2024-08-31T05:13:30.422 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-08-31T05:13:30.448 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-31T05:13:30.543 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881348 branch: wip-mchangir-testing-20240828.085847-main-debug description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/suites/dbench}} email: mchangir@redhat.com first_in_suite: false job_id: '7881348' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-mchangir-testing-20240828.085847-main-debug ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug cephsqlite: 20 mgr/snap_schedule/allow_m_granularity: true mgr/snap_schedule/dump_on_update: true mgr/snap_schedule/log_level: debug mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: global: ms die on skipped message: false mds: mds_bal_replicate_threshold: 1 mds_export_ephemeral_random_max: 0.1 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request mgr-modules: - snap_schedule sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount install: ceph: flavor: default sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=crc - nowsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-mchangir-testing-20240828.085847-main-debug sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 owner: scheduled_mchangir@teuthology priority: 150 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 5413 sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 sleep_before_teardown: 0 subset: 347/512 suite: fs suite_branch: wip-mchangir-testing-20240828.085847-main-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi005.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPiBCYtfqhhHs3tQJtxFpwtRdUQeNkXie1/r17mjMjBmnPf5FQaWfI7/L6D8Xxtm5mxjREdSreDRqS1ya/VHUXc= smithi050.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBHY9neOQmbQCiPzvWkWiC8oHfAGNz26jFbqz5PylD0Y9XEmMPrHOl4Y3Y8MhLG1wlRAAWIhA2lRJntJiOsIzds= smithi070.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLUjo+mPlbAj7030zWPVQlrBHPRnq0Bh9iX3z0VtHXR0lVn/WL2YVhyRWWoZ+suwBDgh4qD0DCrIV+Lc+ZPvXlE= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - suites/dbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-08-30_08:30:37 tube: smithi user: mchangir verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-08-31T05:13:30.543 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa; will attempt to use it 2024-08-31T05:13:30.544 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks 2024-08-31T05:13:30.544 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-08-31T05:13:30.545 INFO:teuthology.task.internal:Checking packages... 2024-08-31T05:13:30.566 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd19e6118f7015f0047264006cb0c873528eb3ae6' 2024-08-31T05:13:30.566 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-31T05:13:30.566 INFO:teuthology.packaging:ref: None 2024-08-31T05:13:30.566 INFO:teuthology.packaging:tag: None 2024-08-31T05:13:30.566 INFO:teuthology.packaging:branch: wip-mchangir-testing-20240828.085847-main-debug 2024-08-31T05:13:30.566 INFO:teuthology.packaging:sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T05:13:30.567 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-mchangir-testing-20240828.085847-main-debug 2024-08-31T05:13:30.711 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4560.gd19e6118 2024-08-31T05:13:30.712 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-08-31T05:13:30.719 INFO:teuthology.task.internal:no buildpackages task found 2024-08-31T05:13:30.719 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-08-31T05:13:30.831 INFO:teuthology.task.internal:Saving configuration 2024-08-31T05:13:30.850 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-08-31T05:13:30.903 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-08-31T05:13:30.928 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi005.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881348', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-31 05:08:39.915873', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPiBCYtfqhhHs3tQJtxFpwtRdUQeNkXie1/r17mjMjBmnPf5FQaWfI7/L6D8Xxtm5mxjREdSreDRqS1ya/VHUXc='} 2024-08-31T05:13:30.948 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi050.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881348', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-31 05:08:39.914426', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBHY9neOQmbQCiPzvWkWiC8oHfAGNz26jFbqz5PylD0Y9XEmMPrHOl4Y3Y8MhLG1wlRAAWIhA2lRJntJiOsIzds='} 2024-08-31T05:13:30.971 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi070.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881348', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-31 05:08:39.912799', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLUjo+mPlbAj7030zWPVQlrBHPRnq0Bh9iX3z0VtHXR0lVn/WL2YVhyRWWoZ+suwBDgh4qD0DCrIV+Lc+ZPvXlE='} 2024-08-31T05:13:30.971 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-08-31T05:13:30.977 INFO:teuthology.task.internal:roles: ubuntu@smithi005.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-08-31T05:13:30.977 INFO:teuthology.task.internal:roles: ubuntu@smithi050.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-08-31T05:13:30.977 INFO:teuthology.task.internal:roles: ubuntu@smithi070.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-08-31T05:13:30.977 INFO:teuthology.run_tasks:Running task console_log... 2024-08-31T05:13:31.118 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3caecafac0>, signals=[15]) 2024-08-31T05:13:31.118 INFO:teuthology.run_tasks:Running task internal.connect... 2024-08-31T05:13:31.135 INFO:teuthology.task.internal:Opening connections... 2024-08-31T05:13:31.135 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi005.front.sepia.ceph.com 2024-08-31T05:13:31.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T05:13:31.212 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi050.front.sepia.ceph.com 2024-08-31T05:13:31.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T05:13:31.285 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi070.front.sepia.ceph.com 2024-08-31T05:13:31.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T05:13:31.359 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-08-31T05:13:31.365 DEBUG:teuthology.orchestra.run.smithi005:> uname -m 2024-08-31T05:13:31.383 INFO:teuthology.orchestra.run.smithi005.stdout:x86_64 2024-08-31T05:13:31.384 DEBUG:teuthology.orchestra.run.smithi005:> cat /etc/os-release 2024-08-31T05:13:31.441 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="CentOS Stream" 2024-08-31T05:13:31.441 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="9" 2024-08-31T05:13:31.441 INFO:teuthology.orchestra.run.smithi005.stdout:ID="centos" 2024-08-31T05:13:31.441 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE="rhel fedora" 2024-08-31T05:13:31.441 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="9" 2024-08-31T05:13:31.441 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM_ID="platform:el9" 2024-08-31T05:13:31.441 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-31T05:13:31.441 INFO:teuthology.orchestra.run.smithi005.stdout:ANSI_COLOR="0;31" 2024-08-31T05:13:31.442 INFO:teuthology.orchestra.run.smithi005.stdout:LOGO="fedora-logo-icon" 2024-08-31T05:13:31.442 INFO:teuthology.orchestra.run.smithi005.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-31T05:13:31.442 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://centos.org/" 2024-08-31T05:13:31.442 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-31T05:13:31.442 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-31T05:13:31.442 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-31T05:13:31.442 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2024-08-31T05:13:31.462 DEBUG:teuthology.orchestra.run.smithi050:> uname -m 2024-08-31T05:13:31.480 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64 2024-08-31T05:13:31.481 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release 2024-08-31T05:13:31.537 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="CentOS Stream" 2024-08-31T05:13:31.537 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="9" 2024-08-31T05:13:31.537 INFO:teuthology.orchestra.run.smithi050.stdout:ID="centos" 2024-08-31T05:13:31.537 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="rhel fedora" 2024-08-31T05:13:31.537 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="9" 2024-08-31T05:13:31.537 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el9" 2024-08-31T05:13:31.538 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-31T05:13:31.538 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31" 2024-08-31T05:13:31.538 INFO:teuthology.orchestra.run.smithi050.stdout:LOGO="fedora-logo-icon" 2024-08-31T05:13:31.538 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-31T05:13:31.538 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://centos.org/" 2024-08-31T05:13:31.538 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-31T05:13:31.538 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-31T05:13:31.538 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-31T05:13:31.538 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2024-08-31T05:13:31.562 DEBUG:teuthology.orchestra.run.smithi070:> uname -m 2024-08-31T05:13:31.580 INFO:teuthology.orchestra.run.smithi070.stdout:x86_64 2024-08-31T05:13:31.581 DEBUG:teuthology.orchestra.run.smithi070:> cat /etc/os-release 2024-08-31T05:13:31.639 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="CentOS Stream" 2024-08-31T05:13:31.639 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="9" 2024-08-31T05:13:31.639 INFO:teuthology.orchestra.run.smithi070.stdout:ID="centos" 2024-08-31T05:13:31.639 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE="rhel fedora" 2024-08-31T05:13:31.639 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="9" 2024-08-31T05:13:31.639 INFO:teuthology.orchestra.run.smithi070.stdout:PLATFORM_ID="platform:el9" 2024-08-31T05:13:31.639 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-31T05:13:31.639 INFO:teuthology.orchestra.run.smithi070.stdout:ANSI_COLOR="0;31" 2024-08-31T05:13:31.639 INFO:teuthology.orchestra.run.smithi070.stdout:LOGO="fedora-logo-icon" 2024-08-31T05:13:31.639 INFO:teuthology.orchestra.run.smithi070.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-31T05:13:31.639 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://centos.org/" 2024-08-31T05:13:31.640 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-31T05:13:31.640 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-31T05:13:31.640 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-31T05:13:31.640 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server 2024-08-31T05:13:31.662 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-08-31T05:13:31.672 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-08-31T05:13:31.754 INFO:teuthology.task.internal:Checking for old test directory... 2024-08-31T05:13:31.754 DEBUG:teuthology.orchestra.run.smithi005:> test '!' -e /home/ubuntu/cephtest 2024-08-31T05:13:31.756 DEBUG:teuthology.orchestra.run.smithi050:> test '!' -e /home/ubuntu/cephtest 2024-08-31T05:13:31.759 DEBUG:teuthology.orchestra.run.smithi070:> test '!' -e /home/ubuntu/cephtest 2024-08-31T05:13:31.775 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-08-31T05:13:31.794 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-08-31T05:13:31.795 DEBUG:teuthology.orchestra.run.smithi005:> test -z $(ls -A /var/lib/ceph) 2024-08-31T05:13:31.814 DEBUG:teuthology.orchestra.run.smithi050:> test -z $(ls -A /var/lib/ceph) 2024-08-31T05:13:31.816 DEBUG:teuthology.orchestra.run.smithi070:> test -z $(ls -A /var/lib/ceph) 2024-08-31T05:13:31.920 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-08-31T05:13:31.984 INFO:teuthology.run_tasks:Running task kernel... 2024-08-31T05:13:31.997 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-08-31T05:13:31.998 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-08-31T05:13:31.998 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-08-31T05:13:31.998 DEBUG:teuthology.orchestra.run.smithi005:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-31T05:13:32.015 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T05:13:32.015 DEBUG:teuthology.orchestra.run.smithi005:> uname -r 2024-08-31T05:13:32.072 INFO:teuthology.orchestra.run.smithi005.stdout:5.14.0-503.el9.x86_64 2024-08-31T05:13:32.073 INFO:teuthology.task.kernel:Running kernel on smithi005: 5.14.0-503.el9.x86_64 2024-08-31T05:13:32.073 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum install -y kernel 2024-08-31T05:13:34.714 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - BaseOS 8.6 MB/s | 8.2 MB 00:00 2024-08-31T05:13:39.439 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - AppStream 5.7 MB/s | 20 MB 00:03 2024-08-31T05:13:44.840 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - CRB 4.6 MB/s | 6.6 MB 00:01 2024-08-31T05:13:46.490 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - Extras packages 47 kB/s | 18 kB 00:00 2024-08-31T05:13:47.711 INFO:teuthology.orchestra.run.smithi005.stdout:Extra Packages for Enterprise Linux 21 MB/s | 22 MB 00:01 2024-08-31T05:13:53.225 INFO:teuthology.orchestra.run.smithi005.stdout:lab-extras 39 kB/s | 1.7 kB 00:00 2024-08-31T05:13:55.407 INFO:teuthology.orchestra.run.smithi005.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-08-31T05:13:55.407 INFO:teuthology.orchestra.run.smithi005.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-08-31T05:13:55.492 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-08-31T05:13:55.493 INFO:teuthology.orchestra.run.smithi005.stdout:Nothing to do. 2024-08-31T05:13:55.493 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-08-31T05:13:55.635 DEBUG:teuthology.orchestra.run.smithi005:> echo no | sudo yum reinstall kernel || true 2024-08-31T05:13:56.227 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:00:03 ago on Sat 31 Aug 2024 05:13:53 AM UTC. 2024-08-31T05:13:56.381 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-08-31T05:13:56.386 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-08-31T05:13:56.386 INFO:teuthology.orchestra.run.smithi005.stdout: Package Architecture Version Repository Size 2024-08-31T05:13:56.386 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-08-31T05:13:56.386 INFO:teuthology.orchestra.run.smithi005.stdout:Reinstalling: 2024-08-31T05:13:56.386 INFO:teuthology.orchestra.run.smithi005.stdout: kernel x86_64 5.14.0-503.el9 baseos 1.9 M 2024-08-31T05:13:56.386 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:13:56.386 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-08-31T05:13:56.386 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-08-31T05:13:56.386 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:13:56.386 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 1.9 M 2024-08-31T05:13:56.386 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 0 2024-08-31T05:13:56.387 INFO:teuthology.orchestra.run.smithi005.stderr:Operation aborted. 2024-08-31T05:13:56.455 INFO:teuthology.orchestra.run.smithi005.stdout:Is this ok [y/N]: 2024-08-31T05:13:56.455 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum reinstall -y kernel || true 2024-08-31T05:13:57.004 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:00:04 ago on Sat 31 Aug 2024 05:13:53 AM UTC. 2024-08-31T05:13:57.135 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-08-31T05:13:57.136 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-08-31T05:13:57.136 INFO:teuthology.orchestra.run.smithi005.stdout: Package Architecture Version Repository Size 2024-08-31T05:13:57.136 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-08-31T05:13:57.137 INFO:teuthology.orchestra.run.smithi005.stdout:Reinstalling: 2024-08-31T05:13:57.137 INFO:teuthology.orchestra.run.smithi005.stdout: kernel x86_64 5.14.0-503.el9 baseos 1.9 M 2024-08-31T05:13:57.137 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:13:57.137 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-08-31T05:13:57.137 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-08-31T05:13:57.137 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:13:57.137 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 1.9 M 2024-08-31T05:13:57.137 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 0 2024-08-31T05:13:57.137 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-08-31T05:13:57.402 INFO:teuthology.orchestra.run.smithi005.stdout:kernel-5.14.0-503.el9.x86_64.rpm 9.3 MB/s | 1.9 MB 00:00 2024-08-31T05:13:57.402 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-08-31T05:13:57.402 INFO:teuthology.orchestra.run.smithi005.stdout:Total 7.1 MB/s | 1.9 MB 00:00 2024-08-31T05:13:57.435 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-08-31T05:13:57.674 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-08-31T05:13:57.675 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-08-31T05:13:57.706 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-08-31T05:13:57.707 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-08-31T05:13:57.888 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-08-31T05:13:57.979 INFO:teuthology.orchestra.run.smithi005.stdout: Reinstalling : kernel-5.14.0-503.el9.x86_64 1/2 2024-08-31T05:13:57.980 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : kernel-5.14.0-503.el9.x86_64 2/2 2024-08-31T05:13:58.680 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: kernel-5.14.0-503.el9.x86_64 2/2 2024-08-31T05:13:58.681 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : kernel-5.14.0-503.el9.x86_64 1/2 2024-08-31T05:13:59.434 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : kernel-5.14.0-503.el9.x86_64 2/2 2024-08-31T05:13:59.434 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:13:59.434 INFO:teuthology.orchestra.run.smithi005.stdout:Reinstalled: 2024-08-31T05:13:59.434 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-5.14.0-503.el9.x86_64 2024-08-31T05:13:59.435 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:13:59.435 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-08-31T05:13:59.632 DEBUG:teuthology.orchestra.run.smithi005:> rpm -q kernel | sort -rV | head -n 1 2024-08-31T05:13:59.690 INFO:teuthology.orchestra.run.smithi005.stdout:kernel-5.14.0-503.el9.x86_64 2024-08-31T05:13:59.691 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-503.el9.x86_64 2024-08-31T05:13:59.691 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-08-31T05:13:59.691 DEBUG:teuthology.parallel:result is None 2024-08-31T05:13:59.691 INFO:teuthology.run_tasks:Running task internal.base... 2024-08-31T05:13:59.698 INFO:teuthology.task.internal:Creating test directory... 2024-08-31T05:13:59.699 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-31T05:13:59.701 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-31T05:13:59.703 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-31T05:13:59.721 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-08-31T05:13:59.770 INFO:teuthology.run_tasks:Running task internal.archive... 2024-08-31T05:13:59.795 INFO:teuthology.task.internal:Creating archive directory... 2024-08-31T05:13:59.796 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-31T05:13:59.798 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-31T05:13:59.800 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-31T05:13:59.833 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-08-31T05:13:59.879 INFO:teuthology.task.internal:Enabling coredump saving... 2024-08-31T05:13:59.879 DEBUG:teuthology.orchestra.run.smithi050:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-31T05:13:59.895 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T05:13:59.896 DEBUG:teuthology.orchestra.run.smithi070:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-31T05:13:59.912 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T05:13:59.913 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-31T05:13:59.915 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-31T05:13:59.938 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-31T05:13:59.956 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-31T05:13:59.975 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-31T05:13:59.999 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-31T05:14:00.015 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-31T05:14:00.018 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-31T05:14:00.033 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-31T05:14:00.034 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-08-31T05:14:00.041 INFO:teuthology.task.internal:Configuring sudo... 2024-08-31T05:14:00.041 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-31T05:14:00.043 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-31T05:14:00.045 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-31T05:14:00.073 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-08-31T05:14:00.090 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-08-31T05:14:00.090 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-31T05:14:00.107 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-31T05:14:00.113 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-31T05:14:00.130 DEBUG:teuthology.orchestra.run.smithi005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-31T05:14:00.203 DEBUG:teuthology.orchestra.run.smithi005:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-31T05:14:00.251 DEBUG:teuthology.orchestra.run.smithi005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-31T05:14:00.331 DEBUG:teuthology.orchestra.run.smithi005:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-31T05:14:00.372 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-31T05:14:00.373 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-31T05:14:00.437 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-31T05:14:00.479 DEBUG:teuthology.orchestra.run.smithi050:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-31T05:14:00.530 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-31T05:14:00.614 DEBUG:teuthology.orchestra.run.smithi050:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-31T05:14:00.656 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-08-31T05:14:00.657 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-31T05:14:00.724 DEBUG:teuthology.orchestra.run.smithi070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-31T05:14:00.773 DEBUG:teuthology.orchestra.run.smithi070:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-31T05:14:00.827 DEBUG:teuthology.orchestra.run.smithi070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-31T05:14:00.913 DEBUG:teuthology.orchestra.run.smithi070:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-31T05:14:00.955 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-08-31T05:14:00.955 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-31T05:14:01.022 DEBUG:teuthology.orchestra.run.smithi005:> sudo service rsyslog restart 2024-08-31T05:14:01.024 DEBUG:teuthology.orchestra.run.smithi050:> sudo service rsyslog restart 2024-08-31T05:14:01.026 DEBUG:teuthology.orchestra.run.smithi070:> sudo service rsyslog restart 2024-08-31T05:14:01.060 INFO:teuthology.orchestra.run.smithi005.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-31T05:14:01.077 INFO:teuthology.orchestra.run.smithi050.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-31T05:14:01.110 INFO:teuthology.orchestra.run.smithi070.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-31T05:14:01.505 INFO:teuthology.run_tasks:Running task internal.timer... 2024-08-31T05:14:01.512 INFO:teuthology.task.internal:Starting timer... 2024-08-31T05:14:01.512 INFO:teuthology.run_tasks:Running task pcp... 2024-08-31T05:14:01.614 INFO:teuthology.run_tasks:Running task selinux... 2024-08-31T05:14:01.715 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-08-31T05:14:01.715 DEBUG:teuthology.orchestra.run.smithi005:> sudo service auditd rotate 2024-08-31T05:14:01.766 INFO:teuthology.orchestra.run.smithi005.stdout:Rotating logs: 2024-08-31T05:14:01.768 DEBUG:teuthology.orchestra.run.smithi050:> sudo service auditd rotate 2024-08-31T05:14:01.822 INFO:teuthology.orchestra.run.smithi050.stdout:Rotating logs: 2024-08-31T05:14:01.824 DEBUG:teuthology.orchestra.run.smithi070:> sudo service auditd rotate 2024-08-31T05:14:01.876 INFO:teuthology.orchestra.run.smithi070.stdout:Rotating logs: 2024-08-31T05:14:01.878 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-08-31T05:14:01.878 DEBUG:teuthology.orchestra.run.smithi005:> /usr/sbin/getenforce 2024-08-31T05:14:01.896 INFO:teuthology.orchestra.run.smithi005.stdout:Permissive 2024-08-31T05:14:01.896 DEBUG:teuthology.orchestra.run.smithi050:> /usr/sbin/getenforce 2024-08-31T05:14:01.914 INFO:teuthology.orchestra.run.smithi050.stdout:Permissive 2024-08-31T05:14:01.915 DEBUG:teuthology.orchestra.run.smithi070:> /usr/sbin/getenforce 2024-08-31T05:14:01.938 INFO:teuthology.orchestra.run.smithi070.stdout:Permissive 2024-08-31T05:14:01.938 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi005.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi050.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi070.front.sepia.ceph.com': 'permissive'} 2024-08-31T05:14:01.938 DEBUG:teuthology.orchestra.run.smithi005:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-31T05:14:01.963 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T05:14:01.964 DEBUG:teuthology.orchestra.run.smithi050:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-31T05:14:01.990 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T05:14:01.990 DEBUG:teuthology.orchestra.run.smithi070:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-31T05:14:02.018 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T05:14:02.018 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-08-31T05:14:02.018 DEBUG:teuthology.orchestra.run.smithi005:> sudo /usr/sbin/setenforce permissive 2024-08-31T05:14:02.046 DEBUG:teuthology.orchestra.run.smithi050:> sudo /usr/sbin/setenforce permissive 2024-08-31T05:14:02.079 DEBUG:teuthology.orchestra.run.smithi070:> sudo /usr/sbin/setenforce permissive 2024-08-31T05:14:02.108 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-08-31T05:14:02.117 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-08-31T05:14:02.120 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-08-31T05:14:02.232 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-08-31T05:14:02.241 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-08-31T05:14:02.242 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi005.front.sepia.ceph.com,smithi050.front.sepia.ceph.com,smithi070.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-08-31T05:16:15.396 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi005.front.sepia.ceph.com'), Remote(name='ubuntu@smithi050.front.sepia.ceph.com'), Remote(name='ubuntu@smithi070.front.sepia.ceph.com')] 2024-08-31T05:16:15.398 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-08-31T05:16:15.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T05:16:15.476 DEBUG:teuthology.orchestra.run.smithi005:> true 2024-08-31T05:16:15.552 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-08-31T05:16:15.552 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-08-31T05:16:15.553 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T05:16:15.627 DEBUG:teuthology.orchestra.run.smithi050:> true 2024-08-31T05:16:15.709 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-08-31T05:16:15.709 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-08-31T05:16:15.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T05:16:15.783 DEBUG:teuthology.orchestra.run.smithi070:> true 2024-08-31T05:16:15.860 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-08-31T05:16:15.860 INFO:teuthology.run_tasks:Running task clock... 2024-08-31T05:16:15.871 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-08-31T05:16:15.871 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-31T05:16:15.872 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-31T05:16:15.874 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-31T05:16:15.874 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-31T05:16:15.876 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-31T05:16:15.876 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-31T05:16:15.901 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-31T05:16:15.906 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-31T05:16:15.916 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-31T05:16:15.922 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-31T05:16:15.929 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-31T05:16:15.941 INFO:teuthology.orchestra.run.smithi005.stderr:sudo: ntpd: command not found 2024-08-31T05:16:15.943 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-31T05:16:15.948 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: ntpd: command not found 2024-08-31T05:16:15.952 INFO:teuthology.orchestra.run.smithi005.stdout:506 Cannot talk to daemon 2024-08-31T05:16:15.960 INFO:teuthology.orchestra.run.smithi050.stdout:506 Cannot talk to daemon 2024-08-31T05:16:15.966 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-31T05:16:15.968 INFO:teuthology.orchestra.run.smithi070.stderr:sudo: ntpd: command not found 2024-08-31T05:16:15.975 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-31T05:16:15.979 INFO:teuthology.orchestra.run.smithi070.stdout:506 Cannot talk to daemon 2024-08-31T05:16:15.980 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-31T05:16:15.991 INFO:teuthology.orchestra.run.smithi050.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-31T05:16:15.993 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-31T05:16:16.007 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-31T05:16:16.038 INFO:teuthology.orchestra.run.smithi005.stderr:bash: line 1: ntpq: command not found 2024-08-31T05:16:16.041 INFO:teuthology.orchestra.run.smithi005.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-31T05:16:16.041 INFO:teuthology.orchestra.run.smithi005.stdout:=============================================================================== 2024-08-31T05:16:16.041 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T05:16:16.041 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T05:16:16.041 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T05:16:16.042 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T05:16:16.050 INFO:teuthology.orchestra.run.smithi050.stderr:bash: line 1: ntpq: command not found 2024-08-31T05:16:16.053 INFO:teuthology.orchestra.run.smithi050.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-31T05:16:16.053 INFO:teuthology.orchestra.run.smithi050.stdout:=============================================================================== 2024-08-31T05:16:16.054 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T05:16:16.054 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T05:16:16.054 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T05:16:16.054 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T05:16:16.063 INFO:teuthology.orchestra.run.smithi070.stderr:bash: line 1: ntpq: command not found 2024-08-31T05:16:16.067 INFO:teuthology.orchestra.run.smithi070.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-31T05:16:16.067 INFO:teuthology.orchestra.run.smithi070.stdout:=============================================================================== 2024-08-31T05:16:16.067 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T05:16:16.067 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T05:16:16.067 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T05:16:16.067 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T05:16:16.068 INFO:teuthology.run_tasks:Running task install... 2024-08-31T05:16:16.079 DEBUG:teuthology.task.install:project ceph 2024-08-31T05:16:16.080 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6'}} 2024-08-31T05:16:16.080 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6'} 2024-08-31T05:16:16.080 INFO:teuthology.task.install:Using flavor: default 2024-08-31T05:16:16.085 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-08-31T05:16:16.085 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-08-31T05:16:16.086 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6', 'tag': None, 'wait_for_package': False} 2024-08-31T05:16:16.086 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T05:16:16.089 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6', 'tag': None, 'wait_for_package': False} 2024-08-31T05:16:16.089 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T05:16:16.090 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6', 'tag': None, 'wait_for_package': False} 2024-08-31T05:16:16.090 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T05:16:16.232 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/ 2024-08-31T05:16:16.232 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4560.gd19e6118 2024-08-31T05:16:16.243 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/ 2024-08-31T05:16:16.243 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4560.gd19e6118 2024-08-31T05:16:16.264 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/ 2024-08-31T05:16:16.265 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4560.gd19e6118 2024-08-31T05:16:16.341 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-31T05:16:16.341 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-31T05:16:16.341 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-31T05:16:16.352 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-31T05:16:16.352 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-08-31T05:16:16.352 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-31T05:16:16.367 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-08-31T05:16:16.367 DEBUG:teuthology.orchestra.run.smithi005:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d19e6118f7015f0047264006cb0c873528eb3ae6/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-31T05:16:16.369 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-31T05:16:16.369 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-08-31T05:16:16.369 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-31T05:16:16.378 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-08-31T05:16:16.378 DEBUG:teuthology.orchestra.run.smithi070:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d19e6118f7015f0047264006cb0c873528eb3ae6/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-31T05:16:16.395 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-08-31T05:16:16.395 DEBUG:teuthology.orchestra.run.smithi050:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d19e6118f7015f0047264006cb0c873528eb3ae6/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-31T05:16:16.433 DEBUG:teuthology.orchestra.run.smithi005:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-31T05:16:16.444 DEBUG:teuthology.orchestra.run.smithi070:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-31T05:16:16.460 DEBUG:teuthology.orchestra.run.smithi050:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-31T05:16:16.508 DEBUG:teuthology.orchestra.run.smithi005:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-31T05:16:16.519 DEBUG:teuthology.orchestra.run.smithi070:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-31T05:16:16.534 DEBUG:teuthology.orchestra.run.smithi050:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-31T05:16:16.572 INFO:teuthology.orchestra.run.smithi005.stdout:check_obsoletes = 1 2024-08-31T05:16:16.573 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum clean all 2024-08-31T05:16:16.583 INFO:teuthology.orchestra.run.smithi070.stdout:check_obsoletes = 1 2024-08-31T05:16:16.585 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum clean all 2024-08-31T05:16:16.598 INFO:teuthology.orchestra.run.smithi050.stdout:check_obsoletes = 1 2024-08-31T05:16:16.599 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum clean all 2024-08-31T05:16:16.803 INFO:teuthology.orchestra.run.smithi005.stdout:45 files removed 2024-08-31T05:16:16.808 INFO:teuthology.orchestra.run.smithi070.stdout:45 files removed 2024-08-31T05:16:16.829 INFO:teuthology.orchestra.run.smithi050.stdout:45 files removed 2024-08-31T05:16:16.830 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-08-31T05:16:16.834 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-08-31T05:16:16.857 DEBUG:teuthology.orchestra.run.smithi050:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-08-31T05:16:17.381 INFO:teuthology.orchestra.run.smithi005.stdout:ceph packages for x86_64 316 kB/s | 84 kB 00:00 2024-08-31T05:16:17.381 INFO:teuthology.orchestra.run.smithi070.stdout:ceph packages for x86_64 312 kB/s | 84 kB 00:00 2024-08-31T05:16:17.436 INFO:teuthology.orchestra.run.smithi050.stdout:ceph packages for x86_64 284 kB/s | 84 kB 00:00 2024-08-31T05:16:17.665 INFO:teuthology.orchestra.run.smithi070.stdout:ceph noarch packages 100 kB/s | 24 kB 00:00 2024-08-31T05:16:17.681 INFO:teuthology.orchestra.run.smithi005.stdout:ceph noarch packages 95 kB/s | 24 kB 00:00 2024-08-31T05:16:17.720 INFO:teuthology.orchestra.run.smithi050.stdout:ceph noarch packages 101 kB/s | 24 kB 00:00 2024-08-31T05:16:17.940 INFO:teuthology.orchestra.run.smithi070.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-08-31T05:16:17.957 INFO:teuthology.orchestra.run.smithi005.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-08-31T05:16:17.995 INFO:teuthology.orchestra.run.smithi050.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-08-31T05:16:18.690 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-08-31T05:16:19.771 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - BaseOS 4.7 MB/s | 8.2 MB 00:01 2024-08-31T05:16:19.890 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - BaseOS 4.3 MB/s | 8.2 MB 00:01 2024-08-31T05:16:22.200 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - AppStream 8.7 MB/s | 20 MB 00:02 2024-08-31T05:16:22.723 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - AppStream 11 MB/s | 20 MB 00:01 2024-08-31T05:16:23.200 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - AppStream 9.5 MB/s | 20 MB 00:02 2024-08-31T05:16:27.590 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - CRB 7.5 MB/s | 6.6 MB 00:00 2024-08-31T05:16:27.792 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - CRB 3.7 MB/s | 6.6 MB 00:01 2024-08-31T05:16:28.817 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 6.6 MB 00:01 2024-08-31T05:16:29.116 INFO:teuthology.orchestra.run.smithi050.stdout:CentOS Stream 9 - Extras packages 71 kB/s | 18 kB 00:00 2024-08-31T05:16:29.342 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - Extras packages 55 kB/s | 18 kB 00:00 2024-08-31T05:16:30.087 INFO:teuthology.orchestra.run.smithi050.stdout:Extra Packages for Enterprise Linux 27 MB/s | 22 MB 00:00 2024-08-31T05:16:30.463 INFO:teuthology.orchestra.run.smithi070.stdout:Extra Packages for Enterprise Linux 23 MB/s | 22 MB 00:00 2024-08-31T05:16:31.110 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 18 kB 00:01 2024-08-31T05:16:32.130 INFO:teuthology.orchestra.run.smithi005.stdout:Extra Packages for Enterprise Linux 25 MB/s | 22 MB 00:00 2024-08-31T05:16:35.710 INFO:teuthology.orchestra.run.smithi050.stdout:lab-extras 36 kB/s | 1.7 kB 00:00 2024-08-31T05:16:35.844 INFO:teuthology.orchestra.run.smithi070.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-08-31T05:16:37.678 INFO:teuthology.orchestra.run.smithi005.stdout:lab-extras 23 kB/s | 1.7 kB 00:00 2024-08-31T05:16:38.087 INFO:teuthology.orchestra.run.smithi050.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-31T05:16:38.088 INFO:teuthology.orchestra.run.smithi050.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-31T05:16:38.100 INFO:teuthology.orchestra.run.smithi050.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-08-31T05:16:38.100 INFO:teuthology.orchestra.run.smithi050.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-31T05:16:38.101 INFO:teuthology.orchestra.run.smithi050.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-08-31T05:16:38.102 INFO:teuthology.orchestra.run.smithi050.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-31T05:16:38.104 INFO:teuthology.orchestra.run.smithi050.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-31T05:16:38.106 INFO:teuthology.orchestra.run.smithi050.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-31T05:16:38.107 INFO:teuthology.orchestra.run.smithi050.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-08-31T05:16:38.156 INFO:teuthology.orchestra.run.smithi070.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-31T05:16:38.157 INFO:teuthology.orchestra.run.smithi070.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-31T05:16:38.168 INFO:teuthology.orchestra.run.smithi070.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-08-31T05:16:38.169 INFO:teuthology.orchestra.run.smithi070.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-31T05:16:38.170 INFO:teuthology.orchestra.run.smithi070.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-08-31T05:16:38.170 INFO:teuthology.orchestra.run.smithi050.stdout:Dependencies resolved. 2024-08-31T05:16:38.171 INFO:teuthology.orchestra.run.smithi070.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-31T05:16:38.172 INFO:teuthology.orchestra.run.smithi070.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-31T05:16:38.175 INFO:teuthology.orchestra.run.smithi070.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-31T05:16:38.176 INFO:teuthology.orchestra.run.smithi070.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-08-31T05:16:38.190 INFO:teuthology.orchestra.run.smithi050.stdout:======================================================================================= 2024-08-31T05:16:38.190 INFO:teuthology.orchestra.run.smithi050.stdout: Package Arch Version Repository Size 2024-08-31T05:16:38.190 INFO:teuthology.orchestra.run.smithi050.stdout:======================================================================================= 2024-08-31T05:16:38.190 INFO:teuthology.orchestra.run.smithi050.stdout:Installing: 2024-08-31T05:16:38.190 INFO:teuthology.orchestra.run.smithi050.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-31T05:16:38.190 INFO:teuthology.orchestra.run.smithi050.stdout: ceph x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 6.6 k 2024-08-31T05:16:38.190 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-base x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 5.5 M 2024-08-31T05:16:38.190 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-fuse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 874 k 2024-08-31T05:16:38.191 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 148 k 2024-08-31T05:16:38.191 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 1.5 M 2024-08-31T05:16:38.191 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 154 k 2024-08-31T05:16:38.191 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 14 M 2024-08-31T05:16:38.191 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 7.4 M 2024-08-31T05:16:38.191 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-rook noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 49 k 2024-08-31T05:16:38.191 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-radosgw x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 10 M 2024-08-31T05:16:38.191 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-test x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 44 M 2024-08-31T05:16:38.191 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-volume noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 285 k 2024-08-31T05:16:38.191 INFO:teuthology.orchestra.run.smithi050.stdout: cephadm noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 781 k 2024-08-31T05:16:38.191 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-mirror x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 226 k 2024-08-31T05:16:38.191 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-shell x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 27 k 2024-08-31T05:16:38.191 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-top noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 18 k 2024-08-31T05:16:38.192 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-31T05:16:38.192 INFO:teuthology.orchestra.run.smithi050.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-31T05:16:38.192 INFO:teuthology.orchestra.run.smithi050.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-31T05:16:38.192 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs-devel x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 32 k 2024-08-31T05:16:38.192 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 766 k 2024-08-31T05:16:38.192 INFO:teuthology.orchestra.run.smithi050.stdout: librados-devel x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 127 k 2024-08-31T05:16:38.192 INFO:teuthology.orchestra.run.smithi050.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-31T05:16:38.192 INFO:teuthology.orchestra.run.smithi050.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-08-31T05:16:38.192 INFO:teuthology.orchestra.run.smithi050.stdout: openssl-devel x86_64 1:3.2.2-4.el9 appstream 4.4 M 2024-08-31T05:16:38.192 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-08-31T05:16:38.192 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-08-31T05:16:38.192 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-08-31T05:16:38.193 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cephfs x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 161 k 2024-08-31T05:16:38.193 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rados x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 321 k 2024-08-31T05:16:38.193 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rbd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 305 k 2024-08-31T05:16:38.193 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rgw x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 99 k 2024-08-31T05:16:38.193 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-fuse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 86 k 2024-08-31T05:16:38.193 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-mirror x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.1 M 2024-08-31T05:16:38.193 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-nbd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 170 k 2024-08-31T05:16:38.193 INFO:teuthology.orchestra.run.smithi050.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-08-31T05:16:38.193 INFO:teuthology.orchestra.run.smithi050.stdout:Upgrading: 2024-08-31T05:16:38.193 INFO:teuthology.orchestra.run.smithi050.stdout: librados2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.4 M 2024-08-31T05:16:38.193 INFO:teuthology.orchestra.run.smithi050.stdout: librbd1 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.1 M 2024-08-31T05:16:38.193 INFO:teuthology.orchestra.run.smithi050.stdout:Installing dependencies: 2024-08-31T05:16:38.193 INFO:teuthology.orchestra.run.smithi050.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-31T05:16:38.194 INFO:teuthology.orchestra.run.smithi050.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-31T05:16:38.194 INFO:teuthology.orchestra.run.smithi050.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-31T05:16:38.194 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-common x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 20 M 2024-08-31T05:16:38.194 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 34 k 2024-08-31T05:16:38.194 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mds x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 2.3 M 2024-08-31T05:16:38.194 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 290 k 2024-08-31T05:16:38.194 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mon x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 4.9 M 2024-08-31T05:16:38.194 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-osd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 18 M 2024-08-31T05:16:38.194 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 16 k 2024-08-31T05:16:38.194 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-selinux x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 25 k 2024-08-31T05:16:38.194 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-31T05:16:38.194 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-31T05:16:38.194 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-31T05:16:38.195 INFO:teuthology.orchestra.run.smithi050.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-31T05:16:38.195 INFO:teuthology.orchestra.run.smithi050.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-31T05:16:38.195 INFO:teuthology.orchestra.run.smithi050.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-31T05:16:38.195 INFO:teuthology.orchestra.run.smithi050.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-31T05:16:38.195 INFO:teuthology.orchestra.run.smithi050.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-31T05:16:38.195 INFO:teuthology.orchestra.run.smithi050.stdout: libcephsqlite x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 159 k 2024-08-31T05:16:38.195 INFO:teuthology.orchestra.run.smithi050.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-08-31T05:16:38.195 INFO:teuthology.orchestra.run.smithi050.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-31T05:16:38.195 INFO:teuthology.orchestra.run.smithi050.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-31T05:16:38.195 INFO:teuthology.orchestra.run.smithi050.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-08-31T05:16:38.195 INFO:teuthology.orchestra.run.smithi050.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-31T05:16:38.195 INFO:teuthology.orchestra.run.smithi050.stdout: libradosstriper1 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 506 k 2024-08-31T05:16:38.196 INFO:teuthology.orchestra.run.smithi050.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-31T05:16:38.196 INFO:teuthology.orchestra.run.smithi050.stdout: librgw2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 5.3 M 2024-08-31T05:16:38.196 INFO:teuthology.orchestra.run.smithi050.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-31T05:16:38.196 INFO:teuthology.orchestra.run.smithi050.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-31T05:16:38.196 INFO:teuthology.orchestra.run.smithi050.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-31T05:16:38.196 INFO:teuthology.orchestra.run.smithi050.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-31T05:16:38.196 INFO:teuthology.orchestra.run.smithi050.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-31T05:16:38.196 INFO:teuthology.orchestra.run.smithi050.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-31T05:16:38.196 INFO:teuthology.orchestra.run.smithi050.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-08-31T05:16:38.196 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-08-31T05:16:38.196 INFO:teuthology.orchestra.run.smithi050.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-31T05:16:38.196 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-08-31T05:16:38.196 INFO:teuthology.orchestra.run.smithi050.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-31T05:16:38.197 INFO:teuthology.orchestra.run.smithi050.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-31T05:16:38.197 INFO:teuthology.orchestra.run.smithi050.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-31T05:16:38.197 INFO:teuthology.orchestra.run.smithi050.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-08-31T05:16:38.197 INFO:teuthology.orchestra.run.smithi050.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-31T05:16:38.197 INFO:teuthology.orchestra.run.smithi050.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-31T05:16:38.197 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-31T05:16:38.197 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-argparse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 45 k 2024-08-31T05:16:38.197 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-common x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 141 k 2024-08-31T05:16:38.197 INFO:teuthology.orchestra.run.smithi050.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-31T05:16:38.197 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-31T05:16:38.197 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-31T05:16:38.197 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-31T05:16:38.197 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-08-31T05:16:38.197 INFO:teuthology.orchestra.run.smithi050.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-08-31T05:16:38.198 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-31T05:16:38.198 INFO:teuthology.orchestra.run.smithi050.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-08-31T05:16:38.198 INFO:teuthology.orchestra.run.smithi050.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-08-31T05:16:38.198 INFO:teuthology.orchestra.run.smithi050.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-31T05:16:38.198 INFO:teuthology.orchestra.run.smithi050.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-31T05:16:38.198 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-31T05:16:38.198 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-31T05:16:38.198 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-31T05:16:38.198 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-31T05:16:38.198 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-31T05:16:38.198 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-31T05:16:38.198 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-31T05:16:38.199 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-31T05:16:38.199 INFO:teuthology.orchestra.run.smithi050.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-31T05:16:38.199 INFO:teuthology.orchestra.run.smithi050.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-31T05:16:38.199 INFO:teuthology.orchestra.run.smithi050.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-31T05:16:38.199 INFO:teuthology.orchestra.run.smithi050.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-31T05:16:38.199 INFO:teuthology.orchestra.run.smithi050.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-31T05:16:38.199 INFO:teuthology.orchestra.run.smithi050.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-31T05:16:38.199 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-31T05:16:38.199 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-31T05:16:38.199 INFO:teuthology.orchestra.run.smithi050.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-31T05:16:38.199 INFO:teuthology.orchestra.run.smithi050.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-31T05:16:38.199 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-31T05:16:38.199 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-31T05:16:38.199 INFO:teuthology.orchestra.run.smithi050.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-31T05:16:38.200 INFO:teuthology.orchestra.run.smithi050.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-31T05:16:38.200 INFO:teuthology.orchestra.run.smithi050.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-31T05:16:38.200 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-31T05:16:38.200 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-31T05:16:38.200 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-31T05:16:38.200 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-31T05:16:38.200 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-08-31T05:16:38.200 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-31T05:16:38.200 INFO:teuthology.orchestra.run.smithi050.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-31T05:16:38.200 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-31T05:16:38.200 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-31T05:16:38.200 INFO:teuthology.orchestra.run.smithi050.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-31T05:16:38.200 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-31T05:16:38.201 INFO:teuthology.orchestra.run.smithi050.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-31T05:16:38.201 INFO:teuthology.orchestra.run.smithi050.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-31T05:16:38.201 INFO:teuthology.orchestra.run.smithi050.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-31T05:16:38.201 INFO:teuthology.orchestra.run.smithi050.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-31T05:16:38.201 INFO:teuthology.orchestra.run.smithi050.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-31T05:16:38.201 INFO:teuthology.orchestra.run.smithi050.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-08-31T05:16:38.201 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-08-31T05:16:38.201 INFO:teuthology.orchestra.run.smithi050.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-31T05:16:38.201 INFO:teuthology.orchestra.run.smithi050.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-31T05:16:38.201 INFO:teuthology.orchestra.run.smithi050.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-31T05:16:38.201 INFO:teuthology.orchestra.run.smithi050.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-31T05:16:38.201 INFO:teuthology.orchestra.run.smithi050.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-31T05:16:38.201 INFO:teuthology.orchestra.run.smithi050.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-08-31T05:16:38.201 INFO:teuthology.orchestra.run.smithi050.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-31T05:16:38.202 INFO:teuthology.orchestra.run.smithi050.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-31T05:16:38.202 INFO:teuthology.orchestra.run.smithi050.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-08-31T05:16:38.202 INFO:teuthology.orchestra.run.smithi050.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-31T05:16:38.202 INFO:teuthology.orchestra.run.smithi050.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-31T05:16:38.202 INFO:teuthology.orchestra.run.smithi050.stdout:Installing weak dependencies: 2024-08-31T05:16:38.202 INFO:teuthology.orchestra.run.smithi050.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-31T05:16:38.202 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T05:16:38.202 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction Summary 2024-08-31T05:16:38.202 INFO:teuthology.orchestra.run.smithi050.stdout:======================================================================================= 2024-08-31T05:16:38.202 INFO:teuthology.orchestra.run.smithi050.stdout:Install 148 Packages 2024-08-31T05:16:38.202 INFO:teuthology.orchestra.run.smithi050.stdout:Upgrade 2 Packages 2024-08-31T05:16:38.202 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T05:16:38.203 INFO:teuthology.orchestra.run.smithi050.stdout:Total download size: 224 M 2024-08-31T05:16:38.203 INFO:teuthology.orchestra.run.smithi050.stdout:Downloading Packages: 2024-08-31T05:16:38.236 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-08-31T05:16:38.254 INFO:teuthology.orchestra.run.smithi070.stdout:======================================================================================= 2024-08-31T05:16:38.254 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repository Size 2024-08-31T05:16:38.254 INFO:teuthology.orchestra.run.smithi070.stdout:======================================================================================= 2024-08-31T05:16:38.255 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-08-31T05:16:38.255 INFO:teuthology.orchestra.run.smithi070.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-31T05:16:38.255 INFO:teuthology.orchestra.run.smithi070.stdout: ceph x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 6.6 k 2024-08-31T05:16:38.255 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-base x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 5.5 M 2024-08-31T05:16:38.255 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-fuse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 874 k 2024-08-31T05:16:38.255 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 148 k 2024-08-31T05:16:38.255 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 1.5 M 2024-08-31T05:16:38.255 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 154 k 2024-08-31T05:16:38.255 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 14 M 2024-08-31T05:16:38.255 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 7.4 M 2024-08-31T05:16:38.255 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-rook noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 49 k 2024-08-31T05:16:38.255 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-radosgw x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 10 M 2024-08-31T05:16:38.255 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-test x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 44 M 2024-08-31T05:16:38.255 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-volume noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 285 k 2024-08-31T05:16:38.256 INFO:teuthology.orchestra.run.smithi070.stdout: cephadm noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 781 k 2024-08-31T05:16:38.256 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-mirror x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 226 k 2024-08-31T05:16:38.256 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-shell x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 27 k 2024-08-31T05:16:38.256 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-top noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 18 k 2024-08-31T05:16:38.256 INFO:teuthology.orchestra.run.smithi070.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-31T05:16:38.256 INFO:teuthology.orchestra.run.smithi070.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-31T05:16:38.256 INFO:teuthology.orchestra.run.smithi070.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-31T05:16:38.256 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs-devel x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 32 k 2024-08-31T05:16:38.256 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 766 k 2024-08-31T05:16:38.256 INFO:teuthology.orchestra.run.smithi070.stdout: librados-devel x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 127 k 2024-08-31T05:16:38.256 INFO:teuthology.orchestra.run.smithi070.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-31T05:16:38.256 INFO:teuthology.orchestra.run.smithi070.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-08-31T05:16:38.256 INFO:teuthology.orchestra.run.smithi070.stdout: openssl-devel x86_64 1:3.2.2-4.el9 appstream 4.4 M 2024-08-31T05:16:38.256 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-08-31T05:16:38.257 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-08-31T05:16:38.257 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-08-31T05:16:38.257 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cephfs x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 161 k 2024-08-31T05:16:38.257 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rados x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 321 k 2024-08-31T05:16:38.257 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rbd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 305 k 2024-08-31T05:16:38.257 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rgw x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 99 k 2024-08-31T05:16:38.257 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-fuse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 86 k 2024-08-31T05:16:38.257 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-mirror x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.1 M 2024-08-31T05:16:38.257 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-nbd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 170 k 2024-08-31T05:16:38.257 INFO:teuthology.orchestra.run.smithi070.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-08-31T05:16:38.257 INFO:teuthology.orchestra.run.smithi070.stdout:Upgrading: 2024-08-31T05:16:38.257 INFO:teuthology.orchestra.run.smithi070.stdout: librados2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.4 M 2024-08-31T05:16:38.257 INFO:teuthology.orchestra.run.smithi070.stdout: librbd1 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.1 M 2024-08-31T05:16:38.257 INFO:teuthology.orchestra.run.smithi070.stdout:Installing dependencies: 2024-08-31T05:16:38.258 INFO:teuthology.orchestra.run.smithi070.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-31T05:16:38.258 INFO:teuthology.orchestra.run.smithi070.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-31T05:16:38.258 INFO:teuthology.orchestra.run.smithi070.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-31T05:16:38.258 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-common x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 20 M 2024-08-31T05:16:38.258 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 34 k 2024-08-31T05:16:38.258 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mds x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 2.3 M 2024-08-31T05:16:38.258 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 290 k 2024-08-31T05:16:38.258 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mon x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 4.9 M 2024-08-31T05:16:38.258 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-osd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 18 M 2024-08-31T05:16:38.258 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 16 k 2024-08-31T05:16:38.258 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-selinux x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 25 k 2024-08-31T05:16:38.258 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-31T05:16:38.258 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-31T05:16:38.258 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-31T05:16:38.258 INFO:teuthology.orchestra.run.smithi070.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-31T05:16:38.259 INFO:teuthology.orchestra.run.smithi070.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-31T05:16:38.259 INFO:teuthology.orchestra.run.smithi070.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-31T05:16:38.259 INFO:teuthology.orchestra.run.smithi070.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-31T05:16:38.259 INFO:teuthology.orchestra.run.smithi070.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-31T05:16:38.259 INFO:teuthology.orchestra.run.smithi070.stdout: libcephsqlite x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 159 k 2024-08-31T05:16:38.259 INFO:teuthology.orchestra.run.smithi070.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-08-31T05:16:38.259 INFO:teuthology.orchestra.run.smithi070.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-31T05:16:38.259 INFO:teuthology.orchestra.run.smithi070.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-31T05:16:38.259 INFO:teuthology.orchestra.run.smithi070.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-08-31T05:16:38.259 INFO:teuthology.orchestra.run.smithi070.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-31T05:16:38.259 INFO:teuthology.orchestra.run.smithi070.stdout: libradosstriper1 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 506 k 2024-08-31T05:16:38.259 INFO:teuthology.orchestra.run.smithi070.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-31T05:16:38.259 INFO:teuthology.orchestra.run.smithi070.stdout: librgw2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 5.3 M 2024-08-31T05:16:38.259 INFO:teuthology.orchestra.run.smithi070.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-31T05:16:38.259 INFO:teuthology.orchestra.run.smithi070.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-31T05:16:38.260 INFO:teuthology.orchestra.run.smithi070.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-31T05:16:38.260 INFO:teuthology.orchestra.run.smithi070.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-31T05:16:38.260 INFO:teuthology.orchestra.run.smithi070.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-31T05:16:38.260 INFO:teuthology.orchestra.run.smithi070.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-31T05:16:38.260 INFO:teuthology.orchestra.run.smithi070.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-08-31T05:16:38.260 INFO:teuthology.orchestra.run.smithi070.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-08-31T05:16:38.260 INFO:teuthology.orchestra.run.smithi070.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-31T05:16:38.260 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-08-31T05:16:38.260 INFO:teuthology.orchestra.run.smithi070.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-31T05:16:38.260 INFO:teuthology.orchestra.run.smithi070.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-31T05:16:38.260 INFO:teuthology.orchestra.run.smithi070.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-31T05:16:38.260 INFO:teuthology.orchestra.run.smithi070.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-08-31T05:16:38.261 INFO:teuthology.orchestra.run.smithi070.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-31T05:16:38.261 INFO:teuthology.orchestra.run.smithi070.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-31T05:16:38.261 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-31T05:16:38.261 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-argparse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 45 k 2024-08-31T05:16:38.261 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-common x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 141 k 2024-08-31T05:16:38.261 INFO:teuthology.orchestra.run.smithi070.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-31T05:16:38.261 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-31T05:16:38.261 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-31T05:16:38.261 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-31T05:16:38.261 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-08-31T05:16:38.261 INFO:teuthology.orchestra.run.smithi070.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-08-31T05:16:38.261 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-31T05:16:38.261 INFO:teuthology.orchestra.run.smithi070.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-08-31T05:16:38.262 INFO:teuthology.orchestra.run.smithi070.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-08-31T05:16:38.262 INFO:teuthology.orchestra.run.smithi070.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-31T05:16:38.262 INFO:teuthology.orchestra.run.smithi070.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-31T05:16:38.262 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-31T05:16:38.262 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-31T05:16:38.262 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-31T05:16:38.262 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-31T05:16:38.262 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-31T05:16:38.262 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-31T05:16:38.262 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-31T05:16:38.262 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-31T05:16:38.262 INFO:teuthology.orchestra.run.smithi070.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-31T05:16:38.262 INFO:teuthology.orchestra.run.smithi070.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-31T05:16:38.262 INFO:teuthology.orchestra.run.smithi070.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-31T05:16:38.263 INFO:teuthology.orchestra.run.smithi070.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-31T05:16:38.263 INFO:teuthology.orchestra.run.smithi070.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-31T05:16:38.263 INFO:teuthology.orchestra.run.smithi070.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-31T05:16:38.263 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-31T05:16:38.263 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-31T05:16:38.263 INFO:teuthology.orchestra.run.smithi070.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-31T05:16:38.263 INFO:teuthology.orchestra.run.smithi070.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-31T05:16:38.263 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-31T05:16:38.263 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-31T05:16:38.263 INFO:teuthology.orchestra.run.smithi070.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-31T05:16:38.263 INFO:teuthology.orchestra.run.smithi070.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-31T05:16:38.263 INFO:teuthology.orchestra.run.smithi070.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-31T05:16:38.263 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-31T05:16:38.263 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-31T05:16:38.263 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-31T05:16:38.264 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-31T05:16:38.264 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-08-31T05:16:38.264 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-31T05:16:38.264 INFO:teuthology.orchestra.run.smithi070.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-31T05:16:38.264 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-31T05:16:38.264 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-31T05:16:38.264 INFO:teuthology.orchestra.run.smithi070.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-31T05:16:38.264 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-31T05:16:38.264 INFO:teuthology.orchestra.run.smithi070.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-31T05:16:38.264 INFO:teuthology.orchestra.run.smithi070.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-31T05:16:38.264 INFO:teuthology.orchestra.run.smithi070.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-31T05:16:38.264 INFO:teuthology.orchestra.run.smithi070.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-31T05:16:38.264 INFO:teuthology.orchestra.run.smithi070.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-31T05:16:38.264 INFO:teuthology.orchestra.run.smithi070.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-08-31T05:16:38.264 INFO:teuthology.orchestra.run.smithi070.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-08-31T05:16:38.265 INFO:teuthology.orchestra.run.smithi070.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-31T05:16:38.265 INFO:teuthology.orchestra.run.smithi070.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-31T05:16:38.265 INFO:teuthology.orchestra.run.smithi070.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-31T05:16:38.265 INFO:teuthology.orchestra.run.smithi070.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-31T05:16:38.265 INFO:teuthology.orchestra.run.smithi070.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-31T05:16:38.265 INFO:teuthology.orchestra.run.smithi070.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-08-31T05:16:38.265 INFO:teuthology.orchestra.run.smithi070.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-31T05:16:38.265 INFO:teuthology.orchestra.run.smithi070.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-31T05:16:38.265 INFO:teuthology.orchestra.run.smithi070.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-08-31T05:16:38.265 INFO:teuthology.orchestra.run.smithi070.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-31T05:16:38.265 INFO:teuthology.orchestra.run.smithi070.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-31T05:16:38.265 INFO:teuthology.orchestra.run.smithi070.stdout:Installing weak dependencies: 2024-08-31T05:16:38.265 INFO:teuthology.orchestra.run.smithi070.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-31T05:16:38.265 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-08-31T05:16:38.266 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-08-31T05:16:38.266 INFO:teuthology.orchestra.run.smithi070.stdout:======================================================================================= 2024-08-31T05:16:38.266 INFO:teuthology.orchestra.run.smithi070.stdout:Install 148 Packages 2024-08-31T05:16:38.266 INFO:teuthology.orchestra.run.smithi070.stdout:Upgrade 2 Packages 2024-08-31T05:16:38.266 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-08-31T05:16:38.266 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 224 M 2024-08-31T05:16:38.266 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-08-31T05:16:38.886 INFO:teuthology.orchestra.run.smithi070.stdout:(1/150): ceph-19.3.0-4560.gd19e6118.el9.x86_64. 50 kB/s | 6.6 kB 00:00 2024-08-31T05:16:39.062 INFO:teuthology.orchestra.run.smithi070.stdout:(2/150): ceph-fuse-19.3.0-4560.gd19e6118.el9.x8 4.9 MB/s | 874 kB 00:00 2024-08-31T05:16:39.153 INFO:teuthology.orchestra.run.smithi070.stdout:(3/150): ceph-immutable-object-cache-19.3.0-456 1.6 MB/s | 148 kB 00:00 2024-08-31T05:16:39.237 INFO:teuthology.orchestra.run.smithi070.stdout:(4/150): ceph-base-19.3.0-4560.gd19e6118.el9.x8 11 MB/s | 5.5 MB 00:00 2024-08-31T05:16:39.294 INFO:teuthology.orchestra.run.smithi050.stdout:(1/150): ceph-19.3.0-4560.gd19e6118.el9.x86_64. 33 kB/s | 6.6 kB 00:00 2024-08-31T05:16:39.345 INFO:teuthology.orchestra.run.smithi070.stdout:(5/150): ceph-mgr-19.3.0-4560.gd19e6118.el9.x86 14 MB/s | 1.5 MB 00:00 2024-08-31T05:16:39.396 INFO:teuthology.orchestra.run.smithi070.stdout:(6/150): ceph-mds-19.3.0-4560.gd19e6118.el9.x86 9.4 MB/s | 2.3 MB 00:00 2024-08-31T05:16:39.630 INFO:teuthology.orchestra.run.smithi070.stdout:(7/150): ceph-mon-19.3.0-4560.gd19e6118.el9.x86 17 MB/s | 4.9 MB 00:00 2024-08-31T05:16:39.905 INFO:teuthology.orchestra.run.smithi070.stdout:(8/150): ceph-common-19.3.0-4560.gd19e6118.el9. 17 MB/s | 20 MB 00:01 2024-08-31T05:16:39.955 INFO:teuthology.orchestra.run.smithi070.stdout:(9/150): ceph-selinux-19.3.0-4560.gd19e6118.el9 505 kB/s | 25 kB 00:00 2024-08-31T05:16:39.962 INFO:teuthology.orchestra.run.smithi050.stdout:(2/150): ceph-fuse-19.3.0-4560.gd19e6118.el9.x8 1.3 MB/s | 874 kB 00:00 2024-08-31T05:16:40.032 INFO:teuthology.orchestra.run.smithi005.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-31T05:16:40.032 INFO:teuthology.orchestra.run.smithi005.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-31T05:16:40.047 INFO:teuthology.orchestra.run.smithi005.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-08-31T05:16:40.047 INFO:teuthology.orchestra.run.smithi005.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-31T05:16:40.049 INFO:teuthology.orchestra.run.smithi005.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-08-31T05:16:40.049 INFO:teuthology.orchestra.run.smithi005.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-31T05:16:40.051 INFO:teuthology.orchestra.run.smithi005.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-31T05:16:40.055 INFO:teuthology.orchestra.run.smithi005.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-31T05:16:40.055 INFO:teuthology.orchestra.run.smithi005.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-08-31T05:16:40.121 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-08-31T05:16:40.130 INFO:teuthology.orchestra.run.smithi005.stdout:======================================================================================= 2024-08-31T05:16:40.130 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2024-08-31T05:16:40.130 INFO:teuthology.orchestra.run.smithi005.stdout:======================================================================================= 2024-08-31T05:16:40.130 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-08-31T05:16:40.130 INFO:teuthology.orchestra.run.smithi005.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-31T05:16:40.130 INFO:teuthology.orchestra.run.smithi005.stdout: ceph x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 6.6 k 2024-08-31T05:16:40.130 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-base x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 5.5 M 2024-08-31T05:16:40.130 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-fuse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 874 k 2024-08-31T05:16:40.130 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 148 k 2024-08-31T05:16:40.130 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 1.5 M 2024-08-31T05:16:40.130 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 154 k 2024-08-31T05:16:40.130 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 14 M 2024-08-31T05:16:40.131 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 7.4 M 2024-08-31T05:16:40.131 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-rook noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 49 k 2024-08-31T05:16:40.131 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-radosgw x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 10 M 2024-08-31T05:16:40.131 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-test x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 44 M 2024-08-31T05:16:40.131 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-volume noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 285 k 2024-08-31T05:16:40.131 INFO:teuthology.orchestra.run.smithi005.stdout: cephadm noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 781 k 2024-08-31T05:16:40.131 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-mirror x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 226 k 2024-08-31T05:16:40.131 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-shell x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 27 k 2024-08-31T05:16:40.131 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-top noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 18 k 2024-08-31T05:16:40.131 INFO:teuthology.orchestra.run.smithi005.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-31T05:16:40.131 INFO:teuthology.orchestra.run.smithi005.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-31T05:16:40.131 INFO:teuthology.orchestra.run.smithi005.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-31T05:16:40.131 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs-devel x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 32 k 2024-08-31T05:16:40.131 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 766 k 2024-08-31T05:16:40.132 INFO:teuthology.orchestra.run.smithi005.stdout: librados-devel x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 127 k 2024-08-31T05:16:40.132 INFO:teuthology.orchestra.run.smithi005.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-31T05:16:40.132 INFO:teuthology.orchestra.run.smithi005.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-08-31T05:16:40.132 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-devel x86_64 1:3.2.2-4.el9 appstream 4.4 M 2024-08-31T05:16:40.132 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-08-31T05:16:40.132 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-08-31T05:16:40.132 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-08-31T05:16:40.132 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cephfs x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 161 k 2024-08-31T05:16:40.132 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rados x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 321 k 2024-08-31T05:16:40.132 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rbd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 305 k 2024-08-31T05:16:40.132 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rgw x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 99 k 2024-08-31T05:16:40.132 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-fuse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 86 k 2024-08-31T05:16:40.132 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-mirror x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.1 M 2024-08-31T05:16:40.132 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-nbd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 170 k 2024-08-31T05:16:40.133 INFO:teuthology.orchestra.run.smithi005.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-08-31T05:16:40.133 INFO:teuthology.orchestra.run.smithi005.stdout:Upgrading: 2024-08-31T05:16:40.133 INFO:teuthology.orchestra.run.smithi005.stdout: librados2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.4 M 2024-08-31T05:16:40.133 INFO:teuthology.orchestra.run.smithi005.stdout: librbd1 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.1 M 2024-08-31T05:16:40.133 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2024-08-31T05:16:40.133 INFO:teuthology.orchestra.run.smithi005.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-31T05:16:40.133 INFO:teuthology.orchestra.run.smithi005.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-31T05:16:40.133 INFO:teuthology.orchestra.run.smithi005.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-31T05:16:40.133 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-common x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 20 M 2024-08-31T05:16:40.133 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 34 k 2024-08-31T05:16:40.133 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mds x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 2.3 M 2024-08-31T05:16:40.133 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 290 k 2024-08-31T05:16:40.133 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mon x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 4.9 M 2024-08-31T05:16:40.133 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-osd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 18 M 2024-08-31T05:16:40.134 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 16 k 2024-08-31T05:16:40.134 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-selinux x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 25 k 2024-08-31T05:16:40.134 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-31T05:16:40.134 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-31T05:16:40.134 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-31T05:16:40.134 INFO:teuthology.orchestra.run.smithi005.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-31T05:16:40.134 INFO:teuthology.orchestra.run.smithi005.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-31T05:16:40.134 INFO:teuthology.orchestra.run.smithi005.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-31T05:16:40.134 INFO:teuthology.orchestra.run.smithi005.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-31T05:16:40.134 INFO:teuthology.orchestra.run.smithi005.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-31T05:16:40.134 INFO:teuthology.orchestra.run.smithi005.stdout: libcephsqlite x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 159 k 2024-08-31T05:16:40.134 INFO:teuthology.orchestra.run.smithi005.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-08-31T05:16:40.134 INFO:teuthology.orchestra.run.smithi005.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-31T05:16:40.135 INFO:teuthology.orchestra.run.smithi005.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-31T05:16:40.135 INFO:teuthology.orchestra.run.smithi005.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-08-31T05:16:40.135 INFO:teuthology.orchestra.run.smithi005.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-31T05:16:40.135 INFO:teuthology.orchestra.run.smithi005.stdout: libradosstriper1 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 506 k 2024-08-31T05:16:40.135 INFO:teuthology.orchestra.run.smithi005.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-31T05:16:40.135 INFO:teuthology.orchestra.run.smithi005.stdout: librgw2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 5.3 M 2024-08-31T05:16:40.135 INFO:teuthology.orchestra.run.smithi005.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-31T05:16:40.135 INFO:teuthology.orchestra.run.smithi005.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-31T05:16:40.135 INFO:teuthology.orchestra.run.smithi005.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-31T05:16:40.135 INFO:teuthology.orchestra.run.smithi005.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-31T05:16:40.135 INFO:teuthology.orchestra.run.smithi005.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-31T05:16:40.135 INFO:teuthology.orchestra.run.smithi005.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-31T05:16:40.135 INFO:teuthology.orchestra.run.smithi005.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-08-31T05:16:40.136 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-08-31T05:16:40.136 INFO:teuthology.orchestra.run.smithi005.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-31T05:16:40.136 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-08-31T05:16:40.136 INFO:teuthology.orchestra.run.smithi005.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-31T05:16:40.136 INFO:teuthology.orchestra.run.smithi005.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-31T05:16:40.136 INFO:teuthology.orchestra.run.smithi005.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-31T05:16:40.136 INFO:teuthology.orchestra.run.smithi005.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-08-31T05:16:40.136 INFO:teuthology.orchestra.run.smithi005.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-31T05:16:40.136 INFO:teuthology.orchestra.run.smithi005.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-31T05:16:40.136 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-31T05:16:40.136 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-argparse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 45 k 2024-08-31T05:16:40.136 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-common x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 141 k 2024-08-31T05:16:40.136 INFO:teuthology.orchestra.run.smithi005.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-31T05:16:40.136 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-31T05:16:40.137 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-31T05:16:40.137 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-31T05:16:40.137 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-08-31T05:16:40.137 INFO:teuthology.orchestra.run.smithi005.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-08-31T05:16:40.137 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-31T05:16:40.137 INFO:teuthology.orchestra.run.smithi005.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-08-31T05:16:40.137 INFO:teuthology.orchestra.run.smithi005.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-08-31T05:16:40.137 INFO:teuthology.orchestra.run.smithi005.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-31T05:16:40.137 INFO:teuthology.orchestra.run.smithi005.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-31T05:16:40.137 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-31T05:16:40.137 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-31T05:16:40.137 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-31T05:16:40.137 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-31T05:16:40.137 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-31T05:16:40.138 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-31T05:16:40.138 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-31T05:16:40.138 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-31T05:16:40.138 INFO:teuthology.orchestra.run.smithi005.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-31T05:16:40.138 INFO:teuthology.orchestra.run.smithi005.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-31T05:16:40.138 INFO:teuthology.orchestra.run.smithi005.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-31T05:16:40.138 INFO:teuthology.orchestra.run.smithi005.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-31T05:16:40.138 INFO:teuthology.orchestra.run.smithi005.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-31T05:16:40.139 INFO:teuthology.orchestra.run.smithi005.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-31T05:16:40.139 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-31T05:16:40.139 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-31T05:16:40.139 INFO:teuthology.orchestra.run.smithi005.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-31T05:16:40.139 INFO:teuthology.orchestra.run.smithi005.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-31T05:16:40.139 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-31T05:16:40.139 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-31T05:16:40.139 INFO:teuthology.orchestra.run.smithi005.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-31T05:16:40.139 INFO:teuthology.orchestra.run.smithi005.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-31T05:16:40.139 INFO:teuthology.orchestra.run.smithi005.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-31T05:16:40.139 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-31T05:16:40.139 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-31T05:16:40.139 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-31T05:16:40.139 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-31T05:16:40.140 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-08-31T05:16:40.140 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-31T05:16:40.140 INFO:teuthology.orchestra.run.smithi005.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-31T05:16:40.140 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-31T05:16:40.140 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-31T05:16:40.140 INFO:teuthology.orchestra.run.smithi005.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-31T05:16:40.140 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-31T05:16:40.140 INFO:teuthology.orchestra.run.smithi005.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-31T05:16:40.140 INFO:teuthology.orchestra.run.smithi005.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-31T05:16:40.140 INFO:teuthology.orchestra.run.smithi005.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-31T05:16:40.140 INFO:teuthology.orchestra.run.smithi005.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-31T05:16:40.140 INFO:teuthology.orchestra.run.smithi005.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-31T05:16:40.140 INFO:teuthology.orchestra.run.smithi005.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-08-31T05:16:40.140 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-08-31T05:16:40.141 INFO:teuthology.orchestra.run.smithi005.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-31T05:16:40.141 INFO:teuthology.orchestra.run.smithi005.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-31T05:16:40.141 INFO:teuthology.orchestra.run.smithi005.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-31T05:16:40.141 INFO:teuthology.orchestra.run.smithi005.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-31T05:16:40.141 INFO:teuthology.orchestra.run.smithi005.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-31T05:16:40.141 INFO:teuthology.orchestra.run.smithi005.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-08-31T05:16:40.141 INFO:teuthology.orchestra.run.smithi005.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-31T05:16:40.141 INFO:teuthology.orchestra.run.smithi005.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-31T05:16:40.141 INFO:teuthology.orchestra.run.smithi005.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-08-31T05:16:40.141 INFO:teuthology.orchestra.run.smithi005.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-31T05:16:40.141 INFO:teuthology.orchestra.run.smithi005.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-31T05:16:40.141 INFO:teuthology.orchestra.run.smithi005.stdout:Installing weak dependencies: 2024-08-31T05:16:40.141 INFO:teuthology.orchestra.run.smithi005.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-31T05:16:40.141 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:16:40.142 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-08-31T05:16:40.142 INFO:teuthology.orchestra.run.smithi005.stdout:======================================================================================= 2024-08-31T05:16:40.142 INFO:teuthology.orchestra.run.smithi005.stdout:Install 148 Packages 2024-08-31T05:16:40.142 INFO:teuthology.orchestra.run.smithi005.stdout:Upgrade 2 Packages 2024-08-31T05:16:40.142 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:16:40.142 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 224 M 2024-08-31T05:16:40.142 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-08-31T05:16:40.204 INFO:teuthology.orchestra.run.smithi050.stdout:(3/150): ceph-immutable-object-cache-19.3.0-456 613 kB/s | 148 kB 00:00 2024-08-31T05:16:40.439 INFO:teuthology.orchestra.run.smithi070.stdout:(10/150): ceph-osd-19.3.0-4560.gd19e6118.el9.x8 17 MB/s | 18 MB 00:01 2024-08-31T05:16:40.497 INFO:teuthology.orchestra.run.smithi070.stdout:(11/150): cephfs-mirror-19.3.0-4560.gd19e6118.e 3.8 MB/s | 226 kB 00:00 2024-08-31T05:16:40.529 INFO:teuthology.orchestra.run.smithi050.stdout:(4/150): ceph-base-19.3.0-4560.gd19e6118.el9.x8 3.8 MB/s | 5.5 MB 00:01 2024-08-31T05:16:40.555 INFO:teuthology.orchestra.run.smithi070.stdout:(12/150): cephfs-shell-19.3.0-4560.gd19e6118.el 465 kB/s | 27 kB 00:00 2024-08-31T05:16:40.679 INFO:teuthology.orchestra.run.smithi005.stdout:(1/150): ceph-19.3.0-4560.gd19e6118.el9.x86_64. 32 kB/s | 6.6 kB 00:00 2024-08-31T05:16:40.689 INFO:teuthology.orchestra.run.smithi070.stdout:(13/150): libcephfs-devel-19.3.0-4560.gd19e6118 238 kB/s | 32 kB 00:00 2024-08-31T05:16:40.737 INFO:teuthology.orchestra.run.smithi050.stdout:(5/150): ceph-mgr-19.3.0-4560.gd19e6118.el9.x86 7.3 MB/s | 1.5 MB 00:00 2024-08-31T05:16:40.798 INFO:teuthology.orchestra.run.smithi070.stdout:(14/150): ceph-radosgw-19.3.0-4560.gd19e6118.el 8.9 MB/s | 10 MB 00:01 2024-08-31T05:16:40.831 INFO:teuthology.orchestra.run.smithi070.stdout:(15/150): libcephfs2-19.3.0-4560.gd19e6118.el9. 5.3 MB/s | 766 kB 00:00 2024-08-31T05:16:40.890 INFO:teuthology.orchestra.run.smithi070.stdout:(16/150): libcephsqlite-19.3.0-4560.gd19e6118.e 1.7 MB/s | 159 kB 00:00 2024-08-31T05:16:40.904 INFO:teuthology.orchestra.run.smithi005.stdout:(2/150): ceph-fuse-19.3.0-4560.gd19e6118.el9.x8 3.8 MB/s | 874 kB 00:00 2024-08-31T05:16:40.932 INFO:teuthology.orchestra.run.smithi070.stdout:(17/150): librados-devel-19.3.0-4560.gd19e6118. 1.2 MB/s | 127 kB 00:00 2024-08-31T05:16:40.982 INFO:teuthology.orchestra.run.smithi070.stdout:(18/150): libradosstriper1-19.3.0-4560.gd19e611 5.4 MB/s | 506 kB 00:00 2024-08-31T05:16:41.082 INFO:teuthology.orchestra.run.smithi070.stdout:(19/150): python3-ceph-argparse-19.3.0-4560.gd1 451 kB/s | 45 kB 00:00 2024-08-31T05:16:41.166 INFO:teuthology.orchestra.run.smithi070.stdout:(20/150): python3-ceph-common-19.3.0-4560.gd19e 1.7 MB/s | 141 kB 00:00 2024-08-31T05:16:41.221 INFO:teuthology.orchestra.run.smithi005.stdout:(3/150): ceph-base-19.3.0-4560.gd19e6118.el9.x8 7.4 MB/s | 5.5 MB 00:00 2024-08-31T05:16:41.233 INFO:teuthology.orchestra.run.smithi070.stdout:(21/150): python3-cephfs-19.3.0-4560.gd19e6118. 2.4 MB/s | 161 kB 00:00 2024-08-31T05:16:41.246 INFO:teuthology.orchestra.run.smithi005.stdout:(4/150): ceph-immutable-object-cache-19.3.0-456 433 kB/s | 148 kB 00:00 2024-08-31T05:16:41.333 INFO:teuthology.orchestra.run.smithi070.stdout:(22/150): python3-rados-19.3.0-4560.gd19e6118.e 3.1 MB/s | 321 kB 00:00 2024-08-31T05:16:41.488 INFO:teuthology.orchestra.run.smithi050.stdout:(6/150): ceph-mon-19.3.0-4560.gd19e6118.el9.x86 6.5 MB/s | 4.9 MB 00:00 2024-08-31T05:16:41.530 INFO:teuthology.orchestra.run.smithi005.stdout:(5/150): ceph-mds-19.3.0-4560.gd19e6118.el9.x86 7.4 MB/s | 2.3 MB 00:00 2024-08-31T05:16:41.656 INFO:teuthology.orchestra.run.smithi070.stdout:(23/150): librgw2-19.3.0-4560.gd19e6118.el9.x86 7.3 MB/s | 5.3 MB 00:00 2024-08-31T05:16:41.742 INFO:teuthology.orchestra.run.smithi070.stdout:(24/150): python3-rgw-19.3.0-4560.gd19e6118.el9 1.1 MB/s | 99 kB 00:00 2024-08-31T05:16:41.755 INFO:teuthology.orchestra.run.smithi005.stdout:(6/150): ceph-mgr-19.3.0-4560.gd19e6118.el9.x86 3.0 MB/s | 1.5 MB 00:00 2024-08-31T05:16:41.792 INFO:teuthology.orchestra.run.smithi070.stdout:(25/150): rbd-fuse-19.3.0-4560.gd19e6118.el9.x8 1.7 MB/s | 86 kB 00:00 2024-08-31T05:16:41.993 INFO:teuthology.orchestra.run.smithi070.stdout:(26/150): python3-rbd-19.3.0-4560.gd19e6118.el9 463 kB/s | 305 kB 00:00 2024-08-31T05:16:42.013 INFO:teuthology.orchestra.run.smithi050.stdout:(7/150): ceph-mds-19.3.0-4560.gd19e6118.el9.x86 1.3 MB/s | 2.3 MB 00:01 2024-08-31T05:16:42.076 INFO:teuthology.orchestra.run.smithi070.stdout:(27/150): rbd-nbd-19.3.0-4560.gd19e6118.el9.x86 2.0 MB/s | 170 kB 00:00 2024-08-31T05:16:42.135 INFO:teuthology.orchestra.run.smithi070.stdout:(28/150): rbd-mirror-19.3.0-4560.gd19e6118.el9. 9.0 MB/s | 3.1 MB 00:00 2024-08-31T05:16:42.160 INFO:teuthology.orchestra.run.smithi070.stdout:(29/150): ceph-grafana-dashboards-19.3.0-4560.g 410 kB/s | 34 kB 00:00 2024-08-31T05:16:42.185 INFO:teuthology.orchestra.run.smithi070.stdout:(30/150): ceph-mgr-cephadm-19.3.0-4560.gd19e611 3.0 MB/s | 154 kB 00:00 2024-08-31T05:16:42.222 INFO:teuthology.orchestra.run.smithi005.stdout:(7/150): ceph-common-19.3.0-4560.gd19e6118.el9. 11 MB/s | 20 MB 00:01 2024-08-31T05:16:42.297 INFO:teuthology.orchestra.run.smithi005.stdout:(8/150): ceph-mon-19.3.0-4560.gd19e6118.el9.x86 6.4 MB/s | 4.9 MB 00:00 2024-08-31T05:16:42.381 INFO:teuthology.orchestra.run.smithi005.stdout:(9/150): ceph-selinux-19.3.0-4560.gd19e6118.el9 302 kB/s | 25 kB 00:00 2024-08-31T05:16:42.686 INFO:teuthology.orchestra.run.smithi070.stdout:(31/150): ceph-test-19.3.0-4560.gd19e6118.el9.x 16 MB/s | 44 MB 00:02 2024-08-31T05:16:42.778 INFO:teuthology.orchestra.run.smithi070.stdout:(32/150): ceph-mgr-modules-core-19.3.0-4560.gd1 3.1 MB/s | 290 kB 00:00 2024-08-31T05:16:42.869 INFO:teuthology.orchestra.run.smithi070.stdout:(33/150): ceph-mgr-rook-19.3.0-4560.gd19e6118.e 540 kB/s | 49 kB 00:00 2024-08-31T05:16:42.937 INFO:teuthology.orchestra.run.smithi070.stdout:(34/150): ceph-prometheus-alerts-19.3.0-4560.gd 246 kB/s | 16 kB 00:00 2024-08-31T05:16:42.965 INFO:teuthology.orchestra.run.smithi005.stdout:(10/150): ceph-radosgw-19.3.0-4560.gd19e6118.el 14 MB/s | 10 MB 00:00 2024-08-31T05:16:43.012 INFO:teuthology.orchestra.run.smithi070.stdout:(35/150): ceph-volume-19.3.0-4560.gd19e6118.el9 3.7 MB/s | 285 kB 00:00 2024-08-31T05:16:43.048 INFO:teuthology.orchestra.run.smithi005.stdout:(11/150): cephfs-mirror-19.3.0-4560.gd19e6118.e 2.6 MB/s | 226 kB 00:00 2024-08-31T05:16:43.132 INFO:teuthology.orchestra.run.smithi005.stdout:(12/150): cephfs-shell-19.3.0-4560.gd19e6118.el 325 kB/s | 27 kB 00:00 2024-08-31T05:16:43.162 INFO:teuthology.orchestra.run.smithi070.stdout:(36/150): cephadm-19.3.0-4560.gd19e6118.el9.noa 5.1 MB/s | 781 kB 00:00 2024-08-31T05:16:43.207 INFO:teuthology.orchestra.run.smithi005.stdout:(13/150): libcephfs-devel-19.3.0-4560.gd19e6118 422 kB/s | 32 kB 00:00 2024-08-31T05:16:43.262 INFO:teuthology.orchestra.run.smithi070.stdout:(37/150): ceph-mgr-diskprediction-local-19.3.0- 6.9 MB/s | 7.4 MB 00:01 2024-08-31T05:16:43.283 INFO:teuthology.orchestra.run.smithi005.stdout:(14/150): libcephfs2-19.3.0-4560.gd19e6118.el9. 10 MB/s | 766 kB 00:00 2024-08-31T05:16:43.288 INFO:teuthology.orchestra.run.smithi070.stdout:(38/150): cephfs-top-19.3.0-4560.gd19e6118.el9. 146 kB/s | 18 kB 00:00 2024-08-31T05:16:43.341 INFO:teuthology.orchestra.run.smithi005.stdout:(15/150): libcephsqlite-19.3.0-4560.gd19e6118.e 2.7 MB/s | 159 kB 00:00 2024-08-31T05:16:43.400 INFO:teuthology.orchestra.run.smithi005.stdout:(16/150): librados-devel-19.3.0-4560.gd19e6118. 2.1 MB/s | 127 kB 00:00 2024-08-31T05:16:43.421 INFO:teuthology.orchestra.run.smithi070.stdout:(39/150): ceph-mgr-dashboard-19.3.0-4560.gd19e6 11 MB/s | 14 MB 00:01 2024-08-31T05:16:43.475 INFO:teuthology.orchestra.run.smithi005.stdout:(17/150): libradosstriper1-19.3.0-4560.gd19e611 6.6 MB/s | 506 kB 00:00 2024-08-31T05:16:43.538 INFO:teuthology.orchestra.run.smithi070.stdout:(40/150): fuse-2.9.9-16.el9.x86_64.rpm 290 kB/s | 80 kB 00:00 2024-08-31T05:16:43.580 INFO:teuthology.orchestra.run.smithi070.stdout:(41/150): libquadmath-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 191 kB 00:00 2024-08-31T05:16:43.647 INFO:teuthology.orchestra.run.smithi070.stdout:(42/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-08-31T05:16:43.681 INFO:teuthology.orchestra.run.smithi070.stdout:(43/150): libgfortran-11.5.0-2.el9.x86_64.rpm 2.0 MB/s | 801 kB 00:00 2024-08-31T05:16:43.706 INFO:teuthology.orchestra.run.smithi070.stdout:(44/150): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-08-31T05:16:43.731 INFO:teuthology.orchestra.run.smithi070.stdout:(45/150): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-08-31T05:16:43.765 INFO:teuthology.orchestra.run.smithi070.stdout:(46/150): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-08-31T05:16:43.790 INFO:teuthology.orchestra.run.smithi070.stdout:(47/150): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-08-31T05:16:43.792 INFO:teuthology.orchestra.run.smithi005.stdout:(18/150): librgw2-19.3.0-4560.gd19e6118.el9.x86 17 MB/s | 5.3 MB 00:00 2024-08-31T05:16:43.832 INFO:teuthology.orchestra.run.smithi070.stdout:(48/150): python3-cryptography-36.0.1-4.el9.x86 4.9 MB/s | 1.2 MB 00:00 2024-08-31T05:16:43.834 INFO:teuthology.orchestra.run.smithi005.stdout:(19/150): python3-ceph-argparse-19.3.0-4560.gd1 1.1 MB/s | 45 kB 00:00 2024-08-31T05:16:43.884 INFO:teuthology.orchestra.run.smithi005.stdout:(20/150): python3-ceph-common-19.3.0-4560.gd19e 2.8 MB/s | 141 kB 00:00 2024-08-31T05:16:43.921 INFO:teuthology.orchestra.run.smithi050.stdout:(8/150): ceph-osd-19.3.0-4560.gd19e6118.el9.x86 7.3 MB/s | 18 MB 00:02 2024-08-31T05:16:43.934 INFO:teuthology.orchestra.run.smithi005.stdout:(21/150): python3-cephfs-19.3.0-4560.gd19e6118. 3.1 MB/s | 161 kB 00:00 2024-08-31T05:16:43.941 INFO:teuthology.orchestra.run.smithi070.stdout:(49/150): boost-program-options-1.75.0-8.el9.x8 987 kB/s | 107 kB 00:00 2024-08-31T05:16:43.955 INFO:teuthology.orchestra.run.smithi050.stdout:(9/150): ceph-selinux-19.3.0-4560.gd19e6118.el9 760 kB/s | 25 kB 00:00 2024-08-31T05:16:43.974 INFO:teuthology.orchestra.run.smithi070.stdout:(50/150): automake-1.16.2-8.el9.noarch.rpm 3.2 MB/s | 689 kB 00:00 2024-08-31T05:16:43.999 INFO:teuthology.orchestra.run.smithi070.stdout:(51/150): elfutils-libelf-devel-0.191-4.el9.x86 372 kB/s | 22 kB 00:00 2024-08-31T05:16:44.001 INFO:teuthology.orchestra.run.smithi005.stdout:(22/150): python3-rados-19.3.0-4560.gd19e6118.e 4.7 MB/s | 321 kB 00:00 2024-08-31T05:16:44.025 INFO:teuthology.orchestra.run.smithi070.stdout:(52/150): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-08-31T05:16:44.050 INFO:teuthology.orchestra.run.smithi070.stdout:(53/150): flexiblas-3.0.4-8.el9.x86_64.rpm 651 kB/s | 33 kB 00:00 2024-08-31T05:16:44.060 INFO:teuthology.orchestra.run.smithi005.stdout:(23/150): python3-rbd-19.3.0-4560.gd19e6118.el9 5.1 MB/s | 305 kB 00:00 2024-08-31T05:16:44.075 INFO:teuthology.orchestra.run.smithi070.stdout:(54/150): bison-3.7.4-5.el9.x86_64.rpm 3.2 MB/s | 943 kB 00:00 2024-08-31T05:16:44.100 INFO:teuthology.orchestra.run.smithi070.stdout:(55/150): flexiblas-openblas-openmp-3.0.4-8.el9 364 kB/s | 18 kB 00:00 2024-08-31T05:16:44.119 INFO:teuthology.orchestra.run.smithi005.stdout:(24/150): python3-rgw-19.3.0-4560.gd19e6118.el9 1.7 MB/s | 99 kB 00:00 2024-08-31T05:16:44.125 INFO:teuthology.orchestra.run.smithi070.stdout:(56/150): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-08-31T05:16:44.168 INFO:teuthology.orchestra.run.smithi070.stdout:(57/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-08-31T05:16:44.169 INFO:teuthology.orchestra.run.smithi005.stdout:(25/150): rbd-fuse-19.3.0-4560.gd19e6118.el9.x8 1.7 MB/s | 86 kB 00:00 2024-08-31T05:16:44.193 INFO:teuthology.orchestra.run.smithi070.stdout:(58/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 160 kB 00:00 2024-08-31T05:16:44.310 INFO:teuthology.orchestra.run.smithi070.stdout:(59/150): librdkafka-1.6.1-102.el9.x86_64.rpm 4.6 MB/s | 662 kB 00:00 2024-08-31T05:16:44.352 INFO:teuthology.orchestra.run.smithi070.stdout:(60/150): libtool-2.4.6-46.el9.x86_64.rpm 3.6 MB/s | 581 kB 00:00 2024-08-31T05:16:44.377 INFO:teuthology.orchestra.run.smithi070.stdout:(61/150): libuuid-devel-2.37.4-20.el9.x86_64.rp 367 kB/s | 24 kB 00:00 2024-08-31T05:16:44.386 INFO:teuthology.orchestra.run.smithi005.stdout:(26/150): rbd-mirror-19.3.0-4560.gd19e6118.el9. 14 MB/s | 3.1 MB 00:00 2024-08-31T05:16:44.402 INFO:teuthology.orchestra.run.smithi070.stdout:(62/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-08-31T05:16:44.478 INFO:teuthology.orchestra.run.smithi070.stdout:(63/150): lua-5.4.4-4.el9.x86_64.rpm 2.5 MB/s | 188 kB 00:00 2024-08-31T05:16:44.511 INFO:teuthology.orchestra.run.smithi070.stdout:(64/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2024-08-31T05:16:44.537 INFO:teuthology.orchestra.run.smithi070.stdout:(65/150): openblas-0.3.26-2.el9.x86_64.rpm 654 kB/s | 38 kB 00:00 2024-08-31T05:16:44.561 INFO:teuthology.orchestra.run.smithi005.stdout:(27/150): ceph-osd-19.3.0-4560.gd19e6118.el9.x8 6.4 MB/s | 18 MB 00:02 2024-08-31T05:16:44.586 INFO:teuthology.orchestra.run.smithi005.stdout:(28/150): rbd-nbd-19.3.0-4560.gd19e6118.el9.x86 849 kB/s | 170 kB 00:00 2024-08-31T05:16:44.612 INFO:teuthology.orchestra.run.smithi005.stdout:(29/150): ceph-grafana-dashboards-19.3.0-4560.g 686 kB/s | 34 kB 00:00 2024-08-31T05:16:44.645 INFO:teuthology.orchestra.run.smithi005.stdout:(30/150): ceph-mgr-cephadm-19.3.0-4560.gd19e611 2.6 MB/s | 154 kB 00:00 2024-08-31T05:16:44.779 INFO:teuthology.orchestra.run.smithi070.stdout:(66/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.0 MB/s | 3.0 MB 00:00 2024-08-31T05:16:45.096 INFO:teuthology.orchestra.run.smithi005.stdout:(31/150): ceph-mgr-diskprediction-local-19.3.0- 16 MB/s | 7.4 MB 00:00 2024-08-31T05:16:45.154 INFO:teuthology.orchestra.run.smithi005.stdout:(32/150): ceph-mgr-modules-core-19.3.0-4560.gd1 4.9 MB/s | 290 kB 00:00 2024-08-31T05:16:45.204 INFO:teuthology.orchestra.run.smithi005.stdout:(33/150): ceph-mgr-rook-19.3.0-4560.gd19e6118.e 990 kB/s | 49 kB 00:00 2024-08-31T05:16:45.212 INFO:teuthology.orchestra.run.smithi070.stdout:(67/150): postgresql-13.16-1.el9.x86_64.rpm 3.7 MB/s | 1.6 MB 00:00 2024-08-31T05:16:45.313 INFO:teuthology.orchestra.run.smithi050.stdout:(10/150): ceph-radosgw-19.3.0-4560.gd19e6118.el 3.2 MB/s | 10 MB 00:03 2024-08-31T05:16:45.380 INFO:teuthology.orchestra.run.smithi050.stdout:(11/150): cephfs-mirror-19.3.0-4560.gd19e6118.e 3.3 MB/s | 226 kB 00:00 2024-08-31T05:16:45.422 INFO:teuthology.orchestra.run.smithi050.stdout:(12/150): cephfs-shell-19.3.0-4560.gd19e6118.el 652 kB/s | 27 kB 00:00 2024-08-31T05:16:45.464 INFO:teuthology.orchestra.run.smithi050.stdout:(13/150): libcephfs-devel-19.3.0-4560.gd19e6118 762 kB/s | 32 kB 00:00 2024-08-31T05:16:45.471 INFO:teuthology.orchestra.run.smithi070.stdout:(68/150): postgresql-contrib-13.16-1.el9.x86_64 3.4 MB/s | 910 kB 00:00 2024-08-31T05:16:45.546 INFO:teuthology.orchestra.run.smithi070.stdout:(69/150): postgresql-private-libs-13.16-1.el9.x 1.8 MB/s | 137 kB 00:00 2024-08-31T05:16:45.615 INFO:teuthology.orchestra.run.smithi050.stdout:(14/150): libcephfs2-19.3.0-4560.gd19e6118.el9. 5.0 MB/s | 766 kB 00:00 2024-08-31T05:16:45.655 INFO:teuthology.orchestra.run.smithi005.stdout:(34/150): ceph-test-19.3.0-4560.gd19e6118.el9.x 13 MB/s | 44 MB 00:03 2024-08-31T05:16:45.672 INFO:teuthology.orchestra.run.smithi005.stdout:(35/150): ceph-prometheus-alerts-19.3.0-4560.gd 35 kB/s | 16 kB 00:00 2024-08-31T05:16:45.682 INFO:teuthology.orchestra.run.smithi050.stdout:(15/150): libcephsqlite-19.3.0-4560.gd19e6118.e 2.3 MB/s | 159 kB 00:00 2024-08-31T05:16:45.714 INFO:teuthology.orchestra.run.smithi005.stdout:(36/150): ceph-volume-19.3.0-4560.gd19e6118.el9 4.8 MB/s | 285 kB 00:00 2024-08-31T05:16:45.732 INFO:teuthology.orchestra.run.smithi050.stdout:(16/150): librados-devel-19.3.0-4560.gd19e6118. 2.5 MB/s | 127 kB 00:00 2024-08-31T05:16:45.756 INFO:teuthology.orchestra.run.smithi005.stdout:(37/150): cephadm-19.3.0-4560.gd19e6118.el9.noa 9.1 MB/s | 781 kB 00:00 2024-08-31T05:16:45.763 INFO:teuthology.orchestra.run.smithi070.stdout:(70/150): openblas-openmp-0.3.26-2.el9.x86_64.r 3.9 MB/s | 4.9 MB 00:01 2024-08-31T05:16:45.773 INFO:teuthology.orchestra.run.smithi005.stdout:(38/150): cephfs-top-19.3.0-4560.gd19e6118.el9. 312 kB/s | 18 kB 00:00 2024-08-31T05:16:45.830 INFO:teuthology.orchestra.run.smithi070.stdout:(71/150): openssl-devel-3.2.2-4.el9.x86_64.rpm 3.4 MB/s | 4.4 MB 00:01 2024-08-31T05:16:45.840 INFO:teuthology.orchestra.run.smithi050.stdout:(17/150): libradosstriper1-19.3.0-4560.gd19e611 4.6 MB/s | 506 kB 00:00 2024-08-31T05:16:45.889 INFO:teuthology.orchestra.run.smithi070.stdout:(72/150): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-08-31T05:16:45.915 INFO:teuthology.orchestra.run.smithi005.stdout:(39/150): fuse-2.9.9-16.el9.x86_64.rpm 502 kB/s | 80 kB 00:00 2024-08-31T05:16:46.007 INFO:teuthology.orchestra.run.smithi005.stdout:(40/150): libquadmath-11.5.0-2.el9.x86_64.rpm 2.0 MB/s | 191 kB 00:00 2024-08-31T05:16:46.040 INFO:teuthology.orchestra.run.smithi005.stdout:(41/150): libgfortran-11.5.0-2.el9.x86_64.rpm 2.9 MB/s | 801 kB 00:00 2024-08-31T05:16:46.074 INFO:teuthology.orchestra.run.smithi005.stdout:(42/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 253 kB 00:00 2024-08-31T05:16:46.122 INFO:teuthology.orchestra.run.smithi070.stdout:(73/150): protobuf-3.14.0-13.el9.x86_64.rpm 2.8 MB/s | 1.0 MB 00:00 2024-08-31T05:16:46.124 INFO:teuthology.orchestra.run.smithi005.stdout:(43/150): python3-cryptography-36.0.1-4.el9.x86 15 MB/s | 1.2 MB 00:00 2024-08-31T05:16:46.150 INFO:teuthology.orchestra.run.smithi005.stdout:(44/150): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-08-31T05:16:46.156 INFO:teuthology.orchestra.run.smithi070.stdout:(74/150): python3-colorama-0.4.6-3.el9.noarch.r 1.8 MB/s | 61 kB 00:00 2024-08-31T05:16:46.183 INFO:teuthology.orchestra.run.smithi005.stdout:(45/150): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-08-31T05:16:46.208 INFO:teuthology.orchestra.run.smithi005.stdout:(46/150): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-08-31T05:16:46.242 INFO:teuthology.orchestra.run.smithi005.stdout:(47/150): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-08-31T05:16:46.247 INFO:teuthology.orchestra.run.smithi070.stdout:(75/150): python3-devel-3.9.19-8.el9.x86_64.rpm 2.6 MB/s | 245 kB 00:00 2024-08-31T05:16:46.316 INFO:teuthology.orchestra.run.smithi050.stdout:(18/150): ceph-common-19.3.0-4560.gd19e6118.el9 2.8 MB/s | 20 MB 00:07 2024-08-31T05:16:46.339 INFO:teuthology.orchestra.run.smithi070.stdout:(76/150): python3-jinja2-2.11.3-6.el9.noarch.rp 2.6 MB/s | 248 kB 00:00 2024-08-31T05:16:46.381 INFO:teuthology.orchestra.run.smithi070.stdout:(77/150): python3-jsonpatch-1.21-16.el9.noarch. 616 kB/s | 26 kB 00:00 2024-08-31T05:16:46.383 INFO:teuthology.orchestra.run.smithi050.stdout:(19/150): python3-ceph-argparse-19.3.0-4560.gd1 679 kB/s | 45 kB 00:00 2024-08-31T05:16:46.423 INFO:teuthology.orchestra.run.smithi070.stdout:(78/150): python3-jsonpointer-2.0-4.el9.noarch. 462 kB/s | 19 kB 00:00 2024-08-31T05:16:46.433 INFO:teuthology.orchestra.run.smithi050.stdout:(20/150): python3-ceph-common-19.3.0-4560.gd19e 2.8 MB/s | 141 kB 00:00 2024-08-31T05:16:46.443 INFO:teuthology.orchestra.run.smithi005.stdout:(48/150): ceph-mgr-dashboard-19.3.0-4560.gd19e6 7.7 MB/s | 14 MB 00:01 2024-08-31T05:16:46.499 INFO:teuthology.orchestra.run.smithi070.stdout:(79/150): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-08-31T05:16:46.508 INFO:teuthology.orchestra.run.smithi050.stdout:(21/150): python3-cephfs-19.3.0-4560.gd19e6118. 2.1 MB/s | 161 kB 00:00 2024-08-31T05:16:46.540 INFO:teuthology.orchestra.run.smithi070.stdout:(80/150): python3-markupsafe-1.1.1-12.el9.x86_6 834 kB/s | 35 kB 00:00 2024-08-31T05:16:46.576 INFO:teuthology.orchestra.run.smithi005.stdout:(49/150): automake-1.16.2-8.el9.noarch.rpm 1.8 MB/s | 689 kB 00:00 2024-08-31T05:16:46.609 INFO:teuthology.orchestra.run.smithi050.stdout:(22/150): python3-rados-19.3.0-4560.gd19e6118.e 3.1 MB/s | 321 kB 00:00 2024-08-31T05:16:46.626 INFO:teuthology.orchestra.run.smithi005.stdout:(50/150): elfutils-libelf-devel-0.191-4.el9.x86 434 kB/s | 22 kB 00:00 2024-08-31T05:16:46.660 INFO:teuthology.orchestra.run.smithi005.stdout:(51/150): boost-program-options-1.75.0-8.el9.x8 493 kB/s | 107 kB 00:00 2024-08-31T05:16:46.676 INFO:teuthology.orchestra.run.smithi050.stdout:(23/150): python3-rbd-19.3.0-4560.gd19e6118.el9 4.5 MB/s | 305 kB 00:00 2024-08-31T05:16:46.693 INFO:teuthology.orchestra.run.smithi005.stdout:(52/150): bison-3.7.4-5.el9.x86_64.rpm 2.0 MB/s | 943 kB 00:00 2024-08-31T05:16:46.719 INFO:teuthology.orchestra.run.smithi005.stdout:(53/150): flexiblas-3.0.4-8.el9.x86_64.rpm 559 kB/s | 33 kB 00:00 2024-08-31T05:16:46.726 INFO:teuthology.orchestra.run.smithi050.stdout:(24/150): python3-rgw-19.3.0-4560.gd19e6118.el9 1.9 MB/s | 99 kB 00:00 2024-08-31T05:16:46.744 INFO:teuthology.orchestra.run.smithi005.stdout:(54/150): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-08-31T05:16:46.769 INFO:teuthology.orchestra.run.smithi005.stdout:(55/150): flexiblas-openblas-openmp-3.0.4-8.el9 361 kB/s | 18 kB 00:00 2024-08-31T05:16:46.795 INFO:teuthology.orchestra.run.smithi005.stdout:(56/150): libaio-devel-0.3.111-13.el9.x86_64.rp 221 kB/s | 11 kB 00:00 2024-08-31T05:16:46.818 INFO:teuthology.orchestra.run.smithi050.stdout:(25/150): librgw2-19.3.0-4560.gd19e6118.el9.x86 5.4 MB/s | 5.3 MB 00:00 2024-08-31T05:16:46.843 INFO:teuthology.orchestra.run.smithi050.stdout:(26/150): rbd-fuse-19.3.0-4560.gd19e6118.el9.x8 738 kB/s | 86 kB 00:00 2024-08-31T05:16:46.853 INFO:teuthology.orchestra.run.smithi005.stdout:(57/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 775 kB/s | 45 kB 00:00 2024-08-31T05:16:46.878 INFO:teuthology.orchestra.run.smithi005.stdout:(58/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-08-31T05:16:46.910 INFO:teuthology.orchestra.run.smithi050.stdout:(27/150): rbd-nbd-19.3.0-4560.gd19e6118.el9.x86 2.5 MB/s | 170 kB 00:00 2024-08-31T05:16:46.929 INFO:teuthology.orchestra.run.smithi005.stdout:(59/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 13 MB/s | 3.0 MB 00:00 2024-08-31T05:16:46.952 INFO:teuthology.orchestra.run.smithi050.stdout:(28/150): ceph-grafana-dashboards-19.3.0-4560.g 826 kB/s | 34 kB 00:00 2024-08-31T05:16:46.971 INFO:teuthology.orchestra.run.smithi005.stdout:(60/150): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 662 kB 00:00 2024-08-31T05:16:46.996 INFO:teuthology.orchestra.run.smithi005.stdout:(61/150): libuuid-devel-2.37.4-20.el9.x86_64.rp 366 kB/s | 24 kB 00:00 2024-08-31T05:16:47.011 INFO:teuthology.orchestra.run.smithi050.stdout:(29/150): ceph-mgr-cephadm-19.3.0-4560.gd19e611 2.6 MB/s | 154 kB 00:00 2024-08-31T05:16:47.021 INFO:teuthology.orchestra.run.smithi005.stdout:(62/150): libtool-2.4.6-46.el9.x86_64.rpm 4.0 MB/s | 581 kB 00:00 2024-08-31T05:16:47.047 INFO:teuthology.orchestra.run.smithi005.stdout:(63/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 628 kB/s | 47 kB 00:00 2024-08-31T05:16:47.072 INFO:teuthology.orchestra.run.smithi005.stdout:(64/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-08-31T05:16:47.097 INFO:teuthology.orchestra.run.smithi005.stdout:(65/150): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-08-31T05:16:47.123 INFO:teuthology.orchestra.run.smithi005.stdout:(66/150): openblas-0.3.26-2.el9.x86_64.rpm 509 kB/s | 38 kB 00:00 2024-08-31T05:16:47.256 INFO:teuthology.orchestra.run.smithi005.stdout:(67/150): postgresql-13.16-1.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-08-31T05:16:47.299 INFO:teuthology.orchestra.run.smithi070.stdout:(81/150): postgresql-server-13.16-1.el9.x86_64. 3.3 MB/s | 5.8 MB 00:01 2024-08-31T05:16:47.391 INFO:teuthology.orchestra.run.smithi070.stdout:(82/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.7 MB/s | 250 kB 00:00 2024-08-31T05:16:47.440 INFO:teuthology.orchestra.run.smithi005.stdout:(68/150): openblas-openmp-0.3.26-2.el9.x86_64.r 13 MB/s | 4.9 MB 00:00 2024-08-31T05:16:47.473 INFO:teuthology.orchestra.run.smithi005.stdout:(69/150): postgresql-contrib-13.16-1.el9.x86_64 4.1 MB/s | 910 kB 00:00 2024-08-31T05:16:47.475 INFO:teuthology.orchestra.run.smithi070.stdout:(83/150): python3-babel-2.9.1-2.el9.noarch.rpm 3.8 MB/s | 6.0 MB 00:01 2024-08-31T05:16:47.499 INFO:teuthology.orchestra.run.smithi005.stdout:(70/150): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-08-31T05:16:47.512 INFO:teuthology.orchestra.run.smithi050.stdout:(30/150): ceph-test-19.3.0-4560.gd19e6118.el9.x 12 MB/s | 44 MB 00:03 2024-08-31T05:16:47.533 INFO:teuthology.orchestra.run.smithi070.stdout:(84/150): python3-oauthlib-3.1.1-5.el9.noarch.r 1.5 MB/s | 222 kB 00:00 2024-08-31T05:16:47.557 INFO:teuthology.orchestra.run.smithi005.stdout:(71/150): openssl-devel-3.2.2-4.el9.x86_64.rpm 9.6 MB/s | 4.4 MB 00:00 2024-08-31T05:16:47.558 INFO:teuthology.orchestra.run.smithi070.stdout:(85/150): python3-packaging-20.9-5.el9.noarch.r 925 kB/s | 77 kB 00:00 2024-08-31T05:16:47.579 INFO:teuthology.orchestra.run.smithi050.stdout:(31/150): rbd-mirror-19.3.0-4560.gd19e6118.el9. 4.1 MB/s | 3.1 MB 00:00 2024-08-31T05:16:47.584 INFO:teuthology.orchestra.run.smithi070.stdout:(86/150): python3-prettytable-0.7.2-27.el9.noar 844 kB/s | 42 kB 00:00 2024-08-31T05:16:47.599 INFO:teuthology.orchestra.run.smithi005.stdout:(72/150): protobuf-3.14.0-13.el9.x86_64.rpm 10 MB/s | 1.0 MB 00:00 2024-08-31T05:16:47.625 INFO:teuthology.orchestra.run.smithi005.stdout:(73/150): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-08-31T05:16:47.654 INFO:teuthology.orchestra.run.smithi050.stdout:(32/150): ceph-mgr-modules-core-19.3.0-4560.gd1 3.8 MB/s | 290 kB 00:00 2024-08-31T05:16:47.659 INFO:teuthology.orchestra.run.smithi070.stdout:(87/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-08-31T05:16:47.683 INFO:teuthology.orchestra.run.smithi005.stdout:(74/150): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-08-31T05:16:47.684 INFO:teuthology.orchestra.run.smithi070.stdout:(88/150): python3-protobuf-3.14.0-13.el9.noarch 2.1 MB/s | 269 kB 00:00 2024-08-31T05:16:47.704 INFO:teuthology.orchestra.run.smithi050.stdout:(33/150): ceph-mgr-rook-19.3.0-4560.gd19e6118.e 994 kB/s | 49 kB 00:00 2024-08-31T05:16:47.726 INFO:teuthology.orchestra.run.smithi070.stdout:(89/150): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-08-31T05:16:47.754 INFO:teuthology.orchestra.run.smithi050.stdout:(34/150): ceph-prometheus-alerts-19.3.0-4560.gd 329 kB/s | 16 kB 00:00 2024-08-31T05:16:47.758 INFO:teuthology.orchestra.run.smithi005.stdout:(75/150): python3-devel-3.9.19-8.el9.x86_64.rpm 3.2 MB/s | 245 kB 00:00 2024-08-31T05:16:47.768 INFO:teuthology.orchestra.run.smithi070.stdout:(90/150): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 54 kB 00:00 2024-08-31T05:16:47.818 INFO:teuthology.orchestra.run.smithi070.stdout:(91/150): python3-pyasn1-modules-0.4.8-6.el9.no 1.7 MB/s | 279 kB 00:00 2024-08-31T05:16:47.822 INFO:teuthology.orchestra.run.smithi050.stdout:(35/150): ceph-volume-19.3.0-4560.gd19e6118.el9 4.2 MB/s | 285 kB 00:00 2024-08-31T05:16:47.860 INFO:teuthology.orchestra.run.smithi070.stdout:(92/150): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-08-31T05:16:47.884 INFO:teuthology.orchestra.run.smithi005.stdout:(76/150): postgresql-server-13.16-1.el9.x86_64. 14 MB/s | 5.8 MB 00:00 2024-08-31T05:16:47.902 INFO:teuthology.orchestra.run.smithi070.stdout:(93/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.0 MB/s | 44 kB 00:00 2024-08-31T05:16:47.917 INFO:teuthology.orchestra.run.smithi005.stdout:(77/150): python3-jinja2-2.11.3-6.el9.noarch.rp 1.5 MB/s | 248 kB 00:00 2024-08-31T05:16:47.955 INFO:teuthology.orchestra.run.smithi050.stdout:(36/150): cephadm-19.3.0-4560.gd19e6118.el9.noa 5.7 MB/s | 781 kB 00:00 2024-08-31T05:16:47.993 INFO:teuthology.orchestra.run.smithi005.stdout:(78/150): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-08-31T05:16:48.005 INFO:teuthology.orchestra.run.smithi050.stdout:(37/150): cephfs-top-19.3.0-4560.gd19e6118.el9. 366 kB/s | 18 kB 00:00 2024-08-31T05:16:48.018 INFO:teuthology.orchestra.run.smithi005.stdout:(79/150): python3-jsonpatch-1.21-16.el9.noarch. 191 kB/s | 26 kB 00:00 2024-08-31T05:16:48.043 INFO:teuthology.orchestra.run.smithi005.stdout:(80/150): python3-jsonpointer-2.0-4.el9.noarch. 153 kB/s | 19 kB 00:00 2024-08-31T05:16:48.044 INFO:teuthology.orchestra.run.smithi070.stdout:(94/150): qatlib-24.02.0-1.el9.x86_64.rpm 1.5 MB/s | 221 kB 00:00 2024-08-31T05:16:48.077 INFO:teuthology.orchestra.run.smithi005.stdout:(81/150): python3-mako-1.1.4-6.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-08-31T05:16:48.086 INFO:teuthology.orchestra.run.smithi070.stdout:(95/150): qatlib-service-24.02.0-1.el9.x86_64.r 865 kB/s | 36 kB 00:00 2024-08-31T05:16:48.102 INFO:teuthology.orchestra.run.smithi005.stdout:(82/150): python3-markupsafe-1.1.1-12.el9.x86_6 595 kB/s | 35 kB 00:00 2024-08-31T05:16:48.105 INFO:teuthology.orchestra.run.smithi050.stdout:(38/150): ceph-mgr-diskprediction-local-19.3.0- 12 MB/s | 7.4 MB 00:00 2024-08-31T05:16:48.136 INFO:teuthology.orchestra.run.smithi005.stdout:(83/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-08-31T05:16:48.161 INFO:teuthology.orchestra.run.smithi005.stdout:(84/150): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-08-31T05:16:48.195 INFO:teuthology.orchestra.run.smithi005.stdout:(85/150): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-08-31T05:16:48.222 INFO:teuthology.orchestra.run.smithi050.stdout:(39/150): fuse-2.9.9-16.el9.x86_64.rpm 368 kB/s | 80 kB 00:00 2024-08-31T05:16:48.228 INFO:teuthology.orchestra.run.smithi005.stdout:(86/150): python3-prettytable-0.7.2-27.el9.noar 631 kB/s | 42 kB 00:00 2024-08-31T05:16:48.241 INFO:teuthology.orchestra.run.smithi070.stdout:(96/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 34 MB/s | 16 MB 00:00 2024-08-31T05:16:48.254 INFO:teuthology.orchestra.run.smithi005.stdout:(87/150): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-08-31T05:16:48.266 INFO:teuthology.orchestra.run.smithi070.stdout:(97/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 263 kB/s | 47 kB 00:00 2024-08-31T05:16:48.287 INFO:teuthology.orchestra.run.smithi005.stdout:(88/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 159 kB 00:00 2024-08-31T05:16:48.300 INFO:teuthology.orchestra.run.smithi070.stdout:(98/150): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-08-31T05:16:48.306 INFO:teuthology.orchestra.run.smithi050.stdout:(40/150): libquadmath-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-08-31T05:16:48.321 INFO:teuthology.orchestra.run.smithi005.stdout:(89/150): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 279 kB 00:00 2024-08-31T05:16:48.325 INFO:teuthology.orchestra.run.smithi070.stdout:(99/150): uuid-1.6.2-55.el9.x86_64.rpm 987 kB/s | 58 kB 00:00 2024-08-31T05:16:48.331 INFO:teuthology.orchestra.run.smithi050.stdout:(41/150): libgfortran-11.5.0-2.el9.x86_64.rpm 3.5 MB/s | 801 kB 00:00 2024-08-31T05:16:48.346 INFO:teuthology.orchestra.run.smithi005.stdout:(90/150): python3-pytz-2021.1-5.el9.noarch.rpm 871 kB/s | 51 kB 00:00 2024-08-31T05:16:48.371 INFO:teuthology.orchestra.run.smithi005.stdout:(91/150): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-08-31T05:16:48.373 INFO:teuthology.orchestra.run.smithi050.stdout:(42/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 253 kB 00:00 2024-08-31T05:16:48.393 INFO:teuthology.orchestra.run.smithi070.stdout:(100/150): python3-numpy-1.20.1-5.el9.x86_64.rp 2.8 MB/s | 5.1 MB 00:01 2024-08-31T05:16:48.418 INFO:teuthology.orchestra.run.smithi070.stdout:(101/150): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 817 kB/s | 96 kB 00:00 2024-08-31T05:16:48.424 INFO:teuthology.orchestra.run.smithi050.stdout:(43/150): python3-cryptography-36.0.1-4.el9.x86 13 MB/s | 1.2 MB 00:00 2024-08-31T05:16:48.438 INFO:teuthology.orchestra.run.smithi005.stdout:(92/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 13 MB/s | 5.1 MB 00:00 2024-08-31T05:16:48.443 INFO:teuthology.orchestra.run.smithi070.stdout:(102/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 543 kB/s | 64 kB 00:00 2024-08-31T05:16:48.449 INFO:teuthology.orchestra.run.smithi050.stdout:(44/150): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-08-31T05:16:48.465 INFO:teuthology.orchestra.run.smithi005.stdout:(93/150): python3-toml-0.10.2-6.el9.noarch.rpm 446 kB/s | 42 kB 00:00 2024-08-31T05:16:48.474 INFO:teuthology.orchestra.run.smithi050.stdout:(45/150): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-08-31T05:16:48.476 INFO:teuthology.orchestra.run.smithi070.stdout:(103/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 536 kB/s | 45 kB 00:00 2024-08-31T05:16:48.499 INFO:teuthology.orchestra.run.smithi005.stdout:(94/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 736 kB/s | 44 kB 00:00 2024-08-31T05:16:48.499 INFO:teuthology.orchestra.run.smithi050.stdout:(46/150): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-08-31T05:16:48.524 INFO:teuthology.orchestra.run.smithi005.stdout:(95/150): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-08-31T05:16:48.525 INFO:teuthology.orchestra.run.smithi050.stdout:(47/150): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-08-31T05:16:48.527 INFO:teuthology.orchestra.run.smithi070.stdout:(104/150): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-08-31T05:16:48.558 INFO:teuthology.orchestra.run.smithi005.stdout:(96/150): qatlib-service-24.02.0-1.el9.x86_64.r 615 kB/s | 36 kB 00:00 2024-08-31T05:16:48.568 INFO:teuthology.orchestra.run.smithi070.stdout:(105/150): gperftools-libs-2.9.1-2.el9.x86_64.r 7.2 MB/s | 309 kB 00:00 2024-08-31T05:16:48.583 INFO:teuthology.orchestra.run.smithi005.stdout:(97/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 809 kB/s | 47 kB 00:00 2024-08-31T05:16:48.594 INFO:teuthology.orchestra.run.smithi070.stdout:(106/150): grpc-data-1.46.7-10.el9.noarch.rpm 775 kB/s | 19 kB 00:00 2024-08-31T05:16:48.616 INFO:teuthology.orchestra.run.smithi005.stdout:(98/150): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-08-31T05:16:48.642 INFO:teuthology.orchestra.run.smithi005.stdout:(99/150): uuid-1.6.2-55.el9.x86_64.rpm 987 kB/s | 58 kB 00:00 2024-08-31T05:16:48.692 INFO:teuthology.orchestra.run.smithi005.stdout:(100/150): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.2 MB/s | 96 kB 00:00 2024-08-31T05:16:48.711 INFO:teuthology.orchestra.run.smithi070.stdout:(107/150): libarrow-9.0.0-11.el9.x86_64.rpm 38 MB/s | 4.4 MB 00:00 2024-08-31T05:16:48.761 INFO:teuthology.orchestra.run.smithi070.stdout:(108/150): lua-devel-5.4.4-4.el9.x86_64.rpm 65 kB/s | 22 kB 00:00 2024-08-31T05:16:48.794 INFO:teuthology.orchestra.run.smithi070.stdout:(109/150): libarrow-doc-9.0.0-11.el9.noarch.rpm 311 kB/s | 26 kB 00:00 2024-08-31T05:16:48.820 INFO:teuthology.orchestra.run.smithi070.stdout:(110/150): libunwind-1.6.2-1.el9.x86_64.rpm 2.8 MB/s | 67 kB 00:00 2024-08-31T05:16:48.834 INFO:teuthology.orchestra.run.smithi005.stdout:(101/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 332 kB/s | 64 kB 00:00 2024-08-31T05:16:48.845 INFO:teuthology.orchestra.run.smithi070.stdout:(111/150): liboath-2.6.7-2.el9.x86_64.rpm 578 kB/s | 49 kB 00:00 2024-08-31T05:16:48.861 INFO:teuthology.orchestra.run.smithi005.stdout:(102/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 269 kB/s | 45 kB 00:00 2024-08-31T05:16:48.871 INFO:teuthology.orchestra.run.smithi070.stdout:(112/150): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-08-31T05:16:48.912 INFO:teuthology.orchestra.run.smithi070.stdout:(113/150): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-08-31T05:16:48.938 INFO:teuthology.orchestra.run.smithi070.stdout:(114/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-08-31T05:16:48.943 INFO:teuthology.orchestra.run.smithi005.stdout:(103/150): lua-devel-5.4.4-4.el9.x86_64.rpm 205 kB/s | 22 kB 00:00 2024-08-31T05:16:48.963 INFO:teuthology.orchestra.run.smithi070.stdout:(115/150): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-08-31T05:16:48.997 INFO:teuthology.orchestra.run.smithi070.stdout:(116/150): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.4 MB/s | 839 kB 00:00 2024-08-31T05:16:49.002 INFO:teuthology.orchestra.run.smithi005.stdout:(104/150): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-08-31T05:16:49.022 INFO:teuthology.orchestra.run.smithi070.stdout:(117/150): python3-certifi-2023.05.07-4.el9.noa 241 kB/s | 14 kB 00:00 2024-08-31T05:16:49.036 INFO:teuthology.orchestra.run.smithi005.stdout:(105/150): gperftools-libs-2.9.1-2.el9.x86_64.r 9.0 MB/s | 309 kB 00:00 2024-08-31T05:16:49.047 INFO:teuthology.orchestra.run.smithi070.stdout:(118/150): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-08-31T05:16:49.052 INFO:teuthology.orchestra.run.smithi005.stdout:(106/150): grpc-data-1.46.7-10.el9.noarch.rpm 1.1 MB/s | 19 kB 00:00 2024-08-31T05:16:49.080 INFO:teuthology.orchestra.run.smithi070.stdout:(119/150): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-08-31T05:16:49.106 INFO:teuthology.orchestra.run.smithi070.stdout:(120/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-08-31T05:16:49.216 INFO:teuthology.orchestra.run.smithi070.stdout:(121/150): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-08-31T05:16:49.217 INFO:teuthology.orchestra.run.smithi070.stdout:(122/150): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-08-31T05:16:49.217 INFO:teuthology.orchestra.run.smithi070.stdout:(123/150): python3-jaraco-8.2.1-3.el9.noarch.rp 321 kB/s | 11 kB 00:00 2024-08-31T05:16:49.219 INFO:teuthology.orchestra.run.smithi005.stdout:(107/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 19 MB/s | 16 MB 00:00 2024-08-31T05:16:49.224 INFO:teuthology.orchestra.run.smithi070.stdout:(124/150): protobuf-compiler-3.14.0-13.el9.x86_ 1.1 MB/s | 863 kB 00:00 2024-08-31T05:16:49.249 INFO:teuthology.orchestra.run.smithi070.stdout:(125/150): python3-jaraco-classes-3.2.1-5.el9.n 351 kB/s | 18 kB 00:00 2024-08-31T05:16:49.250 INFO:teuthology.orchestra.run.smithi050.stdout:(48/150): ceph-mgr-dashboard-19.3.0-4560.gd19e6 6.3 MB/s | 14 MB 00:02 2024-08-31T05:16:49.261 INFO:teuthology.orchestra.run.smithi005.stdout:(108/150): protobuf-compiler-3.14.0-13.el9.x86_ 2.1 MB/s | 863 kB 00:00 2024-08-31T05:16:49.283 INFO:teuthology.orchestra.run.smithi070.stdout:(126/150): python3-jaraco-functools-3.5.0-2.el9 741 kB/s | 19 kB 00:00 2024-08-31T05:16:49.295 INFO:teuthology.orchestra.run.smithi005.stdout:(109/150): libarrow-doc-9.0.0-11.el9.noarch.rpm 347 kB/s | 26 kB 00:00 2024-08-31T05:16:49.308 INFO:teuthology.orchestra.run.smithi070.stdout:(127/150): python3-jaraco-text-3.2.0-6.el9.noar 843 kB/s | 20 kB 00:00 2024-08-31T05:16:49.328 INFO:teuthology.orchestra.run.smithi005.stdout:(110/150): libunwind-1.6.2-1.el9.x86_64.rpm 2.1 MB/s | 67 kB 00:00 2024-08-31T05:16:49.333 INFO:teuthology.orchestra.run.smithi070.stdout:(128/150): python3-jaraco-collections-3.0.0-8.e 212 kB/s | 23 kB 00:00 2024-08-31T05:16:49.353 INFO:teuthology.orchestra.run.smithi005.stdout:(111/150): liboath-2.6.7-2.el9.x86_64.rpm 539 kB/s | 49 kB 00:00 2024-08-31T05:16:49.379 INFO:teuthology.orchestra.run.smithi005.stdout:(112/150): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-08-31T05:16:49.384 INFO:teuthology.orchestra.run.smithi070.stdout:(129/150): python3-grpcio-1.46.7-10.el9.x86_64. 7.3 MB/s | 2.0 MB 00:00 2024-08-31T05:16:49.409 INFO:teuthology.orchestra.run.smithi070.stdout:(130/150): python3-logutils-0.3.5-21.el9.noarch 617 kB/s | 46 kB 00:00 2024-08-31T05:16:49.434 INFO:teuthology.orchestra.run.smithi070.stdout:(131/150): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-08-31T05:16:49.437 INFO:teuthology.orchestra.run.smithi005.stdout:(113/150): python3-asyncssh-2.13.2-5.el9.noarch 9.2 MB/s | 548 kB 00:00 2024-08-31T05:16:49.459 INFO:teuthology.orchestra.run.smithi070.stdout:(132/150): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-08-31T05:16:49.463 INFO:teuthology.orchestra.run.smithi005.stdout:(114/150): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.5 MB/s | 839 kB 00:00 2024-08-31T05:16:49.476 INFO:teuthology.orchestra.run.smithi050.stdout:(49/150): automake-1.16.2-8.el9.noarch.rpm 706 kB/s | 689 kB 00:00 2024-08-31T05:16:49.485 INFO:teuthology.orchestra.run.smithi070.stdout:(133/150): python3-portend-3.1.0-2.el9.noarch.r 660 kB/s | 16 kB 00:00 2024-08-31T05:16:49.488 INFO:teuthology.orchestra.run.smithi005.stdout:(115/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 868 kB/s | 43 kB 00:00 2024-08-31T05:16:49.510 INFO:teuthology.orchestra.run.smithi070.stdout:(134/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-08-31T05:16:49.513 INFO:teuthology.orchestra.run.smithi005.stdout:(116/150): python3-cachetools-4.2.4-1.el9.noarc 641 kB/s | 32 kB 00:00 2024-08-31T05:16:49.517 INFO:teuthology.orchestra.run.smithi050.stdout:(50/150): bison-3.7.4-5.el9.x86_64.rpm 950 kB/s | 943 kB 00:00 2024-08-31T05:16:49.539 INFO:teuthology.orchestra.run.smithi005.stdout:(117/150): python3-certifi-2023.05.07-4.el9.noa 280 kB/s | 14 kB 00:00 2024-08-31T05:16:49.543 INFO:teuthology.orchestra.run.smithi070.stdout:(135/150): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2024-08-31T05:16:49.564 INFO:teuthology.orchestra.run.smithi005.stdout:(118/150): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-08-31T05:16:49.569 INFO:teuthology.orchestra.run.smithi070.stdout:(136/150): python3-pyperclip-1.8.2-2.el9.noarch 481 kB/s | 28 kB 00:00 2024-08-31T05:16:49.594 INFO:teuthology.orchestra.run.smithi070.stdout:(137/150): python3-repoze-lru-0.7-16.el9.noarch 611 kB/s | 31 kB 00:00 2024-08-31T05:16:49.597 INFO:teuthology.orchestra.run.smithi005.stdout:(119/150): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-08-31T05:16:49.619 INFO:teuthology.orchestra.run.smithi070.stdout:(138/150): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-08-31T05:16:49.631 INFO:teuthology.orchestra.run.smithi005.stdout:(120/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-08-31T05:16:49.644 INFO:teuthology.orchestra.run.smithi070.stdout:(139/150): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-08-31T05:16:49.656 INFO:teuthology.orchestra.run.smithi005.stdout:(121/150): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-08-31T05:16:49.670 INFO:teuthology.orchestra.run.smithi070.stdout:(140/150): python3-tempora-5.0.0-2.el9.noarch.r 709 kB/s | 36 kB 00:00 2024-08-31T05:16:49.690 INFO:teuthology.orchestra.run.smithi005.stdout:(122/150): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-08-31T05:16:49.695 INFO:teuthology.orchestra.run.smithi070.stdout:(141/150): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-08-31T05:16:49.716 INFO:teuthology.orchestra.run.smithi005.stdout:(123/150): python3-jaraco-8.2.1-3.el9.noarch.rp 430 kB/s | 11 kB 00:00 2024-08-31T05:16:49.737 INFO:teuthology.orchestra.run.smithi070.stdout:(142/150): python3-kubernetes-26.1.0-2.el9.noar 2.4 MB/s | 1.0 MB 00:00 2024-08-31T05:16:49.740 INFO:teuthology.orchestra.run.smithi005.stdout:(124/150): python3-jaraco-classes-3.2.1-5.el9.n 713 kB/s | 18 kB 00:00 2024-08-31T05:16:49.762 INFO:teuthology.orchestra.run.smithi070.stdout:(143/150): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-08-31T05:16:49.788 INFO:teuthology.orchestra.run.smithi070.stdout:(144/150): python3-webob-1.8.8-2.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-08-31T05:16:49.813 INFO:teuthology.orchestra.run.smithi070.stdout:(145/150): python3-zc-lockfile-2.0-10.el9.noarc 397 kB/s | 20 kB 00:00 2024-08-31T05:16:49.816 INFO:teuthology.orchestra.run.smithi005.stdout:(125/150): libarrow-9.0.0-11.el9.x86_64.rpm 5.8 MB/s | 4.4 MB 00:00 2024-08-31T05:16:49.838 INFO:teuthology.orchestra.run.smithi070.stdout:(146/150): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-08-31T05:16:49.841 INFO:teuthology.orchestra.run.smithi005.stdout:(126/150): python3-jaraco-collections-3.0.0-8.e 230 kB/s | 23 kB 00:00 2024-08-31T05:16:49.863 INFO:teuthology.orchestra.run.smithi070.stdout:(147/150): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-08-31T05:16:49.866 INFO:teuthology.orchestra.run.smithi005.stdout:(127/150): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-08-31T05:16:49.883 INFO:teuthology.orchestra.run.smithi005.stdout:(128/150): python3-jaraco-text-3.2.0-6.el9.noar 471 kB/s | 20 kB 00:00 2024-08-31T05:16:49.900 INFO:teuthology.orchestra.run.smithi005.stdout:(129/150): python3-logutils-0.3.5-21.el9.noarch 2.8 MB/s | 46 kB 00:00 2024-08-31T05:16:49.922 INFO:teuthology.orchestra.run.smithi070.stdout:(148/150): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-08-31T05:16:49.926 INFO:teuthology.orchestra.run.smithi005.stdout:(130/150): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-08-31T05:16:49.926 INFO:teuthology.orchestra.run.smithi050.stdout:(51/150): boost-program-options-1.75.0-8.el9.x8 158 kB/s | 107 kB 00:00 2024-08-31T05:16:49.951 INFO:teuthology.orchestra.run.smithi005.stdout:(131/150): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-08-31T05:16:50.001 INFO:teuthology.orchestra.run.smithi005.stdout:(132/150): python3-grpcio-1.46.7-10.el9.x86_64. 5.5 MB/s | 2.0 MB 00:00 2024-08-31T05:16:50.018 INFO:teuthology.orchestra.run.smithi050.stdout:(52/150): elfutils-libelf-devel-0.191-4.el9.x86 40 kB/s | 22 kB 00:00 2024-08-31T05:16:50.026 INFO:teuthology.orchestra.run.smithi005.stdout:(133/150): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-08-31T05:16:50.043 INFO:teuthology.orchestra.run.smithi005.stdout:(134/150): python3-portend-3.1.0-2.el9.noarch.r 394 kB/s | 16 kB 00:00 2024-08-31T05:16:50.080 INFO:teuthology.orchestra.run.smithi070.stdout:(149/150): librados2-19.3.0-4560.gd19e6118.el9. 14 MB/s | 3.4 MB 00:00 2024-08-31T05:16:50.085 INFO:teuthology.orchestra.run.smithi005.stdout:(135/150): python3-kubernetes-26.1.0-2.el9.noar 4.7 MB/s | 1.0 MB 00:00 2024-08-31T05:16:50.111 INFO:teuthology.orchestra.run.smithi005.stdout:(136/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2024-08-31T05:16:50.136 INFO:teuthology.orchestra.run.smithi005.stdout:(137/150): python3-pyperclip-1.8.2-2.el9.noarch 305 kB/s | 28 kB 00:00 2024-08-31T05:16:50.161 INFO:teuthology.orchestra.run.smithi005.stdout:(138/150): python3-repoze-lru-0.7-16.el9.noarch 407 kB/s | 31 kB 00:00 2024-08-31T05:16:50.187 INFO:teuthology.orchestra.run.smithi005.stdout:(139/150): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-08-31T05:16:50.212 INFO:teuthology.orchestra.run.smithi005.stdout:(140/150): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-08-31T05:16:50.237 INFO:teuthology.orchestra.run.smithi005.stdout:(141/150): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-08-31T05:16:50.262 INFO:teuthology.orchestra.run.smithi005.stdout:(142/150): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-08-31T05:16:50.288 INFO:teuthology.orchestra.run.smithi005.stdout:(143/150): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-08-31T05:16:50.289 INFO:teuthology.orchestra.run.smithi070.stdout:(150/150): librbd1-19.3.0-4560.gd19e6118.el9.x8 7.4 MB/s | 3.1 MB 00:00 2024-08-31T05:16:50.294 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-08-31T05:16:50.295 INFO:teuthology.orchestra.run.smithi070.stdout:Total 19 MB/s | 224 MB 00:12 2024-08-31T05:16:50.313 INFO:teuthology.orchestra.run.smithi005.stdout:(144/150): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-08-31T05:16:50.338 INFO:teuthology.orchestra.run.smithi005.stdout:(145/150): python3-zc-lockfile-2.0-10.el9.noarc 397 kB/s | 20 kB 00:00 2024-08-31T05:16:50.364 INFO:teuthology.orchestra.run.smithi005.stdout:(146/150): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-08-31T05:16:50.389 INFO:teuthology.orchestra.run.smithi005.stdout:(147/150): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-08-31T05:16:50.402 INFO:teuthology.orchestra.run.smithi050.stdout:(53/150): flex-2.6.4-9.el9.x86_64.rpm 355 kB/s | 313 kB 00:00 2024-08-31T05:16:50.439 INFO:teuthology.orchestra.run.smithi005.stdout:(148/150): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-08-31T05:16:50.477 INFO:teuthology.orchestra.run.smithi050.stdout:(54/150): flexiblas-3.0.4-8.el9.x86_64.rpm 59 kB/s | 33 kB 00:00 2024-08-31T05:16:50.690 INFO:teuthology.orchestra.run.smithi005.stdout:(149/150): librbd1-19.3.0-4560.gd19e6118.el9.x8 10 MB/s | 3.1 MB 00:00 2024-08-31T05:16:50.748 INFO:teuthology.orchestra.run.smithi005.stdout:(150/150): librados2-19.3.0-4560.gd19e6118.el9. 8.8 MB/s | 3.4 MB 00:00 2024-08-31T05:16:50.755 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-08-31T05:16:50.755 INFO:teuthology.orchestra.run.smithi005.stdout:Total 21 MB/s | 224 MB 00:10 2024-08-31T05:16:50.910 INFO:teuthology.orchestra.run.smithi050.stdout:(55/150): flexiblas-openblas-openmp-3.0.4-8.el9 36 kB/s | 18 kB 00:00 2024-08-31T05:16:50.944 INFO:teuthology.orchestra.run.smithi050.stdout:(56/150): libaio-devel-0.3.111-13.el9.x86_64.rp 24 kB/s | 11 kB 00:00 2024-08-31T05:16:51.095 INFO:teuthology.orchestra.run.smithi050.stdout:(57/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.8 MB/s | 3.0 MB 00:01 2024-08-31T05:16:51.397 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-08-31T05:16:51.523 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-08-31T05:16:51.523 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-08-31T05:16:51.537 INFO:teuthology.orchestra.run.smithi050.stdout:(58/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 76 kB/s | 45 kB 00:00 2024-08-31T05:16:51.670 INFO:teuthology.orchestra.run.smithi050.stdout:(59/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 211 kB/s | 160 kB 00:00 2024-08-31T05:16:51.874 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-08-31T05:16:51.954 INFO:teuthology.orchestra.run.smithi050.stdout:(60/150): librdkafka-1.6.1-102.el9.x86_64.rpm 772 kB/s | 662 kB 00:00 2024-08-31T05:16:52.011 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-08-31T05:16:52.011 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-08-31T05:16:52.271 INFO:teuthology.orchestra.run.smithi050.stdout:(61/150): libuuid-devel-2.37.4-20.el9.x86_64.rp 41 kB/s | 24 kB 00:00 2024-08-31T05:16:52.479 INFO:teuthology.orchestra.run.smithi050.stdout:(62/150): libtool-2.4.6-46.el9.x86_64.rpm 617 kB/s | 581 kB 00:00 2024-08-31T05:16:52.588 INFO:teuthology.orchestra.run.smithi050.stdout:(63/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 75 kB/s | 47 kB 00:00 2024-08-31T05:16:53.047 INFO:teuthology.orchestra.run.smithi050.stdout:(64/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 378 kB/s | 292 kB 00:00 2024-08-31T05:16:53.155 INFO:teuthology.orchestra.run.smithi050.stdout:(65/150): openblas-0.3.26-2.el9.x86_64.rpm 68 kB/s | 38 kB 00:00 2024-08-31T05:16:53.197 INFO:teuthology.orchestra.run.smithi050.stdout:(66/150): lua-5.4.4-4.el9.x86_64.rpm 263 kB/s | 188 kB 00:00 2024-08-31T05:16:53.270 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-08-31T05:16:53.272 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-08-31T05:16:53.864 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-08-31T05:16:53.864 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-08-31T05:16:54.181 INFO:teuthology.orchestra.run.smithi050.stdout:(67/150): openblas-openmp-0.3.26-2.el9.x86_64.r 4.4 MB/s | 4.9 MB 00:01 2024-08-31T05:16:54.223 INFO:teuthology.orchestra.run.smithi050.stdout:(68/150): postgresql-13.16-1.el9.x86_64.rpm 1.5 MB/s | 1.6 MB 00:01 2024-08-31T05:16:54.290 INFO:teuthology.orchestra.run.smithi050.stdout:(69/150): openssl-devel-3.2.2-4.el9.x86_64.rpm 3.9 MB/s | 4.4 MB 00:01 2024-08-31T05:16:54.923 INFO:teuthology.orchestra.run.smithi050.stdout:(70/150): postgresql-private-libs-13.16-1.el9.x 196 kB/s | 137 kB 00:00 2024-08-31T05:16:55.115 INFO:teuthology.orchestra.run.smithi050.stdout:(71/150): postgresql-contrib-13.16-1.el9.x86_64 975 kB/s | 910 kB 00:00 2024-08-31T05:16:55.441 INFO:teuthology.orchestra.run.smithi050.stdout:(72/150): postgresql-server-13.16-1.el9.x86_64. 5.0 MB/s | 5.8 MB 00:01 2024-08-31T05:16:55.816 INFO:teuthology.orchestra.run.smithi050.stdout:(73/150): python3-attrs-20.3.0-7.el9.noarch.rpm 125 kB/s | 87 kB 00:00 2024-08-31T05:16:55.924 INFO:teuthology.orchestra.run.smithi050.stdout:(74/150): protobuf-3.14.0-13.el9.x86_64.rpm 1.0 MB/s | 1.0 MB 00:01 2024-08-31T05:16:56.433 INFO:teuthology.orchestra.run.smithi050.stdout:(75/150): python3-colorama-0.4.6-3.el9.noarch.r 99 kB/s | 61 kB 00:00 2024-08-31T05:16:56.625 INFO:teuthology.orchestra.run.smithi050.stdout:(76/150): python3-babel-2.9.1-2.el9.noarch.rpm 5.0 MB/s | 6.0 MB 00:01 2024-08-31T05:16:56.725 INFO:teuthology.orchestra.run.smithi050.stdout:(77/150): python3-devel-3.9.19-8.el9.x86_64.rpm 306 kB/s | 245 kB 00:00 2024-08-31T05:16:57.167 INFO:teuthology.orchestra.run.smithi050.stdout:(78/150): python3-jsonpatch-1.21-16.el9.noarch. 47 kB/s | 26 kB 00:00 2024-08-31T05:16:57.217 INFO:teuthology.orchestra.run.smithi050.stdout:(79/150): python3-jsonpointer-2.0-4.el9.noarch. 40 kB/s | 19 kB 00:00 2024-08-31T05:16:57.476 INFO:teuthology.orchestra.run.smithi050.stdout:(80/150): python3-jinja2-2.11.3-6.el9.noarch.rp 238 kB/s | 248 kB 00:01 2024-08-31T05:16:57.901 INFO:teuthology.orchestra.run.smithi050.stdout:(81/150): python3-markupsafe-1.1.1-12.el9.x86_6 51 kB/s | 35 kB 00:00 2024-08-31T05:16:58.069 INFO:teuthology.orchestra.run.smithi050.stdout:(82/150): python3-mako-1.1.4-6.el9.noarch.rpm 191 kB/s | 172 kB 00:00 2024-08-31T05:16:58.594 INFO:teuthology.orchestra.run.smithi050.stdout:(83/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.6 MB/s | 5.1 MB 00:01 2024-08-31T05:16:58.711 INFO:teuthology.orchestra.run.smithi050.stdout:(84/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 310 kB/s | 250 kB 00:00 2024-08-31T05:16:58.936 INFO:teuthology.orchestra.run.smithi050.stdout:(85/150): python3-oauthlib-3.1.1-5.el9.noarch.r 256 kB/s | 222 kB 00:00 2024-08-31T05:16:59.133 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-08-31T05:16:59.228 INFO:teuthology.orchestra.run.smithi050.stdout:(86/150): python3-packaging-20.9-5.el9.noarch.r 122 kB/s | 77 kB 00:00 2024-08-31T05:16:59.232 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-08-31T05:16:59.286 INFO:teuthology.orchestra.run.smithi050.stdout:(87/150): python3-prettytable-0.7.2-27.el9.noar 73 kB/s | 42 kB 00:00 2024-08-31T05:16:59.331 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-08-31T05:16:59.554 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-08-31T05:16:59.737 INFO:teuthology.orchestra.run.smithi050.stdout:(88/150): python3-protobuf-3.14.0-13.el9.noarch 340 kB/s | 269 kB 00:00 2024-08-31T05:16:59.844 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-08-31T05:16:59.893 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-08-31T05:16:59.945 INFO:teuthology.orchestra.run.smithi050.stdout:(89/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 221 kB/s | 159 kB 00:00 2024-08-31T05:16:59.993 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-08-31T05:17:00.009 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 5/152 2024-08-31T05:17:00.062 INFO:teuthology.orchestra.run.smithi050.stdout:(90/150): python3-pyasn1-modules-0.4.8-6.el9.no 360 kB/s | 279 kB 00:00 2024-08-31T05:17:00.126 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 5/152 2024-08-31T05:17:00.151 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-31T05:17:00.176 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-08-31T05:17:00.222 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-08-31T05:17:00.226 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-31T05:17:00.268 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 7/152 2024-08-31T05:17:00.297 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-08-31T05:17:00.322 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-08-31T05:17:00.329 INFO:teuthology.orchestra.run.smithi050.stdout:(91/150): python3-pytz-2021.1-5.el9.noarch.rpm 86 kB/s | 51 kB 00:00 2024-08-31T05:17:00.484 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 10/152 2024-08-31T05:17:00.545 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : postgresql-13.16-1.el9.x86_64 11/152 2024-08-31T05:17:00.546 INFO:teuthology.orchestra.run.smithi050.stdout:(92/150): python3-requests-oauthlib-1.3.0-12.el 89 kB/s | 54 kB 00:00 2024-08-31T05:17:00.573 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-31T05:17:00.613 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-08-31T05:17:00.670 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-31T05:17:00.707 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 13/152 2024-08-31T05:17:00.718 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 5/152 2024-08-31T05:17:00.770 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 13/152 2024-08-31T05:17:00.799 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-31T05:17:00.826 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-31T05:17:00.847 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 5/152 2024-08-31T05:17:00.878 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-31T05:17:00.905 INFO:teuthology.orchestra.run.smithi050.stdout:(93/150): python3-toml-0.10.2-6.el9.noarch.rpm 72 kB/s | 42 kB 00:00 2024-08-31T05:17:00.989 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-31T05:17:01.037 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 7/152 2024-08-31T05:17:01.065 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-08-31T05:17:01.091 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-08-31T05:17:01.130 INFO:teuthology.orchestra.run.smithi050.stdout:(94/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 77 kB/s | 44 kB 00:00 2024-08-31T05:17:01.138 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-31T05:17:01.174 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-31T05:17:01.254 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 10/152 2024-08-31T05:17:01.286 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/152 2024-08-31T05:17:01.306 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : postgresql-13.16-1.el9.x86_64 11/152 2024-08-31T05:17:01.314 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/152 2024-08-31T05:17:01.333 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-31T05:17:01.349 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/152 2024-08-31T05:17:01.423 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/152 2024-08-31T05:17:01.440 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-31T05:17:01.467 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 13/152 2024-08-31T05:17:01.477 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/152 2024-08-31T05:17:01.514 INFO:teuthology.orchestra.run.smithi050.stdout:(95/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-08-31T05:17:01.524 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-packaging-20.9-5.el9.noarch 21/152 2024-08-31T05:17:01.538 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 13/152 2024-08-31T05:17:01.560 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-31T05:17:01.577 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/152 2024-08-31T05:17:01.583 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-31T05:17:01.609 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/152 2024-08-31T05:17:01.645 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/152 2024-08-31T05:17:01.716 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/152 2024-08-31T05:17:01.768 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 26/152 2024-08-31T05:17:01.772 INFO:teuthology.orchestra.run.smithi050.stdout:(96/150): qatlib-24.02.0-1.el9.x86_64.rpm 255 kB/s | 221 kB 00:00 2024-08-31T05:17:01.797 INFO:teuthology.orchestra.run.smithi050.stdout:(97/150): qatlib-service-24.02.0-1.el9.x86_64.r 54 kB/s | 36 kB 00:00 2024-08-31T05:17:01.798 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/152 2024-08-31T05:17:01.842 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 28/152 2024-08-31T05:17:01.922 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-31T05:17:01.929 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 29/152 2024-08-31T05:17:01.960 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-31T05:17:01.960 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-ceph-common-2:19.3.0-4560.gd19e6118.el9. 30/152 2024-08-31T05:17:02.012 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el 31/152 2024-08-31T05:17:02.051 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_6 32/152 2024-08-31T05:17:02.072 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/152 2024-08-31T05:17:02.098 INFO:teuthology.orchestra.run.smithi050.stdout:(98/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 81 kB/s | 47 kB 00:00 2024-08-31T05:17:02.099 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/152 2024-08-31T05:17:02.124 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/152 2024-08-31T05:17:02.135 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/152 2024-08-31T05:17:02.175 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/152 2024-08-31T05:17:02.211 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/152 2024-08-31T05:17:02.250 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/152 2024-08-31T05:17:02.262 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/152 2024-08-31T05:17:02.301 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-packaging-20.9-5.el9.noarch 21/152 2024-08-31T05:17:02.345 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/152 2024-08-31T05:17:02.386 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/152 2024-08-31T05:17:02.388 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/152 2024-08-31T05:17:02.416 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/152 2024-08-31T05:17:02.423 INFO:teuthology.orchestra.run.smithi050.stdout:(99/150): uuid-1.6.2-55.el9.x86_64.rpm 92 kB/s | 58 kB 00:00 2024-08-31T05:17:02.436 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/152 2024-08-31T05:17:02.510 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/152 2024-08-31T05:17:02.565 INFO:teuthology.orchestra.run.smithi050.stdout:(100/150): socat-1.7.4.1-6.el9.x86_64.rpm 384 kB/s | 304 kB 00:00 2024-08-31T05:17:02.573 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 26/152 2024-08-31T05:17:02.602 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/152 2024-08-31T05:17:02.646 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 28/152 2024-08-31T05:17:02.725 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 29/152 2024-08-31T05:17:02.749 INFO:teuthology.orchestra.run.smithi050.stdout:(101/150): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 147 kB/s | 96 kB 00:00 2024-08-31T05:17:02.764 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-ceph-common-2:19.3.0-4560.gd19e6118.el9. 30/152 2024-08-31T05:17:02.808 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el 31/152 2024-08-31T05:17:02.836 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_6 32/152 2024-08-31T05:17:02.838 INFO:teuthology.orchestra.run.smithi050.stdout:(102/150): lua-devel-5.4.4-4.el9.x86_64.rpm 253 kB/s | 22 kB 00:00 2024-08-31T05:17:02.912 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/152 2024-08-31T05:17:02.969 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/152 2024-08-31T05:17:02.969 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/152 2024-08-31T05:17:03.004 INFO:teuthology.orchestra.run.smithi050.stdout:(103/150): protobuf-compiler-3.14.0-13.el9.x86_ 5.1 MB/s | 863 kB 00:00 2024-08-31T05:17:03.038 INFO:teuthology.orchestra.run.smithi050.stdout:(104/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 104 kB/s | 64 kB 00:00 2024-08-31T05:17:03.048 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/152 2024-08-31T05:17:03.048 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/152 2024-08-31T05:17:03.077 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 40/152 2024-08-31T05:17:03.088 INFO:teuthology.orchestra.run.smithi050.stdout:(105/150): abseil-cpp-20211102.0-3.el9.x86_64.r 6.4 MB/s | 548 kB 00:00 2024-08-31T05:17:03.106 INFO:teuthology.orchestra.run.smithi050.stdout:(106/150): grpc-data-1.46.7-10.el9.noarch.rpm 1.1 MB/s | 19 kB 00:00 2024-08-31T05:17:03.120 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/152 2024-08-31T05:17:03.131 INFO:teuthology.orchestra.run.smithi050.stdout:(107/150): gperftools-libs-2.9.1-2.el9.x86_64.r 3.3 MB/s | 309 kB 00:00 2024-08-31T05:17:03.162 INFO:teuthology.orchestra.run.smithi050.stdout:(108/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 75 kB/s | 45 kB 00:00 2024-08-31T05:17:03.166 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_6 42/152 2024-08-31T05:17:03.187 INFO:teuthology.orchestra.run.smithi050.stdout:(109/150): libarrow-doc-9.0.0-11.el9.noarch.rpm 474 kB/s | 26 kB 00:00 2024-08-31T05:17:03.195 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/152 2024-08-31T05:17:03.207 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/152 2024-08-31T05:17:03.229 INFO:teuthology.orchestra.run.smithi050.stdout:(110/150): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-08-31T05:17:03.257 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/152 2024-08-31T05:17:03.263 INFO:teuthology.orchestra.run.smithi050.stdout:(111/150): liboath-2.6.7-2.el9.x86_64.rpm 484 kB/s | 49 kB 00:00 2024-08-31T05:17:03.288 INFO:teuthology.orchestra.run.smithi050.stdout:(112/150): luarocks-3.9.2-5.el9.noarch.rpm 2.6 MB/s | 151 kB 00:00 2024-08-31T05:17:03.300 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/152 2024-08-31T05:17:03.338 INFO:teuthology.orchestra.run.smithi050.stdout:(113/150): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-08-31T05:17:03.363 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 45/152 2024-08-31T05:17:03.364 INFO:teuthology.orchestra.run.smithi050.stdout:(114/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-08-31T05:17:03.389 INFO:teuthology.orchestra.run.smithi050.stdout:(115/150): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-08-31T05:17:03.431 INFO:teuthology.orchestra.run.smithi050.stdout:(116/150): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.9 MB/s | 839 kB 00:00 2024-08-31T05:17:03.436 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/152 2024-08-31T05:17:03.447 INFO:teuthology.orchestra.run.smithi050.stdout:(117/150): python3-certifi-2023.05.07-4.el9.noa 242 kB/s | 14 kB 00:00 2024-08-31T05:17:03.468 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 47/152 2024-08-31T05:17:03.504 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 48/152 2024-08-31T05:17:03.514 INFO:teuthology.orchestra.run.smithi050.stdout:(118/150): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-08-31T05:17:03.548 INFO:teuthology.orchestra.run.smithi050.stdout:(119/150): python3-cheroot-8.6.0-4.el9.noarch.r 1.4 MB/s | 172 kB 00:00 2024-08-31T05:17:03.551 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/152 2024-08-31T05:17:03.573 INFO:teuthology.orchestra.run.smithi050.stdout:(120/150): python3-cherrypy-18.6.1-2.el9.noarch 2.8 MB/s | 358 kB 00:00 2024-08-31T05:17:03.596 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/152 2024-08-31T05:17:03.599 INFO:teuthology.orchestra.run.smithi050.stdout:(121/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.5 MB/s | 303 kB 00:00 2024-08-31T05:17:03.624 INFO:teuthology.orchestra.run.smithi050.stdout:(122/150): python3-google-auth-2.34.0-1.el9.noa 2.8 MB/s | 220 kB 00:00 2024-08-31T05:17:03.647 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/152 2024-08-31T05:17:03.650 INFO:teuthology.orchestra.run.smithi050.stdout:(123/150): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-08-31T05:17:03.675 INFO:teuthology.orchestra.run.smithi050.stdout:(124/150): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-08-31T05:17:03.689 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/152 2024-08-31T05:17:03.700 INFO:teuthology.orchestra.run.smithi050.stdout:(125/150): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-08-31T05:17:03.725 INFO:teuthology.orchestra.run.smithi050.stdout:(126/150): python3-jaraco-collections-3.0.0-8.e 463 kB/s | 23 kB 00:00 2024-08-31T05:17:03.751 INFO:teuthology.orchestra.run.smithi050.stdout:(127/150): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-08-31T05:17:03.776 INFO:teuthology.orchestra.run.smithi050.stdout:(128/150): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-08-31T05:17:03.801 INFO:teuthology.orchestra.run.smithi050.stdout:(129/150): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-31T05:17:03.820 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/152 2024-08-31T05:17:03.826 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/152 2024-08-31T05:17:03.827 INFO:teuthology.orchestra.run.smithi050.stdout:(130/150): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-08-31T05:17:03.852 INFO:teuthology.orchestra.run.smithi050.stdout:(131/150): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-08-31T05:17:03.866 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/152 2024-08-31T05:17:03.885 INFO:teuthology.orchestra.run.smithi050.stdout:(132/150): python3-kubernetes-26.1.0-2.el9.noar 7.6 MB/s | 1.0 MB 00:00 2024-08-31T05:17:03.908 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/152 2024-08-31T05:17:03.911 INFO:teuthology.orchestra.run.smithi050.stdout:(133/150): python3-portend-3.1.0-2.el9.noarch.r 656 kB/s | 16 kB 00:00 2024-08-31T05:17:03.920 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/152 2024-08-31T05:17:03.953 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 40/152 2024-08-31T05:17:03.961 INFO:teuthology.orchestra.run.smithi050.stdout:(134/150): python3-grpcio-1.46.7-10.el9.x86_64. 5.3 MB/s | 2.0 MB 00:00 2024-08-31T05:17:03.986 INFO:teuthology.orchestra.run.smithi050.stdout:(135/150): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2024-08-31T05:17:03.997 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/152 2024-08-31T05:17:04.003 INFO:teuthology.orchestra.run.smithi050.stdout:(136/150): python3-pyperclip-1.8.2-2.el9.noarch 674 kB/s | 28 kB 00:00 2024-08-31T05:17:04.010 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-08-31T05:17:04.029 INFO:teuthology.orchestra.run.smithi050.stdout:(137/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 765 kB/s | 90 kB 00:00 2024-08-31T05:17:04.041 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 57/152 2024-08-31T05:17:04.045 INFO:teuthology.orchestra.run.smithi050.stdout:(138/150): python3-repoze-lru-0.7-16.el9.noarch 524 kB/s | 31 kB 00:00 2024-08-31T05:17:04.051 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_6 42/152 2024-08-31T05:17:04.071 INFO:teuthology.orchestra.run.smithi050.stdout:(139/150): python3-rsa-4.9-2.el9.noarch.rpm 1.4 MB/s | 59 kB 00:00 2024-08-31T05:17:04.081 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-08-31T05:17:04.085 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/152 2024-08-31T05:17:04.088 INFO:teuthology.orchestra.run.smithi050.stdout:(140/150): python3-tempora-5.0.0-2.el9.noarch.r 854 kB/s | 36 kB 00:00 2024-08-31T05:17:04.113 INFO:teuthology.orchestra.run.smithi050.stdout:(141/150): python3-typing-extensions-4.12.2-2.e 1.7 MB/s | 74 kB 00:00 2024-08-31T05:17:04.115 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-08-31T05:17:04.138 INFO:teuthology.orchestra.run.smithi050.stdout:(142/150): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-08-31T05:17:04.140 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/152 2024-08-31T05:17:04.164 INFO:teuthology.orchestra.run.smithi050.stdout:(143/150): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-08-31T05:17:04.189 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/152 2024-08-31T05:17:04.197 INFO:teuthology.orchestra.run.smithi050.stdout:(144/150): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-08-31T05:17:04.215 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-08-31T05:17:04.222 INFO:teuthology.orchestra.run.smithi050.stdout:(145/150): python3-zc-lockfile-2.0-10.el9.noarc 341 kB/s | 20 kB 00:00 2024-08-31T05:17:04.248 INFO:teuthology.orchestra.run.smithi050.stdout:(146/150): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-08-31T05:17:04.259 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 45/152 2024-08-31T05:17:04.273 INFO:teuthology.orchestra.run.smithi050.stdout:(147/150): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-08-31T05:17:04.323 INFO:teuthology.orchestra.run.smithi050.stdout:(148/150): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-08-31T05:17:04.334 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/152 2024-08-31T05:17:04.343 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-08-31T05:17:04.378 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 47/152 2024-08-31T05:17:04.381 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-08-31T05:17:04.409 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-08-31T05:17:04.414 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 48/152 2024-08-31T05:17:04.443 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-08-31T05:17:04.462 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/152 2024-08-31T05:17:04.487 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-08-31T05:17:04.497 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/152 2024-08-31T05:17:04.525 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 67/152 2024-08-31T05:17:04.542 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/152 2024-08-31T05:17:04.565 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-08-31T05:17:04.574 INFO:teuthology.orchestra.run.smithi050.stdout:(149/150): librbd1-19.3.0-4560.gd19e6118.el9.x8 10 MB/s | 3.1 MB 00:00 2024-08-31T05:17:04.583 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/152 2024-08-31T05:17:04.595 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-08-31T05:17:04.629 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-08-31T05:17:04.663 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-08-31T05:17:04.736 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/152 2024-08-31T05:17:04.784 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/152 2024-08-31T05:17:04.815 INFO:teuthology.orchestra.run.smithi050.stdout:(150/150): librados2-19.3.0-4560.gd19e6118.el9. 6.0 MB/s | 3.4 MB 00:00 2024-08-31T05:17:04.822 INFO:teuthology.orchestra.run.smithi050.stdout:-------------------------------------------------------------------------------- 2024-08-31T05:17:04.822 INFO:teuthology.orchestra.run.smithi050.stdout:Total 8.4 MB/s | 224 MB 00:26 2024-08-31T05:17:04.826 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/152 2024-08-31T05:17:04.889 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-08-31T05:17:04.931 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-08-31T05:17:04.934 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-08-31T05:17:04.967 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 57/152 2024-08-31T05:17:05.008 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-08-31T05:17:05.030 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-08-31T05:17:05.033 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-08-31T05:17:05.057 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/152 2024-08-31T05:17:05.078 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-08-31T05:17:05.117 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-08-31T05:17:05.136 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-08-31T05:17:05.223 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-08-31T05:17:05.277 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 78/152 2024-08-31T05:17:05.283 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-08-31T05:17:05.540 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-08-31T05:17:05.568 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-08-31T05:17:05.603 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-08-31T05:17:05.647 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-08-31T05:17:05.685 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 67/152 2024-08-31T05:17:05.724 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-08-31T05:17:05.754 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-08-31T05:17:05.788 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-08-31T05:17:05.830 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-08-31T05:17:05.872 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-08-31T05:17:05.906 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-08-31T05:17:05.942 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction check 2024-08-31T05:17:05.998 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-08-31T05:17:06.021 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 79/152 2024-08-31T05:17:06.046 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-08-31T05:17:06.066 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 80/152 2024-08-31T05:17:06.076 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-08-31T05:17:06.080 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction check succeeded. 2024-08-31T05:17:06.080 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction test 2024-08-31T05:17:06.099 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 81/152 2024-08-31T05:17:06.185 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-08-31T05:17:06.203 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 82/152 2024-08-31T05:17:06.237 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 78/152 2024-08-31T05:17:06.257 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 83/152 2024-08-31T05:17:06.302 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 84/152 2024-08-31T05:17:06.393 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-08-31T05:17:06.455 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-08-31T05:17:06.646 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : openblas-0.3.26-2.el9.x86_64 87/152 2024-08-31T05:17:06.677 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 88/152 2024-08-31T05:17:06.755 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-08-31T05:17:07.025 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 79/152 2024-08-31T05:17:07.075 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 80/152 2024-08-31T05:17:07.125 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 81/152 2024-08-31T05:17:07.234 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 82/152 2024-08-31T05:17:07.285 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 83/152 2024-08-31T05:17:07.338 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 84/152 2024-08-31T05:17:07.412 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-08-31T05:17:07.429 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-08-31T05:17:07.473 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-08-31T05:17:07.544 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-08-31T05:17:07.672 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openblas-0.3.26-2.el9.x86_64 87/152 2024-08-31T05:17:07.711 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 88/152 2024-08-31T05:17:07.791 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-08-31T05:17:07.933 INFO:teuthology.orchestra.run.smithi050.stdout:Transaction test succeeded. 2024-08-31T05:17:07.933 INFO:teuthology.orchestra.run.smithi050.stdout:Running transaction 2024-08-31T05:17:08.486 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-08-31T05:17:08.608 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-08-31T05:17:08.795 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-08-31T05:17:08.874 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-31T05:17:08.910 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-08-31T05:17:08.951 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 95/152 2024-08-31T05:17:09.279 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-08-31T05:17:09.322 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 97/152 2024-08-31T05:17:09.414 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 97/152 2024-08-31T05:17:09.444 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 98/152 2024-08-31T05:17:09.480 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-08-31T05:17:09.930 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-08-31T05:17:09.976 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 100/152 2024-08-31T05:17:10.009 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 101/152 2024-08-31T05:17:10.024 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-31T05:17:10.052 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-08-31T05:17:10.081 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 101/152 2024-08-31T05:17:10.085 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 95/152 2024-08-31T05:17:10.111 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 102/152 2024-08-31T05:17:10.468 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-08-31T05:17:10.606 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 97/152 2024-08-31T05:17:10.699 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 97/152 2024-08-31T05:17:10.728 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 98/152 2024-08-31T05:17:10.764 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-08-31T05:17:11.290 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 100/152 2024-08-31T05:17:11.326 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 101/152 2024-08-31T05:17:11.397 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 101/152 2024-08-31T05:17:11.427 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 102/152 2024-08-31T05:17:12.383 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-31T05:17:12.427 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-31T05:17:12.997 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-31T05:17:13.035 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 104/152 2024-08-31T05:17:13.111 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 104/152 2024-08-31T05:17:13.111 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-31T05:17:13.112 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-31T05:17:13.112 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-08-31T05:17:13.145 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 105/152 2024-08-31T05:17:13.828 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-31T05:17:13.860 INFO:teuthology.orchestra.run.smithi050.stdout: Preparing : 1/1 2024-08-31T05:17:13.866 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-31T05:17:13.952 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-08-31T05:17:13.977 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-08-31T05:17:14.021 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-08-31T05:17:14.379 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-08-31T05:17:14.463 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-31T05:17:14.494 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 5/152 2024-08-31T05:17:14.502 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 104/152 2024-08-31T05:17:14.593 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 104/152 2024-08-31T05:17:14.593 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-31T05:17:14.593 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-31T05:17:14.593 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:17:14.620 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 105/152 2024-08-31T05:17:14.624 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 5/152 2024-08-31T05:17:14.645 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-31T05:17:14.738 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-31T05:17:14.788 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 7/152 2024-08-31T05:17:14.825 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-08-31T05:17:14.850 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-08-31T05:17:15.015 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 10/152 2024-08-31T05:17:15.082 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : postgresql-13.16-1.el9.x86_64 11/152 2024-08-31T05:17:15.109 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-31T05:17:15.217 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-31T05:17:15.252 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 13/152 2024-08-31T05:17:15.315 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 13/152 2024-08-31T05:17:15.336 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-31T05:17:15.360 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-31T05:17:15.616 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-31T05:17:15.653 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-31T05:17:15.764 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/152 2024-08-31T05:17:15.793 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/152 2024-08-31T05:17:15.830 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/152 2024-08-31T05:17:15.905 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/152 2024-08-31T05:17:15.956 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/152 2024-08-31T05:17:15.995 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-packaging-20.9-5.el9.noarch 21/152 2024-08-31T05:17:16.038 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/152 2024-08-31T05:17:16.079 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/152 2024-08-31T05:17:16.115 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/152 2024-08-31T05:17:16.189 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/152 2024-08-31T05:17:16.239 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 26/152 2024-08-31T05:17:16.267 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/152 2024-08-31T05:17:16.312 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 28/152 2024-08-31T05:17:16.393 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 29/152 2024-08-31T05:17:16.431 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-ceph-common-2:19.3.0-4560.gd19e6118.el9. 30/152 2024-08-31T05:17:16.475 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el 31/152 2024-08-31T05:17:16.503 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_6 32/152 2024-08-31T05:17:16.586 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/152 2024-08-31T05:17:16.646 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/152 2024-08-31T05:17:16.731 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/152 2024-08-31T05:17:16.879 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/152 2024-08-31T05:17:16.931 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/152 2024-08-31T05:17:17.507 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/152 2024-08-31T05:17:17.595 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/152 2024-08-31T05:17:17.628 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 40/152 2024-08-31T05:17:17.671 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/152 2024-08-31T05:17:17.710 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_6 42/152 2024-08-31T05:17:17.743 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/152 2024-08-31T05:17:17.840 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/152 2024-08-31T05:17:17.910 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 45/152 2024-08-31T05:17:17.985 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/152 2024-08-31T05:17:18.028 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 47/152 2024-08-31T05:17:18.064 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 48/152 2024-08-31T05:17:18.113 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/152 2024-08-31T05:17:18.147 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/152 2024-08-31T05:17:18.191 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/152 2024-08-31T05:17:18.233 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/152 2024-08-31T05:17:18.380 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/152 2024-08-31T05:17:18.426 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/152 2024-08-31T05:17:18.468 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/152 2024-08-31T05:17:18.579 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-08-31T05:17:18.609 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 57/152 2024-08-31T05:17:18.649 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-08-31T05:17:18.682 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-08-31T05:17:18.707 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/152 2024-08-31T05:17:18.786 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-08-31T05:17:18.946 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-08-31T05:17:18.981 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-08-31T05:17:19.009 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-08-31T05:17:19.044 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-08-31T05:17:19.089 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-08-31T05:17:19.126 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 67/152 2024-08-31T05:17:19.166 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-08-31T05:17:19.196 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-08-31T05:17:19.230 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-08-31T05:17:19.264 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-08-31T05:17:19.306 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-08-31T05:17:19.340 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-08-31T05:17:19.440 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-08-31T05:17:19.497 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-08-31T05:17:19.526 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-08-31T05:17:19.637 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-08-31T05:17:19.696 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 78/152 2024-08-31T05:17:20.490 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 79/152 2024-08-31T05:17:20.542 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 80/152 2024-08-31T05:17:20.575 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 81/152 2024-08-31T05:17:20.684 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 82/152 2024-08-31T05:17:20.740 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 83/152 2024-08-31T05:17:20.803 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 84/152 2024-08-31T05:17:20.895 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-08-31T05:17:20.929 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-08-31T05:17:21.120 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : openblas-0.3.26-2.el9.x86_64 87/152 2024-08-31T05:17:21.151 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 88/152 2024-08-31T05:17:21.231 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-08-31T05:17:21.938 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-08-31T05:17:22.065 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-08-31T05:17:23.419 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-08-31T05:17:23.514 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-31T05:17:23.543 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-08-31T05:17:23.575 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 95/152 2024-08-31T05:17:23.920 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-08-31T05:17:23.972 INFO:teuthology.orchestra.run.smithi050.stdout: Upgrading : librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 97/152 2024-08-31T05:17:24.063 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 97/152 2024-08-31T05:17:24.093 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 98/152 2024-08-31T05:17:24.129 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-08-31T05:17:24.654 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 100/152 2024-08-31T05:17:24.690 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 101/152 2024-08-31T05:17:24.762 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 101/152 2024-08-31T05:17:24.800 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 102/152 2024-08-31T05:17:24.994 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 105/152 2024-08-31T05:17:24.994 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /sys 2024-08-31T05:17:24.994 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /proc 2024-08-31T05:17:24.994 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /mnt 2024-08-31T05:17:24.994 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /var/tmp 2024-08-31T05:17:24.994 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /home 2024-08-31T05:17:24.994 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /root 2024-08-31T05:17:24.995 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /tmp 2024-08-31T05:17:24.995 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-08-31T05:17:25.177 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 106/152 2024-08-31T05:17:25.196 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 106/152 2024-08-31T05:17:25.196 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:17:25.196 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-31T05:17:25.196 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-08-31T05:17:26.562 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 105/152 2024-08-31T05:17:26.562 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /sys 2024-08-31T05:17:26.562 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /proc 2024-08-31T05:17:26.562 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /mnt 2024-08-31T05:17:26.562 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /var/tmp 2024-08-31T05:17:26.562 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /home 2024-08-31T05:17:26.562 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /root 2024-08-31T05:17:26.562 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /tmp 2024-08-31T05:17:26.562 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:17:26.744 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 106/152 2024-08-31T05:17:26.760 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 106/152 2024-08-31T05:17:26.760 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:17:26.760 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-31T05:17:26.760 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:17:26.788 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 107/152 2024-08-31T05:17:26.815 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 107/152 2024-08-31T05:17:26.816 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:17:26.816 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-31T05:17:26.816 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-31T05:17:26.816 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-31T05:17:26.816 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-08-31T05:17:27.044 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 108/152 2024-08-31T05:17:27.065 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 108/152 2024-08-31T05:17:27.065 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:17:27.066 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-31T05:17:27.066 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-31T05:17:27.066 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-31T05:17:27.066 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-08-31T05:17:27.157 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-31T05:17:27.188 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-31T05:17:27.526 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 109/152 2024-08-31T05:17:27.550 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 109/152 2024-08-31T05:17:27.550 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:17:27.550 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-31T05:17:27.550 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-31T05:17:27.550 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-31T05:17:27.550 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-08-31T05:17:27.665 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-08-31T05:17:27.721 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-08-31T05:17:27.785 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-08-31T05:17:27.789 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-31T05:17:27.833 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 104/152 2024-08-31T05:17:27.926 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 104/152 2024-08-31T05:17:27.926 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-31T05:17:27.926 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-31T05:17:27.926 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T05:17:27.979 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-08-31T05:17:27.985 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 105/152 2024-08-31T05:17:28.027 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-08-31T05:17:28.104 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-08-31T05:17:28.193 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-08-31T05:17:28.342 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-08-31T05:17:28.386 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-08-31T05:17:28.406 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 107/152 2024-08-31T05:17:28.417 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-08-31T05:17:28.433 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 107/152 2024-08-31T05:17:28.434 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:17:28.434 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-31T05:17:28.434 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-31T05:17:28.434 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-31T05:17:28.434 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:17:28.445 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : fuse-2.9.9-16.el9.x86_64 120/152 2024-08-31T05:17:28.669 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 108/152 2024-08-31T05:17:28.692 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 108/152 2024-08-31T05:17:28.692 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:17:28.692 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-31T05:17:28.692 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-31T05:17:28.692 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-31T05:17:28.693 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:17:28.917 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 121/152 2024-08-31T05:17:28.944 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 121/152 2024-08-31T05:17:28.985 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.e 122/152 2024-08-31T05:17:29.051 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118. 123/152 2024-08-31T05:17:29.076 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 124/152 2024-08-31T05:17:29.178 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 109/152 2024-08-31T05:17:29.201 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 109/152 2024-08-31T05:17:29.201 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:17:29.201 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-31T05:17:29.201 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-31T05:17:29.201 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-31T05:17:29.201 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:17:29.309 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-08-31T05:17:29.367 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-08-31T05:17:29.430 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-08-31T05:17:29.632 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-08-31T05:17:29.679 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-08-31T05:17:29.759 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-08-31T05:17:29.857 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-08-31T05:17:30.015 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-08-31T05:17:30.054 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-08-31T05:17:30.086 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-08-31T05:17:30.113 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : fuse-2.9.9-16.el9.x86_64 120/152 2024-08-31T05:17:30.564 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 121/152 2024-08-31T05:17:30.596 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 121/152 2024-08-31T05:17:30.629 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.e 122/152 2024-08-31T05:17:30.699 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118. 123/152 2024-08-31T05:17:30.727 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 124/152 2024-08-31T05:17:32.251 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 124/152 2024-08-31T05:17:32.315 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 125/152 2024-08-31T05:17:33.278 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 125/152 2024-08-31T05:17:33.307 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 126/152 2024-08-31T05:17:33.421 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 126/152 2024-08-31T05:17:33.591 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el 127/152 2024-08-31T05:17:33.618 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 128/152 2024-08-31T05:17:33.642 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 128/152 2024-08-31T05:17:33.642 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:17:33.642 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-31T05:17:33.642 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-31T05:17:33.642 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-31T05:17:33.642 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-08-31T05:17:33.701 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 129/152 2024-08-31T05:17:33.713 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 129/152 2024-08-31T05:17:33.820 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 130/152 2024-08-31T05:17:33.874 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 131/152 2024-08-31T05:17:34.079 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 124/152 2024-08-31T05:17:34.142 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 125/152 2024-08-31T05:17:34.835 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libtool-2.4.6-46.el9.x86_64 132/152 2024-08-31T05:17:34.871 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 133/152 2024-08-31T05:17:34.894 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 133/152 2024-08-31T05:17:34.894 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:17:34.895 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-31T05:17:34.895 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-31T05:17:34.895 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-31T05:17:34.895 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-08-31T05:17:34.938 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 134/152 2024-08-31T05:17:34.961 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 134/152 2024-08-31T05:17:34.961 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:17:34.962 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-31T05:17:34.962 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-08-31T05:17:35.014 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 135/152 2024-08-31T05:17:35.037 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 135/152 2024-08-31T05:17:35.037 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:17:35.037 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-31T05:17:35.037 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-31T05:17:35.038 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-31T05:17:35.038 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-08-31T05:17:35.156 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 125/152 2024-08-31T05:17:35.183 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 126/152 2024-08-31T05:17:35.302 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 126/152 2024-08-31T05:17:35.356 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 136/152 2024-08-31T05:17:35.379 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 136/152 2024-08-31T05:17:35.379 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:17:35.379 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-31T05:17:35.379 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-31T05:17:35.379 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-31T05:17:35.380 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-08-31T05:17:35.475 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el 127/152 2024-08-31T05:17:35.502 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 128/152 2024-08-31T05:17:35.526 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 128/152 2024-08-31T05:17:35.527 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:17:35.527 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-31T05:17:35.527 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-31T05:17:35.527 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-31T05:17:35.527 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:17:35.578 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 129/152 2024-08-31T05:17:35.590 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 129/152 2024-08-31T05:17:35.693 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 130/152 2024-08-31T05:17:35.744 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 131/152 2024-08-31T05:17:36.759 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libtool-2.4.6-46.el9.x86_64 132/152 2024-08-31T05:17:36.798 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 133/152 2024-08-31T05:17:36.821 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 133/152 2024-08-31T05:17:36.821 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:17:36.821 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-31T05:17:36.821 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-31T05:17:36.821 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-31T05:17:36.821 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:17:36.865 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 134/152 2024-08-31T05:17:36.887 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 134/152 2024-08-31T05:17:36.887 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:17:36.887 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-31T05:17:36.887 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:17:36.940 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 135/152 2024-08-31T05:17:36.963 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 135/152 2024-08-31T05:17:36.964 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:17:36.964 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-31T05:17:36.964 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-31T05:17:36.964 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-31T05:17:36.964 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:17:37.300 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 136/152 2024-08-31T05:17:37.323 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 136/152 2024-08-31T05:17:37.323 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:17:37.323 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-31T05:17:37.323 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-31T05:17:37.323 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-31T05:17:37.323 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:17:39.710 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 137/152 2024-08-31T05:17:39.751 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 138/152 2024-08-31T05:17:39.800 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 139/152 2024-08-31T05:17:39.840 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 140/152 2024-08-31T05:17:39.876 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 141/152 2024-08-31T05:17:40.059 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 142/152 2024-08-31T05:17:40.107 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 143/152 2024-08-31T05:17:40.137 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_ 144/152 2024-08-31T05:17:40.294 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 105/152 2024-08-31T05:17:40.294 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /sys 2024-08-31T05:17:40.294 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /proc 2024-08-31T05:17:40.294 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /mnt 2024-08-31T05:17:40.294 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /var/tmp 2024-08-31T05:17:40.294 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /home 2024-08-31T05:17:40.295 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /root 2024-08-31T05:17:40.295 INFO:teuthology.orchestra.run.smithi050.stdout:skipping the directory /tmp 2024-08-31T05:17:40.295 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T05:17:40.483 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 106/152 2024-08-31T05:17:40.498 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 106/152 2024-08-31T05:17:40.499 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:17:40.499 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-31T05:17:40.499 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T05:17:40.759 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-31T05:17:40.802 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-31T05:17:40.822 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-31T05:17:41.652 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 146/152 2024-08-31T05:17:41.740 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : openssl-devel-1:3.2.2-4.el9.x86_64 147/152 2024-08-31T05:17:41.781 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-08-31T05:17:41.861 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-08-31T05:17:41.903 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-08-31T05:17:41.903 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-31T05:17:41.937 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 137/152 2024-08-31T05:17:41.978 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 138/152 2024-08-31T05:17:41.986 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-31T05:17:41.986 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-31T05:17:42.019 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 139/152 2024-08-31T05:17:42.051 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 140/152 2024-08-31T05:17:42.078 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 141/152 2024-08-31T05:17:42.161 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 107/152 2024-08-31T05:17:42.188 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 107/152 2024-08-31T05:17:42.188 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:17:42.188 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-31T05:17:42.188 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-31T05:17:42.188 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-31T05:17:42.188 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T05:17:42.269 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 142/152 2024-08-31T05:17:42.316 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 143/152 2024-08-31T05:17:42.346 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_ 144/152 2024-08-31T05:17:42.420 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 108/152 2024-08-31T05:17:42.443 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 108/152 2024-08-31T05:17:42.443 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:17:42.443 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-31T05:17:42.443 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-31T05:17:42.443 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-31T05:17:42.443 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T05:17:42.929 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 109/152 2024-08-31T05:17:42.952 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 109/152 2024-08-31T05:17:42.952 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:17:42.952 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-31T05:17:42.953 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-31T05:17:42.953 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-31T05:17:42.953 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T05:17:42.979 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-31T05:17:43.019 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-31T05:17:43.039 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-31T05:17:43.062 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-08-31T05:17:43.121 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-08-31T05:17:43.185 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-08-31T05:17:43.387 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-08-31T05:17:43.442 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-08-31T05:17:43.522 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-08-31T05:17:43.611 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-08-31T05:17:43.762 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-08-31T05:17:43.800 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-08-31T05:17:43.832 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-08-31T05:17:43.859 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : fuse-2.9.9-16.el9.x86_64 120/152 2024-08-31T05:17:43.923 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 146/152 2024-08-31T05:17:44.026 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openssl-devel-1:3.2.2-4.el9.x86_64 147/152 2024-08-31T05:17:44.068 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-08-31T05:17:44.161 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-08-31T05:17:44.197 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-08-31T05:17:44.197 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-31T05:17:44.297 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-31T05:17:44.298 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-31T05:17:44.324 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 121/152 2024-08-31T05:17:44.350 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 121/152 2024-08-31T05:17:44.383 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.e 122/152 2024-08-31T05:17:44.451 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118. 123/152 2024-08-31T05:17:44.481 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 124/152 2024-08-31T05:17:47.854 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 124/152 2024-08-31T05:17:47.912 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 125/152 2024-08-31T05:17:48.828 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-31T05:17:48.828 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 1/152 2024-08-31T05:17:48.828 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 2/152 2024-08-31T05:17:48.829 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 3/152 2024-08-31T05:17:48.829 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 4/152 2024-08-31T05:17:48.829 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 5/152 2024-08-31T05:17:48.829 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-31T05:17:48.829 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 7/152 2024-08-31T05:17:48.829 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 8/152 2024-08-31T05:17:48.829 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 9/152 2024-08-31T05:17:48.829 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 10/152 2024-08-31T05:17:48.829 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 11/152 2024-08-31T05:17:48.829 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-31T05:17:48.829 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 13/152 2024-08-31T05:17:48.829 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 14/152 2024-08-31T05:17:48.829 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_ 15/152 2024-08-31T05:17:48.830 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 16/152 2024-08-31T05:17:48.830 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 17/152 2024-08-31T05:17:48.830 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_6 18/152 2024-08-31T05:17:48.830 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 19/152 2024-08-31T05:17:48.830 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 20/152 2024-08-31T05:17:48.830 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el 21/152 2024-08-31T05:17:48.830 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-ceph-common-2:19.3.0-4560.gd19e6118.el9. 22/152 2024-08-31T05:17:48.830 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_6 23/152 2024-08-31T05:17:48.830 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 24/152 2024-08-31T05:17:48.830 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 25/152 2024-08-31T05:17:48.830 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 26/152 2024-08-31T05:17:48.841 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 27/152 2024-08-31T05:17:48.841 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 28/152 2024-08-31T05:17:48.841 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 29/152 2024-08-31T05:17:48.841 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118. 30/152 2024-08-31T05:17:48.841 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 31/152 2024-08-31T05:17:48.841 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 32/152 2024-08-31T05:17:48.841 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 33/152 2024-08-31T05:17:48.841 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el 34/152 2024-08-31T05:17:48.842 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 35/152 2024-08-31T05:17:48.842 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.e 36/152 2024-08-31T05:17:48.842 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 37/152 2024-08-31T05:17:48.842 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 38/152 2024-08-31T05:17:48.842 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 39/152 2024-08-31T05:17:48.842 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/152 2024-08-31T05:17:48.842 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/152 2024-08-31T05:17:48.842 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/152 2024-08-31T05:17:48.842 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-08-31T05:17:48.842 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-08-31T05:17:48.842 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-08-31T05:17:48.842 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-08-31T05:17:48.842 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-08-31T05:17:48.843 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/152 2024-08-31T05:17:48.843 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-08-31T05:17:48.843 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-08-31T05:17:48.843 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-08-31T05:17:48.843 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/152 2024-08-31T05:17:48.843 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-08-31T05:17:48.843 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-08-31T05:17:48.843 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-08-31T05:17:48.843 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-08-31T05:17:48.843 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-08-31T05:17:48.843 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-08-31T05:17:48.843 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-08-31T05:17:48.843 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-08-31T05:17:48.843 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/152 2024-08-31T05:17:48.843 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/152 2024-08-31T05:17:48.844 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-08-31T05:17:48.844 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-08-31T05:17:48.844 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-08-31T05:17:48.844 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/152 2024-08-31T05:17:48.844 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/152 2024-08-31T05:17:48.844 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openssl-devel-1:3.2.2-4.el9.x86_64 68/152 2024-08-31T05:17:48.844 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/152 2024-08-31T05:17:48.844 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/152 2024-08-31T05:17:48.844 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/152 2024-08-31T05:17:48.844 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/152 2024-08-31T05:17:48.844 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-08-31T05:17:48.844 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-08-31T05:17:48.844 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-08-31T05:17:48.845 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/152 2024-08-31T05:17:48.845 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/152 2024-08-31T05:17:48.845 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/152 2024-08-31T05:17:48.845 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/152 2024-08-31T05:17:48.845 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/152 2024-08-31T05:17:48.845 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/152 2024-08-31T05:17:48.845 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/152 2024-08-31T05:17:48.845 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/152 2024-08-31T05:17:48.845 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/152 2024-08-31T05:17:48.845 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/152 2024-08-31T05:17:48.845 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/152 2024-08-31T05:17:48.845 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/152 2024-08-31T05:17:48.845 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/152 2024-08-31T05:17:48.846 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/152 2024-08-31T05:17:48.846 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/152 2024-08-31T05:17:48.846 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/152 2024-08-31T05:17:48.846 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/152 2024-08-31T05:17:48.846 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-31T05:17:48.846 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/152 2024-08-31T05:17:48.846 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/152 2024-08-31T05:17:48.846 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/152 2024-08-31T05:17:48.846 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/152 2024-08-31T05:17:48.846 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/152 2024-08-31T05:17:48.846 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/152 2024-08-31T05:17:48.846 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/152 2024-08-31T05:17:48.846 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/152 2024-08-31T05:17:48.846 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/152 2024-08-31T05:17:48.847 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/152 2024-08-31T05:17:48.847 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/152 2024-08-31T05:17:48.847 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/152 2024-08-31T05:17:48.847 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/152 2024-08-31T05:17:48.847 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/152 2024-08-31T05:17:48.847 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/152 2024-08-31T05:17:48.847 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/152 2024-08-31T05:17:48.847 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/152 2024-08-31T05:17:48.847 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/152 2024-08-31T05:17:48.847 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/152 2024-08-31T05:17:48.847 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/152 2024-08-31T05:17:48.847 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/152 2024-08-31T05:17:48.848 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/152 2024-08-31T05:17:48.848 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/152 2024-08-31T05:17:48.848 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/152 2024-08-31T05:17:48.848 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/152 2024-08-31T05:17:48.848 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/152 2024-08-31T05:17:48.848 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/152 2024-08-31T05:17:48.848 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/152 2024-08-31T05:17:48.848 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/152 2024-08-31T05:17:48.848 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-08-31T05:17:48.848 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-08-31T05:17:48.848 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-08-31T05:17:48.848 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-08-31T05:17:48.848 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-08-31T05:17:48.848 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-08-31T05:17:48.849 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-08-31T05:17:48.849 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-08-31T05:17:48.849 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-08-31T05:17:48.849 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-08-31T05:17:48.849 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-08-31T05:17:48.849 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-08-31T05:17:48.849 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-08-31T05:17:48.849 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-08-31T05:17:48.849 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-08-31T05:17:48.849 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-08-31T05:17:48.849 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-08-31T05:17:48.849 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-08-31T05:17:48.849 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-08-31T05:17:48.849 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/152 2024-08-31T05:17:48.850 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/152 2024-08-31T05:17:48.850 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-08-31T05:17:48.850 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-08-31T05:17:48.850 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-08-31T05:17:48.850 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/152 2024-08-31T05:17:48.850 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-08-31T05:17:48.850 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 149/152 2024-08-31T05:17:48.850 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-08-31T05:17:48.850 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 151/152 2024-08-31T05:17:48.929 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 125/152 2024-08-31T05:17:48.954 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 126/152 2024-08-31T05:17:49.073 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 126/152 2024-08-31T05:17:49.254 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el 127/152 2024-08-31T05:17:49.281 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 128/152 2024-08-31T05:17:49.305 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 128/152 2024-08-31T05:17:49.305 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:17:49.305 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-31T05:17:49.306 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-31T05:17:49.306 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-31T05:17:49.306 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T05:17:49.357 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 129/152 2024-08-31T05:17:49.369 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 129/152 2024-08-31T05:17:49.472 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 130/152 2024-08-31T05:17:49.523 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 131/152 2024-08-31T05:17:50.537 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libtool-2.4.6-46.el9.x86_64 132/152 2024-08-31T05:17:50.576 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 133/152 2024-08-31T05:17:50.600 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 133/152 2024-08-31T05:17:50.600 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:17:50.600 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-31T05:17:50.600 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-31T05:17:50.600 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-31T05:17:50.600 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T05:17:50.643 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 134/152 2024-08-31T05:17:50.667 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 134/152 2024-08-31T05:17:50.667 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:17:50.667 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-31T05:17:50.667 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T05:17:50.728 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 135/152 2024-08-31T05:17:50.751 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 135/152 2024-08-31T05:17:50.751 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:17:50.751 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-31T05:17:50.751 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-31T05:17:50.751 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-31T05:17:50.751 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T05:17:51.036 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-31T05:17:51.036 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 1/152 2024-08-31T05:17:51.037 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 2/152 2024-08-31T05:17:51.037 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 3/152 2024-08-31T05:17:51.037 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 4/152 2024-08-31T05:17:51.037 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 5/152 2024-08-31T05:17:51.037 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-31T05:17:51.037 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 7/152 2024-08-31T05:17:51.037 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 8/152 2024-08-31T05:17:51.037 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 9/152 2024-08-31T05:17:51.037 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 10/152 2024-08-31T05:17:51.037 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 11/152 2024-08-31T05:17:51.037 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-31T05:17:51.037 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 13/152 2024-08-31T05:17:51.038 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 14/152 2024-08-31T05:17:51.038 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_ 15/152 2024-08-31T05:17:51.038 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 16/152 2024-08-31T05:17:51.038 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 17/152 2024-08-31T05:17:51.038 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_6 18/152 2024-08-31T05:17:51.038 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 19/152 2024-08-31T05:17:51.038 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 20/152 2024-08-31T05:17:51.038 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el 21/152 2024-08-31T05:17:51.038 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-ceph-common-2:19.3.0-4560.gd19e6118.el9. 22/152 2024-08-31T05:17:51.038 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_6 23/152 2024-08-31T05:17:51.038 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 24/152 2024-08-31T05:17:51.038 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 25/152 2024-08-31T05:17:51.038 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 26/152 2024-08-31T05:17:51.038 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 27/152 2024-08-31T05:17:51.049 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 28/152 2024-08-31T05:17:51.049 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 29/152 2024-08-31T05:17:51.049 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118. 30/152 2024-08-31T05:17:51.049 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 31/152 2024-08-31T05:17:51.049 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 32/152 2024-08-31T05:17:51.050 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 33/152 2024-08-31T05:17:51.050 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el 34/152 2024-08-31T05:17:51.050 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 35/152 2024-08-31T05:17:51.050 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.e 36/152 2024-08-31T05:17:51.050 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 37/152 2024-08-31T05:17:51.050 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 38/152 2024-08-31T05:17:51.050 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 39/152 2024-08-31T05:17:51.050 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/152 2024-08-31T05:17:51.050 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/152 2024-08-31T05:17:51.050 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/152 2024-08-31T05:17:51.050 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-08-31T05:17:51.050 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-08-31T05:17:51.050 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-08-31T05:17:51.050 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-08-31T05:17:51.051 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-08-31T05:17:51.051 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/152 2024-08-31T05:17:51.051 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-08-31T05:17:51.051 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-08-31T05:17:51.051 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-08-31T05:17:51.051 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/152 2024-08-31T05:17:51.051 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-08-31T05:17:51.051 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-08-31T05:17:51.051 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-08-31T05:17:51.051 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-08-31T05:17:51.051 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-08-31T05:17:51.051 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-08-31T05:17:51.051 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-08-31T05:17:51.052 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-08-31T05:17:51.052 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/152 2024-08-31T05:17:51.052 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/152 2024-08-31T05:17:51.052 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-08-31T05:17:51.052 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-08-31T05:17:51.052 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-08-31T05:17:51.052 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/152 2024-08-31T05:17:51.052 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/152 2024-08-31T05:17:51.052 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-devel-1:3.2.2-4.el9.x86_64 68/152 2024-08-31T05:17:51.052 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/152 2024-08-31T05:17:51.052 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/152 2024-08-31T05:17:51.052 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/152 2024-08-31T05:17:51.052 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/152 2024-08-31T05:17:51.053 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-08-31T05:17:51.053 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-08-31T05:17:51.053 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-08-31T05:17:51.053 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/152 2024-08-31T05:17:51.053 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/152 2024-08-31T05:17:51.053 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/152 2024-08-31T05:17:51.053 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/152 2024-08-31T05:17:51.053 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/152 2024-08-31T05:17:51.053 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/152 2024-08-31T05:17:51.053 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/152 2024-08-31T05:17:51.053 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/152 2024-08-31T05:17:51.053 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/152 2024-08-31T05:17:51.053 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/152 2024-08-31T05:17:51.053 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/152 2024-08-31T05:17:51.054 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/152 2024-08-31T05:17:51.054 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/152 2024-08-31T05:17:51.054 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/152 2024-08-31T05:17:51.054 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/152 2024-08-31T05:17:51.054 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/152 2024-08-31T05:17:51.054 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/152 2024-08-31T05:17:51.054 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-31T05:17:51.054 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/152 2024-08-31T05:17:51.054 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/152 2024-08-31T05:17:51.054 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/152 2024-08-31T05:17:51.054 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/152 2024-08-31T05:17:51.054 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/152 2024-08-31T05:17:51.054 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/152 2024-08-31T05:17:51.055 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/152 2024-08-31T05:17:51.055 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/152 2024-08-31T05:17:51.055 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/152 2024-08-31T05:17:51.055 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/152 2024-08-31T05:17:51.055 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/152 2024-08-31T05:17:51.055 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/152 2024-08-31T05:17:51.055 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/152 2024-08-31T05:17:51.055 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/152 2024-08-31T05:17:51.055 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/152 2024-08-31T05:17:51.055 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/152 2024-08-31T05:17:51.055 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/152 2024-08-31T05:17:51.055 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/152 2024-08-31T05:17:51.055 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/152 2024-08-31T05:17:51.055 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/152 2024-08-31T05:17:51.056 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/152 2024-08-31T05:17:51.056 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/152 2024-08-31T05:17:51.056 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/152 2024-08-31T05:17:51.056 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/152 2024-08-31T05:17:51.056 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/152 2024-08-31T05:17:51.056 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/152 2024-08-31T05:17:51.056 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/152 2024-08-31T05:17:51.056 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/152 2024-08-31T05:17:51.056 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/152 2024-08-31T05:17:51.056 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-08-31T05:17:51.056 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-08-31T05:17:51.056 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-08-31T05:17:51.056 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-08-31T05:17:51.057 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-08-31T05:17:51.057 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-08-31T05:17:51.057 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-08-31T05:17:51.057 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-08-31T05:17:51.057 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-08-31T05:17:51.057 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-08-31T05:17:51.057 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-08-31T05:17:51.057 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-08-31T05:17:51.057 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-08-31T05:17:51.057 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-08-31T05:17:51.057 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-08-31T05:17:51.057 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-08-31T05:17:51.057 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-08-31T05:17:51.057 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-08-31T05:17:51.058 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-08-31T05:17:51.058 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/152 2024-08-31T05:17:51.058 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/152 2024-08-31T05:17:51.058 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-08-31T05:17:51.058 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-08-31T05:17:51.058 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-08-31T05:17:51.058 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/152 2024-08-31T05:17:51.058 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-08-31T05:17:51.058 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 149/152 2024-08-31T05:17:51.058 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-08-31T05:17:51.058 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 151/152 2024-08-31T05:17:51.110 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 136/152 2024-08-31T05:17:51.133 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 136/152 2024-08-31T05:17:51.133 INFO:teuthology.orchestra.run.smithi050.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T05:17:51.133 INFO:teuthology.orchestra.run.smithi050.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-31T05:17:51.133 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-31T05:17:51.134 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-31T05:17:51.134 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T05:17:51.157 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-08-31T05:17:51.157 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-08-31T05:17:51.158 INFO:teuthology.orchestra.run.smithi070.stdout:Upgraded: 2024-08-31T05:17:51.158 INFO:teuthology.orchestra.run.smithi070.stdout: librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:51.158 INFO:teuthology.orchestra.run.smithi070.stdout: librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:51.158 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-08-31T05:17:51.158 INFO:teuthology.orchestra.run.smithi070.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-31T05:17:51.158 INFO:teuthology.orchestra.run.smithi070.stdout: automake-1.16.2-8.el9.noarch 2024-08-31T05:17:51.158 INFO:teuthology.orchestra.run.smithi070.stdout: bison-3.7.4-5.el9.x86_64 2024-08-31T05:17:51.158 INFO:teuthology.orchestra.run.smithi070.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-31T05:17:51.158 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:51.158 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:51.158 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:51.158 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:51.158 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:17:51.159 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-immutable-object-cache-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:51.159 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:51.159 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:51.159 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:17:51.159 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:17:51.159 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:17:51.159 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:17:51.159 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:17:51.159 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:51.159 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:51.159 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:17:51.159 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:51.160 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:51.160 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:51.160 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:17:51.160 INFO:teuthology.orchestra.run.smithi070.stdout: cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:17:51.160 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:51.160 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:51.160 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:17:51.160 INFO:teuthology.orchestra.run.smithi070.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-31T05:17:51.160 INFO:teuthology.orchestra.run.smithi070.stdout: flex-2.6.4-9.el9.x86_64 2024-08-31T05:17:51.160 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-31T05:17:51.160 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-31T05:17:51.160 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-31T05:17:51.161 INFO:teuthology.orchestra.run.smithi070.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-31T05:17:51.161 INFO:teuthology.orchestra.run.smithi070.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-31T05:17:51.161 INFO:teuthology.orchestra.run.smithi070.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-31T05:17:51.161 INFO:teuthology.orchestra.run.smithi070.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-31T05:17:51.161 INFO:teuthology.orchestra.run.smithi070.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-31T05:17:51.161 INFO:teuthology.orchestra.run.smithi070.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-31T05:17:51.161 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:51.161 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:51.161 INFO:teuthology.orchestra.run.smithi070.stdout: libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:51.161 INFO:teuthology.orchestra.run.smithi070.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-08-31T05:17:51.161 INFO:teuthology.orchestra.run.smithi070.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-31T05:17:51.161 INFO:teuthology.orchestra.run.smithi070.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-31T05:17:51.161 INFO:teuthology.orchestra.run.smithi070.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-08-31T05:17:51.162 INFO:teuthology.orchestra.run.smithi070.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-31T05:17:51.162 INFO:teuthology.orchestra.run.smithi070.stdout: librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:51.162 INFO:teuthology.orchestra.run.smithi070.stdout: libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:51.162 INFO:teuthology.orchestra.run.smithi070.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-31T05:17:51.162 INFO:teuthology.orchestra.run.smithi070.stdout: librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:51.162 INFO:teuthology.orchestra.run.smithi070.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-31T05:17:51.162 INFO:teuthology.orchestra.run.smithi070.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-31T05:17:51.162 INFO:teuthology.orchestra.run.smithi070.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-08-31T05:17:51.162 INFO:teuthology.orchestra.run.smithi070.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-31T05:17:51.162 INFO:teuthology.orchestra.run.smithi070.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-31T05:17:51.162 INFO:teuthology.orchestra.run.smithi070.stdout: lua-5.4.4-4.el9.x86_64 2024-08-31T05:17:51.162 INFO:teuthology.orchestra.run.smithi070.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-31T05:17:51.162 INFO:teuthology.orchestra.run.smithi070.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-31T05:17:51.163 INFO:teuthology.orchestra.run.smithi070.stdout: openblas-0.3.26-2.el9.x86_64 2024-08-31T05:17:51.163 INFO:teuthology.orchestra.run.smithi070.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-08-31T05:17:51.163 INFO:teuthology.orchestra.run.smithi070.stdout: openssl-devel-1:3.2.2-4.el9.x86_64 2024-08-31T05:17:51.163 INFO:teuthology.orchestra.run.smithi070.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-31T05:17:51.163 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-13.16-1.el9.x86_64 2024-08-31T05:17:51.163 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-08-31T05:17:51.163 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-08-31T05:17:51.163 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-server-13.16-1.el9.x86_64 2024-08-31T05:17:51.163 INFO:teuthology.orchestra.run.smithi070.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-31T05:17:51.163 INFO:teuthology.orchestra.run.smithi070.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-31T05:17:51.163 INFO:teuthology.orchestra.run.smithi070.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-31T05:17:51.163 INFO:teuthology.orchestra.run.smithi070.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-08-31T05:17:51.163 INFO:teuthology.orchestra.run.smithi070.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-31T05:17:51.163 INFO:teuthology.orchestra.run.smithi070.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-31T05:17:51.164 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-31T05:17:51.164 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:51.164 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:51.164 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:51.164 INFO:teuthology.orchestra.run.smithi070.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-31T05:17:51.164 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-31T05:17:51.164 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-31T05:17:51.164 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-31T05:17:51.164 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-08-31T05:17:51.164 INFO:teuthology.orchestra.run.smithi070.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-08-31T05:17:51.164 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-31T05:17:51.164 INFO:teuthology.orchestra.run.smithi070.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-08-31T05:17:51.165 INFO:teuthology.orchestra.run.smithi070.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-08-31T05:17:51.165 INFO:teuthology.orchestra.run.smithi070.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-31T05:17:51.165 INFO:teuthology.orchestra.run.smithi070.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-31T05:17:51.165 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-31T05:17:51.165 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-31T05:17:51.165 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-31T05:17:51.165 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-31T05:17:51.165 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-31T05:17:51.165 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-31T05:17:51.165 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-31T05:17:51.165 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-31T05:17:51.165 INFO:teuthology.orchestra.run.smithi070.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-31T05:17:51.165 INFO:teuthology.orchestra.run.smithi070.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-31T05:17:51.166 INFO:teuthology.orchestra.run.smithi070.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-31T05:17:51.166 INFO:teuthology.orchestra.run.smithi070.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-31T05:17:51.166 INFO:teuthology.orchestra.run.smithi070.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-31T05:17:51.166 INFO:teuthology.orchestra.run.smithi070.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-31T05:17:51.166 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-31T05:17:51.166 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-31T05:17:51.166 INFO:teuthology.orchestra.run.smithi070.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-31T05:17:51.166 INFO:teuthology.orchestra.run.smithi070.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-31T05:17:51.166 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-31T05:17:51.166 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ply-3.11-14.el9.noarch 2024-08-31T05:17:51.166 INFO:teuthology.orchestra.run.smithi070.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-31T05:17:51.166 INFO:teuthology.orchestra.run.smithi070.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-31T05:17:51.166 INFO:teuthology.orchestra.run.smithi070.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-31T05:17:51.166 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-31T05:17:51.167 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-31T05:17:51.167 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-31T05:17:51.167 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-31T05:17:51.167 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-08-31T05:17:51.167 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-31T05:17:51.167 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:51.167 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:51.167 INFO:teuthology.orchestra.run.smithi070.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-31T05:17:51.167 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-31T05:17:51.167 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-31T05:17:51.167 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:51.167 INFO:teuthology.orchestra.run.smithi070.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-31T05:17:51.167 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-31T05:17:51.168 INFO:teuthology.orchestra.run.smithi070.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-31T05:17:51.168 INFO:teuthology.orchestra.run.smithi070.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-31T05:17:51.168 INFO:teuthology.orchestra.run.smithi070.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-31T05:17:51.168 INFO:teuthology.orchestra.run.smithi070.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-31T05:17:51.168 INFO:teuthology.orchestra.run.smithi070.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-31T05:17:51.168 INFO:teuthology.orchestra.run.smithi070.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-08-31T05:17:51.168 INFO:teuthology.orchestra.run.smithi070.stdout: python3-webob-1.8.8-2.el9.noarch 2024-08-31T05:17:51.168 INFO:teuthology.orchestra.run.smithi070.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-31T05:17:51.168 INFO:teuthology.orchestra.run.smithi070.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-31T05:17:51.168 INFO:teuthology.orchestra.run.smithi070.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-31T05:17:51.168 INFO:teuthology.orchestra.run.smithi070.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-31T05:17:51.168 INFO:teuthology.orchestra.run.smithi070.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-31T05:17:51.168 INFO:teuthology.orchestra.run.smithi070.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-31T05:17:51.169 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:51.169 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:51.169 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:51.169 INFO:teuthology.orchestra.run.smithi070.stdout: re2-1:20211101-20.el9.x86_64 2024-08-31T05:17:51.169 INFO:teuthology.orchestra.run.smithi070.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-31T05:17:51.169 INFO:teuthology.orchestra.run.smithi070.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-31T05:17:51.169 INFO:teuthology.orchestra.run.smithi070.stdout: uuid-1.6.2-55.el9.x86_64 2024-08-31T05:17:51.169 INFO:teuthology.orchestra.run.smithi070.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-08-31T05:17:51.169 INFO:teuthology.orchestra.run.smithi070.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-31T05:17:51.170 INFO:teuthology.orchestra.run.smithi070.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-31T05:17:51.170 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-08-31T05:17:51.170 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-08-31T05:17:51.523 DEBUG:teuthology.parallel:result is None 2024-08-31T05:17:53.472 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-08-31T05:17:53.472 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:17:53.472 INFO:teuthology.orchestra.run.smithi005.stdout:Upgraded: 2024-08-31T05:17:53.473 INFO:teuthology.orchestra.run.smithi005.stdout: librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:53.473 INFO:teuthology.orchestra.run.smithi005.stdout: librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:53.473 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-08-31T05:17:53.473 INFO:teuthology.orchestra.run.smithi005.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-31T05:17:53.473 INFO:teuthology.orchestra.run.smithi005.stdout: automake-1.16.2-8.el9.noarch 2024-08-31T05:17:53.473 INFO:teuthology.orchestra.run.smithi005.stdout: bison-3.7.4-5.el9.x86_64 2024-08-31T05:17:53.473 INFO:teuthology.orchestra.run.smithi005.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-31T05:17:53.473 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:53.473 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:53.473 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:53.473 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:53.473 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:17:53.474 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-immutable-object-cache-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:53.474 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:53.474 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:53.474 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:17:53.474 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:17:53.474 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:17:53.474 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:17:53.474 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:17:53.474 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:53.474 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:53.474 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:17:53.474 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:53.475 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:53.475 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:53.475 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:17:53.475 INFO:teuthology.orchestra.run.smithi005.stdout: cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:17:53.475 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:53.475 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:53.475 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:17:53.475 INFO:teuthology.orchestra.run.smithi005.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-31T05:17:53.475 INFO:teuthology.orchestra.run.smithi005.stdout: flex-2.6.4-9.el9.x86_64 2024-08-31T05:17:53.475 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-31T05:17:53.475 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-31T05:17:53.475 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-31T05:17:53.475 INFO:teuthology.orchestra.run.smithi005.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-31T05:17:53.476 INFO:teuthology.orchestra.run.smithi005.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-31T05:17:53.476 INFO:teuthology.orchestra.run.smithi005.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-31T05:17:53.476 INFO:teuthology.orchestra.run.smithi005.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-31T05:17:53.476 INFO:teuthology.orchestra.run.smithi005.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-31T05:17:53.476 INFO:teuthology.orchestra.run.smithi005.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-31T05:17:53.476 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:53.476 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:53.476 INFO:teuthology.orchestra.run.smithi005.stdout: libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:53.476 INFO:teuthology.orchestra.run.smithi005.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-08-31T05:17:53.476 INFO:teuthology.orchestra.run.smithi005.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-31T05:17:53.476 INFO:teuthology.orchestra.run.smithi005.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-31T05:17:53.476 INFO:teuthology.orchestra.run.smithi005.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-08-31T05:17:53.476 INFO:teuthology.orchestra.run.smithi005.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-31T05:17:53.477 INFO:teuthology.orchestra.run.smithi005.stdout: librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:53.477 INFO:teuthology.orchestra.run.smithi005.stdout: libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:53.477 INFO:teuthology.orchestra.run.smithi005.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-31T05:17:53.477 INFO:teuthology.orchestra.run.smithi005.stdout: librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:53.477 INFO:teuthology.orchestra.run.smithi005.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-31T05:17:53.477 INFO:teuthology.orchestra.run.smithi005.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-31T05:17:53.477 INFO:teuthology.orchestra.run.smithi005.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-08-31T05:17:53.477 INFO:teuthology.orchestra.run.smithi005.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-31T05:17:53.477 INFO:teuthology.orchestra.run.smithi005.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-31T05:17:53.477 INFO:teuthology.orchestra.run.smithi005.stdout: lua-5.4.4-4.el9.x86_64 2024-08-31T05:17:53.477 INFO:teuthology.orchestra.run.smithi005.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-31T05:17:53.477 INFO:teuthology.orchestra.run.smithi005.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-31T05:17:53.477 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-0.3.26-2.el9.x86_64 2024-08-31T05:17:53.478 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-08-31T05:17:53.478 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-devel-1:3.2.2-4.el9.x86_64 2024-08-31T05:17:53.478 INFO:teuthology.orchestra.run.smithi005.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-31T05:17:53.478 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-13.16-1.el9.x86_64 2024-08-31T05:17:53.478 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-08-31T05:17:53.478 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-08-31T05:17:53.478 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-server-13.16-1.el9.x86_64 2024-08-31T05:17:53.478 INFO:teuthology.orchestra.run.smithi005.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-31T05:17:53.478 INFO:teuthology.orchestra.run.smithi005.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-31T05:17:53.478 INFO:teuthology.orchestra.run.smithi005.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-31T05:17:53.478 INFO:teuthology.orchestra.run.smithi005.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-08-31T05:17:53.478 INFO:teuthology.orchestra.run.smithi005.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-31T05:17:53.478 INFO:teuthology.orchestra.run.smithi005.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-31T05:17:53.479 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-31T05:17:53.479 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:53.479 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:53.479 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:53.479 INFO:teuthology.orchestra.run.smithi005.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-31T05:17:53.479 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-31T05:17:53.479 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-31T05:17:53.479 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-31T05:17:53.479 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-08-31T05:17:53.479 INFO:teuthology.orchestra.run.smithi005.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-08-31T05:17:53.479 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-31T05:17:53.479 INFO:teuthology.orchestra.run.smithi005.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-08-31T05:17:53.479 INFO:teuthology.orchestra.run.smithi005.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-08-31T05:17:53.479 INFO:teuthology.orchestra.run.smithi005.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-31T05:17:53.480 INFO:teuthology.orchestra.run.smithi005.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-31T05:17:53.480 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-31T05:17:53.480 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-31T05:17:53.480 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-31T05:17:53.480 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-31T05:17:53.480 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-31T05:17:53.480 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-31T05:17:53.480 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-31T05:17:53.480 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-31T05:17:53.480 INFO:teuthology.orchestra.run.smithi005.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-31T05:17:53.480 INFO:teuthology.orchestra.run.smithi005.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-31T05:17:53.480 INFO:teuthology.orchestra.run.smithi005.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-31T05:17:53.480 INFO:teuthology.orchestra.run.smithi005.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-31T05:17:53.481 INFO:teuthology.orchestra.run.smithi005.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-31T05:17:53.481 INFO:teuthology.orchestra.run.smithi005.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-31T05:17:53.481 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-31T05:17:53.481 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-31T05:17:53.481 INFO:teuthology.orchestra.run.smithi005.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-31T05:17:53.481 INFO:teuthology.orchestra.run.smithi005.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-31T05:17:53.481 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-31T05:17:53.481 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ply-3.11-14.el9.noarch 2024-08-31T05:17:53.481 INFO:teuthology.orchestra.run.smithi005.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-31T05:17:53.481 INFO:teuthology.orchestra.run.smithi005.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-31T05:17:53.481 INFO:teuthology.orchestra.run.smithi005.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-31T05:17:53.481 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-31T05:17:53.481 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-31T05:17:53.482 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-31T05:17:53.482 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-31T05:17:53.482 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-08-31T05:17:53.482 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-31T05:17:53.482 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:53.482 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:53.482 INFO:teuthology.orchestra.run.smithi005.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-31T05:17:53.482 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-31T05:17:53.482 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-31T05:17:53.482 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:53.482 INFO:teuthology.orchestra.run.smithi005.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-31T05:17:53.482 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-31T05:17:53.482 INFO:teuthology.orchestra.run.smithi005.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-31T05:17:53.482 INFO:teuthology.orchestra.run.smithi005.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-31T05:17:53.483 INFO:teuthology.orchestra.run.smithi005.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-31T05:17:53.483 INFO:teuthology.orchestra.run.smithi005.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-31T05:17:53.483 INFO:teuthology.orchestra.run.smithi005.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-31T05:17:53.483 INFO:teuthology.orchestra.run.smithi005.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-08-31T05:17:53.483 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webob-1.8.8-2.el9.noarch 2024-08-31T05:17:53.483 INFO:teuthology.orchestra.run.smithi005.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-31T05:17:53.483 INFO:teuthology.orchestra.run.smithi005.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-31T05:17:53.483 INFO:teuthology.orchestra.run.smithi005.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-31T05:17:53.483 INFO:teuthology.orchestra.run.smithi005.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-31T05:17:53.483 INFO:teuthology.orchestra.run.smithi005.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-31T05:17:53.483 INFO:teuthology.orchestra.run.smithi005.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-31T05:17:53.483 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:53.483 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:53.484 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:17:53.484 INFO:teuthology.orchestra.run.smithi005.stdout: re2-1:20211101-20.el9.x86_64 2024-08-31T05:17:53.484 INFO:teuthology.orchestra.run.smithi005.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-31T05:17:53.484 INFO:teuthology.orchestra.run.smithi005.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-31T05:17:53.484 INFO:teuthology.orchestra.run.smithi005.stdout: uuid-1.6.2-55.el9.x86_64 2024-08-31T05:17:53.484 INFO:teuthology.orchestra.run.smithi005.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-08-31T05:17:53.484 INFO:teuthology.orchestra.run.smithi005.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-31T05:17:53.484 INFO:teuthology.orchestra.run.smithi005.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-31T05:17:53.484 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:17:53.485 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-08-31T05:17:53.853 DEBUG:teuthology.parallel:result is None 2024-08-31T05:17:55.741 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 137/152 2024-08-31T05:17:55.783 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 138/152 2024-08-31T05:17:55.832 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 139/152 2024-08-31T05:17:55.863 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 140/152 2024-08-31T05:17:55.890 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 141/152 2024-08-31T05:17:56.084 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 142/152 2024-08-31T05:17:56.128 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 143/152 2024-08-31T05:17:56.166 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_ 144/152 2024-08-31T05:17:56.781 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-31T05:17:56.822 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-31T05:17:56.843 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-31T05:17:57.736 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 146/152 2024-08-31T05:17:57.827 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : openssl-devel-1:3.2.2-4.el9.x86_64 147/152 2024-08-31T05:17:57.869 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-08-31T05:17:57.962 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-08-31T05:17:58.006 INFO:teuthology.orchestra.run.smithi050.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-08-31T05:17:58.006 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-31T05:17:58.090 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-31T05:17:58.090 INFO:teuthology.orchestra.run.smithi050.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-31T05:18:05.113 INFO:teuthology.orchestra.run.smithi050.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-31T05:18:05.113 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 1/152 2024-08-31T05:18:05.113 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 2/152 2024-08-31T05:18:05.113 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 3/152 2024-08-31T05:18:05.113 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 4/152 2024-08-31T05:18:05.113 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 5/152 2024-08-31T05:18:05.113 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-31T05:18:05.113 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 7/152 2024-08-31T05:18:05.113 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 8/152 2024-08-31T05:18:05.114 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 9/152 2024-08-31T05:18:05.114 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 10/152 2024-08-31T05:18:05.114 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 11/152 2024-08-31T05:18:05.114 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-31T05:18:05.114 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 13/152 2024-08-31T05:18:05.114 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 14/152 2024-08-31T05:18:05.114 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_ 15/152 2024-08-31T05:18:05.114 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 16/152 2024-08-31T05:18:05.114 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 17/152 2024-08-31T05:18:05.114 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_6 18/152 2024-08-31T05:18:05.114 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 19/152 2024-08-31T05:18:05.114 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 20/152 2024-08-31T05:18:05.115 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el 21/152 2024-08-31T05:18:05.115 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ceph-common-2:19.3.0-4560.gd19e6118.el9. 22/152 2024-08-31T05:18:05.115 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_6 23/152 2024-08-31T05:18:05.115 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 24/152 2024-08-31T05:18:05.115 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 25/152 2024-08-31T05:18:05.115 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 26/152 2024-08-31T05:18:05.115 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 27/152 2024-08-31T05:18:05.115 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 28/152 2024-08-31T05:18:05.115 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 29/152 2024-08-31T05:18:05.115 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118. 30/152 2024-08-31T05:18:05.115 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 31/152 2024-08-31T05:18:05.115 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 32/152 2024-08-31T05:18:05.115 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 33/152 2024-08-31T05:18:05.116 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el 34/152 2024-08-31T05:18:05.116 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 35/152 2024-08-31T05:18:05.116 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.e 36/152 2024-08-31T05:18:05.116 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 37/152 2024-08-31T05:18:05.116 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 38/152 2024-08-31T05:18:05.116 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 39/152 2024-08-31T05:18:05.116 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/152 2024-08-31T05:18:05.116 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/152 2024-08-31T05:18:05.116 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/152 2024-08-31T05:18:05.116 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-08-31T05:18:05.116 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-08-31T05:18:05.116 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-08-31T05:18:05.117 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-08-31T05:18:05.117 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-08-31T05:18:05.117 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/152 2024-08-31T05:18:05.117 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-08-31T05:18:05.117 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-08-31T05:18:05.117 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-08-31T05:18:05.117 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/152 2024-08-31T05:18:05.117 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-08-31T05:18:05.117 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-08-31T05:18:05.117 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-08-31T05:18:05.117 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-08-31T05:18:05.117 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-08-31T05:18:05.117 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-08-31T05:18:05.118 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-08-31T05:18:05.118 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-08-31T05:18:05.118 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/152 2024-08-31T05:18:05.118 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/152 2024-08-31T05:18:05.118 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-08-31T05:18:05.118 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-08-31T05:18:05.118 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-08-31T05:18:05.118 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/152 2024-08-31T05:18:05.118 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/152 2024-08-31T05:18:05.118 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : openssl-devel-1:3.2.2-4.el9.x86_64 68/152 2024-08-31T05:18:05.118 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/152 2024-08-31T05:18:05.118 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/152 2024-08-31T05:18:05.119 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/152 2024-08-31T05:18:05.119 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/152 2024-08-31T05:18:05.119 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-08-31T05:18:05.119 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-08-31T05:18:05.119 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-08-31T05:18:05.119 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/152 2024-08-31T05:18:05.119 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/152 2024-08-31T05:18:05.119 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/152 2024-08-31T05:18:05.119 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/152 2024-08-31T05:18:05.119 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/152 2024-08-31T05:18:05.119 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/152 2024-08-31T05:18:05.119 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/152 2024-08-31T05:18:05.120 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/152 2024-08-31T05:18:05.120 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/152 2024-08-31T05:18:05.120 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/152 2024-08-31T05:18:05.120 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/152 2024-08-31T05:18:05.120 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/152 2024-08-31T05:18:05.120 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/152 2024-08-31T05:18:05.120 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/152 2024-08-31T05:18:05.120 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/152 2024-08-31T05:18:05.120 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/152 2024-08-31T05:18:05.120 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/152 2024-08-31T05:18:05.120 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-31T05:18:05.120 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/152 2024-08-31T05:18:05.120 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/152 2024-08-31T05:18:05.121 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/152 2024-08-31T05:18:05.121 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/152 2024-08-31T05:18:05.121 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/152 2024-08-31T05:18:05.121 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/152 2024-08-31T05:18:05.121 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/152 2024-08-31T05:18:05.121 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/152 2024-08-31T05:18:05.121 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/152 2024-08-31T05:18:05.121 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/152 2024-08-31T05:18:05.121 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/152 2024-08-31T05:18:05.121 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/152 2024-08-31T05:18:05.121 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/152 2024-08-31T05:18:05.121 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/152 2024-08-31T05:18:05.121 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/152 2024-08-31T05:18:05.122 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/152 2024-08-31T05:18:05.122 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/152 2024-08-31T05:18:05.122 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/152 2024-08-31T05:18:05.122 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/152 2024-08-31T05:18:05.122 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/152 2024-08-31T05:18:05.122 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/152 2024-08-31T05:18:05.122 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/152 2024-08-31T05:18:05.122 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/152 2024-08-31T05:18:05.122 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/152 2024-08-31T05:18:05.122 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/152 2024-08-31T05:18:05.122 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/152 2024-08-31T05:18:05.122 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/152 2024-08-31T05:18:05.122 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/152 2024-08-31T05:18:05.122 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/152 2024-08-31T05:18:05.122 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-08-31T05:18:05.123 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-08-31T05:18:05.123 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-08-31T05:18:05.123 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-08-31T05:18:05.123 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-08-31T05:18:05.123 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-08-31T05:18:05.123 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-08-31T05:18:05.123 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-08-31T05:18:05.123 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-08-31T05:18:05.123 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-08-31T05:18:05.123 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-08-31T05:18:05.123 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-08-31T05:18:05.123 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-08-31T05:18:05.123 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-08-31T05:18:05.123 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-08-31T05:18:05.124 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-08-31T05:18:05.124 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-08-31T05:18:05.124 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-08-31T05:18:05.124 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-08-31T05:18:05.124 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/152 2024-08-31T05:18:05.124 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/152 2024-08-31T05:18:05.124 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-08-31T05:18:05.124 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-08-31T05:18:05.124 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-08-31T05:18:05.124 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/152 2024-08-31T05:18:05.124 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-08-31T05:18:05.124 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 149/152 2024-08-31T05:18:05.124 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-08-31T05:18:05.124 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 151/152 2024-08-31T05:18:07.365 INFO:teuthology.orchestra.run.smithi050.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-08-31T05:18:07.365 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T05:18:07.365 INFO:teuthology.orchestra.run.smithi050.stdout:Upgraded: 2024-08-31T05:18:07.366 INFO:teuthology.orchestra.run.smithi050.stdout: librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:18:07.366 INFO:teuthology.orchestra.run.smithi050.stdout: librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:18:07.366 INFO:teuthology.orchestra.run.smithi050.stdout:Installed: 2024-08-31T05:18:07.366 INFO:teuthology.orchestra.run.smithi050.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-31T05:18:07.366 INFO:teuthology.orchestra.run.smithi050.stdout: automake-1.16.2-8.el9.noarch 2024-08-31T05:18:07.366 INFO:teuthology.orchestra.run.smithi050.stdout: bison-3.7.4-5.el9.x86_64 2024-08-31T05:18:07.366 INFO:teuthology.orchestra.run.smithi050.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-31T05:18:07.366 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:18:07.366 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:18:07.366 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:18:07.366 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:18:07.366 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:18:07.366 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-immutable-object-cache-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:18:07.367 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:18:07.367 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:18:07.367 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:18:07.367 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:18:07.367 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:18:07.367 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:18:07.367 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:18:07.367 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:18:07.367 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:18:07.367 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:18:07.367 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:18:07.367 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:18:07.368 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:18:07.368 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:18:07.368 INFO:teuthology.orchestra.run.smithi050.stdout: cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:18:07.368 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:18:07.368 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:18:07.368 INFO:teuthology.orchestra.run.smithi050.stdout: cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T05:18:07.368 INFO:teuthology.orchestra.run.smithi050.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-31T05:18:07.368 INFO:teuthology.orchestra.run.smithi050.stdout: flex-2.6.4-9.el9.x86_64 2024-08-31T05:18:07.368 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-31T05:18:07.368 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-31T05:18:07.368 INFO:teuthology.orchestra.run.smithi050.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-31T05:18:07.368 INFO:teuthology.orchestra.run.smithi050.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-31T05:18:07.368 INFO:teuthology.orchestra.run.smithi050.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-31T05:18:07.368 INFO:teuthology.orchestra.run.smithi050.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-31T05:18:07.369 INFO:teuthology.orchestra.run.smithi050.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-31T05:18:07.369 INFO:teuthology.orchestra.run.smithi050.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-31T05:18:07.369 INFO:teuthology.orchestra.run.smithi050.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-31T05:18:07.369 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:18:07.369 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:18:07.369 INFO:teuthology.orchestra.run.smithi050.stdout: libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:18:07.369 INFO:teuthology.orchestra.run.smithi050.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-08-31T05:18:07.369 INFO:teuthology.orchestra.run.smithi050.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-31T05:18:07.369 INFO:teuthology.orchestra.run.smithi050.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-31T05:18:07.369 INFO:teuthology.orchestra.run.smithi050.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-08-31T05:18:07.369 INFO:teuthology.orchestra.run.smithi050.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-31T05:18:07.370 INFO:teuthology.orchestra.run.smithi050.stdout: librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:18:07.370 INFO:teuthology.orchestra.run.smithi050.stdout: libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:18:07.370 INFO:teuthology.orchestra.run.smithi050.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-31T05:18:07.370 INFO:teuthology.orchestra.run.smithi050.stdout: librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:18:07.370 INFO:teuthology.orchestra.run.smithi050.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-31T05:18:07.370 INFO:teuthology.orchestra.run.smithi050.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-31T05:18:07.370 INFO:teuthology.orchestra.run.smithi050.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-08-31T05:18:07.370 INFO:teuthology.orchestra.run.smithi050.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-31T05:18:07.370 INFO:teuthology.orchestra.run.smithi050.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-31T05:18:07.370 INFO:teuthology.orchestra.run.smithi050.stdout: lua-5.4.4-4.el9.x86_64 2024-08-31T05:18:07.370 INFO:teuthology.orchestra.run.smithi050.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-31T05:18:07.370 INFO:teuthology.orchestra.run.smithi050.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-31T05:18:07.371 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-0.3.26-2.el9.x86_64 2024-08-31T05:18:07.371 INFO:teuthology.orchestra.run.smithi050.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-08-31T05:18:07.371 INFO:teuthology.orchestra.run.smithi050.stdout: openssl-devel-1:3.2.2-4.el9.x86_64 2024-08-31T05:18:07.371 INFO:teuthology.orchestra.run.smithi050.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-31T05:18:07.371 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-13.16-1.el9.x86_64 2024-08-31T05:18:07.371 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-08-31T05:18:07.371 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-08-31T05:18:07.371 INFO:teuthology.orchestra.run.smithi050.stdout: postgresql-server-13.16-1.el9.x86_64 2024-08-31T05:18:07.371 INFO:teuthology.orchestra.run.smithi050.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-31T05:18:07.371 INFO:teuthology.orchestra.run.smithi050.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-31T05:18:07.371 INFO:teuthology.orchestra.run.smithi050.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-31T05:18:07.371 INFO:teuthology.orchestra.run.smithi050.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-08-31T05:18:07.371 INFO:teuthology.orchestra.run.smithi050.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-31T05:18:07.372 INFO:teuthology.orchestra.run.smithi050.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-31T05:18:07.372 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-31T05:18:07.372 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:18:07.372 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:18:07.372 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:18:07.372 INFO:teuthology.orchestra.run.smithi050.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-31T05:18:07.372 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-31T05:18:07.372 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-31T05:18:07.372 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-31T05:18:07.372 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-08-31T05:18:07.372 INFO:teuthology.orchestra.run.smithi050.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-08-31T05:18:07.372 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-31T05:18:07.373 INFO:teuthology.orchestra.run.smithi050.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-08-31T05:18:07.373 INFO:teuthology.orchestra.run.smithi050.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-08-31T05:18:07.373 INFO:teuthology.orchestra.run.smithi050.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-31T05:18:07.373 INFO:teuthology.orchestra.run.smithi050.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-31T05:18:07.373 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-31T05:18:07.373 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-31T05:18:07.373 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-31T05:18:07.373 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-31T05:18:07.373 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-31T05:18:07.373 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-31T05:18:07.373 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-31T05:18:07.373 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-31T05:18:07.373 INFO:teuthology.orchestra.run.smithi050.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-31T05:18:07.374 INFO:teuthology.orchestra.run.smithi050.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-31T05:18:07.374 INFO:teuthology.orchestra.run.smithi050.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-31T05:18:07.374 INFO:teuthology.orchestra.run.smithi050.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-31T05:18:07.374 INFO:teuthology.orchestra.run.smithi050.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-31T05:18:07.374 INFO:teuthology.orchestra.run.smithi050.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-31T05:18:07.374 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-31T05:18:07.374 INFO:teuthology.orchestra.run.smithi050.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-31T05:18:07.374 INFO:teuthology.orchestra.run.smithi050.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-31T05:18:07.374 INFO:teuthology.orchestra.run.smithi050.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-31T05:18:07.374 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-31T05:18:07.374 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ply-3.11-14.el9.noarch 2024-08-31T05:18:07.374 INFO:teuthology.orchestra.run.smithi050.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-31T05:18:07.374 INFO:teuthology.orchestra.run.smithi050.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-31T05:18:07.374 INFO:teuthology.orchestra.run.smithi050.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-31T05:18:07.375 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-31T05:18:07.375 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-31T05:18:07.375 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-31T05:18:07.375 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-31T05:18:07.375 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-08-31T05:18:07.375 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-31T05:18:07.375 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:18:07.375 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:18:07.375 INFO:teuthology.orchestra.run.smithi050.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-31T05:18:07.375 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-31T05:18:07.375 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-31T05:18:07.375 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:18:07.375 INFO:teuthology.orchestra.run.smithi050.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-31T05:18:07.375 INFO:teuthology.orchestra.run.smithi050.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-31T05:18:07.376 INFO:teuthology.orchestra.run.smithi050.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-31T05:18:07.376 INFO:teuthology.orchestra.run.smithi050.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-31T05:18:07.376 INFO:teuthology.orchestra.run.smithi050.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-31T05:18:07.376 INFO:teuthology.orchestra.run.smithi050.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-31T05:18:07.376 INFO:teuthology.orchestra.run.smithi050.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-31T05:18:07.376 INFO:teuthology.orchestra.run.smithi050.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-08-31T05:18:07.376 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webob-1.8.8-2.el9.noarch 2024-08-31T05:18:07.376 INFO:teuthology.orchestra.run.smithi050.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-31T05:18:07.376 INFO:teuthology.orchestra.run.smithi050.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-31T05:18:07.376 INFO:teuthology.orchestra.run.smithi050.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-31T05:18:07.376 INFO:teuthology.orchestra.run.smithi050.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-31T05:18:07.376 INFO:teuthology.orchestra.run.smithi050.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-31T05:18:07.376 INFO:teuthology.orchestra.run.smithi050.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-31T05:18:07.376 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:18:07.377 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:18:07.377 INFO:teuthology.orchestra.run.smithi050.stdout: rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T05:18:07.377 INFO:teuthology.orchestra.run.smithi050.stdout: re2-1:20211101-20.el9.x86_64 2024-08-31T05:18:07.377 INFO:teuthology.orchestra.run.smithi050.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-31T05:18:07.377 INFO:teuthology.orchestra.run.smithi050.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-31T05:18:07.377 INFO:teuthology.orchestra.run.smithi050.stdout: uuid-1.6.2-55.el9.x86_64 2024-08-31T05:18:07.377 INFO:teuthology.orchestra.run.smithi050.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-08-31T05:18:07.377 INFO:teuthology.orchestra.run.smithi050.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-31T05:18:07.377 INFO:teuthology.orchestra.run.smithi050.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-31T05:18:07.377 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T05:18:07.378 INFO:teuthology.orchestra.run.smithi050.stdout:Complete! 2024-08-31T05:18:07.731 DEBUG:teuthology.parallel:result is None 2024-08-31T05:18:07.731 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T05:18:07.869 DEBUG:teuthology.orchestra.run.smithi005:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-31T05:18:07.896 INFO:teuthology.orchestra.run.smithi005.stdout:19.3.0-4560.gd19e6118.el9 2024-08-31T05:18:07.897 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4560.gd19e6118.el9 2024-08-31T05:18:07.897 INFO:teuthology.task.install:The correct ceph version 19.3.0-4560.gd19e6118 is installed. 2024-08-31T05:18:07.899 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T05:18:08.038 DEBUG:teuthology.orchestra.run.smithi050:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-31T05:18:08.060 INFO:teuthology.orchestra.run.smithi050.stdout:19.3.0-4560.gd19e6118.el9 2024-08-31T05:18:08.060 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4560.gd19e6118.el9 2024-08-31T05:18:08.061 INFO:teuthology.task.install:The correct ceph version 19.3.0-4560.gd19e6118 is installed. 2024-08-31T05:18:08.062 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T05:18:08.194 DEBUG:teuthology.orchestra.run.smithi070:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-31T05:18:08.221 INFO:teuthology.orchestra.run.smithi070.stdout:19.3.0-4560.gd19e6118.el9 2024-08-31T05:18:08.221 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4560.gd19e6118.el9 2024-08-31T05:18:08.221 INFO:teuthology.task.install:The correct ceph version 19.3.0-4560.gd19e6118 is installed. 2024-08-31T05:18:08.223 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-08-31T05:18:08.223 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-31T05:18:08.223 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-31T05:18:08.255 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-08-31T05:18:08.256 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-31T05:18:08.282 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-08-31T05:18:08.282 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-31T05:18:08.314 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-08-31T05:18:08.314 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-31T05:18:08.314 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/daemon-helper 2024-08-31T05:18:08.344 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-31T05:18:08.412 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-08-31T05:18:08.412 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/daemon-helper 2024-08-31T05:18:08.437 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-31T05:18:08.503 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-08-31T05:18:08.503 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/daemon-helper 2024-08-31T05:18:08.533 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-31T05:18:08.602 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-08-31T05:18:08.602 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-31T05:18:08.602 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-31T05:18:08.632 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-31T05:18:08.702 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-08-31T05:18:08.702 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-31T05:18:08.726 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-31T05:18:08.791 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-08-31T05:18:08.791 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-31T05:18:08.816 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-31T05:18:08.882 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-08-31T05:18:08.882 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-31T05:18:08.882 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/stdin-killer 2024-08-31T05:18:08.911 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-31T05:18:08.980 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-08-31T05:18:08.981 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/stdin-killer 2024-08-31T05:18:09.005 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-31T05:18:09.070 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-08-31T05:18:09.070 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/stdin-killer 2024-08-31T05:18:09.096 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-31T05:18:09.160 INFO:teuthology.run_tasks:Running task cephadm... 2024-08-31T05:18:09.249 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug cephsqlite': 20, 'mgr/snap_schedule/allow_m_granularity': True, 'mgr/snap_schedule/dump_on_update': True, 'mgr/snap_schedule/log_level': 'debug'}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'global': {'ms die on skipped message': False}, 'mds': {'mds_bal_replicate_threshold': 1, 'mds_export_ephemeral_random_max': 0.1}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'mgr-modules': ['snap_schedule'], 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-08-31T05:18:09.249 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T05:18:09.250 INFO:tasks.cephadm:Cluster fsid is 69422704-6758-11ef-bcd4-c7b262605968 2024-08-31T05:18:09.250 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-08-31T05:18:09.250 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.5', 'mon.b': '172.21.15.50', 'mon.c': '172.21.15.70'} 2024-08-31T05:18:09.250 INFO:tasks.cephadm:First mon is mon.a on smithi005 2024-08-31T05:18:09.250 INFO:tasks.cephadm:First mgr is x 2024-08-31T05:18:09.250 INFO:tasks.cephadm:Normalizing hostnames... 2024-08-31T05:18:09.251 DEBUG:teuthology.orchestra.run.smithi005:> sudo hostname $(hostname -s) 2024-08-31T05:18:09.280 DEBUG:teuthology.orchestra.run.smithi050:> sudo hostname $(hostname -s) 2024-08-31T05:18:09.306 DEBUG:teuthology.orchestra.run.smithi070:> sudo hostname $(hostname -s) 2024-08-31T05:18:09.332 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-08-31T05:18:09.332 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T05:18:09.481 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82586/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-4560-gd19e6118', 'node_name': '172.21.5.31+adami01', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-4560.gd19e6118'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-08-28 11:15:32.801765', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-mchangir-testing-20240828.085847-main-debug', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-08-31T05:18:09.620 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref wip-mchangir-testing-20240828.085847-main-debug, sha1 d19e6118f7015f0047264006cb0c873528eb3ae6 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T05:18:09.621 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/x86_64/flavors/default/cephadm 2024-08-31T05:18:09.622 INFO:tasks.cephadm:Downloading cephadm from url: https://4.chacra.ceph.com/binaries/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/x86_64/flavors/default/cephadm 2024-08-31T05:18:09.622 DEBUG:teuthology.orchestra.run.smithi005:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-31T05:18:10.222 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r--. 1 ubuntu ubuntu 801010 Aug 31 05:18 /home/ubuntu/cephtest/cephadm 2024-08-31T05:18:10.223 DEBUG:teuthology.orchestra.run.smithi050:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-31T05:18:10.834 INFO:teuthology.orchestra.run.smithi050.stdout:-rw-r--r--. 1 ubuntu ubuntu 801010 Aug 31 05:18 /home/ubuntu/cephtest/cephadm 2024-08-31T05:18:10.834 DEBUG:teuthology.orchestra.run.smithi070:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-31T05:18:11.421 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r--. 1 ubuntu ubuntu 801010 Aug 31 05:18 /home/ubuntu/cephtest/cephadm 2024-08-31T05:18:11.421 DEBUG:teuthology.orchestra.run.smithi005:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-31T05:18:11.441 DEBUG:teuthology.orchestra.run.smithi050:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-31T05:18:11.461 DEBUG:teuthology.orchestra.run.smithi070:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-31T05:18:11.495 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 on all hosts... 2024-08-31T05:18:11.495 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 pull 2024-08-31T05:18:11.497 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 pull 2024-08-31T05:18:11.503 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 pull 2024-08-31T05:18:12.980 INFO:teuthology.orchestra.run.smithi005.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6... 2024-08-31T05:18:13.099 INFO:teuthology.orchestra.run.smithi070.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6... 2024-08-31T05:18:13.180 INFO:teuthology.orchestra.run.smithi050.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6... 2024-08-31T05:18:52.283 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:18:52.283 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_version": "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)", 2024-08-31T05:18:52.283 INFO:teuthology.orchestra.run.smithi005.stdout: "image_id": "79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0", 2024-08-31T05:18:52.283 INFO:teuthology.orchestra.run.smithi005.stdout: "repo_digests": [ 2024-08-31T05:18:52.283 INFO:teuthology.orchestra.run.smithi005.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61" 2024-08-31T05:18:52.283 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-31T05:18:52.284 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:18:54.501 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-08-31T05:18:54.501 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_version": "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)", 2024-08-31T05:18:54.501 INFO:teuthology.orchestra.run.smithi050.stdout: "image_id": "79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0", 2024-08-31T05:18:54.502 INFO:teuthology.orchestra.run.smithi050.stdout: "repo_digests": [ 2024-08-31T05:18:54.502 INFO:teuthology.orchestra.run.smithi050.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61" 2024-08-31T05:18:54.502 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-08-31T05:18:54.502 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-08-31T05:18:55.862 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-08-31T05:18:55.862 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_version": "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)", 2024-08-31T05:18:55.862 INFO:teuthology.orchestra.run.smithi070.stdout: "image_id": "79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0", 2024-08-31T05:18:55.862 INFO:teuthology.orchestra.run.smithi070.stdout: "repo_digests": [ 2024-08-31T05:18:55.862 INFO:teuthology.orchestra.run.smithi070.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61" 2024-08-31T05:18:55.862 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-08-31T05:18:55.862 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-08-31T05:18:55.887 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /etc/ceph 2024-08-31T05:18:55.920 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /etc/ceph 2024-08-31T05:18:55.953 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /etc/ceph 2024-08-31T05:18:55.980 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 777 /etc/ceph 2024-08-31T05:18:56.009 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 777 /etc/ceph 2024-08-31T05:18:56.038 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 777 /etc/ceph 2024-08-31T05:18:56.062 INFO:tasks.cephadm:Writing seed config... 2024-08-31T05:18:56.064 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-08-31T05:18:56.064 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-08-31T05:18:56.064 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-08-31T05:18:56.064 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-08-31T05:18:56.064 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-08-31T05:18:56.064 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-08-31T05:18:56.064 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-08-31T05:18:56.064 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-08-31T05:18:56.064 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-08-31T05:18:56.064 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-08-31T05:18:56.065 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-08-31T05:18:56.065 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-08-31T05:18:56.065 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-08-31T05:18:56.065 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-08-31T05:18:56.065 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-08-31T05:18:56.065 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-08-31T05:18:56.065 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-08-31T05:18:56.065 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-08-31T05:18:56.065 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-08-31T05:18:56.065 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-08-31T05:18:56.065 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-08-31T05:18:56.065 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-08-31T05:18:56.065 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-08-31T05:18:56.065 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-08-31T05:18:56.066 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-08-31T05:18:56.066 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-08-31T05:18:56.066 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-31T05:18:56.066 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-08-31T05:18:56.084 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 69422704-6758-11ef-bcd4-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [mds] mds_bal_replicate_threshold = 1 mds_export_ephemeral_random_max = 0.1 2024-08-31T05:18:56.085 DEBUG:teuthology.orchestra.run.smithi005:mon.a> sudo journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@mon.a.service 2024-08-31T05:18:56.127 DEBUG:teuthology.orchestra.run.smithi005:mgr.x> sudo journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@mgr.x.service 2024-08-31T05:18:56.170 INFO:tasks.cephadm:Bootstrapping... 2024-08-31T05:18:56.171 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 -v bootstrap --fsid 69422704-6758-11ef-bcd4-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.5 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-08-31T05:18:56.384 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-08-31T05:18:56.384 INFO:teuthology.orchestra.run.smithi005.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', '-v', 'bootstrap', '--fsid', '69422704-6758-11ef-bcd4-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.5', '--skip-admin-label'] 2024-08-31T05:18:56.384 INFO:teuthology.orchestra.run.smithi005.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-08-31T05:18:56.384 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying podman|docker is present... 2024-08-31T05:18:56.407 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stdout 5.2.2 2024-08-31T05:18:56.407 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying lvm2 is present... 2024-08-31T05:18:56.407 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying time synchronization is in place... 2024-08-31T05:18:56.415 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-08-31T05:18:56.415 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-08-31T05:18:56.421 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-08-31T05:18:56.421 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout inactive 2024-08-31T05:18:56.427 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout enabled 2024-08-31T05:18:56.434 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout active 2024-08-31T05:18:56.434 INFO:teuthology.orchestra.run.smithi005.stdout:Unit chronyd.service is enabled and running 2024-08-31T05:18:56.434 INFO:teuthology.orchestra.run.smithi005.stdout:Repeating the final host check... 2024-08-31T05:18:56.456 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stdout 5.2.2 2024-08-31T05:18:56.456 INFO:teuthology.orchestra.run.smithi005.stdout:podman (/bin/podman) version 5.2.2 is present 2024-08-31T05:18:56.456 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl is present 2024-08-31T05:18:56.456 INFO:teuthology.orchestra.run.smithi005.stdout:lvcreate is present 2024-08-31T05:18:56.462 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-08-31T05:18:56.462 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-08-31T05:18:56.468 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-08-31T05:18:56.468 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout inactive 2024-08-31T05:18:56.475 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout enabled 2024-08-31T05:18:56.481 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout active 2024-08-31T05:18:56.481 INFO:teuthology.orchestra.run.smithi005.stdout:Unit chronyd.service is enabled and running 2024-08-31T05:18:56.482 INFO:teuthology.orchestra.run.smithi005.stdout:Host looks OK 2024-08-31T05:18:56.482 INFO:teuthology.orchestra.run.smithi005.stdout:Cluster fsid: 69422704-6758-11ef-bcd4-c7b262605968 2024-08-31T05:18:56.482 INFO:teuthology.orchestra.run.smithi005.stdout:Acquiring lock 140281072161840 on /run/cephadm/69422704-6758-11ef-bcd4-c7b262605968.lock 2024-08-31T05:18:56.482 INFO:teuthology.orchestra.run.smithi005.stdout:Lock 140281072161840 acquired on /run/cephadm/69422704-6758-11ef-bcd4-c7b262605968.lock 2024-08-31T05:18:56.482 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying IP 172.21.15.5 port 3300 ... 2024-08-31T05:18:56.484 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying IP 172.21.15.5 port 6789 ... 2024-08-31T05:18:56.484 INFO:teuthology.orchestra.run.smithi005.stdout:Base mon IP(s) is [172.21.15.5:3300, 172.21.15.5:6789], mon addrv is [v2:172.21.15.5:3300,v1:172.21.15.5:6789] 2024-08-31T05:18:56.485 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.5 metric 100 2024-08-31T05:18:56.485 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.5 metric 100 2024-08-31T05:18:56.488 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-08-31T05:18:56.488 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 1024 pref medium 2024-08-31T05:18:56.488 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 100 pref medium 2024-08-31T05:18:56.490 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-08-31T05:18:56.490 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-08-31T05:18:56.491 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-08-31T05:18:56.491 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-08-31T05:18:56.491 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout inet6 fe80::5e23:6663:4f43:f7c4/64 scope link noprefixroute 2024-08-31T05:18:56.491 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-08-31T05:18:56.492 INFO:teuthology.orchestra.run.smithi005.stdout:Mon IP `172.21.15.5` is in CIDR network `172.21.0.0/20` 2024-08-31T05:18:56.492 INFO:teuthology.orchestra.run.smithi005.stdout:Mon IP `172.21.15.5` is in CIDR network `172.21.0.0/20` 2024-08-31T05:18:56.492 INFO:teuthology.orchestra.run.smithi005.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-08-31T05:18:56.492 INFO:teuthology.orchestra.run.smithi005.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-08-31T05:18:56.493 INFO:teuthology.orchestra.run.smithi005.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6... 2024-08-31T05:18:57.034 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stdout 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 2024-08-31T05:18:57.034 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6... 2024-08-31T05:18:57.035 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stderr Getting image source signatures 2024-08-31T05:18:57.035 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-08-31T05:18:57.035 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stderr Copying blob sha256:1c7f48e91f1eb9e77df623f13bab8a42aaf12d95954655c07fb62a1a85ca19b2 2024-08-31T05:18:57.035 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stderr Copying config sha256:79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 2024-08-31T05:18:57.035 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stderr Writing manifest to image destination 2024-08-31T05:18:57.931 INFO:teuthology.orchestra.run.smithi005.stdout:ceph: stdout ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev) 2024-08-31T05:18:57.931 INFO:teuthology.orchestra.run.smithi005.stdout:Ceph version: ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev) 2024-08-31T05:18:57.931 INFO:teuthology.orchestra.run.smithi005.stdout:Extracting ceph user uid/gid from container image... 2024-08-31T05:18:58.896 INFO:teuthology.orchestra.run.smithi005.stdout:stat: stdout 167 167 2024-08-31T05:18:58.896 INFO:teuthology.orchestra.run.smithi005.stdout:Creating initial keys... 2024-08-31T05:18:59.794 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-authtool: stdout AQDDp9Jmt6ZxDRAAiEsaLh3/HECm/KnQsYSGdg== 2024-08-31T05:19:00.715 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-authtool: stdout AQDEp9JmwAIxCRAANf8umMYl4XfFazh9zLGQOw== 2024-08-31T05:19:01.589 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-authtool: stdout AQDFp9Jm2dqqAhAAnCVNwwJguNcqxJDh+M5aUg== 2024-08-31T05:19:01.590 INFO:teuthology.orchestra.run.smithi005.stdout:Creating initial monmap... 2024-08-31T05:19:02.520 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-08-31T05:19:02.520 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-08-31T05:19:02.521 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 69422704-6758-11ef-bcd4-c7b262605968 2024-08-31T05:19:02.521 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-08-31T05:19:02.521 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool for a [v2:172.21.15.5:3300,v1:172.21.15.5:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-08-31T05:19:02.521 INFO:teuthology.orchestra.run.smithi005.stdout:setting min_mon_release = quincy 2024-08-31T05:19:02.521 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/monmaptool: set fsid to 69422704-6758-11ef-bcd4-c7b262605968 2024-08-31T05:19:02.521 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-08-31T05:19:02.521 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:19:02.521 INFO:teuthology.orchestra.run.smithi005.stdout:Creating mon... 2024-08-31T05:19:03.393 INFO:teuthology.orchestra.run.smithi005.stdout:create mon.a on 2024-08-31T05:19:03.598 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-08-31T05:19:03.735 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-08-31T05:19:03.977 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-69422704-6758-11ef-bcd4-c7b262605968.target → /etc/systemd/system/ceph-69422704-6758-11ef-bcd4-c7b262605968.target. 2024-08-31T05:19:03.977 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-69422704-6758-11ef-bcd4-c7b262605968.target → /etc/systemd/system/ceph-69422704-6758-11ef-bcd4-c7b262605968.target. 2024-08-31T05:19:04.203 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-69422704-6758-11ef-bcd4-c7b262605968@mon.a 2024-08-31T05:19:04.204 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Failed to reset failed state of unit ceph-69422704-6758-11ef-bcd4-c7b262605968@mon.a.service: Unit ceph-69422704-6758-11ef-bcd4-c7b262605968@mon.a.service not loaded. 2024-08-31T05:19:04.368 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-69422704-6758-11ef-bcd4-c7b262605968.target.wants/ceph-69422704-6758-11ef-bcd4-c7b262605968@mon.a.service → /etc/systemd/system/ceph-69422704-6758-11ef-bcd4-c7b262605968@.service. 2024-08-31T05:19:04.900 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-31T05:19:04.900 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout disabled 2024-08-31T05:19:04.906 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-31T05:19:04.906 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout inactive 2024-08-31T05:19:04.907 INFO:teuthology.orchestra.run.smithi005.stdout:firewalld.service is not enabled 2024-08-31T05:19:04.907 INFO:teuthology.orchestra.run.smithi005.stdout:Not possible to enable service . firewalld.service is not available 2024-08-31T05:19:04.907 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for mon to start... 2024-08-31T05:19:04.907 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for mon... 2024-08-31T05:19:05.867 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:05 smithi005 ceph-mon[18239]: monmap epoch 1 2024-08-31T05:19:05.867 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:05 smithi005 ceph-mon[18239]: fsid 69422704-6758-11ef-bcd4-c7b262605968 2024-08-31T05:19:05.868 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:05 smithi005 ceph-mon[18239]: last_changed 2024-08-31T05:19:01.939099+0000 2024-08-31T05:19:05.868 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:05 smithi005 ceph-mon[18239]: created 2024-08-31T05:19:01.939099+0000 2024-08-31T05:19:05.868 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:05 smithi005 ceph-mon[18239]: min_mon_release 19 (squid) 2024-08-31T05:19:05.868 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:05 smithi005 ceph-mon[18239]: election_strategy: 1 2024-08-31T05:19:05.868 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:05 smithi005 ceph-mon[18239]: 0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-31T05:19:05.868 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:05 smithi005 ceph-mon[18239]: fsmap 2024-08-31T05:19:05.868 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:05 smithi005 ceph-mon[18239]: osdmap e1: 0 total, 0 up, 0 in 2024-08-31T05:19:05.868 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:05 smithi005 ceph-mon[18239]: mgrmap e1: no daemons active 2024-08-31T05:19:05.868 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:05 smithi005 ceph-mon[18239]: from='client.? 172.21.15.5:0/1141419708' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-08-31T05:19:05.895 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout cluster: 2024-08-31T05:19:05.897 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout id: 69422704-6758-11ef-bcd4-c7b262605968 2024-08-31T05:19:05.897 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-08-31T05:19:05.897 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-08-31T05:19:05.897 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout services: 2024-08-31T05:19:05.897 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.498985s) 2024-08-31T05:19:05.897 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-08-31T05:19:05.897 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-08-31T05:19:05.897 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-08-31T05:19:05.897 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout data: 2024-08-31T05:19:05.897 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-08-31T05:19:05.897 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-08-31T05:19:05.897 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-08-31T05:19:05.898 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout pgs: 2024-08-31T05:19:05.898 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-08-31T05:19:05.898 INFO:teuthology.orchestra.run.smithi005.stdout:mon is available 2024-08-31T05:19:05.898 INFO:teuthology.orchestra.run.smithi005.stdout:Assimilating anything we can from ceph.conf... 2024-08-31T05:19:06.916 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:06 smithi005 ceph-mon[18239]: from='client.? 172.21.15.5:0/776970099' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-08-31T05:19:06.916 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:06 smithi005 ceph-mon[18239]: from='client.? 172.21.15.5:0/776970099' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-08-31T05:19:06.920 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-08-31T05:19:06.920 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout [global] 2024-08-31T05:19:06.920 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout fsid = 69422704-6758-11ef-bcd4-c7b262605968 2024-08-31T05:19:06.920 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-08-31T05:19:06.920 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.5:3300,v1:172.21.15.5:6789] 2024-08-31T05:19:06.920 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-08-31T05:19:06.920 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-08-31T05:19:06.920 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-08-31T05:19:06.920 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-08-31T05:19:06.921 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-08-31T05:19:06.921 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout [mgr] 2024-08-31T05:19:06.921 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-08-31T05:19:06.921 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-08-31T05:19:06.921 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout [osd] 2024-08-31T05:19:06.921 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-08-31T05:19:06.921 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-08-31T05:19:06.921 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-08-31T05:19:06.921 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-08-31T05:19:06.921 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-08-31T05:19:06.921 INFO:teuthology.orchestra.run.smithi005.stdout:Generating new minimal ceph.conf... 2024-08-31T05:19:07.963 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:07 smithi005 ceph-mon[18239]: from='client.? 172.21.15.5:0/2753600582' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:19:07.966 INFO:teuthology.orchestra.run.smithi005.stdout:Restarting the monitor... 2024-08-31T05:19:08.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:07 smithi005 systemd[1]: Stopping Ceph mon.a for 69422704-6758-11ef-bcd4-c7b262605968... 2024-08-31T05:19:08.642 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:08 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mon-a[18235]: 2024-08-31T05:19:08.240+0000 7fc68ede9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T05:19:08.642 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:08 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mon-a[18235]: 2024-08-31T05:19:08.240+0000 7fc68ede9640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-08-31T05:19:08.642 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:08 smithi005 podman[18480]: 2024-08-31 05:19:08.383770101 +0000 UTC m=+0.245105639 container died 0337cacf67382735b5e50ae6300b9012838f282575afdf7e7823d7d0d4429ecd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mon-a, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-08-31T05:19:08.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:08 smithi005 podman[18480]: 2024-08-31 05:19:08.740340555 +0000 UTC m=+0.601676098 container cleanup 0337cacf67382735b5e50ae6300b9012838f282575afdf7e7823d7d0d4429ecd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0) 2024-08-31T05:19:08.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:08 smithi005 bash[18480]: ceph-69422704-6758-11ef-bcd4-c7b262605968-mon-a 2024-08-31T05:19:09.368 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:08 smithi005 podman[18492]: 2024-08-31 05:19:08.991329135 +0000 UTC m=+0.607594595 container remove 0337cacf67382735b5e50ae6300b9012838f282575afdf7e7823d7d0d4429ecd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mon-a, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T05:19:09.368 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 systemd[1]: ceph-69422704-6758-11ef-bcd4-c7b262605968@mon.a.service: Deactivated successfully. 2024-08-31T05:19:09.368 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 systemd[1]: Stopped Ceph mon.a for 69422704-6758-11ef-bcd4-c7b262605968. 2024-08-31T05:19:09.368 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 systemd[1]: Starting Ceph mon.a for 69422704-6758-11ef-bcd4-c7b262605968... 2024-08-31T05:19:09.608 INFO:teuthology.orchestra.run.smithi005.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-08-31T05:19:09.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 podman[18583]: 2024-08-31 05:19:09.366978067 +0000 UTC m=+0.109455028 container create d301a3f56d33675afaa7a383425a7cf3ca3469a181201045b394c01881e21bd6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-08-31T05:19:09.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 podman[18583]: 2024-08-31 05:19:09.273292887 +0000 UTC m=+0.015769869 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T05:19:09.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 podman[18583]: 2024-08-31 05:19:09.535958638 +0000 UTC m=+0.278435601 container init d301a3f56d33675afaa7a383425a7cf3ca3469a181201045b394c01881e21bd6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mon-a, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-08-31T05:19:09.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 podman[18583]: 2024-08-31 05:19:09.539597684 +0000 UTC m=+0.282074647 container start d301a3f56d33675afaa7a383425a7cf3ca3469a181201045b394c01881e21bd6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-08-31T05:19:09.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: set uid:gid to 167:167 (ceph:ceph) 2024-08-31T05:19:09.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev), process ceph-mon, pid 2 2024-08-31T05:19:09.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: pidfile_write: ignore empty --pid-file 2024-08-31T05:19:09.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: load: jerasure load: lrc 2024-08-31T05:19:09.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: RocksDB version: 7.9.2 2024-08-31T05:19:09.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Git sha 0 2024-08-31T05:19:09.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Compile date 2024-08-28 10:19:06 2024-08-31T05:19:09.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: DB SUMMARY 2024-08-31T05:19:09.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: DB Session ID: MW77IUQGGH950PS3Q54R 2024-08-31T05:19:09.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: CURRENT file: CURRENT 2024-08-31T05:19:09.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: IDENTITY file: IDENTITY 2024-08-31T05:19:09.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-08-31T05:19:09.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-08-31T05:19:09.719 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 95545 ; 2024-08-31T05:19:09.719 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.error_if_exists: 0 2024-08-31T05:19:09.719 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.create_if_missing: 0 2024-08-31T05:19:09.719 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.paranoid_checks: 1 2024-08-31T05:19:09.719 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.flush_verify_memtable_count: 1 2024-08-31T05:19:09.719 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-08-31T05:19:09.719 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-08-31T05:19:09.719 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.env: 0x55b4c34ce5a0 2024-08-31T05:19:09.719 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.fs: PosixFileSystem 2024-08-31T05:19:09.719 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.info_log: 0x55b4c9ac74e0 2024-08-31T05:19:09.719 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.max_file_opening_threads: 16 2024-08-31T05:19:09.719 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.statistics: (nil) 2024-08-31T05:19:09.720 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.use_fsync: 0 2024-08-31T05:19:09.720 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.max_log_file_size: 0 2024-08-31T05:19:09.720 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-08-31T05:19:09.720 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.log_file_time_to_roll: 0 2024-08-31T05:19:09.720 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.keep_log_file_num: 1000 2024-08-31T05:19:09.720 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.recycle_log_file_num: 0 2024-08-31T05:19:09.720 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.allow_fallocate: 1 2024-08-31T05:19:09.720 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.allow_mmap_reads: 0 2024-08-31T05:19:09.720 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.allow_mmap_writes: 0 2024-08-31T05:19:09.720 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.use_direct_reads: 0 2024-08-31T05:19:09.720 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-08-31T05:19:09.721 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.create_missing_column_families: 0 2024-08-31T05:19:09.721 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.db_log_dir: 2024-08-31T05:19:09.721 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.wal_dir: 2024-08-31T05:19:09.721 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.table_cache_numshardbits: 6 2024-08-31T05:19:09.721 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.WAL_ttl_seconds: 0 2024-08-31T05:19:09.721 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.WAL_size_limit_MB: 0 2024-08-31T05:19:09.721 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-08-31T05:19:09.721 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-08-31T05:19:09.721 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.is_fd_close_on_exec: 1 2024-08-31T05:19:09.721 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.advise_random_on_open: 1 2024-08-31T05:19:09.721 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.db_write_buffer_size: 0 2024-08-31T05:19:09.721 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.write_buffer_manager: 0x55b4c9acb5e0 2024-08-31T05:19:09.722 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-08-31T05:19:09.722 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-08-31T05:19:09.722 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.use_adaptive_mutex: 0 2024-08-31T05:19:09.722 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.rate_limiter: (nil) 2024-08-31T05:19:09.723 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-08-31T05:19:09.723 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.wal_recovery_mode: 2 2024-08-31T05:19:09.723 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.enable_thread_tracking: 0 2024-08-31T05:19:09.723 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.enable_pipelined_write: 0 2024-08-31T05:19:09.723 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.unordered_write: 0 2024-08-31T05:19:09.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-08-31T05:19:09.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-08-31T05:19:09.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-08-31T05:19:09.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-08-31T05:19:09.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.row_cache: None 2024-08-31T05:19:09.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.wal_filter: None 2024-08-31T05:19:09.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-08-31T05:19:09.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.allow_ingest_behind: 0 2024-08-31T05:19:09.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.two_write_queues: 0 2024-08-31T05:19:09.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.manual_wal_flush: 0 2024-08-31T05:19:09.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.wal_compression: 0 2024-08-31T05:19:09.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.atomic_flush: 0 2024-08-31T05:19:09.725 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-08-31T05:19:09.725 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.persist_stats_to_disk: 0 2024-08-31T05:19:09.725 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.write_dbid_to_manifest: 0 2024-08-31T05:19:09.725 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.log_readahead_size: 0 2024-08-31T05:19:09.725 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-08-31T05:19:09.725 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.best_efforts_recovery: 0 2024-08-31T05:19:09.725 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-08-31T05:19:09.725 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-08-31T05:19:09.725 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.allow_data_in_errors: 0 2024-08-31T05:19:09.725 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.db_host_id: __hostname__ 2024-08-31T05:19:09.725 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.enforce_single_del_contracts: true 2024-08-31T05:19:09.725 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.max_background_jobs: 2 2024-08-31T05:19:09.726 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.max_background_compactions: -1 2024-08-31T05:19:09.726 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.max_subcompactions: 1 2024-08-31T05:19:09.726 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-08-31T05:19:09.726 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-08-31T05:19:09.726 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.delayed_write_rate : 16777216 2024-08-31T05:19:09.726 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.max_total_wal_size: 0 2024-08-31T05:19:09.726 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-08-31T05:19:09.726 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.stats_dump_period_sec: 600 2024-08-31T05:19:09.726 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.stats_persist_period_sec: 600 2024-08-31T05:19:09.726 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-08-31T05:19:09.726 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.max_open_files: -1 2024-08-31T05:19:09.726 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.bytes_per_sync: 0 2024-08-31T05:19:09.726 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.wal_bytes_per_sync: 0 2024-08-31T05:19:09.727 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.strict_bytes_per_sync: 0 2024-08-31T05:19:09.727 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.compaction_readahead_size: 0 2024-08-31T05:19:09.727 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.max_background_flushes: -1 2024-08-31T05:19:09.727 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Compression algorithms supported: 2024-08-31T05:19:09.727 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: kZSTD supported: 0 2024-08-31T05:19:09.727 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: kXpressCompression supported: 0 2024-08-31T05:19:09.727 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: kBZip2Compression supported: 0 2024-08-31T05:19:09.727 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-08-31T05:19:09.727 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: kLZ4Compression supported: 1 2024-08-31T05:19:09.727 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: kZlibCompression supported: 1 2024-08-31T05:19:09.727 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: kLZ4HCCompression supported: 1 2024-08-31T05:19:09.727 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: kSnappyCompression supported: 1 2024-08-31T05:19:09.727 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Fast CRC32 supported: Supported on x86 2024-08-31T05:19:09.728 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: DMutex implementation: pthread_mutex_t 2024-08-31T05:19:09.728 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-08-31T05:19:09.728 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-08-31T05:19:09.728 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-08-31T05:19:09.728 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.merge_operator: 2024-08-31T05:19:09.728 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.compaction_filter: None 2024-08-31T05:19:09.728 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.compaction_filter_factory: None 2024-08-31T05:19:09.728 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.sst_partitioner_factory: None 2024-08-31T05:19:09.728 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.memtable_factory: SkipListFactory 2024-08-31T05:19:09.728 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.table_factory: BlockBasedTable 2024-08-31T05:19:09.728 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55b4c9ac7100) 2024-08-31T05:19:09.728 INFO:journalctl@ceph.mon.a.smithi005.stdout: cache_index_and_filter_blocks: 1 2024-08-31T05:19:09.728 INFO:journalctl@ceph.mon.a.smithi005.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-08-31T05:19:09.729 INFO:journalctl@ceph.mon.a.smithi005.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-08-31T05:19:09.729 INFO:journalctl@ceph.mon.a.smithi005.stdout: pin_top_level_index_and_filter: 1 2024-08-31T05:19:09.729 INFO:journalctl@ceph.mon.a.smithi005.stdout: index_type: 0 2024-08-31T05:19:09.729 INFO:journalctl@ceph.mon.a.smithi005.stdout: data_block_index_type: 0 2024-08-31T05:19:09.729 INFO:journalctl@ceph.mon.a.smithi005.stdout: index_shortening: 1 2024-08-31T05:19:09.729 INFO:journalctl@ceph.mon.a.smithi005.stdout: data_block_hash_table_util_ratio: 0.750000 2024-08-31T05:19:09.729 INFO:journalctl@ceph.mon.a.smithi005.stdout: checksum: 4 2024-08-31T05:19:09.729 INFO:journalctl@ceph.mon.a.smithi005.stdout: no_block_cache: 0 2024-08-31T05:19:09.729 INFO:journalctl@ceph.mon.a.smithi005.stdout: block_cache: 0x55b4c5a8a850 2024-08-31T05:19:09.729 INFO:journalctl@ceph.mon.a.smithi005.stdout: block_cache_name: BinnedLRUCache 2024-08-31T05:19:09.729 INFO:journalctl@ceph.mon.a.smithi005.stdout: block_cache_options: 2024-08-31T05:19:09.729 INFO:journalctl@ceph.mon.a.smithi005.stdout: capacity : 536870912 2024-08-31T05:19:09.729 INFO:journalctl@ceph.mon.a.smithi005.stdout: num_shard_bits : 4 2024-08-31T05:19:09.730 INFO:journalctl@ceph.mon.a.smithi005.stdout: strict_capacity_limit : 0 2024-08-31T05:19:09.730 INFO:journalctl@ceph.mon.a.smithi005.stdout: high_pri_pool_ratio: 0.000 2024-08-31T05:19:09.730 INFO:journalctl@ceph.mon.a.smithi005.stdout: block_cache_compressed: (nil) 2024-08-31T05:19:09.730 INFO:journalctl@ceph.mon.a.smithi005.stdout: persistent_cache: (nil) 2024-08-31T05:19:09.730 INFO:journalctl@ceph.mon.a.smithi005.stdout: block_size: 4096 2024-08-31T05:19:09.730 INFO:journalctl@ceph.mon.a.smithi005.stdout: block_size_deviation: 10 2024-08-31T05:19:09.730 INFO:journalctl@ceph.mon.a.smithi005.stdout: block_restart_interval: 16 2024-08-31T05:19:09.730 INFO:journalctl@ceph.mon.a.smithi005.stdout: index_block_restart_interval: 1 2024-08-31T05:19:09.730 INFO:journalctl@ceph.mon.a.smithi005.stdout: metadata_block_size: 4096 2024-08-31T05:19:09.730 INFO:journalctl@ceph.mon.a.smithi005.stdout: partition_filters: 0 2024-08-31T05:19:09.730 INFO:journalctl@ceph.mon.a.smithi005.stdout: use_delta_encoding: 1 2024-08-31T05:19:09.730 INFO:journalctl@ceph.mon.a.smithi005.stdout: filter_policy: bloomfilter 2024-08-31T05:19:09.730 INFO:journalctl@ceph.mon.a.smithi005.stdout: whole_key_filtering: 1 2024-08-31T05:19:09.731 INFO:journalctl@ceph.mon.a.smithi005.stdout: verify_compression: 0 2024-08-31T05:19:09.731 INFO:journalctl@ceph.mon.a.smithi005.stdout: read_amp_bytes_per_bit: 0 2024-08-31T05:19:09.731 INFO:journalctl@ceph.mon.a.smithi005.stdout: format_version: 5 2024-08-31T05:19:09.731 INFO:journalctl@ceph.mon.a.smithi005.stdout: enable_index_compression: 1 2024-08-31T05:19:09.731 INFO:journalctl@ceph.mon.a.smithi005.stdout: block_align: 0 2024-08-31T05:19:09.731 INFO:journalctl@ceph.mon.a.smithi005.stdout: max_auto_readahead_size: 262144 2024-08-31T05:19:09.731 INFO:journalctl@ceph.mon.a.smithi005.stdout: prepopulate_block_cache: 0 2024-08-31T05:19:09.731 INFO:journalctl@ceph.mon.a.smithi005.stdout: initial_auto_readahead_size: 8192 2024-08-31T05:19:09.731 INFO:journalctl@ceph.mon.a.smithi005.stdout: num_file_reads_for_auto_readahead: 2 2024-08-31T05:19:09.731 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.write_buffer_size: 33554432 2024-08-31T05:19:09.731 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.max_write_buffer_number: 2 2024-08-31T05:19:09.731 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.compression: NoCompression 2024-08-31T05:19:09.731 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.bottommost_compression: Disabled 2024-08-31T05:19:09.731 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.prefix_extractor: nullptr 2024-08-31T05:19:09.732 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-08-31T05:19:09.732 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.num_levels: 7 2024-08-31T05:19:09.732 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-08-31T05:19:09.732 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-08-31T05:19:09.732 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-08-31T05:19:09.732 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-08-31T05:19:09.732 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-08-31T05:19:09.732 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-08-31T05:19:09.732 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-08-31T05:19:09.732 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-08-31T05:19:09.732 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-08-31T05:19:09.732 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-08-31T05:19:09.732 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-08-31T05:19:09.733 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-08-31T05:19:09.733 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.compression_opts.window_bits: -14 2024-08-31T05:19:09.733 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.compression_opts.level: 32767 2024-08-31T05:19:09.733 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.compression_opts.strategy: 0 2024-08-31T05:19:09.733 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-08-31T05:19:09.733 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-08-31T05:19:09.733 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-08-31T05:19:09.733 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-08-31T05:19:09.733 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.compression_opts.enabled: false 2024-08-31T05:19:09.733 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-08-31T05:19:09.733 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-08-31T05:19:09.733 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-08-31T05:19:09.733 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-08-31T05:19:09.733 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.target_file_size_base: 67108864 2024-08-31T05:19:09.734 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.target_file_size_multiplier: 1 2024-08-31T05:19:09.734 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-08-31T05:19:09.734 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-08-31T05:19:09.734 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-08-31T05:19:09.734 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-08-31T05:19:09.734 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-08-31T05:19:09.734 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-08-31T05:19:09.734 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-08-31T05:19:09.734 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-08-31T05:19:09.734 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-08-31T05:19:09.734 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-08-31T05:19:09.734 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-08-31T05:19:09.734 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-08-31T05:19:09.735 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-08-31T05:19:09.735 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.arena_block_size: 1048576 2024-08-31T05:19:09.735 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-08-31T05:19:09.735 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-08-31T05:19:09.735 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.disable_auto_compactions: 0 2024-08-31T05:19:09.735 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-08-31T05:19:09.735 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-08-31T05:19:09.735 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-08-31T05:19:09.735 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-08-31T05:19:09.735 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-08-31T05:19:09.735 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-08-31T05:19:09.735 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-08-31T05:19:09.735 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-08-31T05:19:09.736 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-08-31T05:19:09.736 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-08-31T05:19:09.736 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-08-31T05:19:09.736 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.inplace_update_support: 0 2024-08-31T05:19:09.736 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.inplace_update_num_locks: 10000 2024-08-31T05:19:09.736 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-08-31T05:19:09.736 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-08-31T05:19:09.736 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.memtable_huge_page_size: 0 2024-08-31T05:19:09.736 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.bloom_locality: 0 2024-08-31T05:19:09.736 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.max_successive_merges: 0 2024-08-31T05:19:09.736 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.optimize_filters_for_hits: 0 2024-08-31T05:19:09.736 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.paranoid_file_checks: 0 2024-08-31T05:19:09.736 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.force_consistency_checks: 1 2024-08-31T05:19:09.737 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.report_bg_io_stats: 0 2024-08-31T05:19:09.737 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.ttl: 2592000 2024-08-31T05:19:09.737 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.periodic_compaction_seconds: 0 2024-08-31T05:19:09.737 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-08-31T05:19:09.737 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-08-31T05:19:09.737 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.enable_blob_files: false 2024-08-31T05:19:09.737 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.min_blob_size: 0 2024-08-31T05:19:09.737 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.blob_file_size: 268435456 2024-08-31T05:19:09.737 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.blob_compression_type: NoCompression 2024-08-31T05:19:09.737 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.enable_blob_garbage_collection: false 2024-08-31T05:19:09.737 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-08-31T05:19:09.737 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-08-31T05:19:09.737 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-08-31T05:19:09.738 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.blob_file_starting_level: 0 2024-08-31T05:19:09.738 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-08-31T05:19:09.738 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-08-31T05:19:09.738 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-08-31T05:19:09.738 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: e57eec5c-c7cb-4b71-b70e-30abf4f48239 2024-08-31T05:19:09.738 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725081549576023, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-08-31T05:19:09.738 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-08-31T05:19:09.738 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725081549577091, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 91652, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 284, "table_properties": {"data_size": 89699, "index_size": 273, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11760, "raw_average_key_size": 48, "raw_value_size": 83087, "raw_average_value_size": 341, "num_data_blocks": 12, "num_entries": 243, "num_filter_entries": 243, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1725081549, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "e57eec5c-c7cb-4b71-b70e-30abf4f48239", "db_session_id": "MW77IUQGGH950PS3Q54R", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-08-31T05:19:09.738 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725081549577194, "job": 1, "event": "recovery_finished"} 2024-08-31T05:19:09.738 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-08-31T05:19:09.738 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-08-31T05:19:09.738 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55b4c9aeaa80 2024-08-31T05:19:09.738 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: DB pointer 0x55b4ca88c000 2024-08-31T05:19:09.739 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-08-31T05:19:09.739 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-08-31T05:19:09.739 INFO:journalctl@ceph.mon.a.smithi005.stdout: ** DB Stats ** 2024-08-31T05:19:09.739 INFO:journalctl@ceph.mon.a.smithi005.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-31T05:19:09.739 INFO:journalctl@ceph.mon.a.smithi005.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-08-31T05:19:09.739 INFO:journalctl@ceph.mon.a.smithi005.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-31T05:19:09.739 INFO:journalctl@ceph.mon.a.smithi005.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-31T05:19:09.739 INFO:journalctl@ceph.mon.a.smithi005.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-08-31T05:19:09.739 INFO:journalctl@ceph.mon.a.smithi005.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-31T05:19:09.739 INFO:journalctl@ceph.mon.a.smithi005.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-31T05:19:09.739 INFO:journalctl@ceph.mon.a.smithi005.stdout: 2024-08-31T05:19:09.739 INFO:journalctl@ceph.mon.a.smithi005.stdout: ** Compaction Stats [default] ** 2024-08-31T05:19:09.739 INFO:journalctl@ceph.mon.a.smithi005.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-31T05:19:09.739 INFO:journalctl@ceph.mon.a.smithi005.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-08-31T05:19:09.739 INFO:journalctl@ceph.mon.a.smithi005.stdout: L0 2/0 91.36 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 132.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-31T05:19:09.740 INFO:journalctl@ceph.mon.a.smithi005.stdout: Sum 2/0 91.36 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 132.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-31T05:19:09.740 INFO:journalctl@ceph.mon.a.smithi005.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 132.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-31T05:19:09.740 INFO:journalctl@ceph.mon.a.smithi005.stdout: 2024-08-31T05:19:09.740 INFO:journalctl@ceph.mon.a.smithi005.stdout: ** Compaction Stats [default] ** 2024-08-31T05:19:09.740 INFO:journalctl@ceph.mon.a.smithi005.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-31T05:19:09.740 INFO:journalctl@ceph.mon.a.smithi005.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-08-31T05:19:09.740 INFO:journalctl@ceph.mon.a.smithi005.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 132.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-31T05:19:09.740 INFO:journalctl@ceph.mon.a.smithi005.stdout: 2024-08-31T05:19:09.740 INFO:journalctl@ceph.mon.a.smithi005.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-08-31T05:19:09.740 INFO:journalctl@ceph.mon.a.smithi005.stdout: 2024-08-31T05:19:09.740 INFO:journalctl@ceph.mon.a.smithi005.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-31T05:19:09.740 INFO:journalctl@ceph.mon.a.smithi005.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-08-31T05:19:09.741 INFO:journalctl@ceph.mon.a.smithi005.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-08-31T05:19:09.741 INFO:journalctl@ceph.mon.a.smithi005.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-08-31T05:19:09.741 INFO:journalctl@ceph.mon.a.smithi005.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-08-31T05:19:09.741 INFO:journalctl@ceph.mon.a.smithi005.stdout: AddFile(Keys): cumulative 0, interval 0 2024-08-31T05:19:09.741 INFO:journalctl@ceph.mon.a.smithi005.stdout: Cumulative compaction: 0.00 GB write, 26.78 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-31T05:19:09.741 INFO:journalctl@ceph.mon.a.smithi005.stdout: Interval compaction: 0.00 GB write, 26.78 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-31T05:19:09.741 INFO:journalctl@ceph.mon.a.smithi005.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-08-31T05:19:09.741 INFO:journalctl@ceph.mon.a.smithi005.stdout: Block cache BinnedLRUCache@0x55b4c5a8a850#2 capacity: 512.00 MB usage: 1.31 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-08-31T05:19:09.741 INFO:journalctl@ceph.mon.a.smithi005.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.84 KB,0.000160933%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-08-31T05:19:09.741 INFO:journalctl@ceph.mon.a.smithi005.stdout: 2024-08-31T05:19:09.741 INFO:journalctl@ceph.mon.a.smithi005.stdout: ** File Read Latency Histogram By Level [default] ** 2024-08-31T05:19:09.741 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: starting mon.a rank 0 at public addrs [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] at bind addrs [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 69422704-6758-11ef-bcd4-c7b262605968 2024-08-31T05:19:09.741 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: mon.a@-1(???) e1 preinit fsid 69422704-6758-11ef-bcd4-c7b262605968 2024-08-31T05:19:09.742 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: mon.a@-1(???).mds e1 new map 2024-08-31T05:19:09.742 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: mon.a@-1(???).mds e1 print_map 2024-08-31T05:19:09.742 INFO:journalctl@ceph.mon.a.smithi005.stdout: e1 2024-08-31T05:19:09.742 INFO:journalctl@ceph.mon.a.smithi005.stdout: btime 2024-08-31T05:19:04:860087+0000 2024-08-31T05:19:09.742 INFO:journalctl@ceph.mon.a.smithi005.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-08-31T05:19:09.742 INFO:journalctl@ceph.mon.a.smithi005.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T05:19:09.742 INFO:journalctl@ceph.mon.a.smithi005.stdout: legacy client fscid: -1 2024-08-31T05:19:09.742 INFO:journalctl@ceph.mon.a.smithi005.stdout: 2024-08-31T05:19:09.742 INFO:journalctl@ceph.mon.a.smithi005.stdout: No filesystems configured 2024-08-31T05:19:09.742 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-08-31T05:19:09.742 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-31T05:19:09.742 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-31T05:19:09.742 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-31T05:19:09.742 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 ceph-mon[18602]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-08-31T05:19:09.743 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 bash[18583]: d301a3f56d33675afaa7a383425a7cf3ca3469a181201045b394c01881e21bd6 2024-08-31T05:19:09.743 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:09 smithi005 systemd[1]: Started Ceph mon.a for 69422704-6758-11ef-bcd4-c7b262605968. 2024-08-31T05:19:10.780 INFO:teuthology.orchestra.run.smithi005.stdout:Wrote config to /etc/ceph/ceph.conf 2024-08-31T05:19:10.793 INFO:teuthology.orchestra.run.smithi005.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-08-31T05:19:10.793 INFO:teuthology.orchestra.run.smithi005.stdout:Creating mgr... 2024-08-31T05:19:10.793 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying port 0.0.0.0:9283 ... 2024-08-31T05:19:10.794 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying port 0.0.0.0:8765 ... 2024-08-31T05:19:10.851 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:10 smithi005 ceph-mon[18602]: mon.a is new leader, mons a in quorum (ranks 0) 2024-08-31T05:19:10.852 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:10 smithi005 ceph-mon[18602]: monmap epoch 1 2024-08-31T05:19:10.852 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:10 smithi005 ceph-mon[18602]: fsid 69422704-6758-11ef-bcd4-c7b262605968 2024-08-31T05:19:10.852 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:10 smithi005 ceph-mon[18602]: last_changed 2024-08-31T05:19:01.939099+0000 2024-08-31T05:19:10.852 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:10 smithi005 ceph-mon[18602]: created 2024-08-31T05:19:01.939099+0000 2024-08-31T05:19:10.852 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:10 smithi005 ceph-mon[18602]: min_mon_release 19 (squid) 2024-08-31T05:19:10.852 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:10 smithi005 ceph-mon[18602]: election_strategy: 1 2024-08-31T05:19:10.852 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:10 smithi005 ceph-mon[18602]: 0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-31T05:19:10.852 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:10 smithi005 ceph-mon[18602]: fsmap 2024-08-31T05:19:10.852 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:10 smithi005 ceph-mon[18602]: osdmap e1: 0 total, 0 up, 0 in 2024-08-31T05:19:10.852 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:10 smithi005 ceph-mon[18602]: mgrmap e1: no daemons active 2024-08-31T05:19:10.852 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:10 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/3205494319' entity='client.admin' 2024-08-31T05:19:11.017 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-69422704-6758-11ef-bcd4-c7b262605968@mgr.x 2024-08-31T05:19:11.017 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Failed to reset failed state of unit ceph-69422704-6758-11ef-bcd4-c7b262605968@mgr.x.service: Unit ceph-69422704-6758-11ef-bcd4-c7b262605968@mgr.x.service not loaded. 2024-08-31T05:19:11.192 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-69422704-6758-11ef-bcd4-c7b262605968.target.wants/ceph-69422704-6758-11ef-bcd4-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-69422704-6758-11ef-bcd4-c7b262605968@.service. 2024-08-31T05:19:11.729 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-31T05:19:11.729 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout disabled 2024-08-31T05:19:11.736 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-31T05:19:11.736 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout inactive 2024-08-31T05:19:11.736 INFO:teuthology.orchestra.run.smithi005.stdout:firewalld.service is not enabled 2024-08-31T05:19:11.736 INFO:teuthology.orchestra.run.smithi005.stdout:Not possible to enable service . firewalld.service is not available 2024-08-31T05:19:11.746 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-31T05:19:11.746 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout disabled 2024-08-31T05:19:11.753 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-31T05:19:11.754 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout inactive 2024-08-31T05:19:11.754 INFO:teuthology.orchestra.run.smithi005.stdout:firewalld.service is not enabled 2024-08-31T05:19:11.754 INFO:teuthology.orchestra.run.smithi005.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-08-31T05:19:11.754 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for mgr to start... 2024-08-31T05:19:11.754 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for mgr... 2024-08-31T05:19:11.877 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:11 smithi005 systemd[1]: Started Ceph mgr.x for 69422704-6758-11ef-bcd4-c7b262605968. 2024-08-31T05:19:12.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:12 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/240212756' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-08-31T05:19:12.813 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-08-31T05:19:12.813 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2024-08-31T05:19:12.813 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "fsid": "69422704-6758-11ef-bcd4-c7b262605968", 2024-08-31T05:19:12.813 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "health": { 2024-08-31T05:19:12.814 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-31T05:19:12.814 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-31T05:19:12.814 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-31T05:19:12.814 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-08-31T05:19:12.814 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-31T05:19:12.814 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-31T05:19:12.814 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 0 2024-08-31T05:19:12.814 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2024-08-31T05:19:12.814 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-31T05:19:12.814 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "a" 2024-08-31T05:19:12.814 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2024-08-31T05:19:12.815 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-08-31T05:19:12.815 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-31T05:19:12.815 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T05:19:12.815 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-08-31T05:19:12.815 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-31T05:19:12.815 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-08-31T05:19:12.815 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-31T05:19:12.815 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T05:19:12.815 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-31T05:19:12.815 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-31T05:19:12.815 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-31T05:19:12.815 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-31T05:19:12.815 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-31T05:19:12.815 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-31T05:19:12.816 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-08-31T05:19:12.816 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-31T05:19:12.816 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-31T05:19:12.816 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-31T05:19:12.816 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-31T05:19:12.816 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-31T05:19:12.816 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-31T05:19:12.816 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-31T05:19:12.816 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-31T05:19:12.816 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-31T05:19:12.816 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-08-31T05:19:12.816 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-31T05:19:12.817 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T05:19:12.817 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "btime": "2024-08-31T05:19:04:860087+0000", 2024-08-31T05:19:12.817 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-31T05:19:12.817 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-31T05:19:12.817 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-08-31T05:19:12.817 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-31T05:19:12.817 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "available": false, 2024-08-31T05:19:12.817 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-31T05:19:12.817 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-31T05:19:12.817 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-31T05:19:12.817 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-31T05:19:12.817 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "restful" 2024-08-31T05:19:12.817 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2024-08-31T05:19:12.817 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-31T05:19:12.817 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-08-31T05:19:12.818 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-31T05:19:12.818 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T05:19:12.818 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "modified": "2024-08-31T05:19:04.860855+0000", 2024-08-31T05:19:12.818 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-31T05:19:12.818 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-08-31T05:19:12.818 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-31T05:19:12.818 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2024-08-31T05:19:12.818 INFO:teuthology.orchestra.run.smithi005.stdout:mgr not available, waiting (1/15)... 2024-08-31T05:19:17.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:16 smithi005 ceph-mon[18602]: Activating manager daemon x 2024-08-31T05:19:17.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:16 smithi005 ceph-mon[18602]: mgrmap e2: x(active, starting, since 0.00358941s) 2024-08-31T05:19:17.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:16 smithi005 ceph-mon[18602]: from='mgr.14100 172.21.15.5:0/1448468023' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-08-31T05:19:17.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:16 smithi005 ceph-mon[18602]: from='mgr.14100 172.21.15.5:0/1448468023' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-08-31T05:19:17.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:16 smithi005 ceph-mon[18602]: from='mgr.14100 172.21.15.5:0/1448468023' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-08-31T05:19:17.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:16 smithi005 ceph-mon[18602]: from='mgr.14100 172.21.15.5:0/1448468023' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T05:19:17.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:16 smithi005 ceph-mon[18602]: from='mgr.14100 172.21.15.5:0/1448468023' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-08-31T05:19:17.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:16 smithi005 ceph-mon[18602]: Manager daemon x is now available 2024-08-31T05:19:17.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:16 smithi005 ceph-mon[18602]: from='mgr.14100 172.21.15.5:0/1448468023' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-08-31T05:19:17.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:16 smithi005 ceph-mon[18602]: from='mgr.14100 172.21.15.5:0/1448468023' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-08-31T05:19:17.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:16 smithi005 ceph-mon[18602]: from='mgr.14100 172.21.15.5:0/1448468023' entity='mgr.x' 2024-08-31T05:19:17.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:16 smithi005 ceph-mon[18602]: from='mgr.14100 172.21.15.5:0/1448468023' entity='mgr.x' 2024-08-31T05:19:17.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:16 smithi005 ceph-mon[18602]: from='mgr.14100 172.21.15.5:0/1448468023' entity='mgr.x' 2024-08-31T05:19:18.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:18 smithi005 ceph-mon[18602]: mgrmap e3: x(active, since 1.00962s) 2024-08-31T05:19:18.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:18 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/162969243' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-08-31T05:19:20.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:19 smithi005 ceph-mon[18602]: mgrmap e4: x(active, since 2s) 2024-08-31T05:19:24.504 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-08-31T05:19:24.507 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2024-08-31T05:19:24.507 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "fsid": "69422704-6758-11ef-bcd4-c7b262605968", 2024-08-31T05:19:24.507 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "health": { 2024-08-31T05:19:24.507 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-31T05:19:24.507 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-31T05:19:24.507 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-31T05:19:24.507 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-08-31T05:19:24.507 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-31T05:19:24.507 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-31T05:19:24.507 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 0 2024-08-31T05:19:24.507 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2024-08-31T05:19:24.508 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-31T05:19:24.508 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "a" 2024-08-31T05:19:24.508 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2024-08-31T05:19:24.508 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-08-31T05:19:24.508 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-31T05:19:24.508 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T05:19:24.508 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-08-31T05:19:24.508 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-31T05:19:24.509 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-08-31T05:19:24.509 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-31T05:19:24.509 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T05:19:24.509 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-31T05:19:24.509 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-31T05:19:24.509 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-31T05:19:24.513 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-31T05:19:24.513 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-31T05:19:24.513 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-31T05:19:24.513 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-08-31T05:19:24.513 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-31T05:19:24.513 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-31T05:19:24.514 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-31T05:19:24.514 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-31T05:19:24.514 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-31T05:19:24.514 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-31T05:19:24.514 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-31T05:19:24.514 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-31T05:19:24.514 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-31T05:19:24.514 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-08-31T05:19:24.514 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-31T05:19:24.514 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T05:19:24.514 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "btime": "2024-08-31T05:19:04:860087+0000", 2024-08-31T05:19:24.514 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-31T05:19:24.514 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-31T05:19:24.514 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-08-31T05:19:24.515 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-31T05:19:24.515 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-31T05:19:24.515 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-31T05:19:24.515 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-31T05:19:24.515 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-31T05:19:24.515 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-31T05:19:24.515 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "restful" 2024-08-31T05:19:24.515 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2024-08-31T05:19:24.515 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-31T05:19:24.515 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-08-31T05:19:24.516 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-31T05:19:24.516 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T05:19:24.516 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "modified": "2024-08-31T05:19:04.860855+0000", 2024-08-31T05:19:24.516 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-31T05:19:24.516 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-08-31T05:19:24.516 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-31T05:19:24.516 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2024-08-31T05:19:24.516 INFO:teuthology.orchestra.run.smithi005.stdout:mgr is available 2024-08-31T05:19:25.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:25 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/63220432' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-08-31T05:19:25.813 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-08-31T05:19:25.813 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout [global] 2024-08-31T05:19:25.814 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout fsid = 69422704-6758-11ef-bcd4-c7b262605968 2024-08-31T05:19:25.814 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-08-31T05:19:25.814 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.5:3300,v1:172.21.15.5:6789] 2024-08-31T05:19:25.814 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-08-31T05:19:25.814 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-08-31T05:19:25.814 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-08-31T05:19:25.815 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-08-31T05:19:25.815 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-08-31T05:19:25.815 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout [mgr] 2024-08-31T05:19:25.815 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-08-31T05:19:25.815 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-08-31T05:19:25.815 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout [osd] 2024-08-31T05:19:25.816 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-08-31T05:19:25.816 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-08-31T05:19:25.816 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-08-31T05:19:25.816 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-08-31T05:19:25.816 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-08-31T05:19:25.816 INFO:teuthology.orchestra.run.smithi005.stdout:Enabling cephadm module... 2024-08-31T05:19:26.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:26 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/670903720' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-08-31T05:19:26.720 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:26 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: ignoring --setuser ceph since I am not root 2024-08-31T05:19:26.720 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:26 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: ignoring --setgroup ceph since I am not root 2024-08-31T05:19:27.682 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:27 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/670903720' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-08-31T05:19:27.682 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:27 smithi005 ceph-mon[18602]: mgrmap e5: x(active, since 9s) 2024-08-31T05:19:28.457 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2024-08-31T05:19:28.457 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-08-31T05:19:28.457 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-31T05:19:28.457 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-08-31T05:19:28.457 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-08-31T05:19:28.458 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2024-08-31T05:19:28.458 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for the mgr to restart... 2024-08-31T05:19:28.458 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for mgr epoch 5... 2024-08-31T05:19:28.716 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:28 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/3849983977' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-08-31T05:19:32.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:31 smithi005 ceph-mon[18602]: Active manager daemon x restarted 2024-08-31T05:19:32.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:31 smithi005 ceph-mon[18602]: Activating manager daemon x 2024-08-31T05:19:32.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:31 smithi005 ceph-mon[18602]: osdmap e2: 0 total, 0 up, 0 in 2024-08-31T05:19:32.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:31 smithi005 ceph-mon[18602]: mgrmap e6: x(active, starting, since 0.00351563s) 2024-08-31T05:19:32.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:31 smithi005 ceph-mon[18602]: from='mgr.14116 172.21.15.5:0/31122668' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T05:19:32.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:31 smithi005 ceph-mon[18602]: from='mgr.14116 172.21.15.5:0/31122668' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-08-31T05:19:32.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:31 smithi005 ceph-mon[18602]: from='mgr.14116 172.21.15.5:0/31122668' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-08-31T05:19:32.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:31 smithi005 ceph-mon[18602]: from='mgr.14116 172.21.15.5:0/31122668' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-08-31T05:19:32.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:31 smithi005 ceph-mon[18602]: from='mgr.14116 172.21.15.5:0/31122668' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-08-31T05:19:32.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:31 smithi005 ceph-mon[18602]: Manager daemon x is now available 2024-08-31T05:19:33.260 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2024-08-31T05:19:33.260 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-08-31T05:19:33.260 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "initialized": true 2024-08-31T05:19:33.260 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2024-08-31T05:19:33.260 INFO:teuthology.orchestra.run.smithi005.stdout:mgr epoch 5 is available 2024-08-31T05:19:33.260 INFO:teuthology.orchestra.run.smithi005.stdout:Setting orchestrator backend to cephadm... 2024-08-31T05:19:33.932 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:33 smithi005 ceph-mon[18602]: mgrmap e7: x(active, since 1.00547s) 2024-08-31T05:19:33.932 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:33 smithi005 ceph-mon[18602]: from='mgr.14116 172.21.15.5:0/31122668' entity='mgr.x' 2024-08-31T05:19:33.932 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:33 smithi005 ceph-mon[18602]: from='mgr.14116 172.21.15.5:0/31122668' entity='mgr.x' 2024-08-31T05:19:33.932 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:33 smithi005 ceph-mon[18602]: Found migration_current of "None". Setting to last migration. 2024-08-31T05:19:33.932 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:33 smithi005 ceph-mon[18602]: from='mgr.14116 172.21.15.5:0/31122668' entity='mgr.x' 2024-08-31T05:19:33.932 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:33 smithi005 ceph-mon[18602]: from='mgr.14116 172.21.15.5:0/31122668' entity='mgr.x' 2024-08-31T05:19:33.932 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:33 smithi005 ceph-mon[18602]: from='mgr.14116 172.21.15.5:0/31122668' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:19:33.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:33 smithi005 ceph-mon[18602]: from='mgr.14116 172.21.15.5:0/31122668' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:19:33.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:33 smithi005 ceph-mon[18602]: from='mgr.14116 172.21.15.5:0/31122668' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-08-31T05:19:33.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:33 smithi005 ceph-mon[18602]: from='mgr.14116 172.21.15.5:0/31122668' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-08-31T05:19:34.918 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:34 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: 2024-08-31T05:19:34.590+0000 7fe391d1b640 -1 log_channel(cephadm) log [ERR] : [31/Aug/2024:05:19:34] ENGINE Error in HTTPServer.serve 2024-08-31T05:19:34.918 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:34 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: Traceback (most recent call last): 2024-08-31T05:19:34.918 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:34 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T05:19:34.919 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:34 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: self._connections.run(self.expiration_interval) 2024-08-31T05:19:34.919 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:34 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T05:19:34.919 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:34 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: self._run(expiration_interval) 2024-08-31T05:19:34.919 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:34 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T05:19:34.919 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:34 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T05:19:34.919 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:34 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T05:19:34.919 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:34 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T05:19:34.920 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:34 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T05:19:34.920 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:34 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: s = self.context.wrap_socket( 2024-08-31T05:19:34.920 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:34 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T05:19:34.920 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:34 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: return self.sslsocket_class._create( 2024-08-31T05:19:34.920 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:34 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T05:19:34.920 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:34 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: self.do_handshake() 2024-08-31T05:19:34.920 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:34 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T05:19:34.920 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:34 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: self._sslobj.do_handshake() 2024-08-31T05:19:34.920 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:34 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T05:19:34.920 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:34 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: 2024-08-31T05:19:35.191 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:34 smithi005 ceph-mon[18602]: from='client.14128 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:19:35.192 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:34 smithi005 ceph-mon[18602]: from='mgr.14116 172.21.15.5:0/31122668' entity='mgr.x' 2024-08-31T05:19:35.192 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:34 smithi005 ceph-mon[18602]: from='mgr.14116 172.21.15.5:0/31122668' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:19:35.192 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:34 smithi005 ceph-mon[18602]: [31/Aug/2024:05:19:34] ENGINE Bus STARTING 2024-08-31T05:19:35.192 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:34 smithi005 ceph-mon[18602]: mgrmap e8: x(active, since 2s) 2024-08-31T05:19:35.193 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:34 smithi005 ceph-mon[18602]: from='mgr.14116 172.21.15.5:0/31122668' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:19:36.003 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:35 smithi005 ceph-mon[18602]: [31/Aug/2024:05:19:34] ENGINE Serving on https://172.21.15.5:7150 2024-08-31T05:19:36.003 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:35 smithi005 ceph-mon[18602]: [31/Aug/2024:05:19:34] ENGINE Error in HTTPServer.serve 2024-08-31T05:19:36.003 INFO:journalctl@ceph.mon.a.smithi005.stdout: Traceback (most recent call last): 2024-08-31T05:19:36.004 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T05:19:36.004 INFO:journalctl@ceph.mon.a.smithi005.stdout: self._connections.run(self.expiration_interval) 2024-08-31T05:19:36.004 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T05:19:36.004 INFO:journalctl@ceph.mon.a.smithi005.stdout: self._run(expiration_interval) 2024-08-31T05:19:36.004 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T05:19:36.004 INFO:journalctl@ceph.mon.a.smithi005.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T05:19:36.004 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T05:19:36.004 INFO:journalctl@ceph.mon.a.smithi005.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T05:19:36.004 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T05:19:36.004 INFO:journalctl@ceph.mon.a.smithi005.stdout: s = self.context.wrap_socket( 2024-08-31T05:19:36.004 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T05:19:36.004 INFO:journalctl@ceph.mon.a.smithi005.stdout: return self.sslsocket_class._create( 2024-08-31T05:19:36.004 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T05:19:36.005 INFO:journalctl@ceph.mon.a.smithi005.stdout: self.do_handshake() 2024-08-31T05:19:36.005 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T05:19:36.005 INFO:journalctl@ceph.mon.a.smithi005.stdout: self._sslobj.do_handshake() 2024-08-31T05:19:36.005 INFO:journalctl@ceph.mon.a.smithi005.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T05:19:36.005 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:35 smithi005 ceph-mon[18602]: [31/Aug/2024:05:19:34] ENGINE Serving on http://172.21.15.5:8765 2024-08-31T05:19:36.005 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:35 smithi005 ceph-mon[18602]: [31/Aug/2024:05:19:34] ENGINE Bus STARTED 2024-08-31T05:19:36.005 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:35 smithi005 ceph-mon[18602]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:19:36.006 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout value unchanged 2024-08-31T05:19:36.006 INFO:teuthology.orchestra.run.smithi005.stdout:Generating ssh key... 2024-08-31T05:19:37.292 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:37 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: Generating public/private rsa key pair. 2024-08-31T05:19:37.292 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:37 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: Your identification has been saved in /tmp/tmpx6c8k0cp/key 2024-08-31T05:19:37.292 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:37 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: Your public key has been saved in /tmp/tmpx6c8k0cp/key.pub 2024-08-31T05:19:37.293 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:37 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: The key fingerprint is: 2024-08-31T05:19:37.293 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:37 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: SHA256:9vxcnVm/lZOd4hfEdZTvGqn9MgA7fpuubPiY52FhnaE ceph-69422704-6758-11ef-bcd4-c7b262605968 2024-08-31T05:19:37.293 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:37 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: The key's randomart image is: 2024-08-31T05:19:37.293 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:37 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: +---[RSA 3072]----+ 2024-08-31T05:19:37.293 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:37 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: | .o| 2024-08-31T05:19:37.293 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:37 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: | .o| 2024-08-31T05:19:37.293 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:37 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: | . . +| 2024-08-31T05:19:37.293 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:37 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: | .o o o.| 2024-08-31T05:19:37.293 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:37 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: | S Eoo .o.| 2024-08-31T05:19:37.293 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:37 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: | . +o.. oo@| 2024-08-31T05:19:37.293 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:37 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: | o=. =.X*| 2024-08-31T05:19:37.293 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:37 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: | .=+++o*.+| 2024-08-31T05:19:37.293 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:37 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: | o==+*o.=.| 2024-08-31T05:19:37.294 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:37 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: +----[SHA256]-----+ 2024-08-31T05:19:38.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:38 smithi005 ceph-mon[18602]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:19:38.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:38 smithi005 ceph-mon[18602]: Generating ssh key... 2024-08-31T05:19:38.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:38 smithi005 ceph-mon[18602]: from='mgr.14116 172.21.15.5:0/31122668' entity='mgr.x' 2024-08-31T05:19:38.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:38 smithi005 ceph-mon[18602]: from='mgr.14116 172.21.15.5:0/31122668' entity='mgr.x' 2024-08-31T05:19:38.652 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0mssebzhXM+T8qzRXE02o+Nrlr4PYxK/4Sp0s11RbF7JWSXZzbfBN37RyDeWF3a2ROt2QEuHaOHd6Tru8OhYvo3He+bkhYwguFRcneR2wyWnlseoJ9zUMA2712LkblJ81EZ0ls1m1q5dAIzqzoCCnaEg6x8kIAFPdbIkuYJ9L3Vwc5/TptfDBdax5vNSRapZ3Fu4lsrz3rCccdG8RZcbSOObf4VJpT2Cj28fzcdH8QN6z6swfuWLIAq4oCdNgUXLrTwZAIO3la6ZEG2RX0nNNblnXYfipZFxOFKuReTWx6Baz6/WgG6q9Lj1um7i+0dALUwc5giNB9B/lhE8ibc6tXLxNXx97TVN9QWFwRBoY28kFfeLcltIuUbJRklRHajWXc9Uvv0C/qGBlMeKXmcwYWzUoWgZ+joYGoAQc92o8UAOOxxV7QT5/0OvJ3W20oL4JFaiTQISwjfdemBqVFRqezx0g9W/oAvP9lU/Alx2iLXBeqTDr8JnZ1M2WzHLw/NU= ceph-69422704-6758-11ef-bcd4-c7b262605968 2024-08-31T05:19:38.652 INFO:teuthology.orchestra.run.smithi005.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-08-31T05:19:38.652 INFO:teuthology.orchestra.run.smithi005.stdout:Adding key to root@localhost authorized_keys... 2024-08-31T05:19:38.652 INFO:teuthology.orchestra.run.smithi005.stdout:Adding host smithi005... 2024-08-31T05:19:39.216 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:39 smithi005 ceph-mon[18602]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:19:40.216 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:40 smithi005 ceph-mon[18602]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi005", "addr": "172.21.15.5", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:19:41.137 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:41 smithi005 ceph-mon[18602]: Deploying cephadm binary to smithi005 2024-08-31T05:19:43.635 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout Added host 'smithi005' with addr '172.21.15.5' 2024-08-31T05:19:43.635 INFO:teuthology.orchestra.run.smithi005.stdout:Deploying unmanaged mon service... 2024-08-31T05:19:44.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:44 smithi005 ceph-mon[18602]: from='mgr.14116 172.21.15.5:0/31122668' entity='mgr.x' 2024-08-31T05:19:44.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:44 smithi005 ceph-mon[18602]: Added host smithi005 2024-08-31T05:19:44.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:44 smithi005 ceph-mon[18602]: from='mgr.14116 172.21.15.5:0/31122668' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:19:44.986 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-08-31T05:19:44.986 INFO:teuthology.orchestra.run.smithi005.stdout:Deploying unmanaged mgr service... 2024-08-31T05:19:45.562 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:45 smithi005 ceph-mon[18602]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:19:45.563 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:45 smithi005 ceph-mon[18602]: Saving service mon spec with placement count:5 2024-08-31T05:19:45.563 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:45 smithi005 ceph-mon[18602]: from='mgr.14116 172.21.15.5:0/31122668' entity='mgr.x' 2024-08-31T05:19:46.361 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-08-31T05:19:46.895 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:46 smithi005 ceph-mon[18602]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:19:46.895 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:46 smithi005 ceph-mon[18602]: Saving service mgr spec with placement count:2 2024-08-31T05:19:46.895 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:46 smithi005 ceph-mon[18602]: from='mgr.14116 172.21.15.5:0/31122668' entity='mgr.x' 2024-08-31T05:19:48.211 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:47 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/3037466128' entity='client.admin' 2024-08-31T05:19:48.211 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:47 smithi005 ceph-mon[18602]: from='mgr.14116 172.21.15.5:0/31122668' entity='mgr.x' 2024-08-31T05:19:49.695 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:49 smithi005 ceph-mon[18602]: from='mgr.14116 172.21.15.5:0/31122668' entity='mgr.x' 2024-08-31T05:19:49.695 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:49 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/2350715313' entity='client.admin' 2024-08-31T05:19:49.697 INFO:teuthology.orchestra.run.smithi005.stdout:Enabling the dashboard module... 2024-08-31T05:19:50.694 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:50 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/2120979269' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-08-31T05:19:50.695 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:50 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: ignoring --setuser ceph since I am not root 2024-08-31T05:19:50.695 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:50 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: ignoring --setgroup ceph since I am not root 2024-08-31T05:19:51.674 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:51 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/2120979269' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-08-31T05:19:51.674 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:51 smithi005 ceph-mon[18602]: mgrmap e9: x(active, since 18s) 2024-08-31T05:19:52.247 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2024-08-31T05:19:52.247 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-08-31T05:19:52.247 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-31T05:19:52.247 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-08-31T05:19:52.247 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-08-31T05:19:52.247 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2024-08-31T05:19:52.247 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for the mgr to restart... 2024-08-31T05:19:52.247 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for mgr epoch 9... 2024-08-31T05:19:52.564 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:52 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/809541944' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-08-31T05:19:55.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:55 smithi005 ceph-mon[18602]: Active manager daemon x restarted 2024-08-31T05:19:55.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:55 smithi005 ceph-mon[18602]: Activating manager daemon x 2024-08-31T05:19:55.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:55 smithi005 ceph-mon[18602]: osdmap e3: 0 total, 0 up, 0 in 2024-08-31T05:19:55.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:55 smithi005 ceph-mon[18602]: mgrmap e10: x(active, starting, since 0.00372955s) 2024-08-31T05:19:55.968 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:55 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T05:19:55.968 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:55 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-08-31T05:19:55.968 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:55 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-08-31T05:19:55.968 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:55 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-08-31T05:19:55.968 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:55 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-08-31T05:19:55.968 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:55 smithi005 ceph-mon[18602]: Manager daemon x is now available 2024-08-31T05:19:56.966 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:56 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:19:56.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:56 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-08-31T05:19:56.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:56 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-08-31T05:19:56.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:56 smithi005 ceph-mon[18602]: mgrmap e11: x(active, since 1.00666s) 2024-08-31T05:19:57.302 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2024-08-31T05:19:57.303 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-08-31T05:19:57.303 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "initialized": true 2024-08-31T05:19:57.303 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2024-08-31T05:19:57.303 INFO:teuthology.orchestra.run.smithi005.stdout:mgr epoch 9 is available 2024-08-31T05:19:57.303 INFO:teuthology.orchestra.run.smithi005.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-08-31T05:19:57.679 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:57 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: 2024-08-31T05:19:57.636+0000 7f3d7f540640 -1 log_channel(cephadm) log [ERR] : [31/Aug/2024:05:19:57] ENGINE Error in HTTPServer.serve 2024-08-31T05:19:57.679 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:57 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: Traceback (most recent call last): 2024-08-31T05:19:57.679 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:57 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T05:19:57.679 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:57 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: self._connections.run(self.expiration_interval) 2024-08-31T05:19:57.679 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:57 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T05:19:57.680 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:57 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: self._run(expiration_interval) 2024-08-31T05:19:57.680 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:57 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T05:19:57.680 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:57 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T05:19:57.680 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:57 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T05:19:57.680 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:57 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T05:19:57.680 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:57 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T05:19:57.680 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:57 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: s = self.context.wrap_socket( 2024-08-31T05:19:57.680 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:57 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T05:19:57.680 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:57 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: return self.sslsocket_class._create( 2024-08-31T05:19:57.680 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:57 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T05:19:57.680 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:57 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: self.do_handshake() 2024-08-31T05:19:57.680 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:57 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T05:19:57.680 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:57 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: self._sslobj.do_handshake() 2024-08-31T05:19:57.680 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:57 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T05:19:57.681 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:19:57 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: 2024-08-31T05:19:57.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:57 smithi005 ceph-mon[18602]: [31/Aug/2024:05:19:57] ENGINE Bus STARTING 2024-08-31T05:19:58.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:58 smithi005 ceph-mon[18602]: [31/Aug/2024:05:19:57] ENGINE Serving on http://172.21.15.5:8765 2024-08-31T05:19:58.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:58 smithi005 ceph-mon[18602]: [31/Aug/2024:05:19:57] ENGINE Serving on https://172.21.15.5:7150 2024-08-31T05:19:58.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:58 smithi005 ceph-mon[18602]: [31/Aug/2024:05:19:57] ENGINE Bus STARTED 2024-08-31T05:19:58.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:58 smithi005 ceph-mon[18602]: [31/Aug/2024:05:19:57] ENGINE Error in HTTPServer.serve 2024-08-31T05:19:58.967 INFO:journalctl@ceph.mon.a.smithi005.stdout: Traceback (most recent call last): 2024-08-31T05:19:58.967 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T05:19:58.967 INFO:journalctl@ceph.mon.a.smithi005.stdout: self._connections.run(self.expiration_interval) 2024-08-31T05:19:58.967 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T05:19:58.968 INFO:journalctl@ceph.mon.a.smithi005.stdout: self._run(expiration_interval) 2024-08-31T05:19:58.968 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T05:19:58.968 INFO:journalctl@ceph.mon.a.smithi005.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T05:19:58.968 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T05:19:58.968 INFO:journalctl@ceph.mon.a.smithi005.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T05:19:58.968 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T05:19:58.968 INFO:journalctl@ceph.mon.a.smithi005.stdout: s = self.context.wrap_socket( 2024-08-31T05:19:58.968 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T05:19:58.968 INFO:journalctl@ceph.mon.a.smithi005.stdout: return self.sslsocket_class._create( 2024-08-31T05:19:58.968 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T05:19:58.968 INFO:journalctl@ceph.mon.a.smithi005.stdout: self.do_handshake() 2024-08-31T05:19:58.968 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T05:19:58.968 INFO:journalctl@ceph.mon.a.smithi005.stdout: self._sslobj.do_handshake() 2024-08-31T05:19:58.969 INFO:journalctl@ceph.mon.a.smithi005.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T05:19:58.969 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:58 smithi005 ceph-mon[18602]: mgrmap e12: x(active, since 2s) 2024-08-31T05:19:58.969 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:58 smithi005 ceph-mon[18602]: from='client.14160 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:19:58.969 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:58 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:19:59.304 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIE+jCCAuKgAwIBAgIUW3YVM+UXbu+Y5BK/CRc5n7OJci8wDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDgzMTA1MTk1OFoXDTM0\nMDkwMTA1MTk1OFowFjEUMBIGA1UEAwwLMTcyLjIxLjE1LjUwggIiMA0GCSqGSIb3\nDQEBAQUAA4ICDwAwggIKAoICAQCkVfSpE+f5vyXzbrZoLYm7KiOFqHfFswuTC3Xc\ns/vGByE7Qm6RyyK2ndhquw83MZv5cDh3qzOk7azdmKXitL3kXybQ0g48XhvtYrgx\nH1JS/q57ozZeWwkPROW6IcOQfogQnR+DJn3WBg7rvsnuu9pnhCYcYCp4yo1p+xPg\nS/1KfgA+w7vCCVSyT1LfYqep1vv3IDXilCz4dhtMsNbI2Ia/IB3+rEu7SHbjf7pm\n3GdUY1GHqmc9HxddbjB0iRYCVupq9YuBg3X1ZsQEnGO2tqnn1vhS4esd4lSTEel8\nWIfz8Xv7VSCT3XDl6GvQdMjVllYHa5OfCsmsiduRiugSOSjw5IvExf7U1L12u6At\nE/m7N3DSmE2UeQVE9cXDKqGHHDKitU2pLFzwy2bFyvGT7gcs1h8D7p/w9VydXGJD\nQng8Slmhh8ObEP3HTMYLnBV1D8NhbNE/iTe/RgsohH2laGqVzAXQy3pEgBE6Hb6L\n9gVmpjBW6Lwod30iACXCHZH6fvtjad0mEvRwJXpsm3rpcxhs6xHXF9RtOUuVljUI\nbW4I2WJYL4VHsXDhBcB4SoeSGEcQgXB+DBx8KeeBYOSm5aX5iM0Dy3NuNrWpyx6+\nyUJvsv2wvA4glKiUSZ88ncjWH3dzBCBVzI9jv+rcaLBoaWy+5V5CLK2b09wleMdY\n1t548QIDAQABoz8wPTAtBgNVHREEJjAkgglzbWl0aGkwMDWCEWRhc2hib2FyZF9z\nZXJ2ZXJzhwSsFQ8FMAwGA1UdEwEB/wQCMAAwDQYJKoZIhvcNAQELBQADggIBABKg\nxg423PNz5Torf9PtioWmWEYWQkkGdlgK0spwh2QqxdDPpBesSn193H5M11UseL/P\nIitYPmcxM9dIbJUFEAYVQQ5DKRm1437KoJ3r2Ymw5FgjYCUj5hAQNHWm/n0LWMCj\nsPEXbxDLVuq6el0qs/x5fLvTsy7RHc4K8qn6B4bNUt+W5F0giRUuqQTGAuJmpo3E\naJKDSOU99Aauj3s4dnodyLMHfF/1X/QGycPeWNZUgEucYzuc4LiRN2LKZS4v4GNg\nn8Nj7in6Mw3+qU1aBhRemHL+vZ/fS9l7YgNP4Srt2XN/FSblAQz9dHbGkHVL0bj0\nLKrQw0kfxGdl5ofVOwjMW/JGt021t+4Z77yvzn3oyNzF4pGrUKb7dLUuAzzQWGPH\nCeNgG38SYxP1O0pdgvfVt9qXCK4RWe79Mtv4XNnCXam2A0SvXTrjonDvB2eMkPeR\nIjEdQ0mXxW/cJECuKNCcPVo6aAktRv4sNTGbGMjb5vF6n8lfgB98MBz0uR0dPG0v\n1N+q33L6t3zgRdMP6s8sSUaIYkeFadKfeZR8y3qYec3ydQtNfzNWKyjpEEznP177\nYDrp2egavCD5oIgde4Vp0EEJmwPI8DXX7gwg2mipk75LeY1opIUASyW770TNG6HM\n4shnk0VUdTmWUbPvNxs+Eo9fNu9VvjxLP7e2aJj0\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJJwIBAAKCAgEApFX0qRPn+b8l8262aC2Juyojhah3xbMLkwt13LP7xgchO0Ju\nkcsitp3YarsPNzGb+XA4d6szpO2s3Zil4rS95F8m0NIOPF4b7WK4MR9SUv6ue6M2\nXlsJD0TluiHDkH6IEJ0fgyZ91gYO677J7rvaZ4QmHGAqeMqNafsT4Ev9Sn4APsO7\nwglUsk9S32Knqdb79yA14pQs+HYbTLDWyNiGvyAd/qxLu0h243+6ZtxnVGNRh6pn\nPR8XXW4wdIkWAlbqavWLgYN19WbEBJxjtrap59b4UuHrHeJUkxHpfFiH8/F7+1Ug\nk91w5ehr0HTI1ZZWB2uTnwrJrInbkYroEjko8OSLxMX+1NS9drugLRP5uzdw0phN\nlHkFRPXFwyqhhxwyorVNqSxc8Mtmxcrxk+4HLNYfA+6f8PVcnVxiQ0J4PEpZoYfD\nmxD9x0zGC5wVdQ/DYWzRP4k3v0YLKIR9pWhqlcwF0Mt6RIAROh2+i/YFZqYwVui8\nKHd9IgAlwh2R+n77Y2ndJhL0cCV6bJt66XMYbOsR1xfUbTlLlZY1CG1uCNliWC+F\nR7Fw4QXAeEqHkhhHEIFwfgwcfCnngWDkpuWl+YjNA8tzbja1qcsevslCb7L9sLwO\nIJSolEmfPJ3I1h93cwQgVcyPY7/q3GiwaGlsvuVeQiytm9PcJXjHWNbeePECAwEA\nAQKCAgAJdnig3shSEX9wMc0XmR2v9Rh4CxAghnORa0zFYWjLSaBQfv4Kb6HHVbX/\nSVeyNC1Y0u0xeN5/rf7xAKf2srUniBIeXqYatEmT5QYZsAXHySoHbQnFq6TNKAi5\na9XMxXh0ynNk1CvVTeKAkSskD9We9dVS93einnk/o8lMdlu2tSQy+QbgALULknVB\nbzcb2MkH/ScVLbacNQLT6u/nP06dBU6s2kN/HIhaB8IWR7U8fv6UGwwYUSjBhMWO\nBFHL3zDe6VY35je94oXBhTbZr9F/S9nfPeqRvTVlBZhGBHwJoDtlKMz4Lr1gQ76n\nkX36DI7WHQvyUcb0pDiMPC0qVXfFtYYiCFFOwheD7zUtf3B8/hSVc5rsgdMxejnn\nOTJ/24+ltoJP6nmzMLoSDyuPLa+t/h2AnsziiuGeVq1aG03UkF8IiTU3QFojWN39\n3OK5F12Q4saLOqFKcbOXXYs0Q+UgPBqvQgMfdL1mxlWXQORhiUNV5Mc9vcm+DFDH\nKxO1dJcOln7ncnaduDIjT4K10ODuvwgsmw3vuyL/B2WMMVMEsmyDZFnaNmI+Q58b\nKsajNGcbOFxDn09/CNoQrz5HY8QKiK3A3B20dT7kYgFVEiRaoVXSKAlhIwwrndBy\nq3oaW2vREFoEtVOuFtZbx3ai76ui+DTmFNAvUlnr53sDX+snBQKCAQEA5BHsZyX7\nQLUCj/8EayKnBPkxN1k4UrGlSgRBcac7ReU7H/+QEHxZIbhu6KahQ7JhsY/sSzJ5\nGv4jMyaAV3C2ZIlJJNfxG4yPx2eh0RMtFKCE8jf/pXbQmadh00Ve7WNSfyfJk2qS\nrxSy+WkpAhjrkeLHxMexOncHCE5DsmEpZRgd/tEH3fzAZ+PF0TRRyVgKPTDSyVU8\nf5XNSSJrH3xEcsbCrUCEaGxkp6gJJPnRn9FBfoe5WI91F4RsoeX2supv9fKa8hGL\nfTePwvTMgiJ9Rdffg/iqYjuJ2qReDTUB7pn7ThF9qvsjqp7as+NwLAn7WII2MeyZ\n8YkI6tW0hDmDFQKCAQEAuHXw1D/5WYn4SO1x0FbWbUbezy5jDV2xpzgJ1KyNIEuW\nnhrv5TWzH/RCjOls7MmHZ4xhPOztezd5EpR0vgYXKDPnA61gFGIpFpoTyLJWOISd\nQ/pF7qyPKMzrQ6Qu3dckAwPj/4tQEo+DRrO97GbUaTFYY2PwCYUKH6gtuC1WhCus\n1Qa6lIutcmabAqWcJrlwzwXTdyUzvT05i5inhcs7/AWBz7jPjDaOdI7tBrwrryqn\nYTzagYNWYjUedbMO0+sFG19mxaMse9bBh0r1/l/qcVKxKKYCufGIRbJeoRPH4Hdo\nZwoKbQV+NCqSctoRrMCXBp53FG3dKjLNxLYBiRlFbQKCAQAyfdlVeK4oRCqeEHo8\n8b4CNtzzgPgcLqIGQezvKXPQ5I/zZJPTYoQlF/zN2t4G673/HnrUpwbyt+K5F0QA\nl755gX9E/d2uGK9YGRRVAibP0z27ljQtwKEr80eQC2KZsYx5BCj3TvfMdQuudd6T\nTUsR0CAj64XMCL/w0crg+eu9KtqxKDvSpHtARMftqeSVa71QkLeJxSoQoOyCzXDj\n1pIcyu4chxUJPT4HdAcaPYhwFlammYuqFJB6tWGLcirsr0Q8Mgqlnsa/4QYdxi5k\nfRg41zLvt6SY/M9nLU55JAwac9KUFQE6UkEyK9sFSkvyI/+WN7Wh1dy7AXiM7OT7\nBPSFAoIBADqoBnT4AuqeHP3Tw6Vkd7s4FhH7xjOx35Q1FaszU405fCO6nR5d/R/k\nJGV6tNB3JT+gPCuLi9jqwu1Nl/H1Ldfy6TsaHrtcm4Q8ap4fV5uRUBEVvLcw2DU5\nNHbF9sFEcIck7ZONUWEVkcEh1vsdl937ewff96yPSbDXYfJ3OFO/L65t/VbPM9B1\nIEWvNAB8Z4rtZ1kz00gR+AKUAHFjNyfk+Gp9ckI79wDJkkXaAGorPh6Fo1Yb1ZRV\nH+J9lfF9gpo5tAyU3shiehfzllXVWk++4+bxI1zNmW/QUJcYGy8dyW06nCYe4Qrl\nnrw26/frJhtMuMEeTn3kudobplFaX+ECggEAC8TaoHVebCPSuxou3HvF/YbWszRQ\n6RprcOTMtqnekHJSB6L0NjGc11yTYfBSlONLjRPIDcCIRKOF4W52zT36VjGKva9d\n6wtvffgVf4kmiZLvh9hnYfx/Kg4PjBWvA7efPLULgnspqS7qL++A/BeLcAkI1A1R\nDT8fnG37g9/Lfo4uIyayvYWh+2AgoYCBKA+WsTMGqwp8GD2SY0YO00VVCwWIlZre\nEfxZSHHeEtfLWoOnbg7R//TG7UpxV2Dopki7vops3oBMtkgWWH2yXZBctOozfpnF\nbxY2QBt7177aokgiO3CxXSJSbjhQgU8S/bTjcHLo5epWDqtl5xCWFUG6hw==\n-----END RSA PRIVATE KEY-----\n"} 2024-08-31T05:20:00.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:59 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:00.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:19:59 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:01.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:00 smithi005 ceph-mon[18602]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:01.385 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-08-31T05:20:02.532 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-08-31T05:20:02.532 INFO:teuthology.orchestra.run.smithi005.stdout:Creating initial admin user... 2024-08-31T05:20:03.215 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:03 smithi005 ceph-mon[18602]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:03.215 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:03 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:03.934 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$Vy8zoWJaR4XgnvrziyPm4.CyI5cWukebsRm9U.LoR2U.6C4upb9Xq", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1725081603, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-08-31T05:20:03.934 INFO:teuthology.orchestra.run.smithi005.stdout:Fetching dashboard port number... 2024-08-31T05:20:04.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:04 smithi005 ceph-mon[18602]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:04.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:04 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:05.072 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 8443 2024-08-31T05:20:05.083 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-31T05:20:05.083 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout disabled 2024-08-31T05:20:05.091 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-31T05:20:05.091 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout inactive 2024-08-31T05:20:05.091 INFO:teuthology.orchestra.run.smithi005.stdout:firewalld.service is not enabled 2024-08-31T05:20:05.092 INFO:teuthology.orchestra.run.smithi005.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-08-31T05:20:05.093 INFO:teuthology.orchestra.run.smithi005.stdout:Ceph Dashboard is now available at: 2024-08-31T05:20:05.093 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:20:05.093 INFO:teuthology.orchestra.run.smithi005.stdout: URL: https://smithi005:8443/ 2024-08-31T05:20:05.093 INFO:teuthology.orchestra.run.smithi005.stdout: User: admin 2024-08-31T05:20:05.093 INFO:teuthology.orchestra.run.smithi005.stdout: Password: v2g32p63aw 2024-08-31T05:20:05.093 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:20:05.094 INFO:teuthology.orchestra.run.smithi005.stdout:Saving cluster configuration to /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/config directory 2024-08-31T05:20:05.716 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:05 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/1592721910' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-08-31T05:20:06.345 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-08-31T05:20:06.345 INFO:teuthology.orchestra.run.smithi005.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-08-31T05:20:06.346 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:20:06.346 INFO:teuthology.orchestra.run.smithi005.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-08-31T05:20:06.346 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:20:06.346 INFO:teuthology.orchestra.run.smithi005.stdout:Or, if you are only running a single cluster on this host: 2024-08-31T05:20:06.346 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:20:06.346 INFO:teuthology.orchestra.run.smithi005.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-08-31T05:20:06.346 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:20:06.346 INFO:teuthology.orchestra.run.smithi005.stdout:Please consider enabling telemetry to help improve Ceph: 2024-08-31T05:20:06.346 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:20:06.346 INFO:teuthology.orchestra.run.smithi005.stdout: ceph telemetry on 2024-08-31T05:20:06.346 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:20:06.346 INFO:teuthology.orchestra.run.smithi005.stdout:For more information see: 2024-08-31T05:20:06.346 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:20:06.346 INFO:teuthology.orchestra.run.smithi005.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-08-31T05:20:06.346 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:20:06.347 INFO:teuthology.orchestra.run.smithi005.stdout:Bootstrap complete. 2024-08-31T05:20:06.385 INFO:tasks.cephadm:Fetching config... 2024-08-31T05:20:06.385 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-31T05:20:06.386 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-08-31T05:20:06.401 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-08-31T05:20:06.402 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-31T05:20:06.402 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-08-31T05:20:06.456 INFO:tasks.cephadm:Fetching mon keyring... 2024-08-31T05:20:06.457 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-31T05:20:06.457 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/keyring of=/dev/stdout 2024-08-31T05:20:06.521 INFO:tasks.cephadm:Fetching pub ssh key... 2024-08-31T05:20:06.521 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-31T05:20:06.521 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-08-31T05:20:06.578 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-08-31T05:20:06.578 DEBUG:teuthology.orchestra.run.smithi005:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0mssebzhXM+T8qzRXE02o+Nrlr4PYxK/4Sp0s11RbF7JWSXZzbfBN37RyDeWF3a2ROt2QEuHaOHd6Tru8OhYvo3He+bkhYwguFRcneR2wyWnlseoJ9zUMA2712LkblJ81EZ0ls1m1q5dAIzqzoCCnaEg6x8kIAFPdbIkuYJ9L3Vwc5/TptfDBdax5vNSRapZ3Fu4lsrz3rCccdG8RZcbSOObf4VJpT2Cj28fzcdH8QN6z6swfuWLIAq4oCdNgUXLrTwZAIO3la6ZEG2RX0nNNblnXYfipZFxOFKuReTWx6Baz6/WgG6q9Lj1um7i+0dALUwc5giNB9B/lhE8ibc6tXLxNXx97TVN9QWFwRBoY28kFfeLcltIuUbJRklRHajWXc9Uvv0C/qGBlMeKXmcwYWzUoWgZ+joYGoAQc92o8UAOOxxV7QT5/0OvJ3W20oL4JFaiTQISwjfdemBqVFRqezx0g9W/oAvP9lU/Alx2iLXBeqTDr8JnZ1M2WzHLw/NU= ceph-69422704-6758-11ef-bcd4-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-31T05:20:06.653 INFO:teuthology.orchestra.run.smithi005.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0mssebzhXM+T8qzRXE02o+Nrlr4PYxK/4Sp0s11RbF7JWSXZzbfBN37RyDeWF3a2ROt2QEuHaOHd6Tru8OhYvo3He+bkhYwguFRcneR2wyWnlseoJ9zUMA2712LkblJ81EZ0ls1m1q5dAIzqzoCCnaEg6x8kIAFPdbIkuYJ9L3Vwc5/TptfDBdax5vNSRapZ3Fu4lsrz3rCccdG8RZcbSOObf4VJpT2Cj28fzcdH8QN6z6swfuWLIAq4oCdNgUXLrTwZAIO3la6ZEG2RX0nNNblnXYfipZFxOFKuReTWx6Baz6/WgG6q9Lj1um7i+0dALUwc5giNB9B/lhE8ibc6tXLxNXx97TVN9QWFwRBoY28kFfeLcltIuUbJRklRHajWXc9Uvv0C/qGBlMeKXmcwYWzUoWgZ+joYGoAQc92o8UAOOxxV7QT5/0OvJ3W20oL4JFaiTQISwjfdemBqVFRqezx0g9W/oAvP9lU/Alx2iLXBeqTDr8JnZ1M2WzHLw/NU= ceph-69422704-6758-11ef-bcd4-c7b262605968 2024-08-31T05:20:06.666 DEBUG:teuthology.orchestra.run.smithi050:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0mssebzhXM+T8qzRXE02o+Nrlr4PYxK/4Sp0s11RbF7JWSXZzbfBN37RyDeWF3a2ROt2QEuHaOHd6Tru8OhYvo3He+bkhYwguFRcneR2wyWnlseoJ9zUMA2712LkblJ81EZ0ls1m1q5dAIzqzoCCnaEg6x8kIAFPdbIkuYJ9L3Vwc5/TptfDBdax5vNSRapZ3Fu4lsrz3rCccdG8RZcbSOObf4VJpT2Cj28fzcdH8QN6z6swfuWLIAq4oCdNgUXLrTwZAIO3la6ZEG2RX0nNNblnXYfipZFxOFKuReTWx6Baz6/WgG6q9Lj1um7i+0dALUwc5giNB9B/lhE8ibc6tXLxNXx97TVN9QWFwRBoY28kFfeLcltIuUbJRklRHajWXc9Uvv0C/qGBlMeKXmcwYWzUoWgZ+joYGoAQc92o8UAOOxxV7QT5/0OvJ3W20oL4JFaiTQISwjfdemBqVFRqezx0g9W/oAvP9lU/Alx2iLXBeqTDr8JnZ1M2WzHLw/NU= ceph-69422704-6758-11ef-bcd4-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-31T05:20:06.710 INFO:teuthology.orchestra.run.smithi050.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0mssebzhXM+T8qzRXE02o+Nrlr4PYxK/4Sp0s11RbF7JWSXZzbfBN37RyDeWF3a2ROt2QEuHaOHd6Tru8OhYvo3He+bkhYwguFRcneR2wyWnlseoJ9zUMA2712LkblJ81EZ0ls1m1q5dAIzqzoCCnaEg6x8kIAFPdbIkuYJ9L3Vwc5/TptfDBdax5vNSRapZ3Fu4lsrz3rCccdG8RZcbSOObf4VJpT2Cj28fzcdH8QN6z6swfuWLIAq4oCdNgUXLrTwZAIO3la6ZEG2RX0nNNblnXYfipZFxOFKuReTWx6Baz6/WgG6q9Lj1um7i+0dALUwc5giNB9B/lhE8ibc6tXLxNXx97TVN9QWFwRBoY28kFfeLcltIuUbJRklRHajWXc9Uvv0C/qGBlMeKXmcwYWzUoWgZ+joYGoAQc92o8UAOOxxV7QT5/0OvJ3W20oL4JFaiTQISwjfdemBqVFRqezx0g9W/oAvP9lU/Alx2iLXBeqTDr8JnZ1M2WzHLw/NU= ceph-69422704-6758-11ef-bcd4-c7b262605968 2024-08-31T05:20:06.723 DEBUG:teuthology.orchestra.run.smithi070:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0mssebzhXM+T8qzRXE02o+Nrlr4PYxK/4Sp0s11RbF7JWSXZzbfBN37RyDeWF3a2ROt2QEuHaOHd6Tru8OhYvo3He+bkhYwguFRcneR2wyWnlseoJ9zUMA2712LkblJ81EZ0ls1m1q5dAIzqzoCCnaEg6x8kIAFPdbIkuYJ9L3Vwc5/TptfDBdax5vNSRapZ3Fu4lsrz3rCccdG8RZcbSOObf4VJpT2Cj28fzcdH8QN6z6swfuWLIAq4oCdNgUXLrTwZAIO3la6ZEG2RX0nNNblnXYfipZFxOFKuReTWx6Baz6/WgG6q9Lj1um7i+0dALUwc5giNB9B/lhE8ibc6tXLxNXx97TVN9QWFwRBoY28kFfeLcltIuUbJRklRHajWXc9Uvv0C/qGBlMeKXmcwYWzUoWgZ+joYGoAQc92o8UAOOxxV7QT5/0OvJ3W20oL4JFaiTQISwjfdemBqVFRqezx0g9W/oAvP9lU/Alx2iLXBeqTDr8JnZ1M2WzHLw/NU= ceph-69422704-6758-11ef-bcd4-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-31T05:20:06.767 INFO:teuthology.orchestra.run.smithi070.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0mssebzhXM+T8qzRXE02o+Nrlr4PYxK/4Sp0s11RbF7JWSXZzbfBN37RyDeWF3a2ROt2QEuHaOHd6Tru8OhYvo3He+bkhYwguFRcneR2wyWnlseoJ9zUMA2712LkblJ81EZ0ls1m1q5dAIzqzoCCnaEg6x8kIAFPdbIkuYJ9L3Vwc5/TptfDBdax5vNSRapZ3Fu4lsrz3rCccdG8RZcbSOObf4VJpT2Cj28fzcdH8QN6z6swfuWLIAq4oCdNgUXLrTwZAIO3la6ZEG2RX0nNNblnXYfipZFxOFKuReTWx6Baz6/WgG6q9Lj1um7i+0dALUwc5giNB9B/lhE8ibc6tXLxNXx97TVN9QWFwRBoY28kFfeLcltIuUbJRklRHajWXc9Uvv0C/qGBlMeKXmcwYWzUoWgZ+joYGoAQc92o8UAOOxxV7QT5/0OvJ3W20oL4JFaiTQISwjfdemBqVFRqezx0g9W/oAvP9lU/Alx2iLXBeqTDr8JnZ1M2WzHLw/NU= ceph-69422704-6758-11ef-bcd4-c7b262605968 2024-08-31T05:20:06.781 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-08-31T05:20:06.905 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:06 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/1621056623' entity='client.admin' 2024-08-31T05:20:07.029 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:20:08.643 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-08-31T05:20:08.644 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-08-31T05:20:08.895 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:20:08.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:08 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/3720333336' entity='client.admin' 2024-08-31T05:20:08.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:08 smithi005 ceph-mon[18602]: mgrmap e13: x(active, since 12s) 2024-08-31T05:20:08.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:08 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:08.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:08 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:08.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:08 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi005", "name": "osd_memory_target"} : dispatch 2024-08-31T05:20:08.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:08 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:08.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:08 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:20:08.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:08 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:10.240 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi050 2024-08-31T05:20:10.240 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-08-31T05:20:10.240 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/etc/ceph/ceph.conf 2024-08-31T05:20:10.259 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-08-31T05:20:10.260 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-31T05:20:10.318 INFO:tasks.cephadm:Adding host smithi050 to orchestrator... 2024-08-31T05:20:10.318 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph orch host add smithi050 2024-08-31T05:20:10.568 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:20:10.796 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:10 smithi005 ceph-mon[18602]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:10.796 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:10 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:10.796 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:10 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:20:10.796 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:10 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:20:10.796 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:10 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:20:10.796 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:10 smithi005 ceph-mon[18602]: Updating smithi005:/etc/ceph/ceph.conf 2024-08-31T05:20:10.796 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:10 smithi005 ceph-mon[18602]: Updating smithi005:/var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:20:10.797 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:10 smithi005 ceph-mon[18602]: Updating smithi005:/etc/ceph/ceph.client.admin.keyring 2024-08-31T05:20:10.797 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:10 smithi005 ceph-mon[18602]: Updating smithi005:/var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T05:20:10.797 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:10 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:10.797 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:10 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:10.797 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:10 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:11.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:11 smithi005 ceph-mon[18602]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi050", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:12.966 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:12 smithi005 ceph-mon[18602]: Deploying cephadm binary to smithi050 2024-08-31T05:20:15.134 INFO:teuthology.orchestra.run.smithi005.stdout:Added host 'smithi050' with addr '172.21.15.50' 2024-08-31T05:20:15.785 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph orch host ls --format=json 2024-08-31T05:20:16.028 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:20:16.411 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:16 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:16.411 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:16 smithi005 ceph-mon[18602]: Added host smithi050 2024-08-31T05:20:16.411 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:16 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:20:16.411 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:16 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:16.411 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:16 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:16.618 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:20:16.618 INFO:teuthology.orchestra.run.smithi005.stdout:[{"addr": "172.21.15.5", "hostname": "smithi005", "labels": [], "status": ""}, {"addr": "172.21.15.50", "hostname": "smithi050", "labels": [], "status": ""}] 2024-08-31T05:20:17.192 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi070 2024-08-31T05:20:17.192 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-08-31T05:20:17.192 DEBUG:teuthology.orchestra.run.smithi070:> dd of=/etc/ceph/ceph.conf 2024-08-31T05:20:17.212 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-08-31T05:20:17.212 DEBUG:teuthology.orchestra.run.smithi070:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-31T05:20:17.270 INFO:tasks.cephadm:Adding host smithi070 to orchestrator... 2024-08-31T05:20:17.270 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph orch host add smithi070 2024-08-31T05:20:17.514 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:20:17.741 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:17 smithi005 ceph-mon[18602]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:20:17.741 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:17 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:18.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:18 smithi005 ceph-mon[18602]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T05:20:19.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:19 smithi005 ceph-mon[18602]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:20:19.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:19 smithi005 ceph-mon[18602]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi070", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:19.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:19 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:19.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:19 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:19.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:19 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:19.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:19 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:19.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:19 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi050", "name": "osd_memory_target"} : dispatch 2024-08-31T05:20:19.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:19 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:20:19.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:19 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:20:20.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:20 smithi005 ceph-mon[18602]: Updating smithi050:/etc/ceph/ceph.conf 2024-08-31T05:20:20.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:20 smithi005 ceph-mon[18602]: Deploying cephadm binary to smithi070 2024-08-31T05:20:20.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:20 smithi005 ceph-mon[18602]: Updating smithi050:/var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:20:20.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:20 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:20.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:20 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:20.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:20 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:21.868 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:21 smithi005 ceph-mon[18602]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:20:21.868 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:21 smithi005 ceph-mon[18602]: Updating smithi050:/etc/ceph/ceph.client.admin.keyring 2024-08-31T05:20:21.868 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:21 smithi005 ceph-mon[18602]: Updating smithi050:/var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T05:20:22.021 INFO:teuthology.orchestra.run.smithi005.stdout:Added host 'smithi070' with addr '172.21.15.70' 2024-08-31T05:20:22.699 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph orch host ls --format=json 2024-08-31T05:20:22.949 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:20:23.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:23 smithi005 ceph-mon[18602]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:20:23.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:23 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:23.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:23 smithi005 ceph-mon[18602]: Added host smithi070 2024-08-31T05:20:23.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:23 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:20:23.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:23 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:23.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:23 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:23.551 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:20:23.551 INFO:teuthology.orchestra.run.smithi005.stdout:[{"addr": "172.21.15.5", "hostname": "smithi005", "labels": [], "status": ""}, {"addr": "172.21.15.50", "hostname": "smithi050", "labels": [], "status": ""}, {"addr": "172.21.15.70", "hostname": "smithi070", "labels": [], "status": ""}] 2024-08-31T05:20:24.123 INFO:tasks.cephadm:Setting crush tunables to default 2024-08-31T05:20:24.123 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph osd crush tunables default 2024-08-31T05:20:24.370 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:20:24.636 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:24 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:25.386 INFO:teuthology.orchestra.run.smithi005.stderr:adjusted tunables profile to default 2024-08-31T05:20:25.691 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:25 smithi005 ceph-mon[18602]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T05:20:25.691 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:25 smithi005 ceph-mon[18602]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:20:25.691 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:25 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/4091766560' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-08-31T05:20:25.990 INFO:tasks.cephadm:Adding mon.a on smithi005 2024-08-31T05:20:25.990 INFO:tasks.cephadm:Adding mon.b on smithi050 2024-08-31T05:20:25.990 INFO:tasks.cephadm:Adding mon.c on smithi070 2024-08-31T05:20:25.991 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph orch apply mon '3;smithi005:172.21.15.5=a;smithi050:172.21.15.50=b;smithi070:172.21.15.70=c' 2024-08-31T05:20:26.236 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-31T05:20:26.280 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-31T05:20:26.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:26 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/4091766560' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-08-31T05:20:26.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:26 smithi005 ceph-mon[18602]: osdmap e4: 0 total, 0 up, 0 in 2024-08-31T05:20:26.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:26 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:26.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:26 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:26.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:26 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:26.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:26 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:26.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:26 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi070", "name": "osd_memory_target"} : dispatch 2024-08-31T05:20:26.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:26 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:20:26.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:26 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:20:26.996 INFO:teuthology.orchestra.run.smithi070.stdout:Scheduled mon update... 2024-08-31T05:20:27.622 DEBUG:teuthology.orchestra.run.smithi050:mon.b> sudo journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@mon.b.service 2024-08-31T05:20:27.624 DEBUG:teuthology.orchestra.run.smithi070:mon.c> sudo journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@mon.c.service 2024-08-31T05:20:27.627 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-31T05:20:27.627 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-31T05:20:27.703 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:27 smithi005 ceph-mon[18602]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:20:27.703 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:27 smithi005 ceph-mon[18602]: Updating smithi070:/etc/ceph/ceph.conf 2024-08-31T05:20:27.704 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:27 smithi005 ceph-mon[18602]: Updating smithi070:/var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:20:27.704 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:27 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:27.704 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:27 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:27.704 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:27 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:27.704 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:27 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:27.704 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:27 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:27.704 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:27 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:27.704 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:27 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:27.705 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:27 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:27.705 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:27 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T05:20:27.705 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:27 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T05:20:27.705 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:27 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:20:27.892 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:20:28.579 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-08-31T05:20:28.579 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":1,"fsid":"69422704-6758-11ef-bcd4-c7b262605968","modified":"2024-08-31T05:19:01.939099Z","created":"2024-08-31T05:19:01.939099Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-31T05:20:28.579 INFO:teuthology.orchestra.run.smithi070.stderr:dumped monmap epoch 1 2024-08-31T05:20:28.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:28 smithi005 ceph-mon[18602]: Updating smithi070:/etc/ceph/ceph.client.admin.keyring 2024-08-31T05:20:28.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:28 smithi005 ceph-mon[18602]: Updating smithi070:/var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T05:20:28.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:28 smithi005 ceph-mon[18602]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi005:172.21.15.5=a;smithi050:172.21.15.50=b;smithi070:172.21.15.70=c", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:28.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:28 smithi005 ceph-mon[18602]: Saving service mon spec with placement smithi005:172.21.15.5=a;smithi050:172.21.15.50=b;smithi070:172.21.15.70=c;count:3 2024-08-31T05:20:28.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:28 smithi005 ceph-mon[18602]: Reconfiguring mon.a (unknown last config time)... 2024-08-31T05:20:28.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:28 smithi005 ceph-mon[18602]: Reconfiguring daemon mon.a on smithi005 2024-08-31T05:20:29.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:29 smithi005 ceph-mon[18602]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:20:29.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:29 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:29.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:29 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:29.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:29 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:20:29.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:29 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:20:29.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:29 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:20:29.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:29 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:29.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:29 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T05:20:29.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:29 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:20:29.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:29 smithi005 ceph-mon[18602]: Deploying daemon mon.c on smithi070 2024-08-31T05:20:29.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:29 smithi005 ceph-mon[18602]: from='client.? 172.21.15.70:0/1289523191' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T05:20:30.195 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-31T05:20:30.397 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-31T05:20:31.103 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T05:20:31.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:31 smithi005 ceph-mon[18602]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:20:32.017 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-08-31T05:20:32.017 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":1,"fsid":"69422704-6758-11ef-bcd4-c7b262605968","modified":"2024-08-31T05:19:01.939099Z","created":"2024-08-31T05:19:01.939099Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-31T05:20:32.017 INFO:teuthology.orchestra.run.smithi070.stderr:dumped monmap epoch 1 2024-08-31T05:20:32.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:32 smithi070 systemd[1]: Starting Ceph mon.c for 69422704-6758-11ef-bcd4-c7b262605968... 2024-08-31T05:20:32.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:32 smithi005 ceph-mon[18602]: from='client.? 172.21.15.70:0/3452974775' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T05:20:32.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:32 smithi070 podman[22294]: 2024-08-31 05:20:32.407000074 +0000 UTC m=+0.020153844 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T05:20:33.231 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 podman[22294]: 2024-08-31 05:20:33.019216744 +0000 UTC m=+0.632370505 container create d0d29cc757a21e855c7ef9ce469c8d96fb9b3b842de6751c5ef2e7d96d426efe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mon-c, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T05:20:33.231 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 podman[22294]: 2024-08-31 05:20:33.229819349 +0000 UTC m=+0.842973114 container init d0d29cc757a21e855c7ef9ce469c8d96fb9b3b842de6751c5ef2e7d96d426efe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mon-c, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.1, GIT_BRANCH=HEAD) 2024-08-31T05:20:33.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 podman[22294]: 2024-08-31 05:20:33.233810548 +0000 UTC m=+0.846964301 container start d0d29cc757a21e855c7ef9ce469c8d96fb9b3b842de6751c5ef2e7d96d426efe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mon-c, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1) 2024-08-31T05:20:33.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: set uid:gid to 167:167 (ceph:ceph) 2024-08-31T05:20:33.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev), process ceph-mon, pid 2 2024-08-31T05:20:33.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: pidfile_write: ignore empty --pid-file 2024-08-31T05:20:33.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: load: jerasure load: lrc 2024-08-31T05:20:33.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: RocksDB version: 7.9.2 2024-08-31T05:20:33.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Git sha 0 2024-08-31T05:20:33.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Compile date 2024-08-28 10:19:06 2024-08-31T05:20:33.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: DB SUMMARY 2024-08-31T05:20:33.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: DB Session ID: LV0FF7U0CI85OSKSFWE7 2024-08-31T05:20:33.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: CURRENT file: CURRENT 2024-08-31T05:20:33.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: IDENTITY file: IDENTITY 2024-08-31T05:20:33.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-08-31T05:20:33.588 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-08-31T05:20:33.588 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-08-31T05:20:33.588 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.error_if_exists: 0 2024-08-31T05:20:33.588 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.create_if_missing: 0 2024-08-31T05:20:33.588 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.paranoid_checks: 1 2024-08-31T05:20:33.588 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.flush_verify_memtable_count: 1 2024-08-31T05:20:33.588 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-08-31T05:20:33.588 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-08-31T05:20:33.588 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.env: 0x55d275e3d5a0 2024-08-31T05:20:33.588 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.fs: PosixFileSystem 2024-08-31T05:20:33.588 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.info_log: 0x55d27bb954e0 2024-08-31T05:20:33.588 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.max_file_opening_threads: 16 2024-08-31T05:20:33.589 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.statistics: (nil) 2024-08-31T05:20:33.589 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.use_fsync: 0 2024-08-31T05:20:33.589 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.max_log_file_size: 0 2024-08-31T05:20:33.589 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-08-31T05:20:33.589 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.log_file_time_to_roll: 0 2024-08-31T05:20:33.589 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.keep_log_file_num: 1000 2024-08-31T05:20:33.589 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.recycle_log_file_num: 0 2024-08-31T05:20:33.589 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.allow_fallocate: 1 2024-08-31T05:20:33.589 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.allow_mmap_reads: 0 2024-08-31T05:20:33.589 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.allow_mmap_writes: 0 2024-08-31T05:20:33.589 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.use_direct_reads: 0 2024-08-31T05:20:33.589 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-08-31T05:20:33.589 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.create_missing_column_families: 0 2024-08-31T05:20:33.589 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.db_log_dir: 2024-08-31T05:20:33.590 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.wal_dir: 2024-08-31T05:20:33.590 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.table_cache_numshardbits: 6 2024-08-31T05:20:33.590 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.WAL_ttl_seconds: 0 2024-08-31T05:20:33.590 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.WAL_size_limit_MB: 0 2024-08-31T05:20:33.590 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-08-31T05:20:33.590 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-08-31T05:20:33.590 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.is_fd_close_on_exec: 1 2024-08-31T05:20:33.590 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.advise_random_on_open: 1 2024-08-31T05:20:33.590 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.db_write_buffer_size: 0 2024-08-31T05:20:33.590 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.write_buffer_manager: 0x55d27bb995e0 2024-08-31T05:20:33.590 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-08-31T05:20:33.590 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-08-31T05:20:33.590 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.use_adaptive_mutex: 0 2024-08-31T05:20:33.590 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.rate_limiter: (nil) 2024-08-31T05:20:33.591 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-08-31T05:20:33.591 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.wal_recovery_mode: 2 2024-08-31T05:20:33.591 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.enable_thread_tracking: 0 2024-08-31T05:20:33.591 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.enable_pipelined_write: 0 2024-08-31T05:20:33.591 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.unordered_write: 0 2024-08-31T05:20:33.591 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-08-31T05:20:33.591 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-08-31T05:20:33.591 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-08-31T05:20:33.591 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-08-31T05:20:33.591 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.row_cache: None 2024-08-31T05:20:33.591 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.wal_filter: None 2024-08-31T05:20:33.591 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-08-31T05:20:33.591 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.allow_ingest_behind: 0 2024-08-31T05:20:33.591 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.two_write_queues: 0 2024-08-31T05:20:33.592 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.manual_wal_flush: 0 2024-08-31T05:20:33.592 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.wal_compression: 0 2024-08-31T05:20:33.592 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.atomic_flush: 0 2024-08-31T05:20:33.592 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-08-31T05:20:33.592 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.persist_stats_to_disk: 0 2024-08-31T05:20:33.593 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.write_dbid_to_manifest: 0 2024-08-31T05:20:33.593 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.log_readahead_size: 0 2024-08-31T05:20:33.593 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-08-31T05:20:33.594 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.best_efforts_recovery: 0 2024-08-31T05:20:33.594 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-08-31T05:20:33.594 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-08-31T05:20:33.594 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.allow_data_in_errors: 0 2024-08-31T05:20:33.594 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.db_host_id: __hostname__ 2024-08-31T05:20:33.594 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.enforce_single_del_contracts: true 2024-08-31T05:20:33.594 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.max_background_jobs: 2 2024-08-31T05:20:33.594 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.max_background_compactions: -1 2024-08-31T05:20:33.594 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.max_subcompactions: 1 2024-08-31T05:20:33.594 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-08-31T05:20:33.594 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-08-31T05:20:33.594 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.delayed_write_rate : 16777216 2024-08-31T05:20:33.594 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.max_total_wal_size: 0 2024-08-31T05:20:33.595 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-08-31T05:20:33.595 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.stats_dump_period_sec: 600 2024-08-31T05:20:33.595 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.stats_persist_period_sec: 600 2024-08-31T05:20:33.595 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-08-31T05:20:33.595 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.max_open_files: -1 2024-08-31T05:20:33.595 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.bytes_per_sync: 0 2024-08-31T05:20:33.595 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.wal_bytes_per_sync: 0 2024-08-31T05:20:33.595 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.strict_bytes_per_sync: 0 2024-08-31T05:20:33.595 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.compaction_readahead_size: 0 2024-08-31T05:20:33.595 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.max_background_flushes: -1 2024-08-31T05:20:33.595 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Compression algorithms supported: 2024-08-31T05:20:33.595 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: kZSTD supported: 0 2024-08-31T05:20:33.596 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: kXpressCompression supported: 0 2024-08-31T05:20:33.596 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: kBZip2Compression supported: 0 2024-08-31T05:20:33.596 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-08-31T05:20:33.596 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: kLZ4Compression supported: 1 2024-08-31T05:20:33.596 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: kZlibCompression supported: 1 2024-08-31T05:20:33.596 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: kLZ4HCCompression supported: 1 2024-08-31T05:20:33.596 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: kSnappyCompression supported: 1 2024-08-31T05:20:33.596 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Fast CRC32 supported: Supported on x86 2024-08-31T05:20:33.596 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: DMutex implementation: pthread_mutex_t 2024-08-31T05:20:33.596 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-08-31T05:20:33.596 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-08-31T05:20:33.597 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-08-31T05:20:33.597 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.merge_operator: 2024-08-31T05:20:33.597 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.compaction_filter: None 2024-08-31T05:20:33.597 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.compaction_filter_factory: None 2024-08-31T05:20:33.597 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.sst_partitioner_factory: None 2024-08-31T05:20:33.597 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.memtable_factory: SkipListFactory 2024-08-31T05:20:33.597 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.table_factory: BlockBasedTable 2024-08-31T05:20:33.597 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55d27bb95100) 2024-08-31T05:20:33.597 INFO:journalctl@ceph.mon.c.smithi070.stdout: cache_index_and_filter_blocks: 1 2024-08-31T05:20:33.597 INFO:journalctl@ceph.mon.c.smithi070.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-08-31T05:20:33.598 INFO:journalctl@ceph.mon.c.smithi070.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-08-31T05:20:33.598 INFO:journalctl@ceph.mon.c.smithi070.stdout: pin_top_level_index_and_filter: 1 2024-08-31T05:20:33.598 INFO:journalctl@ceph.mon.c.smithi070.stdout: index_type: 0 2024-08-31T05:20:33.598 INFO:journalctl@ceph.mon.c.smithi070.stdout: data_block_index_type: 0 2024-08-31T05:20:33.598 INFO:journalctl@ceph.mon.c.smithi070.stdout: index_shortening: 1 2024-08-31T05:20:33.598 INFO:journalctl@ceph.mon.c.smithi070.stdout: data_block_hash_table_util_ratio: 0.750000 2024-08-31T05:20:33.598 INFO:journalctl@ceph.mon.c.smithi070.stdout: checksum: 4 2024-08-31T05:20:33.598 INFO:journalctl@ceph.mon.c.smithi070.stdout: no_block_cache: 0 2024-08-31T05:20:33.598 INFO:journalctl@ceph.mon.c.smithi070.stdout: block_cache: 0x55d277b58850 2024-08-31T05:20:33.598 INFO:journalctl@ceph.mon.c.smithi070.stdout: block_cache_name: BinnedLRUCache 2024-08-31T05:20:33.598 INFO:journalctl@ceph.mon.c.smithi070.stdout: block_cache_options: 2024-08-31T05:20:33.598 INFO:journalctl@ceph.mon.c.smithi070.stdout: capacity : 536870912 2024-08-31T05:20:33.598 INFO:journalctl@ceph.mon.c.smithi070.stdout: num_shard_bits : 4 2024-08-31T05:20:33.598 INFO:journalctl@ceph.mon.c.smithi070.stdout: strict_capacity_limit : 0 2024-08-31T05:20:33.599 INFO:journalctl@ceph.mon.c.smithi070.stdout: high_pri_pool_ratio: 0.000 2024-08-31T05:20:33.599 INFO:journalctl@ceph.mon.c.smithi070.stdout: block_cache_compressed: (nil) 2024-08-31T05:20:33.599 INFO:journalctl@ceph.mon.c.smithi070.stdout: persistent_cache: (nil) 2024-08-31T05:20:33.599 INFO:journalctl@ceph.mon.c.smithi070.stdout: block_size: 4096 2024-08-31T05:20:33.599 INFO:journalctl@ceph.mon.c.smithi070.stdout: block_size_deviation: 10 2024-08-31T05:20:33.599 INFO:journalctl@ceph.mon.c.smithi070.stdout: block_restart_interval: 16 2024-08-31T05:20:33.599 INFO:journalctl@ceph.mon.c.smithi070.stdout: index_block_restart_interval: 1 2024-08-31T05:20:33.599 INFO:journalctl@ceph.mon.c.smithi070.stdout: metadata_block_size: 4096 2024-08-31T05:20:33.599 INFO:journalctl@ceph.mon.c.smithi070.stdout: partition_filters: 0 2024-08-31T05:20:33.599 INFO:journalctl@ceph.mon.c.smithi070.stdout: use_delta_encoding: 1 2024-08-31T05:20:33.599 INFO:journalctl@ceph.mon.c.smithi070.stdout: filter_policy: bloomfilter 2024-08-31T05:20:33.599 INFO:journalctl@ceph.mon.c.smithi070.stdout: whole_key_filtering: 1 2024-08-31T05:20:33.600 INFO:journalctl@ceph.mon.c.smithi070.stdout: verify_compression: 0 2024-08-31T05:20:33.600 INFO:journalctl@ceph.mon.c.smithi070.stdout: read_amp_bytes_per_bit: 0 2024-08-31T05:20:33.600 INFO:journalctl@ceph.mon.c.smithi070.stdout: format_version: 5 2024-08-31T05:20:33.600 INFO:journalctl@ceph.mon.c.smithi070.stdout: enable_index_compression: 1 2024-08-31T05:20:33.600 INFO:journalctl@ceph.mon.c.smithi070.stdout: block_align: 0 2024-08-31T05:20:33.600 INFO:journalctl@ceph.mon.c.smithi070.stdout: max_auto_readahead_size: 262144 2024-08-31T05:20:33.600 INFO:journalctl@ceph.mon.c.smithi070.stdout: prepopulate_block_cache: 0 2024-08-31T05:20:33.600 INFO:journalctl@ceph.mon.c.smithi070.stdout: initial_auto_readahead_size: 8192 2024-08-31T05:20:33.600 INFO:journalctl@ceph.mon.c.smithi070.stdout: num_file_reads_for_auto_readahead: 2 2024-08-31T05:20:33.600 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.write_buffer_size: 33554432 2024-08-31T05:20:33.600 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.max_write_buffer_number: 2 2024-08-31T05:20:33.600 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.compression: NoCompression 2024-08-31T05:20:33.600 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.bottommost_compression: Disabled 2024-08-31T05:20:33.600 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.prefix_extractor: nullptr 2024-08-31T05:20:33.600 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-08-31T05:20:33.601 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.num_levels: 7 2024-08-31T05:20:33.601 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-08-31T05:20:33.601 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-08-31T05:20:33.601 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-08-31T05:20:33.601 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-08-31T05:20:33.601 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-08-31T05:20:33.601 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-08-31T05:20:33.601 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-08-31T05:20:33.601 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-08-31T05:20:33.601 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-08-31T05:20:33.601 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-08-31T05:20:33.601 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-08-31T05:20:33.602 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-08-31T05:20:33.602 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.compression_opts.window_bits: -14 2024-08-31T05:20:33.602 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.compression_opts.level: 32767 2024-08-31T05:20:33.602 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.compression_opts.strategy: 0 2024-08-31T05:20:33.602 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-08-31T05:20:33.602 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-08-31T05:20:33.602 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-08-31T05:20:33.602 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-08-31T05:20:33.602 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.compression_opts.enabled: false 2024-08-31T05:20:33.602 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-08-31T05:20:33.602 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-08-31T05:20:33.602 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-08-31T05:20:33.602 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-08-31T05:20:33.603 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.target_file_size_base: 67108864 2024-08-31T05:20:33.603 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.target_file_size_multiplier: 1 2024-08-31T05:20:33.603 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-08-31T05:20:33.603 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-08-31T05:20:33.603 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-08-31T05:20:33.603 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-08-31T05:20:33.603 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-08-31T05:20:33.603 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-08-31T05:20:33.603 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-08-31T05:20:33.603 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-08-31T05:20:33.603 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-08-31T05:20:33.603 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-08-31T05:20:33.603 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-08-31T05:20:33.604 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-08-31T05:20:33.604 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-08-31T05:20:33.604 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.arena_block_size: 1048576 2024-08-31T05:20:33.604 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-08-31T05:20:33.604 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-08-31T05:20:33.604 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.disable_auto_compactions: 0 2024-08-31T05:20:33.604 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-08-31T05:20:33.604 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-08-31T05:20:33.604 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-08-31T05:20:33.604 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-08-31T05:20:33.604 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-08-31T05:20:33.604 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-08-31T05:20:33.604 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-08-31T05:20:33.604 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-08-31T05:20:33.605 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-08-31T05:20:33.605 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-08-31T05:20:33.605 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-08-31T05:20:33.605 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.inplace_update_support: 0 2024-08-31T05:20:33.605 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.inplace_update_num_locks: 10000 2024-08-31T05:20:33.605 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-08-31T05:20:33.605 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-08-31T05:20:33.605 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.memtable_huge_page_size: 0 2024-08-31T05:20:33.605 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.bloom_locality: 0 2024-08-31T05:20:33.605 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.max_successive_merges: 0 2024-08-31T05:20:33.605 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.optimize_filters_for_hits: 0 2024-08-31T05:20:33.605 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.paranoid_file_checks: 0 2024-08-31T05:20:33.605 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.force_consistency_checks: 1 2024-08-31T05:20:33.605 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.report_bg_io_stats: 0 2024-08-31T05:20:33.606 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.ttl: 2592000 2024-08-31T05:20:33.606 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.periodic_compaction_seconds: 0 2024-08-31T05:20:33.606 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-08-31T05:20:33.606 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-08-31T05:20:33.606 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.enable_blob_files: false 2024-08-31T05:20:33.606 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.min_blob_size: 0 2024-08-31T05:20:33.606 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.blob_file_size: 268435456 2024-08-31T05:20:33.606 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.blob_compression_type: NoCompression 2024-08-31T05:20:33.606 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.enable_blob_garbage_collection: false 2024-08-31T05:20:33.606 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-08-31T05:20:33.606 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-08-31T05:20:33.606 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-08-31T05:20:33.606 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.blob_file_starting_level: 0 2024-08-31T05:20:33.607 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-08-31T05:20:33.607 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-08-31T05:20:33.607 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-08-31T05:20:33.607 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: ba2a0288-8f3c-48e3-a1f7-0396a91c0f02 2024-08-31T05:20:33.607 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725081633270138, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-08-31T05:20:33.607 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-08-31T05:20:33.607 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725081633270559, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1725081633, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "ba2a0288-8f3c-48e3-a1f7-0396a91c0f02", "db_session_id": "LV0FF7U0CI85OSKSFWE7", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-08-31T05:20:33.607 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725081633270654, "job": 1, "event": "recovery_finished"} 2024-08-31T05:20:33.607 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-08-31T05:20:33.607 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-08-31T05:20:33.607 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55d27bbb8a80 2024-08-31T05:20:33.607 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: DB pointer 0x55d27c95a000 2024-08-31T05:20:33.607 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-08-31T05:20:33.607 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-08-31T05:20:33.608 INFO:journalctl@ceph.mon.c.smithi070.stdout: ** DB Stats ** 2024-08-31T05:20:33.608 INFO:journalctl@ceph.mon.c.smithi070.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-31T05:20:33.608 INFO:journalctl@ceph.mon.c.smithi070.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-08-31T05:20:33.608 INFO:journalctl@ceph.mon.c.smithi070.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-31T05:20:33.608 INFO:journalctl@ceph.mon.c.smithi070.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-31T05:20:33.608 INFO:journalctl@ceph.mon.c.smithi070.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-08-31T05:20:33.608 INFO:journalctl@ceph.mon.c.smithi070.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-31T05:20:33.608 INFO:journalctl@ceph.mon.c.smithi070.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-31T05:20:33.608 INFO:journalctl@ceph.mon.c.smithi070.stdout: 2024-08-31T05:20:33.608 INFO:journalctl@ceph.mon.c.smithi070.stdout: ** Compaction Stats [default] ** 2024-08-31T05:20:33.608 INFO:journalctl@ceph.mon.c.smithi070.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-31T05:20:33.608 INFO:journalctl@ceph.mon.c.smithi070.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-08-31T05:20:33.608 INFO:journalctl@ceph.mon.c.smithi070.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-31T05:20:33.608 INFO:journalctl@ceph.mon.c.smithi070.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-31T05:20:33.609 INFO:journalctl@ceph.mon.c.smithi070.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-31T05:20:33.609 INFO:journalctl@ceph.mon.c.smithi070.stdout: 2024-08-31T05:20:33.609 INFO:journalctl@ceph.mon.c.smithi070.stdout: ** Compaction Stats [default] ** 2024-08-31T05:20:33.609 INFO:journalctl@ceph.mon.c.smithi070.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-31T05:20:33.609 INFO:journalctl@ceph.mon.c.smithi070.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-08-31T05:20:33.609 INFO:journalctl@ceph.mon.c.smithi070.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-31T05:20:33.609 INFO:journalctl@ceph.mon.c.smithi070.stdout: 2024-08-31T05:20:33.610 INFO:journalctl@ceph.mon.c.smithi070.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-08-31T05:20:33.610 INFO:journalctl@ceph.mon.c.smithi070.stdout: 2024-08-31T05:20:33.610 INFO:journalctl@ceph.mon.c.smithi070.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-31T05:20:33.610 INFO:journalctl@ceph.mon.c.smithi070.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-08-31T05:20:33.610 INFO:journalctl@ceph.mon.c.smithi070.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-08-31T05:20:33.610 INFO:journalctl@ceph.mon.c.smithi070.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-08-31T05:20:33.610 INFO:journalctl@ceph.mon.c.smithi070.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-08-31T05:20:33.610 INFO:journalctl@ceph.mon.c.smithi070.stdout: AddFile(Keys): cumulative 0, interval 0 2024-08-31T05:20:33.610 INFO:journalctl@ceph.mon.c.smithi070.stdout: Cumulative compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-31T05:20:33.610 INFO:journalctl@ceph.mon.c.smithi070.stdout: Interval compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-31T05:20:33.610 INFO:journalctl@ceph.mon.c.smithi070.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-08-31T05:20:33.610 INFO:journalctl@ceph.mon.c.smithi070.stdout: Block cache BinnedLRUCache@0x55d277b58850#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-08-31T05:20:33.610 INFO:journalctl@ceph.mon.c.smithi070.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-08-31T05:20:33.611 INFO:journalctl@ceph.mon.c.smithi070.stdout: 2024-08-31T05:20:33.611 INFO:journalctl@ceph.mon.c.smithi070.stdout: ** File Read Latency Histogram By Level [default] ** 2024-08-31T05:20:33.611 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-08-31T05:20:33.611 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: using public_addr v2:172.21.15.70:0/0 -> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-08-31T05:20:33.611 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: starting mon.c rank -1 at public addrs [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] at bind addrs [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 69422704-6758-11ef-bcd4-c7b262605968 2024-08-31T05:20:33.611 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: mon.c@-1(???) e0 preinit fsid 69422704-6758-11ef-bcd4-c7b262605968 2024-08-31T05:20:33.611 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: mon.c@-1(synchronizing).mds e1 new map 2024-08-31T05:20:33.611 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: mon.c@-1(synchronizing).mds e1 print_map 2024-08-31T05:20:33.611 INFO:journalctl@ceph.mon.c.smithi070.stdout: e1 2024-08-31T05:20:33.612 INFO:journalctl@ceph.mon.c.smithi070.stdout: btime 2024-08-31T05:19:04:860087+0000 2024-08-31T05:20:33.612 INFO:journalctl@ceph.mon.c.smithi070.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-08-31T05:20:33.612 INFO:journalctl@ceph.mon.c.smithi070.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T05:20:33.612 INFO:journalctl@ceph.mon.c.smithi070.stdout: legacy client fscid: -1 2024-08-31T05:20:33.612 INFO:journalctl@ceph.mon.c.smithi070.stdout: 2024-08-31T05:20:33.612 INFO:journalctl@ceph.mon.c.smithi070.stdout: No filesystems configured 2024-08-31T05:20:33.612 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-08-31T05:20:33.612 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-08-31T05:20:33.612 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-08-31T05:20:33.612 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-08-31T05:20:33.612 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-08-31T05:20:33.612 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-08-31T05:20:33.612 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-08-31T05:20:33.612 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-31T05:20:33.613 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-31T05:20:33.613 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-31T05:20:33.613 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:33.613 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T05:20:33.613 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:20:33.613 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/4091766560' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-08-31T05:20:33.613 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/4091766560' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-08-31T05:20:33.613 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: osdmap e4: 0 total, 0 up, 0 in 2024-08-31T05:20:33.613 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:33.613 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:33.613 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:33.613 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:33.613 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi070", "name": "osd_memory_target"} : dispatch 2024-08-31T05:20:33.613 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:20:33.614 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:20:33.614 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:20:33.614 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: Updating smithi070:/etc/ceph/ceph.conf 2024-08-31T05:20:33.614 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: Updating smithi070:/var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:20:33.614 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:33.614 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:33.614 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:33.614 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:33.614 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:33.614 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:33.614 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:33.614 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:33.614 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T05:20:33.614 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T05:20:33.614 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:20:33.615 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: Updating smithi070:/etc/ceph/ceph.client.admin.keyring 2024-08-31T05:20:33.615 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: Updating smithi070:/var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T05:20:33.615 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi005:172.21.15.5=a;smithi050:172.21.15.50=b;smithi070:172.21.15.70=c", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:20:33.615 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: Saving service mon spec with placement smithi005:172.21.15.5=a;smithi050:172.21.15.50=b;smithi070:172.21.15.70=c;count:3 2024-08-31T05:20:33.615 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: Reconfiguring mon.a (unknown last config time)... 2024-08-31T05:20:33.615 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: Reconfiguring daemon mon.a on smithi005 2024-08-31T05:20:33.615 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:20:33.615 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:33.615 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:33.615 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:20:33.615 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:20:33.615 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:20:33.615 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:33.615 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T05:20:33.616 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:20:33.616 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: Deploying daemon mon.c on smithi070 2024-08-31T05:20:33.616 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: from='client.? 172.21.15.70:0/1289523191' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T05:20:33.616 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:20:33.616 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: from='client.? 172.21.15.70:0/3452974775' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T05:20:33.616 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 ceph-mon[22316]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-08-31T05:20:33.616 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 bash[22294]: d0d29cc757a21e855c7ef9ce469c8d96fb9b3b842de6751c5ef2e7d96d426efe 2024-08-31T05:20:33.616 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:33 smithi070 systemd[1]: Started Ceph mon.c for 69422704-6758-11ef-bcd4-c7b262605968. 2024-08-31T05:20:33.936 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-31T05:20:33.936 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-31T05:20:34.184 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T05:20:38.691 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:38 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T05:20:38.691 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:38 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:20:38.691 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:38 smithi070 ceph-mon[22316]: mon.a calling monitor election 2024-08-31T05:20:38.692 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:38 smithi070 ceph-mon[22316]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:20:38.692 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:38 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:20:38.692 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:38 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:20:38.692 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:38 smithi070 ceph-mon[22316]: mon.c calling monitor election 2024-08-31T05:20:38.692 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:38 smithi070 ceph-mon[22316]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:20:38.692 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:38 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:20:38.692 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:38 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:20:38.693 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:38 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:20:38.693 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:38 smithi070 ceph-mon[22316]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-31T05:20:38.693 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:38 smithi070 ceph-mon[22316]: monmap epoch 2 2024-08-31T05:20:38.693 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:38 smithi070 ceph-mon[22316]: fsid 69422704-6758-11ef-bcd4-c7b262605968 2024-08-31T05:20:38.693 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:38 smithi070 ceph-mon[22316]: last_changed 2024-08-31T05:20:33.297003+0000 2024-08-31T05:20:38.693 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:38 smithi070 ceph-mon[22316]: created 2024-08-31T05:19:01.939099+0000 2024-08-31T05:20:38.694 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:38 smithi070 ceph-mon[22316]: min_mon_release 19 (squid) 2024-08-31T05:20:38.694 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:38 smithi070 ceph-mon[22316]: election_strategy: 1 2024-08-31T05:20:38.694 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:38 smithi070 ceph-mon[22316]: 0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-31T05:20:38.694 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:38 smithi070 ceph-mon[22316]: 1: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.c 2024-08-31T05:20:38.694 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:38 smithi070 ceph-mon[22316]: fsmap 2024-08-31T05:20:38.694 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:38 smithi070 ceph-mon[22316]: osdmap e4: 0 total, 0 up, 0 in 2024-08-31T05:20:38.695 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:38 smithi070 ceph-mon[22316]: mgrmap e13: x(active, since 42s) 2024-08-31T05:20:38.695 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:38 smithi070 ceph-mon[22316]: overall HEALTH_OK 2024-08-31T05:20:38.695 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:38 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:38.695 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:38 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:38.695 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:38 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:38.695 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:38 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T05:20:38.696 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:38 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:20:38.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:38 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T05:20:38.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:38 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:20:38.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:38 smithi005 ceph-mon[18602]: mon.a calling monitor election 2024-08-31T05:20:38.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:38 smithi005 ceph-mon[18602]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:20:38.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:38 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:20:38.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:38 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:20:38.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:38 smithi005 ceph-mon[18602]: mon.c calling monitor election 2024-08-31T05:20:38.719 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:38 smithi005 ceph-mon[18602]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:20:38.719 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:38 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:20:38.719 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:38 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:20:38.719 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:38 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:20:38.719 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:38 smithi005 ceph-mon[18602]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-31T05:20:38.720 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:38 smithi005 ceph-mon[18602]: monmap epoch 2 2024-08-31T05:20:38.720 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:38 smithi005 ceph-mon[18602]: fsid 69422704-6758-11ef-bcd4-c7b262605968 2024-08-31T05:20:38.720 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:38 smithi005 ceph-mon[18602]: last_changed 2024-08-31T05:20:33.297003+0000 2024-08-31T05:20:38.720 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:38 smithi005 ceph-mon[18602]: created 2024-08-31T05:19:01.939099+0000 2024-08-31T05:20:38.720 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:38 smithi005 ceph-mon[18602]: min_mon_release 19 (squid) 2024-08-31T05:20:38.721 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:38 smithi005 ceph-mon[18602]: election_strategy: 1 2024-08-31T05:20:38.721 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:38 smithi005 ceph-mon[18602]: 0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-31T05:20:38.721 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:38 smithi005 ceph-mon[18602]: 1: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.c 2024-08-31T05:20:38.722 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:38 smithi005 ceph-mon[18602]: fsmap 2024-08-31T05:20:38.722 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:38 smithi005 ceph-mon[18602]: osdmap e4: 0 total, 0 up, 0 in 2024-08-31T05:20:38.722 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:38 smithi005 ceph-mon[18602]: mgrmap e13: x(active, since 42s) 2024-08-31T05:20:38.722 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:38 smithi005 ceph-mon[18602]: overall HEALTH_OK 2024-08-31T05:20:38.722 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:38 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:38.722 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:38 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:38.722 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:38 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:38.723 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:38 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T05:20:38.723 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:38 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:20:39.261 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-08-31T05:20:39.262 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":2,"fsid":"69422704-6758-11ef-bcd4-c7b262605968","modified":"2024-08-31T05:20:33.297003Z","created":"2024-08-31T05:19:01.939099Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:3300","nonce":0},{"type":"v1","addr":"172.21.15.70:6789","nonce":0}]},"addr":"172.21.15.70:6789/0","public_addr":"172.21.15.70:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-08-31T05:20:39.262 INFO:teuthology.orchestra.run.smithi070.stderr:dumped monmap epoch 2 2024-08-31T05:20:39.553 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:39 smithi070 ceph-mon[22316]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:20:39.553 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:39 smithi070 ceph-mon[22316]: Deploying daemon mon.b on smithi050 2024-08-31T05:20:39.553 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:39 smithi070 ceph-mon[22316]: from='client.? 172.21.15.70:0/3923520087' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T05:20:39.553 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:39 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:20:39.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:39 smithi005 ceph-mon[18602]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:20:39.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:39 smithi005 ceph-mon[18602]: Deploying daemon mon.b on smithi050 2024-08-31T05:20:39.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:39 smithi005 ceph-mon[18602]: from='client.? 172.21.15.70:0/3923520087' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T05:20:39.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:39 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:20:40.847 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-31T05:20:40.848 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-31T05:20:41.099 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T05:20:41.530 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:41 smithi070 ceph-mon[22316]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:20:41.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:41 smithi005 ceph-mon[18602]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:20:41.787 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-08-31T05:20:41.787 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":2,"fsid":"69422704-6758-11ef-bcd4-c7b262605968","modified":"2024-08-31T05:20:33.297003Z","created":"2024-08-31T05:19:01.939099Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:3300","nonce":0},{"type":"v1","addr":"172.21.15.70:6789","nonce":0}]},"addr":"172.21.15.70:6789/0","public_addr":"172.21.15.70:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-08-31T05:20:41.788 INFO:teuthology.orchestra.run.smithi070.stderr:dumped monmap epoch 2 2024-08-31T05:20:42.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:42 smithi050 systemd[1]: Started Ceph mon.b for 69422704-6758-11ef-bcd4-c7b262605968. 2024-08-31T05:20:43.378 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-31T05:20:43.378 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-31T05:20:43.629 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T05:20:47.340 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-08-31T05:20:47.340 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":3,"fsid":"69422704-6758-11ef-bcd4-c7b262605968","modified":"2024-08-31T05:20:42.039914Z","created":"2024-08-31T05:19:01.939099Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:3300","nonce":0},{"type":"v1","addr":"172.21.15.70:6789","nonce":0}]},"addr":"172.21.15.70:6789/0","public_addr":"172.21.15.70:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:3300","nonce":0},{"type":"v1","addr":"172.21.15.50:6789","nonce":0}]},"addr":"172.21.15.50:6789/0","public_addr":"172.21.15.50:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-08-31T05:20:47.340 INFO:teuthology.orchestra.run.smithi070.stderr:dumped monmap epoch 3 2024-08-31T05:20:47.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:47 smithi005 ceph-mon[18602]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:20:47.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:47 smithi005 ceph-mon[18602]: mon.c calling monitor election 2024-08-31T05:20:47.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:47 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T05:20:47.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:47 smithi005 ceph-mon[18602]: mon.a calling monitor election 2024-08-31T05:20:47.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:47 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:20:47.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:47 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:20:47.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:47 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:20:47.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:47 smithi005 ceph-mon[18602]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:20:47.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:47 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:20:47.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:47 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:20:47.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:47 smithi005 ceph-mon[18602]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:20:47.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:47 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:20:47.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:47 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:20:47.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:47 smithi005 ceph-mon[18602]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-31T05:20:47.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:47 smithi005 ceph-mon[18602]: monmap epoch 3 2024-08-31T05:20:47.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:47 smithi005 ceph-mon[18602]: fsid 69422704-6758-11ef-bcd4-c7b262605968 2024-08-31T05:20:47.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:47 smithi005 ceph-mon[18602]: last_changed 2024-08-31T05:20:42.039914+0000 2024-08-31T05:20:47.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:47 smithi005 ceph-mon[18602]: created 2024-08-31T05:19:01.939099+0000 2024-08-31T05:20:47.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:47 smithi005 ceph-mon[18602]: min_mon_release 19 (squid) 2024-08-31T05:20:47.469 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:47 smithi005 ceph-mon[18602]: election_strategy: 1 2024-08-31T05:20:47.469 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:47 smithi005 ceph-mon[18602]: 0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-31T05:20:47.469 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:47 smithi005 ceph-mon[18602]: 1: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.c 2024-08-31T05:20:47.469 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:47 smithi005 ceph-mon[18602]: 2: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.b 2024-08-31T05:20:47.469 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:47 smithi005 ceph-mon[18602]: fsmap 2024-08-31T05:20:47.469 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:47 smithi005 ceph-mon[18602]: osdmap e4: 0 total, 0 up, 0 in 2024-08-31T05:20:47.469 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:47 smithi005 ceph-mon[18602]: mgrmap e13: x(active, since 51s) 2024-08-31T05:20:47.469 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:47 smithi005 ceph-mon[18602]: overall HEALTH_OK 2024-08-31T05:20:47.469 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:47 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:47.469 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:47 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:47.469 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:47 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:47.469 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:47 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:47.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:47 smithi070 ceph-mon[22316]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:20:47.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:47 smithi070 ceph-mon[22316]: mon.c calling monitor election 2024-08-31T05:20:47.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:47 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T05:20:47.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:47 smithi070 ceph-mon[22316]: mon.a calling monitor election 2024-08-31T05:20:47.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:47 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:20:47.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:47 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:20:47.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:47 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:20:47.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:47 smithi070 ceph-mon[22316]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:20:47.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:47 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:20:47.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:47 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:20:47.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:47 smithi070 ceph-mon[22316]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:20:47.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:47 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:20:47.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:47 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:20:47.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:47 smithi070 ceph-mon[22316]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-31T05:20:47.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:47 smithi070 ceph-mon[22316]: monmap epoch 3 2024-08-31T05:20:47.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:47 smithi070 ceph-mon[22316]: fsid 69422704-6758-11ef-bcd4-c7b262605968 2024-08-31T05:20:47.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:47 smithi070 ceph-mon[22316]: last_changed 2024-08-31T05:20:42.039914+0000 2024-08-31T05:20:47.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:47 smithi070 ceph-mon[22316]: created 2024-08-31T05:19:01.939099+0000 2024-08-31T05:20:47.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:47 smithi070 ceph-mon[22316]: min_mon_release 19 (squid) 2024-08-31T05:20:47.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:47 smithi070 ceph-mon[22316]: election_strategy: 1 2024-08-31T05:20:47.588 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:47 smithi070 ceph-mon[22316]: 0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-31T05:20:47.588 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:47 smithi070 ceph-mon[22316]: 1: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.c 2024-08-31T05:20:47.588 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:47 smithi070 ceph-mon[22316]: 2: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.b 2024-08-31T05:20:47.588 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:47 smithi070 ceph-mon[22316]: fsmap 2024-08-31T05:20:47.588 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:47 smithi070 ceph-mon[22316]: osdmap e4: 0 total, 0 up, 0 in 2024-08-31T05:20:47.588 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:47 smithi070 ceph-mon[22316]: mgrmap e13: x(active, since 51s) 2024-08-31T05:20:47.588 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:47 smithi070 ceph-mon[22316]: overall HEALTH_OK 2024-08-31T05:20:47.588 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:47 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:47.588 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:47 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:47.588 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:47 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:47.588 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:47 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:47.951 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-08-31T05:20:47.951 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph config generate-minimal-conf 2024-08-31T05:20:48.213 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:20:48.300 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:48 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:20:48.300 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:48 smithi070 ceph-mon[22316]: from='client.? 172.21.15.70:0/3644744900' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T05:20:48.300 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:48 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:20:48.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:48 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:20:48.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:48 smithi005 ceph-mon[18602]: from='client.? 172.21.15.70:0/3644744900' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T05:20:48.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:48 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:20:48.888 INFO:teuthology.orchestra.run.smithi005.stdout:# minimal ceph.conf for 69422704-6758-11ef-bcd4-c7b262605968 2024-08-31T05:20:48.888 INFO:teuthology.orchestra.run.smithi005.stdout:[global] 2024-08-31T05:20:48.888 INFO:teuthology.orchestra.run.smithi005.stdout: fsid = 69422704-6758-11ef-bcd4-c7b262605968 2024-08-31T05:20:48.889 INFO:teuthology.orchestra.run.smithi005.stdout: mon_host = [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] 2024-08-31T05:20:49.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:20:49.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: mon.c calling monitor election 2024-08-31T05:20:49.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T05:20:49.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: mon.a calling monitor election 2024-08-31T05:20:49.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:20:49.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:20:49.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:20:49.408 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:20:49.408 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:20:49.408 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:20:49.408 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:20:49.408 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:20:49.408 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:20:49.408 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-31T05:20:49.408 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: monmap epoch 3 2024-08-31T05:20:49.408 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: fsid 69422704-6758-11ef-bcd4-c7b262605968 2024-08-31T05:20:49.408 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: last_changed 2024-08-31T05:20:42.039914+0000 2024-08-31T05:20:49.408 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: created 2024-08-31T05:19:01.939099+0000 2024-08-31T05:20:49.408 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: min_mon_release 19 (squid) 2024-08-31T05:20:49.408 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: election_strategy: 1 2024-08-31T05:20:49.409 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: 0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-31T05:20:49.409 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: 1: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.c 2024-08-31T05:20:49.409 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: 2: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.b 2024-08-31T05:20:49.409 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: fsmap 2024-08-31T05:20:49.409 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: osdmap e4: 0 total, 0 up, 0 in 2024-08-31T05:20:49.409 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: mgrmap e13: x(active, since 51s) 2024-08-31T05:20:49.409 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: overall HEALTH_OK 2024-08-31T05:20:49.409 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:49.409 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:49.409 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:49.409 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:49.409 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:20:49.409 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: from='client.? 172.21.15.70:0/3644744900' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T05:20:49.409 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:20:49.753 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-08-31T05:20:49.754 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-31T05:20:49.754 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/ceph/ceph.conf 2024-08-31T05:20:49.783 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-31T05:20:49.783 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-31T05:20:49.848 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-08-31T05:20:49.848 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/ceph/ceph.conf 2024-08-31T05:20:49.879 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-08-31T05:20:49.879 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-31T05:20:49.945 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-08-31T05:20:49.945 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/ceph/ceph.conf 2024-08-31T05:20:49.969 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:49 smithi070 ceph-mon[22316]: mon.b calling monitor election 2024-08-31T05:20:49.969 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:49 smithi070 ceph-mon[22316]: Updating smithi005:/etc/ceph/ceph.conf 2024-08-31T05:20:49.970 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:49 smithi070 ceph-mon[22316]: Updating smithi050:/etc/ceph/ceph.conf 2024-08-31T05:20:49.970 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:49 smithi070 ceph-mon[22316]: Updating smithi070:/etc/ceph/ceph.conf 2024-08-31T05:20:49.970 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:49 smithi070 ceph-mon[22316]: Updating smithi070:/var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:20:49.970 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:49 smithi070 ceph-mon[22316]: Updating smithi005:/var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:20:49.970 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:49 smithi070 ceph-mon[22316]: Updating smithi050:/var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:20:49.970 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:49 smithi070 ceph-mon[22316]: mon.b calling monitor election 2024-08-31T05:20:49.970 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:49 smithi070 ceph-mon[22316]: mon.c calling monitor election 2024-08-31T05:20:49.970 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:49 smithi070 ceph-mon[22316]: mon.a calling monitor election 2024-08-31T05:20:49.970 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:49 smithi070 ceph-mon[22316]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-08-31T05:20:49.970 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:49 smithi070 ceph-mon[22316]: monmap epoch 3 2024-08-31T05:20:49.970 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:49 smithi070 ceph-mon[22316]: fsid 69422704-6758-11ef-bcd4-c7b262605968 2024-08-31T05:20:49.970 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:49 smithi070 ceph-mon[22316]: last_changed 2024-08-31T05:20:42.039914+0000 2024-08-31T05:20:49.970 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:49 smithi070 ceph-mon[22316]: created 2024-08-31T05:19:01.939099+0000 2024-08-31T05:20:49.971 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:49 smithi070 ceph-mon[22316]: min_mon_release 19 (squid) 2024-08-31T05:20:49.971 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:49 smithi070 ceph-mon[22316]: election_strategy: 1 2024-08-31T05:20:49.971 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:49 smithi070 ceph-mon[22316]: 0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-31T05:20:49.971 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:49 smithi070 ceph-mon[22316]: 1: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.c 2024-08-31T05:20:49.971 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:49 smithi070 ceph-mon[22316]: 2: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.b 2024-08-31T05:20:49.971 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:49 smithi070 ceph-mon[22316]: fsmap 2024-08-31T05:20:49.971 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:49 smithi070 ceph-mon[22316]: osdmap e4: 0 total, 0 up, 0 in 2024-08-31T05:20:49.971 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:49 smithi070 ceph-mon[22316]: mgrmap e13: x(active, since 53s) 2024-08-31T05:20:49.971 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:49 smithi070 ceph-mon[22316]: overall HEALTH_OK 2024-08-31T05:20:49.972 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:49 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:49.972 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:49 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:49.972 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:49 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:49.972 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:49 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:49.972 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:49 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:49.972 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:49 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:49.972 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:49 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:49.972 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:49 smithi070 ceph-mon[22316]: Reconfiguring mon.a (monmap changed)... 2024-08-31T05:20:49.972 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:49 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T05:20:49.972 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:49 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T05:20:49.972 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:49 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:20:49.972 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:49 smithi070 ceph-mon[22316]: Reconfiguring daemon mon.a on smithi005 2024-08-31T05:20:49.973 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-08-31T05:20:49.974 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-31T05:20:50.021 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:49 smithi005 ceph-mon[18602]: mon.b calling monitor election 2024-08-31T05:20:50.022 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:49 smithi005 ceph-mon[18602]: Updating smithi005:/etc/ceph/ceph.conf 2024-08-31T05:20:50.022 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:49 smithi005 ceph-mon[18602]: Updating smithi050:/etc/ceph/ceph.conf 2024-08-31T05:20:50.022 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:49 smithi005 ceph-mon[18602]: Updating smithi070:/etc/ceph/ceph.conf 2024-08-31T05:20:50.022 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:49 smithi005 ceph-mon[18602]: Updating smithi070:/var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:20:50.022 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:49 smithi005 ceph-mon[18602]: Updating smithi005:/var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:20:50.022 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:49 smithi005 ceph-mon[18602]: Updating smithi050:/var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:20:50.022 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:49 smithi005 ceph-mon[18602]: mon.b calling monitor election 2024-08-31T05:20:50.022 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:49 smithi005 ceph-mon[18602]: mon.c calling monitor election 2024-08-31T05:20:50.022 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:49 smithi005 ceph-mon[18602]: mon.a calling monitor election 2024-08-31T05:20:50.022 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:49 smithi005 ceph-mon[18602]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-08-31T05:20:50.022 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:49 smithi005 ceph-mon[18602]: monmap epoch 3 2024-08-31T05:20:50.022 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:49 smithi005 ceph-mon[18602]: fsid 69422704-6758-11ef-bcd4-c7b262605968 2024-08-31T05:20:50.022 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:49 smithi005 ceph-mon[18602]: last_changed 2024-08-31T05:20:42.039914+0000 2024-08-31T05:20:50.023 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:49 smithi005 ceph-mon[18602]: created 2024-08-31T05:19:01.939099+0000 2024-08-31T05:20:50.023 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:49 smithi005 ceph-mon[18602]: min_mon_release 19 (squid) 2024-08-31T05:20:50.023 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:49 smithi005 ceph-mon[18602]: election_strategy: 1 2024-08-31T05:20:50.023 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:49 smithi005 ceph-mon[18602]: 0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-31T05:20:50.023 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:49 smithi005 ceph-mon[18602]: 1: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.c 2024-08-31T05:20:50.023 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:49 smithi005 ceph-mon[18602]: 2: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.b 2024-08-31T05:20:50.023 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:49 smithi005 ceph-mon[18602]: fsmap 2024-08-31T05:20:50.023 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:49 smithi005 ceph-mon[18602]: osdmap e4: 0 total, 0 up, 0 in 2024-08-31T05:20:50.023 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:49 smithi005 ceph-mon[18602]: mgrmap e13: x(active, since 53s) 2024-08-31T05:20:50.023 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:49 smithi005 ceph-mon[18602]: overall HEALTH_OK 2024-08-31T05:20:50.023 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:49 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:50.023 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:49 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:50.023 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:49 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:50.023 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:49 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:50.024 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:49 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:50.024 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:49 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:50.024 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:49 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:50.024 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:49 smithi005 ceph-mon[18602]: Reconfiguring mon.a (monmap changed)... 2024-08-31T05:20:50.024 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:49 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T05:20:50.024 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:49 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T05:20:50.024 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:49 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:20:50.024 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:49 smithi005 ceph-mon[18602]: Reconfiguring daemon mon.a on smithi005 2024-08-31T05:20:50.041 INFO:tasks.cephadm:enabling module snap_schedule 2024-08-31T05:20:50.041 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- sudo ceph --cluster ceph mgr module enable snap_schedule 2024-08-31T05:20:50.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: mon.b calling monitor election 2024-08-31T05:20:50.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: Updating smithi005:/etc/ceph/ceph.conf 2024-08-31T05:20:50.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: Updating smithi050:/etc/ceph/ceph.conf 2024-08-31T05:20:50.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: Updating smithi070:/etc/ceph/ceph.conf 2024-08-31T05:20:50.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: Updating smithi070:/var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:20:50.158 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: Updating smithi005:/var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:20:50.158 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: Updating smithi050:/var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:20:50.158 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: mon.b calling monitor election 2024-08-31T05:20:50.158 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: mon.c calling monitor election 2024-08-31T05:20:50.158 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: mon.a calling monitor election 2024-08-31T05:20:50.158 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-08-31T05:20:50.158 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: monmap epoch 3 2024-08-31T05:20:50.158 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: fsid 69422704-6758-11ef-bcd4-c7b262605968 2024-08-31T05:20:50.158 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: last_changed 2024-08-31T05:20:42.039914+0000 2024-08-31T05:20:50.158 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: created 2024-08-31T05:19:01.939099+0000 2024-08-31T05:20:50.158 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: min_mon_release 19 (squid) 2024-08-31T05:20:50.158 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: election_strategy: 1 2024-08-31T05:20:50.158 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: 0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-08-31T05:20:50.158 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: 1: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.c 2024-08-31T05:20:50.159 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: 2: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.b 2024-08-31T05:20:50.159 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: fsmap 2024-08-31T05:20:50.159 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: osdmap e4: 0 total, 0 up, 0 in 2024-08-31T05:20:50.159 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: mgrmap e13: x(active, since 53s) 2024-08-31T05:20:50.159 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: overall HEALTH_OK 2024-08-31T05:20:50.159 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:50.159 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:50.159 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:50.159 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:50.160 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:50.160 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:50.160 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:50.160 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: Reconfiguring mon.a (monmap changed)... 2024-08-31T05:20:50.160 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T05:20:50.160 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T05:20:50.160 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:20:50.160 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:49 smithi050 ceph-mon[22146]: Reconfiguring daemon mon.a on smithi005 2024-08-31T05:20:50.824 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:20:50.943 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:50 smithi005 ceph-mon[18602]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:20:50.944 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:50 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:20:51.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:50 smithi070 ceph-mon[22316]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:20:51.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:50 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:20:51.118 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:50 smithi050 ceph-mon[22146]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:20:51.118 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:50 smithi050 ceph-mon[22146]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:20:51.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:51 smithi050 ceph-mon[22146]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:51.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:51 smithi050 ceph-mon[22146]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:51.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:51 smithi050 ceph-mon[22146]: Reconfiguring mon.b (monmap changed)... 2024-08-31T05:20:51.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:51 smithi050 ceph-mon[22146]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T05:20:51.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:51 smithi050 ceph-mon[22146]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T05:20:51.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:51 smithi050 ceph-mon[22146]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:20:51.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:51 smithi050 ceph-mon[22146]: Reconfiguring daemon mon.b on smithi050 2024-08-31T05:20:51.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:51 smithi050 ceph-mon[22146]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:51.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:51 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/1209762514' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-08-31T05:20:52.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:51 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:52.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:51 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:52.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:51 smithi070 ceph-mon[22316]: Reconfiguring mon.b (monmap changed)... 2024-08-31T05:20:52.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:51 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T05:20:52.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:51 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T05:20:52.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:51 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:20:52.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:51 smithi070 ceph-mon[22316]: Reconfiguring daemon mon.b on smithi050 2024-08-31T05:20:52.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:51 smithi070 ceph-mon[22316]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:52.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:51 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/1209762514' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-08-31T05:20:52.115 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:51 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:52.115 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:51 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:52.116 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:51 smithi005 ceph-mon[18602]: Reconfiguring mon.b (monmap changed)... 2024-08-31T05:20:52.116 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:51 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T05:20:52.116 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:51 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T05:20:52.116 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:51 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:20:52.116 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:51 smithi005 ceph-mon[18602]: Reconfiguring daemon mon.b on smithi050 2024-08-31T05:20:52.116 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:51 smithi005 ceph-mon[18602]: from='mgr.14148 172.21.15.5:0/2444205747' entity='mgr.x' 2024-08-31T05:20:52.116 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:51 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/1209762514' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-08-31T05:20:52.419 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:20:52 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: ignoring --setuser ceph since I am not root 2024-08-31T05:20:52.419 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:20:52 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: ignoring --setgroup ceph since I am not root 2024-08-31T05:20:52.690 INFO:tasks.cephadm:Adding mgr.x on smithi005 2024-08-31T05:20:52.690 INFO:tasks.cephadm:Adding mgr.y on smithi050 2024-08-31T05:20:52.691 INFO:tasks.cephadm:Adding mgr.z on smithi070 2024-08-31T05:20:52.691 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph orch apply mgr '3;smithi005=x;smithi050=y;smithi070=z' 2024-08-31T05:20:52.938 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T05:20:53.335 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:53 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/1209762514' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-08-31T05:20:53.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:53 smithi070 ceph-mon[22316]: mgrmap e14: x(active, since 56s) 2024-08-31T05:20:53.408 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:53 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/1209762514' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-08-31T05:20:53.408 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:53 smithi050 ceph-mon[22146]: mgrmap e14: x(active, since 56s) 2024-08-31T05:20:53.466 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:53 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/1209762514' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-08-31T05:20:53.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:53 smithi005 ceph-mon[18602]: mgrmap e14: x(active, since 56s) 2024-08-31T05:20:57.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:57 smithi050 ceph-mon[22146]: Active manager daemon x restarted 2024-08-31T05:20:57.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:57 smithi050 ceph-mon[22146]: Activating manager daemon x 2024-08-31T05:20:57.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:57 smithi050 ceph-mon[22146]: osdmap e5: 0 total, 0 up, 0 in 2024-08-31T05:20:57.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:57 smithi050 ceph-mon[22146]: mgrmap e15: x(active, starting, since 0.00470645s) 2024-08-31T05:20:57.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:57 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T05:20:57.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:57 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:20:57.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:57 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:20:57.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:57 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-08-31T05:20:57.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:57 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-08-31T05:20:57.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:57 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-08-31T05:20:57.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:57 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-08-31T05:20:57.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:57 smithi050 ceph-mon[22146]: Manager daemon x is now available 2024-08-31T05:20:57.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:57 smithi005 ceph-mon[18602]: Active manager daemon x restarted 2024-08-31T05:20:57.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:57 smithi005 ceph-mon[18602]: Activating manager daemon x 2024-08-31T05:20:57.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:57 smithi005 ceph-mon[18602]: osdmap e5: 0 total, 0 up, 0 in 2024-08-31T05:20:57.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:57 smithi005 ceph-mon[18602]: mgrmap e15: x(active, starting, since 0.00470645s) 2024-08-31T05:20:57.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:57 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T05:20:57.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:57 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:20:57.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:57 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:20:57.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:57 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-08-31T05:20:57.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:57 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-08-31T05:20:57.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:57 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-08-31T05:20:57.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:57 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-08-31T05:20:57.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:57 smithi005 ceph-mon[18602]: Manager daemon x is now available 2024-08-31T05:20:57.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:57 smithi070 ceph-mon[22316]: Active manager daemon x restarted 2024-08-31T05:20:57.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:57 smithi070 ceph-mon[22316]: Activating manager daemon x 2024-08-31T05:20:57.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:57 smithi070 ceph-mon[22316]: osdmap e5: 0 total, 0 up, 0 in 2024-08-31T05:20:57.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:57 smithi070 ceph-mon[22316]: mgrmap e15: x(active, starting, since 0.00470645s) 2024-08-31T05:20:57.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:57 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T05:20:57.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:57 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:20:57.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:57 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:20:57.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:57 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-08-31T05:20:57.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:57 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-08-31T05:20:57.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:57 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-08-31T05:20:57.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:57 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-08-31T05:20:57.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:57 smithi070 ceph-mon[22316]: Manager daemon x is now available 2024-08-31T05:20:58.352 INFO:teuthology.orchestra.run.smithi070.stdout:Scheduled mgr update... 2024-08-31T05:20:58.655 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:58 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:20:58.655 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:58 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-08-31T05:20:58.655 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:58 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-08-31T05:20:58.655 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:58 smithi050 ceph-mon[22146]: mgrmap e16: x(active, since 1.00947s) 2024-08-31T05:20:58.655 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:20:58 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:20:58.670 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:58 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:20:58.670 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:58 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-08-31T05:20:58.670 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:58 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-08-31T05:20:58.670 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:58 smithi005 ceph-mon[18602]: mgrmap e16: x(active, since 1.00947s) 2024-08-31T05:20:58.670 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:20:58 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:20:58.691 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:58 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:20:58.691 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:58 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-08-31T05:20:58.691 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:58 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-08-31T05:20:58.691 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:58 smithi070 ceph-mon[22316]: mgrmap e16: x(active, since 1.00947s) 2024-08-31T05:20:58.691 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:20:58 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:20:59.001 DEBUG:teuthology.orchestra.run.smithi050:mgr.y> sudo journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@mgr.y.service 2024-08-31T05:20:59.004 DEBUG:teuthology.orchestra.run.smithi070:mgr.z> sudo journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@mgr.z.service 2024-08-31T05:20:59.006 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-08-31T05:20:59.006 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph config set client client_mount_timeout 600 2024-08-31T05:20:59.009 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-08-31T05:20:59.012 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph config set client debug_client 20 2024-08-31T05:20:59.055 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-08-31T05:20:59.055 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph config set client debug_ms 1 2024-08-31T05:20:59.098 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-08-31T05:20:59.099 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph config set client rados_mon_op_timeout 900 2024-08-31T05:20:59.141 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-08-31T05:20:59.142 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph config set client rados_osd_op_timeout 900 2024-08-31T05:20:59.185 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-08-31T05:20:59.185 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph config set mds debug_mds 20 2024-08-31T05:20:59.228 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-08-31T05:20:59.228 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph config set mds debug_mds_balancer 20 2024-08-31T05:20:59.287 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-08-31T05:20:59.287 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph config set mds debug_ms 2 2024-08-31T05:20:59.338 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2024-08-31T05:20:59.339 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph config set mds mds_bal_fragment_size_max 10000 2024-08-31T05:20:59.389 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2024-08-31T05:20:59.389 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph config set mds mds_bal_merge_size 5 2024-08-31T05:20:59.390 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:20:59.433 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2024-08-31T05:20:59.433 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph config set mds mds_bal_split_bits 3 2024-08-31T05:20:59.481 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2024-08-31T05:20:59.481 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph config set mds mds_bal_split_size 100 2024-08-31T05:20:59.534 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-08-31T05:20:59.534 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph config set mds mds_debug_frag True 2024-08-31T05:20:59.579 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-08-31T05:20:59.580 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph config set mds mds_debug_scatterstat True 2024-08-31T05:20:59.629 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-08-31T05:20:59.629 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph config set mds mds_op_complaint_time 180 2024-08-31T05:20:59.684 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-08-31T05:20:59.684 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph config set mds mds_verify_scatter True 2024-08-31T05:20:59.741 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-08-31T05:20:59.741 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph config set mds osd_op_complaint_time 180 2024-08-31T05:20:59.806 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-08-31T05:20:59.806 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph config set mds rados_mon_op_timeout 900 2024-08-31T05:20:59.850 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-08-31T05:20:59.850 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph config set mds rados_osd_op_timeout 900 2024-08-31T05:20:59.905 INFO:tasks.cephadm:setting config [mgr] debug_cephsqlite = 20 2024-08-31T05:20:59.905 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph config set mgr debug_cephsqlite 20 2024-08-31T05:20:59.957 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/allow_m_granularity = True 2024-08-31T05:20:59.958 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2024-08-31T05:21:00.015 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/dump_on_update = True 2024-08-31T05:21:00.015 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph config set mgr mgr/snap_schedule/dump_on_update True 2024-08-31T05:21:00.066 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/log_level = debug 2024-08-31T05:21:00.066 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph config set mgr mgr/snap_schedule/log_level debug 2024-08-31T05:21:00.106 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:21:00.108 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-08-31T05:21:00.108 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph config set mon mon_op_complaint_time 120 2024-08-31T05:21:00.159 INFO:tasks.cephadm:setting config [mon] mon_warn_on_pool_no_app = False 2024-08-31T05:21:00.159 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph config set mon mon_warn_on_pool_no_app False 2024-08-31T05:21:00.212 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-08-31T05:21:00.213 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph config set osd osd_op_complaint_time 180 2024-08-31T05:21:00.213 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:00 smithi005 ceph-mon[18602]: Saving service mgr spec with placement smithi005=x;smithi050=y;smithi070=z;count:3 2024-08-31T05:21:00.214 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:00 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:00.214 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:00 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:00.214 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:00 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:00.214 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:00 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:00.214 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:00 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:00.214 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:00 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:00.214 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:00 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi050", "name": "osd_memory_target"} : dispatch 2024-08-31T05:21:00.214 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:00 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:00.214 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:00 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:00.302 DEBUG:tasks.cephadm:set 26 configs 2024-08-31T05:21:00.302 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '69422704-6758-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi005') 2024-08-31T05:21:00.303 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:21:00.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:00 smithi070 ceph-mon[22316]: Saving service mgr spec with placement smithi005=x;smithi050=y;smithi070=z;count:3 2024-08-31T05:21:00.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:00 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:00.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:00 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:00.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:00 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:00.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:00 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:00.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:00 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:00.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:00 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:00.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:00 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi050", "name": "osd_memory_target"} : dispatch 2024-08-31T05:21:00.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:00 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:00.337 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:00 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:00.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:00 smithi050 ceph-mon[22146]: Saving service mgr spec with placement smithi005=x;smithi050=y;smithi070=z;count:3 2024-08-31T05:21:00.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:00 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:00.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:00 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:00.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:00 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:00.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:00 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:00.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:00 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:00.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:00 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:00.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:00 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi050", "name": "osd_memory_target"} : dispatch 2024-08-31T05:21:00.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:00 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:00.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:00 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:01.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:01 smithi050 ceph-mon[22146]: mgrmap e17: x(active, since 2s) 2024-08-31T05:21:01.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:01 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:01.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:01 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:01.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:01 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi070", "name": "osd_memory_target"} : dispatch 2024-08-31T05:21:01.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:01 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/3603096708' entity='client.admin' 2024-08-31T05:21:01.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:01 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:01.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:01 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:01.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:01 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi005", "name": "osd_memory_target"} : dispatch 2024-08-31T05:21:01.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:01 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:21:01.408 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:01 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:21:01.469 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:01 smithi005 ceph-mon[18602]: mgrmap e17: x(active, since 2s) 2024-08-31T05:21:01.469 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:01 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:01.469 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:01 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:01.469 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:01 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi070", "name": "osd_memory_target"} : dispatch 2024-08-31T05:21:01.469 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:01 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/3603096708' entity='client.admin' 2024-08-31T05:21:01.469 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:01 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:01.469 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:01 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:01.469 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:01 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi005", "name": "osd_memory_target"} : dispatch 2024-08-31T05:21:01.469 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:01 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:21:01.469 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:01 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:21:01.470 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:21:01 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: 2024-08-31T05:21:01.171+0000 7f5d7a9ef640 -1 log_channel(cephadm) log [ERR] : [31/Aug/2024:05:21:01] ENGINE Error in HTTPServer.serve 2024-08-31T05:21:01.470 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:21:01 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: Traceback (most recent call last): 2024-08-31T05:21:01.470 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:21:01 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T05:21:01.470 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:21:01 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: self._connections.run(self.expiration_interval) 2024-08-31T05:21:01.470 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:21:01 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T05:21:01.470 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:21:01 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: self._run(expiration_interval) 2024-08-31T05:21:01.470 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:21:01 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T05:21:01.470 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:21:01 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T05:21:01.470 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:21:01 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T05:21:01.470 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:21:01 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T05:21:01.471 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:21:01 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T05:21:01.471 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:21:01 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: s = self.context.wrap_socket( 2024-08-31T05:21:01.471 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:21:01 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T05:21:01.471 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:21:01 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: return self.sslsocket_class._create( 2024-08-31T05:21:01.471 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:21:01 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T05:21:01.471 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:21:01 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: self.do_handshake() 2024-08-31T05:21:01.471 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:21:01 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T05:21:01.471 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:21:01 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: self._sslobj.do_handshake() 2024-08-31T05:21:01.471 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:21:01 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T05:21:01.471 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:21:01 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: 2024-08-31T05:21:01.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:01 smithi070 ceph-mon[22316]: mgrmap e17: x(active, since 2s) 2024-08-31T05:21:01.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:01 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:01.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:01 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:01.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:01 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi070", "name": "osd_memory_target"} : dispatch 2024-08-31T05:21:01.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:01 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/3603096708' entity='client.admin' 2024-08-31T05:21:01.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:01 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:01.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:01 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:01.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:01 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi005", "name": "osd_memory_target"} : dispatch 2024-08-31T05:21:01.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:01 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:21:01.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:01 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:21:01.819 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '69422704-6758-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi005') 2024-08-31T05:21:02.400 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:02 smithi005 ceph-mon[18602]: [31/Aug/2024:05:21:00] ENGINE Bus STARTING 2024-08-31T05:21:02.401 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:02 smithi005 ceph-mon[18602]: Updating smithi005:/etc/ceph/ceph.conf 2024-08-31T05:21:02.401 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:02 smithi005 ceph-mon[18602]: Updating smithi050:/etc/ceph/ceph.conf 2024-08-31T05:21:02.401 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:02 smithi005 ceph-mon[18602]: Updating smithi070:/etc/ceph/ceph.conf 2024-08-31T05:21:02.401 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:02 smithi005 ceph-mon[18602]: [31/Aug/2024:05:21:01] ENGINE Serving on http://172.21.15.5:8765 2024-08-31T05:21:02.401 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:02 smithi005 ceph-mon[18602]: [31/Aug/2024:05:21:01] ENGINE Serving on https://172.21.15.5:7150 2024-08-31T05:21:02.401 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:02 smithi005 ceph-mon[18602]: [31/Aug/2024:05:21:01] ENGINE Bus STARTED 2024-08-31T05:21:02.401 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:02 smithi005 ceph-mon[18602]: [31/Aug/2024:05:21:01] ENGINE Error in HTTPServer.serve 2024-08-31T05:21:02.401 INFO:journalctl@ceph.mon.a.smithi005.stdout: Traceback (most recent call last): 2024-08-31T05:21:02.401 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T05:21:02.401 INFO:journalctl@ceph.mon.a.smithi005.stdout: self._connections.run(self.expiration_interval) 2024-08-31T05:21:02.401 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T05:21:02.401 INFO:journalctl@ceph.mon.a.smithi005.stdout: self._run(expiration_interval) 2024-08-31T05:21:02.401 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T05:21:02.402 INFO:journalctl@ceph.mon.a.smithi005.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T05:21:02.402 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T05:21:02.402 INFO:journalctl@ceph.mon.a.smithi005.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T05:21:02.402 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T05:21:02.402 INFO:journalctl@ceph.mon.a.smithi005.stdout: s = self.context.wrap_socket( 2024-08-31T05:21:02.402 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T05:21:02.402 INFO:journalctl@ceph.mon.a.smithi005.stdout: return self.sslsocket_class._create( 2024-08-31T05:21:02.402 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T05:21:02.402 INFO:journalctl@ceph.mon.a.smithi005.stdout: self.do_handshake() 2024-08-31T05:21:02.402 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T05:21:02.402 INFO:journalctl@ceph.mon.a.smithi005.stdout: self._sslobj.do_handshake() 2024-08-31T05:21:02.402 INFO:journalctl@ceph.mon.a.smithi005.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T05:21:02.402 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:02 smithi005 ceph-mon[18602]: from='client.? ' entity='client.admin' 2024-08-31T05:21:02.402 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:02 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:02.403 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:02 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:02.403 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:02 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:02.403 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:02 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:02.403 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:02 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:02.403 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:02 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:02.403 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:02 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:02.403 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:02 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-31T05:21:02.403 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:02 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-31T05:21:02.403 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:02 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-31T05:21:02.403 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:02 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:21:02.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:02 smithi050 ceph-mon[22146]: [31/Aug/2024:05:21:00] ENGINE Bus STARTING 2024-08-31T05:21:02.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:02 smithi050 ceph-mon[22146]: Updating smithi005:/etc/ceph/ceph.conf 2024-08-31T05:21:02.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:02 smithi050 ceph-mon[22146]: Updating smithi050:/etc/ceph/ceph.conf 2024-08-31T05:21:02.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:02 smithi050 ceph-mon[22146]: Updating smithi070:/etc/ceph/ceph.conf 2024-08-31T05:21:02.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:02 smithi050 ceph-mon[22146]: [31/Aug/2024:05:21:01] ENGINE Serving on http://172.21.15.5:8765 2024-08-31T05:21:02.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:02 smithi050 ceph-mon[22146]: [31/Aug/2024:05:21:01] ENGINE Serving on https://172.21.15.5:7150 2024-08-31T05:21:02.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:02 smithi050 ceph-mon[22146]: [31/Aug/2024:05:21:01] ENGINE Bus STARTED 2024-08-31T05:21:02.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:02 smithi050 ceph-mon[22146]: [31/Aug/2024:05:21:01] ENGINE Error in HTTPServer.serve 2024-08-31T05:21:02.407 INFO:journalctl@ceph.mon.b.smithi050.stdout: Traceback (most recent call last): 2024-08-31T05:21:02.407 INFO:journalctl@ceph.mon.b.smithi050.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T05:21:02.407 INFO:journalctl@ceph.mon.b.smithi050.stdout: self._connections.run(self.expiration_interval) 2024-08-31T05:21:02.408 INFO:journalctl@ceph.mon.b.smithi050.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T05:21:02.408 INFO:journalctl@ceph.mon.b.smithi050.stdout: self._run(expiration_interval) 2024-08-31T05:21:02.408 INFO:journalctl@ceph.mon.b.smithi050.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T05:21:02.408 INFO:journalctl@ceph.mon.b.smithi050.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T05:21:02.408 INFO:journalctl@ceph.mon.b.smithi050.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T05:21:02.408 INFO:journalctl@ceph.mon.b.smithi050.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T05:21:02.408 INFO:journalctl@ceph.mon.b.smithi050.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T05:21:02.408 INFO:journalctl@ceph.mon.b.smithi050.stdout: s = self.context.wrap_socket( 2024-08-31T05:21:02.408 INFO:journalctl@ceph.mon.b.smithi050.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T05:21:02.408 INFO:journalctl@ceph.mon.b.smithi050.stdout: return self.sslsocket_class._create( 2024-08-31T05:21:02.408 INFO:journalctl@ceph.mon.b.smithi050.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T05:21:02.408 INFO:journalctl@ceph.mon.b.smithi050.stdout: self.do_handshake() 2024-08-31T05:21:02.408 INFO:journalctl@ceph.mon.b.smithi050.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T05:21:02.409 INFO:journalctl@ceph.mon.b.smithi050.stdout: self._sslobj.do_handshake() 2024-08-31T05:21:02.409 INFO:journalctl@ceph.mon.b.smithi050.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T05:21:02.409 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:02 smithi050 ceph-mon[22146]: from='client.? ' entity='client.admin' 2024-08-31T05:21:02.409 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:02 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:02.409 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:02 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:02.409 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:02 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:02.409 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:02 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:02.409 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:02 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:02.409 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:02 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:02.409 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:02 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:02.409 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:02 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-31T05:21:02.409 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:02 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-31T05:21:02.409 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:02 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-31T05:21:02.409 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:02 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:21:02.423 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:02 smithi070 ceph-mon[22316]: [31/Aug/2024:05:21:00] ENGINE Bus STARTING 2024-08-31T05:21:02.423 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:02 smithi070 ceph-mon[22316]: Updating smithi005:/etc/ceph/ceph.conf 2024-08-31T05:21:02.424 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:02 smithi070 ceph-mon[22316]: Updating smithi050:/etc/ceph/ceph.conf 2024-08-31T05:21:02.424 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:02 smithi070 ceph-mon[22316]: Updating smithi070:/etc/ceph/ceph.conf 2024-08-31T05:21:02.424 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:02 smithi070 ceph-mon[22316]: [31/Aug/2024:05:21:01] ENGINE Serving on http://172.21.15.5:8765 2024-08-31T05:21:02.424 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:02 smithi070 ceph-mon[22316]: [31/Aug/2024:05:21:01] ENGINE Serving on https://172.21.15.5:7150 2024-08-31T05:21:02.424 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:02 smithi070 ceph-mon[22316]: [31/Aug/2024:05:21:01] ENGINE Bus STARTED 2024-08-31T05:21:02.424 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:02 smithi070 ceph-mon[22316]: [31/Aug/2024:05:21:01] ENGINE Error in HTTPServer.serve 2024-08-31T05:21:02.424 INFO:journalctl@ceph.mon.c.smithi070.stdout: Traceback (most recent call last): 2024-08-31T05:21:02.424 INFO:journalctl@ceph.mon.c.smithi070.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T05:21:02.424 INFO:journalctl@ceph.mon.c.smithi070.stdout: self._connections.run(self.expiration_interval) 2024-08-31T05:21:02.424 INFO:journalctl@ceph.mon.c.smithi070.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T05:21:02.424 INFO:journalctl@ceph.mon.c.smithi070.stdout: self._run(expiration_interval) 2024-08-31T05:21:02.424 INFO:journalctl@ceph.mon.c.smithi070.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T05:21:02.424 INFO:journalctl@ceph.mon.c.smithi070.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T05:21:02.424 INFO:journalctl@ceph.mon.c.smithi070.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T05:21:02.425 INFO:journalctl@ceph.mon.c.smithi070.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T05:21:02.425 INFO:journalctl@ceph.mon.c.smithi070.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T05:21:02.425 INFO:journalctl@ceph.mon.c.smithi070.stdout: s = self.context.wrap_socket( 2024-08-31T05:21:02.425 INFO:journalctl@ceph.mon.c.smithi070.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T05:21:02.425 INFO:journalctl@ceph.mon.c.smithi070.stdout: return self.sslsocket_class._create( 2024-08-31T05:21:02.425 INFO:journalctl@ceph.mon.c.smithi070.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T05:21:02.425 INFO:journalctl@ceph.mon.c.smithi070.stdout: self.do_handshake() 2024-08-31T05:21:02.425 INFO:journalctl@ceph.mon.c.smithi070.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T05:21:02.425 INFO:journalctl@ceph.mon.c.smithi070.stdout: self._sslobj.do_handshake() 2024-08-31T05:21:02.425 INFO:journalctl@ceph.mon.c.smithi070.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T05:21:02.425 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:02 smithi070 ceph-mon[22316]: from='client.? ' entity='client.admin' 2024-08-31T05:21:02.425 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:02 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:02.425 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:02 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:02.426 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:02 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:02.426 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:02 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:02.426 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:02 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:02.426 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:02 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:02.426 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:02 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:02.426 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:02 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-31T05:21:02.426 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:02 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-31T05:21:02.426 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:02 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-31T05:21:02.426 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:02 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:21:02.431 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '69422704-6758-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi005') 2024-08-31T05:21:02.609 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:21:02.609 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:21:02.617 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:21:02.818 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:21:02.820 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:21:02.820 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:21:02.828 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:21:02.847 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:21:02.859 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:21:03.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:03.109+0000 7f2856862640 1 -- 172.21.15.5:0/1449366786 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f283c03f320 msgr2=0x7f283c041830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:03.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:03.109+0000 7f2856862640 1 --2- 172.21.15.5:0/1449366786 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f283c03f320 0x7f283c041830 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2840006010 tx=0x7f2840000bc0 comp rx=0 tx=0).stop 2024-08-31T05:21:03.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:03.109+0000 7f2856862640 1 -- 172.21.15.5:0/1449366786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2850116110 msgr2=0x7f285011b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:03.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:03.109+0000 7f2856862640 1 --2- 172.21.15.5:0/1449366786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2850116110 0x7f285011b030 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f284800bd60 tx=0x7f284800be50 comp rx=0 tx=0).stop 2024-08-31T05:21:03.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:03.109+0000 7f2856862640 1 -- 172.21.15.5:0/1449366786 shutdown_connections 2024-08-31T05:21:03.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:03.109+0000 7f2856862640 1 --2- 172.21.15.5:0/1449366786 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f283c03f320 0x7f283c041830 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:03.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:03.109+0000 7f2856862640 1 --2- 172.21.15.5:0/1449366786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2850116110 0x7f285011b030 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:03.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:03.109+0000 7f2856862640 1 --2- 172.21.15.5:0/1449366786 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f285011c940 0x7f2850115bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:03.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:03.109+0000 7f2856862640 1 --2- 172.21.15.5:0/1449366786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f285010d990 0x7f2850115690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:03.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:03.109+0000 7f2856862640 1 -- 172.21.15.5:0/1449366786 >> 172.21.15.5:0/1449366786 conn(0x7f285006e790 msgr2=0x7f285010c420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:03.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:03.109+0000 7f2856862640 1 -- 172.21.15.5:0/1449366786 shutdown_connections 2024-08-31T05:21:03.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:03.109+0000 7f2856862640 1 -- 172.21.15.5:0/1449366786 wait complete. 2024-08-31T05:21:03.361 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:03 smithi070 ceph-mon[22316]: Updating smithi005:/var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:21:03.361 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:03 smithi070 ceph-mon[22316]: Updating smithi070:/var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:21:03.361 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:03 smithi070 ceph-mon[22316]: Updating smithi050:/var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:21:03.361 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:03 smithi070 ceph-mon[22316]: Updating smithi005:/etc/ceph/ceph.client.admin.keyring 2024-08-31T05:21:03.361 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:03 smithi070 ceph-mon[22316]: Updating smithi070:/etc/ceph/ceph.client.admin.keyring 2024-08-31T05:21:03.361 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:03 smithi070 ceph-mon[22316]: Updating smithi050:/etc/ceph/ceph.client.admin.keyring 2024-08-31T05:21:03.361 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:03 smithi070 ceph-mon[22316]: Updating smithi005:/var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T05:21:03.361 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:03 smithi070 ceph-mon[22316]: Updating smithi070:/var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T05:21:03.361 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:03 smithi070 ceph-mon[22316]: Updating smithi050:/var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T05:21:03.361 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:03 smithi070 ceph-mon[22316]: Deploying daemon mgr.z on smithi070 2024-08-31T05:21:03.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:03 smithi050 ceph-mon[22146]: Updating smithi005:/var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:21:03.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:03 smithi050 ceph-mon[22146]: Updating smithi070:/var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:21:03.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:03 smithi050 ceph-mon[22146]: Updating smithi050:/var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:21:03.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:03 smithi050 ceph-mon[22146]: Updating smithi005:/etc/ceph/ceph.client.admin.keyring 2024-08-31T05:21:03.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:03 smithi050 ceph-mon[22146]: Updating smithi070:/etc/ceph/ceph.client.admin.keyring 2024-08-31T05:21:03.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:03 smithi050 ceph-mon[22146]: Updating smithi050:/etc/ceph/ceph.client.admin.keyring 2024-08-31T05:21:03.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:03 smithi050 ceph-mon[22146]: Updating smithi005:/var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T05:21:03.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:03 smithi050 ceph-mon[22146]: Updating smithi070:/var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T05:21:03.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:03 smithi050 ceph-mon[22146]: Updating smithi050:/var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T05:21:03.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:03 smithi050 ceph-mon[22146]: Deploying daemon mgr.z on smithi070 2024-08-31T05:21:03.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:03 smithi005 ceph-mon[18602]: Updating smithi005:/var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:21:03.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:03 smithi005 ceph-mon[18602]: Updating smithi070:/var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:21:03.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:03 smithi005 ceph-mon[18602]: Updating smithi050:/var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T05:21:03.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:03 smithi005 ceph-mon[18602]: Updating smithi005:/etc/ceph/ceph.client.admin.keyring 2024-08-31T05:21:03.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:03 smithi005 ceph-mon[18602]: Updating smithi070:/etc/ceph/ceph.client.admin.keyring 2024-08-31T05:21:03.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:03 smithi005 ceph-mon[18602]: Updating smithi050:/etc/ceph/ceph.client.admin.keyring 2024-08-31T05:21:03.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:03 smithi005 ceph-mon[18602]: Updating smithi005:/var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T05:21:03.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:03 smithi005 ceph-mon[18602]: Updating smithi070:/var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T05:21:03.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:03 smithi005 ceph-mon[18602]: Updating smithi050:/var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T05:21:03.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:03 smithi005 ceph-mon[18602]: Deploying daemon mgr.z on smithi070 2024-08-31T05:21:03.774 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '69422704-6758-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi005') 2024-08-31T05:21:03.780 INFO:journalctl@ceph.mgr.z.smithi070.stdout:Aug 31 05:21:03 smithi070 systemd[1]: Starting Ceph mgr.z for 69422704-6758-11ef-bcd4-c7b262605968... 2024-08-31T05:21:04.086 INFO:journalctl@ceph.mgr.z.smithi070.stdout:Aug 31 05:21:03 smithi070 podman[24939]: 2024-08-31 05:21:03.681680467 +0000 UTC m=+0.015368828 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T05:21:04.086 INFO:journalctl@ceph.mgr.z.smithi070.stdout:Aug 31 05:21:03 smithi070 podman[24939]: 2024-08-31 05:21:03.872052043 +0000 UTC m=+0.205740402 container create ffd858e28eb8f6df4eea652be7c5932a650fb936b3405711265ee5d8b6e12c3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-08-31T05:21:04.344 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:04 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/1449366786' entity='client.admin' 2024-08-31T05:21:04.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.348+0000 7fd3222a8640 1 -- 172.21.15.5:0/1406374568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd31c108140 msgr2=0x7fd31c108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:04.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.348+0000 7fd3222a8640 1 --2- 172.21.15.5:0/1406374568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd31c108140 0x7fd31c108550 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd310009900 tx=0x7fd31002a410 comp rx=0 tx=0).stop 2024-08-31T05:21:04.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.348+0000 7fd3222a8640 1 -- 172.21.15.5:0/1406374568 shutdown_connections 2024-08-31T05:21:04.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.348+0000 7fd3222a8640 1 --2- 172.21.15.5:0/1406374568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd31c108a90 0x7fd31c10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:04.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.348+0000 7fd3222a8640 1 --2- 172.21.15.5:0/1406374568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd31c108140 0x7fd31c108550 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:04.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.348+0000 7fd3222a8640 1 --2- 172.21.15.5:0/1406374568 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd31c102800 0x7fd31c102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:04.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.348+0000 7fd3222a8640 1 -- 172.21.15.5:0/1406374568 >> 172.21.15.5:0/1406374568 conn(0x7fd31c0794d0 msgr2=0x7fd31c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:04.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.348+0000 7fd3222a8640 1 -- 172.21.15.5:0/1406374568 shutdown_connections 2024-08-31T05:21:04.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.348+0000 7fd3222a8640 1 -- 172.21.15.5:0/1406374568 wait complete. 2024-08-31T05:21:04.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.348+0000 7fd3222a8640 1 Processor -- start 2024-08-31T05:21:04.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.348+0000 7fd3222a8640 1 -- start start 2024-08-31T05:21:04.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.349+0000 7fd3222a8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd31c102800 0x7fd31c19a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:04.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.349+0000 7fd3222a8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd31c108140 0x7fd31c19a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:04.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.349+0000 7fd3222a8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd31c108a90 0x7fd31c19f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:04.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.349+0000 7fd3222a8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd31c112490 con 0x7fd31c108a90 2024-08-31T05:21:04.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.349+0000 7fd3222a8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd31c112310 con 0x7fd31c108140 2024-08-31T05:21:04.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.349+0000 7fd3222a8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd31c112610 con 0x7fd31c102800 2024-08-31T05:21:04.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.349+0000 7fd320845640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd31c108a90 0x7fd31c19f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:04.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.349+0000 7fd320845640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd31c108a90 0x7fd31c19f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45636/0 (socket says 172.21.15.5:45636) 2024-08-31T05:21:04.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.349+0000 7fd320845640 1 -- 172.21.15.5:0/673718668 learned_addr learned my addr 172.21.15.5:0/673718668 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:21:04.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.349+0000 7fd31bfff640 1 --2- 172.21.15.5:0/673718668 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd31c102800 0x7fd31c19a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:04.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.349+0000 7fd31b7fe640 1 --2- 172.21.15.5:0/673718668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd31c108140 0x7fd31c19a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:04.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.350+0000 7fd320845640 1 -- 172.21.15.5:0/673718668 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd31c102800 msgr2=0x7fd31c19a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:04.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.350+0000 7fd320845640 1 --2- 172.21.15.5:0/673718668 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd31c102800 0x7fd31c19a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:04.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.350+0000 7fd320845640 1 -- 172.21.15.5:0/673718668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd31c108140 msgr2=0x7fd31c19a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:04.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.350+0000 7fd320845640 1 --2- 172.21.15.5:0/673718668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd31c108140 0x7fd31c19a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:04.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.350+0000 7fd320845640 1 -- 172.21.15.5:0/673718668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd31c19ffc0 con 0x7fd31c108a90 2024-08-31T05:21:04.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.350+0000 7fd31bfff640 1 --2- 172.21.15.5:0/673718668 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd31c102800 0x7fd31c19a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:21:04.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.350+0000 7fd320845640 1 --2- 172.21.15.5:0/673718668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd31c108a90 0x7fd31c19f890 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd31400cad0 tx=0x7fd31400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:04.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.350+0000 7fd3197fa640 1 -- 172.21.15.5:0/673718668 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd31400ae20 con 0x7fd31c108a90 2024-08-31T05:21:04.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.350+0000 7fd3197fa640 1 -- 172.21.15.5:0/673718668 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7fd314005020 con 0x7fd31c108a90 2024-08-31T05:21:04.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.350+0000 7fd3197fa640 1 -- 172.21.15.5:0/673718668 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd31400f6b0 con 0x7fd31c108a90 2024-08-31T05:21:04.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.350+0000 7fd3222a8640 1 -- 172.21.15.5:0/673718668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd31c1a02b0 con 0x7fd31c108a90 2024-08-31T05:21:04.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.350+0000 7fd3222a8640 1 -- 172.21.15.5:0/673718668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd31c0ff2f0 con 0x7fd31c108a90 2024-08-31T05:21:04.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.351+0000 7fd3222a8640 1 -- 172.21.15.5:0/673718668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd31c103a80 con 0x7fd31c108a90 2024-08-31T05:21:04.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.351+0000 7fd3197fa640 1 -- 172.21.15.5:0/673718668 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 51269+0+0 (secure 0 0 0) 0x7fd31400f850 con 0x7fd31c108a90 2024-08-31T05:21:04.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.352+0000 7fd3197fa640 1 --2- 172.21.15.5:0/673718668 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd30403f2d0 0x7fd3040417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:04.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.352+0000 7fd3197fa640 1 -- 172.21.15.5:0/673718668 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fd314053ad0 con 0x7fd31c108a90 2024-08-31T05:21:04.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.352+0000 7fd31bfff640 1 --2- 172.21.15.5:0/673718668 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd30403f2d0 0x7fd3040417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:04.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.352+0000 7fd31bfff640 1 --2- 172.21.15.5:0/673718668 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd30403f2d0 0x7fd3040417e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd30c009690 tx=0x7fd30c00f7a0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:04.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.357+0000 7fd3197fa640 1 -- 172.21.15.5:0/673718668 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd314014030 con 0x7fd31c108a90 2024-08-31T05:21:04.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:04 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/1449366786' entity='client.admin' 2024-08-31T05:21:04.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.547+0000 7fd3222a8640 1 -- 172.21.15.5:0/673718668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7fd31c10b890 con 0x7fd31c108a90 2024-08-31T05:21:04.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.550+0000 7fd3197fa640 1 -- 172.21.15.5:0/673718668 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v13)=0 v13) ==== 116+0+0 (secure 0 0 0) 0x7fd314020350 con 0x7fd31c108a90 2024-08-31T05:21:04.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.553+0000 7fd3222a8640 1 -- 172.21.15.5:0/673718668 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd30403f2d0 msgr2=0x7fd3040417e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:04.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.553+0000 7fd3222a8640 1 --2- 172.21.15.5:0/673718668 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd30403f2d0 0x7fd3040417e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd30c009690 tx=0x7fd30c00f7a0 comp rx=0 tx=0).stop 2024-08-31T05:21:04.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.553+0000 7fd3222a8640 1 -- 172.21.15.5:0/673718668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd31c108a90 msgr2=0x7fd31c19f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:04.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.553+0000 7fd3222a8640 1 --2- 172.21.15.5:0/673718668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd31c108a90 0x7fd31c19f890 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd31400cad0 tx=0x7fd31400cf90 comp rx=0 tx=0).stop 2024-08-31T05:21:04.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.553+0000 7fd3222a8640 1 -- 172.21.15.5:0/673718668 shutdown_connections 2024-08-31T05:21:04.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.553+0000 7fd3222a8640 1 --2- 172.21.15.5:0/673718668 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd30403f2d0 0x7fd3040417e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:04.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.553+0000 7fd3222a8640 1 --2- 172.21.15.5:0/673718668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd31c108a90 0x7fd31c19f890 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:04.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.553+0000 7fd3222a8640 1 --2- 172.21.15.5:0/673718668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd31c108140 0x7fd31c19a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:04.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.553+0000 7fd3222a8640 1 --2- 172.21.15.5:0/673718668 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd31c102800 0x7fd31c19a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:04.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.553+0000 7fd3222a8640 1 -- 172.21.15.5:0/673718668 >> 172.21.15.5:0/673718668 conn(0x7fd31c0794d0 msgr2=0x7fd31c06b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:04.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.553+0000 7fd3222a8640 1 -- 172.21.15.5:0/673718668 shutdown_connections 2024-08-31T05:21:04.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.553+0000 7fd3222a8640 1 -- 172.21.15.5:0/673718668 wait complete. 2024-08-31T05:21:04.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:04 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/1449366786' entity='client.admin' 2024-08-31T05:21:04.586 INFO:journalctl@ceph.mgr.z.smithi070.stdout:Aug 31 05:21:04 smithi070 podman[24939]: 2024-08-31 05:21:04.204194014 +0000 UTC m=+0.537882383 container init ffd858e28eb8f6df4eea652be7c5932a650fb936b3405711265ee5d8b6e12c3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-z, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-08-31T05:21:04.586 INFO:journalctl@ceph.mgr.z.smithi070.stdout:Aug 31 05:21:04 smithi070 podman[24939]: 2024-08-31 05:21:04.207017395 +0000 UTC m=+0.540705757 container start ffd858e28eb8f6df4eea652be7c5932a650fb936b3405711265ee5d8b6e12c3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-z, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.build-date=20240731) 2024-08-31T05:21:04.586 INFO:journalctl@ceph.mgr.z.smithi070.stdout:Aug 31 05:21:04 smithi070 ceph-mgr[24959]: -- 172.21.15.70:0/1173685066 <== mon.1 v2:172.21.15.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557df39df0e0 con 0x557df39fda80 2024-08-31T05:21:04.586 INFO:journalctl@ceph.mgr.z.smithi070.stdout:Aug 31 05:21:04 smithi070 bash[24939]: ffd858e28eb8f6df4eea652be7c5932a650fb936b3405711265ee5d8b6e12c3d 2024-08-31T05:21:04.586 INFO:journalctl@ceph.mgr.z.smithi070.stdout:Aug 31 05:21:04 smithi070 systemd[1]: Started Ceph mgr.z for 69422704-6758-11ef-bcd4-c7b262605968. 2024-08-31T05:21:05.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.002+0000 7f9e41883640 1 -- 172.21.15.5:0/1868718745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e3c108a90 msgr2=0x7f9e3c10f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:05.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.002+0000 7f9e41883640 1 --2- 172.21.15.5:0/1868718745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e3c108a90 0x7f9e3c10f2c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9e34009ca0 tx=0x7f9e3402a8c0 comp rx=0 tx=0).stop 2024-08-31T05:21:05.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.002+0000 7f9e41883640 1 -- 172.21.15.5:0/1868718745 shutdown_connections 2024-08-31T05:21:05.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.002+0000 7f9e41883640 1 --2- 172.21.15.5:0/1868718745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e3c108a90 0x7f9e3c10f2c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:05.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.002+0000 7f9e41883640 1 --2- 172.21.15.5:0/1868718745 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e3c108140 0x7f9e3c108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:05.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.002+0000 7f9e41883640 1 --2- 172.21.15.5:0/1868718745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e3c102800 0x7f9e3c102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:05.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.002+0000 7f9e41883640 1 -- 172.21.15.5:0/1868718745 >> 172.21.15.5:0/1868718745 conn(0x7f9e3c0794d0 msgr2=0x7f9e3c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:05.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.002+0000 7f9e41883640 1 -- 172.21.15.5:0/1868718745 shutdown_connections 2024-08-31T05:21:05.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.002+0000 7f9e41883640 1 -- 172.21.15.5:0/1868718745 wait complete. 2024-08-31T05:21:05.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.003+0000 7f9e41883640 1 Processor -- start 2024-08-31T05:21:05.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.003+0000 7f9e41883640 1 -- start start 2024-08-31T05:21:05.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.003+0000 7f9e41883640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e3c102800 0x7f9e3c199020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:05.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.003+0000 7f9e41883640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e3c108140 0x7f9e3c1995c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:05.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.003+0000 7f9e41883640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e3c108a90 0x7f9e3c19e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:05.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.003+0000 7f9e41883640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9e3c1125b0 con 0x7f9e3c108140 2024-08-31T05:21:05.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.003+0000 7f9e41883640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9e3c112430 con 0x7f9e3c108a90 2024-08-31T05:21:05.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.003+0000 7f9e41883640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9e3c112730 con 0x7f9e3c102800 2024-08-31T05:21:05.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.003+0000 7f9e3a7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e3c108140 0x7f9e3c1995c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:05.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.003+0000 7f9e3a7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e3c108140 0x7f9e3c1995c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45676/0 (socket says 172.21.15.5:45676) 2024-08-31T05:21:05.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.003+0000 7f9e3a7fc640 1 -- 172.21.15.5:0/254231760 learned_addr learned my addr 172.21.15.5:0/254231760 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:21:05.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.003+0000 7f9e3affd640 1 --2- 172.21.15.5:0/254231760 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e3c102800 0x7f9e3c199020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:05.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.004+0000 7f9e3b7fe640 1 --2- 172.21.15.5:0/254231760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e3c108a90 0x7f9e3c19e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:05.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.004+0000 7f9e3a7fc640 1 -- 172.21.15.5:0/254231760 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e3c102800 msgr2=0x7f9e3c199020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:05.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.004+0000 7f9e3a7fc640 1 --2- 172.21.15.5:0/254231760 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e3c102800 0x7f9e3c199020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:05.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.004+0000 7f9e3a7fc640 1 -- 172.21.15.5:0/254231760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e3c108a90 msgr2=0x7f9e3c19e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:05.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.004+0000 7f9e3a7fc640 1 --2- 172.21.15.5:0/254231760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e3c108a90 0x7f9e3c19e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:05.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.004+0000 7f9e3a7fc640 1 -- 172.21.15.5:0/254231760 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e3c19ef90 con 0x7f9e3c108140 2024-08-31T05:21:05.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.004+0000 7f9e3b7fe640 1 --2- 172.21.15.5:0/254231760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e3c108a90 0x7f9e3c19e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:21:05.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.004+0000 7f9e3a7fc640 1 --2- 172.21.15.5:0/254231760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e3c108140 0x7f9e3c1995c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9e30005fd0 tx=0x7f9e3000dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:05.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.004+0000 7f9e40881640 1 -- 172.21.15.5:0/254231760 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e30017070 con 0x7f9e3c108140 2024-08-31T05:21:05.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.004+0000 7f9e40881640 1 -- 172.21.15.5:0/254231760 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f9e30009c30 con 0x7f9e3c108140 2024-08-31T05:21:05.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.004+0000 7f9e41883640 1 -- 172.21.15.5:0/254231760 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e3c19f280 con 0x7f9e3c108140 2024-08-31T05:21:05.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.004+0000 7f9e40881640 1 -- 172.21.15.5:0/254231760 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e30003c80 con 0x7f9e3c108140 2024-08-31T05:21:05.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.004+0000 7f9e41883640 1 -- 172.21.15.5:0/254231760 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e3c1a59e0 con 0x7f9e3c108140 2024-08-31T05:21:05.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.005+0000 7f9e41883640 1 -- 172.21.15.5:0/254231760 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e3c102c10 con 0x7f9e3c108140 2024-08-31T05:21:05.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.005+0000 7f9e40881640 1 -- 172.21.15.5:0/254231760 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 51269+0+0 (secure 0 0 0) 0x7f9e30010460 con 0x7f9e3c108140 2024-08-31T05:21:05.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.005+0000 7f9e40881640 1 --2- 172.21.15.5:0/254231760 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9e2403f2d0 0x7f9e240417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:05.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.005+0000 7f9e40881640 1 -- 172.21.15.5:0/254231760 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f9e30053690 con 0x7f9e3c108140 2024-08-31T05:21:05.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.006+0000 7f9e3affd640 1 --2- 172.21.15.5:0/254231760 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9e2403f2d0 0x7f9e240417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:05.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.006+0000 7f9e3affd640 1 --2- 172.21.15.5:0/254231760 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9e2403f2d0 0x7f9e240417e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c00bbe0 tx=0x7f9e2c00b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:05.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.010+0000 7f9e40881640 1 -- 172.21.15.5:0/254231760 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f9e30020030 con 0x7f9e3c108140 2024-08-31T05:21:05.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.199+0000 7f9e41883640 1 -- 172.21.15.5:0/254231760 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f9e3c10a880 con 0x7f9e3c108140 2024-08-31T05:21:05.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.202+0000 7f9e40881640 1 -- 172.21.15.5:0/254231760 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v15)=0 v15) ==== 108+0+0 (secure 0 0 0) 0x7f9e30009de0 con 0x7f9e3c108140 2024-08-31T05:21:05.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.204+0000 7f9e41883640 1 -- 172.21.15.5:0/254231760 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9e2403f2d0 msgr2=0x7f9e240417e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:05.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.204+0000 7f9e41883640 1 --2- 172.21.15.5:0/254231760 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9e2403f2d0 0x7f9e240417e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c00bbe0 tx=0x7f9e2c00b390 comp rx=0 tx=0).stop 2024-08-31T05:21:05.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.204+0000 7f9e41883640 1 -- 172.21.15.5:0/254231760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e3c108140 msgr2=0x7f9e3c1995c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:05.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.204+0000 7f9e41883640 1 --2- 172.21.15.5:0/254231760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e3c108140 0x7f9e3c1995c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9e30005fd0 tx=0x7f9e3000dde0 comp rx=0 tx=0).stop 2024-08-31T05:21:05.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.204+0000 7f9e41883640 1 -- 172.21.15.5:0/254231760 shutdown_connections 2024-08-31T05:21:05.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.204+0000 7f9e41883640 1 --2- 172.21.15.5:0/254231760 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9e2403f2d0 0x7f9e240417e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:05.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.204+0000 7f9e41883640 1 --2- 172.21.15.5:0/254231760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9e3c108a90 0x7f9e3c19e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:05.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.204+0000 7f9e41883640 1 --2- 172.21.15.5:0/254231760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9e3c108140 0x7f9e3c1995c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:05.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.204+0000 7f9e41883640 1 --2- 172.21.15.5:0/254231760 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e3c102800 0x7f9e3c199020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:05.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.204+0000 7f9e41883640 1 -- 172.21.15.5:0/254231760 >> 172.21.15.5:0/254231760 conn(0x7f9e3c0794d0 msgr2=0x7f9e3c105090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:05.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.204+0000 7f9e41883640 1 -- 172.21.15.5:0/254231760 shutdown_connections 2024-08-31T05:21:05.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.204+0000 7f9e41883640 1 -- 172.21.15.5:0/254231760 wait complete. 2024-08-31T05:21:05.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:05 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:05.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:05 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:05.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:05 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:05.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:05 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-31T05:21:05.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:05 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-31T05:21:05.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:05 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-31T05:21:05.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:05 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:21:05.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:05 smithi005 ceph-mon[18602]: Deploying daemon mgr.y on smithi050 2024-08-31T05:21:05.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:05 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/673718668' entity='client.admin' 2024-08-31T05:21:05.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:05 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/3187417926' entity='client.admin' 2024-08-31T05:21:05.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:05 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/254231760' entity='client.admin' 2024-08-31T05:21:05.621 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:05 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:05.621 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:05 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:05.621 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:05 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:05.621 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:05 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-31T05:21:05.622 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:05 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-31T05:21:05.622 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:05 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-31T05:21:05.622 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:05 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:21:05.622 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:05 smithi050 ceph-mon[22146]: Deploying daemon mgr.y on smithi050 2024-08-31T05:21:05.622 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:05 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/673718668' entity='client.admin' 2024-08-31T05:21:05.622 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:05 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/3187417926' entity='client.admin' 2024-08-31T05:21:05.622 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:05 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/254231760' entity='client.admin' 2024-08-31T05:21:05.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:05 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:05.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:05 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:05.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:05 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:05.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:05 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-31T05:21:05.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:05 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-31T05:21:05.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:05 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-31T05:21:05.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:05 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:21:05.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:05 smithi070 ceph-mon[22316]: Deploying daemon mgr.y on smithi050 2024-08-31T05:21:05.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:05 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/673718668' entity='client.admin' 2024-08-31T05:21:05.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:05 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/3187417926' entity='client.admin' 2024-08-31T05:21:05.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:05 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/254231760' entity='client.admin' 2024-08-31T05:21:06.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.076+0000 7fb1c9a86640 1 -- 172.21.15.5:0/679713673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1c4108140 msgr2=0x7fb1c4108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:06.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.076+0000 7fb1c9a86640 1 --2- 172.21.15.5:0/679713673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1c4108140 0x7fb1c4108550 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac009900 tx=0x7fb1ac02a410 comp rx=0 tx=0).stop 2024-08-31T05:21:06.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.076+0000 7fb1c9a86640 1 -- 172.21.15.5:0/679713673 shutdown_connections 2024-08-31T05:21:06.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.076+0000 7fb1c9a86640 1 --2- 172.21.15.5:0/679713673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb1c4108a90 0x7fb1c410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:06.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.076+0000 7fb1c9a86640 1 --2- 172.21.15.5:0/679713673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1c4108140 0x7fb1c4108550 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:06.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.076+0000 7fb1c9a86640 1 --2- 172.21.15.5:0/679713673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1c4102800 0x7fb1c4102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:06.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.076+0000 7fb1c9a86640 1 -- 172.21.15.5:0/679713673 >> 172.21.15.5:0/679713673 conn(0x7fb1c40794d0 msgr2=0x7fb1c40798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:06.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.076+0000 7fb1c9a86640 1 -- 172.21.15.5:0/679713673 shutdown_connections 2024-08-31T05:21:06.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.076+0000 7fb1c9a86640 1 -- 172.21.15.5:0/679713673 wait complete. 2024-08-31T05:21:06.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.077+0000 7fb1c9a86640 1 Processor -- start 2024-08-31T05:21:06.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.077+0000 7fb1c9a86640 1 -- start start 2024-08-31T05:21:06.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.078+0000 7fb1c9a86640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1c4102800 0x7fb1c4199010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:06.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.078+0000 7fb1c9a86640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1c4108140 0x7fb1c41995b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:06.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.078+0000 7fb1c9a86640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb1c4108a90 0x7fb1c419e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:06.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.078+0000 7fb1c9a86640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c41125a0 con 0x7fb1c4108140 2024-08-31T05:21:06.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.078+0000 7fb1c9a86640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c4112420 con 0x7fb1c4102800 2024-08-31T05:21:06.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.078+0000 7fb1c9a86640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c4112720 con 0x7fb1c4108a90 2024-08-31T05:21:06.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.078+0000 7fb1baffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1c4108140 0x7fb1c41995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:06.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.078+0000 7fb1baffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1c4108140 0x7fb1c41995b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45712/0 (socket says 172.21.15.5:45712) 2024-08-31T05:21:06.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.078+0000 7fb1baffd640 1 -- 172.21.15.5:0/187016964 learned_addr learned my addr 172.21.15.5:0/187016964 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:21:06.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.078+0000 7fb1c37fe640 1 --2- 172.21.15.5:0/187016964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1c4102800 0x7fb1c4199010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:06.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.078+0000 7fb1c3fff640 1 --2- 172.21.15.5:0/187016964 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb1c4108a90 0x7fb1c419e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:06.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.078+0000 7fb1baffd640 1 -- 172.21.15.5:0/187016964 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb1c4108a90 msgr2=0x7fb1c419e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:06.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.078+0000 7fb1baffd640 1 --2- 172.21.15.5:0/187016964 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb1c4108a90 0x7fb1c419e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:06.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.078+0000 7fb1baffd640 1 -- 172.21.15.5:0/187016964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1c4102800 msgr2=0x7fb1c4199010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:06.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.078+0000 7fb1baffd640 1 --2- 172.21.15.5:0/187016964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1c4102800 0x7fb1c4199010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:06.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.078+0000 7fb1baffd640 1 -- 172.21.15.5:0/187016964 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1c419ef80 con 0x7fb1c4108140 2024-08-31T05:21:06.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.078+0000 7fb1baffd640 1 --2- 172.21.15.5:0/187016964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1c4108140 0x7fb1c41995b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac005940 tx=0x7fb1ac0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:06.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.078+0000 7fb1c17fa640 1 -- 172.21.15.5:0/187016964 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac03f030 con 0x7fb1c4108140 2024-08-31T05:21:06.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.079+0000 7fb1c17fa640 1 -- 172.21.15.5:0/187016964 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fb1ac031800 con 0x7fb1c4108140 2024-08-31T05:21:06.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.079+0000 7fb1c17fa640 1 -- 172.21.15.5:0/187016964 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac035070 con 0x7fb1c4108140 2024-08-31T05:21:06.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.079+0000 7fb1c9a86640 1 -- 172.21.15.5:0/187016964 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1c419f210 con 0x7fb1c4108140 2024-08-31T05:21:06.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.079+0000 7fb1c9a86640 1 -- 172.21.15.5:0/187016964 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1c41a59d0 con 0x7fb1c4108140 2024-08-31T05:21:06.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.080+0000 7fb1c17fa640 1 -- 172.21.15.5:0/187016964 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 51269+0+0 (secure 0 0 0) 0x7fb1ac042030 con 0x7fb1c4108140 2024-08-31T05:21:06.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.080+0000 7fb1c9a86640 1 -- 172.21.15.5:0/187016964 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1c4103a80 con 0x7fb1c4108140 2024-08-31T05:21:06.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.080+0000 7fb1c17fa640 1 --2- 172.21.15.5:0/187016964 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb1b003f2d0 0x7fb1b00417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:06.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.080+0000 7fb1c17fa640 1 -- 172.21.15.5:0/187016964 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fb1ac073f70 con 0x7fb1c4108140 2024-08-31T05:21:06.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.080+0000 7fb1c37fe640 1 --2- 172.21.15.5:0/187016964 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb1b003f2d0 0x7fb1b00417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:06.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.080+0000 7fb1c37fe640 1 --2- 172.21.15.5:0/187016964 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb1b003f2d0 0x7fb1b00417e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4005d00 tx=0x7fb1b400b410 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:06.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.085+0000 7fb1c17fa640 1 -- 172.21.15.5:0/187016964 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb1ac038350 con 0x7fb1c4108140 2024-08-31T05:21:06.158 INFO:journalctl@ceph.mgr.y.smithi050.stdout:Aug 31 05:21:06 smithi050 systemd[1]: Starting Ceph mgr.y for 69422704-6758-11ef-bcd4-c7b262605968... 2024-08-31T05:21:06.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.274+0000 7fb1c9a86640 1 -- 172.21.15.5:0/187016964 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fb1c410a880 con 0x7fb1c4108140 2024-08-31T05:21:06.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.277+0000 7fb1c17fa640 1 -- 172.21.15.5:0/187016964 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v17)=0 v17) ==== 123+0+0 (secure 0 0 0) 0x7fb1ac003db0 con 0x7fb1c4108140 2024-08-31T05:21:06.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.278+0000 7fb1c17fa640 1 -- 172.21.15.5:0/187016964 <== mon.0 v2:172.21.15.5:3300/0 8 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb1ac0396f0 con 0x7fb1c4108140 2024-08-31T05:21:06.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.279+0000 7fb1c9a86640 1 -- 172.21.15.5:0/187016964 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb1b003f2d0 msgr2=0x7fb1b00417e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:06.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.279+0000 7fb1c9a86640 1 --2- 172.21.15.5:0/187016964 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb1b003f2d0 0x7fb1b00417e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4005d00 tx=0x7fb1b400b410 comp rx=0 tx=0).stop 2024-08-31T05:21:06.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.279+0000 7fb1c9a86640 1 -- 172.21.15.5:0/187016964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1c4108140 msgr2=0x7fb1c41995b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:06.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.279+0000 7fb1c9a86640 1 --2- 172.21.15.5:0/187016964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1c4108140 0x7fb1c41995b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac005940 tx=0x7fb1ac0042f0 comp rx=0 tx=0).stop 2024-08-31T05:21:06.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.280+0000 7fb1c9a86640 1 -- 172.21.15.5:0/187016964 shutdown_connections 2024-08-31T05:21:06.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.280+0000 7fb1c9a86640 1 --2- 172.21.15.5:0/187016964 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb1b003f2d0 0x7fb1b00417e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:06.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.280+0000 7fb1c9a86640 1 --2- 172.21.15.5:0/187016964 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb1c4108a90 0x7fb1c419e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:06.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.280+0000 7fb1c9a86640 1 --2- 172.21.15.5:0/187016964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1c4108140 0x7fb1c41995b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:06.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.280+0000 7fb1c9a86640 1 --2- 172.21.15.5:0/187016964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1c4102800 0x7fb1c4199010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:06.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.280+0000 7fb1c9a86640 1 -- 172.21.15.5:0/187016964 >> 172.21.15.5:0/187016964 conn(0x7fb1c40794d0 msgr2=0x7fb1c4105090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:06.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.280+0000 7fb1c9a86640 1 -- 172.21.15.5:0/187016964 shutdown_connections 2024-08-31T05:21:06.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:06.280+0000 7fb1c9a86640 1 -- 172.21.15.5:0/187016964 wait complete. 2024-08-31T05:21:06.531 INFO:journalctl@ceph.mgr.y.smithi050.stdout:Aug 31 05:21:06 smithi050 podman[24448]: 2024-08-31 05:21:06.175720554 +0000 UTC m=+0.015654584 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T05:21:06.532 INFO:journalctl@ceph.mgr.y.smithi050.stdout:Aug 31 05:21:06 smithi050 podman[24448]: 2024-08-31 05:21:06.28019771 +0000 UTC m=+0.120131725 container create 8582941710f524f6450e38e33afca0966baf87e98517113373cbab916e5f63ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-08-31T05:21:06.532 INFO:journalctl@ceph.mgr.y.smithi050.stdout:Aug 31 05:21:06 smithi050 podman[24448]: 2024-08-31 05:21:06.491305407 +0000 UTC m=+0.331239422 container init 8582941710f524f6450e38e33afca0966baf87e98517113373cbab916e5f63ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-y, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-08-31T05:21:06.532 INFO:journalctl@ceph.mgr.y.smithi050.stdout:Aug 31 05:21:06 smithi050 podman[24448]: 2024-08-31 05:21:06.494082013 +0000 UTC m=+0.334016029 container start 8582941710f524f6450e38e33afca0966baf87e98517113373cbab916e5f63ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-y, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T05:21:06.532 INFO:journalctl@ceph.mgr.y.smithi050.stdout:Aug 31 05:21:06 smithi050 ceph-mgr[24467]: -- 172.21.15.50:0/1233087720 <== mon.2 v2:172.21.15.50:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f00668b0e0 con 0x55f00b42a000 2024-08-31T05:21:06.906 INFO:journalctl@ceph.mgr.y.smithi050.stdout:Aug 31 05:21:06 smithi050 bash[24448]: 8582941710f524f6450e38e33afca0966baf87e98517113373cbab916e5f63ea 2024-08-31T05:21:06.907 INFO:journalctl@ceph.mgr.y.smithi050.stdout:Aug 31 05:21:06 smithi050 systemd[1]: Started Ceph mgr.y for 69422704-6758-11ef-bcd4-c7b262605968. 2024-08-31T05:21:06.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.780+0000 7f22f6222640 1 -- 172.21.15.5:0/3549249334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22f0109240 msgr2=0x7f22f0109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:06.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.780+0000 7f22f6222640 1 --2- 172.21.15.5:0/3549249334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22f0109240 0x7f22f0109650 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f22e4009900 tx=0x7f22e402a410 comp rx=0 tx=0).stop 2024-08-31T05:21:06.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.780+0000 7f22f6222640 1 -- 172.21.15.5:0/3549249334 shutdown_connections 2024-08-31T05:21:06.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.780+0000 7f22f6222640 1 --2- 172.21.15.5:0/3549249334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22f0109b90 0x7f22f01103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:06.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.780+0000 7f22f6222640 1 --2- 172.21.15.5:0/3549249334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22f0109240 0x7f22f0109650 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:06.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.780+0000 7f22f6222640 1 --2- 172.21.15.5:0/3549249334 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22f0103900 0x7f22f0103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:06.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.780+0000 7f22f6222640 1 -- 172.21.15.5:0/3549249334 >> 172.21.15.5:0/3549249334 conn(0x7f22f007b5f0 msgr2=0x7f22f007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:06.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.780+0000 7f22f6222640 1 -- 172.21.15.5:0/3549249334 shutdown_connections 2024-08-31T05:21:06.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.780+0000 7f22f6222640 1 -- 172.21.15.5:0/3549249334 wait complete. 2024-08-31T05:21:06.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.781+0000 7f22f6222640 1 Processor -- start 2024-08-31T05:21:06.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.781+0000 7f22f6222640 1 -- start start 2024-08-31T05:21:06.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.782+0000 7f22f6222640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22f0103900 0x7f22f00754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:06.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.782+0000 7f22f6222640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22f0109240 0x7f22f00759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:06.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.782+0000 7f22f6222640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22f0109b90 0x7f22f0075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:06.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.782+0000 7f22f6222640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f22f0113750 con 0x7f22f0109240 2024-08-31T05:21:06.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.782+0000 7f22f6222640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f22f01135d0 con 0x7f22f0109b90 2024-08-31T05:21:06.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.782+0000 7f22f6222640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f22f01138d0 con 0x7f22f0103900 2024-08-31T05:21:06.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.782+0000 7f22eeffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22f0109240 0x7f22f00759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:06.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.782+0000 7f22eeffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22f0109240 0x7f22f00759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45694/0 (socket says 172.21.15.5:45694) 2024-08-31T05:21:06.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.782+0000 7f22eeffd640 1 -- 172.21.15.5:0/121046046 learned_addr learned my addr 172.21.15.5:0/121046046 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:21:06.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.782+0000 7f22ef7fe640 1 --2- 172.21.15.5:0/121046046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22f0103900 0x7f22f00754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:06.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.782+0000 7f22effff640 1 --2- 172.21.15.5:0/121046046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22f0109b90 0x7f22f0075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:06.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.782+0000 7f22eeffd640 1 -- 172.21.15.5:0/121046046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22f0103900 msgr2=0x7f22f00754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:06.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.782+0000 7f22eeffd640 1 --2- 172.21.15.5:0/121046046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22f0103900 0x7f22f00754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:06.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.782+0000 7f22eeffd640 1 -- 172.21.15.5:0/121046046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22f0109b90 msgr2=0x7f22f0075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:06.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.782+0000 7f22eeffd640 1 --2- 172.21.15.5:0/121046046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22f0109b90 0x7f22f0075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:06.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.782+0000 7f22eeffd640 1 -- 172.21.15.5:0/121046046 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22f01a8480 con 0x7f22f0109240 2024-08-31T05:21:06.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.782+0000 7f22eeffd640 1 --2- 172.21.15.5:0/121046046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22f0109240 0x7f22f00759f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f22e4005940 tx=0x7f22e40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:06.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.782+0000 7f22ecff9640 1 -- 172.21.15.5:0/121046046 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e403f030 con 0x7f22f0109240 2024-08-31T05:21:06.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.782+0000 7f22ecff9640 1 -- 172.21.15.5:0/121046046 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f22e4031800 con 0x7f22f0109240 2024-08-31T05:21:06.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.782+0000 7f22f6222640 1 -- 172.21.15.5:0/121046046 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22f01a8710 con 0x7f22f0109240 2024-08-31T05:21:06.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.782+0000 7f22ecff9640 1 -- 172.21.15.5:0/121046046 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e4035070 con 0x7f22f0109240 2024-08-31T05:21:06.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.783+0000 7f22f6222640 1 -- 172.21.15.5:0/121046046 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22f01a8c70 con 0x7f22f0109240 2024-08-31T05:21:06.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.783+0000 7f22ecff9640 1 -- 172.21.15.5:0/121046046 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 51269+0+0 (secure 0 0 0) 0x7f22e4042030 con 0x7f22f0109240 2024-08-31T05:21:06.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.784+0000 7f22f6222640 1 -- 172.21.15.5:0/121046046 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22f0103d10 con 0x7f22f0109240 2024-08-31T05:21:06.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.784+0000 7f22ecff9640 1 --2- 172.21.15.5:0/121046046 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f22d803f2d0 0x7f22d80417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:06.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.784+0000 7f22ecff9640 1 -- 172.21.15.5:0/121046046 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f22e4073f60 con 0x7f22f0109240 2024-08-31T05:21:06.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.784+0000 7f22ef7fe640 1 --2- 172.21.15.5:0/121046046 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f22d803f2d0 0x7f22d80417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:06.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.784+0000 7f22ef7fe640 1 --2- 172.21.15.5:0/121046046 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f22d803f2d0 0x7f22d80417e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f22f0076f00 tx=0x7f22e000b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:06.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.789+0000 7f22ecff9640 1 -- 172.21.15.5:0/121046046 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f22e40303a0 con 0x7f22f0109240 2024-08-31T05:21:06.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.978+0000 7f22f6222640 1 -- 172.21.15.5:0/121046046 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7f22f010b980 con 0x7f22f0109240 2024-08-31T05:21:06.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.982+0000 7f22ecff9640 1 -- 172.21.15.5:0/121046046 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v16)=0 v16) ==== 127+0+0 (secure 0 0 0) 0x7f22e402f300 con 0x7f22f0109240 2024-08-31T05:21:06.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.984+0000 7f22f6222640 1 -- 172.21.15.5:0/121046046 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f22d803f2d0 msgr2=0x7f22d80417e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:06.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.984+0000 7f22f6222640 1 --2- 172.21.15.5:0/121046046 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f22d803f2d0 0x7f22d80417e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f22f0076f00 tx=0x7f22e000b390 comp rx=0 tx=0).stop 2024-08-31T05:21:06.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.984+0000 7f22f6222640 1 -- 172.21.15.5:0/121046046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22f0109240 msgr2=0x7f22f00759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:06.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.984+0000 7f22f6222640 1 --2- 172.21.15.5:0/121046046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22f0109240 0x7f22f00759f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f22e4005940 tx=0x7f22e40042f0 comp rx=0 tx=0).stop 2024-08-31T05:21:06.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.985+0000 7f22f6222640 1 -- 172.21.15.5:0/121046046 shutdown_connections 2024-08-31T05:21:06.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.985+0000 7f22f6222640 1 --2- 172.21.15.5:0/121046046 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f22d803f2d0 0x7f22d80417e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:06.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.985+0000 7f22f6222640 1 --2- 172.21.15.5:0/121046046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22f0109b90 0x7f22f0075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:06.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.985+0000 7f22f6222640 1 --2- 172.21.15.5:0/121046046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22f0109240 0x7f22f00759f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:06.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.985+0000 7f22f6222640 1 --2- 172.21.15.5:0/121046046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22f0103900 0x7f22f00754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:06.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.985+0000 7f22f6222640 1 -- 172.21.15.5:0/121046046 >> 172.21.15.5:0/121046046 conn(0x7f22f007b5f0 msgr2=0x7f22f0107340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:06.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.985+0000 7f22f6222640 1 -- 172.21.15.5:0/121046046 shutdown_connections 2024-08-31T05:21:06.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:05.985+0000 7f22f6222640 1 -- 172.21.15.5:0/121046046 wait complete. 2024-08-31T05:21:07.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:06 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/121046046' entity='client.admin' 2024-08-31T05:21:07.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:06 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/187016964' entity='client.admin' 2024-08-31T05:21:07.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:06 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:07.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:06 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:07.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:06 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:07.184 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:06 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:07.184 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:06 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:21:07.330 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:06 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/121046046' entity='client.admin' 2024-08-31T05:21:07.331 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:06 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/187016964' entity='client.admin' 2024-08-31T05:21:07.331 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:06 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:07.331 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:06 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:07.331 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:06 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:07.331 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:06 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:07.332 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:06 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:21:07.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:06 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/121046046' entity='client.admin' 2024-08-31T05:21:07.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:06 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/187016964' entity='client.admin' 2024-08-31T05:21:07.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:06 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:07.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:06 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:07.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:06 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:07.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:06 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:07.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:06 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:21:07.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.654+0000 7f00b9d61640 1 -- 172.21.15.5:0/687504448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00b410dc00 msgr2=0x7f00b41100d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:07.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.654+0000 7f00b9d61640 1 --2- 172.21.15.5:0/687504448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00b410dc00 0x7f00b41100d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f00ac009ca0 tx=0x7f00ac02a8e0 comp rx=0 tx=0).stop 2024-08-31T05:21:07.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.654+0000 7f00b9d61640 1 -- 172.21.15.5:0/687504448 shutdown_connections 2024-08-31T05:21:07.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.654+0000 7f00b9d61640 1 --2- 172.21.15.5:0/687504448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00b410dc00 0x7f00b41100d0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:07.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.654+0000 7f00b9d61640 1 --2- 172.21.15.5:0/687504448 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00b4105120 0x7f00b410d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:07.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.654+0000 7f00b9d61640 1 --2- 172.21.15.5:0/687504448 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00b41047d0 0x7f00b4104be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:07.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.654+0000 7f00b9d61640 1 -- 172.21.15.5:0/687504448 >> 172.21.15.5:0/687504448 conn(0x7f00b4079530 msgr2=0x7f00b4079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:07.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.655+0000 7f00b9d61640 1 -- 172.21.15.5:0/687504448 shutdown_connections 2024-08-31T05:21:07.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.655+0000 7f00b9d61640 1 -- 172.21.15.5:0/687504448 wait complete. 2024-08-31T05:21:07.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.656+0000 7f00b9d61640 1 Processor -- start 2024-08-31T05:21:07.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.656+0000 7f00b9d61640 1 -- start start 2024-08-31T05:21:07.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.656+0000 7f00b9d61640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00b41047d0 0x7f00b419a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:07.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.656+0000 7f00b9d61640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00b4105120 0x7f00b419a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:07.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.656+0000 7f00b9d61640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00b410dc00 0x7f00b419fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:07.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.656+0000 7f00b9d61640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f00b4113900 con 0x7f00b410dc00 2024-08-31T05:21:07.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.656+0000 7f00b9d61640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f00b4113780 con 0x7f00b41047d0 2024-08-31T05:21:07.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.656+0000 7f00b9d61640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f00b4113a80 con 0x7f00b4105120 2024-08-31T05:21:07.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.656+0000 7f00b3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00b410dc00 0x7f00b419fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:07.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.656+0000 7f00b2ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00b4105120 0x7f00b419a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:07.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.657+0000 7f00b3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00b410dc00 0x7f00b419fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45732/0 (socket says 172.21.15.5:45732) 2024-08-31T05:21:07.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.657+0000 7f00b3fff640 1 -- 172.21.15.5:0/779716864 learned_addr learned my addr 172.21.15.5:0/779716864 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:21:07.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.657+0000 7f00b37fe640 1 --2- 172.21.15.5:0/779716864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00b41047d0 0x7f00b419a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:07.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.657+0000 7f00b2ffd640 1 -- 172.21.15.5:0/779716864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00b41047d0 msgr2=0x7f00b419a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:07.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.657+0000 7f00b2ffd640 1 --2- 172.21.15.5:0/779716864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00b41047d0 0x7f00b419a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:07.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.657+0000 7f00b2ffd640 1 -- 172.21.15.5:0/779716864 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00b410dc00 msgr2=0x7f00b419fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:07.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.657+0000 7f00b2ffd640 1 --2- 172.21.15.5:0/779716864 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00b410dc00 0x7f00b419fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:07.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.657+0000 7f00b2ffd640 1 -- 172.21.15.5:0/779716864 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00b41a0260 con 0x7f00b4105120 2024-08-31T05:21:07.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.657+0000 7f00b3fff640 1 --2- 172.21.15.5:0/779716864 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00b410dc00 0x7f00b419fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:21:07.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.667+0000 7f00b2ffd640 1 --2- 172.21.15.5:0/779716864 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00b4105120 0x7f00b419a890 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f00b406a630 tx=0x7f00a800dbb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:07.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.667+0000 7f00b0ff9640 1 -- 172.21.15.5:0/779716864 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a8017070 con 0x7f00b4105120 2024-08-31T05:21:07.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.667+0000 7f00b0ff9640 1 -- 172.21.15.5:0/779716864 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00a80099a0 con 0x7f00b4105120 2024-08-31T05:21:07.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.667+0000 7f00b9d61640 1 -- 172.21.15.5:0/779716864 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00b41a0550 con 0x7f00b4105120 2024-08-31T05:21:07.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.667+0000 7f00b0ff9640 1 -- 172.21.15.5:0/779716864 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a80047a0 con 0x7f00b4105120 2024-08-31T05:21:07.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.667+0000 7f00b9d61640 1 -- 172.21.15.5:0/779716864 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00b41023f0 con 0x7f00b4105120 2024-08-31T05:21:07.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.668+0000 7f00b0ff9640 1 -- 172.21.15.5:0/779716864 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 51269+0+0 (secure 0 0 0) 0x7f00a8004940 con 0x7f00b4105120 2024-08-31T05:21:07.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.668+0000 7f00b0ff9640 1 --2- 172.21.15.5:0/779716864 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f009c03f2d0 0x7f009c0417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:07.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.669+0000 7f00b9d61640 1 -- 172.21.15.5:0/779716864 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00b4104be0 con 0x7f00b4105120 2024-08-31T05:21:07.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.669+0000 7f00b0ff9640 1 -- 172.21.15.5:0/779716864 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f00a8054550 con 0x7f00b4105120 2024-08-31T05:21:07.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.669+0000 7f00b37fe640 1 --2- 172.21.15.5:0/779716864 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f009c03f2d0 0x7f009c0417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:07.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.669+0000 7f00b37fe640 1 --2- 172.21.15.5:0/779716864 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f009c03f2d0 0x7f009c0417e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f00a4006fd0 tx=0x7f00a40090e0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:07.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.686+0000 7f00b0ff9640 1 -- 172.21.15.5:0/779716864 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f00a8020020 con 0x7f00b4105120 2024-08-31T05:21:07.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.885+0000 7f00b9d61640 1 -- 172.21.15.5:0/779716864 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f00b4102650 con 0x7f00b4105120 2024-08-31T05:21:07.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.890+0000 7f00b0ff9640 1 -- 172.21.15.5:0/779716864 <== mon.1 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v18)=0 v18) ==== 117+0+0 (secure 0 0 0) 0x7f00a8009b50 con 0x7f00b4105120 2024-08-31T05:21:07.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.894+0000 7f00b9d61640 1 -- 172.21.15.5:0/779716864 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f009c03f2d0 msgr2=0x7f009c0417e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:07.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.894+0000 7f00b9d61640 1 --2- 172.21.15.5:0/779716864 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f009c03f2d0 0x7f009c0417e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f00a4006fd0 tx=0x7f00a40090e0 comp rx=0 tx=0).stop 2024-08-31T05:21:07.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.894+0000 7f00b9d61640 1 -- 172.21.15.5:0/779716864 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00b4105120 msgr2=0x7f00b419a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:07.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.894+0000 7f00b9d61640 1 --2- 172.21.15.5:0/779716864 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00b4105120 0x7f00b419a890 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f00b406a630 tx=0x7f00a800dbb0 comp rx=0 tx=0).stop 2024-08-31T05:21:07.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.895+0000 7f00b9d61640 1 -- 172.21.15.5:0/779716864 shutdown_connections 2024-08-31T05:21:07.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.895+0000 7f00b9d61640 1 --2- 172.21.15.5:0/779716864 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f009c03f2d0 0x7f009c0417e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:07.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.895+0000 7f00b9d61640 1 --2- 172.21.15.5:0/779716864 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00b410dc00 0x7f00b419fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:07.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.895+0000 7f00b9d61640 1 --2- 172.21.15.5:0/779716864 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00b4105120 0x7f00b419a890 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:07.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.895+0000 7f00b9d61640 1 --2- 172.21.15.5:0/779716864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f00b41047d0 0x7f00b419a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:07.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.895+0000 7f00b9d61640 1 -- 172.21.15.5:0/779716864 >> 172.21.15.5:0/779716864 conn(0x7f00b4079530 msgr2=0x7f00b4106660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:07.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.895+0000 7f00b9d61640 1 -- 172.21.15.5:0/779716864 shutdown_connections 2024-08-31T05:21:07.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.895+0000 7f00b9d61640 1 -- 172.21.15.5:0/779716864 wait complete. 2024-08-31T05:21:07.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.980+0000 7fd1eca5b640 1 -- 172.21.15.5:0/1021653166 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1e8105120 msgr2=0x7fd1e810d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:07.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.980+0000 7fd1eca5b640 1 --2- 172.21.15.5:0/1021653166 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1e8105120 0x7fd1e810d670 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc009900 tx=0x7fd1dc02a410 comp rx=0 tx=0).stop 2024-08-31T05:21:07.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.980+0000 7fd1eca5b640 1 -- 172.21.15.5:0/1021653166 shutdown_connections 2024-08-31T05:21:07.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.980+0000 7fd1eca5b640 1 --2- 172.21.15.5:0/1021653166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1e810dc00 0x7fd1e81100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:07.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.980+0000 7fd1eca5b640 1 --2- 172.21.15.5:0/1021653166 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1e8105120 0x7fd1e810d670 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:07.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.980+0000 7fd1eca5b640 1 --2- 172.21.15.5:0/1021653166 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd1e81047d0 0x7fd1e8104be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:07.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.980+0000 7fd1eca5b640 1 -- 172.21.15.5:0/1021653166 >> 172.21.15.5:0/1021653166 conn(0x7fd1e8079530 msgr2=0x7fd1e8079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:07.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.980+0000 7fd1eca5b640 1 -- 172.21.15.5:0/1021653166 shutdown_connections 2024-08-31T05:21:07.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.980+0000 7fd1eca5b640 1 -- 172.21.15.5:0/1021653166 wait complete. 2024-08-31T05:21:07.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.981+0000 7fd1eca5b640 1 Processor -- start 2024-08-31T05:21:07.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.981+0000 7fd1eca5b640 1 -- start start 2024-08-31T05:21:07.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.981+0000 7fd1eca5b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1e81047d0 0x7fd1e819a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:07.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.981+0000 7fd1eca5b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd1e8105120 0x7fd1e819a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:07.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.981+0000 7fd1eca5b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1e810dc00 0x7fd1e819fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:07.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.981+0000 7fd1eca5b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e8113800 con 0x7fd1e81047d0 2024-08-31T05:21:07.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.981+0000 7fd1eca5b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e8113680 con 0x7fd1e810dc00 2024-08-31T05:21:07.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.981+0000 7fd1eca5b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e8113980 con 0x7fd1e8105120 2024-08-31T05:21:07.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.981+0000 7fd1e659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1e81047d0 0x7fd1e819a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:07.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.981+0000 7fd1e659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1e81047d0 0x7fd1e819a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45752/0 (socket says 172.21.15.5:45752) 2024-08-31T05:21:07.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.981+0000 7fd1e659c640 1 -- 172.21.15.5:0/3817542727 learned_addr learned my addr 172.21.15.5:0/3817542727 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:21:07.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.981+0000 7fd1e5d9b640 1 --2- 172.21.15.5:0/3817542727 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd1e8105120 0x7fd1e819a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:07.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.981+0000 7fd1e6d9d640 1 --2- 172.21.15.5:0/3817542727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1e810dc00 0x7fd1e819fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:07.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.982+0000 7fd1e5d9b640 1 -- 172.21.15.5:0/3817542727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1e810dc00 msgr2=0x7fd1e819fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:07.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.982+0000 7fd1e5d9b640 1 --2- 172.21.15.5:0/3817542727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1e810dc00 0x7fd1e819fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:07.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.982+0000 7fd1e5d9b640 1 -- 172.21.15.5:0/3817542727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1e81047d0 msgr2=0x7fd1e819a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:07.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.982+0000 7fd1e5d9b640 1 --2- 172.21.15.5:0/3817542727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1e81047d0 0x7fd1e819a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:07.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.982+0000 7fd1e5d9b640 1 -- 172.21.15.5:0/3817542727 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1e81a0180 con 0x7fd1e8105120 2024-08-31T05:21:07.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.982+0000 7fd1e659c640 1 --2- 172.21.15.5:0/3817542727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1e81047d0 0x7fd1e819a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:21:07.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.982+0000 7fd1e5d9b640 1 --2- 172.21.15.5:0/3817542727 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd1e8105120 0x7fd1e819a7b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc02a930 tx=0x7fd1dc031a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:07.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.982+0000 7fd1d77fe640 1 -- 172.21.15.5:0/3817542727 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc03f070 con 0x7fd1e8105120 2024-08-31T05:21:07.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.982+0000 7fd1d77fe640 1 -- 172.21.15.5:0/3817542727 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd1dc004490 con 0x7fd1e8105120 2024-08-31T05:21:07.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.982+0000 7fd1eca5b640 1 -- 172.21.15.5:0/3817542727 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1e81a0410 con 0x7fd1e8105120 2024-08-31T05:21:07.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.982+0000 7fd1d77fe640 1 -- 172.21.15.5:0/3817542727 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc035070 con 0x7fd1e8105120 2024-08-31T05:21:07.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.982+0000 7fd1eca5b640 1 -- 172.21.15.5:0/3817542727 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1e81a6bd0 con 0x7fd1e8105120 2024-08-31T05:21:07.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.983+0000 7fd1d77fe640 1 -- 172.21.15.5:0/3817542727 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 51269+0+0 (secure 0 0 0) 0x7fd1dc043400 con 0x7fd1e8105120 2024-08-31T05:21:07.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.983+0000 7fd1d77fe640 1 --2- 172.21.15.5:0/3817542727 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd1d003f2d0 0x7fd1d00417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:07.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.983+0000 7fd1eca5b640 1 -- 172.21.15.5:0/3817542727 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1e806bc70 con 0x7fd1e8105120 2024-08-31T05:21:07.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.984+0000 7fd1d77fe640 1 -- 172.21.15.5:0/3817542727 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fd1dc074f80 con 0x7fd1e8105120 2024-08-31T05:21:07.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.984+0000 7fd1e659c640 1 --2- 172.21.15.5:0/3817542727 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd1d003f2d0 0x7fd1d00417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:07.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.984+0000 7fd1e659c640 1 --2- 172.21.15.5:0/3817542727 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd1d003f2d0 0x7fd1d00417e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd1d8011550 tx=0x7fd1d8005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:07.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:07.989+0000 7fd1d77fe640 1 -- 172.21.15.5:0/3817542727 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd1dc02edc0 con 0x7fd1e8105120 2024-08-31T05:21:08.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:08.179+0000 7fd1eca5b640 1 -- 172.21.15.5:0/3817542727 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7fd1e8104be0 con 0x7fd1e8105120 2024-08-31T05:21:08.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:08.184+0000 7fd1d77fe640 1 -- 172.21.15.5:0/3817542727 <== mon.1 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v19)=0 v19) ==== 121+0+0 (secure 0 0 0) 0x7fd1dc03f400 con 0x7fd1e8105120 2024-08-31T05:21:08.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:08.187+0000 7fd1eca5b640 1 -- 172.21.15.5:0/3817542727 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd1d003f2d0 msgr2=0x7fd1d00417e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:08.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:08.187+0000 7fd1eca5b640 1 --2- 172.21.15.5:0/3817542727 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd1d003f2d0 0x7fd1d00417e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd1d8011550 tx=0x7fd1d8005f90 comp rx=0 tx=0).stop 2024-08-31T05:21:08.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:08.187+0000 7fd1eca5b640 1 -- 172.21.15.5:0/3817542727 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd1e8105120 msgr2=0x7fd1e819a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:08.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:08.187+0000 7fd1eca5b640 1 --2- 172.21.15.5:0/3817542727 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd1e8105120 0x7fd1e819a7b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc02a930 tx=0x7fd1dc031a20 comp rx=0 tx=0).stop 2024-08-31T05:21:08.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:08.187+0000 7fd1eca5b640 1 -- 172.21.15.5:0/3817542727 shutdown_connections 2024-08-31T05:21:08.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:08.187+0000 7fd1eca5b640 1 --2- 172.21.15.5:0/3817542727 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd1d003f2d0 0x7fd1d00417e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:08.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:08.187+0000 7fd1eca5b640 1 --2- 172.21.15.5:0/3817542727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd1e810dc00 0x7fd1e819fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:08.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:08.187+0000 7fd1eca5b640 1 --2- 172.21.15.5:0/3817542727 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd1e8105120 0x7fd1e819a7b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:08.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:08.187+0000 7fd1eca5b640 1 --2- 172.21.15.5:0/3817542727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1e81047d0 0x7fd1e819a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:08.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:08.187+0000 7fd1eca5b640 1 -- 172.21.15.5:0/3817542727 >> 172.21.15.5:0/3817542727 conn(0x7fd1e8079530 msgr2=0x7fd1e8100650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:08.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:08.188+0000 7fd1eca5b640 1 -- 172.21.15.5:0/3817542727 shutdown_connections 2024-08-31T05:21:08.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:08.188+0000 7fd1eca5b640 1 -- 172.21.15.5:0/3817542727 wait complete. 2024-08-31T05:21:09.031 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:08 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:09.031 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:08 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:09.031 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:08 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:09.031 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:08 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:09.031 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:08 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:09.031 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:08 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:21:09.031 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:08 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:21:09.031 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:08 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:09.031 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:08 smithi005 ceph-mon[18602]: from='client.? ' entity='client.admin' 2024-08-31T05:21:09.032 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:08 smithi005 ceph-mon[18602]: Reconfiguring mgr.x (unknown last config time)... 2024-08-31T05:21:09.032 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:08 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-31T05:21:09.032 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:08 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-31T05:21:09.032 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:08 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:21:09.032 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:08 smithi005 ceph-mon[18602]: Reconfiguring daemon mgr.x on smithi005 2024-08-31T05:21:09.032 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:08 smithi005 ceph-mon[18602]: from='client.? ' entity='client.admin' 2024-08-31T05:21:09.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:08 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:09.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:08 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:09.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:08 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:09.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:08 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:09.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:08 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:09.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:08 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:21:09.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:08 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:21:09.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:08 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:09.087 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:08 smithi070 ceph-mon[22316]: from='client.? ' entity='client.admin' 2024-08-31T05:21:09.087 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:08 smithi070 ceph-mon[22316]: Reconfiguring mgr.x (unknown last config time)... 2024-08-31T05:21:09.087 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:08 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-31T05:21:09.087 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:08 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-31T05:21:09.087 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:08 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:21:09.087 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:08 smithi070 ceph-mon[22316]: Reconfiguring daemon mgr.x on smithi005 2024-08-31T05:21:09.087 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:08 smithi070 ceph-mon[22316]: from='client.? ' entity='client.admin' 2024-08-31T05:21:09.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:08 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:09.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:08 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:09.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:08 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:09.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:08 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:09.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:08 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:09.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:08 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:21:09.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:08 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:21:09.158 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:08 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:09.158 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:08 smithi050 ceph-mon[22146]: from='client.? ' entity='client.admin' 2024-08-31T05:21:09.158 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:08 smithi050 ceph-mon[22146]: Reconfiguring mgr.x (unknown last config time)... 2024-08-31T05:21:09.158 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:08 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-31T05:21:09.158 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:08 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-31T05:21:09.158 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:08 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:21:09.158 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:08 smithi050 ceph-mon[22146]: Reconfiguring daemon mgr.x on smithi005 2024-08-31T05:21:09.158 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:08 smithi050 ceph-mon[22146]: from='client.? ' entity='client.admin' 2024-08-31T05:21:09.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.600+0000 7ff21f14f640 1 -- 172.21.15.5:0/1594121789 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff218108260 msgr2=0x7ff21810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:09.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.600+0000 7ff21f14f640 1 --2- 172.21.15.5:0/1594121789 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff218108260 0x7ff21810ea90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff21000adb0 tx=0x7ff21002b7a0 comp rx=0 tx=0).stop 2024-08-31T05:21:09.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.600+0000 7ff21f14f640 1 -- 172.21.15.5:0/1594121789 shutdown_connections 2024-08-31T05:21:09.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.600+0000 7ff21f14f640 1 --2- 172.21.15.5:0/1594121789 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff218108260 0x7ff21810ea90 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:09.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.600+0000 7ff21f14f640 1 --2- 172.21.15.5:0/1594121789 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff218107910 0x7ff218107d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:09.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.600+0000 7ff21f14f640 1 --2- 172.21.15.5:0/1594121789 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff218101fd0 0x7ff2181023e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:09.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.600+0000 7ff21f14f640 1 -- 172.21.15.5:0/1594121789 >> 172.21.15.5:0/1594121789 conn(0x7ff218079be0 msgr2=0x7ff218079ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:09.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.600+0000 7ff21f14f640 1 -- 172.21.15.5:0/1594121789 shutdown_connections 2024-08-31T05:21:09.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.600+0000 7ff21f14f640 1 -- 172.21.15.5:0/1594121789 wait complete. 2024-08-31T05:21:09.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.601+0000 7ff21f14f640 1 Processor -- start 2024-08-31T05:21:09.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.601+0000 7ff21f14f640 1 -- start start 2024-08-31T05:21:09.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.601+0000 7ff21f14f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff218101fd0 0x7ff21819a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:09.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.601+0000 7ff21f14f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff218107910 0x7ff21819a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:09.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.601+0000 7ff21f14f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff218108260 0x7ff21819f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:09.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.601+0000 7ff21f14f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff218111460 con 0x7ff218107910 2024-08-31T05:21:09.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.601+0000 7ff21f14f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff2181112e0 con 0x7ff218101fd0 2024-08-31T05:21:09.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.601+0000 7ff21f14f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff2181115e0 con 0x7ff218108260 2024-08-31T05:21:09.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.601+0000 7ff217fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff218107910 0x7ff21819a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:09.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.601+0000 7ff217fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff218107910 0x7ff21819a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45650/0 (socket says 172.21.15.5:45650) 2024-08-31T05:21:09.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.601+0000 7ff217fff640 1 -- 172.21.15.5:0/3187417926 learned_addr learned my addr 172.21.15.5:0/3187417926 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:21:09.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.601+0000 7ff21ceeb640 1 --2- 172.21.15.5:0/3187417926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff218101fd0 0x7ff21819a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:09.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.601+0000 7ff21d6ec640 1 --2- 172.21.15.5:0/3187417926 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff218108260 0x7ff21819f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:09.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.601+0000 7ff217fff640 1 -- 172.21.15.5:0/3187417926 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff218108260 msgr2=0x7ff21819f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:09.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.601+0000 7ff217fff640 1 --2- 172.21.15.5:0/3187417926 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff218108260 0x7ff21819f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:09.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.601+0000 7ff217fff640 1 -- 172.21.15.5:0/3187417926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff218101fd0 msgr2=0x7ff21819a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:09.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.601+0000 7ff217fff640 1 --2- 172.21.15.5:0/3187417926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff218101fd0 0x7ff21819a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:09.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.601+0000 7ff217fff640 1 -- 172.21.15.5:0/3187417926 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2181a0030 con 0x7ff218107910 2024-08-31T05:21:09.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.602+0000 7ff217fff640 1 --2- 172.21.15.5:0/3187417926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff218107910 0x7ff21819a660 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff20c00d740 tx=0x7ff20c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:09.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.602+0000 7ff215ffb640 1 -- 172.21.15.5:0/3187417926 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff20c017070 con 0x7ff218107910 2024-08-31T05:21:09.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.602+0000 7ff215ffb640 1 -- 172.21.15.5:0/3187417926 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7ff20c00de50 con 0x7ff218107910 2024-08-31T05:21:09.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.602+0000 7ff21f14f640 1 -- 172.21.15.5:0/3187417926 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2181a0320 con 0x7ff218107910 2024-08-31T05:21:09.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.602+0000 7ff215ffb640 1 -- 172.21.15.5:0/3187417926 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff20c00f620 con 0x7ff218107910 2024-08-31T05:21:09.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.602+0000 7ff21f14f640 1 -- 172.21.15.5:0/3187417926 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2181a6a80 con 0x7ff218107910 2024-08-31T05:21:09.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.603+0000 7ff215ffb640 1 -- 172.21.15.5:0/3187417926 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 51269+0+0 (secure 0 0 0) 0x7ff20c01a070 con 0x7ff218107910 2024-08-31T05:21:09.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.603+0000 7ff21f14f640 1 -- 172.21.15.5:0/3187417926 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2181023e0 con 0x7ff218107910 2024-08-31T05:21:09.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.603+0000 7ff215ffb640 1 --2- 172.21.15.5:0/3187417926 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff20003f2d0 0x7ff2000417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:09.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.603+0000 7ff215ffb640 1 -- 172.21.15.5:0/3187417926 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7ff20c053480 con 0x7ff218107910 2024-08-31T05:21:09.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.603+0000 7ff21ceeb640 1 --2- 172.21.15.5:0/3187417926 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff20003f2d0 0x7ff2000417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:09.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.604+0000 7ff21ceeb640 1 --2- 172.21.15.5:0/3187417926 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff20003f2d0 0x7ff2000417e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff208009bd0 tx=0x7ff208005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:09.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.608+0000 7ff215ffb640 1 -- 172.21.15.5:0/3187417926 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff20c010e10 con 0x7ff218107910 2024-08-31T05:21:09.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.803+0000 7ff21f14f640 1 -- 172.21.15.5:0/3187417926 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7ff21810a050 con 0x7ff218107910 2024-08-31T05:21:09.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.813+0000 7ff215ffb640 1 -- 172.21.15.5:0/3187417926 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v14)=0 v14) ==== 123+0+0 (secure 0 0 0) 0x7ff20c0211d0 con 0x7ff218107910 2024-08-31T05:21:09.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.814+0000 7ff215ffb640 1 -- 172.21.15.5:0/3187417926 <== mon.0 v2:172.21.15.5:3300/0 8 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7ff20c009c30 con 0x7ff218107910 2024-08-31T05:21:09.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.816+0000 7ff21f14f640 1 -- 172.21.15.5:0/3187417926 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff20003f2d0 msgr2=0x7ff2000417e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:09.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.816+0000 7ff21f14f640 1 --2- 172.21.15.5:0/3187417926 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff20003f2d0 0x7ff2000417e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff208009bd0 tx=0x7ff208005f90 comp rx=0 tx=0).stop 2024-08-31T05:21:09.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.816+0000 7ff21f14f640 1 -- 172.21.15.5:0/3187417926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff218107910 msgr2=0x7ff21819a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:09.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.816+0000 7ff21f14f640 1 --2- 172.21.15.5:0/3187417926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff218107910 0x7ff21819a660 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff20c00d740 tx=0x7ff20c00dc00 comp rx=0 tx=0).stop 2024-08-31T05:21:09.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.816+0000 7ff21f14f640 1 -- 172.21.15.5:0/3187417926 shutdown_connections 2024-08-31T05:21:09.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.816+0000 7ff21f14f640 1 --2- 172.21.15.5:0/3187417926 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff20003f2d0 0x7ff2000417e0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:09.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.816+0000 7ff21f14f640 1 --2- 172.21.15.5:0/3187417926 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff218108260 0x7ff21819f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:09.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.816+0000 7ff21f14f640 1 --2- 172.21.15.5:0/3187417926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff218107910 0x7ff21819a660 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:09.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.816+0000 7ff21f14f640 1 --2- 172.21.15.5:0/3187417926 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff218101fd0 0x7ff21819a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:09.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.816+0000 7ff21f14f640 1 -- 172.21.15.5:0/3187417926 >> 172.21.15.5:0/3187417926 conn(0x7ff218079be0 msgr2=0x7ff218105a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:09.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.816+0000 7ff21f14f640 1 -- 172.21.15.5:0/3187417926 shutdown_connections 2024-08-31T05:21:09.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:04.816+0000 7ff21f14f640 1 -- 172.21.15.5:0/3187417926 wait complete. 2024-08-31T05:21:09.501 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:21:09.503 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:21:09.503 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:21:09.507 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:21:09.508 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:21:09.508 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:21:09.508 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:21:09.515 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:21:09.522 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:21:09.523 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:21:09.873 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:09 smithi005 ceph-mon[18602]: Standby manager daemon z started 2024-08-31T05:21:09.873 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:09 smithi005 ceph-mon[18602]: from='mgr.? 172.21.15.70:0/4068140665' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-08-31T05:21:09.873 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:09 smithi005 ceph-mon[18602]: from='mgr.? 172.21.15.70:0/4068140665' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-31T05:21:09.873 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:09 smithi005 ceph-mon[18602]: from='mgr.? 172.21.15.70:0/4068140665' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-08-31T05:21:09.873 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:09 smithi005 ceph-mon[18602]: from='mgr.? 172.21.15.70:0/4068140665' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-31T05:21:10.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:09 smithi070 ceph-mon[22316]: Standby manager daemon z started 2024-08-31T05:21:10.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:09 smithi070 ceph-mon[22316]: from='mgr.? 172.21.15.70:0/4068140665' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-08-31T05:21:10.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:09 smithi070 ceph-mon[22316]: from='mgr.? 172.21.15.70:0/4068140665' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-31T05:21:10.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:09 smithi070 ceph-mon[22316]: from='mgr.? 172.21.15.70:0/4068140665' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-08-31T05:21:10.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:09 smithi070 ceph-mon[22316]: from='mgr.? 172.21.15.70:0/4068140665' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-31T05:21:10.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:09 smithi050 ceph-mon[22146]: Standby manager daemon z started 2024-08-31T05:21:10.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:09 smithi050 ceph-mon[22146]: from='mgr.? 172.21.15.70:0/4068140665' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-08-31T05:21:10.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:09 smithi050 ceph-mon[22146]: from='mgr.? 172.21.15.70:0/4068140665' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-31T05:21:10.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:09 smithi050 ceph-mon[22146]: from='mgr.? 172.21.15.70:0/4068140665' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-08-31T05:21:10.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:09 smithi050 ceph-mon[22146]: from='mgr.? 172.21.15.70:0/4068140665' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-31T05:21:10.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.874+0000 7f145f470640 1 -- 172.21.15.5:0/3019020528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1458108140 msgr2=0x7f1458108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:10.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.874+0000 7f145f470640 1 --2- 172.21.15.5:0/3019020528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1458108140 0x7f1458108550 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1448009900 tx=0x7f144802a410 comp rx=0 tx=0).stop 2024-08-31T05:21:10.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.874+0000 7f145f470640 1 -- 172.21.15.5:0/3019020528 shutdown_connections 2024-08-31T05:21:10.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.874+0000 7f145f470640 1 --2- 172.21.15.5:0/3019020528 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1458108a90 0x7f145810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:10.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.874+0000 7f145f470640 1 --2- 172.21.15.5:0/3019020528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1458108140 0x7f1458108550 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:10.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.874+0000 7f145f470640 1 --2- 172.21.15.5:0/3019020528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1458102800 0x7f1458102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:10.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.874+0000 7f145f470640 1 -- 172.21.15.5:0/3019020528 >> 172.21.15.5:0/3019020528 conn(0x7f14580794d0 msgr2=0x7f14580798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:10.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.874+0000 7f145f470640 1 -- 172.21.15.5:0/3019020528 shutdown_connections 2024-08-31T05:21:10.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.875+0000 7f145f470640 1 -- 172.21.15.5:0/3019020528 wait complete. 2024-08-31T05:21:10.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.875+0000 7f145f470640 1 Processor -- start 2024-08-31T05:21:10.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.875+0000 7f145f470640 1 -- start start 2024-08-31T05:21:10.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.875+0000 7f145f470640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1458102800 0x7f145819aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:10.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.875+0000 7f145f470640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1458108140 0x7f145819b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:10.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.875+0000 7f145f470640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1458108a90 0x7f145819ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:10.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.875+0000 7f145f470640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f14581126e0 con 0x7f1458108140 2024-08-31T05:21:10.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.876+0000 7f145f470640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1458112560 con 0x7f1458102800 2024-08-31T05:21:10.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.876+0000 7f145f470640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1458112860 con 0x7f1458108a90 2024-08-31T05:21:10.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.876+0000 7f145ca0b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1458108140 0x7f145819b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:10.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.876+0000 7f145d20c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1458102800 0x7f145819aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:10.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.876+0000 7f145ca0b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1458108140 0x7f145819b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45784/0 (socket says 172.21.15.5:45784) 2024-08-31T05:21:10.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.876+0000 7f145ca0b640 1 -- 172.21.15.5:0/3089755463 learned_addr learned my addr 172.21.15.5:0/3089755463 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:21:10.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.876+0000 7f145da0d640 1 --2- 172.21.15.5:0/3089755463 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1458108a90 0x7f145819ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:10.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.876+0000 7f145d20c640 1 -- 172.21.15.5:0/3089755463 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1458108a90 msgr2=0x7f145819ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:10.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.876+0000 7f145d20c640 1 --2- 172.21.15.5:0/3089755463 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1458108a90 0x7f145819ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:10.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.876+0000 7f145d20c640 1 -- 172.21.15.5:0/3089755463 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1458108140 msgr2=0x7f145819b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:10.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.876+0000 7f145d20c640 1 --2- 172.21.15.5:0/3089755463 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1458108140 0x7f145819b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:10.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.876+0000 7f145d20c640 1 -- 172.21.15.5:0/3089755463 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14581a62b0 con 0x7f1458102800 2024-08-31T05:21:10.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.876+0000 7f145ca0b640 1 --2- 172.21.15.5:0/3089755463 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1458108140 0x7f145819b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:21:10.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.876+0000 7f145d20c640 1 --2- 172.21.15.5:0/3089755463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1458102800 0x7f145819aff0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f145400e9f0 tx=0x7f145400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:10.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.876+0000 7f144e7fc640 1 -- 172.21.15.5:0/3089755463 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f145400ccc0 con 0x7f1458102800 2024-08-31T05:21:10.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.876+0000 7f144e7fc640 1 -- 172.21.15.5:0/3089755463 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14540108e0 con 0x7f1458102800 2024-08-31T05:21:10.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.876+0000 7f145f470640 1 -- 172.21.15.5:0/3089755463 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14581a65a0 con 0x7f1458102800 2024-08-31T05:21:10.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.876+0000 7f144e7fc640 1 -- 172.21.15.5:0/3089755463 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1454018880 con 0x7f1458102800 2024-08-31T05:21:10.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.877+0000 7f145f470640 1 -- 172.21.15.5:0/3089755463 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14581a6ae0 con 0x7f1458102800 2024-08-31T05:21:10.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.878+0000 7f145f470640 1 -- 172.21.15.5:0/3089755463 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1458102c10 con 0x7f1458102800 2024-08-31T05:21:10.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.878+0000 7f144e7fc640 1 -- 172.21.15.5:0/3089755463 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 18) ==== 101903+0+0 (secure 0 0 0) 0x7f1454018a20 con 0x7f1458102800 2024-08-31T05:21:10.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.879+0000 7f144e7fc640 1 --2- 172.21.15.5:0/3089755463 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f1444079ee0 0x7f144407c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:10.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.879+0000 7f144e7fc640 1 -- 172.21.15.5:0/3089755463 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f145409bb80 con 0x7f1458102800 2024-08-31T05:21:10.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.879+0000 7f145ca0b640 1 --2- 172.21.15.5:0/3089755463 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f1444079ee0 0x7f144407c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:10.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.879+0000 7f145ca0b640 1 --2- 172.21.15.5:0/3089755463 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f1444079ee0 0x7f144407c3f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f14480096c0 tx=0x7f1448032ed0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:10.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.884+0000 7f144e7fc640 1 -- 172.21.15.5:0/3089755463 <== mon.2 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f1454068b40 con 0x7f1458102800 2024-08-31T05:21:10.966 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:10 smithi005 ceph-mon[18602]: mgrmap e18: x(active, since 12s), standbys: z 2024-08-31T05:21:10.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:10 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-08-31T05:21:11.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:11.074+0000 7f145f470640 1 -- 172.21.15.5:0/3089755463 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f145810a880 con 0x7f1458102800 2024-08-31T05:21:11.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:11.079+0000 7f144e7fc640 1 -- 172.21.15.5:0/3089755463 <== mon.2 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v21)=0 v21) ==== 121+0+0 (secure 0 0 0) 0x7f145406d560 con 0x7f1458102800 2024-08-31T05:21:11.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:11.082+0000 7f145f470640 1 -- 172.21.15.5:0/3089755463 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f1444079ee0 msgr2=0x7f144407c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:11.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:11.082+0000 7f145f470640 1 --2- 172.21.15.5:0/3089755463 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f1444079ee0 0x7f144407c3f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f14480096c0 tx=0x7f1448032ed0 comp rx=0 tx=0).stop 2024-08-31T05:21:11.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:11.082+0000 7f145f470640 1 -- 172.21.15.5:0/3089755463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1458102800 msgr2=0x7f145819aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:11.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:11.082+0000 7f145f470640 1 --2- 172.21.15.5:0/3089755463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1458102800 0x7f145819aff0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f145400e9f0 tx=0x7f145400eeb0 comp rx=0 tx=0).stop 2024-08-31T05:21:11.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:11.082+0000 7f145f470640 1 -- 172.21.15.5:0/3089755463 shutdown_connections 2024-08-31T05:21:11.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:11.082+0000 7f145f470640 1 --2- 172.21.15.5:0/3089755463 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f1444079ee0 0x7f144407c3f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:11.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:11.082+0000 7f145f470640 1 --2- 172.21.15.5:0/3089755463 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1458108a90 0x7f145819ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:11.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:11.082+0000 7f145f470640 1 --2- 172.21.15.5:0/3089755463 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1458108140 0x7f145819b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:11.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:11.082+0000 7f145f470640 1 --2- 172.21.15.5:0/3089755463 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1458102800 0x7f145819aff0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:11.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:11.082+0000 7f145f470640 1 -- 172.21.15.5:0/3089755463 >> 172.21.15.5:0/3089755463 conn(0x7f14580794d0 msgr2=0x7f1458105040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:11.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:11.082+0000 7f145f470640 1 -- 172.21.15.5:0/3089755463 shutdown_connections 2024-08-31T05:21:11.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:11.082+0000 7f145f470640 1 -- 172.21.15.5:0/3089755463 wait complete. 2024-08-31T05:21:11.085 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:10 smithi070 ceph-mon[22316]: mgrmap e18: x(active, since 12s), standbys: z 2024-08-31T05:21:11.085 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:10 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-08-31T05:21:11.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:10 smithi050 ceph-mon[22146]: mgrmap e18: x(active, since 12s), standbys: z 2024-08-31T05:21:11.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:10 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-08-31T05:21:12.258 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:11 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/4148688395' entity='client.admin' 2024-08-31T05:21:12.258 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:11 smithi005 ceph-mon[18602]: from='client.? ' entity='client.admin' 2024-08-31T05:21:12.258 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:11 smithi005 ceph-mon[18602]: Standby manager daemon y started 2024-08-31T05:21:12.258 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:11 smithi005 ceph-mon[18602]: from='mgr.? 172.21.15.50:0/3503102216' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-08-31T05:21:12.259 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:11 smithi005 ceph-mon[18602]: from='mgr.? 172.21.15.50:0/3503102216' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-31T05:21:12.259 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:11 smithi005 ceph-mon[18602]: from='mgr.? 172.21.15.50:0/3503102216' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-08-31T05:21:12.259 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:11 smithi005 ceph-mon[18602]: from='mgr.? 172.21.15.50:0/3503102216' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-31T05:21:12.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:11 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/4148688395' entity='client.admin' 2024-08-31T05:21:12.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:11 smithi070 ceph-mon[22316]: from='client.? ' entity='client.admin' 2024-08-31T05:21:12.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:11 smithi070 ceph-mon[22316]: Standby manager daemon y started 2024-08-31T05:21:12.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:11 smithi070 ceph-mon[22316]: from='mgr.? 172.21.15.50:0/3503102216' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-08-31T05:21:12.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:11 smithi070 ceph-mon[22316]: from='mgr.? 172.21.15.50:0/3503102216' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-31T05:21:12.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:11 smithi070 ceph-mon[22316]: from='mgr.? 172.21.15.50:0/3503102216' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-08-31T05:21:12.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:11 smithi070 ceph-mon[22316]: from='mgr.? 172.21.15.50:0/3503102216' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-31T05:21:12.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:11 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/4148688395' entity='client.admin' 2024-08-31T05:21:12.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:11 smithi050 ceph-mon[22146]: from='client.? ' entity='client.admin' 2024-08-31T05:21:12.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:11 smithi050 ceph-mon[22146]: Standby manager daemon y started 2024-08-31T05:21:12.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:11 smithi050 ceph-mon[22146]: from='mgr.? 172.21.15.50:0/3503102216' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-08-31T05:21:12.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:11 smithi050 ceph-mon[22146]: from='mgr.? 172.21.15.50:0/3503102216' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-31T05:21:12.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:11 smithi050 ceph-mon[22146]: from='mgr.? 172.21.15.50:0/3503102216' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-08-31T05:21:12.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:11 smithi050 ceph-mon[22146]: from='mgr.? 172.21.15.50:0/3503102216' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-31T05:21:13.214 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:13 smithi005 ceph-mon[18602]: mgrmap e19: x(active, since 14s), standbys: z, y 2024-08-31T05:21:13.214 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:13 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-08-31T05:21:13.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.309+0000 7f3da60d6640 1 -- 172.21.15.5:0/156385322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3da01050b0 msgr2=0x7f3da010d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:13.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.309+0000 7f3da60d6640 1 --2- 172.21.15.5:0/156385322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3da01050b0 0x7f3da010d600 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3d94009900 tx=0x7f3d9402a410 comp rx=0 tx=0).stop 2024-08-31T05:21:13.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.309+0000 7f3da60d6640 1 -- 172.21.15.5:0/156385322 shutdown_connections 2024-08-31T05:21:13.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.309+0000 7f3da60d6640 1 --2- 172.21.15.5:0/156385322 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3da010dbc0 0x7f3da01100b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:13.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.309+0000 7f3da60d6640 1 --2- 172.21.15.5:0/156385322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3da01050b0 0x7f3da010d600 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:13.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.309+0000 7f3da60d6640 1 --2- 172.21.15.5:0/156385322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3da0104760 0x7f3da0104b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:13.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.309+0000 7f3da60d6640 1 -- 172.21.15.5:0/156385322 >> 172.21.15.5:0/156385322 conn(0x7f3da00794d0 msgr2=0x7f3da00798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:13.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.309+0000 7f3da60d6640 1 -- 172.21.15.5:0/156385322 shutdown_connections 2024-08-31T05:21:13.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.309+0000 7f3da60d6640 1 -- 172.21.15.5:0/156385322 wait complete. 2024-08-31T05:21:13.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.310+0000 7f3da60d6640 1 Processor -- start 2024-08-31T05:21:13.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.310+0000 7f3da60d6640 1 -- start start 2024-08-31T05:21:13.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.311+0000 7f3da60d6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3da0104760 0x7f3da019a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:13.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.311+0000 7f3da60d6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3da01050b0 0x7f3da019a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:13.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.311+0000 7f3da60d6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3da010dbc0 0x7f3da019faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:13.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.311+0000 7f3da60d6640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3da01137e0 con 0x7f3da0104760 2024-08-31T05:21:13.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.311+0000 7f3da60d6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3da0113660 con 0x7f3da010dbc0 2024-08-31T05:21:13.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.311+0000 7f3da60d6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3da0113960 con 0x7f3da01050b0 2024-08-31T05:21:13.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.311+0000 7f3d9f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3da0104760 0x7f3da019a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:13.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.311+0000 7f3d9f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3da0104760 0x7f3da019a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47362/0 (socket says 172.21.15.5:47362) 2024-08-31T05:21:13.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.311+0000 7f3d9f7fe640 1 -- 172.21.15.5:0/1848508175 learned_addr learned my addr 172.21.15.5:0/1848508175 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:21:13.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.311+0000 7f3d9effd640 1 --2- 172.21.15.5:0/1848508175 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3da01050b0 0x7f3da019a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:13.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.311+0000 7f3d9ffff640 1 --2- 172.21.15.5:0/1848508175 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3da010dbc0 0x7f3da019faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:13.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.311+0000 7f3d9f7fe640 1 -- 172.21.15.5:0/1848508175 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3da01050b0 msgr2=0x7f3da019a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:13.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.311+0000 7f3d9f7fe640 1 --2- 172.21.15.5:0/1848508175 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3da01050b0 0x7f3da019a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:13.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.311+0000 7f3d9f7fe640 1 -- 172.21.15.5:0/1848508175 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3da010dbc0 msgr2=0x7f3da019faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:13.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.311+0000 7f3d9f7fe640 1 --2- 172.21.15.5:0/1848508175 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3da010dbc0 0x7f3da019faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:13.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.311+0000 7f3d9f7fe640 1 -- 172.21.15.5:0/1848508175 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3da01a0160 con 0x7f3da0104760 2024-08-31T05:21:13.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.311+0000 7f3d9ffff640 1 --2- 172.21.15.5:0/1848508175 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3da010dbc0 0x7f3da019faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:21:13.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.311+0000 7f3d9f7fe640 1 --2- 172.21.15.5:0/1848508175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3da0104760 0x7f3da019a2b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3d9000d950 tx=0x7f3d9000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:13.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.311+0000 7f3d9cff9640 1 -- 172.21.15.5:0/1848508175 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d90017020 con 0x7f3da0104760 2024-08-31T05:21:13.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.312+0000 7f3d9cff9640 1 -- 172.21.15.5:0/1848508175 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d90009c30 con 0x7f3da0104760 2024-08-31T05:21:13.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.312+0000 7f3da60d6640 1 -- 172.21.15.5:0/1848508175 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3da01a0450 con 0x7f3da0104760 2024-08-31T05:21:13.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.312+0000 7f3d9cff9640 1 -- 172.21.15.5:0/1848508175 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d9000f690 con 0x7f3da0104760 2024-08-31T05:21:13.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.312+0000 7f3da60d6640 1 -- 172.21.15.5:0/1848508175 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3da01a6c70 con 0x7f3da0104760 2024-08-31T05:21:13.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.313+0000 7f3da60d6640 1 -- 172.21.15.5:0/1848508175 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3da006bf80 con 0x7f3da0104760 2024-08-31T05:21:13.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.314+0000 7f3d9cff9640 1 -- 172.21.15.5:0/1848508175 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) ==== 152537+0+0 (secure 0 0 0) 0x7f3d9001a020 con 0x7f3da0104760 2024-08-31T05:21:13.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.315+0000 7f3d9cff9640 1 --2- 172.21.15.5:0/1848508175 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f3d880b4b20 0x7f3d880b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:13.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.315+0000 7f3d9effd640 1 --2- 172.21.15.5:0/1848508175 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f3d880b4b20 0x7f3d880b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:13.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.315+0000 7f3d9cff9640 1 -- 172.21.15.5:0/1848508175 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f3d900e3890 con 0x7f3da0104760 2024-08-31T05:21:13.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.315+0000 7f3d9effd640 1 --2- 172.21.15.5:0/1848508175 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f3d880b4b20 0x7f3d880b7030 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3d94009230 tx=0x7f3d94031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:13.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.318+0000 7f3d9cff9640 1 -- 172.21.15.5:0/1848508175 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f3d90021020 con 0x7f3da0104760 2024-08-31T05:21:13.335 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:13 smithi070 ceph-mon[22316]: mgrmap e19: x(active, since 14s), standbys: z, y 2024-08-31T05:21:13.335 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:13 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-08-31T05:21:13.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:13 smithi050 ceph-mon[22146]: mgrmap e19: x(active, since 14s), standbys: z, y 2024-08-31T05:21:13.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:13 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-08-31T05:21:13.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.514+0000 7f3da60d6640 1 -- 172.21.15.5:0/1848508175 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f3da019b3e0 con 0x7f3da0104760 2024-08-31T05:21:13.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.518+0000 7f3d9cff9640 1 -- 172.21.15.5:0/1848508175 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v23)=0 v23) ==== 106+0+0 (secure 0 0 0) 0x7f3d90009de0 con 0x7f3da0104760 2024-08-31T05:21:13.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.520+0000 7f3da60d6640 1 -- 172.21.15.5:0/1848508175 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f3d880b4b20 msgr2=0x7f3d880b7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:13.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.520+0000 7f3da60d6640 1 --2- 172.21.15.5:0/1848508175 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f3d880b4b20 0x7f3d880b7030 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3d94009230 tx=0x7f3d94031400 comp rx=0 tx=0).stop 2024-08-31T05:21:13.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.520+0000 7f3da60d6640 1 -- 172.21.15.5:0/1848508175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3da0104760 msgr2=0x7f3da019a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:13.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.520+0000 7f3da60d6640 1 --2- 172.21.15.5:0/1848508175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3da0104760 0x7f3da019a2b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3d9000d950 tx=0x7f3d9000de10 comp rx=0 tx=0).stop 2024-08-31T05:21:13.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.520+0000 7f3da60d6640 1 -- 172.21.15.5:0/1848508175 shutdown_connections 2024-08-31T05:21:13.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.520+0000 7f3da60d6640 1 --2- 172.21.15.5:0/1848508175 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f3d880b4b20 0x7f3d880b7030 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:13.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.520+0000 7f3da60d6640 1 --2- 172.21.15.5:0/1848508175 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3da010dbc0 0x7f3da019faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:13.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.520+0000 7f3da60d6640 1 --2- 172.21.15.5:0/1848508175 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3da01050b0 0x7f3da019a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:13.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.520+0000 7f3da60d6640 1 --2- 172.21.15.5:0/1848508175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3da0104760 0x7f3da019a2b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:13.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.520+0000 7f3da60d6640 1 -- 172.21.15.5:0/1848508175 >> 172.21.15.5:0/1848508175 conn(0x7f3da00794d0 msgr2=0x7f3da01006c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:13.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.521+0000 7f3da60d6640 1 -- 172.21.15.5:0/1848508175 shutdown_connections 2024-08-31T05:21:13.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.521+0000 7f3da60d6640 1 -- 172.21.15.5:0/1848508175 wait complete. 2024-08-31T05:21:14.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.392+0000 7f7f96c3d640 1 -- 172.21.15.5:0/1914810944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f90102ce0 msgr2=0x7f7f9010fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:14.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.392+0000 7f7f96c3d640 1 --2- 172.21.15.5:0/1914810944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f90102ce0 0x7f7f9010fa00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c009900 tx=0x7f7f7c02a480 comp rx=0 tx=0).stop 2024-08-31T05:21:14.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.392+0000 7f7f96c3d640 1 -- 172.21.15.5:0/1914810944 shutdown_connections 2024-08-31T05:21:14.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.392+0000 7f7f96c3d640 1 --2- 172.21.15.5:0/1914810944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f9010ff40 0x7f7f90112360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:14.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.392+0000 7f7f96c3d640 1 --2- 172.21.15.5:0/1914810944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f90102ce0 0x7f7f9010fa00 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:14.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.392+0000 7f7f96c3d640 1 --2- 172.21.15.5:0/1914810944 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f90102390 0x7f7f901027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:14.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.392+0000 7f7f96c3d640 1 -- 172.21.15.5:0/1914810944 >> 172.21.15.5:0/1914810944 conn(0x7f7f900794e0 msgr2=0x7f7f900798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:14.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.392+0000 7f7f96c3d640 1 -- 172.21.15.5:0/1914810944 shutdown_connections 2024-08-31T05:21:14.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.392+0000 7f7f96c3d640 1 -- 172.21.15.5:0/1914810944 wait complete. 2024-08-31T05:21:14.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.393+0000 7f7f96c3d640 1 Processor -- start 2024-08-31T05:21:14.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.393+0000 7f7f96c3d640 1 -- start start 2024-08-31T05:21:14.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.393+0000 7f7f96c3d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f90102390 0x7f7f9019c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:14.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.393+0000 7f7f96c3d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f90102ce0 0x7f7f9019c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:14.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.393+0000 7f7f96c3d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f9010ff40 0x7f7f901a1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:14.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.393+0000 7f7f96c3d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7f90115a30 con 0x7f7f9010ff40 2024-08-31T05:21:14.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.393+0000 7f7f96c3d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7f901158b0 con 0x7f7f90102ce0 2024-08-31T05:21:14.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.393+0000 7f7f96c3d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7f90115bb0 con 0x7f7f90102390 2024-08-31T05:21:14.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.394+0000 7f7f951da640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f9010ff40 0x7f7f901a1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:14.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.394+0000 7f7f951da640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f9010ff40 0x7f7f901a1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47380/0 (socket says 172.21.15.5:47380) 2024-08-31T05:21:14.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.394+0000 7f7f951da640 1 -- 172.21.15.5:0/2039284611 learned_addr learned my addr 172.21.15.5:0/2039284611 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:21:14.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.394+0000 7f7f8ffff640 1 --2- 172.21.15.5:0/2039284611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f90102ce0 0x7f7f9019c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:14.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.394+0000 7f7f949d9640 1 --2- 172.21.15.5:0/2039284611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f90102390 0x7f7f9019c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:14.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.394+0000 7f7f951da640 1 -- 172.21.15.5:0/2039284611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f90102390 msgr2=0x7f7f9019c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:14.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.394+0000 7f7f951da640 1 --2- 172.21.15.5:0/2039284611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f90102390 0x7f7f9019c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:14.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.394+0000 7f7f951da640 1 -- 172.21.15.5:0/2039284611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f90102ce0 msgr2=0x7f7f9019c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:14.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.394+0000 7f7f951da640 1 --2- 172.21.15.5:0/2039284611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f90102ce0 0x7f7f9019c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:14.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.394+0000 7f7f951da640 1 -- 172.21.15.5:0/2039284611 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f901a22d0 con 0x7f7f9010ff40 2024-08-31T05:21:14.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.394+0000 7f7f951da640 1 --2- 172.21.15.5:0/2039284611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f9010ff40 0x7f7f901a1c60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7f8800cce0 tx=0x7f7f8800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:14.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.394+0000 7f7f8dffb640 1 -- 172.21.15.5:0/2039284611 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8800f450 con 0x7f7f9010ff40 2024-08-31T05:21:14.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.394+0000 7f7f96c3d640 1 -- 172.21.15.5:0/2039284611 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f901a25c0 con 0x7f7f9010ff40 2024-08-31T05:21:14.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.394+0000 7f7f8dffb640 1 -- 172.21.15.5:0/2039284611 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f8800faa0 con 0x7f7f9010ff40 2024-08-31T05:21:14.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.394+0000 7f7f8dffb640 1 -- 172.21.15.5:0/2039284611 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f88018b70 con 0x7f7f9010ff40 2024-08-31T05:21:14.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.395+0000 7f7f96c3d640 1 -- 172.21.15.5:0/2039284611 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f901a8de0 con 0x7f7f9010ff40 2024-08-31T05:21:14.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.396+0000 7f7f96c3d640 1 -- 172.21.15.5:0/2039284611 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f9006bfe0 con 0x7f7f9010ff40 2024-08-31T05:21:14.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.397+0000 7f7f8dffb640 1 -- 172.21.15.5:0/2039284611 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) ==== 152537+0+0 (secure 0 0 0) 0x7f7f88018d10 con 0x7f7f9010ff40 2024-08-31T05:21:14.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.398+0000 7f7f8dffb640 1 --2- 172.21.15.5:0/2039284611 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f7f800b4ba0 0x7f7f800b70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:14.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.398+0000 7f7f949d9640 1 --2- 172.21.15.5:0/2039284611 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f7f800b4ba0 0x7f7f800b70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:14.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.398+0000 7f7f8dffb640 1 -- 172.21.15.5:0/2039284611 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f7f880e3980 con 0x7f7f9010ff40 2024-08-31T05:21:14.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.398+0000 7f7f949d9640 1 --2- 172.21.15.5:0/2039284611 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f7f800b4ba0 0x7f7f800b70b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7f8400bbe0 tx=0x7f7f8400b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:14.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.402+0000 7f7f8dffb640 1 -- 172.21.15.5:0/2039284611 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7f88014030 con 0x7f7f9010ff40 2024-08-31T05:21:14.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:14 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/2059050403' entity='client.admin' 2024-08-31T05:21:14.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:14 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/1848508175' entity='client.admin' 2024-08-31T05:21:14.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.592+0000 7f7f96c3d640 1 -- 172.21.15.5:0/2039284611 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f7f9010b0d0 con 0x7f7f9010ff40 2024-08-31T05:21:14.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.596+0000 7f7f8dffb640 1 -- 172.21.15.5:0/2039284611 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v24)=0 v24) ==== 119+0+0 (secure 0 0 0) 0x7f7f880ac610 con 0x7f7f9010ff40 2024-08-31T05:21:14.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.599+0000 7f7f96c3d640 1 -- 172.21.15.5:0/2039284611 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f7f800b4ba0 msgr2=0x7f7f800b70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:14.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.599+0000 7f7f96c3d640 1 --2- 172.21.15.5:0/2039284611 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f7f800b4ba0 0x7f7f800b70b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7f8400bbe0 tx=0x7f7f8400b390 comp rx=0 tx=0).stop 2024-08-31T05:21:14.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.599+0000 7f7f96c3d640 1 -- 172.21.15.5:0/2039284611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f9010ff40 msgr2=0x7f7f901a1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:14.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.599+0000 7f7f96c3d640 1 --2- 172.21.15.5:0/2039284611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f9010ff40 0x7f7f901a1c60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7f8800cce0 tx=0x7f7f8800a620 comp rx=0 tx=0).stop 2024-08-31T05:21:14.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.599+0000 7f7f96c3d640 1 -- 172.21.15.5:0/2039284611 shutdown_connections 2024-08-31T05:21:14.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.599+0000 7f7f96c3d640 1 --2- 172.21.15.5:0/2039284611 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f7f800b4ba0 0x7f7f800b70b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:14.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.599+0000 7f7f96c3d640 1 --2- 172.21.15.5:0/2039284611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f9010ff40 0x7f7f901a1c60 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:14.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.599+0000 7f7f96c3d640 1 --2- 172.21.15.5:0/2039284611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f90102ce0 0x7f7f9019c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:14.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.599+0000 7f7f96c3d640 1 --2- 172.21.15.5:0/2039284611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f90102390 0x7f7f9019c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:14.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.599+0000 7f7f96c3d640 1 -- 172.21.15.5:0/2039284611 >> 172.21.15.5:0/2039284611 conn(0x7f7f900794e0 msgr2=0x7f7f901113c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:14.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.599+0000 7f7f96c3d640 1 -- 172.21.15.5:0/2039284611 shutdown_connections 2024-08-31T05:21:14.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.599+0000 7f7f96c3d640 1 -- 172.21.15.5:0/2039284611 wait complete. 2024-08-31T05:21:14.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.671+0000 7f1f8522a640 1 -- 172.21.15.5:0/2017613408 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f801081c0 msgr2=0x7f1f801085d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:14.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.671+0000 7f1f8522a640 1 --2- 172.21.15.5:0/2017613408 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f801081c0 0x7f1f801085d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1f74009900 tx=0x7f1f7402a410 comp rx=0 tx=0).stop 2024-08-31T05:21:14.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.672+0000 7f1f8522a640 1 -- 172.21.15.5:0/2017613408 shutdown_connections 2024-08-31T05:21:14.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.672+0000 7f1f8522a640 1 --2- 172.21.15.5:0/2017613408 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f80108b10 0x7f1f8010f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:14.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.672+0000 7f1f8522a640 1 --2- 172.21.15.5:0/2017613408 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f801081c0 0x7f1f801085d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:14.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.672+0000 7f1f8522a640 1 --2- 172.21.15.5:0/2017613408 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f80102880 0x7f1f80102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:14.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.672+0000 7f1f8522a640 1 -- 172.21.15.5:0/2017613408 >> 172.21.15.5:0/2017613408 conn(0x7f1f80079510 msgr2=0x7f1f80079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:14.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.672+0000 7f1f8522a640 1 -- 172.21.15.5:0/2017613408 shutdown_connections 2024-08-31T05:21:14.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.672+0000 7f1f8522a640 1 -- 172.21.15.5:0/2017613408 wait complete. 2024-08-31T05:21:14.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.672+0000 7f1f8522a640 1 Processor -- start 2024-08-31T05:21:14.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.673+0000 7f1f8522a640 1 -- start start 2024-08-31T05:21:14.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.673+0000 7f1f8522a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f80102880 0x7f1f8019a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:14.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.673+0000 7f1f8522a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f801081c0 0x7f1f8019a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:14.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.673+0000 7f1f8522a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f80108b10 0x7f1f8019faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:14.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.673+0000 7f1f8522a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1f801127f0 con 0x7f1f801081c0 2024-08-31T05:21:14.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.673+0000 7f1f8522a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1f80112670 con 0x7f1f80108b10 2024-08-31T05:21:14.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.673+0000 7f1f8522a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1f80112970 con 0x7f1f80102880 2024-08-31T05:21:14.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.673+0000 7f1f7e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f801081c0 0x7f1f8019a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:14.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.673+0000 7f1f7e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f801081c0 0x7f1f8019a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47402/0 (socket says 172.21.15.5:47402) 2024-08-31T05:21:14.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.673+0000 7f1f7e59c640 1 -- 172.21.15.5:0/1515368380 learned_addr learned my addr 172.21.15.5:0/1515368380 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:21:14.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.673+0000 7f1f7ed9d640 1 --2- 172.21.15.5:0/1515368380 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f80102880 0x7f1f8019a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:14.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.673+0000 7f1f7f59e640 1 --2- 172.21.15.5:0/1515368380 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f80108b10 0x7f1f8019faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:14.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.673+0000 7f1f7e59c640 1 -- 172.21.15.5:0/1515368380 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f80102880 msgr2=0x7f1f8019a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:14.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.673+0000 7f1f7e59c640 1 --2- 172.21.15.5:0/1515368380 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f80102880 0x7f1f8019a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:14.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.673+0000 7f1f7e59c640 1 -- 172.21.15.5:0/1515368380 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f80108b10 msgr2=0x7f1f8019faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:14.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.673+0000 7f1f7e59c640 1 --2- 172.21.15.5:0/1515368380 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f80108b10 0x7f1f8019faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:14.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.673+0000 7f1f7e59c640 1 -- 172.21.15.5:0/1515368380 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f801a0220 con 0x7f1f801081c0 2024-08-31T05:21:14.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.674+0000 7f1f7e59c640 1 --2- 172.21.15.5:0/1515368380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f801081c0 0x7f1f8019a850 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1f74005ab0 tx=0x7f1f74003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:14.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.674+0000 7f1f67fff640 1 -- 172.21.15.5:0/1515368380 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7403f070 con 0x7f1f801081c0 2024-08-31T05:21:14.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.674+0000 7f1f67fff640 1 -- 172.21.15.5:0/1515368380 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f74031b50 con 0x7f1f801081c0 2024-08-31T05:21:14.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.674+0000 7f1f8522a640 1 -- 172.21.15.5:0/1515368380 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f801a04b0 con 0x7f1f801081c0 2024-08-31T05:21:14.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.674+0000 7f1f67fff640 1 -- 172.21.15.5:0/1515368380 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f74035030 con 0x7f1f801081c0 2024-08-31T05:21:14.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.674+0000 7f1f8522a640 1 -- 172.21.15.5:0/1515368380 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f801a6c70 con 0x7f1f801081c0 2024-08-31T05:21:14.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.675+0000 7f1f8522a640 1 -- 172.21.15.5:0/1515368380 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f80103b00 con 0x7f1f801081c0 2024-08-31T05:21:14.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.676+0000 7f1f67fff640 1 -- 172.21.15.5:0/1515368380 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) ==== 152537+0+0 (secure 0 0 0) 0x7f1f74042070 con 0x7f1f801081c0 2024-08-31T05:21:14.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.677+0000 7f1f67fff640 1 --2- 172.21.15.5:0/1515368380 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f1f680b4af0 0x7f1f680b7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:14.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.677+0000 7f1f7ed9d640 1 --2- 172.21.15.5:0/1515368380 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f1f680b4af0 0x7f1f680b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:14.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.677+0000 7f1f67fff640 1 -- 172.21.15.5:0/1515368380 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f1f74103f10 con 0x7f1f801081c0 2024-08-31T05:21:14.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.678+0000 7f1f7ed9d640 1 --2- 172.21.15.5:0/1515368380 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f1f680b4af0 0x7f1f680b7000 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1f70009bd0 tx=0x7f1f70005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:14.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.681+0000 7f1f67fff640 1 -- 172.21.15.5:0/1515368380 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f1f740cc550 con 0x7f1f801081c0 2024-08-31T05:21:14.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:14 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/2059050403' entity='client.admin' 2024-08-31T05:21:14.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:14 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/1848508175' entity='client.admin' 2024-08-31T05:21:14.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.873+0000 7f1f8522a640 1 -- 172.21.15.5:0/1515368380 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7f1f80102c90 con 0x7f1f801081c0 2024-08-31T05:21:14.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.877+0000 7f1f67fff640 1 -- 172.21.15.5:0/1515368380 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v25)=0 v25) ==== 133+0+0 (secure 0 0 0) 0x7f1f740d0d10 con 0x7f1f801081c0 2024-08-31T05:21:14.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.879+0000 7f1f8522a640 1 -- 172.21.15.5:0/1515368380 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f1f680b4af0 msgr2=0x7f1f680b7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:14.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.879+0000 7f1f8522a640 1 --2- 172.21.15.5:0/1515368380 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f1f680b4af0 0x7f1f680b7000 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1f70009bd0 tx=0x7f1f70005f90 comp rx=0 tx=0).stop 2024-08-31T05:21:14.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.879+0000 7f1f8522a640 1 -- 172.21.15.5:0/1515368380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f801081c0 msgr2=0x7f1f8019a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:14.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.879+0000 7f1f8522a640 1 --2- 172.21.15.5:0/1515368380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f801081c0 0x7f1f8019a850 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1f74005ab0 tx=0x7f1f74003b90 comp rx=0 tx=0).stop 2024-08-31T05:21:14.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.879+0000 7f1f8522a640 1 -- 172.21.15.5:0/1515368380 shutdown_connections 2024-08-31T05:21:14.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.879+0000 7f1f8522a640 1 --2- 172.21.15.5:0/1515368380 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f1f680b4af0 0x7f1f680b7000 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:14.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.879+0000 7f1f8522a640 1 --2- 172.21.15.5:0/1515368380 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f80108b10 0x7f1f8019faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:14.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.879+0000 7f1f8522a640 1 --2- 172.21.15.5:0/1515368380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f801081c0 0x7f1f8019a850 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:14.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.879+0000 7f1f8522a640 1 --2- 172.21.15.5:0/1515368380 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f80102880 0x7f1f8019a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:14.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.879+0000 7f1f8522a640 1 -- 172.21.15.5:0/1515368380 >> 172.21.15.5:0/1515368380 conn(0x7f1f80079510 msgr2=0x7f1f80101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:14.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.880+0000 7f1f8522a640 1 -- 172.21.15.5:0/1515368380 shutdown_connections 2024-08-31T05:21:14.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.880+0000 7f1f8522a640 1 -- 172.21.15.5:0/1515368380 wait complete. 2024-08-31T05:21:14.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:14 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/2059050403' entity='client.admin' 2024-08-31T05:21:14.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:14 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/1848508175' entity='client.admin' 2024-08-31T05:21:15.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.969+0000 7fb402390640 1 -- 172.21.15.5:0/2339778458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3fc102800 msgr2=0x7fb3fc102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:15.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.969+0000 7fb402390640 1 --2- 172.21.15.5:0/2339778458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3fc102800 0x7fb3fc102c10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec009900 tx=0x7fb3ec02a410 comp rx=0 tx=0).stop 2024-08-31T05:21:15.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.969+0000 7fb402390640 1 -- 172.21.15.5:0/2339778458 shutdown_connections 2024-08-31T05:21:15.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.969+0000 7fb402390640 1 --2- 172.21.15.5:0/2339778458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb3fc108a90 0x7fb3fc10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:15.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.969+0000 7fb402390640 1 --2- 172.21.15.5:0/2339778458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3fc108140 0x7fb3fc108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:15.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.969+0000 7fb402390640 1 --2- 172.21.15.5:0/2339778458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3fc102800 0x7fb3fc102c10 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:15.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.969+0000 7fb402390640 1 -- 172.21.15.5:0/2339778458 >> 172.21.15.5:0/2339778458 conn(0x7fb3fc0794d0 msgr2=0x7fb3fc0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:15.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.969+0000 7fb402390640 1 -- 172.21.15.5:0/2339778458 shutdown_connections 2024-08-31T05:21:15.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.969+0000 7fb402390640 1 -- 172.21.15.5:0/2339778458 wait complete. 2024-08-31T05:21:15.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.970+0000 7fb402390640 1 Processor -- start 2024-08-31T05:21:15.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.970+0000 7fb402390640 1 -- start start 2024-08-31T05:21:15.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.970+0000 7fb402390640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3fc102800 0x7fb3fc103ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:15.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.970+0000 7fb402390640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3fc108140 0x7fb3fc104530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:15.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.970+0000 7fb402390640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb3fc108a90 0x7fb3fc104a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:15.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.970+0000 7fb402390640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb3fc1126f0 con 0x7fb3fc108140 2024-08-31T05:21:15.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.970+0000 7fb402390640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb3fc112570 con 0x7fb3fc102800 2024-08-31T05:21:15.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.970+0000 7fb402390640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb3fc112870 con 0x7fb3fc108a90 2024-08-31T05:21:15.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.970+0000 7fb3f3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3fc108140 0x7fb3fc104530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:15.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.970+0000 7fb3f3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3fc108140 0x7fb3fc104530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47414/0 (socket says 172.21.15.5:47414) 2024-08-31T05:21:15.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.970+0000 7fb3f3fff640 1 -- 172.21.15.5:0/2241142951 learned_addr learned my addr 172.21.15.5:0/2241142951 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:21:15.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.970+0000 7fb3fbfff640 1 --2- 172.21.15.5:0/2241142951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3fc102800 0x7fb3fc103ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:15.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.970+0000 7fb40092d640 1 --2- 172.21.15.5:0/2241142951 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb3fc108a90 0x7fb3fc104a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:15.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.970+0000 7fb3f3fff640 1 -- 172.21.15.5:0/2241142951 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb3fc108a90 msgr2=0x7fb3fc104a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:15.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.970+0000 7fb3f3fff640 1 --2- 172.21.15.5:0/2241142951 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb3fc108a90 0x7fb3fc104a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:15.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.970+0000 7fb3f3fff640 1 -- 172.21.15.5:0/2241142951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3fc102800 msgr2=0x7fb3fc103ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:15.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.970+0000 7fb3f3fff640 1 --2- 172.21.15.5:0/2241142951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3fc102800 0x7fb3fc103ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:15.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.971+0000 7fb3f3fff640 1 -- 172.21.15.5:0/2241142951 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3fc1a8550 con 0x7fb3fc108140 2024-08-31T05:21:15.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.971+0000 7fb3f3fff640 1 --2- 172.21.15.5:0/2241142951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3fc108140 0x7fb3fc104530 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb3e400e9c0 tx=0x7fb3e400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:15.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.971+0000 7fb3f9ffb640 1 -- 172.21.15.5:0/2241142951 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3e400cd80 con 0x7fb3fc108140 2024-08-31T05:21:15.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.971+0000 7fb3f9ffb640 1 -- 172.21.15.5:0/2241142951 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3e40054d0 con 0x7fb3fc108140 2024-08-31T05:21:15.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.971+0000 7fb402390640 1 -- 172.21.15.5:0/2241142951 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3fc1a8840 con 0x7fb3fc108140 2024-08-31T05:21:15.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.971+0000 7fb3f9ffb640 1 -- 172.21.15.5:0/2241142951 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3e4010430 con 0x7fb3fc108140 2024-08-31T05:21:15.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.971+0000 7fb402390640 1 -- 172.21.15.5:0/2241142951 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3fc1a8dd0 con 0x7fb3fc108140 2024-08-31T05:21:15.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.972+0000 7fb402390640 1 -- 172.21.15.5:0/2241142951 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3fc102c10 con 0x7fb3fc108140 2024-08-31T05:21:15.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.974+0000 7fb3f9ffb640 1 -- 172.21.15.5:0/2241142951 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) ==== 152537+0+0 (secure 0 0 0) 0x7fb3e4004fb0 con 0x7fb3fc108140 2024-08-31T05:21:15.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.975+0000 7fb3f9ffb640 1 --2- 172.21.15.5:0/2241142951 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb3e80b4b70 0x7fb3e80b7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:15.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.975+0000 7fb3fbfff640 1 --2- 172.21.15.5:0/2241142951 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb3e80b4b70 0x7fb3e80b7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:15.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.975+0000 7fb3f9ffb640 1 -- 172.21.15.5:0/2241142951 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fb3e40e3d00 con 0x7fb3fc108140 2024-08-31T05:21:15.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.976+0000 7fb3fbfff640 1 --2- 172.21.15.5:0/2241142951 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb3e80b4b70 0x7fb3e80b7080 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec000c00 tx=0x7fb3ec031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:15.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:14.978+0000 7fb3f9ffb640 1 -- 172.21.15.5:0/2241142951 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb3e4056130 con 0x7fb3fc108140 2024-08-31T05:21:15.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:15.165+0000 7fb402390640 1 -- 172.21.15.5:0/2241142951 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fb3fc1052f0 con 0x7fb3fc108140 2024-08-31T05:21:15.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:15.169+0000 7fb3f9ffb640 1 -- 172.21.15.5:0/2241142951 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v26)=0 v26) ==== 121+0+0 (secure 0 0 0) 0x7fb3fc1052f0 con 0x7fb3fc108140 2024-08-31T05:21:15.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:15.171+0000 7fb402390640 1 -- 172.21.15.5:0/2241142951 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb3e80b4b70 msgr2=0x7fb3e80b7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:15.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:15.171+0000 7fb402390640 1 --2- 172.21.15.5:0/2241142951 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb3e80b4b70 0x7fb3e80b7080 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec000c00 tx=0x7fb3ec031400 comp rx=0 tx=0).stop 2024-08-31T05:21:15.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:15.171+0000 7fb402390640 1 -- 172.21.15.5:0/2241142951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3fc108140 msgr2=0x7fb3fc104530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:15.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:15.171+0000 7fb402390640 1 --2- 172.21.15.5:0/2241142951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3fc108140 0x7fb3fc104530 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb3e400e9c0 tx=0x7fb3e400ee80 comp rx=0 tx=0).stop 2024-08-31T05:21:15.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:15.171+0000 7fb402390640 1 -- 172.21.15.5:0/2241142951 shutdown_connections 2024-08-31T05:21:15.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:15.171+0000 7fb402390640 1 --2- 172.21.15.5:0/2241142951 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb3e80b4b70 0x7fb3e80b7080 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:15.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:15.171+0000 7fb402390640 1 --2- 172.21.15.5:0/2241142951 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb3fc108a90 0x7fb3fc104a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:15.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:15.171+0000 7fb402390640 1 --2- 172.21.15.5:0/2241142951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3fc108140 0x7fb3fc104530 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:15.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:15.171+0000 7fb402390640 1 --2- 172.21.15.5:0/2241142951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3fc102800 0x7fb3fc103ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:15.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:15.171+0000 7fb402390640 1 -- 172.21.15.5:0/2241142951 >> 172.21.15.5:0/2241142951 conn(0x7fb3fc0794d0 msgr2=0x7fb3fc1018e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:15.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:15.171+0000 7fb402390640 1 -- 172.21.15.5:0/2241142951 shutdown_connections 2024-08-31T05:21:15.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:15.171+0000 7fb402390640 1 -- 172.21.15.5:0/2241142951 wait complete. 2024-08-31T05:21:15.900 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:15 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/2039284611' entity='client.admin' 2024-08-31T05:21:15.900 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:15 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/1515368380' entity='client.admin' 2024-08-31T05:21:15.900 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:15 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/2241142951' entity='client.admin' 2024-08-31T05:21:15.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:15 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/2039284611' entity='client.admin' 2024-08-31T05:21:15.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:15 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/1515368380' entity='client.admin' 2024-08-31T05:21:15.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:15 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/2241142951' entity='client.admin' 2024-08-31T05:21:16.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:15 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/2039284611' entity='client.admin' 2024-08-31T05:21:16.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:15 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/1515368380' entity='client.admin' 2024-08-31T05:21:16.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:15 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/2241142951' entity='client.admin' 2024-08-31T05:21:16.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.688+0000 7f22f0375640 1 -- 172.21.15.5:0/2102847114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22e8108160 msgr2=0x7f22e8108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:16.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.688+0000 7f22f0375640 1 --2- 172.21.15.5:0/2102847114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22e8108160 0x7f22e8108570 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f22d8009900 tx=0x7f22d802a410 comp rx=0 tx=0).stop 2024-08-31T05:21:16.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.688+0000 7f22f0375640 1 -- 172.21.15.5:0/2102847114 shutdown_connections 2024-08-31T05:21:16.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.688+0000 7f22f0375640 1 --2- 172.21.15.5:0/2102847114 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22e8108ab0 0x7f22e810f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:16.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.688+0000 7f22f0375640 1 --2- 172.21.15.5:0/2102847114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22e8108160 0x7f22e8108570 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:16.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.688+0000 7f22f0375640 1 --2- 172.21.15.5:0/2102847114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22e8102820 0x7f22e8102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:16.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.688+0000 7f22f0375640 1 -- 172.21.15.5:0/2102847114 >> 172.21.15.5:0/2102847114 conn(0x7f22e80794e0 msgr2=0x7f22e80798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:16.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.688+0000 7f22f0375640 1 -- 172.21.15.5:0/2102847114 shutdown_connections 2024-08-31T05:21:16.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.688+0000 7f22f0375640 1 -- 172.21.15.5:0/2102847114 wait complete. 2024-08-31T05:21:16.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.689+0000 7f22f0375640 1 Processor -- start 2024-08-31T05:21:16.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.689+0000 7f22f0375640 1 -- start start 2024-08-31T05:21:16.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.689+0000 7f22f0375640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22e8102820 0x7f22e8104ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:16.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.689+0000 7f22f0375640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22e8108160 0x7f22e81053e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:16.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.689+0000 7f22f0375640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22e8108ab0 0x7f22e8105920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:16.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.689+0000 7f22f0375640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f22e8112700 con 0x7f22e8102820 2024-08-31T05:21:16.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.689+0000 7f22f0375640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f22e8112580 con 0x7f22e8108160 2024-08-31T05:21:16.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.689+0000 7f22f0375640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f22e8112880 con 0x7f22e8108ab0 2024-08-31T05:21:16.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.689+0000 7f22ee111640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22e8102820 0x7f22e8104ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:16.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.689+0000 7f22ee111640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22e8102820 0x7f22e8104ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47438/0 (socket says 172.21.15.5:47438) 2024-08-31T05:21:16.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.689+0000 7f22ee111640 1 -- 172.21.15.5:0/3842293267 learned_addr learned my addr 172.21.15.5:0/3842293267 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:21:16.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.690+0000 7f22ed910640 1 --2- 172.21.15.5:0/3842293267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22e8108160 0x7f22e81053e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:16.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.690+0000 7f22ee912640 1 --2- 172.21.15.5:0/3842293267 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22e8108ab0 0x7f22e8105920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:16.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.690+0000 7f22ee111640 1 -- 172.21.15.5:0/3842293267 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22e8108ab0 msgr2=0x7f22e8105920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:16.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.690+0000 7f22ee111640 1 --2- 172.21.15.5:0/3842293267 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22e8108ab0 0x7f22e8105920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:16.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.690+0000 7f22ee111640 1 -- 172.21.15.5:0/3842293267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22e8108160 msgr2=0x7f22e81053e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:16.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.690+0000 7f22ee111640 1 --2- 172.21.15.5:0/3842293267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22e8108160 0x7f22e81053e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:16.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.690+0000 7f22ee111640 1 -- 172.21.15.5:0/3842293267 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22e81a8470 con 0x7f22e8102820 2024-08-31T05:21:16.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.690+0000 7f22ee111640 1 --2- 172.21.15.5:0/3842293267 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22e8102820 0x7f22e8104ea0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f22e400c950 tx=0x7f22e400ce10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:16.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.690+0000 7f22df7fe640 1 -- 172.21.15.5:0/3842293267 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e4007c70 con 0x7f22e8102820 2024-08-31T05:21:16.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.690+0000 7f22df7fe640 1 -- 172.21.15.5:0/3842293267 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22e4007e10 con 0x7f22e8102820 2024-08-31T05:21:16.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.690+0000 7f22f0375640 1 -- 172.21.15.5:0/3842293267 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22e81a8760 con 0x7f22e8102820 2024-08-31T05:21:16.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.690+0000 7f22df7fe640 1 -- 172.21.15.5:0/3842293267 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e40187f0 con 0x7f22e8102820 2024-08-31T05:21:16.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.690+0000 7f22f0375640 1 -- 172.21.15.5:0/3842293267 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22e81a8cc0 con 0x7f22e8102820 2024-08-31T05:21:16.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.691+0000 7f22f0375640 1 -- 172.21.15.5:0/3842293267 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22e8103aa0 con 0x7f22e8102820 2024-08-31T05:21:16.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.693+0000 7f22df7fe640 1 -- 172.21.15.5:0/3842293267 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) ==== 152537+0+0 (secure 0 0 0) 0x7f22e4018990 con 0x7f22e8102820 2024-08-31T05:21:16.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.694+0000 7f22df7fe640 1 --2- 172.21.15.5:0/3842293267 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f22d40b4bf0 0x7f22d40b7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:16.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.694+0000 7f22ed910640 1 --2- 172.21.15.5:0/3842293267 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f22d40b4bf0 0x7f22d40b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:16.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.694+0000 7f22df7fe640 1 -- 172.21.15.5:0/3842293267 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f22e40e3950 con 0x7f22e8102820 2024-08-31T05:21:16.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.694+0000 7f22ed910640 1 --2- 172.21.15.5:0/3842293267 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f22d40b4bf0 0x7f22d40b7100 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f22d8000c00 tx=0x7f22d8031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:16.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.697+0000 7f22df7fe640 1 -- 172.21.15.5:0/3842293267 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f22e4014030 con 0x7f22e8102820 2024-08-31T05:21:16.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.888+0000 7f22f0375640 1 -- 172.21.15.5:0/3842293267 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f22e81061a0 con 0x7f22e8102820 2024-08-31T05:21:16.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.892+0000 7f22df7fe640 1 -- 172.21.15.5:0/3842293267 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v28)=0 v28) ==== 118+0+0 (secure 0 0 0) 0x7f22e40ac6f0 con 0x7f22e8102820 2024-08-31T05:21:16.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.894+0000 7f22f0375640 1 -- 172.21.15.5:0/3842293267 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f22d40b4bf0 msgr2=0x7f22d40b7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:16.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.894+0000 7f22f0375640 1 --2- 172.21.15.5:0/3842293267 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f22d40b4bf0 0x7f22d40b7100 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f22d8000c00 tx=0x7f22d8031400 comp rx=0 tx=0).stop 2024-08-31T05:21:16.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.894+0000 7f22f0375640 1 -- 172.21.15.5:0/3842293267 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22e8102820 msgr2=0x7f22e8104ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:16.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.894+0000 7f22f0375640 1 --2- 172.21.15.5:0/3842293267 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22e8102820 0x7f22e8104ea0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f22e400c950 tx=0x7f22e400ce10 comp rx=0 tx=0).stop 2024-08-31T05:21:16.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.894+0000 7f22f0375640 1 -- 172.21.15.5:0/3842293267 shutdown_connections 2024-08-31T05:21:16.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.894+0000 7f22f0375640 1 --2- 172.21.15.5:0/3842293267 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f22d40b4bf0 0x7f22d40b7100 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:16.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.894+0000 7f22f0375640 1 --2- 172.21.15.5:0/3842293267 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22e8108ab0 0x7f22e8105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:16.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.894+0000 7f22f0375640 1 --2- 172.21.15.5:0/3842293267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f22e8108160 0x7f22e81053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:16.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.894+0000 7f22f0375640 1 --2- 172.21.15.5:0/3842293267 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22e8102820 0x7f22e8104ea0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:16.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.894+0000 7f22f0375640 1 -- 172.21.15.5:0/3842293267 >> 172.21.15.5:0/3842293267 conn(0x7f22e80794e0 msgr2=0x7f22e806bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:16.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.895+0000 7f22f0375640 1 -- 172.21.15.5:0/3842293267 shutdown_connections 2024-08-31T05:21:16.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.895+0000 7f22f0375640 1 -- 172.21.15.5:0/3842293267 wait complete. 2024-08-31T05:21:17.243 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '69422704-6758-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi005') 2024-08-31T05:21:17.243 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '69422704-6758-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi005') 2024-08-31T05:21:17.243 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '69422704-6758-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi005') 2024-08-31T05:21:17.243 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '69422704-6758-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi005') 2024-08-31T05:21:17.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:17.401+0000 7fec6c975640 1 -- 172.21.15.5:0/2145802077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec68103920 msgr2=0x7fec68103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:17.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:17.401+0000 7fec6c975640 1 --2- 172.21.15.5:0/2145802077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec68103920 0x7fec68103d30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fec58009900 tx=0x7fec5802a410 comp rx=0 tx=0).stop 2024-08-31T05:21:17.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:17.401+0000 7fec6c975640 1 -- 172.21.15.5:0/2145802077 shutdown_connections 2024-08-31T05:21:17.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:17.401+0000 7fec6c975640 1 --2- 172.21.15.5:0/2145802077 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec68109bb0 0x7fec681103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:17.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:17.401+0000 7fec6c975640 1 --2- 172.21.15.5:0/2145802077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec68109260 0x7fec68109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:17.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:17.401+0000 7fec6c975640 1 --2- 172.21.15.5:0/2145802077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec68103920 0x7fec68103d30 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:17.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:17.401+0000 7fec6c975640 1 -- 172.21.15.5:0/2145802077 >> 172.21.15.5:0/2145802077 conn(0x7fec680ff3b0 msgr2=0x7fec68101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:17.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:17.401+0000 7fec6c975640 1 -- 172.21.15.5:0/2145802077 shutdown_connections 2024-08-31T05:21:17.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:17.401+0000 7fec6c975640 1 -- 172.21.15.5:0/2145802077 wait complete. 2024-08-31T05:21:17.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:17.402+0000 7fec6c975640 1 Processor -- start 2024-08-31T05:21:17.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:17.402+0000 7fec6c975640 1 -- start start 2024-08-31T05:21:17.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:17.402+0000 7fec6c975640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec68103920 0x7fec6819a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:17.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:17.402+0000 7fec6c975640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec68109260 0x7fec6819a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:17.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:17.402+0000 7fec6c975640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec68109bb0 0x7fec6819faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:17.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:17.402+0000 7fec6c975640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fec68113870 con 0x7fec68109bb0 2024-08-31T05:21:17.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:17.402+0000 7fec6c975640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fec681136f0 con 0x7fec68109260 2024-08-31T05:21:17.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:17.402+0000 7fec6c975640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fec681139f0 con 0x7fec68103920 2024-08-31T05:21:17.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:17.402+0000 7fec66d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec68109bb0 0x7fec6819faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:17.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:17.402+0000 7fec66d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec68109bb0 0x7fec6819faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47452/0 (socket says 172.21.15.5:47452) 2024-08-31T05:21:17.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:17.402+0000 7fec66d9d640 1 -- 172.21.15.5:0/3106760204 learned_addr learned my addr 172.21.15.5:0/3106760204 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:21:17.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:17.402+0000 7fec6659c640 1 --2- 172.21.15.5:0/3106760204 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec68103920 0x7fec6819a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:17.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:17.402+0000 7fec65d9b640 1 --2- 172.21.15.5:0/3106760204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec68109260 0x7fec6819a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:17.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:17.402+0000 7fec66d9d640 1 -- 172.21.15.5:0/3106760204 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec68103920 msgr2=0x7fec6819a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:17.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:17.402+0000 7fec66d9d640 1 --2- 172.21.15.5:0/3106760204 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec68103920 0x7fec6819a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:17.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:17.402+0000 7fec66d9d640 1 -- 172.21.15.5:0/3106760204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec68109260 msgr2=0x7fec6819a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:17.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:17.402+0000 7fec66d9d640 1 --2- 172.21.15.5:0/3106760204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec68109260 0x7fec6819a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:17.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:17.402+0000 7fec66d9d640 1 -- 172.21.15.5:0/3106760204 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec681a01d0 con 0x7fec68109bb0 2024-08-31T05:21:17.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:17.403+0000 7fec66d9d640 1 --2- 172.21.15.5:0/3106760204 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec68109bb0 0x7fec6819faa0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fec60009fd0 tx=0x7fec6000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:17.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:17.403+0000 7fec577fe640 1 -- 172.21.15.5:0/3106760204 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec60017070 con 0x7fec68109bb0 2024-08-31T05:21:17.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:17.403+0000 7fec577fe640 1 -- 172.21.15.5:0/3106760204 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec60003e20 con 0x7fec68109bb0 2024-08-31T05:21:17.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:17.403+0000 7fec6c975640 1 -- 172.21.15.5:0/3106760204 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec681a04c0 con 0x7fec68109bb0 2024-08-31T05:21:17.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:17.403+0000 7fec577fe640 1 -- 172.21.15.5:0/3106760204 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec60010460 con 0x7fec68109bb0 2024-08-31T05:21:17.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:17.403+0000 7fec6c975640 1 -- 172.21.15.5:0/3106760204 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec681a6c20 con 0x7fec68109bb0 2024-08-31T05:21:17.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:17.404+0000 7fec6c975640 1 -- 172.21.15.5:0/3106760204 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec68103d30 con 0x7fec68109bb0 2024-08-31T05:21:17.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:17.406+0000 7fec577fe640 1 -- 172.21.15.5:0/3106760204 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) ==== 152537+0+0 (secure 0 0 0) 0x7fec60003970 con 0x7fec68109bb0 2024-08-31T05:21:17.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:17.406+0000 7fec577fe640 1 --2- 172.21.15.5:0/3106760204 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fec500b4af0 0x7fec500b7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:17.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:17.406+0000 7fec6659c640 1 --2- 172.21.15.5:0/3106760204 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fec500b4af0 0x7fec500b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:17.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:17.406+0000 7fec577fe640 1 -- 172.21.15.5:0/3106760204 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fec600e36b0 con 0x7fec68109bb0 2024-08-31T05:21:17.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:17.407+0000 7fec6659c640 1 --2- 172.21.15.5:0/3106760204 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fec500b4af0 0x7fec500b7000 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fec58031440 tx=0x7fec58009560 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:17.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:17.410+0000 7fec577fe640 1 -- 172.21.15.5:0/3106760204 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fec600ac3e0 con 0x7fec68109bb0 2024-08-31T05:21:17.415 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:21:17.466 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:17 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/1866334165' entity='client.admin' 2024-08-31T05:21:17.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:17 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/3842293267' entity='client.admin' 2024-08-31T05:21:17.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:15.996+0000 7ff6e0e9d640 1 -- 172.21.15.5:0/3131490943 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6dc103940 msgr2=0x7ff6dc103d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:17.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:15.996+0000 7ff6e0e9d640 1 --2- 172.21.15.5:0/3131490943 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6dc103940 0x7ff6dc103d50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc009900 tx=0x7ff6cc02a3f0 comp rx=0 tx=0).stop 2024-08-31T05:21:17.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:15.996+0000 7ff6e0e9d640 1 -- 172.21.15.5:0/3131490943 shutdown_connections 2024-08-31T05:21:17.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:15.996+0000 7ff6e0e9d640 1 --2- 172.21.15.5:0/3131490943 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6dc109bd0 0x7ff6dc110400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:17.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:15.996+0000 7ff6e0e9d640 1 --2- 172.21.15.5:0/3131490943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff6dc109280 0x7ff6dc109690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:17.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:15.996+0000 7ff6e0e9d640 1 --2- 172.21.15.5:0/3131490943 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6dc103940 0x7ff6dc103d50 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:17.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:15.996+0000 7ff6e0e9d640 1 -- 172.21.15.5:0/3131490943 >> 172.21.15.5:0/3131490943 conn(0x7ff6dc0ff3d0 msgr2=0x7ff6dc101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:17.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:15.996+0000 7ff6e0e9d640 1 -- 172.21.15.5:0/3131490943 shutdown_connections 2024-08-31T05:21:17.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:15.996+0000 7ff6e0e9d640 1 -- 172.21.15.5:0/3131490943 wait complete. 2024-08-31T05:21:17.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:15.997+0000 7ff6e0e9d640 1 Processor -- start 2024-08-31T05:21:17.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:15.997+0000 7ff6e0e9d640 1 -- start start 2024-08-31T05:21:17.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:15.997+0000 7ff6e0e9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff6dc103940 0x7ff6dc0754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:17.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:15.997+0000 7ff6e0e9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6dc109280 0x7ff6dc0759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:17.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:15.997+0000 7ff6e0e9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6dc109bd0 0x7ff6dc075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:17.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:15.997+0000 7ff6e0e9d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff6dc113890 con 0x7ff6dc109bd0 2024-08-31T05:21:17.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:15.997+0000 7ff6e0e9d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff6dc113710 con 0x7ff6dc109280 2024-08-31T05:21:17.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:15.997+0000 7ff6e0e9d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff6dc113a10 con 0x7ff6dc103940 2024-08-31T05:21:17.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:15.997+0000 7ff6dad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6dc109bd0 0x7ff6dc075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:17.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:15.998+0000 7ff6dad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6dc109bd0 0x7ff6dc075f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47424/0 (socket says 172.21.15.5:47424) 2024-08-31T05:21:17.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:15.998+0000 7ff6dad9d640 1 -- 172.21.15.5:0/1866334165 learned_addr learned my addr 172.21.15.5:0/1866334165 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:21:17.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:15.998+0000 7ff6da59c640 1 --2- 172.21.15.5:0/1866334165 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff6dc103940 0x7ff6dc0754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:17.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:15.998+0000 7ff6d9d9b640 1 --2- 172.21.15.5:0/1866334165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6dc109280 0x7ff6dc0759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:17.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:15.998+0000 7ff6dad9d640 1 -- 172.21.15.5:0/1866334165 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff6dc103940 msgr2=0x7ff6dc0754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:17.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:15.998+0000 7ff6dad9d640 1 --2- 172.21.15.5:0/1866334165 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff6dc103940 0x7ff6dc0754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:17.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:15.998+0000 7ff6dad9d640 1 -- 172.21.15.5:0/1866334165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6dc109280 msgr2=0x7ff6dc0759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:17.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:15.998+0000 7ff6dad9d640 1 --2- 172.21.15.5:0/1866334165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6dc109280 0x7ff6dc0759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:17.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:15.998+0000 7ff6dad9d640 1 -- 172.21.15.5:0/1866334165 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6dc1a8450 con 0x7ff6dc109bd0 2024-08-31T05:21:17.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:15.998+0000 7ff6da59c640 1 --2- 172.21.15.5:0/1866334165 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff6dc103940 0x7ff6dc0754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:21:17.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:15.998+0000 7ff6d9d9b640 1 --2- 172.21.15.5:0/1866334165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6dc109280 0x7ff6dc0759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:21:17.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:15.998+0000 7ff6dad9d640 1 --2- 172.21.15.5:0/1866334165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6dc109bd0 0x7ff6dc075f30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff6d400cce0 tx=0x7ff6d400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:17.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:15.998+0000 7ff6cb7fe640 1 -- 172.21.15.5:0/1866334165 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d400f450 con 0x7ff6dc109bd0 2024-08-31T05:21:17.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:15.998+0000 7ff6cb7fe640 1 -- 172.21.15.5:0/1866334165 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6d400faa0 con 0x7ff6dc109bd0 2024-08-31T05:21:17.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:15.998+0000 7ff6e0e9d640 1 -- 172.21.15.5:0/1866334165 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6dc1a8740 con 0x7ff6dc109bd0 2024-08-31T05:21:17.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:15.998+0000 7ff6cb7fe640 1 -- 172.21.15.5:0/1866334165 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d4018b70 con 0x7ff6dc109bd0 2024-08-31T05:21:17.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:15.998+0000 7ff6e0e9d640 1 -- 172.21.15.5:0/1866334165 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6dc1a8c30 con 0x7ff6dc109bd0 2024-08-31T05:21:17.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:15.999+0000 7ff6e0e9d640 1 -- 172.21.15.5:0/1866334165 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6dc103d50 con 0x7ff6dc109bd0 2024-08-31T05:21:17.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.001+0000 7ff6cb7fe640 1 -- 172.21.15.5:0/1866334165 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) ==== 152537+0+0 (secure 0 0 0) 0x7ff6d4018d10 con 0x7ff6dc109bd0 2024-08-31T05:21:17.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.001+0000 7ff6cb7fe640 1 --2- 172.21.15.5:0/1866334165 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff6c40b4af0 0x7ff6c40b7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:17.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.002+0000 7ff6cb7fe640 1 -- 172.21.15.5:0/1866334165 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7ff6d40e3b60 con 0x7ff6dc109bd0 2024-08-31T05:21:17.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.002+0000 7ff6da59c640 1 --2- 172.21.15.5:0/1866334165 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff6c40b4af0 0x7ff6c40b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:17.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.002+0000 7ff6da59c640 1 --2- 172.21.15.5:0/1866334165 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff6c40b4af0 0x7ff6c40b7000 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc000c00 tx=0x7ff6cc031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:17.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.004+0000 7ff6cb7fe640 1 -- 172.21.15.5:0/1866334165 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff6d4014030 con 0x7ff6dc109bd0 2024-08-31T05:21:17.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.192+0000 7ff6e0e9d640 1 -- 172.21.15.5:0/1866334165 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7ff6dc0767b0 con 0x7ff6dc109bd0 2024-08-31T05:21:17.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.196+0000 7ff6cb7fe640 1 -- 172.21.15.5:0/1866334165 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v27)=0 v27) ==== 125+0+0 (secure 0 0 0) 0x7ff6d40ac920 con 0x7ff6dc109bd0 2024-08-31T05:21:17.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.199+0000 7ff6e0e9d640 1 -- 172.21.15.5:0/1866334165 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff6c40b4af0 msgr2=0x7ff6c40b7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:17.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.199+0000 7ff6e0e9d640 1 --2- 172.21.15.5:0/1866334165 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff6c40b4af0 0x7ff6c40b7000 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc000c00 tx=0x7ff6cc031400 comp rx=0 tx=0).stop 2024-08-31T05:21:17.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.199+0000 7ff6e0e9d640 1 -- 172.21.15.5:0/1866334165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6dc109bd0 msgr2=0x7ff6dc075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:17.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.199+0000 7ff6e0e9d640 1 --2- 172.21.15.5:0/1866334165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6dc109bd0 0x7ff6dc075f30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff6d400cce0 tx=0x7ff6d400a620 comp rx=0 tx=0).stop 2024-08-31T05:21:17.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.199+0000 7ff6e0e9d640 1 -- 172.21.15.5:0/1866334165 shutdown_connections 2024-08-31T05:21:17.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.199+0000 7ff6e0e9d640 1 --2- 172.21.15.5:0/1866334165 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff6c40b4af0 0x7ff6c40b7000 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:17.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.199+0000 7ff6e0e9d640 1 --2- 172.21.15.5:0/1866334165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff6dc109bd0 0x7ff6dc075f30 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:17.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.199+0000 7ff6e0e9d640 1 --2- 172.21.15.5:0/1866334165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff6dc109280 0x7ff6dc0759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:17.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.199+0000 7ff6e0e9d640 1 --2- 172.21.15.5:0/1866334165 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff6dc103940 0x7ff6dc0754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:17.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.199+0000 7ff6e0e9d640 1 -- 172.21.15.5:0/1866334165 >> 172.21.15.5:0/1866334165 conn(0x7ff6dc0ff3d0 msgr2=0x7ff6dc1088f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:17.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.199+0000 7ff6e0e9d640 1 -- 172.21.15.5:0/1866334165 shutdown_connections 2024-08-31T05:21:17.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:16.199+0000 7ff6e0e9d640 1 -- 172.21.15.5:0/1866334165 wait complete. 2024-08-31T05:21:17.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:17 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/1866334165' entity='client.admin' 2024-08-31T05:21:17.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:17 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/3842293267' entity='client.admin' 2024-08-31T05:21:17.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:17.599+0000 7fec6c975640 1 -- 172.21.15.5:0/3106760204 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7fec6802e430 con 0x7fec68109bb0 2024-08-31T05:21:17.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:17.603+0000 7fec577fe640 1 -- 172.21.15.5:0/3106760204 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v29)=0 v29) ==== 138+0+0 (secure 0 0 0) 0x7fec600abce0 con 0x7fec68109bb0 2024-08-31T05:21:17.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:17.605+0000 7fec6c975640 1 -- 172.21.15.5:0/3106760204 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fec500b4af0 msgr2=0x7fec500b7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:17.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:17.605+0000 7fec6c975640 1 --2- 172.21.15.5:0/3106760204 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fec500b4af0 0x7fec500b7000 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fec58031440 tx=0x7fec58009560 comp rx=0 tx=0).stop 2024-08-31T05:21:17.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:17.605+0000 7fec6c975640 1 -- 172.21.15.5:0/3106760204 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec68109bb0 msgr2=0x7fec6819faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:17.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:17.605+0000 7fec6c975640 1 --2- 172.21.15.5:0/3106760204 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec68109bb0 0x7fec6819faa0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fec60009fd0 tx=0x7fec6000b260 comp rx=0 tx=0).stop 2024-08-31T05:21:17.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:17.605+0000 7fec6c975640 1 -- 172.21.15.5:0/3106760204 shutdown_connections 2024-08-31T05:21:17.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:17.605+0000 7fec6c975640 1 --2- 172.21.15.5:0/3106760204 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fec500b4af0 0x7fec500b7000 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:17.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:17.605+0000 7fec6c975640 1 --2- 172.21.15.5:0/3106760204 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec68109bb0 0x7fec6819faa0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:17.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:17.605+0000 7fec6c975640 1 --2- 172.21.15.5:0/3106760204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec68109260 0x7fec6819a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:17.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:17.605+0000 7fec6c975640 1 --2- 172.21.15.5:0/3106760204 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec68103920 0x7fec6819a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:17.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:17.605+0000 7fec6c975640 1 -- 172.21.15.5:0/3106760204 >> 172.21.15.5:0/3106760204 conn(0x7fec680ff3b0 msgr2=0x7fec681017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:17.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:17.606+0000 7fec6c975640 1 -- 172.21.15.5:0/3106760204 shutdown_connections 2024-08-31T05:21:17.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:17.606+0000 7fec6c975640 1 -- 172.21.15.5:0/3106760204 wait complete. 2024-08-31T05:21:17.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:17 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/1866334165' entity='client.admin' 2024-08-31T05:21:17.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:17 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/3842293267' entity='client.admin' 2024-08-31T05:21:18.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:18.250+0000 7fd4bb4be640 1 -- 172.21.15.5:0/2534651570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4b410dbc0 msgr2=0x7fd4b41100b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:18.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:18.250+0000 7fd4bb4be640 1 --2- 172.21.15.5:0/2534651570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4b410dbc0 0x7fd4b41100b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac009900 tx=0x7fd4ac02a410 comp rx=0 tx=0).stop 2024-08-31T05:21:18.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:18.250+0000 7fd4bb4be640 1 -- 172.21.15.5:0/2534651570 shutdown_connections 2024-08-31T05:21:18.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:18.250+0000 7fd4bb4be640 1 --2- 172.21.15.5:0/2534651570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4b410dbc0 0x7fd4b41100b0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:18.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:18.250+0000 7fd4bb4be640 1 --2- 172.21.15.5:0/2534651570 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4b41050b0 0x7fd4b410d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:18.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:18.250+0000 7fd4bb4be640 1 --2- 172.21.15.5:0/2534651570 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4b4104760 0x7fd4b4104b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:18.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:18.250+0000 7fd4bb4be640 1 -- 172.21.15.5:0/2534651570 >> 172.21.15.5:0/2534651570 conn(0x7fd4b40794b0 msgr2=0x7fd4b40798c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:18.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:18.250+0000 7fd4bb4be640 1 -- 172.21.15.5:0/2534651570 shutdown_connections 2024-08-31T05:21:18.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:18.250+0000 7fd4bb4be640 1 -- 172.21.15.5:0/2534651570 wait complete. 2024-08-31T05:21:18.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:18.251+0000 7fd4bb4be640 1 Processor -- start 2024-08-31T05:21:18.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:18.251+0000 7fd4bb4be640 1 -- start start 2024-08-31T05:21:18.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:18.251+0000 7fd4bb4be640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4b4104760 0x7fd4b419a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:18.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:18.251+0000 7fd4bb4be640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4b41050b0 0x7fd4b419a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:18.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:18.251+0000 7fd4bb4be640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4b410dbc0 0x7fd4b419f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:18.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:18.251+0000 7fd4bb4be640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b4113830 con 0x7fd4b410dbc0 2024-08-31T05:21:18.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:18.251+0000 7fd4bb4be640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b41136b0 con 0x7fd4b41050b0 2024-08-31T05:21:18.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:18.251+0000 7fd4bb4be640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b41139b0 con 0x7fd4b4104760 2024-08-31T05:21:18.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:18.251+0000 7fd4b9a5b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4b410dbc0 0x7fd4b419f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:18.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:18.251+0000 7fd4b9a5b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4b410dbc0 0x7fd4b419f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47468/0 (socket says 172.21.15.5:47468) 2024-08-31T05:21:18.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:18.251+0000 7fd4b9a5b640 1 -- 172.21.15.5:0/1863837529 learned_addr learned my addr 172.21.15.5:0/1863837529 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:21:18.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:18.251+0000 7fd4b8a59640 1 --2- 172.21.15.5:0/1863837529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4b41050b0 0x7fd4b419a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:18.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:18.251+0000 7fd4b925a640 1 --2- 172.21.15.5:0/1863837529 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4b4104760 0x7fd4b419a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:18.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:18.252+0000 7fd4b9a5b640 1 -- 172.21.15.5:0/1863837529 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4b4104760 msgr2=0x7fd4b419a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:18.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:18.252+0000 7fd4b9a5b640 1 --2- 172.21.15.5:0/1863837529 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4b4104760 0x7fd4b419a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:18.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:18.252+0000 7fd4b9a5b640 1 -- 172.21.15.5:0/1863837529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4b41050b0 msgr2=0x7fd4b419a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:18.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:18.252+0000 7fd4b9a5b640 1 --2- 172.21.15.5:0/1863837529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4b41050b0 0x7fd4b419a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:18.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:18.252+0000 7fd4b9a5b640 1 -- 172.21.15.5:0/1863837529 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4b41a0050 con 0x7fd4b410dbc0 2024-08-31T05:21:18.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:18.252+0000 7fd4b9a5b640 1 --2- 172.21.15.5:0/1863837529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4b410dbc0 0x7fd4b419f9e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac004770 tx=0x7fd4ac004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:18.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:18.252+0000 7fd4a67fc640 1 -- 172.21.15.5:0/1863837529 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac03f030 con 0x7fd4b410dbc0 2024-08-31T05:21:18.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:18.252+0000 7fd4a67fc640 1 -- 172.21.15.5:0/1863837529 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4ac003aa0 con 0x7fd4b410dbc0 2024-08-31T05:21:18.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:18.252+0000 7fd4bb4be640 1 -- 172.21.15.5:0/1863837529 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4b41a02e0 con 0x7fd4b410dbc0 2024-08-31T05:21:18.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:18.252+0000 7fd4a67fc640 1 -- 172.21.15.5:0/1863837529 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac035070 con 0x7fd4b410dbc0 2024-08-31T05:21:18.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:18.252+0000 7fd4bb4be640 1 -- 172.21.15.5:0/1863837529 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4b41a07c0 con 0x7fd4b410dbc0 2024-08-31T05:21:18.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:18.253+0000 7fd4bb4be640 1 -- 172.21.15.5:0/1863837529 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4b406c000 con 0x7fd4b410dbc0 2024-08-31T05:21:18.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:18.254+0000 7fd4a67fc640 1 -- 172.21.15.5:0/1863837529 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) ==== 152537+0+0 (secure 0 0 0) 0x7fd4ac042030 con 0x7fd4b410dbc0 2024-08-31T05:21:18.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:18.255+0000 7fd4a67fc640 1 --2- 172.21.15.5:0/1863837529 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd4a00b4b20 0x7fd4a00b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:18.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:18.255+0000 7fd4b925a640 1 --2- 172.21.15.5:0/1863837529 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd4a00b4b20 0x7fd4a00b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:18.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:18.255+0000 7fd4a67fc640 1 -- 172.21.15.5:0/1863837529 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fd4ac103e90 con 0x7fd4b410dbc0 2024-08-31T05:21:18.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:18.256+0000 7fd4b925a640 1 --2- 172.21.15.5:0/1863837529 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd4a00b4b20 0x7fd4a00b7030 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd4b000abe0 tx=0x7fd4b000a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:18.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:18.258+0000 7fd4a67fc640 1 -- 172.21.15.5:0/1863837529 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd4ac0ccbc0 con 0x7fd4b410dbc0 2024-08-31T05:21:18.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:18.448+0000 7fd4bb4be640 1 -- 172.21.15.5:0/1863837529 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7fd4b41083d0 con 0x7fd4b410dbc0 2024-08-31T05:21:18.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:18.452+0000 7fd4a67fc640 1 -- 172.21.15.5:0/1863837529 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v30)=0 v30) ==== 122+0+0 (secure 0 0 0) 0x7fd4ac0cc4c0 con 0x7fd4b410dbc0 2024-08-31T05:21:18.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:18.454+0000 7fd4bb4be640 1 -- 172.21.15.5:0/1863837529 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd4a00b4b20 msgr2=0x7fd4a00b7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:18.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:18.455+0000 7fd4bb4be640 1 --2- 172.21.15.5:0/1863837529 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd4a00b4b20 0x7fd4a00b7030 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd4b000abe0 tx=0x7fd4b000a2d0 comp rx=0 tx=0).stop 2024-08-31T05:21:18.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:18.455+0000 7fd4bb4be640 1 -- 172.21.15.5:0/1863837529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4b410dbc0 msgr2=0x7fd4b419f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:18.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:18.455+0000 7fd4bb4be640 1 --2- 172.21.15.5:0/1863837529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4b410dbc0 0x7fd4b419f9e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac004770 tx=0x7fd4ac004270 comp rx=0 tx=0).stop 2024-08-31T05:21:18.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:18.455+0000 7fd4bb4be640 1 -- 172.21.15.5:0/1863837529 shutdown_connections 2024-08-31T05:21:18.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:18.455+0000 7fd4bb4be640 1 --2- 172.21.15.5:0/1863837529 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd4a00b4b20 0x7fd4a00b7030 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:18.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:18.455+0000 7fd4bb4be640 1 --2- 172.21.15.5:0/1863837529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4b410dbc0 0x7fd4b419f9e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:18.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:18.455+0000 7fd4bb4be640 1 --2- 172.21.15.5:0/1863837529 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd4b41050b0 0x7fd4b419a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:18.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:18.455+0000 7fd4bb4be640 1 --2- 172.21.15.5:0/1863837529 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4b4104760 0x7fd4b419a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:18.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:18.455+0000 7fd4bb4be640 1 -- 172.21.15.5:0/1863837529 >> 172.21.15.5:0/1863837529 conn(0x7fd4b40794b0 msgr2=0x7fd4b41055a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:18.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:18.455+0000 7fd4bb4be640 1 -- 172.21.15.5:0/1863837529 shutdown_connections 2024-08-31T05:21:18.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:18.455+0000 7fd4bb4be640 1 -- 172.21.15.5:0/1863837529 wait complete. 2024-08-31T05:21:18.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:18 smithi005 ceph-mon[18602]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:18.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:18 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/3106760204' entity='client.admin' 2024-08-31T05:21:18.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:18 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/1863837529' entity='client.admin' 2024-08-31T05:21:18.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:18 smithi050 ceph-mon[22146]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:18.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:18 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/3106760204' entity='client.admin' 2024-08-31T05:21:18.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:18 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/1863837529' entity='client.admin' 2024-08-31T05:21:18.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.792+0000 7fd528baa640 1 -- 172.21.15.5:0/842339349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd524108160 msgr2=0x7fd524108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:18.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.792+0000 7fd528baa640 1 --2- 172.21.15.5:0/842339349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd524108160 0x7fd524108570 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd50c009900 tx=0x7fd50c02a410 comp rx=0 tx=0).stop 2024-08-31T05:21:18.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.792+0000 7fd528baa640 1 -- 172.21.15.5:0/842339349 shutdown_connections 2024-08-31T05:21:18.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.792+0000 7fd528baa640 1 --2- 172.21.15.5:0/842339349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd524108ab0 0x7fd52410f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:18.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.792+0000 7fd528baa640 1 --2- 172.21.15.5:0/842339349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd524108160 0x7fd524108570 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:18.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.792+0000 7fd528baa640 1 --2- 172.21.15.5:0/842339349 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd524102820 0x7fd524102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:18.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.792+0000 7fd528baa640 1 -- 172.21.15.5:0/842339349 >> 172.21.15.5:0/842339349 conn(0x7fd5240794e0 msgr2=0x7fd5240798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:18.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.792+0000 7fd528baa640 1 -- 172.21.15.5:0/842339349 shutdown_connections 2024-08-31T05:21:18.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.792+0000 7fd528baa640 1 -- 172.21.15.5:0/842339349 wait complete. 2024-08-31T05:21:18.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.793+0000 7fd528baa640 1 Processor -- start 2024-08-31T05:21:18.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.793+0000 7fd528baa640 1 -- start start 2024-08-31T05:21:18.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.793+0000 7fd528baa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd524102820 0x7fd524104ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:18.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.793+0000 7fd528baa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd524108160 0x7fd5241053e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:18.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.793+0000 7fd528baa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd524108ab0 0x7fd524105920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:18.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.793+0000 7fd528baa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd5241126e0 con 0x7fd524102820 2024-08-31T05:21:18.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.793+0000 7fd528baa640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd524112560 con 0x7fd524108ab0 2024-08-31T05:21:18.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.793+0000 7fd528baa640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd524112860 con 0x7fd524108160 2024-08-31T05:21:18.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.793+0000 7fd52259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd524102820 0x7fd524104ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:18.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.793+0000 7fd52259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd524102820 0x7fd524104ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45766/0 (socket says 172.21.15.5:45766) 2024-08-31T05:21:18.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.793+0000 7fd52259c640 1 -- 172.21.15.5:0/4148688395 learned_addr learned my addr 172.21.15.5:0/4148688395 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:21:18.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.793+0000 7fd522d9d640 1 --2- 172.21.15.5:0/4148688395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd524108ab0 0x7fd524105920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:18.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.793+0000 7fd521d9b640 1 --2- 172.21.15.5:0/4148688395 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd524108160 0x7fd5241053e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:18.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.794+0000 7fd52259c640 1 -- 172.21.15.5:0/4148688395 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd524108160 msgr2=0x7fd5241053e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:18.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.794+0000 7fd52259c640 1 --2- 172.21.15.5:0/4148688395 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd524108160 0x7fd5241053e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:18.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.794+0000 7fd52259c640 1 -- 172.21.15.5:0/4148688395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd524108ab0 msgr2=0x7fd524105920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:18.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.794+0000 7fd52259c640 1 --2- 172.21.15.5:0/4148688395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd524108ab0 0x7fd524105920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:18.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.794+0000 7fd52259c640 1 -- 172.21.15.5:0/4148688395 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5241a8490 con 0x7fd524102820 2024-08-31T05:21:18.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.794+0000 7fd521d9b640 1 --2- 172.21.15.5:0/4148688395 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd524108160 0x7fd5241053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:21:18.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.794+0000 7fd52259c640 1 --2- 172.21.15.5:0/4148688395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd524102820 0x7fd524104ea0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd51400d950 tx=0x7fd51400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:18.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.794+0000 7fd51b7fe640 1 -- 172.21.15.5:0/4148688395 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd514017030 con 0x7fd524102820 2024-08-31T05:21:18.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.794+0000 7fd528baa640 1 -- 172.21.15.5:0/4148688395 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5241a8780 con 0x7fd524102820 2024-08-31T05:21:18.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.794+0000 7fd51b7fe640 1 -- 172.21.15.5:0/4148688395 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd514004020 con 0x7fd524102820 2024-08-31T05:21:18.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.794+0000 7fd51b7fe640 1 -- 172.21.15.5:0/4148688395 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5140047a0 con 0x7fd524102820 2024-08-31T05:21:18.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.794+0000 7fd528baa640 1 -- 172.21.15.5:0/4148688395 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5241a8c90 con 0x7fd524102820 2024-08-31T05:21:18.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.795+0000 7fd5197fa640 1 -- 172.21.15.5:0/4148688395 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd508005290 con 0x7fd524102820 2024-08-31T05:21:18.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.796+0000 7fd51b7fe640 1 -- 172.21.15.5:0/4148688395 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 101903+0+0 (secure 0 0 0) 0x7fd514009a30 con 0x7fd524102820 2024-08-31T05:21:18.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.797+0000 7fd51b7fe640 1 --2- 172.21.15.5:0/4148688395 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd510079ee0 0x7fd51007c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:18.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.797+0000 7fd51b7fe640 1 -- 172.21.15.5:0/4148688395 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fd51409b2c0 con 0x7fd524102820 2024-08-31T05:21:18.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.797+0000 7fd521d9b640 1 --2- 172.21.15.5:0/4148688395 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd510079ee0 0x7fd51007c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:18.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.798+0000 7fd521d9b640 1 --2- 172.21.15.5:0/4148688395 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd510079ee0 0x7fd51007c3f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd50c000c00 tx=0x7fd50c032cc0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:18.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.802+0000 7fd51b7fe640 1 -- 172.21.15.5:0/4148688395 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd514064110 con 0x7fd524102820 2024-08-31T05:21:18.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.990+0000 7fd5197fa640 1 -- 172.21.15.5:0/4148688395 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7fd508005580 con 0x7fd524102820 2024-08-31T05:21:18.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.993+0000 7fd51b7fe640 1 -- 172.21.15.5:0/4148688395 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v20)=0 v20) ==== 115+0+0 (secure 0 0 0) 0x7fd514063a10 con 0x7fd524102820 2024-08-31T05:21:18.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.996+0000 7fd5197fa640 1 -- 172.21.15.5:0/4148688395 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd510079ee0 msgr2=0x7fd51007c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:18.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.996+0000 7fd5197fa640 1 --2- 172.21.15.5:0/4148688395 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd510079ee0 0x7fd51007c3f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd50c000c00 tx=0x7fd50c032cc0 comp rx=0 tx=0).stop 2024-08-31T05:21:18.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.996+0000 7fd5197fa640 1 -- 172.21.15.5:0/4148688395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd524102820 msgr2=0x7fd524104ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:18.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.996+0000 7fd5197fa640 1 --2- 172.21.15.5:0/4148688395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd524102820 0x7fd524104ea0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd51400d950 tx=0x7fd51400de10 comp rx=0 tx=0).stop 2024-08-31T05:21:18.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.996+0000 7fd5197fa640 1 -- 172.21.15.5:0/4148688395 shutdown_connections 2024-08-31T05:21:18.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.996+0000 7fd5197fa640 1 --2- 172.21.15.5:0/4148688395 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd510079ee0 0x7fd51007c3f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:18.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.996+0000 7fd5197fa640 1 --2- 172.21.15.5:0/4148688395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd524108ab0 0x7fd524105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:18.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.996+0000 7fd5197fa640 1 --2- 172.21.15.5:0/4148688395 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd524108160 0x7fd5241053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:18.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.996+0000 7fd5197fa640 1 --2- 172.21.15.5:0/4148688395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd524102820 0x7fd524104ea0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:18.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.996+0000 7fd5197fa640 1 -- 172.21.15.5:0/4148688395 >> 172.21.15.5:0/4148688395 conn(0x7fd5240794e0 msgr2=0x7fd52406b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:18.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.996+0000 7fd5197fa640 1 -- 172.21.15.5:0/4148688395 shutdown_connections 2024-08-31T05:21:18.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:10.996+0000 7fd5197fa640 1 -- 172.21.15.5:0/4148688395 wait complete. 2024-08-31T05:21:19.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:18 smithi070 ceph-mon[22316]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:19.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:18 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/3106760204' entity='client.admin' 2024-08-31T05:21:19.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:18 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/1863837529' entity='client.admin' 2024-08-31T05:21:20.436 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '69422704-6758-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi005') 2024-08-31T05:21:20.437 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '69422704-6758-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi005') 2024-08-31T05:21:20.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:20 smithi005 ceph-mon[18602]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:20.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:20 smithi050 ceph-mon[22146]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:20.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.212+0000 7f09ae05e640 1 -- 172.21.15.5:0/1710936484 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09a8109240 msgr2=0x7f09a8109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:20.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.212+0000 7f09ae05e640 1 --2- 172.21.15.5:0/1710936484 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09a8109240 0x7f09a8109650 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f099c009900 tx=0x7f099c02a410 comp rx=0 tx=0).stop 2024-08-31T05:21:20.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.212+0000 7f09ae05e640 1 -- 172.21.15.5:0/1710936484 shutdown_connections 2024-08-31T05:21:20.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.212+0000 7f09ae05e640 1 --2- 172.21.15.5:0/1710936484 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09a8109b90 0x7f09a81103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:20.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.212+0000 7f09ae05e640 1 --2- 172.21.15.5:0/1710936484 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09a8109240 0x7f09a8109650 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:20.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.212+0000 7f09ae05e640 1 --2- 172.21.15.5:0/1710936484 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09a8103900 0x7f09a8103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:20.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.212+0000 7f09ae05e640 1 -- 172.21.15.5:0/1710936484 >> 172.21.15.5:0/1710936484 conn(0x7f09a807b5f0 msgr2=0x7f09a807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:20.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.212+0000 7f09ae05e640 1 -- 172.21.15.5:0/1710936484 shutdown_connections 2024-08-31T05:21:20.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.212+0000 7f09ae05e640 1 -- 172.21.15.5:0/1710936484 wait complete. 2024-08-31T05:21:20.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.213+0000 7f09ae05e640 1 Processor -- start 2024-08-31T05:21:20.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.214+0000 7f09ae05e640 1 -- start start 2024-08-31T05:21:20.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.214+0000 7f09ae05e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09a8103900 0x7f09a819a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:20.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.214+0000 7f09ae05e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09a8109240 0x7f09a819a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:20.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.214+0000 7f09ae05e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09a8109b90 0x7f09a819fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:20.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.214+0000 7f09ae05e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f09a8113850 con 0x7f09a8109240 2024-08-31T05:21:20.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.214+0000 7f09ae05e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f09a81136d0 con 0x7f09a8103900 2024-08-31T05:21:20.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.214+0000 7f09ae05e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f09a81139d0 con 0x7f09a8109b90 2024-08-31T05:21:20.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.214+0000 7f09a6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09a8109240 0x7f09a819a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:20.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.214+0000 7f09a6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09a8109240 0x7f09a819a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47344/0 (socket says 172.21.15.5:47344) 2024-08-31T05:21:20.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.214+0000 7f09a6ffd640 1 -- 172.21.15.5:0/2059050403 learned_addr learned my addr 172.21.15.5:0/2059050403 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:21:20.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.214+0000 7f09a7fff640 1 --2- 172.21.15.5:0/2059050403 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09a8109b90 0x7f09a819fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:20.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.214+0000 7f09a77fe640 1 --2- 172.21.15.5:0/2059050403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09a8103900 0x7f09a819a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:20.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.214+0000 7f09a6ffd640 1 -- 172.21.15.5:0/2059050403 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09a8109b90 msgr2=0x7f09a819fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:20.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.214+0000 7f09a6ffd640 1 --2- 172.21.15.5:0/2059050403 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09a8109b90 0x7f09a819fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:20.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.214+0000 7f09a6ffd640 1 -- 172.21.15.5:0/2059050403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09a8103900 msgr2=0x7f09a819a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:20.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.214+0000 7f09a6ffd640 1 --2- 172.21.15.5:0/2059050403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09a8103900 0x7f09a819a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:20.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.214+0000 7f09a6ffd640 1 -- 172.21.15.5:0/2059050403 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09a81a00d0 con 0x7f09a8109240 2024-08-31T05:21:20.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.215+0000 7f09a6ffd640 1 --2- 172.21.15.5:0/2059050403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09a8109240 0x7f09a819a7c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f099c02a930 tx=0x7f099c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:20.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.215+0000 7f09a4ff9640 1 -- 172.21.15.5:0/2059050403 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f099c03f030 con 0x7f09a8109240 2024-08-31T05:21:20.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.215+0000 7f09ae05e640 1 -- 172.21.15.5:0/2059050403 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09a81a0360 con 0x7f09a8109240 2024-08-31T05:21:20.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.215+0000 7f09a4ff9640 1 -- 172.21.15.5:0/2059050403 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f099c003aa0 con 0x7f09a8109240 2024-08-31T05:21:20.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.215+0000 7f09a4ff9640 1 -- 172.21.15.5:0/2059050403 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f099c035070 con 0x7f09a8109240 2024-08-31T05:21:20.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.215+0000 7f09ae05e640 1 -- 172.21.15.5:0/2059050403 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09a81a0840 con 0x7f09a8109240 2024-08-31T05:21:20.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.216+0000 7f09ae05e640 1 -- 172.21.15.5:0/2059050403 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09a8103d10 con 0x7f09a8109240 2024-08-31T05:21:20.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.219+0000 7f09a4ff9640 1 -- 172.21.15.5:0/2059050403 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) ==== 152537+0+0 (secure 0 0 0) 0x7f099c042030 con 0x7f09a8109240 2024-08-31T05:21:20.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.220+0000 7f09a4ff9640 1 --2- 172.21.15.5:0/2059050403 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f09900b4b20 0x7f09900b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:20.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.220+0000 7f09a77fe640 1 --2- 172.21.15.5:0/2059050403 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f09900b4b20 0x7f09900b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:20.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.221+0000 7f09a4ff9640 1 -- 172.21.15.5:0/2059050403 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f099c104210 con 0x7f09a8109240 2024-08-31T05:21:20.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.221+0000 7f09a77fe640 1 --2- 172.21.15.5:0/2059050403 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f09900b4b20 0x7f09900b7030 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f099800abe0 tx=0x7f099800a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:20.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.222+0000 7f09a4ff9640 1 -- 172.21.15.5:0/2059050403 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f099c049030 con 0x7f09a8109240 2024-08-31T05:21:20.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.413+0000 7f09ae05e640 1 -- 172.21.15.5:0/2059050403 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f09a819b350 con 0x7f09a8109240 2024-08-31T05:21:20.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.418+0000 7f09a4ff9640 1 -- 172.21.15.5:0/2059050403 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v22)=0 v22) ==== 116+0+0 (secure 0 0 0) 0x7f099c0ccf40 con 0x7f09a8109240 2024-08-31T05:21:20.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.420+0000 7f09ae05e640 1 -- 172.21.15.5:0/2059050403 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f09900b4b20 msgr2=0x7f09900b7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:20.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.420+0000 7f09ae05e640 1 --2- 172.21.15.5:0/2059050403 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f09900b4b20 0x7f09900b7030 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f099800abe0 tx=0x7f099800a2d0 comp rx=0 tx=0).stop 2024-08-31T05:21:20.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.421+0000 7f09ae05e640 1 -- 172.21.15.5:0/2059050403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09a8109240 msgr2=0x7f09a819a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:20.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.421+0000 7f09ae05e640 1 --2- 172.21.15.5:0/2059050403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09a8109240 0x7f09a819a7c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f099c02a930 tx=0x7f099c004270 comp rx=0 tx=0).stop 2024-08-31T05:21:20.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.421+0000 7f09ae05e640 1 -- 172.21.15.5:0/2059050403 shutdown_connections 2024-08-31T05:21:20.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.421+0000 7f09ae05e640 1 --2- 172.21.15.5:0/2059050403 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f09900b4b20 0x7f09900b7030 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:20.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.421+0000 7f09ae05e640 1 --2- 172.21.15.5:0/2059050403 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09a8109b90 0x7f09a819fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:20.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.421+0000 7f09ae05e640 1 --2- 172.21.15.5:0/2059050403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09a8109240 0x7f09a819a7c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:20.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.421+0000 7f09ae05e640 1 --2- 172.21.15.5:0/2059050403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09a8103900 0x7f09a819a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:20.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.421+0000 7f09ae05e640 1 -- 172.21.15.5:0/2059050403 >> 172.21.15.5:0/2059050403 conn(0x7f09a807b5f0 msgr2=0x7f09a8107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:20.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.421+0000 7f09ae05e640 1 -- 172.21.15.5:0/2059050403 shutdown_connections 2024-08-31T05:21:20.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:13.421+0000 7f09ae05e640 1 -- 172.21.15.5:0/2059050403 wait complete. 2024-08-31T05:21:21.085 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:20 smithi070 ceph-mon[22316]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:21.474 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:21:21.481 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:21:21.486 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '69422704-6758-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi005') 2024-08-31T05:21:21.486 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '69422704-6758-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi005') 2024-08-31T05:21:21.486 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:21:22.283 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '69422704-6758-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi005') 2024-08-31T05:21:22.283 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '69422704-6758-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi005') 2024-08-31T05:21:22.283 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '69422704-6758-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi005') 2024-08-31T05:21:22.284 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '69422704-6758-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi005') 2024-08-31T05:21:22.284 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '69422704-6758-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi005') 2024-08-31T05:21:22.284 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '69422704-6758-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi005') 2024-08-31T05:21:22.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:22.466+0000 7fdfd0590640 1 -- 172.21.15.5:0/1129550497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfc8102820 msgr2=0x7fdfc8102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:22.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:22.466+0000 7fdfd0590640 1 --2- 172.21.15.5:0/1129550497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfc8102820 0x7fdfc8102c30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc009900 tx=0x7fdfbc02a410 comp rx=0 tx=0).stop 2024-08-31T05:21:22.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:22.466+0000 7fdfd0590640 1 -- 172.21.15.5:0/1129550497 shutdown_connections 2024-08-31T05:21:22.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:22.466+0000 7fdfd0590640 1 --2- 172.21.15.5:0/1129550497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfc8108ab0 0x7fdfc810f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:22.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:22.466+0000 7fdfd0590640 1 --2- 172.21.15.5:0/1129550497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdfc8108160 0x7fdfc8108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:22.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:22.466+0000 7fdfd0590640 1 --2- 172.21.15.5:0/1129550497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfc8102820 0x7fdfc8102c30 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:22.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:22.466+0000 7fdfd0590640 1 -- 172.21.15.5:0/1129550497 >> 172.21.15.5:0/1129550497 conn(0x7fdfc80794e0 msgr2=0x7fdfc80798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:22.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:22.466+0000 7fdfd0590640 1 -- 172.21.15.5:0/1129550497 shutdown_connections 2024-08-31T05:21:22.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:22.466+0000 7fdfd0590640 1 -- 172.21.15.5:0/1129550497 wait complete. 2024-08-31T05:21:22.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:22.467+0000 7fdfd0590640 1 Processor -- start 2024-08-31T05:21:22.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:22.467+0000 7fdfd0590640 1 -- start start 2024-08-31T05:21:22.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:22.468+0000 7fdfd0590640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfc8102820 0x7fdfc81991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:22.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:22.468+0000 7fdfd0590640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdfc8108160 0x7fdfc8199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:22.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:22.468+0000 7fdfd0590640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfc8108ab0 0x7fdfc819ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:22.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:22.468+0000 7fdfd0590640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc8112730 con 0x7fdfc8108ab0 2024-08-31T05:21:22.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:22.468+0000 7fdfd0590640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc81125b0 con 0x7fdfc8102820 2024-08-31T05:21:22.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:22.468+0000 7fdfd0590640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc81128b0 con 0x7fdfc8108160 2024-08-31T05:21:22.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:22.468+0000 7fdfceb2d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfc8108ab0 0x7fdfc819ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:22.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:22.468+0000 7fdfceb2d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfc8108ab0 0x7fdfc819ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53674/0 (socket says 172.21.15.5:53674) 2024-08-31T05:21:22.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:22.468+0000 7fdfceb2d640 1 -- 172.21.15.5:0/3672270638 learned_addr learned my addr 172.21.15.5:0/3672270638 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:21:22.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:22.468+0000 7fdfce32c640 1 --2- 172.21.15.5:0/3672270638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfc8102820 0x7fdfc81991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:22.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:22.468+0000 7fdfcdb2b640 1 --2- 172.21.15.5:0/3672270638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdfc8108160 0x7fdfc8199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:22.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:22.468+0000 7fdfceb2d640 1 -- 172.21.15.5:0/3672270638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdfc8108160 msgr2=0x7fdfc8199760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:22.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:22.468+0000 7fdfceb2d640 1 --2- 172.21.15.5:0/3672270638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdfc8108160 0x7fdfc8199760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:22.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:22.468+0000 7fdfceb2d640 1 -- 172.21.15.5:0/3672270638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfc8102820 msgr2=0x7fdfc81991c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:22.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:22.468+0000 7fdfceb2d640 1 --2- 172.21.15.5:0/3672270638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfc8102820 0x7fdfc81991c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:22.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:22.468+0000 7fdfceb2d640 1 -- 172.21.15.5:0/3672270638 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfc819f070 con 0x7fdfc8108ab0 2024-08-31T05:21:22.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:22.468+0000 7fdfceb2d640 1 --2- 172.21.15.5:0/3672270638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfc8108ab0 0x7fdfc819ea00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdfc000cce0 tx=0x7fdfc000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:22.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:22.469+0000 7fdfbb7fe640 1 -- 172.21.15.5:0/3672270638 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc000f450 con 0x7fdfc8108ab0 2024-08-31T05:21:22.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:22.469+0000 7fdfbb7fe640 1 -- 172.21.15.5:0/3672270638 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdfc000faa0 con 0x7fdfc8108ab0 2024-08-31T05:21:22.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:22.469+0000 7fdfd0590640 1 -- 172.21.15.5:0/3672270638 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfc819f360 con 0x7fdfc8108ab0 2024-08-31T05:21:22.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:22.469+0000 7fdfbb7fe640 1 -- 172.21.15.5:0/3672270638 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc0018b70 con 0x7fdfc8108ab0 2024-08-31T05:21:22.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:22.469+0000 7fdfd0590640 1 -- 172.21.15.5:0/3672270638 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfc81a5b80 con 0x7fdfc8108ab0 2024-08-31T05:21:22.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:22.470+0000 7fdfd0590640 1 -- 172.21.15.5:0/3672270638 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfc8102c30 con 0x7fdfc8108ab0 2024-08-31T05:21:22.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:22.471+0000 7fdfbb7fe640 1 -- 172.21.15.5:0/3672270638 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) ==== 152537+0+0 (secure 0 0 0) 0x7fdfc0018d10 con 0x7fdfc8108ab0 2024-08-31T05:21:22.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:22.472+0000 7fdfbb7fe640 1 --2- 172.21.15.5:0/3672270638 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fdfb40b4b20 0x7fdfb40b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:22.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:22.472+0000 7fdfce32c640 1 --2- 172.21.15.5:0/3672270638 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fdfb40b4b20 0x7fdfb40b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:22.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:22.472+0000 7fdfbb7fe640 1 -- 172.21.15.5:0/3672270638 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fdfc00e3880 con 0x7fdfc8108ab0 2024-08-31T05:21:22.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:22.473+0000 7fdfce32c640 1 --2- 172.21.15.5:0/3672270638 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fdfb40b4b20 0x7fdfb40b7030 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc031440 tx=0x7fdfbc009560 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:22.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:22.476+0000 7fdfbb7fe640 1 -- 172.21.15.5:0/3672270638 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fdfc0014030 con 0x7fdfc8108ab0 2024-08-31T05:21:22.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:22.663+0000 7fdfd0590640 1 -- 172.21.15.5:0/3672270638 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7fdfc810a880 con 0x7fdfc8108ab0 2024-08-31T05:21:22.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:22.667+0000 7fdfbb7fe640 1 -- 172.21.15.5:0/3672270638 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v31)=0 v31) ==== 121+0+0 (secure 0 0 0) 0x7fdfc00ac5b0 con 0x7fdfc8108ab0 2024-08-31T05:21:22.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:22.669+0000 7fdfd0590640 1 -- 172.21.15.5:0/3672270638 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fdfb40b4b20 msgr2=0x7fdfb40b7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:22.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:22.669+0000 7fdfd0590640 1 --2- 172.21.15.5:0/3672270638 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fdfb40b4b20 0x7fdfb40b7030 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc031440 tx=0x7fdfbc009560 comp rx=0 tx=0).stop 2024-08-31T05:21:22.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:22.669+0000 7fdfd0590640 1 -- 172.21.15.5:0/3672270638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfc8108ab0 msgr2=0x7fdfc819ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:22.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:22.669+0000 7fdfd0590640 1 --2- 172.21.15.5:0/3672270638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfc8108ab0 0x7fdfc819ea00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdfc000cce0 tx=0x7fdfc000a620 comp rx=0 tx=0).stop 2024-08-31T05:21:22.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:22.669+0000 7fdfd0590640 1 -- 172.21.15.5:0/3672270638 shutdown_connections 2024-08-31T05:21:22.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:22.669+0000 7fdfd0590640 1 --2- 172.21.15.5:0/3672270638 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fdfb40b4b20 0x7fdfb40b7030 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:22.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:22.669+0000 7fdfd0590640 1 --2- 172.21.15.5:0/3672270638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdfc8108ab0 0x7fdfc819ea00 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:22.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:22.669+0000 7fdfd0590640 1 --2- 172.21.15.5:0/3672270638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdfc8108160 0x7fdfc8199760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:22.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:22.669+0000 7fdfd0590640 1 --2- 172.21.15.5:0/3672270638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdfc8102820 0x7fdfc81991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:22.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:22.669+0000 7fdfd0590640 1 -- 172.21.15.5:0/3672270638 >> 172.21.15.5:0/3672270638 conn(0x7fdfc80794e0 msgr2=0x7fdfc8101230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:22.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:22.669+0000 7fdfd0590640 1 -- 172.21.15.5:0/3672270638 shutdown_connections 2024-08-31T05:21:22.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:22.669+0000 7fdfd0590640 1 -- 172.21.15.5:0/3672270638 wait complete. 2024-08-31T05:21:22.760 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:22 smithi005 ceph-mon[18602]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:22.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:22 smithi050 ceph-mon[22146]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:23.085 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:22 smithi070 ceph-mon[22316]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:23.734 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:23 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/3672270638' entity='client.admin' 2024-08-31T05:21:24.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:23 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/3672270638' entity='client.admin' 2024-08-31T05:21:24.156 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:23 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/3672270638' entity='client.admin' 2024-08-31T05:21:24.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.775+0000 7fd088af9640 1 -- 172.21.15.5:0/1779302746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd084104750 msgr2=0x7fd084104b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:24.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.775+0000 7fd088af9640 1 --2- 172.21.15.5:0/1779302746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd084104750 0x7fd084104b60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd074009900 tx=0x7fd07402a410 comp rx=0 tx=0).stop 2024-08-31T05:21:24.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.775+0000 7fd088af9640 1 -- 172.21.15.5:0/1779302746 shutdown_connections 2024-08-31T05:21:24.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.775+0000 7fd088af9640 1 --2- 172.21.15.5:0/1779302746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd08410dbb0 0x7fd0841100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:24.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.775+0000 7fd088af9640 1 --2- 172.21.15.5:0/1779302746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0841050a0 0x7fd08410d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:24.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.775+0000 7fd088af9640 1 --2- 172.21.15.5:0/1779302746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd084104750 0x7fd084104b60 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:24.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.775+0000 7fd088af9640 1 -- 172.21.15.5:0/1779302746 >> 172.21.15.5:0/1779302746 conn(0x7fd0840794d0 msgr2=0x7fd0840798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:24.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.775+0000 7fd088af9640 1 -- 172.21.15.5:0/1779302746 shutdown_connections 2024-08-31T05:21:24.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.775+0000 7fd088af9640 1 -- 172.21.15.5:0/1779302746 wait complete. 2024-08-31T05:21:24.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.776+0000 7fd088af9640 1 Processor -- start 2024-08-31T05:21:24.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.776+0000 7fd088af9640 1 -- start start 2024-08-31T05:21:24.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.776+0000 7fd088af9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd084104750 0x7fd08419a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:24.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.776+0000 7fd088af9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0841050a0 0x7fd08419a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:24.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.776+0000 7fd088af9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd08410dbb0 0x7fd08419fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:24.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.776+0000 7fd088af9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd084113830 con 0x7fd0841050a0 2024-08-31T05:21:24.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.776+0000 7fd088af9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd0841136b0 con 0x7fd084104750 2024-08-31T05:21:24.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.776+0000 7fd088af9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd0841139b0 con 0x7fd08410dbb0 2024-08-31T05:21:24.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.776+0000 7fd081d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0841050a0 0x7fd08419a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:24.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.776+0000 7fd081d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0841050a0 0x7fd08419a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53692/0 (socket says 172.21.15.5:53692) 2024-08-31T05:21:24.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.776+0000 7fd081d9b640 1 -- 172.21.15.5:0/2448572541 learned_addr learned my addr 172.21.15.5:0/2448572541 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:21:24.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.776+0000 7fd082d9d640 1 --2- 172.21.15.5:0/2448572541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd08410dbb0 0x7fd08419fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:24.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.776+0000 7fd08259c640 1 --2- 172.21.15.5:0/2448572541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd084104750 0x7fd08419a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:24.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.776+0000 7fd081d9b640 1 -- 172.21.15.5:0/2448572541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd08410dbb0 msgr2=0x7fd08419fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:24.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.776+0000 7fd081d9b640 1 --2- 172.21.15.5:0/2448572541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd08410dbb0 0x7fd08419fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:24.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.776+0000 7fd081d9b640 1 -- 172.21.15.5:0/2448572541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd084104750 msgr2=0x7fd08419a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:24.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.776+0000 7fd081d9b640 1 --2- 172.21.15.5:0/2448572541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd084104750 0x7fd08419a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:24.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.776+0000 7fd081d9b640 1 -- 172.21.15.5:0/2448572541 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0841a0270 con 0x7fd0841050a0 2024-08-31T05:21:24.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.776+0000 7fd082d9d640 1 --2- 172.21.15.5:0/2448572541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd08410dbb0 0x7fd08419fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:21:24.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.776+0000 7fd08259c640 1 --2- 172.21.15.5:0/2448572541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd084104750 0x7fd08419a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:21:24.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.777+0000 7fd081d9b640 1 --2- 172.21.15.5:0/2448572541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0841050a0 0x7fd08419a8a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd07800e9c0 tx=0x7fd07800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:24.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.777+0000 7fd0737fe640 1 -- 172.21.15.5:0/2448572541 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd07800ccc0 con 0x7fd0841050a0 2024-08-31T05:21:24.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.777+0000 7fd0737fe640 1 -- 172.21.15.5:0/2448572541 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0780054d0 con 0x7fd0841050a0 2024-08-31T05:21:24.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.777+0000 7fd088af9640 1 -- 172.21.15.5:0/2448572541 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0841a0560 con 0x7fd0841050a0 2024-08-31T05:21:24.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.777+0000 7fd0737fe640 1 -- 172.21.15.5:0/2448572541 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd078010430 con 0x7fd0841050a0 2024-08-31T05:21:24.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.777+0000 7fd088af9640 1 -- 172.21.15.5:0/2448572541 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0841a6cc0 con 0x7fd0841050a0 2024-08-31T05:21:24.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.778+0000 7fd088af9640 1 -- 172.21.15.5:0/2448572541 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd084104b60 con 0x7fd0841050a0 2024-08-31T05:21:24.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.780+0000 7fd0737fe640 1 -- 172.21.15.5:0/2448572541 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) ==== 152537+0+0 (secure 0 0 0) 0x7fd078005000 con 0x7fd0841050a0 2024-08-31T05:21:24.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.780+0000 7fd0737fe640 1 --2- 172.21.15.5:0/2448572541 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd06c0b4af0 0x7fd06c0b7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:24.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.780+0000 7fd08259c640 1 --2- 172.21.15.5:0/2448572541 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd06c0b4af0 0x7fd06c0b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:24.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.780+0000 7fd0737fe640 1 -- 172.21.15.5:0/2448572541 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fd0780e3c00 con 0x7fd0841050a0 2024-08-31T05:21:24.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.781+0000 7fd08259c640 1 --2- 172.21.15.5:0/2448572541 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd06c0b4af0 0x7fd06c0b7000 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd0740096c0 tx=0x7fd074031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:24.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.783+0000 7fd0737fe640 1 -- 172.21.15.5:0/2448572541 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd078056130 con 0x7fd0841050a0 2024-08-31T05:21:24.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:24 smithi005 ceph-mon[18602]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:24.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.968+0000 7fd088af9640 1 -- 172.21.15.5:0/2448572541 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7fd08419b430 con 0x7fd0841050a0 2024-08-31T05:21:24.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.973+0000 7fd0737fe640 1 -- 172.21.15.5:0/2448572541 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v32)=0 v32) ==== 129+0+0 (secure 0 0 0) 0x7fd08419b430 con 0x7fd0841050a0 2024-08-31T05:21:24.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.975+0000 7fd088af9640 1 -- 172.21.15.5:0/2448572541 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd06c0b4af0 msgr2=0x7fd06c0b7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:24.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.975+0000 7fd088af9640 1 --2- 172.21.15.5:0/2448572541 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd06c0b4af0 0x7fd06c0b7000 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd0740096c0 tx=0x7fd074031400 comp rx=0 tx=0).stop 2024-08-31T05:21:24.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.975+0000 7fd088af9640 1 -- 172.21.15.5:0/2448572541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0841050a0 msgr2=0x7fd08419a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:24.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.975+0000 7fd088af9640 1 --2- 172.21.15.5:0/2448572541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0841050a0 0x7fd08419a8a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd07800e9c0 tx=0x7fd07800ee80 comp rx=0 tx=0).stop 2024-08-31T05:21:24.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.975+0000 7fd088af9640 1 -- 172.21.15.5:0/2448572541 shutdown_connections 2024-08-31T05:21:24.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.975+0000 7fd088af9640 1 --2- 172.21.15.5:0/2448572541 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd06c0b4af0 0x7fd06c0b7000 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:24.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.975+0000 7fd088af9640 1 --2- 172.21.15.5:0/2448572541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd08410dbb0 0x7fd08419fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:24.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.975+0000 7fd088af9640 1 --2- 172.21.15.5:0/2448572541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd0841050a0 0x7fd08419a8a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:24.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.975+0000 7fd088af9640 1 --2- 172.21.15.5:0/2448572541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd084104750 0x7fd08419a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:24.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.975+0000 7fd088af9640 1 -- 172.21.15.5:0/2448572541 >> 172.21.15.5:0/2448572541 conn(0x7fd0840794d0 msgr2=0x7fd0840ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:24.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.975+0000 7fd088af9640 1 -- 172.21.15.5:0/2448572541 shutdown_connections 2024-08-31T05:21:24.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:24.975+0000 7fd088af9640 1 -- 172.21.15.5:0/2448572541 wait complete. 2024-08-31T05:21:25.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:24 smithi070 ceph-mon[22316]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:25.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:24 smithi050 ceph-mon[22146]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:25.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:25.923+0000 7f7838c0c640 1 -- 172.21.15.5:0/2427626113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7834105120 msgr2=0x7f783410d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:25.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:25.923+0000 7f7838c0c640 1 --2- 172.21.15.5:0/2427626113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7834105120 0x7f783410d670 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f781c009900 tx=0x7f781c02a410 comp rx=0 tx=0).stop 2024-08-31T05:21:25.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:25.923+0000 7f7838c0c640 1 -- 172.21.15.5:0/2427626113 shutdown_connections 2024-08-31T05:21:25.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:25.923+0000 7f7838c0c640 1 --2- 172.21.15.5:0/2427626113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f783410dc00 0x7f78341100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:25.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:25.923+0000 7f7838c0c640 1 --2- 172.21.15.5:0/2427626113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7834105120 0x7f783410d670 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:25.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:25.923+0000 7f7838c0c640 1 --2- 172.21.15.5:0/2427626113 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78341047d0 0x7f7834104be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:25.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:25.923+0000 7f7838c0c640 1 -- 172.21.15.5:0/2427626113 >> 172.21.15.5:0/2427626113 conn(0x7f7834079550 msgr2=0x7f7834079960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:25.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:25.923+0000 7f7838c0c640 1 -- 172.21.15.5:0/2427626113 shutdown_connections 2024-08-31T05:21:25.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:25.923+0000 7f7838c0c640 1 -- 172.21.15.5:0/2427626113 wait complete. 2024-08-31T05:21:25.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:25.924+0000 7f7838c0c640 1 Processor -- start 2024-08-31T05:21:25.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:25.924+0000 7f7838c0c640 1 -- start start 2024-08-31T05:21:25.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:25.924+0000 7f7838c0c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78341047d0 0x7f7834102510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:25.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:25.924+0000 7f7838c0c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7834105120 0x7f7834102a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:25.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:25.924+0000 7f7838c0c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f783410dc00 0x7f7834102f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:25.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:25.924+0000 7f7838c0c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7834113800 con 0x7f783410dc00 2024-08-31T05:21:25.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:25.924+0000 7f7838c0c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7834113680 con 0x7f78341047d0 2024-08-31T05:21:25.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:25.924+0000 7f7838c0c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7834113980 con 0x7f7834105120 2024-08-31T05:21:25.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:25.924+0000 7f7832d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f783410dc00 0x7f7834102f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:25.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:25.924+0000 7f7832d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f783410dc00 0x7f7834102f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53712/0 (socket says 172.21.15.5:53712) 2024-08-31T05:21:25.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:25.924+0000 7f7832d9d640 1 -- 172.21.15.5:0/3934647322 learned_addr learned my addr 172.21.15.5:0/3934647322 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:21:25.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:25.925+0000 7f783259c640 1 --2- 172.21.15.5:0/3934647322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78341047d0 0x7f7834102510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:25.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:25.925+0000 7f7831d9b640 1 --2- 172.21.15.5:0/3934647322 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7834105120 0x7f7834102a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:25.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:25.925+0000 7f7832d9d640 1 -- 172.21.15.5:0/3934647322 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7834105120 msgr2=0x7f7834102a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:25.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:25.925+0000 7f7832d9d640 1 --2- 172.21.15.5:0/3934647322 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7834105120 0x7f7834102a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:25.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:25.925+0000 7f7832d9d640 1 -- 172.21.15.5:0/3934647322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78341047d0 msgr2=0x7f7834102510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:25.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:25.925+0000 7f7832d9d640 1 --2- 172.21.15.5:0/3934647322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78341047d0 0x7f7834102510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:25.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:25.925+0000 7f7832d9d640 1 -- 172.21.15.5:0/3934647322 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78341a8460 con 0x7f783410dc00 2024-08-31T05:21:25.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:25.925+0000 7f783259c640 1 --2- 172.21.15.5:0/3934647322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78341047d0 0x7f7834102510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:21:25.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:25.925+0000 7f7832d9d640 1 --2- 172.21.15.5:0/3934647322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f783410dc00 0x7f7834102f90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f782c00d950 tx=0x7f782c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:25.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:25.925+0000 7f782b7fe640 1 -- 172.21.15.5:0/3934647322 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f782c017030 con 0x7f783410dc00 2024-08-31T05:21:25.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:25.925+0000 7f782b7fe640 1 -- 172.21.15.5:0/3934647322 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f782c004020 con 0x7f783410dc00 2024-08-31T05:21:25.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:25.925+0000 7f7838c0c640 1 -- 172.21.15.5:0/3934647322 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78341a8750 con 0x7f783410dc00 2024-08-31T05:21:25.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:25.925+0000 7f782b7fe640 1 -- 172.21.15.5:0/3934647322 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f782c003b50 con 0x7f783410dc00 2024-08-31T05:21:25.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:25.925+0000 7f7838c0c640 1 -- 172.21.15.5:0/3934647322 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78341a8c10 con 0x7f783410dc00 2024-08-31T05:21:25.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:25.926+0000 7f7838c0c640 1 -- 172.21.15.5:0/3934647322 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f783406bc70 con 0x7f783410dc00 2024-08-31T05:21:25.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:25.928+0000 7f782b7fe640 1 -- 172.21.15.5:0/3934647322 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) ==== 152537+0+0 (secure 0 0 0) 0x7f782c01a070 con 0x7f783410dc00 2024-08-31T05:21:25.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:25.929+0000 7f782b7fe640 1 --2- 172.21.15.5:0/3934647322 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f78200b4af0 0x7f78200b7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:25.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:25.929+0000 7f782b7fe640 1 -- 172.21.15.5:0/3934647322 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f782c0e3460 con 0x7f783410dc00 2024-08-31T05:21:25.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:25.929+0000 7f783259c640 1 --2- 172.21.15.5:0/3934647322 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f78200b4af0 0x7f78200b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:25.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:25.929+0000 7f783259c640 1 --2- 172.21.15.5:0/3934647322 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f78200b4af0 0x7f78200b7000 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7834103f60 tx=0x7f7824007480 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:25.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:25.932+0000 7f782b7fe640 1 -- 172.21.15.5:0/3934647322 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f782c0ac190 con 0x7f783410dc00 2024-08-31T05:21:26.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.118+0000 7f7838c0c640 1 -- 172.21.15.5:0/3934647322 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f7834104be0 con 0x7f783410dc00 2024-08-31T05:21:26.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.122+0000 7f782b7fe640 1 -- 172.21.15.5:0/3934647322 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v33)=0 v33) ==== 120+0+0 (secure 0 0 0) 0x7f782c0a7070 con 0x7f783410dc00 2024-08-31T05:21:26.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.124+0000 7f7838c0c640 1 -- 172.21.15.5:0/3934647322 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f78200b4af0 msgr2=0x7f78200b7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:26.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.124+0000 7f7838c0c640 1 --2- 172.21.15.5:0/3934647322 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f78200b4af0 0x7f78200b7000 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7834103f60 tx=0x7f7824007480 comp rx=0 tx=0).stop 2024-08-31T05:21:26.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.125+0000 7f7838c0c640 1 -- 172.21.15.5:0/3934647322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f783410dc00 msgr2=0x7f7834102f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:26.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.125+0000 7f7838c0c640 1 --2- 172.21.15.5:0/3934647322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f783410dc00 0x7f7834102f90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f782c00d950 tx=0x7f782c00de10 comp rx=0 tx=0).stop 2024-08-31T05:21:26.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.125+0000 7f7838c0c640 1 -- 172.21.15.5:0/3934647322 shutdown_connections 2024-08-31T05:21:26.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.125+0000 7f7838c0c640 1 --2- 172.21.15.5:0/3934647322 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f78200b4af0 0x7f78200b7000 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:26.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.125+0000 7f7838c0c640 1 --2- 172.21.15.5:0/3934647322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f783410dc00 0x7f7834102f90 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:26.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.125+0000 7f7838c0c640 1 --2- 172.21.15.5:0/3934647322 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7834105120 0x7f7834102a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:26.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.125+0000 7f7838c0c640 1 --2- 172.21.15.5:0/3934647322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78341047d0 0x7f7834102510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:26.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.125+0000 7f7838c0c640 1 -- 172.21.15.5:0/3934647322 >> 172.21.15.5:0/3934647322 conn(0x7f7834079550 msgr2=0x7f78341006d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:26.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.125+0000 7f7838c0c640 1 -- 172.21.15.5:0/3934647322 shutdown_connections 2024-08-31T05:21:26.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.125+0000 7f7838c0c640 1 -- 172.21.15.5:0/3934647322 wait complete. 2024-08-31T05:21:26.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.149+0000 7fda8f6ed640 1 -- 172.21.15.5:0/687143679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda88102840 msgr2=0x7fda88102c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:26.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.149+0000 7fda8f6ed640 1 --2- 172.21.15.5:0/687143679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda88102840 0x7fda88102c50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fda84009900 tx=0x7fda8402a410 comp rx=0 tx=0).stop 2024-08-31T05:21:26.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.149+0000 7fda8f6ed640 1 -- 172.21.15.5:0/687143679 shutdown_connections 2024-08-31T05:21:26.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.149+0000 7fda8f6ed640 1 --2- 172.21.15.5:0/687143679 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda88108ad0 0x7fda8810f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:26.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.149+0000 7fda8f6ed640 1 --2- 172.21.15.5:0/687143679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda88108180 0x7fda88108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:26.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.149+0000 7fda8f6ed640 1 --2- 172.21.15.5:0/687143679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda88102840 0x7fda88102c50 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:26.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.149+0000 7fda8f6ed640 1 -- 172.21.15.5:0/687143679 >> 172.21.15.5:0/687143679 conn(0x7fda880794f0 msgr2=0x7fda88079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:26.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.149+0000 7fda8f6ed640 1 -- 172.21.15.5:0/687143679 shutdown_connections 2024-08-31T05:21:26.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.149+0000 7fda8f6ed640 1 -- 172.21.15.5:0/687143679 wait complete. 2024-08-31T05:21:26.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.149+0000 7fda8f6ed640 1 Processor -- start 2024-08-31T05:21:26.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.150+0000 7fda8f6ed640 1 -- start start 2024-08-31T05:21:26.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.150+0000 7fda8f6ed640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda88102840 0x7fda8819a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:26.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.150+0000 7fda8f6ed640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda88108180 0x7fda8819a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:26.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.150+0000 7fda8f6ed640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda88108ad0 0x7fda8819fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:26.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.150+0000 7fda8f6ed640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fda881127a0 con 0x7fda88102840 2024-08-31T05:21:26.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.150+0000 7fda8f6ed640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fda88112620 con 0x7fda88108180 2024-08-31T05:21:26.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.150+0000 7fda8f6ed640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fda88112920 con 0x7fda88108ad0 2024-08-31T05:21:26.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.150+0000 7fda8d489640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda88102840 0x7fda8819a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:26.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.150+0000 7fda8cc88640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda88108180 0x7fda8819a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:26.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.150+0000 7fda8d489640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda88102840 0x7fda8819a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53730/0 (socket says 172.21.15.5:53730) 2024-08-31T05:21:26.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.150+0000 7fda8d489640 1 -- 172.21.15.5:0/4085003979 learned_addr learned my addr 172.21.15.5:0/4085003979 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:21:26.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.150+0000 7fda8dc8a640 1 --2- 172.21.15.5:0/4085003979 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda88108ad0 0x7fda8819fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:26.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.150+0000 7fda8cc88640 1 -- 172.21.15.5:0/4085003979 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda88108ad0 msgr2=0x7fda8819fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:26.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.150+0000 7fda8cc88640 1 --2- 172.21.15.5:0/4085003979 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda88108ad0 0x7fda8819fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:26.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.150+0000 7fda8cc88640 1 -- 172.21.15.5:0/4085003979 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda88102840 msgr2=0x7fda8819a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:26.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.150+0000 7fda8cc88640 1 --2- 172.21.15.5:0/4085003979 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda88102840 0x7fda8819a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:26.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.150+0000 7fda8cc88640 1 -- 172.21.15.5:0/4085003979 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda881a02b0 con 0x7fda88108180 2024-08-31T05:21:26.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.150+0000 7fda8dc8a640 1 --2- 172.21.15.5:0/4085003979 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda88108ad0 0x7fda8819fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:21:26.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.150+0000 7fda8d489640 1 --2- 172.21.15.5:0/4085003979 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda88102840 0x7fda8819a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:21:26.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.151+0000 7fda8cc88640 1 --2- 172.21.15.5:0/4085003979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda88108180 0x7fda8819a8e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fda8806a8c0 tx=0x7fda7800ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:26.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.151+0000 7fda7e7fc640 1 -- 172.21.15.5:0/4085003979 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda7800cd00 con 0x7fda88108180 2024-08-31T05:21:26.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.151+0000 7fda8f6ed640 1 -- 172.21.15.5:0/4085003979 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda881a05a0 con 0x7fda88108180 2024-08-31T05:21:26.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.151+0000 7fda7e7fc640 1 -- 172.21.15.5:0/4085003979 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda780035f0 con 0x7fda88108180 2024-08-31T05:21:26.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.151+0000 7fda7e7fc640 1 -- 172.21.15.5:0/4085003979 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda78010690 con 0x7fda88108180 2024-08-31T05:21:26.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.151+0000 7fda8f6ed640 1 -- 172.21.15.5:0/4085003979 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda880ff2f0 con 0x7fda88108180 2024-08-31T05:21:26.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.152+0000 7fda8f6ed640 1 -- 172.21.15.5:0/4085003979 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda88102c50 con 0x7fda88108180 2024-08-31T05:21:26.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.154+0000 7fda7e7fc640 1 -- 172.21.15.5:0/4085003979 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 19) ==== 152537+0+0 (secure 0 0 0) 0x7fda780037a0 con 0x7fda88108180 2024-08-31T05:21:26.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.155+0000 7fda7e7fc640 1 --2- 172.21.15.5:0/4085003979 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fda740b4b70 0x7fda740b7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:26.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.155+0000 7fda7e7fc640 1 -- 172.21.15.5:0/4085003979 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fda780e3820 con 0x7fda88108180 2024-08-31T05:21:26.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.155+0000 7fda8d489640 1 --2- 172.21.15.5:0/4085003979 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fda740b4b70 0x7fda740b7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:26.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.155+0000 7fda8d489640 1 --2- 172.21.15.5:0/4085003979 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fda740b4b70 0x7fda740b7080 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fda84031440 tx=0x7fda840058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:26.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.158+0000 7fda7e7fc640 1 -- 172.21.15.5:0/4085003979 <== mon.2 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fda780ac530 con 0x7fda88108180 2024-08-31T05:21:26.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:25 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/2448572541' entity='client.admin' 2024-08-31T05:21:26.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:25 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:26.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:25 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:26.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:25 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T05:21:26.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:25 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T05:21:26.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:25 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:21:26.249 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:25 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/2448572541' entity='client.admin' 2024-08-31T05:21:26.249 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:25 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:26.249 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:25 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:26.249 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:25 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T05:21:26.249 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:25 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T05:21:26.249 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:25 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:21:26.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:25 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/2448572541' entity='client.admin' 2024-08-31T05:21:26.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:25 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:26.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:25 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:26.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:25 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T05:21:26.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:25 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T05:21:26.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:25 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:21:26.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.348+0000 7fda8f6ed640 1 -- 172.21.15.5:0/4085003979 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command([{prefix=config set, name=debug_cephsqlite}] v 0) -- 0x7fda8810b8c0 con 0x7fda88108180 2024-08-31T05:21:26.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.354+0000 7fda7e7fc640 1 -- 172.21.15.5:0/4085003979 <== mon.2 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_cephsqlite}]=0 v34)=0 v34) ==== 115+0+0 (secure 0 0 0) 0x7fda78009440 con 0x7fda88108180 2024-08-31T05:21:26.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.357+0000 7fda8f6ed640 1 -- 172.21.15.5:0/4085003979 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fda740b4b70 msgr2=0x7fda740b7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:26.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.357+0000 7fda8f6ed640 1 --2- 172.21.15.5:0/4085003979 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fda740b4b70 0x7fda740b7080 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fda84031440 tx=0x7fda840058d0 comp rx=0 tx=0).stop 2024-08-31T05:21:26.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.357+0000 7fda8f6ed640 1 -- 172.21.15.5:0/4085003979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda88108180 msgr2=0x7fda8819a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:26.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.357+0000 7fda8f6ed640 1 --2- 172.21.15.5:0/4085003979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda88108180 0x7fda8819a8e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fda8806a8c0 tx=0x7fda7800ee50 comp rx=0 tx=0).stop 2024-08-31T05:21:26.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.357+0000 7fda8f6ed640 1 -- 172.21.15.5:0/4085003979 shutdown_connections 2024-08-31T05:21:26.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.357+0000 7fda8f6ed640 1 --2- 172.21.15.5:0/4085003979 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fda740b4b70 0x7fda740b7080 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:26.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.357+0000 7fda8f6ed640 1 --2- 172.21.15.5:0/4085003979 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda88108ad0 0x7fda8819fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:26.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.357+0000 7fda8f6ed640 1 --2- 172.21.15.5:0/4085003979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda88108180 0x7fda8819a8e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:26.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.357+0000 7fda8f6ed640 1 --2- 172.21.15.5:0/4085003979 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda88102840 0x7fda8819a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:26.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.357+0000 7fda8f6ed640 1 -- 172.21.15.5:0/4085003979 >> 172.21.15.5:0/4085003979 conn(0x7fda880794f0 msgr2=0x7fda881018e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:26.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.357+0000 7fda8f6ed640 1 -- 172.21.15.5:0/4085003979 shutdown_connections 2024-08-31T05:21:26.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:26.357+0000 7fda8f6ed640 1 -- 172.21.15.5:0/4085003979 wait complete. 2024-08-31T05:21:27.275 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '69422704-6758-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi005') 2024-08-31T05:21:27.388 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:27 smithi070 ceph-mon[22316]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:27.388 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:27 smithi070 ceph-mon[22316]: Reconfiguring mon.b (monmap changed)... 2024-08-31T05:21:27.388 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:27 smithi070 ceph-mon[22316]: Reconfiguring daemon mon.b on smithi050 2024-08-31T05:21:27.389 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:27 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/3934647322' entity='client.admin' 2024-08-31T05:21:27.389 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:27 smithi070 ceph-mon[22316]: from='client.? ' entity='client.admin' 2024-08-31T05:21:27.389 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:27 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:27.389 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:27 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:27.389 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:27 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T05:21:27.389 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:27 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T05:21:27.389 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:27 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:21:27.406 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:27 smithi005 ceph-mon[18602]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:27.406 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:27 smithi005 ceph-mon[18602]: Reconfiguring mon.b (monmap changed)... 2024-08-31T05:21:27.406 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:27 smithi005 ceph-mon[18602]: Reconfiguring daemon mon.b on smithi050 2024-08-31T05:21:27.406 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:27 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/3934647322' entity='client.admin' 2024-08-31T05:21:27.406 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:27 smithi005 ceph-mon[18602]: from='client.? ' entity='client.admin' 2024-08-31T05:21:27.406 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:27 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:27.406 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:27 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:27.406 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:27 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T05:21:27.407 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:27 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T05:21:27.407 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:27 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:21:27.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:27 smithi050 ceph-mon[22146]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:27.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:27 smithi050 ceph-mon[22146]: Reconfiguring mon.b (monmap changed)... 2024-08-31T05:21:27.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:27 smithi050 ceph-mon[22146]: Reconfiguring daemon mon.b on smithi050 2024-08-31T05:21:27.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:27 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/3934647322' entity='client.admin' 2024-08-31T05:21:27.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:27 smithi050 ceph-mon[22146]: from='client.? ' entity='client.admin' 2024-08-31T05:21:27.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:27 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:27.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:27 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:27.408 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:27 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T05:21:27.408 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:27 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T05:21:27.408 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:27 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:21:27.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.502+0000 7fe799cdd640 1 -- 172.21.15.5:0/2161308544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe794101d10 msgr2=0x7fe794102120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:27.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.502+0000 7fe799cdd640 1 --2- 172.21.15.5:0/2161308544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe794101d10 0x7fe794102120 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe784009900 tx=0x7fe78402a410 comp rx=0 tx=0).stop 2024-08-31T05:21:27.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.502+0000 7fe799cdd640 1 -- 172.21.15.5:0/2161308544 shutdown_connections 2024-08-31T05:21:27.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.502+0000 7fe799cdd640 1 --2- 172.21.15.5:0/2161308544 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe794109ba0 0x7fe7941103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:27.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.502+0000 7fe799cdd640 1 --2- 172.21.15.5:0/2161308544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe794109250 0x7fe794109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:27.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.502+0000 7fe799cdd640 1 --2- 172.21.15.5:0/2161308544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe794101d10 0x7fe794102120 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:27.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.502+0000 7fe799cdd640 1 -- 172.21.15.5:0/2161308544 >> 172.21.15.5:0/2161308544 conn(0x7fe794077a00 msgr2=0x7fe794077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:27.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.502+0000 7fe799cdd640 1 -- 172.21.15.5:0/2161308544 shutdown_connections 2024-08-31T05:21:27.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.502+0000 7fe799cdd640 1 -- 172.21.15.5:0/2161308544 wait complete. 2024-08-31T05:21:27.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.503+0000 7fe799cdd640 1 Processor -- start 2024-08-31T05:21:27.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.503+0000 7fe799cdd640 1 -- start start 2024-08-31T05:21:27.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.503+0000 7fe799cdd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe794101d10 0x7fe79419a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:27.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.503+0000 7fe799cdd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe794109250 0x7fe79419a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:27.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.503+0000 7fe799cdd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe794109ba0 0x7fe79419fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:27.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.503+0000 7fe799cdd640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe7941138b0 con 0x7fe794109ba0 2024-08-31T05:21:27.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.503+0000 7fe799cdd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe794113730 con 0x7fe794101d10 2024-08-31T05:21:27.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.503+0000 7fe799cdd640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe794113a30 con 0x7fe794109250 2024-08-31T05:21:27.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.503+0000 7fe793fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe794109ba0 0x7fe79419fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:27.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.503+0000 7fe793fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe794109ba0 0x7fe79419fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53742/0 (socket says 172.21.15.5:53742) 2024-08-31T05:21:27.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.503+0000 7fe793fff640 1 -- 172.21.15.5:0/993771460 learned_addr learned my addr 172.21.15.5:0/993771460 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:21:27.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.503+0000 7fe792ffd640 1 --2- 172.21.15.5:0/993771460 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe794109250 0x7fe79419a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:27.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.504+0000 7fe7937fe640 1 --2- 172.21.15.5:0/993771460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe794101d10 0x7fe79419a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:27.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.504+0000 7fe793fff640 1 -- 172.21.15.5:0/993771460 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe794109250 msgr2=0x7fe79419a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:27.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.504+0000 7fe793fff640 1 --2- 172.21.15.5:0/993771460 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe794109250 0x7fe79419a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:27.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.504+0000 7fe793fff640 1 -- 172.21.15.5:0/993771460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe794101d10 msgr2=0x7fe79419a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:27.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.504+0000 7fe793fff640 1 --2- 172.21.15.5:0/993771460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe794101d10 0x7fe79419a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:27.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.504+0000 7fe793fff640 1 -- 172.21.15.5:0/993771460 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7941a0170 con 0x7fe794109ba0 2024-08-31T05:21:27.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.504+0000 7fe7937fe640 1 --2- 172.21.15.5:0/993771460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe794101d10 0x7fe79419a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:21:27.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.504+0000 7fe793fff640 1 --2- 172.21.15.5:0/993771460 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe794109ba0 0x7fe79419fa40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe78c00eaa0 tx=0x7fe78c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:27.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.504+0000 7fe790ff9640 1 -- 172.21.15.5:0/993771460 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe78c00cdb0 con 0x7fe794109ba0 2024-08-31T05:21:27.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.504+0000 7fe790ff9640 1 -- 172.21.15.5:0/993771460 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe78c005020 con 0x7fe794109ba0 2024-08-31T05:21:27.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.504+0000 7fe790ff9640 1 -- 172.21.15.5:0/993771460 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe78c0116d0 con 0x7fe794109ba0 2024-08-31T05:21:27.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.504+0000 7fe799cdd640 1 -- 172.21.15.5:0/993771460 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7941a0460 con 0x7fe794109ba0 2024-08-31T05:21:27.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.504+0000 7fe799cdd640 1 -- 172.21.15.5:0/993771460 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7941a6bc0 con 0x7fe794109ba0 2024-08-31T05:21:27.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.505+0000 7fe799cdd640 1 -- 172.21.15.5:0/993771460 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe794102120 con 0x7fe794109ba0 2024-08-31T05:21:27.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.507+0000 7fe790ff9640 1 -- 172.21.15.5:0/993771460 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) ==== 152537+0+0 (secure 0 0 0) 0x7fe78c0051d0 con 0x7fe794109ba0 2024-08-31T05:21:27.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.507+0000 7fe790ff9640 1 --2- 172.21.15.5:0/993771460 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe77c0b4b70 0x7fe77c0b7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:27.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.508+0000 7fe7937fe640 1 --2- 172.21.15.5:0/993771460 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe77c0b4b70 0x7fe77c0b7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:27.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.508+0000 7fe790ff9640 1 -- 172.21.15.5:0/993771460 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fe78c0e3a50 con 0x7fe794109ba0 2024-08-31T05:21:27.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.508+0000 7fe7937fe640 1 --2- 172.21.15.5:0/993771460 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe77c0b4b70 0x7fe77c0b7080 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe784000c00 tx=0x7fe784031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:27.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.511+0000 7fe790ff9640 1 -- 172.21.15.5:0/993771460 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe78c016030 con 0x7fe794109ba0 2024-08-31T05:21:27.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.699+0000 7fe799cdd640 1 -- 172.21.15.5:0/993771460 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fe79419b330 con 0x7fe794109ba0 2024-08-31T05:21:27.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.703+0000 7fe790ff9640 1 -- 172.21.15.5:0/993771460 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v35)=0 v35) ==== 120+0+0 (secure 0 0 0) 0x7fe79419b330 con 0x7fe794109ba0 2024-08-31T05:21:27.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.706+0000 7fe799cdd640 1 -- 172.21.15.5:0/993771460 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe77c0b4b70 msgr2=0x7fe77c0b7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:27.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.706+0000 7fe799cdd640 1 --2- 172.21.15.5:0/993771460 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe77c0b4b70 0x7fe77c0b7080 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe784000c00 tx=0x7fe784031400 comp rx=0 tx=0).stop 2024-08-31T05:21:27.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.706+0000 7fe799cdd640 1 -- 172.21.15.5:0/993771460 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe794109ba0 msgr2=0x7fe79419fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:27.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.706+0000 7fe799cdd640 1 --2- 172.21.15.5:0/993771460 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe794109ba0 0x7fe79419fa40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe78c00eaa0 tx=0x7fe78c00ef60 comp rx=0 tx=0).stop 2024-08-31T05:21:27.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.706+0000 7fe799cdd640 1 -- 172.21.15.5:0/993771460 shutdown_connections 2024-08-31T05:21:27.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.706+0000 7fe799cdd640 1 --2- 172.21.15.5:0/993771460 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe77c0b4b70 0x7fe77c0b7080 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:27.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.706+0000 7fe799cdd640 1 --2- 172.21.15.5:0/993771460 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe794109ba0 0x7fe79419fa40 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:27.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.706+0000 7fe799cdd640 1 --2- 172.21.15.5:0/993771460 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe794109250 0x7fe79419a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:27.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.706+0000 7fe799cdd640 1 --2- 172.21.15.5:0/993771460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe794101d10 0x7fe79419a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:27.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.706+0000 7fe799cdd640 1 -- 172.21.15.5:0/993771460 >> 172.21.15.5:0/993771460 conn(0x7fe794077a00 msgr2=0x7fe794107240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:27.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.706+0000 7fe799cdd640 1 -- 172.21.15.5:0/993771460 shutdown_connections 2024-08-31T05:21:27.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:27.706+0000 7fe799cdd640 1 -- 172.21.15.5:0/993771460 wait complete. 2024-08-31T05:21:28.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:28 smithi050 ceph-mon[22146]: Reconfiguring mon.c (monmap changed)... 2024-08-31T05:21:28.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:28 smithi050 ceph-mon[22146]: Reconfiguring daemon mon.c on smithi070 2024-08-31T05:21:28.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:28 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/993771460' entity='client.admin' 2024-08-31T05:21:28.408 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:28 smithi005 ceph-mon[18602]: Reconfiguring mon.c (monmap changed)... 2024-08-31T05:21:28.408 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:28 smithi005 ceph-mon[18602]: Reconfiguring daemon mon.c on smithi070 2024-08-31T05:21:28.408 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:28 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/993771460' entity='client.admin' 2024-08-31T05:21:28.512 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '69422704-6758-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mgr', 'debug_cephsqlite', '20'], check_status=True, hostname='smithi005') 2024-08-31T05:21:28.512 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '69422704-6758-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/allow_m_granularity', 'True'], check_status=True, hostname='smithi005') 2024-08-31T05:21:28.512 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '69422704-6758-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/dump_on_update', 'True'], check_status=True, hostname='smithi005') 2024-08-31T05:21:28.513 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '69422704-6758-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/log_level', 'debug'], check_status=True, hostname='smithi005') 2024-08-31T05:21:28.513 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '69422704-6758-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi005') 2024-08-31T05:21:28.513 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '69422704-6758-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi005') 2024-08-31T05:21:28.513 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '69422704-6758-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi005') 2024-08-31T05:21:28.513 INFO:tasks.cephadm:Deploying OSDs... 2024-08-31T05:21:28.514 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-31T05:21:28.514 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/scratch_devs of=/dev/stdout 2024-08-31T05:21:28.529 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-31T05:21:28.530 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_1 2024-08-31T05:21:28.584 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-31T05:21:28.585 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T05:21:28.585 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-08-31T05:21:28.585 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T05:21:28.585 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T05:21:28.585 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-08-31 05:20:07.208825243 +0000 2024-08-31T05:21:28.585 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-08-31 05:15:29.461997590 +0000 2024-08-31T05:21:28.585 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-08-31 05:15:29.461997590 +0000 2024-08-31T05:21:28.585 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-08-31 05:15:29.461997590 +0000 2024-08-31T05:21:28.585 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-31T05:21:28.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:28 smithi070 ceph-mon[22316]: Reconfiguring mon.c (monmap changed)... 2024-08-31T05:21:28.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:28 smithi070 ceph-mon[22316]: Reconfiguring daemon mon.c on smithi070 2024-08-31T05:21:28.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:28 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/993771460' entity='client.admin' 2024-08-31T05:21:28.649 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-31T05:21:28.649 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-31T05:21:28.649 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000109396 s, 4.7 MB/s 2024-08-31T05:21:28.650 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-31T05:21:28.706 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_2 2024-08-31T05:21:28.761 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-31T05:21:28.761 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T05:21:28.761 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-08-31T05:21:28.762 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T05:21:28.762 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T05:21:28.762 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-08-31 05:20:07.241824538 +0000 2024-08-31T05:21:28.762 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-08-31 05:15:29.778989653 +0000 2024-08-31T05:21:28.762 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-08-31 05:15:29.778989653 +0000 2024-08-31T05:21:28.762 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-08-31 05:15:29.778989653 +0000 2024-08-31T05:21:28.762 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-31T05:21:28.824 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-31T05:21:28.824 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-31T05:21:28.824 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.00010579 s, 4.8 MB/s 2024-08-31T05:21:28.825 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-31T05:21:28.885 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_3 2024-08-31T05:21:28.940 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-31T05:21:28.940 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T05:21:28.940 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-08-31T05:21:28.940 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T05:21:28.941 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T05:21:28.941 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-08-31 05:20:07.274823832 +0000 2024-08-31T05:21:28.941 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-08-31 05:15:30.087981915 +0000 2024-08-31T05:21:28.941 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-08-31 05:15:30.087981915 +0000 2024-08-31T05:21:28.941 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-08-31 05:15:30.087981915 +0000 2024-08-31T05:21:28.941 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-31T05:21:29.003 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-31T05:21:29.003 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-31T05:21:29.003 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000107449 s, 4.8 MB/s 2024-08-31T05:21:29.004 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-31T05:21:29.060 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_4 2024-08-31T05:21:29.115 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-31T05:21:29.115 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T05:21:29.116 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-08-31T05:21:29.116 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T05:21:29.116 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T05:21:29.116 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-08-31 05:20:07.310823062 +0000 2024-08-31T05:21:29.116 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-08-31 05:15:30.403974003 +0000 2024-08-31T05:21:29.116 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-08-31 05:15:30.403974003 +0000 2024-08-31T05:21:29.116 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-08-31 05:15:30.403974003 +0000 2024-08-31T05:21:29.116 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-31T05:21:29.179 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-08-31T05:21:29.179 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-08-31T05:21:29.179 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 9.8823e-05 s, 5.2 MB/s 2024-08-31T05:21:29.180 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-31T05:21:29.236 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-08-31T05:21:29.236 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/scratch_devs of=/dev/stdout 2024-08-31T05:21:29.256 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-31T05:21:29.256 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_1 2024-08-31T05:21:29.314 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-31T05:21:29.314 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T05:21:29.314 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-08-31T05:21:29.314 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T05:21:29.314 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T05:21:29.314 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-08-31 05:21:06.004793677 +0000 2024-08-31T05:21:29.315 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-08-31 05:15:49.072926623 +0000 2024-08-31T05:21:29.315 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-08-31 05:15:49.072926623 +0000 2024-08-31T05:21:29.315 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2024-08-31 05:15:49.072926623 +0000 2024-08-31T05:21:29.315 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-31T05:21:29.381 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:29 smithi050 ceph-mon[22146]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:29.381 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:29 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:29.381 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:29 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:29.381 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:29 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:21:29.381 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:29 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:21:29.381 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:29 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:21:29.381 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:29 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:29.384 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-08-31T05:21:29.384 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-08-31T05:21:29.385 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000111717 s, 4.6 MB/s 2024-08-31T05:21:29.386 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-31T05:21:29.445 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_2 2024-08-31T05:21:29.466 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:29 smithi005 ceph-mon[18602]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:29.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:29 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:29.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:29 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:29.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:29 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:21:29.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:29 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:21:29.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:29 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:21:29.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:29 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:29.503 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-31T05:21:29.503 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T05:21:29.503 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-08-31T05:21:29.503 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T05:21:29.503 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T05:21:29.503 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-08-31 05:21:06.005793652 +0000 2024-08-31T05:21:29.504 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-08-31 05:15:49.387918659 +0000 2024-08-31T05:21:29.504 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-08-31 05:15:49.387918659 +0000 2024-08-31T05:21:29.504 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2024-08-31 05:15:49.387918659 +0000 2024-08-31T05:21:29.504 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-31T05:21:29.569 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-08-31T05:21:29.569 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-08-31T05:21:29.569 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.00011658 s, 4.4 MB/s 2024-08-31T05:21:29.570 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-31T05:21:29.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:29 smithi070 ceph-mon[22316]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:29.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:29 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:29.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:29 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:29.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:29 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:21:29.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:29 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:21:29.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:29 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:21:29.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:29 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:29.628 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_3 2024-08-31T05:21:29.685 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-31T05:21:29.685 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T05:21:29.685 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-08-31T05:21:29.685 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T05:21:29.685 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T05:21:29.685 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-08-31 05:21:06.005793652 +0000 2024-08-31T05:21:29.685 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-08-31 05:15:49.703910671 +0000 2024-08-31T05:21:29.685 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-08-31 05:15:49.703910671 +0000 2024-08-31T05:21:29.685 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2024-08-31 05:15:49.703910671 +0000 2024-08-31T05:21:29.686 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-31T05:21:29.750 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-08-31T05:21:29.751 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-08-31T05:21:29.751 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000119869 s, 4.3 MB/s 2024-08-31T05:21:29.752 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-31T05:21:29.810 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_4 2024-08-31T05:21:29.865 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-31T05:21:29.866 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T05:21:29.866 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-08-31T05:21:29.866 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T05:21:29.866 INFO:teuthology.orchestra.run.smithi050.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T05:21:29.866 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-08-31 05:21:06.005793652 +0000 2024-08-31T05:21:29.866 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-08-31 05:15:50.024902555 +0000 2024-08-31T05:21:29.866 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-08-31 05:15:50.024902555 +0000 2024-08-31T05:21:29.866 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: 2024-08-31 05:15:50.024902555 +0000 2024-08-31T05:21:29.866 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-31T05:21:29.929 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-08-31T05:21:29.930 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-08-31T05:21:29.930 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000112728 s, 4.5 MB/s 2024-08-31T05:21:29.931 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-31T05:21:29.988 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-08-31T05:21:29.989 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/scratch_devs of=/dev/stdout 2024-08-31T05:21:30.008 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-31T05:21:30.008 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_1 2024-08-31T05:21:30.067 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-31T05:21:30.067 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T05:21:30.067 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-08-31T05:21:30.068 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T05:21:30.068 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T05:21:30.068 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-08-31 05:21:03.510998130 +0000 2024-08-31T05:21:30.068 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-08-31 05:15:57.605017338 +0000 2024-08-31T05:21:30.068 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-08-31 05:15:57.605017338 +0000 2024-08-31T05:21:30.068 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2024-08-31 05:15:57.605017338 +0000 2024-08-31T05:21:30.068 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-31T05:21:30.138 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-08-31T05:21:30.139 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-08-31T05:21:30.139 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.00013442 s, 3.8 MB/s 2024-08-31T05:21:30.140 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-31T05:21:30.200 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_2 2024-08-31T05:21:30.256 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-31T05:21:30.257 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T05:21:30.257 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 688 Links: 1 2024-08-31T05:21:30.257 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T05:21:30.257 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T05:21:30.257 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-08-31 05:21:03.510998130 +0000 2024-08-31T05:21:30.257 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-08-31 05:15:57.921007603 +0000 2024-08-31T05:21:30.257 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-08-31 05:15:57.921007603 +0000 2024-08-31T05:21:30.257 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2024-08-31 05:15:57.921007603 +0000 2024-08-31T05:21:30.257 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-31T05:21:30.322 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-08-31T05:21:30.322 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-08-31T05:21:30.322 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000117785 s, 4.3 MB/s 2024-08-31T05:21:30.324 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-31T05:21:30.381 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_3 2024-08-31T05:21:30.437 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-31T05:21:30.437 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T05:21:30.437 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-08-31T05:21:30.437 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T05:21:30.437 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T05:21:30.437 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-08-31 05:21:03.510998130 +0000 2024-08-31T05:21:30.437 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-08-31 05:15:58.241997714 +0000 2024-08-31T05:21:30.437 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-08-31 05:15:58.241997714 +0000 2024-08-31T05:21:30.437 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2024-08-31 05:15:58.241997714 +0000 2024-08-31T05:21:30.438 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-31T05:21:30.501 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-08-31T05:21:30.501 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-08-31T05:21:30.501 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 8.8413e-05 s, 5.8 MB/s 2024-08-31T05:21:30.502 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-31T05:21:30.558 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_4 2024-08-31T05:21:30.614 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-31T05:21:30.614 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T05:21:30.614 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-08-31T05:21:30.614 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T05:21:30.614 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T05:21:30.614 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-08-31 05:21:03.511998099 +0000 2024-08-31T05:21:30.614 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-08-31 05:15:58.571987548 +0000 2024-08-31T05:21:30.614 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-08-31 05:15:58.571987548 +0000 2024-08-31T05:21:30.614 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2024-08-31 05:15:58.571987548 +0000 2024-08-31T05:21:30.615 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-31T05:21:30.677 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-08-31T05:21:30.677 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-08-31T05:21:30.677 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000113324 s, 4.5 MB/s 2024-08-31T05:21:30.678 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-31T05:21:30.735 INFO:tasks.cephadm:Deploying osd.0 on smithi005 with /dev/vg_nvme/lv_4... 2024-08-31T05:21:30.735 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-31T05:21:30.993 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:21:31.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:31 smithi050 ceph-mon[22146]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:31.415 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:31 smithi005 ceph-mon[18602]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:31.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:31 smithi070 ceph-mon[22316]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:33.320 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:21:33.348 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi005:vg_nvme/lv_4 2024-08-31T05:21:33.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:33 smithi050 ceph-mon[22146]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:33.466 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:33 smithi005 ceph-mon[18602]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:33.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:33 smithi070 ceph-mon[22316]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:33.594 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:21:34.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:34.003+0000 7f82e99bf640 1 -- 172.21.15.5:0/2333090895 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82e4108ac0 msgr2=0x7f82e410f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:34.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:34.003+0000 7f82e99bf640 1 --2- 172.21.15.5:0/2333090895 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82e4108ac0 0x7f82e410f2f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f82dc009ca0 tx=0x7f82dc02a8c0 comp rx=0 tx=0).stop 2024-08-31T05:21:34.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:34.003+0000 7f82e99bf640 1 -- 172.21.15.5:0/2333090895 shutdown_connections 2024-08-31T05:21:34.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:34.003+0000 7f82e99bf640 1 --2- 172.21.15.5:0/2333090895 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82e4108ac0 0x7f82e410f2f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:34.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:34.003+0000 7f82e99bf640 1 --2- 172.21.15.5:0/2333090895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82e4108170 0x7f82e4108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:34.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:34.003+0000 7f82e99bf640 1 --2- 172.21.15.5:0/2333090895 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82e4102880 0x7f82e4102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:34.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:34.003+0000 7f82e99bf640 1 -- 172.21.15.5:0/2333090895 >> 172.21.15.5:0/2333090895 conn(0x7f82e4079500 msgr2=0x7f82e4079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:34.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:34.003+0000 7f82e99bf640 1 -- 172.21.15.5:0/2333090895 shutdown_connections 2024-08-31T05:21:34.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:34.003+0000 7f82e99bf640 1 -- 172.21.15.5:0/2333090895 wait complete. 2024-08-31T05:21:34.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:34.004+0000 7f82e99bf640 1 Processor -- start 2024-08-31T05:21:34.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:34.004+0000 7f82e99bf640 1 -- start start 2024-08-31T05:21:34.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:34.004+0000 7f82e99bf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82e4102880 0x7f82e419a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:34.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:34.004+0000 7f82e99bf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82e4108170 0x7f82e419a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:34.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:34.004+0000 7f82e99bf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82e4108ac0 0x7f82e419fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:34.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:34.004+0000 7f82e99bf640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f82e4112740 con 0x7f82e4108ac0 2024-08-31T05:21:34.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:34.004+0000 7f82e99bf640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f82e41125c0 con 0x7f82e4102880 2024-08-31T05:21:34.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:34.004+0000 7f82e99bf640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f82e41128c0 con 0x7f82e4108170 2024-08-31T05:21:34.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:34.004+0000 7f82e37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82e4108ac0 0x7f82e419fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:34.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:34.004+0000 7f82e37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82e4108ac0 0x7f82e419fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51812/0 (socket says 172.21.15.5:51812) 2024-08-31T05:21:34.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:34.004+0000 7f82e37fe640 1 -- 172.21.15.5:0/247207354 learned_addr learned my addr 172.21.15.5:0/247207354 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:21:34.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:34.004+0000 7f82e27fc640 1 --2- 172.21.15.5:0/247207354 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82e4108170 0x7f82e419a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:34.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:34.004+0000 7f82e2ffd640 1 --2- 172.21.15.5:0/247207354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82e4102880 0x7f82e419a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:34.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:34.005+0000 7f82e37fe640 1 -- 172.21.15.5:0/247207354 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82e4108170 msgr2=0x7f82e419a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:34.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:34.005+0000 7f82e37fe640 1 --2- 172.21.15.5:0/247207354 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82e4108170 0x7f82e419a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:34.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:34.005+0000 7f82e37fe640 1 -- 172.21.15.5:0/247207354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82e4102880 msgr2=0x7f82e419a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:34.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:34.005+0000 7f82e37fe640 1 --2- 172.21.15.5:0/247207354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82e4102880 0x7f82e419a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:34.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:34.005+0000 7f82e37fe640 1 -- 172.21.15.5:0/247207354 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82e41a0130 con 0x7f82e4108ac0 2024-08-31T05:21:34.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:34.005+0000 7f82e37fe640 1 --2- 172.21.15.5:0/247207354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82e4108ac0 0x7f82e419fa00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f82dc005cc0 tx=0x7f82dc02f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:34.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:34.005+0000 7f82e89bd640 1 -- 172.21.15.5:0/247207354 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82dc003bf0 con 0x7f82e4108ac0 2024-08-31T05:21:34.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:34.005+0000 7f82e89bd640 1 -- 172.21.15.5:0/247207354 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82dc003d90 con 0x7f82e4108ac0 2024-08-31T05:21:34.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:34.005+0000 7f82e99bf640 1 -- 172.21.15.5:0/247207354 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82e41a03c0 con 0x7f82e4108ac0 2024-08-31T05:21:34.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:34.005+0000 7f82e89bd640 1 -- 172.21.15.5:0/247207354 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82dc02fbc0 con 0x7f82e4108ac0 2024-08-31T05:21:34.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:34.005+0000 7f82e99bf640 1 -- 172.21.15.5:0/247207354 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82e41a6b80 con 0x7f82e4108ac0 2024-08-31T05:21:34.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:34.006+0000 7f82e99bf640 1 -- 172.21.15.5:0/247207354 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82e4102c90 con 0x7f82e4108ac0 2024-08-31T05:21:34.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:34.009+0000 7f82e89bd640 1 -- 172.21.15.5:0/247207354 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) ==== 152537+0+0 (secure 0 0 0) 0x7f82dc02fd60 con 0x7f82e4108ac0 2024-08-31T05:21:34.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:34.009+0000 7f82e89bd640 1 --2- 172.21.15.5:0/247207354 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f82cc0b4af0 0x7f82cc0b7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:34.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:34.009+0000 7f82e2ffd640 1 --2- 172.21.15.5:0/247207354 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f82cc0b4af0 0x7f82cc0b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:34.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:34.009+0000 7f82e89bd640 1 -- 172.21.15.5:0/247207354 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f82dc104c90 con 0x7f82e4108ac0 2024-08-31T05:21:34.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:34.010+0000 7f82e2ffd640 1 --2- 172.21.15.5:0/247207354 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f82cc0b4af0 0x7f82cc0b7000 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f82d4005fd0 tx=0x7f82d4005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:34.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:34.013+0000 7f82e89bd640 1 -- 172.21.15.5:0/247207354 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f82dc0cd920 con 0x7f82e4108ac0 2024-08-31T05:21:34.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:34.208+0000 7f82e99bf640 1 -- 172.21.15.5:0/247207354 --> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f82e410b920 con 0x7f82cc0b4af0 2024-08-31T05:21:35.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:35 smithi005 ceph-mon[18602]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:35.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:35 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:21:35.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:35 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:21:35.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:35 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:21:35.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:35 smithi050 ceph-mon[22146]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:35.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:35 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:21:35.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:35 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:21:35.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:35 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:21:35.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:35 smithi070 ceph-mon[22316]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:35.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:35 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:21:35.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:35 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:21:35.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:35 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:21:36.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:36 smithi050 ceph-mon[22146]: from='client.14415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:21:36.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:36 smithi005 ceph-mon[18602]: from='client.14415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:21:36.585 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:36 smithi070 ceph-mon[22316]: from='client.14415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:21:37.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:37 smithi050 ceph-mon[22146]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:37.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:37 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/1599392167' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c5745391-e9d7-4799-9db9-6b34bb91b7df"} : dispatch 2024-08-31T05:21:37.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:37 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/1599392167' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c5745391-e9d7-4799-9db9-6b34bb91b7df"}]': finished 2024-08-31T05:21:37.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:37 smithi050 ceph-mon[22146]: osdmap e6: 1 total, 0 up, 1 in 2024-08-31T05:21:37.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:37 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T05:21:37.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:37 smithi005 ceph-mon[18602]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:37.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:37 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/1599392167' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c5745391-e9d7-4799-9db9-6b34bb91b7df"} : dispatch 2024-08-31T05:21:37.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:37 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/1599392167' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c5745391-e9d7-4799-9db9-6b34bb91b7df"}]': finished 2024-08-31T05:21:37.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:37 smithi005 ceph-mon[18602]: osdmap e6: 1 total, 0 up, 1 in 2024-08-31T05:21:37.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:37 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T05:21:37.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:37 smithi070 ceph-mon[22316]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:37.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:37 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/1599392167' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c5745391-e9d7-4799-9db9-6b34bb91b7df"} : dispatch 2024-08-31T05:21:37.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:37 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/1599392167' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c5745391-e9d7-4799-9db9-6b34bb91b7df"}]': finished 2024-08-31T05:21:37.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:37 smithi070 ceph-mon[22316]: osdmap e6: 1 total, 0 up, 1 in 2024-08-31T05:21:37.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:37 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T05:21:38.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:38 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/1036696999' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:21:38.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:38 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/1036696999' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:21:38.487 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:38 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/1036696999' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:21:39.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:39 smithi050 ceph-mon[22146]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:39.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:39 smithi005 ceph-mon[18602]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:39.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:39 smithi070 ceph-mon[22316]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:41.216 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:41 smithi005 ceph-mon[18602]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:41.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:41 smithi050 ceph-mon[22146]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:41.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:41 smithi070 ceph-mon[22316]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:43.374 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:43 smithi005 ceph-mon[18602]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:43.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:43 smithi050 ceph-mon[22146]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:43.588 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:43 smithi070 ceph-mon[22316]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:45.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:45 smithi005 ceph-mon[18602]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:45.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:45 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-08-31T05:21:45.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:45 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:21:45.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:45 smithi070 ceph-mon[22316]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:45.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:45 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-08-31T05:21:45.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:45 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:21:45.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:45 smithi050 ceph-mon[22146]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:45.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:45 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-08-31T05:21:45.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:45 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:21:46.452 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:46 smithi005 ceph-mon[18602]: Deploying daemon osd.0 on smithi005 2024-08-31T05:21:46.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:46 smithi070 ceph-mon[22316]: Deploying daemon osd.0 on smithi005 2024-08-31T05:21:46.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:46 smithi050 ceph-mon[22146]: Deploying daemon osd.0 on smithi005 2024-08-31T05:21:47.326 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:47 smithi005 ceph-mon[18602]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:47.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:47 smithi070 ceph-mon[22316]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:47.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:47 smithi050 ceph-mon[22146]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:49.283 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:49 smithi005 ceph-mon[18602]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:49.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:49 smithi070 ceph-mon[22316]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:49.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:49 smithi050 ceph-mon[22146]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:50.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:50 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:21:50.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:50 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:50.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:50 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:50.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:50 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:21:50.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:50 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:50.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:50 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:50.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:50 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:21:50.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:50 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:50.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:50 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:51.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:51 smithi005 ceph-mon[18602]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:51.585 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:51 smithi070 ceph-mon[22316]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:51.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:51 smithi050 ceph-mon[22146]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:53.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:53 smithi005 ceph-mon[18602]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:53.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:53 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:53.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:53 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:53.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:53 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:21:53.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:53 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:21:53.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:53 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:53.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:53 smithi070 ceph-mon[22316]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:53.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:53 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:53.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:53 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:53.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:53 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:21:53.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:53 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:21:53.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:53 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:53.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:53 smithi050 ceph-mon[22146]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:53.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:53 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:53.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:53 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:53.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:53 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:21:53.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:53 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:21:53.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:53 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:54.386 INFO:teuthology.orchestra.run.smithi005.stdout:Created osd(s) 0 on host 'smithi005' 2024-08-31T05:21:54.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:54.384+0000 7f82e89bd640 1 -- 172.21.15.5:0/247207354 <== mgr.14220 v2:172.21.15.5:6800/2696053609 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f82e410b920 con 0x7f82cc0b4af0 2024-08-31T05:21:54.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:54.386+0000 7f82e99bf640 1 -- 172.21.15.5:0/247207354 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f82cc0b4af0 msgr2=0x7f82cc0b7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:54.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:54.386+0000 7f82e99bf640 1 --2- 172.21.15.5:0/247207354 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f82cc0b4af0 0x7f82cc0b7000 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f82d4005fd0 tx=0x7f82d4005850 comp rx=0 tx=0).stop 2024-08-31T05:21:54.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:54.386+0000 7f82e99bf640 1 -- 172.21.15.5:0/247207354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82e4108ac0 msgr2=0x7f82e419fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:54.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:54.386+0000 7f82e99bf640 1 --2- 172.21.15.5:0/247207354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82e4108ac0 0x7f82e419fa00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f82dc005cc0 tx=0x7f82dc02f380 comp rx=0 tx=0).stop 2024-08-31T05:21:54.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:54.386+0000 7f82e99bf640 1 -- 172.21.15.5:0/247207354 shutdown_connections 2024-08-31T05:21:54.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:54.386+0000 7f82e99bf640 1 --2- 172.21.15.5:0/247207354 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f82cc0b4af0 0x7f82cc0b7000 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:54.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:54.386+0000 7f82e99bf640 1 --2- 172.21.15.5:0/247207354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82e4108ac0 0x7f82e419fa00 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:54.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:54.386+0000 7f82e99bf640 1 --2- 172.21.15.5:0/247207354 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82e4108170 0x7f82e419a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:54.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:54.386+0000 7f82e99bf640 1 --2- 172.21.15.5:0/247207354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82e4102880 0x7f82e419a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:54.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:54.386+0000 7f82e99bf640 1 -- 172.21.15.5:0/247207354 >> 172.21.15.5:0/247207354 conn(0x7f82e4079500 msgr2=0x7f82e4101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:54.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:54.386+0000 7f82e99bf640 1 -- 172.21.15.5:0/247207354 shutdown_connections 2024-08-31T05:21:54.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:21:54.386+0000 7f82e99bf640 1 -- 172.21.15.5:0/247207354 wait complete. 2024-08-31T05:21:55.042 DEBUG:teuthology.orchestra.run.smithi005:osd.0> sudo journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@osd.0.service 2024-08-31T05:21:55.048 INFO:tasks.cephadm:Deploying osd.1 on smithi050 with /dev/vg_nvme/lv_4... 2024-08-31T05:21:55.048 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-31T05:21:55.309 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T05:21:55.356 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:55 smithi005 ceph-mon[18602]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:55.356 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:55 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:21:55.356 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:55 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:55.356 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:55 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:55.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:55 smithi050 ceph-mon[22146]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:55.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:55 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:21:55.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:55 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:55.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:55 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:55.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:55 smithi070 ceph-mon[22316]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:55.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:55 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:21:55.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:55 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:55.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:55 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:56.188 INFO:journalctl@ceph.osd.0.smithi005.stdout:Aug 31 05:21:55 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-0[34499]: 2024-08-31T05:21:55.726+0000 7f6af7d72640 -1 osd.0 0 log_to_monitors true 2024-08-31T05:21:56.441 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:56 smithi050 ceph-mon[22146]: from='osd.0 [v2:172.21.15.5:6802/2312496244,v1:172.21.15.5:6803/2312496244]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-08-31T05:21:56.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:56 smithi005 ceph-mon[18602]: from='osd.0 [v2:172.21.15.5:6802/2312496244,v1:172.21.15.5:6803/2312496244]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-08-31T05:21:56.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:56 smithi070 ceph-mon[22316]: from='osd.0 [v2:172.21.15.5:6802/2312496244,v1:172.21.15.5:6803/2312496244]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-08-31T05:21:57.223 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:57 smithi005 ceph-mon[18602]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:57.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:57 smithi005 ceph-mon[18602]: from='osd.0 [v2:172.21.15.5:6802/2312496244,v1:172.21.15.5:6803/2312496244]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-31T05:21:57.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:57 smithi005 ceph-mon[18602]: osdmap e7: 1 total, 0 up, 1 in 2024-08-31T05:21:57.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:57 smithi005 ceph-mon[18602]: from='osd.0 [v2:172.21.15.5:6802/2312496244,v1:172.21.15.5:6803/2312496244]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]} : dispatch 2024-08-31T05:21:57.224 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:57 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T05:21:57.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:57 smithi050 ceph-mon[22146]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:57.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:57 smithi050 ceph-mon[22146]: from='osd.0 [v2:172.21.15.5:6802/2312496244,v1:172.21.15.5:6803/2312496244]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-31T05:21:57.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:57 smithi050 ceph-mon[22146]: osdmap e7: 1 total, 0 up, 1 in 2024-08-31T05:21:57.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:57 smithi050 ceph-mon[22146]: from='osd.0 [v2:172.21.15.5:6802/2312496244,v1:172.21.15.5:6803/2312496244]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]} : dispatch 2024-08-31T05:21:57.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:57 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T05:21:57.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:57 smithi070 ceph-mon[22316]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:57.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:57 smithi070 ceph-mon[22316]: from='osd.0 [v2:172.21.15.5:6802/2312496244,v1:172.21.15.5:6803/2312496244]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-31T05:21:57.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:57 smithi070 ceph-mon[22316]: osdmap e7: 1 total, 0 up, 1 in 2024-08-31T05:21:57.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:57 smithi070 ceph-mon[22316]: from='osd.0 [v2:172.21.15.5:6802/2312496244,v1:172.21.15.5:6803/2312496244]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]} : dispatch 2024-08-31T05:21:57.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:57 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T05:21:57.776 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T05:21:57.805 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi050:vg_nvme/lv_4 2024-08-31T05:21:57.896 INFO:journalctl@ceph.osd.0.smithi005.stdout:Aug 31 05:21:57 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-0[34499]: 2024-08-31T05:21:57.651+0000 7f6af4509640 -1 osd.0 0 waiting for initial osdmap 2024-08-31T05:21:57.896 INFO:journalctl@ceph.osd.0.smithi005.stdout:Aug 31 05:21:57 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-0[34499]: 2024-08-31T05:21:57.654+0000 7f6aebaea640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T05:21:58.056 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T05:21:58.444 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:58 smithi050 ceph-mon[22146]: from='osd.0 [v2:172.21.15.5:6802/2312496244,v1:172.21.15.5:6803/2312496244]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-08-31T05:21:58.444 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:58 smithi050 ceph-mon[22146]: osdmap e8: 1 total, 0 up, 1 in 2024-08-31T05:21:58.444 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:58 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T05:21:58.444 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:58 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T05:21:58.445 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:58 smithi050 ceph-mon[22146]: from='osd.0 [v2:172.21.15.5:6802/2312496244,v1:172.21.15.5:6803/2312496244]' entity='osd.0' 2024-08-31T05:21:58.445 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:58 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:58.445 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:58 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:58.445 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:58 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T05:21:58.445 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:58 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:58.446 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:58 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:21:58.446 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:58 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:21:58.446 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:58 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:58.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:58 smithi005 ceph-mon[18602]: from='osd.0 [v2:172.21.15.5:6802/2312496244,v1:172.21.15.5:6803/2312496244]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-08-31T05:21:58.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:58 smithi005 ceph-mon[18602]: osdmap e8: 1 total, 0 up, 1 in 2024-08-31T05:21:58.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:58 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T05:21:58.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:58 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T05:21:58.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:58 smithi005 ceph-mon[18602]: from='osd.0 [v2:172.21.15.5:6802/2312496244,v1:172.21.15.5:6803/2312496244]' entity='osd.0' 2024-08-31T05:21:58.469 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:58 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:58.469 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:58 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:58.469 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:58 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T05:21:58.469 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:58 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:58.469 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:58 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:21:58.469 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:58 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:21:58.469 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:58 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:58.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:21:58.537+0000 7fb2f512d640 1 -- 172.21.15.50:0/2838422004 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2f0108270 msgr2=0x7fb2f010eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:58.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:21:58.537+0000 7fb2f512d640 1 --2- 172.21.15.50:0/2838422004 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2f0108270 0x7fb2f010eaa0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb2e8009ca0 tx=0x7fb2e802a8c0 comp rx=0 tx=0).stop 2024-08-31T05:21:58.543 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:21:58.537+0000 7fb2f512d640 1 -- 172.21.15.50:0/2838422004 shutdown_connections 2024-08-31T05:21:58.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:21:58.537+0000 7fb2f512d640 1 --2- 172.21.15.50:0/2838422004 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2f0108270 0x7fb2f010eaa0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:58.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:21:58.537+0000 7fb2f512d640 1 --2- 172.21.15.50:0/2838422004 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2f0107920 0x7fb2f0107d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:58.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:21:58.537+0000 7fb2f512d640 1 --2- 172.21.15.50:0/2838422004 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2f0101fe0 0x7fb2f01023f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:58.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:21:58.537+0000 7fb2f512d640 1 -- 172.21.15.50:0/2838422004 >> 172.21.15.50:0/2838422004 conn(0x7fb2f0079d30 msgr2=0x7fb2f007a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:21:58.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:21:58.537+0000 7fb2f512d640 1 -- 172.21.15.50:0/2838422004 shutdown_connections 2024-08-31T05:21:58.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:21:58.537+0000 7fb2f512d640 1 -- 172.21.15.50:0/2838422004 wait complete. 2024-08-31T05:21:58.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:21:58.538+0000 7fb2f512d640 1 Processor -- start 2024-08-31T05:21:58.544 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:21:58.538+0000 7fb2f512d640 1 -- start start 2024-08-31T05:21:58.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:21:58.538+0000 7fb2f512d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2f0101fe0 0x7fb2f019a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:58.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:21:58.538+0000 7fb2f512d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2f0107920 0x7fb2f019a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:58.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:21:58.538+0000 7fb2f512d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2f0108270 0x7fb2f019faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:58.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:21:58.538+0000 7fb2f512d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f0111f30 con 0x7fb2f0107920 2024-08-31T05:21:58.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:21:58.538+0000 7fb2f512d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f0111db0 con 0x7fb2f0101fe0 2024-08-31T05:21:58.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:21:58.538+0000 7fb2f512d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f01120b0 con 0x7fb2f0108270 2024-08-31T05:21:58.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:21:58.539+0000 7fb2eed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2f0101fe0 0x7fb2f019a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:58.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:21:58.539+0000 7fb2eed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2f0101fe0 0x7fb2f019a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:33348/0 (socket says 172.21.15.50:33348) 2024-08-31T05:21:58.545 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:21:58.539+0000 7fb2eed9d640 1 -- 172.21.15.50:0/2795677265 learned_addr learned my addr 172.21.15.50:0/2795677265 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T05:21:58.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:21:58.539+0000 7fb2ef59e640 1 --2- 172.21.15.50:0/2795677265 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2f0108270 0x7fb2f019faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:58.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:21:58.539+0000 7fb2ee59c640 1 --2- 172.21.15.50:0/2795677265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2f0107920 0x7fb2f019a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:58.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:21:58.539+0000 7fb2eed9d640 1 -- 172.21.15.50:0/2795677265 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2f0108270 msgr2=0x7fb2f019faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:58.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:21:58.539+0000 7fb2eed9d640 1 --2- 172.21.15.50:0/2795677265 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2f0108270 0x7fb2f019faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:58.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:21:58.539+0000 7fb2eed9d640 1 -- 172.21.15.50:0/2795677265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2f0107920 msgr2=0x7fb2f019a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:21:58.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:21:58.539+0000 7fb2eed9d640 1 --2- 172.21.15.50:0/2795677265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2f0107920 0x7fb2f019a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:21:58.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:21:58.539+0000 7fb2eed9d640 1 -- 172.21.15.50:0/2795677265 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2f01a01d0 con 0x7fb2f0101fe0 2024-08-31T05:21:58.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:21:58.539+0000 7fb2ef59e640 1 --2- 172.21.15.50:0/2795677265 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2f0108270 0x7fb2f019faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:21:58.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:21:58.539+0000 7fb2ee59c640 1 --2- 172.21.15.50:0/2795677265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2f0107920 0x7fb2f019a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:21:58.546 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:21:58.539+0000 7fb2eed9d640 1 --2- 172.21.15.50:0/2795677265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2f0101fe0 0x7fb2f019a260 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb2e000c890 tx=0x7fb2e000cd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:58.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:21:58.539+0000 7fb2d7fff640 1 -- 172.21.15.50:0/2795677265 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2e0004220 con 0x7fb2f0101fe0 2024-08-31T05:21:58.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:21:58.539+0000 7fb2d7fff640 1 -- 172.21.15.50:0/2795677265 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2e00043c0 con 0x7fb2f0101fe0 2024-08-31T05:21:58.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:21:58.539+0000 7fb2f512d640 1 -- 172.21.15.50:0/2795677265 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2f01a04c0 con 0x7fb2f0101fe0 2024-08-31T05:21:58.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:21:58.539+0000 7fb2d7fff640 1 -- 172.21.15.50:0/2795677265 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2e0004a00 con 0x7fb2f0101fe0 2024-08-31T05:21:58.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:21:58.539+0000 7fb2f512d640 1 -- 172.21.15.50:0/2795677265 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2f01a6c20 con 0x7fb2f0101fe0 2024-08-31T05:21:58.547 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:21:58.540+0000 7fb2f512d640 1 -- 172.21.15.50:0/2795677265 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2f01023f0 con 0x7fb2f0101fe0 2024-08-31T05:21:58.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:21:58.542+0000 7fb2d7fff640 1 -- 172.21.15.50:0/2795677265 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 19) ==== 152537+0+0 (secure 0 0 0) 0x7fb2e00079b0 con 0x7fb2f0101fe0 2024-08-31T05:21:58.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:21:58.543+0000 7fb2d7fff640 1 --2- 172.21.15.50:0/2795677265 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb2d80b4b70 0x7fb2d80b7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:21:58.548 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:21:58.543+0000 7fb2d7fff640 1 -- 172.21.15.50:0/2795677265 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1702+0+0 (secure 0 0 0) 0x7fb2e00e39b0 con 0x7fb2f0101fe0 2024-08-31T05:21:58.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:21:58.543+0000 7fb2ee59c640 1 --2- 172.21.15.50:0/2795677265 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb2d80b4b70 0x7fb2d80b7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:21:58.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:21:58.543+0000 7fb2ee59c640 1 --2- 172.21.15.50:0/2795677265 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb2d80b4b70 0x7fb2d80b7080 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4005fd0 tx=0x7fb2e400b5d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:21:58.549 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:21:58.546+0000 7fb2d7fff640 1 -- 172.21.15.50:0/2795677265 <== mon.2 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb2e0014030 con 0x7fb2f0101fe0 2024-08-31T05:21:58.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:58 smithi070 ceph-mon[22316]: from='osd.0 [v2:172.21.15.5:6802/2312496244,v1:172.21.15.5:6803/2312496244]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-08-31T05:21:58.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:58 smithi070 ceph-mon[22316]: osdmap e8: 1 total, 0 up, 1 in 2024-08-31T05:21:58.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:58 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T05:21:58.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:58 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T05:21:58.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:58 smithi070 ceph-mon[22316]: from='osd.0 [v2:172.21.15.5:6802/2312496244,v1:172.21.15.5:6803/2312496244]' entity='osd.0' 2024-08-31T05:21:58.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:58 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:58.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:58 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:58.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:58 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T05:21:58.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:58 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:58.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:58 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:21:58.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:58 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:21:58.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:58 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:21:58.743 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:21:58.741+0000 7fb2f512d640 1 -- 172.21.15.50:0/2795677265 --> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fb2f0101390 con 0x7fb2d80b4b70 2024-08-31T05:21:59.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:59 smithi050 ceph-mon[22146]: purged_snaps scrub starts 2024-08-31T05:21:59.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:59 smithi050 ceph-mon[22146]: purged_snaps scrub ok 2024-08-31T05:21:59.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:59 smithi050 ceph-mon[22146]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:59.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:59 smithi050 ceph-mon[22146]: Detected new or changed devices on smithi005 2024-08-31T05:21:59.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:59 smithi050 ceph-mon[22146]: Adjusting osd_memory_target on smithi005 to 17092M 2024-08-31T05:21:59.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:59 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T05:21:59.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:59 smithi050 ceph-mon[22146]: osd.0 [v2:172.21.15.5:6802/2312496244,v1:172.21.15.5:6803/2312496244] boot 2024-08-31T05:21:59.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:59 smithi050 ceph-mon[22146]: osdmap e9: 1 total, 1 up, 1 in 2024-08-31T05:21:59.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:59 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T05:21:59.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:59 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:21:59.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:59 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:21:59.408 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:21:59 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:21:59.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:59 smithi005 ceph-mon[18602]: purged_snaps scrub starts 2024-08-31T05:21:59.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:59 smithi005 ceph-mon[18602]: purged_snaps scrub ok 2024-08-31T05:21:59.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:59 smithi005 ceph-mon[18602]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:59.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:59 smithi005 ceph-mon[18602]: Detected new or changed devices on smithi005 2024-08-31T05:21:59.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:59 smithi005 ceph-mon[18602]: Adjusting osd_memory_target on smithi005 to 17092M 2024-08-31T05:21:59.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:59 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T05:21:59.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:59 smithi005 ceph-mon[18602]: osd.0 [v2:172.21.15.5:6802/2312496244,v1:172.21.15.5:6803/2312496244] boot 2024-08-31T05:21:59.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:59 smithi005 ceph-mon[18602]: osdmap e9: 1 total, 1 up, 1 in 2024-08-31T05:21:59.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:59 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T05:21:59.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:59 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:21:59.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:59 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:21:59.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:21:59 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:21:59.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:59 smithi070 ceph-mon[22316]: purged_snaps scrub starts 2024-08-31T05:21:59.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:59 smithi070 ceph-mon[22316]: purged_snaps scrub ok 2024-08-31T05:21:59.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:59 smithi070 ceph-mon[22316]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T05:21:59.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:59 smithi070 ceph-mon[22316]: Detected new or changed devices on smithi005 2024-08-31T05:21:59.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:59 smithi070 ceph-mon[22316]: Adjusting osd_memory_target on smithi005 to 17092M 2024-08-31T05:21:59.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:59 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T05:21:59.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:59 smithi070 ceph-mon[22316]: osd.0 [v2:172.21.15.5:6802/2312496244,v1:172.21.15.5:6803/2312496244] boot 2024-08-31T05:21:59.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:59 smithi070 ceph-mon[22316]: osdmap e9: 1 total, 1 up, 1 in 2024-08-31T05:21:59.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:59 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T05:21:59.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:59 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:21:59.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:59 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:21:59.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:21:59 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:22:00.335 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:00 smithi050 ceph-mon[22146]: from='client.24272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:00.336 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:00 smithi050 ceph-mon[22146]: osdmap e10: 1 total, 1 up, 1 in 2024-08-31T05:22:00.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:00 smithi005 ceph-mon[18602]: from='client.24272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:00.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:00 smithi005 ceph-mon[18602]: osdmap e10: 1 total, 1 up, 1 in 2024-08-31T05:22:00.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:00 smithi070 ceph-mon[22316]: from='client.24272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:00.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:00 smithi070 ceph-mon[22316]: osdmap e10: 1 total, 1 up, 1 in 2024-08-31T05:22:01.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:01 smithi005 ceph-mon[18602]: pgmap v28: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:22:01.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:01 smithi005 ceph-mon[18602]: from='client.? 172.21.15.50:0/3514400874' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f1903bd7-b2c5-424e-a74e-795f729471db"} : dispatch 2024-08-31T05:22:01.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:01 smithi005 ceph-mon[18602]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f1903bd7-b2c5-424e-a74e-795f729471db"} : dispatch 2024-08-31T05:22:01.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:01 smithi005 ceph-mon[18602]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f1903bd7-b2c5-424e-a74e-795f729471db"}]': finished 2024-08-31T05:22:01.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:01 smithi005 ceph-mon[18602]: osdmap e11: 2 total, 1 up, 2 in 2024-08-31T05:22:01.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:01 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T05:22:01.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:01 smithi070 ceph-mon[22316]: pgmap v28: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:22:01.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:01 smithi070 ceph-mon[22316]: from='client.? 172.21.15.50:0/3514400874' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f1903bd7-b2c5-424e-a74e-795f729471db"} : dispatch 2024-08-31T05:22:01.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:01 smithi070 ceph-mon[22316]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f1903bd7-b2c5-424e-a74e-795f729471db"} : dispatch 2024-08-31T05:22:01.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:01 smithi070 ceph-mon[22316]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f1903bd7-b2c5-424e-a74e-795f729471db"}]': finished 2024-08-31T05:22:01.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:01 smithi070 ceph-mon[22316]: osdmap e11: 2 total, 1 up, 2 in 2024-08-31T05:22:01.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:01 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T05:22:01.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:01 smithi050 ceph-mon[22146]: pgmap v28: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:22:01.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:01 smithi050 ceph-mon[22146]: from='client.? 172.21.15.50:0/3514400874' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f1903bd7-b2c5-424e-a74e-795f729471db"} : dispatch 2024-08-31T05:22:01.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:01 smithi050 ceph-mon[22146]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f1903bd7-b2c5-424e-a74e-795f729471db"} : dispatch 2024-08-31T05:22:01.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:01 smithi050 ceph-mon[22146]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f1903bd7-b2c5-424e-a74e-795f729471db"}]': finished 2024-08-31T05:22:01.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:01 smithi050 ceph-mon[22146]: osdmap e11: 2 total, 1 up, 2 in 2024-08-31T05:22:01.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:01 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T05:22:02.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:02 smithi005 ceph-mon[18602]: from='client.? 172.21.15.50:0/2767398295' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:22:02.585 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:02 smithi070 ceph-mon[22316]: from='client.? 172.21.15.50:0/2767398295' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:22:02.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:02 smithi050 ceph-mon[22146]: from='client.? 172.21.15.50:0/2767398295' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:22:03.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:03 smithi005 ceph-mon[18602]: pgmap v31: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:22:03.595 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:03 smithi070 ceph-mon[22316]: pgmap v31: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:22:04.032 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:03 smithi050 ceph-mon[22146]: pgmap v31: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:22:04.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:04 smithi070 ceph-mon[22316]: pgmap v32: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:22:04.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:04 smithi050 ceph-mon[22146]: pgmap v32: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:22:04.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:04 smithi005 ceph-mon[18602]: pgmap v32: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:22:06.616 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:06 smithi050 ceph-mon[22146]: pgmap v33: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:22:06.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:06 smithi005 ceph-mon[18602]: pgmap v33: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:22:06.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:06 smithi070 ceph-mon[22316]: pgmap v33: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:22:08.531 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:08 smithi050 ceph-mon[22146]: pgmap v34: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:22:08.716 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:08 smithi005 ceph-mon[18602]: pgmap v34: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:22:08.835 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:08 smithi070 ceph-mon[22316]: pgmap v34: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:22:10.641 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:10 smithi050 ceph-mon[22146]: pgmap v35: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:22:10.641 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:10 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-08-31T05:22:10.641 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:10 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:22:10.641 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:10 smithi050 ceph-mon[22146]: Deploying daemon osd.1 on smithi050 2024-08-31T05:22:10.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:10 smithi005 ceph-mon[18602]: pgmap v35: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:22:10.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:10 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-08-31T05:22:10.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:10 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:22:10.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:10 smithi005 ceph-mon[18602]: Deploying daemon osd.1 on smithi050 2024-08-31T05:22:10.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:10 smithi070 ceph-mon[22316]: pgmap v35: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:22:10.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:10 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-08-31T05:22:10.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:10 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:22:10.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:10 smithi070 ceph-mon[22316]: Deploying daemon osd.1 on smithi050 2024-08-31T05:22:12.547 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:12 smithi050 ceph-mon[22146]: pgmap v36: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:22:12.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:12 smithi005 ceph-mon[18602]: pgmap v36: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:22:12.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:12 smithi070 ceph-mon[22316]: pgmap v36: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:22:14.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:14 smithi050 ceph-mon[22146]: pgmap v37: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:22:14.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:14 smithi005 ceph-mon[18602]: pgmap v37: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:22:14.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:14 smithi070 ceph-mon[22316]: pgmap v37: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:22:15.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:15 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:22:15.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:15 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:15.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:15 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:15.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:15 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:22:15.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:15 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:15.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:15 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:15.835 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:15 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:22:15.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:15 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:15.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:15 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:17.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:16 smithi005 ceph-mon[18602]: pgmap v38: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:22:17.226 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:16 smithi050 ceph-mon[22146]: pgmap v38: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:22:17.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:16 smithi070 ceph-mon[22316]: pgmap v38: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:22:18.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:18 smithi070 ceph-mon[22316]: pgmap v39: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:22:18.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:18 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:18.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:18 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:18.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:18 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:22:18.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:18 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:22:18.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:18 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:18.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:18 smithi050 ceph-mon[22146]: pgmap v39: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:22:18.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:18 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:18.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:18 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:18.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:18 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:22:18.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:18 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:22:18.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:18 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:18.983 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:18 smithi005 ceph-mon[18602]: pgmap v39: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:22:18.983 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:18 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:18.983 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:18 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:18.983 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:18 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:22:18.984 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:18 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:22:18.984 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:18 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:19.250 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:22:19.246+0000 7fb2d7fff640 1 -- 172.21.15.50:0/2795677265 <== mgr.14220 v2:172.21.15.5:6800/2696053609 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb2f0101390 con 0x7fb2d80b4b70 2024-08-31T05:22:19.251 INFO:teuthology.orchestra.run.smithi050.stdout:Created osd(s) 1 on host 'smithi050' 2024-08-31T05:22:19.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:22:19.248+0000 7fb2f512d640 1 -- 172.21.15.50:0/2795677265 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb2d80b4b70 msgr2=0x7fb2d80b7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:22:19.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:22:19.248+0000 7fb2f512d640 1 --2- 172.21.15.50:0/2795677265 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb2d80b4b70 0x7fb2d80b7080 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4005fd0 tx=0x7fb2e400b5d0 comp rx=0 tx=0).stop 2024-08-31T05:22:19.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:22:19.249+0000 7fb2f512d640 1 -- 172.21.15.50:0/2795677265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2f0101fe0 msgr2=0x7fb2f019a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:22:19.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:22:19.249+0000 7fb2f512d640 1 --2- 172.21.15.50:0/2795677265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2f0101fe0 0x7fb2f019a260 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb2e000c890 tx=0x7fb2e000cd50 comp rx=0 tx=0).stop 2024-08-31T05:22:19.252 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:22:19.249+0000 7fb2f512d640 1 -- 172.21.15.50:0/2795677265 shutdown_connections 2024-08-31T05:22:19.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:22:19.249+0000 7fb2f512d640 1 --2- 172.21.15.50:0/2795677265 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb2d80b4b70 0x7fb2d80b7080 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:19.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:22:19.249+0000 7fb2f512d640 1 --2- 172.21.15.50:0/2795677265 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2f0108270 0x7fb2f019faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:19.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:22:19.249+0000 7fb2f512d640 1 --2- 172.21.15.50:0/2795677265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2f0107920 0x7fb2f019a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:19.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:22:19.249+0000 7fb2f512d640 1 --2- 172.21.15.50:0/2795677265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb2f0101fe0 0x7fb2f019a260 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:19.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:22:19.249+0000 7fb2f512d640 1 -- 172.21.15.50:0/2795677265 >> 172.21.15.50:0/2795677265 conn(0x7fb2f0079d30 msgr2=0x7fb2f0100c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:22:19.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:22:19.249+0000 7fb2f512d640 1 -- 172.21.15.50:0/2795677265 shutdown_connections 2024-08-31T05:22:19.253 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:22:19.249+0000 7fb2f512d640 1 -- 172.21.15.50:0/2795677265 wait complete. 2024-08-31T05:22:19.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:19 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:22:19.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:19 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:19.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:19 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:19.885 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:19 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:22:19.885 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:19 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:19.885 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:19 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:19.913 DEBUG:teuthology.orchestra.run.smithi050:osd.1> sudo journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@osd.1.service 2024-08-31T05:22:19.916 INFO:tasks.cephadm:Deploying osd.2 on smithi070 with /dev/vg_nvme/lv_4... 2024-08-31T05:22:19.916 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-31T05:22:19.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:19 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:22:19.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:19 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:19.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:19 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:20.164 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T05:22:20.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:20 smithi070 ceph-mon[22316]: pgmap v40: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:22:20.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:20 smithi050 ceph-mon[22146]: pgmap v40: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:22:20.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:20 smithi005 ceph-mon[18602]: pgmap v40: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:22:21.192 INFO:journalctl@ceph.osd.1.smithi050.stdout:Aug 31 05:22:21 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-1[27783]: 2024-08-31T05:22:21.011+0000 7f85cccde640 -1 osd.1 0 log_to_monitors true 2024-08-31T05:22:21.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:21 smithi070 ceph-mon[22316]: from='osd.1 [v2:172.21.15.50:6800/2777359361,v1:172.21.15.50:6801/2777359361]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-31T05:22:21.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:21 smithi070 ceph-mon[22316]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-31T05:22:21.868 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:21 smithi005 ceph-mon[18602]: from='osd.1 [v2:172.21.15.50:6800/2777359361,v1:172.21.15.50:6801/2777359361]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-31T05:22:21.868 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:21 smithi005 ceph-mon[18602]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-31T05:22:21.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:21 smithi050 ceph-mon[22146]: from='osd.1 [v2:172.21.15.50:6800/2777359361,v1:172.21.15.50:6801/2777359361]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-31T05:22:21.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:21 smithi050 ceph-mon[22146]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-31T05:22:22.622 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-08-31T05:22:22.648 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi070:vg_nvme/lv_4 2024-08-31T05:22:22.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:22 smithi050 ceph-mon[22146]: pgmap v41: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:22:22.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:22 smithi050 ceph-mon[22146]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-31T05:22:22.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:22 smithi050 ceph-mon[22146]: osdmap e12: 2 total, 1 up, 2 in 2024-08-31T05:22:22.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:22 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T05:22:22.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:22 smithi050 ceph-mon[22146]: from='osd.1 [v2:172.21.15.50:6800/2777359361,v1:172.21.15.50:6801/2777359361]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T05:22:22.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:22 smithi050 ceph-mon[22146]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T05:22:22.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:22 smithi070 ceph-mon[22316]: pgmap v41: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:22:22.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:22 smithi070 ceph-mon[22316]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-31T05:22:22.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:22 smithi070 ceph-mon[22316]: osdmap e12: 2 total, 1 up, 2 in 2024-08-31T05:22:22.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:22 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T05:22:22.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:22 smithi070 ceph-mon[22316]: from='osd.1 [v2:172.21.15.50:6800/2777359361,v1:172.21.15.50:6801/2777359361]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T05:22:22.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:22 smithi070 ceph-mon[22316]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T05:22:22.898 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T05:22:22.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:22 smithi005 ceph-mon[18602]: pgmap v41: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:22:22.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:22 smithi005 ceph-mon[18602]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-31T05:22:22.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:22 smithi005 ceph-mon[18602]: osdmap e12: 2 total, 1 up, 2 in 2024-08-31T05:22:22.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:22 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T05:22:22.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:22 smithi005 ceph-mon[18602]: from='osd.1 [v2:172.21.15.50:6800/2777359361,v1:172.21.15.50:6801/2777359361]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T05:22:22.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:22 smithi005 ceph-mon[18602]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T05:22:23.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:23.395+0000 7f06d9c63640 1 -- 172.21.15.70:0/2213988795 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06d4108ac0 msgr2=0x7f06d410f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:22:23.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:23.395+0000 7f06d9c63640 1 --2- 172.21.15.70:0/2213988795 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06d4108ac0 0x7f06d410f2f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f06cc009ca0 tx=0x7f06cc02a8c0 comp rx=0 tx=0).stop 2024-08-31T05:22:23.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:23.395+0000 7f06d9c63640 1 -- 172.21.15.70:0/2213988795 shutdown_connections 2024-08-31T05:22:23.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:23.395+0000 7f06d9c63640 1 --2- 172.21.15.70:0/2213988795 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06d4108ac0 0x7f06d410f2f0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:23.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:23.395+0000 7f06d9c63640 1 --2- 172.21.15.70:0/2213988795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06d4108170 0x7f06d4108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:23.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:23.395+0000 7f06d9c63640 1 --2- 172.21.15.70:0/2213988795 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06d4102880 0x7f06d4102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:23.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:23.395+0000 7f06d9c63640 1 -- 172.21.15.70:0/2213988795 >> 172.21.15.70:0/2213988795 conn(0x7f06d4079500 msgr2=0x7f06d4079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:22:23.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:23.395+0000 7f06d9c63640 1 -- 172.21.15.70:0/2213988795 shutdown_connections 2024-08-31T05:22:23.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:23.395+0000 7f06d9c63640 1 -- 172.21.15.70:0/2213988795 wait complete. 2024-08-31T05:22:23.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:23.396+0000 7f06d9c63640 1 Processor -- start 2024-08-31T05:22:23.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:23.396+0000 7f06d9c63640 1 -- start start 2024-08-31T05:22:23.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:23.396+0000 7f06d9c63640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06d4102880 0x7f06d419b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:22:23.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:23.396+0000 7f06d9c63640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06d4108170 0x7f06d419b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:22:23.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:23.396+0000 7f06d9c63640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06d4108ac0 0x7f06d419bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:22:23.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:23.396+0000 7f06d9c63640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f06d4112790 con 0x7f06d4108170 2024-08-31T05:22:23.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:23.396+0000 7f06d9c63640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f06d4112610 con 0x7f06d4102880 2024-08-31T05:22:23.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:23.396+0000 7f06d9c63640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f06d4112910 con 0x7f06d4108ac0 2024-08-31T05:22:23.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:23.396+0000 7f06d3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06d4108ac0 0x7f06d419bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:22:23.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:23.396+0000 7f06d3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06d4108ac0 0x7f06d419bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40986/0 (socket says 172.21.15.70:40986) 2024-08-31T05:22:23.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:23.396+0000 7f06d3fff640 1 -- 172.21.15.70:0/524580416 learned_addr learned my addr 172.21.15.70:0/524580416 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-08-31T05:22:23.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:23.396+0000 7f06d37fe640 1 --2- 172.21.15.70:0/524580416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06d4102880 0x7f06d419b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:22:23.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:23.397+0000 7f06d2ffd640 1 --2- 172.21.15.70:0/524580416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06d4108170 0x7f06d419b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:22:23.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:23.397+0000 7f06d37fe640 1 -- 172.21.15.70:0/524580416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06d4108ac0 msgr2=0x7f06d419bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:22:23.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:23.397+0000 7f06d37fe640 1 --2- 172.21.15.70:0/524580416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06d4108ac0 0x7f06d419bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:23.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:23.397+0000 7f06d37fe640 1 -- 172.21.15.70:0/524580416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06d4108170 msgr2=0x7f06d419b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:22:23.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:23.397+0000 7f06d37fe640 1 --2- 172.21.15.70:0/524580416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06d4108170 0x7f06d419b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:23.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:23.397+0000 7f06d37fe640 1 -- 172.21.15.70:0/524580416 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06d41a6240 con 0x7f06d4102880 2024-08-31T05:22:23.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:23.397+0000 7f06d3fff640 1 --2- 172.21.15.70:0/524580416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06d4108ac0 0x7f06d419bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:22:23.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:23.397+0000 7f06d37fe640 1 --2- 172.21.15.70:0/524580416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06d4102880 0x7f06d419b040 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f06c400c970 tx=0x7f06c400cd70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:22:23.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:23.397+0000 7f06d0ff9640 1 -- 172.21.15.70:0/524580416 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c4007bb0 con 0x7f06d4102880 2024-08-31T05:22:23.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:23.397+0000 7f06d9c63640 1 -- 172.21.15.70:0/524580416 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06d41a6530 con 0x7f06d4102880 2024-08-31T05:22:23.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:23.397+0000 7f06d0ff9640 1 -- 172.21.15.70:0/524580416 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06c4007d50 con 0x7f06d4102880 2024-08-31T05:22:23.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:23.397+0000 7f06d0ff9640 1 -- 172.21.15.70:0/524580416 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c4018660 con 0x7f06d4102880 2024-08-31T05:22:23.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:23.397+0000 7f06d9c63640 1 -- 172.21.15.70:0/524580416 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06d41a6b40 con 0x7f06d4102880 2024-08-31T05:22:23.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:23.398+0000 7f06d9c63640 1 -- 172.21.15.70:0/524580416 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06d4103ab0 con 0x7f06d4102880 2024-08-31T05:22:23.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:23.400+0000 7f06d0ff9640 1 -- 172.21.15.70:0/524580416 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 19) ==== 152537+0+0 (secure 0 0 0) 0x7f06c4005020 con 0x7f06d4102880 2024-08-31T05:22:23.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:23.400+0000 7f06d0ff9640 1 --2- 172.21.15.70:0/524580416 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f06bc0b4b20 0x7f06bc0b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:22:23.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:23.401+0000 7f06d0ff9640 1 -- 172.21.15.70:0/524580416 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2244+0+0 (secure 0 0 0) 0x7f06c40e3bc0 con 0x7f06d4102880 2024-08-31T05:22:23.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:23.401+0000 7f06d2ffd640 1 --2- 172.21.15.70:0/524580416 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f06bc0b4b20 0x7f06bc0b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:22:23.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:23.401+0000 7f06d2ffd640 1 --2- 172.21.15.70:0/524580416 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f06bc0b4b20 0x7f06bc0b7030 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f06d41078a0 tx=0x7f06c8009110 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:22:23.407 INFO:journalctl@ceph.osd.1.smithi050.stdout:Aug 31 05:22:23 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-1[27783]: 2024-08-31T05:22:23.041+0000 7f85c8c60640 -1 osd.1 0 waiting for initial osdmap 2024-08-31T05:22:23.407 INFO:journalctl@ceph.osd.1.smithi050.stdout:Aug 31 05:22:23 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-1[27783]: 2024-08-31T05:22:23.045+0000 7f85c0a56640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T05:22:23.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:23.403+0000 7f06d0ff9640 1 -- 172.21.15.70:0/524580416 <== mon.2 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f06c4014030 con 0x7f06d4102880 2024-08-31T05:22:23.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:23.590+0000 7f06d9c63640 1 -- 172.21.15.70:0/524580416 --> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f06d4102c90 con 0x7f06bc0b4b20 2024-08-31T05:22:23.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:23 smithi070 ceph-mon[22316]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-08-31T05:22:23.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:23 smithi070 ceph-mon[22316]: osdmap e13: 2 total, 1 up, 2 in 2024-08-31T05:22:23.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:23 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T05:22:23.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:23 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T05:22:23.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:23 smithi070 ceph-mon[22316]: Detected new or changed devices on smithi050 2024-08-31T05:22:23.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:23 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:23.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:23 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:23.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:23 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T05:22:23.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:23 smithi070 ceph-mon[22316]: Adjusting osd_memory_target on smithi050 to 17092M 2024-08-31T05:22:23.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:23 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:23.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:23 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:22:23.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:23 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:22:23.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:23 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:23.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:23 smithi070 ceph-mon[22316]: from='osd.1 ' entity='osd.1' 2024-08-31T05:22:23.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:23 smithi050 ceph-mon[22146]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-08-31T05:22:23.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:23 smithi050 ceph-mon[22146]: osdmap e13: 2 total, 1 up, 2 in 2024-08-31T05:22:23.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:23 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T05:22:23.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:23 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T05:22:23.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:23 smithi050 ceph-mon[22146]: Detected new or changed devices on smithi050 2024-08-31T05:22:23.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:23 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:23.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:23 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:23.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:23 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T05:22:23.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:23 smithi050 ceph-mon[22146]: Adjusting osd_memory_target on smithi050 to 17092M 2024-08-31T05:22:23.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:23 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:23.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:23 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:22:23.908 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:23 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:22:23.908 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:23 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:23.908 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:23 smithi050 ceph-mon[22146]: from='osd.1 ' entity='osd.1' 2024-08-31T05:22:23.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:23 smithi005 ceph-mon[18602]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-08-31T05:22:23.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:23 smithi005 ceph-mon[18602]: osdmap e13: 2 total, 1 up, 2 in 2024-08-31T05:22:23.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:23 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T05:22:23.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:23 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T05:22:23.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:23 smithi005 ceph-mon[18602]: Detected new or changed devices on smithi050 2024-08-31T05:22:23.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:23 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:23.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:23 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:23.968 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:23 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T05:22:23.968 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:23 smithi005 ceph-mon[18602]: Adjusting osd_memory_target on smithi050 to 17092M 2024-08-31T05:22:23.968 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:23 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:23.968 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:23 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:22:23.968 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:23 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:22:23.968 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:23 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:23.968 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:23 smithi005 ceph-mon[18602]: from='osd.1 ' entity='osd.1' 2024-08-31T05:22:24.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:24 smithi070 ceph-mon[22316]: purged_snaps scrub starts 2024-08-31T05:22:24.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:24 smithi070 ceph-mon[22316]: purged_snaps scrub ok 2024-08-31T05:22:24.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:24 smithi070 ceph-mon[22316]: pgmap v44: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:22:24.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:24 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T05:22:24.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:24 smithi070 ceph-mon[22316]: from='client.24296 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:24.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:24 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:22:24.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:24 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:22:24.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:24 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:22:24.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:24 smithi070 ceph-mon[22316]: osd.1 [v2:172.21.15.50:6800/2777359361,v1:172.21.15.50:6801/2777359361] boot 2024-08-31T05:22:24.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:24 smithi070 ceph-mon[22316]: osdmap e14: 2 total, 2 up, 2 in 2024-08-31T05:22:24.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:24 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T05:22:24.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:24 smithi050 ceph-mon[22146]: purged_snaps scrub starts 2024-08-31T05:22:24.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:24 smithi050 ceph-mon[22146]: purged_snaps scrub ok 2024-08-31T05:22:24.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:24 smithi050 ceph-mon[22146]: pgmap v44: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:22:24.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:24 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T05:22:24.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:24 smithi050 ceph-mon[22146]: from='client.24296 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:24.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:24 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:22:24.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:24 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:22:24.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:24 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:22:24.908 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:24 smithi050 ceph-mon[22146]: osd.1 [v2:172.21.15.50:6800/2777359361,v1:172.21.15.50:6801/2777359361] boot 2024-08-31T05:22:24.908 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:24 smithi050 ceph-mon[22146]: osdmap e14: 2 total, 2 up, 2 in 2024-08-31T05:22:24.908 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:24 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T05:22:24.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:24 smithi005 ceph-mon[18602]: purged_snaps scrub starts 2024-08-31T05:22:24.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:24 smithi005 ceph-mon[18602]: purged_snaps scrub ok 2024-08-31T05:22:24.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:24 smithi005 ceph-mon[18602]: pgmap v44: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-31T05:22:24.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:24 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T05:22:24.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:24 smithi005 ceph-mon[18602]: from='client.24296 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:24.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:24 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:22:24.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:24 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:22:24.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:24 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:22:24.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:24 smithi005 ceph-mon[18602]: osd.1 [v2:172.21.15.50:6800/2777359361,v1:172.21.15.50:6801/2777359361] boot 2024-08-31T05:22:24.968 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:24 smithi005 ceph-mon[18602]: osdmap e14: 2 total, 2 up, 2 in 2024-08-31T05:22:24.968 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:24 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T05:22:26.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:26 smithi070 ceph-mon[22316]: pgmap v46: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:22:26.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:26 smithi070 ceph-mon[22316]: osdmap e15: 2 total, 2 up, 2 in 2024-08-31T05:22:26.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:26 smithi070 ceph-mon[22316]: from='client.? 172.21.15.70:0/628766722' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "134c5892-e44a-44f2-8cd2-484d22a45e2e"} : dispatch 2024-08-31T05:22:26.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:26 smithi070 ceph-mon[22316]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "134c5892-e44a-44f2-8cd2-484d22a45e2e"} : dispatch 2024-08-31T05:22:26.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:26 smithi070 ceph-mon[22316]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "134c5892-e44a-44f2-8cd2-484d22a45e2e"}]': finished 2024-08-31T05:22:26.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:26 smithi070 ceph-mon[22316]: osdmap e16: 3 total, 2 up, 3 in 2024-08-31T05:22:26.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:26 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T05:22:26.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:26 smithi070 ceph-mon[22316]: from='client.? 172.21.15.70:0/2570003011' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:22:26.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:26 smithi050 ceph-mon[22146]: pgmap v46: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:22:26.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:26 smithi050 ceph-mon[22146]: osdmap e15: 2 total, 2 up, 2 in 2024-08-31T05:22:26.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:26 smithi050 ceph-mon[22146]: from='client.? 172.21.15.70:0/628766722' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "134c5892-e44a-44f2-8cd2-484d22a45e2e"} : dispatch 2024-08-31T05:22:26.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:26 smithi050 ceph-mon[22146]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "134c5892-e44a-44f2-8cd2-484d22a45e2e"} : dispatch 2024-08-31T05:22:26.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:26 smithi050 ceph-mon[22146]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "134c5892-e44a-44f2-8cd2-484d22a45e2e"}]': finished 2024-08-31T05:22:26.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:26 smithi050 ceph-mon[22146]: osdmap e16: 3 total, 2 up, 3 in 2024-08-31T05:22:26.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:26 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T05:22:26.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:26 smithi050 ceph-mon[22146]: from='client.? 172.21.15.70:0/2570003011' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:22:26.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:26 smithi005 ceph-mon[18602]: pgmap v46: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:22:26.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:26 smithi005 ceph-mon[18602]: osdmap e15: 2 total, 2 up, 2 in 2024-08-31T05:22:26.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:26 smithi005 ceph-mon[18602]: from='client.? 172.21.15.70:0/628766722' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "134c5892-e44a-44f2-8cd2-484d22a45e2e"} : dispatch 2024-08-31T05:22:26.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:26 smithi005 ceph-mon[18602]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "134c5892-e44a-44f2-8cd2-484d22a45e2e"} : dispatch 2024-08-31T05:22:26.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:26 smithi005 ceph-mon[18602]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "134c5892-e44a-44f2-8cd2-484d22a45e2e"}]': finished 2024-08-31T05:22:26.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:26 smithi005 ceph-mon[18602]: osdmap e16: 3 total, 2 up, 3 in 2024-08-31T05:22:26.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:26 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T05:22:26.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:26 smithi005 ceph-mon[18602]: from='client.? 172.21.15.70:0/2570003011' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:22:28.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:28 smithi050 ceph-mon[22146]: pgmap v49: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:22:28.968 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:28 smithi005 ceph-mon[18602]: pgmap v49: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:22:29.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:28 smithi070 ceph-mon[22316]: pgmap v49: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:22:30.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:30 smithi050 ceph-mon[22146]: pgmap v50: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:22:30.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:30 smithi005 ceph-mon[18602]: pgmap v50: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:22:31.085 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:30 smithi070 ceph-mon[22316]: pgmap v50: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:22:32.754 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:32 smithi070 ceph-mon[22316]: pgmap v51: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:22:32.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:32 smithi050 ceph-mon[22146]: pgmap v51: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:22:32.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:32 smithi005 ceph-mon[18602]: pgmap v51: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:22:34.879 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:34 smithi070 ceph-mon[22316]: pgmap v52: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:22:34.880 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:34 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-08-31T05:22:34.880 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:34 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:22:34.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:34 smithi050 ceph-mon[22146]: pgmap v52: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:22:34.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:34 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-08-31T05:22:34.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:34 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:22:34.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:34 smithi005 ceph-mon[18602]: pgmap v52: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:22:34.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:34 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-08-31T05:22:34.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:34 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:22:35.859 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:35 smithi070 ceph-mon[22316]: Deploying daemon osd.2 on smithi070 2024-08-31T05:22:35.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:35 smithi050 ceph-mon[22146]: Deploying daemon osd.2 on smithi070 2024-08-31T05:22:35.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:35 smithi005 ceph-mon[18602]: Deploying daemon osd.2 on smithi070 2024-08-31T05:22:36.789 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:36 smithi070 ceph-mon[22316]: pgmap v53: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:22:36.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:36 smithi050 ceph-mon[22146]: pgmap v53: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:22:36.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:36 smithi005 ceph-mon[18602]: pgmap v53: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:22:38.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:38 smithi050 ceph-mon[22146]: pgmap v54: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:22:38.930 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:38 smithi070 ceph-mon[22316]: pgmap v54: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:22:38.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:38 smithi005 ceph-mon[18602]: pgmap v54: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:22:39.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:39 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:22:39.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:39 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:39.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:39 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:39.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:39 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:22:39.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:39 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:39.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:39 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:39.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:39 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:22:39.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:39 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:39.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:39 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:40.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:40 smithi070 ceph-mon[22316]: pgmap v55: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:22:40.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:40 smithi050 ceph-mon[22146]: pgmap v55: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:22:40.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:40 smithi005 ceph-mon[18602]: pgmap v55: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:22:43.314 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:43 smithi070 ceph-mon[22316]: pgmap v56: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:22:43.314 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:43 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:43.314 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:43 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:43.314 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:43 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:22:43.314 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:43 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:22:43.314 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:43 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:43.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:43.353+0000 7f06d0ff9640 1 -- 172.21.15.70:0/524580416 <== mgr.14220 v2:172.21.15.5:6800/2696053609 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f06c80095e0 con 0x7f06bc0b4b20 2024-08-31T05:22:43.355 INFO:teuthology.orchestra.run.smithi070.stdout:Created osd(s) 2 on host 'smithi070' 2024-08-31T05:22:43.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:43.355+0000 7f06d9c63640 1 -- 172.21.15.70:0/524580416 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f06bc0b4b20 msgr2=0x7f06bc0b7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:22:43.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:43.355+0000 7f06d9c63640 1 --2- 172.21.15.70:0/524580416 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f06bc0b4b20 0x7f06bc0b7030 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f06d41078a0 tx=0x7f06c8009110 comp rx=0 tx=0).stop 2024-08-31T05:22:43.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:43.355+0000 7f06d9c63640 1 -- 172.21.15.70:0/524580416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06d4102880 msgr2=0x7f06d419b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:22:43.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:43.355+0000 7f06d9c63640 1 --2- 172.21.15.70:0/524580416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06d4102880 0x7f06d419b040 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f06c400c970 tx=0x7f06c400cd70 comp rx=0 tx=0).stop 2024-08-31T05:22:43.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:43.355+0000 7f06d9c63640 1 -- 172.21.15.70:0/524580416 shutdown_connections 2024-08-31T05:22:43.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:43.355+0000 7f06d9c63640 1 --2- 172.21.15.70:0/524580416 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f06bc0b4b20 0x7f06bc0b7030 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:43.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:43.355+0000 7f06d9c63640 1 --2- 172.21.15.70:0/524580416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06d4108ac0 0x7f06d419bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:43.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:43.355+0000 7f06d9c63640 1 --2- 172.21.15.70:0/524580416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06d4108170 0x7f06d419b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:43.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:43.355+0000 7f06d9c63640 1 --2- 172.21.15.70:0/524580416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06d4102880 0x7f06d419b040 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:43.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:43.355+0000 7f06d9c63640 1 -- 172.21.15.70:0/524580416 >> 172.21.15.70:0/524580416 conn(0x7f06d4079500 msgr2=0x7f06d4104fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:22:43.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:43.355+0000 7f06d9c63640 1 -- 172.21.15.70:0/524580416 shutdown_connections 2024-08-31T05:22:43.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:22:43.355+0000 7f06d9c63640 1 -- 172.21.15.70:0/524580416 wait complete. 2024-08-31T05:22:43.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:43 smithi050 ceph-mon[22146]: pgmap v56: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:22:43.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:43 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:43.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:43 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:43.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:43 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:22:43.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:43 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:22:43.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:43 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:43.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:43 smithi005 ceph-mon[18602]: pgmap v56: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:22:43.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:43 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:43.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:43 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:43.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:43 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:22:43.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:43 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:22:43.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:43 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:43.958 DEBUG:teuthology.orchestra.run.smithi070:osd.2> sudo journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@osd.2.service 2024-08-31T05:22:43.960 INFO:tasks.cephadm:Deploying osd.3 on smithi005 with /dev/vg_nvme/lv_3... 2024-08-31T05:22:43.961 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-08-31T05:22:44.188 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:44 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:22:44.188 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:44 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:44.188 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:44 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:44.225 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:22:44.345 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:44 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:22:44.346 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:44 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:44.346 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:44 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:44.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:44 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:22:44.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:44 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:44.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:44 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:45.360 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:45 smithi070 ceph-mon[22316]: pgmap v57: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:22:45.381 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:45 smithi005 ceph-mon[18602]: pgmap v57: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:22:45.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:45 smithi050 ceph-mon[22146]: pgmap v57: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:22:45.836 INFO:journalctl@ceph.osd.2.smithi070.stdout:Aug 31 05:22:45 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-2[28434]: 2024-08-31T05:22:45.606+0000 7f7b2d884640 -1 osd.2 0 log_to_monitors true 2024-08-31T05:22:46.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:46 smithi005 ceph-mon[18602]: from='osd.2 [v2:172.21.15.70:6800/1400583716,v1:172.21.15.70:6801/1400583716]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-31T05:22:46.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:46 smithi005 ceph-mon[18602]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-31T05:22:46.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:46 smithi070 ceph-mon[22316]: from='osd.2 [v2:172.21.15.70:6800/1400583716,v1:172.21.15.70:6801/1400583716]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-31T05:22:46.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:46 smithi070 ceph-mon[22316]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-31T05:22:46.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:46 smithi050 ceph-mon[22146]: from='osd.2 [v2:172.21.15.70:6800/1400583716,v1:172.21.15.70:6801/1400583716]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-31T05:22:46.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:46 smithi050 ceph-mon[22146]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-31T05:22:46.968 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:22:46.992 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi005:vg_nvme/lv_3 2024-08-31T05:22:47.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:47 smithi005 ceph-mon[18602]: pgmap v58: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:22:47.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:47 smithi005 ceph-mon[18602]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-31T05:22:47.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:47 smithi005 ceph-mon[18602]: osdmap e17: 3 total, 2 up, 3 in 2024-08-31T05:22:47.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:47 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T05:22:47.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:47 smithi005 ceph-mon[18602]: from='osd.2 [v2:172.21.15.70:6800/1400583716,v1:172.21.15.70:6801/1400583716]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-08-31T05:22:47.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:47 smithi005 ceph-mon[18602]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-08-31T05:22:47.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:47 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:47.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:47 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:47.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:47 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T05:22:47.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:47 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:47.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:47 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:22:47.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:47 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:22:47.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:47 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:47.243 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:22:47.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:47 smithi050 ceph-mon[22146]: pgmap v58: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:22:47.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:47 smithi050 ceph-mon[22146]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-31T05:22:47.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:47 smithi050 ceph-mon[22146]: osdmap e17: 3 total, 2 up, 3 in 2024-08-31T05:22:47.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:47 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T05:22:47.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:47 smithi050 ceph-mon[22146]: from='osd.2 [v2:172.21.15.70:6800/1400583716,v1:172.21.15.70:6801/1400583716]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-08-31T05:22:47.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:47 smithi050 ceph-mon[22146]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-08-31T05:22:47.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:47 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:47.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:47 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:47.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:47 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T05:22:47.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:47 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:47.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:47 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:22:47.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:47 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:22:47.408 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:47 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:47.512 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:47 smithi070 ceph-mon[22316]: pgmap v58: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:22:47.512 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:47 smithi070 ceph-mon[22316]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-31T05:22:47.512 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:47 smithi070 ceph-mon[22316]: osdmap e17: 3 total, 2 up, 3 in 2024-08-31T05:22:47.512 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:47 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T05:22:47.512 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:47 smithi070 ceph-mon[22316]: from='osd.2 [v2:172.21.15.70:6800/1400583716,v1:172.21.15.70:6801/1400583716]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-08-31T05:22:47.512 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:47 smithi070 ceph-mon[22316]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-08-31T05:22:47.512 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:47 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:47.513 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:47 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:47.513 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:47 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T05:22:47.513 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:47 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:47.513 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:47 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:22:47.513 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:47 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:22:47.513 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:47 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:47.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:22:47.703+0000 7f76b1711640 1 -- 172.21.15.5:0/1283250133 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76ac10dbb0 msgr2=0x7f76ac1100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:22:47.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:22:47.703+0000 7f76b1711640 1 --2- 172.21.15.5:0/1283250133 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76ac10dbb0 0x7f76ac1100a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f769c009ca0 tx=0x7f769c02a8c0 comp rx=0 tx=0).stop 2024-08-31T05:22:47.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:22:47.703+0000 7f76b1711640 1 -- 172.21.15.5:0/1283250133 shutdown_connections 2024-08-31T05:22:47.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:22:47.703+0000 7f76b1711640 1 --2- 172.21.15.5:0/1283250133 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76ac10dbb0 0x7f76ac1100a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:47.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:22:47.703+0000 7f76b1711640 1 --2- 172.21.15.5:0/1283250133 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76ac1050a0 0x7f76ac10d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:47.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:22:47.703+0000 7f76b1711640 1 --2- 172.21.15.5:0/1283250133 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76ac104750 0x7f76ac104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:47.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:22:47.703+0000 7f76b1711640 1 -- 172.21.15.5:0/1283250133 >> 172.21.15.5:0/1283250133 conn(0x7f76ac0794d0 msgr2=0x7f76ac0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:22:47.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:22:47.703+0000 7f76b1711640 1 -- 172.21.15.5:0/1283250133 shutdown_connections 2024-08-31T05:22:47.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:22:47.703+0000 7f76b1711640 1 -- 172.21.15.5:0/1283250133 wait complete. 2024-08-31T05:22:47.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:22:47.704+0000 7f76b1711640 1 Processor -- start 2024-08-31T05:22:47.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:22:47.704+0000 7f76b1711640 1 -- start start 2024-08-31T05:22:47.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:22:47.704+0000 7f76b1711640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76ac104750 0x7f76ac19a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:22:47.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:22:47.704+0000 7f76b1711640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76ac1050a0 0x7f76ac19a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:22:47.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:22:47.704+0000 7f76b1711640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76ac10dbb0 0x7f76ac19fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:22:47.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:22:47.704+0000 7f76b1711640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f76ac113810 con 0x7f76ac1050a0 2024-08-31T05:22:47.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:22:47.704+0000 7f76b1711640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f76ac113690 con 0x7f76ac10dbb0 2024-08-31T05:22:47.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:22:47.704+0000 7f76b1711640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f76ac113990 con 0x7f76ac104750 2024-08-31T05:22:47.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:22:47.705+0000 7f76aa7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76ac1050a0 0x7f76ac19a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:22:47.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:22:47.705+0000 7f76aa7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76ac1050a0 0x7f76ac19a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37370/0 (socket says 172.21.15.5:37370) 2024-08-31T05:22:47.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:22:47.705+0000 7f76aa7fc640 1 -- 172.21.15.5:0/4060087770 learned_addr learned my addr 172.21.15.5:0/4060087770 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:22:47.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:22:47.705+0000 7f76aaffd640 1 --2- 172.21.15.5:0/4060087770 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76ac104750 0x7f76ac19a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:22:47.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:22:47.705+0000 7f76ab7fe640 1 --2- 172.21.15.5:0/4060087770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76ac10dbb0 0x7f76ac19fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:22:47.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:22:47.705+0000 7f76aa7fc640 1 -- 172.21.15.5:0/4060087770 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76ac104750 msgr2=0x7f76ac19a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:22:47.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:22:47.705+0000 7f76aa7fc640 1 --2- 172.21.15.5:0/4060087770 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76ac104750 0x7f76ac19a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:47.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:22:47.705+0000 7f76aa7fc640 1 -- 172.21.15.5:0/4060087770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76ac10dbb0 msgr2=0x7f76ac19fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:22:47.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:22:47.705+0000 7f76aa7fc640 1 --2- 172.21.15.5:0/4060087770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76ac10dbb0 0x7f76ac19fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:22:47.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:22:47.705+0000 7f76aa7fc640 1 -- 172.21.15.5:0/4060087770 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76ac1a0130 con 0x7f76ac1050a0 2024-08-31T05:22:47.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:22:47.705+0000 7f76aa7fc640 1 --2- 172.21.15.5:0/4060087770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76ac1050a0 0x7f76ac19a820 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f769400c970 tx=0x7f769400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:22:47.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:22:47.705+0000 7f76a3fff640 1 -- 172.21.15.5:0/4060087770 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7694007bb0 con 0x7f76ac1050a0 2024-08-31T05:22:47.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:22:47.705+0000 7f76b1711640 1 -- 172.21.15.5:0/4060087770 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76ac1a0420 con 0x7f76ac1050a0 2024-08-31T05:22:47.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:22:47.705+0000 7f76a3fff640 1 -- 172.21.15.5:0/4060087770 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7694007d50 con 0x7f76ac1050a0 2024-08-31T05:22:47.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:22:47.705+0000 7f76a3fff640 1 -- 172.21.15.5:0/4060087770 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7694004e10 con 0x7f76ac1050a0 2024-08-31T05:22:47.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:22:47.705+0000 7f76b1711640 1 -- 172.21.15.5:0/4060087770 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76ac1a6c40 con 0x7f76ac1050a0 2024-08-31T05:22:47.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:22:47.706+0000 7f76b1711640 1 -- 172.21.15.5:0/4060087770 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76ac104b60 con 0x7f76ac1050a0 2024-08-31T05:22:47.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:22:47.708+0000 7f76a3fff640 1 -- 172.21.15.5:0/4060087770 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) ==== 152537+0+0 (secure 0 0 0) 0x7f7694004fb0 con 0x7f76ac1050a0 2024-08-31T05:22:47.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:22:47.709+0000 7f76a3fff640 1 --2- 172.21.15.5:0/4060087770 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f76980b4b20 0x7f76980b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:22:47.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:22:47.709+0000 7f76aaffd640 1 --2- 172.21.15.5:0/4060087770 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f76980b4b20 0x7f76980b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:22:47.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:22:47.709+0000 7f76a3fff640 1 -- 172.21.15.5:0/4060087770 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2786+0+0 (secure 0 0 0) 0x7f76940e3b70 con 0x7f76ac1050a0 2024-08-31T05:22:47.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:22:47.710+0000 7f76aaffd640 1 --2- 172.21.15.5:0/4060087770 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f76980b4b20 0x7f76980b7030 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f76ac06ba00 tx=0x7f76a4005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:22:47.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:22:47.712+0000 7f76a3fff640 1 -- 172.21.15.5:0/4060087770 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7694014030 con 0x7f76ac1050a0 2024-08-31T05:22:47.835 INFO:journalctl@ceph.osd.2.smithi070.stdout:Aug 31 05:22:47 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-2[28434]: 2024-08-31T05:22:47.510+0000 7f7b2a01b640 -1 osd.2 0 waiting for initial osdmap 2024-08-31T05:22:47.836 INFO:journalctl@ceph.osd.2.smithi070.stdout:Aug 31 05:22:47 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-2[28434]: 2024-08-31T05:22:47.515+0000 7f7b215fc640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T05:22:47.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:22:47.907+0000 7f76b1711640 1 -- 172.21.15.5:0/4060087770 --> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f76ac0635a0 con 0x7f76980b4b20 2024-08-31T05:22:48.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:48 smithi005 ceph-mon[18602]: Detected new or changed devices on smithi070 2024-08-31T05:22:48.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:48 smithi005 ceph-mon[18602]: Adjusting osd_memory_target on smithi070 to 17088M 2024-08-31T05:22:48.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:48 smithi005 ceph-mon[18602]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-08-31T05:22:48.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:48 smithi005 ceph-mon[18602]: osdmap e18: 3 total, 2 up, 3 in 2024-08-31T05:22:48.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:48 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T05:22:48.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:48 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T05:22:48.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:48 smithi005 ceph-mon[18602]: from='osd.2 ' entity='osd.2' 2024-08-31T05:22:48.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:48 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:22:48.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:48 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:22:48.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:48 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:22:48.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:48 smithi050 ceph-mon[22146]: Detected new or changed devices on smithi070 2024-08-31T05:22:48.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:48 smithi050 ceph-mon[22146]: Adjusting osd_memory_target on smithi070 to 17088M 2024-08-31T05:22:48.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:48 smithi050 ceph-mon[22146]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-08-31T05:22:48.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:48 smithi050 ceph-mon[22146]: osdmap e18: 3 total, 2 up, 3 in 2024-08-31T05:22:48.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:48 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T05:22:48.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:48 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T05:22:48.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:48 smithi050 ceph-mon[22146]: from='osd.2 ' entity='osd.2' 2024-08-31T05:22:48.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:48 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:22:48.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:48 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:22:48.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:48 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:22:48.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:48 smithi070 ceph-mon[22316]: Detected new or changed devices on smithi070 2024-08-31T05:22:48.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:48 smithi070 ceph-mon[22316]: Adjusting osd_memory_target on smithi070 to 17088M 2024-08-31T05:22:48.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:48 smithi070 ceph-mon[22316]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-08-31T05:22:48.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:48 smithi070 ceph-mon[22316]: osdmap e18: 3 total, 2 up, 3 in 2024-08-31T05:22:48.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:48 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T05:22:48.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:48 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T05:22:48.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:48 smithi070 ceph-mon[22316]: from='osd.2 ' entity='osd.2' 2024-08-31T05:22:48.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:48 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:22:48.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:48 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:22:48.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:48 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:22:49.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:49 smithi050 ceph-mon[22146]: purged_snaps scrub starts 2024-08-31T05:22:49.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:49 smithi050 ceph-mon[22146]: purged_snaps scrub ok 2024-08-31T05:22:49.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:49 smithi050 ceph-mon[22146]: pgmap v61: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:22:49.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:49 smithi050 ceph-mon[22146]: from='client.14478 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:49.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:49 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T05:22:49.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:49 smithi050 ceph-mon[22146]: osd.2 [v2:172.21.15.70:6800/1400583716,v1:172.21.15.70:6801/1400583716] boot 2024-08-31T05:22:49.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:49 smithi050 ceph-mon[22146]: osdmap e19: 3 total, 3 up, 3 in 2024-08-31T05:22:49.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:49 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T05:22:49.425 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:49 smithi005 ceph-mon[18602]: purged_snaps scrub starts 2024-08-31T05:22:49.425 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:49 smithi005 ceph-mon[18602]: purged_snaps scrub ok 2024-08-31T05:22:49.425 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:49 smithi005 ceph-mon[18602]: pgmap v61: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:22:49.425 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:49 smithi005 ceph-mon[18602]: from='client.14478 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:49.425 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:49 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T05:22:49.426 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:49 smithi005 ceph-mon[18602]: osd.2 [v2:172.21.15.70:6800/1400583716,v1:172.21.15.70:6801/1400583716] boot 2024-08-31T05:22:49.426 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:49 smithi005 ceph-mon[18602]: osdmap e19: 3 total, 3 up, 3 in 2024-08-31T05:22:49.426 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:49 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T05:22:49.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:49 smithi070 ceph-mon[22316]: purged_snaps scrub starts 2024-08-31T05:22:49.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:49 smithi070 ceph-mon[22316]: purged_snaps scrub ok 2024-08-31T05:22:49.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:49 smithi070 ceph-mon[22316]: pgmap v61: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-31T05:22:49.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:49 smithi070 ceph-mon[22316]: from='client.14478 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:22:49.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:49 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T05:22:49.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:49 smithi070 ceph-mon[22316]: osd.2 [v2:172.21.15.70:6800/1400583716,v1:172.21.15.70:6801/1400583716] boot 2024-08-31T05:22:49.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:49 smithi070 ceph-mon[22316]: osdmap e19: 3 total, 3 up, 3 in 2024-08-31T05:22:49.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:49 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T05:22:50.670 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:50 smithi005 ceph-mon[18602]: pgmap v63: 0 pgs: ; 0 B data, 104 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:22:50.670 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:50 smithi005 ceph-mon[18602]: osdmap e20: 3 total, 3 up, 3 in 2024-08-31T05:22:50.670 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:50 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-08-31T05:22:50.768 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:50 smithi050 ceph-mon[22146]: pgmap v63: 0 pgs: ; 0 B data, 104 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:22:50.768 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:50 smithi050 ceph-mon[22146]: osdmap e20: 3 total, 3 up, 3 in 2024-08-31T05:22:50.769 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:50 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-08-31T05:22:50.769 INFO:journalctl@ceph.osd.1.smithi050.stdout:Aug 31 05:22:50 smithi050 sudo[31708]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-31T05:22:50.769 INFO:journalctl@ceph.osd.1.smithi050.stdout:Aug 31 05:22:50 smithi050 sudo[31708]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T05:22:50.769 INFO:journalctl@ceph.osd.1.smithi050.stdout:Aug 31 05:22:50 smithi050 sudo[31708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T05:22:50.769 INFO:journalctl@ceph.osd.1.smithi050.stdout:Aug 31 05:22:50 smithi050 sudo[31708]: pam_unix(sudo:session): session closed for user root 2024-08-31T05:22:50.769 INFO:journalctl@ceph.osd.1.smithi050.stdout:Aug 31 05:22:50 smithi050 sudo[31711]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-31T05:22:50.769 INFO:journalctl@ceph.osd.1.smithi050.stdout:Aug 31 05:22:50 smithi050 sudo[31711]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T05:22:50.769 INFO:journalctl@ceph.osd.1.smithi050.stdout:Aug 31 05:22:50 smithi050 sudo[31711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T05:22:50.769 INFO:journalctl@ceph.osd.1.smithi050.stdout:Aug 31 05:22:50 smithi050 sudo[31711]: pam_unix(sudo:session): session closed for user root 2024-08-31T05:22:50.805 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:50 smithi070 ceph-mon[22316]: pgmap v63: 0 pgs: ; 0 B data, 104 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:22:50.805 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:50 smithi070 ceph-mon[22316]: osdmap e20: 3 total, 3 up, 3 in 2024-08-31T05:22:50.805 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:50 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-08-31T05:22:50.947 INFO:journalctl@ceph.osd.0.smithi005.stdout:Aug 31 05:22:50 smithi005 sudo[38924]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-31T05:22:50.947 INFO:journalctl@ceph.osd.0.smithi005.stdout:Aug 31 05:22:50 smithi005 sudo[38924]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T05:22:50.947 INFO:journalctl@ceph.osd.0.smithi005.stdout:Aug 31 05:22:50 smithi005 sudo[38924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T05:22:50.947 INFO:journalctl@ceph.osd.0.smithi005.stdout:Aug 31 05:22:50 smithi005 sudo[38924]: pam_unix(sudo:session): session closed for user root 2024-08-31T05:22:50.947 INFO:journalctl@ceph.osd.0.smithi005.stdout:Aug 31 05:22:50 smithi005 sudo[38928]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-31T05:22:50.947 INFO:journalctl@ceph.osd.0.smithi005.stdout:Aug 31 05:22:50 smithi005 sudo[38928]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T05:22:50.947 INFO:journalctl@ceph.osd.0.smithi005.stdout:Aug 31 05:22:50 smithi005 sudo[38928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T05:22:50.948 INFO:journalctl@ceph.osd.0.smithi005.stdout:Aug 31 05:22:50 smithi005 sudo[38928]: pam_unix(sudo:session): session closed for user root 2024-08-31T05:22:50.948 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:50 smithi005 sudo[38937]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-31T05:22:50.948 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:50 smithi005 sudo[38937]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T05:22:50.948 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:50 smithi005 sudo[38937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T05:22:50.948 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:50 smithi005 sudo[38937]: pam_unix(sudo:session): session closed for user root 2024-08-31T05:22:50.948 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:50 smithi005 sudo[38940]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-31T05:22:50.948 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:50 smithi005 sudo[38940]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T05:22:50.948 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:50 smithi005 sudo[38940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T05:22:50.948 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:50 smithi005 sudo[38940]: pam_unix(sudo:session): session closed for user root 2024-08-31T05:22:51.086 INFO:journalctl@ceph.osd.2.smithi070.stdout:Aug 31 05:22:50 smithi070 sudo[32519]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-31T05:22:51.086 INFO:journalctl@ceph.osd.2.smithi070.stdout:Aug 31 05:22:50 smithi070 sudo[32519]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T05:22:51.086 INFO:journalctl@ceph.osd.2.smithi070.stdout:Aug 31 05:22:50 smithi070 sudo[32519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T05:22:51.086 INFO:journalctl@ceph.osd.2.smithi070.stdout:Aug 31 05:22:50 smithi070 sudo[32519]: pam_unix(sudo:session): session closed for user root 2024-08-31T05:22:51.086 INFO:journalctl@ceph.osd.2.smithi070.stdout:Aug 31 05:22:50 smithi070 sudo[32522]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-31T05:22:51.086 INFO:journalctl@ceph.osd.2.smithi070.stdout:Aug 31 05:22:50 smithi070 sudo[32522]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T05:22:51.086 INFO:journalctl@ceph.osd.2.smithi070.stdout:Aug 31 05:22:50 smithi070 sudo[32522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T05:22:51.086 INFO:journalctl@ceph.osd.2.smithi070.stdout:Aug 31 05:22:50 smithi070 sudo[32522]: pam_unix(sudo:session): session closed for user root 2024-08-31T05:22:51.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:50 smithi070 sudo[32525]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-31T05:22:51.087 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:50 smithi070 sudo[32525]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T05:22:51.087 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:50 smithi070 sudo[32525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T05:22:51.087 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:50 smithi070 sudo[32525]: pam_unix(sudo:session): session closed for user root 2024-08-31T05:22:51.087 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:50 smithi070 sudo[32528]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-31T05:22:51.087 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:50 smithi070 sudo[32528]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T05:22:51.087 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:50 smithi070 sudo[32528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T05:22:51.087 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:50 smithi070 sudo[32528]: pam_unix(sudo:session): session closed for user root 2024-08-31T05:22:51.156 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:50 smithi050 sudo[31714]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-31T05:22:51.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:50 smithi050 sudo[31714]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T05:22:51.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:50 smithi050 sudo[31714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T05:22:51.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:50 smithi050 sudo[31714]: pam_unix(sudo:session): session closed for user root 2024-08-31T05:22:51.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:50 smithi050 sudo[31717]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-31T05:22:51.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:50 smithi050 sudo[31717]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T05:22:51.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:50 smithi050 sudo[31717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T05:22:51.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:50 smithi050 sudo[31717]: pam_unix(sudo:session): session closed for user root 2024-08-31T05:22:51.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:51 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-08-31T05:22:51.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:51 smithi070 ceph-mon[22316]: osdmap e21: 3 total, 3 up, 3 in 2024-08-31T05:22:51.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:51 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-08-31T05:22:51.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:51 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/1811530383' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "af49398a-e171-496b-a50e-1f767fc42923"} : dispatch 2024-08-31T05:22:51.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:51 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-31T05:22:51.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:51 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/1811530383' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "af49398a-e171-496b-a50e-1f767fc42923"}]': finished 2024-08-31T05:22:51.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:51 smithi070 ceph-mon[22316]: osdmap e22: 4 total, 3 up, 4 in 2024-08-31T05:22:51.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:51 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T05:22:51.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:51 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:51.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:51 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:51.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:51 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:51.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:51 smithi070 ceph-mon[22316]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T05:22:51.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:51 smithi070 ceph-mon[22316]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T05:22:51.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:51 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T05:22:51.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:51 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:22:51.838 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:51 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:22:51.838 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:51 smithi070 ceph-mon[22316]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T05:22:51.838 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:51 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T05:22:51.838 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:51 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:22:51.838 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:51 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:22:51.838 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:51 smithi070 ceph-mon[22316]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T05:22:51.838 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:51 smithi070 ceph-mon[22316]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T05:22:51.838 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:51 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T05:22:51.838 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:51 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:22:51.838 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:51 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:22:51.838 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:51 smithi070 ceph-mon[22316]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T05:22:51.838 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:51 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/3790624988' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:22:51.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:22:51.868+0000 7f76a3fff640 1 -- 172.21.15.5:0/4060087770 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f76940a7ef0 con 0x7f76ac1050a0 2024-08-31T05:22:51.870 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:51 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-08-31T05:22:51.870 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:51 smithi005 ceph-mon[18602]: osdmap e21: 3 total, 3 up, 3 in 2024-08-31T05:22:51.870 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:51 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-08-31T05:22:51.871 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:51 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/1811530383' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "af49398a-e171-496b-a50e-1f767fc42923"} : dispatch 2024-08-31T05:22:51.871 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:51 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-31T05:22:51.871 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:51 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/1811530383' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "af49398a-e171-496b-a50e-1f767fc42923"}]': finished 2024-08-31T05:22:51.871 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:51 smithi005 ceph-mon[18602]: osdmap e22: 4 total, 3 up, 4 in 2024-08-31T05:22:51.871 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:51 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T05:22:51.871 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:51 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:51.871 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:51 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:51.871 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:51 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:51.871 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:51 smithi005 ceph-mon[18602]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T05:22:51.871 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:51 smithi005 ceph-mon[18602]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T05:22:51.871 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:51 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T05:22:51.871 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:51 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:22:51.872 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:51 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:22:51.872 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:51 smithi005 ceph-mon[18602]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T05:22:51.872 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:51 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T05:22:51.872 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:51 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:22:51.872 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:51 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:22:51.872 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:51 smithi005 ceph-mon[18602]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T05:22:51.872 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:51 smithi005 ceph-mon[18602]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T05:22:51.872 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:51 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T05:22:51.872 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:51 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:22:51.872 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:51 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:22:51.872 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:51 smithi005 ceph-mon[18602]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T05:22:51.872 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:51 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/3790624988' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:22:51.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:51 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-08-31T05:22:51.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:51 smithi050 ceph-mon[22146]: osdmap e21: 3 total, 3 up, 3 in 2024-08-31T05:22:51.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:51 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-08-31T05:22:51.908 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:51 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/1811530383' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "af49398a-e171-496b-a50e-1f767fc42923"} : dispatch 2024-08-31T05:22:51.908 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:51 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-31T05:22:51.908 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:51 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/1811530383' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "af49398a-e171-496b-a50e-1f767fc42923"}]': finished 2024-08-31T05:22:51.908 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:51 smithi050 ceph-mon[22146]: osdmap e22: 4 total, 3 up, 4 in 2024-08-31T05:22:51.908 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:51 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T05:22:51.909 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:51 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:51.909 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:51 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:51.909 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:51 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:22:51.909 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:51 smithi050 ceph-mon[22146]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T05:22:51.909 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:51 smithi050 ceph-mon[22146]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T05:22:51.909 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:51 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T05:22:51.909 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:51 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:22:51.909 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:51 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:22:51.909 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:51 smithi050 ceph-mon[22146]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T05:22:51.910 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:51 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T05:22:51.910 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:51 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:22:51.910 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:51 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:22:51.910 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:51 smithi050 ceph-mon[22146]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T05:22:51.910 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:51 smithi050 ceph-mon[22146]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T05:22:51.910 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:51 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T05:22:51.910 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:51 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T05:22:51.910 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:51 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T05:22:51.910 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:51 smithi050 ceph-mon[22146]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T05:22:51.910 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:51 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/3790624988' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:22:52.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:52 smithi050 ceph-mon[22146]: pgmap v67: 1 pgs: 1 unknown; 0 B data, 104 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:22:52.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:52 smithi050 ceph-mon[22146]: osdmap e23: 4 total, 3 up, 4 in 2024-08-31T05:22:52.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:52 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T05:22:52.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:52 smithi050 ceph-mon[22146]: mgrmap e20: x(active, since 114s), standbys: z, y 2024-08-31T05:22:52.966 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:52 smithi005 ceph-mon[18602]: pgmap v67: 1 pgs: 1 unknown; 0 B data, 104 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:22:52.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:52 smithi005 ceph-mon[18602]: osdmap e23: 4 total, 3 up, 4 in 2024-08-31T05:22:52.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:52 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T05:22:52.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:52 smithi005 ceph-mon[18602]: mgrmap e20: x(active, since 114s), standbys: z, y 2024-08-31T05:22:53.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:52 smithi070 ceph-mon[22316]: pgmap v67: 1 pgs: 1 unknown; 0 B data, 104 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:22:53.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:52 smithi070 ceph-mon[22316]: osdmap e23: 4 total, 3 up, 4 in 2024-08-31T05:22:53.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:52 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T05:22:53.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:52 smithi070 ceph-mon[22316]: mgrmap e20: x(active, since 114s), standbys: z, y 2024-08-31T05:22:54.908 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:54 smithi050 ceph-mon[22146]: pgmap v69: 1 pgs: 1 unknown; 0 B data, 104 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:22:54.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:54 smithi005 ceph-mon[18602]: pgmap v69: 1 pgs: 1 unknown; 0 B data, 104 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:22:55.085 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:54 smithi070 ceph-mon[22316]: pgmap v69: 1 pgs: 1 unknown; 0 B data, 104 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:22:56.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:56 smithi050 ceph-mon[22146]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:22:56.945 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:56 smithi005 ceph-mon[18602]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:22:57.085 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:56 smithi070 ceph-mon[22316]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:22:58.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:58 smithi050 ceph-mon[22146]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:22:58.966 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:58 smithi005 ceph-mon[18602]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:22:59.085 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:58 smithi070 ceph-mon[22316]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:22:59.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:59 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-08-31T05:22:59.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:59 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:22:59.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:22:59 smithi005 ceph-mon[18602]: Deploying daemon osd.3 on smithi005 2024-08-31T05:22:59.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:59 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-08-31T05:22:59.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:59 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:22:59.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:22:59 smithi050 ceph-mon[22146]: Deploying daemon osd.3 on smithi005 2024-08-31T05:23:00.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:59 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-08-31T05:23:00.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:59 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:23:00.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:22:59 smithi070 ceph-mon[22316]: Deploying daemon osd.3 on smithi005 2024-08-31T05:23:00.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:00 smithi005 ceph-mon[18602]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:23:00.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:00 smithi050 ceph-mon[22146]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:23:01.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:00 smithi070 ceph-mon[22316]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:23:02.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:02 smithi005 ceph-mon[18602]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:23:02.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:02 smithi050 ceph-mon[22146]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:23:03.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:02 smithi070 ceph-mon[22316]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:23:04.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:04 smithi050 ceph-mon[22146]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:23:04.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:04 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:23:04.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:04 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:04.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:04 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:04.956 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:04 smithi005 ceph-mon[18602]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:23:04.957 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:04 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:23:04.957 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:04 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:04.957 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:04 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:05.085 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:04 smithi070 ceph-mon[22316]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:23:05.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:04 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:23:05.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:04 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:05.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:04 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:06.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:06 smithi050 ceph-mon[22146]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:23:06.946 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:06 smithi005 ceph-mon[18602]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:23:07.085 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:06 smithi070 ceph-mon[22316]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:23:08.190 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:08 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:08.190 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:08 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:08.190 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:08 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:23:08.191 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:08 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:23:08.191 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:08 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:08.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:08 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:08.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:08 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:08.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:08 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:23:08.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:08 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:23:08.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:08 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:08.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:08 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:08.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:08 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:08.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:08 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:23:08.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:08 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:23:08.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:08 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:08.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:23:08.497+0000 7f76a3fff640 1 -- 172.21.15.5:0/4060087770 <== mgr.14220 v2:172.21.15.5:6800/2696053609 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f76ac0635a0 con 0x7f76980b4b20 2024-08-31T05:23:08.500 INFO:teuthology.orchestra.run.smithi005.stdout:Created osd(s) 3 on host 'smithi005' 2024-08-31T05:23:08.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:23:08.500+0000 7f76b1711640 1 -- 172.21.15.5:0/4060087770 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f76980b4b20 msgr2=0x7f76980b7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:23:08.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:23:08.500+0000 7f76b1711640 1 --2- 172.21.15.5:0/4060087770 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f76980b4b20 0x7f76980b7030 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f76ac06ba00 tx=0x7f76a4005f90 comp rx=0 tx=0).stop 2024-08-31T05:23:08.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:23:08.500+0000 7f76b1711640 1 -- 172.21.15.5:0/4060087770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76ac1050a0 msgr2=0x7f76ac19a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:23:08.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:23:08.500+0000 7f76b1711640 1 --2- 172.21.15.5:0/4060087770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76ac1050a0 0x7f76ac19a820 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f769400c970 tx=0x7f769400ce30 comp rx=0 tx=0).stop 2024-08-31T05:23:08.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:23:08.500+0000 7f76b1711640 1 -- 172.21.15.5:0/4060087770 shutdown_connections 2024-08-31T05:23:08.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:23:08.500+0000 7f76b1711640 1 --2- 172.21.15.5:0/4060087770 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f76980b4b20 0x7f76980b7030 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:08.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:23:08.500+0000 7f76b1711640 1 --2- 172.21.15.5:0/4060087770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f76ac10dbb0 0x7f76ac19fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:08.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:23:08.500+0000 7f76b1711640 1 --2- 172.21.15.5:0/4060087770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76ac1050a0 0x7f76ac19a820 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:08.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:23:08.500+0000 7f76b1711640 1 --2- 172.21.15.5:0/4060087770 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76ac104750 0x7f76ac19a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:08.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:23:08.500+0000 7f76b1711640 1 -- 172.21.15.5:0/4060087770 >> 172.21.15.5:0/4060087770 conn(0x7f76ac0794d0 msgr2=0x7f76ac1004d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:23:08.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:23:08.500+0000 7f76b1711640 1 -- 172.21.15.5:0/4060087770 shutdown_connections 2024-08-31T05:23:08.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:23:08.500+0000 7f76b1711640 1 -- 172.21.15.5:0/4060087770 wait complete. 2024-08-31T05:23:09.164 DEBUG:teuthology.orchestra.run.smithi005:osd.3> sudo journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@osd.3.service 2024-08-31T05:23:09.166 INFO:tasks.cephadm:Deploying osd.4 on smithi050 with /dev/vg_nvme/lv_3... 2024-08-31T05:23:09.166 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-08-31T05:23:09.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:09 smithi050 ceph-mon[22146]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:23:09.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:09 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:23:09.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:09 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:09.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:09 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:09.429 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T05:23:09.440 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:09 smithi005 ceph-mon[18602]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:23:09.440 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:09 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:23:09.440 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:09 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:09.440 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:09 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:09.555 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:09 smithi070 ceph-mon[22316]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:23:09.555 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:09 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:23:09.555 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:09 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:09.556 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:09 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:10.873 INFO:journalctl@ceph.osd.3.smithi005.stdout:Aug 31 05:23:10 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-3[40929]: 2024-08-31T05:23:10.613+0000 7f3fe5104640 -1 osd.3 0 log_to_monitors true 2024-08-31T05:23:11.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:11 smithi005 ceph-mon[18602]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:23:11.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:11 smithi005 ceph-mon[18602]: from='osd.3 [v2:172.21.15.5:6810/1647468379,v1:172.21.15.5:6811/1647468379]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-08-31T05:23:11.369 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:11 smithi050 ceph-mon[22146]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:23:11.369 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:11 smithi050 ceph-mon[22146]: from='osd.3 [v2:172.21.15.5:6810/1647468379,v1:172.21.15.5:6811/1647468379]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-08-31T05:23:11.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:11 smithi070 ceph-mon[22316]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:23:11.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:11 smithi070 ceph-mon[22316]: from='osd.3 [v2:172.21.15.5:6810/1647468379,v1:172.21.15.5:6811/1647468379]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-08-31T05:23:11.967 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T05:23:11.992 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi050:vg_nvme/lv_3 2024-08-31T05:23:12.253 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T05:23:12.382 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:12 smithi050 ceph-mon[22146]: from='osd.3 [v2:172.21.15.5:6810/1647468379,v1:172.21.15.5:6811/1647468379]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-31T05:23:12.382 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:12 smithi050 ceph-mon[22146]: osdmap e24: 4 total, 3 up, 4 in 2024-08-31T05:23:12.382 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:12 smithi050 ceph-mon[22146]: from='osd.3 [v2:172.21.15.5:6810/1647468379,v1:172.21.15.5:6811/1647468379]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi005", "root=default"]} : dispatch 2024-08-31T05:23:12.382 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:12 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T05:23:12.382 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:12 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:12.382 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:12 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:12.382 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:12 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T05:23:12.382 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:12 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T05:23:12.383 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:12 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:12.383 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:12 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:23:12.383 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:12 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:23:12.383 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:12 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:12.383 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:12 smithi050 ceph-mon[22146]: from='osd.3 [v2:172.21.15.5:6810/1647468379,v1:172.21.15.5:6811/1647468379]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-08-31T05:23:12.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:12 smithi005 ceph-mon[18602]: from='osd.3 [v2:172.21.15.5:6810/1647468379,v1:172.21.15.5:6811/1647468379]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-31T05:23:12.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:12 smithi005 ceph-mon[18602]: osdmap e24: 4 total, 3 up, 4 in 2024-08-31T05:23:12.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:12 smithi005 ceph-mon[18602]: from='osd.3 [v2:172.21.15.5:6810/1647468379,v1:172.21.15.5:6811/1647468379]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi005", "root=default"]} : dispatch 2024-08-31T05:23:12.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:12 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T05:23:12.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:12 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:12.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:12 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:12.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:12 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T05:23:12.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:12 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T05:23:12.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:12 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:12.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:12 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:23:12.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:12 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:23:12.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:12 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:12.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:12 smithi005 ceph-mon[18602]: from='osd.3 [v2:172.21.15.5:6810/1647468379,v1:172.21.15.5:6811/1647468379]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-08-31T05:23:12.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:12 smithi070 ceph-mon[22316]: from='osd.3 [v2:172.21.15.5:6810/1647468379,v1:172.21.15.5:6811/1647468379]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-31T05:23:12.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:12 smithi070 ceph-mon[22316]: osdmap e24: 4 total, 3 up, 4 in 2024-08-31T05:23:12.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:12 smithi070 ceph-mon[22316]: from='osd.3 [v2:172.21.15.5:6810/1647468379,v1:172.21.15.5:6811/1647468379]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi005", "root=default"]} : dispatch 2024-08-31T05:23:12.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:12 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T05:23:12.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:12 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:12.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:12 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:12.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:12 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T05:23:12.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:12 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T05:23:12.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:12 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:12.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:12 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:23:12.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:12 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:23:12.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:12 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:12.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:12 smithi070 ceph-mon[22316]: from='osd.3 [v2:172.21.15.5:6810/1647468379,v1:172.21.15.5:6811/1647468379]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-08-31T05:23:12.770 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:12.768+0000 7f73f3553640 1 -- 172.21.15.50:0/1758953420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73ec1023f0 msgr2=0x7f73ec102800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:23:12.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:12.768+0000 7f73f3553640 1 --2- 172.21.15.50:0/1758953420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73ec1023f0 0x7f73ec102800 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f73dc009ca0 tx=0x7f73dc02a950 comp rx=0 tx=0).stop 2024-08-31T05:23:12.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:12.768+0000 7f73f3553640 1 -- 172.21.15.50:0/1758953420 shutdown_connections 2024-08-31T05:23:12.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:12.768+0000 7f73f3553640 1 --2- 172.21.15.50:0/1758953420 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73ec10ffa0 0x7f73ec1123c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:12.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:12.768+0000 7f73f3553640 1 --2- 172.21.15.50:0/1758953420 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73ec102d40 0x7f73ec10fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:12.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:12.768+0000 7f73f3553640 1 --2- 172.21.15.50:0/1758953420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73ec1023f0 0x7f73ec102800 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:12.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:12.768+0000 7f73f3553640 1 -- 172.21.15.50:0/1758953420 >> 172.21.15.50:0/1758953420 conn(0x7f73ec079530 msgr2=0x7f73ec079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:23:12.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:12.768+0000 7f73f3553640 1 -- 172.21.15.50:0/1758953420 shutdown_connections 2024-08-31T05:23:12.771 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:12.768+0000 7f73f3553640 1 -- 172.21.15.50:0/1758953420 wait complete. 2024-08-31T05:23:12.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:12.769+0000 7f73f3553640 1 Processor -- start 2024-08-31T05:23:12.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:12.769+0000 7f73f3553640 1 -- start start 2024-08-31T05:23:12.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:12.769+0000 7f73f3553640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73ec1023f0 0x7f73ec19c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:23:12.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:12.770+0000 7f73f3553640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73ec102d40 0x7f73ec19ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:23:12.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:12.770+0000 7f73f3553640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73ec10ffa0 0x7f73ec1a1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:23:12.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:12.770+0000 7f73f3553640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f73ec115a40 con 0x7f73ec1023f0 2024-08-31T05:23:12.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:12.770+0000 7f73f3553640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f73ec1158c0 con 0x7f73ec102d40 2024-08-31T05:23:12.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:12.770+0000 7f73f3553640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f73ec115bc0 con 0x7f73ec10ffa0 2024-08-31T05:23:12.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:12.770+0000 7f73f12ef640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73ec1023f0 0x7f73ec19c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:23:12.773 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:12.770+0000 7f73f0aee640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73ec102d40 0x7f73ec19ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:23:12.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:12.770+0000 7f73f12ef640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73ec1023f0 0x7f73ec19c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.50:36522/0 (socket says 172.21.15.50:36522) 2024-08-31T05:23:12.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:12.770+0000 7f73f0aee640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73ec102d40 0x7f73ec19ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:47996/0 (socket says 172.21.15.50:47996) 2024-08-31T05:23:12.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:12.770+0000 7f73f12ef640 1 -- 172.21.15.50:0/2815513777 learned_addr learned my addr 172.21.15.50:0/2815513777 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T05:23:12.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:12.770+0000 7f73f1af0640 1 --2- 172.21.15.50:0/2815513777 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73ec10ffa0 0x7f73ec1a1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:23:12.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:12.770+0000 7f73f0aee640 1 -- 172.21.15.50:0/2815513777 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73ec10ffa0 msgr2=0x7f73ec1a1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:23:12.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:12.770+0000 7f73f0aee640 1 --2- 172.21.15.50:0/2815513777 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73ec10ffa0 0x7f73ec1a1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:12.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:12.770+0000 7f73f0aee640 1 -- 172.21.15.50:0/2815513777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73ec1023f0 msgr2=0x7f73ec19c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:23:12.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:12.770+0000 7f73f0aee640 1 --2- 172.21.15.50:0/2815513777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73ec1023f0 0x7f73ec19c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:12.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:12.770+0000 7f73f0aee640 1 -- 172.21.15.50:0/2815513777 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73ec1a23e0 con 0x7f73ec102d40 2024-08-31T05:23:12.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:12.770+0000 7f73f12ef640 1 --2- 172.21.15.50:0/2815513777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73ec1023f0 0x7f73ec19c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:23:12.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:12.770+0000 7f73f0aee640 1 --2- 172.21.15.50:0/2815513777 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73ec102d40 0x7f73ec19ca10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f73e000c970 tx=0x7f73e000ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:23:12.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:12.770+0000 7f73ea7fc640 1 -- 172.21.15.50:0/2815513777 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73e0007bb0 con 0x7f73ec102d40 2024-08-31T05:23:12.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:12.770+0000 7f73ea7fc640 1 -- 172.21.15.50:0/2815513777 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73e0007d50 con 0x7f73ec102d40 2024-08-31T05:23:12.774 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:12.770+0000 7f73f3553640 1 -- 172.21.15.50:0/2815513777 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73ec1a26d0 con 0x7f73ec102d40 2024-08-31T05:23:12.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:12.770+0000 7f73ea7fc640 1 -- 172.21.15.50:0/2815513777 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73e0004df0 con 0x7f73ec102d40 2024-08-31T05:23:12.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:12.771+0000 7f73f3553640 1 -- 172.21.15.50:0/2815513777 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73ec1a8e30 con 0x7f73ec102d40 2024-08-31T05:23:12.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:12.771+0000 7f73f3553640 1 -- 172.21.15.50:0/2815513777 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73ec102800 con 0x7f73ec102d40 2024-08-31T05:23:12.775 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:12.773+0000 7f73ea7fc640 1 -- 172.21.15.50:0/2815513777 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f73e0005000 con 0x7f73ec102d40 2024-08-31T05:23:12.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:12.774+0000 7f73ea7fc640 1 --2- 172.21.15.50:0/2815513777 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f73d40b4b80 0x7f73d40b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:23:12.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:12.774+0000 7f73ea7fc640 1 -- 172.21.15.50:0/2815513777 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 3604+0+0 (secure 0 0 0) 0x7f73e00e3f80 con 0x7f73ec102d40 2024-08-31T05:23:12.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:12.774+0000 7f73f12ef640 1 --2- 172.21.15.50:0/2815513777 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f73d40b4b80 0x7f73d40b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:23:12.776 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:12.775+0000 7f73f12ef640 1 --2- 172.21.15.50:0/2815513777 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f73d40b4b80 0x7f73d40b7090 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f73dc0094e0 tx=0x7f73dc005c50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:23:12.779 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:12.777+0000 7f73ea7fc640 1 -- 172.21.15.50:0/2815513777 <== mon.2 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f73e0014030 con 0x7f73ec102d40 2024-08-31T05:23:12.967 INFO:journalctl@ceph.osd.3.smithi005.stdout:Aug 31 05:23:12 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-3[40929]: 2024-08-31T05:23:12.540+0000 7f3fe1086640 -1 osd.3 0 waiting for initial osdmap 2024-08-31T05:23:12.967 INFO:journalctl@ceph.osd.3.smithi005.stdout:Aug 31 05:23:12 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-3[40929]: 2024-08-31T05:23:12.546+0000 7f3fd8e7c640 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T05:23:12.973 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:12.971+0000 7f73f3553640 1 -- 172.21.15.50:0/2815513777 --> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f73ec10a230 con 0x7f73d40b4b80 2024-08-31T05:23:13.385 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:13 smithi050 ceph-mon[22146]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:23:13.385 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:13 smithi050 ceph-mon[22146]: Detected new or changed devices on smithi005 2024-08-31T05:23:13.385 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:13 smithi050 ceph-mon[22146]: Adjusting osd_memory_target on smithi005 to 8546M 2024-08-31T05:23:13.385 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:13 smithi050 ceph-mon[22146]: osdmap e25: 4 total, 3 up, 4 in 2024-08-31T05:23:13.385 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:13 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T05:23:13.386 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:13 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T05:23:13.386 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:13 smithi050 ceph-mon[22146]: from='osd.3 [v2:172.21.15.5:6810/1647468379,v1:172.21.15.5:6811/1647468379]' entity='osd.3' 2024-08-31T05:23:13.386 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:13 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:23:13.386 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:13 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:23:13.386 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:13 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:23:13.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:13 smithi005 ceph-mon[18602]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:23:13.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:13 smithi005 ceph-mon[18602]: Detected new or changed devices on smithi005 2024-08-31T05:23:13.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:13 smithi005 ceph-mon[18602]: Adjusting osd_memory_target on smithi005 to 8546M 2024-08-31T05:23:13.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:13 smithi005 ceph-mon[18602]: osdmap e25: 4 total, 3 up, 4 in 2024-08-31T05:23:13.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:13 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T05:23:13.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:13 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T05:23:13.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:13 smithi005 ceph-mon[18602]: from='osd.3 [v2:172.21.15.5:6810/1647468379,v1:172.21.15.5:6811/1647468379]' entity='osd.3' 2024-08-31T05:23:13.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:13 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:23:13.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:13 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:23:13.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:13 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:23:13.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:13 smithi070 ceph-mon[22316]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:23:13.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:13 smithi070 ceph-mon[22316]: Detected new or changed devices on smithi005 2024-08-31T05:23:13.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:13 smithi070 ceph-mon[22316]: Adjusting osd_memory_target on smithi005 to 8546M 2024-08-31T05:23:13.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:13 smithi070 ceph-mon[22316]: osdmap e25: 4 total, 3 up, 4 in 2024-08-31T05:23:13.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:13 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T05:23:13.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:13 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T05:23:13.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:13 smithi070 ceph-mon[22316]: from='osd.3 [v2:172.21.15.5:6810/1647468379,v1:172.21.15.5:6811/1647468379]' entity='osd.3' 2024-08-31T05:23:13.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:13 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:23:13.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:13 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:23:13.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:13 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:23:14.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:14 smithi050 ceph-mon[22146]: purged_snaps scrub starts 2024-08-31T05:23:14.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:14 smithi050 ceph-mon[22146]: purged_snaps scrub ok 2024-08-31T05:23:14.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:14 smithi050 ceph-mon[22146]: from='client.24338 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:23:14.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:14 smithi050 ceph-mon[22146]: osd.3 [v2:172.21.15.5:6810/1647468379,v1:172.21.15.5:6811/1647468379] boot 2024-08-31T05:23:14.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:14 smithi050 ceph-mon[22146]: osdmap e26: 4 total, 4 up, 4 in 2024-08-31T05:23:14.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:14 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T05:23:14.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:14 smithi005 ceph-mon[18602]: purged_snaps scrub starts 2024-08-31T05:23:14.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:14 smithi005 ceph-mon[18602]: purged_snaps scrub ok 2024-08-31T05:23:14.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:14 smithi005 ceph-mon[18602]: from='client.24338 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:23:14.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:14 smithi005 ceph-mon[18602]: osd.3 [v2:172.21.15.5:6810/1647468379,v1:172.21.15.5:6811/1647468379] boot 2024-08-31T05:23:14.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:14 smithi005 ceph-mon[18602]: osdmap e26: 4 total, 4 up, 4 in 2024-08-31T05:23:14.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:14 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T05:23:14.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:14 smithi070 ceph-mon[22316]: purged_snaps scrub starts 2024-08-31T05:23:14.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:14 smithi070 ceph-mon[22316]: purged_snaps scrub ok 2024-08-31T05:23:14.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:14 smithi070 ceph-mon[22316]: from='client.24338 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:23:14.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:14 smithi070 ceph-mon[22316]: osd.3 [v2:172.21.15.5:6810/1647468379,v1:172.21.15.5:6811/1647468379] boot 2024-08-31T05:23:14.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:14 smithi070 ceph-mon[22316]: osdmap e26: 4 total, 4 up, 4 in 2024-08-31T05:23:14.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:14 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T05:23:15.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:15 smithi050 ceph-mon[22146]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:23:15.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:15 smithi050 ceph-mon[22146]: osdmap e27: 4 total, 4 up, 4 in 2024-08-31T05:23:15.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:15 smithi050 ceph-mon[22146]: osdmap e28: 4 total, 4 up, 4 in 2024-08-31T05:23:15.466 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:15 smithi005 ceph-mon[18602]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:23:15.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:15 smithi005 ceph-mon[18602]: osdmap e27: 4 total, 4 up, 4 in 2024-08-31T05:23:15.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:15 smithi005 ceph-mon[18602]: osdmap e28: 4 total, 4 up, 4 in 2024-08-31T05:23:15.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:15 smithi070 ceph-mon[22316]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail 2024-08-31T05:23:15.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:15 smithi070 ceph-mon[22316]: osdmap e27: 4 total, 4 up, 4 in 2024-08-31T05:23:15.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:15 smithi070 ceph-mon[22316]: osdmap e28: 4 total, 4 up, 4 in 2024-08-31T05:23:16.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:16 smithi050 ceph-mon[22146]: from='client.? 172.21.15.50:0/1283662587' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "59b847ef-6eb0-4c13-aa06-53a76d77ce45"} : dispatch 2024-08-31T05:23:16.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:16 smithi050 ceph-mon[22146]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "59b847ef-6eb0-4c13-aa06-53a76d77ce45"} : dispatch 2024-08-31T05:23:16.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:16 smithi050 ceph-mon[22146]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "59b847ef-6eb0-4c13-aa06-53a76d77ce45"}]': finished 2024-08-31T05:23:16.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:16 smithi050 ceph-mon[22146]: osdmap e29: 5 total, 4 up, 5 in 2024-08-31T05:23:16.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:16 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T05:23:16.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:16 smithi050 ceph-mon[22146]: from='client.? 172.21.15.50:0/906849585' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:23:16.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:16 smithi005 ceph-mon[18602]: from='client.? 172.21.15.50:0/1283662587' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "59b847ef-6eb0-4c13-aa06-53a76d77ce45"} : dispatch 2024-08-31T05:23:16.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:16 smithi005 ceph-mon[18602]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "59b847ef-6eb0-4c13-aa06-53a76d77ce45"} : dispatch 2024-08-31T05:23:16.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:16 smithi005 ceph-mon[18602]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "59b847ef-6eb0-4c13-aa06-53a76d77ce45"}]': finished 2024-08-31T05:23:16.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:16 smithi005 ceph-mon[18602]: osdmap e29: 5 total, 4 up, 5 in 2024-08-31T05:23:16.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:16 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T05:23:16.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:16 smithi005 ceph-mon[18602]: from='client.? 172.21.15.50:0/906849585' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:23:16.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:16 smithi070 ceph-mon[22316]: from='client.? 172.21.15.50:0/1283662587' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "59b847ef-6eb0-4c13-aa06-53a76d77ce45"} : dispatch 2024-08-31T05:23:16.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:16 smithi070 ceph-mon[22316]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "59b847ef-6eb0-4c13-aa06-53a76d77ce45"} : dispatch 2024-08-31T05:23:16.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:16 smithi070 ceph-mon[22316]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "59b847ef-6eb0-4c13-aa06-53a76d77ce45"}]': finished 2024-08-31T05:23:16.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:16 smithi070 ceph-mon[22316]: osdmap e29: 5 total, 4 up, 5 in 2024-08-31T05:23:16.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:16 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T05:23:16.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:16 smithi070 ceph-mon[22316]: from='client.? 172.21.15.50:0/906849585' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:23:17.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:17 smithi050 ceph-mon[22146]: pgmap v85: 1 pgs: 1 peering; 577 KiB data, 139 MiB used, 357 GiB / 358 GiB avail 2024-08-31T05:23:17.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:17 smithi005 ceph-mon[18602]: pgmap v85: 1 pgs: 1 peering; 577 KiB data, 139 MiB used, 357 GiB / 358 GiB avail 2024-08-31T05:23:17.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:17 smithi070 ceph-mon[22316]: pgmap v85: 1 pgs: 1 peering; 577 KiB data, 139 MiB used, 357 GiB / 358 GiB avail 2024-08-31T05:23:19.335 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:19 smithi070 ceph-mon[22316]: pgmap v87: 1 pgs: 1 peering; 577 KiB data, 139 MiB used, 357 GiB / 358 GiB avail 2024-08-31T05:23:19.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:19 smithi050 ceph-mon[22146]: pgmap v87: 1 pgs: 1 peering; 577 KiB data, 139 MiB used, 357 GiB / 358 GiB avail 2024-08-31T05:23:19.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:19 smithi005 ceph-mon[18602]: pgmap v87: 1 pgs: 1 peering; 577 KiB data, 139 MiB used, 357 GiB / 358 GiB avail 2024-08-31T05:23:21.381 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:21 smithi050 ceph-mon[22146]: pgmap v88: 1 pgs: 1 peering; 577 KiB data, 139 MiB used, 357 GiB / 358 GiB avail 2024-08-31T05:23:21.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:21 smithi005 ceph-mon[18602]: pgmap v88: 1 pgs: 1 peering; 577 KiB data, 139 MiB used, 357 GiB / 358 GiB avail 2024-08-31T05:23:21.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:21 smithi070 ceph-mon[22316]: pgmap v88: 1 pgs: 1 peering; 577 KiB data, 139 MiB used, 357 GiB / 358 GiB avail 2024-08-31T05:23:23.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:23 smithi050 ceph-mon[22146]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 357 GiB / 358 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-08-31T05:23:23.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:23 smithi005 ceph-mon[18602]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 357 GiB / 358 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-08-31T05:23:23.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:23 smithi070 ceph-mon[22316]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 357 GiB / 358 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-08-31T05:23:24.391 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:24 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-08-31T05:23:24.392 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:24 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:23:24.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:24 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-08-31T05:23:24.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:24 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:23:24.585 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:24 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-08-31T05:23:24.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:24 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:23:25.255 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:25 smithi050 ceph-mon[22146]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 357 GiB / 358 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-08-31T05:23:25.256 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:25 smithi050 ceph-mon[22146]: Deploying daemon osd.4 on smithi050 2024-08-31T05:23:25.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:25 smithi005 ceph-mon[18602]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 357 GiB / 358 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-08-31T05:23:25.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:25 smithi005 ceph-mon[18602]: Deploying daemon osd.4 on smithi050 2024-08-31T05:23:25.585 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:25 smithi070 ceph-mon[22316]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 357 GiB / 358 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-08-31T05:23:25.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:25 smithi070 ceph-mon[22316]: Deploying daemon osd.4 on smithi050 2024-08-31T05:23:27.395 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:27 smithi050 ceph-mon[22146]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-31T05:23:27.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:27 smithi005 ceph-mon[18602]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-31T05:23:27.585 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:27 smithi070 ceph-mon[22316]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-31T05:23:29.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:29 smithi050 ceph-mon[22146]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 357 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-08-31T05:23:29.466 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:29 smithi005 ceph-mon[18602]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 357 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-08-31T05:23:29.585 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:29 smithi070 ceph-mon[22316]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 357 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-08-31T05:23:30.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:30 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:23:30.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:30 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:30.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:30 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:30.466 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:30 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:23:30.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:30 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:30.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:30 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:30.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:30 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:23:30.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:30 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:30.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:30 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:31.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:31 smithi050 ceph-mon[22146]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T05:23:31.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:31 smithi005 ceph-mon[18602]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T05:23:31.585 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:31 smithi070 ceph-mon[22316]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T05:23:33.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:32 smithi070 ceph-mon[22316]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T05:23:33.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:32 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:33.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:32 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:33.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:32 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:23:33.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:32 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:23:33.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:32 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:33.119 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:32 smithi050 ceph-mon[22146]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T05:23:33.119 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:32 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:33.119 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:32 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:33.119 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:32 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:23:33.119 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:32 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:23:33.119 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:32 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:33.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:32 smithi005 ceph-mon[18602]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T05:23:33.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:32 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:33.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:32 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:33.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:32 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:23:33.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:32 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:23:33.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:32 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:33.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:33.428+0000 7f73ea7fc640 1 -- 172.21.15.50:0/2815513777 <== mgr.14220 v2:172.21.15.5:6800/2696053609 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f73ec10a230 con 0x7f73d40b4b80 2024-08-31T05:23:33.430 INFO:teuthology.orchestra.run.smithi050.stdout:Created osd(s) 4 on host 'smithi050' 2024-08-31T05:23:33.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:33.430+0000 7f73f3553640 1 -- 172.21.15.50:0/2815513777 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f73d40b4b80 msgr2=0x7f73d40b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:23:33.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:33.430+0000 7f73f3553640 1 --2- 172.21.15.50:0/2815513777 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f73d40b4b80 0x7f73d40b7090 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f73dc0094e0 tx=0x7f73dc005c50 comp rx=0 tx=0).stop 2024-08-31T05:23:33.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:33.430+0000 7f73f3553640 1 -- 172.21.15.50:0/2815513777 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73ec102d40 msgr2=0x7f73ec19ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:23:33.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:33.430+0000 7f73f3553640 1 --2- 172.21.15.50:0/2815513777 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73ec102d40 0x7f73ec19ca10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f73e000c970 tx=0x7f73e000ce30 comp rx=0 tx=0).stop 2024-08-31T05:23:33.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:33.430+0000 7f73f3553640 1 -- 172.21.15.50:0/2815513777 shutdown_connections 2024-08-31T05:23:33.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:33.430+0000 7f73f3553640 1 --2- 172.21.15.50:0/2815513777 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f73d40b4b80 0x7f73d40b7090 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:33.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:33.430+0000 7f73f3553640 1 --2- 172.21.15.50:0/2815513777 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73ec10ffa0 0x7f73ec1a1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:33.432 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:33.430+0000 7f73f3553640 1 --2- 172.21.15.50:0/2815513777 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73ec102d40 0x7f73ec19ca10 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:33.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:33.430+0000 7f73f3553640 1 --2- 172.21.15.50:0/2815513777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73ec1023f0 0x7f73ec19c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:33.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:33.430+0000 7f73f3553640 1 -- 172.21.15.50:0/2815513777 >> 172.21.15.50:0/2815513777 conn(0x7f73ec079530 msgr2=0x7f73ec109b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:23:33.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:33.430+0000 7f73f3553640 1 -- 172.21.15.50:0/2815513777 shutdown_connections 2024-08-31T05:23:33.433 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:23:33.430+0000 7f73f3553640 1 -- 172.21.15.50:0/2815513777 wait complete. 2024-08-31T05:23:33.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:33 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:23:33.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:33 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:33.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:33 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:34.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:33 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:23:34.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:33 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:34.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:33 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:34.108 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:33 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:23:34.108 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:33 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:34.108 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:33 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:34.136 DEBUG:teuthology.orchestra.run.smithi050:osd.4> sudo journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@osd.4.service 2024-08-31T05:23:34.139 INFO:tasks.cephadm:Deploying osd.5 on smithi070 with /dev/vg_nvme/lv_3... 2024-08-31T05:23:34.139 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-08-31T05:23:34.391 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T05:23:35.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:34 smithi070 ceph-mon[22316]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 357 GiB / 358 GiB avail 2024-08-31T05:23:35.156 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:34 smithi050 ceph-mon[22146]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 357 GiB / 358 GiB avail 2024-08-31T05:23:35.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:34 smithi005 ceph-mon[18602]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 357 GiB / 358 GiB avail 2024-08-31T05:23:35.572 INFO:journalctl@ceph.osd.4.smithi050.stdout:Aug 31 05:23:35 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-4[34341]: 2024-08-31T05:23:35.410+0000 7f6af98fd640 -1 osd.4 0 log_to_monitors true 2024-08-31T05:23:36.085 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:35 smithi070 ceph-mon[22316]: from='osd.4 [v2:172.21.15.50:6808/2314546877,v1:172.21.15.50:6809/2314546877]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-31T05:23:36.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:35 smithi070 ceph-mon[22316]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-31T05:23:36.156 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:35 smithi050 ceph-mon[22146]: from='osd.4 [v2:172.21.15.50:6808/2314546877,v1:172.21.15.50:6809/2314546877]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-31T05:23:36.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:35 smithi050 ceph-mon[22146]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-31T05:23:36.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:35 smithi005 ceph-mon[18602]: from='osd.4 [v2:172.21.15.50:6808/2314546877,v1:172.21.15.50:6809/2314546877]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-31T05:23:36.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:35 smithi005 ceph-mon[18602]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-31T05:23:36.989 INFO:journalctl@ceph.osd.4.smithi050.stdout:Aug 31 05:23:36 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-4[34341]: 2024-08-31T05:23:36.839+0000 7f6af587f640 -1 osd.4 0 waiting for initial osdmap 2024-08-31T05:23:36.990 INFO:journalctl@ceph.osd.4.smithi050.stdout:Aug 31 05:23:36 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-4[34341]: 2024-08-31T05:23:36.845+0000 7f6af167d640 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T05:23:36.990 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:36 smithi050 ceph-mon[22146]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 357 GiB / 358 GiB avail 2024-08-31T05:23:36.990 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:36 smithi050 ceph-mon[22146]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-31T05:23:36.990 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:36 smithi050 ceph-mon[22146]: from='osd.4 [v2:172.21.15.50:6808/2314546877,v1:172.21.15.50:6809/2314546877]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T05:23:36.990 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:36 smithi050 ceph-mon[22146]: osdmap e30: 5 total, 4 up, 5 in 2024-08-31T05:23:36.990 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:36 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T05:23:36.990 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:36 smithi050 ceph-mon[22146]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T05:23:37.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:36 smithi070 ceph-mon[22316]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 357 GiB / 358 GiB avail 2024-08-31T05:23:37.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:36 smithi070 ceph-mon[22316]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-31T05:23:37.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:36 smithi070 ceph-mon[22316]: from='osd.4 [v2:172.21.15.50:6808/2314546877,v1:172.21.15.50:6809/2314546877]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T05:23:37.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:36 smithi070 ceph-mon[22316]: osdmap e30: 5 total, 4 up, 5 in 2024-08-31T05:23:37.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:36 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T05:23:37.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:36 smithi070 ceph-mon[22316]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T05:23:37.092 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-08-31T05:23:37.118 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi070:vg_nvme/lv_3 2024-08-31T05:23:37.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:36 smithi005 ceph-mon[18602]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 357 GiB / 358 GiB avail 2024-08-31T05:23:37.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:36 smithi005 ceph-mon[18602]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-31T05:23:37.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:36 smithi005 ceph-mon[18602]: from='osd.4 [v2:172.21.15.50:6808/2314546877,v1:172.21.15.50:6809/2314546877]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T05:23:37.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:36 smithi005 ceph-mon[18602]: osdmap e30: 5 total, 4 up, 5 in 2024-08-31T05:23:37.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:36 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T05:23:37.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:36 smithi005 ceph-mon[18602]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T05:23:37.369 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T05:23:37.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:23:37.926+0000 7f11edaa2640 1 -- 172.21.15.70:0/3591171516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11e8108140 msgr2=0x7f11e8108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:23:37.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:23:37.926+0000 7f11edaa2640 1 --2- 172.21.15.70:0/3591171516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11e8108140 0x7f11e8108550 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f11d0009900 tx=0x7f11d002a410 comp rx=0 tx=0).stop 2024-08-31T05:23:37.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:23:37.926+0000 7f11edaa2640 1 -- 172.21.15.70:0/3591171516 shutdown_connections 2024-08-31T05:23:37.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:23:37.926+0000 7f11edaa2640 1 --2- 172.21.15.70:0/3591171516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11e8108a90 0x7f11e810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:37.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:23:37.926+0000 7f11edaa2640 1 --2- 172.21.15.70:0/3591171516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11e8108140 0x7f11e8108550 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:37.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:23:37.926+0000 7f11edaa2640 1 --2- 172.21.15.70:0/3591171516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11e8102800 0x7f11e8102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:37.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:23:37.926+0000 7f11edaa2640 1 -- 172.21.15.70:0/3591171516 >> 172.21.15.70:0/3591171516 conn(0x7f11e80794d0 msgr2=0x7f11e80798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:23:37.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:23:37.926+0000 7f11edaa2640 1 -- 172.21.15.70:0/3591171516 shutdown_connections 2024-08-31T05:23:37.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:23:37.926+0000 7f11edaa2640 1 -- 172.21.15.70:0/3591171516 wait complete. 2024-08-31T05:23:37.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:23:37.927+0000 7f11edaa2640 1 Processor -- start 2024-08-31T05:23:37.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:23:37.927+0000 7f11edaa2640 1 -- start start 2024-08-31T05:23:37.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:23:37.927+0000 7f11edaa2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11e8102800 0x7f11e81990d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:23:37.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:23:37.927+0000 7f11edaa2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11e8108140 0x7f11e8199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:23:37.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:23:37.928+0000 7f11edaa2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11e8108a90 0x7f11e819e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:23:37.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:23:37.928+0000 7f11edaa2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f11e81126c0 con 0x7f11e8102800 2024-08-31T05:23:37.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:23:37.928+0000 7f11edaa2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f11e8112540 con 0x7f11e8108140 2024-08-31T05:23:37.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:23:37.928+0000 7f11edaa2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f11e8112840 con 0x7f11e8108a90 2024-08-31T05:23:37.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:23:37.928+0000 7f11e7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11e8108a90 0x7f11e819e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:23:37.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:23:37.928+0000 7f11e7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11e8108a90 0x7f11e819e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52030/0 (socket says 172.21.15.70:52030) 2024-08-31T05:23:37.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:23:37.928+0000 7f11e7fff640 1 -- 172.21.15.70:0/2299366781 learned_addr learned my addr 172.21.15.70:0/2299366781 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-08-31T05:23:37.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:23:37.928+0000 7f11e6ffd640 1 --2- 172.21.15.70:0/2299366781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11e8108140 0x7f11e8199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:23:37.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:23:37.928+0000 7f11e77fe640 1 --2- 172.21.15.70:0/2299366781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11e8102800 0x7f11e81990d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:23:37.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:23:37.928+0000 7f11e7fff640 1 -- 172.21.15.70:0/2299366781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11e8108140 msgr2=0x7f11e8199670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:23:37.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:23:37.928+0000 7f11e7fff640 1 --2- 172.21.15.70:0/2299366781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11e8108140 0x7f11e8199670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:37.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:23:37.928+0000 7f11e7fff640 1 -- 172.21.15.70:0/2299366781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11e8102800 msgr2=0x7f11e81990d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:23:37.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:23:37.928+0000 7f11e7fff640 1 --2- 172.21.15.70:0/2299366781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11e8102800 0x7f11e81990d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:37.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:23:37.928+0000 7f11e7fff640 1 -- 172.21.15.70:0/2299366781 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11e819f040 con 0x7f11e8108a90 2024-08-31T05:23:37.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:23:37.928+0000 7f11e7fff640 1 --2- 172.21.15.70:0/2299366781 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11e8108a90 0x7f11e819e910 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f11e000d750 tx=0x7f11e000dc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:23:37.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:23:37.928+0000 7f11e4ff9640 1 -- 172.21.15.70:0/2299366781 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11e0017070 con 0x7f11e8108a90 2024-08-31T05:23:37.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:23:37.928+0000 7f11e4ff9640 1 -- 172.21.15.70:0/2299366781 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f11e00054d0 con 0x7f11e8108a90 2024-08-31T05:23:37.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:23:37.928+0000 7f11edaa2640 1 -- 172.21.15.70:0/2299366781 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11e819f330 con 0x7f11e8108a90 2024-08-31T05:23:37.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:23:37.928+0000 7f11e4ff9640 1 -- 172.21.15.70:0/2299366781 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11e0004c60 con 0x7f11e8108a90 2024-08-31T05:23:37.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:23:37.928+0000 7f11edaa2640 1 -- 172.21.15.70:0/2299366781 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11e81a5a90 con 0x7f11e8108a90 2024-08-31T05:23:37.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:23:37.929+0000 7f11edaa2640 1 -- 172.21.15.70:0/2299366781 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11e8102c10 con 0x7f11e8108a90 2024-08-31T05:23:37.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:23:37.931+0000 7f11e4ff9640 1 -- 172.21.15.70:0/2299366781 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f11e0009bd0 con 0x7f11e8108a90 2024-08-31T05:23:37.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:23:37.932+0000 7f11e4ff9640 1 --2- 172.21.15.70:0/2299366781 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f11d40b4c00 0x7f11d40b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:23:37.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:23:37.932+0000 7f11e4ff9640 1 -- 172.21.15.70:0/2299366781 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4316+0+0 (secure 0 0 0) 0x7f11e00e3f50 con 0x7f11e8108a90 2024-08-31T05:23:37.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:23:37.933+0000 7f11e77fe640 1 --2- 172.21.15.70:0/2299366781 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f11d40b4c00 0x7f11d40b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:23:37.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:23:37.933+0000 7f11e77fe640 1 --2- 172.21.15.70:0/2299366781 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f11d40b4c00 0x7f11d40b7110 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f11d8005fd0 tx=0x7f11d8009680 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:23:37.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:23:37.936+0000 7f11e4ff9640 1 -- 172.21.15.70:0/2299366781 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f11e00ab9b0 con 0x7f11e8108a90 2024-08-31T05:23:38.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:37 smithi070 ceph-mon[22316]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-08-31T05:23:38.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:37 smithi070 ceph-mon[22316]: osdmap e31: 5 total, 4 up, 5 in 2024-08-31T05:23:38.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:37 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T05:23:38.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:37 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T05:23:38.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:37 smithi070 ceph-mon[22316]: Detected new or changed devices on smithi050 2024-08-31T05:23:38.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:37 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:38.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:37 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:38.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:37 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T05:23:38.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:37 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T05:23:38.087 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:37 smithi070 ceph-mon[22316]: Adjusting osd_memory_target on smithi050 to 8546M 2024-08-31T05:23:38.087 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:37 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:38.087 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:37 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:23:38.087 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:37 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:23:38.087 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:37 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:38.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:23:38.132+0000 7f11edaa2640 1 -- 172.21.15.70:0/2299366781 --> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f11e80635a0 con 0x7f11d40b4c00 2024-08-31T05:23:38.156 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:37 smithi050 ceph-mon[22146]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-08-31T05:23:38.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:37 smithi050 ceph-mon[22146]: osdmap e31: 5 total, 4 up, 5 in 2024-08-31T05:23:38.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:37 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T05:23:38.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:37 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T05:23:38.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:37 smithi050 ceph-mon[22146]: Detected new or changed devices on smithi050 2024-08-31T05:23:38.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:37 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:38.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:37 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:38.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:37 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T05:23:38.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:37 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T05:23:38.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:37 smithi050 ceph-mon[22146]: Adjusting osd_memory_target on smithi050 to 8546M 2024-08-31T05:23:38.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:37 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:38.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:37 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:23:38.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:37 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:23:38.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:37 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:38.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:37 smithi005 ceph-mon[18602]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-08-31T05:23:38.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:37 smithi005 ceph-mon[18602]: osdmap e31: 5 total, 4 up, 5 in 2024-08-31T05:23:38.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:37 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T05:23:38.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:37 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T05:23:38.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:37 smithi005 ceph-mon[18602]: Detected new or changed devices on smithi050 2024-08-31T05:23:38.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:37 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:38.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:37 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:38.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:37 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T05:23:38.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:37 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T05:23:38.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:37 smithi005 ceph-mon[18602]: Adjusting osd_memory_target on smithi050 to 8546M 2024-08-31T05:23:38.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:37 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:38.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:37 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:23:38.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:37 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:23:38.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:37 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:39.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:38 smithi050 ceph-mon[22146]: purged_snaps scrub starts 2024-08-31T05:23:39.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:38 smithi050 ceph-mon[22146]: purged_snaps scrub ok 2024-08-31T05:23:39.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:38 smithi050 ceph-mon[22146]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 357 GiB / 358 GiB avail 2024-08-31T05:23:39.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:38 smithi050 ceph-mon[22146]: osd.4 [v2:172.21.15.50:6808/2314546877,v1:172.21.15.50:6809/2314546877] boot 2024-08-31T05:23:39.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:38 smithi050 ceph-mon[22146]: osdmap e32: 5 total, 5 up, 5 in 2024-08-31T05:23:39.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:38 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T05:23:39.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:38 smithi050 ceph-mon[22146]: from='client.24388 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:23:39.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:38 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:23:39.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:38 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:23:39.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:38 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:23:39.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:38 smithi005 ceph-mon[18602]: purged_snaps scrub starts 2024-08-31T05:23:39.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:38 smithi005 ceph-mon[18602]: purged_snaps scrub ok 2024-08-31T05:23:39.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:38 smithi005 ceph-mon[18602]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 357 GiB / 358 GiB avail 2024-08-31T05:23:39.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:38 smithi005 ceph-mon[18602]: osd.4 [v2:172.21.15.50:6808/2314546877,v1:172.21.15.50:6809/2314546877] boot 2024-08-31T05:23:39.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:38 smithi005 ceph-mon[18602]: osdmap e32: 5 total, 5 up, 5 in 2024-08-31T05:23:39.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:38 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T05:23:39.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:38 smithi005 ceph-mon[18602]: from='client.24388 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:23:39.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:38 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:23:39.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:38 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:23:39.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:38 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:23:39.258 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:38 smithi070 ceph-mon[22316]: purged_snaps scrub starts 2024-08-31T05:23:39.258 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:38 smithi070 ceph-mon[22316]: purged_snaps scrub ok 2024-08-31T05:23:39.258 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:38 smithi070 ceph-mon[22316]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 357 GiB / 358 GiB avail 2024-08-31T05:23:39.258 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:38 smithi070 ceph-mon[22316]: osd.4 [v2:172.21.15.50:6808/2314546877,v1:172.21.15.50:6809/2314546877] boot 2024-08-31T05:23:39.258 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:38 smithi070 ceph-mon[22316]: osdmap e32: 5 total, 5 up, 5 in 2024-08-31T05:23:39.258 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:38 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T05:23:39.258 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:38 smithi070 ceph-mon[22316]: from='client.24388 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:23:39.258 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:38 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:23:39.258 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:38 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:23:39.258 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:38 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:23:40.128 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:40 smithi070 ceph-mon[22316]: osdmap e33: 5 total, 5 up, 5 in 2024-08-31T05:23:40.323 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:40 smithi050 ceph-mon[22146]: osdmap e33: 5 total, 5 up, 5 in 2024-08-31T05:23:40.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:40 smithi005 ceph-mon[18602]: osdmap e33: 5 total, 5 up, 5 in 2024-08-31T05:23:41.202 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:41 smithi070 ceph-mon[22316]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:23:41.202 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:41 smithi070 ceph-mon[22316]: from='client.? 172.21.15.70:0/3219401807' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b0dac185-4462-4760-aa36-0d221923b007"} : dispatch 2024-08-31T05:23:41.202 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:41 smithi070 ceph-mon[22316]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b0dac185-4462-4760-aa36-0d221923b007"} : dispatch 2024-08-31T05:23:41.202 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:41 smithi070 ceph-mon[22316]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b0dac185-4462-4760-aa36-0d221923b007"}]': finished 2024-08-31T05:23:41.202 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:41 smithi070 ceph-mon[22316]: osdmap e34: 6 total, 5 up, 6 in 2024-08-31T05:23:41.202 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:41 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T05:23:41.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:41 smithi050 ceph-mon[22146]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:23:41.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:41 smithi050 ceph-mon[22146]: from='client.? 172.21.15.70:0/3219401807' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b0dac185-4462-4760-aa36-0d221923b007"} : dispatch 2024-08-31T05:23:41.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:41 smithi050 ceph-mon[22146]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b0dac185-4462-4760-aa36-0d221923b007"} : dispatch 2024-08-31T05:23:41.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:41 smithi050 ceph-mon[22146]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b0dac185-4462-4760-aa36-0d221923b007"}]': finished 2024-08-31T05:23:41.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:41 smithi050 ceph-mon[22146]: osdmap e34: 6 total, 5 up, 6 in 2024-08-31T05:23:41.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:41 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T05:23:41.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:41 smithi005 ceph-mon[18602]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:23:41.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:41 smithi005 ceph-mon[18602]: from='client.? 172.21.15.70:0/3219401807' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b0dac185-4462-4760-aa36-0d221923b007"} : dispatch 2024-08-31T05:23:41.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:41 smithi005 ceph-mon[18602]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b0dac185-4462-4760-aa36-0d221923b007"} : dispatch 2024-08-31T05:23:41.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:41 smithi005 ceph-mon[18602]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b0dac185-4462-4760-aa36-0d221923b007"}]': finished 2024-08-31T05:23:41.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:41 smithi005 ceph-mon[18602]: osdmap e34: 6 total, 5 up, 6 in 2024-08-31T05:23:41.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:41 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T05:23:42.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:42 smithi070 ceph-mon[22316]: from='client.? 172.21.15.70:0/1000894602' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:23:42.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:42 smithi050 ceph-mon[22146]: from='client.? 172.21.15.70:0/1000894602' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:23:42.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:42 smithi005 ceph-mon[18602]: from='client.? 172.21.15.70:0/1000894602' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:23:43.335 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:43 smithi070 ceph-mon[22316]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:23:43.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:43 smithi050 ceph-mon[22146]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:23:43.466 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:43 smithi005 ceph-mon[18602]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:23:45.317 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:45 smithi070 ceph-mon[22316]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:23:45.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:45 smithi050 ceph-mon[22146]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:23:45.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:45 smithi005 ceph-mon[18602]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:23:47.306 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:47 smithi070 ceph-mon[22316]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:23:47.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:47 smithi050 ceph-mon[22146]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:23:47.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:47 smithi005 ceph-mon[18602]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:23:49.324 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:49 smithi070 ceph-mon[22316]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:23:49.325 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:49 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-08-31T05:23:49.325 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:49 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:23:49.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:49 smithi050 ceph-mon[22146]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:23:49.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:49 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-08-31T05:23:49.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:49 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:23:49.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:49 smithi005 ceph-mon[18602]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:23:49.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:49 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-08-31T05:23:49.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:49 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:23:50.326 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:50 smithi070 ceph-mon[22316]: Deploying daemon osd.5 on smithi070 2024-08-31T05:23:50.396 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:50 smithi050 ceph-mon[22146]: Deploying daemon osd.5 on smithi070 2024-08-31T05:23:50.466 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:50 smithi005 ceph-mon[18602]: Deploying daemon osd.5 on smithi070 2024-08-31T05:23:51.335 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:51 smithi070 ceph-mon[22316]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:23:51.368 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:51 smithi005 ceph-mon[18602]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:23:51.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:51 smithi050 ceph-mon[22146]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:23:53.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:53 smithi070 ceph-mon[22316]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:23:53.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:53 smithi050 ceph-mon[22146]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:23:53.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:53 smithi005 ceph-mon[18602]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:23:55.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:55 smithi070 ceph-mon[22316]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:23:55.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:55 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:23:55.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:55 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:55.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:55 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:55.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:55 smithi050 ceph-mon[22146]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:23:55.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:55 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:23:55.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:55 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:55.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:55 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:55.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:55 smithi005 ceph-mon[18602]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:23:55.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:55 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:23:55.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:55 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:55.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:55 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:57.335 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:57 smithi070 ceph-mon[22316]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:23:57.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:57 smithi050 ceph-mon[22146]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:23:57.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:57 smithi005 ceph-mon[18602]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:23:58.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:58 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:58.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:58 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:58.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:58 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:23:58.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:58 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:23:58.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:58 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:58.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:58 smithi070 ceph-mon[22316]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:23:58.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:58 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:58.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:58 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:58.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:58 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:23:58.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:58 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:23:58.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:58 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:58.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:58 smithi050 ceph-mon[22146]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:23:58.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:58 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:58.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:58 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:58.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:58 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:23:58.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:58 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:23:58.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:58 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:58.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:58 smithi005 ceph-mon[18602]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:23:58.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:23:58.806+0000 7f11e4ff9640 1 -- 172.21.15.70:0/2299366781 <== mgr.14220 v2:172.21.15.5:6800/2696053609 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f11e80635a0 con 0x7f11d40b4c00 2024-08-31T05:23:58.808 INFO:teuthology.orchestra.run.smithi070.stdout:Created osd(s) 5 on host 'smithi070' 2024-08-31T05:23:58.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:23:58.808+0000 7f11edaa2640 1 -- 172.21.15.70:0/2299366781 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f11d40b4c00 msgr2=0x7f11d40b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:23:58.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:23:58.808+0000 7f11edaa2640 1 --2- 172.21.15.70:0/2299366781 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f11d40b4c00 0x7f11d40b7110 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f11d8005fd0 tx=0x7f11d8009680 comp rx=0 tx=0).stop 2024-08-31T05:23:58.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:23:58.808+0000 7f11edaa2640 1 -- 172.21.15.70:0/2299366781 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11e8108a90 msgr2=0x7f11e819e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:23:58.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:23:58.808+0000 7f11edaa2640 1 --2- 172.21.15.70:0/2299366781 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11e8108a90 0x7f11e819e910 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f11e000d750 tx=0x7f11e000dc10 comp rx=0 tx=0).stop 2024-08-31T05:23:58.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:23:58.808+0000 7f11edaa2640 1 -- 172.21.15.70:0/2299366781 shutdown_connections 2024-08-31T05:23:58.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:23:58.808+0000 7f11edaa2640 1 --2- 172.21.15.70:0/2299366781 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f11d40b4c00 0x7f11d40b7110 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:58.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:23:58.808+0000 7f11edaa2640 1 --2- 172.21.15.70:0/2299366781 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11e8108a90 0x7f11e819e910 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:58.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:23:58.808+0000 7f11edaa2640 1 --2- 172.21.15.70:0/2299366781 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f11e8108140 0x7f11e8199670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:58.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:23:58.808+0000 7f11edaa2640 1 --2- 172.21.15.70:0/2299366781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f11e8102800 0x7f11e81990d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:23:58.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:23:58.808+0000 7f11edaa2640 1 -- 172.21.15.70:0/2299366781 >> 172.21.15.70:0/2299366781 conn(0x7f11e80794d0 msgr2=0x7f11e8104fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:23:58.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:23:58.808+0000 7f11edaa2640 1 -- 172.21.15.70:0/2299366781 shutdown_connections 2024-08-31T05:23:58.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:23:58.808+0000 7f11edaa2640 1 -- 172.21.15.70:0/2299366781 wait complete. 2024-08-31T05:23:59.454 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:59 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:23:59.455 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:59 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:59.455 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:23:59 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:59.487 DEBUG:teuthology.orchestra.run.smithi070:osd.5> sudo journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@osd.5.service 2024-08-31T05:23:59.489 INFO:tasks.cephadm:Deploying osd.6 on smithi005 with /dev/vg_nvme/lv_2... 2024-08-31T05:23:59.490 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-08-31T05:23:59.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:59 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:23:59.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:59 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:59.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:23:59 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:59.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:59 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:23:59.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:59 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:59.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:23:59 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:23:59.752 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:24:00.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:00 smithi005 ceph-mon[18602]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:24:00.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:00 smithi070 ceph-mon[22316]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:24:00.586 INFO:journalctl@ceph.osd.5.smithi070.stdout:Aug 31 05:24:00 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-5[35331]: 2024-08-31T05:24:00.405+0000 7efe0d996640 -1 osd.5 0 log_to_monitors true 2024-08-31T05:24:00.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:00 smithi050 ceph-mon[22146]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:24:01.553 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:01 smithi005 ceph-mon[18602]: from='osd.5 [v2:172.21.15.70:6808/311426299,v1:172.21.15.70:6809/311426299]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-31T05:24:01.554 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:01 smithi005 ceph-mon[18602]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-31T05:24:01.636 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:01 smithi070 ceph-mon[22316]: from='osd.5 [v2:172.21.15.70:6808/311426299,v1:172.21.15.70:6809/311426299]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-31T05:24:01.636 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:01 smithi070 ceph-mon[22316]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-31T05:24:01.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:01 smithi050 ceph-mon[22146]: from='osd.5 [v2:172.21.15.70:6808/311426299,v1:172.21.15.70:6809/311426299]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-31T05:24:01.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:01 smithi050 ceph-mon[22146]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-31T05:24:02.588 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:02 smithi070 ceph-mon[22316]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-31T05:24:02.588 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:02 smithi070 ceph-mon[22316]: osdmap e35: 6 total, 5 up, 6 in 2024-08-31T05:24:02.588 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:02 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T05:24:02.588 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:02 smithi070 ceph-mon[22316]: from='osd.5 [v2:172.21.15.70:6808/311426299,v1:172.21.15.70:6809/311426299]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-08-31T05:24:02.588 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:02 smithi070 ceph-mon[22316]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-08-31T05:24:02.588 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:02 smithi070 ceph-mon[22316]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:24:02.588 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:02 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:02.588 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:02 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:02.588 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:02 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T05:24:02.588 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:02 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T05:24:02.588 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:02 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:02.589 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:02 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:24:02.589 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:02 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:24:02.589 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:02 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:02.594 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:02 smithi005 ceph-mon[18602]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-31T05:24:02.594 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:02 smithi005 ceph-mon[18602]: osdmap e35: 6 total, 5 up, 6 in 2024-08-31T05:24:02.594 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:02 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T05:24:02.594 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:02 smithi005 ceph-mon[18602]: from='osd.5 [v2:172.21.15.70:6808/311426299,v1:172.21.15.70:6809/311426299]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-08-31T05:24:02.594 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:02 smithi005 ceph-mon[18602]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-08-31T05:24:02.594 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:02 smithi005 ceph-mon[18602]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:24:02.594 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:02 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:02.594 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:02 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:02.594 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:02 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T05:24:02.595 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:02 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T05:24:02.595 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:02 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:02.595 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:02 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:24:02.595 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:02 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:24:02.595 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:02 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:02.659 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:02 smithi050 ceph-mon[22146]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-31T05:24:02.660 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:02 smithi050 ceph-mon[22146]: osdmap e35: 6 total, 5 up, 6 in 2024-08-31T05:24:02.660 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:02 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T05:24:02.660 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:02 smithi050 ceph-mon[22146]: from='osd.5 [v2:172.21.15.70:6808/311426299,v1:172.21.15.70:6809/311426299]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-08-31T05:24:02.660 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:02 smithi050 ceph-mon[22146]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-08-31T05:24:02.660 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:02 smithi050 ceph-mon[22146]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:24:02.660 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:02 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:02.660 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:02 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:02.660 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:02 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T05:24:02.660 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:02 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T05:24:02.660 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:02 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:02.660 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:02 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:24:02.660 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:02 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:24:02.661 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:02 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:02.713 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:24:02.742 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi005:vg_nvme/lv_2 2024-08-31T05:24:03.001 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:24:03.085 INFO:journalctl@ceph.osd.5.smithi070.stdout:Aug 31 05:24:02 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-5[35331]: 2024-08-31T05:24:02.785+0000 7efe09918640 -1 osd.5 0 waiting for initial osdmap 2024-08-31T05:24:03.086 INFO:journalctl@ceph.osd.5.smithi070.stdout:Aug 31 05:24:02 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-5[35331]: 2024-08-31T05:24:02.792+0000 7efe0170e640 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T05:24:03.412 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:03 smithi005 ceph-mon[18602]: Detected new or changed devices on smithi070 2024-08-31T05:24:03.413 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:03 smithi005 ceph-mon[18602]: Adjusting osd_memory_target on smithi070 to 8544M 2024-08-31T05:24:03.413 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:03 smithi005 ceph-mon[18602]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-08-31T05:24:03.413 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:03 smithi005 ceph-mon[18602]: osdmap e36: 6 total, 5 up, 6 in 2024-08-31T05:24:03.413 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:03 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T05:24:03.413 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:03 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T05:24:03.413 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:03 smithi005 ceph-mon[18602]: from='osd.5 ' entity='osd.5' 2024-08-31T05:24:03.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:24:03.506+0000 7f30f0788640 1 -- 172.21.15.5:0/3356443510 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30e8102f00 msgr2=0x7f30e8103310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:03.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:24:03.506+0000 7f30f0788640 1 --2- 172.21.15.5:0/3356443510 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30e8102f00 0x7f30e8103310 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f30d8009900 tx=0x7f30d802a410 comp rx=0 tx=0).stop 2024-08-31T05:24:03.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:24:03.506+0000 7f30f0788640 1 -- 172.21.15.5:0/3356443510 shutdown_connections 2024-08-31T05:24:03.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:24:03.506+0000 7f30f0788640 1 --2- 172.21.15.5:0/3356443510 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30e8105860 0x7f30e810f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:03.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:24:03.506+0000 7f30f0788640 1 --2- 172.21.15.5:0/3356443510 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30e8104f10 0x7f30e8105320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:03.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:24:03.506+0000 7f30f0788640 1 --2- 172.21.15.5:0/3356443510 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30e8102f00 0x7f30e8103310 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:03.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:24:03.506+0000 7f30f0788640 1 -- 172.21.15.5:0/3356443510 >> 172.21.15.5:0/3356443510 conn(0x7f30e8077a00 msgr2=0x7f30e8077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:24:03.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:24:03.506+0000 7f30f0788640 1 -- 172.21.15.5:0/3356443510 shutdown_connections 2024-08-31T05:24:03.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:24:03.506+0000 7f30f0788640 1 -- 172.21.15.5:0/3356443510 wait complete. 2024-08-31T05:24:03.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:24:03.507+0000 7f30f0788640 1 Processor -- start 2024-08-31T05:24:03.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:24:03.507+0000 7f30f0788640 1 -- start start 2024-08-31T05:24:03.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:24:03.507+0000 7f30f0788640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30e8102f00 0x7f30e81991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:24:03.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:24:03.507+0000 7f30f0788640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30e8104f10 0x7f30e8199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:24:03.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:24:03.507+0000 7f30f0788640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30e8105860 0x7f30e819e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:24:03.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:24:03.507+0000 7f30f0788640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f30e8112770 con 0x7f30e8104f10 2024-08-31T05:24:03.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:24:03.507+0000 7f30f0788640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f30e81125f0 con 0x7f30e8102f00 2024-08-31T05:24:03.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:24:03.507+0000 7f30f0788640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f30e81128f0 con 0x7f30e8105860 2024-08-31T05:24:03.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:24:03.508+0000 7f30edd23640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30e8104f10 0x7f30e8199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:24:03.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:24:03.508+0000 7f30edd23640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30e8104f10 0x7f30e8199740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55234/0 (socket says 172.21.15.5:55234) 2024-08-31T05:24:03.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:24:03.508+0000 7f30edd23640 1 -- 172.21.15.5:0/1676233277 learned_addr learned my addr 172.21.15.5:0/1676233277 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:24:03.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:24:03.508+0000 7f30ee524640 1 --2- 172.21.15.5:0/1676233277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30e8102f00 0x7f30e81991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:24:03.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:24:03.508+0000 7f30eed25640 1 --2- 172.21.15.5:0/1676233277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30e8105860 0x7f30e819e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:24:03.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:24:03.508+0000 7f30edd23640 1 -- 172.21.15.5:0/1676233277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30e8105860 msgr2=0x7f30e819e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:03.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:24:03.508+0000 7f30edd23640 1 --2- 172.21.15.5:0/1676233277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30e8105860 0x7f30e819e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:03.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:24:03.508+0000 7f30edd23640 1 -- 172.21.15.5:0/1676233277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30e8102f00 msgr2=0x7f30e81991a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:03.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:24:03.508+0000 7f30edd23640 1 --2- 172.21.15.5:0/1676233277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30e8102f00 0x7f30e81991a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:03.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:24:03.508+0000 7f30edd23640 1 -- 172.21.15.5:0/1676233277 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30e819f050 con 0x7f30e8104f10 2024-08-31T05:24:03.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:24:03.508+0000 7f30edd23640 1 --2- 172.21.15.5:0/1676233277 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30e8104f10 0x7f30e8199740 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f30e400e9c0 tx=0x7f30e400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:24:03.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:24:03.508+0000 7f30df7fe640 1 -- 172.21.15.5:0/1676233277 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e400ccc0 con 0x7f30e8104f10 2024-08-31T05:24:03.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:24:03.508+0000 7f30df7fe640 1 -- 172.21.15.5:0/1676233277 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30e40054d0 con 0x7f30e8104f10 2024-08-31T05:24:03.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:24:03.508+0000 7f30f0788640 1 -- 172.21.15.5:0/1676233277 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30e819f340 con 0x7f30e8104f10 2024-08-31T05:24:03.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:24:03.508+0000 7f30df7fe640 1 -- 172.21.15.5:0/1676233277 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e4010430 con 0x7f30e8104f10 2024-08-31T05:24:03.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:24:03.509+0000 7f30f0788640 1 -- 172.21.15.5:0/1676233277 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30e81a5b60 con 0x7f30e8104f10 2024-08-31T05:24:03.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:24:03.510+0000 7f30f0788640 1 -- 172.21.15.5:0/1676233277 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30e8103310 con 0x7f30e8104f10 2024-08-31T05:24:03.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:24:03.511+0000 7f30df7fe640 1 -- 172.21.15.5:0/1676233277 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f30e4005020 con 0x7f30e8104f10 2024-08-31T05:24:03.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:24:03.512+0000 7f30df7fe640 1 --2- 172.21.15.5:0/1676233277 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f30d40b4bb0 0x7f30d40b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:24:03.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:24:03.512+0000 7f30ee524640 1 --2- 172.21.15.5:0/1676233277 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f30d40b4bb0 0x7f30d40b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:24:03.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:24:03.512+0000 7f30df7fe640 1 -- 172.21.15.5:0/1676233277 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4781+0+0 (secure 0 0 0) 0x7f30e40e48a0 con 0x7f30e8104f10 2024-08-31T05:24:03.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:24:03.513+0000 7f30ee524640 1 --2- 172.21.15.5:0/1676233277 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f30d40b4bb0 0x7f30d40b70c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f30d8031440 tx=0x7f30d8009560 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:24:03.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:24:03.515+0000 7f30df7fe640 1 -- 172.21.15.5:0/1676233277 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f30e4056130 con 0x7f30e8104f10 2024-08-31T05:24:03.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:03 smithi050 ceph-mon[22146]: Detected new or changed devices on smithi070 2024-08-31T05:24:03.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:03 smithi050 ceph-mon[22146]: Adjusting osd_memory_target on smithi070 to 8544M 2024-08-31T05:24:03.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:03 smithi050 ceph-mon[22146]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-08-31T05:24:03.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:03 smithi050 ceph-mon[22146]: osdmap e36: 6 total, 5 up, 6 in 2024-08-31T05:24:03.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:03 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T05:24:03.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:03 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T05:24:03.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:03 smithi050 ceph-mon[22146]: from='osd.5 ' entity='osd.5' 2024-08-31T05:24:03.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:24:03.727+0000 7f30f0788640 1 -- 172.21.15.5:0/1676233277 --> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f30e80635a0 con 0x7f30d40b4bb0 2024-08-31T05:24:03.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:03 smithi070 ceph-mon[22316]: Detected new or changed devices on smithi070 2024-08-31T05:24:03.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:03 smithi070 ceph-mon[22316]: Adjusting osd_memory_target on smithi070 to 8544M 2024-08-31T05:24:03.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:03 smithi070 ceph-mon[22316]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-08-31T05:24:03.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:03 smithi070 ceph-mon[22316]: osdmap e36: 6 total, 5 up, 6 in 2024-08-31T05:24:03.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:03 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T05:24:03.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:03 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T05:24:03.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:03 smithi070 ceph-mon[22316]: from='osd.5 ' entity='osd.5' 2024-08-31T05:24:04.390 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:04 smithi005 ceph-mon[18602]: purged_snaps scrub starts 2024-08-31T05:24:04.391 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:04 smithi005 ceph-mon[18602]: purged_snaps scrub ok 2024-08-31T05:24:04.391 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:04 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T05:24:04.391 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:04 smithi005 ceph-mon[18602]: osd.5 [v2:172.21.15.70:6808/311426299,v1:172.21.15.70:6809/311426299] boot 2024-08-31T05:24:04.391 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:04 smithi005 ceph-mon[18602]: osdmap e37: 6 total, 6 up, 6 in 2024-08-31T05:24:04.391 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:04 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T05:24:04.391 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:04 smithi005 ceph-mon[18602]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:24:04.391 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:04 smithi005 ceph-mon[18602]: from='client.14559 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:04.391 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:04 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:24:04.391 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:04 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:24:04.391 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:04 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:24:04.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:04 smithi050 ceph-mon[22146]: purged_snaps scrub starts 2024-08-31T05:24:04.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:04 smithi050 ceph-mon[22146]: purged_snaps scrub ok 2024-08-31T05:24:04.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:04 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T05:24:04.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:04 smithi050 ceph-mon[22146]: osd.5 [v2:172.21.15.70:6808/311426299,v1:172.21.15.70:6809/311426299] boot 2024-08-31T05:24:04.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:04 smithi050 ceph-mon[22146]: osdmap e37: 6 total, 6 up, 6 in 2024-08-31T05:24:04.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:04 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T05:24:04.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:04 smithi050 ceph-mon[22146]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:24:04.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:04 smithi050 ceph-mon[22146]: from='client.14559 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:04.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:04 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:24:04.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:04 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:24:04.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:04 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:24:04.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:04 smithi070 ceph-mon[22316]: purged_snaps scrub starts 2024-08-31T05:24:04.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:04 smithi070 ceph-mon[22316]: purged_snaps scrub ok 2024-08-31T05:24:04.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:04 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T05:24:04.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:04 smithi070 ceph-mon[22316]: osd.5 [v2:172.21.15.70:6808/311426299,v1:172.21.15.70:6809/311426299] boot 2024-08-31T05:24:04.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:04 smithi070 ceph-mon[22316]: osdmap e37: 6 total, 6 up, 6 in 2024-08-31T05:24:04.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:04 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T05:24:04.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:04 smithi070 ceph-mon[22316]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-08-31T05:24:04.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:04 smithi070 ceph-mon[22316]: from='client.14559 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:04.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:04 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:24:04.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:04 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:24:04.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:04 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:24:05.454 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:05 smithi005 ceph-mon[18602]: osdmap e38: 6 total, 6 up, 6 in 2024-08-31T05:24:05.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:05 smithi050 ceph-mon[22146]: osdmap e38: 6 total, 6 up, 6 in 2024-08-31T05:24:05.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:05 smithi070 ceph-mon[22316]: osdmap e38: 6 total, 6 up, 6 in 2024-08-31T05:24:06.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:06 smithi050 ceph-mon[22146]: osdmap e39: 6 total, 6 up, 6 in 2024-08-31T05:24:06.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:06 smithi050 ceph-mon[22146]: pgmap v121: 1 pgs: 1 peering; 577 KiB data, 201 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:24:06.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:06 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/3909098699' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "12486aa2-61e4-4bdf-94dd-ce5c4cd3df6e"} : dispatch 2024-08-31T05:24:06.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:06 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/3909098699' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "12486aa2-61e4-4bdf-94dd-ce5c4cd3df6e"}]': finished 2024-08-31T05:24:06.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:06 smithi050 ceph-mon[22146]: osdmap e40: 7 total, 6 up, 7 in 2024-08-31T05:24:06.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:06 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T05:24:06.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:06 smithi005 ceph-mon[18602]: osdmap e39: 6 total, 6 up, 6 in 2024-08-31T05:24:06.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:06 smithi005 ceph-mon[18602]: pgmap v121: 1 pgs: 1 peering; 577 KiB data, 201 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:24:06.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:06 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/3909098699' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "12486aa2-61e4-4bdf-94dd-ce5c4cd3df6e"} : dispatch 2024-08-31T05:24:06.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:06 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/3909098699' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "12486aa2-61e4-4bdf-94dd-ce5c4cd3df6e"}]': finished 2024-08-31T05:24:06.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:06 smithi005 ceph-mon[18602]: osdmap e40: 7 total, 6 up, 7 in 2024-08-31T05:24:06.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:06 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T05:24:06.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:06 smithi070 ceph-mon[22316]: osdmap e39: 6 total, 6 up, 6 in 2024-08-31T05:24:06.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:06 smithi070 ceph-mon[22316]: pgmap v121: 1 pgs: 1 peering; 577 KiB data, 201 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:24:06.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:06 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/3909098699' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "12486aa2-61e4-4bdf-94dd-ce5c4cd3df6e"} : dispatch 2024-08-31T05:24:06.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:06 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/3909098699' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "12486aa2-61e4-4bdf-94dd-ce5c4cd3df6e"}]': finished 2024-08-31T05:24:06.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:06 smithi070 ceph-mon[22316]: osdmap e40: 7 total, 6 up, 7 in 2024-08-31T05:24:06.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:06 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T05:24:07.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:07 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/4029852180' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:24:07.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:07 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/4029852180' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:24:07.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:07 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/4029852180' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:24:08.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:08 smithi050 ceph-mon[22146]: pgmap v123: 1 pgs: 1 peering; 577 KiB data, 201 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:24:08.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:08 smithi005 ceph-mon[18602]: pgmap v123: 1 pgs: 1 peering; 577 KiB data, 201 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:24:08.737 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:08 smithi070 ceph-mon[22316]: pgmap v123: 1 pgs: 1 peering; 577 KiB data, 201 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:24:10.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:10 smithi005 ceph-mon[18602]: pgmap v124: 1 pgs: 1 peering; 577 KiB data, 201 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:24:10.744 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:10 smithi050 ceph-mon[22146]: pgmap v124: 1 pgs: 1 peering; 577 KiB data, 201 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:24:10.835 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:10 smithi070 ceph-mon[22316]: pgmap v124: 1 pgs: 1 peering; 577 KiB data, 201 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:24:12.675 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:12 smithi005 ceph-mon[18602]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 536 GiB / 536 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-08-31T05:24:12.835 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:12 smithi070 ceph-mon[22316]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 536 GiB / 536 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-08-31T05:24:12.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:12 smithi050 ceph-mon[22146]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 536 GiB / 536 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-08-31T05:24:14.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:14 smithi005 ceph-mon[18602]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-31T05:24:14.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:14 smithi070 ceph-mon[22316]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-31T05:24:14.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:14 smithi050 ceph-mon[22146]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-31T05:24:15.707 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:15 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-08-31T05:24:15.707 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:15 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:24:15.707 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:15 smithi005 ceph-mon[18602]: Deploying daemon osd.6 on smithi005 2024-08-31T05:24:15.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:15 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-08-31T05:24:15.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:15 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:24:15.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:15 smithi070 ceph-mon[22316]: Deploying daemon osd.6 on smithi005 2024-08-31T05:24:15.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:15 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-08-31T05:24:15.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:15 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:24:15.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:15 smithi050 ceph-mon[22146]: Deploying daemon osd.6 on smithi005 2024-08-31T05:24:16.695 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:16 smithi005 ceph-mon[18602]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-31T05:24:16.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:16 smithi070 ceph-mon[22316]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-31T05:24:16.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:16 smithi050 ceph-mon[22146]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-31T05:24:18.690 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:18 smithi005 ceph-mon[18602]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-08-31T05:24:18.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:18 smithi070 ceph-mon[22316]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-08-31T05:24:18.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:18 smithi050 ceph-mon[22146]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-08-31T05:24:20.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:20 smithi005 ceph-mon[18602]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T05:24:20.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:20 smithi070 ceph-mon[22316]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T05:24:20.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:20 smithi050 ceph-mon[22146]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T05:24:21.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:21 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:24:21.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:21 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:21.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:21 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:21.695 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:21 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:24:21.695 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:21 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:21.695 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:21 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:21.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:21 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:24:21.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:21 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:21.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:21 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:22.676 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:22 smithi005 ceph-mon[18602]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T05:24:22.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:22 smithi050 ceph-mon[22146]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T05:24:23.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:22 smithi070 ceph-mon[22316]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T05:24:24.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:24:24.785+0000 7f30df7fe640 1 -- 172.21.15.5:0/1676233277 <== mgr.14220 v2:172.21.15.5:6800/2696053609 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f30e80635a0 con 0x7f30d40b4bb0 2024-08-31T05:24:24.787 INFO:teuthology.orchestra.run.smithi005.stdout:Created osd(s) 6 on host 'smithi005' 2024-08-31T05:24:24.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:24:24.788+0000 7f30f0788640 1 -- 172.21.15.5:0/1676233277 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f30d40b4bb0 msgr2=0x7f30d40b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:24.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:24:24.788+0000 7f30f0788640 1 --2- 172.21.15.5:0/1676233277 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f30d40b4bb0 0x7f30d40b70c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f30d8031440 tx=0x7f30d8009560 comp rx=0 tx=0).stop 2024-08-31T05:24:24.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:24:24.788+0000 7f30f0788640 1 -- 172.21.15.5:0/1676233277 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30e8104f10 msgr2=0x7f30e8199740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:24.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:24:24.788+0000 7f30f0788640 1 --2- 172.21.15.5:0/1676233277 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30e8104f10 0x7f30e8199740 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f30e400e9c0 tx=0x7f30e400ee80 comp rx=0 tx=0).stop 2024-08-31T05:24:24.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:24:24.788+0000 7f30f0788640 1 -- 172.21.15.5:0/1676233277 shutdown_connections 2024-08-31T05:24:24.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:24:24.788+0000 7f30f0788640 1 --2- 172.21.15.5:0/1676233277 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f30d40b4bb0 0x7f30d40b70c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:24.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:24:24.788+0000 7f30f0788640 1 --2- 172.21.15.5:0/1676233277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30e8105860 0x7f30e819e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:24.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:24:24.788+0000 7f30f0788640 1 --2- 172.21.15.5:0/1676233277 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30e8104f10 0x7f30e8199740 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:24.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:24:24.788+0000 7f30f0788640 1 --2- 172.21.15.5:0/1676233277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30e8102f00 0x7f30e81991a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:24.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:24:24.788+0000 7f30f0788640 1 -- 172.21.15.5:0/1676233277 >> 172.21.15.5:0/1676233277 conn(0x7f30e8077a00 msgr2=0x7f30e8106d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:24:24.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:24:24.788+0000 7f30f0788640 1 -- 172.21.15.5:0/1676233277 shutdown_connections 2024-08-31T05:24:24.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:24:24.788+0000 7f30f0788640 1 -- 172.21.15.5:0/1676233277 wait complete. 2024-08-31T05:24:24.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:24 smithi005 ceph-mon[18602]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:24:24.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:24 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:24.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:24 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:24.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:24 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:24:24.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:24 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:24:24.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:24 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:25.088 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:24 smithi070 ceph-mon[22316]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:24:25.088 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:24 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:25.088 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:24 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:25.088 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:24 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:24:25.089 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:24 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:24:25.089 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:24 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:25.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:24 smithi050 ceph-mon[22146]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:24:25.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:24 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:25.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:24 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:25.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:24 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:24:25.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:24 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:24:25.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:24 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:25.573 DEBUG:teuthology.orchestra.run.smithi005:osd.6> sudo journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@osd.6.service 2024-08-31T05:24:25.576 INFO:tasks.cephadm:Deploying osd.7 on smithi050 with /dev/vg_nvme/lv_2... 2024-08-31T05:24:25.576 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-08-31T05:24:25.839 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T05:24:25.895 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:25 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:24:25.895 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:25 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:25.895 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:25 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:25.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:25 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:24:25.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:25 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:25.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:25 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:26.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:25 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:24:26.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:25 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:26.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:25 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:26.217 INFO:journalctl@ceph.osd.6.smithi005.stdout:Aug 31 05:24:26 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-6[47562]: 2024-08-31T05:24:26.017+0000 7fe7a79b1640 -1 osd.6 0 log_to_monitors true 2024-08-31T05:24:27.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:26 smithi070 ceph-mon[22316]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:24:27.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:26 smithi070 ceph-mon[22316]: from='osd.6 [v2:172.21.15.5:6818/1027645612,v1:172.21.15.5:6819/1027645612]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-08-31T05:24:27.143 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:26 smithi005 ceph-mon[18602]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:24:27.143 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:26 smithi005 ceph-mon[18602]: from='osd.6 [v2:172.21.15.5:6818/1027645612,v1:172.21.15.5:6819/1027645612]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-08-31T05:24:27.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:26 smithi050 ceph-mon[22146]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:24:27.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:26 smithi050 ceph-mon[22146]: from='osd.6 [v2:172.21.15.5:6818/1027645612,v1:172.21.15.5:6819/1027645612]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-08-31T05:24:28.057 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:27 smithi050 ceph-mon[22146]: from='osd.6 [v2:172.21.15.5:6818/1027645612,v1:172.21.15.5:6819/1027645612]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-08-31T05:24:28.057 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:27 smithi050 ceph-mon[22146]: osdmap e41: 7 total, 6 up, 7 in 2024-08-31T05:24:28.057 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:27 smithi050 ceph-mon[22146]: from='osd.6 [v2:172.21.15.5:6818/1027645612,v1:172.21.15.5:6819/1027645612]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi005", "root=default"]} : dispatch 2024-08-31T05:24:28.057 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:27 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T05:24:28.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:27 smithi070 ceph-mon[22316]: from='osd.6 [v2:172.21.15.5:6818/1027645612,v1:172.21.15.5:6819/1027645612]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-08-31T05:24:28.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:27 smithi070 ceph-mon[22316]: osdmap e41: 7 total, 6 up, 7 in 2024-08-31T05:24:28.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:27 smithi070 ceph-mon[22316]: from='osd.6 [v2:172.21.15.5:6818/1027645612,v1:172.21.15.5:6819/1027645612]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi005", "root=default"]} : dispatch 2024-08-31T05:24:28.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:27 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T05:24:28.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:27 smithi005 ceph-mon[18602]: from='osd.6 [v2:172.21.15.5:6818/1027645612,v1:172.21.15.5:6819/1027645612]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-08-31T05:24:28.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:27 smithi005 ceph-mon[18602]: osdmap e41: 7 total, 6 up, 7 in 2024-08-31T05:24:28.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:27 smithi005 ceph-mon[18602]: from='osd.6 [v2:172.21.15.5:6818/1027645612,v1:172.21.15.5:6819/1027645612]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi005", "root=default"]} : dispatch 2024-08-31T05:24:28.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:27 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T05:24:28.218 INFO:journalctl@ceph.osd.6.smithi005.stdout:Aug 31 05:24:27 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-6[47562]: 2024-08-31T05:24:27.803+0000 7fe7a3933640 -1 osd.6 0 waiting for initial osdmap 2024-08-31T05:24:28.218 INFO:journalctl@ceph.osd.6.smithi005.stdout:Aug 31 05:24:27 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-6[47562]: 2024-08-31T05:24:27.813+0000 7fe79f731640 -1 osd.6 42 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T05:24:28.807 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T05:24:28.836 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi050:vg_nvme/lv_2 2024-08-31T05:24:29.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:28 smithi070 ceph-mon[22316]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:24:29.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:28 smithi070 ceph-mon[22316]: from='osd.6 [v2:172.21.15.5:6818/1027645612,v1:172.21.15.5:6819/1027645612]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-08-31T05:24:29.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:28 smithi070 ceph-mon[22316]: osdmap e42: 7 total, 6 up, 7 in 2024-08-31T05:24:29.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:28 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T05:24:29.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:28 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T05:24:29.095 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T05:24:29.156 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:28 smithi050 ceph-mon[22146]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:24:29.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:28 smithi050 ceph-mon[22146]: from='osd.6 [v2:172.21.15.5:6818/1027645612,v1:172.21.15.5:6819/1027645612]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-08-31T05:24:29.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:28 smithi050 ceph-mon[22146]: osdmap e42: 7 total, 6 up, 7 in 2024-08-31T05:24:29.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:28 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T05:24:29.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:28 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T05:24:29.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:28 smithi005 ceph-mon[18602]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 536 GiB / 536 GiB avail 2024-08-31T05:24:29.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:28 smithi005 ceph-mon[18602]: from='osd.6 [v2:172.21.15.5:6818/1027645612,v1:172.21.15.5:6819/1027645612]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-08-31T05:24:29.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:28 smithi005 ceph-mon[18602]: osdmap e42: 7 total, 6 up, 7 in 2024-08-31T05:24:29.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:28 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T05:24:29.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:28 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T05:24:29.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:24:29.592+0000 7f9cb8333640 1 -- 172.21.15.50:0/2427065524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cb0102820 msgr2=0x7f9cb0102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:29.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:24:29.592+0000 7f9cb8333640 1 --2- 172.21.15.50:0/2427065524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cb0102820 0x7f9cb0102c30 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0009900 tx=0x7f9ca002a410 comp rx=0 tx=0).stop 2024-08-31T05:24:29.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:24:29.592+0000 7f9cb8333640 1 -- 172.21.15.50:0/2427065524 shutdown_connections 2024-08-31T05:24:29.608 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:24:29.592+0000 7f9cb8333640 1 --2- 172.21.15.50:0/2427065524 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9cb0108ab0 0x7f9cb010f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:29.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:24:29.592+0000 7f9cb8333640 1 --2- 172.21.15.50:0/2427065524 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cb0108160 0x7f9cb0108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:29.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:24:29.592+0000 7f9cb8333640 1 --2- 172.21.15.50:0/2427065524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cb0102820 0x7f9cb0102c30 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:29.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:24:29.592+0000 7f9cb8333640 1 -- 172.21.15.50:0/2427065524 >> 172.21.15.50:0/2427065524 conn(0x7f9cb00794e0 msgr2=0x7f9cb00798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:24:29.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:24:29.592+0000 7f9cb8333640 1 -- 172.21.15.50:0/2427065524 shutdown_connections 2024-08-31T05:24:29.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:24:29.592+0000 7f9cb8333640 1 -- 172.21.15.50:0/2427065524 wait complete. 2024-08-31T05:24:29.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:24:29.593+0000 7f9cb8333640 1 Processor -- start 2024-08-31T05:24:29.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:24:29.593+0000 7f9cb8333640 1 -- start start 2024-08-31T05:24:29.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:24:29.593+0000 7f9cb8333640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9cb0102820 0x7f9cb019b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:24:29.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:24:29.593+0000 7f9cb8333640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cb0108160 0x7f9cb019b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:24:29.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:24:29.593+0000 7f9cb8333640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cb0108ab0 0x7f9cb019bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:24:29.609 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:24:29.593+0000 7f9cb8333640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb0112730 con 0x7f9cb0108160 2024-08-31T05:24:29.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:24:29.593+0000 7f9cb8333640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb01125b0 con 0x7f9cb0108ab0 2024-08-31T05:24:29.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:24:29.593+0000 7f9cb8333640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb01128b0 con 0x7f9cb0102820 2024-08-31T05:24:29.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:24:29.593+0000 7f9cb68d0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cb0108ab0 0x7f9cb019bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:24:29.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:24:29.593+0000 7f9cb68d0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cb0108ab0 0x7f9cb019bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:58116/0 (socket says 172.21.15.50:58116) 2024-08-31T05:24:29.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:24:29.593+0000 7f9cb68d0640 1 -- 172.21.15.50:0/4163581261 learned_addr learned my addr 172.21.15.50:0/4163581261 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T05:24:29.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:24:29.593+0000 7f9cb60cf640 1 --2- 172.21.15.50:0/4163581261 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9cb0102820 0x7f9cb019b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:24:29.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:24:29.593+0000 7f9cb58ce640 1 --2- 172.21.15.50:0/4163581261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cb0108160 0x7f9cb019b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:24:29.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:24:29.593+0000 7f9cb68d0640 1 -- 172.21.15.50:0/4163581261 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9cb0102820 msgr2=0x7f9cb019b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:29.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:24:29.593+0000 7f9cb68d0640 1 --2- 172.21.15.50:0/4163581261 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9cb0102820 0x7f9cb019b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:29.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:24:29.593+0000 7f9cb68d0640 1 -- 172.21.15.50:0/4163581261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cb0108160 msgr2=0x7f9cb019b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:29.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:24:29.593+0000 7f9cb68d0640 1 --2- 172.21.15.50:0/4163581261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cb0108160 0x7f9cb019b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:29.610 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:24:29.593+0000 7f9cb68d0640 1 -- 172.21.15.50:0/4163581261 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cb01a62f0 con 0x7f9cb0108ab0 2024-08-31T05:24:29.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:24:29.593+0000 7f9cb68d0640 1 --2- 172.21.15.50:0/4163581261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cb0108ab0 0x7f9cb019bae0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9ca800cad0 tx=0x7f9ca800cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:24:29.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:24:29.594+0000 7f9ca77fe640 1 -- 172.21.15.50:0/4163581261 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca800ae20 con 0x7f9cb0108ab0 2024-08-31T05:24:29.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:24:29.594+0000 7f9cb8333640 1 -- 172.21.15.50:0/4163581261 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cb01a65e0 con 0x7f9cb0108ab0 2024-08-31T05:24:29.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:24:29.594+0000 7f9ca77fe640 1 -- 172.21.15.50:0/4163581261 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ca8005020 con 0x7f9cb0108ab0 2024-08-31T05:24:29.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:24:29.594+0000 7f9ca77fe640 1 -- 172.21.15.50:0/4163581261 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca800f6b0 con 0x7f9cb0108ab0 2024-08-31T05:24:29.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:24:29.594+0000 7f9cb8333640 1 -- 172.21.15.50:0/4163581261 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cb01a6b20 con 0x7f9cb0108ab0 2024-08-31T05:24:29.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:24:29.595+0000 7f9cb8333640 1 -- 172.21.15.50:0/4163581261 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cb0103aa0 con 0x7f9cb0108ab0 2024-08-31T05:24:29.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:24:29.596+0000 7f9ca77fe640 1 -- 172.21.15.50:0/4163581261 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f9ca80051d0 con 0x7f9cb0108ab0 2024-08-31T05:24:29.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:24:29.597+0000 7f9ca77fe640 1 --2- 172.21.15.50:0/4163581261 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9c9c0b4bb0 0x7f9c9c0b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:24:29.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:24:29.597+0000 7f9cb60cf640 1 --2- 172.21.15.50:0/4163581261 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9c9c0b4bb0 0x7f9c9c0b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:24:29.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:24:29.597+0000 7f9ca77fe640 1 -- 172.21.15.50:0/4163581261 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5180+0+0 (secure 0 0 0) 0x7f9ca80e4a80 con 0x7f9cb0108ab0 2024-08-31T05:24:29.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:24:29.598+0000 7f9cb60cf640 1 --2- 172.21.15.50:0/4163581261 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9c9c0b4bb0 0x7f9c9c0b70c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0000c00 tx=0x7f9ca0031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:24:29.611 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:24:29.601+0000 7f9ca77fe640 1 -- 172.21.15.50:0/4163581261 <== mon.2 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f9ca8014030 con 0x7f9cb0108ab0 2024-08-31T05:24:29.799 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:24:29.798+0000 7f9cb8333640 1 -- 172.21.15.50:0/4163581261 --> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f9cb00635a0 con 0x7f9c9c0b4bb0 2024-08-31T05:24:30.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:29 smithi070 ceph-mon[22316]: purged_snaps scrub starts 2024-08-31T05:24:30.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:29 smithi070 ceph-mon[22316]: purged_snaps scrub ok 2024-08-31T05:24:30.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:29 smithi070 ceph-mon[22316]: Detected new or changed devices on smithi005 2024-08-31T05:24:30.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:29 smithi070 ceph-mon[22316]: osd.6 [v2:172.21.15.5:6818/1027645612,v1:172.21.15.5:6819/1027645612] boot 2024-08-31T05:24:30.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:29 smithi070 ceph-mon[22316]: osdmap e43: 7 total, 7 up, 7 in 2024-08-31T05:24:30.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:29 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T05:24:30.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:29 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:30.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:29 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:30.087 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:29 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T05:24:30.087 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:29 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T05:24:30.087 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:29 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T05:24:30.087 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:29 smithi070 ceph-mon[22316]: Adjusting osd_memory_target on smithi005 to 5697M 2024-08-31T05:24:30.087 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:29 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:30.087 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:29 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:24:30.087 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:29 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:24:30.087 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:29 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:30.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:29 smithi050 ceph-mon[22146]: purged_snaps scrub starts 2024-08-31T05:24:30.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:29 smithi050 ceph-mon[22146]: purged_snaps scrub ok 2024-08-31T05:24:30.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:29 smithi050 ceph-mon[22146]: Detected new or changed devices on smithi005 2024-08-31T05:24:30.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:29 smithi050 ceph-mon[22146]: osd.6 [v2:172.21.15.5:6818/1027645612,v1:172.21.15.5:6819/1027645612] boot 2024-08-31T05:24:30.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:29 smithi050 ceph-mon[22146]: osdmap e43: 7 total, 7 up, 7 in 2024-08-31T05:24:30.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:29 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T05:24:30.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:29 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:30.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:29 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:30.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:29 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T05:24:30.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:29 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T05:24:30.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:29 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T05:24:30.158 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:29 smithi050 ceph-mon[22146]: Adjusting osd_memory_target on smithi005 to 5697M 2024-08-31T05:24:30.158 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:29 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:30.158 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:29 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:24:30.158 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:29 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:24:30.158 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:29 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:30.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:29 smithi005 ceph-mon[18602]: purged_snaps scrub starts 2024-08-31T05:24:30.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:29 smithi005 ceph-mon[18602]: purged_snaps scrub ok 2024-08-31T05:24:30.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:29 smithi005 ceph-mon[18602]: Detected new or changed devices on smithi005 2024-08-31T05:24:30.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:29 smithi005 ceph-mon[18602]: osd.6 [v2:172.21.15.5:6818/1027645612,v1:172.21.15.5:6819/1027645612] boot 2024-08-31T05:24:30.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:29 smithi005 ceph-mon[18602]: osdmap e43: 7 total, 7 up, 7 in 2024-08-31T05:24:30.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:29 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T05:24:30.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:29 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:30.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:29 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:30.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:29 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T05:24:30.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:29 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T05:24:30.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:29 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T05:24:30.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:29 smithi005 ceph-mon[18602]: Adjusting osd_memory_target on smithi005 to 5697M 2024-08-31T05:24:30.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:29 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:30.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:29 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:24:30.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:29 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:24:30.219 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:29 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:30.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:30 smithi050 ceph-mon[22146]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:24:30.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:30 smithi050 ceph-mon[22146]: from='client.24410 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:30.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:30 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:24:30.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:30 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:24:30.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:30 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:24:30.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:30 smithi050 ceph-mon[22146]: osdmap e44: 7 total, 7 up, 7 in 2024-08-31T05:24:31.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:30 smithi070 ceph-mon[22316]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:24:31.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:30 smithi070 ceph-mon[22316]: from='client.24410 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:31.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:30 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:24:31.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:30 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:24:31.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:30 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:24:31.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:30 smithi070 ceph-mon[22316]: osdmap e44: 7 total, 7 up, 7 in 2024-08-31T05:24:31.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:30 smithi005 ceph-mon[18602]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:24:31.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:30 smithi005 ceph-mon[18602]: from='client.24410 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:31.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:30 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:24:31.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:30 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:24:31.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:30 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:24:31.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:30 smithi005 ceph-mon[18602]: osdmap e44: 7 total, 7 up, 7 in 2024-08-31T05:24:32.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:32 smithi050 ceph-mon[22146]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:24:32.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:32 smithi050 ceph-mon[22146]: from='client.? 172.21.15.50:0/1824868780' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "66f9dcf9-d5c3-4016-812f-d9496e9892d5"} : dispatch 2024-08-31T05:24:32.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:32 smithi050 ceph-mon[22146]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "66f9dcf9-d5c3-4016-812f-d9496e9892d5"} : dispatch 2024-08-31T05:24:32.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:32 smithi050 ceph-mon[22146]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "66f9dcf9-d5c3-4016-812f-d9496e9892d5"}]': finished 2024-08-31T05:24:32.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:32 smithi050 ceph-mon[22146]: osdmap e45: 8 total, 7 up, 8 in 2024-08-31T05:24:32.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:32 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T05:24:33.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:32 smithi070 ceph-mon[22316]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:24:33.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:32 smithi070 ceph-mon[22316]: from='client.? 172.21.15.50:0/1824868780' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "66f9dcf9-d5c3-4016-812f-d9496e9892d5"} : dispatch 2024-08-31T05:24:33.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:32 smithi070 ceph-mon[22316]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "66f9dcf9-d5c3-4016-812f-d9496e9892d5"} : dispatch 2024-08-31T05:24:33.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:32 smithi070 ceph-mon[22316]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "66f9dcf9-d5c3-4016-812f-d9496e9892d5"}]': finished 2024-08-31T05:24:33.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:32 smithi070 ceph-mon[22316]: osdmap e45: 8 total, 7 up, 8 in 2024-08-31T05:24:33.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:32 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T05:24:33.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:32 smithi005 ceph-mon[18602]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:24:33.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:32 smithi005 ceph-mon[18602]: from='client.? 172.21.15.50:0/1824868780' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "66f9dcf9-d5c3-4016-812f-d9496e9892d5"} : dispatch 2024-08-31T05:24:33.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:32 smithi005 ceph-mon[18602]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "66f9dcf9-d5c3-4016-812f-d9496e9892d5"} : dispatch 2024-08-31T05:24:33.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:32 smithi005 ceph-mon[18602]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "66f9dcf9-d5c3-4016-812f-d9496e9892d5"}]': finished 2024-08-31T05:24:33.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:32 smithi005 ceph-mon[18602]: osdmap e45: 8 total, 7 up, 8 in 2024-08-31T05:24:33.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:32 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T05:24:34.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:33 smithi070 ceph-mon[22316]: from='client.? 172.21.15.50:0/2795709377' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:24:34.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:33 smithi050 ceph-mon[22146]: from='client.? 172.21.15.50:0/2795709377' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:24:34.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:33 smithi005 ceph-mon[18602]: from='client.? 172.21.15.50:0/2795709377' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:24:35.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:34 smithi070 ceph-mon[22316]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:24:35.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:34 smithi050 ceph-mon[22146]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:24:35.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:34 smithi005 ceph-mon[18602]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:24:37.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:36 smithi070 ceph-mon[22316]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:24:37.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:36 smithi050 ceph-mon[22146]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:24:37.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:36 smithi005 ceph-mon[18602]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:24:39.005 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:38 smithi050 ceph-mon[22146]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:24:39.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:38 smithi070 ceph-mon[22316]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:24:39.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:38 smithi005 ceph-mon[18602]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:24:41.084 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:40 smithi050 ceph-mon[22146]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:24:41.085 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:40 smithi070 ceph-mon[22316]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:24:41.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:40 smithi005 ceph-mon[18602]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:24:42.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:41 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-08-31T05:24:42.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:41 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:24:42.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:41 smithi070 ceph-mon[22316]: Deploying daemon osd.7 on smithi050 2024-08-31T05:24:42.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:41 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-08-31T05:24:42.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:41 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:24:42.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:41 smithi050 ceph-mon[22146]: Deploying daemon osd.7 on smithi050 2024-08-31T05:24:42.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:41 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-08-31T05:24:42.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:41 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:24:42.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:41 smithi005 ceph-mon[18602]: Deploying daemon osd.7 on smithi050 2024-08-31T05:24:43.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:42 smithi070 ceph-mon[22316]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:24:43.132 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:42 smithi050 ceph-mon[22146]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:24:43.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:42 smithi005 ceph-mon[18602]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:24:45.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:44 smithi070 ceph-mon[22316]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:24:45.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:44 smithi050 ceph-mon[22146]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:24:45.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:44 smithi005 ceph-mon[18602]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:24:47.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:46 smithi050 ceph-mon[22146]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:24:47.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:46 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:24:47.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:46 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:47.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:46 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:47.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:46 smithi005 ceph-mon[18602]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:24:47.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:46 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:24:47.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:46 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:47.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:46 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:47.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:46 smithi070 ceph-mon[22316]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:24:47.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:46 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:24:47.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:46 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:47.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:46 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:48.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:48 smithi050 ceph-mon[22146]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:24:49.219 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:48 smithi005 ceph-mon[18602]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:24:49.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:48 smithi070 ceph-mon[22316]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:24:50.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:50 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:50.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:50 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:50.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:50 smithi050 ceph-mon[22146]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:24:50.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:50 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:24:50.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:50 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:24:50.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:50 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:50.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:50 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:50.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:50 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:50.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:50 smithi070 ceph-mon[22316]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:24:50.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:50 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:24:50.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:50 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:24:50.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:50 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:50.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:50 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:50.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:50 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:50.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:50 smithi005 ceph-mon[18602]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:24:50.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:50 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:24:50.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:50 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:24:50.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:50 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:50.801 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:24:50.799+0000 7f9ca77fe640 1 -- 172.21.15.50:0/4163581261 <== mgr.14220 v2:172.21.15.5:6800/2696053609 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9cb00635a0 con 0x7f9c9c0b4bb0 2024-08-31T05:24:50.801 INFO:teuthology.orchestra.run.smithi050.stdout:Created osd(s) 7 on host 'smithi050' 2024-08-31T05:24:50.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:24:50.801+0000 7f9cb8333640 1 -- 172.21.15.50:0/4163581261 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9c9c0b4bb0 msgr2=0x7f9c9c0b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:50.803 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:24:50.801+0000 7f9cb8333640 1 --2- 172.21.15.50:0/4163581261 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9c9c0b4bb0 0x7f9c9c0b70c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0000c00 tx=0x7f9ca0031400 comp rx=0 tx=0).stop 2024-08-31T05:24:50.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:24:50.801+0000 7f9cb8333640 1 -- 172.21.15.50:0/4163581261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cb0108ab0 msgr2=0x7f9cb019bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:50.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:24:50.801+0000 7f9cb8333640 1 --2- 172.21.15.50:0/4163581261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cb0108ab0 0x7f9cb019bae0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9ca800cad0 tx=0x7f9ca800cf90 comp rx=0 tx=0).stop 2024-08-31T05:24:50.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:24:50.801+0000 7f9cb8333640 1 -- 172.21.15.50:0/4163581261 shutdown_connections 2024-08-31T05:24:50.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:24:50.801+0000 7f9cb8333640 1 --2- 172.21.15.50:0/4163581261 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9c9c0b4bb0 0x7f9c9c0b70c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:50.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:24:50.801+0000 7f9cb8333640 1 --2- 172.21.15.50:0/4163581261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9cb0108ab0 0x7f9cb019bae0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:50.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:24:50.801+0000 7f9cb8333640 1 --2- 172.21.15.50:0/4163581261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9cb0108160 0x7f9cb019b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:50.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:24:50.801+0000 7f9cb8333640 1 --2- 172.21.15.50:0/4163581261 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9cb0102820 0x7f9cb019b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:50.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:24:50.801+0000 7f9cb8333640 1 -- 172.21.15.50:0/4163581261 >> 172.21.15.50:0/4163581261 conn(0x7f9cb00794e0 msgr2=0x7f9cb0101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:24:50.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:24:50.802+0000 7f9cb8333640 1 -- 172.21.15.50:0/4163581261 shutdown_connections 2024-08-31T05:24:50.804 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:24:50.802+0000 7f9cb8333640 1 -- 172.21.15.50:0/4163581261 wait complete. 2024-08-31T05:24:51.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:51 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:24:51.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:51 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:51.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:51 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:51.517 DEBUG:teuthology.orchestra.run.smithi050:osd.7> sudo journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@osd.7.service 2024-08-31T05:24:51.519 INFO:tasks.cephadm:Deploying osd.8 on smithi070 with /dev/vg_nvme/lv_2... 2024-08-31T05:24:51.519 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-08-31T05:24:51.619 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:51 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:24:51.619 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:51 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:51.619 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:51 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:51.770 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T05:24:51.835 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:51 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:24:51.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:51 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:51.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:51 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:52.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:52 smithi070 ceph-mon[22316]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:24:52.644 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:52 smithi050 ceph-mon[22146]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:24:52.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:52 smithi005 ceph-mon[18602]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:24:52.907 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:24:52 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:24:52.642+0000 7ffba75f2640 -1 osd.7 0 log_to_monitors true 2024-08-31T05:24:53.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:53 smithi070 ceph-mon[22316]: from='osd.7 [v2:172.21.15.50:6816/2718354517,v1:172.21.15.50:6817/2718354517]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-31T05:24:53.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:53 smithi050 ceph-mon[22146]: from='osd.7 [v2:172.21.15.50:6816/2718354517,v1:172.21.15.50:6817/2718354517]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-31T05:24:53.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:53 smithi005 ceph-mon[18602]: from='osd.7 [v2:172.21.15.50:6816/2718354517,v1:172.21.15.50:6817/2718354517]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-31T05:24:54.493 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:54 smithi070 ceph-mon[22316]: from='osd.7 [v2:172.21.15.50:6816/2718354517,v1:172.21.15.50:6817/2718354517]' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-08-31T05:24:54.493 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:54 smithi070 ceph-mon[22316]: osdmap e46: 8 total, 7 up, 8 in 2024-08-31T05:24:54.494 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:54 smithi070 ceph-mon[22316]: from='osd.7 [v2:172.21.15.50:6816/2718354517,v1:172.21.15.50:6817/2718354517]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T05:24:54.494 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:54 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T05:24:54.494 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:54 smithi070 ceph-mon[22316]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:24:54.497 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-08-31T05:24:54.524 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi070:vg_nvme/lv_2 2024-08-31T05:24:54.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:54 smithi050 ceph-mon[22146]: from='osd.7 [v2:172.21.15.50:6816/2718354517,v1:172.21.15.50:6817/2718354517]' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-08-31T05:24:54.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:54 smithi050 ceph-mon[22146]: osdmap e46: 8 total, 7 up, 8 in 2024-08-31T05:24:54.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:54 smithi050 ceph-mon[22146]: from='osd.7 [v2:172.21.15.50:6816/2718354517,v1:172.21.15.50:6817/2718354517]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T05:24:54.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:54 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T05:24:54.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:54 smithi050 ceph-mon[22146]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:24:54.658 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:24:54 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:24:54.357+0000 7ffba3574640 -1 osd.7 0 waiting for initial osdmap 2024-08-31T05:24:54.658 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:24:54 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:24:54.367+0000 7ffb9f372640 -1 osd.7 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T05:24:54.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:54 smithi005 ceph-mon[18602]: from='osd.7 [v2:172.21.15.50:6816/2718354517,v1:172.21.15.50:6817/2718354517]' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-08-31T05:24:54.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:54 smithi005 ceph-mon[18602]: osdmap e46: 8 total, 7 up, 8 in 2024-08-31T05:24:54.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:54 smithi005 ceph-mon[18602]: from='osd.7 [v2:172.21.15.50:6816/2718354517,v1:172.21.15.50:6817/2718354517]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T05:24:54.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:54 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T05:24:54.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:54 smithi005 ceph-mon[18602]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-08-31T05:24:54.774 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T05:24:55.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:24:55.241+0000 7faa62d0c640 1 -- 172.21.15.70:0/2920644453 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa5c102800 msgr2=0x7faa5c102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:55.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:24:55.241+0000 7faa62d0c640 1 --2- 172.21.15.70:0/2920644453 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa5c102800 0x7faa5c102c10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7faa50009900 tx=0x7faa5002a410 comp rx=0 tx=0).stop 2024-08-31T05:24:55.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:24:55.241+0000 7faa62d0c640 1 -- 172.21.15.70:0/2920644453 shutdown_connections 2024-08-31T05:24:55.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:24:55.241+0000 7faa62d0c640 1 --2- 172.21.15.70:0/2920644453 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa5c108a90 0x7faa5c10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:55.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:24:55.241+0000 7faa62d0c640 1 --2- 172.21.15.70:0/2920644453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa5c108140 0x7faa5c108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:55.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:24:55.241+0000 7faa62d0c640 1 --2- 172.21.15.70:0/2920644453 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa5c102800 0x7faa5c102c10 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:55.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:24:55.241+0000 7faa62d0c640 1 -- 172.21.15.70:0/2920644453 >> 172.21.15.70:0/2920644453 conn(0x7faa5c0794d0 msgr2=0x7faa5c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:24:55.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:24:55.241+0000 7faa62d0c640 1 -- 172.21.15.70:0/2920644453 shutdown_connections 2024-08-31T05:24:55.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:24:55.241+0000 7faa62d0c640 1 -- 172.21.15.70:0/2920644453 wait complete. 2024-08-31T05:24:55.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:24:55.242+0000 7faa62d0c640 1 Processor -- start 2024-08-31T05:24:55.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:24:55.242+0000 7faa62d0c640 1 -- start start 2024-08-31T05:24:55.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:24:55.242+0000 7faa62d0c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa5c102800 0x7faa5c198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:24:55.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:24:55.242+0000 7faa62d0c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa5c108140 0x7faa5c1993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:24:55.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:24:55.242+0000 7faa62d0c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa5c108a90 0x7faa5c199930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:24:55.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:24:55.242+0000 7faa62d0c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7faa5c1126f0 con 0x7faa5c108a90 2024-08-31T05:24:55.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:24:55.242+0000 7faa62d0c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7faa5c112570 con 0x7faa5c102800 2024-08-31T05:24:55.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:24:55.242+0000 7faa62d0c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7faa5c112870 con 0x7faa5c108140 2024-08-31T05:24:55.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:24:55.243+0000 7faa5bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa5c108140 0x7faa5c1993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:24:55.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:24:55.243+0000 7faa5bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa5c108140 0x7faa5c1993f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60058/0 (socket says 172.21.15.70:60058) 2024-08-31T05:24:55.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:24:55.243+0000 7faa5bfff640 1 -- 172.21.15.70:0/2682677196 learned_addr learned my addr 172.21.15.70:0/2682677196 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-08-31T05:24:55.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:24:55.243+0000 7faa60aa8640 1 --2- 172.21.15.70:0/2682677196 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa5c102800 0x7faa5c198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:24:55.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:24:55.243+0000 7faa612a9640 1 --2- 172.21.15.70:0/2682677196 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa5c108a90 0x7faa5c199930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:24:55.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:24:55.243+0000 7faa5bfff640 1 -- 172.21.15.70:0/2682677196 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa5c102800 msgr2=0x7faa5c198eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:55.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:24:55.243+0000 7faa5bfff640 1 --2- 172.21.15.70:0/2682677196 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa5c102800 0x7faa5c198eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:55.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:24:55.243+0000 7faa5bfff640 1 -- 172.21.15.70:0/2682677196 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa5c108a90 msgr2=0x7faa5c199930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:24:55.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:24:55.243+0000 7faa5bfff640 1 --2- 172.21.15.70:0/2682677196 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa5c108a90 0x7faa5c199930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:24:55.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:24:55.243+0000 7faa5bfff640 1 -- 172.21.15.70:0/2682677196 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa5c1a8560 con 0x7faa5c108140 2024-08-31T05:24:55.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:24:55.243+0000 7faa5bfff640 1 --2- 172.21.15.70:0/2682677196 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa5c108140 0x7faa5c1993f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7faa4800d770 tx=0x7faa4800dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:24:55.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:24:55.243+0000 7faa59ffb640 1 -- 172.21.15.70:0/2682677196 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa48017070 con 0x7faa5c108140 2024-08-31T05:24:55.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:24:55.243+0000 7faa59ffb640 1 -- 172.21.15.70:0/2682677196 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa48009c30 con 0x7faa5c108140 2024-08-31T05:24:55.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:24:55.243+0000 7faa62d0c640 1 -- 172.21.15.70:0/2682677196 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa5c1a8850 con 0x7faa5c108140 2024-08-31T05:24:55.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:24:55.243+0000 7faa59ffb640 1 -- 172.21.15.70:0/2682677196 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa4800f620 con 0x7faa5c108140 2024-08-31T05:24:55.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:24:55.244+0000 7faa62d0c640 1 -- 172.21.15.70:0/2682677196 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa5c1a8d90 con 0x7faa5c108140 2024-08-31T05:24:55.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:24:55.245+0000 7faa62d0c640 1 -- 172.21.15.70:0/2682677196 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa5c102c10 con 0x7faa5c108140 2024-08-31T05:24:55.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:24:55.246+0000 7faa59ffb640 1 -- 172.21.15.70:0/2682677196 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7faa4801a070 con 0x7faa5c108140 2024-08-31T05:24:55.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:24:55.247+0000 7faa59ffb640 1 --2- 172.21.15.70:0/2682677196 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7faa4c0b4b80 0x7faa4c0b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:24:55.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:24:55.247+0000 7faa59ffb640 1 -- 172.21.15.70:0/2682677196 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5645+0+0 (secure 0 0 0) 0x7faa480e42f0 con 0x7faa5c108140 2024-08-31T05:24:55.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:24:55.247+0000 7faa60aa8640 1 --2- 172.21.15.70:0/2682677196 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7faa4c0b4b80 0x7faa4c0b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:24:55.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:24:55.248+0000 7faa60aa8640 1 --2- 172.21.15.70:0/2682677196 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7faa4c0b4b80 0x7faa4c0b7090 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7faa50000c00 tx=0x7faa50031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:24:55.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:24:55.250+0000 7faa59ffb640 1 -- 172.21.15.70:0/2682677196 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7faa48009de0 con 0x7faa5c108140 2024-08-31T05:24:55.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:24:55.446+0000 7faa62d0c640 1 -- 172.21.15.70:0/2682677196 --> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7faa5c0635a0 con 0x7faa4c0b4b80 2024-08-31T05:24:55.449 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:55 smithi070 ceph-mon[22316]: from='osd.7 [v2:172.21.15.50:6816/2718354517,v1:172.21.15.50:6817/2718354517]' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-08-31T05:24:55.449 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:55 smithi070 ceph-mon[22316]: osdmap e47: 8 total, 7 up, 8 in 2024-08-31T05:24:55.449 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:55 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T05:24:55.449 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:55 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T05:24:55.449 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:55 smithi070 ceph-mon[22316]: Detected new or changed devices on smithi050 2024-08-31T05:24:55.449 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:55 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:55.449 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:55 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:55.449 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:55 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T05:24:55.449 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:55 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T05:24:55.449 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:55 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T05:24:55.449 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:55 smithi070 ceph-mon[22316]: Adjusting osd_memory_target on smithi050 to 5697M 2024-08-31T05:24:55.449 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:55 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:55.450 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:55 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:24:55.450 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:55 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:24:55.450 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:55 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:55.450 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:55 smithi070 ceph-mon[22316]: osd.7 [v2:172.21.15.50:6816/2718354517,v1:172.21.15.50:6817/2718354517] boot 2024-08-31T05:24:55.450 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:55 smithi070 ceph-mon[22316]: osdmap e48: 8 total, 8 up, 8 in 2024-08-31T05:24:55.450 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:55 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T05:24:55.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:55 smithi050 ceph-mon[22146]: from='osd.7 [v2:172.21.15.50:6816/2718354517,v1:172.21.15.50:6817/2718354517]' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-08-31T05:24:55.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:55 smithi050 ceph-mon[22146]: osdmap e47: 8 total, 7 up, 8 in 2024-08-31T05:24:55.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:55 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T05:24:55.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:55 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T05:24:55.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:55 smithi050 ceph-mon[22146]: Detected new or changed devices on smithi050 2024-08-31T05:24:55.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:55 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:55.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:55 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:55.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:55 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T05:24:55.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:55 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T05:24:55.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:55 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T05:24:55.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:55 smithi050 ceph-mon[22146]: Adjusting osd_memory_target on smithi050 to 5697M 2024-08-31T05:24:55.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:55 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:55.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:55 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:24:55.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:55 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:24:55.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:55 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:55.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:55 smithi050 ceph-mon[22146]: osd.7 [v2:172.21.15.50:6816/2718354517,v1:172.21.15.50:6817/2718354517] boot 2024-08-31T05:24:55.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:55 smithi050 ceph-mon[22146]: osdmap e48: 8 total, 8 up, 8 in 2024-08-31T05:24:55.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:55 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T05:24:55.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:55 smithi005 ceph-mon[18602]: from='osd.7 [v2:172.21.15.50:6816/2718354517,v1:172.21.15.50:6817/2718354517]' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-08-31T05:24:55.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:55 smithi005 ceph-mon[18602]: osdmap e47: 8 total, 7 up, 8 in 2024-08-31T05:24:55.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:55 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T05:24:55.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:55 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T05:24:55.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:55 smithi005 ceph-mon[18602]: Detected new or changed devices on smithi050 2024-08-31T05:24:55.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:55 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:55.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:55 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:55.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:55 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T05:24:55.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:55 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T05:24:55.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:55 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T05:24:55.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:55 smithi005 ceph-mon[18602]: Adjusting osd_memory_target on smithi050 to 5697M 2024-08-31T05:24:55.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:55 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:55.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:55 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:24:55.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:55 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:24:55.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:55 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:24:55.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:55 smithi005 ceph-mon[18602]: osd.7 [v2:172.21.15.50:6816/2718354517,v1:172.21.15.50:6817/2718354517] boot 2024-08-31T05:24:55.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:55 smithi005 ceph-mon[18602]: osdmap e48: 8 total, 8 up, 8 in 2024-08-31T05:24:55.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:55 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T05:24:56.579 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:56 smithi070 ceph-mon[22316]: purged_snaps scrub starts 2024-08-31T05:24:56.580 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:56 smithi070 ceph-mon[22316]: purged_snaps scrub ok 2024-08-31T05:24:56.580 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:56 smithi070 ceph-mon[22316]: pgmap v155: 1 pgs: 1 unknown; 577 KiB data, 255 MiB used, 715 GiB / 715 GiB avail 2024-08-31T05:24:56.580 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:56 smithi070 ceph-mon[22316]: from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:56.580 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:56 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:24:56.580 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:56 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:24:56.580 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:56 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:24:56.580 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:56 smithi070 ceph-mon[22316]: osdmap e49: 8 total, 8 up, 8 in 2024-08-31T05:24:56.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:56 smithi050 ceph-mon[22146]: purged_snaps scrub starts 2024-08-31T05:24:56.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:56 smithi050 ceph-mon[22146]: purged_snaps scrub ok 2024-08-31T05:24:56.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:56 smithi050 ceph-mon[22146]: pgmap v155: 1 pgs: 1 unknown; 577 KiB data, 255 MiB used, 715 GiB / 715 GiB avail 2024-08-31T05:24:56.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:56 smithi050 ceph-mon[22146]: from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:56.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:56 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:24:56.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:56 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:24:56.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:56 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:24:56.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:56 smithi050 ceph-mon[22146]: osdmap e49: 8 total, 8 up, 8 in 2024-08-31T05:24:56.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:56 smithi005 ceph-mon[18602]: purged_snaps scrub starts 2024-08-31T05:24:56.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:56 smithi005 ceph-mon[18602]: purged_snaps scrub ok 2024-08-31T05:24:56.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:56 smithi005 ceph-mon[18602]: pgmap v155: 1 pgs: 1 unknown; 577 KiB data, 255 MiB used, 715 GiB / 715 GiB avail 2024-08-31T05:24:56.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:56 smithi005 ceph-mon[18602]: from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:24:56.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:56 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:24:56.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:56 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:24:56.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:56 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:24:56.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:56 smithi005 ceph-mon[18602]: osdmap e49: 8 total, 8 up, 8 in 2024-08-31T05:24:57.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:57 smithi005 ceph-mon[18602]: osdmap e50: 8 total, 8 up, 8 in 2024-08-31T05:24:58.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:57 smithi070 ceph-mon[22316]: osdmap e50: 8 total, 8 up, 8 in 2024-08-31T05:24:58.156 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:57 smithi050 ceph-mon[22146]: osdmap e50: 8 total, 8 up, 8 in 2024-08-31T05:24:58.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:58 smithi070 ceph-mon[22316]: pgmap v158: 1 pgs: 1 unknown; 577 KiB data, 255 MiB used, 715 GiB / 715 GiB avail 2024-08-31T05:24:58.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:58 smithi070 ceph-mon[22316]: from='client.? 172.21.15.70:0/3322329661' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "584837f9-af4b-4189-a7e5-04156a94a805"} : dispatch 2024-08-31T05:24:58.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:58 smithi070 ceph-mon[22316]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "584837f9-af4b-4189-a7e5-04156a94a805"} : dispatch 2024-08-31T05:24:58.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:58 smithi070 ceph-mon[22316]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "584837f9-af4b-4189-a7e5-04156a94a805"}]': finished 2024-08-31T05:24:58.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:58 smithi070 ceph-mon[22316]: osdmap e51: 9 total, 8 up, 9 in 2024-08-31T05:24:58.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:58 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T05:24:58.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:24:58 smithi070 ceph-mon[22316]: from='client.? 172.21.15.70:0/2333452341' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:24:58.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:58 smithi005 ceph-mon[18602]: pgmap v158: 1 pgs: 1 unknown; 577 KiB data, 255 MiB used, 715 GiB / 715 GiB avail 2024-08-31T05:24:58.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:58 smithi005 ceph-mon[18602]: from='client.? 172.21.15.70:0/3322329661' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "584837f9-af4b-4189-a7e5-04156a94a805"} : dispatch 2024-08-31T05:24:58.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:58 smithi005 ceph-mon[18602]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "584837f9-af4b-4189-a7e5-04156a94a805"} : dispatch 2024-08-31T05:24:58.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:58 smithi005 ceph-mon[18602]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "584837f9-af4b-4189-a7e5-04156a94a805"}]': finished 2024-08-31T05:24:58.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:58 smithi005 ceph-mon[18602]: osdmap e51: 9 total, 8 up, 9 in 2024-08-31T05:24:58.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:58 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T05:24:58.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:24:58 smithi005 ceph-mon[18602]: from='client.? 172.21.15.70:0/2333452341' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:24:59.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:58 smithi050 ceph-mon[22146]: pgmap v158: 1 pgs: 1 unknown; 577 KiB data, 255 MiB used, 715 GiB / 715 GiB avail 2024-08-31T05:24:59.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:58 smithi050 ceph-mon[22146]: from='client.? 172.21.15.70:0/3322329661' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "584837f9-af4b-4189-a7e5-04156a94a805"} : dispatch 2024-08-31T05:24:59.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:58 smithi050 ceph-mon[22146]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "584837f9-af4b-4189-a7e5-04156a94a805"} : dispatch 2024-08-31T05:24:59.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:58 smithi050 ceph-mon[22146]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "584837f9-af4b-4189-a7e5-04156a94a805"}]': finished 2024-08-31T05:24:59.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:58 smithi050 ceph-mon[22146]: osdmap e51: 9 total, 8 up, 9 in 2024-08-31T05:24:59.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:58 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T05:24:59.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:24:58 smithi050 ceph-mon[22146]: from='client.? 172.21.15.70:0/2333452341' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:25:00.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:00 smithi005 ceph-mon[18602]: pgmap v160: 1 pgs: 1 unknown; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-08-31T05:25:01.085 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:00 smithi070 ceph-mon[22316]: pgmap v160: 1 pgs: 1 unknown; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-08-31T05:25:01.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:00 smithi050 ceph-mon[22146]: pgmap v160: 1 pgs: 1 unknown; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-08-31T05:25:02.964 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:02 smithi005 ceph-mon[18602]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 192 KiB/s, 0 objects/s recovering 2024-08-31T05:25:03.085 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:02 smithi070 ceph-mon[22316]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 192 KiB/s, 0 objects/s recovering 2024-08-31T05:25:03.156 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:02 smithi050 ceph-mon[22146]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 192 KiB/s, 0 objects/s recovering 2024-08-31T05:25:04.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:04 smithi070 ceph-mon[22316]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 149 KiB/s, 0 objects/s recovering 2024-08-31T05:25:04.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:04 smithi005 ceph-mon[18602]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 149 KiB/s, 0 objects/s recovering 2024-08-31T05:25:05.156 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:04 smithi050 ceph-mon[22146]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 149 KiB/s, 0 objects/s recovering 2024-08-31T05:25:06.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:06 smithi005 ceph-mon[18602]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 132 KiB/s, 0 objects/s recovering 2024-08-31T05:25:07.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:06 smithi070 ceph-mon[22316]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 132 KiB/s, 0 objects/s recovering 2024-08-31T05:25:07.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:06 smithi050 ceph-mon[22146]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 132 KiB/s, 0 objects/s recovering 2024-08-31T05:25:07.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:07 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-08-31T05:25:07.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:07 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:25:07.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:07 smithi070 ceph-mon[22316]: Deploying daemon osd.8 on smithi070 2024-08-31T05:25:07.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:07 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-08-31T05:25:07.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:07 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:25:07.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:07 smithi005 ceph-mon[18602]: Deploying daemon osd.8 on smithi070 2024-08-31T05:25:08.156 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:07 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-08-31T05:25:08.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:07 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:25:08.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:07 smithi050 ceph-mon[22146]: Deploying daemon osd.8 on smithi070 2024-08-31T05:25:08.752 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:08 smithi070 ceph-mon[22316]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-08-31T05:25:08.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:08 smithi005 ceph-mon[18602]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-08-31T05:25:09.156 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:08 smithi050 ceph-mon[22146]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-08-31T05:25:10.896 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:10 smithi070 ceph-mon[22316]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-08-31T05:25:10.959 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:10 smithi050 ceph-mon[22146]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-08-31T05:25:10.966 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:10 smithi005 ceph-mon[18602]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-08-31T05:25:12.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:12 smithi005 ceph-mon[18602]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-31T05:25:12.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:12 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:25:12.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:12 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:12.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:12 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:12.997 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:12 smithi070 ceph-mon[22316]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-31T05:25:12.998 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:12 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:25:12.998 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:12 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:12.998 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:12 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:13.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:12 smithi050 ceph-mon[22146]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-31T05:25:13.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:12 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:25:13.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:12 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:13.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:12 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:14.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:14 smithi005 ceph-mon[18602]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-08-31T05:25:15.062 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:14 smithi070 ceph-mon[22316]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-08-31T05:25:15.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:14 smithi050 ceph-mon[22146]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-08-31T05:25:16.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:25:16.225+0000 7faa59ffb640 1 -- 172.21.15.70:0/2682677196 <== mgr.14220 v2:172.21.15.5:6800/2696053609 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7faa5c0635a0 con 0x7faa4c0b4b80 2024-08-31T05:25:16.227 INFO:teuthology.orchestra.run.smithi070.stdout:Created osd(s) 8 on host 'smithi070' 2024-08-31T05:25:16.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:25:16.228+0000 7faa62d0c640 1 -- 172.21.15.70:0/2682677196 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7faa4c0b4b80 msgr2=0x7faa4c0b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:16.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:25:16.228+0000 7faa62d0c640 1 --2- 172.21.15.70:0/2682677196 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7faa4c0b4b80 0x7faa4c0b7090 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7faa50000c00 tx=0x7faa50031400 comp rx=0 tx=0).stop 2024-08-31T05:25:16.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:25:16.228+0000 7faa62d0c640 1 -- 172.21.15.70:0/2682677196 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa5c108140 msgr2=0x7faa5c1993f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:16.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:25:16.228+0000 7faa62d0c640 1 --2- 172.21.15.70:0/2682677196 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa5c108140 0x7faa5c1993f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7faa4800d770 tx=0x7faa4800dc30 comp rx=0 tx=0).stop 2024-08-31T05:25:16.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:25:16.228+0000 7faa62d0c640 1 -- 172.21.15.70:0/2682677196 shutdown_connections 2024-08-31T05:25:16.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:25:16.228+0000 7faa62d0c640 1 --2- 172.21.15.70:0/2682677196 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7faa4c0b4b80 0x7faa4c0b7090 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:16.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:25:16.228+0000 7faa62d0c640 1 --2- 172.21.15.70:0/2682677196 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa5c108a90 0x7faa5c199930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:16.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:25:16.228+0000 7faa62d0c640 1 --2- 172.21.15.70:0/2682677196 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa5c108140 0x7faa5c1993f0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:16.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:25:16.228+0000 7faa62d0c640 1 --2- 172.21.15.70:0/2682677196 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa5c102800 0x7faa5c198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:16.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:25:16.228+0000 7faa62d0c640 1 -- 172.21.15.70:0/2682677196 >> 172.21.15.70:0/2682677196 conn(0x7faa5c0794d0 msgr2=0x7faa5c101250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:25:16.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:25:16.228+0000 7faa62d0c640 1 -- 172.21.15.70:0/2682677196 shutdown_connections 2024-08-31T05:25:16.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:25:16.228+0000 7faa62d0c640 1 -- 172.21.15.70:0/2682677196 wait complete. 2024-08-31T05:25:16.907 DEBUG:teuthology.orchestra.run.smithi070:osd.8> sudo journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@osd.8.service 2024-08-31T05:25:16.910 INFO:tasks.cephadm:Deploying osd.9 on smithi005 with /dev/vg_nvme/lv_1... 2024-08-31T05:25:16.910 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-08-31T05:25:17.177 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:25:17.522 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:17 smithi070 ceph-mon[22316]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-08-31T05:25:17.522 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:17 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:17.522 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:17 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:17.522 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:17 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:17.522 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:17 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:17.542 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:17 smithi005 ceph-mon[18602]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-08-31T05:25:17.542 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:17 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:17.542 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:17 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:17.542 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:17 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:17.542 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:17 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:17.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:17 smithi050 ceph-mon[22146]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-08-31T05:25:17.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:17 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:17.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:17 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:17.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:17 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:17.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:17 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:18.731 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:25:18 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:25:18.388+0000 7f1af9e3d640 -1 osd.8 0 log_to_monitors true 2024-08-31T05:25:19.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:19 smithi005 ceph-mon[18602]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-08-31T05:25:19.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:19 smithi005 ceph-mon[18602]: from='osd.8 [v2:172.21.15.70:6816/3155722993,v1:172.21.15.70:6817/3155722993]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-31T05:25:19.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:19 smithi005 ceph-mon[18602]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-31T05:25:19.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:19 smithi070 ceph-mon[22316]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-08-31T05:25:19.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:19 smithi070 ceph-mon[22316]: from='osd.8 [v2:172.21.15.70:6816/3155722993,v1:172.21.15.70:6817/3155722993]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-31T05:25:19.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:19 smithi070 ceph-mon[22316]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-31T05:25:19.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:19 smithi050 ceph-mon[22146]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-08-31T05:25:19.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:19 smithi050 ceph-mon[22146]: from='osd.8 [v2:172.21.15.70:6816/3155722993,v1:172.21.15.70:6817/3155722993]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-31T05:25:19.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:19 smithi050 ceph-mon[22146]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-31T05:25:20.076 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:25:20.101 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi005:vg_nvme/lv_1 2024-08-31T05:25:20.368 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:25:20.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:20 smithi005 ceph-mon[18602]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-08-31T05:25:20.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:20 smithi005 ceph-mon[18602]: osdmap e52: 9 total, 8 up, 9 in 2024-08-31T05:25:20.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:20 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T05:25:20.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:20 smithi005 ceph-mon[18602]: from='osd.8 [v2:172.21.15.70:6816/3155722993,v1:172.21.15.70:6817/3155722993]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-08-31T05:25:20.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:20 smithi005 ceph-mon[18602]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-08-31T05:25:20.586 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:25:20 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:25:20.236+0000 7f1af5dbf640 -1 osd.8 0 waiting for initial osdmap 2024-08-31T05:25:20.586 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:25:20 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:25:20.247+0000 7f1af1bbd640 -1 osd.8 53 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T05:25:20.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:20 smithi070 ceph-mon[22316]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-08-31T05:25:20.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:20 smithi070 ceph-mon[22316]: osdmap e52: 9 total, 8 up, 9 in 2024-08-31T05:25:20.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:20 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T05:25:20.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:20 smithi070 ceph-mon[22316]: from='osd.8 [v2:172.21.15.70:6816/3155722993,v1:172.21.15.70:6817/3155722993]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-08-31T05:25:20.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:20 smithi070 ceph-mon[22316]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-08-31T05:25:20.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:20 smithi050 ceph-mon[22146]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-08-31T05:25:20.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:20 smithi050 ceph-mon[22146]: osdmap e52: 9 total, 8 up, 9 in 2024-08-31T05:25:20.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:20 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T05:25:20.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:20 smithi050 ceph-mon[22146]: from='osd.8 [v2:172.21.15.70:6816/3155722993,v1:172.21.15.70:6817/3155722993]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-08-31T05:25:20.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:20 smithi050 ceph-mon[22146]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-08-31T05:25:20.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:25:20.819+0000 7f99aa2fb640 1 -- 172.21.15.5:0/3533443197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a4102880 msgr2=0x7f99a4102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:20.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:25:20.819+0000 7f99aa2fb640 1 --2- 172.21.15.5:0/3533443197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a4102880 0x7f99a4102c90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9994009900 tx=0x7f999402a410 comp rx=0 tx=0).stop 2024-08-31T05:25:20.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:25:20.819+0000 7f99aa2fb640 1 -- 172.21.15.5:0/3533443197 shutdown_connections 2024-08-31T05:25:20.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:25:20.819+0000 7f99aa2fb640 1 --2- 172.21.15.5:0/3533443197 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99a4108ac0 0x7f99a410f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:20.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:25:20.819+0000 7f99aa2fb640 1 --2- 172.21.15.5:0/3533443197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99a4108170 0x7f99a4108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:20.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:25:20.819+0000 7f99aa2fb640 1 --2- 172.21.15.5:0/3533443197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a4102880 0x7f99a4102c90 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:20.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:25:20.819+0000 7f99aa2fb640 1 -- 172.21.15.5:0/3533443197 >> 172.21.15.5:0/3533443197 conn(0x7f99a4079550 msgr2=0x7f99a4079960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:25:20.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:25:20.819+0000 7f99aa2fb640 1 -- 172.21.15.5:0/3533443197 shutdown_connections 2024-08-31T05:25:20.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:25:20.819+0000 7f99aa2fb640 1 -- 172.21.15.5:0/3533443197 wait complete. 2024-08-31T05:25:20.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:25:20.820+0000 7f99aa2fb640 1 Processor -- start 2024-08-31T05:25:20.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:25:20.820+0000 7f99aa2fb640 1 -- start start 2024-08-31T05:25:20.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:25:20.820+0000 7f99aa2fb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99a4102880 0x7f99a419b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:20.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:25:20.820+0000 7f99aa2fb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a4108170 0x7f99a419b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:20.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:25:20.820+0000 7f99aa2fb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99a4108ac0 0x7f99a419bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:20.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:25:20.820+0000 7f99aa2fb640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f99a4112770 con 0x7f99a4108170 2024-08-31T05:25:20.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:25:20.820+0000 7f99aa2fb640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f99a41125f0 con 0x7f99a4108ac0 2024-08-31T05:25:20.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:25:20.820+0000 7f99aa2fb640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f99a41128f0 con 0x7f99a4102880 2024-08-31T05:25:20.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:25:20.820+0000 7f99a37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a4108170 0x7f99a419b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:20.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:25:20.820+0000 7f99a37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a4108170 0x7f99a419b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39454/0 (socket says 172.21.15.5:39454) 2024-08-31T05:25:20.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:25:20.820+0000 7f99a37fe640 1 -- 172.21.15.5:0/2753483545 learned_addr learned my addr 172.21.15.5:0/2753483545 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:25:20.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:25:20.820+0000 7f99a8898640 1 --2- 172.21.15.5:0/2753483545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99a4108ac0 0x7f99a419bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:20.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:25:20.821+0000 7f99a3fff640 1 --2- 172.21.15.5:0/2753483545 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99a4102880 0x7f99a419b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:20.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:25:20.821+0000 7f99a37fe640 1 -- 172.21.15.5:0/2753483545 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99a4102880 msgr2=0x7f99a419b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:20.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:25:20.821+0000 7f99a37fe640 1 --2- 172.21.15.5:0/2753483545 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99a4102880 0x7f99a419b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:20.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:25:20.821+0000 7f99a37fe640 1 -- 172.21.15.5:0/2753483545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99a4108ac0 msgr2=0x7f99a419bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:20.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:25:20.821+0000 7f99a37fe640 1 --2- 172.21.15.5:0/2753483545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99a4108ac0 0x7f99a419bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:20.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:25:20.821+0000 7f99a37fe640 1 -- 172.21.15.5:0/2753483545 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99a41a6410 con 0x7f99a4108170 2024-08-31T05:25:20.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:25:20.821+0000 7f99a37fe640 1 --2- 172.21.15.5:0/2753483545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a4108170 0x7f99a419b6c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f999800d740 tx=0x7f999800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:25:20.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:25:20.821+0000 7f99a17fa640 1 -- 172.21.15.5:0/2753483545 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9998017070 con 0x7f99a4108170 2024-08-31T05:25:20.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:25:20.821+0000 7f99aa2fb640 1 -- 172.21.15.5:0/2753483545 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99a41a6700 con 0x7f99a4108170 2024-08-31T05:25:20.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:25:20.821+0000 7f99a17fa640 1 -- 172.21.15.5:0/2753483545 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f999800de50 con 0x7f99a4108170 2024-08-31T05:25:20.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:25:20.821+0000 7f99a17fa640 1 -- 172.21.15.5:0/2753483545 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f999800f620 con 0x7f99a4108170 2024-08-31T05:25:20.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:25:20.821+0000 7f99aa2fb640 1 -- 172.21.15.5:0/2753483545 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99a41a6c40 con 0x7f99a4108170 2024-08-31T05:25:20.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:25:20.822+0000 7f99aa2fb640 1 -- 172.21.15.5:0/2753483545 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99a4102c90 con 0x7f99a4108170 2024-08-31T05:25:20.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:25:20.824+0000 7f99a17fa640 1 -- 172.21.15.5:0/2753483545 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f999801a070 con 0x7f99a4108170 2024-08-31T05:25:20.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:25:20.825+0000 7f99a17fa640 1 --2- 172.21.15.5:0/2753483545 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f998c0b4bb0 0x7f998c0b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:20.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:25:20.825+0000 7f99a17fa640 1 -- 172.21.15.5:0/2753483545 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5764+0+0 (secure 0 0 0) 0x7f99980e4070 con 0x7f99a4108170 2024-08-31T05:25:20.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:25:20.825+0000 7f99a3fff640 1 --2- 172.21.15.5:0/2753483545 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f998c0b4bb0 0x7f998c0b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:20.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:25:20.825+0000 7f99a3fff640 1 --2- 172.21.15.5:0/2753483545 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f998c0b4bb0 0x7f998c0b70c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9994000c00 tx=0x7f9994031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:25:20.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:25:20.829+0000 7f99a17fa640 1 -- 172.21.15.5:0/2753483545 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f99980ab540 con 0x7f99a4108170 2024-08-31T05:25:21.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:25:21.029+0000 7f99aa2fb640 1 -- 172.21.15.5:0/2753483545 --> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f99a40635a0 con 0x7f998c0b4bb0 2024-08-31T05:25:21.577 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:21 smithi005 ceph-mon[18602]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-08-31T05:25:21.577 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:21 smithi005 ceph-mon[18602]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-08-31T05:25:21.578 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:21 smithi005 ceph-mon[18602]: osdmap e53: 9 total, 8 up, 9 in 2024-08-31T05:25:21.578 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:21 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T05:25:21.578 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:21 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T05:25:21.578 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:21 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:21.578 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:21 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:21.578 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:21 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T05:25:21.578 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:21 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T05:25:21.578 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:21 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T05:25:21.578 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:21 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:21.578 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:21 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:25:21.578 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:21 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:25:21.578 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:21 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:21.578 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:21 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:25:21.578 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:21 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:25:21.579 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:21 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:25:21.579 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:21 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:21.579 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:21 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:25:21.579 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:21 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:25:21.579 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:21 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:25:21.579 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:21 smithi005 ceph-mon[18602]: osd.8 [v2:172.21.15.70:6816/3155722993,v1:172.21.15.70:6817/3155722993] boot 2024-08-31T05:25:21.579 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:21 smithi005 ceph-mon[18602]: osdmap e54: 9 total, 9 up, 9 in 2024-08-31T05:25:21.579 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:21 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T05:25:21.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:21 smithi070 ceph-mon[22316]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-08-31T05:25:21.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:21 smithi070 ceph-mon[22316]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-08-31T05:25:21.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:21 smithi070 ceph-mon[22316]: osdmap e53: 9 total, 8 up, 9 in 2024-08-31T05:25:21.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:21 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T05:25:21.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:21 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T05:25:21.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:21 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:21.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:21 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:21.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:21 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T05:25:21.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:21 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T05:25:21.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:21 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T05:25:21.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:21 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:21.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:21 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:25:21.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:21 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:25:21.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:21 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:21.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:21 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:25:21.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:21 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:25:21.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:21 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:25:21.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:21 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:21.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:21 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:25:21.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:21 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:25:21.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:21 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:25:21.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:21 smithi070 ceph-mon[22316]: osd.8 [v2:172.21.15.70:6816/3155722993,v1:172.21.15.70:6817/3155722993] boot 2024-08-31T05:25:21.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:21 smithi070 ceph-mon[22316]: osdmap e54: 9 total, 9 up, 9 in 2024-08-31T05:25:21.588 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:21 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T05:25:21.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:21 smithi050 ceph-mon[22146]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-08-31T05:25:21.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:21 smithi050 ceph-mon[22146]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-08-31T05:25:21.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:21 smithi050 ceph-mon[22146]: osdmap e53: 9 total, 8 up, 9 in 2024-08-31T05:25:21.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:21 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T05:25:21.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:21 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T05:25:21.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:21 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:21.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:21 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:21.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:21 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T05:25:21.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:21 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T05:25:21.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:21 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T05:25:21.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:21 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:21.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:21 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:25:21.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:21 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:25:21.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:21 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:21.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:21 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:25:21.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:21 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:25:21.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:21 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:25:21.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:21 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:21.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:21 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:25:21.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:21 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:25:21.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:21 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:25:21.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:21 smithi050 ceph-mon[22146]: osd.8 [v2:172.21.15.70:6816/3155722993,v1:172.21.15.70:6817/3155722993] boot 2024-08-31T05:25:21.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:21 smithi050 ceph-mon[22146]: osdmap e54: 9 total, 9 up, 9 in 2024-08-31T05:25:21.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:21 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T05:25:22.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:22 smithi005 ceph-mon[18602]: purged_snaps scrub starts 2024-08-31T05:25:22.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:22 smithi005 ceph-mon[18602]: purged_snaps scrub ok 2024-08-31T05:25:22.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:22 smithi005 ceph-mon[18602]: Detected new or changed devices on smithi070 2024-08-31T05:25:22.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:22 smithi005 ceph-mon[18602]: Adjusting osd_memory_target on smithi070 to 5696M 2024-08-31T05:25:22.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:22 smithi005 ceph-mon[18602]: from='client.14619 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:25:22.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:22 smithi005 ceph-mon[18602]: osdmap e55: 9 total, 9 up, 9 in 2024-08-31T05:25:22.585 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:22 smithi070 ceph-mon[22316]: purged_snaps scrub starts 2024-08-31T05:25:22.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:22 smithi070 ceph-mon[22316]: purged_snaps scrub ok 2024-08-31T05:25:22.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:22 smithi070 ceph-mon[22316]: Detected new or changed devices on smithi070 2024-08-31T05:25:22.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:22 smithi070 ceph-mon[22316]: Adjusting osd_memory_target on smithi070 to 5696M 2024-08-31T05:25:22.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:22 smithi070 ceph-mon[22316]: from='client.14619 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:25:22.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:22 smithi070 ceph-mon[22316]: osdmap e55: 9 total, 9 up, 9 in 2024-08-31T05:25:22.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:22 smithi050 ceph-mon[22146]: purged_snaps scrub starts 2024-08-31T05:25:22.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:22 smithi050 ceph-mon[22146]: purged_snaps scrub ok 2024-08-31T05:25:22.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:22 smithi050 ceph-mon[22146]: Detected new or changed devices on smithi070 2024-08-31T05:25:22.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:22 smithi050 ceph-mon[22146]: Adjusting osd_memory_target on smithi070 to 5696M 2024-08-31T05:25:22.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:22 smithi050 ceph-mon[22146]: from='client.14619 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:25:22.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:22 smithi050 ceph-mon[22146]: osdmap e55: 9 total, 9 up, 9 in 2024-08-31T05:25:23.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:23 smithi070 ceph-mon[22316]: pgmap v174: 1 pgs: 1 peering; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-08-31T05:25:23.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:23 smithi050 ceph-mon[22146]: pgmap v174: 1 pgs: 1 peering; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-08-31T05:25:23.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:23 smithi005 ceph-mon[18602]: pgmap v174: 1 pgs: 1 peering; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-08-31T05:25:24.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:24 smithi070 ceph-mon[22316]: osdmap e56: 9 total, 9 up, 9 in 2024-08-31T05:25:24.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:24 smithi070 ceph-mon[22316]: pgmap v177: 1 pgs: 1 peering; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-08-31T05:25:24.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:24 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/1431210088' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ef60de6e-3456-435c-bd48-ed2636cc0d7f"} : dispatch 2024-08-31T05:25:24.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:24 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/1431210088' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ef60de6e-3456-435c-bd48-ed2636cc0d7f"}]': finished 2024-08-31T05:25:24.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:24 smithi070 ceph-mon[22316]: osdmap e57: 10 total, 9 up, 10 in 2024-08-31T05:25:24.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:24 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T05:25:24.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:24 smithi050 ceph-mon[22146]: osdmap e56: 9 total, 9 up, 9 in 2024-08-31T05:25:24.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:24 smithi050 ceph-mon[22146]: pgmap v177: 1 pgs: 1 peering; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-08-31T05:25:24.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:24 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/1431210088' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ef60de6e-3456-435c-bd48-ed2636cc0d7f"} : dispatch 2024-08-31T05:25:24.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:24 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/1431210088' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ef60de6e-3456-435c-bd48-ed2636cc0d7f"}]': finished 2024-08-31T05:25:24.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:24 smithi050 ceph-mon[22146]: osdmap e57: 10 total, 9 up, 10 in 2024-08-31T05:25:24.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:24 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T05:25:24.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:24 smithi005 ceph-mon[18602]: osdmap e56: 9 total, 9 up, 9 in 2024-08-31T05:25:24.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:24 smithi005 ceph-mon[18602]: pgmap v177: 1 pgs: 1 peering; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-08-31T05:25:24.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:24 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/1431210088' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ef60de6e-3456-435c-bd48-ed2636cc0d7f"} : dispatch 2024-08-31T05:25:24.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:24 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/1431210088' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ef60de6e-3456-435c-bd48-ed2636cc0d7f"}]': finished 2024-08-31T05:25:24.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:24 smithi005 ceph-mon[18602]: osdmap e57: 10 total, 9 up, 10 in 2024-08-31T05:25:24.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:24 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T05:25:25.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:25 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/2018785099' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:25:25.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:25 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/2018785099' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:25:25.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:25 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/2018785099' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:25:26.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:26 smithi070 ceph-mon[22316]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 139 KiB/s, 0 objects/s recovering 2024-08-31T05:25:26.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:26 smithi050 ceph-mon[22146]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 139 KiB/s, 0 objects/s recovering 2024-08-31T05:25:26.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:26 smithi005 ceph-mon[18602]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 139 KiB/s, 0 objects/s recovering 2024-08-31T05:25:28.633 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:28 smithi005 ceph-mon[18602]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-31T05:25:28.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:28 smithi070 ceph-mon[22316]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-31T05:25:28.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:28 smithi050 ceph-mon[22146]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-31T05:25:30.611 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:30 smithi005 ceph-mon[18602]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-08-31T05:25:30.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:30 smithi070 ceph-mon[22316]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-08-31T05:25:30.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:30 smithi050 ceph-mon[22146]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-08-31T05:25:32.714 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:32 smithi005 ceph-mon[18602]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-08-31T05:25:32.714 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:32 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-08-31T05:25:32.714 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:32 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:25:32.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:32 smithi070 ceph-mon[22316]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-08-31T05:25:32.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:32 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-08-31T05:25:32.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:32 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:25:32.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:32 smithi050 ceph-mon[22146]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-08-31T05:25:32.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:32 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-08-31T05:25:32.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:32 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:25:33.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:33 smithi005 ceph-mon[18602]: Deploying daemon osd.9 on smithi005 2024-08-31T05:25:33.835 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:33 smithi070 ceph-mon[22316]: Deploying daemon osd.9 on smithi005 2024-08-31T05:25:33.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:33 smithi050 ceph-mon[22146]: Deploying daemon osd.9 on smithi005 2024-08-31T05:25:34.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:34 smithi005 ceph-mon[18602]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-31T05:25:34.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:34 smithi070 ceph-mon[22316]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-31T05:25:34.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:34 smithi050 ceph-mon[22146]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-31T05:25:36.573 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:36 smithi005 ceph-mon[18602]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-08-31T05:25:36.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:36 smithi070 ceph-mon[22316]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-08-31T05:25:36.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:36 smithi050 ceph-mon[22146]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-08-31T05:25:38.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:38 smithi005 ceph-mon[18602]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-08-31T05:25:38.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:38 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:25:38.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:38 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:38.609 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:38 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:38.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:38 smithi070 ceph-mon[22316]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-08-31T05:25:38.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:38 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:25:38.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:38 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:38.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:38 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:38.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:38 smithi050 ceph-mon[22146]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-08-31T05:25:38.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:38 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:25:38.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:38 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:38.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:38 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:40.521 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:40 smithi005 ceph-mon[18602]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-08-31T05:25:40.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:40 smithi070 ceph-mon[22316]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-08-31T05:25:40.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:40 smithi050 ceph-mon[22146]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-08-31T05:25:41.377 INFO:teuthology.orchestra.run.smithi005.stdout:Created osd(s) 9 on host 'smithi005' 2024-08-31T05:25:41.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:25:41.375+0000 7f99a17fa640 1 -- 172.21.15.5:0/2753483545 <== mgr.14220 v2:172.21.15.5:6800/2696053609 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f99a40635a0 con 0x7f998c0b4bb0 2024-08-31T05:25:41.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:25:41.378+0000 7f99aa2fb640 1 -- 172.21.15.5:0/2753483545 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f998c0b4bb0 msgr2=0x7f998c0b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:41.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:25:41.378+0000 7f99aa2fb640 1 --2- 172.21.15.5:0/2753483545 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f998c0b4bb0 0x7f998c0b70c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9994000c00 tx=0x7f9994031400 comp rx=0 tx=0).stop 2024-08-31T05:25:41.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:25:41.378+0000 7f99aa2fb640 1 -- 172.21.15.5:0/2753483545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a4108170 msgr2=0x7f99a419b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:41.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:25:41.378+0000 7f99aa2fb640 1 --2- 172.21.15.5:0/2753483545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a4108170 0x7f99a419b6c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f999800d740 tx=0x7f999800dc00 comp rx=0 tx=0).stop 2024-08-31T05:25:41.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:25:41.378+0000 7f99aa2fb640 1 -- 172.21.15.5:0/2753483545 shutdown_connections 2024-08-31T05:25:41.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:25:41.378+0000 7f99aa2fb640 1 --2- 172.21.15.5:0/2753483545 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f998c0b4bb0 0x7f998c0b70c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:41.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:25:41.378+0000 7f99aa2fb640 1 --2- 172.21.15.5:0/2753483545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99a4108ac0 0x7f99a419bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:41.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:25:41.378+0000 7f99aa2fb640 1 --2- 172.21.15.5:0/2753483545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99a4108170 0x7f99a419b6c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:41.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:25:41.378+0000 7f99aa2fb640 1 --2- 172.21.15.5:0/2753483545 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99a4102880 0x7f99a419b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:41.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:25:41.378+0000 7f99aa2fb640 1 -- 172.21.15.5:0/2753483545 >> 172.21.15.5:0/2753483545 conn(0x7f99a4079550 msgr2=0x7f99a41062c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:25:41.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:25:41.378+0000 7f99aa2fb640 1 -- 172.21.15.5:0/2753483545 shutdown_connections 2024-08-31T05:25:41.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:25:41.378+0000 7f99aa2fb640 1 -- 172.21.15.5:0/2753483545 wait complete. 2024-08-31T05:25:42.102 DEBUG:teuthology.orchestra.run.smithi005:osd.9> sudo journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@osd.9.service 2024-08-31T05:25:42.104 INFO:tasks.cephadm:Deploying osd.10 on smithi050 with /dev/vg_nvme/lv_1... 2024-08-31T05:25:42.104 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-08-31T05:25:42.371 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T05:25:42.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:42 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:42.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:42 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:42.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:42 smithi050 ceph-mon[22146]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-08-31T05:25:42.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:42 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:42.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:42 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:42.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:42 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:42.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:42 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:42.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:42 smithi005 ceph-mon[18602]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-08-31T05:25:42.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:42 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:42.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:42 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:42.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:42 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:42.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:42 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:42.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:42 smithi070 ceph-mon[22316]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-08-31T05:25:42.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:42 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:42.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:42 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:44.217 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:25:44 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:25:43.998+0000 7fc4464ae640 -1 osd.9 0 log_to_monitors true 2024-08-31T05:25:44.486 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:44 smithi050 ceph-mon[22146]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-08-31T05:25:44.486 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:44 smithi050 ceph-mon[22146]: from='osd.9 [v2:172.21.15.5:6826/2988145512,v1:172.21.15.5:6827/2988145512]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-08-31T05:25:44.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:44 smithi005 ceph-mon[18602]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-08-31T05:25:44.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:44 smithi005 ceph-mon[18602]: from='osd.9 [v2:172.21.15.5:6826/2988145512,v1:172.21.15.5:6827/2988145512]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-08-31T05:25:44.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:44 smithi070 ceph-mon[22316]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-08-31T05:25:44.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:44 smithi070 ceph-mon[22316]: from='osd.9 [v2:172.21.15.5:6826/2988145512,v1:172.21.15.5:6827/2988145512]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-08-31T05:25:45.423 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-08-31T05:25:45.450 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi050:vg_nvme/lv_1 2024-08-31T05:25:45.704 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T05:25:45.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:45 smithi005 ceph-mon[18602]: from='osd.9 [v2:172.21.15.5:6826/2988145512,v1:172.21.15.5:6827/2988145512]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-08-31T05:25:45.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:45 smithi005 ceph-mon[18602]: osdmap e58: 10 total, 9 up, 10 in 2024-08-31T05:25:45.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:45 smithi005 ceph-mon[18602]: from='osd.9 [v2:172.21.15.5:6826/2988145512,v1:172.21.15.5:6827/2988145512]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi005", "root=default"]} : dispatch 2024-08-31T05:25:45.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:45 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T05:25:45.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:45 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:45.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:45 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:45.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:45 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T05:25:45.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:45 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T05:25:45.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:45 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T05:25:45.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:45 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-31T05:25:45.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:45 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:45.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:45 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:25:45.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:45 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:25:45.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:45 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:45.824 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:45 smithi050 ceph-mon[22146]: from='osd.9 [v2:172.21.15.5:6826/2988145512,v1:172.21.15.5:6827/2988145512]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-08-31T05:25:45.825 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:45 smithi050 ceph-mon[22146]: osdmap e58: 10 total, 9 up, 10 in 2024-08-31T05:25:45.825 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:45 smithi050 ceph-mon[22146]: from='osd.9 [v2:172.21.15.5:6826/2988145512,v1:172.21.15.5:6827/2988145512]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi005", "root=default"]} : dispatch 2024-08-31T05:25:45.825 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:45 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T05:25:45.825 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:45 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:45.825 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:45 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:45.825 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:45 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T05:25:45.825 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:45 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T05:25:45.825 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:45 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T05:25:45.825 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:45 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-31T05:25:45.825 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:45 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:45.825 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:45 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:25:45.825 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:45 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:25:45.826 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:45 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:45.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:45 smithi070 ceph-mon[22316]: from='osd.9 [v2:172.21.15.5:6826/2988145512,v1:172.21.15.5:6827/2988145512]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-08-31T05:25:45.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:45 smithi070 ceph-mon[22316]: osdmap e58: 10 total, 9 up, 10 in 2024-08-31T05:25:45.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:45 smithi070 ceph-mon[22316]: from='osd.9 [v2:172.21.15.5:6826/2988145512,v1:172.21.15.5:6827/2988145512]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi005", "root=default"]} : dispatch 2024-08-31T05:25:45.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:45 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T05:25:45.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:45 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:45.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:45 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:45.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:45 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T05:25:45.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:45 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T05:25:45.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:45 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T05:25:45.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:45 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-31T05:25:45.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:45 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:45.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:45 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:25:45.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:45 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:25:45.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:45 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:46.217 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:25:45 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:25:45.904+0000 7fc442430640 -1 osd.9 0 waiting for initial osdmap 2024-08-31T05:25:46.217 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:25:45 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:25:45.916+0000 7fc43a226640 -1 osd.9 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T05:25:46.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:25:46.218+0000 7f9b1adbc640 1 -- 172.21.15.50:0/1406630638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b14104f50 msgr2=0x7f9b14105360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:46.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:25:46.218+0000 7f9b1adbc640 1 --2- 172.21.15.50:0/1406630638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b14104f50 0x7f9b14105360 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9b00009930 tx=0x7f9b0002a420 comp rx=0 tx=0).stop 2024-08-31T05:25:46.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:25:46.218+0000 7f9b1adbc640 1 -- 172.21.15.50:0/1406630638 shutdown_connections 2024-08-31T05:25:46.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:25:46.218+0000 7f9b1adbc640 1 --2- 172.21.15.50:0/1406630638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b141058a0 0x7f9b1410f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:46.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:25:46.218+0000 7f9b1adbc640 1 --2- 172.21.15.50:0/1406630638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b14104f50 0x7f9b14105360 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:46.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:25:46.218+0000 7f9b1adbc640 1 --2- 172.21.15.50:0/1406630638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b14102f80 0x7f9b14103390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:46.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:25:46.218+0000 7f9b1adbc640 1 -- 172.21.15.50:0/1406630638 >> 172.21.15.50:0/1406630638 conn(0x7f9b14077a60 msgr2=0x7f9b14077ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:25:46.261 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:25:46.218+0000 7f9b1adbc640 1 -- 172.21.15.50:0/1406630638 shutdown_connections 2024-08-31T05:25:46.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:25:46.218+0000 7f9b1adbc640 1 -- 172.21.15.50:0/1406630638 wait complete. 2024-08-31T05:25:46.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:25:46.219+0000 7f9b1adbc640 1 Processor -- start 2024-08-31T05:25:46.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:25:46.219+0000 7f9b1adbc640 1 -- start start 2024-08-31T05:25:46.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:25:46.219+0000 7f9b1adbc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b14102f80 0x7f9b1419a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:46.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:25:46.219+0000 7f9b1adbc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b14104f50 0x7f9b1419a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:46.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:25:46.219+0000 7f9b1adbc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b141058a0 0x7f9b1419fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:46.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:25:46.219+0000 7f9b1adbc640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9b14113880 con 0x7f9b14102f80 2024-08-31T05:25:46.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:25:46.219+0000 7f9b1adbc640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9b14113700 con 0x7f9b14104f50 2024-08-31T05:25:46.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:25:46.219+0000 7f9b1adbc640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9b14113a00 con 0x7f9b141058a0 2024-08-31T05:25:46.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:25:46.219+0000 7f9b13fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b14104f50 0x7f9b1419a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:46.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:25:46.220+0000 7f9b13fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b14104f50 0x7f9b1419a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.50:35958/0 (socket says 172.21.15.50:35958) 2024-08-31T05:25:46.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:25:46.220+0000 7f9b13fff640 1 -- 172.21.15.50:0/362021047 learned_addr learned my addr 172.21.15.50:0/362021047 (peer_addr_for_me v2:172.21.15.50:0/0) 2024-08-31T05:25:46.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:25:46.220+0000 7f9b18b58640 1 --2- 172.21.15.50:0/362021047 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b14102f80 0x7f9b1419a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:46.262 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:25:46.220+0000 7f9b19359640 1 --2- 172.21.15.50:0/362021047 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b141058a0 0x7f9b1419fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:46.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:25:46.220+0000 7f9b13fff640 1 -- 172.21.15.50:0/362021047 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b141058a0 msgr2=0x7f9b1419fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:46.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:25:46.220+0000 7f9b13fff640 1 --2- 172.21.15.50:0/362021047 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b141058a0 0x7f9b1419fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:46.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:25:46.220+0000 7f9b13fff640 1 -- 172.21.15.50:0/362021047 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b14102f80 msgr2=0x7f9b1419a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:25:46.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:25:46.220+0000 7f9b13fff640 1 --2- 172.21.15.50:0/362021047 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b14102f80 0x7f9b1419a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:25:46.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:25:46.220+0000 7f9b13fff640 1 -- 172.21.15.50:0/362021047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b141a0240 con 0x7f9b14104f50 2024-08-31T05:25:46.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:25:46.220+0000 7f9b19359640 1 --2- 172.21.15.50:0/362021047 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b141058a0 0x7f9b1419fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:25:46.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:25:46.220+0000 7f9b13fff640 1 --2- 172.21.15.50:0/362021047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b14104f50 0x7f9b1419a870 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9b00031440 tx=0x7f9b00004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:25:46.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:25:46.220+0000 7f9b11ffb640 1 -- 172.21.15.50:0/362021047 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b0003f030 con 0x7f9b14104f50 2024-08-31T05:25:46.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:25:46.220+0000 7f9b11ffb640 1 -- 172.21.15.50:0/362021047 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b00003aa0 con 0x7f9b14104f50 2024-08-31T05:25:46.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:25:46.220+0000 7f9b11ffb640 1 -- 172.21.15.50:0/362021047 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b00035070 con 0x7f9b14104f50 2024-08-31T05:25:46.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:25:46.220+0000 7f9b1adbc640 1 -- 172.21.15.50:0/362021047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b141a04d0 con 0x7f9b14104f50 2024-08-31T05:25:46.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:25:46.221+0000 7f9b1adbc640 1 -- 172.21.15.50:0/362021047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b141a6c90 con 0x7f9b14104f50 2024-08-31T05:25:46.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:25:46.222+0000 7f9b1adbc640 1 -- 172.21.15.50:0/362021047 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b14103390 con 0x7f9b14104f50 2024-08-31T05:25:46.263 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:25:46.223+0000 7f9b11ffb640 1 -- 172.21.15.50:0/362021047 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f9b00042030 con 0x7f9b14104f50 2024-08-31T05:25:46.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:25:46.224+0000 7f9b11ffb640 1 --2- 172.21.15.50:0/362021047 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9b040b4c00 0x7f9b040b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:25:46.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:25:46.224+0000 7f9b11ffb640 1 -- 172.21.15.50:0/362021047 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6196+0+0 (secure 0 0 0) 0x7f9b00104e50 con 0x7f9b14104f50 2024-08-31T05:25:46.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:25:46.224+0000 7f9b18b58640 1 --2- 172.21.15.50:0/362021047 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9b040b4c00 0x7f9b040b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:25:46.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:25:46.224+0000 7f9b18b58640 1 --2- 172.21.15.50:0/362021047 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9b040b4c00 0x7f9b040b7110 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9b08005fd0 tx=0x7f9b0800b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:25:46.264 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:25:46.228+0000 7f9b11ffb640 1 -- 172.21.15.50:0/362021047 <== mon.2 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f9b000cc7c0 con 0x7f9b14104f50 2024-08-31T05:25:46.430 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:25:46.425+0000 7f9b1adbc640 1 -- 172.21.15.50:0/362021047 --> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f9b140635a0 con 0x7f9b040b4c00 2024-08-31T05:25:46.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:46 smithi005 ceph-mon[18602]: Detected new or changed devices on smithi005 2024-08-31T05:25:46.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:46 smithi005 ceph-mon[18602]: Adjusting osd_memory_target on smithi005 to 4273M 2024-08-31T05:25:46.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:46 smithi005 ceph-mon[18602]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-08-31T05:25:46.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:46 smithi005 ceph-mon[18602]: from='osd.9 [v2:172.21.15.5:6826/2988145512,v1:172.21.15.5:6827/2988145512]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-08-31T05:25:46.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:46 smithi005 ceph-mon[18602]: osdmap e59: 10 total, 9 up, 10 in 2024-08-31T05:25:46.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:46 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T05:25:46.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:46 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T05:25:46.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:46 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:25:46.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:46 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:25:46.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:46 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:25:46.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:46 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:46.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:46 smithi005 ceph-mon[18602]: from='osd.9 [v2:172.21.15.5:6826/2988145512,v1:172.21.15.5:6827/2988145512]' entity='osd.9' 2024-08-31T05:25:46.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:46 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:25:46.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:46 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:25:46.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:46 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:25:46.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:46 smithi070 ceph-mon[22316]: Detected new or changed devices on smithi005 2024-08-31T05:25:46.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:46 smithi070 ceph-mon[22316]: Adjusting osd_memory_target on smithi005 to 4273M 2024-08-31T05:25:46.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:46 smithi070 ceph-mon[22316]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-08-31T05:25:46.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:46 smithi070 ceph-mon[22316]: from='osd.9 [v2:172.21.15.5:6826/2988145512,v1:172.21.15.5:6827/2988145512]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-08-31T05:25:46.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:46 smithi070 ceph-mon[22316]: osdmap e59: 10 total, 9 up, 10 in 2024-08-31T05:25:46.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:46 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T05:25:46.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:46 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T05:25:46.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:46 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:25:46.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:46 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:25:46.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:46 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:25:46.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:46 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:46.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:46 smithi070 ceph-mon[22316]: from='osd.9 [v2:172.21.15.5:6826/2988145512,v1:172.21.15.5:6827/2988145512]' entity='osd.9' 2024-08-31T05:25:46.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:46 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:25:46.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:46 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:25:46.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:46 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:25:46.839 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:46 smithi050 ceph-mon[22146]: Detected new or changed devices on smithi005 2024-08-31T05:25:46.839 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:46 smithi050 ceph-mon[22146]: Adjusting osd_memory_target on smithi005 to 4273M 2024-08-31T05:25:46.840 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:46 smithi050 ceph-mon[22146]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-08-31T05:25:46.840 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:46 smithi050 ceph-mon[22146]: from='osd.9 [v2:172.21.15.5:6826/2988145512,v1:172.21.15.5:6827/2988145512]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-08-31T05:25:46.840 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:46 smithi050 ceph-mon[22146]: osdmap e59: 10 total, 9 up, 10 in 2024-08-31T05:25:46.840 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:46 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T05:25:46.840 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:46 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T05:25:46.840 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:46 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:25:46.840 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:46 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:25:46.840 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:46 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:25:46.840 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:46 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:25:46.840 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:46 smithi050 ceph-mon[22146]: from='osd.9 [v2:172.21.15.5:6826/2988145512,v1:172.21.15.5:6827/2988145512]' entity='osd.9' 2024-08-31T05:25:46.840 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:46 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:25:46.840 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:46 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:25:46.840 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:46 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:25:47.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:47 smithi005 ceph-mon[18602]: purged_snaps scrub starts 2024-08-31T05:25:47.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:47 smithi005 ceph-mon[18602]: purged_snaps scrub ok 2024-08-31T05:25:47.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:47 smithi005 ceph-mon[18602]: from='client.24473 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:25:47.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:47 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T05:25:47.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:47 smithi005 ceph-mon[18602]: osd.9 [v2:172.21.15.5:6826/2988145512,v1:172.21.15.5:6827/2988145512] boot 2024-08-31T05:25:47.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:47 smithi005 ceph-mon[18602]: osdmap e60: 10 total, 10 up, 10 in 2024-08-31T05:25:47.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:47 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T05:25:47.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:47 smithi070 ceph-mon[22316]: purged_snaps scrub starts 2024-08-31T05:25:47.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:47 smithi070 ceph-mon[22316]: purged_snaps scrub ok 2024-08-31T05:25:47.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:47 smithi070 ceph-mon[22316]: from='client.24473 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:25:47.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:47 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T05:25:47.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:47 smithi070 ceph-mon[22316]: osd.9 [v2:172.21.15.5:6826/2988145512,v1:172.21.15.5:6827/2988145512] boot 2024-08-31T05:25:47.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:47 smithi070 ceph-mon[22316]: osdmap e60: 10 total, 10 up, 10 in 2024-08-31T05:25:47.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:47 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T05:25:47.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:47 smithi050 ceph-mon[22146]: purged_snaps scrub starts 2024-08-31T05:25:47.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:47 smithi050 ceph-mon[22146]: purged_snaps scrub ok 2024-08-31T05:25:47.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:47 smithi050 ceph-mon[22146]: from='client.24473 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi050:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:25:47.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:47 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T05:25:47.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:47 smithi050 ceph-mon[22146]: osd.9 [v2:172.21.15.5:6826/2988145512,v1:172.21.15.5:6827/2988145512] boot 2024-08-31T05:25:47.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:47 smithi050 ceph-mon[22146]: osdmap e60: 10 total, 10 up, 10 in 2024-08-31T05:25:47.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:47 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T05:25:49.156 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:48 smithi050 ceph-mon[22146]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-08-31T05:25:49.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:48 smithi050 ceph-mon[22146]: osdmap e61: 10 total, 10 up, 10 in 2024-08-31T05:25:49.220 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:48 smithi005 ceph-mon[18602]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-08-31T05:25:49.220 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:48 smithi005 ceph-mon[18602]: osdmap e61: 10 total, 10 up, 10 in 2024-08-31T05:25:49.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:48 smithi070 ceph-mon[22316]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-08-31T05:25:49.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:48 smithi070 ceph-mon[22316]: osdmap e61: 10 total, 10 up, 10 in 2024-08-31T05:25:50.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:49 smithi050 ceph-mon[22146]: from='client.? 172.21.15.50:0/3589669729' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "96c5de40-53df-412d-9501-8ce1711a76a2"} : dispatch 2024-08-31T05:25:50.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:49 smithi050 ceph-mon[22146]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "96c5de40-53df-412d-9501-8ce1711a76a2"} : dispatch 2024-08-31T05:25:50.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:49 smithi050 ceph-mon[22146]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "96c5de40-53df-412d-9501-8ce1711a76a2"}]': finished 2024-08-31T05:25:50.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:49 smithi050 ceph-mon[22146]: osdmap e62: 11 total, 10 up, 11 in 2024-08-31T05:25:50.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:49 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T05:25:50.158 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:49 smithi050 ceph-mon[22146]: from='client.? 172.21.15.50:0/3034854232' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:25:50.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:49 smithi005 ceph-mon[18602]: from='client.? 172.21.15.50:0/3589669729' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "96c5de40-53df-412d-9501-8ce1711a76a2"} : dispatch 2024-08-31T05:25:50.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:49 smithi005 ceph-mon[18602]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "96c5de40-53df-412d-9501-8ce1711a76a2"} : dispatch 2024-08-31T05:25:50.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:49 smithi005 ceph-mon[18602]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "96c5de40-53df-412d-9501-8ce1711a76a2"}]': finished 2024-08-31T05:25:50.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:49 smithi005 ceph-mon[18602]: osdmap e62: 11 total, 10 up, 11 in 2024-08-31T05:25:50.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:49 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T05:25:50.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:49 smithi005 ceph-mon[18602]: from='client.? 172.21.15.50:0/3034854232' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:25:50.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:49 smithi070 ceph-mon[22316]: from='client.? 172.21.15.50:0/3589669729' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "96c5de40-53df-412d-9501-8ce1711a76a2"} : dispatch 2024-08-31T05:25:50.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:49 smithi070 ceph-mon[22316]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "96c5de40-53df-412d-9501-8ce1711a76a2"} : dispatch 2024-08-31T05:25:50.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:49 smithi070 ceph-mon[22316]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "96c5de40-53df-412d-9501-8ce1711a76a2"}]': finished 2024-08-31T05:25:50.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:49 smithi070 ceph-mon[22316]: osdmap e62: 11 total, 10 up, 11 in 2024-08-31T05:25:50.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:49 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T05:25:50.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:49 smithi070 ceph-mon[22316]: from='client.? 172.21.15.50:0/3034854232' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:25:51.403 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:51 smithi005 ceph-mon[18602]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 894 GiB / 894 GiB avail 2024-08-31T05:25:51.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:51 smithi050 ceph-mon[22146]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 894 GiB / 894 GiB avail 2024-08-31T05:25:51.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:51 smithi070 ceph-mon[22316]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 894 GiB / 894 GiB avail 2024-08-31T05:25:53.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:53 smithi050 ceph-mon[22146]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 894 GiB / 894 GiB avail 2024-08-31T05:25:53.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:53 smithi005 ceph-mon[18602]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 894 GiB / 894 GiB avail 2024-08-31T05:25:53.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:53 smithi070 ceph-mon[22316]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 894 GiB / 894 GiB avail 2024-08-31T05:25:55.277 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:55 smithi050 ceph-mon[22146]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 894 GiB / 894 GiB avail 2024-08-31T05:25:55.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:55 smithi005 ceph-mon[18602]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 894 GiB / 894 GiB avail 2024-08-31T05:25:55.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:55 smithi070 ceph-mon[22316]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 894 GiB / 894 GiB avail 2024-08-31T05:25:57.372 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:57 smithi050 ceph-mon[22146]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 894 GiB / 894 GiB avail 2024-08-31T05:25:57.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:57 smithi005 ceph-mon[18602]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 894 GiB / 894 GiB avail 2024-08-31T05:25:57.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:57 smithi070 ceph-mon[22316]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 894 GiB / 894 GiB avail 2024-08-31T05:25:59.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:59 smithi050 ceph-mon[22146]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 894 GiB / 894 GiB avail 2024-08-31T05:25:59.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:59 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-08-31T05:25:59.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:25:59 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:25:59.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:59 smithi005 ceph-mon[18602]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 894 GiB / 894 GiB avail 2024-08-31T05:25:59.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:59 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-08-31T05:25:59.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:25:59 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:25:59.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:59 smithi070 ceph-mon[22316]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 894 GiB / 894 GiB avail 2024-08-31T05:25:59.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:59 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-08-31T05:25:59.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:25:59 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:26:00.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:00 smithi050 ceph-mon[22146]: Deploying daemon osd.10 on smithi050 2024-08-31T05:26:00.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:00 smithi005 ceph-mon[18602]: Deploying daemon osd.10 on smithi050 2024-08-31T05:26:00.585 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:00 smithi070 ceph-mon[22316]: Deploying daemon osd.10 on smithi050 2024-08-31T05:26:01.218 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:01 smithi050 ceph-mon[22146]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 894 GiB / 894 GiB avail 2024-08-31T05:26:01.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:01 smithi005 ceph-mon[18602]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 894 GiB / 894 GiB avail 2024-08-31T05:26:01.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:01 smithi070 ceph-mon[22316]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 894 GiB / 894 GiB avail 2024-08-31T05:26:03.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:03 smithi050 ceph-mon[22146]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 894 GiB / 894 GiB avail 2024-08-31T05:26:03.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:03 smithi005 ceph-mon[18602]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 894 GiB / 894 GiB avail 2024-08-31T05:26:03.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:03 smithi070 ceph-mon[22316]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 894 GiB / 894 GiB avail 2024-08-31T05:26:05.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:05 smithi050 ceph-mon[22146]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 894 GiB / 894 GiB avail 2024-08-31T05:26:05.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:05 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:26:05.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:05 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:05.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:05 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:05.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:05 smithi005 ceph-mon[18602]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 894 GiB / 894 GiB avail 2024-08-31T05:26:05.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:05 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:26:05.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:05 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:05.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:05 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:05.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:05 smithi070 ceph-mon[22316]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 894 GiB / 894 GiB avail 2024-08-31T05:26:05.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:05 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:26:05.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:05 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:05.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:05 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:07.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:07 smithi050 ceph-mon[22146]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 894 GiB / 894 GiB avail 2024-08-31T05:26:07.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:07 smithi005 ceph-mon[18602]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 894 GiB / 894 GiB avail 2024-08-31T05:26:07.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:07 smithi070 ceph-mon[22316]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 894 GiB / 894 GiB avail 2024-08-31T05:26:07.986 INFO:teuthology.orchestra.run.smithi050.stdout:Created osd(s) 10 on host 'smithi050' 2024-08-31T05:26:07.987 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:26:07.984+0000 7f9b11ffb640 1 -- 172.21.15.50:0/362021047 <== mgr.14220 v2:172.21.15.5:6800/2696053609 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f9b140635a0 con 0x7f9b040b4c00 2024-08-31T05:26:07.988 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:26:07.986+0000 7f9b1adbc640 1 -- 172.21.15.50:0/362021047 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9b040b4c00 msgr2=0x7f9b040b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:07.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:26:07.986+0000 7f9b1adbc640 1 --2- 172.21.15.50:0/362021047 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9b040b4c00 0x7f9b040b7110 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9b08005fd0 tx=0x7f9b0800b390 comp rx=0 tx=0).stop 2024-08-31T05:26:07.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:26:07.986+0000 7f9b1adbc640 1 -- 172.21.15.50:0/362021047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b14104f50 msgr2=0x7f9b1419a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:07.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:26:07.986+0000 7f9b1adbc640 1 --2- 172.21.15.50:0/362021047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b14104f50 0x7f9b1419a870 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9b00031440 tx=0x7f9b00004270 comp rx=0 tx=0).stop 2024-08-31T05:26:07.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:26:07.987+0000 7f9b1adbc640 1 -- 172.21.15.50:0/362021047 shutdown_connections 2024-08-31T05:26:07.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:26:07.987+0000 7f9b1adbc640 1 --2- 172.21.15.50:0/362021047 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9b040b4c00 0x7f9b040b7110 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:07.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:26:07.987+0000 7f9b1adbc640 1 --2- 172.21.15.50:0/362021047 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b141058a0 0x7f9b1419fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:07.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:26:07.987+0000 7f9b1adbc640 1 --2- 172.21.15.50:0/362021047 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b14104f50 0x7f9b1419a870 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:07.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:26:07.987+0000 7f9b1adbc640 1 --2- 172.21.15.50:0/362021047 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b14102f80 0x7f9b1419a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:07.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:26:07.987+0000 7f9b1adbc640 1 -- 172.21.15.50:0/362021047 >> 172.21.15.50:0/362021047 conn(0x7f9b14077a60 msgr2=0x7f9b14106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:26:07.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:26:07.987+0000 7f9b1adbc640 1 -- 172.21.15.50:0/362021047 shutdown_connections 2024-08-31T05:26:07.989 INFO:teuthology.orchestra.run.smithi050.stderr:2024-08-31T05:26:07.987+0000 7f9b1adbc640 1 -- 172.21.15.50:0/362021047 wait complete. 2024-08-31T05:26:08.357 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:08 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:08.357 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:08 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:08.357 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:08 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:08.358 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:08 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:08.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:08 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:08.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:08 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:08.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:08 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:08.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:08 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:08.487 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:08 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:08.487 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:08 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:08.487 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:08 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:08.487 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:08 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:08.694 DEBUG:teuthology.orchestra.run.smithi050:osd.10> sudo journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@osd.10.service 2024-08-31T05:26:08.696 INFO:tasks.cephadm:Deploying osd.11 on smithi070 with /dev/vg_nvme/lv_1... 2024-08-31T05:26:08.696 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-08-31T05:26:08.957 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T05:26:09.262 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:09 smithi070 ceph-mon[22316]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 894 GiB / 894 GiB avail 2024-08-31T05:26:09.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:09 smithi050 ceph-mon[22146]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 894 GiB / 894 GiB avail 2024-08-31T05:26:09.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:09 smithi005 ceph-mon[18602]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 894 GiB / 894 GiB avail 2024-08-31T05:26:10.149 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:26:09 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:26:09.770+0000 7f84a81b6640 -1 osd.10 0 log_to_monitors true 2024-08-31T05:26:10.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:10 smithi070 ceph-mon[22316]: from='osd.10 [v2:172.21.15.50:6824/4168871229,v1:172.21.15.50:6825/4168871229]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-31T05:26:10.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:10 smithi070 ceph-mon[22316]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-31T05:26:10.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:10 smithi050 ceph-mon[22146]: from='osd.10 [v2:172.21.15.50:6824/4168871229,v1:172.21.15.50:6825/4168871229]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-31T05:26:10.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:10 smithi050 ceph-mon[22146]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-31T05:26:10.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:10 smithi005 ceph-mon[18602]: from='osd.10 [v2:172.21.15.50:6824/4168871229,v1:172.21.15.50:6825/4168871229]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-31T05:26:10.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:10 smithi005 ceph-mon[18602]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-31T05:26:11.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:11 smithi050 ceph-mon[22146]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 894 GiB / 894 GiB avail 2024-08-31T05:26:11.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:11 smithi050 ceph-mon[22146]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-08-31T05:26:11.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:11 smithi050 ceph-mon[22146]: osdmap e63: 11 total, 10 up, 11 in 2024-08-31T05:26:11.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:11 smithi050 ceph-mon[22146]: from='osd.10 [v2:172.21.15.50:6824/4168871229,v1:172.21.15.50:6825/4168871229]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T05:26:11.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:11 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T05:26:11.408 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:11 smithi050 ceph-mon[22146]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T05:26:11.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:11 smithi005 ceph-mon[18602]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 894 GiB / 894 GiB avail 2024-08-31T05:26:11.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:11 smithi005 ceph-mon[18602]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-08-31T05:26:11.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:11 smithi005 ceph-mon[18602]: osdmap e63: 11 total, 10 up, 11 in 2024-08-31T05:26:11.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:11 smithi005 ceph-mon[18602]: from='osd.10 [v2:172.21.15.50:6824/4168871229,v1:172.21.15.50:6825/4168871229]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T05:26:11.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:11 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T05:26:11.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:11 smithi005 ceph-mon[18602]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T05:26:11.570 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:11 smithi070 ceph-mon[22316]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 894 GiB / 894 GiB avail 2024-08-31T05:26:11.571 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:11 smithi070 ceph-mon[22316]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-08-31T05:26:11.571 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:11 smithi070 ceph-mon[22316]: osdmap e63: 11 total, 10 up, 11 in 2024-08-31T05:26:11.571 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:11 smithi070 ceph-mon[22316]: from='osd.10 [v2:172.21.15.50:6824/4168871229,v1:172.21.15.50:6825/4168871229]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T05:26:11.571 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:11 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T05:26:11.571 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:11 smithi070 ceph-mon[22316]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi050", "root=default"]} : dispatch 2024-08-31T05:26:11.796 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:26:11 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:26:11.658+0000 7f84a4138640 -1 osd.10 0 waiting for initial osdmap 2024-08-31T05:26:11.796 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:26:11 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:26:11.673+0000 7f849bf2e640 -1 osd.10 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T05:26:11.883 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-08-31T05:26:11.908 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi070:vg_nvme/lv_1 2024-08-31T05:26:12.151 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T05:26:12.421 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:12 smithi070 ceph-mon[22316]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-08-31T05:26:12.421 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:12 smithi070 ceph-mon[22316]: osdmap e64: 11 total, 10 up, 11 in 2024-08-31T05:26:12.421 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:12 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T05:26:12.421 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:12 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T05:26:12.421 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:12 smithi070 ceph-mon[22316]: from='osd.10 ' entity='osd.10' 2024-08-31T05:26:12.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:12 smithi005 ceph-mon[18602]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-08-31T05:26:12.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:12 smithi005 ceph-mon[18602]: osdmap e64: 11 total, 10 up, 11 in 2024-08-31T05:26:12.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:12 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T05:26:12.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:12 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T05:26:12.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:12 smithi005 ceph-mon[18602]: from='osd.10 ' entity='osd.10' 2024-08-31T05:26:12.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:12 smithi050 ceph-mon[22146]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi050", "root=default"]}]': finished 2024-08-31T05:26:12.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:12 smithi050 ceph-mon[22146]: osdmap e64: 11 total, 10 up, 11 in 2024-08-31T05:26:12.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:12 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T05:26:12.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:12 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T05:26:12.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:12 smithi050 ceph-mon[22146]: from='osd.10 ' entity='osd.10' 2024-08-31T05:26:12.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:12.657+0000 7f21c8ed1640 1 -- 172.21.15.70:0/2049035621 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f21c4109b90 msgr2=0x7f21c41103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:12.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:12.657+0000 7f21c8ed1640 1 --2- 172.21.15.70:0/2049035621 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f21c4109b90 0x7f21c41103c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f21bc009ca0 tx=0x7f21bc02a8c0 comp rx=0 tx=0).stop 2024-08-31T05:26:12.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:12.657+0000 7f21c8ed1640 1 -- 172.21.15.70:0/2049035621 shutdown_connections 2024-08-31T05:26:12.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:12.657+0000 7f21c8ed1640 1 --2- 172.21.15.70:0/2049035621 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f21c4109b90 0x7f21c41103c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:12.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:12.657+0000 7f21c8ed1640 1 --2- 172.21.15.70:0/2049035621 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21c4109240 0x7f21c4109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:12.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:12.657+0000 7f21c8ed1640 1 --2- 172.21.15.70:0/2049035621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21c4103900 0x7f21c4103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:12.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:12.657+0000 7f21c8ed1640 1 -- 172.21.15.70:0/2049035621 >> 172.21.15.70:0/2049035621 conn(0x7f21c407b5f0 msgr2=0x7f21c407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:26:12.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:12.657+0000 7f21c8ed1640 1 -- 172.21.15.70:0/2049035621 shutdown_connections 2024-08-31T05:26:12.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:12.657+0000 7f21c8ed1640 1 -- 172.21.15.70:0/2049035621 wait complete. 2024-08-31T05:26:12.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:12.658+0000 7f21c8ed1640 1 Processor -- start 2024-08-31T05:26:12.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:12.658+0000 7f21c8ed1640 1 -- start start 2024-08-31T05:26:12.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:12.659+0000 7f21c8ed1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21c4103900 0x7f21c419a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:12.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:12.659+0000 7f21c8ed1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21c4109240 0x7f21c419a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:12.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:12.659+0000 7f21c8ed1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f21c4109b90 0x7f21c419fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:12.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:12.659+0000 7f21c8ed1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f21c4113850 con 0x7f21c4109240 2024-08-31T05:26:12.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:12.659+0000 7f21c8ed1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f21c41136d0 con 0x7f21c4103900 2024-08-31T05:26:12.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:12.659+0000 7f21c8ed1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f21c41139d0 con 0x7f21c4109b90 2024-08-31T05:26:12.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:12.659+0000 7f21c259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21c4103900 0x7f21c419a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:12.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:12.659+0000 7f21c259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21c4103900 0x7f21c419a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.70:57124/0 (socket says 172.21.15.70:57124) 2024-08-31T05:26:12.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:12.659+0000 7f21c259c640 1 -- 172.21.15.70:0/2230702453 learned_addr learned my addr 172.21.15.70:0/2230702453 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-08-31T05:26:12.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:12.659+0000 7f21b9d9b640 1 --2- 172.21.15.70:0/2230702453 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21c4109240 0x7f21c419a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:12.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:12.659+0000 7f21c2d9d640 1 --2- 172.21.15.70:0/2230702453 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f21c4109b90 0x7f21c419fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:12.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:12.659+0000 7f21c259c640 1 -- 172.21.15.70:0/2230702453 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f21c4109b90 msgr2=0x7f21c419fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:12.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:12.659+0000 7f21c259c640 1 --2- 172.21.15.70:0/2230702453 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f21c4109b90 0x7f21c419fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:12.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:12.659+0000 7f21c259c640 1 -- 172.21.15.70:0/2230702453 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21c4109240 msgr2=0x7f21c419a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:12.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:12.659+0000 7f21c259c640 1 --2- 172.21.15.70:0/2230702453 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21c4109240 0x7f21c419a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:12.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:12.659+0000 7f21c259c640 1 -- 172.21.15.70:0/2230702453 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21c41a0130 con 0x7f21c4103900 2024-08-31T05:26:12.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:12.659+0000 7f21b9d9b640 1 --2- 172.21.15.70:0/2230702453 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21c4109240 0x7f21c419a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:26:12.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:12.660+0000 7f21c259c640 1 --2- 172.21.15.70:0/2230702453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21c4103900 0x7f21c419a280 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f21b400c920 tx=0x7f21b400cde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:26:12.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:12.660+0000 7f21bbfff640 1 -- 172.21.15.70:0/2230702453 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b4007c70 con 0x7f21c4103900 2024-08-31T05:26:12.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:12.660+0000 7f21c8ed1640 1 -- 172.21.15.70:0/2230702453 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21c41a0420 con 0x7f21c4103900 2024-08-31T05:26:12.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:12.660+0000 7f21bbfff640 1 -- 172.21.15.70:0/2230702453 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21b4007e10 con 0x7f21c4103900 2024-08-31T05:26:12.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:12.660+0000 7f21bbfff640 1 -- 172.21.15.70:0/2230702453 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b4018820 con 0x7f21c4103900 2024-08-31T05:26:12.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:12.660+0000 7f21c8ed1640 1 -- 172.21.15.70:0/2230702453 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21c41a6c40 con 0x7f21c4103900 2024-08-31T05:26:12.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:12.661+0000 7f21c8ed1640 1 -- 172.21.15.70:0/2230702453 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21c4103d10 con 0x7f21c4103900 2024-08-31T05:26:12.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:12.662+0000 7f21bbfff640 1 -- 172.21.15.70:0/2230702453 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f21b400f450 con 0x7f21c4103900 2024-08-31T05:26:12.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:12.663+0000 7f21bbfff640 1 --2- 172.21.15.70:0/2230702453 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f21b00b4bb0 0x7f21b00b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:12.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:12.663+0000 7f21b9d9b640 1 --2- 172.21.15.70:0/2230702453 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f21b00b4bb0 0x7f21b00b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:12.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:12.663+0000 7f21bbfff640 1 -- 172.21.15.70:0/2230702453 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6942+0+0 (secure 0 0 0) 0x7f21b40e4fe0 con 0x7f21c4103900 2024-08-31T05:26:12.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:12.664+0000 7f21b9d9b640 1 --2- 172.21.15.70:0/2230702453 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f21b00b4bb0 0x7f21b00b70c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f21c4106200 tx=0x7f21ac005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:26:12.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:12.666+0000 7f21bbfff640 1 -- 172.21.15.70:0/2230702453 <== mon.2 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f21b4014030 con 0x7f21c4103900 2024-08-31T05:26:12.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:12.854+0000 7f21c8ed1640 1 -- 172.21.15.70:0/2230702453 --> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f21c410b9b0 con 0x7f21b00b4bb0 2024-08-31T05:26:13.413 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:13 smithi070 ceph-mon[22316]: purged_snaps scrub starts 2024-08-31T05:26:13.413 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:13 smithi070 ceph-mon[22316]: purged_snaps scrub ok 2024-08-31T05:26:13.413 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:13 smithi070 ceph-mon[22316]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 894 GiB / 894 GiB avail 2024-08-31T05:26:13.413 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:13 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T05:26:13.413 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:13 smithi070 ceph-mon[22316]: osd.10 [v2:172.21.15.50:6824/4168871229,v1:172.21.15.50:6825/4168871229] boot 2024-08-31T05:26:13.413 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:13 smithi070 ceph-mon[22316]: osdmap e65: 11 total, 11 up, 11 in 2024-08-31T05:26:13.414 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:13 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T05:26:13.414 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:13 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:13.414 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:13 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:13.414 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:13 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T05:26:13.414 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:13 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T05:26:13.414 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:13 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T05:26:13.414 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:13 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-31T05:26:13.414 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:13 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:13.414 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:13 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:26:13.414 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:13 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:26:13.414 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:13 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:13.414 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:13 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:26:13.414 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:13 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:26:13.414 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:13 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:26:13.415 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:13 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:13.415 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:13 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:26:13.415 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:13 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:26:13.415 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:13 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:26:13.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:13 smithi005 ceph-mon[18602]: purged_snaps scrub starts 2024-08-31T05:26:13.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:13 smithi005 ceph-mon[18602]: purged_snaps scrub ok 2024-08-31T05:26:13.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:13 smithi005 ceph-mon[18602]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 894 GiB / 894 GiB avail 2024-08-31T05:26:13.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:13 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T05:26:13.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:13 smithi005 ceph-mon[18602]: osd.10 [v2:172.21.15.50:6824/4168871229,v1:172.21.15.50:6825/4168871229] boot 2024-08-31T05:26:13.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:13 smithi005 ceph-mon[18602]: osdmap e65: 11 total, 11 up, 11 in 2024-08-31T05:26:13.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:13 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T05:26:13.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:13 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:13.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:13 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:13.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:13 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T05:26:13.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:13 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T05:26:13.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:13 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T05:26:13.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:13 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-31T05:26:13.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:13 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:13.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:13 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:26:13.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:13 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:26:13.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:13 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:13.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:13 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:26:13.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:13 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:26:13.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:13 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:26:13.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:13 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:13.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:13 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:26:13.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:13 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:26:13.469 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:13 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:26:13.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:13 smithi050 ceph-mon[22146]: purged_snaps scrub starts 2024-08-31T05:26:13.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:13 smithi050 ceph-mon[22146]: purged_snaps scrub ok 2024-08-31T05:26:13.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:13 smithi050 ceph-mon[22146]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 894 GiB / 894 GiB avail 2024-08-31T05:26:13.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:13 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T05:26:13.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:13 smithi050 ceph-mon[22146]: osd.10 [v2:172.21.15.50:6824/4168871229,v1:172.21.15.50:6825/4168871229] boot 2024-08-31T05:26:13.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:13 smithi050 ceph-mon[22146]: osdmap e65: 11 total, 11 up, 11 in 2024-08-31T05:26:13.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:13 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T05:26:13.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:13 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:13.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:13 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:13.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:13 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T05:26:13.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:13 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T05:26:13.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:13 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T05:26:13.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:13 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-31T05:26:13.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:13 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:13.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:13 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:26:13.659 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:13 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:26:13.659 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:13 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:13.659 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:13 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:26:13.659 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:13 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:26:13.659 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:13 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:26:13.659 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:13 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:13.659 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:13 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T05:26:13.659 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:13 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T05:26:13.659 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:13 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:26:14.293 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:14 smithi070 ceph-mon[22316]: Detected new or changed devices on smithi050 2024-08-31T05:26:14.293 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:14 smithi070 ceph-mon[22316]: Adjusting osd_memory_target on smithi050 to 4273M 2024-08-31T05:26:14.293 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:14 smithi070 ceph-mon[22316]: from='client.24500 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:26:14.293 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:14 smithi070 ceph-mon[22316]: osdmap e66: 11 total, 11 up, 11 in 2024-08-31T05:26:14.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:14 smithi005 ceph-mon[18602]: Detected new or changed devices on smithi050 2024-08-31T05:26:14.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:14 smithi005 ceph-mon[18602]: Adjusting osd_memory_target on smithi050 to 4273M 2024-08-31T05:26:14.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:14 smithi005 ceph-mon[18602]: from='client.24500 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:26:14.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:14 smithi005 ceph-mon[18602]: osdmap e66: 11 total, 11 up, 11 in 2024-08-31T05:26:14.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:14 smithi050 ceph-mon[22146]: Detected new or changed devices on smithi050 2024-08-31T05:26:14.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:14 smithi050 ceph-mon[22146]: Adjusting osd_memory_target on smithi050 to 4273M 2024-08-31T05:26:14.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:14 smithi050 ceph-mon[22146]: from='client.24500 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:26:14.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:14 smithi050 ceph-mon[22146]: osdmap e66: 11 total, 11 up, 11 in 2024-08-31T05:26:15.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:15 smithi070 ceph-mon[22316]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 983 GiB / 983 GiB avail 2024-08-31T05:26:15.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:15 smithi070 ceph-mon[22316]: osdmap e67: 11 total, 11 up, 11 in 2024-08-31T05:26:15.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:15 smithi005 ceph-mon[18602]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 983 GiB / 983 GiB avail 2024-08-31T05:26:15.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:15 smithi005 ceph-mon[18602]: osdmap e67: 11 total, 11 up, 11 in 2024-08-31T05:26:15.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:15 smithi050 ceph-mon[22146]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 983 GiB / 983 GiB avail 2024-08-31T05:26:15.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:15 smithi050 ceph-mon[22146]: osdmap e67: 11 total, 11 up, 11 in 2024-08-31T05:26:16.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:16 smithi070 ceph-mon[22316]: from='client.? 172.21.15.70:0/4255902525' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "20beefe0-59c3-4392-9f61-8d215e9d2de3"} : dispatch 2024-08-31T05:26:16.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:16 smithi070 ceph-mon[22316]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "20beefe0-59c3-4392-9f61-8d215e9d2de3"} : dispatch 2024-08-31T05:26:16.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:16 smithi070 ceph-mon[22316]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "20beefe0-59c3-4392-9f61-8d215e9d2de3"}]': finished 2024-08-31T05:26:16.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:16 smithi070 ceph-mon[22316]: osdmap e68: 12 total, 11 up, 12 in 2024-08-31T05:26:16.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:16 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T05:26:16.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:16 smithi070 ceph-mon[22316]: from='client.? 172.21.15.70:0/641425112' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:26:16.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:16 smithi005 ceph-mon[18602]: from='client.? 172.21.15.70:0/4255902525' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "20beefe0-59c3-4392-9f61-8d215e9d2de3"} : dispatch 2024-08-31T05:26:16.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:16 smithi005 ceph-mon[18602]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "20beefe0-59c3-4392-9f61-8d215e9d2de3"} : dispatch 2024-08-31T05:26:16.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:16 smithi005 ceph-mon[18602]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "20beefe0-59c3-4392-9f61-8d215e9d2de3"}]': finished 2024-08-31T05:26:16.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:16 smithi005 ceph-mon[18602]: osdmap e68: 12 total, 11 up, 12 in 2024-08-31T05:26:16.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:16 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T05:26:16.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:16 smithi005 ceph-mon[18602]: from='client.? 172.21.15.70:0/641425112' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:26:16.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:16 smithi050 ceph-mon[22146]: from='client.? 172.21.15.70:0/4255902525' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "20beefe0-59c3-4392-9f61-8d215e9d2de3"} : dispatch 2024-08-31T05:26:16.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:16 smithi050 ceph-mon[22146]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "20beefe0-59c3-4392-9f61-8d215e9d2de3"} : dispatch 2024-08-31T05:26:16.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:16 smithi050 ceph-mon[22146]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "20beefe0-59c3-4392-9f61-8d215e9d2de3"}]': finished 2024-08-31T05:26:16.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:16 smithi050 ceph-mon[22146]: osdmap e68: 12 total, 11 up, 12 in 2024-08-31T05:26:16.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:16 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T05:26:16.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:16 smithi050 ceph-mon[22146]: from='client.? 172.21.15.70:0/641425112' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T05:26:17.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:17 smithi005 ceph-mon[18602]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-08-31T05:26:17.585 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:17 smithi070 ceph-mon[22316]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-08-31T05:26:17.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:17 smithi050 ceph-mon[22146]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-08-31T05:26:19.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:19 smithi005 ceph-mon[18602]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 983 GiB / 983 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-08-31T05:26:19.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:19 smithi070 ceph-mon[22316]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 983 GiB / 983 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-08-31T05:26:19.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:19 smithi050 ceph-mon[22146]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 983 GiB / 983 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-08-31T05:26:21.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:21 smithi070 ceph-mon[22316]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 983 GiB / 983 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-08-31T05:26:21.466 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:21 smithi005 ceph-mon[18602]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 983 GiB / 983 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-08-31T05:26:21.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:21 smithi050 ceph-mon[22146]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 983 GiB / 983 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-08-31T05:26:23.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:23 smithi070 ceph-mon[22316]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-31T05:26:23.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:23 smithi005 ceph-mon[18602]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-31T05:26:23.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:23 smithi050 ceph-mon[22146]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-31T05:26:24.335 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:24 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-08-31T05:26:24.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:24 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:26:24.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:24 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-08-31T05:26:24.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:24 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:26:24.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:24 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-08-31T05:26:24.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:24 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:26:25.459 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:25 smithi070 ceph-mon[22316]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-08-31T05:26:25.459 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:25 smithi070 ceph-mon[22316]: Deploying daemon osd.11 on smithi070 2024-08-31T05:26:25.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:25 smithi005 ceph-mon[18602]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-08-31T05:26:25.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:25 smithi005 ceph-mon[18602]: Deploying daemon osd.11 on smithi070 2024-08-31T05:26:25.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:25 smithi050 ceph-mon[22146]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-08-31T05:26:25.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:25 smithi050 ceph-mon[22146]: Deploying daemon osd.11 on smithi070 2024-08-31T05:26:27.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:27 smithi005 ceph-mon[18602]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 983 GiB / 983 GiB avail 2024-08-31T05:26:27.514 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:27 smithi070 ceph-mon[22316]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 983 GiB / 983 GiB avail 2024-08-31T05:26:27.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:27 smithi050 ceph-mon[22146]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 983 GiB / 983 GiB avail 2024-08-31T05:26:29.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:29 smithi005 ceph-mon[18602]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 983 GiB / 983 GiB avail 2024-08-31T05:26:29.528 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:29 smithi070 ceph-mon[22316]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 983 GiB / 983 GiB avail 2024-08-31T05:26:29.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:29 smithi050 ceph-mon[22146]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 983 GiB / 983 GiB avail 2024-08-31T05:26:30.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:30 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:26:30.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:30 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:30.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:30 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:30.517 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:30 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:26:30.517 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:30 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:30.517 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:30 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:30.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:30 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:26:30.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:30 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:30.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:30 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:31.271 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:31 smithi070 ceph-mon[22316]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 983 GiB / 983 GiB avail 2024-08-31T05:26:31.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:31 smithi005 ceph-mon[18602]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 983 GiB / 983 GiB avail 2024-08-31T05:26:31.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:31 smithi050 ceph-mon[22146]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 983 GiB / 983 GiB avail 2024-08-31T05:26:33.417 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:33 smithi070 ceph-mon[22316]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 983 GiB / 983 GiB avail 2024-08-31T05:26:33.417 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:33 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:33.417 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:33 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:33.417 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:33 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:26:33.417 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:33 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:26:33.417 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:33 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:33.464 INFO:teuthology.orchestra.run.smithi070.stdout:Created osd(s) 11 on host 'smithi070' 2024-08-31T05:26:33.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:33.461+0000 7f21bbfff640 1 -- 172.21.15.70:0/2230702453 <== mgr.14220 v2:172.21.15.5:6800/2696053609 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f21c410b9b0 con 0x7f21b00b4bb0 2024-08-31T05:26:33.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:33.464+0000 7f21c8ed1640 1 -- 172.21.15.70:0/2230702453 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f21b00b4bb0 msgr2=0x7f21b00b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:33.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:33.464+0000 7f21c8ed1640 1 --2- 172.21.15.70:0/2230702453 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f21b00b4bb0 0x7f21b00b70c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f21c4106200 tx=0x7f21ac005f90 comp rx=0 tx=0).stop 2024-08-31T05:26:33.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:33.464+0000 7f21c8ed1640 1 -- 172.21.15.70:0/2230702453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21c4103900 msgr2=0x7f21c419a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:33.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:33.464+0000 7f21c8ed1640 1 --2- 172.21.15.70:0/2230702453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21c4103900 0x7f21c419a280 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f21b400c920 tx=0x7f21b400cde0 comp rx=0 tx=0).stop 2024-08-31T05:26:33.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:33.464+0000 7f21c8ed1640 1 -- 172.21.15.70:0/2230702453 shutdown_connections 2024-08-31T05:26:33.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:33.464+0000 7f21c8ed1640 1 --2- 172.21.15.70:0/2230702453 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f21b00b4bb0 0x7f21b00b70c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:33.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:33.464+0000 7f21c8ed1640 1 --2- 172.21.15.70:0/2230702453 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f21c4109b90 0x7f21c419fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:33.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:33.464+0000 7f21c8ed1640 1 --2- 172.21.15.70:0/2230702453 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21c4109240 0x7f21c419a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:33.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:33.464+0000 7f21c8ed1640 1 --2- 172.21.15.70:0/2230702453 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f21c4103900 0x7f21c419a280 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:33.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:33.464+0000 7f21c8ed1640 1 -- 172.21.15.70:0/2230702453 >> 172.21.15.70:0/2230702453 conn(0x7f21c407b5f0 msgr2=0x7f21c4107250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:26:33.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:33.465+0000 7f21c8ed1640 1 -- 172.21.15.70:0/2230702453 shutdown_connections 2024-08-31T05:26:33.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:33.465+0000 7f21c8ed1640 1 -- 172.21.15.70:0/2230702453 wait complete. 2024-08-31T05:26:33.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:33 smithi005 ceph-mon[18602]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 983 GiB / 983 GiB avail 2024-08-31T05:26:33.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:33 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:33.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:33 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:33.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:33 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:26:33.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:33 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:26:33.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:33 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:33.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:33 smithi050 ceph-mon[22146]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 983 GiB / 983 GiB avail 2024-08-31T05:26:33.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:33 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:33.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:33 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:33.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:33 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:26:33.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:33 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:26:33.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:33 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:34.206 DEBUG:teuthology.orchestra.run.smithi070:osd.11> sudo journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@osd.11.service 2024-08-31T05:26:34.208 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-08-31T05:26:34.209 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph osd stat -f json 2024-08-31T05:26:34.335 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:34 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:26:34.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:34 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:34.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:34 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:34.473 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:26:34.593 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:34 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:26:34.593 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:34 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:34.593 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:34 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:34.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:34 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:26:34.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:34 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:34.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:34 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:34.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:34.931+0000 7fa1f58b8640 1 -- 172.21.15.5:0/598376764 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1f0109b90 msgr2=0x7fa1f01103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:34.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:34.931+0000 7fa1f58b8640 1 --2- 172.21.15.5:0/598376764 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1f0109b90 0x7fa1f01103c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8009900 tx=0x7fa1e802a410 comp rx=0 tx=0).stop 2024-08-31T05:26:34.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:34.931+0000 7fa1f58b8640 1 -- 172.21.15.5:0/598376764 shutdown_connections 2024-08-31T05:26:34.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:34.931+0000 7fa1f58b8640 1 --2- 172.21.15.5:0/598376764 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1f0109b90 0x7fa1f01103c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:34.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:34.931+0000 7fa1f58b8640 1 --2- 172.21.15.5:0/598376764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1f0109240 0x7fa1f0109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:34.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:34.931+0000 7fa1f58b8640 1 --2- 172.21.15.5:0/598376764 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1f0103900 0x7fa1f0103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:34.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:34.931+0000 7fa1f58b8640 1 -- 172.21.15.5:0/598376764 >> 172.21.15.5:0/598376764 conn(0x7fa1f007b5f0 msgr2=0x7fa1f007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:26:34.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:34.931+0000 7fa1f58b8640 1 -- 172.21.15.5:0/598376764 shutdown_connections 2024-08-31T05:26:34.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:34.931+0000 7fa1f58b8640 1 -- 172.21.15.5:0/598376764 wait complete. 2024-08-31T05:26:34.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:34.932+0000 7fa1f58b8640 1 Processor -- start 2024-08-31T05:26:34.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:34.932+0000 7fa1f58b8640 1 -- start start 2024-08-31T05:26:34.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:34.932+0000 7fa1f58b8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1f0103900 0x7fa1f00754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:34.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:34.932+0000 7fa1f58b8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1f0109240 0x7fa1f00759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:34.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:34.932+0000 7fa1f58b8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1f0109b90 0x7fa1f0075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:34.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:34.932+0000 7fa1f58b8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f0113850 con 0x7fa1f0109b90 2024-08-31T05:26:34.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:34.932+0000 7fa1f58b8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f01136d0 con 0x7fa1f0109240 2024-08-31T05:26:34.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:34.932+0000 7fa1f58b8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f01139d0 con 0x7fa1f0103900 2024-08-31T05:26:34.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:34.932+0000 7fa1ef7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1f0109b90 0x7fa1f0075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:34.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:34.932+0000 7fa1eeffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1f0103900 0x7fa1f00754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:34.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:34.932+0000 7fa1ef7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1f0109b90 0x7fa1f0075f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40780/0 (socket says 172.21.15.5:40780) 2024-08-31T05:26:34.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:34.932+0000 7fa1eeffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1f0103900 0x7fa1f00754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:56014/0 (socket says 172.21.15.5:56014) 2024-08-31T05:26:34.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:34.932+0000 7fa1ef7fe640 1 -- 172.21.15.5:0/2624571899 learned_addr learned my addr 172.21.15.5:0/2624571899 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:26:34.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:34.932+0000 7fa1ee7fc640 1 --2- 172.21.15.5:0/2624571899 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1f0109240 0x7fa1f00759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:34.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:34.933+0000 7fa1eeffd640 1 -- 172.21.15.5:0/2624571899 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1f0109240 msgr2=0x7fa1f00759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:34.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:34.933+0000 7fa1eeffd640 1 --2- 172.21.15.5:0/2624571899 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1f0109240 0x7fa1f00759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:34.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:34.933+0000 7fa1eeffd640 1 -- 172.21.15.5:0/2624571899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1f0109b90 msgr2=0x7fa1f0075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:34.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:34.933+0000 7fa1eeffd640 1 --2- 172.21.15.5:0/2624571899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1f0109b90 0x7fa1f0075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:34.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:34.933+0000 7fa1eeffd640 1 -- 172.21.15.5:0/2624571899 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1f01a84e0 con 0x7fa1f0103900 2024-08-31T05:26:34.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:34.933+0000 7fa1ef7fe640 1 --2- 172.21.15.5:0/2624571899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1f0109b90 0x7fa1f0075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:26:34.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:34.933+0000 7fa1eeffd640 1 --2- 172.21.15.5:0/2624571899 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1f0103900 0x7fa1f00754b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0005fd0 tx=0x7fa1e000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:26:34.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:34.933+0000 7fa1f48b6640 1 -- 172.21.15.5:0/2624571899 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e000cd80 con 0x7fa1f0103900 2024-08-31T05:26:34.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:34.933+0000 7fa1f48b6640 1 -- 172.21.15.5:0/2624571899 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1e0005020 con 0x7fa1f0103900 2024-08-31T05:26:34.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:34.933+0000 7fa1f48b6640 1 -- 172.21.15.5:0/2624571899 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e00116d0 con 0x7fa1f0103900 2024-08-31T05:26:34.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:34.933+0000 7fa1f58b8640 1 -- 172.21.15.5:0/2624571899 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1f01a87d0 con 0x7fa1f0103900 2024-08-31T05:26:34.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:34.933+0000 7fa1f58b8640 1 -- 172.21.15.5:0/2624571899 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1f01a8cc0 con 0x7fa1f0103900 2024-08-31T05:26:34.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:34.934+0000 7fa1f58b8640 1 -- 172.21.15.5:0/2624571899 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1f0103d10 con 0x7fa1f0103900 2024-08-31T05:26:34.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:34.936+0000 7fa1f48b6640 1 -- 172.21.15.5:0/2624571899 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7fa1e00054d0 con 0x7fa1f0103900 2024-08-31T05:26:34.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:34.936+0000 7fa1f48b6640 1 --2- 172.21.15.5:0/2624571899 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa1dc0b4b80 0x7fa1dc0b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:34.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:34.936+0000 7fa1ee7fc640 1 --2- 172.21.15.5:0/2624571899 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa1dc0b4b80 0x7fa1dc0b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:34.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:34.937+0000 7fa1f48b6640 1 -- 172.21.15.5:0/2624571899 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7024+0+0 (secure 0 0 0) 0x7fa1e00e4df0 con 0x7fa1f0103900 2024-08-31T05:26:34.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:34.937+0000 7fa1ee7fc640 1 --2- 172.21.15.5:0/2624571899 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa1dc0b4b80 0x7fa1dc0b7090 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0106ce0 tx=0x7fa1d800b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:26:34.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:34.941+0000 7fa1f48b6640 1 -- 172.21.15.5:0/2624571899 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa1e0016030 con 0x7fa1f0103900 2024-08-31T05:26:35.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:35.132+0000 7fa1f58b8640 1 -- 172.21.15.5:0/2624571899 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fa1f002e430 con 0x7fa1f0103900 2024-08-31T05:26:35.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:35.133+0000 7fa1f48b6640 1 -- 172.21.15.5:0/2624571899 <== mon.1 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v68) ==== 74+0+133 (secure 0 0 0) 0x7fa1e00abd60 con 0x7fa1f0103900 2024-08-31T05:26:35.135 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:26:35.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:35.135+0000 7fa1f58b8640 1 -- 172.21.15.5:0/2624571899 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa1dc0b4b80 msgr2=0x7fa1dc0b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:35.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:35.135+0000 7fa1f58b8640 1 --2- 172.21.15.5:0/2624571899 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa1dc0b4b80 0x7fa1dc0b7090 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0106ce0 tx=0x7fa1d800b390 comp rx=0 tx=0).stop 2024-08-31T05:26:35.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:35.135+0000 7fa1f58b8640 1 -- 172.21.15.5:0/2624571899 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1f0103900 msgr2=0x7fa1f00754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:35.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:35.135+0000 7fa1f58b8640 1 --2- 172.21.15.5:0/2624571899 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1f0103900 0x7fa1f00754b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0005fd0 tx=0x7fa1e000ee80 comp rx=0 tx=0).stop 2024-08-31T05:26:35.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:35.135+0000 7fa1f58b8640 1 -- 172.21.15.5:0/2624571899 shutdown_connections 2024-08-31T05:26:35.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:35.135+0000 7fa1f58b8640 1 --2- 172.21.15.5:0/2624571899 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa1dc0b4b80 0x7fa1dc0b7090 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:35.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:35.135+0000 7fa1f58b8640 1 --2- 172.21.15.5:0/2624571899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa1f0109b90 0x7fa1f0075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:35.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:35.135+0000 7fa1f58b8640 1 --2- 172.21.15.5:0/2624571899 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa1f0109240 0x7fa1f00759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:35.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:35.135+0000 7fa1f58b8640 1 --2- 172.21.15.5:0/2624571899 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1f0103900 0x7fa1f00754b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:35.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:35.135+0000 7fa1f58b8640 1 -- 172.21.15.5:0/2624571899 >> 172.21.15.5:0/2624571899 conn(0x7fa1f007b5f0 msgr2=0x7fa1f0105210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:26:35.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:35.135+0000 7fa1f58b8640 1 -- 172.21.15.5:0/2624571899 shutdown_connections 2024-08-31T05:26:35.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:35.135+0000 7fa1f58b8640 1 -- 172.21.15.5:0/2624571899 wait complete. 2024-08-31T05:26:35.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:35 smithi005 ceph-mon[18602]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 983 GiB / 983 GiB avail 2024-08-31T05:26:35.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:35 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/2624571899' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-31T05:26:35.480 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:35 smithi070 ceph-mon[22316]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 983 GiB / 983 GiB avail 2024-08-31T05:26:35.480 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:35 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/2624571899' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-31T05:26:35.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:35 smithi050 ceph-mon[22146]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 983 GiB / 983 GiB avail 2024-08-31T05:26:35.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:35 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/2624571899' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-31T05:26:35.932 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":68,"num_osds":12,"num_up_osds":11,"osd_up_since":1725081972,"num_in_osds":12,"osd_in_since":1725081975,"num_remapped_pgs":0} 2024-08-31T05:26:36.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:26:35 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:26:35.884+0000 7f32e7b3f640 -1 osd.11 0 log_to_monitors true 2024-08-31T05:26:36.522 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:36 smithi070 ceph-mon[22316]: from='osd.11 [v2:172.21.15.70:6824/2593470535,v1:172.21.15.70:6825/2593470535]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-31T05:26:36.522 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:36 smithi070 ceph-mon[22316]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-31T05:26:36.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:36 smithi050 ceph-mon[22146]: from='osd.11 [v2:172.21.15.70:6824/2593470535,v1:172.21.15.70:6825/2593470535]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-31T05:26:36.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:36 smithi050 ceph-mon[22146]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-31T05:26:36.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:36 smithi005 ceph-mon[18602]: from='osd.11 [v2:172.21.15.70:6824/2593470535,v1:172.21.15.70:6825/2593470535]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-31T05:26:36.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:36 smithi005 ceph-mon[18602]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-31T05:26:36.933 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph osd stat -f json 2024-08-31T05:26:37.191 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:26:37.498 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:37 smithi005 ceph-mon[18602]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 983 GiB / 983 GiB avail 2024-08-31T05:26:37.498 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:37 smithi005 ceph-mon[18602]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-08-31T05:26:37.499 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:37 smithi005 ceph-mon[18602]: osdmap e69: 12 total, 11 up, 12 in 2024-08-31T05:26:37.499 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:37 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T05:26:37.499 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:37 smithi005 ceph-mon[18602]: from='osd.11 [v2:172.21.15.70:6824/2593470535,v1:172.21.15.70:6825/2593470535]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-08-31T05:26:37.499 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:37 smithi005 ceph-mon[18602]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-08-31T05:26:37.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:37 smithi070 ceph-mon[22316]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 983 GiB / 983 GiB avail 2024-08-31T05:26:37.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:37 smithi070 ceph-mon[22316]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-08-31T05:26:37.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:37 smithi070 ceph-mon[22316]: osdmap e69: 12 total, 11 up, 12 in 2024-08-31T05:26:37.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:37 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T05:26:37.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:37 smithi070 ceph-mon[22316]: from='osd.11 [v2:172.21.15.70:6824/2593470535,v1:172.21.15.70:6825/2593470535]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-08-31T05:26:37.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:37 smithi070 ceph-mon[22316]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-08-31T05:26:37.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:37 smithi050 ceph-mon[22146]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 983 GiB / 983 GiB avail 2024-08-31T05:26:37.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:37 smithi050 ceph-mon[22146]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-08-31T05:26:37.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:37 smithi050 ceph-mon[22146]: osdmap e69: 12 total, 11 up, 12 in 2024-08-31T05:26:37.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:37 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T05:26:37.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:37 smithi050 ceph-mon[22146]: from='osd.11 [v2:172.21.15.70:6824/2593470535,v1:172.21.15.70:6825/2593470535]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-08-31T05:26:37.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:37 smithi050 ceph-mon[22146]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi070", "root=default"]} : dispatch 2024-08-31T05:26:37.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.698+0000 7f8e99ab9640 1 -- 172.21.15.5:0/2206498792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e94102800 msgr2=0x7f8e94102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:37.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.698+0000 7f8e99ab9640 1 --2- 172.21.15.5:0/2206498792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e94102800 0x7f8e94102c10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8e84009900 tx=0x7f8e8402a410 comp rx=0 tx=0).stop 2024-08-31T05:26:37.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.698+0000 7f8e99ab9640 1 -- 172.21.15.5:0/2206498792 shutdown_connections 2024-08-31T05:26:37.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.698+0000 7f8e99ab9640 1 --2- 172.21.15.5:0/2206498792 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e94108a90 0x7f8e9410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:37.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.698+0000 7f8e99ab9640 1 --2- 172.21.15.5:0/2206498792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e94108140 0x7f8e94108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:37.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.698+0000 7f8e99ab9640 1 --2- 172.21.15.5:0/2206498792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e94102800 0x7f8e94102c10 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:37.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.698+0000 7f8e99ab9640 1 -- 172.21.15.5:0/2206498792 >> 172.21.15.5:0/2206498792 conn(0x7f8e940794d0 msgr2=0x7f8e940798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:26:37.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.698+0000 7f8e99ab9640 1 -- 172.21.15.5:0/2206498792 shutdown_connections 2024-08-31T05:26:37.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.698+0000 7f8e99ab9640 1 -- 172.21.15.5:0/2206498792 wait complete. 2024-08-31T05:26:37.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.699+0000 7f8e99ab9640 1 Processor -- start 2024-08-31T05:26:37.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.699+0000 7f8e99ab9640 1 -- start start 2024-08-31T05:26:37.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.699+0000 7f8e99ab9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e94102800 0x7f8e9419b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:37.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.699+0000 7f8e99ab9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e94108140 0x7f8e9419b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:37.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.699+0000 7f8e99ab9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e94108a90 0x7f8e9419bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:37.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.699+0000 7f8e99ab9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8e941126f0 con 0x7f8e94102800 2024-08-31T05:26:37.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.699+0000 7f8e99ab9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8e94112570 con 0x7f8e94108a90 2024-08-31T05:26:37.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.699+0000 7f8e99ab9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8e94112870 con 0x7f8e94108140 2024-08-31T05:26:37.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.699+0000 7f8e937fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e94102800 0x7f8e9419b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:37.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.699+0000 7f8e937fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e94102800 0x7f8e9419b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40788/0 (socket says 172.21.15.5:40788) 2024-08-31T05:26:37.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.699+0000 7f8e937fe640 1 -- 172.21.15.5:0/779266731 learned_addr learned my addr 172.21.15.5:0/779266731 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:26:37.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.700+0000 7f8e93fff640 1 --2- 172.21.15.5:0/779266731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e94108a90 0x7f8e9419bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:37.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.700+0000 7f8e8affd640 1 --2- 172.21.15.5:0/779266731 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e94108140 0x7f8e9419b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:37.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.700+0000 7f8e937fe640 1 -- 172.21.15.5:0/779266731 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e94108140 msgr2=0x7f8e9419b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:37.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.700+0000 7f8e937fe640 1 --2- 172.21.15.5:0/779266731 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e94108140 0x7f8e9419b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:37.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.700+0000 7f8e937fe640 1 -- 172.21.15.5:0/779266731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e94108a90 msgr2=0x7f8e9419bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:37.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.700+0000 7f8e937fe640 1 --2- 172.21.15.5:0/779266731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e94108a90 0x7f8e9419bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:37.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.700+0000 7f8e937fe640 1 -- 172.21.15.5:0/779266731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e941a6370 con 0x7f8e94102800 2024-08-31T05:26:37.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.700+0000 7f8e8affd640 1 --2- 172.21.15.5:0/779266731 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e94108140 0x7f8e9419b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:26:37.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.700+0000 7f8e937fe640 1 --2- 172.21.15.5:0/779266731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e94102800 0x7f8e9419b060 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8e84005940 tx=0x7f8e840042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:26:37.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.700+0000 7f8e917fa640 1 -- 172.21.15.5:0/779266731 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e8403f030 con 0x7f8e94102800 2024-08-31T05:26:37.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.700+0000 7f8e99ab9640 1 -- 172.21.15.5:0/779266731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e941a6600 con 0x7f8e94102800 2024-08-31T05:26:37.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.700+0000 7f8e917fa640 1 -- 172.21.15.5:0/779266731 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e84003cb0 con 0x7f8e94102800 2024-08-31T05:26:37.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.700+0000 7f8e917fa640 1 -- 172.21.15.5:0/779266731 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e84035070 con 0x7f8e94102800 2024-08-31T05:26:37.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.700+0000 7f8e99ab9640 1 -- 172.21.15.5:0/779266731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e941a6b30 con 0x7f8e94102800 2024-08-31T05:26:37.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.701+0000 7f8e99ab9640 1 -- 172.21.15.5:0/779266731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e94102c10 con 0x7f8e94102800 2024-08-31T05:26:37.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.703+0000 7f8e917fa640 1 -- 172.21.15.5:0/779266731 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f8e84042030 con 0x7f8e94102800 2024-08-31T05:26:37.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.703+0000 7f8e917fa640 1 --2- 172.21.15.5:0/779266731 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f8e800b4b80 0x7f8e800b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:37.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.704+0000 7f8e8affd640 1 --2- 172.21.15.5:0/779266731 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f8e800b4b80 0x7f8e800b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:37.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.704+0000 7f8e917fa640 1 -- 172.21.15.5:0/779266731 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7062+0+0 (secure 0 0 0) 0x7f8e84105890 con 0x7f8e94102800 2024-08-31T05:26:37.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.704+0000 7f8e8affd640 1 --2- 172.21.15.5:0/779266731 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f8e800b4b80 0x7f8e800b7090 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c0058c0 tx=0x7f8e7c005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:26:37.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.707+0000 7f8e917fa640 1 -- 172.21.15.5:0/779266731 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8e840ccea0 con 0x7f8e94102800 2024-08-31T05:26:37.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.893+0000 7f8e99ab9640 1 -- 172.21.15.5:0/779266731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f8e9410a8c0 con 0x7f8e94102800 2024-08-31T05:26:37.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.893+0000 7f8e917fa640 1 -- 172.21.15.5:0/779266731 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v70) ==== 74+0+133 (secure 0 0 0) 0x7f8e840d53e0 con 0x7f8e94102800 2024-08-31T05:26:37.896 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:26:37.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.895+0000 7f8e99ab9640 1 -- 172.21.15.5:0/779266731 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f8e800b4b80 msgr2=0x7f8e800b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:37.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.895+0000 7f8e99ab9640 1 --2- 172.21.15.5:0/779266731 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f8e800b4b80 0x7f8e800b7090 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c0058c0 tx=0x7f8e7c005850 comp rx=0 tx=0).stop 2024-08-31T05:26:37.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.895+0000 7f8e99ab9640 1 -- 172.21.15.5:0/779266731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e94102800 msgr2=0x7f8e9419b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:37.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.895+0000 7f8e99ab9640 1 --2- 172.21.15.5:0/779266731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e94102800 0x7f8e9419b060 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8e84005940 tx=0x7f8e840042f0 comp rx=0 tx=0).stop 2024-08-31T05:26:37.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.896+0000 7f8e99ab9640 1 -- 172.21.15.5:0/779266731 shutdown_connections 2024-08-31T05:26:37.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.896+0000 7f8e99ab9640 1 --2- 172.21.15.5:0/779266731 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f8e800b4b80 0x7f8e800b7090 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:37.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.896+0000 7f8e99ab9640 1 --2- 172.21.15.5:0/779266731 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8e94108a90 0x7f8e9419bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:37.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.896+0000 7f8e99ab9640 1 --2- 172.21.15.5:0/779266731 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e94108140 0x7f8e9419b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:37.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.896+0000 7f8e99ab9640 1 --2- 172.21.15.5:0/779266731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e94102800 0x7f8e9419b060 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:37.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.896+0000 7f8e99ab9640 1 -- 172.21.15.5:0/779266731 >> 172.21.15.5:0/779266731 conn(0x7f8e940794d0 msgr2=0x7f8e94101250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:26:37.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.896+0000 7f8e99ab9640 1 -- 172.21.15.5:0/779266731 shutdown_connections 2024-08-31T05:26:37.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:37.896+0000 7f8e99ab9640 1 -- 172.21.15.5:0/779266731 wait complete. 2024-08-31T05:26:38.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:26:37 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:26:37.672+0000 7f32e3ac1640 -1 osd.11 0 waiting for initial osdmap 2024-08-31T05:26:38.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:26:37 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:26:37.687+0000 7f32db8b7640 -1 osd.11 70 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T05:26:38.360 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:38 smithi070 ceph-mon[22316]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-08-31T05:26:38.361 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:38 smithi070 ceph-mon[22316]: osdmap e70: 12 total, 11 up, 12 in 2024-08-31T05:26:38.361 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:38 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T05:26:38.361 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:38 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T05:26:38.361 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:38 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:38.361 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:38 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:38.361 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:38 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T05:26:38.361 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:38 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T05:26:38.361 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:38 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T05:26:38.361 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:38 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-31T05:26:38.361 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:38 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:38.361 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:38 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:26:38.361 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:38 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:26:38.362 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:38 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:38.362 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:38 smithi070 ceph-mon[22316]: from='osd.11 ' entity='osd.11' 2024-08-31T05:26:38.362 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:38 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/779266731' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-31T05:26:38.531 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:38 smithi005 ceph-mon[18602]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-08-31T05:26:38.531 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:38 smithi005 ceph-mon[18602]: osdmap e70: 12 total, 11 up, 12 in 2024-08-31T05:26:38.531 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:38 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T05:26:38.531 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:38 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T05:26:38.532 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:38 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:38.532 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:38 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:38.532 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:38 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T05:26:38.532 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:38 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T05:26:38.532 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:38 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T05:26:38.532 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:38 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-31T05:26:38.532 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:38 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:38.532 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:38 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:26:38.532 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:38 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:26:38.532 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:38 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:38.532 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:38 smithi005 ceph-mon[18602]: from='osd.11 ' entity='osd.11' 2024-08-31T05:26:38.532 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:38 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/779266731' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-31T05:26:38.559 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":70,"num_osds":12,"num_up_osds":11,"osd_up_since":1725081972,"num_in_osds":12,"osd_in_since":1725081975,"num_remapped_pgs":0} 2024-08-31T05:26:38.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:38 smithi050 ceph-mon[22146]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-08-31T05:26:38.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:38 smithi050 ceph-mon[22146]: osdmap e70: 12 total, 11 up, 12 in 2024-08-31T05:26:38.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:38 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T05:26:38.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:38 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T05:26:38.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:38 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:38.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:38 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:38.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:38 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T05:26:38.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:38 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T05:26:38.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:38 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T05:26:38.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:38 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-31T05:26:38.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:38 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:38.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:38 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:26:38.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:38 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:26:38.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:38 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:38.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:38 smithi050 ceph-mon[22146]: from='osd.11 ' entity='osd.11' 2024-08-31T05:26:38.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:38 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/779266731' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-31T05:26:39.560 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph osd stat -f json 2024-08-31T05:26:39.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:39 smithi070 ceph-mon[22316]: purged_snaps scrub starts 2024-08-31T05:26:39.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:39 smithi070 ceph-mon[22316]: purged_snaps scrub ok 2024-08-31T05:26:39.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:39 smithi070 ceph-mon[22316]: Detected new or changed devices on smithi070 2024-08-31T05:26:39.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:39 smithi070 ceph-mon[22316]: Adjusting osd_memory_target on smithi070 to 4272M 2024-08-31T05:26:39.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:39 smithi070 ceph-mon[22316]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 983 GiB / 983 GiB avail 2024-08-31T05:26:39.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:39 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T05:26:39.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:39 smithi070 ceph-mon[22316]: osd.11 [v2:172.21.15.70:6824/2593470535,v1:172.21.15.70:6825/2593470535] boot 2024-08-31T05:26:39.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:39 smithi070 ceph-mon[22316]: osdmap e71: 12 total, 12 up, 12 in 2024-08-31T05:26:39.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:39 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T05:26:39.588 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:39 smithi005 ceph-mon[18602]: purged_snaps scrub starts 2024-08-31T05:26:39.588 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:39 smithi005 ceph-mon[18602]: purged_snaps scrub ok 2024-08-31T05:26:39.588 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:39 smithi005 ceph-mon[18602]: Detected new or changed devices on smithi070 2024-08-31T05:26:39.588 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:39 smithi005 ceph-mon[18602]: Adjusting osd_memory_target on smithi070 to 4272M 2024-08-31T05:26:39.588 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:39 smithi005 ceph-mon[18602]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 983 GiB / 983 GiB avail 2024-08-31T05:26:39.588 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:39 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T05:26:39.588 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:39 smithi005 ceph-mon[18602]: osd.11 [v2:172.21.15.70:6824/2593470535,v1:172.21.15.70:6825/2593470535] boot 2024-08-31T05:26:39.588 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:39 smithi005 ceph-mon[18602]: osdmap e71: 12 total, 12 up, 12 in 2024-08-31T05:26:39.588 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:39 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T05:26:39.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:39 smithi050 ceph-mon[22146]: purged_snaps scrub starts 2024-08-31T05:26:39.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:39 smithi050 ceph-mon[22146]: purged_snaps scrub ok 2024-08-31T05:26:39.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:39 smithi050 ceph-mon[22146]: Detected new or changed devices on smithi070 2024-08-31T05:26:39.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:39 smithi050 ceph-mon[22146]: Adjusting osd_memory_target on smithi070 to 4272M 2024-08-31T05:26:39.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:39 smithi050 ceph-mon[22146]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 983 GiB / 983 GiB avail 2024-08-31T05:26:39.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:39 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T05:26:39.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:39 smithi050 ceph-mon[22146]: osd.11 [v2:172.21.15.70:6824/2593470535,v1:172.21.15.70:6825/2593470535] boot 2024-08-31T05:26:39.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:39 smithi050 ceph-mon[22146]: osdmap e71: 12 total, 12 up, 12 in 2024-08-31T05:26:39.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:39 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T05:26:39.824 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:26:40.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.450+0000 7f28be9b1640 1 -- 172.21.15.5:0/2721853457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28b8104770 msgr2=0x7f28b8104b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:40.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.450+0000 7f28be9b1640 1 --2- 172.21.15.5:0/2721853457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28b8104770 0x7f28b8104b80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f28a8009900 tx=0x7f28a802a3f0 comp rx=0 tx=0).stop 2024-08-31T05:26:40.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.450+0000 7f28be9b1640 1 -- 172.21.15.5:0/2721853457 shutdown_connections 2024-08-31T05:26:40.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.450+0000 7f28be9b1640 1 --2- 172.21.15.5:0/2721853457 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28b810dbd0 0x7f28b81100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:40.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.450+0000 7f28be9b1640 1 --2- 172.21.15.5:0/2721853457 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28b81050c0 0x7f28b810d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:40.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.450+0000 7f28be9b1640 1 --2- 172.21.15.5:0/2721853457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28b8104770 0x7f28b8104b80 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:40.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.450+0000 7f28be9b1640 1 -- 172.21.15.5:0/2721853457 >> 172.21.15.5:0/2721853457 conn(0x7f28b80794e0 msgr2=0x7f28b80798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:26:40.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.450+0000 7f28be9b1640 1 -- 172.21.15.5:0/2721853457 shutdown_connections 2024-08-31T05:26:40.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.450+0000 7f28be9b1640 1 -- 172.21.15.5:0/2721853457 wait complete. 2024-08-31T05:26:40.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.451+0000 7f28be9b1640 1 Processor -- start 2024-08-31T05:26:40.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.451+0000 7f28be9b1640 1 -- start start 2024-08-31T05:26:40.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.451+0000 7f28be9b1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28b8104770 0x7f28b81024b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:40.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.451+0000 7f28be9b1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28b81050c0 0x7f28b81029f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:40.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.451+0000 7f28be9b1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28b810dbd0 0x7f28b8102f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:40.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.451+0000 7f28be9b1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f28b8113880 con 0x7f28b81050c0 2024-08-31T05:26:40.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.451+0000 7f28be9b1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f28b8113700 con 0x7f28b8104770 2024-08-31T05:26:40.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.451+0000 7f28be9b1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f28b8113a00 con 0x7f28b810dbd0 2024-08-31T05:26:40.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.452+0000 7f28b77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28b81050c0 0x7f28b81029f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:40.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.452+0000 7f28b77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28b81050c0 0x7f28b81029f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40814/0 (socket says 172.21.15.5:40814) 2024-08-31T05:26:40.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.452+0000 7f28b77fe640 1 -- 172.21.15.5:0/2313557271 learned_addr learned my addr 172.21.15.5:0/2313557271 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:26:40.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.452+0000 7f28b7fff640 1 --2- 172.21.15.5:0/2313557271 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28b8104770 0x7f28b81024b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:40.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.452+0000 7f28bcf4e640 1 --2- 172.21.15.5:0/2313557271 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28b810dbd0 0x7f28b8102f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:40.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.452+0000 7f28b77fe640 1 -- 172.21.15.5:0/2313557271 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28b810dbd0 msgr2=0x7f28b8102f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:40.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.452+0000 7f28b77fe640 1 --2- 172.21.15.5:0/2313557271 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28b810dbd0 0x7f28b8102f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:40.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.452+0000 7f28b77fe640 1 -- 172.21.15.5:0/2313557271 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28b8104770 msgr2=0x7f28b81024b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:40.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.452+0000 7f28b77fe640 1 --2- 172.21.15.5:0/2313557271 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28b8104770 0x7f28b81024b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:40.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.452+0000 7f28b77fe640 1 -- 172.21.15.5:0/2313557271 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28b81a8480 con 0x7f28b81050c0 2024-08-31T05:26:40.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.452+0000 7f28bcf4e640 1 --2- 172.21.15.5:0/2313557271 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28b810dbd0 0x7f28b8102f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:26:40.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.452+0000 7f28b77fe640 1 --2- 172.21.15.5:0/2313557271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28b81050c0 0x7f28b81029f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f28ac00c8c0 tx=0x7f28ac00cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:26:40.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.452+0000 7f28b57fa640 1 -- 172.21.15.5:0/2313557271 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28ac007bb0 con 0x7f28b81050c0 2024-08-31T05:26:40.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.452+0000 7f28be9b1640 1 -- 172.21.15.5:0/2313557271 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28b81a8770 con 0x7f28b81050c0 2024-08-31T05:26:40.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.452+0000 7f28b57fa640 1 -- 172.21.15.5:0/2313557271 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f28ac007d50 con 0x7f28b81050c0 2024-08-31T05:26:40.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.452+0000 7f28b57fa640 1 -- 172.21.15.5:0/2313557271 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28ac0187c0 con 0x7f28b81050c0 2024-08-31T05:26:40.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.452+0000 7f28be9b1640 1 -- 172.21.15.5:0/2313557271 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28b81a8c80 con 0x7f28b81050c0 2024-08-31T05:26:40.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.453+0000 7f28be9b1640 1 -- 172.21.15.5:0/2313557271 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28b806bfe0 con 0x7f28b81050c0 2024-08-31T05:26:40.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.455+0000 7f28b57fa640 1 -- 172.21.15.5:0/2313557271 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f28ac00fa20 con 0x7f28b81050c0 2024-08-31T05:26:40.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.456+0000 7f28b57fa640 1 --2- 172.21.15.5:0/2313557271 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f28a00b4b80 0x7f28a00b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:40.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.456+0000 7f28b7fff640 1 --2- 172.21.15.5:0/2313557271 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f28a00b4b80 0x7f28a00b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:40.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.456+0000 7f28b57fa640 1 -- 172.21.15.5:0/2313557271 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7f28ac0e51d0 con 0x7f28b81050c0 2024-08-31T05:26:40.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.456+0000 7f28b7fff640 1 --2- 172.21.15.5:0/2313557271 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f28a00b4b80 0x7f28a00b7090 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f28a8031440 tx=0x7f28a8005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:26:40.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.459+0000 7f28b57fa640 1 -- 172.21.15.5:0/2313557271 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f28ac014030 con 0x7f28b81050c0 2024-08-31T05:26:40.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.647+0000 7f28be9b1640 1 -- 172.21.15.5:0/2313557271 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f28b81037b0 con 0x7f28b81050c0 2024-08-31T05:26:40.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.647+0000 7f28b57fa640 1 -- 172.21.15.5:0/2313557271 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v72) ==== 74+0+133 (secure 0 0 0) 0x7f28b81037b0 con 0x7f28b81050c0 2024-08-31T05:26:40.649 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:26:40.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.649+0000 7f28be9b1640 1 -- 172.21.15.5:0/2313557271 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f28a00b4b80 msgr2=0x7f28a00b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:40.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.649+0000 7f28be9b1640 1 --2- 172.21.15.5:0/2313557271 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f28a00b4b80 0x7f28a00b7090 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f28a8031440 tx=0x7f28a8005a20 comp rx=0 tx=0).stop 2024-08-31T05:26:40.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.649+0000 7f28be9b1640 1 -- 172.21.15.5:0/2313557271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28b81050c0 msgr2=0x7f28b81029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:40.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.649+0000 7f28be9b1640 1 --2- 172.21.15.5:0/2313557271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28b81050c0 0x7f28b81029f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f28ac00c8c0 tx=0x7f28ac00cd80 comp rx=0 tx=0).stop 2024-08-31T05:26:40.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.650+0000 7f28be9b1640 1 -- 172.21.15.5:0/2313557271 shutdown_connections 2024-08-31T05:26:40.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.650+0000 7f28be9b1640 1 --2- 172.21.15.5:0/2313557271 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f28a00b4b80 0x7f28a00b7090 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:40.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.650+0000 7f28be9b1640 1 --2- 172.21.15.5:0/2313557271 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28b810dbd0 0x7f28b8102f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:40.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.650+0000 7f28be9b1640 1 --2- 172.21.15.5:0/2313557271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28b81050c0 0x7f28b81029f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:40.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.650+0000 7f28be9b1640 1 --2- 172.21.15.5:0/2313557271 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f28b8104770 0x7f28b81024b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:40.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.650+0000 7f28be9b1640 1 -- 172.21.15.5:0/2313557271 >> 172.21.15.5:0/2313557271 conn(0x7f28b80794e0 msgr2=0x7f28b80ff310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:26:40.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.650+0000 7f28be9b1640 1 -- 172.21.15.5:0/2313557271 shutdown_connections 2024-08-31T05:26:40.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:40.650+0000 7f28be9b1640 1 -- 172.21.15.5:0/2313557271 wait complete. 2024-08-31T05:26:40.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:40 smithi005 ceph-mon[18602]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:26:40.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:40 smithi005 ceph-mon[18602]: osdmap e72: 12 total, 12 up, 12 in 2024-08-31T05:26:40.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:40 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/2313557271' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-31T05:26:41.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:40 smithi070 ceph-mon[22316]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:26:41.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:40 smithi070 ceph-mon[22316]: osdmap e72: 12 total, 12 up, 12 in 2024-08-31T05:26:41.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:40 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/2313557271' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-31T05:26:41.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:40 smithi050 ceph-mon[22146]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:26:41.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:40 smithi050 ceph-mon[22146]: osdmap e72: 12 total, 12 up, 12 in 2024-08-31T05:26:41.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:40 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/2313557271' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-31T05:26:41.425 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":72,"num_osds":12,"num_up_osds":12,"osd_up_since":1725081998,"num_in_osds":12,"osd_in_since":1725081975,"num_remapped_pgs":0} 2024-08-31T05:26:41.426 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T05:26:41.723 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:26:42.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.207+0000 7f13333a3640 1 -- 172.21.15.5:0/1381536062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f132c109260 msgr2=0x7f132c109670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:42.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.207+0000 7f13333a3640 1 --2- 172.21.15.5:0/1381536062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f132c109260 0x7f132c109670 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f131c009900 tx=0x7f131c02a410 comp rx=0 tx=0).stop 2024-08-31T05:26:42.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.207+0000 7f13333a3640 1 -- 172.21.15.5:0/1381536062 shutdown_connections 2024-08-31T05:26:42.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.207+0000 7f13333a3640 1 --2- 172.21.15.5:0/1381536062 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f132c109bb0 0x7f132c1103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:42.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.207+0000 7f13333a3640 1 --2- 172.21.15.5:0/1381536062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f132c109260 0x7f132c109670 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:42.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.207+0000 7f13333a3640 1 --2- 172.21.15.5:0/1381536062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f132c103920 0x7f132c103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:42.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.207+0000 7f13333a3640 1 -- 172.21.15.5:0/1381536062 >> 172.21.15.5:0/1381536062 conn(0x7f132c0ff370 msgr2=0x7f132c1017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:26:42.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.207+0000 7f13333a3640 1 -- 172.21.15.5:0/1381536062 shutdown_connections 2024-08-31T05:26:42.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.207+0000 7f13333a3640 1 -- 172.21.15.5:0/1381536062 wait complete. 2024-08-31T05:26:42.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.208+0000 7f13333a3640 1 Processor -- start 2024-08-31T05:26:42.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.208+0000 7f13333a3640 1 -- start start 2024-08-31T05:26:42.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.208+0000 7f13333a3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f132c103920 0x7f132c19a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:42.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.208+0000 7f13333a3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f132c109260 0x7f132c19a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:42.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.208+0000 7f13333a3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f132c109bb0 0x7f132c19fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:42.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.208+0000 7f13333a3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f132c113890 con 0x7f132c109bb0 2024-08-31T05:26:42.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.208+0000 7f13333a3640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f132c113710 con 0x7f132c109260 2024-08-31T05:26:42.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.208+0000 7f13333a3640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f132c113a10 con 0x7f132c103920 2024-08-31T05:26:42.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.209+0000 7f1331940640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f132c109bb0 0x7f132c19fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:42.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.209+0000 7f133093e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f132c109260 0x7f132c19a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:42.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.209+0000 7f1331940640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f132c109bb0 0x7f132c19fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39260/0 (socket says 172.21.15.5:39260) 2024-08-31T05:26:42.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.209+0000 7f1331940640 1 -- 172.21.15.5:0/4214071905 learned_addr learned my addr 172.21.15.5:0/4214071905 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:26:42.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.209+0000 7f133113f640 1 --2- 172.21.15.5:0/4214071905 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f132c103920 0x7f132c19a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:42.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.209+0000 7f1331940640 1 -- 172.21.15.5:0/4214071905 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f132c103920 msgr2=0x7f132c19a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:42.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.209+0000 7f1331940640 1 --2- 172.21.15.5:0/4214071905 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f132c103920 0x7f132c19a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:42.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.209+0000 7f1331940640 1 -- 172.21.15.5:0/4214071905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f132c109260 msgr2=0x7f132c19a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:42.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.209+0000 7f1331940640 1 --2- 172.21.15.5:0/4214071905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f132c109260 0x7f132c19a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:42.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.209+0000 7f1331940640 1 -- 172.21.15.5:0/4214071905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f132c1a0210 con 0x7f132c109bb0 2024-08-31T05:26:42.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.209+0000 7f133093e640 1 --2- 172.21.15.5:0/4214071905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f132c109260 0x7f132c19a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:26:42.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.209+0000 7f1331940640 1 --2- 172.21.15.5:0/4214071905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f132c109bb0 0x7f132c19fae0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f132400b970 tx=0x7f132400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:26:42.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.209+0000 7f13227fc640 1 -- 172.21.15.5:0/4214071905 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1324019070 con 0x7f132c109bb0 2024-08-31T05:26:42.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.209+0000 7f13227fc640 1 -- 172.21.15.5:0/4214071905 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1324014440 con 0x7f132c109bb0 2024-08-31T05:26:42.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.209+0000 7f13333a3640 1 -- 172.21.15.5:0/4214071905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f132c1a0500 con 0x7f132c109bb0 2024-08-31T05:26:42.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.209+0000 7f13227fc640 1 -- 172.21.15.5:0/4214071905 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13240075d0 con 0x7f132c109bb0 2024-08-31T05:26:42.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.209+0000 7f13333a3640 1 -- 172.21.15.5:0/4214071905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f132c1a6c60 con 0x7f132c109bb0 2024-08-31T05:26:42.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.210+0000 7f13333a3640 1 -- 172.21.15.5:0/4214071905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f132c103d30 con 0x7f132c109bb0 2024-08-31T05:26:42.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.212+0000 7f13227fc640 1 -- 172.21.15.5:0/4214071905 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f132401c070 con 0x7f132c109bb0 2024-08-31T05:26:42.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.213+0000 7f13227fc640 1 --2- 172.21.15.5:0/4214071905 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f13180b4b80 0x7f13180b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:42.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.213+0000 7f133113f640 1 --2- 172.21.15.5:0/4214071905 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f13180b4b80 0x7f13180b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:42.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.213+0000 7f13227fc640 1 -- 172.21.15.5:0/4214071905 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7f13240e4730 con 0x7f132c109bb0 2024-08-31T05:26:42.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.213+0000 7f133113f640 1 --2- 172.21.15.5:0/4214071905 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f13180b4b80 0x7f13180b7090 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1328009bd0 tx=0x7f1328005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:26:42.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.216+0000 7f13227fc640 1 -- 172.21.15.5:0/4214071905 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f13240ab5e0 con 0x7f132c109bb0 2024-08-31T05:26:42.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.401+0000 7f13333a3640 1 -- 172.21.15.5:0/4214071905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f132c19b3d0 con 0x7f132c109bb0 2024-08-31T05:26:42.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.402+0000 7f13227fc640 1 -- 172.21.15.5:0/4214071905 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) ==== 74+0+18663 (secure 0 0 0) 0x7f132c19b3d0 con 0x7f132c109bb0 2024-08-31T05:26:42.405 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:26:42.405 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":72,"fsid":"69422704-6758-11ef-bcd4-c7b262605968","created":"2024-08-31T05:19:04.860258+0000","modified":"2024-08-31T05:26:39.677412+0000","last_up_change":"2024-08-31T05:26:38.675914+0000","last_in_change":"2024-08-31T05:26:15.366713+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T05:22:49.802575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c5745391-e9d7-4799-9db9-6b34bb91b7df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6803","nonce":2312496244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6805","nonce":2312496244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6809","nonce":2312496244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6807","nonce":2312496244}]},"public_addr":"172.21.15.5:6803/2312496244","cluster_addr":"172.21.15.5:6805/2312496244","heartbeat_back_addr":"172.21.15.5:6809/2312496244","heartbeat_front_addr":"172.21.15.5:6807/2312496244","state":["exists","up"]},{"osd":1,"uuid":"f1903bd7-b2c5-424e-a74e-795f729471db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6801","nonce":2777359361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6803","nonce":2777359361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6807","nonce":2777359361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6805","nonce":2777359361}]},"public_addr":"172.21.15.50:6801/2777359361","cluster_addr":"172.21.15.50:6803/2777359361","heartbeat_back_addr":"172.21.15.50:6807/2777359361","heartbeat_front_addr":"172.21.15.50:6805/2777359361","state":["exists","up"]},{"osd":2,"uuid":"134c5892-e44a-44f2-8cd2-484d22a45e2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6801","nonce":1400583716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6803","nonce":1400583716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6807","nonce":1400583716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6805","nonce":1400583716}]},"public_addr":"172.21.15.70:6801/1400583716","cluster_addr":"172.21.15.70:6803/1400583716","heartbeat_back_addr":"172.21.15.70:6807/1400583716","heartbeat_front_addr":"172.21.15.70:6805/1400583716","state":["exists","up"]},{"osd":3,"uuid":"af49398a-e171-496b-a50e-1f767fc42923","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6811","nonce":1647468379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6813","nonce":1647468379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6817","nonce":1647468379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6815","nonce":1647468379}]},"public_addr":"172.21.15.5:6811/1647468379","cluster_addr":"172.21.15.5:6813/1647468379","heartbeat_back_addr":"172.21.15.5:6817/1647468379","heartbeat_front_addr":"172.21.15.5:6815/1647468379","state":["exists","up"]},{"osd":4,"uuid":"59b847ef-6eb0-4c13-aa06-53a76d77ce45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6809","nonce":2314546877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6811","nonce":2314546877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6815","nonce":2314546877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6813","nonce":2314546877}]},"public_addr":"172.21.15.50:6809/2314546877","cluster_addr":"172.21.15.50:6811/2314546877","heartbeat_back_addr":"172.21.15.50:6815/2314546877","heartbeat_front_addr":"172.21.15.50:6813/2314546877","state":["exists","up"]},{"osd":5,"uuid":"b0dac185-4462-4760-aa36-0d221923b007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6809","nonce":311426299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6811","nonce":311426299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6815","nonce":311426299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6813","nonce":311426299}]},"public_addr":"172.21.15.70:6809/311426299","cluster_addr":"172.21.15.70:6811/311426299","heartbeat_back_addr":"172.21.15.70:6815/311426299","heartbeat_front_addr":"172.21.15.70:6813/311426299","state":["exists","up"]},{"osd":6,"uuid":"12486aa2-61e4-4bdf-94dd-ce5c4cd3df6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6819","nonce":1027645612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6821","nonce":1027645612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6825","nonce":1027645612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6823","nonce":1027645612}]},"public_addr":"172.21.15.5:6819/1027645612","cluster_addr":"172.21.15.5:6821/1027645612","heartbeat_back_addr":"172.21.15.5:6825/1027645612","heartbeat_front_addr":"172.21.15.5:6823/1027645612","state":["exists","up"]},{"osd":7,"uuid":"66f9dcf9-d5c3-4016-812f-d9496e9892d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6817","nonce":2718354517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6819","nonce":2718354517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6823","nonce":2718354517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6821","nonce":2718354517}]},"public_addr":"172.21.15.50:6817/2718354517","cluster_addr":"172.21.15.50:6819/2718354517","heartbeat_back_addr":"172.21.15.50:6823/2718354517","heartbeat_front_addr":"172.21.15.50:6821/2718354517","state":["exists","up"]},{"osd":8,"uuid":"584837f9-af4b-4189-a7e5-04156a94a805","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6817","nonce":3155722993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6819","nonce":3155722993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6823","nonce":3155722993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6821","nonce":3155722993}]},"public_addr":"172.21.15.70:6817/3155722993","cluster_addr":"172.21.15.70:6819/3155722993","heartbeat_back_addr":"172.21.15.70:6823/3155722993","heartbeat_front_addr":"172.21.15.70:6821/3155722993","state":["exists","up"]},{"osd":9,"uuid":"ef60de6e-3456-435c-bd48-ed2636cc0d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6827","nonce":2988145512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6829","nonce":2988145512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6833","nonce":2988145512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6831","nonce":2988145512}]},"public_addr":"172.21.15.5:6827/2988145512","cluster_addr":"172.21.15.5:6829/2988145512","heartbeat_back_addr":"172.21.15.5:6833/2988145512","heartbeat_front_addr":"172.21.15.5:6831/2988145512","state":["exists","up"]},{"osd":10,"uuid":"96c5de40-53df-412d-9501-8ce1711a76a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6825","nonce":4168871229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6827","nonce":4168871229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6831","nonce":4168871229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6829","nonce":4168871229}]},"public_addr":"172.21.15.50:6825/4168871229","cluster_addr":"172.21.15.50:6827/4168871229","heartbeat_back_addr":"172.21.15.50:6831/4168871229","heartbeat_front_addr":"172.21.15.50:6829/4168871229","state":["exists","up"]},{"osd":11,"uuid":"20beefe0-59c3-4392-9f61-8d215e9d2de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6825","nonce":2593470535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6827","nonce":2593470535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6831","nonce":2593470535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6829","nonce":2593470535}]},"public_addr":"172.21.15.70:6825/2593470535","cluster_addr":"172.21.15.70:6827/2593470535","heartbeat_back_addr":"172.21.15.70:6831/2593470535","heartbeat_front_addr":"172.21.15.70:6829/2593470535","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:21:56.748083+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:22:21.969492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:22:46.642917+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:23:11.630486+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:23:36.389322+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:24:01.431039+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:24:27.057017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:24:53.628200+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:25:19.356502+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:25:44.958024+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:26:10.804919+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:26:36.849133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:0/2473024253":"2024-09-01T05:20:57.333680+0000","172.21.15.5:0/2924148490":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/2163558485":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/2111919168":"2024-09-01T05:19:55.663503+0000","172.21.15.5:6801/3616278616":"2024-09-01T05:19:55.663503+0000","172.21.15.5:0/2436421090":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/1570244689":"2024-09-01T05:19:55.663503+0000","172.21.15.5:0/2700448223":"2024-09-01T05:20:57.333680+0000","172.21.15.5:6800/3616278616":"2024-09-01T05:19:55.663503+0000","172.21.15.5:6800/2898463711":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/2450461036":"2024-09-01T05:20:57.333680+0000","172.21.15.5:0/1947189952":"2024-09-01T05:19:55.663503+0000","172.21.15.5:6800/1439868821":"2024-09-01T05:20:57.333680+0000","172.21.15.5:6801/2898463711":"2024-09-01T05:19:31.728664+0000","172.21.15.5:6801/1439868821":"2024-09-01T05:20:57.333680+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T05:26:42.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.405+0000 7f13333a3640 1 -- 172.21.15.5:0/4214071905 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f13180b4b80 msgr2=0x7f13180b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:42.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.405+0000 7f13333a3640 1 --2- 172.21.15.5:0/4214071905 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f13180b4b80 0x7f13180b7090 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1328009bd0 tx=0x7f1328005f90 comp rx=0 tx=0).stop 2024-08-31T05:26:42.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.405+0000 7f13333a3640 1 -- 172.21.15.5:0/4214071905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f132c109bb0 msgr2=0x7f132c19fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:42.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.405+0000 7f13333a3640 1 --2- 172.21.15.5:0/4214071905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f132c109bb0 0x7f132c19fae0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f132400b970 tx=0x7f132400be30 comp rx=0 tx=0).stop 2024-08-31T05:26:42.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.405+0000 7f13333a3640 1 -- 172.21.15.5:0/4214071905 shutdown_connections 2024-08-31T05:26:42.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.405+0000 7f13333a3640 1 --2- 172.21.15.5:0/4214071905 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f13180b4b80 0x7f13180b7090 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:42.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.405+0000 7f13333a3640 1 --2- 172.21.15.5:0/4214071905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f132c109bb0 0x7f132c19fae0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:42.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.405+0000 7f13333a3640 1 --2- 172.21.15.5:0/4214071905 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f132c109260 0x7f132c19a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:42.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.405+0000 7f13333a3640 1 --2- 172.21.15.5:0/4214071905 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f132c103920 0x7f132c19a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:42.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.405+0000 7f13333a3640 1 -- 172.21.15.5:0/4214071905 >> 172.21.15.5:0/4214071905 conn(0x7f132c0ff370 msgr2=0x7f132c101790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:26:42.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.405+0000 7f13333a3640 1 -- 172.21.15.5:0/4214071905 shutdown_connections 2024-08-31T05:26:42.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:42.405+0000 7f13333a3640 1 -- 172.21.15.5:0/4214071905 wait complete. 2024-08-31T05:26:42.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:42 smithi005 ceph-mon[18602]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:26:42.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:42 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/4214071905' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T05:26:43.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:42 smithi070 ceph-mon[22316]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:26:43.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:42 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/4214071905' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T05:26:43.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:42 smithi050 ceph-mon[22146]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:26:43.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:42 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/4214071905' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T05:26:43.236 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-31T05:22:49.802575+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-08-31T05:26:43.237 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-08-31T05:26:43.494 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:26:44.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.013+0000 7f0208edb640 1 -- 172.21.15.5:0/4082680988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0204102820 msgr2=0x7f0204102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:44.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.013+0000 7f0208edb640 1 --2- 172.21.15.5:0/4082680988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0204102820 0x7f0204102c30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f01f4009900 tx=0x7f01f402a410 comp rx=0 tx=0).stop 2024-08-31T05:26:44.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.013+0000 7f0208edb640 1 -- 172.21.15.5:0/4082680988 shutdown_connections 2024-08-31T05:26:44.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.013+0000 7f0208edb640 1 --2- 172.21.15.5:0/4082680988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0204108ab0 0x7f020410f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:44.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.013+0000 7f0208edb640 1 --2- 172.21.15.5:0/4082680988 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0204108160 0x7f0204108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:44.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.013+0000 7f0208edb640 1 --2- 172.21.15.5:0/4082680988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0204102820 0x7f0204102c30 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:44.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.013+0000 7f0208edb640 1 -- 172.21.15.5:0/4082680988 >> 172.21.15.5:0/4082680988 conn(0x7f02040794e0 msgr2=0x7f02040798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:26:44.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.013+0000 7f0208edb640 1 -- 172.21.15.5:0/4082680988 shutdown_connections 2024-08-31T05:26:44.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.013+0000 7f0208edb640 1 -- 172.21.15.5:0/4082680988 wait complete. 2024-08-31T05:26:44.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.014+0000 7f0208edb640 1 Processor -- start 2024-08-31T05:26:44.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.014+0000 7f0208edb640 1 -- start start 2024-08-31T05:26:44.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.014+0000 7f0208edb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0204102820 0x7f0204199120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:44.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.014+0000 7f0208edb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0204108160 0x7f02041996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:44.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.014+0000 7f0208edb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0204108ab0 0x7f020419e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:44.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.014+0000 7f0208edb640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0204112710 con 0x7f0204108160 2024-08-31T05:26:44.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.014+0000 7f0208edb640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0204112590 con 0x7f0204102820 2024-08-31T05:26:44.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.014+0000 7f0208edb640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0204112890 con 0x7f0204108ab0 2024-08-31T05:26:44.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.014+0000 7f0201d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0204108160 0x7f02041996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:44.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.014+0000 7f0201d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0204108160 0x7f02041996c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39290/0 (socket says 172.21.15.5:39290) 2024-08-31T05:26:44.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.014+0000 7f0201d9b640 1 -- 172.21.15.5:0/2341746352 learned_addr learned my addr 172.21.15.5:0/2341746352 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:26:44.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.015+0000 7f0202d9d640 1 --2- 172.21.15.5:0/2341746352 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0204108ab0 0x7f020419e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:44.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.015+0000 7f020259c640 1 --2- 172.21.15.5:0/2341746352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0204102820 0x7f0204199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:44.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.015+0000 7f0201d9b640 1 -- 172.21.15.5:0/2341746352 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0204108ab0 msgr2=0x7f020419e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:44.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.015+0000 7f0201d9b640 1 --2- 172.21.15.5:0/2341746352 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0204108ab0 0x7f020419e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:44.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.015+0000 7f0201d9b640 1 -- 172.21.15.5:0/2341746352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0204102820 msgr2=0x7f0204199120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:44.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.015+0000 7f0201d9b640 1 --2- 172.21.15.5:0/2341746352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0204102820 0x7f0204199120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:44.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.015+0000 7f0201d9b640 1 -- 172.21.15.5:0/2341746352 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f020419efd0 con 0x7f0204108160 2024-08-31T05:26:44.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.015+0000 7f020259c640 1 --2- 172.21.15.5:0/2341746352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0204102820 0x7f0204199120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:26:44.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.015+0000 7f0201d9b640 1 --2- 172.21.15.5:0/2341746352 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0204108160 0x7f02041996c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f01f800d770 tx=0x7f01f800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:26:44.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.015+0000 7f01f37fe640 1 -- 172.21.15.5:0/2341746352 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f8017070 con 0x7f0204108160 2024-08-31T05:26:44.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.015+0000 7f01f37fe640 1 -- 172.21.15.5:0/2341746352 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01f8009c30 con 0x7f0204108160 2024-08-31T05:26:44.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.015+0000 7f0208edb640 1 -- 172.21.15.5:0/2341746352 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f020419f2c0 con 0x7f0204108160 2024-08-31T05:26:44.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.015+0000 7f01f37fe640 1 -- 172.21.15.5:0/2341746352 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f800f620 con 0x7f0204108160 2024-08-31T05:26:44.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.015+0000 7f0208edb640 1 -- 172.21.15.5:0/2341746352 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02041a5ae0 con 0x7f0204108160 2024-08-31T05:26:44.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.016+0000 7f0208edb640 1 -- 172.21.15.5:0/2341746352 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0204103aa0 con 0x7f0204108160 2024-08-31T05:26:44.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.018+0000 7f01f37fe640 1 -- 172.21.15.5:0/2341746352 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f01f801a070 con 0x7f0204108160 2024-08-31T05:26:44.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.018+0000 7f01f37fe640 1 --2- 172.21.15.5:0/2341746352 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f01ec0b4bb0 0x7f01ec0b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:44.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.019+0000 7f020259c640 1 --2- 172.21.15.5:0/2341746352 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f01ec0b4bb0 0x7f01ec0b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:44.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.019+0000 7f01f37fe640 1 -- 172.21.15.5:0/2341746352 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7f01f80e4940 con 0x7f0204108160 2024-08-31T05:26:44.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.019+0000 7f020259c640 1 --2- 172.21.15.5:0/2341746352 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f01ec0b4bb0 0x7f01ec0b70c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f01f40096c0 tx=0x7f01f4031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:26:44.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.022+0000 7f01f37fe640 1 -- 172.21.15.5:0/2341746352 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f01f80abe40 con 0x7f0204108160 2024-08-31T05:26:44.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.207+0000 7f0208edb640 1 -- 172.21.15.5:0/2341746352 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f020410a880 con 0x7f0204108160 2024-08-31T05:26:44.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.207+0000 7f01f37fe640 1 -- 172.21.15.5:0/2341746352 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) ==== 93+0+10 (secure 0 0 0) 0x7f01f80ab740 con 0x7f0204108160 2024-08-31T05:26:44.209 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-08-31T05:26:44.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.209+0000 7f0208edb640 1 -- 172.21.15.5:0/2341746352 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f01ec0b4bb0 msgr2=0x7f01ec0b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:44.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.209+0000 7f0208edb640 1 --2- 172.21.15.5:0/2341746352 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f01ec0b4bb0 0x7f01ec0b70c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f01f40096c0 tx=0x7f01f4031400 comp rx=0 tx=0).stop 2024-08-31T05:26:44.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.209+0000 7f0208edb640 1 -- 172.21.15.5:0/2341746352 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0204108160 msgr2=0x7f02041996c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:44.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.209+0000 7f0208edb640 1 --2- 172.21.15.5:0/2341746352 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0204108160 0x7f02041996c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f01f800d770 tx=0x7f01f800dc30 comp rx=0 tx=0).stop 2024-08-31T05:26:44.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.210+0000 7f0208edb640 1 -- 172.21.15.5:0/2341746352 shutdown_connections 2024-08-31T05:26:44.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.210+0000 7f0208edb640 1 --2- 172.21.15.5:0/2341746352 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f01ec0b4bb0 0x7f01ec0b70c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:44.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.210+0000 7f0208edb640 1 --2- 172.21.15.5:0/2341746352 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0204108ab0 0x7f020419e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:44.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.210+0000 7f0208edb640 1 --2- 172.21.15.5:0/2341746352 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0204108160 0x7f02041996c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:44.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.210+0000 7f0208edb640 1 --2- 172.21.15.5:0/2341746352 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0204102820 0x7f0204199120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:44.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.210+0000 7f0208edb640 1 -- 172.21.15.5:0/2341746352 >> 172.21.15.5:0/2341746352 conn(0x7f02040794e0 msgr2=0x7f0204101290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:26:44.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.210+0000 7f0208edb640 1 -- 172.21.15.5:0/2341746352 shutdown_connections 2024-08-31T05:26:44.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:44.210+0000 7f0208edb640 1 -- 172.21.15.5:0/2341746352 wait complete. 2024-08-31T05:26:44.944 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:44 smithi005 ceph-mon[18602]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:26:44.944 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:44 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/2341746352' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-31T05:26:44.974 INFO:tasks.cephadm:Adding mds.a on smithi005 2024-08-31T05:26:44.975 INFO:tasks.cephadm:Adding mds.d on smithi005 2024-08-31T05:26:44.975 INFO:tasks.cephadm:Adding mds.g on smithi005 2024-08-31T05:26:44.975 INFO:tasks.cephadm:Adding mds.j on smithi005 2024-08-31T05:26:44.975 INFO:tasks.cephadm:Adding mds.b on smithi050 2024-08-31T05:26:44.975 INFO:tasks.cephadm:Adding mds.e on smithi050 2024-08-31T05:26:44.975 INFO:tasks.cephadm:Adding mds.h on smithi050 2024-08-31T05:26:44.975 INFO:tasks.cephadm:Adding mds.k on smithi050 2024-08-31T05:26:44.975 INFO:tasks.cephadm:Adding mds.c on smithi070 2024-08-31T05:26:44.975 INFO:tasks.cephadm:Adding mds.f on smithi070 2024-08-31T05:26:44.975 INFO:tasks.cephadm:Adding mds.i on smithi070 2024-08-31T05:26:44.975 INFO:tasks.cephadm:Adding mds.l on smithi070 2024-08-31T05:26:44.976 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph orch apply mds all '12;smithi005=a;smithi005=d;smithi005=g;smithi005=j;smithi050=b;smithi050=e;smithi050=h;smithi050=k;smithi070=c;smithi070=f;smithi070=i;smithi070=l' 2024-08-31T05:26:45.004 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:44 smithi070 ceph-mon[22316]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:26:45.004 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:44 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/2341746352' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-31T05:26:45.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:44 smithi050 ceph-mon[22146]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:26:45.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:44 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/2341746352' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-31T05:26:45.232 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T05:26:45.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.739+0000 7f7c23244640 1 -- 172.21.15.70:0/2188753553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c1c102800 msgr2=0x7f7c1c102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:45.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.739+0000 7f7c23244640 1 --2- 172.21.15.70:0/2188753553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c1c102800 0x7f7c1c102c10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7c10009900 tx=0x7f7c1002a410 comp rx=0 tx=0).stop 2024-08-31T05:26:45.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.739+0000 7f7c23244640 1 -- 172.21.15.70:0/2188753553 shutdown_connections 2024-08-31T05:26:45.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.739+0000 7f7c23244640 1 --2- 172.21.15.70:0/2188753553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c1c108a90 0x7f7c1c10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:45.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.739+0000 7f7c23244640 1 --2- 172.21.15.70:0/2188753553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c1c108140 0x7f7c1c108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:45.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.739+0000 7f7c23244640 1 --2- 172.21.15.70:0/2188753553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c1c102800 0x7f7c1c102c10 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:45.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.739+0000 7f7c23244640 1 -- 172.21.15.70:0/2188753553 >> 172.21.15.70:0/2188753553 conn(0x7f7c1c0794d0 msgr2=0x7f7c1c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:26:45.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.739+0000 7f7c23244640 1 -- 172.21.15.70:0/2188753553 shutdown_connections 2024-08-31T05:26:45.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.739+0000 7f7c23244640 1 -- 172.21.15.70:0/2188753553 wait complete. 2024-08-31T05:26:45.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.740+0000 7f7c23244640 1 Processor -- start 2024-08-31T05:26:45.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.740+0000 7f7c23244640 1 -- start start 2024-08-31T05:26:45.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.740+0000 7f7c23244640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c1c102800 0x7f7c1c199100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:45.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.740+0000 7f7c23244640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c1c108140 0x7f7c1c1996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:45.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.741+0000 7f7c23244640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c1c108a90 0x7f7c1c19e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:45.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.741+0000 7f7c23244640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7c1c112710 con 0x7f7c1c108140 2024-08-31T05:26:45.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.741+0000 7f7c23244640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7c1c112590 con 0x7f7c1c108a90 2024-08-31T05:26:45.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.741+0000 7f7c23244640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7c1c112890 con 0x7f7c1c102800 2024-08-31T05:26:45.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.741+0000 7f7c20fe0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c1c102800 0x7f7c1c199100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:45.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.741+0000 7f7c20fe0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c1c102800 0x7f7c1c199100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35052/0 (socket says 172.21.15.70:35052) 2024-08-31T05:26:45.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.741+0000 7f7c20fe0640 1 -- 172.21.15.70:0/2906131147 learned_addr learned my addr 172.21.15.70:0/2906131147 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-08-31T05:26:45.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.741+0000 7f7c1bfff640 1 --2- 172.21.15.70:0/2906131147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c1c108140 0x7f7c1c1996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:45.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.741+0000 7f7c217e1640 1 --2- 172.21.15.70:0/2906131147 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c1c108a90 0x7f7c1c19e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:45.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.741+0000 7f7c20fe0640 1 -- 172.21.15.70:0/2906131147 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c1c108a90 msgr2=0x7f7c1c19e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:45.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.741+0000 7f7c20fe0640 1 --2- 172.21.15.70:0/2906131147 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c1c108a90 0x7f7c1c19e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:45.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.741+0000 7f7c20fe0640 1 -- 172.21.15.70:0/2906131147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c1c108140 msgr2=0x7f7c1c1996a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:45.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.741+0000 7f7c20fe0640 1 --2- 172.21.15.70:0/2906131147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c1c108140 0x7f7c1c1996a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:45.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.741+0000 7f7c20fe0640 1 -- 172.21.15.70:0/2906131147 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c1c19f070 con 0x7f7c1c102800 2024-08-31T05:26:45.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.741+0000 7f7c1bfff640 1 --2- 172.21.15.70:0/2906131147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c1c108140 0x7f7c1c1996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:26:45.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.741+0000 7f7c20fe0640 1 --2- 172.21.15.70:0/2906131147 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c1c102800 0x7f7c1c199100 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7c10005940 tx=0x7f7c100042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:26:45.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.741+0000 7f7c19ffb640 1 -- 172.21.15.70:0/2906131147 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c1003f030 con 0x7f7c1c102800 2024-08-31T05:26:45.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.741+0000 7f7c23244640 1 -- 172.21.15.70:0/2906131147 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c1c19f300 con 0x7f7c1c102800 2024-08-31T05:26:45.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.741+0000 7f7c19ffb640 1 -- 172.21.15.70:0/2906131147 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c10003cb0 con 0x7f7c1c102800 2024-08-31T05:26:45.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.742+0000 7f7c19ffb640 1 -- 172.21.15.70:0/2906131147 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c10035070 con 0x7f7c1c102800 2024-08-31T05:26:45.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.742+0000 7f7c23244640 1 -- 172.21.15.70:0/2906131147 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c1c1a5ac0 con 0x7f7c1c102800 2024-08-31T05:26:45.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.743+0000 7f7c23244640 1 -- 172.21.15.70:0/2906131147 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c1c102c10 con 0x7f7c1c102800 2024-08-31T05:26:45.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.744+0000 7f7c19ffb640 1 -- 172.21.15.70:0/2906131147 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f7c10042030 con 0x7f7c1c102800 2024-08-31T05:26:45.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.745+0000 7f7c19ffb640 1 --2- 172.21.15.70:0/2906131147 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f7c0c0b4b80 0x7f7c0c0b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:45.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.746+0000 7f7c19ffb640 1 -- 172.21.15.70:0/2906131147 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7f7c101058b0 con 0x7f7c1c102800 2024-08-31T05:26:45.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.746+0000 7f7c1bfff640 1 --2- 172.21.15.70:0/2906131147 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f7c0c0b4b80 0x7f7c0c0b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:45.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.746+0000 7f7c1bfff640 1 --2- 172.21.15.70:0/2906131147 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f7c0c0b4b80 0x7f7c0c0b7090 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c100b40 tx=0x7f7c0800b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:26:45.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.749+0000 7f7c19ffb640 1 -- 172.21.15.70:0/2906131147 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7c100cc6c0 con 0x7f7c1c102800 2024-08-31T05:26:45.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.934+0000 7f7c23244640 1 -- 172.21.15.70:0/2906131147 --> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi005=a;smithi005=d;smithi005=g;smithi005=j;smithi050=b;smithi050=e;smithi050=h;smithi050=k;smithi070=c;smithi070=f;smithi070=i;smithi070=l", "target": ["mon-mgr", ""]}) -- 0x7f7c1c0635a0 con 0x7f7c0c0b4b80 2024-08-31T05:26:45.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.942+0000 7f7c19ffb640 1 -- 172.21.15.70:0/2906131147 <== mgr.14220 v2:172.21.15.5:6800/2696053609 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f7c1c0635a0 con 0x7f7c0c0b4b80 2024-08-31T05:26:45.944 INFO:teuthology.orchestra.run.smithi070.stdout:Scheduled mds.all update... 2024-08-31T05:26:45.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.944+0000 7f7c23244640 1 -- 172.21.15.70:0/2906131147 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f7c0c0b4b80 msgr2=0x7f7c0c0b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:45.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.944+0000 7f7c23244640 1 --2- 172.21.15.70:0/2906131147 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f7c0c0b4b80 0x7f7c0c0b7090 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c100b40 tx=0x7f7c0800b390 comp rx=0 tx=0).stop 2024-08-31T05:26:45.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.944+0000 7f7c23244640 1 -- 172.21.15.70:0/2906131147 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c1c102800 msgr2=0x7f7c1c199100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:45.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.944+0000 7f7c23244640 1 --2- 172.21.15.70:0/2906131147 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c1c102800 0x7f7c1c199100 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7c10005940 tx=0x7f7c100042f0 comp rx=0 tx=0).stop 2024-08-31T05:26:45.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.944+0000 7f7c23244640 1 -- 172.21.15.70:0/2906131147 shutdown_connections 2024-08-31T05:26:45.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.944+0000 7f7c23244640 1 --2- 172.21.15.70:0/2906131147 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f7c0c0b4b80 0x7f7c0c0b7090 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:45.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.944+0000 7f7c23244640 1 --2- 172.21.15.70:0/2906131147 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c1c108a90 0x7f7c1c19e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:45.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.944+0000 7f7c23244640 1 --2- 172.21.15.70:0/2906131147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c1c108140 0x7f7c1c1996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:45.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.944+0000 7f7c23244640 1 --2- 172.21.15.70:0/2906131147 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c1c102800 0x7f7c1c199100 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:45.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.944+0000 7f7c23244640 1 -- 172.21.15.70:0/2906131147 >> 172.21.15.70:0/2906131147 conn(0x7f7c1c0794d0 msgr2=0x7f7c1c101250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:26:45.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.944+0000 7f7c23244640 1 -- 172.21.15.70:0/2906131147 shutdown_connections 2024-08-31T05:26:45.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-08-31T05:26:45.944+0000 7f7c23244640 1 -- 172.21.15.70:0/2906131147 wait complete. 2024-08-31T05:26:46.901 DEBUG:teuthology.orchestra.run.smithi005:mds.a> sudo journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@mds.a.service 2024-08-31T05:26:46.904 DEBUG:teuthology.orchestra.run.smithi005:mds.d> sudo journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@mds.d.service 2024-08-31T05:26:46.948 DEBUG:teuthology.orchestra.run.smithi005:mds.g> sudo journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@mds.g.service 2024-08-31T05:26:46.990 DEBUG:teuthology.orchestra.run.smithi005:mds.j> sudo journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@mds.j.service 2024-08-31T05:26:47.033 DEBUG:teuthology.orchestra.run.smithi050:mds.b> sudo journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@mds.b.service 2024-08-31T05:26:47.037 DEBUG:teuthology.orchestra.run.smithi050:mds.e> sudo journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@mds.e.service 2024-08-31T05:26:47.080 DEBUG:teuthology.orchestra.run.smithi050:mds.h> sudo journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@mds.h.service 2024-08-31T05:26:47.123 DEBUG:teuthology.orchestra.run.smithi050:mds.k> sudo journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@mds.k.service 2024-08-31T05:26:47.149 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:46 smithi070 ceph-mon[22316]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:26:47.149 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:46 smithi070 ceph-mon[22316]: from='client.24571 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi005=a;smithi005=d;smithi005=g;smithi005=j;smithi050=b;smithi050=e;smithi050=h;smithi050=k;smithi070=c;smithi070=f;smithi070=i;smithi070=l", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:26:47.149 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:46 smithi070 ceph-mon[22316]: Saving service mds.all spec with placement smithi005=a;smithi005=d;smithi005=g;smithi005=j;smithi050=b;smithi050=e;smithi050=h;smithi050=k;smithi070=c;smithi070=f;smithi070=i;smithi070=l;count:12 2024-08-31T05:26:47.149 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:46 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:47.149 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:46 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:26:47.149 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:46 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:26:47.150 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:46 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:26:47.150 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:46 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:47.150 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:46 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T05:26:47.150 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:46 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T05:26:47.150 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:46 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:26:47.150 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:46 smithi070 ceph-mon[22316]: Deploying daemon mds.l on smithi070 2024-08-31T05:26:47.165 DEBUG:teuthology.orchestra.run.smithi070:mds.c> sudo journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@mds.c.service 2024-08-31T05:26:47.168 DEBUG:teuthology.orchestra.run.smithi070:mds.f> sudo journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@mds.f.service 2024-08-31T05:26:47.211 DEBUG:teuthology.orchestra.run.smithi070:mds.i> sudo journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@mds.i.service 2024-08-31T05:26:47.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:46 smithi005 ceph-mon[18602]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:26:47.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:46 smithi005 ceph-mon[18602]: from='client.24571 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi005=a;smithi005=d;smithi005=g;smithi005=j;smithi050=b;smithi050=e;smithi050=h;smithi050=k;smithi070=c;smithi070=f;smithi070=i;smithi070=l", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:26:47.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:46 smithi005 ceph-mon[18602]: Saving service mds.all spec with placement smithi005=a;smithi005=d;smithi005=g;smithi005=j;smithi050=b;smithi050=e;smithi050=h;smithi050=k;smithi070=c;smithi070=f;smithi070=i;smithi070=l;count:12 2024-08-31T05:26:47.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:46 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:47.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:46 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:26:47.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:46 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:26:47.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:46 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:26:47.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:46 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:47.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:46 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T05:26:47.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:46 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T05:26:47.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:46 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:26:47.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:46 smithi005 ceph-mon[18602]: Deploying daemon mds.l on smithi070 2024-08-31T05:26:47.254 DEBUG:teuthology.orchestra.run.smithi070:mds.l> sudo journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@mds.l.service 2024-08-31T05:26:47.296 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-08-31T05:26:47.297 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T05:26:47.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:46 smithi050 ceph-mon[22146]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:26:47.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:46 smithi050 ceph-mon[22146]: from='client.24571 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi005=a;smithi005=d;smithi005=g;smithi005=j;smithi050=b;smithi050=e;smithi050=h;smithi050=k;smithi070=c;smithi070=f;smithi070=i;smithi070=l", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:26:47.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:46 smithi050 ceph-mon[22146]: Saving service mds.all spec with placement smithi005=a;smithi005=d;smithi005=g;smithi005=j;smithi050=b;smithi050=e;smithi050=h;smithi050=k;smithi070=c;smithi070=f;smithi070=i;smithi070=l;count:12 2024-08-31T05:26:47.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:46 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:47.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:46 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:26:47.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:46 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:26:47.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:46 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:26:47.408 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:46 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:47.408 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:46 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T05:26:47.408 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:46 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T05:26:47.408 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:46 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:26:47.408 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:46 smithi050 ceph-mon[22146]: Deploying daemon mds.l on smithi070 2024-08-31T05:26:47.550 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:26:48.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:48.070+0000 7f33c5c4d640 1 -- 172.21.15.5:0/4072770863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33c010dbd0 msgr2=0x7f33c01100c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:48.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:48.070+0000 7f33c5c4d640 1 --2- 172.21.15.5:0/4072770863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33c010dbd0 0x7f33c01100c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f33b8009ca0 tx=0x7f33b802a8c0 comp rx=0 tx=0).stop 2024-08-31T05:26:48.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:48.071+0000 7f33c5c4d640 1 -- 172.21.15.5:0/4072770863 shutdown_connections 2024-08-31T05:26:48.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:48.071+0000 7f33c5c4d640 1 --2- 172.21.15.5:0/4072770863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33c010dbd0 0x7f33c01100c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:48.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:48.071+0000 7f33c5c4d640 1 --2- 172.21.15.5:0/4072770863 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33c01050c0 0x7f33c010d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:48.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:48.071+0000 7f33c5c4d640 1 --2- 172.21.15.5:0/4072770863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33c0104770 0x7f33c0104b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:48.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:48.071+0000 7f33c5c4d640 1 -- 172.21.15.5:0/4072770863 >> 172.21.15.5:0/4072770863 conn(0x7f33c00794e0 msgr2=0x7f33c00798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:26:48.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:48.071+0000 7f33c5c4d640 1 -- 172.21.15.5:0/4072770863 shutdown_connections 2024-08-31T05:26:48.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:48.071+0000 7f33c5c4d640 1 -- 172.21.15.5:0/4072770863 wait complete. 2024-08-31T05:26:48.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:48.071+0000 7f33c5c4d640 1 Processor -- start 2024-08-31T05:26:48.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:48.071+0000 7f33c5c4d640 1 -- start start 2024-08-31T05:26:48.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:48.072+0000 7f33c5c4d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33c0104770 0x7f33c019a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:48.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:48.072+0000 7f33c5c4d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33c01050c0 0x7f33c019a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:48.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:48.072+0000 7f33c5c4d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33c010dbd0 0x7f33c019faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:48.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:48.072+0000 7f33c5c4d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f33c0113850 con 0x7f33c010dbd0 2024-08-31T05:26:48.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:48.072+0000 7f33c5c4d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f33c01136d0 con 0x7f33c01050c0 2024-08-31T05:26:48.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:48.072+0000 7f33c5c4d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f33c01139d0 con 0x7f33c0104770 2024-08-31T05:26:48.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:48.072+0000 7f33bffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33c010dbd0 0x7f33c019faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:48.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:48.072+0000 7f33bffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33c010dbd0 0x7f33c019faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39318/0 (socket says 172.21.15.5:39318) 2024-08-31T05:26:48.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:48.072+0000 7f33bffff640 1 -- 172.21.15.5:0/1829656045 learned_addr learned my addr 172.21.15.5:0/1829656045 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:26:48.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:48.072+0000 7f33bf7fe640 1 --2- 172.21.15.5:0/1829656045 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33c0104770 0x7f33c019a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:48.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:48.072+0000 7f33beffd640 1 --2- 172.21.15.5:0/1829656045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33c01050c0 0x7f33c019a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:48.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:48.072+0000 7f33bffff640 1 -- 172.21.15.5:0/1829656045 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33c0104770 msgr2=0x7f33c019a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:48.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:48.072+0000 7f33bffff640 1 --2- 172.21.15.5:0/1829656045 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33c0104770 0x7f33c019a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:48.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:48.072+0000 7f33bffff640 1 -- 172.21.15.5:0/1829656045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33c01050c0 msgr2=0x7f33c019a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:48.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:48.072+0000 7f33bffff640 1 --2- 172.21.15.5:0/1829656045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33c01050c0 0x7f33c019a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:48.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:48.072+0000 7f33bffff640 1 -- 172.21.15.5:0/1829656045 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33c01a01d0 con 0x7f33c010dbd0 2024-08-31T05:26:48.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:48.072+0000 7f33bffff640 1 --2- 172.21.15.5:0/1829656045 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33c010dbd0 0x7f33c019faa0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f33b8005cc0 tx=0x7f33b802f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:26:48.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:48.072+0000 7f33bcff9640 1 -- 172.21.15.5:0/1829656045 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b8003bf0 con 0x7f33c010dbd0 2024-08-31T05:26:48.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:48.072+0000 7f33bcff9640 1 -- 172.21.15.5:0/1829656045 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f33b8003d90 con 0x7f33c010dbd0 2024-08-31T05:26:48.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:48.072+0000 7f33c5c4d640 1 -- 172.21.15.5:0/1829656045 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33c01a0460 con 0x7f33c010dbd0 2024-08-31T05:26:48.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:48.072+0000 7f33bcff9640 1 -- 172.21.15.5:0/1829656045 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b802fbc0 con 0x7f33c010dbd0 2024-08-31T05:26:48.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:48.073+0000 7f33c5c4d640 1 -- 172.21.15.5:0/1829656045 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33c01a6c20 con 0x7f33c010dbd0 2024-08-31T05:26:48.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:48.074+0000 7f33c5c4d640 1 -- 172.21.15.5:0/1829656045 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33c006bfe0 con 0x7f33c010dbd0 2024-08-31T05:26:48.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:48.076+0000 7f33bcff9640 1 -- 172.21.15.5:0/1829656045 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f33b802fd60 con 0x7f33c010dbd0 2024-08-31T05:26:48.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:48.077+0000 7f33bcff9640 1 --2- 172.21.15.5:0/1829656045 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f33a80b4c00 0x7f33a80b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:48.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:48.077+0000 7f33bf7fe640 1 --2- 172.21.15.5:0/1829656045 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f33a80b4c00 0x7f33a80b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:48.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:48.077+0000 7f33bcff9640 1 -- 172.21.15.5:0/1829656045 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7f33b81063d0 con 0x7f33c010dbd0 2024-08-31T05:26:48.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:48.077+0000 7f33bf7fe640 1 --2- 172.21.15.5:0/1829656045 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f33a80b4c00 0x7f33a80b7110 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f33c006c6e0 tx=0x7f33b000b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:26:48.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:48.080+0000 7f33bcff9640 1 -- 172.21.15.5:0/1829656045 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f33b80cd830 con 0x7f33c010dbd0 2024-08-31T05:26:48.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:48.305+0000 7f33c5c4d640 1 -- 172.21.15.5:0/1829656045 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f33c0104b80 con 0x7f33c010dbd0 2024-08-31T05:26:48.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:48.305+0000 7f33bcff9640 1 -- 172.21.15.5:0/1829656045 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f33c0104b80 con 0x7f33c010dbd0 2024-08-31T05:26:48.309 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:26:48.310 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":1,"btime":"2024-08-31T05:19:04:860087+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-08-31T05:26:48.311 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 1 2024-08-31T05:26:48.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:48.308+0000 7f33c5c4d640 1 -- 172.21.15.5:0/1829656045 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f33a80b4c00 msgr2=0x7f33a80b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:48.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:48.308+0000 7f33c5c4d640 1 --2- 172.21.15.5:0/1829656045 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f33a80b4c00 0x7f33a80b7110 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f33c006c6e0 tx=0x7f33b000b390 comp rx=0 tx=0).stop 2024-08-31T05:26:48.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:48.308+0000 7f33c5c4d640 1 -- 172.21.15.5:0/1829656045 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33c010dbd0 msgr2=0x7f33c019faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:48.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:48.308+0000 7f33c5c4d640 1 --2- 172.21.15.5:0/1829656045 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33c010dbd0 0x7f33c019faa0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f33b8005cc0 tx=0x7f33b802f380 comp rx=0 tx=0).stop 2024-08-31T05:26:48.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:48.308+0000 7f33c5c4d640 1 -- 172.21.15.5:0/1829656045 shutdown_connections 2024-08-31T05:26:48.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:48.308+0000 7f33c5c4d640 1 --2- 172.21.15.5:0/1829656045 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f33a80b4c00 0x7f33a80b7110 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:48.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:48.308+0000 7f33c5c4d640 1 --2- 172.21.15.5:0/1829656045 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33c010dbd0 0x7f33c019faa0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:48.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:48.308+0000 7f33c5c4d640 1 --2- 172.21.15.5:0/1829656045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33c01050c0 0x7f33c019a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:48.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:48.308+0000 7f33c5c4d640 1 --2- 172.21.15.5:0/1829656045 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33c0104770 0x7f33c019a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:48.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:48.308+0000 7f33c5c4d640 1 -- 172.21.15.5:0/1829656045 >> 172.21.15.5:0/1829656045 conn(0x7f33c00794e0 msgr2=0x7f33c00ff310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:26:48.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:48.308+0000 7f33c5c4d640 1 -- 172.21.15.5:0/1829656045 shutdown_connections 2024-08-31T05:26:48.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:48.308+0000 7f33c5c4d640 1 -- 172.21.15.5:0/1829656045 wait complete. 2024-08-31T05:26:48.720 INFO:journalctl@ceph.mds.l.smithi070.stdout:Aug 31 05:26:48 smithi070 systemd[1]: Starting Ceph mds.l for 69422704-6758-11ef-bcd4-c7b262605968... 2024-08-31T05:26:48.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:48 smithi005 ceph-mon[18602]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:26:48.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:48 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/1829656045' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:26:49.000 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:48 smithi070 ceph-mon[22316]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:26:49.000 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:48 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/1829656045' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:26:49.000 INFO:journalctl@ceph.mds.l.smithi070.stdout:Aug 31 05:26:48 smithi070 podman[52895]: 2024-08-31 05:26:48.620102268 +0000 UTC m=+0.015293673 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T05:26:49.000 INFO:journalctl@ceph.mds.l.smithi070.stdout:Aug 31 05:26:48 smithi070 podman[52895]: 2024-08-31 05:26:48.737923801 +0000 UTC m=+0.133115213 container create 4fff19ffe3caad705972df9cc88114f332126bb8d22290caf1e0859042c63640 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-l, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-08-31T05:26:49.001 INFO:journalctl@ceph.mds.l.smithi070.stdout:Aug 31 05:26:48 smithi070 podman[52895]: 2024-08-31 05:26:48.99911132 +0000 UTC m=+0.394302727 container init 4fff19ffe3caad705972df9cc88114f332126bb8d22290caf1e0859042c63640 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-l, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-08-31T05:26:49.336 INFO:journalctl@ceph.mds.l.smithi070.stdout:Aug 31 05:26:49 smithi070 podman[52895]: 2024-08-31 05:26:49.002069112 +0000 UTC m=+0.397260521 container start 4fff19ffe3caad705972df9cc88114f332126bb8d22290caf1e0859042c63640 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-l, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-08-31T05:26:49.336 INFO:journalctl@ceph.mds.l.smithi070.stdout:Aug 31 05:26:49 smithi070 ceph-mds[52914]: -- 172.21.15.70:0/1768919771 <== mon.1 v2:172.21.15.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5587a59f9860 con 0x5587a9b9f180 2024-08-31T05:26:49.336 INFO:journalctl@ceph.mds.l.smithi070.stdout:Aug 31 05:26:49 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-l[52910]: starting mds.l at 2024-08-31T05:26:49.336 INFO:journalctl@ceph.mds.l.smithi070.stdout:Aug 31 05:26:49 smithi070 bash[52895]: 4fff19ffe3caad705972df9cc88114f332126bb8d22290caf1e0859042c63640 2024-08-31T05:26:49.336 INFO:journalctl@ceph.mds.l.smithi070.stdout:Aug 31 05:26:49 smithi070 systemd[1]: Started Ceph mds.l for 69422704-6758-11ef-bcd4-c7b262605968. 2024-08-31T05:26:49.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:48 smithi050 ceph-mon[22146]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:26:49.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:48 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/1829656045' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:26:50.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:50 smithi070 ceph-mon[22316]: mds.? [v2:172.21.15.70:6832/364083443,v1:172.21.15.70:6833/364083443] up:boot 2024-08-31T05:26:50.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:50 smithi070 ceph-mon[22316]: fsmap 1 up:standby 2024-08-31T05:26:50.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:50 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-08-31T05:26:50.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:50 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:50.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:50 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:50.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:50 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:50.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:50 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T05:26:50.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:50 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T05:26:50.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:50 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:26:50.337 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:50 smithi070 ceph-mon[22316]: Deploying daemon mds.k on smithi050 2024-08-31T05:26:50.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:50 smithi050 ceph-mon[22146]: mds.? [v2:172.21.15.70:6832/364083443,v1:172.21.15.70:6833/364083443] up:boot 2024-08-31T05:26:50.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:50 smithi050 ceph-mon[22146]: fsmap 1 up:standby 2024-08-31T05:26:50.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:50 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-08-31T05:26:50.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:50 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:50.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:50 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:50.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:50 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:50.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:50 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T05:26:50.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:50 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T05:26:50.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:50 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:26:50.408 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:50 smithi050 ceph-mon[22146]: Deploying daemon mds.k on smithi050 2024-08-31T05:26:50.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:50 smithi005 ceph-mon[18602]: mds.? [v2:172.21.15.70:6832/364083443,v1:172.21.15.70:6833/364083443] up:boot 2024-08-31T05:26:50.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:50 smithi005 ceph-mon[18602]: fsmap 1 up:standby 2024-08-31T05:26:50.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:50 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-08-31T05:26:50.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:50 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:50.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:50 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:50.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:50 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:50.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:50 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T05:26:50.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:50 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T05:26:50.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:50 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:26:50.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:50 smithi005 ceph-mon[18602]: Deploying daemon mds.k on smithi050 2024-08-31T05:26:51.071 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T05:26:51.213 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:51 smithi050 ceph-mon[22146]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:26:51.334 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:26:51.368 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:51 smithi005 ceph-mon[18602]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:26:51.589 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:51 smithi070 ceph-mon[22316]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:26:51.600 INFO:journalctl@ceph.mds.k.smithi050.stdout:Aug 31 05:26:51 smithi050 systemd[1]: Starting Ceph mds.k for 69422704-6758-11ef-bcd4-c7b262605968... 2024-08-31T05:26:51.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:51.849+0000 7f79cf985640 1 -- 172.21.15.5:0/3396152598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79c8107910 msgr2=0x7f79c8107d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:51.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:51.849+0000 7f79cf985640 1 --2- 172.21.15.5:0/3396152598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79c8107910 0x7f79c8107d20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f79b800aa10 tx=0x7f79b802b720 comp rx=0 tx=0).stop 2024-08-31T05:26:51.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:51.849+0000 7f79cf985640 1 -- 172.21.15.5:0/3396152598 shutdown_connections 2024-08-31T05:26:51.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:51.849+0000 7f79cf985640 1 --2- 172.21.15.5:0/3396152598 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79c8108260 0x7f79c810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:51.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:51.849+0000 7f79cf985640 1 --2- 172.21.15.5:0/3396152598 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79c8107910 0x7f79c8107d20 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:51.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:51.849+0000 7f79cf985640 1 --2- 172.21.15.5:0/3396152598 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79c8101fd0 0x7f79c81023e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:51.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:51.849+0000 7f79cf985640 1 -- 172.21.15.5:0/3396152598 >> 172.21.15.5:0/3396152598 conn(0x7f79c8079bb0 msgr2=0x7f79c8079fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:26:51.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:51.849+0000 7f79cf985640 1 -- 172.21.15.5:0/3396152598 shutdown_connections 2024-08-31T05:26:51.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:51.849+0000 7f79cf985640 1 -- 172.21.15.5:0/3396152598 wait complete. 2024-08-31T05:26:51.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:51.850+0000 7f79cf985640 1 Processor -- start 2024-08-31T05:26:51.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:51.850+0000 7f79cf985640 1 -- start start 2024-08-31T05:26:51.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:51.851+0000 7f79cf985640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79c8101fd0 0x7f79c819a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:51.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:51.851+0000 7f79cf985640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79c8107910 0x7f79c819a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:51.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:51.851+0000 7f79cf985640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79c8108260 0x7f79c819fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:51.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:51.851+0000 7f79cf985640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f79c8113850 con 0x7f79c8107910 2024-08-31T05:26:51.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:51.851+0000 7f79cf985640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f79c81136d0 con 0x7f79c8101fd0 2024-08-31T05:26:51.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:51.851+0000 7f79cf985640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f79c81139d0 con 0x7f79c8108260 2024-08-31T05:26:51.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:51.851+0000 7f79cd721640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79c8101fd0 0x7f79c819a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:51.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:51.851+0000 7f79cd721640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79c8101fd0 0x7f79c819a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:54554/0 (socket says 172.21.15.5:54554) 2024-08-31T05:26:51.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:51.851+0000 7f79ccf20640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79c8107910 0x7f79c819a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:51.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:51.851+0000 7f79cd721640 1 -- 172.21.15.5:0/981001984 learned_addr learned my addr 172.21.15.5:0/981001984 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:26:51.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:51.851+0000 7f79cdf22640 1 --2- 172.21.15.5:0/981001984 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79c8108260 0x7f79c819fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:51.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:51.851+0000 7f79cd721640 1 -- 172.21.15.5:0/981001984 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79c8108260 msgr2=0x7f79c819fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:51.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:51.851+0000 7f79cd721640 1 --2- 172.21.15.5:0/981001984 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79c8108260 0x7f79c819fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:51.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:51.851+0000 7f79cd721640 1 -- 172.21.15.5:0/981001984 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79c8107910 msgr2=0x7f79c819a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:51.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:51.851+0000 7f79cd721640 1 --2- 172.21.15.5:0/981001984 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79c8107910 0x7f79c819a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:51.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:51.851+0000 7f79cd721640 1 -- 172.21.15.5:0/981001984 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79c81a0290 con 0x7f79c8101fd0 2024-08-31T05:26:51.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:51.851+0000 7f79ccf20640 1 --2- 172.21.15.5:0/981001984 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79c8107910 0x7f79c819a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:26:51.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:51.851+0000 7f79cd721640 1 --2- 172.21.15.5:0/981001984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79c8101fd0 0x7f79c819a320 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f79c400e9f0 tx=0x7f79c400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:26:51.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:51.852+0000 7f79be7fc640 1 -- 172.21.15.5:0/981001984 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c400cd80 con 0x7f79c8101fd0 2024-08-31T05:26:51.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:51.852+0000 7f79cf985640 1 -- 172.21.15.5:0/981001984 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79c81a0580 con 0x7f79c8101fd0 2024-08-31T05:26:51.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:51.852+0000 7f79be7fc640 1 -- 172.21.15.5:0/981001984 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f79c40108e0 con 0x7f79c8101fd0 2024-08-31T05:26:51.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:51.852+0000 7f79be7fc640 1 -- 172.21.15.5:0/981001984 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c4018980 con 0x7f79c8101fd0 2024-08-31T05:26:51.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:51.852+0000 7f79cf985640 1 -- 172.21.15.5:0/981001984 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79c81a6ce0 con 0x7f79c8101fd0 2024-08-31T05:26:51.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:51.853+0000 7f79cf985640 1 -- 172.21.15.5:0/981001984 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79c8103250 con 0x7f79c8101fd0 2024-08-31T05:26:51.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:51.854+0000 7f79be7fc640 1 -- 172.21.15.5:0/981001984 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f79c4010430 con 0x7f79c8101fd0 2024-08-31T05:26:51.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:51.855+0000 7f79be7fc640 1 --2- 172.21.15.5:0/981001984 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f79b40b4b80 0x7f79b40b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:51.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:51.855+0000 7f79ccf20640 1 --2- 172.21.15.5:0/981001984 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f79b40b4b80 0x7f79b40b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:51.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:51.856+0000 7f79be7fc640 1 -- 172.21.15.5:0/981001984 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7f79c40e5620 con 0x7f79c8101fd0 2024-08-31T05:26:51.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:51.856+0000 7f79ccf20640 1 --2- 172.21.15.5:0/981001984 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f79b40b4b80 0x7f79b40b7090 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f79b800a340 tx=0x7f79b8030510 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:26:51.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:51.858+0000 7f79be7fc640 1 -- 172.21.15.5:0/981001984 <== mon.2 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f79c40ac430 con 0x7f79c8101fd0 2024-08-31T05:26:51.872 INFO:journalctl@ceph.mds.k.smithi050.stdout:Aug 31 05:26:51 smithi050 podman[52654]: 2024-08-31 05:26:51.500968908 +0000 UTC m=+0.015990557 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T05:26:51.872 INFO:journalctl@ceph.mds.k.smithi050.stdout:Aug 31 05:26:51 smithi050 podman[52654]: 2024-08-31 05:26:51.618142519 +0000 UTC m=+0.133164165 container create 7dea81a4f4a0313db8e618533dd6f544228a08363180bef2dbe3d1fa34eac3d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-k, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-08-31T05:26:51.872 INFO:journalctl@ceph.mds.k.smithi050.stdout:Aug 31 05:26:51 smithi050 podman[52654]: 2024-08-31 05:26:51.870994234 +0000 UTC m=+0.386015881 container init 7dea81a4f4a0313db8e618533dd6f544228a08363180bef2dbe3d1fa34eac3d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-k, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T05:26:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:52.089+0000 7f79cf985640 1 -- 172.21.15.5:0/981001984 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f79c81023e0 con 0x7f79c8101fd0 2024-08-31T05:26:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:52.090+0000 7f79be7fc640 1 -- 172.21.15.5:0/981001984 <== mon.2 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1432 (secure 0 0 0) 0x7f79c40b0bf0 con 0x7f79c8101fd0 2024-08-31T05:26:52.092 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:26:52.092 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":2,"btime":"2024-08-31T05:26:49:040615+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6833/364083443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":364083443},{"type":"v1","addr":"172.21.15.70:6833","nonce":364083443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-08-31T05:26:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 2 2024-08-31T05:26:52.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:52.092+0000 7f79cf985640 1 -- 172.21.15.5:0/981001984 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f79b40b4b80 msgr2=0x7f79b40b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:52.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:52.092+0000 7f79cf985640 1 --2- 172.21.15.5:0/981001984 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f79b40b4b80 0x7f79b40b7090 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f79b800a340 tx=0x7f79b8030510 comp rx=0 tx=0).stop 2024-08-31T05:26:52.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:52.092+0000 7f79cf985640 1 -- 172.21.15.5:0/981001984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79c8101fd0 msgr2=0x7f79c819a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:52.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:52.092+0000 7f79cf985640 1 --2- 172.21.15.5:0/981001984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79c8101fd0 0x7f79c819a320 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f79c400e9f0 tx=0x7f79c400eeb0 comp rx=0 tx=0).stop 2024-08-31T05:26:52.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:52.092+0000 7f79cf985640 1 -- 172.21.15.5:0/981001984 shutdown_connections 2024-08-31T05:26:52.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:52.092+0000 7f79cf985640 1 --2- 172.21.15.5:0/981001984 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f79b40b4b80 0x7f79b40b7090 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:52.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:52.092+0000 7f79cf985640 1 --2- 172.21.15.5:0/981001984 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79c8108260 0x7f79c819fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:52.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:52.092+0000 7f79cf985640 1 --2- 172.21.15.5:0/981001984 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79c8107910 0x7f79c819a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:52.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:52.092+0000 7f79cf985640 1 --2- 172.21.15.5:0/981001984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79c8101fd0 0x7f79c819a320 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:52.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:52.092+0000 7f79cf985640 1 -- 172.21.15.5:0/981001984 >> 172.21.15.5:0/981001984 conn(0x7f79c8079bb0 msgr2=0x7f79c8105a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:26:52.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:52.092+0000 7f79cf985640 1 -- 172.21.15.5:0/981001984 shutdown_connections 2024-08-31T05:26:52.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:52.092+0000 7f79cf985640 1 -- 172.21.15.5:0/981001984 wait complete. 2024-08-31T05:26:52.157 INFO:journalctl@ceph.mds.k.smithi050.stdout:Aug 31 05:26:51 smithi050 podman[52654]: 2024-08-31 05:26:51.873952383 +0000 UTC m=+0.388974034 container start 7dea81a4f4a0313db8e618533dd6f544228a08363180bef2dbe3d1fa34eac3d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-k, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1) 2024-08-31T05:26:52.157 INFO:journalctl@ceph.mds.k.smithi050.stdout:Aug 31 05:26:51 smithi050 ceph-mds[52673]: -- 172.21.15.50:0/772915440 <== mon.2 v2:172.21.15.50:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5581aabb7860 con 0x5581aed5d600 2024-08-31T05:26:52.157 INFO:journalctl@ceph.mds.k.smithi050.stdout:Aug 31 05:26:51 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-k[52669]: starting mds.k at 2024-08-31T05:26:52.157 INFO:journalctl@ceph.mds.k.smithi050.stdout:Aug 31 05:26:51 smithi050 bash[52654]: 7dea81a4f4a0313db8e618533dd6f544228a08363180bef2dbe3d1fa34eac3d2 2024-08-31T05:26:52.157 INFO:journalctl@ceph.mds.k.smithi050.stdout:Aug 31 05:26:51 smithi050 systemd[1]: Started Ceph mds.k for 69422704-6758-11ef-bcd4-c7b262605968. 2024-08-31T05:26:53.165 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:53 smithi005 ceph-mon[18602]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:26:53.165 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:53 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:53.165 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:53 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:53.165 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:53 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:53.166 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:53 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T05:26:53.166 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:53 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T05:26:53.166 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:53 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:26:53.166 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:53 smithi005 ceph-mon[18602]: Deploying daemon mds.j on smithi005 2024-08-31T05:26:53.166 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:53 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/981001984' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:26:53.166 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:53 smithi005 ceph-mon[18602]: mds.? [v2:172.21.15.50:6832/1153378982,v1:172.21.15.50:6833/1153378982] up:boot 2024-08-31T05:26:53.166 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:53 smithi005 ceph-mon[18602]: fsmap 2 up:standby 2024-08-31T05:26:53.166 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:53 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-08-31T05:26:53.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:53 smithi070 ceph-mon[22316]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:26:53.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:53 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:53.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:53 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:53.337 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:53 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:53.337 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:53 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T05:26:53.337 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:53 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T05:26:53.337 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:53 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:26:53.337 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:53 smithi070 ceph-mon[22316]: Deploying daemon mds.j on smithi005 2024-08-31T05:26:53.337 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:53 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/981001984' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:26:53.337 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:53 smithi070 ceph-mon[22316]: mds.? [v2:172.21.15.50:6832/1153378982,v1:172.21.15.50:6833/1153378982] up:boot 2024-08-31T05:26:53.337 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:53 smithi070 ceph-mon[22316]: fsmap 2 up:standby 2024-08-31T05:26:53.337 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:53 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-08-31T05:26:53.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:53 smithi050 ceph-mon[22146]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:26:54.005 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:53 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:54.005 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:53 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:54.005 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:53 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:54.005 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:53 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T05:26:54.006 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:53 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T05:26:54.006 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:53 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:26:54.006 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:53 smithi050 ceph-mon[22146]: Deploying daemon mds.j on smithi005 2024-08-31T05:26:54.006 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:53 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/981001984' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:26:54.006 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:53 smithi050 ceph-mon[22146]: mds.? [v2:172.21.15.50:6832/1153378982,v1:172.21.15.50:6833/1153378982] up:boot 2024-08-31T05:26:54.006 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:53 smithi050 ceph-mon[22146]: fsmap 2 up:standby 2024-08-31T05:26:54.006 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:53 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-08-31T05:26:54.879 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T05:26:54.903 INFO:journalctl@ceph.mds.j.smithi005.stdout:Aug 31 05:26:54 smithi005 systemd[1]: Starting Ceph mds.j for 69422704-6758-11ef-bcd4-c7b262605968... 2024-08-31T05:26:55.156 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:55 smithi050 ceph-mon[22146]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:26:55.180 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:55 smithi005 ceph-mon[18602]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:26:55.181 INFO:journalctl@ceph.mds.j.smithi005.stdout:Aug 31 05:26:54 smithi005 podman[59229]: 2024-08-31 05:26:54.805848261 +0000 UTC m=+0.015980555 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T05:26:55.181 INFO:journalctl@ceph.mds.j.smithi005.stdout:Aug 31 05:26:54 smithi005 podman[59229]: 2024-08-31 05:26:54.926236244 +0000 UTC m=+0.136368533 container create 79c435f3a5b958143ff7cc7c0074bee8a93a93f77b1edcee18ca983169ab91ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-j, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1) 2024-08-31T05:26:55.181 INFO:journalctl@ceph.mds.j.smithi005.stdout:Aug 31 05:26:55 smithi005 podman[59229]: 2024-08-31 05:26:55.179217837 +0000 UTC m=+0.389350127 container init 79c435f3a5b958143ff7cc7c0074bee8a93a93f77b1edcee18ca983169ab91ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-08-31T05:26:55.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:55 smithi070 ceph-mon[22316]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:26:55.384 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:26:55.467 INFO:journalctl@ceph.mds.j.smithi005.stdout:Aug 31 05:26:55 smithi005 podman[59229]: 2024-08-31 05:26:55.182494133 +0000 UTC m=+0.392626423 container start 79c435f3a5b958143ff7cc7c0074bee8a93a93f77b1edcee18ca983169ab91ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-j, GIT_CLEAN=True, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-08-31T05:26:55.467 INFO:journalctl@ceph.mds.j.smithi005.stdout:Aug 31 05:26:55 smithi005 ceph-mds[59279]: -- 172.21.15.5:0/35147158 <== mon.0 v2:172.21.15.5:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56328e2fbc20 con 0x5632924a1a80 2024-08-31T05:26:55.467 INFO:journalctl@ceph.mds.j.smithi005.stdout:Aug 31 05:26:55 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-j[59262]: starting mds.j at 2024-08-31T05:26:55.467 INFO:journalctl@ceph.mds.j.smithi005.stdout:Aug 31 05:26:55 smithi005 bash[59229]: 79c435f3a5b958143ff7cc7c0074bee8a93a93f77b1edcee18ca983169ab91ac 2024-08-31T05:26:55.467 INFO:journalctl@ceph.mds.j.smithi005.stdout:Aug 31 05:26:55 smithi005 systemd[1]: Started Ceph mds.j for 69422704-6758-11ef-bcd4-c7b262605968. 2024-08-31T05:26:55.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:55.941+0000 7fd3850e5640 1 -- 172.21.15.5:0/4131222735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd380103900 msgr2=0x7fd380103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:55.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:55.941+0000 7fd3850e5640 1 --2- 172.21.15.5:0/4131222735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd380103900 0x7fd380103d10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd370009900 tx=0x7fd37002a410 comp rx=0 tx=0).stop 2024-08-31T05:26:55.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:55.941+0000 7fd3850e5640 1 -- 172.21.15.5:0/4131222735 shutdown_connections 2024-08-31T05:26:55.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:55.941+0000 7fd3850e5640 1 --2- 172.21.15.5:0/4131222735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd380109b90 0x7fd3801103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:55.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:55.941+0000 7fd3850e5640 1 --2- 172.21.15.5:0/4131222735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd380109240 0x7fd380109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:55.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:55.941+0000 7fd3850e5640 1 --2- 172.21.15.5:0/4131222735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd380103900 0x7fd380103d10 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:55.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:55.941+0000 7fd3850e5640 1 -- 172.21.15.5:0/4131222735 >> 172.21.15.5:0/4131222735 conn(0x7fd38007b5f0 msgr2=0x7fd38007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:26:55.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:55.941+0000 7fd3850e5640 1 -- 172.21.15.5:0/4131222735 shutdown_connections 2024-08-31T05:26:55.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:55.941+0000 7fd3850e5640 1 -- 172.21.15.5:0/4131222735 wait complete. 2024-08-31T05:26:55.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:55.942+0000 7fd3850e5640 1 Processor -- start 2024-08-31T05:26:55.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:55.942+0000 7fd3850e5640 1 -- start start 2024-08-31T05:26:55.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:55.943+0000 7fd3850e5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd380103900 0x7fd38019a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:55.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:55.943+0000 7fd3850e5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd380109240 0x7fd38019a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:55.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:55.943+0000 7fd3850e5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd380109b90 0x7fd38019faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:55.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:55.943+0000 7fd3850e5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd3801138a0 con 0x7fd380109240 2024-08-31T05:26:55.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:55.943+0000 7fd3850e5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd380113720 con 0x7fd380103900 2024-08-31T05:26:55.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:55.943+0000 7fd3850e5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd380113a20 con 0x7fd380109b90 2024-08-31T05:26:55.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:55.943+0000 7fd37e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd380109240 0x7fd38019a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:55.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:55.943+0000 7fd37e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd380109240 0x7fd38019a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58740/0 (socket says 172.21.15.5:58740) 2024-08-31T05:26:55.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:55.943+0000 7fd37e59c640 1 -- 172.21.15.5:0/917969440 learned_addr learned my addr 172.21.15.5:0/917969440 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:26:55.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:55.943+0000 7fd37ed9d640 1 --2- 172.21.15.5:0/917969440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd380103900 0x7fd38019a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:55.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:55.943+0000 7fd37f59e640 1 --2- 172.21.15.5:0/917969440 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd380109b90 0x7fd38019faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:55.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:55.943+0000 7fd37e59c640 1 -- 172.21.15.5:0/917969440 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd380109b90 msgr2=0x7fd38019faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:55.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:55.943+0000 7fd37e59c640 1 --2- 172.21.15.5:0/917969440 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd380109b90 0x7fd38019faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:55.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:55.943+0000 7fd37e59c640 1 -- 172.21.15.5:0/917969440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd380103900 msgr2=0x7fd38019a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:55.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:55.943+0000 7fd37e59c640 1 --2- 172.21.15.5:0/917969440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd380103900 0x7fd38019a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:55.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:55.943+0000 7fd37e59c640 1 -- 172.21.15.5:0/917969440 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3801a0220 con 0x7fd380109240 2024-08-31T05:26:55.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:55.943+0000 7fd37e59c640 1 --2- 172.21.15.5:0/917969440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd380109240 0x7fd38019a850 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd37400c970 tx=0x7fd37400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:26:55.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:55.943+0000 7fd367fff640 1 -- 172.21.15.5:0/917969440 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd374007bb0 con 0x7fd380109240 2024-08-31T05:26:55.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:55.943+0000 7fd3850e5640 1 -- 172.21.15.5:0/917969440 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3801a0510 con 0x7fd380109240 2024-08-31T05:26:55.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:55.944+0000 7fd367fff640 1 -- 172.21.15.5:0/917969440 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd374007d50 con 0x7fd380109240 2024-08-31T05:26:55.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:55.944+0000 7fd367fff640 1 -- 172.21.15.5:0/917969440 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd374004e10 con 0x7fd380109240 2024-08-31T05:26:55.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:55.944+0000 7fd3850e5640 1 -- 172.21.15.5:0/917969440 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3801a6c70 con 0x7fd380109240 2024-08-31T05:26:55.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:55.945+0000 7fd3850e5640 1 -- 172.21.15.5:0/917969440 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd380103d10 con 0x7fd380109240 2024-08-31T05:26:55.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:55.946+0000 7fd367fff640 1 -- 172.21.15.5:0/917969440 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7fd374004fb0 con 0x7fd380109240 2024-08-31T05:26:55.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:55.947+0000 7fd367fff640 1 --2- 172.21.15.5:0/917969440 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd3680b4b80 0x7fd3680b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:26:55.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:55.947+0000 7fd37ed9d640 1 --2- 172.21.15.5:0/917969440 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd3680b4b80 0x7fd3680b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:26:55.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:55.947+0000 7fd367fff640 1 -- 172.21.15.5:0/917969440 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7fd3740e4b60 con 0x7fd380109240 2024-08-31T05:26:55.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:55.948+0000 7fd37ed9d640 1 --2- 172.21.15.5:0/917969440 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd3680b4b80 0x7fd3680b7090 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd370005ab0 tx=0x7fd370005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:26:55.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:55.952+0000 7fd367fff640 1 -- 172.21.15.5:0/917969440 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd374014030 con 0x7fd380109240 2024-08-31T05:26:56.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:56.187+0000 7fd3850e5640 1 -- 172.21.15.5:0/917969440 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd38002e430 con 0x7fd380109240 2024-08-31T05:26:56.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:56.188+0000 7fd367fff640 1 -- 172.21.15.5:0/917969440 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3079 (secure 0 0 0) 0x7fd3740ab970 con 0x7fd380109240 2024-08-31T05:26:56.190 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:26:56.190 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":4,"btime":"2024-08-31T05:26:56:013302+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14739,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2024812199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2024812199},{"type":"v1","addr":"172.21.15.5:6835","nonce":2024812199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24560,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1153378982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1153378982},{"type":"v1","addr":"172.21.15.50:6833","nonce":1153378982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6833/364083443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":364083443},{"type":"v1","addr":"172.21.15.70:6833","nonce":364083443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-08-31T05:26:56.191 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 4 2024-08-31T05:26:56.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:56.190+0000 7fd3850e5640 1 -- 172.21.15.5:0/917969440 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd3680b4b80 msgr2=0x7fd3680b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:56.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:56.190+0000 7fd3850e5640 1 --2- 172.21.15.5:0/917969440 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd3680b4b80 0x7fd3680b7090 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd370005ab0 tx=0x7fd370005a20 comp rx=0 tx=0).stop 2024-08-31T05:26:56.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:56.190+0000 7fd3850e5640 1 -- 172.21.15.5:0/917969440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd380109240 msgr2=0x7fd38019a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:26:56.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:56.190+0000 7fd3850e5640 1 --2- 172.21.15.5:0/917969440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd380109240 0x7fd38019a850 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd37400c970 tx=0x7fd37400ce30 comp rx=0 tx=0).stop 2024-08-31T05:26:56.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:56.190+0000 7fd3850e5640 1 -- 172.21.15.5:0/917969440 shutdown_connections 2024-08-31T05:26:56.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:56.190+0000 7fd3850e5640 1 --2- 172.21.15.5:0/917969440 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd3680b4b80 0x7fd3680b7090 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:56.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:56.190+0000 7fd3850e5640 1 --2- 172.21.15.5:0/917969440 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd380109b90 0x7fd38019faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:56.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:56.190+0000 7fd3850e5640 1 --2- 172.21.15.5:0/917969440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd380109240 0x7fd38019a850 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:56.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:56.190+0000 7fd3850e5640 1 --2- 172.21.15.5:0/917969440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd380103900 0x7fd38019a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:26:56.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:56.190+0000 7fd3850e5640 1 -- 172.21.15.5:0/917969440 >> 172.21.15.5:0/917969440 conn(0x7fd38007b5f0 msgr2=0x7fd380107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:26:56.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:56.190+0000 7fd3850e5640 1 -- 172.21.15.5:0/917969440 shutdown_connections 2024-08-31T05:26:56.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:26:56.190+0000 7fd3850e5640 1 -- 172.21.15.5:0/917969440 wait complete. 2024-08-31T05:26:56.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:56 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:56.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:56 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:56.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:56 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:56.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:56 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T05:26:56.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:56 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T05:26:56.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:56 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:26:56.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:56 smithi005 ceph-mon[18602]: Deploying daemon mds.d on smithi005 2024-08-31T05:26:56.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:56 smithi005 ceph-mon[18602]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:26:56.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:56 smithi005 ceph-mon[18602]: mds.? [v2:172.21.15.5:6834/2024812199,v1:172.21.15.5:6835/2024812199] up:boot 2024-08-31T05:26:56.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:56 smithi005 ceph-mon[18602]: fsmap 3 up:standby 2024-08-31T05:26:56.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:56 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-08-31T05:26:56.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:56 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/917969440' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:26:56.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:56 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:56.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:56 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:56.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:56 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:56.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:56 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T05:26:56.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:56 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T05:26:56.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:56 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:26:56.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:56 smithi050 ceph-mon[22146]: Deploying daemon mds.d on smithi005 2024-08-31T05:26:56.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:56 smithi050 ceph-mon[22146]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:26:56.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:56 smithi050 ceph-mon[22146]: mds.? [v2:172.21.15.5:6834/2024812199,v1:172.21.15.5:6835/2024812199] up:boot 2024-08-31T05:26:56.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:56 smithi050 ceph-mon[22146]: fsmap 3 up:standby 2024-08-31T05:26:56.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:56 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-08-31T05:26:56.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:56 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/917969440' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:26:56.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:56 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:56.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:56 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:56.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:56 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:26:56.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:56 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T05:26:56.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:56 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T05:26:56.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:56 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:26:56.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:56 smithi070 ceph-mon[22316]: Deploying daemon mds.d on smithi005 2024-08-31T05:26:56.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:56 smithi070 ceph-mon[22316]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:26:56.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:56 smithi070 ceph-mon[22316]: mds.? [v2:172.21.15.5:6834/2024812199,v1:172.21.15.5:6835/2024812199] up:boot 2024-08-31T05:26:56.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:56 smithi070 ceph-mon[22316]: fsmap 3 up:standby 2024-08-31T05:26:56.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:56 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-08-31T05:26:56.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:56 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/917969440' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:26:58.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:26:58 smithi005 ceph-mon[18602]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:26:58.717 INFO:journalctl@ceph.mds.d.smithi005.stdout:Aug 31 05:26:58 smithi005 systemd[1]: Starting Ceph mds.d for 69422704-6758-11ef-bcd4-c7b262605968... 2024-08-31T05:26:58.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:26:58 smithi070 ceph-mon[22316]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:26:58.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:26:58 smithi050 ceph-mon[22146]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:26:59.123 INFO:journalctl@ceph.mds.d.smithi005.stdout:Aug 31 05:26:58 smithi005 podman[59642]: 2024-08-31 05:26:58.747726311 +0000 UTC m=+0.016151954 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T05:26:59.123 INFO:journalctl@ceph.mds.d.smithi005.stdout:Aug 31 05:26:58 smithi005 podman[59642]: 2024-08-31 05:26:58.860459069 +0000 UTC m=+0.128884737 container create abe2903c3fbc67dc1e266b5eb10c9f36768ba1d2400e3a2be2be321f17ee5776 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-d, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1) 2024-08-31T05:26:59.123 INFO:journalctl@ceph.mds.d.smithi005.stdout:Aug 31 05:26:59 smithi005 podman[59642]: 2024-08-31 05:26:59.121625139 +0000 UTC m=+0.390050774 container init abe2903c3fbc67dc1e266b5eb10c9f36768ba1d2400e3a2be2be321f17ee5776 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-d, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS) 2024-08-31T05:26:59.467 INFO:journalctl@ceph.mds.d.smithi005.stdout:Aug 31 05:26:59 smithi005 podman[59642]: 2024-08-31 05:26:59.125320126 +0000 UTC m=+0.393745752 container start abe2903c3fbc67dc1e266b5eb10c9f36768ba1d2400e3a2be2be321f17ee5776 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-d, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2) 2024-08-31T05:26:59.467 INFO:journalctl@ceph.mds.d.smithi005.stdout:Aug 31 05:26:59 smithi005 ceph-mds[59661]: -- 172.21.15.5:0/2135214418 <== mon.0 v2:172.21.15.5:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ba68cb1860 con 0x55ba6ce57600 2024-08-31T05:26:59.467 INFO:journalctl@ceph.mds.d.smithi005.stdout:Aug 31 05:26:59 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-d[59657]: starting mds.d at 2024-08-31T05:26:59.467 INFO:journalctl@ceph.mds.d.smithi005.stdout:Aug 31 05:26:59 smithi005 bash[59642]: abe2903c3fbc67dc1e266b5eb10c9f36768ba1d2400e3a2be2be321f17ee5776 2024-08-31T05:26:59.467 INFO:journalctl@ceph.mds.d.smithi005.stdout:Aug 31 05:26:59 smithi005 systemd[1]: Started Ceph mds.d for 69422704-6758-11ef-bcd4-c7b262605968. 2024-08-31T05:26:59.699 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T05:26:59.953 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:27:00.336 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:00 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:00.336 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:00 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:00.336 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:00 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:00.336 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:00 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T05:27:00.336 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:00 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T05:27:00.336 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:00 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:27:00.336 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:00 smithi005 ceph-mon[18602]: Deploying daemon mds.e on smithi050 2024-08-31T05:27:00.336 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:00 smithi005 ceph-mon[18602]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:00.336 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:00 smithi005 ceph-mon[18602]: mds.? [v2:172.21.15.5:6836/3629023702,v1:172.21.15.5:6837/3629023702] up:boot 2024-08-31T05:27:00.337 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:00 smithi005 ceph-mon[18602]: fsmap 4 up:standby 2024-08-31T05:27:00.337 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:00 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-08-31T05:27:00.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.424+0000 7efe6acde640 1 -- 172.21.15.5:0/2346066555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe64109b90 msgr2=0x7efe641103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:00.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.424+0000 7efe6acde640 1 --2- 172.21.15.5:0/2346066555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe64109b90 0x7efe641103c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7efe5c009ca0 tx=0x7efe5c02a8c0 comp rx=0 tx=0).stop 2024-08-31T05:27:00.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.424+0000 7efe6acde640 1 -- 172.21.15.5:0/2346066555 shutdown_connections 2024-08-31T05:27:00.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.424+0000 7efe6acde640 1 --2- 172.21.15.5:0/2346066555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe64109b90 0x7efe641103c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:00.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.424+0000 7efe6acde640 1 --2- 172.21.15.5:0/2346066555 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe64109240 0x7efe64109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:00.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.424+0000 7efe6acde640 1 --2- 172.21.15.5:0/2346066555 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe64103900 0x7efe64103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:00.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.424+0000 7efe6acde640 1 -- 172.21.15.5:0/2346066555 >> 172.21.15.5:0/2346066555 conn(0x7efe6407b5f0 msgr2=0x7efe6407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:00.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.424+0000 7efe6acde640 1 -- 172.21.15.5:0/2346066555 shutdown_connections 2024-08-31T05:27:00.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.425+0000 7efe6acde640 1 -- 172.21.15.5:0/2346066555 wait complete. 2024-08-31T05:27:00.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.425+0000 7efe6acde640 1 Processor -- start 2024-08-31T05:27:00.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.425+0000 7efe6acde640 1 -- start start 2024-08-31T05:27:00.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.425+0000 7efe6acde640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe64103900 0x7efe6419a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:00.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.425+0000 7efe6acde640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe64109240 0x7efe6419a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:00.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.426+0000 7efe6acde640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe64109b90 0x7efe6419f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:00.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.426+0000 7efe6acde640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7efe64113850 con 0x7efe64109240 2024-08-31T05:27:00.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.426+0000 7efe6acde640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7efe641136d0 con 0x7efe64103900 2024-08-31T05:27:00.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.426+0000 7efe6acde640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efe641139d0 con 0x7efe64109b90 2024-08-31T05:27:00.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.426+0000 7efe63fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe64109240 0x7efe6419a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:00.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.426+0000 7efe63fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe64109240 0x7efe6419a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58776/0 (socket says 172.21.15.5:58776) 2024-08-31T05:27:00.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.426+0000 7efe63fff640 1 -- 172.21.15.5:0/1295560000 learned_addr learned my addr 172.21.15.5:0/1295560000 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:27:00.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.426+0000 7efe68a7a640 1 --2- 172.21.15.5:0/1295560000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe64103900 0x7efe6419a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:00.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.426+0000 7efe6927b640 1 --2- 172.21.15.5:0/1295560000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe64109b90 0x7efe6419f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:00.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.426+0000 7efe63fff640 1 -- 172.21.15.5:0/1295560000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe64109b90 msgr2=0x7efe6419f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:00.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.426+0000 7efe63fff640 1 --2- 172.21.15.5:0/1295560000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe64109b90 0x7efe6419f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:00.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.426+0000 7efe63fff640 1 -- 172.21.15.5:0/1295560000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe64103900 msgr2=0x7efe6419a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:00.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.426+0000 7efe63fff640 1 --2- 172.21.15.5:0/1295560000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe64103900 0x7efe6419a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:00.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.426+0000 7efe63fff640 1 -- 172.21.15.5:0/1295560000 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe641a0110 con 0x7efe64109240 2024-08-31T05:27:00.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.426+0000 7efe6927b640 1 --2- 172.21.15.5:0/1295560000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe64109b90 0x7efe6419f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:27:00.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.426+0000 7efe63fff640 1 --2- 172.21.15.5:0/1295560000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe64109240 0x7efe6419a740 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7efe5000d740 tx=0x7efe5000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:00.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.426+0000 7efe61ffb640 1 -- 172.21.15.5:0/1295560000 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe50017070 con 0x7efe64109240 2024-08-31T05:27:00.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.426+0000 7efe61ffb640 1 -- 172.21.15.5:0/1295560000 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe5000de50 con 0x7efe64109240 2024-08-31T05:27:00.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.426+0000 7efe6acde640 1 -- 172.21.15.5:0/1295560000 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe641a0400 con 0x7efe64109240 2024-08-31T05:27:00.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.426+0000 7efe61ffb640 1 -- 172.21.15.5:0/1295560000 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe5000f620 con 0x7efe64109240 2024-08-31T05:27:00.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.427+0000 7efe6acde640 1 -- 172.21.15.5:0/1295560000 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe641a6b60 con 0x7efe64109240 2024-08-31T05:27:00.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.428+0000 7efe6acde640 1 -- 172.21.15.5:0/1295560000 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe64103d10 con 0x7efe64109240 2024-08-31T05:27:00.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.429+0000 7efe61ffb640 1 -- 172.21.15.5:0/1295560000 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7efe5001a070 con 0x7efe64109240 2024-08-31T05:27:00.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.430+0000 7efe61ffb640 1 --2- 172.21.15.5:0/1295560000 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7efe540b4c00 0x7efe540b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:00.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.430+0000 7efe61ffb640 1 -- 172.21.15.5:0/1295560000 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7efe500e4790 con 0x7efe64109240 2024-08-31T05:27:00.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.430+0000 7efe68a7a640 1 --2- 172.21.15.5:0/1295560000 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7efe540b4c00 0x7efe540b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:00.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.430+0000 7efe68a7a640 1 --2- 172.21.15.5:0/1295560000 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7efe540b4c00 0x7efe540b7110 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7efe5800bbe0 tx=0x7efe5800b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:00.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.434+0000 7efe61ffb640 1 -- 172.21.15.5:0/1295560000 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7efe500abc90 con 0x7efe64109240 2024-08-31T05:27:00.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:00 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:00.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:00 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:00.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:00 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:00.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:00 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T05:27:00.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:00 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T05:27:00.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:00 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:27:00.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:00 smithi070 ceph-mon[22316]: Deploying daemon mds.e on smithi050 2024-08-31T05:27:00.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:00 smithi070 ceph-mon[22316]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:00.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:00 smithi070 ceph-mon[22316]: mds.? [v2:172.21.15.5:6836/3629023702,v1:172.21.15.5:6837/3629023702] up:boot 2024-08-31T05:27:00.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:00 smithi070 ceph-mon[22316]: fsmap 4 up:standby 2024-08-31T05:27:00.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:00 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-08-31T05:27:00.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:00 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:00.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:00 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:00.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:00 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:00.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:00 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T05:27:00.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:00 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T05:27:00.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:00 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:27:00.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:00 smithi050 ceph-mon[22146]: Deploying daemon mds.e on smithi050 2024-08-31T05:27:00.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:00 smithi050 ceph-mon[22146]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:00.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:00 smithi050 ceph-mon[22146]: mds.? [v2:172.21.15.5:6836/3629023702,v1:172.21.15.5:6837/3629023702] up:boot 2024-08-31T05:27:00.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:00 smithi050 ceph-mon[22146]: fsmap 4 up:standby 2024-08-31T05:27:00.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:00 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-08-31T05:27:00.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.654+0000 7efe6acde640 1 -- 172.21.15.5:0/1295560000 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efe6402e430 con 0x7efe64109240 2024-08-31T05:27:00.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.654+0000 7efe61ffb640 1 -- 172.21.15.5:0/1295560000 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3901 (secure 0 0 0) 0x7efe500b41d0 con 0x7efe64109240 2024-08-31T05:27:00.659 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:27:00.659 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":5,"btime":"2024-08-31T05:26:59:464729+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14739,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2024812199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2024812199},{"type":"v1","addr":"172.21.15.5:6835","nonce":2024812199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3629023702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3629023702},{"type":"v1","addr":"172.21.15.5:6837","nonce":3629023702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24560,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1153378982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1153378982},{"type":"v1","addr":"172.21.15.50:6833","nonce":1153378982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6833/364083443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":364083443},{"type":"v1","addr":"172.21.15.70:6833","nonce":364083443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-08-31T05:27:00.659 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 5 2024-08-31T05:27:00.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.658+0000 7efe6acde640 1 -- 172.21.15.5:0/1295560000 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7efe540b4c00 msgr2=0x7efe540b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:00.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.658+0000 7efe6acde640 1 --2- 172.21.15.5:0/1295560000 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7efe540b4c00 0x7efe540b7110 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7efe5800bbe0 tx=0x7efe5800b390 comp rx=0 tx=0).stop 2024-08-31T05:27:00.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.658+0000 7efe6acde640 1 -- 172.21.15.5:0/1295560000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe64109240 msgr2=0x7efe6419a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:00.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.658+0000 7efe6acde640 1 --2- 172.21.15.5:0/1295560000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe64109240 0x7efe6419a740 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7efe5000d740 tx=0x7efe5000dc00 comp rx=0 tx=0).stop 2024-08-31T05:27:00.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.658+0000 7efe6acde640 1 -- 172.21.15.5:0/1295560000 shutdown_connections 2024-08-31T05:27:00.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.658+0000 7efe6acde640 1 --2- 172.21.15.5:0/1295560000 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7efe540b4c00 0x7efe540b7110 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:00.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.658+0000 7efe6acde640 1 --2- 172.21.15.5:0/1295560000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe64109b90 0x7efe6419f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:00.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.658+0000 7efe6acde640 1 --2- 172.21.15.5:0/1295560000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe64109240 0x7efe6419a740 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:00.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.658+0000 7efe6acde640 1 --2- 172.21.15.5:0/1295560000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe64103900 0x7efe6419a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:00.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.658+0000 7efe6acde640 1 -- 172.21.15.5:0/1295560000 >> 172.21.15.5:0/1295560000 conn(0x7efe6407b5f0 msgr2=0x7efe64107230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:00.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.658+0000 7efe6acde640 1 -- 172.21.15.5:0/1295560000 shutdown_connections 2024-08-31T05:27:00.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:00.658+0000 7efe6acde640 1 -- 172.21.15.5:0/1295560000 wait complete. 2024-08-31T05:27:01.358 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:01 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/1295560000' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:27:01.551 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:01 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/1295560000' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:27:01.551 INFO:journalctl@ceph.mds.e.smithi050.stdout:Aug 31 05:27:01 smithi050 systemd[1]: Starting Ceph mds.e for 69422704-6758-11ef-bcd4-c7b262605968... 2024-08-31T05:27:01.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:01 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/1295560000' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:27:01.820 INFO:journalctl@ceph.mds.e.smithi050.stdout:Aug 31 05:27:01 smithi050 podman[52966]: 2024-08-31 05:27:01.45204941 +0000 UTC m=+0.015764802 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T05:27:01.820 INFO:journalctl@ceph.mds.e.smithi050.stdout:Aug 31 05:27:01 smithi050 podman[52966]: 2024-08-31 05:27:01.565631317 +0000 UTC m=+0.129346693 container create d52661ba868e0339c8120adf33977cb9a21122c553f3a617e9a0f72c0ccebec6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T05:27:01.820 INFO:journalctl@ceph.mds.e.smithi050.stdout:Aug 31 05:27:01 smithi050 podman[52966]: 2024-08-31 05:27:01.818518131 +0000 UTC m=+0.382233503 container init d52661ba868e0339c8120adf33977cb9a21122c553f3a617e9a0f72c0ccebec6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-08-31T05:27:02.157 INFO:journalctl@ceph.mds.e.smithi050.stdout:Aug 31 05:27:01 smithi050 podman[52966]: 2024-08-31 05:27:01.822193753 +0000 UTC m=+0.385909134 container start d52661ba868e0339c8120adf33977cb9a21122c553f3a617e9a0f72c0ccebec6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-e, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T05:27:02.157 INFO:journalctl@ceph.mds.e.smithi050.stdout:Aug 31 05:27:01 smithi050 ceph-mds[52985]: -- 172.21.15.50:0/882421648 <== mon.2 v2:172.21.15.50:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c240a0b860 con 0x55c244bb1600 2024-08-31T05:27:02.157 INFO:journalctl@ceph.mds.e.smithi050.stdout:Aug 31 05:27:01 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-e[52981]: starting mds.e at 2024-08-31T05:27:02.157 INFO:journalctl@ceph.mds.e.smithi050.stdout:Aug 31 05:27:01 smithi050 bash[52966]: d52661ba868e0339c8120adf33977cb9a21122c553f3a617e9a0f72c0ccebec6 2024-08-31T05:27:02.157 INFO:journalctl@ceph.mds.e.smithi050.stdout:Aug 31 05:27:01 smithi050 systemd[1]: Started Ceph mds.e for 69422704-6758-11ef-bcd4-c7b262605968. 2024-08-31T05:27:03.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:02 smithi005 ceph-mon[18602]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:03.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:02 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:03.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:02 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:03.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:02 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:03.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:02 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T05:27:03.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:02 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T05:27:03.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:02 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:27:03.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:02 smithi005 ceph-mon[18602]: Deploying daemon mds.f on smithi070 2024-08-31T05:27:03.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:02 smithi005 ceph-mon[18602]: mds.? [v2:172.21.15.50:6834/2346896794,v1:172.21.15.50:6835/2346896794] up:boot 2024-08-31T05:27:03.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:02 smithi005 ceph-mon[18602]: fsmap 5 up:standby 2024-08-31T05:27:03.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:02 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-31T05:27:03.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:02 smithi070 ceph-mon[22316]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:03.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:02 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:03.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:02 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:03.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:02 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:03.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:02 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T05:27:03.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:02 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T05:27:03.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:02 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:27:03.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:02 smithi070 ceph-mon[22316]: Deploying daemon mds.f on smithi070 2024-08-31T05:27:03.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:02 smithi070 ceph-mon[22316]: mds.? [v2:172.21.15.50:6834/2346896794,v1:172.21.15.50:6835/2346896794] up:boot 2024-08-31T05:27:03.337 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:02 smithi070 ceph-mon[22316]: fsmap 5 up:standby 2024-08-31T05:27:03.337 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:02 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-31T05:27:03.388 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T05:27:03.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:02 smithi050 ceph-mon[22146]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:03.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:02 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:03.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:02 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:03.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:02 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:03.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:02 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T05:27:03.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:02 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T05:27:03.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:02 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:27:03.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:02 smithi050 ceph-mon[22146]: Deploying daemon mds.f on smithi070 2024-08-31T05:27:03.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:02 smithi050 ceph-mon[22146]: mds.? [v2:172.21.15.50:6834/2346896794,v1:172.21.15.50:6835/2346896794] up:boot 2024-08-31T05:27:03.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:02 smithi050 ceph-mon[22146]: fsmap 5 up:standby 2024-08-31T05:27:03.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:02 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-31T05:27:03.655 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:27:04.086 INFO:journalctl@ceph.mds.f.smithi070.stdout:Aug 31 05:27:03 smithi070 systemd[1]: Starting Ceph mds.f for 69422704-6758-11ef-bcd4-c7b262605968... 2024-08-31T05:27:04.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:04.169+0000 7f45fb6ab640 1 -- 172.21.15.5:0/519319729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45f4108ad0 msgr2=0x7f45f410f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:04.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:04.169+0000 7f45fb6ab640 1 --2- 172.21.15.5:0/519319729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45f4108ad0 0x7f45f410f300 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f45ec009ca0 tx=0x7f45ec02a8c0 comp rx=0 tx=0).stop 2024-08-31T05:27:04.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:04.169+0000 7f45fb6ab640 1 -- 172.21.15.5:0/519319729 shutdown_connections 2024-08-31T05:27:04.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:04.169+0000 7f45fb6ab640 1 --2- 172.21.15.5:0/519319729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45f4108ad0 0x7f45f410f300 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:04.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:04.169+0000 7f45fb6ab640 1 --2- 172.21.15.5:0/519319729 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45f4108180 0x7f45f4108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:04.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:04.169+0000 7f45fb6ab640 1 --2- 172.21.15.5:0/519319729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45f4102840 0x7f45f4102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:04.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:04.169+0000 7f45fb6ab640 1 -- 172.21.15.5:0/519319729 >> 172.21.15.5:0/519319729 conn(0x7f45f4079580 msgr2=0x7f45f4079990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:04.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:04.169+0000 7f45fb6ab640 1 -- 172.21.15.5:0/519319729 shutdown_connections 2024-08-31T05:27:04.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:04.169+0000 7f45fb6ab640 1 -- 172.21.15.5:0/519319729 wait complete. 2024-08-31T05:27:04.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:04.170+0000 7f45fb6ab640 1 Processor -- start 2024-08-31T05:27:04.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:04.170+0000 7f45fb6ab640 1 -- start start 2024-08-31T05:27:04.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:04.171+0000 7f45fb6ab640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45f4102840 0x7f45f419afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:04.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:04.171+0000 7f45fb6ab640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45f4108180 0x7f45f419b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:04.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:04.171+0000 7f45fb6ab640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45f4108ad0 0x7f45f419ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:04.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:04.171+0000 7f45fb6ab640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f45f4112730 con 0x7f45f4108180 2024-08-31T05:27:04.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:04.171+0000 7f45fb6ab640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f45f41125b0 con 0x7f45f4108ad0 2024-08-31T05:27:04.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:04.171+0000 7f45fb6ab640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f45f41128b0 con 0x7f45f4102840 2024-08-31T05:27:04.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:04.171+0000 7f45f8c46640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45f4108180 0x7f45f419b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:04.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:04.171+0000 7f45f8c46640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45f4108180 0x7f45f419b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58230/0 (socket says 172.21.15.5:58230) 2024-08-31T05:27:04.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:04.171+0000 7f45f8c46640 1 -- 172.21.15.5:0/3526322131 learned_addr learned my addr 172.21.15.5:0/3526322131 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:27:04.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:04.171+0000 7f45f9447640 1 --2- 172.21.15.5:0/3526322131 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45f4102840 0x7f45f419afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:04.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:04.171+0000 7f45f9c48640 1 --2- 172.21.15.5:0/3526322131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45f4108ad0 0x7f45f419ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:04.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:04.171+0000 7f45f8c46640 1 -- 172.21.15.5:0/3526322131 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45f4102840 msgr2=0x7f45f419afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:04.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:04.171+0000 7f45f8c46640 1 --2- 172.21.15.5:0/3526322131 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45f4102840 0x7f45f419afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:04.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:04.171+0000 7f45f8c46640 1 -- 172.21.15.5:0/3526322131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45f4108ad0 msgr2=0x7f45f419ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:04.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:04.171+0000 7f45f8c46640 1 --2- 172.21.15.5:0/3526322131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45f4108ad0 0x7f45f419ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:04.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:04.171+0000 7f45f8c46640 1 -- 172.21.15.5:0/3526322131 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45f41a6280 con 0x7f45f4108180 2024-08-31T05:27:04.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:04.171+0000 7f45f8c46640 1 --2- 172.21.15.5:0/3526322131 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45f4108180 0x7f45f419b500 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f45e400d770 tx=0x7f45e400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:04.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:04.172+0000 7f45ea7fc640 1 -- 172.21.15.5:0/3526322131 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e4017070 con 0x7f45f4108180 2024-08-31T05:27:04.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:04.172+0000 7f45fb6ab640 1 -- 172.21.15.5:0/3526322131 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45f41a6570 con 0x7f45f4108180 2024-08-31T05:27:04.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:04.172+0000 7f45ea7fc640 1 -- 172.21.15.5:0/3526322131 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f45e4009c30 con 0x7f45f4108180 2024-08-31T05:27:04.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:04.172+0000 7f45ea7fc640 1 -- 172.21.15.5:0/3526322131 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e400f620 con 0x7f45f4108180 2024-08-31T05:27:04.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:04.172+0000 7f45fb6ab640 1 -- 172.21.15.5:0/3526322131 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45f41a6b00 con 0x7f45f4108180 2024-08-31T05:27:04.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:04.173+0000 7f45fb6ab640 1 -- 172.21.15.5:0/3526322131 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45f4102c50 con 0x7f45f4108180 2024-08-31T05:27:04.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:04.174+0000 7f45ea7fc640 1 -- 172.21.15.5:0/3526322131 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f45e401a070 con 0x7f45f4108180 2024-08-31T05:27:04.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:04.175+0000 7f45ea7fc640 1 --2- 172.21.15.5:0/3526322131 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f45e00b4b80 0x7f45e00b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:04.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:04.175+0000 7f45f9447640 1 --2- 172.21.15.5:0/3526322131 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f45e00b4b80 0x7f45e00b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:04.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:04.175+0000 7f45ea7fc640 1 -- 172.21.15.5:0/3526322131 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7f45e40e4820 con 0x7f45f4108180 2024-08-31T05:27:04.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:04.176+0000 7f45f9447640 1 --2- 172.21.15.5:0/3526322131 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f45e00b4b80 0x7f45e00b7090 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f45f406c140 tx=0x7f45f000b410 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:04.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:04.184+0000 7f45ea7fc640 1 -- 172.21.15.5:0/3526322131 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f45e4009de0 con 0x7f45f4108180 2024-08-31T05:27:04.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:04.421+0000 7f45fb6ab640 1 -- 172.21.15.5:0/3526322131 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f45f402e430 con 0x7f45f4108180 2024-08-31T05:27:04.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:04.422+0000 7f45ea7fc640 1 -- 172.21.15.5:0/3526322131 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4726 (secure 0 0 0) 0x7f45e40b4260 con 0x7f45f4108180 2024-08-31T05:27:04.425 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:27:04.425 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":6,"btime":"2024-08-31T05:27:02:285842+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14739,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2024812199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2024812199},{"type":"v1","addr":"172.21.15.5:6835","nonce":2024812199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3629023702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3629023702},{"type":"v1","addr":"172.21.15.5:6837","nonce":3629023702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24560,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1153378982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1153378982},{"type":"v1","addr":"172.21.15.50:6833","nonce":1153378982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6833/364083443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":364083443},{"type":"v1","addr":"172.21.15.70:6833","nonce":364083443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24587,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2346896794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2346896794},{"type":"v1","addr":"172.21.15.50:6835","nonce":2346896794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-08-31T05:27:04.426 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 6 2024-08-31T05:27:04.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:04.424+0000 7f45fb6ab640 1 -- 172.21.15.5:0/3526322131 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f45e00b4b80 msgr2=0x7f45e00b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:04.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:04.424+0000 7f45fb6ab640 1 --2- 172.21.15.5:0/3526322131 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f45e00b4b80 0x7f45e00b7090 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f45f406c140 tx=0x7f45f000b410 comp rx=0 tx=0).stop 2024-08-31T05:27:04.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:04.424+0000 7f45fb6ab640 1 -- 172.21.15.5:0/3526322131 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45f4108180 msgr2=0x7f45f419b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:04.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:04.424+0000 7f45fb6ab640 1 --2- 172.21.15.5:0/3526322131 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45f4108180 0x7f45f419b500 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f45e400d770 tx=0x7f45e400dc30 comp rx=0 tx=0).stop 2024-08-31T05:27:04.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:04.424+0000 7f45fb6ab640 1 -- 172.21.15.5:0/3526322131 shutdown_connections 2024-08-31T05:27:04.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:04.424+0000 7f45fb6ab640 1 --2- 172.21.15.5:0/3526322131 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f45e00b4b80 0x7f45e00b7090 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:04.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:04.424+0000 7f45fb6ab640 1 --2- 172.21.15.5:0/3526322131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f45f4108ad0 0x7f45f419ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:04.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:04.424+0000 7f45fb6ab640 1 --2- 172.21.15.5:0/3526322131 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45f4108180 0x7f45f419b500 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:04.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:04.424+0000 7f45fb6ab640 1 --2- 172.21.15.5:0/3526322131 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45f4102840 0x7f45f419afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:04.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:04.424+0000 7f45fb6ab640 1 -- 172.21.15.5:0/3526322131 >> 172.21.15.5:0/3526322131 conn(0x7f45f4079580 msgr2=0x7f45f4104fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:04.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:04.425+0000 7f45fb6ab640 1 -- 172.21.15.5:0/3526322131 shutdown_connections 2024-08-31T05:27:04.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:04.425+0000 7f45fb6ab640 1 -- 172.21.15.5:0/3526322131 wait complete. 2024-08-31T05:27:04.429 INFO:journalctl@ceph.mds.f.smithi070.stdout:Aug 31 05:27:04 smithi070 podman[53197]: 2024-08-31 05:27:04.025847452 +0000 UTC m=+0.015550124 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T05:27:04.429 INFO:journalctl@ceph.mds.f.smithi070.stdout:Aug 31 05:27:04 smithi070 podman[53197]: 2024-08-31 05:27:04.141723808 +0000 UTC m=+0.131426466 container create 5ec2d22fd65e8f74ecafd2690c0bb8ce3360cb976ce90ab276753d851a7db959 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-f, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-08-31T05:27:04.429 INFO:journalctl@ceph.mds.f.smithi070.stdout:Aug 31 05:27:04 smithi070 podman[53197]: 2024-08-31 05:27:04.427695051 +0000 UTC m=+0.417397710 container init 5ec2d22fd65e8f74ecafd2690c0bb8ce3360cb976ce90ab276753d851a7db959 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-f, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-08-31T05:27:04.836 INFO:journalctl@ceph.mds.f.smithi070.stdout:Aug 31 05:27:04 smithi070 podman[53197]: 2024-08-31 05:27:04.430627339 +0000 UTC m=+0.420329998 container start 5ec2d22fd65e8f74ecafd2690c0bb8ce3360cb976ce90ab276753d851a7db959 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-f, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T05:27:04.836 INFO:journalctl@ceph.mds.f.smithi070.stdout:Aug 31 05:27:04 smithi070 ceph-mds[53217]: -- 172.21.15.70:0/3772890752 <== mon.1 v2:172.21.15.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ad2f60b860 con 0x55ad337b1180 2024-08-31T05:27:04.836 INFO:journalctl@ceph.mds.f.smithi070.stdout:Aug 31 05:27:04 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-f[53213]: starting mds.f at 2024-08-31T05:27:04.836 INFO:journalctl@ceph.mds.f.smithi070.stdout:Aug 31 05:27:04 smithi070 bash[53197]: 5ec2d22fd65e8f74ecafd2690c0bb8ce3360cb976ce90ab276753d851a7db959 2024-08-31T05:27:04.836 INFO:journalctl@ceph.mds.f.smithi070.stdout:Aug 31 05:27:04 smithi070 systemd[1]: Started Ceph mds.f for 69422704-6758-11ef-bcd4-c7b262605968. 2024-08-31T05:27:05.042 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:04 smithi005 ceph-mon[18602]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:05.043 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:04 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/3526322131' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:27:05.043 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:04 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:05.043 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:04 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:05.043 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:04 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:05.043 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:04 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T05:27:05.043 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:04 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T05:27:05.043 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:04 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:27:05.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:04 smithi050 ceph-mon[22146]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:05.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:04 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/3526322131' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:27:05.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:04 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:05.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:04 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:05.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:04 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:05.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:04 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T05:27:05.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:04 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T05:27:05.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:04 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:27:05.249 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:04 smithi070 ceph-mon[22316]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:05.249 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:04 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/3526322131' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:27:05.249 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:04 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:05.249 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:04 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:05.250 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:04 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:05.250 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:04 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T05:27:05.250 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:04 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T05:27:05.250 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:04 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:27:06.275 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:05 smithi070 ceph-mon[22316]: Deploying daemon mds.c on smithi070 2024-08-31T05:27:06.276 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:05 smithi070 ceph-mon[22316]: mds.? [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] up:boot 2024-08-31T05:27:06.276 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:05 smithi070 ceph-mon[22316]: fsmap 6 up:standby 2024-08-31T05:27:06.276 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:05 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-31T05:27:06.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:05 smithi050 ceph-mon[22146]: Deploying daemon mds.c on smithi070 2024-08-31T05:27:06.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:05 smithi050 ceph-mon[22146]: mds.? [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] up:boot 2024-08-31T05:27:06.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:05 smithi050 ceph-mon[22146]: fsmap 6 up:standby 2024-08-31T05:27:06.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:05 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-31T05:27:06.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:05 smithi005 ceph-mon[18602]: Deploying daemon mds.c on smithi070 2024-08-31T05:27:06.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:05 smithi005 ceph-mon[18602]: mds.? [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] up:boot 2024-08-31T05:27:06.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:05 smithi005 ceph-mon[18602]: fsmap 6 up:standby 2024-08-31T05:27:06.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:05 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-31T05:27:06.586 INFO:journalctl@ceph.mds.c.smithi070.stdout:Aug 31 05:27:06 smithi070 systemd[1]: Starting Ceph mds.c for 69422704-6758-11ef-bcd4-c7b262605968... 2024-08-31T05:27:06.975 INFO:journalctl@ceph.mds.c.smithi070.stdout:Aug 31 05:27:06 smithi070 podman[53498]: 2024-08-31 05:27:06.561286149 +0000 UTC m=+0.015477316 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T05:27:06.976 INFO:journalctl@ceph.mds.c.smithi070.stdout:Aug 31 05:27:06 smithi070 podman[53498]: 2024-08-31 05:27:06.696321453 +0000 UTC m=+0.150512614 container create 94cd21a2ad6f6bf0bb20a66b487f7cfe5031493ba2cb2d54a6531b39992f6934 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-c, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T05:27:06.976 INFO:journalctl@ceph.mds.c.smithi070.stdout:Aug 31 05:27:06 smithi070 podman[53498]: 2024-08-31 05:27:06.97435374 +0000 UTC m=+0.428544900 container init 94cd21a2ad6f6bf0bb20a66b487f7cfe5031493ba2cb2d54a6531b39992f6934 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-c, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T05:27:07.070 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T05:27:07.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:06 smithi070 ceph-mon[22316]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:07.336 INFO:journalctl@ceph.mds.c.smithi070.stdout:Aug 31 05:27:06 smithi070 podman[53498]: 2024-08-31 05:27:06.977198647 +0000 UTC m=+0.431389808 container start 94cd21a2ad6f6bf0bb20a66b487f7cfe5031493ba2cb2d54a6531b39992f6934 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-c, io.buildah.version=1.37.1, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-08-31T05:27:07.336 INFO:journalctl@ceph.mds.c.smithi070.stdout:Aug 31 05:27:07 smithi070 ceph-mds[53517]: -- 172.21.15.70:0/3390186895 <== mon.1 v2:172.21.15.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5596fd0a1860 con 0x559701247180 2024-08-31T05:27:07.336 INFO:journalctl@ceph.mds.c.smithi070.stdout:Aug 31 05:27:07 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-c[53513]: starting mds.c at 2024-08-31T05:27:07.336 INFO:journalctl@ceph.mds.c.smithi070.stdout:Aug 31 05:27:07 smithi070 bash[53498]: 94cd21a2ad6f6bf0bb20a66b487f7cfe5031493ba2cb2d54a6531b39992f6934 2024-08-31T05:27:07.336 INFO:journalctl@ceph.mds.c.smithi070.stdout:Aug 31 05:27:07 smithi070 systemd[1]: Started Ceph mds.c for 69422704-6758-11ef-bcd4-c7b262605968. 2024-08-31T05:27:07.343 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:27:07.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:06 smithi050 ceph-mon[22146]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:07.463 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:06 smithi005 ceph-mon[18602]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:07.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:07.835+0000 7f19d03f2640 1 -- 172.21.15.5:0/4178517053 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19c8103900 msgr2=0x7f19c8103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:07.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:07.835+0000 7f19d03f2640 1 --2- 172.21.15.5:0/4178517053 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19c8103900 0x7f19c8103d10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f19c4009900 tx=0x7f19c402a410 comp rx=0 tx=0).stop 2024-08-31T05:27:07.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:07.835+0000 7f19d03f2640 1 -- 172.21.15.5:0/4178517053 shutdown_connections 2024-08-31T05:27:07.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:07.835+0000 7f19d03f2640 1 --2- 172.21.15.5:0/4178517053 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f19c8109b90 0x7f19c81103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:07.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:07.835+0000 7f19d03f2640 1 --2- 172.21.15.5:0/4178517053 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19c8109240 0x7f19c8109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:07.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:07.835+0000 7f19d03f2640 1 --2- 172.21.15.5:0/4178517053 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19c8103900 0x7f19c8103d10 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:07.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:07.835+0000 7f19d03f2640 1 -- 172.21.15.5:0/4178517053 >> 172.21.15.5:0/4178517053 conn(0x7f19c807b5f0 msgr2=0x7f19c807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:07.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:07.835+0000 7f19d03f2640 1 -- 172.21.15.5:0/4178517053 shutdown_connections 2024-08-31T05:27:07.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:07.835+0000 7f19d03f2640 1 -- 172.21.15.5:0/4178517053 wait complete. 2024-08-31T05:27:07.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:07.836+0000 7f19d03f2640 1 Processor -- start 2024-08-31T05:27:07.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:07.836+0000 7f19d03f2640 1 -- start start 2024-08-31T05:27:07.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:07.836+0000 7f19d03f2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19c8103900 0x7f19c819a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:07.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:07.836+0000 7f19d03f2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f19c8109240 0x7f19c819a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:07.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:07.836+0000 7f19d03f2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19c8109b90 0x7f19c819fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:07.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:07.836+0000 7f19d03f2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f19c8113870 con 0x7f19c8103900 2024-08-31T05:27:07.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:07.836+0000 7f19d03f2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f19c81136f0 con 0x7f19c8109b90 2024-08-31T05:27:07.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:07.836+0000 7f19d03f2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f19c81139f0 con 0x7f19c8109240 2024-08-31T05:27:07.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:07.836+0000 7f19ce18e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19c8103900 0x7f19c819a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:07.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:07.836+0000 7f19ce18e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19c8103900 0x7f19c819a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58238/0 (socket says 172.21.15.5:58238) 2024-08-31T05:27:07.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:07.836+0000 7f19ce18e640 1 -- 172.21.15.5:0/181812740 learned_addr learned my addr 172.21.15.5:0/181812740 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:27:07.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:07.837+0000 7f19ce18e640 1 -- 172.21.15.5:0/181812740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f19c8109240 msgr2=0x7f19c819a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:07.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:07.837+0000 7f19ce98f640 1 --2- 172.21.15.5:0/181812740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19c8109b90 0x7f19c819fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:07.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:07.837+0000 7f19ce18e640 1 --2- 172.21.15.5:0/181812740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f19c8109240 0x7f19c819a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:07.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:07.837+0000 7f19ce18e640 1 -- 172.21.15.5:0/181812740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19c8109b90 msgr2=0x7f19c819fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:07.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:07.837+0000 7f19ce18e640 1 --2- 172.21.15.5:0/181812740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19c8109b90 0x7f19c819fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:07.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:07.837+0000 7f19ce18e640 1 -- 172.21.15.5:0/181812740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19c81a01b0 con 0x7f19c8103900 2024-08-31T05:27:07.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:07.837+0000 7f19ce18e640 1 --2- 172.21.15.5:0/181812740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19c8103900 0x7f19c819a240 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f19c4005940 tx=0x7f19c40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:07.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:07.837+0000 7f19bf7fe640 1 -- 172.21.15.5:0/181812740 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c403f030 con 0x7f19c8103900 2024-08-31T05:27:07.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:07.837+0000 7f19d03f2640 1 -- 172.21.15.5:0/181812740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19c81a0440 con 0x7f19c8103900 2024-08-31T05:27:07.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:07.837+0000 7f19bf7fe640 1 -- 172.21.15.5:0/181812740 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19c4003cb0 con 0x7f19c8103900 2024-08-31T05:27:07.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:07.837+0000 7f19bf7fe640 1 -- 172.21.15.5:0/181812740 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c4035070 con 0x7f19c8103900 2024-08-31T05:27:07.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:07.837+0000 7f19d03f2640 1 -- 172.21.15.5:0/181812740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19c81a6c00 con 0x7f19c8103900 2024-08-31T05:27:07.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:07.838+0000 7f19d03f2640 1 -- 172.21.15.5:0/181812740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19c8103d10 con 0x7f19c8103900 2024-08-31T05:27:07.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:07.839+0000 7f19bf7fe640 1 -- 172.21.15.5:0/181812740 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f19c4042030 con 0x7f19c8103900 2024-08-31T05:27:07.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:07.840+0000 7f19bf7fe640 1 --2- 172.21.15.5:0/181812740 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f19b40b4b80 0x7f19b40b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:07.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:07.840+0000 7f19cd98d640 1 --2- 172.21.15.5:0/181812740 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f19b40b4b80 0x7f19b40b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:07.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:07.840+0000 7f19bf7fe640 1 -- 172.21.15.5:0/181812740 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7f19c4105a10 con 0x7f19c8103900 2024-08-31T05:27:07.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:07.841+0000 7f19cd98d640 1 --2- 172.21.15.5:0/181812740 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f19b40b4b80 0x7f19b40b7090 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f19c81061f0 tx=0x7f19b8005be0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:07.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:07.843+0000 7f19bf7fe640 1 -- 172.21.15.5:0/181812740 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f19c40cce70 con 0x7f19c8103900 2024-08-31T05:27:08.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:08.066+0000 7f19d03f2640 1 -- 172.21.15.5:0/181812740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f19c819b370 con 0x7f19c8103900 2024-08-31T05:27:08.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:08.066+0000 7f19bf7fe640 1 -- 172.21.15.5:0/181812740 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6376 (secure 0 0 0) 0x7f19c40cc770 con 0x7f19c8103900 2024-08-31T05:27:08.069 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:27:08.069 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":8,"btime":"2024-08-31T05:27:07:989201+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14739,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2024812199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2024812199},{"type":"v1","addr":"172.21.15.5:6835","nonce":2024812199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3629023702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3629023702},{"type":"v1","addr":"172.21.15.5:6837","nonce":3629023702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24560,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1153378982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1153378982},{"type":"v1","addr":"172.21.15.50:6833","nonce":1153378982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6833/364083443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":364083443},{"type":"v1","addr":"172.21.15.70:6833","nonce":364083443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24587,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2346896794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2346896794},{"type":"v1","addr":"172.21.15.50:6835","nonce":2346896794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24625,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2061504114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2061504114},{"type":"v1","addr":"172.21.15.70:6835","nonce":2061504114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24631,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2780036414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2780036414},{"type":"v1","addr":"172.21.15.70:6837","nonce":2780036414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-08-31T05:27:08.069 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 8 2024-08-31T05:27:08.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:08.069+0000 7f19d03f2640 1 -- 172.21.15.5:0/181812740 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f19b40b4b80 msgr2=0x7f19b40b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:08.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:08.069+0000 7f19d03f2640 1 --2- 172.21.15.5:0/181812740 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f19b40b4b80 0x7f19b40b7090 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f19c81061f0 tx=0x7f19b8005be0 comp rx=0 tx=0).stop 2024-08-31T05:27:08.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:08.069+0000 7f19d03f2640 1 -- 172.21.15.5:0/181812740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19c8103900 msgr2=0x7f19c819a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:08.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:08.069+0000 7f19d03f2640 1 --2- 172.21.15.5:0/181812740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19c8103900 0x7f19c819a240 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f19c4005940 tx=0x7f19c40042f0 comp rx=0 tx=0).stop 2024-08-31T05:27:08.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:08.070+0000 7f19d03f2640 1 -- 172.21.15.5:0/181812740 shutdown_connections 2024-08-31T05:27:08.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:08.070+0000 7f19d03f2640 1 --2- 172.21.15.5:0/181812740 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f19b40b4b80 0x7f19b40b7090 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:08.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:08.070+0000 7f19d03f2640 1 --2- 172.21.15.5:0/181812740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f19c8109b90 0x7f19c819fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:08.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:08.070+0000 7f19d03f2640 1 --2- 172.21.15.5:0/181812740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f19c8109240 0x7f19c819a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:08.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:08.070+0000 7f19d03f2640 1 --2- 172.21.15.5:0/181812740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19c8103900 0x7f19c819a240 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:08.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:08.070+0000 7f19d03f2640 1 -- 172.21.15.5:0/181812740 >> 172.21.15.5:0/181812740 conn(0x7f19c807b5f0 msgr2=0x7f19c8107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:08.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:08.070+0000 7f19d03f2640 1 -- 172.21.15.5:0/181812740 shutdown_connections 2024-08-31T05:27:08.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:08.070+0000 7f19d03f2640 1 -- 172.21.15.5:0/181812740 wait complete. 2024-08-31T05:27:08.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:08 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:08.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:08 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:08.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:08 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:08.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:08 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T05:27:08.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:08 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T05:27:08.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:08 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:27:08.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:08 smithi050 ceph-mon[22146]: Deploying daemon mds.h on smithi050 2024-08-31T05:27:08.408 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:08 smithi050 ceph-mon[22146]: mds.? [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] up:boot 2024-08-31T05:27:08.408 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:08 smithi050 ceph-mon[22146]: fsmap 7 up:standby 2024-08-31T05:27:08.408 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:08 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-31T05:27:08.408 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:08 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/181812740' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:27:08.442 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:08 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:08.442 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:08 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:08.442 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:08 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:08.442 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:08 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T05:27:08.442 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:08 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T05:27:08.442 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:08 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:27:08.442 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:08 smithi005 ceph-mon[18602]: Deploying daemon mds.h on smithi050 2024-08-31T05:27:08.442 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:08 smithi005 ceph-mon[18602]: mds.? [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] up:boot 2024-08-31T05:27:08.442 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:08 smithi005 ceph-mon[18602]: fsmap 7 up:standby 2024-08-31T05:27:08.442 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:08 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-31T05:27:08.442 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:08 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/181812740' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:27:08.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:08 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:08.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:08 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:08.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:08 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:08.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:08 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T05:27:08.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:08 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T05:27:08.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:08 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:27:08.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:08 smithi070 ceph-mon[22316]: Deploying daemon mds.h on smithi050 2024-08-31T05:27:08.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:08 smithi070 ceph-mon[22316]: mds.? [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] up:boot 2024-08-31T05:27:08.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:08 smithi070 ceph-mon[22316]: fsmap 7 up:standby 2024-08-31T05:27:08.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:08 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-31T05:27:08.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:08 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/181812740' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:27:09.395 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:09 smithi050 ceph-mon[22146]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:09.396 INFO:journalctl@ceph.mds.h.smithi050.stdout:Aug 31 05:27:09 smithi050 systemd[1]: Starting Ceph mds.h for 69422704-6758-11ef-bcd4-c7b262605968... 2024-08-31T05:27:09.396 INFO:journalctl@ceph.mds.h.smithi050.stdout:Aug 31 05:27:09 smithi050 podman[53268]: 2024-08-31 05:27:09.296167232 +0000 UTC m=+0.015794827 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T05:27:09.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:09 smithi005 ceph-mon[18602]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:09.510 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:09 smithi070 ceph-mon[22316]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:09.657 INFO:journalctl@ceph.mds.h.smithi050.stdout:Aug 31 05:27:09 smithi050 podman[53268]: 2024-08-31 05:27:09.421852562 +0000 UTC m=+0.141480150 container create fb36ada1d4ac26c3279536cb5f30a597cd1b314733dc2ef8cf2bc72e75bcf71e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-h, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-08-31T05:27:10.157 INFO:journalctl@ceph.mds.h.smithi050.stdout:Aug 31 05:27:09 smithi050 podman[53268]: 2024-08-31 05:27:09.69148032 +0000 UTC m=+0.411107908 container init fb36ada1d4ac26c3279536cb5f30a597cd1b314733dc2ef8cf2bc72e75bcf71e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-h, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T05:27:10.157 INFO:journalctl@ceph.mds.h.smithi050.stdout:Aug 31 05:27:09 smithi050 podman[53268]: 2024-08-31 05:27:09.69455653 +0000 UTC m=+0.414184125 container start fb36ada1d4ac26c3279536cb5f30a597cd1b314733dc2ef8cf2bc72e75bcf71e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-h, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-08-31T05:27:10.157 INFO:journalctl@ceph.mds.h.smithi050.stdout:Aug 31 05:27:09 smithi050 ceph-mds[53287]: -- 172.21.15.50:0/3413934882 <== mon.2 v2:172.21.15.50:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56316f917860 con 0x563173abd180 2024-08-31T05:27:10.157 INFO:journalctl@ceph.mds.h.smithi050.stdout:Aug 31 05:27:09 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-h[53283]: starting mds.h at 2024-08-31T05:27:10.157 INFO:journalctl@ceph.mds.h.smithi050.stdout:Aug 31 05:27:09 smithi050 bash[53268]: fb36ada1d4ac26c3279536cb5f30a597cd1b314733dc2ef8cf2bc72e75bcf71e 2024-08-31T05:27:10.157 INFO:journalctl@ceph.mds.h.smithi050.stdout:Aug 31 05:27:09 smithi050 systemd[1]: Started Ceph mds.h for 69422704-6758-11ef-bcd4-c7b262605968. 2024-08-31T05:27:10.783 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T05:27:11.050 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:27:11.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:10 smithi070 ceph-mon[22316]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:11.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:10 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:11.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:10 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:11.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:10 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:11.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:10 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T05:27:11.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:10 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T05:27:11.087 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:10 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:27:11.087 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:10 smithi070 ceph-mon[22316]: Deploying daemon mds.i on smithi070 2024-08-31T05:27:11.087 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:10 smithi070 ceph-mon[22316]: mds.? [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] up:boot 2024-08-31T05:27:11.087 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:10 smithi070 ceph-mon[22316]: fsmap 8 up:standby 2024-08-31T05:27:11.087 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:10 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-31T05:27:11.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:10 smithi050 ceph-mon[22146]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:11.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:10 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:11.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:10 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:11.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:10 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:11.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:10 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T05:27:11.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:10 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T05:27:11.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:10 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:27:11.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:10 smithi050 ceph-mon[22146]: Deploying daemon mds.i on smithi070 2024-08-31T05:27:11.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:10 smithi050 ceph-mon[22146]: mds.? [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] up:boot 2024-08-31T05:27:11.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:10 smithi050 ceph-mon[22146]: fsmap 8 up:standby 2024-08-31T05:27:11.158 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:10 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-31T05:27:11.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:10 smithi005 ceph-mon[18602]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:11.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:10 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:11.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:10 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:11.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:10 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:11.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:10 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T05:27:11.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:10 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T05:27:11.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:10 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:27:11.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:10 smithi005 ceph-mon[18602]: Deploying daemon mds.i on smithi070 2024-08-31T05:27:11.171 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:10 smithi005 ceph-mon[18602]: mds.? [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] up:boot 2024-08-31T05:27:11.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:10 smithi005 ceph-mon[18602]: fsmap 8 up:standby 2024-08-31T05:27:11.172 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:10 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-31T05:27:11.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.559+0000 7f516f6d8640 1 -- 172.21.15.5:0/4099423101 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5168109b90 msgr2=0x7f51681103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:11.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.559+0000 7f516f6d8640 1 --2- 172.21.15.5:0/4099423101 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5168109b90 0x7f51681103c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5160009ca0 tx=0x7f516002a8c0 comp rx=0 tx=0).stop 2024-08-31T05:27:11.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.559+0000 7f516f6d8640 1 -- 172.21.15.5:0/4099423101 shutdown_connections 2024-08-31T05:27:11.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.559+0000 7f516f6d8640 1 --2- 172.21.15.5:0/4099423101 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5168109b90 0x7f51681103c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:11.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.559+0000 7f516f6d8640 1 --2- 172.21.15.5:0/4099423101 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5168109240 0x7f5168109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:11.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.559+0000 7f516f6d8640 1 --2- 172.21.15.5:0/4099423101 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5168103900 0x7f5168103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:11.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.559+0000 7f516f6d8640 1 -- 172.21.15.5:0/4099423101 >> 172.21.15.5:0/4099423101 conn(0x7f516807b5f0 msgr2=0x7f516807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:11.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.559+0000 7f516f6d8640 1 -- 172.21.15.5:0/4099423101 shutdown_connections 2024-08-31T05:27:11.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.559+0000 7f516f6d8640 1 -- 172.21.15.5:0/4099423101 wait complete. 2024-08-31T05:27:11.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.560+0000 7f516f6d8640 1 Processor -- start 2024-08-31T05:27:11.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.560+0000 7f516f6d8640 1 -- start start 2024-08-31T05:27:11.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.560+0000 7f516f6d8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5168103900 0x7f51680754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:11.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.560+0000 7f516f6d8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5168109240 0x7f51680759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:11.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.560+0000 7f516f6d8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5168109b90 0x7f5168075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:11.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.560+0000 7f516f6d8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5168113850 con 0x7f5168103900 2024-08-31T05:27:11.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.560+0000 7f516f6d8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f51681136d0 con 0x7f5168109240 2024-08-31T05:27:11.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.560+0000 7f516f6d8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f51681139d0 con 0x7f5168109b90 2024-08-31T05:27:11.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.560+0000 7f516d474640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5168103900 0x7f51680754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:11.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.561+0000 7f516d474640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5168103900 0x7f51680754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58250/0 (socket says 172.21.15.5:58250) 2024-08-31T05:27:11.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.561+0000 7f516d474640 1 -- 172.21.15.5:0/2051237920 learned_addr learned my addr 172.21.15.5:0/2051237920 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:27:11.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.561+0000 7f516cc73640 1 --2- 172.21.15.5:0/2051237920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5168109240 0x7f51680759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:11.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.561+0000 7f516dc75640 1 --2- 172.21.15.5:0/2051237920 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5168109b90 0x7f5168075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:11.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.561+0000 7f516d474640 1 -- 172.21.15.5:0/2051237920 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5168109b90 msgr2=0x7f5168075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:11.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.561+0000 7f516d474640 1 --2- 172.21.15.5:0/2051237920 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5168109b90 0x7f5168075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:11.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.561+0000 7f516d474640 1 -- 172.21.15.5:0/2051237920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5168109240 msgr2=0x7f51680759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:11.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.561+0000 7f516d474640 1 --2- 172.21.15.5:0/2051237920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5168109240 0x7f51680759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:11.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.561+0000 7f516d474640 1 -- 172.21.15.5:0/2051237920 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51681a84e0 con 0x7f5168103900 2024-08-31T05:27:11.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.561+0000 7f516cc73640 1 --2- 172.21.15.5:0/2051237920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5168109240 0x7f51680759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:27:11.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.561+0000 7f516d474640 1 --2- 172.21.15.5:0/2051237920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5168103900 0x7f51680754b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f516400e9f0 tx=0x7f516400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:11.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.561+0000 7f515e7fc640 1 -- 172.21.15.5:0/2051237920 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f516400cd80 con 0x7f5168103900 2024-08-31T05:27:11.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.561+0000 7f516f6d8640 1 -- 172.21.15.5:0/2051237920 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51681a87d0 con 0x7f5168103900 2024-08-31T05:27:11.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.561+0000 7f515e7fc640 1 -- 172.21.15.5:0/2051237920 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51640108e0 con 0x7f5168103900 2024-08-31T05:27:11.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.561+0000 7f515e7fc640 1 -- 172.21.15.5:0/2051237920 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5164018980 con 0x7f5168103900 2024-08-31T05:27:11.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.561+0000 7f516f6d8640 1 -- 172.21.15.5:0/2051237920 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51681a8d60 con 0x7f5168103900 2024-08-31T05:27:11.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.562+0000 7f516f6d8640 1 -- 172.21.15.5:0/2051237920 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5168103d10 con 0x7f5168103900 2024-08-31T05:27:11.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.564+0000 7f515e7fc640 1 -- 172.21.15.5:0/2051237920 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f5164010430 con 0x7f5168103900 2024-08-31T05:27:11.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.565+0000 7f515e7fc640 1 --2- 172.21.15.5:0/2051237920 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f51540b4c00 0x7f51540b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:11.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.565+0000 7f516cc73640 1 --2- 172.21.15.5:0/2051237920 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f51540b4c00 0x7f51540b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:11.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.565+0000 7f515e7fc640 1 -- 172.21.15.5:0/2051237920 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7f51640e5640 con 0x7f5168103900 2024-08-31T05:27:11.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.565+0000 7f516cc73640 1 --2- 172.21.15.5:0/2051237920 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f51540b4c00 0x7f51540b7110 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5168106d80 tx=0x7f5158005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:11.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.568+0000 7f515e7fc640 1 -- 172.21.15.5:0/2051237920 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f51640ac450 con 0x7f5168103900 2024-08-31T05:27:11.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.791+0000 7f516f6d8640 1 -- 172.21.15.5:0/2051237920 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f51680767b0 con 0x7f5168103900 2024-08-31T05:27:11.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.792+0000 7f515e7fc640 1 -- 172.21.15.5:0/2051237920 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7198 (secure 0 0 0) 0x7f51640b0c10 con 0x7f5168103900 2024-08-31T05:27:11.794 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:27:11.794 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":9,"btime":"2024-08-31T05:27:10:150909+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14739,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2024812199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2024812199},{"type":"v1","addr":"172.21.15.5:6835","nonce":2024812199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3629023702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3629023702},{"type":"v1","addr":"172.21.15.5:6837","nonce":3629023702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24560,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1153378982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1153378982},{"type":"v1","addr":"172.21.15.50:6833","nonce":1153378982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6833/364083443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":364083443},{"type":"v1","addr":"172.21.15.70:6833","nonce":364083443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24587,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2346896794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2346896794},{"type":"v1","addr":"172.21.15.50:6835","nonce":2346896794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24602,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/428759669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":428759669},{"type":"v1","addr":"172.21.15.50:6837","nonce":428759669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24625,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2061504114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2061504114},{"type":"v1","addr":"172.21.15.70:6835","nonce":2061504114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24631,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2780036414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2780036414},{"type":"v1","addr":"172.21.15.70:6837","nonce":2780036414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-08-31T05:27:11.794 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 9 2024-08-31T05:27:11.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.794+0000 7f516f6d8640 1 -- 172.21.15.5:0/2051237920 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f51540b4c00 msgr2=0x7f51540b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:11.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.794+0000 7f516f6d8640 1 --2- 172.21.15.5:0/2051237920 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f51540b4c00 0x7f51540b7110 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5168106d80 tx=0x7f5158005f90 comp rx=0 tx=0).stop 2024-08-31T05:27:11.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.794+0000 7f516f6d8640 1 -- 172.21.15.5:0/2051237920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5168103900 msgr2=0x7f51680754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:11.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.794+0000 7f516f6d8640 1 --2- 172.21.15.5:0/2051237920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5168103900 0x7f51680754b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f516400e9f0 tx=0x7f516400eeb0 comp rx=0 tx=0).stop 2024-08-31T05:27:11.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.794+0000 7f516f6d8640 1 -- 172.21.15.5:0/2051237920 shutdown_connections 2024-08-31T05:27:11.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.794+0000 7f516f6d8640 1 --2- 172.21.15.5:0/2051237920 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f51540b4c00 0x7f51540b7110 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:11.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.794+0000 7f516f6d8640 1 --2- 172.21.15.5:0/2051237920 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5168109b90 0x7f5168075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:11.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.794+0000 7f516f6d8640 1 --2- 172.21.15.5:0/2051237920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5168109240 0x7f51680759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:11.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.794+0000 7f516f6d8640 1 --2- 172.21.15.5:0/2051237920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5168103900 0x7f51680754b0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:11.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.794+0000 7f516f6d8640 1 -- 172.21.15.5:0/2051237920 >> 172.21.15.5:0/2051237920 conn(0x7f516807b5f0 msgr2=0x7f51681072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:11.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.795+0000 7f516f6d8640 1 -- 172.21.15.5:0/2051237920 shutdown_connections 2024-08-31T05:27:11.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:11.795+0000 7f516f6d8640 1 -- 172.21.15.5:0/2051237920 wait complete. 2024-08-31T05:27:12.010 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:11 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/2051237920' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:27:12.156 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:11 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/2051237920' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:27:12.204 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:11 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/2051237920' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:27:12.586 INFO:journalctl@ceph.mds.i.smithi070.stdout:Aug 31 05:27:12 smithi070 systemd[1]: Started Ceph mds.i for 69422704-6758-11ef-bcd4-c7b262605968. 2024-08-31T05:27:13.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:12 smithi070 ceph-mon[22316]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:13.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:12 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:13.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:12 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:13.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:12 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:13.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:12 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T05:27:13.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:12 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T05:27:13.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:12 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:27:13.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:12 smithi050 ceph-mon[22146]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:13.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:12 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:13.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:12 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:13.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:12 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:13.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:12 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T05:27:13.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:12 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T05:27:13.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:12 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:27:13.175 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:12 smithi005 ceph-mon[18602]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:13.175 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:12 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:13.175 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:12 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:13.176 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:12 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:13.176 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:12 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T05:27:13.176 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:12 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T05:27:13.176 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:12 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:27:13.955 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:13 smithi005 ceph-mon[18602]: Deploying daemon mds.g on smithi005 2024-08-31T05:27:13.955 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:13 smithi005 ceph-mon[18602]: mds.? [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] up:boot 2024-08-31T05:27:13.955 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:13 smithi005 ceph-mon[18602]: fsmap 9 up:standby 2024-08-31T05:27:13.955 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:13 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-31T05:27:14.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:13 smithi050 ceph-mon[22146]: Deploying daemon mds.g on smithi005 2024-08-31T05:27:14.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:13 smithi050 ceph-mon[22146]: mds.? [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] up:boot 2024-08-31T05:27:14.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:13 smithi050 ceph-mon[22146]: fsmap 9 up:standby 2024-08-31T05:27:14.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:13 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-31T05:27:14.337 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:13 smithi070 ceph-mon[22316]: Deploying daemon mds.g on smithi005 2024-08-31T05:27:14.337 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:13 smithi070 ceph-mon[22316]: mds.? [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] up:boot 2024-08-31T05:27:14.337 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:13 smithi070 ceph-mon[22316]: fsmap 9 up:standby 2024-08-31T05:27:14.337 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:13 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-31T05:27:14.452 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T05:27:14.941 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:14 smithi005 ceph-mon[18602]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:15.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:14 smithi050 ceph-mon[22146]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:15.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:14 smithi070 ceph-mon[22316]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:15.353 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:27:15.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:15.857+0000 7fe2ddcc8640 1 -- 172.21.15.5:0/1266739462 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2d8102830 msgr2=0x7fe2d8102c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:15.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:15.857+0000 7fe2ddcc8640 1 --2- 172.21.15.5:0/1266739462 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2d8102830 0x7fe2d8102c40 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8009900 tx=0x7fe2c802a410 comp rx=0 tx=0).stop 2024-08-31T05:27:15.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:15.857+0000 7fe2ddcc8640 1 -- 172.21.15.5:0/1266739462 shutdown_connections 2024-08-31T05:27:15.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:15.857+0000 7fe2ddcc8640 1 --2- 172.21.15.5:0/1266739462 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2d8108ac0 0x7fe2d810f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:15.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:15.857+0000 7fe2ddcc8640 1 --2- 172.21.15.5:0/1266739462 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2d8108170 0x7fe2d8108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:15.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:15.857+0000 7fe2ddcc8640 1 --2- 172.21.15.5:0/1266739462 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2d8102830 0x7fe2d8102c40 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:15.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:15.857+0000 7fe2ddcc8640 1 -- 172.21.15.5:0/1266739462 >> 172.21.15.5:0/1266739462 conn(0x7fe2d80794f0 msgr2=0x7fe2d8079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:15.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:15.857+0000 7fe2ddcc8640 1 -- 172.21.15.5:0/1266739462 shutdown_connections 2024-08-31T05:27:15.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:15.857+0000 7fe2ddcc8640 1 -- 172.21.15.5:0/1266739462 wait complete. 2024-08-31T05:27:15.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:15.858+0000 7fe2ddcc8640 1 Processor -- start 2024-08-31T05:27:15.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:15.858+0000 7fe2ddcc8640 1 -- start start 2024-08-31T05:27:15.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:15.858+0000 7fe2ddcc8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2d8102830 0x7fe2d819b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:15.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:15.858+0000 7fe2ddcc8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2d8108170 0x7fe2d819b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:15.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:15.858+0000 7fe2ddcc8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2d8108ac0 0x7fe2d819bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:15.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:15.858+0000 7fe2ddcc8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d8112740 con 0x7fe2d8102830 2024-08-31T05:27:15.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:15.858+0000 7fe2ddcc8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d81125c0 con 0x7fe2d8108ac0 2024-08-31T05:27:15.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:15.858+0000 7fe2ddcc8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d81128c0 con 0x7fe2d8108170 2024-08-31T05:27:15.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:15.858+0000 7fe2d77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2d8102830 0x7fe2d819b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:15.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:15.858+0000 7fe2d77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2d8102830 0x7fe2d819b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39490/0 (socket says 172.21.15.5:39490) 2024-08-31T05:27:15.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:15.858+0000 7fe2d77fe640 1 -- 172.21.15.5:0/1119322486 learned_addr learned my addr 172.21.15.5:0/1119322486 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:27:15.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:15.858+0000 7fe2d7fff640 1 --2- 172.21.15.5:0/1119322486 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2d8108ac0 0x7fe2d819bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:15.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:15.859+0000 7fe2d6ffd640 1 --2- 172.21.15.5:0/1119322486 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2d8108170 0x7fe2d819b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:15.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:15.859+0000 7fe2d77fe640 1 -- 172.21.15.5:0/1119322486 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2d8108170 msgr2=0x7fe2d819b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:15.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:15.859+0000 7fe2d77fe640 1 --2- 172.21.15.5:0/1119322486 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2d8108170 0x7fe2d819b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:15.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:15.859+0000 7fe2d77fe640 1 -- 172.21.15.5:0/1119322486 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2d8108ac0 msgr2=0x7fe2d819bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:15.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:15.859+0000 7fe2d77fe640 1 --2- 172.21.15.5:0/1119322486 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2d8108ac0 0x7fe2d819bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:15.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:15.859+0000 7fe2d77fe640 1 -- 172.21.15.5:0/1119322486 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2d81a6380 con 0x7fe2d8102830 2024-08-31T05:27:15.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:15.859+0000 7fe2d7fff640 1 --2- 172.21.15.5:0/1119322486 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2d8108ac0 0x7fe2d819bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:27:15.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:15.859+0000 7fe2d6ffd640 1 --2- 172.21.15.5:0/1119322486 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2d8108170 0x7fe2d819b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:27:15.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:15.859+0000 7fe2d77fe640 1 --2- 172.21.15.5:0/1119322486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2d8102830 0x7fe2d819b0f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8005940 tx=0x7fe2c80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:15.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:15.859+0000 7fe2d4ff9640 1 -- 172.21.15.5:0/1119322486 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c803f030 con 0x7fe2d8102830 2024-08-31T05:27:15.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:15.859+0000 7fe2d4ff9640 1 -- 172.21.15.5:0/1119322486 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2c8003cb0 con 0x7fe2d8102830 2024-08-31T05:27:15.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:15.859+0000 7fe2d4ff9640 1 -- 172.21.15.5:0/1119322486 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c8035070 con 0x7fe2d8102830 2024-08-31T05:27:15.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:15.859+0000 7fe2ddcc8640 1 -- 172.21.15.5:0/1119322486 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2d81a6610 con 0x7fe2d8102830 2024-08-31T05:27:15.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:15.859+0000 7fe2ddcc8640 1 -- 172.21.15.5:0/1119322486 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2d81a6af0 con 0x7fe2d8102830 2024-08-31T05:27:15.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:15.860+0000 7fe2ddcc8640 1 -- 172.21.15.5:0/1119322486 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2d8103ab0 con 0x7fe2d8102830 2024-08-31T05:27:15.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:15.863+0000 7fe2d4ff9640 1 -- 172.21.15.5:0/1119322486 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7fe2c8042030 con 0x7fe2d8102830 2024-08-31T05:27:15.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:15.863+0000 7fe2d4ff9640 1 --2- 172.21.15.5:0/1119322486 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe2c00b4bb0 0x7fe2c00b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:15.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:15.864+0000 7fe2d6ffd640 1 --2- 172.21.15.5:0/1119322486 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe2c00b4bb0 0x7fe2c00b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:15.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:15.864+0000 7fe2d4ff9640 1 -- 172.21.15.5:0/1119322486 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7fe2c8105690 con 0x7fe2d8102830 2024-08-31T05:27:15.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:15.864+0000 7fe2d6ffd640 1 --2- 172.21.15.5:0/1119322486 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe2c00b4bb0 0x7fe2c00b70c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe2d8079af0 tx=0x7fe2cc005e50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:15.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:15.867+0000 7fe2d4ff9640 1 -- 172.21.15.5:0/1119322486 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe2c80ccaf0 con 0x7fe2d8102830 2024-08-31T05:27:16.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:16.099+0000 7fe2ddcc8640 1 -- 172.21.15.5:0/1119322486 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe2d806bd30 con 0x7fe2d8102830 2024-08-31T05:27:16.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:16.100+0000 7fe2d4ff9640 1 -- 172.21.15.5:0/1119322486 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8848 (secure 0 0 0) 0x7fe2d806bd30 con 0x7fe2d8102830 2024-08-31T05:27:16.102 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:27:16.102 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":11,"btime":"2024-08-31T05:27:15:842084+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14739,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2024812199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2024812199},{"type":"v1","addr":"172.21.15.5:6835","nonce":2024812199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3629023702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3629023702},{"type":"v1","addr":"172.21.15.5:6837","nonce":3629023702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14808,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6839/2412701258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":2412701258},{"type":"v1","addr":"172.21.15.5:6839","nonce":2412701258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24560,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1153378982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1153378982},{"type":"v1","addr":"172.21.15.50:6833","nonce":1153378982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6833/364083443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":364083443},{"type":"v1","addr":"172.21.15.70:6833","nonce":364083443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24587,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2346896794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2346896794},{"type":"v1","addr":"172.21.15.50:6835","nonce":2346896794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24602,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/428759669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":428759669},{"type":"v1","addr":"172.21.15.50:6837","nonce":428759669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24625,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2061504114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2061504114},{"type":"v1","addr":"172.21.15.70:6835","nonce":2061504114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24631,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2780036414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2780036414},{"type":"v1","addr":"172.21.15.70:6837","nonce":2780036414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24652,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/2756569250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":2756569250},{"type":"v1","addr":"172.21.15.70:6839","nonce":2756569250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-08-31T05:27:16.102 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 11 2024-08-31T05:27:16.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:16.102+0000 7fe2ddcc8640 1 -- 172.21.15.5:0/1119322486 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe2c00b4bb0 msgr2=0x7fe2c00b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:16.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:16.102+0000 7fe2ddcc8640 1 --2- 172.21.15.5:0/1119322486 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe2c00b4bb0 0x7fe2c00b70c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe2d8079af0 tx=0x7fe2cc005e50 comp rx=0 tx=0).stop 2024-08-31T05:27:16.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:16.102+0000 7fe2ddcc8640 1 -- 172.21.15.5:0/1119322486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2d8102830 msgr2=0x7fe2d819b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:16.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:16.102+0000 7fe2ddcc8640 1 --2- 172.21.15.5:0/1119322486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2d8102830 0x7fe2d819b0f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8005940 tx=0x7fe2c80042f0 comp rx=0 tx=0).stop 2024-08-31T05:27:16.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:16.102+0000 7fe2ddcc8640 1 -- 172.21.15.5:0/1119322486 shutdown_connections 2024-08-31T05:27:16.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:16.102+0000 7fe2ddcc8640 1 --2- 172.21.15.5:0/1119322486 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe2c00b4bb0 0x7fe2c00b70c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:16.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:16.102+0000 7fe2ddcc8640 1 --2- 172.21.15.5:0/1119322486 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe2d8108ac0 0x7fe2d819bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:16.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:16.102+0000 7fe2ddcc8640 1 --2- 172.21.15.5:0/1119322486 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2d8108170 0x7fe2d819b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:16.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:16.102+0000 7fe2ddcc8640 1 --2- 172.21.15.5:0/1119322486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2d8102830 0x7fe2d819b0f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:16.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:16.102+0000 7fe2ddcc8640 1 -- 172.21.15.5:0/1119322486 >> 172.21.15.5:0/1119322486 conn(0x7fe2d80794f0 msgr2=0x7fe2d81012a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:16.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:16.102+0000 7fe2ddcc8640 1 -- 172.21.15.5:0/1119322486 shutdown_connections 2024-08-31T05:27:16.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:16.102+0000 7fe2ddcc8640 1 -- 172.21.15.5:0/1119322486 wait complete. 2024-08-31T05:27:16.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:16 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:16.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:16 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:16.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:16 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:16.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:16 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T05:27:16.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:16 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T05:27:16.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:16 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:27:16.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:16 smithi005 ceph-mon[18602]: Deploying daemon mds.a on smithi005 2024-08-31T05:27:16.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:16 smithi005 ceph-mon[18602]: mds.? [v2:172.21.15.5:6838/2412701258,v1:172.21.15.5:6839/2412701258] up:boot 2024-08-31T05:27:16.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:16 smithi005 ceph-mon[18602]: fsmap 10 up:standby 2024-08-31T05:27:16.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:16 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-08-31T05:27:16.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:16 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/1119322486' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:27:16.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:16 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:16.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:16 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:16.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:16 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:16.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:16 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T05:27:16.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:16 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T05:27:16.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:16 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:27:16.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:16 smithi070 ceph-mon[22316]: Deploying daemon mds.a on smithi005 2024-08-31T05:27:16.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:16 smithi070 ceph-mon[22316]: mds.? [v2:172.21.15.5:6838/2412701258,v1:172.21.15.5:6839/2412701258] up:boot 2024-08-31T05:27:16.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:16 smithi070 ceph-mon[22316]: fsmap 10 up:standby 2024-08-31T05:27:16.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:16 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-08-31T05:27:16.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:16 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/1119322486' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:27:16.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:16 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:16.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:16 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:16.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:16 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:16.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:16 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T05:27:16.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:16 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T05:27:16.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:16 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:27:16.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:16 smithi050 ceph-mon[22146]: Deploying daemon mds.a on smithi005 2024-08-31T05:27:16.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:16 smithi050 ceph-mon[22146]: mds.? [v2:172.21.15.5:6838/2412701258,v1:172.21.15.5:6839/2412701258] up:boot 2024-08-31T05:27:16.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:16 smithi050 ceph-mon[22146]: fsmap 10 up:standby 2024-08-31T05:27:16.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:16 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-08-31T05:27:16.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:16 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/1119322486' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:27:17.413 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:17 smithi005 ceph-mon[18602]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:17.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:17 smithi070 ceph-mon[22316]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:17.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:17 smithi050 ceph-mon[22146]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:18.374 INFO:journalctl@ceph.mds.a.smithi005.stdout:Aug 31 05:27:18 smithi005 systemd[1]: Starting Ceph mds.a for 69422704-6758-11ef-bcd4-c7b262605968... 2024-08-31T05:27:18.661 INFO:journalctl@ceph.mds.a.smithi005.stdout:Aug 31 05:27:18 smithi005 podman[60827]: 2024-08-31 05:27:18.274733146 +0000 UTC m=+0.016051602 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T05:27:18.661 INFO:journalctl@ceph.mds.a.smithi005.stdout:Aug 31 05:27:18 smithi005 podman[60827]: 2024-08-31 05:27:18.390649275 +0000 UTC m=+0.131967715 container create b2adead453e74cc3f73e08d20bad2034326c2f0573f038049db3f321d219a4f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-a, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T05:27:18.661 INFO:journalctl@ceph.mds.a.smithi005.stdout:Aug 31 05:27:18 smithi005 podman[60827]: 2024-08-31 05:27:18.660060186 +0000 UTC m=+0.401378629 container init b2adead453e74cc3f73e08d20bad2034326c2f0573f038049db3f321d219a4f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-a, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, GIT_BRANCH=HEAD) 2024-08-31T05:27:18.889 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T05:27:18.912 INFO:journalctl@ceph.mds.a.smithi005.stdout:Aug 31 05:27:18 smithi005 podman[60827]: 2024-08-31 05:27:18.662937208 +0000 UTC m=+0.404255648 container start b2adead453e74cc3f73e08d20bad2034326c2f0573f038049db3f321d219a4f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-a, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-08-31T05:27:18.912 INFO:journalctl@ceph.mds.a.smithi005.stdout:Aug 31 05:27:18 smithi005 ceph-mds[60846]: -- 172.21.15.5:0/1744831789 <== mon.0 v2:172.21.15.5:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559036d61860 con 0x55903af07180 2024-08-31T05:27:18.912 INFO:journalctl@ceph.mds.a.smithi005.stdout:Aug 31 05:27:18 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-a[60842]: starting mds.a at 2024-08-31T05:27:18.912 INFO:journalctl@ceph.mds.a.smithi005.stdout:Aug 31 05:27:18 smithi005 bash[60827]: b2adead453e74cc3f73e08d20bad2034326c2f0573f038049db3f321d219a4f6 2024-08-31T05:27:18.913 INFO:journalctl@ceph.mds.a.smithi005.stdout:Aug 31 05:27:18 smithi005 systemd[1]: Started Ceph mds.a for 69422704-6758-11ef-bcd4-c7b262605968. 2024-08-31T05:27:19.145 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:27:19.566 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:19 smithi005 ceph-mon[18602]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:19.566 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:19 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:19.566 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:19 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:19.566 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:19 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:19.567 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:19 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T05:27:19.567 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:19 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T05:27:19.567 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:19 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:27:19.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:19 smithi070 ceph-mon[22316]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:19.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:19 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:19.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:19 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:19.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:19 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:19.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:19 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T05:27:19.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:19 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T05:27:19.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:19 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:27:19.630 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:19 smithi050 ceph-mon[22146]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:19.630 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:19 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:19.630 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:19 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:19.630 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:19 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:19.630 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:19 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T05:27:19.630 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:19 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T05:27:19.630 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:19 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:27:19.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:19.655+0000 7f297fd27640 1 -- 172.21.15.5:0/317354644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2978109ba0 msgr2=0x7f29781103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:19.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:19.655+0000 7f297fd27640 1 --2- 172.21.15.5:0/317354644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2978109ba0 0x7f29781103d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2970009ca0 tx=0x7f297002a8c0 comp rx=0 tx=0).stop 2024-08-31T05:27:19.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:19.655+0000 7f297fd27640 1 -- 172.21.15.5:0/317354644 shutdown_connections 2024-08-31T05:27:19.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:19.655+0000 7f297fd27640 1 --2- 172.21.15.5:0/317354644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2978109ba0 0x7f29781103d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:19.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:19.655+0000 7f297fd27640 1 --2- 172.21.15.5:0/317354644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2978109250 0x7f2978109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:19.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:19.655+0000 7f297fd27640 1 --2- 172.21.15.5:0/317354644 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2978103910 0x7f2978103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:19.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:19.655+0000 7f297fd27640 1 -- 172.21.15.5:0/317354644 >> 172.21.15.5:0/317354644 conn(0x7f29780ff380 msgr2=0x7f29781017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:19.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:19.655+0000 7f297fd27640 1 -- 172.21.15.5:0/317354644 shutdown_connections 2024-08-31T05:27:19.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:19.655+0000 7f297fd27640 1 -- 172.21.15.5:0/317354644 wait complete. 2024-08-31T05:27:19.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:19.656+0000 7f297fd27640 1 Processor -- start 2024-08-31T05:27:19.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:19.656+0000 7f297fd27640 1 -- start start 2024-08-31T05:27:19.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:19.656+0000 7f297fd27640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2978103910 0x7f297819a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:19.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:19.656+0000 7f297fd27640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2978109250 0x7f297819a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:19.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:19.656+0000 7f297fd27640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2978109ba0 0x7f297819fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:19.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:19.657+0000 7f297fd27640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2978113860 con 0x7f2978109250 2024-08-31T05:27:19.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:19.657+0000 7f297fd27640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f29781136e0 con 0x7f2978109ba0 2024-08-31T05:27:19.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:19.657+0000 7f297fd27640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f29781139e0 con 0x7f2978103910 2024-08-31T05:27:19.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:19.657+0000 7f297d2c2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2978109250 0x7f297819a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:19.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:19.657+0000 7f297d2c2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2978109250 0x7f297819a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39514/0 (socket says 172.21.15.5:39514) 2024-08-31T05:27:19.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:19.657+0000 7f297d2c2640 1 -- 172.21.15.5:0/3212803333 learned_addr learned my addr 172.21.15.5:0/3212803333 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:27:19.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:19.657+0000 7f297e2c4640 1 --2- 172.21.15.5:0/3212803333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2978109ba0 0x7f297819fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:19.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:19.657+0000 7f297dac3640 1 --2- 172.21.15.5:0/3212803333 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2978103910 0x7f297819a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:19.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:19.657+0000 7f297d2c2640 1 -- 172.21.15.5:0/3212803333 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2978103910 msgr2=0x7f297819a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:19.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:19.657+0000 7f297d2c2640 1 --2- 172.21.15.5:0/3212803333 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2978103910 0x7f297819a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:19.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:19.657+0000 7f297d2c2640 1 -- 172.21.15.5:0/3212803333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2978109ba0 msgr2=0x7f297819fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:19.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:19.657+0000 7f297d2c2640 1 --2- 172.21.15.5:0/3212803333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2978109ba0 0x7f297819fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:19.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:19.657+0000 7f297d2c2640 1 -- 172.21.15.5:0/3212803333 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29781a0160 con 0x7f2978109250 2024-08-31T05:27:19.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:19.657+0000 7f297d2c2640 1 --2- 172.21.15.5:0/3212803333 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2978109250 0x7f297819a790 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f297400d740 tx=0x7f297400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:19.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:19.657+0000 7f296affd640 1 -- 172.21.15.5:0/3212803333 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2974017070 con 0x7f2978109250 2024-08-31T05:27:19.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:19.657+0000 7f296affd640 1 -- 172.21.15.5:0/3212803333 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f297400de50 con 0x7f2978109250 2024-08-31T05:27:19.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:19.657+0000 7f297fd27640 1 -- 172.21.15.5:0/3212803333 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29781a0450 con 0x7f2978109250 2024-08-31T05:27:19.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:19.657+0000 7f296affd640 1 -- 172.21.15.5:0/3212803333 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f297400f620 con 0x7f2978109250 2024-08-31T05:27:19.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:19.657+0000 7f297fd27640 1 -- 172.21.15.5:0/3212803333 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29781a6bb0 con 0x7f2978109250 2024-08-31T05:27:19.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:19.659+0000 7f297fd27640 1 -- 172.21.15.5:0/3212803333 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2978103d20 con 0x7f2978109250 2024-08-31T05:27:19.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:19.660+0000 7f296affd640 1 -- 172.21.15.5:0/3212803333 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f297401a070 con 0x7f2978109250 2024-08-31T05:27:19.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:19.661+0000 7f296affd640 1 --2- 172.21.15.5:0/3212803333 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f29640b4c00 0x7f29640b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:19.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:19.661+0000 7f297dac3640 1 --2- 172.21.15.5:0/3212803333 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f29640b4c00 0x7f29640b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:19.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:19.661+0000 7f296affd640 1 -- 172.21.15.5:0/3212803333 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7f29740e47b0 con 0x7f2978109250 2024-08-31T05:27:19.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:19.661+0000 7f297dac3640 1 --2- 172.21.15.5:0/3212803333 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f29640b4c00 0x7f29640b7110 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f296c009b60 tx=0x7f296c005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:19.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:19.664+0000 7f296affd640 1 -- 172.21.15.5:0/3212803333 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f29740abc90 con 0x7f2978109250 2024-08-31T05:27:19.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:19.884+0000 7f297fd27640 1 -- 172.21.15.5:0/3212803333 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f297810b9f0 con 0x7f2978109250 2024-08-31T05:27:19.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:19.885+0000 7f296affd640 1 -- 172.21.15.5:0/3212803333 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9668 (secure 0 0 0) 0x7f29740b41d0 con 0x7f2978109250 2024-08-31T05:27:19.888 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 12 2024-08-31T05:27:19.888 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:27:19.888 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":12,"btime":"2024-08-31T05:27:19:250516+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14739,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2024812199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2024812199},{"type":"v1","addr":"172.21.15.5:6835","nonce":2024812199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3629023702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3629023702},{"type":"v1","addr":"172.21.15.5:6837","nonce":3629023702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14808,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6839/2412701258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":2412701258},{"type":"v1","addr":"172.21.15.5:6839","nonce":2412701258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6841/747057838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":747057838},{"type":"v1","addr":"172.21.15.5:6841","nonce":747057838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24560,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1153378982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1153378982},{"type":"v1","addr":"172.21.15.50:6833","nonce":1153378982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6833/364083443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":364083443},{"type":"v1","addr":"172.21.15.70:6833","nonce":364083443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24587,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2346896794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2346896794},{"type":"v1","addr":"172.21.15.50:6835","nonce":2346896794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24602,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/428759669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":428759669},{"type":"v1","addr":"172.21.15.50:6837","nonce":428759669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24625,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2061504114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2061504114},{"type":"v1","addr":"172.21.15.70:6835","nonce":2061504114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24631,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2780036414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2780036414},{"type":"v1","addr":"172.21.15.70:6837","nonce":2780036414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24652,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/2756569250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":2756569250},{"type":"v1","addr":"172.21.15.70:6839","nonce":2756569250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-08-31T05:27:19.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:19.887+0000 7f297fd27640 1 -- 172.21.15.5:0/3212803333 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f29640b4c00 msgr2=0x7f29640b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:19.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:19.887+0000 7f297fd27640 1 --2- 172.21.15.5:0/3212803333 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f29640b4c00 0x7f29640b7110 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f296c009b60 tx=0x7f296c005f90 comp rx=0 tx=0).stop 2024-08-31T05:27:19.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:19.887+0000 7f297fd27640 1 -- 172.21.15.5:0/3212803333 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2978109250 msgr2=0x7f297819a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:19.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:19.887+0000 7f297fd27640 1 --2- 172.21.15.5:0/3212803333 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2978109250 0x7f297819a790 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f297400d740 tx=0x7f297400dc00 comp rx=0 tx=0).stop 2024-08-31T05:27:19.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:19.887+0000 7f297fd27640 1 -- 172.21.15.5:0/3212803333 shutdown_connections 2024-08-31T05:27:19.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:19.887+0000 7f297fd27640 1 --2- 172.21.15.5:0/3212803333 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f29640b4c00 0x7f29640b7110 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:19.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:19.887+0000 7f297fd27640 1 --2- 172.21.15.5:0/3212803333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2978109ba0 0x7f297819fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:19.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:19.887+0000 7f297fd27640 1 --2- 172.21.15.5:0/3212803333 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2978109250 0x7f297819a790 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:19.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:19.887+0000 7f297fd27640 1 --2- 172.21.15.5:0/3212803333 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2978103910 0x7f297819a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:19.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:19.887+0000 7f297fd27640 1 -- 172.21.15.5:0/3212803333 >> 172.21.15.5:0/3212803333 conn(0x7f29780ff380 msgr2=0x7f2978106860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:19.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:19.888+0000 7f297fd27640 1 -- 172.21.15.5:0/3212803333 shutdown_connections 2024-08-31T05:27:19.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:19.888+0000 7f297fd27640 1 -- 172.21.15.5:0/3212803333 wait complete. 2024-08-31T05:27:20.531 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:20 smithi005 ceph-mon[18602]: Deploying daemon mds.b on smithi050 2024-08-31T05:27:20.532 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:20 smithi005 ceph-mon[18602]: mds.? [v2:172.21.15.5:6840/747057838,v1:172.21.15.5:6841/747057838] up:boot 2024-08-31T05:27:20.532 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:20 smithi005 ceph-mon[18602]: fsmap 11 up:standby 2024-08-31T05:27:20.532 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:20 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-08-31T05:27:20.532 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:20 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/3212803333' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:27:20.535 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:20 smithi050 ceph-mon[22146]: Deploying daemon mds.b on smithi050 2024-08-31T05:27:20.536 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:20 smithi050 ceph-mon[22146]: mds.? [v2:172.21.15.5:6840/747057838,v1:172.21.15.5:6841/747057838] up:boot 2024-08-31T05:27:20.536 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:20 smithi050 ceph-mon[22146]: fsmap 11 up:standby 2024-08-31T05:27:20.536 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:20 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-08-31T05:27:20.536 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:20 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/3212803333' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:27:20.578 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:20 smithi070 ceph-mon[22316]: Deploying daemon mds.b on smithi050 2024-08-31T05:27:20.578 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:20 smithi070 ceph-mon[22316]: mds.? [v2:172.21.15.5:6840/747057838,v1:172.21.15.5:6841/747057838] up:boot 2024-08-31T05:27:20.578 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:20 smithi070 ceph-mon[22316]: fsmap 11 up:standby 2024-08-31T05:27:20.578 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:20 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-08-31T05:27:20.578 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:20 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/3212803333' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:27:21.266 INFO:journalctl@ceph.mds.b.smithi050.stdout:Aug 31 05:27:21 smithi050 podman[53584]: 2024-08-31 05:27:21.152088155 +0000 UTC m=+0.132238688 container create 415dd5033240e50544bc300f727d7c2f41e7d1e0a19ea8514b997fb2aeb1c693 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-b, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T05:27:21.523 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:21 smithi050 ceph-mon[22146]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:21.524 INFO:journalctl@ceph.mds.b.smithi050.stdout:Aug 31 05:27:21 smithi050 podman[53584]: 2024-08-31 05:27:21.413849375 +0000 UTC m=+0.393999910 container init 415dd5033240e50544bc300f727d7c2f41e7d1e0a19ea8514b997fb2aeb1c693 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-08-31T05:27:21.524 INFO:journalctl@ceph.mds.b.smithi050.stdout:Aug 31 05:27:21 smithi050 podman[53584]: 2024-08-31 05:27:21.416654881 +0000 UTC m=+0.396805414 container start 415dd5033240e50544bc300f727d7c2f41e7d1e0a19ea8514b997fb2aeb1c693 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-08-31T05:27:21.524 INFO:journalctl@ceph.mds.b.smithi050.stdout:Aug 31 05:27:21 smithi050 ceph-mds[53603]: -- 172.21.15.50:0/1316968386 <== mon.2 v2:172.21.15.50:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ebf328f860 con 0x55ebf7435600 2024-08-31T05:27:21.524 INFO:journalctl@ceph.mds.b.smithi050.stdout:Aug 31 05:27:21 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-b[53599]: starting mds.b at 2024-08-31T05:27:21.524 INFO:journalctl@ceph.mds.b.smithi050.stdout:Aug 31 05:27:21 smithi050 bash[53584]: 415dd5033240e50544bc300f727d7c2f41e7d1e0a19ea8514b997fb2aeb1c693 2024-08-31T05:27:21.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:21 smithi070 ceph-mon[22316]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:21.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:21 smithi005 ceph-mon[18602]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:21.810 INFO:journalctl@ceph.mds.b.smithi050.stdout:Aug 31 05:27:21 smithi050 systemd[1]: Started Ceph mds.b for 69422704-6758-11ef-bcd4-c7b262605968. 2024-08-31T05:27:22.563 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T05:27:22.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:22 smithi070 ceph-mon[22316]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:22.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:22 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:22.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:22 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:22.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:22 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:22.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:22 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:22.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:22 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:22.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:22 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:27:22.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:22 smithi070 ceph-mon[22316]: mds.? [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] up:boot 2024-08-31T05:27:22.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:22 smithi070 ceph-mon[22316]: fsmap 12 up:standby 2024-08-31T05:27:22.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:22 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-31T05:27:22.856 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:27:22.875 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:22 smithi050 ceph-mon[22146]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:22.875 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:22 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:22.875 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:22 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:22.875 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:22 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:22.876 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:22 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:22.876 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:22 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:22.876 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:22 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:27:22.876 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:22 smithi050 ceph-mon[22146]: mds.? [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] up:boot 2024-08-31T05:27:22.876 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:22 smithi050 ceph-mon[22146]: fsmap 12 up:standby 2024-08-31T05:27:22.876 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:22 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-31T05:27:22.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:22 smithi005 ceph-mon[18602]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:22.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:22 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:22.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:22 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:22.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:22 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:22.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:22 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:22.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:22 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:22.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:22 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:27:22.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:22 smithi005 ceph-mon[18602]: mds.? [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] up:boot 2024-08-31T05:27:22.968 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:22 smithi005 ceph-mon[18602]: fsmap 12 up:standby 2024-08-31T05:27:22.968 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:22 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-31T05:27:23.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:23.398+0000 7fcd8d192640 1 -- 172.21.15.5:0/1217186571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd88103900 msgr2=0x7fcd88103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:23.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:23.398+0000 7fcd8d192640 1 --2- 172.21.15.5:0/1217186571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd88103900 0x7fcd88103d10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fcd78009900 tx=0x7fcd7802a410 comp rx=0 tx=0).stop 2024-08-31T05:27:23.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:23.398+0000 7fcd8d192640 1 -- 172.21.15.5:0/1217186571 shutdown_connections 2024-08-31T05:27:23.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:23.398+0000 7fcd8d192640 1 --2- 172.21.15.5:0/1217186571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd88109b90 0x7fcd881103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:23.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:23.398+0000 7fcd8d192640 1 --2- 172.21.15.5:0/1217186571 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd88109240 0x7fcd88109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:23.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:23.398+0000 7fcd8d192640 1 --2- 172.21.15.5:0/1217186571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd88103900 0x7fcd88103d10 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:23.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:23.398+0000 7fcd8d192640 1 -- 172.21.15.5:0/1217186571 >> 172.21.15.5:0/1217186571 conn(0x7fcd8807b5f0 msgr2=0x7fcd8807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:23.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:23.398+0000 7fcd8d192640 1 -- 172.21.15.5:0/1217186571 shutdown_connections 2024-08-31T05:27:23.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:23.398+0000 7fcd8d192640 1 -- 172.21.15.5:0/1217186571 wait complete. 2024-08-31T05:27:23.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:23.399+0000 7fcd8d192640 1 Processor -- start 2024-08-31T05:27:23.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:23.399+0000 7fcd8d192640 1 -- start start 2024-08-31T05:27:23.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:23.400+0000 7fcd8d192640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd88103900 0x7fcd8819a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:23.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:23.400+0000 7fcd8d192640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd88109240 0x7fcd8819a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:23.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:23.400+0000 7fcd8d192640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd88109b90 0x7fcd8819fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:23.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:23.400+0000 7fcd8d192640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fcd88113850 con 0x7fcd88103900 2024-08-31T05:27:23.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:23.400+0000 7fcd8d192640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcd881136d0 con 0x7fcd88109b90 2024-08-31T05:27:23.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:23.400+0000 7fcd8d192640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcd881139d0 con 0x7fcd88109240 2024-08-31T05:27:23.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:23.400+0000 7fcd86d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd88103900 0x7fcd8819a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:23.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:23.400+0000 7fcd86d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd88103900 0x7fcd8819a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56974/0 (socket says 172.21.15.5:56974) 2024-08-31T05:27:23.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:23.400+0000 7fcd86d9d640 1 -- 172.21.15.5:0/2902270020 learned_addr learned my addr 172.21.15.5:0/2902270020 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:27:23.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:23.400+0000 7fcd8659c640 1 --2- 172.21.15.5:0/2902270020 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd88109240 0x7fcd8819a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:23.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:23.400+0000 7fcd8759e640 1 --2- 172.21.15.5:0/2902270020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd88109b90 0x7fcd8819fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:23.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:23.400+0000 7fcd86d9d640 1 -- 172.21.15.5:0/2902270020 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd88109240 msgr2=0x7fcd8819a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:23.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:23.400+0000 7fcd86d9d640 1 --2- 172.21.15.5:0/2902270020 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd88109240 0x7fcd8819a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:23.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:23.400+0000 7fcd86d9d640 1 -- 172.21.15.5:0/2902270020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd88109b90 msgr2=0x7fcd8819fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:23.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:23.400+0000 7fcd86d9d640 1 --2- 172.21.15.5:0/2902270020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd88109b90 0x7fcd8819fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:23.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:23.400+0000 7fcd86d9d640 1 -- 172.21.15.5:0/2902270020 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd881a0230 con 0x7fcd88103900 2024-08-31T05:27:23.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:23.400+0000 7fcd86d9d640 1 --2- 172.21.15.5:0/2902270020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd88103900 0x7fcd8819a2c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcd78005940 tx=0x7fcd78004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:23.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:23.401+0000 7fcd6ffff640 1 -- 172.21.15.5:0/2902270020 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd7803f030 con 0x7fcd88103900 2024-08-31T05:27:23.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:23.401+0000 7fcd8d192640 1 -- 172.21.15.5:0/2902270020 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd881a04c0 con 0x7fcd88103900 2024-08-31T05:27:23.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:23.401+0000 7fcd6ffff640 1 -- 172.21.15.5:0/2902270020 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd78003aa0 con 0x7fcd88103900 2024-08-31T05:27:23.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:23.401+0000 7fcd6ffff640 1 -- 172.21.15.5:0/2902270020 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd78035070 con 0x7fcd88103900 2024-08-31T05:27:23.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:23.401+0000 7fcd8d192640 1 -- 172.21.15.5:0/2902270020 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd881a6c80 con 0x7fcd88103900 2024-08-31T05:27:23.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:23.402+0000 7fcd8d192640 1 -- 172.21.15.5:0/2902270020 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd88103d10 con 0x7fcd88103900 2024-08-31T05:27:23.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:23.403+0000 7fcd6ffff640 1 -- 172.21.15.5:0/2902270020 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7fcd78042030 con 0x7fcd88103900 2024-08-31T05:27:23.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:23.404+0000 7fcd6ffff640 1 --2- 172.21.15.5:0/2902270020 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fcd700b4b80 0x7fcd700b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:23.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:23.404+0000 7fcd8659c640 1 --2- 172.21.15.5:0/2902270020 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fcd700b4b80 0x7fcd700b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:23.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:23.404+0000 7fcd6ffff640 1 -- 172.21.15.5:0/2902270020 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7fcd78105710 con 0x7fcd88103900 2024-08-31T05:27:23.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:23.405+0000 7fcd8659c640 1 --2- 172.21.15.5:0/2902270020 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fcd700b4b80 0x7fcd700b7090 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcd88106260 tx=0x7fcd7c005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:23.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:23.407+0000 7fcd6ffff640 1 -- 172.21.15.5:0/2902270020 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fcd780cc5c0 con 0x7fcd88103900 2024-08-31T05:27:23.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:23.661+0000 7fcd8d192640 1 -- 172.21.15.5:0/2902270020 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcd8819b3f0 con 0x7fcd88103900 2024-08-31T05:27:23.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:23.662+0000 7fcd6ffff640 1 -- 172.21.15.5:0/2902270020 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10488 (secure 0 0 0) 0x7fcd780d0d80 con 0x7fcd88103900 2024-08-31T05:27:23.664 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:27:23.664 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":13,"btime":"2024-08-31T05:27:22:264233+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14739,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2024812199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2024812199},{"type":"v1","addr":"172.21.15.5:6835","nonce":2024812199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3629023702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3629023702},{"type":"v1","addr":"172.21.15.5:6837","nonce":3629023702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14808,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6839/2412701258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":2412701258},{"type":"v1","addr":"172.21.15.5:6839","nonce":2412701258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6841/747057838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":747057838},{"type":"v1","addr":"172.21.15.5:6841","nonce":747057838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24560,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1153378982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1153378982},{"type":"v1","addr":"172.21.15.50:6833","nonce":1153378982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6833/364083443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":364083443},{"type":"v1","addr":"172.21.15.70:6833","nonce":364083443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24587,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2346896794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2346896794},{"type":"v1","addr":"172.21.15.50:6835","nonce":2346896794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24602,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/428759669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":428759669},{"type":"v1","addr":"172.21.15.50:6837","nonce":428759669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24625,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2061504114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2061504114},{"type":"v1","addr":"172.21.15.70:6835","nonce":2061504114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24631,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2780036414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2780036414},{"type":"v1","addr":"172.21.15.70:6837","nonce":2780036414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24638,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/98200944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":98200944},{"type":"v1","addr":"172.21.15.50:6839","nonce":98200944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24652,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/2756569250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":2756569250},{"type":"v1","addr":"172.21.15.70:6839","nonce":2756569250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-08-31T05:27:23.665 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 13 2024-08-31T05:27:23.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:23.665+0000 7fcd8d192640 1 -- 172.21.15.5:0/2902270020 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fcd700b4b80 msgr2=0x7fcd700b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:23.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:23.665+0000 7fcd8d192640 1 --2- 172.21.15.5:0/2902270020 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fcd700b4b80 0x7fcd700b7090 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcd88106260 tx=0x7fcd7c005f90 comp rx=0 tx=0).stop 2024-08-31T05:27:23.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:23.665+0000 7fcd8d192640 1 -- 172.21.15.5:0/2902270020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd88103900 msgr2=0x7fcd8819a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:23.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:23.665+0000 7fcd8d192640 1 --2- 172.21.15.5:0/2902270020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd88103900 0x7fcd8819a2c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcd78005940 tx=0x7fcd78004270 comp rx=0 tx=0).stop 2024-08-31T05:27:23.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:23.666+0000 7fcd8d192640 1 -- 172.21.15.5:0/2902270020 shutdown_connections 2024-08-31T05:27:23.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:23.666+0000 7fcd8d192640 1 --2- 172.21.15.5:0/2902270020 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fcd700b4b80 0x7fcd700b7090 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:23.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:23.666+0000 7fcd8d192640 1 --2- 172.21.15.5:0/2902270020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd88109b90 0x7fcd8819fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:23.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:23.666+0000 7fcd8d192640 1 --2- 172.21.15.5:0/2902270020 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd88109240 0x7fcd8819a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:23.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:23.666+0000 7fcd8d192640 1 --2- 172.21.15.5:0/2902270020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd88103900 0x7fcd8819a2c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:23.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:23.666+0000 7fcd8d192640 1 -- 172.21.15.5:0/2902270020 >> 172.21.15.5:0/2902270020 conn(0x7fcd8807b5f0 msgr2=0x7fcd88107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:23.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:23.666+0000 7fcd8d192640 1 -- 172.21.15.5:0/2902270020 shutdown_connections 2024-08-31T05:27:23.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:23.666+0000 7fcd8d192640 1 -- 172.21.15.5:0/2902270020 wait complete. 2024-08-31T05:27:23.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:23 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:23.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:23 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:23.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:23 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:23.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:23 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:23.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:23 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:23.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:23 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/2902270020' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:27:24.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:23 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:24.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:23 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:24.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:23 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:24.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:23 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:24.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:23 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:24.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:23 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/2902270020' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:27:24.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:23 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:24.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:23 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:24.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:23 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:24.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:23 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:24.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:23 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:24.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:23 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/2902270020' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:27:24.392 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-08-31T05:27:24.662 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:27:25.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.215+0000 7f4dc4405640 1 -- 172.21.15.5:0/2699357176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4dbc109bc0 msgr2=0x7f4dbc1103f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:25.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.215+0000 7f4dc4405640 1 --2- 172.21.15.5:0/2699357176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4dbc109bc0 0x7f4dbc1103f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4db4009ca0 tx=0x7f4db402a8c0 comp rx=0 tx=0).stop 2024-08-31T05:27:25.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.215+0000 7f4dc4405640 1 -- 172.21.15.5:0/2699357176 shutdown_connections 2024-08-31T05:27:25.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.215+0000 7f4dc4405640 1 --2- 172.21.15.5:0/2699357176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4dbc109bc0 0x7f4dbc1103f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:25.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.215+0000 7f4dc4405640 1 --2- 172.21.15.5:0/2699357176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dbc109270 0x7f4dbc109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:25.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.215+0000 7f4dc4405640 1 --2- 172.21.15.5:0/2699357176 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4dbc103930 0x7f4dbc103d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:25.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.215+0000 7f4dc4405640 1 -- 172.21.15.5:0/2699357176 >> 172.21.15.5:0/2699357176 conn(0x7f4dbc0ff380 msgr2=0x7f4dbc1017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:25.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.215+0000 7f4dc4405640 1 -- 172.21.15.5:0/2699357176 shutdown_connections 2024-08-31T05:27:25.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.215+0000 7f4dc4405640 1 -- 172.21.15.5:0/2699357176 wait complete. 2024-08-31T05:27:25.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.216+0000 7f4dc4405640 1 Processor -- start 2024-08-31T05:27:25.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.216+0000 7f4dc4405640 1 -- start start 2024-08-31T05:27:25.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.216+0000 7f4dc4405640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4dbc103930 0x7f4dbc19a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:25.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.216+0000 7f4dc4405640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4dbc109270 0x7f4dbc19a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:25.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.216+0000 7f4dc4405640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dbc109bc0 0x7f4dbc19fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:25.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.216+0000 7f4dc4405640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4dbc113880 con 0x7f4dbc109270 2024-08-31T05:27:25.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.216+0000 7f4dc4405640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4dbc113700 con 0x7f4dbc109bc0 2024-08-31T05:27:25.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.216+0000 7f4dc4405640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4dbc113a00 con 0x7f4dbc103930 2024-08-31T05:27:25.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.216+0000 7f4dc29a2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dbc109bc0 0x7f4dbc19fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:25.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.216+0000 7f4dc19a0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4dbc109270 0x7f4dbc19a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:25.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.216+0000 7f4dc21a1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4dbc103930 0x7f4dbc19a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:25.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.216+0000 7f4dc29a2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dbc109bc0 0x7f4dbc19fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:52888/0 (socket says 172.21.15.5:52888) 2024-08-31T05:27:25.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.216+0000 7f4dc21a1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4dbc103930 0x7f4dbc19a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:39478/0 (socket says 172.21.15.5:39478) 2024-08-31T05:27:25.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.216+0000 7f4dc29a2640 1 -- 172.21.15.5:0/3010165978 learned_addr learned my addr 172.21.15.5:0/3010165978 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:27:25.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.216+0000 7f4dc19a0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4dbc109270 0x7f4dbc19a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56990/0 (socket says 172.21.15.5:56990) 2024-08-31T05:27:25.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.217+0000 7f4dc19a0640 1 -- 172.21.15.5:0/3010165978 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4dbc103930 msgr2=0x7f4dbc19a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:25.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.217+0000 7f4dc19a0640 1 --2- 172.21.15.5:0/3010165978 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4dbc103930 0x7f4dbc19a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:25.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.217+0000 7f4dc19a0640 1 -- 172.21.15.5:0/3010165978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dbc109bc0 msgr2=0x7f4dbc19fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:25.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.217+0000 7f4dc19a0640 1 --2- 172.21.15.5:0/3010165978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dbc109bc0 0x7f4dbc19fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:25.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.217+0000 7f4dc19a0640 1 -- 172.21.15.5:0/3010165978 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dbc1a0140 con 0x7f4dbc109270 2024-08-31T05:27:25.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.217+0000 7f4dc19a0640 1 --2- 172.21.15.5:0/3010165978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4dbc109270 0x7f4dbc19a770 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc06c960 tx=0x7f4dac00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:25.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.217+0000 7f4db37fe640 1 -- 172.21.15.5:0/3010165978 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dac00cc40 con 0x7f4dbc109270 2024-08-31T05:27:25.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.217+0000 7f4db37fe640 1 -- 172.21.15.5:0/3010165978 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4dac00cde0 con 0x7f4dbc109270 2024-08-31T05:27:25.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.217+0000 7f4dc4405640 1 -- 172.21.15.5:0/3010165978 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dbc1a0430 con 0x7f4dbc109270 2024-08-31T05:27:25.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.217+0000 7f4db37fe640 1 -- 172.21.15.5:0/3010165978 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dac018780 con 0x7f4dbc109270 2024-08-31T05:27:25.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.217+0000 7f4dc4405640 1 -- 172.21.15.5:0/3010165978 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dbc1a6b90 con 0x7f4dbc109270 2024-08-31T05:27:25.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.218+0000 7f4dc4405640 1 -- 172.21.15.5:0/3010165978 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dbc103d40 con 0x7f4dbc109270 2024-08-31T05:27:25.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.220+0000 7f4db37fe640 1 -- 172.21.15.5:0/3010165978 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f4dac010a90 con 0x7f4dbc109270 2024-08-31T05:27:25.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.220+0000 7f4db37fe640 1 --2- 172.21.15.5:0/3010165978 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4da80b4c00 0x7f4da80b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:25.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.221+0000 7f4dc21a1640 1 --2- 172.21.15.5:0/3010165978 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4da80b4c00 0x7f4da80b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:25.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.221+0000 7f4db37fe640 1 -- 172.21.15.5:0/3010165978 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7f4dac0e54a0 con 0x7f4dbc109270 2024-08-31T05:27:25.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.221+0000 7f4dc21a1640 1 --2- 172.21.15.5:0/3010165978 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4da80b4c00 0x7f4da80b7110 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4db8009bd0 tx=0x7f4db8005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:25.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.224+0000 7f4db37fe640 1 -- 172.21.15.5:0/3010165978 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4dac0ac350 con 0x7f4dbc109270 2024-08-31T05:27:25.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.428+0000 7f4dc4405640 1 -- 172.21.15.5:0/3010165978 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f4dbc19b300 con 0x7f4dbc109270 2024-08-31T05:27:25.430 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:25 smithi005 ceph-mon[18602]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:25.430 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:25 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:25.431 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:25 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:25.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.429+0000 7f4db37fe640 1 -- 172.21.15.5:0/3010165978 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v72) ==== 84+0+65 (secure 0 0 0) 0x7f4dac0b0b10 con 0x7f4dbc109270 2024-08-31T05:27:25.431 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:27:25.431 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2024-08-31T05:27:25.431 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:27:25.431 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2024-08-31T05:27:25.431 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2024-08-31T05:27:25.431 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:27:25.432 INFO:teuthology.orchestra.run.smithi005.stdout:] 2024-08-31T05:27:25.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.431+0000 7f4dc4405640 1 -- 172.21.15.5:0/3010165978 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4da80b4c00 msgr2=0x7f4da80b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:25.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.431+0000 7f4dc4405640 1 --2- 172.21.15.5:0/3010165978 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4da80b4c00 0x7f4da80b7110 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4db8009bd0 tx=0x7f4db8005f90 comp rx=0 tx=0).stop 2024-08-31T05:27:25.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.431+0000 7f4dc4405640 1 -- 172.21.15.5:0/3010165978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4dbc109270 msgr2=0x7f4dbc19a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:25.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.431+0000 7f4dc4405640 1 --2- 172.21.15.5:0/3010165978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4dbc109270 0x7f4dbc19a770 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc06c960 tx=0x7f4dac00ee50 comp rx=0 tx=0).stop 2024-08-31T05:27:25.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.431+0000 7f4dc4405640 1 -- 172.21.15.5:0/3010165978 shutdown_connections 2024-08-31T05:27:25.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.431+0000 7f4dc4405640 1 --2- 172.21.15.5:0/3010165978 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4da80b4c00 0x7f4da80b7110 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:25.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.431+0000 7f4dc4405640 1 --2- 172.21.15.5:0/3010165978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4dbc109bc0 0x7f4dbc19fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:25.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.431+0000 7f4dc4405640 1 --2- 172.21.15.5:0/3010165978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4dbc109270 0x7f4dbc19a770 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:25.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.431+0000 7f4dc4405640 1 --2- 172.21.15.5:0/3010165978 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4dbc103930 0x7f4dbc19a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:25.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.431+0000 7f4dc4405640 1 -- 172.21.15.5:0/3010165978 >> 172.21.15.5:0/3010165978 conn(0x7f4dbc0ff380 msgr2=0x7f4dbc106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:25.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.431+0000 7f4dc4405640 1 -- 172.21.15.5:0/3010165978 shutdown_connections 2024-08-31T05:27:25.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:25.431+0000 7f4dc4405640 1 -- 172.21.15.5:0/3010165978 wait complete. 2024-08-31T05:27:25.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:25 smithi070 ceph-mon[22316]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:25.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:25 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:25.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:25 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:25.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:25 smithi050 ceph-mon[22146]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:25.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:25 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:25.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:25 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:26.108 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-31T05:27:26.108 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-31T05:27:26.399 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:26 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:27:26.399 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:26 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:27:26.399 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:26 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:26.399 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:26 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/3010165978' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-08-31T05:27:26.399 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:26 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:27:26.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:26 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:27:26.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:26 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:27:26.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:26 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:26.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:26 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/3010165978' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-08-31T05:27:26.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:26 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:27:26.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:26 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:27:26.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:26 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:27:26.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:26 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:26.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:26 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/3010165978' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-08-31T05:27:26.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:26 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:27:27.104 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:27:27.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:27 smithi005 ceph-mon[18602]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:27.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:27 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:27.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:27 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:27.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:27 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:27.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:27 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:27.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:27 smithi070 ceph-mon[22316]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:27.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:27 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:27.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:27 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:27.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:27 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:27.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:27 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:27.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:27.614+0000 7fc742e4f640 1 -- 172.21.15.5:0/803019753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc73c108140 msgr2=0x7fc73c108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:27.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:27.614+0000 7fc742e4f640 1 --2- 172.21.15.5:0/803019753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc73c108140 0x7fc73c108550 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc72c009900 tx=0x7fc72c02a410 comp rx=0 tx=0).stop 2024-08-31T05:27:27.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:27.614+0000 7fc742e4f640 1 -- 172.21.15.5:0/803019753 shutdown_connections 2024-08-31T05:27:27.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:27.614+0000 7fc742e4f640 1 --2- 172.21.15.5:0/803019753 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc73c108a90 0x7fc73c10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:27.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:27.614+0000 7fc742e4f640 1 --2- 172.21.15.5:0/803019753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc73c108140 0x7fc73c108550 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:27.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:27.614+0000 7fc742e4f640 1 --2- 172.21.15.5:0/803019753 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc73c102800 0x7fc73c102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:27.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:27.614+0000 7fc742e4f640 1 -- 172.21.15.5:0/803019753 >> 172.21.15.5:0/803019753 conn(0x7fc73c0794d0 msgr2=0x7fc73c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:27.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:27.614+0000 7fc742e4f640 1 -- 172.21.15.5:0/803019753 shutdown_connections 2024-08-31T05:27:27.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:27.614+0000 7fc742e4f640 1 -- 172.21.15.5:0/803019753 wait complete. 2024-08-31T05:27:27.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:27.615+0000 7fc742e4f640 1 Processor -- start 2024-08-31T05:27:27.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:27.615+0000 7fc742e4f640 1 -- start start 2024-08-31T05:27:27.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:27.615+0000 7fc742e4f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc73c102800 0x7fc73c19b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:27.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:27.615+0000 7fc742e4f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc73c108140 0x7fc73c19b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:27.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:27.615+0000 7fc742e4f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc73c108a90 0x7fc73c19bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:27.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:27.615+0000 7fc742e4f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc73c1126e0 con 0x7fc73c102800 2024-08-31T05:27:27.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:27.615+0000 7fc742e4f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc73c112560 con 0x7fc73c108140 2024-08-31T05:27:27.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:27.615+0000 7fc742e4f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc73c112860 con 0x7fc73c108a90 2024-08-31T05:27:27.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:27.615+0000 7fc740beb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc73c102800 0x7fc73c19b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:27.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:27.615+0000 7fc740beb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc73c102800 0x7fc73c19b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57012/0 (socket says 172.21.15.5:57012) 2024-08-31T05:27:27.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:27.615+0000 7fc740beb640 1 -- 172.21.15.5:0/1419291415 learned_addr learned my addr 172.21.15.5:0/1419291415 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:27:27.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:27.615+0000 7fc7413ec640 1 --2- 172.21.15.5:0/1419291415 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc73c108a90 0x7fc73c19bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:27.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:27.615+0000 7fc733fff640 1 --2- 172.21.15.5:0/1419291415 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc73c108140 0x7fc73c19b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:27.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:27.616+0000 7fc740beb640 1 -- 172.21.15.5:0/1419291415 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc73c108a90 msgr2=0x7fc73c19bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:27.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:27.616+0000 7fc740beb640 1 --2- 172.21.15.5:0/1419291415 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc73c108a90 0x7fc73c19bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:27.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:27.616+0000 7fc740beb640 1 -- 172.21.15.5:0/1419291415 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc73c108140 msgr2=0x7fc73c19b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:27.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:27.616+0000 7fc740beb640 1 --2- 172.21.15.5:0/1419291415 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc73c108140 0x7fc73c19b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:27.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:27.616+0000 7fc740beb640 1 -- 172.21.15.5:0/1419291415 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc73c1a63a0 con 0x7fc73c102800 2024-08-31T05:27:27.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:27.616+0000 7fc733fff640 1 --2- 172.21.15.5:0/1419291415 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc73c108140 0x7fc73c19b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:27:27.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:27.616+0000 7fc740beb640 1 --2- 172.21.15.5:0/1419291415 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc73c102800 0x7fc73c19b090 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc73800c970 tx=0x7fc73800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:27.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:27.616+0000 7fc731ffb640 1 -- 172.21.15.5:0/1419291415 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc738007bb0 con 0x7fc73c102800 2024-08-31T05:27:27.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:27.616+0000 7fc742e4f640 1 -- 172.21.15.5:0/1419291415 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc73c1a6690 con 0x7fc73c102800 2024-08-31T05:27:27.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:27.616+0000 7fc731ffb640 1 -- 172.21.15.5:0/1419291415 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc738007d50 con 0x7fc73c102800 2024-08-31T05:27:27.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:27.616+0000 7fc731ffb640 1 -- 172.21.15.5:0/1419291415 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc73800f450 con 0x7fc73c102800 2024-08-31T05:27:27.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:27.616+0000 7fc742e4f640 1 -- 172.21.15.5:0/1419291415 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc73c1a6b80 con 0x7fc73c102800 2024-08-31T05:27:27.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:27.617+0000 7fc742e4f640 1 -- 172.21.15.5:0/1419291415 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc73c102c10 con 0x7fc73c102800 2024-08-31T05:27:27.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:27.619+0000 7fc731ffb640 1 -- 172.21.15.5:0/1419291415 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7fc738004f20 con 0x7fc73c102800 2024-08-31T05:27:27.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:27.619+0000 7fc731ffb640 1 --2- 172.21.15.5:0/1419291415 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc7240b4b80 0x7fc7240b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:27.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:27.619+0000 7fc733fff640 1 --2- 172.21.15.5:0/1419291415 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc7240b4b80 0x7fc7240b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:27.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:27.619+0000 7fc731ffb640 1 -- 172.21.15.5:0/1419291415 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7fc7380e4b00 con 0x7fc73c102800 2024-08-31T05:27:27.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:27.620+0000 7fc733fff640 1 --2- 172.21.15.5:0/1419291415 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc7240b4b80 0x7fc7240b7090 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc72c0096c0 tx=0x7fc72c031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:27.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:27.624+0000 7fc731ffb640 1 -- 172.21.15.5:0/1419291415 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc738014030 con 0x7fc73c102800 2024-08-31T05:27:27.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:27 smithi050 ceph-mon[22146]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:27.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:27 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:27.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:27 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:27.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:27 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:27.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:27 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:27.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:27.829+0000 7fc742e4f640 1 -- 172.21.15.5:0/1419291415 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fc73c02e430 con 0x7fc73c102800 2024-08-31T05:27:28.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:28.217+0000 7fc731ffb640 1 -- 172.21.15.5:0/1419291415 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v73) ==== 138+0+0 (secure 0 0 0) 0x7fc7380ac000 con 0x7fc73c102800 2024-08-31T05:27:28.219 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2024-08-31T05:27:28.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:28.220+0000 7fc742e4f640 1 -- 172.21.15.5:0/1419291415 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc7240b4b80 msgr2=0x7fc7240b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:28.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:28.220+0000 7fc742e4f640 1 --2- 172.21.15.5:0/1419291415 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc7240b4b80 0x7fc7240b7090 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc72c0096c0 tx=0x7fc72c031400 comp rx=0 tx=0).stop 2024-08-31T05:27:28.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:28.220+0000 7fc742e4f640 1 -- 172.21.15.5:0/1419291415 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc73c102800 msgr2=0x7fc73c19b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:28.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:28.220+0000 7fc742e4f640 1 --2- 172.21.15.5:0/1419291415 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc73c102800 0x7fc73c19b090 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc73800c970 tx=0x7fc73800ce30 comp rx=0 tx=0).stop 2024-08-31T05:27:28.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:28.220+0000 7fc742e4f640 1 -- 172.21.15.5:0/1419291415 shutdown_connections 2024-08-31T05:27:28.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:28.220+0000 7fc742e4f640 1 --2- 172.21.15.5:0/1419291415 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc7240b4b80 0x7fc7240b7090 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:28.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:28.220+0000 7fc742e4f640 1 --2- 172.21.15.5:0/1419291415 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc73c108a90 0x7fc73c19bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:28.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:28.220+0000 7fc742e4f640 1 --2- 172.21.15.5:0/1419291415 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc73c108140 0x7fc73c19b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:28.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:28.220+0000 7fc742e4f640 1 --2- 172.21.15.5:0/1419291415 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc73c102800 0x7fc73c19b090 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:28.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:28.220+0000 7fc742e4f640 1 -- 172.21.15.5:0/1419291415 >> 172.21.15.5:0/1419291415 conn(0x7fc73c0794d0 msgr2=0x7fc73c104260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:28.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:28.221+0000 7fc742e4f640 1 -- 172.21.15.5:0/1419291415 shutdown_connections 2024-08-31T05:27:28.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:28.221+0000 7fc742e4f640 1 -- 172.21.15.5:0/1419291415 wait complete. 2024-08-31T05:27:28.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:28 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/1419291415' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-08-31T05:27:28.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:28 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:28.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:28 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:28.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:28 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:27:28.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:28 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:27:28.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:28 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:28.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:28 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/1419291415' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-08-31T05:27:28.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:28 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:28.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:28 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:28.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:28 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:27:28.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:28 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:27:28.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:28 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:28.692 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:28 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/1419291415' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-08-31T05:27:28.692 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:28 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:28.692 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:28 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:28.693 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:28 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:27:28.693 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:28 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:27:28.693 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:28 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:27:29.041 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-08-31T05:27:29.305 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:27:29.425 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:29 smithi005 ceph-mon[18602]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:29.425 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:29 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/1419291415' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-08-31T05:27:29.425 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:29 smithi005 ceph-mon[18602]: osdmap e73: 12 total, 12 up, 12 in 2024-08-31T05:27:29.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:29 smithi070 ceph-mon[22316]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:29.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:29 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/1419291415' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-08-31T05:27:29.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:29 smithi070 ceph-mon[22316]: osdmap e73: 12 total, 12 up, 12 in 2024-08-31T05:27:29.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:29 smithi050 ceph-mon[22146]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:29.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:29 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/1419291415' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-08-31T05:27:29.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:29 smithi050 ceph-mon[22146]: osdmap e73: 12 total, 12 up, 12 in 2024-08-31T05:27:29.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:29.858+0000 7f2352b91640 1 -- 172.21.15.5:0/2552609951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f234c1050a0 msgr2=0x7f234c10d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:29.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:29.858+0000 7f2352b91640 1 --2- 172.21.15.5:0/2552609951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f234c1050a0 0x7f234c10d5f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2334009900 tx=0x7f233402a410 comp rx=0 tx=0).stop 2024-08-31T05:27:29.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:29.858+0000 7f2352b91640 1 -- 172.21.15.5:0/2552609951 shutdown_connections 2024-08-31T05:27:29.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:29.858+0000 7f2352b91640 1 --2- 172.21.15.5:0/2552609951 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f234c10dbb0 0x7f234c1100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:29.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:29.858+0000 7f2352b91640 1 --2- 172.21.15.5:0/2552609951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f234c1050a0 0x7f234c10d5f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:29.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:29.858+0000 7f2352b91640 1 --2- 172.21.15.5:0/2552609951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f234c104750 0x7f234c104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:29.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:29.858+0000 7f2352b91640 1 -- 172.21.15.5:0/2552609951 >> 172.21.15.5:0/2552609951 conn(0x7f234c0794d0 msgr2=0x7f234c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:29.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:29.858+0000 7f2352b91640 1 -- 172.21.15.5:0/2552609951 shutdown_connections 2024-08-31T05:27:29.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:29.858+0000 7f2352b91640 1 -- 172.21.15.5:0/2552609951 wait complete. 2024-08-31T05:27:29.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:29.859+0000 7f2352b91640 1 Processor -- start 2024-08-31T05:27:29.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:29.859+0000 7f2352b91640 1 -- start start 2024-08-31T05:27:29.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:29.859+0000 7f2352b91640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f234c104750 0x7f234c102490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:29.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:29.859+0000 7f2352b91640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f234c1050a0 0x7f234c1029d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:29.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:29.859+0000 7f2352b91640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f234c10dbb0 0x7f234c102f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:29.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:29.859+0000 7f2352b91640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f234c1137f0 con 0x7f234c104750 2024-08-31T05:27:29.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:29.859+0000 7f2352b91640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f234c113670 con 0x7f234c10dbb0 2024-08-31T05:27:29.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:29.859+0000 7f2352b91640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f234c113970 con 0x7f234c1050a0 2024-08-31T05:27:29.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:29.859+0000 7f235092d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f234c104750 0x7f234c102490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:29.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:29.859+0000 7f235092d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f234c104750 0x7f234c102490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57028/0 (socket says 172.21.15.5:57028) 2024-08-31T05:27:29.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:29.859+0000 7f235092d640 1 -- 172.21.15.5:0/374447545 learned_addr learned my addr 172.21.15.5:0/374447545 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:27:29.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:29.860+0000 7f235112e640 1 --2- 172.21.15.5:0/374447545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f234c10dbb0 0x7f234c102f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:29.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:29.860+0000 7f235092d640 1 -- 172.21.15.5:0/374447545 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f234c1050a0 msgr2=0x7f234c1029d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:29.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:29.860+0000 7f235092d640 1 --2- 172.21.15.5:0/374447545 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f234c1050a0 0x7f234c1029d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:29.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:29.860+0000 7f235092d640 1 -- 172.21.15.5:0/374447545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f234c10dbb0 msgr2=0x7f234c102f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:29.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:29.860+0000 7f235092d640 1 --2- 172.21.15.5:0/374447545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f234c10dbb0 0x7f234c102f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:29.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:29.860+0000 7f235092d640 1 -- 172.21.15.5:0/374447545 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f234c1a8470 con 0x7f234c104750 2024-08-31T05:27:29.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:29.860+0000 7f235112e640 1 --2- 172.21.15.5:0/374447545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f234c10dbb0 0x7f234c102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:27:29.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:29.860+0000 7f235092d640 1 --2- 172.21.15.5:0/374447545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f234c104750 0x7f234c102490 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f233c00ccb0 tx=0x7f233c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:29.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:29.860+0000 7f2349ffb640 1 -- 172.21.15.5:0/374447545 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f233c003b70 con 0x7f234c104750 2024-08-31T05:27:29.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:29.860+0000 7f2352b91640 1 -- 172.21.15.5:0/374447545 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f234c1a8760 con 0x7f234c104750 2024-08-31T05:27:29.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:29.860+0000 7f2349ffb640 1 -- 172.21.15.5:0/374447545 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f233c00ae50 con 0x7f234c104750 2024-08-31T05:27:29.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:29.860+0000 7f2349ffb640 1 -- 172.21.15.5:0/374447545 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f233c00f6f0 con 0x7f234c104750 2024-08-31T05:27:29.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:29.860+0000 7f2352b91640 1 -- 172.21.15.5:0/374447545 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f234c1a8ca0 con 0x7f234c104750 2024-08-31T05:27:29.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:29.861+0000 7f2352b91640 1 -- 172.21.15.5:0/374447545 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f234c104b60 con 0x7f234c104750 2024-08-31T05:27:29.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:29.863+0000 7f2349ffb640 1 -- 172.21.15.5:0/374447545 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f233c004000 con 0x7f234c104750 2024-08-31T05:27:29.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:29.864+0000 7f2349ffb640 1 --2- 172.21.15.5:0/374447545 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f23380b4b80 0x7f23380b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:29.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:29.864+0000 7f234bfff640 1 --2- 172.21.15.5:0/374447545 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f23380b4b80 0x7f23380b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:29.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:29.864+0000 7f2349ffb640 1 -- 172.21.15.5:0/374447545 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7712+0+0 (secure 0 0 0) 0x7f233c0e5610 con 0x7f234c104750 2024-08-31T05:27:29.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:29.864+0000 7f234bfff640 1 --2- 172.21.15.5:0/374447545 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f23380b4b80 0x7f23380b7090 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f233402a930 tx=0x7f2334031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:29.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:29.867+0000 7f2349ffb640 1 -- 172.21.15.5:0/374447545 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f233c014070 con 0x7f234c104750 2024-08-31T05:27:30.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:30.053+0000 7f2352b91640 1 -- 172.21.15.5:0/374447545 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f234c103790 con 0x7f234c104750 2024-08-31T05:27:30.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:30.230+0000 7f2349ffb640 1 -- 172.21.15.5:0/374447545 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v75) ==== 171+0+0 (secure 0 0 0) 0x7f233c0ac920 con 0x7f234c104750 2024-08-31T05:27:30.232 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2024-08-31T05:27:30.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:30.233+0000 7f2352b91640 1 -- 172.21.15.5:0/374447545 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f23380b4b80 msgr2=0x7f23380b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:30.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:30.233+0000 7f2352b91640 1 --2- 172.21.15.5:0/374447545 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f23380b4b80 0x7f23380b7090 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f233402a930 tx=0x7f2334031400 comp rx=0 tx=0).stop 2024-08-31T05:27:30.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:30.233+0000 7f2352b91640 1 -- 172.21.15.5:0/374447545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f234c104750 msgr2=0x7f234c102490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:30.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:30.233+0000 7f2352b91640 1 --2- 172.21.15.5:0/374447545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f234c104750 0x7f234c102490 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f233c00ccb0 tx=0x7f233c00a620 comp rx=0 tx=0).stop 2024-08-31T05:27:30.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:30.233+0000 7f2352b91640 1 -- 172.21.15.5:0/374447545 shutdown_connections 2024-08-31T05:27:30.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:30.234+0000 7f2352b91640 1 --2- 172.21.15.5:0/374447545 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f23380b4b80 0x7f23380b7090 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:30.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:30.234+0000 7f2352b91640 1 --2- 172.21.15.5:0/374447545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f234c10dbb0 0x7f234c102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:30.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:30.234+0000 7f2352b91640 1 --2- 172.21.15.5:0/374447545 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f234c1050a0 0x7f234c1029d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:30.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:30.234+0000 7f2352b91640 1 --2- 172.21.15.5:0/374447545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f234c104750 0x7f234c102490 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:30.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:30.234+0000 7f2352b91640 1 -- 172.21.15.5:0/374447545 >> 172.21.15.5:0/374447545 conn(0x7f234c0794d0 msgr2=0x7f234c100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:30.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:30.234+0000 7f2352b91640 1 -- 172.21.15.5:0/374447545 shutdown_connections 2024-08-31T05:27:30.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:30.234+0000 7f2352b91640 1 -- 172.21.15.5:0/374447545 wait complete. 2024-08-31T05:27:30.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:30 smithi005 ceph-mon[18602]: osdmap e74: 12 total, 12 up, 12 in 2024-08-31T05:27:30.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:30 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/374447545' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-08-31T05:27:30.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:30 smithi070 ceph-mon[22316]: osdmap e74: 12 total, 12 up, 12 in 2024-08-31T05:27:30.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:30 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/374447545' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-08-31T05:27:30.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:30 smithi050 ceph-mon[22146]: osdmap e74: 12 total, 12 up, 12 in 2024-08-31T05:27:30.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:30 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/374447545' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-08-31T05:27:30.925 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-31T05:27:31.185 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:27:31.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:31 smithi070 ceph-mon[22316]: pgmap v258: 33 pgs: 11 creating+peering, 16 unknown, 6 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:31.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:31 smithi070 ceph-mon[22316]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-31T05:27:31.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:31 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/374447545' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-08-31T05:27:31.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:31 smithi070 ceph-mon[22316]: osdmap e75: 12 total, 12 up, 12 in 2024-08-31T05:27:31.603 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:31 smithi005 ceph-mon[18602]: pgmap v258: 33 pgs: 11 creating+peering, 16 unknown, 6 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:31.603 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:31 smithi005 ceph-mon[18602]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-31T05:27:31.604 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:31 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/374447545' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-08-31T05:27:31.604 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:31 smithi005 ceph-mon[18602]: osdmap e75: 12 total, 12 up, 12 in 2024-08-31T05:27:31.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:31 smithi050 ceph-mon[22146]: pgmap v258: 33 pgs: 11 creating+peering, 16 unknown, 6 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:31.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:31 smithi050 ceph-mon[22146]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-31T05:27:31.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:31 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/374447545' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-08-31T05:27:31.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:31 smithi050 ceph-mon[22146]: osdmap e75: 12 total, 12 up, 12 in 2024-08-31T05:27:31.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:31.695+0000 7f5c61a95640 1 -- 172.21.15.5:0/1314848742 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c5c108a90 msgr2=0x7f5c5c10f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:31.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:31.695+0000 7f5c61a95640 1 --2- 172.21.15.5:0/1314848742 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c5c108a90 0x7f5c5c10f2c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5c54009ca0 tx=0x7f5c5402a8c0 comp rx=0 tx=0).stop 2024-08-31T05:27:31.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:31.695+0000 7f5c61a95640 1 -- 172.21.15.5:0/1314848742 shutdown_connections 2024-08-31T05:27:31.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:31.695+0000 7f5c61a95640 1 --2- 172.21.15.5:0/1314848742 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c5c108a90 0x7f5c5c10f2c0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:31.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:31.695+0000 7f5c61a95640 1 --2- 172.21.15.5:0/1314848742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c5c108140 0x7f5c5c108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:31.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:31.695+0000 7f5c61a95640 1 --2- 172.21.15.5:0/1314848742 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c5c102800 0x7f5c5c102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:31.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:31.695+0000 7f5c61a95640 1 -- 172.21.15.5:0/1314848742 >> 172.21.15.5:0/1314848742 conn(0x7f5c5c0794d0 msgr2=0x7f5c5c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:31.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:31.695+0000 7f5c61a95640 1 -- 172.21.15.5:0/1314848742 shutdown_connections 2024-08-31T05:27:31.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:31.695+0000 7f5c61a95640 1 -- 172.21.15.5:0/1314848742 wait complete. 2024-08-31T05:27:31.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:31.696+0000 7f5c61a95640 1 Processor -- start 2024-08-31T05:27:31.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:31.696+0000 7f5c61a95640 1 -- start start 2024-08-31T05:27:31.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:31.696+0000 7f5c61a95640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c5c102800 0x7f5c5c19b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:31.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:31.696+0000 7f5c61a95640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c5c108140 0x7f5c5c19b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:31.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:31.696+0000 7f5c61a95640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c5c108a90 0x7f5c5c19bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:31.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:31.696+0000 7f5c61a95640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5c5c112710 con 0x7f5c5c102800 2024-08-31T05:27:31.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:31.696+0000 7f5c61a95640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5c5c112590 con 0x7f5c5c108a90 2024-08-31T05:27:31.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:31.696+0000 7f5c61a95640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5c5c112890 con 0x7f5c5c108140 2024-08-31T05:27:31.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:31.696+0000 7f5c5b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c5c102800 0x7f5c5c19b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:31.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:31.696+0000 7f5c5b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c5c102800 0x7f5c5c19b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57044/0 (socket says 172.21.15.5:57044) 2024-08-31T05:27:31.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:31.696+0000 7f5c5b7fe640 1 -- 172.21.15.5:0/1208031840 learned_addr learned my addr 172.21.15.5:0/1208031840 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:27:31.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:31.696+0000 7f5c5affd640 1 --2- 172.21.15.5:0/1208031840 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c5c108140 0x7f5c5c19b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:31.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:31.696+0000 7f5c5b7fe640 1 -- 172.21.15.5:0/1208031840 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c5c108140 msgr2=0x7f5c5c19b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:31.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:31.696+0000 7f5c5bfff640 1 --2- 172.21.15.5:0/1208031840 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c5c108a90 0x7f5c5c19bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:31.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:31.696+0000 7f5c5b7fe640 1 --2- 172.21.15.5:0/1208031840 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c5c108140 0x7f5c5c19b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:31.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:31.696+0000 7f5c5b7fe640 1 -- 172.21.15.5:0/1208031840 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c5c108a90 msgr2=0x7f5c5c19bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:31.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:31.696+0000 7f5c5b7fe640 1 --2- 172.21.15.5:0/1208031840 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c5c108a90 0x7f5c5c19bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:31.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:31.697+0000 7f5c5b7fe640 1 -- 172.21.15.5:0/1208031840 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c5c1a6320 con 0x7f5c5c102800 2024-08-31T05:27:31.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:31.697+0000 7f5c5affd640 1 --2- 172.21.15.5:0/1208031840 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c5c108140 0x7f5c5c19b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:27:31.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:31.697+0000 7f5c5bfff640 1 --2- 172.21.15.5:0/1208031840 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c5c108a90 0x7f5c5c19bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:27:31.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:31.697+0000 7f5c5b7fe640 1 --2- 172.21.15.5:0/1208031840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c5c102800 0x7f5c5c19b120 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c00d770 tx=0x7f5c4c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:31.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:31.697+0000 7f5c58ff9640 1 -- 172.21.15.5:0/1208031840 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c4c017070 con 0x7f5c5c102800 2024-08-31T05:27:31.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:31.697+0000 7f5c61a95640 1 -- 172.21.15.5:0/1208031840 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c5c1a6610 con 0x7f5c5c102800 2024-08-31T05:27:31.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:31.697+0000 7f5c58ff9640 1 -- 172.21.15.5:0/1208031840 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c4c0054d0 con 0x7f5c5c102800 2024-08-31T05:27:31.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:31.697+0000 7f5c58ff9640 1 -- 172.21.15.5:0/1208031840 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c4c004c30 con 0x7f5c5c102800 2024-08-31T05:27:31.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:31.697+0000 7f5c61a95640 1 -- 172.21.15.5:0/1208031840 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c5c1a6b50 con 0x7f5c5c102800 2024-08-31T05:27:31.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:31.698+0000 7f5c61a95640 1 -- 172.21.15.5:0/1208031840 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c5c102c10 con 0x7f5c5c102800 2024-08-31T05:27:31.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:31.699+0000 7f5c58ff9640 1 -- 172.21.15.5:0/1208031840 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f5c4c004dd0 con 0x7f5c5c102800 2024-08-31T05:27:31.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:31.700+0000 7f5c58ff9640 1 --2- 172.21.15.5:0/1208031840 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5c440b4bb0 0x7f5c440b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:31.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:31.701+0000 7f5c5affd640 1 --2- 172.21.15.5:0/1208031840 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5c440b4bb0 0x7f5c440b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:31.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:31.701+0000 7f5c58ff9640 1 -- 172.21.15.5:0/1208031840 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8094+0+0 (secure 0 0 0) 0x7f5c4c0e4c50 con 0x7f5c5c102800 2024-08-31T05:27:31.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:31.701+0000 7f5c5affd640 1 --2- 172.21.15.5:0/1208031840 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5c440b4bb0 0x7f5c440b70c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5c50005e10 tx=0x7f5c50005da0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:31.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:31.705+0000 7f5c58ff9640 1 -- 172.21.15.5:0/1208031840 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5c4c0ea020 con 0x7f5c5c102800 2024-08-31T05:27:31.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:31.927+0000 7f5c61a95640 1 -- 172.21.15.5:0/1208031840 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f5c5c06b010 con 0x7f5c5c102800 2024-08-31T05:27:32.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:32.249+0000 7f5c58ff9640 1 -- 172.21.15.5:0/1208031840 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f5c4c0abe60 con 0x7f5c5c102800 2024-08-31T05:27:32.252 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 2 and data pool 3 2024-08-31T05:27:32.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:32.253+0000 7f5c61a95640 1 -- 172.21.15.5:0/1208031840 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5c440b4bb0 msgr2=0x7f5c440b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:32.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:32.253+0000 7f5c61a95640 1 --2- 172.21.15.5:0/1208031840 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5c440b4bb0 0x7f5c440b70c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5c50005e10 tx=0x7f5c50005da0 comp rx=0 tx=0).stop 2024-08-31T05:27:32.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:32.253+0000 7f5c61a95640 1 -- 172.21.15.5:0/1208031840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c5c102800 msgr2=0x7f5c5c19b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:32.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:32.253+0000 7f5c61a95640 1 --2- 172.21.15.5:0/1208031840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c5c102800 0x7f5c5c19b120 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c00d770 tx=0x7f5c4c00dc30 comp rx=0 tx=0).stop 2024-08-31T05:27:32.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:32.253+0000 7f5c61a95640 1 -- 172.21.15.5:0/1208031840 shutdown_connections 2024-08-31T05:27:32.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:32.253+0000 7f5c61a95640 1 --2- 172.21.15.5:0/1208031840 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5c440b4bb0 0x7f5c440b70c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:32.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:32.253+0000 7f5c61a95640 1 --2- 172.21.15.5:0/1208031840 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c5c108a90 0x7f5c5c19bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:32.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:32.253+0000 7f5c61a95640 1 --2- 172.21.15.5:0/1208031840 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c5c108140 0x7f5c5c19b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:32.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:32.253+0000 7f5c61a95640 1 --2- 172.21.15.5:0/1208031840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c5c102800 0x7f5c5c19b120 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:32.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:32.253+0000 7f5c61a95640 1 -- 172.21.15.5:0/1208031840 >> 172.21.15.5:0/1208031840 conn(0x7f5c5c0794d0 msgr2=0x7f5c5c1041c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:32.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:32.253+0000 7f5c61a95640 1 -- 172.21.15.5:0/1208031840 shutdown_connections 2024-08-31T05:27:32.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:32.253+0000 7f5c61a95640 1 -- 172.21.15.5:0/1208031840 wait complete. 2024-08-31T05:27:32.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:32 smithi070 ceph-mon[22316]: osdmap e76: 12 total, 12 up, 12 in 2024-08-31T05:27:32.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:32 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/1208031840' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-08-31T05:27:32.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:32 smithi070 ceph-mon[22316]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-08-31T05:27:32.618 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:32 smithi005 ceph-mon[18602]: osdmap e76: 12 total, 12 up, 12 in 2024-08-31T05:27:32.618 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:32 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/1208031840' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-08-31T05:27:32.618 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:32 smithi005 ceph-mon[18602]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-08-31T05:27:32.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:32 smithi050 ceph-mon[22146]: osdmap e76: 12 total, 12 up, 12 in 2024-08-31T05:27:32.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:32 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/1208031840' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-08-31T05:27:32.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:32 smithi050 ceph-mon[22146]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-08-31T05:27:32.955 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-08-31T05:27:32.955 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-08-31T05:27:33.210 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:27:33.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:33 smithi070 ceph-mon[22316]: pgmap v261: 97 pgs: 2 creating+activating, 19 creating+peering, 58 unknown, 18 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:33.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:33 smithi070 ceph-mon[22316]: osdmap e77: 12 total, 12 up, 12 in 2024-08-31T05:27:33.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:33 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/1208031840' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-08-31T05:27:33.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:33 smithi070 ceph-mon[22316]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-08-31T05:27:33.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:33 smithi070 ceph-mon[22316]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-08-31T05:27:33.631 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:33 smithi005 ceph-mon[18602]: pgmap v261: 97 pgs: 2 creating+activating, 19 creating+peering, 58 unknown, 18 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:33.631 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:33 smithi005 ceph-mon[18602]: osdmap e77: 12 total, 12 up, 12 in 2024-08-31T05:27:33.631 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:33 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/1208031840' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-08-31T05:27:33.631 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:33 smithi005 ceph-mon[18602]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-08-31T05:27:33.631 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:33 smithi005 ceph-mon[18602]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-08-31T05:27:33.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:33 smithi050 ceph-mon[22146]: pgmap v261: 97 pgs: 2 creating+activating, 19 creating+peering, 58 unknown, 18 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:33.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:33 smithi050 ceph-mon[22146]: osdmap e77: 12 total, 12 up, 12 in 2024-08-31T05:27:33.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:33 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/1208031840' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-08-31T05:27:33.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:33 smithi050 ceph-mon[22146]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-08-31T05:27:33.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:33 smithi050 ceph-mon[22146]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-08-31T05:27:33.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:33.725+0000 7f13baaf7640 1 -- 172.21.15.5:0/732573686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13b4109240 msgr2=0x7f13b4109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:33.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:33.725+0000 7f13baaf7640 1 --2- 172.21.15.5:0/732573686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13b4109240 0x7f13b4109650 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f13a0009900 tx=0x7f13a002a410 comp rx=0 tx=0).stop 2024-08-31T05:27:33.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:33.725+0000 7f13baaf7640 1 -- 172.21.15.5:0/732573686 shutdown_connections 2024-08-31T05:27:33.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:33.725+0000 7f13baaf7640 1 --2- 172.21.15.5:0/732573686 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13b4109b90 0x7f13b41103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:33.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:33.725+0000 7f13baaf7640 1 --2- 172.21.15.5:0/732573686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13b4109240 0x7f13b4109650 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:33.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:33.725+0000 7f13baaf7640 1 --2- 172.21.15.5:0/732573686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13b4103900 0x7f13b4103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:33.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:33.725+0000 7f13baaf7640 1 -- 172.21.15.5:0/732573686 >> 172.21.15.5:0/732573686 conn(0x7f13b407b5f0 msgr2=0x7f13b407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:33.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:33.725+0000 7f13baaf7640 1 -- 172.21.15.5:0/732573686 shutdown_connections 2024-08-31T05:27:33.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:33.725+0000 7f13baaf7640 1 -- 172.21.15.5:0/732573686 wait complete. 2024-08-31T05:27:33.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:33.725+0000 7f13baaf7640 1 Processor -- start 2024-08-31T05:27:33.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:33.725+0000 7f13baaf7640 1 -- start start 2024-08-31T05:27:33.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:33.726+0000 7f13baaf7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13b4103900 0x7f13b40754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:33.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:33.726+0000 7f13baaf7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13b4109240 0x7f13b40759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:33.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:33.726+0000 7f13baaf7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13b4109b90 0x7f13b4075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:33.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:33.726+0000 7f13baaf7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f13b4113850 con 0x7f13b4103900 2024-08-31T05:27:33.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:33.726+0000 7f13baaf7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f13b41136d0 con 0x7f13b4109b90 2024-08-31T05:27:33.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:33.726+0000 7f13baaf7640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f13b41139d0 con 0x7f13b4109240 2024-08-31T05:27:33.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:33.726+0000 7f13b8893640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13b4103900 0x7f13b40754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:33.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:33.726+0000 7f13b8893640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13b4103900 0x7f13b40754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33162/0 (socket says 172.21.15.5:33162) 2024-08-31T05:27:33.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:33.726+0000 7f13b8893640 1 -- 172.21.15.5:0/3666942738 learned_addr learned my addr 172.21.15.5:0/3666942738 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:27:33.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:33.726+0000 7f13b3fff640 1 --2- 172.21.15.5:0/3666942738 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13b4109240 0x7f13b40759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:33.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:33.726+0000 7f13b9094640 1 --2- 172.21.15.5:0/3666942738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13b4109b90 0x7f13b4075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:33.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:33.726+0000 7f13b8893640 1 -- 172.21.15.5:0/3666942738 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13b4109240 msgr2=0x7f13b40759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:33.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:33.726+0000 7f13b8893640 1 --2- 172.21.15.5:0/3666942738 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13b4109240 0x7f13b40759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:33.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:33.726+0000 7f13b8893640 1 -- 172.21.15.5:0/3666942738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13b4109b90 msgr2=0x7f13b4075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:33.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:33.726+0000 7f13b8893640 1 --2- 172.21.15.5:0/3666942738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13b4109b90 0x7f13b4075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:33.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:33.726+0000 7f13b8893640 1 -- 172.21.15.5:0/3666942738 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13b41a84e0 con 0x7f13b4103900 2024-08-31T05:27:33.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:33.726+0000 7f13b9094640 1 --2- 172.21.15.5:0/3666942738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13b4109b90 0x7f13b4075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:27:33.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:33.726+0000 7f13b8893640 1 --2- 172.21.15.5:0/3666942738 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13b4103900 0x7f13b40754b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f13a800d950 tx=0x7f13a800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:33.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:33.726+0000 7f13b1ffb640 1 -- 172.21.15.5:0/3666942738 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a8017070 con 0x7f13b4103900 2024-08-31T05:27:33.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:33.726+0000 7f13baaf7640 1 -- 172.21.15.5:0/3666942738 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13b41a87d0 con 0x7f13b4103900 2024-08-31T05:27:33.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:33.726+0000 7f13b1ffb640 1 -- 172.21.15.5:0/3666942738 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13a8009c30 con 0x7f13b4103900 2024-08-31T05:27:33.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:33.726+0000 7f13b1ffb640 1 -- 172.21.15.5:0/3666942738 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a800f620 con 0x7f13b4103900 2024-08-31T05:27:33.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:33.727+0000 7f13baaf7640 1 -- 172.21.15.5:0/3666942738 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13b41a8ce0 con 0x7f13b4103900 2024-08-31T05:27:33.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:33.728+0000 7f13baaf7640 1 -- 172.21.15.5:0/3666942738 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13b4103d10 con 0x7f13b4103900 2024-08-31T05:27:33.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:33.729+0000 7f13b1ffb640 1 -- 172.21.15.5:0/3666942738 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f13a8010460 con 0x7f13b4103900 2024-08-31T05:27:33.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:33.730+0000 7f13b1ffb640 1 --2- 172.21.15.5:0/3666942738 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f13a40b4b80 0x7f13a40b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:33.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:33.730+0000 7f13b3fff640 1 --2- 172.21.15.5:0/3666942738 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f13a40b4b80 0x7f13a40b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:33.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:33.730+0000 7f13b1ffb640 1 -- 172.21.15.5:0/3666942738 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8194+0+0 (secure 0 0 0) 0x7f13a80e4db0 con 0x7f13b4103900 2024-08-31T05:27:33.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:33.730+0000 7f13b3fff640 1 --2- 172.21.15.5:0/3666942738 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f13a40b4b80 0x7f13a40b7090 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f13a0009230 tx=0x7f13a0031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:33.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:33.733+0000 7f13b1ffb640 1 -- 172.21.15.5:0/3666942738 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f13a80abf00 con 0x7f13b4103900 2024-08-31T05:27:33.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:33.926+0000 7f13baaf7640 1 -- 172.21.15.5:0/3666942738 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f13b402e430 con 0x7f13b4103900 2024-08-31T05:27:34.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:34.265+0000 7f13b1ffb640 1 -- 172.21.15.5:0/3666942738 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v78) ==== 157+0+0 (secure 0 0 0) 0x7f13a8009de0 con 0x7f13b4103900 2024-08-31T05:27:34.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:34.267+0000 7f13baaf7640 1 -- 172.21.15.5:0/3666942738 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f13a40b4b80 msgr2=0x7f13a40b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:34.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:34.267+0000 7f13baaf7640 1 --2- 172.21.15.5:0/3666942738 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f13a40b4b80 0x7f13a40b7090 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f13a0009230 tx=0x7f13a0031400 comp rx=0 tx=0).stop 2024-08-31T05:27:34.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:34.267+0000 7f13baaf7640 1 -- 172.21.15.5:0/3666942738 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13b4103900 msgr2=0x7f13b40754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:34.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:34.267+0000 7f13baaf7640 1 --2- 172.21.15.5:0/3666942738 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13b4103900 0x7f13b40754b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f13a800d950 tx=0x7f13a800de10 comp rx=0 tx=0).stop 2024-08-31T05:27:34.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:34.267+0000 7f13baaf7640 1 -- 172.21.15.5:0/3666942738 shutdown_connections 2024-08-31T05:27:34.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:34.267+0000 7f13baaf7640 1 --2- 172.21.15.5:0/3666942738 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f13a40b4b80 0x7f13a40b7090 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:34.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:34.267+0000 7f13baaf7640 1 --2- 172.21.15.5:0/3666942738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13b4109b90 0x7f13b4075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:34.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:34.267+0000 7f13baaf7640 1 --2- 172.21.15.5:0/3666942738 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13b4109240 0x7f13b40759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:34.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:34.267+0000 7f13baaf7640 1 --2- 172.21.15.5:0/3666942738 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13b4103900 0x7f13b40754b0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:34.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:34.267+0000 7f13baaf7640 1 -- 172.21.15.5:0/3666942738 >> 172.21.15.5:0/3666942738 conn(0x7f13b407b5f0 msgr2=0x7f13b4107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:34.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:34.267+0000 7f13baaf7640 1 -- 172.21.15.5:0/3666942738 shutdown_connections 2024-08-31T05:27:34.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:34.267+0000 7f13baaf7640 1 -- 172.21.15.5:0/3666942738 wait complete. 2024-08-31T05:27:34.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:34 smithi070 ceph-mon[22316]: mds.? [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] up:active 2024-08-31T05:27:34.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:34 smithi070 ceph-mon[22316]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-31T05:27:34.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:34 smithi070 ceph-mon[22316]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-31T05:27:34.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:34 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/3666942738' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-08-31T05:27:34.653 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:34 smithi005 ceph-mon[18602]: mds.? [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] up:active 2024-08-31T05:27:34.653 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:34 smithi005 ceph-mon[18602]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-31T05:27:34.653 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:34 smithi005 ceph-mon[18602]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-31T05:27:34.653 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:34 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/3666942738' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-08-31T05:27:34.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:34 smithi050 ceph-mon[22146]: mds.? [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] up:active 2024-08-31T05:27:34.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:34 smithi050 ceph-mon[22146]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-31T05:27:34.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:34 smithi050 ceph-mon[22146]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-31T05:27:34.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:34 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/3666942738' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-08-31T05:27:34.997 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-08-31T05:27:35.257 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:27:35.536 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:35 smithi005 ceph-mon[18602]: pgmap v263: 97 pgs: 2 creating+activating, 19 creating+peering, 46 unknown, 30 active+clean; 579 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 976 B/s wr, 2 op/s 2024-08-31T05:27:35.537 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:35 smithi005 ceph-mon[18602]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-08-31T05:27:35.537 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:35 smithi005 ceph-mon[18602]: Cluster is now healthy 2024-08-31T05:27:35.537 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:35 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/3666942738' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-08-31T05:27:35.537 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:35 smithi005 ceph-mon[18602]: osdmap e78: 12 total, 12 up, 12 in 2024-08-31T05:27:35.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:35 smithi070 ceph-mon[22316]: pgmap v263: 97 pgs: 2 creating+activating, 19 creating+peering, 46 unknown, 30 active+clean; 579 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 976 B/s wr, 2 op/s 2024-08-31T05:27:35.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:35 smithi070 ceph-mon[22316]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-08-31T05:27:35.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:35 smithi070 ceph-mon[22316]: Cluster is now healthy 2024-08-31T05:27:35.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:35 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/3666942738' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-08-31T05:27:35.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:35 smithi070 ceph-mon[22316]: osdmap e78: 12 total, 12 up, 12 in 2024-08-31T05:27:35.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:35 smithi050 ceph-mon[22146]: pgmap v263: 97 pgs: 2 creating+activating, 19 creating+peering, 46 unknown, 30 active+clean; 579 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 976 B/s wr, 2 op/s 2024-08-31T05:27:35.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:35 smithi050 ceph-mon[22146]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-08-31T05:27:35.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:35 smithi050 ceph-mon[22146]: Cluster is now healthy 2024-08-31T05:27:35.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:35 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/3666942738' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-08-31T05:27:35.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:35 smithi050 ceph-mon[22146]: osdmap e78: 12 total, 12 up, 12 in 2024-08-31T05:27:35.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:35.764+0000 7fd01051f640 1 -- 172.21.15.5:0/552432379 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd008109280 msgr2=0x7fd008109690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:35.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:35.764+0000 7fd01051f640 1 --2- 172.21.15.5:0/552432379 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd008109280 0x7fd008109690 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcff8009900 tx=0x7fcff802a410 comp rx=0 tx=0).stop 2024-08-31T05:27:35.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:35.764+0000 7fd01051f640 1 -- 172.21.15.5:0/552432379 shutdown_connections 2024-08-31T05:27:35.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:35.764+0000 7fd01051f640 1 --2- 172.21.15.5:0/552432379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd008109bd0 0x7fd008110400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:35.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:35.764+0000 7fd01051f640 1 --2- 172.21.15.5:0/552432379 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd008109280 0x7fd008109690 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:35.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:35.764+0000 7fd01051f640 1 --2- 172.21.15.5:0/552432379 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd008103940 0x7fd008103d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:35.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:35.764+0000 7fd01051f640 1 -- 172.21.15.5:0/552432379 >> 172.21.15.5:0/552432379 conn(0x7fd0080ff3b0 msgr2=0x7fd008101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:35.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:35.764+0000 7fd01051f640 1 -- 172.21.15.5:0/552432379 shutdown_connections 2024-08-31T05:27:35.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:35.764+0000 7fd01051f640 1 -- 172.21.15.5:0/552432379 wait complete. 2024-08-31T05:27:35.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:35.764+0000 7fd01051f640 1 Processor -- start 2024-08-31T05:27:35.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:35.764+0000 7fd01051f640 1 -- start start 2024-08-31T05:27:35.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:35.765+0000 7fd01051f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd008103940 0x7fd00819c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:35.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:35.765+0000 7fd01051f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd008109280 0x7fd00819ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:35.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:35.765+0000 7fd01051f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd008109bd0 0x7fd0081a1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:35.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:35.765+0000 7fd01051f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd008113890 con 0x7fd008103940 2024-08-31T05:27:35.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:35.765+0000 7fd01051f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd008113710 con 0x7fd008109bd0 2024-08-31T05:27:35.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:35.765+0000 7fd01051f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd008113a10 con 0x7fd008109280 2024-08-31T05:27:35.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:35.765+0000 7fd00e2bb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd008103940 0x7fd00819c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:35.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:35.765+0000 7fd00e2bb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd008103940 0x7fd00819c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33176/0 (socket says 172.21.15.5:33176) 2024-08-31T05:27:35.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:35.765+0000 7fd00e2bb640 1 -- 172.21.15.5:0/4133510483 learned_addr learned my addr 172.21.15.5:0/4133510483 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:27:35.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:35.765+0000 7fd00eabc640 1 --2- 172.21.15.5:0/4133510483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd008109bd0 0x7fd0081a1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:35.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:35.765+0000 7fd00daba640 1 --2- 172.21.15.5:0/4133510483 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd008109280 0x7fd00819ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:35.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:35.765+0000 7fd00e2bb640 1 -- 172.21.15.5:0/4133510483 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd008109280 msgr2=0x7fd00819ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:35.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:35.765+0000 7fd00e2bb640 1 --2- 172.21.15.5:0/4133510483 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd008109280 0x7fd00819ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:35.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:35.765+0000 7fd00e2bb640 1 -- 172.21.15.5:0/4133510483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd008109bd0 msgr2=0x7fd0081a1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:35.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:35.765+0000 7fd00e2bb640 1 --2- 172.21.15.5:0/4133510483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd008109bd0 0x7fd0081a1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:35.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:35.765+0000 7fd00e2bb640 1 -- 172.21.15.5:0/4133510483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0081a2410 con 0x7fd008103940 2024-08-31T05:27:35.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:35.766+0000 7fd00e2bb640 1 --2- 172.21.15.5:0/4133510483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd008103940 0x7fd00819c4a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd00400d770 tx=0x7fd00400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:35.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:35.766+0000 7fcfff7fe640 1 -- 172.21.15.5:0/4133510483 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd004017070 con 0x7fd008103940 2024-08-31T05:27:35.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:35.766+0000 7fd01051f640 1 -- 172.21.15.5:0/4133510483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0081a2700 con 0x7fd008103940 2024-08-31T05:27:35.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:35.766+0000 7fcfff7fe640 1 -- 172.21.15.5:0/4133510483 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0040054d0 con 0x7fd008103940 2024-08-31T05:27:35.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:35.766+0000 7fcfff7fe640 1 -- 172.21.15.5:0/4133510483 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd004004d00 con 0x7fd008103940 2024-08-31T05:27:35.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:35.766+0000 7fd01051f640 1 -- 172.21.15.5:0/4133510483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0081a8e60 con 0x7fd008103940 2024-08-31T05:27:35.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:35.767+0000 7fd01051f640 1 -- 172.21.15.5:0/4133510483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd008104bc0 con 0x7fd008103940 2024-08-31T05:27:35.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:35.770+0000 7fcfff7fe640 1 -- 172.21.15.5:0/4133510483 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7fd004004ea0 con 0x7fd008103940 2024-08-31T05:27:35.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:35.770+0000 7fcfff7fe640 1 --2- 172.21.15.5:0/4133510483 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fcff40b4b80 0x7fcff40b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:35.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:35.770+0000 7fd00daba640 1 --2- 172.21.15.5:0/4133510483 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fcff40b4b80 0x7fcff40b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:35.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:35.770+0000 7fcfff7fe640 1 -- 172.21.15.5:0/4133510483 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8492+0+0 (secure 0 0 0) 0x7fd0040e5050 con 0x7fd008103940 2024-08-31T05:27:35.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:35.771+0000 7fd00daba640 1 --2- 172.21.15.5:0/4133510483 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fcff40b4b80 0x7fcff40b7090 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcff8009230 tx=0x7fcff8031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:35.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:35.774+0000 7fcfff7fe640 1 -- 172.21.15.5:0/4133510483 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd0040aba30 con 0x7fd008103940 2024-08-31T05:27:35.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:35.963+0000 7fd01051f640 1 -- 172.21.15.5:0/4133510483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fd0081a9090 con 0x7fd008103940 2024-08-31T05:27:36.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:36 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/4133510483' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-08-31T05:27:36.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:36 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/4133510483' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-08-31T05:27:36.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:36 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/4133510483' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-08-31T05:27:37.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:37.266+0000 7fcfff7fe640 1 -- 172.21.15.5:0/4133510483 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v80) ==== 228+0+0 (secure 0 0 0) 0x7fd0040b01f0 con 0x7fd008103940 2024-08-31T05:27:37.269 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data_ec' created 2024-08-31T05:27:37.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:37.269+0000 7fd01051f640 1 -- 172.21.15.5:0/4133510483 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fcff40b4b80 msgr2=0x7fcff40b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:37.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:37.269+0000 7fd01051f640 1 --2- 172.21.15.5:0/4133510483 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fcff40b4b80 0x7fcff40b7090 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcff8009230 tx=0x7fcff8031400 comp rx=0 tx=0).stop 2024-08-31T05:27:37.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:37.269+0000 7fd01051f640 1 -- 172.21.15.5:0/4133510483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd008103940 msgr2=0x7fd00819c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:37.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:37.269+0000 7fd01051f640 1 --2- 172.21.15.5:0/4133510483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd008103940 0x7fd00819c4a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd00400d770 tx=0x7fd00400dc30 comp rx=0 tx=0).stop 2024-08-31T05:27:37.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:37.269+0000 7fd01051f640 1 -- 172.21.15.5:0/4133510483 shutdown_connections 2024-08-31T05:27:37.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:37.269+0000 7fd01051f640 1 --2- 172.21.15.5:0/4133510483 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fcff40b4b80 0x7fcff40b7090 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:37.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:37.269+0000 7fd01051f640 1 --2- 172.21.15.5:0/4133510483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd008109bd0 0x7fd0081a1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:37.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:37.269+0000 7fd01051f640 1 --2- 172.21.15.5:0/4133510483 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd008109280 0x7fd00819ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:37.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:37.269+0000 7fd01051f640 1 --2- 172.21.15.5:0/4133510483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd008103940 0x7fd00819c4a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:37.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:37.269+0000 7fd01051f640 1 -- 172.21.15.5:0/4133510483 >> 172.21.15.5:0/4133510483 conn(0x7fd0080ff3b0 msgr2=0x7fd008106910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:37.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:37.270+0000 7fd01051f640 1 -- 172.21.15.5:0/4133510483 shutdown_connections 2024-08-31T05:27:37.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:37.270+0000 7fd01051f640 1 -- 172.21.15.5:0/4133510483 wait complete. 2024-08-31T05:27:37.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:37 smithi070 ceph-mon[22316]: pgmap v265: 97 pgs: 2 creating+activating, 95 active+clean; 579 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 4 op/s 2024-08-31T05:27:37.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:37 smithi070 ceph-mon[22316]: osdmap e79: 12 total, 12 up, 12 in 2024-08-31T05:27:37.596 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:37 smithi005 ceph-mon[18602]: pgmap v265: 97 pgs: 2 creating+activating, 95 active+clean; 579 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 4 op/s 2024-08-31T05:27:37.596 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:37 smithi005 ceph-mon[18602]: osdmap e79: 12 total, 12 up, 12 in 2024-08-31T05:27:37.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:37 smithi050 ceph-mon[22146]: pgmap v265: 97 pgs: 2 creating+activating, 95 active+clean; 579 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 4 op/s 2024-08-31T05:27:37.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:37 smithi050 ceph-mon[22146]: osdmap e79: 12 total, 12 up, 12 in 2024-08-31T05:27:37.942 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-08-31T05:27:38.196 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:27:38.274 INFO:journalctl@ceph.mds.i.smithi070.stdout:Aug 31 05:27:37 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-i[53824]: 2024-08-31T05:27:37.842+0000 7f9643477640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-31T05:27:38.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:38 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/4133510483' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-08-31T05:27:38.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:38 smithi070 ceph-mon[22316]: osdmap e80: 12 total, 12 up, 12 in 2024-08-31T05:27:38.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:38 smithi070 ceph-mon[22316]: pgmap v268: 129 pgs: 32 unknown, 97 active+clean; 579 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 8 op/s 2024-08-31T05:27:38.595 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:38 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/4133510483' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-08-31T05:27:38.595 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:38 smithi005 ceph-mon[18602]: osdmap e80: 12 total, 12 up, 12 in 2024-08-31T05:27:38.595 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:38 smithi005 ceph-mon[18602]: pgmap v268: 129 pgs: 32 unknown, 97 active+clean; 579 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 8 op/s 2024-08-31T05:27:38.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:38 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/4133510483' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-08-31T05:27:38.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:38 smithi050 ceph-mon[22146]: osdmap e80: 12 total, 12 up, 12 in 2024-08-31T05:27:38.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:38 smithi050 ceph-mon[22146]: pgmap v268: 129 pgs: 32 unknown, 97 active+clean; 579 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 8 op/s 2024-08-31T05:27:38.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:38.689+0000 7f8c66afd640 1 -- 172.21.15.5:0/4074542241 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c60108aa0 msgr2=0x7f8c6010f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:38.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:38.689+0000 7f8c66afd640 1 --2- 172.21.15.5:0/4074542241 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c60108aa0 0x7f8c6010f2d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8c58009ca0 tx=0x7f8c5802a8c0 comp rx=0 tx=0).stop 2024-08-31T05:27:38.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:38.689+0000 7f8c66afd640 1 -- 172.21.15.5:0/4074542241 shutdown_connections 2024-08-31T05:27:38.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:38.689+0000 7f8c66afd640 1 --2- 172.21.15.5:0/4074542241 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c60108aa0 0x7f8c6010f2d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:38.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:38.689+0000 7f8c66afd640 1 --2- 172.21.15.5:0/4074542241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c60108150 0x7f8c60108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:38.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:38.689+0000 7f8c66afd640 1 --2- 172.21.15.5:0/4074542241 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c60102860 0x7f8c60102c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:38.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:38.689+0000 7f8c66afd640 1 -- 172.21.15.5:0/4074542241 >> 172.21.15.5:0/4074542241 conn(0x7f8c600794c0 msgr2=0x7f8c600798d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:38.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:38.689+0000 7f8c66afd640 1 -- 172.21.15.5:0/4074542241 shutdown_connections 2024-08-31T05:27:38.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:38.689+0000 7f8c66afd640 1 -- 172.21.15.5:0/4074542241 wait complete. 2024-08-31T05:27:38.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:38.690+0000 7f8c66afd640 1 Processor -- start 2024-08-31T05:27:38.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:38.690+0000 7f8c66afd640 1 -- start start 2024-08-31T05:27:38.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:38.690+0000 7f8c66afd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c60102860 0x7f8c601990a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:38.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:38.690+0000 7f8c66afd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c60108150 0x7f8c60199640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:38.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:38.690+0000 7f8c66afd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c60108aa0 0x7f8c6019e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:38.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:38.690+0000 7f8c66afd640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8c60112750 con 0x7f8c60108aa0 2024-08-31T05:27:38.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:38.690+0000 7f8c66afd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8c601125d0 con 0x7f8c60102860 2024-08-31T05:27:38.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:38.690+0000 7f8c66afd640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8c601128d0 con 0x7f8c60108150 2024-08-31T05:27:38.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:38.690+0000 7f8c6509a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c60108aa0 0x7f8c6019e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:38.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:38.690+0000 7f8c6509a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c60108aa0 0x7f8c6019e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33202/0 (socket says 172.21.15.5:33202) 2024-08-31T05:27:38.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:38.690+0000 7f8c6509a640 1 -- 172.21.15.5:0/3309834427 learned_addr learned my addr 172.21.15.5:0/3309834427 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:27:38.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:38.690+0000 7f8c64899640 1 --2- 172.21.15.5:0/3309834427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c60102860 0x7f8c601990a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:38.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:38.691+0000 7f8c5ffff640 1 --2- 172.21.15.5:0/3309834427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c60108150 0x7f8c60199640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:38.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:38.691+0000 7f8c6509a640 1 -- 172.21.15.5:0/3309834427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c60108150 msgr2=0x7f8c60199640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:38.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:38.691+0000 7f8c6509a640 1 --2- 172.21.15.5:0/3309834427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c60108150 0x7f8c60199640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:38.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:38.691+0000 7f8c6509a640 1 -- 172.21.15.5:0/3309834427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c60102860 msgr2=0x7f8c601990a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:38.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:38.691+0000 7f8c6509a640 1 --2- 172.21.15.5:0/3309834427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c60102860 0x7f8c601990a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:38.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:38.691+0000 7f8c6509a640 1 -- 172.21.15.5:0/3309834427 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c6019f010 con 0x7f8c60108aa0 2024-08-31T05:27:38.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:38.691+0000 7f8c6509a640 1 --2- 172.21.15.5:0/3309834427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c60108aa0 0x7f8c6019e8e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8c58005cc0 tx=0x7f8c5802f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:38.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:38.691+0000 7f8c5dffb640 1 -- 172.21.15.5:0/3309834427 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c58003bf0 con 0x7f8c60108aa0 2024-08-31T05:27:38.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:38.691+0000 7f8c5dffb640 1 -- 172.21.15.5:0/3309834427 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c58003d90 con 0x7f8c60108aa0 2024-08-31T05:27:38.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:38.691+0000 7f8c66afd640 1 -- 172.21.15.5:0/3309834427 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c6019f2a0 con 0x7f8c60108aa0 2024-08-31T05:27:38.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:38.691+0000 7f8c5dffb640 1 -- 172.21.15.5:0/3309834427 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c5802fbc0 con 0x7f8c60108aa0 2024-08-31T05:27:38.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:38.691+0000 7f8c66afd640 1 -- 172.21.15.5:0/3309834427 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c6006b5c0 con 0x7f8c60108aa0 2024-08-31T05:27:38.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:38.692+0000 7f8c66afd640 1 -- 172.21.15.5:0/3309834427 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c60103a90 con 0x7f8c60108aa0 2024-08-31T05:27:38.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:38.694+0000 7f8c5dffb640 1 -- 172.21.15.5:0/3309834427 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f8c5802fd60 con 0x7f8c60108aa0 2024-08-31T05:27:38.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:38.695+0000 7f8c5dffb640 1 --2- 172.21.15.5:0/3309834427 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f8c500b4b80 0x7f8c500b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:38.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:38.695+0000 7f8c64899640 1 --2- 172.21.15.5:0/3309834427 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f8c500b4b80 0x7f8c500b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:38.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:38.695+0000 7f8c5dffb640 1 -- 172.21.15.5:0/3309834427 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8985+0+0 (secure 0 0 0) 0x7f8c58106b50 con 0x7f8c60108aa0 2024-08-31T05:27:38.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:38.696+0000 7f8c64899640 1 --2- 172.21.15.5:0/3309834427 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f8c500b4b80 0x7f8c500b7090 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8c540058c0 tx=0x7f8c5400a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:38.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:38.699+0000 7f8c5dffb640 1 -- 172.21.15.5:0/3309834427 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8c580cd990 con 0x7f8c60108aa0 2024-08-31T05:27:38.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:38.883+0000 7f8c66afd640 1 -- 172.21.15.5:0/3309834427 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f8c60102c70 con 0x7f8c60108aa0 2024-08-31T05:27:39.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:39.279+0000 7f8c5dffb640 1 -- 172.21.15.5:0/3309834427 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v82) ==== 169+0+0 (secure 0 0 0) 0x7f8c60102c70 con 0x7f8c60108aa0 2024-08-31T05:27:39.281 INFO:teuthology.orchestra.run.smithi005.stderr:set pool 4 allow_ec_overwrites to true 2024-08-31T05:27:39.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:39.281+0000 7f8c66afd640 1 -- 172.21.15.5:0/3309834427 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f8c500b4b80 msgr2=0x7f8c500b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:39.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:39.281+0000 7f8c66afd640 1 --2- 172.21.15.5:0/3309834427 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f8c500b4b80 0x7f8c500b7090 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8c540058c0 tx=0x7f8c5400a2d0 comp rx=0 tx=0).stop 2024-08-31T05:27:39.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:39.281+0000 7f8c66afd640 1 -- 172.21.15.5:0/3309834427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c60108aa0 msgr2=0x7f8c6019e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:39.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:39.281+0000 7f8c66afd640 1 --2- 172.21.15.5:0/3309834427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c60108aa0 0x7f8c6019e8e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8c58005cc0 tx=0x7f8c5802f380 comp rx=0 tx=0).stop 2024-08-31T05:27:39.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:39.281+0000 7f8c66afd640 1 -- 172.21.15.5:0/3309834427 shutdown_connections 2024-08-31T05:27:39.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:39.281+0000 7f8c66afd640 1 --2- 172.21.15.5:0/3309834427 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f8c500b4b80 0x7f8c500b7090 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:39.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:39.281+0000 7f8c66afd640 1 --2- 172.21.15.5:0/3309834427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8c60108aa0 0x7f8c6019e8e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:39.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:39.281+0000 7f8c66afd640 1 --2- 172.21.15.5:0/3309834427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c60108150 0x7f8c60199640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:39.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:39.281+0000 7f8c66afd640 1 --2- 172.21.15.5:0/3309834427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8c60102860 0x7f8c601990a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:39.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:39.281+0000 7f8c66afd640 1 -- 172.21.15.5:0/3309834427 >> 172.21.15.5:0/3309834427 conn(0x7f8c600794c0 msgr2=0x7f8c60106140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:39.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:39.282+0000 7f8c66afd640 1 -- 172.21.15.5:0/3309834427 shutdown_connections 2024-08-31T05:27:39.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:39.282+0000 7f8c66afd640 1 -- 172.21.15.5:0/3309834427 wait complete. 2024-08-31T05:27:39.547 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:39 smithi070 ceph-mon[22316]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-31T05:27:39.547 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:39 smithi070 ceph-mon[22316]: osdmap e81: 12 total, 12 up, 12 in 2024-08-31T05:27:39.547 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:39 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/3309834427' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-08-31T05:27:39.600 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:39 smithi005 ceph-mon[18602]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-31T05:27:39.600 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:39 smithi005 ceph-mon[18602]: osdmap e81: 12 total, 12 up, 12 in 2024-08-31T05:27:39.600 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:39 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/3309834427' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-08-31T05:27:39.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:39 smithi050 ceph-mon[22146]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-31T05:27:39.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:39 smithi050 ceph-mon[22146]: osdmap e81: 12 total, 12 up, 12 in 2024-08-31T05:27:39.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:39 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/3309834427' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-08-31T05:27:39.944 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs add_data_pool cephfs cephfs_data_ec 2024-08-31T05:27:40.206 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:27:40.580 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:40 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/3309834427' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-08-31T05:27:40.580 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:40 smithi005 ceph-mon[18602]: osdmap e82: 12 total, 12 up, 12 in 2024-08-31T05:27:40.580 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:40 smithi005 ceph-mon[18602]: pgmap v271: 129 pgs: 4 creating+peering, 3 unknown, 122 active+clean; 579 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 5 op/s 2024-08-31T05:27:40.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:40 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/3309834427' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-08-31T05:27:40.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:40 smithi070 ceph-mon[22316]: osdmap e82: 12 total, 12 up, 12 in 2024-08-31T05:27:40.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:40 smithi070 ceph-mon[22316]: pgmap v271: 129 pgs: 4 creating+peering, 3 unknown, 122 active+clean; 579 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 5 op/s 2024-08-31T05:27:40.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:40 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/3309834427' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-08-31T05:27:40.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:40 smithi050 ceph-mon[22146]: osdmap e82: 12 total, 12 up, 12 in 2024-08-31T05:27:40.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:40 smithi050 ceph-mon[22146]: pgmap v271: 129 pgs: 4 creating+peering, 3 unknown, 122 active+clean; 579 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 5 op/s 2024-08-31T05:27:40.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:40.670+0000 7f497da88640 1 -- 172.21.15.5:0/966544508 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4978102880 msgr2=0x7f4978102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:40.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:40.670+0000 7f497da88640 1 --2- 172.21.15.5:0/966544508 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4978102880 0x7f4978102c90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4968009900 tx=0x7f496802a410 comp rx=0 tx=0).stop 2024-08-31T05:27:40.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:40.671+0000 7f497da88640 1 -- 172.21.15.5:0/966544508 shutdown_connections 2024-08-31T05:27:40.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:40.671+0000 7f497da88640 1 --2- 172.21.15.5:0/966544508 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4978108ac0 0x7f497810f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:40.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:40.671+0000 7f497da88640 1 --2- 172.21.15.5:0/966544508 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4978108170 0x7f4978108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:40.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:40.671+0000 7f497da88640 1 --2- 172.21.15.5:0/966544508 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4978102880 0x7f4978102c90 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:40.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:40.671+0000 7f497da88640 1 -- 172.21.15.5:0/966544508 >> 172.21.15.5:0/966544508 conn(0x7f4978079530 msgr2=0x7f4978079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:40.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:40.671+0000 7f497da88640 1 -- 172.21.15.5:0/966544508 shutdown_connections 2024-08-31T05:27:40.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:40.671+0000 7f497da88640 1 -- 172.21.15.5:0/966544508 wait complete. 2024-08-31T05:27:40.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:40.671+0000 7f497da88640 1 Processor -- start 2024-08-31T05:27:40.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:40.672+0000 7f497da88640 1 -- start start 2024-08-31T05:27:40.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:40.672+0000 7f497da88640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4978102880 0x7f49781991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:40.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:40.672+0000 7f497da88640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4978108170 0x7f4978199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:40.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:40.672+0000 7f497da88640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4978108ac0 0x7f497819e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:40.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:40.672+0000 7f497da88640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4978112790 con 0x7f4978108170 2024-08-31T05:27:40.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:40.672+0000 7f497da88640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4978112610 con 0x7f4978102880 2024-08-31T05:27:40.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:40.672+0000 7f497da88640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4978112910 con 0x7f4978108ac0 2024-08-31T05:27:40.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:40.672+0000 7f4976ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4978108170 0x7f4978199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:40.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:40.672+0000 7f4976ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4978108170 0x7f4978199740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33218/0 (socket says 172.21.15.5:33218) 2024-08-31T05:27:40.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:40.672+0000 7f4976ffd640 1 -- 172.21.15.5:0/2223487219 learned_addr learned my addr 172.21.15.5:0/2223487219 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:27:40.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:40.672+0000 7f4977fff640 1 --2- 172.21.15.5:0/2223487219 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4978108ac0 0x7f497819e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:40.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:40.672+0000 7f49777fe640 1 --2- 172.21.15.5:0/2223487219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4978102880 0x7f49781991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:40.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:40.672+0000 7f4976ffd640 1 -- 172.21.15.5:0/2223487219 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4978108ac0 msgr2=0x7f497819e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:40.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:40.672+0000 7f4976ffd640 1 --2- 172.21.15.5:0/2223487219 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4978108ac0 0x7f497819e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:40.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:40.672+0000 7f4976ffd640 1 -- 172.21.15.5:0/2223487219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4978102880 msgr2=0x7f49781991a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:40.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:40.672+0000 7f4976ffd640 1 --2- 172.21.15.5:0/2223487219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4978102880 0x7f49781991a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:40.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:40.672+0000 7f4976ffd640 1 -- 172.21.15.5:0/2223487219 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f497819f110 con 0x7f4978108170 2024-08-31T05:27:40.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:40.672+0000 7f49777fe640 1 --2- 172.21.15.5:0/2223487219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4978102880 0x7f49781991a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:27:40.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:40.673+0000 7f4976ffd640 1 --2- 172.21.15.5:0/2223487219 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4978108170 0x7f4978199740 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f496c00d750 tx=0x7f496c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:40.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:40.673+0000 7f4974ff9640 1 -- 172.21.15.5:0/2223487219 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f496c017070 con 0x7f4978108170 2024-08-31T05:27:40.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:40.673+0000 7f497da88640 1 -- 172.21.15.5:0/2223487219 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f497819f400 con 0x7f4978108170 2024-08-31T05:27:40.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:40.673+0000 7f4974ff9640 1 -- 172.21.15.5:0/2223487219 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f496c0054d0 con 0x7f4978108170 2024-08-31T05:27:40.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:40.673+0000 7f4974ff9640 1 -- 172.21.15.5:0/2223487219 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f496c004c30 con 0x7f4978108170 2024-08-31T05:27:40.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:40.673+0000 7f497da88640 1 -- 172.21.15.5:0/2223487219 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49781a5b60 con 0x7f4978108170 2024-08-31T05:27:40.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:40.674+0000 7f497da88640 1 -- 172.21.15.5:0/2223487219 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4978103ab0 con 0x7f4978108170 2024-08-31T05:27:40.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:40.675+0000 7f4974ff9640 1 -- 172.21.15.5:0/2223487219 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f496c004dd0 con 0x7f4978108170 2024-08-31T05:27:40.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:40.676+0000 7f4974ff9640 1 --2- 172.21.15.5:0/2223487219 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f49600b4b80 0x7f49600b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:40.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:40.676+0000 7f49777fe640 1 --2- 172.21.15.5:0/2223487219 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f49600b4b80 0x7f49600b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:40.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:40.676+0000 7f4974ff9640 1 -- 172.21.15.5:0/2223487219 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8985+0+0 (secure 0 0 0) 0x7f496c0e52a0 con 0x7f4978108170 2024-08-31T05:27:40.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:40.676+0000 7f49777fe640 1 --2- 172.21.15.5:0/2223487219 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f49600b4b80 0x7f49600b7090 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4968031440 tx=0x7f4968009680 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:40.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:40.679+0000 7f4974ff9640 1 -- 172.21.15.5:0/2223487219 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f496c0ac0e0 con 0x7f4978108170 2024-08-31T05:27:40.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:40.902+0000 7f497da88640 1 -- 172.21.15.5:0/2223487219 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f497819a2d0 con 0x7f4978108170 2024-08-31T05:27:41.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:41.292+0000 7f4974ff9640 1 -- 172.21.15.5:0/2223487219 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) ==== 137+0+0 (secure 0 0 0) 0x7f496c0ab9e0 con 0x7f4978108170 2024-08-31T05:27:41.294 INFO:teuthology.orchestra.run.smithi005.stderr:added data pool 4 to fsmap 2024-08-31T05:27:41.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:41.294+0000 7f497da88640 1 -- 172.21.15.5:0/2223487219 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f49600b4b80 msgr2=0x7f49600b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:41.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:41.294+0000 7f497da88640 1 --2- 172.21.15.5:0/2223487219 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f49600b4b80 0x7f49600b7090 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4968031440 tx=0x7f4968009680 comp rx=0 tx=0).stop 2024-08-31T05:27:41.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:41.294+0000 7f497da88640 1 -- 172.21.15.5:0/2223487219 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4978108170 msgr2=0x7f4978199740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:41.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:41.294+0000 7f497da88640 1 --2- 172.21.15.5:0/2223487219 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4978108170 0x7f4978199740 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f496c00d750 tx=0x7f496c00dc10 comp rx=0 tx=0).stop 2024-08-31T05:27:41.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:41.294+0000 7f497da88640 1 -- 172.21.15.5:0/2223487219 shutdown_connections 2024-08-31T05:27:41.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:41.294+0000 7f497da88640 1 --2- 172.21.15.5:0/2223487219 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f49600b4b80 0x7f49600b7090 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:41.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:41.294+0000 7f497da88640 1 --2- 172.21.15.5:0/2223487219 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4978108ac0 0x7f497819e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:41.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:41.294+0000 7f497da88640 1 --2- 172.21.15.5:0/2223487219 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4978108170 0x7f4978199740 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:41.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:41.294+0000 7f497da88640 1 --2- 172.21.15.5:0/2223487219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4978102880 0x7f49781991a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:41.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:41.294+0000 7f497da88640 1 -- 172.21.15.5:0/2223487219 >> 172.21.15.5:0/2223487219 conn(0x7f4978079530 msgr2=0x7f49781062c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:41.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:41.295+0000 7f497da88640 1 -- 172.21.15.5:0/2223487219 shutdown_connections 2024-08-31T05:27:41.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:41.295+0000 7f497da88640 1 -- 172.21.15.5:0/2223487219 wait complete. 2024-08-31T05:27:41.558 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:41 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/2223487219' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-08-31T05:27:41.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:41 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/2223487219' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-08-31T05:27:41.668 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:41 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/2223487219' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-08-31T05:27:42.001 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T05:27:42.255 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:27:42.545 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:42 smithi005 ceph-mon[18602]: osdmap e83: 12 total, 12 up, 12 in 2024-08-31T05:27:42.545 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:42 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/2223487219' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-08-31T05:27:42.545 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:42 smithi005 ceph-mon[18602]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-31T05:27:42.545 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:42 smithi005 ceph-mon[18602]: pgmap v273: 129 pgs: 4 creating+peering, 125 active+clean; 579 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-08-31T05:27:42.573 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:42 smithi050 ceph-mon[22146]: osdmap e83: 12 total, 12 up, 12 in 2024-08-31T05:27:42.573 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:42 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/2223487219' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-08-31T05:27:42.573 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:42 smithi050 ceph-mon[22146]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-31T05:27:42.573 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:42 smithi050 ceph-mon[22146]: pgmap v273: 129 pgs: 4 creating+peering, 125 active+clean; 579 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-08-31T05:27:42.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:42 smithi070 ceph-mon[22316]: osdmap e83: 12 total, 12 up, 12 in 2024-08-31T05:27:42.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:42 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/2223487219' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-08-31T05:27:42.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:42 smithi070 ceph-mon[22316]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-31T05:27:42.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:42 smithi070 ceph-mon[22316]: pgmap v273: 129 pgs: 4 creating+peering, 125 active+clean; 579 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-08-31T05:27:42.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.746+0000 7f624deda640 1 -- 172.21.15.5:0/735402701 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6248109240 msgr2=0x7f6248109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:42.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.746+0000 7f624deda640 1 --2- 172.21.15.5:0/735402701 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6248109240 0x7f6248109650 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f623c009900 tx=0x7f623c02a410 comp rx=0 tx=0).stop 2024-08-31T05:27:42.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.746+0000 7f624deda640 1 -- 172.21.15.5:0/735402701 shutdown_connections 2024-08-31T05:27:42.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.746+0000 7f624deda640 1 --2- 172.21.15.5:0/735402701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6248109b90 0x7f62481103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:42.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.746+0000 7f624deda640 1 --2- 172.21.15.5:0/735402701 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6248109240 0x7f6248109650 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:42.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.746+0000 7f624deda640 1 --2- 172.21.15.5:0/735402701 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6248103900 0x7f6248103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:42.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.746+0000 7f624deda640 1 -- 172.21.15.5:0/735402701 >> 172.21.15.5:0/735402701 conn(0x7f624807b5f0 msgr2=0x7f624807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:42.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.746+0000 7f624deda640 1 -- 172.21.15.5:0/735402701 shutdown_connections 2024-08-31T05:27:42.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.746+0000 7f624deda640 1 -- 172.21.15.5:0/735402701 wait complete. 2024-08-31T05:27:42.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.746+0000 7f624deda640 1 Processor -- start 2024-08-31T05:27:42.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.747+0000 7f624deda640 1 -- start start 2024-08-31T05:27:42.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.747+0000 7f624deda640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6248103900 0x7f624819a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:42.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.747+0000 7f624deda640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6248109240 0x7f624819a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:42.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.747+0000 7f624deda640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6248109b90 0x7f624819fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:42.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.747+0000 7f624deda640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6248113850 con 0x7f6248103900 2024-08-31T05:27:42.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.747+0000 7f624deda640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f62481136d0 con 0x7f6248109240 2024-08-31T05:27:42.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.747+0000 7f624deda640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f62481139d0 con 0x7f6248109b90 2024-08-31T05:27:42.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.747+0000 7f62477fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6248103900 0x7f624819a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:42.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.747+0000 7f62477fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6248103900 0x7f624819a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41144/0 (socket says 172.21.15.5:41144) 2024-08-31T05:27:42.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.747+0000 7f62477fe640 1 -- 172.21.15.5:0/116342240 learned_addr learned my addr 172.21.15.5:0/116342240 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:27:42.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.747+0000 7f6246ffd640 1 --2- 172.21.15.5:0/116342240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6248109240 0x7f624819a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:42.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.747+0000 7f6247fff640 1 --2- 172.21.15.5:0/116342240 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6248109b90 0x7f624819fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:42.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.747+0000 7f62477fe640 1 -- 172.21.15.5:0/116342240 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6248109b90 msgr2=0x7f624819fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:42.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.747+0000 7f62477fe640 1 --2- 172.21.15.5:0/116342240 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6248109b90 0x7f624819fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:42.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.747+0000 7f62477fe640 1 -- 172.21.15.5:0/116342240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6248109240 msgr2=0x7f624819a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:42.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.747+0000 7f62477fe640 1 --2- 172.21.15.5:0/116342240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6248109240 0x7f624819a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:42.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.747+0000 7f62477fe640 1 -- 172.21.15.5:0/116342240 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62481a01b0 con 0x7f6248103900 2024-08-31T05:27:42.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.747+0000 7f6246ffd640 1 --2- 172.21.15.5:0/116342240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6248109240 0x7f624819a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:27:42.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.748+0000 7f62477fe640 1 --2- 172.21.15.5:0/116342240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6248103900 0x7f624819a240 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f623800d770 tx=0x7f623800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:42.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.748+0000 7f6244ff9640 1 -- 172.21.15.5:0/116342240 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6238017070 con 0x7f6248103900 2024-08-31T05:27:42.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.748+0000 7f624deda640 1 -- 172.21.15.5:0/116342240 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62481a04a0 con 0x7f6248103900 2024-08-31T05:27:42.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.748+0000 7f6244ff9640 1 -- 172.21.15.5:0/116342240 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62380054d0 con 0x7f6248103900 2024-08-31T05:27:42.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.748+0000 7f624deda640 1 -- 172.21.15.5:0/116342240 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62481a6c00 con 0x7f6248103900 2024-08-31T05:27:42.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.748+0000 7f6244ff9640 1 -- 172.21.15.5:0/116342240 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6238004c30 con 0x7f6248103900 2024-08-31T05:27:42.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.749+0000 7f624deda640 1 -- 172.21.15.5:0/116342240 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6248104b80 con 0x7f6248103900 2024-08-31T05:27:42.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.750+0000 7f6244ff9640 1 -- 172.21.15.5:0/116342240 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f6238010460 con 0x7f6248103900 2024-08-31T05:27:42.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.751+0000 7f6244ff9640 1 --2- 172.21.15.5:0/116342240 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f62300b4b80 0x7f62300b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:42.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.751+0000 7f6246ffd640 1 --2- 172.21.15.5:0/116342240 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f62300b4b80 0x7f62300b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:42.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.751+0000 7f6244ff9640 1 -- 172.21.15.5:0/116342240 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9017+0+0 (secure 0 0 0) 0x7f62380e4f90 con 0x7f6248103900 2024-08-31T05:27:42.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.752+0000 7f6246ffd640 1 --2- 172.21.15.5:0/116342240 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f62300b4b80 0x7f62300b7090 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f623c009230 tx=0x7f623c031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:42.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.756+0000 7f6244ff9640 1 -- 172.21.15.5:0/116342240 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f62380ab700 con 0x7f6248103900 2024-08-31T05:27:42.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.977+0000 7f624deda640 1 -- 172.21.15.5:0/116342240 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6248103d10 con 0x7f6248103900 2024-08-31T05:27:42.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.977+0000 7f6244ff9640 1 -- 172.21.15.5:0/116342240 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11806 (secure 0 0 0) 0x7f62380a5e20 con 0x7f6248103900 2024-08-31T05:27:42.980 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:27:42.980 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":17,"btime":"2024-08-31T05:27:41:285936+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14739,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2024812199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2024812199},{"type":"v1","addr":"172.21.15.5:6835","nonce":2024812199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3629023702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3629023702},{"type":"v1","addr":"172.21.15.5:6837","nonce":3629023702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14808,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6839/2412701258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":2412701258},{"type":"v1","addr":"172.21.15.5:6839","nonce":2412701258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6841/747057838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":747057838},{"type":"v1","addr":"172.21.15.5:6841","nonce":747057838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24560,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1153378982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1153378982},{"type":"v1","addr":"172.21.15.50:6833","nonce":1153378982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6833/364083443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":364083443},{"type":"v1","addr":"172.21.15.70:6833","nonce":364083443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24587,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2346896794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2346896794},{"type":"v1","addr":"172.21.15.50:6835","nonce":2346896794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24602,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/428759669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":428759669},{"type":"v1","addr":"172.21.15.50:6837","nonce":428759669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24625,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2061504114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2061504114},{"type":"v1","addr":"172.21.15.70:6835","nonce":2061504114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24631,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2780036414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2780036414},{"type":"v1","addr":"172.21.15.70:6837","nonce":2780036414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24638,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/98200944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":98200944},{"type":"v1","addr":"172.21.15.50:6839","nonce":98200944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T05:27:31.929153+0000","modified":"2024-08-31T05:27:40.904002+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24652":{"gid":24652,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.70:6839/2756569250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":2756569250},{"type":"v1","addr":"172.21.15.70:6839","nonce":2756569250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24652,"qdb_cluster":[24652]},"id":1}]} 2024-08-31T05:27:42.980 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 17 2024-08-31T05:27:42.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.979+0000 7f624deda640 1 -- 172.21.15.5:0/116342240 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f62300b4b80 msgr2=0x7f62300b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:42.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.979+0000 7f624deda640 1 --2- 172.21.15.5:0/116342240 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f62300b4b80 0x7f62300b7090 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f623c009230 tx=0x7f623c031400 comp rx=0 tx=0).stop 2024-08-31T05:27:42.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.980+0000 7f624deda640 1 -- 172.21.15.5:0/116342240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6248103900 msgr2=0x7f624819a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:42.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.980+0000 7f624deda640 1 --2- 172.21.15.5:0/116342240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6248103900 0x7f624819a240 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f623800d770 tx=0x7f623800dc30 comp rx=0 tx=0).stop 2024-08-31T05:27:42.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.980+0000 7f624deda640 1 -- 172.21.15.5:0/116342240 shutdown_connections 2024-08-31T05:27:42.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.980+0000 7f624deda640 1 --2- 172.21.15.5:0/116342240 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f62300b4b80 0x7f62300b7090 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:42.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.980+0000 7f624deda640 1 --2- 172.21.15.5:0/116342240 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6248109b90 0x7f624819fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:42.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.980+0000 7f624deda640 1 --2- 172.21.15.5:0/116342240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6248109240 0x7f624819a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:42.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.980+0000 7f624deda640 1 --2- 172.21.15.5:0/116342240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6248103900 0x7f624819a240 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:42.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.980+0000 7f624deda640 1 -- 172.21.15.5:0/116342240 >> 172.21.15.5:0/116342240 conn(0x7f624807b5f0 msgr2=0x7f6248107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:42.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.980+0000 7f624deda640 1 -- 172.21.15.5:0/116342240 shutdown_connections 2024-08-31T05:27:42.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:42.980+0000 7f624deda640 1 -- 172.21.15.5:0/116342240 wait complete. 2024-08-31T05:27:43.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:43 smithi070 ceph-mon[22316]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-08-31T05:27:43.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:43 smithi070 ceph-mon[22316]: Cluster is now healthy 2024-08-31T05:27:43.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:43 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/116342240' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:27:43.605 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:43 smithi005 ceph-mon[18602]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-08-31T05:27:43.606 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:43 smithi005 ceph-mon[18602]: Cluster is now healthy 2024-08-31T05:27:43.606 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:43 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/116342240' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:27:43.636 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T05:27:43.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:43 smithi050 ceph-mon[22146]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-08-31T05:27:43.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:43 smithi050 ceph-mon[22146]: Cluster is now healthy 2024-08-31T05:27:43.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:43 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/116342240' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:27:43.889 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:27:44.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:44.383+0000 7f461046a640 1 -- 172.21.15.5:0/2354655666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4608108140 msgr2=0x7f4608108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:44.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:44.383+0000 7f461046a640 1 --2- 172.21.15.5:0/2354655666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4608108140 0x7f4608108550 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f45f8009900 tx=0x7f45f802a410 comp rx=0 tx=0).stop 2024-08-31T05:27:44.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:44.383+0000 7f461046a640 1 -- 172.21.15.5:0/2354655666 shutdown_connections 2024-08-31T05:27:44.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:44.383+0000 7f461046a640 1 --2- 172.21.15.5:0/2354655666 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4608108a90 0x7f460810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:44.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:44.383+0000 7f461046a640 1 --2- 172.21.15.5:0/2354655666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4608108140 0x7f4608108550 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:44.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:44.383+0000 7f461046a640 1 --2- 172.21.15.5:0/2354655666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4608102800 0x7f4608102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:44.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:44.383+0000 7f461046a640 1 -- 172.21.15.5:0/2354655666 >> 172.21.15.5:0/2354655666 conn(0x7f46080794d0 msgr2=0x7f46080798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:44.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:44.383+0000 7f461046a640 1 -- 172.21.15.5:0/2354655666 shutdown_connections 2024-08-31T05:27:44.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:44.383+0000 7f461046a640 1 -- 172.21.15.5:0/2354655666 wait complete. 2024-08-31T05:27:44.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:44.384+0000 7f461046a640 1 Processor -- start 2024-08-31T05:27:44.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:44.384+0000 7f461046a640 1 -- start start 2024-08-31T05:27:44.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:44.384+0000 7f461046a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4608102800 0x7f46081990f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:44.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:44.384+0000 7f461046a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4608108140 0x7f4608199690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:44.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:44.384+0000 7f461046a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4608108a90 0x7f460819e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:44.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:44.384+0000 7f461046a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f46081126e0 con 0x7f4608102800 2024-08-31T05:27:44.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:44.384+0000 7f461046a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4608112560 con 0x7f4608108a90 2024-08-31T05:27:44.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:44.384+0000 7f461046a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4608112860 con 0x7f4608108140 2024-08-31T05:27:44.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:44.384+0000 7f460e206640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4608102800 0x7f46081990f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:44.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:44.384+0000 7f460e206640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4608102800 0x7f46081990f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41174/0 (socket says 172.21.15.5:41174) 2024-08-31T05:27:44.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:44.384+0000 7f460e206640 1 -- 172.21.15.5:0/2663358346 learned_addr learned my addr 172.21.15.5:0/2663358346 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:27:44.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:44.384+0000 7f460ea07640 1 --2- 172.21.15.5:0/2663358346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4608108a90 0x7f460819e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:44.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:44.384+0000 7f460da05640 1 --2- 172.21.15.5:0/2663358346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4608108140 0x7f4608199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:44.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:44.385+0000 7f460e206640 1 -- 172.21.15.5:0/2663358346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4608108140 msgr2=0x7f4608199690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:44.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:44.385+0000 7f460e206640 1 --2- 172.21.15.5:0/2663358346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4608108140 0x7f4608199690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:44.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:44.385+0000 7f460e206640 1 -- 172.21.15.5:0/2663358346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4608108a90 msgr2=0x7f460819e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:44.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:44.385+0000 7f460e206640 1 --2- 172.21.15.5:0/2663358346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4608108a90 0x7f460819e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:44.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:44.385+0000 7f460e206640 1 -- 172.21.15.5:0/2663358346 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f460819efa0 con 0x7f4608102800 2024-08-31T05:27:44.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:44.385+0000 7f460e206640 1 --2- 172.21.15.5:0/2663358346 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4608102800 0x7f46081990f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f460400c920 tx=0x7f460400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:44.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:44.385+0000 7f45ff7fe640 1 -- 172.21.15.5:0/2663358346 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4604007c70 con 0x7f4608102800 2024-08-31T05:27:44.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:44.385+0000 7f45ff7fe640 1 -- 172.21.15.5:0/2663358346 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4604007e10 con 0x7f4608102800 2024-08-31T05:27:44.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:44.385+0000 7f461046a640 1 -- 172.21.15.5:0/2663358346 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f460819f290 con 0x7f4608102800 2024-08-31T05:27:44.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:44.385+0000 7f45ff7fe640 1 -- 172.21.15.5:0/2663358346 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4604018820 con 0x7f4608102800 2024-08-31T05:27:44.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:44.385+0000 7f461046a640 1 -- 172.21.15.5:0/2663358346 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46081a5ab0 con 0x7f4608102800 2024-08-31T05:27:44.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:44.386+0000 7f461046a640 1 -- 172.21.15.5:0/2663358346 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4608102c10 con 0x7f4608102800 2024-08-31T05:27:44.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:44.388+0000 7f45ff7fe640 1 -- 172.21.15.5:0/2663358346 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f460400f450 con 0x7f4608102800 2024-08-31T05:27:44.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:44.388+0000 7f45ff7fe640 1 --2- 172.21.15.5:0/2663358346 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f45f40b4bb0 0x7f45f40b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:44.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:44.388+0000 7f460da05640 1 --2- 172.21.15.5:0/2663358346 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f45f40b4bb0 0x7f45f40b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:44.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:44.388+0000 7f45ff7fe640 1 -- 172.21.15.5:0/2663358346 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9017+0+0 (secure 0 0 0) 0x7f46040e5510 con 0x7f4608102800 2024-08-31T05:27:44.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:44.389+0000 7f460da05640 1 --2- 172.21.15.5:0/2663358346 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f45f40b4bb0 0x7f45f40b70c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f45f8000c00 tx=0x7f45f8031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:44.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:44.393+0000 7f45ff7fe640 1 -- 172.21.15.5:0/2663358346 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4604014030 con 0x7f4608102800 2024-08-31T05:27:44.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:44.578+0000 7f461046a640 1 -- 172.21.15.5:0/2663358346 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f460819a220 con 0x7f4608102800 2024-08-31T05:27:44.581 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:44 smithi005 ceph-mon[18602]: pgmap v274: 129 pgs: 129 active+clean; 579 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-08-31T05:27:44.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:44.580+0000 7f45ff7fe640 1 -- 172.21.15.5:0/2663358346 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+24407 (secure 0 0 0) 0x7f46040ac330 con 0x7f4608102800 2024-08-31T05:27:44.583 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:27:44.583 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":83,"fsid":"69422704-6758-11ef-bcd4-c7b262605968","created":"2024-08-31T05:19:04.860258+0000","modified":"2024-08-31T05:27:40.903838+0000","last_up_change":"2024-08-31T05:26:38.675914+0000","last_in_change":"2024-08-31T05:26:15.366713+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T05:22:49.802575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T05:27:27.835197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T05:27:30.058144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-31T05:27:36.272228+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c5745391-e9d7-4799-9db9-6b34bb91b7df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6803","nonce":2312496244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6805","nonce":2312496244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6809","nonce":2312496244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6807","nonce":2312496244}]},"public_addr":"172.21.15.5:6803/2312496244","cluster_addr":"172.21.15.5:6805/2312496244","heartbeat_back_addr":"172.21.15.5:6809/2312496244","heartbeat_front_addr":"172.21.15.5:6807/2312496244","state":["exists","up"]},{"osd":1,"uuid":"f1903bd7-b2c5-424e-a74e-795f729471db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6801","nonce":2777359361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6803","nonce":2777359361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6807","nonce":2777359361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6805","nonce":2777359361}]},"public_addr":"172.21.15.50:6801/2777359361","cluster_addr":"172.21.15.50:6803/2777359361","heartbeat_back_addr":"172.21.15.50:6807/2777359361","heartbeat_front_addr":"172.21.15.50:6805/2777359361","state":["exists","up"]},{"osd":2,"uuid":"134c5892-e44a-44f2-8cd2-484d22a45e2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6801","nonce":1400583716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6803","nonce":1400583716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6807","nonce":1400583716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6805","nonce":1400583716}]},"public_addr":"172.21.15.70:6801/1400583716","cluster_addr":"172.21.15.70:6803/1400583716","heartbeat_back_addr":"172.21.15.70:6807/1400583716","heartbeat_front_addr":"172.21.15.70:6805/1400583716","state":["exists","up"]},{"osd":3,"uuid":"af49398a-e171-496b-a50e-1f767fc42923","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6811","nonce":1647468379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6813","nonce":1647468379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6817","nonce":1647468379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6815","nonce":1647468379}]},"public_addr":"172.21.15.5:6811/1647468379","cluster_addr":"172.21.15.5:6813/1647468379","heartbeat_back_addr":"172.21.15.5:6817/1647468379","heartbeat_front_addr":"172.21.15.5:6815/1647468379","state":["exists","up"]},{"osd":4,"uuid":"59b847ef-6eb0-4c13-aa06-53a76d77ce45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6809","nonce":2314546877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6811","nonce":2314546877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6815","nonce":2314546877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6813","nonce":2314546877}]},"public_addr":"172.21.15.50:6809/2314546877","cluster_addr":"172.21.15.50:6811/2314546877","heartbeat_back_addr":"172.21.15.50:6815/2314546877","heartbeat_front_addr":"172.21.15.50:6813/2314546877","state":["exists","up"]},{"osd":5,"uuid":"b0dac185-4462-4760-aa36-0d221923b007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6809","nonce":311426299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6811","nonce":311426299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6815","nonce":311426299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6813","nonce":311426299}]},"public_addr":"172.21.15.70:6809/311426299","cluster_addr":"172.21.15.70:6811/311426299","heartbeat_back_addr":"172.21.15.70:6815/311426299","heartbeat_front_addr":"172.21.15.70:6813/311426299","state":["exists","up"]},{"osd":6,"uuid":"12486aa2-61e4-4bdf-94dd-ce5c4cd3df6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6819","nonce":1027645612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6821","nonce":1027645612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6825","nonce":1027645612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6823","nonce":1027645612}]},"public_addr":"172.21.15.5:6819/1027645612","cluster_addr":"172.21.15.5:6821/1027645612","heartbeat_back_addr":"172.21.15.5:6825/1027645612","heartbeat_front_addr":"172.21.15.5:6823/1027645612","state":["exists","up"]},{"osd":7,"uuid":"66f9dcf9-d5c3-4016-812f-d9496e9892d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6817","nonce":2718354517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6819","nonce":2718354517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6823","nonce":2718354517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6821","nonce":2718354517}]},"public_addr":"172.21.15.50:6817/2718354517","cluster_addr":"172.21.15.50:6819/2718354517","heartbeat_back_addr":"172.21.15.50:6823/2718354517","heartbeat_front_addr":"172.21.15.50:6821/2718354517","state":["exists","up"]},{"osd":8,"uuid":"584837f9-af4b-4189-a7e5-04156a94a805","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6817","nonce":3155722993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6819","nonce":3155722993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6823","nonce":3155722993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6821","nonce":3155722993}]},"public_addr":"172.21.15.70:6817/3155722993","cluster_addr":"172.21.15.70:6819/3155722993","heartbeat_back_addr":"172.21.15.70:6823/3155722993","heartbeat_front_addr":"172.21.15.70:6821/3155722993","state":["exists","up"]},{"osd":9,"uuid":"ef60de6e-3456-435c-bd48-ed2636cc0d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6827","nonce":2988145512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6829","nonce":2988145512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6833","nonce":2988145512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6831","nonce":2988145512}]},"public_addr":"172.21.15.5:6827/2988145512","cluster_addr":"172.21.15.5:6829/2988145512","heartbeat_back_addr":"172.21.15.5:6833/2988145512","heartbeat_front_addr":"172.21.15.5:6831/2988145512","state":["exists","up"]},{"osd":10,"uuid":"96c5de40-53df-412d-9501-8ce1711a76a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6825","nonce":4168871229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6827","nonce":4168871229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6831","nonce":4168871229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6829","nonce":4168871229}]},"public_addr":"172.21.15.50:6825/4168871229","cluster_addr":"172.21.15.50:6827/4168871229","heartbeat_back_addr":"172.21.15.50:6831/4168871229","heartbeat_front_addr":"172.21.15.50:6829/4168871229","state":["exists","up"]},{"osd":11,"uuid":"20beefe0-59c3-4392-9f61-8d215e9d2de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6825","nonce":2593470535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6827","nonce":2593470535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6831","nonce":2593470535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6829","nonce":2593470535}]},"public_addr":"172.21.15.70:6825/2593470535","cluster_addr":"172.21.15.70:6827/2593470535","heartbeat_back_addr":"172.21.15.70:6831/2593470535","heartbeat_front_addr":"172.21.15.70:6829/2593470535","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:21:56.748083+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:22:21.969492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:22:46.642917+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:23:11.630486+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:23:36.389322+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:24:01.431039+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:24:27.057017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:24:53.628200+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:25:19.356502+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:25:44.958024+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:26:10.804919+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:26:36.849133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:0/2473024253":"2024-09-01T05:20:57.333680+0000","172.21.15.5:0/2924148490":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/2163558485":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/2111919168":"2024-09-01T05:19:55.663503+0000","172.21.15.5:6801/3616278616":"2024-09-01T05:19:55.663503+0000","172.21.15.5:0/2436421090":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/1570244689":"2024-09-01T05:19:55.663503+0000","172.21.15.5:0/2700448223":"2024-09-01T05:20:57.333680+0000","172.21.15.5:6800/3616278616":"2024-09-01T05:19:55.663503+0000","172.21.15.5:6800/2898463711":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/2450461036":"2024-09-01T05:20:57.333680+0000","172.21.15.5:0/1947189952":"2024-09-01T05:19:55.663503+0000","172.21.15.5:6800/1439868821":"2024-09-01T05:20:57.333680+0000","172.21.15.5:6801/2898463711":"2024-09-01T05:19:31.728664+0000","172.21.15.5:6801/1439868821":"2024-09-01T05:20:57.333680+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T05:27:44.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:44.582+0000 7f461046a640 1 -- 172.21.15.5:0/2663358346 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f45f40b4bb0 msgr2=0x7f45f40b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:44.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:44.582+0000 7f461046a640 1 --2- 172.21.15.5:0/2663358346 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f45f40b4bb0 0x7f45f40b70c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f45f8000c00 tx=0x7f45f8031400 comp rx=0 tx=0).stop 2024-08-31T05:27:44.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:44.582+0000 7f461046a640 1 -- 172.21.15.5:0/2663358346 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4608102800 msgr2=0x7f46081990f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:44.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:44.582+0000 7f461046a640 1 --2- 172.21.15.5:0/2663358346 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4608102800 0x7f46081990f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f460400c920 tx=0x7f460400cde0 comp rx=0 tx=0).stop 2024-08-31T05:27:44.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:44.582+0000 7f461046a640 1 -- 172.21.15.5:0/2663358346 shutdown_connections 2024-08-31T05:27:44.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:44.582+0000 7f461046a640 1 --2- 172.21.15.5:0/2663358346 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f45f40b4bb0 0x7f45f40b70c0 secure :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f45f8000c00 tx=0x7f45f8031400 comp rx=0 tx=0).stop 2024-08-31T05:27:44.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:44.582+0000 7f461046a640 1 --2- 172.21.15.5:0/2663358346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4608108a90 0x7f460819e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:44.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:44.582+0000 7f461046a640 1 --2- 172.21.15.5:0/2663358346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4608108140 0x7f4608199690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:44.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:44.582+0000 7f461046a640 1 --2- 172.21.15.5:0/2663358346 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4608102800 0x7f46081990f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:44.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:44.582+0000 7f461046a640 1 -- 172.21.15.5:0/2663358346 >> 172.21.15.5:0/2663358346 conn(0x7f46080794d0 msgr2=0x7f4608105040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:44.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:44.582+0000 7f461046a640 1 -- 172.21.15.5:0/2663358346 shutdown_connections 2024-08-31T05:27:44.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:44.582+0000 7f461046a640 1 -- 172.21.15.5:0/2663358346 wait complete. 2024-08-31T05:27:44.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:44 smithi070 ceph-mon[22316]: pgmap v274: 129 pgs: 129 active+clean; 579 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-08-31T05:27:44.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:44 smithi050 ceph-mon[22146]: pgmap v274: 129 pgs: 129 active+clean; 579 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-08-31T05:27:45.417 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T05:27:45.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:45 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/2663358346' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T05:27:45.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:45 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/2663358346' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T05:27:45.676 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:27:45.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:45 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/2663358346' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T05:27:46.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:46.193+0000 7f9351093640 1 -- 172.21.15.5:0/2559496824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f934c103900 msgr2=0x7f934c103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:46.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:46.193+0000 7f9351093640 1 --2- 172.21.15.5:0/2559496824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f934c103900 0x7f934c103d10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f933c009ca0 tx=0x7f933c02a8c0 comp rx=0 tx=0).stop 2024-08-31T05:27:46.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:46.193+0000 7f9351093640 1 -- 172.21.15.5:0/2559496824 shutdown_connections 2024-08-31T05:27:46.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:46.193+0000 7f9351093640 1 --2- 172.21.15.5:0/2559496824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f934c109b90 0x7f934c1103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:46.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:46.193+0000 7f9351093640 1 --2- 172.21.15.5:0/2559496824 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f934c109240 0x7f934c109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:46.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:46.193+0000 7f9351093640 1 --2- 172.21.15.5:0/2559496824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f934c103900 0x7f934c103d10 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:46.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:46.193+0000 7f9351093640 1 -- 172.21.15.5:0/2559496824 >> 172.21.15.5:0/2559496824 conn(0x7f934c07b5f0 msgr2=0x7f934c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:46.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:46.193+0000 7f9351093640 1 -- 172.21.15.5:0/2559496824 shutdown_connections 2024-08-31T05:27:46.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:46.193+0000 7f9351093640 1 -- 172.21.15.5:0/2559496824 wait complete. 2024-08-31T05:27:46.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:46.194+0000 7f9351093640 1 Processor -- start 2024-08-31T05:27:46.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:46.194+0000 7f9351093640 1 -- start start 2024-08-31T05:27:46.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:46.194+0000 7f9351093640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f934c103900 0x7f934c0754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:46.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:46.194+0000 7f9351093640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f934c109240 0x7f934c0759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:46.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:46.194+0000 7f9351093640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f934c109b90 0x7f934c075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:46.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:46.194+0000 7f9351093640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f934c113850 con 0x7f934c103900 2024-08-31T05:27:46.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:46.194+0000 7f9351093640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f934c1136d0 con 0x7f934c109240 2024-08-31T05:27:46.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:46.194+0000 7f9351093640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f934c1139d0 con 0x7f934c109b90 2024-08-31T05:27:46.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:46.194+0000 7f934ad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f934c103900 0x7f934c0754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:46.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:46.194+0000 7f934ad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f934c103900 0x7f934c0754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41188/0 (socket says 172.21.15.5:41188) 2024-08-31T05:27:46.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:46.194+0000 7f934ad9d640 1 -- 172.21.15.5:0/190843203 learned_addr learned my addr 172.21.15.5:0/190843203 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:27:46.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:46.195+0000 7f934b59e640 1 --2- 172.21.15.5:0/190843203 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f934c109b90 0x7f934c075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:46.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:46.195+0000 7f934a59c640 1 --2- 172.21.15.5:0/190843203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f934c109240 0x7f934c0759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:46.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:46.195+0000 7f934ad9d640 1 -- 172.21.15.5:0/190843203 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f934c109b90 msgr2=0x7f934c075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:46.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:46.195+0000 7f934ad9d640 1 --2- 172.21.15.5:0/190843203 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f934c109b90 0x7f934c075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:46.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:46.195+0000 7f934ad9d640 1 -- 172.21.15.5:0/190843203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f934c109240 msgr2=0x7f934c0759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:46.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:46.195+0000 7f934ad9d640 1 --2- 172.21.15.5:0/190843203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f934c109240 0x7f934c0759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:46.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:46.195+0000 7f934ad9d640 1 -- 172.21.15.5:0/190843203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f934c1a8560 con 0x7f934c103900 2024-08-31T05:27:46.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:46.195+0000 7f934ad9d640 1 --2- 172.21.15.5:0/190843203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f934c103900 0x7f934c0754b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f933c006010 tx=0x7f933c0319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:46.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:46.195+0000 7f9333fff640 1 -- 172.21.15.5:0/190843203 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f933c003bf0 con 0x7f934c103900 2024-08-31T05:27:46.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:46.195+0000 7f9351093640 1 -- 172.21.15.5:0/190843203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f934c1a87f0 con 0x7f934c103900 2024-08-31T05:27:46.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:46.195+0000 7f9333fff640 1 -- 172.21.15.5:0/190843203 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f933c003d90 con 0x7f934c103900 2024-08-31T05:27:46.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:46.195+0000 7f9333fff640 1 -- 172.21.15.5:0/190843203 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f933c02fc20 con 0x7f934c103900 2024-08-31T05:27:46.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:46.195+0000 7f9351093640 1 -- 172.21.15.5:0/190843203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f934c1a8d30 con 0x7f934c103900 2024-08-31T05:27:46.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:46.197+0000 7f9351093640 1 -- 172.21.15.5:0/190843203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f934c103d10 con 0x7f934c103900 2024-08-31T05:27:46.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:46.198+0000 7f9333fff640 1 -- 172.21.15.5:0/190843203 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f933c0046a0 con 0x7f934c103900 2024-08-31T05:27:46.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:46.199+0000 7f9333fff640 1 --2- 172.21.15.5:0/190843203 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f93340b4b80 0x7f93340b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:46.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:46.199+0000 7f934a59c640 1 --2- 172.21.15.5:0/190843203 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f93340b4b80 0x7f93340b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:46.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:46.199+0000 7f9333fff640 1 -- 172.21.15.5:0/190843203 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9017+0+0 (secure 0 0 0) 0x7f933c1068f0 con 0x7f934c103900 2024-08-31T05:27:46.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:46.199+0000 7f934a59c640 1 --2- 172.21.15.5:0/190843203 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f93340b4b80 0x7f93340b7090 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f934c106260 tx=0x7f934000b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:46.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:46.202+0000 7f9333fff640 1 -- 172.21.15.5:0/190843203 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f933c0cd710 con 0x7f934c103900 2024-08-31T05:27:46.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:46.393+0000 7f9351093640 1 -- 172.21.15.5:0/190843203 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f934c02e430 con 0x7f934c103900 2024-08-31T05:27:46.396 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:46 smithi005 ceph-mon[18602]: pgmap v275: 129 pgs: 129 active+clean; 579 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:46.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:46.394+0000 7f9333fff640 1 -- 172.21.15.5:0/190843203 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+24407 (secure 0 0 0) 0x7f933c0cd010 con 0x7f934c103900 2024-08-31T05:27:46.397 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:27:46.397 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":83,"fsid":"69422704-6758-11ef-bcd4-c7b262605968","created":"2024-08-31T05:19:04.860258+0000","modified":"2024-08-31T05:27:40.903838+0000","last_up_change":"2024-08-31T05:26:38.675914+0000","last_in_change":"2024-08-31T05:26:15.366713+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T05:22:49.802575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T05:27:27.835197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T05:27:30.058144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-31T05:27:36.272228+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c5745391-e9d7-4799-9db9-6b34bb91b7df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6803","nonce":2312496244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6805","nonce":2312496244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6809","nonce":2312496244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6807","nonce":2312496244}]},"public_addr":"172.21.15.5:6803/2312496244","cluster_addr":"172.21.15.5:6805/2312496244","heartbeat_back_addr":"172.21.15.5:6809/2312496244","heartbeat_front_addr":"172.21.15.5:6807/2312496244","state":["exists","up"]},{"osd":1,"uuid":"f1903bd7-b2c5-424e-a74e-795f729471db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6801","nonce":2777359361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6803","nonce":2777359361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6807","nonce":2777359361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6805","nonce":2777359361}]},"public_addr":"172.21.15.50:6801/2777359361","cluster_addr":"172.21.15.50:6803/2777359361","heartbeat_back_addr":"172.21.15.50:6807/2777359361","heartbeat_front_addr":"172.21.15.50:6805/2777359361","state":["exists","up"]},{"osd":2,"uuid":"134c5892-e44a-44f2-8cd2-484d22a45e2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6801","nonce":1400583716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6803","nonce":1400583716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6807","nonce":1400583716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6805","nonce":1400583716}]},"public_addr":"172.21.15.70:6801/1400583716","cluster_addr":"172.21.15.70:6803/1400583716","heartbeat_back_addr":"172.21.15.70:6807/1400583716","heartbeat_front_addr":"172.21.15.70:6805/1400583716","state":["exists","up"]},{"osd":3,"uuid":"af49398a-e171-496b-a50e-1f767fc42923","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6811","nonce":1647468379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6813","nonce":1647468379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6817","nonce":1647468379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6815","nonce":1647468379}]},"public_addr":"172.21.15.5:6811/1647468379","cluster_addr":"172.21.15.5:6813/1647468379","heartbeat_back_addr":"172.21.15.5:6817/1647468379","heartbeat_front_addr":"172.21.15.5:6815/1647468379","state":["exists","up"]},{"osd":4,"uuid":"59b847ef-6eb0-4c13-aa06-53a76d77ce45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6809","nonce":2314546877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6811","nonce":2314546877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6815","nonce":2314546877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6813","nonce":2314546877}]},"public_addr":"172.21.15.50:6809/2314546877","cluster_addr":"172.21.15.50:6811/2314546877","heartbeat_back_addr":"172.21.15.50:6815/2314546877","heartbeat_front_addr":"172.21.15.50:6813/2314546877","state":["exists","up"]},{"osd":5,"uuid":"b0dac185-4462-4760-aa36-0d221923b007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6809","nonce":311426299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6811","nonce":311426299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6815","nonce":311426299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6813","nonce":311426299}]},"public_addr":"172.21.15.70:6809/311426299","cluster_addr":"172.21.15.70:6811/311426299","heartbeat_back_addr":"172.21.15.70:6815/311426299","heartbeat_front_addr":"172.21.15.70:6813/311426299","state":["exists","up"]},{"osd":6,"uuid":"12486aa2-61e4-4bdf-94dd-ce5c4cd3df6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6819","nonce":1027645612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6821","nonce":1027645612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6825","nonce":1027645612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6823","nonce":1027645612}]},"public_addr":"172.21.15.5:6819/1027645612","cluster_addr":"172.21.15.5:6821/1027645612","heartbeat_back_addr":"172.21.15.5:6825/1027645612","heartbeat_front_addr":"172.21.15.5:6823/1027645612","state":["exists","up"]},{"osd":7,"uuid":"66f9dcf9-d5c3-4016-812f-d9496e9892d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6817","nonce":2718354517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6819","nonce":2718354517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6823","nonce":2718354517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6821","nonce":2718354517}]},"public_addr":"172.21.15.50:6817/2718354517","cluster_addr":"172.21.15.50:6819/2718354517","heartbeat_back_addr":"172.21.15.50:6823/2718354517","heartbeat_front_addr":"172.21.15.50:6821/2718354517","state":["exists","up"]},{"osd":8,"uuid":"584837f9-af4b-4189-a7e5-04156a94a805","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6817","nonce":3155722993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6819","nonce":3155722993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6823","nonce":3155722993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6821","nonce":3155722993}]},"public_addr":"172.21.15.70:6817/3155722993","cluster_addr":"172.21.15.70:6819/3155722993","heartbeat_back_addr":"172.21.15.70:6823/3155722993","heartbeat_front_addr":"172.21.15.70:6821/3155722993","state":["exists","up"]},{"osd":9,"uuid":"ef60de6e-3456-435c-bd48-ed2636cc0d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6827","nonce":2988145512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6829","nonce":2988145512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6833","nonce":2988145512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6831","nonce":2988145512}]},"public_addr":"172.21.15.5:6827/2988145512","cluster_addr":"172.21.15.5:6829/2988145512","heartbeat_back_addr":"172.21.15.5:6833/2988145512","heartbeat_front_addr":"172.21.15.5:6831/2988145512","state":["exists","up"]},{"osd":10,"uuid":"96c5de40-53df-412d-9501-8ce1711a76a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6825","nonce":4168871229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6827","nonce":4168871229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6831","nonce":4168871229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6829","nonce":4168871229}]},"public_addr":"172.21.15.50:6825/4168871229","cluster_addr":"172.21.15.50:6827/4168871229","heartbeat_back_addr":"172.21.15.50:6831/4168871229","heartbeat_front_addr":"172.21.15.50:6829/4168871229","state":["exists","up"]},{"osd":11,"uuid":"20beefe0-59c3-4392-9f61-8d215e9d2de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6825","nonce":2593470535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6827","nonce":2593470535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6831","nonce":2593470535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6829","nonce":2593470535}]},"public_addr":"172.21.15.70:6825/2593470535","cluster_addr":"172.21.15.70:6827/2593470535","heartbeat_back_addr":"172.21.15.70:6831/2593470535","heartbeat_front_addr":"172.21.15.70:6829/2593470535","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:21:56.748083+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:22:21.969492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:22:46.642917+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:23:11.630486+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:23:36.389322+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:24:01.431039+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:24:27.057017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:24:53.628200+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:25:19.356502+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:25:44.958024+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:26:10.804919+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:26:36.849133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:0/2473024253":"2024-09-01T05:20:57.333680+0000","172.21.15.5:0/2924148490":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/2163558485":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/2111919168":"2024-09-01T05:19:55.663503+0000","172.21.15.5:6801/3616278616":"2024-09-01T05:19:55.663503+0000","172.21.15.5:0/2436421090":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/1570244689":"2024-09-01T05:19:55.663503+0000","172.21.15.5:0/2700448223":"2024-09-01T05:20:57.333680+0000","172.21.15.5:6800/3616278616":"2024-09-01T05:19:55.663503+0000","172.21.15.5:6800/2898463711":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/2450461036":"2024-09-01T05:20:57.333680+0000","172.21.15.5:0/1947189952":"2024-09-01T05:19:55.663503+0000","172.21.15.5:6800/1439868821":"2024-09-01T05:20:57.333680+0000","172.21.15.5:6801/2898463711":"2024-09-01T05:19:31.728664+0000","172.21.15.5:6801/1439868821":"2024-09-01T05:20:57.333680+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T05:27:46.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:46.396+0000 7f9351093640 1 -- 172.21.15.5:0/190843203 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f93340b4b80 msgr2=0x7f93340b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:46.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:46.396+0000 7f9351093640 1 --2- 172.21.15.5:0/190843203 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f93340b4b80 0x7f93340b7090 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f934c106260 tx=0x7f934000b390 comp rx=0 tx=0).stop 2024-08-31T05:27:46.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:46.396+0000 7f9351093640 1 -- 172.21.15.5:0/190843203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f934c103900 msgr2=0x7f934c0754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:46.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:46.397+0000 7f9351093640 1 --2- 172.21.15.5:0/190843203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f934c103900 0x7f934c0754b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f933c006010 tx=0x7f933c0319f0 comp rx=0 tx=0).stop 2024-08-31T05:27:46.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:46.397+0000 7f9351093640 1 -- 172.21.15.5:0/190843203 shutdown_connections 2024-08-31T05:27:46.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:46.397+0000 7f9351093640 1 --2- 172.21.15.5:0/190843203 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f93340b4b80 0x7f93340b7090 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:46.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:46.397+0000 7f9351093640 1 --2- 172.21.15.5:0/190843203 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f934c109b90 0x7f934c075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:46.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:46.397+0000 7f9351093640 1 --2- 172.21.15.5:0/190843203 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f934c109240 0x7f934c0759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:46.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:46.397+0000 7f9351093640 1 --2- 172.21.15.5:0/190843203 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f934c103900 0x7f934c0754b0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:46.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:46.397+0000 7f9351093640 1 -- 172.21.15.5:0/190843203 >> 172.21.15.5:0/190843203 conn(0x7f934c07b5f0 msgr2=0x7f934c107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:46.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:46.397+0000 7f9351093640 1 -- 172.21.15.5:0/190843203 shutdown_connections 2024-08-31T05:27:46.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:46.397+0000 7f9351093640 1 -- 172.21.15.5:0/190843203 wait complete. 2024-08-31T05:27:46.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:46 smithi070 ceph-mon[22316]: pgmap v275: 129 pgs: 129 active+clean; 579 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:46.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:46 smithi050 ceph-mon[22146]: pgmap v275: 129 pgs: 129 active+clean; 579 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:47.176 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T05:27:47.434 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:27:47.466 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:47 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/190843203' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T05:27:47.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:47 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/190843203' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T05:27:47.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:47 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/190843203' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T05:27:47.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:47.911+0000 7f34ccbfd640 1 -- 172.21.15.5:0/936599391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34c8108b10 msgr2=0x7f34c810f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:47.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:47.911+0000 7f34ccbfd640 1 --2- 172.21.15.5:0/936599391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34c8108b10 0x7f34c810f340 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f34c0009ca0 tx=0x7f34c002a8c0 comp rx=0 tx=0).stop 2024-08-31T05:27:47.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:47.912+0000 7f34ccbfd640 1 -- 172.21.15.5:0/936599391 shutdown_connections 2024-08-31T05:27:47.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:47.912+0000 7f34ccbfd640 1 --2- 172.21.15.5:0/936599391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34c8108b10 0x7f34c810f340 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:47.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:47.912+0000 7f34ccbfd640 1 --2- 172.21.15.5:0/936599391 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34c81081c0 0x7f34c81085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:47.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:47.912+0000 7f34ccbfd640 1 --2- 172.21.15.5:0/936599391 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34c8102880 0x7f34c8102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:47.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:47.912+0000 7f34ccbfd640 1 -- 172.21.15.5:0/936599391 >> 172.21.15.5:0/936599391 conn(0x7f34c8079510 msgr2=0x7f34c8079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:47.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:47.912+0000 7f34ccbfd640 1 -- 172.21.15.5:0/936599391 shutdown_connections 2024-08-31T05:27:47.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:47.912+0000 7f34ccbfd640 1 -- 172.21.15.5:0/936599391 wait complete. 2024-08-31T05:27:47.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:47.912+0000 7f34ccbfd640 1 Processor -- start 2024-08-31T05:27:47.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:47.913+0000 7f34ccbfd640 1 -- start start 2024-08-31T05:27:47.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:47.913+0000 7f34ccbfd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34c8102880 0x7f34c819a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:47.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:47.913+0000 7f34ccbfd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34c81081c0 0x7f34c819a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:47.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:47.913+0000 7f34ccbfd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34c8108b10 0x7f34c819fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:47.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:47.913+0000 7f34ccbfd640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f34c81138f0 con 0x7f34c81081c0 2024-08-31T05:27:47.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:47.913+0000 7f34ccbfd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f34c8113770 con 0x7f34c8102880 2024-08-31T05:27:47.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:47.913+0000 7f34ccbfd640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f34c8113a70 con 0x7f34c8108b10 2024-08-31T05:27:47.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:47.913+0000 7f34c5d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34c81081c0 0x7f34c819a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:47.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:47.913+0000 7f34c5d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34c81081c0 0x7f34c819a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41206/0 (socket says 172.21.15.5:41206) 2024-08-31T05:27:47.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:47.913+0000 7f34c5d9b640 1 -- 172.21.15.5:0/151601551 learned_addr learned my addr 172.21.15.5:0/151601551 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:27:47.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:47.913+0000 7f34c659c640 1 --2- 172.21.15.5:0/151601551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34c8102880 0x7f34c819a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:47.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:47.913+0000 7f34c6d9d640 1 --2- 172.21.15.5:0/151601551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34c8108b10 0x7f34c819fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:47.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:47.913+0000 7f34c5d9b640 1 -- 172.21.15.5:0/151601551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34c8108b10 msgr2=0x7f34c819fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:47.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:47.913+0000 7f34c5d9b640 1 --2- 172.21.15.5:0/151601551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34c8108b10 0x7f34c819fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:47.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:47.913+0000 7f34c5d9b640 1 -- 172.21.15.5:0/151601551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34c8102880 msgr2=0x7f34c819a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:47.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:47.913+0000 7f34c5d9b640 1 --2- 172.21.15.5:0/151601551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34c8102880 0x7f34c819a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:47.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:47.913+0000 7f34c5d9b640 1 -- 172.21.15.5:0/151601551 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34c81a0270 con 0x7f34c81081c0 2024-08-31T05:27:47.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:47.914+0000 7f34c5d9b640 1 --2- 172.21.15.5:0/151601551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34c81081c0 0x7f34c819a8a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f34bc00d750 tx=0x7f34bc00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:47.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:47.914+0000 7f34b77fe640 1 -- 172.21.15.5:0/151601551 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34bc017070 con 0x7f34c81081c0 2024-08-31T05:27:47.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:47.914+0000 7f34ccbfd640 1 -- 172.21.15.5:0/151601551 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34c81a0560 con 0x7f34c81081c0 2024-08-31T05:27:47.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:47.914+0000 7f34b77fe640 1 -- 172.21.15.5:0/151601551 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34bc0054d0 con 0x7f34c81081c0 2024-08-31T05:27:47.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:47.914+0000 7f34b77fe640 1 -- 172.21.15.5:0/151601551 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34bc004c30 con 0x7f34c81081c0 2024-08-31T05:27:47.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:47.914+0000 7f34ccbfd640 1 -- 172.21.15.5:0/151601551 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34c81a6cc0 con 0x7f34c81081c0 2024-08-31T05:27:47.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:47.915+0000 7f34ccbfd640 1 -- 172.21.15.5:0/151601551 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34c8103b00 con 0x7f34c81081c0 2024-08-31T05:27:47.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:47.917+0000 7f34b77fe640 1 -- 172.21.15.5:0/151601551 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f34bc004dd0 con 0x7f34c81081c0 2024-08-31T05:27:47.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:47.918+0000 7f34b77fe640 1 --2- 172.21.15.5:0/151601551 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f34b00b4b80 0x7f34b00b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:47.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:47.918+0000 7f34c659c640 1 --2- 172.21.15.5:0/151601551 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f34b00b4b80 0x7f34b00b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:47.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:47.918+0000 7f34b77fe640 1 -- 172.21.15.5:0/151601551 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9017+0+0 (secure 0 0 0) 0x7f34bc0e5200 con 0x7f34c81081c0 2024-08-31T05:27:47.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:47.919+0000 7f34c659c640 1 --2- 172.21.15.5:0/151601551 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f34b00b4b80 0x7f34b00b7090 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f34b800bbe0 tx=0x7f34b800b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:47.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:47.921+0000 7f34b77fe640 1 -- 172.21.15.5:0/151601551 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f34bc0ab970 con 0x7f34c81081c0 2024-08-31T05:27:48.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:48.142+0000 7f34ccbfd640 1 -- 172.21.15.5:0/151601551 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f34c8102c90 con 0x7f34c81081c0 2024-08-31T05:27:48.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:48.143+0000 7f34b77fe640 1 -- 172.21.15.5:0/151601551 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11806 (secure 0 0 0) 0x7f34c8102c90 con 0x7f34c81081c0 2024-08-31T05:27:48.146 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:27:48.146 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":17,"btime":"2024-08-31T05:27:41:285936+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14739,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2024812199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2024812199},{"type":"v1","addr":"172.21.15.5:6835","nonce":2024812199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3629023702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3629023702},{"type":"v1","addr":"172.21.15.5:6837","nonce":3629023702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14808,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6839/2412701258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":2412701258},{"type":"v1","addr":"172.21.15.5:6839","nonce":2412701258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14820,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6841/747057838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":747057838},{"type":"v1","addr":"172.21.15.5:6841","nonce":747057838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24560,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6833/1153378982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1153378982},{"type":"v1","addr":"172.21.15.50:6833","nonce":1153378982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24583,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6833/364083443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":364083443},{"type":"v1","addr":"172.21.15.70:6833","nonce":364083443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24587,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6835/2346896794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2346896794},{"type":"v1","addr":"172.21.15.50:6835","nonce":2346896794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24602,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6837/428759669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":428759669},{"type":"v1","addr":"172.21.15.50:6837","nonce":428759669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24625,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2061504114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2061504114},{"type":"v1","addr":"172.21.15.70:6835","nonce":2061504114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24631,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2780036414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2780036414},{"type":"v1","addr":"172.21.15.70:6837","nonce":2780036414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24638,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.50:6839/98200944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":98200944},{"type":"v1","addr":"172.21.15.50:6839","nonce":98200944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-31T05:27:31.929153+0000","modified":"2024-08-31T05:27:40.904002+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24652":{"gid":24652,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.70:6839/2756569250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":2756569250},{"type":"v1","addr":"172.21.15.70:6839","nonce":2756569250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24652,"qdb_cluster":[24652]},"id":1}]} 2024-08-31T05:27:48.147 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 17 2024-08-31T05:27:48.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:48.146+0000 7f34ccbfd640 1 -- 172.21.15.5:0/151601551 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f34b00b4b80 msgr2=0x7f34b00b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:48.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:48.146+0000 7f34ccbfd640 1 --2- 172.21.15.5:0/151601551 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f34b00b4b80 0x7f34b00b7090 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f34b800bbe0 tx=0x7f34b800b390 comp rx=0 tx=0).stop 2024-08-31T05:27:48.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:48.146+0000 7f34ccbfd640 1 -- 172.21.15.5:0/151601551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34c81081c0 msgr2=0x7f34c819a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:48.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:48.146+0000 7f34ccbfd640 1 --2- 172.21.15.5:0/151601551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34c81081c0 0x7f34c819a8a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f34bc00d750 tx=0x7f34bc00dc10 comp rx=0 tx=0).stop 2024-08-31T05:27:48.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:48.147+0000 7f34ccbfd640 1 -- 172.21.15.5:0/151601551 shutdown_connections 2024-08-31T05:27:48.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:48.147+0000 7f34ccbfd640 1 --2- 172.21.15.5:0/151601551 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f34b00b4b80 0x7f34b00b7090 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:48.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:48.147+0000 7f34ccbfd640 1 --2- 172.21.15.5:0/151601551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34c8108b10 0x7f34c819fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:48.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:48.147+0000 7f34ccbfd640 1 --2- 172.21.15.5:0/151601551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34c81081c0 0x7f34c819a8a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:48.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:48.147+0000 7f34ccbfd640 1 --2- 172.21.15.5:0/151601551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34c8102880 0x7f34c819a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:48.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:48.147+0000 7f34ccbfd640 1 -- 172.21.15.5:0/151601551 >> 172.21.15.5:0/151601551 conn(0x7f34c8079510 msgr2=0x7f34c8106210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:48.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:48.147+0000 7f34ccbfd640 1 -- 172.21.15.5:0/151601551 shutdown_connections 2024-08-31T05:27:48.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:48.147+0000 7f34ccbfd640 1 -- 172.21.15.5:0/151601551 wait complete. 2024-08-31T05:27:48.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:48 smithi005 ceph-mon[18602]: pgmap v276: 129 pgs: 129 active+clean; 579 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:48.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:48 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/151601551' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:27:48.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:48 smithi070 ceph-mon[22316]: pgmap v276: 129 pgs: 129 active+clean; 579 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:48.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:48 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/151601551' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:27:48.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:48 smithi050 ceph-mon[22146]: pgmap v276: 129 pgs: 129 active+clean; 579 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:48.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:48 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/151601551' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:27:48.935 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T05:27:49.194 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:27:49.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.690+0000 7f9a0eef0640 1 -- 172.21.15.5:0/193856237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a08109240 msgr2=0x7f9a08109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:49.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.690+0000 7f9a0eef0640 1 --2- 172.21.15.5:0/193856237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a08109240 0x7f9a08109650 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f99f4009900 tx=0x7f99f402a410 comp rx=0 tx=0).stop 2024-08-31T05:27:49.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.690+0000 7f9a0eef0640 1 -- 172.21.15.5:0/193856237 shutdown_connections 2024-08-31T05:27:49.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.690+0000 7f9a0eef0640 1 --2- 172.21.15.5:0/193856237 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a08109b90 0x7f9a081103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:49.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.690+0000 7f9a0eef0640 1 --2- 172.21.15.5:0/193856237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a08109240 0x7f9a08109650 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:49.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.690+0000 7f9a0eef0640 1 --2- 172.21.15.5:0/193856237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a08103900 0x7f9a08103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:49.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.690+0000 7f9a0eef0640 1 -- 172.21.15.5:0/193856237 >> 172.21.15.5:0/193856237 conn(0x7f9a0807b5f0 msgr2=0x7f9a0807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:49.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.690+0000 7f9a0eef0640 1 -- 172.21.15.5:0/193856237 shutdown_connections 2024-08-31T05:27:49.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.690+0000 7f9a0eef0640 1 -- 172.21.15.5:0/193856237 wait complete. 2024-08-31T05:27:49.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.691+0000 7f9a0eef0640 1 Processor -- start 2024-08-31T05:27:49.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.691+0000 7f9a0eef0640 1 -- start start 2024-08-31T05:27:49.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.691+0000 7f9a0eef0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a08103900 0x7f9a0819c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:49.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.691+0000 7f9a0eef0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a08109240 0x7f9a0819ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:49.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.691+0000 7f9a0eef0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a08109b90 0x7f9a081a1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:49.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.691+0000 7f9a0eef0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9a08113870 con 0x7f9a08103900 2024-08-31T05:27:49.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.691+0000 7f9a0eef0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9a081136f0 con 0x7f9a08109240 2024-08-31T05:27:49.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.691+0000 7f9a0eef0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9a081139f0 con 0x7f9a08109b90 2024-08-31T05:27:49.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.691+0000 7f9a0cc8c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a08103900 0x7f9a0819c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:49.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.691+0000 7f9a0cc8c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a08103900 0x7f9a0819c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41234/0 (socket says 172.21.15.5:41234) 2024-08-31T05:27:49.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.691+0000 7f9a0cc8c640 1 -- 172.21.15.5:0/1898954921 learned_addr learned my addr 172.21.15.5:0/1898954921 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:27:49.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.691+0000 7f9a07fff640 1 --2- 172.21.15.5:0/1898954921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a08109240 0x7f9a0819ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:49.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.691+0000 7f9a0d48d640 1 --2- 172.21.15.5:0/1898954921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a08109b90 0x7f9a081a1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:49.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.691+0000 7f9a0cc8c640 1 -- 172.21.15.5:0/1898954921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a08109b90 msgr2=0x7f9a081a1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:49.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.691+0000 7f9a0cc8c640 1 --2- 172.21.15.5:0/1898954921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a08109b90 0x7f9a081a1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:49.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.691+0000 7f9a0cc8c640 1 -- 172.21.15.5:0/1898954921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a08109240 msgr2=0x7f9a0819ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:49.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.691+0000 7f9a0cc8c640 1 --2- 172.21.15.5:0/1898954921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a08109240 0x7f9a0819ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:49.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.692+0000 7f9a0cc8c640 1 -- 172.21.15.5:0/1898954921 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a081a2410 con 0x7f9a08103900 2024-08-31T05:27:49.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.692+0000 7f9a07fff640 1 --2- 172.21.15.5:0/1898954921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a08109240 0x7f9a0819ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:27:49.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.692+0000 7f9a0d48d640 1 --2- 172.21.15.5:0/1898954921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a08109b90 0x7f9a081a1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:27:49.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.692+0000 7f9a0cc8c640 1 --2- 172.21.15.5:0/1898954921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a08103900 0x7f9a0819c4a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f99fc00c890 tx=0x7f99fc00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:49.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.692+0000 7f9a05ffb640 1 -- 172.21.15.5:0/1898954921 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99fc004220 con 0x7f9a08103900 2024-08-31T05:27:49.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.692+0000 7f9a0eef0640 1 -- 172.21.15.5:0/1898954921 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a081a2700 con 0x7f9a08103900 2024-08-31T05:27:49.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.692+0000 7f9a05ffb640 1 -- 172.21.15.5:0/1898954921 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99fc0043c0 con 0x7f9a08103900 2024-08-31T05:27:49.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.692+0000 7f9a05ffb640 1 -- 172.21.15.5:0/1898954921 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99fc004a00 con 0x7f9a08103900 2024-08-31T05:27:49.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.692+0000 7f9a0eef0640 1 -- 172.21.15.5:0/1898954921 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a081a8ee0 con 0x7f9a08103900 2024-08-31T05:27:49.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.693+0000 7f9a0eef0640 1 -- 172.21.15.5:0/1898954921 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a08103d10 con 0x7f9a08103900 2024-08-31T05:27:49.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.695+0000 7f9a05ffb640 1 -- 172.21.15.5:0/1898954921 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f99fc0079b0 con 0x7f9a08103900 2024-08-31T05:27:49.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.695+0000 7f9a05ffb640 1 --2- 172.21.15.5:0/1898954921 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f99f80b4b80 0x7f99f80b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:49.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.695+0000 7f9a07fff640 1 --2- 172.21.15.5:0/1898954921 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f99f80b4b80 0x7f99f80b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:49.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.695+0000 7f9a05ffb640 1 -- 172.21.15.5:0/1898954921 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9017+0+0 (secure 0 0 0) 0x7f99fc0e5700 con 0x7f9a08103900 2024-08-31T05:27:49.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.696+0000 7f9a07fff640 1 --2- 172.21.15.5:0/1898954921 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f99f80b4b80 0x7f99f80b7090 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f99f4000c00 tx=0x7f99f4031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:49.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.699+0000 7f9a05ffb640 1 -- 172.21.15.5:0/1898954921 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f99fc014030 con 0x7f9a08103900 2024-08-31T05:27:49.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.888+0000 7f9a0eef0640 1 -- 172.21.15.5:0/1898954921 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9a0819d5d0 con 0x7f9a08103900 2024-08-31T05:27:49.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.889+0000 7f9a05ffb640 1 -- 172.21.15.5:0/1898954921 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+24407 (secure 0 0 0) 0x7f99fc0ac520 con 0x7f9a08103900 2024-08-31T05:27:49.893 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:27:49.893 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":83,"fsid":"69422704-6758-11ef-bcd4-c7b262605968","created":"2024-08-31T05:19:04.860258+0000","modified":"2024-08-31T05:27:40.903838+0000","last_up_change":"2024-08-31T05:26:38.675914+0000","last_in_change":"2024-08-31T05:26:15.366713+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T05:22:49.802575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T05:27:27.835197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T05:27:30.058144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-31T05:27:36.272228+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c5745391-e9d7-4799-9db9-6b34bb91b7df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6803","nonce":2312496244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6805","nonce":2312496244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6809","nonce":2312496244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6807","nonce":2312496244}]},"public_addr":"172.21.15.5:6803/2312496244","cluster_addr":"172.21.15.5:6805/2312496244","heartbeat_back_addr":"172.21.15.5:6809/2312496244","heartbeat_front_addr":"172.21.15.5:6807/2312496244","state":["exists","up"]},{"osd":1,"uuid":"f1903bd7-b2c5-424e-a74e-795f729471db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6801","nonce":2777359361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6803","nonce":2777359361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6807","nonce":2777359361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6805","nonce":2777359361}]},"public_addr":"172.21.15.50:6801/2777359361","cluster_addr":"172.21.15.50:6803/2777359361","heartbeat_back_addr":"172.21.15.50:6807/2777359361","heartbeat_front_addr":"172.21.15.50:6805/2777359361","state":["exists","up"]},{"osd":2,"uuid":"134c5892-e44a-44f2-8cd2-484d22a45e2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6801","nonce":1400583716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6803","nonce":1400583716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6807","nonce":1400583716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6805","nonce":1400583716}]},"public_addr":"172.21.15.70:6801/1400583716","cluster_addr":"172.21.15.70:6803/1400583716","heartbeat_back_addr":"172.21.15.70:6807/1400583716","heartbeat_front_addr":"172.21.15.70:6805/1400583716","state":["exists","up"]},{"osd":3,"uuid":"af49398a-e171-496b-a50e-1f767fc42923","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6811","nonce":1647468379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6813","nonce":1647468379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6817","nonce":1647468379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6815","nonce":1647468379}]},"public_addr":"172.21.15.5:6811/1647468379","cluster_addr":"172.21.15.5:6813/1647468379","heartbeat_back_addr":"172.21.15.5:6817/1647468379","heartbeat_front_addr":"172.21.15.5:6815/1647468379","state":["exists","up"]},{"osd":4,"uuid":"59b847ef-6eb0-4c13-aa06-53a76d77ce45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6809","nonce":2314546877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6811","nonce":2314546877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6815","nonce":2314546877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6813","nonce":2314546877}]},"public_addr":"172.21.15.50:6809/2314546877","cluster_addr":"172.21.15.50:6811/2314546877","heartbeat_back_addr":"172.21.15.50:6815/2314546877","heartbeat_front_addr":"172.21.15.50:6813/2314546877","state":["exists","up"]},{"osd":5,"uuid":"b0dac185-4462-4760-aa36-0d221923b007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6809","nonce":311426299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6811","nonce":311426299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6815","nonce":311426299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6813","nonce":311426299}]},"public_addr":"172.21.15.70:6809/311426299","cluster_addr":"172.21.15.70:6811/311426299","heartbeat_back_addr":"172.21.15.70:6815/311426299","heartbeat_front_addr":"172.21.15.70:6813/311426299","state":["exists","up"]},{"osd":6,"uuid":"12486aa2-61e4-4bdf-94dd-ce5c4cd3df6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6819","nonce":1027645612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6821","nonce":1027645612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6825","nonce":1027645612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6823","nonce":1027645612}]},"public_addr":"172.21.15.5:6819/1027645612","cluster_addr":"172.21.15.5:6821/1027645612","heartbeat_back_addr":"172.21.15.5:6825/1027645612","heartbeat_front_addr":"172.21.15.5:6823/1027645612","state":["exists","up"]},{"osd":7,"uuid":"66f9dcf9-d5c3-4016-812f-d9496e9892d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6817","nonce":2718354517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6819","nonce":2718354517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6823","nonce":2718354517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6821","nonce":2718354517}]},"public_addr":"172.21.15.50:6817/2718354517","cluster_addr":"172.21.15.50:6819/2718354517","heartbeat_back_addr":"172.21.15.50:6823/2718354517","heartbeat_front_addr":"172.21.15.50:6821/2718354517","state":["exists","up"]},{"osd":8,"uuid":"584837f9-af4b-4189-a7e5-04156a94a805","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6817","nonce":3155722993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6819","nonce":3155722993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6823","nonce":3155722993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6821","nonce":3155722993}]},"public_addr":"172.21.15.70:6817/3155722993","cluster_addr":"172.21.15.70:6819/3155722993","heartbeat_back_addr":"172.21.15.70:6823/3155722993","heartbeat_front_addr":"172.21.15.70:6821/3155722993","state":["exists","up"]},{"osd":9,"uuid":"ef60de6e-3456-435c-bd48-ed2636cc0d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6827","nonce":2988145512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6829","nonce":2988145512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6833","nonce":2988145512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6831","nonce":2988145512}]},"public_addr":"172.21.15.5:6827/2988145512","cluster_addr":"172.21.15.5:6829/2988145512","heartbeat_back_addr":"172.21.15.5:6833/2988145512","heartbeat_front_addr":"172.21.15.5:6831/2988145512","state":["exists","up"]},{"osd":10,"uuid":"96c5de40-53df-412d-9501-8ce1711a76a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6825","nonce":4168871229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6827","nonce":4168871229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6831","nonce":4168871229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6829","nonce":4168871229}]},"public_addr":"172.21.15.50:6825/4168871229","cluster_addr":"172.21.15.50:6827/4168871229","heartbeat_back_addr":"172.21.15.50:6831/4168871229","heartbeat_front_addr":"172.21.15.50:6829/4168871229","state":["exists","up"]},{"osd":11,"uuid":"20beefe0-59c3-4392-9f61-8d215e9d2de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6825","nonce":2593470535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6827","nonce":2593470535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6831","nonce":2593470535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6829","nonce":2593470535}]},"public_addr":"172.21.15.70:6825/2593470535","cluster_addr":"172.21.15.70:6827/2593470535","heartbeat_back_addr":"172.21.15.70:6831/2593470535","heartbeat_front_addr":"172.21.15.70:6829/2593470535","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:21:56.748083+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:22:21.969492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:22:46.642917+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:23:11.630486+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:23:36.389322+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:24:01.431039+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:24:27.057017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:24:53.628200+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:25:19.356502+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:25:44.958024+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:26:10.804919+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:26:36.849133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:0/2473024253":"2024-09-01T05:20:57.333680+0000","172.21.15.5:0/2924148490":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/2163558485":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/2111919168":"2024-09-01T05:19:55.663503+0000","172.21.15.5:6801/3616278616":"2024-09-01T05:19:55.663503+0000","172.21.15.5:0/2436421090":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/1570244689":"2024-09-01T05:19:55.663503+0000","172.21.15.5:0/2700448223":"2024-09-01T05:20:57.333680+0000","172.21.15.5:6800/3616278616":"2024-09-01T05:19:55.663503+0000","172.21.15.5:6800/2898463711":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/2450461036":"2024-09-01T05:20:57.333680+0000","172.21.15.5:0/1947189952":"2024-09-01T05:19:55.663503+0000","172.21.15.5:6800/1439868821":"2024-09-01T05:20:57.333680+0000","172.21.15.5:6801/2898463711":"2024-09-01T05:19:31.728664+0000","172.21.15.5:6801/1439868821":"2024-09-01T05:20:57.333680+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T05:27:49.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.892+0000 7f9a0eef0640 1 -- 172.21.15.5:0/1898954921 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f99f80b4b80 msgr2=0x7f99f80b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:49.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.892+0000 7f9a0eef0640 1 --2- 172.21.15.5:0/1898954921 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f99f80b4b80 0x7f99f80b7090 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f99f4000c00 tx=0x7f99f4031400 comp rx=0 tx=0).stop 2024-08-31T05:27:49.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.892+0000 7f9a0eef0640 1 -- 172.21.15.5:0/1898954921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a08103900 msgr2=0x7f9a0819c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:49.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.892+0000 7f9a0eef0640 1 --2- 172.21.15.5:0/1898954921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a08103900 0x7f9a0819c4a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f99fc00c890 tx=0x7f99fc00cd50 comp rx=0 tx=0).stop 2024-08-31T05:27:49.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.892+0000 7f9a0eef0640 1 -- 172.21.15.5:0/1898954921 shutdown_connections 2024-08-31T05:27:49.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.892+0000 7f9a0eef0640 1 --2- 172.21.15.5:0/1898954921 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f99f80b4b80 0x7f99f80b7090 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:49.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.892+0000 7f9a0eef0640 1 --2- 172.21.15.5:0/1898954921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a08109b90 0x7f9a081a1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:49.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.892+0000 7f9a0eef0640 1 --2- 172.21.15.5:0/1898954921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a08109240 0x7f9a0819ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:49.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.892+0000 7f9a0eef0640 1 --2- 172.21.15.5:0/1898954921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a08103900 0x7f9a0819c4a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:49.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.892+0000 7f9a0eef0640 1 -- 172.21.15.5:0/1898954921 >> 172.21.15.5:0/1898954921 conn(0x7f9a0807b5f0 msgr2=0x7f9a081070b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:49.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.892+0000 7f9a0eef0640 1 -- 172.21.15.5:0/1898954921 shutdown_connections 2024-08-31T05:27:49.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:49.892+0000 7f9a0eef0640 1 -- 172.21.15.5:0/1898954921 wait complete. 2024-08-31T05:27:50.551 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:50 smithi005 ceph-mon[18602]: pgmap v277: 129 pgs: 129 active+clean; 579 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:50.552 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:50 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/1898954921' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T05:27:50.582 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-31T05:27:31.929153+0000', 'modified': '2024-08-31T05:27:40.904002+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24652}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24652': {'gid': 24652, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.70:6839/2756569250', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6838', 'nonce': 2756569250}, {'type': 'v1', 'addr': '172.21.15.70:6839', 'nonce': 2756569250}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24652, 'qdb_cluster': [24652]} 2024-08-31T05:27:50.582 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-31T05:27:50.583 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.i status 2024-08-31T05:27:50.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:50 smithi070 ceph-mon[22316]: pgmap v277: 129 pgs: 129 active+clean; 579 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:50.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:50 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/1898954921' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T05:27:50.837 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:27:50.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:50 smithi050 ceph-mon[22146]: pgmap v277: 129 pgs: 129 active+clean; 579 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:50.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:50 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/1898954921' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T05:27:51.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.355+0000 7fec510fa640 1 -- 172.21.15.5:0/3753051150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec4c1046a0 msgr2=0x7fec4c104ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:51.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.355+0000 7fec510fa640 1 --2- 172.21.15.5:0/3753051150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec4c1046a0 0x7fec4c104ab0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fec3c009900 tx=0x7fec3c02a410 comp rx=0 tx=0).stop 2024-08-31T05:27:51.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.355+0000 7fec510fa640 1 -- 172.21.15.5:0/3753051150 shutdown_connections 2024-08-31T05:27:51.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.355+0000 7fec510fa640 1 --2- 172.21.15.5:0/3753051150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec4c10dc50 0x7fec4c1100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:51.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.355+0000 7fec510fa640 1 --2- 172.21.15.5:0/3753051150 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec4c104ff0 0x7fec4c10d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:51.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.355+0000 7fec510fa640 1 --2- 172.21.15.5:0/3753051150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec4c1046a0 0x7fec4c104ab0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:51.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.355+0000 7fec510fa640 1 -- 172.21.15.5:0/3753051150 >> 172.21.15.5:0/3753051150 conn(0x7fec4c079530 msgr2=0x7fec4c079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:51.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.355+0000 7fec510fa640 1 -- 172.21.15.5:0/3753051150 shutdown_connections 2024-08-31T05:27:51.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.355+0000 7fec510fa640 1 -- 172.21.15.5:0/3753051150 wait complete. 2024-08-31T05:27:51.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.356+0000 7fec510fa640 1 Processor -- start 2024-08-31T05:27:51.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.356+0000 7fec510fa640 1 -- start start 2024-08-31T05:27:51.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.356+0000 7fec510fa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec4c1046a0 0x7fec4c19a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:51.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.356+0000 7fec510fa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec4c104ff0 0x7fec4c19a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:51.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.356+0000 7fec510fa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec4c10dc50 0x7fec4c19fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:51.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.357+0000 7fec510fa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fec4c113840 con 0x7fec4c1046a0 2024-08-31T05:27:51.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.357+0000 7fec510fa640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fec4c1136c0 con 0x7fec4c10dc50 2024-08-31T05:27:51.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.357+0000 7fec510fa640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fec4c1139c0 con 0x7fec4c104ff0 2024-08-31T05:27:51.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.357+0000 7fec4ad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec4c1046a0 0x7fec4c19a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:51.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.357+0000 7fec4ad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec4c1046a0 0x7fec4c19a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41254/0 (socket says 172.21.15.5:41254) 2024-08-31T05:27:51.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.357+0000 7fec4ad9d640 1 -- 172.21.15.5:0/974448636 learned_addr learned my addr 172.21.15.5:0/974448636 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:27:51.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.357+0000 7fec4a59c640 1 --2- 172.21.15.5:0/974448636 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec4c104ff0 0x7fec4c19a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:51.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.357+0000 7fec4b59e640 1 --2- 172.21.15.5:0/974448636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec4c10dc50 0x7fec4c19fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:51.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.357+0000 7fec4ad9d640 1 -- 172.21.15.5:0/974448636 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec4c104ff0 msgr2=0x7fec4c19a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:51.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.357+0000 7fec4ad9d640 1 --2- 172.21.15.5:0/974448636 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec4c104ff0 0x7fec4c19a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:51.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.357+0000 7fec4ad9d640 1 -- 172.21.15.5:0/974448636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec4c10dc50 msgr2=0x7fec4c19fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:51.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.357+0000 7fec4ad9d640 1 --2- 172.21.15.5:0/974448636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec4c10dc50 0x7fec4c19fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:51.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.357+0000 7fec4ad9d640 1 -- 172.21.15.5:0/974448636 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec4c1a01e0 con 0x7fec4c1046a0 2024-08-31T05:27:51.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.357+0000 7fec4ad9d640 1 --2- 172.21.15.5:0/974448636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec4c1046a0 0x7fec4c19a270 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fec3c005940 tx=0x7fec3c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:51.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.357+0000 7fec33fff640 1 -- 172.21.15.5:0/974448636 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec3c03f030 con 0x7fec4c1046a0 2024-08-31T05:27:51.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.358+0000 7fec510fa640 1 -- 172.21.15.5:0/974448636 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec4c1a0470 con 0x7fec4c1046a0 2024-08-31T05:27:51.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.358+0000 7fec33fff640 1 -- 172.21.15.5:0/974448636 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec3c003cb0 con 0x7fec4c1046a0 2024-08-31T05:27:51.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.358+0000 7fec33fff640 1 -- 172.21.15.5:0/974448636 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec3c035070 con 0x7fec4c1046a0 2024-08-31T05:27:51.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.358+0000 7fec510fa640 1 -- 172.21.15.5:0/974448636 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec4c1a6c30 con 0x7fec4c1046a0 2024-08-31T05:27:51.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.360+0000 7fec5766f740 1 Processor -- start 2024-08-31T05:27:51.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.360+0000 7fec5766f740 1 -- start start 2024-08-31T05:27:51.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.360+0000 7fec5766f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d10963af60 0x55d1099e07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:51.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.360+0000 7fec5766f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d1096120a0 0x55d1099e0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:51.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.360+0000 7fec5766f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d10961a280 0x55d1099e1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:51.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.360+0000 7fec5766f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55d1099573f0 con 0x55d1096120a0 2024-08-31T05:27:51.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.360+0000 7fec5766f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d109946980 con 0x55d10963af60 2024-08-31T05:27:51.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.360+0000 7fec5766f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d10994a930 con 0x55d10961a280 2024-08-31T05:27:51.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.360+0000 7fec33fff640 1 -- 172.21.15.5:0/974448636 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7fec3c042030 con 0x7fec4c1046a0 2024-08-31T05:27:51.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.361+0000 7fec4ad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d1096120a0 0x55d1099e0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:51.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.361+0000 7fec4b59e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d10963af60 0x55d1099e07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:51.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.361+0000 7fec4b59e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d10963af60 0x55d1099e07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:36918/0 (socket says 172.21.15.5:36918) 2024-08-31T05:27:51.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.361+0000 7fec4ad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d1096120a0 0x55d1099e0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41266/0 (socket says 172.21.15.5:41266) 2024-08-31T05:27:51.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.361+0000 7fec4b59e640 1 -- 172.21.15.5:0/3155322408 learned_addr learned my addr 172.21.15.5:0/3155322408 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:27:51.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.361+0000 7fec4a59c640 1 --2- 172.21.15.5:0/3155322408 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d10961a280 0x55d1099e1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:51.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.361+0000 7fec4b59e640 1 -- 172.21.15.5:0/3155322408 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d10961a280 msgr2=0x55d1099e1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:27:51.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.361+0000 7fec4b59e640 1 --2- 172.21.15.5:0/3155322408 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d10961a280 0x55d1099e1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:51.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.361+0000 7fec4b59e640 1 -- 172.21.15.5:0/3155322408 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d1096120a0 msgr2=0x55d1099e0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:27:51.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.361+0000 7fec4b59e640 1 --2- 172.21.15.5:0/3155322408 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d1096120a0 0x55d1099e0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:51.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.361+0000 7fec4b59e640 1 -- 172.21.15.5:0/3155322408 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1096a6540 con 0x55d10963af60 2024-08-31T05:27:51.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.361+0000 7fec4a59c640 1 --2- 172.21.15.5:0/3155322408 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d10961a280 0x55d1099e1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:27:51.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.361+0000 7fec4b59e640 1 --2- 172.21.15.5:0/3155322408 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d10963af60 0x55d1099e07b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fec44009f70 tx=0x7fec44010800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=613fb29eb4d26950 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:51.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.362+0000 7fec317fa640 1 -- 172.21.15.5:0/3155322408 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec44016070 con 0x55d10963af60 2024-08-31T05:27:51.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.362+0000 7fec33fff640 1 --2- 172.21.15.5:0/974448636 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fec340b4b80 0x7fec340b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:51.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.362+0000 7fec317fa640 1 -- 172.21.15.5:0/3155322408 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec44004d20 con 0x55d10963af60 2024-08-31T05:27:51.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.362+0000 7fec317fa640 1 -- 172.21.15.5:0/3155322408 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec44012770 con 0x55d10963af60 2024-08-31T05:27:51.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.362+0000 7fec4ad9d640 1 --2- 172.21.15.5:0/974448636 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fec340b4b80 0x7fec340b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:51.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.362+0000 7fec33fff640 1 -- 172.21.15.5:0/974448636 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9017+0+0 (secure 0 0 0) 0x7fec3c105cc0 con 0x7fec4c1046a0 2024-08-31T05:27:51.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.363+0000 7fec5766f740 1 -- 172.21.15.5:0/3155322408 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d10963af60 msgr2=0x55d1099e07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:51.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.363+0000 7fec4ad9d640 1 --2- 172.21.15.5:0/974448636 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fec340b4b80 0x7fec340b7090 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x55d1099df430 tx=0x7fec3c1097a0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:51.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.363+0000 7fec5766f740 1 --2- 172.21.15.5:0/3155322408 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d10963af60 0x55d1099e07b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fec44009f70 tx=0x7fec44010800 comp rx=0 tx=0).stop 2024-08-31T05:27:51.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.363+0000 7fec5766f740 1 -- 172.21.15.5:0/3155322408 shutdown_connections 2024-08-31T05:27:51.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.363+0000 7fec5766f740 1 --2- 172.21.15.5:0/3155322408 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d10961a280 0x55d1099e1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:51.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.363+0000 7fec5766f740 1 --2- 172.21.15.5:0/3155322408 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d1096120a0 0x55d1099e0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:51.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.363+0000 7fec5766f740 1 --2- 172.21.15.5:0/3155322408 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d10963af60 0x55d1099e07b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:51.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.363+0000 7fec5766f740 1 -- 172.21.15.5:0/3155322408 >> 172.21.15.5:0/3155322408 conn(0x55d10962f350 msgr2=0x55d1099de6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:51.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.363+0000 7fec5766f740 1 -- 172.21.15.5:0/3155322408 shutdown_connections 2024-08-31T05:27:51.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.363+0000 7fec5766f740 1 -- 172.21.15.5:0/3155322408 wait complete. 2024-08-31T05:27:51.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.363+0000 7fec5766f740 1 -- start start 2024-08-31T05:27:51.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.363+0000 7fec5766f740 1 Processor -- start 2024-08-31T05:27:51.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.363+0000 7fec5766f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d1096120a0 0x55d1099ebea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:51.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.364+0000 7fec5766f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d10961a280 0x55d1099ec3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:51.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.364+0000 7fec5766f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d10963af60 0x55d1099f82b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:51.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.364+0000 7fec5766f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55d1097a95f0 con 0x55d1096120a0 2024-08-31T05:27:51.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.364+0000 7fec5766f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d1098cd600 con 0x55d10963af60 2024-08-31T05:27:51.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.364+0000 7fec5766f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d1099eef90 con 0x55d10961a280 2024-08-31T05:27:51.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.364+0000 7fec5766f740 10 client.0 _ll_register_callbacks cb 0x55d1098f3af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:27:51.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.364+0000 7fec4b59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d1096120a0 0x55d1099ebea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:51.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.364+0000 7fec4b59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d1096120a0 0x55d1099ebea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41282/0 (socket says 172.21.15.5:41282) 2024-08-31T05:27:51.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.364+0000 7fec4b59e640 1 -- 172.21.15.5:0/2560694199 learned_addr learned my addr 172.21.15.5:0/2560694199 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:27:51.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.364+0000 7fec4a59c640 1 --2- 172.21.15.5:0/2560694199 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d10961a280 0x55d1099ec3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:51.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.364+0000 7fec4b59e640 1 --2- 172.21.15.5:0/2560694199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d10963af60 0x55d1099f82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:51.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.364+0000 7fec4b59e640 1 -- 172.21.15.5:0/2560694199 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d10961a280 msgr2=0x55d1099ec3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:27:51.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.364+0000 7fec4b59e640 1 --2- 172.21.15.5:0/2560694199 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d10961a280 0x55d1099ec3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:51.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.364+0000 7fec4b59e640 1 -- 172.21.15.5:0/2560694199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d10963af60 msgr2=0x55d1099f82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:27:51.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.364+0000 7fec4b59e640 1 --2- 172.21.15.5:0/2560694199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d10963af60 0x55d1099f82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:51.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.364+0000 7fec4b59e640 1 -- 172.21.15.5:0/2560694199 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1099067b0 con 0x55d1096120a0 2024-08-31T05:27:51.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.364+0000 7fec4b59e640 1 --2- 172.21.15.5:0/2560694199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d1096120a0 0x55d1099ebea0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fec440098b0 tx=0x7fec44009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58f1cc0d7151463c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:51.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.364+0000 7fec2eff5640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:27:51.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.364+0000 7fec2eff5640 1 -- 172.21.15.5:0/2560694199 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec44016070 con 0x55d1096120a0 2024-08-31T05:27:51.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.364+0000 7fec2eff5640 1 -- 172.21.15.5:0/2560694199 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 9017+0+0 (secure 0 0 0) 0x7fec44012530 con 0x55d1096120a0 2024-08-31T05:27:51.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.364+0000 7fec5766f740 1 -- 172.21.15.5:0/2560694199 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec44004d20 con 0x55d1096120a0 2024-08-31T05:27:51.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.365+0000 7fec2eff5640 1 -- 172.21.15.5:0/2560694199 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fec440056a0 con 0x55d1096120a0 2024-08-31T05:27:51.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.365+0000 7fec5766f740 10 client.14928 fetch_fsmap learned FSMap version 17 2024-08-31T05:27:51.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.365+0000 7fec5766f740 1 -- 172.21.15.5:0/2560694199 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x55d1099faca0 con 0x55d1096120a0 2024-08-31T05:27:51.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.365+0000 7fec2eff5640 1 -- 172.21.15.5:0/2560694199 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec44004d20 con 0x55d1096120a0 2024-08-31T05:27:51.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.365+0000 7fec2eff5640 1 -- 172.21.15.5:0/2560694199 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7fec4400f040 con 0x55d1096120a0 2024-08-31T05:27:51.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.365+0000 7fec5766f740 10 client.14928 fetch_fsmap finished waiting for FSMap version 17 2024-08-31T05:27:51.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.365+0000 7fec5766f740 10 client.14928 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-31T05:27:51.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.365+0000 7fec5766f740 20 client.14928 populate_metadata read hostname 'smithi005' 2024-08-31T05:27:51.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.365+0000 7fec5766f740 1 --2- 172.21.15.5:0/2560694199 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d1095f98e0 0x55d1099fe290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:51.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.365+0000 7fec5766f740 4 client.14928 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:27:51.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.365+0000 7fec5766f740 1 -- 172.21.15.5:0/2560694199 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d109959340 con 0x55d1095f98e0 2024-08-31T05:27:51.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.365+0000 7fec4a59c640 1 --2- 172.21.15.5:0/2560694199 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d1095f98e0 0x55d1099fe290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:51.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.366+0000 7fec2eff5640 10 client.14928 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:27:51.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.366+0000 7fec4a59c640 1 --2- 172.21.15.5:0/2560694199 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d1095f98e0 0x55d1099fe290 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df5bf34c9e1b44b server_cookie=ce178075198a64b5 in_seq=0 out_seq=0 2024-08-31T05:27:51.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.367+0000 7fec2eff5640 1 -- 172.21.15.5:0/2560694199 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d109959340 con 0x55d1095f98e0 2024-08-31T05:27:51.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.367+0000 7fec2eff5640 10 client.14928 handle_command_reply: tid=0 2024-08-31T05:27:51.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.367+0000 7fec5766f740 1 client.14928 shutdown 2024-08-31T05:27:51.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.367+0000 7fec5766f740 1 -- 172.21.15.5:0/2560694199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d1096120a0 msgr2=0x55d1099ebea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:51.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.367+0000 7fec5766f740 1 --2- 172.21.15.5:0/2560694199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d1096120a0 0x55d1099ebea0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fec440098b0 tx=0x7fec44009800 comp rx=0 tx=0).stop 2024-08-31T05:27:51.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.367+0000 7fec5766f740 1 -- 172.21.15.5:0/2560694199 shutdown_connections 2024-08-31T05:27:51.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.367+0000 7fec5766f740 1 --2- 172.21.15.5:0/2560694199 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d1095f98e0 0x55d1099fe290 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:51.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.367+0000 7fec5766f740 1 --2- 172.21.15.5:0/2560694199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d10963af60 0x55d1099f82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:51.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.367+0000 7fec5766f740 1 --2- 172.21.15.5:0/2560694199 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d10961a280 0x55d1099ec3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:51.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.367+0000 7fec2eff5640 0 client.14928 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:27:51.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.367+0000 7fec5766f740 1 --2- 172.21.15.5:0/2560694199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d1096120a0 0x55d1099ebea0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:51.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.367+0000 7fec5766f740 1 -- 172.21.15.5:0/2560694199 >> 172.21.15.5:0/2560694199 conn(0x55d10962f350 msgr2=0x55d1099e3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:51.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.367+0000 7fec5766f740 1 -- 172.21.15.5:0/2560694199 shutdown_connections 2024-08-31T05:27:51.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.367+0000 7fec5766f740 1 -- 172.21.15.5:0/2560694199 wait complete. 2024-08-31T05:27:51.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.367+0000 7fec5766f740 20 client.14928 trim_cache size 0 max 16384 2024-08-31T05:27:51.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.385+0000 7fec5766f740 1 Processor -- start 2024-08-31T05:27:51.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.386+0000 7fec5766f740 1 -- start start 2024-08-31T05:27:51.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.386+0000 7fec5766f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d1096120a0 0x55d1099f8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:51.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.386+0000 7fec5766f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d10961a280 0x55d1099ebe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:51.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.386+0000 7fec5766f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d10963af60 0x55d1099ec350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:51.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.386+0000 7fec5766f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55d1099fc5d0 con 0x55d10961a280 2024-08-31T05:27:51.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.386+0000 7fec5766f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d1099fcca0 con 0x55d10963af60 2024-08-31T05:27:51.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.386+0000 7fec5766f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d1099fd370 con 0x55d1096120a0 2024-08-31T05:27:51.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.386+0000 7fec4a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d10961a280 0x55d1099ebe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:51.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.386+0000 7fec4a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d10961a280 0x55d1099ebe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41296/0 (socket says 172.21.15.5:41296) 2024-08-31T05:27:51.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.386+0000 7fec4a59c640 1 -- 172.21.15.5:0/1599264576 learned_addr learned my addr 172.21.15.5:0/1599264576 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:27:51.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.386+0000 7fec4b59e640 1 --2- 172.21.15.5:0/1599264576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d1096120a0 0x55d1099f8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:51.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.386+0000 7fec4a59c640 1 -- 172.21.15.5:0/1599264576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d1096120a0 msgr2=0x55d1099f8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:27:51.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.386+0000 7fec4a59c640 1 --2- 172.21.15.5:0/1599264576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d1096120a0 0x55d1099f8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:51.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.386+0000 7fec4b59e640 1 --2- 172.21.15.5:0/1599264576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d10963af60 0x55d1099ec350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:51.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.386+0000 7fec4a59c640 1 -- 172.21.15.5:0/1599264576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d10963af60 msgr2=0x55d1099ec350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:27:51.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.386+0000 7fec4a59c640 1 --2- 172.21.15.5:0/1599264576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d10963af60 0x55d1099ec350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:51.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.386+0000 7fec4a59c640 1 -- 172.21.15.5:0/1599264576 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1099ec980 con 0x55d10961a280 2024-08-31T05:27:51.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.386+0000 7fec4a59c640 1 --2- 172.21.15.5:0/1599264576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d10961a280 0x55d1099ebe10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fec4c0fff10 tx=0x7fec4000b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=452071fe95b77c92 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:51.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.387+0000 7fec30ff9640 1 -- 172.21.15.5:0/1599264576 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec40003e20 con 0x55d10961a280 2024-08-31T05:27:51.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.387+0000 7fec30ff9640 1 -- 172.21.15.5:0/1599264576 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec400054d0 con 0x55d10961a280 2024-08-31T05:27:51.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.387+0000 7fec30ff9640 1 -- 172.21.15.5:0/1599264576 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec400116a0 con 0x55d10961a280 2024-08-31T05:27:51.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.387+0000 7fec5766f740 1 -- 172.21.15.5:0/1599264576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d10961a280 msgr2=0x55d1099ebe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:51.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.387+0000 7fec5766f740 1 --2- 172.21.15.5:0/1599264576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d10961a280 0x55d1099ebe10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fec4c0fff10 tx=0x7fec4000b390 comp rx=0 tx=0).stop 2024-08-31T05:27:51.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.387+0000 7fec5766f740 1 -- 172.21.15.5:0/1599264576 shutdown_connections 2024-08-31T05:27:51.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.387+0000 7fec5766f740 1 --2- 172.21.15.5:0/1599264576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d10963af60 0x55d1099ec350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:51.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.387+0000 7fec5766f740 1 --2- 172.21.15.5:0/1599264576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d10961a280 0x55d1099ebe10 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:51.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.387+0000 7fec5766f740 1 --2- 172.21.15.5:0/1599264576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d1096120a0 0x55d1099f8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:51.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.388+0000 7fec5766f740 1 -- 172.21.15.5:0/1599264576 >> 172.21.15.5:0/1599264576 conn(0x55d10962f350 msgr2=0x55d1099d9400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:51.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.388+0000 7fec5766f740 1 -- 172.21.15.5:0/1599264576 shutdown_connections 2024-08-31T05:27:51.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.388+0000 7fec5766f740 1 -- 172.21.15.5:0/1599264576 wait complete. 2024-08-31T05:27:51.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.388+0000 7fec5766f740 1 -- start start 2024-08-31T05:27:51.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.388+0000 7fec5766f740 1 Processor -- start 2024-08-31T05:27:51.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.388+0000 7fec5766f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d1096120a0 0x55d109a05400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:51.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.388+0000 7fec5766f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d10961a280 0x55d109a05940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:51.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.388+0000 7fec5766f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d10963af60 0x55d1099ffaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:51.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.388+0000 7fec5766f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55d1099fe110 con 0x55d10961a280 2024-08-31T05:27:51.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.388+0000 7fec5766f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d1099fda40 con 0x55d1096120a0 2024-08-31T05:27:51.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.388+0000 7fec5766f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d1099fe7e0 con 0x55d10963af60 2024-08-31T05:27:51.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.388+0000 7fec5766f740 10 client.0 _ll_register_callbacks cb 0x7fec44009df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:27:51.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.388+0000 7fec4a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d10961a280 0x55d109a05940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:51.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.389+0000 7fec4b59e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d1096120a0 0x55d109a05400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:51.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.389+0000 7fec4a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d10961a280 0x55d109a05940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41300/0 (socket says 172.21.15.5:41300) 2024-08-31T05:27:51.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.389+0000 7fec4a59c640 1 -- 172.21.15.5:0/4153976294 learned_addr learned my addr 172.21.15.5:0/4153976294 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:27:51.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.389+0000 7fec4b59e640 1 --2- 172.21.15.5:0/4153976294 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d10963af60 0x55d1099ffaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:51.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.389+0000 7fec4a59c640 1 -- 172.21.15.5:0/4153976294 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d10963af60 msgr2=0x55d1099ffaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:27:51.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.389+0000 7fec4a59c640 1 --2- 172.21.15.5:0/4153976294 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d10963af60 0x55d1099ffaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:51.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.389+0000 7fec4a59c640 1 -- 172.21.15.5:0/4153976294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d1096120a0 msgr2=0x55d109a05400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:27:51.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.389+0000 7fec4a59c640 1 --2- 172.21.15.5:0/4153976294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d1096120a0 0x55d109a05400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:51.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.389+0000 7fec4a59c640 1 -- 172.21.15.5:0/4153976294 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1099fffe0 con 0x55d10961a280 2024-08-31T05:27:51.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.389+0000 7fec4a59c640 1 --2- 172.21.15.5:0/4153976294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d10961a280 0x55d109a05940 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fec4000b5f0 tx=0x7fec4000b970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab9349fb7771d262 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:51.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.389+0000 7fec2eff5640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:27:51.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.389+0000 7fec2eff5640 1 -- 172.21.15.5:0/4153976294 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec400049a0 con 0x55d10961a280 2024-08-31T05:27:51.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.389+0000 7fec2eff5640 1 -- 172.21.15.5:0/4153976294 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 9017+0+0 (secure 0 0 0) 0x7fec40003c20 con 0x55d10961a280 2024-08-31T05:27:51.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.389+0000 7fec5766f740 1 -- 172.21.15.5:0/4153976294 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec400054d0 con 0x55d10961a280 2024-08-31T05:27:51.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.390+0000 7fec2eff5640 1 -- 172.21.15.5:0/4153976294 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fec4003a050 con 0x55d10961a280 2024-08-31T05:27:51.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.390+0000 7fec5766f740 10 client.14934 fetch_fsmap learned FSMap version 17 2024-08-31T05:27:51.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.390+0000 7fec5766f740 1 -- 172.21.15.5:0/4153976294 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x55d109a06960 con 0x55d10961a280 2024-08-31T05:27:51.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.390+0000 7fec2eff5640 1 -- 172.21.15.5:0/4153976294 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec400054d0 con 0x55d10961a280 2024-08-31T05:27:51.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.390+0000 7fec2eff5640 1 -- 172.21.15.5:0/4153976294 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7fec40011cd0 con 0x55d10961a280 2024-08-31T05:27:51.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.390+0000 7fec5766f740 10 client.14934 fetch_fsmap finished waiting for FSMap version 17 2024-08-31T05:27:51.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.390+0000 7fec5766f740 10 client.14934 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-31T05:27:51.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.390+0000 7fec5766f740 20 client.14934 populate_metadata read hostname 'smithi005' 2024-08-31T05:27:51.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.390+0000 7fec5766f740 1 --2- 172.21.15.5:0/4153976294 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d1095cec90 0x55d109a6c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:51.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.390+0000 7fec5766f740 4 client.14934 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T05:27:51.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.390+0000 7fec5766f740 1 -- 172.21.15.5:0/4153976294 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "status"}) -- 0x55d109954de0 con 0x55d1095cec90 2024-08-31T05:27:51.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.390+0000 7fec4b59e640 1 --2- 172.21.15.5:0/4153976294 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d1095cec90 0x55d109a6c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:51.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.391+0000 7fec2eff5640 10 client.14934 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:27:51.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.391+0000 7fec4b59e640 1 --2- 172.21.15.5:0/4153976294 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d1095cec90 0x55d109a6c410 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3ed9740b717139b server_cookie=21ecfcaa93cceee2 in_seq=0 out_seq=0 2024-08-31T05:27:51.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.391+0000 7fec2eff5640 1 -- 172.21.15.5:0/4153976294 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55d109954de0 con 0x55d1095cec90 2024-08-31T05:27:51.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.391+0000 7fec2eff5640 10 client.14934 handle_command_reply: tid=0 2024-08-31T05:27:51.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.391+0000 7fec5766f740 1 client.14934 shutdown 2024-08-31T05:27:51.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.391+0000 7fec5766f740 1 -- 172.21.15.5:0/4153976294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d10961a280 msgr2=0x55d109a05940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:51.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.391+0000 7fec5766f740 1 --2- 172.21.15.5:0/4153976294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d10961a280 0x55d109a05940 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fec4000b5f0 tx=0x7fec4000b970 comp rx=0 tx=0).stop 2024-08-31T05:27:51.456 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:27:51.456 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "69422704-6758-11ef-bcd4-c7b262605968", 2024-08-31T05:27:51.456 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-08-31T05:27:51.457 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 24652, 2024-08-31T05:27:51.457 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-08-31T05:27:51.457 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-08-31T05:27:51.457 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-08-31T05:27:51.457 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 19.141365829000001, 2024-08-31T05:27:51.457 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 17, 2024-08-31T05:27:51.457 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 83, 2024-08-31T05:27:51.457 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 83, 2024-08-31T05:27:51.457 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 39.025561647000004 2024-08-31T05:27:51.457 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:27:51.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.391+0000 7fec5766f740 1 -- 172.21.15.5:0/4153976294 shutdown_connections 2024-08-31T05:27:51.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.391+0000 7fec5766f740 1 --2- 172.21.15.5:0/4153976294 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d1095cec90 0x55d109a6c410 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:51.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.391+0000 7fec5766f740 1 --2- 172.21.15.5:0/4153976294 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d10963af60 0x55d1099ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:51.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.391+0000 7fec2eff5640 0 client.14934 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:27:51.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.391+0000 7fec5766f740 1 --2- 172.21.15.5:0/4153976294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d10961a280 0x55d109a05940 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:51.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.391+0000 7fec5766f740 1 --2- 172.21.15.5:0/4153976294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d1096120a0 0x55d109a05400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:51.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.391+0000 7fec5766f740 1 -- 172.21.15.5:0/4153976294 >> 172.21.15.5:0/4153976294 conn(0x55d10962f350 msgr2=0x55d1099ddf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:51.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.391+0000 7fec5766f740 1 -- 172.21.15.5:0/4153976294 shutdown_connections 2024-08-31T05:27:51.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.391+0000 7fec5766f740 1 -- 172.21.15.5:0/4153976294 wait complete. 2024-08-31T05:27:51.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.392+0000 7fec5766f740 20 client.14934 trim_cache size 0 max 16384 2024-08-31T05:27:51.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.392+0000 7fec510fa640 1 -- 172.21.15.5:0/974448636 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fec340b4b80 msgr2=0x7fec340b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:51.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.392+0000 7fec510fa640 1 --2- 172.21.15.5:0/974448636 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fec340b4b80 0x7fec340b7090 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x55d1099df430 tx=0x7fec3c1097a0 comp rx=0 tx=0).stop 2024-08-31T05:27:51.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.392+0000 7fec510fa640 1 -- 172.21.15.5:0/974448636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec4c1046a0 msgr2=0x7fec4c19a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:51.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.392+0000 7fec510fa640 1 --2- 172.21.15.5:0/974448636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec4c1046a0 0x7fec4c19a270 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fec3c005940 tx=0x7fec3c0042f0 comp rx=0 tx=0).stop 2024-08-31T05:27:51.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.392+0000 7fec510fa640 1 -- 172.21.15.5:0/974448636 shutdown_connections 2024-08-31T05:27:51.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.392+0000 7fec510fa640 1 --2- 172.21.15.5:0/974448636 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fec340b4b80 0x7fec340b7090 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:51.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.392+0000 7fec510fa640 1 --2- 172.21.15.5:0/974448636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec4c10dc50 0x7fec4c19fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:51.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.392+0000 7fec510fa640 1 --2- 172.21.15.5:0/974448636 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec4c104ff0 0x7fec4c19a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:51.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.392+0000 7fec510fa640 1 --2- 172.21.15.5:0/974448636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec4c1046a0 0x7fec4c19a270 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:51.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.392+0000 7fec510fa640 1 -- 172.21.15.5:0/974448636 >> 172.21.15.5:0/974448636 conn(0x7fec4c079530 msgr2=0x7fec4c1077f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:51.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.392+0000 7fec510fa640 1 -- 172.21.15.5:0/974448636 shutdown_connections 2024-08-31T05:27:51.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:51.392+0000 7fec510fa640 1 -- 172.21.15.5:0/974448636 wait complete. 2024-08-31T05:27:52.173 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-08-31T05:27:52.174 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-08-31T05:27:52.174 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs ls 2024-08-31T05:27:52.428 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:27:52.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:52 smithi070 ceph-mon[22316]: pgmap v278: 129 pgs: 129 active+clean; 579 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:52.849 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:52 smithi005 ceph-mon[18602]: pgmap v278: 129 pgs: 129 active+clean; 579 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:52.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:52 smithi050 ceph-mon[22146]: pgmap v278: 129 pgs: 129 active+clean; 579 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:53.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:52.938+0000 7f6dc84a0640 1 -- 172.21.15.5:0/1176717308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6dc01058d0 msgr2=0x7f6dc010f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:53.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:52.938+0000 7f6dc84a0640 1 --2- 172.21.15.5:0/1176717308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6dc01058d0 0x7f6dc010f320 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6db8009ca0 tx=0x7f6db802a8c0 comp rx=0 tx=0).stop 2024-08-31T05:27:53.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:52.938+0000 7f6dc84a0640 1 -- 172.21.15.5:0/1176717308 shutdown_connections 2024-08-31T05:27:53.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:52.938+0000 7f6dc84a0640 1 --2- 172.21.15.5:0/1176717308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6dc01058d0 0x7f6dc010f320 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:53.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:52.938+0000 7f6dc84a0640 1 --2- 172.21.15.5:0/1176717308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dc0104f80 0x7f6dc0105390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:53.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:52.938+0000 7f6dc84a0640 1 --2- 172.21.15.5:0/1176717308 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6dc0102fb0 0x7f6dc01033c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:53.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:52.938+0000 7f6dc84a0640 1 -- 172.21.15.5:0/1176717308 >> 172.21.15.5:0/1176717308 conn(0x7f6dc0079d30 msgr2=0x7f6dc007a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:53.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:52.939+0000 7f6dc84a0640 1 -- 172.21.15.5:0/1176717308 shutdown_connections 2024-08-31T05:27:53.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:52.939+0000 7f6dc84a0640 1 -- 172.21.15.5:0/1176717308 wait complete. 2024-08-31T05:27:53.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:52.939+0000 7f6dc84a0640 1 Processor -- start 2024-08-31T05:27:53.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:52.939+0000 7f6dc84a0640 1 -- start start 2024-08-31T05:27:53.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:52.940+0000 7f6dc84a0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6dc0102fb0 0x7f6dc019a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:53.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:52.940+0000 7f6dc84a0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6dc0104f80 0x7f6dc019a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:53.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:52.940+0000 7f6dc84a0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dc01058d0 0x7f6dc019fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:53.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:52.940+0000 7f6dc84a0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc01127e0 con 0x7f6dc0104f80 2024-08-31T05:27:53.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:52.940+0000 7f6dc84a0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc0112660 con 0x7f6dc01058d0 2024-08-31T05:27:53.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:52.940+0000 7f6dc84a0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc0112960 con 0x7f6dc0102fb0 2024-08-31T05:27:53.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:52.940+0000 7f6dc5a3b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6dc0104f80 0x7f6dc019a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:53.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:52.940+0000 7f6dc5a3b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6dc0104f80 0x7f6dc019a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51152/0 (socket says 172.21.15.5:51152) 2024-08-31T05:27:53.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:52.940+0000 7f6dc5a3b640 1 -- 172.21.15.5:0/140311518 learned_addr learned my addr 172.21.15.5:0/140311518 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:27:53.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:52.940+0000 7f6dc623c640 1 --2- 172.21.15.5:0/140311518 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6dc0102fb0 0x7f6dc019a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:53.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:52.940+0000 7f6dc6a3d640 1 --2- 172.21.15.5:0/140311518 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dc01058d0 0x7f6dc019fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:53.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:52.940+0000 7f6dc5a3b640 1 -- 172.21.15.5:0/140311518 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6dc0102fb0 msgr2=0x7f6dc019a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:53.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:52.940+0000 7f6dc5a3b640 1 --2- 172.21.15.5:0/140311518 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6dc0102fb0 0x7f6dc019a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:53.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:52.940+0000 7f6dc5a3b640 1 -- 172.21.15.5:0/140311518 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dc01058d0 msgr2=0x7f6dc019fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:53.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:52.940+0000 7f6dc5a3b640 1 --2- 172.21.15.5:0/140311518 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dc01058d0 0x7f6dc019fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:53.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:52.940+0000 7f6dc5a3b640 1 -- 172.21.15.5:0/140311518 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dc01a0230 con 0x7f6dc0104f80 2024-08-31T05:27:53.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:52.940+0000 7f6dc5a3b640 1 --2- 172.21.15.5:0/140311518 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6dc0104f80 0x7f6dc019a860 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6db000c970 tx=0x7f6db000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:53.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:52.940+0000 7f6db77fe640 1 -- 172.21.15.5:0/140311518 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db0007bb0 con 0x7f6dc0104f80 2024-08-31T05:27:53.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:52.940+0000 7f6db77fe640 1 -- 172.21.15.5:0/140311518 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6db0007d50 con 0x7f6dc0104f80 2024-08-31T05:27:53.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:52.940+0000 7f6dc84a0640 1 -- 172.21.15.5:0/140311518 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dc01a0520 con 0x7f6dc0104f80 2024-08-31T05:27:53.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:52.940+0000 7f6db77fe640 1 -- 172.21.15.5:0/140311518 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db000f450 con 0x7f6dc0104f80 2024-08-31T05:27:53.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:52.940+0000 7f6dc84a0640 1 -- 172.21.15.5:0/140311518 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dc01a6c80 con 0x7f6dc0104f80 2024-08-31T05:27:53.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:52.941+0000 7f6dc84a0640 1 -- 172.21.15.5:0/140311518 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dc01033c0 con 0x7f6dc0104f80 2024-08-31T05:27:53.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:52.943+0000 7f6db77fe640 1 -- 172.21.15.5:0/140311518 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f6db0004f20 con 0x7f6dc0104f80 2024-08-31T05:27:53.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:52.944+0000 7f6db77fe640 1 --2- 172.21.15.5:0/140311518 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f6dac0b4b80 0x7f6dac0b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:53.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:52.944+0000 7f6dc623c640 1 --2- 172.21.15.5:0/140311518 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f6dac0b4b80 0x7f6dac0b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:53.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:52.944+0000 7f6db77fe640 1 -- 172.21.15.5:0/140311518 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9017+0+0 (secure 0 0 0) 0x7f6db00e5600 con 0x7f6dc0104f80 2024-08-31T05:27:53.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:52.944+0000 7f6dc623c640 1 --2- 172.21.15.5:0/140311518 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f6dac0b4b80 0x7f6dac0b7090 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc009890 tx=0x7f6dbc008040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:53.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:52.947+0000 7f6db77fe640 1 -- 172.21.15.5:0/140311518 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6db0014030 con 0x7f6dc0104f80 2024-08-31T05:27:53.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:53.172+0000 7f6dc84a0640 1 -- 172.21.15.5:0/140311518 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6dc019b3f0 con 0x7f6dc0104f80 2024-08-31T05:27:53.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:53.173+0000 7f6db77fe640 1 -- 172.21.15.5:0/140311518 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+88 (secure 0 0 0) 0x7f6dc019b3f0 con 0x7f6dc0104f80 2024-08-31T05:27:53.175 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-08-31T05:27:53.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:53.175+0000 7f6dc84a0640 1 -- 172.21.15.5:0/140311518 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f6dac0b4b80 msgr2=0x7f6dac0b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:53.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:53.175+0000 7f6dc84a0640 1 --2- 172.21.15.5:0/140311518 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f6dac0b4b80 0x7f6dac0b7090 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc009890 tx=0x7f6dbc008040 comp rx=0 tx=0).stop 2024-08-31T05:27:53.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:53.175+0000 7f6dc84a0640 1 -- 172.21.15.5:0/140311518 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6dc0104f80 msgr2=0x7f6dc019a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:53.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:53.175+0000 7f6dc84a0640 1 --2- 172.21.15.5:0/140311518 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6dc0104f80 0x7f6dc019a860 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6db000c970 tx=0x7f6db000ce30 comp rx=0 tx=0).stop 2024-08-31T05:27:53.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:53.175+0000 7f6dc84a0640 1 -- 172.21.15.5:0/140311518 shutdown_connections 2024-08-31T05:27:53.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:53.175+0000 7f6dc84a0640 1 --2- 172.21.15.5:0/140311518 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f6dac0b4b80 0x7f6dac0b7090 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:53.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:53.175+0000 7f6dc84a0640 1 --2- 172.21.15.5:0/140311518 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6dc01058d0 0x7f6dc019fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:53.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:53.175+0000 7f6dc84a0640 1 --2- 172.21.15.5:0/140311518 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6dc0104f80 0x7f6dc019a860 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:53.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:53.175+0000 7f6dc84a0640 1 --2- 172.21.15.5:0/140311518 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6dc0102fb0 0x7f6dc019a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:53.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:53.175+0000 7f6dc84a0640 1 -- 172.21.15.5:0/140311518 >> 172.21.15.5:0/140311518 conn(0x7f6dc0079d30 msgr2=0x7f6dc01062e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:53.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:53.175+0000 7f6dc84a0640 1 -- 172.21.15.5:0/140311518 shutdown_connections 2024-08-31T05:27:53.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:53.175+0000 7f6dc84a0640 1 -- 172.21.15.5:0/140311518 wait complete. 2024-08-31T05:27:53.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:53 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/140311518' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-08-31T05:27:53.796 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:53 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/140311518' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-08-31T05:27:53.824 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-31T05:27:53.824 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-31T05:27:53.824 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-08-31T05:27:53.824 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-08-31T05:27:53.825 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-08-31T05:27:53.825 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-31T05:27:53.825 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-31T05:27:53.825 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-31T05:27:53.825 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-08-31T05:27:53.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T05:27:53.825 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-08-31T05:27:53.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:53 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/140311518' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-08-31T05:27:53.842 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-31T05:27:53.842 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-31T05:27:53.842 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-08-31T05:27:53.843 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-31T05:27:53.843 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-08-31T05:27:53.843 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-31T05:27:53.843 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-31T05:27:53.843 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-08-31T05:27:53.843 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-08-31T05:27:53.843 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-31T05:27:53.843 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-08-31T05:27:53.843 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-08-31T05:27:53.843 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-31T05:27:53.843 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-08-31T05:27:53.843 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-08-31T05:27:53.843 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-31T05:27:53.843 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42300sec preferred_lft 42300sec 2024-08-31T05:27:53.844 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::5e23:6663:4f43:f7c4/64 scope link noprefixroute 2024-08-31T05:27:53.844 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-31T05:27:53.844 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-31T05:27:53.844 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-08-31T05:27:53.844 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-08-31T05:27:53.844 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-31T05:27:53.845 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T05:27:53.845 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-31T05:27:53.845 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add name ceph-brx type bridge 2024-08-31T05:27:53.845 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip addr flush dev ceph-brx 2024-08-31T05:27:53.845 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set ceph-brx up 2024-08-31T05:27:53.845 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-31T05:27:53.845 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-31T05:27:53.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T05:27:54.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T05:27:54.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T05:27:54.066 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-31T05:27:54.091 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-08-31T05:27:54.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T05:27:54.094 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-08-31T05:27:54.168 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-08-31T05:27:54.168 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-31T05:27:54.168 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-31T05:27:54.169 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-31T05:27:54.169 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-31T05:27:54.169 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T05:27:54.169 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-31T05:27:54.169 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-31T05:27:54.169 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-31T05:27:54.169 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-31T05:27:54.170 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-31T05:27:54.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T05:27:54.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T05:27:54.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T05:27:54.451 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-08-31T05:27:54.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T05:27:54.467 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list-id 2024-08-31T05:27:54.522 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T05:27:54.522 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-31T05:27:54.523 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-31T05:27:54.523 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-08-31T05:27:54.523 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-31T05:27:54.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T05:27:54.618 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:54 smithi005 ceph-mon[18602]: pgmap v279: 129 pgs: 129 active+clean; 579 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:54.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T05:27:54.640 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-08-31T05:27:54.641 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T05:27:54.641 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-31T05:27:54.641 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-08-31T05:27:54.641 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-31T05:27:54.641 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-08-31T05:27:54.641 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-08-31T05:27:54.641 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-08-31T05:27:54.641 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-31T05:27:54.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T05:27:54.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T05:27:54.765 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T05:27:54.765 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-31T05:27:54.765 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2024-08-31T05:27:54.765 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set dev brx.0 master ceph-brx 2024-08-31T05:27:54.765 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-31T05:27:54.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T05:27:54.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T05:27:54.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:54 smithi070 ceph-mon[22316]: pgmap v279: 129 pgs: 129 active+clean; 579 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:54.842 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-08-31T05:27:54.842 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-31T05:27:54.842 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-08-31T05:27:54.857 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-08-31T05:27:54.857 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-31T05:27:54.857 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-08-31T05:27:54.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:54 smithi050 ceph-mon[22146]: pgmap v279: 129 pgs: 129 active+clean; 579 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:54.911 DEBUG:teuthology.orchestra.run.smithi005:> sudo modprobe fuse 2024-08-31T05:27:54.976 DEBUG:teuthology.orchestra.run.smithi005:> cat /proc/self/mounts | awk '{print $2}' 2024-08-31T05:27:55.032 INFO:teuthology.orchestra.run.smithi005.stdout:/proc 2024-08-31T05:27:55.033 INFO:teuthology.orchestra.run.smithi005.stdout:/sys 2024-08-31T05:27:55.033 INFO:teuthology.orchestra.run.smithi005.stdout:/dev 2024-08-31T05:27:55.033 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/security 2024-08-31T05:27:55.033 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/shm 2024-08-31T05:27:55.033 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/pts 2024-08-31T05:27:55.033 INFO:teuthology.orchestra.run.smithi005.stdout:/run 2024-08-31T05:27:55.033 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup 2024-08-31T05:27:55.033 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/pstore 2024-08-31T05:27:55.033 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/bpf 2024-08-31T05:27:55.033 INFO:teuthology.orchestra.run.smithi005.stdout:/ 2024-08-31T05:27:55.033 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/selinux 2024-08-31T05:27:55.033 INFO:teuthology.orchestra.run.smithi005.stdout:/proc/sys/fs/binfmt_misc 2024-08-31T05:27:55.034 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/hugepages 2024-08-31T05:27:55.034 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/mqueue 2024-08-31T05:27:55.034 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/debug 2024-08-31T05:27:55.034 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/tracing 2024-08-31T05:27:55.034 INFO:teuthology.orchestra.run.smithi005.stdout:/run/credentials/systemd-sysusers.service 2024-08-31T05:27:55.034 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/config 2024-08-31T05:27:55.034 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/fuse/connections 2024-08-31T05:27:55.034 INFO:teuthology.orchestra.run.smithi005.stdout:/run/credentials/systemd-sysctl.service 2024-08-31T05:27:55.034 INFO:teuthology.orchestra.run.smithi005.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-31T05:27:55.034 INFO:teuthology.orchestra.run.smithi005.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-31T05:27:55.034 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/nfs/rpc_pipefs 2024-08-31T05:27:55.034 INFO:teuthology.orchestra.run.smithi005.stdout:/run/user/1000 2024-08-31T05:27:55.035 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/ceph 2024-08-31T05:27:55.035 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay 2024-08-31T05:27:55.035 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/3ec2e51008a7684ea5050fadb4362318531c19666e6dfc2eaa859bf684404e6c/merged 2024-08-31T05:27:55.035 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/dd355e72a662937f2d6a002ed296ada28b55dd32714da35fba39fc9121ababe4/merged 2024-08-31T05:27:55.035 INFO:teuthology.orchestra.run.smithi005.stdout:/run/user/0 2024-08-31T05:27:55.035 INFO:teuthology.orchestra.run.smithi005.stdout:/proc/sys/fs/binfmt_misc 2024-08-31T05:27:55.035 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/576016996c6492ea21bd3b1caacf38da23986ca5506d6dcef890e2a03fe93a63/merged 2024-08-31T05:27:55.035 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/d1c008c57d32df65aba44ae50bc770be115e6c9e11db7b60207c2b27f952dee9/merged 2024-08-31T05:27:55.035 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/b2ec6c56cef94ff426daa846a13d14d872df9419d4afe1aa414eb52ac2ee52b6/merged 2024-08-31T05:27:55.035 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/96de55d49436ddbdeb7dc4a002bd33570c9fe0f08b9c6c71949bc9d4d14be561/merged 2024-08-31T05:27:55.035 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/2f9888fa6081073e31a3c6639aef46f8a7efcf56983edea1aafa7a933eda0dfa/merged 2024-08-31T05:27:55.035 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/1efaca712a6056a8cc2bbf580da3de66c6c2a79a8371f45ca251d6505f5f7ce2/merged 2024-08-31T05:27:55.035 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/2ed77ba678b34265d726534caaceaea1ae00d975759cfed16b3d51878a4fb8ce/merged 2024-08-31T05:27:55.036 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/7425123a9ba48ef84e35e9b834ae5e7ffe444e65c757220ff0317b2730d518a8/merged 2024-08-31T05:27:55.036 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns 2024-08-31T05:27:55.036 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-31T05:27:55.036 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-31T05:27:55.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T05:27:55.036 DEBUG:teuthology.orchestra.run.smithi005:> ls /sys/fs/fuse/connections 2024-08-31T05:27:55.087 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-08-31T05:27:55.088 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-08-31T05:27:55.130 DEBUG:teuthology.orchestra.run.smithi005:> sudo modprobe fuse 2024-08-31T05:27:55.154 DEBUG:teuthology.orchestra.run.smithi005:> cat /proc/self/mounts | awk '{print $2}' 2024-08-31T05:27:55.209 INFO:teuthology.orchestra.run.smithi005.stdout:/proc 2024-08-31T05:27:55.209 INFO:teuthology.orchestra.run.smithi005.stdout:/sys 2024-08-31T05:27:55.210 INFO:teuthology.orchestra.run.smithi005.stdout:/dev 2024-08-31T05:27:55.210 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/security 2024-08-31T05:27:55.210 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/shm 2024-08-31T05:27:55.210 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/pts 2024-08-31T05:27:55.210 INFO:teuthology.orchestra.run.smithi005.stdout:/run 2024-08-31T05:27:55.210 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup 2024-08-31T05:27:55.210 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/pstore 2024-08-31T05:27:55.210 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/bpf 2024-08-31T05:27:55.210 INFO:teuthology.orchestra.run.smithi005.stdout:/ 2024-08-31T05:27:55.210 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/selinux 2024-08-31T05:27:55.210 INFO:teuthology.orchestra.run.smithi005.stdout:/proc/sys/fs/binfmt_misc 2024-08-31T05:27:55.210 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/hugepages 2024-08-31T05:27:55.211 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/mqueue 2024-08-31T05:27:55.211 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/debug 2024-08-31T05:27:55.211 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/tracing 2024-08-31T05:27:55.211 INFO:teuthology.orchestra.run.smithi005.stdout:/run/credentials/systemd-sysusers.service 2024-08-31T05:27:55.211 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/config 2024-08-31T05:27:55.211 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/fuse/connections 2024-08-31T05:27:55.211 INFO:teuthology.orchestra.run.smithi005.stdout:/run/credentials/systemd-sysctl.service 2024-08-31T05:27:55.211 INFO:teuthology.orchestra.run.smithi005.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-31T05:27:55.211 INFO:teuthology.orchestra.run.smithi005.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-31T05:27:55.211 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/nfs/rpc_pipefs 2024-08-31T05:27:55.211 INFO:teuthology.orchestra.run.smithi005.stdout:/run/user/1000 2024-08-31T05:27:55.211 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/ceph 2024-08-31T05:27:55.211 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay 2024-08-31T05:27:55.212 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/3ec2e51008a7684ea5050fadb4362318531c19666e6dfc2eaa859bf684404e6c/merged 2024-08-31T05:27:55.212 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/dd355e72a662937f2d6a002ed296ada28b55dd32714da35fba39fc9121ababe4/merged 2024-08-31T05:27:55.212 INFO:teuthology.orchestra.run.smithi005.stdout:/run/user/0 2024-08-31T05:27:55.212 INFO:teuthology.orchestra.run.smithi005.stdout:/proc/sys/fs/binfmt_misc 2024-08-31T05:27:55.212 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/576016996c6492ea21bd3b1caacf38da23986ca5506d6dcef890e2a03fe93a63/merged 2024-08-31T05:27:55.212 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/d1c008c57d32df65aba44ae50bc770be115e6c9e11db7b60207c2b27f952dee9/merged 2024-08-31T05:27:55.212 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/b2ec6c56cef94ff426daa846a13d14d872df9419d4afe1aa414eb52ac2ee52b6/merged 2024-08-31T05:27:55.212 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/96de55d49436ddbdeb7dc4a002bd33570c9fe0f08b9c6c71949bc9d4d14be561/merged 2024-08-31T05:27:55.212 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/2f9888fa6081073e31a3c6639aef46f8a7efcf56983edea1aafa7a933eda0dfa/merged 2024-08-31T05:27:55.212 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/1efaca712a6056a8cc2bbf580da3de66c6c2a79a8371f45ca251d6505f5f7ce2/merged 2024-08-31T05:27:55.212 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/2ed77ba678b34265d726534caaceaea1ae00d975759cfed16b3d51878a4fb8ce/merged 2024-08-31T05:27:55.212 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/7425123a9ba48ef84e35e9b834ae5e7ffe444e65c757220ff0317b2730d518a8/merged 2024-08-31T05:27:55.212 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns 2024-08-31T05:27:55.213 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-31T05:27:55.213 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-31T05:27:55.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T05:27:55.213 DEBUG:teuthology.orchestra.run.smithi005:> ls /sys/fs/fuse/connections 2024-08-31T05:27:55.259 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi005.stderr:2024-08-31T05:27:55.257+0000 7f8b7278e480 -1 init, newargv = 0x7f8b54054370 newargc=15 2024-08-31T05:27:55.259 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi005.stderr:ceph-fuse[64141]: starting ceph client 2024-08-31T05:27:55.267 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi005.stderr:ceph-fuse[64141]: starting fuse 2024-08-31T05:27:56.369 DEBUG:teuthology.orchestra.run.smithi005:> sudo modprobe fuse 2024-08-31T05:27:56.402 DEBUG:teuthology.orchestra.run.smithi005:> cat /proc/self/mounts | awk '{print $2}' 2024-08-31T05:27:56.461 INFO:teuthology.orchestra.run.smithi005.stdout:/proc 2024-08-31T05:27:56.461 INFO:teuthology.orchestra.run.smithi005.stdout:/sys 2024-08-31T05:27:56.461 INFO:teuthology.orchestra.run.smithi005.stdout:/dev 2024-08-31T05:27:56.461 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/security 2024-08-31T05:27:56.462 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/shm 2024-08-31T05:27:56.462 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/pts 2024-08-31T05:27:56.462 INFO:teuthology.orchestra.run.smithi005.stdout:/run 2024-08-31T05:27:56.462 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/cgroup 2024-08-31T05:27:56.462 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/pstore 2024-08-31T05:27:56.462 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/bpf 2024-08-31T05:27:56.462 INFO:teuthology.orchestra.run.smithi005.stdout:/ 2024-08-31T05:27:56.462 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/selinux 2024-08-31T05:27:56.462 INFO:teuthology.orchestra.run.smithi005.stdout:/proc/sys/fs/binfmt_misc 2024-08-31T05:27:56.462 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/hugepages 2024-08-31T05:27:56.462 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/mqueue 2024-08-31T05:27:56.463 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/debug 2024-08-31T05:27:56.463 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/tracing 2024-08-31T05:27:56.463 INFO:teuthology.orchestra.run.smithi005.stdout:/run/credentials/systemd-sysusers.service 2024-08-31T05:27:56.463 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/kernel/config 2024-08-31T05:27:56.463 INFO:teuthology.orchestra.run.smithi005.stdout:/sys/fs/fuse/connections 2024-08-31T05:27:56.463 INFO:teuthology.orchestra.run.smithi005.stdout:/run/credentials/systemd-sysctl.service 2024-08-31T05:27:56.463 INFO:teuthology.orchestra.run.smithi005.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-31T05:27:56.463 INFO:teuthology.orchestra.run.smithi005.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-31T05:27:56.463 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/nfs/rpc_pipefs 2024-08-31T05:27:56.463 INFO:teuthology.orchestra.run.smithi005.stdout:/run/user/1000 2024-08-31T05:27:56.463 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/ceph 2024-08-31T05:27:56.463 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay 2024-08-31T05:27:56.463 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/3ec2e51008a7684ea5050fadb4362318531c19666e6dfc2eaa859bf684404e6c/merged 2024-08-31T05:27:56.464 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/dd355e72a662937f2d6a002ed296ada28b55dd32714da35fba39fc9121ababe4/merged 2024-08-31T05:27:56.464 INFO:teuthology.orchestra.run.smithi005.stdout:/run/user/0 2024-08-31T05:27:56.464 INFO:teuthology.orchestra.run.smithi005.stdout:/proc/sys/fs/binfmt_misc 2024-08-31T05:27:56.464 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/576016996c6492ea21bd3b1caacf38da23986ca5506d6dcef890e2a03fe93a63/merged 2024-08-31T05:27:56.464 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/d1c008c57d32df65aba44ae50bc770be115e6c9e11db7b60207c2b27f952dee9/merged 2024-08-31T05:27:56.464 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/b2ec6c56cef94ff426daa846a13d14d872df9419d4afe1aa414eb52ac2ee52b6/merged 2024-08-31T05:27:56.464 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/96de55d49436ddbdeb7dc4a002bd33570c9fe0f08b9c6c71949bc9d4d14be561/merged 2024-08-31T05:27:56.464 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/2f9888fa6081073e31a3c6639aef46f8a7efcf56983edea1aafa7a933eda0dfa/merged 2024-08-31T05:27:56.464 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/1efaca712a6056a8cc2bbf580da3de66c6c2a79a8371f45ca251d6505f5f7ce2/merged 2024-08-31T05:27:56.464 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/2ed77ba678b34265d726534caaceaea1ae00d975759cfed16b3d51878a4fb8ce/merged 2024-08-31T05:27:56.464 INFO:teuthology.orchestra.run.smithi005.stdout:/var/lib/containers/storage/overlay/7425123a9ba48ef84e35e9b834ae5e7ffe444e65c757220ff0317b2730d518a8/merged 2024-08-31T05:27:56.464 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns 2024-08-31T05:27:56.464 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-31T05:27:56.464 INFO:teuthology.orchestra.run.smithi005.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-31T05:27:56.465 INFO:teuthology.orchestra.run.smithi005.stdout:/home/ubuntu/cephtest/mnt.admin 2024-08-31T05:27:56.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T05:27:56.465 DEBUG:teuthology.orchestra.run.smithi005:> ls /sys/fs/fuse/connections 2024-08-31T05:27:56.519 INFO:teuthology.orchestra.run.smithi005.stdout:121 2024-08-31T05:27:56.520 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [121] 2024-08-31T05:27:56.520 DEBUG:teuthology.orchestra.run.smithi005:> sudo stdin-killer -- python3 -c ' 2024-08-31T05:27:56.520 DEBUG:teuthology.orchestra.run.smithi005:> import glob 2024-08-31T05:27:56.520 DEBUG:teuthology.orchestra.run.smithi005:> import re 2024-08-31T05:27:56.520 DEBUG:teuthology.orchestra.run.smithi005:> import os 2024-08-31T05:27:56.520 DEBUG:teuthology.orchestra.run.smithi005:> import subprocess 2024-08-31T05:27:56.520 DEBUG:teuthology.orchestra.run.smithi005:> 2024-08-31T05:27:56.520 DEBUG:teuthology.orchestra.run.smithi005:> def _find_admin_socket(client_name): 2024-08-31T05:27:56.520 DEBUG:teuthology.orchestra.run.smithi005:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-08-31T05:27:56.521 DEBUG:teuthology.orchestra.run.smithi005:> files = glob.glob(asok_path) 2024-08-31T05:27:56.521 DEBUG:teuthology.orchestra.run.smithi005:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-08-31T05:27:56.521 DEBUG:teuthology.orchestra.run.smithi005:> 2024-08-31T05:27:56.521 DEBUG:teuthology.orchestra.run.smithi005:> # Given a non-glob path, it better be there 2024-08-31T05:27:56.521 DEBUG:teuthology.orchestra.run.smithi005:> if "*" not in asok_path: 2024-08-31T05:27:56.521 DEBUG:teuthology.orchestra.run.smithi005:> assert(len(files) == 1) 2024-08-31T05:27:56.521 DEBUG:teuthology.orchestra.run.smithi005:> return files[0] 2024-08-31T05:27:56.521 DEBUG:teuthology.orchestra.run.smithi005:> 2024-08-31T05:27:56.521 DEBUG:teuthology.orchestra.run.smithi005:> for f in files: 2024-08-31T05:27:56.521 DEBUG:teuthology.orchestra.run.smithi005:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-31T05:27:56.521 DEBUG:teuthology.orchestra.run.smithi005:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-31T05:27:56.521 DEBUG:teuthology.orchestra.run.smithi005:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-31T05:27:56.521 DEBUG:teuthology.orchestra.run.smithi005:> contents = proc_f.read() 2024-08-31T05:27:56.521 DEBUG:teuthology.orchestra.run.smithi005:> if mountpoint in contents: 2024-08-31T05:27:56.522 DEBUG:teuthology.orchestra.run.smithi005:> return f 2024-08-31T05:27:56.522 DEBUG:teuthology.orchestra.run.smithi005:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-31T05:27:56.522 DEBUG:teuthology.orchestra.run.smithi005:> 2024-08-31T05:27:56.522 DEBUG:teuthology.orchestra.run.smithi005:> print(_find_admin_socket("client.admin")) 2024-08-31T05:27:56.522 DEBUG:teuthology.orchestra.run.smithi005:> ' 2024-08-31T05:27:56.645 INFO:teuthology.orchestra.run.smithi005.stdout:/var/run/ceph/ceph-client.admin.64141.asok 2024-08-31T05:27:56.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T05:27:56.655 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:56 smithi005 ceph-mon[18602]: pgmap v280: 129 pgs: 129 active+clean; 579 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:56.656 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.64141.asok 2024-08-31T05:27:56.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T05:27:56.657 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.64141.asok status 2024-08-31T05:27:56.802 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:27:56.802 INFO:teuthology.orchestra.run.smithi005.stdout: "metadata": { 2024-08-31T05:27:56.803 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_sha1": "d19e6118f7015f0047264006cb0c873528eb3ae6", 2024-08-31T05:27:56.803 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_version": "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)", 2024-08-31T05:27:56.803 INFO:teuthology.orchestra.run.smithi005.stdout: "entity_id": "admin", 2024-08-31T05:27:56.803 INFO:teuthology.orchestra.run.smithi005.stdout: "hostname": "smithi005", 2024-08-31T05:27:56.803 INFO:teuthology.orchestra.run.smithi005.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-08-31T05:27:56.803 INFO:teuthology.orchestra.run.smithi005.stdout: "pid": "64141", 2024-08-31T05:27:56.803 INFO:teuthology.orchestra.run.smithi005.stdout: "root": "/" 2024-08-31T05:27:56.803 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:27:56.803 INFO:teuthology.orchestra.run.smithi005.stdout: "dentry_count": 0, 2024-08-31T05:27:56.803 INFO:teuthology.orchestra.run.smithi005.stdout: "dentry_pinned_count": 0, 2024-08-31T05:27:56.803 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 24716, 2024-08-31T05:27:56.803 INFO:teuthology.orchestra.run.smithi005.stdout: "inst": { 2024-08-31T05:27:56.803 INFO:teuthology.orchestra.run.smithi005.stdout: "name": { 2024-08-31T05:27:56.804 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "client", 2024-08-31T05:27:56.804 INFO:teuthology.orchestra.run.smithi005.stdout: "num": 24716 2024-08-31T05:27:56.804 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:27:56.804 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": { 2024-08-31T05:27:56.804 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-31T05:27:56.804 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:0", 2024-08-31T05:27:56.804 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2812635547 2024-08-31T05:27:56.804 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:27:56.804 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:27:56.804 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": { 2024-08-31T05:27:56.804 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-31T05:27:56.804 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:0", 2024-08-31T05:27:56.804 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2812635547 2024-08-31T05:27:56.804 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:27:56.805 INFO:teuthology.orchestra.run.smithi005.stdout: "inst_str": "client.24716 172.21.15.5:0/2812635547", 2024-08-31T05:27:56.805 INFO:teuthology.orchestra.run.smithi005.stdout: "addr_str": "172.21.15.5:0/2812635547", 2024-08-31T05:27:56.805 INFO:teuthology.orchestra.run.smithi005.stdout: "inode_count": 1, 2024-08-31T05:27:56.805 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_epoch": 17, 2024-08-31T05:27:56.805 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_epoch": 83, 2024-08-31T05:27:56.805 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_epoch_barrier": 0, 2024-08-31T05:27:56.805 INFO:teuthology.orchestra.run.smithi005.stdout: "blocklisted": false, 2024-08-31T05:27:56.805 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs" 2024-08-31T05:27:56.805 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:27:56.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T05:27:56.811 DEBUG:teuthology.orchestra.run.smithi005:> stat --file-system '--printf=%T 2024-08-31T05:27:56.811 DEBUG:teuthology.orchestra.run.smithi005:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-08-31T05:27:56.827 INFO:teuthology.orchestra.run.smithi005.stdout:fuseblk 2024-08-31T05:27:56.827 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-08-31T05:27:56.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T05:27:56.827 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-08-31T05:27:56.835 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:56 smithi070 ceph-mon[22316]: pgmap v280: 129 pgs: 129 active+clean; 579 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:56.893 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-08-31T05:27:56.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:56 smithi050 ceph-mon[22146]: pgmap v280: 129 pgs: 129 active+clean; 579 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:56.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-31T05:27:57.010 INFO:teuthology.orchestra.run.smithi005.stdout:# file: . 2024-08-31T05:27:57.011 INFO:teuthology.orchestra.run.smithi005.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-08-31T05:27:57.011 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:27:57.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T05:27:57.016 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-31T05:27:57.017 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-31T05:27:57.033 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph osd blocklist ls 2024-08-31T05:27:57.327 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:27:57.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:57 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]} : dispatch 2024-08-31T05:27:57.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:57 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]} : dispatch 2024-08-31T05:27:57.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:57 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]} : dispatch 2024-08-31T05:27:57.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:57 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]} : dispatch 2024-08-31T05:27:57.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:57 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]} : dispatch 2024-08-31T05:27:57.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:57 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]} : dispatch 2024-08-31T05:27:57.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:57 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 7]} : dispatch 2024-08-31T05:27:57.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:57 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]} : dispatch 2024-08-31T05:27:57.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:57 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 6]} : dispatch 2024-08-31T05:27:57.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:57 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]} : dispatch 2024-08-31T05:27:57.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:57 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]} : dispatch 2024-08-31T05:27:57.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:57 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]} : dispatch 2024-08-31T05:27:57.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:57 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]} : dispatch 2024-08-31T05:27:57.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:57 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]} : dispatch 2024-08-31T05:27:57.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:57 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]} : dispatch 2024-08-31T05:27:57.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:57 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]} : dispatch 2024-08-31T05:27:57.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:57 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 7]} : dispatch 2024-08-31T05:27:57.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:57 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]} : dispatch 2024-08-31T05:27:57.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:57 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 6]} : dispatch 2024-08-31T05:27:57.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:57 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]} : dispatch 2024-08-31T05:27:57.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:57.863+0000 7ff8f00b5640 1 -- 172.21.15.5:0/3251478647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8e8102ce0 msgr2=0x7ff8e810fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:57.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:57.863+0000 7ff8f00b5640 1 --2- 172.21.15.5:0/3251478647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8e8102ce0 0x7ff8e810fa00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8009900 tx=0x7ff8d802a480 comp rx=0 tx=0).stop 2024-08-31T05:27:57.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:57.863+0000 7ff8f00b5640 1 -- 172.21.15.5:0/3251478647 shutdown_connections 2024-08-31T05:27:57.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:57.863+0000 7ff8f00b5640 1 --2- 172.21.15.5:0/3251478647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8e810ff40 0x7ff8e8112360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:57.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:57.863+0000 7ff8f00b5640 1 --2- 172.21.15.5:0/3251478647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8e8102ce0 0x7ff8e810fa00 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:57.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:57.863+0000 7ff8f00b5640 1 --2- 172.21.15.5:0/3251478647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8e8102390 0x7ff8e81027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:57.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:57.863+0000 7ff8f00b5640 1 -- 172.21.15.5:0/3251478647 >> 172.21.15.5:0/3251478647 conn(0x7ff8e80794e0 msgr2=0x7ff8e80798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:57.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:57.863+0000 7ff8f00b5640 1 -- 172.21.15.5:0/3251478647 shutdown_connections 2024-08-31T05:27:57.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:57.863+0000 7ff8f00b5640 1 -- 172.21.15.5:0/3251478647 wait complete. 2024-08-31T05:27:57.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:57.864+0000 7ff8f00b5640 1 Processor -- start 2024-08-31T05:27:57.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:57.864+0000 7ff8f00b5640 1 -- start start 2024-08-31T05:27:57.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:57.864+0000 7ff8f00b5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8e8102390 0x7ff8e819c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:57.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:57.864+0000 7ff8f00b5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8e8102ce0 0x7ff8e819c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:57.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:57.864+0000 7ff8f00b5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8e810ff40 0x7ff8e81a1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:57.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:57.864+0000 7ff8f00b5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e8115a30 con 0x7ff8e810ff40 2024-08-31T05:27:57.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:57.864+0000 7ff8f00b5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e81158b0 con 0x7ff8e8102ce0 2024-08-31T05:27:57.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:57.864+0000 7ff8f00b5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e8115bb0 con 0x7ff8e8102390 2024-08-31T05:27:57.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:57.864+0000 7ff8ee652640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8e810ff40 0x7ff8e81a1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:57.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:57.864+0000 7ff8ee652640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8e810ff40 0x7ff8e81a1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51156/0 (socket says 172.21.15.5:51156) 2024-08-31T05:27:57.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:57.864+0000 7ff8ee652640 1 -- 172.21.15.5:0/2883267113 learned_addr learned my addr 172.21.15.5:0/2883267113 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:27:57.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:57.864+0000 7ff8ede51640 1 --2- 172.21.15.5:0/2883267113 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8e8102390 0x7ff8e819c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:57.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:57.864+0000 7ff8ed650640 1 --2- 172.21.15.5:0/2883267113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8e8102ce0 0x7ff8e819c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:57.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:57.865+0000 7ff8ee652640 1 -- 172.21.15.5:0/2883267113 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8e8102390 msgr2=0x7ff8e819c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:57.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:57.865+0000 7ff8ee652640 1 --2- 172.21.15.5:0/2883267113 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8e8102390 0x7ff8e819c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:57.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:57.865+0000 7ff8ee652640 1 -- 172.21.15.5:0/2883267113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8e8102ce0 msgr2=0x7ff8e819c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:57.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:57.865+0000 7ff8ee652640 1 --2- 172.21.15.5:0/2883267113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8e8102ce0 0x7ff8e819c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:57.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:57.865+0000 7ff8ee652640 1 -- 172.21.15.5:0/2883267113 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8e81a2350 con 0x7ff8e810ff40 2024-08-31T05:27:57.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:57.865+0000 7ff8ee652640 1 --2- 172.21.15.5:0/2883267113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8e810ff40 0x7ff8e81a1c20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff8e000eb10 tx=0x7ff8e000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:57.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:57.865+0000 7ff8deffd640 1 -- 172.21.15.5:0/2883267113 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e0004b20 con 0x7ff8e810ff40 2024-08-31T05:27:57.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:57.865+0000 7ff8f00b5640 1 -- 172.21.15.5:0/2883267113 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8e81a2640 con 0x7ff8e810ff40 2024-08-31T05:27:57.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:57.865+0000 7ff8deffd640 1 -- 172.21.15.5:0/2883267113 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff8e0004cc0 con 0x7ff8e810ff40 2024-08-31T05:27:57.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:57.865+0000 7ff8deffd640 1 -- 172.21.15.5:0/2883267113 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e0010670 con 0x7ff8e810ff40 2024-08-31T05:27:57.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:57.865+0000 7ff8f00b5640 1 -- 172.21.15.5:0/2883267113 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8e81a8da0 con 0x7ff8e810ff40 2024-08-31T05:27:57.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:57.866+0000 7ff8f00b5640 1 -- 172.21.15.5:0/2883267113 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8e806bfe0 con 0x7ff8e810ff40 2024-08-31T05:27:57.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:57.868+0000 7ff8deffd640 1 -- 172.21.15.5:0/2883267113 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7ff8e0005020 con 0x7ff8e810ff40 2024-08-31T05:27:57.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:57.868+0000 7ff8deffd640 1 --2- 172.21.15.5:0/2883267113 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff8d40b4b80 0x7ff8d40b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:57.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:57.868+0000 7ff8deffd640 1 -- 172.21.15.5:0/2883267113 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9307+0+0 (secure 0 0 0) 0x7ff8e00e5c60 con 0x7ff8e810ff40 2024-08-31T05:27:57.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:57.869+0000 7ff8ede51640 1 --2- 172.21.15.5:0/2883267113 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff8d40b4b80 0x7ff8d40b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:57.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:57.869+0000 7ff8ede51640 1 --2- 172.21.15.5:0/2883267113 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff8d40b4b80 0x7ff8d40b7090 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4009bd0 tx=0x7ff8e4005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:57.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:57.873+0000 7ff8deffd640 1 -- 172.21.15.5:0/2883267113 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff8e00ac960 con 0x7ff8e810ff40 2024-08-31T05:27:57.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:57 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]} : dispatch 2024-08-31T05:27:57.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:57 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]} : dispatch 2024-08-31T05:27:57.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:57 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]} : dispatch 2024-08-31T05:27:57.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:57 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]} : dispatch 2024-08-31T05:27:57.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:57 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]} : dispatch 2024-08-31T05:27:57.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:57 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]} : dispatch 2024-08-31T05:27:57.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:57 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 7]} : dispatch 2024-08-31T05:27:57.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:57 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]} : dispatch 2024-08-31T05:27:57.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:57 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 6]} : dispatch 2024-08-31T05:27:57.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:57 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]} : dispatch 2024-08-31T05:27:58.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:58.070+0000 7ff8f00b5640 1 -- 172.21.15.5:0/2883267113 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff8e810ab40 con 0x7ff8e810ff40 2024-08-31T05:27:58.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:58.071+0000 7ff8deffd640 1 -- 172.21.15.5:0/2883267113 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v84) ==== 81+0+873 (secure 0 0 0) 0x7ff8e00ac260 con 0x7ff8e810ff40 2024-08-31T05:27:58.073 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/2473024253 2024-09-01T05:20:57.333680+0000 2024-08-31T05:27:58.073 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/2924148490 2024-09-01T05:19:31.728664+0000 2024-08-31T05:27:58.073 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/2163558485 2024-09-01T05:19:31.728664+0000 2024-08-31T05:27:58.074 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/2111919168 2024-09-01T05:19:55.663503+0000 2024-08-31T05:27:58.074 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6801/3616278616 2024-09-01T05:19:55.663503+0000 2024-08-31T05:27:58.074 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/2436421090 2024-09-01T05:19:31.728664+0000 2024-08-31T05:27:58.074 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/1570244689 2024-09-01T05:19:55.663503+0000 2024-08-31T05:27:58.074 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/2700448223 2024-09-01T05:20:57.333680+0000 2024-08-31T05:27:58.074 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6800/3616278616 2024-09-01T05:19:55.663503+0000 2024-08-31T05:27:58.074 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6800/2898463711 2024-09-01T05:19:31.728664+0000 2024-08-31T05:27:58.074 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/2450461036 2024-09-01T05:20:57.333680+0000 2024-08-31T05:27:58.074 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/1947189952 2024-09-01T05:19:55.663503+0000 2024-08-31T05:27:58.074 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6800/1439868821 2024-09-01T05:20:57.333680+0000 2024-08-31T05:27:58.074 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6801/2898463711 2024-09-01T05:19:31.728664+0000 2024-08-31T05:27:58.074 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6801/1439868821 2024-09-01T05:20:57.333680+0000 2024-08-31T05:27:58.075 INFO:teuthology.orchestra.run.smithi005.stderr:listed 15 entries 2024-08-31T05:27:58.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:58.073+0000 7ff8f00b5640 1 -- 172.21.15.5:0/2883267113 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff8d40b4b80 msgr2=0x7ff8d40b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:58.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:58.073+0000 7ff8f00b5640 1 --2- 172.21.15.5:0/2883267113 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff8d40b4b80 0x7ff8d40b7090 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4009bd0 tx=0x7ff8e4005f90 comp rx=0 tx=0).stop 2024-08-31T05:27:58.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:58.073+0000 7ff8f00b5640 1 -- 172.21.15.5:0/2883267113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8e810ff40 msgr2=0x7ff8e81a1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:58.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:58.073+0000 7ff8f00b5640 1 --2- 172.21.15.5:0/2883267113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8e810ff40 0x7ff8e81a1c20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff8e000eb10 tx=0x7ff8e000c2d0 comp rx=0 tx=0).stop 2024-08-31T05:27:58.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:58.073+0000 7ff8f00b5640 1 -- 172.21.15.5:0/2883267113 shutdown_connections 2024-08-31T05:27:58.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:58.073+0000 7ff8f00b5640 1 --2- 172.21.15.5:0/2883267113 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff8d40b4b80 0x7ff8d40b7090 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:58.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:58.073+0000 7ff8f00b5640 1 --2- 172.21.15.5:0/2883267113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8e810ff40 0x7ff8e81a1c20 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:58.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:58.073+0000 7ff8f00b5640 1 --2- 172.21.15.5:0/2883267113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8e8102ce0 0x7ff8e819c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:58.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:58.073+0000 7ff8f00b5640 1 --2- 172.21.15.5:0/2883267113 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8e8102390 0x7ff8e819c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:58.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:58.073+0000 7ff8f00b5640 1 -- 172.21.15.5:0/2883267113 >> 172.21.15.5:0/2883267113 conn(0x7ff8e80794e0 msgr2=0x7ff8e8111340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:58.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:58.073+0000 7ff8f00b5640 1 -- 172.21.15.5:0/2883267113 shutdown_connections 2024-08-31T05:27:58.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:58.074+0000 7ff8f00b5640 1 -- 172.21.15.5:0/2883267113 wait complete. 2024-08-31T05:27:58.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:58 smithi070 ceph-mon[22316]: pgmap v281: 129 pgs: 129 active+clean; 579 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:58.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:58 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-08-31T05:27:58.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:58 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-08-31T05:27:58.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:58 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-08-31T05:27:58.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:58 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]': finished 2024-08-31T05:27:58.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:58 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-08-31T05:27:58.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:58 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-08-31T05:27:58.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:58 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 7]}]': finished 2024-08-31T05:27:58.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:58 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]': finished 2024-08-31T05:27:58.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:58 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 6]}]': finished 2024-08-31T05:27:58.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:58 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-08-31T05:27:58.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:58 smithi070 ceph-mon[22316]: osdmap e84: 12 total, 12 up, 12 in 2024-08-31T05:27:58.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:58 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/2883267113' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-31T05:27:58.869 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:58 smithi005 ceph-mon[18602]: pgmap v281: 129 pgs: 129 active+clean; 579 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:58.869 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:58 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-08-31T05:27:58.869 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:58 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-08-31T05:27:58.869 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:58 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-08-31T05:27:58.869 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:58 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]': finished 2024-08-31T05:27:58.869 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:58 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-08-31T05:27:58.870 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:58 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-08-31T05:27:58.870 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:58 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 7]}]': finished 2024-08-31T05:27:58.870 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:58 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]': finished 2024-08-31T05:27:58.870 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:58 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 6]}]': finished 2024-08-31T05:27:58.870 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:58 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-08-31T05:27:58.870 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:58 smithi005 ceph-mon[18602]: osdmap e84: 12 total, 12 up, 12 in 2024-08-31T05:27:58.870 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:58 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/2883267113' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-31T05:27:58.898 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-31T05:27:58.898 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-31T05:27:58.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:58 smithi050 ceph-mon[22146]: pgmap v281: 129 pgs: 129 active+clean; 579 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:27:58.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:58 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-08-31T05:27:58.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:58 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-08-31T05:27:58.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:58 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-08-31T05:27:58.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:58 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]': finished 2024-08-31T05:27:58.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:58 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-08-31T05:27:58.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:58 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-08-31T05:27:58.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:58 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 7]}]': finished 2024-08-31T05:27:58.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:58 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]': finished 2024-08-31T05:27:58.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:58 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 6]}]': finished 2024-08-31T05:27:58.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:58 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-08-31T05:27:58.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:58 smithi050 ceph-mon[22146]: osdmap e84: 12 total, 12 up, 12 in 2024-08-31T05:27:58.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:58 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/2883267113' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-31T05:27:58.915 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph osd blocklist ls 2024-08-31T05:27:59.208 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:27:59.615 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:27:59 smithi005 ceph-mon[18602]: osdmap e85: 12 total, 12 up, 12 in 2024-08-31T05:27:59.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.704+0000 7f1ae0ca5640 1 -- 172.21.15.5:0/379997053 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1adc103900 msgr2=0x7f1adc103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:59.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.704+0000 7f1ae0ca5640 1 --2- 172.21.15.5:0/379997053 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1adc103900 0x7f1adc103d10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1acc009900 tx=0x7f1acc02a410 comp rx=0 tx=0).stop 2024-08-31T05:27:59.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.704+0000 7f1ae0ca5640 1 -- 172.21.15.5:0/379997053 shutdown_connections 2024-08-31T05:27:59.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.704+0000 7f1ae0ca5640 1 --2- 172.21.15.5:0/379997053 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1adc109b90 0x7f1adc1103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:59.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.704+0000 7f1ae0ca5640 1 --2- 172.21.15.5:0/379997053 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1adc109240 0x7f1adc109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:59.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.704+0000 7f1ae0ca5640 1 --2- 172.21.15.5:0/379997053 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1adc103900 0x7f1adc103d10 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:59.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.704+0000 7f1ae0ca5640 1 -- 172.21.15.5:0/379997053 >> 172.21.15.5:0/379997053 conn(0x7f1adc07b5f0 msgr2=0x7f1adc07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:59.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.705+0000 7f1ae0ca5640 1 -- 172.21.15.5:0/379997053 shutdown_connections 2024-08-31T05:27:59.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.705+0000 7f1ae0ca5640 1 -- 172.21.15.5:0/379997053 wait complete. 2024-08-31T05:27:59.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.706+0000 7f1ae0ca5640 1 Processor -- start 2024-08-31T05:27:59.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.706+0000 7f1ae0ca5640 1 -- start start 2024-08-31T05:27:59.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.706+0000 7f1ae0ca5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1adc103900 0x7f1adc19a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:59.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.706+0000 7f1ae0ca5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1adc109240 0x7f1adc19a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:59.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.706+0000 7f1ae0ca5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1adc109b90 0x7f1adc19fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:59.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.706+0000 7f1ae0ca5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1adc113910 con 0x7f1adc109b90 2024-08-31T05:27:59.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.706+0000 7f1ae0ca5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1adc113790 con 0x7f1adc103900 2024-08-31T05:27:59.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.706+0000 7f1ae0ca5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1adc113a90 con 0x7f1adc109240 2024-08-31T05:27:59.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.706+0000 7f1adad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1adc109b90 0x7f1adc19fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:59.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.706+0000 7f1adad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1adc109b90 0x7f1adc19fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51172/0 (socket says 172.21.15.5:51172) 2024-08-31T05:27:59.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.706+0000 7f1adad9d640 1 -- 172.21.15.5:0/1857101390 learned_addr learned my addr 172.21.15.5:0/1857101390 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:27:59.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.706+0000 7f1ad9d9b640 1 --2- 172.21.15.5:0/1857101390 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1adc109240 0x7f1adc19a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:59.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.706+0000 7f1ada59c640 1 --2- 172.21.15.5:0/1857101390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1adc103900 0x7f1adc19a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:59.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.707+0000 7f1adad9d640 1 -- 172.21.15.5:0/1857101390 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1adc109240 msgr2=0x7f1adc19a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:59.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.707+0000 7f1adad9d640 1 --2- 172.21.15.5:0/1857101390 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1adc109240 0x7f1adc19a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:59.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.707+0000 7f1adad9d640 1 -- 172.21.15.5:0/1857101390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1adc103900 msgr2=0x7f1adc19a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:59.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.707+0000 7f1adad9d640 1 --2- 172.21.15.5:0/1857101390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1adc103900 0x7f1adc19a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:59.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.707+0000 7f1adad9d640 1 -- 172.21.15.5:0/1857101390 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1adc1a0350 con 0x7f1adc109b90 2024-08-31T05:27:59.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.707+0000 7f1ada59c640 1 --2- 172.21.15.5:0/1857101390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1adc103900 0x7f1adc19a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:27:59.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.707+0000 7f1adad9d640 1 --2- 172.21.15.5:0/1857101390 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1adc109b90 0x7f1adc19fc20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1ad400b970 tx=0x7f1ad400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:59.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.707+0000 7f1acb7fe640 1 -- 172.21.15.5:0/1857101390 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad4019070 con 0x7f1adc109b90 2024-08-31T05:27:59.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.707+0000 7f1ae0ca5640 1 -- 172.21.15.5:0/1857101390 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1adc1a0640 con 0x7f1adc109b90 2024-08-31T05:27:59.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.707+0000 7f1acb7fe640 1 -- 172.21.15.5:0/1857101390 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ad4014440 con 0x7f1adc109b90 2024-08-31T05:27:59.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.707+0000 7f1ae0ca5640 1 -- 172.21.15.5:0/1857101390 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1adc1a6da0 con 0x7f1adc109b90 2024-08-31T05:27:59.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.707+0000 7f1acb7fe640 1 -- 172.21.15.5:0/1857101390 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad40075d0 con 0x7f1adc109b90 2024-08-31T05:27:59.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.708+0000 7f1ae0ca5640 1 -- 172.21.15.5:0/1857101390 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1adc103d90 con 0x7f1adc109b90 2024-08-31T05:27:59.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.710+0000 7f1acb7fe640 1 -- 172.21.15.5:0/1857101390 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f1ad401c070 con 0x7f1adc109b90 2024-08-31T05:27:59.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.710+0000 7f1acb7fe640 1 --2- 172.21.15.5:0/1857101390 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f1ac40b4b80 0x7f1ac40b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:27:59.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.711+0000 7f1ada59c640 1 --2- 172.21.15.5:0/1857101390 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f1ac40b4b80 0x7f1ac40b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:27:59.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.711+0000 7f1acb7fe640 1 -- 172.21.15.5:0/1857101390 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9307+0+0 (secure 0 0 0) 0x7f1ad40e4ef0 con 0x7f1adc109b90 2024-08-31T05:27:59.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.711+0000 7f1ada59c640 1 --2- 172.21.15.5:0/1857101390 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f1ac40b4b80 0x7f1ac40b7090 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1acc031440 tx=0x7f1acc005d50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:27:59.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.714+0000 7f1acb7fe640 1 -- 172.21.15.5:0/1857101390 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f1ad40abbf0 con 0x7f1adc109b90 2024-08-31T05:27:59.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:27:59 smithi070 ceph-mon[22316]: osdmap e85: 12 total, 12 up, 12 in 2024-08-31T05:27:59.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:27:59 smithi050 ceph-mon[22146]: osdmap e85: 12 total, 12 up, 12 in 2024-08-31T05:27:59.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.912+0000 7f1ae0ca5640 1 -- 172.21.15.5:0/1857101390 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1adc19b510 con 0x7f1adc109b90 2024-08-31T05:27:59.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.913+0000 7f1acb7fe640 1 -- 172.21.15.5:0/1857101390 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v85) ==== 81+0+873 (secure 0 0 0) 0x7f1ad40ab4f0 con 0x7f1adc109b90 2024-08-31T05:27:59.915 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/2473024253 2024-09-01T05:20:57.333680+0000 2024-08-31T05:27:59.915 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/2924148490 2024-09-01T05:19:31.728664+0000 2024-08-31T05:27:59.915 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/2163558485 2024-09-01T05:19:31.728664+0000 2024-08-31T05:27:59.915 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/2111919168 2024-09-01T05:19:55.663503+0000 2024-08-31T05:27:59.915 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6801/3616278616 2024-09-01T05:19:55.663503+0000 2024-08-31T05:27:59.915 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/2436421090 2024-09-01T05:19:31.728664+0000 2024-08-31T05:27:59.915 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/1570244689 2024-09-01T05:19:55.663503+0000 2024-08-31T05:27:59.916 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/2700448223 2024-09-01T05:20:57.333680+0000 2024-08-31T05:27:59.916 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6800/3616278616 2024-09-01T05:19:55.663503+0000 2024-08-31T05:27:59.916 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6800/2898463711 2024-09-01T05:19:31.728664+0000 2024-08-31T05:27:59.916 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/2450461036 2024-09-01T05:20:57.333680+0000 2024-08-31T05:27:59.916 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/1947189952 2024-09-01T05:19:55.663503+0000 2024-08-31T05:27:59.916 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6800/1439868821 2024-09-01T05:20:57.333680+0000 2024-08-31T05:27:59.916 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6801/2898463711 2024-09-01T05:19:31.728664+0000 2024-08-31T05:27:59.916 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6801/1439868821 2024-09-01T05:20:57.333680+0000 2024-08-31T05:27:59.916 INFO:teuthology.orchestra.run.smithi005.stderr:listed 15 entries 2024-08-31T05:27:59.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.915+0000 7f1ae0ca5640 1 -- 172.21.15.5:0/1857101390 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f1ac40b4b80 msgr2=0x7f1ac40b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:59.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.915+0000 7f1ae0ca5640 1 --2- 172.21.15.5:0/1857101390 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f1ac40b4b80 0x7f1ac40b7090 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1acc031440 tx=0x7f1acc005d50 comp rx=0 tx=0).stop 2024-08-31T05:27:59.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.915+0000 7f1ae0ca5640 1 -- 172.21.15.5:0/1857101390 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1adc109b90 msgr2=0x7f1adc19fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:27:59.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.915+0000 7f1ae0ca5640 1 --2- 172.21.15.5:0/1857101390 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1adc109b90 0x7f1adc19fc20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1ad400b970 tx=0x7f1ad400bd70 comp rx=0 tx=0).stop 2024-08-31T05:27:59.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.915+0000 7f1ae0ca5640 1 -- 172.21.15.5:0/1857101390 shutdown_connections 2024-08-31T05:27:59.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.915+0000 7f1ae0ca5640 1 --2- 172.21.15.5:0/1857101390 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f1ac40b4b80 0x7f1ac40b7090 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:59.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.915+0000 7f1ae0ca5640 1 --2- 172.21.15.5:0/1857101390 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1adc109b90 0x7f1adc19fc20 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:59.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.915+0000 7f1ae0ca5640 1 --2- 172.21.15.5:0/1857101390 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1adc109240 0x7f1adc19a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:59.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.915+0000 7f1ae0ca5640 1 --2- 172.21.15.5:0/1857101390 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1adc103900 0x7f1adc19a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:27:59.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.915+0000 7f1ae0ca5640 1 -- 172.21.15.5:0/1857101390 >> 172.21.15.5:0/1857101390 conn(0x7f1adc07b5f0 msgr2=0x7f1adc107440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:27:59.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.915+0000 7f1ae0ca5640 1 -- 172.21.15.5:0/1857101390 shutdown_connections 2024-08-31T05:27:59.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:27:59.915+0000 7f1ae0ca5640 1 -- 172.21.15.5:0/1857101390 wait complete. 2024-08-31T05:28:00.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:00 smithi005 ceph-mon[18602]: pgmap v284: 129 pgs: 129 active+clean; 581 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-08-31T05:28:00.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:00 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/1857101390' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-31T05:28:00.751 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi005.front.sepia.ceph.com... 2024-08-31T05:28:00.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T05:28:00.752 DEBUG:teuthology.orchestra.run.smithi005:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-08-31T05:28:00.778 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi005.stderr:ceph-fuse[64141]: fuse finished with error 0 and tester_r 0 2024-08-31T05:28:00.780 INFO:teuthology.orchestra.run:waiting for 300 2024-08-31T05:28:00.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:00 smithi070 ceph-mon[22316]: pgmap v284: 129 pgs: 129 active+clean; 581 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-08-31T05:28:00.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:00 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/1857101390' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-31T05:28:00.840 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-08-31T05:28:00.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T05:28:00.840 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-08-31T05:28:00.863 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T05:28:00.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:00 smithi050 ceph-mon[22146]: pgmap v284: 129 pgs: 129 active+clean; 581 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-08-31T05:28:00.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:00 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/1857101390' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-31T05:28:01.154 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:28:01.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.597+0000 7f5370310640 1 -- 172.21.15.5:0/964338294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5368108270 msgr2=0x7f536810eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:01.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.597+0000 7f5370310640 1 --2- 172.21.15.5:0/964338294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5368108270 0x7f536810eaa0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5360009ca0 tx=0x7f536002a8e0 comp rx=0 tx=0).stop 2024-08-31T05:28:01.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.597+0000 7f5370310640 1 -- 172.21.15.5:0/964338294 shutdown_connections 2024-08-31T05:28:01.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.597+0000 7f5370310640 1 --2- 172.21.15.5:0/964338294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5368108270 0x7f536810eaa0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:01.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.597+0000 7f5370310640 1 --2- 172.21.15.5:0/964338294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5368107920 0x7f5368107d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:01.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.597+0000 7f5370310640 1 --2- 172.21.15.5:0/964338294 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5368101fe0 0x7f53681023f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:01.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.597+0000 7f5370310640 1 -- 172.21.15.5:0/964338294 >> 172.21.15.5:0/964338294 conn(0x7f5368079d30 msgr2=0x7f536807a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:01.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.597+0000 7f5370310640 1 -- 172.21.15.5:0/964338294 shutdown_connections 2024-08-31T05:28:01.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.598+0000 7f5370310640 1 -- 172.21.15.5:0/964338294 wait complete. 2024-08-31T05:28:01.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.598+0000 7f5370310640 1 Processor -- start 2024-08-31T05:28:01.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.598+0000 7f5370310640 1 -- start start 2024-08-31T05:28:01.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.598+0000 7f5370310640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5368101fe0 0x7f536819b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:01.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.598+0000 7f5370310640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5368107920 0x7f536819b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:01.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.598+0000 7f5370310640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5368108270 0x7f536819bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:01.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.598+0000 7f5370310640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5368112810 con 0x7f5368107920 2024-08-31T05:28:01.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.598+0000 7f5370310640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5368112690 con 0x7f5368101fe0 2024-08-31T05:28:01.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.598+0000 7f5370310640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5368112990 con 0x7f5368108270 2024-08-31T05:28:01.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.599+0000 7f536d8ab640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5368107920 0x7f536819b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:01.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.599+0000 7f536d8ab640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5368107920 0x7f536819b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51186/0 (socket says 172.21.15.5:51186) 2024-08-31T05:28:01.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.599+0000 7f536d8ab640 1 -- 172.21.15.5:0/487140623 learned_addr learned my addr 172.21.15.5:0/487140623 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:28:01.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.599+0000 7f536e8ad640 1 --2- 172.21.15.5:0/487140623 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5368108270 0x7f536819bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:01.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.599+0000 7f536e0ac640 1 --2- 172.21.15.5:0/487140623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5368101fe0 0x7f536819b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:01.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.599+0000 7f536d8ab640 1 -- 172.21.15.5:0/487140623 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5368108270 msgr2=0x7f536819bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:01.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.599+0000 7f536d8ab640 1 --2- 172.21.15.5:0/487140623 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5368108270 0x7f536819bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:01.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.599+0000 7f536d8ab640 1 -- 172.21.15.5:0/487140623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5368101fe0 msgr2=0x7f536819b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:01.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.599+0000 7f536d8ab640 1 --2- 172.21.15.5:0/487140623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5368101fe0 0x7f536819b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:01.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.599+0000 7f536d8ab640 1 -- 172.21.15.5:0/487140623 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53681a6320 con 0x7f5368107920 2024-08-31T05:28:01.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.599+0000 7f536e0ac640 1 --2- 172.21.15.5:0/487140623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5368101fe0 0x7f536819b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:28:01.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.599+0000 7f536d8ab640 1 --2- 172.21.15.5:0/487140623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5368107920 0x7f536819b5a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5358006fd0 tx=0x7f535800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:01.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.599+0000 7f535f7fe640 1 -- 172.21.15.5:0/487140623 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5358011830 con 0x7f5368107920 2024-08-31T05:28:01.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.599+0000 7f535f7fe640 1 -- 172.21.15.5:0/487140623 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5358016070 con 0x7f5368107920 2024-08-31T05:28:01.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.599+0000 7f5370310640 1 -- 172.21.15.5:0/487140623 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53681a6610 con 0x7f5368107920 2024-08-31T05:28:01.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.599+0000 7f535f7fe640 1 -- 172.21.15.5:0/487140623 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5358010e00 con 0x7f5368107920 2024-08-31T05:28:01.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.599+0000 7f5370310640 1 -- 172.21.15.5:0/487140623 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53681a6bd0 con 0x7f5368107920 2024-08-31T05:28:01.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.600+0000 7f5370310640 1 -- 172.21.15.5:0/487140623 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53681023f0 con 0x7f5368107920 2024-08-31T05:28:01.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.602+0000 7f535f7fe640 1 -- 172.21.15.5:0/487140623 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f535801b460 con 0x7f5368107920 2024-08-31T05:28:01.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.603+0000 7f535f7fe640 1 --2- 172.21.15.5:0/487140623 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f53540b4b80 0x7f53540b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:01.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.603+0000 7f536e0ac640 1 --2- 172.21.15.5:0/487140623 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f53540b4b80 0x7f53540b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:01.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.603+0000 7f535f7fe640 1 -- 172.21.15.5:0/487140623 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9307+0+0 (secure 0 0 0) 0x7f53580e51f0 con 0x7f5368107920 2024-08-31T05:28:01.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.603+0000 7f536e0ac640 1 --2- 172.21.15.5:0/487140623 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f53540b4b80 0x7f53540b7090 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5364005fd0 tx=0x7f5364005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:01.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.606+0000 7f535f7fe640 1 -- 172.21.15.5:0/487140623 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f53580abe90 con 0x7f5368107920 2024-08-31T05:28:01.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.793+0000 7f5370310640 1 -- 172.21.15.5:0/487140623 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f536810f890 con 0x7f5368107920 2024-08-31T05:28:01.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.795+0000 7f535f7fe640 1 -- 172.21.15.5:0/487140623 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+24934 (secure 0 0 0) 0x7f536810f890 con 0x7f5368107920 2024-08-31T05:28:01.797 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:28:01.797 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":85,"fsid":"69422704-6758-11ef-bcd4-c7b262605968","created":"2024-08-31T05:19:04.860258+0000","modified":"2024-08-31T05:27:58.494079+0000","last_up_change":"2024-08-31T05:26:38.675914+0000","last_in_change":"2024-08-31T05:26:15.366713+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T05:22:49.802575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T05:27:27.835197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T05:27:30.058144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-31T05:27:36.272228+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c5745391-e9d7-4799-9db9-6b34bb91b7df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6803","nonce":2312496244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6805","nonce":2312496244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6809","nonce":2312496244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6807","nonce":2312496244}]},"public_addr":"172.21.15.5:6803/2312496244","cluster_addr":"172.21.15.5:6805/2312496244","heartbeat_back_addr":"172.21.15.5:6809/2312496244","heartbeat_front_addr":"172.21.15.5:6807/2312496244","state":["exists","up"]},{"osd":1,"uuid":"f1903bd7-b2c5-424e-a74e-795f729471db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6801","nonce":2777359361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6803","nonce":2777359361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6807","nonce":2777359361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6805","nonce":2777359361}]},"public_addr":"172.21.15.50:6801/2777359361","cluster_addr":"172.21.15.50:6803/2777359361","heartbeat_back_addr":"172.21.15.50:6807/2777359361","heartbeat_front_addr":"172.21.15.50:6805/2777359361","state":["exists","up"]},{"osd":2,"uuid":"134c5892-e44a-44f2-8cd2-484d22a45e2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6801","nonce":1400583716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6803","nonce":1400583716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6807","nonce":1400583716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6805","nonce":1400583716}]},"public_addr":"172.21.15.70:6801/1400583716","cluster_addr":"172.21.15.70:6803/1400583716","heartbeat_back_addr":"172.21.15.70:6807/1400583716","heartbeat_front_addr":"172.21.15.70:6805/1400583716","state":["exists","up"]},{"osd":3,"uuid":"af49398a-e171-496b-a50e-1f767fc42923","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6811","nonce":1647468379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6813","nonce":1647468379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6817","nonce":1647468379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6815","nonce":1647468379}]},"public_addr":"172.21.15.5:6811/1647468379","cluster_addr":"172.21.15.5:6813/1647468379","heartbeat_back_addr":"172.21.15.5:6817/1647468379","heartbeat_front_addr":"172.21.15.5:6815/1647468379","state":["exists","up"]},{"osd":4,"uuid":"59b847ef-6eb0-4c13-aa06-53a76d77ce45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6809","nonce":2314546877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6811","nonce":2314546877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6815","nonce":2314546877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6813","nonce":2314546877}]},"public_addr":"172.21.15.50:6809/2314546877","cluster_addr":"172.21.15.50:6811/2314546877","heartbeat_back_addr":"172.21.15.50:6815/2314546877","heartbeat_front_addr":"172.21.15.50:6813/2314546877","state":["exists","up"]},{"osd":5,"uuid":"b0dac185-4462-4760-aa36-0d221923b007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6809","nonce":311426299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6811","nonce":311426299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6815","nonce":311426299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6813","nonce":311426299}]},"public_addr":"172.21.15.70:6809/311426299","cluster_addr":"172.21.15.70:6811/311426299","heartbeat_back_addr":"172.21.15.70:6815/311426299","heartbeat_front_addr":"172.21.15.70:6813/311426299","state":["exists","up"]},{"osd":6,"uuid":"12486aa2-61e4-4bdf-94dd-ce5c4cd3df6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6819","nonce":1027645612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6821","nonce":1027645612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6825","nonce":1027645612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6823","nonce":1027645612}]},"public_addr":"172.21.15.5:6819/1027645612","cluster_addr":"172.21.15.5:6821/1027645612","heartbeat_back_addr":"172.21.15.5:6825/1027645612","heartbeat_front_addr":"172.21.15.5:6823/1027645612","state":["exists","up"]},{"osd":7,"uuid":"66f9dcf9-d5c3-4016-812f-d9496e9892d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6817","nonce":2718354517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6819","nonce":2718354517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6823","nonce":2718354517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6821","nonce":2718354517}]},"public_addr":"172.21.15.50:6817/2718354517","cluster_addr":"172.21.15.50:6819/2718354517","heartbeat_back_addr":"172.21.15.50:6823/2718354517","heartbeat_front_addr":"172.21.15.50:6821/2718354517","state":["exists","up"]},{"osd":8,"uuid":"584837f9-af4b-4189-a7e5-04156a94a805","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6817","nonce":3155722993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6819","nonce":3155722993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6823","nonce":3155722993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6821","nonce":3155722993}]},"public_addr":"172.21.15.70:6817/3155722993","cluster_addr":"172.21.15.70:6819/3155722993","heartbeat_back_addr":"172.21.15.70:6823/3155722993","heartbeat_front_addr":"172.21.15.70:6821/3155722993","state":["exists","up"]},{"osd":9,"uuid":"ef60de6e-3456-435c-bd48-ed2636cc0d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6827","nonce":2988145512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6829","nonce":2988145512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6833","nonce":2988145512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6831","nonce":2988145512}]},"public_addr":"172.21.15.5:6827/2988145512","cluster_addr":"172.21.15.5:6829/2988145512","heartbeat_back_addr":"172.21.15.5:6833/2988145512","heartbeat_front_addr":"172.21.15.5:6831/2988145512","state":["exists","up"]},{"osd":10,"uuid":"96c5de40-53df-412d-9501-8ce1711a76a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6825","nonce":4168871229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6827","nonce":4168871229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6831","nonce":4168871229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6829","nonce":4168871229}]},"public_addr":"172.21.15.50:6825/4168871229","cluster_addr":"172.21.15.50:6827/4168871229","heartbeat_back_addr":"172.21.15.50:6831/4168871229","heartbeat_front_addr":"172.21.15.50:6829/4168871229","state":["exists","up"]},{"osd":11,"uuid":"20beefe0-59c3-4392-9f61-8d215e9d2de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6825","nonce":2593470535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6827","nonce":2593470535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6831","nonce":2593470535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6829","nonce":2593470535}]},"public_addr":"172.21.15.70:6825/2593470535","cluster_addr":"172.21.15.70:6827/2593470535","heartbeat_back_addr":"172.21.15.70:6831/2593470535","heartbeat_front_addr":"172.21.15.70:6829/2593470535","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:21:56.748083+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:22:21.969492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:22:46.642917+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:23:11.630486+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:23:36.389322+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:24:01.431039+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:24:27.057017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:24:53.628200+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:25:19.356502+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:25:44.958024+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:26:10.804919+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:26:36.849133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:0/2473024253":"2024-09-01T05:20:57.333680+0000","172.21.15.5:0/2924148490":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/2163558485":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/2111919168":"2024-09-01T05:19:55.663503+0000","172.21.15.5:6801/3616278616":"2024-09-01T05:19:55.663503+0000","172.21.15.5:0/2436421090":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/1570244689":"2024-09-01T05:19:55.663503+0000","172.21.15.5:0/2700448223":"2024-09-01T05:20:57.333680+0000","172.21.15.5:6800/3616278616":"2024-09-01T05:19:55.663503+0000","172.21.15.5:6800/2898463711":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/2450461036":"2024-09-01T05:20:57.333680+0000","172.21.15.5:0/1947189952":"2024-09-01T05:19:55.663503+0000","172.21.15.5:6800/1439868821":"2024-09-01T05:20:57.333680+0000","172.21.15.5:6801/2898463711":"2024-09-01T05:19:31.728664+0000","172.21.15.5:6801/1439868821":"2024-09-01T05:20:57.333680+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T05:28:01.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.797+0000 7f5370310640 1 -- 172.21.15.5:0/487140623 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f53540b4b80 msgr2=0x7f53540b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:01.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.797+0000 7f5370310640 1 --2- 172.21.15.5:0/487140623 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f53540b4b80 0x7f53540b7090 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5364005fd0 tx=0x7f5364005850 comp rx=0 tx=0).stop 2024-08-31T05:28:01.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.797+0000 7f5370310640 1 -- 172.21.15.5:0/487140623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5368107920 msgr2=0x7f536819b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:01.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.797+0000 7f5370310640 1 --2- 172.21.15.5:0/487140623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5368107920 0x7f536819b5a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5358006fd0 tx=0x7f535800b8e0 comp rx=0 tx=0).stop 2024-08-31T05:28:01.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.797+0000 7f5370310640 1 -- 172.21.15.5:0/487140623 shutdown_connections 2024-08-31T05:28:01.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.797+0000 7f5370310640 1 --2- 172.21.15.5:0/487140623 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f53540b4b80 0x7f53540b7090 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:01.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.797+0000 7f5370310640 1 --2- 172.21.15.5:0/487140623 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5368108270 0x7f536819bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:01.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.797+0000 7f5370310640 1 --2- 172.21.15.5:0/487140623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5368107920 0x7f536819b5a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:01.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.797+0000 7f5370310640 1 --2- 172.21.15.5:0/487140623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5368101fe0 0x7f536819b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:01.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.797+0000 7f5370310640 1 -- 172.21.15.5:0/487140623 >> 172.21.15.5:0/487140623 conn(0x7f5368079d30 msgr2=0x7f5368103890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:01.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.797+0000 7f5370310640 1 -- 172.21.15.5:0/487140623 shutdown_connections 2024-08-31T05:28:01.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:01.797+0000 7f5370310640 1 -- 172.21.15.5:0/487140623 wait complete. 2024-08-31T05:28:02.563 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T05:28:02.816 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:28:02.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:02 smithi070 ceph-mon[22316]: pgmap v285: 129 pgs: 129 active+clean; 581 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-08-31T05:28:02.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:02 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/487140623' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T05:28:02.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:02 smithi050 ceph-mon[22146]: pgmap v285: 129 pgs: 129 active+clean; 581 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-08-31T05:28:02.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:02 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/487140623' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T05:28:02.934 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:02 smithi005 ceph-mon[18602]: pgmap v285: 129 pgs: 129 active+clean; 581 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-08-31T05:28:02.934 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:02 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/487140623' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T05:28:03.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.311+0000 7f75a4f08640 1 -- 172.21.15.5:0/1463731726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75a01047d0 msgr2=0x7f75a0104be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:03.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.311+0000 7f75a4f08640 1 --2- 172.21.15.5:0/1463731726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75a01047d0 0x7f75a0104be0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7590009900 tx=0x7f759002a410 comp rx=0 tx=0).stop 2024-08-31T05:28:03.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.312+0000 7f75a4f08640 1 -- 172.21.15.5:0/1463731726 shutdown_connections 2024-08-31T05:28:03.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.312+0000 7f75a4f08640 1 --2- 172.21.15.5:0/1463731726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75a010dc00 0x7f75a01100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:03.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.312+0000 7f75a4f08640 1 --2- 172.21.15.5:0/1463731726 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75a0105120 0x7f75a010d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:03.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.312+0000 7f75a4f08640 1 --2- 172.21.15.5:0/1463731726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75a01047d0 0x7f75a0104be0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:03.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.312+0000 7f75a4f08640 1 -- 172.21.15.5:0/1463731726 >> 172.21.15.5:0/1463731726 conn(0x7f75a0079500 msgr2=0x7f75a0079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:03.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.312+0000 7f75a4f08640 1 -- 172.21.15.5:0/1463731726 shutdown_connections 2024-08-31T05:28:03.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.312+0000 7f75a4f08640 1 -- 172.21.15.5:0/1463731726 wait complete. 2024-08-31T05:28:03.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.312+0000 7f75a4f08640 1 Processor -- start 2024-08-31T05:28:03.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.312+0000 7f75a4f08640 1 -- start start 2024-08-31T05:28:03.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.313+0000 7f75a4f08640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75a01047d0 0x7f75a0102510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:03.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.313+0000 7f75a4f08640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75a0105120 0x7f75a0102a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:03.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.313+0000 7f75a4f08640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75a010dc00 0x7f75a0102f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:03.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.313+0000 7f75a4f08640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f75a01138a0 con 0x7f75a01047d0 2024-08-31T05:28:03.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.313+0000 7f75a4f08640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f75a0113720 con 0x7f75a0105120 2024-08-31T05:28:03.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.313+0000 7f75a4f08640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f75a0113a20 con 0x7f75a010dc00 2024-08-31T05:28:03.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.313+0000 7f759e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75a01047d0 0x7f75a0102510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:03.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.313+0000 7f759e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75a01047d0 0x7f75a0102510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60350/0 (socket says 172.21.15.5:60350) 2024-08-31T05:28:03.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.313+0000 7f759e59c640 1 -- 172.21.15.5:0/3502275679 learned_addr learned my addr 172.21.15.5:0/3502275679 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:28:03.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.313+0000 7f759dd9b640 1 --2- 172.21.15.5:0/3502275679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75a0105120 0x7f75a0102a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:03.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.313+0000 7f759ed9d640 1 --2- 172.21.15.5:0/3502275679 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75a010dc00 0x7f75a0102f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:03.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.313+0000 7f759e59c640 1 -- 172.21.15.5:0/3502275679 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75a010dc00 msgr2=0x7f75a0102f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:03.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.313+0000 7f759e59c640 1 --2- 172.21.15.5:0/3502275679 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75a010dc00 0x7f75a0102f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:03.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.313+0000 7f759e59c640 1 -- 172.21.15.5:0/3502275679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75a0105120 msgr2=0x7f75a0102a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:03.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.313+0000 7f759e59c640 1 --2- 172.21.15.5:0/3502275679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75a0105120 0x7f75a0102a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:03.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.313+0000 7f759e59c640 1 -- 172.21.15.5:0/3502275679 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75a01a8590 con 0x7f75a01047d0 2024-08-31T05:28:03.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.313+0000 7f759ed9d640 1 --2- 172.21.15.5:0/3502275679 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75a010dc00 0x7f75a0102f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:28:03.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.313+0000 7f759e59c640 1 --2- 172.21.15.5:0/3502275679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75a01047d0 0x7f75a0102510 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7590032fd0 tx=0x7f7590004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:03.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.314+0000 7f758f7fe640 1 -- 172.21.15.5:0/3502275679 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f759003f030 con 0x7f75a01047d0 2024-08-31T05:28:03.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.314+0000 7f758f7fe640 1 -- 172.21.15.5:0/3502275679 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7590004490 con 0x7f75a01047d0 2024-08-31T05:28:03.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.314+0000 7f75a4f08640 1 -- 172.21.15.5:0/3502275679 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75a01a8820 con 0x7f75a01047d0 2024-08-31T05:28:03.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.314+0000 7f758f7fe640 1 -- 172.21.15.5:0/3502275679 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7590035070 con 0x7f75a01047d0 2024-08-31T05:28:03.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.314+0000 7f75a4f08640 1 -- 172.21.15.5:0/3502275679 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75a01a8d80 con 0x7f75a01047d0 2024-08-31T05:28:03.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.315+0000 7f75a4f08640 1 -- 172.21.15.5:0/3502275679 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75a006bf90 con 0x7f75a01047d0 2024-08-31T05:28:03.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.317+0000 7f758f7fe640 1 -- 172.21.15.5:0/3502275679 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f7590042030 con 0x7f75a01047d0 2024-08-31T05:28:03.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.317+0000 7f758f7fe640 1 --2- 172.21.15.5:0/3502275679 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f75880b4b80 0x7f75880b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:03.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.317+0000 7f759dd9b640 1 --2- 172.21.15.5:0/3502275679 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f75880b4b80 0x7f75880b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:03.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.317+0000 7f758f7fe640 1 -- 172.21.15.5:0/3502275679 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9307+0+0 (secure 0 0 0) 0x7f7590105ee0 con 0x7f75a01047d0 2024-08-31T05:28:03.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.318+0000 7f759dd9b640 1 --2- 172.21.15.5:0/3502275679 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f75880b4b80 0x7f75880b7090 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f75a0102250 tx=0x7f7594009110 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:03.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.321+0000 7f758f7fe640 1 -- 172.21.15.5:0/3502275679 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f75900ccbe0 con 0x7f75a01047d0 2024-08-31T05:28:03.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.507+0000 7f75a4f08640 1 -- 172.21.15.5:0/3502275679 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f75a0104be0 con 0x7f75a01047d0 2024-08-31T05:28:03.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.509+0000 7f758f7fe640 1 -- 172.21.15.5:0/3502275679 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+24934 (secure 0 0 0) 0x7f75900d5120 con 0x7f75a01047d0 2024-08-31T05:28:03.511 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:28:03.511 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":85,"fsid":"69422704-6758-11ef-bcd4-c7b262605968","created":"2024-08-31T05:19:04.860258+0000","modified":"2024-08-31T05:27:58.494079+0000","last_up_change":"2024-08-31T05:26:38.675914+0000","last_in_change":"2024-08-31T05:26:15.366713+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T05:22:49.802575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T05:27:27.835197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T05:27:30.058144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-31T05:27:36.272228+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c5745391-e9d7-4799-9db9-6b34bb91b7df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6803","nonce":2312496244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6805","nonce":2312496244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6809","nonce":2312496244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6807","nonce":2312496244}]},"public_addr":"172.21.15.5:6803/2312496244","cluster_addr":"172.21.15.5:6805/2312496244","heartbeat_back_addr":"172.21.15.5:6809/2312496244","heartbeat_front_addr":"172.21.15.5:6807/2312496244","state":["exists","up"]},{"osd":1,"uuid":"f1903bd7-b2c5-424e-a74e-795f729471db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6801","nonce":2777359361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6803","nonce":2777359361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6807","nonce":2777359361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6805","nonce":2777359361}]},"public_addr":"172.21.15.50:6801/2777359361","cluster_addr":"172.21.15.50:6803/2777359361","heartbeat_back_addr":"172.21.15.50:6807/2777359361","heartbeat_front_addr":"172.21.15.50:6805/2777359361","state":["exists","up"]},{"osd":2,"uuid":"134c5892-e44a-44f2-8cd2-484d22a45e2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6801","nonce":1400583716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6803","nonce":1400583716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6807","nonce":1400583716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6805","nonce":1400583716}]},"public_addr":"172.21.15.70:6801/1400583716","cluster_addr":"172.21.15.70:6803/1400583716","heartbeat_back_addr":"172.21.15.70:6807/1400583716","heartbeat_front_addr":"172.21.15.70:6805/1400583716","state":["exists","up"]},{"osd":3,"uuid":"af49398a-e171-496b-a50e-1f767fc42923","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6811","nonce":1647468379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6813","nonce":1647468379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6817","nonce":1647468379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6815","nonce":1647468379}]},"public_addr":"172.21.15.5:6811/1647468379","cluster_addr":"172.21.15.5:6813/1647468379","heartbeat_back_addr":"172.21.15.5:6817/1647468379","heartbeat_front_addr":"172.21.15.5:6815/1647468379","state":["exists","up"]},{"osd":4,"uuid":"59b847ef-6eb0-4c13-aa06-53a76d77ce45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6809","nonce":2314546877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6811","nonce":2314546877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6815","nonce":2314546877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6813","nonce":2314546877}]},"public_addr":"172.21.15.50:6809/2314546877","cluster_addr":"172.21.15.50:6811/2314546877","heartbeat_back_addr":"172.21.15.50:6815/2314546877","heartbeat_front_addr":"172.21.15.50:6813/2314546877","state":["exists","up"]},{"osd":5,"uuid":"b0dac185-4462-4760-aa36-0d221923b007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6809","nonce":311426299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6811","nonce":311426299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6815","nonce":311426299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6813","nonce":311426299}]},"public_addr":"172.21.15.70:6809/311426299","cluster_addr":"172.21.15.70:6811/311426299","heartbeat_back_addr":"172.21.15.70:6815/311426299","heartbeat_front_addr":"172.21.15.70:6813/311426299","state":["exists","up"]},{"osd":6,"uuid":"12486aa2-61e4-4bdf-94dd-ce5c4cd3df6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6819","nonce":1027645612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6821","nonce":1027645612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6825","nonce":1027645612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6823","nonce":1027645612}]},"public_addr":"172.21.15.5:6819/1027645612","cluster_addr":"172.21.15.5:6821/1027645612","heartbeat_back_addr":"172.21.15.5:6825/1027645612","heartbeat_front_addr":"172.21.15.5:6823/1027645612","state":["exists","up"]},{"osd":7,"uuid":"66f9dcf9-d5c3-4016-812f-d9496e9892d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6817","nonce":2718354517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6819","nonce":2718354517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6823","nonce":2718354517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6821","nonce":2718354517}]},"public_addr":"172.21.15.50:6817/2718354517","cluster_addr":"172.21.15.50:6819/2718354517","heartbeat_back_addr":"172.21.15.50:6823/2718354517","heartbeat_front_addr":"172.21.15.50:6821/2718354517","state":["exists","up"]},{"osd":8,"uuid":"584837f9-af4b-4189-a7e5-04156a94a805","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6817","nonce":3155722993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6819","nonce":3155722993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6823","nonce":3155722993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6821","nonce":3155722993}]},"public_addr":"172.21.15.70:6817/3155722993","cluster_addr":"172.21.15.70:6819/3155722993","heartbeat_back_addr":"172.21.15.70:6823/3155722993","heartbeat_front_addr":"172.21.15.70:6821/3155722993","state":["exists","up"]},{"osd":9,"uuid":"ef60de6e-3456-435c-bd48-ed2636cc0d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6827","nonce":2988145512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6829","nonce":2988145512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6833","nonce":2988145512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6831","nonce":2988145512}]},"public_addr":"172.21.15.5:6827/2988145512","cluster_addr":"172.21.15.5:6829/2988145512","heartbeat_back_addr":"172.21.15.5:6833/2988145512","heartbeat_front_addr":"172.21.15.5:6831/2988145512","state":["exists","up"]},{"osd":10,"uuid":"96c5de40-53df-412d-9501-8ce1711a76a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6825","nonce":4168871229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6827","nonce":4168871229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6831","nonce":4168871229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6829","nonce":4168871229}]},"public_addr":"172.21.15.50:6825/4168871229","cluster_addr":"172.21.15.50:6827/4168871229","heartbeat_back_addr":"172.21.15.50:6831/4168871229","heartbeat_front_addr":"172.21.15.50:6829/4168871229","state":["exists","up"]},{"osd":11,"uuid":"20beefe0-59c3-4392-9f61-8d215e9d2de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6825","nonce":2593470535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6827","nonce":2593470535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6831","nonce":2593470535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6829","nonce":2593470535}]},"public_addr":"172.21.15.70:6825/2593470535","cluster_addr":"172.21.15.70:6827/2593470535","heartbeat_back_addr":"172.21.15.70:6831/2593470535","heartbeat_front_addr":"172.21.15.70:6829/2593470535","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:21:56.748083+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:22:21.969492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:22:46.642917+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:23:11.630486+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:23:36.389322+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:24:01.431039+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:24:27.057017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:24:53.628200+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:25:19.356502+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:25:44.958024+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:26:10.804919+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:26:36.849133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:0/2473024253":"2024-09-01T05:20:57.333680+0000","172.21.15.5:0/2924148490":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/2163558485":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/2111919168":"2024-09-01T05:19:55.663503+0000","172.21.15.5:6801/3616278616":"2024-09-01T05:19:55.663503+0000","172.21.15.5:0/2436421090":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/1570244689":"2024-09-01T05:19:55.663503+0000","172.21.15.5:0/2700448223":"2024-09-01T05:20:57.333680+0000","172.21.15.5:6800/3616278616":"2024-09-01T05:19:55.663503+0000","172.21.15.5:6800/2898463711":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/2450461036":"2024-09-01T05:20:57.333680+0000","172.21.15.5:0/1947189952":"2024-09-01T05:19:55.663503+0000","172.21.15.5:6800/1439868821":"2024-09-01T05:20:57.333680+0000","172.21.15.5:6801/2898463711":"2024-09-01T05:19:31.728664+0000","172.21.15.5:6801/1439868821":"2024-09-01T05:20:57.333680+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T05:28:03.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.512+0000 7f75a4f08640 1 -- 172.21.15.5:0/3502275679 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f75880b4b80 msgr2=0x7f75880b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:03.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.512+0000 7f75a4f08640 1 --2- 172.21.15.5:0/3502275679 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f75880b4b80 0x7f75880b7090 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f75a0102250 tx=0x7f7594009110 comp rx=0 tx=0).stop 2024-08-31T05:28:03.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.512+0000 7f75a4f08640 1 -- 172.21.15.5:0/3502275679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75a01047d0 msgr2=0x7f75a0102510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:03.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.512+0000 7f75a4f08640 1 --2- 172.21.15.5:0/3502275679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75a01047d0 0x7f75a0102510 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7590032fd0 tx=0x7f7590004270 comp rx=0 tx=0).stop 2024-08-31T05:28:03.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.512+0000 7f75a4f08640 1 -- 172.21.15.5:0/3502275679 shutdown_connections 2024-08-31T05:28:03.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.512+0000 7f75a4f08640 1 --2- 172.21.15.5:0/3502275679 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f75880b4b80 0x7f75880b7090 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:03.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.512+0000 7f75a4f08640 1 --2- 172.21.15.5:0/3502275679 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75a010dc00 0x7f75a0102f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:03.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.512+0000 7f75a4f08640 1 --2- 172.21.15.5:0/3502275679 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f75a0105120 0x7f75a0102a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:03.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.512+0000 7f75a4f08640 1 --2- 172.21.15.5:0/3502275679 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75a01047d0 0x7f75a0102510 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:03.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.512+0000 7f75a4f08640 1 -- 172.21.15.5:0/3502275679 >> 172.21.15.5:0/3502275679 conn(0x7f75a0079500 msgr2=0x7f75a0100650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:03.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.513+0000 7f75a4f08640 1 -- 172.21.15.5:0/3502275679 shutdown_connections 2024-08-31T05:28:03.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:03.513+0000 7f75a4f08640 1 -- 172.21.15.5:0/3502275679 wait complete. 2024-08-31T05:28:03.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:03 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/3502275679' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T05:28:03.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:03 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/3502275679' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T05:28:03.959 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:03 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/3502275679' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T05:28:04.419 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-08-31T05:28:04.679 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:28:04.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:04 smithi005 ceph-mon[18602]: pgmap v286: 129 pgs: 129 active+clean; 581 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s wr, 0 op/s; 72 B/s, 0 objects/s recovering 2024-08-31T05:28:04.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:04 smithi070 ceph-mon[22316]: pgmap v286: 129 pgs: 129 active+clean; 581 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s wr, 0 op/s; 72 B/s, 0 objects/s recovering 2024-08-31T05:28:04.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:04 smithi050 ceph-mon[22146]: pgmap v286: 129 pgs: 129 active+clean; 581 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s wr, 0 op/s; 72 B/s, 0 objects/s recovering 2024-08-31T05:28:05.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:05.291+0000 7fc10d209640 1 -- 172.21.15.5:0/3562080165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1081081f0 msgr2=0x7fc108108600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:05.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:05.291+0000 7fc10d209640 1 --2- 172.21.15.5:0/3562080165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1081081f0 0x7fc108108600 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0009900 tx=0x7fc0f002a410 comp rx=0 tx=0).stop 2024-08-31T05:28:05.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:05.291+0000 7fc10d209640 1 -- 172.21.15.5:0/3562080165 shutdown_connections 2024-08-31T05:28:05.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:05.291+0000 7fc10d209640 1 --2- 172.21.15.5:0/3562080165 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc108108b40 0x7fc10810f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:05.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:05.291+0000 7fc10d209640 1 --2- 172.21.15.5:0/3562080165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1081081f0 0x7fc108108600 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:05.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:05.291+0000 7fc10d209640 1 --2- 172.21.15.5:0/3562080165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1081028b0 0x7fc108102cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:05.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:05.291+0000 7fc10d209640 1 -- 172.21.15.5:0/3562080165 >> 172.21.15.5:0/3562080165 conn(0x7fc108079470 msgr2=0x7fc108079880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:05.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:05.291+0000 7fc10d209640 1 -- 172.21.15.5:0/3562080165 shutdown_connections 2024-08-31T05:28:05.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:05.291+0000 7fc10d209640 1 -- 172.21.15.5:0/3562080165 wait complete. 2024-08-31T05:28:05.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:05.292+0000 7fc10d209640 1 Processor -- start 2024-08-31T05:28:05.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:05.292+0000 7fc10d209640 1 -- start start 2024-08-31T05:28:05.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:05.292+0000 7fc10d209640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1081028b0 0x7fc10819b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:05.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:05.292+0000 7fc10d209640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1081081f0 0x7fc10819b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:05.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:05.292+0000 7fc10d209640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc108108b40 0x7fc10819bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:05.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:05.292+0000 7fc10d209640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc1081127a0 con 0x7fc1081028b0 2024-08-31T05:28:05.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:05.292+0000 7fc10d209640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc108112620 con 0x7fc1081081f0 2024-08-31T05:28:05.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:05.292+0000 7fc10d209640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc108112920 con 0x7fc108108b40 2024-08-31T05:28:05.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:05.292+0000 7fc106d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1081028b0 0x7fc10819b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:05.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:05.292+0000 7fc106d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1081028b0 0x7fc10819b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60366/0 (socket says 172.21.15.5:60366) 2024-08-31T05:28:05.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:05.292+0000 7fc106d9d640 1 -- 172.21.15.5:0/3108919766 learned_addr learned my addr 172.21.15.5:0/3108919766 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:28:05.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:05.293+0000 7fc0fffff640 1 --2- 172.21.15.5:0/3108919766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1081081f0 0x7fc10819b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:05.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:05.293+0000 7fc10759e640 1 --2- 172.21.15.5:0/3108919766 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc108108b40 0x7fc10819bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:05.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:05.293+0000 7fc106d9d640 1 -- 172.21.15.5:0/3108919766 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc108108b40 msgr2=0x7fc10819bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:05.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:05.293+0000 7fc106d9d640 1 --2- 172.21.15.5:0/3108919766 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc108108b40 0x7fc10819bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:05.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:05.293+0000 7fc106d9d640 1 -- 172.21.15.5:0/3108919766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1081081f0 msgr2=0x7fc10819b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:05.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:05.293+0000 7fc106d9d640 1 --2- 172.21.15.5:0/3108919766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1081081f0 0x7fc10819b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:05.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:05.293+0000 7fc106d9d640 1 -- 172.21.15.5:0/3108919766 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1081a6460 con 0x7fc1081028b0 2024-08-31T05:28:05.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:05.293+0000 7fc0fffff640 1 --2- 172.21.15.5:0/3108919766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1081081f0 0x7fc10819b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:28:05.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:05.293+0000 7fc106d9d640 1 --2- 172.21.15.5:0/3108919766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1081028b0 0x7fc10819b1d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc0f800e9f0 tx=0x7fc0f800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:05.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:05.293+0000 7fc104d99640 1 -- 172.21.15.5:0/3108919766 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f800cd80 con 0x7fc1081028b0 2024-08-31T05:28:05.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:05.293+0000 7fc104d99640 1 -- 172.21.15.5:0/3108919766 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc0f80108e0 con 0x7fc1081028b0 2024-08-31T05:28:05.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:05.293+0000 7fc10d209640 1 -- 172.21.15.5:0/3108919766 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1081a6750 con 0x7fc1081028b0 2024-08-31T05:28:05.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:05.293+0000 7fc104d99640 1 -- 172.21.15.5:0/3108919766 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f8018980 con 0x7fc1081028b0 2024-08-31T05:28:05.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:05.293+0000 7fc10d209640 1 -- 172.21.15.5:0/3108919766 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1081a6c60 con 0x7fc1081028b0 2024-08-31T05:28:05.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:05.294+0000 7fc10d209640 1 -- 172.21.15.5:0/3108919766 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc108102cc0 con 0x7fc1081028b0 2024-08-31T05:28:05.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:05.296+0000 7fc104d99640 1 -- 172.21.15.5:0/3108919766 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7fc0f8010430 con 0x7fc1081028b0 2024-08-31T05:28:05.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:05.297+0000 7fc104d99640 1 --2- 172.21.15.5:0/3108919766 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc0f40b4bb0 0x7fc0f40b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:05.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:05.297+0000 7fc0fffff640 1 --2- 172.21.15.5:0/3108919766 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc0f40b4bb0 0x7fc0f40b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:05.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:05.297+0000 7fc104d99640 1 -- 172.21.15.5:0/3108919766 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9307+0+0 (secure 0 0 0) 0x7fc0f80e5ee0 con 0x7fc1081028b0 2024-08-31T05:28:05.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:05.298+0000 7fc0fffff640 1 --2- 172.21.15.5:0/3108919766 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc0f40b4bb0 0x7fc0f40b70c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0009230 tx=0x7fc0f0000bc0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:05.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:05.301+0000 7fc104d99640 1 -- 172.21.15.5:0/3108919766 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc0f80acbc0 con 0x7fc1081028b0 2024-08-31T05:28:05.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:05.530+0000 7fc10d209640 1 -- 172.21.15.5:0/3108919766 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fc10806bd10 con 0x7fc1081028b0 2024-08-31T05:28:06.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:06.527+0000 7fc104d99640 1 -- 172.21.15.5:0/3108919766 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7fc0f80b5100 con 0x7fc1081028b0 2024-08-31T05:28:06.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:06.529+0000 7fc10d209640 1 -- 172.21.15.5:0/3108919766 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc0f40b4bb0 msgr2=0x7fc0f40b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:06.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:06.529+0000 7fc10d209640 1 --2- 172.21.15.5:0/3108919766 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc0f40b4bb0 0x7fc0f40b70c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0009230 tx=0x7fc0f0000bc0 comp rx=0 tx=0).stop 2024-08-31T05:28:06.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:06.529+0000 7fc10d209640 1 -- 172.21.15.5:0/3108919766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1081028b0 msgr2=0x7fc10819b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:06.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:06.529+0000 7fc10d209640 1 --2- 172.21.15.5:0/3108919766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1081028b0 0x7fc10819b1d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc0f800e9f0 tx=0x7fc0f800eeb0 comp rx=0 tx=0).stop 2024-08-31T05:28:06.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:06.529+0000 7fc10d209640 1 -- 172.21.15.5:0/3108919766 shutdown_connections 2024-08-31T05:28:06.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:06.529+0000 7fc10d209640 1 --2- 172.21.15.5:0/3108919766 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc0f40b4bb0 0x7fc0f40b70c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:06.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:06.529+0000 7fc10d209640 1 --2- 172.21.15.5:0/3108919766 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc108108b40 0x7fc10819bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:06.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:06.529+0000 7fc10d209640 1 --2- 172.21.15.5:0/3108919766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1081081f0 0x7fc10819b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:06.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:06.529+0000 7fc10d209640 1 --2- 172.21.15.5:0/3108919766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1081028b0 0x7fc10819b1d0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:06.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:06.529+0000 7fc10d209640 1 -- 172.21.15.5:0/3108919766 >> 172.21.15.5:0/3108919766 conn(0x7fc108079470 msgr2=0x7fc1081063e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:06.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:06.529+0000 7fc10d209640 1 -- 172.21.15.5:0/3108919766 shutdown_connections 2024-08-31T05:28:06.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:06.529+0000 7fc10d209640 1 -- 172.21.15.5:0/3108919766 wait complete. 2024-08-31T05:28:06.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:06 smithi005 ceph-mon[18602]: pgmap v287: 129 pgs: 129 active+clean; 581 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s wr, 0 op/s; 72 B/s, 0 objects/s recovering 2024-08-31T05:28:06.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:06 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/3108919766' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-08-31T05:28:06.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:06 smithi070 ceph-mon[22316]: pgmap v287: 129 pgs: 129 active+clean; 581 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s wr, 0 op/s; 72 B/s, 0 objects/s recovering 2024-08-31T05:28:06.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:06 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/3108919766' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-08-31T05:28:06.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:06 smithi050 ceph-mon[22146]: pgmap v287: 129 pgs: 129 active+clean; 581 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s wr, 0 op/s; 72 B/s, 0 objects/s recovering 2024-08-31T05:28:06.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:06 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/3108919766' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-08-31T05:28:07.361 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-08-31T05:28:07.362 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs set cephfs max_mds 5 2024-08-31T05:28:07.625 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:28:07.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:07 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/3108919766' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-08-31T05:28:07.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:07 smithi005 ceph-mon[18602]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-31T05:28:07.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:07 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/3108919766' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-08-31T05:28:07.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:07 smithi070 ceph-mon[22316]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-31T05:28:07.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:07 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/3108919766' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-08-31T05:28:07.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:07 smithi050 ceph-mon[22146]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-31T05:28:08.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.259+0000 7f469d6b9640 1 -- 172.21.15.5:0/3123353636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4698103900 msgr2=0x7f4698103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:08.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.259+0000 7f469d6b9640 1 --2- 172.21.15.5:0/3123353636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4698103900 0x7f4698103d10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4688009900 tx=0x7f468802a410 comp rx=0 tx=0).stop 2024-08-31T05:28:08.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.259+0000 7f469d6b9640 1 -- 172.21.15.5:0/3123353636 shutdown_connections 2024-08-31T05:28:08.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.259+0000 7f469d6b9640 1 --2- 172.21.15.5:0/3123353636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4698109b90 0x7f46981103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:08.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.260+0000 7f469d6b9640 1 --2- 172.21.15.5:0/3123353636 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4698109240 0x7f4698109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:08.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.260+0000 7f469d6b9640 1 --2- 172.21.15.5:0/3123353636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4698103900 0x7f4698103d10 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:08.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.260+0000 7f469d6b9640 1 -- 172.21.15.5:0/3123353636 >> 172.21.15.5:0/3123353636 conn(0x7f469807b5f0 msgr2=0x7f469807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:08.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.260+0000 7f469d6b9640 1 -- 172.21.15.5:0/3123353636 shutdown_connections 2024-08-31T05:28:08.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.260+0000 7f469d6b9640 1 -- 172.21.15.5:0/3123353636 wait complete. 2024-08-31T05:28:08.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.260+0000 7f469d6b9640 1 Processor -- start 2024-08-31T05:28:08.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.260+0000 7f469d6b9640 1 -- start start 2024-08-31T05:28:08.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.261+0000 7f469d6b9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4698103900 0x7f469819a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:08.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.261+0000 7f469d6b9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4698109240 0x7f469819a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:08.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.261+0000 7f469d6b9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4698109b90 0x7f469819fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:08.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.261+0000 7f469d6b9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4698113850 con 0x7f4698109b90 2024-08-31T05:28:08.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.261+0000 7f469d6b9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f46981136d0 con 0x7f4698109240 2024-08-31T05:28:08.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.261+0000 7f469d6b9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f46981139d0 con 0x7f4698103900 2024-08-31T05:28:08.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.261+0000 7f46977fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4698109b90 0x7f469819fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:08.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.261+0000 7f46977fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4698109b90 0x7f469819fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60382/0 (socket says 172.21.15.5:60382) 2024-08-31T05:28:08.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.261+0000 7f46977fe640 1 -- 172.21.15.5:0/4182434620 learned_addr learned my addr 172.21.15.5:0/4182434620 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:28:08.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.261+0000 7f4696ffd640 1 --2- 172.21.15.5:0/4182434620 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4698103900 0x7f469819a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:08.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.261+0000 7f468e7fc640 1 --2- 172.21.15.5:0/4182434620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4698109240 0x7f469819a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:08.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.261+0000 7f46977fe640 1 -- 172.21.15.5:0/4182434620 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4698103900 msgr2=0x7f469819a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:08.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.261+0000 7f46977fe640 1 --2- 172.21.15.5:0/4182434620 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4698103900 0x7f469819a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:08.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.261+0000 7f46977fe640 1 -- 172.21.15.5:0/4182434620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4698109240 msgr2=0x7f469819a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:08.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.261+0000 7f46977fe640 1 --2- 172.21.15.5:0/4182434620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4698109240 0x7f469819a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:08.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.261+0000 7f46977fe640 1 -- 172.21.15.5:0/4182434620 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46981a0210 con 0x7f4698109b90 2024-08-31T05:28:08.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.261+0000 7f468e7fc640 1 --2- 172.21.15.5:0/4182434620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4698109240 0x7f469819a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:28:08.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.261+0000 7f46977fe640 1 --2- 172.21.15.5:0/4182434620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4698109b90 0x7f469819fae0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f469000cad0 tx=0x7f469000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:08.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.262+0000 7f4694ff9640 1 -- 172.21.15.5:0/4182434620 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f469000ae20 con 0x7f4698109b90 2024-08-31T05:28:08.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.262+0000 7f4694ff9640 1 -- 172.21.15.5:0/4182434620 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4690005020 con 0x7f4698109b90 2024-08-31T05:28:08.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.262+0000 7f469d6b9640 1 -- 172.21.15.5:0/4182434620 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46981a0500 con 0x7f4698109b90 2024-08-31T05:28:08.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.262+0000 7f4694ff9640 1 -- 172.21.15.5:0/4182434620 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f469000f6b0 con 0x7f4698109b90 2024-08-31T05:28:08.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.262+0000 7f469d6b9640 1 -- 172.21.15.5:0/4182434620 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46981a6c60 con 0x7f4698109b90 2024-08-31T05:28:08.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.263+0000 7f469d6b9640 1 -- 172.21.15.5:0/4182434620 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4698103d10 con 0x7f4698109b90 2024-08-31T05:28:08.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.264+0000 7f4694ff9640 1 -- 172.21.15.5:0/4182434620 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f46900051d0 con 0x7f4698109b90 2024-08-31T05:28:08.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.266+0000 7f4694ff9640 1 --2- 172.21.15.5:0/4182434620 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f46840b4c00 0x7f46840b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:08.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.266+0000 7f4696ffd640 1 --2- 172.21.15.5:0/4182434620 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f46840b4c00 0x7f46840b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:08.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.266+0000 7f4694ff9640 1 -- 172.21.15.5:0/4182434620 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9307+0+0 (secure 0 0 0) 0x7f46900e58d0 con 0x7f4698109b90 2024-08-31T05:28:08.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.266+0000 7f4696ffd640 1 --2- 172.21.15.5:0/4182434620 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f46840b4c00 0x7f46840b7110 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4688031440 tx=0x7f4688009560 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:08.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.269+0000 7f4694ff9640 1 -- 172.21.15.5:0/4182434620 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4690014030 con 0x7f4698109b90 2024-08-31T05:28:08.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.493+0000 7f469d6b9640 1 -- 172.21.15.5:0/4182434620 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f469802e430 con 0x7f4698109b90 2024-08-31T05:28:08.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.538+0000 7f4694ff9640 1 -- 172.21.15.5:0/4182434620 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v19) ==== 105+0+0 (secure 0 0 0) 0x7f46900ac650 con 0x7f4698109b90 2024-08-31T05:28:08.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.541+0000 7f469d6b9640 1 -- 172.21.15.5:0/4182434620 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f46840b4c00 msgr2=0x7f46840b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:08.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.541+0000 7f469d6b9640 1 --2- 172.21.15.5:0/4182434620 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f46840b4c00 0x7f46840b7110 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4688031440 tx=0x7f4688009560 comp rx=0 tx=0).stop 2024-08-31T05:28:08.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.541+0000 7f469d6b9640 1 -- 172.21.15.5:0/4182434620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4698109b90 msgr2=0x7f469819fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:08.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.541+0000 7f469d6b9640 1 --2- 172.21.15.5:0/4182434620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4698109b90 0x7f469819fae0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f469000cad0 tx=0x7f469000cf90 comp rx=0 tx=0).stop 2024-08-31T05:28:08.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.542+0000 7f469d6b9640 1 -- 172.21.15.5:0/4182434620 shutdown_connections 2024-08-31T05:28:08.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.542+0000 7f469d6b9640 1 --2- 172.21.15.5:0/4182434620 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f46840b4c00 0x7f46840b7110 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:08.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.542+0000 7f469d6b9640 1 --2- 172.21.15.5:0/4182434620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4698109b90 0x7f469819fae0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:08.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.542+0000 7f469d6b9640 1 --2- 172.21.15.5:0/4182434620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4698109240 0x7f469819a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:08.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.542+0000 7f469d6b9640 1 --2- 172.21.15.5:0/4182434620 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4698103900 0x7f469819a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:08.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.542+0000 7f469d6b9640 1 -- 172.21.15.5:0/4182434620 >> 172.21.15.5:0/4182434620 conn(0x7f469807b5f0 msgr2=0x7f4698107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:08.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.542+0000 7f469d6b9640 1 -- 172.21.15.5:0/4182434620 shutdown_connections 2024-08-31T05:28:08.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:08.542+0000 7f469d6b9640 1 -- 172.21.15.5:0/4182434620 wait complete. 2024-08-31T05:28:08.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:08 smithi070 ceph-mon[22316]: pgmap v288: 129 pgs: 129 active+clean; 581 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 515 B/s wr, 0 op/s; 58 B/s, 0 objects/s recovering 2024-08-31T05:28:08.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:08 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/4182434620' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-08-31T05:28:08.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:08 smithi050 ceph-mon[22146]: pgmap v288: 129 pgs: 129 active+clean; 581 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 515 B/s wr, 0 op/s; 58 B/s, 0 objects/s recovering 2024-08-31T05:28:08.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:08 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/4182434620' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-08-31T05:28:08.920 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:08 smithi005 ceph-mon[18602]: pgmap v288: 129 pgs: 129 active+clean; 581 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 515 B/s wr, 0 op/s; 58 B/s, 0 objects/s recovering 2024-08-31T05:28:08.920 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:08 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/4182434620' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-08-31T05:28:09.401 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-08-31T05:28:09.675 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:28:09.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:09 smithi005 ceph-mon[18602]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-31T05:28:09.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:09 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/4182434620' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-08-31T05:28:09.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:09 smithi005 ceph-mon[18602]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-31T05:28:09.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:09 smithi005 ceph-mon[18602]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-31T05:28:09.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:09 smithi005 ceph-mon[18602]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-08-31T05:28:09.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:09 smithi005 ceph-mon[18602]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-08-31T05:28:09.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:09 smithi070 ceph-mon[22316]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-31T05:28:09.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:09 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/4182434620' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-08-31T05:28:09.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:09 smithi070 ceph-mon[22316]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-31T05:28:09.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:09 smithi070 ceph-mon[22316]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-31T05:28:09.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:09 smithi070 ceph-mon[22316]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-08-31T05:28:09.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:09 smithi070 ceph-mon[22316]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-08-31T05:28:09.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:09 smithi050 ceph-mon[22146]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-31T05:28:09.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:09 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/4182434620' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-08-31T05:28:09.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:09 smithi050 ceph-mon[22146]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-31T05:28:09.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:09 smithi050 ceph-mon[22146]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-08-31T05:28:09.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:09 smithi050 ceph-mon[22146]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-08-31T05:28:09.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:09 smithi050 ceph-mon[22146]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-08-31T05:28:10.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:10.327+0000 7f370aa32640 1 -- 172.21.15.5:0/1443327543 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3704109280 msgr2=0x7f3704109690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:10.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:10.327+0000 7f370aa32640 1 --2- 172.21.15.5:0/1443327543 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3704109280 0x7f3704109690 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f36f8009900 tx=0x7f36f802a410 comp rx=0 tx=0).stop 2024-08-31T05:28:10.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:10.327+0000 7f370aa32640 1 -- 172.21.15.5:0/1443327543 shutdown_connections 2024-08-31T05:28:10.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:10.327+0000 7f370aa32640 1 --2- 172.21.15.5:0/1443327543 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3704109bd0 0x7f3704110400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:10.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:10.327+0000 7f370aa32640 1 --2- 172.21.15.5:0/1443327543 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3704109280 0x7f3704109690 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:10.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:10.327+0000 7f370aa32640 1 --2- 172.21.15.5:0/1443327543 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3704103940 0x7f3704103d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:10.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:10.327+0000 7f370aa32640 1 -- 172.21.15.5:0/1443327543 >> 172.21.15.5:0/1443327543 conn(0x7f37040ff3d0 msgr2=0x7f3704101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:10.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:10.327+0000 7f370aa32640 1 -- 172.21.15.5:0/1443327543 shutdown_connections 2024-08-31T05:28:10.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:10.327+0000 7f370aa32640 1 -- 172.21.15.5:0/1443327543 wait complete. 2024-08-31T05:28:10.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:10.328+0000 7f370aa32640 1 Processor -- start 2024-08-31T05:28:10.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:10.328+0000 7f370aa32640 1 -- start start 2024-08-31T05:28:10.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:10.328+0000 7f370aa32640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3704103940 0x7f370419a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:10.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:10.328+0000 7f370aa32640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3704109280 0x7f370419a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:10.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:10.328+0000 7f370aa32640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3704109bd0 0x7f370419faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:10.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:10.328+0000 7f370aa32640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3704113890 con 0x7f3704109280 2024-08-31T05:28:10.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:10.328+0000 7f370aa32640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3704113710 con 0x7f3704109bd0 2024-08-31T05:28:10.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:10.328+0000 7f370aa32640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3704113a10 con 0x7f3704103940 2024-08-31T05:28:10.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:10.328+0000 7f37037fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3704109280 0x7f370419a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:10.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:10.328+0000 7f37037fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3704109280 0x7f370419a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60394/0 (socket says 172.21.15.5:60394) 2024-08-31T05:28:10.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:10.328+0000 7f37037fe640 1 -- 172.21.15.5:0/1251996209 learned_addr learned my addr 172.21.15.5:0/1251996209 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:28:10.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:10.328+0000 7f3703fff640 1 --2- 172.21.15.5:0/1251996209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3704103940 0x7f370419a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:10.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:10.328+0000 7f37037fe640 1 -- 172.21.15.5:0/1251996209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3704103940 msgr2=0x7f370419a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:10.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:10.328+0000 7f37037fe640 1 --2- 172.21.15.5:0/1251996209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3704103940 0x7f370419a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:10.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:10.328+0000 7f3708fcf640 1 --2- 172.21.15.5:0/1251996209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3704109bd0 0x7f370419faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:10.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:10.328+0000 7f37037fe640 1 -- 172.21.15.5:0/1251996209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3704109bd0 msgr2=0x7f370419faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:10.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:10.328+0000 7f37037fe640 1 --2- 172.21.15.5:0/1251996209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3704109bd0 0x7f370419faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:10.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:10.329+0000 7f37037fe640 1 -- 172.21.15.5:0/1251996209 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37041a01d0 con 0x7f3704109280 2024-08-31T05:28:10.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:10.329+0000 7f37037fe640 1 --2- 172.21.15.5:0/1251996209 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3704109280 0x7f370419a800 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f36f802a930 tx=0x7f36f8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:10.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:10.329+0000 7f37017fa640 1 -- 172.21.15.5:0/1251996209 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f803f030 con 0x7f3704109280 2024-08-31T05:28:10.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:10.329+0000 7f37017fa640 1 -- 172.21.15.5:0/1251996209 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36f8003aa0 con 0x7f3704109280 2024-08-31T05:28:10.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:10.329+0000 7f370aa32640 1 -- 172.21.15.5:0/1251996209 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37041a0460 con 0x7f3704109280 2024-08-31T05:28:10.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:10.329+0000 7f37017fa640 1 -- 172.21.15.5:0/1251996209 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f8035070 con 0x7f3704109280 2024-08-31T05:28:10.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:10.329+0000 7f370aa32640 1 -- 172.21.15.5:0/1251996209 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37041a6c20 con 0x7f3704109280 2024-08-31T05:28:10.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:10.330+0000 7f370aa32640 1 -- 172.21.15.5:0/1251996209 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3704103d50 con 0x7f3704109280 2024-08-31T05:28:10.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:10.332+0000 7f37017fa640 1 -- 172.21.15.5:0/1251996209 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f36f8042030 con 0x7f3704109280 2024-08-31T05:28:10.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:10.333+0000 7f37017fa640 1 --2- 172.21.15.5:0/1251996209 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f36ec0b4b80 0x7f36ec0b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:10.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:10.333+0000 7f3703fff640 1 --2- 172.21.15.5:0/1251996209 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f36ec0b4b80 0x7f36ec0b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:10.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:10.333+0000 7f37017fa640 1 -- 172.21.15.5:0/1251996209 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9307+0+0 (secure 0 0 0) 0x7f36f8106180 con 0x7f3704109280 2024-08-31T05:28:10.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:10.333+0000 7f3703fff640 1 --2- 172.21.15.5:0/1251996209 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f36ec0b4b80 0x7f36ec0b7090 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f36f4005fd0 tx=0x7f36f4005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:10.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:10.336+0000 7f37017fa640 1 -- 172.21.15.5:0/1251996209 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f36f80cce80 con 0x7f3704109280 2024-08-31T05:28:10.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:10.562+0000 7f370aa32640 1 -- 172.21.15.5:0/1251996209 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f370419b390 con 0x7f3704109280 2024-08-31T05:28:10.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:10 smithi070 ceph-mon[22316]: pgmap v289: 129 pgs: 129 active+clean; 582 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s wr, 2 op/s; 53 B/s, 0 objects/s recovering 2024-08-31T05:28:10.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:10 smithi070 ceph-mon[22316]: mds.? [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] up:active 2024-08-31T05:28:10.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:10 smithi070 ceph-mon[22316]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-08-31T05:28:10.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:10 smithi070 ceph-mon[22316]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-08-31T05:28:10.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:10 smithi070 ceph-mon[22316]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-08-31T05:28:10.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:10 smithi070 ceph-mon[22316]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-08-31T05:28:10.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:10 smithi050 ceph-mon[22146]: pgmap v289: 129 pgs: 129 active+clean; 582 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s wr, 2 op/s; 53 B/s, 0 objects/s recovering 2024-08-31T05:28:10.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:10 smithi050 ceph-mon[22146]: mds.? [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] up:active 2024-08-31T05:28:10.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:10 smithi050 ceph-mon[22146]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-08-31T05:28:10.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:10 smithi050 ceph-mon[22146]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-08-31T05:28:10.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:10 smithi050 ceph-mon[22146]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-08-31T05:28:10.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:10 smithi050 ceph-mon[22146]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-08-31T05:28:10.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:10 smithi005 ceph-mon[18602]: pgmap v289: 129 pgs: 129 active+clean; 582 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s wr, 2 op/s; 53 B/s, 0 objects/s recovering 2024-08-31T05:28:10.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:10 smithi005 ceph-mon[18602]: mds.? [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] up:active 2024-08-31T05:28:10.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:10 smithi005 ceph-mon[18602]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-08-31T05:28:10.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:10 smithi005 ceph-mon[18602]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-08-31T05:28:10.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:10 smithi005 ceph-mon[18602]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-08-31T05:28:10.968 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:10 smithi005 ceph-mon[18602]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-08-31T05:28:11.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:11.567+0000 7f37017fa640 1 -- 172.21.15.5:0/1251996209 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v25) ==== 121+0+0 (secure 0 0 0) 0x7f370419b390 con 0x7f3704109280 2024-08-31T05:28:11.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:11.570+0000 7f370aa32640 1 -- 172.21.15.5:0/1251996209 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f36ec0b4b80 msgr2=0x7f36ec0b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:11.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:11.570+0000 7f370aa32640 1 --2- 172.21.15.5:0/1251996209 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f36ec0b4b80 0x7f36ec0b7090 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f36f4005fd0 tx=0x7f36f4005850 comp rx=0 tx=0).stop 2024-08-31T05:28:11.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:11.570+0000 7f370aa32640 1 -- 172.21.15.5:0/1251996209 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3704109280 msgr2=0x7f370419a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:11.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:11.570+0000 7f370aa32640 1 --2- 172.21.15.5:0/1251996209 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3704109280 0x7f370419a800 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f36f802a930 tx=0x7f36f8004270 comp rx=0 tx=0).stop 2024-08-31T05:28:11.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:11.570+0000 7f370aa32640 1 -- 172.21.15.5:0/1251996209 shutdown_connections 2024-08-31T05:28:11.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:11.570+0000 7f370aa32640 1 --2- 172.21.15.5:0/1251996209 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f36ec0b4b80 0x7f36ec0b7090 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:11.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:11.570+0000 7f370aa32640 1 --2- 172.21.15.5:0/1251996209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3704109bd0 0x7f370419faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:11.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:11.570+0000 7f370aa32640 1 --2- 172.21.15.5:0/1251996209 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3704109280 0x7f370419a800 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:11.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:11.570+0000 7f370aa32640 1 --2- 172.21.15.5:0/1251996209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3704103940 0x7f370419a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:11.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:11.570+0000 7f370aa32640 1 -- 172.21.15.5:0/1251996209 >> 172.21.15.5:0/1251996209 conn(0x7f37040ff3d0 msgr2=0x7f37041017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:11.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:11.570+0000 7f370aa32640 1 -- 172.21.15.5:0/1251996209 shutdown_connections 2024-08-31T05:28:11.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:11.570+0000 7f370aa32640 1 -- 172.21.15.5:0/1251996209 wait complete. 2024-08-31T05:28:11.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:11 smithi070 ceph-mon[22316]: mds.? [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] up:active 2024-08-31T05:28:11.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:11 smithi070 ceph-mon[22316]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-08-31T05:28:11.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:11 smithi070 ceph-mon[22316]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-08-31T05:28:11.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:11 smithi070 ceph-mon[22316]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=f=up:creating} 8 up:standby 2024-08-31T05:28:11.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:11 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/1251996209' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-08-31T05:28:11.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:11 smithi070 ceph-mon[22316]: daemon mds.f is now active in filesystem cephfs as rank 3 2024-08-31T05:28:11.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:11 smithi050 ceph-mon[22146]: mds.? [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] up:active 2024-08-31T05:28:11.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:11 smithi050 ceph-mon[22146]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-08-31T05:28:11.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:11 smithi050 ceph-mon[22146]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-08-31T05:28:11.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:11 smithi050 ceph-mon[22146]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=f=up:creating} 8 up:standby 2024-08-31T05:28:11.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:11 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/1251996209' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-08-31T05:28:11.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:11 smithi050 ceph-mon[22146]: daemon mds.f is now active in filesystem cephfs as rank 3 2024-08-31T05:28:11.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:11 smithi005 ceph-mon[18602]: mds.? [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] up:active 2024-08-31T05:28:11.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:11 smithi005 ceph-mon[18602]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-08-31T05:28:11.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:11 smithi005 ceph-mon[18602]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-08-31T05:28:11.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:11 smithi005 ceph-mon[18602]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=f=up:creating} 8 up:standby 2024-08-31T05:28:11.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:11 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/1251996209' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-08-31T05:28:11.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:11 smithi005 ceph-mon[18602]: daemon mds.f is now active in filesystem cephfs as rank 3 2024-08-31T05:28:12.425 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-08-31T05:28:12.690 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:28:12.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:12 smithi005 ceph-mon[18602]: pgmap v290: 129 pgs: 129 active+clean; 582 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 4 op/s; 48 B/s, 0 objects/s recovering 2024-08-31T05:28:12.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:12 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/1251996209' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-08-31T05:28:12.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:12 smithi005 ceph-mon[18602]: mds.? [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] up:active 2024-08-31T05:28:12.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:12 smithi005 ceph-mon[18602]: daemon mds.h assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-08-31T05:28:12.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:12 smithi005 ceph-mon[18602]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-31T05:28:12.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:12 smithi005 ceph-mon[18602]: Cluster is now healthy 2024-08-31T05:28:12.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:12 smithi005 ceph-mon[18602]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=f=up:active} 8 up:standby 2024-08-31T05:28:12.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:12 smithi005 ceph-mon[18602]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-08-31T05:28:12.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:12 smithi005 ceph-mon[18602]: daemon mds.h is now active in filesystem cephfs as rank 4 2024-08-31T05:28:12.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:12 smithi070 ceph-mon[22316]: pgmap v290: 129 pgs: 129 active+clean; 582 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 4 op/s; 48 B/s, 0 objects/s recovering 2024-08-31T05:28:12.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:12 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/1251996209' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-08-31T05:28:12.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:12 smithi070 ceph-mon[22316]: mds.? [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] up:active 2024-08-31T05:28:12.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:12 smithi070 ceph-mon[22316]: daemon mds.h assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-08-31T05:28:12.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:12 smithi070 ceph-mon[22316]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-31T05:28:12.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:12 smithi070 ceph-mon[22316]: Cluster is now healthy 2024-08-31T05:28:12.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:12 smithi070 ceph-mon[22316]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=f=up:active} 8 up:standby 2024-08-31T05:28:12.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:12 smithi070 ceph-mon[22316]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-08-31T05:28:12.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:12 smithi070 ceph-mon[22316]: daemon mds.h is now active in filesystem cephfs as rank 4 2024-08-31T05:28:12.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:12 smithi050 ceph-mon[22146]: pgmap v290: 129 pgs: 129 active+clean; 582 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 4 op/s; 48 B/s, 0 objects/s recovering 2024-08-31T05:28:12.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:12 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/1251996209' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-08-31T05:28:12.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:12 smithi050 ceph-mon[22146]: mds.? [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] up:active 2024-08-31T05:28:12.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:12 smithi050 ceph-mon[22146]: daemon mds.h assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-08-31T05:28:12.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:12 smithi050 ceph-mon[22146]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-31T05:28:12.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:12 smithi050 ceph-mon[22146]: Cluster is now healthy 2024-08-31T05:28:12.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:12 smithi050 ceph-mon[22146]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=f=up:active} 8 up:standby 2024-08-31T05:28:12.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:12 smithi050 ceph-mon[22146]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-08-31T05:28:12.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:12 smithi050 ceph-mon[22146]: daemon mds.h is now active in filesystem cephfs as rank 4 2024-08-31T05:28:13.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:13.210+0000 7f94eacdb640 1 -- 172.21.15.5:0/2682304238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94e4108b10 msgr2=0x7f94e410f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:13.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:13.210+0000 7f94eacdb640 1 --2- 172.21.15.5:0/2682304238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94e4108b10 0x7f94e410f340 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f94dc009ca0 tx=0x7f94dc02a8c0 comp rx=0 tx=0).stop 2024-08-31T05:28:13.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:13.210+0000 7f94eacdb640 1 -- 172.21.15.5:0/2682304238 shutdown_connections 2024-08-31T05:28:13.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:13.210+0000 7f94eacdb640 1 --2- 172.21.15.5:0/2682304238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94e4108b10 0x7f94e410f340 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:13.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:13.210+0000 7f94eacdb640 1 --2- 172.21.15.5:0/2682304238 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94e41081c0 0x7f94e41085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:13.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:13.210+0000 7f94eacdb640 1 --2- 172.21.15.5:0/2682304238 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94e4102880 0x7f94e4102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:13.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:13.210+0000 7f94eacdb640 1 -- 172.21.15.5:0/2682304238 >> 172.21.15.5:0/2682304238 conn(0x7f94e4079510 msgr2=0x7f94e4079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:13.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:13.210+0000 7f94eacdb640 1 -- 172.21.15.5:0/2682304238 shutdown_connections 2024-08-31T05:28:13.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:13.210+0000 7f94eacdb640 1 -- 172.21.15.5:0/2682304238 wait complete. 2024-08-31T05:28:13.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:13.211+0000 7f94eacdb640 1 Processor -- start 2024-08-31T05:28:13.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:13.211+0000 7f94eacdb640 1 -- start start 2024-08-31T05:28:13.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:13.211+0000 7f94eacdb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94e4102880 0x7f94e419a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:13.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:13.211+0000 7f94eacdb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94e41081c0 0x7f94e419a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:13.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:13.211+0000 7f94eacdb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94e4108b10 0x7f94e419fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:13.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:13.211+0000 7f94eacdb640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f94e41138e0 con 0x7f94e4108b10 2024-08-31T05:28:13.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:13.211+0000 7f94eacdb640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f94e4113760 con 0x7f94e41081c0 2024-08-31T05:28:13.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:13.211+0000 7f94eacdb640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f94e4113a60 con 0x7f94e4102880 2024-08-31T05:28:13.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:13.211+0000 7f94e9278640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94e4108b10 0x7f94e419fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:13.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:13.211+0000 7f94e9278640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94e4108b10 0x7f94e419fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37124/0 (socket says 172.21.15.5:37124) 2024-08-31T05:28:13.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:13.211+0000 7f94e9278640 1 -- 172.21.15.5:0/1004769902 learned_addr learned my addr 172.21.15.5:0/1004769902 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:28:13.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:13.211+0000 7f94e8a77640 1 --2- 172.21.15.5:0/1004769902 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94e4102880 0x7f94e419a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:13.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:13.211+0000 7f94e3fff640 1 --2- 172.21.15.5:0/1004769902 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94e41081c0 0x7f94e419a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:13.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:13.211+0000 7f94e9278640 1 -- 172.21.15.5:0/1004769902 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94e4102880 msgr2=0x7f94e419a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:13.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:13.211+0000 7f94e9278640 1 --2- 172.21.15.5:0/1004769902 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94e4102880 0x7f94e419a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:13.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:13.211+0000 7f94e9278640 1 -- 172.21.15.5:0/1004769902 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94e41081c0 msgr2=0x7f94e419a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:13.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:13.211+0000 7f94e9278640 1 --2- 172.21.15.5:0/1004769902 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94e41081c0 0x7f94e419a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:13.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:13.211+0000 7f94e9278640 1 -- 172.21.15.5:0/1004769902 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94e41a01e0 con 0x7f94e4108b10 2024-08-31T05:28:13.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:13.212+0000 7f94e9278640 1 --2- 172.21.15.5:0/1004769902 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94e4108b10 0x7f94e419fab0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f94dc005cc0 tx=0x7f94dc031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:13.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:13.212+0000 7f94e1ffb640 1 -- 172.21.15.5:0/1004769902 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94dc003b70 con 0x7f94e4108b10 2024-08-31T05:28:13.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:13.212+0000 7f94e1ffb640 1 -- 172.21.15.5:0/1004769902 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94dc0318f0 con 0x7f94e4108b10 2024-08-31T05:28:13.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:13.212+0000 7f94eacdb640 1 -- 172.21.15.5:0/1004769902 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94e41a0470 con 0x7f94e4108b10 2024-08-31T05:28:13.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:13.212+0000 7f94e1ffb640 1 -- 172.21.15.5:0/1004769902 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94dc02f950 con 0x7f94e4108b10 2024-08-31T05:28:13.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:13.212+0000 7f94eacdb640 1 -- 172.21.15.5:0/1004769902 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94e41a6c30 con 0x7f94e4108b10 2024-08-31T05:28:13.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:13.213+0000 7f94eacdb640 1 -- 172.21.15.5:0/1004769902 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94e4103b00 con 0x7f94e4108b10 2024-08-31T05:28:13.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:13.215+0000 7f94e1ffb640 1 -- 172.21.15.5:0/1004769902 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f94dc004b40 con 0x7f94e4108b10 2024-08-31T05:28:13.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:13.215+0000 7f94e1ffb640 1 --2- 172.21.15.5:0/1004769902 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f94d40b4b80 0x7f94d40b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:13.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:13.215+0000 7f94e8a77640 1 --2- 172.21.15.5:0/1004769902 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f94d40b4b80 0x7f94d40b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:13.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:13.215+0000 7f94e1ffb640 1 -- 172.21.15.5:0/1004769902 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9307+0+0 (secure 0 0 0) 0x7f94dc1068c0 con 0x7f94e4108b10 2024-08-31T05:28:13.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:13.216+0000 7f94e8a77640 1 --2- 172.21.15.5:0/1004769902 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f94d40b4b80 0x7f94d40b7090 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f94d8009bd0 tx=0x7f94d8005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:13.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:13.219+0000 7f94e1ffb640 1 -- 172.21.15.5:0/1004769902 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f94dc0cd5c0 con 0x7f94e4108b10 2024-08-31T05:28:13.336 INFO:journalctl@ceph.mds.i.smithi070.stdout:Aug 31 05:28:12 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-i[53824]: 2024-08-31T05:28:12.844+0000 7f9643477640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-08-31T05:28:13.336 INFO:journalctl@ceph.mds.i.smithi070.stdout:Aug 31 05:28:12 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-i[53824]: 2024-08-31T05:28:12.844+0000 7f9643477640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-08-31T05:28:13.336 INFO:journalctl@ceph.mds.i.smithi070.stdout:Aug 31 05:28:12 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-i[53824]: 2024-08-31T05:28:12.844+0000 7f9643477640 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-08-31T05:28:13.336 INFO:journalctl@ceph.mds.i.smithi070.stdout:Aug 31 05:28:12 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-i[53824]: 2024-08-31T05:28:12.844+0000 7f9643477640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-08-31T05:28:13.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:13.445+0000 7f94eacdb640 1 -- 172.21.15.5:0/1004769902 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f94e419b3a0 con 0x7f94e4108b10 2024-08-31T05:28:13.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:13.583+0000 7f94e1ffb640 1 -- 172.21.15.5:0/1004769902 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v29) ==== 115+0+0 (secure 0 0 0) 0x7f94dc0ccec0 con 0x7f94e4108b10 2024-08-31T05:28:13.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:13.586+0000 7f94eacdb640 1 -- 172.21.15.5:0/1004769902 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f94d40b4b80 msgr2=0x7f94d40b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:13.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:13.586+0000 7f94eacdb640 1 --2- 172.21.15.5:0/1004769902 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f94d40b4b80 0x7f94d40b7090 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f94d8009bd0 tx=0x7f94d8005f90 comp rx=0 tx=0).stop 2024-08-31T05:28:13.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:13.586+0000 7f94eacdb640 1 -- 172.21.15.5:0/1004769902 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94e4108b10 msgr2=0x7f94e419fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:13.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:13.586+0000 7f94eacdb640 1 --2- 172.21.15.5:0/1004769902 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94e4108b10 0x7f94e419fab0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f94dc005cc0 tx=0x7f94dc031700 comp rx=0 tx=0).stop 2024-08-31T05:28:13.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:13.586+0000 7f94eacdb640 1 -- 172.21.15.5:0/1004769902 shutdown_connections 2024-08-31T05:28:13.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:13.586+0000 7f94eacdb640 1 --2- 172.21.15.5:0/1004769902 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f94d40b4b80 0x7f94d40b7090 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:13.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:13.586+0000 7f94eacdb640 1 --2- 172.21.15.5:0/1004769902 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94e4108b10 0x7f94e419fab0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:13.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:13.586+0000 7f94eacdb640 1 --2- 172.21.15.5:0/1004769902 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94e41081c0 0x7f94e419a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:13.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:13.586+0000 7f94eacdb640 1 --2- 172.21.15.5:0/1004769902 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94e4102880 0x7f94e419a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:13.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:13.586+0000 7f94eacdb640 1 -- 172.21.15.5:0/1004769902 >> 172.21.15.5:0/1004769902 conn(0x7f94e4079510 msgr2=0x7f94e41061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:13.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:13.586+0000 7f94eacdb640 1 -- 172.21.15.5:0/1004769902 shutdown_connections 2024-08-31T05:28:13.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:13.586+0000 7f94eacdb640 1 -- 172.21.15.5:0/1004769902 wait complete. 2024-08-31T05:28:13.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:13 smithi005 ceph-mon[18602]: mds.? [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] up:active 2024-08-31T05:28:13.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:13 smithi005 ceph-mon[18602]: fsmap cephfs:5 7 up:standby 5 up:active 2024-08-31T05:28:13.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:13 smithi005 ceph-mon[18602]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T05:28:13.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:13 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/1004769902' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-08-31T05:28:13.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:13 smithi070 ceph-mon[22316]: mds.? [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] up:active 2024-08-31T05:28:13.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:13 smithi070 ceph-mon[22316]: fsmap cephfs:5 7 up:standby 5 up:active 2024-08-31T05:28:13.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:13 smithi070 ceph-mon[22316]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T05:28:13.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:13 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/1004769902' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-08-31T05:28:13.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:13 smithi050 ceph-mon[22146]: mds.? [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] up:active 2024-08-31T05:28:13.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:13 smithi050 ceph-mon[22146]: fsmap cephfs:5 7 up:standby 5 up:active 2024-08-31T05:28:13.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:13 smithi050 ceph-mon[22146]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T05:28:13.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:13 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/1004769902' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-08-31T05:28:14.352 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2024-08-31T05:28:14.352 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-08-31T05:28:14.607 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:28:14.880 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:14 smithi005 ceph-mon[18602]: pgmap v291: 129 pgs: 129 active+clean; 583 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s rd, 1.9 KiB/s wr, 7 op/s; 48 B/s, 0 objects/s recovering 2024-08-31T05:28:14.880 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:14 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/1004769902' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-08-31T05:28:14.880 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:14 smithi005 ceph-mon[18602]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T05:28:14.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:14 smithi050 ceph-mon[22146]: pgmap v291: 129 pgs: 129 active+clean; 583 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s rd, 1.9 KiB/s wr, 7 op/s; 48 B/s, 0 objects/s recovering 2024-08-31T05:28:14.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:14 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/1004769902' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-08-31T05:28:14.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:14 smithi050 ceph-mon[22146]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T05:28:15.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:14 smithi070 ceph-mon[22316]: pgmap v291: 129 pgs: 129 active+clean; 583 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s rd, 1.9 KiB/s wr, 7 op/s; 48 B/s, 0 objects/s recovering 2024-08-31T05:28:15.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:14 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/1004769902' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-08-31T05:28:15.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:14 smithi070 ceph-mon[22316]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T05:28:15.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.127+0000 7f64018fe640 1 -- 172.21.15.5:0/1618430234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63fc109bd0 msgr2=0x7f63fc110400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:15.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.127+0000 7f64018fe640 1 --2- 172.21.15.5:0/1618430234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63fc109bd0 0x7f63fc110400 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f63f4009ca0 tx=0x7f63f402a8c0 comp rx=0 tx=0).stop 2024-08-31T05:28:15.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.127+0000 7f64018fe640 1 -- 172.21.15.5:0/1618430234 shutdown_connections 2024-08-31T05:28:15.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.127+0000 7f64018fe640 1 --2- 172.21.15.5:0/1618430234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63fc109bd0 0x7f63fc110400 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:15.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.127+0000 7f64018fe640 1 --2- 172.21.15.5:0/1618430234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63fc109280 0x7f63fc109690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:15.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.127+0000 7f64018fe640 1 --2- 172.21.15.5:0/1618430234 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f63fc103940 0x7f63fc103d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:15.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.127+0000 7f64018fe640 1 -- 172.21.15.5:0/1618430234 >> 172.21.15.5:0/1618430234 conn(0x7f63fc0ff3d0 msgr2=0x7f63fc101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:15.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.127+0000 7f64018fe640 1 -- 172.21.15.5:0/1618430234 shutdown_connections 2024-08-31T05:28:15.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.127+0000 7f64018fe640 1 -- 172.21.15.5:0/1618430234 wait complete. 2024-08-31T05:28:15.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.128+0000 7f64018fe640 1 Processor -- start 2024-08-31T05:28:15.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.128+0000 7f64018fe640 1 -- start start 2024-08-31T05:28:15.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.128+0000 7f64018fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63fc103940 0x7f63fc19a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:15.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.128+0000 7f64018fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f63fc109280 0x7f63fc19a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:15.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.128+0000 7f64018fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63fc109bd0 0x7f63fc19fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:15.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.128+0000 7f64018fe640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f63fc113890 con 0x7f63fc103940 2024-08-31T05:28:15.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.128+0000 7f64018fe640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f63fc113710 con 0x7f63fc109bd0 2024-08-31T05:28:15.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.128+0000 7f64018fe640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f63fc113a10 con 0x7f63fc109280 2024-08-31T05:28:15.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.129+0000 7f63faffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63fc103940 0x7f63fc19a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:15.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.129+0000 7f63faffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63fc103940 0x7f63fc19a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37134/0 (socket says 172.21.15.5:37134) 2024-08-31T05:28:15.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.129+0000 7f63faffd640 1 -- 172.21.15.5:0/2362434910 learned_addr learned my addr 172.21.15.5:0/2362434910 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:28:15.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.129+0000 7f63fa7fc640 1 --2- 172.21.15.5:0/2362434910 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f63fc109280 0x7f63fc19a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:15.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.129+0000 7f63fb7fe640 1 --2- 172.21.15.5:0/2362434910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63fc109bd0 0x7f63fc19fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:15.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.129+0000 7f63faffd640 1 -- 172.21.15.5:0/2362434910 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f63fc109280 msgr2=0x7f63fc19a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:15.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.129+0000 7f63faffd640 1 --2- 172.21.15.5:0/2362434910 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f63fc109280 0x7f63fc19a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:15.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.129+0000 7f63faffd640 1 -- 172.21.15.5:0/2362434910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63fc109bd0 msgr2=0x7f63fc19fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:15.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.129+0000 7f63faffd640 1 --2- 172.21.15.5:0/2362434910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63fc109bd0 0x7f63fc19fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:15.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.129+0000 7f63faffd640 1 -- 172.21.15.5:0/2362434910 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63fc1a01f0 con 0x7f63fc103940 2024-08-31T05:28:15.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.129+0000 7f63fb7fe640 1 --2- 172.21.15.5:0/2362434910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63fc109bd0 0x7f63fc19fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:28:15.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.129+0000 7f63faffd640 1 --2- 172.21.15.5:0/2362434910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63fc103940 0x7f63fc19a280 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f63ec00d770 tx=0x7f63ec00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:15.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.129+0000 7f64008fc640 1 -- 172.21.15.5:0/2362434910 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ec017070 con 0x7f63fc103940 2024-08-31T05:28:15.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.129+0000 7f64018fe640 1 -- 172.21.15.5:0/2362434910 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63fc1a04e0 con 0x7f63fc103940 2024-08-31T05:28:15.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.129+0000 7f64008fc640 1 -- 172.21.15.5:0/2362434910 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63ec0054d0 con 0x7f63fc103940 2024-08-31T05:28:15.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.129+0000 7f64008fc640 1 -- 172.21.15.5:0/2362434910 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ec004c30 con 0x7f63fc103940 2024-08-31T05:28:15.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.129+0000 7f64018fe640 1 -- 172.21.15.5:0/2362434910 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63fc1a6c40 con 0x7f63fc103940 2024-08-31T05:28:15.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.130+0000 7f64018fe640 1 -- 172.21.15.5:0/2362434910 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63fc103d50 con 0x7f63fc103940 2024-08-31T05:28:15.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.132+0000 7f64008fc640 1 -- 172.21.15.5:0/2362434910 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 20) ==== 152593+0+0 (secure 0 0 0) 0x7f63ec004dd0 con 0x7f63fc103940 2024-08-31T05:28:15.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.133+0000 7f64008fc640 1 --2- 172.21.15.5:0/2362434910 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f63e40b4b80 0x7f63e40b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:15.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.133+0000 7f63fa7fc640 1 --2- 172.21.15.5:0/2362434910 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f63e40b4b80 0x7f63e40b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:15.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.133+0000 7f64008fc640 1 -- 172.21.15.5:0/2362434910 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9307+0+0 (secure 0 0 0) 0x7f63ec0e5470 con 0x7f63fc103940 2024-08-31T05:28:15.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.133+0000 7f63fa7fc640 1 --2- 172.21.15.5:0/2362434910 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f63e40b4b80 0x7f63e40b7090 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f63fc102ad0 tx=0x7f63f0005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:15.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.138+0000 7f64008fc640 1 -- 172.21.15.5:0/2362434910 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f63ec0ac170 con 0x7f63fc103940 2024-08-31T05:28:15.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.347+0000 7f64018fe640 1 -- 172.21.15.5:0/2362434910 --> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f63fc0635a0 con 0x7f63e40b4b80 2024-08-31T05:28:15.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.377+0000 7f64008fc640 1 -- 172.21.15.5:0/2362434910 <== mgr.14220 v2:172.21.15.5:6800/2696053609 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f63fc0635a0 con 0x7f63e40b4b80 2024-08-31T05:28:15.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.379+0000 7f64018fe640 1 -- 172.21.15.5:0/2362434910 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f63e40b4b80 msgr2=0x7f63e40b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:15.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.379+0000 7f64018fe640 1 --2- 172.21.15.5:0/2362434910 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f63e40b4b80 0x7f63e40b7090 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f63fc102ad0 tx=0x7f63f0005f90 comp rx=0 tx=0).stop 2024-08-31T05:28:15.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.379+0000 7f64018fe640 1 -- 172.21.15.5:0/2362434910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63fc103940 msgr2=0x7f63fc19a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:15.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.379+0000 7f64018fe640 1 --2- 172.21.15.5:0/2362434910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63fc103940 0x7f63fc19a280 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f63ec00d770 tx=0x7f63ec00dc30 comp rx=0 tx=0).stop 2024-08-31T05:28:15.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.379+0000 7f64018fe640 1 -- 172.21.15.5:0/2362434910 shutdown_connections 2024-08-31T05:28:15.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.379+0000 7f64018fe640 1 --2- 172.21.15.5:0/2362434910 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f63e40b4b80 0x7f63e40b7090 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:15.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.379+0000 7f64018fe640 1 --2- 172.21.15.5:0/2362434910 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f63fc109bd0 0x7f63fc19fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:15.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.379+0000 7f64018fe640 1 --2- 172.21.15.5:0/2362434910 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f63fc109280 0x7f63fc19a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:15.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.379+0000 7f64018fe640 1 --2- 172.21.15.5:0/2362434910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63fc103940 0x7f63fc19a280 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:15.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.379+0000 7f64018fe640 1 -- 172.21.15.5:0/2362434910 >> 172.21.15.5:0/2362434910 conn(0x7f63fc0ff3d0 msgr2=0x7f63fc106810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:15.382 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:28:15 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: 2024-08-31T05:28:15.352+0000 7f5d87c03640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T05:28:15.382 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:28:15 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: 2024-08-31T05:28:15.352+0000 7f5d87c03640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T05:28:15.382 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:28:15 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: 2024-08-31T05:28:15.352+0000 7f5d87c03640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T05:28:15.382 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:28:15 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: 2024-08-31T05:28:15.352+0000 7f5d87c03640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T05:28:15.382 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:28:15 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: 2024-08-31T05:28:15.352+0000 7f5d87c03640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T05:28:15.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.379+0000 7f64018fe640 1 -- 172.21.15.5:0/2362434910 shutdown_connections 2024-08-31T05:28:15.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:15.379+0000 7f64018fe640 1 -- 172.21.15.5:0/2362434910 wait complete. 2024-08-31T05:28:16.068 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-08-31T05:28:16.320 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:28:16.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:16 smithi005 ceph-mon[18602]: from='client.15000 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:16.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:16 smithi005 ceph-mon[18602]: pgmap v292: 129 pgs: 129 active+clean; 586 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 3.9 KiB/s wr, 15 op/s 2024-08-31T05:28:16.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:16 smithi005 ceph-mon[18602]: mgrmap e21: x(active, since 7m), standbys: z, y 2024-08-31T05:28:16.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:16.839+0000 7f3541a70640 1 -- 172.21.15.5:0/469725752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f353c108180 msgr2=0x7f353c108590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:16.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:16.839+0000 7f3541a70640 1 --2- 172.21.15.5:0/469725752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f353c108180 0x7f353c108590 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3530009900 tx=0x7f353002a410 comp rx=0 tx=0).stop 2024-08-31T05:28:16.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:16.840+0000 7f3541a70640 1 -- 172.21.15.5:0/469725752 shutdown_connections 2024-08-31T05:28:16.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:16.840+0000 7f3541a70640 1 --2- 172.21.15.5:0/469725752 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f353c108ad0 0x7f353c10f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:16.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:16.840+0000 7f3541a70640 1 --2- 172.21.15.5:0/469725752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f353c108180 0x7f353c108590 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:16.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:16.840+0000 7f3541a70640 1 --2- 172.21.15.5:0/469725752 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f353c102840 0x7f353c102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:16.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:16.840+0000 7f3541a70640 1 -- 172.21.15.5:0/469725752 >> 172.21.15.5:0/469725752 conn(0x7f353c0794f0 msgr2=0x7f353c079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:16.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:16.840+0000 7f3541a70640 1 -- 172.21.15.5:0/469725752 shutdown_connections 2024-08-31T05:28:16.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:16.840+0000 7f3541a70640 1 -- 172.21.15.5:0/469725752 wait complete. 2024-08-31T05:28:16.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:16.840+0000 7f3541a70640 1 Processor -- start 2024-08-31T05:28:16.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:16.840+0000 7f3541a70640 1 -- start start 2024-08-31T05:28:16.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:16.841+0000 7f3541a70640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f353c102840 0x7f353c19a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:16.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:16.841+0000 7f3541a70640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f353c108180 0x7f353c19a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:16.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:16.841+0000 7f3541a70640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f353c108ad0 0x7f353c19fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:16.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:16.841+0000 7f3541a70640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f353c1138c0 con 0x7f353c108ad0 2024-08-31T05:28:16.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:16.841+0000 7f3541a70640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f353c113740 con 0x7f353c108180 2024-08-31T05:28:16.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:16.841+0000 7f3541a70640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f353c113a40 con 0x7f353c102840 2024-08-31T05:28:16.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:16.841+0000 7f353bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f353c108ad0 0x7f353c19fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:16.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:16.841+0000 7f353affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f353c108180 0x7f353c19a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:16.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:16.841+0000 7f353bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f353c108ad0 0x7f353c19fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37166/0 (socket says 172.21.15.5:37166) 2024-08-31T05:28:16.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:16.841+0000 7f353bfff640 1 -- 172.21.15.5:0/822091908 learned_addr learned my addr 172.21.15.5:0/822091908 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:28:16.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:16.841+0000 7f353b7fe640 1 --2- 172.21.15.5:0/822091908 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f353c102840 0x7f353c19a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:16.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:16.841+0000 7f353bfff640 1 -- 172.21.15.5:0/822091908 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f353c102840 msgr2=0x7f353c19a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:16.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:16.841+0000 7f353bfff640 1 --2- 172.21.15.5:0/822091908 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f353c102840 0x7f353c19a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:16.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:16.841+0000 7f353bfff640 1 -- 172.21.15.5:0/822091908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f353c108180 msgr2=0x7f353c19a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:16.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:16.841+0000 7f353bfff640 1 --2- 172.21.15.5:0/822091908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f353c108180 0x7f353c19a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:16.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:16.841+0000 7f353bfff640 1 -- 172.21.15.5:0/822091908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f353c1a02e0 con 0x7f353c108ad0 2024-08-31T05:28:16.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:16.842+0000 7f353bfff640 1 --2- 172.21.15.5:0/822091908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f353c108ad0 0x7f353c19fbb0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f353400cad0 tx=0x7f353400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:16.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:16.842+0000 7f3538ff9640 1 -- 172.21.15.5:0/822091908 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f353400ad60 con 0x7f353c108ad0 2024-08-31T05:28:16.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:16.842+0000 7f3541a70640 1 -- 172.21.15.5:0/822091908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f353c1a05d0 con 0x7f353c108ad0 2024-08-31T05:28:16.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:16.842+0000 7f3538ff9640 1 -- 172.21.15.5:0/822091908 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3534005020 con 0x7f353c108ad0 2024-08-31T05:28:16.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:16.842+0000 7f3538ff9640 1 -- 172.21.15.5:0/822091908 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f353400f6b0 con 0x7f353c108ad0 2024-08-31T05:28:16.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:16.842+0000 7f3541a70640 1 -- 172.21.15.5:0/822091908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f353c1a6d30 con 0x7f353c108ad0 2024-08-31T05:28:16.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:16.843+0000 7f3541a70640 1 -- 172.21.15.5:0/822091908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f353c103ac0 con 0x7f353c108ad0 2024-08-31T05:28:16.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:16.844+0000 7f3538ff9640 1 -- 172.21.15.5:0/822091908 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f35340051d0 con 0x7f353c108ad0 2024-08-31T05:28:16.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:16.845+0000 7f3538ff9640 1 --2- 172.21.15.5:0/822091908 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f35240b4c10 0x7f35240b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:16.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:16.846+0000 7f353b7fe640 1 --2- 172.21.15.5:0/822091908 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f35240b4c10 0x7f35240b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:16.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:16.846+0000 7f3538ff9640 1 -- 172.21.15.5:0/822091908 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9307+0+0 (secure 0 0 0) 0x7f35340e5ac0 con 0x7f353c108ad0 2024-08-31T05:28:16.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:16.846+0000 7f353b7fe640 1 --2- 172.21.15.5:0/822091908 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f35240b4c10 0x7f35240b7120 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f352c009990 tx=0x7f352c009110 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:16.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:16.849+0000 7f3538ff9640 1 -- 172.21.15.5:0/822091908 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f3534014030 con 0x7f353c108ad0 2024-08-31T05:28:16.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:16 smithi050 ceph-mon[22146]: from='client.15000 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:16.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:16 smithi050 ceph-mon[22146]: pgmap v292: 129 pgs: 129 active+clean; 586 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 3.9 KiB/s wr, 15 op/s 2024-08-31T05:28:16.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:16 smithi050 ceph-mon[22146]: mgrmap e21: x(active, since 7m), standbys: z, y 2024-08-31T05:28:17.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:17.065+0000 7f3541a70640 1 -- 172.21.15.5:0/822091908 --> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f353c0635a0 con 0x7f35240b4c10 2024-08-31T05:28:17.085 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:16 smithi070 ceph-mon[22316]: from='client.15000 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:17.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:16 smithi070 ceph-mon[22316]: pgmap v292: 129 pgs: 129 active+clean; 586 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 3.9 KiB/s wr, 15 op/s 2024-08-31T05:28:17.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:16 smithi070 ceph-mon[22316]: mgrmap e21: x(active, since 7m), standbys: z, y 2024-08-31T05:28:17.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:17.092+0000 7f3538ff9640 1 -- 172.21.15.5:0/822091908 <== mgr.14220 v2:172.21.15.5:6800/2696053609 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f353c0635a0 con 0x7f35240b4c10 2024-08-31T05:28:17.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:17.094+0000 7f3541a70640 1 -- 172.21.15.5:0/822091908 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f35240b4c10 msgr2=0x7f35240b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:17.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:17.094+0000 7f3541a70640 1 --2- 172.21.15.5:0/822091908 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f35240b4c10 0x7f35240b7120 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f352c009990 tx=0x7f352c009110 comp rx=0 tx=0).stop 2024-08-31T05:28:17.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:17.094+0000 7f3541a70640 1 -- 172.21.15.5:0/822091908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f353c108ad0 msgr2=0x7f353c19fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:17.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:17.094+0000 7f3541a70640 1 --2- 172.21.15.5:0/822091908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f353c108ad0 0x7f353c19fbb0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f353400cad0 tx=0x7f353400ced0 comp rx=0 tx=0).stop 2024-08-31T05:28:17.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:17.094+0000 7f3541a70640 1 -- 172.21.15.5:0/822091908 shutdown_connections 2024-08-31T05:28:17.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:17.094+0000 7f3541a70640 1 --2- 172.21.15.5:0/822091908 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f35240b4c10 0x7f35240b7120 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:17.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:17.094+0000 7f3541a70640 1 --2- 172.21.15.5:0/822091908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f353c108ad0 0x7f353c19fbb0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:17.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:17.094+0000 7f3541a70640 1 --2- 172.21.15.5:0/822091908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f353c108180 0x7f353c19a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:17.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:17.094+0000 7f3541a70640 1 --2- 172.21.15.5:0/822091908 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f353c102840 0x7f353c19a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:17.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:17.095+0000 7f3541a70640 1 -- 172.21.15.5:0/822091908 >> 172.21.15.5:0/822091908 conn(0x7f353c0794f0 msgr2=0x7f353c1062c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:17.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:17.095+0000 7f3541a70640 1 -- 172.21.15.5:0/822091908 shutdown_connections 2024-08-31T05:28:17.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:17.095+0000 7f3541a70640 1 -- 172.21.15.5:0/822091908 wait complete. 2024-08-31T05:28:17.809 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:17 smithi005 ceph-mon[18602]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:17.838 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-08-31T05:28:17.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:17 smithi050 ceph-mon[22146]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:18.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:17 smithi070 ceph-mon[22316]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:18.090 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:28:18.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:18.692+0000 7f99de01a640 1 -- 172.21.15.5:0/1305967744 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99d8103920 msgr2=0x7f99d8103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:18.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:18.692+0000 7f99de01a640 1 --2- 172.21.15.5:0/1305967744 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99d8103920 0x7f99d8103d30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f99c8009900 tx=0x7f99c802a410 comp rx=0 tx=0).stop 2024-08-31T05:28:18.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:18.692+0000 7f99de01a640 1 -- 172.21.15.5:0/1305967744 shutdown_connections 2024-08-31T05:28:18.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:18.692+0000 7f99de01a640 1 --2- 172.21.15.5:0/1305967744 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99d8109bb0 0x7f99d81103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:18.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:18.692+0000 7f99de01a640 1 --2- 172.21.15.5:0/1305967744 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99d8109260 0x7f99d8109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:18.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:18.692+0000 7f99de01a640 1 --2- 172.21.15.5:0/1305967744 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99d8103920 0x7f99d8103d30 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:18.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:18.692+0000 7f99de01a640 1 -- 172.21.15.5:0/1305967744 >> 172.21.15.5:0/1305967744 conn(0x7f99d80ff3b0 msgr2=0x7f99d8101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:18.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:18.692+0000 7f99de01a640 1 -- 172.21.15.5:0/1305967744 shutdown_connections 2024-08-31T05:28:18.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:18.692+0000 7f99de01a640 1 -- 172.21.15.5:0/1305967744 wait complete. 2024-08-31T05:28:18.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:18.693+0000 7f99de01a640 1 Processor -- start 2024-08-31T05:28:18.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:18.693+0000 7f99de01a640 1 -- start start 2024-08-31T05:28:18.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:18.693+0000 7f99de01a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99d8103920 0x7f99d819a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:18.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:18.693+0000 7f99de01a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99d8109260 0x7f99d819a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:18.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:18.693+0000 7f99de01a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99d8109bb0 0x7f99d819fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:18.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:18.693+0000 7f99de01a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f99d8113870 con 0x7f99d8109bb0 2024-08-31T05:28:18.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:18.693+0000 7f99de01a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f99d81136f0 con 0x7f99d8103920 2024-08-31T05:28:18.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:18.693+0000 7f99de01a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f99d81139f0 con 0x7f99d8109260 2024-08-31T05:28:18.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:18.693+0000 7f99d7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99d8109bb0 0x7f99d819fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:18.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:18.693+0000 7f99d7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99d8109bb0 0x7f99d819fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37176/0 (socket says 172.21.15.5:37176) 2024-08-31T05:28:18.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:18.693+0000 7f99d7fff640 1 -- 172.21.15.5:0/3127695801 learned_addr learned my addr 172.21.15.5:0/3127695801 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:28:18.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:18.693+0000 7f99ceffd640 1 --2- 172.21.15.5:0/3127695801 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99d8109260 0x7f99d819a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:18.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:18.694+0000 7f99d77fe640 1 --2- 172.21.15.5:0/3127695801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99d8103920 0x7f99d819a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:18.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:18.694+0000 7f99d7fff640 1 -- 172.21.15.5:0/3127695801 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99d8109260 msgr2=0x7f99d819a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:18.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:18.694+0000 7f99d7fff640 1 --2- 172.21.15.5:0/3127695801 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99d8109260 0x7f99d819a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:18.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:18.694+0000 7f99d7fff640 1 -- 172.21.15.5:0/3127695801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99d8103920 msgr2=0x7f99d819a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:18.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:18.694+0000 7f99d7fff640 1 --2- 172.21.15.5:0/3127695801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99d8103920 0x7f99d819a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:18.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:18.694+0000 7f99d7fff640 1 -- 172.21.15.5:0/3127695801 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99d81a0230 con 0x7f99d8109bb0 2024-08-31T05:28:18.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:18.694+0000 7f99d7fff640 1 --2- 172.21.15.5:0/3127695801 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99d8109bb0 0x7f99d819fb00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f99d000eaa0 tx=0x7f99d000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:18.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:18.694+0000 7f99d57fa640 1 -- 172.21.15.5:0/3127695801 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d000cdb0 con 0x7f99d8109bb0 2024-08-31T05:28:18.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:18.694+0000 7f99d57fa640 1 -- 172.21.15.5:0/3127695801 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99d0005020 con 0x7f99d8109bb0 2024-08-31T05:28:18.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:18.694+0000 7f99de01a640 1 -- 172.21.15.5:0/3127695801 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99d81a0520 con 0x7f99d8109bb0 2024-08-31T05:28:18.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:18.694+0000 7f99d57fa640 1 -- 172.21.15.5:0/3127695801 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d00116d0 con 0x7f99d8109bb0 2024-08-31T05:28:18.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:18.694+0000 7f99de01a640 1 -- 172.21.15.5:0/3127695801 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99d81a6c80 con 0x7f99d8109bb0 2024-08-31T05:28:18.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:18.695+0000 7f99de01a640 1 -- 172.21.15.5:0/3127695801 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99d8104ba0 con 0x7f99d8109bb0 2024-08-31T05:28:18.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:18.697+0000 7f99d57fa640 1 -- 172.21.15.5:0/3127695801 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f99d00051d0 con 0x7f99d8109bb0 2024-08-31T05:28:18.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:18.698+0000 7f99d57fa640 1 --2- 172.21.15.5:0/3127695801 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f99c40b4c10 0x7f99c40b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:18.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:18.698+0000 7f99d77fe640 1 --2- 172.21.15.5:0/3127695801 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f99c40b4c10 0x7f99c40b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:18.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:18.698+0000 7f99d57fa640 1 -- 172.21.15.5:0/3127695801 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9307+0+0 (secure 0 0 0) 0x7f99d00e5c60 con 0x7f99d8109bb0 2024-08-31T05:28:18.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:18.698+0000 7f99d77fe640 1 --2- 172.21.15.5:0/3127695801 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f99c40b4c10 0x7f99c40b7120 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f99c8031440 tx=0x7f99c8009560 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:18.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:18.701+0000 7f99d57fa640 1 -- 172.21.15.5:0/3127695801 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f99d0016030 con 0x7f99d8109bb0 2024-08-31T05:28:18.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:18 smithi050 ceph-mon[22146]: pgmap v293: 129 pgs: 129 active+clean; 587 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 4.1 KiB/s wr, 17 op/s 2024-08-31T05:28:18.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:18.915+0000 7f99de01a640 1 -- 172.21.15.5:0/3127695801 --> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f99d80635a0 con 0x7f99c40b4c10 2024-08-31T05:28:18.917 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:18 smithi005 ceph-mon[18602]: pgmap v293: 129 pgs: 129 active+clean; 587 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 4.1 KiB/s wr, 17 op/s 2024-08-31T05:28:18.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:18.920+0000 7f99d57fa640 1 -- 172.21.15.5:0/3127695801 <== mgr.14220 v2:172.21.15.5:6800/2696053609 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f99d80635a0 con 0x7f99c40b4c10 2024-08-31T05:28:18.922 INFO:teuthology.orchestra.run.smithi005.stdout:/volumes/qa/sv_0/0d369494-ee9b-4096-ac31-4d961b93944e 2024-08-31T05:28:18.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:18.922+0000 7f99de01a640 1 -- 172.21.15.5:0/3127695801 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f99c40b4c10 msgr2=0x7f99c40b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:18.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:18.922+0000 7f99de01a640 1 --2- 172.21.15.5:0/3127695801 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f99c40b4c10 0x7f99c40b7120 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f99c8031440 tx=0x7f99c8009560 comp rx=0 tx=0).stop 2024-08-31T05:28:18.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:18.922+0000 7f99de01a640 1 -- 172.21.15.5:0/3127695801 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99d8109bb0 msgr2=0x7f99d819fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:18.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:18.922+0000 7f99de01a640 1 --2- 172.21.15.5:0/3127695801 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99d8109bb0 0x7f99d819fb00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f99d000eaa0 tx=0x7f99d000ef60 comp rx=0 tx=0).stop 2024-08-31T05:28:18.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:18.922+0000 7f99de01a640 1 -- 172.21.15.5:0/3127695801 shutdown_connections 2024-08-31T05:28:18.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:18.922+0000 7f99de01a640 1 --2- 172.21.15.5:0/3127695801 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f99c40b4c10 0x7f99c40b7120 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:18.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:18.922+0000 7f99de01a640 1 --2- 172.21.15.5:0/3127695801 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99d8109bb0 0x7f99d819fb00 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:18.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:18.922+0000 7f99de01a640 1 --2- 172.21.15.5:0/3127695801 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99d8109260 0x7f99d819a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:18.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:18.922+0000 7f99de01a640 1 --2- 172.21.15.5:0/3127695801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99d8103920 0x7f99d819a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:18.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:18.922+0000 7f99de01a640 1 -- 172.21.15.5:0/3127695801 >> 172.21.15.5:0/3127695801 conn(0x7f99d80ff3b0 msgr2=0x7f99d81017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:18.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:18.922+0000 7f99de01a640 1 -- 172.21.15.5:0/3127695801 shutdown_connections 2024-08-31T05:28:18.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:18.922+0000 7f99de01a640 1 -- 172.21.15.5:0/3127695801 wait complete. 2024-08-31T05:28:19.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:18 smithi070 ceph-mon[22316]: pgmap v293: 129 pgs: 129 active+clean; 587 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 4.1 KiB/s wr, 17 op/s 2024-08-31T05:28:19.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:19 smithi005 ceph-mon[18602]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:19.811 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-08-31T05:28:19.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:19 smithi070 ceph-mon[22316]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:19.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:19 smithi050 ceph-mon[22146]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:20.065 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:28:20.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.561+0000 7f225cf5d640 1 -- 172.21.15.5:0/4247730796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2258102fd0 msgr2=0x7f22581033e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:20.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.561+0000 7f225cf5d640 1 --2- 172.21.15.5:0/4247730796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2258102fd0 0x7f22581033e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2248009900 tx=0x7f224802a410 comp rx=0 tx=0).stop 2024-08-31T05:28:20.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.561+0000 7f225cf5d640 1 -- 172.21.15.5:0/4247730796 shutdown_connections 2024-08-31T05:28:20.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.561+0000 7f225cf5d640 1 --2- 172.21.15.5:0/4247730796 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2258108d60 0x7f225810f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:20.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.561+0000 7f225cf5d640 1 --2- 172.21.15.5:0/4247730796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2258108410 0x7f2258108820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:20.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.561+0000 7f225cf5d640 1 --2- 172.21.15.5:0/4247730796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2258102fd0 0x7f22581033e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:20.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.561+0000 7f225cf5d640 1 -- 172.21.15.5:0/4247730796 >> 172.21.15.5:0/4247730796 conn(0x7f2258079c40 msgr2=0x7f225807a050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:20.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.561+0000 7f225cf5d640 1 -- 172.21.15.5:0/4247730796 shutdown_connections 2024-08-31T05:28:20.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.561+0000 7f225cf5d640 1 -- 172.21.15.5:0/4247730796 wait complete. 2024-08-31T05:28:20.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.562+0000 7f225cf5d640 1 Processor -- start 2024-08-31T05:28:20.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.562+0000 7f225cf5d640 1 -- start start 2024-08-31T05:28:20.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.563+0000 7f225cf5d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2258102fd0 0x7f225819b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:20.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.563+0000 7f225cf5d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2258108410 0x7f225819b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:20.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.563+0000 7f225cf5d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2258108d60 0x7f225819be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:20.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.563+0000 7f225cf5d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2258112a80 con 0x7f2258102fd0 2024-08-31T05:28:20.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.563+0000 7f225cf5d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2258112900 con 0x7f2258108410 2024-08-31T05:28:20.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.563+0000 7f225cf5d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2258112c00 con 0x7f2258108d60 2024-08-31T05:28:20.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.563+0000 7f225659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2258102fd0 0x7f225819b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:20.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.563+0000 7f225659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2258102fd0 0x7f225819b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37208/0 (socket says 172.21.15.5:37208) 2024-08-31T05:28:20.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.563+0000 7f225659c640 1 -- 172.21.15.5:0/1427007996 learned_addr learned my addr 172.21.15.5:0/1427007996 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:28:20.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.563+0000 7f2256d9d640 1 --2- 172.21.15.5:0/1427007996 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2258108d60 0x7f225819be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:20.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.563+0000 7f2255d9b640 1 --2- 172.21.15.5:0/1427007996 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2258108410 0x7f225819b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:20.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.563+0000 7f225659c640 1 -- 172.21.15.5:0/1427007996 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2258108d60 msgr2=0x7f225819be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:20.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.563+0000 7f225659c640 1 --2- 172.21.15.5:0/1427007996 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2258108d60 0x7f225819be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:20.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.563+0000 7f225659c640 1 -- 172.21.15.5:0/1427007996 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2258108410 msgr2=0x7f225819b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:20.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.563+0000 7f225659c640 1 --2- 172.21.15.5:0/1427007996 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2258108410 0x7f225819b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:20.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.563+0000 7f225659c640 1 -- 172.21.15.5:0/1427007996 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22581a6640 con 0x7f2258102fd0 2024-08-31T05:28:20.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.563+0000 7f2255d9b640 1 --2- 172.21.15.5:0/1427007996 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2258108410 0x7f225819b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:28:20.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.563+0000 7f225659c640 1 --2- 172.21.15.5:0/1427007996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2258102fd0 0x7f225819b3b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2248006010 tx=0x7f22480042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:20.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.564+0000 7f22477fe640 1 -- 172.21.15.5:0/1427007996 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224803f030 con 0x7f2258102fd0 2024-08-31T05:28:20.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.564+0000 7f225cf5d640 1 -- 172.21.15.5:0/1427007996 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22581a68d0 con 0x7f2258102fd0 2024-08-31T05:28:20.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.564+0000 7f22477fe640 1 -- 172.21.15.5:0/1427007996 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2248003800 con 0x7f2258102fd0 2024-08-31T05:28:20.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.564+0000 7f22477fe640 1 -- 172.21.15.5:0/1427007996 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2248035070 con 0x7f2258102fd0 2024-08-31T05:28:20.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.564+0000 7f225cf5d640 1 -- 172.21.15.5:0/1427007996 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22581a6db0 con 0x7f2258102fd0 2024-08-31T05:28:20.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.565+0000 7f225cf5d640 1 -- 172.21.15.5:0/1427007996 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22581033e0 con 0x7f2258102fd0 2024-08-31T05:28:20.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.566+0000 7f22477fe640 1 -- 172.21.15.5:0/1427007996 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f2248003cb0 con 0x7f2258102fd0 2024-08-31T05:28:20.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.567+0000 7f22477fe640 1 --2- 172.21.15.5:0/1427007996 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f22400b4c40 0x7f22400b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:20.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.567+0000 7f2255d9b640 1 --2- 172.21.15.5:0/1427007996 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f22400b4c40 0x7f22400b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:20.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.567+0000 7f22477fe640 1 -- 172.21.15.5:0/1427007996 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9307+0+0 (secure 0 0 0) 0x7f2248106120 con 0x7f2258102fd0 2024-08-31T05:28:20.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.568+0000 7f2255d9b640 1 --2- 172.21.15.5:0/1427007996 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f22400b4c40 0x7f22400b7150 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2258108000 tx=0x7f224c005ec0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:20.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.571+0000 7f22477fe640 1 -- 172.21.15.5:0/1427007996 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f22480cccc0 con 0x7f2258102fd0 2024-08-31T05:28:20.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.784+0000 7f225cf5d640 1 -- 172.21.15.5:0/1427007996 --> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f22580635a0 con 0x7f22400b4c40 2024-08-31T05:28:20.786 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:20 smithi005 ceph-mon[18602]: pgmap v294: 129 pgs: 129 active+clean; 612 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.7 KiB/s wr, 22 op/s 2024-08-31T05:28:20.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.811+0000 7f22477fe640 1 -- 172.21.15.5:0/1427007996 <== mgr.14220 v2:172.21.15.5:6800/2696053609 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f22580635a0 con 0x7f22400b4c40 2024-08-31T05:28:20.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.813+0000 7f225cf5d640 1 -- 172.21.15.5:0/1427007996 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f22400b4c40 msgr2=0x7f22400b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:20.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.813+0000 7f225cf5d640 1 --2- 172.21.15.5:0/1427007996 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f22400b4c40 0x7f22400b7150 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2258108000 tx=0x7f224c005ec0 comp rx=0 tx=0).stop 2024-08-31T05:28:20.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.813+0000 7f225cf5d640 1 -- 172.21.15.5:0/1427007996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2258102fd0 msgr2=0x7f225819b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:20.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.813+0000 7f225cf5d640 1 --2- 172.21.15.5:0/1427007996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2258102fd0 0x7f225819b3b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2248006010 tx=0x7f22480042f0 comp rx=0 tx=0).stop 2024-08-31T05:28:20.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.813+0000 7f225cf5d640 1 -- 172.21.15.5:0/1427007996 shutdown_connections 2024-08-31T05:28:20.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.813+0000 7f225cf5d640 1 --2- 172.21.15.5:0/1427007996 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f22400b4c40 0x7f22400b7150 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:20.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.813+0000 7f225cf5d640 1 --2- 172.21.15.5:0/1427007996 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2258108d60 0x7f225819be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:20.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.813+0000 7f225cf5d640 1 --2- 172.21.15.5:0/1427007996 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2258108410 0x7f225819b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:20.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.813+0000 7f225cf5d640 1 --2- 172.21.15.5:0/1427007996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2258102fd0 0x7f225819b3b0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:20.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.813+0000 7f225cf5d640 1 -- 172.21.15.5:0/1427007996 >> 172.21.15.5:0/1427007996 conn(0x7f2258079c40 msgr2=0x7f22581064c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:20.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.813+0000 7f225cf5d640 1 -- 172.21.15.5:0/1427007996 shutdown_connections 2024-08-31T05:28:20.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:20.813+0000 7f225cf5d640 1 -- 172.21.15.5:0/1427007996 wait complete. 2024-08-31T05:28:20.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:20 smithi050 ceph-mon[22146]: pgmap v294: 129 pgs: 129 active+clean; 612 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.7 KiB/s wr, 22 op/s 2024-08-31T05:28:21.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:20 smithi070 ceph-mon[22316]: pgmap v294: 129 pgs: 129 active+clean; 612 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.7 KiB/s wr, 22 op/s 2024-08-31T05:28:21.633 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-08-31T05:28:21.888 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:28:21.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:21 smithi050 ceph-mon[22146]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:21.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:21 smithi005 ceph-mon[18602]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:22.085 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:21 smithi070 ceph-mon[22316]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:22.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:22.414+0000 7f56e3555640 1 -- 172.21.15.5:0/4105160092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56dc109280 msgr2=0x7f56dc109690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:22.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:22.414+0000 7f56e3555640 1 --2- 172.21.15.5:0/4105160092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56dc109280 0x7f56dc109690 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f56d8009900 tx=0x7f56d802a410 comp rx=0 tx=0).stop 2024-08-31T05:28:22.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:22.414+0000 7f56e3555640 1 -- 172.21.15.5:0/4105160092 shutdown_connections 2024-08-31T05:28:22.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:22.414+0000 7f56e3555640 1 --2- 172.21.15.5:0/4105160092 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56dc109bd0 0x7f56dc110400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:22.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:22.414+0000 7f56e3555640 1 --2- 172.21.15.5:0/4105160092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56dc109280 0x7f56dc109690 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:22.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:22.414+0000 7f56e3555640 1 --2- 172.21.15.5:0/4105160092 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56dc103940 0x7f56dc103d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:22.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:22.414+0000 7f56e3555640 1 -- 172.21.15.5:0/4105160092 >> 172.21.15.5:0/4105160092 conn(0x7f56dc0ff3d0 msgr2=0x7f56dc101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:22.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:22.414+0000 7f56e3555640 1 -- 172.21.15.5:0/4105160092 shutdown_connections 2024-08-31T05:28:22.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:22.414+0000 7f56e3555640 1 -- 172.21.15.5:0/4105160092 wait complete. 2024-08-31T05:28:22.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:22.415+0000 7f56e3555640 1 Processor -- start 2024-08-31T05:28:22.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:22.415+0000 7f56e3555640 1 -- start start 2024-08-31T05:28:22.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:22.415+0000 7f56e3555640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56dc103940 0x7f56dc0754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:22.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:22.415+0000 7f56e3555640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56dc109280 0x7f56dc0759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:22.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:22.415+0000 7f56e3555640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56dc109bd0 0x7f56dc075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:22.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:22.415+0000 7f56e3555640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f56dc113890 con 0x7f56dc109bd0 2024-08-31T05:28:22.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:22.415+0000 7f56e3555640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f56dc113710 con 0x7f56dc103940 2024-08-31T05:28:22.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:22.415+0000 7f56e3555640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f56dc113a10 con 0x7f56dc109280 2024-08-31T05:28:22.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:22.415+0000 7f56e1af2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56dc109bd0 0x7f56dc075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:22.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:22.415+0000 7f56e1af2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56dc109bd0 0x7f56dc075f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47764/0 (socket says 172.21.15.5:47764) 2024-08-31T05:28:22.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:22.415+0000 7f56e1af2640 1 -- 172.21.15.5:0/1526938791 learned_addr learned my addr 172.21.15.5:0/1526938791 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:28:22.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:22.415+0000 7f56e12f1640 1 --2- 172.21.15.5:0/1526938791 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56dc103940 0x7f56dc0754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:22.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:22.415+0000 7f56e0af0640 1 --2- 172.21.15.5:0/1526938791 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56dc109280 0x7f56dc0759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:22.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:22.416+0000 7f56e1af2640 1 -- 172.21.15.5:0/1526938791 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56dc109280 msgr2=0x7f56dc0759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:22.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:22.416+0000 7f56e1af2640 1 --2- 172.21.15.5:0/1526938791 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56dc109280 0x7f56dc0759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:22.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:22.416+0000 7f56e1af2640 1 -- 172.21.15.5:0/1526938791 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56dc103940 msgr2=0x7f56dc0754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:22.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:22.416+0000 7f56e1af2640 1 --2- 172.21.15.5:0/1526938791 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56dc103940 0x7f56dc0754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:22.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:22.416+0000 7f56e1af2640 1 -- 172.21.15.5:0/1526938791 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56dc1a8470 con 0x7f56dc109bd0 2024-08-31T05:28:22.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:22.416+0000 7f56e1af2640 1 --2- 172.21.15.5:0/1526938791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56dc109bd0 0x7f56dc075f30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f56d400cce0 tx=0x7f56d400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:22.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:22.416+0000 7f56ce7fc640 1 -- 172.21.15.5:0/1526938791 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d400f450 con 0x7f56dc109bd0 2024-08-31T05:28:22.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:22.416+0000 7f56ce7fc640 1 -- 172.21.15.5:0/1526938791 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56d400faa0 con 0x7f56dc109bd0 2024-08-31T05:28:22.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:22.416+0000 7f56ce7fc640 1 -- 172.21.15.5:0/1526938791 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d4018b70 con 0x7f56dc109bd0 2024-08-31T05:28:22.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:22.416+0000 7f56e3555640 1 -- 172.21.15.5:0/1526938791 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56dc1a8760 con 0x7f56dc109bd0 2024-08-31T05:28:22.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:22.416+0000 7f56e3555640 1 -- 172.21.15.5:0/1526938791 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56dc1a8c20 con 0x7f56dc109bd0 2024-08-31T05:28:22.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:22.417+0000 7f56e3555640 1 -- 172.21.15.5:0/1526938791 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56dc104bc0 con 0x7f56dc109bd0 2024-08-31T05:28:22.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:22.419+0000 7f56ce7fc640 1 -- 172.21.15.5:0/1526938791 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f56d4018d10 con 0x7f56dc109bd0 2024-08-31T05:28:22.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:22.419+0000 7f56ce7fc640 1 --2- 172.21.15.5:0/1526938791 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f56c80b4c10 0x7f56c80b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:22.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:22.420+0000 7f56e12f1640 1 --2- 172.21.15.5:0/1526938791 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f56c80b4c10 0x7f56c80b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:22.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:22.420+0000 7f56ce7fc640 1 -- 172.21.15.5:0/1526938791 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9307+0+0 (secure 0 0 0) 0x7f56d40e5cd0 con 0x7f56dc109bd0 2024-08-31T05:28:22.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:22.420+0000 7f56e12f1640 1 --2- 172.21.15.5:0/1526938791 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f56c80b4c10 0x7f56c80b7120 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f56dc076f00 tx=0x7f56d000b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:22.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:22.423+0000 7f56ce7fc640 1 -- 172.21.15.5:0/1526938791 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f56d4014030 con 0x7f56dc109bd0 2024-08-31T05:28:22.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:22.638+0000 7f56e3555640 1 -- 172.21.15.5:0/1526938791 --> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f56dc0635a0 con 0x7f56c80b4c10 2024-08-31T05:28:22.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:22.644+0000 7f56ce7fc640 1 -- 172.21.15.5:0/1526938791 <== mgr.14220 v2:172.21.15.5:6800/2696053609 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f56dc0635a0 con 0x7f56c80b4c10 2024-08-31T05:28:22.646 INFO:teuthology.orchestra.run.smithi005.stdout:/volumes/qa/sv_1/15035519-2b35-4b61-92f0-6db90b6d9dc0 2024-08-31T05:28:22.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:22.647+0000 7f56e3555640 1 -- 172.21.15.5:0/1526938791 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f56c80b4c10 msgr2=0x7f56c80b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:22.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:22.647+0000 7f56e3555640 1 --2- 172.21.15.5:0/1526938791 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f56c80b4c10 0x7f56c80b7120 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f56dc076f00 tx=0x7f56d000b390 comp rx=0 tx=0).stop 2024-08-31T05:28:22.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:22.647+0000 7f56e3555640 1 -- 172.21.15.5:0/1526938791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56dc109bd0 msgr2=0x7f56dc075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:22.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:22.647+0000 7f56e3555640 1 --2- 172.21.15.5:0/1526938791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56dc109bd0 0x7f56dc075f30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f56d400cce0 tx=0x7f56d400a620 comp rx=0 tx=0).stop 2024-08-31T05:28:22.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:22.647+0000 7f56e3555640 1 -- 172.21.15.5:0/1526938791 shutdown_connections 2024-08-31T05:28:22.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:22.647+0000 7f56e3555640 1 --2- 172.21.15.5:0/1526938791 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f56c80b4c10 0x7f56c80b7120 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:22.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:22.647+0000 7f56e3555640 1 --2- 172.21.15.5:0/1526938791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56dc109bd0 0x7f56dc075f30 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:22.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:22.647+0000 7f56e3555640 1 --2- 172.21.15.5:0/1526938791 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56dc109280 0x7f56dc0759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:22.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:22.647+0000 7f56e3555640 1 --2- 172.21.15.5:0/1526938791 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f56dc103940 0x7f56dc0754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:22.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:22.647+0000 7f56e3555640 1 -- 172.21.15.5:0/1526938791 >> 172.21.15.5:0/1526938791 conn(0x7f56dc0ff3d0 msgr2=0x7f56dc1017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:22.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:22.647+0000 7f56e3555640 1 -- 172.21.15.5:0/1526938791 shutdown_connections 2024-08-31T05:28:22.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:22.647+0000 7f56e3555640 1 -- 172.21.15.5:0/1526938791 wait complete. 2024-08-31T05:28:22.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:22 smithi050 ceph-mon[22146]: pgmap v295: 129 pgs: 129 active+clean; 612 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.0 KiB/s wr, 21 op/s 2024-08-31T05:28:22.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:22 smithi005 ceph-mon[18602]: pgmap v295: 129 pgs: 129 active+clean; 612 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.0 KiB/s wr, 21 op/s 2024-08-31T05:28:23.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:22 smithi070 ceph-mon[22316]: pgmap v295: 129 pgs: 129 active+clean; 612 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.0 KiB/s wr, 21 op/s 2024-08-31T05:28:23.336 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T05:28:23.590 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:28:23.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:23 smithi005 ceph-mon[18602]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:23.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:23 smithi050 ceph-mon[22146]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:24.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:23 smithi070 ceph-mon[22316]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:28:24.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.247+0000 7f850a1ab640 1 -- 172.21.15.5:0/2252348459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8504103900 msgr2=0x7f8504103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:24.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.247+0000 7f850a1ab640 1 --2- 172.21.15.5:0/2252348459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8504103900 0x7f8504103d10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f84f4009900 tx=0x7f84f402a410 comp rx=0 tx=0).stop 2024-08-31T05:28:24.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.247+0000 7f850a1ab640 1 -- 172.21.15.5:0/2252348459 shutdown_connections 2024-08-31T05:28:24.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.247+0000 7f850a1ab640 1 --2- 172.21.15.5:0/2252348459 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8504109b90 0x7f85041103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:24.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.247+0000 7f850a1ab640 1 --2- 172.21.15.5:0/2252348459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8504109240 0x7f8504109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:24.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.247+0000 7f850a1ab640 1 --2- 172.21.15.5:0/2252348459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8504103900 0x7f8504103d10 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:24.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.247+0000 7f850a1ab640 1 -- 172.21.15.5:0/2252348459 >> 172.21.15.5:0/2252348459 conn(0x7f850407b5f0 msgr2=0x7f850407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:24.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.247+0000 7f850a1ab640 1 -- 172.21.15.5:0/2252348459 shutdown_connections 2024-08-31T05:28:24.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.247+0000 7f850a1ab640 1 -- 172.21.15.5:0/2252348459 wait complete. 2024-08-31T05:28:24.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.247+0000 7f850a1ab640 1 Processor -- start 2024-08-31T05:28:24.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.247+0000 7f850a1ab640 1 -- start start 2024-08-31T05:28:24.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.248+0000 7f850a1ab640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8504103900 0x7f850419a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:24.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.248+0000 7f850a1ab640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8504109240 0x7f850419a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:24.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.248+0000 7f850a1ab640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8504109b90 0x7f850419fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:24.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.248+0000 7f850a1ab640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f85041138a0 con 0x7f8504109b90 2024-08-31T05:28:24.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.248+0000 7f850a1ab640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8504113720 con 0x7f8504103900 2024-08-31T05:28:24.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.248+0000 7f850a1ab640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8504113a20 con 0x7f8504109240 2024-08-31T05:28:24.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.248+0000 7f8503fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8504109b90 0x7f850419fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:24.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.248+0000 7f8503fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8504109b90 0x7f850419fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47784/0 (socket says 172.21.15.5:47784) 2024-08-31T05:28:24.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.248+0000 7f8503fff640 1 -- 172.21.15.5:0/1030163111 learned_addr learned my addr 172.21.15.5:0/1030163111 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:28:24.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.248+0000 7f85037fe640 1 --2- 172.21.15.5:0/1030163111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8504103900 0x7f850419a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:24.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.248+0000 7f84faffd640 1 --2- 172.21.15.5:0/1030163111 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8504109240 0x7f850419a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:24.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.248+0000 7f8503fff640 1 -- 172.21.15.5:0/1030163111 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8504109240 msgr2=0x7f850419a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:24.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.248+0000 7f8503fff640 1 --2- 172.21.15.5:0/1030163111 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8504109240 0x7f850419a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:24.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.248+0000 7f8503fff640 1 -- 172.21.15.5:0/1030163111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8504103900 msgr2=0x7f850419a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:24.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.248+0000 7f8503fff640 1 --2- 172.21.15.5:0/1030163111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8504103900 0x7f850419a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:24.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.248+0000 7f8503fff640 1 -- 172.21.15.5:0/1030163111 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85041a0180 con 0x7f8504109b90 2024-08-31T05:28:24.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.248+0000 7f85037fe640 1 --2- 172.21.15.5:0/1030163111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8504103900 0x7f850419a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:28:24.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.248+0000 7f84faffd640 1 --2- 172.21.15.5:0/1030163111 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8504109240 0x7f850419a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:28:24.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.249+0000 7f8503fff640 1 --2- 172.21.15.5:0/1030163111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8504109b90 0x7f850419fa50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f84fc00eb10 tx=0x7f84fc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:24.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.249+0000 7f85017fa640 1 -- 172.21.15.5:0/1030163111 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84fc004b20 con 0x7f8504109b90 2024-08-31T05:28:24.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.249+0000 7f85017fa640 1 -- 172.21.15.5:0/1030163111 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84fc004cc0 con 0x7f8504109b90 2024-08-31T05:28:24.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.249+0000 7f850a1ab640 1 -- 172.21.15.5:0/1030163111 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85041a0470 con 0x7f8504109b90 2024-08-31T05:28:24.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.249+0000 7f85017fa640 1 -- 172.21.15.5:0/1030163111 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84fc010670 con 0x7f8504109b90 2024-08-31T05:28:24.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.249+0000 7f850a1ab640 1 -- 172.21.15.5:0/1030163111 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85041a6bd0 con 0x7f8504109b90 2024-08-31T05:28:24.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.250+0000 7f850a1ab640 1 -- 172.21.15.5:0/1030163111 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8504103d10 con 0x7f8504109b90 2024-08-31T05:28:24.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.252+0000 7f85017fa640 1 -- 172.21.15.5:0/1030163111 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f84fc005000 con 0x7f8504109b90 2024-08-31T05:28:24.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.252+0000 7f85017fa640 1 --2- 172.21.15.5:0/1030163111 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f84f00b4c90 0x7f84f00b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:24.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.253+0000 7f85037fe640 1 --2- 172.21.15.5:0/1030163111 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f84f00b4c90 0x7f84f00b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:24.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.253+0000 7f85017fa640 1 -- 172.21.15.5:0/1030163111 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9307+0+0 (secure 0 0 0) 0x7f84fc0e5f80 con 0x7f8504109b90 2024-08-31T05:28:24.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.253+0000 7f85037fe640 1 --2- 172.21.15.5:0/1030163111 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f84f00b4c90 0x7f84f00b71a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f84f4000c00 tx=0x7f84f4031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:24.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.256+0000 7f85017fa640 1 -- 172.21.15.5:0/1030163111 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f84fc056130 con 0x7f8504109b90 2024-08-31T05:28:24.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.479+0000 7f850a1ab640 1 -- 172.21.15.5:0/1030163111 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f850419b340 con 0x7f8504109b90 2024-08-31T05:28:24.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.480+0000 7f85017fa640 1 -- 172.21.15.5:0/1030163111 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11941 (secure 0 0 0) 0x7f850419b340 con 0x7f8504109b90 2024-08-31T05:28:24.482 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:28:24.482 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":29,"btime":"2024-08-31T05:28:13:579476+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14739,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2024812199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2024812199},{"type":"v1","addr":"172.21.15.5:6835","nonce":2024812199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3629023702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3629023702},{"type":"v1","addr":"172.21.15.5:6837","nonce":3629023702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T05:27:31.929153+0000","modified":"2024-08-31T05:28:13.446913+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24652,"mds_1":24638,"mds_2":24631,"mds_3":24625,"mds_4":24602},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6839/2412701258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":2412701258},{"type":"v1","addr":"172.21.15.5:6839","nonce":2412701258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14820":{"gid":14820,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6841/747057838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":747057838},{"type":"v1","addr":"172.21.15.5:6841","nonce":747057838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6833/1153378982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1153378982},{"type":"v1","addr":"172.21.15.50:6833","nonce":1153378982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6833/364083443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":364083443},{"type":"v1","addr":"172.21.15.70:6833","nonce":364083443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24587":{"gid":24587,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/2346896794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2346896794},{"type":"v1","addr":"172.21.15.50:6835","nonce":2346896794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24602":{"gid":24602,"name":"h","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.50:6837/428759669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":428759669},{"type":"v1","addr":"172.21.15.50:6837","nonce":428759669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.70:6835/2061504114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2061504114},{"type":"v1","addr":"172.21.15.70:6835","nonce":2061504114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.70:6837/2780036414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2780036414},{"type":"v1","addr":"172.21.15.70:6837","nonce":2780036414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.50:6839/98200944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":98200944},{"type":"v1","addr":"172.21.15.50:6839","nonce":98200944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24652":{"gid":24652,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.70:6839/2756569250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":2756569250},{"type":"v1","addr":"172.21.15.70:6839","nonce":2756569250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24652,"qdb_cluster":[24602,24625,24638,24631,24652]},"id":1}]} 2024-08-31T05:28:24.482 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 29 2024-08-31T05:28:24.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.482+0000 7f850a1ab640 1 -- 172.21.15.5:0/1030163111 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f84f00b4c90 msgr2=0x7f84f00b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:24.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.482+0000 7f850a1ab640 1 --2- 172.21.15.5:0/1030163111 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f84f00b4c90 0x7f84f00b71a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f84f4000c00 tx=0x7f84f4031400 comp rx=0 tx=0).stop 2024-08-31T05:28:24.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.482+0000 7f850a1ab640 1 -- 172.21.15.5:0/1030163111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8504109b90 msgr2=0x7f850419fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:24.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.482+0000 7f850a1ab640 1 --2- 172.21.15.5:0/1030163111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8504109b90 0x7f850419fa50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f84fc00eb10 tx=0x7f84fc00c2d0 comp rx=0 tx=0).stop 2024-08-31T05:28:24.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.482+0000 7f850a1ab640 1 -- 172.21.15.5:0/1030163111 shutdown_connections 2024-08-31T05:28:24.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.482+0000 7f850a1ab640 1 --2- 172.21.15.5:0/1030163111 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f84f00b4c90 0x7f84f00b71a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:24.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.482+0000 7f850a1ab640 1 --2- 172.21.15.5:0/1030163111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8504109b90 0x7f850419fa50 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:24.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.482+0000 7f850a1ab640 1 --2- 172.21.15.5:0/1030163111 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8504109240 0x7f850419a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:24.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.482+0000 7f850a1ab640 1 --2- 172.21.15.5:0/1030163111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8504103900 0x7f850419a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:24.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.482+0000 7f850a1ab640 1 -- 172.21.15.5:0/1030163111 >> 172.21.15.5:0/1030163111 conn(0x7f850407b5f0 msgr2=0x7f8504107290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:24.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.482+0000 7f850a1ab640 1 -- 172.21.15.5:0/1030163111 shutdown_connections 2024-08-31T05:28:24.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:24.482+0000 7f850a1ab640 1 -- 172.21.15.5:0/1030163111 wait complete. 2024-08-31T05:28:24.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:24 smithi005 ceph-mon[18602]: pgmap v296: 129 pgs: 129 active+clean; 635 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.6 KiB/s wr, 22 op/s 2024-08-31T05:28:24.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:24 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/1030163111' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:28:24.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:24 smithi050 ceph-mon[22146]: pgmap v296: 129 pgs: 129 active+clean; 635 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.6 KiB/s wr, 22 op/s 2024-08-31T05:28:24.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:24 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/1030163111' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:28:25.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:24 smithi070 ceph-mon[22316]: pgmap v296: 129 pgs: 129 active+clean; 635 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.6 KiB/s wr, 22 op/s 2024-08-31T05:28:25.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:24 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/1030163111' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:28:25.248 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T05:28:25.503 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:28:25.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:25.969+0000 7f170f5c0640 1 -- 172.21.15.5:0/2402637251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1708102800 msgr2=0x7f1708102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:25.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:25.969+0000 7f170f5c0640 1 --2- 172.21.15.5:0/2402637251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1708102800 0x7f1708102c10 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f16f8009900 tx=0x7f16f802a410 comp rx=0 tx=0).stop 2024-08-31T05:28:25.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:25.969+0000 7f170f5c0640 1 -- 172.21.15.5:0/2402637251 shutdown_connections 2024-08-31T05:28:25.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:25.969+0000 7f170f5c0640 1 --2- 172.21.15.5:0/2402637251 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1708108a90 0x7f170810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:25.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:25.969+0000 7f170f5c0640 1 --2- 172.21.15.5:0/2402637251 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1708108140 0x7f1708108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:25.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:25.969+0000 7f170f5c0640 1 --2- 172.21.15.5:0/2402637251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1708102800 0x7f1708102c10 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:25.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:25.969+0000 7f170f5c0640 1 -- 172.21.15.5:0/2402637251 >> 172.21.15.5:0/2402637251 conn(0x7f17080794d0 msgr2=0x7f17080798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:25.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:25.969+0000 7f170f5c0640 1 -- 172.21.15.5:0/2402637251 shutdown_connections 2024-08-31T05:28:25.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:25.969+0000 7f170f5c0640 1 -- 172.21.15.5:0/2402637251 wait complete. 2024-08-31T05:28:25.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:25.970+0000 7f170f5c0640 1 Processor -- start 2024-08-31T05:28:25.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:25.970+0000 7f170f5c0640 1 -- start start 2024-08-31T05:28:25.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:25.970+0000 7f170f5c0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1708102800 0x7f170819a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:25.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:25.970+0000 7f170f5c0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1708108140 0x7f170819a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:25.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:25.970+0000 7f170f5c0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1708108a90 0x7f170819fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:25.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:25.970+0000 7f170f5c0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1708112710 con 0x7f1708108a90 2024-08-31T05:28:25.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:25.970+0000 7f170f5c0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1708112590 con 0x7f1708108140 2024-08-31T05:28:25.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:25.970+0000 7f170f5c0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1708112890 con 0x7f1708102800 2024-08-31T05:28:25.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:25.971+0000 7f170db5d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1708108a90 0x7f170819fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:25.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:25.971+0000 7f170db5d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1708108a90 0x7f170819fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47804/0 (socket says 172.21.15.5:47804) 2024-08-31T05:28:25.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:25.971+0000 7f170db5d640 1 -- 172.21.15.5:0/1248051814 learned_addr learned my addr 172.21.15.5:0/1248051814 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:28:25.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:25.971+0000 7f170d35c640 1 --2- 172.21.15.5:0/1248051814 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1708102800 0x7f170819a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:25.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:25.971+0000 7f170cb5b640 1 --2- 172.21.15.5:0/1248051814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1708108140 0x7f170819a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:25.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:25.971+0000 7f170db5d640 1 -- 172.21.15.5:0/1248051814 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1708102800 msgr2=0x7f170819a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:25.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:25.971+0000 7f170db5d640 1 --2- 172.21.15.5:0/1248051814 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1708102800 0x7f170819a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:25.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:25.971+0000 7f170db5d640 1 -- 172.21.15.5:0/1248051814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1708108140 msgr2=0x7f170819a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:25.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:25.971+0000 7f170db5d640 1 --2- 172.21.15.5:0/1248051814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1708108140 0x7f170819a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:25.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:25.971+0000 7f170db5d640 1 -- 172.21.15.5:0/1248051814 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17081a00e0 con 0x7f1708108a90 2024-08-31T05:28:25.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:25.971+0000 7f170cb5b640 1 --2- 172.21.15.5:0/1248051814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1708108140 0x7f170819a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:28:25.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:25.971+0000 7f170db5d640 1 --2- 172.21.15.5:0/1248051814 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1708108a90 0x7f170819fa70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f170000cce0 tx=0x7f170000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:25.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:25.971+0000 7f16fe7fc640 1 -- 172.21.15.5:0/1248051814 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170000f450 con 0x7f1708108a90 2024-08-31T05:28:25.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:25.971+0000 7f16fe7fc640 1 -- 172.21.15.5:0/1248051814 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f170000faa0 con 0x7f1708108a90 2024-08-31T05:28:25.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:25.971+0000 7f170f5c0640 1 -- 172.21.15.5:0/1248051814 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17081a03d0 con 0x7f1708108a90 2024-08-31T05:28:25.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:25.971+0000 7f16fe7fc640 1 -- 172.21.15.5:0/1248051814 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1700018b70 con 0x7f1708108a90 2024-08-31T05:28:25.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:25.971+0000 7f170f5c0640 1 -- 172.21.15.5:0/1248051814 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17081a6bf0 con 0x7f1708108a90 2024-08-31T05:28:25.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:25.972+0000 7f170f5c0640 1 -- 172.21.15.5:0/1248051814 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1708102c10 con 0x7f1708108a90 2024-08-31T05:28:25.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:25.974+0000 7f16fe7fc640 1 -- 172.21.15.5:0/1248051814 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f1700018d10 con 0x7f1708108a90 2024-08-31T05:28:25.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:25.975+0000 7f16fe7fc640 1 --2- 172.21.15.5:0/1248051814 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f16f40b4c40 0x7f16f40b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:25.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:25.975+0000 7f16fe7fc640 1 -- 172.21.15.5:0/1248051814 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9307+0+0 (secure 0 0 0) 0x7f17000e5c90 con 0x7f1708108a90 2024-08-31T05:28:25.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:25.975+0000 7f170d35c640 1 --2- 172.21.15.5:0/1248051814 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f16f40b4c40 0x7f16f40b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:25.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:25.976+0000 7f170d35c640 1 --2- 172.21.15.5:0/1248051814 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f16f40b4c40 0x7f16f40b7150 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f16f8031440 tx=0x7f16f8009560 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:25.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:25.978+0000 7f16fe7fc640 1 -- 172.21.15.5:0/1248051814 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f1700014030 con 0x7f1708108a90 2024-08-31T05:28:26.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:26.164+0000 7f170f5c0640 1 -- 172.21.15.5:0/1248051814 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f170819b360 con 0x7f1708108a90 2024-08-31T05:28:26.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:26.165+0000 7f16fe7fc640 1 -- 172.21.15.5:0/1248051814 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+24934 (secure 0 0 0) 0x7f170819b360 con 0x7f1708108a90 2024-08-31T05:28:26.168 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:28:26.168 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":85,"fsid":"69422704-6758-11ef-bcd4-c7b262605968","created":"2024-08-31T05:19:04.860258+0000","modified":"2024-08-31T05:27:58.494079+0000","last_up_change":"2024-08-31T05:26:38.675914+0000","last_in_change":"2024-08-31T05:26:15.366713+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T05:22:49.802575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T05:27:27.835197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T05:27:30.058144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-31T05:27:36.272228+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c5745391-e9d7-4799-9db9-6b34bb91b7df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6803","nonce":2312496244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6805","nonce":2312496244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6809","nonce":2312496244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6807","nonce":2312496244}]},"public_addr":"172.21.15.5:6803/2312496244","cluster_addr":"172.21.15.5:6805/2312496244","heartbeat_back_addr":"172.21.15.5:6809/2312496244","heartbeat_front_addr":"172.21.15.5:6807/2312496244","state":["exists","up"]},{"osd":1,"uuid":"f1903bd7-b2c5-424e-a74e-795f729471db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6801","nonce":2777359361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6803","nonce":2777359361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6807","nonce":2777359361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6805","nonce":2777359361}]},"public_addr":"172.21.15.50:6801/2777359361","cluster_addr":"172.21.15.50:6803/2777359361","heartbeat_back_addr":"172.21.15.50:6807/2777359361","heartbeat_front_addr":"172.21.15.50:6805/2777359361","state":["exists","up"]},{"osd":2,"uuid":"134c5892-e44a-44f2-8cd2-484d22a45e2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6801","nonce":1400583716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6803","nonce":1400583716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6807","nonce":1400583716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6805","nonce":1400583716}]},"public_addr":"172.21.15.70:6801/1400583716","cluster_addr":"172.21.15.70:6803/1400583716","heartbeat_back_addr":"172.21.15.70:6807/1400583716","heartbeat_front_addr":"172.21.15.70:6805/1400583716","state":["exists","up"]},{"osd":3,"uuid":"af49398a-e171-496b-a50e-1f767fc42923","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6811","nonce":1647468379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6813","nonce":1647468379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6817","nonce":1647468379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6815","nonce":1647468379}]},"public_addr":"172.21.15.5:6811/1647468379","cluster_addr":"172.21.15.5:6813/1647468379","heartbeat_back_addr":"172.21.15.5:6817/1647468379","heartbeat_front_addr":"172.21.15.5:6815/1647468379","state":["exists","up"]},{"osd":4,"uuid":"59b847ef-6eb0-4c13-aa06-53a76d77ce45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6809","nonce":2314546877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6811","nonce":2314546877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6815","nonce":2314546877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6813","nonce":2314546877}]},"public_addr":"172.21.15.50:6809/2314546877","cluster_addr":"172.21.15.50:6811/2314546877","heartbeat_back_addr":"172.21.15.50:6815/2314546877","heartbeat_front_addr":"172.21.15.50:6813/2314546877","state":["exists","up"]},{"osd":5,"uuid":"b0dac185-4462-4760-aa36-0d221923b007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6809","nonce":311426299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6811","nonce":311426299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6815","nonce":311426299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6813","nonce":311426299}]},"public_addr":"172.21.15.70:6809/311426299","cluster_addr":"172.21.15.70:6811/311426299","heartbeat_back_addr":"172.21.15.70:6815/311426299","heartbeat_front_addr":"172.21.15.70:6813/311426299","state":["exists","up"]},{"osd":6,"uuid":"12486aa2-61e4-4bdf-94dd-ce5c4cd3df6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6819","nonce":1027645612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6821","nonce":1027645612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6825","nonce":1027645612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6823","nonce":1027645612}]},"public_addr":"172.21.15.5:6819/1027645612","cluster_addr":"172.21.15.5:6821/1027645612","heartbeat_back_addr":"172.21.15.5:6825/1027645612","heartbeat_front_addr":"172.21.15.5:6823/1027645612","state":["exists","up"]},{"osd":7,"uuid":"66f9dcf9-d5c3-4016-812f-d9496e9892d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6817","nonce":2718354517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6819","nonce":2718354517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6823","nonce":2718354517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6821","nonce":2718354517}]},"public_addr":"172.21.15.50:6817/2718354517","cluster_addr":"172.21.15.50:6819/2718354517","heartbeat_back_addr":"172.21.15.50:6823/2718354517","heartbeat_front_addr":"172.21.15.50:6821/2718354517","state":["exists","up"]},{"osd":8,"uuid":"584837f9-af4b-4189-a7e5-04156a94a805","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6817","nonce":3155722993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6819","nonce":3155722993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6823","nonce":3155722993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6821","nonce":3155722993}]},"public_addr":"172.21.15.70:6817/3155722993","cluster_addr":"172.21.15.70:6819/3155722993","heartbeat_back_addr":"172.21.15.70:6823/3155722993","heartbeat_front_addr":"172.21.15.70:6821/3155722993","state":["exists","up"]},{"osd":9,"uuid":"ef60de6e-3456-435c-bd48-ed2636cc0d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6827","nonce":2988145512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6829","nonce":2988145512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6833","nonce":2988145512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6831","nonce":2988145512}]},"public_addr":"172.21.15.5:6827/2988145512","cluster_addr":"172.21.15.5:6829/2988145512","heartbeat_back_addr":"172.21.15.5:6833/2988145512","heartbeat_front_addr":"172.21.15.5:6831/2988145512","state":["exists","up"]},{"osd":10,"uuid":"96c5de40-53df-412d-9501-8ce1711a76a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6825","nonce":4168871229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6827","nonce":4168871229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6831","nonce":4168871229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6829","nonce":4168871229}]},"public_addr":"172.21.15.50:6825/4168871229","cluster_addr":"172.21.15.50:6827/4168871229","heartbeat_back_addr":"172.21.15.50:6831/4168871229","heartbeat_front_addr":"172.21.15.50:6829/4168871229","state":["exists","up"]},{"osd":11,"uuid":"20beefe0-59c3-4392-9f61-8d215e9d2de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6825","nonce":2593470535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6827","nonce":2593470535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6831","nonce":2593470535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6829","nonce":2593470535}]},"public_addr":"172.21.15.70:6825/2593470535","cluster_addr":"172.21.15.70:6827/2593470535","heartbeat_back_addr":"172.21.15.70:6831/2593470535","heartbeat_front_addr":"172.21.15.70:6829/2593470535","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:21:56.748083+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:22:21.969492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:22:46.642917+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:23:11.630486+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:23:36.389322+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:24:01.431039+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:24:27.057017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:24:53.628200+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:25:19.356502+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:25:44.958024+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:26:10.804919+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:26:36.849133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:0/2473024253":"2024-09-01T05:20:57.333680+0000","172.21.15.5:0/2924148490":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/2163558485":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/2111919168":"2024-09-01T05:19:55.663503+0000","172.21.15.5:6801/3616278616":"2024-09-01T05:19:55.663503+0000","172.21.15.5:0/2436421090":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/1570244689":"2024-09-01T05:19:55.663503+0000","172.21.15.5:0/2700448223":"2024-09-01T05:20:57.333680+0000","172.21.15.5:6800/3616278616":"2024-09-01T05:19:55.663503+0000","172.21.15.5:6800/2898463711":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/2450461036":"2024-09-01T05:20:57.333680+0000","172.21.15.5:0/1947189952":"2024-09-01T05:19:55.663503+0000","172.21.15.5:6800/1439868821":"2024-09-01T05:20:57.333680+0000","172.21.15.5:6801/2898463711":"2024-09-01T05:19:31.728664+0000","172.21.15.5:6801/1439868821":"2024-09-01T05:20:57.333680+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T05:28:26.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:26.167+0000 7f170f5c0640 1 -- 172.21.15.5:0/1248051814 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f16f40b4c40 msgr2=0x7f16f40b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:26.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:26.167+0000 7f170f5c0640 1 --2- 172.21.15.5:0/1248051814 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f16f40b4c40 0x7f16f40b7150 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f16f8031440 tx=0x7f16f8009560 comp rx=0 tx=0).stop 2024-08-31T05:28:26.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:26.167+0000 7f170f5c0640 1 -- 172.21.15.5:0/1248051814 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1708108a90 msgr2=0x7f170819fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:26.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:26.167+0000 7f170f5c0640 1 --2- 172.21.15.5:0/1248051814 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1708108a90 0x7f170819fa70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f170000cce0 tx=0x7f170000a620 comp rx=0 tx=0).stop 2024-08-31T05:28:26.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:26.167+0000 7f170f5c0640 1 -- 172.21.15.5:0/1248051814 shutdown_connections 2024-08-31T05:28:26.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:26.167+0000 7f170f5c0640 1 --2- 172.21.15.5:0/1248051814 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f16f40b4c40 0x7f16f40b7150 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:26.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:26.167+0000 7f170f5c0640 1 --2- 172.21.15.5:0/1248051814 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1708108a90 0x7f170819fa70 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:26.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:26.167+0000 7f170f5c0640 1 --2- 172.21.15.5:0/1248051814 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1708108140 0x7f170819a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:26.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:26.167+0000 7f170f5c0640 1 --2- 172.21.15.5:0/1248051814 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1708102800 0x7f170819a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:26.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:26.168+0000 7f170f5c0640 1 -- 172.21.15.5:0/1248051814 >> 172.21.15.5:0/1248051814 conn(0x7f17080794d0 msgr2=0x7f1708101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:26.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:26.168+0000 7f170f5c0640 1 -- 172.21.15.5:0/1248051814 shutdown_connections 2024-08-31T05:28:26.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:26.168+0000 7f170f5c0640 1 -- 172.21.15.5:0/1248051814 wait complete. 2024-08-31T05:28:26.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:26 smithi050 ceph-mon[22146]: pgmap v297: 129 pgs: 129 active+clean; 635 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.4 KiB/s wr, 20 op/s 2024-08-31T05:28:27.035 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:26 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/1248051814' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T05:28:27.036 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:26 smithi005 ceph-mon[18602]: pgmap v297: 129 pgs: 129 active+clean; 635 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.4 KiB/s wr, 20 op/s 2024-08-31T05:28:27.036 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:26 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/1248051814' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T05:28:27.037 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-08-31T05:28:27.038 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph pg dump --format=json 2024-08-31T05:28:27.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:26 smithi070 ceph-mon[22316]: pgmap v297: 129 pgs: 129 active+clean; 635 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.4 KiB/s wr, 20 op/s 2024-08-31T05:28:27.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:26 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/1248051814' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T05:28:27.296 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:28:27.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.778+0000 7f4490792640 1 -- 172.21.15.5:0/3741599578 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4488103900 msgr2=0x7f4488103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:27.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.778+0000 7f4490792640 1 --2- 172.21.15.5:0/3741599578 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4488103900 0x7f4488103d10 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f4484009900 tx=0x7f448402a410 comp rx=0 tx=0).stop 2024-08-31T05:28:27.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.778+0000 7f4490792640 1 -- 172.21.15.5:0/3741599578 shutdown_connections 2024-08-31T05:28:27.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.779+0000 7f4490792640 1 --2- 172.21.15.5:0/3741599578 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4488109b90 0x7f44881103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:27.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.779+0000 7f4490792640 1 --2- 172.21.15.5:0/3741599578 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4488109240 0x7f4488109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:27.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.779+0000 7f4490792640 1 --2- 172.21.15.5:0/3741599578 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4488103900 0x7f4488103d10 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:27.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.779+0000 7f4490792640 1 -- 172.21.15.5:0/3741599578 >> 172.21.15.5:0/3741599578 conn(0x7f448807b5f0 msgr2=0x7f448807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:27.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.779+0000 7f4490792640 1 -- 172.21.15.5:0/3741599578 shutdown_connections 2024-08-31T05:28:27.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.779+0000 7f4490792640 1 -- 172.21.15.5:0/3741599578 wait complete. 2024-08-31T05:28:27.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.779+0000 7f4490792640 1 Processor -- start 2024-08-31T05:28:27.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.779+0000 7f4490792640 1 -- start start 2024-08-31T05:28:27.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.780+0000 7f4490792640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4488103900 0x7f448819a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:27.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.780+0000 7f4490792640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4488109240 0x7f448819a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:27.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.780+0000 7f4490792640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4488109b90 0x7f448819fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:27.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.780+0000 7f4490792640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4488113870 con 0x7f4488109240 2024-08-31T05:28:27.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.780+0000 7f4490792640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f44881136f0 con 0x7f4488103900 2024-08-31T05:28:27.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.780+0000 7f4490792640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f44881139f0 con 0x7f4488109b90 2024-08-31T05:28:27.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.780+0000 7f448dd2d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4488109240 0x7f448819a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:27.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.780+0000 7f448dd2d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4488109240 0x7f448819a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47824/0 (socket says 172.21.15.5:47824) 2024-08-31T05:28:27.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.780+0000 7f448dd2d640 1 -- 172.21.15.5:0/1368095414 learned_addr learned my addr 172.21.15.5:0/1368095414 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:28:27.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.780+0000 7f448e52e640 1 --2- 172.21.15.5:0/1368095414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4488103900 0x7f448819a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:27.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.780+0000 7f448ed2f640 1 --2- 172.21.15.5:0/1368095414 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4488109b90 0x7f448819fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:27.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.780+0000 7f448dd2d640 1 -- 172.21.15.5:0/1368095414 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4488109b90 msgr2=0x7f448819fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:27.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.780+0000 7f448dd2d640 1 --2- 172.21.15.5:0/1368095414 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4488109b90 0x7f448819fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:27.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.780+0000 7f448dd2d640 1 -- 172.21.15.5:0/1368095414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4488103900 msgr2=0x7f448819a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:27.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.780+0000 7f448dd2d640 1 --2- 172.21.15.5:0/1368095414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4488103900 0x7f448819a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:27.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.780+0000 7f448dd2d640 1 -- 172.21.15.5:0/1368095414 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44881a01f0 con 0x7f4488109240 2024-08-31T05:28:27.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.780+0000 7f448ed2f640 1 --2- 172.21.15.5:0/1368095414 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4488109b90 0x7f448819fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:28:27.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.780+0000 7f448dd2d640 1 --2- 172.21.15.5:0/1368095414 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4488109240 0x7f448819a820 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f447800c970 tx=0x7f447800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:27.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.780+0000 7f447f7fe640 1 -- 172.21.15.5:0/1368095414 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4478004220 con 0x7f4488109240 2024-08-31T05:28:27.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.780+0000 7f447f7fe640 1 -- 172.21.15.5:0/1368095414 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44780043c0 con 0x7f4488109240 2024-08-31T05:28:27.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.780+0000 7f4490792640 1 -- 172.21.15.5:0/1368095414 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44881a04e0 con 0x7f4488109240 2024-08-31T05:28:27.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.780+0000 7f447f7fe640 1 -- 172.21.15.5:0/1368095414 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4478004a00 con 0x7f4488109240 2024-08-31T05:28:27.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.781+0000 7f4490792640 1 -- 172.21.15.5:0/1368095414 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44881a6c40 con 0x7f4488109240 2024-08-31T05:28:27.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.782+0000 7f4490792640 1 -- 172.21.15.5:0/1368095414 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4488103d10 con 0x7f4488109240 2024-08-31T05:28:27.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.783+0000 7f447f7fe640 1 -- 172.21.15.5:0/1368095414 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f44780079b0 con 0x7f4488109240 2024-08-31T05:28:27.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.784+0000 7f447f7fe640 1 --2- 172.21.15.5:0/1368095414 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f44740b4c10 0x7f44740b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:27.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.784+0000 7f448e52e640 1 --2- 172.21.15.5:0/1368095414 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f44740b4c10 0x7f44740b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:27.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.784+0000 7f447f7fe640 1 -- 172.21.15.5:0/1368095414 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9307+0+0 (secure 0 0 0) 0x7f44780e54d0 con 0x7f4488109240 2024-08-31T05:28:27.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.784+0000 7f448e52e640 1 --2- 172.21.15.5:0/1368095414 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f44740b4c10 0x7f44740b7120 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4484031440 tx=0x7f4484009560 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:27.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.788+0000 7f447f7fe640 1 -- 172.21.15.5:0/1368095414 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4478014030 con 0x7f4488109240 2024-08-31T05:28:27.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.968+0000 7f4490792640 1 -- 172.21.15.5:0/1368095414 --> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f44880635a0 con 0x7f44740b4c10 2024-08-31T05:28:27.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.975+0000 7f447f7fe640 1 -- 172.21.15.5:0/1368095414 <== mgr.14220 v2:172.21.15.5:6800/2696053609 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340662 (secure 0 0 0) 0x7f44880635a0 con 0x7f44740b4c10 2024-08-31T05:28:27.981 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:28:27.982 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-31T05:28:27.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.978+0000 7f4490792640 1 -- 172.21.15.5:0/1368095414 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f44740b4c10 msgr2=0x7f44740b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:27.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.978+0000 7f4490792640 1 --2- 172.21.15.5:0/1368095414 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f44740b4c10 0x7f44740b7120 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4484031440 tx=0x7f4484009560 comp rx=0 tx=0).stop 2024-08-31T05:28:27.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.979+0000 7f4490792640 1 -- 172.21.15.5:0/1368095414 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4488109240 msgr2=0x7f448819a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:27.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.979+0000 7f4490792640 1 --2- 172.21.15.5:0/1368095414 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4488109240 0x7f448819a820 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f447800c970 tx=0x7f447800ce30 comp rx=0 tx=0).stop 2024-08-31T05:28:27.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.979+0000 7f4490792640 1 -- 172.21.15.5:0/1368095414 shutdown_connections 2024-08-31T05:28:27.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.979+0000 7f4490792640 1 --2- 172.21.15.5:0/1368095414 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f44740b4c10 0x7f44740b7120 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:27.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.979+0000 7f4490792640 1 --2- 172.21.15.5:0/1368095414 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4488109b90 0x7f448819fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:27.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.979+0000 7f4490792640 1 --2- 172.21.15.5:0/1368095414 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4488109240 0x7f448819a820 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:27.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.979+0000 7f4490792640 1 --2- 172.21.15.5:0/1368095414 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4488103900 0x7f448819a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:27.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.979+0000 7f4490792640 1 -- 172.21.15.5:0/1368095414 >> 172.21.15.5:0/1368095414 conn(0x7f448807b5f0 msgr2=0x7f44881072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:27.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.979+0000 7f4490792640 1 -- 172.21.15.5:0/1368095414 shutdown_connections 2024-08-31T05:28:27.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:27.979+0000 7f4490792640 1 -- 172.21.15.5:0/1368095414 wait complete. 2024-08-31T05:28:28.690 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:28 smithi005 ceph-mon[18602]: pgmap v298: 129 pgs: 129 active+clean; 635 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 5.3 KiB/s wr, 12 op/s 2024-08-31T05:28:28.691 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:28 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:28:28.691 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:28 smithi005 ceph-mon[18602]: from='client.15048 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T05:28:28.692 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":298,"stamp":"2024-08-31T05:28:27.434462+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":650210,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":234,"num_read_kb":210,"num_write":361,"num_write_kb":2280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":2952422,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":300,"ondisk_log_size":300,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":402400,"kb_used_data":11552,"kb_used_omap":18,"kb_used_meta":390637,"kb_avail":1124539424,"statfs":{"total":1151940427776,"available":1151528370176,"internally_reserved":0,"allocated":11829248,"data_stored":7800368,"data_compressed":390651,"data_compressed_allocated":528384,"data_compressed_original":2555904,"omap_allocated":19141,"internal_metadata":400012603},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":49859,"num_objects":8,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":113,"num_read_kb":108,"num_write":40,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003687"},"pg_stats":[{"pgid":"2.1f","version":"85'13","reported_seq":72,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:20.599527+0000","last_change":"2024-08-31T05:27:58.511927+0000","last_active":"2024-08-31T05:28:20.599527+0000","last_peered":"2024-08-31T05:28:20.599527+0000","last_clean":"2024-08-31T05:28:20.599527+0000","last_became_active":"2024-08-31T05:27:58.507111+0000","last_became_peered":"2024-08-31T05:27:58.507111+0000","last_unstale":"2024-08-31T05:28:20.599527+0000","last_undegraded":"2024-08-31T05:28:20.599527+0000","last_fullsized":"2024-08-31T05:28:20.599527+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:42:09.078048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.501521+0000","last_change":"2024-08-31T05:27:31.255221+0000","last_active":"2024-08-31T05:27:58.501521+0000","last_peered":"2024-08-31T05:27:58.501521+0000","last_clean":"2024-08-31T05:27:58.501521+0000","last_became_active":"2024-08-31T05:27:31.254684+0000","last_became_peered":"2024-08-31T05:27:31.254684+0000","last_unstale":"2024-08-31T05:27:58.501521+0000","last_undegraded":"2024-08-31T05:27:58.501521+0000","last_fullsized":"2024-08-31T05:27:58.501521+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:34:22.517485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.501430+0000","last_change":"2024-08-31T05:27:38.293857+0000","last_active":"2024-08-31T05:27:58.501430+0000","last_peered":"2024-08-31T05:27:58.501430+0000","last_clean":"2024-08-31T05:27:58.501430+0000","last_became_active":"2024-08-31T05:27:38.292763+0000","last_became_peered":"2024-08-31T05:27:38.292763+0000","last_unstale":"2024-08-31T05:27:58.501430+0000","last_undegraded":"2024-08-31T05:27:58.501430+0000","last_fullsized":"2024-08-31T05:27:58.501430+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:53:27.187697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.501948+0000","last_change":"2024-08-31T05:27:29.281010+0000","last_active":"2024-08-31T05:27:58.501948+0000","last_peered":"2024-08-31T05:27:58.501948+0000","last_clean":"2024-08-31T05:27:58.501948+0000","last_became_active":"2024-08-31T05:27:29.280625+0000","last_became_peered":"2024-08-31T05:27:29.280625+0000","last_unstale":"2024-08-31T05:27:58.501948+0000","last_undegraded":"2024-08-31T05:27:58.501948+0000","last_fullsized":"2024-08-31T05:27:58.501948+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:09:25.542564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.502293+0000","last_change":"2024-08-31T05:27:31.258052+0000","last_active":"2024-08-31T05:27:58.502293+0000","last_peered":"2024-08-31T05:27:58.502293+0000","last_clean":"2024-08-31T05:27:58.502293+0000","last_became_active":"2024-08-31T05:27:31.257549+0000","last_became_peered":"2024-08-31T05:27:31.257549+0000","last_unstale":"2024-08-31T05:27:58.502293+0000","last_undegraded":"2024-08-31T05:27:58.502293+0000","last_fullsized":"2024-08-31T05:27:58.502293+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:14:21.552372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.650345+0000","last_change":"2024-08-31T05:27:38.300359+0000","last_active":"2024-08-31T05:27:58.650345+0000","last_peered":"2024-08-31T05:27:58.650345+0000","last_clean":"2024-08-31T05:27:58.650345+0000","last_became_active":"2024-08-31T05:27:38.299704+0000","last_became_peered":"2024-08-31T05:27:38.299704+0000","last_unstale":"2024-08-31T05:27:58.650345+0000","last_undegraded":"2024-08-31T05:27:58.650345+0000","last_fullsized":"2024-08-31T05:27:58.650345+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:06:50.500384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"85'12","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:12.579038+0000","last_change":"2024-08-31T05:27:29.240652+0000","last_active":"2024-08-31T05:28:12.579038+0000","last_peered":"2024-08-31T05:28:12.579038+0000","last_clean":"2024-08-31T05:28:12.579038+0000","last_became_active":"2024-08-31T05:27:29.239432+0000","last_became_peered":"2024-08-31T05:27:29.239432+0000","last_unstale":"2024-08-31T05:28:12.579038+0000","last_undegraded":"2024-08-31T05:28:12.579038+0000","last_fullsized":"2024-08-31T05:28:12.579038+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:49:56.506299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.503319+0000","last_change":"2024-08-31T05:27:31.261784+0000","last_active":"2024-08-31T05:27:58.503319+0000","last_peered":"2024-08-31T05:27:58.503319+0000","last_clean":"2024-08-31T05:27:58.503319+0000","last_became_active":"2024-08-31T05:27:31.260045+0000","last_became_peered":"2024-08-31T05:27:31.260045+0000","last_unstale":"2024-08-31T05:27:58.503319+0000","last_undegraded":"2024-08-31T05:27:58.503319+0000","last_fullsized":"2024-08-31T05:27:58.503319+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:18:30.044052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.651031+0000","last_change":"2024-08-31T05:27:38.300926+0000","last_active":"2024-08-31T05:27:58.651031+0000","last_peered":"2024-08-31T05:27:58.651031+0000","last_clean":"2024-08-31T05:27:58.651031+0000","last_became_active":"2024-08-31T05:27:38.299444+0000","last_became_peered":"2024-08-31T05:27:38.299444+0000","last_unstale":"2024-08-31T05:27:58.651031+0000","last_undegraded":"2024-08-31T05:27:58.651031+0000","last_fullsized":"2024-08-31T05:27:58.651031+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:56:46.946879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"85'5","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:11.585007+0000","last_change":"2024-08-31T05:27:29.240341+0000","last_active":"2024-08-31T05:28:11.585007+0000","last_peered":"2024-08-31T05:28:11.585007+0000","last_clean":"2024-08-31T05:28:11.585007+0000","last_became_active":"2024-08-31T05:27:29.239944+0000","last_became_peered":"2024-08-31T05:27:29.239944+0000","last_unstale":"2024-08-31T05:28:11.585007+0000","last_undegraded":"2024-08-31T05:28:11.585007+0000","last_fullsized":"2024-08-31T05:28:11.585007+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:58:19.747559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.499316+0000","last_change":"2024-08-31T05:27:31.265116+0000","last_active":"2024-08-31T05:27:58.499316+0000","last_peered":"2024-08-31T05:27:58.499316+0000","last_clean":"2024-08-31T05:27:58.499316+0000","last_became_active":"2024-08-31T05:27:31.264725+0000","last_became_peered":"2024-08-31T05:27:31.264725+0000","last_unstale":"2024-08-31T05:27:58.499316+0000","last_undegraded":"2024-08-31T05:27:58.499316+0000","last_fullsized":"2024-08-31T05:27:58.499316+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:44:45.831881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.650517+0000","last_change":"2024-08-31T05:27:38.298634+0000","last_active":"2024-08-31T05:27:58.650517+0000","last_peered":"2024-08-31T05:27:58.650517+0000","last_clean":"2024-08-31T05:27:58.650517+0000","last_became_active":"2024-08-31T05:27:38.298143+0000","last_became_peered":"2024-08-31T05:27:38.298143+0000","last_unstale":"2024-08-31T05:27:58.650517+0000","last_undegraded":"2024-08-31T05:27:58.650517+0000","last_fullsized":"2024-08-31T05:27:58.650517+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:51:25.639441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.500613+0000","last_change":"2024-08-31T05:27:31.259981+0000","last_active":"2024-08-31T05:27:58.500613+0000","last_peered":"2024-08-31T05:27:58.500613+0000","last_clean":"2024-08-31T05:27:58.500613+0000","last_became_active":"2024-08-31T05:27:31.259584+0000","last_became_peered":"2024-08-31T05:27:31.259584+0000","last_unstale":"2024-08-31T05:27:58.500613+0000","last_undegraded":"2024-08-31T05:27:58.500613+0000","last_fullsized":"2024-08-31T05:27:58.500613+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:52:29.853977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:08.557863+0000","last_change":"2024-08-31T05:27:58.514065+0000","last_active":"2024-08-31T05:28:08.557863+0000","last_peered":"2024-08-31T05:28:08.557863+0000","last_clean":"2024-08-31T05:28:08.557863+0000","last_became_active":"2024-08-31T05:27:58.506011+0000","last_became_peered":"2024-08-31T05:27:58.506011+0000","last_unstale":"2024-08-31T05:28:08.557863+0000","last_undegraded":"2024-08-31T05:28:08.557863+0000","last_fullsized":"2024-08-31T05:28:08.557863+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:25:55.610965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.651049+0000","last_change":"2024-08-31T05:27:38.293265+0000","last_active":"2024-08-31T05:27:58.651049+0000","last_peered":"2024-08-31T05:27:58.651049+0000","last_clean":"2024-08-31T05:27:58.651049+0000","last_became_active":"2024-08-31T05:27:38.292736+0000","last_became_peered":"2024-08-31T05:27:38.292736+0000","last_unstale":"2024-08-31T05:27:58.651049+0000","last_undegraded":"2024-08-31T05:27:58.651049+0000","last_fullsized":"2024-08-31T05:27:58.651049+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:51:25.853365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.502101+0000","last_change":"2024-08-31T05:27:31.252479+0000","last_active":"2024-08-31T05:27:58.502101+0000","last_peered":"2024-08-31T05:27:58.502101+0000","last_clean":"2024-08-31T05:27:58.502101+0000","last_became_active":"2024-08-31T05:27:31.252126+0000","last_became_peered":"2024-08-31T05:27:31.252126+0000","last_unstale":"2024-08-31T05:27:58.502101+0000","last_undegraded":"2024-08-31T05:27:58.502101+0000","last_fullsized":"2024-08-31T05:27:58.502101+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:24:40.864240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"85'3","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:10.571641+0000","last_change":"2024-08-31T05:27:58.508588+0000","last_active":"2024-08-31T05:28:10.571641+0000","last_peered":"2024-08-31T05:28:10.571641+0000","last_clean":"2024-08-31T05:28:10.571641+0000","last_became_active":"2024-08-31T05:27:58.508024+0000","last_became_peered":"2024-08-31T05:27:58.508024+0000","last_unstale":"2024-08-31T05:28:10.571641+0000","last_undegraded":"2024-08-31T05:28:10.571641+0000","last_fullsized":"2024-08-31T05:28:10.571641+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:32:33.222909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"85'1","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.650982+0000","last_change":"2024-08-31T05:27:38.299506+0000","last_active":"2024-08-31T05:27:58.650982+0000","last_peered":"2024-08-31T05:27:58.650982+0000","last_clean":"2024-08-31T05:27:58.650982+0000","last_became_active":"2024-08-31T05:27:38.298756+0000","last_became_peered":"2024-08-31T05:27:38.298756+0000","last_unstale":"2024-08-31T05:27:58.650982+0000","last_undegraded":"2024-08-31T05:27:58.650982+0000","last_fullsized":"2024-08-31T05:27:58.650982+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:25:18.115727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.503026+0000","last_change":"2024-08-31T05:27:31.249220+0000","last_active":"2024-08-31T05:27:58.503026+0000","last_peered":"2024-08-31T05:27:58.503026+0000","last_clean":"2024-08-31T05:27:58.503026+0000","last_became_active":"2024-08-31T05:27:31.248869+0000","last_became_peered":"2024-08-31T05:27:31.248869+0000","last_unstale":"2024-08-31T05:27:58.503026+0000","last_undegraded":"2024-08-31T05:27:58.503026+0000","last_fullsized":"2024-08-31T05:27:58.503026+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:43:13.463903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:11.585131+0000","last_change":"2024-08-31T05:27:29.235278+0000","last_active":"2024-08-31T05:28:11.585131+0000","last_peered":"2024-08-31T05:28:11.585131+0000","last_clean":"2024-08-31T05:28:11.585131+0000","last_became_active":"2024-08-31T05:27:29.234929+0000","last_became_peered":"2024-08-31T05:27:29.234929+0000","last_unstale":"2024-08-31T05:28:11.585131+0000","last_undegraded":"2024-08-31T05:28:11.585131+0000","last_fullsized":"2024-08-31T05:28:11.585131+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:49:55.867542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.503030+0000","last_change":"2024-08-31T05:27:38.293903+0000","last_active":"2024-08-31T05:27:58.503030+0000","last_peered":"2024-08-31T05:27:58.503030+0000","last_clean":"2024-08-31T05:27:58.503030+0000","last_became_active":"2024-08-31T05:27:38.290471+0000","last_became_peered":"2024-08-31T05:27:38.290471+0000","last_unstale":"2024-08-31T05:27:58.503030+0000","last_undegraded":"2024-08-31T05:27:58.503030+0000","last_fullsized":"2024-08-31T05:27:58.503030+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:04:36.573302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.506186+0000","last_change":"2024-08-31T05:27:31.252038+0000","last_active":"2024-08-31T05:27:58.506186+0000","last_peered":"2024-08-31T05:27:58.506186+0000","last_clean":"2024-08-31T05:27:58.506186+0000","last_became_active":"2024-08-31T05:27:31.251630+0000","last_became_peered":"2024-08-31T05:27:31.251630+0000","last_unstale":"2024-08-31T05:27:58.506186+0000","last_undegraded":"2024-08-31T05:27:58.506186+0000","last_fullsized":"2024-08-31T05:27:58.506186+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:10:39.778057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:08.560315+0000","last_change":"2024-08-31T05:27:29.280978+0000","last_active":"2024-08-31T05:28:08.560315+0000","last_peered":"2024-08-31T05:28:08.560315+0000","last_clean":"2024-08-31T05:28:08.560315+0000","last_became_active":"2024-08-31T05:27:29.280524+0000","last_became_peered":"2024-08-31T05:27:29.280524+0000","last_unstale":"2024-08-31T05:28:08.560315+0000","last_undegraded":"2024-08-31T05:28:08.560315+0000","last_fullsized":"2024-08-31T05:28:08.560315+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:56:57.441801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.651297+0000","last_change":"2024-08-31T05:27:38.300947+0000","last_active":"2024-08-31T05:27:58.651297+0000","last_peered":"2024-08-31T05:27:58.651297+0000","last_clean":"2024-08-31T05:27:58.651297+0000","last_became_active":"2024-08-31T05:27:38.300044+0000","last_became_peered":"2024-08-31T05:27:38.300044+0000","last_unstale":"2024-08-31T05:27:58.651297+0000","last_undegraded":"2024-08-31T05:27:58.651297+0000","last_fullsized":"2024-08-31T05:27:58.651297+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:33:05.081601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.502028+0000","last_change":"2024-08-31T05:27:31.257782+0000","last_active":"2024-08-31T05:27:58.502028+0000","last_peered":"2024-08-31T05:27:58.502028+0000","last_clean":"2024-08-31T05:27:58.502028+0000","last_became_active":"2024-08-31T05:27:31.257360+0000","last_became_peered":"2024-08-31T05:27:31.257360+0000","last_unstale":"2024-08-31T05:27:58.502028+0000","last_undegraded":"2024-08-31T05:27:58.502028+0000","last_fullsized":"2024-08-31T05:27:58.502028+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:58:11.249925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"85'7","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:11.583587+0000","last_change":"2024-08-31T05:27:29.392664+0000","last_active":"2024-08-31T05:28:11.583587+0000","last_peered":"2024-08-31T05:28:11.583587+0000","last_clean":"2024-08-31T05:28:11.583587+0000","last_became_active":"2024-08-31T05:27:29.392208+0000","last_became_peered":"2024-08-31T05:27:29.392208+0000","last_unstale":"2024-08-31T05:28:11.583587+0000","last_undegraded":"2024-08-31T05:28:11.583587+0000","last_fullsized":"2024-08-31T05:28:11.583587+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:51:34.981168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.502593+0000","last_change":"2024-08-31T05:27:38.293556+0000","last_active":"2024-08-31T05:27:58.502593+0000","last_peered":"2024-08-31T05:27:58.502593+0000","last_clean":"2024-08-31T05:27:58.502593+0000","last_became_active":"2024-08-31T05:27:38.292338+0000","last_became_peered":"2024-08-31T05:27:38.292338+0000","last_unstale":"2024-08-31T05:27:58.502593+0000","last_undegraded":"2024-08-31T05:27:58.502593+0000","last_fullsized":"2024-08-31T05:27:58.502593+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:13:46.376934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.502564+0000","last_change":"2024-08-31T05:27:31.247408+0000","last_active":"2024-08-31T05:27:58.502564+0000","last_peered":"2024-08-31T05:27:58.502564+0000","last_clean":"2024-08-31T05:27:58.502564+0000","last_became_active":"2024-08-31T05:27:31.247034+0000","last_became_peered":"2024-08-31T05:27:31.247034+0000","last_unstale":"2024-08-31T05:27:58.502564+0000","last_undegraded":"2024-08-31T05:27:58.502564+0000","last_fullsized":"2024-08-31T05:27:58.502564+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:42:08.350054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"85'11","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:18.262881+0000","last_change":"2024-08-31T05:27:29.235941+0000","last_active":"2024-08-31T05:28:18.262881+0000","last_peered":"2024-08-31T05:28:18.262881+0000","last_clean":"2024-08-31T05:28:18.262881+0000","last_became_active":"2024-08-31T05:27:29.235561+0000","last_became_peered":"2024-08-31T05:27:29.235561+0000","last_unstale":"2024-08-31T05:28:18.262881+0000","last_undegraded":"2024-08-31T05:28:18.262881+0000","last_fullsized":"2024-08-31T05:28:18.262881+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:29:34.551748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.500705+0000","last_change":"2024-08-31T05:27:38.286960+0000","last_active":"2024-08-31T05:27:58.500705+0000","last_peered":"2024-08-31T05:27:58.500705+0000","last_clean":"2024-08-31T05:27:58.500705+0000","last_became_active":"2024-08-31T05:27:38.286537+0000","last_became_peered":"2024-08-31T05:27:38.286537+0000","last_unstale":"2024-08-31T05:27:58.500705+0000","last_undegraded":"2024-08-31T05:27:58.500705+0000","last_fullsized":"2024-08-31T05:27:58.500705+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:55:00.656676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.497681+0000","last_change":"2024-08-31T05:27:31.245901+0000","last_active":"2024-08-31T05:27:58.497681+0000","last_peered":"2024-08-31T05:27:58.497681+0000","last_clean":"2024-08-31T05:27:58.497681+0000","last_became_active":"2024-08-31T05:27:31.245534+0000","last_became_peered":"2024-08-31T05:27:31.245534+0000","last_unstale":"2024-08-31T05:27:58.497681+0000","last_undegraded":"2024-08-31T05:27:58.497681+0000","last_fullsized":"2024-08-31T05:27:58.497681+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:26:35.876033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"85'4","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:11.585075+0000","last_change":"2024-08-31T05:27:29.280767+0000","last_active":"2024-08-31T05:28:11.585075+0000","last_peered":"2024-08-31T05:28:11.585075+0000","last_clean":"2024-08-31T05:28:11.585075+0000","last_became_active":"2024-08-31T05:27:29.280334+0000","last_became_peered":"2024-08-31T05:27:29.280334+0000","last_unstale":"2024-08-31T05:28:11.585075+0000","last_undegraded":"2024-08-31T05:28:11.585075+0000","last_fullsized":"2024-08-31T05:28:11.585075+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:25:20.250205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.503220+0000","last_change":"2024-08-31T05:27:38.296846+0000","last_active":"2024-08-31T05:27:58.503220+0000","last_peered":"2024-08-31T05:27:58.503220+0000","last_clean":"2024-08-31T05:27:58.503220+0000","last_became_active":"2024-08-31T05:27:38.295516+0000","last_became_peered":"2024-08-31T05:27:38.295516+0000","last_unstale":"2024-08-31T05:27:58.503220+0000","last_undegraded":"2024-08-31T05:27:58.503220+0000","last_fullsized":"2024-08-31T05:27:58.503220+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:30:51.110144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.498789+0000","last_change":"2024-08-31T05:27:31.246481+0000","last_active":"2024-08-31T05:27:58.498789+0000","last_peered":"2024-08-31T05:27:58.498789+0000","last_clean":"2024-08-31T05:27:58.498789+0000","last_became_active":"2024-08-31T05:27:31.246079+0000","last_became_peered":"2024-08-31T05:27:31.246079+0000","last_unstale":"2024-08-31T05:27:58.498789+0000","last_undegraded":"2024-08-31T05:27:58.498789+0000","last_fullsized":"2024-08-31T05:27:58.498789+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:25:42.536251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"85'1","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.503218+0000","last_change":"2024-08-31T05:27:29.281078+0000","last_active":"2024-08-31T05:27:58.503218+0000","last_peered":"2024-08-31T05:27:58.503218+0000","last_clean":"2024-08-31T05:27:58.503218+0000","last_became_active":"2024-08-31T05:27:29.280674+0000","last_became_peered":"2024-08-31T05:27:29.280674+0000","last_unstale":"2024-08-31T05:27:58.503218+0000","last_undegraded":"2024-08-31T05:27:58.503218+0000","last_fullsized":"2024-08-31T05:27:58.503218+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:04:03.576077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.506060+0000","last_change":"2024-08-31T05:27:38.289472+0000","last_active":"2024-08-31T05:27:58.506060+0000","last_peered":"2024-08-31T05:27:58.506060+0000","last_clean":"2024-08-31T05:27:58.506060+0000","last_became_active":"2024-08-31T05:27:38.289003+0000","last_became_peered":"2024-08-31T05:27:38.289003+0000","last_unstale":"2024-08-31T05:27:58.506060+0000","last_undegraded":"2024-08-31T05:27:58.506060+0000","last_fullsized":"2024-08-31T05:27:58.506060+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:38:37.621451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.498569+0000","last_change":"2024-08-31T05:27:31.251011+0000","last_active":"2024-08-31T05:27:58.498569+0000","last_peered":"2024-08-31T05:27:58.498569+0000","last_clean":"2024-08-31T05:27:58.498569+0000","last_became_active":"2024-08-31T05:27:31.250597+0000","last_became_peered":"2024-08-31T05:27:31.250597+0000","last_unstale":"2024-08-31T05:27:58.498569+0000","last_undegraded":"2024-08-31T05:27:58.498569+0000","last_fullsized":"2024-08-31T05:27:58.498569+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:13:30.858395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'6","reported_seq":56,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:23.604129+0000","last_change":"2024-08-31T05:27:29.242137+0000","last_active":"2024-08-31T05:28:23.604129+0000","last_peered":"2024-08-31T05:28:23.604129+0000","last_clean":"2024-08-31T05:28:23.604129+0000","last_became_active":"2024-08-31T05:27:29.241460+0000","last_became_peered":"2024-08-31T05:27:29.241460+0000","last_unstale":"2024-08-31T05:28:23.604129+0000","last_undegraded":"2024-08-31T05:28:23.604129+0000","last_fullsized":"2024-08-31T05:28:23.604129+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:40:59.174572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.497475+0000","last_change":"2024-08-31T05:27:38.288643+0000","last_active":"2024-08-31T05:27:58.497475+0000","last_peered":"2024-08-31T05:27:58.497475+0000","last_clean":"2024-08-31T05:27:58.497475+0000","last_became_active":"2024-08-31T05:27:38.288235+0000","last_became_peered":"2024-08-31T05:27:38.288235+0000","last_unstale":"2024-08-31T05:27:58.497475+0000","last_undegraded":"2024-08-31T05:27:58.497475+0000","last_fullsized":"2024-08-31T05:27:58.497475+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:23:49.090990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.498712+0000","last_change":"2024-08-31T05:27:31.263326+0000","last_active":"2024-08-31T05:27:58.498712+0000","last_peered":"2024-08-31T05:27:58.498712+0000","last_clean":"2024-08-31T05:27:58.498712+0000","last_became_active":"2024-08-31T05:27:31.262864+0000","last_became_peered":"2024-08-31T05:27:31.262864+0000","last_unstale":"2024-08-31T05:27:58.498712+0000","last_undegraded":"2024-08-31T05:27:58.498712+0000","last_fullsized":"2024-08-31T05:27:58.498712+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:34:21.159545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'5","reported_seq":53,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:22.602475+0000","last_change":"2024-08-31T05:27:29.280829+0000","last_active":"2024-08-31T05:28:22.602475+0000","last_peered":"2024-08-31T05:28:22.602475+0000","last_clean":"2024-08-31T05:28:22.602475+0000","last_became_active":"2024-08-31T05:27:29.280469+0000","last_became_peered":"2024-08-31T05:27:29.280469+0000","last_unstale":"2024-08-31T05:28:22.602475+0000","last_undegraded":"2024-08-31T05:28:22.602475+0000","last_fullsized":"2024-08-31T05:28:22.602475+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:16:59.559680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.497762+0000","last_change":"2024-08-31T05:27:38.290175+0000","last_active":"2024-08-31T05:27:58.497762+0000","last_peered":"2024-08-31T05:27:58.497762+0000","last_clean":"2024-08-31T05:27:58.497762+0000","last_became_active":"2024-08-31T05:27:38.289228+0000","last_became_peered":"2024-08-31T05:27:38.289228+0000","last_unstale":"2024-08-31T05:27:58.497762+0000","last_undegraded":"2024-08-31T05:27:58.497762+0000","last_fullsized":"2024-08-31T05:27:58.497762+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:26:07.251711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.497105+0000","last_change":"2024-08-31T05:27:31.245446+0000","last_active":"2024-08-31T05:27:58.497105+0000","last_peered":"2024-08-31T05:27:58.497105+0000","last_clean":"2024-08-31T05:27:58.497105+0000","last_became_active":"2024-08-31T05:27:31.245099+0000","last_became_peered":"2024-08-31T05:27:31.245099+0000","last_unstale":"2024-08-31T05:27:58.497105+0000","last_undegraded":"2024-08-31T05:27:58.497105+0000","last_fullsized":"2024-08-31T05:27:58.497105+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:18:17.876796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'4","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:09.567528+0000","last_change":"2024-08-31T05:27:29.241333+0000","last_active":"2024-08-31T05:28:09.567528+0000","last_peered":"2024-08-31T05:28:09.567528+0000","last_clean":"2024-08-31T05:28:09.567528+0000","last_became_active":"2024-08-31T05:27:29.240963+0000","last_became_peered":"2024-08-31T05:27:29.240963+0000","last_unstale":"2024-08-31T05:28:09.567528+0000","last_undegraded":"2024-08-31T05:28:09.567528+0000","last_fullsized":"2024-08-31T05:28:09.567528+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:22:06.442824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.499090+0000","last_change":"2024-08-31T05:27:38.287640+0000","last_active":"2024-08-31T05:27:58.499090+0000","last_peered":"2024-08-31T05:27:58.499090+0000","last_clean":"2024-08-31T05:27:58.499090+0000","last_became_active":"2024-08-31T05:27:38.286191+0000","last_became_peered":"2024-08-31T05:27:38.286191+0000","last_unstale":"2024-08-31T05:27:58.499090+0000","last_undegraded":"2024-08-31T05:27:58.499090+0000","last_fullsized":"2024-08-31T05:27:58.499090+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:57:23.535841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.507530+0000","last_change":"2024-08-31T05:27:58.506945+0000","last_active":"2024-08-31T05:27:58.507530+0000","last_peered":"2024-08-31T05:27:58.507530+0000","last_clean":"2024-08-31T05:27:58.507530+0000","last_became_active":"2024-08-31T05:27:58.506505+0000","last_became_peered":"2024-08-31T05:27:58.506505+0000","last_unstale":"2024-08-31T05:27:58.507530+0000","last_undegraded":"2024-08-31T05:27:58.507530+0000","last_fullsized":"2024-08-31T05:27:58.507530+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:16:09.541579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"85'6","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:12.585201+0000","last_change":"2024-08-31T05:27:29.238351+0000","last_active":"2024-08-31T05:28:12.585201+0000","last_peered":"2024-08-31T05:28:12.585201+0000","last_clean":"2024-08-31T05:28:12.585201+0000","last_became_active":"2024-08-31T05:27:29.237940+0000","last_became_peered":"2024-08-31T05:27:29.237940+0000","last_unstale":"2024-08-31T05:28:12.585201+0000","last_undegraded":"2024-08-31T05:28:12.585201+0000","last_fullsized":"2024-08-31T05:28:12.585201+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:55:08.048966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":109,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.501784+0000","last_change":"2024-08-31T05:26:14.183718+0000","last_active":"2024-08-31T05:27:58.501784+0000","last_peered":"2024-08-31T05:27:58.501784+0000","last_clean":"2024-08-31T05:27:58.501784+0000","last_became_active":"2024-08-31T05:26:14.178188+0000","last_became_peered":"2024-08-31T05:26:14.178188+0000","last_unstale":"2024-08-31T05:27:58.501784+0000","last_undegraded":"2024-08-31T05:27:58.501784+0000","last_fullsized":"2024-08-31T05:27:58.501784+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:22:50.516233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:22:50.516233+0000","last_clean_scrub_stamp":"2024-08-31T05:22:50.516233+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:10:01.719715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"85'1","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.501132+0000","last_change":"2024-08-31T05:27:38.289721+0000","last_active":"2024-08-31T05:27:58.501132+0000","last_peered":"2024-08-31T05:27:58.501132+0000","last_clean":"2024-08-31T05:27:58.501132+0000","last_became_active":"2024-08-31T05:27:38.289165+0000","last_became_peered":"2024-08-31T05:27:38.289165+0000","last_unstale":"2024-08-31T05:27:58.501132+0000","last_undegraded":"2024-08-31T05:27:58.501132+0000","last_fullsized":"2024-08-31T05:27:58.501132+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:00:30.689093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.501497+0000","last_change":"2024-08-31T05:27:31.256262+0000","last_active":"2024-08-31T05:27:58.501497+0000","last_peered":"2024-08-31T05:27:58.501497+0000","last_clean":"2024-08-31T05:27:58.501497+0000","last_became_active":"2024-08-31T05:27:31.255644+0000","last_became_peered":"2024-08-31T05:27:31.255644+0000","last_unstale":"2024-08-31T05:27:58.501497+0000","last_undegraded":"2024-08-31T05:27:58.501497+0000","last_fullsized":"2024-08-31T05:27:58.501497+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:50:18.158645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'5","reported_seq":54,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:22.619171+0000","last_change":"2024-08-31T05:27:29.392666+0000","last_active":"2024-08-31T05:28:22.619171+0000","last_peered":"2024-08-31T05:28:22.619171+0000","last_clean":"2024-08-31T05:28:22.619171+0000","last_became_active":"2024-08-31T05:27:29.392153+0000","last_became_peered":"2024-08-31T05:27:29.392153+0000","last_unstale":"2024-08-31T05:28:22.619171+0000","last_undegraded":"2024-08-31T05:28:22.619171+0000","last_fullsized":"2024-08-31T05:28:22.619171+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:53:02.713022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.503095+0000","last_change":"2024-08-31T05:27:38.291459+0000","last_active":"2024-08-31T05:27:58.503095+0000","last_peered":"2024-08-31T05:27:58.503095+0000","last_clean":"2024-08-31T05:27:58.503095+0000","last_became_active":"2024-08-31T05:27:38.291013+0000","last_became_peered":"2024-08-31T05:27:38.291013+0000","last_unstale":"2024-08-31T05:27:58.503095+0000","last_undegraded":"2024-08-31T05:27:58.503095+0000","last_fullsized":"2024-08-31T05:27:58.503095+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:03:46.921137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.500800+0000","last_change":"2024-08-31T05:27:31.251641+0000","last_active":"2024-08-31T05:27:58.500800+0000","last_peered":"2024-08-31T05:27:58.500800+0000","last_clean":"2024-08-31T05:27:58.500800+0000","last_became_active":"2024-08-31T05:27:31.251242+0000","last_became_peered":"2024-08-31T05:27:31.251242+0000","last_unstale":"2024-08-31T05:27:58.500800+0000","last_undegraded":"2024-08-31T05:27:58.500800+0000","last_fullsized":"2024-08-31T05:27:58.500800+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:13:58.227136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'3","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:11.584688+0000","last_change":"2024-08-31T05:27:29.238028+0000","last_active":"2024-08-31T05:28:11.584688+0000","last_peered":"2024-08-31T05:28:11.584688+0000","last_clean":"2024-08-31T05:28:11.584688+0000","last_became_active":"2024-08-31T05:27:29.237449+0000","last_became_peered":"2024-08-31T05:27:29.237449+0000","last_unstale":"2024-08-31T05:28:11.584688+0000","last_undegraded":"2024-08-31T05:28:11.584688+0000","last_fullsized":"2024-08-31T05:28:11.584688+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:13:15.447707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.501844+0000","last_change":"2024-08-31T05:27:38.294072+0000","last_active":"2024-08-31T05:27:58.501844+0000","last_peered":"2024-08-31T05:27:58.501844+0000","last_clean":"2024-08-31T05:27:58.501844+0000","last_became_active":"2024-08-31T05:27:38.293642+0000","last_became_peered":"2024-08-31T05:27:38.293642+0000","last_unstale":"2024-08-31T05:27:58.501844+0000","last_undegraded":"2024-08-31T05:27:58.501844+0000","last_fullsized":"2024-08-31T05:27:58.501844+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:57:41.854799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.501492+0000","last_change":"2024-08-31T05:27:31.253601+0000","last_active":"2024-08-31T05:27:58.501492+0000","last_peered":"2024-08-31T05:27:58.501492+0000","last_clean":"2024-08-31T05:27:58.501492+0000","last_became_active":"2024-08-31T05:27:31.253216+0000","last_became_peered":"2024-08-31T05:27:31.253216+0000","last_unstale":"2024-08-31T05:27:58.501492+0000","last_undegraded":"2024-08-31T05:27:58.501492+0000","last_fullsized":"2024-08-31T05:27:58.501492+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:46:12.757944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'5","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:11.585308+0000","last_change":"2024-08-31T05:27:29.236851+0000","last_active":"2024-08-31T05:28:11.585308+0000","last_peered":"2024-08-31T05:28:11.585308+0000","last_clean":"2024-08-31T05:28:11.585308+0000","last_became_active":"2024-08-31T05:27:29.236473+0000","last_became_peered":"2024-08-31T05:27:29.236473+0000","last_unstale":"2024-08-31T05:28:11.585308+0000","last_undegraded":"2024-08-31T05:28:11.585308+0000","last_fullsized":"2024-08-31T05:28:11.585308+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:01:23.838417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.498386+0000","last_change":"2024-08-31T05:27:38.290069+0000","last_active":"2024-08-31T05:27:58.498386+0000","last_peered":"2024-08-31T05:27:58.498386+0000","last_clean":"2024-08-31T05:27:58.498386+0000","last_became_active":"2024-08-31T05:27:38.289507+0000","last_became_peered":"2024-08-31T05:27:38.289507+0000","last_unstale":"2024-08-31T05:27:58.498386+0000","last_undegraded":"2024-08-31T05:27:58.498386+0000","last_fullsized":"2024-08-31T05:27:58.498386+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:24:33.326308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.503496+0000","last_change":"2024-08-31T05:27:31.252787+0000","last_active":"2024-08-31T05:27:58.503496+0000","last_peered":"2024-08-31T05:27:58.503496+0000","last_clean":"2024-08-31T05:27:58.503496+0000","last_became_active":"2024-08-31T05:27:31.252392+0000","last_became_peered":"2024-08-31T05:27:31.252392+0000","last_unstale":"2024-08-31T05:27:58.503496+0000","last_undegraded":"2024-08-31T05:27:58.503496+0000","last_fullsized":"2024-08-31T05:27:58.503496+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:47:06.613616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:10.561782+0000","last_change":"2024-08-31T05:27:29.240293+0000","last_active":"2024-08-31T05:28:10.561782+0000","last_peered":"2024-08-31T05:28:10.561782+0000","last_clean":"2024-08-31T05:28:10.561782+0000","last_became_active":"2024-08-31T05:27:29.239889+0000","last_became_peered":"2024-08-31T05:27:29.239889+0000","last_unstale":"2024-08-31T05:28:10.561782+0000","last_undegraded":"2024-08-31T05:28:10.561782+0000","last_fullsized":"2024-08-31T05:28:10.561782+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:55:03.524475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.498634+0000","last_change":"2024-08-31T05:27:38.290715+0000","last_active":"2024-08-31T05:27:58.498634+0000","last_peered":"2024-08-31T05:27:58.498634+0000","last_clean":"2024-08-31T05:27:58.498634+0000","last_became_active":"2024-08-31T05:27:38.290227+0000","last_became_peered":"2024-08-31T05:27:38.290227+0000","last_unstale":"2024-08-31T05:27:58.498634+0000","last_undegraded":"2024-08-31T05:27:58.498634+0000","last_fullsized":"2024-08-31T05:27:58.498634+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:09:38.349046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.498825+0000","last_change":"2024-08-31T05:27:31.265672+0000","last_active":"2024-08-31T05:27:58.498825+0000","last_peered":"2024-08-31T05:27:58.498825+0000","last_clean":"2024-08-31T05:27:58.498825+0000","last_became_active":"2024-08-31T05:27:31.265332+0000","last_became_peered":"2024-08-31T05:27:31.265332+0000","last_unstale":"2024-08-31T05:27:58.498825+0000","last_undegraded":"2024-08-31T05:27:58.498825+0000","last_fullsized":"2024-08-31T05:27:58.498825+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:45:01.868256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"85'17","reported_seq":53,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:11.582670+0000","last_change":"2024-08-31T05:27:29.281129+0000","last_active":"2024-08-31T05:28:11.582670+0000","last_peered":"2024-08-31T05:28:11.582670+0000","last_clean":"2024-08-31T05:28:11.582670+0000","last_became_active":"2024-08-31T05:27:29.280613+0000","last_became_peered":"2024-08-31T05:27:29.280613+0000","last_unstale":"2024-08-31T05:28:11.582670+0000","last_undegraded":"2024-08-31T05:28:11.582670+0000","last_fullsized":"2024-08-31T05:28:11.582670+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:17:28.103371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.497664+0000","last_change":"2024-08-31T05:27:38.293492+0000","last_active":"2024-08-31T05:27:58.497664+0000","last_peered":"2024-08-31T05:27:58.497664+0000","last_clean":"2024-08-31T05:27:58.497664+0000","last_became_active":"2024-08-31T05:27:38.293072+0000","last_became_peered":"2024-08-31T05:27:38.293072+0000","last_unstale":"2024-08-31T05:27:58.497664+0000","last_undegraded":"2024-08-31T05:27:58.497664+0000","last_fullsized":"2024-08-31T05:27:58.497664+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:20:21.438948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.505616+0000","last_change":"2024-08-31T05:27:58.505480+0000","last_active":"2024-08-31T05:27:58.505616+0000","last_peered":"2024-08-31T05:27:58.505616+0000","last_clean":"2024-08-31T05:27:58.505616+0000","last_became_active":"2024-08-31T05:27:58.504773+0000","last_became_peered":"2024-08-31T05:27:58.504773+0000","last_unstale":"2024-08-31T05:27:58.505616+0000","last_undegraded":"2024-08-31T05:27:58.505616+0000","last_fullsized":"2024-08-31T05:27:58.505616+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:48:59.979443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'5","reported_seq":54,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:22.603095+0000","last_change":"2024-08-31T05:27:29.239308+0000","last_active":"2024-08-31T05:28:22.603095+0000","last_peered":"2024-08-31T05:28:22.603095+0000","last_clean":"2024-08-31T05:28:22.603095+0000","last_became_active":"2024-08-31T05:27:29.238793+0000","last_became_peered":"2024-08-31T05:27:29.238793+0000","last_unstale":"2024-08-31T05:28:22.603095+0000","last_undegraded":"2024-08-31T05:28:22.603095+0000","last_fullsized":"2024-08-31T05:28:22.603095+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:20:47.837021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.503153+0000","last_change":"2024-08-31T05:27:38.287260+0000","last_active":"2024-08-31T05:27:58.503153+0000","last_peered":"2024-08-31T05:27:58.503153+0000","last_clean":"2024-08-31T05:27:58.503153+0000","last_became_active":"2024-08-31T05:27:38.286250+0000","last_became_peered":"2024-08-31T05:27:38.286250+0000","last_unstale":"2024-08-31T05:27:58.503153+0000","last_undegraded":"2024-08-31T05:27:58.503153+0000","last_fullsized":"2024-08-31T05:27:58.503153+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:17:55.530114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.501008+0000","last_change":"2024-08-31T05:27:31.251152+0000","last_active":"2024-08-31T05:27:58.501008+0000","last_peered":"2024-08-31T05:27:58.501008+0000","last_clean":"2024-08-31T05:27:58.501008+0000","last_became_active":"2024-08-31T05:27:31.250686+0000","last_became_peered":"2024-08-31T05:27:31.250686+0000","last_unstale":"2024-08-31T05:27:58.501008+0000","last_undegraded":"2024-08-31T05:27:58.501008+0000","last_fullsized":"2024-08-31T05:27:58.501008+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:03:37.359332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"85'5","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:11.583460+0000","last_change":"2024-08-31T05:27:29.237404+0000","last_active":"2024-08-31T05:28:11.583460+0000","last_peered":"2024-08-31T05:28:11.583460+0000","last_clean":"2024-08-31T05:28:11.583460+0000","last_became_active":"2024-08-31T05:27:29.236695+0000","last_became_peered":"2024-08-31T05:27:29.236695+0000","last_unstale":"2024-08-31T05:28:11.583460+0000","last_undegraded":"2024-08-31T05:28:11.583460+0000","last_fullsized":"2024-08-31T05:28:11.583460+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:25:05.174288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.503098+0000","last_change":"2024-08-31T05:27:38.296553+0000","last_active":"2024-08-31T05:27:58.503098+0000","last_peered":"2024-08-31T05:27:58.503098+0000","last_clean":"2024-08-31T05:27:58.503098+0000","last_became_active":"2024-08-31T05:27:38.296118+0000","last_became_peered":"2024-08-31T05:27:38.296118+0000","last_unstale":"2024-08-31T05:27:58.503098+0000","last_undegraded":"2024-08-31T05:27:58.503098+0000","last_fullsized":"2024-08-31T05:27:58.503098+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:10:41.334260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.497316+0000","last_change":"2024-08-31T05:27:31.250584+0000","last_active":"2024-08-31T05:27:58.497316+0000","last_peered":"2024-08-31T05:27:58.497316+0000","last_clean":"2024-08-31T05:27:58.497316+0000","last_became_active":"2024-08-31T05:27:31.250234+0000","last_became_peered":"2024-08-31T05:27:31.250234+0000","last_unstale":"2024-08-31T05:27:58.497316+0000","last_undegraded":"2024-08-31T05:27:58.497316+0000","last_fullsized":"2024-08-31T05:27:58.497316+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:00:39.648236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"85'9","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:12.584354+0000","last_change":"2024-08-31T05:27:29.237956+0000","last_active":"2024-08-31T05:28:12.584354+0000","last_peered":"2024-08-31T05:28:12.584354+0000","last_clean":"2024-08-31T05:28:12.584354+0000","last_became_active":"2024-08-31T05:27:29.237510+0000","last_became_peered":"2024-08-31T05:27:29.237510+0000","last_unstale":"2024-08-31T05:28:12.584354+0000","last_undegraded":"2024-08-31T05:28:12.584354+0000","last_fullsized":"2024-08-31T05:28:12.584354+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:18:44.295298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.499168+0000","last_change":"2024-08-31T05:27:38.289472+0000","last_active":"2024-08-31T05:27:58.499168+0000","last_peered":"2024-08-31T05:27:58.499168+0000","last_clean":"2024-08-31T05:27:58.499168+0000","last_became_active":"2024-08-31T05:27:38.288809+0000","last_became_peered":"2024-08-31T05:27:38.288809+0000","last_unstale":"2024-08-31T05:27:58.499168+0000","last_undegraded":"2024-08-31T05:27:58.499168+0000","last_fullsized":"2024-08-31T05:27:58.499168+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:17:06.430110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.506843+0000","last_change":"2024-08-31T05:27:31.258103+0000","last_active":"2024-08-31T05:27:58.506843+0000","last_peered":"2024-08-31T05:27:58.506843+0000","last_clean":"2024-08-31T05:27:58.506843+0000","last_became_active":"2024-08-31T05:27:31.257257+0000","last_became_peered":"2024-08-31T05:27:31.257257+0000","last_unstale":"2024-08-31T05:27:58.506843+0000","last_undegraded":"2024-08-31T05:27:58.506843+0000","last_fullsized":"2024-08-31T05:27:58.506843+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:16:01.309646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"85'31","reported_seq":94,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:22.606151+0000","last_change":"2024-08-31T05:27:29.241129+0000","last_active":"2024-08-31T05:28:22.606151+0000","last_peered":"2024-08-31T05:28:22.606151+0000","last_clean":"2024-08-31T05:28:22.606151+0000","last_became_active":"2024-08-31T05:27:29.240708+0000","last_became_peered":"2024-08-31T05:27:29.240708+0000","last_unstale":"2024-08-31T05:28:22.606151+0000","last_undegraded":"2024-08-31T05:28:22.606151+0000","last_fullsized":"2024-08-31T05:28:22.606151+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:20:10.127588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52404,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":65,"num_write":33,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.501066+0000","last_change":"2024-08-31T05:27:38.291037+0000","last_active":"2024-08-31T05:27:58.501066+0000","last_peered":"2024-08-31T05:27:58.501066+0000","last_clean":"2024-08-31T05:27:58.501066+0000","last_became_active":"2024-08-31T05:27:38.290592+0000","last_became_peered":"2024-08-31T05:27:38.290592+0000","last_unstale":"2024-08-31T05:27:58.501066+0000","last_undegraded":"2024-08-31T05:27:58.501066+0000","last_fullsized":"2024-08-31T05:27:58.501066+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:12:56.391784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.508515+0000","last_change":"2024-08-31T05:27:58.508403+0000","last_active":"2024-08-31T05:27:58.508515+0000","last_peered":"2024-08-31T05:27:58.508515+0000","last_clean":"2024-08-31T05:27:58.508515+0000","last_became_active":"2024-08-31T05:27:58.507918+0000","last_became_peered":"2024-08-31T05:27:58.507918+0000","last_unstale":"2024-08-31T05:27:58.508515+0000","last_undegraded":"2024-08-31T05:27:58.508515+0000","last_fullsized":"2024-08-31T05:27:58.508515+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:47:54.479249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,7],"acting":[1,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"85'5","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:10.572604+0000","last_change":"2024-08-31T05:27:29.281231+0000","last_active":"2024-08-31T05:28:10.572604+0000","last_peered":"2024-08-31T05:28:10.572604+0000","last_clean":"2024-08-31T05:28:10.572604+0000","last_became_active":"2024-08-31T05:27:29.280748+0000","last_became_peered":"2024-08-31T05:27:29.280748+0000","last_unstale":"2024-08-31T05:28:10.572604+0000","last_undegraded":"2024-08-31T05:28:10.572604+0000","last_fullsized":"2024-08-31T05:28:10.572604+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:43:44.783595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.650871+0000","last_change":"2024-08-31T05:27:38.300988+0000","last_active":"2024-08-31T05:27:58.650871+0000","last_peered":"2024-08-31T05:27:58.650871+0000","last_clean":"2024-08-31T05:27:58.650871+0000","last_became_active":"2024-08-31T05:27:38.299938+0000","last_became_peered":"2024-08-31T05:27:38.299938+0000","last_unstale":"2024-08-31T05:27:58.650871+0000","last_undegraded":"2024-08-31T05:27:58.650871+0000","last_fullsized":"2024-08-31T05:27:58.650871+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:25:45.721711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.502349+0000","last_change":"2024-08-31T05:27:31.258030+0000","last_active":"2024-08-31T05:27:58.502349+0000","last_peered":"2024-08-31T05:27:58.502349+0000","last_clean":"2024-08-31T05:27:58.502349+0000","last_became_active":"2024-08-31T05:27:31.257410+0000","last_became_peered":"2024-08-31T05:27:31.257410+0000","last_unstale":"2024-08-31T05:27:58.502349+0000","last_undegraded":"2024-08-31T05:27:58.502349+0000","last_fullsized":"2024-08-31T05:27:58.502349+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:48:27.716531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"85'4","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:11.584450+0000","last_change":"2024-08-31T05:27:29.239560+0000","last_active":"2024-08-31T05:28:11.584450+0000","last_peered":"2024-08-31T05:28:11.584450+0000","last_clean":"2024-08-31T05:28:11.584450+0000","last_became_active":"2024-08-31T05:27:29.239154+0000","last_became_peered":"2024-08-31T05:27:29.239154+0000","last_unstale":"2024-08-31T05:28:11.584450+0000","last_undegraded":"2024-08-31T05:28:11.584450+0000","last_fullsized":"2024-08-31T05:28:11.584450+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:29:36.983690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.500488+0000","last_change":"2024-08-31T05:27:38.297596+0000","last_active":"2024-08-31T05:27:58.500488+0000","last_peered":"2024-08-31T05:27:58.500488+0000","last_clean":"2024-08-31T05:27:58.500488+0000","last_became_active":"2024-08-31T05:27:38.295127+0000","last_became_peered":"2024-08-31T05:27:38.295127+0000","last_unstale":"2024-08-31T05:27:58.500488+0000","last_undegraded":"2024-08-31T05:27:58.500488+0000","last_fullsized":"2024-08-31T05:27:58.500488+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:50:09.363872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.503636+0000","last_change":"2024-08-31T05:27:31.262036+0000","last_active":"2024-08-31T05:27:58.503636+0000","last_peered":"2024-08-31T05:27:58.503636+0000","last_clean":"2024-08-31T05:27:58.503636+0000","last_became_active":"2024-08-31T05:27:31.261589+0000","last_became_peered":"2024-08-31T05:27:31.261589+0000","last_unstale":"2024-08-31T05:27:58.503636+0000","last_undegraded":"2024-08-31T05:27:58.503636+0000","last_fullsized":"2024-08-31T05:27:58.503636+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:24:17.677639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"85'4","reported_seq":61,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:22.603959+0000","last_change":"2024-08-31T05:27:29.233381+0000","last_active":"2024-08-31T05:28:22.603959+0000","last_peered":"2024-08-31T05:28:22.603959+0000","last_clean":"2024-08-31T05:28:22.603959+0000","last_became_active":"2024-08-31T05:27:29.232959+0000","last_became_peered":"2024-08-31T05:27:29.232959+0000","last_unstale":"2024-08-31T05:28:22.603959+0000","last_undegraded":"2024-08-31T05:28:22.603959+0000","last_fullsized":"2024-08-31T05:28:22.603959+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:50:16.901373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.501117+0000","last_change":"2024-08-31T05:27:38.288798+0000","last_active":"2024-08-31T05:27:58.501117+0000","last_peered":"2024-08-31T05:27:58.501117+0000","last_clean":"2024-08-31T05:27:58.501117+0000","last_became_active":"2024-08-31T05:27:38.288369+0000","last_became_peered":"2024-08-31T05:27:38.288369+0000","last_unstale":"2024-08-31T05:27:58.501117+0000","last_undegraded":"2024-08-31T05:27:58.501117+0000","last_fullsized":"2024-08-31T05:27:58.501117+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:52:45.680480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.501801+0000","last_change":"2024-08-31T05:27:38.290029+0000","last_active":"2024-08-31T05:27:58.501801+0000","last_peered":"2024-08-31T05:27:58.501801+0000","last_clean":"2024-08-31T05:27:58.501801+0000","last_became_active":"2024-08-31T05:27:38.289638+0000","last_became_peered":"2024-08-31T05:27:38.289638+0000","last_unstale":"2024-08-31T05:27:58.501801+0000","last_undegraded":"2024-08-31T05:27:58.501801+0000","last_fullsized":"2024-08-31T05:27:58.501801+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:10:34.521418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.501222+0000","last_change":"2024-08-31T05:27:31.241057+0000","last_active":"2024-08-31T05:27:58.501222+0000","last_peered":"2024-08-31T05:27:58.501222+0000","last_clean":"2024-08-31T05:27:58.501222+0000","last_became_active":"2024-08-31T05:27:31.240660+0000","last_became_peered":"2024-08-31T05:27:31.240660+0000","last_unstale":"2024-08-31T05:27:58.501222+0000","last_undegraded":"2024-08-31T05:27:58.501222+0000","last_fullsized":"2024-08-31T05:27:58.501222+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:16:49.730980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"85'3","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:11.583067+0000","last_change":"2024-08-31T05:27:29.240293+0000","last_active":"2024-08-31T05:28:11.583067+0000","last_peered":"2024-08-31T05:28:11.583067+0000","last_clean":"2024-08-31T05:28:11.583067+0000","last_became_active":"2024-08-31T05:27:29.239889+0000","last_became_peered":"2024-08-31T05:27:29.239889+0000","last_unstale":"2024-08-31T05:28:11.583067+0000","last_undegraded":"2024-08-31T05:28:11.583067+0000","last_fullsized":"2024-08-31T05:28:11.583067+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:20:49.121008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.503585+0000","last_change":"2024-08-31T05:27:38.294174+0000","last_active":"2024-08-31T05:27:58.503585+0000","last_peered":"2024-08-31T05:27:58.503585+0000","last_clean":"2024-08-31T05:27:58.503585+0000","last_became_active":"2024-08-31T05:27:38.293747+0000","last_became_peered":"2024-08-31T05:27:38.293747+0000","last_unstale":"2024-08-31T05:27:58.503585+0000","last_undegraded":"2024-08-31T05:27:58.503585+0000","last_fullsized":"2024-08-31T05:27:58.503585+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:35:46.124473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.500916+0000","last_change":"2024-08-31T05:27:31.244942+0000","last_active":"2024-08-31T05:27:58.500916+0000","last_peered":"2024-08-31T05:27:58.500916+0000","last_clean":"2024-08-31T05:27:58.500916+0000","last_became_active":"2024-08-31T05:27:31.244608+0000","last_became_peered":"2024-08-31T05:27:31.244608+0000","last_unstale":"2024-08-31T05:27:58.500916+0000","last_undegraded":"2024-08-31T05:27:58.500916+0000","last_fullsized":"2024-08-31T05:27:58.500916+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:50:13.651172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"85'3","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:09.567463+0000","last_change":"2024-08-31T05:27:29.236832+0000","last_active":"2024-08-31T05:28:09.567463+0000","last_peered":"2024-08-31T05:28:09.567463+0000","last_clean":"2024-08-31T05:28:09.567463+0000","last_became_active":"2024-08-31T05:27:29.236326+0000","last_became_peered":"2024-08-31T05:27:29.236326+0000","last_unstale":"2024-08-31T05:28:09.567463+0000","last_undegraded":"2024-08-31T05:28:09.567463+0000","last_fullsized":"2024-08-31T05:28:09.567463+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:43:26.199499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:10.572578+0000","last_change":"2024-08-31T05:27:29.237409+0000","last_active":"2024-08-31T05:28:10.572578+0000","last_peered":"2024-08-31T05:28:10.572578+0000","last_clean":"2024-08-31T05:28:10.572578+0000","last_became_active":"2024-08-31T05:27:29.236928+0000","last_became_peered":"2024-08-31T05:27:29.236928+0000","last_unstale":"2024-08-31T05:28:10.572578+0000","last_undegraded":"2024-08-31T05:28:10.572578+0000","last_fullsized":"2024-08-31T05:28:10.572578+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:07:53.917242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.499005+0000","last_change":"2024-08-31T05:27:31.263005+0000","last_active":"2024-08-31T05:27:58.499005+0000","last_peered":"2024-08-31T05:27:58.499005+0000","last_clean":"2024-08-31T05:27:58.499005+0000","last_became_active":"2024-08-31T05:27:31.262638+0000","last_became_peered":"2024-08-31T05:27:31.262638+0000","last_unstale":"2024-08-31T05:27:58.499005+0000","last_undegraded":"2024-08-31T05:27:58.499005+0000","last_fullsized":"2024-08-31T05:27:58.499005+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:35:06.094346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.502373+0000","last_change":"2024-08-31T05:27:38.293067+0000","last_active":"2024-08-31T05:27:58.502373+0000","last_peered":"2024-08-31T05:27:58.502373+0000","last_clean":"2024-08-31T05:27:58.502373+0000","last_became_active":"2024-08-31T05:27:38.292413+0000","last_became_peered":"2024-08-31T05:27:38.292413+0000","last_unstale":"2024-08-31T05:27:58.502373+0000","last_undegraded":"2024-08-31T05:27:58.502373+0000","last_fullsized":"2024-08-31T05:27:58.502373+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:26:12.248341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"85'6","reported_seq":63,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:22.604574+0000","last_change":"2024-08-31T05:27:58.652458+0000","last_active":"2024-08-31T05:28:22.604574+0000","last_peered":"2024-08-31T05:28:22.604574+0000","last_clean":"2024-08-31T05:28:22.604574+0000","last_became_active":"2024-08-31T05:27:58.652037+0000","last_became_peered":"2024-08-31T05:27:58.652037+0000","last_unstale":"2024-08-31T05:28:22.604574+0000","last_undegraded":"2024-08-31T05:28:22.604574+0000","last_fullsized":"2024-08-31T05:28:22.604574+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:44:45.839429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.506170+0000","last_change":"2024-08-31T05:27:31.253835+0000","last_active":"2024-08-31T05:27:58.506170+0000","last_peered":"2024-08-31T05:27:58.506170+0000","last_clean":"2024-08-31T05:27:58.506170+0000","last_became_active":"2024-08-31T05:27:31.252828+0000","last_became_peered":"2024-08-31T05:27:31.252828+0000","last_unstale":"2024-08-31T05:27:58.506170+0000","last_undegraded":"2024-08-31T05:27:58.506170+0000","last_fullsized":"2024-08-31T05:27:58.506170+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:59:29.987345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.501919+0000","last_change":"2024-08-31T05:27:38.292690+0000","last_active":"2024-08-31T05:27:58.501919+0000","last_peered":"2024-08-31T05:27:58.501919+0000","last_clean":"2024-08-31T05:27:58.501919+0000","last_became_active":"2024-08-31T05:27:38.292195+0000","last_became_peered":"2024-08-31T05:27:38.292195+0000","last_unstale":"2024-08-31T05:27:58.501919+0000","last_undegraded":"2024-08-31T05:27:58.501919+0000","last_fullsized":"2024-08-31T05:27:58.501919+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:50:06.142879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.502883+0000","last_change":"2024-08-31T05:27:31.253706+0000","last_active":"2024-08-31T05:27:58.502883+0000","last_peered":"2024-08-31T05:27:58.502883+0000","last_clean":"2024-08-31T05:27:58.502883+0000","last_became_active":"2024-08-31T05:27:31.253343+0000","last_became_peered":"2024-08-31T05:27:31.253343+0000","last_unstale":"2024-08-31T05:27:58.502883+0000","last_undegraded":"2024-08-31T05:27:58.502883+0000","last_fullsized":"2024-08-31T05:27:58.502883+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:40:28.318153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.651816+0000","last_change":"2024-08-31T05:27:58.651669+0000","last_active":"2024-08-31T05:27:58.651816+0000","last_peered":"2024-08-31T05:27:58.651816+0000","last_clean":"2024-08-31T05:27:58.651816+0000","last_became_active":"2024-08-31T05:27:58.651273+0000","last_became_peered":"2024-08-31T05:27:58.651273+0000","last_unstale":"2024-08-31T05:27:58.651816+0000","last_undegraded":"2024-08-31T05:27:58.651816+0000","last_fullsized":"2024-08-31T05:27:58.651816+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:37:42.960124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.501585+0000","last_change":"2024-08-31T05:27:31.257648+0000","last_active":"2024-08-31T05:27:58.501585+0000","last_peered":"2024-08-31T05:27:58.501585+0000","last_clean":"2024-08-31T05:27:58.501585+0000","last_became_active":"2024-08-31T05:27:31.257140+0000","last_became_peered":"2024-08-31T05:27:31.257140+0000","last_unstale":"2024-08-31T05:27:58.501585+0000","last_undegraded":"2024-08-31T05:27:58.501585+0000","last_fullsized":"2024-08-31T05:27:58.501585+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:02:15.249225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.501964+0000","last_change":"2024-08-31T05:27:31.264968+0000","last_active":"2024-08-31T05:27:58.501964+0000","last_peered":"2024-08-31T05:27:58.501964+0000","last_clean":"2024-08-31T05:27:58.501964+0000","last_became_active":"2024-08-31T05:27:31.264629+0000","last_became_peered":"2024-08-31T05:27:31.264629+0000","last_unstale":"2024-08-31T05:27:58.501964+0000","last_undegraded":"2024-08-31T05:27:58.501964+0000","last_fullsized":"2024-08-31T05:27:58.501964+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:28:15.283607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.497542+0000","last_change":"2024-08-31T05:27:31.252358+0000","last_active":"2024-08-31T05:27:58.497542+0000","last_peered":"2024-08-31T05:27:58.497542+0000","last_clean":"2024-08-31T05:27:58.497542+0000","last_became_active":"2024-08-31T05:27:31.252013+0000","last_became_peered":"2024-08-31T05:27:31.252013+0000","last_unstale":"2024-08-31T05:27:58.497542+0000","last_undegraded":"2024-08-31T05:27:58.497542+0000","last_fullsized":"2024-08-31T05:27:58.497542+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:48:47.287168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.503437+0000","last_change":"2024-08-31T05:27:31.262626+0000","last_active":"2024-08-31T05:27:58.503437+0000","last_peered":"2024-08-31T05:27:58.503437+0000","last_clean":"2024-08-31T05:27:58.503437+0000","last_became_active":"2024-08-31T05:27:31.262190+0000","last_became_peered":"2024-08-31T05:27:31.262190+0000","last_unstale":"2024-08-31T05:27:58.503437+0000","last_undegraded":"2024-08-31T05:27:58.503437+0000","last_fullsized":"2024-08-31T05:27:58.503437+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:39:19.454606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.502048+0000","last_change":"2024-08-31T05:27:31.254482+0000","last_active":"2024-08-31T05:27:58.502048+0000","last_peered":"2024-08-31T05:27:58.502048+0000","last_clean":"2024-08-31T05:27:58.502048+0000","last_became_active":"2024-08-31T05:27:31.254103+0000","last_became_peered":"2024-08-31T05:27:31.254103+0000","last_unstale":"2024-08-31T05:27:58.502048+0000","last_undegraded":"2024-08-31T05:27:58.502048+0000","last_fullsized":"2024-08-31T05:27:58.502048+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:20:57.333359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.506087+0000","last_change":"2024-08-31T05:27:58.505928+0000","last_active":"2024-08-31T05:27:58.506087+0000","last_peered":"2024-08-31T05:27:58.506087+0000","last_clean":"2024-08-31T05:27:58.506087+0000","last_became_active":"2024-08-31T05:27:58.505527+0000","last_became_peered":"2024-08-31T05:27:58.505527+0000","last_unstale":"2024-08-31T05:27:58.506087+0000","last_undegraded":"2024-08-31T05:27:58.506087+0000","last_fullsized":"2024-08-31T05:27:58.506087+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:44:30.754350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.498581+0000","last_change":"2024-08-31T05:27:31.262385+0000","last_active":"2024-08-31T05:27:58.498581+0000","last_peered":"2024-08-31T05:27:58.498581+0000","last_clean":"2024-08-31T05:27:58.498581+0000","last_became_active":"2024-08-31T05:27:31.262089+0000","last_became_peered":"2024-08-31T05:27:31.262089+0000","last_unstale":"2024-08-31T05:27:58.498581+0000","last_undegraded":"2024-08-31T05:27:58.498581+0000","last_fullsized":"2024-08-31T05:27:58.498581+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:50:17.172462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.501316+0000","last_change":"2024-08-31T05:27:31.249162+0000","last_active":"2024-08-31T05:27:58.501316+0000","last_peered":"2024-08-31T05:27:58.501316+0000","last_clean":"2024-08-31T05:27:58.501316+0000","last_became_active":"2024-08-31T05:27:31.248803+0000","last_became_peered":"2024-08-31T05:27:31.248803+0000","last_unstale":"2024-08-31T05:27:58.501316+0000","last_undegraded":"2024-08-31T05:27:58.501316+0000","last_fullsized":"2024-08-31T05:27:58.501316+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:18:05.449612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.503559+0000","last_change":"2024-08-31T05:27:31.258983+0000","last_active":"2024-08-31T05:27:58.503559+0000","last_peered":"2024-08-31T05:27:58.503559+0000","last_clean":"2024-08-31T05:27:58.503559+0000","last_became_active":"2024-08-31T05:27:31.258480+0000","last_became_peered":"2024-08-31T05:27:31.258480+0000","last_unstale":"2024-08-31T05:27:58.503559+0000","last_undegraded":"2024-08-31T05:27:58.503559+0000","last_fullsized":"2024-08-31T05:27:58.503559+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:57:34.589281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.497478+0000","last_change":"2024-08-31T05:27:31.252561+0000","last_active":"2024-08-31T05:27:58.497478+0000","last_peered":"2024-08-31T05:27:58.497478+0000","last_clean":"2024-08-31T05:27:58.497478+0000","last_became_active":"2024-08-31T05:27:31.251963+0000","last_became_peered":"2024-08-31T05:27:31.251963+0000","last_unstale":"2024-08-31T05:27:58.497478+0000","last_undegraded":"2024-08-31T05:27:58.497478+0000","last_fullsized":"2024-08-31T05:27:58.497478+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:17:45.244329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.503093+0000","last_change":"2024-08-31T05:27:31.257298+0000","last_active":"2024-08-31T05:27:58.503093+0000","last_peered":"2024-08-31T05:27:58.503093+0000","last_clean":"2024-08-31T05:27:58.503093+0000","last_became_active":"2024-08-31T05:27:31.256935+0000","last_became_peered":"2024-08-31T05:27:31.256935+0000","last_unstale":"2024-08-31T05:27:58.503093+0000","last_undegraded":"2024-08-31T05:27:58.503093+0000","last_fullsized":"2024-08-31T05:27:58.503093+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:07:32.876328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.502065+0000","last_change":"2024-08-31T05:27:31.248456+0000","last_active":"2024-08-31T05:27:58.502065+0000","last_peered":"2024-08-31T05:27:58.502065+0000","last_clean":"2024-08-31T05:27:58.502065+0000","last_became_active":"2024-08-31T05:27:31.248060+0000","last_became_peered":"2024-08-31T05:27:31.248060+0000","last_unstale":"2024-08-31T05:27:58.502065+0000","last_undegraded":"2024-08-31T05:27:58.502065+0000","last_fullsized":"2024-08-31T05:27:58.502065+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:29:35.817409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.503318+0000","last_change":"2024-08-31T05:27:31.251345+0000","last_active":"2024-08-31T05:27:58.503318+0000","last_peered":"2024-08-31T05:27:58.503318+0000","last_clean":"2024-08-31T05:27:58.503318+0000","last_became_active":"2024-08-31T05:27:31.251002+0000","last_became_peered":"2024-08-31T05:27:31.251002+0000","last_unstale":"2024-08-31T05:27:58.503318+0000","last_undegraded":"2024-08-31T05:27:58.503318+0000","last_fullsized":"2024-08-31T05:27:58.503318+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:35:24.564897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.504407+0000","last_change":"2024-08-31T05:27:31.260681+0000","last_active":"2024-08-31T05:27:58.504407+0000","last_peered":"2024-08-31T05:27:58.504407+0000","last_clean":"2024-08-31T05:27:58.504407+0000","last_became_active":"2024-08-31T05:27:31.259445+0000","last_became_peered":"2024-08-31T05:27:31.259445+0000","last_unstale":"2024-08-31T05:27:58.504407+0000","last_undegraded":"2024-08-31T05:27:58.504407+0000","last_fullsized":"2024-08-31T05:27:58.504407+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:41:43.480946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.502947+0000","last_change":"2024-08-31T05:27:31.263950+0000","last_active":"2024-08-31T05:27:58.502947+0000","last_peered":"2024-08-31T05:27:58.502947+0000","last_clean":"2024-08-31T05:27:58.502947+0000","last_became_active":"2024-08-31T05:27:31.263568+0000","last_became_peered":"2024-08-31T05:27:31.263568+0000","last_unstale":"2024-08-31T05:27:58.502947+0000","last_undegraded":"2024-08-31T05:27:58.502947+0000","last_fullsized":"2024-08-31T05:27:58.502947+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:50:05.111796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.508949+0000","last_change":"2024-08-31T05:27:58.508829+0000","last_active":"2024-08-31T05:27:58.508949+0000","last_peered":"2024-08-31T05:27:58.508949+0000","last_clean":"2024-08-31T05:27:58.508949+0000","last_became_active":"2024-08-31T05:27:58.508378+0000","last_became_peered":"2024-08-31T05:27:58.508378+0000","last_unstale":"2024-08-31T05:27:58.508949+0000","last_undegraded":"2024-08-31T05:27:58.508949+0000","last_fullsized":"2024-08-31T05:27:58.508949+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:05:46.254003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.501500+0000","last_change":"2024-08-31T05:27:31.261012+0000","last_active":"2024-08-31T05:27:58.501500+0000","last_peered":"2024-08-31T05:27:58.501500+0000","last_clean":"2024-08-31T05:27:58.501500+0000","last_became_active":"2024-08-31T05:27:31.259373+0000","last_became_peered":"2024-08-31T05:27:31.259373+0000","last_unstale":"2024-08-31T05:27:58.501500+0000","last_undegraded":"2024-08-31T05:27:58.501500+0000","last_fullsized":"2024-08-31T05:27:58.501500+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:15:34.711961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.497450+0000","last_change":"2024-08-31T05:27:31.255199+0000","last_active":"2024-08-31T05:27:58.497450+0000","last_peered":"2024-08-31T05:27:58.497450+0000","last_clean":"2024-08-31T05:27:58.497450+0000","last_became_active":"2024-08-31T05:27:31.254833+0000","last_became_peered":"2024-08-31T05:27:31.254833+0000","last_unstale":"2024-08-31T05:27:58.497450+0000","last_undegraded":"2024-08-31T05:27:58.497450+0000","last_fullsized":"2024-08-31T05:27:58.497450+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:55:09.426531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.651143+0000","last_change":"2024-08-31T05:27:31.264881+0000","last_active":"2024-08-31T05:27:58.651143+0000","last_peered":"2024-08-31T05:27:58.651143+0000","last_clean":"2024-08-31T05:27:58.651143+0000","last_became_active":"2024-08-31T05:27:31.264483+0000","last_became_peered":"2024-08-31T05:27:31.264483+0000","last_unstale":"2024-08-31T05:27:58.651143+0000","last_undegraded":"2024-08-31T05:27:58.651143+0000","last_fullsized":"2024-08-31T05:27:58.651143+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:48:55.193321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.501847+0000","last_change":"2024-08-31T05:27:31.258555+0000","last_active":"2024-08-31T05:27:58.501847+0000","last_peered":"2024-08-31T05:27:58.501847+0000","last_clean":"2024-08-31T05:27:58.501847+0000","last_became_active":"2024-08-31T05:27:31.258023+0000","last_became_peered":"2024-08-31T05:27:31.258023+0000","last_unstale":"2024-08-31T05:27:58.501847+0000","last_undegraded":"2024-08-31T05:27:58.501847+0000","last_fullsized":"2024-08-31T05:27:58.501847+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:26:34.911641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.499424+0000","last_change":"2024-08-31T05:27:31.249886+0000","last_active":"2024-08-31T05:27:58.499424+0000","last_peered":"2024-08-31T05:27:58.499424+0000","last_clean":"2024-08-31T05:27:58.499424+0000","last_became_active":"2024-08-31T05:27:31.248549+0000","last_became_peered":"2024-08-31T05:27:31.248549+0000","last_unstale":"2024-08-31T05:27:58.499424+0000","last_undegraded":"2024-08-31T05:27:58.499424+0000","last_fullsized":"2024-08-31T05:27:58.499424+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:57:55.743286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.504021+0000","last_change":"2024-08-31T05:27:31.261697+0000","last_active":"2024-08-31T05:27:58.504021+0000","last_peered":"2024-08-31T05:27:58.504021+0000","last_clean":"2024-08-31T05:27:58.504021+0000","last_became_active":"2024-08-31T05:27:31.260398+0000","last_became_peered":"2024-08-31T05:27:31.260398+0000","last_unstale":"2024-08-31T05:27:58.504021+0000","last_undegraded":"2024-08-31T05:27:58.504021+0000","last_fullsized":"2024-08-31T05:27:58.504021+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:08:03.999556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.500827+0000","last_change":"2024-08-31T05:27:31.256638+0000","last_active":"2024-08-31T05:27:58.500827+0000","last_peered":"2024-08-31T05:27:58.500827+0000","last_clean":"2024-08-31T05:27:58.500827+0000","last_became_active":"2024-08-31T05:27:31.256302+0000","last_became_peered":"2024-08-31T05:27:31.256302+0000","last_unstale":"2024-08-31T05:27:58.500827+0000","last_undegraded":"2024-08-31T05:27:58.500827+0000","last_fullsized":"2024-08-31T05:27:58.500827+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:31:58.946448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.500733+0000","last_change":"2024-08-31T05:27:31.253818+0000","last_active":"2024-08-31T05:27:58.500733+0000","last_peered":"2024-08-31T05:27:58.500733+0000","last_clean":"2024-08-31T05:27:58.500733+0000","last_became_active":"2024-08-31T05:27:31.253423+0000","last_became_peered":"2024-08-31T05:27:31.253423+0000","last_unstale":"2024-08-31T05:27:58.500733+0000","last_undegraded":"2024-08-31T05:27:58.500733+0000","last_fullsized":"2024-08-31T05:27:58.500733+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:45:43.951022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.498682+0000","last_change":"2024-08-31T05:27:31.247171+0000","last_active":"2024-08-31T05:27:58.498682+0000","last_peered":"2024-08-31T05:27:58.498682+0000","last_clean":"2024-08-31T05:27:58.498682+0000","last_became_active":"2024-08-31T05:27:31.246791+0000","last_became_peered":"2024-08-31T05:27:31.246791+0000","last_unstale":"2024-08-31T05:27:58.498682+0000","last_undegraded":"2024-08-31T05:27:58.498682+0000","last_fullsized":"2024-08-31T05:27:58.498682+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:26:12.163389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.506548+0000","last_change":"2024-08-31T05:27:31.257848+0000","last_active":"2024-08-31T05:27:58.506548+0000","last_peered":"2024-08-31T05:27:58.506548+0000","last_clean":"2024-08-31T05:27:58.506548+0000","last_became_active":"2024-08-31T05:27:31.257432+0000","last_became_peered":"2024-08-31T05:27:31.257432+0000","last_unstale":"2024-08-31T05:27:58.506548+0000","last_undegraded":"2024-08-31T05:27:58.506548+0000","last_fullsized":"2024-08-31T05:27:58.506548+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:08:12.512834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.651075+0000","last_change":"2024-08-31T05:27:31.263998+0000","last_active":"2024-08-31T05:27:58.651075+0000","last_peered":"2024-08-31T05:27:58.651075+0000","last_clean":"2024-08-31T05:27:58.651075+0000","last_became_active":"2024-08-31T05:27:31.263638+0000","last_became_peered":"2024-08-31T05:27:31.263638+0000","last_unstale":"2024-08-31T05:27:58.651075+0000","last_undegraded":"2024-08-31T05:27:58.651075+0000","last_fullsized":"2024-08-31T05:27:58.651075+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:07:50.470538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.502526+0000","last_change":"2024-08-31T05:27:31.260600+0000","last_active":"2024-08-31T05:27:58.502526+0000","last_peered":"2024-08-31T05:27:58.502526+0000","last_clean":"2024-08-31T05:27:58.502526+0000","last_became_active":"2024-08-31T05:27:31.259605+0000","last_became_peered":"2024-08-31T05:27:31.259605+0000","last_unstale":"2024-08-31T05:27:58.502526+0000","last_undegraded":"2024-08-31T05:27:58.502526+0000","last_fullsized":"2024-08-31T05:27:58.502526+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:04:16.861879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.501924+0000","last_change":"2024-08-31T05:27:31.256585+0000","last_active":"2024-08-31T05:27:58.501924+0000","last_peered":"2024-08-31T05:27:58.501924+0000","last_clean":"2024-08-31T05:27:58.501924+0000","last_became_active":"2024-08-31T05:27:31.256118+0000","last_became_peered":"2024-08-31T05:27:31.256118+0000","last_unstale":"2024-08-31T05:27:58.501924+0000","last_undegraded":"2024-08-31T05:27:58.501924+0000","last_fullsized":"2024-08-31T05:27:58.501924+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:47:18.891150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.504364+0000","last_change":"2024-08-31T05:27:31.260321+0000","last_active":"2024-08-31T05:27:58.504364+0000","last_peered":"2024-08-31T05:27:58.504364+0000","last_clean":"2024-08-31T05:27:58.504364+0000","last_became_active":"2024-08-31T05:27:31.259901+0000","last_became_peered":"2024-08-31T05:27:31.259901+0000","last_unstale":"2024-08-31T05:27:58.504364+0000","last_undegraded":"2024-08-31T05:27:58.504364+0000","last_fullsized":"2024-08-31T05:27:58.504364+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:44:26.651338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":59608,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":153,"num_read_kb":141,"num_write":236,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":540672,"data_stored":178824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":206,"ondisk_log_size":206,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":280617,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678040,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36264,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708888,"statfs":{"total":95995035648,"available":95957901312,"internally_reserved":0,"allocated":942080,"data_stored":490094,"data_compressed":23633,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874269,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36400,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708752,"statfs":{"total":95995035648,"available":95957762048,"internally_reserved":0,"allocated":1081344,"data_stored":1129314,"data_compressed":59318,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037794,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":970752,"data_stored":494120,"data_compressed":23633,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234023,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":954368,"data_stored":489730,"data_compressed":23633,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430252,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":1087290,"data_compressed":59318,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593777,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":485919,"data_compressed":23633,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790007,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36344,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708808,"statfs":{"total":95995035648,"available":95957819392,"internally_reserved":0,"allocated":1024000,"data_stored":1082481,"data_compressed":59318,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953532,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":490615,"data_compressed":23633,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149761,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36276,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708876,"statfs":{"total":95995035648,"available":95957889024,"internally_reserved":0,"allocated":954368,"data_stored":485236,"data_compressed":23633,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378694,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1011712,"data_stored":538560,"data_compressed":23633,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542219,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36328,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708824,"statfs":{"total":95995035648,"available":95957835776,"internally_reserved":0,"allocated":1007616,"data_stored":540025,"data_compressed":23633,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705744,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36288,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708864,"statfs":{"total":95995035648,"available":95957876736,"internally_reserved":0,"allocated":966656,"data_stored":486984,"data_compressed":23633,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34064,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34064,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34064,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":55219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":53754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":54140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T05:28:28.698 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph pg dump --format=json 2024-08-31T05:28:28.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:28 smithi050 ceph-mon[22146]: pgmap v298: 129 pgs: 129 active+clean; 635 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 5.3 KiB/s wr, 12 op/s 2024-08-31T05:28:28.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:28 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:28:28.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:28 smithi050 ceph-mon[22146]: from='client.15048 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T05:28:29.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:28 smithi070 ceph-mon[22316]: pgmap v298: 129 pgs: 129 active+clean; 635 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 5.3 KiB/s wr, 12 op/s 2024-08-31T05:28:29.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:28 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:28:29.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:28 smithi070 ceph-mon[22316]: from='client.15048 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T05:28:29.590 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:28:30.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:30.112+0000 7f98a27bf640 1 -- 172.21.15.5:0/827389810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f989c107980 msgr2=0x7f989c107d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:30.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:30.112+0000 7f98a27bf640 1 --2- 172.21.15.5:0/827389810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f989c107980 0x7f989c107d90 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9890009900 tx=0x7f989002a410 comp rx=0 tx=0).stop 2024-08-31T05:28:30.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:30.112+0000 7f98a27bf640 1 -- 172.21.15.5:0/827389810 shutdown_connections 2024-08-31T05:28:30.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:30.112+0000 7f98a27bf640 1 --2- 172.21.15.5:0/827389810 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f989c1082d0 0x7f989c10eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:30.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:30.112+0000 7f98a27bf640 1 --2- 172.21.15.5:0/827389810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f989c107980 0x7f989c107d90 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:30.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:30.112+0000 7f98a27bf640 1 --2- 172.21.15.5:0/827389810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f989c102040 0x7f989c102450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:30.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:30.112+0000 7f98a27bf640 1 -- 172.21.15.5:0/827389810 >> 172.21.15.5:0/827389810 conn(0x7f989c079c60 msgr2=0x7f989c07a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:30.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:30.112+0000 7f98a27bf640 1 -- 172.21.15.5:0/827389810 shutdown_connections 2024-08-31T05:28:30.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:30.112+0000 7f98a27bf640 1 -- 172.21.15.5:0/827389810 wait complete. 2024-08-31T05:28:30.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:30.113+0000 7f98a27bf640 1 Processor -- start 2024-08-31T05:28:30.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:30.113+0000 7f98a27bf640 1 -- start start 2024-08-31T05:28:30.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:30.114+0000 7f98a27bf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f989c102040 0x7f989c1992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:30.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:30.114+0000 7f98a27bf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f989c107980 0x7f989c199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:30.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:30.114+0000 7f98a27bf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f989c1082d0 0x7f989c19eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:30.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:30.114+0000 7f98a27bf640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f989c112800 con 0x7f989c1082d0 2024-08-31T05:28:30.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:30.114+0000 7f98a27bf640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f989c112680 con 0x7f989c102040 2024-08-31T05:28:30.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:30.114+0000 7f98a27bf640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f989c112980 con 0x7f989c107980 2024-08-31T05:28:30.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:30.114+0000 7f98a0d5c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f989c1082d0 0x7f989c19eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:30.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:30.114+0000 7f989b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f989c107980 0x7f989c199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:30.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:30.114+0000 7f98a0d5c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f989c1082d0 0x7f989c19eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47848/0 (socket says 172.21.15.5:47848) 2024-08-31T05:28:30.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:30.114+0000 7f98a0d5c640 1 -- 172.21.15.5:0/3504387282 learned_addr learned my addr 172.21.15.5:0/3504387282 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:28:30.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:30.114+0000 7f989bfff640 1 --2- 172.21.15.5:0/3504387282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f989c102040 0x7f989c1992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:30.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:30.114+0000 7f989bfff640 1 -- 172.21.15.5:0/3504387282 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f989c107980 msgr2=0x7f989c199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:30.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:30.114+0000 7f989bfff640 1 --2- 172.21.15.5:0/3504387282 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f989c107980 0x7f989c199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:30.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:30.114+0000 7f989bfff640 1 -- 172.21.15.5:0/3504387282 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f989c1082d0 msgr2=0x7f989c19eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:30.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:30.114+0000 7f989bfff640 1 --2- 172.21.15.5:0/3504387282 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f989c1082d0 0x7f989c19eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:30.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:30.114+0000 7f989bfff640 1 -- 172.21.15.5:0/3504387282 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f989c19f260 con 0x7f989c102040 2024-08-31T05:28:30.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:30.115+0000 7f989bfff640 1 --2- 172.21.15.5:0/3504387282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f989c102040 0x7f989c1992f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f988c00af10 tx=0x7f988c00cc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:30.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:30.115+0000 7f98997fa640 1 -- 172.21.15.5:0/3504387282 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f988c013d70 con 0x7f989c102040 2024-08-31T05:28:30.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:30.115+0000 7f98a27bf640 1 -- 172.21.15.5:0/3504387282 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f989c19f550 con 0x7f989c102040 2024-08-31T05:28:30.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:30.115+0000 7f98997fa640 1 -- 172.21.15.5:0/3504387282 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f988c00ce20 con 0x7f989c102040 2024-08-31T05:28:30.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:30.115+0000 7f98997fa640 1 -- 172.21.15.5:0/3504387282 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f988c0077a0 con 0x7f989c102040 2024-08-31T05:28:30.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:30.115+0000 7f98a27bf640 1 -- 172.21.15.5:0/3504387282 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f989c10f1c0 con 0x7f989c102040 2024-08-31T05:28:30.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:30.116+0000 7f98a27bf640 1 -- 172.21.15.5:0/3504387282 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f989c102450 con 0x7f989c102040 2024-08-31T05:28:30.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:30.118+0000 7f98997fa640 1 -- 172.21.15.5:0/3504387282 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f988c004ec0 con 0x7f989c102040 2024-08-31T05:28:30.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:30.118+0000 7f98997fa640 1 --2- 172.21.15.5:0/3504387282 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f98840b4c10 0x7f98840b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:30.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:30.118+0000 7f989b7fe640 1 --2- 172.21.15.5:0/3504387282 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f98840b4c10 0x7f98840b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:30.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:30.118+0000 7f98997fa640 1 -- 172.21.15.5:0/3504387282 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9307+0+0 (secure 0 0 0) 0x7f988c0e9960 con 0x7f989c102040 2024-08-31T05:28:30.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:30.119+0000 7f989b7fe640 1 --2- 172.21.15.5:0/3504387282 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f98840b4c10 0x7f98840b7120 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9890009230 tx=0x7f9890031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:30.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:30.121+0000 7f98997fa640 1 -- 172.21.15.5:0/3504387282 <== mon.2 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f988c018030 con 0x7f989c102040 2024-08-31T05:28:30.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:30.309+0000 7f98a27bf640 1 -- 172.21.15.5:0/3504387282 --> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f989c10f480 con 0x7f98840b4c10 2024-08-31T05:28:30.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:30.315+0000 7f98997fa640 1 -- 172.21.15.5:0/3504387282 <== mgr.14220 v2:172.21.15.5:6800/2696053609 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340662 (secure 0 0 0) 0x7f989c10f480 con 0x7f98840b4c10 2024-08-31T05:28:30.320 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:28:30.321 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-31T05:28:30.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:30.318+0000 7f98a27bf640 1 -- 172.21.15.5:0/3504387282 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f98840b4c10 msgr2=0x7f98840b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:30.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:30.318+0000 7f98a27bf640 1 --2- 172.21.15.5:0/3504387282 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f98840b4c10 0x7f98840b7120 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9890009230 tx=0x7f9890031400 comp rx=0 tx=0).stop 2024-08-31T05:28:30.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:30.318+0000 7f98a27bf640 1 -- 172.21.15.5:0/3504387282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f989c102040 msgr2=0x7f989c1992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:30.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:30.318+0000 7f98a27bf640 1 --2- 172.21.15.5:0/3504387282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f989c102040 0x7f989c1992f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f988c00af10 tx=0x7f988c00cc90 comp rx=0 tx=0).stop 2024-08-31T05:28:30.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:30.318+0000 7f98a27bf640 1 -- 172.21.15.5:0/3504387282 shutdown_connections 2024-08-31T05:28:30.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:30.318+0000 7f98a27bf640 1 --2- 172.21.15.5:0/3504387282 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f98840b4c10 0x7f98840b7120 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:30.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:30.318+0000 7f98a27bf640 1 --2- 172.21.15.5:0/3504387282 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f989c1082d0 0x7f989c19eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:30.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:30.318+0000 7f98a27bf640 1 --2- 172.21.15.5:0/3504387282 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f989c107980 0x7f989c199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:30.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:30.318+0000 7f98a27bf640 1 --2- 172.21.15.5:0/3504387282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f989c102040 0x7f989c1992f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:30.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:30.318+0000 7f98a27bf640 1 -- 172.21.15.5:0/3504387282 >> 172.21.15.5:0/3504387282 conn(0x7f989c079c60 msgr2=0x7f989c105a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:30.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:30.318+0000 7f98a27bf640 1 -- 172.21.15.5:0/3504387282 shutdown_connections 2024-08-31T05:28:30.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:30.319+0000 7f98a27bf640 1 -- 172.21.15.5:0/3504387282 wait complete. 2024-08-31T05:28:30.715 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:30 smithi005 ceph-mon[18602]: pgmap v299: 129 pgs: 129 active+clean; 639 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.7 KiB/s wr, 15 op/s 2024-08-31T05:28:30.715 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:30 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:28:30.715 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:30 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:28:30.715 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:30 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:28:30.715 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:30 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:28:30.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:30 smithi070 ceph-mon[22316]: pgmap v299: 129 pgs: 129 active+clean; 639 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.7 KiB/s wr, 15 op/s 2024-08-31T05:28:30.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:30 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:28:30.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:30 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:28:30.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:30 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:28:30.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:30 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:28:30.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:30 smithi050 ceph-mon[22146]: pgmap v299: 129 pgs: 129 active+clean; 639 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.7 KiB/s wr, 15 op/s 2024-08-31T05:28:30.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:30 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:28:30.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:30 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:28:30.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:30 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:28:30.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:30 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:28:31.089 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":299,"stamp":"2024-08-31T05:28:29.434913+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654475,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":280,"num_read_kb":240,"num_write":369,"num_write_kb":2286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":2952422,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":304,"ondisk_log_size":304,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":402408,"kb_used_data":11560,"kb_used_omap":18,"kb_used_meta":390637,"kb_avail":1124539416,"statfs":{"total":1151940427776,"available":1151528361984,"internally_reserved":0,"allocated":11837440,"data_stored":7808898,"data_compressed":390651,"data_compressed_allocated":528384,"data_compressed_original":2555904,"omap_allocated":19141,"internal_metadata":400012603},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":53452,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":153,"num_read_kb":132,"num_write":36,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003423"},"pg_stats":[{"pgid":"2.1f","version":"85'13","reported_seq":77,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:25.606549+0000","last_change":"2024-08-31T05:27:58.511927+0000","last_active":"2024-08-31T05:28:25.606549+0000","last_peered":"2024-08-31T05:28:25.606549+0000","last_clean":"2024-08-31T05:28:25.606549+0000","last_became_active":"2024-08-31T05:27:58.507111+0000","last_became_peered":"2024-08-31T05:27:58.507111+0000","last_unstale":"2024-08-31T05:28:25.606549+0000","last_undegraded":"2024-08-31T05:28:25.606549+0000","last_fullsized":"2024-08-31T05:28:25.606549+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:42:09.078048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.501521+0000","last_change":"2024-08-31T05:27:31.255221+0000","last_active":"2024-08-31T05:27:58.501521+0000","last_peered":"2024-08-31T05:27:58.501521+0000","last_clean":"2024-08-31T05:27:58.501521+0000","last_became_active":"2024-08-31T05:27:31.254684+0000","last_became_peered":"2024-08-31T05:27:31.254684+0000","last_unstale":"2024-08-31T05:27:58.501521+0000","last_undegraded":"2024-08-31T05:27:58.501521+0000","last_fullsized":"2024-08-31T05:27:58.501521+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:34:22.517485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.501430+0000","last_change":"2024-08-31T05:27:38.293857+0000","last_active":"2024-08-31T05:27:58.501430+0000","last_peered":"2024-08-31T05:27:58.501430+0000","last_clean":"2024-08-31T05:27:58.501430+0000","last_became_active":"2024-08-31T05:27:38.292763+0000","last_became_peered":"2024-08-31T05:27:38.292763+0000","last_unstale":"2024-08-31T05:27:58.501430+0000","last_undegraded":"2024-08-31T05:27:58.501430+0000","last_fullsized":"2024-08-31T05:27:58.501430+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:53:27.187697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.501948+0000","last_change":"2024-08-31T05:27:29.281010+0000","last_active":"2024-08-31T05:27:58.501948+0000","last_peered":"2024-08-31T05:27:58.501948+0000","last_clean":"2024-08-31T05:27:58.501948+0000","last_became_active":"2024-08-31T05:27:29.280625+0000","last_became_peered":"2024-08-31T05:27:29.280625+0000","last_unstale":"2024-08-31T05:27:58.501948+0000","last_undegraded":"2024-08-31T05:27:58.501948+0000","last_fullsized":"2024-08-31T05:27:58.501948+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:09:25.542564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.502293+0000","last_change":"2024-08-31T05:27:31.258052+0000","last_active":"2024-08-31T05:27:58.502293+0000","last_peered":"2024-08-31T05:27:58.502293+0000","last_clean":"2024-08-31T05:27:58.502293+0000","last_became_active":"2024-08-31T05:27:31.257549+0000","last_became_peered":"2024-08-31T05:27:31.257549+0000","last_unstale":"2024-08-31T05:27:58.502293+0000","last_undegraded":"2024-08-31T05:27:58.502293+0000","last_fullsized":"2024-08-31T05:27:58.502293+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:14:21.552372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.650345+0000","last_change":"2024-08-31T05:27:38.300359+0000","last_active":"2024-08-31T05:27:58.650345+0000","last_peered":"2024-08-31T05:27:58.650345+0000","last_clean":"2024-08-31T05:27:58.650345+0000","last_became_active":"2024-08-31T05:27:38.299704+0000","last_became_peered":"2024-08-31T05:27:38.299704+0000","last_unstale":"2024-08-31T05:27:58.650345+0000","last_undegraded":"2024-08-31T05:27:58.650345+0000","last_fullsized":"2024-08-31T05:27:58.650345+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:06:50.500384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"85'12","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:12.579038+0000","last_change":"2024-08-31T05:27:29.240652+0000","last_active":"2024-08-31T05:28:12.579038+0000","last_peered":"2024-08-31T05:28:12.579038+0000","last_clean":"2024-08-31T05:28:12.579038+0000","last_became_active":"2024-08-31T05:27:29.239432+0000","last_became_peered":"2024-08-31T05:27:29.239432+0000","last_unstale":"2024-08-31T05:28:12.579038+0000","last_undegraded":"2024-08-31T05:28:12.579038+0000","last_fullsized":"2024-08-31T05:28:12.579038+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:49:56.506299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.503319+0000","last_change":"2024-08-31T05:27:31.261784+0000","last_active":"2024-08-31T05:27:58.503319+0000","last_peered":"2024-08-31T05:27:58.503319+0000","last_clean":"2024-08-31T05:27:58.503319+0000","last_became_active":"2024-08-31T05:27:31.260045+0000","last_became_peered":"2024-08-31T05:27:31.260045+0000","last_unstale":"2024-08-31T05:27:58.503319+0000","last_undegraded":"2024-08-31T05:27:58.503319+0000","last_fullsized":"2024-08-31T05:27:58.503319+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:18:30.044052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.651031+0000","last_change":"2024-08-31T05:27:38.300926+0000","last_active":"2024-08-31T05:27:58.651031+0000","last_peered":"2024-08-31T05:27:58.651031+0000","last_clean":"2024-08-31T05:27:58.651031+0000","last_became_active":"2024-08-31T05:27:38.299444+0000","last_became_peered":"2024-08-31T05:27:38.299444+0000","last_unstale":"2024-08-31T05:27:58.651031+0000","last_undegraded":"2024-08-31T05:27:58.651031+0000","last_fullsized":"2024-08-31T05:27:58.651031+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:56:46.946879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"85'5","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:11.585007+0000","last_change":"2024-08-31T05:27:29.240341+0000","last_active":"2024-08-31T05:28:11.585007+0000","last_peered":"2024-08-31T05:28:11.585007+0000","last_clean":"2024-08-31T05:28:11.585007+0000","last_became_active":"2024-08-31T05:27:29.239944+0000","last_became_peered":"2024-08-31T05:27:29.239944+0000","last_unstale":"2024-08-31T05:28:11.585007+0000","last_undegraded":"2024-08-31T05:28:11.585007+0000","last_fullsized":"2024-08-31T05:28:11.585007+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:58:19.747559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.499316+0000","last_change":"2024-08-31T05:27:31.265116+0000","last_active":"2024-08-31T05:27:58.499316+0000","last_peered":"2024-08-31T05:27:58.499316+0000","last_clean":"2024-08-31T05:27:58.499316+0000","last_became_active":"2024-08-31T05:27:31.264725+0000","last_became_peered":"2024-08-31T05:27:31.264725+0000","last_unstale":"2024-08-31T05:27:58.499316+0000","last_undegraded":"2024-08-31T05:27:58.499316+0000","last_fullsized":"2024-08-31T05:27:58.499316+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:44:45.831881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.650517+0000","last_change":"2024-08-31T05:27:38.298634+0000","last_active":"2024-08-31T05:27:58.650517+0000","last_peered":"2024-08-31T05:27:58.650517+0000","last_clean":"2024-08-31T05:27:58.650517+0000","last_became_active":"2024-08-31T05:27:38.298143+0000","last_became_peered":"2024-08-31T05:27:38.298143+0000","last_unstale":"2024-08-31T05:27:58.650517+0000","last_undegraded":"2024-08-31T05:27:58.650517+0000","last_fullsized":"2024-08-31T05:27:58.650517+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:51:25.639441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.500613+0000","last_change":"2024-08-31T05:27:31.259981+0000","last_active":"2024-08-31T05:27:58.500613+0000","last_peered":"2024-08-31T05:27:58.500613+0000","last_clean":"2024-08-31T05:27:58.500613+0000","last_became_active":"2024-08-31T05:27:31.259584+0000","last_became_peered":"2024-08-31T05:27:31.259584+0000","last_unstale":"2024-08-31T05:27:58.500613+0000","last_undegraded":"2024-08-31T05:27:58.500613+0000","last_fullsized":"2024-08-31T05:27:58.500613+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:52:29.853977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:08.557863+0000","last_change":"2024-08-31T05:27:58.514065+0000","last_active":"2024-08-31T05:28:08.557863+0000","last_peered":"2024-08-31T05:28:08.557863+0000","last_clean":"2024-08-31T05:28:08.557863+0000","last_became_active":"2024-08-31T05:27:58.506011+0000","last_became_peered":"2024-08-31T05:27:58.506011+0000","last_unstale":"2024-08-31T05:28:08.557863+0000","last_undegraded":"2024-08-31T05:28:08.557863+0000","last_fullsized":"2024-08-31T05:28:08.557863+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:25:55.610965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.651049+0000","last_change":"2024-08-31T05:27:38.293265+0000","last_active":"2024-08-31T05:27:58.651049+0000","last_peered":"2024-08-31T05:27:58.651049+0000","last_clean":"2024-08-31T05:27:58.651049+0000","last_became_active":"2024-08-31T05:27:38.292736+0000","last_became_peered":"2024-08-31T05:27:38.292736+0000","last_unstale":"2024-08-31T05:27:58.651049+0000","last_undegraded":"2024-08-31T05:27:58.651049+0000","last_fullsized":"2024-08-31T05:27:58.651049+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:51:25.853365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.502101+0000","last_change":"2024-08-31T05:27:31.252479+0000","last_active":"2024-08-31T05:27:58.502101+0000","last_peered":"2024-08-31T05:27:58.502101+0000","last_clean":"2024-08-31T05:27:58.502101+0000","last_became_active":"2024-08-31T05:27:31.252126+0000","last_became_peered":"2024-08-31T05:27:31.252126+0000","last_unstale":"2024-08-31T05:27:58.502101+0000","last_undegraded":"2024-08-31T05:27:58.502101+0000","last_fullsized":"2024-08-31T05:27:58.502101+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:24:40.864240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"85'3","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:10.571641+0000","last_change":"2024-08-31T05:27:58.508588+0000","last_active":"2024-08-31T05:28:10.571641+0000","last_peered":"2024-08-31T05:28:10.571641+0000","last_clean":"2024-08-31T05:28:10.571641+0000","last_became_active":"2024-08-31T05:27:58.508024+0000","last_became_peered":"2024-08-31T05:27:58.508024+0000","last_unstale":"2024-08-31T05:28:10.571641+0000","last_undegraded":"2024-08-31T05:28:10.571641+0000","last_fullsized":"2024-08-31T05:28:10.571641+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:32:33.222909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"85'1","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.650982+0000","last_change":"2024-08-31T05:27:38.299506+0000","last_active":"2024-08-31T05:27:58.650982+0000","last_peered":"2024-08-31T05:27:58.650982+0000","last_clean":"2024-08-31T05:27:58.650982+0000","last_became_active":"2024-08-31T05:27:38.298756+0000","last_became_peered":"2024-08-31T05:27:38.298756+0000","last_unstale":"2024-08-31T05:27:58.650982+0000","last_undegraded":"2024-08-31T05:27:58.650982+0000","last_fullsized":"2024-08-31T05:27:58.650982+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:25:18.115727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.503026+0000","last_change":"2024-08-31T05:27:31.249220+0000","last_active":"2024-08-31T05:27:58.503026+0000","last_peered":"2024-08-31T05:27:58.503026+0000","last_clean":"2024-08-31T05:27:58.503026+0000","last_became_active":"2024-08-31T05:27:31.248869+0000","last_became_peered":"2024-08-31T05:27:31.248869+0000","last_unstale":"2024-08-31T05:27:58.503026+0000","last_undegraded":"2024-08-31T05:27:58.503026+0000","last_fullsized":"2024-08-31T05:27:58.503026+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:43:13.463903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:11.585131+0000","last_change":"2024-08-31T05:27:29.235278+0000","last_active":"2024-08-31T05:28:11.585131+0000","last_peered":"2024-08-31T05:28:11.585131+0000","last_clean":"2024-08-31T05:28:11.585131+0000","last_became_active":"2024-08-31T05:27:29.234929+0000","last_became_peered":"2024-08-31T05:27:29.234929+0000","last_unstale":"2024-08-31T05:28:11.585131+0000","last_undegraded":"2024-08-31T05:28:11.585131+0000","last_fullsized":"2024-08-31T05:28:11.585131+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:49:55.867542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.503030+0000","last_change":"2024-08-31T05:27:38.293903+0000","last_active":"2024-08-31T05:27:58.503030+0000","last_peered":"2024-08-31T05:27:58.503030+0000","last_clean":"2024-08-31T05:27:58.503030+0000","last_became_active":"2024-08-31T05:27:38.290471+0000","last_became_peered":"2024-08-31T05:27:38.290471+0000","last_unstale":"2024-08-31T05:27:58.503030+0000","last_undegraded":"2024-08-31T05:27:58.503030+0000","last_fullsized":"2024-08-31T05:27:58.503030+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:04:36.573302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.506186+0000","last_change":"2024-08-31T05:27:31.252038+0000","last_active":"2024-08-31T05:27:58.506186+0000","last_peered":"2024-08-31T05:27:58.506186+0000","last_clean":"2024-08-31T05:27:58.506186+0000","last_became_active":"2024-08-31T05:27:31.251630+0000","last_became_peered":"2024-08-31T05:27:31.251630+0000","last_unstale":"2024-08-31T05:27:58.506186+0000","last_undegraded":"2024-08-31T05:27:58.506186+0000","last_fullsized":"2024-08-31T05:27:58.506186+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:10:39.778057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:08.560315+0000","last_change":"2024-08-31T05:27:29.280978+0000","last_active":"2024-08-31T05:28:08.560315+0000","last_peered":"2024-08-31T05:28:08.560315+0000","last_clean":"2024-08-31T05:28:08.560315+0000","last_became_active":"2024-08-31T05:27:29.280524+0000","last_became_peered":"2024-08-31T05:27:29.280524+0000","last_unstale":"2024-08-31T05:28:08.560315+0000","last_undegraded":"2024-08-31T05:28:08.560315+0000","last_fullsized":"2024-08-31T05:28:08.560315+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:56:57.441801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.651297+0000","last_change":"2024-08-31T05:27:38.300947+0000","last_active":"2024-08-31T05:27:58.651297+0000","last_peered":"2024-08-31T05:27:58.651297+0000","last_clean":"2024-08-31T05:27:58.651297+0000","last_became_active":"2024-08-31T05:27:38.300044+0000","last_became_peered":"2024-08-31T05:27:38.300044+0000","last_unstale":"2024-08-31T05:27:58.651297+0000","last_undegraded":"2024-08-31T05:27:58.651297+0000","last_fullsized":"2024-08-31T05:27:58.651297+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:33:05.081601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.502028+0000","last_change":"2024-08-31T05:27:31.257782+0000","last_active":"2024-08-31T05:27:58.502028+0000","last_peered":"2024-08-31T05:27:58.502028+0000","last_clean":"2024-08-31T05:27:58.502028+0000","last_became_active":"2024-08-31T05:27:31.257360+0000","last_became_peered":"2024-08-31T05:27:31.257360+0000","last_unstale":"2024-08-31T05:27:58.502028+0000","last_undegraded":"2024-08-31T05:27:58.502028+0000","last_fullsized":"2024-08-31T05:27:58.502028+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:58:11.249925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"85'7","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:11.583587+0000","last_change":"2024-08-31T05:27:29.392664+0000","last_active":"2024-08-31T05:28:11.583587+0000","last_peered":"2024-08-31T05:28:11.583587+0000","last_clean":"2024-08-31T05:28:11.583587+0000","last_became_active":"2024-08-31T05:27:29.392208+0000","last_became_peered":"2024-08-31T05:27:29.392208+0000","last_unstale":"2024-08-31T05:28:11.583587+0000","last_undegraded":"2024-08-31T05:28:11.583587+0000","last_fullsized":"2024-08-31T05:28:11.583587+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:51:34.981168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.502593+0000","last_change":"2024-08-31T05:27:38.293556+0000","last_active":"2024-08-31T05:27:58.502593+0000","last_peered":"2024-08-31T05:27:58.502593+0000","last_clean":"2024-08-31T05:27:58.502593+0000","last_became_active":"2024-08-31T05:27:38.292338+0000","last_became_peered":"2024-08-31T05:27:38.292338+0000","last_unstale":"2024-08-31T05:27:58.502593+0000","last_undegraded":"2024-08-31T05:27:58.502593+0000","last_fullsized":"2024-08-31T05:27:58.502593+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:13:46.376934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.502564+0000","last_change":"2024-08-31T05:27:31.247408+0000","last_active":"2024-08-31T05:27:58.502564+0000","last_peered":"2024-08-31T05:27:58.502564+0000","last_clean":"2024-08-31T05:27:58.502564+0000","last_became_active":"2024-08-31T05:27:31.247034+0000","last_became_peered":"2024-08-31T05:27:31.247034+0000","last_unstale":"2024-08-31T05:27:58.502564+0000","last_undegraded":"2024-08-31T05:27:58.502564+0000","last_fullsized":"2024-08-31T05:27:58.502564+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:42:08.350054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"85'14","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:25.264098+0000","last_change":"2024-08-31T05:27:29.235941+0000","last_active":"2024-08-31T05:28:25.264098+0000","last_peered":"2024-08-31T05:28:25.264098+0000","last_clean":"2024-08-31T05:28:25.264098+0000","last_became_active":"2024-08-31T05:27:29.235561+0000","last_became_peered":"2024-08-31T05:27:29.235561+0000","last_unstale":"2024-08-31T05:28:25.264098+0000","last_undegraded":"2024-08-31T05:28:25.264098+0000","last_fullsized":"2024-08-31T05:28:25.264098+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:29:34.551748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.500705+0000","last_change":"2024-08-31T05:27:38.286960+0000","last_active":"2024-08-31T05:27:58.500705+0000","last_peered":"2024-08-31T05:27:58.500705+0000","last_clean":"2024-08-31T05:27:58.500705+0000","last_became_active":"2024-08-31T05:27:38.286537+0000","last_became_peered":"2024-08-31T05:27:38.286537+0000","last_unstale":"2024-08-31T05:27:58.500705+0000","last_undegraded":"2024-08-31T05:27:58.500705+0000","last_fullsized":"2024-08-31T05:27:58.500705+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:55:00.656676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.497681+0000","last_change":"2024-08-31T05:27:31.245901+0000","last_active":"2024-08-31T05:27:58.497681+0000","last_peered":"2024-08-31T05:27:58.497681+0000","last_clean":"2024-08-31T05:27:58.497681+0000","last_became_active":"2024-08-31T05:27:31.245534+0000","last_became_peered":"2024-08-31T05:27:31.245534+0000","last_unstale":"2024-08-31T05:27:58.497681+0000","last_undegraded":"2024-08-31T05:27:58.497681+0000","last_fullsized":"2024-08-31T05:27:58.497681+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:26:35.876033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"85'4","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:11.585075+0000","last_change":"2024-08-31T05:27:29.280767+0000","last_active":"2024-08-31T05:28:11.585075+0000","last_peered":"2024-08-31T05:28:11.585075+0000","last_clean":"2024-08-31T05:28:11.585075+0000","last_became_active":"2024-08-31T05:27:29.280334+0000","last_became_peered":"2024-08-31T05:27:29.280334+0000","last_unstale":"2024-08-31T05:28:11.585075+0000","last_undegraded":"2024-08-31T05:28:11.585075+0000","last_fullsized":"2024-08-31T05:28:11.585075+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:25:20.250205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.503220+0000","last_change":"2024-08-31T05:27:38.296846+0000","last_active":"2024-08-31T05:27:58.503220+0000","last_peered":"2024-08-31T05:27:58.503220+0000","last_clean":"2024-08-31T05:27:58.503220+0000","last_became_active":"2024-08-31T05:27:38.295516+0000","last_became_peered":"2024-08-31T05:27:38.295516+0000","last_unstale":"2024-08-31T05:27:58.503220+0000","last_undegraded":"2024-08-31T05:27:58.503220+0000","last_fullsized":"2024-08-31T05:27:58.503220+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:30:51.110144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.498789+0000","last_change":"2024-08-31T05:27:31.246481+0000","last_active":"2024-08-31T05:27:58.498789+0000","last_peered":"2024-08-31T05:27:58.498789+0000","last_clean":"2024-08-31T05:27:58.498789+0000","last_became_active":"2024-08-31T05:27:31.246079+0000","last_became_peered":"2024-08-31T05:27:31.246079+0000","last_unstale":"2024-08-31T05:27:58.498789+0000","last_undegraded":"2024-08-31T05:27:58.498789+0000","last_fullsized":"2024-08-31T05:27:58.498789+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:25:42.536251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"85'1","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.503218+0000","last_change":"2024-08-31T05:27:29.281078+0000","last_active":"2024-08-31T05:27:58.503218+0000","last_peered":"2024-08-31T05:27:58.503218+0000","last_clean":"2024-08-31T05:27:58.503218+0000","last_became_active":"2024-08-31T05:27:29.280674+0000","last_became_peered":"2024-08-31T05:27:29.280674+0000","last_unstale":"2024-08-31T05:27:58.503218+0000","last_undegraded":"2024-08-31T05:27:58.503218+0000","last_fullsized":"2024-08-31T05:27:58.503218+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:04:03.576077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.506060+0000","last_change":"2024-08-31T05:27:38.289472+0000","last_active":"2024-08-31T05:27:58.506060+0000","last_peered":"2024-08-31T05:27:58.506060+0000","last_clean":"2024-08-31T05:27:58.506060+0000","last_became_active":"2024-08-31T05:27:38.289003+0000","last_became_peered":"2024-08-31T05:27:38.289003+0000","last_unstale":"2024-08-31T05:27:58.506060+0000","last_undegraded":"2024-08-31T05:27:58.506060+0000","last_fullsized":"2024-08-31T05:27:58.506060+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:38:37.621451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.498569+0000","last_change":"2024-08-31T05:27:31.251011+0000","last_active":"2024-08-31T05:27:58.498569+0000","last_peered":"2024-08-31T05:27:58.498569+0000","last_clean":"2024-08-31T05:27:58.498569+0000","last_became_active":"2024-08-31T05:27:31.250597+0000","last_became_peered":"2024-08-31T05:27:31.250597+0000","last_unstale":"2024-08-31T05:27:58.498569+0000","last_undegraded":"2024-08-31T05:27:58.498569+0000","last_fullsized":"2024-08-31T05:27:58.498569+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:13:30.858395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'6","reported_seq":56,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:23.604129+0000","last_change":"2024-08-31T05:27:29.242137+0000","last_active":"2024-08-31T05:28:23.604129+0000","last_peered":"2024-08-31T05:28:23.604129+0000","last_clean":"2024-08-31T05:28:23.604129+0000","last_became_active":"2024-08-31T05:27:29.241460+0000","last_became_peered":"2024-08-31T05:27:29.241460+0000","last_unstale":"2024-08-31T05:28:23.604129+0000","last_undegraded":"2024-08-31T05:28:23.604129+0000","last_fullsized":"2024-08-31T05:28:23.604129+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:40:59.174572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.497475+0000","last_change":"2024-08-31T05:27:38.288643+0000","last_active":"2024-08-31T05:27:58.497475+0000","last_peered":"2024-08-31T05:27:58.497475+0000","last_clean":"2024-08-31T05:27:58.497475+0000","last_became_active":"2024-08-31T05:27:38.288235+0000","last_became_peered":"2024-08-31T05:27:38.288235+0000","last_unstale":"2024-08-31T05:27:58.497475+0000","last_undegraded":"2024-08-31T05:27:58.497475+0000","last_fullsized":"2024-08-31T05:27:58.497475+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:23:49.090990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.498712+0000","last_change":"2024-08-31T05:27:31.263326+0000","last_active":"2024-08-31T05:27:58.498712+0000","last_peered":"2024-08-31T05:27:58.498712+0000","last_clean":"2024-08-31T05:27:58.498712+0000","last_became_active":"2024-08-31T05:27:31.262864+0000","last_became_peered":"2024-08-31T05:27:31.262864+0000","last_unstale":"2024-08-31T05:27:58.498712+0000","last_undegraded":"2024-08-31T05:27:58.498712+0000","last_fullsized":"2024-08-31T05:27:58.498712+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:34:21.159545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'5","reported_seq":58,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:27.609647+0000","last_change":"2024-08-31T05:27:29.280829+0000","last_active":"2024-08-31T05:28:27.609647+0000","last_peered":"2024-08-31T05:28:27.609647+0000","last_clean":"2024-08-31T05:28:27.609647+0000","last_became_active":"2024-08-31T05:27:29.280469+0000","last_became_peered":"2024-08-31T05:27:29.280469+0000","last_unstale":"2024-08-31T05:28:27.609647+0000","last_undegraded":"2024-08-31T05:28:27.609647+0000","last_fullsized":"2024-08-31T05:28:27.609647+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:16:59.559680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.497762+0000","last_change":"2024-08-31T05:27:38.290175+0000","last_active":"2024-08-31T05:27:58.497762+0000","last_peered":"2024-08-31T05:27:58.497762+0000","last_clean":"2024-08-31T05:27:58.497762+0000","last_became_active":"2024-08-31T05:27:38.289228+0000","last_became_peered":"2024-08-31T05:27:38.289228+0000","last_unstale":"2024-08-31T05:27:58.497762+0000","last_undegraded":"2024-08-31T05:27:58.497762+0000","last_fullsized":"2024-08-31T05:27:58.497762+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:26:07.251711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.497105+0000","last_change":"2024-08-31T05:27:31.245446+0000","last_active":"2024-08-31T05:27:58.497105+0000","last_peered":"2024-08-31T05:27:58.497105+0000","last_clean":"2024-08-31T05:27:58.497105+0000","last_became_active":"2024-08-31T05:27:31.245099+0000","last_became_peered":"2024-08-31T05:27:31.245099+0000","last_unstale":"2024-08-31T05:27:58.497105+0000","last_undegraded":"2024-08-31T05:27:58.497105+0000","last_fullsized":"2024-08-31T05:27:58.497105+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:18:17.876796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'4","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:09.567528+0000","last_change":"2024-08-31T05:27:29.241333+0000","last_active":"2024-08-31T05:28:09.567528+0000","last_peered":"2024-08-31T05:28:09.567528+0000","last_clean":"2024-08-31T05:28:09.567528+0000","last_became_active":"2024-08-31T05:27:29.240963+0000","last_became_peered":"2024-08-31T05:27:29.240963+0000","last_unstale":"2024-08-31T05:28:09.567528+0000","last_undegraded":"2024-08-31T05:28:09.567528+0000","last_fullsized":"2024-08-31T05:28:09.567528+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:22:06.442824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.499090+0000","last_change":"2024-08-31T05:27:38.287640+0000","last_active":"2024-08-31T05:27:58.499090+0000","last_peered":"2024-08-31T05:27:58.499090+0000","last_clean":"2024-08-31T05:27:58.499090+0000","last_became_active":"2024-08-31T05:27:38.286191+0000","last_became_peered":"2024-08-31T05:27:38.286191+0000","last_unstale":"2024-08-31T05:27:58.499090+0000","last_undegraded":"2024-08-31T05:27:58.499090+0000","last_fullsized":"2024-08-31T05:27:58.499090+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:57:23.535841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.507530+0000","last_change":"2024-08-31T05:27:58.506945+0000","last_active":"2024-08-31T05:27:58.507530+0000","last_peered":"2024-08-31T05:27:58.507530+0000","last_clean":"2024-08-31T05:27:58.507530+0000","last_became_active":"2024-08-31T05:27:58.506505+0000","last_became_peered":"2024-08-31T05:27:58.506505+0000","last_unstale":"2024-08-31T05:27:58.507530+0000","last_undegraded":"2024-08-31T05:27:58.507530+0000","last_fullsized":"2024-08-31T05:27:58.507530+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:16:09.541579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"85'6","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:12.585201+0000","last_change":"2024-08-31T05:27:29.238351+0000","last_active":"2024-08-31T05:28:12.585201+0000","last_peered":"2024-08-31T05:28:12.585201+0000","last_clean":"2024-08-31T05:28:12.585201+0000","last_became_active":"2024-08-31T05:27:29.237940+0000","last_became_peered":"2024-08-31T05:27:29.237940+0000","last_unstale":"2024-08-31T05:28:12.585201+0000","last_undegraded":"2024-08-31T05:28:12.585201+0000","last_fullsized":"2024-08-31T05:28:12.585201+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:55:08.048966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":109,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.501784+0000","last_change":"2024-08-31T05:26:14.183718+0000","last_active":"2024-08-31T05:27:58.501784+0000","last_peered":"2024-08-31T05:27:58.501784+0000","last_clean":"2024-08-31T05:27:58.501784+0000","last_became_active":"2024-08-31T05:26:14.178188+0000","last_became_peered":"2024-08-31T05:26:14.178188+0000","last_unstale":"2024-08-31T05:27:58.501784+0000","last_undegraded":"2024-08-31T05:27:58.501784+0000","last_fullsized":"2024-08-31T05:27:58.501784+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:22:50.516233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:22:50.516233+0000","last_clean_scrub_stamp":"2024-08-31T05:22:50.516233+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:10:01.719715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"85'1","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.501132+0000","last_change":"2024-08-31T05:27:38.289721+0000","last_active":"2024-08-31T05:27:58.501132+0000","last_peered":"2024-08-31T05:27:58.501132+0000","last_clean":"2024-08-31T05:27:58.501132+0000","last_became_active":"2024-08-31T05:27:38.289165+0000","last_became_peered":"2024-08-31T05:27:38.289165+0000","last_unstale":"2024-08-31T05:27:58.501132+0000","last_undegraded":"2024-08-31T05:27:58.501132+0000","last_fullsized":"2024-08-31T05:27:58.501132+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:00:30.689093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.501497+0000","last_change":"2024-08-31T05:27:31.256262+0000","last_active":"2024-08-31T05:27:58.501497+0000","last_peered":"2024-08-31T05:27:58.501497+0000","last_clean":"2024-08-31T05:27:58.501497+0000","last_became_active":"2024-08-31T05:27:31.255644+0000","last_became_peered":"2024-08-31T05:27:31.255644+0000","last_unstale":"2024-08-31T05:27:58.501497+0000","last_undegraded":"2024-08-31T05:27:58.501497+0000","last_fullsized":"2024-08-31T05:27:58.501497+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:50:18.158645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'5","reported_seq":59,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:27.626330+0000","last_change":"2024-08-31T05:27:29.392666+0000","last_active":"2024-08-31T05:28:27.626330+0000","last_peered":"2024-08-31T05:28:27.626330+0000","last_clean":"2024-08-31T05:28:27.626330+0000","last_became_active":"2024-08-31T05:27:29.392153+0000","last_became_peered":"2024-08-31T05:27:29.392153+0000","last_unstale":"2024-08-31T05:28:27.626330+0000","last_undegraded":"2024-08-31T05:28:27.626330+0000","last_fullsized":"2024-08-31T05:28:27.626330+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:53:02.713022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.503095+0000","last_change":"2024-08-31T05:27:38.291459+0000","last_active":"2024-08-31T05:27:58.503095+0000","last_peered":"2024-08-31T05:27:58.503095+0000","last_clean":"2024-08-31T05:27:58.503095+0000","last_became_active":"2024-08-31T05:27:38.291013+0000","last_became_peered":"2024-08-31T05:27:38.291013+0000","last_unstale":"2024-08-31T05:27:58.503095+0000","last_undegraded":"2024-08-31T05:27:58.503095+0000","last_fullsized":"2024-08-31T05:27:58.503095+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:03:46.921137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.500800+0000","last_change":"2024-08-31T05:27:31.251641+0000","last_active":"2024-08-31T05:27:58.500800+0000","last_peered":"2024-08-31T05:27:58.500800+0000","last_clean":"2024-08-31T05:27:58.500800+0000","last_became_active":"2024-08-31T05:27:31.251242+0000","last_became_peered":"2024-08-31T05:27:31.251242+0000","last_unstale":"2024-08-31T05:27:58.500800+0000","last_undegraded":"2024-08-31T05:27:58.500800+0000","last_fullsized":"2024-08-31T05:27:58.500800+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:13:58.227136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'3","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:11.584688+0000","last_change":"2024-08-31T05:27:29.238028+0000","last_active":"2024-08-31T05:28:11.584688+0000","last_peered":"2024-08-31T05:28:11.584688+0000","last_clean":"2024-08-31T05:28:11.584688+0000","last_became_active":"2024-08-31T05:27:29.237449+0000","last_became_peered":"2024-08-31T05:27:29.237449+0000","last_unstale":"2024-08-31T05:28:11.584688+0000","last_undegraded":"2024-08-31T05:28:11.584688+0000","last_fullsized":"2024-08-31T05:28:11.584688+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:13:15.447707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.501844+0000","last_change":"2024-08-31T05:27:38.294072+0000","last_active":"2024-08-31T05:27:58.501844+0000","last_peered":"2024-08-31T05:27:58.501844+0000","last_clean":"2024-08-31T05:27:58.501844+0000","last_became_active":"2024-08-31T05:27:38.293642+0000","last_became_peered":"2024-08-31T05:27:38.293642+0000","last_unstale":"2024-08-31T05:27:58.501844+0000","last_undegraded":"2024-08-31T05:27:58.501844+0000","last_fullsized":"2024-08-31T05:27:58.501844+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:57:41.854799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.501492+0000","last_change":"2024-08-31T05:27:31.253601+0000","last_active":"2024-08-31T05:27:58.501492+0000","last_peered":"2024-08-31T05:27:58.501492+0000","last_clean":"2024-08-31T05:27:58.501492+0000","last_became_active":"2024-08-31T05:27:31.253216+0000","last_became_peered":"2024-08-31T05:27:31.253216+0000","last_unstale":"2024-08-31T05:27:58.501492+0000","last_undegraded":"2024-08-31T05:27:58.501492+0000","last_fullsized":"2024-08-31T05:27:58.501492+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:46:12.757944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'5","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:11.585308+0000","last_change":"2024-08-31T05:27:29.236851+0000","last_active":"2024-08-31T05:28:11.585308+0000","last_peered":"2024-08-31T05:28:11.585308+0000","last_clean":"2024-08-31T05:28:11.585308+0000","last_became_active":"2024-08-31T05:27:29.236473+0000","last_became_peered":"2024-08-31T05:27:29.236473+0000","last_unstale":"2024-08-31T05:28:11.585308+0000","last_undegraded":"2024-08-31T05:28:11.585308+0000","last_fullsized":"2024-08-31T05:28:11.585308+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:01:23.838417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.498386+0000","last_change":"2024-08-31T05:27:38.290069+0000","last_active":"2024-08-31T05:27:58.498386+0000","last_peered":"2024-08-31T05:27:58.498386+0000","last_clean":"2024-08-31T05:27:58.498386+0000","last_became_active":"2024-08-31T05:27:38.289507+0000","last_became_peered":"2024-08-31T05:27:38.289507+0000","last_unstale":"2024-08-31T05:27:58.498386+0000","last_undegraded":"2024-08-31T05:27:58.498386+0000","last_fullsized":"2024-08-31T05:27:58.498386+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:24:33.326308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.503496+0000","last_change":"2024-08-31T05:27:31.252787+0000","last_active":"2024-08-31T05:27:58.503496+0000","last_peered":"2024-08-31T05:27:58.503496+0000","last_clean":"2024-08-31T05:27:58.503496+0000","last_became_active":"2024-08-31T05:27:31.252392+0000","last_became_peered":"2024-08-31T05:27:31.252392+0000","last_unstale":"2024-08-31T05:27:58.503496+0000","last_undegraded":"2024-08-31T05:27:58.503496+0000","last_fullsized":"2024-08-31T05:27:58.503496+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:47:06.613616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:10.561782+0000","last_change":"2024-08-31T05:27:29.240293+0000","last_active":"2024-08-31T05:28:10.561782+0000","last_peered":"2024-08-31T05:28:10.561782+0000","last_clean":"2024-08-31T05:28:10.561782+0000","last_became_active":"2024-08-31T05:27:29.239889+0000","last_became_peered":"2024-08-31T05:27:29.239889+0000","last_unstale":"2024-08-31T05:28:10.561782+0000","last_undegraded":"2024-08-31T05:28:10.561782+0000","last_fullsized":"2024-08-31T05:28:10.561782+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:55:03.524475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.498634+0000","last_change":"2024-08-31T05:27:38.290715+0000","last_active":"2024-08-31T05:27:58.498634+0000","last_peered":"2024-08-31T05:27:58.498634+0000","last_clean":"2024-08-31T05:27:58.498634+0000","last_became_active":"2024-08-31T05:27:38.290227+0000","last_became_peered":"2024-08-31T05:27:38.290227+0000","last_unstale":"2024-08-31T05:27:58.498634+0000","last_undegraded":"2024-08-31T05:27:58.498634+0000","last_fullsized":"2024-08-31T05:27:58.498634+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:09:38.349046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.498825+0000","last_change":"2024-08-31T05:27:31.265672+0000","last_active":"2024-08-31T05:27:58.498825+0000","last_peered":"2024-08-31T05:27:58.498825+0000","last_clean":"2024-08-31T05:27:58.498825+0000","last_became_active":"2024-08-31T05:27:31.265332+0000","last_became_peered":"2024-08-31T05:27:31.265332+0000","last_unstale":"2024-08-31T05:27:58.498825+0000","last_undegraded":"2024-08-31T05:27:58.498825+0000","last_fullsized":"2024-08-31T05:27:58.498825+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:45:01.868256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"85'17","reported_seq":53,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:11.582670+0000","last_change":"2024-08-31T05:27:29.281129+0000","last_active":"2024-08-31T05:28:11.582670+0000","last_peered":"2024-08-31T05:28:11.582670+0000","last_clean":"2024-08-31T05:28:11.582670+0000","last_became_active":"2024-08-31T05:27:29.280613+0000","last_became_peered":"2024-08-31T05:27:29.280613+0000","last_unstale":"2024-08-31T05:28:11.582670+0000","last_undegraded":"2024-08-31T05:28:11.582670+0000","last_fullsized":"2024-08-31T05:28:11.582670+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:17:28.103371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.497664+0000","last_change":"2024-08-31T05:27:38.293492+0000","last_active":"2024-08-31T05:27:58.497664+0000","last_peered":"2024-08-31T05:27:58.497664+0000","last_clean":"2024-08-31T05:27:58.497664+0000","last_became_active":"2024-08-31T05:27:38.293072+0000","last_became_peered":"2024-08-31T05:27:38.293072+0000","last_unstale":"2024-08-31T05:27:58.497664+0000","last_undegraded":"2024-08-31T05:27:58.497664+0000","last_fullsized":"2024-08-31T05:27:58.497664+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:20:21.438948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.505616+0000","last_change":"2024-08-31T05:27:58.505480+0000","last_active":"2024-08-31T05:27:58.505616+0000","last_peered":"2024-08-31T05:27:58.505616+0000","last_clean":"2024-08-31T05:27:58.505616+0000","last_became_active":"2024-08-31T05:27:58.504773+0000","last_became_peered":"2024-08-31T05:27:58.504773+0000","last_unstale":"2024-08-31T05:27:58.505616+0000","last_undegraded":"2024-08-31T05:27:58.505616+0000","last_fullsized":"2024-08-31T05:27:58.505616+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:48:59.979443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'5","reported_seq":59,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:27.610363+0000","last_change":"2024-08-31T05:27:29.239308+0000","last_active":"2024-08-31T05:28:27.610363+0000","last_peered":"2024-08-31T05:28:27.610363+0000","last_clean":"2024-08-31T05:28:27.610363+0000","last_became_active":"2024-08-31T05:27:29.238793+0000","last_became_peered":"2024-08-31T05:27:29.238793+0000","last_unstale":"2024-08-31T05:28:27.610363+0000","last_undegraded":"2024-08-31T05:28:27.610363+0000","last_fullsized":"2024-08-31T05:28:27.610363+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:20:47.837021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.503153+0000","last_change":"2024-08-31T05:27:38.287260+0000","last_active":"2024-08-31T05:27:58.503153+0000","last_peered":"2024-08-31T05:27:58.503153+0000","last_clean":"2024-08-31T05:27:58.503153+0000","last_became_active":"2024-08-31T05:27:38.286250+0000","last_became_peered":"2024-08-31T05:27:38.286250+0000","last_unstale":"2024-08-31T05:27:58.503153+0000","last_undegraded":"2024-08-31T05:27:58.503153+0000","last_fullsized":"2024-08-31T05:27:58.503153+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:17:55.530114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.501008+0000","last_change":"2024-08-31T05:27:31.251152+0000","last_active":"2024-08-31T05:27:58.501008+0000","last_peered":"2024-08-31T05:27:58.501008+0000","last_clean":"2024-08-31T05:27:58.501008+0000","last_became_active":"2024-08-31T05:27:31.250686+0000","last_became_peered":"2024-08-31T05:27:31.250686+0000","last_unstale":"2024-08-31T05:27:58.501008+0000","last_undegraded":"2024-08-31T05:27:58.501008+0000","last_fullsized":"2024-08-31T05:27:58.501008+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:03:37.359332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"85'5","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:11.583460+0000","last_change":"2024-08-31T05:27:29.237404+0000","last_active":"2024-08-31T05:28:11.583460+0000","last_peered":"2024-08-31T05:28:11.583460+0000","last_clean":"2024-08-31T05:28:11.583460+0000","last_became_active":"2024-08-31T05:27:29.236695+0000","last_became_peered":"2024-08-31T05:27:29.236695+0000","last_unstale":"2024-08-31T05:28:11.583460+0000","last_undegraded":"2024-08-31T05:28:11.583460+0000","last_fullsized":"2024-08-31T05:28:11.583460+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:25:05.174288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.503098+0000","last_change":"2024-08-31T05:27:38.296553+0000","last_active":"2024-08-31T05:27:58.503098+0000","last_peered":"2024-08-31T05:27:58.503098+0000","last_clean":"2024-08-31T05:27:58.503098+0000","last_became_active":"2024-08-31T05:27:38.296118+0000","last_became_peered":"2024-08-31T05:27:38.296118+0000","last_unstale":"2024-08-31T05:27:58.503098+0000","last_undegraded":"2024-08-31T05:27:58.503098+0000","last_fullsized":"2024-08-31T05:27:58.503098+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:10:41.334260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.497316+0000","last_change":"2024-08-31T05:27:31.250584+0000","last_active":"2024-08-31T05:27:58.497316+0000","last_peered":"2024-08-31T05:27:58.497316+0000","last_clean":"2024-08-31T05:27:58.497316+0000","last_became_active":"2024-08-31T05:27:31.250234+0000","last_became_peered":"2024-08-31T05:27:31.250234+0000","last_unstale":"2024-08-31T05:27:58.497316+0000","last_undegraded":"2024-08-31T05:27:58.497316+0000","last_fullsized":"2024-08-31T05:27:58.497316+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:00:39.648236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"85'9","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:12.584354+0000","last_change":"2024-08-31T05:27:29.237956+0000","last_active":"2024-08-31T05:28:12.584354+0000","last_peered":"2024-08-31T05:28:12.584354+0000","last_clean":"2024-08-31T05:28:12.584354+0000","last_became_active":"2024-08-31T05:27:29.237510+0000","last_became_peered":"2024-08-31T05:27:29.237510+0000","last_unstale":"2024-08-31T05:28:12.584354+0000","last_undegraded":"2024-08-31T05:28:12.584354+0000","last_fullsized":"2024-08-31T05:28:12.584354+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:18:44.295298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.499168+0000","last_change":"2024-08-31T05:27:38.289472+0000","last_active":"2024-08-31T05:27:58.499168+0000","last_peered":"2024-08-31T05:27:58.499168+0000","last_clean":"2024-08-31T05:27:58.499168+0000","last_became_active":"2024-08-31T05:27:38.288809+0000","last_became_peered":"2024-08-31T05:27:38.288809+0000","last_unstale":"2024-08-31T05:27:58.499168+0000","last_undegraded":"2024-08-31T05:27:58.499168+0000","last_fullsized":"2024-08-31T05:27:58.499168+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:17:06.430110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.506843+0000","last_change":"2024-08-31T05:27:31.258103+0000","last_active":"2024-08-31T05:27:58.506843+0000","last_peered":"2024-08-31T05:27:58.506843+0000","last_clean":"2024-08-31T05:27:58.506843+0000","last_became_active":"2024-08-31T05:27:31.257257+0000","last_became_peered":"2024-08-31T05:27:31.257257+0000","last_unstale":"2024-08-31T05:27:58.506843+0000","last_undegraded":"2024-08-31T05:27:58.506843+0000","last_fullsized":"2024-08-31T05:27:58.506843+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:16:01.309646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"85'32","reported_seq":106,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:27.613448+0000","last_change":"2024-08-31T05:27:29.241129+0000","last_active":"2024-08-31T05:28:27.613448+0000","last_peered":"2024-08-31T05:28:27.613448+0000","last_clean":"2024-08-31T05:28:27.613448+0000","last_became_active":"2024-08-31T05:27:29.240708+0000","last_became_peered":"2024-08-31T05:27:29.240708+0000","last_unstale":"2024-08-31T05:28:27.613448+0000","last_undegraded":"2024-08-31T05:28:27.613448+0000","last_fullsized":"2024-08-31T05:28:27.613448+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:20:10.127588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56669,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":39,"num_read_kb":75,"num_write":34,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.501066+0000","last_change":"2024-08-31T05:27:38.291037+0000","last_active":"2024-08-31T05:27:58.501066+0000","last_peered":"2024-08-31T05:27:58.501066+0000","last_clean":"2024-08-31T05:27:58.501066+0000","last_became_active":"2024-08-31T05:27:38.290592+0000","last_became_peered":"2024-08-31T05:27:38.290592+0000","last_unstale":"2024-08-31T05:27:58.501066+0000","last_undegraded":"2024-08-31T05:27:58.501066+0000","last_fullsized":"2024-08-31T05:27:58.501066+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:12:56.391784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.508515+0000","last_change":"2024-08-31T05:27:58.508403+0000","last_active":"2024-08-31T05:27:58.508515+0000","last_peered":"2024-08-31T05:27:58.508515+0000","last_clean":"2024-08-31T05:27:58.508515+0000","last_became_active":"2024-08-31T05:27:58.507918+0000","last_became_peered":"2024-08-31T05:27:58.507918+0000","last_unstale":"2024-08-31T05:27:58.508515+0000","last_undegraded":"2024-08-31T05:27:58.508515+0000","last_fullsized":"2024-08-31T05:27:58.508515+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:47:54.479249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,7],"acting":[1,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"85'5","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:10.572604+0000","last_change":"2024-08-31T05:27:29.281231+0000","last_active":"2024-08-31T05:28:10.572604+0000","last_peered":"2024-08-31T05:28:10.572604+0000","last_clean":"2024-08-31T05:28:10.572604+0000","last_became_active":"2024-08-31T05:27:29.280748+0000","last_became_peered":"2024-08-31T05:27:29.280748+0000","last_unstale":"2024-08-31T05:28:10.572604+0000","last_undegraded":"2024-08-31T05:28:10.572604+0000","last_fullsized":"2024-08-31T05:28:10.572604+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:43:44.783595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.650871+0000","last_change":"2024-08-31T05:27:38.300988+0000","last_active":"2024-08-31T05:27:58.650871+0000","last_peered":"2024-08-31T05:27:58.650871+0000","last_clean":"2024-08-31T05:27:58.650871+0000","last_became_active":"2024-08-31T05:27:38.299938+0000","last_became_peered":"2024-08-31T05:27:38.299938+0000","last_unstale":"2024-08-31T05:27:58.650871+0000","last_undegraded":"2024-08-31T05:27:58.650871+0000","last_fullsized":"2024-08-31T05:27:58.650871+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:25:45.721711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.502349+0000","last_change":"2024-08-31T05:27:31.258030+0000","last_active":"2024-08-31T05:27:58.502349+0000","last_peered":"2024-08-31T05:27:58.502349+0000","last_clean":"2024-08-31T05:27:58.502349+0000","last_became_active":"2024-08-31T05:27:31.257410+0000","last_became_peered":"2024-08-31T05:27:31.257410+0000","last_unstale":"2024-08-31T05:27:58.502349+0000","last_undegraded":"2024-08-31T05:27:58.502349+0000","last_fullsized":"2024-08-31T05:27:58.502349+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:48:27.716531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"85'4","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:11.584450+0000","last_change":"2024-08-31T05:27:29.239560+0000","last_active":"2024-08-31T05:28:11.584450+0000","last_peered":"2024-08-31T05:28:11.584450+0000","last_clean":"2024-08-31T05:28:11.584450+0000","last_became_active":"2024-08-31T05:27:29.239154+0000","last_became_peered":"2024-08-31T05:27:29.239154+0000","last_unstale":"2024-08-31T05:28:11.584450+0000","last_undegraded":"2024-08-31T05:28:11.584450+0000","last_fullsized":"2024-08-31T05:28:11.584450+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:29:36.983690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.500488+0000","last_change":"2024-08-31T05:27:38.297596+0000","last_active":"2024-08-31T05:27:58.500488+0000","last_peered":"2024-08-31T05:27:58.500488+0000","last_clean":"2024-08-31T05:27:58.500488+0000","last_became_active":"2024-08-31T05:27:38.295127+0000","last_became_peered":"2024-08-31T05:27:38.295127+0000","last_unstale":"2024-08-31T05:27:58.500488+0000","last_undegraded":"2024-08-31T05:27:58.500488+0000","last_fullsized":"2024-08-31T05:27:58.500488+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:50:09.363872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.503636+0000","last_change":"2024-08-31T05:27:31.262036+0000","last_active":"2024-08-31T05:27:58.503636+0000","last_peered":"2024-08-31T05:27:58.503636+0000","last_clean":"2024-08-31T05:27:58.503636+0000","last_became_active":"2024-08-31T05:27:31.261589+0000","last_became_peered":"2024-08-31T05:27:31.261589+0000","last_unstale":"2024-08-31T05:27:58.503636+0000","last_undegraded":"2024-08-31T05:27:58.503636+0000","last_fullsized":"2024-08-31T05:27:58.503636+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:24:17.677639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"85'4","reported_seq":71,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:27.611393+0000","last_change":"2024-08-31T05:27:29.233381+0000","last_active":"2024-08-31T05:28:27.611393+0000","last_peered":"2024-08-31T05:28:27.611393+0000","last_clean":"2024-08-31T05:28:27.611393+0000","last_became_active":"2024-08-31T05:27:29.232959+0000","last_became_peered":"2024-08-31T05:27:29.232959+0000","last_unstale":"2024-08-31T05:28:27.611393+0000","last_undegraded":"2024-08-31T05:28:27.611393+0000","last_fullsized":"2024-08-31T05:28:27.611393+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:50:16.901373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.501117+0000","last_change":"2024-08-31T05:27:38.288798+0000","last_active":"2024-08-31T05:27:58.501117+0000","last_peered":"2024-08-31T05:27:58.501117+0000","last_clean":"2024-08-31T05:27:58.501117+0000","last_became_active":"2024-08-31T05:27:38.288369+0000","last_became_peered":"2024-08-31T05:27:38.288369+0000","last_unstale":"2024-08-31T05:27:58.501117+0000","last_undegraded":"2024-08-31T05:27:58.501117+0000","last_fullsized":"2024-08-31T05:27:58.501117+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:52:45.680480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.501801+0000","last_change":"2024-08-31T05:27:38.290029+0000","last_active":"2024-08-31T05:27:58.501801+0000","last_peered":"2024-08-31T05:27:58.501801+0000","last_clean":"2024-08-31T05:27:58.501801+0000","last_became_active":"2024-08-31T05:27:38.289638+0000","last_became_peered":"2024-08-31T05:27:38.289638+0000","last_unstale":"2024-08-31T05:27:58.501801+0000","last_undegraded":"2024-08-31T05:27:58.501801+0000","last_fullsized":"2024-08-31T05:27:58.501801+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:10:34.521418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.501222+0000","last_change":"2024-08-31T05:27:31.241057+0000","last_active":"2024-08-31T05:27:58.501222+0000","last_peered":"2024-08-31T05:27:58.501222+0000","last_clean":"2024-08-31T05:27:58.501222+0000","last_became_active":"2024-08-31T05:27:31.240660+0000","last_became_peered":"2024-08-31T05:27:31.240660+0000","last_unstale":"2024-08-31T05:27:58.501222+0000","last_undegraded":"2024-08-31T05:27:58.501222+0000","last_fullsized":"2024-08-31T05:27:58.501222+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:16:49.730980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"85'3","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:11.583067+0000","last_change":"2024-08-31T05:27:29.240293+0000","last_active":"2024-08-31T05:28:11.583067+0000","last_peered":"2024-08-31T05:28:11.583067+0000","last_clean":"2024-08-31T05:28:11.583067+0000","last_became_active":"2024-08-31T05:27:29.239889+0000","last_became_peered":"2024-08-31T05:27:29.239889+0000","last_unstale":"2024-08-31T05:28:11.583067+0000","last_undegraded":"2024-08-31T05:28:11.583067+0000","last_fullsized":"2024-08-31T05:28:11.583067+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:20:49.121008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.503585+0000","last_change":"2024-08-31T05:27:38.294174+0000","last_active":"2024-08-31T05:27:58.503585+0000","last_peered":"2024-08-31T05:27:58.503585+0000","last_clean":"2024-08-31T05:27:58.503585+0000","last_became_active":"2024-08-31T05:27:38.293747+0000","last_became_peered":"2024-08-31T05:27:38.293747+0000","last_unstale":"2024-08-31T05:27:58.503585+0000","last_undegraded":"2024-08-31T05:27:58.503585+0000","last_fullsized":"2024-08-31T05:27:58.503585+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:35:46.124473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.500916+0000","last_change":"2024-08-31T05:27:31.244942+0000","last_active":"2024-08-31T05:27:58.500916+0000","last_peered":"2024-08-31T05:27:58.500916+0000","last_clean":"2024-08-31T05:27:58.500916+0000","last_became_active":"2024-08-31T05:27:31.244608+0000","last_became_peered":"2024-08-31T05:27:31.244608+0000","last_unstale":"2024-08-31T05:27:58.500916+0000","last_undegraded":"2024-08-31T05:27:58.500916+0000","last_fullsized":"2024-08-31T05:27:58.500916+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:50:13.651172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"85'3","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:09.567463+0000","last_change":"2024-08-31T05:27:29.236832+0000","last_active":"2024-08-31T05:28:09.567463+0000","last_peered":"2024-08-31T05:28:09.567463+0000","last_clean":"2024-08-31T05:28:09.567463+0000","last_became_active":"2024-08-31T05:27:29.236326+0000","last_became_peered":"2024-08-31T05:27:29.236326+0000","last_unstale":"2024-08-31T05:28:09.567463+0000","last_undegraded":"2024-08-31T05:28:09.567463+0000","last_fullsized":"2024-08-31T05:28:09.567463+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:43:26.199499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"85'7","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:10.572578+0000","last_change":"2024-08-31T05:27:29.237409+0000","last_active":"2024-08-31T05:28:10.572578+0000","last_peered":"2024-08-31T05:28:10.572578+0000","last_clean":"2024-08-31T05:28:10.572578+0000","last_became_active":"2024-08-31T05:27:29.236928+0000","last_became_peered":"2024-08-31T05:27:29.236928+0000","last_unstale":"2024-08-31T05:28:10.572578+0000","last_undegraded":"2024-08-31T05:28:10.572578+0000","last_fullsized":"2024-08-31T05:28:10.572578+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:07:53.917242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.499005+0000","last_change":"2024-08-31T05:27:31.263005+0000","last_active":"2024-08-31T05:27:58.499005+0000","last_peered":"2024-08-31T05:27:58.499005+0000","last_clean":"2024-08-31T05:27:58.499005+0000","last_became_active":"2024-08-31T05:27:31.262638+0000","last_became_peered":"2024-08-31T05:27:31.262638+0000","last_unstale":"2024-08-31T05:27:58.499005+0000","last_undegraded":"2024-08-31T05:27:58.499005+0000","last_fullsized":"2024-08-31T05:27:58.499005+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:35:06.094346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.502373+0000","last_change":"2024-08-31T05:27:38.293067+0000","last_active":"2024-08-31T05:27:58.502373+0000","last_peered":"2024-08-31T05:27:58.502373+0000","last_clean":"2024-08-31T05:27:58.502373+0000","last_became_active":"2024-08-31T05:27:38.292413+0000","last_became_peered":"2024-08-31T05:27:38.292413+0000","last_unstale":"2024-08-31T05:27:58.502373+0000","last_undegraded":"2024-08-31T05:27:58.502373+0000","last_fullsized":"2024-08-31T05:27:58.502373+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:26:12.248341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"85'6","reported_seq":68,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:28:27.611959+0000","last_change":"2024-08-31T05:27:58.652458+0000","last_active":"2024-08-31T05:28:27.611959+0000","last_peered":"2024-08-31T05:28:27.611959+0000","last_clean":"2024-08-31T05:28:27.611959+0000","last_became_active":"2024-08-31T05:27:58.652037+0000","last_became_peered":"2024-08-31T05:27:58.652037+0000","last_unstale":"2024-08-31T05:28:27.611959+0000","last_undegraded":"2024-08-31T05:28:27.611959+0000","last_fullsized":"2024-08-31T05:28:27.611959+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:44:45.839429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.506170+0000","last_change":"2024-08-31T05:27:31.253835+0000","last_active":"2024-08-31T05:27:58.506170+0000","last_peered":"2024-08-31T05:27:58.506170+0000","last_clean":"2024-08-31T05:27:58.506170+0000","last_became_active":"2024-08-31T05:27:31.252828+0000","last_became_peered":"2024-08-31T05:27:31.252828+0000","last_unstale":"2024-08-31T05:27:58.506170+0000","last_undegraded":"2024-08-31T05:27:58.506170+0000","last_fullsized":"2024-08-31T05:27:58.506170+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:59:29.987345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.501919+0000","last_change":"2024-08-31T05:27:38.292690+0000","last_active":"2024-08-31T05:27:58.501919+0000","last_peered":"2024-08-31T05:27:58.501919+0000","last_clean":"2024-08-31T05:27:58.501919+0000","last_became_active":"2024-08-31T05:27:38.292195+0000","last_became_peered":"2024-08-31T05:27:38.292195+0000","last_unstale":"2024-08-31T05:27:58.501919+0000","last_undegraded":"2024-08-31T05:27:58.501919+0000","last_fullsized":"2024-08-31T05:27:58.501919+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:50:06.142879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.502883+0000","last_change":"2024-08-31T05:27:31.253706+0000","last_active":"2024-08-31T05:27:58.502883+0000","last_peered":"2024-08-31T05:27:58.502883+0000","last_clean":"2024-08-31T05:27:58.502883+0000","last_became_active":"2024-08-31T05:27:31.253343+0000","last_became_peered":"2024-08-31T05:27:31.253343+0000","last_unstale":"2024-08-31T05:27:58.502883+0000","last_undegraded":"2024-08-31T05:27:58.502883+0000","last_fullsized":"2024-08-31T05:27:58.502883+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:40:28.318153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.651816+0000","last_change":"2024-08-31T05:27:58.651669+0000","last_active":"2024-08-31T05:27:58.651816+0000","last_peered":"2024-08-31T05:27:58.651816+0000","last_clean":"2024-08-31T05:27:58.651816+0000","last_became_active":"2024-08-31T05:27:58.651273+0000","last_became_peered":"2024-08-31T05:27:58.651273+0000","last_unstale":"2024-08-31T05:27:58.651816+0000","last_undegraded":"2024-08-31T05:27:58.651816+0000","last_fullsized":"2024-08-31T05:27:58.651816+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:37:42.960124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.501585+0000","last_change":"2024-08-31T05:27:31.257648+0000","last_active":"2024-08-31T05:27:58.501585+0000","last_peered":"2024-08-31T05:27:58.501585+0000","last_clean":"2024-08-31T05:27:58.501585+0000","last_became_active":"2024-08-31T05:27:31.257140+0000","last_became_peered":"2024-08-31T05:27:31.257140+0000","last_unstale":"2024-08-31T05:27:58.501585+0000","last_undegraded":"2024-08-31T05:27:58.501585+0000","last_fullsized":"2024-08-31T05:27:58.501585+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:02:15.249225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.501964+0000","last_change":"2024-08-31T05:27:31.264968+0000","last_active":"2024-08-31T05:27:58.501964+0000","last_peered":"2024-08-31T05:27:58.501964+0000","last_clean":"2024-08-31T05:27:58.501964+0000","last_became_active":"2024-08-31T05:27:31.264629+0000","last_became_peered":"2024-08-31T05:27:31.264629+0000","last_unstale":"2024-08-31T05:27:58.501964+0000","last_undegraded":"2024-08-31T05:27:58.501964+0000","last_fullsized":"2024-08-31T05:27:58.501964+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:28:15.283607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.497542+0000","last_change":"2024-08-31T05:27:31.252358+0000","last_active":"2024-08-31T05:27:58.497542+0000","last_peered":"2024-08-31T05:27:58.497542+0000","last_clean":"2024-08-31T05:27:58.497542+0000","last_became_active":"2024-08-31T05:27:31.252013+0000","last_became_peered":"2024-08-31T05:27:31.252013+0000","last_unstale":"2024-08-31T05:27:58.497542+0000","last_undegraded":"2024-08-31T05:27:58.497542+0000","last_fullsized":"2024-08-31T05:27:58.497542+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:48:47.287168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.503437+0000","last_change":"2024-08-31T05:27:31.262626+0000","last_active":"2024-08-31T05:27:58.503437+0000","last_peered":"2024-08-31T05:27:58.503437+0000","last_clean":"2024-08-31T05:27:58.503437+0000","last_became_active":"2024-08-31T05:27:31.262190+0000","last_became_peered":"2024-08-31T05:27:31.262190+0000","last_unstale":"2024-08-31T05:27:58.503437+0000","last_undegraded":"2024-08-31T05:27:58.503437+0000","last_fullsized":"2024-08-31T05:27:58.503437+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:39:19.454606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.502048+0000","last_change":"2024-08-31T05:27:31.254482+0000","last_active":"2024-08-31T05:27:58.502048+0000","last_peered":"2024-08-31T05:27:58.502048+0000","last_clean":"2024-08-31T05:27:58.502048+0000","last_became_active":"2024-08-31T05:27:31.254103+0000","last_became_peered":"2024-08-31T05:27:31.254103+0000","last_unstale":"2024-08-31T05:27:58.502048+0000","last_undegraded":"2024-08-31T05:27:58.502048+0000","last_fullsized":"2024-08-31T05:27:58.502048+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:20:57.333359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.506087+0000","last_change":"2024-08-31T05:27:58.505928+0000","last_active":"2024-08-31T05:27:58.506087+0000","last_peered":"2024-08-31T05:27:58.506087+0000","last_clean":"2024-08-31T05:27:58.506087+0000","last_became_active":"2024-08-31T05:27:58.505527+0000","last_became_peered":"2024-08-31T05:27:58.505527+0000","last_unstale":"2024-08-31T05:27:58.506087+0000","last_undegraded":"2024-08-31T05:27:58.506087+0000","last_fullsized":"2024-08-31T05:27:58.506087+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:44:30.754350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.498581+0000","last_change":"2024-08-31T05:27:31.262385+0000","last_active":"2024-08-31T05:27:58.498581+0000","last_peered":"2024-08-31T05:27:58.498581+0000","last_clean":"2024-08-31T05:27:58.498581+0000","last_became_active":"2024-08-31T05:27:31.262089+0000","last_became_peered":"2024-08-31T05:27:31.262089+0000","last_unstale":"2024-08-31T05:27:58.498581+0000","last_undegraded":"2024-08-31T05:27:58.498581+0000","last_fullsized":"2024-08-31T05:27:58.498581+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:50:17.172462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.501316+0000","last_change":"2024-08-31T05:27:31.249162+0000","last_active":"2024-08-31T05:27:58.501316+0000","last_peered":"2024-08-31T05:27:58.501316+0000","last_clean":"2024-08-31T05:27:58.501316+0000","last_became_active":"2024-08-31T05:27:31.248803+0000","last_became_peered":"2024-08-31T05:27:31.248803+0000","last_unstale":"2024-08-31T05:27:58.501316+0000","last_undegraded":"2024-08-31T05:27:58.501316+0000","last_fullsized":"2024-08-31T05:27:58.501316+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:18:05.449612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.503559+0000","last_change":"2024-08-31T05:27:31.258983+0000","last_active":"2024-08-31T05:27:58.503559+0000","last_peered":"2024-08-31T05:27:58.503559+0000","last_clean":"2024-08-31T05:27:58.503559+0000","last_became_active":"2024-08-31T05:27:31.258480+0000","last_became_peered":"2024-08-31T05:27:31.258480+0000","last_unstale":"2024-08-31T05:27:58.503559+0000","last_undegraded":"2024-08-31T05:27:58.503559+0000","last_fullsized":"2024-08-31T05:27:58.503559+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:57:34.589281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.497478+0000","last_change":"2024-08-31T05:27:31.252561+0000","last_active":"2024-08-31T05:27:58.497478+0000","last_peered":"2024-08-31T05:27:58.497478+0000","last_clean":"2024-08-31T05:27:58.497478+0000","last_became_active":"2024-08-31T05:27:31.251963+0000","last_became_peered":"2024-08-31T05:27:31.251963+0000","last_unstale":"2024-08-31T05:27:58.497478+0000","last_undegraded":"2024-08-31T05:27:58.497478+0000","last_fullsized":"2024-08-31T05:27:58.497478+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:17:45.244329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.503093+0000","last_change":"2024-08-31T05:27:31.257298+0000","last_active":"2024-08-31T05:27:58.503093+0000","last_peered":"2024-08-31T05:27:58.503093+0000","last_clean":"2024-08-31T05:27:58.503093+0000","last_became_active":"2024-08-31T05:27:31.256935+0000","last_became_peered":"2024-08-31T05:27:31.256935+0000","last_unstale":"2024-08-31T05:27:58.503093+0000","last_undegraded":"2024-08-31T05:27:58.503093+0000","last_fullsized":"2024-08-31T05:27:58.503093+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:07:32.876328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.502065+0000","last_change":"2024-08-31T05:27:31.248456+0000","last_active":"2024-08-31T05:27:58.502065+0000","last_peered":"2024-08-31T05:27:58.502065+0000","last_clean":"2024-08-31T05:27:58.502065+0000","last_became_active":"2024-08-31T05:27:31.248060+0000","last_became_peered":"2024-08-31T05:27:31.248060+0000","last_unstale":"2024-08-31T05:27:58.502065+0000","last_undegraded":"2024-08-31T05:27:58.502065+0000","last_fullsized":"2024-08-31T05:27:58.502065+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:29:35.817409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.503318+0000","last_change":"2024-08-31T05:27:31.251345+0000","last_active":"2024-08-31T05:27:58.503318+0000","last_peered":"2024-08-31T05:27:58.503318+0000","last_clean":"2024-08-31T05:27:58.503318+0000","last_became_active":"2024-08-31T05:27:31.251002+0000","last_became_peered":"2024-08-31T05:27:31.251002+0000","last_unstale":"2024-08-31T05:27:58.503318+0000","last_undegraded":"2024-08-31T05:27:58.503318+0000","last_fullsized":"2024-08-31T05:27:58.503318+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:35:24.564897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.504407+0000","last_change":"2024-08-31T05:27:31.260681+0000","last_active":"2024-08-31T05:27:58.504407+0000","last_peered":"2024-08-31T05:27:58.504407+0000","last_clean":"2024-08-31T05:27:58.504407+0000","last_became_active":"2024-08-31T05:27:31.259445+0000","last_became_peered":"2024-08-31T05:27:31.259445+0000","last_unstale":"2024-08-31T05:27:58.504407+0000","last_undegraded":"2024-08-31T05:27:58.504407+0000","last_fullsized":"2024-08-31T05:27:58.504407+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:41:43.480946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.502947+0000","last_change":"2024-08-31T05:27:31.263950+0000","last_active":"2024-08-31T05:27:58.502947+0000","last_peered":"2024-08-31T05:27:58.502947+0000","last_clean":"2024-08-31T05:27:58.502947+0000","last_became_active":"2024-08-31T05:27:31.263568+0000","last_became_peered":"2024-08-31T05:27:31.263568+0000","last_unstale":"2024-08-31T05:27:58.502947+0000","last_undegraded":"2024-08-31T05:27:58.502947+0000","last_fullsized":"2024-08-31T05:27:58.502947+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:50:05.111796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.508949+0000","last_change":"2024-08-31T05:27:58.508829+0000","last_active":"2024-08-31T05:27:58.508949+0000","last_peered":"2024-08-31T05:27:58.508949+0000","last_clean":"2024-08-31T05:27:58.508949+0000","last_became_active":"2024-08-31T05:27:58.508378+0000","last_became_peered":"2024-08-31T05:27:58.508378+0000","last_unstale":"2024-08-31T05:27:58.508949+0000","last_undegraded":"2024-08-31T05:27:58.508949+0000","last_fullsized":"2024-08-31T05:27:58.508949+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:05:46.254003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.501500+0000","last_change":"2024-08-31T05:27:31.261012+0000","last_active":"2024-08-31T05:27:58.501500+0000","last_peered":"2024-08-31T05:27:58.501500+0000","last_clean":"2024-08-31T05:27:58.501500+0000","last_became_active":"2024-08-31T05:27:31.259373+0000","last_became_peered":"2024-08-31T05:27:31.259373+0000","last_unstale":"2024-08-31T05:27:58.501500+0000","last_undegraded":"2024-08-31T05:27:58.501500+0000","last_fullsized":"2024-08-31T05:27:58.501500+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:15:34.711961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.497450+0000","last_change":"2024-08-31T05:27:31.255199+0000","last_active":"2024-08-31T05:27:58.497450+0000","last_peered":"2024-08-31T05:27:58.497450+0000","last_clean":"2024-08-31T05:27:58.497450+0000","last_became_active":"2024-08-31T05:27:31.254833+0000","last_became_peered":"2024-08-31T05:27:31.254833+0000","last_unstale":"2024-08-31T05:27:58.497450+0000","last_undegraded":"2024-08-31T05:27:58.497450+0000","last_fullsized":"2024-08-31T05:27:58.497450+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:55:09.426531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.651143+0000","last_change":"2024-08-31T05:27:31.264881+0000","last_active":"2024-08-31T05:27:58.651143+0000","last_peered":"2024-08-31T05:27:58.651143+0000","last_clean":"2024-08-31T05:27:58.651143+0000","last_became_active":"2024-08-31T05:27:31.264483+0000","last_became_peered":"2024-08-31T05:27:31.264483+0000","last_unstale":"2024-08-31T05:27:58.651143+0000","last_undegraded":"2024-08-31T05:27:58.651143+0000","last_fullsized":"2024-08-31T05:27:58.651143+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:48:55.193321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.501847+0000","last_change":"2024-08-31T05:27:31.258555+0000","last_active":"2024-08-31T05:27:58.501847+0000","last_peered":"2024-08-31T05:27:58.501847+0000","last_clean":"2024-08-31T05:27:58.501847+0000","last_became_active":"2024-08-31T05:27:31.258023+0000","last_became_peered":"2024-08-31T05:27:31.258023+0000","last_unstale":"2024-08-31T05:27:58.501847+0000","last_undegraded":"2024-08-31T05:27:58.501847+0000","last_fullsized":"2024-08-31T05:27:58.501847+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:26:34.911641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.499424+0000","last_change":"2024-08-31T05:27:31.249886+0000","last_active":"2024-08-31T05:27:58.499424+0000","last_peered":"2024-08-31T05:27:58.499424+0000","last_clean":"2024-08-31T05:27:58.499424+0000","last_became_active":"2024-08-31T05:27:31.248549+0000","last_became_peered":"2024-08-31T05:27:31.248549+0000","last_unstale":"2024-08-31T05:27:58.499424+0000","last_undegraded":"2024-08-31T05:27:58.499424+0000","last_fullsized":"2024-08-31T05:27:58.499424+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:57:55.743286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.504021+0000","last_change":"2024-08-31T05:27:31.261697+0000","last_active":"2024-08-31T05:27:58.504021+0000","last_peered":"2024-08-31T05:27:58.504021+0000","last_clean":"2024-08-31T05:27:58.504021+0000","last_became_active":"2024-08-31T05:27:31.260398+0000","last_became_peered":"2024-08-31T05:27:31.260398+0000","last_unstale":"2024-08-31T05:27:58.504021+0000","last_undegraded":"2024-08-31T05:27:58.504021+0000","last_fullsized":"2024-08-31T05:27:58.504021+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:08:03.999556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.500827+0000","last_change":"2024-08-31T05:27:31.256638+0000","last_active":"2024-08-31T05:27:58.500827+0000","last_peered":"2024-08-31T05:27:58.500827+0000","last_clean":"2024-08-31T05:27:58.500827+0000","last_became_active":"2024-08-31T05:27:31.256302+0000","last_became_peered":"2024-08-31T05:27:31.256302+0000","last_unstale":"2024-08-31T05:27:58.500827+0000","last_undegraded":"2024-08-31T05:27:58.500827+0000","last_fullsized":"2024-08-31T05:27:58.500827+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:31:58.946448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.500733+0000","last_change":"2024-08-31T05:27:31.253818+0000","last_active":"2024-08-31T05:27:58.500733+0000","last_peered":"2024-08-31T05:27:58.500733+0000","last_clean":"2024-08-31T05:27:58.500733+0000","last_became_active":"2024-08-31T05:27:31.253423+0000","last_became_peered":"2024-08-31T05:27:31.253423+0000","last_unstale":"2024-08-31T05:27:58.500733+0000","last_undegraded":"2024-08-31T05:27:58.500733+0000","last_fullsized":"2024-08-31T05:27:58.500733+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:45:43.951022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.498682+0000","last_change":"2024-08-31T05:27:31.247171+0000","last_active":"2024-08-31T05:27:58.498682+0000","last_peered":"2024-08-31T05:27:58.498682+0000","last_clean":"2024-08-31T05:27:58.498682+0000","last_became_active":"2024-08-31T05:27:31.246791+0000","last_became_peered":"2024-08-31T05:27:31.246791+0000","last_unstale":"2024-08-31T05:27:58.498682+0000","last_undegraded":"2024-08-31T05:27:58.498682+0000","last_fullsized":"2024-08-31T05:27:58.498682+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:26:12.163389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.506548+0000","last_change":"2024-08-31T05:27:31.257848+0000","last_active":"2024-08-31T05:27:58.506548+0000","last_peered":"2024-08-31T05:27:58.506548+0000","last_clean":"2024-08-31T05:27:58.506548+0000","last_became_active":"2024-08-31T05:27:31.257432+0000","last_became_peered":"2024-08-31T05:27:31.257432+0000","last_unstale":"2024-08-31T05:27:58.506548+0000","last_undegraded":"2024-08-31T05:27:58.506548+0000","last_fullsized":"2024-08-31T05:27:58.506548+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:08:12.512834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.651075+0000","last_change":"2024-08-31T05:27:31.263998+0000","last_active":"2024-08-31T05:27:58.651075+0000","last_peered":"2024-08-31T05:27:58.651075+0000","last_clean":"2024-08-31T05:27:58.651075+0000","last_became_active":"2024-08-31T05:27:31.263638+0000","last_became_peered":"2024-08-31T05:27:31.263638+0000","last_unstale":"2024-08-31T05:27:58.651075+0000","last_undegraded":"2024-08-31T05:27:58.651075+0000","last_fullsized":"2024-08-31T05:27:58.651075+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:07:50.470538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.502526+0000","last_change":"2024-08-31T05:27:31.260600+0000","last_active":"2024-08-31T05:27:58.502526+0000","last_peered":"2024-08-31T05:27:58.502526+0000","last_clean":"2024-08-31T05:27:58.502526+0000","last_became_active":"2024-08-31T05:27:31.259605+0000","last_became_peered":"2024-08-31T05:27:31.259605+0000","last_unstale":"2024-08-31T05:27:58.502526+0000","last_undegraded":"2024-08-31T05:27:58.502526+0000","last_fullsized":"2024-08-31T05:27:58.502526+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:04:16.861879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.501924+0000","last_change":"2024-08-31T05:27:31.256585+0000","last_active":"2024-08-31T05:27:58.501924+0000","last_peered":"2024-08-31T05:27:58.501924+0000","last_clean":"2024-08-31T05:27:58.501924+0000","last_became_active":"2024-08-31T05:27:31.256118+0000","last_became_peered":"2024-08-31T05:27:31.256118+0000","last_unstale":"2024-08-31T05:27:58.501924+0000","last_undegraded":"2024-08-31T05:27:58.501924+0000","last_fullsized":"2024-08-31T05:27:58.501924+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:47:18.891150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-08-31T05:27:58.504364+0000","last_change":"2024-08-31T05:27:31.260321+0000","last_active":"2024-08-31T05:27:58.504364+0000","last_peered":"2024-08-31T05:27:58.504364+0000","last_clean":"2024-08-31T05:27:58.504364+0000","last_became_active":"2024-08-31T05:27:31.259901+0000","last_became_peered":"2024-08-31T05:27:31.259901+0000","last_unstale":"2024-08-31T05:27:58.504364+0000","last_undegraded":"2024-08-31T05:27:58.504364+0000","last_fullsized":"2024-08-31T05:27:58.504364+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:44:26.651338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63873,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":199,"num_read_kb":171,"num_write":244,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":548864,"data_stored":187354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":210,"ondisk_log_size":210,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":280617,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678041,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36264,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708888,"statfs":{"total":95995035648,"available":95957901312,"internally_reserved":0,"allocated":942080,"data_stored":490094,"data_compressed":23633,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874270,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36404,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708748,"statfs":{"total":95995035648,"available":95957757952,"internally_reserved":0,"allocated":1085440,"data_stored":1133579,"data_compressed":59318,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037795,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":970752,"data_stored":494120,"data_compressed":23633,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234023,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":954368,"data_stored":489730,"data_compressed":23633,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430252,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":1087290,"data_compressed":59318,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593778,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":485919,"data_compressed":23633,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790008,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36344,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708808,"statfs":{"total":95995035648,"available":95957819392,"internally_reserved":0,"allocated":1024000,"data_stored":1082481,"data_compressed":59318,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953533,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":490615,"data_compressed":23633,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149762,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36276,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708876,"statfs":{"total":95995035648,"available":95957889024,"internally_reserved":0,"allocated":954368,"data_stored":485236,"data_compressed":23633,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378695,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36336,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708816,"statfs":{"total":95995035648,"available":95957827584,"internally_reserved":0,"allocated":1015808,"data_stored":542825,"data_compressed":23633,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542219,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36328,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708824,"statfs":{"total":95995035648,"available":95957835776,"internally_reserved":0,"allocated":1007616,"data_stored":540025,"data_compressed":23633,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705745,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36288,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708864,"statfs":{"total":95995035648,"available":95957876736,"internally_reserved":0,"allocated":966656,"data_stored":486984,"data_compressed":23633,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34064,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34064,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34064,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":55219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":58019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":58405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T05:28:31.094 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-08-31T05:28:31.095 INFO:tasks.cephadm:Setting up client nodes... 2024-08-31T05:28:31.095 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-08-31T05:28:31.350 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:28:31.744 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:31 smithi005 ceph-mon[18602]: from='client.24791 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T05:28:31.745 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:31 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:28:31.745 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:31 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:28:31.745 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:31 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:28:31.745 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:31 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:28:31.745 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:31 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:28:31.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:31.843+0000 7f794f1be640 1 -- 172.21.15.5:0/3700593146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7948108270 msgr2=0x7f7948108680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:31.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:31.843+0000 7f794f1be640 1 --2- 172.21.15.5:0/3700593146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7948108270 0x7f7948108680 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7934009900 tx=0x7f793402a410 comp rx=0 tx=0).stop 2024-08-31T05:28:31.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:31.843+0000 7f794f1be640 1 -- 172.21.15.5:0/3700593146 shutdown_connections 2024-08-31T05:28:31.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:31.843+0000 7f794f1be640 1 --2- 172.21.15.5:0/3700593146 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7948108bc0 0x7f794810f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:31.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:31.843+0000 7f794f1be640 1 --2- 172.21.15.5:0/3700593146 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7948108270 0x7f7948108680 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:31.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:31.843+0000 7f794f1be640 1 --2- 172.21.15.5:0/3700593146 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7948102820 0x7f7948102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:31.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:31.843+0000 7f794f1be640 1 -- 172.21.15.5:0/3700593146 >> 172.21.15.5:0/3700593146 conn(0x7f79480794c0 msgr2=0x7f79480798d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:31.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:31.843+0000 7f794f1be640 1 -- 172.21.15.5:0/3700593146 shutdown_connections 2024-08-31T05:28:31.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:31.843+0000 7f794f1be640 1 -- 172.21.15.5:0/3700593146 wait complete. 2024-08-31T05:28:31.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:31.843+0000 7f794f1be640 1 Processor -- start 2024-08-31T05:28:31.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:31.843+0000 7f794f1be640 1 -- start start 2024-08-31T05:28:31.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:31.844+0000 7f794f1be640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7948102820 0x7f794819a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:31.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:31.844+0000 7f794f1be640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7948108270 0x7f794819a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:31.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:31.844+0000 7f794f1be640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7948108bc0 0x7f794819fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:31.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:31.844+0000 7f794f1be640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f79481139a0 con 0x7f7948102820 2024-08-31T05:28:31.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:31.844+0000 7f794f1be640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7948113820 con 0x7f7948108270 2024-08-31T05:28:31.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:31.844+0000 7f794f1be640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7948113b20 con 0x7f7948108bc0 2024-08-31T05:28:31.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:31.844+0000 7f794cf5a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7948102820 0x7f794819a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:31.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:31.844+0000 7f794cf5a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7948102820 0x7f794819a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47860/0 (socket says 172.21.15.5:47860) 2024-08-31T05:28:31.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:31.844+0000 7f794cf5a640 1 -- 172.21.15.5:0/754237190 learned_addr learned my addr 172.21.15.5:0/754237190 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:28:31.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:31.844+0000 7f7947fff640 1 --2- 172.21.15.5:0/754237190 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7948108270 0x7f794819a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:31.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:31.844+0000 7f794d75b640 1 --2- 172.21.15.5:0/754237190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7948108bc0 0x7f794819fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:31.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:31.844+0000 7f794cf5a640 1 -- 172.21.15.5:0/754237190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7948108bc0 msgr2=0x7f794819fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:31.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:31.844+0000 7f794cf5a640 1 --2- 172.21.15.5:0/754237190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7948108bc0 0x7f794819fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:31.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:31.844+0000 7f794cf5a640 1 -- 172.21.15.5:0/754237190 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7948108270 msgr2=0x7f794819a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:31.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:31.844+0000 7f794cf5a640 1 --2- 172.21.15.5:0/754237190 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7948108270 0x7f794819a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:31.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:31.844+0000 7f794cf5a640 1 -- 172.21.15.5:0/754237190 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79481a0380 con 0x7f7948102820 2024-08-31T05:28:31.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:31.844+0000 7f794d75b640 1 --2- 172.21.15.5:0/754237190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7948108bc0 0x7f794819fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:28:31.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:31.844+0000 7f7947fff640 1 --2- 172.21.15.5:0/754237190 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7948108270 0x7f794819a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:28:31.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:31.844+0000 7f794cf5a640 1 --2- 172.21.15.5:0/754237190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7948102820 0x7f794819a410 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f793c00d950 tx=0x7f793c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:31.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:31.845+0000 7f7945ffb640 1 -- 172.21.15.5:0/754237190 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f793c017070 con 0x7f7948102820 2024-08-31T05:28:31.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:31.845+0000 7f7945ffb640 1 -- 172.21.15.5:0/754237190 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f793c009c30 con 0x7f7948102820 2024-08-31T05:28:31.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:31.845+0000 7f794f1be640 1 -- 172.21.15.5:0/754237190 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79481a0670 con 0x7f7948102820 2024-08-31T05:28:31.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:31.845+0000 7f7945ffb640 1 -- 172.21.15.5:0/754237190 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f793c00f620 con 0x7f7948102820 2024-08-31T05:28:31.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:31.845+0000 7f794f1be640 1 -- 172.21.15.5:0/754237190 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79481a6dd0 con 0x7f7948102820 2024-08-31T05:28:31.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:31.846+0000 7f794f1be640 1 -- 172.21.15.5:0/754237190 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7948103aa0 con 0x7f7948102820 2024-08-31T05:28:31.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:31.847+0000 7f7945ffb640 1 -- 172.21.15.5:0/754237190 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f793c005030 con 0x7f7948102820 2024-08-31T05:28:31.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:31.848+0000 7f7945ffb640 1 --2- 172.21.15.5:0/754237190 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f79380b4c10 0x7f79380b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:31.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:31.848+0000 7f7945ffb640 1 -- 172.21.15.5:0/754237190 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9307+0+0 (secure 0 0 0) 0x7f793c0e5440 con 0x7f7948102820 2024-08-31T05:28:31.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:31.848+0000 7f7947fff640 1 --2- 172.21.15.5:0/754237190 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f79380b4c10 0x7f79380b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:31.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:31.849+0000 7f7947fff640 1 --2- 172.21.15.5:0/754237190 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f79380b4c10 0x7f79380b7120 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7934009230 tx=0x7f7934000bc0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:31.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:31.851+0000 7f7945ffb640 1 -- 172.21.15.5:0/754237190 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f793c0abfe0 con 0x7f7948102820 2024-08-31T05:28:31.908 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:31 smithi050 ceph-mon[22146]: from='client.24791 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T05:28:31.908 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:31 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:28:31.908 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:31 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:28:31.908 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:31 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:28:31.908 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:31 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:28:31.908 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:31 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:28:32.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:31 smithi070 ceph-mon[22316]: from='client.24791 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T05:28:32.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:31 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:28:32.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:31 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:28:32.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:31 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:28:32.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:31 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:28:32.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:31 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:28:32.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:32.107+0000 7f794f1be640 1 -- 172.21.15.5:0/754237190 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f794810a990 con 0x7f7948102820 2024-08-31T05:28:32.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:32.110+0000 7f7945ffb640 1 -- 172.21.15.5:0/754237190 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f793c009de0 con 0x7f7948102820 2024-08-31T05:28:32.112 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2024-08-31T05:28:32.113 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQAAqtJmJHWFBhAAslgdmdeoHThCvRpk0d/FGQ== 2024-08-31T05:28:32.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:32.113+0000 7f794f1be640 1 -- 172.21.15.5:0/754237190 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f79380b4c10 msgr2=0x7f79380b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:32.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:32.113+0000 7f794f1be640 1 --2- 172.21.15.5:0/754237190 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f79380b4c10 0x7f79380b7120 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7934009230 tx=0x7f7934000bc0 comp rx=0 tx=0).stop 2024-08-31T05:28:32.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:32.113+0000 7f794f1be640 1 -- 172.21.15.5:0/754237190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7948102820 msgr2=0x7f794819a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:32.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:32.113+0000 7f794f1be640 1 --2- 172.21.15.5:0/754237190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7948102820 0x7f794819a410 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f793c00d950 tx=0x7f793c00de10 comp rx=0 tx=0).stop 2024-08-31T05:28:32.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:32.113+0000 7f794f1be640 1 -- 172.21.15.5:0/754237190 shutdown_connections 2024-08-31T05:28:32.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:32.113+0000 7f794f1be640 1 --2- 172.21.15.5:0/754237190 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f79380b4c10 0x7f79380b7120 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:32.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:32.113+0000 7f794f1be640 1 --2- 172.21.15.5:0/754237190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7948108bc0 0x7f794819fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:32.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:32.113+0000 7f794f1be640 1 --2- 172.21.15.5:0/754237190 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7948108270 0x7f794819a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:32.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:32.113+0000 7f794f1be640 1 --2- 172.21.15.5:0/754237190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7948102820 0x7f794819a410 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:32.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:32.113+0000 7f794f1be640 1 -- 172.21.15.5:0/754237190 >> 172.21.15.5:0/754237190 conn(0x7f79480794c0 msgr2=0x7f7948104330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:32.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:32.113+0000 7f794f1be640 1 -- 172.21.15.5:0/754237190 shutdown_connections 2024-08-31T05:28:32.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:32.113+0000 7f794f1be640 1 -- 172.21.15.5:0/754237190 wait complete. 2024-08-31T05:28:32.777 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-31T05:28:32.777 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-08-31T05:28:32.778 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-08-31T05:28:32.815 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph config log 1 --format=json 2024-08-31T05:28:33.122 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:28:33.392 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:33 smithi005 ceph-mon[18602]: pgmap v300: 129 pgs: 129 active+clean; 639 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.0 KiB/s wr, 10 op/s 2024-08-31T05:28:33.392 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:33 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/754237190' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-08-31T05:28:33.392 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:33 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/754237190' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-31T05:28:33.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:33 smithi050 ceph-mon[22146]: pgmap v300: 129 pgs: 129 active+clean; 639 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.0 KiB/s wr, 10 op/s 2024-08-31T05:28:33.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:33 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/754237190' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-08-31T05:28:33.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:33 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/754237190' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-31T05:28:33.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:33 smithi070 ceph-mon[22316]: pgmap v300: 129 pgs: 129 active+clean; 639 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.0 KiB/s wr, 10 op/s 2024-08-31T05:28:33.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:33 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/754237190' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-08-31T05:28:33.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:33 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/754237190' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-31T05:28:33.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:33.638+0000 7f9b09b23640 1 -- 172.21.15.5:0/2538515107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b04109b90 msgr2=0x7f9b041103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:33.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:33.638+0000 7f9b09b23640 1 --2- 172.21.15.5:0/2538515107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b04109b90 0x7f9b041103c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9afc009ca0 tx=0x7f9afc02a8c0 comp rx=0 tx=0).stop 2024-08-31T05:28:33.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:33.638+0000 7f9b09b23640 1 -- 172.21.15.5:0/2538515107 shutdown_connections 2024-08-31T05:28:33.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:33.638+0000 7f9b09b23640 1 --2- 172.21.15.5:0/2538515107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b04109b90 0x7f9b041103c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:33.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:33.638+0000 7f9b09b23640 1 --2- 172.21.15.5:0/2538515107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b04109240 0x7f9b04109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:33.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:33.638+0000 7f9b09b23640 1 --2- 172.21.15.5:0/2538515107 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b04103900 0x7f9b04103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:33.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:33.638+0000 7f9b09b23640 1 -- 172.21.15.5:0/2538515107 >> 172.21.15.5:0/2538515107 conn(0x7f9b0407b5f0 msgr2=0x7f9b0407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:33.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:33.638+0000 7f9b09b23640 1 -- 172.21.15.5:0/2538515107 shutdown_connections 2024-08-31T05:28:33.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:33.638+0000 7f9b09b23640 1 -- 172.21.15.5:0/2538515107 wait complete. 2024-08-31T05:28:33.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:33.639+0000 7f9b09b23640 1 Processor -- start 2024-08-31T05:28:33.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:33.639+0000 7f9b09b23640 1 -- start start 2024-08-31T05:28:33.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:33.639+0000 7f9b09b23640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b04103900 0x7f9b04076ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:33.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:33.639+0000 7f9b09b23640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b04109240 0x7f9b040754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:33.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:33.639+0000 7f9b09b23640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b04109b90 0x7f9b040759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:33.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:33.639+0000 7f9b09b23640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9b04113850 con 0x7f9b04103900 2024-08-31T05:28:33.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:33.639+0000 7f9b09b23640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9b041136d0 con 0x7f9b04109b90 2024-08-31T05:28:33.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:33.639+0000 7f9b09b23640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9b041139d0 con 0x7f9b04109240 2024-08-31T05:28:33.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:33.640+0000 7f9b037fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b04103900 0x7f9b04076ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:33.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:33.640+0000 7f9b037fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b04103900 0x7f9b04076ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54920/0 (socket says 172.21.15.5:54920) 2024-08-31T05:28:33.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:33.640+0000 7f9b037fe640 1 -- 172.21.15.5:0/2742018096 learned_addr learned my addr 172.21.15.5:0/2742018096 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:28:33.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:33.640+0000 7f9b03fff640 1 --2- 172.21.15.5:0/2742018096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b04109b90 0x7f9b040759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:33.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:33.640+0000 7f9afaffd640 1 --2- 172.21.15.5:0/2742018096 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b04109240 0x7f9b040754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:33.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:33.640+0000 7f9b037fe640 1 -- 172.21.15.5:0/2742018096 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b04109240 msgr2=0x7f9b040754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:33.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:33.640+0000 7f9b037fe640 1 --2- 172.21.15.5:0/2742018096 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b04109240 0x7f9b040754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:33.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:33.640+0000 7f9b037fe640 1 -- 172.21.15.5:0/2742018096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b04109b90 msgr2=0x7f9b040759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:33.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:33.640+0000 7f9b037fe640 1 --2- 172.21.15.5:0/2742018096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b04109b90 0x7f9b040759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:33.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:33.640+0000 7f9b037fe640 1 -- 172.21.15.5:0/2742018096 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b04076210 con 0x7f9b04103900 2024-08-31T05:28:33.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:33.640+0000 7f9b037fe640 1 --2- 172.21.15.5:0/2742018096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b04103900 0x7f9b04076ec0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9af400d770 tx=0x7f9af400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:33.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:33.640+0000 7f9b017fa640 1 -- 172.21.15.5:0/2742018096 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af4017070 con 0x7f9b04103900 2024-08-31T05:28:33.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:33.640+0000 7f9b09b23640 1 -- 172.21.15.5:0/2742018096 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b041acb80 con 0x7f9b04103900 2024-08-31T05:28:33.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:33.640+0000 7f9b017fa640 1 -- 172.21.15.5:0/2742018096 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9af40054d0 con 0x7f9b04103900 2024-08-31T05:28:33.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:33.640+0000 7f9b017fa640 1 -- 172.21.15.5:0/2742018096 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af4004c30 con 0x7f9b04103900 2024-08-31T05:28:33.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:33.640+0000 7f9b09b23640 1 -- 172.21.15.5:0/2742018096 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b041ad0c0 con 0x7f9b04103900 2024-08-31T05:28:33.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:33.641+0000 7f9b09b23640 1 -- 172.21.15.5:0/2742018096 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b04103d10 con 0x7f9b04103900 2024-08-31T05:28:33.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:33.644+0000 7f9b017fa640 1 -- 172.21.15.5:0/2742018096 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f9af4004dd0 con 0x7f9b04103900 2024-08-31T05:28:33.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:33.644+0000 7f9b017fa640 1 --2- 172.21.15.5:0/2742018096 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9af00b4c10 0x7f9af00b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:33.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:33.645+0000 7f9afaffd640 1 --2- 172.21.15.5:0/2742018096 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9af00b4c10 0x7f9af00b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:33.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:33.645+0000 7f9b017fa640 1 -- 172.21.15.5:0/2742018096 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9307+0+0 (secure 0 0 0) 0x7f9af40e5550 con 0x7f9b04103900 2024-08-31T05:28:33.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:33.645+0000 7f9afaffd640 1 --2- 172.21.15.5:0/2742018096 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9af00b4c10 0x7f9af00b7120 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9b04106e90 tx=0x7f9aec00b410 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:33.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:33.649+0000 7f9b017fa640 1 -- 172.21.15.5:0/2742018096 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f9af40abaa0 con 0x7f9b04103900 2024-08-31T05:28:33.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:33.834+0000 7f9b09b23640 1 -- 172.21.15.5:0/2742018096 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f9b0402e430 con 0x7f9b04103900 2024-08-31T05:28:33.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:33.835+0000 7f9b017fa640 1 -- 172.21.15.5:0/2742018096 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v56) ==== 86+0+133 (secure 0 0 0) 0x7f9af40b0260 con 0x7f9b04103900 2024-08-31T05:28:33.838 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:28:33.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:33.837+0000 7f9b09b23640 1 -- 172.21.15.5:0/2742018096 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9af00b4c10 msgr2=0x7f9af00b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:33.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:33.837+0000 7f9b09b23640 1 --2- 172.21.15.5:0/2742018096 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9af00b4c10 0x7f9af00b7120 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9b04106e90 tx=0x7f9aec00b410 comp rx=0 tx=0).stop 2024-08-31T05:28:33.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:33.837+0000 7f9b09b23640 1 -- 172.21.15.5:0/2742018096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b04103900 msgr2=0x7f9b04076ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:33.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:33.837+0000 7f9b09b23640 1 --2- 172.21.15.5:0/2742018096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b04103900 0x7f9b04076ec0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9af400d770 tx=0x7f9af400dc30 comp rx=0 tx=0).stop 2024-08-31T05:28:33.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:33.837+0000 7f9b09b23640 1 -- 172.21.15.5:0/2742018096 shutdown_connections 2024-08-31T05:28:33.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:33.837+0000 7f9b09b23640 1 --2- 172.21.15.5:0/2742018096 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9af00b4c10 0x7f9af00b7120 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:33.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:33.837+0000 7f9b09b23640 1 --2- 172.21.15.5:0/2742018096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9b04109b90 0x7f9b040759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:33.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:33.837+0000 7f9b09b23640 1 --2- 172.21.15.5:0/2742018096 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b04109240 0x7f9b040754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:33.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:33.837+0000 7f9b09b23640 1 --2- 172.21.15.5:0/2742018096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b04103900 0x7f9b04076ec0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:33.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:33.837+0000 7f9b09b23640 1 -- 172.21.15.5:0/2742018096 >> 172.21.15.5:0/2742018096 conn(0x7f9b0407b5f0 msgr2=0x7f9b04105210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:33.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:33.837+0000 7f9b09b23640 1 -- 172.21.15.5:0/2742018096 shutdown_connections 2024-08-31T05:28:33.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:33.837+0000 7f9b09b23640 1 -- 172.21.15.5:0/2742018096 wait complete. 2024-08-31T05:28:34.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:34 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/2742018096' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-08-31T05:28:34.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:34 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/2742018096' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-08-31T05:28:34.499 INFO:teuthology.orchestra.run.smithi005.stdout:[{"version":56,"timestamp":"2024-08-31T05:27:21.585653+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2024-08-31T05:28:34.499 INFO:tasks.ceph_manager:config epoch is 56 2024-08-31T05:28:34.499 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-08-31T05:28:34.499 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-08-31T05:28:34.500 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph mgr dump --format=json 2024-08-31T05:28:34.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:34 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/2742018096' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-08-31T05:28:34.751 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:28:35.176 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:35 smithi005 ceph-mon[18602]: pgmap v301: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.6 KiB/s wr, 12 op/s 2024-08-31T05:28:35.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:35.270+0000 7f57a947f640 1 -- 172.21.15.5:0/4073365196 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57a4102800 msgr2=0x7f57a4102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:35.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:35.270+0000 7f57a947f640 1 --2- 172.21.15.5:0/4073365196 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57a4102800 0x7f57a4102c10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5794009900 tx=0x7f579402a410 comp rx=0 tx=0).stop 2024-08-31T05:28:35.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:35.270+0000 7f57a947f640 1 -- 172.21.15.5:0/4073365196 shutdown_connections 2024-08-31T05:28:35.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:35.270+0000 7f57a947f640 1 --2- 172.21.15.5:0/4073365196 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57a4108a90 0x7f57a410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:35.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:35.270+0000 7f57a947f640 1 --2- 172.21.15.5:0/4073365196 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57a4108140 0x7f57a4108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:35.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:35.270+0000 7f57a947f640 1 --2- 172.21.15.5:0/4073365196 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57a4102800 0x7f57a4102c10 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:35.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:35.270+0000 7f57a947f640 1 -- 172.21.15.5:0/4073365196 >> 172.21.15.5:0/4073365196 conn(0x7f57a40794d0 msgr2=0x7f57a40798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:35.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:35.270+0000 7f57a947f640 1 -- 172.21.15.5:0/4073365196 shutdown_connections 2024-08-31T05:28:35.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:35.270+0000 7f57a947f640 1 -- 172.21.15.5:0/4073365196 wait complete. 2024-08-31T05:28:35.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:35.270+0000 7f57a947f640 1 Processor -- start 2024-08-31T05:28:35.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:35.271+0000 7f57a947f640 1 -- start start 2024-08-31T05:28:35.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:35.271+0000 7f57a947f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57a4102800 0x7f57a419a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:35.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:35.271+0000 7f57a947f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57a4108140 0x7f57a419a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:35.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:35.271+0000 7f57a947f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57a4108a90 0x7f57a419fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:35.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:35.271+0000 7f57a947f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f57a41126f0 con 0x7f57a4108a90 2024-08-31T05:28:35.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:35.271+0000 7f57a947f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f57a4112570 con 0x7f57a4102800 2024-08-31T05:28:35.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:35.271+0000 7f57a947f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f57a4112870 con 0x7f57a4108140 2024-08-31T05:28:35.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:35.271+0000 7f57a37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57a4108a90 0x7f57a419fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:35.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:35.271+0000 7f57a37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57a4108a90 0x7f57a419fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54940/0 (socket says 172.21.15.5:54940) 2024-08-31T05:28:35.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:35.271+0000 7f57a37fe640 1 -- 172.21.15.5:0/2308112654 learned_addr learned my addr 172.21.15.5:0/2308112654 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:28:35.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:35.271+0000 7f57a2ffd640 1 --2- 172.21.15.5:0/2308112654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57a4102800 0x7f57a419a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:35.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:35.271+0000 7f57a27fc640 1 --2- 172.21.15.5:0/2308112654 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57a4108140 0x7f57a419a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:35.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:35.271+0000 7f57a37fe640 1 -- 172.21.15.5:0/2308112654 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57a4108140 msgr2=0x7f57a419a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:35.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:35.271+0000 7f57a37fe640 1 --2- 172.21.15.5:0/2308112654 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57a4108140 0x7f57a419a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:35.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:35.271+0000 7f57a37fe640 1 -- 172.21.15.5:0/2308112654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57a4102800 msgr2=0x7f57a419a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:35.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:35.271+0000 7f57a37fe640 1 --2- 172.21.15.5:0/2308112654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57a4102800 0x7f57a419a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:35.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:35.271+0000 7f57a37fe640 1 -- 172.21.15.5:0/2308112654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57a41a01c0 con 0x7f57a4108a90 2024-08-31T05:28:35.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:35.272+0000 7f57a37fe640 1 --2- 172.21.15.5:0/2308112654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57a4108a90 0x7f57a419fb50 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f579c007f80 tx=0x7f579c00a6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:35.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:35.272+0000 7f578bfff640 1 -- 172.21.15.5:0/2308112654 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f579c01d070 con 0x7f57a4108a90 2024-08-31T05:28:35.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:35.272+0000 7f57a947f640 1 -- 172.21.15.5:0/2308112654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57a41a04b0 con 0x7f57a4108a90 2024-08-31T05:28:35.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:35.272+0000 7f57a947f640 1 -- 172.21.15.5:0/2308112654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57a4109290 con 0x7f57a4108a90 2024-08-31T05:28:35.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:35.272+0000 7f578bfff640 1 -- 172.21.15.5:0/2308112654 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f579c0169d0 con 0x7f57a4108a90 2024-08-31T05:28:35.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:35.272+0000 7f578bfff640 1 -- 172.21.15.5:0/2308112654 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f579c018a40 con 0x7f57a4108a90 2024-08-31T05:28:35.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:35.273+0000 7f57a947f640 1 -- 172.21.15.5:0/2308112654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5790005290 con 0x7f57a4108a90 2024-08-31T05:28:35.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:35.275+0000 7f578bfff640 1 -- 172.21.15.5:0/2308112654 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f579c020070 con 0x7f57a4108a90 2024-08-31T05:28:35.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:35.276+0000 7f578bfff640 1 --2- 172.21.15.5:0/2308112654 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f578c0b4cc0 0x7f578c0b71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:35.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:35.276+0000 7f57a2ffd640 1 --2- 172.21.15.5:0/2308112654 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f578c0b4cc0 0x7f578c0b71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:35.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:35.276+0000 7f578bfff640 1 -- 172.21.15.5:0/2308112654 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9307+0+0 (secure 0 0 0) 0x7f579c0e9ab0 con 0x7f57a4108a90 2024-08-31T05:28:35.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:35.277+0000 7f57a2ffd640 1 --2- 172.21.15.5:0/2308112654 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f578c0b4cc0 0x7f578c0b71d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5794031440 tx=0x7f5794005e80 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:35.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:35.279+0000 7f578bfff640 1 -- 172.21.15.5:0/2308112654 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f579c027070 con 0x7f57a4108a90 2024-08-31T05:28:35.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:35 smithi050 ceph-mon[22146]: pgmap v301: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.6 KiB/s wr, 12 op/s 2024-08-31T05:28:35.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:35.516+0000 7f57a947f640 1 -- 172.21.15.5:0/2308112654 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f5790005850 con 0x7f57a4108a90 2024-08-31T05:28:35.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:35.522+0000 7f578bfff640 1 -- 172.21.15.5:0/2308112654 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v21) ==== 74+0+293198 (secure 0 0 0) 0x7f579c0affa0 con 0x7f57a4108a90 2024-08-31T05:28:35.528 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:28:35.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:35.525+0000 7f57a947f640 1 -- 172.21.15.5:0/2308112654 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f578c0b4cc0 msgr2=0x7f578c0b71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:35.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:35.525+0000 7f57a947f640 1 --2- 172.21.15.5:0/2308112654 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f578c0b4cc0 0x7f578c0b71d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5794031440 tx=0x7f5794005e80 comp rx=0 tx=0).stop 2024-08-31T05:28:35.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:35.525+0000 7f57a947f640 1 -- 172.21.15.5:0/2308112654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57a4108a90 msgr2=0x7f57a419fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:35.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:35.525+0000 7f57a947f640 1 --2- 172.21.15.5:0/2308112654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57a4108a90 0x7f57a419fb50 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f579c007f80 tx=0x7f579c00a6e0 comp rx=0 tx=0).stop 2024-08-31T05:28:35.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:35.525+0000 7f57a947f640 1 -- 172.21.15.5:0/2308112654 shutdown_connections 2024-08-31T05:28:35.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:35.525+0000 7f57a947f640 1 --2- 172.21.15.5:0/2308112654 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f578c0b4cc0 0x7f578c0b71d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:35.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:35.525+0000 7f57a947f640 1 --2- 172.21.15.5:0/2308112654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57a4108a90 0x7f57a419fb50 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:35.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:35.525+0000 7f57a947f640 1 --2- 172.21.15.5:0/2308112654 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57a4108140 0x7f57a419a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:35.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:35.525+0000 7f57a947f640 1 --2- 172.21.15.5:0/2308112654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f57a4102800 0x7f57a419a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:35.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:35.525+0000 7f57a947f640 1 -- 172.21.15.5:0/2308112654 >> 172.21.15.5:0/2308112654 conn(0x7f57a40794d0 msgr2=0x7f57a4100360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:35.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:35.525+0000 7f57a947f640 1 -- 172.21.15.5:0/2308112654 shutdown_connections 2024-08-31T05:28:35.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:35.525+0000 7f57a947f640 1 -- 172.21.15.5:0/2308112654 wait complete. 2024-08-31T05:28:35.585 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:35 smithi070 ceph-mon[22316]: pgmap v301: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.6 KiB/s wr, 12 op/s 2024-08-31T05:28:36.219 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":21,"flags":0,"active_gid":14220,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":2696053609},{"type":"v1","addr":"172.21.15.5:6801","nonce":2696053609}]},"active_addr":"172.21.15.5:6801/2696053609","active_change":"2024-08-31T05:20:57.333810+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24130,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24164,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.5:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":202504371}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":4008651650}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":1995541846}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":1490833650}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":2765956719}]}]} 2024-08-31T05:28:36.226 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-08-31T05:28:36.226 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-08-31T05:28:36.226 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T05:28:36.408 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:36 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/2308112654' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-08-31T05:28:36.451 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:36 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/2308112654' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-08-31T05:28:36.482 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:28:36.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:36 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/2308112654' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-08-31T05:28:36.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:36.950+0000 7f111ac51640 1 -- 172.21.15.5:0/3982787870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1114102800 msgr2=0x7f1114102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:36.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:36.950+0000 7f111ac51640 1 --2- 172.21.15.5:0/3982787870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1114102800 0x7f1114102c10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f1104009900 tx=0x7f110402a410 comp rx=0 tx=0).stop 2024-08-31T05:28:36.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:36.950+0000 7f111ac51640 1 -- 172.21.15.5:0/3982787870 shutdown_connections 2024-08-31T05:28:36.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:36.950+0000 7f111ac51640 1 --2- 172.21.15.5:0/3982787870 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1114108a90 0x7f111410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:36.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:36.950+0000 7f111ac51640 1 --2- 172.21.15.5:0/3982787870 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1114108140 0x7f1114108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:36.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:36.950+0000 7f111ac51640 1 --2- 172.21.15.5:0/3982787870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1114102800 0x7f1114102c10 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:36.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:36.950+0000 7f111ac51640 1 -- 172.21.15.5:0/3982787870 >> 172.21.15.5:0/3982787870 conn(0x7f11140794d0 msgr2=0x7f11140798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:36.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:36.950+0000 7f111ac51640 1 -- 172.21.15.5:0/3982787870 shutdown_connections 2024-08-31T05:28:36.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:36.950+0000 7f111ac51640 1 -- 172.21.15.5:0/3982787870 wait complete. 2024-08-31T05:28:36.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:36.951+0000 7f111ac51640 1 Processor -- start 2024-08-31T05:28:36.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:36.951+0000 7f111ac51640 1 -- start start 2024-08-31T05:28:36.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:36.951+0000 7f111ac51640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1114102800 0x7f111419a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:36.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:36.951+0000 7f111ac51640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1114108140 0x7f111419a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:36.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:36.951+0000 7f111ac51640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1114108a90 0x7f111419fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:36.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:36.951+0000 7f111ac51640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1114113820 con 0x7f1114108a90 2024-08-31T05:28:36.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:36.951+0000 7f111ac51640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f11141136a0 con 0x7f1114102800 2024-08-31T05:28:36.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:36.951+0000 7f111ac51640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f11141139a0 con 0x7f1114108140 2024-08-31T05:28:36.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:36.952+0000 7f11191ee640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1114108a90 0x7f111419fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:36.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:36.952+0000 7f11191ee640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1114108a90 0x7f111419fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54946/0 (socket says 172.21.15.5:54946) 2024-08-31T05:28:36.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:36.952+0000 7f11191ee640 1 -- 172.21.15.5:0/3031689177 learned_addr learned my addr 172.21.15.5:0/3031689177 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:28:36.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:36.952+0000 7f11189ed640 1 --2- 172.21.15.5:0/3031689177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1114102800 0x7f111419a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:36.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:36.952+0000 7f1113fff640 1 --2- 172.21.15.5:0/3031689177 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1114108140 0x7f111419a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:36.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:36.952+0000 7f11191ee640 1 -- 172.21.15.5:0/3031689177 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1114108140 msgr2=0x7f111419a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:36.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:36.952+0000 7f11191ee640 1 --2- 172.21.15.5:0/3031689177 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1114108140 0x7f111419a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:36.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:36.952+0000 7f11191ee640 1 -- 172.21.15.5:0/3031689177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1114102800 msgr2=0x7f111419a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:36.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:36.952+0000 7f11191ee640 1 --2- 172.21.15.5:0/3031689177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1114102800 0x7f111419a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:36.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:36.952+0000 7f11191ee640 1 -- 172.21.15.5:0/3031689177 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11141a00a0 con 0x7f1114108a90 2024-08-31T05:28:36.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:36.952+0000 7f11191ee640 1 --2- 172.21.15.5:0/3031689177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1114108a90 0x7f111419fa30 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f110c00eaa0 tx=0x7f110c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:36.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:36.952+0000 7f1111ffb640 1 -- 172.21.15.5:0/3031689177 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f110c004d20 con 0x7f1114108a90 2024-08-31T05:28:36.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:36.952+0000 7f1111ffb640 1 -- 172.21.15.5:0/3031689177 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f110c005020 con 0x7f1114108a90 2024-08-31T05:28:36.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:36.952+0000 7f111ac51640 1 -- 172.21.15.5:0/3031689177 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11141a0390 con 0x7f1114108a90 2024-08-31T05:28:36.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:36.952+0000 7f1111ffb640 1 -- 172.21.15.5:0/3031689177 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f110c0116b0 con 0x7f1114108a90 2024-08-31T05:28:36.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:36.953+0000 7f111ac51640 1 -- 172.21.15.5:0/3031689177 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11141a6bb0 con 0x7f1114108a90 2024-08-31T05:28:36.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:36.954+0000 7f111ac51640 1 -- 172.21.15.5:0/3031689177 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1114102c10 con 0x7f1114108a90 2024-08-31T05:28:36.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:36.955+0000 7f1111ffb640 1 -- 172.21.15.5:0/3031689177 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f110c0051d0 con 0x7f1114108a90 2024-08-31T05:28:36.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:36.956+0000 7f1111ffb640 1 --2- 172.21.15.5:0/3031689177 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f10fc0b4cc0 0x7f10fc0b71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:36.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:36.956+0000 7f1111ffb640 1 -- 172.21.15.5:0/3031689177 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9307+0+0 (secure 0 0 0) 0x7f110c0e5c90 con 0x7f1114108a90 2024-08-31T05:28:36.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:36.956+0000 7f11189ed640 1 --2- 172.21.15.5:0/3031689177 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f10fc0b4cc0 0x7f10fc0b71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:36.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:36.956+0000 7f11189ed640 1 --2- 172.21.15.5:0/3031689177 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f10fc0b4cc0 0x7f10fc0b71d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1104031440 tx=0x7f1104009560 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:36.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:36.959+0000 7f1111ffb640 1 -- 172.21.15.5:0/3031689177 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f110c016030 con 0x7f1114108a90 2024-08-31T05:28:37.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:37.145+0000 7f111ac51640 1 -- 172.21.15.5:0/3031689177 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f111419b320 con 0x7f1114108a90 2024-08-31T05:28:37.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:37.146+0000 7f1111ffb640 1 -- 172.21.15.5:0/3031689177 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+24934 (secure 0 0 0) 0x7f111419b320 con 0x7f1114108a90 2024-08-31T05:28:37.150 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:28:37.150 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":85,"fsid":"69422704-6758-11ef-bcd4-c7b262605968","created":"2024-08-31T05:19:04.860258+0000","modified":"2024-08-31T05:27:58.494079+0000","last_up_change":"2024-08-31T05:26:38.675914+0000","last_in_change":"2024-08-31T05:26:15.366713+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T05:22:49.802575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T05:27:27.835197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T05:27:30.058144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-31T05:27:36.272228+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c5745391-e9d7-4799-9db9-6b34bb91b7df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6803","nonce":2312496244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6805","nonce":2312496244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6809","nonce":2312496244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6807","nonce":2312496244}]},"public_addr":"172.21.15.5:6803/2312496244","cluster_addr":"172.21.15.5:6805/2312496244","heartbeat_back_addr":"172.21.15.5:6809/2312496244","heartbeat_front_addr":"172.21.15.5:6807/2312496244","state":["exists","up"]},{"osd":1,"uuid":"f1903bd7-b2c5-424e-a74e-795f729471db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6801","nonce":2777359361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6803","nonce":2777359361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6807","nonce":2777359361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6805","nonce":2777359361}]},"public_addr":"172.21.15.50:6801/2777359361","cluster_addr":"172.21.15.50:6803/2777359361","heartbeat_back_addr":"172.21.15.50:6807/2777359361","heartbeat_front_addr":"172.21.15.50:6805/2777359361","state":["exists","up"]},{"osd":2,"uuid":"134c5892-e44a-44f2-8cd2-484d22a45e2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6801","nonce":1400583716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6803","nonce":1400583716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6807","nonce":1400583716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6805","nonce":1400583716}]},"public_addr":"172.21.15.70:6801/1400583716","cluster_addr":"172.21.15.70:6803/1400583716","heartbeat_back_addr":"172.21.15.70:6807/1400583716","heartbeat_front_addr":"172.21.15.70:6805/1400583716","state":["exists","up"]},{"osd":3,"uuid":"af49398a-e171-496b-a50e-1f767fc42923","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6811","nonce":1647468379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6813","nonce":1647468379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6817","nonce":1647468379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6815","nonce":1647468379}]},"public_addr":"172.21.15.5:6811/1647468379","cluster_addr":"172.21.15.5:6813/1647468379","heartbeat_back_addr":"172.21.15.5:6817/1647468379","heartbeat_front_addr":"172.21.15.5:6815/1647468379","state":["exists","up"]},{"osd":4,"uuid":"59b847ef-6eb0-4c13-aa06-53a76d77ce45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6809","nonce":2314546877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6811","nonce":2314546877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6815","nonce":2314546877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6813","nonce":2314546877}]},"public_addr":"172.21.15.50:6809/2314546877","cluster_addr":"172.21.15.50:6811/2314546877","heartbeat_back_addr":"172.21.15.50:6815/2314546877","heartbeat_front_addr":"172.21.15.50:6813/2314546877","state":["exists","up"]},{"osd":5,"uuid":"b0dac185-4462-4760-aa36-0d221923b007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6809","nonce":311426299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6811","nonce":311426299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6815","nonce":311426299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6813","nonce":311426299}]},"public_addr":"172.21.15.70:6809/311426299","cluster_addr":"172.21.15.70:6811/311426299","heartbeat_back_addr":"172.21.15.70:6815/311426299","heartbeat_front_addr":"172.21.15.70:6813/311426299","state":["exists","up"]},{"osd":6,"uuid":"12486aa2-61e4-4bdf-94dd-ce5c4cd3df6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6819","nonce":1027645612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6821","nonce":1027645612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6825","nonce":1027645612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6823","nonce":1027645612}]},"public_addr":"172.21.15.5:6819/1027645612","cluster_addr":"172.21.15.5:6821/1027645612","heartbeat_back_addr":"172.21.15.5:6825/1027645612","heartbeat_front_addr":"172.21.15.5:6823/1027645612","state":["exists","up"]},{"osd":7,"uuid":"66f9dcf9-d5c3-4016-812f-d9496e9892d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6817","nonce":2718354517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6819","nonce":2718354517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6823","nonce":2718354517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6821","nonce":2718354517}]},"public_addr":"172.21.15.50:6817/2718354517","cluster_addr":"172.21.15.50:6819/2718354517","heartbeat_back_addr":"172.21.15.50:6823/2718354517","heartbeat_front_addr":"172.21.15.50:6821/2718354517","state":["exists","up"]},{"osd":8,"uuid":"584837f9-af4b-4189-a7e5-04156a94a805","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6817","nonce":3155722993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6819","nonce":3155722993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6823","nonce":3155722993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6821","nonce":3155722993}]},"public_addr":"172.21.15.70:6817/3155722993","cluster_addr":"172.21.15.70:6819/3155722993","heartbeat_back_addr":"172.21.15.70:6823/3155722993","heartbeat_front_addr":"172.21.15.70:6821/3155722993","state":["exists","up"]},{"osd":9,"uuid":"ef60de6e-3456-435c-bd48-ed2636cc0d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6827","nonce":2988145512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6829","nonce":2988145512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6833","nonce":2988145512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6831","nonce":2988145512}]},"public_addr":"172.21.15.5:6827/2988145512","cluster_addr":"172.21.15.5:6829/2988145512","heartbeat_back_addr":"172.21.15.5:6833/2988145512","heartbeat_front_addr":"172.21.15.5:6831/2988145512","state":["exists","up"]},{"osd":10,"uuid":"96c5de40-53df-412d-9501-8ce1711a76a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6825","nonce":4168871229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6827","nonce":4168871229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6831","nonce":4168871229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6829","nonce":4168871229}]},"public_addr":"172.21.15.50:6825/4168871229","cluster_addr":"172.21.15.50:6827/4168871229","heartbeat_back_addr":"172.21.15.50:6831/4168871229","heartbeat_front_addr":"172.21.15.50:6829/4168871229","state":["exists","up"]},{"osd":11,"uuid":"20beefe0-59c3-4392-9f61-8d215e9d2de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6825","nonce":2593470535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6827","nonce":2593470535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6831","nonce":2593470535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6829","nonce":2593470535}]},"public_addr":"172.21.15.70:6825/2593470535","cluster_addr":"172.21.15.70:6827/2593470535","heartbeat_back_addr":"172.21.15.70:6831/2593470535","heartbeat_front_addr":"172.21.15.70:6829/2593470535","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:21:56.748083+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:22:21.969492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:22:46.642917+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:23:11.630486+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:23:36.389322+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:24:01.431039+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:24:27.057017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:24:53.628200+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:25:19.356502+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:25:44.958024+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:26:10.804919+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:26:36.849133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:0/2473024253":"2024-09-01T05:20:57.333680+0000","172.21.15.5:0/2924148490":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/2163558485":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/2111919168":"2024-09-01T05:19:55.663503+0000","172.21.15.5:6801/3616278616":"2024-09-01T05:19:55.663503+0000","172.21.15.5:0/2436421090":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/1570244689":"2024-09-01T05:19:55.663503+0000","172.21.15.5:0/2700448223":"2024-09-01T05:20:57.333680+0000","172.21.15.5:6800/3616278616":"2024-09-01T05:19:55.663503+0000","172.21.15.5:6800/2898463711":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/2450461036":"2024-09-01T05:20:57.333680+0000","172.21.15.5:0/1947189952":"2024-09-01T05:19:55.663503+0000","172.21.15.5:6800/1439868821":"2024-09-01T05:20:57.333680+0000","172.21.15.5:6801/2898463711":"2024-09-01T05:19:31.728664+0000","172.21.15.5:6801/1439868821":"2024-09-01T05:20:57.333680+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T05:28:37.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:37.148+0000 7f111ac51640 1 -- 172.21.15.5:0/3031689177 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f10fc0b4cc0 msgr2=0x7f10fc0b71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:37.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:37.148+0000 7f111ac51640 1 --2- 172.21.15.5:0/3031689177 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f10fc0b4cc0 0x7f10fc0b71d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1104031440 tx=0x7f1104009560 comp rx=0 tx=0).stop 2024-08-31T05:28:37.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:37.148+0000 7f111ac51640 1 -- 172.21.15.5:0/3031689177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1114108a90 msgr2=0x7f111419fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:37.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:37.148+0000 7f111ac51640 1 --2- 172.21.15.5:0/3031689177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1114108a90 0x7f111419fa30 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f110c00eaa0 tx=0x7f110c00eea0 comp rx=0 tx=0).stop 2024-08-31T05:28:37.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:37.149+0000 7f111ac51640 1 -- 172.21.15.5:0/3031689177 shutdown_connections 2024-08-31T05:28:37.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:37.149+0000 7f111ac51640 1 --2- 172.21.15.5:0/3031689177 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f10fc0b4cc0 0x7f10fc0b71d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:37.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:37.149+0000 7f111ac51640 1 --2- 172.21.15.5:0/3031689177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1114108a90 0x7f111419fa30 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:37.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:37.149+0000 7f111ac51640 1 --2- 172.21.15.5:0/3031689177 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1114108140 0x7f111419a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:37.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:37.149+0000 7f111ac51640 1 --2- 172.21.15.5:0/3031689177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1114102800 0x7f111419a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:37.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:37.149+0000 7f111ac51640 1 -- 172.21.15.5:0/3031689177 >> 172.21.15.5:0/3031689177 conn(0x7f11140794d0 msgr2=0x7f1114101190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:37.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:37.149+0000 7f111ac51640 1 -- 172.21.15.5:0/3031689177 shutdown_connections 2024-08-31T05:28:37.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:37.149+0000 7f111ac51640 1 -- 172.21.15.5:0/3031689177 wait complete. 2024-08-31T05:28:37.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:37 smithi050 ceph-mon[22146]: pgmap v302: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-08-31T05:28:37.450 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:37 smithi005 ceph-mon[18602]: pgmap v302: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-08-31T05:28:37.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:37 smithi070 ceph-mon[22316]: pgmap v302: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-08-31T05:28:37.789 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-08-31T05:28:37.789 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T05:28:38.045 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:28:38.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:38 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/3031689177' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T05:28:38.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:38 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/3031689177' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T05:28:38.487 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:38 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/3031689177' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T05:28:38.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.570+0000 7f598ffe8640 1 -- 172.21.15.5:0/132871803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5988109b90 msgr2=0x7f59881103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:38.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.570+0000 7f598ffe8640 1 --2- 172.21.15.5:0/132871803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5988109b90 0x7f59881103c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5980009ca0 tx=0x7f598002a8c0 comp rx=0 tx=0).stop 2024-08-31T05:28:38.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.570+0000 7f598ffe8640 1 -- 172.21.15.5:0/132871803 shutdown_connections 2024-08-31T05:28:38.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.570+0000 7f598ffe8640 1 --2- 172.21.15.5:0/132871803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5988109b90 0x7f59881103c0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:38.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.570+0000 7f598ffe8640 1 --2- 172.21.15.5:0/132871803 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5988109240 0x7f5988109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:38.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.570+0000 7f598ffe8640 1 --2- 172.21.15.5:0/132871803 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5988103900 0x7f5988103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:38.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.570+0000 7f598ffe8640 1 -- 172.21.15.5:0/132871803 >> 172.21.15.5:0/132871803 conn(0x7f598807b5f0 msgr2=0x7f598807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:38.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.570+0000 7f598ffe8640 1 -- 172.21.15.5:0/132871803 shutdown_connections 2024-08-31T05:28:38.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.570+0000 7f598ffe8640 1 -- 172.21.15.5:0/132871803 wait complete. 2024-08-31T05:28:38.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.570+0000 7f598ffe8640 1 Processor -- start 2024-08-31T05:28:38.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.570+0000 7f598ffe8640 1 -- start start 2024-08-31T05:28:38.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.571+0000 7f598ffe8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5988103900 0x7f598819a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:38.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.571+0000 7f598ffe8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5988109240 0x7f598819a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:38.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.571+0000 7f598ffe8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5988109b90 0x7f598819fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:38.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.571+0000 7f598ffe8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5988113850 con 0x7f5988109b90 2024-08-31T05:28:38.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.571+0000 7f598ffe8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f59881136d0 con 0x7f5988103900 2024-08-31T05:28:38.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.571+0000 7f598ffe8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f59881139d0 con 0x7f5988109240 2024-08-31T05:28:38.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.571+0000 7f598e585640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5988109b90 0x7f598819fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:38.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.571+0000 7f598e585640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5988109b90 0x7f598819fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54974/0 (socket says 172.21.15.5:54974) 2024-08-31T05:28:38.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.571+0000 7f598e585640 1 -- 172.21.15.5:0/3733235773 learned_addr learned my addr 172.21.15.5:0/3733235773 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:28:38.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.571+0000 7f598d583640 1 --2- 172.21.15.5:0/3733235773 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5988109240 0x7f598819a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:38.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.571+0000 7f598dd84640 1 --2- 172.21.15.5:0/3733235773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5988103900 0x7f598819a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:38.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.571+0000 7f598e585640 1 -- 172.21.15.5:0/3733235773 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5988109240 msgr2=0x7f598819a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:38.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.571+0000 7f598e585640 1 --2- 172.21.15.5:0/3733235773 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5988109240 0x7f598819a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:38.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.571+0000 7f598e585640 1 -- 172.21.15.5:0/3733235773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5988103900 msgr2=0x7f598819a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:38.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.571+0000 7f598e585640 1 --2- 172.21.15.5:0/3733235773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5988103900 0x7f598819a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:38.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.571+0000 7f598e585640 1 -- 172.21.15.5:0/3733235773 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59881a0170 con 0x7f5988109b90 2024-08-31T05:28:38.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.571+0000 7f598dd84640 1 --2- 172.21.15.5:0/3733235773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5988103900 0x7f598819a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:28:38.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.571+0000 7f598e585640 1 --2- 172.21.15.5:0/3733235773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5988109b90 0x7f598819fa40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f59800098d0 tx=0x7f59800317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:38.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.572+0000 7f597effd640 1 -- 172.21.15.5:0/3733235773 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5980003b70 con 0x7f5988109b90 2024-08-31T05:28:38.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.572+0000 7f597effd640 1 -- 172.21.15.5:0/3733235773 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5980003d10 con 0x7f5988109b90 2024-08-31T05:28:38.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.572+0000 7f598ffe8640 1 -- 172.21.15.5:0/3733235773 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59881a0400 con 0x7f5988109b90 2024-08-31T05:28:38.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.572+0000 7f597effd640 1 -- 172.21.15.5:0/3733235773 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f598002fa20 con 0x7f5988109b90 2024-08-31T05:28:38.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.572+0000 7f598ffe8640 1 -- 172.21.15.5:0/3733235773 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59881a6bc0 con 0x7f5988109b90 2024-08-31T05:28:38.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.573+0000 7f598ffe8640 1 -- 172.21.15.5:0/3733235773 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5988103d10 con 0x7f5988109b90 2024-08-31T05:28:38.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.574+0000 7f597effd640 1 -- 172.21.15.5:0/3733235773 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f598002fbe0 con 0x7f5988109b90 2024-08-31T05:28:38.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.575+0000 7f597effd640 1 --2- 172.21.15.5:0/3733235773 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f59740b4c10 0x7f59740b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:38.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.575+0000 7f598dd84640 1 --2- 172.21.15.5:0/3733235773 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f59740b4c10 0x7f59740b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:38.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.576+0000 7f597effd640 1 -- 172.21.15.5:0/3733235773 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9307+0+0 (secure 0 0 0) 0x7f5980106c40 con 0x7f5988109b90 2024-08-31T05:28:38.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.576+0000 7f598dd84640 1 --2- 172.21.15.5:0/3733235773 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f59740b4c10 0x7f59740b7120 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5984005d00 tx=0x7f5984005c70 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:38.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.579+0000 7f597effd640 1 -- 172.21.15.5:0/3733235773 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f59800cd780 con 0x7f5988109b90 2024-08-31T05:28:38.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.763+0000 7f598ffe8640 1 -- 172.21.15.5:0/3733235773 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f598819b330 con 0x7f5988109b90 2024-08-31T05:28:38.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.764+0000 7f597effd640 1 -- 172.21.15.5:0/3733235773 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+24934 (secure 0 0 0) 0x7f598819b330 con 0x7f5988109b90 2024-08-31T05:28:38.767 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:28:38.767 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":85,"fsid":"69422704-6758-11ef-bcd4-c7b262605968","created":"2024-08-31T05:19:04.860258+0000","modified":"2024-08-31T05:27:58.494079+0000","last_up_change":"2024-08-31T05:26:38.675914+0000","last_in_change":"2024-08-31T05:26:15.366713+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T05:22:49.802575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T05:27:27.835197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T05:27:30.058144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-31T05:27:36.272228+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c5745391-e9d7-4799-9db9-6b34bb91b7df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6803","nonce":2312496244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6805","nonce":2312496244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6809","nonce":2312496244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6807","nonce":2312496244}]},"public_addr":"172.21.15.5:6803/2312496244","cluster_addr":"172.21.15.5:6805/2312496244","heartbeat_back_addr":"172.21.15.5:6809/2312496244","heartbeat_front_addr":"172.21.15.5:6807/2312496244","state":["exists","up"]},{"osd":1,"uuid":"f1903bd7-b2c5-424e-a74e-795f729471db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6801","nonce":2777359361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6803","nonce":2777359361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6807","nonce":2777359361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6805","nonce":2777359361}]},"public_addr":"172.21.15.50:6801/2777359361","cluster_addr":"172.21.15.50:6803/2777359361","heartbeat_back_addr":"172.21.15.50:6807/2777359361","heartbeat_front_addr":"172.21.15.50:6805/2777359361","state":["exists","up"]},{"osd":2,"uuid":"134c5892-e44a-44f2-8cd2-484d22a45e2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6801","nonce":1400583716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6803","nonce":1400583716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6807","nonce":1400583716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6805","nonce":1400583716}]},"public_addr":"172.21.15.70:6801/1400583716","cluster_addr":"172.21.15.70:6803/1400583716","heartbeat_back_addr":"172.21.15.70:6807/1400583716","heartbeat_front_addr":"172.21.15.70:6805/1400583716","state":["exists","up"]},{"osd":3,"uuid":"af49398a-e171-496b-a50e-1f767fc42923","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6811","nonce":1647468379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6813","nonce":1647468379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6817","nonce":1647468379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6815","nonce":1647468379}]},"public_addr":"172.21.15.5:6811/1647468379","cluster_addr":"172.21.15.5:6813/1647468379","heartbeat_back_addr":"172.21.15.5:6817/1647468379","heartbeat_front_addr":"172.21.15.5:6815/1647468379","state":["exists","up"]},{"osd":4,"uuid":"59b847ef-6eb0-4c13-aa06-53a76d77ce45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6809","nonce":2314546877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6811","nonce":2314546877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6815","nonce":2314546877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6813","nonce":2314546877}]},"public_addr":"172.21.15.50:6809/2314546877","cluster_addr":"172.21.15.50:6811/2314546877","heartbeat_back_addr":"172.21.15.50:6815/2314546877","heartbeat_front_addr":"172.21.15.50:6813/2314546877","state":["exists","up"]},{"osd":5,"uuid":"b0dac185-4462-4760-aa36-0d221923b007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6809","nonce":311426299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6811","nonce":311426299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6815","nonce":311426299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6813","nonce":311426299}]},"public_addr":"172.21.15.70:6809/311426299","cluster_addr":"172.21.15.70:6811/311426299","heartbeat_back_addr":"172.21.15.70:6815/311426299","heartbeat_front_addr":"172.21.15.70:6813/311426299","state":["exists","up"]},{"osd":6,"uuid":"12486aa2-61e4-4bdf-94dd-ce5c4cd3df6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6819","nonce":1027645612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6821","nonce":1027645612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6825","nonce":1027645612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6823","nonce":1027645612}]},"public_addr":"172.21.15.5:6819/1027645612","cluster_addr":"172.21.15.5:6821/1027645612","heartbeat_back_addr":"172.21.15.5:6825/1027645612","heartbeat_front_addr":"172.21.15.5:6823/1027645612","state":["exists","up"]},{"osd":7,"uuid":"66f9dcf9-d5c3-4016-812f-d9496e9892d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6817","nonce":2718354517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6819","nonce":2718354517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6823","nonce":2718354517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6821","nonce":2718354517}]},"public_addr":"172.21.15.50:6817/2718354517","cluster_addr":"172.21.15.50:6819/2718354517","heartbeat_back_addr":"172.21.15.50:6823/2718354517","heartbeat_front_addr":"172.21.15.50:6821/2718354517","state":["exists","up"]},{"osd":8,"uuid":"584837f9-af4b-4189-a7e5-04156a94a805","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6817","nonce":3155722993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6819","nonce":3155722993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6823","nonce":3155722993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6821","nonce":3155722993}]},"public_addr":"172.21.15.70:6817/3155722993","cluster_addr":"172.21.15.70:6819/3155722993","heartbeat_back_addr":"172.21.15.70:6823/3155722993","heartbeat_front_addr":"172.21.15.70:6821/3155722993","state":["exists","up"]},{"osd":9,"uuid":"ef60de6e-3456-435c-bd48-ed2636cc0d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6827","nonce":2988145512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6829","nonce":2988145512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6833","nonce":2988145512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6831","nonce":2988145512}]},"public_addr":"172.21.15.5:6827/2988145512","cluster_addr":"172.21.15.5:6829/2988145512","heartbeat_back_addr":"172.21.15.5:6833/2988145512","heartbeat_front_addr":"172.21.15.5:6831/2988145512","state":["exists","up"]},{"osd":10,"uuid":"96c5de40-53df-412d-9501-8ce1711a76a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6825","nonce":4168871229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6827","nonce":4168871229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6831","nonce":4168871229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6829","nonce":4168871229}]},"public_addr":"172.21.15.50:6825/4168871229","cluster_addr":"172.21.15.50:6827/4168871229","heartbeat_back_addr":"172.21.15.50:6831/4168871229","heartbeat_front_addr":"172.21.15.50:6829/4168871229","state":["exists","up"]},{"osd":11,"uuid":"20beefe0-59c3-4392-9f61-8d215e9d2de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6825","nonce":2593470535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6827","nonce":2593470535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6831","nonce":2593470535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6829","nonce":2593470535}]},"public_addr":"172.21.15.70:6825/2593470535","cluster_addr":"172.21.15.70:6827/2593470535","heartbeat_back_addr":"172.21.15.70:6831/2593470535","heartbeat_front_addr":"172.21.15.70:6829/2593470535","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:21:56.748083+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:22:21.969492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:22:46.642917+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:23:11.630486+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:23:36.389322+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:24:01.431039+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:24:27.057017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:24:53.628200+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:25:19.356502+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:25:44.958024+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:26:10.804919+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:26:36.849133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:0/2473024253":"2024-09-01T05:20:57.333680+0000","172.21.15.5:0/2924148490":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/2163558485":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/2111919168":"2024-09-01T05:19:55.663503+0000","172.21.15.5:6801/3616278616":"2024-09-01T05:19:55.663503+0000","172.21.15.5:0/2436421090":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/1570244689":"2024-09-01T05:19:55.663503+0000","172.21.15.5:0/2700448223":"2024-09-01T05:20:57.333680+0000","172.21.15.5:6800/3616278616":"2024-09-01T05:19:55.663503+0000","172.21.15.5:6800/2898463711":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/2450461036":"2024-09-01T05:20:57.333680+0000","172.21.15.5:0/1947189952":"2024-09-01T05:19:55.663503+0000","172.21.15.5:6800/1439868821":"2024-09-01T05:20:57.333680+0000","172.21.15.5:6801/2898463711":"2024-09-01T05:19:31.728664+0000","172.21.15.5:6801/1439868821":"2024-09-01T05:20:57.333680+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T05:28:38.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.767+0000 7f598ffe8640 1 -- 172.21.15.5:0/3733235773 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f59740b4c10 msgr2=0x7f59740b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:38.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.767+0000 7f598ffe8640 1 --2- 172.21.15.5:0/3733235773 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f59740b4c10 0x7f59740b7120 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5984005d00 tx=0x7f5984005c70 comp rx=0 tx=0).stop 2024-08-31T05:28:38.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.767+0000 7f598ffe8640 1 -- 172.21.15.5:0/3733235773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5988109b90 msgr2=0x7f598819fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:38.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.767+0000 7f598ffe8640 1 --2- 172.21.15.5:0/3733235773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5988109b90 0x7f598819fa40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f59800098d0 tx=0x7f59800317b0 comp rx=0 tx=0).stop 2024-08-31T05:28:38.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.767+0000 7f598ffe8640 1 -- 172.21.15.5:0/3733235773 shutdown_connections 2024-08-31T05:28:38.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.767+0000 7f598ffe8640 1 --2- 172.21.15.5:0/3733235773 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f59740b4c10 0x7f59740b7120 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:38.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.767+0000 7f598ffe8640 1 --2- 172.21.15.5:0/3733235773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5988109b90 0x7f598819fa40 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:38.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.767+0000 7f598ffe8640 1 --2- 172.21.15.5:0/3733235773 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5988109240 0x7f598819a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:38.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.767+0000 7f598ffe8640 1 --2- 172.21.15.5:0/3733235773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5988103900 0x7f598819a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:38.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.767+0000 7f598ffe8640 1 -- 172.21.15.5:0/3733235773 >> 172.21.15.5:0/3733235773 conn(0x7f598807b5f0 msgr2=0x7f5988107290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:38.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.767+0000 7f598ffe8640 1 -- 172.21.15.5:0/3733235773 shutdown_connections 2024-08-31T05:28:38.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:38.767+0000 7f598ffe8640 1 -- 172.21.15.5:0/3733235773 wait complete. 2024-08-31T05:28:39.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:39 smithi050 ceph-mon[22146]: pgmap v303: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-08-31T05:28:39.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:39 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/3733235773' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T05:28:39.444 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:39 smithi005 ceph-mon[18602]: pgmap v303: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-08-31T05:28:39.444 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:39 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/3733235773' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T05:28:39.475 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-08-31T05:28:39.475 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-08-31T05:28:39.476 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-08-31T05:28:39.476 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-08-31T05:28:39.477 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-08-31T05:28:39.477 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-08-31T05:28:39.477 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-08-31T05:28:39.478 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-08-31T05:28:39.478 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-08-31T05:28:39.479 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-08-31T05:28:39.479 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-08-31T05:28:39.479 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-08-31T05:28:39.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:39 smithi070 ceph-mon[22316]: pgmap v303: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-08-31T05:28:39.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:39 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/3733235773' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T05:28:40.084 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:28:40.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.705+0000 7f41834f1640 1 -- 172.21.15.5:0/3943262452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f417c108b40 msgr2=0x7f417c10f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:40.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.705+0000 7f41834f1640 1 --2- 172.21.15.5:0/3943262452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f417c108b40 0x7f417c10f370 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4174009ca0 tx=0x7f417402a8c0 comp rx=0 tx=0).stop 2024-08-31T05:28:40.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.705+0000 7f41834f1640 1 -- 172.21.15.5:0/3943262452 shutdown_connections 2024-08-31T05:28:40.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.705+0000 7f41834f1640 1 --2- 172.21.15.5:0/3943262452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f417c108b40 0x7f417c10f370 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:40.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.705+0000 7f41834f1640 1 --2- 172.21.15.5:0/3943262452 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f417c1081f0 0x7f417c108600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:40.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.705+0000 7f41834f1640 1 --2- 172.21.15.5:0/3943262452 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f417c1028b0 0x7f417c102cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:40.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.705+0000 7f41834f1640 1 -- 172.21.15.5:0/3943262452 >> 172.21.15.5:0/3943262452 conn(0x7f417c079470 msgr2=0x7f417c079880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:40.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.705+0000 7f41834f1640 1 -- 172.21.15.5:0/3943262452 shutdown_connections 2024-08-31T05:28:40.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.705+0000 7f41834f1640 1 -- 172.21.15.5:0/3943262452 wait complete. 2024-08-31T05:28:40.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.706+0000 7f41834f1640 1 Processor -- start 2024-08-31T05:28:40.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.706+0000 7f41834f1640 1 -- start start 2024-08-31T05:28:40.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.706+0000 7f41834f1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f417c1028b0 0x7f417c19a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:40.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.706+0000 7f41834f1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f417c1081f0 0x7f417c19a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:40.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.706+0000 7f41834f1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f417c108b40 0x7f417c19faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:40.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.706+0000 7f41834f1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f417c1127f0 con 0x7f417c1081f0 2024-08-31T05:28:40.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.706+0000 7f41834f1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f417c112670 con 0x7f417c108b40 2024-08-31T05:28:40.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.706+0000 7f41834f1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f417c112970 con 0x7f417c1028b0 2024-08-31T05:28:40.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.706+0000 7f4180a8c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f417c1081f0 0x7f417c19a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:40.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.706+0000 7f4180a8c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f417c1081f0 0x7f417c19a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54990/0 (socket says 172.21.15.5:54990) 2024-08-31T05:28:40.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.706+0000 7f4180a8c640 1 -- 172.21.15.5:0/667817149 learned_addr learned my addr 172.21.15.5:0/667817149 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:28:40.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.706+0000 7f418128d640 1 --2- 172.21.15.5:0/667817149 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f417c1028b0 0x7f417c19a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:40.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.706+0000 7f4181a8e640 1 --2- 172.21.15.5:0/667817149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f417c108b40 0x7f417c19faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:40.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.707+0000 7f4180a8c640 1 -- 172.21.15.5:0/667817149 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f417c1028b0 msgr2=0x7f417c19a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:40.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.707+0000 7f4180a8c640 1 --2- 172.21.15.5:0/667817149 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f417c1028b0 0x7f417c19a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:40.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.707+0000 7f4180a8c640 1 -- 172.21.15.5:0/667817149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f417c108b40 msgr2=0x7f417c19faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:40.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.707+0000 7f4180a8c640 1 --2- 172.21.15.5:0/667817149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f417c108b40 0x7f417c19faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:40.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.707+0000 7f4180a8c640 1 -- 172.21.15.5:0/667817149 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f417c1a0220 con 0x7f417c1081f0 2024-08-31T05:28:40.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.707+0000 7f418128d640 1 --2- 172.21.15.5:0/667817149 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f417c1028b0 0x7f417c19a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:28:40.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.707+0000 7f4180a8c640 1 --2- 172.21.15.5:0/667817149 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f417c1081f0 0x7f417c19a850 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f417800e9f0 tx=0x7f417800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:40.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.707+0000 7f416e7fc640 1 -- 172.21.15.5:0/667817149 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417800ccc0 con 0x7f417c1081f0 2024-08-31T05:28:40.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.707+0000 7f416e7fc640 1 -- 172.21.15.5:0/667817149 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f41780108e0 con 0x7f417c1081f0 2024-08-31T05:28:40.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.707+0000 7f41834f1640 1 -- 172.21.15.5:0/667817149 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f417c1a0510 con 0x7f417c1081f0 2024-08-31T05:28:40.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.707+0000 7f416e7fc640 1 -- 172.21.15.5:0/667817149 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4178018860 con 0x7f417c1081f0 2024-08-31T05:28:40.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.707+0000 7f41834f1640 1 -- 172.21.15.5:0/667817149 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f417c1a6c70 con 0x7f417c1081f0 2024-08-31T05:28:40.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.708+0000 7f41834f1640 1 -- 172.21.15.5:0/667817149 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f417c063870 con 0x7f417c1081f0 2024-08-31T05:28:40.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.709+0000 7f416e7fc640 1 -- 172.21.15.5:0/667817149 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f4178010430 con 0x7f417c1081f0 2024-08-31T05:28:40.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.710+0000 7f416e7fc640 1 --2- 172.21.15.5:0/667817149 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f41680b4c90 0x7f41680b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:40.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.710+0000 7f418128d640 1 --2- 172.21.15.5:0/667817149 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f41680b4c90 0x7f41680b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:40.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.710+0000 7f416e7fc640 1 -- 172.21.15.5:0/667817149 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9307+0+0 (secure 0 0 0) 0x7f41780e6190 con 0x7f417c1081f0 2024-08-31T05:28:40.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.710+0000 7f416e7fc640 1 --2- 172.21.15.5:0/667817149 >> [v2:172.21.15.5:6802/2312496244,v1:172.21.15.5:6803/2312496244] conn(0x7f41680c0020 0x7f41680c2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:40.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.710+0000 7f416e7fc640 1 -- 172.21.15.5:0/667817149 --> [v2:172.21.15.5:6802/2312496244,v1:172.21.15.5:6803/2312496244] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f41680c2be0 con 0x7f41680c0020 2024-08-31T05:28:40.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.710+0000 7f416e7fc640 1 -- 172.21.15.5:0/667817149 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f41780e65e0 con 0x7f417c1081f0 2024-08-31T05:28:40.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.711+0000 7f4181a8e640 1 --2- 172.21.15.5:0/667817149 >> [v2:172.21.15.5:6802/2312496244,v1:172.21.15.5:6803/2312496244] conn(0x7f41680c0020 0x7f41680c2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:40.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.711+0000 7f418128d640 1 --2- 172.21.15.5:0/667817149 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f41680b4c90 0x7f41680b71a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4170009c20 tx=0x7f4170005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:40.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.711+0000 7f4181a8e640 1 --2- 172.21.15.5:0/667817149 >> [v2:172.21.15.5:6802/2312496244,v1:172.21.15.5:6803/2312496244] conn(0x7f41680c0020 0x7f41680c2510 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:40.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.712+0000 7f416e7fc640 1 -- 172.21.15.5:0/667817149 <== osd.0 v2:172.21.15.5:6802/2312496244 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f41680c2be0 con 0x7f41680c0020 2024-08-31T05:28:40.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.726+0000 7f41834f1640 1 -- 172.21.15.5:0/667817149 --> [v2:172.21.15.5:6802/2312496244,v1:172.21.15.5:6803/2312496244] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f417c063c70 con 0x7f41680c0020 2024-08-31T05:28:40.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.726+0000 7f416e7fc640 1 -- 172.21.15.5:0/667817149 <== osd.0 v2:172.21.15.5:6802/2312496244 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f417c063c70 con 0x7f41680c0020 2024-08-31T05:28:40.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.726+0000 7f41834f1640 1 -- 172.21.15.5:0/667817149 >> [v2:172.21.15.5:6802/2312496244,v1:172.21.15.5:6803/2312496244] conn(0x7f41680c0020 msgr2=0x7f41680c2510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:40.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.726+0000 7f41834f1640 1 --2- 172.21.15.5:0/667817149 >> [v2:172.21.15.5:6802/2312496244,v1:172.21.15.5:6803/2312496244] conn(0x7f41680c0020 0x7f41680c2510 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:40.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.726+0000 7f41834f1640 1 -- 172.21.15.5:0/667817149 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f41680b4c90 msgr2=0x7f41680b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:40.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.726+0000 7f41834f1640 1 --2- 172.21.15.5:0/667817149 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f41680b4c90 0x7f41680b71a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4170009c20 tx=0x7f4170005f90 comp rx=0 tx=0).stop 2024-08-31T05:28:40.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.726+0000 7f41834f1640 1 -- 172.21.15.5:0/667817149 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f417c1081f0 msgr2=0x7f417c19a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:40.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.726+0000 7f41834f1640 1 --2- 172.21.15.5:0/667817149 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f417c1081f0 0x7f417c19a850 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f417800e9f0 tx=0x7f417800eeb0 comp rx=0 tx=0).stop 2024-08-31T05:28:40.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.726+0000 7f4181a8e640 1 -- 172.21.15.5:0/667817149 reap_dead start 2024-08-31T05:28:40.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.727+0000 7f41834f1640 1 -- 172.21.15.5:0/667817149 shutdown_connections 2024-08-31T05:28:40.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.727+0000 7f41834f1640 1 -- 172.21.15.5:0/667817149 >> 172.21.15.5:0/667817149 conn(0x7f417c079470 msgr2=0x7f417c101810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:40.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.727+0000 7f41834f1640 1 -- 172.21.15.5:0/667817149 shutdown_connections 2024-08-31T05:28:40.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:40.727+0000 7f41834f1640 1 -- 172.21.15.5:0/667817149 wait complete. 2024-08-31T05:28:41.385 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:41 smithi005 ceph-mon[18602]: pgmap v304: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-08-31T05:28:41.386 INFO:teuthology.orchestra.run.smithi005.stdout:38654705748 2024-08-31T05:28:41.387 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-08-31T05:28:41.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:41 smithi050 ceph-mon[22146]: pgmap v304: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-08-31T05:28:41.420 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:28:41.430 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:28:41.430 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:28:41.430 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:28:41.431 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:28:41.437 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:28:41.526 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:28:41.527 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:28:41.528 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:28:41.533 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:28:41.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:41 smithi070 ceph-mon[22316]: pgmap v304: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-08-31T05:28:42.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.102+0000 7fba1ca8c640 1 -- 172.21.15.5:0/4190273294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba18108160 msgr2=0x7fba18108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:42.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.102+0000 7fba1ca8c640 1 --2- 172.21.15.5:0/4190273294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba18108160 0x7fba18108570 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fba00009900 tx=0x7fba0002a410 comp rx=0 tx=0).stop 2024-08-31T05:28:42.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.102+0000 7fba1ca8c640 1 -- 172.21.15.5:0/4190273294 shutdown_connections 2024-08-31T05:28:42.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.102+0000 7fba1ca8c640 1 --2- 172.21.15.5:0/4190273294 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba18108ab0 0x7fba1810f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:42.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.102+0000 7fba1ca8c640 1 --2- 172.21.15.5:0/4190273294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba18108160 0x7fba18108570 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:42.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.102+0000 7fba1ca8c640 1 --2- 172.21.15.5:0/4190273294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba18102820 0x7fba18102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:42.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.102+0000 7fba1ca8c640 1 -- 172.21.15.5:0/4190273294 >> 172.21.15.5:0/4190273294 conn(0x7fba180794e0 msgr2=0x7fba180798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:42.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.102+0000 7fba1ca8c640 1 -- 172.21.15.5:0/4190273294 shutdown_connections 2024-08-31T05:28:42.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.102+0000 7fba1ca8c640 1 -- 172.21.15.5:0/4190273294 wait complete. 2024-08-31T05:28:42.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.103+0000 7fba1ca8c640 1 Processor -- start 2024-08-31T05:28:42.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.103+0000 7fba1ca8c640 1 -- start start 2024-08-31T05:28:42.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.103+0000 7fba1ca8c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba18102820 0x7fba1819b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:42.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.103+0000 7fba1ca8c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba18108160 0x7fba1819b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:42.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.104+0000 7fba1ca8c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba18108ab0 0x7fba1819bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:42.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.104+0000 7fba1ca8c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fba18112700 con 0x7fba18102820 2024-08-31T05:28:42.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.104+0000 7fba1ca8c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fba18112580 con 0x7fba18108ab0 2024-08-31T05:28:42.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.104+0000 7fba1ca8c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fba18112880 con 0x7fba18108160 2024-08-31T05:28:42.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.104+0000 7fba1659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba18102820 0x7fba1819b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:42.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.104+0000 7fba1659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba18102820 0x7fba1819b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35374/0 (socket says 172.21.15.5:35374) 2024-08-31T05:28:42.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.104+0000 7fba1659c640 1 -- 172.21.15.5:0/1636086469 learned_addr learned my addr 172.21.15.5:0/1636086469 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:28:42.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.104+0000 7fba16d9d640 1 --2- 172.21.15.5:0/1636086469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba18108ab0 0x7fba1819bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:42.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.104+0000 7fba15d9b640 1 --2- 172.21.15.5:0/1636086469 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba18108160 0x7fba1819b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:42.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.104+0000 7fba1659c640 1 -- 172.21.15.5:0/1636086469 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba18108160 msgr2=0x7fba1819b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:42.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.104+0000 7fba1659c640 1 --2- 172.21.15.5:0/1636086469 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba18108160 0x7fba1819b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:42.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.104+0000 7fba1659c640 1 -- 172.21.15.5:0/1636086469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba18108ab0 msgr2=0x7fba1819bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:42.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.104+0000 7fba1659c640 1 --2- 172.21.15.5:0/1636086469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba18108ab0 0x7fba1819bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:42.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.104+0000 7fba1659c640 1 -- 172.21.15.5:0/1636086469 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba181a63a0 con 0x7fba18102820 2024-08-31T05:28:42.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.104+0000 7fba16d9d640 1 --2- 172.21.15.5:0/1636086469 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fba18108ab0 0x7fba1819bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:28:42.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.104+0000 7fba1659c640 1 --2- 172.21.15.5:0/1636086469 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba18102820 0x7fba1819b110 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fba0800ea60 tx=0x7fba0800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:42.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.104+0000 7fba0f7fe640 1 -- 172.21.15.5:0/1636086469 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0800cde0 con 0x7fba18102820 2024-08-31T05:28:42.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.104+0000 7fba1ca8c640 1 -- 172.21.15.5:0/1636086469 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba181a6690 con 0x7fba18102820 2024-08-31T05:28:42.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.104+0000 7fba0f7fe640 1 -- 172.21.15.5:0/1636086469 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba080035f0 con 0x7fba18102820 2024-08-31T05:28:42.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.104+0000 7fba0f7fe640 1 -- 172.21.15.5:0/1636086469 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba08010690 con 0x7fba18102820 2024-08-31T05:28:42.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.104+0000 7fba1ca8c640 1 -- 172.21.15.5:0/1636086469 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba181a6ba0 con 0x7fba18102820 2024-08-31T05:28:42.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.105+0000 7fba1ca8c640 1 -- 172.21.15.5:0/1636086469 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fba180638f0 con 0x7fba18102820 2024-08-31T05:28:42.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.107+0000 7fba0f7fe640 1 -- 172.21.15.5:0/1636086469 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7fba080037a0 con 0x7fba18102820 2024-08-31T05:28:42.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.107+0000 7fba0f7fe640 1 --2- 172.21.15.5:0/1636086469 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fba040b4c40 0x7fba040b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:42.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.108+0000 7fba0f7fe640 1 -- 172.21.15.5:0/1636086469 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9307+0+0 (secure 0 0 0) 0x7fba080e5ec0 con 0x7fba18102820 2024-08-31T05:28:42.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.108+0000 7fba15d9b640 1 --2- 172.21.15.5:0/1636086469 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fba040b4c40 0x7fba040b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:42.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.108+0000 7fba0f7fe640 1 --2- 172.21.15.5:0/1636086469 >> [v2:172.21.15.70:6824/2593470535,v1:172.21.15.70:6825/2593470535] conn(0x7fba040bffd0 0x7fba040c24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:42.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.108+0000 7fba0f7fe640 1 -- 172.21.15.5:0/1636086469 --> [v2:172.21.15.70:6824/2593470535,v1:172.21.15.70:6825/2593470535] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fba08022e50 con 0x7fba040bffd0 2024-08-31T05:28:42.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.108+0000 7fba0f7fe640 1 -- 172.21.15.5:0/1636086469 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7fba080e6310 con 0x7fba18102820 2024-08-31T05:28:42.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.108+0000 7fba16d9d640 1 --2- 172.21.15.5:0/1636086469 >> [v2:172.21.15.70:6824/2593470535,v1:172.21.15.70:6825/2593470535] conn(0x7fba040bffd0 0x7fba040c24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:42.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.108+0000 7fba15d9b640 1 --2- 172.21.15.5:0/1636086469 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fba040b4c40 0x7fba040b7150 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fba00000c00 tx=0x7fba00031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:42.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.109+0000 7fba16d9d640 1 --2- 172.21.15.5:0/1636086469 >> [v2:172.21.15.70:6824/2593470535,v1:172.21.15.70:6825/2593470535] conn(0x7fba040bffd0 0x7fba040c24c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:42.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.109+0000 7fba0f7fe640 1 -- 172.21.15.5:0/1636086469 <== osd.11 v2:172.21.15.70:6824/2593470535 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fba08022e50 con 0x7fba040bffd0 2024-08-31T05:28:42.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.123+0000 7fba1ca8c640 1 -- 172.21.15.5:0/1636086469 --> [v2:172.21.15.70:6824/2593470535,v1:172.21.15.70:6825/2593470535] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fba18063d70 con 0x7fba040bffd0 2024-08-31T05:28:42.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.124+0000 7fba0f7fe640 1 -- 172.21.15.5:0/1636086469 <== osd.11 v2:172.21.15.70:6824/2593470535 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fba18063d70 con 0x7fba040bffd0 2024-08-31T05:28:42.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.124+0000 7fba1ca8c640 1 -- 172.21.15.5:0/1636086469 >> [v2:172.21.15.70:6824/2593470535,v1:172.21.15.70:6825/2593470535] conn(0x7fba040bffd0 msgr2=0x7fba040c24c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:42.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.124+0000 7fba1ca8c640 1 --2- 172.21.15.5:0/1636086469 >> [v2:172.21.15.70:6824/2593470535,v1:172.21.15.70:6825/2593470535] conn(0x7fba040bffd0 0x7fba040c24c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:42.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.124+0000 7fba1ca8c640 1 -- 172.21.15.5:0/1636086469 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fba040b4c40 msgr2=0x7fba040b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:42.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.124+0000 7fba1ca8c640 1 --2- 172.21.15.5:0/1636086469 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fba040b4c40 0x7fba040b7150 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fba00000c00 tx=0x7fba00031400 comp rx=0 tx=0).stop 2024-08-31T05:28:42.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.124+0000 7fba1ca8c640 1 -- 172.21.15.5:0/1636086469 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba18102820 msgr2=0x7fba1819b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:42.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.124+0000 7fba1ca8c640 1 --2- 172.21.15.5:0/1636086469 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba18102820 0x7fba1819b110 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fba0800ea60 tx=0x7fba0800ef20 comp rx=0 tx=0).stop 2024-08-31T05:28:42.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.124+0000 7fba16d9d640 1 -- 172.21.15.5:0/1636086469 reap_dead start 2024-08-31T05:28:42.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.124+0000 7fba1ca8c640 1 -- 172.21.15.5:0/1636086469 shutdown_connections 2024-08-31T05:28:42.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.124+0000 7fba1ca8c640 1 -- 172.21.15.5:0/1636086469 >> 172.21.15.5:0/1636086469 conn(0x7fba180794e0 msgr2=0x7fba18105110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:42.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.124+0000 7fba1ca8c640 1 -- 172.21.15.5:0/1636086469 shutdown_connections 2024-08-31T05:28:42.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.124+0000 7fba1ca8c640 1 -- 172.21.15.5:0/1636086469 wait complete. 2024-08-31T05:28:42.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.945+0000 7f7f00bb5640 1 -- 172.21.15.5:0/307832221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7efc109240 msgr2=0x7f7efc109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:42.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.945+0000 7f7f00bb5640 1 --2- 172.21.15.5:0/307832221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7efc109240 0x7f7efc109650 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7ef0009900 tx=0x7f7ef002a410 comp rx=0 tx=0).stop 2024-08-31T05:28:42.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.945+0000 7f7f00bb5640 1 -- 172.21.15.5:0/307832221 shutdown_connections 2024-08-31T05:28:42.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.945+0000 7f7f00bb5640 1 --2- 172.21.15.5:0/307832221 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7efc109b90 0x7f7efc1103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:42.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.945+0000 7f7f00bb5640 1 --2- 172.21.15.5:0/307832221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7efc109240 0x7f7efc109650 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:42.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.945+0000 7f7f00bb5640 1 --2- 172.21.15.5:0/307832221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7efc103900 0x7f7efc103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:42.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.945+0000 7f7f00bb5640 1 -- 172.21.15.5:0/307832221 >> 172.21.15.5:0/307832221 conn(0x7f7efc07b5f0 msgr2=0x7f7efc07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:42.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.945+0000 7f7f00bb5640 1 -- 172.21.15.5:0/307832221 shutdown_connections 2024-08-31T05:28:42.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.945+0000 7f7f00bb5640 1 -- 172.21.15.5:0/307832221 wait complete. 2024-08-31T05:28:42.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.946+0000 7f7f00bb5640 1 Processor -- start 2024-08-31T05:28:42.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.946+0000 7f7f00bb5640 1 -- start start 2024-08-31T05:28:42.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.946+0000 7f7f00bb5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7efc103900 0x7f7efc0754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:42.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.946+0000 7f7f00bb5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7efc109240 0x7f7efc0759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:42.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.946+0000 7f7f00bb5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7efc109b90 0x7f7efc075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:42.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.946+0000 7f7f00bb5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7efc113850 con 0x7f7efc109240 2024-08-31T05:28:42.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.946+0000 7f7f00bb5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7efc1136d0 con 0x7f7efc103900 2024-08-31T05:28:42.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.946+0000 7f7f00bb5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7efc1139d0 con 0x7f7efc109b90 2024-08-31T05:28:42.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.946+0000 7f7ef9d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7efc109240 0x7f7efc0759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:42.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.946+0000 7f7ef9d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7efc109240 0x7f7efc0759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35396/0 (socket says 172.21.15.5:35396) 2024-08-31T05:28:42.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.946+0000 7f7ef9d9b640 1 -- 172.21.15.5:0/41891039 learned_addr learned my addr 172.21.15.5:0/41891039 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:28:42.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.946+0000 7f7efa59c640 1 --2- 172.21.15.5:0/41891039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7efc103900 0x7f7efc0754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:42.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.946+0000 7f7efad9d640 1 --2- 172.21.15.5:0/41891039 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7efc109b90 0x7f7efc075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:42.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.947+0000 7f7ef9d9b640 1 -- 172.21.15.5:0/41891039 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7efc109b90 msgr2=0x7f7efc075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:42.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.947+0000 7f7ef9d9b640 1 --2- 172.21.15.5:0/41891039 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7efc109b90 0x7f7efc075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:42.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.947+0000 7f7ef9d9b640 1 -- 172.21.15.5:0/41891039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7efc103900 msgr2=0x7f7efc0754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:42.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.947+0000 7f7ef9d9b640 1 --2- 172.21.15.5:0/41891039 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7efc103900 0x7f7efc0754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:42.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.947+0000 7f7ef9d9b640 1 -- 172.21.15.5:0/41891039 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7efc1a8540 con 0x7f7efc109240 2024-08-31T05:28:42.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.947+0000 7f7efad9d640 1 --2- 172.21.15.5:0/41891039 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7efc109b90 0x7f7efc075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:28:42.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.947+0000 7f7ef9d9b640 1 --2- 172.21.15.5:0/41891039 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7efc109240 0x7f7efc0759f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7ef002a930 tx=0x7f7ef0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:42.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.947+0000 7f7eeb7fe640 1 -- 172.21.15.5:0/41891039 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef003f030 con 0x7f7efc109240 2024-08-31T05:28:42.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.947+0000 7f7eeb7fe640 1 -- 172.21.15.5:0/41891039 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ef0003aa0 con 0x7f7efc109240 2024-08-31T05:28:42.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.947+0000 7f7f00bb5640 1 -- 172.21.15.5:0/41891039 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7efc1a87d0 con 0x7f7efc109240 2024-08-31T05:28:42.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.947+0000 7f7eeb7fe640 1 -- 172.21.15.5:0/41891039 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef0035070 con 0x7f7efc109240 2024-08-31T05:28:42.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.947+0000 7f7f00bb5640 1 -- 172.21.15.5:0/41891039 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7efc1a8d00 con 0x7f7efc109240 2024-08-31T05:28:42.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.948+0000 7f7f00bb5640 1 -- 172.21.15.5:0/41891039 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7efc0638f0 con 0x7f7efc109240 2024-08-31T05:28:42.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.950+0000 7f7eeb7fe640 1 -- 172.21.15.5:0/41891039 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f7ef0042030 con 0x7f7efc109240 2024-08-31T05:28:42.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.950+0000 7f7eeb7fe640 1 --2- 172.21.15.5:0/41891039 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f7ee40b4c90 0x7f7ee40b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:42.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.950+0000 7f7efa59c640 1 --2- 172.21.15.5:0/41891039 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f7ee40b4c90 0x7f7ee40b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:42.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.950+0000 7f7eeb7fe640 1 -- 172.21.15.5:0/41891039 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9307+0+0 (secure 0 0 0) 0x7f7ef01062a0 con 0x7f7efc109240 2024-08-31T05:28:42.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.951+0000 7f7eeb7fe640 1 --2- 172.21.15.5:0/41891039 >> [v2:172.21.15.70:6816/3155722993,v1:172.21.15.70:6817/3155722993] conn(0x7f7ee40c0020 0x7f7ee40c2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:42.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.951+0000 7f7eeb7fe640 1 -- 172.21.15.5:0/41891039 --> [v2:172.21.15.70:6816/3155722993,v1:172.21.15.70:6817/3155722993] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7ee40c2be0 con 0x7f7ee40c0020 2024-08-31T05:28:42.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.951+0000 7f7eeb7fe640 1 -- 172.21.15.5:0/41891039 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f7ef01066f0 con 0x7f7efc109240 2024-08-31T05:28:42.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.951+0000 7f7efa59c640 1 --2- 172.21.15.5:0/41891039 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f7ee40b4c90 0x7f7ee40b71a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7efc076f00 tx=0x7f7eec00b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:42.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.951+0000 7f7efad9d640 1 --2- 172.21.15.5:0/41891039 >> [v2:172.21.15.70:6816/3155722993,v1:172.21.15.70:6817/3155722993] conn(0x7f7ee40c0020 0x7f7ee40c2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:42.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.951+0000 7f7efad9d640 1 --2- 172.21.15.5:0/41891039 >> [v2:172.21.15.70:6816/3155722993,v1:172.21.15.70:6817/3155722993] conn(0x7f7ee40c0020 0x7f7ee40c2510 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:42.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.952+0000 7f7eeb7fe640 1 -- 172.21.15.5:0/41891039 <== osd.8 v2:172.21.15.70:6816/3155722993 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7ee40c2be0 con 0x7f7ee40c0020 2024-08-31T05:28:42.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.967+0000 7f7f00bb5640 1 -- 172.21.15.5:0/41891039 --> [v2:172.21.15.70:6816/3155722993,v1:172.21.15.70:6817/3155722993] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7efc063cf0 con 0x7f7ee40c0020 2024-08-31T05:28:42.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.967+0000 7f7eeb7fe640 1 -- 172.21.15.5:0/41891039 <== osd.8 v2:172.21.15.70:6816/3155722993 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7efc063cf0 con 0x7f7ee40c0020 2024-08-31T05:28:42.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.967+0000 7f7f00bb5640 1 -- 172.21.15.5:0/41891039 >> [v2:172.21.15.70:6816/3155722993,v1:172.21.15.70:6817/3155722993] conn(0x7f7ee40c0020 msgr2=0x7f7ee40c2510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:42.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.967+0000 7f7f00bb5640 1 --2- 172.21.15.5:0/41891039 >> [v2:172.21.15.70:6816/3155722993,v1:172.21.15.70:6817/3155722993] conn(0x7f7ee40c0020 0x7f7ee40c2510 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:42.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.967+0000 7f7f00bb5640 1 -- 172.21.15.5:0/41891039 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f7ee40b4c90 msgr2=0x7f7ee40b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:42.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.967+0000 7f7f00bb5640 1 --2- 172.21.15.5:0/41891039 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f7ee40b4c90 0x7f7ee40b71a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7efc076f00 tx=0x7f7eec00b390 comp rx=0 tx=0).stop 2024-08-31T05:28:42.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.967+0000 7f7f00bb5640 1 -- 172.21.15.5:0/41891039 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7efc109240 msgr2=0x7f7efc0759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:42.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.967+0000 7f7f00bb5640 1 --2- 172.21.15.5:0/41891039 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7efc109240 0x7f7efc0759f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7ef002a930 tx=0x7f7ef0004270 comp rx=0 tx=0).stop 2024-08-31T05:28:42.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.967+0000 7f7efad9d640 1 -- 172.21.15.5:0/41891039 reap_dead start 2024-08-31T05:28:42.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.968+0000 7f7f00bb5640 1 -- 172.21.15.5:0/41891039 shutdown_connections 2024-08-31T05:28:42.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.968+0000 7f7f00bb5640 1 -- 172.21.15.5:0/41891039 >> 172.21.15.5:0/41891039 conn(0x7f7efc07b5f0 msgr2=0x7f7efc107340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:42.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.968+0000 7f7f00bb5640 1 -- 172.21.15.5:0/41891039 shutdown_connections 2024-08-31T05:28:42.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:42.968+0000 7f7f00bb5640 1 -- 172.21.15.5:0/41891039 wait complete. 2024-08-31T05:28:43.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:43 smithi005 ceph-mon[18602]: pgmap v305: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 681 B/s wr, 9 op/s 2024-08-31T05:28:43.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:43 smithi050 ceph-mon[22146]: pgmap v305: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 681 B/s wr, 9 op/s 2024-08-31T05:28:43.575 INFO:teuthology.orchestra.run.smithi005.stdout:304942678044 2024-08-31T05:28:43.576 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-08-31T05:28:43.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:43 smithi070 ceph-mon[22316]: pgmap v305: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 681 B/s wr, 9 op/s 2024-08-31T05:28:43.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.787+0000 7feea9f47640 1 -- 172.21.15.5:0/2670529044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feea410db90 msgr2=0x7feea41100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:43.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.787+0000 7feea9f47640 1 --2- 172.21.15.5:0/2670529044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feea410db90 0x7feea41100a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fee9c009ca0 tx=0x7fee9c02a8c0 comp rx=0 tx=0).stop 2024-08-31T05:28:43.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.787+0000 7feea9f47640 1 -- 172.21.15.5:0/2670529044 shutdown_connections 2024-08-31T05:28:43.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.787+0000 7feea9f47640 1 --2- 172.21.15.5:0/2670529044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feea410db90 0x7feea41100a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:43.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.787+0000 7feea9f47640 1 --2- 172.21.15.5:0/2670529044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feea4105010 0x7feea410d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:43.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.787+0000 7feea9f47640 1 --2- 172.21.15.5:0/2670529044 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feea41045e0 0x7feea41049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:43.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.787+0000 7feea9f47640 1 -- 172.21.15.5:0/2670529044 >> 172.21.15.5:0/2670529044 conn(0x7feea40794d0 msgr2=0x7feea40798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:43.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.787+0000 7feea9f47640 1 -- 172.21.15.5:0/2670529044 shutdown_connections 2024-08-31T05:28:43.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.787+0000 7feea9f47640 1 -- 172.21.15.5:0/2670529044 wait complete. 2024-08-31T05:28:43.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.788+0000 7feea9f47640 1 Processor -- start 2024-08-31T05:28:43.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.788+0000 7feea9f47640 1 -- start start 2024-08-31T05:28:43.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.788+0000 7feea9f47640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feea41045e0 0x7feea419a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:43.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.788+0000 7feea9f47640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feea4105010 0x7feea419a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:43.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.788+0000 7feea9f47640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feea410db90 0x7feea419fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:43.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.788+0000 7feea9f47640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7feea4113810 con 0x7feea4105010 2024-08-31T05:28:43.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.788+0000 7feea9f47640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7feea4113690 con 0x7feea41045e0 2024-08-31T05:28:43.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.788+0000 7feea9f47640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7feea4113990 con 0x7feea410db90 2024-08-31T05:28:43.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.788+0000 7feea2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feea4105010 0x7feea419a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:43.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.789+0000 7feea2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feea4105010 0x7feea419a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35418/0 (socket says 172.21.15.5:35418) 2024-08-31T05:28:43.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.789+0000 7feea2ffd640 1 -- 172.21.15.5:0/2553749194 learned_addr learned my addr 172.21.15.5:0/2553749194 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:28:43.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.789+0000 7feea3fff640 1 --2- 172.21.15.5:0/2553749194 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feea410db90 0x7feea419fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:43.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.789+0000 7feea37fe640 1 --2- 172.21.15.5:0/2553749194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feea41045e0 0x7feea419a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:43.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.789+0000 7feea2ffd640 1 -- 172.21.15.5:0/2553749194 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feea410db90 msgr2=0x7feea419fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:43.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.789+0000 7feea2ffd640 1 --2- 172.21.15.5:0/2553749194 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feea410db90 0x7feea419fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:43.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.789+0000 7feea2ffd640 1 -- 172.21.15.5:0/2553749194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feea41045e0 msgr2=0x7feea419a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:43.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.789+0000 7feea2ffd640 1 --2- 172.21.15.5:0/2553749194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7feea41045e0 0x7feea419a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:43.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.789+0000 7feea2ffd640 1 -- 172.21.15.5:0/2553749194 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feea41a01f0 con 0x7feea4105010 2024-08-31T05:28:43.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.789+0000 7feea2ffd640 1 --2- 172.21.15.5:0/2553749194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feea4105010 0x7feea419a820 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fee9800d740 tx=0x7fee9800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:43.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.789+0000 7feea0ff9640 1 -- 172.21.15.5:0/2553749194 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee98017070 con 0x7feea4105010 2024-08-31T05:28:43.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.789+0000 7feea0ff9640 1 -- 172.21.15.5:0/2553749194 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee9800de50 con 0x7feea4105010 2024-08-31T05:28:43.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.789+0000 7feea9f47640 1 -- 172.21.15.5:0/2553749194 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feea41a04e0 con 0x7feea4105010 2024-08-31T05:28:43.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.789+0000 7feea0ff9640 1 -- 172.21.15.5:0/2553749194 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee9800f620 con 0x7feea4105010 2024-08-31T05:28:43.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.789+0000 7feea9f47640 1 -- 172.21.15.5:0/2553749194 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feea41a6c40 con 0x7feea4105010 2024-08-31T05:28:43.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.791+0000 7feea9f47640 1 -- 172.21.15.5:0/2553749194 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7feea4107110 con 0x7feea4105010 2024-08-31T05:28:43.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.792+0000 7feea0ff9640 1 -- 172.21.15.5:0/2553749194 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7fee9801a070 con 0x7feea4105010 2024-08-31T05:28:43.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.793+0000 7feea0ff9640 1 --2- 172.21.15.5:0/2553749194 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fee8c0b4c10 0x7fee8c0b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:43.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.793+0000 7feea37fe640 1 --2- 172.21.15.5:0/2553749194 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fee8c0b4c10 0x7fee8c0b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:43.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.793+0000 7feea0ff9640 1 -- 172.21.15.5:0/2553749194 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9307+0+0 (secure 0 0 0) 0x7fee980e5460 con 0x7feea4105010 2024-08-31T05:28:43.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.793+0000 7feea0ff9640 1 --2- 172.21.15.5:0/2553749194 >> [v2:172.21.15.70:6808/311426299,v1:172.21.15.70:6809/311426299] conn(0x7fee8c0bffa0 0x7fee8c0c2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:43.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.793+0000 7feea0ff9640 1 -- 172.21.15.5:0/2553749194 --> [v2:172.21.15.70:6808/311426299,v1:172.21.15.70:6809/311426299] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fee8c0c2b60 con 0x7fee8c0bffa0 2024-08-31T05:28:43.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.793+0000 7feea0ff9640 1 -- 172.21.15.5:0/2553749194 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7fee980e58b0 con 0x7feea4105010 2024-08-31T05:28:43.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.794+0000 7feea37fe640 1 --2- 172.21.15.5:0/2553749194 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fee8c0b4c10 0x7fee8c0b7120 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7feea406b9a0 tx=0x7fee9400b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:43.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.794+0000 7feea3fff640 1 --2- 172.21.15.5:0/2553749194 >> [v2:172.21.15.70:6808/311426299,v1:172.21.15.70:6809/311426299] conn(0x7fee8c0bffa0 0x7fee8c0c2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:43.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.794+0000 7feea3fff640 1 --2- 172.21.15.5:0/2553749194 >> [v2:172.21.15.70:6808/311426299,v1:172.21.15.70:6809/311426299] conn(0x7fee8c0bffa0 0x7fee8c0c2490 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:43.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.795+0000 7feea0ff9640 1 -- 172.21.15.5:0/2553749194 <== osd.5 v2:172.21.15.70:6808/311426299 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fee8c0c2b60 con 0x7fee8c0bffa0 2024-08-31T05:28:43.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.810+0000 7feea9f47640 1 -- 172.21.15.5:0/2553749194 --> [v2:172.21.15.70:6808/311426299,v1:172.21.15.70:6809/311426299] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7feea406b2a0 con 0x7fee8c0bffa0 2024-08-31T05:28:43.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.810+0000 7feea0ff9640 1 -- 172.21.15.5:0/2553749194 <== osd.5 v2:172.21.15.70:6808/311426299 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7feea406b2a0 con 0x7fee8c0bffa0 2024-08-31T05:28:43.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.811+0000 7feea9f47640 1 -- 172.21.15.5:0/2553749194 >> [v2:172.21.15.70:6808/311426299,v1:172.21.15.70:6809/311426299] conn(0x7fee8c0bffa0 msgr2=0x7fee8c0c2490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:43.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.811+0000 7feea9f47640 1 --2- 172.21.15.5:0/2553749194 >> [v2:172.21.15.70:6808/311426299,v1:172.21.15.70:6809/311426299] conn(0x7fee8c0bffa0 0x7fee8c0c2490 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:43.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.811+0000 7feea9f47640 1 -- 172.21.15.5:0/2553749194 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fee8c0b4c10 msgr2=0x7fee8c0b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:43.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.811+0000 7feea9f47640 1 --2- 172.21.15.5:0/2553749194 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fee8c0b4c10 0x7fee8c0b7120 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7feea406b9a0 tx=0x7fee9400b390 comp rx=0 tx=0).stop 2024-08-31T05:28:43.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.811+0000 7feea9f47640 1 -- 172.21.15.5:0/2553749194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feea4105010 msgr2=0x7feea419a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:43.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.811+0000 7feea9f47640 1 --2- 172.21.15.5:0/2553749194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feea4105010 0x7feea419a820 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fee9800d740 tx=0x7fee9800dc00 comp rx=0 tx=0).stop 2024-08-31T05:28:43.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.811+0000 7feea3fff640 1 -- 172.21.15.5:0/2553749194 reap_dead start 2024-08-31T05:28:43.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.811+0000 7feea9f47640 1 -- 172.21.15.5:0/2553749194 shutdown_connections 2024-08-31T05:28:43.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.811+0000 7feea9f47640 1 -- 172.21.15.5:0/2553749194 >> 172.21.15.5:0/2553749194 conn(0x7feea40794d0 msgr2=0x7feea41066f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:43.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.811+0000 7feea9f47640 1 -- 172.21.15.5:0/2553749194 shutdown_connections 2024-08-31T05:28:43.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:43.811+0000 7feea9f47640 1 -- 172.21.15.5:0/2553749194 wait complete. 2024-08-31T05:28:44.038 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:28:44.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.669+0000 7f376610c640 1 -- 172.21.15.5:0/2580889727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3760108ab0 msgr2=0x7f376010f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:44.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.669+0000 7f376610c640 1 --2- 172.21.15.5:0/2580889727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3760108ab0 0x7f376010f2e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3758009ca0 tx=0x7f375802a8c0 comp rx=0 tx=0).stop 2024-08-31T05:28:44.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.669+0000 7f376610c640 1 -- 172.21.15.5:0/2580889727 shutdown_connections 2024-08-31T05:28:44.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.669+0000 7f376610c640 1 --2- 172.21.15.5:0/2580889727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3760108ab0 0x7f376010f2e0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:44.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.669+0000 7f376610c640 1 --2- 172.21.15.5:0/2580889727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3760108160 0x7f3760108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:44.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.669+0000 7f376610c640 1 --2- 172.21.15.5:0/2580889727 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3760102820 0x7f3760102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:44.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.669+0000 7f376610c640 1 -- 172.21.15.5:0/2580889727 >> 172.21.15.5:0/2580889727 conn(0x7f37600794e0 msgr2=0x7f37600798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:44.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.669+0000 7f376610c640 1 -- 172.21.15.5:0/2580889727 shutdown_connections 2024-08-31T05:28:44.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.669+0000 7f376610c640 1 -- 172.21.15.5:0/2580889727 wait complete. 2024-08-31T05:28:44.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.669+0000 7f376610c640 1 Processor -- start 2024-08-31T05:28:44.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.669+0000 7f376610c640 1 -- start start 2024-08-31T05:28:44.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.670+0000 7f376610c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3760102820 0x7f376019afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:44.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.670+0000 7f376610c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3760108160 0x7f376019b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:44.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.670+0000 7f376610c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3760108ab0 0x7f376019ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:44.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.670+0000 7f376610c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3760112730 con 0x7f3760108160 2024-08-31T05:28:44.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.670+0000 7f376610c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f37601125b0 con 0x7f3760102820 2024-08-31T05:28:44.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.670+0000 7f376610c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f37601128b0 con 0x7f3760108ab0 2024-08-31T05:28:44.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.670+0000 7f3756ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3760108160 0x7f376019b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:44.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.670+0000 7f3756ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3760108160 0x7f376019b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35430/0 (socket says 172.21.15.5:35430) 2024-08-31T05:28:44.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.670+0000 7f3756ffd640 1 -- 172.21.15.5:0/924382398 learned_addr learned my addr 172.21.15.5:0/924382398 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:28:44.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.670+0000 7f375ffff640 1 --2- 172.21.15.5:0/924382398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3760108ab0 0x7f376019ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:44.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.670+0000 7f375f7fe640 1 --2- 172.21.15.5:0/924382398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3760102820 0x7f376019afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:44.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.670+0000 7f3756ffd640 1 -- 172.21.15.5:0/924382398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3760108ab0 msgr2=0x7f376019ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:44.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.670+0000 7f3756ffd640 1 --2- 172.21.15.5:0/924382398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3760108ab0 0x7f376019ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:44.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.670+0000 7f3756ffd640 1 -- 172.21.15.5:0/924382398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3760102820 msgr2=0x7f376019afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:44.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.670+0000 7f3756ffd640 1 --2- 172.21.15.5:0/924382398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3760102820 0x7f376019afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:44.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.670+0000 7f3756ffd640 1 -- 172.21.15.5:0/924382398 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37601a62d0 con 0x7f3760108160 2024-08-31T05:28:44.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.671+0000 7f3756ffd640 1 --2- 172.21.15.5:0/924382398 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3760108160 0x7f376019b500 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f374800d770 tx=0x7f374800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:44.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.671+0000 7f375d7fa640 1 -- 172.21.15.5:0/924382398 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3748017070 con 0x7f3760108160 2024-08-31T05:28:44.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.671+0000 7f375d7fa640 1 -- 172.21.15.5:0/924382398 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3748009c30 con 0x7f3760108160 2024-08-31T05:28:44.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.671+0000 7f376610c640 1 -- 172.21.15.5:0/924382398 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37601a65c0 con 0x7f3760108160 2024-08-31T05:28:44.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.671+0000 7f375d7fa640 1 -- 172.21.15.5:0/924382398 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f374800f620 con 0x7f3760108160 2024-08-31T05:28:44.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.671+0000 7f376610c640 1 -- 172.21.15.5:0/924382398 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37601a6b00 con 0x7f3760108160 2024-08-31T05:28:44.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.672+0000 7f376610c640 1 -- 172.21.15.5:0/924382398 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f37600638f0 con 0x7f3760108160 2024-08-31T05:28:44.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.673+0000 7f375d7fa640 1 -- 172.21.15.5:0/924382398 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f374801a070 con 0x7f3760108160 2024-08-31T05:28:44.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.674+0000 7f375d7fa640 1 --2- 172.21.15.5:0/924382398 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f374c0b4c10 0x7f374c0b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:44.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.674+0000 7f375f7fe640 1 --2- 172.21.15.5:0/924382398 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f374c0b4c10 0x7f374c0b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:44.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.674+0000 7f375d7fa640 1 -- 172.21.15.5:0/924382398 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9307+0+0 (secure 0 0 0) 0x7f37480e57a0 con 0x7f3760108160 2024-08-31T05:28:44.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.674+0000 7f375d7fa640 1 --2- 172.21.15.5:0/924382398 >> [v2:172.21.15.50:6808/2314546877,v1:172.21.15.50:6809/2314546877] conn(0x7f374c0bffa0 0x7f374c0c2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:44.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.674+0000 7f375d7fa640 1 -- 172.21.15.5:0/924382398 --> [v2:172.21.15.50:6808/2314546877,v1:172.21.15.50:6809/2314546877] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f374c0c2b60 con 0x7f374c0bffa0 2024-08-31T05:28:44.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.674+0000 7f375d7fa640 1 -- 172.21.15.5:0/924382398 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f37480e5bf0 con 0x7f3760108160 2024-08-31T05:28:44.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.675+0000 7f375f7fe640 1 --2- 172.21.15.5:0/924382398 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f374c0b4c10 0x7f374c0b7120 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3750005fd0 tx=0x7f3750005e20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:44.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.675+0000 7f375ffff640 1 --2- 172.21.15.5:0/924382398 >> [v2:172.21.15.50:6808/2314546877,v1:172.21.15.50:6809/2314546877] conn(0x7f374c0bffa0 0x7f374c0c2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:44.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.675+0000 7f375ffff640 1 --2- 172.21.15.5:0/924382398 >> [v2:172.21.15.50:6808/2314546877,v1:172.21.15.50:6809/2314546877] conn(0x7f374c0bffa0 0x7f374c0c2490 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:44.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.676+0000 7f375d7fa640 1 -- 172.21.15.5:0/924382398 <== osd.4 v2:172.21.15.50:6808/2314546877 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f374c0c2b60 con 0x7f374c0bffa0 2024-08-31T05:28:44.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.690+0000 7f376610c640 1 -- 172.21.15.5:0/924382398 --> [v2:172.21.15.50:6808/2314546877,v1:172.21.15.50:6809/2314546877] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3760063cf0 con 0x7f374c0bffa0 2024-08-31T05:28:44.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.690+0000 7f375d7fa640 1 -- 172.21.15.5:0/924382398 <== osd.4 v2:172.21.15.50:6808/2314546877 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3760063cf0 con 0x7f374c0bffa0 2024-08-31T05:28:44.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.691+0000 7f376610c640 1 -- 172.21.15.5:0/924382398 >> [v2:172.21.15.50:6808/2314546877,v1:172.21.15.50:6809/2314546877] conn(0x7f374c0bffa0 msgr2=0x7f374c0c2490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:44.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.691+0000 7f376610c640 1 --2- 172.21.15.5:0/924382398 >> [v2:172.21.15.50:6808/2314546877,v1:172.21.15.50:6809/2314546877] conn(0x7f374c0bffa0 0x7f374c0c2490 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:44.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.691+0000 7f376610c640 1 -- 172.21.15.5:0/924382398 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f374c0b4c10 msgr2=0x7f374c0b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:44.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.691+0000 7f376610c640 1 --2- 172.21.15.5:0/924382398 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f374c0b4c10 0x7f374c0b7120 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3750005fd0 tx=0x7f3750005e20 comp rx=0 tx=0).stop 2024-08-31T05:28:44.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.691+0000 7f376610c640 1 -- 172.21.15.5:0/924382398 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3760108160 msgr2=0x7f376019b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:44.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.691+0000 7f376610c640 1 --2- 172.21.15.5:0/924382398 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3760108160 0x7f376019b500 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f374800d770 tx=0x7f374800dc30 comp rx=0 tx=0).stop 2024-08-31T05:28:44.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.691+0000 7f375ffff640 1 -- 172.21.15.5:0/924382398 reap_dead start 2024-08-31T05:28:44.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.691+0000 7f376610c640 1 -- 172.21.15.5:0/924382398 shutdown_connections 2024-08-31T05:28:44.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.691+0000 7f376610c640 1 -- 172.21.15.5:0/924382398 >> 172.21.15.5:0/924382398 conn(0x7f37600794e0 msgr2=0x7f3760104170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:44.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.691+0000 7f376610c640 1 -- 172.21.15.5:0/924382398 shutdown_connections 2024-08-31T05:28:44.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:44.691+0000 7f376610c640 1 -- 172.21.15.5:0/924382398 wait complete. 2024-08-31T05:28:45.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.134+0000 7f9a28470640 1 -- 172.21.15.5:0/4127483678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a20102800 msgr2=0x7f9a20102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:45.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.134+0000 7f9a28470640 1 --2- 172.21.15.5:0/4127483678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a20102800 0x7f9a20102c10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c009900 tx=0x7f9a1c02a410 comp rx=0 tx=0).stop 2024-08-31T05:28:45.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.134+0000 7f9a28470640 1 -- 172.21.15.5:0/4127483678 shutdown_connections 2024-08-31T05:28:45.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.134+0000 7f9a28470640 1 --2- 172.21.15.5:0/4127483678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a20108a90 0x7f9a2010f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:45.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.134+0000 7f9a28470640 1 --2- 172.21.15.5:0/4127483678 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a20108140 0x7f9a20108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:45.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.134+0000 7f9a28470640 1 --2- 172.21.15.5:0/4127483678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a20102800 0x7f9a20102c10 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:45.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.134+0000 7f9a28470640 1 -- 172.21.15.5:0/4127483678 >> 172.21.15.5:0/4127483678 conn(0x7f9a200794d0 msgr2=0x7f9a200798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:45.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.134+0000 7f9a28470640 1 -- 172.21.15.5:0/4127483678 shutdown_connections 2024-08-31T05:28:45.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.134+0000 7f9a28470640 1 -- 172.21.15.5:0/4127483678 wait complete. 2024-08-31T05:28:45.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.135+0000 7f9a28470640 1 Processor -- start 2024-08-31T05:28:45.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.135+0000 7f9a28470640 1 -- start start 2024-08-31T05:28:45.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.135+0000 7f9a28470640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a20102800 0x7f9a2019a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:45.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.135+0000 7f9a28470640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a20108140 0x7f9a2019a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:45.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.135+0000 7f9a28470640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a20108a90 0x7f9a2019fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:45.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.135+0000 7f9a28470640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9a20112710 con 0x7f9a20108140 2024-08-31T05:28:45.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.135+0000 7f9a28470640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9a20112590 con 0x7f9a20108a90 2024-08-31T05:28:45.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.135+0000 7f9a28470640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9a20112890 con 0x7f9a20102800 2024-08-31T05:28:45.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.135+0000 7f9a25a0b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a20108140 0x7f9a2019a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:45.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.135+0000 7f9a25a0b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a20108140 0x7f9a2019a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35448/0 (socket says 172.21.15.5:35448) 2024-08-31T05:28:45.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.135+0000 7f9a25a0b640 1 -- 172.21.15.5:0/173288030 learned_addr learned my addr 172.21.15.5:0/173288030 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:28:45.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.135+0000 7f9a2620c640 1 --2- 172.21.15.5:0/173288030 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a20102800 0x7f9a2019a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:45.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.135+0000 7f9a26a0d640 1 --2- 172.21.15.5:0/173288030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a20108a90 0x7f9a2019fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:45.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.136+0000 7f9a25a0b640 1 -- 172.21.15.5:0/173288030 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a20102800 msgr2=0x7f9a2019a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:45.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.136+0000 7f9a25a0b640 1 --2- 172.21.15.5:0/173288030 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a20102800 0x7f9a2019a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:45.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.136+0000 7f9a25a0b640 1 -- 172.21.15.5:0/173288030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a20108a90 msgr2=0x7f9a2019fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:45.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.136+0000 7f9a25a0b640 1 --2- 172.21.15.5:0/173288030 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9a20108a90 0x7f9a2019fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:45.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.136+0000 7f9a25a0b640 1 -- 172.21.15.5:0/173288030 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a201a01a0 con 0x7f9a20108140 2024-08-31T05:28:45.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.136+0000 7f9a25a0b640 1 --2- 172.21.15.5:0/173288030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a20108140 0x7f9a2019a7d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f9a1000e9f0 tx=0x7f9a1000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:45.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.136+0000 7f9a177fe640 1 -- 172.21.15.5:0/173288030 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a1000ccc0 con 0x7f9a20108140 2024-08-31T05:28:45.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.136+0000 7f9a28470640 1 -- 172.21.15.5:0/173288030 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a201a0490 con 0x7f9a20108140 2024-08-31T05:28:45.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.136+0000 7f9a177fe640 1 -- 172.21.15.5:0/173288030 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9a100054d0 con 0x7f9a20108140 2024-08-31T05:28:45.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.136+0000 7f9a177fe640 1 -- 172.21.15.5:0/173288030 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a10010430 con 0x7f9a20108140 2024-08-31T05:28:45.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.136+0000 7f9a28470640 1 -- 172.21.15.5:0/173288030 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a201a6bf0 con 0x7f9a20108140 2024-08-31T05:28:45.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.137+0000 7f9a28470640 1 -- 172.21.15.5:0/173288030 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9a201063f0 con 0x7f9a20108140 2024-08-31T05:28:45.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.138+0000 7f9a177fe640 1 -- 172.21.15.5:0/173288030 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f9a100046c0 con 0x7f9a20108140 2024-08-31T05:28:45.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.139+0000 7f9a177fe640 1 --2- 172.21.15.5:0/173288030 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9a0c0b4c10 0x7f9a0c0b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:45.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.139+0000 7f9a2620c640 1 --2- 172.21.15.5:0/173288030 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9a0c0b4c10 0x7f9a0c0b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:45.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.139+0000 7f9a177fe640 1 -- 172.21.15.5:0/173288030 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9307+0+0 (secure 0 0 0) 0x7f9a100e5ef0 con 0x7f9a20108140 2024-08-31T05:28:45.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.139+0000 7f9a177fe640 1 --2- 172.21.15.5:0/173288030 >> [v2:172.21.15.5:6818/1027645612,v1:172.21.15.5:6819/1027645612] conn(0x7f9a0c0bffa0 0x7f9a0c0c2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:45.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.140+0000 7f9a177fe640 1 -- 172.21.15.5:0/173288030 --> [v2:172.21.15.5:6818/1027645612,v1:172.21.15.5:6819/1027645612] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9a1001de50 con 0x7f9a0c0bffa0 2024-08-31T05:28:45.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.140+0000 7f9a177fe640 1 -- 172.21.15.5:0/173288030 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f9a100e6340 con 0x7f9a20108140 2024-08-31T05:28:45.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.140+0000 7f9a26a0d640 1 --2- 172.21.15.5:0/173288030 >> [v2:172.21.15.5:6818/1027645612,v1:172.21.15.5:6819/1027645612] conn(0x7f9a0c0bffa0 0x7f9a0c0c2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:45.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.140+0000 7f9a2620c640 1 --2- 172.21.15.5:0/173288030 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9a0c0b4c10 0x7f9a0c0b7120 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c031440 tx=0x7f9a1c009560 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:45.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.140+0000 7f9a26a0d640 1 --2- 172.21.15.5:0/173288030 >> [v2:172.21.15.5:6818/1027645612,v1:172.21.15.5:6819/1027645612] conn(0x7f9a0c0bffa0 0x7f9a0c0c2490 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:45.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.141+0000 7f9a177fe640 1 -- 172.21.15.5:0/173288030 <== osd.6 v2:172.21.15.5:6818/1027645612 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9a1001de50 con 0x7f9a0c0bffa0 2024-08-31T05:28:45.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.158+0000 7f9a28470640 1 -- 172.21.15.5:0/173288030 --> [v2:172.21.15.5:6818/1027645612,v1:172.21.15.5:6819/1027645612] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9a20103a80 con 0x7f9a0c0bffa0 2024-08-31T05:28:45.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.159+0000 7f9a177fe640 1 -- 172.21.15.5:0/173288030 <== osd.6 v2:172.21.15.5:6818/1027645612 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9a20103a80 con 0x7f9a0c0bffa0 2024-08-31T05:28:45.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.159+0000 7f9a28470640 1 -- 172.21.15.5:0/173288030 >> [v2:172.21.15.5:6818/1027645612,v1:172.21.15.5:6819/1027645612] conn(0x7f9a0c0bffa0 msgr2=0x7f9a0c0c2490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:45.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.159+0000 7f9a28470640 1 --2- 172.21.15.5:0/173288030 >> [v2:172.21.15.5:6818/1027645612,v1:172.21.15.5:6819/1027645612] conn(0x7f9a0c0bffa0 0x7f9a0c0c2490 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:45.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.159+0000 7f9a28470640 1 -- 172.21.15.5:0/173288030 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9a0c0b4c10 msgr2=0x7f9a0c0b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:45.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.159+0000 7f9a28470640 1 --2- 172.21.15.5:0/173288030 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9a0c0b4c10 0x7f9a0c0b7120 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c031440 tx=0x7f9a1c009560 comp rx=0 tx=0).stop 2024-08-31T05:28:45.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.159+0000 7f9a28470640 1 -- 172.21.15.5:0/173288030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a20108140 msgr2=0x7f9a2019a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:45.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.159+0000 7f9a28470640 1 --2- 172.21.15.5:0/173288030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a20108140 0x7f9a2019a7d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f9a1000e9f0 tx=0x7f9a1000eeb0 comp rx=0 tx=0).stop 2024-08-31T05:28:45.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.159+0000 7f9a26a0d640 1 -- 172.21.15.5:0/173288030 reap_dead start 2024-08-31T05:28:45.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.159+0000 7f9a28470640 1 -- 172.21.15.5:0/173288030 shutdown_connections 2024-08-31T05:28:45.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.159+0000 7f9a28470640 1 -- 172.21.15.5:0/173288030 >> 172.21.15.5:0/173288030 conn(0x7f9a200794d0 msgr2=0x7f9a20101870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:45.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.160+0000 7f9a28470640 1 -- 172.21.15.5:0/173288030 shutdown_connections 2024-08-31T05:28:45.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:45.160+0000 7f9a28470640 1 -- 172.21.15.5:0/173288030 wait complete. 2024-08-31T05:28:45.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:45 smithi050 ceph-mon[22146]: pgmap v306: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 681 B/s wr, 10 op/s 2024-08-31T05:28:45.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:45 smithi005 ceph-mon[18602]: pgmap v306: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 681 B/s wr, 10 op/s 2024-08-31T05:28:45.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:45 smithi070 ceph-mon[22316]: pgmap v306: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 681 B/s wr, 10 op/s 2024-08-31T05:28:46.301 INFO:teuthology.orchestra.run.smithi005.stdout:137438953537 2024-08-31T05:28:46.302 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-08-31T05:28:47.089 INFO:teuthology.orchestra.run.smithi005.stdout:158913790011 2024-08-31T05:28:47.090 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-08-31T05:28:47.380 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:47 smithi005 ceph-mon[18602]: pgmap v307: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 10 op/s 2024-08-31T05:28:47.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.378+0000 7f4fbaa0b640 1 -- 172.21.15.5:0/4198684081 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fb4102880 msgr2=0x7f4fb4102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:47.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.378+0000 7f4fbaa0b640 1 --2- 172.21.15.5:0/4198684081 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fb4102880 0x7f4fb4102c90 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4009900 tx=0x7f4fa402a410 comp rx=0 tx=0).stop 2024-08-31T05:28:47.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.378+0000 7f4fbaa0b640 1 -- 172.21.15.5:0/4198684081 shutdown_connections 2024-08-31T05:28:47.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.378+0000 7f4fbaa0b640 1 --2- 172.21.15.5:0/4198684081 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fb4108b10 0x7f4fb410f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:47.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.378+0000 7f4fbaa0b640 1 --2- 172.21.15.5:0/4198684081 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fb41081c0 0x7f4fb41085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:47.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.378+0000 7f4fbaa0b640 1 --2- 172.21.15.5:0/4198684081 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fb4102880 0x7f4fb4102c90 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:47.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.378+0000 7f4fbaa0b640 1 -- 172.21.15.5:0/4198684081 >> 172.21.15.5:0/4198684081 conn(0x7f4fb4079510 msgr2=0x7f4fb4079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:47.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.378+0000 7f4fbaa0b640 1 -- 172.21.15.5:0/4198684081 shutdown_connections 2024-08-31T05:28:47.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.378+0000 7f4fbaa0b640 1 -- 172.21.15.5:0/4198684081 wait complete. 2024-08-31T05:28:47.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.379+0000 7f4fbaa0b640 1 Processor -- start 2024-08-31T05:28:47.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.379+0000 7f4fbaa0b640 1 -- start start 2024-08-31T05:28:47.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.379+0000 7f4fbaa0b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fb4102880 0x7f4fb419a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:47.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.379+0000 7f4fbaa0b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fb41081c0 0x7f4fb419a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:47.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.379+0000 7f4fbaa0b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fb4108b10 0x7f4fb419fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:47.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.379+0000 7f4fbaa0b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb41127e0 con 0x7f4fb41081c0 2024-08-31T05:28:47.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.379+0000 7f4fbaa0b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb4112660 con 0x7f4fb4102880 2024-08-31T05:28:47.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.379+0000 7f4fbaa0b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb4112960 con 0x7f4fb4108b10 2024-08-31T05:28:47.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.379+0000 7f4fb3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fb4102880 0x7f4fb419a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:47.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.380+0000 7f4fb37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fb41081c0 0x7f4fb419a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:47.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.380+0000 7f4fb3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fb4102880 0x7f4fb419a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:49470/0 (socket says 172.21.15.5:49470) 2024-08-31T05:28:47.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.380+0000 7f4fb37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fb41081c0 0x7f4fb419a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35468/0 (socket says 172.21.15.5:35468) 2024-08-31T05:28:47.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.380+0000 7f4fb3fff640 1 -- 172.21.15.5:0/3455975471 learned_addr learned my addr 172.21.15.5:0/3455975471 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:28:47.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.380+0000 7f4fb8fa8640 1 --2- 172.21.15.5:0/3455975471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fb4108b10 0x7f4fb419fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:47.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.380+0000 7f4fb37fe640 1 -- 172.21.15.5:0/3455975471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fb4108b10 msgr2=0x7f4fb419fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:47.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.380+0000 7f4fb37fe640 1 --2- 172.21.15.5:0/3455975471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fb4108b10 0x7f4fb419fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:47.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.380+0000 7f4fb37fe640 1 -- 172.21.15.5:0/3455975471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fb4102880 msgr2=0x7f4fb419a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:47.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.380+0000 7f4fb37fe640 1 --2- 172.21.15.5:0/3455975471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fb4102880 0x7f4fb419a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:47.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.380+0000 7f4fb37fe640 1 -- 172.21.15.5:0/3455975471 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fb41a0190 con 0x7f4fb41081c0 2024-08-31T05:28:47.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.380+0000 7f4fb8fa8640 1 --2- 172.21.15.5:0/3455975471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fb4108b10 0x7f4fb419fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:28:47.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.380+0000 7f4fb37fe640 1 --2- 172.21.15.5:0/3455975471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fb41081c0 0x7f4fb419a880 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4fb406b760 tx=0x7f4fa800cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:47.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.380+0000 7f4fb17fa640 1 -- 172.21.15.5:0/3455975471 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa8007bb0 con 0x7f4fb41081c0 2024-08-31T05:28:47.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.380+0000 7f4fb17fa640 1 -- 172.21.15.5:0/3455975471 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fa8007d50 con 0x7f4fb41081c0 2024-08-31T05:28:47.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.380+0000 7f4fbaa0b640 1 -- 172.21.15.5:0/3455975471 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fb41a0480 con 0x7f4fb41081c0 2024-08-31T05:28:47.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.380+0000 7f4fb17fa640 1 -- 172.21.15.5:0/3455975471 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa80186f0 con 0x7f4fb41081c0 2024-08-31T05:28:47.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.380+0000 7f4fbaa0b640 1 -- 172.21.15.5:0/3455975471 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fb41a6ca0 con 0x7f4fb41081c0 2024-08-31T05:28:47.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.381+0000 7f4fbaa0b640 1 -- 172.21.15.5:0/3455975471 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4fb4063830 con 0x7f4fb41081c0 2024-08-31T05:28:47.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.383+0000 7f4fb17fa640 1 -- 172.21.15.5:0/3455975471 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f4fa800f450 con 0x7f4fb41081c0 2024-08-31T05:28:47.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.383+0000 7f4fb17fa640 1 --2- 172.21.15.5:0/3455975471 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4f9c0b4c40 0x7f4f9c0b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:47.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.384+0000 7f4fb3fff640 1 --2- 172.21.15.5:0/3455975471 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4f9c0b4c40 0x7f4f9c0b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:47.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.384+0000 7f4fb17fa640 1 -- 172.21.15.5:0/3455975471 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9307+0+0 (secure 0 0 0) 0x7f4fa80e5de0 con 0x7f4fb41081c0 2024-08-31T05:28:47.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.384+0000 7f4fb17fa640 1 --2- 172.21.15.5:0/3455975471 >> [v2:172.21.15.50:6824/4168871229,v1:172.21.15.50:6825/4168871229] conn(0x7f4f9c0bffd0 0x7f4f9c0c24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:47.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.384+0000 7f4fb17fa640 1 -- 172.21.15.5:0/3455975471 --> [v2:172.21.15.50:6824/4168871229,v1:172.21.15.50:6825/4168871229] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4fa8014ec0 con 0x7f4f9c0bffd0 2024-08-31T05:28:47.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.384+0000 7f4fb17fa640 1 -- 172.21.15.5:0/3455975471 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f4fa80e6190 con 0x7f4fb41081c0 2024-08-31T05:28:47.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.384+0000 7f4fb3fff640 1 --2- 172.21.15.5:0/3455975471 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4f9c0b4c40 0x7f4f9c0b7150 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4031440 tx=0x7f4fa40058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:47.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.384+0000 7f4fb8fa8640 1 --2- 172.21.15.5:0/3455975471 >> [v2:172.21.15.50:6824/4168871229,v1:172.21.15.50:6825/4168871229] conn(0x7f4f9c0bffd0 0x7f4f9c0c24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:47.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.385+0000 7f4fb8fa8640 1 --2- 172.21.15.5:0/3455975471 >> [v2:172.21.15.50:6824/4168871229,v1:172.21.15.50:6825/4168871229] conn(0x7f4f9c0bffd0 0x7f4f9c0c24c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:47.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.386+0000 7f4fb17fa640 1 -- 172.21.15.5:0/3455975471 <== osd.10 v2:172.21.15.50:6824/4168871229 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4fa8014ec0 con 0x7f4f9c0bffd0 2024-08-31T05:28:47.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.400+0000 7f4fbaa0b640 1 -- 172.21.15.5:0/3455975471 --> [v2:172.21.15.50:6824/4168871229,v1:172.21.15.50:6825/4168871229] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4fb4063c30 con 0x7f4f9c0bffd0 2024-08-31T05:28:47.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.401+0000 7f4fb17fa640 1 -- 172.21.15.5:0/3455975471 <== osd.10 v2:172.21.15.50:6824/4168871229 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4fb4063c30 con 0x7f4f9c0bffd0 2024-08-31T05:28:47.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.401+0000 7f4fbaa0b640 1 -- 172.21.15.5:0/3455975471 >> [v2:172.21.15.50:6824/4168871229,v1:172.21.15.50:6825/4168871229] conn(0x7f4f9c0bffd0 msgr2=0x7f4f9c0c24c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:47.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.401+0000 7f4fbaa0b640 1 --2- 172.21.15.5:0/3455975471 >> [v2:172.21.15.50:6824/4168871229,v1:172.21.15.50:6825/4168871229] conn(0x7f4f9c0bffd0 0x7f4f9c0c24c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:47.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.401+0000 7f4fbaa0b640 1 -- 172.21.15.5:0/3455975471 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4f9c0b4c40 msgr2=0x7f4f9c0b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:47.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.401+0000 7f4fbaa0b640 1 --2- 172.21.15.5:0/3455975471 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4f9c0b4c40 0x7f4f9c0b7150 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4031440 tx=0x7f4fa40058d0 comp rx=0 tx=0).stop 2024-08-31T05:28:47.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.401+0000 7f4fbaa0b640 1 -- 172.21.15.5:0/3455975471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fb41081c0 msgr2=0x7f4fb419a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:47.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.401+0000 7f4fbaa0b640 1 --2- 172.21.15.5:0/3455975471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fb41081c0 0x7f4fb419a880 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4fb406b760 tx=0x7f4fa800cdd0 comp rx=0 tx=0).stop 2024-08-31T05:28:47.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.401+0000 7f4fb8fa8640 1 -- 172.21.15.5:0/3455975471 reap_dead start 2024-08-31T05:28:47.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.401+0000 7f4fbaa0b640 1 -- 172.21.15.5:0/3455975471 shutdown_connections 2024-08-31T05:28:47.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.401+0000 7f4fbaa0b640 1 -- 172.21.15.5:0/3455975471 >> 172.21.15.5:0/3455975471 conn(0x7f4fb4079510 msgr2=0x7f4fb4101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:47.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.402+0000 7f4fbaa0b640 1 -- 172.21.15.5:0/3455975471 shutdown_connections 2024-08-31T05:28:47.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:47.402+0000 7f4fbaa0b640 1 -- 172.21.15.5:0/3455975471 wait complete. 2024-08-31T05:28:47.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:47 smithi050 ceph-mon[22146]: pgmap v307: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 10 op/s 2024-08-31T05:28:47.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:47 smithi070 ceph-mon[22316]: pgmap v307: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 10 op/s 2024-08-31T05:28:48.249 INFO:teuthology.orchestra.run.smithi005.stdout:184683593782 2024-08-31T05:28:48.249 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-08-31T05:28:48.942 INFO:teuthology.orchestra.run.smithi005.stdout:279172874274 2024-08-31T05:28:48.942 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-08-31T05:28:49.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:49 smithi005 ceph-mon[18602]: pgmap v308: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-08-31T05:28:49.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.242+0000 7f5eb59ae640 1 -- 172.21.15.5:0/105685596 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5eb0101f90 msgr2=0x7f5eb01023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:49.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.242+0000 7f5eb59ae640 1 --2- 172.21.15.5:0/105685596 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5eb0101f90 0x7f5eb01023a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0009900 tx=0x7f5ea002a410 comp rx=0 tx=0).stop 2024-08-31T05:28:49.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.242+0000 7f5eb59ae640 1 -- 172.21.15.5:0/105685596 shutdown_connections 2024-08-31T05:28:49.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.242+0000 7f5eb59ae640 1 --2- 172.21.15.5:0/105685596 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5eb0108220 0x7f5eb010ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:49.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.242+0000 7f5eb59ae640 1 --2- 172.21.15.5:0/105685596 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5eb01078d0 0x7f5eb0107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:49.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.242+0000 7f5eb59ae640 1 --2- 172.21.15.5:0/105685596 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5eb0101f90 0x7f5eb01023a0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:49.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.242+0000 7f5eb59ae640 1 -- 172.21.15.5:0/105685596 >> 172.21.15.5:0/105685596 conn(0x7f5eb0077a30 msgr2=0x7f5eb0077e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:49.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.242+0000 7f5eb59ae640 1 -- 172.21.15.5:0/105685596 shutdown_connections 2024-08-31T05:28:49.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.242+0000 7f5eb59ae640 1 -- 172.21.15.5:0/105685596 wait complete. 2024-08-31T05:28:49.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.243+0000 7f5eb59ae640 1 Processor -- start 2024-08-31T05:28:49.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.243+0000 7f5eb59ae640 1 -- start start 2024-08-31T05:28:49.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.243+0000 7f5eb59ae640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5eb0101f90 0x7f5eb019a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:49.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.244+0000 7f5eb59ae640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5eb01078d0 0x7f5eb019a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:49.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.244+0000 7f5eb59ae640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5eb0108220 0x7f5eb019fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:49.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.244+0000 7f5eb59ae640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb0111660 con 0x7f5eb0101f90 2024-08-31T05:28:49.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.244+0000 7f5eb59ae640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb01114e0 con 0x7f5eb01078d0 2024-08-31T05:28:49.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.244+0000 7f5eb59ae640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb01117e0 con 0x7f5eb0108220 2024-08-31T05:28:49.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.244+0000 7f5eaf7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5eb0108220 0x7f5eb019fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:49.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.244+0000 7f5eaf7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5eb0108220 0x7f5eb019fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:45310/0 (socket says 172.21.15.5:45310) 2024-08-31T05:28:49.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.244+0000 7f5eaf7fe640 1 -- 172.21.15.5:0/4282264777 learned_addr learned my addr 172.21.15.5:0/4282264777 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:28:49.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.244+0000 7f5eae7fc640 1 --2- 172.21.15.5:0/4282264777 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5eb01078d0 0x7f5eb019a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:49.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.244+0000 7f5eaeffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5eb0101f90 0x7f5eb019a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:49.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.244+0000 7f5eaf7fe640 1 -- 172.21.15.5:0/4282264777 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5eb01078d0 msgr2=0x7f5eb019a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:49.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.244+0000 7f5eaf7fe640 1 --2- 172.21.15.5:0/4282264777 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5eb01078d0 0x7f5eb019a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:49.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.244+0000 7f5eaf7fe640 1 -- 172.21.15.5:0/4282264777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5eb0101f90 msgr2=0x7f5eb019a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:49.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.244+0000 7f5eaf7fe640 1 --2- 172.21.15.5:0/4282264777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5eb0101f90 0x7f5eb019a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:49.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.244+0000 7f5eaf7fe640 1 -- 172.21.15.5:0/4282264777 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5eb01a02b0 con 0x7f5eb0108220 2024-08-31T05:28:49.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.245+0000 7f5eaf7fe640 1 --2- 172.21.15.5:0/4282264777 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5eb0108220 0x7f5eb019fb80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5ea800eaa0 tx=0x7f5ea800ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:49.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.245+0000 7f5eb49ac640 1 -- 172.21.15.5:0/4282264777 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea800cdb0 con 0x7f5eb0108220 2024-08-31T05:28:49.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.245+0000 7f5eb49ac640 1 -- 172.21.15.5:0/4282264777 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ea8005020 con 0x7f5eb0108220 2024-08-31T05:28:49.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.245+0000 7f5eb49ac640 1 -- 172.21.15.5:0/4282264777 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea80116d0 con 0x7f5eb0108220 2024-08-31T05:28:49.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.245+0000 7f5eb59ae640 1 -- 172.21.15.5:0/4282264777 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5eb01a05a0 con 0x7f5eb0108220 2024-08-31T05:28:49.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.245+0000 7f5eb59ae640 1 -- 172.21.15.5:0/4282264777 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5eb01a6d00 con 0x7f5eb0108220 2024-08-31T05:28:49.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.246+0000 7f5eb59ae640 1 -- 172.21.15.5:0/4282264777 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5eb0063830 con 0x7f5eb0108220 2024-08-31T05:28:49.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.248+0000 7f5eb49ac640 1 -- 172.21.15.5:0/4282264777 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f5ea80051d0 con 0x7f5eb0108220 2024-08-31T05:28:49.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.249+0000 7f5eb49ac640 1 --2- 172.21.15.5:0/4282264777 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5e980b4c90 0x7f5e980b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:49.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.249+0000 7f5eaeffd640 1 --2- 172.21.15.5:0/4282264777 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5e980b4c90 0x7f5e980b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:49.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.249+0000 7f5eb49ac640 1 -- 172.21.15.5:0/4282264777 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9307+0+0 (secure 0 0 0) 0x7f5ea80e5c10 con 0x7f5eb0108220 2024-08-31T05:28:49.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.249+0000 7f5eb49ac640 1 --2- 172.21.15.5:0/4282264777 >> [v2:172.21.15.5:6810/1647468379,v1:172.21.15.5:6811/1647468379] conn(0x7f5e980c0020 0x7f5e980c2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:49.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.249+0000 7f5eb49ac640 1 -- 172.21.15.5:0/4282264777 --> [v2:172.21.15.5:6810/1647468379,v1:172.21.15.5:6811/1647468379] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5ea8014ec0 con 0x7f5e980c0020 2024-08-31T05:28:49.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.249+0000 7f5eb49ac640 1 -- 172.21.15.5:0/4282264777 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f5ea80e5fc0 con 0x7f5eb0108220 2024-08-31T05:28:49.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.250+0000 7f5eae7fc640 1 --2- 172.21.15.5:0/4282264777 >> [v2:172.21.15.5:6810/1647468379,v1:172.21.15.5:6811/1647468379] conn(0x7f5e980c0020 0x7f5e980c2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:49.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.250+0000 7f5eaeffd640 1 --2- 172.21.15.5:0/4282264777 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5e980b4c90 0x7f5e980b71a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0031440 tx=0x7f5ea0009560 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:49.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.250+0000 7f5eae7fc640 1 --2- 172.21.15.5:0/4282264777 >> [v2:172.21.15.5:6810/1647468379,v1:172.21.15.5:6811/1647468379] conn(0x7f5e980c0020 0x7f5e980c2510 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:49.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.251+0000 7f5eb49ac640 1 -- 172.21.15.5:0/4282264777 <== osd.3 v2:172.21.15.5:6810/1647468379 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5ea8014ec0 con 0x7f5e980c0020 2024-08-31T05:28:49.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.265+0000 7f5eb59ae640 1 -- 172.21.15.5:0/4282264777 --> [v2:172.21.15.5:6810/1647468379,v1:172.21.15.5:6811/1647468379] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5eb0063cb0 con 0x7f5e980c0020 2024-08-31T05:28:49.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.265+0000 7f5eb49ac640 1 -- 172.21.15.5:0/4282264777 <== osd.3 v2:172.21.15.5:6810/1647468379 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5eb0063cb0 con 0x7f5e980c0020 2024-08-31T05:28:49.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.265+0000 7f5eb59ae640 1 -- 172.21.15.5:0/4282264777 >> [v2:172.21.15.5:6810/1647468379,v1:172.21.15.5:6811/1647468379] conn(0x7f5e980c0020 msgr2=0x7f5e980c2510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:49.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.265+0000 7f5eb59ae640 1 --2- 172.21.15.5:0/4282264777 >> [v2:172.21.15.5:6810/1647468379,v1:172.21.15.5:6811/1647468379] conn(0x7f5e980c0020 0x7f5e980c2510 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:49.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.265+0000 7f5eb59ae640 1 -- 172.21.15.5:0/4282264777 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5e980b4c90 msgr2=0x7f5e980b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:49.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.265+0000 7f5eb59ae640 1 --2- 172.21.15.5:0/4282264777 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5e980b4c90 0x7f5e980b71a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0031440 tx=0x7f5ea0009560 comp rx=0 tx=0).stop 2024-08-31T05:28:49.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.265+0000 7f5eb59ae640 1 -- 172.21.15.5:0/4282264777 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5eb0108220 msgr2=0x7f5eb019fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:49.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.265+0000 7f5eb59ae640 1 --2- 172.21.15.5:0/4282264777 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5eb0108220 0x7f5eb019fb80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5ea800eaa0 tx=0x7f5ea800ef60 comp rx=0 tx=0).stop 2024-08-31T05:28:49.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.265+0000 7f5eaf7fe640 1 -- 172.21.15.5:0/4282264777 reap_dead start 2024-08-31T05:28:49.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.265+0000 7f5eb59ae640 1 -- 172.21.15.5:0/4282264777 shutdown_connections 2024-08-31T05:28:49.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.265+0000 7f5eb59ae640 1 -- 172.21.15.5:0/4282264777 >> 172.21.15.5:0/4282264777 conn(0x7f5eb0077a30 msgr2=0x7f5eb01059c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:49.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.266+0000 7f5eb59ae640 1 -- 172.21.15.5:0/4282264777 shutdown_connections 2024-08-31T05:28:49.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.266+0000 7f5eb59ae640 1 -- 172.21.15.5:0/4282264777 wait complete. 2024-08-31T05:28:49.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:49 smithi050 ceph-mon[22146]: pgmap v308: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-08-31T05:28:49.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.450+0000 7f62f1cf0640 1 -- 172.21.15.5:0/1119233697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62ec108160 msgr2=0x7f62ec108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:49.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.450+0000 7f62f1cf0640 1 --2- 172.21.15.5:0/1119233697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62ec108160 0x7f62ec108570 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f62e0009900 tx=0x7f62e002a410 comp rx=0 tx=0).stop 2024-08-31T05:28:49.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.450+0000 7f62f1cf0640 1 -- 172.21.15.5:0/1119233697 shutdown_connections 2024-08-31T05:28:49.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.450+0000 7f62f1cf0640 1 --2- 172.21.15.5:0/1119233697 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f62ec108ab0 0x7f62ec10f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:49.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.450+0000 7f62f1cf0640 1 --2- 172.21.15.5:0/1119233697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62ec108160 0x7f62ec108570 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:49.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.450+0000 7f62f1cf0640 1 --2- 172.21.15.5:0/1119233697 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62ec102820 0x7f62ec102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:49.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.450+0000 7f62f1cf0640 1 -- 172.21.15.5:0/1119233697 >> 172.21.15.5:0/1119233697 conn(0x7f62ec0794e0 msgr2=0x7f62ec0798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:49.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.450+0000 7f62f1cf0640 1 -- 172.21.15.5:0/1119233697 shutdown_connections 2024-08-31T05:28:49.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.450+0000 7f62f1cf0640 1 -- 172.21.15.5:0/1119233697 wait complete. 2024-08-31T05:28:49.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.451+0000 7f62f1cf0640 1 Processor -- start 2024-08-31T05:28:49.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.451+0000 7f62f1cf0640 1 -- start start 2024-08-31T05:28:49.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.452+0000 7f62f1cf0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62ec102820 0x7f62ec19a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:49.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.452+0000 7f62f1cf0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f62ec108160 0x7f62ec19a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:49.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.452+0000 7f62f1cf0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62ec108ab0 0x7f62ec19fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:49.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.452+0000 7f62f1cf0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f62ec112700 con 0x7f62ec108ab0 2024-08-31T05:28:49.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.452+0000 7f62f1cf0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f62ec112580 con 0x7f62ec102820 2024-08-31T05:28:49.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.452+0000 7f62f1cf0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f62ec112880 con 0x7f62ec108160 2024-08-31T05:28:49.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.452+0000 7f62ebfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62ec108ab0 0x7f62ec19fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:49.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.452+0000 7f62eb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62ec102820 0x7f62ec19a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:49.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.452+0000 7f62eb7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62ec102820 0x7f62ec19a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:49498/0 (socket says 172.21.15.5:49498) 2024-08-31T05:28:49.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.452+0000 7f62ebfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62ec108ab0 0x7f62ec19fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35498/0 (socket says 172.21.15.5:35498) 2024-08-31T05:28:49.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.452+0000 7f62eb7fe640 1 -- 172.21.15.5:0/929377877 learned_addr learned my addr 172.21.15.5:0/929377877 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:28:49.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.452+0000 7f62eaffd640 1 --2- 172.21.15.5:0/929377877 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f62ec108160 0x7f62ec19a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:49.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.452+0000 7f62ebfff640 1 -- 172.21.15.5:0/929377877 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f62ec108160 msgr2=0x7f62ec19a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:49.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.452+0000 7f62ebfff640 1 --2- 172.21.15.5:0/929377877 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f62ec108160 0x7f62ec19a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:49.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.452+0000 7f62ebfff640 1 -- 172.21.15.5:0/929377877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62ec102820 msgr2=0x7f62ec19a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:49.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.452+0000 7f62ebfff640 1 --2- 172.21.15.5:0/929377877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f62ec102820 0x7f62ec19a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:49.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.452+0000 7f62ebfff640 1 -- 172.21.15.5:0/929377877 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62ec1a0190 con 0x7f62ec108ab0 2024-08-31T05:28:49.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.452+0000 7f62ebfff640 1 --2- 172.21.15.5:0/929377877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62ec108ab0 0x7f62ec19fa60 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f62e400e940 tx=0x7f62e400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:49.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.452+0000 7f62e8ff9640 1 -- 172.21.15.5:0/929377877 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e4004d20 con 0x7f62ec108ab0 2024-08-31T05:28:49.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.453+0000 7f62f1cf0640 1 -- 172.21.15.5:0/929377877 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62ec1a0480 con 0x7f62ec108ab0 2024-08-31T05:28:49.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.453+0000 7f62e8ff9640 1 -- 172.21.15.5:0/929377877 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62e4005020 con 0x7f62ec108ab0 2024-08-31T05:28:49.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.453+0000 7f62e8ff9640 1 -- 172.21.15.5:0/929377877 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e40116d0 con 0x7f62ec108ab0 2024-08-31T05:28:49.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.453+0000 7f62f1cf0640 1 -- 172.21.15.5:0/929377877 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62ec1a6be0 con 0x7f62ec108ab0 2024-08-31T05:28:49.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.453+0000 7f62f1cf0640 1 -- 172.21.15.5:0/929377877 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f62ec0638f0 con 0x7f62ec108ab0 2024-08-31T05:28:49.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.455+0000 7f62e8ff9640 1 -- 172.21.15.5:0/929377877 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f62e4005460 con 0x7f62ec108ab0 2024-08-31T05:28:49.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.456+0000 7f62e8ff9640 1 --2- 172.21.15.5:0/929377877 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f62d40b4c10 0x7f62d40b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:49.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.456+0000 7f62eb7fe640 1 --2- 172.21.15.5:0/929377877 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f62d40b4c10 0x7f62d40b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:49.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.456+0000 7f62e8ff9640 1 -- 172.21.15.5:0/929377877 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9307+0+0 (secure 0 0 0) 0x7f62e40e5c40 con 0x7f62ec108ab0 2024-08-31T05:28:49.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.456+0000 7f62e8ff9640 1 --2- 172.21.15.5:0/929377877 >> [v2:172.21.15.50:6800/2777359361,v1:172.21.15.50:6801/2777359361] conn(0x7f62d40bffa0 0x7f62d40c2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:49.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.456+0000 7f62e8ff9640 1 -- 172.21.15.5:0/929377877 --> [v2:172.21.15.50:6800/2777359361,v1:172.21.15.50:6801/2777359361] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f62e4017e50 con 0x7f62d40bffa0 2024-08-31T05:28:49.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.456+0000 7f62e8ff9640 1 -- 172.21.15.5:0/929377877 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f62e40e5ff0 con 0x7f62ec108ab0 2024-08-31T05:28:49.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.456+0000 7f62eb7fe640 1 --2- 172.21.15.5:0/929377877 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f62d40b4c10 0x7f62d40b7120 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f62dc005fd0 tx=0x7f62dc00b4a0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:49.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.456+0000 7f62eaffd640 1 --2- 172.21.15.5:0/929377877 >> [v2:172.21.15.50:6800/2777359361,v1:172.21.15.50:6801/2777359361] conn(0x7f62d40bffa0 0x7f62d40c2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:49.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.457+0000 7f62eaffd640 1 --2- 172.21.15.5:0/929377877 >> [v2:172.21.15.50:6800/2777359361,v1:172.21.15.50:6801/2777359361] conn(0x7f62d40bffa0 0x7f62d40c2490 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:49.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.458+0000 7f62e8ff9640 1 -- 172.21.15.5:0/929377877 <== osd.1 v2:172.21.15.50:6800/2777359361 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f62e4017e50 con 0x7f62d40bffa0 2024-08-31T05:28:49.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.471+0000 7f62f1cf0640 1 -- 172.21.15.5:0/929377877 --> [v2:172.21.15.50:6800/2777359361,v1:172.21.15.50:6801/2777359361] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f62ec063cf0 con 0x7f62d40bffa0 2024-08-31T05:28:49.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.472+0000 7f62e8ff9640 1 -- 172.21.15.5:0/929377877 <== osd.1 v2:172.21.15.50:6800/2777359361 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f62ec063cf0 con 0x7f62d40bffa0 2024-08-31T05:28:49.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.472+0000 7f62f1cf0640 1 -- 172.21.15.5:0/929377877 >> [v2:172.21.15.50:6800/2777359361,v1:172.21.15.50:6801/2777359361] conn(0x7f62d40bffa0 msgr2=0x7f62d40c2490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:49.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.472+0000 7f62f1cf0640 1 --2- 172.21.15.5:0/929377877 >> [v2:172.21.15.50:6800/2777359361,v1:172.21.15.50:6801/2777359361] conn(0x7f62d40bffa0 0x7f62d40c2490 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:49.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.472+0000 7f62f1cf0640 1 -- 172.21.15.5:0/929377877 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f62d40b4c10 msgr2=0x7f62d40b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:49.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.472+0000 7f62f1cf0640 1 --2- 172.21.15.5:0/929377877 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f62d40b4c10 0x7f62d40b7120 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f62dc005fd0 tx=0x7f62dc00b4a0 comp rx=0 tx=0).stop 2024-08-31T05:28:49.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.472+0000 7f62f1cf0640 1 -- 172.21.15.5:0/929377877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62ec108ab0 msgr2=0x7f62ec19fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:49.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.472+0000 7f62f1cf0640 1 --2- 172.21.15.5:0/929377877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62ec108ab0 0x7f62ec19fa60 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f62e400e940 tx=0x7f62e400ee00 comp rx=0 tx=0).stop 2024-08-31T05:28:49.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.472+0000 7f62ebfff640 1 -- 172.21.15.5:0/929377877 reap_dead start 2024-08-31T05:28:49.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.472+0000 7f62f1cf0640 1 -- 172.21.15.5:0/929377877 shutdown_connections 2024-08-31T05:28:49.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.473+0000 7f62f1cf0640 1 -- 172.21.15.5:0/929377877 >> 172.21.15.5:0/929377877 conn(0x7f62ec0794e0 msgr2=0x7f62ec06bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:49.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.473+0000 7f62f1cf0640 1 -- 172.21.15.5:0/929377877 shutdown_connections 2024-08-31T05:28:49.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:49.473+0000 7f62f1cf0640 1 -- 172.21.15.5:0/929377877 wait complete. 2024-08-31T05:28:49.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:49 smithi070 ceph-mon[22316]: pgmap v308: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-08-31T05:28:50.375 INFO:teuthology.orchestra.run.smithi005.stdout:60129542224 2024-08-31T05:28:50.375 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-08-31T05:28:50.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.554+0000 7fb1bf486640 1 -- 172.21.15.5:0/654749315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1b8104ff0 msgr2=0x7fb1b810d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:50.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.554+0000 7fb1bf486640 1 --2- 172.21.15.5:0/654749315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1b8104ff0 0x7fb1b810d710 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8009900 tx=0x7fb1a802a410 comp rx=0 tx=0).stop 2024-08-31T05:28:50.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.554+0000 7fb1bf486640 1 -- 172.21.15.5:0/654749315 shutdown_connections 2024-08-31T05:28:50.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.554+0000 7fb1bf486640 1 --2- 172.21.15.5:0/654749315 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb1b810dc50 0x7fb1b81100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:50.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.554+0000 7fb1bf486640 1 --2- 172.21.15.5:0/654749315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1b8104ff0 0x7fb1b810d710 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:50.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.554+0000 7fb1bf486640 1 --2- 172.21.15.5:0/654749315 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1b81046a0 0x7fb1b8104ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:50.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.554+0000 7fb1bf486640 1 -- 172.21.15.5:0/654749315 >> 172.21.15.5:0/654749315 conn(0x7fb1b8079530 msgr2=0x7fb1b8079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:50.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.555+0000 7fb1bf486640 1 -- 172.21.15.5:0/654749315 shutdown_connections 2024-08-31T05:28:50.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.555+0000 7fb1bf486640 1 -- 172.21.15.5:0/654749315 wait complete. 2024-08-31T05:28:50.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.555+0000 7fb1bf486640 1 Processor -- start 2024-08-31T05:28:50.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.555+0000 7fb1bf486640 1 -- start start 2024-08-31T05:28:50.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.556+0000 7fb1bf486640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1b81046a0 0x7fb1b819a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:50.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.556+0000 7fb1bf486640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1b8104ff0 0x7fb1b819a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:50.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.556+0000 7fb1bf486640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb1b810dc50 0x7fb1b819fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:50.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.556+0000 7fb1bf486640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb1b8113840 con 0x7fb1b81046a0 2024-08-31T05:28:50.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.556+0000 7fb1bf486640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb1b81136c0 con 0x7fb1b8104ff0 2024-08-31T05:28:50.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.556+0000 7fb1bf486640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb1b81139c0 con 0x7fb1b810dc50 2024-08-31T05:28:50.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.556+0000 7fb1bd222640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1b81046a0 0x7fb1b819a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:50.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.556+0000 7fb1bd222640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1b81046a0 0x7fb1b819a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35516/0 (socket says 172.21.15.5:35516) 2024-08-31T05:28:50.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.556+0000 7fb1bd222640 1 -- 172.21.15.5:0/3401443097 learned_addr learned my addr 172.21.15.5:0/3401443097 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:28:50.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.556+0000 7fb1bca21640 1 --2- 172.21.15.5:0/3401443097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1b8104ff0 0x7fb1b819a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:50.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.556+0000 7fb1bda23640 1 --2- 172.21.15.5:0/3401443097 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb1b810dc50 0x7fb1b819fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:50.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.556+0000 7fb1bd222640 1 -- 172.21.15.5:0/3401443097 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb1b810dc50 msgr2=0x7fb1b819fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:50.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.556+0000 7fb1bd222640 1 --2- 172.21.15.5:0/3401443097 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb1b810dc50 0x7fb1b819fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:50.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.556+0000 7fb1bd222640 1 -- 172.21.15.5:0/3401443097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1b8104ff0 msgr2=0x7fb1b819a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:50.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.556+0000 7fb1bd222640 1 --2- 172.21.15.5:0/3401443097 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb1b8104ff0 0x7fb1b819a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:50.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.556+0000 7fb1bd222640 1 -- 172.21.15.5:0/3401443097 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1b81a0140 con 0x7fb1b81046a0 2024-08-31T05:28:50.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.557+0000 7fb1bd222640 1 --2- 172.21.15.5:0/3401443097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1b81046a0 0x7fb1b819a1d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb1b400d950 tx=0x7fb1b400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:50.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.557+0000 7fb1ae7fc640 1 -- 172.21.15.5:0/3401443097 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b4017030 con 0x7fb1b81046a0 2024-08-31T05:28:50.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.557+0000 7fb1bf486640 1 -- 172.21.15.5:0/3401443097 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1b81a0430 con 0x7fb1b81046a0 2024-08-31T05:28:50.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.557+0000 7fb1ae7fc640 1 -- 172.21.15.5:0/3401443097 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb1b4004020 con 0x7fb1b81046a0 2024-08-31T05:28:50.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.557+0000 7fb1ae7fc640 1 -- 172.21.15.5:0/3401443097 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b40047a0 con 0x7fb1b81046a0 2024-08-31T05:28:50.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.557+0000 7fb1bf486640 1 -- 172.21.15.5:0/3401443097 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1b81a6b90 con 0x7fb1b81046a0 2024-08-31T05:28:50.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.558+0000 7fb1bf486640 1 -- 172.21.15.5:0/3401443097 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb1b80638f0 con 0x7fb1b81046a0 2024-08-31T05:28:50.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.560+0000 7fb1ae7fc640 1 -- 172.21.15.5:0/3401443097 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7fb1b4009a30 con 0x7fb1b81046a0 2024-08-31T05:28:50.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.561+0000 7fb1ae7fc640 1 --2- 172.21.15.5:0/3401443097 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb1a40b4c10 0x7fb1a40b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:50.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.562+0000 7fb1bca21640 1 --2- 172.21.15.5:0/3401443097 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb1a40b4c10 0x7fb1a40b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:50.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.562+0000 7fb1ae7fc640 1 -- 172.21.15.5:0/3401443097 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9307+0+0 (secure 0 0 0) 0x7fb1b40e5c40 con 0x7fb1b81046a0 2024-08-31T05:28:50.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.562+0000 7fb1ae7fc640 1 --2- 172.21.15.5:0/3401443097 >> [v2:172.21.15.70:6800/1400583716,v1:172.21.15.70:6801/1400583716] conn(0x7fb1a40bffa0 0x7fb1a40c2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:50.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.562+0000 7fb1ae7fc640 1 -- 172.21.15.5:0/3401443097 --> [v2:172.21.15.70:6800/1400583716,v1:172.21.15.70:6801/1400583716] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb1b40056a0 con 0x7fb1a40bffa0 2024-08-31T05:28:50.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.562+0000 7fb1ae7fc640 1 -- 172.21.15.5:0/3401443097 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7fb1b40e5ff0 con 0x7fb1b81046a0 2024-08-31T05:28:50.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.562+0000 7fb1bda23640 1 --2- 172.21.15.5:0/3401443097 >> [v2:172.21.15.70:6800/1400583716,v1:172.21.15.70:6801/1400583716] conn(0x7fb1a40bffa0 0x7fb1a40c2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:50.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.562+0000 7fb1bca21640 1 --2- 172.21.15.5:0/3401443097 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb1a40b4c10 0x7fb1a40b7120 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8000c00 tx=0x7fb1a8031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:50.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.563+0000 7fb1bda23640 1 --2- 172.21.15.5:0/3401443097 >> [v2:172.21.15.70:6800/1400583716,v1:172.21.15.70:6801/1400583716] conn(0x7fb1a40bffa0 0x7fb1a40c2490 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:50.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.563+0000 7fb1ae7fc640 1 -- 172.21.15.5:0/3401443097 <== osd.2 v2:172.21.15.70:6800/1400583716 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb1b40056a0 con 0x7fb1a40bffa0 2024-08-31T05:28:50.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.578+0000 7fb1bf486640 1 -- 172.21.15.5:0/3401443097 --> [v2:172.21.15.70:6800/1400583716,v1:172.21.15.70:6801/1400583716] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb1b8063d20 con 0x7fb1a40bffa0 2024-08-31T05:28:50.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.579+0000 7fb1ae7fc640 1 -- 172.21.15.5:0/3401443097 <== osd.2 v2:172.21.15.70:6800/1400583716 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb1b8063d20 con 0x7fb1a40bffa0 2024-08-31T05:28:50.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.579+0000 7fb1bf486640 1 -- 172.21.15.5:0/3401443097 >> [v2:172.21.15.70:6800/1400583716,v1:172.21.15.70:6801/1400583716] conn(0x7fb1a40bffa0 msgr2=0x7fb1a40c2490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:50.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.579+0000 7fb1bf486640 1 --2- 172.21.15.5:0/3401443097 >> [v2:172.21.15.70:6800/1400583716,v1:172.21.15.70:6801/1400583716] conn(0x7fb1a40bffa0 0x7fb1a40c2490 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:50.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.579+0000 7fb1bf486640 1 -- 172.21.15.5:0/3401443097 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb1a40b4c10 msgr2=0x7fb1a40b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:50.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.579+0000 7fb1bf486640 1 --2- 172.21.15.5:0/3401443097 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb1a40b4c10 0x7fb1a40b7120 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8000c00 tx=0x7fb1a8031400 comp rx=0 tx=0).stop 2024-08-31T05:28:50.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.579+0000 7fb1bf486640 1 -- 172.21.15.5:0/3401443097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1b81046a0 msgr2=0x7fb1b819a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:50.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.579+0000 7fb1bf486640 1 --2- 172.21.15.5:0/3401443097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1b81046a0 0x7fb1b819a1d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb1b400d950 tx=0x7fb1b400de10 comp rx=0 tx=0).stop 2024-08-31T05:28:50.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.579+0000 7fb1bda23640 1 -- 172.21.15.5:0/3401443097 reap_dead start 2024-08-31T05:28:50.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.579+0000 7fb1bf486640 1 -- 172.21.15.5:0/3401443097 shutdown_connections 2024-08-31T05:28:50.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.579+0000 7fb1bf486640 1 -- 172.21.15.5:0/3401443097 >> 172.21.15.5:0/3401443097 conn(0x7fb1b8079530 msgr2=0x7fb1b8100700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:50.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.579+0000 7fb1bf486640 1 -- 172.21.15.5:0/3401443097 shutdown_connections 2024-08-31T05:28:50.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.580+0000 7fb1bf486640 1 -- 172.21.15.5:0/3401443097 wait complete. 2024-08-31T05:28:50.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.892+0000 7fd9a3348640 1 -- 172.21.15.5:0/1003339325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd99c108ad0 msgr2=0x7fd99c10f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:50.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.892+0000 7fd9a3348640 1 --2- 172.21.15.5:0/1003339325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd99c108ad0 0x7fd99c10f300 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd994009ca0 tx=0x7fd99402a8c0 comp rx=0 tx=0).stop 2024-08-31T05:28:50.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.892+0000 7fd9a3348640 1 -- 172.21.15.5:0/1003339325 shutdown_connections 2024-08-31T05:28:50.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.892+0000 7fd9a3348640 1 --2- 172.21.15.5:0/1003339325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd99c108ad0 0x7fd99c10f300 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:50.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.892+0000 7fd9a3348640 1 --2- 172.21.15.5:0/1003339325 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd99c108180 0x7fd99c108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:50.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.892+0000 7fd9a3348640 1 --2- 172.21.15.5:0/1003339325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd99c102840 0x7fd99c102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:50.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.892+0000 7fd9a3348640 1 -- 172.21.15.5:0/1003339325 >> 172.21.15.5:0/1003339325 conn(0x7fd99c079580 msgr2=0x7fd99c079990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:50.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.892+0000 7fd9a3348640 1 -- 172.21.15.5:0/1003339325 shutdown_connections 2024-08-31T05:28:50.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.892+0000 7fd9a3348640 1 -- 172.21.15.5:0/1003339325 wait complete. 2024-08-31T05:28:50.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.893+0000 7fd9a3348640 1 Processor -- start 2024-08-31T05:28:50.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.893+0000 7fd9a3348640 1 -- start start 2024-08-31T05:28:50.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.893+0000 7fd9a3348640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd99c102840 0x7fd99c19af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:50.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.893+0000 7fd9a3348640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd99c108180 0x7fd99c19b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:50.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.893+0000 7fd9a3348640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd99c108ad0 0x7fd99c19ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:50.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.893+0000 7fd9a3348640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd99c112750 con 0x7fd99c102840 2024-08-31T05:28:50.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.893+0000 7fd9a3348640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd99c1125d0 con 0x7fd99c108180 2024-08-31T05:28:50.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.893+0000 7fd9a3348640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd99c1128d0 con 0x7fd99c108ad0 2024-08-31T05:28:50.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.893+0000 7fd9a10e4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd99c102840 0x7fd99c19af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:50.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.893+0000 7fd9a10e4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd99c102840 0x7fd99c19af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35544/0 (socket says 172.21.15.5:35544) 2024-08-31T05:28:50.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.893+0000 7fd9a10e4640 1 -- 172.21.15.5:0/3539772252 learned_addr learned my addr 172.21.15.5:0/3539772252 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:28:50.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.894+0000 7fd9a08e3640 1 --2- 172.21.15.5:0/3539772252 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd99c108180 0x7fd99c19b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:50.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.894+0000 7fd9a10e4640 1 -- 172.21.15.5:0/3539772252 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd99c108ad0 msgr2=0x7fd99c19ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:50.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.894+0000 7fd9a18e5640 1 --2- 172.21.15.5:0/3539772252 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd99c108ad0 0x7fd99c19ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:50.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.894+0000 7fd9a10e4640 1 --2- 172.21.15.5:0/3539772252 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd99c108ad0 0x7fd99c19ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:50.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.894+0000 7fd9a10e4640 1 -- 172.21.15.5:0/3539772252 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd99c108180 msgr2=0x7fd99c19b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:50.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.894+0000 7fd9a10e4640 1 --2- 172.21.15.5:0/3539772252 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd99c108180 0x7fd99c19b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:50.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.894+0000 7fd9a10e4640 1 -- 172.21.15.5:0/3539772252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd99c1a61b0 con 0x7fd99c102840 2024-08-31T05:28:50.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.894+0000 7fd9a08e3640 1 --2- 172.21.15.5:0/3539772252 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd99c108180 0x7fd99c19b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:28:50.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.894+0000 7fd9a18e5640 1 --2- 172.21.15.5:0/3539772252 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd99c108ad0 0x7fd99c19ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:28:50.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.894+0000 7fd9a10e4640 1 --2- 172.21.15.5:0/3539772252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd99c102840 0x7fd99c19af80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd99800c920 tx=0x7fd99800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:50.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.894+0000 7fd9927fc640 1 -- 172.21.15.5:0/3539772252 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd998007c70 con 0x7fd99c102840 2024-08-31T05:28:50.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.894+0000 7fd9927fc640 1 -- 172.21.15.5:0/3539772252 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd998007e10 con 0x7fd99c102840 2024-08-31T05:28:50.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.894+0000 7fd9a3348640 1 -- 172.21.15.5:0/3539772252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd99c1a64a0 con 0x7fd99c102840 2024-08-31T05:28:50.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.894+0000 7fd9927fc640 1 -- 172.21.15.5:0/3539772252 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd998018820 con 0x7fd99c102840 2024-08-31T05:28:50.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.894+0000 7fd9a3348640 1 -- 172.21.15.5:0/3539772252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd99c1a6a30 con 0x7fd99c102840 2024-08-31T05:28:50.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.895+0000 7fd9a3348640 1 -- 172.21.15.5:0/3539772252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd99c0638f0 con 0x7fd99c102840 2024-08-31T05:28:50.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.897+0000 7fd9927fc640 1 -- 172.21.15.5:0/3539772252 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7fd99800f450 con 0x7fd99c102840 2024-08-31T05:28:50.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.898+0000 7fd9927fc640 1 --2- 172.21.15.5:0/3539772252 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd9880b4c90 0x7fd9880b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:50.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.898+0000 7fd9a08e3640 1 --2- 172.21.15.5:0/3539772252 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd9880b4c90 0x7fd9880b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:50.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.898+0000 7fd9927fc640 1 -- 172.21.15.5:0/3539772252 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9307+0+0 (secure 0 0 0) 0x7fd9980e5d90 con 0x7fd99c102840 2024-08-31T05:28:50.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.898+0000 7fd9927fc640 1 --2- 172.21.15.5:0/3539772252 >> [v2:172.21.15.5:6826/2988145512,v1:172.21.15.5:6827/2988145512] conn(0x7fd9880c0020 0x7fd9880c2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:50.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.898+0000 7fd9927fc640 1 -- 172.21.15.5:0/3539772252 --> [v2:172.21.15.5:6826/2988145512,v1:172.21.15.5:6827/2988145512] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd998004470 con 0x7fd9880c0020 2024-08-31T05:28:50.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.898+0000 7fd9927fc640 1 -- 172.21.15.5:0/3539772252 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7fd9980e6140 con 0x7fd99c102840 2024-08-31T05:28:50.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.898+0000 7fd9a18e5640 1 --2- 172.21.15.5:0/3539772252 >> [v2:172.21.15.5:6826/2988145512,v1:172.21.15.5:6827/2988145512] conn(0x7fd9880c0020 0x7fd9880c2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:50.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.898+0000 7fd9a08e3640 1 --2- 172.21.15.5:0/3539772252 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd9880b4c90 0x7fd9880b71a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd99c107840 tx=0x7fd98c005d30 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:50.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.898+0000 7fd9a18e5640 1 --2- 172.21.15.5:0/3539772252 >> [v2:172.21.15.5:6826/2988145512,v1:172.21.15.5:6827/2988145512] conn(0x7fd9880c0020 0x7fd9880c2510 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:50.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.899+0000 7fd9927fc640 1 -- 172.21.15.5:0/3539772252 <== osd.9 v2:172.21.15.5:6826/2988145512 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd998004470 con 0x7fd9880c0020 2024-08-31T05:28:50.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.913+0000 7fd9a3348640 1 -- 172.21.15.5:0/3539772252 --> [v2:172.21.15.5:6826/2988145512,v1:172.21.15.5:6827/2988145512] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd99c063cf0 con 0x7fd9880c0020 2024-08-31T05:28:50.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.913+0000 7fd9927fc640 1 -- 172.21.15.5:0/3539772252 <== osd.9 v2:172.21.15.5:6826/2988145512 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd99c063cf0 con 0x7fd9880c0020 2024-08-31T05:28:50.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.914+0000 7fd9a3348640 1 -- 172.21.15.5:0/3539772252 >> [v2:172.21.15.5:6826/2988145512,v1:172.21.15.5:6827/2988145512] conn(0x7fd9880c0020 msgr2=0x7fd9880c2510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:50.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.914+0000 7fd9a3348640 1 --2- 172.21.15.5:0/3539772252 >> [v2:172.21.15.5:6826/2988145512,v1:172.21.15.5:6827/2988145512] conn(0x7fd9880c0020 0x7fd9880c2510 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:50.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.914+0000 7fd9a3348640 1 -- 172.21.15.5:0/3539772252 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd9880b4c90 msgr2=0x7fd9880b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:50.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.914+0000 7fd9a3348640 1 --2- 172.21.15.5:0/3539772252 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd9880b4c90 0x7fd9880b71a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd99c107840 tx=0x7fd98c005d30 comp rx=0 tx=0).stop 2024-08-31T05:28:50.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.914+0000 7fd9a3348640 1 -- 172.21.15.5:0/3539772252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd99c102840 msgr2=0x7fd99c19af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:50.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.914+0000 7fd9a3348640 1 --2- 172.21.15.5:0/3539772252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd99c102840 0x7fd99c19af80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd99800c920 tx=0x7fd99800cde0 comp rx=0 tx=0).stop 2024-08-31T05:28:50.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.914+0000 7fd9a18e5640 1 -- 172.21.15.5:0/3539772252 reap_dead start 2024-08-31T05:28:50.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.914+0000 7fd9a3348640 1 -- 172.21.15.5:0/3539772252 shutdown_connections 2024-08-31T05:28:50.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.914+0000 7fd9a3348640 1 -- 172.21.15.5:0/3539772252 >> 172.21.15.5:0/3539772252 conn(0x7fd99c079580 msgr2=0x7fd99c104fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:50.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.914+0000 7fd9a3348640 1 -- 172.21.15.5:0/3539772252 shutdown_connections 2024-08-31T05:28:50.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:50.914+0000 7fd9a3348640 1 -- 172.21.15.5:0/3539772252 wait complete. 2024-08-31T05:28:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:28:51.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:51 smithi050 ceph-mon[22146]: pgmap v309: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-08-31T05:28:51.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:51 smithi005 ceph-mon[18602]: pgmap v309: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-08-31T05:28:51.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:51 smithi070 ceph-mon[22316]: pgmap v309: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-08-31T05:28:51.598 INFO:teuthology.orchestra.run.smithi005.stdout:111669149767 2024-08-31T05:28:51.599 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-08-31T05:28:51.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.780+0000 7f2eb8dac640 1 -- 172.21.15.5:0/2604396811 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2eb4103920 msgr2=0x7f2eb4103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:51.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.780+0000 7f2eb8dac640 1 --2- 172.21.15.5:0/2604396811 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2eb4103920 0x7f2eb4103d30 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4009900 tx=0x7f2ea402a410 comp rx=0 tx=0).stop 2024-08-31T05:28:51.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.780+0000 7f2eb8dac640 1 -- 172.21.15.5:0/2604396811 shutdown_connections 2024-08-31T05:28:51.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.780+0000 7f2eb8dac640 1 --2- 172.21.15.5:0/2604396811 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2eb4109bb0 0x7f2eb41103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:51.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.780+0000 7f2eb8dac640 1 --2- 172.21.15.5:0/2604396811 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2eb4109260 0x7f2eb4109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:51.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.780+0000 7f2eb8dac640 1 --2- 172.21.15.5:0/2604396811 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2eb4103920 0x7f2eb4103d30 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:51.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.780+0000 7f2eb8dac640 1 -- 172.21.15.5:0/2604396811 >> 172.21.15.5:0/2604396811 conn(0x7f2eb40ff3b0 msgr2=0x7f2eb4101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:51.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.780+0000 7f2eb8dac640 1 -- 172.21.15.5:0/2604396811 shutdown_connections 2024-08-31T05:28:51.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.780+0000 7f2eb8dac640 1 -- 172.21.15.5:0/2604396811 wait complete. 2024-08-31T05:28:51.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.781+0000 7f2eb8dac640 1 Processor -- start 2024-08-31T05:28:51.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.781+0000 7f2eb8dac640 1 -- start start 2024-08-31T05:28:51.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.781+0000 7f2eb8dac640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2eb4103920 0x7f2eb419a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:51.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.781+0000 7f2eb8dac640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2eb4109260 0x7f2eb419a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:51.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.781+0000 7f2eb8dac640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2eb4109bb0 0x7f2eb419fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:51.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.781+0000 7f2eb8dac640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb4113870 con 0x7f2eb4103920 2024-08-31T05:28:51.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.781+0000 7f2eb8dac640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb41136f0 con 0x7f2eb4109bb0 2024-08-31T05:28:51.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.781+0000 7f2eb8dac640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb41139f0 con 0x7f2eb4109260 2024-08-31T05:28:51.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.782+0000 7f2eb259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2eb4103920 0x7f2eb419a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:51.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.782+0000 7f2eb259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2eb4103920 0x7f2eb419a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35550/0 (socket says 172.21.15.5:35550) 2024-08-31T05:28:51.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.782+0000 7f2eb259c640 1 -- 172.21.15.5:0/403111701 learned_addr learned my addr 172.21.15.5:0/403111701 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:28:51.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.782+0000 7f2eb2d9d640 1 --2- 172.21.15.5:0/403111701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2eb4109bb0 0x7f2eb419fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:51.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.782+0000 7f2eb1d9b640 1 --2- 172.21.15.5:0/403111701 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2eb4109260 0x7f2eb419a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:51.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.782+0000 7f2eb259c640 1 -- 172.21.15.5:0/403111701 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2eb4109260 msgr2=0x7f2eb419a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:51.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.782+0000 7f2eb259c640 1 --2- 172.21.15.5:0/403111701 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2eb4109260 0x7f2eb419a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:51.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.782+0000 7f2eb259c640 1 -- 172.21.15.5:0/403111701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2eb4109bb0 msgr2=0x7f2eb419fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:51.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.782+0000 7f2eb259c640 1 --2- 172.21.15.5:0/403111701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2eb4109bb0 0x7f2eb419fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:51.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.782+0000 7f2eb259c640 1 -- 172.21.15.5:0/403111701 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eb41a0170 con 0x7f2eb4103920 2024-08-31T05:28:51.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.782+0000 7f2eb259c640 1 --2- 172.21.15.5:0/403111701 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2eb4103920 0x7f2eb419a200 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4005940 tx=0x7f2ea40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:51.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.783+0000 7f2ea37fe640 1 -- 172.21.15.5:0/403111701 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea403f030 con 0x7f2eb4103920 2024-08-31T05:28:51.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.783+0000 7f2eb8dac640 1 -- 172.21.15.5:0/403111701 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2eb41a0400 con 0x7f2eb4103920 2024-08-31T05:28:51.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.783+0000 7f2ea37fe640 1 -- 172.21.15.5:0/403111701 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ea4003cb0 con 0x7f2eb4103920 2024-08-31T05:28:51.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.783+0000 7f2ea37fe640 1 -- 172.21.15.5:0/403111701 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea4035070 con 0x7f2eb4103920 2024-08-31T05:28:51.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.783+0000 7f2eb8dac640 1 -- 172.21.15.5:0/403111701 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2eb41a6bc0 con 0x7f2eb4103920 2024-08-31T05:28:51.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.784+0000 7f2eb8dac640 1 -- 172.21.15.5:0/403111701 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2eb40638f0 con 0x7f2eb4103920 2024-08-31T05:28:51.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.786+0000 7f2ea37fe640 1 -- 172.21.15.5:0/403111701 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f2ea4042030 con 0x7f2eb4103920 2024-08-31T05:28:51.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.786+0000 7f2ea37fe640 1 --2- 172.21.15.5:0/403111701 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2e9c0b4c10 0x7f2e9c0b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:51.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.787+0000 7f2eb1d9b640 1 --2- 172.21.15.5:0/403111701 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2e9c0b4c10 0x7f2e9c0b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:51.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.787+0000 7f2ea37fe640 1 -- 172.21.15.5:0/403111701 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9307+0+0 (secure 0 0 0) 0x7f2ea4106210 con 0x7f2eb4103920 2024-08-31T05:28:51.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.787+0000 7f2ea37fe640 1 --2- 172.21.15.5:0/403111701 >> [v2:172.21.15.50:6816/2718354517,v1:172.21.15.50:6817/2718354517] conn(0x7f2e9c0bffa0 0x7f2e9c0c2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:51.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.787+0000 7f2ea37fe640 1 -- 172.21.15.5:0/403111701 --> [v2:172.21.15.50:6816/2718354517,v1:172.21.15.50:6817/2718354517] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2ea4036e90 con 0x7f2e9c0bffa0 2024-08-31T05:28:51.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.787+0000 7f2ea37fe640 1 -- 172.21.15.5:0/403111701 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f2ea4106660 con 0x7f2eb4103920 2024-08-31T05:28:51.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.787+0000 7f2eb1d9b640 1 --2- 172.21.15.5:0/403111701 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2e9c0b4c10 0x7f2e9c0b7120 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2eb4108d30 tx=0x7f2ea800b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:51.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.787+0000 7f2eb2d9d640 1 --2- 172.21.15.5:0/403111701 >> [v2:172.21.15.50:6816/2718354517,v1:172.21.15.50:6817/2718354517] conn(0x7f2e9c0bffa0 0x7f2e9c0c2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:51.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.788+0000 7f2eb2d9d640 1 --2- 172.21.15.5:0/403111701 >> [v2:172.21.15.50:6816/2718354517,v1:172.21.15.50:6817/2718354517] conn(0x7f2e9c0bffa0 0x7f2e9c0c2490 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:51.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.789+0000 7f2ea37fe640 1 -- 172.21.15.5:0/403111701 <== osd.7 v2:172.21.15.50:6816/2718354517 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2ea4036e90 con 0x7f2e9c0bffa0 2024-08-31T05:28:51.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.803+0000 7f2eb8dac640 1 -- 172.21.15.5:0/403111701 --> [v2:172.21.15.50:6816/2718354517,v1:172.21.15.50:6817/2718354517] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2eb4063cf0 con 0x7f2e9c0bffa0 2024-08-31T05:28:51.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.804+0000 7f2ea37fe640 1 -- 172.21.15.5:0/403111701 <== osd.7 v2:172.21.15.50:6816/2718354517 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2eb4063cf0 con 0x7f2e9c0bffa0 2024-08-31T05:28:51.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.804+0000 7f2eb8dac640 1 -- 172.21.15.5:0/403111701 >> [v2:172.21.15.50:6816/2718354517,v1:172.21.15.50:6817/2718354517] conn(0x7f2e9c0bffa0 msgr2=0x7f2e9c0c2490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:51.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.804+0000 7f2eb8dac640 1 --2- 172.21.15.5:0/403111701 >> [v2:172.21.15.50:6816/2718354517,v1:172.21.15.50:6817/2718354517] conn(0x7f2e9c0bffa0 0x7f2e9c0c2490 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:51.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.804+0000 7f2eb8dac640 1 -- 172.21.15.5:0/403111701 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2e9c0b4c10 msgr2=0x7f2e9c0b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:51.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.804+0000 7f2eb8dac640 1 --2- 172.21.15.5:0/403111701 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2e9c0b4c10 0x7f2e9c0b7120 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2eb4108d30 tx=0x7f2ea800b390 comp rx=0 tx=0).stop 2024-08-31T05:28:51.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.804+0000 7f2eb8dac640 1 -- 172.21.15.5:0/403111701 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2eb4103920 msgr2=0x7f2eb419a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:51.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.804+0000 7f2eb8dac640 1 --2- 172.21.15.5:0/403111701 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2eb4103920 0x7f2eb419a200 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4005940 tx=0x7f2ea40042f0 comp rx=0 tx=0).stop 2024-08-31T05:28:51.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.804+0000 7f2eb2d9d640 1 -- 172.21.15.5:0/403111701 reap_dead start 2024-08-31T05:28:51.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.804+0000 7f2eb8dac640 1 -- 172.21.15.5:0/403111701 shutdown_connections 2024-08-31T05:28:51.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.805+0000 7f2eb8dac640 1 -- 172.21.15.5:0/403111701 >> 172.21.15.5:0/403111701 conn(0x7f2eb40ff3b0 msgr2=0x7f2eb41017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:51.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.805+0000 7f2eb8dac640 1 -- 172.21.15.5:0/403111701 shutdown_connections 2024-08-31T05:28:51.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:51.805+0000 7f2eb8dac640 1 -- 172.21.15.5:0/403111701 wait complete. 2024-08-31T05:28:52.243 INFO:teuthology.orchestra.run.smithi005.stdout:231928234027 2024-08-31T05:28:52.244 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-08-31T05:28:52.905 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:28:53.285 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:53 smithi005 ceph-mon[18602]: pgmap v310: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-08-31T05:28:53.313 INFO:teuthology.orchestra.run.smithi005.stdout:257698037800 2024-08-31T05:28:53.313 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-08-31T05:28:53.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:53 smithi050 ceph-mon[22146]: pgmap v310: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-08-31T05:28:53.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:53 smithi070 ceph-mon[22316]: pgmap v310: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-08-31T05:28:53.910 INFO:teuthology.orchestra.run.smithi005.stdout:81604378700 2024-08-31T05:28:53.911 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-08-31T05:28:54.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:54.142+0000 7f9176c7a640 1 -- 172.21.15.5:0/1394331497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f917010dbb0 msgr2=0x7f91701100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:54.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:54.142+0000 7f9176c7a640 1 --2- 172.21.15.5:0/1394331497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f917010dbb0 0x7f91701100a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9168009ca0 tx=0x7f916802a8c0 comp rx=0 tx=0).stop 2024-08-31T05:28:54.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:54.143+0000 7f9176c7a640 1 -- 172.21.15.5:0/1394331497 shutdown_connections 2024-08-31T05:28:54.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:54.143+0000 7f9176c7a640 1 --2- 172.21.15.5:0/1394331497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f917010dbb0 0x7f91701100a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:54.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:54.143+0000 7f9176c7a640 1 --2- 172.21.15.5:0/1394331497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91701050a0 0x7f917010d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:54.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:54.143+0000 7f9176c7a640 1 --2- 172.21.15.5:0/1394331497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9170104750 0x7f9170104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:54.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:54.143+0000 7f9176c7a640 1 -- 172.21.15.5:0/1394331497 >> 172.21.15.5:0/1394331497 conn(0x7f91700794d0 msgr2=0x7f91700798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:54.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:54.143+0000 7f9176c7a640 1 -- 172.21.15.5:0/1394331497 shutdown_connections 2024-08-31T05:28:54.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:54.143+0000 7f9176c7a640 1 -- 172.21.15.5:0/1394331497 wait complete. 2024-08-31T05:28:54.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:54.143+0000 7f9176c7a640 1 Processor -- start 2024-08-31T05:28:54.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:54.144+0000 7f9176c7a640 1 -- start start 2024-08-31T05:28:54.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:54.144+0000 7f9176c7a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9170104750 0x7f917019a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:54.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:54.144+0000 7f9176c7a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91701050a0 0x7f917019a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:54.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:54.144+0000 7f9176c7a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f917010dbb0 0x7f917019fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:54.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:54.144+0000 7f9176c7a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9170113810 con 0x7f9170104750 2024-08-31T05:28:54.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:54.144+0000 7f9176c7a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9170113690 con 0x7f91701050a0 2024-08-31T05:28:54.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:54.144+0000 7f9176c7a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9170113990 con 0x7f917010dbb0 2024-08-31T05:28:54.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:54.144+0000 7f9174a16640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9170104750 0x7f917019a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:54.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:54.144+0000 7f9174a16640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9170104750 0x7f917019a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43486/0 (socket says 172.21.15.5:43486) 2024-08-31T05:28:54.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:54.144+0000 7f9174a16640 1 -- 172.21.15.5:0/3657783500 learned_addr learned my addr 172.21.15.5:0/3657783500 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:28:54.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:54.144+0000 7f916ffff640 1 --2- 172.21.15.5:0/3657783500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91701050a0 0x7f917019a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:54.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:54.144+0000 7f9175217640 1 --2- 172.21.15.5:0/3657783500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f917010dbb0 0x7f917019fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:54.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:54.144+0000 7f9174a16640 1 -- 172.21.15.5:0/3657783500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f917010dbb0 msgr2=0x7f917019fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:54.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:54.144+0000 7f9174a16640 1 --2- 172.21.15.5:0/3657783500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f917010dbb0 0x7f917019fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:54.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:54.144+0000 7f9174a16640 1 -- 172.21.15.5:0/3657783500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91701050a0 msgr2=0x7f917019a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:54.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:54.144+0000 7f9174a16640 1 --2- 172.21.15.5:0/3657783500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91701050a0 0x7f917019a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:54.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:54.144+0000 7f9174a16640 1 -- 172.21.15.5:0/3657783500 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91701a0070 con 0x7f9170104750 2024-08-31T05:28:54.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:54.145+0000 7f9174a16640 1 --2- 172.21.15.5:0/3657783500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9170104750 0x7f917019a1c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f916000c970 tx=0x7f916000cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:54.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:54.145+0000 7f916dffb640 1 -- 172.21.15.5:0/3657783500 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9160007b50 con 0x7f9170104750 2024-08-31T05:28:54.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:54.145+0000 7f9176c7a640 1 -- 172.21.15.5:0/3657783500 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91701a0360 con 0x7f9170104750 2024-08-31T05:28:54.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:54.145+0000 7f916dffb640 1 -- 172.21.15.5:0/3657783500 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9160007cf0 con 0x7f9170104750 2024-08-31T05:28:54.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:54.145+0000 7f916dffb640 1 -- 172.21.15.5:0/3657783500 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f916000f6d0 con 0x7f9170104750 2024-08-31T05:28:54.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:54.145+0000 7f9176c7a640 1 -- 172.21.15.5:0/3657783500 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91701a6b80 con 0x7f9170104750 2024-08-31T05:28:54.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:54.146+0000 7f9176c7a640 1 -- 172.21.15.5:0/3657783500 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9170104b60 con 0x7f9170104750 2024-08-31T05:28:54.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:54.148+0000 7f916dffb640 1 -- 172.21.15.5:0/3657783500 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f916000f930 con 0x7f9170104750 2024-08-31T05:28:54.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:54.149+0000 7f916dffb640 1 --2- 172.21.15.5:0/3657783500 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f91580b4c40 0x7f91580b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:54.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:54.149+0000 7f916ffff640 1 --2- 172.21.15.5:0/3657783500 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f91580b4c40 0x7f91580b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:54.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:54.149+0000 7f916dffb640 1 -- 172.21.15.5:0/3657783500 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9307+0+0 (secure 0 0 0) 0x7f91600e5a10 con 0x7f9170104750 2024-08-31T05:28:54.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:54.149+0000 7f916ffff640 1 --2- 172.21.15.5:0/3657783500 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f91580b4c40 0x7f91580b7150 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f917010f790 tx=0x7f916400a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:54.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:54.153+0000 7f916dffb640 1 -- 172.21.15.5:0/3657783500 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f91600ac640 con 0x7f9170104750 2024-08-31T05:28:54.181 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:28:54.181 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:28:54.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:54.349+0000 7f9176c7a640 1 -- 172.21.15.5:0/3657783500 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f917019b2f0 con 0x7f9170104750 2024-08-31T05:28:54.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:54.349+0000 7f916dffb640 1 -- 172.21.15.5:0/3657783500 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f91600abf40 con 0x7f9170104750 2024-08-31T05:28:54.352 INFO:teuthology.orchestra.run.smithi005.stdout:38654705750 2024-08-31T05:28:54.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:54.352+0000 7f9176c7a640 1 -- 172.21.15.5:0/3657783500 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f91580b4c40 msgr2=0x7f91580b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:54.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:54.352+0000 7f9176c7a640 1 --2- 172.21.15.5:0/3657783500 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f91580b4c40 0x7f91580b7150 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f917010f790 tx=0x7f916400a2d0 comp rx=0 tx=0).stop 2024-08-31T05:28:54.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:54.352+0000 7f9176c7a640 1 -- 172.21.15.5:0/3657783500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9170104750 msgr2=0x7f917019a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:54.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:54.352+0000 7f9176c7a640 1 --2- 172.21.15.5:0/3657783500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9170104750 0x7f917019a1c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f916000c970 tx=0x7f916000cd70 comp rx=0 tx=0).stop 2024-08-31T05:28:54.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:54.352+0000 7f9176c7a640 1 -- 172.21.15.5:0/3657783500 shutdown_connections 2024-08-31T05:28:54.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:54.352+0000 7f9176c7a640 1 --2- 172.21.15.5:0/3657783500 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f91580b4c40 0x7f91580b7150 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:54.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:54.352+0000 7f9176c7a640 1 --2- 172.21.15.5:0/3657783500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f917010dbb0 0x7f917019fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:54.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:54.352+0000 7f9176c7a640 1 --2- 172.21.15.5:0/3657783500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f91701050a0 0x7f917019a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:54.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:54.352+0000 7f9176c7a640 1 --2- 172.21.15.5:0/3657783500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9170104750 0x7f917019a1c0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:54.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:54.352+0000 7f9176c7a640 1 -- 172.21.15.5:0/3657783500 >> 172.21.15.5:0/3657783500 conn(0x7f91700794d0 msgr2=0x7f91700ff2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:54.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:54.352+0000 7f9176c7a640 1 -- 172.21.15.5:0/3657783500 shutdown_connections 2024-08-31T05:28:54.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:54.352+0000 7f9176c7a640 1 -- 172.21.15.5:0/3657783500 wait complete. 2024-08-31T05:28:54.774 INFO:teuthology.orchestra.run.smithi005.stdout:206158430258 2024-08-31T05:28:54.774 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-08-31T05:28:55.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:55 smithi005 ceph-mon[18602]: pgmap v311: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-31T05:28:55.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:55 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/3657783500' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-08-31T05:28:55.404 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705748 got 38654705750 for osd.0 2024-08-31T05:28:55.404 DEBUG:teuthology.parallel:result is None 2024-08-31T05:28:55.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:55 smithi050 ceph-mon[22146]: pgmap v311: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-31T05:28:55.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:55 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/3657783500' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-08-31T05:28:55.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:55 smithi070 ceph-mon[22316]: pgmap v311: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-31T05:28:55.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:55 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/3657783500' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-08-31T05:28:56.137 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:28:56.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.156+0000 7f48bbfff640 1 -- 172.21.15.5:0/1461410917 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48bc114040 msgr2=0x7f48bc116510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:56.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.156+0000 7f48bbfff640 1 --2- 172.21.15.5:0/1461410917 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48bc114040 0x7f48bc116510 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f48b4009ca0 tx=0x7f48b402a8c0 comp rx=0 tx=0).stop 2024-08-31T05:28:56.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.159+0000 7f48bbfff640 1 -- 172.21.15.5:0/1461410917 shutdown_connections 2024-08-31T05:28:56.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.159+0000 7f48bbfff640 1 --2- 172.21.15.5:0/1461410917 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48bc114040 0x7f48bc116510 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:56.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.159+0000 7f48bbfff640 1 --2- 172.21.15.5:0/1461410917 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48bc075b70 0x7f48bc075f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:56.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.159+0000 7f48bbfff640 1 --2- 172.21.15.5:0/1461410917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48bc077120 0x7f48bc075550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:56.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.159+0000 7f48bbfff640 1 -- 172.21.15.5:0/1461410917 >> 172.21.15.5:0/1461410917 conn(0x7f48bc0ff200 msgr2=0x7f48bc101650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:56.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.160+0000 7f48bbfff640 1 -- 172.21.15.5:0/1461410917 shutdown_connections 2024-08-31T05:28:56.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.161+0000 7f48bbfff640 1 -- 172.21.15.5:0/1461410917 wait complete. 2024-08-31T05:28:56.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.162+0000 7f48bbfff640 1 Processor -- start 2024-08-31T05:28:56.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.164+0000 7f48bbfff640 1 -- start start 2024-08-31T05:28:56.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.165+0000 7f48bbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48bc075b70 0x7f48bc1a05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:56.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.165+0000 7f48bbfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48bc077120 0x7f48bc1a0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:56.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.165+0000 7f48bbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48bc114040 0x7f48bc1a5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:56.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.165+0000 7f48baffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48bc075b70 0x7f48bc1a05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:56.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.165+0000 7f48baffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48bc075b70 0x7f48bc1a05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43516/0 (socket says 172.21.15.5:43516) 2024-08-31T05:28:56.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.165+0000 7f48baffd640 1 -- 172.21.15.5:0/244029984 learned_addr learned my addr 172.21.15.5:0/244029984 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:28:56.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.166+0000 7f48ba7fc640 1 --2- 172.21.15.5:0/244029984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48bc077120 0x7f48bc1a0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:56.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.166+0000 7f48bbfff640 1 -- 172.21.15.5:0/244029984 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f48bc119cd0 con 0x7f48bc075b70 2024-08-31T05:28:56.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.166+0000 7f48bbfff640 1 -- 172.21.15.5:0/244029984 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f48bc119b50 con 0x7f48bc077120 2024-08-31T05:28:56.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.166+0000 7f48bbfff640 1 -- 172.21.15.5:0/244029984 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f48bc119e50 con 0x7f48bc114040 2024-08-31T05:28:56.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.166+0000 7f48bb7fe640 1 --2- 172.21.15.5:0/244029984 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48bc114040 0x7f48bc1a5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:56.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.167+0000 7f48baffd640 1 -- 172.21.15.5:0/244029984 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48bc114040 msgr2=0x7f48bc1a5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:56.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.167+0000 7f48baffd640 1 --2- 172.21.15.5:0/244029984 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48bc114040 0x7f48bc1a5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:56.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.167+0000 7f48baffd640 1 -- 172.21.15.5:0/244029984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48bc077120 msgr2=0x7f48bc1a0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:56.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.167+0000 7f48baffd640 1 --2- 172.21.15.5:0/244029984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48bc077120 0x7f48bc1a0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:56.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.167+0000 7f48baffd640 1 -- 172.21.15.5:0/244029984 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48bc1a6530 con 0x7f48bc075b70 2024-08-31T05:28:56.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.167+0000 7f48baffd640 1 --2- 172.21.15.5:0/244029984 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48bc075b70 0x7f48bc1a05c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f48b000e9f0 tx=0x7f48b000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:56.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.168+0000 7f48a3fff640 1 -- 172.21.15.5:0/244029984 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b000cd80 con 0x7f48bc075b70 2024-08-31T05:28:56.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.168+0000 7f48a3fff640 1 -- 172.21.15.5:0/244029984 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f48b00108e0 con 0x7f48bc075b70 2024-08-31T05:28:56.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.168+0000 7f48bbfff640 1 -- 172.21.15.5:0/244029984 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48bc1a6820 con 0x7f48bc075b70 2024-08-31T05:28:56.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.169+0000 7f48bbfff640 1 -- 172.21.15.5:0/244029984 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48bc1acf80 con 0x7f48bc075b70 2024-08-31T05:28:56.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.169+0000 7f48a3fff640 1 -- 172.21.15.5:0/244029984 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b0018860 con 0x7f48bc075b70 2024-08-31T05:28:56.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.171+0000 7f48bbfff640 1 -- 172.21.15.5:0/244029984 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48bc075f80 con 0x7f48bc075b70 2024-08-31T05:28:56.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.173+0000 7f48a3fff640 1 -- 172.21.15.5:0/244029984 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f48b0010430 con 0x7f48bc075b70 2024-08-31T05:28:56.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.174+0000 7f48a3fff640 1 --2- 172.21.15.5:0/244029984 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f48a40b4d60 0x7f48a40b7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:56.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.174+0000 7f48a3fff640 1 -- 172.21.15.5:0/244029984 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9307+0+0 (secure 0 0 0) 0x7f48b00e5970 con 0x7f48bc075b70 2024-08-31T05:28:56.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.174+0000 7f48ba7fc640 1 --2- 172.21.15.5:0/244029984 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f48a40b4d60 0x7f48a40b7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:56.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.174+0000 7f48ba7fc640 1 --2- 172.21.15.5:0/244029984 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f48a40b4d60 0x7f48a40b7270 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f48bc115d00 tx=0x7f48ac005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:56.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.178+0000 7f48a3fff640 1 -- 172.21.15.5:0/244029984 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f48b00abec0 con 0x7f48bc075b70 2024-08-31T05:28:56.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.372+0000 7f48bbfff640 1 -- 172.21.15.5:0/244029984 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f48bc1127e0 con 0x7f48bc075b70 2024-08-31T05:28:56.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.373+0000 7f48a3fff640 1 -- 172.21.15.5:0/244029984 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f48b00b0680 con 0x7f48bc075b70 2024-08-31T05:28:56.375 INFO:teuthology.orchestra.run.smithi005.stdout:304942678047 2024-08-31T05:28:56.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.376+0000 7f48bbfff640 1 -- 172.21.15.5:0/244029984 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f48a40b4d60 msgr2=0x7f48a40b7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:56.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.376+0000 7f48bbfff640 1 --2- 172.21.15.5:0/244029984 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f48a40b4d60 0x7f48a40b7270 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f48bc115d00 tx=0x7f48ac005f90 comp rx=0 tx=0).stop 2024-08-31T05:28:56.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.376+0000 7f48bbfff640 1 -- 172.21.15.5:0/244029984 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48bc075b70 msgr2=0x7f48bc1a05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:56.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.376+0000 7f48bbfff640 1 --2- 172.21.15.5:0/244029984 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48bc075b70 0x7f48bc1a05c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f48b000e9f0 tx=0x7f48b000eeb0 comp rx=0 tx=0).stop 2024-08-31T05:28:56.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.376+0000 7f48bbfff640 1 -- 172.21.15.5:0/244029984 shutdown_connections 2024-08-31T05:28:56.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.376+0000 7f48bbfff640 1 --2- 172.21.15.5:0/244029984 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f48a40b4d60 0x7f48a40b7270 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:56.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.376+0000 7f48bbfff640 1 --2- 172.21.15.5:0/244029984 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48bc114040 0x7f48bc1a5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:56.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.376+0000 7f48bbfff640 1 --2- 172.21.15.5:0/244029984 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f48bc077120 0x7f48bc1a0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:56.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.376+0000 7f48bbfff640 1 --2- 172.21.15.5:0/244029984 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48bc075b70 0x7f48bc1a05c0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:56.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.376+0000 7f48bbfff640 1 -- 172.21.15.5:0/244029984 >> 172.21.15.5:0/244029984 conn(0x7f48bc0ff200 msgr2=0x7f48bc10ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:56.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.376+0000 7f48bbfff640 1 -- 172.21.15.5:0/244029984 shutdown_connections 2024-08-31T05:28:56.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.376+0000 7f48bbfff640 1 -- 172.21.15.5:0/244029984 wait complete. 2024-08-31T05:28:56.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.348+0000 7f2a5b960640 1 -- 172.21.15.5:0/4264195218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a54108a90 msgr2=0x7f2a5410f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:56.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.348+0000 7f2a5b960640 1 --2- 172.21.15.5:0/4264195218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a54108a90 0x7f2a5410f2c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c009ca0 tx=0x7f2a4c02a8c0 comp rx=0 tx=0).stop 2024-08-31T05:28:56.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.348+0000 7f2a5b960640 1 -- 172.21.15.5:0/4264195218 shutdown_connections 2024-08-31T05:28:56.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.348+0000 7f2a5b960640 1 --2- 172.21.15.5:0/4264195218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a54108a90 0x7f2a5410f2c0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:56.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.348+0000 7f2a5b960640 1 --2- 172.21.15.5:0/4264195218 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a54108140 0x7f2a54108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:56.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.348+0000 7f2a5b960640 1 --2- 172.21.15.5:0/4264195218 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a54102800 0x7f2a54102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:56.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.348+0000 7f2a5b960640 1 -- 172.21.15.5:0/4264195218 >> 172.21.15.5:0/4264195218 conn(0x7f2a540794d0 msgr2=0x7f2a540798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:56.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.349+0000 7f2a5b960640 1 -- 172.21.15.5:0/4264195218 shutdown_connections 2024-08-31T05:28:56.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.349+0000 7f2a5b960640 1 -- 172.21.15.5:0/4264195218 wait complete. 2024-08-31T05:28:56.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.349+0000 7f2a5b960640 1 Processor -- start 2024-08-31T05:28:56.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.349+0000 7f2a5b960640 1 -- start start 2024-08-31T05:28:56.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.350+0000 7f2a5b960640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a54102800 0x7f2a54199140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:56.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.350+0000 7f2a5b960640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a54108140 0x7f2a541996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:56.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.350+0000 7f2a5b960640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a54108a90 0x7f2a5419e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:56.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.350+0000 7f2a5b960640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2a54112710 con 0x7f2a54102800 2024-08-31T05:28:56.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.350+0000 7f2a5b960640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2a54112590 con 0x7f2a54108a90 2024-08-31T05:28:56.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.350+0000 7f2a5b960640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2a54112890 con 0x7f2a54108140 2024-08-31T05:28:56.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.350+0000 7f2a596fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a54102800 0x7f2a54199140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:56.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.350+0000 7f2a596fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a54102800 0x7f2a54199140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43546/0 (socket says 172.21.15.5:43546) 2024-08-31T05:28:56.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.350+0000 7f2a596fc640 1 -- 172.21.15.5:0/2813574445 learned_addr learned my addr 172.21.15.5:0/2813574445 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:28:56.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.350+0000 7f2a58efb640 1 --2- 172.21.15.5:0/2813574445 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a54108140 0x7f2a541996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:56.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.350+0000 7f2a59efd640 1 --2- 172.21.15.5:0/2813574445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a54108a90 0x7f2a5419e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:56.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.350+0000 7f2a596fc640 1 -- 172.21.15.5:0/2813574445 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a54108140 msgr2=0x7f2a541996e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:56.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.350+0000 7f2a596fc640 1 --2- 172.21.15.5:0/2813574445 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a54108140 0x7f2a541996e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:56.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.350+0000 7f2a596fc640 1 -- 172.21.15.5:0/2813574445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a54108a90 msgr2=0x7f2a5419e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:56.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.350+0000 7f2a596fc640 1 --2- 172.21.15.5:0/2813574445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a54108a90 0x7f2a5419e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:56.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.350+0000 7f2a596fc640 1 -- 172.21.15.5:0/2813574445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a5419f0b0 con 0x7f2a54102800 2024-08-31T05:28:56.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.350+0000 7f2a58efb640 1 --2- 172.21.15.5:0/2813574445 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a54108140 0x7f2a541996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:28:56.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.350+0000 7f2a596fc640 1 --2- 172.21.15.5:0/2813574445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a54102800 0x7f2a54199140 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2a5000d950 tx=0x7f2a5000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:56.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.351+0000 7f2a4a7fc640 1 -- 172.21.15.5:0/2813574445 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a50017070 con 0x7f2a54102800 2024-08-31T05:28:56.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.351+0000 7f2a5b960640 1 -- 172.21.15.5:0/2813574445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a5419f3a0 con 0x7f2a54102800 2024-08-31T05:28:56.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.351+0000 7f2a4a7fc640 1 -- 172.21.15.5:0/2813574445 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2a50009c30 con 0x7f2a54102800 2024-08-31T05:28:56.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.351+0000 7f2a4a7fc640 1 -- 172.21.15.5:0/2813574445 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a5000f620 con 0x7f2a54102800 2024-08-31T05:28:56.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.351+0000 7f2a5b960640 1 -- 172.21.15.5:0/2813574445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a5406ac00 con 0x7f2a54102800 2024-08-31T05:28:56.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.352+0000 7f2a5b960640 1 -- 172.21.15.5:0/2813574445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a54102c10 con 0x7f2a54102800 2024-08-31T05:28:56.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.353+0000 7f2a4a7fc640 1 -- 172.21.15.5:0/2813574445 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f2a50010460 con 0x7f2a54102800 2024-08-31T05:28:56.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.354+0000 7f2a4a7fc640 1 --2- 172.21.15.5:0/2813574445 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2a400b4c10 0x7f2a400b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:56.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.354+0000 7f2a58efb640 1 --2- 172.21.15.5:0/2813574445 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2a400b4c10 0x7f2a400b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:56.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.354+0000 7f2a4a7fc640 1 -- 172.21.15.5:0/2813574445 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9307+0+0 (secure 0 0 0) 0x7f2a500e54a0 con 0x7f2a54102800 2024-08-31T05:28:56.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.355+0000 7f2a58efb640 1 --2- 172.21.15.5:0/2813574445 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2a400b4c10 0x7f2a400b7120 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2a44005fd0 tx=0x7f2a4400b5d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:56.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.362+0000 7f2a4a7fc640 1 -- 172.21.15.5:0/2813574445 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2a500abfe0 con 0x7f2a54102800 2024-08-31T05:28:56.390 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:28:56.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.559+0000 7f2a5b960640 1 -- 172.21.15.5:0/2813574445 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f2a5406b6e0 con 0x7f2a54102800 2024-08-31T05:28:56.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.559+0000 7f2a4a7fc640 1 -- 172.21.15.5:0/2813574445 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f2a50009de0 con 0x7f2a54102800 2024-08-31T05:28:56.561 INFO:teuthology.orchestra.run.smithi005.stdout:137438953539 2024-08-31T05:28:56.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.561+0000 7f2a5b960640 1 -- 172.21.15.5:0/2813574445 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2a400b4c10 msgr2=0x7f2a400b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:56.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.561+0000 7f2a5b960640 1 --2- 172.21.15.5:0/2813574445 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2a400b4c10 0x7f2a400b7120 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2a44005fd0 tx=0x7f2a4400b5d0 comp rx=0 tx=0).stop 2024-08-31T05:28:56.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.561+0000 7f2a5b960640 1 -- 172.21.15.5:0/2813574445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a54102800 msgr2=0x7f2a54199140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:56.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.561+0000 7f2a5b960640 1 --2- 172.21.15.5:0/2813574445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a54102800 0x7f2a54199140 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2a5000d950 tx=0x7f2a5000de10 comp rx=0 tx=0).stop 2024-08-31T05:28:56.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.561+0000 7f2a5b960640 1 -- 172.21.15.5:0/2813574445 shutdown_connections 2024-08-31T05:28:56.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.561+0000 7f2a5b960640 1 --2- 172.21.15.5:0/2813574445 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2a400b4c10 0x7f2a400b7120 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:56.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.561+0000 7f2a5b960640 1 --2- 172.21.15.5:0/2813574445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a54108a90 0x7f2a5419e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:56.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.561+0000 7f2a5b960640 1 --2- 172.21.15.5:0/2813574445 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a54108140 0x7f2a541996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:56.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.561+0000 7f2a5b960640 1 --2- 172.21.15.5:0/2813574445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a54102800 0x7f2a54199140 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:56.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.561+0000 7f2a5b960640 1 -- 172.21.15.5:0/2813574445 >> 172.21.15.5:0/2813574445 conn(0x7f2a540794d0 msgr2=0x7f2a54105040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:56.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.562+0000 7f2a5b960640 1 -- 172.21.15.5:0/2813574445 shutdown_connections 2024-08-31T05:28:56.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:56.562+0000 7f2a5b960640 1 -- 172.21.15.5:0/2813574445 wait complete. 2024-08-31T05:28:57.219 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:57 smithi005 ceph-mon[18602]: pgmap v312: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-08-31T05:28:57.219 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:57 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/244029984' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-08-31T05:28:57.219 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:57 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/2813574445' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-08-31T05:28:57.244 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953537 got 137438953539 for osd.4 2024-08-31T05:28:57.245 DEBUG:teuthology.parallel:result is None 2024-08-31T05:28:57.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:57 smithi050 ceph-mon[22146]: pgmap v312: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-08-31T05:28:57.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:57 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/244029984' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-08-31T05:28:57.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:57 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/2813574445' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-08-31T05:28:57.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:57 smithi070 ceph-mon[22316]: pgmap v312: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-08-31T05:28:57.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:57 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/244029984' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-08-31T05:28:57.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:57 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/2813574445' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-08-31T05:28:57.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:57.937+0000 7f7be5537640 1 -- 172.21.15.5:0/2306725445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7be0101d90 msgr2=0x7f7be01021a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:57.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:57.937+0000 7f7be5537640 1 --2- 172.21.15.5:0/2306725445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7be0101d90 0x7f7be01021a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7bd0009ca0 tx=0x7f7bd002a8c0 comp rx=0 tx=0).stop 2024-08-31T05:28:57.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:57.937+0000 7f7be5537640 1 -- 172.21.15.5:0/2306725445 shutdown_connections 2024-08-31T05:28:57.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:57.937+0000 7f7be5537640 1 --2- 172.21.15.5:0/2306725445 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7be01069c0 0x7f7be0110410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:57.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:57.937+0000 7f7be5537640 1 --2- 172.21.15.5:0/2306725445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7be0106070 0x7f7be0106480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:57.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:57.937+0000 7f7be5537640 1 --2- 172.21.15.5:0/2306725445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7be0101d90 0x7f7be01021a0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:57.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:57.937+0000 7f7be5537640 1 -- 172.21.15.5:0/2306725445 >> 172.21.15.5:0/2306725445 conn(0x7f7be0077a60 msgr2=0x7f7be0077ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:57.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:57.937+0000 7f7be5537640 1 -- 172.21.15.5:0/2306725445 shutdown_connections 2024-08-31T05:28:57.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:57.937+0000 7f7be5537640 1 -- 172.21.15.5:0/2306725445 wait complete. 2024-08-31T05:28:57.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:57.937+0000 7f7be5537640 1 Processor -- start 2024-08-31T05:28:57.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:57.938+0000 7f7be5537640 1 -- start start 2024-08-31T05:28:57.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:57.938+0000 7f7be5537640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7be0101d90 0x7f7be0102d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:57.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:57.938+0000 7f7be5537640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7be0106070 0x7f7be0103270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:57.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:57.938+0000 7f7be5537640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7be01069c0 0x7f7be01037b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:57.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:57.938+0000 7f7be5537640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7be0113860 con 0x7f7be01069c0 2024-08-31T05:28:57.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:57.938+0000 7f7be5537640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7be01136e0 con 0x7f7be0106070 2024-08-31T05:28:57.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:57.938+0000 7f7be5537640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7be01139e0 con 0x7f7be0101d90 2024-08-31T05:28:57.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:57.938+0000 7f7bdf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7be01069c0 0x7f7be01037b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:57.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:57.938+0000 7f7bdf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7be01069c0 0x7f7be01037b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43576/0 (socket says 172.21.15.5:43576) 2024-08-31T05:28:57.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:57.938+0000 7f7bdf7fe640 1 -- 172.21.15.5:0/3282757701 learned_addr learned my addr 172.21.15.5:0/3282757701 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:28:57.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:57.938+0000 7f7bdeffd640 1 --2- 172.21.15.5:0/3282757701 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7be0101d90 0x7f7be0102d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:57.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:57.938+0000 7f7bde7fc640 1 --2- 172.21.15.5:0/3282757701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7be0106070 0x7f7be0103270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:57.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:57.938+0000 7f7bdf7fe640 1 -- 172.21.15.5:0/3282757701 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7be0101d90 msgr2=0x7f7be0102d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:57.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:57.938+0000 7f7bdf7fe640 1 --2- 172.21.15.5:0/3282757701 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7be0101d90 0x7f7be0102d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:57.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:57.938+0000 7f7bdf7fe640 1 -- 172.21.15.5:0/3282757701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7be0106070 msgr2=0x7f7be0103270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:57.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:57.938+0000 7f7bdf7fe640 1 --2- 172.21.15.5:0/3282757701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7be0106070 0x7f7be0103270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:57.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:57.938+0000 7f7bdf7fe640 1 -- 172.21.15.5:0/3282757701 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7be01a84e0 con 0x7f7be01069c0 2024-08-31T05:28:57.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:57.939+0000 7f7bdf7fe640 1 --2- 172.21.15.5:0/3282757701 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7be01069c0 0x7f7be01037b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7bd800c970 tx=0x7f7bd800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:57.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:57.939+0000 7f7bc7fff640 1 -- 172.21.15.5:0/3282757701 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd8007bb0 con 0x7f7be01069c0 2024-08-31T05:28:57.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:57.939+0000 7f7be5537640 1 -- 172.21.15.5:0/3282757701 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7be01a87d0 con 0x7f7be01069c0 2024-08-31T05:28:57.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:57.939+0000 7f7bc7fff640 1 -- 172.21.15.5:0/3282757701 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7bd8007d50 con 0x7f7be01069c0 2024-08-31T05:28:57.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:57.939+0000 7f7bc7fff640 1 -- 172.21.15.5:0/3282757701 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd8018770 con 0x7f7be01069c0 2024-08-31T05:28:57.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:57.939+0000 7f7be5537640 1 -- 172.21.15.5:0/3282757701 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7be01a8cc0 con 0x7f7be01069c0 2024-08-31T05:28:57.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:57.940+0000 7f7be5537640 1 -- 172.21.15.5:0/3282757701 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7be0104030 con 0x7f7be01069c0 2024-08-31T05:28:57.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:57.942+0000 7f7bc7fff640 1 -- 172.21.15.5:0/3282757701 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f7bd800f990 con 0x7f7be01069c0 2024-08-31T05:28:57.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:57.942+0000 7f7bc7fff640 1 --2- 172.21.15.5:0/3282757701 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f7bc80b4c10 0x7f7bc80b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:57.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:57.943+0000 7f7bdeffd640 1 --2- 172.21.15.5:0/3282757701 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f7bc80b4c10 0x7f7bc80b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:57.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:57.943+0000 7f7bc7fff640 1 -- 172.21.15.5:0/3282757701 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9307+0+0 (secure 0 0 0) 0x7f7bd80e5850 con 0x7f7be01069c0 2024-08-31T05:28:57.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:57.943+0000 7f7bdeffd640 1 --2- 172.21.15.5:0/3282757701 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f7bc80b4c10 0x7f7bc80b7120 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7bd0005e30 tx=0x7f7bd0009360 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:57.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:57.945+0000 7f7bc7fff640 1 -- 172.21.15.5:0/3282757701 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7bd8014030 con 0x7f7be01069c0 2024-08-31T05:28:58.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.135+0000 7f7be5537640 1 -- 172.21.15.5:0/3282757701 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f7be010b940 con 0x7f7be01069c0 2024-08-31T05:28:58.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.135+0000 7f7bc7fff640 1 -- 172.21.15.5:0/3282757701 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f7bd80ac480 con 0x7f7be01069c0 2024-08-31T05:28:58.138 INFO:teuthology.orchestra.run.smithi005.stdout:231928234029 2024-08-31T05:28:58.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.138+0000 7f7be5537640 1 -- 172.21.15.5:0/3282757701 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f7bc80b4c10 msgr2=0x7f7bc80b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:58.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.138+0000 7f7be5537640 1 --2- 172.21.15.5:0/3282757701 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f7bc80b4c10 0x7f7bc80b7120 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7bd0005e30 tx=0x7f7bd0009360 comp rx=0 tx=0).stop 2024-08-31T05:28:58.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.138+0000 7f7be5537640 1 -- 172.21.15.5:0/3282757701 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7be01069c0 msgr2=0x7f7be01037b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:58.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.138+0000 7f7be5537640 1 --2- 172.21.15.5:0/3282757701 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7be01069c0 0x7f7be01037b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7bd800c970 tx=0x7f7bd800ce30 comp rx=0 tx=0).stop 2024-08-31T05:28:58.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.138+0000 7f7be5537640 1 -- 172.21.15.5:0/3282757701 shutdown_connections 2024-08-31T05:28:58.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.138+0000 7f7be5537640 1 --2- 172.21.15.5:0/3282757701 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f7bc80b4c10 0x7f7bc80b7120 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:58.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.138+0000 7f7be5537640 1 --2- 172.21.15.5:0/3282757701 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7be01069c0 0x7f7be01037b0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:58.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.138+0000 7f7be5537640 1 --2- 172.21.15.5:0/3282757701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7be0106070 0x7f7be0103270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:58.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.138+0000 7f7be5537640 1 --2- 172.21.15.5:0/3282757701 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7be0101d90 0x7f7be0102d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:58.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.138+0000 7f7be5537640 1 -- 172.21.15.5:0/3282757701 >> 172.21.15.5:0/3282757701 conn(0x7f7be0077a60 msgr2=0x7f7be0107430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:58.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.138+0000 7f7be5537640 1 -- 172.21.15.5:0/3282757701 shutdown_connections 2024-08-31T05:28:58.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.138+0000 7f7be5537640 1 -- 172.21.15.5:0/3282757701 wait complete. 2024-08-31T05:28:58.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.205+0000 7f64691d0640 1 -- 172.21.15.5:0/3187616349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6464075b70 msgr2=0x7f6464075f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:58.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.205+0000 7f64691d0640 1 --2- 172.21.15.5:0/3187616349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6464075b70 0x7f6464075f80 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6458009900 tx=0x7f645802a3f0 comp rx=0 tx=0).stop 2024-08-31T05:28:58.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.205+0000 7f64691d0640 1 -- 172.21.15.5:0/3187616349 shutdown_connections 2024-08-31T05:28:58.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.205+0000 7f64691d0640 1 --2- 172.21.15.5:0/3187616349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6464114200 0x7f64641166d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:58.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.205+0000 7f64691d0640 1 --2- 172.21.15.5:0/3187616349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6464075b70 0x7f6464075f80 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:58.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.205+0000 7f64691d0640 1 --2- 172.21.15.5:0/3187616349 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6464077120 0x7f6464075550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:58.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.205+0000 7f64691d0640 1 -- 172.21.15.5:0/3187616349 >> 172.21.15.5:0/3187616349 conn(0x7f64640ff380 msgr2=0x7f64641017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:58.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.205+0000 7f64691d0640 1 -- 172.21.15.5:0/3187616349 shutdown_connections 2024-08-31T05:28:58.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.205+0000 7f64691d0640 1 -- 172.21.15.5:0/3187616349 wait complete. 2024-08-31T05:28:58.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.206+0000 7f64691d0640 1 Processor -- start 2024-08-31T05:28:58.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.206+0000 7f64691d0640 1 -- start start 2024-08-31T05:28:58.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.207+0000 7f64691d0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6464075b70 0x7f64641a07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:58.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.207+0000 7f64691d0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6464077120 0x7f64641a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:58.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.207+0000 7f64691d0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6464114200 0x7f64641a6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:58.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.207+0000 7f64691d0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6464119e00 con 0x7f6464075b70 2024-08-31T05:28:58.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.207+0000 7f64691d0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6464119c80 con 0x7f6464077120 2024-08-31T05:28:58.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.207+0000 7f64691d0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6464119f80 con 0x7f6464114200 2024-08-31T05:28:58.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.207+0000 7f6462d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6464075b70 0x7f64641a07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:58.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.207+0000 7f6462d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6464075b70 0x7f64641a07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43596/0 (socket says 172.21.15.5:43596) 2024-08-31T05:28:58.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.207+0000 7f6462d9d640 1 -- 172.21.15.5:0/2847897139 learned_addr learned my addr 172.21.15.5:0/2847897139 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:28:58.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.207+0000 7f646359e640 1 --2- 172.21.15.5:0/2847897139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6464114200 0x7f64641a6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:58.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.207+0000 7f646259c640 1 --2- 172.21.15.5:0/2847897139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6464077120 0x7f64641a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:58.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.207+0000 7f6462d9d640 1 -- 172.21.15.5:0/2847897139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6464114200 msgr2=0x7f64641a6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:58.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.207+0000 7f6462d9d640 1 --2- 172.21.15.5:0/2847897139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6464114200 0x7f64641a6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:58.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.207+0000 7f6462d9d640 1 -- 172.21.15.5:0/2847897139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6464077120 msgr2=0x7f64641a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:58.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.207+0000 7f6462d9d640 1 --2- 172.21.15.5:0/2847897139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6464077120 0x7f64641a0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:58.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.207+0000 7f6462d9d640 1 -- 172.21.15.5:0/2847897139 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64641a66a0 con 0x7f6464075b70 2024-08-31T05:28:58.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.208+0000 7f6462d9d640 1 --2- 172.21.15.5:0/2847897139 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6464075b70 0x7f64641a07f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f645400e9f0 tx=0x7f645400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:58.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.208+0000 7f644bfff640 1 -- 172.21.15.5:0/2847897139 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f645400cd80 con 0x7f6464075b70 2024-08-31T05:28:58.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.208+0000 7f644bfff640 1 -- 172.21.15.5:0/2847897139 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64540108e0 con 0x7f6464075b70 2024-08-31T05:28:58.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.208+0000 7f64691d0640 1 -- 172.21.15.5:0/2847897139 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64641a6990 con 0x7f6464075b70 2024-08-31T05:28:58.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.208+0000 7f644bfff640 1 -- 172.21.15.5:0/2847897139 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6454018980 con 0x7f6464075b70 2024-08-31T05:28:58.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.208+0000 7f64691d0640 1 -- 172.21.15.5:0/2847897139 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64641ad1b0 con 0x7f6464075b70 2024-08-31T05:28:58.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.209+0000 7f64691d0640 1 -- 172.21.15.5:0/2847897139 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6464075f80 con 0x7f6464075b70 2024-08-31T05:28:58.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.211+0000 7f644bfff640 1 -- 172.21.15.5:0/2847897139 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f6454010430 con 0x7f6464075b70 2024-08-31T05:28:58.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.212+0000 7f644bfff640 1 --2- 172.21.15.5:0/2847897139 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f644c0b4cc0 0x7f644c0b71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:28:58.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.212+0000 7f646259c640 1 --2- 172.21.15.5:0/2847897139 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f644c0b4cc0 0x7f644c0b71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:28:58.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.212+0000 7f644bfff640 1 -- 172.21.15.5:0/2847897139 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9423+0+0 (secure 0 0 0) 0x7f64540e5ef0 con 0x7f6464075b70 2024-08-31T05:28:58.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.212+0000 7f646259c640 1 --2- 172.21.15.5:0/2847897139 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f644c0b4cc0 0x7f644c0b71d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6458000c00 tx=0x7f6458031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:28:58.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.215+0000 7f644bfff640 1 -- 172.21.15.5:0/2847897139 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f64540ac3d0 con 0x7f6464075b70 2024-08-31T05:28:58.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.404+0000 7f64691d0640 1 -- 172.21.15.5:0/2847897139 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f6464112f90 con 0x7f6464075b70 2024-08-31T05:28:58.407 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:58 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]} : dispatch 2024-08-31T05:28:58.407 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:58 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]} : dispatch 2024-08-31T05:28:58.407 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:58 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.16", "id": [9, 8]} : dispatch 2024-08-31T05:28:58.407 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:58 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [5, 10]} : dispatch 2024-08-31T05:28:58.407 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:58 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/3282757701' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-08-31T05:28:58.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.404+0000 7f644bfff640 1 -- 172.21.15.5:0/2847897139 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f64540b0b90 con 0x7f6464075b70 2024-08-31T05:28:58.407 INFO:teuthology.orchestra.run.smithi005.stdout:184683593784 2024-08-31T05:28:58.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.407+0000 7f64691d0640 1 -- 172.21.15.5:0/2847897139 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f644c0b4cc0 msgr2=0x7f644c0b71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:58.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.407+0000 7f64691d0640 1 --2- 172.21.15.5:0/2847897139 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f644c0b4cc0 0x7f644c0b71d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6458000c00 tx=0x7f6458031400 comp rx=0 tx=0).stop 2024-08-31T05:28:58.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.407+0000 7f64691d0640 1 -- 172.21.15.5:0/2847897139 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6464075b70 msgr2=0x7f64641a07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:28:58.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.407+0000 7f64691d0640 1 --2- 172.21.15.5:0/2847897139 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6464075b70 0x7f64641a07f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f645400e9f0 tx=0x7f645400eeb0 comp rx=0 tx=0).stop 2024-08-31T05:28:58.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.407+0000 7f64691d0640 1 -- 172.21.15.5:0/2847897139 shutdown_connections 2024-08-31T05:28:58.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.407+0000 7f64691d0640 1 --2- 172.21.15.5:0/2847897139 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f644c0b4cc0 0x7f644c0b71d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:58.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.407+0000 7f64691d0640 1 --2- 172.21.15.5:0/2847897139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6464114200 0x7f64641a6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:58.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.407+0000 7f64691d0640 1 --2- 172.21.15.5:0/2847897139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6464077120 0x7f64641a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:58.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.407+0000 7f64691d0640 1 --2- 172.21.15.5:0/2847897139 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6464075b70 0x7f64641a07f0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:28:58.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.407+0000 7f64691d0640 1 -- 172.21.15.5:0/2847897139 >> 172.21.15.5:0/2847897139 conn(0x7f64640ff380 msgr2=0x7f6464110100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:28:58.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.407+0000 7f64691d0640 1 -- 172.21.15.5:0/2847897139 shutdown_connections 2024-08-31T05:28:58.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:28:58.407+0000 7f64691d0640 1 -- 172.21.15.5:0/2847897139 wait complete. 2024-08-31T05:28:58.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:58 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]} : dispatch 2024-08-31T05:28:58.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:58 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]} : dispatch 2024-08-31T05:28:58.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:58 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.16", "id": [9, 8]} : dispatch 2024-08-31T05:28:58.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:58 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [5, 10]} : dispatch 2024-08-31T05:28:58.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:58 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/3282757701' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-08-31T05:28:58.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:58 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]} : dispatch 2024-08-31T05:28:58.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:58 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]} : dispatch 2024-08-31T05:28:58.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:58 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.16", "id": [9, 8]} : dispatch 2024-08-31T05:28:58.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:58 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [5, 10]} : dispatch 2024-08-31T05:28:58.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:58 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/3282757701' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-08-31T05:28:58.910 INFO:tasks.cephadm.ceph_manager.ceph:need seq 231928234027 got 231928234029 for osd.8 2024-08-31T05:28:58.910 DEBUG:teuthology.parallel:result is None 2024-08-31T05:28:59.377 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:28:59.389 INFO:tasks.cephadm.ceph_manager.ceph:need seq 304942678044 got 304942678047 for osd.11 2024-08-31T05:28:59.390 DEBUG:teuthology.parallel:result is None 2024-08-31T05:28:59.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:59 smithi005 ceph-mon[18602]: pgmap v313: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-08-31T05:28:59.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:59 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-08-31T05:28:59.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:59 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]': finished 2024-08-31T05:28:59.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:59 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.16", "id": [9, 8]}]': finished 2024-08-31T05:28:59.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:59 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [5, 10]}]': finished 2024-08-31T05:28:59.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:59 smithi005 ceph-mon[18602]: osdmap e86: 12 total, 12 up, 12 in 2024-08-31T05:28:59.468 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:28:59 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/2847897139' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-08-31T05:28:59.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:59 smithi070 ceph-mon[22316]: pgmap v313: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-08-31T05:28:59.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:59 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-08-31T05:28:59.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:59 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]': finished 2024-08-31T05:28:59.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:59 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.16", "id": [9, 8]}]': finished 2024-08-31T05:28:59.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:59 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [5, 10]}]': finished 2024-08-31T05:28:59.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:59 smithi070 ceph-mon[22316]: osdmap e86: 12 total, 12 up, 12 in 2024-08-31T05:28:59.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:28:59 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/2847897139' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-08-31T05:28:59.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:59 smithi050 ceph-mon[22146]: pgmap v313: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-08-31T05:28:59.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:59 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-08-31T05:28:59.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:59 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]': finished 2024-08-31T05:28:59.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:59 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.16", "id": [9, 8]}]': finished 2024-08-31T05:28:59.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:59 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [5, 10]}]': finished 2024-08-31T05:28:59.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:59 smithi050 ceph-mon[22146]: osdmap e86: 12 total, 12 up, 12 in 2024-08-31T05:28:59.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:28:59 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/2847897139' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-08-31T05:29:00.057 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:29:00.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:00 smithi005 ceph-mon[18602]: osdmap e87: 12 total, 12 up, 12 in 2024-08-31T05:29:00.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:00 smithi070 ceph-mon[22316]: osdmap e87: 12 total, 12 up, 12 in 2024-08-31T05:29:00.594 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:29:00.595 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:29:00.627 INFO:tasks.cephadm.ceph_manager.ceph:need seq 184683593782 got 184683593784 for osd.6 2024-08-31T05:29:00.627 DEBUG:teuthology.parallel:result is None 2024-08-31T05:29:00.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:00 smithi050 ceph-mon[22146]: osdmap e87: 12 total, 12 up, 12 in 2024-08-31T05:29:00.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:00.821+0000 7f7c2bd7c640 1 -- 172.21.15.5:0/211347053 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c24108ab0 msgr2=0x7f7c2410f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:00.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:00.821+0000 7f7c2bd7c640 1 --2- 172.21.15.5:0/211347053 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c24108ab0 0x7f7c2410f2e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c009ca0 tx=0x7f7c1c02a8c0 comp rx=0 tx=0).stop 2024-08-31T05:29:00.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:00.821+0000 7f7c2bd7c640 1 -- 172.21.15.5:0/211347053 shutdown_connections 2024-08-31T05:29:00.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:00.821+0000 7f7c2bd7c640 1 --2- 172.21.15.5:0/211347053 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c24108ab0 0x7f7c2410f2e0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:00.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:00.821+0000 7f7c2bd7c640 1 --2- 172.21.15.5:0/211347053 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c24108160 0x7f7c24108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:00.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:00.821+0000 7f7c2bd7c640 1 --2- 172.21.15.5:0/211347053 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c24102820 0x7f7c24102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:00.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:00.821+0000 7f7c2bd7c640 1 -- 172.21.15.5:0/211347053 >> 172.21.15.5:0/211347053 conn(0x7f7c240794e0 msgr2=0x7f7c240798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:00.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:00.822+0000 7f7c2bd7c640 1 -- 172.21.15.5:0/211347053 shutdown_connections 2024-08-31T05:29:00.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:00.822+0000 7f7c2bd7c640 1 -- 172.21.15.5:0/211347053 wait complete. 2024-08-31T05:29:00.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:00.822+0000 7f7c2bd7c640 1 Processor -- start 2024-08-31T05:29:00.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:00.822+0000 7f7c2bd7c640 1 -- start start 2024-08-31T05:29:00.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:00.822+0000 7f7c2bd7c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c24102820 0x7f7c2419b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:00.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:00.822+0000 7f7c2bd7c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c24108160 0x7f7c2419b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:00.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:00.822+0000 7f7c2bd7c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c24108ab0 0x7f7c2419baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:00.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:00.822+0000 7f7c2bd7c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7c24112730 con 0x7f7c24108ab0 2024-08-31T05:29:00.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:00.822+0000 7f7c2bd7c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7c241125b0 con 0x7f7c24108160 2024-08-31T05:29:00.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:00.822+0000 7f7c2bd7c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7c241128b0 con 0x7f7c24102820 2024-08-31T05:29:00.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:00.823+0000 7f7c2a319640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c24108ab0 0x7f7c2419baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:00.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:00.823+0000 7f7c2a319640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c24108ab0 0x7f7c2419baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43620/0 (socket says 172.21.15.5:43620) 2024-08-31T05:29:00.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:00.823+0000 7f7c2a319640 1 -- 172.21.15.5:0/62805479 learned_addr learned my addr 172.21.15.5:0/62805479 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:00.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:00.823+0000 7f7c29317640 1 --2- 172.21.15.5:0/62805479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c24108160 0x7f7c2419b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:00.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:00.823+0000 7f7c29b18640 1 --2- 172.21.15.5:0/62805479 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c24102820 0x7f7c2419b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:00.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:00.823+0000 7f7c2a319640 1 -- 172.21.15.5:0/62805479 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c24102820 msgr2=0x7f7c2419b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:00.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:00.823+0000 7f7c2a319640 1 --2- 172.21.15.5:0/62805479 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c24102820 0x7f7c2419b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:00.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:00.823+0000 7f7c2a319640 1 -- 172.21.15.5:0/62805479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c24108160 msgr2=0x7f7c2419b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:00.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:00.823+0000 7f7c2a319640 1 --2- 172.21.15.5:0/62805479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c24108160 0x7f7c2419b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:00.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:00.823+0000 7f7c2a319640 1 -- 172.21.15.5:0/62805479 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c241a62b0 con 0x7f7c24108ab0 2024-08-31T05:29:00.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:00.823+0000 7f7c2a319640 1 --2- 172.21.15.5:0/62805479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c24108ab0 0x7f7c2419baa0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c0098d0 tx=0x7f7c1c0317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:00.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:00.823+0000 7f7c1affd640 1 -- 172.21.15.5:0/62805479 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c003b70 con 0x7f7c24108ab0 2024-08-31T05:29:00.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:00.823+0000 7f7c1affd640 1 -- 172.21.15.5:0/62805479 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c1c003d10 con 0x7f7c24108ab0 2024-08-31T05:29:00.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:00.823+0000 7f7c2bd7c640 1 -- 172.21.15.5:0/62805479 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c241a6540 con 0x7f7c24108ab0 2024-08-31T05:29:00.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:00.823+0000 7f7c1affd640 1 -- 172.21.15.5:0/62805479 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c02fa20 con 0x7f7c24108ab0 2024-08-31T05:29:00.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:00.823+0000 7f7c2bd7c640 1 -- 172.21.15.5:0/62805479 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c241a6a80 con 0x7f7c24108ab0 2024-08-31T05:29:00.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:00.824+0000 7f7c2bd7c640 1 -- 172.21.15.5:0/62805479 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c24103aa0 con 0x7f7c24108ab0 2024-08-31T05:29:00.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:00.826+0000 7f7c1affd640 1 -- 172.21.15.5:0/62805479 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f7c1c02fbc0 con 0x7f7c24108ab0 2024-08-31T05:29:00.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:00.827+0000 7f7c1affd640 1 --2- 172.21.15.5:0/62805479 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f7c100b4c40 0x7f7c100b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:00.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:00.827+0000 7f7c29b18640 1 --2- 172.21.15.5:0/62805479 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f7c100b4c40 0x7f7c100b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:00.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:00.827+0000 7f7c1affd640 1 -- 172.21.15.5:0/62805479 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f7c1c106bf0 con 0x7f7c24108ab0 2024-08-31T05:29:00.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:00.827+0000 7f7c29b18640 1 --2- 172.21.15.5:0/62805479 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f7c100b4c40 0x7f7c100b7150 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7c2406c440 tx=0x7f7c2000b410 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:00.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:00.831+0000 7f7c1affd640 1 -- 172.21.15.5:0/62805479 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7c1c0cd6c0 con 0x7f7c24108ab0 2024-08-31T05:29:00.836 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:29:00.837 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:29:01.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.026+0000 7f7c2bd7c640 1 -- 172.21.15.5:0/62805479 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f7c24102c30 con 0x7f7c24108ab0 2024-08-31T05:29:01.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.026+0000 7f7c1affd640 1 -- 172.21.15.5:0/62805479 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f7c1c0ccfc0 con 0x7f7c24108ab0 2024-08-31T05:29:01.028 INFO:teuthology.orchestra.run.smithi005.stdout:111669149769 2024-08-31T05:29:01.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.028+0000 7f7c2bd7c640 1 -- 172.21.15.5:0/62805479 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f7c100b4c40 msgr2=0x7f7c100b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:01.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.028+0000 7f7c2bd7c640 1 --2- 172.21.15.5:0/62805479 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f7c100b4c40 0x7f7c100b7150 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7c2406c440 tx=0x7f7c2000b410 comp rx=0 tx=0).stop 2024-08-31T05:29:01.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.028+0000 7f7c2bd7c640 1 -- 172.21.15.5:0/62805479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c24108ab0 msgr2=0x7f7c2419baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:01.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.028+0000 7f7c2bd7c640 1 --2- 172.21.15.5:0/62805479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c24108ab0 0x7f7c2419baa0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c0098d0 tx=0x7f7c1c0317b0 comp rx=0 tx=0).stop 2024-08-31T05:29:01.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.028+0000 7f7c2bd7c640 1 -- 172.21.15.5:0/62805479 shutdown_connections 2024-08-31T05:29:01.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.028+0000 7f7c2bd7c640 1 --2- 172.21.15.5:0/62805479 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f7c100b4c40 0x7f7c100b7150 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:01.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.028+0000 7f7c2bd7c640 1 --2- 172.21.15.5:0/62805479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c24108ab0 0x7f7c2419baa0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:01.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.028+0000 7f7c2bd7c640 1 --2- 172.21.15.5:0/62805479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c24108160 0x7f7c2419b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:01.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.028+0000 7f7c2bd7c640 1 --2- 172.21.15.5:0/62805479 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c24102820 0x7f7c2419b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:01.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.028+0000 7f7c2bd7c640 1 -- 172.21.15.5:0/62805479 >> 172.21.15.5:0/62805479 conn(0x7f7c240794e0 msgr2=0x7f7c24105000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:01.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.029+0000 7f7c2bd7c640 1 -- 172.21.15.5:0/62805479 shutdown_connections 2024-08-31T05:29:01.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.029+0000 7f7c2bd7c640 1 -- 172.21.15.5:0/62805479 wait complete. 2024-08-31T05:29:01.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:01 smithi005 ceph-mon[18602]: pgmap v316: 129 pgs: 3 peering, 126 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-08-31T05:29:01.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:01 smithi005 ceph-mon[18602]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-08-31T05:29:01.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:01 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/62805479' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-08-31T05:29:01.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.509+0000 7f940efe4640 1 -- 172.21.15.5:0/2176237819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9408108a90 msgr2=0x7f940810f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:01.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.509+0000 7f940efe4640 1 --2- 172.21.15.5:0/2176237819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9408108a90 0x7f940810f2c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9400009900 tx=0x7f940002a410 comp rx=0 tx=0).stop 2024-08-31T05:29:01.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.509+0000 7f940efe4640 1 -- 172.21.15.5:0/2176237819 shutdown_connections 2024-08-31T05:29:01.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.509+0000 7f940efe4640 1 --2- 172.21.15.5:0/2176237819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9408108a90 0x7f940810f2c0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:01.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.509+0000 7f940efe4640 1 --2- 172.21.15.5:0/2176237819 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9408108140 0x7f9408108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:01.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.509+0000 7f940efe4640 1 --2- 172.21.15.5:0/2176237819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9408102800 0x7f9408102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:01.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.509+0000 7f940efe4640 1 -- 172.21.15.5:0/2176237819 >> 172.21.15.5:0/2176237819 conn(0x7f94080794d0 msgr2=0x7f94080798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:01.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.509+0000 7f940efe4640 1 -- 172.21.15.5:0/2176237819 shutdown_connections 2024-08-31T05:29:01.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.509+0000 7f940efe4640 1 -- 172.21.15.5:0/2176237819 wait complete. 2024-08-31T05:29:01.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.510+0000 7f940efe4640 1 Processor -- start 2024-08-31T05:29:01.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.510+0000 7f940efe4640 1 -- start start 2024-08-31T05:29:01.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.510+0000 7f940efe4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9408102800 0x7f9408199190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:01.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.510+0000 7f940efe4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9408108140 0x7f9408199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:01.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.510+0000 7f940efe4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9408108a90 0x7f940819e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:01.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.510+0000 7f940efe4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9408112760 con 0x7f9408108140 2024-08-31T05:29:01.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.510+0000 7f940efe4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f94081125e0 con 0x7f9408108a90 2024-08-31T05:29:01.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.510+0000 7f940efe4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f94081128e0 con 0x7f9408102800 2024-08-31T05:29:01.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.510+0000 7f9407fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9408108140 0x7f9408199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:01.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.510+0000 7f9407fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9408108140 0x7f9408199730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43652/0 (socket says 172.21.15.5:43652) 2024-08-31T05:29:01.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.510+0000 7f9407fff640 1 -- 172.21.15.5:0/2430297454 learned_addr learned my addr 172.21.15.5:0/2430297454 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:01.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.510+0000 7f940d581640 1 --2- 172.21.15.5:0/2430297454 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9408108a90 0x7f940819e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:01.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.510+0000 7f940cd80640 1 --2- 172.21.15.5:0/2430297454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9408102800 0x7f9408199190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:01.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.511+0000 7f9407fff640 1 -- 172.21.15.5:0/2430297454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9408102800 msgr2=0x7f9408199190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:01.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.511+0000 7f9407fff640 1 --2- 172.21.15.5:0/2430297454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9408102800 0x7f9408199190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:01.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.511+0000 7f9407fff640 1 -- 172.21.15.5:0/2430297454 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9408108a90 msgr2=0x7f940819e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:01.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.511+0000 7f9407fff640 1 --2- 172.21.15.5:0/2430297454 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9408108a90 0x7f940819e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:01.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.511+0000 7f9407fff640 1 -- 172.21.15.5:0/2430297454 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f940819f100 con 0x7f9408108140 2024-08-31T05:29:01.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.511+0000 7f940d581640 1 --2- 172.21.15.5:0/2430297454 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9408108a90 0x7f940819e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:29:01.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.511+0000 7f9407fff640 1 --2- 172.21.15.5:0/2430297454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9408108140 0x7f9408199730 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f93f000b450 tx=0x7f93f000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:01.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.511+0000 7f9405ffb640 1 -- 172.21.15.5:0/2430297454 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f0015020 con 0x7f9408108140 2024-08-31T05:29:01.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.511+0000 7f9405ffb640 1 -- 172.21.15.5:0/2430297454 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93f0011d40 con 0x7f9408108140 2024-08-31T05:29:01.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.511+0000 7f9405ffb640 1 -- 172.21.15.5:0/2430297454 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f000f340 con 0x7f9408108140 2024-08-31T05:29:01.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.511+0000 7f940efe4640 1 -- 172.21.15.5:0/2430297454 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f940819f3f0 con 0x7f9408108140 2024-08-31T05:29:01.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.511+0000 7f940efe4640 1 -- 172.21.15.5:0/2430297454 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94081a5b50 con 0x7f9408108140 2024-08-31T05:29:01.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.512+0000 7f940efe4640 1 -- 172.21.15.5:0/2430297454 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9408102c10 con 0x7f9408108140 2024-08-31T05:29:01.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.514+0000 7f9405ffb640 1 -- 172.21.15.5:0/2430297454 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f93f0018020 con 0x7f9408108140 2024-08-31T05:29:01.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.514+0000 7f9405ffb640 1 --2- 172.21.15.5:0/2430297454 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f93f40b4c10 0x7f93f40b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:01.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.515+0000 7f940cd80640 1 --2- 172.21.15.5:0/2430297454 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f93f40b4c10 0x7f93f40b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:01.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.515+0000 7f9405ffb640 1 -- 172.21.15.5:0/2430297454 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f93f00e57b0 con 0x7f9408108140 2024-08-31T05:29:01.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.515+0000 7f940cd80640 1 --2- 172.21.15.5:0/2430297454 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f93f40b4c10 0x7f93f40b7120 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f93f8005fd0 tx=0x7f93f8009870 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:01.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.518+0000 7f9405ffb640 1 -- 172.21.15.5:0/2430297454 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f93f001f020 con 0x7f9408108140 2024-08-31T05:29:01.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:01 smithi070 ceph-mon[22316]: pgmap v316: 129 pgs: 3 peering, 126 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-08-31T05:29:01.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:01 smithi070 ceph-mon[22316]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-08-31T05:29:01.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:01 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/62805479' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-08-31T05:29:01.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:01 smithi050 ceph-mon[22146]: pgmap v316: 129 pgs: 3 peering, 126 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-08-31T05:29:01.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:01 smithi050 ceph-mon[22146]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-08-31T05:29:01.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:01 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/62805479' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-08-31T05:29:01.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.705+0000 7f940efe4640 1 -- 172.21.15.5:0/2430297454 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f940819a2c0 con 0x7f9408108140 2024-08-31T05:29:01.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.705+0000 7f9405ffb640 1 -- 172.21.15.5:0/2430297454 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f940819a2c0 con 0x7f9408108140 2024-08-31T05:29:01.707 INFO:teuthology.orchestra.run.smithi005.stdout:158913790015 2024-08-31T05:29:01.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.707+0000 7f940efe4640 1 -- 172.21.15.5:0/2430297454 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f93f40b4c10 msgr2=0x7f93f40b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:01.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.707+0000 7f940efe4640 1 --2- 172.21.15.5:0/2430297454 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f93f40b4c10 0x7f93f40b7120 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f93f8005fd0 tx=0x7f93f8009870 comp rx=0 tx=0).stop 2024-08-31T05:29:01.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.707+0000 7f940efe4640 1 -- 172.21.15.5:0/2430297454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9408108140 msgr2=0x7f9408199730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:01.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.707+0000 7f940efe4640 1 --2- 172.21.15.5:0/2430297454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9408108140 0x7f9408199730 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f93f000b450 tx=0x7f93f000b910 comp rx=0 tx=0).stop 2024-08-31T05:29:01.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.707+0000 7f940efe4640 1 -- 172.21.15.5:0/2430297454 shutdown_connections 2024-08-31T05:29:01.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.707+0000 7f940efe4640 1 --2- 172.21.15.5:0/2430297454 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f93f40b4c10 0x7f93f40b7120 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:01.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.707+0000 7f940efe4640 1 --2- 172.21.15.5:0/2430297454 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9408108a90 0x7f940819e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:01.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.707+0000 7f940efe4640 1 --2- 172.21.15.5:0/2430297454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9408108140 0x7f9408199730 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:01.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.707+0000 7f940efe4640 1 --2- 172.21.15.5:0/2430297454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9408102800 0x7f9408199190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:01.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.707+0000 7f940efe4640 1 -- 172.21.15.5:0/2430297454 >> 172.21.15.5:0/2430297454 conn(0x7f94080794d0 msgr2=0x7f9408105040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:01.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.708+0000 7f940efe4640 1 -- 172.21.15.5:0/2430297454 shutdown_connections 2024-08-31T05:29:01.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:01.708+0000 7f940efe4640 1 -- 172.21.15.5:0/2430297454 wait complete. 2024-08-31T05:29:02.381 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:02 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/2430297454' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-08-31T05:29:02.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:02 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/2430297454' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-08-31T05:29:02.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:02 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/2430297454' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-08-31T05:29:02.912 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149767 got 111669149769 for osd.3 2024-08-31T05:29:02.913 DEBUG:teuthology.parallel:result is None 2024-08-31T05:29:02.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:02.977+0000 7f4f502db640 1 -- 172.21.15.5:0/1302509953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f48104f60 msgr2=0x7f4f48105370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:02.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:02.977+0000 7f4f502db640 1 --2- 172.21.15.5:0/1302509953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f48104f60 0x7f4f48105370 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4f38009900 tx=0x7f4f3802a410 comp rx=0 tx=0).stop 2024-08-31T05:29:02.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:02.977+0000 7f4f502db640 1 -- 172.21.15.5:0/1302509953 shutdown_connections 2024-08-31T05:29:02.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:02.977+0000 7f4f502db640 1 --2- 172.21.15.5:0/1302509953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f481058b0 0x7f4f4810f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:02.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:02.977+0000 7f4f502db640 1 --2- 172.21.15.5:0/1302509953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f48104f60 0x7f4f48105370 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:02.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:02.977+0000 7f4f502db640 1 --2- 172.21.15.5:0/1302509953 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f48102f50 0x7f4f48103360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:02.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:02.977+0000 7f4f502db640 1 -- 172.21.15.5:0/1302509953 >> 172.21.15.5:0/1302509953 conn(0x7f4f48079d30 msgr2=0x7f4f4807a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:02.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:02.977+0000 7f4f502db640 1 -- 172.21.15.5:0/1302509953 shutdown_connections 2024-08-31T05:29:02.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:02.977+0000 7f4f502db640 1 -- 172.21.15.5:0/1302509953 wait complete. 2024-08-31T05:29:02.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:02.978+0000 7f4f502db640 1 Processor -- start 2024-08-31T05:29:02.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:02.978+0000 7f4f502db640 1 -- start start 2024-08-31T05:29:02.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:02.978+0000 7f4f502db640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f48102f50 0x7f4f4819a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:02.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:02.978+0000 7f4f502db640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f48104f60 0x7f4f4819a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:02.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:02.978+0000 7f4f502db640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f481058b0 0x7f4f4819fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:02.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:02.978+0000 7f4f502db640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4f48112780 con 0x7f4f48104f60 2024-08-31T05:29:02.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:02.978+0000 7f4f502db640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4f48112600 con 0x7f4f48102f50 2024-08-31T05:29:02.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:02.978+0000 7f4f502db640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4f48112900 con 0x7f4f481058b0 2024-08-31T05:29:02.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:02.978+0000 7f4f4d876640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f48104f60 0x7f4f4819a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:02.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:02.978+0000 7f4f4d876640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f48104f60 0x7f4f4819a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35412/0 (socket says 172.21.15.5:35412) 2024-08-31T05:29:02.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:02.978+0000 7f4f4d876640 1 -- 172.21.15.5:0/2025500714 learned_addr learned my addr 172.21.15.5:0/2025500714 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:02.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:02.978+0000 7f4f4e077640 1 --2- 172.21.15.5:0/2025500714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f48102f50 0x7f4f4819a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:02.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:02.978+0000 7f4f4e878640 1 --2- 172.21.15.5:0/2025500714 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f481058b0 0x7f4f4819fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:02.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:02.978+0000 7f4f4d876640 1 -- 172.21.15.5:0/2025500714 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f481058b0 msgr2=0x7f4f4819fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:02.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:02.979+0000 7f4f4d876640 1 --2- 172.21.15.5:0/2025500714 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f481058b0 0x7f4f4819fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:02.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:02.979+0000 7f4f4d876640 1 -- 172.21.15.5:0/2025500714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f48102f50 msgr2=0x7f4f4819a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:02.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:02.979+0000 7f4f4d876640 1 --2- 172.21.15.5:0/2025500714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f48102f50 0x7f4f4819a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:02.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:02.979+0000 7f4f4d876640 1 -- 172.21.15.5:0/2025500714 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f481a02b0 con 0x7f4f48104f60 2024-08-31T05:29:02.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:02.979+0000 7f4f4e878640 1 --2- 172.21.15.5:0/2025500714 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f481058b0 0x7f4f4819fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:29:02.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:02.979+0000 7f4f4d876640 1 --2- 172.21.15.5:0/2025500714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f48104f60 0x7f4f4819a8e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4f3802a930 tx=0x7f4f38004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:02.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:02.979+0000 7f4f3f7fe640 1 -- 172.21.15.5:0/2025500714 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f3803f030 con 0x7f4f48104f60 2024-08-31T05:29:02.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:02.979+0000 7f4f3f7fe640 1 -- 172.21.15.5:0/2025500714 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f38003aa0 con 0x7f4f48104f60 2024-08-31T05:29:02.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:02.979+0000 7f4f502db640 1 -- 172.21.15.5:0/2025500714 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f481a0540 con 0x7f4f48104f60 2024-08-31T05:29:02.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:02.979+0000 7f4f3f7fe640 1 -- 172.21.15.5:0/2025500714 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f38035070 con 0x7f4f48104f60 2024-08-31T05:29:02.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:02.979+0000 7f4f502db640 1 -- 172.21.15.5:0/2025500714 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f481a6d00 con 0x7f4f48104f60 2024-08-31T05:29:02.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:02.980+0000 7f4f502db640 1 -- 172.21.15.5:0/2025500714 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f48103360 con 0x7f4f48104f60 2024-08-31T05:29:02.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:02.983+0000 7f4f3f7fe640 1 -- 172.21.15.5:0/2025500714 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f4f38042030 con 0x7f4f48104f60 2024-08-31T05:29:02.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:02.984+0000 7f4f3f7fe640 1 --2- 172.21.15.5:0/2025500714 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4f340b4c90 0x7f4f340b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:02.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:02.984+0000 7f4f4e077640 1 --2- 172.21.15.5:0/2025500714 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4f340b4c90 0x7f4f340b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:02.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:02.984+0000 7f4f3f7fe640 1 -- 172.21.15.5:0/2025500714 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f4f381062b0 con 0x7f4f48104f60 2024-08-31T05:29:02.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:02.985+0000 7f4f4e077640 1 --2- 172.21.15.5:0/2025500714 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4f340b4c90 0x7f4f340b71a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4f44005fd0 tx=0x7f4f44005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:02.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:02.987+0000 7f4f3f7fe640 1 -- 172.21.15.5:0/2025500714 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4f380ccde0 con 0x7f4f48104f60 2024-08-31T05:29:03.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.183+0000 7f4f502db640 1 -- 172.21.15.5:0/2025500714 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f4f4810b360 con 0x7f4f48104f60 2024-08-31T05:29:03.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.184+0000 7f4f3f7fe640 1 -- 172.21.15.5:0/2025500714 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f4f380cc6e0 con 0x7f4f48104f60 2024-08-31T05:29:03.186 INFO:teuthology.orchestra.run.smithi005.stdout:279172874277 2024-08-31T05:29:03.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.186+0000 7f4f502db640 1 -- 172.21.15.5:0/2025500714 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4f340b4c90 msgr2=0x7f4f340b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:03.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.186+0000 7f4f502db640 1 --2- 172.21.15.5:0/2025500714 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4f340b4c90 0x7f4f340b71a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4f44005fd0 tx=0x7f4f44005850 comp rx=0 tx=0).stop 2024-08-31T05:29:03.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.186+0000 7f4f502db640 1 -- 172.21.15.5:0/2025500714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f48104f60 msgr2=0x7f4f4819a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:03.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.186+0000 7f4f502db640 1 --2- 172.21.15.5:0/2025500714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f48104f60 0x7f4f4819a8e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4f3802a930 tx=0x7f4f38004270 comp rx=0 tx=0).stop 2024-08-31T05:29:03.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.186+0000 7f4f502db640 1 -- 172.21.15.5:0/2025500714 shutdown_connections 2024-08-31T05:29:03.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.186+0000 7f4f502db640 1 --2- 172.21.15.5:0/2025500714 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4f340b4c90 0x7f4f340b71a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:03.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.186+0000 7f4f502db640 1 --2- 172.21.15.5:0/2025500714 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f481058b0 0x7f4f4819fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:03.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.186+0000 7f4f502db640 1 --2- 172.21.15.5:0/2025500714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4f48104f60 0x7f4f4819a8e0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:03.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.186+0000 7f4f502db640 1 --2- 172.21.15.5:0/2025500714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4f48102f50 0x7f4f4819a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:03.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.186+0000 7f4f502db640 1 -- 172.21.15.5:0/2025500714 >> 172.21.15.5:0/2025500714 conn(0x7f4f48079d30 msgr2=0x7f4f481063f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:03.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.186+0000 7f4f502db640 1 -- 172.21.15.5:0/2025500714 shutdown_connections 2024-08-31T05:29:03.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.186+0000 7f4f502db640 1 -- 172.21.15.5:0/2025500714 wait complete. 2024-08-31T05:29:03.463 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:03 smithi005 ceph-mon[18602]: pgmap v317: 129 pgs: 3 peering, 126 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-08-31T05:29:03.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:03 smithi070 ceph-mon[22316]: pgmap v317: 129 pgs: 3 peering, 126 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-08-31T05:29:03.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:03 smithi050 ceph-mon[22146]: pgmap v317: 129 pgs: 3 peering, 126 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-08-31T05:29:03.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.803+0000 7f0053abd640 1 -- 172.21.15.5:0/3874598566 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f004c1039d0 msgr2=0x7f004c103de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:03.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.803+0000 7f0053abd640 1 --2- 172.21.15.5:0/3874598566 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f004c1039d0 0x7f004c103de0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f003c009900 tx=0x7f003c02a3f0 comp rx=0 tx=0).stop 2024-08-31T05:29:03.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.803+0000 7f0053abd640 1 -- 172.21.15.5:0/3874598566 shutdown_connections 2024-08-31T05:29:03.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.803+0000 7f0053abd640 1 --2- 172.21.15.5:0/3874598566 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f004c109c60 0x7f004c110490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:03.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.803+0000 7f0053abd640 1 --2- 172.21.15.5:0/3874598566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f004c109310 0x7f004c109720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:03.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.803+0000 7f0053abd640 1 --2- 172.21.15.5:0/3874598566 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f004c1039d0 0x7f004c103de0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:03.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.803+0000 7f0053abd640 1 -- 172.21.15.5:0/3874598566 >> 172.21.15.5:0/3874598566 conn(0x7f004c07b670 msgr2=0x7f004c07ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:03.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.803+0000 7f0053abd640 1 -- 172.21.15.5:0/3874598566 shutdown_connections 2024-08-31T05:29:03.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.803+0000 7f0053abd640 1 -- 172.21.15.5:0/3874598566 wait complete. 2024-08-31T05:29:03.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.804+0000 7f0053abd640 1 Processor -- start 2024-08-31T05:29:03.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.804+0000 7f0053abd640 1 -- start start 2024-08-31T05:29:03.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.804+0000 7f0053abd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f004c1039d0 0x7f004c19a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:03.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.804+0000 7f0053abd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f004c109310 0x7f004c19a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:03.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.804+0000 7f0053abd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f004c109c60 0x7f004c19fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:03.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.804+0000 7f0053abd640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f004c113880 con 0x7f004c109310 2024-08-31T05:29:03.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.804+0000 7f0053abd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f004c113700 con 0x7f004c1039d0 2024-08-31T05:29:03.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.804+0000 7f0053abd640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f004c113a00 con 0x7f004c109c60 2024-08-31T05:29:03.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.804+0000 7f0051058640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f004c109310 0x7f004c19a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:03.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.804+0000 7f0051058640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f004c109310 0x7f004c19a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35462/0 (socket says 172.21.15.5:35462) 2024-08-31T05:29:03.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.804+0000 7f0051058640 1 -- 172.21.15.5:0/2802920971 learned_addr learned my addr 172.21.15.5:0/2802920971 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:03.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.805+0000 7f005205a640 1 --2- 172.21.15.5:0/2802920971 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f004c109c60 0x7f004c19fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:03.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.805+0000 7f0051859640 1 --2- 172.21.15.5:0/2802920971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f004c1039d0 0x7f004c19a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:03.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.805+0000 7f0051058640 1 -- 172.21.15.5:0/2802920971 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f004c109c60 msgr2=0x7f004c19fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:03.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.805+0000 7f0051058640 1 --2- 172.21.15.5:0/2802920971 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f004c109c60 0x7f004c19fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:03.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.805+0000 7f0051058640 1 -- 172.21.15.5:0/2802920971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f004c1039d0 msgr2=0x7f004c19a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:03.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.805+0000 7f0051058640 1 --2- 172.21.15.5:0/2802920971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f004c1039d0 0x7f004c19a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:03.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.805+0000 7f0051058640 1 -- 172.21.15.5:0/2802920971 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f004c1a0100 con 0x7f004c109310 2024-08-31T05:29:03.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.805+0000 7f0051058640 1 --2- 172.21.15.5:0/2802920971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f004c109310 0x7f004c19a7f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f004800d950 tx=0x7f004800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:03.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.805+0000 7f0042ffd640 1 -- 172.21.15.5:0/2802920971 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0048017070 con 0x7f004c109310 2024-08-31T05:29:03.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.805+0000 7f0042ffd640 1 -- 172.21.15.5:0/2802920971 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0048009c30 con 0x7f004c109310 2024-08-31T05:29:03.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.805+0000 7f0053abd640 1 -- 172.21.15.5:0/2802920971 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f004c1a03f0 con 0x7f004c109310 2024-08-31T05:29:03.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.805+0000 7f0042ffd640 1 -- 172.21.15.5:0/2802920971 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00480047a0 con 0x7f004c109310 2024-08-31T05:29:03.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.805+0000 7f0053abd640 1 -- 172.21.15.5:0/2802920971 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f004c1a6c10 con 0x7f004c109310 2024-08-31T05:29:03.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.806+0000 7f0053abd640 1 -- 172.21.15.5:0/2802920971 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f004c103de0 con 0x7f004c109310 2024-08-31T05:29:03.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.809+0000 7f0042ffd640 1 -- 172.21.15.5:0/2802920971 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f0048004020 con 0x7f004c109310 2024-08-31T05:29:03.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.809+0000 7f0042ffd640 1 --2- 172.21.15.5:0/2802920971 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f00380b4c40 0x7f00380b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:03.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.810+0000 7f0051859640 1 --2- 172.21.15.5:0/2802920971 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f00380b4c40 0x7f00380b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:03.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.810+0000 7f0042ffd640 1 -- 172.21.15.5:0/2802920971 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f00480e57e0 con 0x7f004c109310 2024-08-31T05:29:03.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.810+0000 7f0051859640 1 --2- 172.21.15.5:0/2802920971 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f00380b4c40 0x7f00380b7150 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f003c031440 tx=0x7f003c009560 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:03.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.812+0000 7f0042ffd640 1 -- 172.21.15.5:0/2802920971 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f0048020020 con 0x7f004c109310 2024-08-31T05:29:04.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:04.001+0000 7f0053abd640 1 -- 172.21.15.5:0/2802920971 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f004c10ba30 con 0x7f004c109310 2024-08-31T05:29:04.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:04.001+0000 7f0042ffd640 1 -- 172.21.15.5:0/2802920971 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f00480ac310 con 0x7f004c109310 2024-08-31T05:29:04.003 INFO:teuthology.orchestra.run.smithi005.stdout:206158430260 2024-08-31T05:29:04.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:04.003+0000 7f0053abd640 1 -- 172.21.15.5:0/2802920971 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f00380b4c40 msgr2=0x7f00380b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:04.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:04.003+0000 7f0053abd640 1 --2- 172.21.15.5:0/2802920971 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f00380b4c40 0x7f00380b7150 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f003c031440 tx=0x7f003c009560 comp rx=0 tx=0).stop 2024-08-31T05:29:04.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:04.003+0000 7f0053abd640 1 -- 172.21.15.5:0/2802920971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f004c109310 msgr2=0x7f004c19a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:04.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:04.003+0000 7f0053abd640 1 --2- 172.21.15.5:0/2802920971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f004c109310 0x7f004c19a7f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f004800d950 tx=0x7f004800de10 comp rx=0 tx=0).stop 2024-08-31T05:29:04.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:04.003+0000 7f0053abd640 1 -- 172.21.15.5:0/2802920971 shutdown_connections 2024-08-31T05:29:04.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:04.003+0000 7f0053abd640 1 --2- 172.21.15.5:0/2802920971 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f00380b4c40 0x7f00380b7150 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:04.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:04.003+0000 7f0053abd640 1 --2- 172.21.15.5:0/2802920971 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f004c109c60 0x7f004c19fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:04.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:04.003+0000 7f0053abd640 1 --2- 172.21.15.5:0/2802920971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f004c109310 0x7f004c19a7f0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:04.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:04.003+0000 7f0053abd640 1 --2- 172.21.15.5:0/2802920971 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f004c1039d0 0x7f004c19a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:04.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:04.003+0000 7f0053abd640 1 -- 172.21.15.5:0/2802920971 >> 172.21.15.5:0/2802920971 conn(0x7f004c07b670 msgr2=0x7f004c1073a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:04.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:04.004+0000 7f0053abd640 1 -- 172.21.15.5:0/2802920971 shutdown_connections 2024-08-31T05:29:04.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:04.004+0000 7f0053abd640 1 -- 172.21.15.5:0/2802920971 wait complete. 2024-08-31T05:29:04.374 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:04 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/2025500714' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-08-31T05:29:04.374 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:04 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/163709102' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-08-31T05:29:04.374 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:04 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/2802920971' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-08-31T05:29:04.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:04 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/2025500714' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-08-31T05:29:04.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:04 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/163709102' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-08-31T05:29:04.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:04 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/2802920971' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-08-31T05:29:04.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:04 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/2025500714' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-08-31T05:29:04.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:04 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/163709102' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-08-31T05:29:04.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:04 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/2802920971' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-08-31T05:29:04.766 INFO:tasks.cephadm.ceph_manager.ceph:need seq 206158430258 got 206158430260 for osd.7 2024-08-31T05:29:04.766 DEBUG:teuthology.parallel:result is None 2024-08-31T05:29:05.187 INFO:tasks.cephadm.ceph_manager.ceph:need seq 279172874274 got 279172874277 for osd.10 2024-08-31T05:29:05.187 DEBUG:teuthology.parallel:result is None 2024-08-31T05:29:05.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:05.383+0000 7fe0f1be1640 1 -- 172.21.15.5:0/900108815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0ec109b90 msgr2=0x7fe0ec1103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:05.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:05.383+0000 7fe0f1be1640 1 --2- 172.21.15.5:0/900108815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0ec109b90 0x7fe0ec1103c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4009ca0 tx=0x7fe0e402a8c0 comp rx=0 tx=0).stop 2024-08-31T05:29:05.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:05.383+0000 7fe0f1be1640 1 -- 172.21.15.5:0/900108815 shutdown_connections 2024-08-31T05:29:05.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:05.383+0000 7fe0f1be1640 1 --2- 172.21.15.5:0/900108815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0ec109b90 0x7fe0ec1103c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:05.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:05.383+0000 7fe0f1be1640 1 --2- 172.21.15.5:0/900108815 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0ec109240 0x7fe0ec109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:05.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:05.383+0000 7fe0f1be1640 1 --2- 172.21.15.5:0/900108815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0ec103900 0x7fe0ec103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:05.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:05.383+0000 7fe0f1be1640 1 -- 172.21.15.5:0/900108815 >> 172.21.15.5:0/900108815 conn(0x7fe0ec07b5f0 msgr2=0x7fe0ec07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:05.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:05.383+0000 7fe0f1be1640 1 -- 172.21.15.5:0/900108815 shutdown_connections 2024-08-31T05:29:05.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:05.383+0000 7fe0f1be1640 1 -- 172.21.15.5:0/900108815 wait complete. 2024-08-31T05:29:05.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:05.383+0000 7fe0f1be1640 1 Processor -- start 2024-08-31T05:29:05.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:05.384+0000 7fe0f1be1640 1 -- start start 2024-08-31T05:29:05.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:05.384+0000 7fe0f1be1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0ec103900 0x7fe0ec19c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:05.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:05.384+0000 7fe0f1be1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0ec109240 0x7fe0ec19c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:05.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:05.384+0000 7fe0f1be1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0ec109b90 0x7fe0ec1a1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:05.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:05.384+0000 7fe0f1be1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec113850 con 0x7fe0ec109b90 2024-08-31T05:29:05.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:05.384+0000 7fe0f1be1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec1136d0 con 0x7fe0ec109240 2024-08-31T05:29:05.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:05.384+0000 7fe0f1be1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec1139d0 con 0x7fe0ec103900 2024-08-31T05:29:05.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:05.384+0000 7fe0ebfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0ec109b90 0x7fe0ec1a1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:05.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:05.384+0000 7fe0ebfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0ec109b90 0x7fe0ec1a1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35480/0 (socket says 172.21.15.5:35480) 2024-08-31T05:29:05.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:05.384+0000 7fe0ebfff640 1 -- 172.21.15.5:0/2938222900 learned_addr learned my addr 172.21.15.5:0/2938222900 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:05.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:05.384+0000 7fe0eb7fe640 1 --2- 172.21.15.5:0/2938222900 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0ec103900 0x7fe0ec19c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:05.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:05.384+0000 7fe0eaffd640 1 --2- 172.21.15.5:0/2938222900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0ec109240 0x7fe0ec19c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:05.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:05.384+0000 7fe0ebfff640 1 -- 172.21.15.5:0/2938222900 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0ec103900 msgr2=0x7fe0ec19c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:05.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:05.384+0000 7fe0ebfff640 1 --2- 172.21.15.5:0/2938222900 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0ec103900 0x7fe0ec19c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:05.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:05.384+0000 7fe0ebfff640 1 -- 172.21.15.5:0/2938222900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0ec109240 msgr2=0x7fe0ec19c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:05.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:05.384+0000 7fe0ebfff640 1 --2- 172.21.15.5:0/2938222900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0ec109240 0x7fe0ec19c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:05.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:05.384+0000 7fe0ebfff640 1 -- 172.21.15.5:0/2938222900 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0ec1a2350 con 0x7fe0ec109b90 2024-08-31T05:29:05.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:05.385+0000 7fe0ebfff640 1 --2- 172.21.15.5:0/2938222900 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0ec109b90 0x7fe0ec1a1c20 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4005cc0 tx=0x7fe0e402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:05.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:05.385+0000 7fe0e8ff9640 1 -- 172.21.15.5:0/2938222900 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e4003bf0 con 0x7fe0ec109b90 2024-08-31T05:29:05.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:05.385+0000 7fe0e8ff9640 1 -- 172.21.15.5:0/2938222900 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0e4003d90 con 0x7fe0ec109b90 2024-08-31T05:29:05.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:05.385+0000 7fe0f1be1640 1 -- 172.21.15.5:0/2938222900 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0ec1a25e0 con 0x7fe0ec109b90 2024-08-31T05:29:05.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:05.385+0000 7fe0e8ff9640 1 -- 172.21.15.5:0/2938222900 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e402fbc0 con 0x7fe0ec109b90 2024-08-31T05:29:05.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:05.385+0000 7fe0f1be1640 1 -- 172.21.15.5:0/2938222900 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0ec1a8da0 con 0x7fe0ec109b90 2024-08-31T05:29:05.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:05.386+0000 7fe0f1be1640 1 -- 172.21.15.5:0/2938222900 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0ec103d10 con 0x7fe0ec109b90 2024-08-31T05:29:05.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:05.388+0000 7fe0e8ff9640 1 -- 172.21.15.5:0/2938222900 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7fe0e402fd60 con 0x7fe0ec109b90 2024-08-31T05:29:05.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:05.388+0000 7fe0e8ff9640 1 --2- 172.21.15.5:0/2938222900 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe0d80b4c10 0x7fe0d80b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:05.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:05.389+0000 7fe0eb7fe640 1 --2- 172.21.15.5:0/2938222900 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe0d80b4c10 0x7fe0d80b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:05.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:05.389+0000 7fe0e8ff9640 1 -- 172.21.15.5:0/2938222900 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fe0e4106e60 con 0x7fe0ec109b90 2024-08-31T05:29:05.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:05.389+0000 7fe0eb7fe640 1 --2- 172.21.15.5:0/2938222900 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe0d80b4c10 0x7fe0d80b7120 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe0d400bbe0 tx=0x7fe0d400b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:05.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:05.391+0000 7fe0e8ff9640 1 -- 172.21.15.5:0/2938222900 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe0e40cd990 con 0x7fe0ec109b90 2024-08-31T05:29:05.466 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:05 smithi005 ceph-mon[18602]: pgmap v318: 129 pgs: 3 peering, 126 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 9 op/s 2024-08-31T05:29:05.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.659+0000 7f0b613f4640 1 -- 172.21.15.5:0/3196796766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b5c108ad0 msgr2=0x7f0b5c10f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:05.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.659+0000 7f0b613f4640 1 --2- 172.21.15.5:0/3196796766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b5c108ad0 0x7f0b5c10f300 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0b54009ca0 tx=0x7f0b5402a8c0 comp rx=0 tx=0).stop 2024-08-31T05:29:05.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.659+0000 7f0b613f4640 1 -- 172.21.15.5:0/3196796766 shutdown_connections 2024-08-31T05:29:05.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.659+0000 7f0b613f4640 1 --2- 172.21.15.5:0/3196796766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b5c108ad0 0x7f0b5c10f300 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:05.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.659+0000 7f0b613f4640 1 --2- 172.21.15.5:0/3196796766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b5c108180 0x7f0b5c108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:05.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.659+0000 7f0b613f4640 1 --2- 172.21.15.5:0/3196796766 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b5c102840 0x7f0b5c102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:05.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.659+0000 7f0b613f4640 1 -- 172.21.15.5:0/3196796766 >> 172.21.15.5:0/3196796766 conn(0x7f0b5c0794f0 msgr2=0x7f0b5c079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:05.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.659+0000 7f0b613f4640 1 -- 172.21.15.5:0/3196796766 shutdown_connections 2024-08-31T05:29:05.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.659+0000 7f0b613f4640 1 -- 172.21.15.5:0/3196796766 wait complete. 2024-08-31T05:29:05.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.659+0000 7f0b613f4640 1 Processor -- start 2024-08-31T05:29:05.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.659+0000 7f0b613f4640 1 -- start start 2024-08-31T05:29:05.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.660+0000 7f0b613f4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b5c102840 0x7f0b5c19b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:05.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.660+0000 7f0b613f4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b5c108180 0x7f0b5c19b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:05.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.660+0000 7f0b613f4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b5c108ad0 0x7f0b5c19ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:05.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.660+0000 7f0b613f4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5c1127a0 con 0x7f0b5c108180 2024-08-31T05:29:05.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.660+0000 7f0b613f4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5c112620 con 0x7f0b5c108ad0 2024-08-31T05:29:05.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.660+0000 7f0b613f4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5c112920 con 0x7f0b5c102840 2024-08-31T05:29:05.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.660+0000 7f0b5a7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b5c108180 0x7f0b5c19b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:05.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.660+0000 7f0b5a7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b5c108180 0x7f0b5c19b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35438/0 (socket says 172.21.15.5:35438) 2024-08-31T05:29:05.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.660+0000 7f0b5a7fc640 1 -- 172.21.15.5:0/163709102 learned_addr learned my addr 172.21.15.5:0/163709102 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:05.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.660+0000 7f0b5b7fe640 1 --2- 172.21.15.5:0/163709102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b5c108ad0 0x7f0b5c19ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:05.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.660+0000 7f0b5affd640 1 --2- 172.21.15.5:0/163709102 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b5c102840 0x7f0b5c19b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:05.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.660+0000 7f0b5a7fc640 1 -- 172.21.15.5:0/163709102 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b5c102840 msgr2=0x7f0b5c19b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:05.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.660+0000 7f0b5a7fc640 1 --2- 172.21.15.5:0/163709102 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b5c102840 0x7f0b5c19b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:05.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.660+0000 7f0b5a7fc640 1 -- 172.21.15.5:0/163709102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b5c108ad0 msgr2=0x7f0b5c19ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:05.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.660+0000 7f0b5a7fc640 1 --2- 172.21.15.5:0/163709102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b5c108ad0 0x7f0b5c19ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:05.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.660+0000 7f0b5a7fc640 1 -- 172.21.15.5:0/163709102 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b5c1a6320 con 0x7f0b5c108180 2024-08-31T05:29:05.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.660+0000 7f0b5b7fe640 1 --2- 172.21.15.5:0/163709102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b5c108ad0 0x7f0b5c19ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:29:05.495 INFO:teuthology.orchestra.run.smithi005.stdout:81604378702 2024-08-31T05:29:05.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.660+0000 7f0b5a7fc640 1 --2- 172.21.15.5:0/163709102 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b5c108180 0x7f0b5c19b550 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0b5000e9f0 tx=0x7f0b5000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:05.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.661+0000 7f0b43fff640 1 -- 172.21.15.5:0/163709102 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b5000ccc0 con 0x7f0b5c108180 2024-08-31T05:29:05.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.661+0000 7f0b613f4640 1 -- 172.21.15.5:0/163709102 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b5c1a6610 con 0x7f0b5c108180 2024-08-31T05:29:05.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.661+0000 7f0b43fff640 1 -- 172.21.15.5:0/163709102 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b500108e0 con 0x7f0b5c108180 2024-08-31T05:29:05.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.661+0000 7f0b613f4640 1 -- 172.21.15.5:0/163709102 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b5c1a6ba0 con 0x7f0b5c108180 2024-08-31T05:29:05.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.661+0000 7f0b43fff640 1 -- 172.21.15.5:0/163709102 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b50018860 con 0x7f0b5c108180 2024-08-31T05:29:05.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.662+0000 7f0b613f4640 1 -- 172.21.15.5:0/163709102 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b5c102c50 con 0x7f0b5c108180 2024-08-31T05:29:05.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.663+0000 7f0b43fff640 1 -- 172.21.15.5:0/163709102 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f0b50010430 con 0x7f0b5c108180 2024-08-31T05:29:05.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.664+0000 7f0b43fff640 1 --2- 172.21.15.5:0/163709102 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f0b440b4c10 0x7f0b440b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:05.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.664+0000 7f0b5affd640 1 --2- 172.21.15.5:0/163709102 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f0b440b4c10 0x7f0b440b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:05.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.664+0000 7f0b43fff640 1 -- 172.21.15.5:0/163709102 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f0b500e6020 con 0x7f0b5c108180 2024-08-31T05:29:05.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.665+0000 7f0b5affd640 1 --2- 172.21.15.5:0/163709102 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f0b440b4c10 0x7f0b440b7120 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c06c4a0 tx=0x7f0b4c005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:05.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.667+0000 7f0b43fff640 1 -- 172.21.15.5:0/163709102 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f0b500acb50 con 0x7f0b5c108180 2024-08-31T05:29:05.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.859+0000 7f0b613f4640 1 -- 172.21.15.5:0/163709102 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f0b5c02e430 con 0x7f0b5c108180 2024-08-31T05:29:05.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.859+0000 7f0b43fff640 1 -- 172.21.15.5:0/163709102 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0b500b5090 con 0x7f0b5c108180 2024-08-31T05:29:05.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.861+0000 7f0b613f4640 1 -- 172.21.15.5:0/163709102 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f0b440b4c10 msgr2=0x7f0b440b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:05.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.861+0000 7f0b613f4640 1 --2- 172.21.15.5:0/163709102 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f0b440b4c10 0x7f0b440b7120 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c06c4a0 tx=0x7f0b4c005f90 comp rx=0 tx=0).stop 2024-08-31T05:29:05.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.861+0000 7f0b613f4640 1 -- 172.21.15.5:0/163709102 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b5c108180 msgr2=0x7f0b5c19b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:05.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.861+0000 7f0b613f4640 1 --2- 172.21.15.5:0/163709102 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b5c108180 0x7f0b5c19b550 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0b5000e9f0 tx=0x7f0b5000eeb0 comp rx=0 tx=0).stop 2024-08-31T05:29:05.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.861+0000 7f0b613f4640 1 -- 172.21.15.5:0/163709102 shutdown_connections 2024-08-31T05:29:05.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.861+0000 7f0b613f4640 1 --2- 172.21.15.5:0/163709102 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f0b440b4c10 0x7f0b440b7120 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:05.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.861+0000 7f0b613f4640 1 --2- 172.21.15.5:0/163709102 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0b5c108ad0 0x7f0b5c19ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:05.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.861+0000 7f0b613f4640 1 --2- 172.21.15.5:0/163709102 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b5c108180 0x7f0b5c19b550 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:05.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.861+0000 7f0b613f4640 1 --2- 172.21.15.5:0/163709102 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b5c102840 0x7f0b5c19b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:05.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.861+0000 7f0b613f4640 1 -- 172.21.15.5:0/163709102 >> 172.21.15.5:0/163709102 conn(0x7f0b5c0794f0 msgr2=0x7f0b5c106210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:05.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.862+0000 7f0b613f4640 1 -- 172.21.15.5:0/163709102 shutdown_connections 2024-08-31T05:29:05.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:03.862+0000 7f0b613f4640 1 -- 172.21.15.5:0/163709102 wait complete. 2024-08-31T05:29:05.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:05.579+0000 7fe0f1be1640 1 -- 172.21.15.5:0/2938222900 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fe0ec1a8fd0 con 0x7fe0ec109b90 2024-08-31T05:29:05.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:05.580+0000 7fe0e8ff9640 1 -- 172.21.15.5:0/2938222900 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe0e40cd290 con 0x7fe0ec109b90 2024-08-31T05:29:05.582 INFO:teuthology.orchestra.run.smithi005.stdout:257698037803 2024-08-31T05:29:05.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:05.582+0000 7fe0f1be1640 1 -- 172.21.15.5:0/2938222900 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe0d80b4c10 msgr2=0x7fe0d80b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:05.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:05.582+0000 7fe0f1be1640 1 --2- 172.21.15.5:0/2938222900 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe0d80b4c10 0x7fe0d80b7120 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe0d400bbe0 tx=0x7fe0d400b390 comp rx=0 tx=0).stop 2024-08-31T05:29:05.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:05.582+0000 7fe0f1be1640 1 -- 172.21.15.5:0/2938222900 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0ec109b90 msgr2=0x7fe0ec1a1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:05.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:05.582+0000 7fe0f1be1640 1 --2- 172.21.15.5:0/2938222900 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0ec109b90 0x7fe0ec1a1c20 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4005cc0 tx=0x7fe0e402f380 comp rx=0 tx=0).stop 2024-08-31T05:29:05.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:05.582+0000 7fe0f1be1640 1 -- 172.21.15.5:0/2938222900 shutdown_connections 2024-08-31T05:29:05.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:05.582+0000 7fe0f1be1640 1 --2- 172.21.15.5:0/2938222900 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe0d80b4c10 0x7fe0d80b7120 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:05.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:05.582+0000 7fe0f1be1640 1 --2- 172.21.15.5:0/2938222900 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0ec109b90 0x7fe0ec1a1c20 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:05.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:05.582+0000 7fe0f1be1640 1 --2- 172.21.15.5:0/2938222900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe0ec109240 0x7fe0ec19c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:05.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:05.582+0000 7fe0f1be1640 1 --2- 172.21.15.5:0/2938222900 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0ec103900 0x7fe0ec19c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:05.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:05.582+0000 7fe0f1be1640 1 -- 172.21.15.5:0/2938222900 >> 172.21.15.5:0/2938222900 conn(0x7fe0ec07b5f0 msgr2=0x7fe0ec107050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:05.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:05.582+0000 7fe0f1be1640 1 -- 172.21.15.5:0/2938222900 shutdown_connections 2024-08-31T05:29:05.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:05.582+0000 7fe0f1be1640 1 -- 172.21.15.5:0/2938222900 wait complete. 2024-08-31T05:29:05.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:05 smithi070 ceph-mon[22316]: pgmap v318: 129 pgs: 3 peering, 126 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 9 op/s 2024-08-31T05:29:05.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:05 smithi050 ceph-mon[22146]: pgmap v318: 129 pgs: 3 peering, 126 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 9 op/s 2024-08-31T05:29:06.258 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913790011 got 158913790015 for osd.5 2024-08-31T05:29:06.258 DEBUG:teuthology.parallel:result is None 2024-08-31T05:29:06.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:06 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/2938222900' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-08-31T05:29:06.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:06 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/2938222900' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-08-31T05:29:06.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:06 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/2938222900' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-08-31T05:29:06.681 INFO:tasks.cephadm.ceph_manager.ceph:need seq 257698037800 got 257698037803 for osd.9 2024-08-31T05:29:06.681 DEBUG:teuthology.parallel:result is None 2024-08-31T05:29:06.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:06.914+0000 7f82c0a7d640 1 -- 172.21.15.5:0/983408035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82bc108ab0 msgr2=0x7f82bc10f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:06.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:06.914+0000 7f82c0a7d640 1 --2- 172.21.15.5:0/983408035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82bc108ab0 0x7f82bc10f2e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f82b4009ca0 tx=0x7f82b402a8c0 comp rx=0 tx=0).stop 2024-08-31T05:29:06.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:06.914+0000 7f82c0a7d640 1 -- 172.21.15.5:0/983408035 shutdown_connections 2024-08-31T05:29:06.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:06.914+0000 7f82c0a7d640 1 --2- 172.21.15.5:0/983408035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82bc108ab0 0x7f82bc10f2e0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:06.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:06.914+0000 7f82c0a7d640 1 --2- 172.21.15.5:0/983408035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82bc108160 0x7f82bc108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:06.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:06.914+0000 7f82c0a7d640 1 --2- 172.21.15.5:0/983408035 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82bc102820 0x7f82bc102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:06.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:06.914+0000 7f82c0a7d640 1 -- 172.21.15.5:0/983408035 >> 172.21.15.5:0/983408035 conn(0x7f82bc0794e0 msgr2=0x7f82bc0798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:06.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:06.914+0000 7f82c0a7d640 1 -- 172.21.15.5:0/983408035 shutdown_connections 2024-08-31T05:29:06.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:06.914+0000 7f82c0a7d640 1 -- 172.21.15.5:0/983408035 wait complete. 2024-08-31T05:29:06.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:06.915+0000 7f82c0a7d640 1 Processor -- start 2024-08-31T05:29:06.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:06.915+0000 7f82c0a7d640 1 -- start start 2024-08-31T05:29:06.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:06.915+0000 7f82c0a7d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82bc102820 0x7f82bc19afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:06.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:06.915+0000 7f82c0a7d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82bc108160 0x7f82bc19b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:06.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:06.915+0000 7f82c0a7d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82bc108ab0 0x7f82bc19ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:06.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:06.915+0000 7f82c0a7d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f82bc112730 con 0x7f82bc108160 2024-08-31T05:29:06.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:06.915+0000 7f82c0a7d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f82bc1125b0 con 0x7f82bc108ab0 2024-08-31T05:29:06.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:06.915+0000 7f82c0a7d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f82bc1128b0 con 0x7f82bc102820 2024-08-31T05:29:06.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:06.915+0000 7f82b9d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82bc108160 0x7f82bc19b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:06.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:06.915+0000 7f82b9d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82bc108160 0x7f82bc19b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35496/0 (socket says 172.21.15.5:35496) 2024-08-31T05:29:06.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:06.915+0000 7f82b9d9b640 1 -- 172.21.15.5:0/3439683786 learned_addr learned my addr 172.21.15.5:0/3439683786 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:06.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:06.915+0000 7f82ba59c640 1 --2- 172.21.15.5:0/3439683786 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82bc102820 0x7f82bc19afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:06.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:06.915+0000 7f82bad9d640 1 --2- 172.21.15.5:0/3439683786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82bc108ab0 0x7f82bc19ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:06.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:06.916+0000 7f82b9d9b640 1 -- 172.21.15.5:0/3439683786 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82bc102820 msgr2=0x7f82bc19afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:06.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:06.916+0000 7f82b9d9b640 1 --2- 172.21.15.5:0/3439683786 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82bc102820 0x7f82bc19afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:06.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:06.916+0000 7f82b9d9b640 1 -- 172.21.15.5:0/3439683786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82bc108ab0 msgr2=0x7f82bc19ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:06.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:06.916+0000 7f82b9d9b640 1 --2- 172.21.15.5:0/3439683786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82bc108ab0 0x7f82bc19ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:06.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:06.916+0000 7f82b9d9b640 1 -- 172.21.15.5:0/3439683786 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82bc1a6240 con 0x7f82bc108160 2024-08-31T05:29:06.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:06.916+0000 7f82bad9d640 1 --2- 172.21.15.5:0/3439683786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82bc108ab0 0x7f82bc19ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:29:06.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:06.916+0000 7f82b9d9b640 1 --2- 172.21.15.5:0/3439683786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82bc108160 0x7f82bc19b500 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f82b000c970 tx=0x7f82b000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:06.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:06.916+0000 7f82ab7fe640 1 -- 172.21.15.5:0/3439683786 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b0014070 con 0x7f82bc108160 2024-08-31T05:29:06.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:06.916+0000 7f82c0a7d640 1 -- 172.21.15.5:0/3439683786 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82bc1a6530 con 0x7f82bc108160 2024-08-31T05:29:06.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:06.916+0000 7f82ab7fe640 1 -- 172.21.15.5:0/3439683786 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82b0004440 con 0x7f82bc108160 2024-08-31T05:29:06.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:06.916+0000 7f82ab7fe640 1 -- 172.21.15.5:0/3439683786 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b0003e50 con 0x7f82bc108160 2024-08-31T05:29:06.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:06.916+0000 7f82c0a7d640 1 -- 172.21.15.5:0/3439683786 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82bc1a6ac0 con 0x7f82bc108160 2024-08-31T05:29:06.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:06.917+0000 7f82c0a7d640 1 -- 172.21.15.5:0/3439683786 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82bc103aa0 con 0x7f82bc108160 2024-08-31T05:29:06.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:06.919+0000 7f82ab7fe640 1 -- 172.21.15.5:0/3439683786 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f82b0017070 con 0x7f82bc108160 2024-08-31T05:29:06.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:06.920+0000 7f82ab7fe640 1 --2- 172.21.15.5:0/3439683786 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f82a40b4db0 0x7f82a40b72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:06.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:06.920+0000 7f82ba59c640 1 --2- 172.21.15.5:0/3439683786 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f82a40b4db0 0x7f82a40b72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:06.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:06.920+0000 7f82ab7fe640 1 -- 172.21.15.5:0/3439683786 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f82b00e5a70 con 0x7f82bc108160 2024-08-31T05:29:06.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:06.920+0000 7f82ba59c640 1 --2- 172.21.15.5:0/3439683786 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f82a40b4db0 0x7f82a40b72c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f82bc06c4a0 tx=0x7f82ac005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:06.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:06.923+0000 7f82ab7fe640 1 -- 172.21.15.5:0/3439683786 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f82b001e020 con 0x7f82bc108160 2024-08-31T05:29:07.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:07.115+0000 7f82c0a7d640 1 -- 172.21.15.5:0/3439683786 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f82bc10a310 con 0x7f82bc108160 2024-08-31T05:29:07.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:07.116+0000 7f82ab7fe640 1 -- 172.21.15.5:0/3439683786 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f82b00ac5a0 con 0x7f82bc108160 2024-08-31T05:29:07.118 INFO:teuthology.orchestra.run.smithi005.stdout:60129542228 2024-08-31T05:29:07.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:07.118+0000 7f82c0a7d640 1 -- 172.21.15.5:0/3439683786 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f82a40b4db0 msgr2=0x7f82a40b72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:07.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:07.118+0000 7f82c0a7d640 1 --2- 172.21.15.5:0/3439683786 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f82a40b4db0 0x7f82a40b72c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f82bc06c4a0 tx=0x7f82ac005f90 comp rx=0 tx=0).stop 2024-08-31T05:29:07.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:07.118+0000 7f82c0a7d640 1 -- 172.21.15.5:0/3439683786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82bc108160 msgr2=0x7f82bc19b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:07.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:07.118+0000 7f82c0a7d640 1 --2- 172.21.15.5:0/3439683786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82bc108160 0x7f82bc19b500 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f82b000c970 tx=0x7f82b000ce30 comp rx=0 tx=0).stop 2024-08-31T05:29:07.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:07.118+0000 7f82c0a7d640 1 -- 172.21.15.5:0/3439683786 shutdown_connections 2024-08-31T05:29:07.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:07.118+0000 7f82c0a7d640 1 --2- 172.21.15.5:0/3439683786 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f82a40b4db0 0x7f82a40b72c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:07.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:07.118+0000 7f82c0a7d640 1 --2- 172.21.15.5:0/3439683786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82bc108ab0 0x7f82bc19ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:07.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:07.118+0000 7f82c0a7d640 1 --2- 172.21.15.5:0/3439683786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82bc108160 0x7f82bc19b500 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:07.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:07.118+0000 7f82c0a7d640 1 --2- 172.21.15.5:0/3439683786 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82bc102820 0x7f82bc19afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:07.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:07.118+0000 7f82c0a7d640 1 -- 172.21.15.5:0/3439683786 >> 172.21.15.5:0/3439683786 conn(0x7f82bc0794e0 msgr2=0x7f82bc104170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:07.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:07.118+0000 7f82c0a7d640 1 -- 172.21.15.5:0/3439683786 shutdown_connections 2024-08-31T05:29:07.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:07.118+0000 7f82c0a7d640 1 -- 172.21.15.5:0/3439683786 wait complete. 2024-08-31T05:29:07.378 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378700 got 81604378702 for osd.2 2024-08-31T05:29:07.378 DEBUG:teuthology.parallel:result is None 2024-08-31T05:29:07.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:07 smithi005 ceph-mon[18602]: pgmap v319: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-08-31T05:29:07.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:07 smithi005 ceph-mon[18602]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-08-31T05:29:07.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:07 smithi005 ceph-mon[18602]: Cluster is now healthy 2024-08-31T05:29:07.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:07 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/3439683786' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-08-31T05:29:07.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:07 smithi070 ceph-mon[22316]: pgmap v319: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-08-31T05:29:07.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:07 smithi070 ceph-mon[22316]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-08-31T05:29:07.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:07 smithi070 ceph-mon[22316]: Cluster is now healthy 2024-08-31T05:29:07.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:07 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/3439683786' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-08-31T05:29:07.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:07 smithi050 ceph-mon[22146]: pgmap v319: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-08-31T05:29:07.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:07 smithi050 ceph-mon[22146]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-08-31T05:29:07.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:07 smithi050 ceph-mon[22146]: Cluster is now healthy 2024-08-31T05:29:07.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:07 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/3439683786' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-08-31T05:29:08.014 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542224 got 60129542228 for osd.1 2024-08-31T05:29:08.014 DEBUG:teuthology.parallel:result is None 2024-08-31T05:29:08.014 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-08-31T05:29:08.014 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph pg dump --format=json 2024-08-31T05:29:08.267 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:29:08.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.760+0000 7fc11e2f2640 1 -- 172.21.15.5:0/2723690036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc118108a90 msgr2=0x7fc11810f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:08.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.760+0000 7fc11e2f2640 1 --2- 172.21.15.5:0/2723690036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc118108a90 0x7fc11810f2c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fc110009ca0 tx=0x7fc11002a8c0 comp rx=0 tx=0).stop 2024-08-31T05:29:08.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.760+0000 7fc11e2f2640 1 -- 172.21.15.5:0/2723690036 shutdown_connections 2024-08-31T05:29:08.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.760+0000 7fc11e2f2640 1 --2- 172.21.15.5:0/2723690036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc118108a90 0x7fc11810f2c0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:08.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.760+0000 7fc11e2f2640 1 --2- 172.21.15.5:0/2723690036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc118108140 0x7fc118108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:08.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.760+0000 7fc11e2f2640 1 --2- 172.21.15.5:0/2723690036 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc118102800 0x7fc118102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:08.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.760+0000 7fc11e2f2640 1 -- 172.21.15.5:0/2723690036 >> 172.21.15.5:0/2723690036 conn(0x7fc1180794d0 msgr2=0x7fc1180798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:08.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.760+0000 7fc11e2f2640 1 -- 172.21.15.5:0/2723690036 shutdown_connections 2024-08-31T05:29:08.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.760+0000 7fc11e2f2640 1 -- 172.21.15.5:0/2723690036 wait complete. 2024-08-31T05:29:08.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.761+0000 7fc11e2f2640 1 Processor -- start 2024-08-31T05:29:08.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.761+0000 7fc11e2f2640 1 -- start start 2024-08-31T05:29:08.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.762+0000 7fc11e2f2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc118102800 0x7fc11819a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:08.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.762+0000 7fc11e2f2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc118108140 0x7fc11819a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:08.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.762+0000 7fc11e2f2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc118108a90 0x7fc11819fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:08.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.762+0000 7fc11e2f2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc1181126f0 con 0x7fc118102800 2024-08-31T05:29:08.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.762+0000 7fc11e2f2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc118112570 con 0x7fc118108a90 2024-08-31T05:29:08.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.762+0000 7fc11e2f2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc118112870 con 0x7fc118108140 2024-08-31T05:29:08.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.762+0000 7fc117fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc118102800 0x7fc11819a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:08.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.762+0000 7fc117fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc118102800 0x7fc11819a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35524/0 (socket says 172.21.15.5:35524) 2024-08-31T05:29:08.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.762+0000 7fc117fff640 1 -- 172.21.15.5:0/118676764 learned_addr learned my addr 172.21.15.5:0/118676764 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:08.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.762+0000 7fc11c88f640 1 --2- 172.21.15.5:0/118676764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc118108a90 0x7fc11819fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:08.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.762+0000 7fc1177fe640 1 --2- 172.21.15.5:0/118676764 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc118108140 0x7fc11819a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:08.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.762+0000 7fc117fff640 1 -- 172.21.15.5:0/118676764 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc118108140 msgr2=0x7fc11819a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:08.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.762+0000 7fc117fff640 1 --2- 172.21.15.5:0/118676764 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc118108140 0x7fc11819a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:08.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.762+0000 7fc117fff640 1 -- 172.21.15.5:0/118676764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc118108a90 msgr2=0x7fc11819fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:08.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.762+0000 7fc117fff640 1 --2- 172.21.15.5:0/118676764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc118108a90 0x7fc11819fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:08.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.762+0000 7fc117fff640 1 -- 172.21.15.5:0/118676764 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1181a01e0 con 0x7fc118102800 2024-08-31T05:29:08.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.762+0000 7fc1177fe640 1 --2- 172.21.15.5:0/118676764 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc118108140 0x7fc11819a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:29:08.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.762+0000 7fc117fff640 1 --2- 172.21.15.5:0/118676764 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc118102800 0x7fc11819a270 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc10800c890 tx=0x7fc10800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:08.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.762+0000 7fc1157fa640 1 -- 172.21.15.5:0/118676764 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc108004220 con 0x7fc118102800 2024-08-31T05:29:08.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.763+0000 7fc11e2f2640 1 -- 172.21.15.5:0/118676764 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1181a04d0 con 0x7fc118102800 2024-08-31T05:29:08.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.763+0000 7fc1157fa640 1 -- 172.21.15.5:0/118676764 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1080043c0 con 0x7fc118102800 2024-08-31T05:29:08.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.763+0000 7fc1157fa640 1 -- 172.21.15.5:0/118676764 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc108004a00 con 0x7fc118102800 2024-08-31T05:29:08.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.763+0000 7fc11e2f2640 1 -- 172.21.15.5:0/118676764 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1181a6c30 con 0x7fc118102800 2024-08-31T05:29:08.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.764+0000 7fc11e2f2640 1 -- 172.21.15.5:0/118676764 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc118102c10 con 0x7fc118102800 2024-08-31T05:29:08.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.766+0000 7fc1157fa640 1 -- 172.21.15.5:0/118676764 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7fc1080079b0 con 0x7fc118102800 2024-08-31T05:29:08.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.767+0000 7fc1157fa640 1 --2- 172.21.15.5:0/118676764 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc1000b4c10 0x7fc1000b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:08.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.767+0000 7fc1177fe640 1 --2- 172.21.15.5:0/118676764 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc1000b4c10 0x7fc1000b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:08.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.767+0000 7fc1157fa640 1 -- 172.21.15.5:0/118676764 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fc1080e5980 con 0x7fc118102800 2024-08-31T05:29:08.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.768+0000 7fc1177fe640 1 --2- 172.21.15.5:0/118676764 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc1000b4c10 0x7fc1000b7120 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc10c005fd0 tx=0x7fc10c0094d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:08.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.770+0000 7fc1157fa640 1 -- 172.21.15.5:0/118676764 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc108014030 con 0x7fc118102800 2024-08-31T05:29:08.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.953+0000 7fc11e2f2640 1 -- 172.21.15.5:0/118676764 --> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc11806abe0 con 0x7fc1000b4c10 2024-08-31T05:29:08.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.962+0000 7fc1157fa640 1 -- 172.21.15.5:0/118676764 <== mgr.14220 v2:172.21.15.5:6800/2696053609 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340666 (secure 0 0 0) 0x7fc11806abe0 con 0x7fc1000b4c10 2024-08-31T05:29:08.967 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:29:08.969 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-31T05:29:08.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.965+0000 7fc11e2f2640 1 -- 172.21.15.5:0/118676764 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc1000b4c10 msgr2=0x7fc1000b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:08.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.965+0000 7fc11e2f2640 1 --2- 172.21.15.5:0/118676764 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc1000b4c10 0x7fc1000b7120 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc10c005fd0 tx=0x7fc10c0094d0 comp rx=0 tx=0).stop 2024-08-31T05:29:08.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.965+0000 7fc11e2f2640 1 -- 172.21.15.5:0/118676764 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc118102800 msgr2=0x7fc11819a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:08.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.965+0000 7fc11e2f2640 1 --2- 172.21.15.5:0/118676764 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc118102800 0x7fc11819a270 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc10800c890 tx=0x7fc10800cd50 comp rx=0 tx=0).stop 2024-08-31T05:29:08.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.965+0000 7fc11e2f2640 1 -- 172.21.15.5:0/118676764 shutdown_connections 2024-08-31T05:29:08.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.965+0000 7fc11e2f2640 1 --2- 172.21.15.5:0/118676764 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc1000b4c10 0x7fc1000b7120 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:08.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.965+0000 7fc11e2f2640 1 --2- 172.21.15.5:0/118676764 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc118108a90 0x7fc11819fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:08.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.965+0000 7fc11e2f2640 1 --2- 172.21.15.5:0/118676764 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc118108140 0x7fc11819a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:08.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.965+0000 7fc11e2f2640 1 --2- 172.21.15.5:0/118676764 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc118102800 0x7fc11819a270 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:08.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.965+0000 7fc11e2f2640 1 -- 172.21.15.5:0/118676764 >> 172.21.15.5:0/118676764 conn(0x7fc1180794d0 msgr2=0x7fc1180ff9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:08.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.965+0000 7fc11e2f2640 1 -- 172.21.15.5:0/118676764 shutdown_connections 2024-08-31T05:29:08.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:08.965+0000 7fc11e2f2640 1 -- 172.21.15.5:0/118676764 wait complete. 2024-08-31T05:29:09.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:09 smithi005 ceph-mon[18602]: pgmap v320: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 10 op/s 2024-08-31T05:29:09.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:09 smithi070 ceph-mon[22316]: pgmap v320: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 10 op/s 2024-08-31T05:29:09.654 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":320,"stamp":"2024-08-31T05:29:07.464012+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659878,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":636,"num_read_kb":421,"num_write":374,"num_write_kb":2294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":2952422,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":308,"ondisk_log_size":308,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":402780,"kb_used_data":11864,"kb_used_omap":18,"kb_used_meta":390637,"kb_avail":1124539044,"statfs":{"total":1151940427776,"available":1151527981056,"internally_reserved":0,"allocated":12148736,"data_stored":8062004,"data_compressed":462027,"data_compressed_allocated":626688,"data_compressed_original":2752512,"omap_allocated":19141,"internal_metadata":400012603},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":45,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.307374"},"pg_stats":[{"pgid":"2.1f","version":"85'13","reported_seq":116,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:00.659000+0000","last_change":"2024-08-31T05:27:58.511927+0000","last_active":"2024-08-31T05:29:00.659000+0000","last_peered":"2024-08-31T05:29:00.659000+0000","last_clean":"2024-08-31T05:29:00.659000+0000","last_became_active":"2024-08-31T05:27:58.507111+0000","last_became_peered":"2024-08-31T05:27:58.507111+0000","last_unstale":"2024-08-31T05:29:00.659000+0000","last_undegraded":"2024-08-31T05:29:00.659000+0000","last_fullsized":"2024-08-31T05:29:00.659000+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:42:09.078048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.159755+0000","last_change":"2024-08-31T05:27:31.255221+0000","last_active":"2024-08-31T05:28:59.159755+0000","last_peered":"2024-08-31T05:28:59.159755+0000","last_clean":"2024-08-31T05:28:59.159755+0000","last_became_active":"2024-08-31T05:27:31.254684+0000","last_became_peered":"2024-08-31T05:27:31.254684+0000","last_unstale":"2024-08-31T05:28:59.159755+0000","last_undegraded":"2024-08-31T05:28:59.159755+0000","last_fullsized":"2024-08-31T05:28:59.159755+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:34:22.517485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.661502+0000","last_change":"2024-08-31T05:27:38.293857+0000","last_active":"2024-08-31T05:28:59.661502+0000","last_peered":"2024-08-31T05:28:59.661502+0000","last_clean":"2024-08-31T05:28:59.661502+0000","last_became_active":"2024-08-31T05:27:38.292763+0000","last_became_peered":"2024-08-31T05:27:38.292763+0000","last_unstale":"2024-08-31T05:28:59.661502+0000","last_undegraded":"2024-08-31T05:28:59.661502+0000","last_fullsized":"2024-08-31T05:28:59.661502+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:53:27.187697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.159867+0000","last_change":"2024-08-31T05:27:29.281010+0000","last_active":"2024-08-31T05:28:59.159867+0000","last_peered":"2024-08-31T05:28:59.159867+0000","last_clean":"2024-08-31T05:28:59.159867+0000","last_became_active":"2024-08-31T05:27:29.280625+0000","last_became_peered":"2024-08-31T05:27:29.280625+0000","last_unstale":"2024-08-31T05:28:59.159867+0000","last_undegraded":"2024-08-31T05:28:59.159867+0000","last_fullsized":"2024-08-31T05:28:59.159867+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:09:25.542564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.661230+0000","last_change":"2024-08-31T05:27:31.258052+0000","last_active":"2024-08-31T05:28:59.661230+0000","last_peered":"2024-08-31T05:28:59.661230+0000","last_clean":"2024-08-31T05:28:59.661230+0000","last_became_active":"2024-08-31T05:27:31.257549+0000","last_became_peered":"2024-08-31T05:27:31.257549+0000","last_unstale":"2024-08-31T05:28:59.661230+0000","last_undegraded":"2024-08-31T05:28:59.661230+0000","last_fullsized":"2024-08-31T05:28:59.661230+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:14:21.552372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.160234+0000","last_change":"2024-08-31T05:27:38.300359+0000","last_active":"2024-08-31T05:28:59.160234+0000","last_peered":"2024-08-31T05:28:59.160234+0000","last_clean":"2024-08-31T05:28:59.160234+0000","last_became_active":"2024-08-31T05:27:38.299704+0000","last_became_peered":"2024-08-31T05:27:38.299704+0000","last_unstale":"2024-08-31T05:28:59.160234+0000","last_undegraded":"2024-08-31T05:28:59.160234+0000","last_fullsized":"2024-08-31T05:28:59.160234+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:06:50.500384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"85'12","reported_seq":52,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.165814+0000","last_change":"2024-08-31T05:27:29.240652+0000","last_active":"2024-08-31T05:28:59.165814+0000","last_peered":"2024-08-31T05:28:59.165814+0000","last_clean":"2024-08-31T05:28:59.165814+0000","last_became_active":"2024-08-31T05:27:29.239432+0000","last_became_peered":"2024-08-31T05:27:29.239432+0000","last_unstale":"2024-08-31T05:28:59.165814+0000","last_undegraded":"2024-08-31T05:28:59.165814+0000","last_fullsized":"2024-08-31T05:28:59.165814+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:49:56.506299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.661552+0000","last_change":"2024-08-31T05:27:31.261784+0000","last_active":"2024-08-31T05:28:59.661552+0000","last_peered":"2024-08-31T05:28:59.661552+0000","last_clean":"2024-08-31T05:28:59.661552+0000","last_became_active":"2024-08-31T05:27:31.260045+0000","last_became_peered":"2024-08-31T05:27:31.260045+0000","last_unstale":"2024-08-31T05:28:59.661552+0000","last_undegraded":"2024-08-31T05:28:59.661552+0000","last_fullsized":"2024-08-31T05:28:59.661552+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:18:30.044052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.661334+0000","last_change":"2024-08-31T05:28:59.661205+0000","last_active":"2024-08-31T05:28:59.661334+0000","last_peered":"2024-08-31T05:28:59.661334+0000","last_clean":"2024-08-31T05:28:59.661334+0000","last_became_active":"2024-08-31T05:28:59.660637+0000","last_became_peered":"2024-08-31T05:28:59.660637+0000","last_unstale":"2024-08-31T05:28:59.661334+0000","last_undegraded":"2024-08-31T05:28:59.661334+0000","last_fullsized":"2024-08-31T05:28:59.661334+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:18:21.507475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,10],"acting":[4,3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"85'5","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.165725+0000","last_change":"2024-08-31T05:27:29.240341+0000","last_active":"2024-08-31T05:28:59.165725+0000","last_peered":"2024-08-31T05:28:59.165725+0000","last_clean":"2024-08-31T05:28:59.165725+0000","last_became_active":"2024-08-31T05:27:29.239944+0000","last_became_peered":"2024-08-31T05:27:29.239944+0000","last_unstale":"2024-08-31T05:28:59.165725+0000","last_undegraded":"2024-08-31T05:28:59.165725+0000","last_fullsized":"2024-08-31T05:28:59.165725+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:58:19.747559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161374+0000","last_change":"2024-08-31T05:27:31.265116+0000","last_active":"2024-08-31T05:28:59.161374+0000","last_peered":"2024-08-31T05:28:59.161374+0000","last_clean":"2024-08-31T05:28:59.161374+0000","last_became_active":"2024-08-31T05:27:31.264725+0000","last_became_peered":"2024-08-31T05:27:31.264725+0000","last_unstale":"2024-08-31T05:28:59.161374+0000","last_undegraded":"2024-08-31T05:28:59.161374+0000","last_fullsized":"2024-08-31T05:28:59.161374+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:44:45.831881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.160399+0000","last_change":"2024-08-31T05:27:38.298634+0000","last_active":"2024-08-31T05:28:59.160399+0000","last_peered":"2024-08-31T05:28:59.160399+0000","last_clean":"2024-08-31T05:28:59.160399+0000","last_became_active":"2024-08-31T05:27:38.298143+0000","last_became_peered":"2024-08-31T05:27:38.298143+0000","last_unstale":"2024-08-31T05:28:59.160399+0000","last_undegraded":"2024-08-31T05:28:59.160399+0000","last_fullsized":"2024-08-31T05:28:59.160399+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:51:25.639441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.489279+0000","last_change":"2024-08-31T05:27:31.259981+0000","last_active":"2024-08-31T05:28:59.489279+0000","last_peered":"2024-08-31T05:28:59.489279+0000","last_clean":"2024-08-31T05:28:59.489279+0000","last_became_active":"2024-08-31T05:27:31.259584+0000","last_became_peered":"2024-08-31T05:27:31.259584+0000","last_unstale":"2024-08-31T05:28:59.489279+0000","last_undegraded":"2024-08-31T05:28:59.489279+0000","last_fullsized":"2024-08-31T05:28:59.489279+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:52:29.853977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.481776+0000","last_change":"2024-08-31T05:27:58.514065+0000","last_active":"2024-08-31T05:28:59.481776+0000","last_peered":"2024-08-31T05:28:59.481776+0000","last_clean":"2024-08-31T05:28:59.481776+0000","last_became_active":"2024-08-31T05:27:58.506011+0000","last_became_peered":"2024-08-31T05:27:58.506011+0000","last_unstale":"2024-08-31T05:28:59.481776+0000","last_undegraded":"2024-08-31T05:28:59.481776+0000","last_fullsized":"2024-08-31T05:28:59.481776+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:25:55.610965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.160746+0000","last_change":"2024-08-31T05:27:38.293265+0000","last_active":"2024-08-31T05:28:59.160746+0000","last_peered":"2024-08-31T05:28:59.160746+0000","last_clean":"2024-08-31T05:28:59.160746+0000","last_became_active":"2024-08-31T05:27:38.292736+0000","last_became_peered":"2024-08-31T05:27:38.292736+0000","last_unstale":"2024-08-31T05:28:59.160746+0000","last_undegraded":"2024-08-31T05:28:59.160746+0000","last_fullsized":"2024-08-31T05:28:59.160746+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:51:25.853365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.159300+0000","last_change":"2024-08-31T05:27:31.252479+0000","last_active":"2024-08-31T05:28:59.159300+0000","last_peered":"2024-08-31T05:28:59.159300+0000","last_clean":"2024-08-31T05:28:59.159300+0000","last_became_active":"2024-08-31T05:27:31.252126+0000","last_became_peered":"2024-08-31T05:27:31.252126+0000","last_unstale":"2024-08-31T05:28:59.159300+0000","last_undegraded":"2024-08-31T05:28:59.159300+0000","last_fullsized":"2024-08-31T05:28:59.159300+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:24:40.864240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"85'3","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.481744+0000","last_change":"2024-08-31T05:27:58.508588+0000","last_active":"2024-08-31T05:28:59.481744+0000","last_peered":"2024-08-31T05:28:59.481744+0000","last_clean":"2024-08-31T05:28:59.481744+0000","last_became_active":"2024-08-31T05:27:58.508024+0000","last_became_peered":"2024-08-31T05:27:58.508024+0000","last_unstale":"2024-08-31T05:28:59.481744+0000","last_undegraded":"2024-08-31T05:28:59.481744+0000","last_fullsized":"2024-08-31T05:28:59.481744+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:32:33.222909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"85'1","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.160756+0000","last_change":"2024-08-31T05:27:38.299506+0000","last_active":"2024-08-31T05:28:59.160756+0000","last_peered":"2024-08-31T05:28:59.160756+0000","last_clean":"2024-08-31T05:28:59.160756+0000","last_became_active":"2024-08-31T05:27:38.298756+0000","last_became_peered":"2024-08-31T05:27:38.298756+0000","last_unstale":"2024-08-31T05:28:59.160756+0000","last_undegraded":"2024-08-31T05:28:59.160756+0000","last_fullsized":"2024-08-31T05:28:59.160756+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:25:18.115727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.481728+0000","last_change":"2024-08-31T05:27:31.249220+0000","last_active":"2024-08-31T05:28:59.481728+0000","last_peered":"2024-08-31T05:28:59.481728+0000","last_clean":"2024-08-31T05:28:59.481728+0000","last_became_active":"2024-08-31T05:27:31.248869+0000","last_became_peered":"2024-08-31T05:27:31.248869+0000","last_unstale":"2024-08-31T05:28:59.481728+0000","last_undegraded":"2024-08-31T05:28:59.481728+0000","last_fullsized":"2024-08-31T05:28:59.481728+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:43:13.463903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"85'7","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.159393+0000","last_change":"2024-08-31T05:27:29.235278+0000","last_active":"2024-08-31T05:28:59.159393+0000","last_peered":"2024-08-31T05:28:59.159393+0000","last_clean":"2024-08-31T05:28:59.159393+0000","last_became_active":"2024-08-31T05:27:29.234929+0000","last_became_peered":"2024-08-31T05:27:29.234929+0000","last_unstale":"2024-08-31T05:28:59.159393+0000","last_undegraded":"2024-08-31T05:28:59.159393+0000","last_fullsized":"2024-08-31T05:28:59.159393+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:49:55.867542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.657127+0000","last_change":"2024-08-31T05:27:38.293903+0000","last_active":"2024-08-31T05:28:59.657127+0000","last_peered":"2024-08-31T05:28:59.657127+0000","last_clean":"2024-08-31T05:28:59.657127+0000","last_became_active":"2024-08-31T05:27:38.290471+0000","last_became_peered":"2024-08-31T05:27:38.290471+0000","last_unstale":"2024-08-31T05:28:59.657127+0000","last_undegraded":"2024-08-31T05:28:59.657127+0000","last_fullsized":"2024-08-31T05:28:59.657127+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:04:36.573302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.165104+0000","last_change":"2024-08-31T05:27:31.252038+0000","last_active":"2024-08-31T05:28:59.165104+0000","last_peered":"2024-08-31T05:28:59.165104+0000","last_clean":"2024-08-31T05:28:59.165104+0000","last_became_active":"2024-08-31T05:27:31.251630+0000","last_became_peered":"2024-08-31T05:27:31.251630+0000","last_unstale":"2024-08-31T05:28:59.165104+0000","last_undegraded":"2024-08-31T05:28:59.165104+0000","last_fullsized":"2024-08-31T05:28:59.165104+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:10:39.778057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.661959+0000","last_change":"2024-08-31T05:27:29.280978+0000","last_active":"2024-08-31T05:28:59.661959+0000","last_peered":"2024-08-31T05:28:59.661959+0000","last_clean":"2024-08-31T05:28:59.661959+0000","last_became_active":"2024-08-31T05:27:29.280524+0000","last_became_peered":"2024-08-31T05:27:29.280524+0000","last_unstale":"2024-08-31T05:28:59.661959+0000","last_undegraded":"2024-08-31T05:28:59.661959+0000","last_fullsized":"2024-08-31T05:28:59.661959+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:56:57.441801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161017+0000","last_change":"2024-08-31T05:27:38.300947+0000","last_active":"2024-08-31T05:28:59.161017+0000","last_peered":"2024-08-31T05:28:59.161017+0000","last_clean":"2024-08-31T05:28:59.161017+0000","last_became_active":"2024-08-31T05:27:38.300044+0000","last_became_peered":"2024-08-31T05:27:38.300044+0000","last_unstale":"2024-08-31T05:28:59.161017+0000","last_undegraded":"2024-08-31T05:28:59.161017+0000","last_fullsized":"2024-08-31T05:28:59.161017+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:33:05.081601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.660009+0000","last_change":"2024-08-31T05:27:31.257782+0000","last_active":"2024-08-31T05:28:59.660009+0000","last_peered":"2024-08-31T05:28:59.660009+0000","last_clean":"2024-08-31T05:28:59.660009+0000","last_became_active":"2024-08-31T05:27:31.257360+0000","last_became_peered":"2024-08-31T05:27:31.257360+0000","last_unstale":"2024-08-31T05:28:59.660009+0000","last_undegraded":"2024-08-31T05:28:59.660009+0000","last_fullsized":"2024-08-31T05:28:59.660009+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:58:11.249925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"85'7","reported_seq":47,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161202+0000","last_change":"2024-08-31T05:27:29.392664+0000","last_active":"2024-08-31T05:28:59.161202+0000","last_peered":"2024-08-31T05:28:59.161202+0000","last_clean":"2024-08-31T05:28:59.161202+0000","last_became_active":"2024-08-31T05:27:29.392208+0000","last_became_peered":"2024-08-31T05:27:29.392208+0000","last_unstale":"2024-08-31T05:28:59.161202+0000","last_undegraded":"2024-08-31T05:28:59.161202+0000","last_fullsized":"2024-08-31T05:28:59.161202+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:51:34.981168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.661689+0000","last_change":"2024-08-31T05:27:38.293556+0000","last_active":"2024-08-31T05:28:59.661689+0000","last_peered":"2024-08-31T05:28:59.661689+0000","last_clean":"2024-08-31T05:28:59.661689+0000","last_became_active":"2024-08-31T05:27:38.292338+0000","last_became_peered":"2024-08-31T05:27:38.292338+0000","last_unstale":"2024-08-31T05:28:59.661689+0000","last_undegraded":"2024-08-31T05:28:59.661689+0000","last_fullsized":"2024-08-31T05:28:59.661689+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:13:46.376934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.159649+0000","last_change":"2024-08-31T05:27:31.247408+0000","last_active":"2024-08-31T05:28:59.159649+0000","last_peered":"2024-08-31T05:28:59.159649+0000","last_clean":"2024-08-31T05:28:59.159649+0000","last_became_active":"2024-08-31T05:27:31.247034+0000","last_became_peered":"2024-08-31T05:27:31.247034+0000","last_unstale":"2024-08-31T05:28:59.159649+0000","last_undegraded":"2024-08-31T05:28:59.159649+0000","last_fullsized":"2024-08-31T05:28:59.159649+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:42:08.350054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"85'15","reported_seq":54,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.657389+0000","last_change":"2024-08-31T05:27:29.235941+0000","last_active":"2024-08-31T05:28:59.657389+0000","last_peered":"2024-08-31T05:28:59.657389+0000","last_clean":"2024-08-31T05:28:59.657389+0000","last_became_active":"2024-08-31T05:27:29.235561+0000","last_became_peered":"2024-08-31T05:27:29.235561+0000","last_unstale":"2024-08-31T05:28:59.657389+0000","last_undegraded":"2024-08-31T05:28:59.657389+0000","last_fullsized":"2024-08-31T05:28:59.657389+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:29:34.551748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.159042+0000","last_change":"2024-08-31T05:27:38.286960+0000","last_active":"2024-08-31T05:28:59.159042+0000","last_peered":"2024-08-31T05:28:59.159042+0000","last_clean":"2024-08-31T05:28:59.159042+0000","last_became_active":"2024-08-31T05:27:38.286537+0000","last_became_peered":"2024-08-31T05:27:38.286537+0000","last_unstale":"2024-08-31T05:28:59.159042+0000","last_undegraded":"2024-08-31T05:28:59.159042+0000","last_fullsized":"2024-08-31T05:28:59.159042+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:55:00.656676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.162061+0000","last_change":"2024-08-31T05:27:31.245901+0000","last_active":"2024-08-31T05:28:59.162061+0000","last_peered":"2024-08-31T05:28:59.162061+0000","last_clean":"2024-08-31T05:28:59.162061+0000","last_became_active":"2024-08-31T05:27:31.245534+0000","last_became_peered":"2024-08-31T05:27:31.245534+0000","last_unstale":"2024-08-31T05:28:59.162061+0000","last_undegraded":"2024-08-31T05:28:59.162061+0000","last_fullsized":"2024-08-31T05:28:59.162061+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:26:35.876033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"85'4","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.165965+0000","last_change":"2024-08-31T05:27:29.280767+0000","last_active":"2024-08-31T05:28:59.165965+0000","last_peered":"2024-08-31T05:28:59.165965+0000","last_clean":"2024-08-31T05:28:59.165965+0000","last_became_active":"2024-08-31T05:27:29.280334+0000","last_became_peered":"2024-08-31T05:27:29.280334+0000","last_unstale":"2024-08-31T05:28:59.165965+0000","last_undegraded":"2024-08-31T05:28:59.165965+0000","last_fullsized":"2024-08-31T05:28:59.165965+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:25:20.250205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.481750+0000","last_change":"2024-08-31T05:27:38.296846+0000","last_active":"2024-08-31T05:28:59.481750+0000","last_peered":"2024-08-31T05:28:59.481750+0000","last_clean":"2024-08-31T05:28:59.481750+0000","last_became_active":"2024-08-31T05:27:38.295516+0000","last_became_peered":"2024-08-31T05:27:38.295516+0000","last_unstale":"2024-08-31T05:28:59.481750+0000","last_undegraded":"2024-08-31T05:28:59.481750+0000","last_fullsized":"2024-08-31T05:28:59.481750+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:30:51.110144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.658173+0000","last_change":"2024-08-31T05:27:31.246481+0000","last_active":"2024-08-31T05:28:59.658173+0000","last_peered":"2024-08-31T05:28:59.658173+0000","last_clean":"2024-08-31T05:28:59.658173+0000","last_became_active":"2024-08-31T05:27:31.246079+0000","last_became_peered":"2024-08-31T05:27:31.246079+0000","last_unstale":"2024-08-31T05:28:59.658173+0000","last_undegraded":"2024-08-31T05:28:59.658173+0000","last_fullsized":"2024-08-31T05:28:59.658173+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:25:42.536251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"85'1","reported_seq":40,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.656885+0000","last_change":"2024-08-31T05:27:29.281078+0000","last_active":"2024-08-31T05:28:59.656885+0000","last_peered":"2024-08-31T05:28:59.656885+0000","last_clean":"2024-08-31T05:28:59.656885+0000","last_became_active":"2024-08-31T05:27:29.280674+0000","last_became_peered":"2024-08-31T05:27:29.280674+0000","last_unstale":"2024-08-31T05:28:59.656885+0000","last_undegraded":"2024-08-31T05:28:59.656885+0000","last_fullsized":"2024-08-31T05:28:59.656885+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:04:03.576077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.664219+0000","last_change":"2024-08-31T05:28:59.664061+0000","last_active":"2024-08-31T05:28:59.664219+0000","last_peered":"2024-08-31T05:28:59.664219+0000","last_clean":"2024-08-31T05:28:59.664219+0000","last_became_active":"2024-08-31T05:28:59.663495+0000","last_became_peered":"2024-08-31T05:28:59.663495+0000","last_unstale":"2024-08-31T05:28:59.664219+0000","last_undegraded":"2024-08-31T05:28:59.664219+0000","last_fullsized":"2024-08-31T05:28:59.664219+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:51:38.112492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.658191+0000","last_change":"2024-08-31T05:27:31.251011+0000","last_active":"2024-08-31T05:28:59.658191+0000","last_peered":"2024-08-31T05:28:59.658191+0000","last_clean":"2024-08-31T05:28:59.658191+0000","last_became_active":"2024-08-31T05:27:31.250597+0000","last_became_peered":"2024-08-31T05:27:31.250597+0000","last_unstale":"2024-08-31T05:28:59.658191+0000","last_undegraded":"2024-08-31T05:28:59.658191+0000","last_fullsized":"2024-08-31T05:28:59.658191+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:13:30.858395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'6","reported_seq":100,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:03.663176+0000","last_change":"2024-08-31T05:27:29.242137+0000","last_active":"2024-08-31T05:29:03.663176+0000","last_peered":"2024-08-31T05:29:03.663176+0000","last_clean":"2024-08-31T05:29:03.663176+0000","last_became_active":"2024-08-31T05:27:29.241460+0000","last_became_peered":"2024-08-31T05:27:29.241460+0000","last_unstale":"2024-08-31T05:29:03.663176+0000","last_undegraded":"2024-08-31T05:29:03.663176+0000","last_fullsized":"2024-08-31T05:29:03.663176+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:40:59.174572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161890+0000","last_change":"2024-08-31T05:27:38.288643+0000","last_active":"2024-08-31T05:28:59.161890+0000","last_peered":"2024-08-31T05:28:59.161890+0000","last_clean":"2024-08-31T05:28:59.161890+0000","last_became_active":"2024-08-31T05:27:38.288235+0000","last_became_peered":"2024-08-31T05:27:38.288235+0000","last_unstale":"2024-08-31T05:28:59.161890+0000","last_undegraded":"2024-08-31T05:28:59.161890+0000","last_fullsized":"2024-08-31T05:28:59.161890+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:23:49.090990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.160708+0000","last_change":"2024-08-31T05:27:31.263326+0000","last_active":"2024-08-31T05:28:59.160708+0000","last_peered":"2024-08-31T05:28:59.160708+0000","last_clean":"2024-08-31T05:28:59.160708+0000","last_became_active":"2024-08-31T05:27:31.262864+0000","last_became_peered":"2024-08-31T05:27:31.262864+0000","last_unstale":"2024-08-31T05:28:59.160708+0000","last_undegraded":"2024-08-31T05:28:59.160708+0000","last_fullsized":"2024-08-31T05:28:59.160708+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:34:21.159545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'5","reported_seq":97,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:02.660608+0000","last_change":"2024-08-31T05:27:29.280829+0000","last_active":"2024-08-31T05:29:02.660608+0000","last_peered":"2024-08-31T05:29:02.660608+0000","last_clean":"2024-08-31T05:29:02.660608+0000","last_became_active":"2024-08-31T05:27:29.280469+0000","last_became_peered":"2024-08-31T05:27:29.280469+0000","last_unstale":"2024-08-31T05:29:02.660608+0000","last_undegraded":"2024-08-31T05:29:02.660608+0000","last_fullsized":"2024-08-31T05:29:02.660608+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:16:59.559680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161948+0000","last_change":"2024-08-31T05:27:38.290175+0000","last_active":"2024-08-31T05:28:59.161948+0000","last_peered":"2024-08-31T05:28:59.161948+0000","last_clean":"2024-08-31T05:28:59.161948+0000","last_became_active":"2024-08-31T05:27:38.289228+0000","last_became_peered":"2024-08-31T05:27:38.289228+0000","last_unstale":"2024-08-31T05:28:59.161948+0000","last_undegraded":"2024-08-31T05:28:59.161948+0000","last_fullsized":"2024-08-31T05:28:59.161948+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:26:07.251711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161126+0000","last_change":"2024-08-31T05:27:31.245446+0000","last_active":"2024-08-31T05:28:59.161126+0000","last_peered":"2024-08-31T05:28:59.161126+0000","last_clean":"2024-08-31T05:28:59.161126+0000","last_became_active":"2024-08-31T05:27:31.245099+0000","last_became_peered":"2024-08-31T05:27:31.245099+0000","last_unstale":"2024-08-31T05:28:59.161126+0000","last_undegraded":"2024-08-31T05:28:59.161126+0000","last_fullsized":"2024-08-31T05:28:59.161126+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:18:17.876796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'4","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.489786+0000","last_change":"2024-08-31T05:27:29.241333+0000","last_active":"2024-08-31T05:28:59.489786+0000","last_peered":"2024-08-31T05:28:59.489786+0000","last_clean":"2024-08-31T05:28:59.489786+0000","last_became_active":"2024-08-31T05:27:29.240963+0000","last_became_peered":"2024-08-31T05:27:29.240963+0000","last_unstale":"2024-08-31T05:28:59.489786+0000","last_undegraded":"2024-08-31T05:28:59.489786+0000","last_fullsized":"2024-08-31T05:28:59.489786+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:22:06.442824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161127+0000","last_change":"2024-08-31T05:27:38.287640+0000","last_active":"2024-08-31T05:28:59.161127+0000","last_peered":"2024-08-31T05:28:59.161127+0000","last_clean":"2024-08-31T05:28:59.161127+0000","last_became_active":"2024-08-31T05:27:38.286191+0000","last_became_peered":"2024-08-31T05:27:38.286191+0000","last_unstale":"2024-08-31T05:28:59.161127+0000","last_undegraded":"2024-08-31T05:28:59.161127+0000","last_fullsized":"2024-08-31T05:28:59.161127+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:57:23.535841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.656572+0000","last_change":"2024-08-31T05:27:58.506945+0000","last_active":"2024-08-31T05:28:59.656572+0000","last_peered":"2024-08-31T05:28:59.656572+0000","last_clean":"2024-08-31T05:28:59.656572+0000","last_became_active":"2024-08-31T05:27:58.506505+0000","last_became_peered":"2024-08-31T05:27:58.506505+0000","last_unstale":"2024-08-31T05:28:59.656572+0000","last_undegraded":"2024-08-31T05:28:59.656572+0000","last_fullsized":"2024-08-31T05:28:59.656572+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:16:09.541579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"85'6","reported_seq":48,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161666+0000","last_change":"2024-08-31T05:27:29.238351+0000","last_active":"2024-08-31T05:28:59.161666+0000","last_peered":"2024-08-31T05:28:59.161666+0000","last_clean":"2024-08-31T05:28:59.161666+0000","last_became_active":"2024-08-31T05:27:29.237940+0000","last_became_peered":"2024-08-31T05:27:29.237940+0000","last_unstale":"2024-08-31T05:28:59.161666+0000","last_undegraded":"2024-08-31T05:28:59.161666+0000","last_fullsized":"2024-08-31T05:28:59.161666+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:55:08.048966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":114,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.489971+0000","last_change":"2024-08-31T05:26:14.183718+0000","last_active":"2024-08-31T05:28:59.489971+0000","last_peered":"2024-08-31T05:28:59.489971+0000","last_clean":"2024-08-31T05:28:59.489971+0000","last_became_active":"2024-08-31T05:26:14.178188+0000","last_became_peered":"2024-08-31T05:26:14.178188+0000","last_unstale":"2024-08-31T05:28:59.489971+0000","last_undegraded":"2024-08-31T05:28:59.489971+0000","last_fullsized":"2024-08-31T05:28:59.489971+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:22:50.516233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:22:50.516233+0000","last_clean_scrub_stamp":"2024-08-31T05:22:50.516233+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:10:01.719715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"85'1","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.490210+0000","last_change":"2024-08-31T05:27:38.289721+0000","last_active":"2024-08-31T05:28:59.490210+0000","last_peered":"2024-08-31T05:28:59.490210+0000","last_clean":"2024-08-31T05:28:59.490210+0000","last_became_active":"2024-08-31T05:27:38.289165+0000","last_became_peered":"2024-08-31T05:27:38.289165+0000","last_unstale":"2024-08-31T05:28:59.490210+0000","last_undegraded":"2024-08-31T05:28:59.490210+0000","last_fullsized":"2024-08-31T05:28:59.490210+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:00:30.689093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.490247+0000","last_change":"2024-08-31T05:27:31.256262+0000","last_active":"2024-08-31T05:28:59.490247+0000","last_peered":"2024-08-31T05:28:59.490247+0000","last_clean":"2024-08-31T05:28:59.490247+0000","last_became_active":"2024-08-31T05:27:31.255644+0000","last_became_peered":"2024-08-31T05:27:31.255644+0000","last_unstale":"2024-08-31T05:28:59.490247+0000","last_undegraded":"2024-08-31T05:28:59.490247+0000","last_fullsized":"2024-08-31T05:28:59.490247+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:50:18.158645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'5","reported_seq":98,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:02.688444+0000","last_change":"2024-08-31T05:27:29.392666+0000","last_active":"2024-08-31T05:29:02.688444+0000","last_peered":"2024-08-31T05:29:02.688444+0000","last_clean":"2024-08-31T05:29:02.688444+0000","last_became_active":"2024-08-31T05:27:29.392153+0000","last_became_peered":"2024-08-31T05:27:29.392153+0000","last_unstale":"2024-08-31T05:29:02.688444+0000","last_undegraded":"2024-08-31T05:29:02.688444+0000","last_fullsized":"2024-08-31T05:29:02.688444+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:53:02.713022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.662519+0000","last_change":"2024-08-31T05:27:38.291459+0000","last_active":"2024-08-31T05:28:59.662519+0000","last_peered":"2024-08-31T05:28:59.662519+0000","last_clean":"2024-08-31T05:28:59.662519+0000","last_became_active":"2024-08-31T05:27:38.291013+0000","last_became_peered":"2024-08-31T05:27:38.291013+0000","last_unstale":"2024-08-31T05:28:59.662519+0000","last_undegraded":"2024-08-31T05:28:59.662519+0000","last_fullsized":"2024-08-31T05:28:59.662519+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:03:46.921137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.489301+0000","last_change":"2024-08-31T05:27:31.251641+0000","last_active":"2024-08-31T05:28:59.489301+0000","last_peered":"2024-08-31T05:28:59.489301+0000","last_clean":"2024-08-31T05:28:59.489301+0000","last_became_active":"2024-08-31T05:27:31.251242+0000","last_became_peered":"2024-08-31T05:27:31.251242+0000","last_unstale":"2024-08-31T05:28:59.489301+0000","last_undegraded":"2024-08-31T05:28:59.489301+0000","last_fullsized":"2024-08-31T05:28:59.489301+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:13:58.227136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'3","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161631+0000","last_change":"2024-08-31T05:27:29.238028+0000","last_active":"2024-08-31T05:28:59.161631+0000","last_peered":"2024-08-31T05:28:59.161631+0000","last_clean":"2024-08-31T05:28:59.161631+0000","last_became_active":"2024-08-31T05:27:29.237449+0000","last_became_peered":"2024-08-31T05:27:29.237449+0000","last_unstale":"2024-08-31T05:28:59.161631+0000","last_undegraded":"2024-08-31T05:28:59.161631+0000","last_fullsized":"2024-08-31T05:28:59.161631+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:13:15.447707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.660642+0000","last_change":"2024-08-31T05:27:38.294072+0000","last_active":"2024-08-31T05:28:59.660642+0000","last_peered":"2024-08-31T05:28:59.660642+0000","last_clean":"2024-08-31T05:28:59.660642+0000","last_became_active":"2024-08-31T05:27:38.293642+0000","last_became_peered":"2024-08-31T05:27:38.293642+0000","last_unstale":"2024-08-31T05:28:59.660642+0000","last_undegraded":"2024-08-31T05:28:59.660642+0000","last_fullsized":"2024-08-31T05:28:59.660642+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:57:41.854799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.489357+0000","last_change":"2024-08-31T05:27:31.253601+0000","last_active":"2024-08-31T05:28:59.489357+0000","last_peered":"2024-08-31T05:28:59.489357+0000","last_clean":"2024-08-31T05:28:59.489357+0000","last_became_active":"2024-08-31T05:27:31.253216+0000","last_became_peered":"2024-08-31T05:27:31.253216+0000","last_unstale":"2024-08-31T05:28:59.489357+0000","last_undegraded":"2024-08-31T05:28:59.489357+0000","last_fullsized":"2024-08-31T05:28:59.489357+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:46:12.757944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'5","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.162277+0000","last_change":"2024-08-31T05:27:29.236851+0000","last_active":"2024-08-31T05:28:59.162277+0000","last_peered":"2024-08-31T05:28:59.162277+0000","last_clean":"2024-08-31T05:28:59.162277+0000","last_became_active":"2024-08-31T05:27:29.236473+0000","last_became_peered":"2024-08-31T05:27:29.236473+0000","last_unstale":"2024-08-31T05:28:59.162277+0000","last_undegraded":"2024-08-31T05:28:59.162277+0000","last_fullsized":"2024-08-31T05:28:59.162277+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:01:23.838417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.160488+0000","last_change":"2024-08-31T05:27:38.290069+0000","last_active":"2024-08-31T05:28:59.160488+0000","last_peered":"2024-08-31T05:28:59.160488+0000","last_clean":"2024-08-31T05:28:59.160488+0000","last_became_active":"2024-08-31T05:27:38.289507+0000","last_became_peered":"2024-08-31T05:27:38.289507+0000","last_unstale":"2024-08-31T05:28:59.160488+0000","last_undegraded":"2024-08-31T05:28:59.160488+0000","last_fullsized":"2024-08-31T05:28:59.160488+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:24:33.326308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.481508+0000","last_change":"2024-08-31T05:27:31.252787+0000","last_active":"2024-08-31T05:28:59.481508+0000","last_peered":"2024-08-31T05:28:59.481508+0000","last_clean":"2024-08-31T05:28:59.481508+0000","last_became_active":"2024-08-31T05:27:31.252392+0000","last_became_peered":"2024-08-31T05:27:31.252392+0000","last_unstale":"2024-08-31T05:28:59.481508+0000","last_undegraded":"2024-08-31T05:28:59.481508+0000","last_fullsized":"2024-08-31T05:28:59.481508+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:47:06.613616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.166173+0000","last_change":"2024-08-31T05:27:29.240293+0000","last_active":"2024-08-31T05:28:59.166173+0000","last_peered":"2024-08-31T05:28:59.166173+0000","last_clean":"2024-08-31T05:28:59.166173+0000","last_became_active":"2024-08-31T05:27:29.239889+0000","last_became_peered":"2024-08-31T05:27:29.239889+0000","last_unstale":"2024-08-31T05:28:59.166173+0000","last_undegraded":"2024-08-31T05:28:59.166173+0000","last_fullsized":"2024-08-31T05:28:59.166173+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:55:03.524475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.160712+0000","last_change":"2024-08-31T05:27:38.290715+0000","last_active":"2024-08-31T05:28:59.160712+0000","last_peered":"2024-08-31T05:28:59.160712+0000","last_clean":"2024-08-31T05:28:59.160712+0000","last_became_active":"2024-08-31T05:27:38.290227+0000","last_became_peered":"2024-08-31T05:27:38.290227+0000","last_unstale":"2024-08-31T05:28:59.160712+0000","last_undegraded":"2024-08-31T05:28:59.160712+0000","last_fullsized":"2024-08-31T05:28:59.160712+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:09:38.349046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.160794+0000","last_change":"2024-08-31T05:27:31.265672+0000","last_active":"2024-08-31T05:28:59.160794+0000","last_peered":"2024-08-31T05:28:59.160794+0000","last_clean":"2024-08-31T05:28:59.160794+0000","last_became_active":"2024-08-31T05:27:31.265332+0000","last_became_peered":"2024-08-31T05:27:31.265332+0000","last_unstale":"2024-08-31T05:28:59.160794+0000","last_undegraded":"2024-08-31T05:28:59.160794+0000","last_fullsized":"2024-08-31T05:28:59.160794+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:45:01.868256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"85'17","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.165055+0000","last_change":"2024-08-31T05:27:29.281129+0000","last_active":"2024-08-31T05:28:59.165055+0000","last_peered":"2024-08-31T05:28:59.165055+0000","last_clean":"2024-08-31T05:28:59.165055+0000","last_became_active":"2024-08-31T05:27:29.280613+0000","last_became_peered":"2024-08-31T05:27:29.280613+0000","last_unstale":"2024-08-31T05:28:59.165055+0000","last_undegraded":"2024-08-31T05:28:59.165055+0000","last_fullsized":"2024-08-31T05:28:59.165055+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:17:28.103371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.483707+0000","last_change":"2024-08-31T05:28:59.483629+0000","last_active":"2024-08-31T05:28:59.483707+0000","last_peered":"2024-08-31T05:28:59.483707+0000","last_clean":"2024-08-31T05:28:59.483707+0000","last_became_active":"2024-08-31T05:28:59.483102+0000","last_became_peered":"2024-08-31T05:28:59.483102+0000","last_unstale":"2024-08-31T05:28:59.483707+0000","last_undegraded":"2024-08-31T05:28:59.483707+0000","last_fullsized":"2024-08-31T05:28:59.483707+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:54:18.587227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,8,11],"acting":[6,3,8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.489660+0000","last_change":"2024-08-31T05:27:58.505480+0000","last_active":"2024-08-31T05:28:59.489660+0000","last_peered":"2024-08-31T05:28:59.489660+0000","last_clean":"2024-08-31T05:28:59.489660+0000","last_became_active":"2024-08-31T05:27:58.504773+0000","last_became_peered":"2024-08-31T05:27:58.504773+0000","last_unstale":"2024-08-31T05:28:59.489660+0000","last_undegraded":"2024-08-31T05:28:59.489660+0000","last_fullsized":"2024-08-31T05:28:59.489660+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:48:59.979443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'5","reported_seq":98,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:02.661485+0000","last_change":"2024-08-31T05:27:29.239308+0000","last_active":"2024-08-31T05:29:02.661485+0000","last_peered":"2024-08-31T05:29:02.661485+0000","last_clean":"2024-08-31T05:29:02.661485+0000","last_became_active":"2024-08-31T05:27:29.238793+0000","last_became_peered":"2024-08-31T05:27:29.238793+0000","last_unstale":"2024-08-31T05:29:02.661485+0000","last_undegraded":"2024-08-31T05:29:02.661485+0000","last_fullsized":"2024-08-31T05:29:02.661485+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:20:47.837021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":55,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.657165+0000","last_change":"2024-08-31T05:27:38.287260+0000","last_active":"2024-08-31T05:28:59.657165+0000","last_peered":"2024-08-31T05:28:59.657165+0000","last_clean":"2024-08-31T05:28:59.657165+0000","last_became_active":"2024-08-31T05:27:38.286250+0000","last_became_peered":"2024-08-31T05:27:38.286250+0000","last_unstale":"2024-08-31T05:28:59.657165+0000","last_undegraded":"2024-08-31T05:28:59.657165+0000","last_fullsized":"2024-08-31T05:28:59.657165+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:17:55.530114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.489260+0000","last_change":"2024-08-31T05:27:31.251152+0000","last_active":"2024-08-31T05:28:59.489260+0000","last_peered":"2024-08-31T05:28:59.489260+0000","last_clean":"2024-08-31T05:28:59.489260+0000","last_became_active":"2024-08-31T05:27:31.250686+0000","last_became_peered":"2024-08-31T05:27:31.250686+0000","last_unstale":"2024-08-31T05:28:59.489260+0000","last_undegraded":"2024-08-31T05:28:59.489260+0000","last_fullsized":"2024-08-31T05:28:59.489260+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:03:37.359332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"85'5","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.160924+0000","last_change":"2024-08-31T05:27:29.237404+0000","last_active":"2024-08-31T05:28:59.160924+0000","last_peered":"2024-08-31T05:28:59.160924+0000","last_clean":"2024-08-31T05:28:59.160924+0000","last_became_active":"2024-08-31T05:27:29.236695+0000","last_became_peered":"2024-08-31T05:27:29.236695+0000","last_unstale":"2024-08-31T05:28:59.160924+0000","last_undegraded":"2024-08-31T05:28:59.160924+0000","last_fullsized":"2024-08-31T05:28:59.160924+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:25:05.174288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.481862+0000","last_change":"2024-08-31T05:27:38.296553+0000","last_active":"2024-08-31T05:28:59.481862+0000","last_peered":"2024-08-31T05:28:59.481862+0000","last_clean":"2024-08-31T05:28:59.481862+0000","last_became_active":"2024-08-31T05:27:38.296118+0000","last_became_peered":"2024-08-31T05:27:38.296118+0000","last_unstale":"2024-08-31T05:28:59.481862+0000","last_undegraded":"2024-08-31T05:28:59.481862+0000","last_fullsized":"2024-08-31T05:28:59.481862+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:10:41.334260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161383+0000","last_change":"2024-08-31T05:27:31.250584+0000","last_active":"2024-08-31T05:28:59.161383+0000","last_peered":"2024-08-31T05:28:59.161383+0000","last_clean":"2024-08-31T05:28:59.161383+0000","last_became_active":"2024-08-31T05:27:31.250234+0000","last_became_peered":"2024-08-31T05:27:31.250234+0000","last_unstale":"2024-08-31T05:28:59.161383+0000","last_undegraded":"2024-08-31T05:28:59.161383+0000","last_fullsized":"2024-08-31T05:28:59.161383+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:00:39.648236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"85'9","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.661515+0000","last_change":"2024-08-31T05:27:29.237956+0000","last_active":"2024-08-31T05:28:59.661515+0000","last_peered":"2024-08-31T05:28:59.661515+0000","last_clean":"2024-08-31T05:28:59.661515+0000","last_became_active":"2024-08-31T05:27:29.237510+0000","last_became_peered":"2024-08-31T05:27:29.237510+0000","last_unstale":"2024-08-31T05:28:59.661515+0000","last_undegraded":"2024-08-31T05:28:59.661515+0000","last_fullsized":"2024-08-31T05:28:59.661515+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:18:44.295298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161323+0000","last_change":"2024-08-31T05:27:38.289472+0000","last_active":"2024-08-31T05:28:59.161323+0000","last_peered":"2024-08-31T05:28:59.161323+0000","last_clean":"2024-08-31T05:28:59.161323+0000","last_became_active":"2024-08-31T05:27:38.288809+0000","last_became_peered":"2024-08-31T05:27:38.288809+0000","last_unstale":"2024-08-31T05:28:59.161323+0000","last_undegraded":"2024-08-31T05:28:59.161323+0000","last_fullsized":"2024-08-31T05:28:59.161323+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:17:06.430110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.165669+0000","last_change":"2024-08-31T05:27:31.258103+0000","last_active":"2024-08-31T05:28:59.165669+0000","last_peered":"2024-08-31T05:28:59.165669+0000","last_clean":"2024-08-31T05:28:59.165669+0000","last_became_active":"2024-08-31T05:27:31.257257+0000","last_became_peered":"2024-08-31T05:27:31.257257+0000","last_unstale":"2024-08-31T05:28:59.165669+0000","last_undegraded":"2024-08-31T05:28:59.165669+0000","last_fullsized":"2024-08-31T05:28:59.165669+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:16:01.309646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"85'35","reported_seq":184,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:02.664214+0000","last_change":"2024-08-31T05:27:29.241129+0000","last_active":"2024-08-31T05:29:02.664214+0000","last_peered":"2024-08-31T05:29:02.664214+0000","last_clean":"2024-08-31T05:29:02.664214+0000","last_became_active":"2024-08-31T05:27:29.240708+0000","last_became_peered":"2024-08-31T05:27:29.240708+0000","last_unstale":"2024-08-31T05:29:02.664214+0000","last_undegraded":"2024-08-31T05:29:02.664214+0000","last_fullsized":"2024-08-31T05:29:02.664214+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:20:10.127588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62072,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":110,"num_read_kb":116,"num_write":37,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.656759+0000","last_change":"2024-08-31T05:27:38.291037+0000","last_active":"2024-08-31T05:28:59.656759+0000","last_peered":"2024-08-31T05:28:59.656759+0000","last_clean":"2024-08-31T05:28:59.656759+0000","last_became_active":"2024-08-31T05:27:38.290592+0000","last_became_peered":"2024-08-31T05:27:38.290592+0000","last_unstale":"2024-08-31T05:28:59.656759+0000","last_undegraded":"2024-08-31T05:28:59.656759+0000","last_fullsized":"2024-08-31T05:28:59.656759+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:12:56.391784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.662797+0000","last_change":"2024-08-31T05:27:58.508403+0000","last_active":"2024-08-31T05:28:59.662797+0000","last_peered":"2024-08-31T05:28:59.662797+0000","last_clean":"2024-08-31T05:28:59.662797+0000","last_became_active":"2024-08-31T05:27:58.507918+0000","last_became_peered":"2024-08-31T05:27:58.507918+0000","last_unstale":"2024-08-31T05:28:59.662797+0000","last_undegraded":"2024-08-31T05:28:59.662797+0000","last_fullsized":"2024-08-31T05:28:59.662797+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:47:54.479249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,7],"acting":[1,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"85'5","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161508+0000","last_change":"2024-08-31T05:27:29.281231+0000","last_active":"2024-08-31T05:28:59.161508+0000","last_peered":"2024-08-31T05:28:59.161508+0000","last_clean":"2024-08-31T05:28:59.161508+0000","last_became_active":"2024-08-31T05:27:29.280748+0000","last_became_peered":"2024-08-31T05:27:29.280748+0000","last_unstale":"2024-08-31T05:28:59.161508+0000","last_undegraded":"2024-08-31T05:28:59.161508+0000","last_fullsized":"2024-08-31T05:28:59.161508+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:43:44.783595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.663952+0000","last_change":"2024-08-31T05:28:59.663824+0000","last_active":"2024-08-31T05:28:59.663952+0000","last_peered":"2024-08-31T05:28:59.663952+0000","last_clean":"2024-08-31T05:28:59.663952+0000","last_became_active":"2024-08-31T05:28:59.663270+0000","last_became_peered":"2024-08-31T05:28:59.663270+0000","last_unstale":"2024-08-31T05:28:59.663952+0000","last_undegraded":"2024-08-31T05:28:59.663952+0000","last_fullsized":"2024-08-31T05:28:59.663952+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:23:26.836655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.660028+0000","last_change":"2024-08-31T05:27:31.258030+0000","last_active":"2024-08-31T05:28:59.660028+0000","last_peered":"2024-08-31T05:28:59.660028+0000","last_clean":"2024-08-31T05:28:59.660028+0000","last_became_active":"2024-08-31T05:27:31.257410+0000","last_became_peered":"2024-08-31T05:27:31.257410+0000","last_unstale":"2024-08-31T05:28:59.660028+0000","last_undegraded":"2024-08-31T05:28:59.660028+0000","last_fullsized":"2024-08-31T05:28:59.660028+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:48:27.716531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"85'4","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.490273+0000","last_change":"2024-08-31T05:27:29.239560+0000","last_active":"2024-08-31T05:28:59.490273+0000","last_peered":"2024-08-31T05:28:59.490273+0000","last_clean":"2024-08-31T05:28:59.490273+0000","last_became_active":"2024-08-31T05:27:29.239154+0000","last_became_peered":"2024-08-31T05:27:29.239154+0000","last_unstale":"2024-08-31T05:28:59.490273+0000","last_undegraded":"2024-08-31T05:28:59.490273+0000","last_fullsized":"2024-08-31T05:28:59.490273+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:29:36.983690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.656552+0000","last_change":"2024-08-31T05:27:38.297596+0000","last_active":"2024-08-31T05:28:59.656552+0000","last_peered":"2024-08-31T05:28:59.656552+0000","last_clean":"2024-08-31T05:28:59.656552+0000","last_became_active":"2024-08-31T05:27:38.295127+0000","last_became_peered":"2024-08-31T05:27:38.295127+0000","last_unstale":"2024-08-31T05:28:59.656552+0000","last_undegraded":"2024-08-31T05:28:59.656552+0000","last_fullsized":"2024-08-31T05:28:59.656552+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:50:09.363872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.663130+0000","last_change":"2024-08-31T05:27:31.262036+0000","last_active":"2024-08-31T05:28:59.663130+0000","last_peered":"2024-08-31T05:28:59.663130+0000","last_clean":"2024-08-31T05:28:59.663130+0000","last_became_active":"2024-08-31T05:27:31.261589+0000","last_became_peered":"2024-08-31T05:27:31.261589+0000","last_unstale":"2024-08-31T05:28:59.663130+0000","last_undegraded":"2024-08-31T05:28:59.663130+0000","last_fullsized":"2024-08-31T05:28:59.663130+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:24:17.677639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"85'4","reported_seq":145,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:02.664482+0000","last_change":"2024-08-31T05:27:29.233381+0000","last_active":"2024-08-31T05:29:02.664482+0000","last_peered":"2024-08-31T05:29:02.664482+0000","last_clean":"2024-08-31T05:29:02.664482+0000","last_became_active":"2024-08-31T05:27:29.232959+0000","last_became_peered":"2024-08-31T05:27:29.232959+0000","last_unstale":"2024-08-31T05:29:02.664482+0000","last_undegraded":"2024-08-31T05:29:02.664482+0000","last_fullsized":"2024-08-31T05:29:02.664482+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:50:16.901373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.159157+0000","last_change":"2024-08-31T05:27:38.288798+0000","last_active":"2024-08-31T05:28:59.159157+0000","last_peered":"2024-08-31T05:28:59.159157+0000","last_clean":"2024-08-31T05:28:59.159157+0000","last_became_active":"2024-08-31T05:27:38.288369+0000","last_became_peered":"2024-08-31T05:27:38.288369+0000","last_unstale":"2024-08-31T05:28:59.159157+0000","last_undegraded":"2024-08-31T05:28:59.159157+0000","last_fullsized":"2024-08-31T05:28:59.159157+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:52:45.680480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.660805+0000","last_change":"2024-08-31T05:27:38.290029+0000","last_active":"2024-08-31T05:28:59.660805+0000","last_peered":"2024-08-31T05:28:59.660805+0000","last_clean":"2024-08-31T05:28:59.660805+0000","last_became_active":"2024-08-31T05:27:38.289638+0000","last_became_peered":"2024-08-31T05:27:38.289638+0000","last_unstale":"2024-08-31T05:28:59.660805+0000","last_undegraded":"2024-08-31T05:28:59.660805+0000","last_fullsized":"2024-08-31T05:28:59.660805+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:10:34.521418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.656378+0000","last_change":"2024-08-31T05:27:31.241057+0000","last_active":"2024-08-31T05:28:59.656378+0000","last_peered":"2024-08-31T05:28:59.656378+0000","last_clean":"2024-08-31T05:28:59.656378+0000","last_became_active":"2024-08-31T05:27:31.240660+0000","last_became_peered":"2024-08-31T05:27:31.240660+0000","last_unstale":"2024-08-31T05:28:59.656378+0000","last_undegraded":"2024-08-31T05:28:59.656378+0000","last_fullsized":"2024-08-31T05:28:59.656378+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:16:49.730980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"85'3","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.160858+0000","last_change":"2024-08-31T05:27:29.240293+0000","last_active":"2024-08-31T05:28:59.160858+0000","last_peered":"2024-08-31T05:28:59.160858+0000","last_clean":"2024-08-31T05:28:59.160858+0000","last_became_active":"2024-08-31T05:27:29.239889+0000","last_became_peered":"2024-08-31T05:27:29.239889+0000","last_unstale":"2024-08-31T05:28:59.160858+0000","last_undegraded":"2024-08-31T05:28:59.160858+0000","last_fullsized":"2024-08-31T05:28:59.160858+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:20:49.121008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.481999+0000","last_change":"2024-08-31T05:27:38.294174+0000","last_active":"2024-08-31T05:28:59.481999+0000","last_peered":"2024-08-31T05:28:59.481999+0000","last_clean":"2024-08-31T05:28:59.481999+0000","last_became_active":"2024-08-31T05:27:38.293747+0000","last_became_peered":"2024-08-31T05:27:38.293747+0000","last_unstale":"2024-08-31T05:28:59.481999+0000","last_undegraded":"2024-08-31T05:28:59.481999+0000","last_fullsized":"2024-08-31T05:28:59.481999+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:35:46.124473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.159200+0000","last_change":"2024-08-31T05:27:31.244942+0000","last_active":"2024-08-31T05:28:59.159200+0000","last_peered":"2024-08-31T05:28:59.159200+0000","last_clean":"2024-08-31T05:28:59.159200+0000","last_became_active":"2024-08-31T05:27:31.244608+0000","last_became_peered":"2024-08-31T05:27:31.244608+0000","last_unstale":"2024-08-31T05:28:59.159200+0000","last_undegraded":"2024-08-31T05:28:59.159200+0000","last_fullsized":"2024-08-31T05:28:59.159200+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:50:13.651172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"85'3","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161085+0000","last_change":"2024-08-31T05:27:29.236832+0000","last_active":"2024-08-31T05:28:59.161085+0000","last_peered":"2024-08-31T05:28:59.161085+0000","last_clean":"2024-08-31T05:28:59.161085+0000","last_became_active":"2024-08-31T05:27:29.236326+0000","last_became_peered":"2024-08-31T05:27:29.236326+0000","last_unstale":"2024-08-31T05:28:59.161085+0000","last_undegraded":"2024-08-31T05:28:59.161085+0000","last_fullsized":"2024-08-31T05:28:59.161085+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:43:26.199499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"85'7","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.659350+0000","last_change":"2024-08-31T05:27:29.237409+0000","last_active":"2024-08-31T05:28:59.659350+0000","last_peered":"2024-08-31T05:28:59.659350+0000","last_clean":"2024-08-31T05:28:59.659350+0000","last_became_active":"2024-08-31T05:27:29.236928+0000","last_became_peered":"2024-08-31T05:27:29.236928+0000","last_unstale":"2024-08-31T05:28:59.659350+0000","last_undegraded":"2024-08-31T05:28:59.659350+0000","last_fullsized":"2024-08-31T05:28:59.659350+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:07:53.917242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161147+0000","last_change":"2024-08-31T05:27:31.263005+0000","last_active":"2024-08-31T05:28:59.161147+0000","last_peered":"2024-08-31T05:28:59.161147+0000","last_clean":"2024-08-31T05:28:59.161147+0000","last_became_active":"2024-08-31T05:27:31.262638+0000","last_became_peered":"2024-08-31T05:27:31.262638+0000","last_unstale":"2024-08-31T05:28:59.161147+0000","last_undegraded":"2024-08-31T05:28:59.161147+0000","last_fullsized":"2024-08-31T05:28:59.161147+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:35:06.094346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.661429+0000","last_change":"2024-08-31T05:27:38.293067+0000","last_active":"2024-08-31T05:28:59.661429+0000","last_peered":"2024-08-31T05:28:59.661429+0000","last_clean":"2024-08-31T05:28:59.661429+0000","last_became_active":"2024-08-31T05:27:38.292413+0000","last_became_peered":"2024-08-31T05:27:38.292413+0000","last_unstale":"2024-08-31T05:28:59.661429+0000","last_undegraded":"2024-08-31T05:28:59.661429+0000","last_fullsized":"2024-08-31T05:28:59.661429+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:26:12.248341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"85'6","reported_seq":107,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:02.665023+0000","last_change":"2024-08-31T05:27:58.652458+0000","last_active":"2024-08-31T05:29:02.665023+0000","last_peered":"2024-08-31T05:29:02.665023+0000","last_clean":"2024-08-31T05:29:02.665023+0000","last_became_active":"2024-08-31T05:27:58.652037+0000","last_became_peered":"2024-08-31T05:27:58.652037+0000","last_unstale":"2024-08-31T05:29:02.665023+0000","last_undegraded":"2024-08-31T05:29:02.665023+0000","last_fullsized":"2024-08-31T05:29:02.665023+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:44:45.839429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.165439+0000","last_change":"2024-08-31T05:27:31.253835+0000","last_active":"2024-08-31T05:28:59.165439+0000","last_peered":"2024-08-31T05:28:59.165439+0000","last_clean":"2024-08-31T05:28:59.165439+0000","last_became_active":"2024-08-31T05:27:31.252828+0000","last_became_peered":"2024-08-31T05:27:31.252828+0000","last_unstale":"2024-08-31T05:28:59.165439+0000","last_undegraded":"2024-08-31T05:28:59.165439+0000","last_fullsized":"2024-08-31T05:28:59.165439+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:59:29.987345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.661608+0000","last_change":"2024-08-31T05:27:38.292690+0000","last_active":"2024-08-31T05:28:59.661608+0000","last_peered":"2024-08-31T05:28:59.661608+0000","last_clean":"2024-08-31T05:28:59.661608+0000","last_became_active":"2024-08-31T05:27:38.292195+0000","last_became_peered":"2024-08-31T05:27:38.292195+0000","last_unstale":"2024-08-31T05:28:59.661608+0000","last_undegraded":"2024-08-31T05:28:59.661608+0000","last_fullsized":"2024-08-31T05:28:59.661608+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:50:06.142879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.481425+0000","last_change":"2024-08-31T05:27:31.253706+0000","last_active":"2024-08-31T05:28:59.481425+0000","last_peered":"2024-08-31T05:28:59.481425+0000","last_clean":"2024-08-31T05:28:59.481425+0000","last_became_active":"2024-08-31T05:27:31.253343+0000","last_became_peered":"2024-08-31T05:27:31.253343+0000","last_unstale":"2024-08-31T05:28:59.481425+0000","last_undegraded":"2024-08-31T05:28:59.481425+0000","last_fullsized":"2024-08-31T05:28:59.481425+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:40:28.318153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.661731+0000","last_change":"2024-08-31T05:27:58.651669+0000","last_active":"2024-08-31T05:28:59.661731+0000","last_peered":"2024-08-31T05:28:59.661731+0000","last_clean":"2024-08-31T05:28:59.661731+0000","last_became_active":"2024-08-31T05:27:58.651273+0000","last_became_peered":"2024-08-31T05:27:58.651273+0000","last_unstale":"2024-08-31T05:28:59.661731+0000","last_undegraded":"2024-08-31T05:28:59.661731+0000","last_fullsized":"2024-08-31T05:28:59.661731+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:37:42.960124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.660502+0000","last_change":"2024-08-31T05:27:31.257648+0000","last_active":"2024-08-31T05:28:59.660502+0000","last_peered":"2024-08-31T05:28:59.660502+0000","last_clean":"2024-08-31T05:28:59.660502+0000","last_became_active":"2024-08-31T05:27:31.257140+0000","last_became_peered":"2024-08-31T05:27:31.257140+0000","last_unstale":"2024-08-31T05:28:59.660502+0000","last_undegraded":"2024-08-31T05:28:59.660502+0000","last_fullsized":"2024-08-31T05:28:59.660502+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:02:15.249225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.659970+0000","last_change":"2024-08-31T05:27:31.264968+0000","last_active":"2024-08-31T05:28:59.659970+0000","last_peered":"2024-08-31T05:28:59.659970+0000","last_clean":"2024-08-31T05:28:59.659970+0000","last_became_active":"2024-08-31T05:27:31.264629+0000","last_became_peered":"2024-08-31T05:27:31.264629+0000","last_unstale":"2024-08-31T05:28:59.659970+0000","last_undegraded":"2024-08-31T05:28:59.659970+0000","last_fullsized":"2024-08-31T05:28:59.659970+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:28:15.283607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.162118+0000","last_change":"2024-08-31T05:27:31.252358+0000","last_active":"2024-08-31T05:28:59.162118+0000","last_peered":"2024-08-31T05:28:59.162118+0000","last_clean":"2024-08-31T05:28:59.162118+0000","last_became_active":"2024-08-31T05:27:31.252013+0000","last_became_peered":"2024-08-31T05:27:31.252013+0000","last_unstale":"2024-08-31T05:28:59.162118+0000","last_undegraded":"2024-08-31T05:28:59.162118+0000","last_fullsized":"2024-08-31T05:28:59.162118+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:48:47.287168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.481430+0000","last_change":"2024-08-31T05:27:31.262626+0000","last_active":"2024-08-31T05:28:59.481430+0000","last_peered":"2024-08-31T05:28:59.481430+0000","last_clean":"2024-08-31T05:28:59.481430+0000","last_became_active":"2024-08-31T05:27:31.262190+0000","last_became_peered":"2024-08-31T05:27:31.262190+0000","last_unstale":"2024-08-31T05:28:59.481430+0000","last_undegraded":"2024-08-31T05:28:59.481430+0000","last_fullsized":"2024-08-31T05:28:59.481430+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:39:19.454606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.660542+0000","last_change":"2024-08-31T05:27:31.254482+0000","last_active":"2024-08-31T05:28:59.660542+0000","last_peered":"2024-08-31T05:28:59.660542+0000","last_clean":"2024-08-31T05:28:59.660542+0000","last_became_active":"2024-08-31T05:27:31.254103+0000","last_became_peered":"2024-08-31T05:27:31.254103+0000","last_unstale":"2024-08-31T05:28:59.660542+0000","last_undegraded":"2024-08-31T05:28:59.660542+0000","last_fullsized":"2024-08-31T05:28:59.660542+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:20:57.333359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.159513+0000","last_change":"2024-08-31T05:27:58.505928+0000","last_active":"2024-08-31T05:28:59.159513+0000","last_peered":"2024-08-31T05:28:59.159513+0000","last_clean":"2024-08-31T05:28:59.159513+0000","last_became_active":"2024-08-31T05:27:58.505527+0000","last_became_peered":"2024-08-31T05:27:58.505527+0000","last_unstale":"2024-08-31T05:28:59.159513+0000","last_undegraded":"2024-08-31T05:28:59.159513+0000","last_fullsized":"2024-08-31T05:28:59.159513+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:44:30.754350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.160624+0000","last_change":"2024-08-31T05:27:31.262385+0000","last_active":"2024-08-31T05:28:59.160624+0000","last_peered":"2024-08-31T05:28:59.160624+0000","last_clean":"2024-08-31T05:28:59.160624+0000","last_became_active":"2024-08-31T05:27:31.262089+0000","last_became_peered":"2024-08-31T05:27:31.262089+0000","last_unstale":"2024-08-31T05:28:59.160624+0000","last_undegraded":"2024-08-31T05:28:59.160624+0000","last_fullsized":"2024-08-31T05:28:59.160624+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:50:17.172462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.159224+0000","last_change":"2024-08-31T05:27:31.249162+0000","last_active":"2024-08-31T05:28:59.159224+0000","last_peered":"2024-08-31T05:28:59.159224+0000","last_clean":"2024-08-31T05:28:59.159224+0000","last_became_active":"2024-08-31T05:27:31.248803+0000","last_became_peered":"2024-08-31T05:27:31.248803+0000","last_unstale":"2024-08-31T05:28:59.159224+0000","last_undegraded":"2024-08-31T05:28:59.159224+0000","last_fullsized":"2024-08-31T05:28:59.159224+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:18:05.449612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.661991+0000","last_change":"2024-08-31T05:27:31.258983+0000","last_active":"2024-08-31T05:28:59.661991+0000","last_peered":"2024-08-31T05:28:59.661991+0000","last_clean":"2024-08-31T05:28:59.661991+0000","last_became_active":"2024-08-31T05:27:31.258480+0000","last_became_peered":"2024-08-31T05:27:31.258480+0000","last_unstale":"2024-08-31T05:28:59.661991+0000","last_undegraded":"2024-08-31T05:28:59.661991+0000","last_fullsized":"2024-08-31T05:28:59.661991+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:57:34.589281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161481+0000","last_change":"2024-08-31T05:27:31.252561+0000","last_active":"2024-08-31T05:28:59.161481+0000","last_peered":"2024-08-31T05:28:59.161481+0000","last_clean":"2024-08-31T05:28:59.161481+0000","last_became_active":"2024-08-31T05:27:31.251963+0000","last_became_peered":"2024-08-31T05:27:31.251963+0000","last_unstale":"2024-08-31T05:28:59.161481+0000","last_undegraded":"2024-08-31T05:28:59.161481+0000","last_fullsized":"2024-08-31T05:28:59.161481+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:17:45.244329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.481388+0000","last_change":"2024-08-31T05:27:31.257298+0000","last_active":"2024-08-31T05:28:59.481388+0000","last_peered":"2024-08-31T05:28:59.481388+0000","last_clean":"2024-08-31T05:28:59.481388+0000","last_became_active":"2024-08-31T05:27:31.256935+0000","last_became_peered":"2024-08-31T05:27:31.256935+0000","last_unstale":"2024-08-31T05:28:59.481388+0000","last_undegraded":"2024-08-31T05:28:59.481388+0000","last_fullsized":"2024-08-31T05:28:59.481388+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:07:32.876328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.660555+0000","last_change":"2024-08-31T05:27:31.248456+0000","last_active":"2024-08-31T05:28:59.660555+0000","last_peered":"2024-08-31T05:28:59.660555+0000","last_clean":"2024-08-31T05:28:59.660555+0000","last_became_active":"2024-08-31T05:27:31.248060+0000","last_became_peered":"2024-08-31T05:27:31.248060+0000","last_unstale":"2024-08-31T05:28:59.660555+0000","last_undegraded":"2024-08-31T05:28:59.660555+0000","last_fullsized":"2024-08-31T05:28:59.660555+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:29:35.817409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.657320+0000","last_change":"2024-08-31T05:27:31.251345+0000","last_active":"2024-08-31T05:28:59.657320+0000","last_peered":"2024-08-31T05:28:59.657320+0000","last_clean":"2024-08-31T05:28:59.657320+0000","last_became_active":"2024-08-31T05:27:31.251002+0000","last_became_peered":"2024-08-31T05:27:31.251002+0000","last_unstale":"2024-08-31T05:28:59.657320+0000","last_undegraded":"2024-08-31T05:28:59.657320+0000","last_fullsized":"2024-08-31T05:28:59.657320+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:35:24.564897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.482395+0000","last_change":"2024-08-31T05:27:31.260681+0000","last_active":"2024-08-31T05:28:59.482395+0000","last_peered":"2024-08-31T05:28:59.482395+0000","last_clean":"2024-08-31T05:28:59.482395+0000","last_became_active":"2024-08-31T05:27:31.259445+0000","last_became_peered":"2024-08-31T05:27:31.259445+0000","last_unstale":"2024-08-31T05:28:59.482395+0000","last_undegraded":"2024-08-31T05:28:59.482395+0000","last_fullsized":"2024-08-31T05:28:59.482395+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:41:43.480946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.661479+0000","last_change":"2024-08-31T05:27:31.263950+0000","last_active":"2024-08-31T05:28:59.661479+0000","last_peered":"2024-08-31T05:28:59.661479+0000","last_clean":"2024-08-31T05:28:59.661479+0000","last_became_active":"2024-08-31T05:27:31.263568+0000","last_became_peered":"2024-08-31T05:27:31.263568+0000","last_unstale":"2024-08-31T05:28:59.661479+0000","last_undegraded":"2024-08-31T05:28:59.661479+0000","last_fullsized":"2024-08-31T05:28:59.661479+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:50:05.111796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.660326+0000","last_change":"2024-08-31T05:27:58.508829+0000","last_active":"2024-08-31T05:28:59.660326+0000","last_peered":"2024-08-31T05:28:59.660326+0000","last_clean":"2024-08-31T05:28:59.660326+0000","last_became_active":"2024-08-31T05:27:58.508378+0000","last_became_peered":"2024-08-31T05:27:58.508378+0000","last_unstale":"2024-08-31T05:28:59.660326+0000","last_undegraded":"2024-08-31T05:28:59.660326+0000","last_fullsized":"2024-08-31T05:28:59.660326+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:05:46.254003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.659965+0000","last_change":"2024-08-31T05:27:31.261012+0000","last_active":"2024-08-31T05:28:59.659965+0000","last_peered":"2024-08-31T05:28:59.659965+0000","last_clean":"2024-08-31T05:28:59.659965+0000","last_became_active":"2024-08-31T05:27:31.259373+0000","last_became_peered":"2024-08-31T05:27:31.259373+0000","last_unstale":"2024-08-31T05:28:59.659965+0000","last_undegraded":"2024-08-31T05:28:59.659965+0000","last_fullsized":"2024-08-31T05:28:59.659965+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:15:34.711961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161452+0000","last_change":"2024-08-31T05:27:31.255199+0000","last_active":"2024-08-31T05:28:59.161452+0000","last_peered":"2024-08-31T05:28:59.161452+0000","last_clean":"2024-08-31T05:28:59.161452+0000","last_became_active":"2024-08-31T05:27:31.254833+0000","last_became_peered":"2024-08-31T05:27:31.254833+0000","last_unstale":"2024-08-31T05:28:59.161452+0000","last_undegraded":"2024-08-31T05:28:59.161452+0000","last_fullsized":"2024-08-31T05:28:59.161452+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:55:09.426531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.160969+0000","last_change":"2024-08-31T05:27:31.264881+0000","last_active":"2024-08-31T05:28:59.160969+0000","last_peered":"2024-08-31T05:28:59.160969+0000","last_clean":"2024-08-31T05:28:59.160969+0000","last_became_active":"2024-08-31T05:27:31.264483+0000","last_became_peered":"2024-08-31T05:27:31.264483+0000","last_unstale":"2024-08-31T05:28:59.160969+0000","last_undegraded":"2024-08-31T05:28:59.160969+0000","last_fullsized":"2024-08-31T05:28:59.160969+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:48:55.193321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.489307+0000","last_change":"2024-08-31T05:27:31.258555+0000","last_active":"2024-08-31T05:28:59.489307+0000","last_peered":"2024-08-31T05:28:59.489307+0000","last_clean":"2024-08-31T05:28:59.489307+0000","last_became_active":"2024-08-31T05:27:31.258023+0000","last_became_peered":"2024-08-31T05:27:31.258023+0000","last_unstale":"2024-08-31T05:28:59.489307+0000","last_undegraded":"2024-08-31T05:28:59.489307+0000","last_fullsized":"2024-08-31T05:28:59.489307+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:26:34.911641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.658191+0000","last_change":"2024-08-31T05:27:31.249886+0000","last_active":"2024-08-31T05:28:59.658191+0000","last_peered":"2024-08-31T05:28:59.658191+0000","last_clean":"2024-08-31T05:28:59.658191+0000","last_became_active":"2024-08-31T05:27:31.248549+0000","last_became_peered":"2024-08-31T05:27:31.248549+0000","last_unstale":"2024-08-31T05:28:59.658191+0000","last_undegraded":"2024-08-31T05:28:59.658191+0000","last_fullsized":"2024-08-31T05:28:59.658191+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:57:55.743286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.661844+0000","last_change":"2024-08-31T05:27:31.261697+0000","last_active":"2024-08-31T05:28:59.661844+0000","last_peered":"2024-08-31T05:28:59.661844+0000","last_clean":"2024-08-31T05:28:59.661844+0000","last_became_active":"2024-08-31T05:27:31.260398+0000","last_became_peered":"2024-08-31T05:27:31.260398+0000","last_unstale":"2024-08-31T05:28:59.661844+0000","last_undegraded":"2024-08-31T05:28:59.661844+0000","last_fullsized":"2024-08-31T05:28:59.661844+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:08:03.999556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.159157+0000","last_change":"2024-08-31T05:27:31.256638+0000","last_active":"2024-08-31T05:28:59.159157+0000","last_peered":"2024-08-31T05:28:59.159157+0000","last_clean":"2024-08-31T05:28:59.159157+0000","last_became_active":"2024-08-31T05:27:31.256302+0000","last_became_peered":"2024-08-31T05:27:31.256302+0000","last_unstale":"2024-08-31T05:28:59.159157+0000","last_undegraded":"2024-08-31T05:28:59.159157+0000","last_fullsized":"2024-08-31T05:28:59.159157+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:31:58.946448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.489239+0000","last_change":"2024-08-31T05:27:31.253818+0000","last_active":"2024-08-31T05:28:59.489239+0000","last_peered":"2024-08-31T05:28:59.489239+0000","last_clean":"2024-08-31T05:28:59.489239+0000","last_became_active":"2024-08-31T05:27:31.253423+0000","last_became_peered":"2024-08-31T05:27:31.253423+0000","last_unstale":"2024-08-31T05:28:59.489239+0000","last_undegraded":"2024-08-31T05:28:59.489239+0000","last_fullsized":"2024-08-31T05:28:59.489239+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:45:43.951022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.658092+0000","last_change":"2024-08-31T05:27:31.247171+0000","last_active":"2024-08-31T05:28:59.658092+0000","last_peered":"2024-08-31T05:28:59.658092+0000","last_clean":"2024-08-31T05:28:59.658092+0000","last_became_active":"2024-08-31T05:27:31.246791+0000","last_became_peered":"2024-08-31T05:27:31.246791+0000","last_unstale":"2024-08-31T05:28:59.658092+0000","last_undegraded":"2024-08-31T05:28:59.658092+0000","last_fullsized":"2024-08-31T05:28:59.658092+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:26:12.163389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.165442+0000","last_change":"2024-08-31T05:27:31.257848+0000","last_active":"2024-08-31T05:28:59.165442+0000","last_peered":"2024-08-31T05:28:59.165442+0000","last_clean":"2024-08-31T05:28:59.165442+0000","last_became_active":"2024-08-31T05:27:31.257432+0000","last_became_peered":"2024-08-31T05:27:31.257432+0000","last_unstale":"2024-08-31T05:28:59.165442+0000","last_undegraded":"2024-08-31T05:28:59.165442+0000","last_fullsized":"2024-08-31T05:28:59.165442+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:08:12.512834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.160909+0000","last_change":"2024-08-31T05:27:31.263998+0000","last_active":"2024-08-31T05:28:59.160909+0000","last_peered":"2024-08-31T05:28:59.160909+0000","last_clean":"2024-08-31T05:28:59.160909+0000","last_became_active":"2024-08-31T05:27:31.263638+0000","last_became_peered":"2024-08-31T05:27:31.263638+0000","last_unstale":"2024-08-31T05:28:59.160909+0000","last_undegraded":"2024-08-31T05:28:59.160909+0000","last_fullsized":"2024-08-31T05:28:59.160909+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:07:50.470538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.660702+0000","last_change":"2024-08-31T05:27:31.260600+0000","last_active":"2024-08-31T05:28:59.660702+0000","last_peered":"2024-08-31T05:28:59.660702+0000","last_clean":"2024-08-31T05:28:59.660702+0000","last_became_active":"2024-08-31T05:27:31.259605+0000","last_became_peered":"2024-08-31T05:27:31.259605+0000","last_unstale":"2024-08-31T05:28:59.660702+0000","last_undegraded":"2024-08-31T05:28:59.660702+0000","last_fullsized":"2024-08-31T05:28:59.660702+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:04:16.861879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.660837+0000","last_change":"2024-08-31T05:27:31.256585+0000","last_active":"2024-08-31T05:28:59.660837+0000","last_peered":"2024-08-31T05:28:59.660837+0000","last_clean":"2024-08-31T05:28:59.660837+0000","last_became_active":"2024-08-31T05:27:31.256118+0000","last_became_peered":"2024-08-31T05:27:31.256118+0000","last_unstale":"2024-08-31T05:28:59.660837+0000","last_undegraded":"2024-08-31T05:28:59.660837+0000","last_fullsized":"2024-08-31T05:28:59.660837+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:47:18.891150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.482243+0000","last_change":"2024-08-31T05:27:31.260321+0000","last_active":"2024-08-31T05:28:59.482243+0000","last_peered":"2024-08-31T05:28:59.482243+0000","last_clean":"2024-08-31T05:28:59.482243+0000","last_became_active":"2024-08-31T05:27:31.259901+0000","last_became_peered":"2024-08-31T05:27:31.259901+0000","last_unstale":"2024-08-31T05:28:59.482243+0000","last_undegraded":"2024-08-31T05:28:59.482243+0000","last_fullsized":"2024-08-31T05:28:59.482243+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:44:26.651338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69276,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":555,"num_read_kb":352,"num_write":249,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":207828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":214,"ondisk_log_size":214,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":280617,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678049,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":966656,"data_stored":509480,"data_compressed":29581,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874278,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36440,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708712,"statfs":{"total":95995035648,"available":95957721088,"internally_reserved":0,"allocated":1114112,"data_stored":1158368,"data_compressed":65266,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037803,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36320,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708832,"statfs":{"total":95995035648,"available":95957843968,"internally_reserved":0,"allocated":995328,"data_stored":513506,"data_compressed":29581,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234032,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":978944,"data_stored":509116,"data_compressed":29581,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430261,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1040384,"data_stored":1106676,"data_compressed":65266,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593786,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":966656,"data_stored":505305,"data_compressed":29581,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790016,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36376,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708776,"statfs":{"total":95995035648,"available":95957786624,"internally_reserved":0,"allocated":1048576,"data_stored":1101867,"data_compressed":65266,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953541,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":983040,"data_stored":510001,"data_compressed":29581,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149770,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36304,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708848,"statfs":{"total":95995035648,"available":95957860352,"internally_reserved":0,"allocated":978944,"data_stored":504622,"data_compressed":29581,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378703,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36368,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708784,"statfs":{"total":95995035648,"available":95957794816,"internally_reserved":0,"allocated":1044480,"data_stored":567614,"data_compressed":29581,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542228,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36364,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708788,"statfs":{"total":95995035648,"available":95957798912,"internally_reserved":0,"allocated":1040384,"data_stored":569079,"data_compressed":29581,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705753,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36316,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708836,"statfs":{"total":95995035648,"available":95957848064,"internally_reserved":0,"allocated":991232,"data_stored":506370,"data_compressed":29581,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34064,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34064,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34064,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":64887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":63422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":63808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T05:29:09.660 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph pg dump --format=json 2024-08-31T05:29:09.661 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:09 smithi050 ceph-mon[22146]: pgmap v320: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 10 op/s 2024-08-31T05:29:09.921 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:29:10.453 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:10 smithi005 ceph-mon[18602]: from='client.15234 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T05:29:10.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:10.451+0000 7ff2571f6640 1 -- 172.21.15.5:0/1817525324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff250102800 msgr2=0x7ff250102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:10.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:10.451+0000 7ff2571f6640 1 --2- 172.21.15.5:0/1817525324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff250102800 0x7ff250102c10 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff244009900 tx=0x7ff24402a410 comp rx=0 tx=0).stop 2024-08-31T05:29:10.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:10.451+0000 7ff2571f6640 1 -- 172.21.15.5:0/1817525324 shutdown_connections 2024-08-31T05:29:10.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:10.451+0000 7ff2571f6640 1 --2- 172.21.15.5:0/1817525324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff250108a90 0x7ff25010f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:10.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:10.451+0000 7ff2571f6640 1 --2- 172.21.15.5:0/1817525324 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff250108140 0x7ff250108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:10.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:10.451+0000 7ff2571f6640 1 --2- 172.21.15.5:0/1817525324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff250102800 0x7ff250102c10 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:10.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:10.451+0000 7ff2571f6640 1 -- 172.21.15.5:0/1817525324 >> 172.21.15.5:0/1817525324 conn(0x7ff2500794d0 msgr2=0x7ff2500798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:10.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:10.451+0000 7ff2571f6640 1 -- 172.21.15.5:0/1817525324 shutdown_connections 2024-08-31T05:29:10.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:10.451+0000 7ff2571f6640 1 -- 172.21.15.5:0/1817525324 wait complete. 2024-08-31T05:29:10.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:10.452+0000 7ff2571f6640 1 Processor -- start 2024-08-31T05:29:10.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:10.452+0000 7ff2571f6640 1 -- start start 2024-08-31T05:29:10.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:10.452+0000 7ff2571f6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff250102800 0x7ff25019b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:10.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:10.452+0000 7ff2571f6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff250108140 0x7ff25019b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:10.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:10.452+0000 7ff2571f6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff250108a90 0x7ff25019bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:10.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:10.452+0000 7ff2571f6640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff2501126f0 con 0x7ff250108140 2024-08-31T05:29:10.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:10.452+0000 7ff2571f6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff250112570 con 0x7ff250102800 2024-08-31T05:29:10.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:10.452+0000 7ff2571f6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff250112870 con 0x7ff250108a90 2024-08-31T05:29:10.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:10.452+0000 7ff24ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff250108140 0x7ff25019b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:10.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:10.452+0000 7ff24ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff250108140 0x7ff25019b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35534/0 (socket says 172.21.15.5:35534) 2024-08-31T05:29:10.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:10.452+0000 7ff24ffff640 1 -- 172.21.15.5:0/1132672035 learned_addr learned my addr 172.21.15.5:0/1132672035 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:10.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:10.453+0000 7ff255793640 1 --2- 172.21.15.5:0/1132672035 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff250108a90 0x7ff25019bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:10.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:10.453+0000 7ff254f92640 1 --2- 172.21.15.5:0/1132672035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff250102800 0x7ff25019b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:10.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:10.453+0000 7ff24ffff640 1 -- 172.21.15.5:0/1132672035 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff250108a90 msgr2=0x7ff25019bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:10.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:10.453+0000 7ff24ffff640 1 --2- 172.21.15.5:0/1132672035 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff250108a90 0x7ff25019bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:10.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:10.453+0000 7ff24ffff640 1 -- 172.21.15.5:0/1132672035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff250102800 msgr2=0x7ff25019b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:10.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:10.453+0000 7ff24ffff640 1 --2- 172.21.15.5:0/1132672035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff250102800 0x7ff25019b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:10.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:10.453+0000 7ff24ffff640 1 -- 172.21.15.5:0/1132672035 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2501a62c0 con 0x7ff250108140 2024-08-31T05:29:10.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:10.453+0000 7ff24ffff640 1 --2- 172.21.15.5:0/1132672035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff250108140 0x7ff25019b600 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff23c00d770 tx=0x7ff23c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:10.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:10.453+0000 7ff24dffb640 1 -- 172.21.15.5:0/1132672035 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff23c017070 con 0x7ff250108140 2024-08-31T05:29:10.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:10.453+0000 7ff2571f6640 1 -- 172.21.15.5:0/1132672035 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2501a65b0 con 0x7ff250108140 2024-08-31T05:29:10.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:10.453+0000 7ff24dffb640 1 -- 172.21.15.5:0/1132672035 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff23c009c30 con 0x7ff250108140 2024-08-31T05:29:10.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:10.453+0000 7ff24dffb640 1 -- 172.21.15.5:0/1132672035 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff23c00f620 con 0x7ff250108140 2024-08-31T05:29:10.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:10.453+0000 7ff2571f6640 1 -- 172.21.15.5:0/1132672035 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2501a6b40 con 0x7ff250108140 2024-08-31T05:29:10.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:10.455+0000 7ff2571f6640 1 -- 172.21.15.5:0/1132672035 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff250102c10 con 0x7ff250108140 2024-08-31T05:29:10.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:10.457+0000 7ff24dffb640 1 -- 172.21.15.5:0/1132672035 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7ff23c01a070 con 0x7ff250108140 2024-08-31T05:29:10.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:10.458+0000 7ff24dffb640 1 --2- 172.21.15.5:0/1132672035 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff2400b4c40 0x7ff2400b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:10.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:10.458+0000 7ff24dffb640 1 -- 172.21.15.5:0/1132672035 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7ff23c0e5240 con 0x7ff250108140 2024-08-31T05:29:10.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:10.458+0000 7ff254f92640 1 --2- 172.21.15.5:0/1132672035 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff2400b4c40 0x7ff2400b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:10.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:10.458+0000 7ff254f92640 1 --2- 172.21.15.5:0/1132672035 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff2400b4c40 0x7ff2400b7150 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff244000c00 tx=0x7ff244031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:10.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:10.461+0000 7ff24dffb640 1 -- 172.21.15.5:0/1132672035 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff23c0ab6c0 con 0x7ff250108140 2024-08-31T05:29:10.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:10 smithi070 ceph-mon[22316]: from='client.15234 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T05:29:10.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:10.643+0000 7ff2571f6640 1 -- 172.21.15.5:0/1132672035 --> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff2500635a0 con 0x7ff2400b4c40 2024-08-31T05:29:10.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:10.649+0000 7ff24dffb640 1 -- 172.21.15.5:0/1132672035 <== mgr.14220 v2:172.21.15.5:6800/2696053609 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340671 (secure 0 0 0) 0x7ff2500635a0 con 0x7ff2400b4c40 2024-08-31T05:29:10.654 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:29:10.656 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-31T05:29:10.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:10 smithi050 ceph-mon[22146]: from='client.15234 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T05:29:10.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:10.652+0000 7ff2571f6640 1 -- 172.21.15.5:0/1132672035 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff2400b4c40 msgr2=0x7ff2400b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:10.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:10.652+0000 7ff2571f6640 1 --2- 172.21.15.5:0/1132672035 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff2400b4c40 0x7ff2400b7150 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff244000c00 tx=0x7ff244031400 comp rx=0 tx=0).stop 2024-08-31T05:29:10.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:10.652+0000 7ff2571f6640 1 -- 172.21.15.5:0/1132672035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff250108140 msgr2=0x7ff25019b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:10.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:10.652+0000 7ff2571f6640 1 --2- 172.21.15.5:0/1132672035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff250108140 0x7ff25019b600 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff23c00d770 tx=0x7ff23c00dc30 comp rx=0 tx=0).stop 2024-08-31T05:29:10.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:10.653+0000 7ff2571f6640 1 -- 172.21.15.5:0/1132672035 shutdown_connections 2024-08-31T05:29:10.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:10.653+0000 7ff2571f6640 1 --2- 172.21.15.5:0/1132672035 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff2400b4c40 0x7ff2400b7150 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:10.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:10.653+0000 7ff2571f6640 1 --2- 172.21.15.5:0/1132672035 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff250108a90 0x7ff25019bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:10.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:10.653+0000 7ff2571f6640 1 --2- 172.21.15.5:0/1132672035 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff250108140 0x7ff25019b600 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:10.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:10.653+0000 7ff2571f6640 1 --2- 172.21.15.5:0/1132672035 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff250102800 0x7ff25019b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:10.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:10.653+0000 7ff2571f6640 1 -- 172.21.15.5:0/1132672035 >> 172.21.15.5:0/1132672035 conn(0x7ff2500794d0 msgr2=0x7ff250101250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:10.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:10.653+0000 7ff2571f6640 1 -- 172.21.15.5:0/1132672035 shutdown_connections 2024-08-31T05:29:10.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:10.653+0000 7ff2571f6640 1 -- 172.21.15.5:0/1132672035 wait complete. 2024-08-31T05:29:11.453 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:11 smithi005 ceph-mon[18602]: pgmap v321: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-08-31T05:29:11.484 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":321,"stamp":"2024-08-31T05:29:09.464487+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659878,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":681,"num_read_kb":446,"num_write":374,"num_write_kb":2294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":2952422,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":308,"ondisk_log_size":308,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":402780,"kb_used_data":11864,"kb_used_omap":18,"kb_used_meta":390637,"kb_avail":1124539044,"statfs":{"total":1151940427776,"available":1151527981056,"internally_reserved":0,"allocated":12148736,"data_stored":8062004,"data_compressed":462027,"data_compressed_allocated":626688,"data_compressed_original":2752512,"omap_allocated":19141,"internal_metadata":400012603},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":50,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.306826"},"pg_stats":[{"pgid":"2.1f","version":"85'13","reported_seq":121,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:05.665448+0000","last_change":"2024-08-31T05:27:58.511927+0000","last_active":"2024-08-31T05:29:05.665448+0000","last_peered":"2024-08-31T05:29:05.665448+0000","last_clean":"2024-08-31T05:29:05.665448+0000","last_became_active":"2024-08-31T05:27:58.507111+0000","last_became_peered":"2024-08-31T05:27:58.507111+0000","last_unstale":"2024-08-31T05:29:05.665448+0000","last_undegraded":"2024-08-31T05:29:05.665448+0000","last_fullsized":"2024-08-31T05:29:05.665448+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:42:09.078048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":56,"num_read_kb":56,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.159755+0000","last_change":"2024-08-31T05:27:31.255221+0000","last_active":"2024-08-31T05:28:59.159755+0000","last_peered":"2024-08-31T05:28:59.159755+0000","last_clean":"2024-08-31T05:28:59.159755+0000","last_became_active":"2024-08-31T05:27:31.254684+0000","last_became_peered":"2024-08-31T05:27:31.254684+0000","last_unstale":"2024-08-31T05:28:59.159755+0000","last_undegraded":"2024-08-31T05:28:59.159755+0000","last_fullsized":"2024-08-31T05:28:59.159755+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:34:22.517485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.661502+0000","last_change":"2024-08-31T05:27:38.293857+0000","last_active":"2024-08-31T05:28:59.661502+0000","last_peered":"2024-08-31T05:28:59.661502+0000","last_clean":"2024-08-31T05:28:59.661502+0000","last_became_active":"2024-08-31T05:27:38.292763+0000","last_became_peered":"2024-08-31T05:27:38.292763+0000","last_unstale":"2024-08-31T05:28:59.661502+0000","last_undegraded":"2024-08-31T05:28:59.661502+0000","last_fullsized":"2024-08-31T05:28:59.661502+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:53:27.187697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.159867+0000","last_change":"2024-08-31T05:27:29.281010+0000","last_active":"2024-08-31T05:28:59.159867+0000","last_peered":"2024-08-31T05:28:59.159867+0000","last_clean":"2024-08-31T05:28:59.159867+0000","last_became_active":"2024-08-31T05:27:29.280625+0000","last_became_peered":"2024-08-31T05:27:29.280625+0000","last_unstale":"2024-08-31T05:28:59.159867+0000","last_undegraded":"2024-08-31T05:28:59.159867+0000","last_fullsized":"2024-08-31T05:28:59.159867+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:09:25.542564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.661230+0000","last_change":"2024-08-31T05:27:31.258052+0000","last_active":"2024-08-31T05:28:59.661230+0000","last_peered":"2024-08-31T05:28:59.661230+0000","last_clean":"2024-08-31T05:28:59.661230+0000","last_became_active":"2024-08-31T05:27:31.257549+0000","last_became_peered":"2024-08-31T05:27:31.257549+0000","last_unstale":"2024-08-31T05:28:59.661230+0000","last_undegraded":"2024-08-31T05:28:59.661230+0000","last_fullsized":"2024-08-31T05:28:59.661230+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:14:21.552372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.160234+0000","last_change":"2024-08-31T05:27:38.300359+0000","last_active":"2024-08-31T05:28:59.160234+0000","last_peered":"2024-08-31T05:28:59.160234+0000","last_clean":"2024-08-31T05:28:59.160234+0000","last_became_active":"2024-08-31T05:27:38.299704+0000","last_became_peered":"2024-08-31T05:27:38.299704+0000","last_unstale":"2024-08-31T05:28:59.160234+0000","last_undegraded":"2024-08-31T05:28:59.160234+0000","last_fullsized":"2024-08-31T05:28:59.160234+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:06:50.500384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"85'12","reported_seq":52,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.165814+0000","last_change":"2024-08-31T05:27:29.240652+0000","last_active":"2024-08-31T05:28:59.165814+0000","last_peered":"2024-08-31T05:28:59.165814+0000","last_clean":"2024-08-31T05:28:59.165814+0000","last_became_active":"2024-08-31T05:27:29.239432+0000","last_became_peered":"2024-08-31T05:27:29.239432+0000","last_unstale":"2024-08-31T05:28:59.165814+0000","last_undegraded":"2024-08-31T05:28:59.165814+0000","last_fullsized":"2024-08-31T05:28:59.165814+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:49:56.506299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.661552+0000","last_change":"2024-08-31T05:27:31.261784+0000","last_active":"2024-08-31T05:28:59.661552+0000","last_peered":"2024-08-31T05:28:59.661552+0000","last_clean":"2024-08-31T05:28:59.661552+0000","last_became_active":"2024-08-31T05:27:31.260045+0000","last_became_peered":"2024-08-31T05:27:31.260045+0000","last_unstale":"2024-08-31T05:28:59.661552+0000","last_undegraded":"2024-08-31T05:28:59.661552+0000","last_fullsized":"2024-08-31T05:28:59.661552+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:18:30.044052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.661334+0000","last_change":"2024-08-31T05:28:59.661205+0000","last_active":"2024-08-31T05:28:59.661334+0000","last_peered":"2024-08-31T05:28:59.661334+0000","last_clean":"2024-08-31T05:28:59.661334+0000","last_became_active":"2024-08-31T05:28:59.660637+0000","last_became_peered":"2024-08-31T05:28:59.660637+0000","last_unstale":"2024-08-31T05:28:59.661334+0000","last_undegraded":"2024-08-31T05:28:59.661334+0000","last_fullsized":"2024-08-31T05:28:59.661334+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:18:21.507475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,10],"acting":[4,3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"85'5","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.165725+0000","last_change":"2024-08-31T05:27:29.240341+0000","last_active":"2024-08-31T05:28:59.165725+0000","last_peered":"2024-08-31T05:28:59.165725+0000","last_clean":"2024-08-31T05:28:59.165725+0000","last_became_active":"2024-08-31T05:27:29.239944+0000","last_became_peered":"2024-08-31T05:27:29.239944+0000","last_unstale":"2024-08-31T05:28:59.165725+0000","last_undegraded":"2024-08-31T05:28:59.165725+0000","last_fullsized":"2024-08-31T05:28:59.165725+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:58:19.747559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161374+0000","last_change":"2024-08-31T05:27:31.265116+0000","last_active":"2024-08-31T05:28:59.161374+0000","last_peered":"2024-08-31T05:28:59.161374+0000","last_clean":"2024-08-31T05:28:59.161374+0000","last_became_active":"2024-08-31T05:27:31.264725+0000","last_became_peered":"2024-08-31T05:27:31.264725+0000","last_unstale":"2024-08-31T05:28:59.161374+0000","last_undegraded":"2024-08-31T05:28:59.161374+0000","last_fullsized":"2024-08-31T05:28:59.161374+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:44:45.831881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.160399+0000","last_change":"2024-08-31T05:27:38.298634+0000","last_active":"2024-08-31T05:28:59.160399+0000","last_peered":"2024-08-31T05:28:59.160399+0000","last_clean":"2024-08-31T05:28:59.160399+0000","last_became_active":"2024-08-31T05:27:38.298143+0000","last_became_peered":"2024-08-31T05:27:38.298143+0000","last_unstale":"2024-08-31T05:28:59.160399+0000","last_undegraded":"2024-08-31T05:28:59.160399+0000","last_fullsized":"2024-08-31T05:28:59.160399+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:51:25.639441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.489279+0000","last_change":"2024-08-31T05:27:31.259981+0000","last_active":"2024-08-31T05:28:59.489279+0000","last_peered":"2024-08-31T05:28:59.489279+0000","last_clean":"2024-08-31T05:28:59.489279+0000","last_became_active":"2024-08-31T05:27:31.259584+0000","last_became_peered":"2024-08-31T05:27:31.259584+0000","last_unstale":"2024-08-31T05:28:59.489279+0000","last_undegraded":"2024-08-31T05:28:59.489279+0000","last_fullsized":"2024-08-31T05:28:59.489279+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:52:29.853977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.481776+0000","last_change":"2024-08-31T05:27:58.514065+0000","last_active":"2024-08-31T05:28:59.481776+0000","last_peered":"2024-08-31T05:28:59.481776+0000","last_clean":"2024-08-31T05:28:59.481776+0000","last_became_active":"2024-08-31T05:27:58.506011+0000","last_became_peered":"2024-08-31T05:27:58.506011+0000","last_unstale":"2024-08-31T05:28:59.481776+0000","last_undegraded":"2024-08-31T05:28:59.481776+0000","last_fullsized":"2024-08-31T05:28:59.481776+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:25:55.610965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.160746+0000","last_change":"2024-08-31T05:27:38.293265+0000","last_active":"2024-08-31T05:28:59.160746+0000","last_peered":"2024-08-31T05:28:59.160746+0000","last_clean":"2024-08-31T05:28:59.160746+0000","last_became_active":"2024-08-31T05:27:38.292736+0000","last_became_peered":"2024-08-31T05:27:38.292736+0000","last_unstale":"2024-08-31T05:28:59.160746+0000","last_undegraded":"2024-08-31T05:28:59.160746+0000","last_fullsized":"2024-08-31T05:28:59.160746+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:51:25.853365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.159300+0000","last_change":"2024-08-31T05:27:31.252479+0000","last_active":"2024-08-31T05:28:59.159300+0000","last_peered":"2024-08-31T05:28:59.159300+0000","last_clean":"2024-08-31T05:28:59.159300+0000","last_became_active":"2024-08-31T05:27:31.252126+0000","last_became_peered":"2024-08-31T05:27:31.252126+0000","last_unstale":"2024-08-31T05:28:59.159300+0000","last_undegraded":"2024-08-31T05:28:59.159300+0000","last_fullsized":"2024-08-31T05:28:59.159300+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:24:40.864240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"85'3","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.481744+0000","last_change":"2024-08-31T05:27:58.508588+0000","last_active":"2024-08-31T05:28:59.481744+0000","last_peered":"2024-08-31T05:28:59.481744+0000","last_clean":"2024-08-31T05:28:59.481744+0000","last_became_active":"2024-08-31T05:27:58.508024+0000","last_became_peered":"2024-08-31T05:27:58.508024+0000","last_unstale":"2024-08-31T05:28:59.481744+0000","last_undegraded":"2024-08-31T05:28:59.481744+0000","last_fullsized":"2024-08-31T05:28:59.481744+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:32:33.222909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"85'1","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.160756+0000","last_change":"2024-08-31T05:27:38.299506+0000","last_active":"2024-08-31T05:28:59.160756+0000","last_peered":"2024-08-31T05:28:59.160756+0000","last_clean":"2024-08-31T05:28:59.160756+0000","last_became_active":"2024-08-31T05:27:38.298756+0000","last_became_peered":"2024-08-31T05:27:38.298756+0000","last_unstale":"2024-08-31T05:28:59.160756+0000","last_undegraded":"2024-08-31T05:28:59.160756+0000","last_fullsized":"2024-08-31T05:28:59.160756+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:25:18.115727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.481728+0000","last_change":"2024-08-31T05:27:31.249220+0000","last_active":"2024-08-31T05:28:59.481728+0000","last_peered":"2024-08-31T05:28:59.481728+0000","last_clean":"2024-08-31T05:28:59.481728+0000","last_became_active":"2024-08-31T05:27:31.248869+0000","last_became_peered":"2024-08-31T05:27:31.248869+0000","last_unstale":"2024-08-31T05:28:59.481728+0000","last_undegraded":"2024-08-31T05:28:59.481728+0000","last_fullsized":"2024-08-31T05:28:59.481728+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:43:13.463903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"85'7","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.159393+0000","last_change":"2024-08-31T05:27:29.235278+0000","last_active":"2024-08-31T05:28:59.159393+0000","last_peered":"2024-08-31T05:28:59.159393+0000","last_clean":"2024-08-31T05:28:59.159393+0000","last_became_active":"2024-08-31T05:27:29.234929+0000","last_became_peered":"2024-08-31T05:27:29.234929+0000","last_unstale":"2024-08-31T05:28:59.159393+0000","last_undegraded":"2024-08-31T05:28:59.159393+0000","last_fullsized":"2024-08-31T05:28:59.159393+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:49:55.867542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.657127+0000","last_change":"2024-08-31T05:27:38.293903+0000","last_active":"2024-08-31T05:28:59.657127+0000","last_peered":"2024-08-31T05:28:59.657127+0000","last_clean":"2024-08-31T05:28:59.657127+0000","last_became_active":"2024-08-31T05:27:38.290471+0000","last_became_peered":"2024-08-31T05:27:38.290471+0000","last_unstale":"2024-08-31T05:28:59.657127+0000","last_undegraded":"2024-08-31T05:28:59.657127+0000","last_fullsized":"2024-08-31T05:28:59.657127+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:04:36.573302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.165104+0000","last_change":"2024-08-31T05:27:31.252038+0000","last_active":"2024-08-31T05:28:59.165104+0000","last_peered":"2024-08-31T05:28:59.165104+0000","last_clean":"2024-08-31T05:28:59.165104+0000","last_became_active":"2024-08-31T05:27:31.251630+0000","last_became_peered":"2024-08-31T05:27:31.251630+0000","last_unstale":"2024-08-31T05:28:59.165104+0000","last_undegraded":"2024-08-31T05:28:59.165104+0000","last_fullsized":"2024-08-31T05:28:59.165104+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:10:39.778057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.661959+0000","last_change":"2024-08-31T05:27:29.280978+0000","last_active":"2024-08-31T05:28:59.661959+0000","last_peered":"2024-08-31T05:28:59.661959+0000","last_clean":"2024-08-31T05:28:59.661959+0000","last_became_active":"2024-08-31T05:27:29.280524+0000","last_became_peered":"2024-08-31T05:27:29.280524+0000","last_unstale":"2024-08-31T05:28:59.661959+0000","last_undegraded":"2024-08-31T05:28:59.661959+0000","last_fullsized":"2024-08-31T05:28:59.661959+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:56:57.441801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161017+0000","last_change":"2024-08-31T05:27:38.300947+0000","last_active":"2024-08-31T05:28:59.161017+0000","last_peered":"2024-08-31T05:28:59.161017+0000","last_clean":"2024-08-31T05:28:59.161017+0000","last_became_active":"2024-08-31T05:27:38.300044+0000","last_became_peered":"2024-08-31T05:27:38.300044+0000","last_unstale":"2024-08-31T05:28:59.161017+0000","last_undegraded":"2024-08-31T05:28:59.161017+0000","last_fullsized":"2024-08-31T05:28:59.161017+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:33:05.081601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.660009+0000","last_change":"2024-08-31T05:27:31.257782+0000","last_active":"2024-08-31T05:28:59.660009+0000","last_peered":"2024-08-31T05:28:59.660009+0000","last_clean":"2024-08-31T05:28:59.660009+0000","last_became_active":"2024-08-31T05:27:31.257360+0000","last_became_peered":"2024-08-31T05:27:31.257360+0000","last_unstale":"2024-08-31T05:28:59.660009+0000","last_undegraded":"2024-08-31T05:28:59.660009+0000","last_fullsized":"2024-08-31T05:28:59.660009+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:58:11.249925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"85'7","reported_seq":47,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161202+0000","last_change":"2024-08-31T05:27:29.392664+0000","last_active":"2024-08-31T05:28:59.161202+0000","last_peered":"2024-08-31T05:28:59.161202+0000","last_clean":"2024-08-31T05:28:59.161202+0000","last_became_active":"2024-08-31T05:27:29.392208+0000","last_became_peered":"2024-08-31T05:27:29.392208+0000","last_unstale":"2024-08-31T05:28:59.161202+0000","last_undegraded":"2024-08-31T05:28:59.161202+0000","last_fullsized":"2024-08-31T05:28:59.161202+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:51:34.981168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.661689+0000","last_change":"2024-08-31T05:27:38.293556+0000","last_active":"2024-08-31T05:28:59.661689+0000","last_peered":"2024-08-31T05:28:59.661689+0000","last_clean":"2024-08-31T05:28:59.661689+0000","last_became_active":"2024-08-31T05:27:38.292338+0000","last_became_peered":"2024-08-31T05:27:38.292338+0000","last_unstale":"2024-08-31T05:28:59.661689+0000","last_undegraded":"2024-08-31T05:28:59.661689+0000","last_fullsized":"2024-08-31T05:28:59.661689+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:13:46.376934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.159649+0000","last_change":"2024-08-31T05:27:31.247408+0000","last_active":"2024-08-31T05:28:59.159649+0000","last_peered":"2024-08-31T05:28:59.159649+0000","last_clean":"2024-08-31T05:28:59.159649+0000","last_became_active":"2024-08-31T05:27:31.247034+0000","last_became_peered":"2024-08-31T05:27:31.247034+0000","last_unstale":"2024-08-31T05:28:59.159649+0000","last_undegraded":"2024-08-31T05:28:59.159649+0000","last_fullsized":"2024-08-31T05:28:59.159649+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:42:08.350054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"85'15","reported_seq":54,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.657389+0000","last_change":"2024-08-31T05:27:29.235941+0000","last_active":"2024-08-31T05:28:59.657389+0000","last_peered":"2024-08-31T05:28:59.657389+0000","last_clean":"2024-08-31T05:28:59.657389+0000","last_became_active":"2024-08-31T05:27:29.235561+0000","last_became_peered":"2024-08-31T05:27:29.235561+0000","last_unstale":"2024-08-31T05:28:59.657389+0000","last_undegraded":"2024-08-31T05:28:59.657389+0000","last_fullsized":"2024-08-31T05:28:59.657389+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:29:34.551748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.159042+0000","last_change":"2024-08-31T05:27:38.286960+0000","last_active":"2024-08-31T05:28:59.159042+0000","last_peered":"2024-08-31T05:28:59.159042+0000","last_clean":"2024-08-31T05:28:59.159042+0000","last_became_active":"2024-08-31T05:27:38.286537+0000","last_became_peered":"2024-08-31T05:27:38.286537+0000","last_unstale":"2024-08-31T05:28:59.159042+0000","last_undegraded":"2024-08-31T05:28:59.159042+0000","last_fullsized":"2024-08-31T05:28:59.159042+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:55:00.656676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.162061+0000","last_change":"2024-08-31T05:27:31.245901+0000","last_active":"2024-08-31T05:28:59.162061+0000","last_peered":"2024-08-31T05:28:59.162061+0000","last_clean":"2024-08-31T05:28:59.162061+0000","last_became_active":"2024-08-31T05:27:31.245534+0000","last_became_peered":"2024-08-31T05:27:31.245534+0000","last_unstale":"2024-08-31T05:28:59.162061+0000","last_undegraded":"2024-08-31T05:28:59.162061+0000","last_fullsized":"2024-08-31T05:28:59.162061+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:26:35.876033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"85'4","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.165965+0000","last_change":"2024-08-31T05:27:29.280767+0000","last_active":"2024-08-31T05:28:59.165965+0000","last_peered":"2024-08-31T05:28:59.165965+0000","last_clean":"2024-08-31T05:28:59.165965+0000","last_became_active":"2024-08-31T05:27:29.280334+0000","last_became_peered":"2024-08-31T05:27:29.280334+0000","last_unstale":"2024-08-31T05:28:59.165965+0000","last_undegraded":"2024-08-31T05:28:59.165965+0000","last_fullsized":"2024-08-31T05:28:59.165965+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:25:20.250205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.481750+0000","last_change":"2024-08-31T05:27:38.296846+0000","last_active":"2024-08-31T05:28:59.481750+0000","last_peered":"2024-08-31T05:28:59.481750+0000","last_clean":"2024-08-31T05:28:59.481750+0000","last_became_active":"2024-08-31T05:27:38.295516+0000","last_became_peered":"2024-08-31T05:27:38.295516+0000","last_unstale":"2024-08-31T05:28:59.481750+0000","last_undegraded":"2024-08-31T05:28:59.481750+0000","last_fullsized":"2024-08-31T05:28:59.481750+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:30:51.110144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.658173+0000","last_change":"2024-08-31T05:27:31.246481+0000","last_active":"2024-08-31T05:28:59.658173+0000","last_peered":"2024-08-31T05:28:59.658173+0000","last_clean":"2024-08-31T05:28:59.658173+0000","last_became_active":"2024-08-31T05:27:31.246079+0000","last_became_peered":"2024-08-31T05:27:31.246079+0000","last_unstale":"2024-08-31T05:28:59.658173+0000","last_undegraded":"2024-08-31T05:28:59.658173+0000","last_fullsized":"2024-08-31T05:28:59.658173+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:25:42.536251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"85'1","reported_seq":40,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.656885+0000","last_change":"2024-08-31T05:27:29.281078+0000","last_active":"2024-08-31T05:28:59.656885+0000","last_peered":"2024-08-31T05:28:59.656885+0000","last_clean":"2024-08-31T05:28:59.656885+0000","last_became_active":"2024-08-31T05:27:29.280674+0000","last_became_peered":"2024-08-31T05:27:29.280674+0000","last_unstale":"2024-08-31T05:28:59.656885+0000","last_undegraded":"2024-08-31T05:28:59.656885+0000","last_fullsized":"2024-08-31T05:28:59.656885+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:04:03.576077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.664219+0000","last_change":"2024-08-31T05:28:59.664061+0000","last_active":"2024-08-31T05:28:59.664219+0000","last_peered":"2024-08-31T05:28:59.664219+0000","last_clean":"2024-08-31T05:28:59.664219+0000","last_became_active":"2024-08-31T05:28:59.663495+0000","last_became_peered":"2024-08-31T05:28:59.663495+0000","last_unstale":"2024-08-31T05:28:59.664219+0000","last_undegraded":"2024-08-31T05:28:59.664219+0000","last_fullsized":"2024-08-31T05:28:59.664219+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:51:38.112492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.658191+0000","last_change":"2024-08-31T05:27:31.251011+0000","last_active":"2024-08-31T05:28:59.658191+0000","last_peered":"2024-08-31T05:28:59.658191+0000","last_clean":"2024-08-31T05:28:59.658191+0000","last_became_active":"2024-08-31T05:27:31.250597+0000","last_became_peered":"2024-08-31T05:27:31.250597+0000","last_unstale":"2024-08-31T05:28:59.658191+0000","last_undegraded":"2024-08-31T05:28:59.658191+0000","last_fullsized":"2024-08-31T05:28:59.658191+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:13:30.858395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'6","reported_seq":100,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:03.663176+0000","last_change":"2024-08-31T05:27:29.242137+0000","last_active":"2024-08-31T05:29:03.663176+0000","last_peered":"2024-08-31T05:29:03.663176+0000","last_clean":"2024-08-31T05:29:03.663176+0000","last_became_active":"2024-08-31T05:27:29.241460+0000","last_became_peered":"2024-08-31T05:27:29.241460+0000","last_unstale":"2024-08-31T05:29:03.663176+0000","last_undegraded":"2024-08-31T05:29:03.663176+0000","last_fullsized":"2024-08-31T05:29:03.663176+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:40:59.174572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161890+0000","last_change":"2024-08-31T05:27:38.288643+0000","last_active":"2024-08-31T05:28:59.161890+0000","last_peered":"2024-08-31T05:28:59.161890+0000","last_clean":"2024-08-31T05:28:59.161890+0000","last_became_active":"2024-08-31T05:27:38.288235+0000","last_became_peered":"2024-08-31T05:27:38.288235+0000","last_unstale":"2024-08-31T05:28:59.161890+0000","last_undegraded":"2024-08-31T05:28:59.161890+0000","last_fullsized":"2024-08-31T05:28:59.161890+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:23:49.090990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.160708+0000","last_change":"2024-08-31T05:27:31.263326+0000","last_active":"2024-08-31T05:28:59.160708+0000","last_peered":"2024-08-31T05:28:59.160708+0000","last_clean":"2024-08-31T05:28:59.160708+0000","last_became_active":"2024-08-31T05:27:31.262864+0000","last_became_peered":"2024-08-31T05:27:31.262864+0000","last_unstale":"2024-08-31T05:28:59.160708+0000","last_undegraded":"2024-08-31T05:28:59.160708+0000","last_fullsized":"2024-08-31T05:28:59.160708+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:34:21.159545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'5","reported_seq":102,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:07.668321+0000","last_change":"2024-08-31T05:27:29.280829+0000","last_active":"2024-08-31T05:29:07.668321+0000","last_peered":"2024-08-31T05:29:07.668321+0000","last_clean":"2024-08-31T05:29:07.668321+0000","last_became_active":"2024-08-31T05:27:29.280469+0000","last_became_peered":"2024-08-31T05:27:29.280469+0000","last_unstale":"2024-08-31T05:29:07.668321+0000","last_undegraded":"2024-08-31T05:29:07.668321+0000","last_fullsized":"2024-08-31T05:29:07.668321+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:16:59.559680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":58,"num_read_kb":58,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161948+0000","last_change":"2024-08-31T05:27:38.290175+0000","last_active":"2024-08-31T05:28:59.161948+0000","last_peered":"2024-08-31T05:28:59.161948+0000","last_clean":"2024-08-31T05:28:59.161948+0000","last_became_active":"2024-08-31T05:27:38.289228+0000","last_became_peered":"2024-08-31T05:27:38.289228+0000","last_unstale":"2024-08-31T05:28:59.161948+0000","last_undegraded":"2024-08-31T05:28:59.161948+0000","last_fullsized":"2024-08-31T05:28:59.161948+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:26:07.251711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161126+0000","last_change":"2024-08-31T05:27:31.245446+0000","last_active":"2024-08-31T05:28:59.161126+0000","last_peered":"2024-08-31T05:28:59.161126+0000","last_clean":"2024-08-31T05:28:59.161126+0000","last_became_active":"2024-08-31T05:27:31.245099+0000","last_became_peered":"2024-08-31T05:27:31.245099+0000","last_unstale":"2024-08-31T05:28:59.161126+0000","last_undegraded":"2024-08-31T05:28:59.161126+0000","last_fullsized":"2024-08-31T05:28:59.161126+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:18:17.876796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'4","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.489786+0000","last_change":"2024-08-31T05:27:29.241333+0000","last_active":"2024-08-31T05:28:59.489786+0000","last_peered":"2024-08-31T05:28:59.489786+0000","last_clean":"2024-08-31T05:28:59.489786+0000","last_became_active":"2024-08-31T05:27:29.240963+0000","last_became_peered":"2024-08-31T05:27:29.240963+0000","last_unstale":"2024-08-31T05:28:59.489786+0000","last_undegraded":"2024-08-31T05:28:59.489786+0000","last_fullsized":"2024-08-31T05:28:59.489786+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:22:06.442824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161127+0000","last_change":"2024-08-31T05:27:38.287640+0000","last_active":"2024-08-31T05:28:59.161127+0000","last_peered":"2024-08-31T05:28:59.161127+0000","last_clean":"2024-08-31T05:28:59.161127+0000","last_became_active":"2024-08-31T05:27:38.286191+0000","last_became_peered":"2024-08-31T05:27:38.286191+0000","last_unstale":"2024-08-31T05:28:59.161127+0000","last_undegraded":"2024-08-31T05:28:59.161127+0000","last_fullsized":"2024-08-31T05:28:59.161127+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:57:23.535841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.656572+0000","last_change":"2024-08-31T05:27:58.506945+0000","last_active":"2024-08-31T05:28:59.656572+0000","last_peered":"2024-08-31T05:28:59.656572+0000","last_clean":"2024-08-31T05:28:59.656572+0000","last_became_active":"2024-08-31T05:27:58.506505+0000","last_became_peered":"2024-08-31T05:27:58.506505+0000","last_unstale":"2024-08-31T05:28:59.656572+0000","last_undegraded":"2024-08-31T05:28:59.656572+0000","last_fullsized":"2024-08-31T05:28:59.656572+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:16:09.541579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"85'6","reported_seq":48,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161666+0000","last_change":"2024-08-31T05:27:29.238351+0000","last_active":"2024-08-31T05:28:59.161666+0000","last_peered":"2024-08-31T05:28:59.161666+0000","last_clean":"2024-08-31T05:28:59.161666+0000","last_became_active":"2024-08-31T05:27:29.237940+0000","last_became_peered":"2024-08-31T05:27:29.237940+0000","last_unstale":"2024-08-31T05:28:59.161666+0000","last_undegraded":"2024-08-31T05:28:59.161666+0000","last_fullsized":"2024-08-31T05:28:59.161666+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:55:08.048966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":114,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.489971+0000","last_change":"2024-08-31T05:26:14.183718+0000","last_active":"2024-08-31T05:28:59.489971+0000","last_peered":"2024-08-31T05:28:59.489971+0000","last_clean":"2024-08-31T05:28:59.489971+0000","last_became_active":"2024-08-31T05:26:14.178188+0000","last_became_peered":"2024-08-31T05:26:14.178188+0000","last_unstale":"2024-08-31T05:28:59.489971+0000","last_undegraded":"2024-08-31T05:28:59.489971+0000","last_fullsized":"2024-08-31T05:28:59.489971+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:22:50.516233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:22:50.516233+0000","last_clean_scrub_stamp":"2024-08-31T05:22:50.516233+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:10:01.719715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"85'1","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.490210+0000","last_change":"2024-08-31T05:27:38.289721+0000","last_active":"2024-08-31T05:28:59.490210+0000","last_peered":"2024-08-31T05:28:59.490210+0000","last_clean":"2024-08-31T05:28:59.490210+0000","last_became_active":"2024-08-31T05:27:38.289165+0000","last_became_peered":"2024-08-31T05:27:38.289165+0000","last_unstale":"2024-08-31T05:28:59.490210+0000","last_undegraded":"2024-08-31T05:28:59.490210+0000","last_fullsized":"2024-08-31T05:28:59.490210+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:00:30.689093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.490247+0000","last_change":"2024-08-31T05:27:31.256262+0000","last_active":"2024-08-31T05:28:59.490247+0000","last_peered":"2024-08-31T05:28:59.490247+0000","last_clean":"2024-08-31T05:28:59.490247+0000","last_became_active":"2024-08-31T05:27:31.255644+0000","last_became_peered":"2024-08-31T05:27:31.255644+0000","last_unstale":"2024-08-31T05:28:59.490247+0000","last_undegraded":"2024-08-31T05:28:59.490247+0000","last_fullsized":"2024-08-31T05:28:59.490247+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:50:18.158645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'5","reported_seq":103,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:07.697139+0000","last_change":"2024-08-31T05:27:29.392666+0000","last_active":"2024-08-31T05:29:07.697139+0000","last_peered":"2024-08-31T05:29:07.697139+0000","last_clean":"2024-08-31T05:29:07.697139+0000","last_became_active":"2024-08-31T05:27:29.392153+0000","last_became_peered":"2024-08-31T05:27:29.392153+0000","last_unstale":"2024-08-31T05:29:07.697139+0000","last_undegraded":"2024-08-31T05:29:07.697139+0000","last_fullsized":"2024-08-31T05:29:07.697139+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:53:02.713022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":59,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.662519+0000","last_change":"2024-08-31T05:27:38.291459+0000","last_active":"2024-08-31T05:28:59.662519+0000","last_peered":"2024-08-31T05:28:59.662519+0000","last_clean":"2024-08-31T05:28:59.662519+0000","last_became_active":"2024-08-31T05:27:38.291013+0000","last_became_peered":"2024-08-31T05:27:38.291013+0000","last_unstale":"2024-08-31T05:28:59.662519+0000","last_undegraded":"2024-08-31T05:28:59.662519+0000","last_fullsized":"2024-08-31T05:28:59.662519+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:03:46.921137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.489301+0000","last_change":"2024-08-31T05:27:31.251641+0000","last_active":"2024-08-31T05:28:59.489301+0000","last_peered":"2024-08-31T05:28:59.489301+0000","last_clean":"2024-08-31T05:28:59.489301+0000","last_became_active":"2024-08-31T05:27:31.251242+0000","last_became_peered":"2024-08-31T05:27:31.251242+0000","last_unstale":"2024-08-31T05:28:59.489301+0000","last_undegraded":"2024-08-31T05:28:59.489301+0000","last_fullsized":"2024-08-31T05:28:59.489301+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:13:58.227136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'3","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161631+0000","last_change":"2024-08-31T05:27:29.238028+0000","last_active":"2024-08-31T05:28:59.161631+0000","last_peered":"2024-08-31T05:28:59.161631+0000","last_clean":"2024-08-31T05:28:59.161631+0000","last_became_active":"2024-08-31T05:27:29.237449+0000","last_became_peered":"2024-08-31T05:27:29.237449+0000","last_unstale":"2024-08-31T05:28:59.161631+0000","last_undegraded":"2024-08-31T05:28:59.161631+0000","last_fullsized":"2024-08-31T05:28:59.161631+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:13:15.447707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.660642+0000","last_change":"2024-08-31T05:27:38.294072+0000","last_active":"2024-08-31T05:28:59.660642+0000","last_peered":"2024-08-31T05:28:59.660642+0000","last_clean":"2024-08-31T05:28:59.660642+0000","last_became_active":"2024-08-31T05:27:38.293642+0000","last_became_peered":"2024-08-31T05:27:38.293642+0000","last_unstale":"2024-08-31T05:28:59.660642+0000","last_undegraded":"2024-08-31T05:28:59.660642+0000","last_fullsized":"2024-08-31T05:28:59.660642+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:57:41.854799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.489357+0000","last_change":"2024-08-31T05:27:31.253601+0000","last_active":"2024-08-31T05:28:59.489357+0000","last_peered":"2024-08-31T05:28:59.489357+0000","last_clean":"2024-08-31T05:28:59.489357+0000","last_became_active":"2024-08-31T05:27:31.253216+0000","last_became_peered":"2024-08-31T05:27:31.253216+0000","last_unstale":"2024-08-31T05:28:59.489357+0000","last_undegraded":"2024-08-31T05:28:59.489357+0000","last_fullsized":"2024-08-31T05:28:59.489357+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:46:12.757944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'5","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.162277+0000","last_change":"2024-08-31T05:27:29.236851+0000","last_active":"2024-08-31T05:28:59.162277+0000","last_peered":"2024-08-31T05:28:59.162277+0000","last_clean":"2024-08-31T05:28:59.162277+0000","last_became_active":"2024-08-31T05:27:29.236473+0000","last_became_peered":"2024-08-31T05:27:29.236473+0000","last_unstale":"2024-08-31T05:28:59.162277+0000","last_undegraded":"2024-08-31T05:28:59.162277+0000","last_fullsized":"2024-08-31T05:28:59.162277+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:01:23.838417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.160488+0000","last_change":"2024-08-31T05:27:38.290069+0000","last_active":"2024-08-31T05:28:59.160488+0000","last_peered":"2024-08-31T05:28:59.160488+0000","last_clean":"2024-08-31T05:28:59.160488+0000","last_became_active":"2024-08-31T05:27:38.289507+0000","last_became_peered":"2024-08-31T05:27:38.289507+0000","last_unstale":"2024-08-31T05:28:59.160488+0000","last_undegraded":"2024-08-31T05:28:59.160488+0000","last_fullsized":"2024-08-31T05:28:59.160488+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:24:33.326308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.481508+0000","last_change":"2024-08-31T05:27:31.252787+0000","last_active":"2024-08-31T05:28:59.481508+0000","last_peered":"2024-08-31T05:28:59.481508+0000","last_clean":"2024-08-31T05:28:59.481508+0000","last_became_active":"2024-08-31T05:27:31.252392+0000","last_became_peered":"2024-08-31T05:27:31.252392+0000","last_unstale":"2024-08-31T05:28:59.481508+0000","last_undegraded":"2024-08-31T05:28:59.481508+0000","last_fullsized":"2024-08-31T05:28:59.481508+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:47:06.613616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.166173+0000","last_change":"2024-08-31T05:27:29.240293+0000","last_active":"2024-08-31T05:28:59.166173+0000","last_peered":"2024-08-31T05:28:59.166173+0000","last_clean":"2024-08-31T05:28:59.166173+0000","last_became_active":"2024-08-31T05:27:29.239889+0000","last_became_peered":"2024-08-31T05:27:29.239889+0000","last_unstale":"2024-08-31T05:28:59.166173+0000","last_undegraded":"2024-08-31T05:28:59.166173+0000","last_fullsized":"2024-08-31T05:28:59.166173+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:55:03.524475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.160712+0000","last_change":"2024-08-31T05:27:38.290715+0000","last_active":"2024-08-31T05:28:59.160712+0000","last_peered":"2024-08-31T05:28:59.160712+0000","last_clean":"2024-08-31T05:28:59.160712+0000","last_became_active":"2024-08-31T05:27:38.290227+0000","last_became_peered":"2024-08-31T05:27:38.290227+0000","last_unstale":"2024-08-31T05:28:59.160712+0000","last_undegraded":"2024-08-31T05:28:59.160712+0000","last_fullsized":"2024-08-31T05:28:59.160712+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:09:38.349046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.160794+0000","last_change":"2024-08-31T05:27:31.265672+0000","last_active":"2024-08-31T05:28:59.160794+0000","last_peered":"2024-08-31T05:28:59.160794+0000","last_clean":"2024-08-31T05:28:59.160794+0000","last_became_active":"2024-08-31T05:27:31.265332+0000","last_became_peered":"2024-08-31T05:27:31.265332+0000","last_unstale":"2024-08-31T05:28:59.160794+0000","last_undegraded":"2024-08-31T05:28:59.160794+0000","last_fullsized":"2024-08-31T05:28:59.160794+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:45:01.868256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"85'17","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.165055+0000","last_change":"2024-08-31T05:27:29.281129+0000","last_active":"2024-08-31T05:28:59.165055+0000","last_peered":"2024-08-31T05:28:59.165055+0000","last_clean":"2024-08-31T05:28:59.165055+0000","last_became_active":"2024-08-31T05:27:29.280613+0000","last_became_peered":"2024-08-31T05:27:29.280613+0000","last_unstale":"2024-08-31T05:28:59.165055+0000","last_undegraded":"2024-08-31T05:28:59.165055+0000","last_fullsized":"2024-08-31T05:28:59.165055+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:17:28.103371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.483707+0000","last_change":"2024-08-31T05:28:59.483629+0000","last_active":"2024-08-31T05:28:59.483707+0000","last_peered":"2024-08-31T05:28:59.483707+0000","last_clean":"2024-08-31T05:28:59.483707+0000","last_became_active":"2024-08-31T05:28:59.483102+0000","last_became_peered":"2024-08-31T05:28:59.483102+0000","last_unstale":"2024-08-31T05:28:59.483707+0000","last_undegraded":"2024-08-31T05:28:59.483707+0000","last_fullsized":"2024-08-31T05:28:59.483707+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:54:18.587227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,8,11],"acting":[6,3,8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.489660+0000","last_change":"2024-08-31T05:27:58.505480+0000","last_active":"2024-08-31T05:28:59.489660+0000","last_peered":"2024-08-31T05:28:59.489660+0000","last_clean":"2024-08-31T05:28:59.489660+0000","last_became_active":"2024-08-31T05:27:58.504773+0000","last_became_peered":"2024-08-31T05:27:58.504773+0000","last_unstale":"2024-08-31T05:28:59.489660+0000","last_undegraded":"2024-08-31T05:28:59.489660+0000","last_fullsized":"2024-08-31T05:28:59.489660+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:48:59.979443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'5","reported_seq":103,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:07.669145+0000","last_change":"2024-08-31T05:27:29.239308+0000","last_active":"2024-08-31T05:29:07.669145+0000","last_peered":"2024-08-31T05:29:07.669145+0000","last_clean":"2024-08-31T05:29:07.669145+0000","last_became_active":"2024-08-31T05:27:29.238793+0000","last_became_peered":"2024-08-31T05:27:29.238793+0000","last_unstale":"2024-08-31T05:29:07.669145+0000","last_undegraded":"2024-08-31T05:29:07.669145+0000","last_fullsized":"2024-08-31T05:29:07.669145+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:20:47.837021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":60,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.657165+0000","last_change":"2024-08-31T05:27:38.287260+0000","last_active":"2024-08-31T05:28:59.657165+0000","last_peered":"2024-08-31T05:28:59.657165+0000","last_clean":"2024-08-31T05:28:59.657165+0000","last_became_active":"2024-08-31T05:27:38.286250+0000","last_became_peered":"2024-08-31T05:27:38.286250+0000","last_unstale":"2024-08-31T05:28:59.657165+0000","last_undegraded":"2024-08-31T05:28:59.657165+0000","last_fullsized":"2024-08-31T05:28:59.657165+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:17:55.530114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.489260+0000","last_change":"2024-08-31T05:27:31.251152+0000","last_active":"2024-08-31T05:28:59.489260+0000","last_peered":"2024-08-31T05:28:59.489260+0000","last_clean":"2024-08-31T05:28:59.489260+0000","last_became_active":"2024-08-31T05:27:31.250686+0000","last_became_peered":"2024-08-31T05:27:31.250686+0000","last_unstale":"2024-08-31T05:28:59.489260+0000","last_undegraded":"2024-08-31T05:28:59.489260+0000","last_fullsized":"2024-08-31T05:28:59.489260+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:03:37.359332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"85'5","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.160924+0000","last_change":"2024-08-31T05:27:29.237404+0000","last_active":"2024-08-31T05:28:59.160924+0000","last_peered":"2024-08-31T05:28:59.160924+0000","last_clean":"2024-08-31T05:28:59.160924+0000","last_became_active":"2024-08-31T05:27:29.236695+0000","last_became_peered":"2024-08-31T05:27:29.236695+0000","last_unstale":"2024-08-31T05:28:59.160924+0000","last_undegraded":"2024-08-31T05:28:59.160924+0000","last_fullsized":"2024-08-31T05:28:59.160924+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:25:05.174288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.481862+0000","last_change":"2024-08-31T05:27:38.296553+0000","last_active":"2024-08-31T05:28:59.481862+0000","last_peered":"2024-08-31T05:28:59.481862+0000","last_clean":"2024-08-31T05:28:59.481862+0000","last_became_active":"2024-08-31T05:27:38.296118+0000","last_became_peered":"2024-08-31T05:27:38.296118+0000","last_unstale":"2024-08-31T05:28:59.481862+0000","last_undegraded":"2024-08-31T05:28:59.481862+0000","last_fullsized":"2024-08-31T05:28:59.481862+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:10:41.334260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161383+0000","last_change":"2024-08-31T05:27:31.250584+0000","last_active":"2024-08-31T05:28:59.161383+0000","last_peered":"2024-08-31T05:28:59.161383+0000","last_clean":"2024-08-31T05:28:59.161383+0000","last_became_active":"2024-08-31T05:27:31.250234+0000","last_became_peered":"2024-08-31T05:27:31.250234+0000","last_unstale":"2024-08-31T05:28:59.161383+0000","last_undegraded":"2024-08-31T05:28:59.161383+0000","last_fullsized":"2024-08-31T05:28:59.161383+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:00:39.648236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"85'9","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.661515+0000","last_change":"2024-08-31T05:27:29.237956+0000","last_active":"2024-08-31T05:28:59.661515+0000","last_peered":"2024-08-31T05:28:59.661515+0000","last_clean":"2024-08-31T05:28:59.661515+0000","last_became_active":"2024-08-31T05:27:29.237510+0000","last_became_peered":"2024-08-31T05:27:29.237510+0000","last_unstale":"2024-08-31T05:28:59.661515+0000","last_undegraded":"2024-08-31T05:28:59.661515+0000","last_fullsized":"2024-08-31T05:28:59.661515+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:18:44.295298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161323+0000","last_change":"2024-08-31T05:27:38.289472+0000","last_active":"2024-08-31T05:28:59.161323+0000","last_peered":"2024-08-31T05:28:59.161323+0000","last_clean":"2024-08-31T05:28:59.161323+0000","last_became_active":"2024-08-31T05:27:38.288809+0000","last_became_peered":"2024-08-31T05:27:38.288809+0000","last_unstale":"2024-08-31T05:28:59.161323+0000","last_undegraded":"2024-08-31T05:28:59.161323+0000","last_fullsized":"2024-08-31T05:28:59.161323+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:17:06.430110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.165669+0000","last_change":"2024-08-31T05:27:31.258103+0000","last_active":"2024-08-31T05:28:59.165669+0000","last_peered":"2024-08-31T05:28:59.165669+0000","last_clean":"2024-08-31T05:28:59.165669+0000","last_became_active":"2024-08-31T05:27:31.257257+0000","last_became_peered":"2024-08-31T05:27:31.257257+0000","last_unstale":"2024-08-31T05:28:59.165669+0000","last_undegraded":"2024-08-31T05:28:59.165669+0000","last_fullsized":"2024-08-31T05:28:59.165669+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:16:01.309646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"85'35","reported_seq":194,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:07.670553+0000","last_change":"2024-08-31T05:27:29.241129+0000","last_active":"2024-08-31T05:29:07.670553+0000","last_peered":"2024-08-31T05:29:07.670553+0000","last_clean":"2024-08-31T05:29:07.670553+0000","last_became_active":"2024-08-31T05:27:29.240708+0000","last_became_peered":"2024-08-31T05:27:29.240708+0000","last_unstale":"2024-08-31T05:29:07.670553+0000","last_undegraded":"2024-08-31T05:29:07.670553+0000","last_fullsized":"2024-08-31T05:29:07.670553+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:20:10.127588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62072,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":120,"num_read_kb":121,"num_write":37,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.656759+0000","last_change":"2024-08-31T05:27:38.291037+0000","last_active":"2024-08-31T05:28:59.656759+0000","last_peered":"2024-08-31T05:28:59.656759+0000","last_clean":"2024-08-31T05:28:59.656759+0000","last_became_active":"2024-08-31T05:27:38.290592+0000","last_became_peered":"2024-08-31T05:27:38.290592+0000","last_unstale":"2024-08-31T05:28:59.656759+0000","last_undegraded":"2024-08-31T05:28:59.656759+0000","last_fullsized":"2024-08-31T05:28:59.656759+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:12:56.391784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.662797+0000","last_change":"2024-08-31T05:27:58.508403+0000","last_active":"2024-08-31T05:28:59.662797+0000","last_peered":"2024-08-31T05:28:59.662797+0000","last_clean":"2024-08-31T05:28:59.662797+0000","last_became_active":"2024-08-31T05:27:58.507918+0000","last_became_peered":"2024-08-31T05:27:58.507918+0000","last_unstale":"2024-08-31T05:28:59.662797+0000","last_undegraded":"2024-08-31T05:28:59.662797+0000","last_fullsized":"2024-08-31T05:28:59.662797+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:47:54.479249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,7],"acting":[1,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"85'5","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161508+0000","last_change":"2024-08-31T05:27:29.281231+0000","last_active":"2024-08-31T05:28:59.161508+0000","last_peered":"2024-08-31T05:28:59.161508+0000","last_clean":"2024-08-31T05:28:59.161508+0000","last_became_active":"2024-08-31T05:27:29.280748+0000","last_became_peered":"2024-08-31T05:27:29.280748+0000","last_unstale":"2024-08-31T05:28:59.161508+0000","last_undegraded":"2024-08-31T05:28:59.161508+0000","last_fullsized":"2024-08-31T05:28:59.161508+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:43:44.783595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.663952+0000","last_change":"2024-08-31T05:28:59.663824+0000","last_active":"2024-08-31T05:28:59.663952+0000","last_peered":"2024-08-31T05:28:59.663952+0000","last_clean":"2024-08-31T05:28:59.663952+0000","last_became_active":"2024-08-31T05:28:59.663270+0000","last_became_peered":"2024-08-31T05:28:59.663270+0000","last_unstale":"2024-08-31T05:28:59.663952+0000","last_undegraded":"2024-08-31T05:28:59.663952+0000","last_fullsized":"2024-08-31T05:28:59.663952+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:23:26.836655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.660028+0000","last_change":"2024-08-31T05:27:31.258030+0000","last_active":"2024-08-31T05:28:59.660028+0000","last_peered":"2024-08-31T05:28:59.660028+0000","last_clean":"2024-08-31T05:28:59.660028+0000","last_became_active":"2024-08-31T05:27:31.257410+0000","last_became_peered":"2024-08-31T05:27:31.257410+0000","last_unstale":"2024-08-31T05:28:59.660028+0000","last_undegraded":"2024-08-31T05:28:59.660028+0000","last_fullsized":"2024-08-31T05:28:59.660028+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:48:27.716531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"85'4","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.490273+0000","last_change":"2024-08-31T05:27:29.239560+0000","last_active":"2024-08-31T05:28:59.490273+0000","last_peered":"2024-08-31T05:28:59.490273+0000","last_clean":"2024-08-31T05:28:59.490273+0000","last_became_active":"2024-08-31T05:27:29.239154+0000","last_became_peered":"2024-08-31T05:27:29.239154+0000","last_unstale":"2024-08-31T05:28:59.490273+0000","last_undegraded":"2024-08-31T05:28:59.490273+0000","last_fullsized":"2024-08-31T05:28:59.490273+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:29:36.983690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.656552+0000","last_change":"2024-08-31T05:27:38.297596+0000","last_active":"2024-08-31T05:28:59.656552+0000","last_peered":"2024-08-31T05:28:59.656552+0000","last_clean":"2024-08-31T05:28:59.656552+0000","last_became_active":"2024-08-31T05:27:38.295127+0000","last_became_peered":"2024-08-31T05:27:38.295127+0000","last_unstale":"2024-08-31T05:28:59.656552+0000","last_undegraded":"2024-08-31T05:28:59.656552+0000","last_fullsized":"2024-08-31T05:28:59.656552+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:50:09.363872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.663130+0000","last_change":"2024-08-31T05:27:31.262036+0000","last_active":"2024-08-31T05:28:59.663130+0000","last_peered":"2024-08-31T05:28:59.663130+0000","last_clean":"2024-08-31T05:28:59.663130+0000","last_became_active":"2024-08-31T05:27:31.261589+0000","last_became_peered":"2024-08-31T05:27:31.261589+0000","last_unstale":"2024-08-31T05:28:59.663130+0000","last_undegraded":"2024-08-31T05:28:59.663130+0000","last_fullsized":"2024-08-31T05:28:59.663130+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:24:17.677639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"85'4","reported_seq":155,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:07.671217+0000","last_change":"2024-08-31T05:27:29.233381+0000","last_active":"2024-08-31T05:29:07.671217+0000","last_peered":"2024-08-31T05:29:07.671217+0000","last_clean":"2024-08-31T05:29:07.671217+0000","last_became_active":"2024-08-31T05:27:29.232959+0000","last_became_peered":"2024-08-31T05:27:29.232959+0000","last_unstale":"2024-08-31T05:29:07.671217+0000","last_undegraded":"2024-08-31T05:29:07.671217+0000","last_fullsized":"2024-08-31T05:29:07.671217+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:50:16.901373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":112,"num_read_kb":112,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.159157+0000","last_change":"2024-08-31T05:27:38.288798+0000","last_active":"2024-08-31T05:28:59.159157+0000","last_peered":"2024-08-31T05:28:59.159157+0000","last_clean":"2024-08-31T05:28:59.159157+0000","last_became_active":"2024-08-31T05:27:38.288369+0000","last_became_peered":"2024-08-31T05:27:38.288369+0000","last_unstale":"2024-08-31T05:28:59.159157+0000","last_undegraded":"2024-08-31T05:28:59.159157+0000","last_fullsized":"2024-08-31T05:28:59.159157+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:52:45.680480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.660805+0000","last_change":"2024-08-31T05:27:38.290029+0000","last_active":"2024-08-31T05:28:59.660805+0000","last_peered":"2024-08-31T05:28:59.660805+0000","last_clean":"2024-08-31T05:28:59.660805+0000","last_became_active":"2024-08-31T05:27:38.289638+0000","last_became_peered":"2024-08-31T05:27:38.289638+0000","last_unstale":"2024-08-31T05:28:59.660805+0000","last_undegraded":"2024-08-31T05:28:59.660805+0000","last_fullsized":"2024-08-31T05:28:59.660805+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:10:34.521418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.656378+0000","last_change":"2024-08-31T05:27:31.241057+0000","last_active":"2024-08-31T05:28:59.656378+0000","last_peered":"2024-08-31T05:28:59.656378+0000","last_clean":"2024-08-31T05:28:59.656378+0000","last_became_active":"2024-08-31T05:27:31.240660+0000","last_became_peered":"2024-08-31T05:27:31.240660+0000","last_unstale":"2024-08-31T05:28:59.656378+0000","last_undegraded":"2024-08-31T05:28:59.656378+0000","last_fullsized":"2024-08-31T05:28:59.656378+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:16:49.730980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"85'3","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.160858+0000","last_change":"2024-08-31T05:27:29.240293+0000","last_active":"2024-08-31T05:28:59.160858+0000","last_peered":"2024-08-31T05:28:59.160858+0000","last_clean":"2024-08-31T05:28:59.160858+0000","last_became_active":"2024-08-31T05:27:29.239889+0000","last_became_peered":"2024-08-31T05:27:29.239889+0000","last_unstale":"2024-08-31T05:28:59.160858+0000","last_undegraded":"2024-08-31T05:28:59.160858+0000","last_fullsized":"2024-08-31T05:28:59.160858+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:20:49.121008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.481999+0000","last_change":"2024-08-31T05:27:38.294174+0000","last_active":"2024-08-31T05:28:59.481999+0000","last_peered":"2024-08-31T05:28:59.481999+0000","last_clean":"2024-08-31T05:28:59.481999+0000","last_became_active":"2024-08-31T05:27:38.293747+0000","last_became_peered":"2024-08-31T05:27:38.293747+0000","last_unstale":"2024-08-31T05:28:59.481999+0000","last_undegraded":"2024-08-31T05:28:59.481999+0000","last_fullsized":"2024-08-31T05:28:59.481999+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:35:46.124473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.159200+0000","last_change":"2024-08-31T05:27:31.244942+0000","last_active":"2024-08-31T05:28:59.159200+0000","last_peered":"2024-08-31T05:28:59.159200+0000","last_clean":"2024-08-31T05:28:59.159200+0000","last_became_active":"2024-08-31T05:27:31.244608+0000","last_became_peered":"2024-08-31T05:27:31.244608+0000","last_unstale":"2024-08-31T05:28:59.159200+0000","last_undegraded":"2024-08-31T05:28:59.159200+0000","last_fullsized":"2024-08-31T05:28:59.159200+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:50:13.651172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"85'3","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161085+0000","last_change":"2024-08-31T05:27:29.236832+0000","last_active":"2024-08-31T05:28:59.161085+0000","last_peered":"2024-08-31T05:28:59.161085+0000","last_clean":"2024-08-31T05:28:59.161085+0000","last_became_active":"2024-08-31T05:27:29.236326+0000","last_became_peered":"2024-08-31T05:27:29.236326+0000","last_unstale":"2024-08-31T05:28:59.161085+0000","last_undegraded":"2024-08-31T05:28:59.161085+0000","last_fullsized":"2024-08-31T05:28:59.161085+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:43:26.199499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"85'7","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.659350+0000","last_change":"2024-08-31T05:27:29.237409+0000","last_active":"2024-08-31T05:28:59.659350+0000","last_peered":"2024-08-31T05:28:59.659350+0000","last_clean":"2024-08-31T05:28:59.659350+0000","last_became_active":"2024-08-31T05:27:29.236928+0000","last_became_peered":"2024-08-31T05:27:29.236928+0000","last_unstale":"2024-08-31T05:28:59.659350+0000","last_undegraded":"2024-08-31T05:28:59.659350+0000","last_fullsized":"2024-08-31T05:28:59.659350+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:07:53.917242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161147+0000","last_change":"2024-08-31T05:27:31.263005+0000","last_active":"2024-08-31T05:28:59.161147+0000","last_peered":"2024-08-31T05:28:59.161147+0000","last_clean":"2024-08-31T05:28:59.161147+0000","last_became_active":"2024-08-31T05:27:31.262638+0000","last_became_peered":"2024-08-31T05:27:31.262638+0000","last_unstale":"2024-08-31T05:28:59.161147+0000","last_undegraded":"2024-08-31T05:28:59.161147+0000","last_fullsized":"2024-08-31T05:28:59.161147+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:35:06.094346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.661429+0000","last_change":"2024-08-31T05:27:38.293067+0000","last_active":"2024-08-31T05:28:59.661429+0000","last_peered":"2024-08-31T05:28:59.661429+0000","last_clean":"2024-08-31T05:28:59.661429+0000","last_became_active":"2024-08-31T05:27:38.292413+0000","last_became_peered":"2024-08-31T05:27:38.292413+0000","last_unstale":"2024-08-31T05:28:59.661429+0000","last_undegraded":"2024-08-31T05:28:59.661429+0000","last_fullsized":"2024-08-31T05:28:59.661429+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:26:12.248341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"85'6","reported_seq":112,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:07.671654+0000","last_change":"2024-08-31T05:27:58.652458+0000","last_active":"2024-08-31T05:29:07.671654+0000","last_peered":"2024-08-31T05:29:07.671654+0000","last_clean":"2024-08-31T05:29:07.671654+0000","last_became_active":"2024-08-31T05:27:58.652037+0000","last_became_peered":"2024-08-31T05:27:58.652037+0000","last_unstale":"2024-08-31T05:29:07.671654+0000","last_undegraded":"2024-08-31T05:29:07.671654+0000","last_fullsized":"2024-08-31T05:29:07.671654+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:44:45.839429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":60,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.165439+0000","last_change":"2024-08-31T05:27:31.253835+0000","last_active":"2024-08-31T05:28:59.165439+0000","last_peered":"2024-08-31T05:28:59.165439+0000","last_clean":"2024-08-31T05:28:59.165439+0000","last_became_active":"2024-08-31T05:27:31.252828+0000","last_became_peered":"2024-08-31T05:27:31.252828+0000","last_unstale":"2024-08-31T05:28:59.165439+0000","last_undegraded":"2024-08-31T05:28:59.165439+0000","last_fullsized":"2024-08-31T05:28:59.165439+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:59:29.987345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.661608+0000","last_change":"2024-08-31T05:27:38.292690+0000","last_active":"2024-08-31T05:28:59.661608+0000","last_peered":"2024-08-31T05:28:59.661608+0000","last_clean":"2024-08-31T05:28:59.661608+0000","last_became_active":"2024-08-31T05:27:38.292195+0000","last_became_peered":"2024-08-31T05:27:38.292195+0000","last_unstale":"2024-08-31T05:28:59.661608+0000","last_undegraded":"2024-08-31T05:28:59.661608+0000","last_fullsized":"2024-08-31T05:28:59.661608+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:50:06.142879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.481425+0000","last_change":"2024-08-31T05:27:31.253706+0000","last_active":"2024-08-31T05:28:59.481425+0000","last_peered":"2024-08-31T05:28:59.481425+0000","last_clean":"2024-08-31T05:28:59.481425+0000","last_became_active":"2024-08-31T05:27:31.253343+0000","last_became_peered":"2024-08-31T05:27:31.253343+0000","last_unstale":"2024-08-31T05:28:59.481425+0000","last_undegraded":"2024-08-31T05:28:59.481425+0000","last_fullsized":"2024-08-31T05:28:59.481425+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:40:28.318153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.661731+0000","last_change":"2024-08-31T05:27:58.651669+0000","last_active":"2024-08-31T05:28:59.661731+0000","last_peered":"2024-08-31T05:28:59.661731+0000","last_clean":"2024-08-31T05:28:59.661731+0000","last_became_active":"2024-08-31T05:27:58.651273+0000","last_became_peered":"2024-08-31T05:27:58.651273+0000","last_unstale":"2024-08-31T05:28:59.661731+0000","last_undegraded":"2024-08-31T05:28:59.661731+0000","last_fullsized":"2024-08-31T05:28:59.661731+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:37:42.960124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.660502+0000","last_change":"2024-08-31T05:27:31.257648+0000","last_active":"2024-08-31T05:28:59.660502+0000","last_peered":"2024-08-31T05:28:59.660502+0000","last_clean":"2024-08-31T05:28:59.660502+0000","last_became_active":"2024-08-31T05:27:31.257140+0000","last_became_peered":"2024-08-31T05:27:31.257140+0000","last_unstale":"2024-08-31T05:28:59.660502+0000","last_undegraded":"2024-08-31T05:28:59.660502+0000","last_fullsized":"2024-08-31T05:28:59.660502+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:02:15.249225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.659970+0000","last_change":"2024-08-31T05:27:31.264968+0000","last_active":"2024-08-31T05:28:59.659970+0000","last_peered":"2024-08-31T05:28:59.659970+0000","last_clean":"2024-08-31T05:28:59.659970+0000","last_became_active":"2024-08-31T05:27:31.264629+0000","last_became_peered":"2024-08-31T05:27:31.264629+0000","last_unstale":"2024-08-31T05:28:59.659970+0000","last_undegraded":"2024-08-31T05:28:59.659970+0000","last_fullsized":"2024-08-31T05:28:59.659970+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:28:15.283607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.162118+0000","last_change":"2024-08-31T05:27:31.252358+0000","last_active":"2024-08-31T05:28:59.162118+0000","last_peered":"2024-08-31T05:28:59.162118+0000","last_clean":"2024-08-31T05:28:59.162118+0000","last_became_active":"2024-08-31T05:27:31.252013+0000","last_became_peered":"2024-08-31T05:27:31.252013+0000","last_unstale":"2024-08-31T05:28:59.162118+0000","last_undegraded":"2024-08-31T05:28:59.162118+0000","last_fullsized":"2024-08-31T05:28:59.162118+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:48:47.287168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.481430+0000","last_change":"2024-08-31T05:27:31.262626+0000","last_active":"2024-08-31T05:28:59.481430+0000","last_peered":"2024-08-31T05:28:59.481430+0000","last_clean":"2024-08-31T05:28:59.481430+0000","last_became_active":"2024-08-31T05:27:31.262190+0000","last_became_peered":"2024-08-31T05:27:31.262190+0000","last_unstale":"2024-08-31T05:28:59.481430+0000","last_undegraded":"2024-08-31T05:28:59.481430+0000","last_fullsized":"2024-08-31T05:28:59.481430+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:39:19.454606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.660542+0000","last_change":"2024-08-31T05:27:31.254482+0000","last_active":"2024-08-31T05:28:59.660542+0000","last_peered":"2024-08-31T05:28:59.660542+0000","last_clean":"2024-08-31T05:28:59.660542+0000","last_became_active":"2024-08-31T05:27:31.254103+0000","last_became_peered":"2024-08-31T05:27:31.254103+0000","last_unstale":"2024-08-31T05:28:59.660542+0000","last_undegraded":"2024-08-31T05:28:59.660542+0000","last_fullsized":"2024-08-31T05:28:59.660542+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:20:57.333359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.159513+0000","last_change":"2024-08-31T05:27:58.505928+0000","last_active":"2024-08-31T05:28:59.159513+0000","last_peered":"2024-08-31T05:28:59.159513+0000","last_clean":"2024-08-31T05:28:59.159513+0000","last_became_active":"2024-08-31T05:27:58.505527+0000","last_became_peered":"2024-08-31T05:27:58.505527+0000","last_unstale":"2024-08-31T05:28:59.159513+0000","last_undegraded":"2024-08-31T05:28:59.159513+0000","last_fullsized":"2024-08-31T05:28:59.159513+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:44:30.754350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.160624+0000","last_change":"2024-08-31T05:27:31.262385+0000","last_active":"2024-08-31T05:28:59.160624+0000","last_peered":"2024-08-31T05:28:59.160624+0000","last_clean":"2024-08-31T05:28:59.160624+0000","last_became_active":"2024-08-31T05:27:31.262089+0000","last_became_peered":"2024-08-31T05:27:31.262089+0000","last_unstale":"2024-08-31T05:28:59.160624+0000","last_undegraded":"2024-08-31T05:28:59.160624+0000","last_fullsized":"2024-08-31T05:28:59.160624+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:50:17.172462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.159224+0000","last_change":"2024-08-31T05:27:31.249162+0000","last_active":"2024-08-31T05:28:59.159224+0000","last_peered":"2024-08-31T05:28:59.159224+0000","last_clean":"2024-08-31T05:28:59.159224+0000","last_became_active":"2024-08-31T05:27:31.248803+0000","last_became_peered":"2024-08-31T05:27:31.248803+0000","last_unstale":"2024-08-31T05:28:59.159224+0000","last_undegraded":"2024-08-31T05:28:59.159224+0000","last_fullsized":"2024-08-31T05:28:59.159224+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:18:05.449612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.661991+0000","last_change":"2024-08-31T05:27:31.258983+0000","last_active":"2024-08-31T05:28:59.661991+0000","last_peered":"2024-08-31T05:28:59.661991+0000","last_clean":"2024-08-31T05:28:59.661991+0000","last_became_active":"2024-08-31T05:27:31.258480+0000","last_became_peered":"2024-08-31T05:27:31.258480+0000","last_unstale":"2024-08-31T05:28:59.661991+0000","last_undegraded":"2024-08-31T05:28:59.661991+0000","last_fullsized":"2024-08-31T05:28:59.661991+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:57:34.589281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161481+0000","last_change":"2024-08-31T05:27:31.252561+0000","last_active":"2024-08-31T05:28:59.161481+0000","last_peered":"2024-08-31T05:28:59.161481+0000","last_clean":"2024-08-31T05:28:59.161481+0000","last_became_active":"2024-08-31T05:27:31.251963+0000","last_became_peered":"2024-08-31T05:27:31.251963+0000","last_unstale":"2024-08-31T05:28:59.161481+0000","last_undegraded":"2024-08-31T05:28:59.161481+0000","last_fullsized":"2024-08-31T05:28:59.161481+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:17:45.244329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.481388+0000","last_change":"2024-08-31T05:27:31.257298+0000","last_active":"2024-08-31T05:28:59.481388+0000","last_peered":"2024-08-31T05:28:59.481388+0000","last_clean":"2024-08-31T05:28:59.481388+0000","last_became_active":"2024-08-31T05:27:31.256935+0000","last_became_peered":"2024-08-31T05:27:31.256935+0000","last_unstale":"2024-08-31T05:28:59.481388+0000","last_undegraded":"2024-08-31T05:28:59.481388+0000","last_fullsized":"2024-08-31T05:28:59.481388+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:07:32.876328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.660555+0000","last_change":"2024-08-31T05:27:31.248456+0000","last_active":"2024-08-31T05:28:59.660555+0000","last_peered":"2024-08-31T05:28:59.660555+0000","last_clean":"2024-08-31T05:28:59.660555+0000","last_became_active":"2024-08-31T05:27:31.248060+0000","last_became_peered":"2024-08-31T05:27:31.248060+0000","last_unstale":"2024-08-31T05:28:59.660555+0000","last_undegraded":"2024-08-31T05:28:59.660555+0000","last_fullsized":"2024-08-31T05:28:59.660555+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:29:35.817409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.657320+0000","last_change":"2024-08-31T05:27:31.251345+0000","last_active":"2024-08-31T05:28:59.657320+0000","last_peered":"2024-08-31T05:28:59.657320+0000","last_clean":"2024-08-31T05:28:59.657320+0000","last_became_active":"2024-08-31T05:27:31.251002+0000","last_became_peered":"2024-08-31T05:27:31.251002+0000","last_unstale":"2024-08-31T05:28:59.657320+0000","last_undegraded":"2024-08-31T05:28:59.657320+0000","last_fullsized":"2024-08-31T05:28:59.657320+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:35:24.564897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.482395+0000","last_change":"2024-08-31T05:27:31.260681+0000","last_active":"2024-08-31T05:28:59.482395+0000","last_peered":"2024-08-31T05:28:59.482395+0000","last_clean":"2024-08-31T05:28:59.482395+0000","last_became_active":"2024-08-31T05:27:31.259445+0000","last_became_peered":"2024-08-31T05:27:31.259445+0000","last_unstale":"2024-08-31T05:28:59.482395+0000","last_undegraded":"2024-08-31T05:28:59.482395+0000","last_fullsized":"2024-08-31T05:28:59.482395+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:41:43.480946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.661479+0000","last_change":"2024-08-31T05:27:31.263950+0000","last_active":"2024-08-31T05:28:59.661479+0000","last_peered":"2024-08-31T05:28:59.661479+0000","last_clean":"2024-08-31T05:28:59.661479+0000","last_became_active":"2024-08-31T05:27:31.263568+0000","last_became_peered":"2024-08-31T05:27:31.263568+0000","last_unstale":"2024-08-31T05:28:59.661479+0000","last_undegraded":"2024-08-31T05:28:59.661479+0000","last_fullsized":"2024-08-31T05:28:59.661479+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:50:05.111796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.660326+0000","last_change":"2024-08-31T05:27:58.508829+0000","last_active":"2024-08-31T05:28:59.660326+0000","last_peered":"2024-08-31T05:28:59.660326+0000","last_clean":"2024-08-31T05:28:59.660326+0000","last_became_active":"2024-08-31T05:27:58.508378+0000","last_became_peered":"2024-08-31T05:27:58.508378+0000","last_unstale":"2024-08-31T05:28:59.660326+0000","last_undegraded":"2024-08-31T05:28:59.660326+0000","last_fullsized":"2024-08-31T05:28:59.660326+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:05:46.254003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.659965+0000","last_change":"2024-08-31T05:27:31.261012+0000","last_active":"2024-08-31T05:28:59.659965+0000","last_peered":"2024-08-31T05:28:59.659965+0000","last_clean":"2024-08-31T05:28:59.659965+0000","last_became_active":"2024-08-31T05:27:31.259373+0000","last_became_peered":"2024-08-31T05:27:31.259373+0000","last_unstale":"2024-08-31T05:28:59.659965+0000","last_undegraded":"2024-08-31T05:28:59.659965+0000","last_fullsized":"2024-08-31T05:28:59.659965+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:15:34.711961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161452+0000","last_change":"2024-08-31T05:27:31.255199+0000","last_active":"2024-08-31T05:28:59.161452+0000","last_peered":"2024-08-31T05:28:59.161452+0000","last_clean":"2024-08-31T05:28:59.161452+0000","last_became_active":"2024-08-31T05:27:31.254833+0000","last_became_peered":"2024-08-31T05:27:31.254833+0000","last_unstale":"2024-08-31T05:28:59.161452+0000","last_undegraded":"2024-08-31T05:28:59.161452+0000","last_fullsized":"2024-08-31T05:28:59.161452+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:55:09.426531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.160969+0000","last_change":"2024-08-31T05:27:31.264881+0000","last_active":"2024-08-31T05:28:59.160969+0000","last_peered":"2024-08-31T05:28:59.160969+0000","last_clean":"2024-08-31T05:28:59.160969+0000","last_became_active":"2024-08-31T05:27:31.264483+0000","last_became_peered":"2024-08-31T05:27:31.264483+0000","last_unstale":"2024-08-31T05:28:59.160969+0000","last_undegraded":"2024-08-31T05:28:59.160969+0000","last_fullsized":"2024-08-31T05:28:59.160969+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:48:55.193321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.489307+0000","last_change":"2024-08-31T05:27:31.258555+0000","last_active":"2024-08-31T05:28:59.489307+0000","last_peered":"2024-08-31T05:28:59.489307+0000","last_clean":"2024-08-31T05:28:59.489307+0000","last_became_active":"2024-08-31T05:27:31.258023+0000","last_became_peered":"2024-08-31T05:27:31.258023+0000","last_unstale":"2024-08-31T05:28:59.489307+0000","last_undegraded":"2024-08-31T05:28:59.489307+0000","last_fullsized":"2024-08-31T05:28:59.489307+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:26:34.911641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.658191+0000","last_change":"2024-08-31T05:27:31.249886+0000","last_active":"2024-08-31T05:28:59.658191+0000","last_peered":"2024-08-31T05:28:59.658191+0000","last_clean":"2024-08-31T05:28:59.658191+0000","last_became_active":"2024-08-31T05:27:31.248549+0000","last_became_peered":"2024-08-31T05:27:31.248549+0000","last_unstale":"2024-08-31T05:28:59.658191+0000","last_undegraded":"2024-08-31T05:28:59.658191+0000","last_fullsized":"2024-08-31T05:28:59.658191+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:57:55.743286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.661844+0000","last_change":"2024-08-31T05:27:31.261697+0000","last_active":"2024-08-31T05:28:59.661844+0000","last_peered":"2024-08-31T05:28:59.661844+0000","last_clean":"2024-08-31T05:28:59.661844+0000","last_became_active":"2024-08-31T05:27:31.260398+0000","last_became_peered":"2024-08-31T05:27:31.260398+0000","last_unstale":"2024-08-31T05:28:59.661844+0000","last_undegraded":"2024-08-31T05:28:59.661844+0000","last_fullsized":"2024-08-31T05:28:59.661844+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:08:03.999556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.159157+0000","last_change":"2024-08-31T05:27:31.256638+0000","last_active":"2024-08-31T05:28:59.159157+0000","last_peered":"2024-08-31T05:28:59.159157+0000","last_clean":"2024-08-31T05:28:59.159157+0000","last_became_active":"2024-08-31T05:27:31.256302+0000","last_became_peered":"2024-08-31T05:27:31.256302+0000","last_unstale":"2024-08-31T05:28:59.159157+0000","last_undegraded":"2024-08-31T05:28:59.159157+0000","last_fullsized":"2024-08-31T05:28:59.159157+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:31:58.946448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.489239+0000","last_change":"2024-08-31T05:27:31.253818+0000","last_active":"2024-08-31T05:28:59.489239+0000","last_peered":"2024-08-31T05:28:59.489239+0000","last_clean":"2024-08-31T05:28:59.489239+0000","last_became_active":"2024-08-31T05:27:31.253423+0000","last_became_peered":"2024-08-31T05:27:31.253423+0000","last_unstale":"2024-08-31T05:28:59.489239+0000","last_undegraded":"2024-08-31T05:28:59.489239+0000","last_fullsized":"2024-08-31T05:28:59.489239+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:45:43.951022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.658092+0000","last_change":"2024-08-31T05:27:31.247171+0000","last_active":"2024-08-31T05:28:59.658092+0000","last_peered":"2024-08-31T05:28:59.658092+0000","last_clean":"2024-08-31T05:28:59.658092+0000","last_became_active":"2024-08-31T05:27:31.246791+0000","last_became_peered":"2024-08-31T05:27:31.246791+0000","last_unstale":"2024-08-31T05:28:59.658092+0000","last_undegraded":"2024-08-31T05:28:59.658092+0000","last_fullsized":"2024-08-31T05:28:59.658092+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:26:12.163389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.165442+0000","last_change":"2024-08-31T05:27:31.257848+0000","last_active":"2024-08-31T05:28:59.165442+0000","last_peered":"2024-08-31T05:28:59.165442+0000","last_clean":"2024-08-31T05:28:59.165442+0000","last_became_active":"2024-08-31T05:27:31.257432+0000","last_became_peered":"2024-08-31T05:27:31.257432+0000","last_unstale":"2024-08-31T05:28:59.165442+0000","last_undegraded":"2024-08-31T05:28:59.165442+0000","last_fullsized":"2024-08-31T05:28:59.165442+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:08:12.512834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.160909+0000","last_change":"2024-08-31T05:27:31.263998+0000","last_active":"2024-08-31T05:28:59.160909+0000","last_peered":"2024-08-31T05:28:59.160909+0000","last_clean":"2024-08-31T05:28:59.160909+0000","last_became_active":"2024-08-31T05:27:31.263638+0000","last_became_peered":"2024-08-31T05:27:31.263638+0000","last_unstale":"2024-08-31T05:28:59.160909+0000","last_undegraded":"2024-08-31T05:28:59.160909+0000","last_fullsized":"2024-08-31T05:28:59.160909+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:07:50.470538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.660702+0000","last_change":"2024-08-31T05:27:31.260600+0000","last_active":"2024-08-31T05:28:59.660702+0000","last_peered":"2024-08-31T05:28:59.660702+0000","last_clean":"2024-08-31T05:28:59.660702+0000","last_became_active":"2024-08-31T05:27:31.259605+0000","last_became_peered":"2024-08-31T05:27:31.259605+0000","last_unstale":"2024-08-31T05:28:59.660702+0000","last_undegraded":"2024-08-31T05:28:59.660702+0000","last_fullsized":"2024-08-31T05:28:59.660702+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:04:16.861879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.660837+0000","last_change":"2024-08-31T05:27:31.256585+0000","last_active":"2024-08-31T05:28:59.660837+0000","last_peered":"2024-08-31T05:28:59.660837+0000","last_clean":"2024-08-31T05:28:59.660837+0000","last_became_active":"2024-08-31T05:27:31.256118+0000","last_became_peered":"2024-08-31T05:27:31.256118+0000","last_unstale":"2024-08-31T05:28:59.660837+0000","last_undegraded":"2024-08-31T05:28:59.660837+0000","last_fullsized":"2024-08-31T05:28:59.660837+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:47:18.891150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.482243+0000","last_change":"2024-08-31T05:27:31.260321+0000","last_active":"2024-08-31T05:28:59.482243+0000","last_peered":"2024-08-31T05:28:59.482243+0000","last_clean":"2024-08-31T05:28:59.482243+0000","last_became_active":"2024-08-31T05:27:31.259901+0000","last_became_peered":"2024-08-31T05:27:31.259901+0000","last_unstale":"2024-08-31T05:28:59.482243+0000","last_undegraded":"2024-08-31T05:28:59.482243+0000","last_fullsized":"2024-08-31T05:28:59.482243+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:44:26.651338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69276,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":600,"num_read_kb":377,"num_write":249,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":207828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":214,"ondisk_log_size":214,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":280617,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678050,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":966656,"data_stored":509480,"data_compressed":29581,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874279,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36440,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708712,"statfs":{"total":95995035648,"available":95957721088,"internally_reserved":0,"allocated":1114112,"data_stored":1158368,"data_compressed":65266,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037804,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36320,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708832,"statfs":{"total":95995035648,"available":95957843968,"internally_reserved":0,"allocated":995328,"data_stored":513506,"data_compressed":29581,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234032,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":978944,"data_stored":509116,"data_compressed":29581,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430261,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1040384,"data_stored":1106676,"data_compressed":65266,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593787,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":966656,"data_stored":505305,"data_compressed":29581,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790017,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36376,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708776,"statfs":{"total":95995035648,"available":95957786624,"internally_reserved":0,"allocated":1048576,"data_stored":1101867,"data_compressed":65266,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953542,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":983040,"data_stored":510001,"data_compressed":29581,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149771,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36304,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708848,"statfs":{"total":95995035648,"available":95957860352,"internally_reserved":0,"allocated":978944,"data_stored":504622,"data_compressed":29581,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378704,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36368,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708784,"statfs":{"total":95995035648,"available":95957794816,"internally_reserved":0,"allocated":1044480,"data_stored":567614,"data_compressed":29581,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542228,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36364,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708788,"statfs":{"total":95995035648,"available":95957798912,"internally_reserved":0,"allocated":1040384,"data_stored":569079,"data_compressed":29581,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705754,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36316,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708836,"statfs":{"total":95995035648,"available":95957848064,"internally_reserved":0,"allocated":991232,"data_stored":506370,"data_compressed":29581,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34064,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34064,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34064,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":64887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":63422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":63808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T05:29:11.489 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-08-31T05:29:11.489 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-08-31T05:29:11.489 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-08-31T05:29:11.489 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph health --format=json 2024-08-31T05:29:11.558 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:11 smithi050 ceph-mon[22146]: pgmap v321: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-08-31T05:29:11.585 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:11 smithi070 ceph-mon[22316]: pgmap v321: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-08-31T05:29:11.746 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:29:12.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.204+0000 7f33aef3d640 1 -- 172.21.15.5:0/2543345527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33a8103930 msgr2=0x7f33a8103d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:12.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.204+0000 7f33aef3d640 1 --2- 172.21.15.5:0/2543345527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33a8103930 0x7f33a8103d40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f33a4009900 tx=0x7f33a402a410 comp rx=0 tx=0).stop 2024-08-31T05:29:12.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.204+0000 7f33aef3d640 1 -- 172.21.15.5:0/2543345527 shutdown_connections 2024-08-31T05:29:12.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.204+0000 7f33aef3d640 1 --2- 172.21.15.5:0/2543345527 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33a8109bc0 0x7f33a81103f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:12.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.204+0000 7f33aef3d640 1 --2- 172.21.15.5:0/2543345527 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33a8109270 0x7f33a8109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:12.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.204+0000 7f33aef3d640 1 --2- 172.21.15.5:0/2543345527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33a8103930 0x7f33a8103d40 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:12.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.204+0000 7f33aef3d640 1 -- 172.21.15.5:0/2543345527 >> 172.21.15.5:0/2543345527 conn(0x7f33a80ff3a0 msgr2=0x7f33a81017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:12.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.204+0000 7f33aef3d640 1 -- 172.21.15.5:0/2543345527 shutdown_connections 2024-08-31T05:29:12.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.204+0000 7f33aef3d640 1 -- 172.21.15.5:0/2543345527 wait complete. 2024-08-31T05:29:12.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.205+0000 7f33aef3d640 1 Processor -- start 2024-08-31T05:29:12.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.205+0000 7f33aef3d640 1 -- start start 2024-08-31T05:29:12.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.205+0000 7f33aef3d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33a8103930 0x7f33a819a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:12.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.205+0000 7f33aef3d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33a8109270 0x7f33a819a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:12.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.205+0000 7f33aef3d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33a8109bc0 0x7f33a819fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:12.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.205+0000 7f33aef3d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f33a8113880 con 0x7f33a8109bc0 2024-08-31T05:29:12.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.205+0000 7f33aef3d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f33a8113700 con 0x7f33a8109270 2024-08-31T05:29:12.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.205+0000 7f33aef3d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f33a8113a00 con 0x7f33a8103930 2024-08-31T05:29:12.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.205+0000 7f33ad4da640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33a8109bc0 0x7f33a819fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:12.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.205+0000 7f33ad4da640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33a8109bc0 0x7f33a819fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55322/0 (socket says 172.21.15.5:55322) 2024-08-31T05:29:12.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.205+0000 7f33ad4da640 1 -- 172.21.15.5:0/4017772129 learned_addr learned my addr 172.21.15.5:0/4017772129 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:12.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.205+0000 7f339ffff640 1 --2- 172.21.15.5:0/4017772129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33a8109270 0x7f33a819a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:12.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.205+0000 7f33accd9640 1 --2- 172.21.15.5:0/4017772129 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33a8103930 0x7f33a819a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:12.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.206+0000 7f33ad4da640 1 -- 172.21.15.5:0/4017772129 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33a8103930 msgr2=0x7f33a819a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:12.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.206+0000 7f33ad4da640 1 --2- 172.21.15.5:0/4017772129 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33a8103930 0x7f33a819a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:12.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.206+0000 7f33ad4da640 1 -- 172.21.15.5:0/4017772129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33a8109270 msgr2=0x7f33a819a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:12.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.206+0000 7f33ad4da640 1 --2- 172.21.15.5:0/4017772129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33a8109270 0x7f33a819a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:12.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.206+0000 7f33ad4da640 1 -- 172.21.15.5:0/4017772129 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33a81a01c0 con 0x7f33a8109bc0 2024-08-31T05:29:12.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.206+0000 7f33accd9640 1 --2- 172.21.15.5:0/4017772129 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33a8103930 0x7f33a819a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:29:12.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.206+0000 7f33ad4da640 1 --2- 172.21.15.5:0/4017772129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33a8109bc0 0x7f33a819fa90 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f33a000cad0 tx=0x7f33a000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:12.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.209+0000 7f339dffb640 1 -- 172.21.15.5:0/4017772129 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a000ae20 con 0x7f33a8109bc0 2024-08-31T05:29:12.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.209+0000 7f339dffb640 1 -- 172.21.15.5:0/4017772129 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f33a0005020 con 0x7f33a8109bc0 2024-08-31T05:29:12.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.209+0000 7f33aef3d640 1 -- 172.21.15.5:0/4017772129 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33a81a04b0 con 0x7f33a8109bc0 2024-08-31T05:29:12.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.209+0000 7f339dffb640 1 -- 172.21.15.5:0/4017772129 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a000f6b0 con 0x7f33a8109bc0 2024-08-31T05:29:12.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.209+0000 7f33aef3d640 1 -- 172.21.15.5:0/4017772129 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33a81a6c10 con 0x7f33a8109bc0 2024-08-31T05:29:12.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.210+0000 7f33aef3d640 1 -- 172.21.15.5:0/4017772129 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33a8103d40 con 0x7f33a8109bc0 2024-08-31T05:29:12.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.212+0000 7f339dffb640 1 -- 172.21.15.5:0/4017772129 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f33a00051d0 con 0x7f33a8109bc0 2024-08-31T05:29:12.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.212+0000 7f339dffb640 1 --2- 172.21.15.5:0/4017772129 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f33900b4c10 0x7f33900b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:12.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.213+0000 7f33accd9640 1 --2- 172.21.15.5:0/4017772129 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f33900b4c10 0x7f33900b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:12.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.213+0000 7f339dffb640 1 -- 172.21.15.5:0/4017772129 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f33a00e5800 con 0x7f33a8109bc0 2024-08-31T05:29:12.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.213+0000 7f33accd9640 1 --2- 172.21.15.5:0/4017772129 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f33900b4c10 0x7f33900b7120 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f33a4031440 tx=0x7f33a4009680 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:12.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.219+0000 7f339dffb640 1 -- 172.21.15.5:0/4017772129 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f33a0014030 con 0x7f33a8109bc0 2024-08-31T05:29:12.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.443+0000 7f33aef3d640 1 -- 172.21.15.5:0/4017772129 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f33a802e430 con 0x7f33a8109bc0 2024-08-31T05:29:12.445 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:12 smithi005 ceph-mon[18602]: from='client.15240 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T05:29:12.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.444+0000 7f339dffb640 1 -- 172.21.15.5:0/4017772129 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f33a00ac330 con 0x7f33a8109bc0 2024-08-31T05:29:12.446 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:29:12.446 INFO:teuthology.orchestra.run.smithi005.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-08-31T05:29:12.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.446+0000 7f33aef3d640 1 -- 172.21.15.5:0/4017772129 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f33900b4c10 msgr2=0x7f33900b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:12.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.446+0000 7f33aef3d640 1 --2- 172.21.15.5:0/4017772129 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f33900b4c10 0x7f33900b7120 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f33a4031440 tx=0x7f33a4009680 comp rx=0 tx=0).stop 2024-08-31T05:29:12.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.446+0000 7f33aef3d640 1 -- 172.21.15.5:0/4017772129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33a8109bc0 msgr2=0x7f33a819fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:12.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.446+0000 7f33aef3d640 1 --2- 172.21.15.5:0/4017772129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33a8109bc0 0x7f33a819fa90 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f33a000cad0 tx=0x7f33a000cf90 comp rx=0 tx=0).stop 2024-08-31T05:29:12.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.446+0000 7f33aef3d640 1 -- 172.21.15.5:0/4017772129 shutdown_connections 2024-08-31T05:29:12.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.446+0000 7f33aef3d640 1 --2- 172.21.15.5:0/4017772129 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f33900b4c10 0x7f33900b7120 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:12.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.446+0000 7f33aef3d640 1 --2- 172.21.15.5:0/4017772129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33a8109bc0 0x7f33a819fa90 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:12.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.446+0000 7f33aef3d640 1 --2- 172.21.15.5:0/4017772129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33a8109270 0x7f33a819a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:12.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.446+0000 7f33aef3d640 1 --2- 172.21.15.5:0/4017772129 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33a8103930 0x7f33a819a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:12.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.446+0000 7f33aef3d640 1 -- 172.21.15.5:0/4017772129 >> 172.21.15.5:0/4017772129 conn(0x7f33a80ff3a0 msgr2=0x7f33a81017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:12.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.446+0000 7f33aef3d640 1 -- 172.21.15.5:0/4017772129 shutdown_connections 2024-08-31T05:29:12.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:12.446+0000 7f33aef3d640 1 -- 172.21.15.5:0/4017772129 wait complete. 2024-08-31T05:29:12.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:12 smithi070 ceph-mon[22316]: from='client.15240 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T05:29:12.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:12 smithi050 ceph-mon[22146]: from='client.15240 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T05:29:13.309 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-08-31T05:29:13.309 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T05:29:13.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:13 smithi005 ceph-mon[18602]: pgmap v322: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-31T05:29:13.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:13 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/4017772129' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-08-31T05:29:13.569 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:29:13.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:13 smithi070 ceph-mon[22316]: pgmap v322: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-31T05:29:13.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:13 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/4017772129' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-08-31T05:29:13.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:13 smithi050 ceph-mon[22146]: pgmap v322: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-31T05:29:13.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:13 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/4017772129' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-08-31T05:29:14.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.097+0000 7f82c3909640 1 -- 172.21.15.5:0/88171676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82bc108140 msgr2=0x7f82bc108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:14.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.097+0000 7f82c3909640 1 --2- 172.21.15.5:0/88171676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82bc108140 0x7f82bc108550 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f82ac009900 tx=0x7f82ac02a410 comp rx=0 tx=0).stop 2024-08-31T05:29:14.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.097+0000 7f82c3909640 1 -- 172.21.15.5:0/88171676 shutdown_connections 2024-08-31T05:29:14.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.097+0000 7f82c3909640 1 --2- 172.21.15.5:0/88171676 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82bc108a90 0x7f82bc10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:14.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.097+0000 7f82c3909640 1 --2- 172.21.15.5:0/88171676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82bc108140 0x7f82bc108550 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:14.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.097+0000 7f82c3909640 1 --2- 172.21.15.5:0/88171676 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82bc102800 0x7f82bc102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:14.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.097+0000 7f82c3909640 1 -- 172.21.15.5:0/88171676 >> 172.21.15.5:0/88171676 conn(0x7f82bc0794d0 msgr2=0x7f82bc0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:14.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.097+0000 7f82c3909640 1 -- 172.21.15.5:0/88171676 shutdown_connections 2024-08-31T05:29:14.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.098+0000 7f82c3909640 1 -- 172.21.15.5:0/88171676 wait complete. 2024-08-31T05:29:14.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.098+0000 7f82c3909640 1 Processor -- start 2024-08-31T05:29:14.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.098+0000 7f82c3909640 1 -- start start 2024-08-31T05:29:14.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.099+0000 7f82c3909640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82bc102800 0x7f82bc19b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:14.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.099+0000 7f82c3909640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82bc108140 0x7f82bc19b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:14.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.099+0000 7f82c3909640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82bc108a90 0x7f82bc19bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:14.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.099+0000 7f82c3909640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f82bc1127c0 con 0x7f82bc102800 2024-08-31T05:29:14.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.099+0000 7f82c3909640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f82bc112640 con 0x7f82bc108140 2024-08-31T05:29:14.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.099+0000 7f82c3909640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f82bc112940 con 0x7f82bc108a90 2024-08-31T05:29:14.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.099+0000 7f82c16a5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82bc102800 0x7f82bc19b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:14.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.099+0000 7f82c16a5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82bc102800 0x7f82bc19b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55334/0 (socket says 172.21.15.5:55334) 2024-08-31T05:29:14.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.099+0000 7f82c16a5640 1 -- 172.21.15.5:0/2450805918 learned_addr learned my addr 172.21.15.5:0/2450805918 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:14.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.099+0000 7f82c0ea4640 1 --2- 172.21.15.5:0/2450805918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82bc108140 0x7f82bc19b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:14.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.099+0000 7f82c1ea6640 1 --2- 172.21.15.5:0/2450805918 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82bc108a90 0x7f82bc19bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:14.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.099+0000 7f82c16a5640 1 -- 172.21.15.5:0/2450805918 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82bc108a90 msgr2=0x7f82bc19bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:14.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.099+0000 7f82c16a5640 1 --2- 172.21.15.5:0/2450805918 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82bc108a90 0x7f82bc19bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:14.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.099+0000 7f82c16a5640 1 -- 172.21.15.5:0/2450805918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82bc108140 msgr2=0x7f82bc19b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:14.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.099+0000 7f82c16a5640 1 --2- 172.21.15.5:0/2450805918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82bc108140 0x7f82bc19b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:14.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.099+0000 7f82c16a5640 1 -- 172.21.15.5:0/2450805918 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82bc1a64a0 con 0x7f82bc102800 2024-08-31T05:29:14.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.099+0000 7f82c0ea4640 1 --2- 172.21.15.5:0/2450805918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82bc108140 0x7f82bc19b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:29:14.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.099+0000 7f82c16a5640 1 --2- 172.21.15.5:0/2450805918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82bc102800 0x7f82bc19b210 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f82b800b4a0 tx=0x7f82b800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:14.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.099+0000 7f82b27fc640 1 -- 172.21.15.5:0/2450805918 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b8014070 con 0x7f82bc102800 2024-08-31T05:29:14.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.099+0000 7f82c3909640 1 -- 172.21.15.5:0/2450805918 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82bc1a6790 con 0x7f82bc102800 2024-08-31T05:29:14.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.099+0000 7f82b27fc640 1 -- 172.21.15.5:0/2450805918 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82b8010ac0 con 0x7f82bc102800 2024-08-31T05:29:14.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.099+0000 7f82b27fc640 1 -- 172.21.15.5:0/2450805918 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b8017c30 con 0x7f82bc102800 2024-08-31T05:29:14.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.100+0000 7f82c3909640 1 -- 172.21.15.5:0/2450805918 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82bc1a6cf0 con 0x7f82bc102800 2024-08-31T05:29:14.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.100+0000 7f82c3909640 1 -- 172.21.15.5:0/2450805918 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82bc102c90 con 0x7f82bc102800 2024-08-31T05:29:14.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.102+0000 7f82b27fc640 1 -- 172.21.15.5:0/2450805918 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f82b8017070 con 0x7f82bc102800 2024-08-31T05:29:14.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.103+0000 7f82b27fc640 1 --2- 172.21.15.5:0/2450805918 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f82a80b4cc0 0x7f82a80b71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:14.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.103+0000 7f82c0ea4640 1 --2- 172.21.15.5:0/2450805918 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f82a80b4cc0 0x7f82a80b71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:14.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.103+0000 7f82b27fc640 1 -- 172.21.15.5:0/2450805918 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f82b80e4e80 con 0x7f82bc102800 2024-08-31T05:29:14.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.103+0000 7f82c0ea4640 1 --2- 172.21.15.5:0/2450805918 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f82a80b4cc0 0x7f82a80b71d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f82ac000c00 tx=0x7f82ac031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:14.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.106+0000 7f82b27fc640 1 -- 172.21.15.5:0/2450805918 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f82b80ab950 con 0x7f82bc102800 2024-08-31T05:29:14.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.331+0000 7f82c3909640 1 -- 172.21.15.5:0/2450805918 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f82bc06b010 con 0x7f82bc102800 2024-08-31T05:29:14.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.332+0000 7f82b27fc640 1 -- 172.21.15.5:0/2450805918 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11941 (secure 0 0 0) 0x7f82b80ab250 con 0x7f82bc102800 2024-08-31T05:29:14.334 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:29:14.335 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":29,"btime":"2024-08-31T05:28:13:579476+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14739,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2024812199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2024812199},{"type":"v1","addr":"172.21.15.5:6835","nonce":2024812199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3629023702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3629023702},{"type":"v1","addr":"172.21.15.5:6837","nonce":3629023702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T05:27:31.929153+0000","modified":"2024-08-31T05:28:13.446913+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24652,"mds_1":24638,"mds_2":24631,"mds_3":24625,"mds_4":24602},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6839/2412701258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":2412701258},{"type":"v1","addr":"172.21.15.5:6839","nonce":2412701258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14820":{"gid":14820,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6841/747057838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":747057838},{"type":"v1","addr":"172.21.15.5:6841","nonce":747057838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6833/1153378982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1153378982},{"type":"v1","addr":"172.21.15.50:6833","nonce":1153378982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6833/364083443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":364083443},{"type":"v1","addr":"172.21.15.70:6833","nonce":364083443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24587":{"gid":24587,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/2346896794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2346896794},{"type":"v1","addr":"172.21.15.50:6835","nonce":2346896794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24602":{"gid":24602,"name":"h","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.50:6837/428759669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":428759669},{"type":"v1","addr":"172.21.15.50:6837","nonce":428759669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.70:6835/2061504114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2061504114},{"type":"v1","addr":"172.21.15.70:6835","nonce":2061504114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.70:6837/2780036414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2780036414},{"type":"v1","addr":"172.21.15.70:6837","nonce":2780036414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.50:6839/98200944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":98200944},{"type":"v1","addr":"172.21.15.50:6839","nonce":98200944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24652":{"gid":24652,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.70:6839/2756569250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":2756569250},{"type":"v1","addr":"172.21.15.70:6839","nonce":2756569250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24652,"qdb_cluster":[24602,24625,24638,24631,24652]},"id":1}]} 2024-08-31T05:29:14.335 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 29 2024-08-31T05:29:14.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.335+0000 7f82c3909640 1 -- 172.21.15.5:0/2450805918 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f82a80b4cc0 msgr2=0x7f82a80b71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:14.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.335+0000 7f82c3909640 1 --2- 172.21.15.5:0/2450805918 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f82a80b4cc0 0x7f82a80b71d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f82ac000c00 tx=0x7f82ac031400 comp rx=0 tx=0).stop 2024-08-31T05:29:14.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.335+0000 7f82c3909640 1 -- 172.21.15.5:0/2450805918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82bc102800 msgr2=0x7f82bc19b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:14.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.335+0000 7f82c3909640 1 --2- 172.21.15.5:0/2450805918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82bc102800 0x7f82bc19b210 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f82b800b4a0 tx=0x7f82b800b960 comp rx=0 tx=0).stop 2024-08-31T05:29:14.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.335+0000 7f82c3909640 1 -- 172.21.15.5:0/2450805918 shutdown_connections 2024-08-31T05:29:14.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.335+0000 7f82c3909640 1 --2- 172.21.15.5:0/2450805918 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f82a80b4cc0 0x7f82a80b71d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:14.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.335+0000 7f82c3909640 1 --2- 172.21.15.5:0/2450805918 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82bc108a90 0x7f82bc19bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:14.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.335+0000 7f82c3909640 1 --2- 172.21.15.5:0/2450805918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f82bc108140 0x7f82bc19b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:14.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.335+0000 7f82c3909640 1 --2- 172.21.15.5:0/2450805918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82bc102800 0x7f82bc19b210 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:14.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.335+0000 7f82c3909640 1 -- 172.21.15.5:0/2450805918 >> 172.21.15.5:0/2450805918 conn(0x7f82bc0794d0 msgr2=0x7f82bc105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:14.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.335+0000 7f82c3909640 1 -- 172.21.15.5:0/2450805918 shutdown_connections 2024-08-31T05:29:14.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:14.336+0000 7f82c3909640 1 -- 172.21.15.5:0/2450805918 wait complete. 2024-08-31T05:29:15.099 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T05:29:15.358 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:29:15.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:15 smithi005 ceph-mon[18602]: pgmap v323: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-31T05:29:15.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:15 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/2450805918' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:29:15.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:15 smithi070 ceph-mon[22316]: pgmap v323: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-31T05:29:15.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:15 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/2450805918' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:29:15.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:15 smithi050 ceph-mon[22146]: pgmap v323: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-31T05:29:15.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:15 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/2450805918' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:29:15.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:15.850+0000 7f5c49ce8640 1 -- 172.21.15.5:0/3118957796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c44105090 msgr2=0x7f5c4410d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:15.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:15.850+0000 7f5c49ce8640 1 --2- 172.21.15.5:0/3118957796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c44105090 0x7f5c4410d6d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f5c38009900 tx=0x7f5c3802a410 comp rx=0 tx=0).stop 2024-08-31T05:29:15.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:15.850+0000 7f5c49ce8640 1 -- 172.21.15.5:0/3118957796 shutdown_connections 2024-08-31T05:29:15.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:15.850+0000 7f5c49ce8640 1 --2- 172.21.15.5:0/3118957796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c4410dc10 0x7f5c44110120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:15.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:15.850+0000 7f5c49ce8640 1 --2- 172.21.15.5:0/3118957796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c44105090 0x7f5c4410d6d0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:15.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:15.850+0000 7f5c49ce8640 1 --2- 172.21.15.5:0/3118957796 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c44104660 0x7f5c44104a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:15.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:15.850+0000 7f5c49ce8640 1 -- 172.21.15.5:0/3118957796 >> 172.21.15.5:0/3118957796 conn(0x7f5c44079510 msgr2=0x7f5c44079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:15.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:15.850+0000 7f5c49ce8640 1 -- 172.21.15.5:0/3118957796 shutdown_connections 2024-08-31T05:29:15.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:15.850+0000 7f5c49ce8640 1 -- 172.21.15.5:0/3118957796 wait complete. 2024-08-31T05:29:15.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:15.851+0000 7f5c49ce8640 1 Processor -- start 2024-08-31T05:29:15.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:15.851+0000 7f5c49ce8640 1 -- start start 2024-08-31T05:29:15.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:15.851+0000 7f5c49ce8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c44104660 0x7f5c4419a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:15.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:15.851+0000 7f5c49ce8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c44105090 0x7f5c4419a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:15.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:15.852+0000 7f5c49ce8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c4410dc10 0x7f5c4419fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:15.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:15.852+0000 7f5c49ce8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5c44113890 con 0x7f5c44104660 2024-08-31T05:29:15.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:15.852+0000 7f5c49ce8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5c44113710 con 0x7f5c44105090 2024-08-31T05:29:15.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:15.852+0000 7f5c49ce8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5c44113a10 con 0x7f5c4410dc10 2024-08-31T05:29:15.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:15.852+0000 7f5c437fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c44104660 0x7f5c4419a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:15.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:15.852+0000 7f5c437fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c44104660 0x7f5c4419a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55352/0 (socket says 172.21.15.5:55352) 2024-08-31T05:29:15.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:15.852+0000 7f5c437fe640 1 -- 172.21.15.5:0/2822755894 learned_addr learned my addr 172.21.15.5:0/2822755894 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:15.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:15.852+0000 7f5c42ffd640 1 --2- 172.21.15.5:0/2822755894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c44105090 0x7f5c4419a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:15.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:15.852+0000 7f5c43fff640 1 --2- 172.21.15.5:0/2822755894 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c4410dc10 0x7f5c4419fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:15.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:15.852+0000 7f5c437fe640 1 -- 172.21.15.5:0/2822755894 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c4410dc10 msgr2=0x7f5c4419fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:15.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:15.852+0000 7f5c437fe640 1 --2- 172.21.15.5:0/2822755894 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c4410dc10 0x7f5c4419fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:15.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:15.852+0000 7f5c437fe640 1 -- 172.21.15.5:0/2822755894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c44105090 msgr2=0x7f5c4419a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:15.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:15.852+0000 7f5c437fe640 1 --2- 172.21.15.5:0/2822755894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c44105090 0x7f5c4419a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:15.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:15.852+0000 7f5c437fe640 1 -- 172.21.15.5:0/2822755894 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c441a0210 con 0x7f5c44104660 2024-08-31T05:29:15.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:15.852+0000 7f5c437fe640 1 --2- 172.21.15.5:0/2822755894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c44104660 0x7f5c4419a2a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f5c3400d770 tx=0x7f5c3400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:15.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:15.852+0000 7f5c40ff9640 1 -- 172.21.15.5:0/2822755894 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c34017070 con 0x7f5c44104660 2024-08-31T05:29:15.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:15.852+0000 7f5c49ce8640 1 -- 172.21.15.5:0/2822755894 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c441a0500 con 0x7f5c44104660 2024-08-31T05:29:15.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:15.852+0000 7f5c40ff9640 1 -- 172.21.15.5:0/2822755894 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c340054d0 con 0x7f5c44104660 2024-08-31T05:29:15.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:15.852+0000 7f5c40ff9640 1 -- 172.21.15.5:0/2822755894 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c34004c30 con 0x7f5c44104660 2024-08-31T05:29:15.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:15.852+0000 7f5c49ce8640 1 -- 172.21.15.5:0/2822755894 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c441a6c60 con 0x7f5c44104660 2024-08-31T05:29:15.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:15.854+0000 7f5c49ce8640 1 -- 172.21.15.5:0/2822755894 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c4406bfa0 con 0x7f5c44104660 2024-08-31T05:29:15.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:15.855+0000 7f5c40ff9640 1 -- 172.21.15.5:0/2822755894 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f5c34004dd0 con 0x7f5c44104660 2024-08-31T05:29:15.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:15.856+0000 7f5c40ff9640 1 --2- 172.21.15.5:0/2822755894 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5c2c0b4c10 0x7f5c2c0b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:15.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:15.856+0000 7f5c42ffd640 1 --2- 172.21.15.5:0/2822755894 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5c2c0b4c10 0x7f5c2c0b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:15.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:15.856+0000 7f5c40ff9640 1 -- 172.21.15.5:0/2822755894 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f5c340e5780 con 0x7f5c44104660 2024-08-31T05:29:15.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:15.857+0000 7f5c42ffd640 1 --2- 172.21.15.5:0/2822755894 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5c2c0b4c10 0x7f5c2c0b7120 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5c38009230 tx=0x7f5c38031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:15.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:15.860+0000 7f5c40ff9640 1 -- 172.21.15.5:0/2822755894 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5c340ac250 con 0x7f5c44104660 2024-08-31T05:29:16.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:16.084+0000 7f5c49ce8640 1 -- 172.21.15.5:0/2822755894 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5c44104a70 con 0x7f5c44104660 2024-08-31T05:29:16.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:16.085+0000 7f5c40ff9640 1 -- 172.21.15.5:0/2822755894 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11941 (secure 0 0 0) 0x7f5c340abb50 con 0x7f5c44104660 2024-08-31T05:29:16.087 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:29:16.087 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":29,"btime":"2024-08-31T05:28:13:579476+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14739,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2024812199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2024812199},{"type":"v1","addr":"172.21.15.5:6835","nonce":2024812199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3629023702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3629023702},{"type":"v1","addr":"172.21.15.5:6837","nonce":3629023702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T05:27:31.929153+0000","modified":"2024-08-31T05:28:13.446913+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24652,"mds_1":24638,"mds_2":24631,"mds_3":24625,"mds_4":24602},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6839/2412701258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":2412701258},{"type":"v1","addr":"172.21.15.5:6839","nonce":2412701258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14820":{"gid":14820,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6841/747057838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":747057838},{"type":"v1","addr":"172.21.15.5:6841","nonce":747057838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6833/1153378982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1153378982},{"type":"v1","addr":"172.21.15.50:6833","nonce":1153378982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6833/364083443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":364083443},{"type":"v1","addr":"172.21.15.70:6833","nonce":364083443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24587":{"gid":24587,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/2346896794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2346896794},{"type":"v1","addr":"172.21.15.50:6835","nonce":2346896794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24602":{"gid":24602,"name":"h","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.50:6837/428759669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":428759669},{"type":"v1","addr":"172.21.15.50:6837","nonce":428759669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.70:6835/2061504114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2061504114},{"type":"v1","addr":"172.21.15.70:6835","nonce":2061504114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.70:6837/2780036414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2780036414},{"type":"v1","addr":"172.21.15.70:6837","nonce":2780036414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.50:6839/98200944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":98200944},{"type":"v1","addr":"172.21.15.50:6839","nonce":98200944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24652":{"gid":24652,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.70:6839/2756569250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":2756569250},{"type":"v1","addr":"172.21.15.70:6839","nonce":2756569250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24652,"qdb_cluster":[24602,24625,24638,24631,24652]},"id":1}]} 2024-08-31T05:29:16.087 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 29 2024-08-31T05:29:16.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:16.087+0000 7f5c49ce8640 1 -- 172.21.15.5:0/2822755894 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5c2c0b4c10 msgr2=0x7f5c2c0b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:16.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:16.087+0000 7f5c49ce8640 1 --2- 172.21.15.5:0/2822755894 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5c2c0b4c10 0x7f5c2c0b7120 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5c38009230 tx=0x7f5c38031400 comp rx=0 tx=0).stop 2024-08-31T05:29:16.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:16.087+0000 7f5c49ce8640 1 -- 172.21.15.5:0/2822755894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c44104660 msgr2=0x7f5c4419a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:16.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:16.087+0000 7f5c49ce8640 1 --2- 172.21.15.5:0/2822755894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c44104660 0x7f5c4419a2a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f5c3400d770 tx=0x7f5c3400dc30 comp rx=0 tx=0).stop 2024-08-31T05:29:16.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:16.088+0000 7f5c49ce8640 1 -- 172.21.15.5:0/2822755894 shutdown_connections 2024-08-31T05:29:16.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:16.088+0000 7f5c49ce8640 1 --2- 172.21.15.5:0/2822755894 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5c2c0b4c10 0x7f5c2c0b7120 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:16.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:16.088+0000 7f5c49ce8640 1 --2- 172.21.15.5:0/2822755894 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c4410dc10 0x7f5c4419fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:16.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:16.088+0000 7f5c49ce8640 1 --2- 172.21.15.5:0/2822755894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5c44105090 0x7f5c4419a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:16.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:16.088+0000 7f5c49ce8640 1 --2- 172.21.15.5:0/2822755894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c44104660 0x7f5c4419a2a0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:16.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:16.088+0000 7f5c49ce8640 1 -- 172.21.15.5:0/2822755894 >> 172.21.15.5:0/2822755894 conn(0x7f5c44079510 msgr2=0x7f5c441006a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:16.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:16.088+0000 7f5c49ce8640 1 -- 172.21.15.5:0/2822755894 shutdown_connections 2024-08-31T05:29:16.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:16.088+0000 7f5c49ce8640 1 -- 172.21.15.5:0/2822755894 wait complete. 2024-08-31T05:29:16.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:16 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/2822755894' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:29:16.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:16 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/2822755894' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:29:16.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:16 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/2822755894' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:29:16.831 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T05:29:17.084 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:29:17.460 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:17 smithi005 ceph-mon[18602]: pgmap v324: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-08-31T05:29:17.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.544+0000 7f3054e41640 1 -- 172.21.15.5:0/1364914365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3050103900 msgr2=0x7f3050103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:17.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.544+0000 7f3054e41640 1 --2- 172.21.15.5:0/1364914365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3050103900 0x7f3050103d10 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3040009900 tx=0x7f304002a410 comp rx=0 tx=0).stop 2024-08-31T05:29:17.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.544+0000 7f3054e41640 1 -- 172.21.15.5:0/1364914365 shutdown_connections 2024-08-31T05:29:17.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.544+0000 7f3054e41640 1 --2- 172.21.15.5:0/1364914365 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3050109b90 0x7f30501103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:17.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.544+0000 7f3054e41640 1 --2- 172.21.15.5:0/1364914365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3050109240 0x7f3050109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:17.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.544+0000 7f3054e41640 1 --2- 172.21.15.5:0/1364914365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3050103900 0x7f3050103d10 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:17.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.544+0000 7f3054e41640 1 -- 172.21.15.5:0/1364914365 >> 172.21.15.5:0/1364914365 conn(0x7f305007b5f0 msgr2=0x7f305007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:17.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.544+0000 7f3054e41640 1 -- 172.21.15.5:0/1364914365 shutdown_connections 2024-08-31T05:29:17.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.544+0000 7f3054e41640 1 -- 172.21.15.5:0/1364914365 wait complete. 2024-08-31T05:29:17.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.545+0000 7f3054e41640 1 Processor -- start 2024-08-31T05:29:17.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.545+0000 7f3054e41640 1 -- start start 2024-08-31T05:29:17.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.545+0000 7f3054e41640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3050103900 0x7f305019a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:17.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.545+0000 7f3054e41640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3050109240 0x7f305019a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:17.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.545+0000 7f3054e41640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3050109b90 0x7f305019fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:17.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.545+0000 7f3054e41640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3050113850 con 0x7f3050103900 2024-08-31T05:29:17.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.545+0000 7f3054e41640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f30501136d0 con 0x7f3050109b90 2024-08-31T05:29:17.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.545+0000 7f3054e41640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f30501139d0 con 0x7f3050109240 2024-08-31T05:29:17.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.545+0000 7f304e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3050103900 0x7f305019a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:17.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.545+0000 7f304e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3050103900 0x7f305019a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55370/0 (socket says 172.21.15.5:55370) 2024-08-31T05:29:17.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.546+0000 7f304e59c640 1 -- 172.21.15.5:0/1576266498 learned_addr learned my addr 172.21.15.5:0/1576266498 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:17.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.546+0000 7f304ed9d640 1 --2- 172.21.15.5:0/1576266498 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3050109b90 0x7f305019fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:17.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.546+0000 7f3047fff640 1 --2- 172.21.15.5:0/1576266498 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3050109240 0x7f305019a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:17.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.546+0000 7f304e59c640 1 -- 172.21.15.5:0/1576266498 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3050109240 msgr2=0x7f305019a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:17.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.546+0000 7f304e59c640 1 --2- 172.21.15.5:0/1576266498 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3050109240 0x7f305019a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:17.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.546+0000 7f304e59c640 1 -- 172.21.15.5:0/1576266498 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3050109b90 msgr2=0x7f305019fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:17.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.546+0000 7f304e59c640 1 --2- 172.21.15.5:0/1576266498 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3050109b90 0x7f305019fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:17.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.546+0000 7f304e59c640 1 -- 172.21.15.5:0/1576266498 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30501a01b0 con 0x7f3050103900 2024-08-31T05:29:17.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.546+0000 7f304ed9d640 1 --2- 172.21.15.5:0/1576266498 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3050109b90 0x7f305019fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:29:17.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.546+0000 7f3047fff640 1 --2- 172.21.15.5:0/1576266498 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3050109240 0x7f305019a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:29:17.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.546+0000 7f304e59c640 1 --2- 172.21.15.5:0/1576266498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3050103900 0x7f305019a240 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f3040005940 tx=0x7f30400042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:17.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.546+0000 7f30477fe640 1 -- 172.21.15.5:0/1576266498 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f304003f030 con 0x7f3050103900 2024-08-31T05:29:17.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.546+0000 7f30477fe640 1 -- 172.21.15.5:0/1576266498 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3040003cb0 con 0x7f3050103900 2024-08-31T05:29:17.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.546+0000 7f3054e41640 1 -- 172.21.15.5:0/1576266498 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30501a0440 con 0x7f3050103900 2024-08-31T05:29:17.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.546+0000 7f30477fe640 1 -- 172.21.15.5:0/1576266498 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3040035070 con 0x7f3050103900 2024-08-31T05:29:17.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.546+0000 7f3054e41640 1 -- 172.21.15.5:0/1576266498 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30501a6c00 con 0x7f3050103900 2024-08-31T05:29:17.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.547+0000 7f3054e41640 1 -- 172.21.15.5:0/1576266498 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3050103d10 con 0x7f3050103900 2024-08-31T05:29:17.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.549+0000 7f30477fe640 1 -- 172.21.15.5:0/1576266498 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f3040042030 con 0x7f3050103900 2024-08-31T05:29:17.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.550+0000 7f30477fe640 1 --2- 172.21.15.5:0/1576266498 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f303c0b4c10 0x7f303c0b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:17.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.550+0000 7f3047fff640 1 --2- 172.21.15.5:0/1576266498 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f303c0b4c10 0x7f303c0b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:17.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.550+0000 7f30477fe640 1 -- 172.21.15.5:0/1576266498 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f30401063a0 con 0x7f3050103900 2024-08-31T05:29:17.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.550+0000 7f3047fff640 1 --2- 172.21.15.5:0/1576266498 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f303c0b4c10 0x7f303c0b7120 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3038005d00 tx=0x7f3038005ed0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:17.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.553+0000 7f30477fe640 1 -- 172.21.15.5:0/1576266498 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f30400cced0 con 0x7f3050103900 2024-08-31T05:29:17.585 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:17 smithi070 ceph-mon[22316]: pgmap v324: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-08-31T05:29:17.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:17 smithi050 ceph-mon[22146]: pgmap v324: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-08-31T05:29:17.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.739+0000 7f3054e41640 1 -- 172.21.15.5:0/1576266498 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f305010b3d0 con 0x7f3050103900 2024-08-31T05:29:17.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.740+0000 7f30477fe640 1 -- 172.21.15.5:0/1576266498 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+25122 (secure 0 0 0) 0x7f30400cc7d0 con 0x7f3050103900 2024-08-31T05:29:17.743 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:29:17.743 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":87,"fsid":"69422704-6758-11ef-bcd4-c7b262605968","created":"2024-08-31T05:19:04.860258+0000","modified":"2024-08-31T05:28:59.155542+0000","last_up_change":"2024-08-31T05:26:38.675914+0000","last_in_change":"2024-08-31T05:26:15.366713+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T05:22:49.802575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T05:27:27.835197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T05:27:30.058144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-31T05:27:36.272228+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c5745391-e9d7-4799-9db9-6b34bb91b7df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6803","nonce":2312496244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6805","nonce":2312496244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6809","nonce":2312496244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6807","nonce":2312496244}]},"public_addr":"172.21.15.5:6803/2312496244","cluster_addr":"172.21.15.5:6805/2312496244","heartbeat_back_addr":"172.21.15.5:6809/2312496244","heartbeat_front_addr":"172.21.15.5:6807/2312496244","state":["exists","up"]},{"osd":1,"uuid":"f1903bd7-b2c5-424e-a74e-795f729471db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6801","nonce":2777359361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6803","nonce":2777359361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6807","nonce":2777359361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6805","nonce":2777359361}]},"public_addr":"172.21.15.50:6801/2777359361","cluster_addr":"172.21.15.50:6803/2777359361","heartbeat_back_addr":"172.21.15.50:6807/2777359361","heartbeat_front_addr":"172.21.15.50:6805/2777359361","state":["exists","up"]},{"osd":2,"uuid":"134c5892-e44a-44f2-8cd2-484d22a45e2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6801","nonce":1400583716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6803","nonce":1400583716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6807","nonce":1400583716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6805","nonce":1400583716}]},"public_addr":"172.21.15.70:6801/1400583716","cluster_addr":"172.21.15.70:6803/1400583716","heartbeat_back_addr":"172.21.15.70:6807/1400583716","heartbeat_front_addr":"172.21.15.70:6805/1400583716","state":["exists","up"]},{"osd":3,"uuid":"af49398a-e171-496b-a50e-1f767fc42923","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6811","nonce":1647468379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6813","nonce":1647468379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6817","nonce":1647468379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6815","nonce":1647468379}]},"public_addr":"172.21.15.5:6811/1647468379","cluster_addr":"172.21.15.5:6813/1647468379","heartbeat_back_addr":"172.21.15.5:6817/1647468379","heartbeat_front_addr":"172.21.15.5:6815/1647468379","state":["exists","up"]},{"osd":4,"uuid":"59b847ef-6eb0-4c13-aa06-53a76d77ce45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6809","nonce":2314546877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6811","nonce":2314546877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6815","nonce":2314546877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6813","nonce":2314546877}]},"public_addr":"172.21.15.50:6809/2314546877","cluster_addr":"172.21.15.50:6811/2314546877","heartbeat_back_addr":"172.21.15.50:6815/2314546877","heartbeat_front_addr":"172.21.15.50:6813/2314546877","state":["exists","up"]},{"osd":5,"uuid":"b0dac185-4462-4760-aa36-0d221923b007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6809","nonce":311426299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6811","nonce":311426299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6815","nonce":311426299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6813","nonce":311426299}]},"public_addr":"172.21.15.70:6809/311426299","cluster_addr":"172.21.15.70:6811/311426299","heartbeat_back_addr":"172.21.15.70:6815/311426299","heartbeat_front_addr":"172.21.15.70:6813/311426299","state":["exists","up"]},{"osd":6,"uuid":"12486aa2-61e4-4bdf-94dd-ce5c4cd3df6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6819","nonce":1027645612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6821","nonce":1027645612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6825","nonce":1027645612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6823","nonce":1027645612}]},"public_addr":"172.21.15.5:6819/1027645612","cluster_addr":"172.21.15.5:6821/1027645612","heartbeat_back_addr":"172.21.15.5:6825/1027645612","heartbeat_front_addr":"172.21.15.5:6823/1027645612","state":["exists","up"]},{"osd":7,"uuid":"66f9dcf9-d5c3-4016-812f-d9496e9892d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6817","nonce":2718354517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6819","nonce":2718354517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6823","nonce":2718354517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6821","nonce":2718354517}]},"public_addr":"172.21.15.50:6817/2718354517","cluster_addr":"172.21.15.50:6819/2718354517","heartbeat_back_addr":"172.21.15.50:6823/2718354517","heartbeat_front_addr":"172.21.15.50:6821/2718354517","state":["exists","up"]},{"osd":8,"uuid":"584837f9-af4b-4189-a7e5-04156a94a805","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6817","nonce":3155722993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6819","nonce":3155722993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6823","nonce":3155722993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6821","nonce":3155722993}]},"public_addr":"172.21.15.70:6817/3155722993","cluster_addr":"172.21.15.70:6819/3155722993","heartbeat_back_addr":"172.21.15.70:6823/3155722993","heartbeat_front_addr":"172.21.15.70:6821/3155722993","state":["exists","up"]},{"osd":9,"uuid":"ef60de6e-3456-435c-bd48-ed2636cc0d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6827","nonce":2988145512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6829","nonce":2988145512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6833","nonce":2988145512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6831","nonce":2988145512}]},"public_addr":"172.21.15.5:6827/2988145512","cluster_addr":"172.21.15.5:6829/2988145512","heartbeat_back_addr":"172.21.15.5:6833/2988145512","heartbeat_front_addr":"172.21.15.5:6831/2988145512","state":["exists","up"]},{"osd":10,"uuid":"96c5de40-53df-412d-9501-8ce1711a76a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6825","nonce":4168871229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6827","nonce":4168871229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6831","nonce":4168871229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6829","nonce":4168871229}]},"public_addr":"172.21.15.50:6825/4168871229","cluster_addr":"172.21.15.50:6827/4168871229","heartbeat_back_addr":"172.21.15.50:6831/4168871229","heartbeat_front_addr":"172.21.15.50:6829/4168871229","state":["exists","up"]},{"osd":11,"uuid":"20beefe0-59c3-4392-9f61-8d215e9d2de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6825","nonce":2593470535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6827","nonce":2593470535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6831","nonce":2593470535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6829","nonce":2593470535}]},"public_addr":"172.21.15.70:6825/2593470535","cluster_addr":"172.21.15.70:6827/2593470535","heartbeat_back_addr":"172.21.15.70:6831/2593470535","heartbeat_front_addr":"172.21.15.70:6829/2593470535","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:21:56.748083+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:22:21.969492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:22:46.642917+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:23:11.630486+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:23:36.389322+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:24:01.431039+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:24:27.057017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:24:53.628200+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:25:19.356502+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:25:44.958024+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:26:10.804919+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:26:36.849133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":5,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:0/2473024253":"2024-09-01T05:20:57.333680+0000","172.21.15.5:0/2924148490":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/2163558485":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/2111919168":"2024-09-01T05:19:55.663503+0000","172.21.15.5:6801/3616278616":"2024-09-01T05:19:55.663503+0000","172.21.15.5:0/2436421090":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/1570244689":"2024-09-01T05:19:55.663503+0000","172.21.15.5:0/2700448223":"2024-09-01T05:20:57.333680+0000","172.21.15.5:6800/3616278616":"2024-09-01T05:19:55.663503+0000","172.21.15.5:6800/2898463711":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/2450461036":"2024-09-01T05:20:57.333680+0000","172.21.15.5:0/1947189952":"2024-09-01T05:19:55.663503+0000","172.21.15.5:6800/1439868821":"2024-09-01T05:20:57.333680+0000","172.21.15.5:6801/2898463711":"2024-09-01T05:19:31.728664+0000","172.21.15.5:6801/1439868821":"2024-09-01T05:20:57.333680+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T05:29:17.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.742+0000 7f3054e41640 1 -- 172.21.15.5:0/1576266498 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f303c0b4c10 msgr2=0x7f303c0b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:17.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.742+0000 7f3054e41640 1 --2- 172.21.15.5:0/1576266498 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f303c0b4c10 0x7f303c0b7120 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3038005d00 tx=0x7f3038005ed0 comp rx=0 tx=0).stop 2024-08-31T05:29:17.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.742+0000 7f3054e41640 1 -- 172.21.15.5:0/1576266498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3050103900 msgr2=0x7f305019a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:17.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.743+0000 7f3054e41640 1 --2- 172.21.15.5:0/1576266498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3050103900 0x7f305019a240 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f3040005940 tx=0x7f30400042f0 comp rx=0 tx=0).stop 2024-08-31T05:29:17.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.743+0000 7f3054e41640 1 -- 172.21.15.5:0/1576266498 shutdown_connections 2024-08-31T05:29:17.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.743+0000 7f3054e41640 1 --2- 172.21.15.5:0/1576266498 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f303c0b4c10 0x7f303c0b7120 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:17.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.743+0000 7f3054e41640 1 --2- 172.21.15.5:0/1576266498 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3050109b90 0x7f305019fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:17.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.743+0000 7f3054e41640 1 --2- 172.21.15.5:0/1576266498 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3050109240 0x7f305019a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:17.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.743+0000 7f3054e41640 1 --2- 172.21.15.5:0/1576266498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3050103900 0x7f305019a240 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:17.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.743+0000 7f3054e41640 1 -- 172.21.15.5:0/1576266498 >> 172.21.15.5:0/1576266498 conn(0x7f305007b5f0 msgr2=0x7f30501072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:17.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.743+0000 7f3054e41640 1 -- 172.21.15.5:0/1576266498 shutdown_connections 2024-08-31T05:29:17.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:17.743+0000 7f3054e41640 1 -- 172.21.15.5:0/1576266498 wait complete. 2024-08-31T05:29:18.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:18 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/1576266498' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T05:29:18.518 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T05:29:18.585 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:18 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/1576266498' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T05:29:18.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:18 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/1576266498' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T05:29:18.773 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:29:19.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.254+0000 7f94e6acb640 1 -- 172.21.15.5:0/3222987360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94e0108ab0 msgr2=0x7f94e010f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:19.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.254+0000 7f94e6acb640 1 --2- 172.21.15.5:0/3222987360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94e0108ab0 0x7f94e010f2e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f94d8009900 tx=0x7f94d802a410 comp rx=0 tx=0).stop 2024-08-31T05:29:19.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.254+0000 7f94e6acb640 1 -- 172.21.15.5:0/3222987360 shutdown_connections 2024-08-31T05:29:19.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.254+0000 7f94e6acb640 1 --2- 172.21.15.5:0/3222987360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94e0108ab0 0x7f94e010f2e0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:19.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.254+0000 7f94e6acb640 1 --2- 172.21.15.5:0/3222987360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94e0108160 0x7f94e0108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:19.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.254+0000 7f94e6acb640 1 --2- 172.21.15.5:0/3222987360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94e0102820 0x7f94e0102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:19.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.254+0000 7f94e6acb640 1 -- 172.21.15.5:0/3222987360 >> 172.21.15.5:0/3222987360 conn(0x7f94e00794e0 msgr2=0x7f94e00798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:19.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.254+0000 7f94e6acb640 1 -- 172.21.15.5:0/3222987360 shutdown_connections 2024-08-31T05:29:19.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.254+0000 7f94e6acb640 1 -- 172.21.15.5:0/3222987360 wait complete. 2024-08-31T05:29:19.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.255+0000 7f94e6acb640 1 Processor -- start 2024-08-31T05:29:19.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.255+0000 7f94e6acb640 1 -- start start 2024-08-31T05:29:19.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.255+0000 7f94e6acb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94e0102820 0x7f94e019a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:19.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.255+0000 7f94e6acb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94e0108160 0x7f94e019a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:19.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.255+0000 7f94e6acb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94e0108ab0 0x7f94e019fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:19.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.255+0000 7f94e6acb640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f94e0112730 con 0x7f94e0108ab0 2024-08-31T05:29:19.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.255+0000 7f94e6acb640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f94e01125b0 con 0x7f94e0102820 2024-08-31T05:29:19.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.255+0000 7f94e6acb640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f94e01128b0 con 0x7f94e0108160 2024-08-31T05:29:19.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.255+0000 7f94e5068640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94e0108ab0 0x7f94e019fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:19.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.255+0000 7f94e5068640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94e0108ab0 0x7f94e019fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55388/0 (socket says 172.21.15.5:55388) 2024-08-31T05:29:19.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.255+0000 7f94e5068640 1 -- 172.21.15.5:0/303011869 learned_addr learned my addr 172.21.15.5:0/303011869 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:19.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.255+0000 7f94dffff640 1 --2- 172.21.15.5:0/303011869 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94e0108160 0x7f94e019a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:19.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.256+0000 7f94e4867640 1 --2- 172.21.15.5:0/303011869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94e0102820 0x7f94e019a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:19.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.256+0000 7f94e5068640 1 -- 172.21.15.5:0/303011869 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94e0108160 msgr2=0x7f94e019a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:19.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.256+0000 7f94e5068640 1 --2- 172.21.15.5:0/303011869 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94e0108160 0x7f94e019a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:19.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.256+0000 7f94e5068640 1 -- 172.21.15.5:0/303011869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94e0102820 msgr2=0x7f94e019a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:19.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.256+0000 7f94e5068640 1 --2- 172.21.15.5:0/303011869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94e0102820 0x7f94e019a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:19.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.256+0000 7f94e5068640 1 -- 172.21.15.5:0/303011869 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94e01a01e0 con 0x7f94e0108ab0 2024-08-31T05:29:19.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.256+0000 7f94dffff640 1 --2- 172.21.15.5:0/303011869 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94e0108160 0x7f94e019a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:29:19.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.256+0000 7f94e4867640 1 --2- 172.21.15.5:0/303011869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94e0102820 0x7f94e019a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:29:19.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.256+0000 7f94e5068640 1 --2- 172.21.15.5:0/303011869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94e0108ab0 0x7f94e019fab0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f94d8004770 tx=0x7f94d8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:19.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.256+0000 7f94ddffb640 1 -- 172.21.15.5:0/303011869 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d803f030 con 0x7f94e0108ab0 2024-08-31T05:29:19.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.256+0000 7f94e6acb640 1 -- 172.21.15.5:0/303011869 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94e01a0470 con 0x7f94e0108ab0 2024-08-31T05:29:19.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.256+0000 7f94ddffb640 1 -- 172.21.15.5:0/303011869 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94d8003aa0 con 0x7f94e0108ab0 2024-08-31T05:29:19.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.256+0000 7f94ddffb640 1 -- 172.21.15.5:0/303011869 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d8035070 con 0x7f94e0108ab0 2024-08-31T05:29:19.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.256+0000 7f94e6acb640 1 -- 172.21.15.5:0/303011869 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94e01a6c30 con 0x7f94e0108ab0 2024-08-31T05:29:19.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.257+0000 7f94e6acb640 1 -- 172.21.15.5:0/303011869 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94e0103aa0 con 0x7f94e0108ab0 2024-08-31T05:29:19.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.260+0000 7f94ddffb640 1 -- 172.21.15.5:0/303011869 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f94d8042030 con 0x7f94e0108ab0 2024-08-31T05:29:19.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.260+0000 7f94ddffb640 1 --2- 172.21.15.5:0/303011869 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f94cc0b4c10 0x7f94cc0b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:19.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.261+0000 7f94e4867640 1 --2- 172.21.15.5:0/303011869 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f94cc0b4c10 0x7f94cc0b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:19.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.261+0000 7f94ddffb640 1 -- 172.21.15.5:0/303011869 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f94d8106250 con 0x7f94e0108ab0 2024-08-31T05:29:19.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.261+0000 7f94e4867640 1 --2- 172.21.15.5:0/303011869 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f94cc0b4c10 0x7f94cc0b7120 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f94c8005fd0 tx=0x7f94c8009520 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:19.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.264+0000 7f94ddffb640 1 -- 172.21.15.5:0/303011869 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f94d80ccd80 con 0x7f94e0108ab0 2024-08-31T05:29:19.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:19 smithi005 ceph-mon[18602]: pgmap v325: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-31T05:29:19.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.494+0000 7f94e6acb640 1 -- 172.21.15.5:0/303011869 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f94e0102c30 con 0x7f94e0108ab0 2024-08-31T05:29:19.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.494+0000 7f94ddffb640 1 -- 172.21.15.5:0/303011869 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11941 (secure 0 0 0) 0x7f94e0102c30 con 0x7f94e0108ab0 2024-08-31T05:29:19.497 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:29:19.497 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":29,"btime":"2024-08-31T05:28:13:579476+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14739,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2024812199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2024812199},{"type":"v1","addr":"172.21.15.5:6835","nonce":2024812199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3629023702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3629023702},{"type":"v1","addr":"172.21.15.5:6837","nonce":3629023702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T05:27:31.929153+0000","modified":"2024-08-31T05:28:13.446913+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24652,"mds_1":24638,"mds_2":24631,"mds_3":24625,"mds_4":24602},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6839/2412701258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":2412701258},{"type":"v1","addr":"172.21.15.5:6839","nonce":2412701258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14820":{"gid":14820,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6841/747057838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":747057838},{"type":"v1","addr":"172.21.15.5:6841","nonce":747057838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6833/1153378982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1153378982},{"type":"v1","addr":"172.21.15.50:6833","nonce":1153378982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6833/364083443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":364083443},{"type":"v1","addr":"172.21.15.70:6833","nonce":364083443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24587":{"gid":24587,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/2346896794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2346896794},{"type":"v1","addr":"172.21.15.50:6835","nonce":2346896794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24602":{"gid":24602,"name":"h","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.50:6837/428759669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":428759669},{"type":"v1","addr":"172.21.15.50:6837","nonce":428759669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.70:6835/2061504114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2061504114},{"type":"v1","addr":"172.21.15.70:6835","nonce":2061504114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.70:6837/2780036414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2780036414},{"type":"v1","addr":"172.21.15.70:6837","nonce":2780036414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.50:6839/98200944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":98200944},{"type":"v1","addr":"172.21.15.50:6839","nonce":98200944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24652":{"gid":24652,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.70:6839/2756569250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":2756569250},{"type":"v1","addr":"172.21.15.70:6839","nonce":2756569250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24652,"qdb_cluster":[24602,24625,24638,24631,24652]},"id":1}]} 2024-08-31T05:29:19.497 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 29 2024-08-31T05:29:19.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.497+0000 7f94e6acb640 1 -- 172.21.15.5:0/303011869 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f94cc0b4c10 msgr2=0x7f94cc0b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:19.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.497+0000 7f94e6acb640 1 --2- 172.21.15.5:0/303011869 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f94cc0b4c10 0x7f94cc0b7120 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f94c8005fd0 tx=0x7f94c8009520 comp rx=0 tx=0).stop 2024-08-31T05:29:19.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.497+0000 7f94e6acb640 1 -- 172.21.15.5:0/303011869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94e0108ab0 msgr2=0x7f94e019fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:19.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.497+0000 7f94e6acb640 1 --2- 172.21.15.5:0/303011869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94e0108ab0 0x7f94e019fab0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f94d8004770 tx=0x7f94d8004270 comp rx=0 tx=0).stop 2024-08-31T05:29:19.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.497+0000 7f94e6acb640 1 -- 172.21.15.5:0/303011869 shutdown_connections 2024-08-31T05:29:19.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.497+0000 7f94e6acb640 1 --2- 172.21.15.5:0/303011869 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f94cc0b4c10 0x7f94cc0b7120 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:19.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.497+0000 7f94e6acb640 1 --2- 172.21.15.5:0/303011869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94e0108ab0 0x7f94e019fab0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:19.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.497+0000 7f94e6acb640 1 --2- 172.21.15.5:0/303011869 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94e0108160 0x7f94e019a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:19.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.497+0000 7f94e6acb640 1 --2- 172.21.15.5:0/303011869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94e0102820 0x7f94e019a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:19.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.497+0000 7f94e6acb640 1 -- 172.21.15.5:0/303011869 >> 172.21.15.5:0/303011869 conn(0x7f94e00794e0 msgr2=0x7f94e0101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:19.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.497+0000 7f94e6acb640 1 -- 172.21.15.5:0/303011869 shutdown_connections 2024-08-31T05:29:19.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:19.497+0000 7f94e6acb640 1 -- 172.21.15.5:0/303011869 wait complete. 2024-08-31T05:29:19.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:19 smithi070 ceph-mon[22316]: pgmap v325: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-31T05:29:19.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:19 smithi050 ceph-mon[22146]: pgmap v325: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-31T05:29:20.311 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 29, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-08-31T05:27:31.929153+0000', 'modified': '2024-08-31T05:28:13.446913+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24652, 'mds_1': 24638, 'mds_2': 24631, 'mds_3': 24625, 'mds_4': 24602}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14808': {'gid': 14808, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.5:6839/2412701258', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6838', 'nonce': 2412701258}, {'type': 'v1', 'addr': '172.21.15.5:6839', 'nonce': 2412701258}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14820': {'gid': 14820, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.5:6841/747057838', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6840', 'nonce': 747057838}, {'type': 'v1', 'addr': '172.21.15.5:6841', 'nonce': 747057838}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24560': {'gid': 24560, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.50:6833/1153378982', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6832', 'nonce': 1153378982}, {'type': 'v1', 'addr': '172.21.15.50:6833', 'nonce': 1153378982}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24583': {'gid': 24583, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.70:6833/364083443', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6832', 'nonce': 364083443}, {'type': 'v1', 'addr': '172.21.15.70:6833', 'nonce': 364083443}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24587': {'gid': 24587, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.50:6835/2346896794', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6834', 'nonce': 2346896794}, {'type': 'v1', 'addr': '172.21.15.50:6835', 'nonce': 2346896794}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24602': {'gid': 24602, 'name': 'h', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.50:6837/428759669', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6836', 'nonce': 428759669}, {'type': 'v1', 'addr': '172.21.15.50:6837', 'nonce': 428759669}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24625': {'gid': 24625, 'name': 'f', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 18, 'addr': '172.21.15.70:6835/2061504114', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6834', 'nonce': 2061504114}, {'type': 'v1', 'addr': '172.21.15.70:6835', 'nonce': 2061504114}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24631': {'gid': 24631, 'name': 'c', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.70:6837/2780036414', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6836', 'nonce': 2780036414}, {'type': 'v1', 'addr': '172.21.15.70:6837', 'nonce': 2780036414}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24638': {'gid': 24638, 'name': 'b', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.50:6839/98200944', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6838', 'nonce': 98200944}, {'type': 'v1', 'addr': '172.21.15.50:6839', 'nonce': 98200944}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24652': {'gid': 24652, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.70:6839/2756569250', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6838', 'nonce': 2756569250}, {'type': 'v1', 'addr': '172.21.15.70:6839', 'nonce': 2756569250}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24652, 'qdb_cluster': [24602, 24625, 24638, 24631, 24652]} 2024-08-31T05:29:20.311 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-08-31T05:29:20.312 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.h status 2024-08-31T05:29:20.568 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:29:20.585 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:20 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/303011869' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:29:20.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:20 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/303011869' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:29:20.688 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:20 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/303011869' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:29:21.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.093+0000 7f58a7456640 1 -- 172.21.15.5:0/81185307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58a0108a90 msgr2=0x7f58a010f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:21.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.093+0000 7f58a7456640 1 --2- 172.21.15.5:0/81185307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58a0108a90 0x7f58a010f2c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5898009ca0 tx=0x7f589802a8c0 comp rx=0 tx=0).stop 2024-08-31T05:29:21.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.093+0000 7f58a7456640 1 -- 172.21.15.5:0/81185307 shutdown_connections 2024-08-31T05:29:21.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.093+0000 7f58a7456640 1 --2- 172.21.15.5:0/81185307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58a0108a90 0x7f58a010f2c0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:21.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.093+0000 7f58a7456640 1 --2- 172.21.15.5:0/81185307 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58a0108140 0x7f58a0108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:21.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.093+0000 7f58a7456640 1 --2- 172.21.15.5:0/81185307 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58a0102800 0x7f58a0102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:21.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.093+0000 7f58a7456640 1 -- 172.21.15.5:0/81185307 >> 172.21.15.5:0/81185307 conn(0x7f58a00794d0 msgr2=0x7f58a00798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:21.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.093+0000 7f58a7456640 1 -- 172.21.15.5:0/81185307 shutdown_connections 2024-08-31T05:29:21.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.093+0000 7f58a7456640 1 -- 172.21.15.5:0/81185307 wait complete. 2024-08-31T05:29:21.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.094+0000 7f58a7456640 1 Processor -- start 2024-08-31T05:29:21.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.094+0000 7f58a7456640 1 -- start start 2024-08-31T05:29:21.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.094+0000 7f58a7456640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58a0102800 0x7f58a00ff410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:21.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.094+0000 7f58a7456640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58a0108140 0x7f58a00ff950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:21.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.094+0000 7f58a7456640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58a0108a90 0x7f58a00ffe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:21.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.094+0000 7f58a7456640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f58a01126f0 con 0x7f58a0108140 2024-08-31T05:29:21.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.094+0000 7f58a7456640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f58a0112570 con 0x7f58a0102800 2024-08-31T05:29:21.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.094+0000 7f58a7456640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f58a0112870 con 0x7f58a0108a90 2024-08-31T05:29:21.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.095+0000 7f58a49f1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58a0108140 0x7f58a00ff950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:21.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.095+0000 7f58a49f1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58a0108140 0x7f58a00ff950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55396/0 (socket says 172.21.15.5:55396) 2024-08-31T05:29:21.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.095+0000 7f58a49f1640 1 -- 172.21.15.5:0/542861935 learned_addr learned my addr 172.21.15.5:0/542861935 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:21.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.095+0000 7f58a59f3640 1 --2- 172.21.15.5:0/542861935 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58a0108a90 0x7f58a00ffe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:21.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.095+0000 7f58a51f2640 1 --2- 172.21.15.5:0/542861935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58a0102800 0x7f58a00ff410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:21.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.095+0000 7f58a49f1640 1 -- 172.21.15.5:0/542861935 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58a0108a90 msgr2=0x7f58a00ffe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:21.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.095+0000 7f58a49f1640 1 --2- 172.21.15.5:0/542861935 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58a0108a90 0x7f58a00ffe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:21.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.095+0000 7f58a49f1640 1 -- 172.21.15.5:0/542861935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58a0102800 msgr2=0x7f58a00ff410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:21.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.095+0000 7f58a49f1640 1 --2- 172.21.15.5:0/542861935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58a0102800 0x7f58a00ff410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:21.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.095+0000 7f58a49f1640 1 -- 172.21.15.5:0/542861935 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58a01a8420 con 0x7f58a0108140 2024-08-31T05:29:21.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.095+0000 7f58a49f1640 1 --2- 172.21.15.5:0/542861935 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58a0108140 0x7f58a00ff950 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f589c00c970 tx=0x7f589c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:21.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.095+0000 7f58927fc640 1 -- 172.21.15.5:0/542861935 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f589c014070 con 0x7f58a0108140 2024-08-31T05:29:21.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.095+0000 7f58a7456640 1 -- 172.21.15.5:0/542861935 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58a01a8710 con 0x7f58a0108140 2024-08-31T05:29:21.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.095+0000 7f58927fc640 1 -- 172.21.15.5:0/542861935 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f589c004440 con 0x7f58a0108140 2024-08-31T05:29:21.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.095+0000 7f58927fc640 1 -- 172.21.15.5:0/542861935 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f589c003e50 con 0x7f58a0108140 2024-08-31T05:29:21.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.095+0000 7f58a7456640 1 -- 172.21.15.5:0/542861935 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58a01a8ca0 con 0x7f58a0108140 2024-08-31T05:29:21.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.098+0000 7f58ad9cb740 1 Processor -- start 2024-08-31T05:29:21.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.098+0000 7f58ad9cb740 1 -- start start 2024-08-31T05:29:21.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.099+0000 7f58ad9cb740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56526ca4af60 0x56526cdf07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:21.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.099+0000 7f58ad9cb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56526ca220a0 0x56526cdf0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:21.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.099+0000 7f58ad9cb740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56526ca2a280 0x56526cdf1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:21.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.099+0000 7f58ad9cb740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56526cd673f0 con 0x56526ca4af60 2024-08-31T05:29:21.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.099+0000 7f58ad9cb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56526cd56980 con 0x56526ca220a0 2024-08-31T05:29:21.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.099+0000 7f58ad9cb740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56526cd5a930 con 0x56526ca2a280 2024-08-31T05:29:21.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.099+0000 7f58927fc640 1 -- 172.21.15.5:0/542861935 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f589c017070 con 0x7f58a0108140 2024-08-31T05:29:21.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.099+0000 7f58a59f3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56526ca4af60 0x56526cdf07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:21.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.099+0000 7f58a59f3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56526ca4af60 0x56526cdf07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55398/0 (socket says 172.21.15.5:55398) 2024-08-31T05:29:21.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.099+0000 7f58a59f3640 1 -- 172.21.15.5:0/362882513 learned_addr learned my addr 172.21.15.5:0/362882513 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:21.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.099+0000 7f58a49f1640 1 --2- 172.21.15.5:0/362882513 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56526ca2a280 0x56526cdf1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:21.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.099+0000 7f58a51f2640 1 --2- 172.21.15.5:0/362882513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56526ca220a0 0x56526cdf0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:21.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.099+0000 7f58a59f3640 1 -- 172.21.15.5:0/362882513 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56526ca2a280 msgr2=0x56526cdf1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:21.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.099+0000 7f58a59f3640 1 --2- 172.21.15.5:0/362882513 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56526ca2a280 0x56526cdf1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:21.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.099+0000 7f58a59f3640 1 -- 172.21.15.5:0/362882513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56526ca220a0 msgr2=0x56526cdf0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:21.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.099+0000 7f58a59f3640 1 --2- 172.21.15.5:0/362882513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56526ca220a0 0x56526cdf0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:21.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.099+0000 7f58a59f3640 1 -- 172.21.15.5:0/362882513 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56526cab6540 con 0x56526ca4af60 2024-08-31T05:29:21.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.100+0000 7f58a59f3640 1 --2- 172.21.15.5:0/362882513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56526ca4af60 0x56526cdf07b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5898009930 tx=0x7f5898009960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d55753f55b3850ca server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:21.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.100+0000 7f58927fc640 1 --2- 172.21.15.5:0/542861935 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f588c0b4e30 0x7f588c0b7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:21.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.100+0000 7f588b7fe640 1 -- 172.21.15.5:0/362882513 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5898031df0 con 0x56526ca4af60 2024-08-31T05:29:21.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.100+0000 7f588b7fe640 1 -- 172.21.15.5:0/362882513 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5898036040 con 0x56526ca4af60 2024-08-31T05:29:21.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.100+0000 7f58a51f2640 1 --2- 172.21.15.5:0/542861935 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f588c0b4e30 0x7f588c0b7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:21.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.100+0000 7f588b7fe640 1 -- 172.21.15.5:0/362882513 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58980042d0 con 0x56526ca4af60 2024-08-31T05:29:21.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.100+0000 7f58927fc640 1 -- 172.21.15.5:0/542861935 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f589c0e52d0 con 0x7f58a0108140 2024-08-31T05:29:21.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.101+0000 7f58ad9cb740 1 -- 172.21.15.5:0/362882513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56526ca4af60 msgr2=0x56526cdf07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:21.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.101+0000 7f58a51f2640 1 --2- 172.21.15.5:0/542861935 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f588c0b4e30 0x7f588c0b7340 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5894005a80 tx=0x7f5894005a10 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:21.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.101+0000 7f58ad9cb740 1 --2- 172.21.15.5:0/362882513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56526ca4af60 0x56526cdf07b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5898009930 tx=0x7f5898009960 comp rx=0 tx=0).stop 2024-08-31T05:29:21.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.101+0000 7f58ad9cb740 1 -- 172.21.15.5:0/362882513 shutdown_connections 2024-08-31T05:29:21.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.101+0000 7f58ad9cb740 1 --2- 172.21.15.5:0/362882513 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56526ca2a280 0x56526cdf1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:21.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.101+0000 7f58ad9cb740 1 --2- 172.21.15.5:0/362882513 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56526ca220a0 0x56526cdf0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:21.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.101+0000 7f58ad9cb740 1 --2- 172.21.15.5:0/362882513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56526ca4af60 0x56526cdf07b0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:21.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.101+0000 7f58ad9cb740 1 -- 172.21.15.5:0/362882513 >> 172.21.15.5:0/362882513 conn(0x56526ca3f350 msgr2=0x56526cdee6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:21.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.101+0000 7f58ad9cb740 1 -- 172.21.15.5:0/362882513 shutdown_connections 2024-08-31T05:29:21.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.101+0000 7f58ad9cb740 1 -- 172.21.15.5:0/362882513 wait complete. 2024-08-31T05:29:21.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.101+0000 7f58ad9cb740 1 -- start start 2024-08-31T05:29:21.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.102+0000 7f58ad9cb740 1 Processor -- start 2024-08-31T05:29:21.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.102+0000 7f58ad9cb740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56526ca220a0 0x56526cdfbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:21.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.102+0000 7f58ad9cb740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56526ca2a280 0x56526cdfc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:21.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.102+0000 7f58ad9cb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56526ca4af60 0x56526ce08220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:21.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.102+0000 7f58ad9cb740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56526cbb95f0 con 0x56526ca2a280 2024-08-31T05:29:21.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.102+0000 7f58ad9cb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56526ccdd600 con 0x56526ca4af60 2024-08-31T05:29:21.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.102+0000 7f58ad9cb740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56526cdfef30 con 0x56526ca220a0 2024-08-31T05:29:21.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.102+0000 7f58ad9cb740 10 client.0 _ll_register_callbacks cb 0x56526cd03af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:29:21.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.102+0000 7f58a49f1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56526ca2a280 0x56526cdfc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:21.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.102+0000 7f58a49f1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56526ca2a280 0x56526cdfc3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55406/0 (socket says 172.21.15.5:55406) 2024-08-31T05:29:21.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.102+0000 7f58a49f1640 1 -- 172.21.15.5:0/3003691854 learned_addr learned my addr 172.21.15.5:0/3003691854 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:21.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.102+0000 7f58a59f3640 1 --2- 172.21.15.5:0/3003691854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56526ca4af60 0x56526ce08220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:21.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.102+0000 7f58a51f2640 1 --2- 172.21.15.5:0/3003691854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56526ca220a0 0x56526cdfbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:21.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.103+0000 7f58a49f1640 1 -- 172.21.15.5:0/3003691854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56526ca220a0 msgr2=0x56526cdfbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:21.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.103+0000 7f58a49f1640 1 --2- 172.21.15.5:0/3003691854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56526ca220a0 0x56526cdfbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:21.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.103+0000 7f58a49f1640 1 -- 172.21.15.5:0/3003691854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56526ca4af60 msgr2=0x56526ce08220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:21.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.103+0000 7f58a49f1640 1 --2- 172.21.15.5:0/3003691854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56526ca4af60 0x56526ce08220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:21.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.103+0000 7f58a49f1640 1 -- 172.21.15.5:0/3003691854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56526cd167b0 con 0x56526ca2a280 2024-08-31T05:29:21.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.103+0000 7f58a59f3640 1 --2- 172.21.15.5:0/3003691854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56526ca4af60 0x56526ce08220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:29:21.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.103+0000 7f58a51f2640 1 --2- 172.21.15.5:0/3003691854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56526ca220a0 0x56526cdfbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:29:21.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.103+0000 7f58a49f1640 1 --2- 172.21.15.5:0/3003691854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56526ca2a280 0x56526cdfc3b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f589c0a7780 tx=0x7f589c0ab5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73a42b856fbba3f4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:21.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.103+0000 7f5888ff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:29:21.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.103+0000 7f5888ff9640 1 -- 172.21.15.5:0/3003691854 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f589c0abe00 con 0x56526ca2a280 2024-08-31T05:29:21.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.103+0000 7f5888ff9640 1 -- 172.21.15.5:0/3003691854 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f589c0e2a30 con 0x56526ca2a280 2024-08-31T05:29:21.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.103+0000 7f58ad9cb740 1 -- 172.21.15.5:0/3003691854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5898036040 con 0x56526ca2a280 2024-08-31T05:29:21.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.103+0000 7f5888ff9640 1 -- 172.21.15.5:0/3003691854 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f589c092e60 con 0x56526ca2a280 2024-08-31T05:29:21.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.103+0000 7f58ad9cb740 10 client.15282 fetch_fsmap learned FSMap version 29 2024-08-31T05:29:21.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.103+0000 7f58ad9cb740 1 -- 172.21.15.5:0/3003691854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56526ce0ac40 con 0x56526ca2a280 2024-08-31T05:29:21.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.103+0000 7f5888ff9640 1 -- 172.21.15.5:0/3003691854 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5898036040 con 0x56526ca2a280 2024-08-31T05:29:21.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.104+0000 7f5888ff9640 1 -- 172.21.15.5:0/3003691854 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f589c0e8b10 con 0x56526ca2a280 2024-08-31T05:29:21.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.104+0000 7f58ad9cb740 10 client.15282 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T05:29:21.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.104+0000 7f58ad9cb740 10 client.15282 resolve_mds: resolved name 'h' to daemon mds.h 2024-08-31T05:29:21.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.104+0000 7f58ad9cb740 20 client.15282 populate_metadata read hostname 'smithi005' 2024-08-31T05:29:21.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.104+0000 7f58ad9cb740 1 --2- 172.21.15.5:0/3003691854 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x56526ca098e0 0x56526ce0e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:21.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.104+0000 7f58ad9cb740 4 client.15282 mds_command: new command op to 24602 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:29:21.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.104+0000 7f58ad9cb740 1 -- 172.21.15.5:0/3003691854 --> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56526cd69340 con 0x56526ca098e0 2024-08-31T05:29:21.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.104+0000 7f58a51f2640 1 --2- 172.21.15.5:0/3003691854 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x56526ca098e0 0x56526ce0e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:21.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.104+0000 7f5888ff9640 10 client.15282 ms_handle_connect on v2:172.21.15.50:6836/428759669 2024-08-31T05:29:21.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.104+0000 7f58a51f2640 1 --2- 172.21.15.5:0/3003691854 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x56526ca098e0 0x56526ce0e640 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=47d31f444c0825ed server_cookie=a871c64ae95ef00 in_seq=0 out_seq=0 2024-08-31T05:29:21.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.105+0000 7f5888ff9640 1 -- 172.21.15.5:0/3003691854 <== mds.4 v2:172.21.15.50:6836/428759669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56526cd69340 con 0x56526ca098e0 2024-08-31T05:29:21.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.105+0000 7f5888ff9640 10 client.15282 handle_command_reply: tid=0 2024-08-31T05:29:21.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.105+0000 7f58ad9cb740 1 client.15282 shutdown 2024-08-31T05:29:21.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.105+0000 7f58ad9cb740 1 -- 172.21.15.5:0/3003691854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56526ca2a280 msgr2=0x56526cdfc3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:21.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.105+0000 7f58ad9cb740 1 --2- 172.21.15.5:0/3003691854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56526ca2a280 0x56526cdfc3b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f589c0a7780 tx=0x7f589c0ab5f0 comp rx=0 tx=0).stop 2024-08-31T05:29:21.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.105+0000 7f58ad9cb740 1 -- 172.21.15.5:0/3003691854 shutdown_connections 2024-08-31T05:29:21.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.105+0000 7f58ad9cb740 1 --2- 172.21.15.5:0/3003691854 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x56526ca098e0 0x56526ce0e640 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:21.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.105+0000 7f58ad9cb740 1 --2- 172.21.15.5:0/3003691854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56526ca4af60 0x56526ce08220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:21.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.105+0000 7f58ad9cb740 1 --2- 172.21.15.5:0/3003691854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56526ca2a280 0x56526cdfc3b0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:21.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.105+0000 7f5888ff9640 0 client.15282 ms_handle_reset on v2:172.21.15.50:6836/428759669 2024-08-31T05:29:21.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.105+0000 7f58ad9cb740 1 --2- 172.21.15.5:0/3003691854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56526ca220a0 0x56526cdfbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:21.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.105+0000 7f58ad9cb740 1 -- 172.21.15.5:0/3003691854 >> 172.21.15.5:0/3003691854 conn(0x56526ca3f350 msgr2=0x56526cdf3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:21.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.106+0000 7f58ad9cb740 1 -- 172.21.15.5:0/3003691854 shutdown_connections 2024-08-31T05:29:21.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.106+0000 7f58ad9cb740 1 -- 172.21.15.5:0/3003691854 wait complete. 2024-08-31T05:29:21.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.106+0000 7f58ad9cb740 20 client.15282 trim_cache size 0 max 16384 2024-08-31T05:29:21.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.124+0000 7f58ad9cb740 1 Processor -- start 2024-08-31T05:29:21.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.124+0000 7f58ad9cb740 1 -- start start 2024-08-31T05:29:21.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.124+0000 7f58ad9cb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56526ca220a0 0x56526ce0c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:21.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.124+0000 7f58ad9cb740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56526ca2a280 0x56526ce08190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:21.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.124+0000 7f58ad9cb740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56526ca4af60 0x56526cdedcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:21.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.124+0000 7f58ad9cb740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56526ce0c980 con 0x56526ca4af60 2024-08-31T05:29:21.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.124+0000 7f58ad9cb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56526ce0d050 con 0x56526ca220a0 2024-08-31T05:29:21.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.124+0000 7f58ad9cb740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56526ce0d720 con 0x56526ca2a280 2024-08-31T05:29:21.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.124+0000 7f58a59f3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56526ca4af60 0x56526cdedcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:21.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.124+0000 7f58a59f3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56526ca4af60 0x56526cdedcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55410/0 (socket says 172.21.15.5:55410) 2024-08-31T05:29:21.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.124+0000 7f58a59f3640 1 -- 172.21.15.5:0/1643564500 learned_addr learned my addr 172.21.15.5:0/1643564500 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:21.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.125+0000 7f58a51f2640 1 --2- 172.21.15.5:0/1643564500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56526ca220a0 0x56526ce0c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:21.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.125+0000 7f58a49f1640 1 --2- 172.21.15.5:0/1643564500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56526ca2a280 0x56526ce08190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:21.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.125+0000 7f58a59f3640 1 -- 172.21.15.5:0/1643564500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56526ca2a280 msgr2=0x56526ce08190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:21.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.125+0000 7f58a59f3640 1 --2- 172.21.15.5:0/1643564500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56526ca2a280 0x56526ce08190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:21.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.125+0000 7f58a59f3640 1 -- 172.21.15.5:0/1643564500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56526ca220a0 msgr2=0x56526ce0c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:21.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.125+0000 7f58a59f3640 1 --2- 172.21.15.5:0/1643564500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56526ca220a0 0x56526ce0c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:21.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.125+0000 7f58a59f3640 1 -- 172.21.15.5:0/1643564500 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56526cdfea40 con 0x56526ca4af60 2024-08-31T05:29:21.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.125+0000 7f58a59f3640 1 --2- 172.21.15.5:0/1643564500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56526ca4af60 0x56526cdedcf0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5898009bc0 tx=0x7f5898000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=565273cea5198455 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:21.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.125+0000 7f588affd640 1 -- 172.21.15.5:0/1643564500 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5898031590 con 0x56526ca4af60 2024-08-31T05:29:21.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.125+0000 7f588affd640 1 -- 172.21.15.5:0/1643564500 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5898036050 con 0x56526ca4af60 2024-08-31T05:29:21.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.125+0000 7f588affd640 1 -- 172.21.15.5:0/1643564500 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5898004430 con 0x56526ca4af60 2024-08-31T05:29:21.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.126+0000 7f58ad9cb740 1 -- 172.21.15.5:0/1643564500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56526ca4af60 msgr2=0x56526cdedcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:21.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.126+0000 7f58ad9cb740 1 --2- 172.21.15.5:0/1643564500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56526ca4af60 0x56526cdedcf0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5898009bc0 tx=0x7f5898000f40 comp rx=0 tx=0).stop 2024-08-31T05:29:21.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.126+0000 7f58ad9cb740 1 -- 172.21.15.5:0/1643564500 shutdown_connections 2024-08-31T05:29:21.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.126+0000 7f58ad9cb740 1 --2- 172.21.15.5:0/1643564500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56526ca4af60 0x56526cdedcf0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:21.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.126+0000 7f58ad9cb740 1 --2- 172.21.15.5:0/1643564500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56526ca2a280 0x56526ce08190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:21.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.126+0000 7f58ad9cb740 1 --2- 172.21.15.5:0/1643564500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56526ca220a0 0x56526ce0c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:21.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.126+0000 7f58ad9cb740 1 -- 172.21.15.5:0/1643564500 >> 172.21.15.5:0/1643564500 conn(0x56526ca3f350 msgr2=0x56526cdfa6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:21.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.126+0000 7f58ad9cb740 1 -- 172.21.15.5:0/1643564500 shutdown_connections 2024-08-31T05:29:21.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.126+0000 7f58ad9cb740 1 -- 172.21.15.5:0/1643564500 wait complete. 2024-08-31T05:29:21.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.126+0000 7f58ad9cb740 1 -- start start 2024-08-31T05:29:21.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.126+0000 7f58ad9cb740 1 Processor -- start 2024-08-31T05:29:21.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.127+0000 7f58ad9cb740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56526ca220a0 0x56526ce172b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:21.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.127+0000 7f58ad9cb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56526ca2a280 0x56526ce10780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:21.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.127+0000 7f58ad9cb740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56526ca4af60 0x56526ce10e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:21.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.127+0000 7f58ad9cb740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56526ce0e4c0 con 0x56526ca4af60 2024-08-31T05:29:21.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.127+0000 7f58ad9cb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56526ce0ddf0 con 0x56526ca2a280 2024-08-31T05:29:21.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.127+0000 7f58ad9cb740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56526ce0eb90 con 0x56526ca220a0 2024-08-31T05:29:21.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.127+0000 7f58ad9cb740 10 client.0 _ll_register_callbacks cb 0x7f589c0a75c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:29:21.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.127+0000 7f58a59f3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56526ca4af60 0x56526ce10e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:21.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.127+0000 7f58a59f3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56526ca4af60 0x56526ce10e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55420/0 (socket says 172.21.15.5:55420) 2024-08-31T05:29:21.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.127+0000 7f58a59f3640 1 -- 172.21.15.5:0/3050682078 learned_addr learned my addr 172.21.15.5:0/3050682078 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:21.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.127+0000 7f58a51f2640 1 --2- 172.21.15.5:0/3050682078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56526ca220a0 0x56526ce172b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:21.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.127+0000 7f58a49f1640 1 --2- 172.21.15.5:0/3050682078 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56526ca2a280 0x56526ce10780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:21.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.127+0000 7f58a59f3640 1 -- 172.21.15.5:0/3050682078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56526ca220a0 msgr2=0x56526ce172b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:21.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.127+0000 7f58a59f3640 1 --2- 172.21.15.5:0/3050682078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56526ca220a0 0x56526ce172b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:21.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.127+0000 7f58a59f3640 1 -- 172.21.15.5:0/3050682078 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56526ca2a280 msgr2=0x56526ce10780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:21.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.127+0000 7f58a59f3640 1 --2- 172.21.15.5:0/3050682078 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56526ca2a280 0x56526ce10780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:21.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.127+0000 7f58a59f3640 1 -- 172.21.15.5:0/3050682078 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56526ce15ef0 con 0x56526ca4af60 2024-08-31T05:29:21.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.127+0000 7f58a51f2640 1 --2- 172.21.15.5:0/3050682078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56526ca220a0 0x56526ce172b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:29:21.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.128+0000 7f58a59f3640 1 --2- 172.21.15.5:0/3050682078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56526ca4af60 0x56526ce10e90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f589802ade0 tx=0x7f5898031690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ed3b0a0fc943548 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:21.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.128+0000 7f5888ff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:29:21.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.128+0000 7f5888ff9640 1 -- 172.21.15.5:0/3050682078 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5898003b80 con 0x56526ca4af60 2024-08-31T05:29:21.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.128+0000 7f58ad9cb740 1 -- 172.21.15.5:0/3050682078 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5898036050 con 0x56526ca4af60 2024-08-31T05:29:21.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.128+0000 7f5888ff9640 1 -- 172.21.15.5:0/3050682078 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f5898003d20 con 0x56526ca4af60 2024-08-31T05:29:21.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.128+0000 7f5888ff9640 1 -- 172.21.15.5:0/3050682078 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5898068050 con 0x56526ca4af60 2024-08-31T05:29:21.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.128+0000 7f58ad9cb740 10 client.15288 fetch_fsmap learned FSMap version 29 2024-08-31T05:29:21.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.128+0000 7f58ad9cb740 1 -- 172.21.15.5:0/3050682078 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56526ce79c90 con 0x56526ca4af60 2024-08-31T05:29:21.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.128+0000 7f5888ff9640 1 -- 172.21.15.5:0/3050682078 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5898036050 con 0x56526ca4af60 2024-08-31T05:29:21.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.128+0000 7f5888ff9640 1 -- 172.21.15.5:0/3050682078 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f589804e070 con 0x56526ca4af60 2024-08-31T05:29:21.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.128+0000 7f58ad9cb740 10 client.15288 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T05:29:21.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.128+0000 7f58ad9cb740 10 client.15288 resolve_mds: resolved name 'h' to daemon mds.h 2024-08-31T05:29:21.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.128+0000 7f58ad9cb740 20 client.15288 populate_metadata read hostname 'smithi005' 2024-08-31T05:29:21.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.128+0000 7f58ad9cb740 1 --2- 172.21.15.5:0/3050682078 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x56526c9dec90 0x56526ce7d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:21.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.128+0000 7f58ad9cb740 4 client.15288 mds_command: new command op to 24602 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T05:29:21.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.128+0000 7f58ad9cb740 1 -- 172.21.15.5:0/3050682078 --> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] -- command(tid 0: {"prefix": "status"}) -- 0x56526cd64de0 con 0x56526c9dec90 2024-08-31T05:29:21.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.129+0000 7f58a51f2640 1 --2- 172.21.15.5:0/3050682078 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x56526c9dec90 0x56526ce7d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:21.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.129+0000 7f58a51f2640 1 --2- 172.21.15.5:0/3050682078 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x56526c9dec90 0x56526ce7d0b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c47f29e5df38b91 server_cookie=67c25e47746f89d8 in_seq=0 out_seq=0 2024-08-31T05:29:21.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.129+0000 7f5888ff9640 10 client.15288 ms_handle_connect on v2:172.21.15.50:6836/428759669 2024-08-31T05:29:21.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.129+0000 7f5888ff9640 1 -- 172.21.15.5:0/3050682078 <== mds.4 v2:172.21.15.50:6836/428759669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x56526cd64de0 con 0x56526c9dec90 2024-08-31T05:29:21.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.129+0000 7f5888ff9640 10 client.15288 handle_command_reply: tid=0 2024-08-31T05:29:21.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.130+0000 7f58ad9cb740 1 client.15288 shutdown 2024-08-31T05:29:21.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.130+0000 7f58ad9cb740 1 -- 172.21.15.5:0/3050682078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56526ca4af60 msgr2=0x56526ce10e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:21.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.130+0000 7f58ad9cb740 1 --2- 172.21.15.5:0/3050682078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56526ca4af60 0x56526ce10e90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f589802ade0 tx=0x7f5898031690 comp rx=0 tx=0).stop 2024-08-31T05:29:21.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.130+0000 7f58ad9cb740 1 -- 172.21.15.5:0/3050682078 shutdown_connections 2024-08-31T05:29:21.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.130+0000 7f58ad9cb740 1 --2- 172.21.15.5:0/3050682078 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x56526c9dec90 0x56526ce7d0b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:21.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.130+0000 7f58ad9cb740 1 --2- 172.21.15.5:0/3050682078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56526ca4af60 0x56526ce10e90 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:21.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.130+0000 7f5888ff9640 0 client.15288 ms_handle_reset on v2:172.21.15.50:6836/428759669 2024-08-31T05:29:21.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.130+0000 7f58ad9cb740 1 --2- 172.21.15.5:0/3050682078 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56526ca2a280 0x56526ce10780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:21.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.130+0000 7f58ad9cb740 1 --2- 172.21.15.5:0/3050682078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56526ca220a0 0x56526ce172b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:21.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.130+0000 7f58ad9cb740 1 -- 172.21.15.5:0/3050682078 >> 172.21.15.5:0/3050682078 conn(0x56526ca3f350 msgr2=0x56526cdfd130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:21.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.130+0000 7f58ad9cb740 1 -- 172.21.15.5:0/3050682078 shutdown_connections 2024-08-31T05:29:21.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.130+0000 7f58ad9cb740 1 -- 172.21.15.5:0/3050682078 wait complete. 2024-08-31T05:29:21.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.130+0000 7f58ad9cb740 20 client.15288 trim_cache size 0 max 16384 2024-08-31T05:29:21.140 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:29:21.140 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "69422704-6758-11ef-bcd4-c7b262605968", 2024-08-31T05:29:21.140 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 4, 2024-08-31T05:29:21.140 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 24602, 2024-08-31T05:29:21.140 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-08-31T05:29:21.140 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-08-31T05:29:21.140 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-08-31T05:29:21.140 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 69.557270711000001, 2024-08-31T05:29:21.140 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 29, 2024-08-31T05:29:21.140 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 87, 2024-08-31T05:29:21.140 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 85, 2024-08-31T05:29:21.140 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 131.401602021 2024-08-31T05:29:21.141 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:29:21.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.130+0000 7f58a7456640 1 -- 172.21.15.5:0/542861935 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f588c0b4e30 msgr2=0x7f588c0b7340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:21.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.130+0000 7f58a7456640 1 --2- 172.21.15.5:0/542861935 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f588c0b4e30 0x7f588c0b7340 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5894005a80 tx=0x7f5894005a10 comp rx=0 tx=0).stop 2024-08-31T05:29:21.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.130+0000 7f58a7456640 1 -- 172.21.15.5:0/542861935 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58a0108140 msgr2=0x7f58a00ff950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:21.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.131+0000 7f58a7456640 1 --2- 172.21.15.5:0/542861935 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58a0108140 0x7f58a00ff950 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f589c00c970 tx=0x7f589c00ce30 comp rx=0 tx=0).stop 2024-08-31T05:29:21.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.131+0000 7f58a7456640 1 -- 172.21.15.5:0/542861935 shutdown_connections 2024-08-31T05:29:21.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.131+0000 7f58a7456640 1 --2- 172.21.15.5:0/542861935 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f588c0b4e30 0x7f588c0b7340 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:21.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.131+0000 7f58a7456640 1 --2- 172.21.15.5:0/542861935 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58a0108a90 0x7f58a00ffe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:21.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.131+0000 7f58a7456640 1 --2- 172.21.15.5:0/542861935 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58a0108140 0x7f58a00ff950 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:21.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.131+0000 7f58a7456640 1 --2- 172.21.15.5:0/542861935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58a0102800 0x7f58a00ff410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:21.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.131+0000 7f58a7456640 1 -- 172.21.15.5:0/542861935 >> 172.21.15.5:0/542861935 conn(0x7f58a00794d0 msgr2=0x7f58a006af90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:21.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.131+0000 7f58a7456640 1 -- 172.21.15.5:0/542861935 shutdown_connections 2024-08-31T05:29:21.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:21.131+0000 7f58a7456640 1 -- 172.21.15.5:0/542861935 wait complete. 2024-08-31T05:29:21.454 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:21 smithi005 ceph-mon[18602]: pgmap v326: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-08-31T05:29:21.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:21 smithi070 ceph-mon[22316]: pgmap v326: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-08-31T05:29:21.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:21 smithi050 ceph-mon[22146]: pgmap v326: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-08-31T05:29:21.944 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.f status 2024-08-31T05:29:22.195 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:29:22.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.734+0000 7f4b03a68640 1 -- 172.21.15.5:0/1410002345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4afc102840 msgr2=0x7f4afc102c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:22.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.734+0000 7f4b03a68640 1 --2- 172.21.15.5:0/1410002345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4afc102840 0x7f4afc102c50 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4af8009ca0 tx=0x7f4af802a8c0 comp rx=0 tx=0).stop 2024-08-31T05:29:22.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.734+0000 7f4b03a68640 1 -- 172.21.15.5:0/1410002345 shutdown_connections 2024-08-31T05:29:22.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.734+0000 7f4b03a68640 1 --2- 172.21.15.5:0/1410002345 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4afc108ad0 0x7f4afc10f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:22.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.734+0000 7f4b03a68640 1 --2- 172.21.15.5:0/1410002345 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4afc108180 0x7f4afc108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:22.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.734+0000 7f4b03a68640 1 --2- 172.21.15.5:0/1410002345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4afc102840 0x7f4afc102c50 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:22.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.734+0000 7f4b03a68640 1 -- 172.21.15.5:0/1410002345 >> 172.21.15.5:0/1410002345 conn(0x7f4afc079580 msgr2=0x7f4afc079990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:22.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.735+0000 7f4b03a68640 1 -- 172.21.15.5:0/1410002345 shutdown_connections 2024-08-31T05:29:22.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.735+0000 7f4b03a68640 1 -- 172.21.15.5:0/1410002345 wait complete. 2024-08-31T05:29:22.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.735+0000 7f4b03a68640 1 Processor -- start 2024-08-31T05:29:22.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.736+0000 7f4b03a68640 1 -- start start 2024-08-31T05:29:22.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.736+0000 7f4b03a68640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4afc102840 0x7f4afc10fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:22.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.736+0000 7f4b03a68640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4afc108180 0x7f4afc1102d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:22.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.736+0000 7f4b03a68640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4afc108ad0 0x7f4afc110810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:22.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.736+0000 7f4b03a68640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4afc113860 con 0x7f4afc108ad0 2024-08-31T05:29:22.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.736+0000 7f4b03a68640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4afc1136e0 con 0x7f4afc108180 2024-08-31T05:29:22.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.736+0000 7f4b03a68640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4afc1139e0 con 0x7f4afc102840 2024-08-31T05:29:22.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.736+0000 7f4b02005640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4afc108ad0 0x7f4afc110810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:22.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.736+0000 7f4b02005640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4afc108ad0 0x7f4afc110810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36170/0 (socket says 172.21.15.5:36170) 2024-08-31T05:29:22.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.736+0000 7f4b02005640 1 -- 172.21.15.5:0/2922638645 learned_addr learned my addr 172.21.15.5:0/2922638645 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:22.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.736+0000 7f4b01804640 1 --2- 172.21.15.5:0/2922638645 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4afc102840 0x7f4afc10fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:22.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.736+0000 7f4b01003640 1 --2- 172.21.15.5:0/2922638645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4afc108180 0x7f4afc1102d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:22.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.736+0000 7f4b02005640 1 -- 172.21.15.5:0/2922638645 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4afc102840 msgr2=0x7f4afc10fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:22.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.736+0000 7f4b02005640 1 --2- 172.21.15.5:0/2922638645 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4afc102840 0x7f4afc10fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:22.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.736+0000 7f4b02005640 1 -- 172.21.15.5:0/2922638645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4afc108180 msgr2=0x7f4afc1102d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:22.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.736+0000 7f4b02005640 1 --2- 172.21.15.5:0/2922638645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4afc108180 0x7f4afc1102d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:22.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.736+0000 7f4b02005640 1 -- 172.21.15.5:0/2922638645 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4afc1a84f0 con 0x7f4afc108ad0 2024-08-31T05:29:22.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.736+0000 7f4b01003640 1 --2- 172.21.15.5:0/2922638645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4afc108180 0x7f4afc1102d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:29:22.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.737+0000 7f4b02005640 1 --2- 172.21.15.5:0/2922638645 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4afc108ad0 0x7f4afc110810 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4af400e970 tx=0x7f4af400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:22.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.737+0000 7f4af2ffd640 1 -- 172.21.15.5:0/2922638645 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af400ccc0 con 0x7f4afc108ad0 2024-08-31T05:29:22.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.737+0000 7f4af2ffd640 1 -- 172.21.15.5:0/2922638645 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4af400ce60 con 0x7f4afc108ad0 2024-08-31T05:29:22.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.737+0000 7f4b03a68640 1 -- 172.21.15.5:0/2922638645 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4afc1a87e0 con 0x7f4afc108ad0 2024-08-31T05:29:22.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.737+0000 7f4af2ffd640 1 -- 172.21.15.5:0/2922638645 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af4010430 con 0x7f4afc108ad0 2024-08-31T05:29:22.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.737+0000 7f4b03a68640 1 -- 172.21.15.5:0/2922638645 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4afc1a8d20 con 0x7f4afc108ad0 2024-08-31T05:29:22.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.740+0000 7f4b09fdd740 1 Processor -- start 2024-08-31T05:29:22.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.740+0000 7f4af2ffd640 1 -- 172.21.15.5:0/2922638645 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f4af4004ff0 con 0x7f4afc108ad0 2024-08-31T05:29:22.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.740+0000 7f4b09fdd740 1 -- start start 2024-08-31T05:29:22.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.740+0000 7f4b09fdd740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563155c51f60 0x563155ff77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:22.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.740+0000 7f4b09fdd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563155c290a0 0x563155ff7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:22.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.740+0000 7f4b09fdd740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563155c31280 0x563155ff8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:22.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.740+0000 7f4b09fdd740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x563155f6e3f0 con 0x563155c31280 2024-08-31T05:29:22.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.740+0000 7f4b09fdd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x563155f5d980 con 0x563155c290a0 2024-08-31T05:29:22.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.740+0000 7f4b09fdd740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563155f61930 con 0x563155c51f60 2024-08-31T05:29:22.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.740+0000 7f4b01003640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563155c31280 0x563155ff8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:22.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.740+0000 7f4b01003640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563155c31280 0x563155ff8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36186/0 (socket says 172.21.15.5:36186) 2024-08-31T05:29:22.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.740+0000 7f4b01003640 1 -- 172.21.15.5:0/2362972862 learned_addr learned my addr 172.21.15.5:0/2362972862 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:22.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.741+0000 7f4b01804640 1 --2- 172.21.15.5:0/2362972862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563155c290a0 0x563155ff7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:22.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.741+0000 7f4b01003640 1 --2- 172.21.15.5:0/2362972862 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563155c51f60 0x563155ff77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:22.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.741+0000 7f4b01003640 1 -- 172.21.15.5:0/2362972862 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563155c51f60 msgr2=0x563155ff77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:22.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.741+0000 7f4b01003640 1 --2- 172.21.15.5:0/2362972862 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563155c51f60 0x563155ff77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:22.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.741+0000 7f4b01003640 1 -- 172.21.15.5:0/2362972862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563155c290a0 msgr2=0x563155ff7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:22.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.741+0000 7f4b01003640 1 --2- 172.21.15.5:0/2362972862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563155c290a0 0x563155ff7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:22.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.741+0000 7f4af2ffd640 1 --2- 172.21.15.5:0/2922638645 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4ae80b4c90 0x7f4ae80b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:22.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.741+0000 7f4b01003640 1 -- 172.21.15.5:0/2362972862 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563155cbd540 con 0x563155c31280 2024-08-31T05:29:22.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.741+0000 7f4b01003640 1 --2- 172.21.15.5:0/2362972862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563155c31280 0x563155ff8230 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4aec013550 tx=0x7f4aec009790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b445b72dc8fac75 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:22.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.741+0000 7f4af2ffd640 1 -- 172.21.15.5:0/2922638645 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f4af40e5c20 con 0x7f4afc108ad0 2024-08-31T05:29:22.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.741+0000 7f4b01003640 1 --2- 172.21.15.5:0/2922638645 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4ae80b4c90 0x7f4ae80b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:22.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.741+0000 7f4ae7fff640 1 -- 172.21.15.5:0/2362972862 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aec011470 con 0x563155c31280 2024-08-31T05:29:22.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.741+0000 7f4ae7fff640 1 -- 172.21.15.5:0/2362972862 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4aec012b90 con 0x563155c31280 2024-08-31T05:29:22.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.741+0000 7f4ae7fff640 1 -- 172.21.15.5:0/2362972862 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aec01f3f0 con 0x563155c31280 2024-08-31T05:29:22.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.742+0000 7f4b09fdd740 1 -- 172.21.15.5:0/2362972862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563155c31280 msgr2=0x563155ff8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:22.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.742+0000 7f4b09fdd740 1 --2- 172.21.15.5:0/2362972862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563155c31280 0x563155ff8230 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4aec013550 tx=0x7f4aec009790 comp rx=0 tx=0).stop 2024-08-31T05:29:22.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.742+0000 7f4b01003640 1 --2- 172.21.15.5:0/2922638645 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4ae80b4c90 0x7f4ae80b71a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4aec0133d0 tx=0x7f4aec01f740 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:22.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.742+0000 7f4b09fdd740 1 -- 172.21.15.5:0/2362972862 shutdown_connections 2024-08-31T05:29:22.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.742+0000 7f4b09fdd740 1 --2- 172.21.15.5:0/2362972862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563155c31280 0x563155ff8230 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:22.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.742+0000 7f4b09fdd740 1 --2- 172.21.15.5:0/2362972862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563155c290a0 0x563155ff7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:22.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.742+0000 7f4b09fdd740 1 --2- 172.21.15.5:0/2362972862 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563155c51f60 0x563155ff77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:22.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.742+0000 7f4b09fdd740 1 -- 172.21.15.5:0/2362972862 >> 172.21.15.5:0/2362972862 conn(0x563155c46350 msgr2=0x563155ff56a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:22.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.743+0000 7f4b09fdd740 1 -- 172.21.15.5:0/2362972862 shutdown_connections 2024-08-31T05:29:22.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.743+0000 7f4b09fdd740 1 -- 172.21.15.5:0/2362972862 wait complete. 2024-08-31T05:29:22.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.743+0000 7f4b09fdd740 1 -- start start 2024-08-31T05:29:22.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.743+0000 7f4b09fdd740 1 Processor -- start 2024-08-31T05:29:22.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.744+0000 7f4b09fdd740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563155c290a0 0x563156002d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:22.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.744+0000 7f4b09fdd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563155c31280 0x563156003280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:22.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.744+0000 7f4b09fdd740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563155c51f60 0x5631560037c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:22.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.744+0000 7f4b09fdd740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x563155dc05f0 con 0x563155c51f60 2024-08-31T05:29:22.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.744+0000 7f4b09fdd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x563155ee4600 con 0x563155c31280 2024-08-31T05:29:22.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.744+0000 7f4b09fdd740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563156005f90 con 0x563155c290a0 2024-08-31T05:29:22.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.744+0000 7f4b09fdd740 10 client.0 _ll_register_callbacks cb 0x563155f0aaf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:29:22.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.744+0000 7f4b02005640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563155c51f60 0x5631560037c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:22.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.744+0000 7f4b02005640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563155c51f60 0x5631560037c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36202/0 (socket says 172.21.15.5:36202) 2024-08-31T05:29:22.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.744+0000 7f4b02005640 1 -- 172.21.15.5:0/420902191 learned_addr learned my addr 172.21.15.5:0/420902191 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:22.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.744+0000 7f4b01003640 1 --2- 172.21.15.5:0/420902191 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563155c31280 0x563156003280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:22.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.744+0000 7f4b01804640 1 --2- 172.21.15.5:0/420902191 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563155c290a0 0x563156002d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:22.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.744+0000 7f4b02005640 1 -- 172.21.15.5:0/420902191 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563155c290a0 msgr2=0x563156002d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:22.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.744+0000 7f4b02005640 1 --2- 172.21.15.5:0/420902191 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563155c290a0 0x563156002d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:22.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.744+0000 7f4b02005640 1 -- 172.21.15.5:0/420902191 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563155c31280 msgr2=0x563156003280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:22.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.744+0000 7f4b02005640 1 --2- 172.21.15.5:0/420902191 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563155c31280 0x563156003280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:22.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.744+0000 7f4b02005640 1 -- 172.21.15.5:0/420902191 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563155f1d7b0 con 0x563155c51f60 2024-08-31T05:29:22.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.744+0000 7f4b02005640 1 --2- 172.21.15.5:0/420902191 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563155c51f60 0x5631560037c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4af40abfe0 tx=0x7f4af40e35b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b127fe05ac8f00ff server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:22.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.744+0000 7f4ae57fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:29:22.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.744+0000 7f4ae57fa640 1 -- 172.21.15.5:0/420902191 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af40ac050 con 0x563155c51f60 2024-08-31T05:29:22.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.744+0000 7f4ae57fa640 1 -- 172.21.15.5:0/420902191 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f4af40b4ee0 con 0x563155c51f60 2024-08-31T05:29:22.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.744+0000 7f4b09fdd740 1 -- 172.21.15.5:0/420902191 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4aec012b90 con 0x563155c51f60 2024-08-31T05:29:22.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.745+0000 7f4ae57fa640 1 -- 172.21.15.5:0/420902191 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4af40b08c0 con 0x563155c51f60 2024-08-31T05:29:22.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.745+0000 7f4b09fdd740 10 client.15300 fetch_fsmap learned FSMap version 29 2024-08-31T05:29:22.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.745+0000 7f4b09fdd740 1 -- 172.21.15.5:0/420902191 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563156011bd0 con 0x563155c51f60 2024-08-31T05:29:22.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.745+0000 7f4ae57fa640 1 -- 172.21.15.5:0/420902191 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4af40d1030 con 0x563155c51f60 2024-08-31T05:29:22.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.745+0000 7f4ae57fa640 1 -- 172.21.15.5:0/420902191 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f4af40b0410 con 0x563155c51f60 2024-08-31T05:29:22.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.745+0000 7f4b09fdd740 10 client.15300 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T05:29:22.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.745+0000 7f4b09fdd740 10 client.15300 resolve_mds: resolved name 'f' to daemon mds.f 2024-08-31T05:29:22.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.745+0000 7f4b09fdd740 20 client.15300 populate_metadata read hostname 'smithi005' 2024-08-31T05:29:22.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.745+0000 7f4b09fdd740 1 --2- 172.21.15.5:0/420902191 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x563155c108e0 0x5631560155b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:22.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.745+0000 7f4b09fdd740 4 client.15300 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:29:22.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.745+0000 7f4b09fdd740 1 -- 172.21.15.5:0/420902191 --> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f4aec012b90 con 0x563155c108e0 2024-08-31T05:29:22.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.745+0000 7f4b01804640 1 --2- 172.21.15.5:0/420902191 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x563155c108e0 0x5631560155b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:22.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.746+0000 7f4b01804640 1 --2- 172.21.15.5:0/420902191 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x563155c108e0 0x5631560155b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1dff3699c4b6f6f0 server_cookie=e6fa30c0cb485834 in_seq=0 out_seq=0 2024-08-31T05:29:22.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.746+0000 7f4ae57fa640 10 client.15300 ms_handle_connect on v2:172.21.15.70:6834/2061504114 2024-08-31T05:29:22.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.747+0000 7f4ae57fa640 1 -- 172.21.15.5:0/420902191 <== mds.3 v2:172.21.15.70:6834/2061504114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f4aec012b90 con 0x563155c108e0 2024-08-31T05:29:22.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.747+0000 7f4ae57fa640 10 client.15300 handle_command_reply: tid=0 2024-08-31T05:29:22.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.747+0000 7f4b09fdd740 1 client.15300 shutdown 2024-08-31T05:29:22.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.747+0000 7f4b09fdd740 1 -- 172.21.15.5:0/420902191 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563155c51f60 msgr2=0x5631560037c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:22.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.747+0000 7f4b09fdd740 1 --2- 172.21.15.5:0/420902191 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563155c51f60 0x5631560037c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4af40abfe0 tx=0x7f4af40e35b0 comp rx=0 tx=0).stop 2024-08-31T05:29:22.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.747+0000 7f4b09fdd740 1 -- 172.21.15.5:0/420902191 shutdown_connections 2024-08-31T05:29:22.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.747+0000 7f4b09fdd740 1 --2- 172.21.15.5:0/420902191 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x563155c108e0 0x5631560155b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:22.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.747+0000 7f4b09fdd740 1 --2- 172.21.15.5:0/420902191 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563155c51f60 0x5631560037c0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:22.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.747+0000 7f4b09fdd740 1 --2- 172.21.15.5:0/420902191 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563155c31280 0x563156003280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:22.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.747+0000 7f4b09fdd740 1 --2- 172.21.15.5:0/420902191 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563155c290a0 0x563156002d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:22.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.747+0000 7f4b09fdd740 1 -- 172.21.15.5:0/420902191 >> 172.21.15.5:0/420902191 conn(0x563155c46350 msgr2=0x563155ffa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:22.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.747+0000 7f4ae57fa640 0 client.15300 ms_handle_reset on v2:172.21.15.70:6834/2061504114 2024-08-31T05:29:22.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.747+0000 7f4b09fdd740 1 -- 172.21.15.5:0/420902191 shutdown_connections 2024-08-31T05:29:22.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.747+0000 7f4b09fdd740 1 -- 172.21.15.5:0/420902191 wait complete. 2024-08-31T05:29:22.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.747+0000 7f4b09fdd740 20 client.15300 trim_cache size 0 max 16384 2024-08-31T05:29:22.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.765+0000 7f4b09fdd740 1 Processor -- start 2024-08-31T05:29:22.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.765+0000 7f4b09fdd740 1 -- start start 2024-08-31T05:29:22.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.766+0000 7f4b09fdd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563155c290a0 0x563155ffdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:22.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.766+0000 7f4b09fdd740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563155c31280 0x563155ff4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:22.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.766+0000 7f4b09fdd740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563155c51f60 0x563155ff5230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:22.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.766+0000 7f4b09fdd740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5631560138f0 con 0x563155c31280 2024-08-31T05:29:22.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.766+0000 7f4b09fdd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x563156013fc0 con 0x563155c290a0 2024-08-31T05:29:22.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.766+0000 7f4b09fdd740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563156014690 con 0x563155c51f60 2024-08-31T05:29:22.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.766+0000 7f4b01003640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563155c31280 0x563155ff4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:22.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.766+0000 7f4b01003640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563155c31280 0x563155ff4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36206/0 (socket says 172.21.15.5:36206) 2024-08-31T05:29:22.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.766+0000 7f4b01003640 1 -- 172.21.15.5:0/1727024079 learned_addr learned my addr 172.21.15.5:0/1727024079 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:22.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.766+0000 7f4b01804640 1 --2- 172.21.15.5:0/1727024079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563155c290a0 0x563155ffdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:22.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.766+0000 7f4b01003640 1 -- 172.21.15.5:0/1727024079 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563155c51f60 msgr2=0x563155ff5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:22.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.766+0000 7f4b02005640 1 --2- 172.21.15.5:0/1727024079 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563155c51f60 0x563155ff5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:22.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.766+0000 7f4b01003640 1 --2- 172.21.15.5:0/1727024079 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563155c51f60 0x563155ff5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:22.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.766+0000 7f4b01003640 1 -- 172.21.15.5:0/1727024079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563155c290a0 msgr2=0x563155ffdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:22.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.766+0000 7f4b01003640 1 --2- 172.21.15.5:0/1727024079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563155c290a0 0x563155ffdef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:22.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.766+0000 7f4b01003640 1 -- 172.21.15.5:0/1727024079 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563156005a20 con 0x563155c31280 2024-08-31T05:29:22.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.766+0000 7f4b01804640 1 --2- 172.21.15.5:0/1727024079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563155c290a0 0x563155ffdef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:29:22.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.766+0000 7f4b02005640 1 --2- 172.21.15.5:0/1727024079 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563155c51f60 0x563155ff5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:29:22.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.766+0000 7f4b01003640 1 --2- 172.21.15.5:0/1727024079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563155c31280 0x563155ff4cf0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4aec00fa60 tx=0x7f4aec028000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23ca3dd8d61c5217 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:22.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.767+0000 7f4ae77fe640 1 -- 172.21.15.5:0/1727024079 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aec011470 con 0x563155c31280 2024-08-31T05:29:22.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.767+0000 7f4ae77fe640 1 -- 172.21.15.5:0/1727024079 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4aec01fe10 con 0x563155c31280 2024-08-31T05:29:22.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.767+0000 7f4ae77fe640 1 -- 172.21.15.5:0/1727024079 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aec005050 con 0x563155c31280 2024-08-31T05:29:22.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.767+0000 7f4b09fdd740 1 -- 172.21.15.5:0/1727024079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563155c31280 msgr2=0x563155ff4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:22.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.767+0000 7f4b09fdd740 1 --2- 172.21.15.5:0/1727024079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563155c31280 0x563155ff4cf0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4aec00fa60 tx=0x7f4aec028000 comp rx=0 tx=0).stop 2024-08-31T05:29:22.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.767+0000 7f4b09fdd740 1 -- 172.21.15.5:0/1727024079 shutdown_connections 2024-08-31T05:29:22.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.767+0000 7f4b09fdd740 1 --2- 172.21.15.5:0/1727024079 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563155c51f60 0x563155ff5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:22.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.767+0000 7f4b09fdd740 1 --2- 172.21.15.5:0/1727024079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563155c31280 0x563155ff4cf0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:22.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.767+0000 7f4b09fdd740 1 --2- 172.21.15.5:0/1727024079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563155c290a0 0x563155ffdef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:22.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.767+0000 7f4b09fdd740 1 -- 172.21.15.5:0/1727024079 >> 172.21.15.5:0/1727024079 conn(0x563155c46350 msgr2=0x563156013040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:22.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.768+0000 7f4b09fdd740 1 -- 172.21.15.5:0/1727024079 shutdown_connections 2024-08-31T05:29:22.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.768+0000 7f4b09fdd740 1 -- 172.21.15.5:0/1727024079 wait complete. 2024-08-31T05:29:22.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.768+0000 7f4b09fdd740 1 -- start start 2024-08-31T05:29:22.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.768+0000 7f4b09fdd740 1 Processor -- start 2024-08-31T05:29:22.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.768+0000 7f4b09fdd740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563155c290a0 0x5631560177a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:22.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.768+0000 7f4b09fdd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563155c31280 0x563156017ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:22.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.768+0000 7f4b09fdd740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563155c51f60 0x563156018220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:22.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.768+0000 7f4b09fdd740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x563156015430 con 0x563155c51f60 2024-08-31T05:29:22.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.768+0000 7f4b09fdd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x563156014d60 con 0x563155c31280 2024-08-31T05:29:22.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.768+0000 7f4b09fdd740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563156015b00 con 0x563155c290a0 2024-08-31T05:29:22.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.768+0000 7f4b09fdd740 10 client.0 _ll_register_callbacks cb 0x7f4af40ab8b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:29:22.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.769+0000 7f4b02005640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563155c51f60 0x563156018220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:22.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.769+0000 7f4b02005640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563155c51f60 0x563156018220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36222/0 (socket says 172.21.15.5:36222) 2024-08-31T05:29:22.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.769+0000 7f4b02005640 1 -- 172.21.15.5:0/2448485422 learned_addr learned my addr 172.21.15.5:0/2448485422 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:22.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.769+0000 7f4b01003640 1 --2- 172.21.15.5:0/2448485422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563155c31280 0x563156017ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:22.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.769+0000 7f4b01804640 1 --2- 172.21.15.5:0/2448485422 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563155c290a0 0x5631560177a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:22.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.769+0000 7f4b02005640 1 -- 172.21.15.5:0/2448485422 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563155c290a0 msgr2=0x5631560177a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:22.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.769+0000 7f4b02005640 1 --2- 172.21.15.5:0/2448485422 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563155c290a0 0x5631560177a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:22.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.769+0000 7f4b02005640 1 -- 172.21.15.5:0/2448485422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563155c31280 msgr2=0x563156017ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:22.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.769+0000 7f4b02005640 1 --2- 172.21.15.5:0/2448485422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563155c31280 0x563156017ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:22.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.769+0000 7f4b02005640 1 -- 172.21.15.5:0/2448485422 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56315601cf30 con 0x563155c51f60 2024-08-31T05:29:22.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.769+0000 7f4b01804640 1 --2- 172.21.15.5:0/2448485422 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563155c290a0 0x5631560177a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:29:22.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.769+0000 7f4b01003640 1 --2- 172.21.15.5:0/2448485422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563155c31280 0x563156017ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:29:22.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.769+0000 7f4b02005640 1 --2- 172.21.15.5:0/2448485422 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563155c51f60 0x563156018220 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f4af40a80d0 tx=0x7f4af40e30e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a95caa8560231b9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:22.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.769+0000 7f4ae57fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:29:22.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.769+0000 7f4ae57fa640 1 -- 172.21.15.5:0/2448485422 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af40a7ca0 con 0x563155c51f60 2024-08-31T05:29:22.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.769+0000 7f4ae57fa640 1 -- 172.21.15.5:0/2448485422 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f4af40a8640 con 0x563155c51f60 2024-08-31T05:29:22.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.769+0000 7f4b09fdd740 1 -- 172.21.15.5:0/2448485422 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4aec01fe10 con 0x563155c51f60 2024-08-31T05:29:22.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.769+0000 7f4ae57fa640 1 -- 172.21.15.5:0/2448485422 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4af408d050 con 0x563155c51f60 2024-08-31T05:29:22.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.769+0000 7f4b09fdd740 10 client.15306 fetch_fsmap learned FSMap version 29 2024-08-31T05:29:22.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.769+0000 7f4b09fdd740 1 -- 172.21.15.5:0/2448485422 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563156080bd0 con 0x563155c51f60 2024-08-31T05:29:22.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.770+0000 7f4ae57fa640 1 -- 172.21.15.5:0/2448485422 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4aec01fe10 con 0x563155c51f60 2024-08-31T05:29:22.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.770+0000 7f4ae57fa640 1 -- 172.21.15.5:0/2448485422 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f4af40cd300 con 0x563155c51f60 2024-08-31T05:29:22.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.770+0000 7f4b09fdd740 10 client.15306 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T05:29:22.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.770+0000 7f4b09fdd740 10 client.15306 resolve_mds: resolved name 'f' to daemon mds.f 2024-08-31T05:29:22.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.770+0000 7f4b09fdd740 20 client.15306 populate_metadata read hostname 'smithi005' 2024-08-31T05:29:22.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.770+0000 7f4b09fdd740 1 --2- 172.21.15.5:0/2448485422 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x563155be5c90 0x563156084340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:22.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.770+0000 7f4b09fdd740 4 client.15306 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T05:29:22.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.770+0000 7f4b09fdd740 1 -- 172.21.15.5:0/2448485422 --> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] -- command(tid 0: {"prefix": "status"}) -- 0x563155f70340 con 0x563155be5c90 2024-08-31T05:29:22.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.770+0000 7f4b01804640 1 --2- 172.21.15.5:0/2448485422 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x563155be5c90 0x563156084340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:22.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.771+0000 7f4b01804640 1 --2- 172.21.15.5:0/2448485422 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x563155be5c90 0x563156084340 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b5210b46c4555e82 server_cookie=aee9760006e0dc9b in_seq=0 out_seq=0 2024-08-31T05:29:22.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.771+0000 7f4ae57fa640 10 client.15306 ms_handle_connect on v2:172.21.15.70:6834/2061504114 2024-08-31T05:29:22.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.771+0000 7f4ae57fa640 1 -- 172.21.15.5:0/2448485422 <== mds.3 v2:172.21.15.70:6834/2061504114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x563155f70340 con 0x563155be5c90 2024-08-31T05:29:22.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.771+0000 7f4ae57fa640 10 client.15306 handle_command_reply: tid=0 2024-08-31T05:29:22.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.771+0000 7f4b09fdd740 1 client.15306 shutdown 2024-08-31T05:29:22.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.771+0000 7f4b09fdd740 1 -- 172.21.15.5:0/2448485422 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563155c51f60 msgr2=0x563156018220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:22.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.771+0000 7f4b09fdd740 1 --2- 172.21.15.5:0/2448485422 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563155c51f60 0x563156018220 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f4af40a80d0 tx=0x7f4af40e30e0 comp rx=0 tx=0).stop 2024-08-31T05:29:22.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.771+0000 7f4b09fdd740 1 -- 172.21.15.5:0/2448485422 shutdown_connections 2024-08-31T05:29:22.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.771+0000 7f4b09fdd740 1 --2- 172.21.15.5:0/2448485422 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x563155be5c90 0x563156084340 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:22.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.771+0000 7f4b09fdd740 1 --2- 172.21.15.5:0/2448485422 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563155c51f60 0x563156018220 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:22.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.771+0000 7f4b09fdd740 1 --2- 172.21.15.5:0/2448485422 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563155c31280 0x563156017ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:22.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.771+0000 7f4b09fdd740 1 --2- 172.21.15.5:0/2448485422 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563155c290a0 0x5631560177a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:22.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.771+0000 7f4ae57fa640 0 client.15306 ms_handle_reset on v2:172.21.15.70:6834/2061504114 2024-08-31T05:29:22.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.771+0000 7f4b09fdd740 1 -- 172.21.15.5:0/2448485422 >> 172.21.15.5:0/2448485422 conn(0x563155c46350 msgr2=0x563155ffdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:22.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.771+0000 7f4b09fdd740 1 -- 172.21.15.5:0/2448485422 shutdown_connections 2024-08-31T05:29:22.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.771+0000 7f4b09fdd740 1 -- 172.21.15.5:0/2448485422 wait complete. 2024-08-31T05:29:22.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.771+0000 7f4b09fdd740 20 client.15306 trim_cache size 0 max 16384 2024-08-31T05:29:22.780 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:29:22.781 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "69422704-6758-11ef-bcd4-c7b262605968", 2024-08-31T05:29:22.781 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 3, 2024-08-31T05:29:22.781 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 24625, 2024-08-31T05:29:22.781 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-08-31T05:29:22.781 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-08-31T05:29:22.781 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-08-31T05:29:22.781 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 72.210475915999993, 2024-08-31T05:29:22.781 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 29, 2024-08-31T05:29:22.781 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 87, 2024-08-31T05:29:22.781 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 85, 2024-08-31T05:29:22.781 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 138.306318965 2024-08-31T05:29:22.781 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:29:22.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.772+0000 7f4b03a68640 1 -- 172.21.15.5:0/2922638645 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4ae80b4c90 msgr2=0x7f4ae80b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:22.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.772+0000 7f4b03a68640 1 --2- 172.21.15.5:0/2922638645 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4ae80b4c90 0x7f4ae80b71a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4aec0133d0 tx=0x7f4aec01f740 comp rx=0 tx=0).stop 2024-08-31T05:29:22.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.772+0000 7f4b03a68640 1 -- 172.21.15.5:0/2922638645 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4afc108ad0 msgr2=0x7f4afc110810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:22.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.772+0000 7f4b03a68640 1 --2- 172.21.15.5:0/2922638645 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4afc108ad0 0x7f4afc110810 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4af400e970 tx=0x7f4af400ed70 comp rx=0 tx=0).stop 2024-08-31T05:29:22.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.772+0000 7f4b03a68640 1 -- 172.21.15.5:0/2922638645 shutdown_connections 2024-08-31T05:29:22.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.772+0000 7f4b03a68640 1 --2- 172.21.15.5:0/2922638645 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4ae80b4c90 0x7f4ae80b71a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:22.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.772+0000 7f4b03a68640 1 --2- 172.21.15.5:0/2922638645 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4afc108ad0 0x7f4afc110810 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:22.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.772+0000 7f4b03a68640 1 --2- 172.21.15.5:0/2922638645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4afc108180 0x7f4afc1102d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:22.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.772+0000 7f4b03a68640 1 --2- 172.21.15.5:0/2922638645 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4afc102840 0x7f4afc10fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:22.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.772+0000 7f4b03a68640 1 -- 172.21.15.5:0/2922638645 >> 172.21.15.5:0/2922638645 conn(0x7f4afc079580 msgr2=0x7f4afc1011c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:22.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.772+0000 7f4b03a68640 1 -- 172.21.15.5:0/2922638645 shutdown_connections 2024-08-31T05:29:22.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:22.772+0000 7f4b03a68640 1 -- 172.21.15.5:0/2922638645 wait complete. 2024-08-31T05:29:23.445 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.c status 2024-08-31T05:29:23.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:23 smithi070 ceph-mon[22316]: pgmap v327: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-31T05:29:23.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:23 smithi050 ceph-mon[22146]: pgmap v327: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-31T05:29:23.714 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:29:23.716 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:23 smithi005 ceph-mon[18602]: pgmap v327: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-31T05:29:24.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.195+0000 7f86f3f7c640 1 -- 172.21.15.5:0/2473277131 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86ec102d40 msgr2=0x7f86ec10fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:24.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.195+0000 7f86f3f7c640 1 --2- 172.21.15.5:0/2473277131 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86ec102d40 0x7f86ec10fa60 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f86e8009900 tx=0x7f86e802a480 comp rx=0 tx=0).stop 2024-08-31T05:29:24.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.195+0000 7f86f3f7c640 1 -- 172.21.15.5:0/2473277131 shutdown_connections 2024-08-31T05:29:24.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.195+0000 7f86f3f7c640 1 --2- 172.21.15.5:0/2473277131 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86ec10ffa0 0x7f86ec1123c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:24.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.196+0000 7f86f3f7c640 1 --2- 172.21.15.5:0/2473277131 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86ec102d40 0x7f86ec10fa60 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:24.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.196+0000 7f86f3f7c640 1 --2- 172.21.15.5:0/2473277131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86ec1023f0 0x7f86ec102800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:24.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.196+0000 7f86f3f7c640 1 -- 172.21.15.5:0/2473277131 >> 172.21.15.5:0/2473277131 conn(0x7f86ec0794d0 msgr2=0x7f86ec0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:24.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.196+0000 7f86f3f7c640 1 -- 172.21.15.5:0/2473277131 shutdown_connections 2024-08-31T05:29:24.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.196+0000 7f86f3f7c640 1 -- 172.21.15.5:0/2473277131 wait complete. 2024-08-31T05:29:24.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.196+0000 7f86f3f7c640 1 Processor -- start 2024-08-31T05:29:24.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.196+0000 7f86f3f7c640 1 -- start start 2024-08-31T05:29:24.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.197+0000 7f86f3f7c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86ec1023f0 0x7f86ec19c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:24.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.197+0000 7f86f3f7c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86ec102d40 0x7f86ec19c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:24.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.197+0000 7f86f3f7c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86ec10ffa0 0x7f86ec1a1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:24.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.197+0000 7f86f3f7c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f86ec115a10 con 0x7f86ec10ffa0 2024-08-31T05:29:24.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.197+0000 7f86f3f7c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f86ec115890 con 0x7f86ec1023f0 2024-08-31T05:29:24.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.197+0000 7f86f3f7c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f86ec115b90 con 0x7f86ec102d40 2024-08-31T05:29:24.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.197+0000 7f86f2519640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86ec10ffa0 0x7f86ec1a1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:24.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.197+0000 7f86f2519640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86ec10ffa0 0x7f86ec1a1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36226/0 (socket says 172.21.15.5:36226) 2024-08-31T05:29:24.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.197+0000 7f86f2519640 1 -- 172.21.15.5:0/2485981088 learned_addr learned my addr 172.21.15.5:0/2485981088 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:24.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.197+0000 7f86f1517640 1 --2- 172.21.15.5:0/2485981088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86ec102d40 0x7f86ec19c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:24.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.197+0000 7f86f1d18640 1 --2- 172.21.15.5:0/2485981088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86ec1023f0 0x7f86ec19c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:24.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.197+0000 7f86f2519640 1 -- 172.21.15.5:0/2485981088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86ec102d40 msgr2=0x7f86ec19c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:24.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.197+0000 7f86f2519640 1 --2- 172.21.15.5:0/2485981088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86ec102d40 0x7f86ec19c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:24.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.197+0000 7f86f2519640 1 -- 172.21.15.5:0/2485981088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86ec1023f0 msgr2=0x7f86ec19c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:24.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.197+0000 7f86f2519640 1 --2- 172.21.15.5:0/2485981088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86ec1023f0 0x7f86ec19c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:24.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.197+0000 7f86f2519640 1 -- 172.21.15.5:0/2485981088 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86ec1a2310 con 0x7f86ec10ffa0 2024-08-31T05:29:24.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.197+0000 7f86f2519640 1 --2- 172.21.15.5:0/2485981088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86ec10ffa0 0x7f86ec1a1be0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f86e400eb10 tx=0x7f86e400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:24.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.198+0000 7f86deffd640 1 -- 172.21.15.5:0/2485981088 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e4004b20 con 0x7f86ec10ffa0 2024-08-31T05:29:24.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.198+0000 7f86f3f7c640 1 -- 172.21.15.5:0/2485981088 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86ec1a2600 con 0x7f86ec10ffa0 2024-08-31T05:29:24.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.198+0000 7f86deffd640 1 -- 172.21.15.5:0/2485981088 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86e4004cc0 con 0x7f86ec10ffa0 2024-08-31T05:29:24.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.198+0000 7f86deffd640 1 -- 172.21.15.5:0/2485981088 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e4010670 con 0x7f86ec10ffa0 2024-08-31T05:29:24.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.198+0000 7f86f3f7c640 1 -- 172.21.15.5:0/2485981088 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86ec1a8d60 con 0x7f86ec10ffa0 2024-08-31T05:29:24.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.200+0000 7f86fa4f1740 1 Processor -- start 2024-08-31T05:29:24.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.201+0000 7f86deffd640 1 -- 172.21.15.5:0/2485981088 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f86e4005020 con 0x7f86ec10ffa0 2024-08-31T05:29:24.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.201+0000 7f86fa4f1740 1 -- start start 2024-08-31T05:29:24.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.201+0000 7f86fa4f1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583c4dc8f60 0x5583c516e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:24.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.201+0000 7f86fa4f1740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5583c4da00a0 0x5583c516ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:24.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.201+0000 7f86fa4f1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583c4da8280 0x5583c516f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:24.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.201+0000 7f86fa4f1740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5583c50e53f0 con 0x5583c4da00a0 2024-08-31T05:29:24.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.201+0000 7f86fa4f1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5583c50d4980 con 0x5583c4da8280 2024-08-31T05:29:24.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.201+0000 7f86fa4f1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5583c50d8930 con 0x5583c4dc8f60 2024-08-31T05:29:24.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.201+0000 7f86f1d18640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5583c4da00a0 0x5583c516ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:24.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.201+0000 7f86f1d18640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5583c4da00a0 0x5583c516ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36238/0 (socket says 172.21.15.5:36238) 2024-08-31T05:29:24.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.202+0000 7f86f1d18640 1 -- 172.21.15.5:0/651312278 learned_addr learned my addr 172.21.15.5:0/651312278 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:24.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.202+0000 7f86f1517640 1 --2- 172.21.15.5:0/651312278 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583c4da8280 0x5583c516f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:24.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.202+0000 7f86f1517640 1 --2- 172.21.15.5:0/651312278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583c4dc8f60 0x5583c516e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:24.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.202+0000 7f86deffd640 1 --2- 172.21.15.5:0/2485981088 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f86d80b4c10 0x7f86d80b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:24.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.202+0000 7f86f1d18640 1 -- 172.21.15.5:0/651312278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583c4dc8f60 msgr2=0x5583c516e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:24.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.202+0000 7f86f1d18640 1 --2- 172.21.15.5:0/651312278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583c4dc8f60 0x5583c516e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:24.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.202+0000 7f86f1d18640 1 -- 172.21.15.5:0/651312278 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583c4da8280 msgr2=0x5583c516f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:24.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.202+0000 7f86f1d18640 1 --2- 172.21.15.5:0/651312278 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583c4da8280 0x5583c516f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:24.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.202+0000 7f86f1d18640 1 -- 172.21.15.5:0/651312278 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583c4e34540 con 0x5583c4da00a0 2024-08-31T05:29:24.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.202+0000 7f86f1517640 1 --2- 172.21.15.5:0/651312278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583c4dc8f60 0x5583c516e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:29:24.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.202+0000 7f86deffd640 1 -- 172.21.15.5:0/2485981088 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f86e40e5e60 con 0x7f86ec10ffa0 2024-08-31T05:29:24.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.202+0000 7f86f2519640 1 --2- 172.21.15.5:0/2485981088 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f86d80b4c10 0x7f86d80b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:24.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.202+0000 7f86f1d18640 1 --2- 172.21.15.5:0/651312278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5583c4da00a0 0x5583c516ecf0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f86e0009c80 tx=0x7f86e00117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca9f9e36c01cff95 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:24.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.202+0000 7f86d7fff640 1 -- 172.21.15.5:0/651312278 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e0012450 con 0x5583c4da00a0 2024-08-31T05:29:24.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.203+0000 7f86d7fff640 1 -- 172.21.15.5:0/651312278 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86e0012aa0 con 0x5583c4da00a0 2024-08-31T05:29:24.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.203+0000 7f86d7fff640 1 -- 172.21.15.5:0/651312278 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e000fae0 con 0x5583c4da00a0 2024-08-31T05:29:24.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.204+0000 7f86fa4f1740 1 -- 172.21.15.5:0/651312278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5583c4da00a0 msgr2=0x5583c516ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:24.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.204+0000 7f86f2519640 1 --2- 172.21.15.5:0/2485981088 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f86d80b4c10 0x7f86d80b7120 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f86e40e38f0 tx=0x7f86e40b5040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:24.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.204+0000 7f86fa4f1740 1 --2- 172.21.15.5:0/651312278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5583c4da00a0 0x5583c516ecf0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f86e0009c80 tx=0x7f86e00117b0 comp rx=0 tx=0).stop 2024-08-31T05:29:24.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.204+0000 7f86fa4f1740 1 -- 172.21.15.5:0/651312278 shutdown_connections 2024-08-31T05:29:24.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.204+0000 7f86fa4f1740 1 --2- 172.21.15.5:0/651312278 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583c4da8280 0x5583c516f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:24.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.204+0000 7f86fa4f1740 1 --2- 172.21.15.5:0/651312278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5583c4da00a0 0x5583c516ecf0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:24.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.204+0000 7f86fa4f1740 1 --2- 172.21.15.5:0/651312278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583c4dc8f60 0x5583c516e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:24.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.204+0000 7f86fa4f1740 1 -- 172.21.15.5:0/651312278 >> 172.21.15.5:0/651312278 conn(0x5583c4dbd350 msgr2=0x5583c516c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:24.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.204+0000 7f86fa4f1740 1 -- 172.21.15.5:0/651312278 shutdown_connections 2024-08-31T05:29:24.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.204+0000 7f86fa4f1740 1 -- 172.21.15.5:0/651312278 wait complete. 2024-08-31T05:29:24.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.204+0000 7f86fa4f1740 1 -- start start 2024-08-31T05:29:24.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.204+0000 7f86fa4f1740 1 Processor -- start 2024-08-31T05:29:24.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.205+0000 7f86fa4f1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583c4da00a0 0x5583c5179de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:24.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.205+0000 7f86fa4f1740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5583c4da8280 0x5583c517a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:24.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.205+0000 7f86fa4f1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583c4dc8f60 0x5583c517a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:24.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.205+0000 7f86fa4f1740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5583c4f375f0 con 0x5583c4da8280 2024-08-31T05:29:24.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.205+0000 7f86fa4f1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5583c505b600 con 0x5583c4da00a0 2024-08-31T05:29:24.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.205+0000 7f86fa4f1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5583c517cf90 con 0x5583c4dc8f60 2024-08-31T05:29:24.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.205+0000 7f86fa4f1740 10 client.0 _ll_register_callbacks cb 0x5583c5081af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:29:24.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.205+0000 7f86f1d18640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5583c4da8280 0x5583c517a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:24.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.205+0000 7f86f1d18640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5583c4da8280 0x5583c517a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36252/0 (socket says 172.21.15.5:36252) 2024-08-31T05:29:24.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.205+0000 7f86f1d18640 1 -- 172.21.15.5:0/1910711647 learned_addr learned my addr 172.21.15.5:0/1910711647 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:24.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.205+0000 7f86f1517640 1 --2- 172.21.15.5:0/1910711647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583c4da00a0 0x5583c5179de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:24.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.205+0000 7f86f1517640 1 --2- 172.21.15.5:0/1910711647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583c4dc8f60 0x5583c517a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:24.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.205+0000 7f86f1d18640 1 -- 172.21.15.5:0/1910711647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583c4dc8f60 msgr2=0x5583c517a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:24.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.205+0000 7f86f1d18640 1 --2- 172.21.15.5:0/1910711647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583c4dc8f60 0x5583c517a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:24.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.205+0000 7f86f1d18640 1 -- 172.21.15.5:0/1910711647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583c4da00a0 msgr2=0x5583c5179de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:24.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.205+0000 7f86f1d18640 1 --2- 172.21.15.5:0/1910711647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583c4da00a0 0x5583c5179de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:24.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.205+0000 7f86f1d18640 1 -- 172.21.15.5:0/1910711647 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583c50947b0 con 0x5583c4da8280 2024-08-31T05:29:24.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.206+0000 7f86f1d18640 1 --2- 172.21.15.5:0/1910711647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5583c4da8280 0x5583c517a320 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f86e0009590 tx=0x7f86e0009fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d350de817745e52 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:24.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.206+0000 7f86d57fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:29:24.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.206+0000 7f86d57fa640 1 -- 172.21.15.5:0/1910711647 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e0028020 con 0x5583c4da8280 2024-08-31T05:29:24.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.206+0000 7f86d57fa640 1 -- 172.21.15.5:0/1910711647 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f86e0004450 con 0x5583c4da8280 2024-08-31T05:29:24.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.206+0000 7f86fa4f1740 1 -- 172.21.15.5:0/1910711647 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86e0012aa0 con 0x5583c4da8280 2024-08-31T05:29:24.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.206+0000 7f86d57fa640 1 -- 172.21.15.5:0/1910711647 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f86e0033050 con 0x5583c4da8280 2024-08-31T05:29:24.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.206+0000 7f86fa4f1740 10 client.15318 fetch_fsmap learned FSMap version 29 2024-08-31T05:29:24.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.206+0000 7f86fa4f1740 1 -- 172.21.15.5:0/1910711647 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5583c5188bf0 con 0x5583c4da8280 2024-08-31T05:29:24.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.206+0000 7f86d57fa640 1 -- 172.21.15.5:0/1910711647 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86e0012aa0 con 0x5583c4da8280 2024-08-31T05:29:24.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.206+0000 7f86d57fa640 1 -- 172.21.15.5:0/1910711647 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f86e00035f0 con 0x5583c4da8280 2024-08-31T05:29:24.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.207+0000 7f86fa4f1740 10 client.15318 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T05:29:24.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.207+0000 7f86fa4f1740 10 client.15318 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-31T05:29:24.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.207+0000 7f86fa4f1740 20 client.15318 populate_metadata read hostname 'smithi005' 2024-08-31T05:29:24.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.207+0000 7f86fa4f1740 1 --2- 172.21.15.5:0/1910711647 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x5583c4d878e0 0x5583c518c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:24.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.207+0000 7f86fa4f1740 4 client.15318 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:29:24.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.207+0000 7f86fa4f1740 1 -- 172.21.15.5:0/1910711647 --> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5583c50e7340 con 0x5583c4d878e0 2024-08-31T05:29:24.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.207+0000 7f86f1517640 1 --2- 172.21.15.5:0/1910711647 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x5583c4d878e0 0x5583c518c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:24.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.207+0000 7f86d57fa640 10 client.15318 ms_handle_connect on v2:172.21.15.70:6836/2780036414 2024-08-31T05:29:24.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.207+0000 7f86f1517640 1 --2- 172.21.15.5:0/1910711647 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x5583c4d878e0 0x5583c518c2c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=317a1877c7d4c7e server_cookie=dc99ad98e844ebff in_seq=0 out_seq=0 2024-08-31T05:29:24.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.208+0000 7f86d57fa640 1 -- 172.21.15.5:0/1910711647 <== mds.2 v2:172.21.15.70:6836/2780036414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5583c50e7340 con 0x5583c4d878e0 2024-08-31T05:29:24.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.208+0000 7f86d57fa640 10 client.15318 handle_command_reply: tid=0 2024-08-31T05:29:24.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.208+0000 7f86fa4f1740 1 client.15318 shutdown 2024-08-31T05:29:24.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.208+0000 7f86fa4f1740 1 -- 172.21.15.5:0/1910711647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5583c4da8280 msgr2=0x5583c517a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:24.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.208+0000 7f86fa4f1740 1 --2- 172.21.15.5:0/1910711647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5583c4da8280 0x5583c517a320 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f86e0009590 tx=0x7f86e0009fa0 comp rx=0 tx=0).stop 2024-08-31T05:29:24.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.208+0000 7f86fa4f1740 1 -- 172.21.15.5:0/1910711647 shutdown_connections 2024-08-31T05:29:24.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.208+0000 7f86fa4f1740 1 --2- 172.21.15.5:0/1910711647 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x5583c4d878e0 0x5583c518c2c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:24.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.208+0000 7f86fa4f1740 1 --2- 172.21.15.5:0/1910711647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583c4dc8f60 0x5583c517a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:24.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.208+0000 7f86fa4f1740 1 --2- 172.21.15.5:0/1910711647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5583c4da8280 0x5583c517a320 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:24.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.208+0000 7f86d57fa640 0 client.15318 ms_handle_reset on v2:172.21.15.70:6836/2780036414 2024-08-31T05:29:24.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.208+0000 7f86fa4f1740 1 --2- 172.21.15.5:0/1910711647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583c4da00a0 0x5583c5179de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:24.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.208+0000 7f86fa4f1740 1 -- 172.21.15.5:0/1910711647 >> 172.21.15.5:0/1910711647 conn(0x5583c4dbd350 msgr2=0x5583c5171940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:24.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.209+0000 7f86fa4f1740 1 -- 172.21.15.5:0/1910711647 shutdown_connections 2024-08-31T05:29:24.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.209+0000 7f86fa4f1740 1 -- 172.21.15.5:0/1910711647 wait complete. 2024-08-31T05:29:24.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.209+0000 7f86fa4f1740 20 client.15318 trim_cache size 0 max 16384 2024-08-31T05:29:24.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.246+0000 7f86fa4f1740 1 Processor -- start 2024-08-31T05:29:24.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.246+0000 7f86fa4f1740 1 -- start start 2024-08-31T05:29:24.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.246+0000 7f86fa4f1740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5583c4da00a0 0x5583c518b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:24.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.246+0000 7f86fa4f1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583c4da8280 0x5583c516bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:24.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.246+0000 7f86fa4f1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583c4dc8f60 0x5583c516c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:24.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.246+0000 7f86fa4f1740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5583c518a600 con 0x5583c4da00a0 2024-08-31T05:29:24.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.246+0000 7f86fa4f1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5583c518acd0 con 0x5583c4dc8f60 2024-08-31T05:29:24.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.246+0000 7f86fa4f1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5583c518b3a0 con 0x5583c4da8280 2024-08-31T05:29:24.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.246+0000 7f86f1517640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5583c4da00a0 0x5583c518b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:24.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.246+0000 7f86f1517640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5583c4da00a0 0x5583c518b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36256/0 (socket says 172.21.15.5:36256) 2024-08-31T05:29:24.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.246+0000 7f86f1517640 1 -- 172.21.15.5:0/733535426 learned_addr learned my addr 172.21.15.5:0/733535426 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:24.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.246+0000 7f86f1d18640 1 --2- 172.21.15.5:0/733535426 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583c4da8280 0x5583c516bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:24.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.246+0000 7f86f1517640 1 --2- 172.21.15.5:0/733535426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583c4dc8f60 0x5583c516c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:24.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.247+0000 7f86f1517640 1 -- 172.21.15.5:0/733535426 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583c4da8280 msgr2=0x5583c516bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:24.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.247+0000 7f86f1517640 1 --2- 172.21.15.5:0/733535426 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583c4da8280 0x5583c516bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:24.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.247+0000 7f86f1517640 1 -- 172.21.15.5:0/733535426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583c4dc8f60 msgr2=0x5583c516c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:24.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.247+0000 7f86f1517640 1 --2- 172.21.15.5:0/733535426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583c4dc8f60 0x5583c516c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:24.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.247+0000 7f86f1517640 1 -- 172.21.15.5:0/733535426 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583c517b0a0 con 0x5583c4da00a0 2024-08-31T05:29:24.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.247+0000 7f86f1517640 1 --2- 172.21.15.5:0/733535426 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5583c4da00a0 0x5583c518b520 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f86e802a9a0 tx=0x7f86e8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33e157f8cf28917e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:24.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.247+0000 7f86d77fe640 1 -- 172.21.15.5:0/733535426 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e8035040 con 0x5583c4da00a0 2024-08-31T05:29:24.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.247+0000 7f86d77fe640 1 -- 172.21.15.5:0/733535426 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86e80328b0 con 0x5583c4da00a0 2024-08-31T05:29:24.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.247+0000 7f86d77fe640 1 -- 172.21.15.5:0/733535426 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e80049b0 con 0x5583c4da00a0 2024-08-31T05:29:24.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.248+0000 7f86fa4f1740 1 -- 172.21.15.5:0/733535426 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5583c4da00a0 msgr2=0x5583c518b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:24.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.248+0000 7f86fa4f1740 1 --2- 172.21.15.5:0/733535426 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5583c4da00a0 0x5583c518b520 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f86e802a9a0 tx=0x7f86e8009260 comp rx=0 tx=0).stop 2024-08-31T05:29:24.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.248+0000 7f86fa4f1740 1 -- 172.21.15.5:0/733535426 shutdown_connections 2024-08-31T05:29:24.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.248+0000 7f86fa4f1740 1 --2- 172.21.15.5:0/733535426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583c4dc8f60 0x5583c516c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:24.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.248+0000 7f86fa4f1740 1 --2- 172.21.15.5:0/733535426 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583c4da8280 0x5583c516bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:24.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.248+0000 7f86fa4f1740 1 --2- 172.21.15.5:0/733535426 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5583c4da00a0 0x5583c518b520 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:24.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.248+0000 7f86fa4f1740 1 -- 172.21.15.5:0/733535426 >> 172.21.15.5:0/733535426 conn(0x5583c4dbd350 msgr2=0x5583c5174f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:24.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.248+0000 7f86fa4f1740 1 -- 172.21.15.5:0/733535426 shutdown_connections 2024-08-31T05:29:24.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.248+0000 7f86fa4f1740 1 -- 172.21.15.5:0/733535426 wait complete. 2024-08-31T05:29:24.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.248+0000 7f86fa4f1740 1 -- start start 2024-08-31T05:29:24.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.248+0000 7f86fa4f1740 1 Processor -- start 2024-08-31T05:29:24.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.249+0000 7f86fa4f1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583c4da00a0 0x5583c5194f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:24.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.249+0000 7f86fa4f1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583c4da8280 0x5583c518e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:24.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.249+0000 7f86fa4f1740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5583c4dc8f60 0x5583c518ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:24.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.249+0000 7f86fa4f1740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5583c518c140 con 0x5583c4dc8f60 2024-08-31T05:29:24.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.249+0000 7f86fa4f1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5583c518ba70 con 0x5583c4da8280 2024-08-31T05:29:24.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.249+0000 7f86fa4f1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5583c518c810 con 0x5583c4da00a0 2024-08-31T05:29:24.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.249+0000 7f86fa4f1740 10 client.0 _ll_register_callbacks cb 0x7f86e00056d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:29:24.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.249+0000 7f86f1517640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5583c4dc8f60 0x5583c518ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:24.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.249+0000 7f86f1517640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5583c4dc8f60 0x5583c518ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36270/0 (socket says 172.21.15.5:36270) 2024-08-31T05:29:24.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.249+0000 7f86f1517640 1 -- 172.21.15.5:0/270957350 learned_addr learned my addr 172.21.15.5:0/270957350 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:24.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.249+0000 7f86f1517640 1 --2- 172.21.15.5:0/270957350 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583c4da00a0 0x5583c5194f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:24.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.249+0000 7f86f1d18640 1 --2- 172.21.15.5:0/270957350 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583c4da8280 0x5583c518e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:24.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.249+0000 7f86f1517640 1 -- 172.21.15.5:0/270957350 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583c4da00a0 msgr2=0x5583c5194f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:24.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.249+0000 7f86f1517640 1 --2- 172.21.15.5:0/270957350 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583c4da00a0 0x5583c5194f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:24.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.249+0000 7f86f1517640 1 -- 172.21.15.5:0/270957350 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583c4da8280 msgr2=0x5583c518e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:24.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.250+0000 7f86f1517640 1 --2- 172.21.15.5:0/270957350 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583c4da8280 0x5583c518e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:24.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.250+0000 7f86f1517640 1 -- 172.21.15.5:0/270957350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583c5193bd0 con 0x5583c4dc8f60 2024-08-31T05:29:24.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.250+0000 7f86f1517640 1 --2- 172.21.15.5:0/270957350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5583c4dc8f60 0x5583c518ebd0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f86e80055e0 tx=0x7f86e80054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=976a18ad8f4e5182 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:24.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.250+0000 7f86d57fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:29:24.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.250+0000 7f86d57fa640 1 -- 172.21.15.5:0/270957350 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e8056020 con 0x5583c4dc8f60 2024-08-31T05:29:24.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.250+0000 7f86d57fa640 1 -- 172.21.15.5:0/270957350 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f86e80043e0 con 0x5583c4dc8f60 2024-08-31T05:29:24.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.250+0000 7f86fa4f1740 1 -- 172.21.15.5:0/270957350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86e80328b0 con 0x5583c4dc8f60 2024-08-31T05:29:24.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.250+0000 7f86d57fa640 1 -- 172.21.15.5:0/270957350 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f86e8035040 con 0x5583c4dc8f60 2024-08-31T05:29:24.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.250+0000 7f86fa4f1740 10 client.15324 fetch_fsmap learned FSMap version 29 2024-08-31T05:29:24.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.250+0000 7f86fa4f1740 1 -- 172.21.15.5:0/270957350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5583c51f7950 con 0x5583c4dc8f60 2024-08-31T05:29:24.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.250+0000 7f86d57fa640 1 -- 172.21.15.5:0/270957350 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86e80328b0 con 0x5583c4dc8f60 2024-08-31T05:29:24.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.251+0000 7f86d57fa640 1 -- 172.21.15.5:0/270957350 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f86e804c040 con 0x5583c4dc8f60 2024-08-31T05:29:24.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.251+0000 7f86fa4f1740 10 client.15324 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T05:29:24.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.251+0000 7f86fa4f1740 10 client.15324 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-31T05:29:24.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.251+0000 7f86fa4f1740 20 client.15324 populate_metadata read hostname 'smithi005' 2024-08-31T05:29:24.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.251+0000 7f86fa4f1740 1 --2- 172.21.15.5:0/270957350 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x5583c4d5cc90 0x5583c51faca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:24.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.251+0000 7f86fa4f1740 4 client.15324 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T05:29:24.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.251+0000 7f86fa4f1740 1 -- 172.21.15.5:0/270957350 --> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] -- command(tid 0: {"prefix": "status"}) -- 0x5583c50e2de0 con 0x5583c4d5cc90 2024-08-31T05:29:24.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.251+0000 7f86f1d18640 1 --2- 172.21.15.5:0/270957350 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x5583c4d5cc90 0x5583c51faca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:24.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.251+0000 7f86f1d18640 1 --2- 172.21.15.5:0/270957350 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x5583c4d5cc90 0x5583c51faca0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f0bd92f19901d762 server_cookie=818c22bc284a8ec5 in_seq=0 out_seq=0 2024-08-31T05:29:24.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.251+0000 7f86d57fa640 10 client.15324 ms_handle_connect on v2:172.21.15.70:6836/2780036414 2024-08-31T05:29:24.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.252+0000 7f86d57fa640 1 -- 172.21.15.5:0/270957350 <== mds.2 v2:172.21.15.70:6836/2780036414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5583c50e2de0 con 0x5583c4d5cc90 2024-08-31T05:29:24.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.252+0000 7f86d57fa640 10 client.15324 handle_command_reply: tid=0 2024-08-31T05:29:24.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.252+0000 7f86fa4f1740 1 client.15324 shutdown 2024-08-31T05:29:24.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.252+0000 7f86fa4f1740 1 -- 172.21.15.5:0/270957350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5583c4dc8f60 msgr2=0x5583c518ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:24.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.252+0000 7f86fa4f1740 1 --2- 172.21.15.5:0/270957350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5583c4dc8f60 0x5583c518ebd0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f86e80055e0 tx=0x7f86e80054e0 comp rx=0 tx=0).stop 2024-08-31T05:29:24.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.252+0000 7f86fa4f1740 1 -- 172.21.15.5:0/270957350 shutdown_connections 2024-08-31T05:29:24.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.252+0000 7f86fa4f1740 1 --2- 172.21.15.5:0/270957350 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x5583c4d5cc90 0x5583c51faca0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:24.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.252+0000 7f86fa4f1740 1 --2- 172.21.15.5:0/270957350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5583c4dc8f60 0x5583c518ebd0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:24.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.252+0000 7f86fa4f1740 1 --2- 172.21.15.5:0/270957350 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5583c4da8280 0x5583c518e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:24.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.252+0000 7f86fa4f1740 1 --2- 172.21.15.5:0/270957350 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583c4da00a0 0x5583c5194f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:24.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.252+0000 7f86d57fa640 0 client.15324 ms_handle_reset on v2:172.21.15.70:6836/2780036414 2024-08-31T05:29:24.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.252+0000 7f86fa4f1740 1 -- 172.21.15.5:0/270957350 >> 172.21.15.5:0/270957350 conn(0x5583c4dbd350 msgr2=0x5583c517b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:24.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.252+0000 7f86fa4f1740 1 -- 172.21.15.5:0/270957350 shutdown_connections 2024-08-31T05:29:24.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.252+0000 7f86fa4f1740 1 -- 172.21.15.5:0/270957350 wait complete. 2024-08-31T05:29:24.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.252+0000 7f86fa4f1740 20 client.15324 trim_cache size 0 max 16384 2024-08-31T05:29:24.261 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:29:24.261 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "69422704-6758-11ef-bcd4-c7b262605968", 2024-08-31T05:29:24.261 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 2, 2024-08-31T05:29:24.261 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 24631, 2024-08-31T05:29:24.261 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-08-31T05:29:24.261 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-08-31T05:29:24.261 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-08-31T05:29:24.261 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 74.696095593999999, 2024-08-31T05:29:24.261 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 29, 2024-08-31T05:29:24.262 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 87, 2024-08-31T05:29:24.262 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 85, 2024-08-31T05:29:24.262 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 137.23892672100001 2024-08-31T05:29:24.262 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:29:24.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.253+0000 7f86f3f7c640 1 -- 172.21.15.5:0/2485981088 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f86d80b4c10 msgr2=0x7f86d80b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:24.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.253+0000 7f86f3f7c640 1 --2- 172.21.15.5:0/2485981088 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f86d80b4c10 0x7f86d80b7120 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f86e40e38f0 tx=0x7f86e40b5040 comp rx=0 tx=0).stop 2024-08-31T05:29:24.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.253+0000 7f86f3f7c640 1 -- 172.21.15.5:0/2485981088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86ec10ffa0 msgr2=0x7f86ec1a1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:24.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.253+0000 7f86f3f7c640 1 --2- 172.21.15.5:0/2485981088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86ec10ffa0 0x7f86ec1a1be0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f86e400eb10 tx=0x7f86e400c2d0 comp rx=0 tx=0).stop 2024-08-31T05:29:24.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.253+0000 7f86f3f7c640 1 -- 172.21.15.5:0/2485981088 shutdown_connections 2024-08-31T05:29:24.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.253+0000 7f86f3f7c640 1 --2- 172.21.15.5:0/2485981088 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f86d80b4c10 0x7f86d80b7120 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:24.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.253+0000 7f86f3f7c640 1 --2- 172.21.15.5:0/2485981088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86ec10ffa0 0x7f86ec1a1be0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:24.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.253+0000 7f86f3f7c640 1 --2- 172.21.15.5:0/2485981088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86ec102d40 0x7f86ec19c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:24.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.253+0000 7f86f3f7c640 1 --2- 172.21.15.5:0/2485981088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f86ec1023f0 0x7f86ec19c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:24.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.253+0000 7f86f3f7c640 1 -- 172.21.15.5:0/2485981088 >> 172.21.15.5:0/2485981088 conn(0x7f86ec0794d0 msgr2=0x7f86ec109b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:24.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.253+0000 7f86f3f7c640 1 -- 172.21.15.5:0/2485981088 shutdown_connections 2024-08-31T05:29:24.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:24.253+0000 7f86f3f7c640 1 -- 172.21.15.5:0/2485981088 wait complete. 2024-08-31T05:29:25.216 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.b status 2024-08-31T05:29:25.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:25 smithi005 ceph-mon[18602]: pgmap v328: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-31T05:29:25.473 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:29:25.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:25 smithi070 ceph-mon[22316]: pgmap v328: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-31T05:29:25.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:25 smithi050 ceph-mon[22146]: pgmap v328: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-31T05:29:25.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.947+0000 7f73a5c68640 1 -- 172.21.15.5:0/2526507428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73a0109280 msgr2=0x7f73a0109690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:25.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.947+0000 7f73a5c68640 1 --2- 172.21.15.5:0/2526507428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73a0109280 0x7f73a0109690 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7388009900 tx=0x7f738802a410 comp rx=0 tx=0).stop 2024-08-31T05:29:25.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.947+0000 7f73a5c68640 1 -- 172.21.15.5:0/2526507428 shutdown_connections 2024-08-31T05:29:25.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.947+0000 7f73a5c68640 1 --2- 172.21.15.5:0/2526507428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73a0109bd0 0x7f73a0110400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.947+0000 7f73a5c68640 1 --2- 172.21.15.5:0/2526507428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73a0109280 0x7f73a0109690 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.947+0000 7f73a5c68640 1 --2- 172.21.15.5:0/2526507428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73a0103940 0x7f73a0103d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.947+0000 7f73a5c68640 1 -- 172.21.15.5:0/2526507428 >> 172.21.15.5:0/2526507428 conn(0x7f73a00ff3d0 msgr2=0x7f73a0101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:25.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.947+0000 7f73a5c68640 1 -- 172.21.15.5:0/2526507428 shutdown_connections 2024-08-31T05:29:25.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.947+0000 7f73a5c68640 1 -- 172.21.15.5:0/2526507428 wait complete. 2024-08-31T05:29:25.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.948+0000 7f73a5c68640 1 Processor -- start 2024-08-31T05:29:25.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.948+0000 7f73a5c68640 1 -- start start 2024-08-31T05:29:25.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.949+0000 7f73a5c68640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73a0103940 0x7f73a019a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:25.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.949+0000 7f73a5c68640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73a0109280 0x7f73a019a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:25.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.949+0000 7f73a5c68640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73a0109bd0 0x7f73a019faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:25.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.949+0000 7f73a5c68640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f73a0113890 con 0x7f73a0109280 2024-08-31T05:29:25.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.949+0000 7f73a5c68640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f73a0113710 con 0x7f73a0103940 2024-08-31T05:29:25.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.949+0000 7f73a5c68640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f73a0113a10 con 0x7f73a0109bd0 2024-08-31T05:29:25.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.949+0000 7f7396ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73a0109280 0x7f73a019a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:25.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.949+0000 7f7396ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73a0109280 0x7f73a019a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36282/0 (socket says 172.21.15.5:36282) 2024-08-31T05:29:25.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.949+0000 7f7396ffd640 1 -- 172.21.15.5:0/3973759945 learned_addr learned my addr 172.21.15.5:0/3973759945 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:25.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.949+0000 7f739f7fe640 1 --2- 172.21.15.5:0/3973759945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73a0103940 0x7f73a019a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:25.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.949+0000 7f739ffff640 1 --2- 172.21.15.5:0/3973759945 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73a0109bd0 0x7f73a019faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:25.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.949+0000 7f7396ffd640 1 -- 172.21.15.5:0/3973759945 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73a0109bd0 msgr2=0x7f73a019faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:25.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.949+0000 7f7396ffd640 1 --2- 172.21.15.5:0/3973759945 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73a0109bd0 0x7f73a019faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.949+0000 7f7396ffd640 1 -- 172.21.15.5:0/3973759945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73a0103940 msgr2=0x7f73a019a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:25.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.949+0000 7f7396ffd640 1 --2- 172.21.15.5:0/3973759945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73a0103940 0x7f73a019a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.949+0000 7f7396ffd640 1 -- 172.21.15.5:0/3973759945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73a01a01d0 con 0x7f73a0109280 2024-08-31T05:29:25.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.949+0000 7f739f7fe640 1 --2- 172.21.15.5:0/3973759945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73a0103940 0x7f73a019a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:29:25.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.949+0000 7f7396ffd640 1 --2- 172.21.15.5:0/3973759945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73a0109280 0x7f73a019a800 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f738802a930 tx=0x7f7388004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:25.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.950+0000 7f739d7fa640 1 -- 172.21.15.5:0/3973759945 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f738803f030 con 0x7f73a0109280 2024-08-31T05:29:25.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.950+0000 7f73a5c68640 1 -- 172.21.15.5:0/3973759945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73a01a0460 con 0x7f73a0109280 2024-08-31T05:29:25.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.950+0000 7f739d7fa640 1 -- 172.21.15.5:0/3973759945 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7388003aa0 con 0x7f73a0109280 2024-08-31T05:29:25.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.950+0000 7f739d7fa640 1 -- 172.21.15.5:0/3973759945 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7388035070 con 0x7f73a0109280 2024-08-31T05:29:25.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.950+0000 7f73a5c68640 1 -- 172.21.15.5:0/3973759945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73a01a6c20 con 0x7f73a0109280 2024-08-31T05:29:25.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.952+0000 7f73ac1dd740 1 Processor -- start 2024-08-31T05:29:25.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.952+0000 7f73ac1dd740 1 -- start start 2024-08-31T05:29:25.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.953+0000 7f73ac1dd740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56412f50af60 0x56412f8b07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:25.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.953+0000 7f73ac1dd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56412f4e20a0 0x56412f8b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:25.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.953+0000 7f73ac1dd740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56412f4ea280 0x56412f8b1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:25.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.953+0000 7f73ac1dd740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56412f8273f0 con 0x56412f50af60 2024-08-31T05:29:25.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.953+0000 7f73ac1dd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56412f816980 con 0x56412f4e20a0 2024-08-31T05:29:25.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.953+0000 7f73ac1dd740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56412f81a930 con 0x56412f4ea280 2024-08-31T05:29:25.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.953+0000 7f739d7fa640 1 -- 172.21.15.5:0/3973759945 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f7388042030 con 0x7f73a0109280 2024-08-31T05:29:25.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.953+0000 7f739ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56412f50af60 0x56412f8b07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:25.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.953+0000 7f739ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56412f50af60 0x56412f8b07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36288/0 (socket says 172.21.15.5:36288) 2024-08-31T05:29:25.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.953+0000 7f739ffff640 1 -- 172.21.15.5:0/3918743760 learned_addr learned my addr 172.21.15.5:0/3918743760 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:25.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.953+0000 7f739f7fe640 1 --2- 172.21.15.5:0/3918743760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56412f4e20a0 0x56412f8b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:25.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.953+0000 7f739ffff640 1 -- 172.21.15.5:0/3918743760 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56412f4ea280 msgr2=0x56412f8b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:25.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.953+0000 7f7396ffd640 1 --2- 172.21.15.5:0/3918743760 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56412f4ea280 0x56412f8b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:25.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.953+0000 7f739ffff640 1 --2- 172.21.15.5:0/3918743760 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56412f4ea280 0x56412f8b1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.953+0000 7f739ffff640 1 -- 172.21.15.5:0/3918743760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56412f4e20a0 msgr2=0x56412f8b0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:25.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.953+0000 7f739ffff640 1 --2- 172.21.15.5:0/3918743760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56412f4e20a0 0x56412f8b0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.953+0000 7f739ffff640 1 -- 172.21.15.5:0/3918743760 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56412f576540 con 0x56412f50af60 2024-08-31T05:29:25.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.953+0000 7f7396ffd640 1 --2- 172.21.15.5:0/3918743760 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56412f4ea280 0x56412f8b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:29:25.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.954+0000 7f739ffff640 1 --2- 172.21.15.5:0/3918743760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56412f50af60 0x56412f8b07b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f7398009e60 tx=0x7f7398010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75de1e1dbb9fcfd2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:25.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.954+0000 7f7395ffb640 1 -- 172.21.15.5:0/3918743760 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7398016070 con 0x56412f50af60 2024-08-31T05:29:25.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.954+0000 7f7395ffb640 1 -- 172.21.15.5:0/3918743760 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7398004d20 con 0x56412f50af60 2024-08-31T05:29:25.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.954+0000 7f7395ffb640 1 -- 172.21.15.5:0/3918743760 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7398012740 con 0x56412f50af60 2024-08-31T05:29:25.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.954+0000 7f739d7fa640 1 --2- 172.21.15.5:0/3973759945 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f738c0b4c10 0x7f738c0b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:25.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.954+0000 7f739f7fe640 1 --2- 172.21.15.5:0/3973759945 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f738c0b4c10 0x7f738c0b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:25.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.954+0000 7f739d7fa640 1 -- 172.21.15.5:0/3973759945 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f7388105f70 con 0x7f73a0109280 2024-08-31T05:29:25.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.955+0000 7f739f7fe640 1 --2- 172.21.15.5:0/3973759945 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f738c0b4c10 0x7f738c0b7120 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x56412f8af430 tx=0x7f739000b5c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:25.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.955+0000 7f73ac1dd740 1 -- 172.21.15.5:0/3918743760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56412f50af60 msgr2=0x56412f8b07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:25.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.955+0000 7f73ac1dd740 1 --2- 172.21.15.5:0/3918743760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56412f50af60 0x56412f8b07b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f7398009e60 tx=0x7f7398010740 comp rx=0 tx=0).stop 2024-08-31T05:29:25.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.955+0000 7f73ac1dd740 1 -- 172.21.15.5:0/3918743760 shutdown_connections 2024-08-31T05:29:25.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.955+0000 7f73ac1dd740 1 --2- 172.21.15.5:0/3918743760 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56412f4ea280 0x56412f8b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.955+0000 7f73ac1dd740 1 --2- 172.21.15.5:0/3918743760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56412f4e20a0 0x56412f8b0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.955+0000 7f73ac1dd740 1 --2- 172.21.15.5:0/3918743760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56412f50af60 0x56412f8b07b0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.955+0000 7f73ac1dd740 1 -- 172.21.15.5:0/3918743760 >> 172.21.15.5:0/3918743760 conn(0x56412f4ff350 msgr2=0x56412f8ae6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:25.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.955+0000 7f73ac1dd740 1 -- 172.21.15.5:0/3918743760 shutdown_connections 2024-08-31T05:29:25.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.955+0000 7f73ac1dd740 1 -- 172.21.15.5:0/3918743760 wait complete. 2024-08-31T05:29:25.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.955+0000 7f73ac1dd740 1 -- start start 2024-08-31T05:29:25.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.955+0000 7f73ac1dd740 1 Processor -- start 2024-08-31T05:29:25.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.956+0000 7f73ac1dd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56412f4e20a0 0x56412f8bbe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:25.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.956+0000 7f73ac1dd740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56412f4ea280 0x56412f8bc370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:25.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.956+0000 7f73ac1dd740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56412f50af60 0x56412f8bc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:25.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.956+0000 7f73ac1dd740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56412f6795f0 con 0x56412f4ea280 2024-08-31T05:29:25.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.956+0000 7f73ac1dd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56412f79d600 con 0x56412f4e20a0 2024-08-31T05:29:25.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.956+0000 7f73ac1dd740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56412f8bef90 con 0x56412f50af60 2024-08-31T05:29:25.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.956+0000 7f73ac1dd740 10 client.0 _ll_register_callbacks cb 0x56412f7c3af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:29:25.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.956+0000 7f7396ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56412f4ea280 0x56412f8bc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:25.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.956+0000 7f7396ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56412f4ea280 0x56412f8bc370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36292/0 (socket says 172.21.15.5:36292) 2024-08-31T05:29:25.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.956+0000 7f7396ffd640 1 -- 172.21.15.5:0/3857098506 learned_addr learned my addr 172.21.15.5:0/3857098506 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:25.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.956+0000 7f739ffff640 1 --2- 172.21.15.5:0/3857098506 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56412f50af60 0x56412f8bc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:25.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.956+0000 7f739f7fe640 1 --2- 172.21.15.5:0/3857098506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56412f4e20a0 0x56412f8bbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:25.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.956+0000 7f7396ffd640 1 -- 172.21.15.5:0/3857098506 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56412f50af60 msgr2=0x56412f8bc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:25.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.956+0000 7f7396ffd640 1 --2- 172.21.15.5:0/3857098506 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56412f50af60 0x56412f8bc8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.956+0000 7f7396ffd640 1 -- 172.21.15.5:0/3857098506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56412f4e20a0 msgr2=0x56412f8bbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:25.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.956+0000 7f7396ffd640 1 --2- 172.21.15.5:0/3857098506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56412f4e20a0 0x56412f8bbe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.956+0000 7f7396ffd640 1 -- 172.21.15.5:0/3857098506 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56412f7d67b0 con 0x56412f4ea280 2024-08-31T05:29:25.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.956+0000 7f739f7fe640 1 --2- 172.21.15.5:0/3857098506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56412f4e20a0 0x56412f8bbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:29:25.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.956+0000 7f7396ffd640 1 --2- 172.21.15.5:0/3857098506 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56412f4ea280 0x56412f8bc370 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f73880cc330 tx=0x7f7388000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=959f10e2a5a12dfd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:25.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.956+0000 7f737effd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:29:25.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.957+0000 7f737effd640 1 -- 172.21.15.5:0/3857098506 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7388049050 con 0x56412f4ea280 2024-08-31T05:29:25.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.957+0000 7f737effd640 1 -- 172.21.15.5:0/3857098506 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f73881036d0 con 0x56412f4ea280 2024-08-31T05:29:25.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.957+0000 7f73ac1dd740 1 -- 172.21.15.5:0/3857098506 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7398004d20 con 0x56412f4ea280 2024-08-31T05:29:25.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.957+0000 7f737effd640 1 -- 172.21.15.5:0/3857098506 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f73880cc3a0 con 0x56412f4ea280 2024-08-31T05:29:25.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.957+0000 7f73ac1dd740 10 client.15336 fetch_fsmap learned FSMap version 29 2024-08-31T05:29:25.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.957+0000 7f73ac1dd740 1 -- 172.21.15.5:0/3857098506 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56412f8cabe0 con 0x56412f4ea280 2024-08-31T05:29:25.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.957+0000 7f737effd640 1 -- 172.21.15.5:0/3857098506 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7398004d20 con 0x56412f4ea280 2024-08-31T05:29:25.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.957+0000 7f737effd640 1 -- 172.21.15.5:0/3857098506 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f73880c8630 con 0x56412f4ea280 2024-08-31T05:29:25.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.957+0000 7f73ac1dd740 10 client.15336 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T05:29:25.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.957+0000 7f73ac1dd740 10 client.15336 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-31T05:29:25.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.957+0000 7f73ac1dd740 20 client.15336 populate_metadata read hostname 'smithi005' 2024-08-31T05:29:25.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.957+0000 7f73ac1dd740 1 --2- 172.21.15.5:0/3857098506 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x56412f4c98e0 0x56412f8ce6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:25.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.957+0000 7f73ac1dd740 4 client.15336 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:29:25.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.957+0000 7f73ac1dd740 1 -- 172.21.15.5:0/3857098506 --> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56412f829340 con 0x56412f4c98e0 2024-08-31T05:29:25.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.958+0000 7f739f7fe640 1 --2- 172.21.15.5:0/3857098506 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x56412f4c98e0 0x56412f8ce6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:25.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.958+0000 7f739f7fe640 1 --2- 172.21.15.5:0/3857098506 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x56412f4c98e0 0x56412f8ce6e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e61b95dc21aca3c3 server_cookie=6d7773bbc4c21f3a in_seq=0 out_seq=0 2024-08-31T05:29:25.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.958+0000 7f737effd640 10 client.15336 ms_handle_connect on v2:172.21.15.50:6838/98200944 2024-08-31T05:29:25.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.959+0000 7f737effd640 1 -- 172.21.15.5:0/3857098506 <== mds.1 v2:172.21.15.50:6838/98200944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56412f829340 con 0x56412f4c98e0 2024-08-31T05:29:25.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.959+0000 7f737effd640 10 client.15336 handle_command_reply: tid=0 2024-08-31T05:29:25.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.959+0000 7f73ac1dd740 1 client.15336 shutdown 2024-08-31T05:29:25.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.959+0000 7f73ac1dd740 1 -- 172.21.15.5:0/3857098506 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56412f4ea280 msgr2=0x56412f8bc370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:25.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.959+0000 7f73ac1dd740 1 --2- 172.21.15.5:0/3857098506 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56412f4ea280 0x56412f8bc370 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f73880cc330 tx=0x7f7388000bc0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.959+0000 7f73ac1dd740 1 -- 172.21.15.5:0/3857098506 shutdown_connections 2024-08-31T05:29:25.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.959+0000 7f73ac1dd740 1 --2- 172.21.15.5:0/3857098506 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x56412f4c98e0 0x56412f8ce6e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.959+0000 7f73ac1dd740 1 --2- 172.21.15.5:0/3857098506 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56412f50af60 0x56412f8bc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.959+0000 7f73ac1dd740 1 --2- 172.21.15.5:0/3857098506 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56412f4ea280 0x56412f8bc370 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.959+0000 7f73ac1dd740 1 --2- 172.21.15.5:0/3857098506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56412f4e20a0 0x56412f8bbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.959+0000 7f73ac1dd740 1 -- 172.21.15.5:0/3857098506 >> 172.21.15.5:0/3857098506 conn(0x56412f4ff350 msgr2=0x56412f8b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:25.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.960+0000 7f737effd640 0 client.15336 ms_handle_reset on v2:172.21.15.50:6838/98200944 2024-08-31T05:29:25.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.960+0000 7f73ac1dd740 1 -- 172.21.15.5:0/3857098506 shutdown_connections 2024-08-31T05:29:25.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.960+0000 7f73ac1dd740 1 -- 172.21.15.5:0/3857098506 wait complete. 2024-08-31T05:29:25.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.960+0000 7f73ac1dd740 20 client.15336 trim_cache size 0 max 16384 2024-08-31T05:29:25.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.978+0000 7f73ac1dd740 1 Processor -- start 2024-08-31T05:29:25.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.978+0000 7f73ac1dd740 1 -- start start 2024-08-31T05:29:25.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.978+0000 7f73ac1dd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56412f4e20a0 0x56412f8ba6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:25.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.978+0000 7f73ac1dd740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56412f4ea280 0x56412f8babf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:25.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.978+0000 7f73ac1dd740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56412f50af60 0x56412f8adcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:25.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.978+0000 7f73ac1dd740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56412f8cca20 con 0x56412f50af60 2024-08-31T05:29:25.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.978+0000 7f73ac1dd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56412f8cd0f0 con 0x56412f4e20a0 2024-08-31T05:29:25.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.978+0000 7f73ac1dd740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56412f8cd7c0 con 0x56412f4ea280 2024-08-31T05:29:25.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.978+0000 7f739ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56412f50af60 0x56412f8adcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:25.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.978+0000 7f739ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56412f50af60 0x56412f8adcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36300/0 (socket says 172.21.15.5:36300) 2024-08-31T05:29:25.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.978+0000 7f739ffff640 1 -- 172.21.15.5:0/3452693277 learned_addr learned my addr 172.21.15.5:0/3452693277 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:25.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.978+0000 7f739f7fe640 1 --2- 172.21.15.5:0/3452693277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56412f4e20a0 0x56412f8ba6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:25.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.978+0000 7f7396ffd640 1 --2- 172.21.15.5:0/3452693277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56412f4ea280 0x56412f8babf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:25.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.978+0000 7f739ffff640 1 -- 172.21.15.5:0/3452693277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56412f4ea280 msgr2=0x56412f8babf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:25.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.978+0000 7f739ffff640 1 --2- 172.21.15.5:0/3452693277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56412f4ea280 0x56412f8babf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.978+0000 7f739ffff640 1 -- 172.21.15.5:0/3452693277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56412f4e20a0 msgr2=0x56412f8ba6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:25.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.978+0000 7f739ffff640 1 --2- 172.21.15.5:0/3452693277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56412f4e20a0 0x56412f8ba6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.979+0000 7f739ffff640 1 -- 172.21.15.5:0/3452693277 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56412f8c89b0 con 0x56412f50af60 2024-08-31T05:29:25.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.979+0000 7f739f7fe640 1 --2- 172.21.15.5:0/3452693277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56412f4e20a0 0x56412f8ba6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:29:25.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.979+0000 7f739ffff640 1 --2- 172.21.15.5:0/3452693277 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56412f50af60 0x56412f8adcf0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7398009880 tx=0x7f7398010f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17c11cda2f9680ae server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:25.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.979+0000 7f73957fa640 1 -- 172.21.15.5:0/3452693277 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7398016040 con 0x56412f50af60 2024-08-31T05:29:25.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.979+0000 7f73957fa640 1 -- 172.21.15.5:0/3452693277 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7398012bc0 con 0x56412f50af60 2024-08-31T05:29:25.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.979+0000 7f73957fa640 1 -- 172.21.15.5:0/3452693277 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f739801ac40 con 0x56412f50af60 2024-08-31T05:29:25.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.980+0000 7f73ac1dd740 1 -- 172.21.15.5:0/3452693277 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56412f50af60 msgr2=0x56412f8adcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:25.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.980+0000 7f73ac1dd740 1 --2- 172.21.15.5:0/3452693277 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56412f50af60 0x56412f8adcf0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7398009880 tx=0x7f7398010f10 comp rx=0 tx=0).stop 2024-08-31T05:29:25.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.980+0000 7f73ac1dd740 1 -- 172.21.15.5:0/3452693277 shutdown_connections 2024-08-31T05:29:25.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.980+0000 7f73ac1dd740 1 --2- 172.21.15.5:0/3452693277 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56412f50af60 0x56412f8adcf0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.980+0000 7f73ac1dd740 1 --2- 172.21.15.5:0/3452693277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56412f4ea280 0x56412f8babf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.980+0000 7f73ac1dd740 1 --2- 172.21.15.5:0/3452693277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56412f4e20a0 0x56412f8ba6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.980+0000 7f73ac1dd740 1 -- 172.21.15.5:0/3452693277 >> 172.21.15.5:0/3452693277 conn(0x56412f4ff350 msgr2=0x56412f8b7010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:25.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.980+0000 7f73ac1dd740 1 -- 172.21.15.5:0/3452693277 shutdown_connections 2024-08-31T05:29:25.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.980+0000 7f73ac1dd740 1 -- 172.21.15.5:0/3452693277 wait complete. 2024-08-31T05:29:25.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.980+0000 7f73ac1dd740 1 -- start start 2024-08-31T05:29:25.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.980+0000 7f73ac1dd740 1 Processor -- start 2024-08-31T05:29:25.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.981+0000 7f73ac1dd740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56412f4e20a0 0x56412f8d6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:25.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.981+0000 7f73ac1dd740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56412f4ea280 0x56412f8d0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:25.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.981+0000 7f73ac1dd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56412f50af60 0x56412f8d08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:25.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.981+0000 7f73ac1dd740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56412f8ce560 con 0x56412f4ea280 2024-08-31T05:29:25.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.981+0000 7f73ac1dd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56412f8cde90 con 0x56412f50af60 2024-08-31T05:29:25.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.981+0000 7f73ac1dd740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56412f8cec30 con 0x56412f4e20a0 2024-08-31T05:29:25.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.981+0000 7f73ac1dd740 10 client.0 _ll_register_callbacks cb 0x7f73880cc1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:29:25.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.981+0000 7f7396ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56412f4ea280 0x56412f8d0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:25.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.981+0000 7f7396ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56412f4ea280 0x56412f8d0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36316/0 (socket says 172.21.15.5:36316) 2024-08-31T05:29:25.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.981+0000 7f7396ffd640 1 -- 172.21.15.5:0/4255598748 learned_addr learned my addr 172.21.15.5:0/4255598748 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:25.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.981+0000 7f739ffff640 1 --2- 172.21.15.5:0/4255598748 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56412f50af60 0x56412f8d08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:25.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.981+0000 7f739f7fe640 1 --2- 172.21.15.5:0/4255598748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56412f4e20a0 0x56412f8d6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:25.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.981+0000 7f7396ffd640 1 -- 172.21.15.5:0/4255598748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56412f4e20a0 msgr2=0x56412f8d6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:25.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.981+0000 7f7396ffd640 1 --2- 172.21.15.5:0/4255598748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56412f4e20a0 0x56412f8d6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.981+0000 7f7396ffd640 1 -- 172.21.15.5:0/4255598748 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56412f50af60 msgr2=0x56412f8d08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:25.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.981+0000 7f7396ffd640 1 --2- 172.21.15.5:0/4255598748 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56412f50af60 0x56412f8d08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.981+0000 7f7396ffd640 1 -- 172.21.15.5:0/4255598748 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56412f8d0df0 con 0x56412f4ea280 2024-08-31T05:29:25.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.981+0000 7f7396ffd640 1 --2- 172.21.15.5:0/4255598748 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56412f4ea280 0x56412f8d0370 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f73880c8420 tx=0x7f73880cbeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=464d47b75e0aae9b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:25.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.981+0000 7f737effd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:29:25.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.982+0000 7f737effd640 1 -- 172.21.15.5:0/4255598748 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7388049070 con 0x56412f4ea280 2024-08-31T05:29:25.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.982+0000 7f737effd640 1 -- 172.21.15.5:0/4255598748 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f7388003c50 con 0x56412f4ea280 2024-08-31T05:29:25.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.982+0000 7f73ac1dd740 1 -- 172.21.15.5:0/4255598748 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7398012bc0 con 0x56412f4ea280 2024-08-31T05:29:25.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.982+0000 7f737effd640 1 -- 172.21.15.5:0/4255598748 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f73880d0c10 con 0x56412f4ea280 2024-08-31T05:29:25.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.982+0000 7f73ac1dd740 10 client.15342 fetch_fsmap learned FSMap version 29 2024-08-31T05:29:25.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.982+0000 7f73ac1dd740 1 -- 172.21.15.5:0/4255598748 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56412f8d6700 con 0x56412f4ea280 2024-08-31T05:29:25.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.982+0000 7f737effd640 1 -- 172.21.15.5:0/4255598748 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7398012bc0 con 0x56412f4ea280 2024-08-31T05:29:25.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.982+0000 7f737effd640 1 -- 172.21.15.5:0/4255598748 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f73880cb600 con 0x56412f4ea280 2024-08-31T05:29:25.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.982+0000 7f73ac1dd740 10 client.15342 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T05:29:25.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.982+0000 7f73ac1dd740 10 client.15342 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-31T05:29:25.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.982+0000 7f73ac1dd740 20 client.15342 populate_metadata read hostname 'smithi005' 2024-08-31T05:29:25.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.982+0000 7f73ac1dd740 1 --2- 172.21.15.5:0/4255598748 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x56412f49ec90 0x56412f93cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:25.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.982+0000 7f73ac1dd740 4 client.15342 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T05:29:25.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.982+0000 7f73ac1dd740 1 -- 172.21.15.5:0/4255598748 --> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] -- command(tid 0: {"prefix": "status"}) -- 0x56412f824de0 con 0x56412f49ec90 2024-08-31T05:29:25.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.983+0000 7f739f7fe640 1 --2- 172.21.15.5:0/4255598748 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x56412f49ec90 0x56412f93cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:25.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.983+0000 7f739f7fe640 1 --2- 172.21.15.5:0/4255598748 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x56412f49ec90 0x56412f93cf10 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a2da7a8a5fdebe20 server_cookie=5b8d6f73d6ebf80a in_seq=0 out_seq=0 2024-08-31T05:29:25.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.983+0000 7f737effd640 10 client.15342 ms_handle_connect on v2:172.21.15.50:6838/98200944 2024-08-31T05:29:25.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.983+0000 7f737effd640 1 -- 172.21.15.5:0/4255598748 <== mds.1 v2:172.21.15.50:6838/98200944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x56412f824de0 con 0x56412f49ec90 2024-08-31T05:29:25.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.983+0000 7f737effd640 10 client.15342 handle_command_reply: tid=0 2024-08-31T05:29:25.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.983+0000 7f73ac1dd740 1 client.15342 shutdown 2024-08-31T05:29:25.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.983+0000 7f73ac1dd740 1 -- 172.21.15.5:0/4255598748 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56412f4ea280 msgr2=0x56412f8d0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:25.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.983+0000 7f73ac1dd740 1 --2- 172.21.15.5:0/4255598748 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56412f4ea280 0x56412f8d0370 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f73880c8420 tx=0x7f73880cbeb0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.984+0000 7f73ac1dd740 1 -- 172.21.15.5:0/4255598748 shutdown_connections 2024-08-31T05:29:25.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.984+0000 7f73ac1dd740 1 --2- 172.21.15.5:0/4255598748 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x56412f49ec90 0x56412f93cf10 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.984+0000 7f73ac1dd740 1 --2- 172.21.15.5:0/4255598748 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56412f50af60 0x56412f8d08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.984+0000 7f73ac1dd740 1 --2- 172.21.15.5:0/4255598748 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56412f4ea280 0x56412f8d0370 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.984+0000 7f73ac1dd740 1 --2- 172.21.15.5:0/4255598748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56412f4e20a0 0x56412f8d6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.984+0000 7f73ac1dd740 1 -- 172.21.15.5:0/4255598748 >> 172.21.15.5:0/4255598748 conn(0x56412f4ff350 msgr2=0x56412f8ba2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:25.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.984+0000 7f737effd640 0 client.15342 ms_handle_reset on v2:172.21.15.50:6838/98200944 2024-08-31T05:29:25.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.984+0000 7f73ac1dd740 1 -- 172.21.15.5:0/4255598748 shutdown_connections 2024-08-31T05:29:25.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.984+0000 7f73ac1dd740 1 -- 172.21.15.5:0/4255598748 wait complete. 2024-08-31T05:29:25.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.984+0000 7f73ac1dd740 20 client.15342 trim_cache size 0 max 16384 2024-08-31T05:29:25.991 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:29:25.991 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "69422704-6758-11ef-bcd4-c7b262605968", 2024-08-31T05:29:25.991 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 1, 2024-08-31T05:29:25.991 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 24638, 2024-08-31T05:29:25.991 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-08-31T05:29:25.992 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-08-31T05:29:25.992 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-08-31T05:29:25.992 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 77.437270326999993, 2024-08-31T05:29:25.992 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 29, 2024-08-31T05:29:25.992 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 87, 2024-08-31T05:29:25.992 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 85, 2024-08-31T05:29:25.992 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 124.531880231 2024-08-31T05:29:25.992 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:29:25.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.984+0000 7f73a5c68640 1 -- 172.21.15.5:0/3973759945 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f738c0b4c10 msgr2=0x7f738c0b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:25.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.984+0000 7f73a5c68640 1 --2- 172.21.15.5:0/3973759945 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f738c0b4c10 0x7f738c0b7120 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x56412f8af430 tx=0x7f739000b5c0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.984+0000 7f73a5c68640 1 -- 172.21.15.5:0/3973759945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73a0109280 msgr2=0x7f73a019a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:25.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.984+0000 7f73a5c68640 1 --2- 172.21.15.5:0/3973759945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73a0109280 0x7f73a019a800 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f738802a930 tx=0x7f7388004270 comp rx=0 tx=0).stop 2024-08-31T05:29:25.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.984+0000 7f73a5c68640 1 -- 172.21.15.5:0/3973759945 shutdown_connections 2024-08-31T05:29:25.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.984+0000 7f73a5c68640 1 --2- 172.21.15.5:0/3973759945 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f738c0b4c10 0x7f738c0b7120 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.984+0000 7f73a5c68640 1 --2- 172.21.15.5:0/3973759945 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73a0109bd0 0x7f73a019faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.984+0000 7f73a5c68640 1 --2- 172.21.15.5:0/3973759945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73a0109280 0x7f73a019a800 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.984+0000 7f73a5c68640 1 --2- 172.21.15.5:0/3973759945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73a0103940 0x7f73a019a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:25.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.984+0000 7f73a5c68640 1 -- 172.21.15.5:0/3973759945 >> 172.21.15.5:0/3973759945 conn(0x7f73a00ff3d0 msgr2=0x7f73a01017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:25.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.985+0000 7f73a5c68640 1 -- 172.21.15.5:0/3973759945 shutdown_connections 2024-08-31T05:29:25.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:25.985+0000 7f73a5c68640 1 -- 172.21.15.5:0/3973759945 wait complete. 2024-08-31T05:29:26.775 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.i status 2024-08-31T05:29:27.030 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:29:27.441 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:27 smithi005 ceph-mon[18602]: pgmap v329: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-08-31T05:29:27.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.531+0000 7f2401b9c640 1 -- 172.21.15.5:0/2558225634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23fc109b90 msgr2=0x7f23fc1103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:27.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.531+0000 7f2401b9c640 1 --2- 172.21.15.5:0/2558225634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23fc109b90 0x7f23fc1103c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f23f4009ca0 tx=0x7f23f402a8c0 comp rx=0 tx=0).stop 2024-08-31T05:29:27.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.531+0000 7f2401b9c640 1 -- 172.21.15.5:0/2558225634 shutdown_connections 2024-08-31T05:29:27.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.531+0000 7f2401b9c640 1 --2- 172.21.15.5:0/2558225634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23fc109b90 0x7f23fc1103c0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:27.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.531+0000 7f2401b9c640 1 --2- 172.21.15.5:0/2558225634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23fc109240 0x7f23fc109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:27.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.531+0000 7f2401b9c640 1 --2- 172.21.15.5:0/2558225634 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23fc103900 0x7f23fc103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:27.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.531+0000 7f2401b9c640 1 -- 172.21.15.5:0/2558225634 >> 172.21.15.5:0/2558225634 conn(0x7f23fc07b5f0 msgr2=0x7f23fc07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:27.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.531+0000 7f2401b9c640 1 -- 172.21.15.5:0/2558225634 shutdown_connections 2024-08-31T05:29:27.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.531+0000 7f2401b9c640 1 -- 172.21.15.5:0/2558225634 wait complete. 2024-08-31T05:29:27.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.532+0000 7f2401b9c640 1 Processor -- start 2024-08-31T05:29:27.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.532+0000 7f2401b9c640 1 -- start start 2024-08-31T05:29:27.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.532+0000 7f2401b9c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23fc103900 0x7f23fc0754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:27.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.532+0000 7f2401b9c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23fc109240 0x7f23fc0759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:27.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.532+0000 7f2401b9c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23fc109b90 0x7f23fc075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:27.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.532+0000 7f2401b9c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f23fc113850 con 0x7f23fc109b90 2024-08-31T05:29:27.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.532+0000 7f2401b9c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f23fc1136d0 con 0x7f23fc109240 2024-08-31T05:29:27.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.532+0000 7f2401b9c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f23fc1139d0 con 0x7f23fc103900 2024-08-31T05:29:27.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.532+0000 7f23fbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23fc109b90 0x7f23fc075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:27.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.532+0000 7f23fbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23fc109b90 0x7f23fc075f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36330/0 (socket says 172.21.15.5:36330) 2024-08-31T05:29:27.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.532+0000 7f23fbfff640 1 -- 172.21.15.5:0/342195475 learned_addr learned my addr 172.21.15.5:0/342195475 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:27.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.532+0000 7f23f2ffd640 1 --2- 172.21.15.5:0/342195475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23fc109240 0x7f23fc0759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:27.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.532+0000 7f23fb7fe640 1 --2- 172.21.15.5:0/342195475 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23fc103900 0x7f23fc0754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:27.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.533+0000 7f23fbfff640 1 -- 172.21.15.5:0/342195475 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23fc103900 msgr2=0x7f23fc0754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:27.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.533+0000 7f23fbfff640 1 --2- 172.21.15.5:0/342195475 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23fc103900 0x7f23fc0754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:27.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.533+0000 7f23fbfff640 1 -- 172.21.15.5:0/342195475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23fc109240 msgr2=0x7f23fc0759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:27.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.533+0000 7f23fbfff640 1 --2- 172.21.15.5:0/342195475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23fc109240 0x7f23fc0759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:27.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.533+0000 7f23fbfff640 1 -- 172.21.15.5:0/342195475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23fc1a8480 con 0x7f23fc109b90 2024-08-31T05:29:27.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.533+0000 7f23f2ffd640 1 --2- 172.21.15.5:0/342195475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23fc109240 0x7f23fc0759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:29:27.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.533+0000 7f23fbfff640 1 --2- 172.21.15.5:0/342195475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23fc109b90 0x7f23fc075f30 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f23f40098d0 tx=0x7f23f40317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:27.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.533+0000 7f23f97fa640 1 -- 172.21.15.5:0/342195475 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f4003b70 con 0x7f23fc109b90 2024-08-31T05:29:27.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.533+0000 7f2401b9c640 1 -- 172.21.15.5:0/342195475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23fc1a8710 con 0x7f23fc109b90 2024-08-31T05:29:27.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.533+0000 7f23f97fa640 1 -- 172.21.15.5:0/342195475 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f23f4003d10 con 0x7f23fc109b90 2024-08-31T05:29:27.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.533+0000 7f23f97fa640 1 -- 172.21.15.5:0/342195475 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f402fa20 con 0x7f23fc109b90 2024-08-31T05:29:27.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.533+0000 7f2401b9c640 1 -- 172.21.15.5:0/342195475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23fc1a8c50 con 0x7f23fc109b90 2024-08-31T05:29:27.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.536+0000 7f23f97fa640 1 -- 172.21.15.5:0/342195475 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f23f402fc40 con 0x7f23fc109b90 2024-08-31T05:29:27.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.536+0000 7f2408111740 1 Processor -- start 2024-08-31T05:29:27.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.536+0000 7f2408111740 1 -- start start 2024-08-31T05:29:27.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.536+0000 7f2408111740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dab2289f60 0x55dab262f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:27.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.536+0000 7f2408111740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dab22610a0 0x55dab262fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:27.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.536+0000 7f2408111740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dab2269280 0x55dab2630230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:27.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.536+0000 7f2408111740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55dab25a63f0 con 0x55dab22610a0 2024-08-31T05:29:27.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.536+0000 7f2408111740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55dab2595980 con 0x55dab2289f60 2024-08-31T05:29:27.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.536+0000 7f2408111740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55dab2599930 con 0x55dab2269280 2024-08-31T05:29:27.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.537+0000 7f23fb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dab22610a0 0x55dab262fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:27.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.537+0000 7f23fb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dab22610a0 0x55dab262fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36342/0 (socket says 172.21.15.5:36342) 2024-08-31T05:29:27.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.537+0000 7f23fb7fe640 1 -- 172.21.15.5:0/1388309852 learned_addr learned my addr 172.21.15.5:0/1388309852 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:27.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.537+0000 7f23f97fa640 1 --2- 172.21.15.5:0/342195475 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f23e80b4c10 0x7f23e80b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:27.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.537+0000 7f23f2ffd640 1 --2- 172.21.15.5:0/1388309852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dab2269280 0x55dab2630230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:27.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.537+0000 7f23fb7fe640 1 -- 172.21.15.5:0/1388309852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dab2269280 msgr2=0x55dab2630230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:27.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.537+0000 7f23f2ffd640 1 --2- 172.21.15.5:0/1388309852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dab2289f60 0x55dab262f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:27.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.537+0000 7f23fb7fe640 1 --2- 172.21.15.5:0/1388309852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dab2269280 0x55dab2630230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:27.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.537+0000 7f23fb7fe640 1 -- 172.21.15.5:0/1388309852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dab2289f60 msgr2=0x55dab262f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:27.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.537+0000 7f23fbfff640 1 --2- 172.21.15.5:0/342195475 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f23e80b4c10 0x7f23e80b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:27.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.537+0000 7f23fb7fe640 1 --2- 172.21.15.5:0/1388309852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dab2289f60 0x55dab262f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:27.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.537+0000 7f23fb7fe640 1 -- 172.21.15.5:0/1388309852 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dab22f5540 con 0x55dab22610a0 2024-08-31T05:29:27.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.537+0000 7f23f2ffd640 1 --2- 172.21.15.5:0/1388309852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dab2289f60 0x55dab262f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:29:27.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.537+0000 7f23f97fa640 1 -- 172.21.15.5:0/342195475 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f23f4106bc0 con 0x7f23fc109b90 2024-08-31T05:29:27.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.537+0000 7f23fb7fe640 1 --2- 172.21.15.5:0/1388309852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dab22610a0 0x55dab262fcf0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f23ec00bc90 tx=0x7f23ec00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b84daad984e3799c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:27.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.537+0000 7f23f1ffb640 1 -- 172.21.15.5:0/1388309852 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23ec015070 con 0x55dab22610a0 2024-08-31T05:29:27.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.537+0000 7f23f1ffb640 1 -- 172.21.15.5:0/1388309852 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f23ec01a910 con 0x55dab22610a0 2024-08-31T05:29:27.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.537+0000 7f23f1ffb640 1 -- 172.21.15.5:0/1388309852 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23ec0118c0 con 0x55dab22610a0 2024-08-31T05:29:27.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.538+0000 7f2408111740 1 -- 172.21.15.5:0/1388309852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dab22610a0 msgr2=0x55dab262fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:27.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.538+0000 7f23fbfff640 1 --2- 172.21.15.5:0/342195475 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f23e80b4c10 0x7f23e80b7120 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f23f404d000 tx=0x7f23f4099040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:27.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.538+0000 7f2408111740 1 --2- 172.21.15.5:0/1388309852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dab22610a0 0x55dab262fcf0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f23ec00bc90 tx=0x7f23ec00f730 comp rx=0 tx=0).stop 2024-08-31T05:29:27.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.538+0000 7f2408111740 1 -- 172.21.15.5:0/1388309852 shutdown_connections 2024-08-31T05:29:27.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.538+0000 7f2408111740 1 --2- 172.21.15.5:0/1388309852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dab2269280 0x55dab2630230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:27.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.538+0000 7f2408111740 1 --2- 172.21.15.5:0/1388309852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dab22610a0 0x55dab262fcf0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:27.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.538+0000 7f2408111740 1 --2- 172.21.15.5:0/1388309852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dab2289f60 0x55dab262f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:27.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.538+0000 7f2408111740 1 -- 172.21.15.5:0/1388309852 >> 172.21.15.5:0/1388309852 conn(0x55dab227e350 msgr2=0x55dab262d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:27.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.538+0000 7f2408111740 1 -- 172.21.15.5:0/1388309852 shutdown_connections 2024-08-31T05:29:27.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.538+0000 7f2408111740 1 -- 172.21.15.5:0/1388309852 wait complete. 2024-08-31T05:29:27.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.539+0000 7f2408111740 1 -- start start 2024-08-31T05:29:27.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.539+0000 7f2408111740 1 Processor -- start 2024-08-31T05:29:27.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.539+0000 7f2408111740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dab22610a0 0x55dab263ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:27.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.539+0000 7f2408111740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dab2269280 0x55dab263b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:27.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.539+0000 7f2408111740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dab2289f60 0x55dab2647280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:27.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.539+0000 7f2408111740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55dab23f85f0 con 0x55dab2269280 2024-08-31T05:29:27.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.539+0000 7f2408111740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55dab251c600 con 0x55dab2289f60 2024-08-31T05:29:27.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.539+0000 7f2408111740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55dab263df90 con 0x55dab22610a0 2024-08-31T05:29:27.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.539+0000 7f2408111740 10 client.0 _ll_register_callbacks cb 0x55dab2542af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:29:27.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.540+0000 7f23fb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dab2269280 0x55dab263b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:27.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.540+0000 7f23fb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dab2269280 0x55dab263b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36354/0 (socket says 172.21.15.5:36354) 2024-08-31T05:29:27.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.540+0000 7f23fb7fe640 1 -- 172.21.15.5:0/486514558 learned_addr learned my addr 172.21.15.5:0/486514558 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:27.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.540+0000 7f23f2ffd640 1 --2- 172.21.15.5:0/486514558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dab2289f60 0x55dab2647280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:27.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.540+0000 7f23f2ffd640 1 --2- 172.21.15.5:0/486514558 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dab22610a0 0x55dab263ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:27.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.540+0000 7f23fb7fe640 1 -- 172.21.15.5:0/486514558 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dab22610a0 msgr2=0x55dab263ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:27.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.540+0000 7f23fb7fe640 1 --2- 172.21.15.5:0/486514558 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dab22610a0 0x55dab263ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:27.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.540+0000 7f23fb7fe640 1 -- 172.21.15.5:0/486514558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dab2289f60 msgr2=0x55dab2647280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:27.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.540+0000 7f23fb7fe640 1 --2- 172.21.15.5:0/486514558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dab2289f60 0x55dab2647280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:27.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.540+0000 7f23fb7fe640 1 -- 172.21.15.5:0/486514558 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dab25557b0 con 0x55dab2269280 2024-08-31T05:29:27.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.540+0000 7f23f2ffd640 1 --2- 172.21.15.5:0/486514558 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dab22610a0 0x55dab263ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:29:27.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.540+0000 7f23fb7fe640 1 --2- 172.21.15.5:0/486514558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dab2269280 0x55dab263b3d0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f23ec00b9d0 tx=0x7f23ec01a460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b9f814bdb478e6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:27.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.540+0000 7f23daffd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:29:27.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.540+0000 7f23daffd640 1 -- 172.21.15.5:0/486514558 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23ec028060 con 0x55dab2269280 2024-08-31T05:29:27.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.540+0000 7f23daffd640 1 -- 172.21.15.5:0/486514558 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f23ec01acd0 con 0x55dab2269280 2024-08-31T05:29:27.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.540+0000 7f2408111740 1 -- 172.21.15.5:0/486514558 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23ec01a910 con 0x55dab2269280 2024-08-31T05:29:27.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.540+0000 7f23daffd640 1 -- 172.21.15.5:0/486514558 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f23ec02f050 con 0x55dab2269280 2024-08-31T05:29:27.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.541+0000 7f2408111740 10 client.15354 fetch_fsmap learned FSMap version 29 2024-08-31T05:29:27.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.541+0000 7f2408111740 1 -- 172.21.15.5:0/486514558 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55dab2649bd0 con 0x55dab2269280 2024-08-31T05:29:27.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.541+0000 7f23daffd640 1 -- 172.21.15.5:0/486514558 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f23ec01a910 con 0x55dab2269280 2024-08-31T05:29:27.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.541+0000 7f23daffd640 1 -- 172.21.15.5:0/486514558 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f23ec0049d0 con 0x55dab2269280 2024-08-31T05:29:27.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.541+0000 7f2408111740 10 client.15354 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T05:29:27.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.541+0000 7f2408111740 10 client.15354 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-31T05:29:27.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.541+0000 7f2408111740 20 client.15354 populate_metadata read hostname 'smithi005' 2024-08-31T05:29:27.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.541+0000 7f2408111740 1 --2- 172.21.15.5:0/486514558 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55dab22488e0 0x55dab264d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:27.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.541+0000 7f2408111740 4 client.15354 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:29:27.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.541+0000 7f2408111740 1 -- 172.21.15.5:0/486514558 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dab25a8340 con 0x55dab22488e0 2024-08-31T05:29:27.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.541+0000 7f23f2ffd640 1 --2- 172.21.15.5:0/486514558 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55dab22488e0 0x55dab264d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:27.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.542+0000 7f23f2ffd640 1 --2- 172.21.15.5:0/486514558 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55dab22488e0 0x55dab264d200 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f27a0a008a68f080 server_cookie=90daa24ac041aacf in_seq=0 out_seq=0 2024-08-31T05:29:27.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.542+0000 7f23daffd640 10 client.15354 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:29:27.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.543+0000 7f23daffd640 1 -- 172.21.15.5:0/486514558 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dab25a8340 con 0x55dab22488e0 2024-08-31T05:29:27.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.543+0000 7f23daffd640 10 client.15354 handle_command_reply: tid=0 2024-08-31T05:29:27.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.543+0000 7f2408111740 1 client.15354 shutdown 2024-08-31T05:29:27.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.543+0000 7f2408111740 1 -- 172.21.15.5:0/486514558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dab2269280 msgr2=0x55dab263b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:27.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.543+0000 7f2408111740 1 --2- 172.21.15.5:0/486514558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dab2269280 0x55dab263b3d0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f23ec00b9d0 tx=0x7f23ec01a460 comp rx=0 tx=0).stop 2024-08-31T05:29:27.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.543+0000 7f2408111740 1 -- 172.21.15.5:0/486514558 shutdown_connections 2024-08-31T05:29:27.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.543+0000 7f2408111740 1 --2- 172.21.15.5:0/486514558 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55dab22488e0 0x55dab264d200 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:27.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.543+0000 7f2408111740 1 --2- 172.21.15.5:0/486514558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dab2289f60 0x55dab2647280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:27.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.543+0000 7f2408111740 1 --2- 172.21.15.5:0/486514558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dab2269280 0x55dab263b3d0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:27.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.543+0000 7f23daffd640 0 client.15354 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:29:27.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.543+0000 7f2408111740 1 --2- 172.21.15.5:0/486514558 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dab22610a0 0x55dab263ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:27.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.543+0000 7f2408111740 1 -- 172.21.15.5:0/486514558 >> 172.21.15.5:0/486514558 conn(0x55dab227e350 msgr2=0x55dab2632990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:27.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.543+0000 7f2408111740 1 -- 172.21.15.5:0/486514558 shutdown_connections 2024-08-31T05:29:27.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.543+0000 7f2408111740 1 -- 172.21.15.5:0/486514558 wait complete. 2024-08-31T05:29:27.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.543+0000 7f2408111740 20 client.15354 trim_cache size 0 max 16384 2024-08-31T05:29:27.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.561+0000 7f2408111740 1 Processor -- start 2024-08-31T05:29:27.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.561+0000 7f2408111740 1 -- start start 2024-08-31T05:29:27.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.561+0000 7f2408111740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dab22488e0 0x55dab26471f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:27.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.562+0000 7f2408111740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dab22610a0 0x55dab2639710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:27.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.562+0000 7f2408111740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dab2269280 0x55dab2639c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:27.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.562+0000 7f2408111740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55dab264b540 con 0x55dab22610a0 2024-08-31T05:29:27.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.562+0000 7f2408111740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55dab264bc10 con 0x55dab2269280 2024-08-31T05:29:27.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.562+0000 7f2408111740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55dab264c2e0 con 0x55dab22488e0 2024-08-31T05:29:27.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.562+0000 7f23fb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dab22610a0 0x55dab2639710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:27.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.562+0000 7f23fb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dab22610a0 0x55dab2639710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36362/0 (socket says 172.21.15.5:36362) 2024-08-31T05:29:27.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.562+0000 7f23fb7fe640 1 -- 172.21.15.5:0/3424289084 learned_addr learned my addr 172.21.15.5:0/3424289084 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:27.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.562+0000 7f23f2ffd640 1 --2- 172.21.15.5:0/3424289084 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dab2269280 0x55dab2639c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:27.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.562+0000 7f23f2ffd640 1 --2- 172.21.15.5:0/3424289084 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dab22488e0 0x55dab26471f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:27.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.562+0000 7f23fb7fe640 1 -- 172.21.15.5:0/3424289084 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dab22488e0 msgr2=0x55dab26471f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:27.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.562+0000 7f23fb7fe640 1 --2- 172.21.15.5:0/3424289084 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dab22488e0 0x55dab26471f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:27.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.562+0000 7f23fb7fe640 1 -- 172.21.15.5:0/3424289084 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dab2269280 msgr2=0x55dab2639c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:27.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.562+0000 7f23fb7fe640 1 --2- 172.21.15.5:0/3424289084 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dab2269280 0x55dab2639c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:27.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.562+0000 7f23fb7fe640 1 -- 172.21.15.5:0/3424289084 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dab263d5d0 con 0x55dab22610a0 2024-08-31T05:29:27.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.562+0000 7f23f2ffd640 1 --2- 172.21.15.5:0/3424289084 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dab2269280 0x55dab2639c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:29:27.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.562+0000 7f23fb7fe640 1 --2- 172.21.15.5:0/3424289084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dab22610a0 0x55dab2639710 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f23ec004dd0 tx=0x7f23ec005f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3da93bbb6cb628e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:27.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.562+0000 7f23f17fa640 1 -- 172.21.15.5:0/3424289084 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23ec038070 con 0x55dab22610a0 2024-08-31T05:29:27.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.562+0000 7f23f17fa640 1 -- 172.21.15.5:0/3424289084 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f23ec00fc30 con 0x55dab22610a0 2024-08-31T05:29:27.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.562+0000 7f23f17fa640 1 -- 172.21.15.5:0/3424289084 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23ec028070 con 0x55dab22610a0 2024-08-31T05:29:27.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.563+0000 7f2408111740 1 -- 172.21.15.5:0/3424289084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dab22610a0 msgr2=0x55dab2639710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:27.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.563+0000 7f2408111740 1 --2- 172.21.15.5:0/3424289084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dab22610a0 0x55dab2639710 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f23ec004dd0 tx=0x7f23ec005f30 comp rx=0 tx=0).stop 2024-08-31T05:29:27.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.563+0000 7f2408111740 1 -- 172.21.15.5:0/3424289084 shutdown_connections 2024-08-31T05:29:27.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.563+0000 7f2408111740 1 --2- 172.21.15.5:0/3424289084 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dab2269280 0x55dab2639c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:27.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.563+0000 7f2408111740 1 --2- 172.21.15.5:0/3424289084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dab22610a0 0x55dab2639710 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:27.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.563+0000 7f2408111740 1 --2- 172.21.15.5:0/3424289084 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dab22488e0 0x55dab26471f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:27.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.563+0000 7f2408111740 1 -- 172.21.15.5:0/3424289084 >> 172.21.15.5:0/3424289084 conn(0x55dab227e350 msgr2=0x55dab2628400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:27.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.563+0000 7f2408111740 1 -- 172.21.15.5:0/3424289084 shutdown_connections 2024-08-31T05:29:27.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.563+0000 7f2408111740 1 -- 172.21.15.5:0/3424289084 wait complete. 2024-08-31T05:29:27.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.563+0000 7f2408111740 1 -- start start 2024-08-31T05:29:27.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.564+0000 7f2408111740 1 Processor -- start 2024-08-31T05:29:27.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.564+0000 7f2408111740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dab22488e0 0x55dab264ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:27.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.564+0000 7f2408111740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dab22610a0 0x55dab264f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:27.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.564+0000 7f2408111740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dab2269280 0x55dab2654250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:27.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.564+0000 7f2408111740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55dab264d080 con 0x55dab22488e0 2024-08-31T05:29:27.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.564+0000 7f2408111740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55dab264c9b0 con 0x55dab22610a0 2024-08-31T05:29:27.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.564+0000 7f2408111740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55dab264d750 con 0x55dab2269280 2024-08-31T05:29:27.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.564+0000 7f2408111740 10 client.0 _ll_register_callbacks cb 0x7f23ec00bd80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:29:27.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.564+0000 7f23f2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dab22488e0 0x55dab264ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:27.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.564+0000 7f23f2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dab22488e0 0x55dab264ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36372/0 (socket says 172.21.15.5:36372) 2024-08-31T05:29:27.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.564+0000 7f23f2ffd640 1 -- 172.21.15.5:0/3301737505 learned_addr learned my addr 172.21.15.5:0/3301737505 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:27.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.564+0000 7f23fb7fe640 1 --2- 172.21.15.5:0/3301737505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dab22610a0 0x55dab264f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:27.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.565+0000 7f23f2ffd640 1 -- 172.21.15.5:0/3301737505 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dab2269280 msgr2=0x55dab2654250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:27.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.565+0000 7f23f2ffd640 1 --2- 172.21.15.5:0/3301737505 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dab2269280 0x55dab2654250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:27.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.565+0000 7f23f2ffd640 1 -- 172.21.15.5:0/3301737505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dab22610a0 msgr2=0x55dab264f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:27.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.565+0000 7f23f2ffd640 1 --2- 172.21.15.5:0/3301737505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dab22610a0 0x55dab264f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:27.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.565+0000 7f23f2ffd640 1 -- 172.21.15.5:0/3301737505 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dab26548c0 con 0x55dab22488e0 2024-08-31T05:29:27.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.565+0000 7f23fb7fe640 1 --2- 172.21.15.5:0/3301737505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dab22610a0 0x55dab264f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:29:27.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.565+0000 7f23f2ffd640 1 --2- 172.21.15.5:0/3301737505 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dab22488e0 0x55dab264ec50 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f23fc108f10 tx=0x7f23e400fe60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b51c9f077fa995a2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:27.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.565+0000 7f23daffd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:29:27.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.565+0000 7f23daffd640 1 -- 172.21.15.5:0/3301737505 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e4004320 con 0x55dab22488e0 2024-08-31T05:29:27.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.565+0000 7f2408111740 1 -- 172.21.15.5:0/3301737505 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23ec00fc30 con 0x55dab22488e0 2024-08-31T05:29:27.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.565+0000 7f23daffd640 1 -- 172.21.15.5:0/3301737505 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f23e401b040 con 0x55dab22488e0 2024-08-31T05:29:27.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.565+0000 7f23daffd640 1 -- 172.21.15.5:0/3301737505 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f23e402f050 con 0x55dab22488e0 2024-08-31T05:29:27.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.565+0000 7f2408111740 10 client.15360 fetch_fsmap learned FSMap version 29 2024-08-31T05:29:27.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.565+0000 7f2408111740 1 -- 172.21.15.5:0/3301737505 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55dab2655d30 con 0x55dab22488e0 2024-08-31T05:29:27.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.565+0000 7f23daffd640 1 -- 172.21.15.5:0/3301737505 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f23ec00fc30 con 0x55dab22488e0 2024-08-31T05:29:27.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.565+0000 7f23daffd640 1 -- 172.21.15.5:0/3301737505 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f23e4025030 con 0x55dab22488e0 2024-08-31T05:29:27.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.566+0000 7f2408111740 10 client.15360 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T05:29:27.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.566+0000 7f2408111740 10 client.15360 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-31T05:29:27.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.566+0000 7f2408111740 20 client.15360 populate_metadata read hostname 'smithi005' 2024-08-31T05:29:27.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.566+0000 7f2408111740 1 --2- 172.21.15.5:0/3301737505 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55dab2289f60 0x55dab26bb810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:27.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.566+0000 7f2408111740 4 client.15360 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T05:29:27.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.566+0000 7f2408111740 1 -- 172.21.15.5:0/3301737505 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "status"}) -- 0x55dab25a3de0 con 0x55dab2289f60 2024-08-31T05:29:27.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.566+0000 7f23fb7fe640 1 --2- 172.21.15.5:0/3301737505 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55dab2289f60 0x55dab26bb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:27.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.566+0000 7f23fb7fe640 1 --2- 172.21.15.5:0/3301737505 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55dab2289f60 0x55dab26bb810 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1dedc8e754c76ed server_cookie=51f1a872d90ee4e5 in_seq=0 out_seq=0 2024-08-31T05:29:27.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.566+0000 7f23daffd640 10 client.15360 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:29:27.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.566+0000 7f23daffd640 1 -- 172.21.15.5:0/3301737505 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55dab25a3de0 con 0x55dab2289f60 2024-08-31T05:29:27.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.566+0000 7f23daffd640 10 client.15360 handle_command_reply: tid=0 2024-08-31T05:29:27.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.566+0000 7f2408111740 1 client.15360 shutdown 2024-08-31T05:29:27.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.567+0000 7f2408111740 1 -- 172.21.15.5:0/3301737505 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dab22488e0 msgr2=0x55dab264ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:27.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.567+0000 7f2408111740 1 --2- 172.21.15.5:0/3301737505 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dab22488e0 0x55dab264ec50 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f23fc108f10 tx=0x7f23e400fe60 comp rx=0 tx=0).stop 2024-08-31T05:29:27.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.567+0000 7f2408111740 1 -- 172.21.15.5:0/3301737505 shutdown_connections 2024-08-31T05:29:27.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.567+0000 7f2408111740 1 --2- 172.21.15.5:0/3301737505 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55dab2289f60 0x55dab26bb810 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:27.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.567+0000 7f2408111740 1 --2- 172.21.15.5:0/3301737505 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dab2269280 0x55dab2654250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:27.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.567+0000 7f2408111740 1 --2- 172.21.15.5:0/3301737505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dab22610a0 0x55dab264f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:27.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.567+0000 7f23daffd640 0 client.15360 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:29:27.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.567+0000 7f2408111740 1 --2- 172.21.15.5:0/3301737505 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dab22488e0 0x55dab264ec50 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:27.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.567+0000 7f2408111740 1 -- 172.21.15.5:0/3301737505 >> 172.21.15.5:0/3301737505 conn(0x55dab227e350 msgr2=0x55dab263ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:27.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.567+0000 7f2408111740 1 -- 172.21.15.5:0/3301737505 shutdown_connections 2024-08-31T05:29:27.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.567+0000 7f2408111740 1 -- 172.21.15.5:0/3301737505 wait complete. 2024-08-31T05:29:27.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.567+0000 7f2408111740 20 client.15360 trim_cache size 0 max 16384 2024-08-31T05:29:27.575 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:29:27.576 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "69422704-6758-11ef-bcd4-c7b262605968", 2024-08-31T05:29:27.576 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-08-31T05:29:27.576 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 24652, 2024-08-31T05:29:27.576 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-08-31T05:29:27.576 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-08-31T05:29:27.576 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-08-31T05:29:27.576 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 115.315768322, 2024-08-31T05:29:27.576 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 29, 2024-08-31T05:29:27.576 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 87, 2024-08-31T05:29:27.576 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 85, 2024-08-31T05:29:27.576 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 135.19996440099999 2024-08-31T05:29:27.576 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:29:27.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.568+0000 7f2401b9c640 1 -- 172.21.15.5:0/342195475 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f23e80b4c10 msgr2=0x7f23e80b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:27.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.568+0000 7f2401b9c640 1 --2- 172.21.15.5:0/342195475 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f23e80b4c10 0x7f23e80b7120 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f23f404d000 tx=0x7f23f4099040 comp rx=0 tx=0).stop 2024-08-31T05:29:27.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.568+0000 7f2401b9c640 1 -- 172.21.15.5:0/342195475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23fc109b90 msgr2=0x7f23fc075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:27.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.568+0000 7f2401b9c640 1 --2- 172.21.15.5:0/342195475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23fc109b90 0x7f23fc075f30 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f23f40098d0 tx=0x7f23f40317b0 comp rx=0 tx=0).stop 2024-08-31T05:29:27.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.568+0000 7f2401b9c640 1 -- 172.21.15.5:0/342195475 shutdown_connections 2024-08-31T05:29:27.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.568+0000 7f2401b9c640 1 --2- 172.21.15.5:0/342195475 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f23e80b4c10 0x7f23e80b7120 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:27.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.568+0000 7f2401b9c640 1 --2- 172.21.15.5:0/342195475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23fc109b90 0x7f23fc075f30 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:27.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.568+0000 7f2401b9c640 1 --2- 172.21.15.5:0/342195475 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23fc109240 0x7f23fc0759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:27.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.568+0000 7f2401b9c640 1 --2- 172.21.15.5:0/342195475 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23fc103900 0x7f23fc0754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:27.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.568+0000 7f2401b9c640 1 -- 172.21.15.5:0/342195475 >> 172.21.15.5:0/342195475 conn(0x7f23fc07b5f0 msgr2=0x7f23fc107230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:27.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.568+0000 7f2401b9c640 1 -- 172.21.15.5:0/342195475 shutdown_connections 2024-08-31T05:29:27.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:27.568+0000 7f2401b9c640 1 -- 172.21.15.5:0/342195475 wait complete. 2024-08-31T05:29:27.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:27 smithi070 ceph-mon[22316]: pgmap v329: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-08-31T05:29:27.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:27 smithi050 ceph-mon[22146]: pgmap v329: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-08-31T05:29:28.393 INFO:tasks.cephadm:Setup complete, yielding 2024-08-31T05:29:28.393 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-31T05:29:28.403 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi005.front.sepia.ceph.com 2024-08-31T05:29:28.403 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- bash -c 'ceph orch status' 2024-08-31T05:29:28.655 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:29:29.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.167+0000 7f3415d71640 1 -- 172.21.15.5:0/395039890 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3410108270 msgr2=0x7f341010eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:29.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.167+0000 7f3415d71640 1 --2- 172.21.15.5:0/395039890 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3410108270 0x7f341010eaa0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3408009ca0 tx=0x7f340802a8c0 comp rx=0 tx=0).stop 2024-08-31T05:29:29.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.167+0000 7f3415d71640 1 -- 172.21.15.5:0/395039890 shutdown_connections 2024-08-31T05:29:29.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.167+0000 7f3415d71640 1 --2- 172.21.15.5:0/395039890 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3410108270 0x7f341010eaa0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:29.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.167+0000 7f3415d71640 1 --2- 172.21.15.5:0/395039890 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3410107920 0x7f3410107d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:29.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.167+0000 7f3415d71640 1 --2- 172.21.15.5:0/395039890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3410101fe0 0x7f34101023f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:29.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.167+0000 7f3415d71640 1 -- 172.21.15.5:0/395039890 >> 172.21.15.5:0/395039890 conn(0x7f3410079d30 msgr2=0x7f341007a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:29.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.167+0000 7f3415d71640 1 -- 172.21.15.5:0/395039890 shutdown_connections 2024-08-31T05:29:29.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.167+0000 7f3415d71640 1 -- 172.21.15.5:0/395039890 wait complete. 2024-08-31T05:29:29.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.168+0000 7f3415d71640 1 Processor -- start 2024-08-31T05:29:29.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.168+0000 7f3415d71640 1 -- start start 2024-08-31T05:29:29.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.168+0000 7f3415d71640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3410101fe0 0x7f3410199100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:29.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.168+0000 7f3415d71640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3410107920 0x7f34101996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:29.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.168+0000 7f3415d71640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3410108270 0x7f341019e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:29.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.168+0000 7f3415d71640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f34101127b0 con 0x7f3410108270 2024-08-31T05:29:29.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.168+0000 7f3415d71640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3410112630 con 0x7f3410107920 2024-08-31T05:29:29.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.168+0000 7f3415d71640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3410112930 con 0x7f3410101fe0 2024-08-31T05:29:29.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.168+0000 7f340ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3410108270 0x7f341019e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:29.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.168+0000 7f340ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3410108270 0x7f341019e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36392/0 (socket says 172.21.15.5:36392) 2024-08-31T05:29:29.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.168+0000 7f340ffff640 1 -- 172.21.15.5:0/3308136928 learned_addr learned my addr 172.21.15.5:0/3308136928 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:29.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.168+0000 7f340effd640 1 --2- 172.21.15.5:0/3308136928 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3410107920 0x7f34101996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:29.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.168+0000 7f340f7fe640 1 --2- 172.21.15.5:0/3308136928 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3410101fe0 0x7f3410199100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:29.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.169+0000 7f340ffff640 1 -- 172.21.15.5:0/3308136928 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3410101fe0 msgr2=0x7f3410199100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:29.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.169+0000 7f340ffff640 1 --2- 172.21.15.5:0/3308136928 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3410101fe0 0x7f3410199100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:29.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.169+0000 7f340ffff640 1 -- 172.21.15.5:0/3308136928 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3410107920 msgr2=0x7f34101996a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:29.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.169+0000 7f340ffff640 1 --2- 172.21.15.5:0/3308136928 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3410107920 0x7f34101996a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:29.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.169+0000 7f340ffff640 1 -- 172.21.15.5:0/3308136928 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f341019f070 con 0x7f3410108270 2024-08-31T05:29:29.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.169+0000 7f340f7fe640 1 --2- 172.21.15.5:0/3308136928 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3410101fe0 0x7f3410199100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:29:29.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.169+0000 7f340ffff640 1 --2- 172.21.15.5:0/3308136928 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3410108270 0x7f341019e940 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f3408005cc0 tx=0x7f34080319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:29.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.169+0000 7f340cff9640 1 -- 172.21.15.5:0/3308136928 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f340804a070 con 0x7f3410108270 2024-08-31T05:29:29.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.169+0000 7f3415d71640 1 -- 172.21.15.5:0/3308136928 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f341019f300 con 0x7f3410108270 2024-08-31T05:29:29.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.169+0000 7f340cff9640 1 -- 172.21.15.5:0/3308136928 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3408003b80 con 0x7f3410108270 2024-08-31T05:29:29.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.169+0000 7f340cff9640 1 -- 172.21.15.5:0/3308136928 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f340802f990 con 0x7f3410108270 2024-08-31T05:29:29.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.169+0000 7f3415d71640 1 -- 172.21.15.5:0/3308136928 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f341010f460 con 0x7f3410108270 2024-08-31T05:29:29.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.170+0000 7f3415d71640 1 -- 172.21.15.5:0/3308136928 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3410103260 con 0x7f3410108270 2024-08-31T05:29:29.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.172+0000 7f340cff9640 1 -- 172.21.15.5:0/3308136928 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 21) ==== 152644+0+0 (secure 0 0 0) 0x7f340804d070 con 0x7f3410108270 2024-08-31T05:29:29.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.172+0000 7f340cff9640 1 --2- 172.21.15.5:0/3308136928 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f33f80b4c10 0x7f33f80b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:29.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.173+0000 7f340f7fe640 1 --2- 172.21.15.5:0/3308136928 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f33f80b4c10 0x7f33f80b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:29.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.173+0000 7f340cff9640 1 -- 172.21.15.5:0/3308136928 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f3408107fc0 con 0x7f3410108270 2024-08-31T05:29:29.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.173+0000 7f340f7fe640 1 --2- 172.21.15.5:0/3308136928 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f33f80b4c10 0x7f33f80b7120 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f34000058c0 tx=0x7f3400005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:29.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.176+0000 7f340cff9640 1 -- 172.21.15.5:0/3308136928 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f3408084130 con 0x7f3410108270 2024-08-31T05:29:29.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.378+0000 7f3415d71640 1 -- 172.21.15.5:0/3308136928 --> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f341010f6c0 con 0x7f33f80b4c10 2024-08-31T05:29:29.381 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:29 smithi005 ceph-mon[18602]: pgmap v330: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-31T05:29:29.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.380+0000 7f340cff9640 1 -- 172.21.15.5:0/3308136928 <== mgr.14220 v2:172.21.15.5:6800/2696053609 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f341010f6c0 con 0x7f33f80b4c10 2024-08-31T05:29:29.382 INFO:teuthology.orchestra.run.smithi005.stdout:Backend: cephadm 2024-08-31T05:29:29.382 INFO:teuthology.orchestra.run.smithi005.stdout:Available: Yes 2024-08-31T05:29:29.382 INFO:teuthology.orchestra.run.smithi005.stdout:Paused: No 2024-08-31T05:29:29.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.382+0000 7f3415d71640 1 -- 172.21.15.5:0/3308136928 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f33f80b4c10 msgr2=0x7f33f80b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:29.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.382+0000 7f3415d71640 1 --2- 172.21.15.5:0/3308136928 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f33f80b4c10 0x7f33f80b7120 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f34000058c0 tx=0x7f3400005850 comp rx=0 tx=0).stop 2024-08-31T05:29:29.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.382+0000 7f3415d71640 1 -- 172.21.15.5:0/3308136928 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3410108270 msgr2=0x7f341019e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:29.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.382+0000 7f3415d71640 1 --2- 172.21.15.5:0/3308136928 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3410108270 0x7f341019e940 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f3408005cc0 tx=0x7f34080319f0 comp rx=0 tx=0).stop 2024-08-31T05:29:29.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.382+0000 7f3415d71640 1 -- 172.21.15.5:0/3308136928 shutdown_connections 2024-08-31T05:29:29.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.382+0000 7f3415d71640 1 --2- 172.21.15.5:0/3308136928 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f33f80b4c10 0x7f33f80b7120 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:29.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.382+0000 7f3415d71640 1 --2- 172.21.15.5:0/3308136928 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3410108270 0x7f341019e940 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:29.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.382+0000 7f3415d71640 1 --2- 172.21.15.5:0/3308136928 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3410107920 0x7f34101996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:29.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.382+0000 7f3415d71640 1 --2- 172.21.15.5:0/3308136928 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3410101fe0 0x7f3410199100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:29.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.382+0000 7f3415d71640 1 -- 172.21.15.5:0/3308136928 >> 172.21.15.5:0/3308136928 conn(0x7f3410079d30 msgr2=0x7f3410103890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:29.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.382+0000 7f3415d71640 1 -- 172.21.15.5:0/3308136928 shutdown_connections 2024-08-31T05:29:29.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:29.382+0000 7f3415d71640 1 -- 172.21.15.5:0/3308136928 wait complete. 2024-08-31T05:29:29.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:29 smithi070 ceph-mon[22316]: pgmap v330: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-31T05:29:29.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:29 smithi050 ceph-mon[22146]: pgmap v330: 129 pgs: 129 active+clean; 644 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-31T05:29:30.019 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- bash -c 'ceph orch ps' 2024-08-31T05:29:30.276 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:29:30.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:30.776+0000 7f238f25c640 1 -- 172.21.15.5:0/2691299561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2388103900 msgr2=0x7f2388103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:30.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:30.776+0000 7f238f25c640 1 --2- 172.21.15.5:0/2691299561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2388103900 0x7f2388103d10 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f237c009900 tx=0x7f237c02a410 comp rx=0 tx=0).stop 2024-08-31T05:29:30.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:30.776+0000 7f238f25c640 1 -- 172.21.15.5:0/2691299561 shutdown_connections 2024-08-31T05:29:30.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:30.776+0000 7f238f25c640 1 --2- 172.21.15.5:0/2691299561 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2388109b90 0x7f23881103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:30.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:30.776+0000 7f238f25c640 1 --2- 172.21.15.5:0/2691299561 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2388109240 0x7f2388109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:30.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:30.776+0000 7f238f25c640 1 --2- 172.21.15.5:0/2691299561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2388103900 0x7f2388103d10 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:30.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:30.776+0000 7f238f25c640 1 -- 172.21.15.5:0/2691299561 >> 172.21.15.5:0/2691299561 conn(0x7f238807b5f0 msgr2=0x7f238807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:30.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:30.777+0000 7f238f25c640 1 -- 172.21.15.5:0/2691299561 shutdown_connections 2024-08-31T05:29:30.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:30.777+0000 7f238f25c640 1 -- 172.21.15.5:0/2691299561 wait complete. 2024-08-31T05:29:30.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:30.777+0000 7f238f25c640 1 Processor -- start 2024-08-31T05:29:30.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:30.777+0000 7f238f25c640 1 -- start start 2024-08-31T05:29:30.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:30.777+0000 7f238f25c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2388103900 0x7f23880754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:30.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:30.778+0000 7f238f25c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2388109240 0x7f23880759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:30.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:30.778+0000 7f238f25c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2388109b90 0x7f2388075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:30.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:30.778+0000 7f238f25c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2388113850 con 0x7f2388109240 2024-08-31T05:29:30.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:30.778+0000 7f238f25c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f23881136d0 con 0x7f2388103900 2024-08-31T05:29:30.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:30.778+0000 7f238f25c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f23881139d0 con 0x7f2388109b90 2024-08-31T05:29:30.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:30.778+0000 7f2387fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2388109240 0x7f23880759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:30.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:30.778+0000 7f2387fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2388109240 0x7f23880759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36422/0 (socket says 172.21.15.5:36422) 2024-08-31T05:29:30.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:30.778+0000 7f238cff8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2388103900 0x7f23880754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:30.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:30.778+0000 7f2387fff640 1 -- 172.21.15.5:0/2913498065 learned_addr learned my addr 172.21.15.5:0/2913498065 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:30.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:30.778+0000 7f238d7f9640 1 --2- 172.21.15.5:0/2913498065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2388109b90 0x7f2388075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:30.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:30.778+0000 7f2387fff640 1 -- 172.21.15.5:0/2913498065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2388109b90 msgr2=0x7f2388075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:30.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:30.778+0000 7f2387fff640 1 --2- 172.21.15.5:0/2913498065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2388109b90 0x7f2388075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:30.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:30.778+0000 7f2387fff640 1 -- 172.21.15.5:0/2913498065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2388103900 msgr2=0x7f23880754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:30.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:30.778+0000 7f2387fff640 1 --2- 172.21.15.5:0/2913498065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2388103900 0x7f23880754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:30.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:30.778+0000 7f2387fff640 1 -- 172.21.15.5:0/2913498065 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23881a84b0 con 0x7f2388109240 2024-08-31T05:29:30.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:30.778+0000 7f2387fff640 1 --2- 172.21.15.5:0/2913498065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2388109240 0x7f23880759f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f237400d740 tx=0x7f237400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:30.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:30.778+0000 7f2385ffb640 1 -- 172.21.15.5:0/2913498065 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2374017070 con 0x7f2388109240 2024-08-31T05:29:30.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:30.778+0000 7f2385ffb640 1 -- 172.21.15.5:0/2913498065 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f237400de50 con 0x7f2388109240 2024-08-31T05:29:30.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:30.778+0000 7f238f25c640 1 -- 172.21.15.5:0/2913498065 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23881a87a0 con 0x7f2388109240 2024-08-31T05:29:30.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:30.778+0000 7f2385ffb640 1 -- 172.21.15.5:0/2913498065 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f237400f620 con 0x7f2388109240 2024-08-31T05:29:30.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:30.779+0000 7f238f25c640 1 -- 172.21.15.5:0/2913498065 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23881a8ce0 con 0x7f2388109240 2024-08-31T05:29:30.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:30.780+0000 7f238f25c640 1 -- 172.21.15.5:0/2913498065 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2388103d10 con 0x7f2388109240 2024-08-31T05:29:30.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:30.781+0000 7f2385ffb640 1 -- 172.21.15.5:0/2913498065 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) ==== 152593+0+0 (secure 0 0 0) 0x7f237401a070 con 0x7f2388109240 2024-08-31T05:29:30.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:30.782+0000 7f2385ffb640 1 --2- 172.21.15.5:0/2913498065 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f23780b4b80 0x7f23780b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:30.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:30.782+0000 7f2385ffb640 1 -- 172.21.15.5:0/2913498065 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f23740e5040 con 0x7f2388109240 2024-08-31T05:29:30.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:30.782+0000 7f238cff8640 1 --2- 172.21.15.5:0/2913498065 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f23780b4b80 0x7f23780b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:30.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:30.782+0000 7f238cff8640 1 --2- 172.21.15.5:0/2913498065 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f23780b4b80 0x7f23780b7090 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f237c000c00 tx=0x7f237c031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:30.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:30.785+0000 7f2385ffb640 1 -- 172.21.15.5:0/2913498065 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f23740abcd0 con 0x7f2388109240 2024-08-31T05:29:30.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:30.980+0000 7f238f25c640 1 -- 172.21.15.5:0/2913498065 --> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f23880635a0 con 0x7f23780b4b80 2024-08-31T05:29:30.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:30.993+0000 7f2385ffb640 1 -- 172.21.15.5:0/2913498065 <== mgr.14220 v2:172.21.15.5:6800/2696053609 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4123 (secure 0 0 0) 0x7f23880635a0 con 0x7f23780b4b80 2024-08-31T05:29:30.995 INFO:teuthology.orchestra.run.smithi005.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-31T05:29:30.995 INFO:teuthology.orchestra.run.smithi005.stdout:mds.a smithi005 running (2m) 60s ago 2m 83.5M - 19.3.0-4560-gd19e6118 79f4cde5e369 b2adead453e7 2024-08-31T05:29:30.995 INFO:teuthology.orchestra.run.smithi005.stdout:mds.b smithi050 running (2m) 61s ago 2m 85.0M - 19.3.0-4560-gd19e6118 79f4cde5e369 415dd5033240 2024-08-31T05:29:30.995 INFO:teuthology.orchestra.run.smithi005.stdout:mds.c smithi070 running (2m) 61s ago 2m 86.9M - 19.3.0-4560-gd19e6118 79f4cde5e369 94cd21a2ad6f 2024-08-31T05:29:30.995 INFO:teuthology.orchestra.run.smithi005.stdout:mds.d smithi005 running (2m) 60s ago 2m 81.5M - 19.3.0-4560-gd19e6118 79f4cde5e369 abe2903c3fbc 2024-08-31T05:29:30.995 INFO:teuthology.orchestra.run.smithi005.stdout:mds.e smithi050 running (2m) 61s ago 2m 86.8M - 19.3.0-4560-gd19e6118 79f4cde5e369 d52661ba868e 2024-08-31T05:29:30.995 INFO:teuthology.orchestra.run.smithi005.stdout:mds.f smithi070 running (2m) 61s ago 2m 87.6M - 19.3.0-4560-gd19e6118 79f4cde5e369 5ec2d22fd65e 2024-08-31T05:29:30.995 INFO:teuthology.orchestra.run.smithi005.stdout:mds.g smithi005 running (2m) 60s ago 2m 82.6M - 19.3.0-4560-gd19e6118 79f4cde5e369 1b9c96280683 2024-08-31T05:29:30.996 INFO:teuthology.orchestra.run.smithi005.stdout:mds.h smithi050 running (2m) 61s ago 2m 84.2M - 19.3.0-4560-gd19e6118 79f4cde5e369 fb36ada1d4ac 2024-08-31T05:29:30.996 INFO:teuthology.orchestra.run.smithi005.stdout:mds.i smithi070 running (2m) 61s ago 2m 93.3M - 19.3.0-4560-gd19e6118 79f4cde5e369 56cfe73b724b 2024-08-31T05:29:30.996 INFO:teuthology.orchestra.run.smithi005.stdout:mds.j smithi005 running (2m) 60s ago 2m 81.2M - 19.3.0-4560-gd19e6118 79f4cde5e369 79c435f3a5b9 2024-08-31T05:29:30.996 INFO:teuthology.orchestra.run.smithi005.stdout:mds.k smithi050 running (2m) 61s ago 2m 83.7M - 19.3.0-4560-gd19e6118 79f4cde5e369 7dea81a4f4a0 2024-08-31T05:29:30.996 INFO:teuthology.orchestra.run.smithi005.stdout:mds.l smithi070 running (2m) 61s ago 2m 85.8M - 19.3.0-4560-gd19e6118 79f4cde5e369 4fff19ffe3ca 2024-08-31T05:29:30.996 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.x smithi005 *:9283,8765 running (10m) 60s ago 10m 586M - 19.3.0-4560-gd19e6118 79f4cde5e369 4ade1cc1f01f 2024-08-31T05:29:30.996 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.y smithi050 *:8443,8765 running (8m) 61s ago 8m 523M - 19.3.0-4560-gd19e6118 79f4cde5e369 8582941710f5 2024-08-31T05:29:30.996 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.z smithi070 *:8443,8765 running (8m) 61s ago 8m 526M - 19.3.0-4560-gd19e6118 79f4cde5e369 ffd858e28eb8 2024-08-31T05:29:30.996 INFO:teuthology.orchestra.run.smithi005.stdout:mon.a smithi005 running (10m) 60s ago 10m 119M 2048M 19.3.0-4560-gd19e6118 79f4cde5e369 d301a3f56d33 2024-08-31T05:29:30.996 INFO:teuthology.orchestra.run.smithi005.stdout:mon.b smithi050 running (8m) 61s ago 8m 111M 2048M 19.3.0-4560-gd19e6118 79f4cde5e369 26076fc1617a 2024-08-31T05:29:30.996 INFO:teuthology.orchestra.run.smithi005.stdout:mon.c smithi070 running (8m) 61s ago 8m 111M 2048M 19.3.0-4560-gd19e6118 79f4cde5e369 d0d29cc757a2 2024-08-31T05:29:30.996 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 smithi005 running (7m) 60s ago 7m 126M 4273M 19.3.0-4560-gd19e6118 79f4cde5e369 a600f2f532a9 2024-08-31T05:29:30.997 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 smithi050 running (7m) 61s ago 7m 123M 4273M 19.3.0-4560-gd19e6118 79f4cde5e369 14a2fa755edd 2024-08-31T05:29:30.997 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 smithi070 running (6m) 61s ago 6m 125M 4272M 19.3.0-4560-gd19e6118 79f4cde5e369 42bceb64a815 2024-08-31T05:29:30.997 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 smithi005 running (6m) 60s ago 6m 122M 4273M 19.3.0-4560-gd19e6118 79f4cde5e369 5a43aaca11d2 2024-08-31T05:29:30.997 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 smithi050 running (6m) 61s ago 6m 111M 4273M 19.3.0-4560-gd19e6118 79f4cde5e369 7c99cca641ec 2024-08-31T05:29:30.997 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 smithi070 running (5m) 61s ago 5m 122M 4272M 19.3.0-4560-gd19e6118 79f4cde5e369 7e2b77e6e86b 2024-08-31T05:29:30.997 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6 smithi005 running (5m) 60s ago 5m 112M 4273M 19.3.0-4560-gd19e6118 79f4cde5e369 6d6d836774ba 2024-08-31T05:29:30.997 INFO:teuthology.orchestra.run.smithi005.stdout:osd.7 smithi050 running (4m) 61s ago 4m 111M 4273M 19.3.0-4560-gd19e6118 79f4cde5e369 966af6bada14 2024-08-31T05:29:30.998 INFO:teuthology.orchestra.run.smithi005.stdout:osd.8 smithi070 running (4m) 61s ago 4m 112M 4272M 19.3.0-4560-gd19e6118 79f4cde5e369 56c51196fdfd 2024-08-31T05:29:30.998 INFO:teuthology.orchestra.run.smithi005.stdout:osd.9 smithi005 running (3m) 60s ago 3m 124M 4273M 19.3.0-4560-gd19e6118 79f4cde5e369 bf4fdfcd9419 2024-08-31T05:29:30.998 INFO:teuthology.orchestra.run.smithi005.stdout:osd.10 smithi050 running (3m) 61s ago 3m 121M 4273M 19.3.0-4560-gd19e6118 79f4cde5e369 d873c919450a 2024-08-31T05:29:30.998 INFO:teuthology.orchestra.run.smithi005.stdout:osd.11 smithi070 running (3m) 61s ago 3m 119M 4272M 19.3.0-4560-gd19e6118 79f4cde5e369 f4fd1dfee83c 2024-08-31T05:29:30.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:30.995+0000 7f238f25c640 1 -- 172.21.15.5:0/2913498065 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f23780b4b80 msgr2=0x7f23780b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:30.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:30.995+0000 7f238f25c640 1 --2- 172.21.15.5:0/2913498065 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f23780b4b80 0x7f23780b7090 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f237c000c00 tx=0x7f237c031400 comp rx=0 tx=0).stop 2024-08-31T05:29:30.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:30.995+0000 7f238f25c640 1 -- 172.21.15.5:0/2913498065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2388109240 msgr2=0x7f23880759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:30.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:30.995+0000 7f238f25c640 1 --2- 172.21.15.5:0/2913498065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2388109240 0x7f23880759f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f237400d740 tx=0x7f237400dc00 comp rx=0 tx=0).stop 2024-08-31T05:29:30.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:30.995+0000 7f238f25c640 1 -- 172.21.15.5:0/2913498065 shutdown_connections 2024-08-31T05:29:30.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:30.995+0000 7f238f25c640 1 --2- 172.21.15.5:0/2913498065 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f23780b4b80 0x7f23780b7090 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:30.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:30.995+0000 7f238f25c640 1 --2- 172.21.15.5:0/2913498065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2388109b90 0x7f2388075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:30.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:30.995+0000 7f238f25c640 1 --2- 172.21.15.5:0/2913498065 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2388109240 0x7f23880759f0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:30.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:30.995+0000 7f238f25c640 1 --2- 172.21.15.5:0/2913498065 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2388103900 0x7f23880754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:30.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:30.995+0000 7f238f25c640 1 -- 172.21.15.5:0/2913498065 >> 172.21.15.5:0/2913498065 conn(0x7f238807b5f0 msgr2=0x7f2388107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:30.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:30.995+0000 7f238f25c640 1 -- 172.21.15.5:0/2913498065 shutdown_connections 2024-08-31T05:29:31.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:30.995+0000 7f238f25c640 1 -- 172.21.15.5:0/2913498065 wait complete. 2024-08-31T05:29:31.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:31 smithi070 ceph-mon[22316]: from='client.15366 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:31.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:31 smithi070 ceph-mon[22316]: pgmap v331: 129 pgs: 129 active+clean; 645 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 426 B/s wr, 12 op/s 2024-08-31T05:29:31.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:31 smithi070 ceph-mon[22316]: mgrmap e22: x(active, since 8m), standbys: z, y 2024-08-31T05:29:31.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:31 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:29:31.643 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:31 smithi005 ceph-mon[18602]: from='client.15366 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:31.643 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:31 smithi005 ceph-mon[18602]: pgmap v331: 129 pgs: 129 active+clean; 645 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 426 B/s wr, 12 op/s 2024-08-31T05:29:31.643 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:31 smithi005 ceph-mon[18602]: mgrmap e22: x(active, since 8m), standbys: z, y 2024-08-31T05:29:31.643 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:31 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:29:31.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:31 smithi050 ceph-mon[22146]: from='client.15366 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:31.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:31 smithi050 ceph-mon[22146]: pgmap v331: 129 pgs: 129 active+clean; 645 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 426 B/s wr, 12 op/s 2024-08-31T05:29:31.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:31 smithi050 ceph-mon[22146]: mgrmap e22: x(active, since 8m), standbys: z, y 2024-08-31T05:29:31.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:31 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:29:31.669 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- bash -c 'ceph orch ls' 2024-08-31T05:29:32.331 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:32 smithi005 ceph-mon[18602]: from='client.15372 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:32.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:32 smithi050 ceph-mon[22146]: from='client.15372 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:32.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:32 smithi070 ceph-mon[22316]: from='client.15372 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:32.597 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:29:33.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.109+0000 7fa4cc0bc640 1 -- 172.21.15.5:0/4197809752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4c410ff20 msgr2=0x7fa4c4112340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:33.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.109+0000 7fa4cc0bc640 1 --2- 172.21.15.5:0/4197809752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4c410ff20 0x7fa4c4112340 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc009ca0 tx=0x7fa4bc02a950 comp rx=0 tx=0).stop 2024-08-31T05:29:33.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.109+0000 7fa4cc0bc640 1 -- 172.21.15.5:0/4197809752 shutdown_connections 2024-08-31T05:29:33.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.109+0000 7fa4cc0bc640 1 --2- 172.21.15.5:0/4197809752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4c410ff20 0x7fa4c4112340 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:33.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.109+0000 7fa4cc0bc640 1 --2- 172.21.15.5:0/4197809752 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa4c4102cc0 0x7fa4c410f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:33.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.109+0000 7fa4cc0bc640 1 --2- 172.21.15.5:0/4197809752 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4c4102370 0x7fa4c4102780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:33.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.109+0000 7fa4cc0bc640 1 -- 172.21.15.5:0/4197809752 >> 172.21.15.5:0/4197809752 conn(0x7fa4c40794d0 msgr2=0x7fa4c40798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:33.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.109+0000 7fa4cc0bc640 1 -- 172.21.15.5:0/4197809752 shutdown_connections 2024-08-31T05:29:33.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.109+0000 7fa4cc0bc640 1 -- 172.21.15.5:0/4197809752 wait complete. 2024-08-31T05:29:33.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.110+0000 7fa4cc0bc640 1 Processor -- start 2024-08-31T05:29:33.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.110+0000 7fa4cc0bc640 1 -- start start 2024-08-31T05:29:33.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.110+0000 7fa4cc0bc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4c4102370 0x7fa4c419c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:33.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.110+0000 7fa4cc0bc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa4c4102cc0 0x7fa4c419c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:33.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.110+0000 7fa4cc0bc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4c410ff20 0x7fa4c41a1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:33.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.110+0000 7fa4cc0bc640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c4115a10 con 0x7fa4c410ff20 2024-08-31T05:29:33.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.110+0000 7fa4cc0bc640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c4115890 con 0x7fa4c4102370 2024-08-31T05:29:33.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.110+0000 7fa4cc0bc640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c4115b90 con 0x7fa4c4102cc0 2024-08-31T05:29:33.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.110+0000 7fa4c9e58640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4c4102370 0x7fa4c419c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:33.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.110+0000 7fa4c9657640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa4c4102cc0 0x7fa4c419c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:33.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.110+0000 7fa4ca659640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4c410ff20 0x7fa4c41a1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:33.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.110+0000 7fa4c9e58640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4c4102370 0x7fa4c419c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:39474/0 (socket says 172.21.15.5:39474) 2024-08-31T05:29:33.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.110+0000 7fa4ca659640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4c410ff20 0x7fa4c41a1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52780/0 (socket says 172.21.15.5:52780) 2024-08-31T05:29:33.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.110+0000 7fa4c9e58640 1 -- 172.21.15.5:0/1946901303 learned_addr learned my addr 172.21.15.5:0/1946901303 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:33.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.110+0000 7fa4c9657640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa4c4102cc0 0x7fa4c419c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:59990/0 (socket says 172.21.15.5:59990) 2024-08-31T05:29:33.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.111+0000 7fa4c9e58640 1 -- 172.21.15.5:0/1946901303 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa4c4102cc0 msgr2=0x7fa4c419c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:33.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.111+0000 7fa4c9e58640 1 --2- 172.21.15.5:0/1946901303 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa4c4102cc0 0x7fa4c419c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:33.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.111+0000 7fa4c9e58640 1 -- 172.21.15.5:0/1946901303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4c410ff20 msgr2=0x7fa4c41a1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:33.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.111+0000 7fa4c9e58640 1 --2- 172.21.15.5:0/1946901303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4c410ff20 0x7fa4c41a1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:33.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.111+0000 7fa4c9e58640 1 -- 172.21.15.5:0/1946901303 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4c41a22f0 con 0x7fa4c4102370 2024-08-31T05:29:33.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.111+0000 7fa4c9e58640 1 --2- 172.21.15.5:0/1946901303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4c4102370 0x7fa4c419c380 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa4c000e9f0 tx=0x7fa4c000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:33.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.111+0000 7fa4baffd640 1 -- 172.21.15.5:0/1946901303 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c000cd80 con 0x7fa4c4102370 2024-08-31T05:29:33.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.111+0000 7fa4cc0bc640 1 -- 172.21.15.5:0/1946901303 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4c41a25e0 con 0x7fa4c4102370 2024-08-31T05:29:33.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.112+0000 7fa4cc0bc640 1 -- 172.21.15.5:0/1946901303 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4c41a8d40 con 0x7fa4c4102370 2024-08-31T05:29:33.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.112+0000 7fa4baffd640 1 -- 172.21.15.5:0/1946901303 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4c00108e0 con 0x7fa4c4102370 2024-08-31T05:29:33.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.112+0000 7fa4baffd640 1 -- 172.21.15.5:0/1946901303 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c0018980 con 0x7fa4c4102370 2024-08-31T05:29:33.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.113+0000 7fa4cc0bc640 1 -- 172.21.15.5:0/1946901303 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4a80052c0 con 0x7fa4c4102370 2024-08-31T05:29:33.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.115+0000 7fa4baffd640 1 -- 172.21.15.5:0/1946901303 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 22) ==== 152593+0+0 (secure 0 0 0) 0x7fa4c0010430 con 0x7fa4c4102370 2024-08-31T05:29:33.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.116+0000 7fa4baffd640 1 --2- 172.21.15.5:0/1946901303 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa4b00b4c00 0x7fa4b00b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:33.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.116+0000 7fa4c9657640 1 --2- 172.21.15.5:0/1946901303 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa4b00b4c00 0x7fa4b00b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:33.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.116+0000 7fa4baffd640 1 -- 172.21.15.5:0/1946901303 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fa4c00e5730 con 0x7fa4c4102370 2024-08-31T05:29:33.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.116+0000 7fa4c9657640 1 --2- 172.21.15.5:0/1946901303 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa4b00b4c00 0x7fa4b00b7110 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4103c60 tx=0x7fa4b4005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:33.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.120+0000 7fa4baffd640 1 -- 172.21.15.5:0/1946901303 <== mon.2 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa4c00abd70 con 0x7fa4c4102370 2024-08-31T05:29:33.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.344+0000 7fa4cc0bc640 1 -- 172.21.15.5:0/1946901303 --> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fa4a8000bf0 con 0x7fa4b00b4c00 2024-08-31T05:29:33.346 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:33 smithi005 ceph-mon[18602]: pgmap v332: 129 pgs: 129 active+clean; 645 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 511 B/s wr, 9 op/s 2024-08-31T05:29:33.346 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:33 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:29:33.347 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:33 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:29:33.347 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:33 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:29:33.347 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:33 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:29:33.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.351+0000 7fa4baffd640 1 -- 172.21.15.5:0/1946901303 <== mgr.14220 v2:172.21.15.5:6800/2696053609 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7fa4a8000bf0 con 0x7fa4b00b4c00 2024-08-31T05:29:33.353 INFO:teuthology.orchestra.run.smithi005.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-08-31T05:29:33.353 INFO:teuthology.orchestra.run.smithi005.stdout:mds.all 12/12 62s ago 2m smithi005=a;smithi005=d;smithi005=g;smithi005=j;smithi050=b;smithi050=e;smithi050=h;smithi050=k;smithi070=c;smithi070=f;smithi070=i;smithi070=l;count:12 2024-08-31T05:29:33.353 INFO:teuthology.orchestra.run.smithi005.stdout:mgr 3/3 62s ago 8m smithi005=x;smithi050=y;smithi070=z;count:3 2024-08-31T05:29:33.353 INFO:teuthology.orchestra.run.smithi005.stdout:mon 3/3 62s ago 9m smithi005:172.21.15.5=a;smithi050:172.21.15.50=b;smithi070:172.21.15.70=c;count:3 2024-08-31T05:29:33.353 INFO:teuthology.orchestra.run.smithi005.stdout:osd 12 62s ago - 2024-08-31T05:29:33.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.353+0000 7fa4cc0bc640 1 -- 172.21.15.5:0/1946901303 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa4b00b4c00 msgr2=0x7fa4b00b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:33.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.353+0000 7fa4cc0bc640 1 --2- 172.21.15.5:0/1946901303 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa4b00b4c00 0x7fa4b00b7110 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4103c60 tx=0x7fa4b4005f90 comp rx=0 tx=0).stop 2024-08-31T05:29:33.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.353+0000 7fa4cc0bc640 1 -- 172.21.15.5:0/1946901303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4c4102370 msgr2=0x7fa4c419c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:33.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.353+0000 7fa4cc0bc640 1 --2- 172.21.15.5:0/1946901303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4c4102370 0x7fa4c419c380 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa4c000e9f0 tx=0x7fa4c000eeb0 comp rx=0 tx=0).stop 2024-08-31T05:29:33.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.353+0000 7fa4cc0bc640 1 -- 172.21.15.5:0/1946901303 shutdown_connections 2024-08-31T05:29:33.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.353+0000 7fa4cc0bc640 1 --2- 172.21.15.5:0/1946901303 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa4b00b4c00 0x7fa4b00b7110 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:33.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.353+0000 7fa4cc0bc640 1 --2- 172.21.15.5:0/1946901303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4c410ff20 0x7fa4c41a1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:33.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.353+0000 7fa4cc0bc640 1 --2- 172.21.15.5:0/1946901303 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa4c4102cc0 0x7fa4c419c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:33.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.353+0000 7fa4cc0bc640 1 --2- 172.21.15.5:0/1946901303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa4c4102370 0x7fa4c419c380 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:33.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.353+0000 7fa4cc0bc640 1 -- 172.21.15.5:0/1946901303 >> 172.21.15.5:0/1946901303 conn(0x7fa4c40794d0 msgr2=0x7fa4c4109ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:33.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.353+0000 7fa4cc0bc640 1 -- 172.21.15.5:0/1946901303 shutdown_connections 2024-08-31T05:29:33.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:33.353+0000 7fa4cc0bc640 1 -- 172.21.15.5:0/1946901303 wait complete. 2024-08-31T05:29:33.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:33 smithi070 ceph-mon[22316]: pgmap v332: 129 pgs: 129 active+clean; 645 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 511 B/s wr, 9 op/s 2024-08-31T05:29:33.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:33 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:29:33.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:33 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:29:33.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:33 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:29:33.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:33 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:29:33.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:33 smithi050 ceph-mon[22146]: pgmap v332: 129 pgs: 129 active+clean; 645 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 511 B/s wr, 9 op/s 2024-08-31T05:29:33.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:33 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:29:33.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:33 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:29:33.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:33 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:29:33.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:33 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:29:33.970 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- bash -c 'ceph orch host ls' 2024-08-31T05:29:34.230 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:29:34.644 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:34 smithi005 ceph-mon[18602]: from='client.25061 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:34.645 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:34 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:29:34.645 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:34 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:29:34.645 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:34 smithi005 ceph-mon[18602]: pgmap v333: 129 pgs: 129 active+clean; 645 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 11 op/s 2024-08-31T05:29:34.645 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:34 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:29:34.645 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:34 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:29:34.645 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:34 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:29:34.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:34 smithi050 ceph-mon[22146]: from='client.25061 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:34.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:34 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:29:34.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:34 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:29:34.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:34 smithi050 ceph-mon[22146]: pgmap v333: 129 pgs: 129 active+clean; 645 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 11 op/s 2024-08-31T05:29:34.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:34 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:29:34.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:34 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:29:34.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:34 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:29:34.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:34.736+0000 7f864d0ad640 1 -- 172.21.15.5:0/3282559194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8648102800 msgr2=0x7f8648102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:34.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:34.736+0000 7f864d0ad640 1 --2- 172.21.15.5:0/3282559194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8648102800 0x7f8648102c10 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f8638009900 tx=0x7f863802a410 comp rx=0 tx=0).stop 2024-08-31T05:29:34.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:34.736+0000 7f864d0ad640 1 -- 172.21.15.5:0/3282559194 shutdown_connections 2024-08-31T05:29:34.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:34.736+0000 7f864d0ad640 1 --2- 172.21.15.5:0/3282559194 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8648108a90 0x7f864810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:34.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:34.736+0000 7f864d0ad640 1 --2- 172.21.15.5:0/3282559194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8648108140 0x7f8648108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:34.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:34.736+0000 7f864d0ad640 1 --2- 172.21.15.5:0/3282559194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8648102800 0x7f8648102c10 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:34.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:34.736+0000 7f864d0ad640 1 -- 172.21.15.5:0/3282559194 >> 172.21.15.5:0/3282559194 conn(0x7f86480794d0 msgr2=0x7f86480798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:34.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:34.736+0000 7f864d0ad640 1 -- 172.21.15.5:0/3282559194 shutdown_connections 2024-08-31T05:29:34.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:34.736+0000 7f864d0ad640 1 -- 172.21.15.5:0/3282559194 wait complete. 2024-08-31T05:29:34.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:34.737+0000 7f864d0ad640 1 Processor -- start 2024-08-31T05:29:34.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:34.737+0000 7f864d0ad640 1 -- start start 2024-08-31T05:29:34.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:34.738+0000 7f864d0ad640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8648102800 0x7f864819a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:34.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:34.738+0000 7f864d0ad640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8648108140 0x7f864819a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:34.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:34.738+0000 7f864d0ad640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8648108a90 0x7f864819fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:34.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:34.738+0000 7f864d0ad640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8648113820 con 0x7f8648108140 2024-08-31T05:29:34.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:34.738+0000 7f864d0ad640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f86481136a0 con 0x7f8648108a90 2024-08-31T05:29:34.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:34.738+0000 7f864d0ad640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f86481139a0 con 0x7f8648102800 2024-08-31T05:29:34.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:34.738+0000 7f864659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8648108140 0x7f864819a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:34.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:34.738+0000 7f864659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8648108140 0x7f864819a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52792/0 (socket says 172.21.15.5:52792) 2024-08-31T05:29:34.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:34.738+0000 7f864659c640 1 -- 172.21.15.5:0/2351451726 learned_addr learned my addr 172.21.15.5:0/2351451726 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:34.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:34.738+0000 7f864759e640 1 --2- 172.21.15.5:0/2351451726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8648108a90 0x7f864819fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:34.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:34.738+0000 7f8646d9d640 1 --2- 172.21.15.5:0/2351451726 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8648102800 0x7f864819a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:34.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:34.738+0000 7f864659c640 1 -- 172.21.15.5:0/2351451726 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8648102800 msgr2=0x7f864819a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:34.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:34.738+0000 7f864659c640 1 --2- 172.21.15.5:0/2351451726 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8648102800 0x7f864819a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:34.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:34.738+0000 7f864659c640 1 -- 172.21.15.5:0/2351451726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8648108a90 msgr2=0x7f864819fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:34.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:34.738+0000 7f864659c640 1 --2- 172.21.15.5:0/2351451726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8648108a90 0x7f864819fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:34.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:34.738+0000 7f864659c640 1 -- 172.21.15.5:0/2351451726 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86481a0160 con 0x7f8648108140 2024-08-31T05:29:34.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:34.739+0000 7f864659c640 1 --2- 172.21.15.5:0/2351451726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8648108140 0x7f864819a790 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f863c00e9c0 tx=0x7f863c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:34.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:34.739+0000 7f862ffff640 1 -- 172.21.15.5:0/2351451726 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f863c00cd80 con 0x7f8648108140 2024-08-31T05:29:34.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:34.739+0000 7f864d0ad640 1 -- 172.21.15.5:0/2351451726 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86481a0450 con 0x7f8648108140 2024-08-31T05:29:34.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:34.739+0000 7f862ffff640 1 -- 172.21.15.5:0/2351451726 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f863c0054d0 con 0x7f8648108140 2024-08-31T05:29:34.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:34.739+0000 7f862ffff640 1 -- 172.21.15.5:0/2351451726 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f863c010430 con 0x7f8648108140 2024-08-31T05:29:34.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:34.739+0000 7f864d0ad640 1 -- 172.21.15.5:0/2351451726 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86481a6bb0 con 0x7f8648108140 2024-08-31T05:29:34.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:34.740+0000 7f864d0ad640 1 -- 172.21.15.5:0/2351451726 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8648102c10 con 0x7f8648108140 2024-08-31T05:29:34.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:34.741+0000 7f862ffff640 1 -- 172.21.15.5:0/2351451726 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) ==== 152593+0+0 (secure 0 0 0) 0x7f863c004fb0 con 0x7f8648108140 2024-08-31T05:29:34.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:34.742+0000 7f862ffff640 1 --2- 172.21.15.5:0/2351451726 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f86300b4b80 0x7f86300b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:34.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:34.742+0000 7f8646d9d640 1 --2- 172.21.15.5:0/2351451726 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f86300b4b80 0x7f86300b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:34.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:34.742+0000 7f862ffff640 1 -- 172.21.15.5:0/2351451726 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f863c0e5d70 con 0x7f8648108140 2024-08-31T05:29:34.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:34.743+0000 7f8646d9d640 1 --2- 172.21.15.5:0/2351451726 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f86300b4b80 0x7f86300b7090 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8638031440 tx=0x7f8638005d50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:34.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:34.745+0000 7f862ffff640 1 -- 172.21.15.5:0/2351451726 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f863c056130 con 0x7f8648108140 2024-08-31T05:29:34.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:34 smithi070 ceph-mon[22316]: from='client.25061 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:34.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:34 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:29:34.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:34 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:29:34.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:34 smithi070 ceph-mon[22316]: pgmap v333: 129 pgs: 129 active+clean; 645 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 11 op/s 2024-08-31T05:29:34.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:34 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:29:34.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:34 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:29:34.837 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:34 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:29:34.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:34.941+0000 7f864d0ad640 1 -- 172.21.15.5:0/2351451726 --> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f86480635a0 con 0x7f86300b4b80 2024-08-31T05:29:34.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:34.942+0000 7f862ffff640 1 -- 172.21.15.5:0/2351451726 <== mgr.14220 v2:172.21.15.5:6800/2696053609 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+187 (secure 0 0 0) 0x7f86480635a0 con 0x7f86300b4b80 2024-08-31T05:29:34.945 INFO:teuthology.orchestra.run.smithi005.stdout:HOST ADDR LABELS STATUS 2024-08-31T05:29:34.945 INFO:teuthology.orchestra.run.smithi005.stdout:smithi005 172.21.15.5 2024-08-31T05:29:34.945 INFO:teuthology.orchestra.run.smithi005.stdout:smithi050 172.21.15.50 2024-08-31T05:29:34.945 INFO:teuthology.orchestra.run.smithi005.stdout:smithi070 172.21.15.70 2024-08-31T05:29:34.945 INFO:teuthology.orchestra.run.smithi005.stdout:3 hosts in cluster 2024-08-31T05:29:34.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:34.944+0000 7f864d0ad640 1 -- 172.21.15.5:0/2351451726 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f86300b4b80 msgr2=0x7f86300b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:34.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:34.944+0000 7f864d0ad640 1 --2- 172.21.15.5:0/2351451726 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f86300b4b80 0x7f86300b7090 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8638031440 tx=0x7f8638005d50 comp rx=0 tx=0).stop 2024-08-31T05:29:34.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:34.944+0000 7f864d0ad640 1 -- 172.21.15.5:0/2351451726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8648108140 msgr2=0x7f864819a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:34.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:34.944+0000 7f864d0ad640 1 --2- 172.21.15.5:0/2351451726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8648108140 0x7f864819a790 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f863c00e9c0 tx=0x7f863c00ee80 comp rx=0 tx=0).stop 2024-08-31T05:29:34.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:34.945+0000 7f864d0ad640 1 -- 172.21.15.5:0/2351451726 shutdown_connections 2024-08-31T05:29:34.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:34.945+0000 7f864d0ad640 1 --2- 172.21.15.5:0/2351451726 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f86300b4b80 0x7f86300b7090 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:34.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:34.945+0000 7f864d0ad640 1 --2- 172.21.15.5:0/2351451726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8648108a90 0x7f864819fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:34.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:34.945+0000 7f864d0ad640 1 --2- 172.21.15.5:0/2351451726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8648108140 0x7f864819a790 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:34.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:34.945+0000 7f864d0ad640 1 --2- 172.21.15.5:0/2351451726 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8648102800 0x7f864819a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:34.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:34.945+0000 7f864d0ad640 1 -- 172.21.15.5:0/2351451726 >> 172.21.15.5:0/2351451726 conn(0x7f86480794d0 msgr2=0x7f86481011a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:34.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:34.945+0000 7f864d0ad640 1 -- 172.21.15.5:0/2351451726 shutdown_connections 2024-08-31T05:29:34.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:34.945+0000 7f864d0ad640 1 -- 172.21.15.5:0/2351451726 wait complete. 2024-08-31T05:29:35.575 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:35 smithi005 ceph-mon[18602]: from='client.15384 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:35.606 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- bash -c 'ceph orch device ls' 2024-08-31T05:29:35.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:35 smithi050 ceph-mon[22146]: from='client.15384 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:35.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:35 smithi070 ceph-mon[22316]: from='client.15384 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:35.861 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:29:36.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:36.352+0000 7f330e537640 1 -- 172.21.15.5:0/603516295 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3308103930 msgr2=0x7f3308103d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:36.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:36.352+0000 7f330e537640 1 --2- 172.21.15.5:0/603516295 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3308103930 0x7f3308103d40 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f32f8009900 tx=0x7f32f802a410 comp rx=0 tx=0).stop 2024-08-31T05:29:36.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:36.352+0000 7f330e537640 1 -- 172.21.15.5:0/603516295 shutdown_connections 2024-08-31T05:29:36.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:36.352+0000 7f330e537640 1 --2- 172.21.15.5:0/603516295 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3308109bc0 0x7f33081103f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:36.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:36.352+0000 7f330e537640 1 --2- 172.21.15.5:0/603516295 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3308109270 0x7f3308109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:36.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:36.352+0000 7f330e537640 1 --2- 172.21.15.5:0/603516295 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3308103930 0x7f3308103d40 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:36.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:36.352+0000 7f330e537640 1 -- 172.21.15.5:0/603516295 >> 172.21.15.5:0/603516295 conn(0x7f33080ff3a0 msgr2=0x7f33081017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:36.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:36.352+0000 7f330e537640 1 -- 172.21.15.5:0/603516295 shutdown_connections 2024-08-31T05:29:36.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:36.352+0000 7f330e537640 1 -- 172.21.15.5:0/603516295 wait complete. 2024-08-31T05:29:36.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:36.353+0000 7f330e537640 1 Processor -- start 2024-08-31T05:29:36.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:36.353+0000 7f330e537640 1 -- start start 2024-08-31T05:29:36.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:36.353+0000 7f330e537640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3308103930 0x7f330819a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:36.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:36.353+0000 7f330e537640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3308109270 0x7f330819a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:36.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:36.353+0000 7f330e537640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3308109bc0 0x7f330819fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:36.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:36.353+0000 7f330e537640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f33081138e0 con 0x7f3308109270 2024-08-31T05:29:36.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:36.353+0000 7f330e537640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3308113760 con 0x7f3308109bc0 2024-08-31T05:29:36.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:36.353+0000 7f330e537640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3308113a60 con 0x7f3308103930 2024-08-31T05:29:36.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:36.353+0000 7f33077fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3308109270 0x7f330819a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:36.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:36.353+0000 7f33077fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3308109270 0x7f330819a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52804/0 (socket says 172.21.15.5:52804) 2024-08-31T05:29:36.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:36.353+0000 7f33077fe640 1 -- 172.21.15.5:0/4294528758 learned_addr learned my addr 172.21.15.5:0/4294528758 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:36.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:36.354+0000 7f330cad4640 1 --2- 172.21.15.5:0/4294528758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3308109bc0 0x7f330819fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:36.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:36.354+0000 7f3307fff640 1 --2- 172.21.15.5:0/4294528758 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3308103930 0x7f330819a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:36.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:36.354+0000 7f33077fe640 1 -- 172.21.15.5:0/4294528758 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3308103930 msgr2=0x7f330819a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:36.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:36.354+0000 7f33077fe640 1 --2- 172.21.15.5:0/4294528758 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3308103930 0x7f330819a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:36.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:36.354+0000 7f33077fe640 1 -- 172.21.15.5:0/4294528758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3308109bc0 msgr2=0x7f330819fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:36.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:36.354+0000 7f33077fe640 1 --2- 172.21.15.5:0/4294528758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3308109bc0 0x7f330819fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:36.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:36.354+0000 7f33077fe640 1 -- 172.21.15.5:0/4294528758 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33081a01e0 con 0x7f3308109270 2024-08-31T05:29:36.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:36.354+0000 7f33077fe640 1 --2- 172.21.15.5:0/4294528758 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3308109270 0x7f330819a810 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f32fc00c970 tx=0x7f32fc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:36.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:36.354+0000 7f33057fa640 1 -- 172.21.15.5:0/4294528758 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32fc007bb0 con 0x7f3308109270 2024-08-31T05:29:36.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:36.354+0000 7f330e537640 1 -- 172.21.15.5:0/4294528758 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33081a04d0 con 0x7f3308109270 2024-08-31T05:29:36.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:36.354+0000 7f33057fa640 1 -- 172.21.15.5:0/4294528758 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32fc007d50 con 0x7f3308109270 2024-08-31T05:29:36.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:36.354+0000 7f33057fa640 1 -- 172.21.15.5:0/4294528758 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32fc004e10 con 0x7f3308109270 2024-08-31T05:29:36.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:36.354+0000 7f330e537640 1 -- 172.21.15.5:0/4294528758 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3308075390 con 0x7f3308109270 2024-08-31T05:29:36.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:36.355+0000 7f330e537640 1 -- 172.21.15.5:0/4294528758 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3308103d40 con 0x7f3308109270 2024-08-31T05:29:36.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:36.357+0000 7f33057fa640 1 -- 172.21.15.5:0/4294528758 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) ==== 152593+0+0 (secure 0 0 0) 0x7f32fc005000 con 0x7f3308109270 2024-08-31T05:29:36.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:36.357+0000 7f33057fa640 1 --2- 172.21.15.5:0/4294528758 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f32f00b4b80 0x7f32f00b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:36.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:36.358+0000 7f3307fff640 1 --2- 172.21.15.5:0/4294528758 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f32f00b4b80 0x7f32f00b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:36.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:36.358+0000 7f33057fa640 1 -- 172.21.15.5:0/4294528758 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f32fc0e5900 con 0x7f3308109270 2024-08-31T05:29:36.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:36.358+0000 7f3307fff640 1 --2- 172.21.15.5:0/4294528758 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f32f00b4b80 0x7f32f00b7090 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f32f8031440 tx=0x7f32f803c040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:36.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:36.361+0000 7f33057fa640 1 -- 172.21.15.5:0/4294528758 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f32fc014030 con 0x7f3308109270 2024-08-31T05:29:36.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:36.555+0000 7f330e537640 1 -- 172.21.15.5:0/4294528758 --> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f33080635a0 con 0x7f32f00b4b80 2024-08-31T05:29:36.558 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:36 smithi005 ceph-mon[18602]: pgmap v334: 129 pgs: 129 active+clean; 645 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 11 op/s 2024-08-31T05:29:36.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:36.557+0000 7f33057fa640 1 -- 172.21.15.5:0/4294528758 <== mgr.14220 v2:172.21.15.5:6800/2696053609 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f33080635a0 con 0x7f32f00b4b80 2024-08-31T05:29:36.559 INFO:teuthology.orchestra.run.smithi005.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-08-31T05:29:36.559 INFO:teuthology.orchestra.run.smithi005.stdout:smithi005 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB751300EW480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-08-31T05:29:36.559 INFO:teuthology.orchestra.run.smithi005.stdout:smithi050 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7513001F480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-08-31T05:29:36.559 INFO:teuthology.orchestra.run.smithi005.stdout:smithi070 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7513002P480DGN 447G No 2m ago Has a FileSystem, LVM detected 2024-08-31T05:29:36.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:36.559+0000 7f330e537640 1 -- 172.21.15.5:0/4294528758 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f32f00b4b80 msgr2=0x7f32f00b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:36.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:36.559+0000 7f330e537640 1 --2- 172.21.15.5:0/4294528758 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f32f00b4b80 0x7f32f00b7090 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f32f8031440 tx=0x7f32f803c040 comp rx=0 tx=0).stop 2024-08-31T05:29:36.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:36.559+0000 7f330e537640 1 -- 172.21.15.5:0/4294528758 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3308109270 msgr2=0x7f330819a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:36.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:36.559+0000 7f330e537640 1 --2- 172.21.15.5:0/4294528758 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3308109270 0x7f330819a810 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f32fc00c970 tx=0x7f32fc00ce30 comp rx=0 tx=0).stop 2024-08-31T05:29:36.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:36.560+0000 7f330e537640 1 -- 172.21.15.5:0/4294528758 shutdown_connections 2024-08-31T05:29:36.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:36.560+0000 7f330e537640 1 --2- 172.21.15.5:0/4294528758 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f32f00b4b80 0x7f32f00b7090 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:36.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:36.560+0000 7f330e537640 1 --2- 172.21.15.5:0/4294528758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3308109bc0 0x7f330819fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:36.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:36.560+0000 7f330e537640 1 --2- 172.21.15.5:0/4294528758 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3308109270 0x7f330819a810 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:36.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:36.560+0000 7f330e537640 1 --2- 172.21.15.5:0/4294528758 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3308103930 0x7f330819a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:36.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:36.560+0000 7f330e537640 1 -- 172.21.15.5:0/4294528758 >> 172.21.15.5:0/4294528758 conn(0x7f33080ff3a0 msgr2=0x7f33081017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:36.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:36.560+0000 7f330e537640 1 -- 172.21.15.5:0/4294528758 shutdown_connections 2024-08-31T05:29:36.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:36.560+0000 7f330e537640 1 -- 172.21.15.5:0/4294528758 wait complete. 2024-08-31T05:29:36.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:36 smithi050 ceph-mon[22146]: pgmap v334: 129 pgs: 129 active+clean; 645 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 11 op/s 2024-08-31T05:29:36.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:36 smithi070 ceph-mon[22316]: pgmap v334: 129 pgs: 129 active+clean; 645 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 11 op/s 2024-08-31T05:29:37.239 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-31T05:29:37.248 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi005.front.sepia.ceph.com 2024-08-31T05:29:37.248 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- bash -c 'ceph fs dump' 2024-08-31T05:29:37.466 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:37 smithi005 ceph-mon[18602]: from='client.15390 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:37.503 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:29:37.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:37 smithi050 ceph-mon[22146]: from='client.15390 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:37.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:37 smithi070 ceph-mon[22316]: from='client.15390 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:38.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:38.012+0000 7f16fe5b6640 1 -- 172.21.15.5:0/2165418123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16f8109b90 msgr2=0x7f16f81103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:38.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:38.012+0000 7f16fe5b6640 1 --2- 172.21.15.5:0/2165418123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16f8109b90 0x7f16f81103c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f16f0009ca0 tx=0x7f16f002a8c0 comp rx=0 tx=0).stop 2024-08-31T05:29:38.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:38.012+0000 7f16fe5b6640 1 -- 172.21.15.5:0/2165418123 shutdown_connections 2024-08-31T05:29:38.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:38.012+0000 7f16fe5b6640 1 --2- 172.21.15.5:0/2165418123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16f8109b90 0x7f16f81103c0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:38.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:38.012+0000 7f16fe5b6640 1 --2- 172.21.15.5:0/2165418123 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16f8109240 0x7f16f8109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:38.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:38.012+0000 7f16fe5b6640 1 --2- 172.21.15.5:0/2165418123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16f8103900 0x7f16f8103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:38.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:38.012+0000 7f16fe5b6640 1 -- 172.21.15.5:0/2165418123 >> 172.21.15.5:0/2165418123 conn(0x7f16f807b5f0 msgr2=0x7f16f807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:38.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:38.012+0000 7f16fe5b6640 1 -- 172.21.15.5:0/2165418123 shutdown_connections 2024-08-31T05:29:38.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:38.012+0000 7f16fe5b6640 1 -- 172.21.15.5:0/2165418123 wait complete. 2024-08-31T05:29:38.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:38.013+0000 7f16fe5b6640 1 Processor -- start 2024-08-31T05:29:38.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:38.013+0000 7f16fe5b6640 1 -- start start 2024-08-31T05:29:38.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:38.013+0000 7f16fe5b6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16f8103900 0x7f16f80754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:38.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:38.013+0000 7f16fe5b6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16f8109240 0x7f16f80759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:38.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:38.013+0000 7f16fe5b6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16f8109b90 0x7f16f8075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:38.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:38.013+0000 7f16fe5b6640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f16f8113850 con 0x7f16f8109b90 2024-08-31T05:29:38.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:38.013+0000 7f16fe5b6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f16f81136d0 con 0x7f16f8109240 2024-08-31T05:29:38.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:38.013+0000 7f16fe5b6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f16f81139d0 con 0x7f16f8103900 2024-08-31T05:29:38.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:38.013+0000 7f16fcb53640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16f8109b90 0x7f16f8075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:38.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:38.013+0000 7f16fcb53640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16f8109b90 0x7f16f8075f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52836/0 (socket says 172.21.15.5:52836) 2024-08-31T05:29:38.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:38.013+0000 7f16fcb53640 1 -- 172.21.15.5:0/2158582808 learned_addr learned my addr 172.21.15.5:0/2158582808 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:38.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:38.013+0000 7f16f7fff640 1 --2- 172.21.15.5:0/2158582808 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16f8103900 0x7f16f80754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:38.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:38.013+0000 7f16f77fe640 1 --2- 172.21.15.5:0/2158582808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16f8109240 0x7f16f80759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:38.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:38.014+0000 7f16fcb53640 1 -- 172.21.15.5:0/2158582808 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16f8103900 msgr2=0x7f16f80754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:38.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:38.014+0000 7f16fcb53640 1 --2- 172.21.15.5:0/2158582808 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16f8103900 0x7f16f80754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:38.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:38.014+0000 7f16fcb53640 1 -- 172.21.15.5:0/2158582808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16f8109240 msgr2=0x7f16f80759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:38.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:38.014+0000 7f16fcb53640 1 --2- 172.21.15.5:0/2158582808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16f8109240 0x7f16f80759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:38.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:38.014+0000 7f16fcb53640 1 -- 172.21.15.5:0/2158582808 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f81a8410 con 0x7f16f8109b90 2024-08-31T05:29:38.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:38.014+0000 7f16fcb53640 1 --2- 172.21.15.5:0/2158582808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16f8109b90 0x7f16f8075f30 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f16f0005cc0 tx=0x7f16f002f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:38.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:38.014+0000 7f16f57fa640 1 -- 172.21.15.5:0/2158582808 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f0003cf0 con 0x7f16f8109b90 2024-08-31T05:29:38.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:38.014+0000 7f16f57fa640 1 -- 172.21.15.5:0/2158582808 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16f00044f0 con 0x7f16f8109b90 2024-08-31T05:29:38.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:38.014+0000 7f16fe5b6640 1 -- 172.21.15.5:0/2158582808 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16f81a86a0 con 0x7f16f8109b90 2024-08-31T05:29:38.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:38.014+0000 7f16f57fa640 1 -- 172.21.15.5:0/2158582808 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f002fc30 con 0x7f16f8109b90 2024-08-31T05:29:38.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:38.014+0000 7f16fe5b6640 1 -- 172.21.15.5:0/2158582808 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16f81a8c30 con 0x7f16f8109b90 2024-08-31T05:29:38.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:38.015+0000 7f16fe5b6640 1 -- 172.21.15.5:0/2158582808 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16f8103d10 con 0x7f16f8109b90 2024-08-31T05:29:38.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:38.016+0000 7f16f57fa640 1 -- 172.21.15.5:0/2158582808 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) ==== 152593+0+0 (secure 0 0 0) 0x7f16f00046a0 con 0x7f16f8109b90 2024-08-31T05:29:38.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:38.017+0000 7f16f57fa640 1 --2- 172.21.15.5:0/2158582808 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f16e00b4c00 0x7f16e00b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:38.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:38.017+0000 7f16f7fff640 1 --2- 172.21.15.5:0/2158582808 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f16e00b4c00 0x7f16e00b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:38.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:38.017+0000 7f16f57fa640 1 -- 172.21.15.5:0/2158582808 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f16f0106b90 con 0x7f16f8109b90 2024-08-31T05:29:38.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:38.018+0000 7f16f7fff640 1 --2- 172.21.15.5:0/2158582808 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f16e00b4c00 0x7f16e00b7110 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f16f8076f00 tx=0x7f16e800a2d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:38.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:38.022+0000 7f16f57fa640 1 -- 172.21.15.5:0/2158582808 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f16f00cd7c0 con 0x7f16f8109b90 2024-08-31T05:29:38.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:38.247+0000 7f16fe5b6640 1 -- 172.21.15.5:0/2158582808 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f16f810b3f0 con 0x7f16f8109b90 2024-08-31T05:29:38.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:38.247+0000 7f16f57fa640 1 -- 172.21.15.5:0/2158582808 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 29 v29) ==== 76+0+3108 (secure 0 0 0) 0x7f16f00cd0c0 con 0x7f16f8109b90 2024-08-31T05:29:38.249 INFO:teuthology.orchestra.run.smithi005.stdout:e29 2024-08-31T05:29:38.250 INFO:teuthology.orchestra.run.smithi005.stdout:btime 2024-08-31T05:28:13:579476+0000 2024-08-31T05:29:38.250 INFO:teuthology.orchestra.run.smithi005.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-31T05:29:38.250 INFO:teuthology.orchestra.run.smithi005.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T05:29:38.250 INFO:teuthology.orchestra.run.smithi005.stdout:legacy client fscid: 1 2024-08-31T05:29:38.250 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:29:38.250 INFO:teuthology.orchestra.run.smithi005.stdout:Filesystem 'cephfs' (1) 2024-08-31T05:29:38.250 INFO:teuthology.orchestra.run.smithi005.stdout:fs_name cephfs 2024-08-31T05:29:38.250 INFO:teuthology.orchestra.run.smithi005.stdout:epoch 29 2024-08-31T05:29:38.250 INFO:teuthology.orchestra.run.smithi005.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-31T05:29:38.250 INFO:teuthology.orchestra.run.smithi005.stdout:created 2024-08-31T05:27:31.929153+0000 2024-08-31T05:29:38.250 INFO:teuthology.orchestra.run.smithi005.stdout:modified 2024-08-31T05:28:13.446913+0000 2024-08-31T05:29:38.250 INFO:teuthology.orchestra.run.smithi005.stdout:tableserver 0 2024-08-31T05:29:38.250 INFO:teuthology.orchestra.run.smithi005.stdout:root 0 2024-08-31T05:29:38.251 INFO:teuthology.orchestra.run.smithi005.stdout:session_timeout 300 2024-08-31T05:29:38.251 INFO:teuthology.orchestra.run.smithi005.stdout:session_autoclose 300 2024-08-31T05:29:38.251 INFO:teuthology.orchestra.run.smithi005.stdout:max_file_size 1099511627776 2024-08-31T05:29:38.251 INFO:teuthology.orchestra.run.smithi005.stdout:max_xattr_size 65536 2024-08-31T05:29:38.251 INFO:teuthology.orchestra.run.smithi005.stdout:required_client_features {} 2024-08-31T05:29:38.251 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure 0 2024-08-31T05:29:38.251 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure_osd_epoch 0 2024-08-31T05:29:38.251 INFO:teuthology.orchestra.run.smithi005.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T05:29:38.251 INFO:teuthology.orchestra.run.smithi005.stdout:max_mds 5 2024-08-31T05:29:38.251 INFO:teuthology.orchestra.run.smithi005.stdout:in 0,1,2,3,4 2024-08-31T05:29:38.251 INFO:teuthology.orchestra.run.smithi005.stdout:up {0=24652,1=24638,2=24631,3=24625,4=24602} 2024-08-31T05:29:38.251 INFO:teuthology.orchestra.run.smithi005.stdout:failed 2024-08-31T05:29:38.252 INFO:teuthology.orchestra.run.smithi005.stdout:damaged 2024-08-31T05:29:38.252 INFO:teuthology.orchestra.run.smithi005.stdout:stopped 2024-08-31T05:29:38.252 INFO:teuthology.orchestra.run.smithi005.stdout:data_pools [3,4] 2024-08-31T05:29:38.252 INFO:teuthology.orchestra.run.smithi005.stdout:metadata_pool 2 2024-08-31T05:29:38.252 INFO:teuthology.orchestra.run.smithi005.stdout:inline_data disabled 2024-08-31T05:29:38.252 INFO:teuthology.orchestra.run.smithi005.stdout:balancer 2024-08-31T05:29:38.252 INFO:teuthology.orchestra.run.smithi005.stdout:bal_rank_mask -1 2024-08-31T05:29:38.252 INFO:teuthology.orchestra.run.smithi005.stdout:standby_count_wanted 0 2024-08-31T05:29:38.252 INFO:teuthology.orchestra.run.smithi005.stdout:qdb_cluster leader: 24652 members: 24602,24625,24638,24631,24652 2024-08-31T05:29:38.252 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.i{0:24652} state up:active seq 6 addr [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:29:38.252 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.e{0:24587} state up:standby-replay seq 1 addr [v2:172.21.15.50:6834/2346896794,v1:172.21.15.50:6835/2346896794] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:29:38.252 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.b{1:24638} state up:active seq 13 addr [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:29:38.252 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.l{1:24583} state up:standby-replay seq 1 addr [v2:172.21.15.70:6832/364083443,v1:172.21.15.70:6833/364083443] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:29:38.252 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.c{2:24631} state up:active seq 17 addr [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:29:38.253 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.k{2:24560} state up:standby-replay seq 1 addr [v2:172.21.15.50:6832/1153378982,v1:172.21.15.50:6833/1153378982] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:29:38.253 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.f{3:24625} state up:active seq 18 addr [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:29:38.253 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.a{3:14820} state up:standby-replay seq 1 addr [v2:172.21.15.5:6840/747057838,v1:172.21.15.5:6841/747057838] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:29:38.253 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.h{4:24602} state up:active seq 17 addr [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:29:38.253 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.g{4:14808} state up:standby-replay seq 1 addr [v2:172.21.15.5:6838/2412701258,v1:172.21.15.5:6839/2412701258] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:29:38.253 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:29:38.253 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:29:38.253 INFO:teuthology.orchestra.run.smithi005.stdout:Standby daemons: 2024-08-31T05:29:38.253 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:29:38.253 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.j{-1:14739} state up:standby seq 1 addr [v2:172.21.15.5:6834/2024812199,v1:172.21.15.5:6835/2024812199] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:29:38.253 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.d{-1:14751} state up:standby seq 1 addr [v2:172.21.15.5:6836/3629023702,v1:172.21.15.5:6837/3629023702] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T05:29:38.254 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 29 2024-08-31T05:29:38.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:38.249+0000 7f16fe5b6640 1 -- 172.21.15.5:0/2158582808 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f16e00b4c00 msgr2=0x7f16e00b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:38.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:38.249+0000 7f16fe5b6640 1 --2- 172.21.15.5:0/2158582808 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f16e00b4c00 0x7f16e00b7110 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f16f8076f00 tx=0x7f16e800a2d0 comp rx=0 tx=0).stop 2024-08-31T05:29:38.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:38.249+0000 7f16fe5b6640 1 -- 172.21.15.5:0/2158582808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16f8109b90 msgr2=0x7f16f8075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:38.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:38.249+0000 7f16fe5b6640 1 --2- 172.21.15.5:0/2158582808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16f8109b90 0x7f16f8075f30 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f16f0005cc0 tx=0x7f16f002f470 comp rx=0 tx=0).stop 2024-08-31T05:29:38.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:38.249+0000 7f16fe5b6640 1 -- 172.21.15.5:0/2158582808 shutdown_connections 2024-08-31T05:29:38.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:38.249+0000 7f16fe5b6640 1 --2- 172.21.15.5:0/2158582808 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f16e00b4c00 0x7f16e00b7110 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:38.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:38.249+0000 7f16fe5b6640 1 --2- 172.21.15.5:0/2158582808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f16f8109b90 0x7f16f8075f30 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:38.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:38.249+0000 7f16fe5b6640 1 --2- 172.21.15.5:0/2158582808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f16f8109240 0x7f16f80759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:38.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:38.249+0000 7f16fe5b6640 1 --2- 172.21.15.5:0/2158582808 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16f8103900 0x7f16f80754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:38.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:38.249+0000 7f16fe5b6640 1 -- 172.21.15.5:0/2158582808 >> 172.21.15.5:0/2158582808 conn(0x7f16f807b5f0 msgr2=0x7f16f8107290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:38.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:38.250+0000 7f16fe5b6640 1 -- 172.21.15.5:0/2158582808 shutdown_connections 2024-08-31T05:29:38.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:38.250+0000 7f16fe5b6640 1 -- 172.21.15.5:0/2158582808 wait complete. 2024-08-31T05:29:38.646 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:38 smithi005 ceph-mon[18602]: pgmap v335: 129 pgs: 129 active+clean; 645 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 9 op/s 2024-08-31T05:29:38.646 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:38 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/2158582808' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-31T05:29:38.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:38 smithi070 ceph-mon[22316]: pgmap v335: 129 pgs: 129 active+clean; 645 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 9 op/s 2024-08-31T05:29:38.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:38 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/2158582808' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-31T05:29:38.888 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- bash -c 'ceph osd dump' 2024-08-31T05:29:38.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:38 smithi050 ceph-mon[22146]: pgmap v335: 129 pgs: 129 active+clean; 645 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 9 op/s 2024-08-31T05:29:38.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:38 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/2158582808' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-31T05:29:39.139 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:29:39.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.580+0000 7f5f62e84640 1 -- 172.21.15.5:0/2271511267 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f5c103900 msgr2=0x7f5f5c103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:39.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.580+0000 7f5f62e84640 1 --2- 172.21.15.5:0/2271511267 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f5c103900 0x7f5f5c103d10 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c009900 tx=0x7f5f4c02a410 comp rx=0 tx=0).stop 2024-08-31T05:29:39.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.580+0000 7f5f62e84640 1 -- 172.21.15.5:0/2271511267 shutdown_connections 2024-08-31T05:29:39.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.580+0000 7f5f62e84640 1 --2- 172.21.15.5:0/2271511267 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f5c109b90 0x7f5f5c1103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:39.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.580+0000 7f5f62e84640 1 --2- 172.21.15.5:0/2271511267 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f5c109240 0x7f5f5c109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:39.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.580+0000 7f5f62e84640 1 --2- 172.21.15.5:0/2271511267 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f5c103900 0x7f5f5c103d10 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:39.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.580+0000 7f5f62e84640 1 -- 172.21.15.5:0/2271511267 >> 172.21.15.5:0/2271511267 conn(0x7f5f5c07b5f0 msgr2=0x7f5f5c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:39.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.580+0000 7f5f62e84640 1 -- 172.21.15.5:0/2271511267 shutdown_connections 2024-08-31T05:29:39.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.580+0000 7f5f62e84640 1 -- 172.21.15.5:0/2271511267 wait complete. 2024-08-31T05:29:39.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.581+0000 7f5f62e84640 1 Processor -- start 2024-08-31T05:29:39.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.581+0000 7f5f62e84640 1 -- start start 2024-08-31T05:29:39.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.581+0000 7f5f62e84640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f5c103900 0x7f5f5c19c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:39.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.581+0000 7f5f62e84640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f5c109240 0x7f5f5c19cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:39.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.581+0000 7f5f62e84640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f5c109b90 0x7f5f5c1a1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:39.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.581+0000 7f5f62e84640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5f5c113850 con 0x7f5f5c109b90 2024-08-31T05:29:39.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.581+0000 7f5f62e84640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5f5c1136d0 con 0x7f5f5c103900 2024-08-31T05:29:39.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.581+0000 7f5f62e84640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5f5c1139d0 con 0x7f5f5c109240 2024-08-31T05:29:39.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.581+0000 7f5f61421640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f5c109b90 0x7f5f5c1a1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:39.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.581+0000 7f5f61421640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f5c109b90 0x7f5f5c1a1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52854/0 (socket says 172.21.15.5:52854) 2024-08-31T05:29:39.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.581+0000 7f5f61421640 1 -- 172.21.15.5:0/2609471646 learned_addr learned my addr 172.21.15.5:0/2609471646 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:39.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.581+0000 7f5f60c20640 1 --2- 172.21.15.5:0/2609471646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f5c103900 0x7f5f5c19c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:39.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.582+0000 7f5f5bfff640 1 --2- 172.21.15.5:0/2609471646 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f5c109240 0x7f5f5c19cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:39.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.582+0000 7f5f61421640 1 -- 172.21.15.5:0/2609471646 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f5c109240 msgr2=0x7f5f5c19cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:39.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.582+0000 7f5f61421640 1 --2- 172.21.15.5:0/2609471646 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f5c109240 0x7f5f5c19cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:39.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.582+0000 7f5f61421640 1 -- 172.21.15.5:0/2609471646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f5c103900 msgr2=0x7f5f5c19c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:39.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.582+0000 7f5f61421640 1 --2- 172.21.15.5:0/2609471646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f5c103900 0x7f5f5c19c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:39.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.582+0000 7f5f61421640 1 -- 172.21.15.5:0/2609471646 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f5c1a24b0 con 0x7f5f5c109b90 2024-08-31T05:29:39.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.582+0000 7f5f5bfff640 1 --2- 172.21.15.5:0/2609471646 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f5c109240 0x7f5f5c19cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:29:39.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.582+0000 7f5f61421640 1 --2- 172.21.15.5:0/2609471646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f5c109b90 0x7f5f5c1a1d80 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5f5400d750 tx=0x7f5f5400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:39.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.582+0000 7f5f59ffb640 1 -- 172.21.15.5:0/2609471646 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f54017070 con 0x7f5f5c109b90 2024-08-31T05:29:39.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.582+0000 7f5f59ffb640 1 -- 172.21.15.5:0/2609471646 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f540054d0 con 0x7f5f5c109b90 2024-08-31T05:29:39.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.582+0000 7f5f62e84640 1 -- 172.21.15.5:0/2609471646 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f5c1a27a0 con 0x7f5f5c109b90 2024-08-31T05:29:39.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.582+0000 7f5f59ffb640 1 -- 172.21.15.5:0/2609471646 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f54004c60 con 0x7f5f5c109b90 2024-08-31T05:29:39.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.582+0000 7f5f62e84640 1 -- 172.21.15.5:0/2609471646 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f5c1a8f00 con 0x7f5f5c109b90 2024-08-31T05:29:39.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.583+0000 7f5f62e84640 1 -- 172.21.15.5:0/2609471646 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f5c103d10 con 0x7f5f5c109b90 2024-08-31T05:29:39.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.584+0000 7f5f59ffb640 1 -- 172.21.15.5:0/2609471646 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) ==== 152593+0+0 (secure 0 0 0) 0x7f5f54009bd0 con 0x7f5f5c109b90 2024-08-31T05:29:39.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.585+0000 7f5f59ffb640 1 --2- 172.21.15.5:0/2609471646 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5f440b4b80 0x7f5f440b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:39.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.585+0000 7f5f59ffb640 1 -- 172.21.15.5:0/2609471646 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f5f540e4f90 con 0x7f5f5c109b90 2024-08-31T05:29:39.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.585+0000 7f5f60c20640 1 --2- 172.21.15.5:0/2609471646 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5f440b4b80 0x7f5f440b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:39.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.586+0000 7f5f60c20640 1 --2- 172.21.15.5:0/2609471646 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5f440b4b80 0x7f5f440b7090 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c031440 tx=0x7f5f4c009560 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:39.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.590+0000 7f5f59ffb640 1 -- 172.21.15.5:0/2609471646 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5f540abc20 con 0x7f5f5c109b90 2024-08-31T05:29:39.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.777+0000 7f5f62e84640 1 -- 172.21.15.5:0/2609471646 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f5f5c1a9270 con 0x7f5f5c109b90 2024-08-31T05:29:39.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.778+0000 7f5f59ffb640 1 -- 172.21.15.5:0/2609471646 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v87) ==== 56+0+6039 (secure 0 0 0) 0x7f5f540ab520 con 0x7f5f5c109b90 2024-08-31T05:29:39.780 INFO:teuthology.orchestra.run.smithi005.stdout:epoch 87 2024-08-31T05:29:39.780 INFO:teuthology.orchestra.run.smithi005.stdout:fsid 69422704-6758-11ef-bcd4-c7b262605968 2024-08-31T05:29:39.780 INFO:teuthology.orchestra.run.smithi005.stdout:created 2024-08-31T05:19:04.860258+0000 2024-08-31T05:29:39.780 INFO:teuthology.orchestra.run.smithi005.stdout:modified 2024-08-31T05:28:59.155542+0000 2024-08-31T05:29:39.780 INFO:teuthology.orchestra.run.smithi005.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-08-31T05:29:39.781 INFO:teuthology.orchestra.run.smithi005.stdout:crush_version 27 2024-08-31T05:29:39.781 INFO:teuthology.orchestra.run.smithi005.stdout:full_ratio 0.95 2024-08-31T05:29:39.781 INFO:teuthology.orchestra.run.smithi005.stdout:backfillfull_ratio 0.9 2024-08-31T05:29:39.781 INFO:teuthology.orchestra.run.smithi005.stdout:nearfull_ratio 0.85 2024-08-31T05:29:39.781 INFO:teuthology.orchestra.run.smithi005.stdout:require_min_compat_client luminous 2024-08-31T05:29:39.781 INFO:teuthology.orchestra.run.smithi005.stdout:min_compat_client luminous 2024-08-31T05:29:39.781 INFO:teuthology.orchestra.run.smithi005.stdout:require_osd_release squid 2024-08-31T05:29:39.781 INFO:teuthology.orchestra.run.smithi005.stdout:stretch_mode_enabled false 2024-08-31T05:29:39.781 INFO:teuthology.orchestra.run.smithi005.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 23 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-08-31T05:29:39.781 INFO:teuthology.orchestra.run.smithi005.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 77 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-08-31T05:29:39.781 INFO:teuthology.orchestra.run.smithi005.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 77 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-08-31T05:29:39.781 INFO:teuthology.orchestra.run.smithi005.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 83 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-08-31T05:29:39.781 INFO:teuthology.orchestra.run.smithi005.stdout:max_osd 12 2024-08-31T05:29:39.782 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 up in weight 1 up_from 9 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.5:6802/2312496244,v1:172.21.15.5:6803/2312496244] [v2:172.21.15.5:6804/2312496244,v1:172.21.15.5:6805/2312496244] exists,up c5745391-e9d7-4799-9db9-6b34bb91b7df 2024-08-31T05:29:39.782 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 up in weight 1 up_from 14 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.50:6800/2777359361,v1:172.21.15.50:6801/2777359361] [v2:172.21.15.50:6802/2777359361,v1:172.21.15.50:6803/2777359361] exists,up f1903bd7-b2c5-424e-a74e-795f729471db 2024-08-31T05:29:39.782 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 up in weight 1 up_from 19 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6800/1400583716,v1:172.21.15.70:6801/1400583716] [v2:172.21.15.70:6802/1400583716,v1:172.21.15.70:6803/1400583716] exists,up 134c5892-e44a-44f2-8cd2-484d22a45e2e 2024-08-31T05:29:39.782 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 up in weight 1 up_from 26 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.5:6810/1647468379,v1:172.21.15.5:6811/1647468379] [v2:172.21.15.5:6812/1647468379,v1:172.21.15.5:6813/1647468379] exists,up af49398a-e171-496b-a50e-1f767fc42923 2024-08-31T05:29:39.782 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 up in weight 1 up_from 32 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.50:6808/2314546877,v1:172.21.15.50:6809/2314546877] [v2:172.21.15.50:6810/2314546877,v1:172.21.15.50:6811/2314546877] exists,up 59b847ef-6eb0-4c13-aa06-53a76d77ce45 2024-08-31T05:29:39.782 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 up in weight 1 up_from 37 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6808/311426299,v1:172.21.15.70:6809/311426299] [v2:172.21.15.70:6810/311426299,v1:172.21.15.70:6811/311426299] exists,up b0dac185-4462-4760-aa36-0d221923b007 2024-08-31T05:29:39.782 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6 up in weight 1 up_from 43 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.5:6818/1027645612,v1:172.21.15.5:6819/1027645612] [v2:172.21.15.5:6820/1027645612,v1:172.21.15.5:6821/1027645612] exists,up 12486aa2-61e4-4bdf-94dd-ce5c4cd3df6e 2024-08-31T05:29:39.782 INFO:teuthology.orchestra.run.smithi005.stdout:osd.7 up in weight 1 up_from 48 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.50:6816/2718354517,v1:172.21.15.50:6817/2718354517] [v2:172.21.15.50:6818/2718354517,v1:172.21.15.50:6819/2718354517] exists,up 66f9dcf9-d5c3-4016-812f-d9496e9892d5 2024-08-31T05:29:39.782 INFO:teuthology.orchestra.run.smithi005.stdout:osd.8 up in weight 1 up_from 54 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6816/3155722993,v1:172.21.15.70:6817/3155722993] [v2:172.21.15.70:6818/3155722993,v1:172.21.15.70:6819/3155722993] exists,up 584837f9-af4b-4189-a7e5-04156a94a805 2024-08-31T05:29:39.782 INFO:teuthology.orchestra.run.smithi005.stdout:osd.9 up in weight 1 up_from 60 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.5:6826/2988145512,v1:172.21.15.5:6827/2988145512] [v2:172.21.15.5:6828/2988145512,v1:172.21.15.5:6829/2988145512] exists,up ef60de6e-3456-435c-bd48-ed2636cc0d7f 2024-08-31T05:29:39.782 INFO:teuthology.orchestra.run.smithi005.stdout:osd.10 up in weight 1 up_from 65 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.50:6824/4168871229,v1:172.21.15.50:6825/4168871229] [v2:172.21.15.50:6826/4168871229,v1:172.21.15.50:6827/4168871229] exists,up 96c5de40-53df-412d-9501-8ce1711a76a2 2024-08-31T05:29:39.782 INFO:teuthology.orchestra.run.smithi005.stdout:osd.11 up in weight 1 up_from 71 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6824/2593470535,v1:172.21.15.70:6825/2593470535] [v2:172.21.15.70:6826/2593470535,v1:172.21.15.70:6827/2593470535] exists,up 20beefe0-59c3-4392-9f61-8d215e9d2de3 2024-08-31T05:29:39.782 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 2.a [2,11] 2024-08-31T05:29:39.783 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 2.b [8,11] 2024-08-31T05:29:39.783 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 2.1b [2,4] 2024-08-31T05:29:39.783 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 2.1f [8,1] 2024-08-31T05:29:39.783 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 3.2 [3,9] 2024-08-31T05:29:39.783 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 3.10 [5,9] 2024-08-31T05:29:39.783 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 3.14 [4,7] 2024-08-31T05:29:39.783 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 3.21 [5,9] 2024-08-31T05:29:39.783 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 3.27 [4,6] 2024-08-31T05:29:39.783 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 3.31 [4,8] 2024-08-31T05:29:39.783 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 4.2 [9,1] 2024-08-31T05:29:39.783 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 4.13 [9,8] 2024-08-31T05:29:39.783 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 4.16 [9,8] 2024-08-31T05:29:39.783 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 4.1b [5,10] 2024-08-31T05:29:39.783 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:0/2473024253 expires 2024-09-01T05:20:57.333680+0000 2024-08-31T05:29:39.783 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:0/2924148490 expires 2024-09-01T05:19:31.728664+0000 2024-08-31T05:29:39.784 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:0/2163558485 expires 2024-09-01T05:19:31.728664+0000 2024-08-31T05:29:39.784 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:0/2111919168 expires 2024-09-01T05:19:55.663503+0000 2024-08-31T05:29:39.784 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:6801/3616278616 expires 2024-09-01T05:19:55.663503+0000 2024-08-31T05:29:39.784 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:0/2436421090 expires 2024-09-01T05:19:31.728664+0000 2024-08-31T05:29:39.784 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:0/1570244689 expires 2024-09-01T05:19:55.663503+0000 2024-08-31T05:29:39.784 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:0/2700448223 expires 2024-09-01T05:20:57.333680+0000 2024-08-31T05:29:39.784 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:6800/3616278616 expires 2024-09-01T05:19:55.663503+0000 2024-08-31T05:29:39.784 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:6800/2898463711 expires 2024-09-01T05:19:31.728664+0000 2024-08-31T05:29:39.784 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:0/2450461036 expires 2024-09-01T05:20:57.333680+0000 2024-08-31T05:29:39.784 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:0/1947189952 expires 2024-09-01T05:19:55.663503+0000 2024-08-31T05:29:39.784 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:6800/1439868821 expires 2024-09-01T05:20:57.333680+0000 2024-08-31T05:29:39.784 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:6801/2898463711 expires 2024-09-01T05:19:31.728664+0000 2024-08-31T05:29:39.784 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:6801/1439868821 expires 2024-09-01T05:20:57.333680+0000 2024-08-31T05:29:39.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.780+0000 7f5f62e84640 1 -- 172.21.15.5:0/2609471646 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5f440b4b80 msgr2=0x7f5f440b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:39.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.780+0000 7f5f62e84640 1 --2- 172.21.15.5:0/2609471646 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5f440b4b80 0x7f5f440b7090 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c031440 tx=0x7f5f4c009560 comp rx=0 tx=0).stop 2024-08-31T05:29:39.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.780+0000 7f5f62e84640 1 -- 172.21.15.5:0/2609471646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f5c109b90 msgr2=0x7f5f5c1a1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:39.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.780+0000 7f5f62e84640 1 --2- 172.21.15.5:0/2609471646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f5c109b90 0x7f5f5c1a1d80 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5f5400d750 tx=0x7f5f5400dc10 comp rx=0 tx=0).stop 2024-08-31T05:29:39.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.781+0000 7f5f62e84640 1 -- 172.21.15.5:0/2609471646 shutdown_connections 2024-08-31T05:29:39.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.781+0000 7f5f62e84640 1 --2- 172.21.15.5:0/2609471646 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5f440b4b80 0x7f5f440b7090 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:39.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.781+0000 7f5f62e84640 1 --2- 172.21.15.5:0/2609471646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f5c109b90 0x7f5f5c1a1d80 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:39.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.781+0000 7f5f62e84640 1 --2- 172.21.15.5:0/2609471646 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f5c109240 0x7f5f5c19cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:39.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.781+0000 7f5f62e84640 1 --2- 172.21.15.5:0/2609471646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f5c103900 0x7f5f5c19c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:39.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.781+0000 7f5f62e84640 1 -- 172.21.15.5:0/2609471646 >> 172.21.15.5:0/2609471646 conn(0x7f5f5c07b5f0 msgr2=0x7f5f5c107050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:39.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.781+0000 7f5f62e84640 1 -- 172.21.15.5:0/2609471646 shutdown_connections 2024-08-31T05:29:39.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:39.781+0000 7f5f62e84640 1 -- 172.21.15.5:0/2609471646 wait complete. 2024-08-31T05:29:40.493 INFO:teuthology.run_tasks:Running task fs.ready... 2024-08-31T05:29:40.505 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T05:29:40.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:40 smithi005 ceph-mon[18602]: pgmap v336: 129 pgs: 129 active+clean; 645 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 597 B/s wr, 13 op/s 2024-08-31T05:29:40.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:40 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/2609471646' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-08-31T05:29:40.770 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:29:40.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:40 smithi070 ceph-mon[22316]: pgmap v336: 129 pgs: 129 active+clean; 645 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 597 B/s wr, 13 op/s 2024-08-31T05:29:40.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:40 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/2609471646' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-08-31T05:29:40.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:40 smithi050 ceph-mon[22146]: pgmap v336: 129 pgs: 129 active+clean; 645 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 597 B/s wr, 13 op/s 2024-08-31T05:29:40.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:40 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/2609471646' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-08-31T05:29:41.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:41.274+0000 7f7c6c340640 1 -- 172.21.15.5:0/1923436635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c64102800 msgr2=0x7f7c64102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:41.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:41.274+0000 7f7c6c340640 1 --2- 172.21.15.5:0/1923436635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c64102800 0x7f7c64102c10 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f7c60009900 tx=0x7f7c6002a410 comp rx=0 tx=0).stop 2024-08-31T05:29:41.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:41.274+0000 7f7c6c340640 1 -- 172.21.15.5:0/1923436635 shutdown_connections 2024-08-31T05:29:41.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:41.274+0000 7f7c6c340640 1 --2- 172.21.15.5:0/1923436635 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c64108a90 0x7f7c6410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:41.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:41.274+0000 7f7c6c340640 1 --2- 172.21.15.5:0/1923436635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c64108140 0x7f7c64108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:41.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:41.274+0000 7f7c6c340640 1 --2- 172.21.15.5:0/1923436635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c64102800 0x7f7c64102c10 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:41.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:41.274+0000 7f7c6c340640 1 -- 172.21.15.5:0/1923436635 >> 172.21.15.5:0/1923436635 conn(0x7f7c640794d0 msgr2=0x7f7c640798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:41.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:41.274+0000 7f7c6c340640 1 -- 172.21.15.5:0/1923436635 shutdown_connections 2024-08-31T05:29:41.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:41.274+0000 7f7c6c340640 1 -- 172.21.15.5:0/1923436635 wait complete. 2024-08-31T05:29:41.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:41.275+0000 7f7c6c340640 1 Processor -- start 2024-08-31T05:29:41.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:41.275+0000 7f7c6c340640 1 -- start start 2024-08-31T05:29:41.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:41.275+0000 7f7c6c340640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c64102800 0x7f7c64199120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:41.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:41.275+0000 7f7c6c340640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c64108140 0x7f7c641996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:41.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:41.275+0000 7f7c6c340640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c64108a90 0x7f7c6419e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:41.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:41.275+0000 7f7c6c340640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7c64112710 con 0x7f7c64102800 2024-08-31T05:29:41.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:41.275+0000 7f7c6c340640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7c64112590 con 0x7f7c64108a90 2024-08-31T05:29:41.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:41.275+0000 7f7c6c340640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7c64112890 con 0x7f7c64108140 2024-08-31T05:29:41.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:41.275+0000 7f7c6a0dc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c64102800 0x7f7c64199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:41.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:41.275+0000 7f7c6a0dc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c64102800 0x7f7c64199120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52880/0 (socket says 172.21.15.5:52880) 2024-08-31T05:29:41.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:41.275+0000 7f7c6a0dc640 1 -- 172.21.15.5:0/2097717209 learned_addr learned my addr 172.21.15.5:0/2097717209 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:41.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:41.275+0000 7f7c698db640 1 --2- 172.21.15.5:0/2097717209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c64108140 0x7f7c641996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:41.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:41.275+0000 7f7c6a8dd640 1 --2- 172.21.15.5:0/2097717209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c64108a90 0x7f7c6419e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:41.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:41.275+0000 7f7c6a0dc640 1 -- 172.21.15.5:0/2097717209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c64108140 msgr2=0x7f7c641996c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:41.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:41.275+0000 7f7c6a0dc640 1 --2- 172.21.15.5:0/2097717209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c64108140 0x7f7c641996c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:41.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:41.275+0000 7f7c6a0dc640 1 -- 172.21.15.5:0/2097717209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c64108a90 msgr2=0x7f7c6419e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:41.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:41.275+0000 7f7c6a0dc640 1 --2- 172.21.15.5:0/2097717209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c64108a90 0x7f7c6419e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:41.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:41.275+0000 7f7c6a0dc640 1 -- 172.21.15.5:0/2097717209 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c6419f090 con 0x7f7c64102800 2024-08-31T05:29:41.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:41.276+0000 7f7c6a0dc640 1 --2- 172.21.15.5:0/2097717209 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c64102800 0x7f7c64199120 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7c60005940 tx=0x7f7c600042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:41.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:41.276+0000 7f7c5b7fe640 1 -- 172.21.15.5:0/2097717209 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c6003f030 con 0x7f7c64102800 2024-08-31T05:29:41.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:41.276+0000 7f7c6c340640 1 -- 172.21.15.5:0/2097717209 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c6419f320 con 0x7f7c64102800 2024-08-31T05:29:41.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:41.276+0000 7f7c5b7fe640 1 -- 172.21.15.5:0/2097717209 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c60003cb0 con 0x7f7c64102800 2024-08-31T05:29:41.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:41.276+0000 7f7c5b7fe640 1 -- 172.21.15.5:0/2097717209 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c60035070 con 0x7f7c64102800 2024-08-31T05:29:41.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:41.276+0000 7f7c6c340640 1 -- 172.21.15.5:0/2097717209 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c6406ac00 con 0x7f7c64102800 2024-08-31T05:29:41.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:41.277+0000 7f7c6c340640 1 -- 172.21.15.5:0/2097717209 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c64103a80 con 0x7f7c64102800 2024-08-31T05:29:41.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:41.279+0000 7f7c5b7fe640 1 -- 172.21.15.5:0/2097717209 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) ==== 152593+0+0 (secure 0 0 0) 0x7f7c60042030 con 0x7f7c64102800 2024-08-31T05:29:41.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:41.279+0000 7f7c5b7fe640 1 --2- 172.21.15.5:0/2097717209 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f7c500b4b80 0x7f7c500b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:41.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:41.280+0000 7f7c698db640 1 --2- 172.21.15.5:0/2097717209 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f7c500b4b80 0x7f7c500b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:41.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:41.280+0000 7f7c5b7fe640 1 -- 172.21.15.5:0/2097717209 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f7c60106270 con 0x7f7c64102800 2024-08-31T05:29:41.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:41.280+0000 7f7c698db640 1 --2- 172.21.15.5:0/2097717209 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f7c500b4b80 0x7f7c500b7090 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7c54005fd0 tx=0x7f7c54005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:41.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:41.286+0000 7f7c5b7fe640 1 -- 172.21.15.5:0/2097717209 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7c600ccea0 con 0x7f7c64102800 2024-08-31T05:29:41.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:41.511+0000 7f7c6c340640 1 -- 172.21.15.5:0/2097717209 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7c64102c10 con 0x7f7c64102800 2024-08-31T05:29:41.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:41.511+0000 7f7c5b7fe640 1 -- 172.21.15.5:0/2097717209 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11941 (secure 0 0 0) 0x7f7c600d53e0 con 0x7f7c64102800 2024-08-31T05:29:41.513 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:29:41.514 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":29,"btime":"2024-08-31T05:28:13:579476+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14739,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2024812199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2024812199},{"type":"v1","addr":"172.21.15.5:6835","nonce":2024812199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3629023702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3629023702},{"type":"v1","addr":"172.21.15.5:6837","nonce":3629023702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T05:27:31.929153+0000","modified":"2024-08-31T05:28:13.446913+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24652,"mds_1":24638,"mds_2":24631,"mds_3":24625,"mds_4":24602},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6839/2412701258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":2412701258},{"type":"v1","addr":"172.21.15.5:6839","nonce":2412701258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14820":{"gid":14820,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6841/747057838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":747057838},{"type":"v1","addr":"172.21.15.5:6841","nonce":747057838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6833/1153378982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1153378982},{"type":"v1","addr":"172.21.15.50:6833","nonce":1153378982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6833/364083443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":364083443},{"type":"v1","addr":"172.21.15.70:6833","nonce":364083443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24587":{"gid":24587,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/2346896794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2346896794},{"type":"v1","addr":"172.21.15.50:6835","nonce":2346896794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24602":{"gid":24602,"name":"h","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.50:6837/428759669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":428759669},{"type":"v1","addr":"172.21.15.50:6837","nonce":428759669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.70:6835/2061504114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2061504114},{"type":"v1","addr":"172.21.15.70:6835","nonce":2061504114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.70:6837/2780036414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2780036414},{"type":"v1","addr":"172.21.15.70:6837","nonce":2780036414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.50:6839/98200944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":98200944},{"type":"v1","addr":"172.21.15.50:6839","nonce":98200944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24652":{"gid":24652,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.70:6839/2756569250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":2756569250},{"type":"v1","addr":"172.21.15.70:6839","nonce":2756569250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24652,"qdb_cluster":[24602,24625,24638,24631,24652]},"id":1}]} 2024-08-31T05:29:41.514 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 29 2024-08-31T05:29:41.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:41.514+0000 7f7c6c340640 1 -- 172.21.15.5:0/2097717209 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f7c500b4b80 msgr2=0x7f7c500b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:41.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:41.514+0000 7f7c6c340640 1 --2- 172.21.15.5:0/2097717209 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f7c500b4b80 0x7f7c500b7090 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7c54005fd0 tx=0x7f7c54005850 comp rx=0 tx=0).stop 2024-08-31T05:29:41.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:41.514+0000 7f7c6c340640 1 -- 172.21.15.5:0/2097717209 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c64102800 msgr2=0x7f7c64199120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:41.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:41.514+0000 7f7c6c340640 1 --2- 172.21.15.5:0/2097717209 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c64102800 0x7f7c64199120 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7c60005940 tx=0x7f7c600042f0 comp rx=0 tx=0).stop 2024-08-31T05:29:41.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:41.514+0000 7f7c6c340640 1 -- 172.21.15.5:0/2097717209 shutdown_connections 2024-08-31T05:29:41.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:41.514+0000 7f7c6c340640 1 --2- 172.21.15.5:0/2097717209 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f7c500b4b80 0x7f7c500b7090 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:41.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:41.514+0000 7f7c6c340640 1 --2- 172.21.15.5:0/2097717209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c64108a90 0x7f7c6419e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:41.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:41.514+0000 7f7c6c340640 1 --2- 172.21.15.5:0/2097717209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c64108140 0x7f7c641996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:41.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:41.514+0000 7f7c6c340640 1 --2- 172.21.15.5:0/2097717209 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c64102800 0x7f7c64199120 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:41.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:41.514+0000 7f7c6c340640 1 -- 172.21.15.5:0/2097717209 >> 172.21.15.5:0/2097717209 conn(0x7f7c640794d0 msgr2=0x7f7c64101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:41.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:41.514+0000 7f7c6c340640 1 -- 172.21.15.5:0/2097717209 shutdown_connections 2024-08-31T05:29:41.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:41.514+0000 7f7c6c340640 1 -- 172.21.15.5:0/2097717209 wait complete. 2024-08-31T05:29:41.792 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:41 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/2097717209' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:29:41.808 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:41 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/2097717209' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:29:41.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:41 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/2097717209' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:29:42.167 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T05:29:42.421 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:29:42.808 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:42 smithi005 ceph-mon[18602]: pgmap v337: 129 pgs: 129 active+clean; 645 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 9 op/s 2024-08-31T05:29:42.821 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:42 smithi050 ceph-mon[22146]: pgmap v337: 129 pgs: 129 active+clean; 645 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 9 op/s 2024-08-31T05:29:42.835 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:42 smithi070 ceph-mon[22316]: pgmap v337: 129 pgs: 129 active+clean; 645 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 9 op/s 2024-08-31T05:29:42.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:42.899+0000 7f39b0444640 1 -- 172.21.15.5:0/109648756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39a81081c0 msgr2=0x7f39a81085d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:42.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:42.899+0000 7f39b0444640 1 --2- 172.21.15.5:0/109648756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39a81081c0 0x7f39a81085d0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f39a4009900 tx=0x7f39a402a410 comp rx=0 tx=0).stop 2024-08-31T05:29:42.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:42.899+0000 7f39b0444640 1 -- 172.21.15.5:0/109648756 shutdown_connections 2024-08-31T05:29:42.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:42.899+0000 7f39b0444640 1 --2- 172.21.15.5:0/109648756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39a8108b10 0x7f39a810f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:42.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:42.899+0000 7f39b0444640 1 --2- 172.21.15.5:0/109648756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39a81081c0 0x7f39a81085d0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:42.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:42.899+0000 7f39b0444640 1 --2- 172.21.15.5:0/109648756 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f39a8102880 0x7f39a8102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:42.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:42.899+0000 7f39b0444640 1 -- 172.21.15.5:0/109648756 >> 172.21.15.5:0/109648756 conn(0x7f39a8079510 msgr2=0x7f39a8079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:42.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:42.899+0000 7f39b0444640 1 -- 172.21.15.5:0/109648756 shutdown_connections 2024-08-31T05:29:42.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:42.899+0000 7f39b0444640 1 -- 172.21.15.5:0/109648756 wait complete. 2024-08-31T05:29:42.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:42.900+0000 7f39b0444640 1 Processor -- start 2024-08-31T05:29:42.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:42.900+0000 7f39b0444640 1 -- start start 2024-08-31T05:29:42.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:42.900+0000 7f39b0444640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f39a8102880 0x7f39a819a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:42.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:42.900+0000 7f39b0444640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39a81081c0 0x7f39a819a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:42.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:42.900+0000 7f39b0444640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39a8108b10 0x7f39a819fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:42.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:42.900+0000 7f39b0444640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f39a81138a0 con 0x7f39a8108b10 2024-08-31T05:29:42.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:42.900+0000 7f39b0444640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f39a8113720 con 0x7f39a81081c0 2024-08-31T05:29:42.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:42.900+0000 7f39b0444640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f39a8113a20 con 0x7f39a8102880 2024-08-31T05:29:42.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:42.901+0000 7f39ae9e1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39a8108b10 0x7f39a819fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:42.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:42.901+0000 7f39ad9df640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39a81081c0 0x7f39a819a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:42.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:42.901+0000 7f39ae9e1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39a8108b10 0x7f39a819fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53964/0 (socket says 172.21.15.5:53964) 2024-08-31T05:29:42.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:42.901+0000 7f39ae9e1640 1 -- 172.21.15.5:0/2205873889 learned_addr learned my addr 172.21.15.5:0/2205873889 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:42.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:42.901+0000 7f39ae1e0640 1 --2- 172.21.15.5:0/2205873889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f39a8102880 0x7f39a819a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:42.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:42.901+0000 7f39ae9e1640 1 -- 172.21.15.5:0/2205873889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f39a8102880 msgr2=0x7f39a819a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:42.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:42.901+0000 7f39ae9e1640 1 --2- 172.21.15.5:0/2205873889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f39a8102880 0x7f39a819a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:42.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:42.901+0000 7f39ae9e1640 1 -- 172.21.15.5:0/2205873889 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39a81081c0 msgr2=0x7f39a819a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:42.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:42.901+0000 7f39ae9e1640 1 --2- 172.21.15.5:0/2205873889 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39a81081c0 0x7f39a819a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:42.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:42.901+0000 7f39ae9e1640 1 -- 172.21.15.5:0/2205873889 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39a81a0280 con 0x7f39a8108b10 2024-08-31T05:29:42.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:42.901+0000 7f39ae9e1640 1 --2- 172.21.15.5:0/2205873889 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39a8108b10 0x7f39a819fb50 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f39a0009fd0 tx=0x7f39a000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:42.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:42.901+0000 7f399b7fe640 1 -- 172.21.15.5:0/2205873889 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a0017070 con 0x7f39a8108b10 2024-08-31T05:29:42.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:42.901+0000 7f399b7fe640 1 -- 172.21.15.5:0/2205873889 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f39a0003e20 con 0x7f39a8108b10 2024-08-31T05:29:42.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:42.901+0000 7f39b0444640 1 -- 172.21.15.5:0/2205873889 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39a81a0570 con 0x7f39a8108b10 2024-08-31T05:29:42.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:42.901+0000 7f399b7fe640 1 -- 172.21.15.5:0/2205873889 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a0010460 con 0x7f39a8108b10 2024-08-31T05:29:42.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:42.901+0000 7f39b0444640 1 -- 172.21.15.5:0/2205873889 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39a81a6cd0 con 0x7f39a8108b10 2024-08-31T05:29:42.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:42.902+0000 7f39b0444640 1 -- 172.21.15.5:0/2205873889 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39a8103b00 con 0x7f39a8108b10 2024-08-31T05:29:42.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:42.904+0000 7f399b7fe640 1 -- 172.21.15.5:0/2205873889 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) ==== 152593+0+0 (secure 0 0 0) 0x7f39a0003970 con 0x7f39a8108b10 2024-08-31T05:29:42.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:42.905+0000 7f399b7fe640 1 --2- 172.21.15.5:0/2205873889 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f39940b4b80 0x7f39940b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:42.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:42.905+0000 7f39ae1e0640 1 --2- 172.21.15.5:0/2205873889 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f39940b4b80 0x7f39940b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:42.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:42.905+0000 7f399b7fe640 1 -- 172.21.15.5:0/2205873889 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f39a00e56e0 con 0x7f39a8108b10 2024-08-31T05:29:42.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:42.905+0000 7f39ae1e0640 1 --2- 172.21.15.5:0/2205873889 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f39940b4b80 0x7f39940b7090 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f399c005fd0 tx=0x7f399c00b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:42.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:42.908+0000 7f399b7fe640 1 -- 172.21.15.5:0/2205873889 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f39a00abd20 con 0x7f39a8108b10 2024-08-31T05:29:43.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:43.133+0000 7f39b0444640 1 -- 172.21.15.5:0/2205873889 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f39a810a950 con 0x7f39a8108b10 2024-08-31T05:29:43.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:43.134+0000 7f399b7fe640 1 -- 172.21.15.5:0/2205873889 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11941 (secure 0 0 0) 0x7f39a810a950 con 0x7f39a8108b10 2024-08-31T05:29:43.136 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:29:43.136 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":29,"btime":"2024-08-31T05:28:13:579476+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14739,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2024812199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2024812199},{"type":"v1","addr":"172.21.15.5:6835","nonce":2024812199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3629023702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3629023702},{"type":"v1","addr":"172.21.15.5:6837","nonce":3629023702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T05:27:31.929153+0000","modified":"2024-08-31T05:28:13.446913+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24652,"mds_1":24638,"mds_2":24631,"mds_3":24625,"mds_4":24602},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6839/2412701258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":2412701258},{"type":"v1","addr":"172.21.15.5:6839","nonce":2412701258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14820":{"gid":14820,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6841/747057838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":747057838},{"type":"v1","addr":"172.21.15.5:6841","nonce":747057838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6833/1153378982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1153378982},{"type":"v1","addr":"172.21.15.50:6833","nonce":1153378982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6833/364083443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":364083443},{"type":"v1","addr":"172.21.15.70:6833","nonce":364083443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24587":{"gid":24587,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/2346896794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2346896794},{"type":"v1","addr":"172.21.15.50:6835","nonce":2346896794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24602":{"gid":24602,"name":"h","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.50:6837/428759669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":428759669},{"type":"v1","addr":"172.21.15.50:6837","nonce":428759669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.70:6835/2061504114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2061504114},{"type":"v1","addr":"172.21.15.70:6835","nonce":2061504114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.70:6837/2780036414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2780036414},{"type":"v1","addr":"172.21.15.70:6837","nonce":2780036414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.50:6839/98200944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":98200944},{"type":"v1","addr":"172.21.15.50:6839","nonce":98200944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24652":{"gid":24652,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.70:6839/2756569250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":2756569250},{"type":"v1","addr":"172.21.15.70:6839","nonce":2756569250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24652,"qdb_cluster":[24602,24625,24638,24631,24652]},"id":1}]} 2024-08-31T05:29:43.137 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 29 2024-08-31T05:29:43.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:43.136+0000 7f39b0444640 1 -- 172.21.15.5:0/2205873889 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f39940b4b80 msgr2=0x7f39940b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:43.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:43.136+0000 7f39b0444640 1 --2- 172.21.15.5:0/2205873889 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f39940b4b80 0x7f39940b7090 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f399c005fd0 tx=0x7f399c00b390 comp rx=0 tx=0).stop 2024-08-31T05:29:43.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:43.136+0000 7f39b0444640 1 -- 172.21.15.5:0/2205873889 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39a8108b10 msgr2=0x7f39a819fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:43.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:43.136+0000 7f39b0444640 1 --2- 172.21.15.5:0/2205873889 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39a8108b10 0x7f39a819fb50 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f39a0009fd0 tx=0x7f39a000b260 comp rx=0 tx=0).stop 2024-08-31T05:29:43.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:43.137+0000 7f39b0444640 1 -- 172.21.15.5:0/2205873889 shutdown_connections 2024-08-31T05:29:43.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:43.137+0000 7f39b0444640 1 --2- 172.21.15.5:0/2205873889 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f39940b4b80 0x7f39940b7090 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:43.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:43.137+0000 7f39b0444640 1 --2- 172.21.15.5:0/2205873889 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39a8108b10 0x7f39a819fb50 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:43.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:43.137+0000 7f39b0444640 1 --2- 172.21.15.5:0/2205873889 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39a81081c0 0x7f39a819a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:43.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:43.137+0000 7f39b0444640 1 --2- 172.21.15.5:0/2205873889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f39a8102880 0x7f39a819a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:43.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:43.137+0000 7f39b0444640 1 -- 172.21.15.5:0/2205873889 >> 172.21.15.5:0/2205873889 conn(0x7f39a8079510 msgr2=0x7f39a8104240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:43.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:43.137+0000 7f39b0444640 1 -- 172.21.15.5:0/2205873889 shutdown_connections 2024-08-31T05:29:43.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:43.137+0000 7f39b0444640 1 -- 172.21.15.5:0/2205873889 wait complete. 2024-08-31T05:29:43.800 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:43 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/2205873889' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:29:43.801 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T05:29:43.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:43 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/2205873889' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:29:43.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:43 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/2205873889' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:29:44.053 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:29:44.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:44.544+0000 7fda45aa1640 1 -- 172.21.15.5:0/2054888420 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda40109b90 msgr2=0x7fda401103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:44.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:44.544+0000 7fda45aa1640 1 --2- 172.21.15.5:0/2054888420 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda40109b90 0x7fda401103c0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fda38009ca0 tx=0x7fda3802a8c0 comp rx=0 tx=0).stop 2024-08-31T05:29:44.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:44.544+0000 7fda45aa1640 1 -- 172.21.15.5:0/2054888420 shutdown_connections 2024-08-31T05:29:44.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:44.544+0000 7fda45aa1640 1 --2- 172.21.15.5:0/2054888420 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda40109b90 0x7fda401103c0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:44.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:44.544+0000 7fda45aa1640 1 --2- 172.21.15.5:0/2054888420 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda40109240 0x7fda40109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:44.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:44.544+0000 7fda45aa1640 1 --2- 172.21.15.5:0/2054888420 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda40103900 0x7fda40103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:44.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:44.544+0000 7fda45aa1640 1 -- 172.21.15.5:0/2054888420 >> 172.21.15.5:0/2054888420 conn(0x7fda4007b5f0 msgr2=0x7fda4007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:44.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:44.545+0000 7fda45aa1640 1 -- 172.21.15.5:0/2054888420 shutdown_connections 2024-08-31T05:29:44.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:44.545+0000 7fda45aa1640 1 -- 172.21.15.5:0/2054888420 wait complete. 2024-08-31T05:29:44.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:44.545+0000 7fda45aa1640 1 Processor -- start 2024-08-31T05:29:44.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:44.545+0000 7fda45aa1640 1 -- start start 2024-08-31T05:29:44.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:44.546+0000 7fda45aa1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda40103900 0x7fda4019a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:44.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:44.546+0000 7fda45aa1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda40109240 0x7fda4019a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:44.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:44.546+0000 7fda45aa1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda40109b90 0x7fda4019f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:44.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:44.546+0000 7fda45aa1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fda401138a0 con 0x7fda40109b90 2024-08-31T05:29:44.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:44.546+0000 7fda45aa1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fda40113720 con 0x7fda40103900 2024-08-31T05:29:44.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:44.546+0000 7fda45aa1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fda40113a20 con 0x7fda40109240 2024-08-31T05:29:44.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:44.546+0000 7fda3ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda40109b90 0x7fda4019f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:44.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:44.546+0000 7fda3ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda40109b90 0x7fda4019f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53986/0 (socket says 172.21.15.5:53986) 2024-08-31T05:29:44.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:44.546+0000 7fda3ffff640 1 -- 172.21.15.5:0/2486210796 learned_addr learned my addr 172.21.15.5:0/2486210796 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:44.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:44.546+0000 7fda3f7fe640 1 --2- 172.21.15.5:0/2486210796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda40103900 0x7fda4019a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:44.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:44.546+0000 7fda3effd640 1 --2- 172.21.15.5:0/2486210796 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda40109240 0x7fda4019a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:44.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:44.546+0000 7fda3ffff640 1 -- 172.21.15.5:0/2486210796 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda40109240 msgr2=0x7fda4019a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:44.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:44.546+0000 7fda3ffff640 1 --2- 172.21.15.5:0/2486210796 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda40109240 0x7fda4019a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:44.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:44.546+0000 7fda3ffff640 1 -- 172.21.15.5:0/2486210796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda40103900 msgr2=0x7fda4019a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:44.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:44.546+0000 7fda3ffff640 1 --2- 172.21.15.5:0/2486210796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda40103900 0x7fda4019a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:44.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:44.546+0000 7fda3ffff640 1 -- 172.21.15.5:0/2486210796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda401a0120 con 0x7fda40109b90 2024-08-31T05:29:44.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:44.546+0000 7fda3ffff640 1 --2- 172.21.15.5:0/2486210796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda40109b90 0x7fda4019f9f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fda38009430 tx=0x7fda380319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:44.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:44.547+0000 7fda3cff9640 1 -- 172.21.15.5:0/2486210796 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda38003c30 con 0x7fda40109b90 2024-08-31T05:29:44.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:44.547+0000 7fda3cff9640 1 -- 172.21.15.5:0/2486210796 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda38003dd0 con 0x7fda40109b90 2024-08-31T05:29:44.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:44.547+0000 7fda45aa1640 1 -- 172.21.15.5:0/2486210796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda401a03b0 con 0x7fda40109b90 2024-08-31T05:29:44.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:44.547+0000 7fda3cff9640 1 -- 172.21.15.5:0/2486210796 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda3802faa0 con 0x7fda40109b90 2024-08-31T05:29:44.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:44.547+0000 7fda45aa1640 1 -- 172.21.15.5:0/2486210796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda401a6b70 con 0x7fda40109b90 2024-08-31T05:29:44.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:44.548+0000 7fda45aa1640 1 -- 172.21.15.5:0/2486210796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda40103d10 con 0x7fda40109b90 2024-08-31T05:29:44.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:44.549+0000 7fda3cff9640 1 -- 172.21.15.5:0/2486210796 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) ==== 152593+0+0 (secure 0 0 0) 0x7fda3802fc40 con 0x7fda40109b90 2024-08-31T05:29:44.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:44.550+0000 7fda3cff9640 1 --2- 172.21.15.5:0/2486210796 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fda2c0b4b80 0x7fda2c0b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:44.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:44.550+0000 7fda3f7fe640 1 --2- 172.21.15.5:0/2486210796 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fda2c0b4b80 0x7fda2c0b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:44.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:44.550+0000 7fda3cff9640 1 -- 172.21.15.5:0/2486210796 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fda38106b10 con 0x7fda40109b90 2024-08-31T05:29:44.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:44.551+0000 7fda3f7fe640 1 --2- 172.21.15.5:0/2486210796 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fda2c0b4b80 0x7fda2c0b7090 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fda2800bbe0 tx=0x7fda2800b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:44.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:44.553+0000 7fda3cff9640 1 -- 172.21.15.5:0/2486210796 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fda380cd740 con 0x7fda40109b90 2024-08-31T05:29:44.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:44 smithi005 ceph-mon[18602]: pgmap v338: 129 pgs: 129 active+clean; 645 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 10 op/s 2024-08-31T05:29:44.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:44.741+0000 7fda45aa1640 1 -- 172.21.15.5:0/2486210796 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fda4019b2e0 con 0x7fda40109b90 2024-08-31T05:29:44.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:44.742+0000 7fda3cff9640 1 -- 172.21.15.5:0/2486210796 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+25122 (secure 0 0 0) 0x7fda4019b2e0 con 0x7fda40109b90 2024-08-31T05:29:44.745 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:29:44.745 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":87,"fsid":"69422704-6758-11ef-bcd4-c7b262605968","created":"2024-08-31T05:19:04.860258+0000","modified":"2024-08-31T05:28:59.155542+0000","last_up_change":"2024-08-31T05:26:38.675914+0000","last_in_change":"2024-08-31T05:26:15.366713+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T05:22:49.802575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T05:27:27.835197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T05:27:30.058144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-31T05:27:36.272228+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c5745391-e9d7-4799-9db9-6b34bb91b7df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6803","nonce":2312496244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6805","nonce":2312496244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6809","nonce":2312496244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6807","nonce":2312496244}]},"public_addr":"172.21.15.5:6803/2312496244","cluster_addr":"172.21.15.5:6805/2312496244","heartbeat_back_addr":"172.21.15.5:6809/2312496244","heartbeat_front_addr":"172.21.15.5:6807/2312496244","state":["exists","up"]},{"osd":1,"uuid":"f1903bd7-b2c5-424e-a74e-795f729471db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6801","nonce":2777359361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6803","nonce":2777359361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6807","nonce":2777359361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6805","nonce":2777359361}]},"public_addr":"172.21.15.50:6801/2777359361","cluster_addr":"172.21.15.50:6803/2777359361","heartbeat_back_addr":"172.21.15.50:6807/2777359361","heartbeat_front_addr":"172.21.15.50:6805/2777359361","state":["exists","up"]},{"osd":2,"uuid":"134c5892-e44a-44f2-8cd2-484d22a45e2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6801","nonce":1400583716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6803","nonce":1400583716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6807","nonce":1400583716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6805","nonce":1400583716}]},"public_addr":"172.21.15.70:6801/1400583716","cluster_addr":"172.21.15.70:6803/1400583716","heartbeat_back_addr":"172.21.15.70:6807/1400583716","heartbeat_front_addr":"172.21.15.70:6805/1400583716","state":["exists","up"]},{"osd":3,"uuid":"af49398a-e171-496b-a50e-1f767fc42923","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6811","nonce":1647468379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6813","nonce":1647468379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6817","nonce":1647468379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6815","nonce":1647468379}]},"public_addr":"172.21.15.5:6811/1647468379","cluster_addr":"172.21.15.5:6813/1647468379","heartbeat_back_addr":"172.21.15.5:6817/1647468379","heartbeat_front_addr":"172.21.15.5:6815/1647468379","state":["exists","up"]},{"osd":4,"uuid":"59b847ef-6eb0-4c13-aa06-53a76d77ce45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6809","nonce":2314546877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6811","nonce":2314546877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6815","nonce":2314546877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6813","nonce":2314546877}]},"public_addr":"172.21.15.50:6809/2314546877","cluster_addr":"172.21.15.50:6811/2314546877","heartbeat_back_addr":"172.21.15.50:6815/2314546877","heartbeat_front_addr":"172.21.15.50:6813/2314546877","state":["exists","up"]},{"osd":5,"uuid":"b0dac185-4462-4760-aa36-0d221923b007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6809","nonce":311426299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6811","nonce":311426299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6815","nonce":311426299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6813","nonce":311426299}]},"public_addr":"172.21.15.70:6809/311426299","cluster_addr":"172.21.15.70:6811/311426299","heartbeat_back_addr":"172.21.15.70:6815/311426299","heartbeat_front_addr":"172.21.15.70:6813/311426299","state":["exists","up"]},{"osd":6,"uuid":"12486aa2-61e4-4bdf-94dd-ce5c4cd3df6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6819","nonce":1027645612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6821","nonce":1027645612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6825","nonce":1027645612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6823","nonce":1027645612}]},"public_addr":"172.21.15.5:6819/1027645612","cluster_addr":"172.21.15.5:6821/1027645612","heartbeat_back_addr":"172.21.15.5:6825/1027645612","heartbeat_front_addr":"172.21.15.5:6823/1027645612","state":["exists","up"]},{"osd":7,"uuid":"66f9dcf9-d5c3-4016-812f-d9496e9892d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6817","nonce":2718354517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6819","nonce":2718354517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6823","nonce":2718354517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6821","nonce":2718354517}]},"public_addr":"172.21.15.50:6817/2718354517","cluster_addr":"172.21.15.50:6819/2718354517","heartbeat_back_addr":"172.21.15.50:6823/2718354517","heartbeat_front_addr":"172.21.15.50:6821/2718354517","state":["exists","up"]},{"osd":8,"uuid":"584837f9-af4b-4189-a7e5-04156a94a805","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6817","nonce":3155722993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6819","nonce":3155722993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6823","nonce":3155722993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6821","nonce":3155722993}]},"public_addr":"172.21.15.70:6817/3155722993","cluster_addr":"172.21.15.70:6819/3155722993","heartbeat_back_addr":"172.21.15.70:6823/3155722993","heartbeat_front_addr":"172.21.15.70:6821/3155722993","state":["exists","up"]},{"osd":9,"uuid":"ef60de6e-3456-435c-bd48-ed2636cc0d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6827","nonce":2988145512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6829","nonce":2988145512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6833","nonce":2988145512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6831","nonce":2988145512}]},"public_addr":"172.21.15.5:6827/2988145512","cluster_addr":"172.21.15.5:6829/2988145512","heartbeat_back_addr":"172.21.15.5:6833/2988145512","heartbeat_front_addr":"172.21.15.5:6831/2988145512","state":["exists","up"]},{"osd":10,"uuid":"96c5de40-53df-412d-9501-8ce1711a76a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6825","nonce":4168871229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6827","nonce":4168871229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6831","nonce":4168871229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6829","nonce":4168871229}]},"public_addr":"172.21.15.50:6825/4168871229","cluster_addr":"172.21.15.50:6827/4168871229","heartbeat_back_addr":"172.21.15.50:6831/4168871229","heartbeat_front_addr":"172.21.15.50:6829/4168871229","state":["exists","up"]},{"osd":11,"uuid":"20beefe0-59c3-4392-9f61-8d215e9d2de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6825","nonce":2593470535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6827","nonce":2593470535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6831","nonce":2593470535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6829","nonce":2593470535}]},"public_addr":"172.21.15.70:6825/2593470535","cluster_addr":"172.21.15.70:6827/2593470535","heartbeat_back_addr":"172.21.15.70:6831/2593470535","heartbeat_front_addr":"172.21.15.70:6829/2593470535","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:21:56.748083+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:22:21.969492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:22:46.642917+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:23:11.630486+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:23:36.389322+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:24:01.431039+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:24:27.057017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:24:53.628200+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:25:19.356502+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:25:44.958024+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:26:10.804919+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:26:36.849133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":5,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:0/2473024253":"2024-09-01T05:20:57.333680+0000","172.21.15.5:0/2924148490":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/2163558485":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/2111919168":"2024-09-01T05:19:55.663503+0000","172.21.15.5:6801/3616278616":"2024-09-01T05:19:55.663503+0000","172.21.15.5:0/2436421090":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/1570244689":"2024-09-01T05:19:55.663503+0000","172.21.15.5:0/2700448223":"2024-09-01T05:20:57.333680+0000","172.21.15.5:6800/3616278616":"2024-09-01T05:19:55.663503+0000","172.21.15.5:6800/2898463711":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/2450461036":"2024-09-01T05:20:57.333680+0000","172.21.15.5:0/1947189952":"2024-09-01T05:19:55.663503+0000","172.21.15.5:6800/1439868821":"2024-09-01T05:20:57.333680+0000","172.21.15.5:6801/2898463711":"2024-09-01T05:19:31.728664+0000","172.21.15.5:6801/1439868821":"2024-09-01T05:20:57.333680+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T05:29:44.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:44.744+0000 7fda45aa1640 1 -- 172.21.15.5:0/2486210796 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fda2c0b4b80 msgr2=0x7fda2c0b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:44.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:44.744+0000 7fda45aa1640 1 --2- 172.21.15.5:0/2486210796 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fda2c0b4b80 0x7fda2c0b7090 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fda2800bbe0 tx=0x7fda2800b390 comp rx=0 tx=0).stop 2024-08-31T05:29:44.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:44.744+0000 7fda45aa1640 1 -- 172.21.15.5:0/2486210796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda40109b90 msgr2=0x7fda4019f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:44.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:44.744+0000 7fda45aa1640 1 --2- 172.21.15.5:0/2486210796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda40109b90 0x7fda4019f9f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fda38009430 tx=0x7fda380319f0 comp rx=0 tx=0).stop 2024-08-31T05:29:44.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:44.744+0000 7fda45aa1640 1 -- 172.21.15.5:0/2486210796 shutdown_connections 2024-08-31T05:29:44.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:44.744+0000 7fda45aa1640 1 --2- 172.21.15.5:0/2486210796 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fda2c0b4b80 0x7fda2c0b7090 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:44.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:44.744+0000 7fda45aa1640 1 --2- 172.21.15.5:0/2486210796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda40109b90 0x7fda4019f9f0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:44.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:44.744+0000 7fda45aa1640 1 --2- 172.21.15.5:0/2486210796 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda40109240 0x7fda4019a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:44.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:44.744+0000 7fda45aa1640 1 --2- 172.21.15.5:0/2486210796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda40103900 0x7fda4019a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:44.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:44.744+0000 7fda45aa1640 1 -- 172.21.15.5:0/2486210796 >> 172.21.15.5:0/2486210796 conn(0x7fda4007b5f0 msgr2=0x7fda40107230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:44.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:44.745+0000 7fda45aa1640 1 -- 172.21.15.5:0/2486210796 shutdown_connections 2024-08-31T05:29:44.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:44.745+0000 7fda45aa1640 1 -- 172.21.15.5:0/2486210796 wait complete. 2024-08-31T05:29:44.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:44 smithi070 ceph-mon[22316]: pgmap v338: 129 pgs: 129 active+clean; 645 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 10 op/s 2024-08-31T05:29:44.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:44 smithi050 ceph-mon[22146]: pgmap v338: 129 pgs: 129 active+clean; 645 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 10 op/s 2024-08-31T05:29:45.415 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 29, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-08-31T05:27:31.929153+0000', 'modified': '2024-08-31T05:28:13.446913+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24652, 'mds_1': 24638, 'mds_2': 24631, 'mds_3': 24625, 'mds_4': 24602}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14808': {'gid': 14808, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.5:6839/2412701258', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6838', 'nonce': 2412701258}, {'type': 'v1', 'addr': '172.21.15.5:6839', 'nonce': 2412701258}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14820': {'gid': 14820, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.5:6841/747057838', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6840', 'nonce': 747057838}, {'type': 'v1', 'addr': '172.21.15.5:6841', 'nonce': 747057838}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24560': {'gid': 24560, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.50:6833/1153378982', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6832', 'nonce': 1153378982}, {'type': 'v1', 'addr': '172.21.15.50:6833', 'nonce': 1153378982}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24583': {'gid': 24583, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.70:6833/364083443', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6832', 'nonce': 364083443}, {'type': 'v1', 'addr': '172.21.15.70:6833', 'nonce': 364083443}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24587': {'gid': 24587, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.50:6835/2346896794', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6834', 'nonce': 2346896794}, {'type': 'v1', 'addr': '172.21.15.50:6835', 'nonce': 2346896794}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24602': {'gid': 24602, 'name': 'h', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.50:6837/428759669', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6836', 'nonce': 428759669}, {'type': 'v1', 'addr': '172.21.15.50:6837', 'nonce': 428759669}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24625': {'gid': 24625, 'name': 'f', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 18, 'addr': '172.21.15.70:6835/2061504114', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6834', 'nonce': 2061504114}, {'type': 'v1', 'addr': '172.21.15.70:6835', 'nonce': 2061504114}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24631': {'gid': 24631, 'name': 'c', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.70:6837/2780036414', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6836', 'nonce': 2780036414}, {'type': 'v1', 'addr': '172.21.15.70:6837', 'nonce': 2780036414}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24638': {'gid': 24638, 'name': 'b', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.50:6839/98200944', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6838', 'nonce': 98200944}, {'type': 'v1', 'addr': '172.21.15.50:6839', 'nonce': 98200944}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24652': {'gid': 24652, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.70:6839/2756569250', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.70:6838', 'nonce': 2756569250}, {'type': 'v1', 'addr': '172.21.15.70:6839', 'nonce': 2756569250}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24652, 'qdb_cluster': [24602, 24625, 24638, 24631, 24652]} 2024-08-31T05:29:45.415 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-08-31T05:29:45.415 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.h status 2024-08-31T05:29:45.671 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:29:45.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:45 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/2486210796' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T05:29:45.835 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:45 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/2486210796' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T05:29:45.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:45 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/2486210796' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T05:29:46.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.152+0000 7fceeb6f6640 1 -- 172.21.15.5:0/648784055 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcee4109b90 msgr2=0x7fcee41103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:46.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.152+0000 7fceeb6f6640 1 --2- 172.21.15.5:0/648784055 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcee4109b90 0x7fcee41103c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fcedc009ca0 tx=0x7fcedc02a8c0 comp rx=0 tx=0).stop 2024-08-31T05:29:46.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.152+0000 7fceeb6f6640 1 -- 172.21.15.5:0/648784055 shutdown_connections 2024-08-31T05:29:46.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.152+0000 7fceeb6f6640 1 --2- 172.21.15.5:0/648784055 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcee4109b90 0x7fcee41103c0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:46.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.152+0000 7fceeb6f6640 1 --2- 172.21.15.5:0/648784055 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcee4109240 0x7fcee4109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:46.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.152+0000 7fceeb6f6640 1 --2- 172.21.15.5:0/648784055 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcee4103900 0x7fcee4103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:46.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.152+0000 7fceeb6f6640 1 -- 172.21.15.5:0/648784055 >> 172.21.15.5:0/648784055 conn(0x7fcee407b5f0 msgr2=0x7fcee407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:46.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.152+0000 7fceeb6f6640 1 -- 172.21.15.5:0/648784055 shutdown_connections 2024-08-31T05:29:46.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.152+0000 7fceeb6f6640 1 -- 172.21.15.5:0/648784055 wait complete. 2024-08-31T05:29:46.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.153+0000 7fceeb6f6640 1 Processor -- start 2024-08-31T05:29:46.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.153+0000 7fceeb6f6640 1 -- start start 2024-08-31T05:29:46.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.153+0000 7fceeb6f6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcee4103900 0x7fcee40754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:46.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.153+0000 7fceeb6f6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcee4109240 0x7fcee40759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:46.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.153+0000 7fceeb6f6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcee4109b90 0x7fcee4075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:46.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.153+0000 7fceeb6f6640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fcee4113850 con 0x7fcee4109240 2024-08-31T05:29:46.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.153+0000 7fceeb6f6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcee41136d0 con 0x7fcee4109b90 2024-08-31T05:29:46.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.153+0000 7fceeb6f6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcee41139d0 con 0x7fcee4103900 2024-08-31T05:29:46.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.154+0000 7fcee8c91640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcee4109240 0x7fcee40759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:46.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.154+0000 7fcee8c91640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcee4109240 0x7fcee40759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54004/0 (socket says 172.21.15.5:54004) 2024-08-31T05:29:46.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.154+0000 7fcee8c91640 1 -- 172.21.15.5:0/863426970 learned_addr learned my addr 172.21.15.5:0/863426970 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:46.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.154+0000 7fcee9492640 1 --2- 172.21.15.5:0/863426970 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcee4103900 0x7fcee40754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:46.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.154+0000 7fcee9c93640 1 --2- 172.21.15.5:0/863426970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcee4109b90 0x7fcee4075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:46.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.154+0000 7fcee8c91640 1 -- 172.21.15.5:0/863426970 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcee4103900 msgr2=0x7fcee40754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:46.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.154+0000 7fcee8c91640 1 --2- 172.21.15.5:0/863426970 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcee4103900 0x7fcee40754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:46.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.154+0000 7fcee8c91640 1 -- 172.21.15.5:0/863426970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcee4109b90 msgr2=0x7fcee4075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:46.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.154+0000 7fcee8c91640 1 --2- 172.21.15.5:0/863426970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcee4109b90 0x7fcee4075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:46.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.154+0000 7fcee8c91640 1 -- 172.21.15.5:0/863426970 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcee41a8390 con 0x7fcee4109240 2024-08-31T05:29:46.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.154+0000 7fcee8c91640 1 --2- 172.21.15.5:0/863426970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcee4109240 0x7fcee40759f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fced400d740 tx=0x7fced400db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:46.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.154+0000 7fceda7fc640 1 -- 172.21.15.5:0/863426970 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced4017070 con 0x7fcee4109240 2024-08-31T05:29:46.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.154+0000 7fceda7fc640 1 -- 172.21.15.5:0/863426970 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fced4010460 con 0x7fcee4109240 2024-08-31T05:29:46.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.154+0000 7fceda7fc640 1 -- 172.21.15.5:0/863426970 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced400f600 con 0x7fcee4109240 2024-08-31T05:29:46.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.154+0000 7fceeb6f6640 1 -- 172.21.15.5:0/863426970 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcee41a8680 con 0x7fcee4109240 2024-08-31T05:29:46.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.154+0000 7fceeb6f6640 1 -- 172.21.15.5:0/863426970 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcee41a8bc0 con 0x7fcee4109240 2024-08-31T05:29:46.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.157+0000 7fcef1c6b740 1 Processor -- start 2024-08-31T05:29:46.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.157+0000 7fceda7fc640 1 -- 172.21.15.5:0/863426970 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) ==== 152593+0+0 (secure 0 0 0) 0x7fced401a070 con 0x7fcee4109240 2024-08-31T05:29:46.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.157+0000 7fcef1c6b740 1 -- start start 2024-08-31T05:29:46.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.157+0000 7fcef1c6b740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e587608f60 0x55e5879ae7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:46.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.157+0000 7fcef1c6b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5875e00a0 0x55e5879aecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:46.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.157+0000 7fcef1c6b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5875e8280 0x55e5879af230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:46.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.157+0000 7fcef1c6b740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55e5879253f0 con 0x55e587608f60 2024-08-31T05:29:46.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.157+0000 7fcef1c6b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e587914980 con 0x55e5875e8280 2024-08-31T05:29:46.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.157+0000 7fcef1c6b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e587918930 con 0x55e5875e00a0 2024-08-31T05:29:46.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.157+0000 7fcee9c93640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e587608f60 0x55e5879ae7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:46.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.158+0000 7fcee9c93640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e587608f60 0x55e5879ae7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54010/0 (socket says 172.21.15.5:54010) 2024-08-31T05:29:46.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.158+0000 7fcee9c93640 1 -- 172.21.15.5:0/1088638356 learned_addr learned my addr 172.21.15.5:0/1088638356 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:46.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.158+0000 7fcee8c91640 1 --2- 172.21.15.5:0/1088638356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5875e8280 0x55e5879af230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:46.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.158+0000 7fcee9492640 1 --2- 172.21.15.5:0/1088638356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5875e00a0 0x55e5879aecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:46.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.158+0000 7fcee9c93640 1 -- 172.21.15.5:0/1088638356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5875e00a0 msgr2=0x55e5879aecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:46.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.158+0000 7fcee9c93640 1 --2- 172.21.15.5:0/1088638356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5875e00a0 0x55e5879aecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:46.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.158+0000 7fceda7fc640 1 --2- 172.21.15.5:0/863426970 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fced00b4b80 0x7fced00b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:46.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.158+0000 7fcee9c93640 1 -- 172.21.15.5:0/1088638356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5875e8280 msgr2=0x55e5879af230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:46.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.158+0000 7fcee9c93640 1 --2- 172.21.15.5:0/1088638356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5875e8280 0x55e5879af230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:46.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.158+0000 7fcee9c93640 1 -- 172.21.15.5:0/1088638356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e587674540 con 0x55e587608f60 2024-08-31T05:29:46.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.158+0000 7fceda7fc640 1 -- 172.21.15.5:0/863426970 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fced40e4fc0 con 0x7fcee4109240 2024-08-31T05:29:46.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.158+0000 7fcee9c93640 1 --2- 172.21.15.5:0/863426970 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fced00b4b80 0x7fced00b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:46.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.158+0000 7fcee9c93640 1 --2- 172.21.15.5:0/1088638356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e587608f60 0x55e5879ae7b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fcedc009920 tx=0x7fcedc009950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=373c3de5cb175271 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:46.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.158+0000 7fcecf7fe640 1 -- 172.21.15.5:0/1088638356 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcedc031450 con 0x55e587608f60 2024-08-31T05:29:46.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.159+0000 7fcecf7fe640 1 -- 172.21.15.5:0/1088638356 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcedc036030 con 0x55e587608f60 2024-08-31T05:29:46.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.159+0000 7fcecf7fe640 1 -- 172.21.15.5:0/1088638356 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcedc02f660 con 0x55e587608f60 2024-08-31T05:29:46.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.159+0000 7fcef1c6b740 1 -- 172.21.15.5:0/1088638356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e587608f60 msgr2=0x55e5879ae7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:46.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.159+0000 7fcee9c93640 1 --2- 172.21.15.5:0/863426970 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fced00b4b80 0x7fced00b7090 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fcedc04a000 tx=0x7fcedc04b000 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:46.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.159+0000 7fcef1c6b740 1 --2- 172.21.15.5:0/1088638356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e587608f60 0x55e5879ae7b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fcedc009920 tx=0x7fcedc009950 comp rx=0 tx=0).stop 2024-08-31T05:29:46.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.159+0000 7fcef1c6b740 1 -- 172.21.15.5:0/1088638356 shutdown_connections 2024-08-31T05:29:46.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.160+0000 7fcef1c6b740 1 --2- 172.21.15.5:0/1088638356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5875e8280 0x55e5879af230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:46.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.160+0000 7fcef1c6b740 1 --2- 172.21.15.5:0/1088638356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5875e00a0 0x55e5879aecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:46.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.160+0000 7fcef1c6b740 1 --2- 172.21.15.5:0/1088638356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e587608f60 0x55e5879ae7b0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:46.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.160+0000 7fcef1c6b740 1 -- 172.21.15.5:0/1088638356 >> 172.21.15.5:0/1088638356 conn(0x55e5875fd350 msgr2=0x55e5879ac6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:46.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.160+0000 7fcef1c6b740 1 -- 172.21.15.5:0/1088638356 shutdown_connections 2024-08-31T05:29:46.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.160+0000 7fcef1c6b740 1 -- 172.21.15.5:0/1088638356 wait complete. 2024-08-31T05:29:46.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.160+0000 7fcef1c6b740 1 -- start start 2024-08-31T05:29:46.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.160+0000 7fcef1c6b740 1 Processor -- start 2024-08-31T05:29:46.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.161+0000 7fcef1c6b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5875e00a0 0x55e5879b9de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:46.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.161+0000 7fcef1c6b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5875e8280 0x55e5879ba320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:46.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.161+0000 7fcef1c6b740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e587608f60 0x55e5879ba8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:46.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.161+0000 7fcef1c6b740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55e5877775f0 con 0x55e587608f60 2024-08-31T05:29:46.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.161+0000 7fcef1c6b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e58789b600 con 0x55e5875e8280 2024-08-31T05:29:46.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.161+0000 7fcef1c6b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e5879bce10 con 0x55e5875e00a0 2024-08-31T05:29:46.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.161+0000 7fcef1c6b740 10 client.0 _ll_register_callbacks cb 0x55e5878c1af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:29:46.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.161+0000 7fcee9c93640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e587608f60 0x55e5879ba8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:46.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.161+0000 7fcee9492640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5875e00a0 0x55e5879b9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:46.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.161+0000 7fcee9c93640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e587608f60 0x55e5879ba8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54022/0 (socket says 172.21.15.5:54022) 2024-08-31T05:29:46.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.161+0000 7fcee9c93640 1 -- 172.21.15.5:0/489713551 learned_addr learned my addr 172.21.15.5:0/489713551 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:46.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.161+0000 7fcee8c91640 1 --2- 172.21.15.5:0/489713551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5875e8280 0x55e5879ba320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:46.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.161+0000 7fcee9c93640 1 -- 172.21.15.5:0/489713551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5875e00a0 msgr2=0x55e5879b9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:46.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.161+0000 7fcee9c93640 1 --2- 172.21.15.5:0/489713551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5875e00a0 0x55e5879b9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:46.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.161+0000 7fcee9c93640 1 -- 172.21.15.5:0/489713551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5875e8280 msgr2=0x55e5879ba320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:46.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.161+0000 7fcee9c93640 1 --2- 172.21.15.5:0/489713551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5875e8280 0x55e5879ba320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:46.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.161+0000 7fcee9c93640 1 -- 172.21.15.5:0/489713551 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5878d47b0 con 0x55e587608f60 2024-08-31T05:29:46.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.161+0000 7fcee9c93640 1 --2- 172.21.15.5:0/489713551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e587608f60 0x55e5879ba8a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fcedc009ca0 tx=0x7fcedc0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7493536f16856b0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:46.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.161+0000 7fceccff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:29:46.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.162+0000 7fceccff9640 1 -- 172.21.15.5:0/489713551 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcedc05e060 con 0x55e587608f60 2024-08-31T05:29:46.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.162+0000 7fceccff9640 1 -- 172.21.15.5:0/489713551 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fcedc056070 con 0x55e587608f60 2024-08-31T05:29:46.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.162+0000 7fcef1c6b740 1 -- 172.21.15.5:0/489713551 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcedc036030 con 0x55e587608f60 2024-08-31T05:29:46.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.162+0000 7fceccff9640 1 -- 172.21.15.5:0/489713551 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fcedc02f660 con 0x55e587608f60 2024-08-31T05:29:46.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.162+0000 7fcef1c6b740 10 client.15432 fetch_fsmap learned FSMap version 29 2024-08-31T05:29:46.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.162+0000 7fcef1c6b740 1 -- 172.21.15.5:0/489713551 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e5879c8ab0 con 0x55e587608f60 2024-08-31T05:29:46.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.162+0000 7fceccff9640 1 -- 172.21.15.5:0/489713551 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcedc036030 con 0x55e587608f60 2024-08-31T05:29:46.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.162+0000 7fceccff9640 1 -- 172.21.15.5:0/489713551 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fcedc0305c0 con 0x55e587608f60 2024-08-31T05:29:46.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.162+0000 7fcef1c6b740 10 client.15432 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T05:29:46.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.162+0000 7fcef1c6b740 10 client.15432 resolve_mds: resolved name 'h' to daemon mds.h 2024-08-31T05:29:46.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.162+0000 7fcef1c6b740 20 client.15432 populate_metadata read hostname 'smithi005' 2024-08-31T05:29:46.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.162+0000 7fcef1c6b740 1 --2- 172.21.15.5:0/489713551 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55e5875c78e0 0x55e5879cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:46.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.162+0000 7fcef1c6b740 4 client.15432 mds_command: new command op to 24602 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:29:46.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.162+0000 7fcef1c6b740 1 -- 172.21.15.5:0/489713551 --> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e587927340 con 0x55e5875c78e0 2024-08-31T05:29:46.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.163+0000 7fcee9492640 1 --2- 172.21.15.5:0/489713551 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55e5875c78e0 0x55e5879cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:46.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.163+0000 7fcee9492640 1 --2- 172.21.15.5:0/489713551 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55e5875c78e0 0x55e5879cc1c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5c67a649c00f54c6 server_cookie=abc9194190108ed5 in_seq=0 out_seq=0 2024-08-31T05:29:46.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.163+0000 7fceccff9640 10 client.15432 ms_handle_connect on v2:172.21.15.50:6836/428759669 2024-08-31T05:29:46.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.164+0000 7fceccff9640 1 -- 172.21.15.5:0/489713551 <== mds.4 v2:172.21.15.50:6836/428759669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e587927340 con 0x55e5875c78e0 2024-08-31T05:29:46.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.164+0000 7fceccff9640 10 client.15432 handle_command_reply: tid=0 2024-08-31T05:29:46.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.164+0000 7fcef1c6b740 1 client.15432 shutdown 2024-08-31T05:29:46.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.164+0000 7fcef1c6b740 1 -- 172.21.15.5:0/489713551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e587608f60 msgr2=0x55e5879ba8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:46.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.164+0000 7fcef1c6b740 1 --2- 172.21.15.5:0/489713551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e587608f60 0x55e5879ba8a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fcedc009ca0 tx=0x7fcedc0046d0 comp rx=0 tx=0).stop 2024-08-31T05:29:46.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.164+0000 7fcef1c6b740 1 -- 172.21.15.5:0/489713551 shutdown_connections 2024-08-31T05:29:46.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.164+0000 7fcef1c6b740 1 --2- 172.21.15.5:0/489713551 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55e5875c78e0 0x55e5879cc1c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:46.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.164+0000 7fcef1c6b740 1 --2- 172.21.15.5:0/489713551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e587608f60 0x55e5879ba8a0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:46.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.164+0000 7fcef1c6b740 1 --2- 172.21.15.5:0/489713551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5875e8280 0x55e5879ba320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:46.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.164+0000 7fceccff9640 0 client.15432 ms_handle_reset on v2:172.21.15.50:6836/428759669 2024-08-31T05:29:46.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.164+0000 7fcef1c6b740 1 --2- 172.21.15.5:0/489713551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5875e00a0 0x55e5879b9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:46.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.164+0000 7fcef1c6b740 1 -- 172.21.15.5:0/489713551 >> 172.21.15.5:0/489713551 conn(0x55e5875fd350 msgr2=0x55e5879b1990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:46.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.164+0000 7fcef1c6b740 1 -- 172.21.15.5:0/489713551 shutdown_connections 2024-08-31T05:29:46.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.164+0000 7fcef1c6b740 1 -- 172.21.15.5:0/489713551 wait complete. 2024-08-31T05:29:46.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.164+0000 7fcef1c6b740 20 client.15432 trim_cache size 0 max 16384 2024-08-31T05:29:46.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.183+0000 7fcef1c6b740 1 Processor -- start 2024-08-31T05:29:46.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.183+0000 7fcef1c6b740 1 -- start start 2024-08-31T05:29:46.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.183+0000 7fcef1c6b740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e5875e00a0 0x55e5879cad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:46.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.183+0000 7fcef1c6b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5875e8280 0x55e5879c5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:46.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.183+0000 7fcef1c6b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e587608f60 0x55e5879afef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:46.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.184+0000 7fcef1c6b740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55e5879ca500 con 0x55e5875e00a0 2024-08-31T05:29:46.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.184+0000 7fcef1c6b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e5879cabd0 con 0x55e5875e8280 2024-08-31T05:29:46.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.184+0000 7fcef1c6b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e5879cb2a0 con 0x55e587608f60 2024-08-31T05:29:46.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.184+0000 7fcee9492640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e5875e00a0 0x55e5879cad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:46.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.184+0000 7fcee9492640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e5875e00a0 0x55e5879cad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54036/0 (socket says 172.21.15.5:54036) 2024-08-31T05:29:46.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.184+0000 7fcee9492640 1 -- 172.21.15.5:0/423895207 learned_addr learned my addr 172.21.15.5:0/423895207 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:46.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.184+0000 7fcee9c93640 1 --2- 172.21.15.5:0/423895207 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e587608f60 0x55e5879afef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:46.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.184+0000 7fcee8c91640 1 --2- 172.21.15.5:0/423895207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5875e8280 0x55e5879c5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:46.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.184+0000 7fcee9492640 1 -- 172.21.15.5:0/423895207 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e587608f60 msgr2=0x55e5879afef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:46.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.184+0000 7fcee9492640 1 --2- 172.21.15.5:0/423895207 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e587608f60 0x55e5879afef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:46.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.184+0000 7fcee9492640 1 -- 172.21.15.5:0/423895207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5875e8280 msgr2=0x55e5879c5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:46.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.184+0000 7fcee9492640 1 --2- 172.21.15.5:0/423895207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5875e8280 0x55e5879c5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:46.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.184+0000 7fcee9492640 1 -- 172.21.15.5:0/423895207 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5879b5670 con 0x55e5875e00a0 2024-08-31T05:29:46.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.184+0000 7fcee9492640 1 --2- 172.21.15.5:0/423895207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e5875e00a0 0x55e5879cad50 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fcee0005940 tx=0x7fcee0013830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c66a7c8bd88b9e3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:46.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.184+0000 7fceceffd640 1 -- 172.21.15.5:0/423895207 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee000ae00 con 0x55e5875e00a0 2024-08-31T05:29:46.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.184+0000 7fceceffd640 1 -- 172.21.15.5:0/423895207 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcee00054d0 con 0x55e5875e00a0 2024-08-31T05:29:46.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.184+0000 7fceceffd640 1 -- 172.21.15.5:0/423895207 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee0004d60 con 0x55e5875e00a0 2024-08-31T05:29:46.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.185+0000 7fcef1c6b740 1 -- 172.21.15.5:0/423895207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e5875e00a0 msgr2=0x55e5879cad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:46.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.185+0000 7fcef1c6b740 1 --2- 172.21.15.5:0/423895207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e5875e00a0 0x55e5879cad50 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fcee0005940 tx=0x7fcee0013830 comp rx=0 tx=0).stop 2024-08-31T05:29:46.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.185+0000 7fcef1c6b740 1 -- 172.21.15.5:0/423895207 shutdown_connections 2024-08-31T05:29:46.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.185+0000 7fcef1c6b740 1 --2- 172.21.15.5:0/423895207 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e587608f60 0x55e5879afef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:46.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.185+0000 7fcef1c6b740 1 --2- 172.21.15.5:0/423895207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5875e8280 0x55e5879c5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:46.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.185+0000 7fcef1c6b740 1 --2- 172.21.15.5:0/423895207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e5875e00a0 0x55e5879cad50 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:46.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.185+0000 7fcef1c6b740 1 -- 172.21.15.5:0/423895207 >> 172.21.15.5:0/423895207 conn(0x55e5875fd350 msgr2=0x55e5879af7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:46.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.185+0000 7fcef1c6b740 1 -- 172.21.15.5:0/423895207 shutdown_connections 2024-08-31T05:29:46.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.185+0000 7fcef1c6b740 1 -- 172.21.15.5:0/423895207 wait complete. 2024-08-31T05:29:46.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.186+0000 7fcef1c6b740 1 -- start start 2024-08-31T05:29:46.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.186+0000 7fcef1c6b740 1 Processor -- start 2024-08-31T05:29:46.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.186+0000 7fcef1c6b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5875e00a0 0x55e5879ce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:46.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.186+0000 7fcef1c6b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5875e8280 0x55e5879ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:46.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.186+0000 7fcef1c6b740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e587608f60 0x55e5879cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:46.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.186+0000 7fcef1c6b740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55e5879cc040 con 0x55e587608f60 2024-08-31T05:29:46.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.186+0000 7fcef1c6b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e5879cb970 con 0x55e5875e8280 2024-08-31T05:29:46.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.186+0000 7fcef1c6b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e5879cc710 con 0x55e5875e00a0 2024-08-31T05:29:46.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.186+0000 7fcef1c6b740 10 client.0 _ll_register_callbacks cb 0x7fcedc005bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:29:46.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.186+0000 7fcee9c93640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e587608f60 0x55e5879cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:46.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.186+0000 7fcee9c93640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e587608f60 0x55e5879cf000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54038/0 (socket says 172.21.15.5:54038) 2024-08-31T05:29:46.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.186+0000 7fcee9c93640 1 -- 172.21.15.5:0/2993895129 learned_addr learned my addr 172.21.15.5:0/2993895129 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:46.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.187+0000 7fcee8c91640 1 --2- 172.21.15.5:0/2993895129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5875e8280 0x55e5879ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:46.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.187+0000 7fcee9492640 1 --2- 172.21.15.5:0/2993895129 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5875e00a0 0x55e5879ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:46.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.187+0000 7fcee9c93640 1 -- 172.21.15.5:0/2993895129 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5875e00a0 msgr2=0x55e5879ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:46.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.187+0000 7fcee9c93640 1 --2- 172.21.15.5:0/2993895129 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5875e00a0 0x55e5879ce580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:46.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.187+0000 7fcee9c93640 1 -- 172.21.15.5:0/2993895129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5875e8280 msgr2=0x55e5879ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:46.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.187+0000 7fcee9c93640 1 --2- 172.21.15.5:0/2993895129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5875e8280 0x55e5879ceac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:46.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.187+0000 7fcee9c93640 1 -- 172.21.15.5:0/2993895129 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5879d3e70 con 0x55e587608f60 2024-08-31T05:29:46.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.187+0000 7fcee8c91640 1 --2- 172.21.15.5:0/2993895129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5875e8280 0x55e5879ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:29:46.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.187+0000 7fcee9492640 1 --2- 172.21.15.5:0/2993895129 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5875e00a0 0x55e5879ce580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:29:46.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.187+0000 7fcee9c93640 1 --2- 172.21.15.5:0/2993895129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e587608f60 0x55e5879cf000 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fcedc0094e0 tx=0x7fcedc003f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc175dfc13dcd2bd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:46.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.187+0000 7fceccff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:29:46.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.187+0000 7fceccff9640 1 -- 172.21.15.5:0/2993895129 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcedc06e060 con 0x55e587608f60 2024-08-31T05:29:46.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.187+0000 7fceccff9640 1 -- 172.21.15.5:0/2993895129 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fcedc056040 con 0x55e587608f60 2024-08-31T05:29:46.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.187+0000 7fcef1c6b740 1 -- 172.21.15.5:0/2993895129 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcee00054d0 con 0x55e587608f60 2024-08-31T05:29:46.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.187+0000 7fceccff9640 1 -- 172.21.15.5:0/2993895129 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fcedc075050 con 0x55e587608f60 2024-08-31T05:29:46.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.187+0000 7fcef1c6b740 10 client.15438 fetch_fsmap learned FSMap version 29 2024-08-31T05:29:46.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.187+0000 7fcef1c6b740 1 -- 172.21.15.5:0/2993895129 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e587a37a40 con 0x55e587608f60 2024-08-31T05:29:46.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.188+0000 7fceccff9640 1 -- 172.21.15.5:0/2993895129 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcee00054d0 con 0x55e587608f60 2024-08-31T05:29:46.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.188+0000 7fceccff9640 1 -- 172.21.15.5:0/2993895129 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fcedc030bb0 con 0x55e587608f60 2024-08-31T05:29:46.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.188+0000 7fcef1c6b740 10 client.15438 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T05:29:46.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.188+0000 7fcef1c6b740 10 client.15438 resolve_mds: resolved name 'h' to daemon mds.h 2024-08-31T05:29:46.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.188+0000 7fcef1c6b740 20 client.15438 populate_metadata read hostname 'smithi005' 2024-08-31T05:29:46.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.188+0000 7fcef1c6b740 1 --2- 172.21.15.5:0/2993895129 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55e58759cc90 0x55e587a3b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:46.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.188+0000 7fcef1c6b740 4 client.15438 mds_command: new command op to 24602 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T05:29:46.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.188+0000 7fcef1c6b740 1 -- 172.21.15.5:0/2993895129 --> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] -- command(tid 0: {"prefix": "status"}) -- 0x55e587922de0 con 0x55e58759cc90 2024-08-31T05:29:46.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.188+0000 7fcee9492640 1 --2- 172.21.15.5:0/2993895129 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55e58759cc90 0x55e587a3b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:46.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.189+0000 7fceccff9640 10 client.15438 ms_handle_connect on v2:172.21.15.50:6836/428759669 2024-08-31T05:29:46.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.189+0000 7fcee9492640 1 --2- 172.21.15.5:0/2993895129 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55e58759cc90 0x55e587a3b200 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a23fdabd9366e6e5 server_cookie=5cecf2571c8239b6 in_seq=0 out_seq=0 2024-08-31T05:29:46.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.189+0000 7fceccff9640 1 -- 172.21.15.5:0/2993895129 <== mds.4 v2:172.21.15.50:6836/428759669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55e587922de0 con 0x55e58759cc90 2024-08-31T05:29:46.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.189+0000 7fceccff9640 10 client.15438 handle_command_reply: tid=0 2024-08-31T05:29:46.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.189+0000 7fcef1c6b740 1 client.15438 shutdown 2024-08-31T05:29:46.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.189+0000 7fcef1c6b740 1 -- 172.21.15.5:0/2993895129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e587608f60 msgr2=0x55e5879cf000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:46.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.189+0000 7fcef1c6b740 1 --2- 172.21.15.5:0/2993895129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e587608f60 0x55e5879cf000 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fcedc0094e0 tx=0x7fcedc003f00 comp rx=0 tx=0).stop 2024-08-31T05:29:46.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.189+0000 7fcef1c6b740 1 -- 172.21.15.5:0/2993895129 shutdown_connections 2024-08-31T05:29:46.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.189+0000 7fcef1c6b740 1 --2- 172.21.15.5:0/2993895129 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55e58759cc90 0x55e587a3b200 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:46.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.189+0000 7fceccff9640 0 client.15438 ms_handle_reset on v2:172.21.15.50:6836/428759669 2024-08-31T05:29:46.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.189+0000 7fcef1c6b740 1 --2- 172.21.15.5:0/2993895129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e587608f60 0x55e5879cf000 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:46.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.189+0000 7fcef1c6b740 1 --2- 172.21.15.5:0/2993895129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e5875e8280 0x55e5879ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:46.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.189+0000 7fcef1c6b740 1 --2- 172.21.15.5:0/2993895129 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5875e00a0 0x55e5879ce580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:46.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.189+0000 7fcef1c6b740 1 -- 172.21.15.5:0/2993895129 >> 172.21.15.5:0/2993895129 conn(0x55e5875fd350 msgr2=0x55e5879c57f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:46.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.189+0000 7fcef1c6b740 1 -- 172.21.15.5:0/2993895129 shutdown_connections 2024-08-31T05:29:46.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.189+0000 7fcef1c6b740 1 -- 172.21.15.5:0/2993895129 wait complete. 2024-08-31T05:29:46.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.189+0000 7fcef1c6b740 20 client.15438 trim_cache size 0 max 16384 2024-08-31T05:29:46.196 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:29:46.197 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "69422704-6758-11ef-bcd4-c7b262605968", 2024-08-31T05:29:46.197 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 4, 2024-08-31T05:29:46.197 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 24602, 2024-08-31T05:29:46.197 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-08-31T05:29:46.197 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-08-31T05:29:46.197 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-08-31T05:29:46.197 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 94.615605599000006, 2024-08-31T05:29:46.197 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 29, 2024-08-31T05:29:46.197 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 87, 2024-08-31T05:29:46.197 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 85, 2024-08-31T05:29:46.197 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 156.45993686599999 2024-08-31T05:29:46.197 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:29:46.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.190+0000 7fceeb6f6640 1 -- 172.21.15.5:0/863426970 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fced00b4b80 msgr2=0x7fced00b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:46.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.190+0000 7fceeb6f6640 1 --2- 172.21.15.5:0/863426970 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fced00b4b80 0x7fced00b7090 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fcedc04a000 tx=0x7fcedc04b000 comp rx=0 tx=0).stop 2024-08-31T05:29:46.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.190+0000 7fceeb6f6640 1 -- 172.21.15.5:0/863426970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcee4109240 msgr2=0x7fcee40759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:46.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.190+0000 7fceeb6f6640 1 --2- 172.21.15.5:0/863426970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcee4109240 0x7fcee40759f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fced400d740 tx=0x7fced400db40 comp rx=0 tx=0).stop 2024-08-31T05:29:46.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.190+0000 7fceeb6f6640 1 -- 172.21.15.5:0/863426970 shutdown_connections 2024-08-31T05:29:46.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.190+0000 7fceeb6f6640 1 --2- 172.21.15.5:0/863426970 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fced00b4b80 0x7fced00b7090 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:46.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.190+0000 7fceeb6f6640 1 --2- 172.21.15.5:0/863426970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcee4109b90 0x7fcee4075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:46.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.190+0000 7fceeb6f6640 1 --2- 172.21.15.5:0/863426970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcee4109240 0x7fcee40759f0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:46.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.190+0000 7fceeb6f6640 1 --2- 172.21.15.5:0/863426970 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcee4103900 0x7fcee40754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:46.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.190+0000 7fceeb6f6640 1 -- 172.21.15.5:0/863426970 >> 172.21.15.5:0/863426970 conn(0x7fcee407b5f0 msgr2=0x7fcee4107290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:46.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.190+0000 7fceeb6f6640 1 -- 172.21.15.5:0/863426970 shutdown_connections 2024-08-31T05:29:46.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:46.190+0000 7fceeb6f6640 1 -- 172.21.15.5:0/863426970 wait complete. 2024-08-31T05:29:46.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:46 smithi070 ceph-mon[22316]: pgmap v339: 129 pgs: 129 active+clean; 645 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-08-31T05:29:46.904 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:46 smithi005 ceph-mon[18602]: pgmap v339: 129 pgs: 129 active+clean; 645 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-08-31T05:29:46.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:46 smithi050 ceph-mon[22146]: pgmap v339: 129 pgs: 129 active+clean; 645 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-08-31T05:29:46.934 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.f status 2024-08-31T05:29:47.187 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:29:47.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.630+0000 7f98626d7640 1 -- 172.21.15.5:0/983948608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f985c108b10 msgr2=0x7f985c10f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:47.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.630+0000 7f98626d7640 1 --2- 172.21.15.5:0/983948608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f985c108b10 0x7f985c10f340 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9854009ca0 tx=0x7f985402a8c0 comp rx=0 tx=0).stop 2024-08-31T05:29:47.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.630+0000 7f98626d7640 1 -- 172.21.15.5:0/983948608 shutdown_connections 2024-08-31T05:29:47.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.630+0000 7f98626d7640 1 --2- 172.21.15.5:0/983948608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f985c108b10 0x7f985c10f340 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:47.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.630+0000 7f98626d7640 1 --2- 172.21.15.5:0/983948608 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f985c1081c0 0x7f985c1085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:47.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.630+0000 7f98626d7640 1 --2- 172.21.15.5:0/983948608 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f985c102880 0x7f985c102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:47.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.630+0000 7f98626d7640 1 -- 172.21.15.5:0/983948608 >> 172.21.15.5:0/983948608 conn(0x7f985c079510 msgr2=0x7f985c079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:47.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.630+0000 7f98626d7640 1 -- 172.21.15.5:0/983948608 shutdown_connections 2024-08-31T05:29:47.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.630+0000 7f98626d7640 1 -- 172.21.15.5:0/983948608 wait complete. 2024-08-31T05:29:47.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.631+0000 7f98626d7640 1 Processor -- start 2024-08-31T05:29:47.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.631+0000 7f98626d7640 1 -- start start 2024-08-31T05:29:47.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.631+0000 7f98626d7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f985c102880 0x7f985c0ff410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:47.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.631+0000 7f98626d7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f985c1081c0 0x7f985c0ff950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:47.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.632+0000 7f98626d7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f985c108b10 0x7f985c0ffe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:47.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.632+0000 7f98626d7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f985c1127c0 con 0x7f985c102880 2024-08-31T05:29:47.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.632+0000 7f98626d7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f985c112640 con 0x7f985c1081c0 2024-08-31T05:29:47.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.632+0000 7f98626d7640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f985c112940 con 0x7f985c108b10 2024-08-31T05:29:47.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.632+0000 7f985bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f985c102880 0x7f985c0ff410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:47.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.632+0000 7f985bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f985c102880 0x7f985c0ff410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54064/0 (socket says 172.21.15.5:54064) 2024-08-31T05:29:47.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.632+0000 7f985bfff640 1 -- 172.21.15.5:0/3087142000 learned_addr learned my addr 172.21.15.5:0/3087142000 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:47.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.632+0000 7f985b7fe640 1 --2- 172.21.15.5:0/3087142000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f985c1081c0 0x7f985c0ff950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:47.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.632+0000 7f9860c74640 1 --2- 172.21.15.5:0/3087142000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f985c108b10 0x7f985c0ffe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:47.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.632+0000 7f985bfff640 1 -- 172.21.15.5:0/3087142000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f985c108b10 msgr2=0x7f985c0ffe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:47.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.632+0000 7f985bfff640 1 --2- 172.21.15.5:0/3087142000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f985c108b10 0x7f985c0ffe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:47.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.632+0000 7f985bfff640 1 -- 172.21.15.5:0/3087142000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f985c1081c0 msgr2=0x7f985c0ff950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:47.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.632+0000 7f985bfff640 1 --2- 172.21.15.5:0/3087142000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f985c1081c0 0x7f985c0ff950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:47.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.632+0000 7f985bfff640 1 -- 172.21.15.5:0/3087142000 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f985c1a8500 con 0x7f985c102880 2024-08-31T05:29:47.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.632+0000 7f985bfff640 1 --2- 172.21.15.5:0/3087142000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f985c102880 0x7f985c0ff410 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f984c00d950 tx=0x7f984c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:47.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.632+0000 7f98597fa640 1 -- 172.21.15.5:0/3087142000 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f984c017030 con 0x7f985c102880 2024-08-31T05:29:47.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.633+0000 7f98626d7640 1 -- 172.21.15.5:0/3087142000 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f985c1a87f0 con 0x7f985c102880 2024-08-31T05:29:47.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.633+0000 7f98597fa640 1 -- 172.21.15.5:0/3087142000 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f984c004020 con 0x7f985c102880 2024-08-31T05:29:47.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.633+0000 7f98597fa640 1 -- 172.21.15.5:0/3087142000 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f984c0047a0 con 0x7f985c102880 2024-08-31T05:29:47.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.633+0000 7f98626d7640 1 -- 172.21.15.5:0/3087142000 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f985c1a8d30 con 0x7f985c102880 2024-08-31T05:29:47.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.635+0000 7f98597fa640 1 -- 172.21.15.5:0/3087142000 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) ==== 152593+0+0 (secure 0 0 0) 0x7f984c009a30 con 0x7f985c102880 2024-08-31T05:29:47.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.635+0000 7f9868c4c740 1 Processor -- start 2024-08-31T05:29:47.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.635+0000 7f9868c4c740 1 -- start start 2024-08-31T05:29:47.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.636+0000 7f9868c4c740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623c70bdf60 0x5623c74637b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:47.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.636+0000 7f9868c4c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5623c70950a0 0x5623c7463cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:47.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.636+0000 7f9868c4c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623c709d280 0x5623c7464230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:47.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.636+0000 7f9868c4c740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5623c73da3f0 con 0x5623c70bdf60 2024-08-31T05:29:47.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.636+0000 7f9868c4c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5623c73c9980 con 0x5623c709d280 2024-08-31T05:29:47.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.636+0000 7f9868c4c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5623c73cd930 con 0x5623c70950a0 2024-08-31T05:29:47.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.636+0000 7f9860c74640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623c70bdf60 0x5623c74637b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:47.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.636+0000 7f9860c74640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623c70bdf60 0x5623c74637b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54068/0 (socket says 172.21.15.5:54068) 2024-08-31T05:29:47.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.636+0000 7f9860c74640 1 -- 172.21.15.5:0/3993983166 learned_addr learned my addr 172.21.15.5:0/3993983166 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:47.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.636+0000 7f985bfff640 1 --2- 172.21.15.5:0/3993983166 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5623c70950a0 0x5623c7463cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:47.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.636+0000 7f985b7fe640 1 --2- 172.21.15.5:0/3993983166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623c709d280 0x5623c7464230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:47.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.636+0000 7f98597fa640 1 --2- 172.21.15.5:0/3087142000 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f98440b4b80 0x7f98440b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:47.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.636+0000 7f9860c74640 1 -- 172.21.15.5:0/3993983166 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5623c70950a0 msgr2=0x5623c7463cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:47.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.636+0000 7f9860c74640 1 --2- 172.21.15.5:0/3993983166 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5623c70950a0 0x5623c7463cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:47.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.636+0000 7f9860c74640 1 -- 172.21.15.5:0/3993983166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623c709d280 msgr2=0x5623c7464230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:47.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.636+0000 7f9860c74640 1 --2- 172.21.15.5:0/3993983166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623c709d280 0x5623c7464230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:47.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.636+0000 7f9860c74640 1 -- 172.21.15.5:0/3993983166 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623c7129540 con 0x5623c70bdf60 2024-08-31T05:29:47.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.636+0000 7f985b7fe640 1 --2- 172.21.15.5:0/3993983166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623c709d280 0x5623c7464230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:29:47.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.636+0000 7f98597fa640 1 -- 172.21.15.5:0/3087142000 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f984c0e5100 con 0x7f985c102880 2024-08-31T05:29:47.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.637+0000 7f9860c74640 1 --2- 172.21.15.5:0/3087142000 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f98440b4b80 0x7f98440b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:47.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.637+0000 7f9860c74640 1 --2- 172.21.15.5:0/3993983166 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623c70bdf60 0x5623c74637b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f9854009930 tx=0x7f9854009960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98fc5c475c2daba3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:47.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.637+0000 7f98427fc640 1 -- 172.21.15.5:0/3993983166 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f985404d070 con 0x5623c70bdf60 2024-08-31T05:29:47.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.637+0000 7f98427fc640 1 -- 172.21.15.5:0/3993983166 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9854036040 con 0x5623c70bdf60 2024-08-31T05:29:47.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.637+0000 7f98427fc640 1 -- 172.21.15.5:0/3993983166 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f985402f860 con 0x5623c70bdf60 2024-08-31T05:29:47.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.638+0000 7f9868c4c740 1 -- 172.21.15.5:0/3993983166 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623c70bdf60 msgr2=0x5623c74637b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:47.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.638+0000 7f9868c4c740 1 --2- 172.21.15.5:0/3993983166 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623c70bdf60 0x5623c74637b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f9854009930 tx=0x7f9854009960 comp rx=0 tx=0).stop 2024-08-31T05:29:47.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.638+0000 7f9860c74640 1 --2- 172.21.15.5:0/3087142000 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f98440b4b80 0x7f98440b7090 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f985404a000 tx=0x7f985404b000 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:47.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.638+0000 7f9868c4c740 1 -- 172.21.15.5:0/3993983166 shutdown_connections 2024-08-31T05:29:47.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.638+0000 7f9868c4c740 1 --2- 172.21.15.5:0/3993983166 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623c709d280 0x5623c7464230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:47.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.638+0000 7f9868c4c740 1 --2- 172.21.15.5:0/3993983166 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5623c70950a0 0x5623c7463cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:47.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.638+0000 7f9868c4c740 1 --2- 172.21.15.5:0/3993983166 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623c70bdf60 0x5623c74637b0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:47.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.638+0000 7f9868c4c740 1 -- 172.21.15.5:0/3993983166 >> 172.21.15.5:0/3993983166 conn(0x5623c70b2350 msgr2=0x5623c74616a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:47.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.638+0000 7f9868c4c740 1 -- 172.21.15.5:0/3993983166 shutdown_connections 2024-08-31T05:29:47.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.638+0000 7f9868c4c740 1 -- 172.21.15.5:0/3993983166 wait complete. 2024-08-31T05:29:47.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.638+0000 7f9868c4c740 1 -- start start 2024-08-31T05:29:47.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.639+0000 7f9868c4c740 1 Processor -- start 2024-08-31T05:29:47.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.639+0000 7f9868c4c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623c70950a0 0x5623c746ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:47.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.639+0000 7f9868c4c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5623c709d280 0x5623c746f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:47.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.639+0000 7f9868c4c740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623c70bdf60 0x5623c747b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:47.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.639+0000 7f9868c4c740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5623c722c5f0 con 0x5623c70bdf60 2024-08-31T05:29:47.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.639+0000 7f9868c4c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5623c7350600 con 0x5623c70950a0 2024-08-31T05:29:47.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.639+0000 7f9868c4c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5623c7471f90 con 0x5623c709d280 2024-08-31T05:29:47.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.639+0000 7f9868c4c740 10 client.0 _ll_register_callbacks cb 0x5623c7376af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:29:47.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.639+0000 7f9860c74640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623c70bdf60 0x5623c747b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:47.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.639+0000 7f9860c74640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623c70bdf60 0x5623c747b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54070/0 (socket says 172.21.15.5:54070) 2024-08-31T05:29:47.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.639+0000 7f9860c74640 1 -- 172.21.15.5:0/3549552202 learned_addr learned my addr 172.21.15.5:0/3549552202 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:47.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.639+0000 7f985b7fe640 1 --2- 172.21.15.5:0/3549552202 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5623c709d280 0x5623c746f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:47.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.639+0000 7f985bfff640 1 --2- 172.21.15.5:0/3549552202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623c70950a0 0x5623c746ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:47.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.639+0000 7f9860c74640 1 -- 172.21.15.5:0/3549552202 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5623c709d280 msgr2=0x5623c746f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:47.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.639+0000 7f9860c74640 1 --2- 172.21.15.5:0/3549552202 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5623c709d280 0x5623c746f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:47.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.639+0000 7f9860c74640 1 -- 172.21.15.5:0/3549552202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623c70950a0 msgr2=0x5623c746ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:47.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.639+0000 7f9860c74640 1 --2- 172.21.15.5:0/3549552202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623c70950a0 0x5623c746ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:47.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.639+0000 7f9860c74640 1 -- 172.21.15.5:0/3549552202 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623c73897b0 con 0x5623c70bdf60 2024-08-31T05:29:47.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.639+0000 7f985bfff640 1 --2- 172.21.15.5:0/3549552202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623c70950a0 0x5623c746ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:29:47.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.640+0000 7f9860c74640 1 --2- 172.21.15.5:0/3549552202 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623c70bdf60 0x5623c747b280 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f985402ade0 tx=0x7f9854004970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d29482d4dde43910 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:47.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.640+0000 7f983b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:29:47.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.640+0000 7f983b7fe640 1 -- 172.21.15.5:0/3549552202 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f985404d040 con 0x5623c70bdf60 2024-08-31T05:29:47.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.640+0000 7f983b7fe640 1 -- 172.21.15.5:0/3549552202 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f985402fac0 con 0x5623c70bdf60 2024-08-31T05:29:47.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.640+0000 7f9868c4c740 1 -- 172.21.15.5:0/3549552202 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9854036040 con 0x5623c70bdf60 2024-08-31T05:29:47.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.640+0000 7f983b7fe640 1 -- 172.21.15.5:0/3549552202 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9854064050 con 0x5623c70bdf60 2024-08-31T05:29:47.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.640+0000 7f9868c4c740 10 client.15450 fetch_fsmap learned FSMap version 29 2024-08-31T05:29:47.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.640+0000 7f9868c4c740 1 -- 172.21.15.5:0/3549552202 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5623c747dc60 con 0x5623c70bdf60 2024-08-31T05:29:47.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.640+0000 7f983b7fe640 1 -- 172.21.15.5:0/3549552202 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9854036040 con 0x5623c70bdf60 2024-08-31T05:29:47.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.641+0000 7f983b7fe640 1 -- 172.21.15.5:0/3549552202 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f9854043050 con 0x5623c70bdf60 2024-08-31T05:29:47.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.641+0000 7f9868c4c740 10 client.15450 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T05:29:47.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.641+0000 7f9868c4c740 10 client.15450 resolve_mds: resolved name 'f' to daemon mds.f 2024-08-31T05:29:47.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.641+0000 7f9868c4c740 20 client.15450 populate_metadata read hostname 'smithi005' 2024-08-31T05:29:47.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.641+0000 7f9868c4c740 1 --2- 172.21.15.5:0/3549552202 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5623c707c8e0 0x5623c7481200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:47.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.641+0000 7f9868c4c740 4 client.15450 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:29:47.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.641+0000 7f9868c4c740 1 -- 172.21.15.5:0/3549552202 --> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5623c73dc340 con 0x5623c707c8e0 2024-08-31T05:29:47.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.641+0000 7f985bfff640 1 --2- 172.21.15.5:0/3549552202 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5623c707c8e0 0x5623c7481200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:47.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.641+0000 7f985bfff640 1 --2- 172.21.15.5:0/3549552202 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5623c707c8e0 0x5623c7481200 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=449dcf5216b630af server_cookie=4035cfde98ee3a47 in_seq=0 out_seq=0 2024-08-31T05:29:47.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.641+0000 7f983b7fe640 10 client.15450 ms_handle_connect on v2:172.21.15.70:6834/2061504114 2024-08-31T05:29:47.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.642+0000 7f983b7fe640 1 -- 172.21.15.5:0/3549552202 <== mds.3 v2:172.21.15.70:6834/2061504114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5623c73dc340 con 0x5623c707c8e0 2024-08-31T05:29:47.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.642+0000 7f983b7fe640 10 client.15450 handle_command_reply: tid=0 2024-08-31T05:29:47.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.642+0000 7f9868c4c740 1 client.15450 shutdown 2024-08-31T05:29:47.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.642+0000 7f9868c4c740 1 -- 172.21.15.5:0/3549552202 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623c70bdf60 msgr2=0x5623c747b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:47.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.642+0000 7f9868c4c740 1 --2- 172.21.15.5:0/3549552202 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623c70bdf60 0x5623c747b280 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f985402ade0 tx=0x7f9854004970 comp rx=0 tx=0).stop 2024-08-31T05:29:47.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.642+0000 7f9868c4c740 1 -- 172.21.15.5:0/3549552202 shutdown_connections 2024-08-31T05:29:47.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.642+0000 7f9868c4c740 1 --2- 172.21.15.5:0/3549552202 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5623c707c8e0 0x5623c7481200 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:47.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.642+0000 7f9868c4c740 1 --2- 172.21.15.5:0/3549552202 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623c70bdf60 0x5623c747b280 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:47.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.642+0000 7f9868c4c740 1 --2- 172.21.15.5:0/3549552202 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5623c709d280 0x5623c746f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:47.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.642+0000 7f983b7fe640 0 client.15450 ms_handle_reset on v2:172.21.15.70:6834/2061504114 2024-08-31T05:29:47.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.642+0000 7f9868c4c740 1 --2- 172.21.15.5:0/3549552202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623c70950a0 0x5623c746ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:47.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.642+0000 7f9868c4c740 1 -- 172.21.15.5:0/3549552202 >> 172.21.15.5:0/3549552202 conn(0x5623c70b2350 msgr2=0x5623c7466990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:47.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.642+0000 7f9868c4c740 1 -- 172.21.15.5:0/3549552202 shutdown_connections 2024-08-31T05:29:47.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.642+0000 7f9868c4c740 1 -- 172.21.15.5:0/3549552202 wait complete. 2024-08-31T05:29:47.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.643+0000 7f9868c4c740 20 client.15450 trim_cache size 0 max 16384 2024-08-31T05:29:47.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.661+0000 7f9868c4c740 1 Processor -- start 2024-08-31T05:29:47.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.661+0000 7f9868c4c740 1 -- start start 2024-08-31T05:29:47.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.661+0000 7f9868c4c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623c70950a0 0x5623c7470d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:47.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.661+0000 7f9868c4c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5623c709d280 0x5623c746f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:47.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.661+0000 7f9868c4c740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623c70bdf60 0x5623c7464ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:47.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.661+0000 7f9868c4c740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5623c747f540 con 0x5623c70bdf60 2024-08-31T05:29:47.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.661+0000 7f9868c4c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5623c747fc10 con 0x5623c70950a0 2024-08-31T05:29:47.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.661+0000 7f9868c4c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5623c74802e0 con 0x5623c709d280 2024-08-31T05:29:47.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.661+0000 7f9860c74640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623c70bdf60 0x5623c7464ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:47.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.661+0000 7f985bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623c70950a0 0x5623c7470d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:47.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.661+0000 7f9860c74640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623c70bdf60 0x5623c7464ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54084/0 (socket says 172.21.15.5:54084) 2024-08-31T05:29:47.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.661+0000 7f9860c74640 1 -- 172.21.15.5:0/4189874631 learned_addr learned my addr 172.21.15.5:0/4189874631 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:47.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.661+0000 7f985bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623c70950a0 0x5623c7470d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:44804/0 (socket says 172.21.15.5:44804) 2024-08-31T05:29:47.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.662+0000 7f985b7fe640 1 --2- 172.21.15.5:0/4189874631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5623c709d280 0x5623c746f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:47.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.662+0000 7f9860c74640 1 -- 172.21.15.5:0/4189874631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5623c709d280 msgr2=0x5623c746f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:47.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.662+0000 7f9860c74640 1 --2- 172.21.15.5:0/4189874631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5623c709d280 0x5623c746f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:47.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.662+0000 7f9860c74640 1 -- 172.21.15.5:0/4189874631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623c70950a0 msgr2=0x5623c7470d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:47.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.662+0000 7f9860c74640 1 --2- 172.21.15.5:0/4189874631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623c70950a0 0x5623c7470d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:47.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.662+0000 7f9860c74640 1 -- 172.21.15.5:0/4189874631 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623c7465cd0 con 0x5623c70bdf60 2024-08-31T05:29:47.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.662+0000 7f9860c74640 1 --2- 172.21.15.5:0/4189874631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623c70bdf60 0x5623c7464ef0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f985402f9d0 tx=0x7f9854000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fea14584213eff1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:47.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.662+0000 7f9841ffb640 1 -- 172.21.15.5:0/4189874631 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f985404d040 con 0x5623c70bdf60 2024-08-31T05:29:47.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.662+0000 7f9841ffb640 1 -- 172.21.15.5:0/4189874631 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9854036040 con 0x5623c70bdf60 2024-08-31T05:29:47.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.662+0000 7f9841ffb640 1 -- 172.21.15.5:0/4189874631 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9854030ed0 con 0x5623c70bdf60 2024-08-31T05:29:47.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.663+0000 7f9868c4c740 1 -- 172.21.15.5:0/4189874631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623c70bdf60 msgr2=0x5623c7464ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:47.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.663+0000 7f9868c4c740 1 --2- 172.21.15.5:0/4189874631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623c70bdf60 0x5623c7464ef0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f985402f9d0 tx=0x7f9854000f40 comp rx=0 tx=0).stop 2024-08-31T05:29:47.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.663+0000 7f9868c4c740 1 -- 172.21.15.5:0/4189874631 shutdown_connections 2024-08-31T05:29:47.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.663+0000 7f9868c4c740 1 --2- 172.21.15.5:0/4189874631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623c70bdf60 0x5623c7464ef0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:47.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.663+0000 7f9868c4c740 1 --2- 172.21.15.5:0/4189874631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5623c709d280 0x5623c746f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:47.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.663+0000 7f9868c4c740 1 --2- 172.21.15.5:0/4189874631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623c70950a0 0x5623c7470d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:47.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.663+0000 7f9868c4c740 1 -- 172.21.15.5:0/4189874631 >> 172.21.15.5:0/4189874631 conn(0x5623c70b2350 msgr2=0x5623c74647e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:47.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.663+0000 7f9868c4c740 1 -- 172.21.15.5:0/4189874631 shutdown_connections 2024-08-31T05:29:47.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.663+0000 7f9868c4c740 1 -- 172.21.15.5:0/4189874631 wait complete. 2024-08-31T05:29:47.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.664+0000 7f9868c4c740 1 -- start start 2024-08-31T05:29:47.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.664+0000 7f9868c4c740 1 Processor -- start 2024-08-31T05:29:47.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.664+0000 7f9868c4c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623c70950a0 0x5623c7483810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:47.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.664+0000 7f9868c4c740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623c709d280 0x5623c7483d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:47.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.665+0000 7f9868c4c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5623c70bdf60 0x5623c7488fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:47.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.665+0000 7f9868c4c740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5623c7481080 con 0x5623c709d280 2024-08-31T05:29:47.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.665+0000 7f9868c4c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5623c74809b0 con 0x5623c70950a0 2024-08-31T05:29:47.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.665+0000 7f9868c4c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5623c7481750 con 0x5623c70bdf60 2024-08-31T05:29:47.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.665+0000 7f9868c4c740 10 client.0 _ll_register_callbacks cb 0x7f9854009800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:29:47.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.665+0000 7f985b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623c709d280 0x5623c7483d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:47.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.665+0000 7f985bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623c70950a0 0x5623c7483810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:47.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.665+0000 7f985b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623c709d280 0x5623c7483d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54088/0 (socket says 172.21.15.5:54088) 2024-08-31T05:29:47.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.665+0000 7f985b7fe640 1 -- 172.21.15.5:0/3105877877 learned_addr learned my addr 172.21.15.5:0/3105877877 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:47.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.665+0000 7f9860c74640 1 --2- 172.21.15.5:0/3105877877 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5623c70bdf60 0x5623c7488fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:47.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.665+0000 7f985b7fe640 1 -- 172.21.15.5:0/3105877877 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5623c70bdf60 msgr2=0x5623c7488fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:47.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.665+0000 7f985b7fe640 1 --2- 172.21.15.5:0/3105877877 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5623c70bdf60 0x5623c7488fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:47.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.665+0000 7f985b7fe640 1 -- 172.21.15.5:0/3105877877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623c70950a0 msgr2=0x5623c7483810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:47.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.665+0000 7f985b7fe640 1 --2- 172.21.15.5:0/3105877877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623c70950a0 0x5623c7483810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:47.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.665+0000 7f985b7fe640 1 -- 172.21.15.5:0/3105877877 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623c74894e0 con 0x5623c709d280 2024-08-31T05:29:47.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.665+0000 7f985bfff640 1 --2- 172.21.15.5:0/3105877877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623c70950a0 0x5623c7483810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:29:47.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.665+0000 7f9860c74640 1 --2- 172.21.15.5:0/3105877877 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5623c70bdf60 0x5623c7488fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:29:47.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.665+0000 7f985b7fe640 1 --2- 172.21.15.5:0/3105877877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623c709d280 0x5623c7483d50 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f9850011a30 tx=0x7f9850011ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbe7e46efaf0a99d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:47.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.665+0000 7f983b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:29:47.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.666+0000 7f983b7fe640 1 -- 172.21.15.5:0/3105877877 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9850010b20 con 0x5623c709d280 2024-08-31T05:29:47.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.666+0000 7f983b7fe640 1 -- 172.21.15.5:0/3105877877 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f9850010cc0 con 0x5623c709d280 2024-08-31T05:29:47.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.666+0000 7f9868c4c740 1 -- 172.21.15.5:0/3105877877 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9854036040 con 0x5623c709d280 2024-08-31T05:29:47.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.666+0000 7f983b7fe640 1 -- 172.21.15.5:0/3105877877 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9850029050 con 0x5623c709d280 2024-08-31T05:29:47.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.666+0000 7f9868c4c740 10 client.15456 fetch_fsmap learned FSMap version 29 2024-08-31T05:29:47.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.666+0000 7f9868c4c740 1 -- 172.21.15.5:0/3105877877 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5623c74ecd80 con 0x5623c709d280 2024-08-31T05:29:47.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.666+0000 7f983b7fe640 1 -- 172.21.15.5:0/3105877877 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9854036040 con 0x5623c709d280 2024-08-31T05:29:47.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.666+0000 7f983b7fe640 1 -- 172.21.15.5:0/3105877877 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f985000e420 con 0x5623c709d280 2024-08-31T05:29:47.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.666+0000 7f9868c4c740 10 client.15456 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T05:29:47.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.666+0000 7f9868c4c740 10 client.15456 resolve_mds: resolved name 'f' to daemon mds.f 2024-08-31T05:29:47.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.666+0000 7f9868c4c740 20 client.15456 populate_metadata read hostname 'smithi005' 2024-08-31T05:29:47.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.666+0000 7f9868c4c740 1 --2- 172.21.15.5:0/3105877877 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5623c7051c90 0x5623c74f0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:47.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.666+0000 7f9868c4c740 4 client.15456 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T05:29:47.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.666+0000 7f9868c4c740 1 -- 172.21.15.5:0/3105877877 --> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] -- command(tid 0: {"prefix": "status"}) -- 0x5623c73d7de0 con 0x5623c7051c90 2024-08-31T05:29:47.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.667+0000 7f985bfff640 1 --2- 172.21.15.5:0/3105877877 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5623c7051c90 0x5623c74f0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:47.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.667+0000 7f985bfff640 1 --2- 172.21.15.5:0/3105877877 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5623c7051c90 0x5623c74f0740 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8540a08716d5d040 server_cookie=211b12976c5749e7 in_seq=0 out_seq=0 2024-08-31T05:29:47.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.667+0000 7f983b7fe640 10 client.15456 ms_handle_connect on v2:172.21.15.70:6834/2061504114 2024-08-31T05:29:47.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.667+0000 7f983b7fe640 1 -- 172.21.15.5:0/3105877877 <== mds.3 v2:172.21.15.70:6834/2061504114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5623c73d7de0 con 0x5623c7051c90 2024-08-31T05:29:47.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.667+0000 7f983b7fe640 10 client.15456 handle_command_reply: tid=0 2024-08-31T05:29:47.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.667+0000 7f9868c4c740 1 client.15456 shutdown 2024-08-31T05:29:47.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.668+0000 7f9868c4c740 1 -- 172.21.15.5:0/3105877877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623c709d280 msgr2=0x5623c7483d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:47.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.668+0000 7f9868c4c740 1 --2- 172.21.15.5:0/3105877877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623c709d280 0x5623c7483d50 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f9850011a30 tx=0x7f9850011ef0 comp rx=0 tx=0).stop 2024-08-31T05:29:47.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.668+0000 7f9868c4c740 1 -- 172.21.15.5:0/3105877877 shutdown_connections 2024-08-31T05:29:47.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.668+0000 7f9868c4c740 1 --2- 172.21.15.5:0/3105877877 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5623c7051c90 0x5623c74f0740 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:47.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.668+0000 7f9868c4c740 1 --2- 172.21.15.5:0/3105877877 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5623c70bdf60 0x5623c7488fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:47.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.668+0000 7f9868c4c740 1 --2- 172.21.15.5:0/3105877877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623c709d280 0x5623c7483d50 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:47.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.668+0000 7f9868c4c740 1 --2- 172.21.15.5:0/3105877877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5623c70950a0 0x5623c7483810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:47.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.668+0000 7f9868c4c740 1 -- 172.21.15.5:0/3105877877 >> 172.21.15.5:0/3105877877 conn(0x5623c70b2350 msgr2=0x5623c74651a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:47.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.668+0000 7f983b7fe640 0 client.15456 ms_handle_reset on v2:172.21.15.70:6834/2061504114 2024-08-31T05:29:47.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.668+0000 7f9868c4c740 1 -- 172.21.15.5:0/3105877877 shutdown_connections 2024-08-31T05:29:47.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.668+0000 7f9868c4c740 1 -- 172.21.15.5:0/3105877877 wait complete. 2024-08-31T05:29:47.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.668+0000 7f9868c4c740 20 client.15456 trim_cache size 0 max 16384 2024-08-31T05:29:47.681 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:29:47.681 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "69422704-6758-11ef-bcd4-c7b262605968", 2024-08-31T05:29:47.681 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 3, 2024-08-31T05:29:47.681 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 24625, 2024-08-31T05:29:47.681 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-08-31T05:29:47.681 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-08-31T05:29:47.681 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-08-31T05:29:47.681 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 97.105893819000002, 2024-08-31T05:29:47.681 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 29, 2024-08-31T05:29:47.681 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 87, 2024-08-31T05:29:47.681 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 85, 2024-08-31T05:29:47.681 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 163.201737288 2024-08-31T05:29:47.682 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:29:47.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.668+0000 7f98626d7640 1 -- 172.21.15.5:0/3087142000 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f98440b4b80 msgr2=0x7f98440b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:47.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.668+0000 7f98626d7640 1 --2- 172.21.15.5:0/3087142000 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f98440b4b80 0x7f98440b7090 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f985404a000 tx=0x7f985404b000 comp rx=0 tx=0).stop 2024-08-31T05:29:47.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.668+0000 7f98626d7640 1 -- 172.21.15.5:0/3087142000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f985c102880 msgr2=0x7f985c0ff410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:47.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.668+0000 7f98626d7640 1 --2- 172.21.15.5:0/3087142000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f985c102880 0x7f985c0ff410 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f984c00d950 tx=0x7f984c00de10 comp rx=0 tx=0).stop 2024-08-31T05:29:47.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.669+0000 7f98626d7640 1 -- 172.21.15.5:0/3087142000 shutdown_connections 2024-08-31T05:29:47.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.669+0000 7f98626d7640 1 --2- 172.21.15.5:0/3087142000 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f98440b4b80 0x7f98440b7090 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:47.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.669+0000 7f98626d7640 1 --2- 172.21.15.5:0/3087142000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f985c108b10 0x7f985c0ffe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:47.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.669+0000 7f98626d7640 1 --2- 172.21.15.5:0/3087142000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f985c1081c0 0x7f985c0ff950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:47.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.669+0000 7f98626d7640 1 --2- 172.21.15.5:0/3087142000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f985c102880 0x7f985c0ff410 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:47.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.669+0000 7f98626d7640 1 -- 172.21.15.5:0/3087142000 >> 172.21.15.5:0/3087142000 conn(0x7f985c079510 msgr2=0x7f985c1017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:47.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.669+0000 7f98626d7640 1 -- 172.21.15.5:0/3087142000 shutdown_connections 2024-08-31T05:29:47.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:47.669+0000 7f98626d7640 1 -- 172.21.15.5:0/3087142000 wait complete. 2024-08-31T05:29:48.352 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.c status 2024-08-31T05:29:48.606 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:29:48.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:48 smithi005 ceph-mon[18602]: pgmap v340: 129 pgs: 129 active+clean; 645 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-31T05:29:48.835 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:48 smithi070 ceph-mon[22316]: pgmap v340: 129 pgs: 129 active+clean; 645 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-31T05:29:48.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:48 smithi050 ceph-mon[22146]: pgmap v340: 129 pgs: 129 active+clean; 645 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-31T05:29:49.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.089+0000 7fc2ca8fa640 1 -- 172.21.15.5:0/1934496976 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2c4109240 msgr2=0x7fc2c4109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:49.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.089+0000 7fc2ca8fa640 1 --2- 172.21.15.5:0/1934496976 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2c4109240 0x7fc2c4109650 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fc2b8009900 tx=0x7fc2b802a410 comp rx=0 tx=0).stop 2024-08-31T05:29:49.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.089+0000 7fc2ca8fa640 1 -- 172.21.15.5:0/1934496976 shutdown_connections 2024-08-31T05:29:49.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.089+0000 7fc2ca8fa640 1 --2- 172.21.15.5:0/1934496976 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c4109b90 0x7fc2c41103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:49.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.089+0000 7fc2ca8fa640 1 --2- 172.21.15.5:0/1934496976 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2c4109240 0x7fc2c4109650 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:49.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.089+0000 7fc2ca8fa640 1 --2- 172.21.15.5:0/1934496976 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2c4103900 0x7fc2c4103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:49.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.089+0000 7fc2ca8fa640 1 -- 172.21.15.5:0/1934496976 >> 172.21.15.5:0/1934496976 conn(0x7fc2c407b5f0 msgr2=0x7fc2c407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:49.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.089+0000 7fc2ca8fa640 1 -- 172.21.15.5:0/1934496976 shutdown_connections 2024-08-31T05:29:49.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.089+0000 7fc2ca8fa640 1 -- 172.21.15.5:0/1934496976 wait complete. 2024-08-31T05:29:49.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.090+0000 7fc2ca8fa640 1 Processor -- start 2024-08-31T05:29:49.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.090+0000 7fc2ca8fa640 1 -- start start 2024-08-31T05:29:49.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.090+0000 7fc2ca8fa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2c4103900 0x7fc2c419a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:49.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.090+0000 7fc2ca8fa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c4109240 0x7fc2c419a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:49.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.090+0000 7fc2ca8fa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2c4109b90 0x7fc2c419fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:49.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.090+0000 7fc2ca8fa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c4113850 con 0x7fc2c4103900 2024-08-31T05:29:49.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.090+0000 7fc2ca8fa640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c41136d0 con 0x7fc2c4109240 2024-08-31T05:29:49.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.090+0000 7fc2ca8fa640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c41139d0 con 0x7fc2c4109b90 2024-08-31T05:29:49.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.091+0000 7fc2c3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2c4103900 0x7fc2c419a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:49.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.091+0000 7fc2c3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2c4103900 0x7fc2c419a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54104/0 (socket says 172.21.15.5:54104) 2024-08-31T05:29:49.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.091+0000 7fc2c3fff640 1 -- 172.21.15.5:0/1221878462 learned_addr learned my addr 172.21.15.5:0/1221878462 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:49.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.091+0000 7fc2c8e97640 1 --2- 172.21.15.5:0/1221878462 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2c4109b90 0x7fc2c419fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:49.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.091+0000 7fc2c37fe640 1 --2- 172.21.15.5:0/1221878462 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c4109240 0x7fc2c419a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:49.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.091+0000 7fc2c3fff640 1 -- 172.21.15.5:0/1221878462 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2c4109b90 msgr2=0x7fc2c419fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:49.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.091+0000 7fc2c3fff640 1 --2- 172.21.15.5:0/1221878462 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2c4109b90 0x7fc2c419fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:49.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.091+0000 7fc2c3fff640 1 -- 172.21.15.5:0/1221878462 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c4109240 msgr2=0x7fc2c419a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:49.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.091+0000 7fc2c3fff640 1 --2- 172.21.15.5:0/1221878462 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c4109240 0x7fc2c419a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:49.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.091+0000 7fc2c3fff640 1 -- 172.21.15.5:0/1221878462 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2c41a02b0 con 0x7fc2c4103900 2024-08-31T05:29:49.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.091+0000 7fc2c3fff640 1 --2- 172.21.15.5:0/1221878462 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2c4103900 0x7fc2c419a340 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc2b400d770 tx=0x7fc2b400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:49.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.091+0000 7fc2c17fa640 1 -- 172.21.15.5:0/1221878462 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b4017070 con 0x7fc2c4103900 2024-08-31T05:29:49.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.091+0000 7fc2ca8fa640 1 -- 172.21.15.5:0/1221878462 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2c41a05a0 con 0x7fc2c4103900 2024-08-31T05:29:49.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.091+0000 7fc2c17fa640 1 -- 172.21.15.5:0/1221878462 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2b40054d0 con 0x7fc2c4103900 2024-08-31T05:29:49.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.091+0000 7fc2c17fa640 1 -- 172.21.15.5:0/1221878462 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b4004c30 con 0x7fc2c4103900 2024-08-31T05:29:49.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.092+0000 7fc2ca8fa640 1 -- 172.21.15.5:0/1221878462 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2c41a6d00 con 0x7fc2c4103900 2024-08-31T05:29:49.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.094+0000 7fc2c17fa640 1 -- 172.21.15.5:0/1221878462 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) ==== 152593+0+0 (secure 0 0 0) 0x7fc2b4004e10 con 0x7fc2c4103900 2024-08-31T05:29:49.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.094+0000 7fc2d0e6f740 1 Processor -- start 2024-08-31T05:29:49.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.094+0000 7fc2d0e6f740 1 -- start start 2024-08-31T05:29:49.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.095+0000 7fc2d0e6f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5599e0b61f60 0x5599e0f077b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:49.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.095+0000 7fc2d0e6f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599e0b390a0 0x5599e0f07cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:49.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.095+0000 7fc2d0e6f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599e0b41280 0x5599e0f08230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:49.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.095+0000 7fc2d0e6f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5599e0e7e3f0 con 0x5599e0b390a0 2024-08-31T05:29:49.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.095+0000 7fc2d0e6f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5599e0e6d980 con 0x5599e0b61f60 2024-08-31T05:29:49.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.095+0000 7fc2d0e6f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5599e0e71930 con 0x5599e0b41280 2024-08-31T05:29:49.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.095+0000 7fc2c3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599e0b390a0 0x5599e0f07cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:49.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.095+0000 7fc2c3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599e0b390a0 0x5599e0f07cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54116/0 (socket says 172.21.15.5:54116) 2024-08-31T05:29:49.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.095+0000 7fc2c8e97640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5599e0b61f60 0x5599e0f077b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:49.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.095+0000 7fc2c3fff640 1 -- 172.21.15.5:0/3061993877 learned_addr learned my addr 172.21.15.5:0/3061993877 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:49.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.095+0000 7fc2c17fa640 1 --2- 172.21.15.5:0/1221878462 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc2ac0b4b80 0x7fc2ac0b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:49.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.095+0000 7fc2c37fe640 1 --2- 172.21.15.5:0/3061993877 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599e0b41280 0x5599e0f08230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:49.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.095+0000 7fc2c8e97640 1 --2- 172.21.15.5:0/1221878462 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc2ac0b4b80 0x7fc2ac0b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:49.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.095+0000 7fc2c8e97640 1 -- 172.21.15.5:0/3061993877 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599e0b41280 msgr2=0x5599e0f08230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:49.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.095+0000 7fc2c8e97640 1 --2- 172.21.15.5:0/3061993877 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599e0b41280 0x5599e0f08230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:49.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.095+0000 7fc2c8e97640 1 -- 172.21.15.5:0/3061993877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599e0b390a0 msgr2=0x5599e0f07cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:49.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.095+0000 7fc2c8e97640 1 --2- 172.21.15.5:0/3061993877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599e0b390a0 0x5599e0f07cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:49.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.095+0000 7fc2c8e97640 1 -- 172.21.15.5:0/3061993877 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599e0bcd540 con 0x5599e0b61f60 2024-08-31T05:29:49.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.095+0000 7fc2c3fff640 1 --2- 172.21.15.5:0/3061993877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599e0b390a0 0x5599e0f07cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:29:49.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.095+0000 7fc2c37fe640 1 --2- 172.21.15.5:0/3061993877 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599e0b41280 0x5599e0f08230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:29:49.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.095+0000 7fc2c17fa640 1 -- 172.21.15.5:0/1221878462 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fc2b40e50a0 con 0x7fc2c4103900 2024-08-31T05:29:49.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.095+0000 7fc2c8e97640 1 --2- 172.21.15.5:0/3061993877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5599e0b61f60 0x5599e0f077b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc0149a0 tx=0x7fc2bc014e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74d6b35ba3d96b0a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:49.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.096+0000 7fc2c8e97640 1 --2- 172.21.15.5:0/1221878462 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc2ac0b4b80 0x7fc2ac0b7090 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc01c000 tx=0x7fc2bc01e000 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:49.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.096+0000 7fc2aa7fc640 1 -- 172.21.15.5:0/3061993877 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc023070 con 0x5599e0b61f60 2024-08-31T05:29:49.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.096+0000 7fc2aa7fc640 1 -- 172.21.15.5:0/3061993877 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2bc014030 con 0x5599e0b61f60 2024-08-31T05:29:49.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.096+0000 7fc2aa7fc640 1 -- 172.21.15.5:0/3061993877 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc0138b0 con 0x5599e0b61f60 2024-08-31T05:29:49.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.097+0000 7fc2d0e6f740 1 -- 172.21.15.5:0/3061993877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5599e0b61f60 msgr2=0x5599e0f077b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:49.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.097+0000 7fc2d0e6f740 1 --2- 172.21.15.5:0/3061993877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5599e0b61f60 0x5599e0f077b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc0149a0 tx=0x7fc2bc014e60 comp rx=0 tx=0).stop 2024-08-31T05:29:49.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.097+0000 7fc2d0e6f740 1 -- 172.21.15.5:0/3061993877 shutdown_connections 2024-08-31T05:29:49.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.097+0000 7fc2d0e6f740 1 --2- 172.21.15.5:0/3061993877 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599e0b41280 0x5599e0f08230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:49.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.097+0000 7fc2d0e6f740 1 --2- 172.21.15.5:0/3061993877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599e0b390a0 0x5599e0f07cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:49.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.097+0000 7fc2d0e6f740 1 --2- 172.21.15.5:0/3061993877 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5599e0b61f60 0x5599e0f077b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:49.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.097+0000 7fc2d0e6f740 1 -- 172.21.15.5:0/3061993877 >> 172.21.15.5:0/3061993877 conn(0x5599e0b56350 msgr2=0x5599e0f056a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:49.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.097+0000 7fc2d0e6f740 1 -- 172.21.15.5:0/3061993877 shutdown_connections 2024-08-31T05:29:49.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.097+0000 7fc2d0e6f740 1 -- 172.21.15.5:0/3061993877 wait complete. 2024-08-31T05:29:49.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.097+0000 7fc2d0e6f740 1 -- start start 2024-08-31T05:29:49.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.097+0000 7fc2d0e6f740 1 Processor -- start 2024-08-31T05:29:49.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.098+0000 7fc2d0e6f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599e0b390a0 0x5599e0f12ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:49.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.098+0000 7fc2d0e6f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5599e0b41280 0x5599e0f13400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:49.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.098+0000 7fc2d0e6f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599e0b61f60 0x5599e0f1f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:49.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.098+0000 7fc2d0e6f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5599e0cd05f0 con 0x5599e0b61f60 2024-08-31T05:29:49.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.098+0000 7fc2d0e6f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5599e0df4600 con 0x5599e0b41280 2024-08-31T05:29:49.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.098+0000 7fc2d0e6f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5599e0f15f90 con 0x5599e0b390a0 2024-08-31T05:29:49.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.098+0000 7fc2d0e6f740 10 client.0 _ll_register_callbacks cb 0x5599e0e1aaf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:29:49.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.098+0000 7fc2c8e97640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599e0b61f60 0x5599e0f1f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:49.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.098+0000 7fc2c8e97640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599e0b61f60 0x5599e0f1f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54122/0 (socket says 172.21.15.5:54122) 2024-08-31T05:29:49.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.098+0000 7fc2c8e97640 1 -- 172.21.15.5:0/1504455516 learned_addr learned my addr 172.21.15.5:0/1504455516 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:49.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.098+0000 7fc2c37fe640 1 --2- 172.21.15.5:0/1504455516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5599e0b41280 0x5599e0f13400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:49.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.098+0000 7fc2c3fff640 1 --2- 172.21.15.5:0/1504455516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599e0b390a0 0x5599e0f12ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:49.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.098+0000 7fc2c8e97640 1 -- 172.21.15.5:0/1504455516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599e0b390a0 msgr2=0x5599e0f12ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:49.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.098+0000 7fc2c8e97640 1 --2- 172.21.15.5:0/1504455516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599e0b390a0 0x5599e0f12ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:49.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.098+0000 7fc2c8e97640 1 -- 172.21.15.5:0/1504455516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5599e0b41280 msgr2=0x5599e0f13400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:49.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.098+0000 7fc2c8e97640 1 --2- 172.21.15.5:0/1504455516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5599e0b41280 0x5599e0f13400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:49.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.098+0000 7fc2c8e97640 1 -- 172.21.15.5:0/1504455516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599e0e2d7b0 con 0x5599e0b61f60 2024-08-31T05:29:49.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.098+0000 7fc2c37fe640 1 --2- 172.21.15.5:0/1504455516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5599e0b41280 0x5599e0f13400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:29:49.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.098+0000 7fc2c8e97640 1 --2- 172.21.15.5:0/1504455516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599e0b61f60 0x5599e0f1f2b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc00ec70 tx=0x7fc2bc0146d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b243666c04e7a343 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:49.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.098+0000 7fc2a37fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:29:49.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.098+0000 7fc2a37fe640 1 -- 172.21.15.5:0/1504455516 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc023030 con 0x5599e0b61f60 2024-08-31T05:29:49.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.099+0000 7fc2a37fe640 1 -- 172.21.15.5:0/1504455516 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fc2bc00ed10 con 0x5599e0b61f60 2024-08-31T05:29:49.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.099+0000 7fc2d0e6f740 1 -- 172.21.15.5:0/1504455516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2bc014030 con 0x5599e0b61f60 2024-08-31T05:29:49.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.099+0000 7fc2a37fe640 1 -- 172.21.15.5:0/1504455516 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc2bc03b050 con 0x5599e0b61f60 2024-08-31T05:29:49.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.099+0000 7fc2d0e6f740 10 client.15468 fetch_fsmap learned FSMap version 29 2024-08-31T05:29:49.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.099+0000 7fc2d0e6f740 1 -- 172.21.15.5:0/1504455516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5599e0f21cd0 con 0x5599e0b61f60 2024-08-31T05:29:49.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.099+0000 7fc2a37fe640 1 -- 172.21.15.5:0/1504455516 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2bc014030 con 0x5599e0b61f60 2024-08-31T05:29:49.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.099+0000 7fc2a37fe640 1 -- 172.21.15.5:0/1504455516 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fc2bc00f040 con 0x5599e0b61f60 2024-08-31T05:29:49.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.099+0000 7fc2d0e6f740 10 client.15468 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T05:29:49.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.099+0000 7fc2d0e6f740 10 client.15468 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-31T05:29:49.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.099+0000 7fc2d0e6f740 20 client.15468 populate_metadata read hostname 'smithi005' 2024-08-31T05:29:49.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.099+0000 7fc2d0e6f740 1 --2- 172.21.15.5:0/1504455516 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x5599e0b208e0 0x5599e0f254b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:49.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.099+0000 7fc2d0e6f740 4 client.15468 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:29:49.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.099+0000 7fc2d0e6f740 1 -- 172.21.15.5:0/1504455516 --> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5599e0e80340 con 0x5599e0b208e0 2024-08-31T05:29:49.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.100+0000 7fc2c3fff640 1 --2- 172.21.15.5:0/1504455516 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x5599e0b208e0 0x5599e0f254b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:49.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.100+0000 7fc2c3fff640 1 --2- 172.21.15.5:0/1504455516 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x5599e0b208e0 0x5599e0f254b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d488ea267f68cd20 server_cookie=3fe99dab85375c94 in_seq=0 out_seq=0 2024-08-31T05:29:49.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.100+0000 7fc2a37fe640 10 client.15468 ms_handle_connect on v2:172.21.15.70:6836/2780036414 2024-08-31T05:29:49.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.101+0000 7fc2a37fe640 1 -- 172.21.15.5:0/1504455516 <== mds.2 v2:172.21.15.70:6836/2780036414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5599e0e80340 con 0x5599e0b208e0 2024-08-31T05:29:49.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.101+0000 7fc2a37fe640 10 client.15468 handle_command_reply: tid=0 2024-08-31T05:29:49.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.101+0000 7fc2d0e6f740 1 client.15468 shutdown 2024-08-31T05:29:49.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.101+0000 7fc2d0e6f740 1 -- 172.21.15.5:0/1504455516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599e0b61f60 msgr2=0x5599e0f1f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:49.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.101+0000 7fc2d0e6f740 1 --2- 172.21.15.5:0/1504455516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599e0b61f60 0x5599e0f1f2b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc00ec70 tx=0x7fc2bc0146d0 comp rx=0 tx=0).stop 2024-08-31T05:29:49.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.101+0000 7fc2d0e6f740 1 -- 172.21.15.5:0/1504455516 shutdown_connections 2024-08-31T05:29:49.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.101+0000 7fc2d0e6f740 1 --2- 172.21.15.5:0/1504455516 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x5599e0b208e0 0x5599e0f254b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:49.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.101+0000 7fc2d0e6f740 1 --2- 172.21.15.5:0/1504455516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599e0b61f60 0x5599e0f1f2b0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:49.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.101+0000 7fc2d0e6f740 1 --2- 172.21.15.5:0/1504455516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5599e0b41280 0x5599e0f13400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:49.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.101+0000 7fc2d0e6f740 1 --2- 172.21.15.5:0/1504455516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599e0b390a0 0x5599e0f12ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:49.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.101+0000 7fc2a37fe640 0 client.15468 ms_handle_reset on v2:172.21.15.70:6836/2780036414 2024-08-31T05:29:49.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.101+0000 7fc2d0e6f740 1 -- 172.21.15.5:0/1504455516 >> 172.21.15.5:0/1504455516 conn(0x5599e0b56350 msgr2=0x5599e0f0a940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:49.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.101+0000 7fc2d0e6f740 1 -- 172.21.15.5:0/1504455516 shutdown_connections 2024-08-31T05:29:49.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.101+0000 7fc2d0e6f740 1 -- 172.21.15.5:0/1504455516 wait complete. 2024-08-31T05:29:49.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.101+0000 7fc2d0e6f740 20 client.15468 trim_cache size 0 max 16384 2024-08-31T05:29:49.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.120+0000 7fc2d0e6f740 1 Processor -- start 2024-08-31T05:29:49.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.120+0000 7fc2d0e6f740 1 -- start start 2024-08-31T05:29:49.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.120+0000 7fc2d0e6f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5599e0b390a0 0x5599e0f24de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:49.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.120+0000 7fc2d0e6f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599e0b41280 0x5599e0f1f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:49.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.120+0000 7fc2d0e6f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599e0b61f60 0x5599e0f12c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:49.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.120+0000 7fc2d0e6f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5599e0f237f0 con 0x5599e0b41280 2024-08-31T05:29:49.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.120+0000 7fc2d0e6f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5599e0f23ec0 con 0x5599e0b390a0 2024-08-31T05:29:49.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.120+0000 7fc2d0e6f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5599e0f24590 con 0x5599e0b61f60 2024-08-31T05:29:49.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.120+0000 7fc2c37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599e0b41280 0x5599e0f1f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:49.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.120+0000 7fc2c37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599e0b41280 0x5599e0f1f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54138/0 (socket says 172.21.15.5:54138) 2024-08-31T05:29:49.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.120+0000 7fc2c37fe640 1 -- 172.21.15.5:0/2827807455 learned_addr learned my addr 172.21.15.5:0/2827807455 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:49.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.120+0000 7fc2c3fff640 1 --2- 172.21.15.5:0/2827807455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5599e0b390a0 0x5599e0f24de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:49.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.120+0000 7fc2c8e97640 1 --2- 172.21.15.5:0/2827807455 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599e0b61f60 0x5599e0f12c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:49.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.120+0000 7fc2c37fe640 1 -- 172.21.15.5:0/2827807455 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599e0b61f60 msgr2=0x5599e0f12c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:49.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.120+0000 7fc2c37fe640 1 --2- 172.21.15.5:0/2827807455 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599e0b61f60 0x5599e0f12c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:49.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.120+0000 7fc2c37fe640 1 -- 172.21.15.5:0/2827807455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5599e0b390a0 msgr2=0x5599e0f24de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:49.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.120+0000 7fc2c37fe640 1 --2- 172.21.15.5:0/2827807455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5599e0b390a0 0x5599e0f24de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:49.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.120+0000 7fc2c37fe640 1 -- 172.21.15.5:0/2827807455 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599e0f00eb0 con 0x5599e0b41280 2024-08-31T05:29:49.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.121+0000 7fc2c37fe640 1 --2- 172.21.15.5:0/2827807455 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599e0b41280 0x5599e0f1f220 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc2b802abe0 tx=0x7fc2b8032d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b28f62f8fd1acb53 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:49.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.121+0000 7fc2a9ffb640 1 -- 172.21.15.5:0/2827807455 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b8035040 con 0x5599e0b41280 2024-08-31T05:29:49.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.121+0000 7fc2a9ffb640 1 -- 172.21.15.5:0/2827807455 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2b80316a0 con 0x5599e0b41280 2024-08-31T05:29:49.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.121+0000 7fc2a9ffb640 1 -- 172.21.15.5:0/2827807455 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b8004750 con 0x5599e0b41280 2024-08-31T05:29:49.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.121+0000 7fc2d0e6f740 1 -- 172.21.15.5:0/2827807455 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599e0b41280 msgr2=0x5599e0f1f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:49.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.121+0000 7fc2d0e6f740 1 --2- 172.21.15.5:0/2827807455 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599e0b41280 0x5599e0f1f220 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc2b802abe0 tx=0x7fc2b8032d60 comp rx=0 tx=0).stop 2024-08-31T05:29:49.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.122+0000 7fc2d0e6f740 1 -- 172.21.15.5:0/2827807455 shutdown_connections 2024-08-31T05:29:49.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.122+0000 7fc2d0e6f740 1 --2- 172.21.15.5:0/2827807455 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599e0b61f60 0x5599e0f12c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:49.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.122+0000 7fc2d0e6f740 1 --2- 172.21.15.5:0/2827807455 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599e0b41280 0x5599e0f1f220 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:49.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.122+0000 7fc2d0e6f740 1 --2- 172.21.15.5:0/2827807455 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5599e0b390a0 0x5599e0f24de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:49.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.122+0000 7fc2d0e6f740 1 -- 172.21.15.5:0/2827807455 >> 172.21.15.5:0/2827807455 conn(0x5599e0b56350 msgr2=0x5599e0f11740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:49.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.122+0000 7fc2d0e6f740 1 -- 172.21.15.5:0/2827807455 shutdown_connections 2024-08-31T05:29:49.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.122+0000 7fc2d0e6f740 1 -- 172.21.15.5:0/2827807455 wait complete. 2024-08-31T05:29:49.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.122+0000 7fc2d0e6f740 1 -- start start 2024-08-31T05:29:49.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.122+0000 7fc2d0e6f740 1 Processor -- start 2024-08-31T05:29:49.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.123+0000 7fc2d0e6f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599e0b390a0 0x5599e0f2dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:49.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.123+0000 7fc2d0e6f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599e0b41280 0x5599e0f27090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:49.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.123+0000 7fc2d0e6f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5599e0b61f60 0x5599e0f275d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:49.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.123+0000 7fc2d0e6f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5599e0f25330 con 0x5599e0b390a0 2024-08-31T05:29:49.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.123+0000 7fc2d0e6f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5599e0f24c60 con 0x5599e0b61f60 2024-08-31T05:29:49.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.123+0000 7fc2d0e6f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5599e0f25a00 con 0x5599e0b41280 2024-08-31T05:29:49.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.123+0000 7fc2c3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599e0b390a0 0x5599e0f2dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:49.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.123+0000 7fc2c3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599e0b390a0 0x5599e0f2dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54148/0 (socket says 172.21.15.5:54148) 2024-08-31T05:29:49.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.123+0000 7fc2c3fff640 1 -- 172.21.15.5:0/3019822989 learned_addr learned my addr 172.21.15.5:0/3019822989 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:49.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.123+0000 7fc2d0e6f740 10 client.0 _ll_register_callbacks cb 0x7fc2bc0147a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:29:49.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.123+0000 7fc2c8e97640 1 --2- 172.21.15.5:0/3019822989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5599e0b61f60 0x5599e0f275d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:49.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.123+0000 7fc2c37fe640 1 --2- 172.21.15.5:0/3019822989 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599e0b41280 0x5599e0f27090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:49.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.123+0000 7fc2c3fff640 1 -- 172.21.15.5:0/3019822989 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599e0b41280 msgr2=0x5599e0f27090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:49.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.123+0000 7fc2c3fff640 1 --2- 172.21.15.5:0/3019822989 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599e0b41280 0x5599e0f27090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:49.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.123+0000 7fc2c3fff640 1 -- 172.21.15.5:0/3019822989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5599e0b61f60 msgr2=0x5599e0f275d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:49.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.123+0000 7fc2c3fff640 1 --2- 172.21.15.5:0/3019822989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5599e0b61f60 0x5599e0f275d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:49.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.123+0000 7fc2c3fff640 1 -- 172.21.15.5:0/3019822989 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599e0f27b10 con 0x5599e0b390a0 2024-08-31T05:29:49.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.123+0000 7fc2c37fe640 1 --2- 172.21.15.5:0/3019822989 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599e0b41280 0x5599e0f27090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:29:49.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.123+0000 7fc2c3fff640 1 --2- 172.21.15.5:0/3019822989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599e0b390a0 0x5599e0f2dbe0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4009610 tx=0x7fc2b40e25d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=777d8d9b49c34443 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:49.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.123+0000 7fc2a37fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:29:49.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.124+0000 7fc2a37fe640 1 -- 172.21.15.5:0/3019822989 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b4020040 con 0x5599e0b390a0 2024-08-31T05:29:49.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.124+0000 7fc2a37fe640 1 -- 172.21.15.5:0/3019822989 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fc2b40a7970 con 0x5599e0b390a0 2024-08-31T05:29:49.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.124+0000 7fc2d0e6f740 1 -- 172.21.15.5:0/3019822989 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2b80316a0 con 0x5599e0b390a0 2024-08-31T05:29:49.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.124+0000 7fc2a37fe640 1 -- 172.21.15.5:0/3019822989 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc2b40ab1f0 con 0x5599e0b390a0 2024-08-31T05:29:49.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.124+0000 7fc2d0e6f740 10 client.15474 fetch_fsmap learned FSMap version 29 2024-08-31T05:29:49.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.124+0000 7fc2d0e6f740 1 -- 172.21.15.5:0/3019822989 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5599e0f2d410 con 0x5599e0b390a0 2024-08-31T05:29:49.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.124+0000 7fc2a37fe640 1 -- 172.21.15.5:0/3019822989 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2b80316a0 con 0x5599e0b390a0 2024-08-31T05:29:49.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.124+0000 7fc2a37fe640 1 -- 172.21.15.5:0/3019822989 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fc2b40d21a0 con 0x5599e0b390a0 2024-08-31T05:29:49.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.124+0000 7fc2d0e6f740 10 client.15474 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T05:29:49.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.124+0000 7fc2d0e6f740 10 client.15474 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-31T05:29:49.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.124+0000 7fc2d0e6f740 20 client.15474 populate_metadata read hostname 'smithi005' 2024-08-31T05:29:49.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.124+0000 7fc2d0e6f740 1 --2- 172.21.15.5:0/3019822989 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x5599e0af5c90 0x5599e0f98240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:49.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.124+0000 7fc2d0e6f740 4 client.15474 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T05:29:49.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.124+0000 7fc2d0e6f740 1 -- 172.21.15.5:0/3019822989 --> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] -- command(tid 0: {"prefix": "status"}) -- 0x5599e0e7bde0 con 0x5599e0af5c90 2024-08-31T05:29:49.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.124+0000 7fc2c37fe640 1 --2- 172.21.15.5:0/3019822989 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x5599e0af5c90 0x5599e0f98240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:49.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.125+0000 7fc2c37fe640 1 --2- 172.21.15.5:0/3019822989 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x5599e0af5c90 0x5599e0f98240 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b221a6ee3628ceb4 server_cookie=27f5b9ce4b1ccbd5 in_seq=0 out_seq=0 2024-08-31T05:29:49.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.125+0000 7fc2a37fe640 10 client.15474 ms_handle_connect on v2:172.21.15.70:6836/2780036414 2024-08-31T05:29:49.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.125+0000 7fc2a37fe640 1 -- 172.21.15.5:0/3019822989 <== mds.2 v2:172.21.15.70:6836/2780036414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5599e0e7bde0 con 0x5599e0af5c90 2024-08-31T05:29:49.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.125+0000 7fc2a37fe640 10 client.15474 handle_command_reply: tid=0 2024-08-31T05:29:49.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.125+0000 7fc2d0e6f740 1 client.15474 shutdown 2024-08-31T05:29:49.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.125+0000 7fc2d0e6f740 1 -- 172.21.15.5:0/3019822989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599e0b390a0 msgr2=0x5599e0f2dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:49.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.125+0000 7fc2d0e6f740 1 --2- 172.21.15.5:0/3019822989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599e0b390a0 0x5599e0f2dbe0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4009610 tx=0x7fc2b40e25d0 comp rx=0 tx=0).stop 2024-08-31T05:29:49.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.125+0000 7fc2d0e6f740 1 -- 172.21.15.5:0/3019822989 shutdown_connections 2024-08-31T05:29:49.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.125+0000 7fc2d0e6f740 1 --2- 172.21.15.5:0/3019822989 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x5599e0af5c90 0x5599e0f98240 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:49.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.125+0000 7fc2d0e6f740 1 --2- 172.21.15.5:0/3019822989 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5599e0b61f60 0x5599e0f275d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:49.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.125+0000 7fc2d0e6f740 1 --2- 172.21.15.5:0/3019822989 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599e0b41280 0x5599e0f27090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:49.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.125+0000 7fc2d0e6f740 1 --2- 172.21.15.5:0/3019822989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5599e0b390a0 0x5599e0f2dbe0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:49.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.125+0000 7fc2d0e6f740 1 -- 172.21.15.5:0/3019822989 >> 172.21.15.5:0/3019822989 conn(0x5599e0b56350 msgr2=0x5599e0f12c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:49.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.125+0000 7fc2a37fe640 0 client.15474 ms_handle_reset on v2:172.21.15.70:6836/2780036414 2024-08-31T05:29:49.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.126+0000 7fc2d0e6f740 1 -- 172.21.15.5:0/3019822989 shutdown_connections 2024-08-31T05:29:49.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.126+0000 7fc2d0e6f740 1 -- 172.21.15.5:0/3019822989 wait complete. 2024-08-31T05:29:49.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.126+0000 7fc2d0e6f740 20 client.15474 trim_cache size 0 max 16384 2024-08-31T05:29:49.134 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:29:49.134 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "69422704-6758-11ef-bcd4-c7b262605968", 2024-08-31T05:29:49.134 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 2, 2024-08-31T05:29:49.134 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 24631, 2024-08-31T05:29:49.134 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-08-31T05:29:49.134 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-08-31T05:29:49.134 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-08-31T05:29:49.134 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 99.568521919000005, 2024-08-31T05:29:49.134 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 29, 2024-08-31T05:29:49.135 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 87, 2024-08-31T05:29:49.135 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 85, 2024-08-31T05:29:49.135 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 162.11135166299999 2024-08-31T05:29:49.135 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:29:49.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.126+0000 7fc2ca8fa640 1 -- 172.21.15.5:0/1221878462 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc2ac0b4b80 msgr2=0x7fc2ac0b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:49.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.126+0000 7fc2ca8fa640 1 --2- 172.21.15.5:0/1221878462 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc2ac0b4b80 0x7fc2ac0b7090 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc01c000 tx=0x7fc2bc01e000 comp rx=0 tx=0).stop 2024-08-31T05:29:49.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.126+0000 7fc2ca8fa640 1 -- 172.21.15.5:0/1221878462 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2c4103900 msgr2=0x7fc2c419a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:49.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.126+0000 7fc2ca8fa640 1 --2- 172.21.15.5:0/1221878462 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2c4103900 0x7fc2c419a340 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc2b400d770 tx=0x7fc2b400dc30 comp rx=0 tx=0).stop 2024-08-31T05:29:49.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.126+0000 7fc2ca8fa640 1 -- 172.21.15.5:0/1221878462 shutdown_connections 2024-08-31T05:29:49.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.126+0000 7fc2ca8fa640 1 --2- 172.21.15.5:0/1221878462 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc2ac0b4b80 0x7fc2ac0b7090 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:49.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.126+0000 7fc2ca8fa640 1 --2- 172.21.15.5:0/1221878462 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2c4109b90 0x7fc2c419fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:49.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.126+0000 7fc2ca8fa640 1 --2- 172.21.15.5:0/1221878462 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2c4109240 0x7fc2c419a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:49.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.126+0000 7fc2ca8fa640 1 --2- 172.21.15.5:0/1221878462 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2c4103900 0x7fc2c419a340 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:49.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.126+0000 7fc2ca8fa640 1 -- 172.21.15.5:0/1221878462 >> 172.21.15.5:0/1221878462 conn(0x7fc2c407b5f0 msgr2=0x7fc2c41073a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:49.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.126+0000 7fc2ca8fa640 1 -- 172.21.15.5:0/1221878462 shutdown_connections 2024-08-31T05:29:49.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:49.126+0000 7fc2ca8fa640 1 -- 172.21.15.5:0/1221878462 wait complete. 2024-08-31T05:29:49.795 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.b status 2024-08-31T05:29:50.051 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:29:50.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.550+0000 7f99fee8c640 1 -- 172.21.15.5:0/3534326053 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99f8108ab0 msgr2=0x7f99f810f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:50.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.550+0000 7f99fee8c640 1 --2- 172.21.15.5:0/3534326053 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99f8108ab0 0x7f99f810f2e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f99f0009ca0 tx=0x7f99f002a8c0 comp rx=0 tx=0).stop 2024-08-31T05:29:50.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.550+0000 7f99fee8c640 1 -- 172.21.15.5:0/3534326053 shutdown_connections 2024-08-31T05:29:50.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.550+0000 7f99fee8c640 1 --2- 172.21.15.5:0/3534326053 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99f8108ab0 0x7f99f810f2e0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:50.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.550+0000 7f99fee8c640 1 --2- 172.21.15.5:0/3534326053 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99f8108160 0x7f99f8108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:50.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.550+0000 7f99fee8c640 1 --2- 172.21.15.5:0/3534326053 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99f8102820 0x7f99f8102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:50.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.550+0000 7f99fee8c640 1 -- 172.21.15.5:0/3534326053 >> 172.21.15.5:0/3534326053 conn(0x7f99f80794e0 msgr2=0x7f99f80798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:50.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.550+0000 7f99fee8c640 1 -- 172.21.15.5:0/3534326053 shutdown_connections 2024-08-31T05:29:50.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.550+0000 7f99fee8c640 1 -- 172.21.15.5:0/3534326053 wait complete. 2024-08-31T05:29:50.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.551+0000 7f99fee8c640 1 Processor -- start 2024-08-31T05:29:50.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.551+0000 7f99fee8c640 1 -- start start 2024-08-31T05:29:50.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.551+0000 7f99fee8c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99f8102820 0x7f99f819af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:50.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.551+0000 7f99fee8c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99f8108160 0x7f99f819b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:50.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.551+0000 7f99fee8c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99f8108ab0 0x7f99f819ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:50.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.551+0000 7f99fee8c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f99f8112710 con 0x7f99f8102820 2024-08-31T05:29:50.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.551+0000 7f99fee8c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f99f8112590 con 0x7f99f8108160 2024-08-31T05:29:50.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.551+0000 7f99fee8c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f99f8112890 con 0x7f99f8108ab0 2024-08-31T05:29:50.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.551+0000 7f99fcc28640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99f8102820 0x7f99f819af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:50.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.551+0000 7f99fcc28640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99f8102820 0x7f99f819af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54166/0 (socket says 172.21.15.5:54166) 2024-08-31T05:29:50.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.551+0000 7f99fcc28640 1 -- 172.21.15.5:0/4143956098 learned_addr learned my addr 172.21.15.5:0/4143956098 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:50.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.552+0000 7f99fd429640 1 --2- 172.21.15.5:0/4143956098 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99f8108ab0 0x7f99f819ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:50.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.552+0000 7f99fcc28640 1 -- 172.21.15.5:0/4143956098 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99f8108ab0 msgr2=0x7f99f819ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:50.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.552+0000 7f99fcc28640 1 --2- 172.21.15.5:0/4143956098 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99f8108ab0 0x7f99f819ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:50.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.552+0000 7f99f7fff640 1 --2- 172.21.15.5:0/4143956098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99f8108160 0x7f99f819b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:50.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.552+0000 7f99fcc28640 1 -- 172.21.15.5:0/4143956098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99f8108160 msgr2=0x7f99f819b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:50.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.552+0000 7f99fcc28640 1 --2- 172.21.15.5:0/4143956098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99f8108160 0x7f99f819b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:50.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.552+0000 7f99fcc28640 1 -- 172.21.15.5:0/4143956098 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99f81a6180 con 0x7f99f8102820 2024-08-31T05:29:50.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.552+0000 7f99fd429640 1 --2- 172.21.15.5:0/4143956098 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99f8108ab0 0x7f99f819ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:29:50.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.552+0000 7f99fcc28640 1 --2- 172.21.15.5:0/4143956098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99f8102820 0x7f99f819af80 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f99ec00c920 tx=0x7f99ec00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:50.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.552+0000 7f99f5ffb640 1 -- 172.21.15.5:0/4143956098 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ec007c70 con 0x7f99f8102820 2024-08-31T05:29:50.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.552+0000 7f99f5ffb640 1 -- 172.21.15.5:0/4143956098 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99ec007e10 con 0x7f99f8102820 2024-08-31T05:29:50.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.552+0000 7f99fee8c640 1 -- 172.21.15.5:0/4143956098 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99f81a6470 con 0x7f99f8102820 2024-08-31T05:29:50.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.552+0000 7f99f5ffb640 1 -- 172.21.15.5:0/4143956098 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ec018820 con 0x7f99f8102820 2024-08-31T05:29:50.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.553+0000 7f99fee8c640 1 -- 172.21.15.5:0/4143956098 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99f81a69b0 con 0x7f99f8102820 2024-08-31T05:29:50.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.555+0000 7f99f5ffb640 1 -- 172.21.15.5:0/4143956098 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) ==== 152593+0+0 (secure 0 0 0) 0x7f99ec00f450 con 0x7f99f8102820 2024-08-31T05:29:50.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.556+0000 7f9a05401740 1 Processor -- start 2024-08-31T05:29:50.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.556+0000 7f9a05401740 1 -- start start 2024-08-31T05:29:50.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.556+0000 7f99f5ffb640 1 --2- 172.21.15.5:0/4143956098 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f99e80b4bb0 0x7f99e80b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:50.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.556+0000 7f99fd429640 1 --2- 172.21.15.5:0/4143956098 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f99e80b4bb0 0x7f99e80b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:50.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.556+0000 7f99f5ffb640 1 -- 172.21.15.5:0/4143956098 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f99ec0e57f0 con 0x7f99f8102820 2024-08-31T05:29:50.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.556+0000 7f9a05401740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55616161df60 0x5561619c37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:50.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.556+0000 7f9a05401740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5561615f50a0 0x5561619c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:50.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.556+0000 7f9a05401740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5561615fd280 0x5561619c4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:50.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.556+0000 7f9a05401740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55616193a3f0 con 0x55616161df60 2024-08-31T05:29:50.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.556+0000 7f9a05401740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x556161929980 con 0x5561615fd280 2024-08-31T05:29:50.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.556+0000 7f9a05401740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55616192d930 con 0x5561615f50a0 2024-08-31T05:29:50.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.556+0000 7f99fcc28640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55616161df60 0x5561619c37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:50.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.556+0000 7f99fcc28640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55616161df60 0x5561619c37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54168/0 (socket says 172.21.15.5:54168) 2024-08-31T05:29:50.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.556+0000 7f99fcc28640 1 -- 172.21.15.5:0/2822483851 learned_addr learned my addr 172.21.15.5:0/2822483851 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:50.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.557+0000 7f99f7fff640 1 --2- 172.21.15.5:0/2822483851 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5561615f50a0 0x5561619c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:50.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.557+0000 7f99fd429640 1 --2- 172.21.15.5:0/2822483851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5561615fd280 0x5561619c4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:50.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.557+0000 7f99fcc28640 1 -- 172.21.15.5:0/2822483851 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5561615f50a0 msgr2=0x5561619c3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:50.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.557+0000 7f99fcc28640 1 --2- 172.21.15.5:0/2822483851 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5561615f50a0 0x5561619c3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:50.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.557+0000 7f99fcc28640 1 -- 172.21.15.5:0/2822483851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5561615fd280 msgr2=0x5561619c4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:50.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.557+0000 7f99fcc28640 1 --2- 172.21.15.5:0/2822483851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5561615fd280 0x5561619c4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:50.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.557+0000 7f99fcc28640 1 -- 172.21.15.5:0/2822483851 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556161689540 con 0x55616161df60 2024-08-31T05:29:50.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.557+0000 7f99fd429640 1 --2- 172.21.15.5:0/2822483851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5561615fd280 0x5561619c4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:29:50.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.557+0000 7f99fd429640 1 --2- 172.21.15.5:0/4143956098 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f99e80b4bb0 0x7f99e80b70c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f99f00094e0 tx=0x7f99f0009920 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:50.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.557+0000 7f99fcc28640 1 --2- 172.21.15.5:0/2822483851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55616161df60 0x5561619c37b0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f99ec0a8ff0 tx=0x7f99ec0ac540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c367b3368cb20a2e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:50.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.558+0000 7f99e2ffd640 1 -- 172.21.15.5:0/2822483851 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ec0cee60 con 0x55616161df60 2024-08-31T05:29:50.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.558+0000 7f99e2ffd640 1 -- 172.21.15.5:0/2822483851 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99ec0b50a0 con 0x55616161df60 2024-08-31T05:29:50.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.558+0000 7f99e2ffd640 1 -- 172.21.15.5:0/2822483851 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ec0a8010 con 0x55616161df60 2024-08-31T05:29:50.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.559+0000 7f9a05401740 1 -- 172.21.15.5:0/2822483851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55616161df60 msgr2=0x5561619c37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:50.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.559+0000 7f9a05401740 1 --2- 172.21.15.5:0/2822483851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55616161df60 0x5561619c37b0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f99ec0a8ff0 tx=0x7f99ec0ac540 comp rx=0 tx=0).stop 2024-08-31T05:29:50.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.559+0000 7f9a05401740 1 -- 172.21.15.5:0/2822483851 shutdown_connections 2024-08-31T05:29:50.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.559+0000 7f9a05401740 1 --2- 172.21.15.5:0/2822483851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5561615fd280 0x5561619c4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:50.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.559+0000 7f9a05401740 1 --2- 172.21.15.5:0/2822483851 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5561615f50a0 0x5561619c3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:50.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.559+0000 7f9a05401740 1 --2- 172.21.15.5:0/2822483851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55616161df60 0x5561619c37b0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:50.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.559+0000 7f9a05401740 1 -- 172.21.15.5:0/2822483851 >> 172.21.15.5:0/2822483851 conn(0x556161612350 msgr2=0x5561619c16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:50.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.559+0000 7f9a05401740 1 -- 172.21.15.5:0/2822483851 shutdown_connections 2024-08-31T05:29:50.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.559+0000 7f9a05401740 1 -- 172.21.15.5:0/2822483851 wait complete. 2024-08-31T05:29:50.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.560+0000 7f9a05401740 1 -- start start 2024-08-31T05:29:50.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.560+0000 7f9a05401740 1 Processor -- start 2024-08-31T05:29:50.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.560+0000 7f9a05401740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5561615f50a0 0x5561619d3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:50.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.560+0000 7f9a05401740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5561615fd280 0x5561619d3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:50.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.560+0000 7f9a05401740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55616161df60 0x5561619df620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:50.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.560+0000 7f9a05401740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55616178c5f0 con 0x55616161df60 2024-08-31T05:29:50.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.560+0000 7f9a05401740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5561618b0600 con 0x5561615fd280 2024-08-31T05:29:50.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.560+0000 7f9a05401740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5561619d62f0 con 0x5561615f50a0 2024-08-31T05:29:50.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.560+0000 7f9a05401740 10 client.0 _ll_register_callbacks cb 0x5561618d6af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:29:50.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.560+0000 7f99fd429640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55616161df60 0x5561619df620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:50.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.560+0000 7f99fd429640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55616161df60 0x5561619df620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54180/0 (socket says 172.21.15.5:54180) 2024-08-31T05:29:50.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.560+0000 7f99fd429640 1 -- 172.21.15.5:0/673181610 learned_addr learned my addr 172.21.15.5:0/673181610 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:50.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.560+0000 7f99fcc28640 1 --2- 172.21.15.5:0/673181610 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5561615f50a0 0x5561619d3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:50.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.560+0000 7f99f7fff640 1 --2- 172.21.15.5:0/673181610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5561615fd280 0x5561619d3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:50.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.561+0000 7f99fd429640 1 -- 172.21.15.5:0/673181610 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5561615f50a0 msgr2=0x5561619d3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:50.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.561+0000 7f99fd429640 1 --2- 172.21.15.5:0/673181610 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5561615f50a0 0x5561619d3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:50.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.561+0000 7f99fd429640 1 -- 172.21.15.5:0/673181610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5561615fd280 msgr2=0x5561619d3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:50.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.561+0000 7f99fd429640 1 --2- 172.21.15.5:0/673181610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5561615fd280 0x5561619d3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:50.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.561+0000 7f99fd429640 1 -- 172.21.15.5:0/673181610 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561618e97b0 con 0x55616161df60 2024-08-31T05:29:50.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.561+0000 7f99fd429640 1 --2- 172.21.15.5:0/673181610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55616161df60 0x5561619df620 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f99f00318b0 tx=0x7f99f002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfea93f14386ce7b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:50.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.561+0000 7f99d7fff640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:29:50.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.561+0000 7f99d7fff640 1 -- 172.21.15.5:0/673181610 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f004e060 con 0x55616161df60 2024-08-31T05:29:50.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.561+0000 7f99d7fff640 1 -- 172.21.15.5:0/673181610 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f99f00047b0 con 0x55616161df60 2024-08-31T05:29:50.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.561+0000 7f9a05401740 1 -- 172.21.15.5:0/673181610 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99ec0b50a0 con 0x55616161df60 2024-08-31T05:29:50.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.561+0000 7f99d7fff640 1 -- 172.21.15.5:0/673181610 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f99f0055050 con 0x55616161df60 2024-08-31T05:29:50.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.561+0000 7f9a05401740 10 client.15486 fetch_fsmap learned FSMap version 29 2024-08-31T05:29:50.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.561+0000 7f9a05401740 1 -- 172.21.15.5:0/673181610 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5561619e2030 con 0x55616161df60 2024-08-31T05:29:50.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.561+0000 7f99d7fff640 1 -- 172.21.15.5:0/673181610 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99ec0b50a0 con 0x55616161df60 2024-08-31T05:29:50.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.562+0000 7f99d7fff640 1 -- 172.21.15.5:0/673181610 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f99f0030960 con 0x55616161df60 2024-08-31T05:29:50.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.562+0000 7f9a05401740 10 client.15486 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T05:29:50.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.562+0000 7f9a05401740 10 client.15486 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-31T05:29:50.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.562+0000 7f9a05401740 20 client.15486 populate_metadata read hostname 'smithi005' 2024-08-31T05:29:50.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.562+0000 7f9a05401740 1 --2- 172.21.15.5:0/673181610 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x5561615dc8e0 0x5561619e5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:50.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.562+0000 7f9a05401740 4 client.15486 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:29:50.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.562+0000 7f9a05401740 1 -- 172.21.15.5:0/673181610 --> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55616193c340 con 0x5561615dc8e0 2024-08-31T05:29:50.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.562+0000 7f99fcc28640 1 --2- 172.21.15.5:0/673181610 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x5561615dc8e0 0x5561619e5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:50.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.563+0000 7f99fcc28640 1 --2- 172.21.15.5:0/673181610 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x5561615dc8e0 0x5561619e5ab0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=97d2d786c73ec94d server_cookie=24c6a370470e3765 in_seq=0 out_seq=0 2024-08-31T05:29:50.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.563+0000 7f99d7fff640 10 client.15486 ms_handle_connect on v2:172.21.15.50:6838/98200944 2024-08-31T05:29:50.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.563+0000 7f99d7fff640 1 -- 172.21.15.5:0/673181610 <== mds.1 v2:172.21.15.50:6838/98200944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55616193c340 con 0x5561615dc8e0 2024-08-31T05:29:50.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.563+0000 7f99d7fff640 10 client.15486 handle_command_reply: tid=0 2024-08-31T05:29:50.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.563+0000 7f9a05401740 1 client.15486 shutdown 2024-08-31T05:29:50.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.564+0000 7f9a05401740 1 -- 172.21.15.5:0/673181610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55616161df60 msgr2=0x5561619df620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:50.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.564+0000 7f9a05401740 1 --2- 172.21.15.5:0/673181610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55616161df60 0x5561619df620 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f99f00318b0 tx=0x7f99f002a8c0 comp rx=0 tx=0).stop 2024-08-31T05:29:50.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.564+0000 7f9a05401740 1 -- 172.21.15.5:0/673181610 shutdown_connections 2024-08-31T05:29:50.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.564+0000 7f9a05401740 1 --2- 172.21.15.5:0/673181610 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x5561615dc8e0 0x5561619e5ab0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:50.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.564+0000 7f9a05401740 1 --2- 172.21.15.5:0/673181610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55616161df60 0x5561619df620 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:50.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.564+0000 7f9a05401740 1 --2- 172.21.15.5:0/673181610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5561615fd280 0x5561619d3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:50.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.564+0000 7f9a05401740 1 --2- 172.21.15.5:0/673181610 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5561615f50a0 0x5561619d3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:50.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.564+0000 7f9a05401740 1 -- 172.21.15.5:0/673181610 >> 172.21.15.5:0/673181610 conn(0x556161612350 msgr2=0x5561619bfce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:50.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.564+0000 7f99d7fff640 0 client.15486 ms_handle_reset on v2:172.21.15.50:6838/98200944 2024-08-31T05:29:50.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.564+0000 7f9a05401740 1 -- 172.21.15.5:0/673181610 shutdown_connections 2024-08-31T05:29:50.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.564+0000 7f9a05401740 1 -- 172.21.15.5:0/673181610 wait complete. 2024-08-31T05:29:50.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.564+0000 7f9a05401740 20 client.15486 trim_cache size 0 max 16384 2024-08-31T05:29:50.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.583+0000 7f9a05401740 1 Processor -- start 2024-08-31T05:29:50.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.583+0000 7f9a05401740 1 -- start start 2024-08-31T05:29:50.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.583+0000 7f9a05401740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5561615f50a0 0x5561619e4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:50.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.583+0000 7f9a05401740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5561615fd280 0x5561619e3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:50.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.583+0000 7f9a05401740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55616161df60 0x5561619df590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:50.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.583+0000 7f9a05401740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5561619e3df0 con 0x55616161df60 2024-08-31T05:29:50.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.583+0000 7f9a05401740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5561619e44c0 con 0x5561615fd280 2024-08-31T05:29:50.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.583+0000 7f9a05401740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5561619e4b90 con 0x5561615f50a0 2024-08-31T05:29:50.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.583+0000 7f99fd429640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55616161df60 0x5561619df590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:50.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.583+0000 7f99fcc28640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5561615f50a0 0x5561619e4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:50.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.583+0000 7f99fd429640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55616161df60 0x5561619df590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54188/0 (socket says 172.21.15.5:54188) 2024-08-31T05:29:50.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.583+0000 7f99fd429640 1 -- 172.21.15.5:0/4095263446 learned_addr learned my addr 172.21.15.5:0/4095263446 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:50.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.583+0000 7f99f7fff640 1 --2- 172.21.15.5:0/4095263446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5561615fd280 0x5561619e3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:50.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.583+0000 7f99fd429640 1 -- 172.21.15.5:0/4095263446 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5561615f50a0 msgr2=0x5561619e4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:50.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.583+0000 7f99fd429640 1 --2- 172.21.15.5:0/4095263446 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5561615f50a0 0x5561619e4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:50.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.583+0000 7f99fd429640 1 -- 172.21.15.5:0/4095263446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5561615fd280 msgr2=0x5561619e3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:50.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.583+0000 7f99fd429640 1 --2- 172.21.15.5:0/4095263446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5561615fd280 0x5561619e3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:50.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.583+0000 7f99fd429640 1 -- 172.21.15.5:0/4095263446 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561619c56f0 con 0x55616161df60 2024-08-31T05:29:50.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.583+0000 7f99fcc28640 1 --2- 172.21.15.5:0/4095263446 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5561615f50a0 0x5561619e4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:29:50.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.584+0000 7f99f7fff640 1 --2- 172.21.15.5:0/4095263446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5561615fd280 0x5561619e3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:29:50.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.584+0000 7f99fd429640 1 --2- 172.21.15.5:0/4095263446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55616161df60 0x5561619df590 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f99f00099b0 tx=0x7f99f0003f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d011cfa3c26a5753 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:50.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.584+0000 7f99e27fc640 1 -- 172.21.15.5:0/4095263446 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f005e070 con 0x55616161df60 2024-08-31T05:29:50.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.584+0000 7f99e27fc640 1 -- 172.21.15.5:0/4095263446 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99f0036050 con 0x55616161df60 2024-08-31T05:29:50.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.584+0000 7f99e27fc640 1 -- 172.21.15.5:0/4095263446 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f002fa90 con 0x55616161df60 2024-08-31T05:29:50.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.585+0000 7f9a05401740 1 -- 172.21.15.5:0/4095263446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55616161df60 msgr2=0x5561619df590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:50.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.585+0000 7f9a05401740 1 --2- 172.21.15.5:0/4095263446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55616161df60 0x5561619df590 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f99f00099b0 tx=0x7f99f0003f50 comp rx=0 tx=0).stop 2024-08-31T05:29:50.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.585+0000 7f9a05401740 1 -- 172.21.15.5:0/4095263446 shutdown_connections 2024-08-31T05:29:50.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.585+0000 7f9a05401740 1 --2- 172.21.15.5:0/4095263446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55616161df60 0x5561619df590 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:50.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.585+0000 7f9a05401740 1 --2- 172.21.15.5:0/4095263446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5561615fd280 0x5561619e3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:50.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.585+0000 7f9a05401740 1 --2- 172.21.15.5:0/4095263446 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5561615f50a0 0x5561619e4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:50.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.585+0000 7f9a05401740 1 -- 172.21.15.5:0/4095263446 >> 172.21.15.5:0/4095263446 conn(0x556161612350 msgr2=0x5561619d3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:50.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.585+0000 7f9a05401740 1 -- 172.21.15.5:0/4095263446 shutdown_connections 2024-08-31T05:29:50.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.585+0000 7f9a05401740 1 -- 172.21.15.5:0/4095263446 wait complete. 2024-08-31T05:29:50.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.585+0000 7f9a05401740 1 -- start start 2024-08-31T05:29:50.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.585+0000 7f9a05401740 1 Processor -- start 2024-08-31T05:29:50.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.586+0000 7f9a05401740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5561615f50a0 0x5561619ee470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:50.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.586+0000 7f9a05401740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5561615fd280 0x5561619e7920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:50.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.586+0000 7f9a05401740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55616161df60 0x5561619e7e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:50.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.586+0000 7f9a05401740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5561619e5930 con 0x5561615f50a0 2024-08-31T05:29:50.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.586+0000 7f9a05401740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5561619e5260 con 0x5561615fd280 2024-08-31T05:29:50.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.586+0000 7f9a05401740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5561619e6000 con 0x55616161df60 2024-08-31T05:29:50.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.586+0000 7f9a05401740 10 client.0 _ll_register_callbacks cb 0x7f99f00315b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:29:50.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.586+0000 7f99fcc28640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5561615f50a0 0x5561619ee470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:50.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.586+0000 7f99fcc28640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5561615f50a0 0x5561619ee470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54202/0 (socket says 172.21.15.5:54202) 2024-08-31T05:29:50.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.586+0000 7f99fcc28640 1 -- 172.21.15.5:0/690536457 learned_addr learned my addr 172.21.15.5:0/690536457 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:50.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.586+0000 7f99fd429640 1 --2- 172.21.15.5:0/690536457 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55616161df60 0x5561619e7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:50.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.586+0000 7f99f7fff640 1 --2- 172.21.15.5:0/690536457 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5561615fd280 0x5561619e7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:50.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.586+0000 7f99fcc28640 1 -- 172.21.15.5:0/690536457 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55616161df60 msgr2=0x5561619e7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:50.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.586+0000 7f99fcc28640 1 --2- 172.21.15.5:0/690536457 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55616161df60 0x5561619e7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:50.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.586+0000 7f99fcc28640 1 -- 172.21.15.5:0/690536457 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5561615fd280 msgr2=0x5561619e7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:50.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.586+0000 7f99fcc28640 1 --2- 172.21.15.5:0/690536457 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5561615fd280 0x5561619e7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:50.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.586+0000 7f99fcc28640 1 -- 172.21.15.5:0/690536457 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561619e8520 con 0x5561615f50a0 2024-08-31T05:29:50.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.586+0000 7f99fcc28640 1 --2- 172.21.15.5:0/690536457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5561615f50a0 0x5561619ee470 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f99ec00fd00 tx=0x7f99ec00fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=385a71e4126d5502 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:50.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.586+0000 7f99d7fff640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:29:50.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.587+0000 7f99d7fff640 1 -- 172.21.15.5:0/690536457 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ec0cee60 con 0x5561615f50a0 2024-08-31T05:29:50.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.587+0000 7f99d7fff640 1 -- 172.21.15.5:0/690536457 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f99ec0930b0 con 0x5561615f50a0 2024-08-31T05:29:50.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.587+0000 7f9a05401740 1 -- 172.21.15.5:0/690536457 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99f0036050 con 0x5561615f50a0 2024-08-31T05:29:50.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.587+0000 7f99d7fff640 1 -- 172.21.15.5:0/690536457 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f99ec0b50a0 con 0x5561615f50a0 2024-08-31T05:29:50.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.587+0000 7f9a05401740 10 client.15492 fetch_fsmap learned FSMap version 29 2024-08-31T05:29:50.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.587+0000 7f9a05401740 1 -- 172.21.15.5:0/690536457 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556161a50f80 con 0x5561615f50a0 2024-08-31T05:29:50.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.587+0000 7f99d7fff640 1 -- 172.21.15.5:0/690536457 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99f0036050 con 0x5561615f50a0 2024-08-31T05:29:50.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.587+0000 7f99d7fff640 1 -- 172.21.15.5:0/690536457 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f99ec0e5410 con 0x5561615f50a0 2024-08-31T05:29:50.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.587+0000 7f9a05401740 10 client.15492 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T05:29:50.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.587+0000 7f9a05401740 10 client.15492 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-31T05:29:50.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.587+0000 7f9a05401740 20 client.15492 populate_metadata read hostname 'smithi005' 2024-08-31T05:29:50.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.587+0000 7f9a05401740 1 --2- 172.21.15.5:0/690536457 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x5561615b1c90 0x556161a54220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:50.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.587+0000 7f9a05401740 4 client.15492 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T05:29:50.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.587+0000 7f9a05401740 1 -- 172.21.15.5:0/690536457 --> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] -- command(tid 0: {"prefix": "status"}) -- 0x556161937de0 con 0x5561615b1c90 2024-08-31T05:29:50.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.588+0000 7f99f7fff640 1 --2- 172.21.15.5:0/690536457 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x5561615b1c90 0x556161a54220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:50.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.588+0000 7f99d7fff640 10 client.15492 ms_handle_connect on v2:172.21.15.50:6838/98200944 2024-08-31T05:29:50.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.588+0000 7f99f7fff640 1 --2- 172.21.15.5:0/690536457 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x5561615b1c90 0x556161a54220 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f96fed41e0c72d13 server_cookie=73c13701550169ea in_seq=0 out_seq=0 2024-08-31T05:29:50.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.588+0000 7f99d7fff640 1 -- 172.21.15.5:0/690536457 <== mds.1 v2:172.21.15.50:6838/98200944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x556161937de0 con 0x5561615b1c90 2024-08-31T05:29:50.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.588+0000 7f99d7fff640 10 client.15492 handle_command_reply: tid=0 2024-08-31T05:29:50.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.588+0000 7f9a05401740 1 client.15492 shutdown 2024-08-31T05:29:50.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.588+0000 7f9a05401740 1 -- 172.21.15.5:0/690536457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5561615f50a0 msgr2=0x5561619ee470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:50.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.588+0000 7f9a05401740 1 --2- 172.21.15.5:0/690536457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5561615f50a0 0x5561619ee470 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f99ec00fd00 tx=0x7f99ec00fc90 comp rx=0 tx=0).stop 2024-08-31T05:29:50.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.588+0000 7f9a05401740 1 -- 172.21.15.5:0/690536457 shutdown_connections 2024-08-31T05:29:50.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.588+0000 7f9a05401740 1 --2- 172.21.15.5:0/690536457 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x5561615b1c90 0x556161a54220 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:50.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.588+0000 7f9a05401740 1 --2- 172.21.15.5:0/690536457 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55616161df60 0x5561619e7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:50.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.588+0000 7f9a05401740 1 --2- 172.21.15.5:0/690536457 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5561615fd280 0x5561619e7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:50.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.588+0000 7f9a05401740 1 --2- 172.21.15.5:0/690536457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5561615f50a0 0x5561619ee470 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:50.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.588+0000 7f9a05401740 1 -- 172.21.15.5:0/690536457 >> 172.21.15.5:0/690536457 conn(0x556161612350 msgr2=0x5561619ce490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:50.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.588+0000 7f99d7fff640 0 client.15492 ms_handle_reset on v2:172.21.15.50:6838/98200944 2024-08-31T05:29:50.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.589+0000 7f9a05401740 1 -- 172.21.15.5:0/690536457 shutdown_connections 2024-08-31T05:29:50.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.589+0000 7f9a05401740 1 -- 172.21.15.5:0/690536457 wait complete. 2024-08-31T05:29:50.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.589+0000 7f9a05401740 20 client.15492 trim_cache size 0 max 16384 2024-08-31T05:29:50.595 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:29:50.595 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "69422704-6758-11ef-bcd4-c7b262605968", 2024-08-31T05:29:50.595 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 1, 2024-08-31T05:29:50.595 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 24638, 2024-08-31T05:29:50.595 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-08-31T05:29:50.595 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-08-31T05:29:50.596 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-08-31T05:29:50.596 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 102.042250459, 2024-08-31T05:29:50.596 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 29, 2024-08-31T05:29:50.596 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 87, 2024-08-31T05:29:50.596 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 85, 2024-08-31T05:29:50.596 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 149.13686037799999 2024-08-31T05:29:50.596 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:29:50.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.589+0000 7f99fee8c640 1 -- 172.21.15.5:0/4143956098 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f99e80b4bb0 msgr2=0x7f99e80b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:50.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.589+0000 7f99fee8c640 1 --2- 172.21.15.5:0/4143956098 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f99e80b4bb0 0x7f99e80b70c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f99f00094e0 tx=0x7f99f0009920 comp rx=0 tx=0).stop 2024-08-31T05:29:50.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.589+0000 7f99fee8c640 1 -- 172.21.15.5:0/4143956098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99f8102820 msgr2=0x7f99f819af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:50.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.589+0000 7f99fee8c640 1 --2- 172.21.15.5:0/4143956098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99f8102820 0x7f99f819af80 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f99ec00c920 tx=0x7f99ec00cde0 comp rx=0 tx=0).stop 2024-08-31T05:29:50.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.589+0000 7f99fee8c640 1 -- 172.21.15.5:0/4143956098 shutdown_connections 2024-08-31T05:29:50.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.589+0000 7f99fee8c640 1 --2- 172.21.15.5:0/4143956098 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f99e80b4bb0 0x7f99e80b70c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:50.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.589+0000 7f99fee8c640 1 --2- 172.21.15.5:0/4143956098 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99f8108ab0 0x7f99f819ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:50.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.589+0000 7f99fee8c640 1 --2- 172.21.15.5:0/4143956098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f99f8108160 0x7f99f819b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:50.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.589+0000 7f99fee8c640 1 --2- 172.21.15.5:0/4143956098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99f8102820 0x7f99f819af80 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:50.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.589+0000 7f99fee8c640 1 -- 172.21.15.5:0/4143956098 >> 172.21.15.5:0/4143956098 conn(0x7f99f80794e0 msgr2=0x7f99f81040d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:50.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.590+0000 7f99fee8c640 1 -- 172.21.15.5:0/4143956098 shutdown_connections 2024-08-31T05:29:50.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:50.590+0000 7f99fee8c640 1 -- 172.21.15.5:0/4143956098 wait complete. 2024-08-31T05:29:50.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:50 smithi005 ceph-mon[18602]: pgmap v341: 129 pgs: 129 active+clean; 645 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-08-31T05:29:50.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:50 smithi070 ceph-mon[22316]: pgmap v341: 129 pgs: 129 active+clean; 645 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-08-31T05:29:50.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:50 smithi050 ceph-mon[22146]: pgmap v341: 129 pgs: 129 active+clean; 645 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-08-31T05:29:51.282 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.i status 2024-08-31T05:29:51.532 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:29:52.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.078+0000 7fc8754b1640 1 -- 172.21.15.5:0/4166214503 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc870102810 msgr2=0x7fc870102c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:52.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.078+0000 7fc8754b1640 1 --2- 172.21.15.5:0/4166214503 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc870102810 0x7fc870102c20 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fc860009900 tx=0x7fc86002a3f0 comp rx=0 tx=0).stop 2024-08-31T05:29:52.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.079+0000 7fc8754b1640 1 -- 172.21.15.5:0/4166214503 shutdown_connections 2024-08-31T05:29:52.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.079+0000 7fc8754b1640 1 --2- 172.21.15.5:0/4166214503 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc870108aa0 0x7fc87010f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:52.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.079+0000 7fc8754b1640 1 --2- 172.21.15.5:0/4166214503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc870108150 0x7fc870108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:52.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.079+0000 7fc8754b1640 1 --2- 172.21.15.5:0/4166214503 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc870102810 0x7fc870102c20 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:52.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.079+0000 7fc8754b1640 1 -- 172.21.15.5:0/4166214503 >> 172.21.15.5:0/4166214503 conn(0x7fc8700794b0 msgr2=0x7fc8700798c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.079+0000 7fc8754b1640 1 -- 172.21.15.5:0/4166214503 shutdown_connections 2024-08-31T05:29:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.079+0000 7fc8754b1640 1 -- 172.21.15.5:0/4166214503 wait complete. 2024-08-31T05:29:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.079+0000 7fc8754b1640 1 Processor -- start 2024-08-31T05:29:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.079+0000 7fc8754b1640 1 -- start start 2024-08-31T05:29:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.080+0000 7fc8754b1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc870102810 0x7fc87019a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.080+0000 7fc8754b1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc870108150 0x7fc87019a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.080+0000 7fc8754b1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc870108aa0 0x7fc87019fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.080+0000 7fc8754b1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc870112750 con 0x7fc870102810 2024-08-31T05:29:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.080+0000 7fc8754b1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc8701125d0 con 0x7fc870108150 2024-08-31T05:29:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.080+0000 7fc8754b1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc8701128d0 con 0x7fc870108aa0 2024-08-31T05:29:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.080+0000 7fc86effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc870102810 0x7fc87019a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.080+0000 7fc86effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc870102810 0x7fc87019a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33176/0 (socket says 172.21.15.5:33176) 2024-08-31T05:29:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.080+0000 7fc86effd640 1 -- 172.21.15.5:0/1205332505 learned_addr learned my addr 172.21.15.5:0/1205332505 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:52.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.080+0000 7fc86f7fe640 1 --2- 172.21.15.5:0/1205332505 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc870108aa0 0x7fc87019fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:52.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.080+0000 7fc8667fc640 1 --2- 172.21.15.5:0/1205332505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc870108150 0x7fc87019a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:52.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.080+0000 7fc86effd640 1 -- 172.21.15.5:0/1205332505 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc870108aa0 msgr2=0x7fc87019fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:52.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.080+0000 7fc86effd640 1 --2- 172.21.15.5:0/1205332505 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc870108aa0 0x7fc87019fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:52.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.080+0000 7fc86effd640 1 -- 172.21.15.5:0/1205332505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc870108150 msgr2=0x7fc87019a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:52.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.080+0000 7fc86effd640 1 --2- 172.21.15.5:0/1205332505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc870108150 0x7fc87019a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:52.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.080+0000 7fc86effd640 1 -- 172.21.15.5:0/1205332505 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8701a01e0 con 0x7fc870102810 2024-08-31T05:29:52.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.080+0000 7fc86effd640 1 --2- 172.21.15.5:0/1205332505 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc870102810 0x7fc87019a270 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc860005940 tx=0x7fc8600042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:52.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.081+0000 7fc86cff9640 1 -- 172.21.15.5:0/1205332505 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc86003f030 con 0x7fc870102810 2024-08-31T05:29:52.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.081+0000 7fc86cff9640 1 -- 172.21.15.5:0/1205332505 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc860003cb0 con 0x7fc870102810 2024-08-31T05:29:52.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.081+0000 7fc86cff9640 1 -- 172.21.15.5:0/1205332505 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc860035070 con 0x7fc870102810 2024-08-31T05:29:52.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.081+0000 7fc8754b1640 1 -- 172.21.15.5:0/1205332505 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8701a0470 con 0x7fc870102810 2024-08-31T05:29:52.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.081+0000 7fc8754b1640 1 -- 172.21.15.5:0/1205332505 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8701a6c30 con 0x7fc870102810 2024-08-31T05:29:52.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.083+0000 7fc87ba26740 1 Processor -- start 2024-08-31T05:29:52.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.083+0000 7fc87ba26740 1 -- start start 2024-08-31T05:29:52.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.083+0000 7fc86cff9640 1 -- 172.21.15.5:0/1205332505 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) ==== 152593+0+0 (secure 0 0 0) 0x7fc860042030 con 0x7fc870102810 2024-08-31T05:29:52.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.084+0000 7fc87ba26740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559116e3cf60 0x5591171e27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:52.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.084+0000 7fc87ba26740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559116e140a0 0x5591171e2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:52.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.084+0000 7fc87ba26740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559116e1c280 0x5591171e3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:52.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.084+0000 7fc87ba26740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5591171593f0 con 0x559116e1c280 2024-08-31T05:29:52.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.084+0000 7fc87ba26740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559117148980 con 0x559116e140a0 2024-08-31T05:29:52.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.084+0000 7fc87ba26740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55911714c930 con 0x559116e3cf60 2024-08-31T05:29:52.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.084+0000 7fc8667fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559116e1c280 0x5591171e3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:52.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.084+0000 7fc8667fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559116e1c280 0x5591171e3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33180/0 (socket says 172.21.15.5:33180) 2024-08-31T05:29:52.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.084+0000 7fc8667fc640 1 -- 172.21.15.5:0/17669965 learned_addr learned my addr 172.21.15.5:0/17669965 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:52.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.084+0000 7fc86f7fe640 1 --2- 172.21.15.5:0/17669965 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559116e3cf60 0x5591171e27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:52.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.084+0000 7fc86effd640 1 --2- 172.21.15.5:0/17669965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559116e140a0 0x5591171e2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:52.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.084+0000 7fc8667fc640 1 -- 172.21.15.5:0/17669965 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559116e3cf60 msgr2=0x5591171e27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:52.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.084+0000 7fc8667fc640 1 --2- 172.21.15.5:0/17669965 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559116e3cf60 0x5591171e27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:52.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.084+0000 7fc8667fc640 1 -- 172.21.15.5:0/17669965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559116e140a0 msgr2=0x5591171e2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:52.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.084+0000 7fc8667fc640 1 --2- 172.21.15.5:0/17669965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559116e140a0 0x5591171e2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:52.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.084+0000 7fc8667fc640 1 -- 172.21.15.5:0/17669965 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559116ea8540 con 0x559116e1c280 2024-08-31T05:29:52.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.085+0000 7fc86cff9640 1 --2- 172.21.15.5:0/1205332505 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc85c0b4b80 0x7fc85c0b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:52.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.085+0000 7fc8667fc640 1 --2- 172.21.15.5:0/17669965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559116e1c280 0x5591171e3230 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc85800dcc0 tx=0x7fc85800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20f9f9edf3276c46 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:52.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.085+0000 7fc86f7fe640 1 --2- 172.21.15.5:0/1205332505 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc85c0b4b80 0x7fc85c0b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:52.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.085+0000 7fc86cff9640 1 -- 172.21.15.5:0/1205332505 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fc860105fc0 con 0x7fc870102810 2024-08-31T05:29:52.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.085+0000 7fc8657fa640 1 -- 172.21.15.5:0/17669965 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc858015070 con 0x559116e1c280 2024-08-31T05:29:52.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.085+0000 7fc8657fa640 1 -- 172.21.15.5:0/17669965 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8580054d0 con 0x559116e1c280 2024-08-31T05:29:52.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.085+0000 7fc8657fa640 1 -- 172.21.15.5:0/17669965 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8580116a0 con 0x559116e1c280 2024-08-31T05:29:52.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.086+0000 7fc87ba26740 1 -- 172.21.15.5:0/17669965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559116e1c280 msgr2=0x5591171e3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:52.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.086+0000 7fc87ba26740 1 --2- 172.21.15.5:0/17669965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559116e1c280 0x5591171e3230 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc85800dcc0 tx=0x7fc85800f730 comp rx=0 tx=0).stop 2024-08-31T05:29:52.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.086+0000 7fc86f7fe640 1 --2- 172.21.15.5:0/1205332505 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc85c0b4b80 0x7fc85c0b7090 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc868005fd0 tx=0x7fc8680096e0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:52.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.086+0000 7fc87ba26740 1 -- 172.21.15.5:0/17669965 shutdown_connections 2024-08-31T05:29:52.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.086+0000 7fc87ba26740 1 --2- 172.21.15.5:0/17669965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559116e1c280 0x5591171e3230 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:52.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.086+0000 7fc87ba26740 1 --2- 172.21.15.5:0/17669965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559116e140a0 0x5591171e2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:52.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.086+0000 7fc87ba26740 1 --2- 172.21.15.5:0/17669965 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559116e3cf60 0x5591171e27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:52.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.086+0000 7fc87ba26740 1 -- 172.21.15.5:0/17669965 >> 172.21.15.5:0/17669965 conn(0x559116e31350 msgr2=0x5591171e06a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:52.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.086+0000 7fc87ba26740 1 -- 172.21.15.5:0/17669965 shutdown_connections 2024-08-31T05:29:52.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.086+0000 7fc87ba26740 1 -- 172.21.15.5:0/17669965 wait complete. 2024-08-31T05:29:52.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.086+0000 7fc87ba26740 1 -- start start 2024-08-31T05:29:52.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.087+0000 7fc87ba26740 1 Processor -- start 2024-08-31T05:29:52.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.087+0000 7fc87ba26740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559116e140a0 0x5591171f2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:52.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.087+0000 7fc87ba26740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559116e1c280 0x5591171f27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:52.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.087+0000 7fc87ba26740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559116e3cf60 0x5591171fe650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:52.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.087+0000 7fc87ba26740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x559116fab5f0 con 0x559116e3cf60 2024-08-31T05:29:52.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.087+0000 7fc87ba26740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5591170cf600 con 0x559116e140a0 2024-08-31T05:29:52.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.087+0000 7fc87ba26740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5591171f52c0 con 0x559116e1c280 2024-08-31T05:29:52.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.087+0000 7fc87ba26740 10 client.0 _ll_register_callbacks cb 0x5591170f5af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:29:52.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.087+0000 7fc86f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559116e3cf60 0x5591171fe650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:52.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.087+0000 7fc86f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559116e3cf60 0x5591171fe650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33184/0 (socket says 172.21.15.5:33184) 2024-08-31T05:29:52.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.087+0000 7fc86f7fe640 1 -- 172.21.15.5:0/3810459638 learned_addr learned my addr 172.21.15.5:0/3810459638 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:52.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.087+0000 7fc86effd640 1 --2- 172.21.15.5:0/3810459638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559116e140a0 0x5591171f2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:52.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.087+0000 7fc8667fc640 1 --2- 172.21.15.5:0/3810459638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559116e1c280 0x5591171f27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:52.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.087+0000 7fc86f7fe640 1 -- 172.21.15.5:0/3810459638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559116e1c280 msgr2=0x5591171f27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:52.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.087+0000 7fc86f7fe640 1 --2- 172.21.15.5:0/3810459638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559116e1c280 0x5591171f27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:52.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.087+0000 7fc86f7fe640 1 -- 172.21.15.5:0/3810459638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559116e140a0 msgr2=0x5591171f2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:52.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.087+0000 7fc86f7fe640 1 --2- 172.21.15.5:0/3810459638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559116e140a0 0x5591171f2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:52.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.087+0000 7fc86f7fe640 1 -- 172.21.15.5:0/3810459638 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591171087b0 con 0x559116e3cf60 2024-08-31T05:29:52.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.088+0000 7fc86f7fe640 1 --2- 172.21.15.5:0/3810459638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559116e3cf60 0x5591171fe650 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc86801d870 tx=0x7fc868004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c745eb89e1c0cf23 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:52.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.088+0000 7fc8567fc640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:29:52.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.088+0000 7fc8567fc640 1 -- 172.21.15.5:0/3810459638 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc86801e820 con 0x559116e3cf60 2024-08-31T05:29:52.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.088+0000 7fc8567fc640 1 -- 172.21.15.5:0/3810459638 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fc86801e9c0 con 0x559116e3cf60 2024-08-31T05:29:52.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.088+0000 7fc87ba26740 1 -- 172.21.15.5:0/3810459638 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8580054d0 con 0x559116e3cf60 2024-08-31T05:29:52.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.088+0000 7fc8567fc640 1 -- 172.21.15.5:0/3810459638 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc868032050 con 0x559116e3cf60 2024-08-31T05:29:52.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.088+0000 7fc87ba26740 10 client.15504 fetch_fsmap learned FSMap version 29 2024-08-31T05:29:52.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.088+0000 7fc87ba26740 1 -- 172.21.15.5:0/3810459638 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5591172010d0 con 0x559116e3cf60 2024-08-31T05:29:52.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.088+0000 7fc8567fc640 1 -- 172.21.15.5:0/3810459638 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8580054d0 con 0x559116e3cf60 2024-08-31T05:29:52.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.088+0000 7fc8567fc640 1 -- 172.21.15.5:0/3810459638 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fc86800f040 con 0x559116e3cf60 2024-08-31T05:29:52.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.089+0000 7fc87ba26740 10 client.15504 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T05:29:52.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.089+0000 7fc87ba26740 10 client.15504 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-31T05:29:52.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.089+0000 7fc87ba26740 20 client.15504 populate_metadata read hostname 'smithi005' 2024-08-31T05:29:52.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.089+0000 7fc87ba26740 1 --2- 172.21.15.5:0/3810459638 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x559116dfb8e0 0x559117204bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:52.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.089+0000 7fc87ba26740 4 client.15504 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:29:52.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.089+0000 7fc87ba26740 1 -- 172.21.15.5:0/3810459638 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55911715b340 con 0x559116dfb8e0 2024-08-31T05:29:52.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.089+0000 7fc86effd640 1 --2- 172.21.15.5:0/3810459638 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x559116dfb8e0 0x559117204bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:52.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.089+0000 7fc86effd640 1 --2- 172.21.15.5:0/3810459638 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x559116dfb8e0 0x559117204bd0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2037c25dd8c6ad6 server_cookie=9d3983b9610a6cf0 in_seq=0 out_seq=0 2024-08-31T05:29:52.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.089+0000 7fc8567fc640 10 client.15504 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:29:52.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.090+0000 7fc8567fc640 1 -- 172.21.15.5:0/3810459638 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55911715b340 con 0x559116dfb8e0 2024-08-31T05:29:52.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.090+0000 7fc8567fc640 10 client.15504 handle_command_reply: tid=0 2024-08-31T05:29:52.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.090+0000 7fc87ba26740 1 client.15504 shutdown 2024-08-31T05:29:52.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.090+0000 7fc87ba26740 1 -- 172.21.15.5:0/3810459638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559116e3cf60 msgr2=0x5591171fe650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:52.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.090+0000 7fc87ba26740 1 --2- 172.21.15.5:0/3810459638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559116e3cf60 0x5591171fe650 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc86801d870 tx=0x7fc868004a40 comp rx=0 tx=0).stop 2024-08-31T05:29:52.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.090+0000 7fc87ba26740 1 -- 172.21.15.5:0/3810459638 shutdown_connections 2024-08-31T05:29:52.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.090+0000 7fc87ba26740 1 --2- 172.21.15.5:0/3810459638 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x559116dfb8e0 0x559117204bd0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:52.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.090+0000 7fc87ba26740 1 --2- 172.21.15.5:0/3810459638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559116e3cf60 0x5591171fe650 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:52.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.090+0000 7fc8567fc640 0 client.15504 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:29:52.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.090+0000 7fc87ba26740 1 --2- 172.21.15.5:0/3810459638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559116e1c280 0x5591171f27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:52.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.090+0000 7fc87ba26740 1 --2- 172.21.15.5:0/3810459638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559116e140a0 0x5591171f2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:52.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.090+0000 7fc87ba26740 1 -- 172.21.15.5:0/3810459638 >> 172.21.15.5:0/3810459638 conn(0x559116e31350 msgr2=0x5591171e5940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:52.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.090+0000 7fc87ba26740 1 -- 172.21.15.5:0/3810459638 shutdown_connections 2024-08-31T05:29:52.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.090+0000 7fc87ba26740 1 -- 172.21.15.5:0/3810459638 wait complete. 2024-08-31T05:29:52.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.091+0000 7fc87ba26740 20 client.15504 trim_cache size 0 max 16384 2024-08-31T05:29:52.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.109+0000 7fc87ba26740 1 Processor -- start 2024-08-31T05:29:52.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.109+0000 7fc87ba26740 1 -- start start 2024-08-31T05:29:52.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.109+0000 7fc87ba26740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559116e140a0 0x559117202590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:52.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.109+0000 7fc87ba26740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559116e1c280 0x5591171fe5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:52.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.109+0000 7fc87ba26740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559116e3cf60 0x5591171dfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:52.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.109+0000 7fc87ba26740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x559117202f10 con 0x559116e1c280 2024-08-31T05:29:52.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.110+0000 7fc87ba26740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5591172035e0 con 0x559116e140a0 2024-08-31T05:29:52.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.110+0000 7fc87ba26740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559117203cb0 con 0x559116e3cf60 2024-08-31T05:29:52.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.110+0000 7fc8667fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559116e1c280 0x5591171fe5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:52.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.110+0000 7fc8667fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559116e1c280 0x5591171fe5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33186/0 (socket says 172.21.15.5:33186) 2024-08-31T05:29:52.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.110+0000 7fc8667fc640 1 -- 172.21.15.5:0/842832618 learned_addr learned my addr 172.21.15.5:0/842832618 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:52.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.110+0000 7fc86effd640 1 --2- 172.21.15.5:0/842832618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559116e140a0 0x559117202590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:52.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.110+0000 7fc86f7fe640 1 --2- 172.21.15.5:0/842832618 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559116e3cf60 0x5591171dfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:52.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.110+0000 7fc8667fc640 1 -- 172.21.15.5:0/842832618 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559116e3cf60 msgr2=0x5591171dfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:52.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.110+0000 7fc8667fc640 1 --2- 172.21.15.5:0/842832618 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559116e3cf60 0x5591171dfcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:52.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.110+0000 7fc8667fc640 1 -- 172.21.15.5:0/842832618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559116e140a0 msgr2=0x559117202590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:52.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.110+0000 7fc8667fc640 1 --2- 172.21.15.5:0/842832618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559116e140a0 0x559117202590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:52.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.110+0000 7fc8667fc640 1 -- 172.21.15.5:0/842832618 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591171f2dd0 con 0x559116e1c280 2024-08-31T05:29:52.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.110+0000 7fc86f7fe640 1 --2- 172.21.15.5:0/842832618 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559116e3cf60 0x5591171dfcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:29:52.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.110+0000 7fc86effd640 1 --2- 172.21.15.5:0/842832618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559116e140a0 0x559117202590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:29:52.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.110+0000 7fc8667fc640 1 --2- 172.21.15.5:0/842832618 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559116e1c280 0x5591171fe5c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fc85800dbb0 tx=0x7fc85800d630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daefce0e7fc66cc1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:52.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.110+0000 7fc864ff9640 1 -- 172.21.15.5:0/842832618 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc858029070 con 0x559116e1c280 2024-08-31T05:29:52.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.110+0000 7fc864ff9640 1 -- 172.21.15.5:0/842832618 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc858004030 con 0x559116e1c280 2024-08-31T05:29:52.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.110+0000 7fc864ff9640 1 -- 172.21.15.5:0/842832618 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc858015050 con 0x559116e1c280 2024-08-31T05:29:52.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.111+0000 7fc87ba26740 1 -- 172.21.15.5:0/842832618 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559116e1c280 msgr2=0x5591171fe5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:52.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.111+0000 7fc87ba26740 1 --2- 172.21.15.5:0/842832618 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559116e1c280 0x5591171fe5c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fc85800dbb0 tx=0x7fc85800d630 comp rx=0 tx=0).stop 2024-08-31T05:29:52.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.111+0000 7fc87ba26740 1 -- 172.21.15.5:0/842832618 shutdown_connections 2024-08-31T05:29:52.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.111+0000 7fc87ba26740 1 --2- 172.21.15.5:0/842832618 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559116e3cf60 0x5591171dfcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:52.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.111+0000 7fc87ba26740 1 --2- 172.21.15.5:0/842832618 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559116e1c280 0x5591171fe5c0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:52.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.111+0000 7fc87ba26740 1 --2- 172.21.15.5:0/842832618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559116e140a0 0x559117202590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:52.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.111+0000 7fc87ba26740 1 -- 172.21.15.5:0/842832618 >> 172.21.15.5:0/842832618 conn(0x559116e31350 msgr2=0x5591171f0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:52.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.111+0000 7fc87ba26740 1 -- 172.21.15.5:0/842832618 shutdown_connections 2024-08-31T05:29:52.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.111+0000 7fc87ba26740 1 -- 172.21.15.5:0/842832618 wait complete. 2024-08-31T05:29:52.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.112+0000 7fc87ba26740 1 -- start start 2024-08-31T05:29:52.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.112+0000 7fc87ba26740 1 Processor -- start 2024-08-31T05:29:52.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.112+0000 7fc87ba26740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559116e140a0 0x5591172071b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:52.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.112+0000 7fc87ba26740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559116e1c280 0x5591172076f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:52.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.112+0000 7fc87ba26740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559116e3cf60 0x55911720c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:52.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.112+0000 7fc87ba26740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x559117204a50 con 0x559116e3cf60 2024-08-31T05:29:52.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.112+0000 7fc87ba26740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559117204380 con 0x559116e140a0 2024-08-31T05:29:52.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.112+0000 7fc87ba26740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559117205120 con 0x559116e1c280 2024-08-31T05:29:52.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.112+0000 7fc87ba26740 10 client.0 _ll_register_callbacks cb 0x7fc86801d450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:29:52.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.112+0000 7fc86f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559116e3cf60 0x55911720c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:52.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.113+0000 7fc86f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559116e3cf60 0x55911720c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33202/0 (socket says 172.21.15.5:33202) 2024-08-31T05:29:52.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.113+0000 7fc86f7fe640 1 -- 172.21.15.5:0/792770907 learned_addr learned my addr 172.21.15.5:0/792770907 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:52.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.113+0000 7fc86effd640 1 --2- 172.21.15.5:0/792770907 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559116e140a0 0x5591172071b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:52.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.113+0000 7fc8667fc640 1 --2- 172.21.15.5:0/792770907 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559116e1c280 0x5591172076f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:52.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.113+0000 7fc86f7fe640 1 -- 172.21.15.5:0/792770907 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559116e1c280 msgr2=0x5591172076f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:52.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.113+0000 7fc86f7fe640 1 --2- 172.21.15.5:0/792770907 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559116e1c280 0x5591172076f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:52.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.113+0000 7fc86f7fe640 1 -- 172.21.15.5:0/792770907 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559116e140a0 msgr2=0x5591172071b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:29:52.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.113+0000 7fc86f7fe640 1 --2- 172.21.15.5:0/792770907 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559116e140a0 0x5591172071b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:52.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.113+0000 7fc86f7fe640 1 -- 172.21.15.5:0/792770907 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559117207fe0 con 0x559116e3cf60 2024-08-31T05:29:52.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.113+0000 7fc86effd640 1 --2- 172.21.15.5:0/792770907 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559116e140a0 0x5591172071b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:29:52.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.113+0000 7fc86f7fe640 1 --2- 172.21.15.5:0/792770907 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559116e3cf60 0x55911720c940 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc868000f80 tx=0x7fc86801b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3057bccadf13d5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:52.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.113+0000 7fc8567fc640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:29:52.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.113+0000 7fc8567fc640 1 -- 172.21.15.5:0/792770907 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc86803c070 con 0x559116e3cf60 2024-08-31T05:29:52.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.113+0000 7fc8567fc640 1 -- 172.21.15.5:0/792770907 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fc86801e620 con 0x559116e3cf60 2024-08-31T05:29:52.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.113+0000 7fc87ba26740 1 -- 172.21.15.5:0/792770907 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc858004030 con 0x559116e3cf60 2024-08-31T05:29:52.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.113+0000 7fc8567fc640 1 -- 172.21.15.5:0/792770907 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc86801dd30 con 0x559116e3cf60 2024-08-31T05:29:52.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.113+0000 7fc87ba26740 10 client.15510 fetch_fsmap learned FSMap version 29 2024-08-31T05:29:52.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.113+0000 7fc87ba26740 1 -- 172.21.15.5:0/792770907 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5591172706c0 con 0x559116e3cf60 2024-08-31T05:29:52.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.114+0000 7fc8567fc640 1 -- 172.21.15.5:0/792770907 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc858004030 con 0x559116e3cf60 2024-08-31T05:29:52.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.114+0000 7fc8567fc640 1 -- 172.21.15.5:0/792770907 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fc868035040 con 0x559116e3cf60 2024-08-31T05:29:52.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.114+0000 7fc87ba26740 10 client.15510 fetch_fsmap finished waiting for FSMap version 29 2024-08-31T05:29:52.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.114+0000 7fc87ba26740 10 client.15510 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-31T05:29:52.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.114+0000 7fc87ba26740 20 client.15510 populate_metadata read hostname 'smithi005' 2024-08-31T05:29:52.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.114+0000 7fc87ba26740 1 --2- 172.21.15.5:0/792770907 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x559116dd0c90 0x559117274020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:52.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.114+0000 7fc87ba26740 4 client.15510 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T05:29:52.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.114+0000 7fc87ba26740 1 -- 172.21.15.5:0/792770907 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "status"}) -- 0x559117202d60 con 0x559116dd0c90 2024-08-31T05:29:52.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.114+0000 7fc86effd640 1 --2- 172.21.15.5:0/792770907 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x559116dd0c90 0x559117274020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:52.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.115+0000 7fc86effd640 1 --2- 172.21.15.5:0/792770907 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x559116dd0c90 0x559117274020 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc598aa203d66b57 server_cookie=6d2b668ac4063bc2 in_seq=0 out_seq=0 2024-08-31T05:29:52.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.115+0000 7fc8567fc640 10 client.15510 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:29:52.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.115+0000 7fc8567fc640 1 -- 172.21.15.5:0/792770907 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x559117202d60 con 0x559116dd0c90 2024-08-31T05:29:52.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.115+0000 7fc8567fc640 10 client.15510 handle_command_reply: tid=0 2024-08-31T05:29:52.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.115+0000 7fc87ba26740 1 client.15510 shutdown 2024-08-31T05:29:52.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.115+0000 7fc87ba26740 1 -- 172.21.15.5:0/792770907 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559116e3cf60 msgr2=0x55911720c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:52.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.115+0000 7fc87ba26740 1 --2- 172.21.15.5:0/792770907 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559116e3cf60 0x55911720c940 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc868000f80 tx=0x7fc86801b6c0 comp rx=0 tx=0).stop 2024-08-31T05:29:52.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.115+0000 7fc87ba26740 1 -- 172.21.15.5:0/792770907 shutdown_connections 2024-08-31T05:29:52.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.115+0000 7fc87ba26740 1 --2- 172.21.15.5:0/792770907 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x559116dd0c90 0x559117274020 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:52.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.115+0000 7fc87ba26740 1 --2- 172.21.15.5:0/792770907 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559116e3cf60 0x55911720c940 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:52.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.115+0000 7fc87ba26740 1 --2- 172.21.15.5:0/792770907 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559116e1c280 0x5591172076f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:52.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.115+0000 7fc87ba26740 1 --2- 172.21.15.5:0/792770907 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559116e140a0 0x5591172071b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:52.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.115+0000 7fc87ba26740 1 -- 172.21.15.5:0/792770907 >> 172.21.15.5:0/792770907 conn(0x559116e31350 msgr2=0x5591171e5940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:52.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.115+0000 7fc8567fc640 0 client.15510 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:29:52.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.115+0000 7fc87ba26740 1 -- 172.21.15.5:0/792770907 shutdown_connections 2024-08-31T05:29:52.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.115+0000 7fc87ba26740 1 -- 172.21.15.5:0/792770907 wait complete. 2024-08-31T05:29:52.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.115+0000 7fc87ba26740 20 client.15510 trim_cache size 0 max 16384 2024-08-31T05:29:52.123 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:29:52.123 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "69422704-6758-11ef-bcd4-c7b262605968", 2024-08-31T05:29:52.123 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-08-31T05:29:52.123 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 24652, 2024-08-31T05:29:52.123 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-08-31T05:29:52.123 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-08-31T05:29:52.123 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-08-31T05:29:52.123 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 139.864069796, 2024-08-31T05:29:52.123 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 29, 2024-08-31T05:29:52.123 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 87, 2024-08-31T05:29:52.123 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 85, 2024-08-31T05:29:52.123 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 159.74826594699999 2024-08-31T05:29:52.124 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:29:52.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.116+0000 7fc8754b1640 1 -- 172.21.15.5:0/1205332505 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc85c0b4b80 msgr2=0x7fc85c0b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:52.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.116+0000 7fc8754b1640 1 --2- 172.21.15.5:0/1205332505 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc85c0b4b80 0x7fc85c0b7090 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc868005fd0 tx=0x7fc8680096e0 comp rx=0 tx=0).stop 2024-08-31T05:29:52.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.116+0000 7fc8754b1640 1 -- 172.21.15.5:0/1205332505 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc870102810 msgr2=0x7fc87019a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:52.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.116+0000 7fc8754b1640 1 --2- 172.21.15.5:0/1205332505 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc870102810 0x7fc87019a270 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc860005940 tx=0x7fc8600042f0 comp rx=0 tx=0).stop 2024-08-31T05:29:52.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.116+0000 7fc8754b1640 1 -- 172.21.15.5:0/1205332505 shutdown_connections 2024-08-31T05:29:52.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.116+0000 7fc8754b1640 1 --2- 172.21.15.5:0/1205332505 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc85c0b4b80 0x7fc85c0b7090 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:52.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.116+0000 7fc8754b1640 1 --2- 172.21.15.5:0/1205332505 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc870108aa0 0x7fc87019fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:52.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.116+0000 7fc8754b1640 1 --2- 172.21.15.5:0/1205332505 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc870108150 0x7fc87019a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:52.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.116+0000 7fc8754b1640 1 --2- 172.21.15.5:0/1205332505 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc870102810 0x7fc87019a270 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:52.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.116+0000 7fc8754b1640 1 -- 172.21.15.5:0/1205332505 >> 172.21.15.5:0/1205332505 conn(0x7fc8700794b0 msgr2=0x7fc870101880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:52.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.116+0000 7fc8754b1640 1 -- 172.21.15.5:0/1205332505 shutdown_connections 2024-08-31T05:29:52.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:52.116+0000 7fc8754b1640 1 -- 172.21.15.5:0/1205332505 wait complete. 2024-08-31T05:29:52.688 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:52 smithi005 ceph-mon[18602]: pgmap v342: 129 pgs: 129 active+clean; 645 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-31T05:29:52.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:52 smithi070 ceph-mon[22316]: pgmap v342: 129 pgs: 129 active+clean; 645 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-31T05:29:52.857 INFO:teuthology.run_tasks:Running task kclient... 2024-08-31T05:29:52.870 INFO:tasks.kclient:Mounting kernel clients... 2024-08-31T05:29:52.871 INFO:tasks.kclient:config is {'client.0': {}} 2024-08-31T05:29:52.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T05:29:52.871 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-08-31T05:29:52.887 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-08-31T05:29:52.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T05:29:52.888 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-31T05:29:52.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:52 smithi050 ceph-mon[22146]: pgmap v342: 129 pgs: 129 active+clean; 645 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-31T05:29:52.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T05:29:52.955 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link delete ceph-brx 2024-08-31T05:29:53.057 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=crc', 'nowsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2024-08-31T05:29:53.057 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-08-31T05:29:53.057 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-31T05:29:53.057 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs ls 2024-08-31T05:29:53.317 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:29:53.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:53.799+0000 7f33fda0f640 1 -- 172.21.15.5:0/407074669 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33f8108150 msgr2=0x7f33f8108560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:53.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:53.799+0000 7f33fda0f640 1 --2- 172.21.15.5:0/407074669 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33f8108150 0x7f33f8108560 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f33e0009900 tx=0x7f33e002a410 comp rx=0 tx=0).stop 2024-08-31T05:29:53.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:53.799+0000 7f33fda0f640 1 -- 172.21.15.5:0/407074669 shutdown_connections 2024-08-31T05:29:53.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:53.799+0000 7f33fda0f640 1 --2- 172.21.15.5:0/407074669 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33f8108aa0 0x7f33f810f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:53.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:53.799+0000 7f33fda0f640 1 --2- 172.21.15.5:0/407074669 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33f8108150 0x7f33f8108560 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:53.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:53.799+0000 7f33fda0f640 1 --2- 172.21.15.5:0/407074669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33f8102810 0x7f33f8102c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:53.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:53.799+0000 7f33fda0f640 1 -- 172.21.15.5:0/407074669 >> 172.21.15.5:0/407074669 conn(0x7f33f80794b0 msgr2=0x7f33f80798c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:53.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:53.799+0000 7f33fda0f640 1 -- 172.21.15.5:0/407074669 shutdown_connections 2024-08-31T05:29:53.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:53.799+0000 7f33fda0f640 1 -- 172.21.15.5:0/407074669 wait complete. 2024-08-31T05:29:53.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:53.799+0000 7f33fda0f640 1 Processor -- start 2024-08-31T05:29:53.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:53.799+0000 7f33fda0f640 1 -- start start 2024-08-31T05:29:53.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:53.800+0000 7f33fda0f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33f8102810 0x7f33f819a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:53.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:53.800+0000 7f33fda0f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33f8108150 0x7f33f819a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:53.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:53.800+0000 7f33fda0f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33f8108aa0 0x7f33f819fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:53.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:53.800+0000 7f33fda0f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f33f8113880 con 0x7f33f8108aa0 2024-08-31T05:29:53.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:53.800+0000 7f33fda0f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f33f8113700 con 0x7f33f8102810 2024-08-31T05:29:53.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:53.800+0000 7f33fda0f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f33f8113a00 con 0x7f33f8108150 2024-08-31T05:29:53.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:53.800+0000 7f33f77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33f8108aa0 0x7f33f819fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:53.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:53.800+0000 7f33f77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33f8108aa0 0x7f33f819fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33212/0 (socket says 172.21.15.5:33212) 2024-08-31T05:29:53.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:53.800+0000 7f33f77fe640 1 -- 172.21.15.5:0/1918883098 learned_addr learned my addr 172.21.15.5:0/1918883098 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:53.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:53.800+0000 7f33effff640 1 --2- 172.21.15.5:0/1918883098 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33f8108150 0x7f33f819a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:53.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:53.800+0000 7f33f6ffd640 1 --2- 172.21.15.5:0/1918883098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33f8102810 0x7f33f819a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:53.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:53.800+0000 7f33f77fe640 1 -- 172.21.15.5:0/1918883098 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33f8108150 msgr2=0x7f33f819a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:53.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:53.800+0000 7f33f77fe640 1 --2- 172.21.15.5:0/1918883098 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33f8108150 0x7f33f819a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:53.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:53.800+0000 7f33f77fe640 1 -- 172.21.15.5:0/1918883098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33f8102810 msgr2=0x7f33f819a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:53.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:53.800+0000 7f33f77fe640 1 --2- 172.21.15.5:0/1918883098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33f8102810 0x7f33f819a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:53.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:53.800+0000 7f33f77fe640 1 -- 172.21.15.5:0/1918883098 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33f81a0200 con 0x7f33f8108aa0 2024-08-31T05:29:53.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:53.800+0000 7f33f77fe640 1 --2- 172.21.15.5:0/1918883098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33f8108aa0 0x7f33f819fad0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f33f000eaa0 tx=0x7f33f000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:53.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:53.801+0000 7f33fca0d640 1 -- 172.21.15.5:0/1918883098 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f000cdb0 con 0x7f33f8108aa0 2024-08-31T05:29:53.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:53.801+0000 7f33fda0f640 1 -- 172.21.15.5:0/1918883098 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33f81a04f0 con 0x7f33f8108aa0 2024-08-31T05:29:53.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:53.801+0000 7f33fca0d640 1 -- 172.21.15.5:0/1918883098 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f33f0005020 con 0x7f33f8108aa0 2024-08-31T05:29:53.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:53.801+0000 7f33fca0d640 1 -- 172.21.15.5:0/1918883098 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f00116d0 con 0x7f33f8108aa0 2024-08-31T05:29:53.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:53.801+0000 7f33fda0f640 1 -- 172.21.15.5:0/1918883098 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33f81a6c50 con 0x7f33f8108aa0 2024-08-31T05:29:53.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:53.802+0000 7f33fda0f640 1 -- 172.21.15.5:0/1918883098 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33f8103a90 con 0x7f33f8108aa0 2024-08-31T05:29:53.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:53.803+0000 7f33fca0d640 1 -- 172.21.15.5:0/1918883098 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) ==== 152593+0+0 (secure 0 0 0) 0x7f33f00051d0 con 0x7f33f8108aa0 2024-08-31T05:29:53.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:53.804+0000 7f33fca0d640 1 --2- 172.21.15.5:0/1918883098 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f33e40b4b80 0x7f33e40b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:53.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:53.804+0000 7f33f6ffd640 1 --2- 172.21.15.5:0/1918883098 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f33e40b4b80 0x7f33e40b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:53.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:53.804+0000 7f33fca0d640 1 -- 172.21.15.5:0/1918883098 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f33f00e5a80 con 0x7f33f8108aa0 2024-08-31T05:29:53.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:53.804+0000 7f33f6ffd640 1 --2- 172.21.15.5:0/1918883098 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f33e40b4b80 0x7f33e40b7090 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f33e8005d00 tx=0x7f33e800b410 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:53.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:53.807+0000 7f33fca0d640 1 -- 172.21.15.5:0/1918883098 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f33f0016030 con 0x7f33f8108aa0 2024-08-31T05:29:54.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:54.031+0000 7f33fda0f640 1 -- 172.21.15.5:0/1918883098 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f33f8102c20 con 0x7f33f8108aa0 2024-08-31T05:29:54.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:54.031+0000 7f33fca0d640 1 -- 172.21.15.5:0/1918883098 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v29) ==== 53+0+88 (secure 0 0 0) 0x7f33f8102c20 con 0x7f33f8108aa0 2024-08-31T05:29:54.038 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-08-31T05:29:54.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:54.033+0000 7f33fda0f640 1 -- 172.21.15.5:0/1918883098 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f33e40b4b80 msgr2=0x7f33e40b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:54.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:54.033+0000 7f33fda0f640 1 --2- 172.21.15.5:0/1918883098 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f33e40b4b80 0x7f33e40b7090 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f33e8005d00 tx=0x7f33e800b410 comp rx=0 tx=0).stop 2024-08-31T05:29:54.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:54.033+0000 7f33fda0f640 1 -- 172.21.15.5:0/1918883098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33f8108aa0 msgr2=0x7f33f819fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:54.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:54.033+0000 7f33fda0f640 1 --2- 172.21.15.5:0/1918883098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33f8108aa0 0x7f33f819fad0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f33f000eaa0 tx=0x7f33f000ef60 comp rx=0 tx=0).stop 2024-08-31T05:29:54.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:54.033+0000 7f33fda0f640 1 -- 172.21.15.5:0/1918883098 shutdown_connections 2024-08-31T05:29:54.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:54.033+0000 7f33fda0f640 1 --2- 172.21.15.5:0/1918883098 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f33e40b4b80 0x7f33e40b7090 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:54.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:54.033+0000 7f33fda0f640 1 --2- 172.21.15.5:0/1918883098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33f8108aa0 0x7f33f819fad0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:54.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:54.033+0000 7f33fda0f640 1 --2- 172.21.15.5:0/1918883098 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33f8108150 0x7f33f819a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:54.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:54.033+0000 7f33fda0f640 1 --2- 172.21.15.5:0/1918883098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f33f8102810 0x7f33f819a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:54.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:54.033+0000 7f33fda0f640 1 -- 172.21.15.5:0/1918883098 >> 172.21.15.5:0/1918883098 conn(0x7f33f80794b0 msgr2=0x7f33f8106260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:54.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:54.033+0000 7f33fda0f640 1 -- 172.21.15.5:0/1918883098 shutdown_connections 2024-08-31T05:29:54.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:54.033+0000 7f33fda0f640 1 -- 172.21.15.5:0/1918883098 wait complete. 2024-08-31T05:29:54.823 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:54 smithi005 ceph-mon[18602]: pgmap v343: 129 pgs: 129 active+clean; 645 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-31T05:29:54.823 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:54 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/1918883098' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-08-31T05:29:54.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:54 smithi070 ceph-mon[22316]: pgmap v343: 129 pgs: 129 active+clean; 645 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-31T05:29:54.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:54 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/1918883098' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-08-31T05:29:54.851 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-31T05:29:54.851 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-31T05:29:54.851 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-08-31T05:29:54.851 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-31T05:29:54.851 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-31T05:29:54.851 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-31T05:29:54.851 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-31T05:29:54.851 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-31T05:29:54.852 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-31T05:29:54.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T05:29:54.852 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-08-31T05:29:54.869 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-31T05:29:54.869 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-31T05:29:54.870 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-08-31T05:29:54.870 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-31T05:29:54.870 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-08-31T05:29:54.870 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-31T05:29:54.870 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-31T05:29:54.870 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-08-31T05:29:54.870 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-08-31T05:29:54.870 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-31T05:29:54.870 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-08-31T05:29:54.870 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-08-31T05:29:54.870 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-31T05:29:54.870 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-08-31T05:29:54.870 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-08-31T05:29:54.871 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-31T05:29:54.871 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42179sec preferred_lft 42179sec 2024-08-31T05:29:54.871 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::5e23:6663:4f43:f7c4/64 scope link noprefixroute 2024-08-31T05:29:54.871 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-08-31T05:29:54.871 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-31T05:29:54.871 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-08-31T05:29:54.871 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-08-31T05:29:54.871 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-31T05:29:54.872 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T05:29:54.872 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-31T05:29:54.872 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add name ceph-brx type bridge 2024-08-31T05:29:54.872 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip addr flush dev ceph-brx 2024-08-31T05:29:54.872 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set ceph-brx up 2024-08-31T05:29:54.872 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-31T05:29:54.872 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-31T05:29:54.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:54 smithi050 ceph-mon[22146]: pgmap v343: 129 pgs: 129 active+clean; 645 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-31T05:29:54.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:54 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/1918883098' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-08-31T05:29:54.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T05:29:55.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T05:29:55.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T05:29:55.011 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-31T05:29:55.035 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-08-31T05:29:55.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T05:29:55.037 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-08-31T05:29:55.093 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-08-31T05:29:55.093 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-31T05:29:55.093 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-31T05:29:55.093 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-31T05:29:55.093 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-31T05:29:55.094 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T05:29:55.094 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-31T05:29:55.094 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-31T05:29:55.094 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-31T05:29:55.094 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-31T05:29:55.094 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-31T05:29:55.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T05:29:55.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T05:29:55.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T05:29:55.221 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-08-31T05:29:55.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T05:29:55.237 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list-id 2024-08-31T05:29:55.292 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T05:29:55.292 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-31T05:29:55.292 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-31T05:29:55.292 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-08-31T05:29:55.292 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-31T05:29:55.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T05:29:55.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T05:29:55.409 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-08-31T05:29:55.409 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T05:29:55.409 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-31T05:29:55.409 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-08-31T05:29:55.409 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-31T05:29:55.409 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-08-31T05:29:55.410 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-08-31T05:29:55.410 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-08-31T05:29:55.410 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-31T05:29:55.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T05:29:55.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T05:29:55.523 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T05:29:55.524 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-08-31T05:29:55.524 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2024-08-31T05:29:55.524 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set dev brx.0 master ceph-brx 2024-08-31T05:29:55.524 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-08-31T05:29:55.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T05:29:55.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T05:29:55.601 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-31T05:29:55.602 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-31T05:29:55.616 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-31T05:29:55.616 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-31T05:29:55.617 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-31T05:29:55.672 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-08-31T05:29:55.672 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-08-31T05:29:55.672 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/15035519-2b35-4b61-92f0-6db90b6d9dc0 2024-08-31T05:29:55.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T05:29:55.672 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/15035519-2b35-4b61-92f0-6db90b6d9dc0 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,nowsync,nofallback 2024-08-31T05:29:55.765 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,nowsync,nofallback 2024-08-31T05:29:55.765 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,nowsync". 2024-08-31T05:29:55.925 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,nowsync,nofallback 2024-08-31T05:29:55.925 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,nowsync". 2024-08-31T05:29:55.925 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.50:3300,172.21.15.70:3300" 2024-08-31T05:29:55.925 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with new device syntax: 0@69422704-6758-11ef-bcd4-c7b262605968.cephfs=/volumes/qa/sv_1/15035519-2b35-4b61-92f0-6db90b6d9dc0 2024-08-31T05:29:55.925 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,nowsync,name=0,key=0,mon_addr=172.21.15.5:3300/172.21.15.50:3300/172.21.15.70:3300" will pass to kernel 2024-08-31T05:29:55.926 INFO:teuthology.orchestra.run.smithi005.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-31T05:29:55.926 INFO:teuthology.orchestra.run.smithi005.stdout: You just mounted a file system that supports labels which does not 2024-08-31T05:29:55.926 INFO:teuthology.orchestra.run.smithi005.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-31T05:29:55.926 INFO:teuthology.orchestra.run.smithi005.stdout: applications will generate AVC messages and not be allowed access to 2024-08-31T05:29:55.926 INFO:teuthology.orchestra.run.smithi005.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-31T05:29:55.928 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-31T05:29:55.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T05:29:55.928 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-31T05:29:55.954 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-31T05:29:56.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-31T05:29:56.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T05:29:56.052 INFO:teuthology.orchestra.run.smithi005.stdout:client25181 2024-08-31T05:29:56.052 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-31T05:29:56.052 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-31T05:29:56.069 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-31T05:29:56.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-31T05:29:56.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T05:29:56.164 INFO:teuthology.orchestra.run.smithi005.stdout:client25181 2024-08-31T05:29:56.164 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-31T05:29:56.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-31T05:29:56.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T05:29:56.221 INFO:teuthology.orchestra.run.smithi005.stdout:client25181 2024-08-31T05:29:56.221 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/69422704-6758-11ef-bcd4-c7b262605968.client25181/status') 2024-08-31T05:29:56.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T05:29:56.279 INFO:teuthology.orchestra.run.smithi005.stdout:instance: client.25181 (3)172.21.15.5:0/245398804 2024-08-31T05:29:56.279 INFO:teuthology.orchestra.run.smithi005.stdout:blocklisted: false 2024-08-31T05:29:56.279 INFO:teuthology.orchestra.run.smithi005.stderr:0+1 records in 2024-08-31T05:29:56.279 INFO:teuthology.orchestra.run.smithi005.stderr:0+1 records out 2024-08-31T05:29:56.279 INFO:teuthology.orchestra.run.smithi005.stderr:69 bytes copied, 2.2553e-05 s, 3.1 MB/s 2024-08-31T05:29:56.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T05:29:56.286 INFO:teuthology.run_tasks:Running task exec... 2024-08-31T05:29:56.297 INFO:teuthology.task.exec:Executing custom commands... 2024-08-31T05:29:56.298 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi005.front.sepia.ceph.com 2024-08-31T05:29:56.298 DEBUG:teuthology.orchestra.run.smithi005:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-08-31T05:29:56.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:56.407+0000 7fccb7294640 1 -- 172.21.15.5:0/429560226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccb01089f0 msgr2=0x7fccb010f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:56.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:56.407+0000 7fccb7294640 1 --2- 172.21.15.5:0/429560226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccb01089f0 0x7fccb010f220 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fcca8009ca0 tx=0x7fcca802a8c0 comp rx=0 tx=0).stop 2024-08-31T05:29:56.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:56.408+0000 7fccb7294640 1 -- 172.21.15.5:0/429560226 shutdown_connections 2024-08-31T05:29:56.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:56.408+0000 7fccb7294640 1 --2- 172.21.15.5:0/429560226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccb01089f0 0x7fccb010f220 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:56.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:56.408+0000 7fccb7294640 1 --2- 172.21.15.5:0/429560226 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccb01080a0 0x7fccb01084b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:56.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:56.408+0000 7fccb7294640 1 --2- 172.21.15.5:0/429560226 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fccb0102770 0x7fccb0102b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:56.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:56.408+0000 7fccb7294640 1 -- 172.21.15.5:0/429560226 >> 172.21.15.5:0/429560226 conn(0x7fccb007a4b0 msgr2=0x7fccb007a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:56.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:56.408+0000 7fccb7294640 1 -- 172.21.15.5:0/429560226 shutdown_connections 2024-08-31T05:29:56.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:56.408+0000 7fccb7294640 1 -- 172.21.15.5:0/429560226 wait complete. 2024-08-31T05:29:56.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:56.408+0000 7fccb7294640 1 Processor -- start 2024-08-31T05:29:56.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:56.408+0000 7fccb7294640 1 -- start start 2024-08-31T05:29:56.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:56.409+0000 7fccb7294640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fccb0102770 0x7fccb019b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:56.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:56.409+0000 7fccb7294640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccb01080a0 0x7fccb019b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:56.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:56.409+0000 7fccb7294640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccb01089f0 0x7fccb019bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:56.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:56.409+0000 7fccb7294640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fccb0112660 con 0x7fccb01089f0 2024-08-31T05:29:56.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:56.409+0000 7fccb7294640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fccb01124e0 con 0x7fccb01080a0 2024-08-31T05:29:56.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:56.409+0000 7fccb7294640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fccb01127e0 con 0x7fccb0102770 2024-08-31T05:29:56.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:56.409+0000 7fccb5831640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccb01089f0 0x7fccb019bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:56.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:56.409+0000 7fccb5831640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccb01089f0 0x7fccb019bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33232/0 (socket says 172.21.15.5:33232) 2024-08-31T05:29:56.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:56.409+0000 7fccb5831640 1 -- 172.21.15.5:0/409900259 learned_addr learned my addr 172.21.15.5:0/409900259 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:56.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:56.409+0000 7fccb5030640 1 --2- 172.21.15.5:0/409900259 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fccb0102770 0x7fccb019b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:56.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:56.409+0000 7fccb482f640 1 --2- 172.21.15.5:0/409900259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccb01080a0 0x7fccb019b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:56.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:56.409+0000 7fccb5831640 1 -- 172.21.15.5:0/409900259 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fccb0102770 msgr2=0x7fccb019b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:56.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:56.409+0000 7fccb5831640 1 --2- 172.21.15.5:0/409900259 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fccb0102770 0x7fccb019b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:56.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:56.409+0000 7fccb5831640 1 -- 172.21.15.5:0/409900259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccb01080a0 msgr2=0x7fccb019b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:56.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:56.409+0000 7fccb5831640 1 --2- 172.21.15.5:0/409900259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccb01080a0 0x7fccb019b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:56.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:56.409+0000 7fccb5831640 1 -- 172.21.15.5:0/409900259 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccb01a6340 con 0x7fccb01089f0 2024-08-31T05:29:56.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:56.409+0000 7fccb5831640 1 --2- 172.21.15.5:0/409900259 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccb01089f0 0x7fccb019bb30 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fcca8005cc0 tx=0x7fcca802f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:56.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:56.410+0000 7fcca67fc640 1 -- 172.21.15.5:0/409900259 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca8003bf0 con 0x7fccb01089f0 2024-08-31T05:29:56.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:56.410+0000 7fcca67fc640 1 -- 172.21.15.5:0/409900259 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcca8003d90 con 0x7fccb01089f0 2024-08-31T05:29:56.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:56.410+0000 7fccb7294640 1 -- 172.21.15.5:0/409900259 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccb01a65d0 con 0x7fccb01089f0 2024-08-31T05:29:56.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:56.410+0000 7fcca67fc640 1 -- 172.21.15.5:0/409900259 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca802fbc0 con 0x7fccb01089f0 2024-08-31T05:29:56.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:56.410+0000 7fccb7294640 1 -- 172.21.15.5:0/409900259 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccb01a6b20 con 0x7fccb01089f0 2024-08-31T05:29:56.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:56.411+0000 7fccb7294640 1 -- 172.21.15.5:0/409900259 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccb01039e0 con 0x7fccb01089f0 2024-08-31T05:29:56.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:56.412+0000 7fcca67fc640 1 -- 172.21.15.5:0/409900259 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) ==== 152593+0+0 (secure 0 0 0) 0x7fcca802fd60 con 0x7fccb01089f0 2024-08-31T05:29:56.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:56.413+0000 7fcca67fc640 1 --2- 172.21.15.5:0/409900259 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fcc9c0b4b80 0x7fcc9c0b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:56.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:56.413+0000 7fcca67fc640 1 -- 172.21.15.5:0/409900259 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fcca8106c40 con 0x7fccb01089f0 2024-08-31T05:29:56.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:56.413+0000 7fccb5030640 1 --2- 172.21.15.5:0/409900259 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fcc9c0b4b80 0x7fcc9c0b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:56.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:56.414+0000 7fccb5030640 1 --2- 172.21.15.5:0/409900259 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fcc9c0b4b80 0x7fcc9c0b7090 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fccb006c250 tx=0x7fccac00b410 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:56.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:56.416+0000 7fcca67fc640 1 -- 172.21.15.5:0/409900259 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fcca80cd8d0 con 0x7fccb01089f0 2024-08-31T05:29:56.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:56.644+0000 7fccb7294640 1 -- 172.21.15.5:0/409900259 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7fccb0102b80 con 0x7fccb01089f0 2024-08-31T05:29:56.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:56 smithi070 ceph-mon[22316]: pgmap v344: 129 pgs: 129 active+clean; 645 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-08-31T05:29:56.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:56 smithi050 ceph-mon[22146]: pgmap v344: 129 pgs: 129 active+clean; 645 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-08-31T05:29:56.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:56 smithi005 ceph-mon[18602]: pgmap v344: 129 pgs: 129 active+clean; 645 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-08-31T05:29:57.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.568+0000 7fcca67fc640 1 -- 172.21.15.5:0/409900259 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v30) ==== 118+0+0 (secure 0 0 0) 0x7fcca80098b0 con 0x7fccb01089f0 2024-08-31T05:29:57.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.572+0000 7fccb7294640 1 -- 172.21.15.5:0/409900259 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fcc9c0b4b80 msgr2=0x7fcc9c0b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:57.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.572+0000 7fccb7294640 1 --2- 172.21.15.5:0/409900259 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fcc9c0b4b80 0x7fcc9c0b7090 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fccb006c250 tx=0x7fccac00b410 comp rx=0 tx=0).stop 2024-08-31T05:29:57.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.572+0000 7fccb7294640 1 -- 172.21.15.5:0/409900259 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccb01089f0 msgr2=0x7fccb019bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:57.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.572+0000 7fccb7294640 1 --2- 172.21.15.5:0/409900259 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccb01089f0 0x7fccb019bb30 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fcca8005cc0 tx=0x7fcca802f380 comp rx=0 tx=0).stop 2024-08-31T05:29:57.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.572+0000 7fccb7294640 1 -- 172.21.15.5:0/409900259 shutdown_connections 2024-08-31T05:29:57.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.572+0000 7fccb7294640 1 --2- 172.21.15.5:0/409900259 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fcc9c0b4b80 0x7fcc9c0b7090 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:57.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.572+0000 7fccb7294640 1 --2- 172.21.15.5:0/409900259 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccb01089f0 0x7fccb019bb30 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:57.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.572+0000 7fccb7294640 1 --2- 172.21.15.5:0/409900259 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccb01080a0 0x7fccb019b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:57.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.572+0000 7fccb7294640 1 --2- 172.21.15.5:0/409900259 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fccb0102770 0x7fccb019b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:57.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.572+0000 7fccb7294640 1 -- 172.21.15.5:0/409900259 >> 172.21.15.5:0/409900259 conn(0x7fccb007a4b0 msgr2=0x7fccb0104110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:57.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.572+0000 7fccb7294640 1 -- 172.21.15.5:0/409900259 shutdown_connections 2024-08-31T05:29:57.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.572+0000 7fccb7294640 1 -- 172.21.15.5:0/409900259 wait complete. 2024-08-31T05:29:57.588 DEBUG:teuthology.orchestra.run.smithi005:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-08-31T05:29:57.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.707+0000 7f4e7e253640 1 -- 172.21.15.5:0/1466559116 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e78101af0 msgr2=0x7f4e78101f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:57.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.707+0000 7f4e7e253640 1 --2- 172.21.15.5:0/1466559116 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e78101af0 0x7f4e78101f00 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c009900 tx=0x7f4e6c02a410 comp rx=0 tx=0).stop 2024-08-31T05:29:57.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.707+0000 7f4e7e253640 1 -- 172.21.15.5:0/1466559116 shutdown_connections 2024-08-31T05:29:57.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.707+0000 7f4e7e253640 1 --2- 172.21.15.5:0/1466559116 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e781025c0 0x7f4e78112250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:57.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.707+0000 7f4e7e253640 1 --2- 172.21.15.5:0/1466559116 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e78101af0 0x7f4e78101f00 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:57.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.707+0000 7f4e7e253640 1 --2- 172.21.15.5:0/1466559116 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e781043a0 0x7f4e781047b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:57.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.707+0000 7f4e7e253640 1 -- 172.21.15.5:0/1466559116 >> 172.21.15.5:0/1466559116 conn(0x7f4e78079a80 msgr2=0x7f4e78079ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:57.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.707+0000 7f4e7e253640 1 -- 172.21.15.5:0/1466559116 shutdown_connections 2024-08-31T05:29:57.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.707+0000 7f4e7e253640 1 -- 172.21.15.5:0/1466559116 wait complete. 2024-08-31T05:29:57.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.708+0000 7f4e7e253640 1 Processor -- start 2024-08-31T05:29:57.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.708+0000 7f4e7e253640 1 -- start start 2024-08-31T05:29:57.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.708+0000 7f4e7e253640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e78101af0 0x7f4e7819c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:57.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.708+0000 7f4e7e253640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e781025c0 0x7f4e7819c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:57.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.708+0000 7f4e7e253640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e781043a0 0x7f4e781a1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:57.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.708+0000 7f4e7e253640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4e781159c0 con 0x7f4e781043a0 2024-08-31T05:29:57.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.708+0000 7f4e7e253640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4e78115840 con 0x7f4e781025c0 2024-08-31T05:29:57.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.708+0000 7f4e7e253640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4e78115b40 con 0x7f4e78101af0 2024-08-31T05:29:57.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.708+0000 7f4e77fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e781043a0 0x7f4e781a1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:57.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.708+0000 7f4e77fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e781043a0 0x7f4e781a1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33238/0 (socket says 172.21.15.5:33238) 2024-08-31T05:29:57.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.708+0000 7f4e77fff640 1 -- 172.21.15.5:0/4161926138 learned_addr learned my addr 172.21.15.5:0/4161926138 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:57.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.709+0000 7f4e76ffd640 1 --2- 172.21.15.5:0/4161926138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e781025c0 0x7f4e7819c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:57.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.709+0000 7f4e77fff640 1 -- 172.21.15.5:0/4161926138 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e78101af0 msgr2=0x7f4e7819c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:57.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.709+0000 7f4e777fe640 1 --2- 172.21.15.5:0/4161926138 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e78101af0 0x7f4e7819c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:57.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.709+0000 7f4e77fff640 1 --2- 172.21.15.5:0/4161926138 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e78101af0 0x7f4e7819c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:57.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.709+0000 7f4e77fff640 1 -- 172.21.15.5:0/4161926138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e781025c0 msgr2=0x7f4e7819c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:57.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.709+0000 7f4e77fff640 1 --2- 172.21.15.5:0/4161926138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e781025c0 0x7f4e7819c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:57.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.709+0000 7f4e77fff640 1 -- 172.21.15.5:0/4161926138 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e781a2330 con 0x7f4e781043a0 2024-08-31T05:29:57.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.709+0000 7f4e76ffd640 1 --2- 172.21.15.5:0/4161926138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e781025c0 0x7f4e7819c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:29:57.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.709+0000 7f4e777fe640 1 --2- 172.21.15.5:0/4161926138 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e78101af0 0x7f4e7819c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:29:57.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.709+0000 7f4e77fff640 1 --2- 172.21.15.5:0/4161926138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e781043a0 0x7f4e781a1c30 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f4e7000eb10 tx=0x7f4e7000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:57.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.709+0000 7f4e74ff9640 1 -- 172.21.15.5:0/4161926138 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e70004b20 con 0x7f4e781043a0 2024-08-31T05:29:57.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.709+0000 7f4e74ff9640 1 -- 172.21.15.5:0/4161926138 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e70004cc0 con 0x7f4e781043a0 2024-08-31T05:29:57.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.709+0000 7f4e7e253640 1 -- 172.21.15.5:0/4161926138 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e781a2620 con 0x7f4e781043a0 2024-08-31T05:29:57.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.709+0000 7f4e74ff9640 1 -- 172.21.15.5:0/4161926138 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e70010670 con 0x7f4e781043a0 2024-08-31T05:29:57.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.709+0000 7f4e7e253640 1 -- 172.21.15.5:0/4161926138 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e781a8db0 con 0x7f4e781043a0 2024-08-31T05:29:57.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.710+0000 7f4e7e253640 1 -- 172.21.15.5:0/4161926138 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e78101f00 con 0x7f4e781043a0 2024-08-31T05:29:57.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.712+0000 7f4e74ff9640 1 -- 172.21.15.5:0/4161926138 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) ==== 152593+0+0 (secure 0 0 0) 0x7f4e70005000 con 0x7f4e781043a0 2024-08-31T05:29:57.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.712+0000 7f4e74ff9640 1 --2- 172.21.15.5:0/4161926138 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4e600b4b80 0x7f4e600b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:57.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.712+0000 7f4e74ff9640 1 -- 172.21.15.5:0/4161926138 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f4e700e5eb0 con 0x7f4e781043a0 2024-08-31T05:29:57.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.713+0000 7f4e777fe640 1 --2- 172.21.15.5:0/4161926138 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4e600b4b80 0x7f4e600b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:57.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.713+0000 7f4e777fe640 1 --2- 172.21.15.5:0/4161926138 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4e600b4b80 0x7f4e600b7090 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4e68009b40 tx=0x7f4e68005e50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:57.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.716+0000 7f4e74ff9640 1 -- 172.21.15.5:0/4161926138 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4e70056130 con 0x7f4e781043a0 2024-08-31T05:29:57.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:57 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/409900259' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-08-31T05:29:57.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:57 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/409900259' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-08-31T05:29:57.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.936+0000 7f4e7e253640 1 -- 172.21.15.5:0/4161926138 --> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7f4e781010b0 con 0x7f4e600b4b80 2024-08-31T05:29:57.945 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:57 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/409900259' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-08-31T05:29:57.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.955+0000 7f4e74ff9640 1 -- 172.21.15.5:0/4161926138 <== mgr.14220 v2:172.21.15.5:6800/2696053609 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7f4e781010b0 con 0x7f4e600b4b80 2024-08-31T05:29:57.957 INFO:teuthology.orchestra.run.smithi005.stdout:{} 2024-08-31T05:29:57.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.957+0000 7f4e7e253640 1 -- 172.21.15.5:0/4161926138 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4e600b4b80 msgr2=0x7f4e600b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:57.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.957+0000 7f4e7e253640 1 --2- 172.21.15.5:0/4161926138 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4e600b4b80 0x7f4e600b7090 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4e68009b40 tx=0x7f4e68005e50 comp rx=0 tx=0).stop 2024-08-31T05:29:57.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.957+0000 7f4e7e253640 1 -- 172.21.15.5:0/4161926138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e781043a0 msgr2=0x7f4e781a1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:57.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.957+0000 7f4e7e253640 1 --2- 172.21.15.5:0/4161926138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e781043a0 0x7f4e781a1c30 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f4e7000eb10 tx=0x7f4e7000c2d0 comp rx=0 tx=0).stop 2024-08-31T05:29:57.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.957+0000 7f4e7e253640 1 -- 172.21.15.5:0/4161926138 shutdown_connections 2024-08-31T05:29:57.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.957+0000 7f4e7e253640 1 --2- 172.21.15.5:0/4161926138 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4e600b4b80 0x7f4e600b7090 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:57.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.957+0000 7f4e7e253640 1 --2- 172.21.15.5:0/4161926138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e781043a0 0x7f4e781a1c30 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:57.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.957+0000 7f4e7e253640 1 --2- 172.21.15.5:0/4161926138 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e781025c0 0x7f4e7819c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:57.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.957+0000 7f4e7e253640 1 --2- 172.21.15.5:0/4161926138 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e78101af0 0x7f4e7819c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:57.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.957+0000 7f4e7e253640 1 -- 172.21.15.5:0/4161926138 >> 172.21.15.5:0/4161926138 conn(0x7f4e78079a80 msgr2=0x7f4e781009a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:57.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.957+0000 7f4e7e253640 1 -- 172.21.15.5:0/4161926138 shutdown_connections 2024-08-31T05:29:57.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:57.957+0000 7f4e7e253640 1 -- 172.21.15.5:0/4161926138 wait complete. 2024-08-31T05:29:57.970 INFO:teuthology.run_tasks:Running task check-counter... 2024-08-31T05:29:57.980 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-08-31T05:29:57.993 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-31T05:29:58.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.103+0000 7f7ae2912640 1 -- 172.21.15.5:0/132607337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7adc102770 msgr2=0x7f7adc102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:58.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.103+0000 7f7ae2912640 1 --2- 172.21.15.5:0/132607337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7adc102770 0x7f7adc102b80 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f7acc009900 tx=0x7f7acc02a410 comp rx=0 tx=0).stop 2024-08-31T05:29:58.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.103+0000 7f7ae2912640 1 -- 172.21.15.5:0/132607337 shutdown_connections 2024-08-31T05:29:58.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.103+0000 7f7ae2912640 1 --2- 172.21.15.5:0/132607337 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7adc1089f0 0x7f7adc10f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:58.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.103+0000 7f7ae2912640 1 --2- 172.21.15.5:0/132607337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7adc1080a0 0x7f7adc1084b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:58.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.103+0000 7f7ae2912640 1 --2- 172.21.15.5:0/132607337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7adc102770 0x7f7adc102b80 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:58.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.103+0000 7f7ae2912640 1 -- 172.21.15.5:0/132607337 >> 172.21.15.5:0/132607337 conn(0x7f7adc0fe150 msgr2=0x7f7adc1005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:58.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.103+0000 7f7ae2912640 1 -- 172.21.15.5:0/132607337 shutdown_connections 2024-08-31T05:29:58.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.103+0000 7f7ae2912640 1 -- 172.21.15.5:0/132607337 wait complete. 2024-08-31T05:29:58.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.103+0000 7f7ae2912640 1 Processor -- start 2024-08-31T05:29:58.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.103+0000 7f7ae2912640 1 -- start start 2024-08-31T05:29:58.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.104+0000 7f7ae2912640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7adc102770 0x7f7adc19afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:58.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.104+0000 7f7ae2912640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7adc1080a0 0x7f7adc19b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:58.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.104+0000 7f7ae2912640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7adc1089f0 0x7f7adc19ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:58.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.104+0000 7f7ae2912640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7adc1126c0 con 0x7f7adc1080a0 2024-08-31T05:29:58.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.104+0000 7f7ae2912640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7adc112540 con 0x7f7adc1089f0 2024-08-31T05:29:58.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.104+0000 7f7ae2912640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7adc112840 con 0x7f7adc102770 2024-08-31T05:29:58.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.104+0000 7f7ad3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7adc1080a0 0x7f7adc19b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:58.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.104+0000 7f7ad3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7adc1080a0 0x7f7adc19b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33260/0 (socket says 172.21.15.5:33260) 2024-08-31T05:29:58.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.104+0000 7f7ad3fff640 1 -- 172.21.15.5:0/2336676341 learned_addr learned my addr 172.21.15.5:0/2336676341 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:58.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.104+0000 7f7adbfff640 1 --2- 172.21.15.5:0/2336676341 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7adc102770 0x7f7adc19afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:58.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.104+0000 7f7ad3fff640 1 -- 172.21.15.5:0/2336676341 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7adc102770 msgr2=0x7f7adc19afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:58.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.104+0000 7f7ad3fff640 1 --2- 172.21.15.5:0/2336676341 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7adc102770 0x7f7adc19afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:58.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.104+0000 7f7ad3fff640 1 -- 172.21.15.5:0/2336676341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7adc1089f0 msgr2=0x7f7adc19ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:58.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.104+0000 7f7ae0eaf640 1 --2- 172.21.15.5:0/2336676341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7adc1089f0 0x7f7adc19ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:58.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.104+0000 7f7ad3fff640 1 --2- 172.21.15.5:0/2336676341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7adc1089f0 0x7f7adc19ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:58.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.104+0000 7f7ad3fff640 1 -- 172.21.15.5:0/2336676341 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7adc1a6260 con 0x7f7adc1080a0 2024-08-31T05:29:58.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.104+0000 7f7adbfff640 1 --2- 172.21.15.5:0/2336676341 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7adc102770 0x7f7adc19afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:29:58.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.104+0000 7f7ae0eaf640 1 --2- 172.21.15.5:0/2336676341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7adc1089f0 0x7f7adc19ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:29:58.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.104+0000 7f7ad3fff640 1 --2- 172.21.15.5:0/2336676341 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7adc1080a0 0x7f7adc19b510 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f7ac400d950 tx=0x7f7ac400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:58.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.104+0000 7f7ad9ffb640 1 -- 172.21.15.5:0/2336676341 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac4017070 con 0x7f7adc1080a0 2024-08-31T05:29:58.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.104+0000 7f7ae2912640 1 -- 172.21.15.5:0/2336676341 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7adc1a6550 con 0x7f7adc1080a0 2024-08-31T05:29:58.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.104+0000 7f7ad9ffb640 1 -- 172.21.15.5:0/2336676341 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ac4009c30 con 0x7f7adc1080a0 2024-08-31T05:29:58.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.104+0000 7f7ad9ffb640 1 -- 172.21.15.5:0/2336676341 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac40047a0 con 0x7f7adc1080a0 2024-08-31T05:29:58.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.105+0000 7f7ae2912640 1 -- 172.21.15.5:0/2336676341 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7adc1a6aa0 con 0x7f7adc1080a0 2024-08-31T05:29:58.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.105+0000 7f7ae2912640 1 -- 172.21.15.5:0/2336676341 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7adc102b80 con 0x7f7adc1080a0 2024-08-31T05:29:58.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.108+0000 7f7ad9ffb640 1 -- 172.21.15.5:0/2336676341 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) ==== 152593+0+0 (secure 0 0 0) 0x7f7ac4004020 con 0x7f7adc1080a0 2024-08-31T05:29:58.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.109+0000 7f7ad9ffb640 1 --2- 172.21.15.5:0/2336676341 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f7ac80b4b80 0x7f7ac80b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:58.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.109+0000 7f7adbfff640 1 --2- 172.21.15.5:0/2336676341 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f7ac80b4b80 0x7f7ac80b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:58.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.109+0000 7f7ad9ffb640 1 -- 172.21.15.5:0/2336676341 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f7ac40e58b0 con 0x7f7adc1080a0 2024-08-31T05:29:58.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.109+0000 7f7adbfff640 1 --2- 172.21.15.5:0/2336676341 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f7ac80b4b80 0x7f7ac80b7090 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7acc000c00 tx=0x7f7acc031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:58.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.112+0000 7f7ad9ffb640 1 -- 172.21.15.5:0/2336676341 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7ac4020020 con 0x7f7adc1080a0 2024-08-31T05:29:58.217 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:29:57 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: 2024-08-31T05:29:57.942+0000 7f5d87c03640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T05:29:58.217 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:29:57 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: 2024-08-31T05:29:57.942+0000 7f5d87c03640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T05:29:58.217 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:29:57 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: 2024-08-31T05:29:57.942+0000 7f5d87c03640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T05:29:58.217 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:29:57 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: 2024-08-31T05:29:57.942+0000 7f5d87c03640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T05:29:58.217 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:29:57 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: 2024-08-31T05:29:57.942+0000 7f5d87c03640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T05:29:58.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.299+0000 7f7ae2912640 1 -- 172.21.15.5:0/2336676341 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7adc02e430 con 0x7f7adc1080a0 2024-08-31T05:29:58.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.301+0000 7f7ad9ffb640 1 -- 172.21.15.5:0/2336676341 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+25122 (secure 0 0 0) 0x7f7ac40ac4e0 con 0x7f7adc1080a0 2024-08-31T05:29:58.303 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:29:58.303 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":87,"fsid":"69422704-6758-11ef-bcd4-c7b262605968","created":"2024-08-31T05:19:04.860258+0000","modified":"2024-08-31T05:28:59.155542+0000","last_up_change":"2024-08-31T05:26:38.675914+0000","last_in_change":"2024-08-31T05:26:15.366713+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T05:22:49.802575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T05:27:27.835197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T05:27:30.058144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-31T05:27:36.272228+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c5745391-e9d7-4799-9db9-6b34bb91b7df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6803","nonce":2312496244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6805","nonce":2312496244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6809","nonce":2312496244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6807","nonce":2312496244}]},"public_addr":"172.21.15.5:6803/2312496244","cluster_addr":"172.21.15.5:6805/2312496244","heartbeat_back_addr":"172.21.15.5:6809/2312496244","heartbeat_front_addr":"172.21.15.5:6807/2312496244","state":["exists","up"]},{"osd":1,"uuid":"f1903bd7-b2c5-424e-a74e-795f729471db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6801","nonce":2777359361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6803","nonce":2777359361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6807","nonce":2777359361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6805","nonce":2777359361}]},"public_addr":"172.21.15.50:6801/2777359361","cluster_addr":"172.21.15.50:6803/2777359361","heartbeat_back_addr":"172.21.15.50:6807/2777359361","heartbeat_front_addr":"172.21.15.50:6805/2777359361","state":["exists","up"]},{"osd":2,"uuid":"134c5892-e44a-44f2-8cd2-484d22a45e2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6801","nonce":1400583716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6803","nonce":1400583716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6807","nonce":1400583716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6805","nonce":1400583716}]},"public_addr":"172.21.15.70:6801/1400583716","cluster_addr":"172.21.15.70:6803/1400583716","heartbeat_back_addr":"172.21.15.70:6807/1400583716","heartbeat_front_addr":"172.21.15.70:6805/1400583716","state":["exists","up"]},{"osd":3,"uuid":"af49398a-e171-496b-a50e-1f767fc42923","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6811","nonce":1647468379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6813","nonce":1647468379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6817","nonce":1647468379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6815","nonce":1647468379}]},"public_addr":"172.21.15.5:6811/1647468379","cluster_addr":"172.21.15.5:6813/1647468379","heartbeat_back_addr":"172.21.15.5:6817/1647468379","heartbeat_front_addr":"172.21.15.5:6815/1647468379","state":["exists","up"]},{"osd":4,"uuid":"59b847ef-6eb0-4c13-aa06-53a76d77ce45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6809","nonce":2314546877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6811","nonce":2314546877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6815","nonce":2314546877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6813","nonce":2314546877}]},"public_addr":"172.21.15.50:6809/2314546877","cluster_addr":"172.21.15.50:6811/2314546877","heartbeat_back_addr":"172.21.15.50:6815/2314546877","heartbeat_front_addr":"172.21.15.50:6813/2314546877","state":["exists","up"]},{"osd":5,"uuid":"b0dac185-4462-4760-aa36-0d221923b007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6809","nonce":311426299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6811","nonce":311426299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6815","nonce":311426299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6813","nonce":311426299}]},"public_addr":"172.21.15.70:6809/311426299","cluster_addr":"172.21.15.70:6811/311426299","heartbeat_back_addr":"172.21.15.70:6815/311426299","heartbeat_front_addr":"172.21.15.70:6813/311426299","state":["exists","up"]},{"osd":6,"uuid":"12486aa2-61e4-4bdf-94dd-ce5c4cd3df6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6819","nonce":1027645612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6821","nonce":1027645612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6825","nonce":1027645612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6823","nonce":1027645612}]},"public_addr":"172.21.15.5:6819/1027645612","cluster_addr":"172.21.15.5:6821/1027645612","heartbeat_back_addr":"172.21.15.5:6825/1027645612","heartbeat_front_addr":"172.21.15.5:6823/1027645612","state":["exists","up"]},{"osd":7,"uuid":"66f9dcf9-d5c3-4016-812f-d9496e9892d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6817","nonce":2718354517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6819","nonce":2718354517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6823","nonce":2718354517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6821","nonce":2718354517}]},"public_addr":"172.21.15.50:6817/2718354517","cluster_addr":"172.21.15.50:6819/2718354517","heartbeat_back_addr":"172.21.15.50:6823/2718354517","heartbeat_front_addr":"172.21.15.50:6821/2718354517","state":["exists","up"]},{"osd":8,"uuid":"584837f9-af4b-4189-a7e5-04156a94a805","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6817","nonce":3155722993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6819","nonce":3155722993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6823","nonce":3155722993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6821","nonce":3155722993}]},"public_addr":"172.21.15.70:6817/3155722993","cluster_addr":"172.21.15.70:6819/3155722993","heartbeat_back_addr":"172.21.15.70:6823/3155722993","heartbeat_front_addr":"172.21.15.70:6821/3155722993","state":["exists","up"]},{"osd":9,"uuid":"ef60de6e-3456-435c-bd48-ed2636cc0d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6827","nonce":2988145512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6829","nonce":2988145512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6833","nonce":2988145512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6831","nonce":2988145512}]},"public_addr":"172.21.15.5:6827/2988145512","cluster_addr":"172.21.15.5:6829/2988145512","heartbeat_back_addr":"172.21.15.5:6833/2988145512","heartbeat_front_addr":"172.21.15.5:6831/2988145512","state":["exists","up"]},{"osd":10,"uuid":"96c5de40-53df-412d-9501-8ce1711a76a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6825","nonce":4168871229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6827","nonce":4168871229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6831","nonce":4168871229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6829","nonce":4168871229}]},"public_addr":"172.21.15.50:6825/4168871229","cluster_addr":"172.21.15.50:6827/4168871229","heartbeat_back_addr":"172.21.15.50:6831/4168871229","heartbeat_front_addr":"172.21.15.50:6829/4168871229","state":["exists","up"]},{"osd":11,"uuid":"20beefe0-59c3-4392-9f61-8d215e9d2de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6825","nonce":2593470535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6827","nonce":2593470535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6831","nonce":2593470535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6829","nonce":2593470535}]},"public_addr":"172.21.15.70:6825/2593470535","cluster_addr":"172.21.15.70:6827/2593470535","heartbeat_back_addr":"172.21.15.70:6831/2593470535","heartbeat_front_addr":"172.21.15.70:6829/2593470535","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:21:56.748083+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:22:21.969492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:22:46.642917+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:23:11.630486+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:23:36.389322+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:24:01.431039+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:24:27.057017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:24:53.628200+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:25:19.356502+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:25:44.958024+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:26:10.804919+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:26:36.849133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":5,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:0/2473024253":"2024-09-01T05:20:57.333680+0000","172.21.15.5:0/2924148490":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/2163558485":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/2111919168":"2024-09-01T05:19:55.663503+0000","172.21.15.5:6801/3616278616":"2024-09-01T05:19:55.663503+0000","172.21.15.5:0/2436421090":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/1570244689":"2024-09-01T05:19:55.663503+0000","172.21.15.5:0/2700448223":"2024-09-01T05:20:57.333680+0000","172.21.15.5:6800/3616278616":"2024-09-01T05:19:55.663503+0000","172.21.15.5:6800/2898463711":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/2450461036":"2024-09-01T05:20:57.333680+0000","172.21.15.5:0/1947189952":"2024-09-01T05:19:55.663503+0000","172.21.15.5:6800/1439868821":"2024-09-01T05:20:57.333680+0000","172.21.15.5:6801/2898463711":"2024-09-01T05:19:31.728664+0000","172.21.15.5:6801/1439868821":"2024-09-01T05:20:57.333680+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T05:29:58.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.303+0000 7f7ae2912640 1 -- 172.21.15.5:0/2336676341 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f7ac80b4b80 msgr2=0x7f7ac80b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:58.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.303+0000 7f7ae2912640 1 --2- 172.21.15.5:0/2336676341 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f7ac80b4b80 0x7f7ac80b7090 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7acc000c00 tx=0x7f7acc031400 comp rx=0 tx=0).stop 2024-08-31T05:29:58.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.303+0000 7f7ae2912640 1 -- 172.21.15.5:0/2336676341 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7adc1080a0 msgr2=0x7f7adc19b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:58.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.303+0000 7f7ae2912640 1 --2- 172.21.15.5:0/2336676341 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7adc1080a0 0x7f7adc19b510 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f7ac400d950 tx=0x7f7ac400de10 comp rx=0 tx=0).stop 2024-08-31T05:29:58.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.303+0000 7f7ae2912640 1 -- 172.21.15.5:0/2336676341 shutdown_connections 2024-08-31T05:29:58.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.303+0000 7f7ae2912640 1 --2- 172.21.15.5:0/2336676341 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f7ac80b4b80 0x7f7ac80b7090 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:58.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.303+0000 7f7ae2912640 1 --2- 172.21.15.5:0/2336676341 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7adc1089f0 0x7f7adc19ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:58.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.303+0000 7f7ae2912640 1 --2- 172.21.15.5:0/2336676341 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7adc1080a0 0x7f7adc19b510 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:58.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.303+0000 7f7ae2912640 1 --2- 172.21.15.5:0/2336676341 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7adc102770 0x7f7adc19afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:58.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.303+0000 7f7ae2912640 1 -- 172.21.15.5:0/2336676341 >> 172.21.15.5:0/2336676341 conn(0x7f7adc0fe150 msgr2=0x7f7adc06a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:58.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.303+0000 7f7ae2912640 1 -- 172.21.15.5:0/2336676341 shutdown_connections 2024-08-31T05:29:58.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.303+0000 7f7ae2912640 1 -- 172.21.15.5:0/2336676341 wait complete. 2024-08-31T05:29:58.317 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-31T05:22:49.802575+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-31T05:27:27.835197+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-31T05:27:30.058144+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-08-31T05:27:36.272228+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-31T05:29:58.317 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-31T05:29:58.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.430+0000 7f18e5815640 1 -- 172.21.15.5:0/3802677982 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18e0108070 msgr2=0x7f18e0108480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:58.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.430+0000 7f18e5815640 1 --2- 172.21.15.5:0/3802677982 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18e0108070 0x7f18e0108480 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f18d4009900 tx=0x7f18d402a410 comp rx=0 tx=0).stop 2024-08-31T05:29:58.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.430+0000 7f18e5815640 1 -- 172.21.15.5:0/3802677982 shutdown_connections 2024-08-31T05:29:58.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.430+0000 7f18e5815640 1 --2- 172.21.15.5:0/3802677982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18e01089c0 0x7f18e010f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:58.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.430+0000 7f18e5815640 1 --2- 172.21.15.5:0/3802677982 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18e0108070 0x7f18e0108480 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:58.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.430+0000 7f18e5815640 1 --2- 172.21.15.5:0/3802677982 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18e0102740 0x7f18e0102b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:58.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.430+0000 7f18e5815640 1 -- 172.21.15.5:0/3802677982 >> 172.21.15.5:0/3802677982 conn(0x7f18e00fe120 msgr2=0x7f18e0100570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:58.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.430+0000 7f18e5815640 1 -- 172.21.15.5:0/3802677982 shutdown_connections 2024-08-31T05:29:58.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.430+0000 7f18e5815640 1 -- 172.21.15.5:0/3802677982 wait complete. 2024-08-31T05:29:58.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.430+0000 7f18e5815640 1 Processor -- start 2024-08-31T05:29:58.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.431+0000 7f18e5815640 1 -- start start 2024-08-31T05:29:58.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.431+0000 7f18e5815640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18e0102740 0x7f18e019b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:58.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.431+0000 7f18e5815640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18e0108070 0x7f18e019b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:58.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.431+0000 7f18e5815640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18e01089c0 0x7f18e019ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:58.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.431+0000 7f18e5815640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f18e0112650 con 0x7f18e0108070 2024-08-31T05:29:58.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.431+0000 7f18e5815640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f18e01124d0 con 0x7f18e0102740 2024-08-31T05:29:58.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.431+0000 7f18e5815640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f18e01127d0 con 0x7f18e01089c0 2024-08-31T05:29:58.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.431+0000 7f18de7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18e0108070 0x7f18e019b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:58.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.431+0000 7f18de7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18e0108070 0x7f18e019b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33280/0 (socket says 172.21.15.5:33280) 2024-08-31T05:29:58.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.431+0000 7f18de7fc640 1 -- 172.21.15.5:0/3521703204 learned_addr learned my addr 172.21.15.5:0/3521703204 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:58.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.431+0000 7f18deffd640 1 --2- 172.21.15.5:0/3521703204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18e0102740 0x7f18e019b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:58.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.431+0000 7f18df7fe640 1 --2- 172.21.15.5:0/3521703204 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18e01089c0 0x7f18e019ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:58.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.431+0000 7f18de7fc640 1 -- 172.21.15.5:0/3521703204 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18e01089c0 msgr2=0x7f18e019ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:58.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.431+0000 7f18de7fc640 1 --2- 172.21.15.5:0/3521703204 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18e01089c0 0x7f18e019ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:58.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.431+0000 7f18de7fc640 1 -- 172.21.15.5:0/3521703204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18e0102740 msgr2=0x7f18e019b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:58.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.431+0000 7f18de7fc640 1 --2- 172.21.15.5:0/3521703204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18e0102740 0x7f18e019b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:58.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.431+0000 7f18de7fc640 1 -- 172.21.15.5:0/3521703204 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18e01a6290 con 0x7f18e0108070 2024-08-31T05:29:58.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.431+0000 7f18df7fe640 1 --2- 172.21.15.5:0/3521703204 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18e01089c0 0x7f18e019ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:29:58.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.432+0000 7f18de7fc640 1 --2- 172.21.15.5:0/3521703204 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18e0108070 0x7f18e019b540 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f18d4006010 tx=0x7f18d4004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:58.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.432+0000 7f18e4813640 1 -- 172.21.15.5:0/3521703204 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d403f030 con 0x7f18e0108070 2024-08-31T05:29:58.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.432+0000 7f18e4813640 1 -- 172.21.15.5:0/3521703204 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18d4003aa0 con 0x7f18e0108070 2024-08-31T05:29:58.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.432+0000 7f18e4813640 1 -- 172.21.15.5:0/3521703204 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d4035070 con 0x7f18e0108070 2024-08-31T05:29:58.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.432+0000 7f18e5815640 1 -- 172.21.15.5:0/3521703204 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18e01a6520 con 0x7f18e0108070 2024-08-31T05:29:58.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.432+0000 7f18e5815640 1 -- 172.21.15.5:0/3521703204 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18e01a69c0 con 0x7f18e0108070 2024-08-31T05:29:58.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.433+0000 7f18e5815640 1 -- 172.21.15.5:0/3521703204 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18e0102b50 con 0x7f18e0108070 2024-08-31T05:29:58.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.434+0000 7f18e4813640 1 -- 172.21.15.5:0/3521703204 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) ==== 152593+0+0 (secure 0 0 0) 0x7f18d4042030 con 0x7f18e0108070 2024-08-31T05:29:58.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.435+0000 7f18e4813640 1 --2- 172.21.15.5:0/3521703204 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f18c80b4b80 0x7f18c80b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:58.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.435+0000 7f18deffd640 1 --2- 172.21.15.5:0/3521703204 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f18c80b4b80 0x7f18c80b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:58.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.435+0000 7f18e4813640 1 -- 172.21.15.5:0/3521703204 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f18d4105ff0 con 0x7f18e0108070 2024-08-31T05:29:58.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.436+0000 7f18deffd640 1 --2- 172.21.15.5:0/3521703204 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f18c80b4b80 0x7f18c80b7090 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f18e006c2d0 tx=0x7f18d0005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:58.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.438+0000 7f18e4813640 1 -- 172.21.15.5:0/3521703204 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f18d40ccc60 con 0x7f18e0108070 2024-08-31T05:29:58.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.624+0000 7f18e5815640 1 -- 172.21.15.5:0/3521703204 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f18e01a6dd0 con 0x7f18e0108070 2024-08-31T05:29:58.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.624+0000 7f18e4813640 1 -- 172.21.15.5:0/3521703204 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) ==== 93+0+10 (secure 0 0 0) 0x7f18d40d51a0 con 0x7f18e0108070 2024-08-31T05:29:58.626 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-08-31T05:29:58.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.626+0000 7f18e5815640 1 -- 172.21.15.5:0/3521703204 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f18c80b4b80 msgr2=0x7f18c80b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:58.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.626+0000 7f18e5815640 1 --2- 172.21.15.5:0/3521703204 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f18c80b4b80 0x7f18c80b7090 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f18e006c2d0 tx=0x7f18d0005f90 comp rx=0 tx=0).stop 2024-08-31T05:29:58.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.626+0000 7f18e5815640 1 -- 172.21.15.5:0/3521703204 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18e0108070 msgr2=0x7f18e019b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:58.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.626+0000 7f18e5815640 1 --2- 172.21.15.5:0/3521703204 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18e0108070 0x7f18e019b540 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f18d4006010 tx=0x7f18d4004060 comp rx=0 tx=0).stop 2024-08-31T05:29:58.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.626+0000 7f18e5815640 1 -- 172.21.15.5:0/3521703204 shutdown_connections 2024-08-31T05:29:58.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.626+0000 7f18e5815640 1 --2- 172.21.15.5:0/3521703204 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f18c80b4b80 0x7f18c80b7090 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:58.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.626+0000 7f18e5815640 1 --2- 172.21.15.5:0/3521703204 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18e01089c0 0x7f18e019ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:58.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.626+0000 7f18e5815640 1 --2- 172.21.15.5:0/3521703204 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18e0108070 0x7f18e019b540 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:58.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.626+0000 7f18e5815640 1 --2- 172.21.15.5:0/3521703204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f18e0102740 0x7f18e019b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:58.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.627+0000 7f18e5815640 1 -- 172.21.15.5:0/3521703204 >> 172.21.15.5:0/3521703204 conn(0x7f18e00fe120 msgr2=0x7f18e0106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:58.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.627+0000 7f18e5815640 1 -- 172.21.15.5:0/3521703204 shutdown_connections 2024-08-31T05:29:58.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.627+0000 7f18e5815640 1 -- 172.21.15.5:0/3521703204 wait complete. 2024-08-31T05:29:58.640 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-31T05:29:58.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.753+0000 7fd024086640 1 -- 172.21.15.5:0/3753102177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd01c108070 msgr2=0x7fd01c108480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:58.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.753+0000 7fd024086640 1 --2- 172.21.15.5:0/3753102177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd01c108070 0x7fd01c108480 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd00c009900 tx=0x7fd00c02a410 comp rx=0 tx=0).stop 2024-08-31T05:29:58.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.753+0000 7fd024086640 1 -- 172.21.15.5:0/3753102177 shutdown_connections 2024-08-31T05:29:58.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.753+0000 7fd024086640 1 --2- 172.21.15.5:0/3753102177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd01c1089c0 0x7fd01c10f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:58.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.753+0000 7fd024086640 1 --2- 172.21.15.5:0/3753102177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd01c108070 0x7fd01c108480 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:58.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.753+0000 7fd024086640 1 --2- 172.21.15.5:0/3753102177 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd01c102740 0x7fd01c102b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:58.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.753+0000 7fd024086640 1 -- 172.21.15.5:0/3753102177 >> 172.21.15.5:0/3753102177 conn(0x7fd01c0fe180 msgr2=0x7fd01c1005d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:58.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.753+0000 7fd024086640 1 -- 172.21.15.5:0/3753102177 shutdown_connections 2024-08-31T05:29:58.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.753+0000 7fd024086640 1 -- 172.21.15.5:0/3753102177 wait complete. 2024-08-31T05:29:58.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.754+0000 7fd024086640 1 Processor -- start 2024-08-31T05:29:58.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.754+0000 7fd024086640 1 -- start start 2024-08-31T05:29:58.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.754+0000 7fd024086640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd01c102740 0x7fd01c199090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:58.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.754+0000 7fd024086640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd01c108070 0x7fd01c199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:58.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.754+0000 7fd024086640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd01c1089c0 0x7fd01c19e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:58.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.754+0000 7fd024086640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd01c112630 con 0x7fd01c108070 2024-08-31T05:29:58.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.754+0000 7fd024086640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd01c1124b0 con 0x7fd01c1089c0 2024-08-31T05:29:58.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.754+0000 7fd024086640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd01c1127b0 con 0x7fd01c102740 2024-08-31T05:29:58.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.754+0000 7fd021621640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd01c108070 0x7fd01c199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:58.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.754+0000 7fd021621640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd01c108070 0x7fd01c199630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33306/0 (socket says 172.21.15.5:33306) 2024-08-31T05:29:58.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.754+0000 7fd021621640 1 -- 172.21.15.5:0/845525241 learned_addr learned my addr 172.21.15.5:0/845525241 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:58.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.754+0000 7fd022623640 1 --2- 172.21.15.5:0/845525241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd01c1089c0 0x7fd01c19e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:58.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.754+0000 7fd021e22640 1 --2- 172.21.15.5:0/845525241 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd01c102740 0x7fd01c199090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:58.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.754+0000 7fd021621640 1 -- 172.21.15.5:0/845525241 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd01c102740 msgr2=0x7fd01c199090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:58.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.754+0000 7fd021621640 1 --2- 172.21.15.5:0/845525241 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd01c102740 0x7fd01c199090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:58.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.754+0000 7fd021621640 1 -- 172.21.15.5:0/845525241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd01c1089c0 msgr2=0x7fd01c19e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:58.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.754+0000 7fd021621640 1 --2- 172.21.15.5:0/845525241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd01c1089c0 0x7fd01c19e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:58.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.754+0000 7fd021621640 1 -- 172.21.15.5:0/845525241 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd01c19efc0 con 0x7fd01c108070 2024-08-31T05:29:58.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.755+0000 7fd021621640 1 --2- 172.21.15.5:0/845525241 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd01c108070 0x7fd01c199630 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fd00c006010 tx=0x7fd00c004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:58.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.755+0000 7fd012ffd640 1 -- 172.21.15.5:0/845525241 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd00c03f030 con 0x7fd01c108070 2024-08-31T05:29:58.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.755+0000 7fd012ffd640 1 -- 172.21.15.5:0/845525241 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd00c003aa0 con 0x7fd01c108070 2024-08-31T05:29:58.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.755+0000 7fd024086640 1 -- 172.21.15.5:0/845525241 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd01c19f250 con 0x7fd01c108070 2024-08-31T05:29:58.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.755+0000 7fd012ffd640 1 -- 172.21.15.5:0/845525241 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd00c035070 con 0x7fd01c108070 2024-08-31T05:29:58.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.755+0000 7fd024086640 1 -- 172.21.15.5:0/845525241 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd01c1a5a40 con 0x7fd01c108070 2024-08-31T05:29:58.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.756+0000 7fd024086640 1 -- 172.21.15.5:0/845525241 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd01c1039b0 con 0x7fd01c108070 2024-08-31T05:29:58.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.758+0000 7fd012ffd640 1 -- 172.21.15.5:0/845525241 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) ==== 152593+0+0 (secure 0 0 0) 0x7fd00c042030 con 0x7fd01c108070 2024-08-31T05:29:58.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.759+0000 7fd012ffd640 1 --2- 172.21.15.5:0/845525241 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd0080b4b80 0x7fd0080b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:58.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.759+0000 7fd021e22640 1 --2- 172.21.15.5:0/845525241 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd0080b4b80 0x7fd0080b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:58.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.759+0000 7fd012ffd640 1 -- 172.21.15.5:0/845525241 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fd00c105fc0 con 0x7fd01c108070 2024-08-31T05:29:58.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.760+0000 7fd021e22640 1 --2- 172.21.15.5:0/845525241 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd0080b4b80 0x7fd0080b7090 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd018005fd0 tx=0x7fd018005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:58.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.762+0000 7fd012ffd640 1 -- 172.21.15.5:0/845525241 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd00c0ccc50 con 0x7fd01c108070 2024-08-31T05:29:58.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:58 smithi070 ceph-mon[22316]: pgmap v345: 129 pgs: 129 active+clean; 645 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-31T05:29:58.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:58 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/409900259' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-08-31T05:29:58.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:58 smithi070 ceph-mon[22316]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T05:29:58.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:58 smithi070 ceph-mon[22316]: from='client.15528 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:58.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:58 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/2336676341' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T05:29:58.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:58 smithi050 ceph-mon[22146]: pgmap v345: 129 pgs: 129 active+clean; 645 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-31T05:29:58.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:58 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/409900259' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-08-31T05:29:58.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:58 smithi050 ceph-mon[22146]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T05:29:58.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:58 smithi050 ceph-mon[22146]: from='client.15528 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:58.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:58 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/2336676341' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T05:29:58.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.949+0000 7fd024086640 1 -- 172.21.15.5:0/845525241 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd01c02e430 con 0x7fd01c108070 2024-08-31T05:29:58.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.949+0000 7fd012ffd640 1 -- 172.21.15.5:0/845525241 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) ==== 104+0+11 (secure 0 0 0) 0x7fd00c0d5190 con 0x7fd01c108070 2024-08-31T05:29:58.951 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-08-31T05:29:58.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.951+0000 7fd024086640 1 -- 172.21.15.5:0/845525241 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd0080b4b80 msgr2=0x7fd0080b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:58.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.951+0000 7fd024086640 1 --2- 172.21.15.5:0/845525241 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd0080b4b80 0x7fd0080b7090 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd018005fd0 tx=0x7fd018005850 comp rx=0 tx=0).stop 2024-08-31T05:29:58.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.951+0000 7fd024086640 1 -- 172.21.15.5:0/845525241 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd01c108070 msgr2=0x7fd01c199630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:58.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.951+0000 7fd024086640 1 --2- 172.21.15.5:0/845525241 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd01c108070 0x7fd01c199630 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fd00c006010 tx=0x7fd00c004060 comp rx=0 tx=0).stop 2024-08-31T05:29:58.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.951+0000 7fd024086640 1 -- 172.21.15.5:0/845525241 shutdown_connections 2024-08-31T05:29:58.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.951+0000 7fd024086640 1 --2- 172.21.15.5:0/845525241 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd0080b4b80 0x7fd0080b7090 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:58.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.951+0000 7fd024086640 1 --2- 172.21.15.5:0/845525241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd01c1089c0 0x7fd01c19e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:58.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.951+0000 7fd024086640 1 --2- 172.21.15.5:0/845525241 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd01c108070 0x7fd01c199630 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:58.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.951+0000 7fd024086640 1 --2- 172.21.15.5:0/845525241 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd01c102740 0x7fd01c199090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:58.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.951+0000 7fd024086640 1 -- 172.21.15.5:0/845525241 >> 172.21.15.5:0/845525241 conn(0x7fd01c0fe180 msgr2=0x7fd01c1005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:58.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.951+0000 7fd024086640 1 -- 172.21.15.5:0/845525241 shutdown_connections 2024-08-31T05:29:58.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:58.951+0000 7fd024086640 1 -- 172.21.15.5:0/845525241 wait complete. 2024-08-31T05:29:58.964 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:58 smithi005 ceph-mon[18602]: pgmap v345: 129 pgs: 129 active+clean; 645 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-31T05:29:58.964 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:58 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/409900259' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-08-31T05:29:58.964 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:58 smithi005 ceph-mon[18602]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T05:29:58.964 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:58 smithi005 ceph-mon[18602]: from='client.15528 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:29:58.964 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:58 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/2336676341' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T05:29:58.965 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-31T05:29:59.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.077+0000 7efff72e5640 1 -- 172.21.15.5:0/3127009293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efff0101cd0 msgr2=0x7efff01020e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:59.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.077+0000 7efff72e5640 1 --2- 172.21.15.5:0/3127009293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efff0101cd0 0x7efff01020e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7effe8009900 tx=0x7effe802a410 comp rx=0 tx=0).stop 2024-08-31T05:29:59.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.077+0000 7efff72e5640 1 -- 172.21.15.5:0/3127009293 shutdown_connections 2024-08-31T05:29:59.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.077+0000 7efff72e5640 1 --2- 172.21.15.5:0/3127009293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efff0109ac0 0x7efff01102f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:59.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.077+0000 7efff72e5640 1 --2- 172.21.15.5:0/3127009293 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efff0109170 0x7efff0109580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:59.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.077+0000 7efff72e5640 1 --2- 172.21.15.5:0/3127009293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efff0101cd0 0x7efff01020e0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:59.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.077+0000 7efff72e5640 1 -- 172.21.15.5:0/3127009293 >> 172.21.15.5:0/3127009293 conn(0x7efff0077880 msgr2=0x7efff0077cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:59.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.077+0000 7efff72e5640 1 -- 172.21.15.5:0/3127009293 shutdown_connections 2024-08-31T05:29:59.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.077+0000 7efff72e5640 1 -- 172.21.15.5:0/3127009293 wait complete. 2024-08-31T05:29:59.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.078+0000 7efff72e5640 1 Processor -- start 2024-08-31T05:29:59.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.078+0000 7efff72e5640 1 -- start start 2024-08-31T05:29:59.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.078+0000 7efff72e5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efff0101cd0 0x7efff019a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:59.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.078+0000 7efff72e5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efff0109170 0x7efff019a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:59.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.078+0000 7efff72e5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efff0109ac0 0x7efff019fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:59.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.078+0000 7efff72e5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7efff0113770 con 0x7efff0101cd0 2024-08-31T05:29:59.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.078+0000 7efff72e5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7efff01135f0 con 0x7efff0109170 2024-08-31T05:29:59.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.078+0000 7efff72e5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efff01138f0 con 0x7efff0109ac0 2024-08-31T05:29:59.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.078+0000 7efff5081640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efff0101cd0 0x7efff019a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:59.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.078+0000 7efff5081640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efff0101cd0 0x7efff019a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33332/0 (socket says 172.21.15.5:33332) 2024-08-31T05:29:59.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.078+0000 7efff5081640 1 -- 172.21.15.5:0/2265360766 learned_addr learned my addr 172.21.15.5:0/2265360766 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:59.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.078+0000 7efff5882640 1 --2- 172.21.15.5:0/2265360766 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efff0109ac0 0x7efff019fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:59.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.078+0000 7efff5081640 1 -- 172.21.15.5:0/2265360766 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efff0109ac0 msgr2=0x7efff019fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:59.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.078+0000 7efff5081640 1 --2- 172.21.15.5:0/2265360766 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efff0109ac0 0x7efff019fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:59.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.078+0000 7efff4880640 1 --2- 172.21.15.5:0/2265360766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efff0109170 0x7efff019a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:59.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.078+0000 7efff5081640 1 -- 172.21.15.5:0/2265360766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efff0109170 msgr2=0x7efff019a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:59.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.078+0000 7efff5081640 1 --2- 172.21.15.5:0/2265360766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efff0109170 0x7efff019a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:59.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.078+0000 7efff5081640 1 -- 172.21.15.5:0/2265360766 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efff01a0130 con 0x7efff0101cd0 2024-08-31T05:29:59.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.078+0000 7efff4880640 1 --2- 172.21.15.5:0/2265360766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efff0109170 0x7efff019a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:29:59.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.079+0000 7efff5081640 1 --2- 172.21.15.5:0/2265360766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efff0101cd0 0x7efff019a290 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7effe8005940 tx=0x7effe80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:59.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.079+0000 7effee7fc640 1 -- 172.21.15.5:0/2265360766 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe803f030 con 0x7efff0101cd0 2024-08-31T05:29:59.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.079+0000 7effee7fc640 1 -- 172.21.15.5:0/2265360766 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effe8003cb0 con 0x7efff0101cd0 2024-08-31T05:29:59.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.079+0000 7efff72e5640 1 -- 172.21.15.5:0/2265360766 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efff01a03c0 con 0x7efff0101cd0 2024-08-31T05:29:59.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.079+0000 7effee7fc640 1 -- 172.21.15.5:0/2265360766 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe8035070 con 0x7efff0101cd0 2024-08-31T05:29:59.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.079+0000 7efff72e5640 1 -- 172.21.15.5:0/2265360766 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efff01a08b0 con 0x7efff0101cd0 2024-08-31T05:29:59.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.080+0000 7efff72e5640 1 -- 172.21.15.5:0/2265360766 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efff006a390 con 0x7efff0101cd0 2024-08-31T05:29:59.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.082+0000 7effee7fc640 1 -- 172.21.15.5:0/2265360766 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) ==== 152593+0+0 (secure 0 0 0) 0x7effe8042030 con 0x7efff0101cd0 2024-08-31T05:29:59.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.082+0000 7effee7fc640 1 --2- 172.21.15.5:0/2265360766 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7effd80b4b80 0x7effd80b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:59.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.082+0000 7effee7fc640 1 -- 172.21.15.5:0/2265360766 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7effe8106210 con 0x7efff0101cd0 2024-08-31T05:29:59.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.082+0000 7efff4880640 1 --2- 172.21.15.5:0/2265360766 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7effd80b4b80 0x7effd80b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:59.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.083+0000 7efff4880640 1 --2- 172.21.15.5:0/2265360766 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7effd80b4b80 0x7effd80b7090 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7efff006b3b0 tx=0x7effe4005d90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:59.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.085+0000 7effee7fc640 1 -- 172.21.15.5:0/2265360766 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7effe80ccea0 con 0x7efff0101cd0 2024-08-31T05:29:59.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.274+0000 7efff72e5640 1 -- 172.21.15.5:0/2265360766 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7efff010b870 con 0x7efff0101cd0 2024-08-31T05:29:59.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.274+0000 7effee7fc640 1 -- 172.21.15.5:0/2265360766 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) ==== 100+0+11 (secure 0 0 0) 0x7effe80d53e0 con 0x7efff0101cd0 2024-08-31T05:29:59.276 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-08-31T05:29:59.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.276+0000 7efff72e5640 1 -- 172.21.15.5:0/2265360766 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7effd80b4b80 msgr2=0x7effd80b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:59.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.276+0000 7efff72e5640 1 --2- 172.21.15.5:0/2265360766 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7effd80b4b80 0x7effd80b7090 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7efff006b3b0 tx=0x7effe4005d90 comp rx=0 tx=0).stop 2024-08-31T05:29:59.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.276+0000 7efff72e5640 1 -- 172.21.15.5:0/2265360766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efff0101cd0 msgr2=0x7efff019a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:59.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.276+0000 7efff72e5640 1 --2- 172.21.15.5:0/2265360766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efff0101cd0 0x7efff019a290 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7effe8005940 tx=0x7effe80042f0 comp rx=0 tx=0).stop 2024-08-31T05:29:59.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.277+0000 7efff72e5640 1 -- 172.21.15.5:0/2265360766 shutdown_connections 2024-08-31T05:29:59.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.277+0000 7efff72e5640 1 --2- 172.21.15.5:0/2265360766 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7effd80b4b80 0x7effd80b7090 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:59.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.277+0000 7efff72e5640 1 --2- 172.21.15.5:0/2265360766 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efff0109ac0 0x7efff019fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:59.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.277+0000 7efff72e5640 1 --2- 172.21.15.5:0/2265360766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efff0109170 0x7efff019a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:59.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.277+0000 7efff72e5640 1 --2- 172.21.15.5:0/2265360766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efff0101cd0 0x7efff019a290 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:59.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.277+0000 7efff72e5640 1 -- 172.21.15.5:0/2265360766 >> 172.21.15.5:0/2265360766 conn(0x7efff0077880 msgr2=0x7efff0107310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:59.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.277+0000 7efff72e5640 1 -- 172.21.15.5:0/2265360766 shutdown_connections 2024-08-31T05:29:59.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.277+0000 7efff72e5640 1 -- 172.21.15.5:0/2265360766 wait complete. 2024-08-31T05:29:59.290 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-08-31T05:29:59.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.401+0000 7f5ce547f640 1 -- 172.21.15.5:0/3298002387 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ce0104ff0 msgr2=0x7f5ce010d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:59.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.401+0000 7f5ce547f640 1 --2- 172.21.15.5:0/3298002387 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ce0104ff0 0x7f5ce010d530 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f5cd4009900 tx=0x7f5cd402a410 comp rx=0 tx=0).stop 2024-08-31T05:29:59.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.401+0000 7f5ce547f640 1 -- 172.21.15.5:0/3298002387 shutdown_connections 2024-08-31T05:29:59.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.401+0000 7f5ce547f640 1 --2- 172.21.15.5:0/3298002387 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ce010db00 0x7f5ce010fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:59.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.401+0000 7f5ce547f640 1 --2- 172.21.15.5:0/3298002387 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ce0104ff0 0x7f5ce010d530 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:59.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.401+0000 7f5ce547f640 1 --2- 172.21.15.5:0/3298002387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ce01046a0 0x7f5ce0104ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:59.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.401+0000 7f5ce547f640 1 -- 172.21.15.5:0/3298002387 >> 172.21.15.5:0/3298002387 conn(0x7f5ce00fe130 msgr2=0x7f5ce0100580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:59.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.401+0000 7f5ce547f640 1 -- 172.21.15.5:0/3298002387 shutdown_connections 2024-08-31T05:29:59.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.402+0000 7f5ce547f640 1 -- 172.21.15.5:0/3298002387 wait complete. 2024-08-31T05:29:59.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.402+0000 7f5ce547f640 1 Processor -- start 2024-08-31T05:29:59.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.402+0000 7f5ce547f640 1 -- start start 2024-08-31T05:29:59.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.403+0000 7f5ce547f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ce01046a0 0x7f5ce019a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:59.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.403+0000 7f5ce547f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ce0104ff0 0x7f5ce019a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:59.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.403+0000 7f5ce547f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ce010db00 0x7f5ce019fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:59.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.403+0000 7f5ce547f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce0113750 con 0x7f5ce01046a0 2024-08-31T05:29:59.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.403+0000 7f5ce547f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce01135d0 con 0x7f5ce010db00 2024-08-31T05:29:59.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.403+0000 7f5ce547f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce01138d0 con 0x7f5ce0104ff0 2024-08-31T05:29:59.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.403+0000 7f5cdeffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ce01046a0 0x7f5ce019a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:59.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.403+0000 7f5cdeffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ce01046a0 0x7f5ce019a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33344/0 (socket says 172.21.15.5:33344) 2024-08-31T05:29:59.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.403+0000 7f5cdeffd640 1 -- 172.21.15.5:0/1223337346 learned_addr learned my addr 172.21.15.5:0/1223337346 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:29:59.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.403+0000 7f5cde7fc640 1 --2- 172.21.15.5:0/1223337346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ce0104ff0 0x7f5ce019a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:59.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.403+0000 7f5cdf7fe640 1 --2- 172.21.15.5:0/1223337346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ce010db00 0x7f5ce019fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:59.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.403+0000 7f5cdeffd640 1 -- 172.21.15.5:0/1223337346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ce0104ff0 msgr2=0x7f5ce019a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:59.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.403+0000 7f5cdeffd640 1 --2- 172.21.15.5:0/1223337346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ce0104ff0 0x7f5ce019a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:59.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.403+0000 7f5cdeffd640 1 -- 172.21.15.5:0/1223337346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ce010db00 msgr2=0x7f5ce019fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:59.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.403+0000 7f5cdeffd640 1 --2- 172.21.15.5:0/1223337346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ce010db00 0x7f5ce019fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:59.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.403+0000 7f5cdeffd640 1 -- 172.21.15.5:0/1223337346 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ce01a0100 con 0x7f5ce01046a0 2024-08-31T05:29:59.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.403+0000 7f5cdeffd640 1 --2- 172.21.15.5:0/1223337346 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ce01046a0 0x7f5ce019a1d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f5cd000d950 tx=0x7f5cd000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:59.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.403+0000 7f5cc7fff640 1 -- 172.21.15.5:0/1223337346 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cd0017070 con 0x7f5ce01046a0 2024-08-31T05:29:59.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.403+0000 7f5cc7fff640 1 -- 172.21.15.5:0/1223337346 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5cd0009c30 con 0x7f5ce01046a0 2024-08-31T05:29:59.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.403+0000 7f5ce547f640 1 -- 172.21.15.5:0/1223337346 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ce01a03f0 con 0x7f5ce01046a0 2024-08-31T05:29:59.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.403+0000 7f5cc7fff640 1 -- 172.21.15.5:0/1223337346 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cd000f620 con 0x7f5ce01046a0 2024-08-31T05:29:59.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.404+0000 7f5ce547f640 1 -- 172.21.15.5:0/1223337346 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ce01a6b80 con 0x7f5ce01046a0 2024-08-31T05:29:59.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.405+0000 7f5ce547f640 1 -- 172.21.15.5:0/1223337346 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ce0104ab0 con 0x7f5ce01046a0 2024-08-31T05:29:59.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.406+0000 7f5cc7fff640 1 -- 172.21.15.5:0/1223337346 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 22) ==== 152593+0+0 (secure 0 0 0) 0x7f5cd0010460 con 0x7f5ce01046a0 2024-08-31T05:29:59.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.407+0000 7f5cc7fff640 1 --2- 172.21.15.5:0/1223337346 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5cc80b4b80 0x7f5cc80b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:29:59.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.407+0000 7f5cde7fc640 1 --2- 172.21.15.5:0/1223337346 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5cc80b4b80 0x7f5cc80b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:29:59.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.407+0000 7f5cc7fff640 1 -- 172.21.15.5:0/1223337346 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f5cd00e5240 con 0x7f5ce01046a0 2024-08-31T05:29:59.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.407+0000 7f5cde7fc640 1 --2- 172.21.15.5:0/1223337346 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5cc80b4b80 0x7f5cc80b7090 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5cd4009230 tx=0x7f5cd4031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:29:59.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.411+0000 7f5cc7fff640 1 -- 172.21.15.5:0/1223337346 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5cd0009de0 con 0x7f5ce01046a0 2024-08-31T05:29:59.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.588+0000 7f5cc7fff640 1 -- 172.21.15.5:0/1223337346 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 23) ==== 152644+0+0 (secure 0 0 0) 0x7f5cd00a7ab0 con 0x7f5ce01046a0 2024-08-31T05:29:59.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.602+0000 7f5ce547f640 1 -- 172.21.15.5:0/1223337346 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f5ce01a6ef0 con 0x7f5ce01046a0 2024-08-31T05:29:59.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.602+0000 7f5cc7fff640 1 -- 172.21.15.5:0/1223337346 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v87) ==== 103+0+11 (secure 0 0 0) 0x7f5cd006a1f0 con 0x7f5ce01046a0 2024-08-31T05:29:59.604 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-08-31T05:29:59.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.604+0000 7f5ce547f640 1 -- 172.21.15.5:0/1223337346 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5cc80b4b80 msgr2=0x7f5cc80b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:59.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.604+0000 7f5ce547f640 1 --2- 172.21.15.5:0/1223337346 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5cc80b4b80 0x7f5cc80b7090 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5cd4009230 tx=0x7f5cd4031400 comp rx=0 tx=0).stop 2024-08-31T05:29:59.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.604+0000 7f5ce547f640 1 -- 172.21.15.5:0/1223337346 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ce01046a0 msgr2=0x7f5ce019a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:29:59.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.604+0000 7f5ce547f640 1 --2- 172.21.15.5:0/1223337346 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ce01046a0 0x7f5ce019a1d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f5cd000d950 tx=0x7f5cd000de10 comp rx=0 tx=0).stop 2024-08-31T05:29:59.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.604+0000 7f5ce547f640 1 -- 172.21.15.5:0/1223337346 shutdown_connections 2024-08-31T05:29:59.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.604+0000 7f5ce547f640 1 --2- 172.21.15.5:0/1223337346 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5cc80b4b80 0x7f5cc80b7090 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:59.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.604+0000 7f5ce547f640 1 --2- 172.21.15.5:0/1223337346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ce010db00 0x7f5ce019fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:59.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.604+0000 7f5ce547f640 1 --2- 172.21.15.5:0/1223337346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ce0104ff0 0x7f5ce019a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:59.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.605+0000 7f5ce547f640 1 --2- 172.21.15.5:0/1223337346 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ce01046a0 0x7f5ce019a1d0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:29:59.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.605+0000 7f5ce547f640 1 -- 172.21.15.5:0/1223337346 >> 172.21.15.5:0/1223337346 conn(0x7f5ce00fe130 msgr2=0x7f5ce0106500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:29:59.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.605+0000 7f5ce547f640 1 -- 172.21.15.5:0/1223337346 shutdown_connections 2024-08-31T05:29:59.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:29:59.605+0000 7f5ce547f640 1 -- 172.21.15.5:0/1223337346 wait complete. 2024-08-31T05:29:59.618 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-08-31T05:29:59.619 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T05:29:59.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:59 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/3521703204' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-31T05:29:59.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:59 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/845525241' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-31T05:29:59.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:29:59 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/2265360766' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-31T05:29:59.873 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:29:59.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:59 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/3521703204' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-31T05:29:59.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:59 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/845525241' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-31T05:29:59.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:29:59 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/2265360766' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-31T05:29:59.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:59 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/3521703204' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-31T05:29:59.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:59 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/845525241' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-31T05:29:59.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:29:59 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/2265360766' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-31T05:30:00.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:00.479+0000 7f84b9926640 1 -- 172.21.15.5:0/1884858319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84b4109b90 msgr2=0x7f84b41103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:00.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:00.479+0000 7f84b9926640 1 --2- 172.21.15.5:0/1884858319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84b4109b90 0x7f84b41103c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f84ac009ca0 tx=0x7f84ac02a8c0 comp rx=0 tx=0).stop 2024-08-31T05:30:00.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:00.479+0000 7f84b9926640 1 -- 172.21.15.5:0/1884858319 shutdown_connections 2024-08-31T05:30:00.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:00.479+0000 7f84b9926640 1 --2- 172.21.15.5:0/1884858319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84b4109b90 0x7f84b41103c0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:00.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:00.479+0000 7f84b9926640 1 --2- 172.21.15.5:0/1884858319 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84b4109240 0x7f84b4109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:00.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:00.479+0000 7f84b9926640 1 --2- 172.21.15.5:0/1884858319 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f84b4103900 0x7f84b4103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:00.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:00.479+0000 7f84b9926640 1 -- 172.21.15.5:0/1884858319 >> 172.21.15.5:0/1884858319 conn(0x7f84b407b5f0 msgr2=0x7f84b407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:00.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:00.479+0000 7f84b9926640 1 -- 172.21.15.5:0/1884858319 shutdown_connections 2024-08-31T05:30:00.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:00.479+0000 7f84b9926640 1 -- 172.21.15.5:0/1884858319 wait complete. 2024-08-31T05:30:00.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:00.479+0000 7f84b9926640 1 Processor -- start 2024-08-31T05:30:00.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:00.479+0000 7f84b9926640 1 -- start start 2024-08-31T05:30:00.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:00.480+0000 7f84b9926640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f84b4103900 0x7f84b419a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:00.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:00.480+0000 7f84b9926640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84b4109240 0x7f84b419a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:00.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:00.480+0000 7f84b9926640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84b4109b90 0x7f84b419fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:00.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:00.480+0000 7f84b9926640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f84b4113850 con 0x7f84b4109b90 2024-08-31T05:30:00.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:00.480+0000 7f84b9926640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f84b41136d0 con 0x7f84b4109240 2024-08-31T05:30:00.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:00.480+0000 7f84b9926640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f84b41139d0 con 0x7f84b4103900 2024-08-31T05:30:00.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:00.480+0000 7f84b37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84b4109b90 0x7f84b419fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:00.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:00.480+0000 7f84b37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84b4109b90 0x7f84b419fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33368/0 (socket says 172.21.15.5:33368) 2024-08-31T05:30:00.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:00.480+0000 7f84b37fe640 1 -- 172.21.15.5:0/1712842685 learned_addr learned my addr 172.21.15.5:0/1712842685 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:00.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:00.480+0000 7f84aa7fc640 1 --2- 172.21.15.5:0/1712842685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84b4109240 0x7f84b419a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:00.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:00.480+0000 7f84b2ffd640 1 --2- 172.21.15.5:0/1712842685 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f84b4103900 0x7f84b419a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:00.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:00.480+0000 7f84b37fe640 1 -- 172.21.15.5:0/1712842685 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f84b4103900 msgr2=0x7f84b419a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:00.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:00.480+0000 7f84b37fe640 1 --2- 172.21.15.5:0/1712842685 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f84b4103900 0x7f84b419a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:00.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:00.480+0000 7f84b37fe640 1 -- 172.21.15.5:0/1712842685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84b4109240 msgr2=0x7f84b419a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:00.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:00.480+0000 7f84b37fe640 1 --2- 172.21.15.5:0/1712842685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84b4109240 0x7f84b419a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:00.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:00.480+0000 7f84b37fe640 1 -- 172.21.15.5:0/1712842685 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84b41a0150 con 0x7f84b4109b90 2024-08-31T05:30:00.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:00.481+0000 7f84b37fe640 1 --2- 172.21.15.5:0/1712842685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84b4109b90 0x7f84b419fa20 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f84ac005cc0 tx=0x7f84ac02f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:00.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:00.481+0000 7f84b8924640 1 -- 172.21.15.5:0/1712842685 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84ac003bf0 con 0x7f84b4109b90 2024-08-31T05:30:00.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:00.481+0000 7f84b8924640 1 -- 172.21.15.5:0/1712842685 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84ac003d90 con 0x7f84b4109b90 2024-08-31T05:30:00.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:00.481+0000 7f84b9926640 1 -- 172.21.15.5:0/1712842685 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84b41a03e0 con 0x7f84b4109b90 2024-08-31T05:30:00.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:00.481+0000 7f84b8924640 1 -- 172.21.15.5:0/1712842685 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84ac02fbc0 con 0x7f84b4109b90 2024-08-31T05:30:00.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:00.481+0000 7f84b9926640 1 -- 172.21.15.5:0/1712842685 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84b41a6ba0 con 0x7f84b4109b90 2024-08-31T05:30:00.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:00.482+0000 7f84b9926640 1 -- 172.21.15.5:0/1712842685 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84b4103d10 con 0x7f84b4109b90 2024-08-31T05:30:00.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:00.483+0000 7f84b8924640 1 -- 172.21.15.5:0/1712842685 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 23) ==== 152644+0+0 (secure 0 0 0) 0x7f84ac02fd60 con 0x7f84b4109b90 2024-08-31T05:30:00.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:00.484+0000 7f84b8924640 1 --2- 172.21.15.5:0/1712842685 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f84a00b4c10 0x7f84a00b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:00.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:00.484+0000 7f84b8924640 1 -- 172.21.15.5:0/1712842685 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f84ac106d20 con 0x7f84b4109b90 2024-08-31T05:30:00.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:00.484+0000 7f84b2ffd640 1 --2- 172.21.15.5:0/1712842685 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f84a00b4c10 0x7f84a00b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:00.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:00.485+0000 7f84b2ffd640 1 --2- 172.21.15.5:0/1712842685 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f84a00b4c10 0x7f84a00b7120 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f84a4005fd0 tx=0x7f84a4005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:00.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:00.488+0000 7f84b8924640 1 -- 172.21.15.5:0/1712842685 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f84ac0cd850 con 0x7f84b4109b90 2024-08-31T05:30:00.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:00.710+0000 7f84b9926640 1 -- 172.21.15.5:0/1712842685 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f84b410b980 con 0x7f84b4109b90 2024-08-31T05:30:00.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:00.711+0000 7f84b8924640 1 -- 172.21.15.5:0/1712842685 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11941 (secure 0 0 0) 0x7f84ac0cd150 con 0x7f84b4109b90 2024-08-31T05:30:00.713 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:30:00.713 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":30,"btime":"2024-08-31T05:29:57:563015+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14739,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2024812199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2024812199},{"type":"v1","addr":"172.21.15.5:6835","nonce":2024812199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3629023702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3629023702},{"type":"v1","addr":"172.21.15.5:6837","nonce":3629023702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T05:27:31.929153+0000","modified":"2024-08-31T05:29:56.645530+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24652,"mds_1":24638,"mds_2":24631,"mds_3":24625,"mds_4":24602},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6839/2412701258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":2412701258},{"type":"v1","addr":"172.21.15.5:6839","nonce":2412701258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14820":{"gid":14820,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6841/747057838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":747057838},{"type":"v1","addr":"172.21.15.5:6841","nonce":747057838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6833/1153378982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1153378982},{"type":"v1","addr":"172.21.15.50:6833","nonce":1153378982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6833/364083443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":364083443},{"type":"v1","addr":"172.21.15.70:6833","nonce":364083443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24587":{"gid":24587,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/2346896794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2346896794},{"type":"v1","addr":"172.21.15.50:6835","nonce":2346896794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24602":{"gid":24602,"name":"h","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.50:6837/428759669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":428759669},{"type":"v1","addr":"172.21.15.50:6837","nonce":428759669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.70:6835/2061504114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2061504114},{"type":"v1","addr":"172.21.15.70:6835","nonce":2061504114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.70:6837/2780036414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2780036414},{"type":"v1","addr":"172.21.15.70:6837","nonce":2780036414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.50:6839/98200944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":98200944},{"type":"v1","addr":"172.21.15.50:6839","nonce":98200944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24652":{"gid":24652,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.70:6839/2756569250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":2756569250},{"type":"v1","addr":"172.21.15.70:6839","nonce":2756569250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24652,"qdb_cluster":[24652,24631,24638,24625,24602]},"id":1}]} 2024-08-31T05:30:00.713 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 30 2024-08-31T05:30:00.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:00.713+0000 7f84b9926640 1 -- 172.21.15.5:0/1712842685 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f84a00b4c10 msgr2=0x7f84a00b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:00.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:00.713+0000 7f84b9926640 1 --2- 172.21.15.5:0/1712842685 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f84a00b4c10 0x7f84a00b7120 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f84a4005fd0 tx=0x7f84a4005850 comp rx=0 tx=0).stop 2024-08-31T05:30:00.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:00.713+0000 7f84b9926640 1 -- 172.21.15.5:0/1712842685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84b4109b90 msgr2=0x7f84b419fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:00.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:00.713+0000 7f84b9926640 1 --2- 172.21.15.5:0/1712842685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84b4109b90 0x7f84b419fa20 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f84ac005cc0 tx=0x7f84ac02f380 comp rx=0 tx=0).stop 2024-08-31T05:30:00.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:00.713+0000 7f84b9926640 1 -- 172.21.15.5:0/1712842685 shutdown_connections 2024-08-31T05:30:00.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:00.713+0000 7f84b9926640 1 --2- 172.21.15.5:0/1712842685 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f84a00b4c10 0x7f84a00b7120 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:00.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:00.713+0000 7f84b9926640 1 --2- 172.21.15.5:0/1712842685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84b4109b90 0x7f84b419fa20 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:00.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:00.714+0000 7f84b9926640 1 --2- 172.21.15.5:0/1712842685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84b4109240 0x7f84b419a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:00.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:00.714+0000 7f84b9926640 1 --2- 172.21.15.5:0/1712842685 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f84b4103900 0x7f84b419a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:00.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:00.714+0000 7f84b9926640 1 -- 172.21.15.5:0/1712842685 >> 172.21.15.5:0/1712842685 conn(0x7f84b407b5f0 msgr2=0x7f84b4107250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:00.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:00.714+0000 7f84b9926640 1 -- 172.21.15.5:0/1712842685 shutdown_connections 2024-08-31T05:30:00.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:00.714+0000 7f84b9926640 1 -- 172.21.15.5:0/1712842685 wait complete. 2024-08-31T05:30:00.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:00 smithi070 ceph-mon[22316]: pgmap v346: 129 pgs: 129 active+clean; 652 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-08-31T05:30:00.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:00 smithi070 ceph-mon[22316]: mgrmap e23: x(active, since 9m), standbys: z, y 2024-08-31T05:30:00.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:00 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/1223337346' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-08-31T05:30:00.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:00 smithi070 ceph-mon[22316]: overall HEALTH_OK 2024-08-31T05:30:00.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:00 smithi050 ceph-mon[22146]: pgmap v346: 129 pgs: 129 active+clean; 652 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-08-31T05:30:00.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:00 smithi050 ceph-mon[22146]: mgrmap e23: x(active, since 9m), standbys: z, y 2024-08-31T05:30:00.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:00 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/1223337346' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-08-31T05:30:00.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:00 smithi050 ceph-mon[22146]: overall HEALTH_OK 2024-08-31T05:30:00.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:00 smithi005 ceph-mon[18602]: pgmap v346: 129 pgs: 129 active+clean; 652 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-08-31T05:30:00.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:00 smithi005 ceph-mon[18602]: mgrmap e23: x(active, since 9m), standbys: z, y 2024-08-31T05:30:00.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:00 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/1223337346' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-08-31T05:30:00.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:00 smithi005 ceph-mon[18602]: overall HEALTH_OK 2024-08-31T05:30:01.406 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-08-31T05:30:01.406 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-08-31T05:30:01.406 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-31T05:30:01.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.518+0000 7f606ec7e640 1 -- 172.21.15.5:0/432496882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6068109af0 msgr2=0x7f6068110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:01.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.518+0000 7f606ec7e640 1 --2- 172.21.15.5:0/432496882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6068109af0 0x7f6068110320 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f6060009ca0 tx=0x7f606002a8c0 comp rx=0 tx=0).stop 2024-08-31T05:30:01.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.518+0000 7f606ec7e640 1 -- 172.21.15.5:0/432496882 shutdown_connections 2024-08-31T05:30:01.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.518+0000 7f606ec7e640 1 --2- 172.21.15.5:0/432496882 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6068109af0 0x7f6068110320 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:01.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.518+0000 7f606ec7e640 1 --2- 172.21.15.5:0/432496882 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f60681091a0 0x7f60681095b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:01.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.518+0000 7f606ec7e640 1 --2- 172.21.15.5:0/432496882 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6068103870 0x7f6068103c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:01.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.518+0000 7f606ec7e640 1 -- 172.21.15.5:0/432496882 >> 172.21.15.5:0/432496882 conn(0x7f60680ff2b0 msgr2=0x7f6068101700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:01.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.518+0000 7f606ec7e640 1 -- 172.21.15.5:0/432496882 shutdown_connections 2024-08-31T05:30:01.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.518+0000 7f606ec7e640 1 -- 172.21.15.5:0/432496882 wait complete. 2024-08-31T05:30:01.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.518+0000 7f606ec7e640 1 Processor -- start 2024-08-31T05:30:01.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.519+0000 7f606ec7e640 1 -- start start 2024-08-31T05:30:01.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.519+0000 7f606ec7e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6068103870 0x7f606819a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:01.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.519+0000 7f606ec7e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60681091a0 0x7f606819a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:01.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.519+0000 7f606ec7e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6068109af0 0x7f606819f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:01.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.519+0000 7f606ec7e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f60681137c0 con 0x7f60681091a0 2024-08-31T05:30:01.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.519+0000 7f606ec7e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6068113640 con 0x7f6068103870 2024-08-31T05:30:01.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.519+0000 7f606ec7e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6068113940 con 0x7f6068109af0 2024-08-31T05:30:01.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.519+0000 7f6067fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60681091a0 0x7f606819a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:01.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.519+0000 7f6067fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60681091a0 0x7f606819a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33394/0 (socket says 172.21.15.5:33394) 2024-08-31T05:30:01.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.519+0000 7f6067fff640 1 -- 172.21.15.5:0/2252899507 learned_addr learned my addr 172.21.15.5:0/2252899507 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:01.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.519+0000 7f606ca1a640 1 --2- 172.21.15.5:0/2252899507 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6068103870 0x7f606819a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:01.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.519+0000 7f606d21b640 1 --2- 172.21.15.5:0/2252899507 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6068109af0 0x7f606819f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:01.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.519+0000 7f6067fff640 1 -- 172.21.15.5:0/2252899507 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6068109af0 msgr2=0x7f606819f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:01.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.519+0000 7f6067fff640 1 --2- 172.21.15.5:0/2252899507 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6068109af0 0x7f606819f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:01.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.519+0000 7f6067fff640 1 -- 172.21.15.5:0/2252899507 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6068103870 msgr2=0x7f606819a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:01.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.519+0000 7f6067fff640 1 --2- 172.21.15.5:0/2252899507 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6068103870 0x7f606819a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:01.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.519+0000 7f6067fff640 1 -- 172.21.15.5:0/2252899507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60681a00d0 con 0x7f60681091a0 2024-08-31T05:30:01.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.519+0000 7f6067fff640 1 --2- 172.21.15.5:0/2252899507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60681091a0 0x7f606819a740 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f605400d750 tx=0x7f605400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:01.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.520+0000 7f6065ffb640 1 -- 172.21.15.5:0/2252899507 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6054017070 con 0x7f60681091a0 2024-08-31T05:30:01.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.520+0000 7f606ec7e640 1 -- 172.21.15.5:0/2252899507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60681a03c0 con 0x7f60681091a0 2024-08-31T05:30:01.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.520+0000 7f6065ffb640 1 -- 172.21.15.5:0/2252899507 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60540054d0 con 0x7f60681091a0 2024-08-31T05:30:01.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.520+0000 7f6065ffb640 1 -- 172.21.15.5:0/2252899507 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6054004c30 con 0x7f60681091a0 2024-08-31T05:30:01.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.520+0000 7f606ec7e640 1 -- 172.21.15.5:0/2252899507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60681a6b50 con 0x7f60681091a0 2024-08-31T05:30:01.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.521+0000 7f606ec7e640 1 -- 172.21.15.5:0/2252899507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6068103c80 con 0x7f60681091a0 2024-08-31T05:30:01.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.522+0000 7f6065ffb640 1 -- 172.21.15.5:0/2252899507 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 23) ==== 152644+0+0 (secure 0 0 0) 0x7f6054004dd0 con 0x7f60681091a0 2024-08-31T05:30:01.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.523+0000 7f6065ffb640 1 --2- 172.21.15.5:0/2252899507 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f60580b4c10 0x7f60580b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:01.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.523+0000 7f6065ffb640 1 -- 172.21.15.5:0/2252899507 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f60540e5170 con 0x7f60681091a0 2024-08-31T05:30:01.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.523+0000 7f606ca1a640 1 --2- 172.21.15.5:0/2252899507 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f60580b4c10 0x7f60580b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:01.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.524+0000 7f606ca1a640 1 --2- 172.21.15.5:0/2252899507 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f60580b4c10 0x7f60580b7120 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f605c005d00 tx=0x7f605c00b410 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:01.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.527+0000 7f6065ffb640 1 -- 172.21.15.5:0/2252899507 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f60540ab5f0 con 0x7f60681091a0 2024-08-31T05:30:01.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.710+0000 7f606ec7e640 1 -- 172.21.15.5:0/2252899507 --> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f60680635a0 con 0x7f60580b4c10 2024-08-31T05:30:01.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:01 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/1712842685' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:30:01.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.716+0000 7f6065ffb640 1 -- 172.21.15.5:0/2252899507 <== mgr.14220 v2:172.21.15.5:6800/2696053609 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340795 (secure 0 0 0) 0x7f60680635a0 con 0x7f60580b4c10 2024-08-31T05:30:01.722 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:30:01.724 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-31T05:30:01.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.719+0000 7f606ec7e640 1 -- 172.21.15.5:0/2252899507 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f60580b4c10 msgr2=0x7f60580b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:01.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.719+0000 7f606ec7e640 1 --2- 172.21.15.5:0/2252899507 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f60580b4c10 0x7f60580b7120 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f605c005d00 tx=0x7f605c00b410 comp rx=0 tx=0).stop 2024-08-31T05:30:01.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.719+0000 7f606ec7e640 1 -- 172.21.15.5:0/2252899507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60681091a0 msgr2=0x7f606819a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:01.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.719+0000 7f606ec7e640 1 --2- 172.21.15.5:0/2252899507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60681091a0 0x7f606819a740 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f605400d750 tx=0x7f605400dc10 comp rx=0 tx=0).stop 2024-08-31T05:30:01.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.720+0000 7f606ec7e640 1 -- 172.21.15.5:0/2252899507 shutdown_connections 2024-08-31T05:30:01.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.720+0000 7f606ec7e640 1 --2- 172.21.15.5:0/2252899507 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f60580b4c10 0x7f60580b7120 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:01.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.720+0000 7f606ec7e640 1 --2- 172.21.15.5:0/2252899507 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6068109af0 0x7f606819f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:01.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.720+0000 7f606ec7e640 1 --2- 172.21.15.5:0/2252899507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f60681091a0 0x7f606819a740 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:01.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.720+0000 7f606ec7e640 1 --2- 172.21.15.5:0/2252899507 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6068103870 0x7f606819a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:01.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.720+0000 7f606ec7e640 1 -- 172.21.15.5:0/2252899507 >> 172.21.15.5:0/2252899507 conn(0x7f60680ff2b0 msgr2=0x7f60681016d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:01.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.720+0000 7f606ec7e640 1 -- 172.21.15.5:0/2252899507 shutdown_connections 2024-08-31T05:30:01.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.720+0000 7f606ec7e640 1 -- 172.21.15.5:0/2252899507 wait complete. 2024-08-31T05:30:01.733 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":347,"stamp":"2024-08-31T05:30:01.480396+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":667180,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1193,"num_read_kb":708,"num_write":395,"num_write_kb":2316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":2952422,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":826,"ondisk_log_size":826,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":402736,"kb_used_data":11888,"kb_used_omap":18,"kb_used_meta":390637,"kb_avail":1124539088,"statfs":{"total":1151940427776,"available":1151528026112,"internally_reserved":0,"allocated":12173312,"data_stored":8083519,"data_compressed":462027,"data_compressed_allocated":626688,"data_compressed_original":2752512,"omap_allocated":19141,"internal_metadata":400012603},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6771,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":59,"num_write":12,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003981"},"pg_stats":[{"pgid":"2.1f","version":"87'14","reported_seq":173,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:55.736631+0000","last_change":"2024-08-31T05:27:58.511927+0000","last_active":"2024-08-31T05:29:55.736631+0000","last_peered":"2024-08-31T05:29:55.736631+0000","last_clean":"2024-08-31T05:29:55.736631+0000","last_became_active":"2024-08-31T05:27:58.507111+0000","last_became_peered":"2024-08-31T05:27:58.507111+0000","last_unstale":"2024-08-31T05:29:55.736631+0000","last_undegraded":"2024-08-31T05:29:55.736631+0000","last_fullsized":"2024-08-31T05:29:55.736631+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:42:09.078048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"87'5","reported_seq":40,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.844363+0000","last_change":"2024-08-31T05:27:31.255221+0000","last_active":"2024-08-31T05:29:27.844363+0000","last_peered":"2024-08-31T05:29:27.844363+0000","last_clean":"2024-08-31T05:29:27.844363+0000","last_became_active":"2024-08-31T05:27:31.254684+0000","last_became_peered":"2024-08-31T05:27:31.254684+0000","last_unstale":"2024-08-31T05:29:27.844363+0000","last_undegraded":"2024-08-31T05:29:27.844363+0000","last_fullsized":"2024-08-31T05:29:27.844363+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:34:22.517485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.661502+0000","last_change":"2024-08-31T05:27:38.293857+0000","last_active":"2024-08-31T05:28:59.661502+0000","last_peered":"2024-08-31T05:28:59.661502+0000","last_clean":"2024-08-31T05:28:59.661502+0000","last_became_active":"2024-08-31T05:27:38.292763+0000","last_became_peered":"2024-08-31T05:27:38.292763+0000","last_unstale":"2024-08-31T05:28:59.661502+0000","last_undegraded":"2024-08-31T05:28:59.661502+0000","last_fullsized":"2024-08-31T05:28:59.661502+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:53:27.187697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.159933+0000","last_change":"2024-08-31T05:27:29.281010+0000","last_active":"2024-08-31T05:28:59.159933+0000","last_peered":"2024-08-31T05:28:59.159933+0000","last_clean":"2024-08-31T05:28:59.159933+0000","last_became_active":"2024-08-31T05:27:29.280625+0000","last_became_peered":"2024-08-31T05:27:29.280625+0000","last_unstale":"2024-08-31T05:28:59.159933+0000","last_undegraded":"2024-08-31T05:28:59.159933+0000","last_fullsized":"2024-08-31T05:28:59.159933+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:09:25.542564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"87'6","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.849664+0000","last_change":"2024-08-31T05:27:31.258052+0000","last_active":"2024-08-31T05:29:27.849664+0000","last_peered":"2024-08-31T05:29:27.849664+0000","last_clean":"2024-08-31T05:29:27.849664+0000","last_became_active":"2024-08-31T05:27:31.257549+0000","last_became_peered":"2024-08-31T05:27:31.257549+0000","last_unstale":"2024-08-31T05:29:27.849664+0000","last_undegraded":"2024-08-31T05:29:27.849664+0000","last_fullsized":"2024-08-31T05:29:27.849664+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:14:21.552372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.160234+0000","last_change":"2024-08-31T05:27:38.300359+0000","last_active":"2024-08-31T05:28:59.160234+0000","last_peered":"2024-08-31T05:28:59.160234+0000","last_clean":"2024-08-31T05:28:59.160234+0000","last_became_active":"2024-08-31T05:27:38.299704+0000","last_became_peered":"2024-08-31T05:27:38.299704+0000","last_unstale":"2024-08-31T05:28:59.160234+0000","last_undegraded":"2024-08-31T05:28:59.160234+0000","last_fullsized":"2024-08-31T05:28:59.160234+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:06:50.500384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"85'12","reported_seq":53,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.165905+0000","last_change":"2024-08-31T05:27:29.240652+0000","last_active":"2024-08-31T05:28:59.165905+0000","last_peered":"2024-08-31T05:28:59.165905+0000","last_clean":"2024-08-31T05:28:59.165905+0000","last_became_active":"2024-08-31T05:27:29.239432+0000","last_became_peered":"2024-08-31T05:27:29.239432+0000","last_unstale":"2024-08-31T05:28:59.165905+0000","last_undegraded":"2024-08-31T05:28:59.165905+0000","last_fullsized":"2024-08-31T05:28:59.165905+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:49:56.506299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"87'9","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.849658+0000","last_change":"2024-08-31T05:27:31.261784+0000","last_active":"2024-08-31T05:29:27.849658+0000","last_peered":"2024-08-31T05:29:27.849658+0000","last_clean":"2024-08-31T05:29:27.849658+0000","last_became_active":"2024-08-31T05:27:31.260045+0000","last_became_peered":"2024-08-31T05:27:31.260045+0000","last_unstale":"2024-08-31T05:29:27.849658+0000","last_undegraded":"2024-08-31T05:29:27.849658+0000","last_fullsized":"2024-08-31T05:29:27.849658+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:18:30.044052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.661334+0000","last_change":"2024-08-31T05:28:59.661205+0000","last_active":"2024-08-31T05:28:59.661334+0000","last_peered":"2024-08-31T05:28:59.661334+0000","last_clean":"2024-08-31T05:28:59.661334+0000","last_became_active":"2024-08-31T05:28:59.660637+0000","last_became_peered":"2024-08-31T05:28:59.660637+0000","last_unstale":"2024-08-31T05:28:59.661334+0000","last_undegraded":"2024-08-31T05:28:59.661334+0000","last_fullsized":"2024-08-31T05:28:59.661334+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:18:21.507475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,10],"acting":[4,3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"85'5","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.165866+0000","last_change":"2024-08-31T05:27:29.240341+0000","last_active":"2024-08-31T05:28:59.165866+0000","last_peered":"2024-08-31T05:28:59.165866+0000","last_clean":"2024-08-31T05:28:59.165866+0000","last_became_active":"2024-08-31T05:27:29.239944+0000","last_became_peered":"2024-08-31T05:27:29.239944+0000","last_unstale":"2024-08-31T05:28:59.165866+0000","last_undegraded":"2024-08-31T05:28:59.165866+0000","last_fullsized":"2024-08-31T05:28:59.165866+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:58:19.747559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"87'15","reported_seq":49,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.851465+0000","last_change":"2024-08-31T05:27:31.265116+0000","last_active":"2024-08-31T05:29:27.851465+0000","last_peered":"2024-08-31T05:29:27.851465+0000","last_clean":"2024-08-31T05:29:27.851465+0000","last_became_active":"2024-08-31T05:27:31.264725+0000","last_became_peered":"2024-08-31T05:27:31.264725+0000","last_unstale":"2024-08-31T05:29:27.851465+0000","last_undegraded":"2024-08-31T05:29:27.851465+0000","last_fullsized":"2024-08-31T05:29:27.851465+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:44:45.831881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.160399+0000","last_change":"2024-08-31T05:27:38.298634+0000","last_active":"2024-08-31T05:28:59.160399+0000","last_peered":"2024-08-31T05:28:59.160399+0000","last_clean":"2024-08-31T05:28:59.160399+0000","last_became_active":"2024-08-31T05:27:38.298143+0000","last_became_peered":"2024-08-31T05:27:38.298143+0000","last_unstale":"2024-08-31T05:28:59.160399+0000","last_undegraded":"2024-08-31T05:28:59.160399+0000","last_fullsized":"2024-08-31T05:28:59.160399+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:51:25.639441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"87'5","reported_seq":40,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.851171+0000","last_change":"2024-08-31T05:27:31.259981+0000","last_active":"2024-08-31T05:29:27.851171+0000","last_peered":"2024-08-31T05:29:27.851171+0000","last_clean":"2024-08-31T05:29:27.851171+0000","last_became_active":"2024-08-31T05:27:31.259584+0000","last_became_peered":"2024-08-31T05:27:31.259584+0000","last_unstale":"2024-08-31T05:29:27.851171+0000","last_undegraded":"2024-08-31T05:29:27.851171+0000","last_fullsized":"2024-08-31T05:29:27.851171+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:52:29.853977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.481776+0000","last_change":"2024-08-31T05:27:58.514065+0000","last_active":"2024-08-31T05:28:59.481776+0000","last_peered":"2024-08-31T05:28:59.481776+0000","last_clean":"2024-08-31T05:28:59.481776+0000","last_became_active":"2024-08-31T05:27:58.506011+0000","last_became_peered":"2024-08-31T05:27:58.506011+0000","last_unstale":"2024-08-31T05:28:59.481776+0000","last_undegraded":"2024-08-31T05:28:59.481776+0000","last_fullsized":"2024-08-31T05:28:59.481776+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:25:55.610965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.160810+0000","last_change":"2024-08-31T05:27:38.293265+0000","last_active":"2024-08-31T05:28:59.160810+0000","last_peered":"2024-08-31T05:28:59.160810+0000","last_clean":"2024-08-31T05:28:59.160810+0000","last_became_active":"2024-08-31T05:27:38.292736+0000","last_became_peered":"2024-08-31T05:27:38.292736+0000","last_unstale":"2024-08-31T05:28:59.160810+0000","last_undegraded":"2024-08-31T05:28:59.160810+0000","last_fullsized":"2024-08-31T05:28:59.160810+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:51:25.853365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"87'8","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.843426+0000","last_change":"2024-08-31T05:27:31.252479+0000","last_active":"2024-08-31T05:29:27.843426+0000","last_peered":"2024-08-31T05:29:27.843426+0000","last_clean":"2024-08-31T05:29:27.843426+0000","last_became_active":"2024-08-31T05:27:31.252126+0000","last_became_peered":"2024-08-31T05:27:31.252126+0000","last_unstale":"2024-08-31T05:29:27.843426+0000","last_undegraded":"2024-08-31T05:29:27.843426+0000","last_fullsized":"2024-08-31T05:29:27.843426+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:24:40.864240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"87'4","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.481819+0000","last_change":"2024-08-31T05:27:58.508588+0000","last_active":"2024-08-31T05:28:59.481819+0000","last_peered":"2024-08-31T05:28:59.481819+0000","last_clean":"2024-08-31T05:28:59.481819+0000","last_became_active":"2024-08-31T05:27:58.508024+0000","last_became_peered":"2024-08-31T05:27:58.508024+0000","last_unstale":"2024-08-31T05:28:59.481819+0000","last_undegraded":"2024-08-31T05:28:59.481819+0000","last_fullsized":"2024-08-31T05:28:59.481819+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:32:33.222909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"85'1","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.160825+0000","last_change":"2024-08-31T05:27:38.299506+0000","last_active":"2024-08-31T05:28:59.160825+0000","last_peered":"2024-08-31T05:28:59.160825+0000","last_clean":"2024-08-31T05:28:59.160825+0000","last_became_active":"2024-08-31T05:27:38.298756+0000","last_became_peered":"2024-08-31T05:27:38.298756+0000","last_unstale":"2024-08-31T05:28:59.160825+0000","last_undegraded":"2024-08-31T05:28:59.160825+0000","last_fullsized":"2024-08-31T05:28:59.160825+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:25:18.115727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"87'9","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.842533+0000","last_change":"2024-08-31T05:27:31.249220+0000","last_active":"2024-08-31T05:29:27.842533+0000","last_peered":"2024-08-31T05:29:27.842533+0000","last_clean":"2024-08-31T05:29:27.842533+0000","last_became_active":"2024-08-31T05:27:31.248869+0000","last_became_peered":"2024-08-31T05:27:31.248869+0000","last_unstale":"2024-08-31T05:29:27.842533+0000","last_undegraded":"2024-08-31T05:29:27.842533+0000","last_fullsized":"2024-08-31T05:29:27.842533+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:43:13.463903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"85'7","reported_seq":47,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.159564+0000","last_change":"2024-08-31T05:27:29.235278+0000","last_active":"2024-08-31T05:28:59.159564+0000","last_peered":"2024-08-31T05:28:59.159564+0000","last_clean":"2024-08-31T05:28:59.159564+0000","last_became_active":"2024-08-31T05:27:29.234929+0000","last_became_peered":"2024-08-31T05:27:29.234929+0000","last_unstale":"2024-08-31T05:28:59.159564+0000","last_undegraded":"2024-08-31T05:28:59.159564+0000","last_fullsized":"2024-08-31T05:28:59.159564+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:49:55.867542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.657185+0000","last_change":"2024-08-31T05:27:38.293903+0000","last_active":"2024-08-31T05:28:59.657185+0000","last_peered":"2024-08-31T05:28:59.657185+0000","last_clean":"2024-08-31T05:28:59.657185+0000","last_became_active":"2024-08-31T05:27:38.290471+0000","last_became_peered":"2024-08-31T05:27:38.290471+0000","last_unstale":"2024-08-31T05:28:59.657185+0000","last_undegraded":"2024-08-31T05:28:59.657185+0000","last_fullsized":"2024-08-31T05:28:59.657185+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:04:36.573302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"87'2","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.838859+0000","last_change":"2024-08-31T05:27:31.252038+0000","last_active":"2024-08-31T05:29:27.838859+0000","last_peered":"2024-08-31T05:29:27.838859+0000","last_clean":"2024-08-31T05:29:27.838859+0000","last_became_active":"2024-08-31T05:27:31.251630+0000","last_became_peered":"2024-08-31T05:27:31.251630+0000","last_unstale":"2024-08-31T05:29:27.838859+0000","last_undegraded":"2024-08-31T05:29:27.838859+0000","last_fullsized":"2024-08-31T05:29:27.838859+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:10:39.778057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.662029+0000","last_change":"2024-08-31T05:27:29.280978+0000","last_active":"2024-08-31T05:28:59.662029+0000","last_peered":"2024-08-31T05:28:59.662029+0000","last_clean":"2024-08-31T05:28:59.662029+0000","last_became_active":"2024-08-31T05:27:29.280524+0000","last_became_peered":"2024-08-31T05:27:29.280524+0000","last_unstale":"2024-08-31T05:28:59.662029+0000","last_undegraded":"2024-08-31T05:28:59.662029+0000","last_fullsized":"2024-08-31T05:28:59.662029+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:56:57.441801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161183+0000","last_change":"2024-08-31T05:27:38.300947+0000","last_active":"2024-08-31T05:28:59.161183+0000","last_peered":"2024-08-31T05:28:59.161183+0000","last_clean":"2024-08-31T05:28:59.161183+0000","last_became_active":"2024-08-31T05:27:38.300044+0000","last_became_peered":"2024-08-31T05:27:38.300044+0000","last_unstale":"2024-08-31T05:28:59.161183+0000","last_undegraded":"2024-08-31T05:28:59.161183+0000","last_fullsized":"2024-08-31T05:28:59.161183+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:33:05.081601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"87'7","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.842303+0000","last_change":"2024-08-31T05:27:31.257782+0000","last_active":"2024-08-31T05:29:27.842303+0000","last_peered":"2024-08-31T05:29:27.842303+0000","last_clean":"2024-08-31T05:29:27.842303+0000","last_became_active":"2024-08-31T05:27:31.257360+0000","last_became_peered":"2024-08-31T05:27:31.257360+0000","last_unstale":"2024-08-31T05:29:27.842303+0000","last_undegraded":"2024-08-31T05:29:27.842303+0000","last_fullsized":"2024-08-31T05:29:27.842303+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:58:11.249925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"85'7","reported_seq":48,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161269+0000","last_change":"2024-08-31T05:27:29.392664+0000","last_active":"2024-08-31T05:28:59.161269+0000","last_peered":"2024-08-31T05:28:59.161269+0000","last_clean":"2024-08-31T05:28:59.161269+0000","last_became_active":"2024-08-31T05:27:29.392208+0000","last_became_peered":"2024-08-31T05:27:29.392208+0000","last_unstale":"2024-08-31T05:28:59.161269+0000","last_undegraded":"2024-08-31T05:28:59.161269+0000","last_fullsized":"2024-08-31T05:28:59.161269+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:51:34.981168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.661752+0000","last_change":"2024-08-31T05:27:38.293556+0000","last_active":"2024-08-31T05:28:59.661752+0000","last_peered":"2024-08-31T05:28:59.661752+0000","last_clean":"2024-08-31T05:28:59.661752+0000","last_became_active":"2024-08-31T05:27:38.292338+0000","last_became_peered":"2024-08-31T05:27:38.292338+0000","last_unstale":"2024-08-31T05:28:59.661752+0000","last_undegraded":"2024-08-31T05:28:59.661752+0000","last_fullsized":"2024-08-31T05:28:59.661752+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:13:46.376934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"87'5","reported_seq":40,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.842964+0000","last_change":"2024-08-31T05:27:31.247408+0000","last_active":"2024-08-31T05:29:27.842964+0000","last_peered":"2024-08-31T05:29:27.842964+0000","last_clean":"2024-08-31T05:29:27.842964+0000","last_became_active":"2024-08-31T05:27:31.247034+0000","last_became_peered":"2024-08-31T05:27:31.247034+0000","last_unstale":"2024-08-31T05:29:27.842964+0000","last_undegraded":"2024-08-31T05:29:27.842964+0000","last_fullsized":"2024-08-31T05:29:27.842964+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:42:08.350054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"87'17","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:42.487425+0000","last_change":"2024-08-31T05:27:29.235941+0000","last_active":"2024-08-31T05:29:42.487425+0000","last_peered":"2024-08-31T05:29:42.487425+0000","last_clean":"2024-08-31T05:29:42.487425+0000","last_became_active":"2024-08-31T05:27:29.235561+0000","last_became_peered":"2024-08-31T05:27:29.235561+0000","last_unstale":"2024-08-31T05:29:42.487425+0000","last_undegraded":"2024-08-31T05:29:42.487425+0000","last_fullsized":"2024-08-31T05:29:42.487425+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:29:34.551748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.159114+0000","last_change":"2024-08-31T05:27:38.286960+0000","last_active":"2024-08-31T05:28:59.159114+0000","last_peered":"2024-08-31T05:28:59.159114+0000","last_clean":"2024-08-31T05:28:59.159114+0000","last_became_active":"2024-08-31T05:27:38.286537+0000","last_became_peered":"2024-08-31T05:27:38.286537+0000","last_unstale":"2024-08-31T05:28:59.159114+0000","last_undegraded":"2024-08-31T05:28:59.159114+0000","last_fullsized":"2024-08-31T05:28:59.159114+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:55:00.656676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"87'9","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.842094+0000","last_change":"2024-08-31T05:27:31.245901+0000","last_active":"2024-08-31T05:29:27.842094+0000","last_peered":"2024-08-31T05:29:27.842094+0000","last_clean":"2024-08-31T05:29:27.842094+0000","last_became_active":"2024-08-31T05:27:31.245534+0000","last_became_peered":"2024-08-31T05:27:31.245534+0000","last_unstale":"2024-08-31T05:29:27.842094+0000","last_undegraded":"2024-08-31T05:29:27.842094+0000","last_fullsized":"2024-08-31T05:29:27.842094+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:26:35.876033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"85'4","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.166037+0000","last_change":"2024-08-31T05:27:29.280767+0000","last_active":"2024-08-31T05:28:59.166037+0000","last_peered":"2024-08-31T05:28:59.166037+0000","last_clean":"2024-08-31T05:28:59.166037+0000","last_became_active":"2024-08-31T05:27:29.280334+0000","last_became_peered":"2024-08-31T05:27:29.280334+0000","last_unstale":"2024-08-31T05:28:59.166037+0000","last_undegraded":"2024-08-31T05:28:59.166037+0000","last_fullsized":"2024-08-31T05:28:59.166037+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:25:20.250205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.481848+0000","last_change":"2024-08-31T05:27:38.296846+0000","last_active":"2024-08-31T05:28:59.481848+0000","last_peered":"2024-08-31T05:28:59.481848+0000","last_clean":"2024-08-31T05:28:59.481848+0000","last_became_active":"2024-08-31T05:27:38.295516+0000","last_became_peered":"2024-08-31T05:27:38.295516+0000","last_unstale":"2024-08-31T05:28:59.481848+0000","last_undegraded":"2024-08-31T05:28:59.481848+0000","last_fullsized":"2024-08-31T05:28:59.481848+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:30:51.110144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"87'4","reported_seq":39,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.822866+0000","last_change":"2024-08-31T05:27:31.246481+0000","last_active":"2024-08-31T05:29:27.822866+0000","last_peered":"2024-08-31T05:29:27.822866+0000","last_clean":"2024-08-31T05:29:27.822866+0000","last_became_active":"2024-08-31T05:27:31.246079+0000","last_became_peered":"2024-08-31T05:27:31.246079+0000","last_unstale":"2024-08-31T05:29:27.822866+0000","last_undegraded":"2024-08-31T05:29:27.822866+0000","last_fullsized":"2024-08-31T05:29:27.822866+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:25:42.536251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"85'1","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.656957+0000","last_change":"2024-08-31T05:27:29.281078+0000","last_active":"2024-08-31T05:28:59.656957+0000","last_peered":"2024-08-31T05:28:59.656957+0000","last_clean":"2024-08-31T05:28:59.656957+0000","last_became_active":"2024-08-31T05:27:29.280674+0000","last_became_peered":"2024-08-31T05:27:29.280674+0000","last_unstale":"2024-08-31T05:28:59.656957+0000","last_undegraded":"2024-08-31T05:28:59.656957+0000","last_fullsized":"2024-08-31T05:28:59.656957+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:04:03.576077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.664703+0000","last_change":"2024-08-31T05:28:59.664061+0000","last_active":"2024-08-31T05:28:59.664703+0000","last_peered":"2024-08-31T05:28:59.664703+0000","last_clean":"2024-08-31T05:28:59.664703+0000","last_became_active":"2024-08-31T05:28:59.663495+0000","last_became_peered":"2024-08-31T05:28:59.663495+0000","last_unstale":"2024-08-31T05:28:59.664703+0000","last_undegraded":"2024-08-31T05:28:59.664703+0000","last_fullsized":"2024-08-31T05:28:59.664703+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:51:38.112492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"87'7","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.835248+0000","last_change":"2024-08-31T05:27:31.251011+0000","last_active":"2024-08-31T05:29:27.835248+0000","last_peered":"2024-08-31T05:29:27.835248+0000","last_clean":"2024-08-31T05:29:27.835248+0000","last_became_active":"2024-08-31T05:27:31.250597+0000","last_became_peered":"2024-08-31T05:27:31.250597+0000","last_unstale":"2024-08-31T05:29:27.835248+0000","last_undegraded":"2024-08-31T05:29:27.835248+0000","last_fullsized":"2024-08-31T05:29:27.835248+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:13:30.858395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"87'7","reported_seq":158,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:58.742129+0000","last_change":"2024-08-31T05:27:29.242137+0000","last_active":"2024-08-31T05:29:58.742129+0000","last_peered":"2024-08-31T05:29:58.742129+0000","last_clean":"2024-08-31T05:29:58.742129+0000","last_became_active":"2024-08-31T05:27:29.241460+0000","last_became_peered":"2024-08-31T05:27:29.241460+0000","last_unstale":"2024-08-31T05:29:58.742129+0000","last_undegraded":"2024-08-31T05:29:58.742129+0000","last_fullsized":"2024-08-31T05:29:58.742129+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:40:59.174572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161959+0000","last_change":"2024-08-31T05:27:38.288643+0000","last_active":"2024-08-31T05:28:59.161959+0000","last_peered":"2024-08-31T05:28:59.161959+0000","last_clean":"2024-08-31T05:28:59.161959+0000","last_became_active":"2024-08-31T05:27:38.288235+0000","last_became_peered":"2024-08-31T05:27:38.288235+0000","last_unstale":"2024-08-31T05:28:59.161959+0000","last_undegraded":"2024-08-31T05:28:59.161959+0000","last_fullsized":"2024-08-31T05:28:59.161959+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:23:49.090990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"87'8","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.844926+0000","last_change":"2024-08-31T05:27:31.263326+0000","last_active":"2024-08-31T05:29:27.844926+0000","last_peered":"2024-08-31T05:29:27.844926+0000","last_clean":"2024-08-31T05:29:27.844926+0000","last_became_active":"2024-08-31T05:27:31.262864+0000","last_became_peered":"2024-08-31T05:27:31.262864+0000","last_unstale":"2024-08-31T05:29:27.844926+0000","last_undegraded":"2024-08-31T05:29:27.844926+0000","last_fullsized":"2024-08-31T05:29:27.844926+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:34:21.159545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"87'6","reported_seq":154,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:57.740976+0000","last_change":"2024-08-31T05:27:29.280829+0000","last_active":"2024-08-31T05:29:57.740976+0000","last_peered":"2024-08-31T05:29:57.740976+0000","last_clean":"2024-08-31T05:29:57.740976+0000","last_became_active":"2024-08-31T05:27:29.280469+0000","last_became_peered":"2024-08-31T05:27:29.280469+0000","last_unstale":"2024-08-31T05:29:57.740976+0000","last_undegraded":"2024-08-31T05:29:57.740976+0000","last_fullsized":"2024-08-31T05:29:57.740976+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:16:59.559680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":108,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.162010+0000","last_change":"2024-08-31T05:27:38.290175+0000","last_active":"2024-08-31T05:28:59.162010+0000","last_peered":"2024-08-31T05:28:59.162010+0000","last_clean":"2024-08-31T05:28:59.162010+0000","last_became_active":"2024-08-31T05:27:38.289228+0000","last_became_peered":"2024-08-31T05:27:38.289228+0000","last_unstale":"2024-08-31T05:28:59.162010+0000","last_undegraded":"2024-08-31T05:28:59.162010+0000","last_fullsized":"2024-08-31T05:28:59.162010+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:26:07.251711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"87'5","reported_seq":40,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.842311+0000","last_change":"2024-08-31T05:27:31.245446+0000","last_active":"2024-08-31T05:29:27.842311+0000","last_peered":"2024-08-31T05:29:27.842311+0000","last_clean":"2024-08-31T05:29:27.842311+0000","last_became_active":"2024-08-31T05:27:31.245099+0000","last_became_peered":"2024-08-31T05:27:31.245099+0000","last_unstale":"2024-08-31T05:29:27.842311+0000","last_undegraded":"2024-08-31T05:29:27.842311+0000","last_fullsized":"2024-08-31T05:29:27.842311+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:18:17.876796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'4","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.489895+0000","last_change":"2024-08-31T05:27:29.241333+0000","last_active":"2024-08-31T05:28:59.489895+0000","last_peered":"2024-08-31T05:28:59.489895+0000","last_clean":"2024-08-31T05:28:59.489895+0000","last_became_active":"2024-08-31T05:27:29.240963+0000","last_became_peered":"2024-08-31T05:27:29.240963+0000","last_unstale":"2024-08-31T05:28:59.489895+0000","last_undegraded":"2024-08-31T05:28:59.489895+0000","last_fullsized":"2024-08-31T05:28:59.489895+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:22:06.442824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161183+0000","last_change":"2024-08-31T05:27:38.287640+0000","last_active":"2024-08-31T05:28:59.161183+0000","last_peered":"2024-08-31T05:28:59.161183+0000","last_clean":"2024-08-31T05:28:59.161183+0000","last_became_active":"2024-08-31T05:27:38.286191+0000","last_became_peered":"2024-08-31T05:27:38.286191+0000","last_unstale":"2024-08-31T05:28:59.161183+0000","last_undegraded":"2024-08-31T05:28:59.161183+0000","last_fullsized":"2024-08-31T05:28:59.161183+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:57:23.535841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"87'8","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.845569+0000","last_change":"2024-08-31T05:27:58.506945+0000","last_active":"2024-08-31T05:29:27.845569+0000","last_peered":"2024-08-31T05:29:27.845569+0000","last_clean":"2024-08-31T05:29:27.845569+0000","last_became_active":"2024-08-31T05:27:58.506505+0000","last_became_peered":"2024-08-31T05:27:58.506505+0000","last_unstale":"2024-08-31T05:29:27.845569+0000","last_undegraded":"2024-08-31T05:29:27.845569+0000","last_fullsized":"2024-08-31T05:29:27.845569+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:16:09.541579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"85'6","reported_seq":49,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161730+0000","last_change":"2024-08-31T05:27:29.238351+0000","last_active":"2024-08-31T05:28:59.161730+0000","last_peered":"2024-08-31T05:28:59.161730+0000","last_clean":"2024-08-31T05:28:59.161730+0000","last_became_active":"2024-08-31T05:27:29.237940+0000","last_became_peered":"2024-08-31T05:27:29.237940+0000","last_unstale":"2024-08-31T05:28:59.161730+0000","last_undegraded":"2024-08-31T05:28:59.161730+0000","last_fullsized":"2024-08-31T05:28:59.161730+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:55:08.048966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":114,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.489971+0000","last_change":"2024-08-31T05:26:14.183718+0000","last_active":"2024-08-31T05:28:59.489971+0000","last_peered":"2024-08-31T05:28:59.489971+0000","last_clean":"2024-08-31T05:28:59.489971+0000","last_became_active":"2024-08-31T05:26:14.178188+0000","last_became_peered":"2024-08-31T05:26:14.178188+0000","last_unstale":"2024-08-31T05:28:59.489971+0000","last_undegraded":"2024-08-31T05:28:59.489971+0000","last_fullsized":"2024-08-31T05:28:59.489971+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:22:50.516233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:22:50.516233+0000","last_clean_scrub_stamp":"2024-08-31T05:22:50.516233+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:10:01.719715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"85'1","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.490285+0000","last_change":"2024-08-31T05:27:38.289721+0000","last_active":"2024-08-31T05:28:59.490285+0000","last_peered":"2024-08-31T05:28:59.490285+0000","last_clean":"2024-08-31T05:28:59.490285+0000","last_became_active":"2024-08-31T05:27:38.289165+0000","last_became_peered":"2024-08-31T05:27:38.289165+0000","last_unstale":"2024-08-31T05:28:59.490285+0000","last_undegraded":"2024-08-31T05:28:59.490285+0000","last_fullsized":"2024-08-31T05:28:59.490285+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:00:30.689093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"87'7","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.850881+0000","last_change":"2024-08-31T05:27:31.256262+0000","last_active":"2024-08-31T05:29:27.850881+0000","last_peered":"2024-08-31T05:29:27.850881+0000","last_clean":"2024-08-31T05:29:27.850881+0000","last_became_active":"2024-08-31T05:27:31.255644+0000","last_became_peered":"2024-08-31T05:27:31.255644+0000","last_unstale":"2024-08-31T05:29:27.850881+0000","last_undegraded":"2024-08-31T05:29:27.850881+0000","last_fullsized":"2024-08-31T05:29:27.850881+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:50:18.158645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"87'6","reported_seq":156,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:58.783099+0000","last_change":"2024-08-31T05:27:29.392666+0000","last_active":"2024-08-31T05:29:58.783099+0000","last_peered":"2024-08-31T05:29:58.783099+0000","last_clean":"2024-08-31T05:29:58.783099+0000","last_became_active":"2024-08-31T05:27:29.392153+0000","last_became_peered":"2024-08-31T05:27:29.392153+0000","last_unstale":"2024-08-31T05:29:58.783099+0000","last_undegraded":"2024-08-31T05:29:58.783099+0000","last_fullsized":"2024-08-31T05:29:58.783099+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:53:02.713022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":110,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.662591+0000","last_change":"2024-08-31T05:27:38.291459+0000","last_active":"2024-08-31T05:28:59.662591+0000","last_peered":"2024-08-31T05:28:59.662591+0000","last_clean":"2024-08-31T05:28:59.662591+0000","last_became_active":"2024-08-31T05:27:38.291013+0000","last_became_peered":"2024-08-31T05:27:38.291013+0000","last_unstale":"2024-08-31T05:28:59.662591+0000","last_undegraded":"2024-08-31T05:28:59.662591+0000","last_fullsized":"2024-08-31T05:28:59.662591+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:03:46.921137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"87'6","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.843678+0000","last_change":"2024-08-31T05:27:31.251641+0000","last_active":"2024-08-31T05:29:27.843678+0000","last_peered":"2024-08-31T05:29:27.843678+0000","last_clean":"2024-08-31T05:29:27.843678+0000","last_became_active":"2024-08-31T05:27:31.251242+0000","last_became_peered":"2024-08-31T05:27:31.251242+0000","last_unstale":"2024-08-31T05:29:27.843678+0000","last_undegraded":"2024-08-31T05:29:27.843678+0000","last_fullsized":"2024-08-31T05:29:27.843678+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:13:58.227136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'3","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161695+0000","last_change":"2024-08-31T05:27:29.238028+0000","last_active":"2024-08-31T05:28:59.161695+0000","last_peered":"2024-08-31T05:28:59.161695+0000","last_clean":"2024-08-31T05:28:59.161695+0000","last_became_active":"2024-08-31T05:27:29.237449+0000","last_became_peered":"2024-08-31T05:27:29.237449+0000","last_unstale":"2024-08-31T05:28:59.161695+0000","last_undegraded":"2024-08-31T05:28:59.161695+0000","last_fullsized":"2024-08-31T05:28:59.161695+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:13:15.447707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.660720+0000","last_change":"2024-08-31T05:27:38.294072+0000","last_active":"2024-08-31T05:28:59.660720+0000","last_peered":"2024-08-31T05:28:59.660720+0000","last_clean":"2024-08-31T05:28:59.660720+0000","last_became_active":"2024-08-31T05:27:38.293642+0000","last_became_peered":"2024-08-31T05:27:38.293642+0000","last_unstale":"2024-08-31T05:28:59.660720+0000","last_undegraded":"2024-08-31T05:28:59.660720+0000","last_fullsized":"2024-08-31T05:28:59.660720+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:57:41.854799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"87'9","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.848174+0000","last_change":"2024-08-31T05:27:31.253601+0000","last_active":"2024-08-31T05:29:27.848174+0000","last_peered":"2024-08-31T05:29:27.848174+0000","last_clean":"2024-08-31T05:29:27.848174+0000","last_became_active":"2024-08-31T05:27:31.253216+0000","last_became_peered":"2024-08-31T05:27:31.253216+0000","last_unstale":"2024-08-31T05:29:27.848174+0000","last_undegraded":"2024-08-31T05:29:27.848174+0000","last_fullsized":"2024-08-31T05:29:27.848174+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:46:12.757944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'5","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.162336+0000","last_change":"2024-08-31T05:27:29.236851+0000","last_active":"2024-08-31T05:28:59.162336+0000","last_peered":"2024-08-31T05:28:59.162336+0000","last_clean":"2024-08-31T05:28:59.162336+0000","last_became_active":"2024-08-31T05:27:29.236473+0000","last_became_peered":"2024-08-31T05:27:29.236473+0000","last_unstale":"2024-08-31T05:28:59.162336+0000","last_undegraded":"2024-08-31T05:28:59.162336+0000","last_fullsized":"2024-08-31T05:28:59.162336+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:01:23.838417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.160555+0000","last_change":"2024-08-31T05:27:38.290069+0000","last_active":"2024-08-31T05:28:59.160555+0000","last_peered":"2024-08-31T05:28:59.160555+0000","last_clean":"2024-08-31T05:28:59.160555+0000","last_became_active":"2024-08-31T05:27:38.289507+0000","last_became_peered":"2024-08-31T05:27:38.289507+0000","last_unstale":"2024-08-31T05:28:59.160555+0000","last_undegraded":"2024-08-31T05:28:59.160555+0000","last_fullsized":"2024-08-31T05:28:59.160555+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:24:33.326308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"87'5","reported_seq":40,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.836667+0000","last_change":"2024-08-31T05:27:31.252787+0000","last_active":"2024-08-31T05:29:27.836667+0000","last_peered":"2024-08-31T05:29:27.836667+0000","last_clean":"2024-08-31T05:29:27.836667+0000","last_became_active":"2024-08-31T05:27:31.252392+0000","last_became_peered":"2024-08-31T05:27:31.252392+0000","last_unstale":"2024-08-31T05:29:27.836667+0000","last_undegraded":"2024-08-31T05:29:27.836667+0000","last_fullsized":"2024-08-31T05:29:27.836667+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:47:06.613616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.166232+0000","last_change":"2024-08-31T05:27:29.240293+0000","last_active":"2024-08-31T05:28:59.166232+0000","last_peered":"2024-08-31T05:28:59.166232+0000","last_clean":"2024-08-31T05:28:59.166232+0000","last_became_active":"2024-08-31T05:27:29.239889+0000","last_became_peered":"2024-08-31T05:27:29.239889+0000","last_unstale":"2024-08-31T05:28:59.166232+0000","last_undegraded":"2024-08-31T05:28:59.166232+0000","last_fullsized":"2024-08-31T05:28:59.166232+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:55:03.524475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.160798+0000","last_change":"2024-08-31T05:27:38.290715+0000","last_active":"2024-08-31T05:28:59.160798+0000","last_peered":"2024-08-31T05:28:59.160798+0000","last_clean":"2024-08-31T05:28:59.160798+0000","last_became_active":"2024-08-31T05:27:38.290227+0000","last_became_peered":"2024-08-31T05:27:38.290227+0000","last_unstale":"2024-08-31T05:28:59.160798+0000","last_undegraded":"2024-08-31T05:28:59.160798+0000","last_fullsized":"2024-08-31T05:28:59.160798+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:09:38.349046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"87'6","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.850824+0000","last_change":"2024-08-31T05:27:31.265672+0000","last_active":"2024-08-31T05:29:27.850824+0000","last_peered":"2024-08-31T05:29:27.850824+0000","last_clean":"2024-08-31T05:29:27.850824+0000","last_became_active":"2024-08-31T05:27:31.265332+0000","last_became_peered":"2024-08-31T05:27:31.265332+0000","last_unstale":"2024-08-31T05:29:27.850824+0000","last_undegraded":"2024-08-31T05:29:27.850824+0000","last_fullsized":"2024-08-31T05:29:27.850824+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:45:01.868256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"85'17","reported_seq":58,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.165237+0000","last_change":"2024-08-31T05:27:29.281129+0000","last_active":"2024-08-31T05:28:59.165237+0000","last_peered":"2024-08-31T05:28:59.165237+0000","last_clean":"2024-08-31T05:28:59.165237+0000","last_became_active":"2024-08-31T05:27:29.280613+0000","last_became_peered":"2024-08-31T05:27:29.280613+0000","last_unstale":"2024-08-31T05:28:59.165237+0000","last_undegraded":"2024-08-31T05:28:59.165237+0000","last_fullsized":"2024-08-31T05:28:59.165237+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:17:28.103371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.483707+0000","last_change":"2024-08-31T05:28:59.483629+0000","last_active":"2024-08-31T05:28:59.483707+0000","last_peered":"2024-08-31T05:28:59.483707+0000","last_clean":"2024-08-31T05:28:59.483707+0000","last_became_active":"2024-08-31T05:28:59.483102+0000","last_became_peered":"2024-08-31T05:28:59.483102+0000","last_unstale":"2024-08-31T05:28:59.483707+0000","last_undegraded":"2024-08-31T05:28:59.483707+0000","last_fullsized":"2024-08-31T05:28:59.483707+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:54:18.587227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,8,11],"acting":[6,3,8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"87'6","reported_seq":48,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.847968+0000","last_change":"2024-08-31T05:27:58.505480+0000","last_active":"2024-08-31T05:29:27.847968+0000","last_peered":"2024-08-31T05:29:27.847968+0000","last_clean":"2024-08-31T05:29:27.847968+0000","last_became_active":"2024-08-31T05:27:58.504773+0000","last_became_peered":"2024-08-31T05:27:58.504773+0000","last_unstale":"2024-08-31T05:29:27.847968+0000","last_undegraded":"2024-08-31T05:29:27.847968+0000","last_fullsized":"2024-08-31T05:29:27.847968+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:48:59.979443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"87'6","reported_seq":156,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:57.741512+0000","last_change":"2024-08-31T05:27:29.239308+0000","last_active":"2024-08-31T05:29:57.741512+0000","last_peered":"2024-08-31T05:29:57.741512+0000","last_clean":"2024-08-31T05:29:57.741512+0000","last_became_active":"2024-08-31T05:27:29.238793+0000","last_became_peered":"2024-08-31T05:27:29.238793+0000","last_unstale":"2024-08-31T05:29:57.741512+0000","last_undegraded":"2024-08-31T05:29:57.741512+0000","last_fullsized":"2024-08-31T05:29:57.741512+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:20:47.837021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":896,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":111,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.657165+0000","last_change":"2024-08-31T05:27:38.287260+0000","last_active":"2024-08-31T05:28:59.657165+0000","last_peered":"2024-08-31T05:28:59.657165+0000","last_clean":"2024-08-31T05:28:59.657165+0000","last_became_active":"2024-08-31T05:27:38.286250+0000","last_became_peered":"2024-08-31T05:27:38.286250+0000","last_unstale":"2024-08-31T05:28:59.657165+0000","last_undegraded":"2024-08-31T05:28:59.657165+0000","last_fullsized":"2024-08-31T05:28:59.657165+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:17:55.530114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"87'15","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.848492+0000","last_change":"2024-08-31T05:27:31.251152+0000","last_active":"2024-08-31T05:29:27.848492+0000","last_peered":"2024-08-31T05:29:27.848492+0000","last_clean":"2024-08-31T05:29:27.848492+0000","last_became_active":"2024-08-31T05:27:31.250686+0000","last_became_peered":"2024-08-31T05:27:31.250686+0000","last_unstale":"2024-08-31T05:29:27.848492+0000","last_undegraded":"2024-08-31T05:29:27.848492+0000","last_fullsized":"2024-08-31T05:29:27.848492+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:03:37.359332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"85'5","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161004+0000","last_change":"2024-08-31T05:27:29.237404+0000","last_active":"2024-08-31T05:28:59.161004+0000","last_peered":"2024-08-31T05:28:59.161004+0000","last_clean":"2024-08-31T05:28:59.161004+0000","last_became_active":"2024-08-31T05:27:29.236695+0000","last_became_peered":"2024-08-31T05:27:29.236695+0000","last_unstale":"2024-08-31T05:28:59.161004+0000","last_undegraded":"2024-08-31T05:28:59.161004+0000","last_fullsized":"2024-08-31T05:28:59.161004+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:25:05.174288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.481921+0000","last_change":"2024-08-31T05:27:38.296553+0000","last_active":"2024-08-31T05:28:59.481921+0000","last_peered":"2024-08-31T05:28:59.481921+0000","last_clean":"2024-08-31T05:28:59.481921+0000","last_became_active":"2024-08-31T05:27:38.296118+0000","last_became_peered":"2024-08-31T05:27:38.296118+0000","last_unstale":"2024-08-31T05:28:59.481921+0000","last_undegraded":"2024-08-31T05:28:59.481921+0000","last_fullsized":"2024-08-31T05:28:59.481921+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:10:41.334260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"87'9","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.846961+0000","last_change":"2024-08-31T05:27:31.250584+0000","last_active":"2024-08-31T05:29:27.846961+0000","last_peered":"2024-08-31T05:29:27.846961+0000","last_clean":"2024-08-31T05:29:27.846961+0000","last_became_active":"2024-08-31T05:27:31.250234+0000","last_became_peered":"2024-08-31T05:27:31.250234+0000","last_unstale":"2024-08-31T05:29:27.846961+0000","last_undegraded":"2024-08-31T05:29:27.846961+0000","last_fullsized":"2024-08-31T05:29:27.846961+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:00:39.648236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"85'9","reported_seq":51,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.661583+0000","last_change":"2024-08-31T05:27:29.237956+0000","last_active":"2024-08-31T05:28:59.661583+0000","last_peered":"2024-08-31T05:28:59.661583+0000","last_clean":"2024-08-31T05:28:59.661583+0000","last_became_active":"2024-08-31T05:27:29.237510+0000","last_became_peered":"2024-08-31T05:27:29.237510+0000","last_unstale":"2024-08-31T05:28:59.661583+0000","last_undegraded":"2024-08-31T05:28:59.661583+0000","last_fullsized":"2024-08-31T05:28:59.661583+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:18:44.295298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161323+0000","last_change":"2024-08-31T05:27:38.289472+0000","last_active":"2024-08-31T05:28:59.161323+0000","last_peered":"2024-08-31T05:28:59.161323+0000","last_clean":"2024-08-31T05:28:59.161323+0000","last_became_active":"2024-08-31T05:27:38.288809+0000","last_became_peered":"2024-08-31T05:27:38.288809+0000","last_unstale":"2024-08-31T05:28:59.161323+0000","last_undegraded":"2024-08-31T05:28:59.161323+0000","last_fullsized":"2024-08-31T05:28:59.161323+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:17:06.430110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"87'6","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.839029+0000","last_change":"2024-08-31T05:27:31.258103+0000","last_active":"2024-08-31T05:29:27.839029+0000","last_peered":"2024-08-31T05:29:27.839029+0000","last_clean":"2024-08-31T05:29:27.839029+0000","last_became_active":"2024-08-31T05:27:31.257257+0000","last_became_peered":"2024-08-31T05:27:31.257257+0000","last_unstale":"2024-08-31T05:29:27.839029+0000","last_undegraded":"2024-08-31T05:29:27.839029+0000","last_fullsized":"2024-08-31T05:29:27.839029+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:16:01.309646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"87'42","reported_seq":305,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:57.742069+0000","last_change":"2024-08-31T05:27:29.241129+0000","last_active":"2024-08-31T05:29:57.742069+0000","last_peered":"2024-08-31T05:29:57.742069+0000","last_clean":"2024-08-31T05:29:57.742069+0000","last_became_active":"2024-08-31T05:27:29.240708+0000","last_became_peered":"2024-08-31T05:27:29.240708+0000","last_unstale":"2024-08-31T05:29:57.742069+0000","last_undegraded":"2024-08-31T05:29:57.742069+0000","last_fullsized":"2024-08-31T05:29:57.742069+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:20:10.127588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68393,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":223,"num_read_kb":179,"num_write":44,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.656811+0000","last_change":"2024-08-31T05:27:38.291037+0000","last_active":"2024-08-31T05:28:59.656811+0000","last_peered":"2024-08-31T05:28:59.656811+0000","last_clean":"2024-08-31T05:28:59.656811+0000","last_became_active":"2024-08-31T05:27:38.290592+0000","last_became_peered":"2024-08-31T05:27:38.290592+0000","last_unstale":"2024-08-31T05:28:59.656811+0000","last_undegraded":"2024-08-31T05:28:59.656811+0000","last_fullsized":"2024-08-31T05:28:59.656811+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:12:56.391784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"87'11","reported_seq":53,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.851259+0000","last_change":"2024-08-31T05:27:58.508403+0000","last_active":"2024-08-31T05:29:27.851259+0000","last_peered":"2024-08-31T05:29:27.851259+0000","last_clean":"2024-08-31T05:29:27.851259+0000","last_became_active":"2024-08-31T05:27:58.507918+0000","last_became_peered":"2024-08-31T05:27:58.507918+0000","last_unstale":"2024-08-31T05:29:27.851259+0000","last_undegraded":"2024-08-31T05:29:27.851259+0000","last_fullsized":"2024-08-31T05:29:27.851259+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:47:54.479249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,7],"acting":[1,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"85'5","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161566+0000","last_change":"2024-08-31T05:27:29.281231+0000","last_active":"2024-08-31T05:28:59.161566+0000","last_peered":"2024-08-31T05:28:59.161566+0000","last_clean":"2024-08-31T05:28:59.161566+0000","last_became_active":"2024-08-31T05:27:29.280748+0000","last_became_peered":"2024-08-31T05:27:29.280748+0000","last_unstale":"2024-08-31T05:28:59.161566+0000","last_undegraded":"2024-08-31T05:28:59.161566+0000","last_fullsized":"2024-08-31T05:28:59.161566+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:43:44.783595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.664495+0000","last_change":"2024-08-31T05:28:59.663824+0000","last_active":"2024-08-31T05:28:59.664495+0000","last_peered":"2024-08-31T05:28:59.664495+0000","last_clean":"2024-08-31T05:28:59.664495+0000","last_became_active":"2024-08-31T05:28:59.663270+0000","last_became_peered":"2024-08-31T05:28:59.663270+0000","last_unstale":"2024-08-31T05:28:59.664495+0000","last_undegraded":"2024-08-31T05:28:59.664495+0000","last_fullsized":"2024-08-31T05:28:59.664495+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:23:26.836655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"87'9","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.835619+0000","last_change":"2024-08-31T05:27:31.258030+0000","last_active":"2024-08-31T05:29:27.835619+0000","last_peered":"2024-08-31T05:29:27.835619+0000","last_clean":"2024-08-31T05:29:27.835619+0000","last_became_active":"2024-08-31T05:27:31.257410+0000","last_became_peered":"2024-08-31T05:27:31.257410+0000","last_unstale":"2024-08-31T05:29:27.835619+0000","last_undegraded":"2024-08-31T05:29:27.835619+0000","last_fullsized":"2024-08-31T05:29:27.835619+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:48:27.716531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"85'4","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.490356+0000","last_change":"2024-08-31T05:27:29.239560+0000","last_active":"2024-08-31T05:28:59.490356+0000","last_peered":"2024-08-31T05:28:59.490356+0000","last_clean":"2024-08-31T05:28:59.490356+0000","last_became_active":"2024-08-31T05:27:29.239154+0000","last_became_peered":"2024-08-31T05:27:29.239154+0000","last_unstale":"2024-08-31T05:28:59.490356+0000","last_undegraded":"2024-08-31T05:28:59.490356+0000","last_fullsized":"2024-08-31T05:28:59.490356+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:29:36.983690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.656620+0000","last_change":"2024-08-31T05:27:38.297596+0000","last_active":"2024-08-31T05:28:59.656620+0000","last_peered":"2024-08-31T05:28:59.656620+0000","last_clean":"2024-08-31T05:28:59.656620+0000","last_became_active":"2024-08-31T05:27:38.295127+0000","last_became_peered":"2024-08-31T05:27:38.295127+0000","last_unstale":"2024-08-31T05:28:59.656620+0000","last_undegraded":"2024-08-31T05:28:59.656620+0000","last_fullsized":"2024-08-31T05:28:59.656620+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:50:09.363872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"87'10","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.850147+0000","last_change":"2024-08-31T05:27:31.262036+0000","last_active":"2024-08-31T05:29:27.850147+0000","last_peered":"2024-08-31T05:29:27.850147+0000","last_clean":"2024-08-31T05:29:27.850147+0000","last_became_active":"2024-08-31T05:27:31.261589+0000","last_became_peered":"2024-08-31T05:27:31.261589+0000","last_unstale":"2024-08-31T05:29:27.850147+0000","last_undegraded":"2024-08-31T05:29:27.850147+0000","last_fullsized":"2024-08-31T05:29:27.850147+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:24:17.677639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"87'6","reported_seq":258,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:57.947962+0000","last_change":"2024-08-31T05:27:29.233381+0000","last_active":"2024-08-31T05:29:57.947962+0000","last_peered":"2024-08-31T05:29:57.947962+0000","last_clean":"2024-08-31T05:29:57.947962+0000","last_became_active":"2024-08-31T05:27:29.232959+0000","last_became_peered":"2024-08-31T05:27:29.232959+0000","last_unstale":"2024-08-31T05:29:57.947962+0000","last_undegraded":"2024-08-31T05:29:57.947962+0000","last_fullsized":"2024-08-31T05:29:57.947962+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:50:16.901373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":212,"num_read_kb":212,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.159306+0000","last_change":"2024-08-31T05:27:38.288798+0000","last_active":"2024-08-31T05:28:59.159306+0000","last_peered":"2024-08-31T05:28:59.159306+0000","last_clean":"2024-08-31T05:28:59.159306+0000","last_became_active":"2024-08-31T05:27:38.288369+0000","last_became_peered":"2024-08-31T05:27:38.288369+0000","last_unstale":"2024-08-31T05:28:59.159306+0000","last_undegraded":"2024-08-31T05:28:59.159306+0000","last_fullsized":"2024-08-31T05:28:59.159306+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:52:45.680480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.660858+0000","last_change":"2024-08-31T05:27:38.290029+0000","last_active":"2024-08-31T05:28:59.660858+0000","last_peered":"2024-08-31T05:28:59.660858+0000","last_clean":"2024-08-31T05:28:59.660858+0000","last_became_active":"2024-08-31T05:27:38.289638+0000","last_became_peered":"2024-08-31T05:27:38.289638+0000","last_unstale":"2024-08-31T05:28:59.660858+0000","last_undegraded":"2024-08-31T05:28:59.660858+0000","last_fullsized":"2024-08-31T05:28:59.660858+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:10:34.521418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"87'11","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.841653+0000","last_change":"2024-08-31T05:27:31.241057+0000","last_active":"2024-08-31T05:29:27.841653+0000","last_peered":"2024-08-31T05:29:27.841653+0000","last_clean":"2024-08-31T05:29:27.841653+0000","last_became_active":"2024-08-31T05:27:31.240660+0000","last_became_peered":"2024-08-31T05:27:31.240660+0000","last_unstale":"2024-08-31T05:29:27.841653+0000","last_undegraded":"2024-08-31T05:29:27.841653+0000","last_fullsized":"2024-08-31T05:29:27.841653+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:16:49.730980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"85'3","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161025+0000","last_change":"2024-08-31T05:27:29.240293+0000","last_active":"2024-08-31T05:28:59.161025+0000","last_peered":"2024-08-31T05:28:59.161025+0000","last_clean":"2024-08-31T05:28:59.161025+0000","last_became_active":"2024-08-31T05:27:29.239889+0000","last_became_peered":"2024-08-31T05:27:29.239889+0000","last_unstale":"2024-08-31T05:28:59.161025+0000","last_undegraded":"2024-08-31T05:28:59.161025+0000","last_fullsized":"2024-08-31T05:28:59.161025+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:20:49.121008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.482071+0000","last_change":"2024-08-31T05:27:38.294174+0000","last_active":"2024-08-31T05:28:59.482071+0000","last_peered":"2024-08-31T05:28:59.482071+0000","last_clean":"2024-08-31T05:28:59.482071+0000","last_became_active":"2024-08-31T05:27:38.293747+0000","last_became_peered":"2024-08-31T05:27:38.293747+0000","last_unstale":"2024-08-31T05:28:59.482071+0000","last_undegraded":"2024-08-31T05:28:59.482071+0000","last_fullsized":"2024-08-31T05:28:59.482071+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:35:46.124473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"87'8","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.841262+0000","last_change":"2024-08-31T05:27:31.244942+0000","last_active":"2024-08-31T05:29:27.841262+0000","last_peered":"2024-08-31T05:29:27.841262+0000","last_clean":"2024-08-31T05:29:27.841262+0000","last_became_active":"2024-08-31T05:27:31.244608+0000","last_became_peered":"2024-08-31T05:27:31.244608+0000","last_unstale":"2024-08-31T05:29:27.841262+0000","last_undegraded":"2024-08-31T05:29:27.841262+0000","last_fullsized":"2024-08-31T05:29:27.841262+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:50:13.651172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"85'3","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161154+0000","last_change":"2024-08-31T05:27:29.236832+0000","last_active":"2024-08-31T05:28:59.161154+0000","last_peered":"2024-08-31T05:28:59.161154+0000","last_clean":"2024-08-31T05:28:59.161154+0000","last_became_active":"2024-08-31T05:27:29.236326+0000","last_became_peered":"2024-08-31T05:27:29.236326+0000","last_unstale":"2024-08-31T05:28:59.161154+0000","last_undegraded":"2024-08-31T05:28:59.161154+0000","last_fullsized":"2024-08-31T05:28:59.161154+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:43:26.199499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"85'7","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.659350+0000","last_change":"2024-08-31T05:27:29.237409+0000","last_active":"2024-08-31T05:28:59.659350+0000","last_peered":"2024-08-31T05:28:59.659350+0000","last_clean":"2024-08-31T05:28:59.659350+0000","last_became_active":"2024-08-31T05:27:29.236928+0000","last_became_peered":"2024-08-31T05:27:29.236928+0000","last_unstale":"2024-08-31T05:28:59.659350+0000","last_undegraded":"2024-08-31T05:28:59.659350+0000","last_fullsized":"2024-08-31T05:28:59.659350+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:07:53.917242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"87'8","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.843647+0000","last_change":"2024-08-31T05:27:31.263005+0000","last_active":"2024-08-31T05:29:27.843647+0000","last_peered":"2024-08-31T05:29:27.843647+0000","last_clean":"2024-08-31T05:29:27.843647+0000","last_became_active":"2024-08-31T05:27:31.262638+0000","last_became_peered":"2024-08-31T05:27:31.262638+0000","last_unstale":"2024-08-31T05:29:27.843647+0000","last_undegraded":"2024-08-31T05:29:27.843647+0000","last_fullsized":"2024-08-31T05:29:27.843647+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:35:06.094346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.661429+0000","last_change":"2024-08-31T05:27:38.293067+0000","last_active":"2024-08-31T05:28:59.661429+0000","last_peered":"2024-08-31T05:28:59.661429+0000","last_clean":"2024-08-31T05:28:59.661429+0000","last_became_active":"2024-08-31T05:27:38.292413+0000","last_became_peered":"2024-08-31T05:27:38.292413+0000","last_unstale":"2024-08-31T05:28:59.661429+0000","last_undegraded":"2024-08-31T05:28:59.661429+0000","last_fullsized":"2024-08-31T05:28:59.661429+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:26:12.248341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"87'7","reported_seq":165,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:58.743101+0000","last_change":"2024-08-31T05:27:58.652458+0000","last_active":"2024-08-31T05:29:58.743101+0000","last_peered":"2024-08-31T05:29:58.743101+0000","last_clean":"2024-08-31T05:29:58.743101+0000","last_became_active":"2024-08-31T05:27:58.652037+0000","last_became_peered":"2024-08-31T05:27:58.652037+0000","last_unstale":"2024-08-31T05:29:58.743101+0000","last_undegraded":"2024-08-31T05:29:58.743101+0000","last_fullsized":"2024-08-31T05:29:58.743101+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:44:45.839429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"87'7","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.832180+0000","last_change":"2024-08-31T05:27:31.253835+0000","last_active":"2024-08-31T05:29:27.832180+0000","last_peered":"2024-08-31T05:29:27.832180+0000","last_clean":"2024-08-31T05:29:27.832180+0000","last_became_active":"2024-08-31T05:27:31.252828+0000","last_became_peered":"2024-08-31T05:27:31.252828+0000","last_unstale":"2024-08-31T05:29:27.832180+0000","last_undegraded":"2024-08-31T05:29:27.832180+0000","last_fullsized":"2024-08-31T05:29:27.832180+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:59:29.987345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.661608+0000","last_change":"2024-08-31T05:27:38.292690+0000","last_active":"2024-08-31T05:28:59.661608+0000","last_peered":"2024-08-31T05:28:59.661608+0000","last_clean":"2024-08-31T05:28:59.661608+0000","last_became_active":"2024-08-31T05:27:38.292195+0000","last_became_peered":"2024-08-31T05:27:38.292195+0000","last_unstale":"2024-08-31T05:28:59.661608+0000","last_undegraded":"2024-08-31T05:28:59.661608+0000","last_fullsized":"2024-08-31T05:28:59.661608+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:50:06.142879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"87'9","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.842588+0000","last_change":"2024-08-31T05:27:31.253706+0000","last_active":"2024-08-31T05:29:27.842588+0000","last_peered":"2024-08-31T05:29:27.842588+0000","last_clean":"2024-08-31T05:29:27.842588+0000","last_became_active":"2024-08-31T05:27:31.253343+0000","last_became_peered":"2024-08-31T05:27:31.253343+0000","last_unstale":"2024-08-31T05:29:27.842588+0000","last_undegraded":"2024-08-31T05:29:27.842588+0000","last_fullsized":"2024-08-31T05:29:27.842588+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:40:28.318153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"87'12","reported_seq":54,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.845099+0000","last_change":"2024-08-31T05:27:58.651669+0000","last_active":"2024-08-31T05:29:27.845099+0000","last_peered":"2024-08-31T05:29:27.845099+0000","last_clean":"2024-08-31T05:29:27.845099+0000","last_became_active":"2024-08-31T05:27:58.651273+0000","last_became_peered":"2024-08-31T05:27:58.651273+0000","last_unstale":"2024-08-31T05:29:27.845099+0000","last_undegraded":"2024-08-31T05:29:27.845099+0000","last_fullsized":"2024-08-31T05:29:27.845099+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:37:42.960124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"87'8","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.843302+0000","last_change":"2024-08-31T05:27:31.257648+0000","last_active":"2024-08-31T05:29:27.843302+0000","last_peered":"2024-08-31T05:29:27.843302+0000","last_clean":"2024-08-31T05:29:27.843302+0000","last_became_active":"2024-08-31T05:27:31.257140+0000","last_became_peered":"2024-08-31T05:27:31.257140+0000","last_unstale":"2024-08-31T05:29:27.843302+0000","last_undegraded":"2024-08-31T05:29:27.843302+0000","last_fullsized":"2024-08-31T05:29:27.843302+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:02:15.249225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"87'7","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.835635+0000","last_change":"2024-08-31T05:27:31.264968+0000","last_active":"2024-08-31T05:29:27.835635+0000","last_peered":"2024-08-31T05:29:27.835635+0000","last_clean":"2024-08-31T05:29:27.835635+0000","last_became_active":"2024-08-31T05:27:31.264629+0000","last_became_peered":"2024-08-31T05:27:31.264629+0000","last_unstale":"2024-08-31T05:29:27.835635+0000","last_undegraded":"2024-08-31T05:29:27.835635+0000","last_fullsized":"2024-08-31T05:29:27.835635+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:28:15.283607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"87'4","reported_seq":39,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.843371+0000","last_change":"2024-08-31T05:27:31.252358+0000","last_active":"2024-08-31T05:29:27.843371+0000","last_peered":"2024-08-31T05:29:27.843371+0000","last_clean":"2024-08-31T05:29:27.843371+0000","last_became_active":"2024-08-31T05:27:31.252013+0000","last_became_peered":"2024-08-31T05:27:31.252013+0000","last_unstale":"2024-08-31T05:29:27.843371+0000","last_undegraded":"2024-08-31T05:29:27.843371+0000","last_fullsized":"2024-08-31T05:29:27.843371+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:48:47.287168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"87'6","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.832448+0000","last_change":"2024-08-31T05:27:31.262626+0000","last_active":"2024-08-31T05:29:27.832448+0000","last_peered":"2024-08-31T05:29:27.832448+0000","last_clean":"2024-08-31T05:29:27.832448+0000","last_became_active":"2024-08-31T05:27:31.262190+0000","last_became_peered":"2024-08-31T05:27:31.262190+0000","last_unstale":"2024-08-31T05:29:27.832448+0000","last_undegraded":"2024-08-31T05:29:27.832448+0000","last_fullsized":"2024-08-31T05:29:27.832448+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:39:19.454606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"87'15","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.849196+0000","last_change":"2024-08-31T05:27:31.254482+0000","last_active":"2024-08-31T05:29:27.849196+0000","last_peered":"2024-08-31T05:29:27.849196+0000","last_clean":"2024-08-31T05:29:27.849196+0000","last_became_active":"2024-08-31T05:27:31.254103+0000","last_became_peered":"2024-08-31T05:27:31.254103+0000","last_unstale":"2024-08-31T05:29:27.849196+0000","last_undegraded":"2024-08-31T05:29:27.849196+0000","last_fullsized":"2024-08-31T05:29:27.849196+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:20:57.333359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"87'2","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.844078+0000","last_change":"2024-08-31T05:27:58.505928+0000","last_active":"2024-08-31T05:29:27.844078+0000","last_peered":"2024-08-31T05:29:27.844078+0000","last_clean":"2024-08-31T05:29:27.844078+0000","last_became_active":"2024-08-31T05:27:58.505527+0000","last_became_peered":"2024-08-31T05:27:58.505527+0000","last_unstale":"2024-08-31T05:29:27.844078+0000","last_undegraded":"2024-08-31T05:29:27.844078+0000","last_fullsized":"2024-08-31T05:29:27.844078+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:44:30.754350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"87'6","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.840063+0000","last_change":"2024-08-31T05:27:31.262385+0000","last_active":"2024-08-31T05:29:27.840063+0000","last_peered":"2024-08-31T05:29:27.840063+0000","last_clean":"2024-08-31T05:29:27.840063+0000","last_became_active":"2024-08-31T05:27:31.262089+0000","last_became_peered":"2024-08-31T05:27:31.262089+0000","last_unstale":"2024-08-31T05:29:27.840063+0000","last_undegraded":"2024-08-31T05:29:27.840063+0000","last_fullsized":"2024-08-31T05:29:27.840063+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:50:17.172462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"87'8","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.844837+0000","last_change":"2024-08-31T05:27:31.249162+0000","last_active":"2024-08-31T05:29:27.844837+0000","last_peered":"2024-08-31T05:29:27.844837+0000","last_clean":"2024-08-31T05:29:27.844837+0000","last_became_active":"2024-08-31T05:27:31.248803+0000","last_became_peered":"2024-08-31T05:27:31.248803+0000","last_unstale":"2024-08-31T05:29:27.844837+0000","last_undegraded":"2024-08-31T05:29:27.844837+0000","last_fullsized":"2024-08-31T05:29:27.844837+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:18:05.449612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"87'10","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.851304+0000","last_change":"2024-08-31T05:27:31.258983+0000","last_active":"2024-08-31T05:29:27.851304+0000","last_peered":"2024-08-31T05:29:27.851304+0000","last_clean":"2024-08-31T05:29:27.851304+0000","last_became_active":"2024-08-31T05:27:31.258480+0000","last_became_peered":"2024-08-31T05:27:31.258480+0000","last_unstale":"2024-08-31T05:29:27.851304+0000","last_undegraded":"2024-08-31T05:29:27.851304+0000","last_fullsized":"2024-08-31T05:29:27.851304+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:57:34.589281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"87'11","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.848762+0000","last_change":"2024-08-31T05:27:31.252561+0000","last_active":"2024-08-31T05:29:27.848762+0000","last_peered":"2024-08-31T05:29:27.848762+0000","last_clean":"2024-08-31T05:29:27.848762+0000","last_became_active":"2024-08-31T05:27:31.251963+0000","last_became_peered":"2024-08-31T05:27:31.251963+0000","last_unstale":"2024-08-31T05:29:27.848762+0000","last_undegraded":"2024-08-31T05:29:27.848762+0000","last_fullsized":"2024-08-31T05:29:27.848762+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:17:45.244329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"87'8","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.838675+0000","last_change":"2024-08-31T05:27:31.257298+0000","last_active":"2024-08-31T05:29:27.838675+0000","last_peered":"2024-08-31T05:29:27.838675+0000","last_clean":"2024-08-31T05:29:27.838675+0000","last_became_active":"2024-08-31T05:27:31.256935+0000","last_became_peered":"2024-08-31T05:27:31.256935+0000","last_unstale":"2024-08-31T05:29:27.838675+0000","last_undegraded":"2024-08-31T05:29:27.838675+0000","last_fullsized":"2024-08-31T05:29:27.838675+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:07:32.876328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"87'7","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.844384+0000","last_change":"2024-08-31T05:27:31.248456+0000","last_active":"2024-08-31T05:29:27.844384+0000","last_peered":"2024-08-31T05:29:27.844384+0000","last_clean":"2024-08-31T05:29:27.844384+0000","last_became_active":"2024-08-31T05:27:31.248060+0000","last_became_peered":"2024-08-31T05:27:31.248060+0000","last_unstale":"2024-08-31T05:29:27.844384+0000","last_undegraded":"2024-08-31T05:29:27.844384+0000","last_fullsized":"2024-08-31T05:29:27.844384+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:29:35.817409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"87'10","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.845826+0000","last_change":"2024-08-31T05:27:31.251345+0000","last_active":"2024-08-31T05:29:27.845826+0000","last_peered":"2024-08-31T05:29:27.845826+0000","last_clean":"2024-08-31T05:29:27.845826+0000","last_became_active":"2024-08-31T05:27:31.251002+0000","last_became_peered":"2024-08-31T05:27:31.251002+0000","last_unstale":"2024-08-31T05:29:27.845826+0000","last_undegraded":"2024-08-31T05:29:27.845826+0000","last_fullsized":"2024-08-31T05:29:27.845826+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:35:24.564897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"87'8","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.850908+0000","last_change":"2024-08-31T05:27:31.260681+0000","last_active":"2024-08-31T05:29:27.850908+0000","last_peered":"2024-08-31T05:29:27.850908+0000","last_clean":"2024-08-31T05:29:27.850908+0000","last_became_active":"2024-08-31T05:27:31.259445+0000","last_became_peered":"2024-08-31T05:27:31.259445+0000","last_unstale":"2024-08-31T05:29:27.850908+0000","last_undegraded":"2024-08-31T05:29:27.850908+0000","last_fullsized":"2024-08-31T05:29:27.850908+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:41:43.480946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"87'9","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.850222+0000","last_change":"2024-08-31T05:27:31.263950+0000","last_active":"2024-08-31T05:29:27.850222+0000","last_peered":"2024-08-31T05:29:27.850222+0000","last_clean":"2024-08-31T05:29:27.850222+0000","last_became_active":"2024-08-31T05:27:31.263568+0000","last_became_peered":"2024-08-31T05:27:31.263568+0000","last_unstale":"2024-08-31T05:29:27.850222+0000","last_undegraded":"2024-08-31T05:29:27.850222+0000","last_fullsized":"2024-08-31T05:29:27.850222+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:50:05.111796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"87'7","reported_seq":49,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.833978+0000","last_change":"2024-08-31T05:27:58.508829+0000","last_active":"2024-08-31T05:29:27.833978+0000","last_peered":"2024-08-31T05:29:27.833978+0000","last_clean":"2024-08-31T05:29:27.833978+0000","last_became_active":"2024-08-31T05:27:58.508378+0000","last_became_peered":"2024-08-31T05:27:58.508378+0000","last_unstale":"2024-08-31T05:29:27.833978+0000","last_undegraded":"2024-08-31T05:29:27.833978+0000","last_fullsized":"2024-08-31T05:29:27.833978+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:05:46.254003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"87'7","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.832512+0000","last_change":"2024-08-31T05:27:31.261012+0000","last_active":"2024-08-31T05:29:27.832512+0000","last_peered":"2024-08-31T05:29:27.832512+0000","last_clean":"2024-08-31T05:29:27.832512+0000","last_became_active":"2024-08-31T05:27:31.259373+0000","last_became_peered":"2024-08-31T05:27:31.259373+0000","last_unstale":"2024-08-31T05:29:27.832512+0000","last_undegraded":"2024-08-31T05:29:27.832512+0000","last_fullsized":"2024-08-31T05:29:27.832512+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:15:34.711961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"87'10","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.827232+0000","last_change":"2024-08-31T05:27:31.255199+0000","last_active":"2024-08-31T05:29:27.827232+0000","last_peered":"2024-08-31T05:29:27.827232+0000","last_clean":"2024-08-31T05:29:27.827232+0000","last_became_active":"2024-08-31T05:27:31.254833+0000","last_became_peered":"2024-08-31T05:27:31.254833+0000","last_unstale":"2024-08-31T05:29:27.827232+0000","last_undegraded":"2024-08-31T05:29:27.827232+0000","last_fullsized":"2024-08-31T05:29:27.827232+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:55:09.426531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"87'7","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.843236+0000","last_change":"2024-08-31T05:27:31.264881+0000","last_active":"2024-08-31T05:29:27.843236+0000","last_peered":"2024-08-31T05:29:27.843236+0000","last_clean":"2024-08-31T05:29:27.843236+0000","last_became_active":"2024-08-31T05:27:31.264483+0000","last_became_peered":"2024-08-31T05:27:31.264483+0000","last_unstale":"2024-08-31T05:29:27.843236+0000","last_undegraded":"2024-08-31T05:29:27.843236+0000","last_fullsized":"2024-08-31T05:29:27.843236+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:48:55.193321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"87'6","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.850856+0000","last_change":"2024-08-31T05:27:31.258555+0000","last_active":"2024-08-31T05:29:27.850856+0000","last_peered":"2024-08-31T05:29:27.850856+0000","last_clean":"2024-08-31T05:29:27.850856+0000","last_became_active":"2024-08-31T05:27:31.258023+0000","last_became_peered":"2024-08-31T05:27:31.258023+0000","last_unstale":"2024-08-31T05:29:27.850856+0000","last_undegraded":"2024-08-31T05:29:27.850856+0000","last_fullsized":"2024-08-31T05:29:27.850856+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:26:34.911641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"87'16","reported_seq":51,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.845099+0000","last_change":"2024-08-31T05:27:31.249886+0000","last_active":"2024-08-31T05:29:27.845099+0000","last_peered":"2024-08-31T05:29:27.845099+0000","last_clean":"2024-08-31T05:29:27.845099+0000","last_became_active":"2024-08-31T05:27:31.248549+0000","last_became_peered":"2024-08-31T05:27:31.248549+0000","last_unstale":"2024-08-31T05:29:27.845099+0000","last_undegraded":"2024-08-31T05:29:27.845099+0000","last_fullsized":"2024-08-31T05:29:27.845099+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:57:55.743286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"87'11","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.850202+0000","last_change":"2024-08-31T05:27:31.261697+0000","last_active":"2024-08-31T05:29:27.850202+0000","last_peered":"2024-08-31T05:29:27.850202+0000","last_clean":"2024-08-31T05:29:27.850202+0000","last_became_active":"2024-08-31T05:27:31.260398+0000","last_became_peered":"2024-08-31T05:27:31.260398+0000","last_unstale":"2024-08-31T05:29:27.850202+0000","last_undegraded":"2024-08-31T05:29:27.850202+0000","last_fullsized":"2024-08-31T05:29:27.850202+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:08:03.999556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"87'9","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.844401+0000","last_change":"2024-08-31T05:27:31.256638+0000","last_active":"2024-08-31T05:29:27.844401+0000","last_peered":"2024-08-31T05:29:27.844401+0000","last_clean":"2024-08-31T05:29:27.844401+0000","last_became_active":"2024-08-31T05:27:31.256302+0000","last_became_peered":"2024-08-31T05:27:31.256302+0000","last_unstale":"2024-08-31T05:29:27.844401+0000","last_undegraded":"2024-08-31T05:29:27.844401+0000","last_fullsized":"2024-08-31T05:29:27.844401+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:31:58.946448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"87'5","reported_seq":40,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.841699+0000","last_change":"2024-08-31T05:27:31.253818+0000","last_active":"2024-08-31T05:29:27.841699+0000","last_peered":"2024-08-31T05:29:27.841699+0000","last_clean":"2024-08-31T05:29:27.841699+0000","last_became_active":"2024-08-31T05:27:31.253423+0000","last_became_peered":"2024-08-31T05:27:31.253423+0000","last_unstale":"2024-08-31T05:29:27.841699+0000","last_undegraded":"2024-08-31T05:29:27.841699+0000","last_fullsized":"2024-08-31T05:29:27.841699+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:45:43.951022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"87'6","reported_seq":40,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.835914+0000","last_change":"2024-08-31T05:27:31.247171+0000","last_active":"2024-08-31T05:29:27.835914+0000","last_peered":"2024-08-31T05:29:27.835914+0000","last_clean":"2024-08-31T05:29:27.835914+0000","last_became_active":"2024-08-31T05:27:31.246791+0000","last_became_peered":"2024-08-31T05:27:31.246791+0000","last_unstale":"2024-08-31T05:29:27.835914+0000","last_undegraded":"2024-08-31T05:29:27.835914+0000","last_fullsized":"2024-08-31T05:29:27.835914+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:26:12.163389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"87'4","reported_seq":39,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.845282+0000","last_change":"2024-08-31T05:27:31.257848+0000","last_active":"2024-08-31T05:29:27.845282+0000","last_peered":"2024-08-31T05:29:27.845282+0000","last_clean":"2024-08-31T05:29:27.845282+0000","last_became_active":"2024-08-31T05:27:31.257432+0000","last_became_peered":"2024-08-31T05:27:31.257432+0000","last_unstale":"2024-08-31T05:29:27.845282+0000","last_undegraded":"2024-08-31T05:29:27.845282+0000","last_fullsized":"2024-08-31T05:29:27.845282+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:08:12.512834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"87'8","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.844807+0000","last_change":"2024-08-31T05:27:31.263998+0000","last_active":"2024-08-31T05:29:27.844807+0000","last_peered":"2024-08-31T05:29:27.844807+0000","last_clean":"2024-08-31T05:29:27.844807+0000","last_became_active":"2024-08-31T05:27:31.263638+0000","last_became_peered":"2024-08-31T05:27:31.263638+0000","last_unstale":"2024-08-31T05:29:27.844807+0000","last_undegraded":"2024-08-31T05:29:27.844807+0000","last_fullsized":"2024-08-31T05:29:27.844807+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:07:50.470538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"87'7","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.834442+0000","last_change":"2024-08-31T05:27:31.260600+0000","last_active":"2024-08-31T05:29:27.834442+0000","last_peered":"2024-08-31T05:29:27.834442+0000","last_clean":"2024-08-31T05:29:27.834442+0000","last_became_active":"2024-08-31T05:27:31.259605+0000","last_became_peered":"2024-08-31T05:27:31.259605+0000","last_unstale":"2024-08-31T05:29:27.834442+0000","last_undegraded":"2024-08-31T05:29:27.834442+0000","last_fullsized":"2024-08-31T05:29:27.834442+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:04:16.861879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"87'4","reported_seq":39,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.834461+0000","last_change":"2024-08-31T05:27:31.256585+0000","last_active":"2024-08-31T05:29:27.834461+0000","last_peered":"2024-08-31T05:29:27.834461+0000","last_clean":"2024-08-31T05:29:27.834461+0000","last_became_active":"2024-08-31T05:27:31.256118+0000","last_became_peered":"2024-08-31T05:27:31.256118+0000","last_unstale":"2024-08-31T05:29:27.834461+0000","last_undegraded":"2024-08-31T05:29:27.834461+0000","last_fullsized":"2024-08-31T05:29:27.834461+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:47:18.891150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"87'8","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.850683+0000","last_change":"2024-08-31T05:27:31.260321+0000","last_active":"2024-08-31T05:29:27.850683+0000","last_peered":"2024-08-31T05:29:27.850683+0000","last_clean":"2024-08-31T05:29:27.850683+0000","last_became_active":"2024-08-31T05:27:31.259901+0000","last_became_peered":"2024-08-31T05:27:31.259901+0000","last_unstale":"2024-08-31T05:29:27.850683+0000","last_undegraded":"2024-08-31T05:29:27.850683+0000","last_fullsized":"2024-08-31T05:29:27.850683+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:44:26.651338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":76578,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1112,"num_read_kb":639,"num_write":270,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":229734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":232,"ondisk_log_size":232,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":280617,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678060,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36288,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708864,"statfs":{"total":95995035648,"available":95957876736,"internally_reserved":0,"allocated":966656,"data_stored":509871,"data_compressed":29581,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874289,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36440,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708712,"statfs":{"total":95995035648,"available":95957721088,"internally_reserved":0,"allocated":1122304,"data_stored":1164606,"data_compressed":65266,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037814,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36316,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708836,"statfs":{"total":95995035648,"available":95957848064,"internally_reserved":0,"allocated":995328,"data_stored":513506,"data_compressed":29581,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234043,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":978944,"data_stored":509116,"data_compressed":29581,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430272,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1040384,"data_stored":1107266,"data_compressed":65266,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593797,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":505446,"data_compressed":29581,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790027,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36368,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708784,"statfs":{"total":95995035648,"available":95957794816,"internally_reserved":0,"allocated":1048576,"data_stored":1102008,"data_compressed":65266,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953552,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":510450,"data_compressed":29581,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149781,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":978944,"data_stored":504622,"data_compressed":29581,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378714,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36372,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708780,"statfs":{"total":95995035648,"available":95957790720,"internally_reserved":0,"allocated":1052672,"data_stored":574326,"data_compressed":29581,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542239,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36368,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708784,"statfs":{"total":95995035648,"available":95957794816,"internally_reserved":0,"allocated":1048576,"data_stored":575541,"data_compressed":29581,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705764,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36312,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708840,"statfs":{"total":95995035648,"available":95957852160,"internally_reserved":0,"allocated":991232,"data_stored":506761,"data_compressed":29581,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34064,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34064,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34064,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":71349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":70134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":70437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T05:30:01.739 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-31T05:30:01.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:01 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/1712842685' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:30:01.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.882+0000 7fe62f839640 1 -- 172.21.15.5:0/1835197788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6281089f0 msgr2=0x7fe62810f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.882+0000 7fe62f839640 1 --2- 172.21.15.5:0/1835197788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6281089f0 0x7fe62810f220 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fe620009ca0 tx=0x7fe62002a8e0 comp rx=0 tx=0).stop 2024-08-31T05:30:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.882+0000 7fe62f839640 1 -- 172.21.15.5:0/1835197788 shutdown_connections 2024-08-31T05:30:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.882+0000 7fe62f839640 1 --2- 172.21.15.5:0/1835197788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6281089f0 0x7fe62810f220 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.882+0000 7fe62f839640 1 --2- 172.21.15.5:0/1835197788 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6281080a0 0x7fe6281084b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.882+0000 7fe62f839640 1 --2- 172.21.15.5:0/1835197788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe628102e80 0x7fe628103290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.882+0000 7fe62f839640 1 -- 172.21.15.5:0/1835197788 >> 172.21.15.5:0/1835197788 conn(0x7fe628079ac0 msgr2=0x7fe628079ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.883+0000 7fe62f839640 1 -- 172.21.15.5:0/1835197788 shutdown_connections 2024-08-31T05:30:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.883+0000 7fe62f839640 1 -- 172.21.15.5:0/1835197788 wait complete. 2024-08-31T05:30:01.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.883+0000 7fe62f839640 1 Processor -- start 2024-08-31T05:30:01.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.883+0000 7fe62f839640 1 -- start start 2024-08-31T05:30:01.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.883+0000 7fe62f839640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe628102e80 0x7fe62819b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:01.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.883+0000 7fe62f839640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6281080a0 0x7fe62819b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:01.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.883+0000 7fe62f839640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6281089f0 0x7fe62819bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:01.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.883+0000 7fe62f839640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe6281126f0 con 0x7fe6281080a0 2024-08-31T05:30:01.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.883+0000 7fe62f839640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe628112570 con 0x7fe6281089f0 2024-08-31T05:30:01.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.883+0000 7fe62f839640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe628112870 con 0x7fe628102e80 2024-08-31T05:30:01.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.884+0000 7fe62cdd4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6281080a0 0x7fe62819b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:01.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.884+0000 7fe62cdd4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6281080a0 0x7fe62819b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33410/0 (socket says 172.21.15.5:33410) 2024-08-31T05:30:01.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.884+0000 7fe62cdd4640 1 -- 172.21.15.5:0/724344223 learned_addr learned my addr 172.21.15.5:0/724344223 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:01.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.884+0000 7fe62ddd6640 1 --2- 172.21.15.5:0/724344223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6281089f0 0x7fe62819bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:01.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.884+0000 7fe62d5d5640 1 --2- 172.21.15.5:0/724344223 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe628102e80 0x7fe62819b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:01.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.884+0000 7fe62cdd4640 1 -- 172.21.15.5:0/724344223 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe628102e80 msgr2=0x7fe62819b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:01.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.884+0000 7fe62cdd4640 1 --2- 172.21.15.5:0/724344223 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe628102e80 0x7fe62819b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:01.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.884+0000 7fe62cdd4640 1 -- 172.21.15.5:0/724344223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6281089f0 msgr2=0x7fe62819bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:01.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.884+0000 7fe62cdd4640 1 --2- 172.21.15.5:0/724344223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6281089f0 0x7fe62819bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:01.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.884+0000 7fe62cdd4640 1 -- 172.21.15.5:0/724344223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6281a6330 con 0x7fe6281080a0 2024-08-31T05:30:01.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.884+0000 7fe62cdd4640 1 --2- 172.21.15.5:0/724344223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6281080a0 0x7fe62819b5e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fe618006fd0 tx=0x7fe61800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:01.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.884+0000 7fe61e7fc640 1 -- 172.21.15.5:0/724344223 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe618011830 con 0x7fe6281080a0 2024-08-31T05:30:01.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.884+0000 7fe62f839640 1 -- 172.21.15.5:0/724344223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6281a6620 con 0x7fe6281080a0 2024-08-31T05:30:01.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.884+0000 7fe61e7fc640 1 -- 172.21.15.5:0/724344223 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe618016070 con 0x7fe6281080a0 2024-08-31T05:30:01.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.884+0000 7fe61e7fc640 1 -- 172.21.15.5:0/724344223 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe618010e00 con 0x7fe6281080a0 2024-08-31T05:30:01.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.884+0000 7fe62f839640 1 -- 172.21.15.5:0/724344223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6281a6b70 con 0x7fe6281080a0 2024-08-31T05:30:01.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.886+0000 7fe62f839640 1 -- 172.21.15.5:0/724344223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe62806b4c0 con 0x7fe6281080a0 2024-08-31T05:30:01.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.887+0000 7fe61e7fc640 1 -- 172.21.15.5:0/724344223 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 23) ==== 152644+0+0 (secure 0 0 0) 0x7fe61801b460 con 0x7fe6281080a0 2024-08-31T05:30:01.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.888+0000 7fe61e7fc640 1 --2- 172.21.15.5:0/724344223 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe6140b4c10 0x7fe6140b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:01.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.888+0000 7fe62d5d5640 1 --2- 172.21.15.5:0/724344223 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe6140b4c10 0x7fe6140b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:01.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.889+0000 7fe61e7fc640 1 -- 172.21.15.5:0/724344223 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fe6180e5390 con 0x7fe6281080a0 2024-08-31T05:30:01.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.889+0000 7fe62d5d5640 1 --2- 172.21.15.5:0/724344223 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe6140b4c10 0x7fe6140b7120 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe624005fd0 tx=0x7fe624005e40 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:01.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:01.892+0000 7fe61e7fc640 1 -- 172.21.15.5:0/724344223 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe6180abec0 con 0x7fe6281080a0 2024-08-31T05:30:01.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:01 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/1712842685' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:30:02.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.073+0000 7fe62f839640 1 -- 172.21.15.5:0/724344223 --> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe6280635a0 con 0x7fe6140b4c10 2024-08-31T05:30:02.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.079+0000 7fe61e7fc640 1 -- 172.21.15.5:0/724344223 <== mgr.14220 v2:172.21.15.5:6800/2696053609 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340795 (secure 0 0 0) 0x7fe6280635a0 con 0x7fe6140b4c10 2024-08-31T05:30:02.085 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:30:02.086 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-31T05:30:02.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.082+0000 7fe62f839640 1 -- 172.21.15.5:0/724344223 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe6140b4c10 msgr2=0x7fe6140b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:02.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.082+0000 7fe62f839640 1 --2- 172.21.15.5:0/724344223 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe6140b4c10 0x7fe6140b7120 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe624005fd0 tx=0x7fe624005e40 comp rx=0 tx=0).stop 2024-08-31T05:30:02.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.082+0000 7fe62f839640 1 -- 172.21.15.5:0/724344223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6281080a0 msgr2=0x7fe62819b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:02.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.082+0000 7fe62f839640 1 --2- 172.21.15.5:0/724344223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6281080a0 0x7fe62819b5e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fe618006fd0 tx=0x7fe61800b8e0 comp rx=0 tx=0).stop 2024-08-31T05:30:02.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.082+0000 7fe62f839640 1 -- 172.21.15.5:0/724344223 shutdown_connections 2024-08-31T05:30:02.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.082+0000 7fe62f839640 1 --2- 172.21.15.5:0/724344223 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe6140b4c10 0x7fe6140b7120 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:02.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.082+0000 7fe62f839640 1 --2- 172.21.15.5:0/724344223 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe6281089f0 0x7fe62819bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:02.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.082+0000 7fe62f839640 1 --2- 172.21.15.5:0/724344223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6281080a0 0x7fe62819b5e0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:02.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.082+0000 7fe62f839640 1 --2- 172.21.15.5:0/724344223 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe628102e80 0x7fe62819b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:02.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.082+0000 7fe62f839640 1 -- 172.21.15.5:0/724344223 >> 172.21.15.5:0/724344223 conn(0x7fe628079ac0 msgr2=0x7fe6281060f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:02.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.082+0000 7fe62f839640 1 -- 172.21.15.5:0/724344223 shutdown_connections 2024-08-31T05:30:02.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.082+0000 7fe62f839640 1 -- 172.21.15.5:0/724344223 wait complete. 2024-08-31T05:30:02.096 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":347,"stamp":"2024-08-31T05:30:01.480396+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":667180,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1193,"num_read_kb":708,"num_write":395,"num_write_kb":2316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":2952422,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":826,"ondisk_log_size":826,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":402736,"kb_used_data":11888,"kb_used_omap":18,"kb_used_meta":390637,"kb_avail":1124539088,"statfs":{"total":1151940427776,"available":1151528026112,"internally_reserved":0,"allocated":12173312,"data_stored":8083519,"data_compressed":462027,"data_compressed_allocated":626688,"data_compressed_original":2752512,"omap_allocated":19141,"internal_metadata":400012603},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6771,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":59,"num_write":12,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003981"},"pg_stats":[{"pgid":"2.1f","version":"87'14","reported_seq":173,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:55.736631+0000","last_change":"2024-08-31T05:27:58.511927+0000","last_active":"2024-08-31T05:29:55.736631+0000","last_peered":"2024-08-31T05:29:55.736631+0000","last_clean":"2024-08-31T05:29:55.736631+0000","last_became_active":"2024-08-31T05:27:58.507111+0000","last_became_peered":"2024-08-31T05:27:58.507111+0000","last_unstale":"2024-08-31T05:29:55.736631+0000","last_undegraded":"2024-08-31T05:29:55.736631+0000","last_fullsized":"2024-08-31T05:29:55.736631+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:42:09.078048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"87'5","reported_seq":40,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.844363+0000","last_change":"2024-08-31T05:27:31.255221+0000","last_active":"2024-08-31T05:29:27.844363+0000","last_peered":"2024-08-31T05:29:27.844363+0000","last_clean":"2024-08-31T05:29:27.844363+0000","last_became_active":"2024-08-31T05:27:31.254684+0000","last_became_peered":"2024-08-31T05:27:31.254684+0000","last_unstale":"2024-08-31T05:29:27.844363+0000","last_undegraded":"2024-08-31T05:29:27.844363+0000","last_fullsized":"2024-08-31T05:29:27.844363+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:34:22.517485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.661502+0000","last_change":"2024-08-31T05:27:38.293857+0000","last_active":"2024-08-31T05:28:59.661502+0000","last_peered":"2024-08-31T05:28:59.661502+0000","last_clean":"2024-08-31T05:28:59.661502+0000","last_became_active":"2024-08-31T05:27:38.292763+0000","last_became_peered":"2024-08-31T05:27:38.292763+0000","last_unstale":"2024-08-31T05:28:59.661502+0000","last_undegraded":"2024-08-31T05:28:59.661502+0000","last_fullsized":"2024-08-31T05:28:59.661502+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:53:27.187697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.159933+0000","last_change":"2024-08-31T05:27:29.281010+0000","last_active":"2024-08-31T05:28:59.159933+0000","last_peered":"2024-08-31T05:28:59.159933+0000","last_clean":"2024-08-31T05:28:59.159933+0000","last_became_active":"2024-08-31T05:27:29.280625+0000","last_became_peered":"2024-08-31T05:27:29.280625+0000","last_unstale":"2024-08-31T05:28:59.159933+0000","last_undegraded":"2024-08-31T05:28:59.159933+0000","last_fullsized":"2024-08-31T05:28:59.159933+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:09:25.542564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"87'6","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.849664+0000","last_change":"2024-08-31T05:27:31.258052+0000","last_active":"2024-08-31T05:29:27.849664+0000","last_peered":"2024-08-31T05:29:27.849664+0000","last_clean":"2024-08-31T05:29:27.849664+0000","last_became_active":"2024-08-31T05:27:31.257549+0000","last_became_peered":"2024-08-31T05:27:31.257549+0000","last_unstale":"2024-08-31T05:29:27.849664+0000","last_undegraded":"2024-08-31T05:29:27.849664+0000","last_fullsized":"2024-08-31T05:29:27.849664+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:14:21.552372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.160234+0000","last_change":"2024-08-31T05:27:38.300359+0000","last_active":"2024-08-31T05:28:59.160234+0000","last_peered":"2024-08-31T05:28:59.160234+0000","last_clean":"2024-08-31T05:28:59.160234+0000","last_became_active":"2024-08-31T05:27:38.299704+0000","last_became_peered":"2024-08-31T05:27:38.299704+0000","last_unstale":"2024-08-31T05:28:59.160234+0000","last_undegraded":"2024-08-31T05:28:59.160234+0000","last_fullsized":"2024-08-31T05:28:59.160234+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:06:50.500384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"85'12","reported_seq":53,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.165905+0000","last_change":"2024-08-31T05:27:29.240652+0000","last_active":"2024-08-31T05:28:59.165905+0000","last_peered":"2024-08-31T05:28:59.165905+0000","last_clean":"2024-08-31T05:28:59.165905+0000","last_became_active":"2024-08-31T05:27:29.239432+0000","last_became_peered":"2024-08-31T05:27:29.239432+0000","last_unstale":"2024-08-31T05:28:59.165905+0000","last_undegraded":"2024-08-31T05:28:59.165905+0000","last_fullsized":"2024-08-31T05:28:59.165905+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:49:56.506299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"87'9","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.849658+0000","last_change":"2024-08-31T05:27:31.261784+0000","last_active":"2024-08-31T05:29:27.849658+0000","last_peered":"2024-08-31T05:29:27.849658+0000","last_clean":"2024-08-31T05:29:27.849658+0000","last_became_active":"2024-08-31T05:27:31.260045+0000","last_became_peered":"2024-08-31T05:27:31.260045+0000","last_unstale":"2024-08-31T05:29:27.849658+0000","last_undegraded":"2024-08-31T05:29:27.849658+0000","last_fullsized":"2024-08-31T05:29:27.849658+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:18:30.044052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.661334+0000","last_change":"2024-08-31T05:28:59.661205+0000","last_active":"2024-08-31T05:28:59.661334+0000","last_peered":"2024-08-31T05:28:59.661334+0000","last_clean":"2024-08-31T05:28:59.661334+0000","last_became_active":"2024-08-31T05:28:59.660637+0000","last_became_peered":"2024-08-31T05:28:59.660637+0000","last_unstale":"2024-08-31T05:28:59.661334+0000","last_undegraded":"2024-08-31T05:28:59.661334+0000","last_fullsized":"2024-08-31T05:28:59.661334+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:18:21.507475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,10],"acting":[4,3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"85'5","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.165866+0000","last_change":"2024-08-31T05:27:29.240341+0000","last_active":"2024-08-31T05:28:59.165866+0000","last_peered":"2024-08-31T05:28:59.165866+0000","last_clean":"2024-08-31T05:28:59.165866+0000","last_became_active":"2024-08-31T05:27:29.239944+0000","last_became_peered":"2024-08-31T05:27:29.239944+0000","last_unstale":"2024-08-31T05:28:59.165866+0000","last_undegraded":"2024-08-31T05:28:59.165866+0000","last_fullsized":"2024-08-31T05:28:59.165866+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:58:19.747559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"87'15","reported_seq":49,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.851465+0000","last_change":"2024-08-31T05:27:31.265116+0000","last_active":"2024-08-31T05:29:27.851465+0000","last_peered":"2024-08-31T05:29:27.851465+0000","last_clean":"2024-08-31T05:29:27.851465+0000","last_became_active":"2024-08-31T05:27:31.264725+0000","last_became_peered":"2024-08-31T05:27:31.264725+0000","last_unstale":"2024-08-31T05:29:27.851465+0000","last_undegraded":"2024-08-31T05:29:27.851465+0000","last_fullsized":"2024-08-31T05:29:27.851465+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:44:45.831881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.160399+0000","last_change":"2024-08-31T05:27:38.298634+0000","last_active":"2024-08-31T05:28:59.160399+0000","last_peered":"2024-08-31T05:28:59.160399+0000","last_clean":"2024-08-31T05:28:59.160399+0000","last_became_active":"2024-08-31T05:27:38.298143+0000","last_became_peered":"2024-08-31T05:27:38.298143+0000","last_unstale":"2024-08-31T05:28:59.160399+0000","last_undegraded":"2024-08-31T05:28:59.160399+0000","last_fullsized":"2024-08-31T05:28:59.160399+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:51:25.639441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"87'5","reported_seq":40,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.851171+0000","last_change":"2024-08-31T05:27:31.259981+0000","last_active":"2024-08-31T05:29:27.851171+0000","last_peered":"2024-08-31T05:29:27.851171+0000","last_clean":"2024-08-31T05:29:27.851171+0000","last_became_active":"2024-08-31T05:27:31.259584+0000","last_became_peered":"2024-08-31T05:27:31.259584+0000","last_unstale":"2024-08-31T05:29:27.851171+0000","last_undegraded":"2024-08-31T05:29:27.851171+0000","last_fullsized":"2024-08-31T05:29:27.851171+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:52:29.853977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.481776+0000","last_change":"2024-08-31T05:27:58.514065+0000","last_active":"2024-08-31T05:28:59.481776+0000","last_peered":"2024-08-31T05:28:59.481776+0000","last_clean":"2024-08-31T05:28:59.481776+0000","last_became_active":"2024-08-31T05:27:58.506011+0000","last_became_peered":"2024-08-31T05:27:58.506011+0000","last_unstale":"2024-08-31T05:28:59.481776+0000","last_undegraded":"2024-08-31T05:28:59.481776+0000","last_fullsized":"2024-08-31T05:28:59.481776+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:25:55.610965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.160810+0000","last_change":"2024-08-31T05:27:38.293265+0000","last_active":"2024-08-31T05:28:59.160810+0000","last_peered":"2024-08-31T05:28:59.160810+0000","last_clean":"2024-08-31T05:28:59.160810+0000","last_became_active":"2024-08-31T05:27:38.292736+0000","last_became_peered":"2024-08-31T05:27:38.292736+0000","last_unstale":"2024-08-31T05:28:59.160810+0000","last_undegraded":"2024-08-31T05:28:59.160810+0000","last_fullsized":"2024-08-31T05:28:59.160810+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:51:25.853365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"87'8","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.843426+0000","last_change":"2024-08-31T05:27:31.252479+0000","last_active":"2024-08-31T05:29:27.843426+0000","last_peered":"2024-08-31T05:29:27.843426+0000","last_clean":"2024-08-31T05:29:27.843426+0000","last_became_active":"2024-08-31T05:27:31.252126+0000","last_became_peered":"2024-08-31T05:27:31.252126+0000","last_unstale":"2024-08-31T05:29:27.843426+0000","last_undegraded":"2024-08-31T05:29:27.843426+0000","last_fullsized":"2024-08-31T05:29:27.843426+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:24:40.864240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"87'4","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.481819+0000","last_change":"2024-08-31T05:27:58.508588+0000","last_active":"2024-08-31T05:28:59.481819+0000","last_peered":"2024-08-31T05:28:59.481819+0000","last_clean":"2024-08-31T05:28:59.481819+0000","last_became_active":"2024-08-31T05:27:58.508024+0000","last_became_peered":"2024-08-31T05:27:58.508024+0000","last_unstale":"2024-08-31T05:28:59.481819+0000","last_undegraded":"2024-08-31T05:28:59.481819+0000","last_fullsized":"2024-08-31T05:28:59.481819+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:32:33.222909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"85'1","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.160825+0000","last_change":"2024-08-31T05:27:38.299506+0000","last_active":"2024-08-31T05:28:59.160825+0000","last_peered":"2024-08-31T05:28:59.160825+0000","last_clean":"2024-08-31T05:28:59.160825+0000","last_became_active":"2024-08-31T05:27:38.298756+0000","last_became_peered":"2024-08-31T05:27:38.298756+0000","last_unstale":"2024-08-31T05:28:59.160825+0000","last_undegraded":"2024-08-31T05:28:59.160825+0000","last_fullsized":"2024-08-31T05:28:59.160825+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:25:18.115727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"87'9","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.842533+0000","last_change":"2024-08-31T05:27:31.249220+0000","last_active":"2024-08-31T05:29:27.842533+0000","last_peered":"2024-08-31T05:29:27.842533+0000","last_clean":"2024-08-31T05:29:27.842533+0000","last_became_active":"2024-08-31T05:27:31.248869+0000","last_became_peered":"2024-08-31T05:27:31.248869+0000","last_unstale":"2024-08-31T05:29:27.842533+0000","last_undegraded":"2024-08-31T05:29:27.842533+0000","last_fullsized":"2024-08-31T05:29:27.842533+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:43:13.463903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"85'7","reported_seq":47,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.159564+0000","last_change":"2024-08-31T05:27:29.235278+0000","last_active":"2024-08-31T05:28:59.159564+0000","last_peered":"2024-08-31T05:28:59.159564+0000","last_clean":"2024-08-31T05:28:59.159564+0000","last_became_active":"2024-08-31T05:27:29.234929+0000","last_became_peered":"2024-08-31T05:27:29.234929+0000","last_unstale":"2024-08-31T05:28:59.159564+0000","last_undegraded":"2024-08-31T05:28:59.159564+0000","last_fullsized":"2024-08-31T05:28:59.159564+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:49:55.867542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.657185+0000","last_change":"2024-08-31T05:27:38.293903+0000","last_active":"2024-08-31T05:28:59.657185+0000","last_peered":"2024-08-31T05:28:59.657185+0000","last_clean":"2024-08-31T05:28:59.657185+0000","last_became_active":"2024-08-31T05:27:38.290471+0000","last_became_peered":"2024-08-31T05:27:38.290471+0000","last_unstale":"2024-08-31T05:28:59.657185+0000","last_undegraded":"2024-08-31T05:28:59.657185+0000","last_fullsized":"2024-08-31T05:28:59.657185+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:04:36.573302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"87'2","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.838859+0000","last_change":"2024-08-31T05:27:31.252038+0000","last_active":"2024-08-31T05:29:27.838859+0000","last_peered":"2024-08-31T05:29:27.838859+0000","last_clean":"2024-08-31T05:29:27.838859+0000","last_became_active":"2024-08-31T05:27:31.251630+0000","last_became_peered":"2024-08-31T05:27:31.251630+0000","last_unstale":"2024-08-31T05:29:27.838859+0000","last_undegraded":"2024-08-31T05:29:27.838859+0000","last_fullsized":"2024-08-31T05:29:27.838859+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:10:39.778057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.662029+0000","last_change":"2024-08-31T05:27:29.280978+0000","last_active":"2024-08-31T05:28:59.662029+0000","last_peered":"2024-08-31T05:28:59.662029+0000","last_clean":"2024-08-31T05:28:59.662029+0000","last_became_active":"2024-08-31T05:27:29.280524+0000","last_became_peered":"2024-08-31T05:27:29.280524+0000","last_unstale":"2024-08-31T05:28:59.662029+0000","last_undegraded":"2024-08-31T05:28:59.662029+0000","last_fullsized":"2024-08-31T05:28:59.662029+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:56:57.441801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161183+0000","last_change":"2024-08-31T05:27:38.300947+0000","last_active":"2024-08-31T05:28:59.161183+0000","last_peered":"2024-08-31T05:28:59.161183+0000","last_clean":"2024-08-31T05:28:59.161183+0000","last_became_active":"2024-08-31T05:27:38.300044+0000","last_became_peered":"2024-08-31T05:27:38.300044+0000","last_unstale":"2024-08-31T05:28:59.161183+0000","last_undegraded":"2024-08-31T05:28:59.161183+0000","last_fullsized":"2024-08-31T05:28:59.161183+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:33:05.081601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"87'7","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.842303+0000","last_change":"2024-08-31T05:27:31.257782+0000","last_active":"2024-08-31T05:29:27.842303+0000","last_peered":"2024-08-31T05:29:27.842303+0000","last_clean":"2024-08-31T05:29:27.842303+0000","last_became_active":"2024-08-31T05:27:31.257360+0000","last_became_peered":"2024-08-31T05:27:31.257360+0000","last_unstale":"2024-08-31T05:29:27.842303+0000","last_undegraded":"2024-08-31T05:29:27.842303+0000","last_fullsized":"2024-08-31T05:29:27.842303+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:58:11.249925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"85'7","reported_seq":48,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161269+0000","last_change":"2024-08-31T05:27:29.392664+0000","last_active":"2024-08-31T05:28:59.161269+0000","last_peered":"2024-08-31T05:28:59.161269+0000","last_clean":"2024-08-31T05:28:59.161269+0000","last_became_active":"2024-08-31T05:27:29.392208+0000","last_became_peered":"2024-08-31T05:27:29.392208+0000","last_unstale":"2024-08-31T05:28:59.161269+0000","last_undegraded":"2024-08-31T05:28:59.161269+0000","last_fullsized":"2024-08-31T05:28:59.161269+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:51:34.981168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.661752+0000","last_change":"2024-08-31T05:27:38.293556+0000","last_active":"2024-08-31T05:28:59.661752+0000","last_peered":"2024-08-31T05:28:59.661752+0000","last_clean":"2024-08-31T05:28:59.661752+0000","last_became_active":"2024-08-31T05:27:38.292338+0000","last_became_peered":"2024-08-31T05:27:38.292338+0000","last_unstale":"2024-08-31T05:28:59.661752+0000","last_undegraded":"2024-08-31T05:28:59.661752+0000","last_fullsized":"2024-08-31T05:28:59.661752+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:13:46.376934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"87'5","reported_seq":40,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.842964+0000","last_change":"2024-08-31T05:27:31.247408+0000","last_active":"2024-08-31T05:29:27.842964+0000","last_peered":"2024-08-31T05:29:27.842964+0000","last_clean":"2024-08-31T05:29:27.842964+0000","last_became_active":"2024-08-31T05:27:31.247034+0000","last_became_peered":"2024-08-31T05:27:31.247034+0000","last_unstale":"2024-08-31T05:29:27.842964+0000","last_undegraded":"2024-08-31T05:29:27.842964+0000","last_fullsized":"2024-08-31T05:29:27.842964+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:42:08.350054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"87'17","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:42.487425+0000","last_change":"2024-08-31T05:27:29.235941+0000","last_active":"2024-08-31T05:29:42.487425+0000","last_peered":"2024-08-31T05:29:42.487425+0000","last_clean":"2024-08-31T05:29:42.487425+0000","last_became_active":"2024-08-31T05:27:29.235561+0000","last_became_peered":"2024-08-31T05:27:29.235561+0000","last_unstale":"2024-08-31T05:29:42.487425+0000","last_undegraded":"2024-08-31T05:29:42.487425+0000","last_fullsized":"2024-08-31T05:29:42.487425+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:29:34.551748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.159114+0000","last_change":"2024-08-31T05:27:38.286960+0000","last_active":"2024-08-31T05:28:59.159114+0000","last_peered":"2024-08-31T05:28:59.159114+0000","last_clean":"2024-08-31T05:28:59.159114+0000","last_became_active":"2024-08-31T05:27:38.286537+0000","last_became_peered":"2024-08-31T05:27:38.286537+0000","last_unstale":"2024-08-31T05:28:59.159114+0000","last_undegraded":"2024-08-31T05:28:59.159114+0000","last_fullsized":"2024-08-31T05:28:59.159114+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:55:00.656676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"87'9","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.842094+0000","last_change":"2024-08-31T05:27:31.245901+0000","last_active":"2024-08-31T05:29:27.842094+0000","last_peered":"2024-08-31T05:29:27.842094+0000","last_clean":"2024-08-31T05:29:27.842094+0000","last_became_active":"2024-08-31T05:27:31.245534+0000","last_became_peered":"2024-08-31T05:27:31.245534+0000","last_unstale":"2024-08-31T05:29:27.842094+0000","last_undegraded":"2024-08-31T05:29:27.842094+0000","last_fullsized":"2024-08-31T05:29:27.842094+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:26:35.876033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"85'4","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.166037+0000","last_change":"2024-08-31T05:27:29.280767+0000","last_active":"2024-08-31T05:28:59.166037+0000","last_peered":"2024-08-31T05:28:59.166037+0000","last_clean":"2024-08-31T05:28:59.166037+0000","last_became_active":"2024-08-31T05:27:29.280334+0000","last_became_peered":"2024-08-31T05:27:29.280334+0000","last_unstale":"2024-08-31T05:28:59.166037+0000","last_undegraded":"2024-08-31T05:28:59.166037+0000","last_fullsized":"2024-08-31T05:28:59.166037+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:25:20.250205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.481848+0000","last_change":"2024-08-31T05:27:38.296846+0000","last_active":"2024-08-31T05:28:59.481848+0000","last_peered":"2024-08-31T05:28:59.481848+0000","last_clean":"2024-08-31T05:28:59.481848+0000","last_became_active":"2024-08-31T05:27:38.295516+0000","last_became_peered":"2024-08-31T05:27:38.295516+0000","last_unstale":"2024-08-31T05:28:59.481848+0000","last_undegraded":"2024-08-31T05:28:59.481848+0000","last_fullsized":"2024-08-31T05:28:59.481848+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:30:51.110144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"87'4","reported_seq":39,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.822866+0000","last_change":"2024-08-31T05:27:31.246481+0000","last_active":"2024-08-31T05:29:27.822866+0000","last_peered":"2024-08-31T05:29:27.822866+0000","last_clean":"2024-08-31T05:29:27.822866+0000","last_became_active":"2024-08-31T05:27:31.246079+0000","last_became_peered":"2024-08-31T05:27:31.246079+0000","last_unstale":"2024-08-31T05:29:27.822866+0000","last_undegraded":"2024-08-31T05:29:27.822866+0000","last_fullsized":"2024-08-31T05:29:27.822866+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:25:42.536251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"85'1","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.656957+0000","last_change":"2024-08-31T05:27:29.281078+0000","last_active":"2024-08-31T05:28:59.656957+0000","last_peered":"2024-08-31T05:28:59.656957+0000","last_clean":"2024-08-31T05:28:59.656957+0000","last_became_active":"2024-08-31T05:27:29.280674+0000","last_became_peered":"2024-08-31T05:27:29.280674+0000","last_unstale":"2024-08-31T05:28:59.656957+0000","last_undegraded":"2024-08-31T05:28:59.656957+0000","last_fullsized":"2024-08-31T05:28:59.656957+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:04:03.576077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.664703+0000","last_change":"2024-08-31T05:28:59.664061+0000","last_active":"2024-08-31T05:28:59.664703+0000","last_peered":"2024-08-31T05:28:59.664703+0000","last_clean":"2024-08-31T05:28:59.664703+0000","last_became_active":"2024-08-31T05:28:59.663495+0000","last_became_peered":"2024-08-31T05:28:59.663495+0000","last_unstale":"2024-08-31T05:28:59.664703+0000","last_undegraded":"2024-08-31T05:28:59.664703+0000","last_fullsized":"2024-08-31T05:28:59.664703+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:51:38.112492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"87'7","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.835248+0000","last_change":"2024-08-31T05:27:31.251011+0000","last_active":"2024-08-31T05:29:27.835248+0000","last_peered":"2024-08-31T05:29:27.835248+0000","last_clean":"2024-08-31T05:29:27.835248+0000","last_became_active":"2024-08-31T05:27:31.250597+0000","last_became_peered":"2024-08-31T05:27:31.250597+0000","last_unstale":"2024-08-31T05:29:27.835248+0000","last_undegraded":"2024-08-31T05:29:27.835248+0000","last_fullsized":"2024-08-31T05:29:27.835248+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:13:30.858395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"87'7","reported_seq":158,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:58.742129+0000","last_change":"2024-08-31T05:27:29.242137+0000","last_active":"2024-08-31T05:29:58.742129+0000","last_peered":"2024-08-31T05:29:58.742129+0000","last_clean":"2024-08-31T05:29:58.742129+0000","last_became_active":"2024-08-31T05:27:29.241460+0000","last_became_peered":"2024-08-31T05:27:29.241460+0000","last_unstale":"2024-08-31T05:29:58.742129+0000","last_undegraded":"2024-08-31T05:29:58.742129+0000","last_fullsized":"2024-08-31T05:29:58.742129+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:40:59.174572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161959+0000","last_change":"2024-08-31T05:27:38.288643+0000","last_active":"2024-08-31T05:28:59.161959+0000","last_peered":"2024-08-31T05:28:59.161959+0000","last_clean":"2024-08-31T05:28:59.161959+0000","last_became_active":"2024-08-31T05:27:38.288235+0000","last_became_peered":"2024-08-31T05:27:38.288235+0000","last_unstale":"2024-08-31T05:28:59.161959+0000","last_undegraded":"2024-08-31T05:28:59.161959+0000","last_fullsized":"2024-08-31T05:28:59.161959+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:23:49.090990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"87'8","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.844926+0000","last_change":"2024-08-31T05:27:31.263326+0000","last_active":"2024-08-31T05:29:27.844926+0000","last_peered":"2024-08-31T05:29:27.844926+0000","last_clean":"2024-08-31T05:29:27.844926+0000","last_became_active":"2024-08-31T05:27:31.262864+0000","last_became_peered":"2024-08-31T05:27:31.262864+0000","last_unstale":"2024-08-31T05:29:27.844926+0000","last_undegraded":"2024-08-31T05:29:27.844926+0000","last_fullsized":"2024-08-31T05:29:27.844926+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:34:21.159545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"87'6","reported_seq":154,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:57.740976+0000","last_change":"2024-08-31T05:27:29.280829+0000","last_active":"2024-08-31T05:29:57.740976+0000","last_peered":"2024-08-31T05:29:57.740976+0000","last_clean":"2024-08-31T05:29:57.740976+0000","last_became_active":"2024-08-31T05:27:29.280469+0000","last_became_peered":"2024-08-31T05:27:29.280469+0000","last_unstale":"2024-08-31T05:29:57.740976+0000","last_undegraded":"2024-08-31T05:29:57.740976+0000","last_fullsized":"2024-08-31T05:29:57.740976+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:16:59.559680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":108,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.162010+0000","last_change":"2024-08-31T05:27:38.290175+0000","last_active":"2024-08-31T05:28:59.162010+0000","last_peered":"2024-08-31T05:28:59.162010+0000","last_clean":"2024-08-31T05:28:59.162010+0000","last_became_active":"2024-08-31T05:27:38.289228+0000","last_became_peered":"2024-08-31T05:27:38.289228+0000","last_unstale":"2024-08-31T05:28:59.162010+0000","last_undegraded":"2024-08-31T05:28:59.162010+0000","last_fullsized":"2024-08-31T05:28:59.162010+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:26:07.251711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"87'5","reported_seq":40,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.842311+0000","last_change":"2024-08-31T05:27:31.245446+0000","last_active":"2024-08-31T05:29:27.842311+0000","last_peered":"2024-08-31T05:29:27.842311+0000","last_clean":"2024-08-31T05:29:27.842311+0000","last_became_active":"2024-08-31T05:27:31.245099+0000","last_became_peered":"2024-08-31T05:27:31.245099+0000","last_unstale":"2024-08-31T05:29:27.842311+0000","last_undegraded":"2024-08-31T05:29:27.842311+0000","last_fullsized":"2024-08-31T05:29:27.842311+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:18:17.876796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'4","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.489895+0000","last_change":"2024-08-31T05:27:29.241333+0000","last_active":"2024-08-31T05:28:59.489895+0000","last_peered":"2024-08-31T05:28:59.489895+0000","last_clean":"2024-08-31T05:28:59.489895+0000","last_became_active":"2024-08-31T05:27:29.240963+0000","last_became_peered":"2024-08-31T05:27:29.240963+0000","last_unstale":"2024-08-31T05:28:59.489895+0000","last_undegraded":"2024-08-31T05:28:59.489895+0000","last_fullsized":"2024-08-31T05:28:59.489895+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:22:06.442824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161183+0000","last_change":"2024-08-31T05:27:38.287640+0000","last_active":"2024-08-31T05:28:59.161183+0000","last_peered":"2024-08-31T05:28:59.161183+0000","last_clean":"2024-08-31T05:28:59.161183+0000","last_became_active":"2024-08-31T05:27:38.286191+0000","last_became_peered":"2024-08-31T05:27:38.286191+0000","last_unstale":"2024-08-31T05:28:59.161183+0000","last_undegraded":"2024-08-31T05:28:59.161183+0000","last_fullsized":"2024-08-31T05:28:59.161183+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:57:23.535841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"87'8","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.845569+0000","last_change":"2024-08-31T05:27:58.506945+0000","last_active":"2024-08-31T05:29:27.845569+0000","last_peered":"2024-08-31T05:29:27.845569+0000","last_clean":"2024-08-31T05:29:27.845569+0000","last_became_active":"2024-08-31T05:27:58.506505+0000","last_became_peered":"2024-08-31T05:27:58.506505+0000","last_unstale":"2024-08-31T05:29:27.845569+0000","last_undegraded":"2024-08-31T05:29:27.845569+0000","last_fullsized":"2024-08-31T05:29:27.845569+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:16:09.541579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"85'6","reported_seq":49,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161730+0000","last_change":"2024-08-31T05:27:29.238351+0000","last_active":"2024-08-31T05:28:59.161730+0000","last_peered":"2024-08-31T05:28:59.161730+0000","last_clean":"2024-08-31T05:28:59.161730+0000","last_became_active":"2024-08-31T05:27:29.237940+0000","last_became_peered":"2024-08-31T05:27:29.237940+0000","last_unstale":"2024-08-31T05:28:59.161730+0000","last_undegraded":"2024-08-31T05:28:59.161730+0000","last_fullsized":"2024-08-31T05:28:59.161730+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:55:08.048966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":114,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.489971+0000","last_change":"2024-08-31T05:26:14.183718+0000","last_active":"2024-08-31T05:28:59.489971+0000","last_peered":"2024-08-31T05:28:59.489971+0000","last_clean":"2024-08-31T05:28:59.489971+0000","last_became_active":"2024-08-31T05:26:14.178188+0000","last_became_peered":"2024-08-31T05:26:14.178188+0000","last_unstale":"2024-08-31T05:28:59.489971+0000","last_undegraded":"2024-08-31T05:28:59.489971+0000","last_fullsized":"2024-08-31T05:28:59.489971+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:22:50.516233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:22:50.516233+0000","last_clean_scrub_stamp":"2024-08-31T05:22:50.516233+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:10:01.719715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"85'1","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.490285+0000","last_change":"2024-08-31T05:27:38.289721+0000","last_active":"2024-08-31T05:28:59.490285+0000","last_peered":"2024-08-31T05:28:59.490285+0000","last_clean":"2024-08-31T05:28:59.490285+0000","last_became_active":"2024-08-31T05:27:38.289165+0000","last_became_peered":"2024-08-31T05:27:38.289165+0000","last_unstale":"2024-08-31T05:28:59.490285+0000","last_undegraded":"2024-08-31T05:28:59.490285+0000","last_fullsized":"2024-08-31T05:28:59.490285+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:00:30.689093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"87'7","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.850881+0000","last_change":"2024-08-31T05:27:31.256262+0000","last_active":"2024-08-31T05:29:27.850881+0000","last_peered":"2024-08-31T05:29:27.850881+0000","last_clean":"2024-08-31T05:29:27.850881+0000","last_became_active":"2024-08-31T05:27:31.255644+0000","last_became_peered":"2024-08-31T05:27:31.255644+0000","last_unstale":"2024-08-31T05:29:27.850881+0000","last_undegraded":"2024-08-31T05:29:27.850881+0000","last_fullsized":"2024-08-31T05:29:27.850881+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:50:18.158645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"87'6","reported_seq":156,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:58.783099+0000","last_change":"2024-08-31T05:27:29.392666+0000","last_active":"2024-08-31T05:29:58.783099+0000","last_peered":"2024-08-31T05:29:58.783099+0000","last_clean":"2024-08-31T05:29:58.783099+0000","last_became_active":"2024-08-31T05:27:29.392153+0000","last_became_peered":"2024-08-31T05:27:29.392153+0000","last_unstale":"2024-08-31T05:29:58.783099+0000","last_undegraded":"2024-08-31T05:29:58.783099+0000","last_fullsized":"2024-08-31T05:29:58.783099+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:53:02.713022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":110,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.662591+0000","last_change":"2024-08-31T05:27:38.291459+0000","last_active":"2024-08-31T05:28:59.662591+0000","last_peered":"2024-08-31T05:28:59.662591+0000","last_clean":"2024-08-31T05:28:59.662591+0000","last_became_active":"2024-08-31T05:27:38.291013+0000","last_became_peered":"2024-08-31T05:27:38.291013+0000","last_unstale":"2024-08-31T05:28:59.662591+0000","last_undegraded":"2024-08-31T05:28:59.662591+0000","last_fullsized":"2024-08-31T05:28:59.662591+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:03:46.921137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"87'6","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.843678+0000","last_change":"2024-08-31T05:27:31.251641+0000","last_active":"2024-08-31T05:29:27.843678+0000","last_peered":"2024-08-31T05:29:27.843678+0000","last_clean":"2024-08-31T05:29:27.843678+0000","last_became_active":"2024-08-31T05:27:31.251242+0000","last_became_peered":"2024-08-31T05:27:31.251242+0000","last_unstale":"2024-08-31T05:29:27.843678+0000","last_undegraded":"2024-08-31T05:29:27.843678+0000","last_fullsized":"2024-08-31T05:29:27.843678+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:13:58.227136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'3","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161695+0000","last_change":"2024-08-31T05:27:29.238028+0000","last_active":"2024-08-31T05:28:59.161695+0000","last_peered":"2024-08-31T05:28:59.161695+0000","last_clean":"2024-08-31T05:28:59.161695+0000","last_became_active":"2024-08-31T05:27:29.237449+0000","last_became_peered":"2024-08-31T05:27:29.237449+0000","last_unstale":"2024-08-31T05:28:59.161695+0000","last_undegraded":"2024-08-31T05:28:59.161695+0000","last_fullsized":"2024-08-31T05:28:59.161695+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:13:15.447707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.660720+0000","last_change":"2024-08-31T05:27:38.294072+0000","last_active":"2024-08-31T05:28:59.660720+0000","last_peered":"2024-08-31T05:28:59.660720+0000","last_clean":"2024-08-31T05:28:59.660720+0000","last_became_active":"2024-08-31T05:27:38.293642+0000","last_became_peered":"2024-08-31T05:27:38.293642+0000","last_unstale":"2024-08-31T05:28:59.660720+0000","last_undegraded":"2024-08-31T05:28:59.660720+0000","last_fullsized":"2024-08-31T05:28:59.660720+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:57:41.854799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"87'9","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.848174+0000","last_change":"2024-08-31T05:27:31.253601+0000","last_active":"2024-08-31T05:29:27.848174+0000","last_peered":"2024-08-31T05:29:27.848174+0000","last_clean":"2024-08-31T05:29:27.848174+0000","last_became_active":"2024-08-31T05:27:31.253216+0000","last_became_peered":"2024-08-31T05:27:31.253216+0000","last_unstale":"2024-08-31T05:29:27.848174+0000","last_undegraded":"2024-08-31T05:29:27.848174+0000","last_fullsized":"2024-08-31T05:29:27.848174+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:46:12.757944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'5","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.162336+0000","last_change":"2024-08-31T05:27:29.236851+0000","last_active":"2024-08-31T05:28:59.162336+0000","last_peered":"2024-08-31T05:28:59.162336+0000","last_clean":"2024-08-31T05:28:59.162336+0000","last_became_active":"2024-08-31T05:27:29.236473+0000","last_became_peered":"2024-08-31T05:27:29.236473+0000","last_unstale":"2024-08-31T05:28:59.162336+0000","last_undegraded":"2024-08-31T05:28:59.162336+0000","last_fullsized":"2024-08-31T05:28:59.162336+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:01:23.838417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.160555+0000","last_change":"2024-08-31T05:27:38.290069+0000","last_active":"2024-08-31T05:28:59.160555+0000","last_peered":"2024-08-31T05:28:59.160555+0000","last_clean":"2024-08-31T05:28:59.160555+0000","last_became_active":"2024-08-31T05:27:38.289507+0000","last_became_peered":"2024-08-31T05:27:38.289507+0000","last_unstale":"2024-08-31T05:28:59.160555+0000","last_undegraded":"2024-08-31T05:28:59.160555+0000","last_fullsized":"2024-08-31T05:28:59.160555+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:24:33.326308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"87'5","reported_seq":40,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.836667+0000","last_change":"2024-08-31T05:27:31.252787+0000","last_active":"2024-08-31T05:29:27.836667+0000","last_peered":"2024-08-31T05:29:27.836667+0000","last_clean":"2024-08-31T05:29:27.836667+0000","last_became_active":"2024-08-31T05:27:31.252392+0000","last_became_peered":"2024-08-31T05:27:31.252392+0000","last_unstale":"2024-08-31T05:29:27.836667+0000","last_undegraded":"2024-08-31T05:29:27.836667+0000","last_fullsized":"2024-08-31T05:29:27.836667+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:47:06.613616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.166232+0000","last_change":"2024-08-31T05:27:29.240293+0000","last_active":"2024-08-31T05:28:59.166232+0000","last_peered":"2024-08-31T05:28:59.166232+0000","last_clean":"2024-08-31T05:28:59.166232+0000","last_became_active":"2024-08-31T05:27:29.239889+0000","last_became_peered":"2024-08-31T05:27:29.239889+0000","last_unstale":"2024-08-31T05:28:59.166232+0000","last_undegraded":"2024-08-31T05:28:59.166232+0000","last_fullsized":"2024-08-31T05:28:59.166232+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:55:03.524475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.160798+0000","last_change":"2024-08-31T05:27:38.290715+0000","last_active":"2024-08-31T05:28:59.160798+0000","last_peered":"2024-08-31T05:28:59.160798+0000","last_clean":"2024-08-31T05:28:59.160798+0000","last_became_active":"2024-08-31T05:27:38.290227+0000","last_became_peered":"2024-08-31T05:27:38.290227+0000","last_unstale":"2024-08-31T05:28:59.160798+0000","last_undegraded":"2024-08-31T05:28:59.160798+0000","last_fullsized":"2024-08-31T05:28:59.160798+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:09:38.349046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"87'6","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.850824+0000","last_change":"2024-08-31T05:27:31.265672+0000","last_active":"2024-08-31T05:29:27.850824+0000","last_peered":"2024-08-31T05:29:27.850824+0000","last_clean":"2024-08-31T05:29:27.850824+0000","last_became_active":"2024-08-31T05:27:31.265332+0000","last_became_peered":"2024-08-31T05:27:31.265332+0000","last_unstale":"2024-08-31T05:29:27.850824+0000","last_undegraded":"2024-08-31T05:29:27.850824+0000","last_fullsized":"2024-08-31T05:29:27.850824+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:45:01.868256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"85'17","reported_seq":58,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.165237+0000","last_change":"2024-08-31T05:27:29.281129+0000","last_active":"2024-08-31T05:28:59.165237+0000","last_peered":"2024-08-31T05:28:59.165237+0000","last_clean":"2024-08-31T05:28:59.165237+0000","last_became_active":"2024-08-31T05:27:29.280613+0000","last_became_peered":"2024-08-31T05:27:29.280613+0000","last_unstale":"2024-08-31T05:28:59.165237+0000","last_undegraded":"2024-08-31T05:28:59.165237+0000","last_fullsized":"2024-08-31T05:28:59.165237+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:17:28.103371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.483707+0000","last_change":"2024-08-31T05:28:59.483629+0000","last_active":"2024-08-31T05:28:59.483707+0000","last_peered":"2024-08-31T05:28:59.483707+0000","last_clean":"2024-08-31T05:28:59.483707+0000","last_became_active":"2024-08-31T05:28:59.483102+0000","last_became_peered":"2024-08-31T05:28:59.483102+0000","last_unstale":"2024-08-31T05:28:59.483707+0000","last_undegraded":"2024-08-31T05:28:59.483707+0000","last_fullsized":"2024-08-31T05:28:59.483707+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:54:18.587227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,8,11],"acting":[6,3,8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"87'6","reported_seq":48,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.847968+0000","last_change":"2024-08-31T05:27:58.505480+0000","last_active":"2024-08-31T05:29:27.847968+0000","last_peered":"2024-08-31T05:29:27.847968+0000","last_clean":"2024-08-31T05:29:27.847968+0000","last_became_active":"2024-08-31T05:27:58.504773+0000","last_became_peered":"2024-08-31T05:27:58.504773+0000","last_unstale":"2024-08-31T05:29:27.847968+0000","last_undegraded":"2024-08-31T05:29:27.847968+0000","last_fullsized":"2024-08-31T05:29:27.847968+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:48:59.979443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"87'6","reported_seq":156,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:57.741512+0000","last_change":"2024-08-31T05:27:29.239308+0000","last_active":"2024-08-31T05:29:57.741512+0000","last_peered":"2024-08-31T05:29:57.741512+0000","last_clean":"2024-08-31T05:29:57.741512+0000","last_became_active":"2024-08-31T05:27:29.238793+0000","last_became_peered":"2024-08-31T05:27:29.238793+0000","last_unstale":"2024-08-31T05:29:57.741512+0000","last_undegraded":"2024-08-31T05:29:57.741512+0000","last_fullsized":"2024-08-31T05:29:57.741512+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:20:47.837021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":896,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":111,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.657165+0000","last_change":"2024-08-31T05:27:38.287260+0000","last_active":"2024-08-31T05:28:59.657165+0000","last_peered":"2024-08-31T05:28:59.657165+0000","last_clean":"2024-08-31T05:28:59.657165+0000","last_became_active":"2024-08-31T05:27:38.286250+0000","last_became_peered":"2024-08-31T05:27:38.286250+0000","last_unstale":"2024-08-31T05:28:59.657165+0000","last_undegraded":"2024-08-31T05:28:59.657165+0000","last_fullsized":"2024-08-31T05:28:59.657165+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:17:55.530114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"87'15","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.848492+0000","last_change":"2024-08-31T05:27:31.251152+0000","last_active":"2024-08-31T05:29:27.848492+0000","last_peered":"2024-08-31T05:29:27.848492+0000","last_clean":"2024-08-31T05:29:27.848492+0000","last_became_active":"2024-08-31T05:27:31.250686+0000","last_became_peered":"2024-08-31T05:27:31.250686+0000","last_unstale":"2024-08-31T05:29:27.848492+0000","last_undegraded":"2024-08-31T05:29:27.848492+0000","last_fullsized":"2024-08-31T05:29:27.848492+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:03:37.359332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"85'5","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161004+0000","last_change":"2024-08-31T05:27:29.237404+0000","last_active":"2024-08-31T05:28:59.161004+0000","last_peered":"2024-08-31T05:28:59.161004+0000","last_clean":"2024-08-31T05:28:59.161004+0000","last_became_active":"2024-08-31T05:27:29.236695+0000","last_became_peered":"2024-08-31T05:27:29.236695+0000","last_unstale":"2024-08-31T05:28:59.161004+0000","last_undegraded":"2024-08-31T05:28:59.161004+0000","last_fullsized":"2024-08-31T05:28:59.161004+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:25:05.174288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.481921+0000","last_change":"2024-08-31T05:27:38.296553+0000","last_active":"2024-08-31T05:28:59.481921+0000","last_peered":"2024-08-31T05:28:59.481921+0000","last_clean":"2024-08-31T05:28:59.481921+0000","last_became_active":"2024-08-31T05:27:38.296118+0000","last_became_peered":"2024-08-31T05:27:38.296118+0000","last_unstale":"2024-08-31T05:28:59.481921+0000","last_undegraded":"2024-08-31T05:28:59.481921+0000","last_fullsized":"2024-08-31T05:28:59.481921+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:10:41.334260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"87'9","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.846961+0000","last_change":"2024-08-31T05:27:31.250584+0000","last_active":"2024-08-31T05:29:27.846961+0000","last_peered":"2024-08-31T05:29:27.846961+0000","last_clean":"2024-08-31T05:29:27.846961+0000","last_became_active":"2024-08-31T05:27:31.250234+0000","last_became_peered":"2024-08-31T05:27:31.250234+0000","last_unstale":"2024-08-31T05:29:27.846961+0000","last_undegraded":"2024-08-31T05:29:27.846961+0000","last_fullsized":"2024-08-31T05:29:27.846961+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:00:39.648236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"85'9","reported_seq":51,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.661583+0000","last_change":"2024-08-31T05:27:29.237956+0000","last_active":"2024-08-31T05:28:59.661583+0000","last_peered":"2024-08-31T05:28:59.661583+0000","last_clean":"2024-08-31T05:28:59.661583+0000","last_became_active":"2024-08-31T05:27:29.237510+0000","last_became_peered":"2024-08-31T05:27:29.237510+0000","last_unstale":"2024-08-31T05:28:59.661583+0000","last_undegraded":"2024-08-31T05:28:59.661583+0000","last_fullsized":"2024-08-31T05:28:59.661583+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:18:44.295298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161323+0000","last_change":"2024-08-31T05:27:38.289472+0000","last_active":"2024-08-31T05:28:59.161323+0000","last_peered":"2024-08-31T05:28:59.161323+0000","last_clean":"2024-08-31T05:28:59.161323+0000","last_became_active":"2024-08-31T05:27:38.288809+0000","last_became_peered":"2024-08-31T05:27:38.288809+0000","last_unstale":"2024-08-31T05:28:59.161323+0000","last_undegraded":"2024-08-31T05:28:59.161323+0000","last_fullsized":"2024-08-31T05:28:59.161323+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:17:06.430110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"87'6","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.839029+0000","last_change":"2024-08-31T05:27:31.258103+0000","last_active":"2024-08-31T05:29:27.839029+0000","last_peered":"2024-08-31T05:29:27.839029+0000","last_clean":"2024-08-31T05:29:27.839029+0000","last_became_active":"2024-08-31T05:27:31.257257+0000","last_became_peered":"2024-08-31T05:27:31.257257+0000","last_unstale":"2024-08-31T05:29:27.839029+0000","last_undegraded":"2024-08-31T05:29:27.839029+0000","last_fullsized":"2024-08-31T05:29:27.839029+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:16:01.309646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"87'42","reported_seq":305,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:57.742069+0000","last_change":"2024-08-31T05:27:29.241129+0000","last_active":"2024-08-31T05:29:57.742069+0000","last_peered":"2024-08-31T05:29:57.742069+0000","last_clean":"2024-08-31T05:29:57.742069+0000","last_became_active":"2024-08-31T05:27:29.240708+0000","last_became_peered":"2024-08-31T05:27:29.240708+0000","last_unstale":"2024-08-31T05:29:57.742069+0000","last_undegraded":"2024-08-31T05:29:57.742069+0000","last_fullsized":"2024-08-31T05:29:57.742069+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:20:10.127588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68393,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":223,"num_read_kb":179,"num_write":44,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.656811+0000","last_change":"2024-08-31T05:27:38.291037+0000","last_active":"2024-08-31T05:28:59.656811+0000","last_peered":"2024-08-31T05:28:59.656811+0000","last_clean":"2024-08-31T05:28:59.656811+0000","last_became_active":"2024-08-31T05:27:38.290592+0000","last_became_peered":"2024-08-31T05:27:38.290592+0000","last_unstale":"2024-08-31T05:28:59.656811+0000","last_undegraded":"2024-08-31T05:28:59.656811+0000","last_fullsized":"2024-08-31T05:28:59.656811+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:12:56.391784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"87'11","reported_seq":53,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.851259+0000","last_change":"2024-08-31T05:27:58.508403+0000","last_active":"2024-08-31T05:29:27.851259+0000","last_peered":"2024-08-31T05:29:27.851259+0000","last_clean":"2024-08-31T05:29:27.851259+0000","last_became_active":"2024-08-31T05:27:58.507918+0000","last_became_peered":"2024-08-31T05:27:58.507918+0000","last_unstale":"2024-08-31T05:29:27.851259+0000","last_undegraded":"2024-08-31T05:29:27.851259+0000","last_fullsized":"2024-08-31T05:29:27.851259+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:47:54.479249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,7],"acting":[1,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"85'5","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161566+0000","last_change":"2024-08-31T05:27:29.281231+0000","last_active":"2024-08-31T05:28:59.161566+0000","last_peered":"2024-08-31T05:28:59.161566+0000","last_clean":"2024-08-31T05:28:59.161566+0000","last_became_active":"2024-08-31T05:27:29.280748+0000","last_became_peered":"2024-08-31T05:27:29.280748+0000","last_unstale":"2024-08-31T05:28:59.161566+0000","last_undegraded":"2024-08-31T05:28:59.161566+0000","last_fullsized":"2024-08-31T05:28:59.161566+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:43:44.783595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.664495+0000","last_change":"2024-08-31T05:28:59.663824+0000","last_active":"2024-08-31T05:28:59.664495+0000","last_peered":"2024-08-31T05:28:59.664495+0000","last_clean":"2024-08-31T05:28:59.664495+0000","last_became_active":"2024-08-31T05:28:59.663270+0000","last_became_peered":"2024-08-31T05:28:59.663270+0000","last_unstale":"2024-08-31T05:28:59.664495+0000","last_undegraded":"2024-08-31T05:28:59.664495+0000","last_fullsized":"2024-08-31T05:28:59.664495+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:23:26.836655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"87'9","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.835619+0000","last_change":"2024-08-31T05:27:31.258030+0000","last_active":"2024-08-31T05:29:27.835619+0000","last_peered":"2024-08-31T05:29:27.835619+0000","last_clean":"2024-08-31T05:29:27.835619+0000","last_became_active":"2024-08-31T05:27:31.257410+0000","last_became_peered":"2024-08-31T05:27:31.257410+0000","last_unstale":"2024-08-31T05:29:27.835619+0000","last_undegraded":"2024-08-31T05:29:27.835619+0000","last_fullsized":"2024-08-31T05:29:27.835619+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:48:27.716531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"85'4","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.490356+0000","last_change":"2024-08-31T05:27:29.239560+0000","last_active":"2024-08-31T05:28:59.490356+0000","last_peered":"2024-08-31T05:28:59.490356+0000","last_clean":"2024-08-31T05:28:59.490356+0000","last_became_active":"2024-08-31T05:27:29.239154+0000","last_became_peered":"2024-08-31T05:27:29.239154+0000","last_unstale":"2024-08-31T05:28:59.490356+0000","last_undegraded":"2024-08-31T05:28:59.490356+0000","last_fullsized":"2024-08-31T05:28:59.490356+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:29:36.983690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.656620+0000","last_change":"2024-08-31T05:27:38.297596+0000","last_active":"2024-08-31T05:28:59.656620+0000","last_peered":"2024-08-31T05:28:59.656620+0000","last_clean":"2024-08-31T05:28:59.656620+0000","last_became_active":"2024-08-31T05:27:38.295127+0000","last_became_peered":"2024-08-31T05:27:38.295127+0000","last_unstale":"2024-08-31T05:28:59.656620+0000","last_undegraded":"2024-08-31T05:28:59.656620+0000","last_fullsized":"2024-08-31T05:28:59.656620+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:50:09.363872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"87'10","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.850147+0000","last_change":"2024-08-31T05:27:31.262036+0000","last_active":"2024-08-31T05:29:27.850147+0000","last_peered":"2024-08-31T05:29:27.850147+0000","last_clean":"2024-08-31T05:29:27.850147+0000","last_became_active":"2024-08-31T05:27:31.261589+0000","last_became_peered":"2024-08-31T05:27:31.261589+0000","last_unstale":"2024-08-31T05:29:27.850147+0000","last_undegraded":"2024-08-31T05:29:27.850147+0000","last_fullsized":"2024-08-31T05:29:27.850147+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:24:17.677639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"87'6","reported_seq":258,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:57.947962+0000","last_change":"2024-08-31T05:27:29.233381+0000","last_active":"2024-08-31T05:29:57.947962+0000","last_peered":"2024-08-31T05:29:57.947962+0000","last_clean":"2024-08-31T05:29:57.947962+0000","last_became_active":"2024-08-31T05:27:29.232959+0000","last_became_peered":"2024-08-31T05:27:29.232959+0000","last_unstale":"2024-08-31T05:29:57.947962+0000","last_undegraded":"2024-08-31T05:29:57.947962+0000","last_fullsized":"2024-08-31T05:29:57.947962+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:50:16.901373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":212,"num_read_kb":212,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.159306+0000","last_change":"2024-08-31T05:27:38.288798+0000","last_active":"2024-08-31T05:28:59.159306+0000","last_peered":"2024-08-31T05:28:59.159306+0000","last_clean":"2024-08-31T05:28:59.159306+0000","last_became_active":"2024-08-31T05:27:38.288369+0000","last_became_peered":"2024-08-31T05:27:38.288369+0000","last_unstale":"2024-08-31T05:28:59.159306+0000","last_undegraded":"2024-08-31T05:28:59.159306+0000","last_fullsized":"2024-08-31T05:28:59.159306+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:52:45.680480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.660858+0000","last_change":"2024-08-31T05:27:38.290029+0000","last_active":"2024-08-31T05:28:59.660858+0000","last_peered":"2024-08-31T05:28:59.660858+0000","last_clean":"2024-08-31T05:28:59.660858+0000","last_became_active":"2024-08-31T05:27:38.289638+0000","last_became_peered":"2024-08-31T05:27:38.289638+0000","last_unstale":"2024-08-31T05:28:59.660858+0000","last_undegraded":"2024-08-31T05:28:59.660858+0000","last_fullsized":"2024-08-31T05:28:59.660858+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:10:34.521418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"87'11","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.841653+0000","last_change":"2024-08-31T05:27:31.241057+0000","last_active":"2024-08-31T05:29:27.841653+0000","last_peered":"2024-08-31T05:29:27.841653+0000","last_clean":"2024-08-31T05:29:27.841653+0000","last_became_active":"2024-08-31T05:27:31.240660+0000","last_became_peered":"2024-08-31T05:27:31.240660+0000","last_unstale":"2024-08-31T05:29:27.841653+0000","last_undegraded":"2024-08-31T05:29:27.841653+0000","last_fullsized":"2024-08-31T05:29:27.841653+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:16:49.730980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"85'3","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161025+0000","last_change":"2024-08-31T05:27:29.240293+0000","last_active":"2024-08-31T05:28:59.161025+0000","last_peered":"2024-08-31T05:28:59.161025+0000","last_clean":"2024-08-31T05:28:59.161025+0000","last_became_active":"2024-08-31T05:27:29.239889+0000","last_became_peered":"2024-08-31T05:27:29.239889+0000","last_unstale":"2024-08-31T05:28:59.161025+0000","last_undegraded":"2024-08-31T05:28:59.161025+0000","last_fullsized":"2024-08-31T05:28:59.161025+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:20:49.121008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.482071+0000","last_change":"2024-08-31T05:27:38.294174+0000","last_active":"2024-08-31T05:28:59.482071+0000","last_peered":"2024-08-31T05:28:59.482071+0000","last_clean":"2024-08-31T05:28:59.482071+0000","last_became_active":"2024-08-31T05:27:38.293747+0000","last_became_peered":"2024-08-31T05:27:38.293747+0000","last_unstale":"2024-08-31T05:28:59.482071+0000","last_undegraded":"2024-08-31T05:28:59.482071+0000","last_fullsized":"2024-08-31T05:28:59.482071+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:35:46.124473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"87'8","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.841262+0000","last_change":"2024-08-31T05:27:31.244942+0000","last_active":"2024-08-31T05:29:27.841262+0000","last_peered":"2024-08-31T05:29:27.841262+0000","last_clean":"2024-08-31T05:29:27.841262+0000","last_became_active":"2024-08-31T05:27:31.244608+0000","last_became_peered":"2024-08-31T05:27:31.244608+0000","last_unstale":"2024-08-31T05:29:27.841262+0000","last_undegraded":"2024-08-31T05:29:27.841262+0000","last_fullsized":"2024-08-31T05:29:27.841262+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:50:13.651172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"85'3","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161154+0000","last_change":"2024-08-31T05:27:29.236832+0000","last_active":"2024-08-31T05:28:59.161154+0000","last_peered":"2024-08-31T05:28:59.161154+0000","last_clean":"2024-08-31T05:28:59.161154+0000","last_became_active":"2024-08-31T05:27:29.236326+0000","last_became_peered":"2024-08-31T05:27:29.236326+0000","last_unstale":"2024-08-31T05:28:59.161154+0000","last_undegraded":"2024-08-31T05:28:59.161154+0000","last_fullsized":"2024-08-31T05:28:59.161154+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:43:26.199499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"85'7","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.659350+0000","last_change":"2024-08-31T05:27:29.237409+0000","last_active":"2024-08-31T05:28:59.659350+0000","last_peered":"2024-08-31T05:28:59.659350+0000","last_clean":"2024-08-31T05:28:59.659350+0000","last_became_active":"2024-08-31T05:27:29.236928+0000","last_became_peered":"2024-08-31T05:27:29.236928+0000","last_unstale":"2024-08-31T05:28:59.659350+0000","last_undegraded":"2024-08-31T05:28:59.659350+0000","last_fullsized":"2024-08-31T05:28:59.659350+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:07:53.917242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"87'8","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.843647+0000","last_change":"2024-08-31T05:27:31.263005+0000","last_active":"2024-08-31T05:29:27.843647+0000","last_peered":"2024-08-31T05:29:27.843647+0000","last_clean":"2024-08-31T05:29:27.843647+0000","last_became_active":"2024-08-31T05:27:31.262638+0000","last_became_peered":"2024-08-31T05:27:31.262638+0000","last_unstale":"2024-08-31T05:29:27.843647+0000","last_undegraded":"2024-08-31T05:29:27.843647+0000","last_fullsized":"2024-08-31T05:29:27.843647+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:35:06.094346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.661429+0000","last_change":"2024-08-31T05:27:38.293067+0000","last_active":"2024-08-31T05:28:59.661429+0000","last_peered":"2024-08-31T05:28:59.661429+0000","last_clean":"2024-08-31T05:28:59.661429+0000","last_became_active":"2024-08-31T05:27:38.292413+0000","last_became_peered":"2024-08-31T05:27:38.292413+0000","last_unstale":"2024-08-31T05:28:59.661429+0000","last_undegraded":"2024-08-31T05:28:59.661429+0000","last_fullsized":"2024-08-31T05:28:59.661429+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:26:12.248341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"87'7","reported_seq":165,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:58.743101+0000","last_change":"2024-08-31T05:27:58.652458+0000","last_active":"2024-08-31T05:29:58.743101+0000","last_peered":"2024-08-31T05:29:58.743101+0000","last_clean":"2024-08-31T05:29:58.743101+0000","last_became_active":"2024-08-31T05:27:58.652037+0000","last_became_peered":"2024-08-31T05:27:58.652037+0000","last_unstale":"2024-08-31T05:29:58.743101+0000","last_undegraded":"2024-08-31T05:29:58.743101+0000","last_fullsized":"2024-08-31T05:29:58.743101+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:44:45.839429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"87'7","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.832180+0000","last_change":"2024-08-31T05:27:31.253835+0000","last_active":"2024-08-31T05:29:27.832180+0000","last_peered":"2024-08-31T05:29:27.832180+0000","last_clean":"2024-08-31T05:29:27.832180+0000","last_became_active":"2024-08-31T05:27:31.252828+0000","last_became_peered":"2024-08-31T05:27:31.252828+0000","last_unstale":"2024-08-31T05:29:27.832180+0000","last_undegraded":"2024-08-31T05:29:27.832180+0000","last_fullsized":"2024-08-31T05:29:27.832180+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:59:29.987345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.661608+0000","last_change":"2024-08-31T05:27:38.292690+0000","last_active":"2024-08-31T05:28:59.661608+0000","last_peered":"2024-08-31T05:28:59.661608+0000","last_clean":"2024-08-31T05:28:59.661608+0000","last_became_active":"2024-08-31T05:27:38.292195+0000","last_became_peered":"2024-08-31T05:27:38.292195+0000","last_unstale":"2024-08-31T05:28:59.661608+0000","last_undegraded":"2024-08-31T05:28:59.661608+0000","last_fullsized":"2024-08-31T05:28:59.661608+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:50:06.142879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"87'9","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.842588+0000","last_change":"2024-08-31T05:27:31.253706+0000","last_active":"2024-08-31T05:29:27.842588+0000","last_peered":"2024-08-31T05:29:27.842588+0000","last_clean":"2024-08-31T05:29:27.842588+0000","last_became_active":"2024-08-31T05:27:31.253343+0000","last_became_peered":"2024-08-31T05:27:31.253343+0000","last_unstale":"2024-08-31T05:29:27.842588+0000","last_undegraded":"2024-08-31T05:29:27.842588+0000","last_fullsized":"2024-08-31T05:29:27.842588+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:40:28.318153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"87'12","reported_seq":54,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.845099+0000","last_change":"2024-08-31T05:27:58.651669+0000","last_active":"2024-08-31T05:29:27.845099+0000","last_peered":"2024-08-31T05:29:27.845099+0000","last_clean":"2024-08-31T05:29:27.845099+0000","last_became_active":"2024-08-31T05:27:58.651273+0000","last_became_peered":"2024-08-31T05:27:58.651273+0000","last_unstale":"2024-08-31T05:29:27.845099+0000","last_undegraded":"2024-08-31T05:29:27.845099+0000","last_fullsized":"2024-08-31T05:29:27.845099+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:37:42.960124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"87'8","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.843302+0000","last_change":"2024-08-31T05:27:31.257648+0000","last_active":"2024-08-31T05:29:27.843302+0000","last_peered":"2024-08-31T05:29:27.843302+0000","last_clean":"2024-08-31T05:29:27.843302+0000","last_became_active":"2024-08-31T05:27:31.257140+0000","last_became_peered":"2024-08-31T05:27:31.257140+0000","last_unstale":"2024-08-31T05:29:27.843302+0000","last_undegraded":"2024-08-31T05:29:27.843302+0000","last_fullsized":"2024-08-31T05:29:27.843302+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:02:15.249225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"87'7","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.835635+0000","last_change":"2024-08-31T05:27:31.264968+0000","last_active":"2024-08-31T05:29:27.835635+0000","last_peered":"2024-08-31T05:29:27.835635+0000","last_clean":"2024-08-31T05:29:27.835635+0000","last_became_active":"2024-08-31T05:27:31.264629+0000","last_became_peered":"2024-08-31T05:27:31.264629+0000","last_unstale":"2024-08-31T05:29:27.835635+0000","last_undegraded":"2024-08-31T05:29:27.835635+0000","last_fullsized":"2024-08-31T05:29:27.835635+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:28:15.283607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"87'4","reported_seq":39,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.843371+0000","last_change":"2024-08-31T05:27:31.252358+0000","last_active":"2024-08-31T05:29:27.843371+0000","last_peered":"2024-08-31T05:29:27.843371+0000","last_clean":"2024-08-31T05:29:27.843371+0000","last_became_active":"2024-08-31T05:27:31.252013+0000","last_became_peered":"2024-08-31T05:27:31.252013+0000","last_unstale":"2024-08-31T05:29:27.843371+0000","last_undegraded":"2024-08-31T05:29:27.843371+0000","last_fullsized":"2024-08-31T05:29:27.843371+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:48:47.287168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"87'6","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.832448+0000","last_change":"2024-08-31T05:27:31.262626+0000","last_active":"2024-08-31T05:29:27.832448+0000","last_peered":"2024-08-31T05:29:27.832448+0000","last_clean":"2024-08-31T05:29:27.832448+0000","last_became_active":"2024-08-31T05:27:31.262190+0000","last_became_peered":"2024-08-31T05:27:31.262190+0000","last_unstale":"2024-08-31T05:29:27.832448+0000","last_undegraded":"2024-08-31T05:29:27.832448+0000","last_fullsized":"2024-08-31T05:29:27.832448+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:39:19.454606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"87'15","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.849196+0000","last_change":"2024-08-31T05:27:31.254482+0000","last_active":"2024-08-31T05:29:27.849196+0000","last_peered":"2024-08-31T05:29:27.849196+0000","last_clean":"2024-08-31T05:29:27.849196+0000","last_became_active":"2024-08-31T05:27:31.254103+0000","last_became_peered":"2024-08-31T05:27:31.254103+0000","last_unstale":"2024-08-31T05:29:27.849196+0000","last_undegraded":"2024-08-31T05:29:27.849196+0000","last_fullsized":"2024-08-31T05:29:27.849196+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:20:57.333359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"87'2","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.844078+0000","last_change":"2024-08-31T05:27:58.505928+0000","last_active":"2024-08-31T05:29:27.844078+0000","last_peered":"2024-08-31T05:29:27.844078+0000","last_clean":"2024-08-31T05:29:27.844078+0000","last_became_active":"2024-08-31T05:27:58.505527+0000","last_became_peered":"2024-08-31T05:27:58.505527+0000","last_unstale":"2024-08-31T05:29:27.844078+0000","last_undegraded":"2024-08-31T05:29:27.844078+0000","last_fullsized":"2024-08-31T05:29:27.844078+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:44:30.754350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"87'6","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.840063+0000","last_change":"2024-08-31T05:27:31.262385+0000","last_active":"2024-08-31T05:29:27.840063+0000","last_peered":"2024-08-31T05:29:27.840063+0000","last_clean":"2024-08-31T05:29:27.840063+0000","last_became_active":"2024-08-31T05:27:31.262089+0000","last_became_peered":"2024-08-31T05:27:31.262089+0000","last_unstale":"2024-08-31T05:29:27.840063+0000","last_undegraded":"2024-08-31T05:29:27.840063+0000","last_fullsized":"2024-08-31T05:29:27.840063+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:50:17.172462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"87'8","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.844837+0000","last_change":"2024-08-31T05:27:31.249162+0000","last_active":"2024-08-31T05:29:27.844837+0000","last_peered":"2024-08-31T05:29:27.844837+0000","last_clean":"2024-08-31T05:29:27.844837+0000","last_became_active":"2024-08-31T05:27:31.248803+0000","last_became_peered":"2024-08-31T05:27:31.248803+0000","last_unstale":"2024-08-31T05:29:27.844837+0000","last_undegraded":"2024-08-31T05:29:27.844837+0000","last_fullsized":"2024-08-31T05:29:27.844837+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:18:05.449612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"87'10","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.851304+0000","last_change":"2024-08-31T05:27:31.258983+0000","last_active":"2024-08-31T05:29:27.851304+0000","last_peered":"2024-08-31T05:29:27.851304+0000","last_clean":"2024-08-31T05:29:27.851304+0000","last_became_active":"2024-08-31T05:27:31.258480+0000","last_became_peered":"2024-08-31T05:27:31.258480+0000","last_unstale":"2024-08-31T05:29:27.851304+0000","last_undegraded":"2024-08-31T05:29:27.851304+0000","last_fullsized":"2024-08-31T05:29:27.851304+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:57:34.589281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"87'11","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.848762+0000","last_change":"2024-08-31T05:27:31.252561+0000","last_active":"2024-08-31T05:29:27.848762+0000","last_peered":"2024-08-31T05:29:27.848762+0000","last_clean":"2024-08-31T05:29:27.848762+0000","last_became_active":"2024-08-31T05:27:31.251963+0000","last_became_peered":"2024-08-31T05:27:31.251963+0000","last_unstale":"2024-08-31T05:29:27.848762+0000","last_undegraded":"2024-08-31T05:29:27.848762+0000","last_fullsized":"2024-08-31T05:29:27.848762+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:17:45.244329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"87'8","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.838675+0000","last_change":"2024-08-31T05:27:31.257298+0000","last_active":"2024-08-31T05:29:27.838675+0000","last_peered":"2024-08-31T05:29:27.838675+0000","last_clean":"2024-08-31T05:29:27.838675+0000","last_became_active":"2024-08-31T05:27:31.256935+0000","last_became_peered":"2024-08-31T05:27:31.256935+0000","last_unstale":"2024-08-31T05:29:27.838675+0000","last_undegraded":"2024-08-31T05:29:27.838675+0000","last_fullsized":"2024-08-31T05:29:27.838675+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:07:32.876328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"87'7","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.844384+0000","last_change":"2024-08-31T05:27:31.248456+0000","last_active":"2024-08-31T05:29:27.844384+0000","last_peered":"2024-08-31T05:29:27.844384+0000","last_clean":"2024-08-31T05:29:27.844384+0000","last_became_active":"2024-08-31T05:27:31.248060+0000","last_became_peered":"2024-08-31T05:27:31.248060+0000","last_unstale":"2024-08-31T05:29:27.844384+0000","last_undegraded":"2024-08-31T05:29:27.844384+0000","last_fullsized":"2024-08-31T05:29:27.844384+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:29:35.817409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"87'10","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.845826+0000","last_change":"2024-08-31T05:27:31.251345+0000","last_active":"2024-08-31T05:29:27.845826+0000","last_peered":"2024-08-31T05:29:27.845826+0000","last_clean":"2024-08-31T05:29:27.845826+0000","last_became_active":"2024-08-31T05:27:31.251002+0000","last_became_peered":"2024-08-31T05:27:31.251002+0000","last_unstale":"2024-08-31T05:29:27.845826+0000","last_undegraded":"2024-08-31T05:29:27.845826+0000","last_fullsized":"2024-08-31T05:29:27.845826+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:35:24.564897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"87'8","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.850908+0000","last_change":"2024-08-31T05:27:31.260681+0000","last_active":"2024-08-31T05:29:27.850908+0000","last_peered":"2024-08-31T05:29:27.850908+0000","last_clean":"2024-08-31T05:29:27.850908+0000","last_became_active":"2024-08-31T05:27:31.259445+0000","last_became_peered":"2024-08-31T05:27:31.259445+0000","last_unstale":"2024-08-31T05:29:27.850908+0000","last_undegraded":"2024-08-31T05:29:27.850908+0000","last_fullsized":"2024-08-31T05:29:27.850908+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:41:43.480946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"87'9","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.850222+0000","last_change":"2024-08-31T05:27:31.263950+0000","last_active":"2024-08-31T05:29:27.850222+0000","last_peered":"2024-08-31T05:29:27.850222+0000","last_clean":"2024-08-31T05:29:27.850222+0000","last_became_active":"2024-08-31T05:27:31.263568+0000","last_became_peered":"2024-08-31T05:27:31.263568+0000","last_unstale":"2024-08-31T05:29:27.850222+0000","last_undegraded":"2024-08-31T05:29:27.850222+0000","last_fullsized":"2024-08-31T05:29:27.850222+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:50:05.111796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"87'7","reported_seq":49,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.833978+0000","last_change":"2024-08-31T05:27:58.508829+0000","last_active":"2024-08-31T05:29:27.833978+0000","last_peered":"2024-08-31T05:29:27.833978+0000","last_clean":"2024-08-31T05:29:27.833978+0000","last_became_active":"2024-08-31T05:27:58.508378+0000","last_became_peered":"2024-08-31T05:27:58.508378+0000","last_unstale":"2024-08-31T05:29:27.833978+0000","last_undegraded":"2024-08-31T05:29:27.833978+0000","last_fullsized":"2024-08-31T05:29:27.833978+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:05:46.254003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"87'7","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.832512+0000","last_change":"2024-08-31T05:27:31.261012+0000","last_active":"2024-08-31T05:29:27.832512+0000","last_peered":"2024-08-31T05:29:27.832512+0000","last_clean":"2024-08-31T05:29:27.832512+0000","last_became_active":"2024-08-31T05:27:31.259373+0000","last_became_peered":"2024-08-31T05:27:31.259373+0000","last_unstale":"2024-08-31T05:29:27.832512+0000","last_undegraded":"2024-08-31T05:29:27.832512+0000","last_fullsized":"2024-08-31T05:29:27.832512+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:15:34.711961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"87'10","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.827232+0000","last_change":"2024-08-31T05:27:31.255199+0000","last_active":"2024-08-31T05:29:27.827232+0000","last_peered":"2024-08-31T05:29:27.827232+0000","last_clean":"2024-08-31T05:29:27.827232+0000","last_became_active":"2024-08-31T05:27:31.254833+0000","last_became_peered":"2024-08-31T05:27:31.254833+0000","last_unstale":"2024-08-31T05:29:27.827232+0000","last_undegraded":"2024-08-31T05:29:27.827232+0000","last_fullsized":"2024-08-31T05:29:27.827232+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:55:09.426531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"87'7","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.843236+0000","last_change":"2024-08-31T05:27:31.264881+0000","last_active":"2024-08-31T05:29:27.843236+0000","last_peered":"2024-08-31T05:29:27.843236+0000","last_clean":"2024-08-31T05:29:27.843236+0000","last_became_active":"2024-08-31T05:27:31.264483+0000","last_became_peered":"2024-08-31T05:27:31.264483+0000","last_unstale":"2024-08-31T05:29:27.843236+0000","last_undegraded":"2024-08-31T05:29:27.843236+0000","last_fullsized":"2024-08-31T05:29:27.843236+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:48:55.193321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"87'6","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.850856+0000","last_change":"2024-08-31T05:27:31.258555+0000","last_active":"2024-08-31T05:29:27.850856+0000","last_peered":"2024-08-31T05:29:27.850856+0000","last_clean":"2024-08-31T05:29:27.850856+0000","last_became_active":"2024-08-31T05:27:31.258023+0000","last_became_peered":"2024-08-31T05:27:31.258023+0000","last_unstale":"2024-08-31T05:29:27.850856+0000","last_undegraded":"2024-08-31T05:29:27.850856+0000","last_fullsized":"2024-08-31T05:29:27.850856+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:26:34.911641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"87'16","reported_seq":51,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.845099+0000","last_change":"2024-08-31T05:27:31.249886+0000","last_active":"2024-08-31T05:29:27.845099+0000","last_peered":"2024-08-31T05:29:27.845099+0000","last_clean":"2024-08-31T05:29:27.845099+0000","last_became_active":"2024-08-31T05:27:31.248549+0000","last_became_peered":"2024-08-31T05:27:31.248549+0000","last_unstale":"2024-08-31T05:29:27.845099+0000","last_undegraded":"2024-08-31T05:29:27.845099+0000","last_fullsized":"2024-08-31T05:29:27.845099+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:57:55.743286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"87'11","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.850202+0000","last_change":"2024-08-31T05:27:31.261697+0000","last_active":"2024-08-31T05:29:27.850202+0000","last_peered":"2024-08-31T05:29:27.850202+0000","last_clean":"2024-08-31T05:29:27.850202+0000","last_became_active":"2024-08-31T05:27:31.260398+0000","last_became_peered":"2024-08-31T05:27:31.260398+0000","last_unstale":"2024-08-31T05:29:27.850202+0000","last_undegraded":"2024-08-31T05:29:27.850202+0000","last_fullsized":"2024-08-31T05:29:27.850202+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:08:03.999556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"87'9","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.844401+0000","last_change":"2024-08-31T05:27:31.256638+0000","last_active":"2024-08-31T05:29:27.844401+0000","last_peered":"2024-08-31T05:29:27.844401+0000","last_clean":"2024-08-31T05:29:27.844401+0000","last_became_active":"2024-08-31T05:27:31.256302+0000","last_became_peered":"2024-08-31T05:27:31.256302+0000","last_unstale":"2024-08-31T05:29:27.844401+0000","last_undegraded":"2024-08-31T05:29:27.844401+0000","last_fullsized":"2024-08-31T05:29:27.844401+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:31:58.946448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"87'5","reported_seq":40,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.841699+0000","last_change":"2024-08-31T05:27:31.253818+0000","last_active":"2024-08-31T05:29:27.841699+0000","last_peered":"2024-08-31T05:29:27.841699+0000","last_clean":"2024-08-31T05:29:27.841699+0000","last_became_active":"2024-08-31T05:27:31.253423+0000","last_became_peered":"2024-08-31T05:27:31.253423+0000","last_unstale":"2024-08-31T05:29:27.841699+0000","last_undegraded":"2024-08-31T05:29:27.841699+0000","last_fullsized":"2024-08-31T05:29:27.841699+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:45:43.951022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"87'6","reported_seq":40,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.835914+0000","last_change":"2024-08-31T05:27:31.247171+0000","last_active":"2024-08-31T05:29:27.835914+0000","last_peered":"2024-08-31T05:29:27.835914+0000","last_clean":"2024-08-31T05:29:27.835914+0000","last_became_active":"2024-08-31T05:27:31.246791+0000","last_became_peered":"2024-08-31T05:27:31.246791+0000","last_unstale":"2024-08-31T05:29:27.835914+0000","last_undegraded":"2024-08-31T05:29:27.835914+0000","last_fullsized":"2024-08-31T05:29:27.835914+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:26:12.163389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"87'4","reported_seq":39,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.845282+0000","last_change":"2024-08-31T05:27:31.257848+0000","last_active":"2024-08-31T05:29:27.845282+0000","last_peered":"2024-08-31T05:29:27.845282+0000","last_clean":"2024-08-31T05:29:27.845282+0000","last_became_active":"2024-08-31T05:27:31.257432+0000","last_became_peered":"2024-08-31T05:27:31.257432+0000","last_unstale":"2024-08-31T05:29:27.845282+0000","last_undegraded":"2024-08-31T05:29:27.845282+0000","last_fullsized":"2024-08-31T05:29:27.845282+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:08:12.512834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"87'8","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.844807+0000","last_change":"2024-08-31T05:27:31.263998+0000","last_active":"2024-08-31T05:29:27.844807+0000","last_peered":"2024-08-31T05:29:27.844807+0000","last_clean":"2024-08-31T05:29:27.844807+0000","last_became_active":"2024-08-31T05:27:31.263638+0000","last_became_peered":"2024-08-31T05:27:31.263638+0000","last_unstale":"2024-08-31T05:29:27.844807+0000","last_undegraded":"2024-08-31T05:29:27.844807+0000","last_fullsized":"2024-08-31T05:29:27.844807+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:07:50.470538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"87'7","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.834442+0000","last_change":"2024-08-31T05:27:31.260600+0000","last_active":"2024-08-31T05:29:27.834442+0000","last_peered":"2024-08-31T05:29:27.834442+0000","last_clean":"2024-08-31T05:29:27.834442+0000","last_became_active":"2024-08-31T05:27:31.259605+0000","last_became_peered":"2024-08-31T05:27:31.259605+0000","last_unstale":"2024-08-31T05:29:27.834442+0000","last_undegraded":"2024-08-31T05:29:27.834442+0000","last_fullsized":"2024-08-31T05:29:27.834442+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:04:16.861879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"87'4","reported_seq":39,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.834461+0000","last_change":"2024-08-31T05:27:31.256585+0000","last_active":"2024-08-31T05:29:27.834461+0000","last_peered":"2024-08-31T05:29:27.834461+0000","last_clean":"2024-08-31T05:29:27.834461+0000","last_became_active":"2024-08-31T05:27:31.256118+0000","last_became_peered":"2024-08-31T05:27:31.256118+0000","last_unstale":"2024-08-31T05:29:27.834461+0000","last_undegraded":"2024-08-31T05:29:27.834461+0000","last_fullsized":"2024-08-31T05:29:27.834461+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:47:18.891150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"87'8","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.850683+0000","last_change":"2024-08-31T05:27:31.260321+0000","last_active":"2024-08-31T05:29:27.850683+0000","last_peered":"2024-08-31T05:29:27.850683+0000","last_clean":"2024-08-31T05:29:27.850683+0000","last_became_active":"2024-08-31T05:27:31.259901+0000","last_became_peered":"2024-08-31T05:27:31.259901+0000","last_unstale":"2024-08-31T05:29:27.850683+0000","last_undegraded":"2024-08-31T05:29:27.850683+0000","last_fullsized":"2024-08-31T05:29:27.850683+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:44:26.651338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":76578,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1112,"num_read_kb":639,"num_write":270,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":229734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":232,"ondisk_log_size":232,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":280617,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678060,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36288,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708864,"statfs":{"total":95995035648,"available":95957876736,"internally_reserved":0,"allocated":966656,"data_stored":509871,"data_compressed":29581,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874289,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36440,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708712,"statfs":{"total":95995035648,"available":95957721088,"internally_reserved":0,"allocated":1122304,"data_stored":1164606,"data_compressed":65266,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037814,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36316,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708836,"statfs":{"total":95995035648,"available":95957848064,"internally_reserved":0,"allocated":995328,"data_stored":513506,"data_compressed":29581,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234043,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":978944,"data_stored":509116,"data_compressed":29581,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430272,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1040384,"data_stored":1107266,"data_compressed":65266,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593797,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":505446,"data_compressed":29581,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790027,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36368,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708784,"statfs":{"total":95995035648,"available":95957794816,"internally_reserved":0,"allocated":1048576,"data_stored":1102008,"data_compressed":65266,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953552,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":510450,"data_compressed":29581,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149781,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":978944,"data_stored":504622,"data_compressed":29581,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378714,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36372,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708780,"statfs":{"total":95995035648,"available":95957790720,"internally_reserved":0,"allocated":1052672,"data_stored":574326,"data_compressed":29581,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542239,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36368,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708784,"statfs":{"total":95995035648,"available":95957794816,"internally_reserved":0,"allocated":1048576,"data_stored":575541,"data_compressed":29581,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705764,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36312,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708840,"statfs":{"total":95995035648,"available":95957852160,"internally_reserved":0,"allocated":991232,"data_stored":506761,"data_compressed":29581,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34064,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34064,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34064,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":71349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":70134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":70437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T05:30:02.101 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-08-31T05:30:02.101 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-31T05:30:02.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.244+0000 7f073e6bd640 1 -- 172.21.15.5:0/1155531648 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07381080a0 msgr2=0x7f07381084b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:02.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.244+0000 7f073e6bd640 1 --2- 172.21.15.5:0/1155531648 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07381080a0 0x7f07381084b0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f072c009900 tx=0x7f072c02a410 comp rx=0 tx=0).stop 2024-08-31T05:30:02.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.244+0000 7f073e6bd640 1 -- 172.21.15.5:0/1155531648 shutdown_connections 2024-08-31T05:30:02.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.244+0000 7f073e6bd640 1 --2- 172.21.15.5:0/1155531648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07381089f0 0x7f073810f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:02.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.244+0000 7f073e6bd640 1 --2- 172.21.15.5:0/1155531648 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07381080a0 0x7f07381084b0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:02.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.244+0000 7f073e6bd640 1 --2- 172.21.15.5:0/1155531648 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0738102770 0x7f0738102b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:02.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.244+0000 7f073e6bd640 1 -- 172.21.15.5:0/1155531648 >> 172.21.15.5:0/1155531648 conn(0x7f07380fe190 msgr2=0x7f07381005e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:02.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.244+0000 7f073e6bd640 1 -- 172.21.15.5:0/1155531648 shutdown_connections 2024-08-31T05:30:02.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.244+0000 7f073e6bd640 1 -- 172.21.15.5:0/1155531648 wait complete. 2024-08-31T05:30:02.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.245+0000 7f073e6bd640 1 Processor -- start 2024-08-31T05:30:02.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.245+0000 7f073e6bd640 1 -- start start 2024-08-31T05:30:02.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.245+0000 7f073e6bd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0738102770 0x7f073819a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:02.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.245+0000 7f073e6bd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07381080a0 0x7f073819a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:02.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.245+0000 7f073e6bd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07381089f0 0x7f073819f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:02.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.245+0000 7f073e6bd640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f07381137d0 con 0x7f07381080a0 2024-08-31T05:30:02.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.245+0000 7f073e6bd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0738113650 con 0x7f0738102770 2024-08-31T05:30:02.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.245+0000 7f073e6bd640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0738113950 con 0x7f07381089f0 2024-08-31T05:30:02.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.245+0000 7f07377fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07381080a0 0x7f073819a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:02.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.245+0000 7f07377fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07381080a0 0x7f073819a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41638/0 (socket says 172.21.15.5:41638) 2024-08-31T05:30:02.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.245+0000 7f07377fe640 1 -- 172.21.15.5:0/892432176 learned_addr learned my addr 172.21.15.5:0/892432176 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:02.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.246+0000 7f0737fff640 1 --2- 172.21.15.5:0/892432176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0738102770 0x7f073819a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:02.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.246+0000 7f073cc5a640 1 --2- 172.21.15.5:0/892432176 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07381089f0 0x7f073819f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:02.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.246+0000 7f07377fe640 1 -- 172.21.15.5:0/892432176 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07381089f0 msgr2=0x7f073819f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:02.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.246+0000 7f07377fe640 1 --2- 172.21.15.5:0/892432176 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07381089f0 0x7f073819f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:02.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.246+0000 7f07377fe640 1 -- 172.21.15.5:0/892432176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0738102770 msgr2=0x7f073819a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:02.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.246+0000 7f07377fe640 1 --2- 172.21.15.5:0/892432176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0738102770 0x7f073819a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:02.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.246+0000 7f07377fe640 1 -- 172.21.15.5:0/892432176 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07381a00a0 con 0x7f07381080a0 2024-08-31T05:30:02.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.246+0000 7f0737fff640 1 --2- 172.21.15.5:0/892432176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0738102770 0x7f073819a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:30:02.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.246+0000 7f073cc5a640 1 --2- 172.21.15.5:0/892432176 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07381089f0 0x7f073819f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:30:02.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.246+0000 7f07377fe640 1 --2- 172.21.15.5:0/892432176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07381080a0 0x7f073819a710 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f072c006010 tx=0x7f072c004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:02.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.246+0000 7f07357fa640 1 -- 172.21.15.5:0/892432176 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f072c03f030 con 0x7f07381080a0 2024-08-31T05:30:02.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.246+0000 7f07357fa640 1 -- 172.21.15.5:0/892432176 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f072c003aa0 con 0x7f07381080a0 2024-08-31T05:30:02.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.246+0000 7f073e6bd640 1 -- 172.21.15.5:0/892432176 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07381a0330 con 0x7f07381080a0 2024-08-31T05:30:02.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.246+0000 7f07357fa640 1 -- 172.21.15.5:0/892432176 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f072c035070 con 0x7f07381080a0 2024-08-31T05:30:02.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.246+0000 7f073e6bd640 1 -- 172.21.15.5:0/892432176 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07381a6b20 con 0x7f07381080a0 2024-08-31T05:30:02.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.247+0000 7f073e6bd640 1 -- 172.21.15.5:0/892432176 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0738102b80 con 0x7f07381080a0 2024-08-31T05:30:02.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.249+0000 7f07357fa640 1 -- 172.21.15.5:0/892432176 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 23) ==== 152644+0+0 (secure 0 0 0) 0x7f072c042030 con 0x7f07381080a0 2024-08-31T05:30:02.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.249+0000 7f07357fa640 1 --2- 172.21.15.5:0/892432176 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f07200b4c90 0x7f07200b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:02.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.249+0000 7f07357fa640 1 -- 172.21.15.5:0/892432176 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f072c1060e0 con 0x7f07381080a0 2024-08-31T05:30:02.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.249+0000 7f0737fff640 1 --2- 172.21.15.5:0/892432176 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f07200b4c90 0x7f07200b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:02.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.250+0000 7f0737fff640 1 --2- 172.21.15.5:0/892432176 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f07200b4c90 0x7f07200b71a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0728005d00 tx=0x7f0728005c70 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:02.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.253+0000 7f07357fa640 1 -- 172.21.15.5:0/892432176 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f072c0ccc10 con 0x7f07381080a0 2024-08-31T05:30:02.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.438+0000 7f073e6bd640 1 -- 172.21.15.5:0/892432176 --> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f07380635a0 con 0x7f07200b4c90 2024-08-31T05:30:02.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.444+0000 7f07357fa640 1 -- 172.21.15.5:0/892432176 <== mgr.14220 v2:172.21.15.5:6800/2696053609 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340795 (secure 0 0 0) 0x7f07380635a0 con 0x7f07200b4c90 2024-08-31T05:30:02.449 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:30:02.451 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-08-31T05:30:02.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.447+0000 7f073e6bd640 1 -- 172.21.15.5:0/892432176 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f07200b4c90 msgr2=0x7f07200b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:02.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.447+0000 7f073e6bd640 1 --2- 172.21.15.5:0/892432176 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f07200b4c90 0x7f07200b71a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0728005d00 tx=0x7f0728005c70 comp rx=0 tx=0).stop 2024-08-31T05:30:02.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.448+0000 7f073e6bd640 1 -- 172.21.15.5:0/892432176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07381080a0 msgr2=0x7f073819a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:02.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.448+0000 7f073e6bd640 1 --2- 172.21.15.5:0/892432176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07381080a0 0x7f073819a710 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f072c006010 tx=0x7f072c004060 comp rx=0 tx=0).stop 2024-08-31T05:30:02.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.448+0000 7f073e6bd640 1 -- 172.21.15.5:0/892432176 shutdown_connections 2024-08-31T05:30:02.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.448+0000 7f073e6bd640 1 --2- 172.21.15.5:0/892432176 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f07200b4c90 0x7f07200b71a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:02.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.448+0000 7f073e6bd640 1 --2- 172.21.15.5:0/892432176 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07381089f0 0x7f073819f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:02.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.448+0000 7f073e6bd640 1 --2- 172.21.15.5:0/892432176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07381080a0 0x7f073819a710 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:02.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.448+0000 7f073e6bd640 1 --2- 172.21.15.5:0/892432176 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0738102770 0x7f073819a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:02.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.448+0000 7f073e6bd640 1 -- 172.21.15.5:0/892432176 >> 172.21.15.5:0/892432176 conn(0x7f07380fe190 msgr2=0x7f07381005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:02.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.448+0000 7f073e6bd640 1 -- 172.21.15.5:0/892432176 shutdown_connections 2024-08-31T05:30:02.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:02.448+0000 7f073e6bd640 1 -- 172.21.15.5:0/892432176 wait complete. 2024-08-31T05:30:02.461 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":347,"stamp":"2024-08-31T05:30:01.480396+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":667180,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1193,"num_read_kb":708,"num_write":395,"num_write_kb":2316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":2952422,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":826,"ondisk_log_size":826,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":402736,"kb_used_data":11888,"kb_used_omap":18,"kb_used_meta":390637,"kb_avail":1124539088,"statfs":{"total":1151940427776,"available":1151528026112,"internally_reserved":0,"allocated":12173312,"data_stored":8083519,"data_compressed":462027,"data_compressed_allocated":626688,"data_compressed_original":2752512,"omap_allocated":19141,"internal_metadata":400012603},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6771,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":59,"num_write":12,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003981"},"pg_stats":[{"pgid":"2.1f","version":"87'14","reported_seq":173,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:55.736631+0000","last_change":"2024-08-31T05:27:58.511927+0000","last_active":"2024-08-31T05:29:55.736631+0000","last_peered":"2024-08-31T05:29:55.736631+0000","last_clean":"2024-08-31T05:29:55.736631+0000","last_became_active":"2024-08-31T05:27:58.507111+0000","last_became_peered":"2024-08-31T05:27:58.507111+0000","last_unstale":"2024-08-31T05:29:55.736631+0000","last_undegraded":"2024-08-31T05:29:55.736631+0000","last_fullsized":"2024-08-31T05:29:55.736631+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:42:09.078048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"87'5","reported_seq":40,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.844363+0000","last_change":"2024-08-31T05:27:31.255221+0000","last_active":"2024-08-31T05:29:27.844363+0000","last_peered":"2024-08-31T05:29:27.844363+0000","last_clean":"2024-08-31T05:29:27.844363+0000","last_became_active":"2024-08-31T05:27:31.254684+0000","last_became_peered":"2024-08-31T05:27:31.254684+0000","last_unstale":"2024-08-31T05:29:27.844363+0000","last_undegraded":"2024-08-31T05:29:27.844363+0000","last_fullsized":"2024-08-31T05:29:27.844363+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:34:22.517485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.661502+0000","last_change":"2024-08-31T05:27:38.293857+0000","last_active":"2024-08-31T05:28:59.661502+0000","last_peered":"2024-08-31T05:28:59.661502+0000","last_clean":"2024-08-31T05:28:59.661502+0000","last_became_active":"2024-08-31T05:27:38.292763+0000","last_became_peered":"2024-08-31T05:27:38.292763+0000","last_unstale":"2024-08-31T05:28:59.661502+0000","last_undegraded":"2024-08-31T05:28:59.661502+0000","last_fullsized":"2024-08-31T05:28:59.661502+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:53:27.187697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.159933+0000","last_change":"2024-08-31T05:27:29.281010+0000","last_active":"2024-08-31T05:28:59.159933+0000","last_peered":"2024-08-31T05:28:59.159933+0000","last_clean":"2024-08-31T05:28:59.159933+0000","last_became_active":"2024-08-31T05:27:29.280625+0000","last_became_peered":"2024-08-31T05:27:29.280625+0000","last_unstale":"2024-08-31T05:28:59.159933+0000","last_undegraded":"2024-08-31T05:28:59.159933+0000","last_fullsized":"2024-08-31T05:28:59.159933+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:09:25.542564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"87'6","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.849664+0000","last_change":"2024-08-31T05:27:31.258052+0000","last_active":"2024-08-31T05:29:27.849664+0000","last_peered":"2024-08-31T05:29:27.849664+0000","last_clean":"2024-08-31T05:29:27.849664+0000","last_became_active":"2024-08-31T05:27:31.257549+0000","last_became_peered":"2024-08-31T05:27:31.257549+0000","last_unstale":"2024-08-31T05:29:27.849664+0000","last_undegraded":"2024-08-31T05:29:27.849664+0000","last_fullsized":"2024-08-31T05:29:27.849664+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:14:21.552372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.160234+0000","last_change":"2024-08-31T05:27:38.300359+0000","last_active":"2024-08-31T05:28:59.160234+0000","last_peered":"2024-08-31T05:28:59.160234+0000","last_clean":"2024-08-31T05:28:59.160234+0000","last_became_active":"2024-08-31T05:27:38.299704+0000","last_became_peered":"2024-08-31T05:27:38.299704+0000","last_unstale":"2024-08-31T05:28:59.160234+0000","last_undegraded":"2024-08-31T05:28:59.160234+0000","last_fullsized":"2024-08-31T05:28:59.160234+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:06:50.500384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"85'12","reported_seq":53,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.165905+0000","last_change":"2024-08-31T05:27:29.240652+0000","last_active":"2024-08-31T05:28:59.165905+0000","last_peered":"2024-08-31T05:28:59.165905+0000","last_clean":"2024-08-31T05:28:59.165905+0000","last_became_active":"2024-08-31T05:27:29.239432+0000","last_became_peered":"2024-08-31T05:27:29.239432+0000","last_unstale":"2024-08-31T05:28:59.165905+0000","last_undegraded":"2024-08-31T05:28:59.165905+0000","last_fullsized":"2024-08-31T05:28:59.165905+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:49:56.506299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"87'9","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.849658+0000","last_change":"2024-08-31T05:27:31.261784+0000","last_active":"2024-08-31T05:29:27.849658+0000","last_peered":"2024-08-31T05:29:27.849658+0000","last_clean":"2024-08-31T05:29:27.849658+0000","last_became_active":"2024-08-31T05:27:31.260045+0000","last_became_peered":"2024-08-31T05:27:31.260045+0000","last_unstale":"2024-08-31T05:29:27.849658+0000","last_undegraded":"2024-08-31T05:29:27.849658+0000","last_fullsized":"2024-08-31T05:29:27.849658+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:18:30.044052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.661334+0000","last_change":"2024-08-31T05:28:59.661205+0000","last_active":"2024-08-31T05:28:59.661334+0000","last_peered":"2024-08-31T05:28:59.661334+0000","last_clean":"2024-08-31T05:28:59.661334+0000","last_became_active":"2024-08-31T05:28:59.660637+0000","last_became_peered":"2024-08-31T05:28:59.660637+0000","last_unstale":"2024-08-31T05:28:59.661334+0000","last_undegraded":"2024-08-31T05:28:59.661334+0000","last_fullsized":"2024-08-31T05:28:59.661334+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:18:21.507475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,10],"acting":[4,3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"85'5","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.165866+0000","last_change":"2024-08-31T05:27:29.240341+0000","last_active":"2024-08-31T05:28:59.165866+0000","last_peered":"2024-08-31T05:28:59.165866+0000","last_clean":"2024-08-31T05:28:59.165866+0000","last_became_active":"2024-08-31T05:27:29.239944+0000","last_became_peered":"2024-08-31T05:27:29.239944+0000","last_unstale":"2024-08-31T05:28:59.165866+0000","last_undegraded":"2024-08-31T05:28:59.165866+0000","last_fullsized":"2024-08-31T05:28:59.165866+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:58:19.747559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"87'15","reported_seq":49,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.851465+0000","last_change":"2024-08-31T05:27:31.265116+0000","last_active":"2024-08-31T05:29:27.851465+0000","last_peered":"2024-08-31T05:29:27.851465+0000","last_clean":"2024-08-31T05:29:27.851465+0000","last_became_active":"2024-08-31T05:27:31.264725+0000","last_became_peered":"2024-08-31T05:27:31.264725+0000","last_unstale":"2024-08-31T05:29:27.851465+0000","last_undegraded":"2024-08-31T05:29:27.851465+0000","last_fullsized":"2024-08-31T05:29:27.851465+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:44:45.831881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.160399+0000","last_change":"2024-08-31T05:27:38.298634+0000","last_active":"2024-08-31T05:28:59.160399+0000","last_peered":"2024-08-31T05:28:59.160399+0000","last_clean":"2024-08-31T05:28:59.160399+0000","last_became_active":"2024-08-31T05:27:38.298143+0000","last_became_peered":"2024-08-31T05:27:38.298143+0000","last_unstale":"2024-08-31T05:28:59.160399+0000","last_undegraded":"2024-08-31T05:28:59.160399+0000","last_fullsized":"2024-08-31T05:28:59.160399+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:51:25.639441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"87'5","reported_seq":40,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.851171+0000","last_change":"2024-08-31T05:27:31.259981+0000","last_active":"2024-08-31T05:29:27.851171+0000","last_peered":"2024-08-31T05:29:27.851171+0000","last_clean":"2024-08-31T05:29:27.851171+0000","last_became_active":"2024-08-31T05:27:31.259584+0000","last_became_peered":"2024-08-31T05:27:31.259584+0000","last_unstale":"2024-08-31T05:29:27.851171+0000","last_undegraded":"2024-08-31T05:29:27.851171+0000","last_fullsized":"2024-08-31T05:29:27.851171+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:52:29.853977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.481776+0000","last_change":"2024-08-31T05:27:58.514065+0000","last_active":"2024-08-31T05:28:59.481776+0000","last_peered":"2024-08-31T05:28:59.481776+0000","last_clean":"2024-08-31T05:28:59.481776+0000","last_became_active":"2024-08-31T05:27:58.506011+0000","last_became_peered":"2024-08-31T05:27:58.506011+0000","last_unstale":"2024-08-31T05:28:59.481776+0000","last_undegraded":"2024-08-31T05:28:59.481776+0000","last_fullsized":"2024-08-31T05:28:59.481776+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:25:55.610965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.160810+0000","last_change":"2024-08-31T05:27:38.293265+0000","last_active":"2024-08-31T05:28:59.160810+0000","last_peered":"2024-08-31T05:28:59.160810+0000","last_clean":"2024-08-31T05:28:59.160810+0000","last_became_active":"2024-08-31T05:27:38.292736+0000","last_became_peered":"2024-08-31T05:27:38.292736+0000","last_unstale":"2024-08-31T05:28:59.160810+0000","last_undegraded":"2024-08-31T05:28:59.160810+0000","last_fullsized":"2024-08-31T05:28:59.160810+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:51:25.853365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"87'8","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.843426+0000","last_change":"2024-08-31T05:27:31.252479+0000","last_active":"2024-08-31T05:29:27.843426+0000","last_peered":"2024-08-31T05:29:27.843426+0000","last_clean":"2024-08-31T05:29:27.843426+0000","last_became_active":"2024-08-31T05:27:31.252126+0000","last_became_peered":"2024-08-31T05:27:31.252126+0000","last_unstale":"2024-08-31T05:29:27.843426+0000","last_undegraded":"2024-08-31T05:29:27.843426+0000","last_fullsized":"2024-08-31T05:29:27.843426+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:24:40.864240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"87'4","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.481819+0000","last_change":"2024-08-31T05:27:58.508588+0000","last_active":"2024-08-31T05:28:59.481819+0000","last_peered":"2024-08-31T05:28:59.481819+0000","last_clean":"2024-08-31T05:28:59.481819+0000","last_became_active":"2024-08-31T05:27:58.508024+0000","last_became_peered":"2024-08-31T05:27:58.508024+0000","last_unstale":"2024-08-31T05:28:59.481819+0000","last_undegraded":"2024-08-31T05:28:59.481819+0000","last_fullsized":"2024-08-31T05:28:59.481819+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:32:33.222909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"85'1","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.160825+0000","last_change":"2024-08-31T05:27:38.299506+0000","last_active":"2024-08-31T05:28:59.160825+0000","last_peered":"2024-08-31T05:28:59.160825+0000","last_clean":"2024-08-31T05:28:59.160825+0000","last_became_active":"2024-08-31T05:27:38.298756+0000","last_became_peered":"2024-08-31T05:27:38.298756+0000","last_unstale":"2024-08-31T05:28:59.160825+0000","last_undegraded":"2024-08-31T05:28:59.160825+0000","last_fullsized":"2024-08-31T05:28:59.160825+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:25:18.115727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"87'9","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.842533+0000","last_change":"2024-08-31T05:27:31.249220+0000","last_active":"2024-08-31T05:29:27.842533+0000","last_peered":"2024-08-31T05:29:27.842533+0000","last_clean":"2024-08-31T05:29:27.842533+0000","last_became_active":"2024-08-31T05:27:31.248869+0000","last_became_peered":"2024-08-31T05:27:31.248869+0000","last_unstale":"2024-08-31T05:29:27.842533+0000","last_undegraded":"2024-08-31T05:29:27.842533+0000","last_fullsized":"2024-08-31T05:29:27.842533+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:43:13.463903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"85'7","reported_seq":47,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.159564+0000","last_change":"2024-08-31T05:27:29.235278+0000","last_active":"2024-08-31T05:28:59.159564+0000","last_peered":"2024-08-31T05:28:59.159564+0000","last_clean":"2024-08-31T05:28:59.159564+0000","last_became_active":"2024-08-31T05:27:29.234929+0000","last_became_peered":"2024-08-31T05:27:29.234929+0000","last_unstale":"2024-08-31T05:28:59.159564+0000","last_undegraded":"2024-08-31T05:28:59.159564+0000","last_fullsized":"2024-08-31T05:28:59.159564+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:49:55.867542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.657185+0000","last_change":"2024-08-31T05:27:38.293903+0000","last_active":"2024-08-31T05:28:59.657185+0000","last_peered":"2024-08-31T05:28:59.657185+0000","last_clean":"2024-08-31T05:28:59.657185+0000","last_became_active":"2024-08-31T05:27:38.290471+0000","last_became_peered":"2024-08-31T05:27:38.290471+0000","last_unstale":"2024-08-31T05:28:59.657185+0000","last_undegraded":"2024-08-31T05:28:59.657185+0000","last_fullsized":"2024-08-31T05:28:59.657185+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:04:36.573302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"87'2","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.838859+0000","last_change":"2024-08-31T05:27:31.252038+0000","last_active":"2024-08-31T05:29:27.838859+0000","last_peered":"2024-08-31T05:29:27.838859+0000","last_clean":"2024-08-31T05:29:27.838859+0000","last_became_active":"2024-08-31T05:27:31.251630+0000","last_became_peered":"2024-08-31T05:27:31.251630+0000","last_unstale":"2024-08-31T05:29:27.838859+0000","last_undegraded":"2024-08-31T05:29:27.838859+0000","last_fullsized":"2024-08-31T05:29:27.838859+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:10:39.778057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.662029+0000","last_change":"2024-08-31T05:27:29.280978+0000","last_active":"2024-08-31T05:28:59.662029+0000","last_peered":"2024-08-31T05:28:59.662029+0000","last_clean":"2024-08-31T05:28:59.662029+0000","last_became_active":"2024-08-31T05:27:29.280524+0000","last_became_peered":"2024-08-31T05:27:29.280524+0000","last_unstale":"2024-08-31T05:28:59.662029+0000","last_undegraded":"2024-08-31T05:28:59.662029+0000","last_fullsized":"2024-08-31T05:28:59.662029+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:56:57.441801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161183+0000","last_change":"2024-08-31T05:27:38.300947+0000","last_active":"2024-08-31T05:28:59.161183+0000","last_peered":"2024-08-31T05:28:59.161183+0000","last_clean":"2024-08-31T05:28:59.161183+0000","last_became_active":"2024-08-31T05:27:38.300044+0000","last_became_peered":"2024-08-31T05:27:38.300044+0000","last_unstale":"2024-08-31T05:28:59.161183+0000","last_undegraded":"2024-08-31T05:28:59.161183+0000","last_fullsized":"2024-08-31T05:28:59.161183+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:33:05.081601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"87'7","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.842303+0000","last_change":"2024-08-31T05:27:31.257782+0000","last_active":"2024-08-31T05:29:27.842303+0000","last_peered":"2024-08-31T05:29:27.842303+0000","last_clean":"2024-08-31T05:29:27.842303+0000","last_became_active":"2024-08-31T05:27:31.257360+0000","last_became_peered":"2024-08-31T05:27:31.257360+0000","last_unstale":"2024-08-31T05:29:27.842303+0000","last_undegraded":"2024-08-31T05:29:27.842303+0000","last_fullsized":"2024-08-31T05:29:27.842303+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:58:11.249925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"85'7","reported_seq":48,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161269+0000","last_change":"2024-08-31T05:27:29.392664+0000","last_active":"2024-08-31T05:28:59.161269+0000","last_peered":"2024-08-31T05:28:59.161269+0000","last_clean":"2024-08-31T05:28:59.161269+0000","last_became_active":"2024-08-31T05:27:29.392208+0000","last_became_peered":"2024-08-31T05:27:29.392208+0000","last_unstale":"2024-08-31T05:28:59.161269+0000","last_undegraded":"2024-08-31T05:28:59.161269+0000","last_fullsized":"2024-08-31T05:28:59.161269+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:51:34.981168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.661752+0000","last_change":"2024-08-31T05:27:38.293556+0000","last_active":"2024-08-31T05:28:59.661752+0000","last_peered":"2024-08-31T05:28:59.661752+0000","last_clean":"2024-08-31T05:28:59.661752+0000","last_became_active":"2024-08-31T05:27:38.292338+0000","last_became_peered":"2024-08-31T05:27:38.292338+0000","last_unstale":"2024-08-31T05:28:59.661752+0000","last_undegraded":"2024-08-31T05:28:59.661752+0000","last_fullsized":"2024-08-31T05:28:59.661752+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:13:46.376934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"87'5","reported_seq":40,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.842964+0000","last_change":"2024-08-31T05:27:31.247408+0000","last_active":"2024-08-31T05:29:27.842964+0000","last_peered":"2024-08-31T05:29:27.842964+0000","last_clean":"2024-08-31T05:29:27.842964+0000","last_became_active":"2024-08-31T05:27:31.247034+0000","last_became_peered":"2024-08-31T05:27:31.247034+0000","last_unstale":"2024-08-31T05:29:27.842964+0000","last_undegraded":"2024-08-31T05:29:27.842964+0000","last_fullsized":"2024-08-31T05:29:27.842964+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:42:08.350054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"87'17","reported_seq":57,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:42.487425+0000","last_change":"2024-08-31T05:27:29.235941+0000","last_active":"2024-08-31T05:29:42.487425+0000","last_peered":"2024-08-31T05:29:42.487425+0000","last_clean":"2024-08-31T05:29:42.487425+0000","last_became_active":"2024-08-31T05:27:29.235561+0000","last_became_peered":"2024-08-31T05:27:29.235561+0000","last_unstale":"2024-08-31T05:29:42.487425+0000","last_undegraded":"2024-08-31T05:29:42.487425+0000","last_fullsized":"2024-08-31T05:29:42.487425+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:29:34.551748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.159114+0000","last_change":"2024-08-31T05:27:38.286960+0000","last_active":"2024-08-31T05:28:59.159114+0000","last_peered":"2024-08-31T05:28:59.159114+0000","last_clean":"2024-08-31T05:28:59.159114+0000","last_became_active":"2024-08-31T05:27:38.286537+0000","last_became_peered":"2024-08-31T05:27:38.286537+0000","last_unstale":"2024-08-31T05:28:59.159114+0000","last_undegraded":"2024-08-31T05:28:59.159114+0000","last_fullsized":"2024-08-31T05:28:59.159114+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:55:00.656676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"87'9","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.842094+0000","last_change":"2024-08-31T05:27:31.245901+0000","last_active":"2024-08-31T05:29:27.842094+0000","last_peered":"2024-08-31T05:29:27.842094+0000","last_clean":"2024-08-31T05:29:27.842094+0000","last_became_active":"2024-08-31T05:27:31.245534+0000","last_became_peered":"2024-08-31T05:27:31.245534+0000","last_unstale":"2024-08-31T05:29:27.842094+0000","last_undegraded":"2024-08-31T05:29:27.842094+0000","last_fullsized":"2024-08-31T05:29:27.842094+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:26:35.876033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"85'4","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.166037+0000","last_change":"2024-08-31T05:27:29.280767+0000","last_active":"2024-08-31T05:28:59.166037+0000","last_peered":"2024-08-31T05:28:59.166037+0000","last_clean":"2024-08-31T05:28:59.166037+0000","last_became_active":"2024-08-31T05:27:29.280334+0000","last_became_peered":"2024-08-31T05:27:29.280334+0000","last_unstale":"2024-08-31T05:28:59.166037+0000","last_undegraded":"2024-08-31T05:28:59.166037+0000","last_fullsized":"2024-08-31T05:28:59.166037+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:25:20.250205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.481848+0000","last_change":"2024-08-31T05:27:38.296846+0000","last_active":"2024-08-31T05:28:59.481848+0000","last_peered":"2024-08-31T05:28:59.481848+0000","last_clean":"2024-08-31T05:28:59.481848+0000","last_became_active":"2024-08-31T05:27:38.295516+0000","last_became_peered":"2024-08-31T05:27:38.295516+0000","last_unstale":"2024-08-31T05:28:59.481848+0000","last_undegraded":"2024-08-31T05:28:59.481848+0000","last_fullsized":"2024-08-31T05:28:59.481848+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:30:51.110144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"87'4","reported_seq":39,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.822866+0000","last_change":"2024-08-31T05:27:31.246481+0000","last_active":"2024-08-31T05:29:27.822866+0000","last_peered":"2024-08-31T05:29:27.822866+0000","last_clean":"2024-08-31T05:29:27.822866+0000","last_became_active":"2024-08-31T05:27:31.246079+0000","last_became_peered":"2024-08-31T05:27:31.246079+0000","last_unstale":"2024-08-31T05:29:27.822866+0000","last_undegraded":"2024-08-31T05:29:27.822866+0000","last_fullsized":"2024-08-31T05:29:27.822866+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:25:42.536251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"85'1","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.656957+0000","last_change":"2024-08-31T05:27:29.281078+0000","last_active":"2024-08-31T05:28:59.656957+0000","last_peered":"2024-08-31T05:28:59.656957+0000","last_clean":"2024-08-31T05:28:59.656957+0000","last_became_active":"2024-08-31T05:27:29.280674+0000","last_became_peered":"2024-08-31T05:27:29.280674+0000","last_unstale":"2024-08-31T05:28:59.656957+0000","last_undegraded":"2024-08-31T05:28:59.656957+0000","last_fullsized":"2024-08-31T05:28:59.656957+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:04:03.576077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.664703+0000","last_change":"2024-08-31T05:28:59.664061+0000","last_active":"2024-08-31T05:28:59.664703+0000","last_peered":"2024-08-31T05:28:59.664703+0000","last_clean":"2024-08-31T05:28:59.664703+0000","last_became_active":"2024-08-31T05:28:59.663495+0000","last_became_peered":"2024-08-31T05:28:59.663495+0000","last_unstale":"2024-08-31T05:28:59.664703+0000","last_undegraded":"2024-08-31T05:28:59.664703+0000","last_fullsized":"2024-08-31T05:28:59.664703+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:51:38.112492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"87'7","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.835248+0000","last_change":"2024-08-31T05:27:31.251011+0000","last_active":"2024-08-31T05:29:27.835248+0000","last_peered":"2024-08-31T05:29:27.835248+0000","last_clean":"2024-08-31T05:29:27.835248+0000","last_became_active":"2024-08-31T05:27:31.250597+0000","last_became_peered":"2024-08-31T05:27:31.250597+0000","last_unstale":"2024-08-31T05:29:27.835248+0000","last_undegraded":"2024-08-31T05:29:27.835248+0000","last_fullsized":"2024-08-31T05:29:27.835248+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:13:30.858395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"87'7","reported_seq":158,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:58.742129+0000","last_change":"2024-08-31T05:27:29.242137+0000","last_active":"2024-08-31T05:29:58.742129+0000","last_peered":"2024-08-31T05:29:58.742129+0000","last_clean":"2024-08-31T05:29:58.742129+0000","last_became_active":"2024-08-31T05:27:29.241460+0000","last_became_peered":"2024-08-31T05:27:29.241460+0000","last_unstale":"2024-08-31T05:29:58.742129+0000","last_undegraded":"2024-08-31T05:29:58.742129+0000","last_fullsized":"2024-08-31T05:29:58.742129+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:40:59.174572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161959+0000","last_change":"2024-08-31T05:27:38.288643+0000","last_active":"2024-08-31T05:28:59.161959+0000","last_peered":"2024-08-31T05:28:59.161959+0000","last_clean":"2024-08-31T05:28:59.161959+0000","last_became_active":"2024-08-31T05:27:38.288235+0000","last_became_peered":"2024-08-31T05:27:38.288235+0000","last_unstale":"2024-08-31T05:28:59.161959+0000","last_undegraded":"2024-08-31T05:28:59.161959+0000","last_fullsized":"2024-08-31T05:28:59.161959+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:23:49.090990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"87'8","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.844926+0000","last_change":"2024-08-31T05:27:31.263326+0000","last_active":"2024-08-31T05:29:27.844926+0000","last_peered":"2024-08-31T05:29:27.844926+0000","last_clean":"2024-08-31T05:29:27.844926+0000","last_became_active":"2024-08-31T05:27:31.262864+0000","last_became_peered":"2024-08-31T05:27:31.262864+0000","last_unstale":"2024-08-31T05:29:27.844926+0000","last_undegraded":"2024-08-31T05:29:27.844926+0000","last_fullsized":"2024-08-31T05:29:27.844926+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:34:21.159545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"87'6","reported_seq":154,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:57.740976+0000","last_change":"2024-08-31T05:27:29.280829+0000","last_active":"2024-08-31T05:29:57.740976+0000","last_peered":"2024-08-31T05:29:57.740976+0000","last_clean":"2024-08-31T05:29:57.740976+0000","last_became_active":"2024-08-31T05:27:29.280469+0000","last_became_peered":"2024-08-31T05:27:29.280469+0000","last_unstale":"2024-08-31T05:29:57.740976+0000","last_undegraded":"2024-08-31T05:29:57.740976+0000","last_fullsized":"2024-08-31T05:29:57.740976+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:16:59.559680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":108,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.162010+0000","last_change":"2024-08-31T05:27:38.290175+0000","last_active":"2024-08-31T05:28:59.162010+0000","last_peered":"2024-08-31T05:28:59.162010+0000","last_clean":"2024-08-31T05:28:59.162010+0000","last_became_active":"2024-08-31T05:27:38.289228+0000","last_became_peered":"2024-08-31T05:27:38.289228+0000","last_unstale":"2024-08-31T05:28:59.162010+0000","last_undegraded":"2024-08-31T05:28:59.162010+0000","last_fullsized":"2024-08-31T05:28:59.162010+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:26:07.251711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"87'5","reported_seq":40,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.842311+0000","last_change":"2024-08-31T05:27:31.245446+0000","last_active":"2024-08-31T05:29:27.842311+0000","last_peered":"2024-08-31T05:29:27.842311+0000","last_clean":"2024-08-31T05:29:27.842311+0000","last_became_active":"2024-08-31T05:27:31.245099+0000","last_became_peered":"2024-08-31T05:27:31.245099+0000","last_unstale":"2024-08-31T05:29:27.842311+0000","last_undegraded":"2024-08-31T05:29:27.842311+0000","last_fullsized":"2024-08-31T05:29:27.842311+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:18:17.876796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'4","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.489895+0000","last_change":"2024-08-31T05:27:29.241333+0000","last_active":"2024-08-31T05:28:59.489895+0000","last_peered":"2024-08-31T05:28:59.489895+0000","last_clean":"2024-08-31T05:28:59.489895+0000","last_became_active":"2024-08-31T05:27:29.240963+0000","last_became_peered":"2024-08-31T05:27:29.240963+0000","last_unstale":"2024-08-31T05:28:59.489895+0000","last_undegraded":"2024-08-31T05:28:59.489895+0000","last_fullsized":"2024-08-31T05:28:59.489895+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:22:06.442824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161183+0000","last_change":"2024-08-31T05:27:38.287640+0000","last_active":"2024-08-31T05:28:59.161183+0000","last_peered":"2024-08-31T05:28:59.161183+0000","last_clean":"2024-08-31T05:28:59.161183+0000","last_became_active":"2024-08-31T05:27:38.286191+0000","last_became_peered":"2024-08-31T05:27:38.286191+0000","last_unstale":"2024-08-31T05:28:59.161183+0000","last_undegraded":"2024-08-31T05:28:59.161183+0000","last_fullsized":"2024-08-31T05:28:59.161183+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:57:23.535841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"87'8","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.845569+0000","last_change":"2024-08-31T05:27:58.506945+0000","last_active":"2024-08-31T05:29:27.845569+0000","last_peered":"2024-08-31T05:29:27.845569+0000","last_clean":"2024-08-31T05:29:27.845569+0000","last_became_active":"2024-08-31T05:27:58.506505+0000","last_became_peered":"2024-08-31T05:27:58.506505+0000","last_unstale":"2024-08-31T05:29:27.845569+0000","last_undegraded":"2024-08-31T05:29:27.845569+0000","last_fullsized":"2024-08-31T05:29:27.845569+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:16:09.541579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"85'6","reported_seq":49,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161730+0000","last_change":"2024-08-31T05:27:29.238351+0000","last_active":"2024-08-31T05:28:59.161730+0000","last_peered":"2024-08-31T05:28:59.161730+0000","last_clean":"2024-08-31T05:28:59.161730+0000","last_became_active":"2024-08-31T05:27:29.237940+0000","last_became_peered":"2024-08-31T05:27:29.237940+0000","last_unstale":"2024-08-31T05:28:59.161730+0000","last_undegraded":"2024-08-31T05:28:59.161730+0000","last_fullsized":"2024-08-31T05:28:59.161730+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:55:08.048966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":114,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.489971+0000","last_change":"2024-08-31T05:26:14.183718+0000","last_active":"2024-08-31T05:28:59.489971+0000","last_peered":"2024-08-31T05:28:59.489971+0000","last_clean":"2024-08-31T05:28:59.489971+0000","last_became_active":"2024-08-31T05:26:14.178188+0000","last_became_peered":"2024-08-31T05:26:14.178188+0000","last_unstale":"2024-08-31T05:28:59.489971+0000","last_undegraded":"2024-08-31T05:28:59.489971+0000","last_fullsized":"2024-08-31T05:28:59.489971+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:22:50.516233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:22:50.516233+0000","last_clean_scrub_stamp":"2024-08-31T05:22:50.516233+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:10:01.719715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"85'1","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.490285+0000","last_change":"2024-08-31T05:27:38.289721+0000","last_active":"2024-08-31T05:28:59.490285+0000","last_peered":"2024-08-31T05:28:59.490285+0000","last_clean":"2024-08-31T05:28:59.490285+0000","last_became_active":"2024-08-31T05:27:38.289165+0000","last_became_peered":"2024-08-31T05:27:38.289165+0000","last_unstale":"2024-08-31T05:28:59.490285+0000","last_undegraded":"2024-08-31T05:28:59.490285+0000","last_fullsized":"2024-08-31T05:28:59.490285+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:00:30.689093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"87'7","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.850881+0000","last_change":"2024-08-31T05:27:31.256262+0000","last_active":"2024-08-31T05:29:27.850881+0000","last_peered":"2024-08-31T05:29:27.850881+0000","last_clean":"2024-08-31T05:29:27.850881+0000","last_became_active":"2024-08-31T05:27:31.255644+0000","last_became_peered":"2024-08-31T05:27:31.255644+0000","last_unstale":"2024-08-31T05:29:27.850881+0000","last_undegraded":"2024-08-31T05:29:27.850881+0000","last_fullsized":"2024-08-31T05:29:27.850881+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:50:18.158645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"87'6","reported_seq":156,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:58.783099+0000","last_change":"2024-08-31T05:27:29.392666+0000","last_active":"2024-08-31T05:29:58.783099+0000","last_peered":"2024-08-31T05:29:58.783099+0000","last_clean":"2024-08-31T05:29:58.783099+0000","last_became_active":"2024-08-31T05:27:29.392153+0000","last_became_peered":"2024-08-31T05:27:29.392153+0000","last_unstale":"2024-08-31T05:29:58.783099+0000","last_undegraded":"2024-08-31T05:29:58.783099+0000","last_fullsized":"2024-08-31T05:29:58.783099+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:53:02.713022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":110,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.662591+0000","last_change":"2024-08-31T05:27:38.291459+0000","last_active":"2024-08-31T05:28:59.662591+0000","last_peered":"2024-08-31T05:28:59.662591+0000","last_clean":"2024-08-31T05:28:59.662591+0000","last_became_active":"2024-08-31T05:27:38.291013+0000","last_became_peered":"2024-08-31T05:27:38.291013+0000","last_unstale":"2024-08-31T05:28:59.662591+0000","last_undegraded":"2024-08-31T05:28:59.662591+0000","last_fullsized":"2024-08-31T05:28:59.662591+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:03:46.921137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"87'6","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.843678+0000","last_change":"2024-08-31T05:27:31.251641+0000","last_active":"2024-08-31T05:29:27.843678+0000","last_peered":"2024-08-31T05:29:27.843678+0000","last_clean":"2024-08-31T05:29:27.843678+0000","last_became_active":"2024-08-31T05:27:31.251242+0000","last_became_peered":"2024-08-31T05:27:31.251242+0000","last_unstale":"2024-08-31T05:29:27.843678+0000","last_undegraded":"2024-08-31T05:29:27.843678+0000","last_fullsized":"2024-08-31T05:29:27.843678+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:13:58.227136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'3","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161695+0000","last_change":"2024-08-31T05:27:29.238028+0000","last_active":"2024-08-31T05:28:59.161695+0000","last_peered":"2024-08-31T05:28:59.161695+0000","last_clean":"2024-08-31T05:28:59.161695+0000","last_became_active":"2024-08-31T05:27:29.237449+0000","last_became_peered":"2024-08-31T05:27:29.237449+0000","last_unstale":"2024-08-31T05:28:59.161695+0000","last_undegraded":"2024-08-31T05:28:59.161695+0000","last_fullsized":"2024-08-31T05:28:59.161695+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:13:15.447707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.660720+0000","last_change":"2024-08-31T05:27:38.294072+0000","last_active":"2024-08-31T05:28:59.660720+0000","last_peered":"2024-08-31T05:28:59.660720+0000","last_clean":"2024-08-31T05:28:59.660720+0000","last_became_active":"2024-08-31T05:27:38.293642+0000","last_became_peered":"2024-08-31T05:27:38.293642+0000","last_unstale":"2024-08-31T05:28:59.660720+0000","last_undegraded":"2024-08-31T05:28:59.660720+0000","last_fullsized":"2024-08-31T05:28:59.660720+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:57:41.854799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"87'9","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.848174+0000","last_change":"2024-08-31T05:27:31.253601+0000","last_active":"2024-08-31T05:29:27.848174+0000","last_peered":"2024-08-31T05:29:27.848174+0000","last_clean":"2024-08-31T05:29:27.848174+0000","last_became_active":"2024-08-31T05:27:31.253216+0000","last_became_peered":"2024-08-31T05:27:31.253216+0000","last_unstale":"2024-08-31T05:29:27.848174+0000","last_undegraded":"2024-08-31T05:29:27.848174+0000","last_fullsized":"2024-08-31T05:29:27.848174+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:46:12.757944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'5","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.162336+0000","last_change":"2024-08-31T05:27:29.236851+0000","last_active":"2024-08-31T05:28:59.162336+0000","last_peered":"2024-08-31T05:28:59.162336+0000","last_clean":"2024-08-31T05:28:59.162336+0000","last_became_active":"2024-08-31T05:27:29.236473+0000","last_became_peered":"2024-08-31T05:27:29.236473+0000","last_unstale":"2024-08-31T05:28:59.162336+0000","last_undegraded":"2024-08-31T05:28:59.162336+0000","last_fullsized":"2024-08-31T05:28:59.162336+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:01:23.838417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.160555+0000","last_change":"2024-08-31T05:27:38.290069+0000","last_active":"2024-08-31T05:28:59.160555+0000","last_peered":"2024-08-31T05:28:59.160555+0000","last_clean":"2024-08-31T05:28:59.160555+0000","last_became_active":"2024-08-31T05:27:38.289507+0000","last_became_peered":"2024-08-31T05:27:38.289507+0000","last_unstale":"2024-08-31T05:28:59.160555+0000","last_undegraded":"2024-08-31T05:28:59.160555+0000","last_fullsized":"2024-08-31T05:28:59.160555+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:24:33.326308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"87'5","reported_seq":40,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.836667+0000","last_change":"2024-08-31T05:27:31.252787+0000","last_active":"2024-08-31T05:29:27.836667+0000","last_peered":"2024-08-31T05:29:27.836667+0000","last_clean":"2024-08-31T05:29:27.836667+0000","last_became_active":"2024-08-31T05:27:31.252392+0000","last_became_peered":"2024-08-31T05:27:31.252392+0000","last_unstale":"2024-08-31T05:29:27.836667+0000","last_undegraded":"2024-08-31T05:29:27.836667+0000","last_fullsized":"2024-08-31T05:29:27.836667+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:47:06.613616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.166232+0000","last_change":"2024-08-31T05:27:29.240293+0000","last_active":"2024-08-31T05:28:59.166232+0000","last_peered":"2024-08-31T05:28:59.166232+0000","last_clean":"2024-08-31T05:28:59.166232+0000","last_became_active":"2024-08-31T05:27:29.239889+0000","last_became_peered":"2024-08-31T05:27:29.239889+0000","last_unstale":"2024-08-31T05:28:59.166232+0000","last_undegraded":"2024-08-31T05:28:59.166232+0000","last_fullsized":"2024-08-31T05:28:59.166232+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:55:03.524475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.160798+0000","last_change":"2024-08-31T05:27:38.290715+0000","last_active":"2024-08-31T05:28:59.160798+0000","last_peered":"2024-08-31T05:28:59.160798+0000","last_clean":"2024-08-31T05:28:59.160798+0000","last_became_active":"2024-08-31T05:27:38.290227+0000","last_became_peered":"2024-08-31T05:27:38.290227+0000","last_unstale":"2024-08-31T05:28:59.160798+0000","last_undegraded":"2024-08-31T05:28:59.160798+0000","last_fullsized":"2024-08-31T05:28:59.160798+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:09:38.349046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"87'6","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.850824+0000","last_change":"2024-08-31T05:27:31.265672+0000","last_active":"2024-08-31T05:29:27.850824+0000","last_peered":"2024-08-31T05:29:27.850824+0000","last_clean":"2024-08-31T05:29:27.850824+0000","last_became_active":"2024-08-31T05:27:31.265332+0000","last_became_peered":"2024-08-31T05:27:31.265332+0000","last_unstale":"2024-08-31T05:29:27.850824+0000","last_undegraded":"2024-08-31T05:29:27.850824+0000","last_fullsized":"2024-08-31T05:29:27.850824+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:45:01.868256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"85'17","reported_seq":58,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.165237+0000","last_change":"2024-08-31T05:27:29.281129+0000","last_active":"2024-08-31T05:28:59.165237+0000","last_peered":"2024-08-31T05:28:59.165237+0000","last_clean":"2024-08-31T05:28:59.165237+0000","last_became_active":"2024-08-31T05:27:29.280613+0000","last_became_peered":"2024-08-31T05:27:29.280613+0000","last_unstale":"2024-08-31T05:28:59.165237+0000","last_undegraded":"2024-08-31T05:28:59.165237+0000","last_fullsized":"2024-08-31T05:28:59.165237+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:17:28.103371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.483707+0000","last_change":"2024-08-31T05:28:59.483629+0000","last_active":"2024-08-31T05:28:59.483707+0000","last_peered":"2024-08-31T05:28:59.483707+0000","last_clean":"2024-08-31T05:28:59.483707+0000","last_became_active":"2024-08-31T05:28:59.483102+0000","last_became_peered":"2024-08-31T05:28:59.483102+0000","last_unstale":"2024-08-31T05:28:59.483707+0000","last_undegraded":"2024-08-31T05:28:59.483707+0000","last_fullsized":"2024-08-31T05:28:59.483707+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:54:18.587227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,8,11],"acting":[6,3,8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"87'6","reported_seq":48,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.847968+0000","last_change":"2024-08-31T05:27:58.505480+0000","last_active":"2024-08-31T05:29:27.847968+0000","last_peered":"2024-08-31T05:29:27.847968+0000","last_clean":"2024-08-31T05:29:27.847968+0000","last_became_active":"2024-08-31T05:27:58.504773+0000","last_became_peered":"2024-08-31T05:27:58.504773+0000","last_unstale":"2024-08-31T05:29:27.847968+0000","last_undegraded":"2024-08-31T05:29:27.847968+0000","last_fullsized":"2024-08-31T05:29:27.847968+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:48:59.979443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"87'6","reported_seq":156,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:57.741512+0000","last_change":"2024-08-31T05:27:29.239308+0000","last_active":"2024-08-31T05:29:57.741512+0000","last_peered":"2024-08-31T05:29:57.741512+0000","last_clean":"2024-08-31T05:29:57.741512+0000","last_became_active":"2024-08-31T05:27:29.238793+0000","last_became_peered":"2024-08-31T05:27:29.238793+0000","last_unstale":"2024-08-31T05:29:57.741512+0000","last_undegraded":"2024-08-31T05:29:57.741512+0000","last_fullsized":"2024-08-31T05:29:57.741512+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:20:47.837021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":896,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":111,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.657165+0000","last_change":"2024-08-31T05:27:38.287260+0000","last_active":"2024-08-31T05:28:59.657165+0000","last_peered":"2024-08-31T05:28:59.657165+0000","last_clean":"2024-08-31T05:28:59.657165+0000","last_became_active":"2024-08-31T05:27:38.286250+0000","last_became_peered":"2024-08-31T05:27:38.286250+0000","last_unstale":"2024-08-31T05:28:59.657165+0000","last_undegraded":"2024-08-31T05:28:59.657165+0000","last_fullsized":"2024-08-31T05:28:59.657165+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:17:55.530114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"87'15","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.848492+0000","last_change":"2024-08-31T05:27:31.251152+0000","last_active":"2024-08-31T05:29:27.848492+0000","last_peered":"2024-08-31T05:29:27.848492+0000","last_clean":"2024-08-31T05:29:27.848492+0000","last_became_active":"2024-08-31T05:27:31.250686+0000","last_became_peered":"2024-08-31T05:27:31.250686+0000","last_unstale":"2024-08-31T05:29:27.848492+0000","last_undegraded":"2024-08-31T05:29:27.848492+0000","last_fullsized":"2024-08-31T05:29:27.848492+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:03:37.359332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"85'5","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161004+0000","last_change":"2024-08-31T05:27:29.237404+0000","last_active":"2024-08-31T05:28:59.161004+0000","last_peered":"2024-08-31T05:28:59.161004+0000","last_clean":"2024-08-31T05:28:59.161004+0000","last_became_active":"2024-08-31T05:27:29.236695+0000","last_became_peered":"2024-08-31T05:27:29.236695+0000","last_unstale":"2024-08-31T05:28:59.161004+0000","last_undegraded":"2024-08-31T05:28:59.161004+0000","last_fullsized":"2024-08-31T05:28:59.161004+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:25:05.174288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.481921+0000","last_change":"2024-08-31T05:27:38.296553+0000","last_active":"2024-08-31T05:28:59.481921+0000","last_peered":"2024-08-31T05:28:59.481921+0000","last_clean":"2024-08-31T05:28:59.481921+0000","last_became_active":"2024-08-31T05:27:38.296118+0000","last_became_peered":"2024-08-31T05:27:38.296118+0000","last_unstale":"2024-08-31T05:28:59.481921+0000","last_undegraded":"2024-08-31T05:28:59.481921+0000","last_fullsized":"2024-08-31T05:28:59.481921+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:10:41.334260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"87'9","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.846961+0000","last_change":"2024-08-31T05:27:31.250584+0000","last_active":"2024-08-31T05:29:27.846961+0000","last_peered":"2024-08-31T05:29:27.846961+0000","last_clean":"2024-08-31T05:29:27.846961+0000","last_became_active":"2024-08-31T05:27:31.250234+0000","last_became_peered":"2024-08-31T05:27:31.250234+0000","last_unstale":"2024-08-31T05:29:27.846961+0000","last_undegraded":"2024-08-31T05:29:27.846961+0000","last_fullsized":"2024-08-31T05:29:27.846961+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:00:39.648236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"85'9","reported_seq":51,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.661583+0000","last_change":"2024-08-31T05:27:29.237956+0000","last_active":"2024-08-31T05:28:59.661583+0000","last_peered":"2024-08-31T05:28:59.661583+0000","last_clean":"2024-08-31T05:28:59.661583+0000","last_became_active":"2024-08-31T05:27:29.237510+0000","last_became_peered":"2024-08-31T05:27:29.237510+0000","last_unstale":"2024-08-31T05:28:59.661583+0000","last_undegraded":"2024-08-31T05:28:59.661583+0000","last_fullsized":"2024-08-31T05:28:59.661583+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:18:44.295298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161323+0000","last_change":"2024-08-31T05:27:38.289472+0000","last_active":"2024-08-31T05:28:59.161323+0000","last_peered":"2024-08-31T05:28:59.161323+0000","last_clean":"2024-08-31T05:28:59.161323+0000","last_became_active":"2024-08-31T05:27:38.288809+0000","last_became_peered":"2024-08-31T05:27:38.288809+0000","last_unstale":"2024-08-31T05:28:59.161323+0000","last_undegraded":"2024-08-31T05:28:59.161323+0000","last_fullsized":"2024-08-31T05:28:59.161323+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:17:06.430110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"87'6","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.839029+0000","last_change":"2024-08-31T05:27:31.258103+0000","last_active":"2024-08-31T05:29:27.839029+0000","last_peered":"2024-08-31T05:29:27.839029+0000","last_clean":"2024-08-31T05:29:27.839029+0000","last_became_active":"2024-08-31T05:27:31.257257+0000","last_became_peered":"2024-08-31T05:27:31.257257+0000","last_unstale":"2024-08-31T05:29:27.839029+0000","last_undegraded":"2024-08-31T05:29:27.839029+0000","last_fullsized":"2024-08-31T05:29:27.839029+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:16:01.309646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"87'42","reported_seq":305,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:57.742069+0000","last_change":"2024-08-31T05:27:29.241129+0000","last_active":"2024-08-31T05:29:57.742069+0000","last_peered":"2024-08-31T05:29:57.742069+0000","last_clean":"2024-08-31T05:29:57.742069+0000","last_became_active":"2024-08-31T05:27:29.240708+0000","last_became_peered":"2024-08-31T05:27:29.240708+0000","last_unstale":"2024-08-31T05:29:57.742069+0000","last_undegraded":"2024-08-31T05:29:57.742069+0000","last_fullsized":"2024-08-31T05:29:57.742069+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:20:10.127588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68393,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":223,"num_read_kb":179,"num_write":44,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.656811+0000","last_change":"2024-08-31T05:27:38.291037+0000","last_active":"2024-08-31T05:28:59.656811+0000","last_peered":"2024-08-31T05:28:59.656811+0000","last_clean":"2024-08-31T05:28:59.656811+0000","last_became_active":"2024-08-31T05:27:38.290592+0000","last_became_peered":"2024-08-31T05:27:38.290592+0000","last_unstale":"2024-08-31T05:28:59.656811+0000","last_undegraded":"2024-08-31T05:28:59.656811+0000","last_fullsized":"2024-08-31T05:28:59.656811+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:12:56.391784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"87'11","reported_seq":53,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.851259+0000","last_change":"2024-08-31T05:27:58.508403+0000","last_active":"2024-08-31T05:29:27.851259+0000","last_peered":"2024-08-31T05:29:27.851259+0000","last_clean":"2024-08-31T05:29:27.851259+0000","last_became_active":"2024-08-31T05:27:58.507918+0000","last_became_peered":"2024-08-31T05:27:58.507918+0000","last_unstale":"2024-08-31T05:29:27.851259+0000","last_undegraded":"2024-08-31T05:29:27.851259+0000","last_fullsized":"2024-08-31T05:29:27.851259+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:47:54.479249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,7],"acting":[1,8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"85'5","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161566+0000","last_change":"2024-08-31T05:27:29.281231+0000","last_active":"2024-08-31T05:28:59.161566+0000","last_peered":"2024-08-31T05:28:59.161566+0000","last_clean":"2024-08-31T05:28:59.161566+0000","last_became_active":"2024-08-31T05:27:29.280748+0000","last_became_peered":"2024-08-31T05:27:29.280748+0000","last_unstale":"2024-08-31T05:28:59.161566+0000","last_undegraded":"2024-08-31T05:28:59.161566+0000","last_fullsized":"2024-08-31T05:28:59.161566+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:43:44.783595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.664495+0000","last_change":"2024-08-31T05:28:59.663824+0000","last_active":"2024-08-31T05:28:59.664495+0000","last_peered":"2024-08-31T05:28:59.664495+0000","last_clean":"2024-08-31T05:28:59.664495+0000","last_became_active":"2024-08-31T05:28:59.663270+0000","last_became_peered":"2024-08-31T05:28:59.663270+0000","last_unstale":"2024-08-31T05:28:59.664495+0000","last_undegraded":"2024-08-31T05:28:59.664495+0000","last_fullsized":"2024-08-31T05:28:59.664495+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:23:26.836655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"87'9","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.835619+0000","last_change":"2024-08-31T05:27:31.258030+0000","last_active":"2024-08-31T05:29:27.835619+0000","last_peered":"2024-08-31T05:29:27.835619+0000","last_clean":"2024-08-31T05:29:27.835619+0000","last_became_active":"2024-08-31T05:27:31.257410+0000","last_became_peered":"2024-08-31T05:27:31.257410+0000","last_unstale":"2024-08-31T05:29:27.835619+0000","last_undegraded":"2024-08-31T05:29:27.835619+0000","last_fullsized":"2024-08-31T05:29:27.835619+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:48:27.716531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"85'4","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.490356+0000","last_change":"2024-08-31T05:27:29.239560+0000","last_active":"2024-08-31T05:28:59.490356+0000","last_peered":"2024-08-31T05:28:59.490356+0000","last_clean":"2024-08-31T05:28:59.490356+0000","last_became_active":"2024-08-31T05:27:29.239154+0000","last_became_peered":"2024-08-31T05:27:29.239154+0000","last_unstale":"2024-08-31T05:28:59.490356+0000","last_undegraded":"2024-08-31T05:28:59.490356+0000","last_fullsized":"2024-08-31T05:28:59.490356+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:29:36.983690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.656620+0000","last_change":"2024-08-31T05:27:38.297596+0000","last_active":"2024-08-31T05:28:59.656620+0000","last_peered":"2024-08-31T05:28:59.656620+0000","last_clean":"2024-08-31T05:28:59.656620+0000","last_became_active":"2024-08-31T05:27:38.295127+0000","last_became_peered":"2024-08-31T05:27:38.295127+0000","last_unstale":"2024-08-31T05:28:59.656620+0000","last_undegraded":"2024-08-31T05:28:59.656620+0000","last_fullsized":"2024-08-31T05:28:59.656620+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:50:09.363872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"87'10","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.850147+0000","last_change":"2024-08-31T05:27:31.262036+0000","last_active":"2024-08-31T05:29:27.850147+0000","last_peered":"2024-08-31T05:29:27.850147+0000","last_clean":"2024-08-31T05:29:27.850147+0000","last_became_active":"2024-08-31T05:27:31.261589+0000","last_became_peered":"2024-08-31T05:27:31.261589+0000","last_unstale":"2024-08-31T05:29:27.850147+0000","last_undegraded":"2024-08-31T05:29:27.850147+0000","last_fullsized":"2024-08-31T05:29:27.850147+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:24:17.677639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"87'6","reported_seq":258,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:57.947962+0000","last_change":"2024-08-31T05:27:29.233381+0000","last_active":"2024-08-31T05:29:57.947962+0000","last_peered":"2024-08-31T05:29:57.947962+0000","last_clean":"2024-08-31T05:29:57.947962+0000","last_became_active":"2024-08-31T05:27:29.232959+0000","last_became_peered":"2024-08-31T05:27:29.232959+0000","last_unstale":"2024-08-31T05:29:57.947962+0000","last_undegraded":"2024-08-31T05:29:57.947962+0000","last_fullsized":"2024-08-31T05:29:57.947962+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:50:16.901373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":212,"num_read_kb":212,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.159306+0000","last_change":"2024-08-31T05:27:38.288798+0000","last_active":"2024-08-31T05:28:59.159306+0000","last_peered":"2024-08-31T05:28:59.159306+0000","last_clean":"2024-08-31T05:28:59.159306+0000","last_became_active":"2024-08-31T05:27:38.288369+0000","last_became_peered":"2024-08-31T05:27:38.288369+0000","last_unstale":"2024-08-31T05:28:59.159306+0000","last_undegraded":"2024-08-31T05:28:59.159306+0000","last_fullsized":"2024-08-31T05:28:59.159306+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:52:45.680480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.660858+0000","last_change":"2024-08-31T05:27:38.290029+0000","last_active":"2024-08-31T05:28:59.660858+0000","last_peered":"2024-08-31T05:28:59.660858+0000","last_clean":"2024-08-31T05:28:59.660858+0000","last_became_active":"2024-08-31T05:27:38.289638+0000","last_became_peered":"2024-08-31T05:27:38.289638+0000","last_unstale":"2024-08-31T05:28:59.660858+0000","last_undegraded":"2024-08-31T05:28:59.660858+0000","last_fullsized":"2024-08-31T05:28:59.660858+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:10:34.521418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"87'11","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.841653+0000","last_change":"2024-08-31T05:27:31.241057+0000","last_active":"2024-08-31T05:29:27.841653+0000","last_peered":"2024-08-31T05:29:27.841653+0000","last_clean":"2024-08-31T05:29:27.841653+0000","last_became_active":"2024-08-31T05:27:31.240660+0000","last_became_peered":"2024-08-31T05:27:31.240660+0000","last_unstale":"2024-08-31T05:29:27.841653+0000","last_undegraded":"2024-08-31T05:29:27.841653+0000","last_fullsized":"2024-08-31T05:29:27.841653+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:16:49.730980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"85'3","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161025+0000","last_change":"2024-08-31T05:27:29.240293+0000","last_active":"2024-08-31T05:28:59.161025+0000","last_peered":"2024-08-31T05:28:59.161025+0000","last_clean":"2024-08-31T05:28:59.161025+0000","last_became_active":"2024-08-31T05:27:29.239889+0000","last_became_peered":"2024-08-31T05:27:29.239889+0000","last_unstale":"2024-08-31T05:28:59.161025+0000","last_undegraded":"2024-08-31T05:28:59.161025+0000","last_fullsized":"2024-08-31T05:28:59.161025+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:20:49.121008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.482071+0000","last_change":"2024-08-31T05:27:38.294174+0000","last_active":"2024-08-31T05:28:59.482071+0000","last_peered":"2024-08-31T05:28:59.482071+0000","last_clean":"2024-08-31T05:28:59.482071+0000","last_became_active":"2024-08-31T05:27:38.293747+0000","last_became_peered":"2024-08-31T05:27:38.293747+0000","last_unstale":"2024-08-31T05:28:59.482071+0000","last_undegraded":"2024-08-31T05:28:59.482071+0000","last_fullsized":"2024-08-31T05:28:59.482071+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:35:46.124473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"87'8","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.841262+0000","last_change":"2024-08-31T05:27:31.244942+0000","last_active":"2024-08-31T05:29:27.841262+0000","last_peered":"2024-08-31T05:29:27.841262+0000","last_clean":"2024-08-31T05:29:27.841262+0000","last_became_active":"2024-08-31T05:27:31.244608+0000","last_became_peered":"2024-08-31T05:27:31.244608+0000","last_unstale":"2024-08-31T05:29:27.841262+0000","last_undegraded":"2024-08-31T05:29:27.841262+0000","last_fullsized":"2024-08-31T05:29:27.841262+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:50:13.651172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"85'3","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.161154+0000","last_change":"2024-08-31T05:27:29.236832+0000","last_active":"2024-08-31T05:28:59.161154+0000","last_peered":"2024-08-31T05:28:59.161154+0000","last_clean":"2024-08-31T05:28:59.161154+0000","last_became_active":"2024-08-31T05:27:29.236326+0000","last_became_peered":"2024-08-31T05:27:29.236326+0000","last_unstale":"2024-08-31T05:28:59.161154+0000","last_undegraded":"2024-08-31T05:28:59.161154+0000","last_fullsized":"2024-08-31T05:28:59.161154+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:43:26.199499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"85'7","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.659350+0000","last_change":"2024-08-31T05:27:29.237409+0000","last_active":"2024-08-31T05:28:59.659350+0000","last_peered":"2024-08-31T05:28:59.659350+0000","last_clean":"2024-08-31T05:28:59.659350+0000","last_became_active":"2024-08-31T05:27:29.236928+0000","last_became_peered":"2024-08-31T05:27:29.236928+0000","last_unstale":"2024-08-31T05:28:59.659350+0000","last_undegraded":"2024-08-31T05:28:59.659350+0000","last_fullsized":"2024-08-31T05:28:59.659350+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:07:53.917242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"87'8","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.843647+0000","last_change":"2024-08-31T05:27:31.263005+0000","last_active":"2024-08-31T05:29:27.843647+0000","last_peered":"2024-08-31T05:29:27.843647+0000","last_clean":"2024-08-31T05:29:27.843647+0000","last_became_active":"2024-08-31T05:27:31.262638+0000","last_became_peered":"2024-08-31T05:27:31.262638+0000","last_unstale":"2024-08-31T05:29:27.843647+0000","last_undegraded":"2024-08-31T05:29:27.843647+0000","last_fullsized":"2024-08-31T05:29:27.843647+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:35:06.094346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.661429+0000","last_change":"2024-08-31T05:27:38.293067+0000","last_active":"2024-08-31T05:28:59.661429+0000","last_peered":"2024-08-31T05:28:59.661429+0000","last_clean":"2024-08-31T05:28:59.661429+0000","last_became_active":"2024-08-31T05:27:38.292413+0000","last_became_peered":"2024-08-31T05:27:38.292413+0000","last_unstale":"2024-08-31T05:28:59.661429+0000","last_undegraded":"2024-08-31T05:28:59.661429+0000","last_fullsized":"2024-08-31T05:28:59.661429+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:26:12.248341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"87'7","reported_seq":165,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:58.743101+0000","last_change":"2024-08-31T05:27:58.652458+0000","last_active":"2024-08-31T05:29:58.743101+0000","last_peered":"2024-08-31T05:29:58.743101+0000","last_clean":"2024-08-31T05:29:58.743101+0000","last_became_active":"2024-08-31T05:27:58.652037+0000","last_became_peered":"2024-08-31T05:27:58.652037+0000","last_unstale":"2024-08-31T05:29:58.743101+0000","last_undegraded":"2024-08-31T05:29:58.743101+0000","last_fullsized":"2024-08-31T05:29:58.743101+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:28.212775+0000","last_clean_scrub_stamp":"2024-08-31T05:27:28.212775+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:44:45.839429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"87'7","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.832180+0000","last_change":"2024-08-31T05:27:31.253835+0000","last_active":"2024-08-31T05:29:27.832180+0000","last_peered":"2024-08-31T05:29:27.832180+0000","last_clean":"2024-08-31T05:29:27.832180+0000","last_became_active":"2024-08-31T05:27:31.252828+0000","last_became_peered":"2024-08-31T05:27:31.252828+0000","last_unstale":"2024-08-31T05:29:27.832180+0000","last_undegraded":"2024-08-31T05:29:27.832180+0000","last_fullsized":"2024-08-31T05:29:27.832180+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:59:29.987345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:28:59.661608+0000","last_change":"2024-08-31T05:27:38.292690+0000","last_active":"2024-08-31T05:28:59.661608+0000","last_peered":"2024-08-31T05:28:59.661608+0000","last_clean":"2024-08-31T05:28:59.661608+0000","last_became_active":"2024-08-31T05:27:38.292195+0000","last_became_peered":"2024-08-31T05:27:38.292195+0000","last_unstale":"2024-08-31T05:28:59.661608+0000","last_undegraded":"2024-08-31T05:28:59.661608+0000","last_fullsized":"2024-08-31T05:28:59.661608+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:37.265334+0000","last_clean_scrub_stamp":"2024-08-31T05:27:37.265334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:50:06.142879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"87'9","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.842588+0000","last_change":"2024-08-31T05:27:31.253706+0000","last_active":"2024-08-31T05:29:27.842588+0000","last_peered":"2024-08-31T05:29:27.842588+0000","last_clean":"2024-08-31T05:29:27.842588+0000","last_became_active":"2024-08-31T05:27:31.253343+0000","last_became_peered":"2024-08-31T05:27:31.253343+0000","last_unstale":"2024-08-31T05:29:27.842588+0000","last_undegraded":"2024-08-31T05:29:27.842588+0000","last_fullsized":"2024-08-31T05:29:27.842588+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:40:28.318153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"87'12","reported_seq":54,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.845099+0000","last_change":"2024-08-31T05:27:58.651669+0000","last_active":"2024-08-31T05:29:27.845099+0000","last_peered":"2024-08-31T05:29:27.845099+0000","last_clean":"2024-08-31T05:29:27.845099+0000","last_became_active":"2024-08-31T05:27:58.651273+0000","last_became_peered":"2024-08-31T05:27:58.651273+0000","last_unstale":"2024-08-31T05:29:27.845099+0000","last_undegraded":"2024-08-31T05:29:27.845099+0000","last_fullsized":"2024-08-31T05:29:27.845099+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:37:42.960124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"87'8","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.843302+0000","last_change":"2024-08-31T05:27:31.257648+0000","last_active":"2024-08-31T05:29:27.843302+0000","last_peered":"2024-08-31T05:29:27.843302+0000","last_clean":"2024-08-31T05:29:27.843302+0000","last_became_active":"2024-08-31T05:27:31.257140+0000","last_became_peered":"2024-08-31T05:27:31.257140+0000","last_unstale":"2024-08-31T05:29:27.843302+0000","last_undegraded":"2024-08-31T05:29:27.843302+0000","last_fullsized":"2024-08-31T05:29:27.843302+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:02:15.249225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"87'7","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.835635+0000","last_change":"2024-08-31T05:27:31.264968+0000","last_active":"2024-08-31T05:29:27.835635+0000","last_peered":"2024-08-31T05:29:27.835635+0000","last_clean":"2024-08-31T05:29:27.835635+0000","last_became_active":"2024-08-31T05:27:31.264629+0000","last_became_peered":"2024-08-31T05:27:31.264629+0000","last_unstale":"2024-08-31T05:29:27.835635+0000","last_undegraded":"2024-08-31T05:29:27.835635+0000","last_fullsized":"2024-08-31T05:29:27.835635+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:28:15.283607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"87'4","reported_seq":39,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.843371+0000","last_change":"2024-08-31T05:27:31.252358+0000","last_active":"2024-08-31T05:29:27.843371+0000","last_peered":"2024-08-31T05:29:27.843371+0000","last_clean":"2024-08-31T05:29:27.843371+0000","last_became_active":"2024-08-31T05:27:31.252013+0000","last_became_peered":"2024-08-31T05:27:31.252013+0000","last_unstale":"2024-08-31T05:29:27.843371+0000","last_undegraded":"2024-08-31T05:29:27.843371+0000","last_fullsized":"2024-08-31T05:29:27.843371+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:48:47.287168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"87'6","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.832448+0000","last_change":"2024-08-31T05:27:31.262626+0000","last_active":"2024-08-31T05:29:27.832448+0000","last_peered":"2024-08-31T05:29:27.832448+0000","last_clean":"2024-08-31T05:29:27.832448+0000","last_became_active":"2024-08-31T05:27:31.262190+0000","last_became_peered":"2024-08-31T05:27:31.262190+0000","last_unstale":"2024-08-31T05:29:27.832448+0000","last_undegraded":"2024-08-31T05:29:27.832448+0000","last_fullsized":"2024-08-31T05:29:27.832448+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:39:19.454606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"87'15","reported_seq":50,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.849196+0000","last_change":"2024-08-31T05:27:31.254482+0000","last_active":"2024-08-31T05:29:27.849196+0000","last_peered":"2024-08-31T05:29:27.849196+0000","last_clean":"2024-08-31T05:29:27.849196+0000","last_became_active":"2024-08-31T05:27:31.254103+0000","last_became_peered":"2024-08-31T05:27:31.254103+0000","last_unstale":"2024-08-31T05:29:27.849196+0000","last_undegraded":"2024-08-31T05:29:27.849196+0000","last_fullsized":"2024-08-31T05:29:27.849196+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:20:57.333359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"87'2","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.844078+0000","last_change":"2024-08-31T05:27:58.505928+0000","last_active":"2024-08-31T05:29:27.844078+0000","last_peered":"2024-08-31T05:29:27.844078+0000","last_clean":"2024-08-31T05:29:27.844078+0000","last_became_active":"2024-08-31T05:27:58.505527+0000","last_became_peered":"2024-08-31T05:27:58.505527+0000","last_unstale":"2024-08-31T05:29:27.844078+0000","last_undegraded":"2024-08-31T05:29:27.844078+0000","last_fullsized":"2024-08-31T05:29:27.844078+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:44:30.754350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"87'6","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.840063+0000","last_change":"2024-08-31T05:27:31.262385+0000","last_active":"2024-08-31T05:29:27.840063+0000","last_peered":"2024-08-31T05:29:27.840063+0000","last_clean":"2024-08-31T05:29:27.840063+0000","last_became_active":"2024-08-31T05:27:31.262089+0000","last_became_peered":"2024-08-31T05:27:31.262089+0000","last_unstale":"2024-08-31T05:29:27.840063+0000","last_undegraded":"2024-08-31T05:29:27.840063+0000","last_fullsized":"2024-08-31T05:29:27.840063+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:50:17.172462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"87'8","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.844837+0000","last_change":"2024-08-31T05:27:31.249162+0000","last_active":"2024-08-31T05:29:27.844837+0000","last_peered":"2024-08-31T05:29:27.844837+0000","last_clean":"2024-08-31T05:29:27.844837+0000","last_became_active":"2024-08-31T05:27:31.248803+0000","last_became_peered":"2024-08-31T05:27:31.248803+0000","last_unstale":"2024-08-31T05:29:27.844837+0000","last_undegraded":"2024-08-31T05:29:27.844837+0000","last_fullsized":"2024-08-31T05:29:27.844837+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:18:05.449612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"87'10","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.851304+0000","last_change":"2024-08-31T05:27:31.258983+0000","last_active":"2024-08-31T05:29:27.851304+0000","last_peered":"2024-08-31T05:29:27.851304+0000","last_clean":"2024-08-31T05:29:27.851304+0000","last_became_active":"2024-08-31T05:27:31.258480+0000","last_became_peered":"2024-08-31T05:27:31.258480+0000","last_unstale":"2024-08-31T05:29:27.851304+0000","last_undegraded":"2024-08-31T05:29:27.851304+0000","last_fullsized":"2024-08-31T05:29:27.851304+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:57:34.589281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"87'11","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.848762+0000","last_change":"2024-08-31T05:27:31.252561+0000","last_active":"2024-08-31T05:29:27.848762+0000","last_peered":"2024-08-31T05:29:27.848762+0000","last_clean":"2024-08-31T05:29:27.848762+0000","last_became_active":"2024-08-31T05:27:31.251963+0000","last_became_peered":"2024-08-31T05:27:31.251963+0000","last_unstale":"2024-08-31T05:29:27.848762+0000","last_undegraded":"2024-08-31T05:29:27.848762+0000","last_fullsized":"2024-08-31T05:29:27.848762+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:17:45.244329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"87'8","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.838675+0000","last_change":"2024-08-31T05:27:31.257298+0000","last_active":"2024-08-31T05:29:27.838675+0000","last_peered":"2024-08-31T05:29:27.838675+0000","last_clean":"2024-08-31T05:29:27.838675+0000","last_became_active":"2024-08-31T05:27:31.256935+0000","last_became_peered":"2024-08-31T05:27:31.256935+0000","last_unstale":"2024-08-31T05:29:27.838675+0000","last_undegraded":"2024-08-31T05:29:27.838675+0000","last_fullsized":"2024-08-31T05:29:27.838675+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:07:32.876328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"87'7","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.844384+0000","last_change":"2024-08-31T05:27:31.248456+0000","last_active":"2024-08-31T05:29:27.844384+0000","last_peered":"2024-08-31T05:29:27.844384+0000","last_clean":"2024-08-31T05:29:27.844384+0000","last_became_active":"2024-08-31T05:27:31.248060+0000","last_became_peered":"2024-08-31T05:27:31.248060+0000","last_unstale":"2024-08-31T05:29:27.844384+0000","last_undegraded":"2024-08-31T05:29:27.844384+0000","last_fullsized":"2024-08-31T05:29:27.844384+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:29:35.817409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"87'10","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.845826+0000","last_change":"2024-08-31T05:27:31.251345+0000","last_active":"2024-08-31T05:29:27.845826+0000","last_peered":"2024-08-31T05:29:27.845826+0000","last_clean":"2024-08-31T05:29:27.845826+0000","last_became_active":"2024-08-31T05:27:31.251002+0000","last_became_peered":"2024-08-31T05:27:31.251002+0000","last_unstale":"2024-08-31T05:29:27.845826+0000","last_undegraded":"2024-08-31T05:29:27.845826+0000","last_fullsized":"2024-08-31T05:29:27.845826+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:35:24.564897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"87'8","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.850908+0000","last_change":"2024-08-31T05:27:31.260681+0000","last_active":"2024-08-31T05:29:27.850908+0000","last_peered":"2024-08-31T05:29:27.850908+0000","last_clean":"2024-08-31T05:29:27.850908+0000","last_became_active":"2024-08-31T05:27:31.259445+0000","last_became_peered":"2024-08-31T05:27:31.259445+0000","last_unstale":"2024-08-31T05:29:27.850908+0000","last_undegraded":"2024-08-31T05:29:27.850908+0000","last_fullsized":"2024-08-31T05:29:27.850908+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:41:43.480946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"87'9","reported_seq":44,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.850222+0000","last_change":"2024-08-31T05:27:31.263950+0000","last_active":"2024-08-31T05:29:27.850222+0000","last_peered":"2024-08-31T05:29:27.850222+0000","last_clean":"2024-08-31T05:29:27.850222+0000","last_became_active":"2024-08-31T05:27:31.263568+0000","last_became_peered":"2024-08-31T05:27:31.263568+0000","last_unstale":"2024-08-31T05:29:27.850222+0000","last_undegraded":"2024-08-31T05:29:27.850222+0000","last_fullsized":"2024-08-31T05:29:27.850222+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:50:05.111796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"87'7","reported_seq":49,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.833978+0000","last_change":"2024-08-31T05:27:58.508829+0000","last_active":"2024-08-31T05:29:27.833978+0000","last_peered":"2024-08-31T05:29:27.833978+0000","last_clean":"2024-08-31T05:29:27.833978+0000","last_became_active":"2024-08-31T05:27:58.508378+0000","last_became_peered":"2024-08-31T05:27:58.508378+0000","last_unstale":"2024-08-31T05:29:27.833978+0000","last_undegraded":"2024-08-31T05:29:27.833978+0000","last_fullsized":"2024-08-31T05:29:27.833978+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:05:46.254003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"87'7","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.832512+0000","last_change":"2024-08-31T05:27:31.261012+0000","last_active":"2024-08-31T05:29:27.832512+0000","last_peered":"2024-08-31T05:29:27.832512+0000","last_clean":"2024-08-31T05:29:27.832512+0000","last_became_active":"2024-08-31T05:27:31.259373+0000","last_became_peered":"2024-08-31T05:27:31.259373+0000","last_unstale":"2024-08-31T05:29:27.832512+0000","last_undegraded":"2024-08-31T05:29:27.832512+0000","last_fullsized":"2024-08-31T05:29:27.832512+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:15:34.711961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"87'10","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.827232+0000","last_change":"2024-08-31T05:27:31.255199+0000","last_active":"2024-08-31T05:29:27.827232+0000","last_peered":"2024-08-31T05:29:27.827232+0000","last_clean":"2024-08-31T05:29:27.827232+0000","last_became_active":"2024-08-31T05:27:31.254833+0000","last_became_peered":"2024-08-31T05:27:31.254833+0000","last_unstale":"2024-08-31T05:29:27.827232+0000","last_undegraded":"2024-08-31T05:29:27.827232+0000","last_fullsized":"2024-08-31T05:29:27.827232+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:55:09.426531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"87'7","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.843236+0000","last_change":"2024-08-31T05:27:31.264881+0000","last_active":"2024-08-31T05:29:27.843236+0000","last_peered":"2024-08-31T05:29:27.843236+0000","last_clean":"2024-08-31T05:29:27.843236+0000","last_became_active":"2024-08-31T05:27:31.264483+0000","last_became_peered":"2024-08-31T05:27:31.264483+0000","last_unstale":"2024-08-31T05:29:27.843236+0000","last_undegraded":"2024-08-31T05:29:27.843236+0000","last_fullsized":"2024-08-31T05:29:27.843236+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:48:55.193321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"87'6","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.850856+0000","last_change":"2024-08-31T05:27:31.258555+0000","last_active":"2024-08-31T05:29:27.850856+0000","last_peered":"2024-08-31T05:29:27.850856+0000","last_clean":"2024-08-31T05:29:27.850856+0000","last_became_active":"2024-08-31T05:27:31.258023+0000","last_became_peered":"2024-08-31T05:27:31.258023+0000","last_unstale":"2024-08-31T05:29:27.850856+0000","last_undegraded":"2024-08-31T05:29:27.850856+0000","last_fullsized":"2024-08-31T05:29:27.850856+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:26:34.911641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"87'16","reported_seq":51,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.845099+0000","last_change":"2024-08-31T05:27:31.249886+0000","last_active":"2024-08-31T05:29:27.845099+0000","last_peered":"2024-08-31T05:29:27.845099+0000","last_clean":"2024-08-31T05:29:27.845099+0000","last_became_active":"2024-08-31T05:27:31.248549+0000","last_became_peered":"2024-08-31T05:27:31.248549+0000","last_unstale":"2024-08-31T05:29:27.845099+0000","last_undegraded":"2024-08-31T05:29:27.845099+0000","last_fullsized":"2024-08-31T05:29:27.845099+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:57:55.743286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"87'11","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.850202+0000","last_change":"2024-08-31T05:27:31.261697+0000","last_active":"2024-08-31T05:29:27.850202+0000","last_peered":"2024-08-31T05:29:27.850202+0000","last_clean":"2024-08-31T05:29:27.850202+0000","last_became_active":"2024-08-31T05:27:31.260398+0000","last_became_peered":"2024-08-31T05:27:31.260398+0000","last_unstale":"2024-08-31T05:29:27.850202+0000","last_undegraded":"2024-08-31T05:29:27.850202+0000","last_fullsized":"2024-08-31T05:29:27.850202+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:08:03.999556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"87'9","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.844401+0000","last_change":"2024-08-31T05:27:31.256638+0000","last_active":"2024-08-31T05:29:27.844401+0000","last_peered":"2024-08-31T05:29:27.844401+0000","last_clean":"2024-08-31T05:29:27.844401+0000","last_became_active":"2024-08-31T05:27:31.256302+0000","last_became_peered":"2024-08-31T05:27:31.256302+0000","last_unstale":"2024-08-31T05:29:27.844401+0000","last_undegraded":"2024-08-31T05:29:27.844401+0000","last_fullsized":"2024-08-31T05:29:27.844401+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:31:58.946448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"87'5","reported_seq":40,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.841699+0000","last_change":"2024-08-31T05:27:31.253818+0000","last_active":"2024-08-31T05:29:27.841699+0000","last_peered":"2024-08-31T05:29:27.841699+0000","last_clean":"2024-08-31T05:29:27.841699+0000","last_became_active":"2024-08-31T05:27:31.253423+0000","last_became_peered":"2024-08-31T05:27:31.253423+0000","last_unstale":"2024-08-31T05:29:27.841699+0000","last_undegraded":"2024-08-31T05:29:27.841699+0000","last_fullsized":"2024-08-31T05:29:27.841699+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T05:45:43.951022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"87'6","reported_seq":40,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.835914+0000","last_change":"2024-08-31T05:27:31.247171+0000","last_active":"2024-08-31T05:29:27.835914+0000","last_peered":"2024-08-31T05:29:27.835914+0000","last_clean":"2024-08-31T05:29:27.835914+0000","last_became_active":"2024-08-31T05:27:31.246791+0000","last_became_peered":"2024-08-31T05:27:31.246791+0000","last_unstale":"2024-08-31T05:29:27.835914+0000","last_undegraded":"2024-08-31T05:29:27.835914+0000","last_fullsized":"2024-08-31T05:29:27.835914+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:26:12.163389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"87'4","reported_seq":39,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.845282+0000","last_change":"2024-08-31T05:27:31.257848+0000","last_active":"2024-08-31T05:29:27.845282+0000","last_peered":"2024-08-31T05:29:27.845282+0000","last_clean":"2024-08-31T05:29:27.845282+0000","last_became_active":"2024-08-31T05:27:31.257432+0000","last_became_peered":"2024-08-31T05:27:31.257432+0000","last_unstale":"2024-08-31T05:29:27.845282+0000","last_undegraded":"2024-08-31T05:29:27.845282+0000","last_fullsized":"2024-08-31T05:29:27.845282+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:08:12.512834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"87'8","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.844807+0000","last_change":"2024-08-31T05:27:31.263998+0000","last_active":"2024-08-31T05:29:27.844807+0000","last_peered":"2024-08-31T05:29:27.844807+0000","last_clean":"2024-08-31T05:29:27.844807+0000","last_became_active":"2024-08-31T05:27:31.263638+0000","last_became_peered":"2024-08-31T05:27:31.263638+0000","last_unstale":"2024-08-31T05:29:27.844807+0000","last_undegraded":"2024-08-31T05:29:27.844807+0000","last_fullsized":"2024-08-31T05:29:27.844807+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:07:50.470538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"87'7","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.834442+0000","last_change":"2024-08-31T05:27:31.260600+0000","last_active":"2024-08-31T05:29:27.834442+0000","last_peered":"2024-08-31T05:29:27.834442+0000","last_clean":"2024-08-31T05:29:27.834442+0000","last_became_active":"2024-08-31T05:27:31.259605+0000","last_became_peered":"2024-08-31T05:27:31.259605+0000","last_unstale":"2024-08-31T05:29:27.834442+0000","last_undegraded":"2024-08-31T05:29:27.834442+0000","last_fullsized":"2024-08-31T05:29:27.834442+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:04:16.861879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"87'4","reported_seq":39,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.834461+0000","last_change":"2024-08-31T05:27:31.256585+0000","last_active":"2024-08-31T05:29:27.834461+0000","last_peered":"2024-08-31T05:29:27.834461+0000","last_clean":"2024-08-31T05:29:27.834461+0000","last_became_active":"2024-08-31T05:27:31.256118+0000","last_became_peered":"2024-08-31T05:27:31.256118+0000","last_unstale":"2024-08-31T05:29:27.834461+0000","last_undegraded":"2024-08-31T05:29:27.834461+0000","last_fullsized":"2024-08-31T05:29:27.834461+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:47:18.891150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"87'8","reported_seq":43,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-08-31T05:29:27.850683+0000","last_change":"2024-08-31T05:27:31.260321+0000","last_active":"2024-08-31T05:29:27.850683+0000","last_peered":"2024-08-31T05:29:27.850683+0000","last_clean":"2024-08-31T05:29:27.850683+0000","last_became_active":"2024-08-31T05:27:31.259901+0000","last_became_peered":"2024-08-31T05:27:31.259901+0000","last_unstale":"2024-08-31T05:29:27.850683+0000","last_undegraded":"2024-08-31T05:29:27.850683+0000","last_fullsized":"2024-08-31T05:29:27.850683+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T05:27:30.225391+0000","last_clean_scrub_stamp":"2024-08-31T05:27:30.225391+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:44:26.651338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":76578,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1112,"num_read_kb":639,"num_write":270,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":229734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":232,"ondisk_log_size":232,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":280617,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678060,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36288,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708864,"statfs":{"total":95995035648,"available":95957876736,"internally_reserved":0,"allocated":966656,"data_stored":509871,"data_compressed":29581,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874289,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36440,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708712,"statfs":{"total":95995035648,"available":95957721088,"internally_reserved":0,"allocated":1122304,"data_stored":1164606,"data_compressed":65266,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037814,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36316,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708836,"statfs":{"total":95995035648,"available":95957848064,"internally_reserved":0,"allocated":995328,"data_stored":513506,"data_compressed":29581,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234043,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":978944,"data_stored":509116,"data_compressed":29581,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430272,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1040384,"data_stored":1107266,"data_compressed":65266,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593797,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":505446,"data_compressed":29581,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790027,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36368,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708784,"statfs":{"total":95995035648,"available":95957794816,"internally_reserved":0,"allocated":1048576,"data_stored":1102008,"data_compressed":65266,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953552,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":510450,"data_compressed":29581,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149781,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":978944,"data_stored":504622,"data_compressed":29581,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378714,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36372,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708780,"statfs":{"total":95995035648,"available":95957790720,"internally_reserved":0,"allocated":1052672,"data_stored":574326,"data_compressed":29581,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542239,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36368,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708784,"statfs":{"total":95995035648,"available":95957794816,"internally_reserved":0,"allocated":1048576,"data_stored":575541,"data_compressed":29581,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705764,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36312,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708840,"statfs":{"total":95995035648,"available":95957852160,"internally_reserved":0,"allocated":991232,"data_stored":506761,"data_compressed":29581,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34064,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34064,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34064,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35685,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":71349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":70134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":70437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T05:30:02.513 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T05:30:02.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:02 smithi005 ceph-mon[18602]: pgmap v347: 129 pgs: 129 active+clean; 652 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-08-31T05:30:02.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:02 smithi005 ceph-mon[18602]: from='client.15576 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T05:30:02.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:02 smithi005 ceph-mon[18602]: from='client.15582 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T05:30:02.765 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:30:02.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:02 smithi050 ceph-mon[22146]: pgmap v347: 129 pgs: 129 active+clean; 652 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-08-31T05:30:02.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:02 smithi050 ceph-mon[22146]: from='client.15576 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T05:30:02.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:02 smithi050 ceph-mon[22146]: from='client.15582 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T05:30:03.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:02 smithi070 ceph-mon[22316]: pgmap v347: 129 pgs: 129 active+clean; 652 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-08-31T05:30:03.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:02 smithi070 ceph-mon[22316]: from='client.15576 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T05:30:03.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:02 smithi070 ceph-mon[22316]: from='client.15582 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T05:30:03.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:03.256+0000 7fda7f3a2640 1 -- 172.21.15.5:0/2023460765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda78108a90 msgr2=0x7fda7810f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:03.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:03.256+0000 7fda7f3a2640 1 --2- 172.21.15.5:0/2023460765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda78108a90 0x7fda7810f2c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fda70009ca0 tx=0x7fda7002a8c0 comp rx=0 tx=0).stop 2024-08-31T05:30:03.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:03.256+0000 7fda7f3a2640 1 -- 172.21.15.5:0/2023460765 shutdown_connections 2024-08-31T05:30:03.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:03.256+0000 7fda7f3a2640 1 --2- 172.21.15.5:0/2023460765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda78108a90 0x7fda7810f2c0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:03.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:03.256+0000 7fda7f3a2640 1 --2- 172.21.15.5:0/2023460765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda78108140 0x7fda78108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:03.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:03.256+0000 7fda7f3a2640 1 --2- 172.21.15.5:0/2023460765 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda78102800 0x7fda78102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:03.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:03.256+0000 7fda7f3a2640 1 -- 172.21.15.5:0/2023460765 >> 172.21.15.5:0/2023460765 conn(0x7fda780794d0 msgr2=0x7fda780798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:03.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:03.256+0000 7fda7f3a2640 1 -- 172.21.15.5:0/2023460765 shutdown_connections 2024-08-31T05:30:03.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:03.257+0000 7fda7f3a2640 1 -- 172.21.15.5:0/2023460765 wait complete. 2024-08-31T05:30:03.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:03.257+0000 7fda7f3a2640 1 Processor -- start 2024-08-31T05:30:03.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:03.257+0000 7fda7f3a2640 1 -- start start 2024-08-31T05:30:03.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:03.258+0000 7fda7f3a2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda78102800 0x7fda7819a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:03.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:03.258+0000 7fda7f3a2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda78108140 0x7fda7819a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:03.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:03.258+0000 7fda7f3a2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda78108a90 0x7fda7819fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:03.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:03.258+0000 7fda7f3a2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fda78112760 con 0x7fda78108140 2024-08-31T05:30:03.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:03.258+0000 7fda7f3a2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fda781125e0 con 0x7fda78102800 2024-08-31T05:30:03.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:03.258+0000 7fda7f3a2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fda781128e0 con 0x7fda78108a90 2024-08-31T05:30:03.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:03.258+0000 7fda7c93d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda78108140 0x7fda7819a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:03.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:03.258+0000 7fda7c93d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda78108140 0x7fda7819a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41658/0 (socket says 172.21.15.5:41658) 2024-08-31T05:30:03.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:03.258+0000 7fda7c93d640 1 -- 172.21.15.5:0/2046022740 learned_addr learned my addr 172.21.15.5:0/2046022740 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:03.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:03.258+0000 7fda7d13e640 1 --2- 172.21.15.5:0/2046022740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda78102800 0x7fda7819a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:03.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:03.258+0000 7fda7d93f640 1 --2- 172.21.15.5:0/2046022740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda78108a90 0x7fda7819fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:03.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:03.258+0000 7fda7c93d640 1 -- 172.21.15.5:0/2046022740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda78108a90 msgr2=0x7fda7819fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:03.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:03.258+0000 7fda7c93d640 1 --2- 172.21.15.5:0/2046022740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda78108a90 0x7fda7819fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:03.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:03.258+0000 7fda7c93d640 1 -- 172.21.15.5:0/2046022740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda78102800 msgr2=0x7fda7819a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:03.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:03.258+0000 7fda7c93d640 1 --2- 172.21.15.5:0/2046022740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda78102800 0x7fda7819a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:03.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:03.258+0000 7fda7c93d640 1 -- 172.21.15.5:0/2046022740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda781a01b0 con 0x7fda78108140 2024-08-31T05:30:03.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:03.258+0000 7fda7c93d640 1 --2- 172.21.15.5:0/2046022740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda78108140 0x7fda7819a7e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fda6800d770 tx=0x7fda6800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:03.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:03.259+0000 7fda6e7fc640 1 -- 172.21.15.5:0/2046022740 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda68017070 con 0x7fda78108140 2024-08-31T05:30:03.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:03.259+0000 7fda7f3a2640 1 -- 172.21.15.5:0/2046022740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda781a04a0 con 0x7fda78108140 2024-08-31T05:30:03.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:03.259+0000 7fda6e7fc640 1 -- 172.21.15.5:0/2046022740 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda68009c30 con 0x7fda78108140 2024-08-31T05:30:03.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:03.259+0000 7fda6e7fc640 1 -- 172.21.15.5:0/2046022740 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda6800f620 con 0x7fda78108140 2024-08-31T05:30:03.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:03.259+0000 7fda7f3a2640 1 -- 172.21.15.5:0/2046022740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda780ff2f0 con 0x7fda78108140 2024-08-31T05:30:03.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:03.260+0000 7fda7f3a2640 1 -- 172.21.15.5:0/2046022740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda78102c10 con 0x7fda78108140 2024-08-31T05:30:03.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:03.263+0000 7fda6e7fc640 1 -- 172.21.15.5:0/2046022740 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 23) ==== 152644+0+0 (secure 0 0 0) 0x7fda6801a070 con 0x7fda78108140 2024-08-31T05:30:03.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:03.264+0000 7fda6e7fc640 1 --2- 172.21.15.5:0/2046022740 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fda640b9020 0x7fda640bb530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:03.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:03.264+0000 7fda7d13e640 1 --2- 172.21.15.5:0/2046022740 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fda640b9020 0x7fda640bb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:03.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:03.264+0000 7fda6e7fc640 1 -- 172.21.15.5:0/2046022740 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fda680e5190 con 0x7fda78108140 2024-08-31T05:30:03.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:03.264+0000 7fda7d13e640 1 --2- 172.21.15.5:0/2046022740 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fda640b9020 0x7fda640bb530 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fda74009bd0 tx=0x7fda74005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:03.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:03.267+0000 7fda6e7fc640 1 -- 172.21.15.5:0/2046022740 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fda68009de0 con 0x7fda78108140 2024-08-31T05:30:03.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:03.492+0000 7fda7f3a2640 1 -- 172.21.15.5:0/2046022740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fda7819b370 con 0x7fda78108140 2024-08-31T05:30:03.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:03.493+0000 7fda6e7fc640 1 -- 172.21.15.5:0/2046022740 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11941 (secure 0 0 0) 0x7fda7819b370 con 0x7fda78108140 2024-08-31T05:30:03.496 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:30:03.496 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":30,"btime":"2024-08-31T05:29:57:563015+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14739,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2024812199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2024812199},{"type":"v1","addr":"172.21.15.5:6835","nonce":2024812199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3629023702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3629023702},{"type":"v1","addr":"172.21.15.5:6837","nonce":3629023702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T05:27:31.929153+0000","modified":"2024-08-31T05:29:56.645530+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24652,"mds_1":24638,"mds_2":24631,"mds_3":24625,"mds_4":24602},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6839/2412701258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":2412701258},{"type":"v1","addr":"172.21.15.5:6839","nonce":2412701258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14820":{"gid":14820,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6841/747057838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":747057838},{"type":"v1","addr":"172.21.15.5:6841","nonce":747057838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6833/1153378982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1153378982},{"type":"v1","addr":"172.21.15.50:6833","nonce":1153378982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6833/364083443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":364083443},{"type":"v1","addr":"172.21.15.70:6833","nonce":364083443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24587":{"gid":24587,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/2346896794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2346896794},{"type":"v1","addr":"172.21.15.50:6835","nonce":2346896794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24602":{"gid":24602,"name":"h","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.50:6837/428759669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":428759669},{"type":"v1","addr":"172.21.15.50:6837","nonce":428759669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.70:6835/2061504114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2061504114},{"type":"v1","addr":"172.21.15.70:6835","nonce":2061504114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.70:6837/2780036414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2780036414},{"type":"v1","addr":"172.21.15.70:6837","nonce":2780036414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.50:6839/98200944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":98200944},{"type":"v1","addr":"172.21.15.50:6839","nonce":98200944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24652":{"gid":24652,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.70:6839/2756569250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":2756569250},{"type":"v1","addr":"172.21.15.70:6839","nonce":2756569250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24652,"qdb_cluster":[24652,24631,24638,24625,24602]},"id":1}]} 2024-08-31T05:30:03.496 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 30 2024-08-31T05:30:03.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:03.495+0000 7fda7f3a2640 1 -- 172.21.15.5:0/2046022740 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fda640b9020 msgr2=0x7fda640bb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:03.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:03.495+0000 7fda7f3a2640 1 --2- 172.21.15.5:0/2046022740 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fda640b9020 0x7fda640bb530 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fda74009bd0 tx=0x7fda74005f90 comp rx=0 tx=0).stop 2024-08-31T05:30:03.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:03.495+0000 7fda7f3a2640 1 -- 172.21.15.5:0/2046022740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda78108140 msgr2=0x7fda7819a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:03.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:03.495+0000 7fda7f3a2640 1 --2- 172.21.15.5:0/2046022740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda78108140 0x7fda7819a7e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fda6800d770 tx=0x7fda6800dc30 comp rx=0 tx=0).stop 2024-08-31T05:30:03.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:03.496+0000 7fda7f3a2640 1 -- 172.21.15.5:0/2046022740 shutdown_connections 2024-08-31T05:30:03.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:03.496+0000 7fda7f3a2640 1 --2- 172.21.15.5:0/2046022740 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fda640b9020 0x7fda640bb530 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:03.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:03.496+0000 7fda7f3a2640 1 --2- 172.21.15.5:0/2046022740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda78108a90 0x7fda7819fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:03.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:03.496+0000 7fda7f3a2640 1 --2- 172.21.15.5:0/2046022740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda78108140 0x7fda7819a7e0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:03.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:03.496+0000 7fda7f3a2640 1 --2- 172.21.15.5:0/2046022740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fda78102800 0x7fda7819a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:03.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:03.496+0000 7fda7f3a2640 1 -- 172.21.15.5:0/2046022740 >> 172.21.15.5:0/2046022740 conn(0x7fda780794d0 msgr2=0x7fda7806af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:03.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:03.496+0000 7fda7f3a2640 1 -- 172.21.15.5:0/2046022740 shutdown_connections 2024-08-31T05:30:03.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:03.496+0000 7fda7f3a2640 1 -- 172.21.15.5:0/2046022740 wait complete. 2024-08-31T05:30:03.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:03 smithi050 ceph-mon[22146]: from='client.15588 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T05:30:03.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:03 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/2046022740' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:30:03.915 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:03 smithi005 ceph-mon[18602]: from='client.15588 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T05:30:03.915 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:03 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/2046022740' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:30:04.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:03 smithi070 ceph-mon[22316]: from='client.15588 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T05:30:04.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:03 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/2046022740' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:30:04.166 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T05:30:04.420 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:30:04.824 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:04 smithi005 ceph-mon[18602]: pgmap v348: 129 pgs: 129 active+clean; 654 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-08-31T05:30:04.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:04 smithi050 ceph-mon[22146]: pgmap v348: 129 pgs: 129 active+clean; 654 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-08-31T05:30:04.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:04.913+0000 7f06f91e1640 1 -- 172.21.15.5:0/3650509964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06f4109be0 msgr2=0x7f06f4110410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:04.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:04.913+0000 7f06f91e1640 1 --2- 172.21.15.5:0/3650509964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06f4109be0 0x7f06f4110410 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f06ec009ca0 tx=0x7f06ec02a8e0 comp rx=0 tx=0).stop 2024-08-31T05:30:04.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:04.913+0000 7f06f91e1640 1 -- 172.21.15.5:0/3650509964 shutdown_connections 2024-08-31T05:30:04.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:04.913+0000 7f06f91e1640 1 --2- 172.21.15.5:0/3650509964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06f4109be0 0x7f06f4110410 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:04.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:04.913+0000 7f06f91e1640 1 --2- 172.21.15.5:0/3650509964 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06f4109290 0x7f06f41096a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:04.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:04.913+0000 7f06f91e1640 1 --2- 172.21.15.5:0/3650509964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06f4103950 0x7f06f4103d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:04.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:04.913+0000 7f06f91e1640 1 -- 172.21.15.5:0/3650509964 >> 172.21.15.5:0/3650509964 conn(0x7f06f40ff3a0 msgr2=0x7f06f41017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:04.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:04.913+0000 7f06f91e1640 1 -- 172.21.15.5:0/3650509964 shutdown_connections 2024-08-31T05:30:04.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:04.913+0000 7f06f91e1640 1 -- 172.21.15.5:0/3650509964 wait complete. 2024-08-31T05:30:04.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:04.914+0000 7f06f91e1640 1 Processor -- start 2024-08-31T05:30:04.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:04.914+0000 7f06f91e1640 1 -- start start 2024-08-31T05:30:04.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:04.914+0000 7f06f91e1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06f4103950 0x7f06f40754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:04.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:04.914+0000 7f06f91e1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06f4109290 0x7f06f40759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:04.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:04.914+0000 7f06f91e1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06f4109be0 0x7f06f4075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:04.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:04.914+0000 7f06f91e1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f06f41138e0 con 0x7f06f4103950 2024-08-31T05:30:04.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:04.914+0000 7f06f91e1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f06f4113760 con 0x7f06f4109290 2024-08-31T05:30:04.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:04.914+0000 7f06f91e1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f06f4113a60 con 0x7f06f4109be0 2024-08-31T05:30:04.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:04.915+0000 7f06f2d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06f4103950 0x7f06f40754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:04.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:04.915+0000 7f06f2d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06f4103950 0x7f06f40754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41676/0 (socket says 172.21.15.5:41676) 2024-08-31T05:30:04.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:04.915+0000 7f06f2d9d640 1 -- 172.21.15.5:0/1077989245 learned_addr learned my addr 172.21.15.5:0/1077989245 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:04.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:04.915+0000 7f06f259c640 1 --2- 172.21.15.5:0/1077989245 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06f4109290 0x7f06f40759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:04.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:04.915+0000 7f06f359e640 1 --2- 172.21.15.5:0/1077989245 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06f4109be0 0x7f06f4075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:04.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:04.915+0000 7f06f2d9d640 1 -- 172.21.15.5:0/1077989245 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06f4109be0 msgr2=0x7f06f4075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:04.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:04.915+0000 7f06f2d9d640 1 --2- 172.21.15.5:0/1077989245 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06f4109be0 0x7f06f4075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:04.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:04.915+0000 7f06f2d9d640 1 -- 172.21.15.5:0/1077989245 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06f4109290 msgr2=0x7f06f40759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:04.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:04.915+0000 7f06f2d9d640 1 --2- 172.21.15.5:0/1077989245 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06f4109290 0x7f06f40759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:04.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:04.915+0000 7f06f2d9d640 1 -- 172.21.15.5:0/1077989245 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06f41a8510 con 0x7f06f4103950 2024-08-31T05:30:04.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:04.915+0000 7f06f259c640 1 --2- 172.21.15.5:0/1077989245 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06f4109290 0x7f06f40759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:30:04.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:04.915+0000 7f06f2d9d640 1 --2- 172.21.15.5:0/1077989245 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06f4103950 0x7f06f40754b0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f06e400c890 tx=0x7f06e400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:04.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:04.915+0000 7f06dbfff640 1 -- 172.21.15.5:0/1077989245 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e4004220 con 0x7f06f4103950 2024-08-31T05:30:04.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:04.915+0000 7f06dbfff640 1 -- 172.21.15.5:0/1077989245 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06e40043c0 con 0x7f06f4103950 2024-08-31T05:30:04.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:04.915+0000 7f06f91e1640 1 -- 172.21.15.5:0/1077989245 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06f41a8800 con 0x7f06f4103950 2024-08-31T05:30:04.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:04.915+0000 7f06dbfff640 1 -- 172.21.15.5:0/1077989245 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e4004a00 con 0x7f06f4103950 2024-08-31T05:30:04.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:04.915+0000 7f06f91e1640 1 -- 172.21.15.5:0/1077989245 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06f41a8dc0 con 0x7f06f4103950 2024-08-31T05:30:04.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:04.916+0000 7f06f91e1640 1 -- 172.21.15.5:0/1077989245 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06f4103d60 con 0x7f06f4103950 2024-08-31T05:30:04.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:04.918+0000 7f06dbfff640 1 -- 172.21.15.5:0/1077989245 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 23) ==== 152644+0+0 (secure 0 0 0) 0x7f06e40079b0 con 0x7f06f4103950 2024-08-31T05:30:04.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:04.919+0000 7f06dbfff640 1 --2- 172.21.15.5:0/1077989245 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f06dc0b4c10 0x7f06dc0b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:04.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:04.919+0000 7f06f259c640 1 --2- 172.21.15.5:0/1077989245 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f06dc0b4c10 0x7f06dc0b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:04.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:04.919+0000 7f06dbfff640 1 -- 172.21.15.5:0/1077989245 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f06e40e5a20 con 0x7f06f4103950 2024-08-31T05:30:04.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:04.919+0000 7f06f259c640 1 --2- 172.21.15.5:0/1077989245 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f06dc0b4c10 0x7f06dc0b7120 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f06f4108d30 tx=0x7f06e8008040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:04.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:04.922+0000 7f06dbfff640 1 -- 172.21.15.5:0/1077989245 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f06e4014030 con 0x7f06f4103950 2024-08-31T05:30:05.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:04 smithi070 ceph-mon[22316]: pgmap v348: 129 pgs: 129 active+clean; 654 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-08-31T05:30:05.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:05.108+0000 7f06f91e1640 1 -- 172.21.15.5:0/1077989245 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f06f402e430 con 0x7f06f4103950 2024-08-31T05:30:05.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:05.110+0000 7f06dbfff640 1 -- 172.21.15.5:0/1077989245 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+25122 (secure 0 0 0) 0x7f06e40ac550 con 0x7f06f4103950 2024-08-31T05:30:05.112 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:30:05.112 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":87,"fsid":"69422704-6758-11ef-bcd4-c7b262605968","created":"2024-08-31T05:19:04.860258+0000","modified":"2024-08-31T05:28:59.155542+0000","last_up_change":"2024-08-31T05:26:38.675914+0000","last_in_change":"2024-08-31T05:26:15.366713+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T05:22:49.802575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T05:27:27.835197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T05:27:30.058144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-31T05:27:36.272228+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c5745391-e9d7-4799-9db9-6b34bb91b7df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6803","nonce":2312496244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6805","nonce":2312496244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6809","nonce":2312496244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6807","nonce":2312496244}]},"public_addr":"172.21.15.5:6803/2312496244","cluster_addr":"172.21.15.5:6805/2312496244","heartbeat_back_addr":"172.21.15.5:6809/2312496244","heartbeat_front_addr":"172.21.15.5:6807/2312496244","state":["exists","up"]},{"osd":1,"uuid":"f1903bd7-b2c5-424e-a74e-795f729471db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6801","nonce":2777359361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6803","nonce":2777359361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6807","nonce":2777359361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6805","nonce":2777359361}]},"public_addr":"172.21.15.50:6801/2777359361","cluster_addr":"172.21.15.50:6803/2777359361","heartbeat_back_addr":"172.21.15.50:6807/2777359361","heartbeat_front_addr":"172.21.15.50:6805/2777359361","state":["exists","up"]},{"osd":2,"uuid":"134c5892-e44a-44f2-8cd2-484d22a45e2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6801","nonce":1400583716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6803","nonce":1400583716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6807","nonce":1400583716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6805","nonce":1400583716}]},"public_addr":"172.21.15.70:6801/1400583716","cluster_addr":"172.21.15.70:6803/1400583716","heartbeat_back_addr":"172.21.15.70:6807/1400583716","heartbeat_front_addr":"172.21.15.70:6805/1400583716","state":["exists","up"]},{"osd":3,"uuid":"af49398a-e171-496b-a50e-1f767fc42923","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6811","nonce":1647468379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6813","nonce":1647468379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6817","nonce":1647468379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6815","nonce":1647468379}]},"public_addr":"172.21.15.5:6811/1647468379","cluster_addr":"172.21.15.5:6813/1647468379","heartbeat_back_addr":"172.21.15.5:6817/1647468379","heartbeat_front_addr":"172.21.15.5:6815/1647468379","state":["exists","up"]},{"osd":4,"uuid":"59b847ef-6eb0-4c13-aa06-53a76d77ce45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6809","nonce":2314546877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6811","nonce":2314546877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6815","nonce":2314546877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6813","nonce":2314546877}]},"public_addr":"172.21.15.50:6809/2314546877","cluster_addr":"172.21.15.50:6811/2314546877","heartbeat_back_addr":"172.21.15.50:6815/2314546877","heartbeat_front_addr":"172.21.15.50:6813/2314546877","state":["exists","up"]},{"osd":5,"uuid":"b0dac185-4462-4760-aa36-0d221923b007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6809","nonce":311426299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6811","nonce":311426299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6815","nonce":311426299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6813","nonce":311426299}]},"public_addr":"172.21.15.70:6809/311426299","cluster_addr":"172.21.15.70:6811/311426299","heartbeat_back_addr":"172.21.15.70:6815/311426299","heartbeat_front_addr":"172.21.15.70:6813/311426299","state":["exists","up"]},{"osd":6,"uuid":"12486aa2-61e4-4bdf-94dd-ce5c4cd3df6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6819","nonce":1027645612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6821","nonce":1027645612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6825","nonce":1027645612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6823","nonce":1027645612}]},"public_addr":"172.21.15.5:6819/1027645612","cluster_addr":"172.21.15.5:6821/1027645612","heartbeat_back_addr":"172.21.15.5:6825/1027645612","heartbeat_front_addr":"172.21.15.5:6823/1027645612","state":["exists","up"]},{"osd":7,"uuid":"66f9dcf9-d5c3-4016-812f-d9496e9892d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6817","nonce":2718354517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6819","nonce":2718354517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6823","nonce":2718354517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6821","nonce":2718354517}]},"public_addr":"172.21.15.50:6817/2718354517","cluster_addr":"172.21.15.50:6819/2718354517","heartbeat_back_addr":"172.21.15.50:6823/2718354517","heartbeat_front_addr":"172.21.15.50:6821/2718354517","state":["exists","up"]},{"osd":8,"uuid":"584837f9-af4b-4189-a7e5-04156a94a805","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6817","nonce":3155722993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6819","nonce":3155722993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6823","nonce":3155722993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6821","nonce":3155722993}]},"public_addr":"172.21.15.70:6817/3155722993","cluster_addr":"172.21.15.70:6819/3155722993","heartbeat_back_addr":"172.21.15.70:6823/3155722993","heartbeat_front_addr":"172.21.15.70:6821/3155722993","state":["exists","up"]},{"osd":9,"uuid":"ef60de6e-3456-435c-bd48-ed2636cc0d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6827","nonce":2988145512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6829","nonce":2988145512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6833","nonce":2988145512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6831","nonce":2988145512}]},"public_addr":"172.21.15.5:6827/2988145512","cluster_addr":"172.21.15.5:6829/2988145512","heartbeat_back_addr":"172.21.15.5:6833/2988145512","heartbeat_front_addr":"172.21.15.5:6831/2988145512","state":["exists","up"]},{"osd":10,"uuid":"96c5de40-53df-412d-9501-8ce1711a76a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6825","nonce":4168871229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6827","nonce":4168871229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6831","nonce":4168871229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6829","nonce":4168871229}]},"public_addr":"172.21.15.50:6825/4168871229","cluster_addr":"172.21.15.50:6827/4168871229","heartbeat_back_addr":"172.21.15.50:6831/4168871229","heartbeat_front_addr":"172.21.15.50:6829/4168871229","state":["exists","up"]},{"osd":11,"uuid":"20beefe0-59c3-4392-9f61-8d215e9d2de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6825","nonce":2593470535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6827","nonce":2593470535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6831","nonce":2593470535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6829","nonce":2593470535}]},"public_addr":"172.21.15.70:6825/2593470535","cluster_addr":"172.21.15.70:6827/2593470535","heartbeat_back_addr":"172.21.15.70:6831/2593470535","heartbeat_front_addr":"172.21.15.70:6829/2593470535","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:21:56.748083+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:22:21.969492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:22:46.642917+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:23:11.630486+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:23:36.389322+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:24:01.431039+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:24:27.057017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:24:53.628200+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:25:19.356502+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:25:44.958024+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:26:10.804919+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:26:36.849133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":5,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:0/2473024253":"2024-09-01T05:20:57.333680+0000","172.21.15.5:0/2924148490":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/2163558485":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/2111919168":"2024-09-01T05:19:55.663503+0000","172.21.15.5:6801/3616278616":"2024-09-01T05:19:55.663503+0000","172.21.15.5:0/2436421090":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/1570244689":"2024-09-01T05:19:55.663503+0000","172.21.15.5:0/2700448223":"2024-09-01T05:20:57.333680+0000","172.21.15.5:6800/3616278616":"2024-09-01T05:19:55.663503+0000","172.21.15.5:6800/2898463711":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/2450461036":"2024-09-01T05:20:57.333680+0000","172.21.15.5:0/1947189952":"2024-09-01T05:19:55.663503+0000","172.21.15.5:6800/1439868821":"2024-09-01T05:20:57.333680+0000","172.21.15.5:6801/2898463711":"2024-09-01T05:19:31.728664+0000","172.21.15.5:6801/1439868821":"2024-09-01T05:20:57.333680+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T05:30:05.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:05.112+0000 7f06f91e1640 1 -- 172.21.15.5:0/1077989245 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f06dc0b4c10 msgr2=0x7f06dc0b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:05.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:05.112+0000 7f06f91e1640 1 --2- 172.21.15.5:0/1077989245 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f06dc0b4c10 0x7f06dc0b7120 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f06f4108d30 tx=0x7f06e8008040 comp rx=0 tx=0).stop 2024-08-31T05:30:05.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:05.112+0000 7f06f91e1640 1 -- 172.21.15.5:0/1077989245 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06f4103950 msgr2=0x7f06f40754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:05.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:05.112+0000 7f06f91e1640 1 --2- 172.21.15.5:0/1077989245 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06f4103950 0x7f06f40754b0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f06e400c890 tx=0x7f06e400cd50 comp rx=0 tx=0).stop 2024-08-31T05:30:05.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:05.112+0000 7f06f91e1640 1 -- 172.21.15.5:0/1077989245 shutdown_connections 2024-08-31T05:30:05.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:05.112+0000 7f06f91e1640 1 --2- 172.21.15.5:0/1077989245 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f06dc0b4c10 0x7f06dc0b7120 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:05.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:05.112+0000 7f06f91e1640 1 --2- 172.21.15.5:0/1077989245 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06f4109be0 0x7f06f4075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:05.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:05.112+0000 7f06f91e1640 1 --2- 172.21.15.5:0/1077989245 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f06f4109290 0x7f06f40759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:05.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:05.112+0000 7f06f91e1640 1 --2- 172.21.15.5:0/1077989245 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f06f4103950 0x7f06f40754b0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:05.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:05.112+0000 7f06f91e1640 1 -- 172.21.15.5:0/1077989245 >> 172.21.15.5:0/1077989245 conn(0x7f06f40ff3a0 msgr2=0x7f06f41017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:05.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:05.112+0000 7f06f91e1640 1 -- 172.21.15.5:0/1077989245 shutdown_connections 2024-08-31T05:30:05.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:05.112+0000 7f06f91e1640 1 -- 172.21.15.5:0/1077989245 wait complete. 2024-08-31T05:30:05.805 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:05 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/1077989245' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T05:30:05.839 DEBUG:tasks.fwd_scrub:Yielding 2024-08-31T05:30:05.839 INFO:teuthology.run_tasks:Running task exec... 2024-08-31T05:30:05.848 INFO:teuthology.task.exec:Executing custom commands... 2024-08-31T05:30:05.848 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi005.front.sepia.ceph.com 2024-08-31T05:30:05.849 DEBUG:teuthology.orchestra.run.smithi005:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-08-31T05:30:05.849 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-08-31T05:30:05.849 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T05:30:05.849 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T05:30:05.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:05 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/1077989245' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T05:30:05.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:05.969+0000 7f2a94d20640 1 -- 172.21.15.5:0/1921084554 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a90101dc0 msgr2=0x7f2a901021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:05.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:05.969+0000 7f2a94d20640 1 --2- 172.21.15.5:0/1921084554 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a90101dc0 0x7f2a901021d0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f2a80009900 tx=0x7f2a8002a410 comp rx=0 tx=0).stop 2024-08-31T05:30:05.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:05.969+0000 7f2a94d20640 1 -- 172.21.15.5:0/1921084554 shutdown_connections 2024-08-31T05:30:05.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:05.969+0000 7f2a94d20640 1 --2- 172.21.15.5:0/1921084554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a901068f0 0x7f2a90110380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:05.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:05.969+0000 7f2a94d20640 1 --2- 172.21.15.5:0/1921084554 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a90105fa0 0x7f2a901063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:05.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:05.969+0000 7f2a94d20640 1 --2- 172.21.15.5:0/1921084554 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a90101dc0 0x7f2a901021d0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:05.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:05.969+0000 7f2a94d20640 1 -- 172.21.15.5:0/1921084554 >> 172.21.15.5:0/1921084554 conn(0x7f2a90079bf0 msgr2=0x7f2a9007a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:05.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:05.969+0000 7f2a94d20640 1 -- 172.21.15.5:0/1921084554 shutdown_connections 2024-08-31T05:30:05.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:05.969+0000 7f2a94d20640 1 -- 172.21.15.5:0/1921084554 wait complete. 2024-08-31T05:30:05.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:05.970+0000 7f2a94d20640 1 Processor -- start 2024-08-31T05:30:05.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:05.970+0000 7f2a94d20640 1 -- start start 2024-08-31T05:30:05.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:05.970+0000 7f2a94d20640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a90101dc0 0x7f2a9019a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:05.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:05.970+0000 7f2a94d20640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a90105fa0 0x7f2a9019a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:05.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:05.970+0000 7f2a94d20640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a901068f0 0x7f2a9019faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:05.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:05.970+0000 7f2a94d20640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2a901137f0 con 0x7f2a90105fa0 2024-08-31T05:30:05.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:05.970+0000 7f2a94d20640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2a90113670 con 0x7f2a90101dc0 2024-08-31T05:30:05.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:05.970+0000 7f2a94d20640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2a90113970 con 0x7f2a901068f0 2024-08-31T05:30:05.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:05.970+0000 7f2a8dd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a90105fa0 0x7f2a9019a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:05.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:05.970+0000 7f2a8dd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a90105fa0 0x7f2a9019a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41692/0 (socket says 172.21.15.5:41692) 2024-08-31T05:30:05.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:05.970+0000 7f2a8dd9b640 1 -- 172.21.15.5:0/4032675933 learned_addr learned my addr 172.21.15.5:0/4032675933 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:05.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:05.971+0000 7f2a8e59c640 1 --2- 172.21.15.5:0/4032675933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a90101dc0 0x7f2a9019a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:05.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:05.971+0000 7f2a8ed9d640 1 --2- 172.21.15.5:0/4032675933 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a901068f0 0x7f2a9019faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:05.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:05.971+0000 7f2a8dd9b640 1 -- 172.21.15.5:0/4032675933 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a901068f0 msgr2=0x7f2a9019faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:05.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:05.971+0000 7f2a8dd9b640 1 --2- 172.21.15.5:0/4032675933 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a901068f0 0x7f2a9019faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:05.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:05.971+0000 7f2a8dd9b640 1 -- 172.21.15.5:0/4032675933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a90101dc0 msgr2=0x7f2a9019a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:05.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:05.971+0000 7f2a8dd9b640 1 --2- 172.21.15.5:0/4032675933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a90101dc0 0x7f2a9019a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:05.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:05.971+0000 7f2a8dd9b640 1 -- 172.21.15.5:0/4032675933 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a901a0110 con 0x7f2a90105fa0 2024-08-31T05:30:05.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:05.971+0000 7f2a8dd9b640 1 --2- 172.21.15.5:0/4032675933 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a90105fa0 0x7f2a9019a810 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f2a8400d750 tx=0x7f2a8400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:05.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:05.971+0000 7f2a7f7fe640 1 -- 172.21.15.5:0/4032675933 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a84017070 con 0x7f2a90105fa0 2024-08-31T05:30:05.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:05.971+0000 7f2a7f7fe640 1 -- 172.21.15.5:0/4032675933 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2a840054d0 con 0x7f2a90105fa0 2024-08-31T05:30:05.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:05.971+0000 7f2a94d20640 1 -- 172.21.15.5:0/4032675933 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a901a0400 con 0x7f2a90105fa0 2024-08-31T05:30:05.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:05.971+0000 7f2a7f7fe640 1 -- 172.21.15.5:0/4032675933 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a84004c30 con 0x7f2a90105fa0 2024-08-31T05:30:05.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:05.971+0000 7f2a94d20640 1 -- 172.21.15.5:0/4032675933 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a901a6c20 con 0x7f2a90105fa0 2024-08-31T05:30:05.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:05.972+0000 7f2a94d20640 1 -- 172.21.15.5:0/4032675933 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a9006b400 con 0x7f2a90105fa0 2024-08-31T05:30:05.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:05.975+0000 7f2a7f7fe640 1 -- 172.21.15.5:0/4032675933 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 23) ==== 152644+0+0 (secure 0 0 0) 0x7f2a84004dd0 con 0x7f2a90105fa0 2024-08-31T05:30:05.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:05.976+0000 7f2a7f7fe640 1 --2- 172.21.15.5:0/4032675933 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2a780b4c90 0x7f2a780b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:05.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:05.976+0000 7f2a8e59c640 1 --2- 172.21.15.5:0/4032675933 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2a780b4c90 0x7f2a780b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:05.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:05.976+0000 7f2a7f7fe640 1 -- 172.21.15.5:0/4032675933 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f2a840e5630 con 0x7f2a90105fa0 2024-08-31T05:30:05.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:05.977+0000 7f2a8e59c640 1 --2- 172.21.15.5:0/4032675933 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2a780b4c90 0x7f2a780b71a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2a80000c00 tx=0x7f2a80031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:05.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:05.979+0000 7f2a7f7fe640 1 -- 172.21.15.5:0/4032675933 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2a840ac180 con 0x7f2a90105fa0 2024-08-31T05:30:06.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:05 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/1077989245' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T05:30:06.119 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:30:06.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.209+0000 7f2a94d20640 1 -- 172.21.15.5:0/4032675933 --> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f2a900635a0 con 0x7f2a780b4c90 2024-08-31T05:30:06.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.364+0000 7f2a7f7fe640 1 -- 172.21.15.5:0/4032675933 <== mgr.14220 v2:172.21.15.5:6800/2696053609 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f2a900635a0 con 0x7f2a780b4c90 2024-08-31T05:30:06.366 INFO:teuthology.orchestra.run.smithi005.stdout:Schedule set for path / 2024-08-31T05:30:06.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.367+0000 7f2a94d20640 1 -- 172.21.15.5:0/4032675933 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2a780b4c90 msgr2=0x7f2a780b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:06.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.367+0000 7f2a94d20640 1 --2- 172.21.15.5:0/4032675933 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2a780b4c90 0x7f2a780b71a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2a80000c00 tx=0x7f2a80031400 comp rx=0 tx=0).stop 2024-08-31T05:30:06.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.367+0000 7f2a94d20640 1 -- 172.21.15.5:0/4032675933 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a90105fa0 msgr2=0x7f2a9019a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:06.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.367+0000 7f2a94d20640 1 --2- 172.21.15.5:0/4032675933 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a90105fa0 0x7f2a9019a810 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f2a8400d750 tx=0x7f2a8400dc10 comp rx=0 tx=0).stop 2024-08-31T05:30:06.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.367+0000 7f2a94d20640 1 -- 172.21.15.5:0/4032675933 shutdown_connections 2024-08-31T05:30:06.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.367+0000 7f2a94d20640 1 --2- 172.21.15.5:0/4032675933 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2a780b4c90 0x7f2a780b71a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:06.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.367+0000 7f2a94d20640 1 --2- 172.21.15.5:0/4032675933 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a901068f0 0x7f2a9019faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:06.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.367+0000 7f2a94d20640 1 --2- 172.21.15.5:0/4032675933 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a90105fa0 0x7f2a9019a810 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:06.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.367+0000 7f2a94d20640 1 --2- 172.21.15.5:0/4032675933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a90101dc0 0x7f2a9019a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:06.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.367+0000 7f2a94d20640 1 -- 172.21.15.5:0/4032675933 >> 172.21.15.5:0/4032675933 conn(0x7f2a90079bf0 msgr2=0x7f2a90107290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:06.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.367+0000 7f2a94d20640 1 -- 172.21.15.5:0/4032675933 shutdown_connections 2024-08-31T05:30:06.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.367+0000 7f2a94d20640 1 -- 172.21.15.5:0/4032675933 wait complete. 2024-08-31T05:30:06.382 DEBUG:teuthology.orchestra.run.smithi005:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-08-31T05:30:06.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.499+0000 7f4fcbcf4640 1 -- 172.21.15.5:0/3649058042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fc4108090 msgr2=0x7f4fc41084a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:06.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.499+0000 7f4fcbcf4640 1 --2- 172.21.15.5:0/3649058042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fc4108090 0x7f4fc41084a0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4fb4009900 tx=0x7f4fb402a410 comp rx=0 tx=0).stop 2024-08-31T05:30:06.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.499+0000 7f4fcbcf4640 1 -- 172.21.15.5:0/3649058042 shutdown_connections 2024-08-31T05:30:06.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.499+0000 7f4fcbcf4640 1 --2- 172.21.15.5:0/3649058042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fc41089e0 0x7f4fc410f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:06.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.499+0000 7f4fcbcf4640 1 --2- 172.21.15.5:0/3649058042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fc4108090 0x7f4fc41084a0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:06.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.499+0000 7f4fcbcf4640 1 --2- 172.21.15.5:0/3649058042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fc4102760 0x7f4fc4102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:06.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.499+0000 7f4fcbcf4640 1 -- 172.21.15.5:0/3649058042 >> 172.21.15.5:0/3649058042 conn(0x7f4fc40fe160 msgr2=0x7f4fc41005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:06.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.499+0000 7f4fcbcf4640 1 -- 172.21.15.5:0/3649058042 shutdown_connections 2024-08-31T05:30:06.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.499+0000 7f4fcbcf4640 1 -- 172.21.15.5:0/3649058042 wait complete. 2024-08-31T05:30:06.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.500+0000 7f4fcbcf4640 1 Processor -- start 2024-08-31T05:30:06.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.500+0000 7f4fcbcf4640 1 -- start start 2024-08-31T05:30:06.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.500+0000 7f4fcbcf4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fc4102760 0x7f4fc4198d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:06.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.500+0000 7f4fcbcf4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fc4108090 0x7f4fc41992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:06.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.500+0000 7f4fcbcf4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fc41089e0 0x7f4fc41997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:06.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.500+0000 7f4fcbcf4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc4112670 con 0x7f4fc41089e0 2024-08-31T05:30:06.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.500+0000 7f4fcbcf4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc41124f0 con 0x7f4fc4108090 2024-08-31T05:30:06.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.500+0000 7f4fcbcf4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc41127f0 con 0x7f4fc4102760 2024-08-31T05:30:06.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.500+0000 7f4fca291640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fc41089e0 0x7f4fc41997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:06.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.501+0000 7f4fca291640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fc41089e0 0x7f4fc41997f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41728/0 (socket says 172.21.15.5:41728) 2024-08-31T05:30:06.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.501+0000 7f4fca291640 1 -- 172.21.15.5:0/573316124 learned_addr learned my addr 172.21.15.5:0/573316124 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:06.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.501+0000 7f4fc928f640 1 --2- 172.21.15.5:0/573316124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fc4108090 0x7f4fc41992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:06.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.501+0000 7f4fc9a90640 1 --2- 172.21.15.5:0/573316124 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fc4102760 0x7f4fc4198d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:06.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.501+0000 7f4fca291640 1 -- 172.21.15.5:0/573316124 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fc4102760 msgr2=0x7f4fc4198d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:06.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.501+0000 7f4fca291640 1 --2- 172.21.15.5:0/573316124 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fc4102760 0x7f4fc4198d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:06.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.501+0000 7f4fca291640 1 -- 172.21.15.5:0/573316124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fc4108090 msgr2=0x7f4fc41992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:06.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.501+0000 7f4fca291640 1 --2- 172.21.15.5:0/573316124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fc4108090 0x7f4fc41992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:06.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.501+0000 7f4fca291640 1 -- 172.21.15.5:0/573316124 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fc41a8470 con 0x7f4fc41089e0 2024-08-31T05:30:06.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.501+0000 7f4fca291640 1 --2- 172.21.15.5:0/573316124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fc41089e0 0x7f4fc41997f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc00eb10 tx=0x7f4fbc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:06.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.501+0000 7f4fbaffd640 1 -- 172.21.15.5:0/573316124 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc004b20 con 0x7f4fc41089e0 2024-08-31T05:30:06.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.501+0000 7f4fcbcf4640 1 -- 172.21.15.5:0/573316124 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fc41a8760 con 0x7f4fc41089e0 2024-08-31T05:30:06.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.501+0000 7f4fbaffd640 1 -- 172.21.15.5:0/573316124 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fbc004cc0 con 0x7f4fc41089e0 2024-08-31T05:30:06.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.501+0000 7f4fbaffd640 1 -- 172.21.15.5:0/573316124 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc010690 con 0x7f4fc41089e0 2024-08-31T05:30:06.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.501+0000 7f4fcbcf4640 1 -- 172.21.15.5:0/573316124 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fc41a8c80 con 0x7f4fc41089e0 2024-08-31T05:30:06.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.503+0000 7f4fcbcf4640 1 -- 172.21.15.5:0/573316124 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fc4102b70 con 0x7f4fc41089e0 2024-08-31T05:30:06.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.504+0000 7f4fbaffd640 1 -- 172.21.15.5:0/573316124 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 23) ==== 152644+0+0 (secure 0 0 0) 0x7f4fbc005020 con 0x7f4fc41089e0 2024-08-31T05:30:06.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.504+0000 7f4fbaffd640 1 --2- 172.21.15.5:0/573316124 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4fb00b4c10 0x7f4fb00b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:06.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.505+0000 7f4fc9a90640 1 --2- 172.21.15.5:0/573316124 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4fb00b4c10 0x7f4fb00b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:06.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.505+0000 7f4fbaffd640 1 -- 172.21.15.5:0/573316124 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f4fbc0e5da0 con 0x7f4fc41089e0 2024-08-31T05:30:06.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.505+0000 7f4fc9a90640 1 --2- 172.21.15.5:0/573316124 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4fb00b4c10 0x7f4fb00b7120 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4fc4104690 tx=0x7f4fc0005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:06.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.509+0000 7f4fbaffd640 1 -- 172.21.15.5:0/573316124 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4fbc0ac870 con 0x7f4fc41089e0 2024-08-31T05:30:06.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.603+0000 7f209d412640 1 -- 172.21.15.5:0/4097750587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2098102800 msgr2=0x7f2098102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:06.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.603+0000 7f209d412640 1 --2- 172.21.15.5:0/4097750587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2098102800 0x7f2098102c10 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f2088009ca0 tx=0x7f208802a8c0 comp rx=0 tx=0).stop 2024-08-31T05:30:06.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.603+0000 7f209d412640 1 -- 172.21.15.5:0/4097750587 shutdown_connections 2024-08-31T05:30:06.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.603+0000 7f209d412640 1 --2- 172.21.15.5:0/4097750587 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2098108a90 0x7f209810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:06.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.603+0000 7f209d412640 1 --2- 172.21.15.5:0/4097750587 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2098108140 0x7f2098108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:06.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.603+0000 7f209d412640 1 --2- 172.21.15.5:0/4097750587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2098102800 0x7f2098102c10 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:06.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.603+0000 7f209d412640 1 -- 172.21.15.5:0/4097750587 >> 172.21.15.5:0/4097750587 conn(0x7f20980794d0 msgr2=0x7f20980798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:06.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.603+0000 7f209d412640 1 -- 172.21.15.5:0/4097750587 shutdown_connections 2024-08-31T05:30:06.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.603+0000 7f209d412640 1 -- 172.21.15.5:0/4097750587 wait complete. 2024-08-31T05:30:06.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.604+0000 7f209d412640 1 Processor -- start 2024-08-31T05:30:06.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.604+0000 7f209d412640 1 -- start start 2024-08-31T05:30:06.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.604+0000 7f209d412640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2098102800 0x7f209819a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:06.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.604+0000 7f209d412640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2098108140 0x7f209819a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:06.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.604+0000 7f209d412640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2098108a90 0x7f209819faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:06.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.604+0000 7f209d412640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2098112760 con 0x7f2098108a90 2024-08-31T05:30:06.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.604+0000 7f209d412640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f20981125e0 con 0x7f2098108140 2024-08-31T05:30:06.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.604+0000 7f209d412640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f20981128e0 con 0x7f2098102800 2024-08-31T05:30:06.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.604+0000 7f20977fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2098108a90 0x7f209819faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:06.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.604+0000 7f2096ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2098102800 0x7f209819a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:06.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.604+0000 7f20967fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2098108140 0x7f209819a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:06.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.604+0000 7f20977fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2098108a90 0x7f209819faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41742/0 (socket says 172.21.15.5:41742) 2024-08-31T05:30:06.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.604+0000 7f20977fe640 1 -- 172.21.15.5:0/3216410103 learned_addr learned my addr 172.21.15.5:0/3216410103 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:06.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.605+0000 7f20977fe640 1 -- 172.21.15.5:0/3216410103 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2098102800 msgr2=0x7f209819a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:06.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.605+0000 7f20977fe640 1 --2- 172.21.15.5:0/3216410103 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2098102800 0x7f209819a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:06.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.605+0000 7f20977fe640 1 -- 172.21.15.5:0/3216410103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2098108140 msgr2=0x7f209819a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:06.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.605+0000 7f20977fe640 1 --2- 172.21.15.5:0/3216410103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2098108140 0x7f209819a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:06.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.605+0000 7f20977fe640 1 -- 172.21.15.5:0/3216410103 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20981a01d0 con 0x7f2098108a90 2024-08-31T05:30:06.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.605+0000 7f20977fe640 1 --2- 172.21.15.5:0/3216410103 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2098108a90 0x7f209819faa0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f209000d750 tx=0x7f209000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:06.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.607+0000 7f207ffff640 1 -- 172.21.15.5:0/3216410103 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2090017070 con 0x7f2098108a90 2024-08-31T05:30:06.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.607+0000 7f207ffff640 1 -- 172.21.15.5:0/3216410103 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20900054d0 con 0x7f2098108a90 2024-08-31T05:30:06.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.607+0000 7f207ffff640 1 -- 172.21.15.5:0/3216410103 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2090004c60 con 0x7f2098108a90 2024-08-31T05:30:06.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.607+0000 7f209d412640 1 -- 172.21.15.5:0/3216410103 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20981a04c0 con 0x7f2098108a90 2024-08-31T05:30:06.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.607+0000 7f209d412640 1 -- 172.21.15.5:0/3216410103 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2098104090 con 0x7f2098108a90 2024-08-31T05:30:06.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.610+0000 7f20a3987740 1 Processor -- start 2024-08-31T05:30:06.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.611+0000 7f207ffff640 1 -- 172.21.15.5:0/3216410103 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 23) ==== 152644+0+0 (secure 0 0 0) 0x7f2090010460 con 0x7f2098108a90 2024-08-31T05:30:06.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.611+0000 7f20a3987740 1 -- start start 2024-08-31T05:30:06.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.611+0000 7f20a3987740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e273c6350 0x563e2776c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:06.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.611+0000 7f20a3987740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e2739d490 0x563e2776ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:06.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.611+0000 7f20a3987740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e273a5670 0x563e2776d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:06.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.611+0000 7f20a3987740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x563e276e25f0 con 0x563e2739d490 2024-08-31T05:30:06.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.611+0000 7f20a3987740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x563e276d1b80 con 0x563e273c6350 2024-08-31T05:30:06.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.611+0000 7f20a3987740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563e276d5b30 con 0x563e273a5670 2024-08-31T05:30:06.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.611+0000 7f2096ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e2739d490 0x563e2776ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:06.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.611+0000 7f2096ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e2739d490 0x563e2776ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41748/0 (socket says 172.21.15.5:41748) 2024-08-31T05:30:06.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.611+0000 7f2096ffd640 1 -- 172.21.15.5:0/4192326442 learned_addr learned my addr 172.21.15.5:0/4192326442 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:06.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.611+0000 7f207ffff640 1 --2- 172.21.15.5:0/3216410103 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f20800b4c90 0x7f20800b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:06.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.611+0000 7f20967fc640 1 --2- 172.21.15.5:0/4192326442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e273a5670 0x563e2776d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:06.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.611+0000 7f20967fc640 1 --2- 172.21.15.5:0/4192326442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e273c6350 0x563e2776c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:06.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.612+0000 7f20977fe640 1 --2- 172.21.15.5:0/3216410103 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f20800b4c90 0x7f20800b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:06.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.612+0000 7f207ffff640 1 -- 172.21.15.5:0/3216410103 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f20900e5010 con 0x7f2098108a90 2024-08-31T05:30:06.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.612+0000 7f20967fc640 1 -- 172.21.15.5:0/4192326442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e273c6350 msgr2=0x563e2776c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:06.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.612+0000 7f20967fc640 1 --2- 172.21.15.5:0/4192326442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e273c6350 0x563e2776c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:06.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.612+0000 7f20967fc640 1 -- 172.21.15.5:0/4192326442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e2739d490 msgr2=0x563e2776ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:06.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.612+0000 7f20967fc640 1 --2- 172.21.15.5:0/4192326442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e2739d490 0x563e2776ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:06.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.612+0000 7f20967fc640 1 -- 172.21.15.5:0/4192326442 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e27431930 con 0x563e273a5670 2024-08-31T05:30:06.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.612+0000 7f2096ffd640 1 --2- 172.21.15.5:0/4192326442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e2739d490 0x563e2776ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:30:06.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.612+0000 7f20977fe640 1 --2- 172.21.15.5:0/3216410103 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f20800b4c90 0x7f20800b71a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f20900a8760 tx=0x7f20900776f0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:06.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.612+0000 7f20967fc640 1 --2- 172.21.15.5:0/4192326442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e273a5670 0x563e2776d200 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2098100980 tx=0x7f208c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccca879455ef90fb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:06.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.612+0000 7f207d7fa640 1 -- 172.21.15.5:0/4192326442 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c012ca0 con 0x563e273a5670 2024-08-31T05:30:06.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.612+0000 7f207d7fa640 1 -- 172.21.15.5:0/4192326442 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f208c012e40 con 0x563e273a5670 2024-08-31T05:30:06.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.612+0000 7f207d7fa640 1 -- 172.21.15.5:0/4192326442 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c004a00 con 0x563e273a5670 2024-08-31T05:30:06.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.613+0000 7f20a3987740 1 -- 172.21.15.5:0/4192326442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e273a5670 msgr2=0x563e2776d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:06.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.613+0000 7f20a3987740 1 --2- 172.21.15.5:0/4192326442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e273a5670 0x563e2776d200 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2098100980 tx=0x7f208c004730 comp rx=0 tx=0).stop 2024-08-31T05:30:06.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.613+0000 7f20a3987740 1 -- 172.21.15.5:0/4192326442 shutdown_connections 2024-08-31T05:30:06.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.613+0000 7f20a3987740 1 --2- 172.21.15.5:0/4192326442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e273a5670 0x563e2776d200 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:06.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.613+0000 7f20a3987740 1 --2- 172.21.15.5:0/4192326442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e2739d490 0x563e2776ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:06.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.613+0000 7f20a3987740 1 --2- 172.21.15.5:0/4192326442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e273c6350 0x563e2776c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:06.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.613+0000 7f20a3987740 1 -- 172.21.15.5:0/4192326442 >> 172.21.15.5:0/4192326442 conn(0x563e273ba740 msgr2=0x563e2776a670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:06.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.613+0000 7f20a3987740 1 -- 172.21.15.5:0/4192326442 shutdown_connections 2024-08-31T05:30:06.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.614+0000 7f20a3987740 1 -- 172.21.15.5:0/4192326442 wait complete. 2024-08-31T05:30:06.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.614+0000 7f20a3987740 1 -- start start 2024-08-31T05:30:06.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.614+0000 7f20a3987740 1 Processor -- start 2024-08-31T05:30:06.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.615+0000 7f20a3987740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e2739d490 0x563e27778000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:06.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.615+0000 7f20a3987740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e273a5670 0x563e277785a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:06.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.615+0000 7f20a3987740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e273c6350 0x563e27784250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:06.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.615+0000 7f20a3987740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x563e27534890 con 0x563e2739d490 2024-08-31T05:30:06.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.615+0000 7f20a3987740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x563e27658790 con 0x563e273a5670 2024-08-31T05:30:06.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.615+0000 7f20a3987740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563e2777af60 con 0x563e273c6350 2024-08-31T05:30:06.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.615+0000 7f20a3987740 10 client.0 _ll_register_callbacks cb 0x563e273ddba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:30:06.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.615+0000 7f20967fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e2739d490 0x563e27778000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:06.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.615+0000 7f20967fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e2739d490 0x563e27778000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41750/0 (socket says 172.21.15.5:41750) 2024-08-31T05:30:06.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.615+0000 7f20967fc640 1 -- 172.21.15.5:0/2000909289 learned_addr learned my addr 172.21.15.5:0/2000909289 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:06.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.615+0000 7f2096ffd640 1 --2- 172.21.15.5:0/2000909289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e273a5670 0x563e277785a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:06.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.615+0000 7f20967fc640 1 --2- 172.21.15.5:0/2000909289 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e273c6350 0x563e27784250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:06.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.615+0000 7f20967fc640 1 -- 172.21.15.5:0/2000909289 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e273c6350 msgr2=0x563e27784250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:06.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.615+0000 7f20967fc640 1 --2- 172.21.15.5:0/2000909289 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e273c6350 0x563e27784250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:06.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.615+0000 7f20967fc640 1 -- 172.21.15.5:0/2000909289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e273a5670 msgr2=0x563e277785a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:06.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.615+0000 7f20967fc640 1 --2- 172.21.15.5:0/2000909289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e273a5670 0x563e277785a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:06.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.615+0000 7f20967fc640 1 -- 172.21.15.5:0/2000909289 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e2768ff30 con 0x563e2739d490 2024-08-31T05:30:06.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.615+0000 7f20967fc640 1 --2- 172.21.15.5:0/2000909289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e2739d490 0x563e27778000 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f208c005560 tx=0x7f208c00b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f80cf534d53cd0e5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:06.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.615+0000 7f207aff5640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:30:06.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.616+0000 7f207aff5640 1 -- 172.21.15.5:0/2000909289 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c010940 con 0x563e2739d490 2024-08-31T05:30:06.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.616+0000 7f20a3987740 1 -- 172.21.15.5:0/2000909289 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563e276e4540 con 0x563e2739d490 2024-08-31T05:30:06.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.616+0000 7f207aff5640 1 -- 172.21.15.5:0/2000909289 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f208c010ae0 con 0x563e2739d490 2024-08-31T05:30:06.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.616+0000 7f207aff5640 1 -- 172.21.15.5:0/2000909289 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f208c004460 con 0x563e2739d490 2024-08-31T05:30:06.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.616+0000 7f20a3987740 10 client.15630 fetch_fsmap learned FSMap version 30 2024-08-31T05:30:06.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.616+0000 7f20a3987740 1 -- 172.21.15.5:0/2000909289 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563e27786df0 con 0x563e2739d490 2024-08-31T05:30:06.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.616+0000 7f207aff5640 1 -- 172.21.15.5:0/2000909289 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x563e276e4540 con 0x563e2739d490 2024-08-31T05:30:06.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.616+0000 7f207aff5640 1 -- 172.21.15.5:0/2000909289 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f208c01f470 con 0x563e2739d490 2024-08-31T05:30:06.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.616+0000 7f20a3987740 10 client.15630 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T05:30:06.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.616+0000 7f20a3987740 10 client.15630 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:30:06.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.616+0000 7f20a3987740 20 client.15630 populate_metadata read hostname 'smithi005' 2024-08-31T05:30:06.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.616+0000 7f20a3987740 1 --2- 172.21.15.5:0/2000909289 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x563e27384cd0 0x563e2778a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:06.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.616+0000 7f20a3987740 4 client.15630 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:30:06.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.616+0000 7f20a3987740 1 -- 172.21.15.5:0/2000909289 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563e276dffe0 con 0x563e27384cd0 2024-08-31T05:30:06.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.617+0000 7f2096ffd640 1 --2- 172.21.15.5:0/2000909289 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x563e27384cd0 0x563e2778a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:06.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.617+0000 7f207aff5640 10 client.15630 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:30:06.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.617+0000 7f2096ffd640 1 --2- 172.21.15.5:0/2000909289 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x563e27384cd0 0x563e2778a150 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50f2d604a9b7846e server_cookie=55b98f16bbe1175 in_seq=0 out_seq=0 2024-08-31T05:30:06.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.618+0000 7f207aff5640 1 -- 172.21.15.5:0/2000909289 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563e276dffe0 con 0x563e27384cd0 2024-08-31T05:30:06.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.618+0000 7f207aff5640 10 client.15630 handle_command_reply: tid=0 2024-08-31T05:30:06.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.618+0000 7f20a3987740 1 client.15630 shutdown 2024-08-31T05:30:06.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.618+0000 7f20a3987740 1 -- 172.21.15.5:0/2000909289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e2739d490 msgr2=0x563e27778000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:06.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.618+0000 7f20a3987740 1 --2- 172.21.15.5:0/2000909289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e2739d490 0x563e27778000 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f208c005560 tx=0x7f208c00b410 comp rx=0 tx=0).stop 2024-08-31T05:30:06.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.618+0000 7f20a3987740 1 -- 172.21.15.5:0/2000909289 shutdown_connections 2024-08-31T05:30:06.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.618+0000 7f20a3987740 1 --2- 172.21.15.5:0/2000909289 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x563e27384cd0 0x563e2778a150 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:06.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.618+0000 7f20a3987740 1 --2- 172.21.15.5:0/2000909289 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e273c6350 0x563e27784250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:06.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.618+0000 7f20a3987740 1 --2- 172.21.15.5:0/2000909289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e273a5670 0x563e277785a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:06.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.618+0000 7f20a3987740 1 --2- 172.21.15.5:0/2000909289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e2739d490 0x563e27778000 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:06.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.618+0000 7f20a3987740 1 -- 172.21.15.5:0/2000909289 >> 172.21.15.5:0/2000909289 conn(0x563e273ba740 msgr2=0x563e2776f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:06.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.618+0000 7f207aff5640 0 client.15630 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:30:06.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.618+0000 7f20a3987740 1 -- 172.21.15.5:0/2000909289 shutdown_connections 2024-08-31T05:30:06.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.618+0000 7f20a3987740 1 -- 172.21.15.5:0/2000909289 wait complete. 2024-08-31T05:30:06.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.618+0000 7f20a3987740 20 client.15630 trim_cache size 0 max 16384 2024-08-31T05:30:06.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.636+0000 7f20a3987740 1 Processor -- start 2024-08-31T05:30:06.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.636+0000 7f20a3987740 1 -- start start 2024-08-31T05:30:06.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.637+0000 7f20a3987740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e2739d490 0x563e27770240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:06.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.637+0000 7f20a3987740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e273a5670 0x563e27779c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:06.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.637+0000 7f20a3987740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e273c6350 0x563e27784150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:06.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.637+0000 7f20a3987740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f20981b2f10 con 0x563e2739d490 2024-08-31T05:30:06.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.637+0000 7f20a3987740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f20981b4a50 con 0x563e273a5670 2024-08-31T05:30:06.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.637+0000 7f20a3987740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f20981b35e0 con 0x563e273c6350 2024-08-31T05:30:06.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.637+0000 7f20967fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e2739d490 0x563e27770240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:06.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.637+0000 7f20967fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e2739d490 0x563e27770240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41762/0 (socket says 172.21.15.5:41762) 2024-08-31T05:30:06.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.637+0000 7f20967fc640 1 -- 172.21.15.5:0/3621132692 learned_addr learned my addr 172.21.15.5:0/3621132692 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:06.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.637+0000 7f2096ffd640 1 --2- 172.21.15.5:0/3621132692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e273a5670 0x563e27779c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:06.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.637+0000 7f20967fc640 1 -- 172.21.15.5:0/3621132692 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e273c6350 msgr2=0x563e27784150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:06.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.637+0000 7f20967fc640 1 --2- 172.21.15.5:0/3621132692 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e273c6350 0x563e27784150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:06.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.637+0000 7f20967fc640 1 -- 172.21.15.5:0/3621132692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e273a5670 msgr2=0x563e27779c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:06.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.637+0000 7f20967fc640 1 --2- 172.21.15.5:0/3621132692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e273a5670 0x563e27779c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:06.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.637+0000 7f20967fc640 1 -- 172.21.15.5:0/3621132692 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e2776f3c0 con 0x563e2739d490 2024-08-31T05:30:06.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.637+0000 7f20967fc640 1 --2- 172.21.15.5:0/3621132692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e2739d490 0x563e27770240 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f208c000c00 tx=0x7f208c00bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe336dd3cc15122a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:06.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.637+0000 7f207cff9640 1 -- 172.21.15.5:0/3621132692 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c00bbb0 con 0x563e2739d490 2024-08-31T05:30:06.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.638+0000 7f207cff9640 1 -- 172.21.15.5:0/3621132692 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f208c016040 con 0x563e2739d490 2024-08-31T05:30:06.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.638+0000 7f207cff9640 1 -- 172.21.15.5:0/3621132692 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c010e50 con 0x563e2739d490 2024-08-31T05:30:06.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.638+0000 7f20a3987740 1 -- 172.21.15.5:0/3621132692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e2739d490 msgr2=0x563e27770240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:06.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.638+0000 7f20a3987740 1 --2- 172.21.15.5:0/3621132692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e2739d490 0x563e27770240 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f208c000c00 tx=0x7f208c00bf80 comp rx=0 tx=0).stop 2024-08-31T05:30:06.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.638+0000 7f20a3987740 1 -- 172.21.15.5:0/3621132692 shutdown_connections 2024-08-31T05:30:06.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.638+0000 7f20a3987740 1 --2- 172.21.15.5:0/3621132692 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e273c6350 0x563e27784150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:06.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.638+0000 7f20a3987740 1 --2- 172.21.15.5:0/3621132692 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e273a5670 0x563e27779c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:06.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.638+0000 7f20a3987740 1 --2- 172.21.15.5:0/3621132692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e2739d490 0x563e27770240 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:06.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.638+0000 7f20a3987740 1 -- 172.21.15.5:0/3621132692 >> 172.21.15.5:0/3621132692 conn(0x563e273ba740 msgr2=0x563e27779520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:06.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.638+0000 7f20a3987740 1 -- 172.21.15.5:0/3621132692 shutdown_connections 2024-08-31T05:30:06.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.639+0000 7f20a3987740 1 -- 172.21.15.5:0/3621132692 wait complete. 2024-08-31T05:30:06.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.639+0000 7f20a3987740 1 -- start start 2024-08-31T05:30:06.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.639+0000 7f20a3987740 1 Processor -- start 2024-08-31T05:30:06.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.640+0000 7f20a3987740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e2739d490 0x563e2777c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:06.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.640+0000 7f20a3987740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e273a5670 0x563e2777c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:06.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.640+0000 7f20a3987740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e273c6350 0x563e2777cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:06.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.640+0000 7f20a3987740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f20981b4380 con 0x563e273a5670 2024-08-31T05:30:06.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.640+0000 7f20a3987740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f20981b3cb0 con 0x563e2739d490 2024-08-31T05:30:06.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.640+0000 7f20a3987740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f20981b0ef0 con 0x563e273c6350 2024-08-31T05:30:06.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.640+0000 7f20a3987740 10 client.0 _ll_register_callbacks cb 0x7f2088009900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:30:06.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.640+0000 7f2096ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e273a5670 0x563e2777c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:06.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.640+0000 7f20967fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e2739d490 0x563e2777c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:06.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.640+0000 7f2096ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e273a5670 0x563e2777c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41774/0 (socket says 172.21.15.5:41774) 2024-08-31T05:30:06.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.640+0000 7f2096ffd640 1 -- 172.21.15.5:0/3064903122 learned_addr learned my addr 172.21.15.5:0/3064903122 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:06.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.640+0000 7f20967fc640 1 --2- 172.21.15.5:0/3064903122 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e273c6350 0x563e2777cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:06.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.640+0000 7f2096ffd640 1 -- 172.21.15.5:0/3064903122 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e273c6350 msgr2=0x563e2777cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:06.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.640+0000 7f2096ffd640 1 --2- 172.21.15.5:0/3064903122 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e273c6350 0x563e2777cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:06.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.640+0000 7f2096ffd640 1 -- 172.21.15.5:0/3064903122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e2739d490 msgr2=0x563e2777c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:06.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.640+0000 7f2096ffd640 1 --2- 172.21.15.5:0/3064903122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e2739d490 0x563e2777c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:06.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.640+0000 7f2096ffd640 1 -- 172.21.15.5:0/3064903122 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e277f39f0 con 0x563e273a5670 2024-08-31T05:30:06.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.640+0000 7f20967fc640 1 --2- 172.21.15.5:0/3064903122 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e273c6350 0x563e2777cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:30:06.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.640+0000 7f2096ffd640 1 --2- 172.21.15.5:0/3064903122 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e273a5670 0x563e2777c7d0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f2088000f80 tx=0x7f20880317a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=415d30059483fbbc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:06.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.640+0000 7f207aff5640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:30:06.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.640+0000 7f207aff5640 1 -- 172.21.15.5:0/3064903122 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2088003d80 con 0x563e273a5670 2024-08-31T05:30:06.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.641+0000 7f207aff5640 1 -- 172.21.15.5:0/3064903122 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f2088004040 con 0x563e273a5670 2024-08-31T05:30:06.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.641+0000 7f20a3987740 1 -- 172.21.15.5:0/3064903122 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f208c016040 con 0x563e273a5670 2024-08-31T05:30:06.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.641+0000 7f207aff5640 1 -- 172.21.15.5:0/3064903122 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f208805d050 con 0x563e273a5670 2024-08-31T05:30:06.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.641+0000 7f20a3987740 10 client.15636 fetch_fsmap learned FSMap version 30 2024-08-31T05:30:06.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.641+0000 7f20a3987740 1 -- 172.21.15.5:0/3064903122 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563e277f4d40 con 0x563e273a5670 2024-08-31T05:30:06.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.641+0000 7f207aff5640 1 -- 172.21.15.5:0/3064903122 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f208c016040 con 0x563e273a5670 2024-08-31T05:30:06.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.641+0000 7f207aff5640 1 -- 172.21.15.5:0/3064903122 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f208802f940 con 0x563e273a5670 2024-08-31T05:30:06.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.641+0000 7f20a3987740 10 client.15636 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T05:30:06.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.641+0000 7f20a3987740 10 client.15636 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:30:06.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.641+0000 7f20a3987740 20 client.15636 populate_metadata read hostname 'smithi005' 2024-08-31T05:30:06.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.641+0000 7f20a3987740 1 --2- 172.21.15.5:0/3064903122 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x563e2735a080 0x563e277f7530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:06.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.641+0000 7f20a3987740 4 client.15636 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T05:30:06.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.641+0000 7f20a3987740 1 -- 172.21.15.5:0/3064903122 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x563e276dd720 con 0x563e2735a080 2024-08-31T05:30:06.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.642+0000 7f20967fc640 1 --2- 172.21.15.5:0/3064903122 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x563e2735a080 0x563e277f7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:06.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.642+0000 7f207aff5640 10 client.15636 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:30:06.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.642+0000 7f20967fc640 1 --2- 172.21.15.5:0/3064903122 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x563e2735a080 0x563e277f7530 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f87ae5d23724f75d server_cookie=2e71a00711bc89f6 in_seq=0 out_seq=0 2024-08-31T05:30:06.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.643+0000 7f207aff5640 1 -- 172.21.15.5:0/3064903122 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563e276dd720 con 0x563e2735a080 2024-08-31T05:30:06.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.643+0000 7f207aff5640 10 client.15636 handle_command_reply: tid=0 2024-08-31T05:30:06.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.643+0000 7f20a3987740 1 client.15636 shutdown 2024-08-31T05:30:06.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.644+0000 7f20a3987740 1 -- 172.21.15.5:0/3064903122 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e273a5670 msgr2=0x563e2777c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:06.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.644+0000 7f20a3987740 1 --2- 172.21.15.5:0/3064903122 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e273a5670 0x563e2777c7d0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f2088000f80 tx=0x7f20880317a0 comp rx=0 tx=0).stop 2024-08-31T05:30:06.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.644+0000 7f20a3987740 1 -- 172.21.15.5:0/3064903122 shutdown_connections 2024-08-31T05:30:06.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.644+0000 7f20a3987740 1 --2- 172.21.15.5:0/3064903122 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x563e2735a080 0x563e277f7530 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:06.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.644+0000 7f20a3987740 1 --2- 172.21.15.5:0/3064903122 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e273c6350 0x563e2777cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:06.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.644+0000 7f20a3987740 1 --2- 172.21.15.5:0/3064903122 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e273a5670 0x563e2777c7d0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:06.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.644+0000 7f20a3987740 1 --2- 172.21.15.5:0/3064903122 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e2739d490 0x563e2777c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:06.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.644+0000 7f207aff5640 0 client.15636 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:30:06.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.644+0000 7f20a3987740 1 -- 172.21.15.5:0/3064903122 >> 172.21.15.5:0/3064903122 conn(0x563e273ba740 msgr2=0x563e2776e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:06.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.644+0000 7f20a3987740 1 -- 172.21.15.5:0/3064903122 shutdown_connections 2024-08-31T05:30:06.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.644+0000 7f20a3987740 1 -- 172.21.15.5:0/3064903122 wait complete. 2024-08-31T05:30:06.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.644+0000 7f20a3987740 20 client.15636 trim_cache size 0 max 16384 2024-08-31T05:30:06.649 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:30:06.649 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-08-31T05:30:06.650 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "75d84398-5d9c-4872-b879-2fbce045fa71", 2024-08-31T05:30:06.650 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-08-31T05:30:06.650 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:30:06.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.645+0000 7f209d412640 1 -- 172.21.15.5:0/3216410103 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f20800b4c90 msgr2=0x7f20800b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:06.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.645+0000 7f209d412640 1 --2- 172.21.15.5:0/3216410103 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f20800b4c90 0x7f20800b71a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f20900a8760 tx=0x7f20900776f0 comp rx=0 tx=0).stop 2024-08-31T05:30:06.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.645+0000 7f209d412640 1 -- 172.21.15.5:0/3216410103 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2098108a90 msgr2=0x7f209819faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:06.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.645+0000 7f209d412640 1 --2- 172.21.15.5:0/3216410103 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2098108a90 0x7f209819faa0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f209000d750 tx=0x7f209000dc10 comp rx=0 tx=0).stop 2024-08-31T05:30:06.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.645+0000 7f209d412640 1 -- 172.21.15.5:0/3216410103 shutdown_connections 2024-08-31T05:30:06.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.645+0000 7f209d412640 1 --2- 172.21.15.5:0/3216410103 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f20800b4c90 0x7f20800b71a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:06.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.645+0000 7f209d412640 1 --2- 172.21.15.5:0/3216410103 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2098108a90 0x7f209819faa0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:06.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.645+0000 7f209d412640 1 --2- 172.21.15.5:0/3216410103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2098108140 0x7f209819a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:06.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.645+0000 7f209d412640 1 --2- 172.21.15.5:0/3216410103 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2098102800 0x7f209819a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:06.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.645+0000 7f209d412640 1 -- 172.21.15.5:0/3216410103 >> 172.21.15.5:0/3216410103 conn(0x7f20980794d0 msgr2=0x7f2098106520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:06.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.645+0000 7f209d412640 1 -- 172.21.15.5:0/3216410103 shutdown_connections 2024-08-31T05:30:06.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.645+0000 7f209d412640 1 -- 172.21.15.5:0/3216410103 wait complete. 2024-08-31T05:30:06.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.748+0000 7f4fcbcf4640 1 -- 172.21.15.5:0/573316124 --> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7f4fc40635a0 con 0x7f4fb00b4c10 2024-08-31T05:30:06.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.807+0000 7f4fbaffd640 1 -- 172.21.15.5:0/573316124 <== mgr.14220 v2:172.21.15.5:6800/2696053609 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7f4fc40635a0 con 0x7f4fb00b4c10 2024-08-31T05:30:06.809 INFO:teuthology.orchestra.run.smithi005.stdout:Retention added to path / 2024-08-31T05:30:06.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.809+0000 7f4fcbcf4640 1 -- 172.21.15.5:0/573316124 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4fb00b4c10 msgr2=0x7f4fb00b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:06.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.809+0000 7f4fcbcf4640 1 --2- 172.21.15.5:0/573316124 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4fb00b4c10 0x7f4fb00b7120 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4fc4104690 tx=0x7f4fc0005f90 comp rx=0 tx=0).stop 2024-08-31T05:30:06.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.809+0000 7f4fcbcf4640 1 -- 172.21.15.5:0/573316124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fc41089e0 msgr2=0x7f4fc41997f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:06.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.809+0000 7f4fcbcf4640 1 --2- 172.21.15.5:0/573316124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fc41089e0 0x7f4fc41997f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc00eb10 tx=0x7f4fbc00c2d0 comp rx=0 tx=0).stop 2024-08-31T05:30:06.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.809+0000 7f4fcbcf4640 1 -- 172.21.15.5:0/573316124 shutdown_connections 2024-08-31T05:30:06.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.809+0000 7f4fcbcf4640 1 --2- 172.21.15.5:0/573316124 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4fb00b4c10 0x7f4fb00b7120 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:06.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.809+0000 7f4fcbcf4640 1 --2- 172.21.15.5:0/573316124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fc41089e0 0x7f4fc41997f0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:06.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.809+0000 7f4fcbcf4640 1 --2- 172.21.15.5:0/573316124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4fc4108090 0x7f4fc41992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:06.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.809+0000 7f4fcbcf4640 1 --2- 172.21.15.5:0/573316124 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fc4102760 0x7f4fc4198d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:06.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.809+0000 7f4fcbcf4640 1 -- 172.21.15.5:0/573316124 >> 172.21.15.5:0/573316124 conn(0x7f4fc40fe160 msgr2=0x7f4fc4107720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:06.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.809+0000 7f4fcbcf4640 1 -- 172.21.15.5:0/573316124 shutdown_connections 2024-08-31T05:30:06.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.809+0000 7f4fcbcf4640 1 -- 172.21.15.5:0/573316124 wait complete. 2024-08-31T05:30:06.821 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:06 smithi005 ceph-mon[18602]: pgmap v349: 129 pgs: 129 active+clean; 654 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-08-31T05:30:06.821 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:06 smithi005 ceph-mon[18602]: from='client.15606 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:30:06.825 DEBUG:teuthology.orchestra.run.smithi005:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-08-31T05:30:06.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:06 smithi050 ceph-mon[22146]: pgmap v349: 129 pgs: 129 active+clean; 654 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-08-31T05:30:06.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:06 smithi050 ceph-mon[22146]: from='client.15606 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:30:06.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.935+0000 7f39d6ab6640 1 -- 172.21.15.5:0/941172662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39d0108a20 msgr2=0x7f39d010f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:06.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.935+0000 7f39d6ab6640 1 --2- 172.21.15.5:0/941172662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39d0108a20 0x7f39d010f250 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f39c8009ca0 tx=0x7f39c802a8c0 comp rx=0 tx=0).stop 2024-08-31T05:30:06.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.935+0000 7f39d6ab6640 1 -- 172.21.15.5:0/941172662 shutdown_connections 2024-08-31T05:30:06.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.935+0000 7f39d6ab6640 1 --2- 172.21.15.5:0/941172662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39d0108a20 0x7f39d010f250 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:06.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.935+0000 7f39d6ab6640 1 --2- 172.21.15.5:0/941172662 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f39d01080d0 0x7f39d01084e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:06.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.935+0000 7f39d6ab6640 1 --2- 172.21.15.5:0/941172662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39d01027a0 0x7f39d0102bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:06.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.935+0000 7f39d6ab6640 1 -- 172.21.15.5:0/941172662 >> 172.21.15.5:0/941172662 conn(0x7f39d00fe1a0 msgr2=0x7f39d01005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:06.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.936+0000 7f39d6ab6640 1 -- 172.21.15.5:0/941172662 shutdown_connections 2024-08-31T05:30:06.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.936+0000 7f39d6ab6640 1 -- 172.21.15.5:0/941172662 wait complete. 2024-08-31T05:30:06.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.936+0000 7f39d6ab6640 1 Processor -- start 2024-08-31T05:30:06.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.936+0000 7f39d6ab6640 1 -- start start 2024-08-31T05:30:06.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.936+0000 7f39d6ab6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39d01027a0 0x7f39d019a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:06.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.936+0000 7f39d6ab6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f39d01080d0 0x7f39d019a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:06.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.936+0000 7f39d6ab6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39d0108a20 0x7f39d019f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:06.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.936+0000 7f39d6ab6640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f39d0113800 con 0x7f39d0108a20 2024-08-31T05:30:06.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.936+0000 7f39d6ab6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f39d0113680 con 0x7f39d01027a0 2024-08-31T05:30:06.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.936+0000 7f39d6ab6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f39d0113980 con 0x7f39d01080d0 2024-08-31T05:30:06.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.937+0000 7f39d5053640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39d0108a20 0x7f39d019f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:06.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.937+0000 7f39d5053640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39d0108a20 0x7f39d019f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41802/0 (socket says 172.21.15.5:41802) 2024-08-31T05:30:06.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.937+0000 7f39d5053640 1 -- 172.21.15.5:0/4247798198 learned_addr learned my addr 172.21.15.5:0/4247798198 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:06.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.937+0000 7f39cffff640 1 --2- 172.21.15.5:0/4247798198 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f39d01080d0 0x7f39d019a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:06.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.937+0000 7f39d4852640 1 --2- 172.21.15.5:0/4247798198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39d01027a0 0x7f39d019a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:06.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.937+0000 7f39d5053640 1 -- 172.21.15.5:0/4247798198 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f39d01080d0 msgr2=0x7f39d019a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:06.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.937+0000 7f39d5053640 1 --2- 172.21.15.5:0/4247798198 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f39d01080d0 0x7f39d019a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:06.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.937+0000 7f39d5053640 1 -- 172.21.15.5:0/4247798198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39d01027a0 msgr2=0x7f39d019a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:06.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.937+0000 7f39d5053640 1 --2- 172.21.15.5:0/4247798198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39d01027a0 0x7f39d019a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:06.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.937+0000 7f39d5053640 1 -- 172.21.15.5:0/4247798198 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39d01a00b0 con 0x7f39d0108a20 2024-08-31T05:30:06.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.937+0000 7f39d5053640 1 --2- 172.21.15.5:0/4247798198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39d0108a20 0x7f39d019f9b0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f39c80098d0 tx=0x7f39c80317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:06.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.937+0000 7f39cdffb640 1 -- 172.21.15.5:0/4247798198 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c8003b70 con 0x7f39d0108a20 2024-08-31T05:30:06.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.937+0000 7f39cdffb640 1 -- 172.21.15.5:0/4247798198 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f39c8003d10 con 0x7f39d0108a20 2024-08-31T05:30:06.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.937+0000 7f39cdffb640 1 -- 172.21.15.5:0/4247798198 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c802fa20 con 0x7f39d0108a20 2024-08-31T05:30:06.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.937+0000 7f39d6ab6640 1 -- 172.21.15.5:0/4247798198 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39d01a0340 con 0x7f39d0108a20 2024-08-31T05:30:06.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.938+0000 7f39d6ab6640 1 -- 172.21.15.5:0/4247798198 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39d01a6b30 con 0x7f39d0108a20 2024-08-31T05:30:06.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.939+0000 7f39d6ab6640 1 -- 172.21.15.5:0/4247798198 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39d0103a10 con 0x7f39d0108a20 2024-08-31T05:30:06.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.940+0000 7f39cdffb640 1 -- 172.21.15.5:0/4247798198 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 23) ==== 152644+0+0 (secure 0 0 0) 0x7f39c802fbe0 con 0x7f39d0108a20 2024-08-31T05:30:06.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.941+0000 7f39cdffb640 1 --2- 172.21.15.5:0/4247798198 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f39c00b4c90 0x7f39c00b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:06.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.941+0000 7f39d4852640 1 --2- 172.21.15.5:0/4247798198 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f39c00b4c90 0x7f39c00b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:06.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.941+0000 7f39cdffb640 1 -- 172.21.15.5:0/4247798198 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f39c8106e20 con 0x7f39d0108a20 2024-08-31T05:30:06.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.941+0000 7f39d4852640 1 --2- 172.21.15.5:0/4247798198 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f39c00b4c90 0x7f39c00b71a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f39c4005d00 tx=0x7f39c4005c50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:06.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:06.944+0000 7f39cdffb640 1 -- 172.21.15.5:0/4247798198 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f39c80cd8f0 con 0x7f39d0108a20 2024-08-31T05:30:07.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:06 smithi070 ceph-mon[22316]: pgmap v349: 129 pgs: 129 active+clean; 654 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-08-31T05:30:07.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:06 smithi070 ceph-mon[22316]: from='client.15606 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:30:07.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.150+0000 7f39d6ab6640 1 -- 172.21.15.5:0/4247798198 --> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f39d00635a0 con 0x7f39c00b4c90 2024-08-31T05:30:07.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.157+0000 7f39cdffb640 1 -- 172.21.15.5:0/4247798198 <== mgr.14220 v2:172.21.15.5:6800/2696053609 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7f39d00635a0 con 0x7f39c00b4c90 2024-08-31T05:30:07.160 INFO:teuthology.orchestra.run.smithi005.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-08-31T00:00:00", "created": "2024-08-31T05:30:06", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-08-31T05:30:07.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.159+0000 7f39d6ab6640 1 -- 172.21.15.5:0/4247798198 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f39c00b4c90 msgr2=0x7f39c00b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:07.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.159+0000 7f39d6ab6640 1 --2- 172.21.15.5:0/4247798198 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f39c00b4c90 0x7f39c00b71a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f39c4005d00 tx=0x7f39c4005c50 comp rx=0 tx=0).stop 2024-08-31T05:30:07.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.159+0000 7f39d6ab6640 1 -- 172.21.15.5:0/4247798198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39d0108a20 msgr2=0x7f39d019f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:07.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.159+0000 7f39d6ab6640 1 --2- 172.21.15.5:0/4247798198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39d0108a20 0x7f39d019f9b0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f39c80098d0 tx=0x7f39c80317b0 comp rx=0 tx=0).stop 2024-08-31T05:30:07.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.159+0000 7f39d6ab6640 1 -- 172.21.15.5:0/4247798198 shutdown_connections 2024-08-31T05:30:07.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.159+0000 7f39d6ab6640 1 --2- 172.21.15.5:0/4247798198 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f39c00b4c90 0x7f39c00b71a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:07.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.159+0000 7f39d6ab6640 1 --2- 172.21.15.5:0/4247798198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39d0108a20 0x7f39d019f9b0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:07.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.159+0000 7f39d6ab6640 1 --2- 172.21.15.5:0/4247798198 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f39d01080d0 0x7f39d019a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:07.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.159+0000 7f39d6ab6640 1 --2- 172.21.15.5:0/4247798198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f39d01027a0 0x7f39d019a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:07.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.159+0000 7f39d6ab6640 1 -- 172.21.15.5:0/4247798198 >> 172.21.15.5:0/4247798198 conn(0x7f39d00fe1a0 msgr2=0x7f39d0107680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:07.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.159+0000 7f39d6ab6640 1 -- 172.21.15.5:0/4247798198 shutdown_connections 2024-08-31T05:30:07.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.159+0000 7f39d6ab6640 1 -- 172.21.15.5:0/4247798198 wait complete. 2024-08-31T05:30:07.174 DEBUG:teuthology.orchestra.run.smithi005:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-08-31T05:30:07.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.283+0000 7f7907dc3640 1 -- 172.21.15.5:0/3251227550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79001057d0 msgr2=0x7f790010f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:07.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.284+0000 7f7907dc3640 1 --2- 172.21.15.5:0/3251227550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79001057d0 0x7f790010f240 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f78f8009ca0 tx=0x7f78f802a8c0 comp rx=0 tx=0).stop 2024-08-31T05:30:07.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.284+0000 7f7907dc3640 1 -- 172.21.15.5:0/3251227550 shutdown_connections 2024-08-31T05:30:07.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.284+0000 7f7907dc3640 1 --2- 172.21.15.5:0/3251227550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79001057d0 0x7f790010f240 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:07.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.284+0000 7f7907dc3640 1 --2- 172.21.15.5:0/3251227550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7900104e80 0x7f7900105290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:07.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.284+0000 7f7907dc3640 1 --2- 172.21.15.5:0/3251227550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7900102f20 0x7f7900103330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:07.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.284+0000 7f7907dc3640 1 -- 172.21.15.5:0/3251227550 >> 172.21.15.5:0/3251227550 conn(0x7f7900079c40 msgr2=0x7f790007a050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:07.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.284+0000 7f7907dc3640 1 -- 172.21.15.5:0/3251227550 shutdown_connections 2024-08-31T05:30:07.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.284+0000 7f7907dc3640 1 -- 172.21.15.5:0/3251227550 wait complete. 2024-08-31T05:30:07.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.284+0000 7f7907dc3640 1 Processor -- start 2024-08-31T05:30:07.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.284+0000 7f7907dc3640 1 -- start start 2024-08-31T05:30:07.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.285+0000 7f7907dc3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7900102f20 0x7f79000fec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:07.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.285+0000 7f7907dc3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7900104e80 0x7f79000ff1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:07.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.285+0000 7f7907dc3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79001057d0 0x7f79000ff6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:07.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.285+0000 7f7907dc3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f79001126c0 con 0x7f7900102f20 2024-08-31T05:30:07.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.285+0000 7f7907dc3640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7900112540 con 0x7f7900104e80 2024-08-31T05:30:07.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.285+0000 7f7907dc3640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7900112840 con 0x7f79001057d0 2024-08-31T05:30:07.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.285+0000 7f7905b5f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7900102f20 0x7f79000fec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:07.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.285+0000 7f7905b5f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7900102f20 0x7f79000fec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41830/0 (socket says 172.21.15.5:41830) 2024-08-31T05:30:07.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.285+0000 7f7905b5f640 1 -- 172.21.15.5:0/2438381705 learned_addr learned my addr 172.21.15.5:0/2438381705 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:07.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.285+0000 7f7906360640 1 --2- 172.21.15.5:0/2438381705 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79001057d0 0x7f79000ff6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:07.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.285+0000 7f790535e640 1 --2- 172.21.15.5:0/2438381705 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7900104e80 0x7f79000ff1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:07.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.285+0000 7f7905b5f640 1 -- 172.21.15.5:0/2438381705 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79001057d0 msgr2=0x7f79000ff6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:07.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.285+0000 7f7905b5f640 1 --2- 172.21.15.5:0/2438381705 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79001057d0 0x7f79000ff6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:07.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.285+0000 7f7905b5f640 1 -- 172.21.15.5:0/2438381705 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7900104e80 msgr2=0x7f79000ff1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:07.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.285+0000 7f7905b5f640 1 --2- 172.21.15.5:0/2438381705 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7900104e80 0x7f79000ff1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:07.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.285+0000 7f7905b5f640 1 -- 172.21.15.5:0/2438381705 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79001a8460 con 0x7f7900102f20 2024-08-31T05:30:07.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.285+0000 7f790535e640 1 --2- 172.21.15.5:0/2438381705 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7900104e80 0x7f79000ff1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:30:07.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.285+0000 7f7905b5f640 1 --2- 172.21.15.5:0/2438381705 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7900102f20 0x7f79000fec70 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f78fc00d950 tx=0x7f78fc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:07.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.285+0000 7f78f6ffd640 1 -- 172.21.15.5:0/2438381705 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78fc017070 con 0x7f7900102f20 2024-08-31T05:30:07.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.285+0000 7f78f6ffd640 1 -- 172.21.15.5:0/2438381705 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78fc009c30 con 0x7f7900102f20 2024-08-31T05:30:07.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.285+0000 7f7907dc3640 1 -- 172.21.15.5:0/2438381705 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79001a8750 con 0x7f7900102f20 2024-08-31T05:30:07.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.285+0000 7f78f6ffd640 1 -- 172.21.15.5:0/2438381705 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78fc00f620 con 0x7f7900102f20 2024-08-31T05:30:07.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.286+0000 7f7907dc3640 1 -- 172.21.15.5:0/2438381705 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79001a8ca0 con 0x7f7900102f20 2024-08-31T05:30:07.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.286+0000 7f7907dc3640 1 -- 172.21.15.5:0/2438381705 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7900103330 con 0x7f7900102f20 2024-08-31T05:30:07.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.289+0000 7f78f6ffd640 1 -- 172.21.15.5:0/2438381705 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 23) ==== 152644+0+0 (secure 0 0 0) 0x7f78fc005030 con 0x7f7900102f20 2024-08-31T05:30:07.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.289+0000 7f78f6ffd640 1 --2- 172.21.15.5:0/2438381705 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f78ec0b4c40 0x7f78ec0b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:07.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.290+0000 7f790535e640 1 --2- 172.21.15.5:0/2438381705 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f78ec0b4c40 0x7f78ec0b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:07.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.290+0000 7f78f6ffd640 1 -- 172.21.15.5:0/2438381705 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f78fc0e53a0 con 0x7f7900102f20 2024-08-31T05:30:07.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.290+0000 7f790535e640 1 --2- 172.21.15.5:0/2438381705 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f78ec0b4c40 0x7f78ec0b7150 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f79001056a0 tx=0x7f78f0005e50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:07.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.292+0000 7f78f6ffd640 1 -- 172.21.15.5:0/2438381705 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f78fc0abed0 con 0x7f7900102f20 2024-08-31T05:30:07.324 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T05:30:07.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.511+0000 7f7907dc3640 1 -- 172.21.15.5:0/2438381705 --> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f79000635a0 con 0x7f78ec0b4c40 2024-08-31T05:30:07.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.518+0000 7f78f6ffd640 1 -- 172.21.15.5:0/2438381705 <== mgr.14220 v2:172.21.15.5:6800/2696053609 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f79000635a0 con 0x7f78ec0b4c40 2024-08-31T05:30:07.521 INFO:teuthology.orchestra.run.smithi005.stdout:/ 1m 6m3h 2024-08-31T05:30:07.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.521+0000 7f7907dc3640 1 -- 172.21.15.5:0/2438381705 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f78ec0b4c40 msgr2=0x7f78ec0b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:07.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.521+0000 7f7907dc3640 1 --2- 172.21.15.5:0/2438381705 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f78ec0b4c40 0x7f78ec0b7150 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f79001056a0 tx=0x7f78f0005e50 comp rx=0 tx=0).stop 2024-08-31T05:30:07.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.521+0000 7f7907dc3640 1 -- 172.21.15.5:0/2438381705 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7900102f20 msgr2=0x7f79000fec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:07.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.521+0000 7f7907dc3640 1 --2- 172.21.15.5:0/2438381705 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7900102f20 0x7f79000fec70 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f78fc00d950 tx=0x7f78fc00de10 comp rx=0 tx=0).stop 2024-08-31T05:30:07.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.521+0000 7f7907dc3640 1 -- 172.21.15.5:0/2438381705 shutdown_connections 2024-08-31T05:30:07.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.521+0000 7f7907dc3640 1 --2- 172.21.15.5:0/2438381705 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f78ec0b4c40 0x7f78ec0b7150 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:07.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.521+0000 7f7907dc3640 1 --2- 172.21.15.5:0/2438381705 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79001057d0 0x7f79000ff6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:07.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.521+0000 7f7907dc3640 1 --2- 172.21.15.5:0/2438381705 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7900104e80 0x7f79000ff1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:07.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.521+0000 7f7907dc3640 1 --2- 172.21.15.5:0/2438381705 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7900102f20 0x7f79000fec70 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:07.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.521+0000 7f7907dc3640 1 -- 172.21.15.5:0/2438381705 >> 172.21.15.5:0/2438381705 conn(0x7f7900079c40 msgr2=0x7f7900101090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:07.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.521+0000 7f7907dc3640 1 -- 172.21.15.5:0/2438381705 shutdown_connections 2024-08-31T05:30:07.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:07.521+0000 7f7907dc3640 1 -- 172.21.15.5:0/2438381705 wait complete. 2024-08-31T05:30:07.538 DEBUG:teuthology.orchestra.run.smithi005:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-08-31T05:30:07.565 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-08-31T05:30:07.575 INFO:teuthology.run_tasks:Running task background_exec... 2024-08-31T05:30:07.649 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi005.front.sepia.ceph.com 2024-08-31T05:30:07.650 DEBUG:teuthology.orchestra.run.smithi005:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-08-31T05:30:07.650 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:30:07.652 INFO:teuthology.run_tasks:Running task workunit... 2024-08-31T05:30:07.676 INFO:tasks.workunit:Pulling workunits from ref d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T05:30:07.676 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-08-31T05:30:07.677 INFO:tasks.workunit:timeout=3h 2024-08-31T05:30:07.677 INFO:tasks.workunit:cleanup=True 2024-08-31T05:30:07.677 DEBUG:teuthology.orchestra.run.smithi005:> stat -- /home/ubuntu/cephtest/mnt.0 2024-08-31T05:30:07.692 INFO:teuthology.orchestra.run.smithi005.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-08-31T05:30:07.692 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-08-31T05:30:07.692 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 79h/121d Inode: 1099511628283 Links: 2 2024-08-31T05:30:07.692 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T05:30:07.692 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-08-31T05:30:07.692 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-08-31 05:28:20.790059899 +0000 2024-08-31T05:30:07.692 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-08-31 05:28:20.790059899 +0000 2024-08-31T05:30:07.692 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-08-31 05:29:55.950237153 +0000 2024-08-31T05:30:07.693 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-08-31 05:28:20.790059899 +0000 2024-08-31T05:30:07.693 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-08-31T05:30:07.693 DEBUG:teuthology.orchestra.run.smithi005:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-08-31T05:30:07.765 DEBUG:teuthology.orchestra.run.smithi005:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T05:30:07.823 INFO:tasks.workunit.client.0.smithi005.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-08-31T05:30:07.852 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:07 smithi005 ceph-mon[18602]: scrub queued for path: / 2024-08-31T05:30:07.852 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:07 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:30:07.852 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:07 smithi005 ceph-mon[18602]: scrub summary: active paths [/] 2024-08-31T05:30:07.852 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:07 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:30:07.852 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:07 smithi005 ceph-mon[18602]: from='client.15618 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:30:07.852 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:07 smithi005 ceph-mon[18602]: from='client.15642 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:30:07.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:07 smithi050 ceph-mon[22146]: scrub queued for path: / 2024-08-31T05:30:07.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:07 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:30:07.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:07 smithi050 ceph-mon[22146]: scrub summary: active paths [/] 2024-08-31T05:30:07.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:07 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:30:07.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:07 smithi050 ceph-mon[22146]: from='client.15618 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:30:07.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:07 smithi050 ceph-mon[22146]: from='client.15642 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:30:08.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:07 smithi070 ceph-mon[22316]: scrub queued for path: / 2024-08-31T05:30:08.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:07 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:30:08.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:07 smithi070 ceph-mon[22316]: scrub summary: active paths [/] 2024-08-31T05:30:08.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:07 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:30:08.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:07 smithi070 ceph-mon[22316]: from='client.15618 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:30:08.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:07 smithi070 ceph-mon[22316]: from='client.15642 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:30:08.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.102+0000 7f748dacc640 1 -- 172.21.15.5:0/3722297355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7488109bd0 msgr2=0x7f7488110400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:08.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.102+0000 7f748dacc640 1 --2- 172.21.15.5:0/3722297355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7488109bd0 0x7f7488110400 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f7480009ca0 tx=0x7f748002a8c0 comp rx=0 tx=0).stop 2024-08-31T05:30:08.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.102+0000 7f748dacc640 1 -- 172.21.15.5:0/3722297355 shutdown_connections 2024-08-31T05:30:08.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.102+0000 7f748dacc640 1 --2- 172.21.15.5:0/3722297355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7488109bd0 0x7f7488110400 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:08.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.102+0000 7f748dacc640 1 --2- 172.21.15.5:0/3722297355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7488109280 0x7f7488109690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:08.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.102+0000 7f748dacc640 1 --2- 172.21.15.5:0/3722297355 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7488103940 0x7f7488103d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:08.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.102+0000 7f748dacc640 1 -- 172.21.15.5:0/3722297355 >> 172.21.15.5:0/3722297355 conn(0x7f74880ff3b0 msgr2=0x7f7488101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:08.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.102+0000 7f748dacc640 1 -- 172.21.15.5:0/3722297355 shutdown_connections 2024-08-31T05:30:08.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.102+0000 7f748dacc640 1 -- 172.21.15.5:0/3722297355 wait complete. 2024-08-31T05:30:08.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.103+0000 7f748dacc640 1 Processor -- start 2024-08-31T05:30:08.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.104+0000 7f748dacc640 1 -- start start 2024-08-31T05:30:08.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.104+0000 7f748dacc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7488103940 0x7f748819a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:08.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.104+0000 7f748dacc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7488109280 0x7f748819a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:08.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.104+0000 7f748dacc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7488109bd0 0x7f748819fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:08.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.104+0000 7f748dacc640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7488113890 con 0x7f7488109bd0 2024-08-31T05:30:08.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.104+0000 7f748dacc640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7488113710 con 0x7f7488103940 2024-08-31T05:30:08.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.104+0000 7f748dacc640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7488113a10 con 0x7f7488109280 2024-08-31T05:30:08.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.104+0000 7f7486ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7488109280 0x7f748819a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:08.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.104+0000 7f7487fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7488109bd0 0x7f748819fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:08.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.104+0000 7f7486ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7488109280 0x7f748819a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:34110/0 (socket says 172.21.15.5:34110) 2024-08-31T05:30:08.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.104+0000 7f7487fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7488109bd0 0x7f748819fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41848/0 (socket says 172.21.15.5:41848) 2024-08-31T05:30:08.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.104+0000 7f7486ffd640 1 -- 172.21.15.5:0/110966551 learned_addr learned my addr 172.21.15.5:0/110966551 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:08.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.104+0000 7f74877fe640 1 --2- 172.21.15.5:0/110966551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7488103940 0x7f748819a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:08.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.104+0000 7f7486ffd640 1 -- 172.21.15.5:0/110966551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7488103940 msgr2=0x7f748819a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:08.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.104+0000 7f7486ffd640 1 --2- 172.21.15.5:0/110966551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7488103940 0x7f748819a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:08.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.104+0000 7f7486ffd640 1 -- 172.21.15.5:0/110966551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7488109bd0 msgr2=0x7f748819fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:08.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.104+0000 7f7486ffd640 1 --2- 172.21.15.5:0/110966551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7488109bd0 0x7f748819fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:08.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.104+0000 7f7486ffd640 1 -- 172.21.15.5:0/110966551 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74881a0090 con 0x7f7488109280 2024-08-31T05:30:08.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.105+0000 7f7487fff640 1 --2- 172.21.15.5:0/110966551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7488109bd0 0x7f748819fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:30:08.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.105+0000 7f7486ffd640 1 --2- 172.21.15.5:0/110966551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7488109280 0x7f748819a780 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f747c00c8c0 tx=0x7f747c00cd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:08.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.105+0000 7f7484ff9640 1 -- 172.21.15.5:0/110966551 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f747c007bb0 con 0x7f7488109280 2024-08-31T05:30:08.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.105+0000 7f748dacc640 1 -- 172.21.15.5:0/110966551 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74881a0380 con 0x7f7488109280 2024-08-31T05:30:08.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.105+0000 7f7484ff9640 1 -- 172.21.15.5:0/110966551 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f747c007d50 con 0x7f7488109280 2024-08-31T05:30:08.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.105+0000 7f748dacc640 1 -- 172.21.15.5:0/110966551 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74881a6ba0 con 0x7f7488109280 2024-08-31T05:30:08.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.105+0000 7f7484ff9640 1 -- 172.21.15.5:0/110966551 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f747c0187c0 con 0x7f7488109280 2024-08-31T05:30:08.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.108+0000 7f7494041740 1 Processor -- start 2024-08-31T05:30:08.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.108+0000 7f7494041740 1 -- start start 2024-08-31T05:30:08.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.109+0000 7f7494041740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55edddab2070 0x55eddde57300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:08.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.109+0000 7f7494041740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eddda891b0 0x55eddde57840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:08.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.109+0000 7f7484ff9640 1 -- 172.21.15.5:0/110966551 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 24) ==== 152701+0+0 (secure 0 0 0) 0x7f747c00fa20 con 0x7f7488109280 2024-08-31T05:30:08.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.109+0000 7f7494041740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eddda91390 0x55eddde57d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:08.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.109+0000 7f7494041740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55eddddce630 con 0x55edddab2070 2024-08-31T05:30:08.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.109+0000 7f7494041740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55eddddbdbc0 con 0x55eddda91390 2024-08-31T05:30:08.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.109+0000 7f7494041740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55eddddc1b70 con 0x55eddda891b0 2024-08-31T05:30:08.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.109+0000 7f7487fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55edddab2070 0x55eddde57300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:08.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.109+0000 7f7487fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55edddab2070 0x55eddde57300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41850/0 (socket says 172.21.15.5:41850) 2024-08-31T05:30:08.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.109+0000 7f7487fff640 1 -- 172.21.15.5:0/189373997 learned_addr learned my addr 172.21.15.5:0/189373997 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:08.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.109+0000 7f74877fe640 1 --2- 172.21.15.5:0/189373997 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eddda891b0 0x55eddde57840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:08.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.109+0000 7f7486ffd640 1 --2- 172.21.15.5:0/189373997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eddda91390 0x55eddde57d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:08.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.109+0000 7f7487fff640 1 -- 172.21.15.5:0/189373997 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eddda891b0 msgr2=0x55eddde57840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:08.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.109+0000 7f7487fff640 1 --2- 172.21.15.5:0/189373997 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eddda891b0 0x55eddde57840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:08.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.109+0000 7f7487fff640 1 -- 172.21.15.5:0/189373997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eddda91390 msgr2=0x55eddde57d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:08.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.109+0000 7f7487fff640 1 --2- 172.21.15.5:0/189373997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eddda91390 0x55eddde57d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:08.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.109+0000 7f7487fff640 1 -- 172.21.15.5:0/189373997 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edddb1d650 con 0x55edddab2070 2024-08-31T05:30:08.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.109+0000 7f74877fe640 1 --2- 172.21.15.5:0/189373997 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eddda891b0 0x55eddde57840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:30:08.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.109+0000 7f7486ffd640 1 --2- 172.21.15.5:0/189373997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eddda91390 0x55eddde57d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:30:08.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.110+0000 7f7487fff640 1 --2- 172.21.15.5:0/189373997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55edddab2070 0x55eddde57300 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f7480033010 tx=0x7f7480009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac3e182690516c7f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:08.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.110+0000 7f7484ff9640 1 --2- 172.21.15.5:0/110966551 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f74700b4cd0 0x7f74700b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:08.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.110+0000 7f746dffb640 1 -- 172.21.15.5:0/189373997 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7480031650 con 0x55edddab2070 2024-08-31T05:30:08.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.110+0000 7f746dffb640 1 -- 172.21.15.5:0/189373997 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7480036040 con 0x55edddab2070 2024-08-31T05:30:08.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.110+0000 7f746dffb640 1 -- 172.21.15.5:0/189373997 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7480004640 con 0x55edddab2070 2024-08-31T05:30:08.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.110+0000 7f7484ff9640 1 -- 172.21.15.5:0/110966551 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f747c0e58c0 con 0x7f7488109280 2024-08-31T05:30:08.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.110+0000 7f74877fe640 1 --2- 172.21.15.5:0/110966551 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f74700b4cd0 0x7f74700b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:08.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.111+0000 7f7494041740 1 -- 172.21.15.5:0/189373997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55edddab2070 msgr2=0x55eddde57300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:08.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.111+0000 7f74877fe640 1 --2- 172.21.15.5:0/110966551 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f74700b4cd0 0x7f74700b71e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x55eddde55f80 tx=0x7f747800b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:08.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.111+0000 7f7494041740 1 --2- 172.21.15.5:0/189373997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55edddab2070 0x55eddde57300 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f7480033010 tx=0x7f7480009800 comp rx=0 tx=0).stop 2024-08-31T05:30:08.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.111+0000 7f7494041740 1 -- 172.21.15.5:0/189373997 shutdown_connections 2024-08-31T05:30:08.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.111+0000 7f7494041740 1 --2- 172.21.15.5:0/189373997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eddda91390 0x55eddde57d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:08.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.111+0000 7f7494041740 1 --2- 172.21.15.5:0/189373997 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eddda891b0 0x55eddde57840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:08.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.111+0000 7f7494041740 1 --2- 172.21.15.5:0/189373997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55edddab2070 0x55eddde57300 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:08.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.111+0000 7f7494041740 1 -- 172.21.15.5:0/189373997 >> 172.21.15.5:0/189373997 conn(0x55edddaa6460 msgr2=0x55eddde551f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:08.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.111+0000 7f7494041740 1 -- 172.21.15.5:0/189373997 shutdown_connections 2024-08-31T05:30:08.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.111+0000 7f7494041740 1 -- 172.21.15.5:0/189373997 wait complete. 2024-08-31T05:30:08.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.111+0000 7f7494041740 1 -- start start 2024-08-31T05:30:08.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.111+0000 7f7494041740 1 Processor -- start 2024-08-31T05:30:08.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.112+0000 7f7494041740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eddda891b0 0x55eddde66e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:08.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.112+0000 7f7494041740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eddda91390 0x55eddde673b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:08.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.112+0000 7f7494041740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55edddab2070 0x55eddde72fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:08.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.112+0000 7f7494041740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55edddc20700 con 0x55edddab2070 2024-08-31T05:30:08.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.112+0000 7f7494041740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55edddd44700 con 0x55eddda891b0 2024-08-31T05:30:08.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.112+0000 7f7494041740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55eddde69c60 con 0x55eddda91390 2024-08-31T05:30:08.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.112+0000 7f7494041740 10 client.0 _ll_register_callbacks cb 0x55edddd73dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:30:08.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.112+0000 7f7487fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55edddab2070 0x55eddde72fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:08.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.112+0000 7f7486ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eddda91390 0x55eddde673b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:08.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.112+0000 7f7487fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55edddab2070 0x55eddde72fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41854/0 (socket says 172.21.15.5:41854) 2024-08-31T05:30:08.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.112+0000 7f7487fff640 1 -- 172.21.15.5:0/2567696963 learned_addr learned my addr 172.21.15.5:0/2567696963 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:08.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.112+0000 7f74877fe640 1 --2- 172.21.15.5:0/2567696963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eddda891b0 0x55eddde66e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:08.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.112+0000 7f7487fff640 1 -- 172.21.15.5:0/2567696963 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eddda91390 msgr2=0x55eddde673b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:08.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.112+0000 7f7487fff640 1 --2- 172.21.15.5:0/2567696963 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eddda91390 0x55eddde673b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:08.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.112+0000 7f7487fff640 1 -- 172.21.15.5:0/2567696963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eddda891b0 msgr2=0x55eddde66e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:08.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.112+0000 7f7487fff640 1 --2- 172.21.15.5:0/2567696963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eddda891b0 0x55eddde66e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:08.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.112+0000 7f7487fff640 1 -- 172.21.15.5:0/2567696963 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edddd7d8b0 con 0x55edddab2070 2024-08-31T05:30:08.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.112+0000 7f7486ffd640 1 --2- 172.21.15.5:0/2567696963 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eddda91390 0x55eddde673b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:30:08.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.113+0000 7f7487fff640 1 --2- 172.21.15.5:0/2567696963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55edddab2070 0x55eddde72fc0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f7480006010 tx=0x7f7480031780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dcce0c8d4423219 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:08.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.113+0000 7f7466ffd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:30:08.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.113+0000 7f7466ffd640 1 -- 172.21.15.5:0/2567696963 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7480052020 con 0x55edddab2070 2024-08-31T05:30:08.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.113+0000 7f7466ffd640 1 -- 172.21.15.5:0/2567696963 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f7480003b80 con 0x55edddab2070 2024-08-31T05:30:08.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.113+0000 7f7494041740 1 -- 172.21.15.5:0/2567696963 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7480036040 con 0x55edddab2070 2024-08-31T05:30:08.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.113+0000 7f7466ffd640 1 -- 172.21.15.5:0/2567696963 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7480003d80 con 0x55edddab2070 2024-08-31T05:30:08.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.113+0000 7f7494041740 10 client.15660 fetch_fsmap learned FSMap version 30 2024-08-31T05:30:08.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.113+0000 7f7494041740 1 -- 172.21.15.5:0/2567696963 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55eddde759d0 con 0x55edddab2070 2024-08-31T05:30:08.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.113+0000 7f7466ffd640 1 -- 172.21.15.5:0/2567696963 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7480036040 con 0x55edddab2070 2024-08-31T05:30:08.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.113+0000 7f7466ffd640 1 -- 172.21.15.5:0/2567696963 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f7480044070 con 0x55edddab2070 2024-08-31T05:30:08.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.113+0000 7f7494041740 10 client.15660 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T05:30:08.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.113+0000 7f7494041740 10 client.15660 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:30:08.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.113+0000 7f7494041740 20 client.15660 populate_metadata read hostname 'smithi005' 2024-08-31T05:30:08.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.114+0000 7f7494041740 1 --2- 172.21.15.5:0/2567696963 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55eddda709f0 0x55eddde78d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:08.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.114+0000 7f7494041740 4 client.15660 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:30:08.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.114+0000 7f7494041740 1 -- 172.21.15.5:0/2567696963 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eddddd0580 con 0x55eddda709f0 2024-08-31T05:30:08.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.114+0000 7f74877fe640 1 --2- 172.21.15.5:0/2567696963 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55eddda709f0 0x55eddde78d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:08.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.114+0000 7f7466ffd640 10 client.15660 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:30:08.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.114+0000 7f74877fe640 1 --2- 172.21.15.5:0/2567696963 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55eddda709f0 0x55eddde78d30 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63c6683bdeb24249 server_cookie=3ea5e3f6ff9c0df5 in_seq=0 out_seq=0 2024-08-31T05:30:08.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.115+0000 7f7466ffd640 1 -- 172.21.15.5:0/2567696963 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55eddddd0580 con 0x55eddda709f0 2024-08-31T05:30:08.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.115+0000 7f7466ffd640 10 client.15660 handle_command_reply: tid=0 2024-08-31T05:30:08.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.115+0000 7f7494041740 1 client.15660 shutdown 2024-08-31T05:30:08.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.115+0000 7f7494041740 1 -- 172.21.15.5:0/2567696963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55edddab2070 msgr2=0x55eddde72fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:08.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.115+0000 7f7494041740 1 --2- 172.21.15.5:0/2567696963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55edddab2070 0x55eddde72fc0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f7480006010 tx=0x7f7480031780 comp rx=0 tx=0).stop 2024-08-31T05:30:08.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.115+0000 7f7494041740 1 -- 172.21.15.5:0/2567696963 shutdown_connections 2024-08-31T05:30:08.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.115+0000 7f7494041740 1 --2- 172.21.15.5:0/2567696963 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55eddda709f0 0x55eddde78d30 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:08.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.115+0000 7f7494041740 1 --2- 172.21.15.5:0/2567696963 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55edddab2070 0x55eddde72fc0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:08.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.115+0000 7f7494041740 1 --2- 172.21.15.5:0/2567696963 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eddda91390 0x55eddde673b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:08.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.115+0000 7f7494041740 1 --2- 172.21.15.5:0/2567696963 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eddda891b0 0x55eddde66e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:08.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.115+0000 7f7494041740 1 -- 172.21.15.5:0/2567696963 >> 172.21.15.5:0/2567696963 conn(0x55edddaa6460 msgr2=0x55eddde537b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:08.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.115+0000 7f7466ffd640 0 client.15660 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:30:08.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.115+0000 7f7494041740 1 -- 172.21.15.5:0/2567696963 shutdown_connections 2024-08-31T05:30:08.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.115+0000 7f7494041740 1 -- 172.21.15.5:0/2567696963 wait complete. 2024-08-31T05:30:08.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.115+0000 7f7494041740 20 client.15660 trim_cache size 0 max 16384 2024-08-31T05:30:08.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.133+0000 7f7494041740 1 Processor -- start 2024-08-31T05:30:08.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.133+0000 7f7494041740 1 -- start start 2024-08-31T05:30:08.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.133+0000 7f7494041740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eddda891b0 0x55eddde67330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:08.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.133+0000 7f7494041740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eddda91390 0x55eddde72ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:08.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.133+0000 7f7494041740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55edddab2070 0x55eddde5c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:08.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.133+0000 7f7494041740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f74881ae930 con 0x55edddab2070 2024-08-31T05:30:08.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.133+0000 7f7494041740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f74881b0470 con 0x55eddda891b0 2024-08-31T05:30:08.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.133+0000 7f7494041740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f74881af000 con 0x55eddda91390 2024-08-31T05:30:08.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.133+0000 7f7487fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55edddab2070 0x55eddde5c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:08.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.134+0000 7f7487fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55edddab2070 0x55eddde5c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41864/0 (socket says 172.21.15.5:41864) 2024-08-31T05:30:08.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.134+0000 7f7487fff640 1 -- 172.21.15.5:0/962821719 learned_addr learned my addr 172.21.15.5:0/962821719 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:08.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.134+0000 7f7486ffd640 1 --2- 172.21.15.5:0/962821719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eddda91390 0x55eddde72ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:08.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.134+0000 7f74877fe640 1 --2- 172.21.15.5:0/962821719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eddda891b0 0x55eddde67330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:08.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.134+0000 7f7487fff640 1 -- 172.21.15.5:0/962821719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eddda91390 msgr2=0x55eddde72ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:08.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.134+0000 7f7487fff640 1 --2- 172.21.15.5:0/962821719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eddda91390 0x55eddde72ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:08.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.134+0000 7f7487fff640 1 -- 172.21.15.5:0/962821719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eddda891b0 msgr2=0x55eddde67330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:08.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.134+0000 7f7487fff640 1 --2- 172.21.15.5:0/962821719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eddda891b0 0x55eddde67330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:08.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.134+0000 7f7487fff640 1 -- 172.21.15.5:0/962821719 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eddde580f0 con 0x55edddab2070 2024-08-31T05:30:08.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.134+0000 7f74877fe640 1 --2- 172.21.15.5:0/962821719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eddda891b0 0x55eddde67330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:30:08.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.134+0000 7f7487fff640 1 --2- 172.21.15.5:0/962821719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55edddab2070 0x55eddde5c4a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f7480009bf0 tx=0x7f7480009540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81552de5f91e050b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:08.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.134+0000 7f746d7fa640 1 -- 172.21.15.5:0/962821719 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7480052020 con 0x55edddab2070 2024-08-31T05:30:08.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.134+0000 7f746d7fa640 1 -- 172.21.15.5:0/962821719 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7480036070 con 0x55edddab2070 2024-08-31T05:30:08.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.134+0000 7f746d7fa640 1 -- 172.21.15.5:0/962821719 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7480003f20 con 0x55edddab2070 2024-08-31T05:30:08.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.135+0000 7f7494041740 1 -- 172.21.15.5:0/962821719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55edddab2070 msgr2=0x55eddde5c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:08.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.135+0000 7f7494041740 1 --2- 172.21.15.5:0/962821719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55edddab2070 0x55eddde5c4a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f7480009bf0 tx=0x7f7480009540 comp rx=0 tx=0).stop 2024-08-31T05:30:08.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.135+0000 7f7494041740 1 -- 172.21.15.5:0/962821719 shutdown_connections 2024-08-31T05:30:08.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.135+0000 7f7494041740 1 --2- 172.21.15.5:0/962821719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55edddab2070 0x55eddde5c4a0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:08.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.135+0000 7f7494041740 1 --2- 172.21.15.5:0/962821719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eddda91390 0x55eddde72ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:08.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.135+0000 7f7494041740 1 --2- 172.21.15.5:0/962821719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eddda891b0 0x55eddde67330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:08.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.135+0000 7f7494041740 1 -- 172.21.15.5:0/962821719 >> 172.21.15.5:0/962821719 conn(0x55edddaa6460 msgr2=0x55eddde66c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:08.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.135+0000 7f7494041740 1 -- 172.21.15.5:0/962821719 shutdown_connections 2024-08-31T05:30:08.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.135+0000 7f7494041740 1 -- 172.21.15.5:0/962821719 wait complete. 2024-08-31T05:30:08.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.135+0000 7f7494041740 1 -- start start 2024-08-31T05:30:08.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.136+0000 7f7494041740 1 Processor -- start 2024-08-31T05:30:08.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.136+0000 7f7494041740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eddda891b0 0x55eddde6f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:08.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.136+0000 7f7494041740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eddda91390 0x55eddde6ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:08.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.136+0000 7f7494041740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55edddab2070 0x55eddde6b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:08.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.136+0000 7f7494041740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f74881afda0 con 0x55eddda91390 2024-08-31T05:30:08.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.136+0000 7f7494041740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f74881af6d0 con 0x55eddda891b0 2024-08-31T05:30:08.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.136+0000 7f7494041740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f74881ac910 con 0x55edddab2070 2024-08-31T05:30:08.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.136+0000 7f7494041740 10 client.0 _ll_register_callbacks cb 0x7f7480032f60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:30:08.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.136+0000 7f7486ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eddda91390 0x55eddde6ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:08.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.136+0000 7f7486ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eddda91390 0x55eddde6ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41874/0 (socket says 172.21.15.5:41874) 2024-08-31T05:30:08.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.136+0000 7f7486ffd640 1 -- 172.21.15.5:0/3629591185 learned_addr learned my addr 172.21.15.5:0/3629591185 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:08.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.136+0000 7f74877fe640 1 --2- 172.21.15.5:0/3629591185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eddda891b0 0x55eddde6f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:08.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.136+0000 7f7487fff640 1 --2- 172.21.15.5:0/3629591185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55edddab2070 0x55eddde6b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:08.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.136+0000 7f7486ffd640 1 -- 172.21.15.5:0/3629591185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55edddab2070 msgr2=0x55eddde6b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:08.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.136+0000 7f7486ffd640 1 --2- 172.21.15.5:0/3629591185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55edddab2070 0x55eddde6b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:08.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.136+0000 7f7486ffd640 1 -- 172.21.15.5:0/3629591185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eddda891b0 msgr2=0x55eddde6f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:08.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.136+0000 7f7486ffd640 1 --2- 172.21.15.5:0/3629591185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eddda891b0 0x55eddde6f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:08.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.136+0000 7f7486ffd640 1 -- 172.21.15.5:0/3629591185 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edddee2530 con 0x55eddda91390 2024-08-31T05:30:08.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.136+0000 7f74877fe640 1 --2- 172.21.15.5:0/3629591185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eddda891b0 0x55eddde6f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:30:08.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.137+0000 7f7486ffd640 1 --2- 172.21.15.5:0/3629591185 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eddda91390 0x55eddde6ae60 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f747c0e2cf0 tx=0x7f747c0a7c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b010977b6252bdfd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:08.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.137+0000 7f7466ffd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:30:08.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.137+0000 7f7466ffd640 1 -- 172.21.15.5:0/3629591185 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f747c0ab3a0 con 0x55eddda91390 2024-08-31T05:30:08.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.137+0000 7f7466ffd640 1 -- 172.21.15.5:0/3629591185 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f747c0aae90 con 0x55eddda91390 2024-08-31T05:30:08.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.137+0000 7f7494041740 1 -- 172.21.15.5:0/3629591185 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7480036070 con 0x55eddda91390 2024-08-31T05:30:08.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.137+0000 7f7466ffd640 1 -- 172.21.15.5:0/3629591185 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f747c0a73c0 con 0x55eddda91390 2024-08-31T05:30:08.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.137+0000 7f7494041740 10 client.15666 fetch_fsmap learned FSMap version 30 2024-08-31T05:30:08.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.137+0000 7f7494041740 1 -- 172.21.15.5:0/3629591185 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55edddee3690 con 0x55eddda91390 2024-08-31T05:30:08.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.137+0000 7f7466ffd640 1 -- 172.21.15.5:0/3629591185 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7480036070 con 0x55eddda91390 2024-08-31T05:30:08.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.137+0000 7f7466ffd640 1 -- 172.21.15.5:0/3629591185 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f747c0aa900 con 0x55eddda91390 2024-08-31T05:30:08.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.137+0000 7f7494041740 10 client.15666 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T05:30:08.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.137+0000 7f7494041740 10 client.15666 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:30:08.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.137+0000 7f7494041740 20 client.15666 populate_metadata read hostname 'smithi005' 2024-08-31T05:30:08.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.137+0000 7f7494041740 1 --2- 172.21.15.5:0/3629591185 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55eddda45da0 0x55edddee5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:08.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.137+0000 7f7494041740 4 client.15666 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T05:30:08.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.137+0000 7f7494041740 1 -- 172.21.15.5:0/3629591185 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55eddddcc020 con 0x55eddda45da0 2024-08-31T05:30:08.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.138+0000 7f74877fe640 1 --2- 172.21.15.5:0/3629591185 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55eddda45da0 0x55edddee5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:08.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.138+0000 7f7466ffd640 10 client.15666 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:30:08.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.138+0000 7f74877fe640 1 --2- 172.21.15.5:0/3629591185 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55eddda45da0 0x55edddee5e30 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0edff1a6e5a166e server_cookie=f5672defbc58e53c in_seq=0 out_seq=0 2024-08-31T05:30:08.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.138+0000 7f7466ffd640 1 -- 172.21.15.5:0/3629591185 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+570 (crc 0 0 0) 0x55eddddcc020 con 0x55eddda45da0 2024-08-31T05:30:08.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.138+0000 7f7466ffd640 10 client.15666 handle_command_reply: tid=0 2024-08-31T05:30:08.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.138+0000 7f7494041740 1 client.15666 shutdown 2024-08-31T05:30:08.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.138+0000 7f7494041740 1 -- 172.21.15.5:0/3629591185 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eddda91390 msgr2=0x55eddde6ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:08.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.138+0000 7f7494041740 1 --2- 172.21.15.5:0/3629591185 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eddda91390 0x55eddde6ae60 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f747c0e2cf0 tx=0x7f747c0a7c20 comp rx=0 tx=0).stop 2024-08-31T05:30:08.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.138+0000 7f7494041740 1 -- 172.21.15.5:0/3629591185 shutdown_connections 2024-08-31T05:30:08.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.138+0000 7f7494041740 1 --2- 172.21.15.5:0/3629591185 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55eddda45da0 0x55edddee5e30 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:08.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.138+0000 7f7494041740 1 --2- 172.21.15.5:0/3629591185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55edddab2070 0x55eddde6b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:08.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.139+0000 7f7494041740 1 --2- 172.21.15.5:0/3629591185 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eddda91390 0x55eddde6ae60 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:08.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.139+0000 7f7494041740 1 --2- 172.21.15.5:0/3629591185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eddda891b0 0x55eddde6f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:08.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.139+0000 7f7494041740 1 -- 172.21.15.5:0/3629591185 >> 172.21.15.5:0/3629591185 conn(0x55edddaa6460 msgr2=0x55eddde551c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:08.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.139+0000 7f7466ffd640 0 client.15666 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:30:08.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.139+0000 7f7494041740 1 -- 172.21.15.5:0/3629591185 shutdown_connections 2024-08-31T05:30:08.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.139+0000 7f7494041740 1 -- 172.21.15.5:0/3629591185 wait complete. 2024-08-31T05:30:08.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.139+0000 7f7494041740 20 client.15666 trim_cache size 0 max 16384 2024-08-31T05:30:08.147 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:30:08.147 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T05:30:08.147 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2024-08-31T05:30:08.147 INFO:teuthology.orchestra.run.smithi005.stdout: "75d84398-5d9c-4872-b879-2fbce045fa71": { 2024-08-31T05:30:08.147 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:30:08.147 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "75d84398-5d9c-4872-b879-2fbce045fa71", 2024-08-31T05:30:08.147 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2024-08-31T05:30:08.147 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:30:08.148 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:30:08.148 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_stats": { 2024-08-31T05:30:08.148 INFO:teuthology.orchestra.run.smithi005.stdout: "75d84398-5d9c-4872-b879-2fbce045fa71": { 2024-08-31T05:30:08.148 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:06.642335+0000", 2024-08-31T05:30:08.148 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:30:08.148 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:30:08.148 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:30:08.148 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:30:08.148 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:30:08.148 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:30:08.148 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:30:08.148 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:30:08.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.139+0000 7f748dacc640 1 -- 172.21.15.5:0/110966551 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f74700b4cd0 msgr2=0x7f74700b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:08.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.139+0000 7f748dacc640 1 --2- 172.21.15.5:0/110966551 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f74700b4cd0 0x7f74700b71e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x55eddde55f80 tx=0x7f747800b390 comp rx=0 tx=0).stop 2024-08-31T05:30:08.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.139+0000 7f748dacc640 1 -- 172.21.15.5:0/110966551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7488109280 msgr2=0x7f748819a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:08.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.139+0000 7f748dacc640 1 --2- 172.21.15.5:0/110966551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7488109280 0x7f748819a780 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f747c00c8c0 tx=0x7f747c00cd80 comp rx=0 tx=0).stop 2024-08-31T05:30:08.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.139+0000 7f748dacc640 1 -- 172.21.15.5:0/110966551 shutdown_connections 2024-08-31T05:30:08.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.139+0000 7f748dacc640 1 --2- 172.21.15.5:0/110966551 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f74700b4cd0 0x7f74700b71e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:08.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.139+0000 7f748dacc640 1 --2- 172.21.15.5:0/110966551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7488109bd0 0x7f748819fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:08.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.139+0000 7f748dacc640 1 --2- 172.21.15.5:0/110966551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7488109280 0x7f748819a780 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:08.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.139+0000 7f748dacc640 1 --2- 172.21.15.5:0/110966551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7488103940 0x7f748819a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:08.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.139+0000 7f748dacc640 1 -- 172.21.15.5:0/110966551 >> 172.21.15.5:0/110966551 conn(0x7f74880ff3b0 msgr2=0x7f7488106810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:08.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.140+0000 7f748dacc640 1 -- 172.21.15.5:0/110966551 shutdown_connections 2024-08-31T05:30:08.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:08.140+0000 7f748dacc640 1 -- 172.21.15.5:0/110966551 wait complete. 2024-08-31T05:30:08.895 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:08 smithi005 ceph-mon[18602]: pgmap v350: 129 pgs: 129 active+clean; 654 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2024-08-31T05:30:08.895 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:08 smithi005 ceph-mon[18602]: from='client.15648 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:30:08.895 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:08 smithi005 ceph-mon[18602]: mgrmap e24: x(active, since 9m), standbys: z, y 2024-08-31T05:30:08.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:08 smithi050 ceph-mon[22146]: pgmap v350: 129 pgs: 129 active+clean; 654 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2024-08-31T05:30:08.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:08 smithi050 ceph-mon[22146]: from='client.15648 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:30:08.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:08 smithi050 ceph-mon[22146]: mgrmap e24: x(active, since 9m), standbys: z, y 2024-08-31T05:30:08.921 INFO:tasks.cephfs.filesystem:scrub status for tag:75d84398-5d9c-4872-b879-2fbce045fa71 - {'path': '/', 'tag': '75d84398-5d9c-4872-b879-2fbce045fa71', 'options': 'recursive,force'} 2024-08-31T05:30:09.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:08 smithi070 ceph-mon[22316]: pgmap v350: 129 pgs: 129 active+clean; 654 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2024-08-31T05:30:09.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:08 smithi070 ceph-mon[22316]: from='client.15648 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:30:09.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:08 smithi070 ceph-mon[22316]: mgrmap e24: x(active, since 9m), standbys: z, y 2024-08-31T05:30:10.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:10 smithi050 ceph-mon[22146]: pgmap v351: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 176 KiB/s wr, 59 op/s 2024-08-31T05:30:10.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:10 smithi005 ceph-mon[18602]: pgmap v351: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 176 KiB/s wr, 59 op/s 2024-08-31T05:30:11.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:10 smithi070 ceph-mon[22316]: pgmap v351: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 176 KiB/s wr, 59 op/s 2024-08-31T05:30:12.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:12 smithi050 ceph-mon[22146]: pgmap v352: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 55 op/s 2024-08-31T05:30:12.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:12 smithi005 ceph-mon[18602]: pgmap v352: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 55 op/s 2024-08-31T05:30:13.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:12 smithi070 ceph-mon[22316]: pgmap v352: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 55 op/s 2024-08-31T05:30:14.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:14 smithi050 ceph-mon[22146]: pgmap v353: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 175 KiB/s wr, 58 op/s 2024-08-31T05:30:14.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:14 smithi005 ceph-mon[18602]: pgmap v353: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 175 KiB/s wr, 58 op/s 2024-08-31T05:30:15.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:14 smithi070 ceph-mon[22316]: pgmap v353: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 175 KiB/s wr, 58 op/s 2024-08-31T05:30:16.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:16 smithi050 ceph-mon[22146]: pgmap v354: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 175 KiB/s wr, 57 op/s 2024-08-31T05:30:16.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:16 smithi005 ceph-mon[18602]: pgmap v354: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 175 KiB/s wr, 57 op/s 2024-08-31T05:30:17.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:16 smithi070 ceph-mon[22316]: pgmap v354: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 175 KiB/s wr, 57 op/s 2024-08-31T05:30:17.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:17 smithi050 ceph-mon[22146]: scrub summary: idle 2024-08-31T05:30:17.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:17 smithi005 ceph-mon[18602]: scrub summary: idle 2024-08-31T05:30:18.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:17 smithi070 ceph-mon[22316]: scrub summary: idle 2024-08-31T05:30:18.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:18 smithi050 ceph-mon[22146]: pgmap v355: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 175 KiB/s wr, 55 op/s 2024-08-31T05:30:18.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:18 smithi005 ceph-mon[18602]: pgmap v355: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 175 KiB/s wr, 55 op/s 2024-08-31T05:30:19.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:18 smithi070 ceph-mon[22316]: pgmap v355: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 175 KiB/s wr, 55 op/s 2024-08-31T05:30:20.806 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.803+0000 7ffb74847640 1 -- 172.21.15.5:0/567881046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb70108a10 msgr2=0x7ffb7010f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:20.806 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.803+0000 7ffb74847640 1 --2- 172.21.15.5:0/567881046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb70108a10 0x7ffb7010f240 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7ffb68009ca0 tx=0x7ffb6802a8c0 comp rx=0 tx=0).stop 2024-08-31T05:30:20.806 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.803+0000 7ffb74847640 1 -- 172.21.15.5:0/567881046 shutdown_connections 2024-08-31T05:30:20.806 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.803+0000 7ffb74847640 1 --2- 172.21.15.5:0/567881046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb70108a10 0x7ffb7010f240 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:20.806 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.803+0000 7ffb74847640 1 --2- 172.21.15.5:0/567881046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb701080c0 0x7ffb701084d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:20.806 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.803+0000 7ffb74847640 1 --2- 172.21.15.5:0/567881046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb70102790 0x7ffb70102ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:20.806 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.803+0000 7ffb74847640 1 -- 172.21.15.5:0/567881046 >> 172.21.15.5:0/567881046 conn(0x7ffb700fe190 msgr2=0x7ffb701005e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:20.806 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.803+0000 7ffb74847640 1 -- 172.21.15.5:0/567881046 shutdown_connections 2024-08-31T05:30:20.806 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.803+0000 7ffb74847640 1 -- 172.21.15.5:0/567881046 wait complete. 2024-08-31T05:30:20.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.804+0000 7ffb74847640 1 Processor -- start 2024-08-31T05:30:20.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.804+0000 7ffb74847640 1 -- start start 2024-08-31T05:30:20.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.805+0000 7ffb74847640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb70102790 0x7ffb7019afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:20.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.805+0000 7ffb74847640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb701080c0 0x7ffb7019b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:20.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.805+0000 7ffb74847640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb70108a10 0x7ffb7019ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:20.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.805+0000 7ffb74847640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ffb701126e0 con 0x7ffb70108a10 2024-08-31T05:30:20.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.805+0000 7ffb74847640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ffb70112560 con 0x7ffb701080c0 2024-08-31T05:30:20.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.805+0000 7ffb74847640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ffb70112860 con 0x7ffb70102790 2024-08-31T05:30:20.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.805+0000 7ffb6ed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb70108a10 0x7ffb7019ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:20.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.805+0000 7ffb6ed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb70108a10 0x7ffb7019ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54278/0 (socket says 172.21.15.5:54278) 2024-08-31T05:30:20.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.805+0000 7ffb6ed9d640 1 -- 172.21.15.5:0/4146435708 learned_addr learned my addr 172.21.15.5:0/4146435708 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:20.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.805+0000 7ffb6e59c640 1 --2- 172.21.15.5:0/4146435708 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb70102790 0x7ffb7019afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:20.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.805+0000 7ffb6dd9b640 1 --2- 172.21.15.5:0/4146435708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb701080c0 0x7ffb7019b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:20.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.805+0000 7ffb6ed9d640 1 -- 172.21.15.5:0/4146435708 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb70102790 msgr2=0x7ffb7019afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:20.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.805+0000 7ffb6ed9d640 1 --2- 172.21.15.5:0/4146435708 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb70102790 0x7ffb7019afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:20.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.805+0000 7ffb6ed9d640 1 -- 172.21.15.5:0/4146435708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb701080c0 msgr2=0x7ffb7019b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:20.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.805+0000 7ffb6ed9d640 1 --2- 172.21.15.5:0/4146435708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb701080c0 0x7ffb7019b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:20.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.805+0000 7ffb6ed9d640 1 -- 172.21.15.5:0/4146435708 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb701a6240 con 0x7ffb70108a10 2024-08-31T05:30:20.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.805+0000 7ffb6e59c640 1 --2- 172.21.15.5:0/4146435708 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb70102790 0x7ffb7019afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:30:20.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.805+0000 7ffb6ed9d640 1 --2- 172.21.15.5:0/4146435708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb70108a10 0x7ffb7019ba30 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7ffb68005cc0 tx=0x7ffb68031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:20.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.806+0000 7ffb5f7fe640 1 -- 172.21.15.5:0/4146435708 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb68003b70 con 0x7ffb70108a10 2024-08-31T05:30:20.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.806+0000 7ffb5f7fe640 1 -- 172.21.15.5:0/4146435708 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb680318f0 con 0x7ffb70108a10 2024-08-31T05:30:20.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.806+0000 7ffb5f7fe640 1 -- 172.21.15.5:0/4146435708 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb6802f950 con 0x7ffb70108a10 2024-08-31T05:30:20.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.806+0000 7ffb74847640 1 -- 172.21.15.5:0/4146435708 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb701a64d0 con 0x7ffb70108a10 2024-08-31T05:30:20.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.806+0000 7ffb74847640 1 -- 172.21.15.5:0/4146435708 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb701a69d0 con 0x7ffb70108a10 2024-08-31T05:30:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.809+0000 7ffb7b88b740 1 Processor -- start 2024-08-31T05:30:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.809+0000 7ffb5f7fe640 1 -- 172.21.15.5:0/4146435708 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) ==== 152701+0+0 (secure 0 0 0) 0x7ffb6802fb50 con 0x7ffb70108a10 2024-08-31T05:30:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.809+0000 7ffb7b88b740 1 -- start start 2024-08-31T05:30:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.809+0000 7ffb7b88b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641957991b0 0x564195b3cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.809+0000 7ffb7b88b740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641957702f0 0x564195b3d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.809+0000 7ffb7b88b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641957784d0 0x564195b3d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.809+0000 7ffb7b88b740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x564195ab2000 con 0x5641957702f0 2024-08-31T05:30:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.809+0000 7ffb7b88b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564195aa1590 con 0x5641957784d0 2024-08-31T05:30:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.809+0000 7ffb7b88b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564195aa5540 con 0x5641957991b0 2024-08-31T05:30:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.809+0000 7ffb6e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641957702f0 0x564195b3d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.810+0000 7ffb6e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641957702f0 0x564195b3d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54284/0 (socket says 172.21.15.5:54284) 2024-08-31T05:30:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.810+0000 7ffb6e59c640 1 -- 172.21.15.5:0/2568219192 learned_addr learned my addr 172.21.15.5:0/2568219192 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.810+0000 7ffb6dd9b640 1 --2- 172.21.15.5:0/2568219192 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641957784d0 0x564195b3d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.810+0000 7ffb6dd9b640 1 --2- 172.21.15.5:0/2568219192 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641957991b0 0x564195b3cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.810+0000 7ffb5f7fe640 1 --2- 172.21.15.5:0/4146435708 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ffb580b4d20 0x7ffb580b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.810+0000 7ffb6e59c640 1 -- 172.21.15.5:0/2568219192 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641957991b0 msgr2=0x564195b3cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:20.818 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.810+0000 7ffb6e59c640 1 --2- 172.21.15.5:0/2568219192 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641957991b0 0x564195b3cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:20.818 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.810+0000 7ffb6e59c640 1 -- 172.21.15.5:0/2568219192 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641957784d0 msgr2=0x564195b3d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:20.818 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.810+0000 7ffb6e59c640 1 --2- 172.21.15.5:0/2568219192 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641957784d0 0x564195b3d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:20.818 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.810+0000 7ffb6e59c640 1 -- 172.21.15.5:0/2568219192 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564195804790 con 0x5641957702f0 2024-08-31T05:30:20.818 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.810+0000 7ffb6dd9b640 1 --2- 172.21.15.5:0/2568219192 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641957991b0 0x564195b3cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:30:20.818 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.810+0000 7ffb6ed9d640 1 --2- 172.21.15.5:0/4146435708 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ffb580b4d20 0x7ffb580b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:20.818 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.810+0000 7ffb6e59c640 1 --2- 172.21.15.5:0/2568219192 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641957702f0 0x564195b3d000 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7ffb600114f0 tx=0x7ffb600119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c44efb1f2958cdd0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:20.818 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.810+0000 7ffb5f7fe640 1 -- 172.21.15.5:0/4146435708 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7ffb68106a20 con 0x7ffb70108a10 2024-08-31T05:30:20.818 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.810+0000 7ffb5cff9640 1 -- 172.21.15.5:0/2568219192 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb6001e070 con 0x5641957702f0 2024-08-31T05:30:20.818 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.810+0000 7ffb5cff9640 1 -- 172.21.15.5:0/2568219192 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb600035f0 con 0x5641957702f0 2024-08-31T05:30:20.818 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.810+0000 7ffb5cff9640 1 -- 172.21.15.5:0/2568219192 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb6000f820 con 0x5641957702f0 2024-08-31T05:30:20.818 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.811+0000 7ffb7b88b740 1 -- 172.21.15.5:0/2568219192 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641957702f0 msgr2=0x564195b3d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:20.818 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.811+0000 7ffb7b88b740 1 --2- 172.21.15.5:0/2568219192 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641957702f0 0x564195b3d000 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7ffb600114f0 tx=0x7ffb600119b0 comp rx=0 tx=0).stop 2024-08-31T05:30:20.818 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.811+0000 7ffb6ed9d640 1 --2- 172.21.15.5:0/4146435708 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ffb580b4d20 0x7ffb580b7230 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ffb68103ea0 tx=0x7ffb680047b0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:20.819 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.811+0000 7ffb7b88b740 1 -- 172.21.15.5:0/2568219192 shutdown_connections 2024-08-31T05:30:20.819 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.811+0000 7ffb7b88b740 1 --2- 172.21.15.5:0/2568219192 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641957784d0 0x564195b3d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:20.819 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.811+0000 7ffb7b88b740 1 --2- 172.21.15.5:0/2568219192 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641957702f0 0x564195b3d000 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:20.819 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.811+0000 7ffb7b88b740 1 --2- 172.21.15.5:0/2568219192 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641957991b0 0x564195b3cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:20.819 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.811+0000 7ffb7b88b740 1 -- 172.21.15.5:0/2568219192 >> 172.21.15.5:0/2568219192 conn(0x56419578d300 msgr2=0x564195b3a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:20.819 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.811+0000 7ffb7b88b740 1 -- 172.21.15.5:0/2568219192 shutdown_connections 2024-08-31T05:30:20.819 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.811+0000 7ffb7b88b740 1 -- 172.21.15.5:0/2568219192 wait complete. 2024-08-31T05:30:20.819 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.812+0000 7ffb7b88b740 1 -- start start 2024-08-31T05:30:20.819 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.812+0000 7ffb7b88b740 1 Processor -- start 2024-08-31T05:30:20.819 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.812+0000 7ffb7b88b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641957702f0 0x564195b48660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:20.819 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.812+0000 7ffb7b88b740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641957784d0 0x564195b48ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:20.819 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.812+0000 7ffb7b88b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641957991b0 0x564195b54560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:20.819 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.812+0000 7ffb7b88b740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5641959daab0 con 0x5641957784d0 2024-08-31T05:30:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.812+0000 7ffb7b88b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564195a28680 con 0x5641957702f0 2024-08-31T05:30:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.812+0000 7ffb7b88b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564195b4b240 con 0x5641957991b0 2024-08-31T05:30:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.812+0000 7ffb7b88b740 10 client.0 _ll_register_callbacks cb 0x5641957b0a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:30:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.812+0000 7ffb6e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641957784d0 0x564195b48ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.812+0000 7ffb6e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641957784d0 0x564195b48ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54294/0 (socket says 172.21.15.5:54294) 2024-08-31T05:30:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.812+0000 7ffb6e59c640 1 -- 172.21.15.5:0/3852907751 learned_addr learned my addr 172.21.15.5:0/3852907751 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.813+0000 7ffb6dd9b640 1 --2- 172.21.15.5:0/3852907751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641957991b0 0x564195b54560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.813+0000 7ffb6dd9b640 1 --2- 172.21.15.5:0/3852907751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641957702f0 0x564195b48660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.813+0000 7ffb6e59c640 1 -- 172.21.15.5:0/3852907751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641957991b0 msgr2=0x564195b54560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.813+0000 7ffb6e59c640 1 --2- 172.21.15.5:0/3852907751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641957991b0 0x564195b54560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.813+0000 7ffb6e59c640 1 -- 172.21.15.5:0/3852907751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641957702f0 msgr2=0x564195b48660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.813+0000 7ffb6e59c640 1 --2- 172.21.15.5:0/3852907751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641957702f0 0x564195b48660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.813+0000 7ffb6e59c640 1 -- 172.21.15.5:0/3852907751 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56419587d620 con 0x5641957784d0 2024-08-31T05:30:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.813+0000 7ffb6dd9b640 1 --2- 172.21.15.5:0/3852907751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641957991b0 0x564195b54560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:30:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.813+0000 7ffb6e59c640 1 --2- 172.21.15.5:0/3852907751 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641957784d0 0x564195b48ba0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7ffb600114c0 tx=0x7ffb60009de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e3b131677da75da server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.813+0000 7ffb55ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:30:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.813+0000 7ffb55ffb640 1 -- 172.21.15.5:0/3852907751 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb6001e040 con 0x5641957784d0 2024-08-31T05:30:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.813+0000 7ffb55ffb640 1 -- 172.21.15.5:0/3852907751 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7ffb600039e0 con 0x5641957784d0 2024-08-31T05:30:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.813+0000 7ffb7b88b740 1 -- 172.21.15.5:0/3852907751 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb600035f0 con 0x5641957784d0 2024-08-31T05:30:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.813+0000 7ffb55ffb640 1 -- 172.21.15.5:0/3852907751 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ffb60032050 con 0x5641957784d0 2024-08-31T05:30:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.813+0000 7ffb7b88b740 10 client.15678 fetch_fsmap learned FSMap version 30 2024-08-31T05:30:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.813+0000 7ffb7b88b740 1 -- 172.21.15.5:0/3852907751 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564195b57260 con 0x5641957784d0 2024-08-31T05:30:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.814+0000 7ffb55ffb640 1 -- 172.21.15.5:0/3852907751 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb600035f0 con 0x5641957784d0 2024-08-31T05:30:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.814+0000 7ffb55ffb640 1 -- 172.21.15.5:0/3852907751 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7ffb60021030 con 0x5641957784d0 2024-08-31T05:30:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.814+0000 7ffb7b88b740 10 client.15678 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T05:30:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.814+0000 7ffb7b88b740 10 client.15678 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:30:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.814+0000 7ffb7b88b740 20 client.15678 populate_metadata read hostname 'smithi005' 2024-08-31T05:30:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.814+0000 7ffb7b88b740 1 --2- 172.21.15.5:0/3852907751 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x564195757d80 0x564195b5a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:20.822 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.814+0000 7ffb7b88b740 4 client.15678 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:30:20.822 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.814+0000 7ffb7b88b740 1 -- 172.21.15.5:0/3852907751 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564195ab3f50 con 0x564195757d80 2024-08-31T05:30:20.822 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.814+0000 7ffb6dd9b640 1 --2- 172.21.15.5:0/3852907751 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x564195757d80 0x564195b5a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:20.822 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.815+0000 7ffb55ffb640 10 client.15678 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:30:20.822 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.815+0000 7ffb6dd9b640 1 --2- 172.21.15.5:0/3852907751 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x564195757d80 0x564195b5a670 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f2f8c33587e499f server_cookie=3b42ee77e16116c6 in_seq=0 out_seq=0 2024-08-31T05:30:20.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.815+0000 7ffb55ffb640 1 -- 172.21.15.5:0/3852907751 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564195ab3f50 con 0x564195757d80 2024-08-31T05:30:20.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.815+0000 7ffb55ffb640 10 client.15678 handle_command_reply: tid=0 2024-08-31T05:30:20.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.816+0000 7ffb7b88b740 1 client.15678 shutdown 2024-08-31T05:30:20.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.816+0000 7ffb7b88b740 1 -- 172.21.15.5:0/3852907751 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641957784d0 msgr2=0x564195b48ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:20.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.816+0000 7ffb7b88b740 1 --2- 172.21.15.5:0/3852907751 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641957784d0 0x564195b48ba0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7ffb600114c0 tx=0x7ffb60009de0 comp rx=0 tx=0).stop 2024-08-31T05:30:20.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.816+0000 7ffb7b88b740 1 -- 172.21.15.5:0/3852907751 shutdown_connections 2024-08-31T05:30:20.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.816+0000 7ffb7b88b740 1 --2- 172.21.15.5:0/3852907751 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x564195757d80 0x564195b5a670 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:20.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.816+0000 7ffb7b88b740 1 --2- 172.21.15.5:0/3852907751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641957991b0 0x564195b54560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:20.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.816+0000 7ffb7b88b740 1 --2- 172.21.15.5:0/3852907751 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641957784d0 0x564195b48ba0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:20.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.816+0000 7ffb55ffb640 0 client.15678 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:30:20.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.816+0000 7ffb7b88b740 1 --2- 172.21.15.5:0/3852907751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641957702f0 0x564195b48660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:20.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.816+0000 7ffb7b88b740 1 -- 172.21.15.5:0/3852907751 >> 172.21.15.5:0/3852907751 conn(0x56419578d300 msgr2=0x564195b3daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:20.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.816+0000 7ffb7b88b740 1 -- 172.21.15.5:0/3852907751 shutdown_connections 2024-08-31T05:30:20.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.816+0000 7ffb7b88b740 1 -- 172.21.15.5:0/3852907751 wait complete. 2024-08-31T05:30:20.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.816+0000 7ffb7b88b740 20 client.15678 trim_cache size 0 max 16384 2024-08-31T05:30:20.834 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.831+0000 7ffb7b88b740 1 Processor -- start 2024-08-31T05:30:20.834 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.831+0000 7ffb7b88b740 1 -- start start 2024-08-31T05:30:20.834 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.831+0000 7ffb7b88b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641957702f0 0x564195b54460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:20.834 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.831+0000 7ffb7b88b740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641957784d0 0x564195b41bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:20.834 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.831+0000 7ffb7b88b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641957991b0 0x564195b42130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:20.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.831+0000 7ffb7b88b740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ffb701b0c00 con 0x5641957784d0 2024-08-31T05:30:20.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.831+0000 7ffb7b88b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ffb701b2740 con 0x5641957991b0 2024-08-31T05:30:20.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.831+0000 7ffb7b88b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ffb701b12d0 con 0x5641957702f0 2024-08-31T05:30:20.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.831+0000 7ffb6e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641957784d0 0x564195b41bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:20.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.831+0000 7ffb6e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641957784d0 0x564195b41bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54302/0 (socket says 172.21.15.5:54302) 2024-08-31T05:30:20.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.832+0000 7ffb6e59c640 1 -- 172.21.15.5:0/3349375627 learned_addr learned my addr 172.21.15.5:0/3349375627 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:20.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.832+0000 7ffb6dd9b640 1 --2- 172.21.15.5:0/3349375627 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641957991b0 0x564195b42130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:20.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.832+0000 7ffb6dd9b640 1 --2- 172.21.15.5:0/3349375627 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641957702f0 0x564195b54460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:20.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.832+0000 7ffb6e59c640 1 -- 172.21.15.5:0/3349375627 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641957702f0 msgr2=0x564195b54460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:20.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.832+0000 7ffb6e59c640 1 --2- 172.21.15.5:0/3349375627 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641957702f0 0x564195b54460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:20.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.832+0000 7ffb6e59c640 1 -- 172.21.15.5:0/3349375627 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641957991b0 msgr2=0x564195b42130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:20.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.832+0000 7ffb6e59c640 1 --2- 172.21.15.5:0/3349375627 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641957991b0 0x564195b42130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:20.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.832+0000 7ffb6e59c640 1 -- 172.21.15.5:0/3349375627 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564195b42670 con 0x5641957784d0 2024-08-31T05:30:20.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.832+0000 7ffb6dd9b640 1 --2- 172.21.15.5:0/3349375627 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641957702f0 0x564195b54460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:30:20.836 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.832+0000 7ffb6e59c640 1 --2- 172.21.15.5:0/3349375627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641957784d0 0x564195b41bf0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7ffb60011eb0 tx=0x7ffb600119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff5b0abd66d67be server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:20.836 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.832+0000 7ffb57fff640 1 -- 172.21.15.5:0/3349375627 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb6001e070 con 0x5641957784d0 2024-08-31T05:30:20.836 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.832+0000 7ffb57fff640 1 -- 172.21.15.5:0/3349375627 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb60029070 con 0x5641957784d0 2024-08-31T05:30:20.836 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.832+0000 7ffb57fff640 1 -- 172.21.15.5:0/3349375627 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb600052a0 con 0x5641957784d0 2024-08-31T05:30:20.839 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.833+0000 7ffb7b88b740 1 -- 172.21.15.5:0/3349375627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641957784d0 msgr2=0x564195b41bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:20.839 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.833+0000 7ffb7b88b740 1 --2- 172.21.15.5:0/3349375627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641957784d0 0x564195b41bf0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7ffb60011eb0 tx=0x7ffb600119b0 comp rx=0 tx=0).stop 2024-08-31T05:30:20.839 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.833+0000 7ffb7b88b740 1 -- 172.21.15.5:0/3349375627 shutdown_connections 2024-08-31T05:30:20.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.833+0000 7ffb7b88b740 1 --2- 172.21.15.5:0/3349375627 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641957991b0 0x564195b42130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:20.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.833+0000 7ffb7b88b740 1 --2- 172.21.15.5:0/3349375627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641957784d0 0x564195b41bf0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:20.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.833+0000 7ffb7b88b740 1 --2- 172.21.15.5:0/3349375627 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641957702f0 0x564195b54460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:20.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.833+0000 7ffb7b88b740 1 -- 172.21.15.5:0/3349375627 >> 172.21.15.5:0/3349375627 conn(0x56419578d300 msgr2=0x564195b46cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:20.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.833+0000 7ffb7b88b740 1 -- 172.21.15.5:0/3349375627 shutdown_connections 2024-08-31T05:30:20.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.833+0000 7ffb7b88b740 1 -- 172.21.15.5:0/3349375627 wait complete. 2024-08-31T05:30:20.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.833+0000 7ffb7b88b740 1 -- start start 2024-08-31T05:30:20.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.833+0000 7ffb7b88b740 1 Processor -- start 2024-08-31T05:30:20.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.834+0000 7ffb7b88b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641957702f0 0x564195b4ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:20.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.834+0000 7ffb7b88b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641957784d0 0x564195b4d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:20.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.834+0000 7ffb7b88b740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641957991b0 0x564195bc3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:20.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.834+0000 7ffb7b88b740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ffb701b2070 con 0x5641957991b0 2024-08-31T05:30:20.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.834+0000 7ffb7b88b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ffb701b19a0 con 0x5641957784d0 2024-08-31T05:30:20.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.834+0000 7ffb7b88b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ffb701aebe0 con 0x5641957702f0 2024-08-31T05:30:20.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.834+0000 7ffb7b88b740 10 client.0 _ll_register_callbacks cb 0x7ffb6001c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:30:20.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.834+0000 7ffb6dd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641957991b0 0x564195bc3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:20.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.834+0000 7ffb6dd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641957991b0 0x564195bc3ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54306/0 (socket says 172.21.15.5:54306) 2024-08-31T05:30:20.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.834+0000 7ffb6dd9b640 1 -- 172.21.15.5:0/601973571 learned_addr learned my addr 172.21.15.5:0/601973571 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:20.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.834+0000 7ffb6dd9b640 1 --2- 172.21.15.5:0/601973571 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641957702f0 0x564195b4ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:20.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.834+0000 7ffb6e59c640 1 --2- 172.21.15.5:0/601973571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641957784d0 0x564195b4d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:20.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.834+0000 7ffb6dd9b640 1 -- 172.21.15.5:0/601973571 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641957702f0 msgr2=0x564195b4ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:20.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.834+0000 7ffb6dd9b640 1 --2- 172.21.15.5:0/601973571 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641957702f0 0x564195b4ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:20.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.834+0000 7ffb6dd9b640 1 -- 172.21.15.5:0/601973571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641957784d0 msgr2=0x564195b4d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:20.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.834+0000 7ffb6dd9b640 1 --2- 172.21.15.5:0/601973571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641957784d0 0x564195b4d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:20.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.834+0000 7ffb6dd9b640 1 -- 172.21.15.5:0/601973571 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564195bc4510 con 0x5641957991b0 2024-08-31T05:30:20.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.834+0000 7ffb6dd9b640 1 --2- 172.21.15.5:0/601973571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641957991b0 0x564195bc3ed0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7ffb6400a010 tx=0x7ffb64012040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee15050f13ade9af server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:20.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.834+0000 7ffb55ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:30:20.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.835+0000 7ffb55ffb640 1 -- 172.21.15.5:0/601973571 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb64005020 con 0x5641957991b0 2024-08-31T05:30:20.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.835+0000 7ffb55ffb640 1 -- 172.21.15.5:0/601973571 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7ffb640051c0 con 0x5641957991b0 2024-08-31T05:30:20.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.835+0000 7ffb7b88b740 1 -- 172.21.15.5:0/601973571 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb60029070 con 0x5641957991b0 2024-08-31T05:30:20.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.835+0000 7ffb55ffb640 1 -- 172.21.15.5:0/601973571 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ffb640053c0 con 0x5641957991b0 2024-08-31T05:30:20.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.835+0000 7ffb7b88b740 10 client.15684 fetch_fsmap learned FSMap version 30 2024-08-31T05:30:20.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.835+0000 7ffb7b88b740 1 -- 172.21.15.5:0/601973571 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564195bc56f0 con 0x5641957991b0 2024-08-31T05:30:20.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.835+0000 7ffb55ffb640 1 -- 172.21.15.5:0/601973571 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb60029070 con 0x5641957991b0 2024-08-31T05:30:20.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.835+0000 7ffb55ffb640 1 -- 172.21.15.5:0/601973571 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7ffb640214e0 con 0x5641957991b0 2024-08-31T05:30:20.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.835+0000 7ffb7b88b740 10 client.15684 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T05:30:20.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.835+0000 7ffb7b88b740 10 client.15684 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:30:20.843 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.835+0000 7ffb7b88b740 20 client.15684 populate_metadata read hostname 'smithi005' 2024-08-31T05:30:20.843 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.835+0000 7ffb7b88b740 1 --2- 172.21.15.5:0/601973571 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56419572d1c0 0x564195bc7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:20.843 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.835+0000 7ffb7b88b740 4 client.15684 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:30:20.843 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.835+0000 7ffb7b88b740 1 -- 172.21.15.5:0/601973571 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564195aaf9f0 con 0x56419572d1c0 2024-08-31T05:30:20.843 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.836+0000 7ffb6e59c640 1 --2- 172.21.15.5:0/601973571 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56419572d1c0 0x564195bc7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:20.843 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.836+0000 7ffb55ffb640 10 client.15684 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:30:20.843 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.836+0000 7ffb6e59c640 1 --2- 172.21.15.5:0/601973571 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56419572d1c0 0x564195bc7eb0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1555382cc69a47e server_cookie=b93bad1e14d92fdd in_seq=0 out_seq=0 2024-08-31T05:30:20.854 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.852+0000 7ffb55ffb640 1 -- 172.21.15.5:0/601973571 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564195aaf9f0 con 0x56419572d1c0 2024-08-31T05:30:20.854 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.852+0000 7ffb55ffb640 10 client.15684 handle_command_reply: tid=0 2024-08-31T05:30:20.854 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.852+0000 7ffb7b88b740 1 client.15684 shutdown 2024-08-31T05:30:20.854 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.852+0000 7ffb7b88b740 1 -- 172.21.15.5:0/601973571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641957991b0 msgr2=0x564195bc3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:20.854 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.852+0000 7ffb7b88b740 1 --2- 172.21.15.5:0/601973571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641957991b0 0x564195bc3ed0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7ffb6400a010 tx=0x7ffb64012040 comp rx=0 tx=0).stop 2024-08-31T05:30:20.854 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.852+0000 7ffb7b88b740 1 -- 172.21.15.5:0/601973571 shutdown_connections 2024-08-31T05:30:20.855 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.852+0000 7ffb7b88b740 1 --2- 172.21.15.5:0/601973571 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56419572d1c0 0x564195bc7eb0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:20.855 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.852+0000 7ffb7b88b740 1 --2- 172.21.15.5:0/601973571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641957991b0 0x564195bc3ed0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:20.855 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.852+0000 7ffb55ffb640 0 client.15684 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:30:20.855 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.852+0000 7ffb7b88b740 1 --2- 172.21.15.5:0/601973571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641957784d0 0x564195b4d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:20.855 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.852+0000 7ffb7b88b740 1 --2- 172.21.15.5:0/601973571 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641957702f0 0x564195b4ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:20.855 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.852+0000 7ffb7b88b740 1 -- 172.21.15.5:0/601973571 >> 172.21.15.5:0/601973571 conn(0x56419578d300 msgr2=0x564195b46c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:20.855 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.852+0000 7ffb7b88b740 1 -- 172.21.15.5:0/601973571 shutdown_connections 2024-08-31T05:30:20.855 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.852+0000 7ffb7b88b740 1 -- 172.21.15.5:0/601973571 wait complete. 2024-08-31T05:30:20.855 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.852+0000 7ffb7b88b740 20 client.15684 trim_cache size 0 max 16384 2024-08-31T05:30:20.855 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:30:20.855 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:30:20.856 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:30:20.856 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:30:20.856 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.853+0000 7ffb74847640 1 -- 172.21.15.5:0/4146435708 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ffb580b4d20 msgr2=0x7ffb580b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:20.856 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.853+0000 7ffb74847640 1 --2- 172.21.15.5:0/4146435708 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ffb580b4d20 0x7ffb580b7230 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ffb68103ea0 tx=0x7ffb680047b0 comp rx=0 tx=0).stop 2024-08-31T05:30:20.856 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.853+0000 7ffb74847640 1 -- 172.21.15.5:0/4146435708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb70108a10 msgr2=0x7ffb7019ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:20.856 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.853+0000 7ffb74847640 1 --2- 172.21.15.5:0/4146435708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb70108a10 0x7ffb7019ba30 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7ffb68005cc0 tx=0x7ffb68031700 comp rx=0 tx=0).stop 2024-08-31T05:30:20.857 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.853+0000 7ffb74847640 1 -- 172.21.15.5:0/4146435708 shutdown_connections 2024-08-31T05:30:20.857 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.853+0000 7ffb74847640 1 --2- 172.21.15.5:0/4146435708 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ffb580b4d20 0x7ffb580b7230 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:20.857 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.853+0000 7ffb74847640 1 --2- 172.21.15.5:0/4146435708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb70108a10 0x7ffb7019ba30 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:20.857 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.853+0000 7ffb74847640 1 --2- 172.21.15.5:0/4146435708 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffb701080c0 0x7ffb7019b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:20.857 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.853+0000 7ffb74847640 1 --2- 172.21.15.5:0/4146435708 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb70102790 0x7ffb7019afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:20.857 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.853+0000 7ffb74847640 1 -- 172.21.15.5:0/4146435708 >> 172.21.15.5:0/4146435708 conn(0x7ffb700fe190 msgr2=0x7ffb70107690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:20.857 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.853+0000 7ffb74847640 1 -- 172.21.15.5:0/4146435708 shutdown_connections 2024-08-31T05:30:20.857 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:20.853+0000 7ffb74847640 1 -- 172.21.15.5:0/4146435708 wait complete. 2024-08-31T05:30:20.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:20 smithi050 ceph-mon[22146]: pgmap v356: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 175 KiB/s wr, 59 op/s 2024-08-31T05:30:20.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:20 smithi005 ceph-mon[18602]: pgmap v356: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 175 KiB/s wr, 59 op/s 2024-08-31T05:30:21.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:20 smithi070 ceph-mon[22316]: pgmap v356: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 175 KiB/s wr, 59 op/s 2024-08-31T05:30:22.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:22 smithi050 ceph-mon[22146]: pgmap v357: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 511 B/s wr, 10 op/s 2024-08-31T05:30:22.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:22 smithi005 ceph-mon[18602]: pgmap v357: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 511 B/s wr, 10 op/s 2024-08-31T05:30:23.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:22 smithi070 ceph-mon[22316]: pgmap v357: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 511 B/s wr, 10 op/s 2024-08-31T05:30:24.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:24 smithi050 ceph-mon[22146]: pgmap v358: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.6 KiB/s wr, 14 op/s 2024-08-31T05:30:24.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:24 smithi005 ceph-mon[18602]: pgmap v358: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.6 KiB/s wr, 14 op/s 2024-08-31T05:30:25.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:24 smithi070 ceph-mon[22316]: pgmap v358: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.6 KiB/s wr, 14 op/s 2024-08-31T05:30:26.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:26 smithi050 ceph-mon[22146]: pgmap v359: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.0 KiB/s wr, 15 op/s 2024-08-31T05:30:26.966 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:26 smithi005 ceph-mon[18602]: pgmap v359: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.0 KiB/s wr, 15 op/s 2024-08-31T05:30:27.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:26 smithi070 ceph-mon[22316]: pgmap v359: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.0 KiB/s wr, 15 op/s 2024-08-31T05:30:28.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:28 smithi050 ceph-mon[22146]: pgmap v360: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.0 KiB/s wr, 13 op/s 2024-08-31T05:30:28.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:28 smithi005 ceph-mon[18602]: pgmap v360: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.0 KiB/s wr, 13 op/s 2024-08-31T05:30:29.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:28 smithi070 ceph-mon[22316]: pgmap v360: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.0 KiB/s wr, 13 op/s 2024-08-31T05:30:30.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:30 smithi050 ceph-mon[22146]: pgmap v361: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.0 KiB/s wr, 16 op/s 2024-08-31T05:30:30.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:30 smithi005 ceph-mon[18602]: pgmap v361: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.0 KiB/s wr, 16 op/s 2024-08-31T05:30:31.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:30 smithi070 ceph-mon[22316]: pgmap v361: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.0 KiB/s wr, 16 op/s 2024-08-31T05:30:32.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:32 smithi050 ceph-mon[22146]: pgmap v362: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.0 KiB/s wr, 13 op/s 2024-08-31T05:30:32.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:32 smithi005 ceph-mon[18602]: pgmap v362: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.0 KiB/s wr, 13 op/s 2024-08-31T05:30:33.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:32 smithi070 ceph-mon[22316]: pgmap v362: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.0 KiB/s wr, 13 op/s 2024-08-31T05:30:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.963+0000 7fc79045a640 1 -- 172.21.15.5:0/1908055961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc788103870 msgr2=0x7fc788103c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.963+0000 7fc79045a640 1 --2- 172.21.15.5:0/1908055961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc788103870 0x7fc788103c80 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fc784009900 tx=0x7fc78402a410 comp rx=0 tx=0).stop 2024-08-31T05:30:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.963+0000 7fc79045a640 1 -- 172.21.15.5:0/1908055961 shutdown_connections 2024-08-31T05:30:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.963+0000 7fc79045a640 1 --2- 172.21.15.5:0/1908055961 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc788109af0 0x7fc788110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.963+0000 7fc79045a640 1 --2- 172.21.15.5:0/1908055961 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7881091a0 0x7fc7881095b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.963+0000 7fc79045a640 1 --2- 172.21.15.5:0/1908055961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc788103870 0x7fc788103c80 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.963+0000 7fc79045a640 1 -- 172.21.15.5:0/1908055961 >> 172.21.15.5:0/1908055961 conn(0x7fc7880ff270 msgr2=0x7fc7881016c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.963+0000 7fc79045a640 1 -- 172.21.15.5:0/1908055961 shutdown_connections 2024-08-31T05:30:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.963+0000 7fc79045a640 1 -- 172.21.15.5:0/1908055961 wait complete. 2024-08-31T05:30:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.964+0000 7fc79045a640 1 Processor -- start 2024-08-31T05:30:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.964+0000 7fc79045a640 1 -- start start 2024-08-31T05:30:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.964+0000 7fc79045a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc788103870 0x7fc78819a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:33.969 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.964+0000 7fc79045a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7881091a0 0x7fc78819a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:33.969 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.964+0000 7fc79045a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc788109af0 0x7fc78819fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:33.969 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.964+0000 7fc79045a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc7881137c0 con 0x7fc788109af0 2024-08-31T05:30:33.969 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.964+0000 7fc79045a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc788113640 con 0x7fc7881091a0 2024-08-31T05:30:33.969 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.964+0000 7fc79045a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc788113940 con 0x7fc788103870 2024-08-31T05:30:33.969 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.964+0000 7fc78e9f7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc788109af0 0x7fc78819fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:33.969 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.964+0000 7fc78e9f7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc788109af0 0x7fc78819fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34142/0 (socket says 172.21.15.5:34142) 2024-08-31T05:30:33.969 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.964+0000 7fc78e9f7640 1 -- 172.21.15.5:0/1859506550 learned_addr learned my addr 172.21.15.5:0/1859506550 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:33.969 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.964+0000 7fc78e1f6640 1 --2- 172.21.15.5:0/1859506550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc788103870 0x7fc78819a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:33.969 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.965+0000 7fc78d9f5640 1 --2- 172.21.15.5:0/1859506550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7881091a0 0x7fc78819a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:33.969 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.965+0000 7fc78e9f7640 1 -- 172.21.15.5:0/1859506550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc788103870 msgr2=0x7fc78819a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:33.969 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.965+0000 7fc78e9f7640 1 --2- 172.21.15.5:0/1859506550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc788103870 0x7fc78819a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:33.970 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.965+0000 7fc78e9f7640 1 -- 172.21.15.5:0/1859506550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7881091a0 msgr2=0x7fc78819a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:33.970 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.965+0000 7fc78e9f7640 1 --2- 172.21.15.5:0/1859506550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7881091a0 0x7fc78819a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:33.970 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.965+0000 7fc78e9f7640 1 -- 172.21.15.5:0/1859506550 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7881a0170 con 0x7fc788109af0 2024-08-31T05:30:33.970 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.965+0000 7fc78e9f7640 1 --2- 172.21.15.5:0/1859506550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc788109af0 0x7fc78819fa70 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fc780009fd0 tx=0x7fc78000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:33.970 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.965+0000 7fc77f7fe640 1 -- 172.21.15.5:0/1859506550 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc780017070 con 0x7fc788109af0 2024-08-31T05:30:33.970 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.965+0000 7fc79045a640 1 -- 172.21.15.5:0/1859506550 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7881a0460 con 0x7fc788109af0 2024-08-31T05:30:33.970 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.965+0000 7fc79045a640 1 -- 172.21.15.5:0/1859506550 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7881a6bf0 con 0x7fc788109af0 2024-08-31T05:30:33.970 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.965+0000 7fc77f7fe640 1 -- 172.21.15.5:0/1859506550 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc780003e20 con 0x7fc788109af0 2024-08-31T05:30:33.970 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.965+0000 7fc77f7fe640 1 -- 172.21.15.5:0/1859506550 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc780010460 con 0x7fc788109af0 2024-08-31T05:30:33.971 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.968+0000 7fc7973c9740 1 Processor -- start 2024-08-31T05:30:33.971 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.969+0000 7fc77f7fe640 1 -- 172.21.15.5:0/1859506550 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) ==== 152701+0+0 (secure 0 0 0) 0x7fc780010720 con 0x7fc788109af0 2024-08-31T05:30:33.973 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.970+0000 7fc7973c9740 1 -- start start 2024-08-31T05:30:33.973 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.970+0000 7fc7973c9740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560cffdcc1b0 0x560d0016fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:33.973 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.970+0000 7fc7973c9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560cffda32f0 0x560d00170000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:33.973 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.970+0000 7fc7973c9740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560cffdab4d0 0x560d00170540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:33.973 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.970+0000 7fc7973c9740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x560d000e5000 con 0x560cffdab4d0 2024-08-31T05:30:33.974 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.970+0000 7fc7973c9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560d000d4590 con 0x560cffda32f0 2024-08-31T05:30:33.974 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.970+0000 7fc7973c9740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560d000d8540 con 0x560cffdcc1b0 2024-08-31T05:30:33.974 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.970+0000 7fc78d9f5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560cffdab4d0 0x560d00170540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:33.974 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.970+0000 7fc78d9f5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560cffdab4d0 0x560d00170540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34152/0 (socket says 172.21.15.5:34152) 2024-08-31T05:30:33.974 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.970+0000 7fc78d9f5640 1 -- 172.21.15.5:0/1007432867 learned_addr learned my addr 172.21.15.5:0/1007432867 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:33.974 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.970+0000 7fc78d9f5640 1 --2- 172.21.15.5:0/1007432867 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560cffdcc1b0 0x560d0016fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:33.974 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.970+0000 7fc78e1f6640 1 --2- 172.21.15.5:0/1007432867 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560cffda32f0 0x560d00170000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:33.974 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.970+0000 7fc77f7fe640 1 --2- 172.21.15.5:0/1859506550 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc7740b4d20 0x7fc7740b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:33.974 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.971+0000 7fc78d9f5640 1 -- 172.21.15.5:0/1007432867 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560cffdcc1b0 msgr2=0x560d0016fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:33.974 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.971+0000 7fc78d9f5640 1 --2- 172.21.15.5:0/1007432867 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560cffdcc1b0 0x560d0016fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:33.974 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.971+0000 7fc78d9f5640 1 -- 172.21.15.5:0/1007432867 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560cffda32f0 msgr2=0x560d00170000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:33.974 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.971+0000 7fc78d9f5640 1 --2- 172.21.15.5:0/1007432867 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560cffda32f0 0x560d00170000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:33.974 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.971+0000 7fc78d9f5640 1 -- 172.21.15.5:0/1007432867 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cffe37790 con 0x560cffdab4d0 2024-08-31T05:30:33.975 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.971+0000 7fc78e9f7640 1 --2- 172.21.15.5:0/1859506550 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc7740b4d20 0x7fc7740b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:33.975 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.971+0000 7fc77f7fe640 1 -- 172.21.15.5:0/1859506550 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fc7800e5450 con 0x7fc788109af0 2024-08-31T05:30:33.975 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.971+0000 7fc78d9f5640 1 --2- 172.21.15.5:0/1007432867 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560cffdab4d0 0x560d00170540 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fc7780116b0 tx=0x7fc77800a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8f063b378857ddf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:33.975 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.971+0000 7fc77cbfe640 1 -- 172.21.15.5:0/1007432867 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc778004020 con 0x560cffdab4d0 2024-08-31T05:30:33.975 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.971+0000 7fc77cbfe640 1 -- 172.21.15.5:0/1007432867 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7780054d0 con 0x560cffdab4d0 2024-08-31T05:30:33.975 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.971+0000 7fc77cbfe640 1 -- 172.21.15.5:0/1007432867 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc778004bf0 con 0x560cffdab4d0 2024-08-31T05:30:33.979 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.972+0000 7fc7973c9740 1 -- 172.21.15.5:0/1007432867 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560cffdab4d0 msgr2=0x560d00170540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:33.979 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.972+0000 7fc7973c9740 1 --2- 172.21.15.5:0/1007432867 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560cffdab4d0 0x560d00170540 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fc7780116b0 tx=0x7fc77800a640 comp rx=0 tx=0).stop 2024-08-31T05:30:33.979 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.972+0000 7fc78e9f7640 1 --2- 172.21.15.5:0/1859506550 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc7740b4d20 0x7fc7740b7230 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc7800e2970 tx=0x7fc78000bf10 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:33.979 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.972+0000 7fc7973c9740 1 -- 172.21.15.5:0/1007432867 shutdown_connections 2024-08-31T05:30:33.979 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.972+0000 7fc7973c9740 1 --2- 172.21.15.5:0/1007432867 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560cffdab4d0 0x560d00170540 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:33.980 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.972+0000 7fc7973c9740 1 --2- 172.21.15.5:0/1007432867 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560cffda32f0 0x560d00170000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:33.980 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.972+0000 7fc7973c9740 1 --2- 172.21.15.5:0/1007432867 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560cffdcc1b0 0x560d0016fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:33.980 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.972+0000 7fc7973c9740 1 -- 172.21.15.5:0/1007432867 >> 172.21.15.5:0/1007432867 conn(0x560cffdc0300 msgr2=0x560d0016d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:33.980 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.972+0000 7fc7973c9740 1 -- 172.21.15.5:0/1007432867 shutdown_connections 2024-08-31T05:30:33.980 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.972+0000 7fc7973c9740 1 -- 172.21.15.5:0/1007432867 wait complete. 2024-08-31T05:30:33.980 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.972+0000 7fc7973c9740 1 -- start start 2024-08-31T05:30:33.980 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.973+0000 7fc7973c9740 1 Processor -- start 2024-08-31T05:30:33.980 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.973+0000 7fc7973c9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560cffda32f0 0x560d0017b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:33.980 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.973+0000 7fc7973c9740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560cffdab4d0 0x560d0017bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:33.980 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.973+0000 7fc7973c9740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560cffdcc1b0 0x560d00187590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:33.980 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.973+0000 7fc7973c9740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x560d0000dab0 con 0x560cffdab4d0 2024-08-31T05:30:33.980 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.973+0000 7fc7973c9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560d0005b680 con 0x560cffda32f0 2024-08-31T05:30:33.980 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.973+0000 7fc7973c9740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560d0017e240 con 0x560cffdcc1b0 2024-08-31T05:30:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.973+0000 7fc7973c9740 10 client.0 _ll_register_callbacks cb 0x560cffde3a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:30:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.973+0000 7fc78e1f6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560cffdab4d0 0x560d0017bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.973+0000 7fc78e1f6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560cffdab4d0 0x560d0017bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34162/0 (socket says 172.21.15.5:34162) 2024-08-31T05:30:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.973+0000 7fc78e1f6640 1 -- 172.21.15.5:0/3849547172 learned_addr learned my addr 172.21.15.5:0/3849547172 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.973+0000 7fc78d9f5640 1 --2- 172.21.15.5:0/3849547172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560cffda32f0 0x560d0017b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.973+0000 7fc78d9f5640 1 --2- 172.21.15.5:0/3849547172 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560cffdcc1b0 0x560d00187590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.973+0000 7fc78e1f6640 1 -- 172.21.15.5:0/3849547172 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560cffdcc1b0 msgr2=0x560d00187590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.973+0000 7fc78e1f6640 1 --2- 172.21.15.5:0/3849547172 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560cffdcc1b0 0x560d00187590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.973+0000 7fc78e1f6640 1 -- 172.21.15.5:0/3849547172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560cffda32f0 msgr2=0x560d0017b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.973+0000 7fc78e1f6640 1 --2- 172.21.15.5:0/3849547172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560cffda32f0 0x560d0017b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.973+0000 7fc78e1f6640 1 -- 172.21.15.5:0/3849547172 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560cffeb0620 con 0x560cffdab4d0 2024-08-31T05:30:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.974+0000 7fc78e1f6640 1 --2- 172.21.15.5:0/3849547172 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560cffdab4d0 0x560d0017bbd0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fc784009900 tx=0x7fc7840316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c043de664e78894 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.974+0000 7fc771ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:30:33.982 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.974+0000 7fc771ffb640 1 -- 172.21.15.5:0/3849547172 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc784035040 con 0x560cffdab4d0 2024-08-31T05:30:33.982 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.974+0000 7fc771ffb640 1 -- 172.21.15.5:0/3849547172 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fc784004040 con 0x560cffdab4d0 2024-08-31T05:30:33.982 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.974+0000 7fc7973c9740 1 -- 172.21.15.5:0/3849547172 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7780054d0 con 0x560cffdab4d0 2024-08-31T05:30:33.982 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.974+0000 7fc771ffb640 1 -- 172.21.15.5:0/3849547172 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc78404f050 con 0x560cffdab4d0 2024-08-31T05:30:33.982 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.974+0000 7fc7973c9740 10 client.15696 fetch_fsmap learned FSMap version 30 2024-08-31T05:30:33.982 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.974+0000 7fc7973c9740 1 -- 172.21.15.5:0/3849547172 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x560d0018a2e0 con 0x560cffdab4d0 2024-08-31T05:30:33.982 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.974+0000 7fc771ffb640 1 -- 172.21.15.5:0/3849547172 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7780054d0 con 0x560cffdab4d0 2024-08-31T05:30:33.982 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.974+0000 7fc771ffb640 1 -- 172.21.15.5:0/3849547172 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7fc784004950 con 0x560cffdab4d0 2024-08-31T05:30:33.982 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.974+0000 7fc7973c9740 10 client.15696 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T05:30:33.982 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.974+0000 7fc7973c9740 10 client.15696 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:30:33.982 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.974+0000 7fc7973c9740 20 client.15696 populate_metadata read hostname 'smithi005' 2024-08-31T05:30:33.982 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.974+0000 7fc7973c9740 1 --2- 172.21.15.5:0/3849547172 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x560cffd8ad80 0x560d0018d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:33.982 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.974+0000 7fc7973c9740 4 client.15696 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:30:33.982 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.974+0000 7fc7973c9740 1 -- 172.21.15.5:0/3849547172 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d000e6f50 con 0x560cffd8ad80 2024-08-31T05:30:33.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.975+0000 7fc78d9f5640 1 --2- 172.21.15.5:0/3849547172 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x560cffd8ad80 0x560d0018d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:33.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.975+0000 7fc771ffb640 10 client.15696 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:30:33.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.975+0000 7fc78d9f5640 1 --2- 172.21.15.5:0/3849547172 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x560cffd8ad80 0x560d0018d880 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac1d566fc3b8c877 server_cookie=6b2d291d17196f90 in_seq=0 out_seq=0 2024-08-31T05:30:33.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.976+0000 7fc771ffb640 1 -- 172.21.15.5:0/3849547172 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560d000e6f50 con 0x560cffd8ad80 2024-08-31T05:30:33.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.976+0000 7fc771ffb640 10 client.15696 handle_command_reply: tid=0 2024-08-31T05:30:33.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.976+0000 7fc7973c9740 1 client.15696 shutdown 2024-08-31T05:30:33.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.976+0000 7fc7973c9740 1 -- 172.21.15.5:0/3849547172 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560cffdab4d0 msgr2=0x560d0017bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:33.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.976+0000 7fc7973c9740 1 --2- 172.21.15.5:0/3849547172 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560cffdab4d0 0x560d0017bbd0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fc784009900 tx=0x7fc7840316d0 comp rx=0 tx=0).stop 2024-08-31T05:30:33.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.976+0000 7fc7973c9740 1 -- 172.21.15.5:0/3849547172 shutdown_connections 2024-08-31T05:30:33.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.976+0000 7fc7973c9740 1 --2- 172.21.15.5:0/3849547172 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x560cffd8ad80 0x560d0018d880 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:33.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.976+0000 7fc7973c9740 1 --2- 172.21.15.5:0/3849547172 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560cffdcc1b0 0x560d00187590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:33.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.976+0000 7fc7973c9740 1 --2- 172.21.15.5:0/3849547172 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560cffdab4d0 0x560d0017bbd0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:33.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.976+0000 7fc771ffb640 0 client.15696 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:30:33.984 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.976+0000 7fc7973c9740 1 --2- 172.21.15.5:0/3849547172 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560cffda32f0 0x560d0017b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:33.984 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.976+0000 7fc7973c9740 1 -- 172.21.15.5:0/3849547172 >> 172.21.15.5:0/3849547172 conn(0x560cffdc0300 msgr2=0x560d00170af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:33.984 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.976+0000 7fc7973c9740 1 -- 172.21.15.5:0/3849547172 shutdown_connections 2024-08-31T05:30:33.984 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.976+0000 7fc7973c9740 1 -- 172.21.15.5:0/3849547172 wait complete. 2024-08-31T05:30:33.984 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.977+0000 7fc7973c9740 20 client.15696 trim_cache size 0 max 16384 2024-08-31T05:30:33.994 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.991+0000 7fc7973c9740 1 Processor -- start 2024-08-31T05:30:33.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.991+0000 7fc7973c9740 1 -- start start 2024-08-31T05:30:33.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.992+0000 7fc7973c9740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560cffd8ad80 0x560d00179ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:33.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.992+0000 7fc7973c9740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560cffda32f0 0x560d0017a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:33.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.992+0000 7fc7973c9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560cffdab4d0 0x560d0017a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:33.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.992+0000 7fc7973c9740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc7881b0b30 con 0x560cffd8ad80 2024-08-31T05:30:33.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.992+0000 7fc7973c9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc7881b2670 con 0x560cffdab4d0 2024-08-31T05:30:33.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.992+0000 7fc7973c9740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc7881b1200 con 0x560cffda32f0 2024-08-31T05:30:33.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.992+0000 7fc78d9f5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560cffd8ad80 0x560d00179ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:33.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.992+0000 7fc78d9f5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560cffd8ad80 0x560d00179ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34166/0 (socket says 172.21.15.5:34166) 2024-08-31T05:30:33.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.992+0000 7fc78d9f5640 1 -- 172.21.15.5:0/390021058 learned_addr learned my addr 172.21.15.5:0/390021058 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:33.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.992+0000 7fc78e1f6640 1 --2- 172.21.15.5:0/390021058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560cffda32f0 0x560d0017a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:33.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.992+0000 7fc78d9f5640 1 -- 172.21.15.5:0/390021058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560cffda32f0 msgr2=0x560d0017a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:33.995 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.992+0000 7fc78d9f5640 1 --2- 172.21.15.5:0/390021058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560cffda32f0 0x560d0017a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:33.996 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.992+0000 7fc78d9f5640 1 -- 172.21.15.5:0/390021058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560cffdab4d0 msgr2=0x560d0017a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:33.996 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.992+0000 7fc78d9f5640 1 --2- 172.21.15.5:0/390021058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560cffdab4d0 0x560d0017a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:33.996 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.992+0000 7fc78d9f5640 1 -- 172.21.15.5:0/390021058 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d0017c740 con 0x560cffd8ad80 2024-08-31T05:30:33.996 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.992+0000 7fc78d9f5640 1 --2- 172.21.15.5:0/390021058 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560cffd8ad80 0x560d00179ce0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fc7780116b0 tx=0x7fc77801a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e44f06146ef7fbc0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:33.996 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.993+0000 7fc773fff640 1 -- 172.21.15.5:0/390021058 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc778004020 con 0x560cffd8ad80 2024-08-31T05:30:33.996 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.993+0000 7fc773fff640 1 -- 172.21.15.5:0/390021058 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7780041c0 con 0x560cffd8ad80 2024-08-31T05:30:33.996 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.993+0000 7fc773fff640 1 -- 172.21.15.5:0/390021058 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc77800f600 con 0x560cffd8ad80 2024-08-31T05:30:33.999 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.993+0000 7fc7973c9740 1 -- 172.21.15.5:0/390021058 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560cffd8ad80 msgr2=0x560d00179ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:33.999 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.993+0000 7fc7973c9740 1 --2- 172.21.15.5:0/390021058 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560cffd8ad80 0x560d00179ce0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fc7780116b0 tx=0x7fc77801a040 comp rx=0 tx=0).stop 2024-08-31T05:30:33.999 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.993+0000 7fc7973c9740 1 -- 172.21.15.5:0/390021058 shutdown_connections 2024-08-31T05:30:34.000 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.993+0000 7fc7973c9740 1 --2- 172.21.15.5:0/390021058 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560cffdab4d0 0x560d0017a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:34.000 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.993+0000 7fc7973c9740 1 --2- 172.21.15.5:0/390021058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560cffda32f0 0x560d0017a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:34.000 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.993+0000 7fc7973c9740 1 --2- 172.21.15.5:0/390021058 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560cffd8ad80 0x560d00179ce0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:34.000 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.993+0000 7fc7973c9740 1 -- 172.21.15.5:0/390021058 >> 172.21.15.5:0/390021058 conn(0x560cffdc0300 msgr2=0x560d0017b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:34.000 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.994+0000 7fc7973c9740 1 -- 172.21.15.5:0/390021058 shutdown_connections 2024-08-31T05:30:34.000 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.994+0000 7fc7973c9740 1 -- 172.21.15.5:0/390021058 wait complete. 2024-08-31T05:30:34.000 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.994+0000 7fc7973c9740 1 -- start start 2024-08-31T05:30:34.000 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.994+0000 7fc7973c9740 1 Processor -- start 2024-08-31T05:30:34.000 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.994+0000 7fc7973c9740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560cffd8ad80 0x560d0017f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:34.000 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.994+0000 7fc7973c9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560cffda32f0 0x560d0017fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:34.000 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.994+0000 7fc7973c9740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560cffdab4d0 0x560d00180130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:34.001 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.994+0000 7fc7973c9740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc7881b1fa0 con 0x560cffdab4d0 2024-08-31T05:30:34.001 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.994+0000 7fc7973c9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc7881b18d0 con 0x560cffda32f0 2024-08-31T05:30:34.001 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.994+0000 7fc7973c9740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc7881aeb10 con 0x560cffd8ad80 2024-08-31T05:30:34.001 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.994+0000 7fc7973c9740 10 client.0 _ll_register_callbacks cb 0x7fc784005e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:30:34.001 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.995+0000 7fc78d9f5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560cffdab4d0 0x560d00180130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:34.001 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.995+0000 7fc78d9f5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560cffdab4d0 0x560d00180130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34182/0 (socket says 172.21.15.5:34182) 2024-08-31T05:30:34.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.995+0000 7fc78d9f5640 1 -- 172.21.15.5:0/3515182753 learned_addr learned my addr 172.21.15.5:0/3515182753 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:34.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.995+0000 7fc78d9f5640 1 --2- 172.21.15.5:0/3515182753 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560cffd8ad80 0x560d0017f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:34.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.995+0000 7fc78e1f6640 1 --2- 172.21.15.5:0/3515182753 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560cffda32f0 0x560d0017fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:34.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.995+0000 7fc78d9f5640 1 -- 172.21.15.5:0/3515182753 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560cffd8ad80 msgr2=0x560d0017f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:34.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.995+0000 7fc78d9f5640 1 --2- 172.21.15.5:0/3515182753 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560cffd8ad80 0x560d0017f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:34.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.995+0000 7fc78d9f5640 1 -- 172.21.15.5:0/3515182753 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560cffda32f0 msgr2=0x560d0017fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:34.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.995+0000 7fc78d9f5640 1 --2- 172.21.15.5:0/3515182753 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560cffda32f0 0x560d0017fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:34.003 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.995+0000 7fc78d9f5640 1 -- 172.21.15.5:0/3515182753 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d001f7480 con 0x560cffdab4d0 2024-08-31T05:30:34.003 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.995+0000 7fc78d9f5640 1 --2- 172.21.15.5:0/3515182753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560cffdab4d0 0x560d00180130 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fc778003fd0 tx=0x7fc778003cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2ce9dbf4a7610fe server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:34.003 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.995+0000 7fc771ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:30:34.003 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.995+0000 7fc771ffb640 1 -- 172.21.15.5:0/3515182753 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc778004370 con 0x560cffdab4d0 2024-08-31T05:30:34.003 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.995+0000 7fc771ffb640 1 -- 172.21.15.5:0/3515182753 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fc7780035f0 con 0x560cffdab4d0 2024-08-31T05:30:34.003 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.995+0000 7fc7973c9740 1 -- 172.21.15.5:0/3515182753 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7780041c0 con 0x560cffdab4d0 2024-08-31T05:30:34.003 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.995+0000 7fc771ffb640 1 -- 172.21.15.5:0/3515182753 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc7780037f0 con 0x560cffdab4d0 2024-08-31T05:30:34.003 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.995+0000 7fc7973c9740 10 client.15702 fetch_fsmap learned FSMap version 30 2024-08-31T05:30:34.003 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.995+0000 7fc7973c9740 1 -- 172.21.15.5:0/3515182753 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x560d001f8710 con 0x560cffdab4d0 2024-08-31T05:30:34.003 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.996+0000 7fc771ffb640 1 -- 172.21.15.5:0/3515182753 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7780041c0 con 0x560cffdab4d0 2024-08-31T05:30:34.003 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.996+0000 7fc771ffb640 1 -- 172.21.15.5:0/3515182753 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7fc77801e500 con 0x560cffdab4d0 2024-08-31T05:30:34.003 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.996+0000 7fc7973c9740 10 client.15702 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T05:30:34.003 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.996+0000 7fc7973c9740 10 client.15702 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:30:34.004 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.996+0000 7fc7973c9740 20 client.15702 populate_metadata read hostname 'smithi005' 2024-08-31T05:30:34.004 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.996+0000 7fc7973c9740 1 --2- 172.21.15.5:0/3515182753 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x560cffdcc1b0 0x560d001fabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:34.004 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.996+0000 7fc7973c9740 4 client.15702 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:30:34.004 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.996+0000 7fc7973c9740 1 -- 172.21.15.5:0/3515182753 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560d000e29f0 con 0x560cffdcc1b0 2024-08-31T05:30:34.004 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.996+0000 7fc78e1f6640 1 --2- 172.21.15.5:0/3515182753 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x560cffdcc1b0 0x560d001fabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:34.004 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.997+0000 7fc78e1f6640 1 --2- 172.21.15.5:0/3515182753 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x560cffdcc1b0 0x560d001fabe0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f17c8d308a55db8 server_cookie=37692fd557e2d05a in_seq=0 out_seq=0 2024-08-31T05:30:34.004 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:33.997+0000 7fc771ffb640 10 client.15702 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:30:34.007 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:34.005+0000 7fc771ffb640 1 -- 172.21.15.5:0/3515182753 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560d000e29f0 con 0x560cffdcc1b0 2024-08-31T05:30:34.007 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:34.005+0000 7fc771ffb640 10 client.15702 handle_command_reply: tid=0 2024-08-31T05:30:34.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:34.005+0000 7fc7973c9740 1 client.15702 shutdown 2024-08-31T05:30:34.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:34.005+0000 7fc7973c9740 1 -- 172.21.15.5:0/3515182753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560cffdab4d0 msgr2=0x560d00180130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:34.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:34.005+0000 7fc7973c9740 1 --2- 172.21.15.5:0/3515182753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560cffdab4d0 0x560d00180130 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fc778003fd0 tx=0x7fc778003cb0 comp rx=0 tx=0).stop 2024-08-31T05:30:34.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:34.005+0000 7fc7973c9740 1 -- 172.21.15.5:0/3515182753 shutdown_connections 2024-08-31T05:30:34.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:34.005+0000 7fc7973c9740 1 --2- 172.21.15.5:0/3515182753 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x560cffdcc1b0 0x560d001fabe0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:34.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:34.005+0000 7fc7973c9740 1 --2- 172.21.15.5:0/3515182753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560cffdab4d0 0x560d00180130 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:34.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:34.005+0000 7fc771ffb640 0 client.15702 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:30:34.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:34.005+0000 7fc7973c9740 1 --2- 172.21.15.5:0/3515182753 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560cffda32f0 0x560d0017fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:34.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:34.005+0000 7fc7973c9740 1 --2- 172.21.15.5:0/3515182753 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560cffd8ad80 0x560d0017f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:34.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:34.005+0000 7fc7973c9740 1 -- 172.21.15.5:0/3515182753 >> 172.21.15.5:0/3515182753 conn(0x560cffdc0300 msgr2=0x560d00174b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:34.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:34.005+0000 7fc7973c9740 1 -- 172.21.15.5:0/3515182753 shutdown_connections 2024-08-31T05:30:34.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:34.005+0000 7fc7973c9740 1 -- 172.21.15.5:0/3515182753 wait complete. 2024-08-31T05:30:34.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:34.005+0000 7fc7973c9740 20 client.15702 trim_cache size 0 max 16384 2024-08-31T05:30:34.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:30:34.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:30:34.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:30:34.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:30:34.010 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:34.006+0000 7fc79045a640 1 -- 172.21.15.5:0/1859506550 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc7740b4d20 msgr2=0x7fc7740b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:34.010 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:34.006+0000 7fc79045a640 1 --2- 172.21.15.5:0/1859506550 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc7740b4d20 0x7fc7740b7230 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc7800e2970 tx=0x7fc78000bf10 comp rx=0 tx=0).stop 2024-08-31T05:30:34.010 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:34.006+0000 7fc79045a640 1 -- 172.21.15.5:0/1859506550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc788109af0 msgr2=0x7fc78819fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:34.010 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:34.006+0000 7fc79045a640 1 --2- 172.21.15.5:0/1859506550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc788109af0 0x7fc78819fa70 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fc780009fd0 tx=0x7fc78000b260 comp rx=0 tx=0).stop 2024-08-31T05:30:34.010 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:34.006+0000 7fc79045a640 1 -- 172.21.15.5:0/1859506550 shutdown_connections 2024-08-31T05:30:34.010 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:34.006+0000 7fc79045a640 1 --2- 172.21.15.5:0/1859506550 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc7740b4d20 0x7fc7740b7230 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:34.010 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:34.006+0000 7fc79045a640 1 --2- 172.21.15.5:0/1859506550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc788109af0 0x7fc78819fa70 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:34.010 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:34.006+0000 7fc79045a640 1 --2- 172.21.15.5:0/1859506550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7881091a0 0x7fc78819a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:34.010 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:34.006+0000 7fc79045a640 1 --2- 172.21.15.5:0/1859506550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc788103870 0x7fc78819a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:34.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:34.006+0000 7fc79045a640 1 -- 172.21.15.5:0/1859506550 >> 172.21.15.5:0/1859506550 conn(0x7fc7880ff270 msgr2=0x7fc788108890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:34.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:34.006+0000 7fc79045a640 1 -- 172.21.15.5:0/1859506550 shutdown_connections 2024-08-31T05:30:34.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:34.006+0000 7fc79045a640 1 -- 172.21.15.5:0/1859506550 wait complete. 2024-08-31T05:30:34.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:34 smithi050 ceph-mon[22146]: pgmap v363: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.8 KiB/s wr, 14 op/s 2024-08-31T05:30:34.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:34 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:30:34.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:34 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:30:34.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:34 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:30:34.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:34 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:30:34.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:34 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:30:34.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:34 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:30:34.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:34 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:30:34.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:34 smithi005 ceph-mon[18602]: pgmap v363: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.8 KiB/s wr, 14 op/s 2024-08-31T05:30:34.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:34 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:30:34.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:34 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:30:34.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:34 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:30:34.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:34 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:30:34.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:34 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:30:34.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:34 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:30:34.968 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:34 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:30:35.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:34 smithi070 ceph-mon[22316]: pgmap v363: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.8 KiB/s wr, 14 op/s 2024-08-31T05:30:35.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:34 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:30:35.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:34 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:30:35.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:34 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:30:35.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:34 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:30:35.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:34 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:30:35.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:34 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:30:35.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:34 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:30:35.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:35 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:30:35.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:35 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:30:35.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:35 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:30:35.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:35 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:30:35.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:35 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:30:35.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:35 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:30:36.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:35 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:30:36.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:35 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:30:36.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:35 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:30:37.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:36 smithi070 ceph-mon[22316]: pgmap v364: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 597 B/s wr, 12 op/s 2024-08-31T05:30:37.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:36 smithi050 ceph-mon[22146]: pgmap v364: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 597 B/s wr, 12 op/s 2024-08-31T05:30:37.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:36 smithi005 ceph-mon[18602]: pgmap v364: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 597 B/s wr, 12 op/s 2024-08-31T05:30:38.923 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T05:30:39.199 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:30:39.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:38 smithi005 ceph-mon[18602]: pgmap v365: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-08-31T05:30:39.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:38 smithi070 ceph-mon[22316]: pgmap v365: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-08-31T05:30:39.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:38 smithi050 ceph-mon[22146]: pgmap v365: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-08-31T05:30:39.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.758+0000 7f770adfe640 1 -- 172.21.15.5:0/217271441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f770410dbb0 msgr2=0x7f77041100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:39.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.758+0000 7f770adfe640 1 --2- 172.21.15.5:0/217271441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f770410dbb0 0x7f77041100a0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f76fc009ca0 tx=0x7f76fc02a8c0 comp rx=0 tx=0).stop 2024-08-31T05:30:39.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.758+0000 7f770adfe640 1 -- 172.21.15.5:0/217271441 shutdown_connections 2024-08-31T05:30:39.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.758+0000 7f770adfe640 1 --2- 172.21.15.5:0/217271441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f770410dbb0 0x7f77041100a0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:39.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.758+0000 7f770adfe640 1 --2- 172.21.15.5:0/217271441 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77041050a0 0x7f770410d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:39.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.758+0000 7f770adfe640 1 --2- 172.21.15.5:0/217271441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7704104750 0x7f7704104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:39.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.758+0000 7f770adfe640 1 -- 172.21.15.5:0/217271441 >> 172.21.15.5:0/217271441 conn(0x7f77040794d0 msgr2=0x7f77040798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:39.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.758+0000 7f770adfe640 1 -- 172.21.15.5:0/217271441 shutdown_connections 2024-08-31T05:30:39.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.758+0000 7f770adfe640 1 -- 172.21.15.5:0/217271441 wait complete. 2024-08-31T05:30:39.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.759+0000 7f770adfe640 1 Processor -- start 2024-08-31T05:30:39.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.759+0000 7f770adfe640 1 -- start start 2024-08-31T05:30:39.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.759+0000 7f770adfe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7704104750 0x7f770419a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:39.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.760+0000 7f770adfe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77041050a0 0x7f770419a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:39.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.760+0000 7f770adfe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f770410dbb0 0x7f770419fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:39.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.760+0000 7f770adfe640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7704113830 con 0x7f7704104750 2024-08-31T05:30:39.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.760+0000 7f770adfe640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f77041136b0 con 0x7f77041050a0 2024-08-31T05:30:39.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.760+0000 7f770adfe640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f77041139b0 con 0x7f770410dbb0 2024-08-31T05:30:39.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.760+0000 7f7708b9a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7704104750 0x7f770419a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:39.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.760+0000 7f7708b9a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7704104750 0x7f770419a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34212/0 (socket says 172.21.15.5:34212) 2024-08-31T05:30:39.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.760+0000 7f7708b9a640 1 -- 172.21.15.5:0/3440504271 learned_addr learned my addr 172.21.15.5:0/3440504271 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:39.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.760+0000 7f7703fff640 1 --2- 172.21.15.5:0/3440504271 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77041050a0 0x7f770419a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:39.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.760+0000 7f770939b640 1 --2- 172.21.15.5:0/3440504271 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f770410dbb0 0x7f770419fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:39.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.760+0000 7f7708b9a640 1 -- 172.21.15.5:0/3440504271 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f770410dbb0 msgr2=0x7f770419fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:39.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.760+0000 7f7708b9a640 1 --2- 172.21.15.5:0/3440504271 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f770410dbb0 0x7f770419fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:39.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.760+0000 7f7708b9a640 1 -- 172.21.15.5:0/3440504271 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77041050a0 msgr2=0x7f770419a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:39.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.760+0000 7f7708b9a640 1 --2- 172.21.15.5:0/3440504271 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77041050a0 0x7f770419a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:39.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.760+0000 7f7708b9a640 1 -- 172.21.15.5:0/3440504271 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77041a02b0 con 0x7f7704104750 2024-08-31T05:30:39.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.760+0000 7f7703fff640 1 --2- 172.21.15.5:0/3440504271 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77041050a0 0x7f770419a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:30:39.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.760+0000 7f7708b9a640 1 --2- 172.21.15.5:0/3440504271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7704104750 0x7f770419a340 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f76f800e9c0 tx=0x7f76f800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:39.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.761+0000 7f7701ffb640 1 -- 172.21.15.5:0/3440504271 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f800cd80 con 0x7f7704104750 2024-08-31T05:30:39.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.761+0000 7f7701ffb640 1 -- 172.21.15.5:0/3440504271 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76f80035f0 con 0x7f7704104750 2024-08-31T05:30:39.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.761+0000 7f7701ffb640 1 -- 172.21.15.5:0/3440504271 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f8010690 con 0x7f7704104750 2024-08-31T05:30:39.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.761+0000 7f770adfe640 1 -- 172.21.15.5:0/3440504271 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77041a05a0 con 0x7f7704104750 2024-08-31T05:30:39.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.761+0000 7f770adfe640 1 -- 172.21.15.5:0/3440504271 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77041a6d00 con 0x7f7704104750 2024-08-31T05:30:39.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.764+0000 7f7711373740 1 Processor -- start 2024-08-31T05:30:39.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.764+0000 7f7711373740 1 -- start start 2024-08-31T05:30:39.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.765+0000 7f7711373740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a4fb32070 0x561a4fed7300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:39.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.765+0000 7f7711373740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a4fb091b0 0x561a4fed7840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:39.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.765+0000 7f7711373740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561a4fb11390 0x561a4fed7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:39.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.765+0000 7f7711373740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x561a4fe4e630 con 0x561a4fb11390 2024-08-31T05:30:39.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.765+0000 7f7711373740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x561a4fe3dbc0 con 0x561a4fb32070 2024-08-31T05:30:39.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.765+0000 7f7711373740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561a4fe41b70 con 0x561a4fb091b0 2024-08-31T05:30:39.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.765+0000 7f7703fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561a4fb11390 0x561a4fed7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:39.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.765+0000 7f7703fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561a4fb11390 0x561a4fed7d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34214/0 (socket says 172.21.15.5:34214) 2024-08-31T05:30:39.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.765+0000 7f7703fff640 1 -- 172.21.15.5:0/3874398393 learned_addr learned my addr 172.21.15.5:0/3874398393 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:39.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.765+0000 7f770939b640 1 --2- 172.21.15.5:0/3874398393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a4fb32070 0x561a4fed7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:39.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.766+0000 7f770939b640 1 -- 172.21.15.5:0/3874398393 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a4fb091b0 msgr2=0x561a4fed7840 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T05:30:39.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.766+0000 7f770939b640 1 --2- 172.21.15.5:0/3874398393 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a4fb091b0 0x561a4fed7840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:39.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.766+0000 7f770939b640 1 -- 172.21.15.5:0/3874398393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561a4fb11390 msgr2=0x561a4fed7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:39.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.766+0000 7f770939b640 1 --2- 172.21.15.5:0/3874398393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561a4fb11390 0x561a4fed7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:39.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.766+0000 7f770939b640 1 -- 172.21.15.5:0/3874398393 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a4fb9d650 con 0x561a4fb32070 2024-08-31T05:30:39.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.766+0000 7f7703fff640 1 --2- 172.21.15.5:0/3874398393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561a4fb11390 0x561a4fed7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:30:39.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.766+0000 7f7701ffb640 1 -- 172.21.15.5:0/3440504271 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) ==== 152701+0+0 (secure 0 0 0) 0x7f76f80037a0 con 0x7f7704104750 2024-08-31T05:30:39.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.766+0000 7f770939b640 1 --2- 172.21.15.5:0/3874398393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a4fb32070 0x561a4fed7300 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f76fc005e30 tx=0x7f76fc02f410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d48ac6daf3e2f6cf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:39.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.766+0000 7f76eeffd640 1 -- 172.21.15.5:0/3874398393 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76fc031cf0 con 0x561a4fb32070 2024-08-31T05:30:39.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.766+0000 7f76eeffd640 1 -- 172.21.15.5:0/3874398393 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76fc036070 con 0x561a4fb32070 2024-08-31T05:30:39.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.766+0000 7f76eeffd640 1 -- 172.21.15.5:0/3874398393 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76fc004040 con 0x561a4fb32070 2024-08-31T05:30:39.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.767+0000 7f7701ffb640 1 --2- 172.21.15.5:0/3440504271 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f76f40b4d20 0x7f76f40b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:39.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.767+0000 7f7711373740 1 -- 172.21.15.5:0/3874398393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a4fb32070 msgr2=0x561a4fed7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:39.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.767+0000 7f7711373740 1 --2- 172.21.15.5:0/3874398393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a4fb32070 0x561a4fed7300 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f76fc005e30 tx=0x7f76fc02f410 comp rx=0 tx=0).stop 2024-08-31T05:30:39.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.767+0000 7f7701ffb640 1 -- 172.21.15.5:0/3440504271 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f76f80e5c10 con 0x7f7704104750 2024-08-31T05:30:39.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.767+0000 7f7708b9a640 1 --2- 172.21.15.5:0/3440504271 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f76f40b4d20 0x7f76f40b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:39.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.767+0000 7f7711373740 1 -- 172.21.15.5:0/3874398393 shutdown_connections 2024-08-31T05:30:39.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.767+0000 7f7711373740 1 --2- 172.21.15.5:0/3874398393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561a4fb11390 0x561a4fed7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:39.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.767+0000 7f7711373740 1 --2- 172.21.15.5:0/3874398393 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a4fb091b0 0x561a4fed7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:39.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.767+0000 7f7711373740 1 --2- 172.21.15.5:0/3874398393 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a4fb32070 0x561a4fed7300 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:39.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.767+0000 7f7711373740 1 -- 172.21.15.5:0/3874398393 >> 172.21.15.5:0/3874398393 conn(0x561a4fb26460 msgr2=0x561a4fed51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:39.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.768+0000 7f7711373740 1 -- 172.21.15.5:0/3874398393 shutdown_connections 2024-08-31T05:30:39.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.768+0000 7f7708b9a640 1 --2- 172.21.15.5:0/3440504271 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f76f40b4d20 0x7f76f40b7230 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x561a4fed5f80 tx=0x7f76f8009700 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:39.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.768+0000 7f7711373740 1 -- 172.21.15.5:0/3874398393 wait complete. 2024-08-31T05:30:39.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.768+0000 7f7711373740 1 -- start start 2024-08-31T05:30:39.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.769+0000 7f7711373740 1 Processor -- start 2024-08-31T05:30:39.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.769+0000 7f7711373740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561a4fb091b0 0x561a4fee2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:39.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.770+0000 7f7711373740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a4fb11390 0x561a4fee2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:39.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.770+0000 7f7711373740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a4fb32070 0x561a4feeeda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:39.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.770+0000 7f770939b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561a4fb091b0 0x561a4fee2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:39.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.770+0000 7f770939b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561a4fb091b0 0x561a4fee2a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34220/0 (socket says 172.21.15.5:34220) 2024-08-31T05:30:39.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.770+0000 7f770939b640 1 -- 172.21.15.5:0/3791267957 learned_addr learned my addr 172.21.15.5:0/3791267957 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:39.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.770+0000 7f7711373740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x561a4fca0700 con 0x561a4fb091b0 2024-08-31T05:30:39.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.770+0000 7f7711373740 1 -- 172.21.15.5:0/3791267957 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x561a4fdc4700 con 0x561a4fb11390 2024-08-31T05:30:39.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.770+0000 7f7703fff640 1 --2- 172.21.15.5:0/3791267957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a4fb11390 0x561a4fee2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:39.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.770+0000 7f7711373740 1 -- 172.21.15.5:0/3791267957 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561a4fee5a80 con 0x561a4fb32070 2024-08-31T05:30:39.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.770+0000 7f7711373740 10 client.0 _ll_register_callbacks cb 0x561a4fdf3dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:30:39.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.770+0000 7f770939b640 1 -- 172.21.15.5:0/3791267957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a4fb32070 msgr2=0x561a4feeeda0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T05:30:39.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.770+0000 7f770939b640 1 --2- 172.21.15.5:0/3791267957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a4fb32070 0x561a4feeeda0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:39.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.770+0000 7f770939b640 1 -- 172.21.15.5:0/3791267957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a4fb11390 msgr2=0x561a4fee2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:39.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.770+0000 7f770939b640 1 --2- 172.21.15.5:0/3791267957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a4fb11390 0x561a4fee2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:39.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.770+0000 7f770939b640 1 -- 172.21.15.5:0/3791267957 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a4fdfd8b0 con 0x561a4fb091b0 2024-08-31T05:30:39.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.771+0000 7f770939b640 1 --2- 172.21.15.5:0/3791267957 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561a4fb091b0 0x561a4fee2a20 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f76fc005c90 tx=0x7f76fc032d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=918fdc46b15020bb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:39.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.771+0000 7f76e3fff640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:30:39.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.771+0000 7f76e3fff640 1 -- 172.21.15.5:0/3791267957 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76fc04f040 con 0x561a4fb091b0 2024-08-31T05:30:39.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.771+0000 7f76e3fff640 1 -- 172.21.15.5:0/3791267957 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f76fc031650 con 0x561a4fb091b0 2024-08-31T05:30:39.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.771+0000 7f7711373740 1 -- 172.21.15.5:0/3791267957 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76fc036070 con 0x561a4fb091b0 2024-08-31T05:30:39.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.772+0000 7f76e3fff640 1 -- 172.21.15.5:0/3791267957 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f76fc061050 con 0x561a4fb091b0 2024-08-31T05:30:39.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.772+0000 7f7711373740 10 client.15714 fetch_fsmap learned FSMap version 30 2024-08-31T05:30:39.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.772+0000 7f7711373740 1 -- 172.21.15.5:0/3791267957 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561a4fef17c0 con 0x561a4fb091b0 2024-08-31T05:30:39.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.772+0000 7f76e3fff640 1 -- 172.21.15.5:0/3791267957 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76fc036070 con 0x561a4fb091b0 2024-08-31T05:30:39.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.773+0000 7f76e3fff640 1 -- 172.21.15.5:0/3791267957 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f76fc052070 con 0x561a4fb091b0 2024-08-31T05:30:39.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.773+0000 7f7711373740 10 client.15714 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T05:30:39.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.773+0000 7f7711373740 10 client.15714 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:30:39.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.773+0000 7f7711373740 20 client.15714 populate_metadata read hostname 'smithi005' 2024-08-31T05:30:39.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.773+0000 7f7711373740 1 --2- 172.21.15.5:0/3791267957 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561a4faf09f0 0x561a4fef4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:39.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.773+0000 7f7711373740 4 client.15714 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:30:39.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.773+0000 7f7711373740 1 -- 172.21.15.5:0/3791267957 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561a4fe50580 con 0x561a4faf09f0 2024-08-31T05:30:39.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.773+0000 7f7703fff640 1 --2- 172.21.15.5:0/3791267957 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561a4faf09f0 0x561a4fef4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:39.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.774+0000 7f7703fff640 1 --2- 172.21.15.5:0/3791267957 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561a4faf09f0 0x561a4fef4bd0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=692fcab05c8a9ca9 server_cookie=f08191e1d31e9a2a in_seq=0 out_seq=0 2024-08-31T05:30:39.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.774+0000 7f76e3fff640 10 client.15714 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:30:39.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.774+0000 7f76e3fff640 1 -- 172.21.15.5:0/3791267957 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561a4fe50580 con 0x561a4faf09f0 2024-08-31T05:30:39.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.774+0000 7f76e3fff640 10 client.15714 handle_command_reply: tid=0 2024-08-31T05:30:39.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.775+0000 7f7711373740 1 client.15714 shutdown 2024-08-31T05:30:39.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.775+0000 7f7711373740 1 -- 172.21.15.5:0/3791267957 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561a4fb091b0 msgr2=0x561a4fee2a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:39.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.775+0000 7f7711373740 1 --2- 172.21.15.5:0/3791267957 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561a4fb091b0 0x561a4fee2a20 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f76fc005c90 tx=0x7f76fc032d30 comp rx=0 tx=0).stop 2024-08-31T05:30:39.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.775+0000 7f7711373740 1 -- 172.21.15.5:0/3791267957 shutdown_connections 2024-08-31T05:30:39.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.775+0000 7f7711373740 1 --2- 172.21.15.5:0/3791267957 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561a4faf09f0 0x561a4fef4bd0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:39.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.775+0000 7f7711373740 1 --2- 172.21.15.5:0/3791267957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a4fb32070 0x561a4feeeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:39.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.775+0000 7f7711373740 1 --2- 172.21.15.5:0/3791267957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a4fb11390 0x561a4fee2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:39.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.775+0000 7f7711373740 1 --2- 172.21.15.5:0/3791267957 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561a4fb091b0 0x561a4fee2a20 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:39.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.775+0000 7f7711373740 1 -- 172.21.15.5:0/3791267957 >> 172.21.15.5:0/3791267957 conn(0x561a4fb26460 msgr2=0x561a4feda490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:39.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.775+0000 7f76e3fff640 0 client.15714 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:30:39.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.775+0000 7f7711373740 1 -- 172.21.15.5:0/3791267957 shutdown_connections 2024-08-31T05:30:39.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.775+0000 7f7711373740 1 -- 172.21.15.5:0/3791267957 wait complete. 2024-08-31T05:30:39.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.775+0000 7f7711373740 20 client.15714 trim_cache size 0 max 16384 2024-08-31T05:30:39.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.809+0000 7f7711373740 1 Processor -- start 2024-08-31T05:30:39.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.809+0000 7f7711373740 1 -- start start 2024-08-31T05:30:39.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.810+0000 7f7711373740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a4fb091b0 0x561a4fee4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:39.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.810+0000 7f7711373740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561a4fb11390 0x561a4fedfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:39.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.810+0000 7f7711373740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a4fb32070 0x561a4fee0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:39.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.810+0000 7f7711373740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f77041ae9d0 con 0x561a4fb11390 2024-08-31T05:30:39.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.810+0000 7f7711373740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f77041b0510 con 0x561a4fb32070 2024-08-31T05:30:39.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.810+0000 7f7711373740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f77041af0a0 con 0x561a4fb091b0 2024-08-31T05:30:39.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.810+0000 7f7703fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561a4fb11390 0x561a4fedfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:39.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.810+0000 7f770939b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a4fb091b0 0x561a4fee4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:39.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.810+0000 7f7703fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561a4fb11390 0x561a4fedfc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34228/0 (socket says 172.21.15.5:34228) 2024-08-31T05:30:39.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.810+0000 7f7703fff640 1 -- 172.21.15.5:0/234991651 learned_addr learned my addr 172.21.15.5:0/234991651 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:39.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.810+0000 7f770939b640 1 --2- 172.21.15.5:0/234991651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a4fb32070 0x561a4fee0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:39.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.810+0000 7f770939b640 1 -- 172.21.15.5:0/234991651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a4fb32070 msgr2=0x561a4fee0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:39.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.810+0000 7f770939b640 1 --2- 172.21.15.5:0/234991651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a4fb32070 0x561a4fee0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:39.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.810+0000 7f770939b640 1 -- 172.21.15.5:0/234991651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561a4fb11390 msgr2=0x561a4fedfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:39.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.810+0000 7f770939b640 1 --2- 172.21.15.5:0/234991651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561a4fb11390 0x561a4fedfc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:39.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.810+0000 7f770939b640 1 -- 172.21.15.5:0/234991651 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a4feda160 con 0x561a4fb091b0 2024-08-31T05:30:39.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.811+0000 7f770939b640 1 --2- 172.21.15.5:0/234991651 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a4fb091b0 0x561a4fee4650 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f76fc004660 tx=0x7f76fc005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=686580831e1be232 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:39.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.811+0000 7f76ee7fc640 1 -- 172.21.15.5:0/234991651 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76fc003fd0 con 0x561a4fb091b0 2024-08-31T05:30:39.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.811+0000 7f76ee7fc640 1 -- 172.21.15.5:0/234991651 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76fc036040 con 0x561a4fb091b0 2024-08-31T05:30:39.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.811+0000 7f76ee7fc640 1 -- 172.21.15.5:0/234991651 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76fc003d60 con 0x561a4fb091b0 2024-08-31T05:30:39.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.812+0000 7f7711373740 1 -- 172.21.15.5:0/234991651 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a4fb091b0 msgr2=0x561a4fee4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:39.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.812+0000 7f7711373740 1 --2- 172.21.15.5:0/234991651 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a4fb091b0 0x561a4fee4650 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f76fc004660 tx=0x7f76fc005fd0 comp rx=0 tx=0).stop 2024-08-31T05:30:39.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.812+0000 7f7711373740 1 -- 172.21.15.5:0/234991651 shutdown_connections 2024-08-31T05:30:39.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.812+0000 7f7711373740 1 --2- 172.21.15.5:0/234991651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a4fb32070 0x561a4fee0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:39.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.812+0000 7f7711373740 1 --2- 172.21.15.5:0/234991651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561a4fb11390 0x561a4fedfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:39.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.812+0000 7f7711373740 1 --2- 172.21.15.5:0/234991651 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a4fb091b0 0x561a4fee4650 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:39.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.812+0000 7f7711373740 1 -- 172.21.15.5:0/234991651 >> 172.21.15.5:0/234991651 conn(0x561a4fb26460 msgr2=0x561a4fee3f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:39.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.812+0000 7f7711373740 1 -- 172.21.15.5:0/234991651 shutdown_connections 2024-08-31T05:30:39.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.813+0000 7f7711373740 1 -- 172.21.15.5:0/234991651 wait complete. 2024-08-31T05:30:39.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.813+0000 7f7711373740 1 -- start start 2024-08-31T05:30:39.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.813+0000 7f7711373740 1 Processor -- start 2024-08-31T05:30:39.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.814+0000 7f7711373740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a4fb091b0 0x561a4feeb590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:39.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.814+0000 7f7711373740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561a4fb11390 0x561a4fee8a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:39.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.814+0000 7f7711373740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a4fb32070 0x561a4fee9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:39.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.814+0000 7f7703fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561a4fb11390 0x561a4fee8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:39.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.814+0000 7f7703fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561a4fb11390 0x561a4fee8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34244/0 (socket says 172.21.15.5:34244) 2024-08-31T05:30:39.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.814+0000 7f7703fff640 1 -- 172.21.15.5:0/2982792922 learned_addr learned my addr 172.21.15.5:0/2982792922 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:39.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.814+0000 7f7711373740 1 -- 172.21.15.5:0/2982792922 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f77041afe40 con 0x561a4fb11390 2024-08-31T05:30:39.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.814+0000 7f7711373740 1 -- 172.21.15.5:0/2982792922 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f77041af770 con 0x561a4fb32070 2024-08-31T05:30:39.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.814+0000 7f7711373740 1 -- 172.21.15.5:0/2982792922 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f77041ac9b0 con 0x561a4fb091b0 2024-08-31T05:30:39.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.814+0000 7f7711373740 10 client.0 _ll_register_callbacks cb 0x7f76f0009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:30:39.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.814+0000 7f770939b640 1 --2- 172.21.15.5:0/2982792922 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a4fb091b0 0x561a4feeb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:39.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.814+0000 7f7703fff640 1 -- 172.21.15.5:0/2982792922 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a4fb091b0 msgr2=0x561a4feeb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:39.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.814+0000 7f7703fff640 1 --2- 172.21.15.5:0/2982792922 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a4fb091b0 0x561a4feeb590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:39.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.814+0000 7f7703fff640 1 -- 172.21.15.5:0/2982792922 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a4fb32070 msgr2=0x561a4fee9040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T05:30:39.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.814+0000 7f7703fff640 1 --2- 172.21.15.5:0/2982792922 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a4fb32070 0x561a4fee9040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:39.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.814+0000 7f7703fff640 1 -- 172.21.15.5:0/2982792922 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a4fedd650 con 0x561a4fb11390 2024-08-31T05:30:39.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.814+0000 7f770939b640 1 --2- 172.21.15.5:0/2982792922 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a4fb091b0 0x561a4feeb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:30:39.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.815+0000 7f7703fff640 1 --2- 172.21.15.5:0/2982792922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561a4fb11390 0x561a4fee8a60 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f76f0012380 tx=0x7f76f0012b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f15dd9a2cb87fb3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:39.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.815+0000 7f76e3fff640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:30:39.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.815+0000 7f76e3fff640 1 -- 172.21.15.5:0/2982792922 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f0012c60 con 0x561a4fb11390 2024-08-31T05:30:39.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.815+0000 7f76e3fff640 1 -- 172.21.15.5:0/2982792922 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f76f0012e00 con 0x561a4fb11390 2024-08-31T05:30:39.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.815+0000 7f7711373740 1 -- 172.21.15.5:0/2982792922 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76fc036040 con 0x561a4fb11390 2024-08-31T05:30:39.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.815+0000 7f76e3fff640 1 -- 172.21.15.5:0/2982792922 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f76f0031050 con 0x561a4fb11390 2024-08-31T05:30:39.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.815+0000 7f7711373740 10 client.15720 fetch_fsmap learned FSMap version 30 2024-08-31T05:30:39.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.815+0000 7f7711373740 1 -- 172.21.15.5:0/2982792922 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x561a4ff5f430 con 0x561a4fb11390 2024-08-31T05:30:39.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.816+0000 7f76e3fff640 1 -- 172.21.15.5:0/2982792922 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76f0010e40 con 0x561a4fb11390 2024-08-31T05:30:39.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.816+0000 7f76e3fff640 1 -- 172.21.15.5:0/2982792922 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f76f0023070 con 0x561a4fb11390 2024-08-31T05:30:39.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.816+0000 7f7711373740 10 client.15720 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T05:30:39.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.816+0000 7f7711373740 10 client.15720 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:30:39.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.816+0000 7f7711373740 20 client.15720 populate_metadata read hostname 'smithi005' 2024-08-31T05:30:39.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.816+0000 7f7711373740 1 --2- 172.21.15.5:0/2982792922 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561a4fac5da0 0x561a4ff61c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:39.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.816+0000 7f7711373740 4 client.15720 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T05:30:39.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.816+0000 7f7711373740 1 -- 172.21.15.5:0/2982792922 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f76fc036040 con 0x561a4fac5da0 2024-08-31T05:30:39.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.816+0000 7f770939b640 1 --2- 172.21.15.5:0/2982792922 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561a4fac5da0 0x561a4ff61c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:39.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.817+0000 7f770939b640 1 --2- 172.21.15.5:0/2982792922 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561a4fac5da0 0x561a4ff61c20 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aeb411a02514b8a4 server_cookie=7e1302ab2bde51a4 in_seq=0 out_seq=0 2024-08-31T05:30:39.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.817+0000 7f76e3fff640 10 client.15720 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:30:39.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.817+0000 7f76e3fff640 1 -- 172.21.15.5:0/2982792922 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+374 (crc 0 0 0) 0x7f76fc036040 con 0x561a4fac5da0 2024-08-31T05:30:39.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.817+0000 7f76e3fff640 10 client.15720 handle_command_reply: tid=0 2024-08-31T05:30:39.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.817+0000 7f7711373740 1 client.15720 shutdown 2024-08-31T05:30:39.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.818+0000 7f7711373740 1 -- 172.21.15.5:0/2982792922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561a4fb11390 msgr2=0x561a4fee8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:39.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.818+0000 7f7711373740 1 --2- 172.21.15.5:0/2982792922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561a4fb11390 0x561a4fee8a60 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f76f0012380 tx=0x7f76f0012b30 comp rx=0 tx=0).stop 2024-08-31T05:30:39.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.818+0000 7f7711373740 1 -- 172.21.15.5:0/2982792922 shutdown_connections 2024-08-31T05:30:39.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.818+0000 7f7711373740 1 --2- 172.21.15.5:0/2982792922 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561a4fac5da0 0x561a4ff61c20 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:39.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.818+0000 7f7711373740 1 --2- 172.21.15.5:0/2982792922 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a4fb32070 0x561a4fee9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:39.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.818+0000 7f7711373740 1 --2- 172.21.15.5:0/2982792922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561a4fb11390 0x561a4fee8a60 secure :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f76f0012380 tx=0x7f76f0012b30 comp rx=0 tx=0).stop 2024-08-31T05:30:39.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.818+0000 7f7711373740 1 --2- 172.21.15.5:0/2982792922 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a4fb091b0 0x561a4feeb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:39.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.818+0000 7f7711373740 1 -- 172.21.15.5:0/2982792922 >> 172.21.15.5:0/2982792922 conn(0x561a4fb26460 msgr2=0x561a4fee47f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:39.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.818+0000 7f76e3fff640 0 client.15720 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:30:39.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.818+0000 7f7711373740 1 -- 172.21.15.5:0/2982792922 shutdown_connections 2024-08-31T05:30:39.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.818+0000 7f7711373740 1 -- 172.21.15.5:0/2982792922 wait complete. 2024-08-31T05:30:39.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.818+0000 7f7711373740 20 client.15720 trim_cache size 0 max 16384 2024-08-31T05:30:39.823 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:30:39.823 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "no active scrubs running", 2024-08-31T05:30:39.823 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": {}, 2024-08-31T05:30:39.823 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_stats": { 2024-08-31T05:30:39.823 INFO:teuthology.orchestra.run.smithi005.stdout: "75d84398-5d9c-4872-b879-2fbce045fa71": { 2024-08-31T05:30:39.823 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:06.642335+0000", 2024-08-31T05:30:39.823 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:30:39.824 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:30:39.824 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:30:39.824 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:30:39.824 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:30:39.824 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:30:39.824 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:30:39.824 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:30:39.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.819+0000 7f770adfe640 1 -- 172.21.15.5:0/3440504271 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f76f40b4d20 msgr2=0x7f76f40b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:39.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.819+0000 7f770adfe640 1 --2- 172.21.15.5:0/3440504271 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f76f40b4d20 0x7f76f40b7230 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x561a4fed5f80 tx=0x7f76f8009700 comp rx=0 tx=0).stop 2024-08-31T05:30:39.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.819+0000 7f770adfe640 1 -- 172.21.15.5:0/3440504271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7704104750 msgr2=0x7f770419a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:39.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.819+0000 7f770adfe640 1 --2- 172.21.15.5:0/3440504271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7704104750 0x7f770419a340 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f76f800e9c0 tx=0x7f76f800ee80 comp rx=0 tx=0).stop 2024-08-31T05:30:39.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.819+0000 7f770adfe640 1 -- 172.21.15.5:0/3440504271 shutdown_connections 2024-08-31T05:30:39.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.819+0000 7f770adfe640 1 --2- 172.21.15.5:0/3440504271 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f76f40b4d20 0x7f76f40b7230 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:39.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.819+0000 7f770adfe640 1 --2- 172.21.15.5:0/3440504271 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f770410dbb0 0x7f770419fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:39.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.819+0000 7f770adfe640 1 --2- 172.21.15.5:0/3440504271 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77041050a0 0x7f770419a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:39.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.819+0000 7f770adfe640 1 --2- 172.21.15.5:0/3440504271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7704104750 0x7f770419a340 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:39.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.819+0000 7f770adfe640 1 -- 172.21.15.5:0/3440504271 >> 172.21.15.5:0/3440504271 conn(0x7f77040794d0 msgr2=0x7f77040ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:39.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.819+0000 7f770adfe640 1 -- 172.21.15.5:0/3440504271 shutdown_connections 2024-08-31T05:30:39.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:39.819+0000 7f770adfe640 1 -- 172.21.15.5:0/3440504271 wait complete. 2024-08-31T05:30:40.678 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T05:30:40.678 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T05:30:41.054 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:30:41.303 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:41 smithi005 ceph-mon[18602]: pgmap v366: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 682 B/s wr, 13 op/s 2024-08-31T05:30:41.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:41 smithi070 ceph-mon[22316]: pgmap v366: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 682 B/s wr, 13 op/s 2024-08-31T05:30:41.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:41 smithi050 ceph-mon[22146]: pgmap v366: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 682 B/s wr, 13 op/s 2024-08-31T05:30:41.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:41.553+0000 7f1f529d3640 1 -- 172.21.15.5:0/1475106934 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f4c108160 msgr2=0x7f1f4c108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:41.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:41.553+0000 7f1f529d3640 1 --2- 172.21.15.5:0/1475106934 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f4c108160 0x7f1f4c108570 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f1f40009900 tx=0x7f1f4002a410 comp rx=0 tx=0).stop 2024-08-31T05:30:41.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:41.553+0000 7f1f529d3640 1 -- 172.21.15.5:0/1475106934 shutdown_connections 2024-08-31T05:30:41.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:41.553+0000 7f1f529d3640 1 --2- 172.21.15.5:0/1475106934 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f4c108ab0 0x7f1f4c10f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:41.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:41.553+0000 7f1f529d3640 1 --2- 172.21.15.5:0/1475106934 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f4c108160 0x7f1f4c108570 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:41.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:41.553+0000 7f1f529d3640 1 --2- 172.21.15.5:0/1475106934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f4c102820 0x7f1f4c102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:41.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:41.554+0000 7f1f529d3640 1 -- 172.21.15.5:0/1475106934 >> 172.21.15.5:0/1475106934 conn(0x7f1f4c0794e0 msgr2=0x7f1f4c0798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:41.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:41.554+0000 7f1f529d3640 1 -- 172.21.15.5:0/1475106934 shutdown_connections 2024-08-31T05:30:41.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:41.554+0000 7f1f529d3640 1 -- 172.21.15.5:0/1475106934 wait complete. 2024-08-31T05:30:41.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:41.555+0000 7f1f529d3640 1 Processor -- start 2024-08-31T05:30:41.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:41.555+0000 7f1f529d3640 1 -- start start 2024-08-31T05:30:41.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:41.555+0000 7f1f529d3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f4c102820 0x7f1f4c1a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:41.555+0000 7f1f529d3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f4c108160 0x7f1f4c1a1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:41.555+0000 7f1f529d3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f4c108ab0 0x7f1f4c1ac560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:41.555+0000 7f1f529d3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1f4c113840 con 0x7f1f4c108160 2024-08-31T05:30:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:41.555+0000 7f1f529d3640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1f4c1136c0 con 0x7f1f4c102820 2024-08-31T05:30:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:41.555+0000 7f1f529d3640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1f4c1139c0 con 0x7f1f4c108ab0 2024-08-31T05:30:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:41.556+0000 7f1f4b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f4c108160 0x7f1f4c1a1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:41.556+0000 7f1f4b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f4c108160 0x7f1f4c1a1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34268/0 (socket says 172.21.15.5:34268) 2024-08-31T05:30:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:41.556+0000 7f1f4b7fe640 1 -- 172.21.15.5:0/2412067538 learned_addr learned my addr 172.21.15.5:0/2412067538 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:41.556+0000 7f1f4bfff640 1 --2- 172.21.15.5:0/2412067538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f4c102820 0x7f1f4c1a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:41.556+0000 7f1f50f70640 1 --2- 172.21.15.5:0/2412067538 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f4c108ab0 0x7f1f4c1ac560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:41.556+0000 7f1f4b7fe640 1 -- 172.21.15.5:0/2412067538 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f4c108ab0 msgr2=0x7f1f4c1ac560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:41.556+0000 7f1f4b7fe640 1 --2- 172.21.15.5:0/2412067538 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f4c108ab0 0x7f1f4c1ac560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:41.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:41.556+0000 7f1f4b7fe640 1 -- 172.21.15.5:0/2412067538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f4c102820 msgr2=0x7f1f4c1a16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:41.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:41.556+0000 7f1f4b7fe640 1 --2- 172.21.15.5:0/2412067538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f4c102820 0x7f1f4c1a16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:41.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:41.556+0000 7f1f4b7fe640 1 -- 172.21.15.5:0/2412067538 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f4c1acaa0 con 0x7f1f4c108160 2024-08-31T05:30:41.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:41.556+0000 7f1f4b7fe640 1 --2- 172.21.15.5:0/2412067538 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f4c108160 0x7f1f4c1a1bf0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f1f40006010 tx=0x7f1f40004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:41.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:41.557+0000 7f1f497fa640 1 -- 172.21.15.5:0/2412067538 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4003f030 con 0x7f1f4c108160 2024-08-31T05:30:41.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:41.557+0000 7f1f529d3640 1 -- 172.21.15.5:0/2412067538 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f4c1acd30 con 0x7f1f4c108160 2024-08-31T05:30:41.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:41.557+0000 7f1f497fa640 1 -- 172.21.15.5:0/2412067538 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f40003aa0 con 0x7f1f4c108160 2024-08-31T05:30:41.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:41.557+0000 7f1f497fa640 1 -- 172.21.15.5:0/2412067538 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f40035070 con 0x7f1f4c108160 2024-08-31T05:30:41.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:41.557+0000 7f1f529d3640 1 -- 172.21.15.5:0/2412067538 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f4c1ad1c0 con 0x7f1f4c108160 2024-08-31T05:30:41.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:41.558+0000 7f1f529d3640 1 -- 172.21.15.5:0/2412067538 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f4c103aa0 con 0x7f1f4c108160 2024-08-31T05:30:41.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:41.560+0000 7f1f497fa640 1 -- 172.21.15.5:0/2412067538 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) ==== 152701+0+0 (secure 0 0 0) 0x7f1f40042030 con 0x7f1f4c108160 2024-08-31T05:30:41.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:41.561+0000 7f1f497fa640 1 --2- 172.21.15.5:0/2412067538 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f1f340b4ca0 0x7f1f340b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:41.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:41.562+0000 7f1f497fa640 1 -- 172.21.15.5:0/2412067538 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f1f40106090 con 0x7f1f4c108160 2024-08-31T05:30:41.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:41.562+0000 7f1f4bfff640 1 --2- 172.21.15.5:0/2412067538 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f1f340b4ca0 0x7f1f340b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:41.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:41.562+0000 7f1f4bfff640 1 --2- 172.21.15.5:0/2412067538 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f1f340b4ca0 0x7f1f340b71b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c10f5c0 tx=0x7f1f3c00b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:41.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:41.566+0000 7f1f497fa640 1 -- 172.21.15.5:0/2412067538 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f1f400cc4b0 con 0x7f1f4c108160 2024-08-31T05:30:41.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:41.859+0000 7f1f529d3640 1 -- 172.21.15.5:0/2412067538 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1f4c10ee70 con 0x7f1f4c108160 2024-08-31T05:30:41.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:41.860+0000 7f1f497fa640 1 -- 172.21.15.5:0/2412067538 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11941 (secure 0 0 0) 0x7f1f4c10ee70 con 0x7f1f4c108160 2024-08-31T05:30:41.862 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:30:41.863 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":30,"btime":"2024-08-31T05:29:57:563015+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14739,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2024812199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2024812199},{"type":"v1","addr":"172.21.15.5:6835","nonce":2024812199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3629023702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3629023702},{"type":"v1","addr":"172.21.15.5:6837","nonce":3629023702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T05:27:31.929153+0000","modified":"2024-08-31T05:29:56.645530+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24652,"mds_1":24638,"mds_2":24631,"mds_3":24625,"mds_4":24602},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6839/2412701258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":2412701258},{"type":"v1","addr":"172.21.15.5:6839","nonce":2412701258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14820":{"gid":14820,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6841/747057838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":747057838},{"type":"v1","addr":"172.21.15.5:6841","nonce":747057838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6833/1153378982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1153378982},{"type":"v1","addr":"172.21.15.50:6833","nonce":1153378982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6833/364083443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":364083443},{"type":"v1","addr":"172.21.15.70:6833","nonce":364083443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24587":{"gid":24587,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/2346896794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2346896794},{"type":"v1","addr":"172.21.15.50:6835","nonce":2346896794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24602":{"gid":24602,"name":"h","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.50:6837/428759669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":428759669},{"type":"v1","addr":"172.21.15.50:6837","nonce":428759669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.70:6835/2061504114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2061504114},{"type":"v1","addr":"172.21.15.70:6835","nonce":2061504114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.70:6837/2780036414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2780036414},{"type":"v1","addr":"172.21.15.70:6837","nonce":2780036414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.50:6839/98200944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":98200944},{"type":"v1","addr":"172.21.15.50:6839","nonce":98200944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24652":{"gid":24652,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.70:6839/2756569250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":2756569250},{"type":"v1","addr":"172.21.15.70:6839","nonce":2756569250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24652,"qdb_cluster":[24652,24631,24638,24625,24602]},"id":1}]} 2024-08-31T05:30:41.863 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 30 2024-08-31T05:30:41.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:41.862+0000 7f1f529d3640 1 -- 172.21.15.5:0/2412067538 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f1f340b4ca0 msgr2=0x7f1f340b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:41.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:41.862+0000 7f1f529d3640 1 --2- 172.21.15.5:0/2412067538 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f1f340b4ca0 0x7f1f340b71b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c10f5c0 tx=0x7f1f3c00b390 comp rx=0 tx=0).stop 2024-08-31T05:30:41.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:41.862+0000 7f1f529d3640 1 -- 172.21.15.5:0/2412067538 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f4c108160 msgr2=0x7f1f4c1a1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:41.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:41.862+0000 7f1f529d3640 1 --2- 172.21.15.5:0/2412067538 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f4c108160 0x7f1f4c1a1bf0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f1f40006010 tx=0x7f1f40004060 comp rx=0 tx=0).stop 2024-08-31T05:30:41.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:41.863+0000 7f1f529d3640 1 -- 172.21.15.5:0/2412067538 shutdown_connections 2024-08-31T05:30:41.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:41.863+0000 7f1f529d3640 1 --2- 172.21.15.5:0/2412067538 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f1f340b4ca0 0x7f1f340b71b0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:41.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:41.863+0000 7f1f529d3640 1 --2- 172.21.15.5:0/2412067538 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f4c108ab0 0x7f1f4c1ac560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:41.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:41.863+0000 7f1f529d3640 1 --2- 172.21.15.5:0/2412067538 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f4c108160 0x7f1f4c1a1bf0 secure :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f1f40006010 tx=0x7f1f40004060 comp rx=0 tx=0).stop 2024-08-31T05:30:41.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:41.863+0000 7f1f529d3640 1 --2- 172.21.15.5:0/2412067538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f4c102820 0x7f1f4c1a16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:41.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:41.863+0000 7f1f529d3640 1 -- 172.21.15.5:0/2412067538 >> 172.21.15.5:0/2412067538 conn(0x7f1f4c0794e0 msgr2=0x7f1f4c105000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:41.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:41.863+0000 7f1f529d3640 1 -- 172.21.15.5:0/2412067538 shutdown_connections 2024-08-31T05:30:41.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:41.863+0000 7f1f529d3640 1 -- 172.21.15.5:0/2412067538 wait complete. 2024-08-31T05:30:42.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:42 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/2412067538' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:30:42.308 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:42 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/2412067538' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:30:42.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:42 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/2412067538' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:30:42.658 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-31T05:30:42.995 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:30:43.263 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:43 smithi005 ceph-mon[18602]: pgmap v367: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 682 B/s wr, 9 op/s 2024-08-31T05:30:43.335 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:43 smithi070 ceph-mon[22316]: pgmap v367: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 682 B/s wr, 9 op/s 2024-08-31T05:30:43.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:43 smithi050 ceph-mon[22146]: pgmap v367: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 682 B/s wr, 9 op/s 2024-08-31T05:30:43.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.544+0000 7fb5bbe1e640 1 -- 172.21.15.5:0/3093995400 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5b4107900 msgr2=0x7fb5b4107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:43.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.544+0000 7fb5bbe1e640 1 --2- 172.21.15.5:0/3093995400 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5b4107900 0x7fb5b4107d10 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fb5a4009900 tx=0x7fb5a402a410 comp rx=0 tx=0).stop 2024-08-31T05:30:43.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.544+0000 7fb5bbe1e640 1 -- 172.21.15.5:0/3093995400 shutdown_connections 2024-08-31T05:30:43.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.544+0000 7fb5bbe1e640 1 --2- 172.21.15.5:0/3093995400 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb5b4108250 0x7fb5b410ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:43.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.544+0000 7fb5bbe1e640 1 --2- 172.21.15.5:0/3093995400 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5b4107900 0x7fb5b4107d10 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:43.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.544+0000 7fb5bbe1e640 1 --2- 172.21.15.5:0/3093995400 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5b4102010 0x7fb5b4102420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:43.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.544+0000 7fb5bbe1e640 1 -- 172.21.15.5:0/3093995400 >> 172.21.15.5:0/3093995400 conn(0x7fb5b4077a60 msgr2=0x7fb5b4077ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:43.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.544+0000 7fb5bbe1e640 1 -- 172.21.15.5:0/3093995400 shutdown_connections 2024-08-31T05:30:43.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.544+0000 7fb5bbe1e640 1 -- 172.21.15.5:0/3093995400 wait complete. 2024-08-31T05:30:43.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.545+0000 7fb5bbe1e640 1 Processor -- start 2024-08-31T05:30:43.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.545+0000 7fb5bbe1e640 1 -- start start 2024-08-31T05:30:43.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.546+0000 7fb5bbe1e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb5b4102010 0x7fb5b419b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:43.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.546+0000 7fb5bbe1e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5b4107900 0x7fb5b419b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:43.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.546+0000 7fb5bbe1e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5b4108250 0x7fb5b419bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:43.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.546+0000 7fb5bbe1e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b4112790 con 0x7fb5b4108250 2024-08-31T05:30:43.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.546+0000 7fb5bbe1e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b4112610 con 0x7fb5b4107900 2024-08-31T05:30:43.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.546+0000 7fb5bbe1e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b4112910 con 0x7fb5b4102010 2024-08-31T05:30:43.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.546+0000 7fb5ba3bb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5b4108250 0x7fb5b419bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:43.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.546+0000 7fb5ba3bb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5b4108250 0x7fb5b419bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56478/0 (socket says 172.21.15.5:56478) 2024-08-31T05:30:43.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.546+0000 7fb5ba3bb640 1 -- 172.21.15.5:0/3764261550 learned_addr learned my addr 172.21.15.5:0/3764261550 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:43.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.546+0000 7fb5b93b9640 1 --2- 172.21.15.5:0/3764261550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5b4107900 0x7fb5b419b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:43.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.546+0000 7fb5b9bba640 1 --2- 172.21.15.5:0/3764261550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb5b4102010 0x7fb5b419b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:43.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.546+0000 7fb5ba3bb640 1 -- 172.21.15.5:0/3764261550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb5b4102010 msgr2=0x7fb5b419b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:43.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.546+0000 7fb5ba3bb640 1 --2- 172.21.15.5:0/3764261550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb5b4102010 0x7fb5b419b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:43.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.546+0000 7fb5ba3bb640 1 -- 172.21.15.5:0/3764261550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5b4107900 msgr2=0x7fb5b419b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:43.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.546+0000 7fb5ba3bb640 1 --2- 172.21.15.5:0/3764261550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5b4107900 0x7fb5b419b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:43.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.547+0000 7fb5ba3bb640 1 -- 172.21.15.5:0/3764261550 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5b41a6310 con 0x7fb5b4108250 2024-08-31T05:30:43.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.547+0000 7fb5ba3bb640 1 --2- 172.21.15.5:0/3764261550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5b4108250 0x7fb5b419bb00 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac00eaa0 tx=0x7fb5ac00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:43.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.547+0000 7fb5aaffd640 1 -- 172.21.15.5:0/3764261550 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac00cdb0 con 0x7fb5b4108250 2024-08-31T05:30:43.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.547+0000 7fb5aaffd640 1 -- 172.21.15.5:0/3764261550 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5ac005020 con 0x7fb5b4108250 2024-08-31T05:30:43.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.547+0000 7fb5aaffd640 1 -- 172.21.15.5:0/3764261550 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac0116d0 con 0x7fb5b4108250 2024-08-31T05:30:43.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.547+0000 7fb5bbe1e640 1 -- 172.21.15.5:0/3764261550 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5b41a6600 con 0x7fb5b4108250 2024-08-31T05:30:43.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.547+0000 7fb5bbe1e640 1 -- 172.21.15.5:0/3764261550 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5b41a6ac0 con 0x7fb5b4108250 2024-08-31T05:30:43.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.550+0000 7fb5aaffd640 1 -- 172.21.15.5:0/3764261550 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) ==== 152701+0+0 (secure 0 0 0) 0x7fb5ac0051d0 con 0x7fb5b4108250 2024-08-31T05:30:43.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.551+0000 7fb5c2393740 1 Processor -- start 2024-08-31T05:30:43.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.551+0000 7fb5c2393740 1 -- start start 2024-08-31T05:30:43.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.551+0000 7fb5c2393740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558219b9d070 0x558219f42310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:43.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.551+0000 7fb5c2393740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558219b741b0 0x558219f42850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:43.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.551+0000 7fb5c2393740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558219b7c390 0x558219f42d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:43.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.552+0000 7fb5c2393740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x558219eb9680 con 0x558219b7c390 2024-08-31T05:30:43.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.552+0000 7fb5c2393740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558219ea8c10 con 0x558219b741b0 2024-08-31T05:30:43.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.552+0000 7fb5c2393740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558219eacbc0 con 0x558219b9d070 2024-08-31T05:30:43.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.552+0000 7fb5b93b9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558219b7c390 0x558219f42d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:43.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.552+0000 7fb5aaffd640 1 --2- 172.21.15.5:0/3764261550 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb5a00b4d50 0x7fb5a00b7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:43.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.552+0000 7fb5b9bba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558219b741b0 0x558219f42850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:43.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.552+0000 7fb5b9bba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558219b741b0 0x558219f42850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:42818/0 (socket says 172.21.15.5:42818) 2024-08-31T05:30:43.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.552+0000 7fb5b93b9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558219b7c390 0x558219f42d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56492/0 (socket says 172.21.15.5:56492) 2024-08-31T05:30:43.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.552+0000 7fb5b9bba640 1 -- 172.21.15.5:0/4206204587 learned_addr learned my addr 172.21.15.5:0/4206204587 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:43.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.552+0000 7fb5b93b9640 1 --2- 172.21.15.5:0/4206204587 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558219b9d070 0x558219f42310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:43.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.552+0000 7fb5ba3bb640 1 --2- 172.21.15.5:0/3764261550 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb5a00b4d50 0x7fb5a00b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:43.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.552+0000 7fb5aaffd640 1 -- 172.21.15.5:0/3764261550 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fb5ac0e5980 con 0x7fb5b4108250 2024-08-31T05:30:43.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.552+0000 7fb5b9bba640 1 -- 172.21.15.5:0/4206204587 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558219b9d070 msgr2=0x558219f42310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:43.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.552+0000 7fb5b9bba640 1 --2- 172.21.15.5:0/4206204587 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558219b9d070 0x558219f42310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:43.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.552+0000 7fb5b9bba640 1 -- 172.21.15.5:0/4206204587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558219b7c390 msgr2=0x558219f42d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:43.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.552+0000 7fb5b9bba640 1 --2- 172.21.15.5:0/4206204587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558219b7c390 0x558219f42d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:43.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.552+0000 7fb5b9bba640 1 -- 172.21.15.5:0/4206204587 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558219c08650 con 0x558219b741b0 2024-08-31T05:30:43.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.552+0000 7fb5b93b9640 1 --2- 172.21.15.5:0/4206204587 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558219b9d070 0x558219f42310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:30:43.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.553+0000 7fb5ba3bb640 1 --2- 172.21.15.5:0/3764261550 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb5a00b4d50 0x7fb5a00b7260 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac0a9010 tx=0x7fb5ac093040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:43.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.553+0000 7fb5b9bba640 1 --2- 172.21.15.5:0/4206204587 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558219b741b0 0x558219f42850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb5b000bcb0 tx=0x7fb5b00107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=584b34548185bf17 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:43.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.553+0000 7fb59ffff640 1 -- 172.21.15.5:0/4206204587 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b001c480 con 0x558219b741b0 2024-08-31T05:30:43.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.553+0000 7fb59ffff640 1 -- 172.21.15.5:0/4206204587 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5b001cad0 con 0x558219b741b0 2024-08-31T05:30:43.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.553+0000 7fb59ffff640 1 -- 172.21.15.5:0/4206204587 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b0011c30 con 0x558219b741b0 2024-08-31T05:30:43.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.554+0000 7fb5c2393740 1 -- 172.21.15.5:0/4206204587 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558219b741b0 msgr2=0x558219f42850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:43.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.554+0000 7fb5c2393740 1 --2- 172.21.15.5:0/4206204587 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558219b741b0 0x558219f42850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb5b000bcb0 tx=0x7fb5b00107a0 comp rx=0 tx=0).stop 2024-08-31T05:30:43.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.554+0000 7fb5c2393740 1 -- 172.21.15.5:0/4206204587 shutdown_connections 2024-08-31T05:30:43.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.554+0000 7fb5c2393740 1 --2- 172.21.15.5:0/4206204587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558219b7c390 0x558219f42d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:43.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.554+0000 7fb5c2393740 1 --2- 172.21.15.5:0/4206204587 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558219b741b0 0x558219f42850 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:43.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.554+0000 7fb5c2393740 1 --2- 172.21.15.5:0/4206204587 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558219b9d070 0x558219f42310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:43.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.554+0000 7fb5c2393740 1 -- 172.21.15.5:0/4206204587 >> 172.21.15.5:0/4206204587 conn(0x558219b91460 msgr2=0x558219f40200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:43.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.554+0000 7fb5c2393740 1 -- 172.21.15.5:0/4206204587 shutdown_connections 2024-08-31T05:30:43.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.554+0000 7fb5c2393740 1 -- 172.21.15.5:0/4206204587 wait complete. 2024-08-31T05:30:43.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.554+0000 7fb5c2393740 1 -- start start 2024-08-31T05:30:43.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.555+0000 7fb5c2393740 1 Processor -- start 2024-08-31T05:30:43.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.555+0000 7fb5c2393740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558219b741b0 0x558219f4da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:43.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.555+0000 7fb5c2393740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558219b7c390 0x558219f4dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:43.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.555+0000 7fb5c2393740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558219b9d070 0x558219f59de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:43.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.555+0000 7fb5c2393740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x558219d0b700 con 0x558219b741b0 2024-08-31T05:30:43.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.555+0000 7fb5c2393740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558219e2f750 con 0x558219b9d070 2024-08-31T05:30:43.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.555+0000 7fb5c2393740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558219f50af0 con 0x558219b7c390 2024-08-31T05:30:43.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.555+0000 7fb5c2393740 10 client.0 _ll_register_callbacks cb 0x558219e5ee10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:30:43.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.555+0000 7fb5b93b9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558219b741b0 0x558219f4da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:43.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.555+0000 7fb5b93b9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558219b741b0 0x558219f4da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56506/0 (socket says 172.21.15.5:56506) 2024-08-31T05:30:43.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.555+0000 7fb5b93b9640 1 -- 172.21.15.5:0/1957529496 learned_addr learned my addr 172.21.15.5:0/1957529496 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:43.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.556+0000 7fb5b9bba640 1 --2- 172.21.15.5:0/1957529496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558219b7c390 0x558219f4dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:43.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.556+0000 7fb5b93b9640 1 --2- 172.21.15.5:0/1957529496 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558219b9d070 0x558219f59de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:43.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.556+0000 7fb5b93b9640 1 -- 172.21.15.5:0/1957529496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558219b7c390 msgr2=0x558219f4dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:43.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.556+0000 7fb5b93b9640 1 --2- 172.21.15.5:0/1957529496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558219b7c390 0x558219f4dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:43.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.556+0000 7fb5b93b9640 1 -- 172.21.15.5:0/1957529496 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558219b9d070 msgr2=0x558219f59de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:43.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.556+0000 7fb5b93b9640 1 --2- 172.21.15.5:0/1957529496 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558219b9d070 0x558219f59de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:43.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.556+0000 7fb5b93b9640 1 -- 172.21.15.5:0/1957529496 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558219e68900 con 0x558219b741b0 2024-08-31T05:30:43.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.556+0000 7fb5b93b9640 1 --2- 172.21.15.5:0/1957529496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558219b741b0 0x558219f4da70 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fb5a4005f70 tx=0x7fb5a4041040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f09f383d07ebab6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:43.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.556+0000 7fb59d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:30:43.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.556+0000 7fb59d7fa640 1 -- 172.21.15.5:0/1957529496 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a4035040 con 0x558219b741b0 2024-08-31T05:30:43.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.556+0000 7fb5c2393740 1 -- 172.21.15.5:0/1957529496 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5b001cad0 con 0x558219b741b0 2024-08-31T05:30:43.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.556+0000 7fb59d7fa640 1 -- 172.21.15.5:0/1957529496 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fb5a4004250 con 0x558219b741b0 2024-08-31T05:30:43.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.557+0000 7fb59d7fa640 1 -- 172.21.15.5:0/1957529496 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb5a4053050 con 0x558219b741b0 2024-08-31T05:30:43.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.557+0000 7fb5c2393740 10 client.15738 fetch_fsmap learned FSMap version 30 2024-08-31T05:30:43.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.557+0000 7fb5c2393740 1 -- 172.21.15.5:0/1957529496 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x558219f5c8f0 con 0x558219b741b0 2024-08-31T05:30:43.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.557+0000 7fb59d7fa640 1 -- 172.21.15.5:0/1957529496 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5b001cad0 con 0x558219b741b0 2024-08-31T05:30:43.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.557+0000 7fb59d7fa640 1 -- 172.21.15.5:0/1957529496 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7fb5a40049b0 con 0x558219b741b0 2024-08-31T05:30:43.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.558+0000 7fb5c2393740 10 client.15738 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T05:30:43.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.558+0000 7fb5c2393740 10 client.15738 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-31T05:30:43.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.558+0000 7fb5c2393740 20 client.15738 populate_metadata read hostname 'smithi005' 2024-08-31T05:30:43.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.558+0000 7fb5c2393740 1 --2- 172.21.15.5:0/1957529496 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x558219b5b9f0 0x558219f5fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:43.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.558+0000 7fb5c2393740 4 client.15738 mds_command: new command op to 24602 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:30:43.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.558+0000 7fb5c2393740 1 -- 172.21.15.5:0/1957529496 --> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558219ebb5d0 con 0x558219b5b9f0 2024-08-31T05:30:43.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.559+0000 7fb5b9bba640 1 --2- 172.21.15.5:0/1957529496 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x558219b5b9f0 0x558219f5fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:43.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.559+0000 7fb5b9bba640 1 --2- 172.21.15.5:0/1957529496 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x558219b5b9f0 0x558219f5fd10 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8aeba76ebed15f5 server_cookie=d8c56d4bb002679 in_seq=0 out_seq=0 2024-08-31T05:30:43.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.559+0000 7fb59d7fa640 10 client.15738 ms_handle_connect on v2:172.21.15.50:6836/428759669 2024-08-31T05:30:43.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.560+0000 7fb59d7fa640 1 -- 172.21.15.5:0/1957529496 <== mds.4 v2:172.21.15.50:6836/428759669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558219ebb5d0 con 0x558219b5b9f0 2024-08-31T05:30:43.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.560+0000 7fb59d7fa640 10 client.15738 handle_command_reply: tid=0 2024-08-31T05:30:43.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.560+0000 7fb5c2393740 1 client.15738 shutdown 2024-08-31T05:30:43.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.560+0000 7fb5c2393740 1 -- 172.21.15.5:0/1957529496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558219b741b0 msgr2=0x558219f4da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:43.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.560+0000 7fb5c2393740 1 --2- 172.21.15.5:0/1957529496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558219b741b0 0x558219f4da70 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fb5a4005f70 tx=0x7fb5a4041040 comp rx=0 tx=0).stop 2024-08-31T05:30:43.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.560+0000 7fb5c2393740 1 -- 172.21.15.5:0/1957529496 shutdown_connections 2024-08-31T05:30:43.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.560+0000 7fb5c2393740 1 --2- 172.21.15.5:0/1957529496 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x558219b5b9f0 0x558219f5fd10 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:43.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.560+0000 7fb5c2393740 1 --2- 172.21.15.5:0/1957529496 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558219b9d070 0x558219f59de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:43.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.560+0000 7fb5c2393740 1 --2- 172.21.15.5:0/1957529496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558219b7c390 0x558219f4dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:43.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.560+0000 7fb5c2393740 1 --2- 172.21.15.5:0/1957529496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558219b741b0 0x558219f4da70 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:43.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.560+0000 7fb5c2393740 1 -- 172.21.15.5:0/1957529496 >> 172.21.15.5:0/1957529496 conn(0x558219b91460 msgr2=0x558219f454a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:43.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.560+0000 7fb59d7fa640 0 client.15738 ms_handle_reset on v2:172.21.15.50:6836/428759669 2024-08-31T05:30:43.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.560+0000 7fb5c2393740 1 -- 172.21.15.5:0/1957529496 shutdown_connections 2024-08-31T05:30:43.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.560+0000 7fb5c2393740 1 -- 172.21.15.5:0/1957529496 wait complete. 2024-08-31T05:30:43.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.561+0000 7fb5c2393740 20 client.15738 trim_cache size 0 max 16384 2024-08-31T05:30:43.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.579+0000 7fb5c2393740 1 Processor -- start 2024-08-31T05:30:43.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.579+0000 7fb5c2393740 1 -- start start 2024-08-31T05:30:43.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.580+0000 7fb5c2393740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558219b741b0 0x558219f45b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:43.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.580+0000 7fb5c2393740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558219b7c390 0x558219f4ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:43.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.580+0000 7fb5c2393740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558219b9d070 0x558219f4b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:43.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.580+0000 7fb5c2393740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b41b0c00 con 0x558219b9d070 2024-08-31T05:30:43.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.580+0000 7fb5c2393740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b41b2740 con 0x558219b741b0 2024-08-31T05:30:43.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.580+0000 7fb5c2393740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b41b12d0 con 0x558219b7c390 2024-08-31T05:30:43.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.580+0000 7fb5b93b9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558219b9d070 0x558219f4b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:43.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.580+0000 7fb5b93b9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558219b9d070 0x558219f4b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56510/0 (socket says 172.21.15.5:56510) 2024-08-31T05:30:43.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.580+0000 7fb5b93b9640 1 -- 172.21.15.5:0/15859809 learned_addr learned my addr 172.21.15.5:0/15859809 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:43.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.580+0000 7fb5b93b9640 1 --2- 172.21.15.5:0/15859809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558219b741b0 0x558219f45b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:43.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.580+0000 7fb5b9bba640 1 --2- 172.21.15.5:0/15859809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558219b7c390 0x558219f4ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:43.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.581+0000 7fb5b93b9640 1 -- 172.21.15.5:0/15859809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558219b7c390 msgr2=0x558219f4ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:43.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.581+0000 7fb5b93b9640 1 --2- 172.21.15.5:0/15859809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558219b7c390 0x558219f4ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:43.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.581+0000 7fb5b93b9640 1 -- 172.21.15.5:0/15859809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558219b9d070 msgr2=0x558219f4b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:43.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.581+0000 7fb5b93b9640 1 --2- 172.21.15.5:0/15859809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558219b9d070 0x558219f4b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:43.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.581+0000 7fb5b93b9640 1 -- 172.21.15.5:0/15859809 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558219f44ba0 con 0x558219b741b0 2024-08-31T05:30:43.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.581+0000 7fb5b93b9640 1 --2- 172.21.15.5:0/15859809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558219b741b0 0x558219f45b20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb5a4001eb0 tx=0x7fb5a4000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b347b03901e8e090 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:43.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.581+0000 7fb59f7fe640 1 -- 172.21.15.5:0/15859809 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a405d070 con 0x558219b741b0 2024-08-31T05:30:43.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.581+0000 7fb59f7fe640 1 -- 172.21.15.5:0/15859809 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5a4004b70 con 0x558219b741b0 2024-08-31T05:30:43.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.581+0000 7fb59f7fe640 1 -- 172.21.15.5:0/15859809 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a4003d60 con 0x558219b741b0 2024-08-31T05:30:43.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.582+0000 7fb5c2393740 1 -- 172.21.15.5:0/15859809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558219b741b0 msgr2=0x558219f45b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:43.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.582+0000 7fb5c2393740 1 --2- 172.21.15.5:0/15859809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558219b741b0 0x558219f45b20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb5a4001eb0 tx=0x7fb5a4000bc0 comp rx=0 tx=0).stop 2024-08-31T05:30:43.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.582+0000 7fb5c2393740 1 -- 172.21.15.5:0/15859809 shutdown_connections 2024-08-31T05:30:43.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.582+0000 7fb5c2393740 1 --2- 172.21.15.5:0/15859809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558219b9d070 0x558219f4b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:43.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.582+0000 7fb5c2393740 1 --2- 172.21.15.5:0/15859809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558219b7c390 0x558219f4ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:43.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.582+0000 7fb5c2393740 1 --2- 172.21.15.5:0/15859809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558219b741b0 0x558219f45b20 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:43.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.582+0000 7fb5c2393740 1 -- 172.21.15.5:0/15859809 >> 172.21.15.5:0/15859809 conn(0x558219b91460 msgr2=0x558219f45410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:43.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.583+0000 7fb5c2393740 1 -- 172.21.15.5:0/15859809 shutdown_connections 2024-08-31T05:30:43.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.583+0000 7fb5c2393740 1 -- 172.21.15.5:0/15859809 wait complete. 2024-08-31T05:30:43.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.583+0000 7fb5c2393740 1 -- start start 2024-08-31T05:30:43.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.583+0000 7fb5c2393740 1 Processor -- start 2024-08-31T05:30:43.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.584+0000 7fb5c2393740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558219b741b0 0x558219f52850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:43.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.584+0000 7fb5c2393740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558219b7c390 0x558219f52df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:43.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.584+0000 7fb5c2393740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558219b9d070 0x558219fc37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:43.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.584+0000 7fb5c2393740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b41b2070 con 0x558219b7c390 2024-08-31T05:30:43.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.584+0000 7fb5c2393740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b41b19a0 con 0x558219b741b0 2024-08-31T05:30:43.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.584+0000 7fb5c2393740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b41aebe0 con 0x558219b9d070 2024-08-31T05:30:43.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.584+0000 7fb5c2393740 10 client.0 _ll_register_callbacks cb 0x7fb5a4009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:30:43.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.584+0000 7fb5b9bba640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558219b7c390 0x558219f52df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:43.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.584+0000 7fb5b9bba640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558219b7c390 0x558219f52df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56520/0 (socket says 172.21.15.5:56520) 2024-08-31T05:30:43.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.584+0000 7fb5b93b9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558219b9d070 0x558219fc37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:43.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.584+0000 7fb5b9bba640 1 -- 172.21.15.5:0/668662158 learned_addr learned my addr 172.21.15.5:0/668662158 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:43.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.584+0000 7fb5b93b9640 1 --2- 172.21.15.5:0/668662158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558219b741b0 0x558219f52850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:43.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.584+0000 7fb5b9bba640 1 -- 172.21.15.5:0/668662158 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558219b9d070 msgr2=0x558219fc37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:43.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.584+0000 7fb5b9bba640 1 --2- 172.21.15.5:0/668662158 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558219b9d070 0x558219fc37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:43.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.584+0000 7fb5b9bba640 1 -- 172.21.15.5:0/668662158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558219b741b0 msgr2=0x558219f52850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:43.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.584+0000 7fb5b9bba640 1 --2- 172.21.15.5:0/668662158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558219b741b0 0x558219f52850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:43.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.584+0000 7fb5b9bba640 1 -- 172.21.15.5:0/668662158 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558219fc3e30 con 0x558219b7c390 2024-08-31T05:30:43.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.585+0000 7fb5b9bba640 1 --2- 172.21.15.5:0/668662158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558219b7c390 0x558219f52df0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fb5b000bcb0 tx=0x7fb5b000b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ff202dc936dd74 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:43.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.585+0000 7fb59d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:30:43.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.585+0000 7fb59d7fa640 1 -- 172.21.15.5:0/668662158 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b0011440 con 0x558219b7c390 2024-08-31T05:30:43.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.585+0000 7fb59d7fa640 1 -- 172.21.15.5:0/668662158 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fb5b0005040 con 0x558219b7c390 2024-08-31T05:30:43.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.585+0000 7fb5c2393740 1 -- 172.21.15.5:0/668662158 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5a4004b70 con 0x558219b7c390 2024-08-31T05:30:43.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.586+0000 7fb59d7fa640 1 -- 172.21.15.5:0/668662158 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb5b0038050 con 0x558219b7c390 2024-08-31T05:30:43.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.586+0000 7fb5c2393740 10 client.15744 fetch_fsmap learned FSMap version 30 2024-08-31T05:30:43.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.586+0000 7fb5c2393740 1 -- 172.21.15.5:0/668662158 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x558219fcb220 con 0x558219b7c390 2024-08-31T05:30:43.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.586+0000 7fb59d7fa640 1 -- 172.21.15.5:0/668662158 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5a4004b70 con 0x558219b7c390 2024-08-31T05:30:43.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.586+0000 7fb59d7fa640 1 -- 172.21.15.5:0/668662158 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7fb5b00035f0 con 0x558219b7c390 2024-08-31T05:30:43.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.586+0000 7fb5c2393740 10 client.15744 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T05:30:43.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.586+0000 7fb5c2393740 10 client.15744 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-31T05:30:43.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.587+0000 7fb5c2393740 20 client.15744 populate_metadata read hostname 'smithi005' 2024-08-31T05:30:43.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.587+0000 7fb5c2393740 1 --2- 172.21.15.5:0/668662158 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x558219b30da0 0x558219fcd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:43.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.587+0000 7fb5c2393740 4 client.15744 mds_command: new command op to 24602 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:30:43.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.587+0000 7fb5c2393740 1 -- 172.21.15.5:0/668662158 --> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558219eb7070 con 0x558219b30da0 2024-08-31T05:30:43.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.587+0000 7fb5b93b9640 1 --2- 172.21.15.5:0/668662158 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x558219b30da0 0x558219fcd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:43.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.587+0000 7fb59d7fa640 10 client.15744 ms_handle_connect on v2:172.21.15.50:6836/428759669 2024-08-31T05:30:43.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.587+0000 7fb5b93b9640 1 --2- 172.21.15.5:0/668662158 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x558219b30da0 0x558219fcd6d0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=32bb655e8f0b6027 server_cookie=f75f945c6a90081e in_seq=0 out_seq=0 2024-08-31T05:30:43.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.588+0000 7fb59d7fa640 1 -- 172.21.15.5:0/668662158 <== mds.4 v2:172.21.15.50:6836/428759669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558219eb7070 con 0x558219b30da0 2024-08-31T05:30:43.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.588+0000 7fb59d7fa640 10 client.15744 handle_command_reply: tid=0 2024-08-31T05:30:43.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.588+0000 7fb5c2393740 1 client.15744 shutdown 2024-08-31T05:30:43.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.588+0000 7fb5c2393740 1 -- 172.21.15.5:0/668662158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558219b7c390 msgr2=0x558219f52df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:43.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.588+0000 7fb5c2393740 1 --2- 172.21.15.5:0/668662158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558219b7c390 0x558219f52df0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fb5b000bcb0 tx=0x7fb5b000b790 comp rx=0 tx=0).stop 2024-08-31T05:30:43.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.588+0000 7fb5c2393740 1 -- 172.21.15.5:0/668662158 shutdown_connections 2024-08-31T05:30:43.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.588+0000 7fb5c2393740 1 --2- 172.21.15.5:0/668662158 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x558219b30da0 0x558219fcd6d0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:43.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.588+0000 7fb5c2393740 1 --2- 172.21.15.5:0/668662158 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558219b9d070 0x558219fc37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:43.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.588+0000 7fb5c2393740 1 --2- 172.21.15.5:0/668662158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558219b7c390 0x558219f52df0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:43.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.588+0000 7fb5c2393740 1 --2- 172.21.15.5:0/668662158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558219b741b0 0x558219f52850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:43.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.588+0000 7fb59d7fa640 0 client.15744 ms_handle_reset on v2:172.21.15.50:6836/428759669 2024-08-31T05:30:43.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.588+0000 7fb5c2393740 1 -- 172.21.15.5:0/668662158 >> 172.21.15.5:0/668662158 conn(0x558219b91460 msgr2=0x558219f432d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:43.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.588+0000 7fb5c2393740 1 -- 172.21.15.5:0/668662158 shutdown_connections 2024-08-31T05:30:43.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.588+0000 7fb5c2393740 1 -- 172.21.15.5:0/668662158 wait complete. 2024-08-31T05:30:43.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.588+0000 7fb5c2393740 20 client.15744 trim_cache size 0 max 16384 2024-08-31T05:30:43.592 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:30:43.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.589+0000 7fb5bbe1e640 1 -- 172.21.15.5:0/3764261550 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb5a00b4d50 msgr2=0x7fb5a00b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:43.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.589+0000 7fb5bbe1e640 1 --2- 172.21.15.5:0/3764261550 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb5a00b4d50 0x7fb5a00b7260 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac0a9010 tx=0x7fb5ac093040 comp rx=0 tx=0).stop 2024-08-31T05:30:43.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.589+0000 7fb5bbe1e640 1 -- 172.21.15.5:0/3764261550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5b4108250 msgr2=0x7fb5b419bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:43.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.589+0000 7fb5bbe1e640 1 --2- 172.21.15.5:0/3764261550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5b4108250 0x7fb5b419bb00 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac00eaa0 tx=0x7fb5ac00ef60 comp rx=0 tx=0).stop 2024-08-31T05:30:43.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.589+0000 7fb5bbe1e640 1 -- 172.21.15.5:0/3764261550 shutdown_connections 2024-08-31T05:30:43.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.589+0000 7fb5bbe1e640 1 --2- 172.21.15.5:0/3764261550 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb5a00b4d50 0x7fb5a00b7260 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:43.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.589+0000 7fb5bbe1e640 1 --2- 172.21.15.5:0/3764261550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb5b4108250 0x7fb5b419bb00 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:43.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.589+0000 7fb5bbe1e640 1 --2- 172.21.15.5:0/3764261550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb5b4107900 0x7fb5b419b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:43.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.589+0000 7fb5bbe1e640 1 --2- 172.21.15.5:0/3764261550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb5b4102010 0x7fb5b419b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:43.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.589+0000 7fb5bbe1e640 1 -- 172.21.15.5:0/3764261550 >> 172.21.15.5:0/3764261550 conn(0x7fb5b4077a60 msgr2=0x7fb5b41059f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:43.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.589+0000 7fb5bbe1e640 1 -- 172.21.15.5:0/3764261550 shutdown_connections 2024-08-31T05:30:43.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:43.589+0000 7fb5bbe1e640 1 -- 172.21.15.5:0/3764261550 wait complete. 2024-08-31T05:30:44.443 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-31T05:30:44.721 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:30:45.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:45 smithi005 ceph-mon[18602]: pgmap v368: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-08-31T05:30:45.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.291+0000 7f32f3fc7640 1 -- 172.21.15.5:0/613219848 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32ec10dbb0 msgr2=0x7f32ec1100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:45.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.291+0000 7f32f3fc7640 1 --2- 172.21.15.5:0/613219848 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32ec10dbb0 0x7f32ec1100a0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f32e4009ca0 tx=0x7f32e402a8c0 comp rx=0 tx=0).stop 2024-08-31T05:30:45.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.291+0000 7f32f3fc7640 1 -- 172.21.15.5:0/613219848 shutdown_connections 2024-08-31T05:30:45.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.291+0000 7f32f3fc7640 1 --2- 172.21.15.5:0/613219848 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32ec10dbb0 0x7f32ec1100a0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:45.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.291+0000 7f32f3fc7640 1 --2- 172.21.15.5:0/613219848 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32ec1050a0 0x7f32ec10d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:45.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.291+0000 7f32f3fc7640 1 --2- 172.21.15.5:0/613219848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32ec104750 0x7f32ec104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:45.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.291+0000 7f32f3fc7640 1 -- 172.21.15.5:0/613219848 >> 172.21.15.5:0/613219848 conn(0x7f32ec0794d0 msgr2=0x7f32ec0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:45.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.292+0000 7f32f3fc7640 1 -- 172.21.15.5:0/613219848 shutdown_connections 2024-08-31T05:30:45.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.292+0000 7f32f3fc7640 1 -- 172.21.15.5:0/613219848 wait complete. 2024-08-31T05:30:45.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.293+0000 7f32f3fc7640 1 Processor -- start 2024-08-31T05:30:45.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.293+0000 7f32f3fc7640 1 -- start start 2024-08-31T05:30:45.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.293+0000 7f32f3fc7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32ec104750 0x7f32ec19a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:45.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.293+0000 7f32f3fc7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32ec1050a0 0x7f32ec19a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:45.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.293+0000 7f32f3fc7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32ec10dbb0 0x7f32ec19fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:45.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.293+0000 7f32f2564640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32ec10dbb0 0x7f32ec19fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:45.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.293+0000 7f32f2564640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32ec10dbb0 0x7f32ec19fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56544/0 (socket says 172.21.15.5:56544) 2024-08-31T05:30:45.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.293+0000 7f32f2564640 1 -- 172.21.15.5:0/624482607 learned_addr learned my addr 172.21.15.5:0/624482607 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:45.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.293+0000 7f32f3fc7640 1 -- 172.21.15.5:0/624482607 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f32ec113830 con 0x7f32ec10dbb0 2024-08-31T05:30:45.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.293+0000 7f32f3fc7640 1 -- 172.21.15.5:0/624482607 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f32ec1136b0 con 0x7f32ec104750 2024-08-31T05:30:45.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.293+0000 7f32f3fc7640 1 -- 172.21.15.5:0/624482607 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f32ec1139b0 con 0x7f32ec1050a0 2024-08-31T05:30:45.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.294+0000 7f32f1d63640 1 --2- 172.21.15.5:0/624482607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32ec104750 0x7f32ec19a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:45.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.294+0000 7f32f1562640 1 --2- 172.21.15.5:0/624482607 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32ec1050a0 0x7f32ec19a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:45.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.294+0000 7f32f2564640 1 -- 172.21.15.5:0/624482607 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32ec1050a0 msgr2=0x7f32ec19a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:45.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.294+0000 7f32f2564640 1 --2- 172.21.15.5:0/624482607 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32ec1050a0 0x7f32ec19a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:45.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.294+0000 7f32f2564640 1 -- 172.21.15.5:0/624482607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32ec104750 msgr2=0x7f32ec19a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:45.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.294+0000 7f32f2564640 1 --2- 172.21.15.5:0/624482607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32ec104750 0x7f32ec19a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:45.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.294+0000 7f32f2564640 1 -- 172.21.15.5:0/624482607 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32ec1a02b0 con 0x7f32ec10dbb0 2024-08-31T05:30:45.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.294+0000 7f32f2564640 1 --2- 172.21.15.5:0/624482607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32ec10dbb0 0x7f32ec19fb80 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f32e4005cc0 tx=0x7f32e4031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:45.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.295+0000 7f32e2ffd640 1 -- 172.21.15.5:0/624482607 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e4003b70 con 0x7f32ec10dbb0 2024-08-31T05:30:45.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.295+0000 7f32f3fc7640 1 -- 172.21.15.5:0/624482607 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32ec1a0540 con 0x7f32ec10dbb0 2024-08-31T05:30:45.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.295+0000 7f32e2ffd640 1 -- 172.21.15.5:0/624482607 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32e40318f0 con 0x7f32ec10dbb0 2024-08-31T05:30:45.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.295+0000 7f32f3fc7640 1 -- 172.21.15.5:0/624482607 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32ec1a6d00 con 0x7f32ec10dbb0 2024-08-31T05:30:45.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.295+0000 7f32e2ffd640 1 -- 172.21.15.5:0/624482607 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e402f950 con 0x7f32ec10dbb0 2024-08-31T05:30:45.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.298+0000 7f32e2ffd640 1 -- 172.21.15.5:0/624482607 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) ==== 152701+0+0 (secure 0 0 0) 0x7f32e402fbf0 con 0x7f32ec10dbb0 2024-08-31T05:30:45.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.298+0000 7f32fa53c740 1 Processor -- start 2024-08-31T05:30:45.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.299+0000 7f32fa53c740 1 -- start start 2024-08-31T05:30:45.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.299+0000 7f32fa53c740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d213573070 0x55d213918310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:45.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.299+0000 7f32fa53c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d21354a1b0 0x55d213918850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:45.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.299+0000 7f32fa53c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d213552390 0x55d213918d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:45.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.299+0000 7f32fa53c740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55d21388f680 con 0x55d213573070 2024-08-31T05:30:45.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.299+0000 7f32fa53c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d21387ec10 con 0x55d213552390 2024-08-31T05:30:45.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.299+0000 7f32fa53c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d213882bc0 con 0x55d21354a1b0 2024-08-31T05:30:45.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.299+0000 7f32e2ffd640 1 --2- 172.21.15.5:0/624482607 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f32d80b4d20 0x7f32d80b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:45.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.299+0000 7f32f1562640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d213573070 0x55d213918310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:45.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.299+0000 7f32f1562640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d213573070 0x55d213918310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56550/0 (socket says 172.21.15.5:56550) 2024-08-31T05:30:45.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.299+0000 7f32f1562640 1 -- 172.21.15.5:0/3948068082 learned_addr learned my addr 172.21.15.5:0/3948068082 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:45.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.300+0000 7f32f2564640 1 --2- 172.21.15.5:0/624482607 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f32d80b4d20 0x7f32d80b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:45.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.300+0000 7f32f1562640 1 -- 172.21.15.5:0/3948068082 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d21354a1b0 msgr2=0x55d213918850 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T05:30:45.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.300+0000 7f32f1562640 1 --2- 172.21.15.5:0/3948068082 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d21354a1b0 0x55d213918850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:45.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.300+0000 7f32f1562640 1 -- 172.21.15.5:0/3948068082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d213552390 msgr2=0x55d213918d90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T05:30:45.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.300+0000 7f32f1562640 1 --2- 172.21.15.5:0/3948068082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d213552390 0x55d213918d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:45.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.300+0000 7f32f1562640 1 -- 172.21.15.5:0/3948068082 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2135de650 con 0x55d213573070 2024-08-31T05:30:45.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.300+0000 7f32f1562640 1 --2- 172.21.15.5:0/3948068082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d213573070 0x55d213918310 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f32dc013bd0 tx=0x7f32dc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=665ebd4e92439571 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:45.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.300+0000 7f32e2ffd640 1 -- 172.21.15.5:0/624482607 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f32e41069f0 con 0x7f32ec10dbb0 2024-08-31T05:30:45.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.300+0000 7f32f2564640 1 --2- 172.21.15.5:0/624482607 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f32d80b4d20 0x7f32d80b7230 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f32e4005e30 tx=0x7f32e40095c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:45.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.301+0000 7f32d7fff640 1 -- 172.21.15.5:0/3948068082 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32dc021070 con 0x55d213573070 2024-08-31T05:30:45.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.301+0000 7f32d7fff640 1 -- 172.21.15.5:0/3948068082 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32dc009c80 con 0x55d213573070 2024-08-31T05:30:45.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.301+0000 7f32d7fff640 1 -- 172.21.15.5:0/3948068082 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32dc0035f0 con 0x55d213573070 2024-08-31T05:30:45.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.302+0000 7f32fa53c740 1 -- 172.21.15.5:0/3948068082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d213573070 msgr2=0x55d213918310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:45.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.302+0000 7f32fa53c740 1 --2- 172.21.15.5:0/3948068082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d213573070 0x55d213918310 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f32dc013bd0 tx=0x7f32dc009b50 comp rx=0 tx=0).stop 2024-08-31T05:30:45.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.302+0000 7f32fa53c740 1 -- 172.21.15.5:0/3948068082 shutdown_connections 2024-08-31T05:30:45.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.302+0000 7f32fa53c740 1 --2- 172.21.15.5:0/3948068082 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d213552390 0x55d213918d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:45.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.302+0000 7f32fa53c740 1 --2- 172.21.15.5:0/3948068082 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d21354a1b0 0x55d213918850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:45.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.302+0000 7f32fa53c740 1 --2- 172.21.15.5:0/3948068082 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d213573070 0x55d213918310 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:45.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.302+0000 7f32fa53c740 1 -- 172.21.15.5:0/3948068082 >> 172.21.15.5:0/3948068082 conn(0x55d213567460 msgr2=0x55d213916200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:45.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.302+0000 7f32fa53c740 1 -- 172.21.15.5:0/3948068082 shutdown_connections 2024-08-31T05:30:45.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.302+0000 7f32fa53c740 1 -- 172.21.15.5:0/3948068082 wait complete. 2024-08-31T05:30:45.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.303+0000 7f32fa53c740 1 -- start start 2024-08-31T05:30:45.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.303+0000 7f32fa53c740 1 Processor -- start 2024-08-31T05:30:45.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.303+0000 7f32fa53c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d21354a1b0 0x55d213923ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:45.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.303+0000 7f32fa53c740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d213552390 0x55d213924140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:45.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.304+0000 7f32f1d63640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d213552390 0x55d213924140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:45.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.304+0000 7f32f1d63640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d213552390 0x55d213924140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56564/0 (socket says 172.21.15.5:56564) 2024-08-31T05:30:45.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.304+0000 7f32f1d63640 1 -- 172.21.15.5:0/268683652 learned_addr learned my addr 172.21.15.5:0/268683652 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:45.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.304+0000 7f32fa53c740 1 --2- 172.21.15.5:0/268683652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d213573070 0x55d213938660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:45.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.304+0000 7f32f1562640 1 --2- 172.21.15.5:0/268683652 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d21354a1b0 0x55d213923ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:45.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.304+0000 7f32fa53c740 1 -- 172.21.15.5:0/268683652 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55d2136e1700 con 0x55d213552390 2024-08-31T05:30:45.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.304+0000 7f32fa53c740 1 -- 172.21.15.5:0/268683652 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d213805750 con 0x55d213573070 2024-08-31T05:30:45.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.304+0000 7f32fa53c740 1 -- 172.21.15.5:0/268683652 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d21392f270 con 0x55d21354a1b0 2024-08-31T05:30:45.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.304+0000 7f32fa53c740 10 client.0 _ll_register_callbacks cb 0x55d213834e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:30:45.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.304+0000 7f32f1562640 1 -- 172.21.15.5:0/268683652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d213573070 msgr2=0x55d213938660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:45.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.304+0000 7f32f1562640 1 --2- 172.21.15.5:0/268683652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d213573070 0x55d213938660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:45.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.304+0000 7f32f1562640 1 -- 172.21.15.5:0/268683652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d213552390 msgr2=0x55d213924140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:45.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.304+0000 7f32f1562640 1 --2- 172.21.15.5:0/268683652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d213552390 0x55d213924140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:45.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.304+0000 7f32f1562640 1 -- 172.21.15.5:0/268683652 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d21383e900 con 0x55d21354a1b0 2024-08-31T05:30:45.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.304+0000 7f32f1562640 1 --2- 172.21.15.5:0/268683652 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d21354a1b0 0x55d213923ba0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f32dc013ba0 tx=0x7f32dc009f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b9b840bcf870fe9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:45.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.304+0000 7f32d57fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:30:45.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.305+0000 7f32d57fa640 1 -- 172.21.15.5:0/268683652 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32dc021070 con 0x55d21354a1b0 2024-08-31T05:30:45.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.305+0000 7f32fa53c740 1 -- 172.21.15.5:0/268683652 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32dc009c80 con 0x55d21354a1b0 2024-08-31T05:30:45.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.305+0000 7f32d57fa640 1 -- 172.21.15.5:0/268683652 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f32dc0130b0 con 0x55d21354a1b0 2024-08-31T05:30:45.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.305+0000 7f32d57fa640 1 -- 172.21.15.5:0/268683652 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f32dc02f050 con 0x55d21354a1b0 2024-08-31T05:30:45.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.305+0000 7f32fa53c740 10 client.25411 fetch_fsmap learned FSMap version 30 2024-08-31T05:30:45.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.305+0000 7f32fa53c740 1 -- 172.21.15.5:0/268683652 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d21393b1b0 con 0x55d21354a1b0 2024-08-31T05:30:45.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.305+0000 7f32d57fa640 1 -- 172.21.15.5:0/268683652 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32dc009c80 con 0x55d21354a1b0 2024-08-31T05:30:45.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.306+0000 7f32d57fa640 1 -- 172.21.15.5:0/268683652 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f32dc0132b0 con 0x55d21354a1b0 2024-08-31T05:30:45.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.306+0000 7f32fa53c740 10 client.25411 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T05:30:45.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.306+0000 7f32fa53c740 10 client.25411 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-31T05:30:45.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.307+0000 7f32fa53c740 20 client.25411 populate_metadata read hostname 'smithi005' 2024-08-31T05:30:45.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.307+0000 7f32fa53c740 1 --2- 172.21.15.5:0/268683652 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x55d2135319f0 0x55d21393e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:45.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.307+0000 7f32fa53c740 4 client.25411 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:30:45.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.307+0000 7f32fa53c740 1 -- 172.21.15.5:0/268683652 --> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d2138915d0 con 0x55d2135319f0 2024-08-31T05:30:45.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.307+0000 7f32f1d63640 1 --2- 172.21.15.5:0/268683652 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x55d2135319f0 0x55d21393e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:45.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.307+0000 7f32f1d63640 1 --2- 172.21.15.5:0/268683652 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x55d2135319f0 0x55d21393e510 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8f7489b41a2948b9 server_cookie=888e7dd56396f7d5 in_seq=0 out_seq=0 2024-08-31T05:30:45.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.307+0000 7f32d57fa640 10 client.25411 ms_handle_connect on v2:172.21.15.70:6834/2061504114 2024-08-31T05:30:45.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.308+0000 7f32d57fa640 1 -- 172.21.15.5:0/268683652 <== mds.3 v2:172.21.15.70:6834/2061504114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d2138915d0 con 0x55d2135319f0 2024-08-31T05:30:45.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.308+0000 7f32d57fa640 10 client.25411 handle_command_reply: tid=0 2024-08-31T05:30:45.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.308+0000 7f32fa53c740 1 client.25411 shutdown 2024-08-31T05:30:45.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.308+0000 7f32fa53c740 1 -- 172.21.15.5:0/268683652 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d21354a1b0 msgr2=0x55d213923ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:45.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.308+0000 7f32fa53c740 1 --2- 172.21.15.5:0/268683652 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d21354a1b0 0x55d213923ba0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f32dc013ba0 tx=0x7f32dc009f70 comp rx=0 tx=0).stop 2024-08-31T05:30:45.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.309+0000 7f32fa53c740 1 -- 172.21.15.5:0/268683652 shutdown_connections 2024-08-31T05:30:45.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.309+0000 7f32fa53c740 1 --2- 172.21.15.5:0/268683652 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x55d2135319f0 0x55d21393e510 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:45.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.309+0000 7f32d57fa640 0 client.25411 ms_handle_reset on v2:172.21.15.70:6834/2061504114 2024-08-31T05:30:45.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.309+0000 7f32fa53c740 1 --2- 172.21.15.5:0/268683652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d213573070 0x55d213938660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:45.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.309+0000 7f32fa53c740 1 --2- 172.21.15.5:0/268683652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d213552390 0x55d213924140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:45.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.309+0000 7f32fa53c740 1 --2- 172.21.15.5:0/268683652 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d21354a1b0 0x55d213923ba0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:45.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.309+0000 7f32fa53c740 1 -- 172.21.15.5:0/268683652 >> 172.21.15.5:0/268683652 conn(0x55d213567460 msgr2=0x55d213919340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:45.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.309+0000 7f32fa53c740 1 -- 172.21.15.5:0/268683652 shutdown_connections 2024-08-31T05:30:45.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.309+0000 7f32fa53c740 1 -- 172.21.15.5:0/268683652 wait complete. 2024-08-31T05:30:45.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.309+0000 7f32fa53c740 20 client.25411 trim_cache size 0 max 16384 2024-08-31T05:30:45.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:45 smithi070 ceph-mon[22316]: pgmap v368: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-08-31T05:30:45.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.335+0000 7f32fa53c740 1 Processor -- start 2024-08-31T05:30:45.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.335+0000 7f32fa53c740 1 -- start start 2024-08-31T05:30:45.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.336+0000 7f32fa53c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d2135319f0 0x55d213916300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:45.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.336+0000 7f32fa53c740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d21354a1b0 0x55d213938610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:45.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.336+0000 7f32f1d63640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d21354a1b0 0x55d213938610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:45.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.336+0000 7f32f1d63640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d21354a1b0 0x55d213938610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56578/0 (socket says 172.21.15.5:56578) 2024-08-31T05:30:45.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.336+0000 7f32f1d63640 1 -- 172.21.15.5:0/4183981447 learned_addr learned my addr 172.21.15.5:0/4183981447 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:45.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.336+0000 7f32f1562640 1 --2- 172.21.15.5:0/4183981447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d2135319f0 0x55d213916300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:45.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.336+0000 7f32fa53c740 1 --2- 172.21.15.5:0/4183981447 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d213552390 0x55d213920dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:45.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.336+0000 7f32fa53c740 1 -- 172.21.15.5:0/4183981447 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f32d000ff30 con 0x55d21354a1b0 2024-08-31T05:30:45.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.336+0000 7f32fa53c740 1 -- 172.21.15.5:0/4183981447 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f32d0011a70 con 0x55d2135319f0 2024-08-31T05:30:45.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.336+0000 7f32fa53c740 1 -- 172.21.15.5:0/4183981447 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f32d0010600 con 0x55d213552390 2024-08-31T05:30:45.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.337+0000 7f32f1562640 1 -- 172.21.15.5:0/4183981447 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d213552390 msgr2=0x55d213920dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:45.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.337+0000 7f32f1562640 1 --2- 172.21.15.5:0/4183981447 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d213552390 0x55d213920dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:45.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.337+0000 7f32f1562640 1 -- 172.21.15.5:0/4183981447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d21354a1b0 msgr2=0x55d213938610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:45.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.337+0000 7f32f1562640 1 --2- 172.21.15.5:0/4183981447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d21354a1b0 0x55d213938610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:45.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.337+0000 7f32f1562640 1 -- 172.21.15.5:0/4183981447 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2139262e0 con 0x55d2135319f0 2024-08-31T05:30:45.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.337+0000 7f32f1d63640 1 --2- 172.21.15.5:0/4183981447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d21354a1b0 0x55d213938610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:30:45.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.337+0000 7f32f1562640 1 --2- 172.21.15.5:0/4183981447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d2135319f0 0x55d213916300 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f32dc0059f0 tx=0x7f32dc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=114d7236a1d53aa7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:45.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.337+0000 7f32d77fe640 1 -- 172.21.15.5:0/4183981447 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32dc021050 con 0x55d2135319f0 2024-08-31T05:30:45.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.337+0000 7f32d77fe640 1 -- 172.21.15.5:0/4183981447 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32dc009c80 con 0x55d2135319f0 2024-08-31T05:30:45.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.337+0000 7f32d77fe640 1 -- 172.21.15.5:0/4183981447 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32dc003da0 con 0x55d2135319f0 2024-08-31T05:30:45.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.338+0000 7f32fa53c740 1 -- 172.21.15.5:0/4183981447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d2135319f0 msgr2=0x55d213916300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:45.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.338+0000 7f32fa53c740 1 --2- 172.21.15.5:0/4183981447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d2135319f0 0x55d213916300 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f32dc0059f0 tx=0x7f32dc009b50 comp rx=0 tx=0).stop 2024-08-31T05:30:45.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.339+0000 7f32fa53c740 1 -- 172.21.15.5:0/4183981447 shutdown_connections 2024-08-31T05:30:45.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.339+0000 7f32fa53c740 1 --2- 172.21.15.5:0/4183981447 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d213552390 0x55d213920dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:45.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.339+0000 7f32fa53c740 1 --2- 172.21.15.5:0/4183981447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d21354a1b0 0x55d213938610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:45.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.339+0000 7f32fa53c740 1 --2- 172.21.15.5:0/4183981447 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d2135319f0 0x55d213916300 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:45.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.339+0000 7f32fa53c740 1 -- 172.21.15.5:0/4183981447 >> 172.21.15.5:0/4183981447 conn(0x55d213567460 msgr2=0x55d213915bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:45.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.339+0000 7f32fa53c740 1 -- 172.21.15.5:0/4183981447 shutdown_connections 2024-08-31T05:30:45.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.339+0000 7f32fa53c740 1 -- 172.21.15.5:0/4183981447 wait complete. 2024-08-31T05:30:45.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.339+0000 7f32fa53c740 1 -- start start 2024-08-31T05:30:45.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.339+0000 7f32fa53c740 1 Processor -- start 2024-08-31T05:30:45.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.340+0000 7f32fa53c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d2135319f0 0x55d2139201f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:45.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.340+0000 7f32fa53c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d21354a1b0 0x55d213920730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:45.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.340+0000 7f32fa53c740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d213552390 0x55d213920c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:45.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.340+0000 7f32fa53c740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f32d00113a0 con 0x55d213552390 2024-08-31T05:30:45.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.340+0000 7f32fa53c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f32d0010cd0 con 0x55d21354a1b0 2024-08-31T05:30:45.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.340+0000 7f32fa53c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f32d000df10 con 0x55d2135319f0 2024-08-31T05:30:45.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.340+0000 7f32fa53c740 10 client.0 _ll_register_callbacks cb 0x7f32dc01f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:30:45.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.340+0000 7f32f1562640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d2135319f0 0x55d2139201f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:45.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.341+0000 7f32f1562640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d2135319f0 0x55d2139201f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:43952/0 (socket says 172.21.15.5:43952) 2024-08-31T05:30:45.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.341+0000 7f32f1562640 1 -- 172.21.15.5:0/2113975407 learned_addr learned my addr 172.21.15.5:0/2113975407 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:45.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.341+0000 7f32f1d63640 1 --2- 172.21.15.5:0/2113975407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d21354a1b0 0x55d213920730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:45.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.341+0000 7f32f1562640 1 --2- 172.21.15.5:0/2113975407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d213552390 0x55d213920c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:45.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.341+0000 7f32f1d63640 1 -- 172.21.15.5:0/2113975407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d2135319f0 msgr2=0x55d2139201f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:45.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.341+0000 7f32f1d63640 1 --2- 172.21.15.5:0/2113975407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d2135319f0 0x55d2139201f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:45.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.341+0000 7f32f1d63640 1 -- 172.21.15.5:0/2113975407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d213552390 msgr2=0x55d213920c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:45.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.341+0000 7f32f1d63640 1 --2- 172.21.15.5:0/2113975407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d213552390 0x55d213920c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:45.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.341+0000 7f32f1d63640 1 -- 172.21.15.5:0/2113975407 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d213942700 con 0x55d21354a1b0 2024-08-31T05:30:45.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.341+0000 7f32f1562640 1 --2- 172.21.15.5:0/2113975407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d213552390 0x55d213920c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:30:45.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.341+0000 7f32f1d63640 1 --2- 172.21.15.5:0/2113975407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d21354a1b0 0x55d213920730 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x55d2139396a0 tx=0x7f32e80108c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b06a143e470897b7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:45.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.341+0000 7f32d57fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:30:45.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.342+0000 7f32d57fa640 1 -- 172.21.15.5:0/2113975407 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e80035f0 con 0x55d21354a1b0 2024-08-31T05:30:45.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.342+0000 7f32fa53c740 1 -- 172.21.15.5:0/2113975407 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32dc009c80 con 0x55d21354a1b0 2024-08-31T05:30:45.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.342+0000 7f32d57fa640 1 -- 172.21.15.5:0/2113975407 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f32e8003790 con 0x55d21354a1b0 2024-08-31T05:30:45.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.342+0000 7f32d57fa640 1 -- 172.21.15.5:0/2113975407 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f32e802f050 con 0x55d21354a1b0 2024-08-31T05:30:45.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.342+0000 7f32fa53c740 10 client.25382 fetch_fsmap learned FSMap version 30 2024-08-31T05:30:45.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.342+0000 7f32fa53c740 1 -- 172.21.15.5:0/2113975407 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d2139a91c0 con 0x55d21354a1b0 2024-08-31T05:30:45.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.342+0000 7f32d57fa640 1 -- 172.21.15.5:0/2113975407 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32dc009c80 con 0x55d21354a1b0 2024-08-31T05:30:45.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.344+0000 7f32d57fa640 1 -- 172.21.15.5:0/2113975407 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f32e8003990 con 0x55d21354a1b0 2024-08-31T05:30:45.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.344+0000 7f32fa53c740 10 client.25382 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T05:30:45.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.344+0000 7f32fa53c740 10 client.25382 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-31T05:30:45.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.344+0000 7f32fa53c740 20 client.25382 populate_metadata read hostname 'smithi005' 2024-08-31T05:30:45.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.344+0000 7f32fa53c740 1 --2- 172.21.15.5:0/2113975407 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x55d213573070 0x55d2139ab950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:45.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.344+0000 7f32fa53c740 4 client.25382 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:30:45.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.344+0000 7f32fa53c740 1 -- 172.21.15.5:0/2113975407 --> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d21388d070 con 0x55d213573070 2024-08-31T05:30:45.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.344+0000 7f32f1562640 1 --2- 172.21.15.5:0/2113975407 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x55d213573070 0x55d2139ab950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:45.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.345+0000 7f32f1562640 1 --2- 172.21.15.5:0/2113975407 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x55d213573070 0x55d2139ab950 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ecd7ef20f5ccc79e server_cookie=faa44b6c0619e473 in_seq=0 out_seq=0 2024-08-31T05:30:45.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.345+0000 7f32d57fa640 10 client.25382 ms_handle_connect on v2:172.21.15.70:6834/2061504114 2024-08-31T05:30:45.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.345+0000 7f32d57fa640 1 -- 172.21.15.5:0/2113975407 <== mds.3 v2:172.21.15.70:6834/2061504114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d21388d070 con 0x55d213573070 2024-08-31T05:30:45.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.345+0000 7f32d57fa640 10 client.25382 handle_command_reply: tid=0 2024-08-31T05:30:45.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.345+0000 7f32fa53c740 1 client.25382 shutdown 2024-08-31T05:30:45.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.345+0000 7f32fa53c740 1 -- 172.21.15.5:0/2113975407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d21354a1b0 msgr2=0x55d213920730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:45.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.345+0000 7f32fa53c740 1 --2- 172.21.15.5:0/2113975407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d21354a1b0 0x55d213920730 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x55d2139396a0 tx=0x7f32e80108c0 comp rx=0 tx=0).stop 2024-08-31T05:30:45.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.345+0000 7f32fa53c740 1 -- 172.21.15.5:0/2113975407 shutdown_connections 2024-08-31T05:30:45.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.345+0000 7f32fa53c740 1 --2- 172.21.15.5:0/2113975407 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x55d213573070 0x55d2139ab950 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:45.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.345+0000 7f32d57fa640 0 client.25382 ms_handle_reset on v2:172.21.15.70:6834/2061504114 2024-08-31T05:30:45.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.345+0000 7f32fa53c740 1 --2- 172.21.15.5:0/2113975407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d213552390 0x55d213920c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:45.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.345+0000 7f32fa53c740 1 --2- 172.21.15.5:0/2113975407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d21354a1b0 0x55d213920730 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:45.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.345+0000 7f32fa53c740 1 --2- 172.21.15.5:0/2113975407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d2135319f0 0x55d2139201f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:45.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.345+0000 7f32fa53c740 1 -- 172.21.15.5:0/2113975407 >> 172.21.15.5:0/2113975407 conn(0x55d213567460 msgr2=0x55d2139182f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:45.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.345+0000 7f32fa53c740 1 -- 172.21.15.5:0/2113975407 shutdown_connections 2024-08-31T05:30:45.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.345+0000 7f32fa53c740 1 -- 172.21.15.5:0/2113975407 wait complete. 2024-08-31T05:30:45.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.346+0000 7f32fa53c740 20 client.25382 trim_cache size 0 max 16384 2024-08-31T05:30:45.349 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:30:45.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.346+0000 7f32f3fc7640 1 -- 172.21.15.5:0/624482607 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f32d80b4d20 msgr2=0x7f32d80b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:45.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.346+0000 7f32f3fc7640 1 --2- 172.21.15.5:0/624482607 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f32d80b4d20 0x7f32d80b7230 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f32e4005e30 tx=0x7f32e40095c0 comp rx=0 tx=0).stop 2024-08-31T05:30:45.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.346+0000 7f32f3fc7640 1 -- 172.21.15.5:0/624482607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32ec10dbb0 msgr2=0x7f32ec19fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:45.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.346+0000 7f32f3fc7640 1 --2- 172.21.15.5:0/624482607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32ec10dbb0 0x7f32ec19fb80 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f32e4005cc0 tx=0x7f32e4031700 comp rx=0 tx=0).stop 2024-08-31T05:30:45.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.347+0000 7f32f3fc7640 1 -- 172.21.15.5:0/624482607 shutdown_connections 2024-08-31T05:30:45.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.347+0000 7f32f3fc7640 1 --2- 172.21.15.5:0/624482607 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f32d80b4d20 0x7f32d80b7230 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:45.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.347+0000 7f32f3fc7640 1 --2- 172.21.15.5:0/624482607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32ec10dbb0 0x7f32ec19fb80 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:45.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.347+0000 7f32f3fc7640 1 --2- 172.21.15.5:0/624482607 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f32ec1050a0 0x7f32ec19a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:45.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.347+0000 7f32f3fc7640 1 --2- 172.21.15.5:0/624482607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f32ec104750 0x7f32ec19a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:45.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.347+0000 7f32f3fc7640 1 -- 172.21.15.5:0/624482607 >> 172.21.15.5:0/624482607 conn(0x7f32ec0794d0 msgr2=0x7f32ec0ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:45.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.347+0000 7f32f3fc7640 1 -- 172.21.15.5:0/624482607 shutdown_connections 2024-08-31T05:30:45.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:45.347+0000 7f32f3fc7640 1 -- 172.21.15.5:0/624482607 wait complete. 2024-08-31T05:30:45.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:45 smithi050 ceph-mon[22146]: pgmap v368: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-08-31T05:30:46.166 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T05:30:46.445 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:30:46.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:46.996+0000 7fc61a9aa640 1 -- 172.21.15.5:0/1698115280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc614108140 msgr2=0x7fc614108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:46.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:46.996+0000 7fc61a9aa640 1 --2- 172.21.15.5:0/1698115280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc614108140 0x7fc614108550 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fc608009900 tx=0x7fc60802a410 comp rx=0 tx=0).stop 2024-08-31T05:30:46.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:46.996+0000 7fc61a9aa640 1 -- 172.21.15.5:0/1698115280 shutdown_connections 2024-08-31T05:30:46.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:46.997+0000 7fc61a9aa640 1 --2- 172.21.15.5:0/1698115280 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc614108a90 0x7fc61410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:46.997+0000 7fc61a9aa640 1 --2- 172.21.15.5:0/1698115280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc614108140 0x7fc614108550 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:46.997+0000 7fc61a9aa640 1 --2- 172.21.15.5:0/1698115280 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc614102800 0x7fc614102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:46.997+0000 7fc61a9aa640 1 -- 172.21.15.5:0/1698115280 >> 172.21.15.5:0/1698115280 conn(0x7fc6140794d0 msgr2=0x7fc6140798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:47.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:46.997+0000 7fc61a9aa640 1 -- 172.21.15.5:0/1698115280 shutdown_connections 2024-08-31T05:30:47.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:46.997+0000 7fc61a9aa640 1 -- 172.21.15.5:0/1698115280 wait complete. 2024-08-31T05:30:47.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:46.998+0000 7fc61a9aa640 1 Processor -- start 2024-08-31T05:30:47.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:46.998+0000 7fc61a9aa640 1 -- start start 2024-08-31T05:30:47.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:46.999+0000 7fc61a9aa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc614102800 0x7fc614199110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:47.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:46.999+0000 7fc61a9aa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc614108140 0x7fc6141996b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:47.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.000+0000 7fc61a9aa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc614108a90 0x7fc61419e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:47.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.000+0000 7fc613fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc614102800 0x7fc614199110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:47.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.000+0000 7fc613fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc614102800 0x7fc614199110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:43968/0 (socket says 172.21.15.5:43968) 2024-08-31T05:30:47.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.000+0000 7fc618f47640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc614108a90 0x7fc61419e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:47.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.000+0000 7fc618f47640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc614108a90 0x7fc61419e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56602/0 (socket says 172.21.15.5:56602) 2024-08-31T05:30:47.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.000+0000 7fc6137fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc614108140 0x7fc6141996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:47.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.000+0000 7fc6137fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc614108140 0x7fc6141996b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:42892/0 (socket says 172.21.15.5:42892) 2024-08-31T05:30:47.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.000+0000 7fc613fff640 1 -- 172.21.15.5:0/1053732544 learned_addr learned my addr 172.21.15.5:0/1053732544 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:47.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.000+0000 7fc61a9aa640 1 -- 172.21.15.5:0/1053732544 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc6141126c0 con 0x7fc614108a90 2024-08-31T05:30:47.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.000+0000 7fc61a9aa640 1 -- 172.21.15.5:0/1053732544 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc614112540 con 0x7fc614108140 2024-08-31T05:30:47.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.000+0000 7fc61a9aa640 1 -- 172.21.15.5:0/1053732544 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc614112840 con 0x7fc614102800 2024-08-31T05:30:47.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.001+0000 7fc613fff640 1 -- 172.21.15.5:0/1053732544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc614108140 msgr2=0x7fc6141996b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:47.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.001+0000 7fc613fff640 1 --2- 172.21.15.5:0/1053732544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc614108140 0x7fc6141996b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.001+0000 7fc613fff640 1 -- 172.21.15.5:0/1053732544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc614108a90 msgr2=0x7fc61419e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:47.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.001+0000 7fc613fff640 1 --2- 172.21.15.5:0/1053732544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc614108a90 0x7fc61419e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.001+0000 7fc613fff640 1 -- 172.21.15.5:0/1053732544 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc61419f080 con 0x7fc614102800 2024-08-31T05:30:47.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.001+0000 7fc6137fe640 1 --2- 172.21.15.5:0/1053732544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc614108140 0x7fc6141996b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:30:47.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.001+0000 7fc613fff640 1 --2- 172.21.15.5:0/1053732544 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc614102800 0x7fc614199110 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc6040092c0 tx=0x7fc604009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:47.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.001+0000 7fc6117fa640 1 -- 172.21.15.5:0/1053732544 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc604004220 con 0x7fc614102800 2024-08-31T05:30:47.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.002+0000 7fc61a9aa640 1 -- 172.21.15.5:0/1053732544 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc61419f370 con 0x7fc614102800 2024-08-31T05:30:47.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.002+0000 7fc61a9aa640 1 -- 172.21.15.5:0/1053732544 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc61406ac00 con 0x7fc614102800 2024-08-31T05:30:47.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.002+0000 7fc6117fa640 1 -- 172.21.15.5:0/1053732544 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6040043c0 con 0x7fc614102800 2024-08-31T05:30:47.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.002+0000 7fc6117fa640 1 -- 172.21.15.5:0/1053732544 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6040035f0 con 0x7fc614102800 2024-08-31T05:30:47.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.005+0000 7fc620f1f740 1 Processor -- start 2024-08-31T05:30:47.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.005+0000 7fc620f1f740 1 -- start start 2024-08-31T05:30:47.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.005+0000 7fc620f1f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f7b020d070 0x55f7b05b2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:47.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.005+0000 7fc620f1f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7b01e41b0 0x55f7b05b2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:47.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.005+0000 7fc620f1f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f7b01ec390 0x55f7b05b2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:47.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.006+0000 7fc620f1f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f7b0529680 con 0x55f7b01ec390 2024-08-31T05:30:47.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.006+0000 7fc620f1f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f7b0518c10 con 0x55f7b020d070 2024-08-31T05:30:47.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.006+0000 7fc620f1f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f7b051cbc0 con 0x55f7b01e41b0 2024-08-31T05:30:47.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.006+0000 7fc6137fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f7b01ec390 0x55f7b05b2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:47.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.006+0000 7fc6137fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f7b01ec390 0x55f7b05b2d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56604/0 (socket says 172.21.15.5:56604) 2024-08-31T05:30:47.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.006+0000 7fc6137fe640 1 -- 172.21.15.5:0/201872278 learned_addr learned my addr 172.21.15.5:0/201872278 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:47.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.006+0000 7fc618f47640 1 --2- 172.21.15.5:0/201872278 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f7b020d070 0x55f7b05b2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:47.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.006+0000 7fc6137fe640 1 -- 172.21.15.5:0/201872278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7b01e41b0 msgr2=0x55f7b05b2850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T05:30:47.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.006+0000 7fc6137fe640 1 --2- 172.21.15.5:0/201872278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7b01e41b0 0x55f7b05b2850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.006+0000 7fc6137fe640 1 -- 172.21.15.5:0/201872278 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f7b020d070 msgr2=0x55f7b05b2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:47.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.006+0000 7fc6137fe640 1 --2- 172.21.15.5:0/201872278 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f7b020d070 0x55f7b05b2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.006+0000 7fc6137fe640 1 -- 172.21.15.5:0/201872278 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7b0278650 con 0x55f7b01ec390 2024-08-31T05:30:47.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.006+0000 7fc6137fe640 1 --2- 172.21.15.5:0/201872278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f7b01ec390 0x55f7b05b2d90 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fc608009900 tx=0x7fc608032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7286bbb40d011bc0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:47.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.007+0000 7fc6117fa640 1 -- 172.21.15.5:0/1053732544 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 24) ==== 152701+0+0 (secure 0 0 0) 0x7fc6040046c0 con 0x7fc614102800 2024-08-31T05:30:47.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.007+0000 7fc5fa7fc640 1 -- 172.21.15.5:0/201872278 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc60803f070 con 0x55f7b01ec390 2024-08-31T05:30:47.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.007+0000 7fc5fa7fc640 1 -- 172.21.15.5:0/201872278 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6080316a0 con 0x55f7b01ec390 2024-08-31T05:30:47.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.007+0000 7fc5fa7fc640 1 -- 172.21.15.5:0/201872278 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc608035070 con 0x55f7b01ec390 2024-08-31T05:30:47.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.008+0000 7fc6117fa640 1 --2- 172.21.15.5:0/1053732544 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc5fc0b4d20 0x7fc5fc0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:47.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.008+0000 7fc6117fa640 1 -- 172.21.15.5:0/1053732544 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fc6040ed610 con 0x7fc614102800 2024-08-31T05:30:47.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.008+0000 7fc618f47640 1 --2- 172.21.15.5:0/1053732544 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc5fc0b4d20 0x7fc5fc0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:47.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.008+0000 7fc620f1f740 1 -- 172.21.15.5:0/201872278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f7b01ec390 msgr2=0x55f7b05b2d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:47.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.008+0000 7fc620f1f740 1 --2- 172.21.15.5:0/201872278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f7b01ec390 0x55f7b05b2d90 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fc608009900 tx=0x7fc608032ce0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.009+0000 7fc620f1f740 1 -- 172.21.15.5:0/201872278 shutdown_connections 2024-08-31T05:30:47.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.009+0000 7fc620f1f740 1 --2- 172.21.15.5:0/201872278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f7b01ec390 0x55f7b05b2d90 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.009+0000 7fc620f1f740 1 --2- 172.21.15.5:0/201872278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7b01e41b0 0x55f7b05b2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.009+0000 7fc620f1f740 1 --2- 172.21.15.5:0/201872278 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f7b020d070 0x55f7b05b2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.009+0000 7fc620f1f740 1 -- 172.21.15.5:0/201872278 >> 172.21.15.5:0/201872278 conn(0x55f7b0201460 msgr2=0x55f7b05b0200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:47.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.009+0000 7fc618f47640 1 --2- 172.21.15.5:0/1053732544 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc5fc0b4d20 0x7fc5fc0b7230 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc60c005fd0 tx=0x7fc60c009600 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:47.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.009+0000 7fc620f1f740 1 -- 172.21.15.5:0/201872278 shutdown_connections 2024-08-31T05:30:47.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.009+0000 7fc620f1f740 1 -- 172.21.15.5:0/201872278 wait complete. 2024-08-31T05:30:47.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.009+0000 7fc620f1f740 1 -- start start 2024-08-31T05:30:47.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.010+0000 7fc620f1f740 1 Processor -- start 2024-08-31T05:30:47.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.010+0000 7fc620f1f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f7b01e41b0 0x55f7b05bdb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:47.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.010+0000 7fc620f1f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f7b01ec390 0x55f7b05be050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:47.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.010+0000 7fc620f1f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7b020d070 0x55f7b05c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:47.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.010+0000 7fc613fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f7b01e41b0 0x55f7b05bdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:47.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.010+0000 7fc613fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f7b01e41b0 0x55f7b05bdb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56610/0 (socket says 172.21.15.5:56610) 2024-08-31T05:30:47.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.010+0000 7fc613fff640 1 -- 172.21.15.5:0/1424979958 learned_addr learned my addr 172.21.15.5:0/1424979958 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:47.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.010+0000 7fc620f1f740 1 -- 172.21.15.5:0/1424979958 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f7b037b700 con 0x55f7b01e41b0 2024-08-31T05:30:47.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.010+0000 7fc620f1f740 1 -- 172.21.15.5:0/1424979958 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f7b049f750 con 0x55f7b01ec390 2024-08-31T05:30:47.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.010+0000 7fc620f1f740 1 -- 172.21.15.5:0/1424979958 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f7b05c0a90 con 0x55f7b020d070 2024-08-31T05:30:47.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.011+0000 7fc6137fe640 1 --2- 172.21.15.5:0/1424979958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f7b01ec390 0x55f7b05be050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:47.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.011+0000 7fc620f1f740 10 client.0 _ll_register_callbacks cb 0x55f7b04cee10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:30:47.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.011+0000 7fc618f47640 1 --2- 172.21.15.5:0/1424979958 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7b020d070 0x55f7b05c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:47.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.011+0000 7fc613fff640 1 -- 172.21.15.5:0/1424979958 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7b020d070 msgr2=0x55f7b05c9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:47.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.011+0000 7fc613fff640 1 --2- 172.21.15.5:0/1424979958 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7b020d070 0x55f7b05c9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.011+0000 7fc613fff640 1 -- 172.21.15.5:0/1424979958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f7b01ec390 msgr2=0x55f7b05be050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:47.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.011+0000 7fc613fff640 1 --2- 172.21.15.5:0/1424979958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f7b01ec390 0x55f7b05be050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.011+0000 7fc613fff640 1 -- 172.21.15.5:0/1424979958 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7b04d8900 con 0x55f7b01e41b0 2024-08-31T05:30:47.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.011+0000 7fc6137fe640 1 --2- 172.21.15.5:0/1424979958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f7b01ec390 0x55f7b05be050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:30:47.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.011+0000 7fc618f47640 1 --2- 172.21.15.5:0/1424979958 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7b020d070 0x55f7b05c9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:30:47.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.011+0000 7fc620f1f740 1 -- 172.21.15.5:0/1424979958 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6080316a0 con 0x55f7b01e41b0 2024-08-31T05:30:47.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.011+0000 7fc613fff640 1 --2- 172.21.15.5:0/1424979958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f7b01e41b0 0x55f7b05bdb10 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc6040eafe0 tx=0x7fc6040af2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8369942803579de7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:47.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.011+0000 7fc5f37fe640 10 client.15774 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:30:47.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.011+0000 7fc5f37fe640 1 -- 172.21.15.5:0/1424979958 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc604025040 con 0x55f7b01e41b0 2024-08-31T05:30:47.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.012+0000 7fc5f37fe640 1 -- 172.21.15.5:0/1424979958 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fc6040afcc0 con 0x55f7b01e41b0 2024-08-31T05:30:47.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.012+0000 7fc5f37fe640 1 -- 172.21.15.5:0/1424979958 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc6040bcca0 con 0x55f7b01e41b0 2024-08-31T05:30:47.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.012+0000 7fc620f1f740 10 client.15774 fetch_fsmap learned FSMap version 30 2024-08-31T05:30:47.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.012+0000 7fc620f1f740 1 -- 172.21.15.5:0/1424979958 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55f7b05cc810 con 0x55f7b01e41b0 2024-08-31T05:30:47.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.012+0000 7fc5f37fe640 1 -- 172.21.15.5:0/1424979958 <== mon.0 v2:172.21.15.5:3300/0 4 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7fc6040ed240 con 0x55f7b01e41b0 2024-08-31T05:30:47.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.012+0000 7fc620f1f740 10 client.15774 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T05:30:47.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.012+0000 7fc620f1f740 10 client.15774 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-31T05:30:47.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.012+0000 7fc620f1f740 20 client.15774 populate_metadata read hostname 'smithi005' 2024-08-31T05:30:47.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.012+0000 7fc620f1f740 1 --2- 172.21.15.5:0/1424979958 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55f7b01cb9f0 0x55f7b05cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:47.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.012+0000 7fc620f1f740 4 client.15774 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:30:47.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.012+0000 7fc620f1f740 1 -- 172.21.15.5:0/1424979958 --> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f7b052b5d0 con 0x55f7b01cb9f0 2024-08-31T05:30:47.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.013+0000 7fc6137fe640 1 --2- 172.21.15.5:0/1424979958 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55f7b01cb9f0 0x55f7b05cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:47.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.013+0000 7fc6137fe640 1 --2- 172.21.15.5:0/1424979958 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55f7b01cb9f0 0x55f7b05cfcd0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=65479dab6c640635 server_cookie=8ff498084682ab2a in_seq=0 out_seq=0 2024-08-31T05:30:47.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.013+0000 7fc5f37fe640 10 client.15774 ms_handle_connect on v2:172.21.15.70:6836/2780036414 2024-08-31T05:30:47.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.014+0000 7fc5f37fe640 1 -- 172.21.15.5:0/1424979958 <== mds.2 v2:172.21.15.70:6836/2780036414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f7b052b5d0 con 0x55f7b01cb9f0 2024-08-31T05:30:47.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.014+0000 7fc5f37fe640 10 client.15774 handle_command_reply: tid=0 2024-08-31T05:30:47.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.014+0000 7fc620f1f740 1 client.15774 shutdown 2024-08-31T05:30:47.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.015+0000 7fc620f1f740 1 -- 172.21.15.5:0/1424979958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f7b01e41b0 msgr2=0x55f7b05bdb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:47.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.015+0000 7fc620f1f740 1 --2- 172.21.15.5:0/1424979958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f7b01e41b0 0x55f7b05bdb10 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc6040eafe0 tx=0x7fc6040af2b0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.015+0000 7fc620f1f740 1 -- 172.21.15.5:0/1424979958 shutdown_connections 2024-08-31T05:30:47.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.015+0000 7fc620f1f740 1 --2- 172.21.15.5:0/1424979958 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55f7b01cb9f0 0x55f7b05cfcd0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.015+0000 7fc5f37fe640 0 client.15774 ms_handle_reset on v2:172.21.15.70:6836/2780036414 2024-08-31T05:30:47.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.015+0000 7fc620f1f740 1 --2- 172.21.15.5:0/1424979958 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7b020d070 0x55f7b05c9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.015+0000 7fc620f1f740 1 --2- 172.21.15.5:0/1424979958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f7b01ec390 0x55f7b05be050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.015+0000 7fc620f1f740 1 --2- 172.21.15.5:0/1424979958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f7b01e41b0 0x55f7b05bdb10 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.015+0000 7fc620f1f740 1 -- 172.21.15.5:0/1424979958 >> 172.21.15.5:0/1424979958 conn(0x55f7b0201460 msgr2=0x55f7b05b54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:47.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.015+0000 7fc620f1f740 1 -- 172.21.15.5:0/1424979958 shutdown_connections 2024-08-31T05:30:47.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.015+0000 7fc620f1f740 1 -- 172.21.15.5:0/1424979958 wait complete. 2024-08-31T05:30:47.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.015+0000 7fc620f1f740 20 client.15774 trim_cache size 0 max 16384 2024-08-31T05:30:47.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.041+0000 7fc620f1f740 1 Processor -- start 2024-08-31T05:30:47.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.041+0000 7fc620f1f740 1 -- start start 2024-08-31T05:30:47.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.041+0000 7fc620f1f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f7b01cb9f0 0x55f7b05b5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:47.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.042+0000 7fc620f1f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7b01e41b0 0x55f7b05bad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:47.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.042+0000 7fc613fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f7b01cb9f0 0x55f7b05b5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:47.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.042+0000 7fc613fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f7b01cb9f0 0x55f7b05b5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56612/0 (socket says 172.21.15.5:56612) 2024-08-31T05:30:47.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.042+0000 7fc613fff640 1 -- 172.21.15.5:0/1663965405 learned_addr learned my addr 172.21.15.5:0/1663965405 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:47.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.042+0000 7fc620f1f740 1 --2- 172.21.15.5:0/1663965405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f7b01ec390 0x55f7b05bb240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:47.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.042+0000 7fc620f1f740 1 -- 172.21.15.5:0/1663965405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc60000fe10 con 0x55f7b01cb9f0 2024-08-31T05:30:47.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.042+0000 7fc620f1f740 1 -- 172.21.15.5:0/1663965405 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc600011950 con 0x55f7b01ec390 2024-08-31T05:30:47.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.042+0000 7fc620f1f740 1 -- 172.21.15.5:0/1663965405 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc6000104e0 con 0x55f7b01e41b0 2024-08-31T05:30:47.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.042+0000 7fc6137fe640 1 --2- 172.21.15.5:0/1663965405 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7b01e41b0 0x55f7b05bad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:47.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.042+0000 7fc618f47640 1 --2- 172.21.15.5:0/1663965405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f7b01ec390 0x55f7b05bb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:47.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.042+0000 7fc613fff640 1 -- 172.21.15.5:0/1663965405 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7b01e41b0 msgr2=0x55f7b05bad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:47.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.042+0000 7fc613fff640 1 --2- 172.21.15.5:0/1663965405 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7b01e41b0 0x55f7b05bad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.042+0000 7fc613fff640 1 -- 172.21.15.5:0/1663965405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f7b01ec390 msgr2=0x55f7b05bb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:47.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.042+0000 7fc613fff640 1 --2- 172.21.15.5:0/1663965405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f7b01ec390 0x55f7b05bb240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.042+0000 7fc613fff640 1 -- 172.21.15.5:0/1663965405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7b05bedd0 con 0x55f7b01cb9f0 2024-08-31T05:30:47.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.043+0000 7fc613fff640 1 --2- 172.21.15.5:0/1663965405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f7b01cb9f0 0x55f7b05b5b20 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc604005fd0 tx=0x7fc604022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa73eef098cadf0d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:47.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.043+0000 7fc5f9ffb640 1 -- 172.21.15.5:0/1663965405 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc604025040 con 0x55f7b01cb9f0 2024-08-31T05:30:47.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.043+0000 7fc5f9ffb640 1 -- 172.21.15.5:0/1663965405 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6080316a0 con 0x55f7b01cb9f0 2024-08-31T05:30:47.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.043+0000 7fc5f9ffb640 1 -- 172.21.15.5:0/1663965405 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6040ed370 con 0x55f7b01cb9f0 2024-08-31T05:30:47.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.044+0000 7fc620f1f740 1 -- 172.21.15.5:0/1663965405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f7b01cb9f0 msgr2=0x55f7b05b5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:47.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.044+0000 7fc620f1f740 1 --2- 172.21.15.5:0/1663965405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f7b01cb9f0 0x55f7b05b5b20 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc604005fd0 tx=0x7fc604022000 comp rx=0 tx=0).stop 2024-08-31T05:30:47.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.045+0000 7fc620f1f740 1 -- 172.21.15.5:0/1663965405 shutdown_connections 2024-08-31T05:30:47.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.045+0000 7fc620f1f740 1 --2- 172.21.15.5:0/1663965405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f7b01ec390 0x55f7b05bb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.045+0000 7fc620f1f740 1 --2- 172.21.15.5:0/1663965405 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7b01e41b0 0x55f7b05bad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.045+0000 7fc620f1f740 1 --2- 172.21.15.5:0/1663965405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f7b01cb9f0 0x55f7b05b5b20 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.045+0000 7fc620f1f740 1 -- 172.21.15.5:0/1663965405 >> 172.21.15.5:0/1663965405 conn(0x55f7b0201460 msgr2=0x55f7b05b5410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:47.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.045+0000 7fc620f1f740 1 -- 172.21.15.5:0/1663965405 shutdown_connections 2024-08-31T05:30:47.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.045+0000 7fc620f1f740 1 -- 172.21.15.5:0/1663965405 wait complete. 2024-08-31T05:30:47.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.045+0000 7fc620f1f740 1 -- start start 2024-08-31T05:30:47.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.045+0000 7fc620f1f740 1 Processor -- start 2024-08-31T05:30:47.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.046+0000 7fc620f1f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7b01cb9f0 0x55f7b05c6520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:47.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.046+0000 7fc620f1f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f7b01e41b0 0x55f7b05c29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:47.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.046+0000 7fc620f1f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f7b01ec390 0x55f7b05c2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:47.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.046+0000 7fc618f47640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f7b01ec390 0x55f7b05c2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:47.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.046+0000 7fc618f47640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f7b01ec390 0x55f7b05c2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56618/0 (socket says 172.21.15.5:56618) 2024-08-31T05:30:47.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.046+0000 7fc613fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7b01cb9f0 0x55f7b05c6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:47.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.046+0000 7fc618f47640 1 -- 172.21.15.5:0/3649858893 learned_addr learned my addr 172.21.15.5:0/3649858893 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:47.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.046+0000 7fc6137fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f7b01e41b0 0x55f7b05c29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:47.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.046+0000 7fc620f1f740 1 -- 172.21.15.5:0/3649858893 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc600011280 con 0x55f7b01ec390 2024-08-31T05:30:47.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.046+0000 7fc620f1f740 1 -- 172.21.15.5:0/3649858893 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc600010bb0 con 0x55f7b01e41b0 2024-08-31T05:30:47.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.046+0000 7fc620f1f740 1 -- 172.21.15.5:0/3649858893 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc60000ddf0 con 0x55f7b01cb9f0 2024-08-31T05:30:47.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.047+0000 7fc618f47640 1 -- 172.21.15.5:0/3649858893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7b01cb9f0 msgr2=0x55f7b05c6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:47.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.047+0000 7fc618f47640 1 --2- 172.21.15.5:0/3649858893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7b01cb9f0 0x55f7b05c6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.047+0000 7fc618f47640 1 -- 172.21.15.5:0/3649858893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f7b01e41b0 msgr2=0x55f7b05c29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:47.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.047+0000 7fc618f47640 1 --2- 172.21.15.5:0/3649858893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f7b01e41b0 0x55f7b05c29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.047+0000 7fc618f47640 1 -- 172.21.15.5:0/3649858893 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7b05c3690 con 0x55f7b01ec390 2024-08-31T05:30:47.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.047+0000 7fc620f1f740 10 client.0 _ll_register_callbacks cb 0x7fc604004570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:30:47.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.047+0000 7fc618f47640 1 --2- 172.21.15.5:0/3649858893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f7b01ec390 0x55f7b05c2f20 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc60c021b90 tx=0x7fc60c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b427271c1c57682 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:47.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.047+0000 7fc620f1f740 1 -- 172.21.15.5:0/3649858893 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6080316a0 con 0x55f7b01ec390 2024-08-31T05:30:47.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.047+0000 7fc5f37fe640 10 client.15780 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:30:47.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.048+0000 7fc5f37fe640 1 -- 172.21.15.5:0/3649858893 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc60c03e060 con 0x55f7b01ec390 2024-08-31T05:30:47.054 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:30:47.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.048+0000 7fc5f37fe640 1 -- 172.21.15.5:0/3649858893 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fc60c02dc90 con 0x55f7b01ec390 2024-08-31T05:30:47.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.048+0000 7fc5f37fe640 1 -- 172.21.15.5:0/3649858893 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc60c039430 con 0x55f7b01ec390 2024-08-31T05:30:47.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.048+0000 7fc6137fe640 1 --2- 172.21.15.5:0/3649858893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f7b01e41b0 0x55f7b05c29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:30:47.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.048+0000 7fc613fff640 1 --2- 172.21.15.5:0/3649858893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7b01cb9f0 0x55f7b05c6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:30:47.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.048+0000 7fc620f1f740 10 client.15780 fetch_fsmap learned FSMap version 30 2024-08-31T05:30:47.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.048+0000 7fc620f1f740 1 -- 172.21.15.5:0/3649858893 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55f7b064c580 con 0x55f7b01ec390 2024-08-31T05:30:47.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.048+0000 7fc5f37fe640 1 -- 172.21.15.5:0/3649858893 <== mon.0 v2:172.21.15.5:3300/0 4 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7fc60c038070 con 0x55f7b01ec390 2024-08-31T05:30:47.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.048+0000 7fc620f1f740 10 client.15780 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T05:30:47.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.048+0000 7fc620f1f740 10 client.15780 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-31T05:30:47.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.049+0000 7fc620f1f740 20 client.15780 populate_metadata read hostname 'smithi005' 2024-08-31T05:30:47.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.049+0000 7fc620f1f740 1 --2- 172.21.15.5:0/3649858893 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55f7b020d070 0x55f7b064ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:47.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.049+0000 7fc620f1f740 4 client.15780 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:30:47.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.049+0000 7fc620f1f740 1 -- 172.21.15.5:0/3649858893 --> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f7b0527070 con 0x55f7b020d070 2024-08-31T05:30:47.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.049+0000 7fc613fff640 1 --2- 172.21.15.5:0/3649858893 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55f7b020d070 0x55f7b064ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:47.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.049+0000 7fc613fff640 1 --2- 172.21.15.5:0/3649858893 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55f7b020d070 0x55f7b064ec40 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a264de600ef61b84 server_cookie=b9d6f646382c0fb2 in_seq=0 out_seq=0 2024-08-31T05:30:47.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.049+0000 7fc5f37fe640 10 client.15780 ms_handle_connect on v2:172.21.15.70:6836/2780036414 2024-08-31T05:30:47.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.049+0000 7fc5f37fe640 1 -- 172.21.15.5:0/3649858893 <== mds.2 v2:172.21.15.70:6836/2780036414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f7b0527070 con 0x55f7b020d070 2024-08-31T05:30:47.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.050+0000 7fc5f37fe640 10 client.15780 handle_command_reply: tid=0 2024-08-31T05:30:47.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.050+0000 7fc620f1f740 1 client.15780 shutdown 2024-08-31T05:30:47.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.050+0000 7fc620f1f740 1 -- 172.21.15.5:0/3649858893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f7b01ec390 msgr2=0x55f7b05c2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:47.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.050+0000 7fc620f1f740 1 --2- 172.21.15.5:0/3649858893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f7b01ec390 0x55f7b05c2f20 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc60c021b90 tx=0x7fc60c004a40 comp rx=0 tx=0).stop 2024-08-31T05:30:47.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.050+0000 7fc620f1f740 1 -- 172.21.15.5:0/3649858893 shutdown_connections 2024-08-31T05:30:47.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.050+0000 7fc620f1f740 1 --2- 172.21.15.5:0/3649858893 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55f7b020d070 0x55f7b064ec40 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.050+0000 7fc5f37fe640 0 client.15780 ms_handle_reset on v2:172.21.15.70:6836/2780036414 2024-08-31T05:30:47.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.050+0000 7fc620f1f740 1 --2- 172.21.15.5:0/3649858893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f7b01ec390 0x55f7b05c2f20 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.050+0000 7fc620f1f740 1 --2- 172.21.15.5:0/3649858893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f7b01e41b0 0x55f7b05c29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.050+0000 7fc620f1f740 1 --2- 172.21.15.5:0/3649858893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7b01cb9f0 0x55f7b05c6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.050+0000 7fc620f1f740 1 -- 172.21.15.5:0/3649858893 >> 172.21.15.5:0/3649858893 conn(0x55f7b0201460 msgr2=0x55f7b05b3340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:47.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.050+0000 7fc620f1f740 1 -- 172.21.15.5:0/3649858893 shutdown_connections 2024-08-31T05:30:47.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.050+0000 7fc620f1f740 1 -- 172.21.15.5:0/3649858893 wait complete. 2024-08-31T05:30:47.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.050+0000 7fc620f1f740 20 client.15780 trim_cache size 0 max 16384 2024-08-31T05:30:47.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.051+0000 7fc61a9aa640 1 -- 172.21.15.5:0/1053732544 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc5fc0b4d20 msgr2=0x7fc5fc0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:47.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.051+0000 7fc61a9aa640 1 --2- 172.21.15.5:0/1053732544 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc5fc0b4d20 0x7fc5fc0b7230 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc60c005fd0 tx=0x7fc60c009600 comp rx=0 tx=0).stop 2024-08-31T05:30:47.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.051+0000 7fc61a9aa640 1 -- 172.21.15.5:0/1053732544 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc614102800 msgr2=0x7fc614199110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:47.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.051+0000 7fc61a9aa640 1 --2- 172.21.15.5:0/1053732544 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc614102800 0x7fc614199110 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc6040092c0 tx=0x7fc604009780 comp rx=0 tx=0).stop 2024-08-31T05:30:47.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.051+0000 7fc61a9aa640 1 -- 172.21.15.5:0/1053732544 shutdown_connections 2024-08-31T05:30:47.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.051+0000 7fc61a9aa640 1 --2- 172.21.15.5:0/1053732544 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc5fc0b4d20 0x7fc5fc0b7230 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.051+0000 7fc61a9aa640 1 --2- 172.21.15.5:0/1053732544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc614108a90 0x7fc61419e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.051+0000 7fc61a9aa640 1 --2- 172.21.15.5:0/1053732544 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc614108140 0x7fc6141996b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.051+0000 7fc61a9aa640 1 --2- 172.21.15.5:0/1053732544 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc614102800 0x7fc614199110 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.051+0000 7fc61a9aa640 1 -- 172.21.15.5:0/1053732544 >> 172.21.15.5:0/1053732544 conn(0x7fc6140794d0 msgr2=0x7fc614105040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:47.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.051+0000 7fc61a9aa640 1 -- 172.21.15.5:0/1053732544 shutdown_connections 2024-08-31T05:30:47.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:47.052+0000 7fc61a9aa640 1 -- 172.21.15.5:0/1053732544 wait complete. 2024-08-31T05:30:47.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.138+0000 7ffac098b640 1 -- 172.21.15.5:0/262058900 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffabc1089e0 msgr2=0x7ffabc10f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:47.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.138+0000 7ffac098b640 1 --2- 172.21.15.5:0/262058900 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffabc1089e0 0x7ffabc10f210 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ffab4009ca0 tx=0x7ffab402a8c0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.138+0000 7ffac098b640 1 -- 172.21.15.5:0/262058900 shutdown_connections 2024-08-31T05:30:47.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.138+0000 7ffac098b640 1 --2- 172.21.15.5:0/262058900 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffabc1089e0 0x7ffabc10f210 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.138+0000 7ffac098b640 1 --2- 172.21.15.5:0/262058900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffabc108090 0x7ffabc1084a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.141 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.138+0000 7ffac098b640 1 --2- 172.21.15.5:0/262058900 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffabc102760 0x7ffabc102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.141 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.138+0000 7ffac098b640 1 -- 172.21.15.5:0/262058900 >> 172.21.15.5:0/262058900 conn(0x7ffabc0fe160 msgr2=0x7ffabc1005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:47.141 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.138+0000 7ffac098b640 1 -- 172.21.15.5:0/262058900 shutdown_connections 2024-08-31T05:30:47.141 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.138+0000 7ffac098b640 1 -- 172.21.15.5:0/262058900 wait complete. 2024-08-31T05:30:47.142 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.139+0000 7ffac098b640 1 Processor -- start 2024-08-31T05:30:47.142 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.139+0000 7ffac098b640 1 -- start start 2024-08-31T05:30:47.142 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.140+0000 7ffac098b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffabc102760 0x7ffabc19a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:47.142 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.140+0000 7ffac098b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffabc108090 0x7ffabc19a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.140+0000 7ffac098b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffabc1089e0 0x7ffabc19f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.140+0000 7ffac098b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ffabc1137c0 con 0x7ffabc108090 2024-08-31T05:30:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.140+0000 7ffac098b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ffabc113640 con 0x7ffabc102760 2024-08-31T05:30:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.140+0000 7ffac098b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ffabc113940 con 0x7ffabc1089e0 2024-08-31T05:30:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.140+0000 7ffab3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffabc108090 0x7ffabc19a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.140+0000 7ffabad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffabc1089e0 0x7ffabc19f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.140+0000 7ffaba59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffabc102760 0x7ffabc19a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.140+0000 7ffabad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffabc1089e0 0x7ffabc19f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:44024/0 (socket says 172.21.15.5:44024) 2024-08-31T05:30:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.140+0000 7ffabad9d640 1 -- 172.21.15.5:0/571870228 learned_addr learned my addr 172.21.15.5:0/571870228 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.140+0000 7ffabad9d640 1 -- 172.21.15.5:0/571870228 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffabc102760 msgr2=0x7ffabc19a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.140+0000 7ffabad9d640 1 --2- 172.21.15.5:0/571870228 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffabc102760 0x7ffabc19a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.140+0000 7ffabad9d640 1 -- 172.21.15.5:0/571870228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffabc108090 msgr2=0x7ffabc19a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.140+0000 7ffabad9d640 1 --2- 172.21.15.5:0/571870228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffabc108090 0x7ffabc19a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.144 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.140+0000 7ffabad9d640 1 -- 172.21.15.5:0/571870228 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffabc1a00b0 con 0x7ffabc1089e0 2024-08-31T05:30:47.144 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.140+0000 7ffab3fff640 1 --2- 172.21.15.5:0/571870228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffabc108090 0x7ffabc19a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:30:47.144 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.141+0000 7ffabad9d640 1 --2- 172.21.15.5:0/571870228 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffabc1089e0 0x7ffabc19f9b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ffab4005cc0 tx=0x7ffab4031700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:47.144 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.141+0000 7ffab37fe640 1 -- 172.21.15.5:0/571870228 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab4003b70 con 0x7ffabc1089e0 2024-08-31T05:30:47.144 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.141+0000 7ffab37fe640 1 -- 172.21.15.5:0/571870228 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffab40318f0 con 0x7ffabc1089e0 2024-08-31T05:30:47.145 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.141+0000 7ffab37fe640 1 -- 172.21.15.5:0/571870228 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab402f950 con 0x7ffabc1089e0 2024-08-31T05:30:47.145 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.141+0000 7ffac098b640 1 -- 172.21.15.5:0/571870228 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffabc1a0340 con 0x7ffabc1089e0 2024-08-31T05:30:47.145 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.141+0000 7ffac098b640 1 -- 172.21.15.5:0/571870228 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffabc1a6b30 con 0x7ffabc1089e0 2024-08-31T05:30:47.146 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.145+0000 7ffac79d7740 1 Processor -- start 2024-08-31T05:30:47.146 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.145+0000 7ffab37fe640 1 -- 172.21.15.5:0/571870228 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 24) ==== 152701+0+0 (secure 0 0 0) 0x7ffab402fb50 con 0x7ffabc1089e0 2024-08-31T05:30:47.148 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.145+0000 7ffac79d7740 1 -- start start 2024-08-31T05:30:47.148 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.145+0000 7ffac79d7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638416b11b0 0x563841a54ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:47.148 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.145+0000 7ffac79d7740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638416882f0 0x563841a55000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:47.148 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.145+0000 7ffac79d7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638416904d0 0x563841a55540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:47.148 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.145+0000 7ffac79d7740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5638419ca000 con 0x5638416882f0 2024-08-31T05:30:47.148 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.145+0000 7ffac79d7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5638419b9590 con 0x5638416904d0 2024-08-31T05:30:47.148 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.145+0000 7ffac79d7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5638419bd540 con 0x5638416b11b0 2024-08-31T05:30:47.148 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.146+0000 7ffaba59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638416882f0 0x563841a55000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:47.149 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.146+0000 7ffaba59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638416882f0 0x563841a55000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56658/0 (socket says 172.21.15.5:56658) 2024-08-31T05:30:47.149 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.146+0000 7ffaba59c640 1 -- 172.21.15.5:0/2012688843 learned_addr learned my addr 172.21.15.5:0/2012688843 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:47.149 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.146+0000 7ffab3fff640 1 --2- 172.21.15.5:0/2012688843 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638416b11b0 0x563841a54ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:47.149 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.146+0000 7ffab3fff640 1 --2- 172.21.15.5:0/2012688843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638416904d0 0x563841a55540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:47.149 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.146+0000 7ffaba59c640 1 -- 172.21.15.5:0/2012688843 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638416b11b0 msgr2=0x563841a54ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:47.149 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.146+0000 7ffaba59c640 1 --2- 172.21.15.5:0/2012688843 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638416b11b0 0x563841a54ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.149 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.146+0000 7ffaba59c640 1 -- 172.21.15.5:0/2012688843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638416904d0 msgr2=0x563841a55540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:47.149 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.146+0000 7ffaba59c640 1 --2- 172.21.15.5:0/2012688843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638416904d0 0x563841a55540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.149 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.146+0000 7ffaba59c640 1 -- 172.21.15.5:0/2012688843 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56384171c790 con 0x5638416882f0 2024-08-31T05:30:47.149 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.146+0000 7ffaba59c640 1 --2- 172.21.15.5:0/2012688843 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638416882f0 0x563841a55000 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7ffaac009d20 tx=0x7ffaac011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96af9bc2eb7a357a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:47.150 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.147+0000 7ffab0ff9640 1 -- 172.21.15.5:0/2012688843 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaac01e070 con 0x5638416882f0 2024-08-31T05:30:47.151 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.147+0000 7ffab0ff9640 1 -- 172.21.15.5:0/2012688843 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffaac009e10 con 0x5638416882f0 2024-08-31T05:30:47.151 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.147+0000 7ffab0ff9640 1 -- 172.21.15.5:0/2012688843 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaac018870 con 0x5638416882f0 2024-08-31T05:30:47.151 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.147+0000 7ffab37fe640 1 --2- 172.21.15.5:0/571870228 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ffaa80b4d20 0x7ffaa80b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:47.151 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.147+0000 7ffab3fff640 1 --2- 172.21.15.5:0/571870228 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ffaa80b4d20 0x7ffaa80b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:47.151 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.147+0000 7ffab37fe640 1 -- 172.21.15.5:0/571870228 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7ffab41069f0 con 0x7ffabc1089e0 2024-08-31T05:30:47.151 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.148+0000 7ffac79d7740 1 -- 172.21.15.5:0/2012688843 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638416882f0 msgr2=0x563841a55000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:47.151 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.148+0000 7ffab3fff640 1 --2- 172.21.15.5:0/571870228 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ffaa80b4d20 0x7ffaa80b7230 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ffaa40058c0 tx=0x7ffaa4005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:47.151 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.148+0000 7ffac79d7740 1 --2- 172.21.15.5:0/2012688843 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638416882f0 0x563841a55000 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7ffaac009d20 tx=0x7ffaac011810 comp rx=0 tx=0).stop 2024-08-31T05:30:47.151 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.148+0000 7ffac79d7740 1 -- 172.21.15.5:0/2012688843 shutdown_connections 2024-08-31T05:30:47.151 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.148+0000 7ffac79d7740 1 --2- 172.21.15.5:0/2012688843 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638416904d0 0x563841a55540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.151 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.148+0000 7ffac79d7740 1 --2- 172.21.15.5:0/2012688843 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638416882f0 0x563841a55000 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.151 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.148+0000 7ffac79d7740 1 --2- 172.21.15.5:0/2012688843 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638416b11b0 0x563841a54ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.152 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.148+0000 7ffac79d7740 1 -- 172.21.15.5:0/2012688843 >> 172.21.15.5:0/2012688843 conn(0x5638416a5300 msgr2=0x563841a529b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:47.152 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.149+0000 7ffac79d7740 1 -- 172.21.15.5:0/2012688843 shutdown_connections 2024-08-31T05:30:47.152 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.149+0000 7ffac79d7740 1 -- 172.21.15.5:0/2012688843 wait complete. 2024-08-31T05:30:47.154 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.149+0000 7ffac79d7740 1 -- start start 2024-08-31T05:30:47.155 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.149+0000 7ffac79d7740 1 Processor -- start 2024-08-31T05:30:47.155 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.150+0000 7ffac79d7740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638416882f0 0x563841a606a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:47.155 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.150+0000 7ffac79d7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638416904d0 0x563841a60be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:47.155 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.150+0000 7ffac79d7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638416b11b0 0x563841a6c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:47.155 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.151+0000 7ffaba59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638416882f0 0x563841a606a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:47.155 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.151+0000 7ffaba59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638416882f0 0x563841a606a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56660/0 (socket says 172.21.15.5:56660) 2024-08-31T05:30:47.155 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.151+0000 7ffab3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638416904d0 0x563841a60be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:47.155 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.151+0000 7ffab3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638416904d0 0x563841a60be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:42948/0 (socket says 172.21.15.5:42948) 2024-08-31T05:30:47.155 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.151+0000 7ffac79d7740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5638418f2ab0 con 0x5638416882f0 2024-08-31T05:30:47.155 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.151+0000 7ffac79d7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x563841940680 con 0x5638416904d0 2024-08-31T05:30:47.155 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.151+0000 7ffac79d7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563841a63240 con 0x5638416b11b0 2024-08-31T05:30:47.155 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.151+0000 7ffabad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638416b11b0 0x563841a6c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:47.155 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.151+0000 7ffabad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638416b11b0 0x563841a6c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:44046/0 (socket says 172.21.15.5:44046) 2024-08-31T05:30:47.156 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.151+0000 7ffabad9d640 1 -- 172.21.15.5:0/2490504896 learned_addr learned my addr 172.21.15.5:0/2490504896 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:47.156 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.151+0000 7ffac79d7740 10 client.0 _ll_register_callbacks cb 0x5638416c8a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:30:47.156 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.151+0000 7ffabad9d640 1 -- 172.21.15.5:0/2490504896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638416904d0 msgr2=0x563841a60be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:47.156 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.151+0000 7ffabad9d640 1 --2- 172.21.15.5:0/2490504896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638416904d0 0x563841a60be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.156 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.151+0000 7ffabad9d640 1 -- 172.21.15.5:0/2490504896 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638416882f0 msgr2=0x563841a606a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:47.156 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.151+0000 7ffabad9d640 1 --2- 172.21.15.5:0/2490504896 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638416882f0 0x563841a606a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.156 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.151+0000 7ffabad9d640 1 -- 172.21.15.5:0/2490504896 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563841795620 con 0x5638416b11b0 2024-08-31T05:30:47.156 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.151+0000 7ffab3fff640 1 --2- 172.21.15.5:0/2490504896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638416904d0 0x563841a60be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:30:47.156 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.151+0000 7ffaba59c640 1 --2- 172.21.15.5:0/2490504896 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638416882f0 0x563841a606a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:30:47.156 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.152+0000 7ffabad9d640 1 --2- 172.21.15.5:0/2490504896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638416b11b0 0x563841a6c560 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ffab40c8de0 tx=0x7ffab40cd520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d0dc121efd0a678 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:47.156 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.152+0000 7ffaa1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:30:47.156 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.152+0000 7ffaa1ffb640 1 -- 172.21.15.5:0/2490504896 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab40d6080 con 0x5638416b11b0 2024-08-31T05:30:47.156 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.152+0000 7ffaa1ffb640 1 -- 172.21.15.5:0/2490504896 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7ffab4104040 con 0x5638416b11b0 2024-08-31T05:30:47.156 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.152+0000 7ffac79d7740 1 -- 172.21.15.5:0/2490504896 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffaac009e10 con 0x5638416b11b0 2024-08-31T05:30:47.157 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.152+0000 7ffaa1ffb640 1 -- 172.21.15.5:0/2490504896 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ffab40c8ff0 con 0x5638416b11b0 2024-08-31T05:30:47.157 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.152+0000 7ffac79d7740 10 client.25435 fetch_fsmap learned FSMap version 30 2024-08-31T05:30:47.157 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.152+0000 7ffac79d7740 1 -- 172.21.15.5:0/2490504896 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563841a6f2b0 con 0x5638416b11b0 2024-08-31T05:30:47.157 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.152+0000 7ffaa1ffb640 1 -- 172.21.15.5:0/2490504896 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffab4036040 con 0x5638416b11b0 2024-08-31T05:30:47.157 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.152+0000 7ffaa1ffb640 1 -- 172.21.15.5:0/2490504896 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7ffab40ccfc0 con 0x5638416b11b0 2024-08-31T05:30:47.157 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.152+0000 7ffac79d7740 10 client.25435 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T05:30:47.157 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.152+0000 7ffac79d7740 10 client.25435 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:30:47.157 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.152+0000 7ffac79d7740 20 client.25435 populate_metadata read hostname 'smithi005' 2024-08-31T05:30:47.157 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.153+0000 7ffac79d7740 1 --2- 172.21.15.5:0/2490504896 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56384166fd80 0x563841a72850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:47.157 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.153+0000 7ffac79d7740 4 client.25435 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:30:47.157 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.153+0000 7ffac79d7740 1 -- 172.21.15.5:0/2490504896 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ffaac009e10 con 0x56384166fd80 2024-08-31T05:30:47.157 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.153+0000 7ffaba59c640 1 --2- 172.21.15.5:0/2490504896 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56384166fd80 0x563841a72850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:47.159 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.153+0000 7ffaa1ffb640 10 client.25435 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:30:47.159 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.153+0000 7ffaba59c640 1 --2- 172.21.15.5:0/2490504896 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56384166fd80 0x563841a72850 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c17e37eb051cc1e5 server_cookie=ed8f58e705f1ad96 in_seq=0 out_seq=0 2024-08-31T05:30:47.159 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.154+0000 7ffaa1ffb640 1 -- 172.21.15.5:0/2490504896 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7ffaac009e10 con 0x56384166fd80 2024-08-31T05:30:47.159 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.154+0000 7ffaa1ffb640 10 client.25435 handle_command_reply: tid=0 2024-08-31T05:30:47.159 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.154+0000 7ffac79d7740 1 client.25435 shutdown 2024-08-31T05:30:47.159 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.154+0000 7ffac79d7740 1 -- 172.21.15.5:0/2490504896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638416b11b0 msgr2=0x563841a6c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:47.159 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.154+0000 7ffac79d7740 1 --2- 172.21.15.5:0/2490504896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638416b11b0 0x563841a6c560 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ffab40c8de0 tx=0x7ffab40cd520 comp rx=0 tx=0).stop 2024-08-31T05:30:47.159 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.154+0000 7ffac79d7740 1 -- 172.21.15.5:0/2490504896 shutdown_connections 2024-08-31T05:30:47.159 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.154+0000 7ffac79d7740 1 --2- 172.21.15.5:0/2490504896 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56384166fd80 0x563841a72850 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.159 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.154+0000 7ffac79d7740 1 --2- 172.21.15.5:0/2490504896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638416b11b0 0x563841a6c560 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.159 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.154+0000 7ffac79d7740 1 --2- 172.21.15.5:0/2490504896 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638416904d0 0x563841a60be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.159 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.154+0000 7ffac79d7740 1 --2- 172.21.15.5:0/2490504896 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638416882f0 0x563841a606a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.159 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.154+0000 7ffac79d7740 1 -- 172.21.15.5:0/2490504896 >> 172.21.15.5:0/2490504896 conn(0x5638416a5300 msgr2=0x563841a55af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:47.160 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.154+0000 7ffaa1ffb640 0 client.25435 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:30:47.160 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.155+0000 7ffac79d7740 1 -- 172.21.15.5:0/2490504896 shutdown_connections 2024-08-31T05:30:47.160 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.155+0000 7ffac79d7740 1 -- 172.21.15.5:0/2490504896 wait complete. 2024-08-31T05:30:47.160 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.155+0000 7ffac79d7740 20 client.25435 trim_cache size 0 max 16384 2024-08-31T05:30:47.186 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.184+0000 7ffac79d7740 1 Processor -- start 2024-08-31T05:30:47.186 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.184+0000 7ffac79d7740 1 -- start start 2024-08-31T05:30:47.187 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.184+0000 7ffac79d7740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638416882f0 0x563841a5ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:47.187 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.184+0000 7ffac79d7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638416904d0 0x563841a5f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:47.187 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.184+0000 7ffac79d7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638416b11b0 0x563841a59b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:47.187 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.184+0000 7ffac79d7740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ffabc1b0bc0 con 0x5638416882f0 2024-08-31T05:30:47.187 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.184+0000 7ffac79d7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ffabc1b2700 con 0x5638416b11b0 2024-08-31T05:30:47.187 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.184+0000 7ffac79d7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ffabc1b1290 con 0x5638416904d0 2024-08-31T05:30:47.187 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.184+0000 7ffaba59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638416882f0 0x563841a5ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:47.187 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.184+0000 7ffaba59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638416882f0 0x563841a5ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56670/0 (socket says 172.21.15.5:56670) 2024-08-31T05:30:47.187 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.184+0000 7ffaba59c640 1 -- 172.21.15.5:0/2321752947 learned_addr learned my addr 172.21.15.5:0/2321752947 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:47.187 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.184+0000 7ffab3fff640 1 --2- 172.21.15.5:0/2321752947 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638416904d0 0x563841a5f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:47.187 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.184+0000 7ffabad9d640 1 --2- 172.21.15.5:0/2321752947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638416b11b0 0x563841a59b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:47.187 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.185+0000 7ffaba59c640 1 -- 172.21.15.5:0/2321752947 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638416904d0 msgr2=0x563841a5f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:47.188 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.185+0000 7ffaba59c640 1 --2- 172.21.15.5:0/2321752947 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638416904d0 0x563841a5f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.188 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.185+0000 7ffaba59c640 1 -- 172.21.15.5:0/2321752947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638416b11b0 msgr2=0x563841a59b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:47.188 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.185+0000 7ffaba59c640 1 --2- 172.21.15.5:0/2321752947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638416b11b0 0x563841a59b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.188 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.185+0000 7ffaba59c640 1 -- 172.21.15.5:0/2321752947 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563841a4c800 con 0x5638416882f0 2024-08-31T05:30:47.188 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.185+0000 7ffab3fff640 1 --2- 172.21.15.5:0/2321752947 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638416904d0 0x563841a5f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:30:47.188 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.185+0000 7ffaba59c640 1 --2- 172.21.15.5:0/2321752947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638416882f0 0x563841a5ecf0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x563841a53740 tx=0x7ffaac0183b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=603c0c5d8bb1167c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:47.189 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.185+0000 7ffaa3fff640 1 -- 172.21.15.5:0/2321752947 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaac01e040 con 0x5638416882f0 2024-08-31T05:30:47.189 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.185+0000 7ffaa3fff640 1 -- 172.21.15.5:0/2321752947 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffaac029030 con 0x5638416882f0 2024-08-31T05:30:47.189 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.185+0000 7ffaa3fff640 1 -- 172.21.15.5:0/2321752947 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaac004970 con 0x5638416882f0 2024-08-31T05:30:47.189 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.186+0000 7ffac79d7740 1 -- 172.21.15.5:0/2321752947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638416882f0 msgr2=0x563841a5ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:47.189 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.186+0000 7ffac79d7740 1 --2- 172.21.15.5:0/2321752947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638416882f0 0x563841a5ecf0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x563841a53740 tx=0x7ffaac0183b0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.189 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.186+0000 7ffac79d7740 1 -- 172.21.15.5:0/2321752947 shutdown_connections 2024-08-31T05:30:47.189 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.186+0000 7ffac79d7740 1 --2- 172.21.15.5:0/2321752947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638416b11b0 0x563841a59b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.189 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.186+0000 7ffac79d7740 1 --2- 172.21.15.5:0/2321752947 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638416904d0 0x563841a5f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.189 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.186+0000 7ffac79d7740 1 --2- 172.21.15.5:0/2321752947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638416882f0 0x563841a5ecf0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.189 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.186+0000 7ffac79d7740 1 -- 172.21.15.5:0/2321752947 >> 172.21.15.5:0/2321752947 conn(0x5638416a5300 msgr2=0x563841a5b590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:47.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.188+0000 7ffac79d7740 1 -- 172.21.15.5:0/2321752947 shutdown_connections 2024-08-31T05:30:47.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.188+0000 7ffac79d7740 1 -- 172.21.15.5:0/2321752947 wait complete. 2024-08-31T05:30:47.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.188+0000 7ffac79d7740 1 -- start start 2024-08-31T05:30:47.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.188+0000 7ffac79d7740 1 Processor -- start 2024-08-31T05:30:47.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.189+0000 7ffac79d7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638416882f0 0x563841a68ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:47.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.189+0000 7ffac79d7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638416904d0 0x563841a63fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:47.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.189+0000 7ffac79d7740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638416b11b0 0x563841a644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:47.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.189+0000 7ffac79d7740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ffabc1b2030 con 0x5638416b11b0 2024-08-31T05:30:47.192 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.189+0000 7ffaba59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638416882f0 0x563841a68ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:47.192 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.189+0000 7ffaba59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638416882f0 0x563841a68ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:44068/0 (socket says 172.21.15.5:44068) 2024-08-31T05:30:47.192 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.189+0000 7ffab3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638416904d0 0x563841a63fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:47.192 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.189+0000 7ffaba59c640 1 -- 172.21.15.5:0/2236756630 learned_addr learned my addr 172.21.15.5:0/2236756630 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:47.192 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.189+0000 7ffabad9d640 1 --2- 172.21.15.5:0/2236756630 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638416b11b0 0x563841a644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:47.192 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.189+0000 7ffac79d7740 1 -- 172.21.15.5:0/2236756630 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ffabc1b1960 con 0x5638416904d0 2024-08-31T05:30:47.192 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.189+0000 7ffac79d7740 1 -- 172.21.15.5:0/2236756630 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ffabc1aeba0 con 0x5638416882f0 2024-08-31T05:30:47.192 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.189+0000 7ffac79d7740 10 client.0 _ll_register_callbacks cb 0x7ffab4009920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:30:47.194 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.189+0000 7ffab3fff640 1 -- 172.21.15.5:0/2236756630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638416882f0 msgr2=0x563841a68ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:47.194 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.189+0000 7ffab3fff640 1 --2- 172.21.15.5:0/2236756630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638416882f0 0x563841a68ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.194 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.189+0000 7ffab3fff640 1 -- 172.21.15.5:0/2236756630 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638416b11b0 msgr2=0x563841a644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:47.194 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.189+0000 7ffab3fff640 1 --2- 172.21.15.5:0/2236756630 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638416b11b0 0x563841a644f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.194 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.189+0000 7ffab3fff640 1 -- 172.21.15.5:0/2236756630 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563841a64ab0 con 0x5638416904d0 2024-08-31T05:30:47.194 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.189+0000 7ffaba59c640 1 --2- 172.21.15.5:0/2236756630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638416882f0 0x563841a68ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:30:47.194 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.189+0000 7ffabad9d640 1 --2- 172.21.15.5:0/2236756630 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638416b11b0 0x563841a644f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:30:47.194 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.190+0000 7ffab3fff640 1 --2- 172.21.15.5:0/2236756630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638416904d0 0x563841a63fb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4011fd0 tx=0x7ffaa4005850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79246455a3dec75e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:47.194 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.190+0000 7ffaa1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:30:47.194 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.190+0000 7ffaa1ffb640 1 -- 172.21.15.5:0/2236756630 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa4020b70 con 0x5638416904d0 2024-08-31T05:30:47.194 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.190+0000 7ffac79d7740 1 -- 172.21.15.5:0/2236756630 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffaac029030 con 0x5638416904d0 2024-08-31T05:30:47.194 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.190+0000 7ffaa1ffb640 1 -- 172.21.15.5:0/2236756630 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7ffaa4020d10 con 0x5638416904d0 2024-08-31T05:30:47.195 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.190+0000 7ffaa1ffb640 1 -- 172.21.15.5:0/2236756630 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ffaa4038050 con 0x5638416904d0 2024-08-31T05:30:47.195 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.190+0000 7ffac79d7740 10 client.25415 fetch_fsmap learned FSMap version 30 2024-08-31T05:30:47.195 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.190+0000 7ffac79d7740 1 -- 172.21.15.5:0/2236756630 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563841adcfc0 con 0x5638416904d0 2024-08-31T05:30:47.195 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.191+0000 7ffaa1ffb640 1 -- 172.21.15.5:0/2236756630 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffaa402d910 con 0x5638416904d0 2024-08-31T05:30:47.195 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.192+0000 7ffaa1ffb640 1 -- 172.21.15.5:0/2236756630 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7ffaa401f4f0 con 0x5638416904d0 2024-08-31T05:30:47.195 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.192+0000 7ffac79d7740 10 client.25415 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T05:30:47.195 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.192+0000 7ffac79d7740 10 client.25415 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:30:47.195 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.192+0000 7ffac79d7740 20 client.25415 populate_metadata read hostname 'smithi005' 2024-08-31T05:30:47.195 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.192+0000 7ffac79d7740 1 --2- 172.21.15.5:0/2236756630 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5638416451c0 0x563841adf800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:47.195 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.192+0000 7ffac79d7740 4 client.25415 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:30:47.195 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.192+0000 7ffac79d7740 1 -- 172.21.15.5:0/2236756630 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7ffaac029030 con 0x5638416451c0 2024-08-31T05:30:47.195 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.192+0000 7ffaba59c640 1 --2- 172.21.15.5:0/2236756630 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5638416451c0 0x563841adf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:47.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.192+0000 7ffaa1ffb640 10 client.25415 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:30:47.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.192+0000 7ffaba59c640 1 --2- 172.21.15.5:0/2236756630 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5638416451c0 0x563841adf800 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0c5b4fcc4c68aa6 server_cookie=a2d12ce29a71952c in_seq=0 out_seq=0 2024-08-31T05:30:47.202 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.200+0000 7ffaa1ffb640 1 -- 172.21.15.5:0/2236756630 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7ffaac029030 con 0x5638416451c0 2024-08-31T05:30:47.202 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.200+0000 7ffaa1ffb640 10 client.25415 handle_command_reply: tid=0 2024-08-31T05:30:47.203 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.201+0000 7ffac79d7740 1 client.25415 shutdown 2024-08-31T05:30:47.203 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.201+0000 7ffac79d7740 1 -- 172.21.15.5:0/2236756630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638416904d0 msgr2=0x563841a63fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:47.203 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.201+0000 7ffac79d7740 1 --2- 172.21.15.5:0/2236756630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638416904d0 0x563841a63fb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4011fd0 tx=0x7ffaa4005850 comp rx=0 tx=0).stop 2024-08-31T05:30:47.203 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.201+0000 7ffac79d7740 1 -- 172.21.15.5:0/2236756630 shutdown_connections 2024-08-31T05:30:47.203 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.201+0000 7ffac79d7740 1 --2- 172.21.15.5:0/2236756630 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5638416451c0 0x563841adf800 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.203 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.201+0000 7ffac79d7740 1 --2- 172.21.15.5:0/2236756630 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5638416b11b0 0x563841a644f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.203 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.201+0000 7ffac79d7740 1 --2- 172.21.15.5:0/2236756630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5638416904d0 0x563841a63fb0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.204 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.201+0000 7ffac79d7740 1 --2- 172.21.15.5:0/2236756630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638416882f0 0x563841a68ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.204 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.201+0000 7ffac79d7740 1 -- 172.21.15.5:0/2236756630 >> 172.21.15.5:0/2236756630 conn(0x5638416a5300 msgr2=0x563841a59b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:47.204 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.201+0000 7ffaa1ffb640 0 client.25415 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:30:47.204 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.201+0000 7ffac79d7740 1 -- 172.21.15.5:0/2236756630 shutdown_connections 2024-08-31T05:30:47.204 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.201+0000 7ffac79d7740 1 -- 172.21.15.5:0/2236756630 wait complete. 2024-08-31T05:30:47.204 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.201+0000 7ffac79d7740 20 client.25415 trim_cache size 0 max 16384 2024-08-31T05:30:47.204 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:30:47.204 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:30:47.204 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:30:47.204 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:30:47.206 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.202+0000 7ffac098b640 1 -- 172.21.15.5:0/571870228 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ffaa80b4d20 msgr2=0x7ffaa80b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:47.206 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.202+0000 7ffac098b640 1 --2- 172.21.15.5:0/571870228 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ffaa80b4d20 0x7ffaa80b7230 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ffaa40058c0 tx=0x7ffaa4005f90 comp rx=0 tx=0).stop 2024-08-31T05:30:47.206 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.202+0000 7ffac098b640 1 -- 172.21.15.5:0/571870228 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffabc1089e0 msgr2=0x7ffabc19f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:47.206 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.202+0000 7ffac098b640 1 --2- 172.21.15.5:0/571870228 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffabc1089e0 0x7ffabc19f9b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ffab4005cc0 tx=0x7ffab4031700 comp rx=0 tx=0).stop 2024-08-31T05:30:47.206 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.202+0000 7ffac098b640 1 -- 172.21.15.5:0/571870228 shutdown_connections 2024-08-31T05:30:47.206 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.202+0000 7ffac098b640 1 --2- 172.21.15.5:0/571870228 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ffaa80b4d20 0x7ffaa80b7230 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.206 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.202+0000 7ffac098b640 1 --2- 172.21.15.5:0/571870228 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffabc1089e0 0x7ffabc19f9b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.206 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.202+0000 7ffac098b640 1 --2- 172.21.15.5:0/571870228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffabc108090 0x7ffabc19a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.206 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.202+0000 7ffac098b640 1 --2- 172.21.15.5:0/571870228 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffabc102760 0x7ffabc19a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:47.206 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.202+0000 7ffac098b640 1 -- 172.21.15.5:0/571870228 >> 172.21.15.5:0/571870228 conn(0x7ffabc0fe160 msgr2=0x7ffabc105600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:47.206 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.202+0000 7ffac098b640 1 -- 172.21.15.5:0/571870228 shutdown_connections 2024-08-31T05:30:47.207 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:30:47.203+0000 7ffac098b640 1 -- 172.21.15.5:0/571870228 wait complete. 2024-08-31T05:30:47.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:47 smithi005 ceph-mon[18602]: pgmap v369: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-08-31T05:30:47.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:47 smithi070 ceph-mon[22316]: pgmap v369: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-08-31T05:30:47.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:47 smithi050 ceph-mon[22146]: pgmap v369: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-08-31T05:30:47.796 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T05:30:48.185 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:30:48.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.751+0000 7f7f79617640 1 -- 172.21.15.5:0/384319395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f74108220 msgr2=0x7f7f7410ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:48.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.751+0000 7f7f79617640 1 --2- 172.21.15.5:0/384319395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f74108220 0x7f7f7410ea50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c009be0 tx=0x7f7f6c02a6c0 comp rx=0 tx=0).stop 2024-08-31T05:30:48.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.751+0000 7f7f79617640 1 -- 172.21.15.5:0/384319395 shutdown_connections 2024-08-31T05:30:48.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.751+0000 7f7f79617640 1 --2- 172.21.15.5:0/384319395 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f74108220 0x7f7f7410ea50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:48.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.751+0000 7f7f79617640 1 --2- 172.21.15.5:0/384319395 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f741078d0 0x7f7f74107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:48.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.751+0000 7f7f79617640 1 --2- 172.21.15.5:0/384319395 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f74101f90 0x7f7f741023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:48.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.751+0000 7f7f79617640 1 -- 172.21.15.5:0/384319395 >> 172.21.15.5:0/384319395 conn(0x7f7f74077a00 msgr2=0x7f7f74077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:48.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.751+0000 7f7f79617640 1 -- 172.21.15.5:0/384319395 shutdown_connections 2024-08-31T05:30:48.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.751+0000 7f7f79617640 1 -- 172.21.15.5:0/384319395 wait complete. 2024-08-31T05:30:48.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.753+0000 7f7f79617640 1 Processor -- start 2024-08-31T05:30:48.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.753+0000 7f7f79617640 1 -- start start 2024-08-31T05:30:48.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.753+0000 7f7f79617640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f74101f90 0x7f7f74197fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:48.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.753+0000 7f7f79617640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f741078d0 0x7f7f74198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:48.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.754+0000 7f7f79617640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f74108220 0x7f7f7419d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:48.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.754+0000 7f7f79617640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7f74111660 con 0x7f7f74101f90 2024-08-31T05:30:48.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.754+0000 7f7f72ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f74101f90 0x7f7f74197fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:48.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.754+0000 7f7f72ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f74101f90 0x7f7f74197fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56692/0 (socket says 172.21.15.5:56692) 2024-08-31T05:30:48.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.754+0000 7f7f72ffd640 1 -- 172.21.15.5:0/991935706 learned_addr learned my addr 172.21.15.5:0/991935706 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:48.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.754+0000 7f7f737fe640 1 --2- 172.21.15.5:0/991935706 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f74108220 0x7f7f7419d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:48.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.754+0000 7f7f6bfff640 1 --2- 172.21.15.5:0/991935706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f741078d0 0x7f7f74198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:48.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.754+0000 7f7f79617640 1 -- 172.21.15.5:0/991935706 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7f741114e0 con 0x7f7f74108220 2024-08-31T05:30:48.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.754+0000 7f7f79617640 1 -- 172.21.15.5:0/991935706 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7f741117e0 con 0x7f7f741078d0 2024-08-31T05:30:48.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.755+0000 7f7f72ffd640 1 -- 172.21.15.5:0/991935706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f741078d0 msgr2=0x7f7f74198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:48.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.755+0000 7f7f72ffd640 1 --2- 172.21.15.5:0/991935706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f741078d0 0x7f7f74198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:48.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.755+0000 7f7f72ffd640 1 -- 172.21.15.5:0/991935706 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f74108220 msgr2=0x7f7f7419d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:48.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.755+0000 7f7f72ffd640 1 --2- 172.21.15.5:0/991935706 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f74108220 0x7f7f7419d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:48.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.755+0000 7f7f72ffd640 1 -- 172.21.15.5:0/991935706 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f7419df40 con 0x7f7f74101f90 2024-08-31T05:30:48.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.755+0000 7f7f6bfff640 1 --2- 172.21.15.5:0/991935706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f741078d0 0x7f7f74198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:30:48.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.755+0000 7f7f72ffd640 1 --2- 172.21.15.5:0/991935706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f74101f90 0x7f7f74197fd0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f7f6400e9f0 tx=0x7f7f6400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:48.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.755+0000 7f7f70ff9640 1 -- 172.21.15.5:0/991935706 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f6400cd80 con 0x7f7f74101f90 2024-08-31T05:30:48.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.755+0000 7f7f70ff9640 1 -- 172.21.15.5:0/991935706 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f640054d0 con 0x7f7f74101f90 2024-08-31T05:30:48.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.755+0000 7f7f70ff9640 1 -- 172.21.15.5:0/991935706 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f64010690 con 0x7f7f74101f90 2024-08-31T05:30:48.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.756+0000 7f7f79617640 1 -- 172.21.15.5:0/991935706 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f7419e230 con 0x7f7f74101f90 2024-08-31T05:30:48.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.756+0000 7f7f79617640 1 -- 172.21.15.5:0/991935706 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f741a4990 con 0x7f7f74101f90 2024-08-31T05:30:48.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.759+0000 7f7f7fb8c740 1 Processor -- start 2024-08-31T05:30:48.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.759+0000 7f7f7fb8c740 1 -- start start 2024-08-31T05:30:48.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.760+0000 7f7f7fb8c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba97711070 0x55ba97abeb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:48.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.760+0000 7f7f7fb8c740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba976e81b0 0x55ba97abf060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:48.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.760+0000 7f7f7fb8c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba976f0390 0x55ba97abf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:48.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.760+0000 7f7f7fb8c740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55ba97a2d680 con 0x55ba976e81b0 2024-08-31T05:30:48.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.760+0000 7f7f7fb8c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ba97a1cc10 con 0x55ba976f0390 2024-08-31T05:30:48.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.760+0000 7f7f7fb8c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ba97a20bc0 con 0x55ba97711070 2024-08-31T05:30:48.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.760+0000 7f7f737fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba97711070 0x55ba97abeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:48.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.760+0000 7f7f6bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba976f0390 0x55ba97abf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:48.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.760+0000 7f7f737fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba97711070 0x55ba97abeb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:44092/0 (socket says 172.21.15.5:44092) 2024-08-31T05:30:48.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.760+0000 7f7f737fe640 1 -- 172.21.15.5:0/395533689 learned_addr learned my addr 172.21.15.5:0/395533689 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:48.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.761+0000 7f7f70ff9640 1 -- 172.21.15.5:0/991935706 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) ==== 152701+0+0 (secure 0 0 0) 0x7f7f64004e90 con 0x7f7f74101f90 2024-08-31T05:30:48.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.761+0000 7f7f737fe640 1 -- 172.21.15.5:0/395533689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba976f0390 msgr2=0x55ba97abf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:48.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.761+0000 7f7f737fe640 1 --2- 172.21.15.5:0/395533689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba976f0390 0x55ba97abf5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:48.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.761+0000 7f7f737fe640 1 -- 172.21.15.5:0/395533689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba976e81b0 msgr2=0x55ba97abf060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:48.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.761+0000 7f7f72ffd640 1 --2- 172.21.15.5:0/395533689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba976e81b0 0x55ba97abf060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:48.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.761+0000 7f7f737fe640 1 --2- 172.21.15.5:0/395533689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba976e81b0 0x55ba97abf060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:48.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.761+0000 7f7f737fe640 1 -- 172.21.15.5:0/395533689 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba9777c650 con 0x55ba97711070 2024-08-31T05:30:48.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.761+0000 7f7f72ffd640 1 --2- 172.21.15.5:0/395533689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba976e81b0 0x55ba97abf060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:30:48.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.762+0000 7f7f737fe640 1 --2- 172.21.15.5:0/395533689 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba97711070 0x55ba97abeb20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c009be0 tx=0x7f7f6c005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=488c7e3b5d35ff11 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:48.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.762+0000 7f7f697fa640 1 -- 172.21.15.5:0/395533689 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c047070 con 0x55ba97711070 2024-08-31T05:30:48.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.762+0000 7f7f697fa640 1 -- 172.21.15.5:0/395533689 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f6c003e20 con 0x55ba97711070 2024-08-31T05:30:48.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.762+0000 7f7f70ff9640 1 --2- 172.21.15.5:0/991935706 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f7f600b4da0 0x7f7f600b72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:48.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.763+0000 7f7f697fa640 1 -- 172.21.15.5:0/395533689 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c036040 con 0x55ba97711070 2024-08-31T05:30:48.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.763+0000 7f7f70ff9640 1 -- 172.21.15.5:0/991935706 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f7f640e5d00 con 0x7f7f74101f90 2024-08-31T05:30:48.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.763+0000 7f7f72ffd640 1 --2- 172.21.15.5:0/991935706 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f7f600b4da0 0x7f7f600b72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:48.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.763+0000 7f7f7fb8c740 1 -- 172.21.15.5:0/395533689 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba97711070 msgr2=0x55ba97abeb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:48.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.763+0000 7f7f7fb8c740 1 --2- 172.21.15.5:0/395533689 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba97711070 0x55ba97abeb20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c009be0 tx=0x7f7f6c005fd0 comp rx=0 tx=0).stop 2024-08-31T05:30:48.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.763+0000 7f7f72ffd640 1 --2- 172.21.15.5:0/991935706 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f7f600b4da0 0x7f7f600b72b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x55ba97abd7a0 tx=0x7f7f640aba70 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:48.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.764+0000 7f7f7fb8c740 1 -- 172.21.15.5:0/395533689 shutdown_connections 2024-08-31T05:30:48.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.764+0000 7f7f7fb8c740 1 --2- 172.21.15.5:0/395533689 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba976f0390 0x55ba97abf5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:48.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.764+0000 7f7f7fb8c740 1 --2- 172.21.15.5:0/395533689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba976e81b0 0x55ba97abf060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:48.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.764+0000 7f7f7fb8c740 1 --2- 172.21.15.5:0/395533689 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba97711070 0x55ba97abeb20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:48.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.764+0000 7f7f7fb8c740 1 -- 172.21.15.5:0/395533689 >> 172.21.15.5:0/395533689 conn(0x55ba97705460 msgr2=0x55ba97abca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:48.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.764+0000 7f7f7fb8c740 1 -- 172.21.15.5:0/395533689 shutdown_connections 2024-08-31T05:30:48.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.764+0000 7f7f7fb8c740 1 -- 172.21.15.5:0/395533689 wait complete. 2024-08-31T05:30:48.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.765+0000 7f7f7fb8c740 1 -- start start 2024-08-31T05:30:48.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.765+0000 7f7f7fb8c740 1 Processor -- start 2024-08-31T05:30:48.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.766+0000 7f7f7fb8c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba976e81b0 0x55ba97aca220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:48.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.766+0000 7f7f7fb8c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba976f0390 0x55ba97aca760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:48.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.766+0000 7f7f7fb8c740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba97711070 0x55ba97ad66b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:48.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.766+0000 7f7f737fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba976e81b0 0x55ba97aca220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:48.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.766+0000 7f7f737fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba976e81b0 0x55ba97aca220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:44100/0 (socket says 172.21.15.5:44100) 2024-08-31T05:30:48.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.766+0000 7f7f6bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba976f0390 0x55ba97aca760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:48.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.766+0000 7f7f6bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba976f0390 0x55ba97aca760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:43004/0 (socket says 172.21.15.5:43004) 2024-08-31T05:30:48.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.766+0000 7f7f737fe640 1 -- 172.21.15.5:0/3780064602 learned_addr learned my addr 172.21.15.5:0/3780064602 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:48.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.766+0000 7f7f7fb8c740 1 -- 172.21.15.5:0/3780064602 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55ba9787f700 con 0x55ba97711070 2024-08-31T05:30:48.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.766+0000 7f7f7fb8c740 1 -- 172.21.15.5:0/3780064602 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ba979a3750 con 0x55ba976f0390 2024-08-31T05:30:48.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.766+0000 7f7f7fb8c740 1 -- 172.21.15.5:0/3780064602 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ba97acd340 con 0x55ba976e81b0 2024-08-31T05:30:48.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.767+0000 7f7f737fe640 1 --2- 172.21.15.5:0/3780064602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba97711070 0x55ba97ad66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:48.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.768+0000 7f7f6bfff640 1 -- 172.21.15.5:0/3780064602 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba976e81b0 msgr2=0x55ba97aca220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:48.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.768+0000 7f7f6bfff640 1 --2- 172.21.15.5:0/3780064602 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba976e81b0 0x55ba97aca220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:48.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.768+0000 7f7f6bfff640 1 -- 172.21.15.5:0/3780064602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba97711070 msgr2=0x55ba97ad66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:48.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.768+0000 7f7f7fb8c740 10 client.0 _ll_register_callbacks cb 0x55ba979d2e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:30:48.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.768+0000 7f7f6bfff640 1 --2- 172.21.15.5:0/3780064602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba97711070 0x55ba97ad66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:48.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.768+0000 7f7f6bfff640 1 -- 172.21.15.5:0/3780064602 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba979dc900 con 0x55ba976f0390 2024-08-31T05:30:48.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.768+0000 7f7f7fb8c740 1 -- 172.21.15.5:0/3780064602 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f6c003e20 con 0x55ba976f0390 2024-08-31T05:30:48.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.768+0000 7f7f737fe640 1 --2- 172.21.15.5:0/3780064602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba97711070 0x55ba97ad66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:30:48.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.768+0000 7f7f6bfff640 1 --2- 172.21.15.5:0/3780064602 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba976f0390 0x55ba97aca760 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c00a640 tx=0x7f7f5c00c7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8b4e34d549c524 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:48.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.768+0000 7f7f5a7fc640 10 client.25427 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:30:48.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.768+0000 7f7f5a7fc640 1 -- 172.21.15.5:0/3780064602 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c0047a0 con 0x55ba976f0390 2024-08-31T05:30:48.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.769+0000 7f7f5a7fc640 1 -- 172.21.15.5:0/3780064602 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f7f5c004940 con 0x55ba976f0390 2024-08-31T05:30:48.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.769+0000 7f7f5a7fc640 1 -- 172.21.15.5:0/3780064602 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7f5c004b80 con 0x55ba976f0390 2024-08-31T05:30:48.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.769+0000 7f7f7fb8c740 10 client.25427 fetch_fsmap learned FSMap version 30 2024-08-31T05:30:48.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.769+0000 7f7f7fb8c740 1 -- 172.21.15.5:0/3780064602 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55ba97ad9010 con 0x55ba976f0390 2024-08-31T05:30:48.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.769+0000 7f7f5a7fc640 1 -- 172.21.15.5:0/3780064602 <== mon.2 v2:172.21.15.50:3300/0 4 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f7f5c018070 con 0x55ba976f0390 2024-08-31T05:30:48.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.769+0000 7f7f7fb8c740 10 client.25427 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T05:30:48.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.769+0000 7f7f7fb8c740 10 client.25427 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-31T05:30:48.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.769+0000 7f7f7fb8c740 20 client.25427 populate_metadata read hostname 'smithi005' 2024-08-31T05:30:48.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.769+0000 7f7f7fb8c740 1 --2- 172.21.15.5:0/3780064602 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55ba976cf9f0 0x55ba97adc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:48.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.769+0000 7f7f7fb8c740 4 client.25427 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:30:48.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.769+0000 7f7f7fb8c740 1 -- 172.21.15.5:0/3780064602 --> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ba97a2f5d0 con 0x55ba976cf9f0 2024-08-31T05:30:48.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.770+0000 7f7f737fe640 1 --2- 172.21.15.5:0/3780064602 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55ba976cf9f0 0x55ba97adc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:48.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.771+0000 7f7f737fe640 1 --2- 172.21.15.5:0/3780064602 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55ba976cf9f0 0x55ba97adc950 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2932fdb90096c3e server_cookie=1b115633321fa2ce in_seq=0 out_seq=0 2024-08-31T05:30:48.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.771+0000 7f7f5a7fc640 10 client.25427 ms_handle_connect on v2:172.21.15.50:6838/98200944 2024-08-31T05:30:48.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.771+0000 7f7f5a7fc640 1 -- 172.21.15.5:0/3780064602 <== mds.1 v2:172.21.15.50:6838/98200944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ba97a2f5d0 con 0x55ba976cf9f0 2024-08-31T05:30:48.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.771+0000 7f7f5a7fc640 10 client.25427 handle_command_reply: tid=0 2024-08-31T05:30:48.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.771+0000 7f7f7fb8c740 1 client.25427 shutdown 2024-08-31T05:30:48.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.772+0000 7f7f7fb8c740 1 -- 172.21.15.5:0/3780064602 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba976f0390 msgr2=0x55ba97aca760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:48.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.772+0000 7f7f7fb8c740 1 --2- 172.21.15.5:0/3780064602 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba976f0390 0x55ba97aca760 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c00a640 tx=0x7f7f5c00c7a0 comp rx=0 tx=0).stop 2024-08-31T05:30:48.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.772+0000 7f7f7fb8c740 1 -- 172.21.15.5:0/3780064602 shutdown_connections 2024-08-31T05:30:48.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.772+0000 7f7f7fb8c740 1 --2- 172.21.15.5:0/3780064602 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55ba976cf9f0 0x55ba97adc950 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:48.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.772+0000 7f7f5a7fc640 0 client.25427 ms_handle_reset on v2:172.21.15.50:6838/98200944 2024-08-31T05:30:48.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.772+0000 7f7f7fb8c740 1 --2- 172.21.15.5:0/3780064602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba97711070 0x55ba97ad66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:48.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.772+0000 7f7f7fb8c740 1 --2- 172.21.15.5:0/3780064602 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba976f0390 0x55ba97aca760 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:48.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.772+0000 7f7f7fb8c740 1 --2- 172.21.15.5:0/3780064602 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba976e81b0 0x55ba97aca220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:48.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.772+0000 7f7f7fb8c740 1 -- 172.21.15.5:0/3780064602 >> 172.21.15.5:0/3780064602 conn(0x55ba97705460 msgr2=0x55ba97ac1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:48.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.772+0000 7f7f7fb8c740 1 -- 172.21.15.5:0/3780064602 shutdown_connections 2024-08-31T05:30:48.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.772+0000 7f7f7fb8c740 1 -- 172.21.15.5:0/3780064602 wait complete. 2024-08-31T05:30:48.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.772+0000 7f7f7fb8c740 20 client.25427 trim_cache size 0 max 16384 2024-08-31T05:30:48.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.799+0000 7f7f7fb8c740 1 Processor -- start 2024-08-31T05:30:48.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.799+0000 7f7f7fb8c740 1 -- start start 2024-08-31T05:30:48.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.799+0000 7f7f7fb8c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba976e81b0 0x55ba97ad65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:48.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.799+0000 7f7f7fb8c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba976f0390 0x55ba97ac7410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:48.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.799+0000 7f7f7fb8c740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba97711070 0x55ba97ac7950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:48.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.799+0000 7f7f7fb8c740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7f741aea10 con 0x55ba97711070 2024-08-31T05:30:48.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.799+0000 7f7f7fb8c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7f741b0550 con 0x55ba976e81b0 2024-08-31T05:30:48.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.799+0000 7f7f7fb8c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7f741af0e0 con 0x55ba976f0390 2024-08-31T05:30:48.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.800+0000 7f7f737fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba97711070 0x55ba97ac7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:48.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.800+0000 7f7f737fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba97711070 0x55ba97ac7950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56708/0 (socket says 172.21.15.5:56708) 2024-08-31T05:30:48.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.800+0000 7f7f737fe640 1 -- 172.21.15.5:0/3199382893 learned_addr learned my addr 172.21.15.5:0/3199382893 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:48.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.800+0000 7f7f737fe640 1 --2- 172.21.15.5:0/3199382893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba976e81b0 0x55ba97ad65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:48.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.800+0000 7f7f6bfff640 1 --2- 172.21.15.5:0/3199382893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba976f0390 0x55ba97ac7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:48.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.800+0000 7f7f737fe640 1 -- 172.21.15.5:0/3199382893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba976f0390 msgr2=0x55ba97ac7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:48.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.800+0000 7f7f737fe640 1 --2- 172.21.15.5:0/3199382893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba976f0390 0x55ba97ac7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:48.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.800+0000 7f7f737fe640 1 -- 172.21.15.5:0/3199382893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba976e81b0 msgr2=0x55ba97ad65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:48.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.800+0000 7f7f737fe640 1 --2- 172.21.15.5:0/3199382893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba976e81b0 0x55ba97ad65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:48.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.800+0000 7f7f737fe640 1 -- 172.21.15.5:0/3199382893 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba97a53460 con 0x55ba97711070 2024-08-31T05:30:48.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.800+0000 7f7f6bfff640 1 --2- 172.21.15.5:0/3199382893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba976f0390 0x55ba97ac7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:30:48.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.801+0000 7f7f737fe640 1 --2- 172.21.15.5:0/3199382893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba97711070 0x55ba97ac7950 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c004af0 tx=0x7f7f6c033040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25b3d74eed2a53cf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:48.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.801+0000 7f7f68ff9640 1 -- 172.21.15.5:0/3199382893 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c036040 con 0x55ba97711070 2024-08-31T05:30:48.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.801+0000 7f7f68ff9640 1 -- 172.21.15.5:0/3199382893 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f6c030ad0 con 0x55ba97711070 2024-08-31T05:30:48.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.801+0000 7f7f68ff9640 1 -- 172.21.15.5:0/3199382893 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c047040 con 0x55ba97711070 2024-08-31T05:30:48.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.802+0000 7f7f7fb8c740 1 -- 172.21.15.5:0/3199382893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba97711070 msgr2=0x55ba97ac7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:48.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.802+0000 7f7f7fb8c740 1 --2- 172.21.15.5:0/3199382893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba97711070 0x55ba97ac7950 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c004af0 tx=0x7f7f6c033040 comp rx=0 tx=0).stop 2024-08-31T05:30:48.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.803+0000 7f7f7fb8c740 1 -- 172.21.15.5:0/3199382893 shutdown_connections 2024-08-31T05:30:48.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.803+0000 7f7f7fb8c740 1 --2- 172.21.15.5:0/3199382893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba97711070 0x55ba97ac7950 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:48.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.803+0000 7f7f7fb8c740 1 --2- 172.21.15.5:0/3199382893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba976f0390 0x55ba97ac7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:48.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.803+0000 7f7f7fb8c740 1 --2- 172.21.15.5:0/3199382893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba976e81b0 0x55ba97ad65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:48.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.803+0000 7f7f7fb8c740 1 -- 172.21.15.5:0/3199382893 >> 172.21.15.5:0/3199382893 conn(0x55ba97705460 msgr2=0x55ba97ac8aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:48.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.803+0000 7f7f7fb8c740 1 -- 172.21.15.5:0/3199382893 shutdown_connections 2024-08-31T05:30:48.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.803+0000 7f7f7fb8c740 1 -- 172.21.15.5:0/3199382893 wait complete. 2024-08-31T05:30:48.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.803+0000 7f7f7fb8c740 1 -- start start 2024-08-31T05:30:48.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.803+0000 7f7f7fb8c740 1 Processor -- start 2024-08-31T05:30:48.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.804+0000 7f7f7fb8c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba976e81b0 0x55ba97acee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:48.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.804+0000 7f7f7fb8c740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba976f0390 0x55ba97acf380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:48.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.804+0000 7f7f6bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba976f0390 0x55ba97acf380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:48.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.804+0000 7f7f6bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba976f0390 0x55ba97acf380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56720/0 (socket says 172.21.15.5:56720) 2024-08-31T05:30:48.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.804+0000 7f7f6bfff640 1 -- 172.21.15.5:0/3534113710 learned_addr learned my addr 172.21.15.5:0/3534113710 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:48.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.804+0000 7f7f7fb8c740 1 --2- 172.21.15.5:0/3534113710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba97711070 0x55ba97b46160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:48.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.804+0000 7f7f7fb8c740 1 -- 172.21.15.5:0/3534113710 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7f741afe80 con 0x55ba976f0390 2024-08-31T05:30:48.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.804+0000 7f7f7fb8c740 1 -- 172.21.15.5:0/3534113710 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7f741af7b0 con 0x55ba97711070 2024-08-31T05:30:48.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.804+0000 7f7f7fb8c740 1 -- 172.21.15.5:0/3534113710 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7f741ac9f0 con 0x55ba976e81b0 2024-08-31T05:30:48.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.804+0000 7f7f737fe640 1 --2- 172.21.15.5:0/3534113710 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba976e81b0 0x55ba97acee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:48.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.804+0000 7f7f7fb8c740 10 client.0 _ll_register_callbacks cb 0x7f7f5c00ad50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:30:48.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.805+0000 7f7f737fe640 1 --2- 172.21.15.5:0/3534113710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba97711070 0x55ba97b46160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:48.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.805+0000 7f7f6bfff640 1 -- 172.21.15.5:0/3534113710 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba976e81b0 msgr2=0x55ba97acee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:48.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.805+0000 7f7f6bfff640 1 --2- 172.21.15.5:0/3534113710 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba976e81b0 0x55ba97acee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:48.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.805+0000 7f7f6bfff640 1 -- 172.21.15.5:0/3534113710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba97711070 msgr2=0x55ba97b46160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:48.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.805+0000 7f7f6bfff640 1 --2- 172.21.15.5:0/3534113710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba97711070 0x55ba97b46160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:48.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.805+0000 7f7f6bfff640 1 -- 172.21.15.5:0/3534113710 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba97b46770 con 0x55ba976f0390 2024-08-31T05:30:48.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.805+0000 7f7f737fe640 1 --2- 172.21.15.5:0/3534113710 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba976e81b0 0x55ba97acee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:30:48.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.805+0000 7f7f6bfff640 1 --2- 172.21.15.5:0/3534113710 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba976f0390 0x55ba97acf380 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c00ea30 tx=0x7f7f5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb4510dcf9aaed server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:48.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.805+0000 7f7f5a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:30:48.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.805+0000 7f7f5a7fc640 1 -- 172.21.15.5:0/3534113710 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c005510 con 0x55ba976f0390 2024-08-31T05:30:48.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.805+0000 7f7f7fb8c740 1 -- 172.21.15.5:0/3534113710 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f6c030ad0 con 0x55ba976f0390 2024-08-31T05:30:48.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.806+0000 7f7f5a7fc640 1 -- 172.21.15.5:0/3534113710 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f7f5c0056b0 con 0x55ba976f0390 2024-08-31T05:30:48.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.806+0000 7f7f5a7fc640 1 -- 172.21.15.5:0/3534113710 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7f5c023430 con 0x55ba976f0390 2024-08-31T05:30:48.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.806+0000 7f7f7fb8c740 10 client.15813 fetch_fsmap learned FSMap version 30 2024-08-31T05:30:48.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.806+0000 7f7f7fb8c740 1 -- 172.21.15.5:0/3534113710 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55ba97ab3a50 con 0x55ba976f0390 2024-08-31T05:30:48.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.806+0000 7f7f5a7fc640 1 -- 172.21.15.5:0/3534113710 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f6c030ad0 con 0x55ba976f0390 2024-08-31T05:30:48.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.806+0000 7f7f5a7fc640 1 -- 172.21.15.5:0/3534113710 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f7f5c03c070 con 0x55ba976f0390 2024-08-31T05:30:48.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.806+0000 7f7f7fb8c740 10 client.15813 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T05:30:48.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.806+0000 7f7f7fb8c740 10 client.15813 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-31T05:30:48.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.806+0000 7f7f7fb8c740 20 client.15813 populate_metadata read hostname 'smithi005' 2024-08-31T05:30:48.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.806+0000 7f7f7fb8c740 1 --2- 172.21.15.5:0/3534113710 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55ba976a4da0 0x55ba97ab61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:48.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.806+0000 7f7f7fb8c740 4 client.15813 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:30:48.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.806+0000 7f7f7fb8c740 1 -- 172.21.15.5:0/3534113710 --> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ba97a2b070 con 0x55ba976a4da0 2024-08-31T05:30:48.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.807+0000 7f7f737fe640 1 --2- 172.21.15.5:0/3534113710 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55ba976a4da0 0x55ba97ab61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:48.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.807+0000 7f7f5a7fc640 10 client.15813 ms_handle_connect on v2:172.21.15.50:6838/98200944 2024-08-31T05:30:48.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.807+0000 7f7f737fe640 1 --2- 172.21.15.5:0/3534113710 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55ba976a4da0 0x55ba97ab61e0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cf29bcb43da40d04 server_cookie=1ccaba4c0ff0e8c in_seq=0 out_seq=0 2024-08-31T05:30:48.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.807+0000 7f7f5a7fc640 1 -- 172.21.15.5:0/3534113710 <== mds.1 v2:172.21.15.50:6838/98200944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ba97a2b070 con 0x55ba976a4da0 2024-08-31T05:30:48.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.807+0000 7f7f5a7fc640 10 client.15813 handle_command_reply: tid=0 2024-08-31T05:30:48.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.807+0000 7f7f7fb8c740 1 client.15813 shutdown 2024-08-31T05:30:48.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.808+0000 7f7f7fb8c740 1 -- 172.21.15.5:0/3534113710 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba976f0390 msgr2=0x55ba97acf380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:48.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.808+0000 7f7f7fb8c740 1 --2- 172.21.15.5:0/3534113710 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba976f0390 0x55ba97acf380 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c00ea30 tx=0x7f7f5c0046c0 comp rx=0 tx=0).stop 2024-08-31T05:30:48.814 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:30:48.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.808+0000 7f7f7fb8c740 1 -- 172.21.15.5:0/3534113710 shutdown_connections 2024-08-31T05:30:48.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.808+0000 7f7f7fb8c740 1 --2- 172.21.15.5:0/3534113710 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55ba976a4da0 0x55ba97ab61e0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:48.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.808+0000 7f7f5a7fc640 0 client.15813 ms_handle_reset on v2:172.21.15.50:6838/98200944 2024-08-31T05:30:48.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.808+0000 7f7f7fb8c740 1 --2- 172.21.15.5:0/3534113710 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba97711070 0x55ba97b46160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:48.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.808+0000 7f7f7fb8c740 1 --2- 172.21.15.5:0/3534113710 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba976f0390 0x55ba97acf380 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:48.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.808+0000 7f7f7fb8c740 1 --2- 172.21.15.5:0/3534113710 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba976e81b0 0x55ba97acee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:48.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.808+0000 7f7f7fb8c740 1 -- 172.21.15.5:0/3534113710 >> 172.21.15.5:0/3534113710 conn(0x55ba97705460 msgr2=0x55ba97ac8a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:48.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.808+0000 7f7f7fb8c740 1 -- 172.21.15.5:0/3534113710 shutdown_connections 2024-08-31T05:30:48.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.808+0000 7f7f7fb8c740 1 -- 172.21.15.5:0/3534113710 wait complete. 2024-08-31T05:30:48.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.808+0000 7f7f7fb8c740 20 client.15813 trim_cache size 0 max 16384 2024-08-31T05:30:48.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.809+0000 7f7f79617640 1 -- 172.21.15.5:0/991935706 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f7f600b4da0 msgr2=0x7f7f600b72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:48.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.809+0000 7f7f79617640 1 --2- 172.21.15.5:0/991935706 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f7f600b4da0 0x7f7f600b72b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x55ba97abd7a0 tx=0x7f7f640aba70 comp rx=0 tx=0).stop 2024-08-31T05:30:48.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.809+0000 7f7f79617640 1 -- 172.21.15.5:0/991935706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f74101f90 msgr2=0x7f7f74197fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:48.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.809+0000 7f7f79617640 1 --2- 172.21.15.5:0/991935706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f74101f90 0x7f7f74197fd0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f7f6400e9f0 tx=0x7f7f6400edf0 comp rx=0 tx=0).stop 2024-08-31T05:30:48.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.809+0000 7f7f79617640 1 -- 172.21.15.5:0/991935706 shutdown_connections 2024-08-31T05:30:48.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.809+0000 7f7f79617640 1 --2- 172.21.15.5:0/991935706 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f7f600b4da0 0x7f7f600b72b0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:48.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.809+0000 7f7f79617640 1 --2- 172.21.15.5:0/991935706 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7f74108220 0x7f7f7419d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:48.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.809+0000 7f7f79617640 1 --2- 172.21.15.5:0/991935706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f741078d0 0x7f7f74198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:48.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.809+0000 7f7f79617640 1 --2- 172.21.15.5:0/991935706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f74101f90 0x7f7f74197fd0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:48.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.809+0000 7f7f79617640 1 -- 172.21.15.5:0/991935706 >> 172.21.15.5:0/991935706 conn(0x7f7f74077a00 msgr2=0x7f7f741038e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:48.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.809+0000 7f7f79617640 1 -- 172.21.15.5:0/991935706 shutdown_connections 2024-08-31T05:30:48.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:48.809+0000 7f7f79617640 1 -- 172.21.15.5:0/991935706 wait complete. 2024-08-31T05:30:49.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:49 smithi070 ceph-mon[22316]: pgmap v370: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-08-31T05:30:49.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:49 smithi050 ceph-mon[22146]: pgmap v370: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-08-31T05:30:49.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:49 smithi005 ceph-mon[18602]: pgmap v370: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-08-31T05:30:49.536 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T05:30:49.880 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:30:50.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.400+0000 7f91470db640 1 -- 172.21.15.5:0/3227606074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9140102880 msgr2=0x7f9140102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:50.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.400+0000 7f91470db640 1 --2- 172.21.15.5:0/3227606074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9140102880 0x7f9140102c90 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f9134009900 tx=0x7f913402a410 comp rx=0 tx=0).stop 2024-08-31T05:30:50.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.400+0000 7f91470db640 1 -- 172.21.15.5:0/3227606074 shutdown_connections 2024-08-31T05:30:50.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.400+0000 7f91470db640 1 --2- 172.21.15.5:0/3227606074 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9140108ac0 0x7f914010f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:50.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.400+0000 7f91470db640 1 --2- 172.21.15.5:0/3227606074 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9140108170 0x7f9140108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:50.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.400+0000 7f91470db640 1 --2- 172.21.15.5:0/3227606074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9140102880 0x7f9140102c90 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:50.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.400+0000 7f91470db640 1 -- 172.21.15.5:0/3227606074 >> 172.21.15.5:0/3227606074 conn(0x7f9140079500 msgr2=0x7f9140079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:50.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.400+0000 7f91470db640 1 -- 172.21.15.5:0/3227606074 shutdown_connections 2024-08-31T05:30:50.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.400+0000 7f91470db640 1 -- 172.21.15.5:0/3227606074 wait complete. 2024-08-31T05:30:50.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.401+0000 7f91470db640 1 Processor -- start 2024-08-31T05:30:50.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.401+0000 7f91470db640 1 -- start start 2024-08-31T05:30:50.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.402+0000 7f91470db640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9140102880 0x7f914019a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:50.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.402+0000 7f91470db640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9140108170 0x7f914019a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:50.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.402+0000 7f91470db640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9140108ac0 0x7f914019fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:50.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.402+0000 7f91470db640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9140112720 con 0x7f9140102880 2024-08-31T05:30:50.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.402+0000 7f91470db640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f91401125a0 con 0x7f9140108ac0 2024-08-31T05:30:50.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.402+0000 7f91470db640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f91401128a0 con 0x7f9140108170 2024-08-31T05:30:50.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.402+0000 7f9144e77640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9140102880 0x7f914019a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:50.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.402+0000 7f9144e77640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9140102880 0x7f914019a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56730/0 (socket says 172.21.15.5:56730) 2024-08-31T05:30:50.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.402+0000 7f9144e77640 1 -- 172.21.15.5:0/1900397937 learned_addr learned my addr 172.21.15.5:0/1900397937 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:50.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.402+0000 7f913ffff640 1 --2- 172.21.15.5:0/1900397937 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9140108170 0x7f914019a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:50.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.402+0000 7f9145678640 1 --2- 172.21.15.5:0/1900397937 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9140108ac0 0x7f914019fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:50.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.402+0000 7f9144e77640 1 -- 172.21.15.5:0/1900397937 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9140108170 msgr2=0x7f914019a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:50.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.402+0000 7f9144e77640 1 --2- 172.21.15.5:0/1900397937 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9140108170 0x7f914019a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:50.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.402+0000 7f9144e77640 1 -- 172.21.15.5:0/1900397937 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9140108ac0 msgr2=0x7f914019fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:50.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.402+0000 7f9144e77640 1 --2- 172.21.15.5:0/1900397937 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9140108ac0 0x7f914019fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:50.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.402+0000 7f9144e77640 1 -- 172.21.15.5:0/1900397937 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91401a0170 con 0x7f9140102880 2024-08-31T05:30:50.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.403+0000 7f9144e77640 1 --2- 172.21.15.5:0/1900397937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9140102880 0x7f914019a200 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f9134000c00 tx=0x7f9134005230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:50.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.403+0000 7f913dffb640 1 -- 172.21.15.5:0/1900397937 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9134040030 con 0x7f9140102880 2024-08-31T05:30:50.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.403+0000 7f91470db640 1 -- 172.21.15.5:0/1900397937 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91401a0400 con 0x7f9140102880 2024-08-31T05:30:50.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.403+0000 7f913dffb640 1 -- 172.21.15.5:0/1900397937 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9134005630 con 0x7f9140102880 2024-08-31T05:30:50.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.403+0000 7f913dffb640 1 -- 172.21.15.5:0/1900397937 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913403c860 con 0x7f9140102880 2024-08-31T05:30:50.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.403+0000 7f91470db640 1 -- 172.21.15.5:0/1900397937 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9140103f00 con 0x7f9140102880 2024-08-31T05:30:50.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.407+0000 7f914d650740 1 Processor -- start 2024-08-31T05:30:50.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.407+0000 7f914d650740 1 -- start start 2024-08-31T05:30:50.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.407+0000 7f914d650740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f0f42ba070 0x55f0f465f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:50.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.407+0000 7f914d650740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f0f42911b0 0x55f0f465f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:50.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.407+0000 7f914d650740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f0f4299390 0x55f0f465fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:50.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.407+0000 7f914d650740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f0f45d6680 con 0x55f0f4299390 2024-08-31T05:30:50.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.407+0000 7f914d650740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f0f45c5c10 con 0x55f0f42ba070 2024-08-31T05:30:50.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.407+0000 7f914d650740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f0f45c9bc0 con 0x55f0f42911b0 2024-08-31T05:30:50.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.407+0000 7f913dffb640 1 -- 172.21.15.5:0/1900397937 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) ==== 152701+0+0 (secure 0 0 0) 0x7f9134043030 con 0x7f9140102880 2024-08-31T05:30:50.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.407+0000 7f913ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f0f4299390 0x55f0f465fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:50.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.408+0000 7f913ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f0f4299390 0x55f0f465fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56740/0 (socket says 172.21.15.5:56740) 2024-08-31T05:30:50.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.408+0000 7f913ffff640 1 -- 172.21.15.5:0/4188453577 learned_addr learned my addr 172.21.15.5:0/4188453577 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:50.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.408+0000 7f9145678640 1 --2- 172.21.15.5:0/4188453577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f0f42ba070 0x55f0f465f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:50.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.408+0000 7f9144e77640 1 --2- 172.21.15.5:0/4188453577 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f0f42911b0 0x55f0f465f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:50.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.408+0000 7f913ffff640 1 -- 172.21.15.5:0/4188453577 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f0f42911b0 msgr2=0x55f0f465f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:50.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.408+0000 7f913ffff640 1 --2- 172.21.15.5:0/4188453577 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f0f42911b0 0x55f0f465f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:50.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.408+0000 7f913ffff640 1 -- 172.21.15.5:0/4188453577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f0f42ba070 msgr2=0x55f0f465f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:50.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.408+0000 7f913ffff640 1 --2- 172.21.15.5:0/4188453577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f0f42ba070 0x55f0f465f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:50.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.408+0000 7f913ffff640 1 -- 172.21.15.5:0/4188453577 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0f4325650 con 0x55f0f4299390 2024-08-31T05:30:50.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.408+0000 7f913ffff640 1 --2- 172.21.15.5:0/4188453577 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f0f4299390 0x55f0f465fd90 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f912c00bc70 tx=0x7f912c0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f54a5640f1a3ff88 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:50.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.409+0000 7f912affd640 1 -- 172.21.15.5:0/4188453577 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f912c005220 con 0x55f0f4299390 2024-08-31T05:30:50.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.409+0000 7f912affd640 1 -- 172.21.15.5:0/4188453577 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f912c00be20 con 0x55f0f4299390 2024-08-31T05:30:50.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.409+0000 7f912affd640 1 -- 172.21.15.5:0/4188453577 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f912c011680 con 0x55f0f4299390 2024-08-31T05:30:50.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.409+0000 7f913dffb640 1 --2- 172.21.15.5:0/1900397937 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f91300b4da0 0x7f91300b72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:50.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.409+0000 7f913dffb640 1 -- 172.21.15.5:0/1900397937 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f91341060a0 con 0x7f9140102880 2024-08-31T05:30:50.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.409+0000 7f9145678640 1 --2- 172.21.15.5:0/1900397937 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f91300b4da0 0x7f91300b72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:50.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.410+0000 7f914d650740 1 -- 172.21.15.5:0/4188453577 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f0f4299390 msgr2=0x55f0f465fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:50.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.410+0000 7f9145678640 1 --2- 172.21.15.5:0/1900397937 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f91300b4da0 0x7f91300b72b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9138005fd0 tx=0x7f9138009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:50.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.410+0000 7f914d650740 1 --2- 172.21.15.5:0/4188453577 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f0f4299390 0x55f0f465fd90 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f912c00bc70 tx=0x7f912c0107a0 comp rx=0 tx=0).stop 2024-08-31T05:30:50.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.410+0000 7f914d650740 1 -- 172.21.15.5:0/4188453577 shutdown_connections 2024-08-31T05:30:50.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.410+0000 7f914d650740 1 --2- 172.21.15.5:0/4188453577 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f0f4299390 0x55f0f465fd90 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:50.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.410+0000 7f914d650740 1 --2- 172.21.15.5:0/4188453577 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f0f42911b0 0x55f0f465f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:50.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.410+0000 7f914d650740 1 --2- 172.21.15.5:0/4188453577 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f0f42ba070 0x55f0f465f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:50.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.410+0000 7f914d650740 1 -- 172.21.15.5:0/4188453577 >> 172.21.15.5:0/4188453577 conn(0x55f0f42ae460 msgr2=0x55f0f465d200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:50.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.411+0000 7f914d650740 1 -- 172.21.15.5:0/4188453577 shutdown_connections 2024-08-31T05:30:50.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.411+0000 7f914d650740 1 -- 172.21.15.5:0/4188453577 wait complete. 2024-08-31T05:30:50.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.412+0000 7f914d650740 1 -- start start 2024-08-31T05:30:50.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.412+0000 7f914d650740 1 Processor -- start 2024-08-31T05:30:50.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.413+0000 7f914d650740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f0f42911b0 0x55f0f466aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:50.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.413+0000 7f914d650740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f0f4299390 0x55f0f466afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:50.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.413+0000 7f914d650740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f0f42ba070 0x55f0f4676e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:50.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.413+0000 7f914d650740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f0f4428700 con 0x55f0f42911b0 2024-08-31T05:30:50.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.413+0000 7f914d650740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f0f454c750 con 0x55f0f42ba070 2024-08-31T05:30:50.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.413+0000 7f914d650740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f0f466daf0 con 0x55f0f4299390 2024-08-31T05:30:50.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.413+0000 7f9144e77640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f0f42911b0 0x55f0f466aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:50.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.413+0000 7f914d650740 10 client.0 _ll_register_callbacks cb 0x55f0f457be10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:30:50.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.413+0000 7f9144e77640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f0f42911b0 0x55f0f466aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56742/0 (socket says 172.21.15.5:56742) 2024-08-31T05:30:50.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.413+0000 7f9144e77640 1 -- 172.21.15.5:0/4263335933 learned_addr learned my addr 172.21.15.5:0/4263335933 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:50.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.413+0000 7f913ffff640 1 --2- 172.21.15.5:0/4263335933 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f0f4299390 0x55f0f466afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:50.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.413+0000 7f9145678640 1 --2- 172.21.15.5:0/4263335933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f0f42ba070 0x55f0f4676e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:50.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.413+0000 7f913ffff640 1 -- 172.21.15.5:0/4263335933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f0f42ba070 msgr2=0x55f0f4676e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:50.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.413+0000 7f913ffff640 1 --2- 172.21.15.5:0/4263335933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f0f42ba070 0x55f0f4676e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:50.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.413+0000 7f913ffff640 1 -- 172.21.15.5:0/4263335933 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f0f42911b0 msgr2=0x55f0f466aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:50.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.414+0000 7f913ffff640 1 --2- 172.21.15.5:0/4263335933 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f0f42911b0 0x55f0f466aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:50.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.414+0000 7f913ffff640 1 -- 172.21.15.5:0/4263335933 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0f4585900 con 0x55f0f4299390 2024-08-31T05:30:50.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.414+0000 7f913ffff640 1 --2- 172.21.15.5:0/4263335933 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f0f4299390 0x55f0f466afe0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f912c00c010 tx=0x7f912c004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f5f708c28303903 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:50.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.414+0000 7f911ffff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:30:50.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.414+0000 7f9144e77640 1 --2- 172.21.15.5:0/4263335933 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f0f42911b0 0x55f0f466aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:30:50.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.414+0000 7f911ffff640 1 -- 172.21.15.5:0/4263335933 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f912c02a060 con 0x55f0f4299390 2024-08-31T05:30:50.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.414+0000 7f914d650740 1 -- 172.21.15.5:0/4263335933 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f912c00be20 con 0x55f0f4299390 2024-08-31T05:30:50.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.414+0000 7f911ffff640 1 -- 172.21.15.5:0/4263335933 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f912c005160 con 0x55f0f4299390 2024-08-31T05:30:50.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.414+0000 7f911ffff640 1 -- 172.21.15.5:0/4263335933 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f912c031050 con 0x55f0f4299390 2024-08-31T05:30:50.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.415+0000 7f914d650740 10 client.25468 fetch_fsmap learned FSMap version 30 2024-08-31T05:30:50.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.415+0000 7f914d650740 1 -- 172.21.15.5:0/4263335933 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f0f4679900 con 0x55f0f4299390 2024-08-31T05:30:50.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.415+0000 7f911ffff640 1 -- 172.21.15.5:0/4263335933 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f912c00be20 con 0x55f0f4299390 2024-08-31T05:30:50.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.415+0000 7f911ffff640 1 -- 172.21.15.5:0/4263335933 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f912c003710 con 0x55f0f4299390 2024-08-31T05:30:50.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.416+0000 7f914d650740 10 client.25468 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T05:30:50.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.416+0000 7f914d650740 10 client.25468 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:30:50.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.416+0000 7f914d650740 20 client.25468 populate_metadata read hostname 'smithi005' 2024-08-31T05:30:50.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.416+0000 7f914d650740 1 --2- 172.21.15.5:0/4263335933 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55f0f42789f0 0x55f0f467cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:50.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.416+0000 7f914d650740 4 client.25468 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:30:50.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.416+0000 7f914d650740 1 -- 172.21.15.5:0/4263335933 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f0f45d85d0 con 0x55f0f42789f0 2024-08-31T05:30:50.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.416+0000 7f9144e77640 1 --2- 172.21.15.5:0/4263335933 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55f0f42789f0 0x55f0f467cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:50.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.417+0000 7f911ffff640 10 client.25468 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:30:50.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.417+0000 7f9144e77640 1 --2- 172.21.15.5:0/4263335933 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55f0f42789f0 0x55f0f467cc60 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40a6f0961d5f9646 server_cookie=d145f1f4c90bb6f9 in_seq=0 out_seq=0 2024-08-31T05:30:50.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.417+0000 7f911ffff640 1 -- 172.21.15.5:0/4263335933 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f0f45d85d0 con 0x55f0f42789f0 2024-08-31T05:30:50.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.417+0000 7f911ffff640 10 client.25468 handle_command_reply: tid=0 2024-08-31T05:30:50.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.417+0000 7f914d650740 1 client.25468 shutdown 2024-08-31T05:30:50.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.418+0000 7f914d650740 1 -- 172.21.15.5:0/4263335933 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f0f4299390 msgr2=0x55f0f466afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:50.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.418+0000 7f914d650740 1 --2- 172.21.15.5:0/4263335933 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f0f4299390 0x55f0f466afe0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f912c00c010 tx=0x7f912c004270 comp rx=0 tx=0).stop 2024-08-31T05:30:50.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.418+0000 7f914d650740 1 -- 172.21.15.5:0/4263335933 shutdown_connections 2024-08-31T05:30:50.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.418+0000 7f914d650740 1 --2- 172.21.15.5:0/4263335933 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55f0f42789f0 0x55f0f467cc60 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:50.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.418+0000 7f911ffff640 0 client.25468 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:30:50.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.418+0000 7f914d650740 1 --2- 172.21.15.5:0/4263335933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f0f42ba070 0x55f0f4676e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:50.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.418+0000 7f914d650740 1 --2- 172.21.15.5:0/4263335933 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f0f4299390 0x55f0f466afe0 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f912c00c010 tx=0x7f912c004270 comp rx=0 tx=0).stop 2024-08-31T05:30:50.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.418+0000 7f914d650740 1 --2- 172.21.15.5:0/4263335933 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f0f42911b0 0x55f0f466aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:50.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.418+0000 7f914d650740 1 -- 172.21.15.5:0/4263335933 >> 172.21.15.5:0/4263335933 conn(0x55f0f42ae460 msgr2=0x55f0f46624a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:50.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.418+0000 7f914d650740 1 -- 172.21.15.5:0/4263335933 shutdown_connections 2024-08-31T05:30:50.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.418+0000 7f914d650740 1 -- 172.21.15.5:0/4263335933 wait complete. 2024-08-31T05:30:50.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.418+0000 7f914d650740 20 client.25468 trim_cache size 0 max 16384 2024-08-31T05:30:50.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.432+0000 7f914d650740 1 Processor -- start 2024-08-31T05:30:50.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.432+0000 7f914d650740 1 -- start start 2024-08-31T05:30:50.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.432+0000 7f914d650740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f0f42911b0 0x55f0f4662b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:50.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.432+0000 7f914d650740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f0f42ba070 0x55f0f4667c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:50.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.432+0000 7f914d650740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f0f424dda0 0x55f0f46681d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:50.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.432+0000 7f914d650740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f91401b2e40 con 0x55f0f424dda0 2024-08-31T05:30:50.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.432+0000 7f914d650740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f91401b4980 con 0x55f0f42911b0 2024-08-31T05:30:50.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.432+0000 7f914d650740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f91401b3510 con 0x55f0f42ba070 2024-08-31T05:30:50.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.432+0000 7f9145678640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f0f424dda0 0x55f0f46681d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:50.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.432+0000 7f9145678640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f0f424dda0 0x55f0f46681d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56754/0 (socket says 172.21.15.5:56754) 2024-08-31T05:30:50.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.432+0000 7f9145678640 1 -- 172.21.15.5:0/2652754378 learned_addr learned my addr 172.21.15.5:0/2652754378 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:50.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.433+0000 7f9144e77640 1 --2- 172.21.15.5:0/2652754378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f0f42911b0 0x55f0f4662b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:50.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.433+0000 7f9145678640 1 -- 172.21.15.5:0/2652754378 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f0f42ba070 msgr2=0x55f0f4667c90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T05:30:50.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.433+0000 7f913ffff640 1 --2- 172.21.15.5:0/2652754378 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f0f42ba070 0x55f0f4667c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:50.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.433+0000 7f9145678640 1 --2- 172.21.15.5:0/2652754378 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f0f42ba070 0x55f0f4667c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:50.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.433+0000 7f9145678640 1 -- 172.21.15.5:0/2652754378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f0f42911b0 msgr2=0x55f0f4662b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:50.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.433+0000 7f9145678640 1 --2- 172.21.15.5:0/2652754378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f0f42911b0 0x55f0f4662b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:50.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.433+0000 7f9145678640 1 -- 172.21.15.5:0/2652754378 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0f466bd60 con 0x55f0f424dda0 2024-08-31T05:30:50.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.433+0000 7f9145678640 1 --2- 172.21.15.5:0/2652754378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f0f424dda0 0x55f0f46681d0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f913801f560 tx=0x7f9138016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8af5ed7603d1f8c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:50.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.434+0000 7f912a7fc640 1 -- 172.21.15.5:0/2652754378 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913802d070 con 0x55f0f424dda0 2024-08-31T05:30:50.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.434+0000 7f912a7fc640 1 -- 172.21.15.5:0/2652754378 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91380288c0 con 0x55f0f424dda0 2024-08-31T05:30:50.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.434+0000 7f912a7fc640 1 -- 172.21.15.5:0/2652754378 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913801c750 con 0x55f0f424dda0 2024-08-31T05:30:50.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.435+0000 7f914d650740 1 -- 172.21.15.5:0/2652754378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f0f424dda0 msgr2=0x55f0f46681d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:50.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.435+0000 7f914d650740 1 --2- 172.21.15.5:0/2652754378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f0f424dda0 0x55f0f46681d0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f913801f560 tx=0x7f9138016000 comp rx=0 tx=0).stop 2024-08-31T05:30:50.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.435+0000 7f914d650740 1 -- 172.21.15.5:0/2652754378 shutdown_connections 2024-08-31T05:30:50.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.435+0000 7f914d650740 1 --2- 172.21.15.5:0/2652754378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f0f424dda0 0x55f0f46681d0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:50.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.435+0000 7f914d650740 1 --2- 172.21.15.5:0/2652754378 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f0f42ba070 0x55f0f4667c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:50.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.435+0000 7f914d650740 1 --2- 172.21.15.5:0/2652754378 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f0f42911b0 0x55f0f4662b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:50.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.435+0000 7f914d650740 1 -- 172.21.15.5:0/2652754378 >> 172.21.15.5:0/2652754378 conn(0x55f0f42ae460 msgr2=0x55f0f4662410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:50.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.435+0000 7f914d650740 1 -- 172.21.15.5:0/2652754378 shutdown_connections 2024-08-31T05:30:50.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.435+0000 7f914d650740 1 -- 172.21.15.5:0/2652754378 wait complete. 2024-08-31T05:30:50.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.435+0000 7f914d650740 1 -- start start 2024-08-31T05:30:50.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.436+0000 7f914d650740 1 Processor -- start 2024-08-31T05:30:50.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.436+0000 7f914d650740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f0f424dda0 0x55f0f467e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:50.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.436+0000 7f914d650740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f0f42911b0 0x55f0f467eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:50.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.436+0000 7f914d650740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f0f42ba070 0x55f0f46e0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:50.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.436+0000 7f914d650740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f91401b42b0 con 0x55f0f424dda0 2024-08-31T05:30:50.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.436+0000 7f914d650740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f91401b3be0 con 0x55f0f42911b0 2024-08-31T05:30:50.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.436+0000 7f914d650740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f91401b0e20 con 0x55f0f42ba070 2024-08-31T05:30:50.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.436+0000 7f914d650740 10 client.0 _ll_register_callbacks cb 0x7f91380099c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:30:50.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.436+0000 7f9144e77640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f0f424dda0 0x55f0f467e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:50.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.436+0000 7f9144e77640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f0f424dda0 0x55f0f467e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56770/0 (socket says 172.21.15.5:56770) 2024-08-31T05:30:50.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.436+0000 7f9144e77640 1 -- 172.21.15.5:0/389374046 learned_addr learned my addr 172.21.15.5:0/389374046 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:50.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.437+0000 7f9145678640 1 --2- 172.21.15.5:0/389374046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f0f42ba070 0x55f0f46e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:50.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.437+0000 7f9144e77640 1 -- 172.21.15.5:0/389374046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f0f42ba070 msgr2=0x55f0f46e0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:50.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.437+0000 7f9144e77640 1 --2- 172.21.15.5:0/389374046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f0f42ba070 0x55f0f46e0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:50.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.437+0000 7f9144e77640 1 -- 172.21.15.5:0/389374046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f0f42911b0 msgr2=0x55f0f467eb80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T05:30:50.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.437+0000 7f9144e77640 1 --2- 172.21.15.5:0/389374046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f0f42911b0 0x55f0f467eb80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:50.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.437+0000 7f9144e77640 1 -- 172.21.15.5:0/389374046 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0f46e0a90 con 0x55f0f424dda0 2024-08-31T05:30:50.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.437+0000 7f9144e77640 1 --2- 172.21.15.5:0/389374046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f0f424dda0 0x55f0f467e5c0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f91340d5010 tx=0x7f91340d5040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fd46c1be6bafcfd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:50.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.437+0000 7f911ffff640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:30:50.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.437+0000 7f911ffff640 1 -- 172.21.15.5:0/389374046 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913404a040 con 0x55f0f424dda0 2024-08-31T05:30:50.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.437+0000 7f911ffff640 1 -- 172.21.15.5:0/389374046 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f91340c8640 con 0x55f0f424dda0 2024-08-31T05:30:50.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.437+0000 7f914d650740 1 -- 172.21.15.5:0/389374046 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91380288c0 con 0x55f0f424dda0 2024-08-31T05:30:50.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.438+0000 7f911ffff640 1 -- 172.21.15.5:0/389374046 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f91340cbb20 con 0x55f0f424dda0 2024-08-31T05:30:50.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.438+0000 7f914d650740 10 client.15831 fetch_fsmap learned FSMap version 30 2024-08-31T05:30:50.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.438+0000 7f914d650740 1 -- 172.21.15.5:0/389374046 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f0f46e7dc0 con 0x55f0f424dda0 2024-08-31T05:30:50.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.438+0000 7f911ffff640 1 -- 172.21.15.5:0/389374046 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91340f30d0 con 0x55f0f424dda0 2024-08-31T05:30:50.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.438+0000 7f911ffff640 1 -- 172.21.15.5:0/389374046 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f91340cc610 con 0x55f0f424dda0 2024-08-31T05:30:50.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.438+0000 7f914d650740 10 client.15831 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T05:30:50.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.438+0000 7f914d650740 10 client.15831 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:30:50.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.438+0000 7f914d650740 20 client.15831 populate_metadata read hostname 'smithi005' 2024-08-31T05:30:50.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.438+0000 7f914d650740 1 --2- 172.21.15.5:0/389374046 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55f0f46e8520 0x55f0f46ea940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:50.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.438+0000 7f914d650740 4 client.15831 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:30:50.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.438+0000 7f914d650740 1 -- 172.21.15.5:0/389374046 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f91380288c0 con 0x55f0f46e8520 2024-08-31T05:30:50.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.439+0000 7f913ffff640 1 --2- 172.21.15.5:0/389374046 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55f0f46e8520 0x55f0f46ea940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:50.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.439+0000 7f913ffff640 1 --2- 172.21.15.5:0/389374046 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55f0f46e8520 0x55f0f46ea940 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8dfdd81170f3c6c0 server_cookie=bab4d6fa024adef8 in_seq=0 out_seq=0 2024-08-31T05:30:50.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.439+0000 7f911ffff640 10 client.15831 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:30:50.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.440+0000 7f911ffff640 1 -- 172.21.15.5:0/389374046 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f91380288c0 con 0x55f0f46e8520 2024-08-31T05:30:50.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.440+0000 7f911ffff640 10 client.15831 handle_command_reply: tid=0 2024-08-31T05:30:50.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.440+0000 7f914d650740 1 client.15831 shutdown 2024-08-31T05:30:50.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.440+0000 7f914d650740 1 -- 172.21.15.5:0/389374046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f0f424dda0 msgr2=0x55f0f467e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:50.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.440+0000 7f914d650740 1 --2- 172.21.15.5:0/389374046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f0f424dda0 0x55f0f467e5c0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f91340d5010 tx=0x7f91340d5040 comp rx=0 tx=0).stop 2024-08-31T05:30:50.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.440+0000 7f914d650740 1 -- 172.21.15.5:0/389374046 shutdown_connections 2024-08-31T05:30:50.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.440+0000 7f914d650740 1 --2- 172.21.15.5:0/389374046 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55f0f46e8520 0x55f0f46ea940 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:50.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.440+0000 7f914d650740 1 --2- 172.21.15.5:0/389374046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f0f42ba070 0x55f0f46e0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:50.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.440+0000 7f914d650740 1 --2- 172.21.15.5:0/389374046 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f0f42911b0 0x55f0f467eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:50.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.440+0000 7f914d650740 1 --2- 172.21.15.5:0/389374046 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f0f424dda0 0x55f0f467e5c0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:50.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.440+0000 7f914d650740 1 -- 172.21.15.5:0/389374046 >> 172.21.15.5:0/389374046 conn(0x55f0f42ae460 msgr2=0x55f0f4660340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:50.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.440+0000 7f911ffff640 0 client.15831 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:30:50.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.440+0000 7f914d650740 1 -- 172.21.15.5:0/389374046 shutdown_connections 2024-08-31T05:30:50.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.440+0000 7f914d650740 1 -- 172.21.15.5:0/389374046 wait complete. 2024-08-31T05:30:50.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.440+0000 7f914d650740 20 client.15831 trim_cache size 0 max 16384 2024-08-31T05:30:50.444 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:30:50.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.441+0000 7f91470db640 1 -- 172.21.15.5:0/1900397937 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f91300b4da0 msgr2=0x7f91300b72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:50.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.441+0000 7f91470db640 1 --2- 172.21.15.5:0/1900397937 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f91300b4da0 0x7f91300b72b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9138005fd0 tx=0x7f9138009500 comp rx=0 tx=0).stop 2024-08-31T05:30:50.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.441+0000 7f91470db640 1 -- 172.21.15.5:0/1900397937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9140102880 msgr2=0x7f914019a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:50.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.441+0000 7f91470db640 1 --2- 172.21.15.5:0/1900397937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9140102880 0x7f914019a200 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f9134000c00 tx=0x7f9134005230 comp rx=0 tx=0).stop 2024-08-31T05:30:50.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.441+0000 7f91470db640 1 -- 172.21.15.5:0/1900397937 shutdown_connections 2024-08-31T05:30:50.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.441+0000 7f91470db640 1 --2- 172.21.15.5:0/1900397937 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f91300b4da0 0x7f91300b72b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:50.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.441+0000 7f91470db640 1 --2- 172.21.15.5:0/1900397937 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9140108ac0 0x7f914019fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:50.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.441+0000 7f91470db640 1 --2- 172.21.15.5:0/1900397937 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9140108170 0x7f914019a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:50.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.441+0000 7f91470db640 1 --2- 172.21.15.5:0/1900397937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9140102880 0x7f914019a200 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:50.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.441+0000 7f91470db640 1 -- 172.21.15.5:0/1900397937 >> 172.21.15.5:0/1900397937 conn(0x7f9140079500 msgr2=0x7f91401018b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:50.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.441+0000 7f91470db640 1 -- 172.21.15.5:0/1900397937 shutdown_connections 2024-08-31T05:30:50.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:50.442+0000 7f91470db640 1 -- 172.21.15.5:0/1900397937 wait complete. 2024-08-31T05:30:51.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:51 smithi070 ceph-mon[22316]: pgmap v371: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 2.1 KiB/s wr, 14 op/s 2024-08-31T05:30:51.404 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:51 smithi005 ceph-mon[18602]: pgmap v371: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 2.1 KiB/s wr, 14 op/s 2024-08-31T05:30:51.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:51 smithi050 ceph-mon[22146]: pgmap v371: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 2.1 KiB/s wr, 14 op/s 2024-08-31T05:30:52.141 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T05:30:52.141 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T05:30:52.438 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:30:53.028 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:53 smithi005 ceph-mon[18602]: pgmap v372: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2024-08-31T05:30:53.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.033+0000 7fb81a2eb640 1 -- 172.21.15.5:0/3204469384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb814108a90 msgr2=0x7fb81410f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:53.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.033+0000 7fb81a2eb640 1 --2- 172.21.15.5:0/3204469384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb814108a90 0x7fb81410f2c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fb80c009ca0 tx=0x7fb80c02a8e0 comp rx=0 tx=0).stop 2024-08-31T05:30:53.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.033+0000 7fb81a2eb640 1 -- 172.21.15.5:0/3204469384 shutdown_connections 2024-08-31T05:30:53.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.033+0000 7fb81a2eb640 1 --2- 172.21.15.5:0/3204469384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb814108a90 0x7fb81410f2c0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:53.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.033+0000 7fb81a2eb640 1 --2- 172.21.15.5:0/3204469384 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb814108140 0x7fb814108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:53.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.033+0000 7fb81a2eb640 1 --2- 172.21.15.5:0/3204469384 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb814102800 0x7fb814102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:53.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.033+0000 7fb81a2eb640 1 -- 172.21.15.5:0/3204469384 >> 172.21.15.5:0/3204469384 conn(0x7fb8140794d0 msgr2=0x7fb8140798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:53.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.033+0000 7fb81a2eb640 1 -- 172.21.15.5:0/3204469384 shutdown_connections 2024-08-31T05:30:53.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.033+0000 7fb81a2eb640 1 -- 172.21.15.5:0/3204469384 wait complete. 2024-08-31T05:30:53.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.034+0000 7fb81a2eb640 1 Processor -- start 2024-08-31T05:30:53.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.034+0000 7fb81a2eb640 1 -- start start 2024-08-31T05:30:53.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.035+0000 7fb81a2eb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb814102800 0x7fb814198fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:53.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.035+0000 7fb81a2eb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb814108140 0x7fb814199550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:53.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.036+0000 7fb81a2eb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb814108a90 0x7fb81419e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:53.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.036+0000 7fb813fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb814102800 0x7fb814198fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:53.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.036+0000 7fb813fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb814102800 0x7fb814198fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53190/0 (socket says 172.21.15.5:53190) 2024-08-31T05:30:53.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.036+0000 7fb813fff640 1 -- 172.21.15.5:0/631737699 learned_addr learned my addr 172.21.15.5:0/631737699 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:53.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.036+0000 7fb81a2eb640 1 -- 172.21.15.5:0/631737699 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb8141127b0 con 0x7fb814102800 2024-08-31T05:30:53.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.036+0000 7fb81a2eb640 1 -- 172.21.15.5:0/631737699 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb814112630 con 0x7fb814108a90 2024-08-31T05:30:53.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.036+0000 7fb81a2eb640 1 -- 172.21.15.5:0/631737699 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb814112930 con 0x7fb814108140 2024-08-31T05:30:53.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.036+0000 7fb818888640 1 --2- 172.21.15.5:0/631737699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb814108a90 0x7fb81419e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:53.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.036+0000 7fb8137fe640 1 --2- 172.21.15.5:0/631737699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb814108140 0x7fb814199550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:53.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.037+0000 7fb818888640 1 -- 172.21.15.5:0/631737699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb814108140 msgr2=0x7fb814199550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:53.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.037+0000 7fb818888640 1 --2- 172.21.15.5:0/631737699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb814108140 0x7fb814199550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:53.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.037+0000 7fb818888640 1 -- 172.21.15.5:0/631737699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb814102800 msgr2=0x7fb814198fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:53.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.037+0000 7fb818888640 1 --2- 172.21.15.5:0/631737699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb814102800 0x7fb814198fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:53.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.037+0000 7fb818888640 1 -- 172.21.15.5:0/631737699 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb81419ef20 con 0x7fb814108a90 2024-08-31T05:30:53.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.037+0000 7fb818888640 1 --2- 172.21.15.5:0/631737699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb814108a90 0x7fb81419e7f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb80c02ae00 tx=0x7fb80c0095b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:53.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.037+0000 7fb8117fa640 1 -- 172.21.15.5:0/631737699 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb80c045070 con 0x7fb814108a90 2024-08-31T05:30:53.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.037+0000 7fb8117fa640 1 -- 172.21.15.5:0/631737699 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb80c03d2e0 con 0x7fb814108a90 2024-08-31T05:30:53.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.037+0000 7fb8117fa640 1 -- 172.21.15.5:0/631737699 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb80c0305e0 con 0x7fb814108a90 2024-08-31T05:30:53.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.037+0000 7fb81a2eb640 1 -- 172.21.15.5:0/631737699 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb81419f1b0 con 0x7fb814108a90 2024-08-31T05:30:53.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.038+0000 7fb81a2eb640 1 -- 172.21.15.5:0/631737699 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb81419f5b0 con 0x7fb814108a90 2024-08-31T05:30:53.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.041+0000 7fb820860740 1 Processor -- start 2024-08-31T05:30:53.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.041+0000 7fb8117fa640 1 -- 172.21.15.5:0/631737699 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 24) ==== 152701+0+0 (secure 0 0 0) 0x7fb80c048070 con 0x7fb814108a90 2024-08-31T05:30:53.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.042+0000 7fb820860740 1 -- start start 2024-08-31T05:30:53.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.042+0000 7fb820860740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56371ccb3350 0x56371d059780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:53.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.042+0000 7fb820860740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56371cc8a490 0x56371d059cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:53.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.042+0000 7fb820860740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56371cc92670 0x56371d05a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:53.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.042+0000 7fb820860740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56371cfcf5f0 con 0x56371cc8a490 2024-08-31T05:30:53.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.042+0000 7fb820860740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56371cfbeb80 con 0x56371ccb3350 2024-08-31T05:30:53.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.042+0000 7fb820860740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56371cfc2b30 con 0x56371cc92670 2024-08-31T05:30:53.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.043+0000 7fb8137fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56371ccb3350 0x56371d059780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:53.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.043+0000 7fb8137fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56371ccb3350 0x56371d059780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:54948/0 (socket says 172.21.15.5:54948) 2024-08-31T05:30:53.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.043+0000 7fb8137fe640 1 -- 172.21.15.5:0/2615902565 learned_addr learned my addr 172.21.15.5:0/2615902565 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:53.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.043+0000 7fb813fff640 1 --2- 172.21.15.5:0/2615902565 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56371cc8a490 0x56371d059cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:53.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.043+0000 7fb813fff640 1 -- 172.21.15.5:0/2615902565 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56371cc92670 msgr2=0x56371d05a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:53.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.043+0000 7fb8117fa640 1 --2- 172.21.15.5:0/631737699 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb7fc0b4da0 0x7fb7fc0b72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:53.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.044+0000 7fb8117fa640 1 -- 172.21.15.5:0/631737699 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fb80c10ab30 con 0x7fb814108a90 2024-08-31T05:30:53.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.043+0000 7fb8137fe640 1 --2- 172.21.15.5:0/2615902565 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56371cc92670 0x56371d05a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:53.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.044+0000 7fb818888640 1 --2- 172.21.15.5:0/631737699 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb7fc0b4da0 0x7fb7fc0b72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:53.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.044+0000 7fb813fff640 1 --2- 172.21.15.5:0/2615902565 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56371cc92670 0x56371d05a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:53.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.044+0000 7fb813fff640 1 -- 172.21.15.5:0/2615902565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56371ccb3350 msgr2=0x56371d059780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:53.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.044+0000 7fb813fff640 1 --2- 172.21.15.5:0/2615902565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56371ccb3350 0x56371d059780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:53.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.044+0000 7fb813fff640 1 -- 172.21.15.5:0/2615902565 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56371cd1e930 con 0x56371cc8a490 2024-08-31T05:30:53.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.045+0000 7fb8137fe640 1 --2- 172.21.15.5:0/2615902565 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56371cc92670 0x56371d05a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:30:53.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.045+0000 7fb813fff640 1 --2- 172.21.15.5:0/2615902565 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56371cc8a490 0x56371d059cc0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fb804009c80 tx=0x7fb804011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36d2560d7ad748f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:53.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.045+0000 7fb818888640 1 --2- 172.21.15.5:0/631737699 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb7fc0b4da0 0x7fb7fc0b72b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb80c107f00 tx=0x7fb80c03d040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:53.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.045+0000 7fb7fa7fc640 1 -- 172.21.15.5:0/2615902565 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb804004230 con 0x56371cc8a490 2024-08-31T05:30:53.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.045+0000 7fb7fa7fc640 1 -- 172.21.15.5:0/2615902565 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8040043d0 con 0x56371cc8a490 2024-08-31T05:30:53.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.045+0000 7fb7fa7fc640 1 -- 172.21.15.5:0/2615902565 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb804004d80 con 0x56371cc8a490 2024-08-31T05:30:53.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.047+0000 7fb820860740 1 -- 172.21.15.5:0/2615902565 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56371cc8a490 msgr2=0x56371d059cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:53.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.047+0000 7fb820860740 1 --2- 172.21.15.5:0/2615902565 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56371cc8a490 0x56371d059cc0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fb804009c80 tx=0x7fb804011810 comp rx=0 tx=0).stop 2024-08-31T05:30:53.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.047+0000 7fb820860740 1 -- 172.21.15.5:0/2615902565 shutdown_connections 2024-08-31T05:30:53.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.047+0000 7fb820860740 1 --2- 172.21.15.5:0/2615902565 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56371cc92670 0x56371d05a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:53.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.047+0000 7fb820860740 1 --2- 172.21.15.5:0/2615902565 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56371cc8a490 0x56371d059cc0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:53.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.047+0000 7fb820860740 1 --2- 172.21.15.5:0/2615902565 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56371ccb3350 0x56371d059780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:53.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.047+0000 7fb820860740 1 -- 172.21.15.5:0/2615902565 >> 172.21.15.5:0/2615902565 conn(0x56371cca7740 msgr2=0x56371d057670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:53.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.047+0000 7fb820860740 1 -- 172.21.15.5:0/2615902565 shutdown_connections 2024-08-31T05:30:53.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.047+0000 7fb820860740 1 -- 172.21.15.5:0/2615902565 wait complete. 2024-08-31T05:30:53.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.047+0000 7fb820860740 1 -- start start 2024-08-31T05:30:53.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.048+0000 7fb820860740 1 Processor -- start 2024-08-31T05:30:53.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.048+0000 7fb820860740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56371cc8a490 0x56371d064f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:53.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.048+0000 7fb820860740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56371cc92670 0x56371d0654b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:53.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.048+0000 7fb820860740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56371ccb3350 0x56371d0822e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:53.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.048+0000 7fb820860740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56371ce21890 con 0x56371ccb3350 2024-08-31T05:30:53.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.048+0000 7fb820860740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56371cf45790 con 0x56371cc92670 2024-08-31T05:30:53.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.048+0000 7fb820860740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56371d067f60 con 0x56371cc8a490 2024-08-31T05:30:53.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.049+0000 7fb820860740 10 client.0 _ll_register_callbacks cb 0x56371cccaba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:30:53.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.049+0000 7fb8137fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56371ccb3350 0x56371d0822e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:53.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.049+0000 7fb8137fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56371ccb3350 0x56371d0822e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53218/0 (socket says 172.21.15.5:53218) 2024-08-31T05:30:53.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.049+0000 7fb8137fe640 1 -- 172.21.15.5:0/409789021 learned_addr learned my addr 172.21.15.5:0/409789021 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:53.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.049+0000 7fb8137fe640 1 -- 172.21.15.5:0/409789021 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56371cc8a490 msgr2=0x56371d064f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:53.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.049+0000 7fb8137fe640 1 --2- 172.21.15.5:0/409789021 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56371cc8a490 0x56371d064f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:53.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.049+0000 7fb8137fe640 1 -- 172.21.15.5:0/409789021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56371cc92670 msgr2=0x56371d0654b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T05:30:53.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.049+0000 7fb8137fe640 1 --2- 172.21.15.5:0/409789021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56371cc92670 0x56371d0654b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:53.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.049+0000 7fb8137fe640 1 -- 172.21.15.5:0/409789021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56371cf7cf30 con 0x56371ccb3350 2024-08-31T05:30:53.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.050+0000 7fb8137fe640 1 --2- 172.21.15.5:0/409789021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56371ccb3350 0x56371d0822e0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fb808006ca0 tx=0x7fb8080236b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8759a1ad7da6db08 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:53.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.050+0000 7fb7f37fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:30:53.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.050+0000 7fb7f37fe640 1 -- 172.21.15.5:0/409789021 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb808029070 con 0x56371ccb3350 2024-08-31T05:30:53.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.050+0000 7fb7f37fe640 1 -- 172.21.15.5:0/409789021 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fb8080253f0 con 0x56371ccb3350 2024-08-31T05:30:53.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.050+0000 7fb820860740 1 -- 172.21.15.5:0/409789021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8040043d0 con 0x56371ccb3350 2024-08-31T05:30:53.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.050+0000 7fb7f37fe640 1 -- 172.21.15.5:0/409789021 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb808033050 con 0x56371ccb3350 2024-08-31T05:30:53.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.050+0000 7fb820860740 10 client.15843 fetch_fsmap learned FSMap version 30 2024-08-31T05:30:53.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.050+0000 7fb820860740 1 -- 172.21.15.5:0/409789021 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56371d082880 con 0x56371ccb3350 2024-08-31T05:30:53.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.051+0000 7fb7f37fe640 1 -- 172.21.15.5:0/409789021 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb808025aa0 con 0x56371ccb3350 2024-08-31T05:30:53.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.051+0000 7fb7f37fe640 1 -- 172.21.15.5:0/409789021 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7fb808036020 con 0x56371ccb3350 2024-08-31T05:30:53.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.051+0000 7fb820860740 10 client.15843 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T05:30:53.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.051+0000 7fb820860740 10 client.15843 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:30:53.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.051+0000 7fb820860740 20 client.15843 populate_metadata read hostname 'smithi005' 2024-08-31T05:30:53.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.051+0000 7fb820860740 1 --2- 172.21.15.5:0/409789021 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56371cc71cd0 0x56371d085e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:53.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.051+0000 7fb820860740 4 client.15843 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:30:53.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.051+0000 7fb820860740 1 -- 172.21.15.5:0/409789021 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fb8040043d0 con 0x56371cc71cd0 2024-08-31T05:30:53.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.055+0000 7fb813fff640 1 --2- 172.21.15.5:0/409789021 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56371cc71cd0 0x56371d085e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:53.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.055+0000 7fb813fff640 1 --2- 172.21.15.5:0/409789021 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56371cc71cd0 0x56371d085e90 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=178fa1eccf616f54 server_cookie=c06271327c64a447 in_seq=0 out_seq=0 2024-08-31T05:30:53.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.055+0000 7fb7f37fe640 10 client.15843 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:30:53.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.056+0000 7fb7f37fe640 1 -- 172.21.15.5:0/409789021 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fb8040043d0 con 0x56371cc71cd0 2024-08-31T05:30:53.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.056+0000 7fb7f37fe640 10 client.15843 handle_command_reply: tid=0 2024-08-31T05:30:53.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.056+0000 7fb820860740 1 client.15843 shutdown 2024-08-31T05:30:53.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.057+0000 7fb820860740 1 -- 172.21.15.5:0/409789021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56371ccb3350 msgr2=0x56371d0822e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:53.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.057+0000 7fb820860740 1 --2- 172.21.15.5:0/409789021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56371ccb3350 0x56371d0822e0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fb808006ca0 tx=0x7fb8080236b0 comp rx=0 tx=0).stop 2024-08-31T05:30:53.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.057+0000 7fb820860740 1 -- 172.21.15.5:0/409789021 shutdown_connections 2024-08-31T05:30:53.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.057+0000 7fb820860740 1 --2- 172.21.15.5:0/409789021 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56371cc71cd0 0x56371d085e90 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:53.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.057+0000 7fb7f37fe640 0 client.15843 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:30:53.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.057+0000 7fb820860740 1 --2- 172.21.15.5:0/409789021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56371ccb3350 0x56371d0822e0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:53.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.057+0000 7fb820860740 1 --2- 172.21.15.5:0/409789021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56371cc92670 0x56371d0654b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:53.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.057+0000 7fb820860740 1 --2- 172.21.15.5:0/409789021 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56371cc8a490 0x56371d064f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:53.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.057+0000 7fb820860740 1 -- 172.21.15.5:0/409789021 >> 172.21.15.5:0/409789021 conn(0x56371cca7740 msgr2=0x56371d05c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:53.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.057+0000 7fb820860740 1 -- 172.21.15.5:0/409789021 shutdown_connections 2024-08-31T05:30:53.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.057+0000 7fb820860740 1 -- 172.21.15.5:0/409789021 wait complete. 2024-08-31T05:30:53.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.057+0000 7fb820860740 20 client.15843 trim_cache size 0 max 16384 2024-08-31T05:30:53.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.093+0000 7fb820860740 1 Processor -- start 2024-08-31T05:30:53.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.093+0000 7fb820860740 1 -- start start 2024-08-31T05:30:53.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.094+0000 7fb820860740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56371cc71cd0 0x56371d08ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:53.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.094+0000 7fb8137fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56371cc71cd0 0x56371d08ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:53.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.094+0000 7fb8137fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56371cc71cd0 0x56371d08ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53228/0 (socket says 172.21.15.5:53228) 2024-08-31T05:30:53.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.094+0000 7fb8137fe640 1 -- 172.21.15.5:0/230296501 learned_addr learned my addr 172.21.15.5:0/230296501 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:53.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.094+0000 7fb820860740 1 --2- 172.21.15.5:0/230296501 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56371cc8a490 0x56371d05c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:53.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.094+0000 7fb820860740 1 --2- 172.21.15.5:0/230296501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56371cc92670 0x56371d05cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:53.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.094+0000 7fb820860740 1 -- 172.21.15.5:0/230296501 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb8141a6330 con 0x56371cc71cd0 2024-08-31T05:30:53.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.094+0000 7fb820860740 1 -- 172.21.15.5:0/230296501 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb8141a7e70 con 0x56371cc92670 2024-08-31T05:30:53.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.094+0000 7fb820860740 1 -- 172.21.15.5:0/230296501 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb8141a6a00 con 0x56371cc8a490 2024-08-31T05:30:53.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.095+0000 7fb8137fe640 1 -- 172.21.15.5:0/230296501 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56371cc8a490 msgr2=0x56371d05c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:53.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.095+0000 7fb8137fe640 1 --2- 172.21.15.5:0/230296501 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56371cc8a490 0x56371d05c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:53.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.095+0000 7fb8137fe640 1 -- 172.21.15.5:0/230296501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56371cc92670 msgr2=0x56371d05cdc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T05:30:53.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.095+0000 7fb8137fe640 1 --2- 172.21.15.5:0/230296501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56371cc92670 0x56371d05cdc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:53.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.095+0000 7fb8137fe640 1 -- 172.21.15.5:0/230296501 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56371d05ba70 con 0x56371cc71cd0 2024-08-31T05:30:53.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.095+0000 7fb8137fe640 1 --2- 172.21.15.5:0/230296501 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56371cc71cd0 0x56371d08ad20 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fb80800a920 tx=0x7fb80800ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=557fe72faa47c22d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:53.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.095+0000 7fb7f9ffb640 1 -- 172.21.15.5:0/230296501 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb80803c070 con 0x56371cc71cd0 2024-08-31T05:30:53.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.095+0000 7fb7f9ffb640 1 -- 172.21.15.5:0/230296501 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb80802d860 con 0x56371cc71cd0 2024-08-31T05:30:53.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.095+0000 7fb7f9ffb640 1 -- 172.21.15.5:0/230296501 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb808029070 con 0x56371cc71cd0 2024-08-31T05:30:53.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.097+0000 7fb820860740 1 -- 172.21.15.5:0/230296501 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56371cc71cd0 msgr2=0x56371d08ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:53.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.097+0000 7fb820860740 1 --2- 172.21.15.5:0/230296501 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56371cc71cd0 0x56371d08ad20 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fb80800a920 tx=0x7fb80800ad30 comp rx=0 tx=0).stop 2024-08-31T05:30:53.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.097+0000 7fb820860740 1 -- 172.21.15.5:0/230296501 shutdown_connections 2024-08-31T05:30:53.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.097+0000 7fb820860740 1 --2- 172.21.15.5:0/230296501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56371cc92670 0x56371d05cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:53.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.097+0000 7fb820860740 1 --2- 172.21.15.5:0/230296501 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56371cc8a490 0x56371d05c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:53.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.097+0000 7fb820860740 1 --2- 172.21.15.5:0/230296501 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56371cc71cd0 0x56371d08ad20 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:53.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.097+0000 7fb820860740 1 -- 172.21.15.5:0/230296501 >> 172.21.15.5:0/230296501 conn(0x56371cca7740 msgr2=0x56371d08a610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:53.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.097+0000 7fb820860740 1 -- 172.21.15.5:0/230296501 shutdown_connections 2024-08-31T05:30:53.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.097+0000 7fb820860740 1 -- 172.21.15.5:0/230296501 wait complete. 2024-08-31T05:30:53.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.097+0000 7fb820860740 1 -- start start 2024-08-31T05:30:53.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.098+0000 7fb820860740 1 Processor -- start 2024-08-31T05:30:53.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.098+0000 7fb820860740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56371cc71cd0 0x56371d092a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:53.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.098+0000 7fb820860740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56371cc8a490 0x56371d090000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:53.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.098+0000 7fb820860740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56371cc92670 0x56371d090540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:53.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.099+0000 7fb820860740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb8141a77a0 con 0x56371cc92670 2024-08-31T05:30:53.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.099+0000 7fb820860740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb8141a70d0 con 0x56371cc8a490 2024-08-31T05:30:53.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.099+0000 7fb820860740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb814073d30 con 0x56371cc71cd0 2024-08-31T05:30:53.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.099+0000 7fb820860740 10 client.0 _ll_register_callbacks cb 0x7fb80800a460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:30:53.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.099+0000 7fb813fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56371cc8a490 0x56371d090000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:53.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.099+0000 7fb8137fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56371cc92670 0x56371d090540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:53.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.099+0000 7fb8137fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56371cc71cd0 0x56371d092a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:53.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.099+0000 7fb8137fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56371cc71cd0 0x56371d092a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:59684/0 (socket says 172.21.15.5:59684) 2024-08-31T05:30:53.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.099+0000 7fb8137fe640 1 -- 172.21.15.5:0/2406527740 learned_addr learned my addr 172.21.15.5:0/2406527740 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:53.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.099+0000 7fb8137fe640 1 -- 172.21.15.5:0/2406527740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56371cc71cd0 msgr2=0x56371d092a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:53.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.099+0000 7fb8137fe640 1 --2- 172.21.15.5:0/2406527740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56371cc71cd0 0x56371d092a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:53.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.099+0000 7fb8137fe640 1 -- 172.21.15.5:0/2406527740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56371cc8a490 msgr2=0x56371d090000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:53.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.099+0000 7fb8137fe640 1 --2- 172.21.15.5:0/2406527740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56371cc8a490 0x56371d090000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:53.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.099+0000 7fb8137fe640 1 -- 172.21.15.5:0/2406527740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56371d090a80 con 0x56371cc92670 2024-08-31T05:30:53.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.100+0000 7fb8137fe640 1 --2- 172.21.15.5:0/2406527740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56371cc92670 0x56371d090540 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x56371d0494f0 tx=0x7fb8080236b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6760fc7e8375449 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:53.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.100+0000 7fb7f37fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:30:53.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.100+0000 7fb7f37fe640 1 -- 172.21.15.5:0/2406527740 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb808029070 con 0x56371cc92670 2024-08-31T05:30:53.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.100+0000 7fb7f37fe640 1 -- 172.21.15.5:0/2406527740 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fb80802e640 con 0x56371cc92670 2024-08-31T05:30:53.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.100+0000 7fb820860740 1 -- 172.21.15.5:0/2406527740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56371cfd1540 con 0x56371cc92670 2024-08-31T05:30:53.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.100+0000 7fb7f37fe640 1 -- 172.21.15.5:0/2406527740 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb80804b050 con 0x56371cc92670 2024-08-31T05:30:53.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.101+0000 7fb820860740 10 client.15849 fetch_fsmap learned FSMap version 30 2024-08-31T05:30:53.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.101+0000 7fb820860740 1 -- 172.21.15.5:0/2406527740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56371d0f3440 con 0x56371cc92670 2024-08-31T05:30:53.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.101+0000 7fb7f37fe640 1 -- 172.21.15.5:0/2406527740 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb80802ecf0 con 0x56371cc92670 2024-08-31T05:30:53.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.101+0000 7fb7f37fe640 1 -- 172.21.15.5:0/2406527740 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7fb808042070 con 0x56371cc92670 2024-08-31T05:30:53.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.101+0000 7fb820860740 10 client.15849 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T05:30:53.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.101+0000 7fb820860740 10 client.15849 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:30:53.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.101+0000 7fb820860740 20 client.15849 populate_metadata read hostname 'smithi005' 2024-08-31T05:30:53.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.101+0000 7fb820860740 1 --2- 172.21.15.5:0/2406527740 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56371ccb3350 0x56371d0f5af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:53.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.102+0000 7fb820860740 4 client.15849 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T05:30:53.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.102+0000 7fb820860740 1 -- 172.21.15.5:0/2406527740 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56371cfd1540 con 0x56371ccb3350 2024-08-31T05:30:53.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.102+0000 7fb813fff640 1 --2- 172.21.15.5:0/2406527740 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56371ccb3350 0x56371d0f5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:53.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.103+0000 7fb813fff640 1 --2- 172.21.15.5:0/2406527740 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56371ccb3350 0x56371d0f5af0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc1fdce76f43c3b3 server_cookie=5731d10eb2627b60 in_seq=0 out_seq=0 2024-08-31T05:30:53.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.103+0000 7fb7f37fe640 10 client.15849 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:30:53.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.105+0000 7fb7f37fe640 1 -- 172.21.15.5:0/2406527740 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56371cfd1540 con 0x56371ccb3350 2024-08-31T05:30:53.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.105+0000 7fb7f37fe640 10 client.15849 handle_command_reply: tid=0 2024-08-31T05:30:53.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.105+0000 7fb820860740 1 client.15849 shutdown 2024-08-31T05:30:53.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.105+0000 7fb820860740 1 -- 172.21.15.5:0/2406527740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56371cc92670 msgr2=0x56371d090540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:53.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.106+0000 7fb820860740 1 --2- 172.21.15.5:0/2406527740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56371cc92670 0x56371d090540 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x56371d0494f0 tx=0x7fb8080236b0 comp rx=0 tx=0).stop 2024-08-31T05:30:53.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.106+0000 7fb820860740 1 -- 172.21.15.5:0/2406527740 shutdown_connections 2024-08-31T05:30:53.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.106+0000 7fb820860740 1 --2- 172.21.15.5:0/2406527740 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56371ccb3350 0x56371d0f5af0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:53.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.106+0000 7fb7f37fe640 0 client.15849 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:30:53.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.106+0000 7fb820860740 1 --2- 172.21.15.5:0/2406527740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56371cc92670 0x56371d090540 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:53.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.106+0000 7fb820860740 1 --2- 172.21.15.5:0/2406527740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56371cc8a490 0x56371d090000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:53.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.106+0000 7fb820860740 1 --2- 172.21.15.5:0/2406527740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56371cc71cd0 0x56371d092a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:53.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.106+0000 7fb820860740 1 -- 172.21.15.5:0/2406527740 >> 172.21.15.5:0/2406527740 conn(0x56371cca7740 msgr2=0x56371d08a610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:53.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.106+0000 7fb820860740 1 -- 172.21.15.5:0/2406527740 shutdown_connections 2024-08-31T05:30:53.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.107+0000 7fb820860740 1 -- 172.21.15.5:0/2406527740 wait complete. 2024-08-31T05:30:53.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.107+0000 7fb820860740 20 client.15849 trim_cache size 0 max 16384 2024-08-31T05:30:53.109 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:30:53.109 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-08-31T05:30:53.110 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "cda92ac0-b35f-47a5-a3a5-471c888462a5", 2024-08-31T05:30:53.110 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-08-31T05:30:53.110 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:30:53.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.107+0000 7fb81a2eb640 1 -- 172.21.15.5:0/631737699 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb7fc0b4da0 msgr2=0x7fb7fc0b72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:53.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.107+0000 7fb81a2eb640 1 --2- 172.21.15.5:0/631737699 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb7fc0b4da0 0x7fb7fc0b72b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb80c107f00 tx=0x7fb80c03d040 comp rx=0 tx=0).stop 2024-08-31T05:30:53.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.108+0000 7fb81a2eb640 1 -- 172.21.15.5:0/631737699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb814108a90 msgr2=0x7fb81419e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:53.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.108+0000 7fb81a2eb640 1 --2- 172.21.15.5:0/631737699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb814108a90 0x7fb81419e7f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb80c02ae00 tx=0x7fb80c0095b0 comp rx=0 tx=0).stop 2024-08-31T05:30:53.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.108+0000 7fb81a2eb640 1 -- 172.21.15.5:0/631737699 shutdown_connections 2024-08-31T05:30:53.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.108+0000 7fb81a2eb640 1 --2- 172.21.15.5:0/631737699 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb7fc0b4da0 0x7fb7fc0b72b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:53.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.108+0000 7fb81a2eb640 1 --2- 172.21.15.5:0/631737699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb814108a90 0x7fb81419e7f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:53.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.108+0000 7fb81a2eb640 1 --2- 172.21.15.5:0/631737699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb814108140 0x7fb814199550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:53.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.108+0000 7fb81a2eb640 1 --2- 172.21.15.5:0/631737699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb814102800 0x7fb814198fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:53.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.108+0000 7fb81a2eb640 1 -- 172.21.15.5:0/631737699 >> 172.21.15.5:0/631737699 conn(0x7fb8140794d0 msgr2=0x7fb814109170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:53.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.108+0000 7fb81a2eb640 1 -- 172.21.15.5:0/631737699 shutdown_connections 2024-08-31T05:30:53.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:53.109+0000 7fb81a2eb640 1 -- 172.21.15.5:0/631737699 wait complete. 2024-08-31T05:30:53.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:53 smithi070 ceph-mon[22316]: pgmap v372: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2024-08-31T05:30:53.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:53 smithi050 ceph-mon[22146]: pgmap v372: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2024-08-31T05:30:53.871 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T05:30:54.144 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:30:54.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:54 smithi005 ceph-mon[18602]: scrub queued for path: / 2024-08-31T05:30:54.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:54 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:30:54.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:54 smithi005 ceph-mon[18602]: scrub summary: active paths [/] 2024-08-31T05:30:54.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:54 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:30:54.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:54 smithi070 ceph-mon[22316]: scrub queued for path: / 2024-08-31T05:30:54.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:54 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:30:54.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:54 smithi070 ceph-mon[22316]: scrub summary: active paths [/] 2024-08-31T05:30:54.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:54 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:30:54.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:54 smithi050 ceph-mon[22146]: scrub queued for path: / 2024-08-31T05:30:54.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:54 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:30:54.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:54 smithi050 ceph-mon[22146]: scrub summary: active paths [/] 2024-08-31T05:30:54.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:54 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:30:54.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.714+0000 7f5191a92640 1 -- 172.21.15.5:0/3401085289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f518c10dc00 msgr2=0x7f518c1100f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:54.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.714+0000 7f5191a92640 1 --2- 172.21.15.5:0/3401085289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f518c10dc00 0x7f518c1100f0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f5184009ca0 tx=0x7f518402a8c0 comp rx=0 tx=0).stop 2024-08-31T05:30:54.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.714+0000 7f5191a92640 1 -- 172.21.15.5:0/3401085289 shutdown_connections 2024-08-31T05:30:54.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.714+0000 7f5191a92640 1 --2- 172.21.15.5:0/3401085289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f518c10dc00 0x7f518c1100f0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:54.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.714+0000 7f5191a92640 1 --2- 172.21.15.5:0/3401085289 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f518c1050f0 0x7f518c10d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:54.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.714+0000 7f5191a92640 1 --2- 172.21.15.5:0/3401085289 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f518c1047a0 0x7f518c104bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:54.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.714+0000 7f5191a92640 1 -- 172.21.15.5:0/3401085289 >> 172.21.15.5:0/3401085289 conn(0x7f518c079450 msgr2=0x7f518c079860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:54.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.714+0000 7f5191a92640 1 -- 172.21.15.5:0/3401085289 shutdown_connections 2024-08-31T05:30:54.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.714+0000 7f5191a92640 1 -- 172.21.15.5:0/3401085289 wait complete. 2024-08-31T05:30:54.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.715+0000 7f5191a92640 1 Processor -- start 2024-08-31T05:30:54.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.715+0000 7f5191a92640 1 -- start start 2024-08-31T05:30:54.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.715+0000 7f5191a92640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f518c1047a0 0x7f518c19a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:54.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.715+0000 7f5191a92640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f518c1050f0 0x7f518c19a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:54.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.716+0000 7f5191a92640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f518c10dc00 0x7f518c19f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:54.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.716+0000 7f5191a92640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f518c1138b0 con 0x7f518c1050f0 2024-08-31T05:30:54.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.716+0000 7f5191a92640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f518c113730 con 0x7f518c10dc00 2024-08-31T05:30:54.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.716+0000 7f5191a92640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f518c113a30 con 0x7f518c1047a0 2024-08-31T05:30:54.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.716+0000 7f518b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f518c1047a0 0x7f518c19a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:54.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.716+0000 7f518affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f518c1050f0 0x7f518c19a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:54.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.716+0000 7f518b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f518c1047a0 0x7f518c19a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:59702/0 (socket says 172.21.15.5:59702) 2024-08-31T05:30:54.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.716+0000 7f518b7fe640 1 -- 172.21.15.5:0/354244277 learned_addr learned my addr 172.21.15.5:0/354244277 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:54.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.716+0000 7f518bfff640 1 --2- 172.21.15.5:0/354244277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f518c10dc00 0x7f518c19f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:54.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.716+0000 7f518b7fe640 1 -- 172.21.15.5:0/354244277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f518c10dc00 msgr2=0x7f518c19f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:54.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.716+0000 7f518b7fe640 1 --2- 172.21.15.5:0/354244277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f518c10dc00 0x7f518c19f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:54.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.716+0000 7f518b7fe640 1 -- 172.21.15.5:0/354244277 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f518c1050f0 msgr2=0x7f518c19a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:54.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.716+0000 7f518b7fe640 1 --2- 172.21.15.5:0/354244277 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f518c1050f0 0x7f518c19a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:54.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.716+0000 7f518b7fe640 1 -- 172.21.15.5:0/354244277 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f518c19fff0 con 0x7f518c1047a0 2024-08-31T05:30:54.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.716+0000 7f518affd640 1 --2- 172.21.15.5:0/354244277 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f518c1050f0 0x7f518c19a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:30:54.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.717+0000 7f518b7fe640 1 --2- 172.21.15.5:0/354244277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f518c1047a0 0x7f518c19a080 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f517c00e9c0 tx=0x7f517c00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:54.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.717+0000 7f5188ff9640 1 -- 172.21.15.5:0/354244277 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517c00cd80 con 0x7f518c1047a0 2024-08-31T05:30:54.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.717+0000 7f5191a92640 1 -- 172.21.15.5:0/354244277 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f518c1a02e0 con 0x7f518c1047a0 2024-08-31T05:30:54.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.717+0000 7f5188ff9640 1 -- 172.21.15.5:0/354244277 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f517c0035f0 con 0x7f518c1047a0 2024-08-31T05:30:54.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.717+0000 7f5191a92640 1 -- 172.21.15.5:0/354244277 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f518c1a6a40 con 0x7f518c1047a0 2024-08-31T05:30:54.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.718+0000 7f5188ff9640 1 -- 172.21.15.5:0/354244277 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517c010690 con 0x7f518c1047a0 2024-08-31T05:30:54.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.721+0000 7f5198007740 1 Processor -- start 2024-08-31T05:30:54.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.721+0000 7f5198007740 1 -- start start 2024-08-31T05:30:54.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.721+0000 7f5198007740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562376dfc070 0x5623771a1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:54.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.721+0000 7f5198007740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562376dd31b0 0x5623771a1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:54.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.721+0000 7f5198007740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562376ddb390 0x5623771a1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:54.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.722+0000 7f5198007740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x562377118630 con 0x562376ddb390 2024-08-31T05:30:54.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.722+0000 7f518affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562376ddb390 0x5623771a1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:54.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.722+0000 7f518affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562376ddb390 0x5623771a1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53260/0 (socket says 172.21.15.5:53260) 2024-08-31T05:30:54.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.722+0000 7f518affd640 1 -- 172.21.15.5:0/2597592953 learned_addr learned my addr 172.21.15.5:0/2597592953 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:54.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.722+0000 7f5198007740 1 -- 172.21.15.5:0/2597592953 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562377107bc0 con 0x562376dd31b0 2024-08-31T05:30:54.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.722+0000 7f518bfff640 1 --2- 172.21.15.5:0/2597592953 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562376dfc070 0x5623771a1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:54.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.722+0000 7f5198007740 1 -- 172.21.15.5:0/2597592953 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56237710bb70 con 0x562376dfc070 2024-08-31T05:30:54.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.722+0000 7f518affd640 1 -- 172.21.15.5:0/2597592953 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562376dfc070 msgr2=0x5623771a1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:54.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.722+0000 7f518affd640 1 --2- 172.21.15.5:0/2597592953 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562376dfc070 0x5623771a1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:54.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.722+0000 7f518affd640 1 -- 172.21.15.5:0/2597592953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562376dd31b0 msgr2=0x5623771a1840 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T05:30:54.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.722+0000 7f518affd640 1 --2- 172.21.15.5:0/2597592953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562376dd31b0 0x5623771a1840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:54.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.722+0000 7f518affd640 1 -- 172.21.15.5:0/2597592953 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562376e67650 con 0x562376ddb390 2024-08-31T05:30:54.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.722+0000 7f518bfff640 1 --2- 172.21.15.5:0/2597592953 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562376dfc070 0x5623771a1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:30:54.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.723+0000 7f5188ff9640 1 -- 172.21.15.5:0/354244277 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 24) ==== 152701+0+0 (secure 0 0 0) 0x7f517c0037a0 con 0x7f518c1047a0 2024-08-31T05:30:54.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.723+0000 7f518affd640 1 --2- 172.21.15.5:0/2597592953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562376ddb390 0x5623771a1d80 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f518c06b720 tx=0x7f5180010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0c84a23f7d95177 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:54.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.723+0000 7f5171ffb640 1 -- 172.21.15.5:0/2597592953 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5180004220 con 0x562376ddb390 2024-08-31T05:30:54.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.723+0000 7f5171ffb640 1 -- 172.21.15.5:0/2597592953 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51800043c0 con 0x562376ddb390 2024-08-31T05:30:54.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.723+0000 7f5171ffb640 1 -- 172.21.15.5:0/2597592953 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51800119c0 con 0x562376ddb390 2024-08-31T05:30:54.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.724+0000 7f5188ff9640 1 --2- 172.21.15.5:0/354244277 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f51740b4ea0 0x7f51740b73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:54.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.724+0000 7f518bfff640 1 --2- 172.21.15.5:0/354244277 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f51740b4ea0 0x7f51740b73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:54.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.724+0000 7f5188ff9640 1 -- 172.21.15.5:0/354244277 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f517c010430 con 0x7f518c1047a0 2024-08-31T05:30:54.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.724+0000 7f5198007740 1 -- 172.21.15.5:0/2597592953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562376ddb390 msgr2=0x5623771a1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:54.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.724+0000 7f5198007740 1 --2- 172.21.15.5:0/2597592953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562376ddb390 0x5623771a1d80 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f518c06b720 tx=0x7f5180010860 comp rx=0 tx=0).stop 2024-08-31T05:30:54.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.724+0000 7f5198007740 1 -- 172.21.15.5:0/2597592953 shutdown_connections 2024-08-31T05:30:54.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.724+0000 7f5198007740 1 --2- 172.21.15.5:0/2597592953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562376ddb390 0x5623771a1d80 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:54.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.724+0000 7f5198007740 1 --2- 172.21.15.5:0/2597592953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562376dd31b0 0x5623771a1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:54.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.724+0000 7f5198007740 1 --2- 172.21.15.5:0/2597592953 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562376dfc070 0x5623771a1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:54.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.724+0000 7f5198007740 1 -- 172.21.15.5:0/2597592953 >> 172.21.15.5:0/2597592953 conn(0x562376df0460 msgr2=0x56237719f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:54.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.725+0000 7f5198007740 1 -- 172.21.15.5:0/2597592953 shutdown_connections 2024-08-31T05:30:54.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.725+0000 7f518bfff640 1 --2- 172.21.15.5:0/354244277 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f51740b4ea0 0x7f51740b73b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5184009620 tx=0x7f5184009560 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:54.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.725+0000 7f5198007740 1 -- 172.21.15.5:0/2597592953 wait complete. 2024-08-31T05:30:54.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.725+0000 7f5198007740 1 -- start start 2024-08-31T05:30:54.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.726+0000 7f5198007740 1 Processor -- start 2024-08-31T05:30:54.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.726+0000 7f5198007740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562376dd31b0 0x5623771acaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:54.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.726+0000 7f5198007740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562376ddb390 0x5623771acfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:54.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.726+0000 7f5198007740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562376dfc070 0x5623771b8e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:54.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.726+0000 7f5198007740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x562376f6a700 con 0x562376dd31b0 2024-08-31T05:30:54.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.726+0000 7f5198007740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56237708e700 con 0x562376dfc070 2024-08-31T05:30:54.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.726+0000 7f5198007740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5623771afb30 con 0x562376ddb390 2024-08-31T05:30:54.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.726+0000 7f5198007740 10 client.0 _ll_register_callbacks cb 0x5623770bddc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:30:54.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.726+0000 7f518b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562376dd31b0 0x5623771acaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:54.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.726+0000 7f518b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562376dd31b0 0x5623771acaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53264/0 (socket says 172.21.15.5:53264) 2024-08-31T05:30:54.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.726+0000 7f518b7fe640 1 -- 172.21.15.5:0/1298450855 learned_addr learned my addr 172.21.15.5:0/1298450855 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:54.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.726+0000 7f518affd640 1 --2- 172.21.15.5:0/1298450855 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562376ddb390 0x5623771acfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:54.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.726+0000 7f518bfff640 1 --2- 172.21.15.5:0/1298450855 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562376dfc070 0x5623771b8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:54.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.727+0000 7f518b7fe640 1 -- 172.21.15.5:0/1298450855 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562376ddb390 msgr2=0x5623771acfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:54.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.727+0000 7f518b7fe640 1 --2- 172.21.15.5:0/1298450855 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562376ddb390 0x5623771acfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:54.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.727+0000 7f518b7fe640 1 -- 172.21.15.5:0/1298450855 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562376dfc070 msgr2=0x5623771b8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:54.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.727+0000 7f518b7fe640 1 --2- 172.21.15.5:0/1298450855 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562376dfc070 0x5623771b8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:54.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.727+0000 7f518b7fe640 1 -- 172.21.15.5:0/1298450855 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623770c78b0 con 0x562376dd31b0 2024-08-31T05:30:54.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.727+0000 7f518affd640 1 --2- 172.21.15.5:0/1298450855 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562376ddb390 0x5623771acfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:30:54.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.727+0000 7f518b7fe640 1 --2- 172.21.15.5:0/1298450855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562376dd31b0 0x5623771acaa0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f517c0e2ec0 tx=0x7f517c0ab9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=650e75681c43d7f7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:54.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.727+0000 7f516affd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:30:54.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.727+0000 7f516affd640 1 -- 172.21.15.5:0/1298450855 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517c0b0670 con 0x562376dd31b0 2024-08-31T05:30:54.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.727+0000 7f516affd640 1 -- 172.21.15.5:0/1298450855 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f517c093110 con 0x562376dd31b0 2024-08-31T05:30:54.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.727+0000 7f5198007740 1 -- 172.21.15.5:0/1298450855 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51800043c0 con 0x562376dd31b0 2024-08-31T05:30:54.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.728+0000 7f516affd640 1 -- 172.21.15.5:0/1298450855 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f517c0c6050 con 0x562376dd31b0 2024-08-31T05:30:54.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.728+0000 7f5198007740 10 client.15861 fetch_fsmap learned FSMap version 30 2024-08-31T05:30:54.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.728+0000 7f5198007740 1 -- 172.21.15.5:0/1298450855 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5623771bb930 con 0x562376dd31b0 2024-08-31T05:30:54.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.728+0000 7f516affd640 1 -- 172.21.15.5:0/1298450855 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51800043c0 con 0x562376dd31b0 2024-08-31T05:30:54.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.728+0000 7f516affd640 1 -- 172.21.15.5:0/1298450855 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f517c0c6cc0 con 0x562376dd31b0 2024-08-31T05:30:54.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.729+0000 7f5198007740 10 client.15861 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T05:30:54.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.729+0000 7f5198007740 10 client.15861 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:30:54.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.729+0000 7f5198007740 20 client.15861 populate_metadata read hostname 'smithi005' 2024-08-31T05:30:54.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.729+0000 7f5198007740 1 --2- 172.21.15.5:0/1298450855 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x562376dba9f0 0x5623771bed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:54.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.729+0000 7f5198007740 4 client.15861 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:30:54.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.729+0000 7f5198007740 1 -- 172.21.15.5:0/1298450855 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56237711a580 con 0x562376dba9f0 2024-08-31T05:30:54.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.729+0000 7f518affd640 1 --2- 172.21.15.5:0/1298450855 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x562376dba9f0 0x5623771bed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:54.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.729+0000 7f516affd640 10 client.15861 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:30:54.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.729+0000 7f518affd640 1 --2- 172.21.15.5:0/1298450855 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x562376dba9f0 0x5623771bed90 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95ceb3d493c81e22 server_cookie=b36ef360249f3efe in_seq=0 out_seq=0 2024-08-31T05:30:54.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.730+0000 7f516affd640 1 -- 172.21.15.5:0/1298450855 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56237711a580 con 0x562376dba9f0 2024-08-31T05:30:54.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.730+0000 7f516affd640 10 client.15861 handle_command_reply: tid=0 2024-08-31T05:30:54.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.730+0000 7f5198007740 1 client.15861 shutdown 2024-08-31T05:30:54.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.731+0000 7f5198007740 1 -- 172.21.15.5:0/1298450855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562376dd31b0 msgr2=0x5623771acaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:54.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.731+0000 7f5198007740 1 --2- 172.21.15.5:0/1298450855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562376dd31b0 0x5623771acaa0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f517c0e2ec0 tx=0x7f517c0ab9d0 comp rx=0 tx=0).stop 2024-08-31T05:30:54.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.731+0000 7f5198007740 1 -- 172.21.15.5:0/1298450855 shutdown_connections 2024-08-31T05:30:54.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.731+0000 7f5198007740 1 --2- 172.21.15.5:0/1298450855 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x562376dba9f0 0x5623771bed90 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:54.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.731+0000 7f5198007740 1 --2- 172.21.15.5:0/1298450855 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562376dfc070 0x5623771b8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:54.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.731+0000 7f5198007740 1 --2- 172.21.15.5:0/1298450855 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562376ddb390 0x5623771acfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:54.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.731+0000 7f5198007740 1 --2- 172.21.15.5:0/1298450855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562376dd31b0 0x5623771acaa0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:54.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.731+0000 7f5198007740 1 -- 172.21.15.5:0/1298450855 >> 172.21.15.5:0/1298450855 conn(0x562376df0460 msgr2=0x5623771a4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:54.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.731+0000 7f516affd640 0 client.15861 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:30:54.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.731+0000 7f5198007740 1 -- 172.21.15.5:0/1298450855 shutdown_connections 2024-08-31T05:30:54.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.731+0000 7f5198007740 1 -- 172.21.15.5:0/1298450855 wait complete. 2024-08-31T05:30:54.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.732+0000 7f5198007740 20 client.15861 trim_cache size 0 max 16384 2024-08-31T05:30:54.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.749+0000 7f5198007740 1 Processor -- start 2024-08-31T05:30:54.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.749+0000 7f5198007740 1 -- start start 2024-08-31T05:30:54.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.750+0000 7f5198007740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562376ddb390 0x5623771a8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:54.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.750+0000 7f5198007740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562376dfc070 0x5623771a4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:54.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.750+0000 7f5198007740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562376d8fda0 0x5623771a9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:54.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.750+0000 7f5198007740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f518c1b0cb0 con 0x562376dfc070 2024-08-31T05:30:54.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.750+0000 7f5198007740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f518c1b27f0 con 0x562376d8fda0 2024-08-31T05:30:54.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.750+0000 7f5198007740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f518c1b1380 con 0x562376ddb390 2024-08-31T05:30:54.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.750+0000 7f518affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562376dfc070 0x5623771a4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:54.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.750+0000 7f518affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562376dfc070 0x5623771a4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53270/0 (socket says 172.21.15.5:53270) 2024-08-31T05:30:54.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.750+0000 7f518affd640 1 -- 172.21.15.5:0/719477518 learned_addr learned my addr 172.21.15.5:0/719477518 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:54.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.750+0000 7f518bfff640 1 --2- 172.21.15.5:0/719477518 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562376d8fda0 0x5623771a9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:54.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.751+0000 7f518affd640 1 -- 172.21.15.5:0/719477518 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562376ddb390 msgr2=0x5623771a8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:54.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.751+0000 7f518affd640 1 --2- 172.21.15.5:0/719477518 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562376ddb390 0x5623771a8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:54.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.751+0000 7f518affd640 1 -- 172.21.15.5:0/719477518 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562376d8fda0 msgr2=0x5623771a9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:54.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.751+0000 7f518affd640 1 --2- 172.21.15.5:0/719477518 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562376d8fda0 0x5623771a9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:54.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.751+0000 7f518affd640 1 -- 172.21.15.5:0/719477518 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623771ad920 con 0x562376dfc070 2024-08-31T05:30:54.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.751+0000 7f518affd640 1 --2- 172.21.15.5:0/719477518 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562376dfc070 0x5623771a4b10 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f5180000c00 tx=0x7f518000b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c67fadcfb6dcc894 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:54.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.751+0000 7f51717fa640 1 -- 172.21.15.5:0/719477518 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51800054d0 con 0x562376dfc070 2024-08-31T05:30:54.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.751+0000 7f51717fa640 1 -- 172.21.15.5:0/719477518 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5180004b10 con 0x562376dfc070 2024-08-31T05:30:54.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.751+0000 7f51717fa640 1 -- 172.21.15.5:0/719477518 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5180011ab0 con 0x562376dfc070 2024-08-31T05:30:54.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.752+0000 7f5198007740 1 -- 172.21.15.5:0/719477518 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562376dfc070 msgr2=0x5623771a4b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:54.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.752+0000 7f5198007740 1 --2- 172.21.15.5:0/719477518 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562376dfc070 0x5623771a4b10 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f5180000c00 tx=0x7f518000b410 comp rx=0 tx=0).stop 2024-08-31T05:30:54.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.752+0000 7f5198007740 1 -- 172.21.15.5:0/719477518 shutdown_connections 2024-08-31T05:30:54.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.752+0000 7f5198007740 1 --2- 172.21.15.5:0/719477518 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562376d8fda0 0x5623771a9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:54.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.752+0000 7f5198007740 1 --2- 172.21.15.5:0/719477518 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562376dfc070 0x5623771a4b10 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:54.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.752+0000 7f5198007740 1 --2- 172.21.15.5:0/719477518 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562376ddb390 0x5623771a8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:54.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.752+0000 7f5198007740 1 -- 172.21.15.5:0/719477518 >> 172.21.15.5:0/719477518 conn(0x562376df0460 msgr2=0x5623771a4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:54.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.752+0000 7f5198007740 1 -- 172.21.15.5:0/719477518 shutdown_connections 2024-08-31T05:30:54.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.752+0000 7f5198007740 1 -- 172.21.15.5:0/719477518 wait complete. 2024-08-31T05:30:54.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.753+0000 7f5198007740 1 -- start start 2024-08-31T05:30:54.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.753+0000 7f5198007740 1 Processor -- start 2024-08-31T05:30:54.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.753+0000 7f5198007740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562376d8fda0 0x5623771b5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:54.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.753+0000 7f5198007740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562376ddb390 0x5623771b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:54.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.753+0000 7f5198007740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623771b0e30 0x5623771b1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:54.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.753+0000 7f5198007740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f518c1b2120 con 0x5623771b0e30 2024-08-31T05:30:54.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.753+0000 7f5198007740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f518c1b1a50 con 0x562376d8fda0 2024-08-31T05:30:54.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.753+0000 7f5198007740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f518c1aec90 con 0x562376ddb390 2024-08-31T05:30:54.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.753+0000 7f5198007740 10 client.0 _ll_register_callbacks cb 0x7f517c009700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:30:54.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.753+0000 7f518bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623771b0e30 0x5623771b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:54.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.753+0000 7f518bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623771b0e30 0x5623771b1240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53284/0 (socket says 172.21.15.5:53284) 2024-08-31T05:30:54.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.753+0000 7f518bfff640 1 -- 172.21.15.5:0/2768669442 learned_addr learned my addr 172.21.15.5:0/2768669442 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:30:54.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.753+0000 7f518affd640 1 --2- 172.21.15.5:0/2768669442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562376ddb390 0x5623771b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:54.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.754+0000 7f518b7fe640 1 --2- 172.21.15.5:0/2768669442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562376d8fda0 0x5623771b5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:54.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.754+0000 7f518bfff640 1 -- 172.21.15.5:0/2768669442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562376ddb390 msgr2=0x5623771b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:54.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.754+0000 7f518bfff640 1 --2- 172.21.15.5:0/2768669442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562376ddb390 0x5623771b08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:54.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.754+0000 7f518bfff640 1 -- 172.21.15.5:0/2768669442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562376d8fda0 msgr2=0x5623771b5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:30:54.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.754+0000 7f518bfff640 1 --2- 172.21.15.5:0/2768669442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562376d8fda0 0x5623771b5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:54.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.754+0000 7f518bfff640 1 -- 172.21.15.5:0/2768669442 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562377228750 con 0x5623771b0e30 2024-08-31T05:30:54.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.754+0000 7f518bfff640 1 --2- 172.21.15.5:0/2768669442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623771b0e30 0x5623771b1240 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f5184009ca0 tx=0x7f5184005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d52eca2a9109252 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:30:54.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.754+0000 7f516affd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:30:54.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.754+0000 7f516affd640 1 -- 172.21.15.5:0/2768669442 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5184004250 con 0x5623771b0e30 2024-08-31T05:30:54.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.754+0000 7f516affd640 1 -- 172.21.15.5:0/2768669442 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f51840043f0 con 0x5623771b0e30 2024-08-31T05:30:54.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.754+0000 7f5198007740 1 -- 172.21.15.5:0/2768669442 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5180004b10 con 0x5623771b0e30 2024-08-31T05:30:54.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.755+0000 7f516affd640 1 -- 172.21.15.5:0/2768669442 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f51840045f0 con 0x5623771b0e30 2024-08-31T05:30:54.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.755+0000 7f5198007740 10 client.15867 fetch_fsmap learned FSMap version 30 2024-08-31T05:30:54.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.755+0000 7f5198007740 1 -- 172.21.15.5:0/2768669442 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x562377229990 con 0x5623771b0e30 2024-08-31T05:30:54.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.755+0000 7f516affd640 1 -- 172.21.15.5:0/2768669442 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5180004b10 con 0x5623771b0e30 2024-08-31T05:30:54.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.755+0000 7f516affd640 1 -- 172.21.15.5:0/2768669442 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f51840305c0 con 0x5623771b0e30 2024-08-31T05:30:54.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.755+0000 7f5198007740 10 client.15867 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T05:30:54.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.755+0000 7f5198007740 10 client.15867 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:30:54.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.755+0000 7f5198007740 20 client.15867 populate_metadata read hostname 'smithi005' 2024-08-31T05:30:54.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.755+0000 7f5198007740 1 --2- 172.21.15.5:0/2768669442 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56237722a170 0x56237722c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:30:54.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.755+0000 7f5198007740 4 client.15867 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T05:30:54.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.755+0000 7f5198007740 1 -- 172.21.15.5:0/2768669442 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562377116020 con 0x56237722a170 2024-08-31T05:30:54.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.756+0000 7f518b7fe640 1 --2- 172.21.15.5:0/2768669442 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56237722a170 0x56237722c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:30:54.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.756+0000 7f516affd640 10 client.15867 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:30:54.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.756+0000 7f518b7fe640 1 --2- 172.21.15.5:0/2768669442 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56237722a170 0x56237722c590 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba27078fc82bb90 server_cookie=a8a4313844a89c5c in_seq=0 out_seq=0 2024-08-31T05:30:54.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.756+0000 7f516affd640 1 -- 172.21.15.5:0/2768669442 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+854 (crc 0 0 0) 0x562377116020 con 0x56237722a170 2024-08-31T05:30:54.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.756+0000 7f516affd640 10 client.15867 handle_command_reply: tid=0 2024-08-31T05:30:54.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.756+0000 7f5198007740 1 client.15867 shutdown 2024-08-31T05:30:54.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.756+0000 7f5198007740 1 -- 172.21.15.5:0/2768669442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623771b0e30 msgr2=0x5623771b1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:54.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.757+0000 7f5198007740 1 --2- 172.21.15.5:0/2768669442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623771b0e30 0x5623771b1240 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f5184009ca0 tx=0x7f5184005fd0 comp rx=0 tx=0).stop 2024-08-31T05:30:54.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.757+0000 7f5198007740 1 -- 172.21.15.5:0/2768669442 shutdown_connections 2024-08-31T05:30:54.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.757+0000 7f5198007740 1 --2- 172.21.15.5:0/2768669442 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56237722a170 0x56237722c590 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:54.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.757+0000 7f5198007740 1 --2- 172.21.15.5:0/2768669442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5623771b0e30 0x5623771b1240 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:54.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.757+0000 7f5198007740 1 --2- 172.21.15.5:0/2768669442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562376ddb390 0x5623771b08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:54.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.757+0000 7f5198007740 1 --2- 172.21.15.5:0/2768669442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562376d8fda0 0x5623771b5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:54.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.757+0000 7f5198007740 1 -- 172.21.15.5:0/2768669442 >> 172.21.15.5:0/2768669442 conn(0x562376df0460 msgr2=0x5623771ab1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:54.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.757+0000 7f516affd640 0 client.15867 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:30:54.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.757+0000 7f5198007740 1 -- 172.21.15.5:0/2768669442 shutdown_connections 2024-08-31T05:30:54.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.757+0000 7f5198007740 1 -- 172.21.15.5:0/2768669442 wait complete. 2024-08-31T05:30:54.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.757+0000 7f5198007740 20 client.15867 trim_cache size 0 max 16384 2024-08-31T05:30:54.763 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:30:54.763 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T05:30:54.763 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2024-08-31T05:30:54.763 INFO:teuthology.orchestra.run.smithi005.stdout: "cda92ac0-b35f-47a5-a3a5-471c888462a5": { 2024-08-31T05:30:54.764 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:30:54.764 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "cda92ac0-b35f-47a5-a3a5-471c888462a5", 2024-08-31T05:30:54.764 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2024-08-31T05:30:54.764 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:30:54.764 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:30:54.764 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_stats": { 2024-08-31T05:30:54.764 INFO:teuthology.orchestra.run.smithi005.stdout: "cda92ac0-b35f-47a5-a3a5-471c888462a5": { 2024-08-31T05:30:54.764 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:53.103905+0000", 2024-08-31T05:30:54.764 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:30:54.764 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:30:54.764 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:30:54.764 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:30:54.764 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:30:54.764 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:30:54.765 INFO:teuthology.orchestra.run.smithi005.stdout: "75d84398-5d9c-4872-b879-2fbce045fa71": { 2024-08-31T05:30:54.765 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:06.642335+0000", 2024-08-31T05:30:54.765 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:30:54.765 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:30:54.765 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:30:54.765 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:30:54.765 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:30:54.765 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:30:54.765 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:30:54.765 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:30:54.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.759+0000 7f5191a92640 1 -- 172.21.15.5:0/354244277 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f51740b4ea0 msgr2=0x7f51740b73b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:54.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.759+0000 7f5191a92640 1 --2- 172.21.15.5:0/354244277 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f51740b4ea0 0x7f51740b73b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5184009620 tx=0x7f5184009560 comp rx=0 tx=0).stop 2024-08-31T05:30:54.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.759+0000 7f5191a92640 1 -- 172.21.15.5:0/354244277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f518c1047a0 msgr2=0x7f518c19a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:30:54.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.759+0000 7f5191a92640 1 --2- 172.21.15.5:0/354244277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f518c1047a0 0x7f518c19a080 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f517c00e9c0 tx=0x7f517c00ee80 comp rx=0 tx=0).stop 2024-08-31T05:30:54.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.759+0000 7f5191a92640 1 -- 172.21.15.5:0/354244277 shutdown_connections 2024-08-31T05:30:54.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.759+0000 7f5191a92640 1 --2- 172.21.15.5:0/354244277 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f51740b4ea0 0x7f51740b73b0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:54.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.759+0000 7f5191a92640 1 --2- 172.21.15.5:0/354244277 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f518c10dc00 0x7f518c19f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:54.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.759+0000 7f5191a92640 1 --2- 172.21.15.5:0/354244277 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f518c1050f0 0x7f518c19a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:54.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.759+0000 7f5191a92640 1 --2- 172.21.15.5:0/354244277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f518c1047a0 0x7f518c19a080 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:30:54.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.759+0000 7f5191a92640 1 -- 172.21.15.5:0/354244277 >> 172.21.15.5:0/354244277 conn(0x7f518c079450 msgr2=0x7f518c1055e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:30:54.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.759+0000 7f5191a92640 1 -- 172.21.15.5:0/354244277 shutdown_connections 2024-08-31T05:30:54.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:30:54.759+0000 7f5191a92640 1 -- 172.21.15.5:0/354244277 wait complete. 2024-08-31T05:30:55.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:55 smithi070 ceph-mon[22316]: pgmap v373: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-08-31T05:30:55.389 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:55 smithi005 ceph-mon[18602]: pgmap v373: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-08-31T05:30:55.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:55 smithi050 ceph-mon[22146]: pgmap v373: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-08-31T05:30:55.431 INFO:tasks.cephfs.filesystem:scrub status for tag:cda92ac0-b35f-47a5-a3a5-471c888462a5 - {'path': '/', 'tag': 'cda92ac0-b35f-47a5-a3a5-471c888462a5', 'options': 'recursive,force'} 2024-08-31T05:30:57.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:57 smithi070 ceph-mon[22316]: pgmap v374: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 767 B/s wr, 12 op/s 2024-08-31T05:30:57.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:57 smithi050 ceph-mon[22146]: pgmap v374: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 767 B/s wr, 12 op/s 2024-08-31T05:30:57.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:57 smithi005 ceph-mon[18602]: pgmap v374: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 767 B/s wr, 12 op/s 2024-08-31T05:30:58.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:58 smithi070 ceph-mon[22316]: scrub summary: idle 2024-08-31T05:30:58.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:58 smithi050 ceph-mon[22146]: scrub summary: idle 2024-08-31T05:30:58.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:58 smithi005 ceph-mon[18602]: scrub summary: idle 2024-08-31T05:30:59.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:30:59 smithi070 ceph-mon[22316]: pgmap v375: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 11 op/s 2024-08-31T05:30:59.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:30:59 smithi050 ceph-mon[22146]: pgmap v375: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 11 op/s 2024-08-31T05:30:59.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:30:59 smithi005 ceph-mon[18602]: pgmap v375: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 11 op/s 2024-08-31T05:31:00.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.330+0000 7f5b813c6640 1 -- 172.21.15.5:0/318944714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b7c1089e0 msgr2=0x7f5b7c10f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:00.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.330+0000 7f5b813c6640 1 --2- 172.21.15.5:0/318944714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b7c1089e0 0x7f5b7c10f210 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f5b74009ca0 tx=0x7f5b7402a8c0 comp rx=0 tx=0).stop 2024-08-31T05:31:00.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.330+0000 7f5b813c6640 1 -- 172.21.15.5:0/318944714 shutdown_connections 2024-08-31T05:31:00.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.330+0000 7f5b813c6640 1 --2- 172.21.15.5:0/318944714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b7c1089e0 0x7f5b7c10f210 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:00.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.330+0000 7f5b813c6640 1 --2- 172.21.15.5:0/318944714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b7c108090 0x7f5b7c1084a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:00.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.330+0000 7f5b813c6640 1 --2- 172.21.15.5:0/318944714 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b7c102760 0x7f5b7c102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:00.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.330+0000 7f5b813c6640 1 -- 172.21.15.5:0/318944714 >> 172.21.15.5:0/318944714 conn(0x7f5b7c0fe160 msgr2=0x7f5b7c1005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:00.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.330+0000 7f5b813c6640 1 -- 172.21.15.5:0/318944714 shutdown_connections 2024-08-31T05:31:00.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.330+0000 7f5b813c6640 1 -- 172.21.15.5:0/318944714 wait complete. 2024-08-31T05:31:00.335 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.331+0000 7f5b813c6640 1 Processor -- start 2024-08-31T05:31:00.335 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.331+0000 7f5b813c6640 1 -- start start 2024-08-31T05:31:00.335 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.332+0000 7f5b813c6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b7c102760 0x7f5b7c19b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:00.335 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.332+0000 7f5b813c6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b7c108090 0x7f5b7c19b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:00.335 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.332+0000 7f5b813c6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b7c1089e0 0x7f5b7c19bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:00.335 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.332+0000 7f5b813c6640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5b7c1126b0 con 0x7f5b7c102760 2024-08-31T05:31:00.335 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.332+0000 7f5b813c6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5b7c112530 con 0x7f5b7c108090 2024-08-31T05:31:00.335 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.332+0000 7f5b813c6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5b7c112830 con 0x7f5b7c1089e0 2024-08-31T05:31:00.335 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.332+0000 7f5b7affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b7c102760 0x7f5b7c19b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:00.335 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.332+0000 7f5b7affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b7c102760 0x7f5b7c19b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53298/0 (socket says 172.21.15.5:53298) 2024-08-31T05:31:00.335 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.332+0000 7f5b7affd640 1 -- 172.21.15.5:0/1778802601 learned_addr learned my addr 172.21.15.5:0/1778802601 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:00.335 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.332+0000 7f5b7a7fc640 1 --2- 172.21.15.5:0/1778802601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b7c108090 0x7f5b7c19b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:00.336 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.332+0000 7f5b7b7fe640 1 --2- 172.21.15.5:0/1778802601 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b7c1089e0 0x7f5b7c19bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:00.336 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.332+0000 7f5b7a7fc640 1 -- 172.21.15.5:0/1778802601 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b7c1089e0 msgr2=0x7f5b7c19bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:00.336 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.332+0000 7f5b7a7fc640 1 --2- 172.21.15.5:0/1778802601 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b7c1089e0 0x7f5b7c19bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:00.336 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.332+0000 7f5b7a7fc640 1 -- 172.21.15.5:0/1778802601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b7c102760 msgr2=0x7f5b7c19b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:00.336 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.332+0000 7f5b7a7fc640 1 --2- 172.21.15.5:0/1778802601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b7c102760 0x7f5b7c19b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:00.336 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.332+0000 7f5b7a7fc640 1 -- 172.21.15.5:0/1778802601 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b7c1a62f0 con 0x7f5b7c108090 2024-08-31T05:31:00.336 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.332+0000 7f5b7affd640 1 --2- 172.21.15.5:0/1778802601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b7c102760 0x7f5b7c19b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:31:00.336 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.332+0000 7f5b7a7fc640 1 --2- 172.21.15.5:0/1778802601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b7c108090 0x7f5b7c19b5a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c06a710 tx=0x7f5b7000ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:00.336 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.333+0000 7f5b63fff640 1 -- 172.21.15.5:0/1778802601 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b7000cc40 con 0x7f5b7c108090 2024-08-31T05:31:00.336 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.333+0000 7f5b63fff640 1 -- 172.21.15.5:0/1778802601 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b7000cde0 con 0x7f5b7c108090 2024-08-31T05:31:00.336 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.333+0000 7f5b63fff640 1 -- 172.21.15.5:0/1778802601 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b70018780 con 0x7f5b7c108090 2024-08-31T05:31:00.337 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.334+0000 7f5b813c6640 1 -- 172.21.15.5:0/1778802601 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b7c1a65e0 con 0x7f5b7c108090 2024-08-31T05:31:00.337 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.334+0000 7f5b813c6640 1 -- 172.21.15.5:0/1778802601 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b7c1a6ab0 con 0x7f5b7c108090 2024-08-31T05:31:00.338 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.337+0000 7f5b63fff640 1 -- 172.21.15.5:0/1778802601 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 24) ==== 152701+0+0 (secure 0 0 0) 0x7f5b7001f020 con 0x7f5b7c108090 2024-08-31T05:31:00.339 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.337+0000 7f5b88415740 1 Processor -- start 2024-08-31T05:31:00.339 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.338+0000 7f5b88415740 1 -- start start 2024-08-31T05:31:00.340 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.338+0000 7f5b63fff640 1 --2- 172.21.15.5:0/1778802601 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5b640b4ca0 0x7f5b640b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:00.340 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.338+0000 7f5b88415740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5579736fb1b0 0x557973a9ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:00.340 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.338+0000 7f5b88415740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5579736d22f0 0x557973a9f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.338+0000 7f5b88415740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5579736da4d0 0x557973a9f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.338+0000 7f5b88415740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x557973a14000 con 0x5579736da4d0 2024-08-31T05:31:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.338+0000 7f5b88415740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x557973a03590 con 0x5579736d22f0 2024-08-31T05:31:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.338+0000 7f5b88415740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557973a07540 con 0x5579736fb1b0 2024-08-31T05:31:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.338+0000 7f5b7b7fe640 1 --2- 172.21.15.5:0/1778802601 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5b640b4ca0 0x7f5b640b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.338+0000 7f5b7affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5579736fb1b0 0x557973a9ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.338+0000 7f5b7b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5579736da4d0 0x557973a9f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.338+0000 7f5b7affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5579736fb1b0 0x557973a9ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:59766/0 (socket says 172.21.15.5:59766) 2024-08-31T05:31:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.338+0000 7f5b7affd640 1 -- 172.21.15.5:0/3340491054 learned_addr learned my addr 172.21.15.5:0/3340491054 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.338+0000 7f5b7a7fc640 1 --2- 172.21.15.5:0/3340491054 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5579736d22f0 0x557973a9f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:00.342 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.339+0000 7f5b63fff640 1 -- 172.21.15.5:0/1778802601 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f5b700e5a60 con 0x7f5b7c108090 2024-08-31T05:31:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.339+0000 7f5b7affd640 1 -- 172.21.15.5:0/3340491054 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5579736d22f0 msgr2=0x557973a9f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.339+0000 7f5b7affd640 1 --2- 172.21.15.5:0/3340491054 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5579736d22f0 0x557973a9f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.339+0000 7f5b7affd640 1 -- 172.21.15.5:0/3340491054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5579736da4d0 msgr2=0x557973a9f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.339+0000 7f5b7affd640 1 --2- 172.21.15.5:0/3340491054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5579736da4d0 0x557973a9f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.339+0000 7f5b7affd640 1 -- 172.21.15.5:0/3340491054 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557973766790 con 0x5579736fb1b0 2024-08-31T05:31:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.339+0000 7f5b7affd640 1 --2- 172.21.15.5:0/3340491054 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5579736fb1b0 0x557973a9ece0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c011620 tx=0x7f5b6c011ae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6cb1272e1243537 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.339+0000 7f5b617fa640 1 -- 172.21.15.5:0/3340491054 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c005020 con 0x5579736fb1b0 2024-08-31T05:31:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.339+0000 7f5b617fa640 1 -- 172.21.15.5:0/3340491054 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b6c0047a0 con 0x5579736fb1b0 2024-08-31T05:31:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.339+0000 7f5b617fa640 1 -- 172.21.15.5:0/3340491054 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c00f950 con 0x5579736fb1b0 2024-08-31T05:31:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.340+0000 7f5b88415740 1 -- 172.21.15.5:0/3340491054 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5579736fb1b0 msgr2=0x557973a9ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.340+0000 7f5b88415740 1 --2- 172.21.15.5:0/3340491054 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5579736fb1b0 0x557973a9ece0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c011620 tx=0x7f5b6c011ae0 comp rx=0 tx=0).stop 2024-08-31T05:31:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.340+0000 7f5b7b7fe640 1 --2- 172.21.15.5:0/1778802601 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5b640b4ca0 0x7f5b640b71b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5b740094e0 tx=0x7f5b74009800 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.340+0000 7f5b88415740 1 -- 172.21.15.5:0/3340491054 shutdown_connections 2024-08-31T05:31:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.340+0000 7f5b88415740 1 --2- 172.21.15.5:0/3340491054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5579736da4d0 0x557973a9f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.340+0000 7f5b88415740 1 --2- 172.21.15.5:0/3340491054 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5579736d22f0 0x557973a9f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.340+0000 7f5b88415740 1 --2- 172.21.15.5:0/3340491054 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5579736fb1b0 0x557973a9ece0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.340+0000 7f5b88415740 1 -- 172.21.15.5:0/3340491054 >> 172.21.15.5:0/3340491054 conn(0x5579736ef300 msgr2=0x557973a9cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.340+0000 7f5b88415740 1 -- 172.21.15.5:0/3340491054 shutdown_connections 2024-08-31T05:31:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.340+0000 7f5b88415740 1 -- 172.21.15.5:0/3340491054 wait complete. 2024-08-31T05:31:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.341+0000 7f5b88415740 1 -- start start 2024-08-31T05:31:00.344 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.341+0000 7f5b88415740 1 Processor -- start 2024-08-31T05:31:00.347 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.341+0000 7f5b88415740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5579736d22f0 0x557973aaa860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:00.347 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.341+0000 7f5b88415740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5579736da4d0 0x557973aaada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:00.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.341+0000 7f5b88415740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5579736fb1b0 0x557973abab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:00.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.341+0000 7f5b88415740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55797393cab0 con 0x5579736fb1b0 2024-08-31T05:31:00.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.341+0000 7f5b88415740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55797398a680 con 0x5579736d22f0 2024-08-31T05:31:00.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.341+0000 7f5b88415740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557973ab1870 con 0x5579736da4d0 2024-08-31T05:31:00.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.341+0000 7f5b88415740 10 client.0 _ll_register_callbacks cb 0x557973712a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:31:00.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.342+0000 7f5b7affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5579736d22f0 0x557973aaa860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:00.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.342+0000 7f5b7affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5579736d22f0 0x557973aaa860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:55040/0 (socket says 172.21.15.5:55040) 2024-08-31T05:31:00.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.342+0000 7f5b7affd640 1 -- 172.21.15.5:0/3417168145 learned_addr learned my addr 172.21.15.5:0/3417168145 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:00.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.342+0000 7f5b7a7fc640 1 --2- 172.21.15.5:0/3417168145 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5579736da4d0 0x557973aaada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:00.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.342+0000 7f5b7b7fe640 1 --2- 172.21.15.5:0/3417168145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5579736fb1b0 0x557973abab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:00.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.342+0000 7f5b7affd640 1 -- 172.21.15.5:0/3417168145 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5579736da4d0 msgr2=0x557973aaada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:00.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.342+0000 7f5b7affd640 1 --2- 172.21.15.5:0/3417168145 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5579736da4d0 0x557973aaada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:00.349 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.342+0000 7f5b7affd640 1 -- 172.21.15.5:0/3417168145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5579736fb1b0 msgr2=0x557973abab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:00.349 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.342+0000 7f5b7affd640 1 --2- 172.21.15.5:0/3417168145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5579736fb1b0 0x557973abab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:00.349 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.342+0000 7f5b7affd640 1 -- 172.21.15.5:0/3417168145 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579737df620 con 0x5579736d22f0 2024-08-31T05:31:00.349 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.342+0000 7f5b7affd640 1 --2- 172.21.15.5:0/3417168145 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5579736d22f0 0x557973aaa860 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c01b040 tx=0x7f5b6c0052b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c89df14fd026cdc0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:00.349 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.342+0000 7f5b5eff5640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:31:00.349 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.342+0000 7f5b5eff5640 1 -- 172.21.15.5:0/3417168145 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c026020 con 0x5579736d22f0 2024-08-31T05:31:00.349 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.343+0000 7f5b88415740 1 -- 172.21.15.5:0/3417168145 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b6c0047a0 con 0x5579736d22f0 2024-08-31T05:31:00.349 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.343+0000 7f5b5eff5640 1 -- 172.21.15.5:0/3417168145 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f5b6c00f6f0 con 0x5579736d22f0 2024-08-31T05:31:00.349 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.343+0000 7f5b5eff5640 1 -- 172.21.15.5:0/3417168145 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5b6c031050 con 0x5579736d22f0 2024-08-31T05:31:00.349 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.343+0000 7f5b88415740 10 client.25487 fetch_fsmap learned FSMap version 30 2024-08-31T05:31:00.349 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.343+0000 7f5b88415740 1 -- 172.21.15.5:0/3417168145 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557973abd840 con 0x5579736d22f0 2024-08-31T05:31:00.349 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.343+0000 7f5b5eff5640 1 -- 172.21.15.5:0/3417168145 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b6c0047a0 con 0x5579736d22f0 2024-08-31T05:31:00.350 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.343+0000 7f5b5eff5640 1 -- 172.21.15.5:0/3417168145 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f5b6c022840 con 0x5579736d22f0 2024-08-31T05:31:00.350 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.343+0000 7f5b88415740 10 client.25487 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T05:31:00.350 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.343+0000 7f5b88415740 10 client.25487 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:31:00.350 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.343+0000 7f5b88415740 20 client.25487 populate_metadata read hostname 'smithi005' 2024-08-31T05:31:00.350 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.343+0000 7f5b88415740 1 --2- 172.21.15.5:0/3417168145 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5579736b9d80 0x557973ac0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:00.350 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.343+0000 7f5b88415740 4 client.25487 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:31:00.350 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.343+0000 7f5b88415740 1 -- 172.21.15.5:0/3417168145 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557973a15f50 con 0x5579736b9d80 2024-08-31T05:31:00.350 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.344+0000 7f5b7a7fc640 1 --2- 172.21.15.5:0/3417168145 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5579736b9d80 0x557973ac0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:00.350 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.344+0000 7f5b5eff5640 10 client.25487 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:31:00.350 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.344+0000 7f5b7a7fc640 1 --2- 172.21.15.5:0/3417168145 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5579736b9d80 0x557973ac0c60 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5cacdf88c05d1e43 server_cookie=78e79f3df972862f in_seq=0 out_seq=0 2024-08-31T05:31:00.350 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.345+0000 7f5b5eff5640 1 -- 172.21.15.5:0/3417168145 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557973a15f50 con 0x5579736b9d80 2024-08-31T05:31:00.350 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.345+0000 7f5b5eff5640 10 client.25487 handle_command_reply: tid=0 2024-08-31T05:31:00.350 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.345+0000 7f5b88415740 1 client.25487 shutdown 2024-08-31T05:31:00.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.345+0000 7f5b88415740 1 -- 172.21.15.5:0/3417168145 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5579736d22f0 msgr2=0x557973aaa860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:00.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.345+0000 7f5b88415740 1 --2- 172.21.15.5:0/3417168145 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5579736d22f0 0x557973aaa860 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c01b040 tx=0x7f5b6c0052b0 comp rx=0 tx=0).stop 2024-08-31T05:31:00.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.345+0000 7f5b88415740 1 -- 172.21.15.5:0/3417168145 shutdown_connections 2024-08-31T05:31:00.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.345+0000 7f5b88415740 1 --2- 172.21.15.5:0/3417168145 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5579736b9d80 0x557973ac0c60 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:00.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.345+0000 7f5b88415740 1 --2- 172.21.15.5:0/3417168145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5579736fb1b0 0x557973abab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:00.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.345+0000 7f5b88415740 1 --2- 172.21.15.5:0/3417168145 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5579736da4d0 0x557973aaada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:00.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.345+0000 7f5b5eff5640 0 client.25487 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:31:00.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.345+0000 7f5b88415740 1 --2- 172.21.15.5:0/3417168145 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5579736d22f0 0x557973aaa860 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:00.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.345+0000 7f5b88415740 1 -- 172.21.15.5:0/3417168145 >> 172.21.15.5:0/3417168145 conn(0x5579736ef300 msgr2=0x557973a9fd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:00.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.345+0000 7f5b88415740 1 -- 172.21.15.5:0/3417168145 shutdown_connections 2024-08-31T05:31:00.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.345+0000 7f5b88415740 1 -- 172.21.15.5:0/3417168145 wait complete. 2024-08-31T05:31:00.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.345+0000 7f5b88415740 20 client.25487 trim_cache size 0 max 16384 2024-08-31T05:31:00.376 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.375+0000 7f5b88415740 1 Processor -- start 2024-08-31T05:31:00.377 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.375+0000 7f5b88415740 1 -- start start 2024-08-31T05:31:00.378 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.375+0000 7f5b88415740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5579736b9d80 0x557973aac640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.375+0000 7f5b88415740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5579736d22f0 0x557973abab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.375+0000 7f5b88415740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5579736da4d0 0x557973abb060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.375+0000 7f5b88415740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5b7c1aeac0 con 0x5579736b9d80 2024-08-31T05:31:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.375+0000 7f5b88415740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5b7c1b0600 con 0x5579736da4d0 2024-08-31T05:31:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.375+0000 7f5b88415740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5b7c1af190 con 0x5579736d22f0 2024-08-31T05:31:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.375+0000 7f5b7affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5579736b9d80 0x557973aac640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.375+0000 7f5b7affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5579736b9d80 0x557973aac640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53318/0 (socket says 172.21.15.5:53318) 2024-08-31T05:31:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.375+0000 7f5b7affd640 1 -- 172.21.15.5:0/1998261575 learned_addr learned my addr 172.21.15.5:0/1998261575 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.376+0000 7f5b7a7fc640 1 --2- 172.21.15.5:0/1998261575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5579736d22f0 0x557973abab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.376+0000 7f5b7b7fe640 1 --2- 172.21.15.5:0/1998261575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5579736da4d0 0x557973abb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.376+0000 7f5b7affd640 1 -- 172.21.15.5:0/1998261575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5579736d22f0 msgr2=0x557973abab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.376+0000 7f5b7affd640 1 --2- 172.21.15.5:0/1998261575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5579736d22f0 0x557973abab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:00.379 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.376+0000 7f5b7affd640 1 -- 172.21.15.5:0/1998261575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5579736da4d0 msgr2=0x557973abb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.376+0000 7f5b7affd640 1 --2- 172.21.15.5:0/1998261575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5579736da4d0 0x557973abb060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.376+0000 7f5b7affd640 1 -- 172.21.15.5:0/1998261575 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557973a96980 con 0x5579736b9d80 2024-08-31T05:31:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.376+0000 7f5b7a7fc640 1 --2- 172.21.15.5:0/1998261575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5579736d22f0 0x557973abab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:31:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.376+0000 7f5b7affd640 1 --2- 172.21.15.5:0/1998261575 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5579736b9d80 0x557973aac640 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c022ce0 tx=0x7f5b6c023ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cceca1a05330ee6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.376+0000 7f5b60ff9640 1 -- 172.21.15.5:0/1998261575 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c03a070 con 0x5579736b9d80 2024-08-31T05:31:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.376+0000 7f5b60ff9640 1 -- 172.21.15.5:0/1998261575 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b6c004cd0 con 0x5579736b9d80 2024-08-31T05:31:00.380 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.376+0000 7f5b60ff9640 1 -- 172.21.15.5:0/1998261575 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c026070 con 0x5579736b9d80 2024-08-31T05:31:00.384 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.377+0000 7f5b88415740 1 -- 172.21.15.5:0/1998261575 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5579736b9d80 msgr2=0x557973aac640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:00.384 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.377+0000 7f5b88415740 1 --2- 172.21.15.5:0/1998261575 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5579736b9d80 0x557973aac640 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c022ce0 tx=0x7f5b6c023ee0 comp rx=0 tx=0).stop 2024-08-31T05:31:00.384 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.377+0000 7f5b88415740 1 -- 172.21.15.5:0/1998261575 shutdown_connections 2024-08-31T05:31:00.384 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.377+0000 7f5b88415740 1 --2- 172.21.15.5:0/1998261575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5579736da4d0 0x557973abb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:00.384 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.377+0000 7f5b88415740 1 --2- 172.21.15.5:0/1998261575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5579736d22f0 0x557973abab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:00.384 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.377+0000 7f5b88415740 1 --2- 172.21.15.5:0/1998261575 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5579736b9d80 0x557973aac640 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:00.384 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.377+0000 7f5b88415740 1 -- 172.21.15.5:0/1998261575 >> 172.21.15.5:0/1998261575 conn(0x5579736ef300 msgr2=0x557973aba410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:00.384 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.377+0000 7f5b88415740 1 -- 172.21.15.5:0/1998261575 shutdown_connections 2024-08-31T05:31:00.384 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.377+0000 7f5b88415740 1 -- 172.21.15.5:0/1998261575 wait complete. 2024-08-31T05:31:00.384 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.378+0000 7f5b88415740 1 -- start start 2024-08-31T05:31:00.384 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.378+0000 7f5b88415740 1 Processor -- start 2024-08-31T05:31:00.384 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.378+0000 7f5b88415740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5579736b9d80 0x557973ab7470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:00.385 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.378+0000 7f5b88415740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5579736d22f0 0x557973ab4930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:00.385 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.378+0000 7f5b88415740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5579736da4d0 0x557973ab5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:00.385 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.378+0000 7f5b88415740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5b7c1aff30 con 0x5579736d22f0 2024-08-31T05:31:00.385 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.378+0000 7f5b88415740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5b7c1af860 con 0x5579736b9d80 2024-08-31T05:31:00.385 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.378+0000 7f5b88415740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5b7c1acaa0 con 0x5579736da4d0 2024-08-31T05:31:00.385 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.378+0000 7f5b88415740 10 client.0 _ll_register_callbacks cb 0x7f5b6c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:31:00.385 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.378+0000 7f5b7a7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5579736d22f0 0x557973ab4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:00.385 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.378+0000 7f5b7a7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5579736d22f0 0x557973ab4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53322/0 (socket says 172.21.15.5:53322) 2024-08-31T05:31:00.385 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.378+0000 7f5b7a7fc640 1 -- 172.21.15.5:0/1972661950 learned_addr learned my addr 172.21.15.5:0/1972661950 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:00.385 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.379+0000 7f5b7affd640 1 --2- 172.21.15.5:0/1972661950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5579736b9d80 0x557973ab7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:00.385 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.379+0000 7f5b7b7fe640 1 --2- 172.21.15.5:0/1972661950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5579736da4d0 0x557973ab5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:00.385 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.379+0000 7f5b7a7fc640 1 -- 172.21.15.5:0/1972661950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5579736da4d0 msgr2=0x557973ab5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:00.385 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.379+0000 7f5b7a7fc640 1 --2- 172.21.15.5:0/1972661950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5579736da4d0 0x557973ab5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:00.385 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.379+0000 7f5b7a7fc640 1 -- 172.21.15.5:0/1972661950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5579736b9d80 msgr2=0x557973ab7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:00.386 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.379+0000 7f5b7a7fc640 1 --2- 172.21.15.5:0/1972661950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5579736b9d80 0x557973ab7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:00.386 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.379+0000 7f5b7a7fc640 1 -- 172.21.15.5:0/1972661950 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557973aa1490 con 0x5579736d22f0 2024-08-31T05:31:00.386 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.379+0000 7f5b7b7fe640 1 --2- 172.21.15.5:0/1972661950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5579736da4d0 0x557973ab5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:31:00.386 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.379+0000 7f5b7affd640 1 --2- 172.21.15.5:0/1972661950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5579736b9d80 0x557973ab7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:31:00.386 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.379+0000 7f5b7a7fc640 1 --2- 172.21.15.5:0/1972661950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5579736d22f0 0x557973ab4930 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f5b7000c6a0 tx=0x7f5b700abe30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22f7c9ff67fe87e0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:00.386 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.379+0000 7f5b5eff5640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:31:00.386 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.379+0000 7f5b5eff5640 1 -- 172.21.15.5:0/1972661950 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b700b5090 con 0x5579736d22f0 2024-08-31T05:31:00.386 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.379+0000 7f5b5eff5640 1 -- 172.21.15.5:0/1972661950 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f5b700930c0 con 0x5579736d22f0 2024-08-31T05:31:00.386 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.379+0000 7f5b88415740 1 -- 172.21.15.5:0/1972661950 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b6c004cd0 con 0x5579736d22f0 2024-08-31T05:31:00.386 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.379+0000 7f5b5eff5640 1 -- 172.21.15.5:0/1972661950 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5b700a8000 con 0x5579736d22f0 2024-08-31T05:31:00.386 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.380+0000 7f5b88415740 10 client.15885 fetch_fsmap learned FSMap version 30 2024-08-31T05:31:00.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.380+0000 7f5b88415740 1 -- 172.21.15.5:0/1972661950 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557973b2b530 con 0x5579736d22f0 2024-08-31T05:31:00.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.380+0000 7f5b5eff5640 1 -- 172.21.15.5:0/1972661950 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b700cee50 con 0x5579736d22f0 2024-08-31T05:31:00.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.380+0000 7f5b5eff5640 1 -- 172.21.15.5:0/1972661950 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f5b700e3050 con 0x5579736d22f0 2024-08-31T05:31:00.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.380+0000 7f5b88415740 10 client.15885 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T05:31:00.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.380+0000 7f5b88415740 10 client.15885 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:31:00.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.380+0000 7f5b88415740 20 client.15885 populate_metadata read hostname 'smithi005' 2024-08-31T05:31:00.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.380+0000 7f5b88415740 1 --2- 172.21.15.5:0/1972661950 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5579736fb1b0 0x557973b2dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:00.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.380+0000 7f5b88415740 4 client.15885 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:31:00.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.380+0000 7f5b88415740 1 -- 172.21.15.5:0/1972661950 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f5b6c004cd0 con 0x5579736fb1b0 2024-08-31T05:31:00.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.380+0000 7f5b7affd640 1 --2- 172.21.15.5:0/1972661950 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5579736fb1b0 0x557973b2dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:00.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.381+0000 7f5b5eff5640 10 client.15885 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:31:00.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.381+0000 7f5b7affd640 1 --2- 172.21.15.5:0/1972661950 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5579736fb1b0 0x557973b2dcf0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf2170a8dc53dd18 server_cookie=3dcc0985c5db156c in_seq=0 out_seq=0 2024-08-31T05:31:00.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.385+0000 7f5b5eff5640 1 -- 172.21.15.5:0/1972661950 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f5b6c004cd0 con 0x5579736fb1b0 2024-08-31T05:31:00.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.385+0000 7f5b5eff5640 10 client.15885 handle_command_reply: tid=0 2024-08-31T05:31:00.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.385+0000 7f5b88415740 1 client.15885 shutdown 2024-08-31T05:31:00.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.385+0000 7f5b88415740 1 -- 172.21.15.5:0/1972661950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5579736d22f0 msgr2=0x557973ab4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:00.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.385+0000 7f5b88415740 1 --2- 172.21.15.5:0/1972661950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5579736d22f0 0x557973ab4930 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f5b7000c6a0 tx=0x7f5b700abe30 comp rx=0 tx=0).stop 2024-08-31T05:31:00.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.385+0000 7f5b88415740 1 -- 172.21.15.5:0/1972661950 shutdown_connections 2024-08-31T05:31:00.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.385+0000 7f5b88415740 1 --2- 172.21.15.5:0/1972661950 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5579736fb1b0 0x557973b2dcf0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:00.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.385+0000 7f5b88415740 1 --2- 172.21.15.5:0/1972661950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5579736da4d0 0x557973ab5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:00.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.385+0000 7f5b88415740 1 --2- 172.21.15.5:0/1972661950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5579736d22f0 0x557973ab4930 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:00.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.385+0000 7f5b88415740 1 --2- 172.21.15.5:0/1972661950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5579736b9d80 0x557973ab7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:00.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.385+0000 7f5b88415740 1 -- 172.21.15.5:0/1972661950 >> 172.21.15.5:0/1972661950 conn(0x5579736ef300 msgr2=0x557973ababa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:00.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.385+0000 7f5b5eff5640 0 client.15885 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:31:00.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.385+0000 7f5b88415740 1 -- 172.21.15.5:0/1972661950 shutdown_connections 2024-08-31T05:31:00.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.385+0000 7f5b88415740 1 -- 172.21.15.5:0/1972661950 wait complete. 2024-08-31T05:31:00.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.386+0000 7f5b88415740 20 client.15885 trim_cache size 0 max 16384 2024-08-31T05:31:00.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:31:00.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:31:00.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:31:00.391 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:31:00.391 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.386+0000 7f5b813c6640 1 -- 172.21.15.5:0/1778802601 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5b640b4ca0 msgr2=0x7f5b640b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:00.391 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.386+0000 7f5b813c6640 1 --2- 172.21.15.5:0/1778802601 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5b640b4ca0 0x7f5b640b71b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5b740094e0 tx=0x7f5b74009800 comp rx=0 tx=0).stop 2024-08-31T05:31:00.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.386+0000 7f5b813c6640 1 -- 172.21.15.5:0/1778802601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b7c108090 msgr2=0x7f5b7c19b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:00.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.386+0000 7f5b813c6640 1 --2- 172.21.15.5:0/1778802601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b7c108090 0x7f5b7c19b5a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c06a710 tx=0x7f5b7000ee50 comp rx=0 tx=0).stop 2024-08-31T05:31:00.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.386+0000 7f5b813c6640 1 -- 172.21.15.5:0/1778802601 shutdown_connections 2024-08-31T05:31:00.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.386+0000 7f5b813c6640 1 --2- 172.21.15.5:0/1778802601 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5b640b4ca0 0x7f5b640b71b0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:00.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.386+0000 7f5b813c6640 1 --2- 172.21.15.5:0/1778802601 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b7c1089e0 0x7f5b7c19bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:00.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.386+0000 7f5b813c6640 1 --2- 172.21.15.5:0/1778802601 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5b7c108090 0x7f5b7c19b5a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:00.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.386+0000 7f5b813c6640 1 --2- 172.21.15.5:0/1778802601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b7c102760 0x7f5b7c19b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:00.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.386+0000 7f5b813c6640 1 -- 172.21.15.5:0/1778802601 >> 172.21.15.5:0/1778802601 conn(0x7f5b7c0fe160 msgr2=0x7f5b7c105620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:00.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.387+0000 7f5b813c6640 1 -- 172.21.15.5:0/1778802601 shutdown_connections 2024-08-31T05:31:00.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:00.387+0000 7f5b813c6640 1 -- 172.21.15.5:0/1778802601 wait complete. 2024-08-31T05:31:01.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:31:01 smithi005 ceph-mon[18602]: pgmap v376: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 597 B/s wr, 13 op/s 2024-08-31T05:31:01.217 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:31:00 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: 2024-08-31T05:31:00.820+0000 7f5d67048640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T05:31:01.217 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:31:00 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: 2024-08-31T05:31:00.820+0000 7f5d67048640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T05:31:01.218 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:31:00 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: 2024-08-31T05:31:00.821+0000 7f5d67048640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T05:31:01.218 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:31:00 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: 2024-08-31T05:31:00.821+0000 7f5d67048640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T05:31:01.218 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:31:00 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: 2024-08-31T05:31:00.821+0000 7f5d67048640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T05:31:01.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:31:01 smithi070 ceph-mon[22316]: pgmap v376: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 597 B/s wr, 13 op/s 2024-08-31T05:31:01.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:31:01 smithi050 ceph-mon[22146]: pgmap v376: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 597 B/s wr, 13 op/s 2024-08-31T05:31:03.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:31:03 smithi070 ceph-mon[22316]: pgmap v377: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 85 B/s wr, 10 op/s 2024-08-31T05:31:03.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:31:03 smithi070 ceph-mon[22316]: mgrmap e25: x(active, since 10m), standbys: z, y 2024-08-31T05:31:03.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:31:03 smithi050 ceph-mon[22146]: pgmap v377: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 85 B/s wr, 10 op/s 2024-08-31T05:31:03.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:31:03 smithi050 ceph-mon[22146]: mgrmap e25: x(active, since 10m), standbys: z, y 2024-08-31T05:31:03.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:31:03 smithi005 ceph-mon[18602]: pgmap v377: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 85 B/s wr, 10 op/s 2024-08-31T05:31:03.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:31:03 smithi005 ceph-mon[18602]: mgrmap e25: x(active, since 10m), standbys: z, y 2024-08-31T05:31:05.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:31:05 smithi070 ceph-mon[22316]: pgmap v378: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 KiB/s wr, 25 op/s 2024-08-31T05:31:05.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:31:05 smithi050 ceph-mon[22146]: pgmap v378: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 KiB/s wr, 25 op/s 2024-08-31T05:31:05.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:31:05 smithi005 ceph-mon[18602]: pgmap v378: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 KiB/s wr, 25 op/s 2024-08-31T05:31:07.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:31:07 smithi070 ceph-mon[22316]: pgmap v379: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 27 op/s 2024-08-31T05:31:07.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:31:07 smithi050 ceph-mon[22146]: pgmap v379: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 27 op/s 2024-08-31T05:31:07.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:31:07 smithi005 ceph-mon[18602]: pgmap v379: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 27 op/s 2024-08-31T05:31:09.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:31:09 smithi070 ceph-mon[22316]: pgmap v380: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 25 op/s 2024-08-31T05:31:09.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:31:09 smithi050 ceph-mon[22146]: pgmap v380: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 25 op/s 2024-08-31T05:31:09.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:31:09 smithi005 ceph-mon[18602]: pgmap v380: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 25 op/s 2024-08-31T05:31:11.307 INFO:tasks.workunit.client.0.smithi005.stderr:Updating files: 95% (12081/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-08-31T05:31:11.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:31:11 smithi070 ceph-mon[22316]: pgmap v381: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-08-31T05:31:11.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:31:11 smithi050 ceph-mon[22146]: pgmap v381: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-08-31T05:31:11.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:31:11 smithi005 ceph-mon[18602]: pgmap v381: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-08-31T05:31:11.843 INFO:tasks.workunit.client.0.smithi005.stderr:Note: switching to 'd19e6118f7015f0047264006cb0c873528eb3ae6'. 2024-08-31T05:31:11.843 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-08-31T05:31:11.843 INFO:tasks.workunit.client.0.smithi005.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-08-31T05:31:11.843 INFO:tasks.workunit.client.0.smithi005.stderr:changes and commit them, and you can discard any commits you make in this 2024-08-31T05:31:11.843 INFO:tasks.workunit.client.0.smithi005.stderr:state without impacting any branches by switching back to a branch. 2024-08-31T05:31:11.843 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-08-31T05:31:11.843 INFO:tasks.workunit.client.0.smithi005.stderr:If you want to create a new branch to retain commits you create, you may 2024-08-31T05:31:11.844 INFO:tasks.workunit.client.0.smithi005.stderr:do so (now or later) by using -c with the switch command. Example: 2024-08-31T05:31:11.844 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-08-31T05:31:11.844 INFO:tasks.workunit.client.0.smithi005.stderr: git switch -c 2024-08-31T05:31:11.844 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-08-31T05:31:11.844 INFO:tasks.workunit.client.0.smithi005.stderr:Or undo this operation with: 2024-08-31T05:31:11.844 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-08-31T05:31:11.844 INFO:tasks.workunit.client.0.smithi005.stderr: git switch - 2024-08-31T05:31:11.844 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-08-31T05:31:11.844 INFO:tasks.workunit.client.0.smithi005.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-08-31T05:31:11.844 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-08-31T05:31:11.844 INFO:tasks.workunit.client.0.smithi005.stderr:HEAD is now at d19e6118f70 Merge PR #44359 into wip-mchangir-testing-20240828.085847-main-debug 2024-08-31T05:31:11.848 DEBUG:teuthology.orchestra.run.smithi005:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-08-31T05:31:11.868 INFO:tasks.workunit.client.0.smithi005.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-08-31T05:31:11.871 INFO:tasks.workunit.client.0.smithi005.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-31T05:31:11.871 INFO:tasks.workunit.client.0.smithi005.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-08-31T05:31:12.526 INFO:tasks.workunit.client.0.smithi005.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-08-31T05:31:12.593 INFO:tasks.workunit.client.0.smithi005.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-08-31T05:31:12.632 INFO:tasks.workunit.client.0.smithi005.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-31T05:31:12.633 INFO:tasks.workunit.client.0.smithi005.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-31T05:31:12.633 INFO:tasks.workunit.client.0.smithi005.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-08-31T05:31:12.672 INFO:tasks.workunit.client.0.smithi005.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-31T05:31:12.675 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-31T05:31:12.675 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-08-31T05:31:12.732 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2024-08-31T05:31:12.733 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2024-08-31T05:31:12.734 DEBUG:teuthology.orchestra.run.smithi005:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d19e6118f7015f0047264006cb0c873528eb3ae6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2024-08-31T05:31:12.793 INFO:tasks.workunit.client.0.smithi005.stderr:+ dbench 1 2024-08-31T05:31:12.806 INFO:tasks.workunit.client.0.smithi005.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-08-31T05:31:12.806 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-08-31T05:31:12.806 INFO:tasks.workunit.client.0.smithi005.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-08-31T05:31:12.807 INFO:tasks.workunit.client.0.smithi005.stdout:0 of 1 processes prepared for launch 0 sec 2024-08-31T05:31:12.907 INFO:tasks.workunit.client.0.smithi005.stdout:1 of 1 processes prepared for launch 0 sec 2024-08-31T05:31:12.907 INFO:tasks.workunit.client.0.smithi005.stdout:releasing clients 2024-08-31T05:31:13.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:31:13 smithi070 ceph-mon[22316]: pgmap v382: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 25 op/s 2024-08-31T05:31:13.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:31:13 smithi050 ceph-mon[22146]: pgmap v382: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 25 op/s 2024-08-31T05:31:13.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:31:13 smithi005 ceph-mon[18602]: pgmap v382: 129 pgs: 129 active+clean; 1.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 25 op/s 2024-08-31T05:31:13.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.489+0000 7ff53b2be640 1 -- 172.21.15.5:0/909230990 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5341027b0 msgr2=0x7ff534102bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:13.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.489+0000 7ff53b2be640 1 --2- 172.21.15.5:0/909230990 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5341027b0 0x7ff534102bc0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7ff530009900 tx=0x7ff53002a410 comp rx=0 tx=0).stop 2024-08-31T05:31:13.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.489+0000 7ff53b2be640 1 -- 172.21.15.5:0/909230990 shutdown_connections 2024-08-31T05:31:13.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.489+0000 7ff53b2be640 1 --2- 172.21.15.5:0/909230990 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff534108a30 0x7ff53410f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:13.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.489+0000 7ff53b2be640 1 --2- 172.21.15.5:0/909230990 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5341080e0 0x7ff5341084f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:13.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.489+0000 7ff53b2be640 1 --2- 172.21.15.5:0/909230990 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5341027b0 0x7ff534102bc0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:13.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.489+0000 7ff53b2be640 1 -- 172.21.15.5:0/909230990 >> 172.21.15.5:0/909230990 conn(0x7ff5340fe1b0 msgr2=0x7ff534100600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:13.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.489+0000 7ff53b2be640 1 -- 172.21.15.5:0/909230990 shutdown_connections 2024-08-31T05:31:13.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.489+0000 7ff53b2be640 1 -- 172.21.15.5:0/909230990 wait complete. 2024-08-31T05:31:13.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.490+0000 7ff53b2be640 1 Processor -- start 2024-08-31T05:31:13.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.490+0000 7ff53b2be640 1 -- start start 2024-08-31T05:31:13.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.490+0000 7ff53b2be640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5341027b0 0x7ff534199180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:13.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.490+0000 7ff53b2be640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5341080e0 0x7ff534199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:13.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.490+0000 7ff53b2be640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff534108a30 0x7ff53419e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:13.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.490+0000 7ff53b2be640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff534112700 con 0x7ff534108a30 2024-08-31T05:31:13.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.490+0000 7ff53b2be640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff534112580 con 0x7ff5341080e0 2024-08-31T05:31:13.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.490+0000 7ff53b2be640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff534112880 con 0x7ff5341027b0 2024-08-31T05:31:13.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.490+0000 7ff53985b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff534108a30 0x7ff53419e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:13.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.490+0000 7ff53905a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5341027b0 0x7ff534199180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:13.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.490+0000 7ff53985b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff534108a30 0x7ff53419e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41228/0 (socket says 172.21.15.5:41228) 2024-08-31T05:31:13.495 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.490+0000 7ff53985b640 1 -- 172.21.15.5:0/3420094946 learned_addr learned my addr 172.21.15.5:0/3420094946 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:13.495 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.490+0000 7ff538859640 1 --2- 172.21.15.5:0/3420094946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5341080e0 0x7ff534199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:13.495 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.490+0000 7ff53985b640 1 -- 172.21.15.5:0/3420094946 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5341027b0 msgr2=0x7ff534199180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:13.495 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.490+0000 7ff53985b640 1 --2- 172.21.15.5:0/3420094946 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5341027b0 0x7ff534199180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:13.495 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.490+0000 7ff53985b640 1 -- 172.21.15.5:0/3420094946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5341080e0 msgr2=0x7ff534199720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:13.495 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.490+0000 7ff53985b640 1 --2- 172.21.15.5:0/3420094946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5341080e0 0x7ff534199720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:13.495 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.490+0000 7ff53985b640 1 -- 172.21.15.5:0/3420094946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff53419f0b0 con 0x7ff534108a30 2024-08-31T05:31:13.495 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.491+0000 7ff53985b640 1 --2- 172.21.15.5:0/3420094946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff534108a30 0x7ff53419e9b0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7ff52c00eb10 tx=0x7ff52c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:13.495 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.491+0000 7ff52a7fc640 1 -- 172.21.15.5:0/3420094946 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff52c004b20 con 0x7ff534108a30 2024-08-31T05:31:13.495 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.491+0000 7ff52a7fc640 1 -- 172.21.15.5:0/3420094946 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff52c004cc0 con 0x7ff534108a30 2024-08-31T05:31:13.495 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.491+0000 7ff52a7fc640 1 -- 172.21.15.5:0/3420094946 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff52c010670 con 0x7ff534108a30 2024-08-31T05:31:13.496 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.491+0000 7ff53b2be640 1 -- 172.21.15.5:0/3420094946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff53419f3a0 con 0x7ff534108a30 2024-08-31T05:31:13.496 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.491+0000 7ff53b2be640 1 -- 172.21.15.5:0/3420094946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5341a5b30 con 0x7ff534108a30 2024-08-31T05:31:13.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.494+0000 7ff542224740 1 Processor -- start 2024-08-31T05:31:13.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.494+0000 7ff52a7fc640 1 -- 172.21.15.5:0/3420094946 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 25) ==== 152758+0+0 (secure 0 0 0) 0x7ff52c005020 con 0x7ff534108a30 2024-08-31T05:31:13.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.494+0000 7ff542224740 1 -- start start 2024-08-31T05:31:13.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.495+0000 7ff542224740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c1ebf841b0 0x55c1ec327ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:13.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.495+0000 7ff542224740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1ebf5b2f0 0x55c1ec328220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:13.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.495+0000 7ff542224740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c1ebf634d0 0x55c1ec328760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:13.500 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.495+0000 7ff542224740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55c1ec29d000 con 0x55c1ebf841b0 2024-08-31T05:31:13.500 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.495+0000 7ff542224740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55c1ec28c590 con 0x55c1ebf634d0 2024-08-31T05:31:13.500 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.495+0000 7ff542224740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c1ec290540 con 0x55c1ebf5b2f0 2024-08-31T05:31:13.500 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.495+0000 7ff538859640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c1ebf841b0 0x55c1ec327ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:13.500 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.495+0000 7ff53905a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1ebf5b2f0 0x55c1ec328220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:13.500 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.495+0000 7ff538859640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c1ebf841b0 0x55c1ec327ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41242/0 (socket says 172.21.15.5:41242) 2024-08-31T05:31:13.500 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.495+0000 7ff53905a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1ebf5b2f0 0x55c1ec328220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:39892/0 (socket says 172.21.15.5:39892) 2024-08-31T05:31:13.500 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.495+0000 7ff538859640 1 -- 172.21.15.5:0/771057263 learned_addr learned my addr 172.21.15.5:0/771057263 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:13.500 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.495+0000 7ff538859640 1 --2- 172.21.15.5:0/771057263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c1ebf634d0 0x55c1ec328760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:13.500 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.495+0000 7ff53905a640 1 -- 172.21.15.5:0/771057263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c1ebf634d0 msgr2=0x55c1ec328760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:13.500 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.495+0000 7ff53905a640 1 --2- 172.21.15.5:0/771057263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c1ebf634d0 0x55c1ec328760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:13.501 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.495+0000 7ff53905a640 1 -- 172.21.15.5:0/771057263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c1ebf841b0 msgr2=0x55c1ec327ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:13.501 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.495+0000 7ff53905a640 1 --2- 172.21.15.5:0/771057263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c1ebf841b0 0x55c1ec327ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:13.501 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.495+0000 7ff53905a640 1 -- 172.21.15.5:0/771057263 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1ebfef790 con 0x55c1ebf5b2f0 2024-08-31T05:31:13.501 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.495+0000 7ff52a7fc640 1 --2- 172.21.15.5:0/3420094946 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff5200b4d30 0x7ff5200b7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:13.501 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.495+0000 7ff538859640 1 --2- 172.21.15.5:0/3420094946 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff5200b4d30 0x7ff5200b7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:13.501 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.495+0000 7ff52a7fc640 1 -- 172.21.15.5:0/3420094946 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7ff52c0e60b0 con 0x7ff534108a30 2024-08-31T05:31:13.501 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.495+0000 7ff53905a640 1 --2- 172.21.15.5:0/771057263 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1ebf5b2f0 0x55c1ec328220 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff530009230 tx=0x7ff530032b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bfb27b67bed32ca server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:13.501 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.496+0000 7ff51f7fe640 1 -- 172.21.15.5:0/771057263 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff530040070 con 0x55c1ebf5b2f0 2024-08-31T05:31:13.501 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.496+0000 7ff538859640 1 --2- 172.21.15.5:0/3420094946 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff5200b4d30 0x7ff5200b7240 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff524009710 tx=0x7ff524015040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:13.501 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.496+0000 7ff51f7fe640 1 -- 172.21.15.5:0/771057263 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff530004030 con 0x55c1ebf5b2f0 2024-08-31T05:31:13.501 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.496+0000 7ff51f7fe640 1 -- 172.21.15.5:0/771057263 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff530035040 con 0x55c1ebf5b2f0 2024-08-31T05:31:13.501 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.497+0000 7ff542224740 1 -- 172.21.15.5:0/771057263 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1ebf5b2f0 msgr2=0x55c1ec328220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:13.501 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.497+0000 7ff542224740 1 --2- 172.21.15.5:0/771057263 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1ebf5b2f0 0x55c1ec328220 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff530009230 tx=0x7ff530032b90 comp rx=0 tx=0).stop 2024-08-31T05:31:13.502 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.497+0000 7ff542224740 1 -- 172.21.15.5:0/771057263 shutdown_connections 2024-08-31T05:31:13.502 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.497+0000 7ff542224740 1 --2- 172.21.15.5:0/771057263 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c1ebf634d0 0x55c1ec328760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:13.502 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.497+0000 7ff542224740 1 --2- 172.21.15.5:0/771057263 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1ebf5b2f0 0x55c1ec328220 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:13.502 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.497+0000 7ff542224740 1 --2- 172.21.15.5:0/771057263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c1ebf841b0 0x55c1ec327ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:13.502 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.497+0000 7ff542224740 1 -- 172.21.15.5:0/771057263 >> 172.21.15.5:0/771057263 conn(0x55c1ebf78300 msgr2=0x55c1ec325bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:13.502 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.497+0000 7ff542224740 1 -- 172.21.15.5:0/771057263 shutdown_connections 2024-08-31T05:31:13.502 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.497+0000 7ff542224740 1 -- 172.21.15.5:0/771057263 wait complete. 2024-08-31T05:31:13.502 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.497+0000 7ff542224740 1 -- start start 2024-08-31T05:31:13.502 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.497+0000 7ff542224740 1 Processor -- start 2024-08-31T05:31:13.506 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.498+0000 7ff542224740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c1ebf5b2f0 0x55c1ec335a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:13.506 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.498+0000 7ff542224740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1ebf634d0 0x55c1ec335f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:13.506 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.498+0000 7ff542224740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c1ebf841b0 0x55c1ec341970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:13.506 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.498+0000 7ff542224740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55c1ec1c5ab0 con 0x55c1ebf5b2f0 2024-08-31T05:31:13.506 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.498+0000 7ff542224740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55c1ec213680 con 0x55c1ebf841b0 2024-08-31T05:31:13.506 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.498+0000 7ff542224740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c1ec338610 con 0x55c1ebf634d0 2024-08-31T05:31:13.506 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.498+0000 7ff542224740 10 client.0 _ll_register_callbacks cb 0x55c1ebf9ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:31:13.506 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.498+0000 7ff53905a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c1ebf5b2f0 0x55c1ec335a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:13.507 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.498+0000 7ff53905a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c1ebf5b2f0 0x55c1ec335a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41258/0 (socket says 172.21.15.5:41258) 2024-08-31T05:31:13.507 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.498+0000 7ff538859640 1 --2- 172.21.15.5:0/2784849700 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1ebf634d0 0x55c1ec335f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:13.507 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.498+0000 7ff53905a640 1 -- 172.21.15.5:0/2784849700 learned_addr learned my addr 172.21.15.5:0/2784849700 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:13.507 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.498+0000 7ff53985b640 1 --2- 172.21.15.5:0/2784849700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c1ebf841b0 0x55c1ec341970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:13.507 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.498+0000 7ff53905a640 1 -- 172.21.15.5:0/2784849700 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1ebf634d0 msgr2=0x55c1ec335f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:13.507 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.498+0000 7ff53905a640 1 --2- 172.21.15.5:0/2784849700 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1ebf634d0 0x55c1ec335f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:13.507 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.498+0000 7ff53905a640 1 -- 172.21.15.5:0/2784849700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c1ebf841b0 msgr2=0x55c1ec341970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:13.507 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.498+0000 7ff53905a640 1 --2- 172.21.15.5:0/2784849700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c1ebf841b0 0x55c1ec341970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:13.507 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.498+0000 7ff53905a640 1 -- 172.21.15.5:0/2784849700 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1ec068620 con 0x55c1ebf5b2f0 2024-08-31T05:31:13.507 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.498+0000 7ff53905a640 1 --2- 172.21.15.5:0/2784849700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c1ebf5b2f0 0x55c1ec335a10 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7ff530032f30 tx=0x7ff530032f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e3619818ab156a2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:13.507 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.498+0000 7ff51cff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:31:13.507 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.498+0000 7ff51cff9640 1 -- 172.21.15.5:0/2784849700 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff530040070 con 0x55c1ebf5b2f0 2024-08-31T05:31:13.507 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.499+0000 7ff51cff9640 1 -- 172.21.15.5:0/2784849700 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7ff5300314a0 con 0x55c1ebf5b2f0 2024-08-31T05:31:13.507 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.499+0000 7ff542224740 1 -- 172.21.15.5:0/2784849700 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff530004030 con 0x55c1ebf5b2f0 2024-08-31T05:31:13.508 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.499+0000 7ff51cff9640 1 -- 172.21.15.5:0/2784849700 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff530056050 con 0x55c1ebf5b2f0 2024-08-31T05:31:13.508 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.499+0000 7ff542224740 10 client.15903 fetch_fsmap learned FSMap version 30 2024-08-31T05:31:13.508 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.499+0000 7ff542224740 1 -- 172.21.15.5:0/2784849700 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c1ec3445f0 con 0x55c1ebf5b2f0 2024-08-31T05:31:13.508 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.499+0000 7ff51cff9640 1 -- 172.21.15.5:0/2784849700 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff530004030 con 0x55c1ebf5b2f0 2024-08-31T05:31:13.508 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.499+0000 7ff51cff9640 1 -- 172.21.15.5:0/2784849700 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7ff530004a80 con 0x55c1ebf5b2f0 2024-08-31T05:31:13.508 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.499+0000 7ff542224740 10 client.15903 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T05:31:13.508 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.499+0000 7ff542224740 10 client.15903 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:31:13.508 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.499+0000 7ff542224740 20 client.15903 populate_metadata read hostname 'smithi005' 2024-08-31T05:31:13.508 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.499+0000 7ff542224740 1 --2- 172.21.15.5:0/2784849700 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55c1ebf42d80 0x55c1ec347950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:13.508 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.499+0000 7ff542224740 4 client.15903 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:31:13.508 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.499+0000 7ff542224740 1 -- 172.21.15.5:0/2784849700 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c1ec29ef50 con 0x55c1ebf42d80 2024-08-31T05:31:13.508 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.499+0000 7ff538859640 1 --2- 172.21.15.5:0/2784849700 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55c1ebf42d80 0x55c1ec347950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:13.508 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.500+0000 7ff51cff9640 10 client.15903 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:31:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.500+0000 7ff538859640 1 --2- 172.21.15.5:0/2784849700 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55c1ebf42d80 0x55c1ec347950 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1dce0a2b0cf7e3a server_cookie=5c943ba89d621f6a in_seq=0 out_seq=0 2024-08-31T05:31:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.500+0000 7ff51cff9640 1 -- 172.21.15.5:0/2784849700 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c1ec29ef50 con 0x55c1ebf42d80 2024-08-31T05:31:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.500+0000 7ff51cff9640 10 client.15903 handle_command_reply: tid=0 2024-08-31T05:31:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.500+0000 7ff542224740 1 client.15903 shutdown 2024-08-31T05:31:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.501+0000 7ff542224740 1 -- 172.21.15.5:0/2784849700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c1ebf5b2f0 msgr2=0x55c1ec335a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.501+0000 7ff542224740 1 --2- 172.21.15.5:0/2784849700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c1ebf5b2f0 0x55c1ec335a10 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7ff530032f30 tx=0x7ff530032f60 comp rx=0 tx=0).stop 2024-08-31T05:31:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.501+0000 7ff542224740 1 -- 172.21.15.5:0/2784849700 shutdown_connections 2024-08-31T05:31:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.501+0000 7ff542224740 1 --2- 172.21.15.5:0/2784849700 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55c1ebf42d80 0x55c1ec347950 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.501+0000 7ff542224740 1 --2- 172.21.15.5:0/2784849700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c1ebf841b0 0x55c1ec341970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.501+0000 7ff542224740 1 --2- 172.21.15.5:0/2784849700 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1ebf634d0 0x55c1ec335f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.501+0000 7ff542224740 1 --2- 172.21.15.5:0/2784849700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c1ebf5b2f0 0x55c1ec335a10 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.501+0000 7ff51cff9640 0 client.15903 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:31:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.501+0000 7ff542224740 1 -- 172.21.15.5:0/2784849700 >> 172.21.15.5:0/2784849700 conn(0x55c1ebf78300 msgr2=0x55c1ec324170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:13.510 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.501+0000 7ff542224740 1 -- 172.21.15.5:0/2784849700 shutdown_connections 2024-08-31T05:31:13.510 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.501+0000 7ff542224740 1 -- 172.21.15.5:0/2784849700 wait complete. 2024-08-31T05:31:13.510 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.501+0000 7ff542224740 20 client.15903 trim_cache size 0 max 16384 2024-08-31T05:31:13.519 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.516+0000 7ff542224740 1 Processor -- start 2024-08-31T05:31:13.519 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.516+0000 7ff542224740 1 -- start start 2024-08-31T05:31:13.519 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.516+0000 7ff542224740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c1ebf5b2f0 0x55c1ec329420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:13.519 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.516+0000 7ff542224740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1ebf634d0 0x55c1ec3418e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:13.519 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.516+0000 7ff542224740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c1ebf841b0 0x55c1ec341e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:13.520 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.516+0000 7ff542224740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff5341ae9e0 con 0x55c1ebf841b0 2024-08-31T05:31:13.520 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.516+0000 7ff542224740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff5341b0520 con 0x55c1ebf5b2f0 2024-08-31T05:31:13.520 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.516+0000 7ff542224740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff5341af0b0 con 0x55c1ebf634d0 2024-08-31T05:31:13.520 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.517+0000 7ff53985b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c1ebf841b0 0x55c1ec341e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:13.520 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.517+0000 7ff53905a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c1ebf5b2f0 0x55c1ec329420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:13.520 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.517+0000 7ff538859640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1ebf634d0 0x55c1ec3418e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:13.520 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.517+0000 7ff53985b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c1ebf841b0 0x55c1ec341e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41266/0 (socket says 172.21.15.5:41266) 2024-08-31T05:31:13.520 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.517+0000 7ff53985b640 1 -- 172.21.15.5:0/3219425438 learned_addr learned my addr 172.21.15.5:0/3219425438 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:13.520 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.517+0000 7ff53985b640 1 -- 172.21.15.5:0/3219425438 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1ebf634d0 msgr2=0x55c1ec3418e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:13.520 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.517+0000 7ff53985b640 1 --2- 172.21.15.5:0/3219425438 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1ebf634d0 0x55c1ec3418e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:13.520 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.517+0000 7ff53985b640 1 -- 172.21.15.5:0/3219425438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c1ebf5b2f0 msgr2=0x55c1ec329420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:13.520 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.517+0000 7ff53985b640 1 --2- 172.21.15.5:0/3219425438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c1ebf5b2f0 0x55c1ec329420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:13.520 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.517+0000 7ff53985b640 1 -- 172.21.15.5:0/3219425438 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1ec323f60 con 0x55c1ebf841b0 2024-08-31T05:31:13.521 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.517+0000 7ff53985b640 1 --2- 172.21.15.5:0/3219425438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c1ebf841b0 0x55c1ec341e20 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7ff52c0049d0 tx=0x7ff52c0cf040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c9804758e3a0b18 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:13.521 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.517+0000 7ff51effd640 1 -- 172.21.15.5:0/3219425438 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff52c0abd60 con 0x55c1ebf841b0 2024-08-31T05:31:13.521 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.517+0000 7ff51effd640 1 -- 172.21.15.5:0/3219425438 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff52c0ac950 con 0x55c1ebf841b0 2024-08-31T05:31:13.521 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.517+0000 7ff51effd640 1 -- 172.21.15.5:0/3219425438 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff52c0ac4b0 con 0x55c1ebf841b0 2024-08-31T05:31:13.524 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.518+0000 7ff542224740 1 -- 172.21.15.5:0/3219425438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c1ebf841b0 msgr2=0x55c1ec341e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:13.524 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.518+0000 7ff542224740 1 --2- 172.21.15.5:0/3219425438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c1ebf841b0 0x55c1ec341e20 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7ff52c0049d0 tx=0x7ff52c0cf040 comp rx=0 tx=0).stop 2024-08-31T05:31:13.524 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.519+0000 7ff542224740 1 -- 172.21.15.5:0/3219425438 shutdown_connections 2024-08-31T05:31:13.525 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.519+0000 7ff542224740 1 --2- 172.21.15.5:0/3219425438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c1ebf841b0 0x55c1ec341e20 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:13.525 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.519+0000 7ff542224740 1 --2- 172.21.15.5:0/3219425438 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1ebf634d0 0x55c1ec3418e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:13.525 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.519+0000 7ff542224740 1 --2- 172.21.15.5:0/3219425438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c1ebf5b2f0 0x55c1ec329420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:13.525 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.519+0000 7ff542224740 1 -- 172.21.15.5:0/3219425438 >> 172.21.15.5:0/3219425438 conn(0x55c1ebf78300 msgr2=0x55c1ec328d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:13.525 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.519+0000 7ff542224740 1 -- 172.21.15.5:0/3219425438 shutdown_connections 2024-08-31T05:31:13.525 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.519+0000 7ff542224740 1 -- 172.21.15.5:0/3219425438 wait complete. 2024-08-31T05:31:13.525 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.519+0000 7ff542224740 1 -- start start 2024-08-31T05:31:13.525 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.519+0000 7ff542224740 1 Processor -- start 2024-08-31T05:31:13.525 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.520+0000 7ff542224740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c1ebf5b2f0 0x55c1ec348960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:13.525 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.520+0000 7ff542224740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1ebf634d0 0x55c1ec348ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:13.525 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.520+0000 7ff542224740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c1ebf841b0 0x55c1ec3493e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:13.525 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.520+0000 7ff542224740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff5341afe50 con 0x55c1ebf5b2f0 2024-08-31T05:31:13.525 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.520+0000 7ff542224740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff5341af780 con 0x55c1ebf841b0 2024-08-31T05:31:13.526 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.520+0000 7ff542224740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff5341ac9c0 con 0x55c1ebf634d0 2024-08-31T05:31:13.526 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.520+0000 7ff542224740 10 client.0 _ll_register_callbacks cb 0x7ff524009a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:31:13.526 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.520+0000 7ff53905a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c1ebf5b2f0 0x55c1ec348960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:13.526 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.520+0000 7ff53905a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c1ebf5b2f0 0x55c1ec348960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41274/0 (socket says 172.21.15.5:41274) 2024-08-31T05:31:13.526 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.520+0000 7ff53905a640 1 -- 172.21.15.5:0/1993621217 learned_addr learned my addr 172.21.15.5:0/1993621217 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:13.526 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.520+0000 7ff538859640 1 --2- 172.21.15.5:0/1993621217 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1ebf634d0 0x55c1ec348ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:13.526 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.520+0000 7ff53985b640 1 --2- 172.21.15.5:0/1993621217 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c1ebf841b0 0x55c1ec3493e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:13.526 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.520+0000 7ff53905a640 1 -- 172.21.15.5:0/1993621217 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1ebf634d0 msgr2=0x55c1ec348ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:13.526 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.520+0000 7ff53905a640 1 --2- 172.21.15.5:0/1993621217 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1ebf634d0 0x55c1ec348ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:13.526 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.520+0000 7ff53905a640 1 -- 172.21.15.5:0/1993621217 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c1ebf841b0 msgr2=0x55c1ec3493e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:13.526 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.520+0000 7ff53905a640 1 --2- 172.21.15.5:0/1993621217 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c1ebf841b0 0x55c1ec3493e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:13.526 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.520+0000 7ff53905a640 1 -- 172.21.15.5:0/1993621217 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1ec3b10d0 con 0x55c1ebf5b2f0 2024-08-31T05:31:13.527 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.521+0000 7ff51cff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:31:13.527 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.521+0000 7ff53905a640 1 --2- 172.21.15.5:0/1993621217 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c1ebf5b2f0 0x55c1ec348960 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7ff530032f30 tx=0x7ff530005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=341b478e85815370 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:13.527 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.521+0000 7ff51cff9640 1 -- 172.21.15.5:0/1993621217 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53005f030 con 0x55c1ebf5b2f0 2024-08-31T05:31:13.527 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.521+0000 7ff542224740 1 -- 172.21.15.5:0/1993621217 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff52c0ac950 con 0x55c1ebf5b2f0 2024-08-31T05:31:13.527 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.521+0000 7ff51cff9640 1 -- 172.21.15.5:0/1993621217 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7ff530031770 con 0x55c1ebf5b2f0 2024-08-31T05:31:13.527 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.521+0000 7ff51cff9640 1 -- 172.21.15.5:0/1993621217 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff530069050 con 0x55c1ebf5b2f0 2024-08-31T05:31:13.527 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.521+0000 7ff542224740 10 client.15909 fetch_fsmap learned FSMap version 30 2024-08-31T05:31:13.527 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.521+0000 7ff542224740 1 -- 172.21.15.5:0/1993621217 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c1ec3b2360 con 0x55c1ebf5b2f0 2024-08-31T05:31:13.527 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.521+0000 7ff51cff9640 1 -- 172.21.15.5:0/1993621217 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff52c0ac950 con 0x55c1ebf5b2f0 2024-08-31T05:31:13.527 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.521+0000 7ff51cff9640 1 -- 172.21.15.5:0/1993621217 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7ff530064450 con 0x55c1ebf5b2f0 2024-08-31T05:31:13.527 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.521+0000 7ff542224740 10 client.15909 fetch_fsmap finished waiting for FSMap version 30 2024-08-31T05:31:13.528 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.521+0000 7ff542224740 10 client.15909 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:31:13.528 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.521+0000 7ff542224740 20 client.15909 populate_metadata read hostname 'smithi005' 2024-08-31T05:31:13.528 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.521+0000 7ff542224740 1 --2- 172.21.15.5:0/1993621217 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55c1ebf181c0 0x55c1ec3b4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:13.528 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.521+0000 7ff542224740 4 client.15909 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:31:13.528 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.521+0000 7ff542224740 1 -- 172.21.15.5:0/1993621217 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c1ec29a9f0 con 0x55c1ebf181c0 2024-08-31T05:31:13.528 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.522+0000 7ff538859640 1 --2- 172.21.15.5:0/1993621217 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55c1ebf181c0 0x55c1ec3b4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:13.528 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.522+0000 7ff51cff9640 10 client.15909 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:31:13.528 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.522+0000 7ff538859640 1 --2- 172.21.15.5:0/1993621217 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55c1ebf181c0 0x55c1ec3b4ab0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aee97195849d1652 server_cookie=9eee7da07b3be076 in_seq=0 out_seq=0 2024-08-31T05:31:13.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.581+0000 7ff51cff9640 1 -- 172.21.15.5:0/1993621217 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c1ec29a9f0 con 0x55c1ebf181c0 2024-08-31T05:31:13.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.581+0000 7ff51cff9640 10 client.15909 handle_command_reply: tid=0 2024-08-31T05:31:13.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.581+0000 7ff542224740 1 client.15909 shutdown 2024-08-31T05:31:13.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.581+0000 7ff542224740 1 -- 172.21.15.5:0/1993621217 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c1ebf5b2f0 msgr2=0x55c1ec348960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:13.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.581+0000 7ff542224740 1 --2- 172.21.15.5:0/1993621217 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c1ebf5b2f0 0x55c1ec348960 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7ff530032f30 tx=0x7ff530005f10 comp rx=0 tx=0).stop 2024-08-31T05:31:13.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.581+0000 7ff542224740 1 -- 172.21.15.5:0/1993621217 shutdown_connections 2024-08-31T05:31:13.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.581+0000 7ff542224740 1 --2- 172.21.15.5:0/1993621217 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55c1ebf181c0 0x55c1ec3b4ab0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:13.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.581+0000 7ff542224740 1 --2- 172.21.15.5:0/1993621217 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c1ebf841b0 0x55c1ec3493e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:13.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.581+0000 7ff51cff9640 0 client.15909 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:31:13.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.581+0000 7ff542224740 1 --2- 172.21.15.5:0/1993621217 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1ebf634d0 0x55c1ec348ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:13.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.581+0000 7ff542224740 1 --2- 172.21.15.5:0/1993621217 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c1ebf5b2f0 0x55c1ec348960 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:13.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.581+0000 7ff542224740 1 -- 172.21.15.5:0/1993621217 >> 172.21.15.5:0/1993621217 conn(0x55c1ebf78300 msgr2=0x55c1ec32d590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:13.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.581+0000 7ff542224740 1 -- 172.21.15.5:0/1993621217 shutdown_connections 2024-08-31T05:31:13.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.581+0000 7ff542224740 1 -- 172.21.15.5:0/1993621217 wait complete. 2024-08-31T05:31:13.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.581+0000 7ff542224740 20 client.15909 trim_cache size 0 max 16384 2024-08-31T05:31:13.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:31:13.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:31:13.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:31:13.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:31:13.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.582+0000 7ff53b2be640 1 -- 172.21.15.5:0/3420094946 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff5200b4d30 msgr2=0x7ff5200b7240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:13.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.582+0000 7ff53b2be640 1 --2- 172.21.15.5:0/3420094946 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff5200b4d30 0x7ff5200b7240 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff524009710 tx=0x7ff524015040 comp rx=0 tx=0).stop 2024-08-31T05:31:13.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.582+0000 7ff53b2be640 1 -- 172.21.15.5:0/3420094946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff534108a30 msgr2=0x7ff53419e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:13.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.582+0000 7ff53b2be640 1 --2- 172.21.15.5:0/3420094946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff534108a30 0x7ff53419e9b0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7ff52c00eb10 tx=0x7ff52c00c2d0 comp rx=0 tx=0).stop 2024-08-31T05:31:13.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.582+0000 7ff53b2be640 1 -- 172.21.15.5:0/3420094946 shutdown_connections 2024-08-31T05:31:13.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.582+0000 7ff53b2be640 1 --2- 172.21.15.5:0/3420094946 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff5200b4d30 0x7ff5200b7240 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:13.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.582+0000 7ff53b2be640 1 --2- 172.21.15.5:0/3420094946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff534108a30 0x7ff53419e9b0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:13.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.582+0000 7ff53b2be640 1 --2- 172.21.15.5:0/3420094946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff5341080e0 0x7ff534199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:13.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.582+0000 7ff53b2be640 1 --2- 172.21.15.5:0/3420094946 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff5341027b0 0x7ff534199180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:13.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.582+0000 7ff53b2be640 1 -- 172.21.15.5:0/3420094946 >> 172.21.15.5:0/3420094946 conn(0x7ff5340fe1b0 msgr2=0x7ff5341077d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:13.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.582+0000 7ff53b2be640 1 -- 172.21.15.5:0/3420094946 shutdown_connections 2024-08-31T05:31:13.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:13.582+0000 7ff53b2be640 1 -- 172.21.15.5:0/3420094946 wait complete. 2024-08-31T05:31:13.907 INFO:tasks.workunit.client.0.smithi005.stdout: 1 3024 33.54 MB/sec warmup 1 sec latency 31.568 ms 2024-08-31T05:31:14.907 INFO:tasks.workunit.client.0.smithi005.stdout: 1 5983 23.61 MB/sec warmup 2 sec latency 11.097 ms 2024-08-31T05:31:15.335 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:31:15 smithi070 ceph-mon[22316]: pgmap v383: 129 pgs: 129 active+clean; 1.6 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 39 KiB/s wr, 30 op/s 2024-08-31T05:31:15.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:31:15 smithi050 ceph-mon[22146]: pgmap v383: 129 pgs: 129 active+clean; 1.6 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 39 KiB/s wr, 30 op/s 2024-08-31T05:31:15.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:31:15 smithi005 ceph-mon[18602]: pgmap v383: 129 pgs: 129 active+clean; 1.6 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 39 KiB/s wr, 30 op/s 2024-08-31T05:31:15.907 INFO:tasks.workunit.client.0.smithi005.stdout: 1 8366 20.44 MB/sec warmup 3 sec latency 10.721 ms 2024-08-31T05:31:16.907 INFO:tasks.workunit.client.0.smithi005.stdout: 1 11251 19.58 MB/sec warmup 4 sec latency 13.165 ms 2024-08-31T05:31:17.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:31:17 smithi070 ceph-mon[22316]: pgmap v384: 129 pgs: 129 active+clean; 2.5 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 124 KiB/s wr, 41 op/s 2024-08-31T05:31:17.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:31:17 smithi050 ceph-mon[22146]: pgmap v384: 129 pgs: 129 active+clean; 2.5 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 124 KiB/s wr, 41 op/s 2024-08-31T05:31:17.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:31:17 smithi005 ceph-mon[18602]: pgmap v384: 129 pgs: 129 active+clean; 2.5 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 124 KiB/s wr, 41 op/s 2024-08-31T05:31:17.907 INFO:tasks.workunit.client.0.smithi005.stdout: 1 14451 19.42 MB/sec warmup 5 sec latency 15.812 ms 2024-08-31T05:31:18.907 INFO:tasks.workunit.client.0.smithi005.stdout: 1 17123 18.33 MB/sec warmup 6 sec latency 39.062 ms 2024-08-31T05:31:19.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:31:19 smithi070 ceph-mon[22316]: pgmap v385: 129 pgs: 129 active+clean; 2.9 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 152 KiB/s wr, 46 op/s 2024-08-31T05:31:19.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:31:19 smithi070 ceph-mon[22316]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T05:31:19.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:31:19 smithi050 ceph-mon[22146]: pgmap v385: 129 pgs: 129 active+clean; 2.9 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 152 KiB/s wr, 46 op/s 2024-08-31T05:31:19.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:31:19 smithi050 ceph-mon[22146]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T05:31:19.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:31:19 smithi005 ceph-mon[18602]: pgmap v385: 129 pgs: 129 active+clean; 2.9 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 152 KiB/s wr, 46 op/s 2024-08-31T05:31:19.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:31:19 smithi005 ceph-mon[18602]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T05:31:19.907 INFO:tasks.workunit.client.0.smithi005.stdout: 1 20119 17.64 MB/sec warmup 7 sec latency 10.476 ms 2024-08-31T05:31:20.907 INFO:tasks.workunit.client.0.smithi005.stdout: 1 22512 17.22 MB/sec warmup 8 sec latency 11.814 ms 2024-08-31T05:31:21.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:31:21 smithi070 ceph-mon[22316]: pgmap v386: 129 pgs: 129 active+clean; 9.5 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 829 KiB/s wr, 137 op/s 2024-08-31T05:31:21.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:31:21 smithi050 ceph-mon[22146]: pgmap v386: 129 pgs: 129 active+clean; 9.5 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 829 KiB/s wr, 137 op/s 2024-08-31T05:31:21.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:31:21 smithi005 ceph-mon[18602]: pgmap v386: 129 pgs: 129 active+clean; 9.5 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 829 KiB/s wr, 137 op/s 2024-08-31T05:31:21.907 INFO:tasks.workunit.client.0.smithi005.stdout: 1 25431 17.21 MB/sec warmup 9 sec latency 15.988 ms 2024-08-31T05:31:22.907 INFO:tasks.workunit.client.0.smithi005.stdout: 1 28678 17.37 MB/sec warmup 10 sec latency 11.079 ms 2024-08-31T05:31:23.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:31:23 smithi050 ceph-mon[22146]: pgmap v387: 129 pgs: 129 active+clean; 9.9 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 882 KiB/s wr, 138 op/s 2024-08-31T05:31:23.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:31:23 smithi005 ceph-mon[18602]: pgmap v387: 129 pgs: 129 active+clean; 9.9 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 882 KiB/s wr, 138 op/s 2024-08-31T05:31:23.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:31:23 smithi070 ceph-mon[22316]: pgmap v387: 129 pgs: 129 active+clean; 9.9 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 882 KiB/s wr, 138 op/s 2024-08-31T05:31:23.907 INFO:tasks.workunit.client.0.smithi005.stdout: 1 31415 16.96 MB/sec warmup 11 sec latency 16.821 ms 2024-08-31T05:31:24.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:31:24 smithi050 ceph-mon[22146]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T05:31:24.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:31:24 smithi005 ceph-mon[18602]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T05:31:24.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:31:24 smithi070 ceph-mon[22316]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T05:31:24.907 INFO:tasks.workunit.client.0.smithi005.stdout: 1 34389 16.69 MB/sec warmup 12 sec latency 11.682 ms 2024-08-31T05:31:25.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:31:25 smithi050 ceph-mon[22146]: pgmap v388: 129 pgs: 129 active+clean; 10 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 913 KiB/s wr, 142 op/s 2024-08-31T05:31:25.431 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T05:31:25.457 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:31:25 smithi005 ceph-mon[18602]: pgmap v388: 129 pgs: 129 active+clean; 10 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 913 KiB/s wr, 142 op/s 2024-08-31T05:31:25.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:31:25 smithi070 ceph-mon[22316]: pgmap v388: 129 pgs: 129 active+clean; 10 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 913 KiB/s wr, 142 op/s 2024-08-31T05:31:25.705 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:31:25.907 INFO:tasks.workunit.client.0.smithi005.stdout: 1 36956 16.71 MB/sec warmup 13 sec latency 10.927 ms 2024-08-31T05:31:26.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.238+0000 7fb03c657640 1 -- 172.21.15.5:0/366024531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb034109250 msgr2=0x7fb034109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:26.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.238+0000 7fb03c657640 1 --2- 172.21.15.5:0/366024531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb034109250 0x7fb034109660 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fb024009900 tx=0x7fb02402a410 comp rx=0 tx=0).stop 2024-08-31T05:31:26.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.238+0000 7fb03c657640 1 -- 172.21.15.5:0/366024531 shutdown_connections 2024-08-31T05:31:26.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.238+0000 7fb03c657640 1 --2- 172.21.15.5:0/366024531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb034109ba0 0x7fb0341103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.238+0000 7fb03c657640 1 --2- 172.21.15.5:0/366024531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb034109250 0x7fb034109660 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.238+0000 7fb03c657640 1 --2- 172.21.15.5:0/366024531 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb034103910 0x7fb034103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.238+0000 7fb03c657640 1 -- 172.21.15.5:0/366024531 >> 172.21.15.5:0/366024531 conn(0x7fb0340ff380 msgr2=0x7fb0341017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:26.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.239+0000 7fb03c657640 1 -- 172.21.15.5:0/366024531 shutdown_connections 2024-08-31T05:31:26.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.239+0000 7fb03c657640 1 -- 172.21.15.5:0/366024531 wait complete. 2024-08-31T05:31:26.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.239+0000 7fb03c657640 1 Processor -- start 2024-08-31T05:31:26.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.239+0000 7fb03c657640 1 -- start start 2024-08-31T05:31:26.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.240+0000 7fb03c657640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb034103910 0x7fb0340754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:26.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.240+0000 7fb03c657640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb034109250 0x7fb0340759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:26.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.240+0000 7fb03c657640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb034109ba0 0x7fb034075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:26.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.240+0000 7fb03c657640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb034113860 con 0x7fb034109ba0 2024-08-31T05:31:26.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.240+0000 7fb03c657640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb0341136e0 con 0x7fb034109250 2024-08-31T05:31:26.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.240+0000 7fb03c657640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb0341139e0 con 0x7fb034103910 2024-08-31T05:31:26.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.240+0000 7fb03a3f3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb034103910 0x7fb0340754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:26.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.240+0000 7fb03abf4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb034109ba0 0x7fb034075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:26.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.240+0000 7fb03a3f3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb034103910 0x7fb0340754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:56662/0 (socket says 172.21.15.5:56662) 2024-08-31T05:31:26.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.240+0000 7fb03abf4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb034109ba0 0x7fb034075f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53374/0 (socket says 172.21.15.5:53374) 2024-08-31T05:31:26.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.240+0000 7fb039bf2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb034109250 0x7fb0340759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:26.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.240+0000 7fb03a3f3640 1 -- 172.21.15.5:0/3752112574 learned_addr learned my addr 172.21.15.5:0/3752112574 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:26.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.240+0000 7fb03a3f3640 1 -- 172.21.15.5:0/3752112574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb034109250 msgr2=0x7fb0340759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:26.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.240+0000 7fb03a3f3640 1 --2- 172.21.15.5:0/3752112574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb034109250 0x7fb0340759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.240+0000 7fb03a3f3640 1 -- 172.21.15.5:0/3752112574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb034109ba0 msgr2=0x7fb034075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:26.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.240+0000 7fb03a3f3640 1 --2- 172.21.15.5:0/3752112574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb034109ba0 0x7fb034075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.240+0000 7fb03a3f3640 1 -- 172.21.15.5:0/3752112574 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0341a8510 con 0x7fb034103910 2024-08-31T05:31:26.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.240+0000 7fb03abf4640 1 --2- 172.21.15.5:0/3752112574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb034109ba0 0x7fb034075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:31:26.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.240+0000 7fb03a3f3640 1 --2- 172.21.15.5:0/3752112574 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb034103910 0x7fb0340754b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb03000e9f0 tx=0x7fb03000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:26.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.240+0000 7fb02b7fe640 1 -- 172.21.15.5:0/3752112574 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03000cd80 con 0x7fb034103910 2024-08-31T05:31:26.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.241+0000 7fb03c657640 1 -- 172.21.15.5:0/3752112574 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0341a8800 con 0x7fb034103910 2024-08-31T05:31:26.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.241+0000 7fb02b7fe640 1 -- 172.21.15.5:0/3752112574 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb0300108e0 con 0x7fb034103910 2024-08-31T05:31:26.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.241+0000 7fb02b7fe640 1 -- 172.21.15.5:0/3752112574 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb030018980 con 0x7fb034103910 2024-08-31T05:31:26.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.241+0000 7fb03c657640 1 -- 172.21.15.5:0/3752112574 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0341a8d60 con 0x7fb034103910 2024-08-31T05:31:26.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.243+0000 7fb042bcc740 1 Processor -- start 2024-08-31T05:31:26.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.244+0000 7fb042bcc740 1 -- start start 2024-08-31T05:31:26.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.244+0000 7fb02b7fe640 1 -- 172.21.15.5:0/3752112574 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 152758+0+0 (secure 0 0 0) 0x7fb030018b20 con 0x7fb034103910 2024-08-31T05:31:26.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.244+0000 7fb042bcc740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c81b5a070 0x560c81eff2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:26.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.244+0000 7fb042bcc740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c81b311b0 0x560c81eff800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:26.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.244+0000 7fb03a3f3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c81b311b0 0x560c81eff800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:26.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.244+0000 7fb03a3f3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c81b311b0 0x560c81eff800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:56664/0 (socket says 172.21.15.5:56664) 2024-08-31T05:31:26.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.244+0000 7fb03a3f3640 1 -- 172.21.15.5:0/3150645705 learned_addr learned my addr 172.21.15.5:0/3150645705 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:26.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.244+0000 7fb03abf4640 1 --2- 172.21.15.5:0/3150645705 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c81b5a070 0x560c81eff2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:26.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.245+0000 7fb042bcc740 1 --2- 172.21.15.5:0/3150645705 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c81b39390 0x560c81effd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:26.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.245+0000 7fb042bcc740 1 -- 172.21.15.5:0/3150645705 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x560c81e76630 con 0x560c81b39390 2024-08-31T05:31:26.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.245+0000 7fb042bcc740 1 -- 172.21.15.5:0/3150645705 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560c81e65bc0 con 0x560c81b5a070 2024-08-31T05:31:26.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.245+0000 7fb042bcc740 1 -- 172.21.15.5:0/3150645705 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560c81e69b70 con 0x560c81b311b0 2024-08-31T05:31:26.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.245+0000 7fb039bf2640 1 --2- 172.21.15.5:0/3150645705 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c81b39390 0x560c81effd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:26.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.245+0000 7fb03a3f3640 1 -- 172.21.15.5:0/3150645705 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c81b5a070 msgr2=0x560c81eff2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:26.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.245+0000 7fb03a3f3640 1 --2- 172.21.15.5:0/3150645705 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c81b5a070 0x560c81eff2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.245+0000 7fb03a3f3640 1 -- 172.21.15.5:0/3150645705 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c81b39390 msgr2=0x560c81effd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:26.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.245+0000 7fb03a3f3640 1 --2- 172.21.15.5:0/3150645705 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c81b39390 0x560c81effd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.245+0000 7fb03a3f3640 1 -- 172.21.15.5:0/3150645705 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c81bc5650 con 0x560c81b311b0 2024-08-31T05:31:26.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.245+0000 7fb03abf4640 1 --2- 172.21.15.5:0/3150645705 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c81b5a070 0x560c81eff2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:31:26.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.245+0000 7fb039bf2640 1 --2- 172.21.15.5:0/3150645705 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c81b39390 0x560c81effd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:31:26.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.245+0000 7fb02b7fe640 1 --2- 172.21.15.5:0/3752112574 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb0200b4d30 0x7fb0200b7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:26.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.245+0000 7fb03a3f3640 1 --2- 172.21.15.5:0/3150645705 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c81b311b0 0x560c81eff800 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb0300e3090 tx=0x7fb0300ee4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3cf0cb4b55a32822 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:26.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.246+0000 7fb03abf4640 1 --2- 172.21.15.5:0/3752112574 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb0200b4d30 0x7fb0200b7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:26.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.246+0000 7fb028ff9640 1 -- 172.21.15.5:0/3150645705 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0300a7f50 con 0x560c81b311b0 2024-08-31T05:31:26.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.246+0000 7fb02b7fe640 1 -- 172.21.15.5:0/3752112574 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fb0300e5de0 con 0x7fb034103910 2024-08-31T05:31:26.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.246+0000 7fb028ff9640 1 -- 172.21.15.5:0/3150645705 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb0300abba0 con 0x560c81b311b0 2024-08-31T05:31:26.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.246+0000 7fb028ff9640 1 -- 172.21.15.5:0/3150645705 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0300ab800 con 0x560c81b311b0 2024-08-31T05:31:26.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.247+0000 7fb042bcc740 1 -- 172.21.15.5:0/3150645705 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c81b311b0 msgr2=0x560c81eff800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:26.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.247+0000 7fb03abf4640 1 --2- 172.21.15.5:0/3752112574 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb0200b4d30 0x7fb0200b7240 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb02c005fd0 tx=0x7fb02c009600 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:26.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.247+0000 7fb042bcc740 1 --2- 172.21.15.5:0/3150645705 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c81b311b0 0x560c81eff800 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb0300e3090 tx=0x7fb0300ee4b0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.247+0000 7fb042bcc740 1 -- 172.21.15.5:0/3150645705 shutdown_connections 2024-08-31T05:31:26.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.247+0000 7fb042bcc740 1 --2- 172.21.15.5:0/3150645705 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c81b39390 0x560c81effd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.247+0000 7fb042bcc740 1 --2- 172.21.15.5:0/3150645705 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c81b311b0 0x560c81eff800 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.247+0000 7fb042bcc740 1 --2- 172.21.15.5:0/3150645705 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c81b5a070 0x560c81eff2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.247+0000 7fb042bcc740 1 -- 172.21.15.5:0/3150645705 >> 172.21.15.5:0/3150645705 conn(0x560c81b4e460 msgr2=0x560c81efd1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:26.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.247+0000 7fb042bcc740 1 -- 172.21.15.5:0/3150645705 shutdown_connections 2024-08-31T05:31:26.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.247+0000 7fb042bcc740 1 -- 172.21.15.5:0/3150645705 wait complete. 2024-08-31T05:31:26.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.247+0000 7fb042bcc740 1 -- start start 2024-08-31T05:31:26.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.248+0000 7fb042bcc740 1 Processor -- start 2024-08-31T05:31:26.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.248+0000 7fb042bcc740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c81b311b0 0x560c81f0aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:26.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.248+0000 7fb042bcc740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c81b39390 0x560c81f0afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:26.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.248+0000 7fb042bcc740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c81b5a070 0x560c81f16d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:26.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.248+0000 7fb042bcc740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x560c81cc8700 con 0x560c81b5a070 2024-08-31T05:31:26.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.248+0000 7fb042bcc740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560c81dec700 con 0x560c81b311b0 2024-08-31T05:31:26.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.248+0000 7fb042bcc740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560c81f0daa0 con 0x560c81b39390 2024-08-31T05:31:26.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.248+0000 7fb042bcc740 10 client.0 _ll_register_callbacks cb 0x560c81e1bdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:31:26.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.248+0000 7fb03abf4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c81b5a070 0x560c81f16d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:26.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.248+0000 7fb03abf4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c81b5a070 0x560c81f16d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53392/0 (socket says 172.21.15.5:53392) 2024-08-31T05:31:26.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.248+0000 7fb03abf4640 1 -- 172.21.15.5:0/1583262534 learned_addr learned my addr 172.21.15.5:0/1583262534 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:26.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.248+0000 7fb039bf2640 1 --2- 172.21.15.5:0/1583262534 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c81b39390 0x560c81f0afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:26.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.248+0000 7fb03a3f3640 1 --2- 172.21.15.5:0/1583262534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c81b311b0 0x560c81f0aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:26.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.249+0000 7fb039bf2640 1 -- 172.21.15.5:0/1583262534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c81b311b0 msgr2=0x560c81f0aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:26.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.249+0000 7fb039bf2640 1 --2- 172.21.15.5:0/1583262534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c81b311b0 0x560c81f0aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.249+0000 7fb039bf2640 1 -- 172.21.15.5:0/1583262534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c81b5a070 msgr2=0x560c81f16d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:26.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.249+0000 7fb039bf2640 1 --2- 172.21.15.5:0/1583262534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c81b5a070 0x560c81f16d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.249+0000 7fb039bf2640 1 -- 172.21.15.5:0/1583262534 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c81e258b0 con 0x560c81b39390 2024-08-31T05:31:26.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.249+0000 7fb03abf4640 1 --2- 172.21.15.5:0/1583262534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c81b5a070 0x560c81f16d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:31:26.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.249+0000 7fb039bf2640 1 --2- 172.21.15.5:0/1583262534 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c81b39390 0x560c81f0afc0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb02402a930 tx=0x7fb024032e90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=796c672c92235d28 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:26.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.249+0000 7fb01dffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:31:26.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.249+0000 7fb01dffb640 1 -- 172.21.15.5:0/1583262534 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb024040070 con 0x560c81b39390 2024-08-31T05:31:26.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.249+0000 7fb01dffb640 1 -- 172.21.15.5:0/1583262534 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fb024004040 con 0x560c81b39390 2024-08-31T05:31:26.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.249+0000 7fb042bcc740 1 -- 172.21.15.5:0/1583262534 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0300abba0 con 0x560c81b39390 2024-08-31T05:31:26.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.249+0000 7fb01dffb640 1 -- 172.21.15.5:0/1583262534 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fb02404d050 con 0x560c81b39390 2024-08-31T05:31:26.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.249+0000 7fb042bcc740 10 client.25543 fetch_fsmap learned FSMap version 32 2024-08-31T05:31:26.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.249+0000 7fb042bcc740 1 -- 172.21.15.5:0/1583262534 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x560c81f19840 con 0x560c81b39390 2024-08-31T05:31:26.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.249+0000 7fb01dffb640 1 -- 172.21.15.5:0/1583262534 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb0300abba0 con 0x560c81b39390 2024-08-31T05:31:26.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.250+0000 7fb01dffb640 1 -- 172.21.15.5:0/1583262534 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7fb024004750 con 0x560c81b39390 2024-08-31T05:31:26.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.250+0000 7fb042bcc740 10 client.25543 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:31:26.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.250+0000 7fb042bcc740 10 client.25543 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:31:26.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.250+0000 7fb042bcc740 20 client.25543 populate_metadata read hostname 'smithi005' 2024-08-31T05:31:26.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.251+0000 7fb042bcc740 1 --2- 172.21.15.5:0/1583262534 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x560c81b189f0 0x560c81f1ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:26.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.251+0000 7fb042bcc740 4 client.25543 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:31:26.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.251+0000 7fb042bcc740 1 -- 172.21.15.5:0/1583262534 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560c81e78580 con 0x560c81b189f0 2024-08-31T05:31:26.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.251+0000 7fb03a3f3640 1 --2- 172.21.15.5:0/1583262534 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x560c81b189f0 0x560c81f1ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:26.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.251+0000 7fb01dffb640 10 client.25543 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:31:26.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.251+0000 7fb03a3f3640 1 --2- 172.21.15.5:0/1583262534 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x560c81b189f0 0x560c81f1ce10 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d860e8a8a3152a4b server_cookie=3ce59dd39a23dd0c in_seq=0 out_seq=0 2024-08-31T05:31:26.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.252+0000 7fb01dffb640 1 -- 172.21.15.5:0/1583262534 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560c81e78580 con 0x560c81b189f0 2024-08-31T05:31:26.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.252+0000 7fb01dffb640 10 client.25543 handle_command_reply: tid=0 2024-08-31T05:31:26.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.252+0000 7fb042bcc740 1 client.25543 shutdown 2024-08-31T05:31:26.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.253+0000 7fb042bcc740 1 -- 172.21.15.5:0/1583262534 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c81b39390 msgr2=0x560c81f0afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:26.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.253+0000 7fb042bcc740 1 --2- 172.21.15.5:0/1583262534 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c81b39390 0x560c81f0afc0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb02402a930 tx=0x7fb024032e90 comp rx=0 tx=0).stop 2024-08-31T05:31:26.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.253+0000 7fb042bcc740 1 -- 172.21.15.5:0/1583262534 shutdown_connections 2024-08-31T05:31:26.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.253+0000 7fb042bcc740 1 --2- 172.21.15.5:0/1583262534 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x560c81b189f0 0x560c81f1ce10 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.253+0000 7fb042bcc740 1 --2- 172.21.15.5:0/1583262534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c81b5a070 0x560c81f16d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.253+0000 7fb042bcc740 1 --2- 172.21.15.5:0/1583262534 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c81b39390 0x560c81f0afc0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.253+0000 7fb042bcc740 1 --2- 172.21.15.5:0/1583262534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c81b311b0 0x560c81f0aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.253+0000 7fb01dffb640 0 client.25543 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:31:26.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.253+0000 7fb042bcc740 1 -- 172.21.15.5:0/1583262534 >> 172.21.15.5:0/1583262534 conn(0x560c81b4e460 msgr2=0x560c81f002f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:26.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.253+0000 7fb042bcc740 1 -- 172.21.15.5:0/1583262534 shutdown_connections 2024-08-31T05:31:26.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.253+0000 7fb042bcc740 1 -- 172.21.15.5:0/1583262534 wait complete. 2024-08-31T05:31:26.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.253+0000 7fb042bcc740 20 client.25543 trim_cache size 0 max 16384 2024-08-31T05:31:26.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.273+0000 7fb042bcc740 1 Processor -- start 2024-08-31T05:31:26.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.273+0000 7fb042bcc740 1 -- start start 2024-08-31T05:31:26.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.273+0000 7fb042bcc740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c81b311b0 0x560c81f0af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:26.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.273+0000 7fb042bcc740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c81b39390 0x560c81f16c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:26.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.273+0000 7fb042bcc740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c81b5a070 0x560c81f171d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:26.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.273+0000 7fb042bcc740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb0341b2ed0 con 0x560c81b5a070 2024-08-31T05:31:26.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.273+0000 7fb042bcc740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb0341b4ad0 con 0x560c81b311b0 2024-08-31T05:31:26.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.273+0000 7fb042bcc740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb0341b35a0 con 0x560c81b39390 2024-08-31T05:31:26.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.273+0000 7fb03abf4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c81b5a070 0x560c81f171d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:26.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.273+0000 7fb03a3f3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c81b311b0 0x560c81f0af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:26.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.273+0000 7fb03abf4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c81b5a070 0x560c81f171d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53398/0 (socket says 172.21.15.5:53398) 2024-08-31T05:31:26.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.273+0000 7fb03abf4640 1 -- 172.21.15.5:0/3363692820 learned_addr learned my addr 172.21.15.5:0/3363692820 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:26.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.273+0000 7fb039bf2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c81b39390 0x560c81f16c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:26.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.274+0000 7fb03a3f3640 1 -- 172.21.15.5:0/3363692820 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c81b39390 msgr2=0x560c81f16c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:26.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.274+0000 7fb03a3f3640 1 --2- 172.21.15.5:0/3363692820 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c81b39390 0x560c81f16c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.274+0000 7fb03a3f3640 1 -- 172.21.15.5:0/3363692820 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c81b5a070 msgr2=0x560c81f171d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:26.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.274+0000 7fb03a3f3640 1 --2- 172.21.15.5:0/3363692820 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c81b5a070 0x560c81f171d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.274+0000 7fb03a3f3640 1 -- 172.21.15.5:0/3363692820 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c81efdf40 con 0x560c81b311b0 2024-08-31T05:31:26.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.274+0000 7fb03a3f3640 1 --2- 172.21.15.5:0/3363692820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c81b311b0 0x560c81f0af40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb0300e3180 tx=0x7fb03000cf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd4ebd330396991d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:26.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.274+0000 7fb01ffff640 1 -- 172.21.15.5:0/3363692820 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0300ab9e0 con 0x560c81b311b0 2024-08-31T05:31:26.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.274+0000 7fb01ffff640 1 -- 172.21.15.5:0/3363692820 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb0300abba0 con 0x560c81b311b0 2024-08-31T05:31:26.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.274+0000 7fb01ffff640 1 -- 172.21.15.5:0/3363692820 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0300abe60 con 0x560c81b311b0 2024-08-31T05:31:26.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.275+0000 7fb042bcc740 1 -- 172.21.15.5:0/3363692820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c81b311b0 msgr2=0x560c81f0af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:26.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.275+0000 7fb042bcc740 1 --2- 172.21.15.5:0/3363692820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c81b311b0 0x560c81f0af40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb0300e3180 tx=0x7fb03000cf20 comp rx=0 tx=0).stop 2024-08-31T05:31:26.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.275+0000 7fb042bcc740 1 -- 172.21.15.5:0/3363692820 shutdown_connections 2024-08-31T05:31:26.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.275+0000 7fb042bcc740 1 --2- 172.21.15.5:0/3363692820 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c81b5a070 0x560c81f171d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.275+0000 7fb042bcc740 1 --2- 172.21.15.5:0/3363692820 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c81b39390 0x560c81f16c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.275+0000 7fb042bcc740 1 --2- 172.21.15.5:0/3363692820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c81b311b0 0x560c81f0af40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.275+0000 7fb042bcc740 1 -- 172.21.15.5:0/3363692820 >> 172.21.15.5:0/3363692820 conn(0x560c81b4e460 msgr2=0x560c81f0a830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:26.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.275+0000 7fb042bcc740 1 -- 172.21.15.5:0/3363692820 shutdown_connections 2024-08-31T05:31:26.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.275+0000 7fb042bcc740 1 -- 172.21.15.5:0/3363692820 wait complete. 2024-08-31T05:31:26.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.276+0000 7fb042bcc740 1 -- start start 2024-08-31T05:31:26.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.276+0000 7fb042bcc740 1 Processor -- start 2024-08-31T05:31:26.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.276+0000 7fb042bcc740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c81b311b0 0x560c81f0ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:26.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.276+0000 7fb042bcc740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c81b39390 0x560c81f0f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:26.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.276+0000 7fb042bcc740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c81b5a070 0x560c81f0f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:26.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.276+0000 7fb042bcc740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb0341b4340 con 0x560c81b39390 2024-08-31T05:31:26.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.276+0000 7fb042bcc740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb0341b3c70 con 0x560c81b5a070 2024-08-31T05:31:26.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.276+0000 7fb042bcc740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb0341b0eb0 con 0x560c81b311b0 2024-08-31T05:31:26.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.276+0000 7fb042bcc740 10 client.0 _ll_register_callbacks cb 0x7fb024009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:31:26.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.276+0000 7fb03a3f3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c81b311b0 0x560c81f0ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:26.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.276+0000 7fb039bf2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c81b39390 0x560c81f0f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:26.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.277+0000 7fb03abf4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c81b5a070 0x560c81f0f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:26.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.277+0000 7fb039bf2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c81b39390 0x560c81f0f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53402/0 (socket says 172.21.15.5:53402) 2024-08-31T05:31:26.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.277+0000 7fb03a3f3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c81b311b0 0x560c81f0ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:56698/0 (socket says 172.21.15.5:56698) 2024-08-31T05:31:26.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.277+0000 7fb039bf2640 1 -- 172.21.15.5:0/1271619767 learned_addr learned my addr 172.21.15.5:0/1271619767 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:26.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.277+0000 7fb039bf2640 1 -- 172.21.15.5:0/1271619767 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c81b311b0 msgr2=0x560c81f0ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:26.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.277+0000 7fb039bf2640 1 --2- 172.21.15.5:0/1271619767 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c81b311b0 0x560c81f0ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.277+0000 7fb039bf2640 1 -- 172.21.15.5:0/1271619767 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c81b5a070 msgr2=0x560c81f0f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:26.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.277+0000 7fb039bf2640 1 --2- 172.21.15.5:0/1271619767 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c81b5a070 0x560c81f0f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.277+0000 7fb039bf2640 1 -- 172.21.15.5:0/1271619767 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c81f86780 con 0x560c81b39390 2024-08-31T05:31:26.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.277+0000 7fb03a3f3640 1 --2- 172.21.15.5:0/1271619767 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c81b311b0 0x560c81f0ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:31:26.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.277+0000 7fb039bf2640 1 --2- 172.21.15.5:0/1271619767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c81b39390 0x560c81f0f190 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x560c81f0d610 tx=0x7fb02402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc69283ac5ffa71a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:26.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.277+0000 7fb01dffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:31:26.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.277+0000 7fb01dffb640 1 -- 172.21.15.5:0/1271619767 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb024040070 con 0x560c81b39390 2024-08-31T05:31:26.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.277+0000 7fb01dffb640 1 -- 172.21.15.5:0/1271619767 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fb02404a070 con 0x560c81b39390 2024-08-31T05:31:26.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.277+0000 7fb042bcc740 1 -- 172.21.15.5:0/1271619767 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0300abba0 con 0x560c81b39390 2024-08-31T05:31:26.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.277+0000 7fb01dffb640 1 -- 172.21.15.5:0/1271619767 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fb024061050 con 0x560c81b39390 2024-08-31T05:31:26.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.278+0000 7fb042bcc740 10 client.15924 fetch_fsmap learned FSMap version 32 2024-08-31T05:31:26.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.278+0000 7fb042bcc740 1 -- 172.21.15.5:0/1271619767 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x560c81f879d0 con 0x560c81b39390 2024-08-31T05:31:26.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.278+0000 7fb01dffb640 1 -- 172.21.15.5:0/1271619767 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb0300abba0 con 0x560c81b39390 2024-08-31T05:31:26.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.278+0000 7fb01dffb640 1 -- 172.21.15.5:0/1271619767 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7fb024005090 con 0x560c81b39390 2024-08-31T05:31:26.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.278+0000 7fb042bcc740 10 client.15924 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:31:26.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.278+0000 7fb042bcc740 10 client.15924 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:31:26.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.278+0000 7fb042bcc740 20 client.15924 populate_metadata read hostname 'smithi005' 2024-08-31T05:31:26.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.278+0000 7fb042bcc740 1 --2- 172.21.15.5:0/1271619767 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x560c81aedda0 0x560c81f8a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:26.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.278+0000 7fb042bcc740 4 client.15924 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T05:31:26.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.278+0000 7fb042bcc740 1 -- 172.21.15.5:0/1271619767 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560c81e74020 con 0x560c81aedda0 2024-08-31T05:31:26.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.278+0000 7fb03a3f3640 1 --2- 172.21.15.5:0/1271619767 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x560c81aedda0 0x560c81f8a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:26.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.279+0000 7fb01dffb640 10 client.15924 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:31:26.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.279+0000 7fb03a3f3640 1 --2- 172.21.15.5:0/1271619767 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x560c81aedda0 0x560c81f8a300 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f62059a9b360cc7 server_cookie=85f47e6c5560242a in_seq=0 out_seq=0 2024-08-31T05:31:26.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.279+0000 7fb01dffb640 1 -- 172.21.15.5:0/1271619767 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+658 (crc 0 0 0) 0x560c81e74020 con 0x560c81aedda0 2024-08-31T05:31:26.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.279+0000 7fb01dffb640 10 client.15924 handle_command_reply: tid=0 2024-08-31T05:31:26.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.279+0000 7fb042bcc740 1 client.15924 shutdown 2024-08-31T05:31:26.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.279+0000 7fb042bcc740 1 -- 172.21.15.5:0/1271619767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c81b39390 msgr2=0x560c81f0f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:26.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.279+0000 7fb042bcc740 1 --2- 172.21.15.5:0/1271619767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c81b39390 0x560c81f0f190 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x560c81f0d610 tx=0x7fb02402a410 comp rx=0 tx=0).stop 2024-08-31T05:31:26.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.279+0000 7fb042bcc740 1 -- 172.21.15.5:0/1271619767 shutdown_connections 2024-08-31T05:31:26.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.279+0000 7fb042bcc740 1 --2- 172.21.15.5:0/1271619767 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x560c81aedda0 0x560c81f8a300 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.279+0000 7fb042bcc740 1 --2- 172.21.15.5:0/1271619767 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c81b5a070 0x560c81f0f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.279+0000 7fb01dffb640 0 client.15924 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:31:26.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.279+0000 7fb042bcc740 1 --2- 172.21.15.5:0/1271619767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c81b39390 0x560c81f0f190 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.279+0000 7fb042bcc740 1 --2- 172.21.15.5:0/1271619767 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c81b311b0 0x560c81f0ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.279+0000 7fb042bcc740 1 -- 172.21.15.5:0/1271619767 >> 172.21.15.5:0/1271619767 conn(0x560c81b4e460 msgr2=0x560c81efc990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:26.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.279+0000 7fb042bcc740 1 -- 172.21.15.5:0/1271619767 shutdown_connections 2024-08-31T05:31:26.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.279+0000 7fb042bcc740 1 -- 172.21.15.5:0/1271619767 wait complete. 2024-08-31T05:31:26.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.279+0000 7fb042bcc740 20 client.15924 trim_cache size 0 max 16384 2024-08-31T05:31:26.287 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:31:26.287 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "no active scrubs running", 2024-08-31T05:31:26.287 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": {}, 2024-08-31T05:31:26.287 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_stats": { 2024-08-31T05:31:26.287 INFO:teuthology.orchestra.run.smithi005.stdout: "cda92ac0-b35f-47a5-a3a5-471c888462a5": { 2024-08-31T05:31:26.287 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:53.103905+0000", 2024-08-31T05:31:26.288 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:31:26.288 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:31:26.288 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:31:26.288 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:31:26.288 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:31:26.288 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:31:26.288 INFO:teuthology.orchestra.run.smithi005.stdout: "75d84398-5d9c-4872-b879-2fbce045fa71": { 2024-08-31T05:31:26.288 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:06.642335+0000", 2024-08-31T05:31:26.288 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:31:26.288 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:31:26.288 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:31:26.288 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:31:26.288 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:31:26.289 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:31:26.289 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:31:26.289 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:31:26.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.280+0000 7fb03c657640 1 -- 172.21.15.5:0/3752112574 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb0200b4d30 msgr2=0x7fb0200b7240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:26.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.280+0000 7fb03c657640 1 --2- 172.21.15.5:0/3752112574 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb0200b4d30 0x7fb0200b7240 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb02c005fd0 tx=0x7fb02c009600 comp rx=0 tx=0).stop 2024-08-31T05:31:26.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.280+0000 7fb03c657640 1 -- 172.21.15.5:0/3752112574 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb034103910 msgr2=0x7fb0340754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:26.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.280+0000 7fb03c657640 1 --2- 172.21.15.5:0/3752112574 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb034103910 0x7fb0340754b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb03000e9f0 tx=0x7fb03000eeb0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.280+0000 7fb03c657640 1 -- 172.21.15.5:0/3752112574 shutdown_connections 2024-08-31T05:31:26.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.280+0000 7fb03c657640 1 --2- 172.21.15.5:0/3752112574 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb0200b4d30 0x7fb0200b7240 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.280+0000 7fb03c657640 1 --2- 172.21.15.5:0/3752112574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb034109ba0 0x7fb034075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.280+0000 7fb03c657640 1 --2- 172.21.15.5:0/3752112574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb034109250 0x7fb0340759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.280+0000 7fb03c657640 1 --2- 172.21.15.5:0/3752112574 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb034103910 0x7fb0340754b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.280+0000 7fb03c657640 1 -- 172.21.15.5:0/3752112574 >> 172.21.15.5:0/3752112574 conn(0x7fb0340ff380 msgr2=0x7fb0341017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:26.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.280+0000 7fb03c657640 1 -- 172.21.15.5:0/3752112574 shutdown_connections 2024-08-31T05:31:26.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:26.280+0000 7fb03c657640 1 -- 172.21.15.5:0/3752112574 wait complete. 2024-08-31T05:31:26.701 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.699+0000 7ff650562640 1 -- 172.21.15.5:0/2806202132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff64810ac90 msgr2=0x7ff648115d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:26.701 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.699+0000 7ff650562640 1 --2- 172.21.15.5:0/2806202132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff64810ac90 0x7ff648115d70 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7ff638009900 tx=0x7ff63802a3f0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.701 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.699+0000 7ff650562640 1 -- 172.21.15.5:0/2806202132 shutdown_connections 2024-08-31T05:31:26.702 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.699+0000 7ff650562640 1 --2- 172.21.15.5:0/2806202132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff648116340 0x7ff648118820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.702 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.699+0000 7ff650562640 1 --2- 172.21.15.5:0/2806202132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff64810ac90 0x7ff648115d70 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.702 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.699+0000 7ff650562640 1 --2- 172.21.15.5:0/2806202132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff64810a340 0x7ff64810a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.702 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.699+0000 7ff650562640 1 -- 172.21.15.5:0/2806202132 >> 172.21.15.5:0/2806202132 conn(0x7ff648070b30 msgr2=0x7ff648070f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:26.702 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.699+0000 7ff650562640 1 -- 172.21.15.5:0/2806202132 shutdown_connections 2024-08-31T05:31:26.702 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.699+0000 7ff650562640 1 -- 172.21.15.5:0/2806202132 wait complete. 2024-08-31T05:31:26.702 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.700+0000 7ff650562640 1 Processor -- start 2024-08-31T05:31:26.703 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.701+0000 7ff650562640 1 -- start start 2024-08-31T05:31:26.705 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.701+0000 7ff650562640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff64810a340 0x7ff648114510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:26.705 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.701+0000 7ff650562640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff64810ac90 0x7ff648114a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:26.706 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.701+0000 7ff650562640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff648116340 0x7ff6481b4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:26.706 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.701+0000 7ff650562640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff648119e10 con 0x7ff648116340 2024-08-31T05:31:26.706 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.701+0000 7ff650562640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff648119c90 con 0x7ff64810ac90 2024-08-31T05:31:26.706 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.701+0000 7ff650562640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff648119f90 con 0x7ff64810a340 2024-08-31T05:31:26.706 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.701+0000 7ff64dafd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff64810ac90 0x7ff648114a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:26.706 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.701+0000 7ff64e2fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff64810a340 0x7ff648114510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:26.706 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.701+0000 7ff64e2fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff64810a340 0x7ff648114510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:56720/0 (socket says 172.21.15.5:56720) 2024-08-31T05:31:26.706 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.701+0000 7ff64e2fe640 1 -- 172.21.15.5:0/4053327536 learned_addr learned my addr 172.21.15.5:0/4053327536 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:26.706 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.702+0000 7ff64eaff640 1 --2- 172.21.15.5:0/4053327536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff648116340 0x7ff6481b4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:26.707 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.702+0000 7ff64dafd640 1 -- 172.21.15.5:0/4053327536 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff64810a340 msgr2=0x7ff648114510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:26.707 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.702+0000 7ff64dafd640 1 --2- 172.21.15.5:0/4053327536 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff64810a340 0x7ff648114510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.707 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.702+0000 7ff64dafd640 1 -- 172.21.15.5:0/4053327536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff648116340 msgr2=0x7ff6481b4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:26.707 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.702+0000 7ff64dafd640 1 --2- 172.21.15.5:0/4053327536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff648116340 0x7ff6481b4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.707 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.702+0000 7ff64dafd640 1 -- 172.21.15.5:0/4053327536 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6481b51a0 con 0x7ff64810ac90 2024-08-31T05:31:26.707 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.702+0000 7ff64dafd640 1 --2- 172.21.15.5:0/4053327536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff64810ac90 0x7ff648114a50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff638009230 tx=0x7ff638003be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:26.707 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.703+0000 7ff63f7fe640 1 -- 172.21.15.5:0/4053327536 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff63803f070 con 0x7ff64810ac90 2024-08-31T05:31:26.707 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.703+0000 7ff650562640 1 -- 172.21.15.5:0/4053327536 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6481b5370 con 0x7ff64810ac90 2024-08-31T05:31:26.707 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.703+0000 7ff63f7fe640 1 -- 172.21.15.5:0/4053327536 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff638003e10 con 0x7ff64810ac90 2024-08-31T05:31:26.708 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.703+0000 7ff63f7fe640 1 -- 172.21.15.5:0/4053327536 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff638035030 con 0x7ff64810ac90 2024-08-31T05:31:26.708 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.703+0000 7ff650562640 1 -- 172.21.15.5:0/4053327536 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6481b5960 con 0x7ff64810ac90 2024-08-31T05:31:26.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.707+0000 7ff6574cf740 1 Processor -- start 2024-08-31T05:31:26.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.707+0000 7ff6574cf740 1 -- start start 2024-08-31T05:31:26.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.708+0000 7ff6574cf740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558db9af01b0 0x558db9e93ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:26.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.708+0000 7ff6574cf740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558db9ac72f0 0x558db9e94000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:26.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.708+0000 7ff6574cf740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558db9acf4d0 0x558db9e94540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:26.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.708+0000 7ff6574cf740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x558db9e09000 con 0x558db9ac72f0 2024-08-31T05:31:26.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.708+0000 7ff6574cf740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558db9df8590 con 0x558db9af01b0 2024-08-31T05:31:26.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.708+0000 7ff6574cf740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558db9dfc540 con 0x558db9acf4d0 2024-08-31T05:31:26.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.708+0000 7ff64eaff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558db9af01b0 0x558db9e93ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:26.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.709+0000 7ff64eaff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558db9af01b0 0x558db9e93ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:36136/0 (socket says 172.21.15.5:36136) 2024-08-31T05:31:26.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.709+0000 7ff64eaff640 1 -- 172.21.15.5:0/2288242041 learned_addr learned my addr 172.21.15.5:0/2288242041 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:26.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.709+0000 7ff64eaff640 1 -- 172.21.15.5:0/2288242041 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558db9acf4d0 msgr2=0x558db9e94540 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T05:31:26.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.709+0000 7ff64eaff640 1 --2- 172.21.15.5:0/2288242041 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558db9acf4d0 0x558db9e94540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.709+0000 7ff64eaff640 1 -- 172.21.15.5:0/2288242041 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558db9ac72f0 msgr2=0x558db9e94000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:26.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.709+0000 7ff64eaff640 1 --2- 172.21.15.5:0/2288242041 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558db9ac72f0 0x558db9e94000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.709+0000 7ff64eaff640 1 -- 172.21.15.5:0/2288242041 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558db9b5b790 con 0x558db9af01b0 2024-08-31T05:31:26.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.709+0000 7ff63f7fe640 1 -- 172.21.15.5:0/4053327536 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 25) ==== 152758+0+0 (secure 0 0 0) 0x7ff638042070 con 0x7ff64810ac90 2024-08-31T05:31:26.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.710+0000 7ff64eaff640 1 --2- 172.21.15.5:0/2288242041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558db9af01b0 0x558db9e93ac0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff64000a460 tx=0x7ff640009650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a81614e563163472 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:26.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.710+0000 7ff63cbfe640 1 -- 172.21.15.5:0/2288242041 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff640013790 con 0x558db9af01b0 2024-08-31T05:31:26.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.710+0000 7ff63cbfe640 1 -- 172.21.15.5:0/2288242041 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff640019070 con 0x558db9af01b0 2024-08-31T05:31:26.717 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.711+0000 7ff63f7fe640 1 --2- 172.21.15.5:0/4053327536 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff6340b4de0 0x7ff6340b72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:26.717 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.711+0000 7ff63f7fe640 1 -- 172.21.15.5:0/4053327536 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7ff638106150 con 0x7ff64810ac90 2024-08-31T05:31:26.717 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.711+0000 7ff63cbfe640 1 -- 172.21.15.5:0/2288242041 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff640014cc0 con 0x558db9af01b0 2024-08-31T05:31:26.717 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.711+0000 7ff6574cf740 1 -- 172.21.15.5:0/2288242041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558db9af01b0 msgr2=0x558db9e93ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:26.717 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.711+0000 7ff6574cf740 1 --2- 172.21.15.5:0/2288242041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558db9af01b0 0x558db9e93ac0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff64000a460 tx=0x7ff640009650 comp rx=0 tx=0).stop 2024-08-31T05:31:26.717 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.712+0000 7ff64e2fe640 1 --2- 172.21.15.5:0/4053327536 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff6340b4de0 0x7ff6340b72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:26.717 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.712+0000 7ff6574cf740 1 -- 172.21.15.5:0/2288242041 shutdown_connections 2024-08-31T05:31:26.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.712+0000 7ff6574cf740 1 --2- 172.21.15.5:0/2288242041 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558db9acf4d0 0x558db9e94540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.712+0000 7ff6574cf740 1 --2- 172.21.15.5:0/2288242041 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558db9ac72f0 0x558db9e94000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.712+0000 7ff6574cf740 1 --2- 172.21.15.5:0/2288242041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558db9af01b0 0x558db9e93ac0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.712+0000 7ff6574cf740 1 -- 172.21.15.5:0/2288242041 >> 172.21.15.5:0/2288242041 conn(0x558db9ae4300 msgr2=0x558db9e919b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:26.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.712+0000 7ff6574cf740 1 -- 172.21.15.5:0/2288242041 shutdown_connections 2024-08-31T05:31:26.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.713+0000 7ff6574cf740 1 -- 172.21.15.5:0/2288242041 wait complete. 2024-08-31T05:31:26.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.713+0000 7ff64e2fe640 1 --2- 172.21.15.5:0/4053327536 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff6340b4de0 0x7ff6340b72f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x558db9e92740 tx=0x7ff6440046c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:26.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.713+0000 7ff6574cf740 1 -- start start 2024-08-31T05:31:26.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.713+0000 7ff6574cf740 1 Processor -- start 2024-08-31T05:31:26.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.714+0000 7ff6574cf740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558db9ac72f0 0x558db9e9f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:26.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.714+0000 7ff6574cf740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558db9acf4d0 0x558db9e9fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:26.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.714+0000 7ff6574cf740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558db9af01b0 0x558db9eab600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:26.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.714+0000 7ff6574cf740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x558db9d31ab0 con 0x558db9ac72f0 2024-08-31T05:31:26.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.714+0000 7ff6574cf740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558db9d7f680 con 0x558db9af01b0 2024-08-31T05:31:26.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.714+0000 7ff6574cf740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558db9ea2290 con 0x558db9acf4d0 2024-08-31T05:31:26.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.714+0000 7ff6574cf740 10 client.0 _ll_register_callbacks cb 0x558db9b07a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:31:26.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.714+0000 7ff64e2fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558db9ac72f0 0x558db9e9f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:26.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.714+0000 7ff64e2fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558db9ac72f0 0x558db9e9f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53426/0 (socket says 172.21.15.5:53426) 2024-08-31T05:31:26.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.714+0000 7ff64e2fe640 1 -- 172.21.15.5:0/774786715 learned_addr learned my addr 172.21.15.5:0/774786715 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:26.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.714+0000 7ff64eaff640 1 --2- 172.21.15.5:0/774786715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558db9af01b0 0x558db9eab600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:26.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.714+0000 7ff64dafd640 1 --2- 172.21.15.5:0/774786715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558db9acf4d0 0x558db9e9fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:26.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.714+0000 7ff64e2fe640 1 -- 172.21.15.5:0/774786715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558db9acf4d0 msgr2=0x558db9e9fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:26.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.714+0000 7ff64e2fe640 1 --2- 172.21.15.5:0/774786715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558db9acf4d0 0x558db9e9fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.714+0000 7ff64e2fe640 1 -- 172.21.15.5:0/774786715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558db9af01b0 msgr2=0x558db9eab600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:26.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.714+0000 7ff64e2fe640 1 --2- 172.21.15.5:0/774786715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558db9af01b0 0x558db9eab600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.714+0000 7ff64e2fe640 1 -- 172.21.15.5:0/774786715 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558db9bd4620 con 0x558db9ac72f0 2024-08-31T05:31:26.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.715+0000 7ff64e2fe640 1 --2- 172.21.15.5:0/774786715 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558db9ac72f0 0x558db9e9f6e0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7ff64401cb90 tx=0x7ff644005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33e19839701c25a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:26.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.715+0000 7ff631ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:31:26.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.715+0000 7ff631ffb640 1 -- 172.21.15.5:0/774786715 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff644011e60 con 0x558db9ac72f0 2024-08-31T05:31:26.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.715+0000 7ff631ffb640 1 -- 172.21.15.5:0/774786715 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7ff64400fb40 con 0x558db9ac72f0 2024-08-31T05:31:26.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.715+0000 7ff6574cf740 1 -- 172.21.15.5:0/774786715 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff640019070 con 0x558db9ac72f0 2024-08-31T05:31:26.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.716+0000 7ff631ffb640 1 -- 172.21.15.5:0/774786715 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff644030050 con 0x558db9ac72f0 2024-08-31T05:31:26.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.716+0000 7ff6574cf740 10 client.15933 fetch_fsmap learned FSMap version 32 2024-08-31T05:31:26.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.716+0000 7ff6574cf740 1 -- 172.21.15.5:0/774786715 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x558db9eae3e0 con 0x558db9ac72f0 2024-08-31T05:31:26.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.716+0000 7ff631ffb640 1 -- 172.21.15.5:0/774786715 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff640019070 con 0x558db9ac72f0 2024-08-31T05:31:26.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.716+0000 7ff631ffb640 1 -- 172.21.15.5:0/774786715 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7ff64401d410 con 0x558db9ac72f0 2024-08-31T05:31:26.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.716+0000 7ff6574cf740 10 client.15933 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:31:26.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.716+0000 7ff6574cf740 10 client.15933 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:31:26.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.716+0000 7ff6574cf740 20 client.15933 populate_metadata read hostname 'smithi005' 2024-08-31T05:31:26.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.716+0000 7ff6574cf740 1 --2- 172.21.15.5:0/774786715 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x558db9aaed80 0x558db9eb1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:26.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.716+0000 7ff6574cf740 4 client.15933 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:31:26.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.716+0000 7ff6574cf740 1 -- 172.21.15.5:0/774786715 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558db9e0af50 con 0x558db9aaed80 2024-08-31T05:31:26.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.717+0000 7ff64dafd640 1 --2- 172.21.15.5:0/774786715 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x558db9aaed80 0x558db9eb1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:26.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.718+0000 7ff64dafd640 1 --2- 172.21.15.5:0/774786715 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x558db9aaed80 0x558db9eb1bb0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b44153d388f0716 server_cookie=653f53ebac4174ac in_seq=0 out_seq=0 2024-08-31T05:31:26.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.718+0000 7ff631ffb640 10 client.15933 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:31:26.723 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.720+0000 7ff631ffb640 1 -- 172.21.15.5:0/774786715 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558db9e0af50 con 0x558db9aaed80 2024-08-31T05:31:26.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.720+0000 7ff631ffb640 10 client.15933 handle_command_reply: tid=0 2024-08-31T05:31:26.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.720+0000 7ff6574cf740 1 client.15933 shutdown 2024-08-31T05:31:26.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.720+0000 7ff6574cf740 1 -- 172.21.15.5:0/774786715 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558db9ac72f0 msgr2=0x558db9e9f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:26.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.720+0000 7ff6574cf740 1 --2- 172.21.15.5:0/774786715 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558db9ac72f0 0x558db9e9f6e0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7ff64401cb90 tx=0x7ff644005f90 comp rx=0 tx=0).stop 2024-08-31T05:31:26.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.720+0000 7ff6574cf740 1 -- 172.21.15.5:0/774786715 shutdown_connections 2024-08-31T05:31:26.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.720+0000 7ff6574cf740 1 --2- 172.21.15.5:0/774786715 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x558db9aaed80 0x558db9eb1bb0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.720+0000 7ff6574cf740 1 --2- 172.21.15.5:0/774786715 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558db9af01b0 0x558db9eab600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.720+0000 7ff6574cf740 1 --2- 172.21.15.5:0/774786715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558db9acf4d0 0x558db9e9fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.720+0000 7ff6574cf740 1 --2- 172.21.15.5:0/774786715 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558db9ac72f0 0x558db9e9f6e0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.720+0000 7ff6574cf740 1 -- 172.21.15.5:0/774786715 >> 172.21.15.5:0/774786715 conn(0x558db9ae4300 msgr2=0x558db9e94af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:26.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.720+0000 7ff631ffb640 0 client.15933 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:31:26.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.720+0000 7ff6574cf740 1 -- 172.21.15.5:0/774786715 shutdown_connections 2024-08-31T05:31:26.725 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.721+0000 7ff6574cf740 1 -- 172.21.15.5:0/774786715 wait complete. 2024-08-31T05:31:26.725 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.721+0000 7ff6574cf740 20 client.15933 trim_cache size 0 max 16384 2024-08-31T05:31:26.750 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.747+0000 7ff6574cf740 1 Processor -- start 2024-08-31T05:31:26.751 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.747+0000 7ff6574cf740 1 -- start start 2024-08-31T05:31:26.751 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.748+0000 7ff6574cf740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558db9ac72f0 0x558db9e98b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:26.751 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.748+0000 7ff6574cf740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558db9acf4d0 0x558db9e990c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:26.751 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.748+0000 7ff6574cf740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558db9af01b0 0x558db9eb7370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:26.751 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.748+0000 7ff6574cf740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff6481bf9f0 con 0x558db9acf4d0 2024-08-31T05:31:26.751 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.748+0000 7ff6574cf740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff6481c15f0 con 0x558db9af01b0 2024-08-31T05:31:26.751 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.748+0000 7ff6574cf740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff6481c00c0 con 0x558db9ac72f0 2024-08-31T05:31:26.751 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.748+0000 7ff64e2fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558db9ac72f0 0x558db9e98b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:26.751 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.748+0000 7ff64e2fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558db9ac72f0 0x558db9e98b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:56730/0 (socket says 172.21.15.5:56730) 2024-08-31T05:31:26.751 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.748+0000 7ff64e2fe640 1 -- 172.21.15.5:0/4050958294 learned_addr learned my addr 172.21.15.5:0/4050958294 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:26.751 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.748+0000 7ff64dafd640 1 --2- 172.21.15.5:0/4050958294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558db9acf4d0 0x558db9e990c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:26.751 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.748+0000 7ff64eaff640 1 --2- 172.21.15.5:0/4050958294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558db9af01b0 0x558db9eb7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:26.752 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.749+0000 7ff64e2fe640 1 -- 172.21.15.5:0/4050958294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558db9af01b0 msgr2=0x558db9eb7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:26.752 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.749+0000 7ff64e2fe640 1 --2- 172.21.15.5:0/4050958294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558db9af01b0 0x558db9eb7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.752 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.749+0000 7ff64e2fe640 1 -- 172.21.15.5:0/4050958294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558db9acf4d0 msgr2=0x558db9e990c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:26.752 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.749+0000 7ff64e2fe640 1 --2- 172.21.15.5:0/4050958294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558db9acf4d0 0x558db9e990c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.752 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.749+0000 7ff64e2fe640 1 -- 172.21.15.5:0/4050958294 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558db9e8b800 con 0x558db9ac72f0 2024-08-31T05:31:26.752 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.749+0000 7ff64eaff640 1 --2- 172.21.15.5:0/4050958294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558db9af01b0 0x558db9eb7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:31:26.752 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.749+0000 7ff64dafd640 1 --2- 172.21.15.5:0/4050958294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558db9acf4d0 0x558db9e990c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:31:26.753 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.749+0000 7ff64e2fe640 1 --2- 172.21.15.5:0/4050958294 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558db9ac72f0 0x558db9e98b80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff644009de0 tx=0x7ff64401c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a69bdf3bec4cf36f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:26.753 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.750+0000 7ff633fff640 1 -- 172.21.15.5:0/4050958294 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff644011e60 con 0x558db9ac72f0 2024-08-31T05:31:26.753 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.750+0000 7ff633fff640 1 -- 172.21.15.5:0/4050958294 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff64401d4d0 con 0x558db9ac72f0 2024-08-31T05:31:26.753 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.750+0000 7ff633fff640 1 -- 172.21.15.5:0/4050958294 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff64400f790 con 0x558db9ac72f0 2024-08-31T05:31:26.754 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.751+0000 7ff6574cf740 1 -- 172.21.15.5:0/4050958294 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558db9ac72f0 msgr2=0x558db9e98b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:26.754 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.751+0000 7ff6574cf740 1 --2- 172.21.15.5:0/4050958294 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558db9ac72f0 0x558db9e98b80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff644009de0 tx=0x7ff64401c840 comp rx=0 tx=0).stop 2024-08-31T05:31:26.754 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.752+0000 7ff6574cf740 1 -- 172.21.15.5:0/4050958294 shutdown_connections 2024-08-31T05:31:26.754 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.752+0000 7ff6574cf740 1 --2- 172.21.15.5:0/4050958294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558db9af01b0 0x558db9eb7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.754 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.752+0000 7ff6574cf740 1 --2- 172.21.15.5:0/4050958294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558db9acf4d0 0x558db9e990c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.754 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.752+0000 7ff6574cf740 1 --2- 172.21.15.5:0/4050958294 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558db9ac72f0 0x558db9e98b80 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.754 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.752+0000 7ff6574cf740 1 -- 172.21.15.5:0/4050958294 >> 172.21.15.5:0/4050958294 conn(0x558db9ae4300 msgr2=0x558db9e9a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:26.755 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.753+0000 7ff6574cf740 1 -- 172.21.15.5:0/4050958294 shutdown_connections 2024-08-31T05:31:26.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.754+0000 7ff6574cf740 1 -- 172.21.15.5:0/4050958294 wait complete. 2024-08-31T05:31:26.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.754+0000 7ff6574cf740 1 -- start start 2024-08-31T05:31:26.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.754+0000 7ff6574cf740 1 Processor -- start 2024-08-31T05:31:26.757 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.755+0000 7ff6574cf740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558db9acf4d0 0x558db9ea7c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:26.757 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.755+0000 7ff6574cf740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558db9af01b0 0x558db9ea5150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:26.757 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.755+0000 7ff6574cf740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558db9a841c0 0x558db9ea5690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:26.757 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.755+0000 7ff6574cf740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff6481c0e60 con 0x558db9acf4d0 2024-08-31T05:31:26.757 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.755+0000 7ff6574cf740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff6481c0790 con 0x558db9a841c0 2024-08-31T05:31:26.757 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.755+0000 7ff6574cf740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff6481bd9d0 con 0x558db9af01b0 2024-08-31T05:31:26.758 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.755+0000 7ff64e2fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558db9acf4d0 0x558db9ea7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:26.758 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.755+0000 7ff64e2fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558db9acf4d0 0x558db9ea7c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53448/0 (socket says 172.21.15.5:53448) 2024-08-31T05:31:26.758 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.755+0000 7ff6574cf740 10 client.0 _ll_register_callbacks cb 0x7ff644009a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:31:26.758 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.755+0000 7ff64e2fe640 1 -- 172.21.15.5:0/817029301 learned_addr learned my addr 172.21.15.5:0/817029301 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:26.758 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.755+0000 7ff64eaff640 1 --2- 172.21.15.5:0/817029301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558db9a841c0 0x558db9ea5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:26.759 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.756+0000 7ff64e2fe640 1 -- 172.21.15.5:0/817029301 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558db9af01b0 msgr2=0x558db9ea5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:26.759 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.756+0000 7ff64e2fe640 1 --2- 172.21.15.5:0/817029301 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558db9af01b0 0x558db9ea5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.759 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.756+0000 7ff64e2fe640 1 -- 172.21.15.5:0/817029301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558db9a841c0 msgr2=0x558db9ea5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:26.759 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.756+0000 7ff64e2fe640 1 --2- 172.21.15.5:0/817029301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558db9a841c0 0x558db9ea5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.759 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.756+0000 7ff64e2fe640 1 -- 172.21.15.5:0/817029301 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558db9ea1c10 con 0x558db9acf4d0 2024-08-31T05:31:26.759 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.756+0000 7ff64e2fe640 1 --2- 172.21.15.5:0/817029301 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558db9acf4d0 0x558db9ea7c90 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7ff64401d7e0 tx=0x7ff64401dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85ddeee643691557 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:26.759 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.756+0000 7ff631ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:31:26.759 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.756+0000 7ff631ffb640 1 -- 172.21.15.5:0/817029301 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff644043060 con 0x558db9acf4d0 2024-08-31T05:31:26.759 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.757+0000 7ff631ffb640 1 -- 172.21.15.5:0/817029301 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7ff644009040 con 0x558db9acf4d0 2024-08-31T05:31:26.759 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.757+0000 7ff6574cf740 1 -- 172.21.15.5:0/817029301 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff64401d4d0 con 0x558db9acf4d0 2024-08-31T05:31:26.759 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.757+0000 7ff631ffb640 1 -- 172.21.15.5:0/817029301 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff644011e60 con 0x558db9acf4d0 2024-08-31T05:31:26.760 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.757+0000 7ff6574cf740 10 client.15939 fetch_fsmap learned FSMap version 32 2024-08-31T05:31:26.760 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.757+0000 7ff6574cf740 1 -- 172.21.15.5:0/817029301 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x558db9f1c240 con 0x558db9acf4d0 2024-08-31T05:31:26.760 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.758+0000 7ff631ffb640 1 -- 172.21.15.5:0/817029301 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff64401d4d0 con 0x558db9acf4d0 2024-08-31T05:31:26.760 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.758+0000 7ff631ffb640 1 -- 172.21.15.5:0/817029301 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7ff64400fc60 con 0x558db9acf4d0 2024-08-31T05:31:26.761 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.758+0000 7ff6574cf740 10 client.15939 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:31:26.761 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.758+0000 7ff6574cf740 10 client.15939 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:31:26.761 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.758+0000 7ff6574cf740 20 client.15939 populate_metadata read hostname 'smithi005' 2024-08-31T05:31:26.761 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.758+0000 7ff6574cf740 1 --2- 172.21.15.5:0/817029301 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x558db9f1ca00 0x558db9f1ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:26.761 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.758+0000 7ff6574cf740 4 client.15939 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:31:26.761 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.758+0000 7ff6574cf740 1 -- 172.21.15.5:0/817029301 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558db9e069f0 con 0x558db9f1ca00 2024-08-31T05:31:26.761 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.759+0000 7ff64dafd640 1 --2- 172.21.15.5:0/817029301 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x558db9f1ca00 0x558db9f1ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:26.762 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.760+0000 7ff631ffb640 10 client.15939 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:31:26.762 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.760+0000 7ff64dafd640 1 --2- 172.21.15.5:0/817029301 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x558db9f1ca00 0x558db9f1ee20 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4cf29fbe6612f90 server_cookie=2da6b8d702c82546 in_seq=0 out_seq=0 2024-08-31T05:31:26.844 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.842+0000 7ff631ffb640 1 -- 172.21.15.5:0/817029301 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558db9e069f0 con 0x558db9f1ca00 2024-08-31T05:31:26.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.842+0000 7ff631ffb640 10 client.15939 handle_command_reply: tid=0 2024-08-31T05:31:26.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.842+0000 7ff6574cf740 1 client.15939 shutdown 2024-08-31T05:31:26.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.842+0000 7ff6574cf740 1 -- 172.21.15.5:0/817029301 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558db9acf4d0 msgr2=0x558db9ea7c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:26.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.842+0000 7ff6574cf740 1 --2- 172.21.15.5:0/817029301 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558db9acf4d0 0x558db9ea7c90 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7ff64401d7e0 tx=0x7ff64401dbe0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.842+0000 7ff6574cf740 1 -- 172.21.15.5:0/817029301 shutdown_connections 2024-08-31T05:31:26.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.842+0000 7ff6574cf740 1 --2- 172.21.15.5:0/817029301 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x558db9f1ca00 0x558db9f1ee20 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.842+0000 7ff6574cf740 1 --2- 172.21.15.5:0/817029301 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558db9a841c0 0x558db9ea5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.842+0000 7ff6574cf740 1 --2- 172.21.15.5:0/817029301 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558db9af01b0 0x558db9ea5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.842+0000 7ff631ffb640 0 client.15939 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:31:26.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.842+0000 7ff6574cf740 1 --2- 172.21.15.5:0/817029301 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558db9acf4d0 0x558db9ea7c90 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.842+0000 7ff6574cf740 1 -- 172.21.15.5:0/817029301 >> 172.21.15.5:0/817029301 conn(0x558db9ae4300 msgr2=0x558db9e9a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:26.846 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.842+0000 7ff6574cf740 1 -- 172.21.15.5:0/817029301 shutdown_connections 2024-08-31T05:31:26.846 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.842+0000 7ff6574cf740 1 -- 172.21.15.5:0/817029301 wait complete. 2024-08-31T05:31:26.846 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.842+0000 7ff6574cf740 20 client.15939 trim_cache size 0 max 16384 2024-08-31T05:31:26.846 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:31:26.846 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:31:26.846 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:31:26.846 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:31:26.847 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.843+0000 7ff650562640 1 -- 172.21.15.5:0/4053327536 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff6340b4de0 msgr2=0x7ff6340b72f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:26.847 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.843+0000 7ff650562640 1 --2- 172.21.15.5:0/4053327536 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff6340b4de0 0x7ff6340b72f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x558db9e92740 tx=0x7ff6440046c0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.847 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.843+0000 7ff650562640 1 -- 172.21.15.5:0/4053327536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff64810ac90 msgr2=0x7ff648114a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:26.847 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.843+0000 7ff650562640 1 --2- 172.21.15.5:0/4053327536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff64810ac90 0x7ff648114a50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff638009230 tx=0x7ff638003be0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.847 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.843+0000 7ff650562640 1 -- 172.21.15.5:0/4053327536 shutdown_connections 2024-08-31T05:31:26.847 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.843+0000 7ff650562640 1 --2- 172.21.15.5:0/4053327536 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff6340b4de0 0x7ff6340b72f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.847 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.843+0000 7ff650562640 1 --2- 172.21.15.5:0/4053327536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff648116340 0x7ff6481b4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.848 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.843+0000 7ff650562640 1 --2- 172.21.15.5:0/4053327536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff64810ac90 0x7ff648114a50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.848 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.843+0000 7ff650562640 1 --2- 172.21.15.5:0/4053327536 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff64810a340 0x7ff648114510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:26.848 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.843+0000 7ff650562640 1 -- 172.21.15.5:0/4053327536 >> 172.21.15.5:0/4053327536 conn(0x7ff648070b30 msgr2=0x7ff64811c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:26.848 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.843+0000 7ff650562640 1 -- 172.21.15.5:0/4053327536 shutdown_connections 2024-08-31T05:31:26.848 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:26.843+0000 7ff650562640 1 -- 172.21.15.5:0/4053327536 wait complete. 2024-08-31T05:31:26.908 INFO:tasks.workunit.client.0.smithi005.stdout: 1 39494 16.52 MB/sec warmup 14 sec latency 34.562 ms 2024-08-31T05:31:27.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:31:27 smithi005 ceph-mon[18602]: pgmap v389: 129 pgs: 129 active+clean; 16 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 789 KiB/s rd, 1.5 MiB/s wr, 221 op/s 2024-08-31T05:31:27.304 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T05:31:27.305 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T05:31:27.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:31:27 smithi050 ceph-mon[22146]: pgmap v389: 129 pgs: 129 active+clean; 16 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 789 KiB/s rd, 1.5 MiB/s wr, 221 op/s 2024-08-31T05:31:27.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:31:27 smithi070 ceph-mon[22316]: pgmap v389: 129 pgs: 129 active+clean; 16 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 789 KiB/s rd, 1.5 MiB/s wr, 221 op/s 2024-08-31T05:31:27.622 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:31:27.907 INFO:tasks.workunit.client.0.smithi005.stdout: 1 42745 16.61 MB/sec warmup 15 sec latency 12.711 ms 2024-08-31T05:31:28.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.122+0000 7f936c68f640 1 -- 172.21.15.5:0/3671590140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9364102800 msgr2=0x7f9364102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:28.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.122+0000 7f936c68f640 1 --2- 172.21.15.5:0/3671590140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9364102800 0x7f9364102c10 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f9360009900 tx=0x7f936002a410 comp rx=0 tx=0).stop 2024-08-31T05:31:28.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.122+0000 7f936c68f640 1 -- 172.21.15.5:0/3671590140 shutdown_connections 2024-08-31T05:31:28.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.122+0000 7f936c68f640 1 --2- 172.21.15.5:0/3671590140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9364108a90 0x7f936410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:28.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.122+0000 7f936c68f640 1 --2- 172.21.15.5:0/3671590140 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9364108140 0x7f9364108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:28.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.122+0000 7f936c68f640 1 --2- 172.21.15.5:0/3671590140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9364102800 0x7f9364102c10 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:28.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.122+0000 7f936c68f640 1 -- 172.21.15.5:0/3671590140 >> 172.21.15.5:0/3671590140 conn(0x7f93640794d0 msgr2=0x7f93640798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:28.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.122+0000 7f936c68f640 1 -- 172.21.15.5:0/3671590140 shutdown_connections 2024-08-31T05:31:28.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.122+0000 7f936c68f640 1 -- 172.21.15.5:0/3671590140 wait complete. 2024-08-31T05:31:28.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.123+0000 7f936c68f640 1 Processor -- start 2024-08-31T05:31:28.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.123+0000 7f936c68f640 1 -- start start 2024-08-31T05:31:28.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.123+0000 7f936c68f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9364102800 0x7f936419a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:28.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.123+0000 7f936c68f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9364108140 0x7f936419a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:28.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.123+0000 7f936c68f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9364108a90 0x7f936419fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:28.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.123+0000 7f936c68f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f93641126f0 con 0x7f9364102800 2024-08-31T05:31:28.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.123+0000 7f936c68f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9364112570 con 0x7f9364108a90 2024-08-31T05:31:28.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.123+0000 7f936c68f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9364112870 con 0x7f9364108140 2024-08-31T05:31:28.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.123+0000 7f936a42b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9364102800 0x7f936419a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:28.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.123+0000 7f936a42b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9364102800 0x7f936419a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53478/0 (socket says 172.21.15.5:53478) 2024-08-31T05:31:28.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.123+0000 7f936a42b640 1 -- 172.21.15.5:0/1461117525 learned_addr learned my addr 172.21.15.5:0/1461117525 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:28.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.123+0000 7f9369c2a640 1 --2- 172.21.15.5:0/1461117525 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9364108140 0x7f936419a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:28.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.123+0000 7f936ac2c640 1 --2- 172.21.15.5:0/1461117525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9364108a90 0x7f936419fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:28.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.124+0000 7f936a42b640 1 -- 172.21.15.5:0/1461117525 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9364108140 msgr2=0x7f936419a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:28.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.124+0000 7f936a42b640 1 --2- 172.21.15.5:0/1461117525 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9364108140 0x7f936419a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:28.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.124+0000 7f936a42b640 1 -- 172.21.15.5:0/1461117525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9364108a90 msgr2=0x7f936419fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:28.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.124+0000 7f936a42b640 1 --2- 172.21.15.5:0/1461117525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9364108a90 0x7f936419fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:28.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.124+0000 7f936a42b640 1 -- 172.21.15.5:0/1461117525 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93641a01e0 con 0x7f9364102800 2024-08-31T05:31:28.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.124+0000 7f9369c2a640 1 --2- 172.21.15.5:0/1461117525 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9364108140 0x7f936419a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:31:28.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.124+0000 7f936a42b640 1 --2- 172.21.15.5:0/1461117525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9364102800 0x7f936419a270 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f9360005940 tx=0x7f93600040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:28.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.124+0000 7f935b7fe640 1 -- 172.21.15.5:0/1461117525 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f936003f030 con 0x7f9364102800 2024-08-31T05:31:28.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.124+0000 7f936c68f640 1 -- 172.21.15.5:0/1461117525 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93641a0470 con 0x7f9364102800 2024-08-31T05:31:28.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.124+0000 7f935b7fe640 1 -- 172.21.15.5:0/1461117525 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93600044c0 con 0x7f9364102800 2024-08-31T05:31:28.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.124+0000 7f935b7fe640 1 -- 172.21.15.5:0/1461117525 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9360035070 con 0x7f9364102800 2024-08-31T05:31:28.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.124+0000 7f936c68f640 1 -- 172.21.15.5:0/1461117525 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93641a6c30 con 0x7f9364102800 2024-08-31T05:31:28.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.125+0000 7f936c68f640 1 -- 172.21.15.5:0/1461117525 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9364102c10 con 0x7f9364102800 2024-08-31T05:31:28.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.127+0000 7f935b7fe640 1 -- 172.21.15.5:0/1461117525 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 25) ==== 152758+0+0 (secure 0 0 0) 0x7f9360042030 con 0x7f9364102800 2024-08-31T05:31:28.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.127+0000 7f935b7fe640 1 --2- 172.21.15.5:0/1461117525 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f93500b4d30 0x7f93500b7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:28.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.127+0000 7f9369c2a640 1 --2- 172.21.15.5:0/1461117525 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f93500b4d30 0x7f93500b7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:28.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.128+0000 7f935b7fe640 1 -- 172.21.15.5:0/1461117525 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f9360105fa0 con 0x7f9364102800 2024-08-31T05:31:28.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.128+0000 7f9369c2a640 1 --2- 172.21.15.5:0/1461117525 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f93500b4d30 0x7f93500b7240 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9364100c10 tx=0x7f9354005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:28.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.131+0000 7f935b7fe640 1 -- 172.21.15.5:0/1461117525 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f93600cc250 con 0x7f9364102800 2024-08-31T05:31:28.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.373+0000 7f936c68f640 1 -- 172.21.15.5:0/1461117525 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f936419b3a0 con 0x7f9364102800 2024-08-31T05:31:28.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.374+0000 7f935b7fe640 1 -- 172.21.15.5:0/1461117525 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11948 (secure 0 0 0) 0x7f93600d0a10 con 0x7f9364102800 2024-08-31T05:31:28.376 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:31:28.376 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":32,"btime":"2024-08-31T05:31:23:083919+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14739,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2024812199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2024812199},{"type":"v1","addr":"172.21.15.5:6835","nonce":2024812199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3629023702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3629023702},{"type":"v1","addr":"172.21.15.5:6837","nonce":3629023702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T05:27:31.929153+0000","modified":"2024-08-31T05:31:22.377433+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24652,"mds_1":24638,"mds_2":24631,"mds_3":24625,"mds_4":24602},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6839/2412701258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":2412701258},{"type":"v1","addr":"172.21.15.5:6839","nonce":2412701258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14820":{"gid":14820,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6841/747057838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":747057838},{"type":"v1","addr":"172.21.15.5:6841","nonce":747057838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6833/1153378982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1153378982},{"type":"v1","addr":"172.21.15.50:6833","nonce":1153378982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6833/364083443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":364083443},{"type":"v1","addr":"172.21.15.70:6833","nonce":364083443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24587":{"gid":24587,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/2346896794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2346896794},{"type":"v1","addr":"172.21.15.50:6835","nonce":2346896794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24602":{"gid":24602,"name":"h","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.50:6837/428759669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":428759669},{"type":"v1","addr":"172.21.15.50:6837","nonce":428759669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.70:6835/2061504114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2061504114},{"type":"v1","addr":"172.21.15.70:6835","nonce":2061504114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.70:6837/2780036414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2780036414},{"type":"v1","addr":"172.21.15.70:6837","nonce":2780036414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.50:6839/98200944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":98200944},{"type":"v1","addr":"172.21.15.50:6839","nonce":98200944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24652":{"gid":24652,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.70:6839/2756569250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":2756569250},{"type":"v1","addr":"172.21.15.70:6839","nonce":2756569250}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24652,"qdb_cluster":[24652,24631,24638,24625,24602]},"id":1}]} 2024-08-31T05:31:28.377 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 32 2024-08-31T05:31:28.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.376+0000 7f936c68f640 1 -- 172.21.15.5:0/1461117525 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f93500b4d30 msgr2=0x7f93500b7240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:28.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.376+0000 7f936c68f640 1 --2- 172.21.15.5:0/1461117525 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f93500b4d30 0x7f93500b7240 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9364100c10 tx=0x7f9354005f90 comp rx=0 tx=0).stop 2024-08-31T05:31:28.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.376+0000 7f936c68f640 1 -- 172.21.15.5:0/1461117525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9364102800 msgr2=0x7f936419a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:28.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.376+0000 7f936c68f640 1 --2- 172.21.15.5:0/1461117525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9364102800 0x7f936419a270 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f9360005940 tx=0x7f93600040c0 comp rx=0 tx=0).stop 2024-08-31T05:31:28.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.376+0000 7f936c68f640 1 -- 172.21.15.5:0/1461117525 shutdown_connections 2024-08-31T05:31:28.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.376+0000 7f936c68f640 1 --2- 172.21.15.5:0/1461117525 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f93500b4d30 0x7f93500b7240 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:28.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.376+0000 7f936c68f640 1 --2- 172.21.15.5:0/1461117525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9364108a90 0x7f936419fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:28.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.376+0000 7f936c68f640 1 --2- 172.21.15.5:0/1461117525 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9364108140 0x7f936419a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:28.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.376+0000 7f936c68f640 1 --2- 172.21.15.5:0/1461117525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9364102800 0x7f936419a270 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:28.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.376+0000 7f936c68f640 1 -- 172.21.15.5:0/1461117525 >> 172.21.15.5:0/1461117525 conn(0x7f93640794d0 msgr2=0x7f93641017b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:28.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.377+0000 7f936c68f640 1 -- 172.21.15.5:0/1461117525 shutdown_connections 2024-08-31T05:31:28.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:28.377+0000 7f936c68f640 1 -- 172.21.15.5:0/1461117525 wait complete. 2024-08-31T05:31:28.908 INFO:tasks.workunit.client.0.smithi005.stdout: 1 45529 16.44 MB/sec warmup 16 sec latency 12.233 ms 2024-08-31T05:31:29.073 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-31T05:31:29.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:31:29 smithi005 ceph-mon[18602]: pgmap v390: 129 pgs: 129 active+clean; 17 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 789 KiB/s rd, 1.5 MiB/s wr, 203 op/s 2024-08-31T05:31:29.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:31:29 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/1461117525' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:31:29.332 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:31:29.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:31:29 smithi050 ceph-mon[22146]: pgmap v390: 129 pgs: 129 active+clean; 17 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 789 KiB/s rd, 1.5 MiB/s wr, 203 op/s 2024-08-31T05:31:29.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:31:29 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/1461117525' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:31:29.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:31:29 smithi070 ceph-mon[22316]: pgmap v390: 129 pgs: 129 active+clean; 17 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 789 KiB/s rd, 1.5 MiB/s wr, 203 op/s 2024-08-31T05:31:29.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:31:29 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/1461117525' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:31:29.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.849+0000 7f846ffff640 1 -- 172.21.15.5:0/3048341572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f847010d9c0 msgr2=0x7f847010feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:29.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.849+0000 7f846ffff640 1 --2- 172.21.15.5:0/3048341572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f847010d9c0 0x7f847010feb0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f8468009ca0 tx=0x7f846802a8c0 comp rx=0 tx=0).stop 2024-08-31T05:31:29.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.849+0000 7f846ffff640 1 -- 172.21.15.5:0/3048341572 shutdown_connections 2024-08-31T05:31:29.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.849+0000 7f846ffff640 1 --2- 172.21.15.5:0/3048341572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f847010d9c0 0x7f847010feb0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:29.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.849+0000 7f846ffff640 1 --2- 172.21.15.5:0/3048341572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8470104eb0 0x7f847010d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:29.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.849+0000 7f846ffff640 1 --2- 172.21.15.5:0/3048341572 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8470104560 0x7f8470104970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:29.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.849+0000 7f846ffff640 1 -- 172.21.15.5:0/3048341572 >> 172.21.15.5:0/3048341572 conn(0x7f84700fe060 msgr2=0x7f84701004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:29.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.849+0000 7f846ffff640 1 -- 172.21.15.5:0/3048341572 shutdown_connections 2024-08-31T05:31:29.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.849+0000 7f846ffff640 1 -- 172.21.15.5:0/3048341572 wait complete. 2024-08-31T05:31:29.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.849+0000 7f846ffff640 1 Processor -- start 2024-08-31T05:31:29.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.849+0000 7f846ffff640 1 -- start start 2024-08-31T05:31:29.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.850+0000 7f846ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8470104560 0x7f847019a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:29.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.850+0000 7f846ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8470104eb0 0x7f847019a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:29.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.850+0000 7f846ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f847010d9c0 0x7f847019f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:29.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.850+0000 7f846ffff640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8470113640 con 0x7f8470104eb0 2024-08-31T05:31:29.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.850+0000 7f846ffff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f84701134c0 con 0x7f847010d9c0 2024-08-31T05:31:29.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.850+0000 7f846ffff640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f84701137c0 con 0x7f8470104560 2024-08-31T05:31:29.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.850+0000 7f8467fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8470104eb0 0x7f847019a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:29.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.850+0000 7f8467fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8470104eb0 0x7f847019a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53502/0 (socket says 172.21.15.5:53502) 2024-08-31T05:31:29.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.850+0000 7f8467fff640 1 -- 172.21.15.5:0/1249596953 learned_addr learned my addr 172.21.15.5:0/1249596953 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:29.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.850+0000 7f846effd640 1 --2- 172.21.15.5:0/1249596953 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8470104560 0x7f847019a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:29.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.850+0000 7f846f7fe640 1 --2- 172.21.15.5:0/1249596953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f847010d9c0 0x7f847019f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:29.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.850+0000 7f8467fff640 1 -- 172.21.15.5:0/1249596953 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8470104560 msgr2=0x7f847019a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:29.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.850+0000 7f8467fff640 1 --2- 172.21.15.5:0/1249596953 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8470104560 0x7f847019a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:29.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.850+0000 7f8467fff640 1 -- 172.21.15.5:0/1249596953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f847010d9c0 msgr2=0x7f847019f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:29.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.850+0000 7f8467fff640 1 --2- 172.21.15.5:0/1249596953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f847010d9c0 0x7f847019f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:29.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.850+0000 7f8467fff640 1 -- 172.21.15.5:0/1249596953 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f847019ffe0 con 0x7f8470104eb0 2024-08-31T05:31:29.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.850+0000 7f846f7fe640 1 --2- 172.21.15.5:0/1249596953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f847010d9c0 0x7f847019f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:31:29.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.850+0000 7f8467fff640 1 --2- 172.21.15.5:0/1249596953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8470104eb0 0x7f847019a610 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f845800e9f0 tx=0x7f845800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:29.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.851+0000 7f8474801640 1 -- 172.21.15.5:0/1249596953 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f845800ccc0 con 0x7f8470104eb0 2024-08-31T05:31:29.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.851+0000 7f8474801640 1 -- 172.21.15.5:0/1249596953 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84580108e0 con 0x7f8470104eb0 2024-08-31T05:31:29.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.851+0000 7f846ffff640 1 -- 172.21.15.5:0/1249596953 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84701a02d0 con 0x7f8470104eb0 2024-08-31T05:31:29.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.851+0000 7f8474801640 1 -- 172.21.15.5:0/1249596953 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8458018860 con 0x7f8470104eb0 2024-08-31T05:31:29.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.851+0000 7f846ffff640 1 -- 172.21.15.5:0/1249596953 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84701a6a30 con 0x7f8470104eb0 2024-08-31T05:31:29.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.853+0000 7f8474801640 1 -- 172.21.15.5:0/1249596953 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 25) ==== 152758+0+0 (secure 0 0 0) 0x7f8458010430 con 0x7f8470104eb0 2024-08-31T05:31:29.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.854+0000 7f847bd78740 1 Processor -- start 2024-08-31T05:31:29.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.854+0000 7f847bd78740 1 -- start start 2024-08-31T05:31:29.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.854+0000 7f847bd78740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594848f3070 0x559484c984f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:29.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.854+0000 7f847bd78740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5594848ca1b0 0x559484c98a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:29.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.855+0000 7f847bd78740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594848d2390 0x559484c98f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:29.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.855+0000 7f847bd78740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x559484c0f680 con 0x5594848f3070 2024-08-31T05:31:29.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.855+0000 7f847bd78740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559484bfec10 con 0x5594848ca1b0 2024-08-31T05:31:29.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.855+0000 7f847bd78740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559484c02bc0 con 0x5594848d2390 2024-08-31T05:31:29.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.855+0000 7f846f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594848f3070 0x559484c984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:29.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.855+0000 7f846f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594848f3070 0x559484c984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53516/0 (socket says 172.21.15.5:53516) 2024-08-31T05:31:29.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.855+0000 7f846f7fe640 1 -- 172.21.15.5:0/622285135 learned_addr learned my addr 172.21.15.5:0/622285135 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:29.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.855+0000 7f846effd640 1 --2- 172.21.15.5:0/622285135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5594848ca1b0 0x559484c98a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:29.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.855+0000 7f8467fff640 1 --2- 172.21.15.5:0/622285135 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594848d2390 0x559484c98f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:29.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.855+0000 7f8474801640 1 --2- 172.21.15.5:0/1249596953 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f845c0b91c0 0x7f845c0bb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:29.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.855+0000 7f846f7fe640 1 -- 172.21.15.5:0/622285135 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594848d2390 msgr2=0x559484c98f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:29.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.855+0000 7f846f7fe640 1 --2- 172.21.15.5:0/622285135 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594848d2390 0x559484c98f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:29.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.855+0000 7f846f7fe640 1 -- 172.21.15.5:0/622285135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5594848ca1b0 msgr2=0x559484c98a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:29.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.855+0000 7f846f7fe640 1 --2- 172.21.15.5:0/622285135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5594848ca1b0 0x559484c98a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:29.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.855+0000 7f846f7fe640 1 -- 172.21.15.5:0/622285135 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55948495e650 con 0x5594848f3070 2024-08-31T05:31:29.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.855+0000 7f8474801640 1 -- 172.21.15.5:0/1249596953 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f84580e5d10 con 0x7f8470104eb0 2024-08-31T05:31:29.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.855+0000 7f846f7fe640 1 --2- 172.21.15.5:0/622285135 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594848f3070 0x559484c984f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f8468006010 tx=0x7f8468009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d59fce0806a311ed server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:29.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.855+0000 7f846f7fe640 1 --2- 172.21.15.5:0/1249596953 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f845c0b91c0 0x7f845c0bb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:29.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.856+0000 7f8465ffb640 1 -- 172.21.15.5:0/622285135 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8468049040 con 0x5594848f3070 2024-08-31T05:31:29.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.856+0000 7f8465ffb640 1 -- 172.21.15.5:0/622285135 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8468036070 con 0x5594848f3070 2024-08-31T05:31:29.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.856+0000 7f8465ffb640 1 -- 172.21.15.5:0/622285135 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84680042e0 con 0x5594848f3070 2024-08-31T05:31:29.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.857+0000 7f847bd78740 1 -- 172.21.15.5:0/622285135 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594848f3070 msgr2=0x559484c984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:29.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.857+0000 7f847bd78740 1 --2- 172.21.15.5:0/622285135 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594848f3070 0x559484c984f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f8468006010 tx=0x7f8468009800 comp rx=0 tx=0).stop 2024-08-31T05:31:29.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.857+0000 7f846f7fe640 1 --2- 172.21.15.5:0/1249596953 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f845c0b91c0 0x7f845c0bb6d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8468003fd0 tx=0x7f84680045e0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:29.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.857+0000 7f847bd78740 1 -- 172.21.15.5:0/622285135 shutdown_connections 2024-08-31T05:31:29.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.857+0000 7f847bd78740 1 --2- 172.21.15.5:0/622285135 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594848d2390 0x559484c98f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:29.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.857+0000 7f847bd78740 1 --2- 172.21.15.5:0/622285135 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5594848ca1b0 0x559484c98a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:29.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.857+0000 7f847bd78740 1 --2- 172.21.15.5:0/622285135 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594848f3070 0x559484c984f0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:29.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.857+0000 7f847bd78740 1 -- 172.21.15.5:0/622285135 >> 172.21.15.5:0/622285135 conn(0x5594848e7460 msgr2=0x559484c963e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:29.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.857+0000 7f847bd78740 1 -- 172.21.15.5:0/622285135 shutdown_connections 2024-08-31T05:31:29.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.857+0000 7f847bd78740 1 -- 172.21.15.5:0/622285135 wait complete. 2024-08-31T05:31:29.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.857+0000 7f847bd78740 1 -- start start 2024-08-31T05:31:29.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.857+0000 7f847bd78740 1 Processor -- start 2024-08-31T05:31:29.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.858+0000 7f847bd78740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594848ca1b0 0x559484ca3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:29.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.858+0000 7f847bd78740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594848d2390 0x559484ca4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:29.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.858+0000 7f847bd78740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5594848f3070 0x559484caffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:29.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.858+0000 7f847bd78740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x559484a61700 con 0x5594848ca1b0 2024-08-31T05:31:29.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.858+0000 7f847bd78740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559484b85750 con 0x5594848f3070 2024-08-31T05:31:29.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.858+0000 7f847bd78740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559484ca6c70 con 0x5594848d2390 2024-08-31T05:31:29.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.858+0000 7f847bd78740 10 client.0 _ll_register_callbacks cb 0x559484bb4e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:31:29.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.858+0000 7f846effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594848ca1b0 0x559484ca3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:29.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.858+0000 7f8467fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594848d2390 0x559484ca4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:29.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.858+0000 7f846effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594848ca1b0 0x559484ca3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53528/0 (socket says 172.21.15.5:53528) 2024-08-31T05:31:29.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.858+0000 7f846effd640 1 -- 172.21.15.5:0/3044367537 learned_addr learned my addr 172.21.15.5:0/3044367537 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:29.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.858+0000 7f846f7fe640 1 --2- 172.21.15.5:0/3044367537 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5594848f3070 0x559484caffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:29.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.858+0000 7f846effd640 1 -- 172.21.15.5:0/3044367537 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594848d2390 msgr2=0x559484ca4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:29.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.858+0000 7f846effd640 1 --2- 172.21.15.5:0/3044367537 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594848d2390 0x559484ca4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:29.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.858+0000 7f846effd640 1 -- 172.21.15.5:0/3044367537 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5594848f3070 msgr2=0x559484caffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:29.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.858+0000 7f846effd640 1 --2- 172.21.15.5:0/3044367537 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5594848f3070 0x559484caffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:29.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.858+0000 7f846effd640 1 -- 172.21.15.5:0/3044367537 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559484bbe900 con 0x5594848ca1b0 2024-08-31T05:31:29.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.858+0000 7f8467fff640 1 --2- 172.21.15.5:0/3044367537 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594848d2390 0x559484ca4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:31:29.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.858+0000 7f846f7fe640 1 --2- 172.21.15.5:0/3044367537 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5594848f3070 0x559484caffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:31:29.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.859+0000 7f846effd640 1 --2- 172.21.15.5:0/3044367537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594848ca1b0 0x559484ca3bc0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f8460012740 tx=0x7f8460012c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f49b9b8955961f4a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:29.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.859+0000 7f844effd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:31:29.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.859+0000 7f844effd640 1 -- 172.21.15.5:0/3044367537 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f846000f920 con 0x5594848ca1b0 2024-08-31T05:31:29.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.859+0000 7f844effd640 1 -- 172.21.15.5:0/3044367537 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f846000fac0 con 0x5594848ca1b0 2024-08-31T05:31:29.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.859+0000 7f847bd78740 1 -- 172.21.15.5:0/3044367537 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8468036070 con 0x5594848ca1b0 2024-08-31T05:31:29.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.859+0000 7f844effd640 1 -- 172.21.15.5:0/3044367537 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f846000fd00 con 0x5594848ca1b0 2024-08-31T05:31:29.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.859+0000 7f847bd78740 10 client.15957 fetch_fsmap learned FSMap version 32 2024-08-31T05:31:29.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.859+0000 7f847bd78740 1 -- 172.21.15.5:0/3044367537 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x559484cb2a20 con 0x5594848ca1b0 2024-08-31T05:31:29.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.859+0000 7f844effd640 1 -- 172.21.15.5:0/3044367537 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8468036070 con 0x5594848ca1b0 2024-08-31T05:31:29.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.859+0000 7f844effd640 1 -- 172.21.15.5:0/3044367537 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f846001c420 con 0x5594848ca1b0 2024-08-31T05:31:29.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.859+0000 7f847bd78740 10 client.15957 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:31:29.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.859+0000 7f847bd78740 10 client.15957 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-31T05:31:29.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.859+0000 7f847bd78740 20 client.15957 populate_metadata read hostname 'smithi005' 2024-08-31T05:31:29.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.860+0000 7f847bd78740 1 --2- 172.21.15.5:0/3044367537 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x5594848b19f0 0x559484cb5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:29.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.860+0000 7f847bd78740 4 client.15957 mds_command: new command op to 24602 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:31:29.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.860+0000 7f847bd78740 1 -- 172.21.15.5:0/3044367537 --> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559484c115d0 con 0x5594848b19f0 2024-08-31T05:31:29.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.860+0000 7f8467fff640 1 --2- 172.21.15.5:0/3044367537 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x5594848b19f0 0x559484cb5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:29.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.860+0000 7f8467fff640 1 --2- 172.21.15.5:0/3044367537 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x5594848b19f0 0x559484cb5fd0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=85dbf5cd405f491b server_cookie=ebef5bd8af341a3a in_seq=0 out_seq=0 2024-08-31T05:31:29.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.860+0000 7f844effd640 10 client.15957 ms_handle_connect on v2:172.21.15.50:6836/428759669 2024-08-31T05:31:29.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.861+0000 7f844effd640 1 -- 172.21.15.5:0/3044367537 <== mds.4 v2:172.21.15.50:6836/428759669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559484c115d0 con 0x5594848b19f0 2024-08-31T05:31:29.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.861+0000 7f844effd640 10 client.15957 handle_command_reply: tid=0 2024-08-31T05:31:29.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.861+0000 7f847bd78740 1 client.15957 shutdown 2024-08-31T05:31:29.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.861+0000 7f847bd78740 1 -- 172.21.15.5:0/3044367537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594848ca1b0 msgr2=0x559484ca3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:29.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.861+0000 7f847bd78740 1 --2- 172.21.15.5:0/3044367537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594848ca1b0 0x559484ca3bc0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f8460012740 tx=0x7f8460012c00 comp rx=0 tx=0).stop 2024-08-31T05:31:29.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.861+0000 7f847bd78740 1 -- 172.21.15.5:0/3044367537 shutdown_connections 2024-08-31T05:31:29.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.861+0000 7f847bd78740 1 --2- 172.21.15.5:0/3044367537 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x5594848b19f0 0x559484cb5fd0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:29.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.861+0000 7f844effd640 0 client.15957 ms_handle_reset on v2:172.21.15.50:6836/428759669 2024-08-31T05:31:29.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.861+0000 7f847bd78740 1 --2- 172.21.15.5:0/3044367537 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5594848f3070 0x559484caffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:29.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.861+0000 7f847bd78740 1 --2- 172.21.15.5:0/3044367537 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594848d2390 0x559484ca4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:29.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.861+0000 7f847bd78740 1 --2- 172.21.15.5:0/3044367537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594848ca1b0 0x559484ca3bc0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:29.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.861+0000 7f847bd78740 1 -- 172.21.15.5:0/3044367537 >> 172.21.15.5:0/3044367537 conn(0x5594848e7460 msgr2=0x559484c9b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:29.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.861+0000 7f847bd78740 1 -- 172.21.15.5:0/3044367537 shutdown_connections 2024-08-31T05:31:29.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.861+0000 7f847bd78740 1 -- 172.21.15.5:0/3044367537 wait complete. 2024-08-31T05:31:29.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.862+0000 7f847bd78740 20 client.15957 trim_cache size 0 max 16384 2024-08-31T05:31:29.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.876+0000 7f847bd78740 1 Processor -- start 2024-08-31T05:31:29.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.876+0000 7f847bd78740 1 -- start start 2024-08-31T05:31:29.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.876+0000 7f847bd78740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594848ca1b0 0x559484c94f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:29.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.876+0000 7f847bd78740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5594848d2390 0x559484cafec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:29.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.876+0000 7f847bd78740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594848f3070 0x559484ca0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:29.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.876+0000 7f847bd78740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f84701ae900 con 0x5594848ca1b0 2024-08-31T05:31:29.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.876+0000 7f847bd78740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f84701b0500 con 0x5594848d2390 2024-08-31T05:31:29.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.876+0000 7f847bd78740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f84701aefd0 con 0x5594848f3070 2024-08-31T05:31:29.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.876+0000 7f846effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594848ca1b0 0x559484c94f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:29.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.876+0000 7f8467fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5594848d2390 0x559484cafec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:29.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.876+0000 7f846f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594848f3070 0x559484ca0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:29.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.876+0000 7f846effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594848ca1b0 0x559484c94f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53544/0 (socket says 172.21.15.5:53544) 2024-08-31T05:31:29.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.876+0000 7f846effd640 1 -- 172.21.15.5:0/2975870064 learned_addr learned my addr 172.21.15.5:0/2975870064 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:29.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.876+0000 7f846effd640 1 -- 172.21.15.5:0/2975870064 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594848f3070 msgr2=0x559484ca0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:29.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.876+0000 7f846effd640 1 --2- 172.21.15.5:0/2975870064 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594848f3070 0x559484ca0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:29.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.876+0000 7f846effd640 1 -- 172.21.15.5:0/2975870064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5594848d2390 msgr2=0x559484cafec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:29.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.876+0000 7f846effd640 1 --2- 172.21.15.5:0/2975870064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5594848d2390 0x559484cafec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:29.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.876+0000 7f846effd640 1 -- 172.21.15.5:0/2975870064 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559484c9aa10 con 0x5594848ca1b0 2024-08-31T05:31:29.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.876+0000 7f846f7fe640 1 --2- 172.21.15.5:0/2975870064 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594848f3070 0x559484ca0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:31:29.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.876+0000 7f8467fff640 1 --2- 172.21.15.5:0/2975870064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5594848d2390 0x559484cafec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:31:29.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.877+0000 7f846effd640 1 --2- 172.21.15.5:0/2975870064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594848ca1b0 0x559484c94f60 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f846001c8e0 tx=0x7f84600123a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81d59cdfd70807d3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:29.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.877+0000 7f84657fa640 1 -- 172.21.15.5:0/2975870064 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f846000fea0 con 0x5594848ca1b0 2024-08-31T05:31:29.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.877+0000 7f84657fa640 1 -- 172.21.15.5:0/2975870064 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8460012e50 con 0x5594848ca1b0 2024-08-31T05:31:29.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.877+0000 7f84657fa640 1 -- 172.21.15.5:0/2975870064 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84600035f0 con 0x5594848ca1b0 2024-08-31T05:31:29.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.878+0000 7f847bd78740 1 -- 172.21.15.5:0/2975870064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594848ca1b0 msgr2=0x559484c94f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:29.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.878+0000 7f847bd78740 1 --2- 172.21.15.5:0/2975870064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594848ca1b0 0x559484c94f60 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f846001c8e0 tx=0x7f84600123a0 comp rx=0 tx=0).stop 2024-08-31T05:31:29.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.878+0000 7f847bd78740 1 -- 172.21.15.5:0/2975870064 shutdown_connections 2024-08-31T05:31:29.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.878+0000 7f847bd78740 1 --2- 172.21.15.5:0/2975870064 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594848f3070 0x559484ca0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:29.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.878+0000 7f847bd78740 1 --2- 172.21.15.5:0/2975870064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5594848d2390 0x559484cafec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:29.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.878+0000 7f847bd78740 1 --2- 172.21.15.5:0/2975870064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594848ca1b0 0x559484c94f60 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:29.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.878+0000 7f847bd78740 1 -- 172.21.15.5:0/2975870064 >> 172.21.15.5:0/2975870064 conn(0x5594848e7460 msgr2=0x559484c94850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:29.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.878+0000 7f847bd78740 1 -- 172.21.15.5:0/2975870064 shutdown_connections 2024-08-31T05:31:29.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.878+0000 7f847bd78740 1 -- 172.21.15.5:0/2975870064 wait complete. 2024-08-31T05:31:29.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.878+0000 7f847bd78740 1 -- start start 2024-08-31T05:31:29.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.878+0000 7f847bd78740 1 Processor -- start 2024-08-31T05:31:29.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.879+0000 7f847bd78740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5594848ca1b0 0x559484cac5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:29.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.879+0000 7f847bd78740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594848d2390 0x559484ca7a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:29.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.879+0000 7f847bd78740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594848f3070 0x559484ca7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:29.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.879+0000 7f847bd78740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f84701afd70 con 0x5594848f3070 2024-08-31T05:31:29.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.879+0000 7f847bd78740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f84701af6a0 con 0x5594848ca1b0 2024-08-31T05:31:29.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.879+0000 7f847bd78740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f84701ac8e0 con 0x5594848d2390 2024-08-31T05:31:29.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.879+0000 7f847bd78740 10 client.0 _ll_register_callbacks cb 0x7f8460009910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:31:29.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.879+0000 7f846f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594848f3070 0x559484ca7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:29.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.879+0000 7f846f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594848f3070 0x559484ca7fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53552/0 (socket says 172.21.15.5:53552) 2024-08-31T05:31:29.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.879+0000 7f846f7fe640 1 -- 172.21.15.5:0/2689633479 learned_addr learned my addr 172.21.15.5:0/2689633479 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:29.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.879+0000 7f8467fff640 1 --2- 172.21.15.5:0/2689633479 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594848d2390 0x559484ca7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:29.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.879+0000 7f846effd640 1 --2- 172.21.15.5:0/2689633479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5594848ca1b0 0x559484cac5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:29.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.879+0000 7f846f7fe640 1 -- 172.21.15.5:0/2689633479 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594848d2390 msgr2=0x559484ca7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:29.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.879+0000 7f846f7fe640 1 --2- 172.21.15.5:0/2689633479 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594848d2390 0x559484ca7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:29.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.879+0000 7f846f7fe640 1 -- 172.21.15.5:0/2689633479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5594848ca1b0 msgr2=0x559484cac5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:29.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.879+0000 7f846f7fe640 1 --2- 172.21.15.5:0/2689633479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5594848ca1b0 0x559484cac5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:29.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.879+0000 7f846f7fe640 1 -- 172.21.15.5:0/2689633479 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559484ca85e0 con 0x5594848f3070 2024-08-31T05:31:29.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.879+0000 7f846f7fe640 1 --2- 172.21.15.5:0/2689633479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594848f3070 0x559484ca7fa0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f84680094e0 tx=0x7f8468042000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad2814a29027dd47 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:29.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.879+0000 7f844effd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:31:29.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.880+0000 7f844effd640 1 -- 172.21.15.5:0/2689633479 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8468061070 con 0x5594848f3070 2024-08-31T05:31:29.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.880+0000 7f844effd640 1 -- 172.21.15.5:0/2689633479 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f8468003970 con 0x5594848f3070 2024-08-31T05:31:29.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.880+0000 7f847bd78740 1 -- 172.21.15.5:0/2689633479 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8460012e50 con 0x5594848f3070 2024-08-31T05:31:29.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.880+0000 7f844effd640 1 -- 172.21.15.5:0/2689633479 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f846806d050 con 0x5594848f3070 2024-08-31T05:31:29.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.880+0000 7f847bd78740 10 client.15963 fetch_fsmap learned FSMap version 32 2024-08-31T05:31:29.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.880+0000 7f847bd78740 1 -- 172.21.15.5:0/2689633479 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x559484d207f0 con 0x5594848f3070 2024-08-31T05:31:29.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.880+0000 7f844effd640 1 -- 172.21.15.5:0/2689633479 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8460012e50 con 0x5594848f3070 2024-08-31T05:31:29.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.880+0000 7f844effd640 1 -- 172.21.15.5:0/2689633479 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f846805c040 con 0x5594848f3070 2024-08-31T05:31:29.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.880+0000 7f847bd78740 10 client.15963 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:31:29.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.880+0000 7f847bd78740 10 client.15963 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-31T05:31:29.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.880+0000 7f847bd78740 20 client.15963 populate_metadata read hostname 'smithi005' 2024-08-31T05:31:29.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.880+0000 7f847bd78740 1 --2- 172.21.15.5:0/2689633479 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x559484886da0 0x559484d22bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:29.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.880+0000 7f847bd78740 4 client.15963 mds_command: new command op to 24602 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:31:29.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.880+0000 7f847bd78740 1 -- 172.21.15.5:0/2689633479 --> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559484c0d070 con 0x559484886da0 2024-08-31T05:31:29.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.881+0000 7f846effd640 1 --2- 172.21.15.5:0/2689633479 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x559484886da0 0x559484d22bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:29.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.881+0000 7f846effd640 1 --2- 172.21.15.5:0/2689633479 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x559484886da0 0x559484d22bc0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c5a87bea5a1feae0 server_cookie=ad961adf7d26e25a in_seq=0 out_seq=0 2024-08-31T05:31:29.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.881+0000 7f844effd640 10 client.15963 ms_handle_connect on v2:172.21.15.50:6836/428759669 2024-08-31T05:31:29.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.881+0000 7f844effd640 1 -- 172.21.15.5:0/2689633479 <== mds.4 v2:172.21.15.50:6836/428759669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559484c0d070 con 0x559484886da0 2024-08-31T05:31:29.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.881+0000 7f844effd640 10 client.15963 handle_command_reply: tid=0 2024-08-31T05:31:29.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.881+0000 7f847bd78740 1 client.15963 shutdown 2024-08-31T05:31:29.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.882+0000 7f847bd78740 1 -- 172.21.15.5:0/2689633479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594848f3070 msgr2=0x559484ca7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:29.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.882+0000 7f847bd78740 1 --2- 172.21.15.5:0/2689633479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594848f3070 0x559484ca7fa0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f84680094e0 tx=0x7f8468042000 comp rx=0 tx=0).stop 2024-08-31T05:31:29.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.882+0000 7f847bd78740 1 -- 172.21.15.5:0/2689633479 shutdown_connections 2024-08-31T05:31:29.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.882+0000 7f847bd78740 1 --2- 172.21.15.5:0/2689633479 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x559484886da0 0x559484d22bc0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:29.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.882+0000 7f847bd78740 1 --2- 172.21.15.5:0/2689633479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5594848f3070 0x559484ca7fa0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:29.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.882+0000 7f847bd78740 1 --2- 172.21.15.5:0/2689633479 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594848d2390 0x559484ca7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:29.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.882+0000 7f847bd78740 1 --2- 172.21.15.5:0/2689633479 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5594848ca1b0 0x559484cac5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:29.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.882+0000 7f847bd78740 1 -- 172.21.15.5:0/2689633479 >> 172.21.15.5:0/2689633479 conn(0x5594848e7460 msgr2=0x559484c9d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:29.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.882+0000 7f844effd640 0 client.15963 ms_handle_reset on v2:172.21.15.50:6836/428759669 2024-08-31T05:31:29.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.882+0000 7f847bd78740 1 -- 172.21.15.5:0/2689633479 shutdown_connections 2024-08-31T05:31:29.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.882+0000 7f847bd78740 1 -- 172.21.15.5:0/2689633479 wait complete. 2024-08-31T05:31:29.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.882+0000 7f847bd78740 20 client.15963 trim_cache size 0 max 16384 2024-08-31T05:31:29.889 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:31:29.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.882+0000 7f846ffff640 1 -- 172.21.15.5:0/1249596953 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f845c0b91c0 msgr2=0x7f845c0bb6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:29.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.882+0000 7f846ffff640 1 --2- 172.21.15.5:0/1249596953 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f845c0b91c0 0x7f845c0bb6d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8468003fd0 tx=0x7f84680045e0 comp rx=0 tx=0).stop 2024-08-31T05:31:29.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.882+0000 7f846ffff640 1 -- 172.21.15.5:0/1249596953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8470104eb0 msgr2=0x7f847019a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:29.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.882+0000 7f846ffff640 1 --2- 172.21.15.5:0/1249596953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8470104eb0 0x7f847019a610 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f845800e9f0 tx=0x7f845800eeb0 comp rx=0 tx=0).stop 2024-08-31T05:31:29.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.883+0000 7f846ffff640 1 -- 172.21.15.5:0/1249596953 shutdown_connections 2024-08-31T05:31:29.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.883+0000 7f846ffff640 1 --2- 172.21.15.5:0/1249596953 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f845c0b91c0 0x7f845c0bb6d0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:29.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.883+0000 7f846ffff640 1 --2- 172.21.15.5:0/1249596953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f847010d9c0 0x7f847019f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:29.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.883+0000 7f846ffff640 1 --2- 172.21.15.5:0/1249596953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8470104eb0 0x7f847019a610 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:29.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.883+0000 7f846ffff640 1 --2- 172.21.15.5:0/1249596953 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8470104560 0x7f847019a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:29.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.883+0000 7f846ffff640 1 -- 172.21.15.5:0/1249596953 >> 172.21.15.5:0/1249596953 conn(0x7f84700fe060 msgr2=0x7f8470107470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:29.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.883+0000 7f846ffff640 1 -- 172.21.15.5:0/1249596953 shutdown_connections 2024-08-31T05:31:29.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:29.883+0000 7f846ffff640 1 -- 172.21.15.5:0/1249596953 wait complete. 2024-08-31T05:31:29.908 INFO:tasks.workunit.client.0.smithi005.stdout: 1 47677 16.16 MB/sec warmup 17 sec latency 21.317 ms 2024-08-31T05:31:30.887 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-31T05:31:30.908 INFO:tasks.workunit.client.0.smithi005.stdout: 1 50498 16.07 MB/sec warmup 18 sec latency 11.429 ms 2024-08-31T05:31:31.159 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:31:31.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:31:31 smithi050 ceph-mon[22146]: pgmap v391: 129 pgs: 129 active+clean; 18 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.9 MiB/s wr, 290 op/s 2024-08-31T05:31:31.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:31:31 smithi050 ceph-mon[22146]: mgrmap e26: x(active, since 10m), standbys: z, y 2024-08-31T05:31:31.442 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:31:31 smithi005 ceph-mon[18602]: pgmap v391: 129 pgs: 129 active+clean; 18 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.9 MiB/s wr, 290 op/s 2024-08-31T05:31:31.442 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:31:31 smithi005 ceph-mon[18602]: mgrmap e26: x(active, since 10m), standbys: z, y 2024-08-31T05:31:31.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:31:31 smithi070 ceph-mon[22316]: pgmap v391: 129 pgs: 129 active+clean; 18 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.9 MiB/s wr, 290 op/s 2024-08-31T05:31:31.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:31:31 smithi070 ceph-mon[22316]: mgrmap e26: x(active, since 10m), standbys: z, y 2024-08-31T05:31:31.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.671+0000 7f37e5238640 1 -- 172.21.15.5:0/1338066207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37e01050a0 msgr2=0x7f37e010d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:31.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.671+0000 7f37e5238640 1 --2- 172.21.15.5:0/1338066207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37e01050a0 0x7f37e010d5f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f37d4009900 tx=0x7f37d402a410 comp rx=0 tx=0).stop 2024-08-31T05:31:31.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.671+0000 7f37e5238640 1 -- 172.21.15.5:0/1338066207 shutdown_connections 2024-08-31T05:31:31.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.671+0000 7f37e5238640 1 --2- 172.21.15.5:0/1338066207 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37e010dbb0 0x7f37e01100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:31.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.671+0000 7f37e5238640 1 --2- 172.21.15.5:0/1338066207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37e01050a0 0x7f37e010d5f0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:31.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.671+0000 7f37e5238640 1 --2- 172.21.15.5:0/1338066207 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37e0104750 0x7f37e0104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:31.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.671+0000 7f37e5238640 1 -- 172.21.15.5:0/1338066207 >> 172.21.15.5:0/1338066207 conn(0x7f37e00794d0 msgr2=0x7f37e00798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:31.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.671+0000 7f37e5238640 1 -- 172.21.15.5:0/1338066207 shutdown_connections 2024-08-31T05:31:31.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.671+0000 7f37e5238640 1 -- 172.21.15.5:0/1338066207 wait complete. 2024-08-31T05:31:31.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.672+0000 7f37e5238640 1 Processor -- start 2024-08-31T05:31:31.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.672+0000 7f37e5238640 1 -- start start 2024-08-31T05:31:31.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.672+0000 7f37e5238640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37e0104750 0x7f37e019a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:31.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.672+0000 7f37e5238640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37e01050a0 0x7f37e019a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:31.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.672+0000 7f37e5238640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37e010dbb0 0x7f37e019fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:31.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.672+0000 7f37e5238640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f37e01137f0 con 0x7f37e01050a0 2024-08-31T05:31:31.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.672+0000 7f37e5238640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f37e0113670 con 0x7f37e0104750 2024-08-31T05:31:31.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.672+0000 7f37e5238640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f37e0113970 con 0x7f37e010dbb0 2024-08-31T05:31:31.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.672+0000 7f37ded9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37e0104750 0x7f37e019a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:31.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.672+0000 7f37de59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37e01050a0 0x7f37e019a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:31.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.672+0000 7f37df59e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37e010dbb0 0x7f37e019fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:31.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.672+0000 7f37ded9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37e0104750 0x7f37e019a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:36284/0 (socket says 172.21.15.5:36284) 2024-08-31T05:31:31.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.672+0000 7f37ded9d640 1 -- 172.21.15.5:0/1889885512 learned_addr learned my addr 172.21.15.5:0/1889885512 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:31.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.672+0000 7f37de59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37e01050a0 0x7f37e019a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53562/0 (socket says 172.21.15.5:53562) 2024-08-31T05:31:31.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.673+0000 7f37ded9d640 1 -- 172.21.15.5:0/1889885512 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37e010dbb0 msgr2=0x7f37e019fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:31.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.673+0000 7f37ded9d640 1 --2- 172.21.15.5:0/1889885512 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37e010dbb0 0x7f37e019fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:31.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.673+0000 7f37ded9d640 1 -- 172.21.15.5:0/1889885512 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37e01050a0 msgr2=0x7f37e019a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:31.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.673+0000 7f37ded9d640 1 --2- 172.21.15.5:0/1889885512 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37e01050a0 0x7f37e019a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:31.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.673+0000 7f37ded9d640 1 -- 172.21.15.5:0/1889885512 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37e01a0190 con 0x7f37e0104750 2024-08-31T05:31:31.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.673+0000 7f37ded9d640 1 --2- 172.21.15.5:0/1889885512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37e0104750 0x7f37e019a220 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f37d000e9c0 tx=0x7f37d000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:31.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.673+0000 7f37c7fff640 1 -- 172.21.15.5:0/1889885512 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d000cd80 con 0x7f37e0104750 2024-08-31T05:31:31.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.673+0000 7f37e5238640 1 -- 172.21.15.5:0/1889885512 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37e01a0480 con 0x7f37e0104750 2024-08-31T05:31:31.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.673+0000 7f37c7fff640 1 -- 172.21.15.5:0/1889885512 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37d00035f0 con 0x7f37e0104750 2024-08-31T05:31:31.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.673+0000 7f37c7fff640 1 -- 172.21.15.5:0/1889885512 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d0010690 con 0x7f37e0104750 2024-08-31T05:31:31.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.673+0000 7f37e5238640 1 -- 172.21.15.5:0/1889885512 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37e01a6be0 con 0x7f37e0104750 2024-08-31T05:31:31.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.676+0000 7f37eb7ad740 1 Processor -- start 2024-08-31T05:31:31.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.676+0000 7f37eb7ad740 1 -- start start 2024-08-31T05:31:31.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.677+0000 7f37eb7ad740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fd8204070 0x564fd85a9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:31.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.677+0000 7f37eb7ad740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fd81db1b0 0x564fd85a9890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:31.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.677+0000 7f37eb7ad740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564fd81e3390 0x564fd85a9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:31.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.677+0000 7f37eb7ad740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x564fd8520680 con 0x564fd81e3390 2024-08-31T05:31:31.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.677+0000 7f37eb7ad740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564fd850fc10 con 0x564fd81db1b0 2024-08-31T05:31:31.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.677+0000 7f37eb7ad740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564fd8513bc0 con 0x564fd8204070 2024-08-31T05:31:31.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.677+0000 7f37c7fff640 1 -- 172.21.15.5:0/1889885512 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f37d0010830 con 0x7f37e0104750 2024-08-31T05:31:31.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.677+0000 7f37df59e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fd8204070 0x564fd85a9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:31.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.677+0000 7f37df59e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fd8204070 0x564fd85a9350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:56828/0 (socket says 172.21.15.5:56828) 2024-08-31T05:31:31.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.677+0000 7f37df59e640 1 -- 172.21.15.5:0/1005468699 learned_addr learned my addr 172.21.15.5:0/1005468699 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:31.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.677+0000 7f37de59c640 1 --2- 172.21.15.5:0/1005468699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564fd81e3390 0x564fd85a9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:31.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.677+0000 7f37ded9d640 1 --2- 172.21.15.5:0/1005468699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fd81db1b0 0x564fd85a9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:31.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.677+0000 7f37df59e640 1 -- 172.21.15.5:0/1005468699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fd81db1b0 msgr2=0x564fd85a9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:31.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.677+0000 7f37df59e640 1 --2- 172.21.15.5:0/1005468699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fd81db1b0 0x564fd85a9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:31.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.677+0000 7f37df59e640 1 -- 172.21.15.5:0/1005468699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564fd81e3390 msgr2=0x564fd85a9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:31.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.677+0000 7f37df59e640 1 --2- 172.21.15.5:0/1005468699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564fd81e3390 0x564fd85a9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:31.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.677+0000 7f37df59e640 1 -- 172.21.15.5:0/1005468699 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fd826f650 con 0x564fd8204070 2024-08-31T05:31:31.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.677+0000 7f37ded9d640 1 --2- 172.21.15.5:0/1005468699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fd81db1b0 0x564fd85a9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:31:31.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.678+0000 7f37df59e640 1 --2- 172.21.15.5:0/1005468699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fd8204070 0x564fd85a9350 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f37d8009fd0 tx=0x7f37d80118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6db4949a9e3fbcef server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:31.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.678+0000 7f37c57fa640 1 -- 172.21.15.5:0/1005468699 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d8004d20 con 0x564fd8204070 2024-08-31T05:31:31.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.678+0000 7f37c57fa640 1 -- 172.21.15.5:0/1005468699 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37d8004050 con 0x564fd8204070 2024-08-31T05:31:31.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.678+0000 7f37c57fa640 1 -- 172.21.15.5:0/1005468699 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d8005220 con 0x564fd8204070 2024-08-31T05:31:31.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.678+0000 7f37c7fff640 1 --2- 172.21.15.5:0/1889885512 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f37c80b4ca0 0x7f37c80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:31.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.678+0000 7f37ded9d640 1 --2- 172.21.15.5:0/1889885512 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f37c80b4ca0 0x7f37c80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:31.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.678+0000 7f37c7fff640 1 -- 172.21.15.5:0/1889885512 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f37d00e5ea0 con 0x7f37e0104750 2024-08-31T05:31:31.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.679+0000 7f37eb7ad740 1 -- 172.21.15.5:0/1005468699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fd8204070 msgr2=0x564fd85a9350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:31.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.679+0000 7f37ded9d640 1 --2- 172.21.15.5:0/1889885512 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f37c80b4ca0 0x7f37c80b71b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x564fd85a7fd0 tx=0x7f37d0003e70 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:31.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.679+0000 7f37eb7ad740 1 --2- 172.21.15.5:0/1005468699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fd8204070 0x564fd85a9350 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f37d8009fd0 tx=0x7f37d80118d0 comp rx=0 tx=0).stop 2024-08-31T05:31:31.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.679+0000 7f37eb7ad740 1 -- 172.21.15.5:0/1005468699 shutdown_connections 2024-08-31T05:31:31.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.679+0000 7f37eb7ad740 1 --2- 172.21.15.5:0/1005468699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564fd81e3390 0x564fd85a9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:31.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.679+0000 7f37eb7ad740 1 --2- 172.21.15.5:0/1005468699 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fd81db1b0 0x564fd85a9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:31.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.679+0000 7f37eb7ad740 1 --2- 172.21.15.5:0/1005468699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fd8204070 0x564fd85a9350 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:31.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.679+0000 7f37eb7ad740 1 -- 172.21.15.5:0/1005468699 >> 172.21.15.5:0/1005468699 conn(0x564fd81f8460 msgr2=0x564fd85a7240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:31.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.679+0000 7f37eb7ad740 1 -- 172.21.15.5:0/1005468699 shutdown_connections 2024-08-31T05:31:31.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.679+0000 7f37eb7ad740 1 -- 172.21.15.5:0/1005468699 wait complete. 2024-08-31T05:31:31.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.679+0000 7f37eb7ad740 1 -- start start 2024-08-31T05:31:31.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.680+0000 7f37eb7ad740 1 Processor -- start 2024-08-31T05:31:31.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.680+0000 7f37eb7ad740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fd81db1b0 0x564fd85b4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:31.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.680+0000 7f37eb7ad740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564fd81e3390 0x564fd85b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:31.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.680+0000 7f37eb7ad740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fd8204070 0x564fd85c0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:31.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.680+0000 7f37eb7ad740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x564fd8372700 con 0x564fd81e3390 2024-08-31T05:31:31.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.680+0000 7f37eb7ad740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564fd8496750 con 0x564fd81db1b0 2024-08-31T05:31:31.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.680+0000 7f37eb7ad740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564fd85b7b30 con 0x564fd8204070 2024-08-31T05:31:31.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.680+0000 7f37eb7ad740 10 client.0 _ll_register_callbacks cb 0x564fd84c5e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:31:31.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.680+0000 7f37de59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564fd81e3390 0x564fd85b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:31.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.680+0000 7f37de59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564fd81e3390 0x564fd85b4f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53570/0 (socket says 172.21.15.5:53570) 2024-08-31T05:31:31.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.680+0000 7f37de59c640 1 -- 172.21.15.5:0/4194588210 learned_addr learned my addr 172.21.15.5:0/4194588210 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:31.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.680+0000 7f37df59e640 1 --2- 172.21.15.5:0/4194588210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fd81db1b0 0x564fd85b4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:31.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.680+0000 7f37df59e640 1 --2- 172.21.15.5:0/4194588210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fd8204070 0x564fd85c0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:31.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.680+0000 7f37de59c640 1 -- 172.21.15.5:0/4194588210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fd8204070 msgr2=0x564fd85c0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:31.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.680+0000 7f37de59c640 1 --2- 172.21.15.5:0/4194588210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fd8204070 0x564fd85c0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:31.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.680+0000 7f37de59c640 1 -- 172.21.15.5:0/4194588210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fd81db1b0 msgr2=0x564fd85b4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:31.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.680+0000 7f37de59c640 1 --2- 172.21.15.5:0/4194588210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fd81db1b0 0x564fd85b4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:31.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.680+0000 7f37de59c640 1 -- 172.21.15.5:0/4194588210 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fd84cf900 con 0x564fd81e3390 2024-08-31T05:31:31.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.680+0000 7f37df59e640 1 --2- 172.21.15.5:0/4194588210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fd81db1b0 0x564fd85b4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:31:31.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.681+0000 7f37de59c640 1 --2- 172.21.15.5:0/4194588210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564fd81e3390 0x564fd85b4f80 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f37d4009900 tx=0x7f37d4032e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eddf3e15ff63b2e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:31.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.681+0000 7f37c2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:31:31.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.681+0000 7f37c2ff5640 1 -- 172.21.15.5:0/4194588210 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d4035040 con 0x564fd81e3390 2024-08-31T05:31:31.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.681+0000 7f37c2ff5640 1 -- 172.21.15.5:0/4194588210 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f37d4031760 con 0x564fd81e3390 2024-08-31T05:31:31.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.681+0000 7f37eb7ad740 1 -- 172.21.15.5:0/4194588210 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37d8004050 con 0x564fd81e3390 2024-08-31T05:31:31.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.681+0000 7f37c2ff5640 1 -- 172.21.15.5:0/4194588210 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f37d404f050 con 0x564fd81e3390 2024-08-31T05:31:31.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.681+0000 7f37eb7ad740 10 client.15975 fetch_fsmap learned FSMap version 32 2024-08-31T05:31:31.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.681+0000 7f37eb7ad740 1 -- 172.21.15.5:0/4194588210 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x564fd85c3870 con 0x564fd81e3390 2024-08-31T05:31:31.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.681+0000 7f37c2ff5640 1 -- 172.21.15.5:0/4194588210 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37d8004050 con 0x564fd81e3390 2024-08-31T05:31:31.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.682+0000 7f37c2ff5640 1 -- 172.21.15.5:0/4194588210 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f37d40054b0 con 0x564fd81e3390 2024-08-31T05:31:31.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.682+0000 7f37eb7ad740 10 client.15975 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:31:31.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.682+0000 7f37eb7ad740 10 client.15975 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-31T05:31:31.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.682+0000 7f37eb7ad740 20 client.15975 populate_metadata read hostname 'smithi005' 2024-08-31T05:31:31.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.682+0000 7f37eb7ad740 1 --2- 172.21.15.5:0/4194588210 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x564fd81c29f0 0x564fd85c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:31.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.682+0000 7f37eb7ad740 4 client.15975 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:31:31.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.682+0000 7f37eb7ad740 1 -- 172.21.15.5:0/4194588210 --> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564fd85225d0 con 0x564fd81c29f0 2024-08-31T05:31:31.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.682+0000 7f37df59e640 1 --2- 172.21.15.5:0/4194588210 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x564fd81c29f0 0x564fd85c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:31.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.682+0000 7f37df59e640 1 --2- 172.21.15.5:0/4194588210 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x564fd81c29f0 0x564fd85c6db0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f718793d732153df server_cookie=6f44dbe1666dae10 in_seq=0 out_seq=0 2024-08-31T05:31:31.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.682+0000 7f37c2ff5640 10 client.15975 ms_handle_connect on v2:172.21.15.70:6834/2061504114 2024-08-31T05:31:31.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.683+0000 7f37c2ff5640 1 -- 172.21.15.5:0/4194588210 <== mds.3 v2:172.21.15.70:6834/2061504114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564fd85225d0 con 0x564fd81c29f0 2024-08-31T05:31:31.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.683+0000 7f37c2ff5640 10 client.15975 handle_command_reply: tid=0 2024-08-31T05:31:31.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.683+0000 7f37eb7ad740 1 client.15975 shutdown 2024-08-31T05:31:31.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.683+0000 7f37eb7ad740 1 -- 172.21.15.5:0/4194588210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564fd81e3390 msgr2=0x564fd85b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:31.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.683+0000 7f37eb7ad740 1 --2- 172.21.15.5:0/4194588210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564fd81e3390 0x564fd85b4f80 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f37d4009900 tx=0x7f37d4032e90 comp rx=0 tx=0).stop 2024-08-31T05:31:31.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.683+0000 7f37eb7ad740 1 -- 172.21.15.5:0/4194588210 shutdown_connections 2024-08-31T05:31:31.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.683+0000 7f37eb7ad740 1 --2- 172.21.15.5:0/4194588210 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x564fd81c29f0 0x564fd85c6db0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:31.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.683+0000 7f37c2ff5640 0 client.15975 ms_handle_reset on v2:172.21.15.70:6834/2061504114 2024-08-31T05:31:31.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.683+0000 7f37eb7ad740 1 --2- 172.21.15.5:0/4194588210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fd8204070 0x564fd85c0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:31.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.683+0000 7f37eb7ad740 1 --2- 172.21.15.5:0/4194588210 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564fd81e3390 0x564fd85b4f80 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:31.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.683+0000 7f37eb7ad740 1 --2- 172.21.15.5:0/4194588210 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fd81db1b0 0x564fd85b4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:31.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.683+0000 7f37eb7ad740 1 -- 172.21.15.5:0/4194588210 >> 172.21.15.5:0/4194588210 conn(0x564fd81f8460 msgr2=0x564fd85ac4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:31.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.683+0000 7f37eb7ad740 1 -- 172.21.15.5:0/4194588210 shutdown_connections 2024-08-31T05:31:31.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.683+0000 7f37eb7ad740 1 -- 172.21.15.5:0/4194588210 wait complete. 2024-08-31T05:31:31.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.683+0000 7f37eb7ad740 20 client.15975 trim_cache size 0 max 16384 2024-08-31T05:31:31.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.697+0000 7f37eb7ad740 1 Processor -- start 2024-08-31T05:31:31.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.697+0000 7f37eb7ad740 1 -- start start 2024-08-31T05:31:31.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.697+0000 7f37eb7ad740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fd81c29f0 0x564fd85a2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:31.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.697+0000 7f37eb7ad740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564fd81db1b0 0x564fd85bd160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:31.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.697+0000 7f37eb7ad740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fd81e3390 0x564fd85bd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:31.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.697+0000 7f37eb7ad740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f37e01b0be0 con 0x564fd81db1b0 2024-08-31T05:31:31.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.697+0000 7f37eb7ad740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f37e01b27e0 con 0x564fd81e3390 2024-08-31T05:31:31.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.697+0000 7f37eb7ad740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f37e01b12b0 con 0x564fd81c29f0 2024-08-31T05:31:31.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.697+0000 7f37de59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564fd81db1b0 0x564fd85bd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:31.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.697+0000 7f37de59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564fd81db1b0 0x564fd85bd160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53582/0 (socket says 172.21.15.5:53582) 2024-08-31T05:31:31.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.697+0000 7f37de59c640 1 -- 172.21.15.5:0/427521314 learned_addr learned my addr 172.21.15.5:0/427521314 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:31.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.697+0000 7f37df59e640 1 --2- 172.21.15.5:0/427521314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fd81e3390 0x564fd85bd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:31.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.698+0000 7f37df59e640 1 --2- 172.21.15.5:0/427521314 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fd81c29f0 0x564fd85a2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:31.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.698+0000 7f37de59c640 1 -- 172.21.15.5:0/427521314 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fd81c29f0 msgr2=0x564fd85a2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:31.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.698+0000 7f37de59c640 1 --2- 172.21.15.5:0/427521314 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fd81c29f0 0x564fd85a2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:31.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.698+0000 7f37de59c640 1 -- 172.21.15.5:0/427521314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fd81e3390 msgr2=0x564fd85bd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:31.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.698+0000 7f37de59c640 1 --2- 172.21.15.5:0/427521314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fd81e3390 0x564fd85bd6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:31.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.698+0000 7f37de59c640 1 -- 172.21.15.5:0/427521314 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fd85ac1b0 con 0x564fd81db1b0 2024-08-31T05:31:31.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.698+0000 7f37de59c640 1 --2- 172.21.15.5:0/427521314 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564fd81db1b0 0x564fd85bd160 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f37d4004b80 tx=0x7f37d4004bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ad6ba53a36b3577 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:31.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.698+0000 7f37c4ff9640 1 -- 172.21.15.5:0/427521314 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d4035030 con 0x564fd81db1b0 2024-08-31T05:31:31.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.698+0000 7f37c4ff9640 1 -- 172.21.15.5:0/427521314 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37d4031d10 con 0x564fd81db1b0 2024-08-31T05:31:31.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.698+0000 7f37c4ff9640 1 -- 172.21.15.5:0/427521314 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d40053a0 con 0x564fd81db1b0 2024-08-31T05:31:31.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.699+0000 7f37eb7ad740 1 -- 172.21.15.5:0/427521314 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564fd81db1b0 msgr2=0x564fd85bd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:31.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.699+0000 7f37eb7ad740 1 --2- 172.21.15.5:0/427521314 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564fd81db1b0 0x564fd85bd160 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f37d4004b80 tx=0x7f37d4004bb0 comp rx=0 tx=0).stop 2024-08-31T05:31:31.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.699+0000 7f37eb7ad740 1 -- 172.21.15.5:0/427521314 shutdown_connections 2024-08-31T05:31:31.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.699+0000 7f37eb7ad740 1 --2- 172.21.15.5:0/427521314 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fd81e3390 0x564fd85bd6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:31.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.699+0000 7f37eb7ad740 1 --2- 172.21.15.5:0/427521314 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564fd81db1b0 0x564fd85bd160 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:31.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.699+0000 7f37eb7ad740 1 --2- 172.21.15.5:0/427521314 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fd81c29f0 0x564fd85a2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:31.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.699+0000 7f37eb7ad740 1 -- 172.21.15.5:0/427521314 >> 172.21.15.5:0/427521314 conn(0x564fd81f8460 msgr2=0x564fd85b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:31.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.699+0000 7f37eb7ad740 1 -- 172.21.15.5:0/427521314 shutdown_connections 2024-08-31T05:31:31.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.699+0000 7f37eb7ad740 1 -- 172.21.15.5:0/427521314 wait complete. 2024-08-31T05:31:31.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.700+0000 7f37eb7ad740 1 -- start start 2024-08-31T05:31:31.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.700+0000 7f37eb7ad740 1 Processor -- start 2024-08-31T05:31:31.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.700+0000 7f37eb7ad740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fd81c29f0 0x564fd8629930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:31.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.700+0000 7f37eb7ad740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564fd81db1b0 0x564fd8629e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:31.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.700+0000 7f37eb7ad740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fd81e3390 0x564fd86347b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:31.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.700+0000 7f37eb7ad740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f37e01b2050 con 0x564fd81db1b0 2024-08-31T05:31:31.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.700+0000 7f37eb7ad740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f37e01b1980 con 0x564fd81e3390 2024-08-31T05:31:31.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.700+0000 7f37eb7ad740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f37e01aebc0 con 0x564fd81c29f0 2024-08-31T05:31:31.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.700+0000 7f37eb7ad740 10 client.0 _ll_register_callbacks cb 0x7f37d4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:31:31.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.701+0000 7f37df59e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fd81c29f0 0x564fd8629930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:31.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.701+0000 7f37df59e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fd81e3390 0x564fd86347b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:31.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.701+0000 7f37de59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564fd81db1b0 0x564fd8629e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:31.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.701+0000 7f37df59e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fd81c29f0 0x564fd8629930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:56852/0 (socket says 172.21.15.5:56852) 2024-08-31T05:31:31.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.701+0000 7f37de59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564fd81db1b0 0x564fd8629e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53598/0 (socket says 172.21.15.5:53598) 2024-08-31T05:31:31.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.701+0000 7f37df59e640 1 -- 172.21.15.5:0/1501098216 learned_addr learned my addr 172.21.15.5:0/1501098216 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:31.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.701+0000 7f37df59e640 1 -- 172.21.15.5:0/1501098216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fd81e3390 msgr2=0x564fd86347b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:31.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.701+0000 7f37df59e640 1 --2- 172.21.15.5:0/1501098216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fd81e3390 0x564fd86347b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:31.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.701+0000 7f37df59e640 1 -- 172.21.15.5:0/1501098216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564fd81db1b0 msgr2=0x564fd8629e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:31.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.701+0000 7f37df59e640 1 --2- 172.21.15.5:0/1501098216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564fd81db1b0 0x564fd8629e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:31.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.701+0000 7f37df59e640 1 -- 172.21.15.5:0/1501098216 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fd8634cf0 con 0x564fd81c29f0 2024-08-31T05:31:31.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.701+0000 7f37df59e640 1 --2- 172.21.15.5:0/1501098216 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fd81c29f0 0x564fd8629930 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f37d8011910 tx=0x7f37d4000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efc15b16bf84a011 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:31.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.701+0000 7f37c2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:31:31.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.701+0000 7f37c2ff5640 1 -- 172.21.15.5:0/1501098216 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d802c020 con 0x564fd81c29f0 2024-08-31T05:31:31.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.701+0000 7f37c2ff5640 1 -- 172.21.15.5:0/1501098216 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f37d8004320 con 0x564fd81c29f0 2024-08-31T05:31:31.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.701+0000 7f37eb7ad740 1 -- 172.21.15.5:0/1501098216 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37d4031d10 con 0x564fd81c29f0 2024-08-31T05:31:31.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.702+0000 7f37c2ff5640 1 -- 172.21.15.5:0/1501098216 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f37d8004520 con 0x564fd81c29f0 2024-08-31T05:31:31.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.702+0000 7f37eb7ad740 10 client.25600 fetch_fsmap learned FSMap version 32 2024-08-31T05:31:31.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.702+0000 7f37eb7ad740 1 -- 172.21.15.5:0/1501098216 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x564fd8635eb0 con 0x564fd81c29f0 2024-08-31T05:31:31.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.702+0000 7f37c2ff5640 1 -- 172.21.15.5:0/1501098216 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37d4031d10 con 0x564fd81c29f0 2024-08-31T05:31:31.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.702+0000 7f37c2ff5640 1 -- 172.21.15.5:0/1501098216 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f37d8028450 con 0x564fd81c29f0 2024-08-31T05:31:31.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.702+0000 7f37eb7ad740 10 client.25600 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:31:31.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.702+0000 7f37eb7ad740 10 client.25600 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-31T05:31:31.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.702+0000 7f37eb7ad740 20 client.25600 populate_metadata read hostname 'smithi005' 2024-08-31T05:31:31.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.702+0000 7f37eb7ad740 1 --2- 172.21.15.5:0/1501098216 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x564fd8204070 0x564fd8638480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:31.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.702+0000 7f37eb7ad740 4 client.25600 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:31:31.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.702+0000 7f37eb7ad740 1 -- 172.21.15.5:0/1501098216 --> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564fd851e070 con 0x564fd8204070 2024-08-31T05:31:31.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.702+0000 7f37de59c640 1 --2- 172.21.15.5:0/1501098216 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x564fd8204070 0x564fd8638480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:31.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.703+0000 7f37c2ff5640 10 client.25600 ms_handle_connect on v2:172.21.15.70:6834/2061504114 2024-08-31T05:31:31.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.703+0000 7f37de59c640 1 --2- 172.21.15.5:0/1501098216 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x564fd8204070 0x564fd8638480 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9068a3c4ca0f859e server_cookie=5c13727811342561 in_seq=0 out_seq=0 2024-08-31T05:31:31.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.703+0000 7f37c2ff5640 1 -- 172.21.15.5:0/1501098216 <== mds.3 v2:172.21.15.70:6834/2061504114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564fd851e070 con 0x564fd8204070 2024-08-31T05:31:31.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.703+0000 7f37c2ff5640 10 client.25600 handle_command_reply: tid=0 2024-08-31T05:31:31.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.703+0000 7f37eb7ad740 1 client.25600 shutdown 2024-08-31T05:31:31.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.703+0000 7f37eb7ad740 1 -- 172.21.15.5:0/1501098216 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fd81c29f0 msgr2=0x564fd8629930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:31.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.703+0000 7f37eb7ad740 1 --2- 172.21.15.5:0/1501098216 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fd81c29f0 0x564fd8629930 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f37d8011910 tx=0x7f37d4000bc0 comp rx=0 tx=0).stop 2024-08-31T05:31:31.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.703+0000 7f37eb7ad740 1 -- 172.21.15.5:0/1501098216 shutdown_connections 2024-08-31T05:31:31.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.703+0000 7f37eb7ad740 1 --2- 172.21.15.5:0/1501098216 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x564fd8204070 0x564fd8638480 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:31.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.703+0000 7f37eb7ad740 1 --2- 172.21.15.5:0/1501098216 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564fd81e3390 0x564fd86347b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:31.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.703+0000 7f37c2ff5640 0 client.25600 ms_handle_reset on v2:172.21.15.70:6834/2061504114 2024-08-31T05:31:31.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.703+0000 7f37eb7ad740 1 --2- 172.21.15.5:0/1501098216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564fd81db1b0 0x564fd8629e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:31.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.703+0000 7f37eb7ad740 1 --2- 172.21.15.5:0/1501098216 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fd81c29f0 0x564fd8629930 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:31.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.703+0000 7f37eb7ad740 1 -- 172.21.15.5:0/1501098216 >> 172.21.15.5:0/1501098216 conn(0x564fd81f8460 msgr2=0x564fd85aa380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:31.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.703+0000 7f37eb7ad740 1 -- 172.21.15.5:0/1501098216 shutdown_connections 2024-08-31T05:31:31.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.703+0000 7f37eb7ad740 1 -- 172.21.15.5:0/1501098216 wait complete. 2024-08-31T05:31:31.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.703+0000 7f37eb7ad740 20 client.25600 trim_cache size 0 max 16384 2024-08-31T05:31:31.710 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:31:31.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.704+0000 7f37e5238640 1 -- 172.21.15.5:0/1889885512 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f37c80b4ca0 msgr2=0x7f37c80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:31.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.704+0000 7f37e5238640 1 --2- 172.21.15.5:0/1889885512 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f37c80b4ca0 0x7f37c80b71b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x564fd85a7fd0 tx=0x7f37d0003e70 comp rx=0 tx=0).stop 2024-08-31T05:31:31.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.704+0000 7f37e5238640 1 -- 172.21.15.5:0/1889885512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37e0104750 msgr2=0x7f37e019a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:31.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.704+0000 7f37e5238640 1 --2- 172.21.15.5:0/1889885512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37e0104750 0x7f37e019a220 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f37d000e9c0 tx=0x7f37d000ee80 comp rx=0 tx=0).stop 2024-08-31T05:31:31.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.704+0000 7f37e5238640 1 -- 172.21.15.5:0/1889885512 shutdown_connections 2024-08-31T05:31:31.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.704+0000 7f37e5238640 1 --2- 172.21.15.5:0/1889885512 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f37c80b4ca0 0x7f37c80b71b0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:31.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.704+0000 7f37e5238640 1 --2- 172.21.15.5:0/1889885512 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37e010dbb0 0x7f37e019fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:31.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.704+0000 7f37e5238640 1 --2- 172.21.15.5:0/1889885512 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f37e01050a0 0x7f37e019a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:31.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.704+0000 7f37e5238640 1 --2- 172.21.15.5:0/1889885512 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f37e0104750 0x7f37e019a220 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:31.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.704+0000 7f37e5238640 1 -- 172.21.15.5:0/1889885512 >> 172.21.15.5:0/1889885512 conn(0x7f37e00794d0 msgr2=0x7f37e01005c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:31.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.704+0000 7f37e5238640 1 -- 172.21.15.5:0/1889885512 shutdown_connections 2024-08-31T05:31:31.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:31.704+0000 7f37e5238640 1 -- 172.21.15.5:0/1889885512 wait complete. 2024-08-31T05:31:31.908 INFO:tasks.workunit.client.0.smithi005.stdout: 1 53626 16.20 MB/sec warmup 19 sec latency 39.993 ms 2024-08-31T05:31:32.578 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T05:31:32.885 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:31:32.908 INFO:tasks.workunit.client.0.smithi005.stdout: 1 56586 16.11 MB/sec warmup 20 sec latency 61.003 ms 2024-08-31T05:31:33.279 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:31:33 smithi005 ceph-mon[18602]: pgmap v392: 129 pgs: 129 active+clean; 20 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 814 KiB/s rd, 1.5 MiB/s wr, 241 op/s 2024-08-31T05:31:33.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.373+0000 7f20c8079640 1 -- 172.21.15.5:0/173499480 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20c010ff20 msgr2=0x7f20c0112340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:33.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.373+0000 7f20c8079640 1 --2- 172.21.15.5:0/173499480 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20c010ff20 0x7f20c0112340 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f20b8009900 tx=0x7f20b802a480 comp rx=0 tx=0).stop 2024-08-31T05:31:33.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.373+0000 7f20c8079640 1 -- 172.21.15.5:0/173499480 shutdown_connections 2024-08-31T05:31:33.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.373+0000 7f20c8079640 1 --2- 172.21.15.5:0/173499480 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20c010ff20 0x7f20c0112340 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:33.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.373+0000 7f20c8079640 1 --2- 172.21.15.5:0/173499480 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20c0102cc0 0x7f20c010f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:33.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.373+0000 7f20c8079640 1 --2- 172.21.15.5:0/173499480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20c0102370 0x7f20c0102780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:33.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.373+0000 7f20c8079640 1 -- 172.21.15.5:0/173499480 >> 172.21.15.5:0/173499480 conn(0x7f20c00794d0 msgr2=0x7f20c00798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:33.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.373+0000 7f20c8079640 1 -- 172.21.15.5:0/173499480 shutdown_connections 2024-08-31T05:31:33.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.373+0000 7f20c8079640 1 -- 172.21.15.5:0/173499480 wait complete. 2024-08-31T05:31:33.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.373+0000 7f20c8079640 1 Processor -- start 2024-08-31T05:31:33.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.373+0000 7f20c8079640 1 -- start start 2024-08-31T05:31:33.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.374+0000 7f20c8079640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20c0102370 0x7f20c019c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:33.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.374+0000 7f20c8079640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20c0102cc0 0x7f20c019c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:33.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.374+0000 7f20c8079640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20c010ff20 0x7f20c01a1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:33.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.374+0000 7f20c8079640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f20c0115a10 con 0x7f20c010ff20 2024-08-31T05:31:33.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.374+0000 7f20c8079640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f20c0115890 con 0x7f20c0102cc0 2024-08-31T05:31:33.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.374+0000 7f20c8079640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f20c0115b90 con 0x7f20c0102370 2024-08-31T05:31:33.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.374+0000 7f20c5e15640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20c0102370 0x7f20c019c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:33.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.374+0000 7f20c6616640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20c010ff20 0x7f20c01a1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:33.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.374+0000 7f20c5e15640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20c0102370 0x7f20c019c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:54358/0 (socket says 172.21.15.5:54358) 2024-08-31T05:31:33.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.374+0000 7f20c5e15640 1 -- 172.21.15.5:0/4251087229 learned_addr learned my addr 172.21.15.5:0/4251087229 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:33.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.374+0000 7f20c5614640 1 --2- 172.21.15.5:0/4251087229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20c0102cc0 0x7f20c019c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:33.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.374+0000 7f20c5e15640 1 -- 172.21.15.5:0/4251087229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20c0102cc0 msgr2=0x7f20c019c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:33.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.374+0000 7f20c5e15640 1 --2- 172.21.15.5:0/4251087229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20c0102cc0 0x7f20c019c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:33.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.374+0000 7f20c5e15640 1 -- 172.21.15.5:0/4251087229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20c010ff20 msgr2=0x7f20c01a1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:33.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.374+0000 7f20c5e15640 1 --2- 172.21.15.5:0/4251087229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20c010ff20 0x7f20c01a1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:33.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.374+0000 7f20c5e15640 1 -- 172.21.15.5:0/4251087229 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20c01a2350 con 0x7f20c0102370 2024-08-31T05:31:33.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.374+0000 7f20c5e15640 1 --2- 172.21.15.5:0/4251087229 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20c0102370 0x7f20c019c3e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f20b0009d50 tx=0x7f20b000c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:33.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.375+0000 7f20beffd640 1 -- 172.21.15.5:0/4251087229 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b0003b70 con 0x7f20c0102370 2024-08-31T05:31:33.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.375+0000 7f20beffd640 1 -- 172.21.15.5:0/4251087229 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20b0003d10 con 0x7f20c0102370 2024-08-31T05:31:33.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.375+0000 7f20beffd640 1 -- 172.21.15.5:0/4251087229 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b00108a0 con 0x7f20c0102370 2024-08-31T05:31:33.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.375+0000 7f20c8079640 1 -- 172.21.15.5:0/4251087229 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20c01a2640 con 0x7f20c0102370 2024-08-31T05:31:33.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.375+0000 7f20c8079640 1 -- 172.21.15.5:0/4251087229 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20c01a8da0 con 0x7f20c0102370 2024-08-31T05:31:33.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.377+0000 7f20ce5ee740 1 Processor -- start 2024-08-31T05:31:33.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.377+0000 7f20ce5ee740 1 -- start start 2024-08-31T05:31:33.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.377+0000 7f20beffd640 1 -- 172.21.15.5:0/4251087229 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f20b0004000 con 0x7f20c0102370 2024-08-31T05:31:33.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.378+0000 7f20ce5ee740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c40514f070 0x55c4054f4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:33.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.378+0000 7f20ce5ee740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4051261b0 0x55c4054f4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:33.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.378+0000 7f20ce5ee740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c40512e390 0x55c4054f4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:33.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.378+0000 7f20ce5ee740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55c40546b680 con 0x55c40512e390 2024-08-31T05:31:33.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.378+0000 7f20ce5ee740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55c40545ac10 con 0x55c40514f070 2024-08-31T05:31:33.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.378+0000 7f20ce5ee740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c40545ebc0 con 0x55c4051261b0 2024-08-31T05:31:33.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.378+0000 7f20c5e15640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4051261b0 0x55c4054f4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:33.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.378+0000 7f20c6616640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c40514f070 0x55c4054f4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:33.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.378+0000 7f20c5614640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c40512e390 0x55c4054f4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:33.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.378+0000 7f20c6616640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c40514f070 0x55c4054f4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:44400/0 (socket says 172.21.15.5:44400) 2024-08-31T05:31:33.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.378+0000 7f20c6616640 1 -- 172.21.15.5:0/1028578645 learned_addr learned my addr 172.21.15.5:0/1028578645 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:33.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.378+0000 7f20c5e15640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4051261b0 0x55c4054f4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:54360/0 (socket says 172.21.15.5:54360) 2024-08-31T05:31:33.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.378+0000 7f20c5614640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c40512e390 0x55c4054f4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39914/0 (socket says 172.21.15.5:39914) 2024-08-31T05:31:33.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.378+0000 7f20c6616640 1 -- 172.21.15.5:0/1028578645 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4051261b0 msgr2=0x55c4054f4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:33.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.378+0000 7f20c6616640 1 --2- 172.21.15.5:0/1028578645 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4051261b0 0x55c4054f4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:33.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.378+0000 7f20c6616640 1 -- 172.21.15.5:0/1028578645 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c40512e390 msgr2=0x55c4054f4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:33.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.378+0000 7f20c6616640 1 --2- 172.21.15.5:0/1028578645 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c40512e390 0x55c4054f4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:33.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.378+0000 7f20c6616640 1 -- 172.21.15.5:0/1028578645 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4051ba650 con 0x55c40514f070 2024-08-31T05:31:33.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.378+0000 7f20c5614640 1 --2- 172.21.15.5:0/1028578645 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c40512e390 0x55c4054f4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:31:33.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.378+0000 7f20beffd640 1 --2- 172.21.15.5:0/4251087229 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f20a80b4ca0 0x7f20a80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:33.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.378+0000 7f20c6616640 1 --2- 172.21.15.5:0/1028578645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c40514f070 0x55c4054f4310 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f20b8009900 tx=0x7f20b8032b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9cbfdba17cdb8d83 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:33.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.379+0000 7f20c5e15640 1 --2- 172.21.15.5:0/4251087229 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f20a80b4ca0 0x7f20a80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:33.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.379+0000 7f20a7fff640 1 -- 172.21.15.5:0/1028578645 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b8040070 con 0x55c40514f070 2024-08-31T05:31:33.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.379+0000 7f20beffd640 1 -- 172.21.15.5:0/4251087229 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f20b00e5fa0 con 0x7f20c0102370 2024-08-31T05:31:33.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.379+0000 7f20a7fff640 1 -- 172.21.15.5:0/1028578645 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20b8004030 con 0x55c40514f070 2024-08-31T05:31:33.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.379+0000 7f20a7fff640 1 -- 172.21.15.5:0/1028578645 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b8035040 con 0x55c40514f070 2024-08-31T05:31:33.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.380+0000 7f20ce5ee740 1 -- 172.21.15.5:0/1028578645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c40514f070 msgr2=0x55c4054f4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:33.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.380+0000 7f20c5e15640 1 --2- 172.21.15.5:0/4251087229 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f20a80b4ca0 0x7f20a80b71b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f20b00e3420 tx=0x7f20b00e9af0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:33.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.380+0000 7f20ce5ee740 1 --2- 172.21.15.5:0/1028578645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c40514f070 0x55c4054f4310 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f20b8009900 tx=0x7f20b8032b20 comp rx=0 tx=0).stop 2024-08-31T05:31:33.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.380+0000 7f20ce5ee740 1 -- 172.21.15.5:0/1028578645 shutdown_connections 2024-08-31T05:31:33.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.380+0000 7f20ce5ee740 1 --2- 172.21.15.5:0/1028578645 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c40512e390 0x55c4054f4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:33.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.380+0000 7f20ce5ee740 1 --2- 172.21.15.5:0/1028578645 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4051261b0 0x55c4054f4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:33.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.380+0000 7f20ce5ee740 1 --2- 172.21.15.5:0/1028578645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c40514f070 0x55c4054f4310 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:33.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.380+0000 7f20ce5ee740 1 -- 172.21.15.5:0/1028578645 >> 172.21.15.5:0/1028578645 conn(0x55c405143460 msgr2=0x55c4054f2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:33.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.380+0000 7f20ce5ee740 1 -- 172.21.15.5:0/1028578645 shutdown_connections 2024-08-31T05:31:33.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.380+0000 7f20ce5ee740 1 -- 172.21.15.5:0/1028578645 wait complete. 2024-08-31T05:31:33.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.380+0000 7f20ce5ee740 1 -- start start 2024-08-31T05:31:33.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.380+0000 7f20ce5ee740 1 Processor -- start 2024-08-31T05:31:33.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.381+0000 7f20ce5ee740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4051261b0 0x55c4054ffb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:33.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.381+0000 7f20ce5ee740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c40512e390 0x55c405500090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:33.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.381+0000 7f20ce5ee740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c40514f070 0x55c40550bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:33.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.381+0000 7f20ce5ee740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55c4052bd700 con 0x55c40514f070 2024-08-31T05:31:33.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.381+0000 7f20ce5ee740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55c4053e1750 con 0x55c40512e390 2024-08-31T05:31:33.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.381+0000 7f20ce5ee740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c405502a90 con 0x55c4051261b0 2024-08-31T05:31:33.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.381+0000 7f20ce5ee740 10 client.0 _ll_register_callbacks cb 0x55c405410e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:31:33.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.381+0000 7f20c6616640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c40514f070 0x55c40550bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:33.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.381+0000 7f20c6616640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c40514f070 0x55c40550bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39918/0 (socket says 172.21.15.5:39918) 2024-08-31T05:31:33.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.381+0000 7f20c6616640 1 -- 172.21.15.5:0/2033549042 learned_addr learned my addr 172.21.15.5:0/2033549042 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:33.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.381+0000 7f20c6616640 1 --2- 172.21.15.5:0/2033549042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4051261b0 0x55c4054ffb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:33.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.381+0000 7f20c5614640 1 --2- 172.21.15.5:0/2033549042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c40512e390 0x55c405500090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:33.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.381+0000 7f20c6616640 1 -- 172.21.15.5:0/2033549042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4051261b0 msgr2=0x55c4054ffb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:33.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.381+0000 7f20c6616640 1 --2- 172.21.15.5:0/2033549042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4051261b0 0x55c4054ffb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:33.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.381+0000 7f20c6616640 1 -- 172.21.15.5:0/2033549042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c40512e390 msgr2=0x55c405500090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:33.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.381+0000 7f20c6616640 1 --2- 172.21.15.5:0/2033549042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c40512e390 0x55c405500090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:33.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.381+0000 7f20c6616640 1 -- 172.21.15.5:0/2033549042 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c40541a900 con 0x55c40514f070 2024-08-31T05:31:33.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.381+0000 7f20c5614640 1 --2- 172.21.15.5:0/2033549042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c40512e390 0x55c405500090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:31:33.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.382+0000 7f20c6616640 1 --2- 172.21.15.5:0/2033549042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c40514f070 0x55c40550bd80 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f20b8005ef0 tx=0x7f20b8005180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55a37cdb6a27c864 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:33.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.382+0000 7f20a57fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:31:33.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.382+0000 7f20a57fa640 1 -- 172.21.15.5:0/2033549042 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b8035030 con 0x55c40514f070 2024-08-31T05:31:33.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.382+0000 7f20ce5ee740 1 -- 172.21.15.5:0/2033549042 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20b8004030 con 0x55c40514f070 2024-08-31T05:31:33.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.382+0000 7f20a57fa640 1 -- 172.21.15.5:0/2033549042 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f20b8005260 con 0x55c40514f070 2024-08-31T05:31:33.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.382+0000 7f20a57fa640 1 -- 172.21.15.5:0/2033549042 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f20b8040040 con 0x55c40514f070 2024-08-31T05:31:33.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.382+0000 7f20ce5ee740 10 client.15993 fetch_fsmap learned FSMap version 32 2024-08-31T05:31:33.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.382+0000 7f20ce5ee740 1 -- 172.21.15.5:0/2033549042 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55c40550e8f0 con 0x55c40514f070 2024-08-31T05:31:33.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.382+0000 7f20a57fa640 1 -- 172.21.15.5:0/2033549042 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20b8004030 con 0x55c40514f070 2024-08-31T05:31:33.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.382+0000 7f20a57fa640 1 -- 172.21.15.5:0/2033549042 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f20b80047e0 con 0x55c40514f070 2024-08-31T05:31:33.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.382+0000 7f20ce5ee740 10 client.15993 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:31:33.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.382+0000 7f20ce5ee740 10 client.15993 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-31T05:31:33.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.382+0000 7f20ce5ee740 20 client.15993 populate_metadata read hostname 'smithi005' 2024-08-31T05:31:33.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.382+0000 7f20ce5ee740 1 --2- 172.21.15.5:0/2033549042 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55c40510d9f0 0x55c405511c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:33.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.383+0000 7f20ce5ee740 4 client.15993 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:31:33.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.383+0000 7f20ce5ee740 1 -- 172.21.15.5:0/2033549042 --> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c40546d5d0 con 0x55c40510d9f0 2024-08-31T05:31:33.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.383+0000 7f20c5614640 1 --2- 172.21.15.5:0/2033549042 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55c40510d9f0 0x55c405511c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:33.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.383+0000 7f20a57fa640 10 client.15993 ms_handle_connect on v2:172.21.15.70:6836/2780036414 2024-08-31T05:31:33.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.383+0000 7f20c5614640 1 --2- 172.21.15.5:0/2033549042 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55c40510d9f0 0x55c405511c50 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=aa135b96917938a6 server_cookie=970ea63f2950f359 in_seq=0 out_seq=0 2024-08-31T05:31:33.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.384+0000 7f20a57fa640 1 -- 172.21.15.5:0/2033549042 <== mds.2 v2:172.21.15.70:6836/2780036414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c40546d5d0 con 0x55c40510d9f0 2024-08-31T05:31:33.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.384+0000 7f20a57fa640 10 client.15993 handle_command_reply: tid=0 2024-08-31T05:31:33.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.384+0000 7f20ce5ee740 1 client.15993 shutdown 2024-08-31T05:31:33.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.385+0000 7f20ce5ee740 1 -- 172.21.15.5:0/2033549042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c40514f070 msgr2=0x55c40550bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:33.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.385+0000 7f20ce5ee740 1 --2- 172.21.15.5:0/2033549042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c40514f070 0x55c40550bd80 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f20b8005ef0 tx=0x7f20b8005180 comp rx=0 tx=0).stop 2024-08-31T05:31:33.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.385+0000 7f20ce5ee740 1 -- 172.21.15.5:0/2033549042 shutdown_connections 2024-08-31T05:31:33.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.385+0000 7f20ce5ee740 1 --2- 172.21.15.5:0/2033549042 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55c40510d9f0 0x55c405511c50 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:33.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.385+0000 7f20ce5ee740 1 --2- 172.21.15.5:0/2033549042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c40514f070 0x55c40550bd80 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:33.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.385+0000 7f20ce5ee740 1 --2- 172.21.15.5:0/2033549042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c40512e390 0x55c405500090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:33.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.385+0000 7f20a57fa640 0 client.15993 ms_handle_reset on v2:172.21.15.70:6836/2780036414 2024-08-31T05:31:33.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.385+0000 7f20ce5ee740 1 --2- 172.21.15.5:0/2033549042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4051261b0 0x55c4054ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:33.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.385+0000 7f20ce5ee740 1 -- 172.21.15.5:0/2033549042 >> 172.21.15.5:0/2033549042 conn(0x55c405143460 msgr2=0x55c4054f74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:33.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.385+0000 7f20ce5ee740 1 -- 172.21.15.5:0/2033549042 shutdown_connections 2024-08-31T05:31:33.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.385+0000 7f20ce5ee740 1 -- 172.21.15.5:0/2033549042 wait complete. 2024-08-31T05:31:33.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.385+0000 7f20ce5ee740 20 client.15993 trim_cache size 0 max 16384 2024-08-31T05:31:33.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.399+0000 7f20ce5ee740 1 Processor -- start 2024-08-31T05:31:33.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.399+0000 7f20ce5ee740 1 -- start start 2024-08-31T05:31:33.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.399+0000 7f20ce5ee740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c40510d9f0 0x55c405501740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:33.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.399+0000 7f20ce5ee740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4051261b0 0x55c4054fcd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:33.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.399+0000 7f20ce5ee740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c40512e390 0x55c4054fd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:33.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.399+0000 7f20ce5ee740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f20c01b2e80 con 0x55c40512e390 2024-08-31T05:31:33.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.399+0000 7f20ce5ee740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f20c01b4a80 con 0x55c40510d9f0 2024-08-31T05:31:33.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.399+0000 7f20ce5ee740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f20c01b3550 con 0x55c4051261b0 2024-08-31T05:31:33.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.400+0000 7f20c5614640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4051261b0 0x55c4054fcd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:33.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.400+0000 7f20c6616640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c40512e390 0x55c4054fd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:33.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.400+0000 7f20c5614640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4051261b0 0x55c4054fcd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:54384/0 (socket says 172.21.15.5:54384) 2024-08-31T05:31:33.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.400+0000 7f20c6616640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c40512e390 0x55c4054fd240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39926/0 (socket says 172.21.15.5:39926) 2024-08-31T05:31:33.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.400+0000 7f20c5614640 1 -- 172.21.15.5:0/1601445824 learned_addr learned my addr 172.21.15.5:0/1601445824 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:33.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.400+0000 7f20c6616640 1 --2- 172.21.15.5:0/1601445824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c40510d9f0 0x55c405501740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:33.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.400+0000 7f20c5614640 1 -- 172.21.15.5:0/1601445824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c40510d9f0 msgr2=0x55c405501740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:33.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.400+0000 7f20c5614640 1 --2- 172.21.15.5:0/1601445824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c40510d9f0 0x55c405501740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:33.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.400+0000 7f20c5614640 1 -- 172.21.15.5:0/1601445824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c40512e390 msgr2=0x55c4054fd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:33.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.400+0000 7f20c5614640 1 --2- 172.21.15.5:0/1601445824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c40512e390 0x55c4054fd240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:33.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.400+0000 7f20c5614640 1 -- 172.21.15.5:0/1601445824 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4054f2e00 con 0x55c4051261b0 2024-08-31T05:31:33.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.400+0000 7f20c5614640 1 --2- 172.21.15.5:0/1601445824 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4051261b0 0x55c4054fcd00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f20b4012790 tx=0x7f20b4005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8bfd7954ac5dab10 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:33.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.400+0000 7f20a77fe640 1 -- 172.21.15.5:0/1601445824 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b4004050 con 0x55c4051261b0 2024-08-31T05:31:33.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.400+0000 7f20a77fe640 1 -- 172.21.15.5:0/1601445824 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20b400fd50 con 0x55c4051261b0 2024-08-31T05:31:33.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.400+0000 7f20a77fe640 1 -- 172.21.15.5:0/1601445824 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b4005580 con 0x55c4051261b0 2024-08-31T05:31:33.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.401+0000 7f20ce5ee740 1 -- 172.21.15.5:0/1601445824 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4051261b0 msgr2=0x55c4054fcd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:33.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.401+0000 7f20ce5ee740 1 --2- 172.21.15.5:0/1601445824 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4051261b0 0x55c4054fcd00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f20b4012790 tx=0x7f20b4005f90 comp rx=0 tx=0).stop 2024-08-31T05:31:33.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.401+0000 7f20ce5ee740 1 -- 172.21.15.5:0/1601445824 shutdown_connections 2024-08-31T05:31:33.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.401+0000 7f20ce5ee740 1 --2- 172.21.15.5:0/1601445824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c40512e390 0x55c4054fd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:33.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.401+0000 7f20ce5ee740 1 --2- 172.21.15.5:0/1601445824 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4051261b0 0x55c4054fcd00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:33.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.401+0000 7f20ce5ee740 1 --2- 172.21.15.5:0/1601445824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c40510d9f0 0x55c405501740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:33.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.401+0000 7f20ce5ee740 1 -- 172.21.15.5:0/1601445824 >> 172.21.15.5:0/1601445824 conn(0x55c405143460 msgr2=0x55c405501030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:33.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.401+0000 7f20ce5ee740 1 -- 172.21.15.5:0/1601445824 shutdown_connections 2024-08-31T05:31:33.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.401+0000 7f20ce5ee740 1 -- 172.21.15.5:0/1601445824 wait complete. 2024-08-31T05:31:33.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.402+0000 7f20ce5ee740 1 -- start start 2024-08-31T05:31:33.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.402+0000 7f20ce5ee740 1 Processor -- start 2024-08-31T05:31:33.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.402+0000 7f20ce5ee740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c40510d9f0 0x55c405514ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:33.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.402+0000 7f20ce5ee740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4051261b0 0x55c4055150c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:33.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.402+0000 7f20ce5ee740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c40512e390 0x55c405571600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:33.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.402+0000 7f20ce5ee740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f20c01b42f0 con 0x55c40512e390 2024-08-31T05:31:33.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.402+0000 7f20ce5ee740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f20c01b3c20 con 0x55c40510d9f0 2024-08-31T05:31:33.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.402+0000 7f20ce5ee740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f20c01b0e60 con 0x55c4051261b0 2024-08-31T05:31:33.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.403+0000 7f20ce5ee740 10 client.0 _ll_register_callbacks cb 0x7f20b4009570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:31:33.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.403+0000 7f20c6616640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c40510d9f0 0x55c405514ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:33.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.403+0000 7f20c6616640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c40512e390 0x55c405571600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:33.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.403+0000 7f20c5614640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4051261b0 0x55c4055150c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:33.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.403+0000 7f20c5614640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4051261b0 0x55c4055150c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:54392/0 (socket says 172.21.15.5:54392) 2024-08-31T05:31:33.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.403+0000 7f20c6616640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c40512e390 0x55c405571600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39934/0 (socket says 172.21.15.5:39934) 2024-08-31T05:31:33.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.403+0000 7f20c5614640 1 -- 172.21.15.5:0/666149078 learned_addr learned my addr 172.21.15.5:0/666149078 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:33.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.403+0000 7f20c6616640 1 -- 172.21.15.5:0/666149078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4051261b0 msgr2=0x55c4055150c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:33.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.403+0000 7f20c6616640 1 --2- 172.21.15.5:0/666149078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4051261b0 0x55c4055150c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:33.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.403+0000 7f20c6616640 1 -- 172.21.15.5:0/666149078 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c40510d9f0 msgr2=0x55c405514ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:33.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.403+0000 7f20c6616640 1 --2- 172.21.15.5:0/666149078 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c40510d9f0 0x55c405514ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:33.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.403+0000 7f20c6616640 1 -- 172.21.15.5:0/666149078 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c405571c70 con 0x55c40512e390 2024-08-31T05:31:33.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.403+0000 7f20c5614640 1 --2- 172.21.15.5:0/666149078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4051261b0 0x55c4055150c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:31:33.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.403+0000 7f20c6616640 1 --2- 172.21.15.5:0/666149078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c40512e390 0x55c405571600 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f20b8004c30 tx=0x7f20b8031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c351caa6505aded2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:33.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.403+0000 7f20a57fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:31:33.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.403+0000 7f20a57fa640 1 -- 172.21.15.5:0/666149078 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b8035030 con 0x55c40512e390 2024-08-31T05:31:33.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.403+0000 7f20a57fa640 1 -- 172.21.15.5:0/666149078 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f20b8005400 con 0x55c40512e390 2024-08-31T05:31:33.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.403+0000 7f20ce5ee740 1 -- 172.21.15.5:0/666149078 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20b400fd50 con 0x55c40512e390 2024-08-31T05:31:33.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.404+0000 7f20a57fa640 1 -- 172.21.15.5:0/666149078 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f20b8005600 con 0x55c40512e390 2024-08-31T05:31:33.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.404+0000 7f20ce5ee740 10 client.15999 fetch_fsmap learned FSMap version 32 2024-08-31T05:31:33.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.404+0000 7f20ce5ee740 1 -- 172.21.15.5:0/666149078 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55c40557c2a0 con 0x55c40512e390 2024-08-31T05:31:33.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.404+0000 7f20a57fa640 1 -- 172.21.15.5:0/666149078 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20b400fd50 con 0x55c40512e390 2024-08-31T05:31:33.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.404+0000 7f20a57fa640 1 -- 172.21.15.5:0/666149078 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f20b80038a0 con 0x55c40512e390 2024-08-31T05:31:33.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.404+0000 7f20ce5ee740 10 client.15999 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:31:33.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.404+0000 7f20ce5ee740 10 client.15999 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-31T05:31:33.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.404+0000 7f20ce5ee740 20 client.15999 populate_metadata read hostname 'smithi005' 2024-08-31T05:31:33.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.404+0000 7f20ce5ee740 1 --2- 172.21.15.5:0/666149078 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55c40514f070 0x55c40557e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:33.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.404+0000 7f20ce5ee740 4 client.15999 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:31:33.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.404+0000 7f20ce5ee740 1 -- 172.21.15.5:0/666149078 --> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c405469070 con 0x55c40514f070 2024-08-31T05:31:33.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.404+0000 7f20c5614640 1 --2- 172.21.15.5:0/666149078 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55c40514f070 0x55c40557e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:33.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.405+0000 7f20a57fa640 10 client.15999 ms_handle_connect on v2:172.21.15.70:6836/2780036414 2024-08-31T05:31:33.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.405+0000 7f20c5614640 1 --2- 172.21.15.5:0/666149078 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55c40514f070 0x55c40557e6b0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c9834939ee6f37f5 server_cookie=f28b26b3510a521 in_seq=0 out_seq=0 2024-08-31T05:31:33.413 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:31:33 smithi050 ceph-mon[22146]: pgmap v392: 129 pgs: 129 active+clean; 20 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 814 KiB/s rd, 1.5 MiB/s wr, 241 op/s 2024-08-31T05:31:33.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.406+0000 7f20a57fa640 1 -- 172.21.15.5:0/666149078 <== mds.2 v2:172.21.15.70:6836/2780036414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c405469070 con 0x55c40514f070 2024-08-31T05:31:33.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.406+0000 7f20a57fa640 10 client.15999 handle_command_reply: tid=0 2024-08-31T05:31:33.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.406+0000 7f20ce5ee740 1 client.15999 shutdown 2024-08-31T05:31:33.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.406+0000 7f20ce5ee740 1 -- 172.21.15.5:0/666149078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c40512e390 msgr2=0x55c405571600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:33.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.406+0000 7f20ce5ee740 1 --2- 172.21.15.5:0/666149078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c40512e390 0x55c405571600 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f20b8004c30 tx=0x7f20b8031400 comp rx=0 tx=0).stop 2024-08-31T05:31:33.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.406+0000 7f20ce5ee740 1 -- 172.21.15.5:0/666149078 shutdown_connections 2024-08-31T05:31:33.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.406+0000 7f20ce5ee740 1 --2- 172.21.15.5:0/666149078 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55c40514f070 0x55c40557e6b0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:33.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.406+0000 7f20ce5ee740 1 --2- 172.21.15.5:0/666149078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c40512e390 0x55c405571600 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:33.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.406+0000 7f20ce5ee740 1 --2- 172.21.15.5:0/666149078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4051261b0 0x55c4055150c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:33.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.406+0000 7f20a57fa640 0 client.15999 ms_handle_reset on v2:172.21.15.70:6836/2780036414 2024-08-31T05:31:33.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.406+0000 7f20ce5ee740 1 --2- 172.21.15.5:0/666149078 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c40510d9f0 0x55c405514ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:33.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.406+0000 7f20ce5ee740 1 -- 172.21.15.5:0/666149078 >> 172.21.15.5:0/666149078 conn(0x55c405143460 msgr2=0x55c4054f7ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:33.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.407+0000 7f20ce5ee740 1 -- 172.21.15.5:0/666149078 shutdown_connections 2024-08-31T05:31:33.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.407+0000 7f20ce5ee740 1 -- 172.21.15.5:0/666149078 wait complete. 2024-08-31T05:31:33.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.407+0000 7f20ce5ee740 20 client.15999 trim_cache size 0 max 16384 2024-08-31T05:31:33.415 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:31:33.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.407+0000 7f20c8079640 1 -- 172.21.15.5:0/4251087229 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f20a80b4ca0 msgr2=0x7f20a80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:33.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.407+0000 7f20c8079640 1 --2- 172.21.15.5:0/4251087229 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f20a80b4ca0 0x7f20a80b71b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f20b00e3420 tx=0x7f20b00e9af0 comp rx=0 tx=0).stop 2024-08-31T05:31:33.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.407+0000 7f20c8079640 1 -- 172.21.15.5:0/4251087229 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20c0102370 msgr2=0x7f20c019c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:33.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.407+0000 7f20c8079640 1 --2- 172.21.15.5:0/4251087229 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20c0102370 0x7f20c019c3e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f20b0009d50 tx=0x7f20b000c6a0 comp rx=0 tx=0).stop 2024-08-31T05:31:33.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.407+0000 7f20c8079640 1 -- 172.21.15.5:0/4251087229 shutdown_connections 2024-08-31T05:31:33.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.407+0000 7f20c8079640 1 --2- 172.21.15.5:0/4251087229 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f20a80b4ca0 0x7f20a80b71b0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:33.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.407+0000 7f20c8079640 1 --2- 172.21.15.5:0/4251087229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20c010ff20 0x7f20c01a1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:33.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.407+0000 7f20c8079640 1 --2- 172.21.15.5:0/4251087229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f20c0102cc0 0x7f20c019c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:33.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.407+0000 7f20c8079640 1 --2- 172.21.15.5:0/4251087229 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20c0102370 0x7f20c019c3e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:33.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.407+0000 7f20c8079640 1 -- 172.21.15.5:0/4251087229 >> 172.21.15.5:0/4251087229 conn(0x7f20c00794d0 msgr2=0x7f20c0108a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:33.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.407+0000 7f20c8079640 1 -- 172.21.15.5:0/4251087229 shutdown_connections 2024-08-31T05:31:33.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:33.407+0000 7f20c8079640 1 -- 172.21.15.5:0/4251087229 wait complete. 2024-08-31T05:31:33.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:31:33 smithi070 ceph-mon[22316]: pgmap v392: 129 pgs: 129 active+clean; 20 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 814 KiB/s rd, 1.5 MiB/s wr, 241 op/s 2024-08-31T05:31:33.908 INFO:tasks.workunit.client.0.smithi005.stdout: 1 59088 15.89 MB/sec warmup 21 sec latency 22.892 ms 2024-08-31T05:31:34.174 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T05:31:34.432 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:31:34.908 INFO:tasks.workunit.client.0.smithi005.stdout: 1 61464 15.82 MB/sec warmup 22 sec latency 17.666 ms 2024-08-31T05:31:34.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.945+0000 7f9c4cbb5640 1 -- 172.21.15.5:0/2339273745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c48108140 msgr2=0x7f9c48108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:34.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.945+0000 7f9c4cbb5640 1 --2- 172.21.15.5:0/2339273745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c48108140 0x7f9c48108550 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c009900 tx=0x7f9c3c02a410 comp rx=0 tx=0).stop 2024-08-31T05:31:34.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.945+0000 7f9c4cbb5640 1 -- 172.21.15.5:0/2339273745 shutdown_connections 2024-08-31T05:31:34.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.945+0000 7f9c4cbb5640 1 --2- 172.21.15.5:0/2339273745 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9c48108a90 0x7f9c4810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:34.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.945+0000 7f9c4cbb5640 1 --2- 172.21.15.5:0/2339273745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c48108140 0x7f9c48108550 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:34.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.945+0000 7f9c4cbb5640 1 --2- 172.21.15.5:0/2339273745 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c48102800 0x7f9c48102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:34.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.945+0000 7f9c4cbb5640 1 -- 172.21.15.5:0/2339273745 >> 172.21.15.5:0/2339273745 conn(0x7f9c480794d0 msgr2=0x7f9c480798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:34.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.945+0000 7f9c4cbb5640 1 -- 172.21.15.5:0/2339273745 shutdown_connections 2024-08-31T05:31:34.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.945+0000 7f9c4cbb5640 1 -- 172.21.15.5:0/2339273745 wait complete. 2024-08-31T05:31:34.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.946+0000 7f9c4cbb5640 1 Processor -- start 2024-08-31T05:31:34.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.946+0000 7f9c4cbb5640 1 -- start start 2024-08-31T05:31:34.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.947+0000 7f9c4cbb5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c48102800 0x7f9c48104e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:34.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.947+0000 7f9c4cbb5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9c48108140 0x7f9c48105380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:34.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.947+0000 7f9c4cbb5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c48108a90 0x7f9c481058c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:34.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.947+0000 7f9c4cbb5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9c481126e0 con 0x7f9c48102800 2024-08-31T05:31:34.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.947+0000 7f9c4cbb5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9c48112560 con 0x7f9c48108a90 2024-08-31T05:31:34.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.947+0000 7f9c4cbb5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9c48112860 con 0x7f9c48108140 2024-08-31T05:31:34.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.947+0000 7f9c4659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c48102800 0x7f9c48104e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:34.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.947+0000 7f9c4659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c48102800 0x7f9c48104e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39956/0 (socket says 172.21.15.5:39956) 2024-08-31T05:31:34.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.947+0000 7f9c4659c640 1 -- 172.21.15.5:0/985753345 learned_addr learned my addr 172.21.15.5:0/985753345 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:34.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.947+0000 7f9c45d9b640 1 --2- 172.21.15.5:0/985753345 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9c48108140 0x7f9c48105380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:34.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.947+0000 7f9c46d9d640 1 --2- 172.21.15.5:0/985753345 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c48108a90 0x7f9c481058c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:34.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.947+0000 7f9c4659c640 1 -- 172.21.15.5:0/985753345 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9c48108140 msgr2=0x7f9c48105380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:34.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.947+0000 7f9c4659c640 1 --2- 172.21.15.5:0/985753345 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9c48108140 0x7f9c48105380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:34.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.947+0000 7f9c4659c640 1 -- 172.21.15.5:0/985753345 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c48108a90 msgr2=0x7f9c481058c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:34.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.947+0000 7f9c4659c640 1 --2- 172.21.15.5:0/985753345 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c48108a90 0x7f9c481058c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:34.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.947+0000 7f9c4659c640 1 -- 172.21.15.5:0/985753345 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c481a8520 con 0x7f9c48102800 2024-08-31T05:31:34.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.947+0000 7f9c46d9d640 1 --2- 172.21.15.5:0/985753345 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c48108a90 0x7f9c481058c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:31:34.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.948+0000 7f9c4659c640 1 --2- 172.21.15.5:0/985753345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c48102800 0x7f9c48104e40 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f9c3800ea20 tx=0x7f9c3800eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:34.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.948+0000 7f9c377fe640 1 -- 172.21.15.5:0/985753345 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c3800cd80 con 0x7f9c48102800 2024-08-31T05:31:34.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.948+0000 7f9c377fe640 1 -- 172.21.15.5:0/985753345 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c380108e0 con 0x7f9c48102800 2024-08-31T05:31:34.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.948+0000 7f9c4cbb5640 1 -- 172.21.15.5:0/985753345 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c481a8810 con 0x7f9c48102800 2024-08-31T05:31:34.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.948+0000 7f9c377fe640 1 -- 172.21.15.5:0/985753345 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c38018840 con 0x7f9c48102800 2024-08-31T05:31:34.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.948+0000 7f9c4cbb5640 1 -- 172.21.15.5:0/985753345 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c481a8d70 con 0x7f9c48102800 2024-08-31T05:31:34.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.951+0000 7f9c5312a740 1 Processor -- start 2024-08-31T05:31:34.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.951+0000 7f9c377fe640 1 -- 172.21.15.5:0/985753345 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f9c38010430 con 0x7f9c48102800 2024-08-31T05:31:34.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.951+0000 7f9c5312a740 1 -- start start 2024-08-31T05:31:34.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.952+0000 7f9c5312a740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565314be2070 0x565314f87310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:34.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.952+0000 7f9c5312a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565314bb91b0 0x565314f87850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:34.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.952+0000 7f9c5312a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565314bc1390 0x565314f87d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:34.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.952+0000 7f9c5312a740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x565314efe680 con 0x565314be2070 2024-08-31T05:31:34.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.952+0000 7f9c5312a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x565314eedc10 con 0x565314bb91b0 2024-08-31T05:31:34.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.952+0000 7f9c5312a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x565314ef1bc0 con 0x565314bc1390 2024-08-31T05:31:34.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.952+0000 7f9c46d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565314be2070 0x565314f87310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:34.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.952+0000 7f9c46d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565314be2070 0x565314f87310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39960/0 (socket says 172.21.15.5:39960) 2024-08-31T05:31:34.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.952+0000 7f9c46d9d640 1 -- 172.21.15.5:0/554805382 learned_addr learned my addr 172.21.15.5:0/554805382 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:34.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.952+0000 7f9c45d9b640 1 --2- 172.21.15.5:0/554805382 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565314bc1390 0x565314f87d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:34.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.952+0000 7f9c4659c640 1 --2- 172.21.15.5:0/554805382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565314bb91b0 0x565314f87850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:34.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.952+0000 7f9c46d9d640 1 -- 172.21.15.5:0/554805382 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565314bc1390 msgr2=0x565314f87d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:34.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.952+0000 7f9c377fe640 1 --2- 172.21.15.5:0/985753345 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9c300b4d20 0x7f9c300b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:34.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.952+0000 7f9c46d9d640 1 --2- 172.21.15.5:0/554805382 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565314bc1390 0x565314f87d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:34.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.952+0000 7f9c46d9d640 1 -- 172.21.15.5:0/554805382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565314bb91b0 msgr2=0x565314f87850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:34.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.952+0000 7f9c46d9d640 1 --2- 172.21.15.5:0/554805382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565314bb91b0 0x565314f87850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:34.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.952+0000 7f9c46d9d640 1 -- 172.21.15.5:0/554805382 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565314c4d650 con 0x565314be2070 2024-08-31T05:31:34.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.952+0000 7f9c4659c640 1 --2- 172.21.15.5:0/554805382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565314bb91b0 0x565314f87850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:31:34.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.953+0000 7f9c46d9d640 1 --2- 172.21.15.5:0/985753345 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9c300b4d20 0x7f9c300b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:34.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.953+0000 7f9c377fe640 1 -- 172.21.15.5:0/985753345 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f9c380e5b40 con 0x7f9c48102800 2024-08-31T05:31:34.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.953+0000 7f9c46d9d640 1 --2- 172.21.15.5:0/554805382 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565314be2070 0x565314f87310 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f9c40011790 tx=0x7f9c40011c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f8f05c50f4c8016 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:34.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.953+0000 7f9c34ff9640 1 -- 172.21.15.5:0/554805382 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c4000f9a0 con 0x565314be2070 2024-08-31T05:31:34.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.953+0000 7f9c34ff9640 1 -- 172.21.15.5:0/554805382 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c4000fc80 con 0x565314be2070 2024-08-31T05:31:34.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.953+0000 7f9c34ff9640 1 -- 172.21.15.5:0/554805382 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c4001cab0 con 0x565314be2070 2024-08-31T05:31:34.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.954+0000 7f9c5312a740 1 -- 172.21.15.5:0/554805382 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565314be2070 msgr2=0x565314f87310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:34.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.954+0000 7f9c46d9d640 1 --2- 172.21.15.5:0/985753345 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9c300b4d20 0x7f9c300b7230 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9c40020000 tx=0x7f9c40021000 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:34.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.954+0000 7f9c5312a740 1 --2- 172.21.15.5:0/554805382 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565314be2070 0x565314f87310 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f9c40011790 tx=0x7f9c40011c50 comp rx=0 tx=0).stop 2024-08-31T05:31:34.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.954+0000 7f9c5312a740 1 -- 172.21.15.5:0/554805382 shutdown_connections 2024-08-31T05:31:34.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.954+0000 7f9c5312a740 1 --2- 172.21.15.5:0/554805382 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565314bc1390 0x565314f87d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:34.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.954+0000 7f9c5312a740 1 --2- 172.21.15.5:0/554805382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565314bb91b0 0x565314f87850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:34.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.954+0000 7f9c5312a740 1 --2- 172.21.15.5:0/554805382 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565314be2070 0x565314f87310 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:34.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.954+0000 7f9c5312a740 1 -- 172.21.15.5:0/554805382 >> 172.21.15.5:0/554805382 conn(0x565314bd6460 msgr2=0x565314f85200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:34.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.954+0000 7f9c5312a740 1 -- 172.21.15.5:0/554805382 shutdown_connections 2024-08-31T05:31:34.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.954+0000 7f9c5312a740 1 -- 172.21.15.5:0/554805382 wait complete. 2024-08-31T05:31:34.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.954+0000 7f9c5312a740 1 -- start start 2024-08-31T05:31:34.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.955+0000 7f9c5312a740 1 Processor -- start 2024-08-31T05:31:34.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.955+0000 7f9c5312a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565314bb91b0 0x565314f92ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:34.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.955+0000 7f9c5312a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565314bc1390 0x565314f93000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:34.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.955+0000 7f9c5312a740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565314be2070 0x565314f9ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:34.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.955+0000 7f9c5312a740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x565314d50700 con 0x565314be2070 2024-08-31T05:31:34.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.955+0000 7f9c5312a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x565314e74750 con 0x565314bb91b0 2024-08-31T05:31:34.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.955+0000 7f9c5312a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x565314f95af0 con 0x565314bc1390 2024-08-31T05:31:34.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.955+0000 7f9c5312a740 10 client.0 _ll_register_callbacks cb 0x565314ea3e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:31:34.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.955+0000 7f9c46d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565314be2070 0x565314f9ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:34.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.955+0000 7f9c46d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565314be2070 0x565314f9ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39972/0 (socket says 172.21.15.5:39972) 2024-08-31T05:31:34.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.955+0000 7f9c4659c640 1 --2- 172.21.15.5:0/478624183 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565314bb91b0 0x565314f92ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:34.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.955+0000 7f9c46d9d640 1 -- 172.21.15.5:0/478624183 learned_addr learned my addr 172.21.15.5:0/478624183 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:34.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.955+0000 7f9c45d9b640 1 --2- 172.21.15.5:0/478624183 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565314bc1390 0x565314f93000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:34.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.955+0000 7f9c4659c640 1 -- 172.21.15.5:0/478624183 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565314bc1390 msgr2=0x565314f93000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:34.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.955+0000 7f9c4659c640 1 --2- 172.21.15.5:0/478624183 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565314bc1390 0x565314f93000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:34.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.955+0000 7f9c4659c640 1 -- 172.21.15.5:0/478624183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565314be2070 msgr2=0x565314f9ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:34.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.955+0000 7f9c4659c640 1 --2- 172.21.15.5:0/478624183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565314be2070 0x565314f9ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:34.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.955+0000 7f9c4659c640 1 -- 172.21.15.5:0/478624183 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565314ead900 con 0x565314bb91b0 2024-08-31T05:31:34.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.956+0000 7f9c46d9d640 1 --2- 172.21.15.5:0/478624183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565314be2070 0x565314f9ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:31:34.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.956+0000 7f9c4659c640 1 --2- 172.21.15.5:0/478624183 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565314bb91b0 0x565314f92ac0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9c380e2f10 tx=0x7f9c380ab6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70322f6c1cc7b48c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:34.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.956+0000 7f9c2dffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:31:34.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.956+0000 7f9c2dffb640 1 -- 172.21.15.5:0/478624183 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c380abf60 con 0x565314bb91b0 2024-08-31T05:31:34.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.956+0000 7f9c2dffb640 1 -- 172.21.15.5:0/478624183 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f9c380930e0 con 0x565314bb91b0 2024-08-31T05:31:34.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.956+0000 7f9c5312a740 1 -- 172.21.15.5:0/478624183 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c4000fc80 con 0x565314bb91b0 2024-08-31T05:31:34.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.956+0000 7f9c2dffb640 1 -- 172.21.15.5:0/478624183 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f9c380b0720 con 0x565314bb91b0 2024-08-31T05:31:34.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.956+0000 7f9c5312a740 10 client.25622 fetch_fsmap learned FSMap version 32 2024-08-31T05:31:34.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.956+0000 7f9c5312a740 1 -- 172.21.15.5:0/478624183 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x565314fa18f0 con 0x565314bb91b0 2024-08-31T05:31:34.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.956+0000 7f9c2dffb640 1 -- 172.21.15.5:0/478624183 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c4000fc80 con 0x565314bb91b0 2024-08-31T05:31:34.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.956+0000 7f9c2dffb640 1 -- 172.21.15.5:0/478624183 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f9c380a79f0 con 0x565314bb91b0 2024-08-31T05:31:34.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.956+0000 7f9c5312a740 10 client.25622 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:31:34.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.957+0000 7f9c5312a740 10 client.25622 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-31T05:31:34.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.957+0000 7f9c5312a740 20 client.25622 populate_metadata read hostname 'smithi005' 2024-08-31T05:31:34.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.957+0000 7f9c5312a740 1 --2- 172.21.15.5:0/478624183 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x565314ba09f0 0x565314fa4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:34.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.957+0000 7f9c5312a740 4 client.25622 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:31:34.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.957+0000 7f9c5312a740 1 -- 172.21.15.5:0/478624183 --> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565314f005d0 con 0x565314ba09f0 2024-08-31T05:31:34.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.957+0000 7f9c45d9b640 1 --2- 172.21.15.5:0/478624183 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x565314ba09f0 0x565314fa4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:34.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.957+0000 7f9c2dffb640 10 client.25622 ms_handle_connect on v2:172.21.15.50:6838/98200944 2024-08-31T05:31:34.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.957+0000 7f9c45d9b640 1 --2- 172.21.15.5:0/478624183 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x565314ba09f0 0x565314fa4dc0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=df1592c5865b348e server_cookie=c4537918f71c2619 in_seq=0 out_seq=0 2024-08-31T05:31:34.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.958+0000 7f9c2dffb640 1 -- 172.21.15.5:0/478624183 <== mds.1 v2:172.21.15.50:6838/98200944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x565314f005d0 con 0x565314ba09f0 2024-08-31T05:31:34.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.958+0000 7f9c2dffb640 10 client.25622 handle_command_reply: tid=0 2024-08-31T05:31:34.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.958+0000 7f9c5312a740 1 client.25622 shutdown 2024-08-31T05:31:34.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.958+0000 7f9c5312a740 1 -- 172.21.15.5:0/478624183 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565314bb91b0 msgr2=0x565314f92ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:34.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.958+0000 7f9c5312a740 1 --2- 172.21.15.5:0/478624183 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565314bb91b0 0x565314f92ac0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9c380e2f10 tx=0x7f9c380ab6d0 comp rx=0 tx=0).stop 2024-08-31T05:31:34.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.958+0000 7f9c5312a740 1 -- 172.21.15.5:0/478624183 shutdown_connections 2024-08-31T05:31:34.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.958+0000 7f9c5312a740 1 --2- 172.21.15.5:0/478624183 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x565314ba09f0 0x565314fa4dc0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:34.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.958+0000 7f9c5312a740 1 --2- 172.21.15.5:0/478624183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565314be2070 0x565314f9ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:34.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.958+0000 7f9c5312a740 1 --2- 172.21.15.5:0/478624183 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565314bc1390 0x565314f93000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:34.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.958+0000 7f9c5312a740 1 --2- 172.21.15.5:0/478624183 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565314bb91b0 0x565314f92ac0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:34.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.958+0000 7f9c2dffb640 0 client.25622 ms_handle_reset on v2:172.21.15.50:6838/98200944 2024-08-31T05:31:34.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.958+0000 7f9c5312a740 1 -- 172.21.15.5:0/478624183 >> 172.21.15.5:0/478624183 conn(0x565314bd6460 msgr2=0x565314f8a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:34.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.958+0000 7f9c5312a740 1 -- 172.21.15.5:0/478624183 shutdown_connections 2024-08-31T05:31:34.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.958+0000 7f9c5312a740 1 -- 172.21.15.5:0/478624183 wait complete. 2024-08-31T05:31:34.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.958+0000 7f9c5312a740 20 client.25622 trim_cache size 0 max 16384 2024-08-31T05:31:34.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.973+0000 7f9c5312a740 1 Processor -- start 2024-08-31T05:31:34.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.973+0000 7f9c5312a740 1 -- start start 2024-08-31T05:31:34.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.973+0000 7f9c5312a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565314bb91b0 0x565314f85300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:34.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.973+0000 7f9c5312a740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565314bc1390 0x565314f9ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:34.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.973+0000 7f9c5312a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565314be2070 0x565314f9f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:34.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.973+0000 7f9c5312a740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9c481b2ee0 con 0x565314bc1390 2024-08-31T05:31:34.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.973+0000 7f9c5312a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9c481b4ae0 con 0x565314be2070 2024-08-31T05:31:34.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.973+0000 7f9c5312a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9c481b35b0 con 0x565314bb91b0 2024-08-31T05:31:34.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.973+0000 7f9c4659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565314bb91b0 0x565314f85300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:34.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.973+0000 7f9c4659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565314bb91b0 0x565314f85300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:54446/0 (socket says 172.21.15.5:54446) 2024-08-31T05:31:34.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.973+0000 7f9c4659c640 1 -- 172.21.15.5:0/2685308531 learned_addr learned my addr 172.21.15.5:0/2685308531 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:34.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.973+0000 7f9c45d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565314bc1390 0x565314f9ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:34.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.974+0000 7f9c46d9d640 1 --2- 172.21.15.5:0/2685308531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565314be2070 0x565314f9f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:34.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.974+0000 7f9c4659c640 1 -- 172.21.15.5:0/2685308531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565314be2070 msgr2=0x565314f9f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:34.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.974+0000 7f9c4659c640 1 --2- 172.21.15.5:0/2685308531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565314be2070 0x565314f9f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:34.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.974+0000 7f9c4659c640 1 -- 172.21.15.5:0/2685308531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565314bc1390 msgr2=0x565314f9ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:34.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.974+0000 7f9c4659c640 1 --2- 172.21.15.5:0/2685308531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565314bc1390 0x565314f9ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:34.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.974+0000 7f9c4659c640 1 -- 172.21.15.5:0/2685308531 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565314f93d80 con 0x565314bb91b0 2024-08-31T05:31:34.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.974+0000 7f9c4659c640 1 --2- 172.21.15.5:0/2685308531 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565314bb91b0 0x565314f85300 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9c380a91d0 tx=0x7f9c380a7e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ec123d1d92983f6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:34.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.974+0000 7f9c2ffff640 1 -- 172.21.15.5:0/2685308531 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c38010720 con 0x565314bb91b0 2024-08-31T05:31:34.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.974+0000 7f9c2ffff640 1 -- 172.21.15.5:0/2685308531 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c380aac30 con 0x565314bb91b0 2024-08-31T05:31:34.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.974+0000 7f9c2ffff640 1 -- 172.21.15.5:0/2685308531 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c380a7b30 con 0x565314bb91b0 2024-08-31T05:31:34.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.975+0000 7f9c5312a740 1 -- 172.21.15.5:0/2685308531 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565314bb91b0 msgr2=0x565314f85300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:34.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.975+0000 7f9c5312a740 1 --2- 172.21.15.5:0/2685308531 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565314bb91b0 0x565314f85300 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9c380a91d0 tx=0x7f9c380a7e80 comp rx=0 tx=0).stop 2024-08-31T05:31:34.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.975+0000 7f9c5312a740 1 -- 172.21.15.5:0/2685308531 shutdown_connections 2024-08-31T05:31:34.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.975+0000 7f9c5312a740 1 --2- 172.21.15.5:0/2685308531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565314be2070 0x565314f9f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:34.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.975+0000 7f9c5312a740 1 --2- 172.21.15.5:0/2685308531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565314bc1390 0x565314f9ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:34.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.975+0000 7f9c5312a740 1 --2- 172.21.15.5:0/2685308531 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565314bb91b0 0x565314f85300 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:34.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.975+0000 7f9c5312a740 1 -- 172.21.15.5:0/2685308531 >> 172.21.15.5:0/2685308531 conn(0x565314bd6460 msgr2=0x565314f84bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:34.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.975+0000 7f9c5312a740 1 -- 172.21.15.5:0/2685308531 shutdown_connections 2024-08-31T05:31:34.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.975+0000 7f9c5312a740 1 -- 172.21.15.5:0/2685308531 wait complete. 2024-08-31T05:31:34.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.976+0000 7f9c5312a740 1 -- start start 2024-08-31T05:31:34.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.976+0000 7f9c5312a740 1 Processor -- start 2024-08-31T05:31:34.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.976+0000 7f9c5312a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565314bb91b0 0x565314f97650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:34.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.976+0000 7f9c5312a740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565314bc1390 0x565314f97c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:34.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.976+0000 7f9c5312a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565314be2070 0x565315008730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:34.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.976+0000 7f9c5312a740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9c481b4350 con 0x565314bc1390 2024-08-31T05:31:34.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.976+0000 7f9c5312a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9c481b3c80 con 0x565314be2070 2024-08-31T05:31:34.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.976+0000 7f9c5312a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9c481b0ec0 con 0x565314bb91b0 2024-08-31T05:31:34.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.976+0000 7f9c5312a740 10 client.0 _ll_register_callbacks cb 0x7f9c3800ef50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:31:34.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.976+0000 7f9c45d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565314bc1390 0x565314f97c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:34.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.976+0000 7f9c4659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565314bb91b0 0x565314f97650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:34.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.976+0000 7f9c45d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565314bc1390 0x565314f97c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39984/0 (socket says 172.21.15.5:39984) 2024-08-31T05:31:34.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.976+0000 7f9c45d9b640 1 -- 172.21.15.5:0/961359344 learned_addr learned my addr 172.21.15.5:0/961359344 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:34.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.977+0000 7f9c46d9d640 1 --2- 172.21.15.5:0/961359344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565314be2070 0x565315008730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:34.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.977+0000 7f9c45d9b640 1 -- 172.21.15.5:0/961359344 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565314bb91b0 msgr2=0x565314f97650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:34.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.977+0000 7f9c45d9b640 1 --2- 172.21.15.5:0/961359344 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565314bb91b0 0x565314f97650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:34.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.977+0000 7f9c45d9b640 1 -- 172.21.15.5:0/961359344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565314be2070 msgr2=0x565315008730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:34.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.977+0000 7f9c45d9b640 1 --2- 172.21.15.5:0/961359344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565314be2070 0x565315008730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:34.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.977+0000 7f9c45d9b640 1 -- 172.21.15.5:0/961359344 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565315008da0 con 0x565314bc1390 2024-08-31T05:31:34.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.977+0000 7f9c4659c640 1 --2- 172.21.15.5:0/961359344 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565314bb91b0 0x565314f97650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:31:34.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.977+0000 7f9c46d9d640 1 --2- 172.21.15.5:0/961359344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565314be2070 0x565315008730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:31:34.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.977+0000 7f9c45d9b640 1 --2- 172.21.15.5:0/961359344 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565314bc1390 0x565314f97c30 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c005940 tx=0x7f9c3c032f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8d4040e6b606910 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:34.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.977+0000 7f9c2dffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:31:34.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.977+0000 7f9c2dffb640 1 -- 172.21.15.5:0/961359344 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c035040 con 0x565314bc1390 2024-08-31T05:31:34.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.977+0000 7f9c2dffb640 1 -- 172.21.15.5:0/961359344 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f9c3c005040 con 0x565314bc1390 2024-08-31T05:31:34.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.977+0000 7f9c5312a740 1 -- 172.21.15.5:0/961359344 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c380aac30 con 0x565314bc1390 2024-08-31T05:31:34.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.977+0000 7f9c2dffb640 1 -- 172.21.15.5:0/961359344 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f9c3c056050 con 0x565314bc1390 2024-08-31T05:31:34.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.977+0000 7f9c5312a740 10 client.16017 fetch_fsmap learned FSMap version 32 2024-08-31T05:31:34.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.977+0000 7f9c5312a740 1 -- 172.21.15.5:0/961359344 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x565315010150 con 0x565314bc1390 2024-08-31T05:31:34.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.977+0000 7f9c2dffb640 1 -- 172.21.15.5:0/961359344 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c380aac30 con 0x565314bc1390 2024-08-31T05:31:34.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.978+0000 7f9c2dffb640 1 -- 172.21.15.5:0/961359344 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f9c3c0035f0 con 0x565314bc1390 2024-08-31T05:31:34.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.978+0000 7f9c5312a740 10 client.16017 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:31:34.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.978+0000 7f9c5312a740 10 client.16017 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-31T05:31:34.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.978+0000 7f9c5312a740 20 client.16017 populate_metadata read hostname 'smithi005' 2024-08-31T05:31:34.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.978+0000 7f9c5312a740 1 --2- 172.21.15.5:0/961359344 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x565314b75da0 0x565315012940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:34.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.978+0000 7f9c5312a740 4 client.16017 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:31:34.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.978+0000 7f9c5312a740 1 -- 172.21.15.5:0/961359344 --> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] -- command(tid 0: {"prefix": "damage ls"}) -- 0x565314efc070 con 0x565314b75da0 2024-08-31T05:31:34.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.978+0000 7f9c4659c640 1 --2- 172.21.15.5:0/961359344 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x565314b75da0 0x565315012940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:34.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.978+0000 7f9c4659c640 1 --2- 172.21.15.5:0/961359344 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x565314b75da0 0x565315012940 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=74946ba2a5fd044c server_cookie=ed4e8cf84adbaee3 in_seq=0 out_seq=0 2024-08-31T05:31:34.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.978+0000 7f9c2dffb640 10 client.16017 ms_handle_connect on v2:172.21.15.50:6838/98200944 2024-08-31T05:31:34.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.979+0000 7f9c2dffb640 1 -- 172.21.15.5:0/961359344 <== mds.1 v2:172.21.15.50:6838/98200944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x565314efc070 con 0x565314b75da0 2024-08-31T05:31:34.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.979+0000 7f9c2dffb640 10 client.16017 handle_command_reply: tid=0 2024-08-31T05:31:34.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.979+0000 7f9c5312a740 1 client.16017 shutdown 2024-08-31T05:31:34.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.979+0000 7f9c5312a740 1 -- 172.21.15.5:0/961359344 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565314bc1390 msgr2=0x565314f97c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:34.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.979+0000 7f9c5312a740 1 --2- 172.21.15.5:0/961359344 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565314bc1390 0x565314f97c30 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c005940 tx=0x7f9c3c032f90 comp rx=0 tx=0).stop 2024-08-31T05:31:34.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.979+0000 7f9c5312a740 1 -- 172.21.15.5:0/961359344 shutdown_connections 2024-08-31T05:31:34.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.979+0000 7f9c5312a740 1 --2- 172.21.15.5:0/961359344 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x565314b75da0 0x565315012940 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:34.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.979+0000 7f9c5312a740 1 --2- 172.21.15.5:0/961359344 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565314be2070 0x565315008730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:34.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.979+0000 7f9c5312a740 1 --2- 172.21.15.5:0/961359344 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565314bc1390 0x565314f97c30 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:34.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.979+0000 7f9c5312a740 1 --2- 172.21.15.5:0/961359344 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565314bb91b0 0x565314f97650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:34.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.979+0000 7f9c2dffb640 0 client.16017 ms_handle_reset on v2:172.21.15.50:6838/98200944 2024-08-31T05:31:34.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.979+0000 7f9c5312a740 1 -- 172.21.15.5:0/961359344 >> 172.21.15.5:0/961359344 conn(0x565314bd6460 msgr2=0x565314f90f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:34.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.979+0000 7f9c5312a740 1 -- 172.21.15.5:0/961359344 shutdown_connections 2024-08-31T05:31:34.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.979+0000 7f9c5312a740 1 -- 172.21.15.5:0/961359344 wait complete. 2024-08-31T05:31:34.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.979+0000 7f9c5312a740 20 client.16017 trim_cache size 0 max 16384 2024-08-31T05:31:34.987 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:31:34.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.980+0000 7f9c4cbb5640 1 -- 172.21.15.5:0/985753345 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9c300b4d20 msgr2=0x7f9c300b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:34.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.980+0000 7f9c4cbb5640 1 --2- 172.21.15.5:0/985753345 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9c300b4d20 0x7f9c300b7230 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9c40020000 tx=0x7f9c40021000 comp rx=0 tx=0).stop 2024-08-31T05:31:34.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.980+0000 7f9c4cbb5640 1 -- 172.21.15.5:0/985753345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c48102800 msgr2=0x7f9c48104e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:34.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.980+0000 7f9c4cbb5640 1 --2- 172.21.15.5:0/985753345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c48102800 0x7f9c48104e40 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f9c3800ea20 tx=0x7f9c3800eee0 comp rx=0 tx=0).stop 2024-08-31T05:31:34.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.980+0000 7f9c4cbb5640 1 -- 172.21.15.5:0/985753345 shutdown_connections 2024-08-31T05:31:34.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.980+0000 7f9c4cbb5640 1 --2- 172.21.15.5:0/985753345 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9c300b4d20 0x7f9c300b7230 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:34.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.980+0000 7f9c4cbb5640 1 --2- 172.21.15.5:0/985753345 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c48108a90 0x7f9c481058c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:34.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.980+0000 7f9c4cbb5640 1 --2- 172.21.15.5:0/985753345 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9c48108140 0x7f9c48105380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:34.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.980+0000 7f9c4cbb5640 1 --2- 172.21.15.5:0/985753345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c48102800 0x7f9c48104e40 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:34.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.980+0000 7f9c4cbb5640 1 -- 172.21.15.5:0/985753345 >> 172.21.15.5:0/985753345 conn(0x7f9c480794d0 msgr2=0x7f9c4806af90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:34.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.980+0000 7f9c4cbb5640 1 -- 172.21.15.5:0/985753345 shutdown_connections 2024-08-31T05:31:34.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:34.980+0000 7f9c4cbb5640 1 -- 172.21.15.5:0/985753345 wait complete. 2024-08-31T05:31:35.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:31:35 smithi050 ceph-mon[22146]: pgmap v393: 129 pgs: 129 active+clean; 21 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 1.5 MiB/s wr, 242 op/s 2024-08-31T05:31:35.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:31:35 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:31:35.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:31:35 smithi005 ceph-mon[18602]: pgmap v393: 129 pgs: 129 active+clean; 21 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 1.5 MiB/s wr, 242 op/s 2024-08-31T05:31:35.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:31:35 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:31:35.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:31:35 smithi070 ceph-mon[22316]: pgmap v393: 129 pgs: 129 active+clean; 21 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 1.5 MiB/s wr, 242 op/s 2024-08-31T05:31:35.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:31:35 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:31:35.908 INFO:tasks.workunit.client.0.smithi005.stdout: 1 64327 15.88 MB/sec warmup 23 sec latency 16.784 ms 2024-08-31T05:31:36.385 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T05:31:36.677 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:31:36.908 INFO:tasks.workunit.client.0.smithi005.stdout: 1 67563 15.96 MB/sec warmup 24 sec latency 10.110 ms 2024-08-31T05:31:37.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:31:37 smithi050 ceph-mon[22146]: pgmap v394: 129 pgs: 129 active+clean; 24 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 985 KiB/s rd, 1.9 MiB/s wr, 283 op/s 2024-08-31T05:31:37.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:31:37 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:31:37.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:31:37 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:31:37.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:31:37 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:31:37.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:31:37 smithi005 ceph-mon[18602]: pgmap v394: 129 pgs: 129 active+clean; 24 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 985 KiB/s rd, 1.9 MiB/s wr, 283 op/s 2024-08-31T05:31:37.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:31:37 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:31:37.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:31:37 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:31:37.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:31:37 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:31:37.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:31:37 smithi070 ceph-mon[22316]: pgmap v394: 129 pgs: 129 active+clean; 24 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 985 KiB/s rd, 1.9 MiB/s wr, 283 op/s 2024-08-31T05:31:37.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:31:37 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:31:37.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:31:37 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:31:37.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:31:37 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:31:37.908 INFO:tasks.workunit.client.0.smithi005.stdout: 1 70293 15.82 MB/sec warmup 25 sec latency 21.107 ms 2024-08-31T05:31:38.908 INFO:tasks.workunit.client.0.smithi005.stdout: 1 71836 15.54 MB/sec warmup 26 sec latency 202.375 ms 2024-08-31T05:31:38.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.918+0000 7f390880f640 1 -- 172.21.15.5:0/1532473421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3904111ce0 msgr2=0x7f390410a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:38.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.918+0000 7f390880f640 1 --2- 172.21.15.5:0/1532473421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3904111ce0 0x7f390410a160 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f38ec009900 tx=0x7f38ec02a440 comp rx=0 tx=0).stop 2024-08-31T05:31:38.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.921+0000 7f390880f640 1 -- 172.21.15.5:0/1532473421 shutdown_connections 2024-08-31T05:31:38.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.921+0000 7f390880f640 1 --2- 172.21.15.5:0/1532473421 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f390411c9d0 0x7f390411eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:38.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.921+0000 7f390880f640 1 --2- 172.21.15.5:0/1532473421 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f390410a780 0x7f390410ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:38.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.921+0000 7f390880f640 1 --2- 172.21.15.5:0/1532473421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3904111ce0 0x7f390410a160 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:38.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.921+0000 7f390880f640 1 -- 172.21.15.5:0/1532473421 >> 172.21.15.5:0/1532473421 conn(0x7f3904070c60 msgr2=0x7f3904071070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:38.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.923+0000 7f390880f640 1 -- 172.21.15.5:0/1532473421 shutdown_connections 2024-08-31T05:31:38.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.923+0000 7f390880f640 1 -- 172.21.15.5:0/1532473421 wait complete. 2024-08-31T05:31:38.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.925+0000 7f390880f640 1 Processor -- start 2024-08-31T05:31:38.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.925+0000 7f390880f640 1 -- start start 2024-08-31T05:31:38.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.925+0000 7f390880f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f390410a780 0x7f39041a9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:38.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.925+0000 7f390880f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3904111ce0 0x7f39041a9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:38.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.925+0000 7f390880f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f390411c9d0 0x7f39041aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:38.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.925+0000 7f390880f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f39041227a0 con 0x7f3904111ce0 2024-08-31T05:31:38.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.925+0000 7f390880f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3904122620 con 0x7f390410a780 2024-08-31T05:31:38.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.925+0000 7f390880f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3904122920 con 0x7f390411c9d0 2024-08-31T05:31:38.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.926+0000 7f3902d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f390411c9d0 0x7f39041aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:38.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.926+0000 7f3902d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f390411c9d0 0x7f39041aebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:54478/0 (socket says 172.21.15.5:54478) 2024-08-31T05:31:38.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.926+0000 7f3902d9d640 1 -- 172.21.15.5:0/977115431 learned_addr learned my addr 172.21.15.5:0/977115431 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:38.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.927+0000 7f38fbfff640 1 --2- 172.21.15.5:0/977115431 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3904111ce0 0x7f39041a9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:38.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.927+0000 7f3902d9d640 1 -- 172.21.15.5:0/977115431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f390410a780 msgr2=0x7f39041a9370 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-31T05:31:38.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.927+0000 7f3902d9d640 1 --2- 172.21.15.5:0/977115431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f390410a780 0x7f39041a9370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:38.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.927+0000 7f3902d9d640 1 -- 172.21.15.5:0/977115431 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3904111ce0 msgr2=0x7f39041a9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:38.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.927+0000 7f3902d9d640 1 --2- 172.21.15.5:0/977115431 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3904111ce0 0x7f39041a9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:38.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.927+0000 7f3902d9d640 1 -- 172.21.15.5:0/977115431 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39041af2e0 con 0x7f390411c9d0 2024-08-31T05:31:38.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.930+0000 7f3902d9d640 1 --2- 172.21.15.5:0/977115431 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f390411c9d0 0x7f39041aebb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f38fc00b990 tx=0x7f38fc00be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:38.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.930+0000 7f38fb7fe640 1 -- 172.21.15.5:0/977115431 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38fc019070 con 0x7f390411c9d0 2024-08-31T05:31:38.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.930+0000 7f38fb7fe640 1 -- 172.21.15.5:0/977115431 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38fc00cba0 con 0x7f390411c9d0 2024-08-31T05:31:38.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.931+0000 7f390880f640 1 -- 172.21.15.5:0/977115431 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39041af5d0 con 0x7f390411c9d0 2024-08-31T05:31:38.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.931+0000 7f38fb7fe640 1 -- 172.21.15.5:0/977115431 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38fc0075d0 con 0x7f390411c9d0 2024-08-31T05:31:38.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.932+0000 7f390880f640 1 -- 172.21.15.5:0/977115431 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39041b5d30 con 0x7f390411c9d0 2024-08-31T05:31:38.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.936+0000 7f390ed84740 1 Processor -- start 2024-08-31T05:31:38.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.938+0000 7f390ed84740 1 -- start start 2024-08-31T05:31:38.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.938+0000 7f390ed84740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e37f4be070 0x55e37f863310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:38.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.938+0000 7f390ed84740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e37f4951b0 0x55e37f863850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:38.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.938+0000 7f390ed84740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e37f49d390 0x55e37f863d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:38.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.938+0000 7f390ed84740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55e37f7da680 con 0x55e37f4951b0 2024-08-31T05:31:38.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.938+0000 7f390ed84740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e37f7c9c10 con 0x55e37f49d390 2024-08-31T05:31:38.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.938+0000 7f390ed84740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e37f7cdbc0 con 0x55e37f4be070 2024-08-31T05:31:38.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.944+0000 7f38fbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e37f4be070 0x55e37f863310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:38.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.944+0000 7f38fbfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e37f49d390 0x55e37f863d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:38.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.944+0000 7f390259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e37f4951b0 0x55e37f863850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:38.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.944+0000 7f390259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e37f4951b0 0x55e37f863850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40004/0 (socket says 172.21.15.5:40004) 2024-08-31T05:31:38.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.944+0000 7f390259c640 1 -- 172.21.15.5:0/2044497215 learned_addr learned my addr 172.21.15.5:0/2044497215 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:38.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.944+0000 7f390259c640 1 -- 172.21.15.5:0/2044497215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e37f4be070 msgr2=0x55e37f863310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:38.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.944+0000 7f390259c640 1 --2- 172.21.15.5:0/2044497215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e37f4be070 0x55e37f863310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:38.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.944+0000 7f390259c640 1 -- 172.21.15.5:0/2044497215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e37f49d390 msgr2=0x55e37f863d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:38.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.944+0000 7f390259c640 1 --2- 172.21.15.5:0/2044497215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e37f49d390 0x55e37f863d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:38.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.944+0000 7f390259c640 1 -- 172.21.15.5:0/2044497215 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e37f529650 con 0x55e37f4951b0 2024-08-31T05:31:38.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.944+0000 7f38fb7fe640 1 -- 172.21.15.5:0/977115431 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f38fc014440 con 0x7f390411c9d0 2024-08-31T05:31:38.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.946+0000 7f38fb7fe640 1 --2- 172.21.15.5:0/977115431 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f38f00b4eb0 0x7f38f00b73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:38.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.946+0000 7f38fb7fe640 1 -- 172.21.15.5:0/977115431 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f38fc0e4d40 con 0x7f390411c9d0 2024-08-31T05:31:38.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.947+0000 7f38fbfff640 1 --2- 172.21.15.5:0/977115431 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f38f00b4eb0 0x7f38f00b73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:38.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.947+0000 7f390259c640 1 --2- 172.21.15.5:0/2044497215 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e37f4951b0 0x55e37f863850 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f38ec02a9b0 tx=0x7f38ec0040f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=255393770e9f2efc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:38.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.948+0000 7f38f8ff9640 1 -- 172.21.15.5:0/2044497215 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ec03e030 con 0x55e37f4951b0 2024-08-31T05:31:38.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.948+0000 7f38f8ff9640 1 -- 172.21.15.5:0/2044497215 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38ec004320 con 0x55e37f4951b0 2024-08-31T05:31:38.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.948+0000 7f38f8ff9640 1 -- 172.21.15.5:0/2044497215 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ec035040 con 0x55e37f4951b0 2024-08-31T05:31:38.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.950+0000 7f390ed84740 1 -- 172.21.15.5:0/2044497215 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e37f4951b0 msgr2=0x55e37f863850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:38.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.950+0000 7f390ed84740 1 --2- 172.21.15.5:0/2044497215 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e37f4951b0 0x55e37f863850 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f38ec02a9b0 tx=0x7f38ec0040f0 comp rx=0 tx=0).stop 2024-08-31T05:31:38.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.950+0000 7f38fbfff640 1 --2- 172.21.15.5:0/977115431 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f38f00b4eb0 0x7f38f00b73c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f38f4006a90 tx=0x7f38f40046e0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:38.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.951+0000 7f390ed84740 1 -- 172.21.15.5:0/2044497215 shutdown_connections 2024-08-31T05:31:38.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.951+0000 7f390ed84740 1 --2- 172.21.15.5:0/2044497215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e37f49d390 0x55e37f863d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:38.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.951+0000 7f390ed84740 1 --2- 172.21.15.5:0/2044497215 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e37f4951b0 0x55e37f863850 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:38.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.951+0000 7f390ed84740 1 --2- 172.21.15.5:0/2044497215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e37f4be070 0x55e37f863310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:38.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.951+0000 7f390ed84740 1 -- 172.21.15.5:0/2044497215 >> 172.21.15.5:0/2044497215 conn(0x55e37f4b2460 msgr2=0x55e37f861200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:38.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.952+0000 7f390ed84740 1 -- 172.21.15.5:0/2044497215 shutdown_connections 2024-08-31T05:31:38.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.953+0000 7f390ed84740 1 -- 172.21.15.5:0/2044497215 wait complete. 2024-08-31T05:31:38.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.953+0000 7f390ed84740 1 -- start start 2024-08-31T05:31:38.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.954+0000 7f390ed84740 1 Processor -- start 2024-08-31T05:31:38.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.955+0000 7f390ed84740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e37f4951b0 0x55e37f86ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:38.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.955+0000 7f390ed84740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e37f49d390 0x55e37f86efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:38.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.955+0000 7f390ed84740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e37f4be070 0x55e37f87adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:38.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.955+0000 7f390ed84740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55e37f62c700 con 0x55e37f4951b0 2024-08-31T05:31:38.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.955+0000 7f390ed84740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e37f750750 con 0x55e37f4be070 2024-08-31T05:31:38.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.955+0000 7f390ed84740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e37f871a90 con 0x55e37f49d390 2024-08-31T05:31:38.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.955+0000 7f390ed84740 10 client.0 _ll_register_callbacks cb 0x55e37f77fe10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:31:38.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.955+0000 7f390259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e37f4951b0 0x55e37f86ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:38.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.956+0000 7f390259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e37f4951b0 0x55e37f86ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40020/0 (socket says 172.21.15.5:40020) 2024-08-31T05:31:38.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.956+0000 7f390259c640 1 -- 172.21.15.5:0/2911370382 learned_addr learned my addr 172.21.15.5:0/2911370382 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:38.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.956+0000 7f3902d9d640 1 --2- 172.21.15.5:0/2911370382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e37f4be070 0x55e37f87adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:38.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.957+0000 7f38fbfff640 1 --2- 172.21.15.5:0/2911370382 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e37f49d390 0x55e37f86efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:38.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.957+0000 7f390259c640 1 -- 172.21.15.5:0/2911370382 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e37f49d390 msgr2=0x55e37f86efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:38.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.957+0000 7f390259c640 1 --2- 172.21.15.5:0/2911370382 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e37f49d390 0x55e37f86efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:38.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.957+0000 7f390259c640 1 -- 172.21.15.5:0/2911370382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e37f4be070 msgr2=0x55e37f87adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:38.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.957+0000 7f390259c640 1 --2- 172.21.15.5:0/2911370382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e37f4be070 0x55e37f87adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:38.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.957+0000 7f390259c640 1 -- 172.21.15.5:0/2911370382 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e37f789900 con 0x55e37f4951b0 2024-08-31T05:31:38.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.958+0000 7f390259c640 1 --2- 172.21.15.5:0/2911370382 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e37f4951b0 0x55e37f86ea70 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f38ec0057c0 tx=0x7f38ec003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1dbadb45366574e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:38.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.958+0000 7f38e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:31:38.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.960+0000 7f38e9ffb640 1 -- 172.21.15.5:0/2911370382 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ec035050 con 0x55e37f4951b0 2024-08-31T05:31:38.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.960+0000 7f38e9ffb640 1 -- 172.21.15.5:0/2911370382 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f38ec003c10 con 0x55e37f4951b0 2024-08-31T05:31:38.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.960+0000 7f390ed84740 1 -- 172.21.15.5:0/2911370382 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38ec004320 con 0x55e37f4951b0 2024-08-31T05:31:38.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.961+0000 7f38e9ffb640 1 -- 172.21.15.5:0/2911370382 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f38ec054050 con 0x55e37f4951b0 2024-08-31T05:31:38.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.961+0000 7f390ed84740 10 client.16029 fetch_fsmap learned FSMap version 32 2024-08-31T05:31:38.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.961+0000 7f390ed84740 1 -- 172.21.15.5:0/2911370382 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e37f87d830 con 0x55e37f4951b0 2024-08-31T05:31:38.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.962+0000 7f38e9ffb640 1 -- 172.21.15.5:0/2911370382 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38ec004320 con 0x55e37f4951b0 2024-08-31T05:31:38.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.962+0000 7f38e9ffb640 1 -- 172.21.15.5:0/2911370382 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f38ec043570 con 0x55e37f4951b0 2024-08-31T05:31:38.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.962+0000 7f390ed84740 10 client.16029 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:31:38.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.962+0000 7f390ed84740 10 client.16029 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:31:38.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.962+0000 7f390ed84740 20 client.16029 populate_metadata read hostname 'smithi005' 2024-08-31T05:31:38.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.962+0000 7f390ed84740 1 --2- 172.21.15.5:0/2911370382 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55e37f47c9f0 0x55e37f880e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:38.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.962+0000 7f390ed84740 4 client.16029 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:31:38.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.962+0000 7f390ed84740 1 -- 172.21.15.5:0/2911370382 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e37f7dc5d0 con 0x55e37f47c9f0 2024-08-31T05:31:38.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.963+0000 7f38fbfff640 1 --2- 172.21.15.5:0/2911370382 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55e37f47c9f0 0x55e37f880e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:38.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.970+0000 7f38fbfff640 1 --2- 172.21.15.5:0/2911370382 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55e37f47c9f0 0x55e37f880e40 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e714898fce57f125 server_cookie=cda47e8e9e52e41e in_seq=0 out_seq=0 2024-08-31T05:31:38.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.970+0000 7f38e9ffb640 10 client.16029 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:31:38.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.972+0000 7f38e9ffb640 1 -- 172.21.15.5:0/2911370382 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e37f7dc5d0 con 0x55e37f47c9f0 2024-08-31T05:31:38.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.972+0000 7f38e9ffb640 10 client.16029 handle_command_reply: tid=0 2024-08-31T05:31:38.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.972+0000 7f390ed84740 1 client.16029 shutdown 2024-08-31T05:31:38.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.975+0000 7f390ed84740 1 -- 172.21.15.5:0/2911370382 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e37f4951b0 msgr2=0x55e37f86ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:38.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.975+0000 7f390ed84740 1 --2- 172.21.15.5:0/2911370382 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e37f4951b0 0x55e37f86ea70 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f38ec0057c0 tx=0x7f38ec003820 comp rx=0 tx=0).stop 2024-08-31T05:31:38.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.979+0000 7f390ed84740 1 -- 172.21.15.5:0/2911370382 shutdown_connections 2024-08-31T05:31:38.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.979+0000 7f390ed84740 1 --2- 172.21.15.5:0/2911370382 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55e37f47c9f0 0x55e37f880e40 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:38.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.979+0000 7f390ed84740 1 --2- 172.21.15.5:0/2911370382 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e37f4be070 0x55e37f87adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:38.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.979+0000 7f390ed84740 1 --2- 172.21.15.5:0/2911370382 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e37f49d390 0x55e37f86efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:38.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.979+0000 7f390ed84740 1 --2- 172.21.15.5:0/2911370382 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e37f4951b0 0x55e37f86ea70 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:38.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.979+0000 7f390ed84740 1 -- 172.21.15.5:0/2911370382 >> 172.21.15.5:0/2911370382 conn(0x55e37f4b2460 msgr2=0x55e37f8664a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:38.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.979+0000 7f38e9ffb640 0 client.16029 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:31:38.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.979+0000 7f390ed84740 1 -- 172.21.15.5:0/2911370382 shutdown_connections 2024-08-31T05:31:38.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.979+0000 7f390ed84740 1 -- 172.21.15.5:0/2911370382 wait complete. 2024-08-31T05:31:38.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:38.979+0000 7f390ed84740 20 client.16029 trim_cache size 0 max 16384 2024-08-31T05:31:39.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.010+0000 7f390ed84740 1 Processor -- start 2024-08-31T05:31:39.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.011+0000 7f390ed84740 1 -- start start 2024-08-31T05:31:39.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.011+0000 7f390ed84740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e37f4951b0 0x55e37f86a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:39.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.011+0000 7f390ed84740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e37f49d390 0x55e37f864a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:39.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.011+0000 7f390ed84740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e37f4be070 0x55e37f86bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:39.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.011+0000 7f390ed84740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f39041bfbc0 con 0x55e37f4951b0 2024-08-31T05:31:39.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.011+0000 7f390ed84740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f39041c17c0 con 0x55e37f49d390 2024-08-31T05:31:39.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.011+0000 7f390ed84740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f39041c0290 con 0x55e37f4be070 2024-08-31T05:31:39.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.012+0000 7f38fbfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e37f49d390 0x55e37f864a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:39.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.012+0000 7f38fbfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e37f49d390 0x55e37f864a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:44540/0 (socket says 172.21.15.5:44540) 2024-08-31T05:31:39.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.012+0000 7f38fbfff640 1 -- 172.21.15.5:0/447811383 learned_addr learned my addr 172.21.15.5:0/447811383 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:39.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.012+0000 7f3902d9d640 1 --2- 172.21.15.5:0/447811383 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e37f4be070 0x55e37f86bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:39.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.013+0000 7f390259c640 1 --2- 172.21.15.5:0/447811383 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e37f4951b0 0x55e37f86a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:39.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.015+0000 7f3902d9d640 1 -- 172.21.15.5:0/447811383 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e37f49d390 msgr2=0x55e37f864a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:39.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.015+0000 7f3902d9d640 1 --2- 172.21.15.5:0/447811383 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e37f49d390 0x55e37f864a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:39.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.015+0000 7f3902d9d640 1 -- 172.21.15.5:0/447811383 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e37f4951b0 msgr2=0x55e37f86a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:39.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.015+0000 7f3902d9d640 1 --2- 172.21.15.5:0/447811383 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e37f4951b0 0x55e37f86a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:39.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.015+0000 7f3902d9d640 1 -- 172.21.15.5:0/447811383 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e37f865600 con 0x55e37f4be070 2024-08-31T05:31:39.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.015+0000 7f3902d9d640 1 --2- 172.21.15.5:0/447811383 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e37f4be070 0x55e37f86bc60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f38fc0e20b0 tx=0x7f38fc0aab60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64cb575530796d34 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:39.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.016+0000 7f38ebfff640 1 -- 172.21.15.5:0/447811383 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38fc0af8c0 con 0x55e37f4be070 2024-08-31T05:31:39.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.016+0000 7f38ebfff640 1 -- 172.21.15.5:0/447811383 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38fc0b4370 con 0x55e37f4be070 2024-08-31T05:31:39.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.016+0000 7f38ebfff640 1 -- 172.21.15.5:0/447811383 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38fc0ab2b0 con 0x55e37f4be070 2024-08-31T05:31:39.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.018+0000 7f390ed84740 1 -- 172.21.15.5:0/447811383 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e37f4be070 msgr2=0x55e37f86bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:39.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.018+0000 7f390ed84740 1 --2- 172.21.15.5:0/447811383 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e37f4be070 0x55e37f86bc60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f38fc0e20b0 tx=0x7f38fc0aab60 comp rx=0 tx=0).stop 2024-08-31T05:31:39.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.018+0000 7f390ed84740 1 -- 172.21.15.5:0/447811383 shutdown_connections 2024-08-31T05:31:39.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.018+0000 7f390ed84740 1 --2- 172.21.15.5:0/447811383 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e37f4be070 0x55e37f86bc60 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:39.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.019+0000 7f390ed84740 1 --2- 172.21.15.5:0/447811383 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e37f49d390 0x55e37f864a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:39.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.019+0000 7f390ed84740 1 --2- 172.21.15.5:0/447811383 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e37f4951b0 0x55e37f86a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:39.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.019+0000 7f390ed84740 1 -- 172.21.15.5:0/447811383 >> 172.21.15.5:0/447811383 conn(0x55e37f4b2460 msgr2=0x55e37f864340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:39.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.019+0000 7f390ed84740 1 -- 172.21.15.5:0/447811383 shutdown_connections 2024-08-31T05:31:39.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.021+0000 7f390ed84740 1 -- 172.21.15.5:0/447811383 wait complete. 2024-08-31T05:31:39.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.022+0000 7f390ed84740 1 -- start start 2024-08-31T05:31:39.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.022+0000 7f390ed84740 1 Processor -- start 2024-08-31T05:31:39.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.023+0000 7f390ed84740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e37f4951b0 0x55e37f877250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:39.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.023+0000 7f390ed84740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e37f49d390 0x55e37f874770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:39.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.023+0000 7f390259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e37f4951b0 0x55e37f877250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:39.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.024+0000 7f390259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e37f4951b0 0x55e37f877250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:44554/0 (socket says 172.21.15.5:44554) 2024-08-31T05:31:39.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.024+0000 7f38fbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e37f49d390 0x55e37f874770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:39.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.024+0000 7f390259c640 1 -- 172.21.15.5:0/1146478233 learned_addr learned my addr 172.21.15.5:0/1146478233 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:39.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.024+0000 7f390ed84740 1 --2- 172.21.15.5:0/1146478233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e37f4be070 0x55e37f874cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:39.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.024+0000 7f390ed84740 1 -- 172.21.15.5:0/1146478233 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f39041c1030 con 0x55e37f4be070 2024-08-31T05:31:39.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.025+0000 7f390ed84740 1 -- 172.21.15.5:0/1146478233 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f39041c0960 con 0x55e37f4951b0 2024-08-31T05:31:39.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.025+0000 7f3902d9d640 1 --2- 172.21.15.5:0/1146478233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e37f4be070 0x55e37f874cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:39.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.025+0000 7f390ed84740 1 -- 172.21.15.5:0/1146478233 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f39041bdba0 con 0x55e37f49d390 2024-08-31T05:31:39.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.025+0000 7f390ed84740 10 client.0 _ll_register_callbacks cb 0x7f38ec004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:31:39.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.025+0000 7f390259c640 1 -- 172.21.15.5:0/1146478233 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e37f49d390 msgr2=0x55e37f874770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:39.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.025+0000 7f390259c640 1 --2- 172.21.15.5:0/1146478233 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e37f49d390 0x55e37f874770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:39.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.025+0000 7f390259c640 1 -- 172.21.15.5:0/1146478233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e37f4be070 msgr2=0x55e37f874cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:39.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.025+0000 7f390259c640 1 --2- 172.21.15.5:0/1146478233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e37f4be070 0x55e37f874cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:39.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.025+0000 7f390259c640 1 -- 172.21.15.5:0/1146478233 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e37f8751f0 con 0x55e37f4951b0 2024-08-31T05:31:39.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.026+0000 7f390259c640 1 --2- 172.21.15.5:0/1146478233 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e37f4951b0 0x55e37f877250 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f38ec006010 tx=0x7f38ec0095d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c252fd28a3ae5a5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:39.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.026+0000 7f38e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:31:39.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.026+0000 7f38e9ffb640 1 -- 172.21.15.5:0/1146478233 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ec05d060 con 0x55e37f4951b0 2024-08-31T05:31:39.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.026+0000 7f38e9ffb640 1 -- 172.21.15.5:0/1146478233 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f38ec02ac30 con 0x55e37f4951b0 2024-08-31T05:31:39.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.027+0000 7f390ed84740 1 -- 172.21.15.5:0/1146478233 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38fc0b4370 con 0x55e37f4951b0 2024-08-31T05:31:39.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.028+0000 7f38e9ffb640 1 -- 172.21.15.5:0/1146478233 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f38ec035040 con 0x55e37f4951b0 2024-08-31T05:31:39.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.028+0000 7f390ed84740 10 client.25634 fetch_fsmap learned FSMap version 32 2024-08-31T05:31:39.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.028+0000 7f390ed84740 1 -- 172.21.15.5:0/1146478233 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({fsmap=32}) -- 0x55e37f8fc330 con 0x55e37f4951b0 2024-08-31T05:31:39.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.029+0000 7f38e9ffb640 1 -- 172.21.15.5:0/1146478233 <== mon.2 v2:172.21.15.50:3300/0 4 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f38ec043410 con 0x55e37f4951b0 2024-08-31T05:31:39.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.029+0000 7f390ed84740 10 client.25634 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:31:39.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.029+0000 7f390ed84740 10 client.25634 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:31:39.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.029+0000 7f390ed84740 20 client.25634 populate_metadata read hostname 'smithi005' 2024-08-31T05:31:39.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.029+0000 7f390ed84740 1 --2- 172.21.15.5:0/1146478233 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55e37f451da0 0x55e37f8fe9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:39.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.029+0000 7f390ed84740 4 client.25634 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:31:39.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.029+0000 7f390ed84740 1 -- 172.21.15.5:0/1146478233 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f38fc0b4370 con 0x55e37f451da0 2024-08-31T05:31:39.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.030+0000 7f38fbfff640 1 --2- 172.21.15.5:0/1146478233 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55e37f451da0 0x55e37f8fe9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:39.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.031+0000 7f38fbfff640 1 --2- 172.21.15.5:0/1146478233 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55e37f451da0 0x55e37f8fe9f0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=564ed023474bb3e4 server_cookie=388ec14be62e8148 in_seq=0 out_seq=0 2024-08-31T05:31:39.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.031+0000 7f38e9ffb640 10 client.25634 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:31:39.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.033+0000 7f38e9ffb640 1 -- 172.21.15.5:0/1146478233 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f38fc0b4370 con 0x55e37f451da0 2024-08-31T05:31:39.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.033+0000 7f38e9ffb640 10 client.25634 handle_command_reply: tid=0 2024-08-31T05:31:39.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.033+0000 7f390ed84740 1 client.25634 shutdown 2024-08-31T05:31:39.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.035+0000 7f390ed84740 1 -- 172.21.15.5:0/1146478233 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e37f4951b0 msgr2=0x55e37f877250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:39.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.035+0000 7f390ed84740 1 --2- 172.21.15.5:0/1146478233 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e37f4951b0 0x55e37f877250 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f38ec006010 tx=0x7f38ec0095d0 comp rx=0 tx=0).stop 2024-08-31T05:31:39.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.036+0000 7f390ed84740 1 -- 172.21.15.5:0/1146478233 shutdown_connections 2024-08-31T05:31:39.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.036+0000 7f390ed84740 1 --2- 172.21.15.5:0/1146478233 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55e37f451da0 0x55e37f8fe9f0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:39.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.036+0000 7f390ed84740 1 --2- 172.21.15.5:0/1146478233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e37f4be070 0x55e37f874cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:39.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.036+0000 7f38e9ffb640 0 client.25634 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:31:39.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.036+0000 7f390ed84740 1 --2- 172.21.15.5:0/1146478233 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e37f49d390 0x55e37f874770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:39.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.036+0000 7f390ed84740 1 --2- 172.21.15.5:0/1146478233 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e37f4951b0 0x55e37f877250 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:39.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.036+0000 7f390ed84740 1 -- 172.21.15.5:0/1146478233 >> 172.21.15.5:0/1146478233 conn(0x55e37f4b2460 msgr2=0x55e37f86feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:39.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.036+0000 7f390ed84740 1 -- 172.21.15.5:0/1146478233 shutdown_connections 2024-08-31T05:31:39.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.037+0000 7f390ed84740 1 -- 172.21.15.5:0/1146478233 wait complete. 2024-08-31T05:31:39.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.037+0000 7f390ed84740 20 client.25634 trim_cache size 0 max 16384 2024-08-31T05:31:39.040 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:31:39.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.039+0000 7f390880f640 1 -- 172.21.15.5:0/977115431 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f38f00b4eb0 msgr2=0x7f38f00b73c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:39.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.039+0000 7f390880f640 1 --2- 172.21.15.5:0/977115431 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f38f00b4eb0 0x7f38f00b73c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f38f4006a90 tx=0x7f38f40046e0 comp rx=0 tx=0).stop 2024-08-31T05:31:39.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.039+0000 7f390880f640 1 -- 172.21.15.5:0/977115431 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f390411c9d0 msgr2=0x7f39041aebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:39.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.039+0000 7f390880f640 1 --2- 172.21.15.5:0/977115431 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f390411c9d0 0x7f39041aebb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f38fc00b990 tx=0x7f38fc00be50 comp rx=0 tx=0).stop 2024-08-31T05:31:39.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.039+0000 7f390880f640 1 -- 172.21.15.5:0/977115431 shutdown_connections 2024-08-31T05:31:39.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.039+0000 7f390880f640 1 --2- 172.21.15.5:0/977115431 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f38f00b4eb0 0x7f38f00b73c0 secure :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f38f4006a90 tx=0x7f38f40046e0 comp rx=0 tx=0).stop 2024-08-31T05:31:39.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.039+0000 7f390880f640 1 --2- 172.21.15.5:0/977115431 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f390411c9d0 0x7f39041aebb0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:39.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.039+0000 7f390880f640 1 --2- 172.21.15.5:0/977115431 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3904111ce0 0x7f39041a9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:39.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.039+0000 7f390880f640 1 --2- 172.21.15.5:0/977115431 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f390410a780 0x7f39041a9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:39.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.039+0000 7f390880f640 1 -- 172.21.15.5:0/977115431 >> 172.21.15.5:0/977115431 conn(0x7f3904070c60 msgr2=0x7f3904071bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:39.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.039+0000 7f390880f640 1 -- 172.21.15.5:0/977115431 shutdown_connections 2024-08-31T05:31:39.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:39.039+0000 7f390880f640 1 -- 172.21.15.5:0/977115431 wait complete. 2024-08-31T05:31:39.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:31:39 smithi050 ceph-mon[22146]: pgmap v395: 129 pgs: 129 active+clean; 27 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 791 KiB/s rd, 1.5 MiB/s wr, 244 op/s 2024-08-31T05:31:39.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:31:39 smithi005 ceph-mon[18602]: pgmap v395: 129 pgs: 129 active+clean; 27 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 791 KiB/s rd, 1.5 MiB/s wr, 244 op/s 2024-08-31T05:31:39.585 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:31:39 smithi070 ceph-mon[22316]: pgmap v395: 129 pgs: 129 active+clean; 27 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 791 KiB/s rd, 1.5 MiB/s wr, 244 op/s 2024-08-31T05:31:39.908 INFO:tasks.workunit.client.0.smithi005.stdout: 1 73394 15.20 MB/sec warmup 27 sec latency 249.898 ms 2024-08-31T05:31:39.998 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:39.996+0000 7f567e7fc640 1 -- 172.21.15.5:0/739748930 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f567002f310 con 0x7f5680104490 2024-08-31T05:31:39.999 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:39.997+0000 7f5685a47640 1 -- 172.21.15.5:0/739748930 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5680104490 msgr2=0x7f56801048a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:40.000 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:39.997+0000 7f5685a47640 1 --2- 172.21.15.5:0/739748930 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5680104490 0x7f56801048a0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f5670009ca0 tx=0x7f567002a8c0 comp rx=0 tx=0).stop 2024-08-31T05:31:40.000 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:39.998+0000 7f5685a47640 1 -- 172.21.15.5:0/739748930 shutdown_connections 2024-08-31T05:31:40.000 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:39.998+0000 7f5685a47640 1 --2- 172.21.15.5:0/739748930 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56801026b0 0x7f5680112330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:40.000 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:39.998+0000 7f5685a47640 1 --2- 172.21.15.5:0/739748930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5680101c00 0x7f5680102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:40.000 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:39.998+0000 7f5685a47640 1 --2- 172.21.15.5:0/739748930 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5680104490 0x7f56801048a0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:40.000 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:39.998+0000 7f5685a47640 1 -- 172.21.15.5:0/739748930 >> 172.21.15.5:0/739748930 conn(0x7f5680079bf0 msgr2=0x7f568007a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:40.001 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:39.998+0000 7f5685a47640 1 -- 172.21.15.5:0/739748930 shutdown_connections 2024-08-31T05:31:40.001 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:39.998+0000 7f5685a47640 1 -- 172.21.15.5:0/739748930 wait complete. 2024-08-31T05:31:40.001 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:39.999+0000 7f5685a47640 1 Processor -- start 2024-08-31T05:31:40.001 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:39.999+0000 7f5685a47640 1 -- start start 2024-08-31T05:31:40.001 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.000+0000 7f5685a47640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5680101c00 0x7f568010eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:40.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.000+0000 7f5685a47640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56801026b0 0x7f568010f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:40.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.000+0000 7f5685a47640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5680104490 0x7f568019c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:40.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.000+0000 7f5685a47640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5680105e90 con 0x7f56801026b0 2024-08-31T05:31:40.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.000+0000 7f5685a47640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5680105d10 con 0x7f5680104490 2024-08-31T05:31:40.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.000+0000 7f5685a47640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5680106010 con 0x7f5680101c00 2024-08-31T05:31:40.003 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.000+0000 7f56767fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56801026b0 0x7f568010f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:40.003 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.000+0000 7f56767fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56801026b0 0x7f568010f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40060/0 (socket says 172.21.15.5:40060) 2024-08-31T05:31:40.003 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.000+0000 7f56767fc640 1 -- 172.21.15.5:0/2329741528 learned_addr learned my addr 172.21.15.5:0/2329741528 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:40.003 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.000+0000 7f567effd640 1 --2- 172.21.15.5:0/2329741528 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5680101c00 0x7f568010eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:40.003 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.000+0000 7f567f7fe640 1 --2- 172.21.15.5:0/2329741528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5680104490 0x7f568019c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:40.003 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.001+0000 7f567effd640 1 -- 172.21.15.5:0/2329741528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5680104490 msgr2=0x7f568019c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:40.003 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.001+0000 7f567effd640 1 --2- 172.21.15.5:0/2329741528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5680104490 0x7f568019c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:40.003 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.001+0000 7f567effd640 1 -- 172.21.15.5:0/2329741528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56801026b0 msgr2=0x7f568010f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:40.003 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.001+0000 7f567effd640 1 --2- 172.21.15.5:0/2329741528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56801026b0 0x7f568010f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:40.003 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.001+0000 7f567effd640 1 -- 172.21.15.5:0/2329741528 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f568019ce90 con 0x7f5680101c00 2024-08-31T05:31:40.004 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.001+0000 7f56767fc640 1 --2- 172.21.15.5:0/2329741528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56801026b0 0x7f568010f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:31:40.004 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.001+0000 7f567effd640 1 --2- 172.21.15.5:0/2329741528 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5680101c00 0x7f568010eb90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5670000f80 tx=0x7f56700319f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:40.004 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.002+0000 7f5684a45640 1 -- 172.21.15.5:0/2329741528 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5670003b70 con 0x7f5680101c00 2024-08-31T05:31:40.004 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.002+0000 7f5684a45640 1 -- 172.21.15.5:0/2329741528 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5670003d10 con 0x7f5680101c00 2024-08-31T05:31:40.005 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.002+0000 7f5684a45640 1 -- 172.21.15.5:0/2329741528 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f567002fb70 con 0x7f5680101c00 2024-08-31T05:31:40.005 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.002+0000 7f5685a47640 1 -- 172.21.15.5:0/2329741528 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f568019d120 con 0x7f5680101c00 2024-08-31T05:31:40.005 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.002+0000 7f5685a47640 1 -- 172.21.15.5:0/2329741528 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56801a4a00 con 0x7f5680101c00 2024-08-31T05:31:40.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.005+0000 7f568ca8b740 1 Processor -- start 2024-08-31T05:31:40.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.005+0000 7f568ca8b740 1 -- start start 2024-08-31T05:31:40.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.005+0000 7f568ca8b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fb8cb4a1b0 0x55fb8ceedac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:40.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.005+0000 7f568ca8b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fb8cb212f0 0x55fb8ceee000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:40.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.005+0000 7f568ca8b740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb8cb294d0 0x55fb8ceee540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:40.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.005+0000 7f568ca8b740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55fb8ce63000 con 0x55fb8cb294d0 2024-08-31T05:31:40.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.005+0000 7f568ca8b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55fb8ce52590 con 0x55fb8cb4a1b0 2024-08-31T05:31:40.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.005+0000 7f568ca8b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fb8ce56540 con 0x55fb8cb212f0 2024-08-31T05:31:40.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.005+0000 7f567f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fb8cb4a1b0 0x55fb8ceedac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:40.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.005+0000 7f56767fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb8cb294d0 0x55fb8ceee540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:40.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.006+0000 7f567f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fb8cb4a1b0 0x55fb8ceedac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:44598/0 (socket says 172.21.15.5:44598) 2024-08-31T05:31:40.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.006+0000 7f567f7fe640 1 -- 172.21.15.5:0/754463198 learned_addr learned my addr 172.21.15.5:0/754463198 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:40.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.006+0000 7f5684a45640 1 -- 172.21.15.5:0/2329741528 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f567002fd10 con 0x7f5680101c00 2024-08-31T05:31:40.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.006+0000 7f567f7fe640 1 -- 172.21.15.5:0/754463198 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fb8cb212f0 msgr2=0x55fb8ceee000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:40.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.006+0000 7f567f7fe640 1 --2- 172.21.15.5:0/754463198 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fb8cb212f0 0x55fb8ceee000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:40.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.006+0000 7f567f7fe640 1 -- 172.21.15.5:0/754463198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb8cb294d0 msgr2=0x55fb8ceee540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:40.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.006+0000 7f567f7fe640 1 --2- 172.21.15.5:0/754463198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb8cb294d0 0x55fb8ceee540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:40.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.006+0000 7f567f7fe640 1 -- 172.21.15.5:0/754463198 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb8cbb5790 con 0x55fb8cb4a1b0 2024-08-31T05:31:40.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.006+0000 7f567f7fe640 1 --2- 172.21.15.5:0/754463198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fb8cb4a1b0 0x55fb8ceedac0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f567800b730 tx=0x7f567800bbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60d54e06a4978cf3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:40.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.006+0000 7f5675ffb640 1 -- 172.21.15.5:0/754463198 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5678003dd0 con 0x55fb8cb4a1b0 2024-08-31T05:31:40.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.007+0000 7f5675ffb640 1 -- 172.21.15.5:0/754463198 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5678015030 con 0x55fb8cb4a1b0 2024-08-31T05:31:40.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.007+0000 7f5675ffb640 1 -- 172.21.15.5:0/754463198 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5678010660 con 0x55fb8cb4a1b0 2024-08-31T05:31:40.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.007+0000 7f5684a45640 1 --2- 172.21.15.5:0/2329741528 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f566c0bd4b0 0x7f566c0bf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:40.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.007+0000 7f5684a45640 1 -- 172.21.15.5:0/2329741528 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f56701069d0 con 0x7f5680101c00 2024-08-31T05:31:40.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.008+0000 7f568ca8b740 1 -- 172.21.15.5:0/754463198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fb8cb4a1b0 msgr2=0x55fb8ceedac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:40.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.008+0000 7f568ca8b740 1 --2- 172.21.15.5:0/754463198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fb8cb4a1b0 0x55fb8ceedac0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f567800b730 tx=0x7f567800bbf0 comp rx=0 tx=0).stop 2024-08-31T05:31:40.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.008+0000 7f568ca8b740 1 -- 172.21.15.5:0/754463198 shutdown_connections 2024-08-31T05:31:40.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.008+0000 7f567effd640 1 --2- 172.21.15.5:0/2329741528 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f566c0bd4b0 0x7f566c0bf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:40.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.008+0000 7f568ca8b740 1 --2- 172.21.15.5:0/754463198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb8cb294d0 0x55fb8ceee540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:40.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.008+0000 7f568ca8b740 1 --2- 172.21.15.5:0/754463198 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fb8cb212f0 0x55fb8ceee000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:40.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.008+0000 7f568ca8b740 1 --2- 172.21.15.5:0/754463198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fb8cb4a1b0 0x55fb8ceedac0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:40.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.008+0000 7f568ca8b740 1 -- 172.21.15.5:0/754463198 >> 172.21.15.5:0/754463198 conn(0x55fb8cb3e300 msgr2=0x55fb8ceeb9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:40.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.009+0000 7f568ca8b740 1 -- 172.21.15.5:0/754463198 shutdown_connections 2024-08-31T05:31:40.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.009+0000 7f568ca8b740 1 -- 172.21.15.5:0/754463198 wait complete. 2024-08-31T05:31:40.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.010+0000 7f568ca8b740 1 -- start start 2024-08-31T05:31:40.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.010+0000 7f567effd640 1 --2- 172.21.15.5:0/2329741528 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f566c0bd4b0 0x7f566c0bf9c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x55fb8ceec740 tx=0x7f567002f6a0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:40.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.010+0000 7f568ca8b740 1 Processor -- start 2024-08-31T05:31:40.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.011+0000 7f568ca8b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fb8cb212f0 0x55fb8cef96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:40.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.011+0000 7f568ca8b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fb8cb294d0 0x55fb8cef9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:40.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.011+0000 7f568ca8b740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb8cb4a1b0 0x55fb8cf055b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:40.014 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.011+0000 7f568ca8b740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55fb8cd8bab0 con 0x55fb8cb4a1b0 2024-08-31T05:31:40.014 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.011+0000 7f568ca8b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55fb8cdd9680 con 0x55fb8cb294d0 2024-08-31T05:31:40.014 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.011+0000 7f568ca8b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fb8cefc290 con 0x55fb8cb212f0 2024-08-31T05:31:40.014 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.011+0000 7f568ca8b740 10 client.0 _ll_register_callbacks cb 0x55fb8cb61a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:31:40.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.011+0000 7f567f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fb8cb212f0 0x55fb8cef96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:40.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.011+0000 7f567f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fb8cb212f0 0x55fb8cef96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:54548/0 (socket says 172.21.15.5:54548) 2024-08-31T05:31:40.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.011+0000 7f567f7fe640 1 -- 172.21.15.5:0/2117882652 learned_addr learned my addr 172.21.15.5:0/2117882652 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:40.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.011+0000 7f567f7fe640 1 --2- 172.21.15.5:0/2117882652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb8cb4a1b0 0x55fb8cf055b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:40.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.012+0000 7f56767fc640 1 --2- 172.21.15.5:0/2117882652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fb8cb294d0 0x55fb8cef9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:40.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.012+0000 7f567f7fe640 1 -- 172.21.15.5:0/2117882652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fb8cb294d0 msgr2=0x55fb8cef9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:40.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.012+0000 7f567f7fe640 1 --2- 172.21.15.5:0/2117882652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fb8cb294d0 0x55fb8cef9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:40.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.012+0000 7f567f7fe640 1 -- 172.21.15.5:0/2117882652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb8cb4a1b0 msgr2=0x55fb8cf055b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:40.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.012+0000 7f567f7fe640 1 --2- 172.21.15.5:0/2117882652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb8cb4a1b0 0x55fb8cf055b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:40.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.012+0000 7f567f7fe640 1 -- 172.21.15.5:0/2117882652 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb8cc2e620 con 0x55fb8cb212f0 2024-08-31T05:31:40.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.012+0000 7f56767fc640 1 --2- 172.21.15.5:0/2117882652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fb8cb294d0 0x55fb8cef9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:31:40.016 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.012+0000 7f567f7fe640 1 --2- 172.21.15.5:0/2117882652 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fb8cb212f0 0x55fb8cef96a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5678011500 tx=0x7f56780042d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db795c760b688db9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:40.016 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.012+0000 7f565effd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:31:40.017 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.013+0000 7f565effd640 1 -- 172.21.15.5:0/2117882652 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5678023040 con 0x55fb8cb212f0 2024-08-31T05:31:40.017 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.013+0000 7f565effd640 1 -- 172.21.15.5:0/2117882652 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f5678011760 con 0x55fb8cb212f0 2024-08-31T05:31:40.018 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.013+0000 7f568ca8b740 1 -- 172.21.15.5:0/2117882652 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5678015030 con 0x55fb8cb212f0 2024-08-31T05:31:40.018 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.013+0000 7f565effd640 1 -- 172.21.15.5:0/2117882652 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f5678011960 con 0x55fb8cb212f0 2024-08-31T05:31:40.018 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.013+0000 7f568ca8b740 10 client.25654 fetch_fsmap learned FSMap version 32 2024-08-31T05:31:40.018 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.013+0000 7f568ca8b740 1 -- 172.21.15.5:0/2117882652 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55fb8cf08280 con 0x55fb8cb212f0 2024-08-31T05:31:40.018 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.014+0000 7f565effd640 1 -- 172.21.15.5:0/2117882652 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5678015030 con 0x55fb8cb212f0 2024-08-31T05:31:40.018 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.014+0000 7f565effd640 1 -- 172.21.15.5:0/2117882652 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f567801a420 con 0x55fb8cb212f0 2024-08-31T05:31:40.018 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.014+0000 7f568ca8b740 10 client.25654 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:31:40.018 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.014+0000 7f568ca8b740 10 client.25654 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:31:40.018 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.014+0000 7f568ca8b740 20 client.25654 populate_metadata read hostname 'smithi005' 2024-08-31T05:31:40.018 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.014+0000 7f568ca8b740 1 --2- 172.21.15.5:0/2117882652 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55fb8cb08d80 0x55fb8cf0b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:40.018 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.014+0000 7f568ca8b740 4 client.25654 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:31:40.018 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.014+0000 7f568ca8b740 1 -- 172.21.15.5:0/2117882652 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fb8ce64f50 con 0x55fb8cb08d80 2024-08-31T05:31:40.019 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.015+0000 7f56767fc640 1 --2- 172.21.15.5:0/2117882652 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55fb8cb08d80 0x55fb8cf0b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:40.019 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.015+0000 7f565effd640 10 client.25654 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:31:40.019 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.015+0000 7f56767fc640 1 --2- 172.21.15.5:0/2117882652 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55fb8cb08d80 0x55fb8cf0b6f0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=144c5cdef1994bef server_cookie=13a8cfb69116c412 in_seq=0 out_seq=0 2024-08-31T05:31:40.019 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.017+0000 7f565effd640 1 -- 172.21.15.5:0/2117882652 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fb8ce64f50 con 0x55fb8cb08d80 2024-08-31T05:31:40.019 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.017+0000 7f565effd640 10 client.25654 handle_command_reply: tid=0 2024-08-31T05:31:40.020 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.017+0000 7f568ca8b740 1 client.25654 shutdown 2024-08-31T05:31:40.020 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.017+0000 7f568ca8b740 1 -- 172.21.15.5:0/2117882652 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fb8cb212f0 msgr2=0x55fb8cef96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:40.020 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.017+0000 7f568ca8b740 1 --2- 172.21.15.5:0/2117882652 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fb8cb212f0 0x55fb8cef96a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5678011500 tx=0x7f56780042d0 comp rx=0 tx=0).stop 2024-08-31T05:31:40.020 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.018+0000 7f568ca8b740 1 -- 172.21.15.5:0/2117882652 shutdown_connections 2024-08-31T05:31:40.020 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.018+0000 7f568ca8b740 1 --2- 172.21.15.5:0/2117882652 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55fb8cb08d80 0x55fb8cf0b6f0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:40.021 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.018+0000 7f568ca8b740 1 --2- 172.21.15.5:0/2117882652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb8cb4a1b0 0x55fb8cf055b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:40.021 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.018+0000 7f568ca8b740 1 --2- 172.21.15.5:0/2117882652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fb8cb294d0 0x55fb8cef9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:40.021 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.018+0000 7f568ca8b740 1 --2- 172.21.15.5:0/2117882652 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fb8cb212f0 0x55fb8cef96a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:40.021 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.018+0000 7f568ca8b740 1 -- 172.21.15.5:0/2117882652 >> 172.21.15.5:0/2117882652 conn(0x55fb8cb3e300 msgr2=0x55fb8ceeeaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:40.021 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.018+0000 7f565effd640 0 client.25654 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:31:40.021 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.019+0000 7f568ca8b740 1 -- 172.21.15.5:0/2117882652 shutdown_connections 2024-08-31T05:31:40.021 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.019+0000 7f568ca8b740 1 -- 172.21.15.5:0/2117882652 wait complete. 2024-08-31T05:31:40.022 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.019+0000 7f568ca8b740 20 client.25654 trim_cache size 0 max 16384 2024-08-31T05:31:40.046 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.043+0000 7f568ca8b740 1 Processor -- start 2024-08-31T05:31:40.046 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.043+0000 7f568ca8b740 1 -- start start 2024-08-31T05:31:40.046 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.043+0000 7f568ca8b740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb8cb212f0 0x55fb8cef2b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:40.046 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.043+0000 7f568ca8b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fb8cb294d0 0x55fb8cef3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:40.046 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.043+0000 7f568ca8b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fb8cb4a1b0 0x55fb8cef66a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:40.046 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.043+0000 7f568ca8b740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f56801ae9c0 con 0x55fb8cb212f0 2024-08-31T05:31:40.047 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.043+0000 7f568ca8b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f56801b05c0 con 0x55fb8cb294d0 2024-08-31T05:31:40.047 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.043+0000 7f568ca8b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f56801af090 con 0x55fb8cb4a1b0 2024-08-31T05:31:40.047 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.043+0000 7f567f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb8cb212f0 0x55fb8cef2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:40.047 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.043+0000 7f567f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb8cb212f0 0x55fb8cef2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40094/0 (socket says 172.21.15.5:40094) 2024-08-31T05:31:40.047 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.043+0000 7f567f7fe640 1 -- 172.21.15.5:0/2366740666 learned_addr learned my addr 172.21.15.5:0/2366740666 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:40.047 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.043+0000 7f56767fc640 1 --2- 172.21.15.5:0/2366740666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fb8cb294d0 0x55fb8cef3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:40.047 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.044+0000 7f567f7fe640 1 --2- 172.21.15.5:0/2366740666 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fb8cb4a1b0 0x55fb8cef66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:40.047 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.044+0000 7f567f7fe640 1 -- 172.21.15.5:0/2366740666 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fb8cb4a1b0 msgr2=0x55fb8cef66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:40.047 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.044+0000 7f567f7fe640 1 --2- 172.21.15.5:0/2366740666 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fb8cb4a1b0 0x55fb8cef66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:40.047 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.044+0000 7f567f7fe640 1 -- 172.21.15.5:0/2366740666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fb8cb294d0 msgr2=0x55fb8cef3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:40.047 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.044+0000 7f567f7fe640 1 --2- 172.21.15.5:0/2366740666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fb8cb294d0 0x55fb8cef3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:40.047 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.044+0000 7f567f7fe640 1 -- 172.21.15.5:0/2366740666 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb8cf0bb50 con 0x55fb8cb212f0 2024-08-31T05:31:40.048 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.044+0000 7f567f7fe640 1 --2- 172.21.15.5:0/2366740666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb8cb212f0 0x55fb8cef2b50 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f567800b730 tx=0x7f567800b2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bee4fd4e5bd6076 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:40.048 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.044+0000 7f56757fa640 1 -- 172.21.15.5:0/2366740666 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5678011b00 con 0x55fb8cb212f0 2024-08-31T05:31:40.048 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.044+0000 7f56757fa640 1 -- 172.21.15.5:0/2366740666 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5678015070 con 0x55fb8cb212f0 2024-08-31T05:31:40.048 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.044+0000 7f56757fa640 1 -- 172.21.15.5:0/2366740666 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5678011530 con 0x55fb8cb212f0 2024-08-31T05:31:40.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.045+0000 7f568ca8b740 1 -- 172.21.15.5:0/2366740666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb8cb212f0 msgr2=0x55fb8cef2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:40.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.045+0000 7f568ca8b740 1 --2- 172.21.15.5:0/2366740666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb8cb212f0 0x55fb8cef2b50 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f567800b730 tx=0x7f567800b2e0 comp rx=0 tx=0).stop 2024-08-31T05:31:40.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.045+0000 7f568ca8b740 1 -- 172.21.15.5:0/2366740666 shutdown_connections 2024-08-31T05:31:40.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.045+0000 7f568ca8b740 1 --2- 172.21.15.5:0/2366740666 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fb8cb4a1b0 0x55fb8cef66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:40.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.045+0000 7f568ca8b740 1 --2- 172.21.15.5:0/2366740666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fb8cb294d0 0x55fb8cef3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:40.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.045+0000 7f568ca8b740 1 --2- 172.21.15.5:0/2366740666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb8cb212f0 0x55fb8cef2b50 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:40.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.045+0000 7f568ca8b740 1 -- 172.21.15.5:0/2366740666 >> 172.21.15.5:0/2366740666 conn(0x55fb8cb3e300 msgr2=0x55fb8cef7cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:40.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.045+0000 7f568ca8b740 1 -- 172.21.15.5:0/2366740666 shutdown_connections 2024-08-31T05:31:40.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.045+0000 7f568ca8b740 1 -- 172.21.15.5:0/2366740666 wait complete. 2024-08-31T05:31:40.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.046+0000 7f568ca8b740 1 -- start start 2024-08-31T05:31:40.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.046+0000 7f568ca8b740 1 Processor -- start 2024-08-31T05:31:40.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.047+0000 7f568ca8b740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb8cb212f0 0x55fb8cefef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:40.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.047+0000 7f568ca8b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fb8cb294d0 0x55fb8ceff4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:40.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.047+0000 7f568ca8b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fb8cb4a1b0 0x55fb8cf6e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:40.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.047+0000 7f568ca8b740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f56801afe30 con 0x55fb8cb212f0 2024-08-31T05:31:40.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.047+0000 7f568ca8b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f56801af760 con 0x55fb8cb294d0 2024-08-31T05:31:40.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.047+0000 7f568ca8b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f56801ac9a0 con 0x55fb8cb4a1b0 2024-08-31T05:31:40.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.047+0000 7f568ca8b740 10 client.0 _ll_register_callbacks cb 0x7f5668009470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:31:40.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.047+0000 7f567f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb8cb212f0 0x55fb8cefef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:40.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.047+0000 7f567f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb8cb212f0 0x55fb8cefef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40102/0 (socket says 172.21.15.5:40102) 2024-08-31T05:31:40.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.047+0000 7f567f7fe640 1 -- 172.21.15.5:0/4094269946 learned_addr learned my addr 172.21.15.5:0/4094269946 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:40.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.047+0000 7f567f7fe640 1 --2- 172.21.15.5:0/4094269946 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fb8cb4a1b0 0x55fb8cf6e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:40.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.047+0000 7f56767fc640 1 --2- 172.21.15.5:0/4094269946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fb8cb294d0 0x55fb8ceff4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:40.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.047+0000 7f567f7fe640 1 -- 172.21.15.5:0/4094269946 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fb8cb4a1b0 msgr2=0x55fb8cf6e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:40.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.047+0000 7f567f7fe640 1 --2- 172.21.15.5:0/4094269946 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fb8cb4a1b0 0x55fb8cf6e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:40.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.047+0000 7f567f7fe640 1 -- 172.21.15.5:0/4094269946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fb8cb294d0 msgr2=0x55fb8ceff4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:40.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.047+0000 7f567f7fe640 1 --2- 172.21.15.5:0/4094269946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fb8cb294d0 0x55fb8ceff4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:40.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.047+0000 7f567f7fe640 1 -- 172.21.15.5:0/4094269946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb8cf6e690 con 0x55fb8cb212f0 2024-08-31T05:31:40.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.047+0000 7f567f7fe640 1 --2- 172.21.15.5:0/4094269946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb8cb212f0 0x55fb8cefef40 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f5678003b40 tx=0x7f5678003e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8ca5fd2598ae307 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:40.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.047+0000 7f565effd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:31:40.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.048+0000 7f565effd640 1 -- 172.21.15.5:0/4094269946 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5678011e60 con 0x55fb8cb212f0 2024-08-31T05:31:40.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.048+0000 7f568ca8b740 1 -- 172.21.15.5:0/4094269946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5678015070 con 0x55fb8cb212f0 2024-08-31T05:31:40.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.048+0000 7f565effd640 1 -- 172.21.15.5:0/4094269946 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f5678011640 con 0x55fb8cb212f0 2024-08-31T05:31:40.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.048+0000 7f565effd640 1 -- 172.21.15.5:0/4094269946 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f567801ac70 con 0x55fb8cb212f0 2024-08-31T05:31:40.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.048+0000 7f568ca8b740 10 client.16053 fetch_fsmap learned FSMap version 32 2024-08-31T05:31:40.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.048+0000 7f568ca8b740 1 -- 172.21.15.5:0/4094269946 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55fb8cf75ab0 con 0x55fb8cb212f0 2024-08-31T05:31:40.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.048+0000 7f565effd640 1 -- 172.21.15.5:0/4094269946 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56780054e0 con 0x55fb8cb212f0 2024-08-31T05:31:40.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.048+0000 7f565effd640 1 -- 172.21.15.5:0/4094269946 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f5678004a10 con 0x55fb8cb212f0 2024-08-31T05:31:40.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.048+0000 7f568ca8b740 10 client.16053 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:31:40.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.048+0000 7f568ca8b740 10 client.16053 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:31:40.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.048+0000 7f568ca8b740 20 client.16053 populate_metadata read hostname 'smithi005' 2024-08-31T05:31:40.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.048+0000 7f568ca8b740 1 --2- 172.21.15.5:0/4094269946 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55fb8cade1c0 0x55fb8cf77ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:40.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.048+0000 7f568ca8b740 4 client.16053 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:31:40.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.048+0000 7f568ca8b740 1 -- 172.21.15.5:0/4094269946 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f5678015070 con 0x55fb8cade1c0 2024-08-31T05:31:40.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.049+0000 7f56767fc640 1 --2- 172.21.15.5:0/4094269946 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55fb8cade1c0 0x55fb8cf77ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:40.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.049+0000 7f565effd640 10 client.16053 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:31:40.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.049+0000 7f56767fc640 1 --2- 172.21.15.5:0/4094269946 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55fb8cade1c0 0x55fb8cf77ff0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=466dac307ad1e65c server_cookie=4052d7cb7c608a41 in_seq=0 out_seq=0 2024-08-31T05:31:40.116 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.113+0000 7f565effd640 1 -- 172.21.15.5:0/4094269946 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f5678015070 con 0x55fb8cade1c0 2024-08-31T05:31:40.116 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.113+0000 7f565effd640 10 client.16053 handle_command_reply: tid=0 2024-08-31T05:31:40.116 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.113+0000 7f568ca8b740 1 client.16053 shutdown 2024-08-31T05:31:40.117 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.114+0000 7f568ca8b740 1 -- 172.21.15.5:0/4094269946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb8cb212f0 msgr2=0x55fb8cefef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:40.117 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.114+0000 7f568ca8b740 1 --2- 172.21.15.5:0/4094269946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb8cb212f0 0x55fb8cefef40 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f5678003b40 tx=0x7f5678003e40 comp rx=0 tx=0).stop 2024-08-31T05:31:40.117 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.114+0000 7f568ca8b740 1 -- 172.21.15.5:0/4094269946 shutdown_connections 2024-08-31T05:31:40.117 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.114+0000 7f568ca8b740 1 --2- 172.21.15.5:0/4094269946 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55fb8cade1c0 0x55fb8cf77ff0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:40.117 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.114+0000 7f568ca8b740 1 --2- 172.21.15.5:0/4094269946 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fb8cb4a1b0 0x55fb8cf6e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:40.117 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.114+0000 7f568ca8b740 1 --2- 172.21.15.5:0/4094269946 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fb8cb294d0 0x55fb8ceff4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:40.117 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.114+0000 7f568ca8b740 1 --2- 172.21.15.5:0/4094269946 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fb8cb212f0 0x55fb8cefef40 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:40.117 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.114+0000 7f568ca8b740 1 -- 172.21.15.5:0/4094269946 >> 172.21.15.5:0/4094269946 conn(0x55fb8cb3e300 msgr2=0x55fb8cef2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:40.117 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.114+0000 7f565effd640 0 client.16053 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:31:40.117 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.114+0000 7f568ca8b740 1 -- 172.21.15.5:0/4094269946 shutdown_connections 2024-08-31T05:31:40.117 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.114+0000 7f568ca8b740 1 -- 172.21.15.5:0/4094269946 wait complete. 2024-08-31T05:31:40.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.114+0000 7f568ca8b740 20 client.16053 trim_cache size 0 max 16384 2024-08-31T05:31:40.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:31:40.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:31:40.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:31:40.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:31:40.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.115+0000 7f5685a47640 1 -- 172.21.15.5:0/2329741528 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f566c0bd4b0 msgr2=0x7f566c0bf9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:40.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.115+0000 7f5685a47640 1 --2- 172.21.15.5:0/2329741528 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f566c0bd4b0 0x7f566c0bf9c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x55fb8ceec740 tx=0x7f567002f6a0 comp rx=0 tx=0).stop 2024-08-31T05:31:40.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.115+0000 7f5685a47640 1 -- 172.21.15.5:0/2329741528 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5680101c00 msgr2=0x7f568010eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:40.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.115+0000 7f5685a47640 1 --2- 172.21.15.5:0/2329741528 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5680101c00 0x7f568010eb90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5670000f80 tx=0x7f56700319f0 comp rx=0 tx=0).stop 2024-08-31T05:31:40.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.116+0000 7f5685a47640 1 -- 172.21.15.5:0/2329741528 shutdown_connections 2024-08-31T05:31:40.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.116+0000 7f5685a47640 1 --2- 172.21.15.5:0/2329741528 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f566c0bd4b0 0x7f566c0bf9c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:40.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.116+0000 7f5685a47640 1 --2- 172.21.15.5:0/2329741528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5680104490 0x7f568019c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:40.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.116+0000 7f5685a47640 1 --2- 172.21.15.5:0/2329741528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56801026b0 0x7f568010f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:40.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.116+0000 7f5685a47640 1 --2- 172.21.15.5:0/2329741528 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5680101c00 0x7f568010eb90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:40.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.116+0000 7f5685a47640 1 -- 172.21.15.5:0/2329741528 >> 172.21.15.5:0/2329741528 conn(0x7f5680079bf0 msgr2=0x7f5680100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:40.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.116+0000 7f5685a47640 1 -- 172.21.15.5:0/2329741528 shutdown_connections 2024-08-31T05:31:40.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:40.116+0000 7f5685a47640 1 -- 172.21.15.5:0/2329741528 wait complete. 2024-08-31T05:31:40.908 INFO:tasks.workunit.client.0.smithi005.stdout: 1 75018 15.09 MB/sec warmup 28 sec latency 13.407 ms 2024-08-31T05:31:40.993 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T05:31:40.994 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T05:31:41.254 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:31:41.375 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:31:41 smithi005 ceph-mon[18602]: pgmap v396: 129 pgs: 129 active+clean; 74 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 796 KiB/s rd, 5.5 MiB/s wr, 302 op/s 2024-08-31T05:31:41.387 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:31:41 smithi070 ceph-mon[22316]: pgmap v396: 129 pgs: 129 active+clean; 74 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 796 KiB/s rd, 5.5 MiB/s wr, 302 op/s 2024-08-31T05:31:41.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:31:41 smithi050 ceph-mon[22146]: pgmap v396: 129 pgs: 129 active+clean; 74 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 796 KiB/s rd, 5.5 MiB/s wr, 302 op/s 2024-08-31T05:31:41.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.743+0000 7f2655c93640 1 -- 172.21.15.5:0/229231602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2650108170 msgr2=0x7f2650108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:41.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.743+0000 7f2655c93640 1 --2- 172.21.15.5:0/229231602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2650108170 0x7f2650108580 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f2644009900 tx=0x7f264402a410 comp rx=0 tx=0).stop 2024-08-31T05:31:41.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.743+0000 7f2655c93640 1 -- 172.21.15.5:0/229231602 shutdown_connections 2024-08-31T05:31:41.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.743+0000 7f2655c93640 1 --2- 172.21.15.5:0/229231602 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2650108ac0 0x7f265010f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:41.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.743+0000 7f2655c93640 1 --2- 172.21.15.5:0/229231602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2650108170 0x7f2650108580 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:41.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.743+0000 7f2655c93640 1 --2- 172.21.15.5:0/229231602 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2650102880 0x7f2650102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:41.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.743+0000 7f2655c93640 1 -- 172.21.15.5:0/229231602 >> 172.21.15.5:0/229231602 conn(0x7f2650079500 msgr2=0x7f2650079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:41.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.743+0000 7f2655c93640 1 -- 172.21.15.5:0/229231602 shutdown_connections 2024-08-31T05:31:41.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.743+0000 7f2655c93640 1 -- 172.21.15.5:0/229231602 wait complete. 2024-08-31T05:31:41.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.743+0000 7f2655c93640 1 Processor -- start 2024-08-31T05:31:41.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.744+0000 7f2655c93640 1 -- start start 2024-08-31T05:31:41.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.744+0000 7f2655c93640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2650102880 0x7f2650199100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:41.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.744+0000 7f2655c93640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2650108170 0x7f26501996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:41.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.744+0000 7f2655c93640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2650108ac0 0x7f265019e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:41.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.744+0000 7f2655c93640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2650112710 con 0x7f2650102880 2024-08-31T05:31:41.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.744+0000 7f2655c93640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2650112590 con 0x7f2650108ac0 2024-08-31T05:31:41.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.744+0000 7f2655c93640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2650112890 con 0x7f2650108170 2024-08-31T05:31:41.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.744+0000 7f264f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2650102880 0x7f2650199100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:41.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.744+0000 7f264effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2650108170 0x7f26501996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:41.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.744+0000 7f264f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2650102880 0x7f2650199100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40118/0 (socket says 172.21.15.5:40118) 2024-08-31T05:31:41.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.744+0000 7f264effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2650108170 0x7f26501996a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:54576/0 (socket says 172.21.15.5:54576) 2024-08-31T05:31:41.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.744+0000 7f264f7fe640 1 -- 172.21.15.5:0/4145589200 learned_addr learned my addr 172.21.15.5:0/4145589200 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:41.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.744+0000 7f264ffff640 1 --2- 172.21.15.5:0/4145589200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2650108ac0 0x7f265019e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:41.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.745+0000 7f264effd640 1 -- 172.21.15.5:0/4145589200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2650108ac0 msgr2=0x7f265019e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:41.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.745+0000 7f264effd640 1 --2- 172.21.15.5:0/4145589200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2650108ac0 0x7f265019e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:41.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.745+0000 7f264effd640 1 -- 172.21.15.5:0/4145589200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2650102880 msgr2=0x7f2650199100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:41.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.745+0000 7f264effd640 1 --2- 172.21.15.5:0/4145589200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2650102880 0x7f2650199100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:41.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.745+0000 7f264effd640 1 -- 172.21.15.5:0/4145589200 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f265019f070 con 0x7f2650108170 2024-08-31T05:31:41.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.745+0000 7f264effd640 1 --2- 172.21.15.5:0/4145589200 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2650108170 0x7f26501996a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f264402a930 tx=0x7f2644031a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:41.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.745+0000 7f264cff9640 1 -- 172.21.15.5:0/4145589200 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f264403f070 con 0x7f2650108170 2024-08-31T05:31:41.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.745+0000 7f264cff9640 1 -- 172.21.15.5:0/4145589200 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2644004490 con 0x7f2650108170 2024-08-31T05:31:41.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.745+0000 7f264cff9640 1 -- 172.21.15.5:0/4145589200 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2644035070 con 0x7f2650108170 2024-08-31T05:31:41.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.745+0000 7f2655c93640 1 -- 172.21.15.5:0/4145589200 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f265019f300 con 0x7f2650108170 2024-08-31T05:31:41.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.745+0000 7f2655c93640 1 -- 172.21.15.5:0/4145589200 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26501a5ac0 con 0x7f2650108170 2024-08-31T05:31:41.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.748+0000 7f264cff9640 1 -- 172.21.15.5:0/4145589200 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f264403b460 con 0x7f2650108170 2024-08-31T05:31:41.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.748+0000 7f265c208740 1 Processor -- start 2024-08-31T05:31:41.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.748+0000 7f265c208740 1 -- start start 2024-08-31T05:31:41.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.749+0000 7f265c208740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a6247c350 0x562a62822780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:41.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.749+0000 7f265c208740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a62453490 0x562a62822cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:41.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.749+0000 7f265c208740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562a6245b670 0x562a62823200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:41.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.749+0000 7f265c208740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x562a627985f0 con 0x562a6247c350 2024-08-31T05:31:41.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.749+0000 7f265c208740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562a62787b80 con 0x562a6245b670 2024-08-31T05:31:41.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.749+0000 7f265c208740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562a6278bb30 con 0x562a62453490 2024-08-31T05:31:41.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.749+0000 7f264ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a6247c350 0x562a62822780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:41.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.749+0000 7f264effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562a6245b670 0x562a62823200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:41.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.749+0000 7f264ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a6247c350 0x562a62822780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40128/0 (socket says 172.21.15.5:40128) 2024-08-31T05:31:41.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.749+0000 7f264ffff640 1 -- 172.21.15.5:0/1007080072 learned_addr learned my addr 172.21.15.5:0/1007080072 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:41.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.749+0000 7f264f7fe640 1 --2- 172.21.15.5:0/1007080072 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a62453490 0x562a62822cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:41.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.749+0000 7f264ffff640 1 -- 172.21.15.5:0/1007080072 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a62453490 msgr2=0x562a62822cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:41.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.749+0000 7f264ffff640 1 --2- 172.21.15.5:0/1007080072 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a62453490 0x562a62822cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:41.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.749+0000 7f264ffff640 1 -- 172.21.15.5:0/1007080072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562a6245b670 msgr2=0x562a62823200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:41.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.749+0000 7f264ffff640 1 --2- 172.21.15.5:0/1007080072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562a6245b670 0x562a62823200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:41.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.749+0000 7f264ffff640 1 -- 172.21.15.5:0/1007080072 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a624e7930 con 0x562a6247c350 2024-08-31T05:31:41.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.749+0000 7f264cff9640 1 --2- 172.21.15.5:0/4145589200 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f26380b4ca0 0x7f26380b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:41.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.749+0000 7f264ffff640 1 --2- 172.21.15.5:0/1007080072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a6247c350 0x562a62822780 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f2648009fd0 tx=0x7f26480118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=540162287da275f9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:41.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.750+0000 7f264f7fe640 1 --2- 172.21.15.5:0/4145589200 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f26380b4ca0 0x7f26380b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:41.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.750+0000 7f264cff9640 1 -- 172.21.15.5:0/4145589200 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f2644105da0 con 0x7f2650108170 2024-08-31T05:31:41.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.750+0000 7f2635ffb640 1 -- 172.21.15.5:0/1007080072 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2648004d20 con 0x562a6247c350 2024-08-31T05:31:41.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.750+0000 7f2635ffb640 1 -- 172.21.15.5:0/1007080072 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2648004050 con 0x562a6247c350 2024-08-31T05:31:41.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.750+0000 7f2635ffb640 1 -- 172.21.15.5:0/1007080072 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2648005280 con 0x562a6247c350 2024-08-31T05:31:41.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.751+0000 7f265c208740 1 -- 172.21.15.5:0/1007080072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a6247c350 msgr2=0x562a62822780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:41.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.751+0000 7f264f7fe640 1 --2- 172.21.15.5:0/4145589200 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f26380b4ca0 0x7f26380b71b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x562a62821400 tx=0x7f2640005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:41.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.751+0000 7f265c208740 1 --2- 172.21.15.5:0/1007080072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a6247c350 0x562a62822780 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f2648009fd0 tx=0x7f26480118d0 comp rx=0 tx=0).stop 2024-08-31T05:31:41.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.751+0000 7f265c208740 1 -- 172.21.15.5:0/1007080072 shutdown_connections 2024-08-31T05:31:41.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.751+0000 7f265c208740 1 --2- 172.21.15.5:0/1007080072 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562a6245b670 0x562a62823200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:41.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.751+0000 7f265c208740 1 --2- 172.21.15.5:0/1007080072 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a62453490 0x562a62822cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:41.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.751+0000 7f265c208740 1 --2- 172.21.15.5:0/1007080072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a6247c350 0x562a62822780 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:41.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.751+0000 7f265c208740 1 -- 172.21.15.5:0/1007080072 >> 172.21.15.5:0/1007080072 conn(0x562a62470740 msgr2=0x562a62820670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:41.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.751+0000 7f265c208740 1 -- 172.21.15.5:0/1007080072 shutdown_connections 2024-08-31T05:31:41.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.751+0000 7f265c208740 1 -- 172.21.15.5:0/1007080072 wait complete. 2024-08-31T05:31:41.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.751+0000 7f265c208740 1 -- start start 2024-08-31T05:31:41.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.752+0000 7f265c208740 1 Processor -- start 2024-08-31T05:31:41.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.752+0000 7f265c208740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562a62453490 0x562a6282c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:41.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.752+0000 7f265c208740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a6245b670 0x562a6282c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:41.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.752+0000 7f265c208740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a6247c350 0x562a62838350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:41.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.752+0000 7f265c208740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x562a625ea890 con 0x562a6245b670 2024-08-31T05:31:41.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.752+0000 7f265c208740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562a6270e790 con 0x562a62453490 2024-08-31T05:31:41.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.752+0000 7f265c208740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562a62830da0 con 0x562a6247c350 2024-08-31T05:31:41.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.752+0000 7f265c208740 10 client.0 _ll_register_callbacks cb 0x562a62493ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:31:41.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.752+0000 7f264f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562a62453490 0x562a6282c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:41.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.752+0000 7f264ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a6247c350 0x562a62838350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:41.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.752+0000 7f264effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a6245b670 0x562a6282c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:41.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.752+0000 7f264f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562a62453490 0x562a6282c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:44664/0 (socket says 172.21.15.5:44664) 2024-08-31T05:31:41.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.752+0000 7f264ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a6247c350 0x562a62838350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:54594/0 (socket says 172.21.15.5:54594) 2024-08-31T05:31:41.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.752+0000 7f264f7fe640 1 -- 172.21.15.5:0/1505993247 learned_addr learned my addr 172.21.15.5:0/1505993247 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:41.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.753+0000 7f264f7fe640 1 -- 172.21.15.5:0/1505993247 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a6247c350 msgr2=0x562a62838350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:41.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.753+0000 7f264f7fe640 1 --2- 172.21.15.5:0/1505993247 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a6247c350 0x562a62838350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:41.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.753+0000 7f264f7fe640 1 -- 172.21.15.5:0/1505993247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a6245b670 msgr2=0x562a6282c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:41.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.753+0000 7f264f7fe640 1 --2- 172.21.15.5:0/1505993247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a6245b670 0x562a6282c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:41.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.753+0000 7f264f7fe640 1 -- 172.21.15.5:0/1505993247 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a62745f30 con 0x562a62453490 2024-08-31T05:31:41.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.753+0000 7f264ffff640 1 --2- 172.21.15.5:0/1505993247 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a6247c350 0x562a62838350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:31:41.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.753+0000 7f264effd640 1 --2- 172.21.15.5:0/1505993247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a6245b670 0x562a6282c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:31:41.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.753+0000 7f264f7fe640 1 --2- 172.21.15.5:0/1505993247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562a62453490 0x562a6282c410 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f26400045f0 tx=0x7f2640004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99c422c7d080cf15 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:41.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.753+0000 7f262effd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:31:41.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.753+0000 7f262effd640 1 -- 172.21.15.5:0/1505993247 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2640005020 con 0x562a62453490 2024-08-31T05:31:41.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.753+0000 7f265c208740 1 -- 172.21.15.5:0/1505993247 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2648004050 con 0x562a62453490 2024-08-31T05:31:41.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.753+0000 7f262effd640 1 -- 172.21.15.5:0/1505993247 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f26400051c0 con 0x562a62453490 2024-08-31T05:31:41.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.753+0000 7f262effd640 1 -- 172.21.15.5:0/1505993247 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f26400053c0 con 0x562a62453490 2024-08-31T05:31:41.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.753+0000 7f265c208740 10 client.25661 fetch_fsmap learned FSMap version 32 2024-08-31T05:31:41.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.753+0000 7f265c208740 1 -- 172.21.15.5:0/1505993247 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x562a62841260 con 0x562a62453490 2024-08-31T05:31:41.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.754+0000 7f262effd640 1 -- 172.21.15.5:0/1505993247 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2648004050 con 0x562a62453490 2024-08-31T05:31:41.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.754+0000 7f262effd640 1 -- 172.21.15.5:0/1505993247 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f2640027070 con 0x562a62453490 2024-08-31T05:31:41.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.754+0000 7f265c208740 10 client.25661 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:31:41.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.754+0000 7f265c208740 10 client.25661 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:31:41.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.754+0000 7f265c208740 20 client.25661 populate_metadata read hostname 'smithi005' 2024-08-31T05:31:41.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.754+0000 7f265c208740 1 --2- 172.21.15.5:0/1505993247 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x562a6243acd0 0x562a628447e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:41.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.754+0000 7f265c208740 4 client.25661 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:31:41.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.754+0000 7f265c208740 1 -- 172.21.15.5:0/1505993247 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562a6279a540 con 0x562a6243acd0 2024-08-31T05:31:41.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.754+0000 7f264effd640 1 --2- 172.21.15.5:0/1505993247 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x562a6243acd0 0x562a628447e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:41.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.755+0000 7f262effd640 10 client.25661 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:31:41.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.755+0000 7f264effd640 1 --2- 172.21.15.5:0/1505993247 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x562a6243acd0 0x562a628447e0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31bbf5240ec6feb8 server_cookie=435c17e998dcb1b0 in_seq=0 out_seq=0 2024-08-31T05:31:41.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.755+0000 7f262effd640 1 -- 172.21.15.5:0/1505993247 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562a6279a540 con 0x562a6243acd0 2024-08-31T05:31:41.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.755+0000 7f262effd640 10 client.25661 handle_command_reply: tid=0 2024-08-31T05:31:41.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.755+0000 7f265c208740 1 client.25661 shutdown 2024-08-31T05:31:41.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.756+0000 7f265c208740 1 -- 172.21.15.5:0/1505993247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562a62453490 msgr2=0x562a6282c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:41.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.756+0000 7f265c208740 1 --2- 172.21.15.5:0/1505993247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562a62453490 0x562a6282c410 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f26400045f0 tx=0x7f2640004730 comp rx=0 tx=0).stop 2024-08-31T05:31:41.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.756+0000 7f265c208740 1 -- 172.21.15.5:0/1505993247 shutdown_connections 2024-08-31T05:31:41.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.756+0000 7f265c208740 1 --2- 172.21.15.5:0/1505993247 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x562a6243acd0 0x562a628447e0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:41.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.756+0000 7f265c208740 1 --2- 172.21.15.5:0/1505993247 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a6247c350 0x562a62838350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:41.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.756+0000 7f265c208740 1 --2- 172.21.15.5:0/1505993247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a6245b670 0x562a6282c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:41.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.756+0000 7f262effd640 0 client.25661 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:31:41.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.756+0000 7f265c208740 1 --2- 172.21.15.5:0/1505993247 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562a62453490 0x562a6282c410 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:41.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.756+0000 7f265c208740 1 -- 172.21.15.5:0/1505993247 >> 172.21.15.5:0/1505993247 conn(0x562a62470740 msgr2=0x562a62825960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:41.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.756+0000 7f265c208740 1 -- 172.21.15.5:0/1505993247 shutdown_connections 2024-08-31T05:31:41.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.756+0000 7f265c208740 1 -- 172.21.15.5:0/1505993247 wait complete. 2024-08-31T05:31:41.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.756+0000 7f265c208740 20 client.25661 trim_cache size 0 max 16384 2024-08-31T05:31:41.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.775+0000 7f265c208740 1 Processor -- start 2024-08-31T05:31:41.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.775+0000 7f265c208740 1 -- start start 2024-08-31T05:31:41.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.776+0000 7f265c208740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a62453490 0x562a6283f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:41.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.776+0000 7f265c208740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562a6245b670 0x562a628279c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:41.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.776+0000 7f265c208740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a6247c350 0x562a6282e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:41.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.776+0000 7f265c208740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f26501ae990 con 0x562a6247c350 2024-08-31T05:31:41.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.776+0000 7f265c208740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f26501b0590 con 0x562a6245b670 2024-08-31T05:31:41.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.776+0000 7f265c208740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f26501af060 con 0x562a62453490 2024-08-31T05:31:41.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.776+0000 7f264ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a6247c350 0x562a6282e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:41.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.776+0000 7f264ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a6247c350 0x562a6282e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40148/0 (socket says 172.21.15.5:40148) 2024-08-31T05:31:41.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.776+0000 7f264ffff640 1 -- 172.21.15.5:0/143722575 learned_addr learned my addr 172.21.15.5:0/143722575 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:41.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.776+0000 7f264effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562a6245b670 0x562a628279c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:41.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.776+0000 7f264f7fe640 1 --2- 172.21.15.5:0/143722575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a62453490 0x562a6283f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:41.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.776+0000 7f264ffff640 1 -- 172.21.15.5:0/143722575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a62453490 msgr2=0x562a6283f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:41.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.776+0000 7f264ffff640 1 --2- 172.21.15.5:0/143722575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a62453490 0x562a6283f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:41.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.776+0000 7f264ffff640 1 -- 172.21.15.5:0/143722575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562a6245b670 msgr2=0x562a628279c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:41.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.776+0000 7f264ffff640 1 --2- 172.21.15.5:0/143722575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562a6245b670 0x562a628279c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:41.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.776+0000 7f264ffff640 1 -- 172.21.15.5:0/143722575 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a6282b170 con 0x562a6247c350 2024-08-31T05:31:41.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.776+0000 7f264effd640 1 --2- 172.21.15.5:0/143722575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562a6245b670 0x562a628279c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:31:41.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.777+0000 7f264ffff640 1 --2- 172.21.15.5:0/143722575 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a6247c350 0x562a6282e0f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f2648009f70 tx=0x7f2648009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91e766b29673684d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:41.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.777+0000 7f26357fa640 1 -- 172.21.15.5:0/143722575 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2648004a00 con 0x562a6247c350 2024-08-31T05:31:41.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.777+0000 7f26357fa640 1 -- 172.21.15.5:0/143722575 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2648004ba0 con 0x562a6247c350 2024-08-31T05:31:41.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.777+0000 7f26357fa640 1 -- 172.21.15.5:0/143722575 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2648005320 con 0x562a6247c350 2024-08-31T05:31:41.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.778+0000 7f265c208740 1 -- 172.21.15.5:0/143722575 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a6247c350 msgr2=0x562a6282e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:41.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.778+0000 7f265c208740 1 --2- 172.21.15.5:0/143722575 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a6247c350 0x562a6282e0f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f2648009f70 tx=0x7f2648009b30 comp rx=0 tx=0).stop 2024-08-31T05:31:41.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.778+0000 7f265c208740 1 -- 172.21.15.5:0/143722575 shutdown_connections 2024-08-31T05:31:41.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.778+0000 7f265c208740 1 --2- 172.21.15.5:0/143722575 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a6247c350 0x562a6282e0f0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:41.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.778+0000 7f265c208740 1 --2- 172.21.15.5:0/143722575 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562a6245b670 0x562a628279c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:41.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.778+0000 7f265c208740 1 --2- 172.21.15.5:0/143722575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a62453490 0x562a6283f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:41.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.778+0000 7f265c208740 1 -- 172.21.15.5:0/143722575 >> 172.21.15.5:0/143722575 conn(0x562a62470740 msgr2=0x562a628237b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:41.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.778+0000 7f265c208740 1 -- 172.21.15.5:0/143722575 shutdown_connections 2024-08-31T05:31:41.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.778+0000 7f265c208740 1 -- 172.21.15.5:0/143722575 wait complete. 2024-08-31T05:31:41.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.778+0000 7f265c208740 1 -- start start 2024-08-31T05:31:41.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.778+0000 7f265c208740 1 Processor -- start 2024-08-31T05:31:41.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.779+0000 7f265c208740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562a62453490 0x562a6283a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:41.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.779+0000 7f265c208740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a6245b670 0x562a6283aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:41.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.779+0000 7f265c208740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a6247c350 0x562a628ae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:41.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.779+0000 7f265c208740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f26501afe00 con 0x562a6245b670 2024-08-31T05:31:41.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.779+0000 7f265c208740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f26501af730 con 0x562a62453490 2024-08-31T05:31:41.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.779+0000 7f265c208740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f26501ac970 con 0x562a6247c350 2024-08-31T05:31:41.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.779+0000 7f265c208740 10 client.0 _ll_register_callbacks cb 0x7f2640009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:31:41.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.779+0000 7f264effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a6245b670 0x562a6283aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:41.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.779+0000 7f264effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a6245b670 0x562a6283aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40162/0 (socket says 172.21.15.5:40162) 2024-08-31T05:31:41.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.779+0000 7f264effd640 1 -- 172.21.15.5:0/1694637178 learned_addr learned my addr 172.21.15.5:0/1694637178 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:41.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.779+0000 7f264f7fe640 1 --2- 172.21.15.5:0/1694637178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562a62453490 0x562a6283a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:41.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.779+0000 7f264ffff640 1 --2- 172.21.15.5:0/1694637178 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a6247c350 0x562a628ae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:41.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.779+0000 7f264effd640 1 -- 172.21.15.5:0/1694637178 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a6247c350 msgr2=0x562a628ae1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:41.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.779+0000 7f264effd640 1 --2- 172.21.15.5:0/1694637178 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a6247c350 0x562a628ae1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:41.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.779+0000 7f264effd640 1 -- 172.21.15.5:0/1694637178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562a62453490 msgr2=0x562a6283a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:41.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.779+0000 7f264effd640 1 --2- 172.21.15.5:0/1694637178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562a62453490 0x562a6283a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:41.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.779+0000 7f264effd640 1 -- 172.21.15.5:0/1694637178 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a6283b6c0 con 0x562a6245b670 2024-08-31T05:31:41.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.779+0000 7f264ffff640 1 --2- 172.21.15.5:0/1694637178 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a6247c350 0x562a628ae1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:31:41.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.779+0000 7f264effd640 1 --2- 172.21.15.5:0/1694637178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a6245b670 0x562a6283aed0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f26440c93d0 tx=0x7f26441081f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a684165fb9b7cd1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:41.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.779+0000 7f262effd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:31:41.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.780+0000 7f262effd640 1 -- 172.21.15.5:0/1694637178 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2644048040 con 0x562a6245b670 2024-08-31T05:31:41.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.780+0000 7f265c208740 1 -- 172.21.15.5:0/1694637178 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2648004ba0 con 0x562a6245b670 2024-08-31T05:31:41.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.780+0000 7f262effd640 1 -- 172.21.15.5:0/1694637178 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f26440cc3c0 con 0x562a6245b670 2024-08-31T05:31:41.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.780+0000 7f262effd640 1 -- 172.21.15.5:0/1694637178 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f26440cbab0 con 0x562a6245b670 2024-08-31T05:31:41.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.780+0000 7f265c208740 10 client.16071 fetch_fsmap learned FSMap version 32 2024-08-31T05:31:41.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.780+0000 7f265c208740 1 -- 172.21.15.5:0/1694637178 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x562a628af6d0 con 0x562a6245b670 2024-08-31T05:31:41.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.780+0000 7f262effd640 1 -- 172.21.15.5:0/1694637178 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2648004ba0 con 0x562a6245b670 2024-08-31T05:31:41.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.780+0000 7f262effd640 1 -- 172.21.15.5:0/1694637178 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f264404b060 con 0x562a6245b670 2024-08-31T05:31:41.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.780+0000 7f265c208740 10 client.16071 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:31:41.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.780+0000 7f265c208740 10 client.16071 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:31:41.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.780+0000 7f265c208740 20 client.16071 populate_metadata read hostname 'smithi005' 2024-08-31T05:31:41.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.780+0000 7f265c208740 1 --2- 172.21.15.5:0/1694637178 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x562a62410080 0x562a628b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:41.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.780+0000 7f265c208740 4 client.16071 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T05:31:41.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.780+0000 7f265c208740 1 -- 172.21.15.5:0/1694637178 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562a62795fe0 con 0x562a62410080 2024-08-31T05:31:41.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.781+0000 7f264f7fe640 1 --2- 172.21.15.5:0/1694637178 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x562a62410080 0x562a628b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:41.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.781+0000 7f262effd640 10 client.16071 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:31:41.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.781+0000 7f264f7fe640 1 --2- 172.21.15.5:0/1694637178 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x562a62410080 0x562a628b1f20 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d56e23fd0e68306 server_cookie=1560bb2fadc00375 in_seq=0 out_seq=0 2024-08-31T05:31:41.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.782+0000 7f262effd640 1 -- 172.21.15.5:0/1694637178 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562a62795fe0 con 0x562a62410080 2024-08-31T05:31:41.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.782+0000 7f262effd640 10 client.16071 handle_command_reply: tid=0 2024-08-31T05:31:41.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.782+0000 7f265c208740 1 client.16071 shutdown 2024-08-31T05:31:41.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.782+0000 7f265c208740 1 -- 172.21.15.5:0/1694637178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a6245b670 msgr2=0x562a6283aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:41.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.782+0000 7f265c208740 1 --2- 172.21.15.5:0/1694637178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a6245b670 0x562a6283aed0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f26440c93d0 tx=0x7f26441081f0 comp rx=0 tx=0).stop 2024-08-31T05:31:41.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.782+0000 7f265c208740 1 -- 172.21.15.5:0/1694637178 shutdown_connections 2024-08-31T05:31:41.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.782+0000 7f265c208740 1 --2- 172.21.15.5:0/1694637178 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x562a62410080 0x562a628b1f20 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:41.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.782+0000 7f265c208740 1 --2- 172.21.15.5:0/1694637178 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a6247c350 0x562a628ae1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:41.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.782+0000 7f265c208740 1 --2- 172.21.15.5:0/1694637178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a6245b670 0x562a6283aed0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:41.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.782+0000 7f265c208740 1 --2- 172.21.15.5:0/1694637178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562a62453490 0x562a6283a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:41.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.782+0000 7f265c208740 1 -- 172.21.15.5:0/1694637178 >> 172.21.15.5:0/1694637178 conn(0x562a62470740 msgr2=0x562a62823f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:41.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.782+0000 7f262effd640 0 client.16071 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:31:41.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.782+0000 7f265c208740 1 -- 172.21.15.5:0/1694637178 shutdown_connections 2024-08-31T05:31:41.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.782+0000 7f265c208740 1 -- 172.21.15.5:0/1694637178 wait complete. 2024-08-31T05:31:41.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.782+0000 7f265c208740 20 client.16071 trim_cache size 0 max 16384 2024-08-31T05:31:41.791 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:31:41.791 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-08-31T05:31:41.791 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "ece37b07-9ab2-45f8-bc33-2755a07aac0b", 2024-08-31T05:31:41.791 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-08-31T05:31:41.791 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:31:41.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.783+0000 7f2655c93640 1 -- 172.21.15.5:0/4145589200 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f26380b4ca0 msgr2=0x7f26380b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:41.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.783+0000 7f2655c93640 1 --2- 172.21.15.5:0/4145589200 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f26380b4ca0 0x7f26380b71b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x562a62821400 tx=0x7f2640005f90 comp rx=0 tx=0).stop 2024-08-31T05:31:41.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.783+0000 7f2655c93640 1 -- 172.21.15.5:0/4145589200 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2650108170 msgr2=0x7f26501996a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:41.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.783+0000 7f2655c93640 1 --2- 172.21.15.5:0/4145589200 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2650108170 0x7f26501996a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f264402a930 tx=0x7f2644031a20 comp rx=0 tx=0).stop 2024-08-31T05:31:41.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.783+0000 7f2655c93640 1 -- 172.21.15.5:0/4145589200 shutdown_connections 2024-08-31T05:31:41.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.783+0000 7f2655c93640 1 --2- 172.21.15.5:0/4145589200 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f26380b4ca0 0x7f26380b71b0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:41.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.783+0000 7f2655c93640 1 --2- 172.21.15.5:0/4145589200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2650108ac0 0x7f265019e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:41.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.783+0000 7f2655c93640 1 --2- 172.21.15.5:0/4145589200 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2650108170 0x7f26501996a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:41.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.783+0000 7f2655c93640 1 --2- 172.21.15.5:0/4145589200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2650102880 0x7f2650199100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:41.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.783+0000 7f2655c93640 1 -- 172.21.15.5:0/4145589200 >> 172.21.15.5:0/4145589200 conn(0x7f2650079500 msgr2=0x7f2650105070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:41.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.783+0000 7f2655c93640 1 -- 172.21.15.5:0/4145589200 shutdown_connections 2024-08-31T05:31:41.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:41.783+0000 7f2655c93640 1 -- 172.21.15.5:0/4145589200 wait complete. 2024-08-31T05:31:41.908 INFO:tasks.workunit.client.0.smithi005.stdout: 1 77906 15.07 MB/sec warmup 29 sec latency 72.579 ms 2024-08-31T05:31:42.400 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:31:42 smithi070 ceph-mon[22316]: scrub summary: active paths [/] 2024-08-31T05:31:42.400 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:31:42 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:31:42.406 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:31:42 smithi005 ceph-mon[18602]: scrub summary: active paths [/] 2024-08-31T05:31:42.406 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:31:42 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:31:42.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:31:42 smithi050 ceph-mon[22146]: scrub summary: active paths [/] 2024-08-31T05:31:42.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:31:42 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:31:42.560 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T05:31:42.852 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:31:42.908 INFO:tasks.workunit.client.0.smithi005.stdout: 1 79617 14.89 MB/sec warmup 30 sec latency 31.643 ms 2024-08-31T05:31:43.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:31:43 smithi050 ceph-mon[22146]: pgmap v397: 129 pgs: 129 active+clean; 81 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 6.0 MiB/s wr, 253 op/s 2024-08-31T05:31:43.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:31:43 smithi050 ceph-mon[22146]: scrub queued for path: / 2024-08-31T05:31:43.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:31:43 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:31:43.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:31:43 smithi050 ceph-mon[22146]: scrub summary: active paths [/] 2024-08-31T05:31:43.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:31:43 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:31:43.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:31:43 smithi005 ceph-mon[18602]: pgmap v397: 129 pgs: 129 active+clean; 81 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 6.0 MiB/s wr, 253 op/s 2024-08-31T05:31:43.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:31:43 smithi005 ceph-mon[18602]: scrub queued for path: / 2024-08-31T05:31:43.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:31:43 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:31:43.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:31:43 smithi005 ceph-mon[18602]: scrub summary: active paths [/] 2024-08-31T05:31:43.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:31:43 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:31:43.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:31:43 smithi070 ceph-mon[22316]: pgmap v397: 129 pgs: 129 active+clean; 81 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 6.0 MiB/s wr, 253 op/s 2024-08-31T05:31:43.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:31:43 smithi070 ceph-mon[22316]: scrub queued for path: / 2024-08-31T05:31:43.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:31:43 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:31:43.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:31:43 smithi070 ceph-mon[22316]: scrub summary: active paths [/] 2024-08-31T05:31:43.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:31:43 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:31:43.908 INFO:tasks.workunit.client.0.smithi005.stdout: 1 82187 14.87 MB/sec warmup 31 sec latency 13.156 ms 2024-08-31T05:31:44.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.061+0000 7f29bb881640 1 -- 172.21.15.5:0/2097528098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29b41050a0 msgr2=0x7f29b410d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:44.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.061+0000 7f29bb881640 1 --2- 172.21.15.5:0/2097528098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29b41050a0 0x7f29b410d5f0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f29a8009900 tx=0x7f29a802a410 comp rx=0 tx=0).stop 2024-08-31T05:31:44.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.061+0000 7f29bb881640 1 -- 172.21.15.5:0/2097528098 shutdown_connections 2024-08-31T05:31:44.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.061+0000 7f29bb881640 1 --2- 172.21.15.5:0/2097528098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29b410dbb0 0x7f29b41100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:44.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.061+0000 7f29bb881640 1 --2- 172.21.15.5:0/2097528098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29b41050a0 0x7f29b410d5f0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:44.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.061+0000 7f29bb881640 1 --2- 172.21.15.5:0/2097528098 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29b4104750 0x7f29b4104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:44.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.061+0000 7f29bb881640 1 -- 172.21.15.5:0/2097528098 >> 172.21.15.5:0/2097528098 conn(0x7f29b40794d0 msgr2=0x7f29b40798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:44.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.061+0000 7f29bb881640 1 -- 172.21.15.5:0/2097528098 shutdown_connections 2024-08-31T05:31:44.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.061+0000 7f29bb881640 1 -- 172.21.15.5:0/2097528098 wait complete. 2024-08-31T05:31:44.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.062+0000 7f29bb881640 1 Processor -- start 2024-08-31T05:31:44.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.063+0000 7f29bb881640 1 -- start start 2024-08-31T05:31:44.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.063+0000 7f29bb881640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29b4104750 0x7f29b419a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:44.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.063+0000 7f29bb881640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29b41050a0 0x7f29b419a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:44.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.063+0000 7f29bb881640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29b410dbb0 0x7f29b419fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:44.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.063+0000 7f29bb881640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f29b41137f0 con 0x7f29b4104750 2024-08-31T05:31:44.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.063+0000 7f29bb881640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f29b4113670 con 0x7f29b410dbb0 2024-08-31T05:31:44.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.063+0000 7f29bb881640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f29b4113970 con 0x7f29b41050a0 2024-08-31T05:31:44.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.063+0000 7f29b961d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29b4104750 0x7f29b419a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:44.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.063+0000 7f29b961d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29b4104750 0x7f29b419a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33972/0 (socket says 172.21.15.5:33972) 2024-08-31T05:31:44.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.063+0000 7f29b961d640 1 -- 172.21.15.5:0/1699120389 learned_addr learned my addr 172.21.15.5:0/1699120389 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:44.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.063+0000 7f29b8e1c640 1 --2- 172.21.15.5:0/1699120389 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29b41050a0 0x7f29b419a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:44.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.063+0000 7f29b9e1e640 1 --2- 172.21.15.5:0/1699120389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29b410dbb0 0x7f29b419fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:44.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.063+0000 7f29b961d640 1 -- 172.21.15.5:0/1699120389 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29b41050a0 msgr2=0x7f29b419a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:44.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.063+0000 7f29b961d640 1 --2- 172.21.15.5:0/1699120389 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29b41050a0 0x7f29b419a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:44.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.063+0000 7f29b961d640 1 -- 172.21.15.5:0/1699120389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29b410dbb0 msgr2=0x7f29b419fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:44.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.063+0000 7f29b961d640 1 --2- 172.21.15.5:0/1699120389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29b410dbb0 0x7f29b419fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:44.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.063+0000 7f29b961d640 1 -- 172.21.15.5:0/1699120389 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29b41a0190 con 0x7f29b4104750 2024-08-31T05:31:44.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.063+0000 7f29b8e1c640 1 --2- 172.21.15.5:0/1699120389 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29b41050a0 0x7f29b419a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:31:44.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.064+0000 7f29b961d640 1 --2- 172.21.15.5:0/1699120389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29b4104750 0x7f29b419a220 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f29b000e9c0 tx=0x7f29b000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:44.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.064+0000 7f29a67fc640 1 -- 172.21.15.5:0/1699120389 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b000cd80 con 0x7f29b4104750 2024-08-31T05:31:44.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.064+0000 7f29bb881640 1 -- 172.21.15.5:0/1699120389 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29b41a0480 con 0x7f29b4104750 2024-08-31T05:31:44.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.064+0000 7f29a67fc640 1 -- 172.21.15.5:0/1699120389 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29b00035f0 con 0x7f29b4104750 2024-08-31T05:31:44.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.064+0000 7f29a67fc640 1 -- 172.21.15.5:0/1699120389 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b0010690 con 0x7f29b4104750 2024-08-31T05:31:44.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.064+0000 7f29bb881640 1 -- 172.21.15.5:0/1699120389 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29b41a6be0 con 0x7f29b4104750 2024-08-31T05:31:44.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.067+0000 7f29c1df6740 1 Processor -- start 2024-08-31T05:31:44.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.067+0000 7f29c1df6740 1 -- start start 2024-08-31T05:31:44.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.067+0000 7f29c1df6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b4cf502070 0x55b4cf8a72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:44.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.067+0000 7f29c1df6740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b4cf4d91b0 0x55b4cf8a7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:44.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.067+0000 7f29c1df6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b4cf4e1390 0x55b4cf8a7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:44.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.067+0000 7f29c1df6740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55b4cf81e630 con 0x55b4cf4d91b0 2024-08-31T05:31:44.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.067+0000 7f29c1df6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b4cf80dbc0 con 0x55b4cf4e1390 2024-08-31T05:31:44.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.067+0000 7f29c1df6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b4cf811b70 con 0x55b4cf502070 2024-08-31T05:31:44.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.068+0000 7f29b9e1e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b4cf502070 0x55b4cf8a72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:44.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.068+0000 7f29a67fc640 1 -- 172.21.15.5:0/1699120389 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f29b0004000 con 0x7f29b4104750 2024-08-31T05:31:44.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.068+0000 7f29b8e1c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b4cf4e1390 0x55b4cf8a7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:44.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.068+0000 7f29b9e1e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b4cf502070 0x55b4cf8a72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:44698/0 (socket says 172.21.15.5:44698) 2024-08-31T05:31:44.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.068+0000 7f29b9e1e640 1 -- 172.21.15.5:0/124981069 learned_addr learned my addr 172.21.15.5:0/124981069 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:44.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.068+0000 7f29b961d640 1 --2- 172.21.15.5:0/124981069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b4cf4d91b0 0x55b4cf8a7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:44.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.068+0000 7f29b9e1e640 1 -- 172.21.15.5:0/124981069 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b4cf4e1390 msgr2=0x55b4cf8a7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:44.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.068+0000 7f29b9e1e640 1 --2- 172.21.15.5:0/124981069 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b4cf4e1390 0x55b4cf8a7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:44.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.068+0000 7f29b9e1e640 1 -- 172.21.15.5:0/124981069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b4cf4d91b0 msgr2=0x55b4cf8a7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:44.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.068+0000 7f29b9e1e640 1 --2- 172.21.15.5:0/124981069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b4cf4d91b0 0x55b4cf8a7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:44.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.068+0000 7f29b9e1e640 1 -- 172.21.15.5:0/124981069 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4cf56d650 con 0x55b4cf502070 2024-08-31T05:31:44.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.068+0000 7f29b961d640 1 --2- 172.21.15.5:0/124981069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b4cf4d91b0 0x55b4cf8a7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:31:44.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.068+0000 7f29b9e1e640 1 --2- 172.21.15.5:0/124981069 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b4cf502070 0x55b4cf8a72c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f29ac010370 tx=0x7f29ac010830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca760bf1ee3faa1e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:44.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.068+0000 7f299f7fe640 1 -- 172.21.15.5:0/124981069 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ac016070 con 0x55b4cf502070 2024-08-31T05:31:44.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.068+0000 7f299f7fe640 1 -- 172.21.15.5:0/124981069 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29ac004d20 con 0x55b4cf502070 2024-08-31T05:31:44.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.069+0000 7f299f7fe640 1 -- 172.21.15.5:0/124981069 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ac005350 con 0x55b4cf502070 2024-08-31T05:31:44.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.069+0000 7f29a67fc640 1 --2- 172.21.15.5:0/1699120389 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f29a00b4ca0 0x7f29a00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:44.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.069+0000 7f29b961d640 1 --2- 172.21.15.5:0/1699120389 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f29a00b4ca0 0x7f29a00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:44.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.069+0000 7f29a67fc640 1 -- 172.21.15.5:0/1699120389 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f29b00e5da0 con 0x7f29b4104750 2024-08-31T05:31:44.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.069+0000 7f29c1df6740 1 -- 172.21.15.5:0/124981069 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b4cf502070 msgr2=0x55b4cf8a72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:44.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.069+0000 7f29c1df6740 1 --2- 172.21.15.5:0/124981069 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b4cf502070 0x55b4cf8a72c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f29ac010370 tx=0x7f29ac010830 comp rx=0 tx=0).stop 2024-08-31T05:31:44.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.070+0000 7f29c1df6740 1 -- 172.21.15.5:0/124981069 shutdown_connections 2024-08-31T05:31:44.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.070+0000 7f29c1df6740 1 --2- 172.21.15.5:0/124981069 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b4cf4e1390 0x55b4cf8a7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:44.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.070+0000 7f29c1df6740 1 --2- 172.21.15.5:0/124981069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b4cf4d91b0 0x55b4cf8a7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:44.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.070+0000 7f29c1df6740 1 --2- 172.21.15.5:0/124981069 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b4cf502070 0x55b4cf8a72c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:44.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.070+0000 7f29c1df6740 1 -- 172.21.15.5:0/124981069 >> 172.21.15.5:0/124981069 conn(0x55b4cf4f6460 msgr2=0x55b4cf8a51b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:44.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.070+0000 7f29c1df6740 1 -- 172.21.15.5:0/124981069 shutdown_connections 2024-08-31T05:31:44.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.070+0000 7f29b961d640 1 --2- 172.21.15.5:0/1699120389 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f29a00b4ca0 0x7f29a00b71b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f29b00e3220 tx=0x7f29b0003e70 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:44.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.070+0000 7f29c1df6740 1 -- 172.21.15.5:0/124981069 wait complete. 2024-08-31T05:31:44.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.070+0000 7f29c1df6740 1 -- start start 2024-08-31T05:31:44.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.070+0000 7f29c1df6740 1 Processor -- start 2024-08-31T05:31:44.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.071+0000 7f29c1df6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b4cf4d91b0 0x55b4cf8b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:44.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.071+0000 7f29c1df6740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b4cf4e1390 0x55b4cf8b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:44.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.071+0000 7f29c1df6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b4cf502070 0x55b4cf8bed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:44.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.071+0000 7f29c1df6740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55b4cf670700 con 0x55b4cf4e1390 2024-08-31T05:31:44.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.071+0000 7f29c1df6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b4cf794700 con 0x55b4cf502070 2024-08-31T05:31:44.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.071+0000 7f29c1df6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b4cf8b5aa0 con 0x55b4cf4d91b0 2024-08-31T05:31:44.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.071+0000 7f29b8e1c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b4cf4e1390 0x55b4cf8b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:44.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.071+0000 7f29c1df6740 10 client.0 _ll_register_callbacks cb 0x55b4cf7c3dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:31:44.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.071+0000 7f29b8e1c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b4cf4e1390 0x55b4cf8b2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33998/0 (socket says 172.21.15.5:33998) 2024-08-31T05:31:44.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.071+0000 7f29b9e1e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b4cf502070 0x55b4cf8bed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:44.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.071+0000 7f29b8e1c640 1 -- 172.21.15.5:0/283463695 learned_addr learned my addr 172.21.15.5:0/283463695 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:44.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.071+0000 7f29b9e1e640 1 --2- 172.21.15.5:0/283463695 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b4cf4d91b0 0x55b4cf8b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:44.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.072+0000 7f29b9e1e640 1 -- 172.21.15.5:0/283463695 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b4cf4d91b0 msgr2=0x55b4cf8b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:44.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.072+0000 7f29b9e1e640 1 --2- 172.21.15.5:0/283463695 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b4cf4d91b0 0x55b4cf8b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:44.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.072+0000 7f29b9e1e640 1 -- 172.21.15.5:0/283463695 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b4cf4e1390 msgr2=0x55b4cf8b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:44.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.072+0000 7f29b9e1e640 1 --2- 172.21.15.5:0/283463695 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b4cf4e1390 0x55b4cf8b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:44.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.072+0000 7f29b9e1e640 1 -- 172.21.15.5:0/283463695 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4cf7cd8b0 con 0x55b4cf502070 2024-08-31T05:31:44.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.072+0000 7f29b8e1c640 1 --2- 172.21.15.5:0/283463695 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b4cf4e1390 0x55b4cf8b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:31:44.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.072+0000 7f29b9e1e640 1 --2- 172.21.15.5:0/283463695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b4cf502070 0x55b4cf8bed90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f29ac004ff0 tx=0x7f29ac012ea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5de2181dd5f146 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:44.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.072+0000 7f299cff9640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:31:44.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.072+0000 7f299cff9640 1 -- 172.21.15.5:0/283463695 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ac016070 con 0x55b4cf502070 2024-08-31T05:31:44.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.072+0000 7f29c1df6740 1 -- 172.21.15.5:0/283463695 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29ac004d20 con 0x55b4cf502070 2024-08-31T05:31:44.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.072+0000 7f299cff9640 1 -- 172.21.15.5:0/283463695 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f29ac005730 con 0x55b4cf502070 2024-08-31T05:31:44.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.072+0000 7f299cff9640 1 -- 172.21.15.5:0/283463695 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f29ac033050 con 0x55b4cf502070 2024-08-31T05:31:44.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.072+0000 7f29c1df6740 10 client.25679 fetch_fsmap learned FSMap version 32 2024-08-31T05:31:44.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.072+0000 7f29c1df6740 1 -- 172.21.15.5:0/283463695 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55b4cf8c1820 con 0x55b4cf502070 2024-08-31T05:31:44.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.073+0000 7f299cff9640 1 -- 172.21.15.5:0/283463695 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29ac004d20 con 0x55b4cf502070 2024-08-31T05:31:44.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.073+0000 7f299cff9640 1 -- 172.21.15.5:0/283463695 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f29ac00f040 con 0x55b4cf502070 2024-08-31T05:31:44.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.073+0000 7f29c1df6740 10 client.25679 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:31:44.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.073+0000 7f29c1df6740 10 client.25679 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:31:44.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.073+0000 7f29c1df6740 20 client.25679 populate_metadata read hostname 'smithi005' 2024-08-31T05:31:44.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.073+0000 7f29c1df6740 1 --2- 172.21.15.5:0/283463695 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55b4cf4c09f0 0x55b4cf8c5170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:44.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.073+0000 7f29c1df6740 4 client.25679 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:31:44.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.073+0000 7f29c1df6740 1 -- 172.21.15.5:0/283463695 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b4cf820580 con 0x55b4cf4c09f0 2024-08-31T05:31:44.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.073+0000 7f29b8e1c640 1 --2- 172.21.15.5:0/283463695 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55b4cf4c09f0 0x55b4cf8c5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:44.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.074+0000 7f299cff9640 10 client.25679 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:31:44.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.074+0000 7f29b8e1c640 1 --2- 172.21.15.5:0/283463695 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55b4cf4c09f0 0x55b4cf8c5170 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8517bbf19e0b3c5f server_cookie=6c95fba7a3232c8b in_seq=0 out_seq=0 2024-08-31T05:31:44.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.075+0000 7f299cff9640 1 -- 172.21.15.5:0/283463695 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b4cf820580 con 0x55b4cf4c09f0 2024-08-31T05:31:44.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.075+0000 7f299cff9640 10 client.25679 handle_command_reply: tid=0 2024-08-31T05:31:44.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.075+0000 7f29c1df6740 1 client.25679 shutdown 2024-08-31T05:31:44.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.075+0000 7f29c1df6740 1 -- 172.21.15.5:0/283463695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b4cf502070 msgr2=0x55b4cf8bed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:44.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.075+0000 7f29c1df6740 1 --2- 172.21.15.5:0/283463695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b4cf502070 0x55b4cf8bed90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f29ac004ff0 tx=0x7f29ac012ea0 comp rx=0 tx=0).stop 2024-08-31T05:31:44.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.075+0000 7f29c1df6740 1 -- 172.21.15.5:0/283463695 shutdown_connections 2024-08-31T05:31:44.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.075+0000 7f29c1df6740 1 --2- 172.21.15.5:0/283463695 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55b4cf4c09f0 0x55b4cf8c5170 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:44.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.075+0000 7f29c1df6740 1 --2- 172.21.15.5:0/283463695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b4cf502070 0x55b4cf8bed90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:44.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.075+0000 7f29c1df6740 1 --2- 172.21.15.5:0/283463695 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b4cf4e1390 0x55b4cf8b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:44.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.075+0000 7f299cff9640 0 client.25679 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:31:44.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.075+0000 7f29c1df6740 1 --2- 172.21.15.5:0/283463695 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b4cf4d91b0 0x55b4cf8b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:44.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.075+0000 7f29c1df6740 1 -- 172.21.15.5:0/283463695 >> 172.21.15.5:0/283463695 conn(0x55b4cf4f6460 msgr2=0x55b4cf8aa450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:44.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.075+0000 7f29c1df6740 1 -- 172.21.15.5:0/283463695 shutdown_connections 2024-08-31T05:31:44.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.075+0000 7f29c1df6740 1 -- 172.21.15.5:0/283463695 wait complete. 2024-08-31T05:31:44.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.075+0000 7f29c1df6740 20 client.25679 trim_cache size 0 max 16384 2024-08-31T05:31:44.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.094+0000 7f29c1df6740 1 Processor -- start 2024-08-31T05:31:44.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.094+0000 7f29c1df6740 1 -- start start 2024-08-31T05:31:44.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.094+0000 7f29c1df6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b4cf4d91b0 0x55b4cf8a52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:44.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.094+0000 7f29c1df6740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b4cf4e1390 0x55b4cf8adc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:44.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.094+0000 7f29c1df6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b4cf502070 0x55b4cf8bec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:44.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.094+0000 7f29c1df6740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f29b41b0ca0 con 0x55b4cf4e1390 2024-08-31T05:31:44.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.094+0000 7f29c1df6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f29b41b28a0 con 0x55b4cf502070 2024-08-31T05:31:44.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.094+0000 7f29c1df6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f29b41b1370 con 0x55b4cf4d91b0 2024-08-31T05:31:44.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.095+0000 7f29b8e1c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b4cf4e1390 0x55b4cf8adc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:44.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.095+0000 7f29b9e1e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b4cf4d91b0 0x55b4cf8a52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:44.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.095+0000 7f29b8e1c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b4cf4e1390 0x55b4cf8adc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34010/0 (socket says 172.21.15.5:34010) 2024-08-31T05:31:44.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.095+0000 7f29b8e1c640 1 -- 172.21.15.5:0/2318979526 learned_addr learned my addr 172.21.15.5:0/2318979526 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:44.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.095+0000 7f29b9e1e640 1 --2- 172.21.15.5:0/2318979526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b4cf502070 0x55b4cf8bec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:44.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.095+0000 7f29b8e1c640 1 -- 172.21.15.5:0/2318979526 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b4cf4d91b0 msgr2=0x55b4cf8a52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:44.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.095+0000 7f29b8e1c640 1 --2- 172.21.15.5:0/2318979526 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b4cf4d91b0 0x55b4cf8a52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:44.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.095+0000 7f29b8e1c640 1 -- 172.21.15.5:0/2318979526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b4cf502070 msgr2=0x55b4cf8bec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:44.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.095+0000 7f29b8e1c640 1 --2- 172.21.15.5:0/2318979526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b4cf502070 0x55b4cf8bec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:44.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.095+0000 7f29b8e1c640 1 -- 172.21.15.5:0/2318979526 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4cf8b19f0 con 0x55b4cf4e1390 2024-08-31T05:31:44.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.095+0000 7f29b8e1c640 1 --2- 172.21.15.5:0/2318979526 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b4cf4e1390 0x55b4cf8adc40 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f29b406aad0 tx=0x7f29a8031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=817bcb1ac6b99585 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:44.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.095+0000 7f299effd640 1 -- 172.21.15.5:0/2318979526 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a804a020 con 0x55b4cf4e1390 2024-08-31T05:31:44.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.095+0000 7f299effd640 1 -- 172.21.15.5:0/2318979526 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29a80054f0 con 0x55b4cf4e1390 2024-08-31T05:31:44.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.095+0000 7f299effd640 1 -- 172.21.15.5:0/2318979526 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a8035040 con 0x55b4cf4e1390 2024-08-31T05:31:44.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.096+0000 7f29c1df6740 1 -- 172.21.15.5:0/2318979526 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b4cf4e1390 msgr2=0x55b4cf8adc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:44.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.096+0000 7f29c1df6740 1 --2- 172.21.15.5:0/2318979526 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b4cf4e1390 0x55b4cf8adc40 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f29b406aad0 tx=0x7f29a8031400 comp rx=0 tx=0).stop 2024-08-31T05:31:44.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.096+0000 7f29c1df6740 1 -- 172.21.15.5:0/2318979526 shutdown_connections 2024-08-31T05:31:44.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.096+0000 7f29c1df6740 1 --2- 172.21.15.5:0/2318979526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b4cf502070 0x55b4cf8bec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:44.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.096+0000 7f29c1df6740 1 --2- 172.21.15.5:0/2318979526 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b4cf4e1390 0x55b4cf8adc40 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:44.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.096+0000 7f29c1df6740 1 --2- 172.21.15.5:0/2318979526 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b4cf4d91b0 0x55b4cf8a52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:44.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.096+0000 7f29c1df6740 1 -- 172.21.15.5:0/2318979526 >> 172.21.15.5:0/2318979526 conn(0x55b4cf4f6460 msgr2=0x55b4cf8a4ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:44.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.096+0000 7f29c1df6740 1 -- 172.21.15.5:0/2318979526 shutdown_connections 2024-08-31T05:31:44.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.096+0000 7f29c1df6740 1 -- 172.21.15.5:0/2318979526 wait complete. 2024-08-31T05:31:44.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.096+0000 7f29c1df6740 1 -- start start 2024-08-31T05:31:44.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.097+0000 7f29c1df6740 1 Processor -- start 2024-08-31T05:31:44.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.097+0000 7f29c1df6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b4cf4d91b0 0x55b4cf8bb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:44.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.097+0000 7f29c1df6740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b4cf4e1390 0x55b4cf8b6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:44.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.097+0000 7f29c1df6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b4cf502070 0x55b4cf8b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:44.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.097+0000 7f29c1df6740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f29b41b2110 con 0x55b4cf4e1390 2024-08-31T05:31:44.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.097+0000 7f29c1df6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f29b41b1a40 con 0x55b4cf502070 2024-08-31T05:31:44.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.097+0000 7f29c1df6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f29b41aec80 con 0x55b4cf4d91b0 2024-08-31T05:31:44.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.097+0000 7f29c1df6740 10 client.0 _ll_register_callbacks cb 0x7f29a8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:31:44.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.097+0000 7f29b9e1e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b4cf4d91b0 0x55b4cf8bb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:44.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.097+0000 7f29b8e1c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b4cf4e1390 0x55b4cf8b6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:44.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.097+0000 7f29b9e1e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b4cf4d91b0 0x55b4cf8bb3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:44706/0 (socket says 172.21.15.5:44706) 2024-08-31T05:31:44.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.097+0000 7f29b9e1e640 1 -- 172.21.15.5:0/1483681616 learned_addr learned my addr 172.21.15.5:0/1483681616 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:44.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.097+0000 7f29b9e1e640 1 --2- 172.21.15.5:0/1483681616 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b4cf502070 0x55b4cf8b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:44.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.098+0000 7f29b8e1c640 1 -- 172.21.15.5:0/1483681616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b4cf4d91b0 msgr2=0x55b4cf8bb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:44.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.098+0000 7f29b8e1c640 1 --2- 172.21.15.5:0/1483681616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b4cf4d91b0 0x55b4cf8bb3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:44.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.098+0000 7f29b8e1c640 1 -- 172.21.15.5:0/1483681616 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b4cf502070 msgr2=0x55b4cf8b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:44.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.098+0000 7f29b8e1c640 1 --2- 172.21.15.5:0/1483681616 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b4cf502070 0x55b4cf8b6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:44.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.098+0000 7f29b8e1c640 1 -- 172.21.15.5:0/1483681616 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4cf8b7420 con 0x55b4cf4e1390 2024-08-31T05:31:44.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.098+0000 7f29b9e1e640 1 --2- 172.21.15.5:0/1483681616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b4cf4d91b0 0x55b4cf8bb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:31:44.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.098+0000 7f29b8e1c640 1 --2- 172.21.15.5:0/1483681616 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b4cf4e1390 0x55b4cf8b6870 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f29a8009850 tx=0x7f29a8032f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=babc3ef7cea5e86c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:44.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.098+0000 7f299cff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:31:44.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.098+0000 7f299cff9640 1 -- 172.21.15.5:0/1483681616 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a804a030 con 0x55b4cf4e1390 2024-08-31T05:31:44.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.098+0000 7f299cff9640 1 -- 172.21.15.5:0/1483681616 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f29a8004770 con 0x55b4cf4e1390 2024-08-31T05:31:44.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.098+0000 7f29c1df6740 1 -- 172.21.15.5:0/1483681616 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29a80054f0 con 0x55b4cf4e1390 2024-08-31T05:31:44.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.098+0000 7f299cff9640 1 -- 172.21.15.5:0/1483681616 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f29a805f050 con 0x55b4cf4e1390 2024-08-31T05:31:44.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.098+0000 7f29c1df6740 10 client.16086 fetch_fsmap learned FSMap version 32 2024-08-31T05:31:44.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.098+0000 7f29c1df6740 1 -- 172.21.15.5:0/1483681616 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55b4cf92f940 con 0x55b4cf4e1390 2024-08-31T05:31:44.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.099+0000 7f299cff9640 1 -- 172.21.15.5:0/1483681616 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29a80054f0 con 0x55b4cf4e1390 2024-08-31T05:31:44.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.099+0000 7f299cff9640 1 -- 172.21.15.5:0/1483681616 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f29a8031cb0 con 0x55b4cf4e1390 2024-08-31T05:31:44.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.099+0000 7f29c1df6740 10 client.16086 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:31:44.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.099+0000 7f29c1df6740 10 client.16086 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:31:44.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.099+0000 7f29c1df6740 20 client.16086 populate_metadata read hostname 'smithi005' 2024-08-31T05:31:44.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.099+0000 7f29c1df6740 1 --2- 172.21.15.5:0/1483681616 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55b4cf495da0 0x55b4cf9320b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:44.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.099+0000 7f29c1df6740 4 client.16086 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T05:31:44.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.099+0000 7f29c1df6740 1 -- 172.21.15.5:0/1483681616 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b4cf81c020 con 0x55b4cf495da0 2024-08-31T05:31:44.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.099+0000 7f29b9e1e640 1 --2- 172.21.15.5:0/1483681616 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55b4cf495da0 0x55b4cf9320b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:44.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.099+0000 7f299cff9640 10 client.16086 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:31:44.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.099+0000 7f29b9e1e640 1 --2- 172.21.15.5:0/1483681616 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55b4cf495da0 0x55b4cf9320b0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=263e9fb899d63f5c server_cookie=8cad8e957a23905 in_seq=0 out_seq=0 2024-08-31T05:31:44.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.100+0000 7f299cff9640 1 -- 172.21.15.5:0/1483681616 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1138 (crc 0 0 0) 0x55b4cf81c020 con 0x55b4cf495da0 2024-08-31T05:31:44.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.100+0000 7f299cff9640 10 client.16086 handle_command_reply: tid=0 2024-08-31T05:31:44.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.100+0000 7f29c1df6740 1 client.16086 shutdown 2024-08-31T05:31:44.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.100+0000 7f29c1df6740 1 -- 172.21.15.5:0/1483681616 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b4cf4e1390 msgr2=0x55b4cf8b6870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:44.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.100+0000 7f29c1df6740 1 --2- 172.21.15.5:0/1483681616 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b4cf4e1390 0x55b4cf8b6870 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f29a8009850 tx=0x7f29a8032f60 comp rx=0 tx=0).stop 2024-08-31T05:31:44.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.100+0000 7f29c1df6740 1 -- 172.21.15.5:0/1483681616 shutdown_connections 2024-08-31T05:31:44.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.100+0000 7f29c1df6740 1 --2- 172.21.15.5:0/1483681616 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55b4cf495da0 0x55b4cf9320b0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:44.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.100+0000 7f29c1df6740 1 --2- 172.21.15.5:0/1483681616 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b4cf502070 0x55b4cf8b6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:44.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.100+0000 7f29c1df6740 1 --2- 172.21.15.5:0/1483681616 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b4cf4e1390 0x55b4cf8b6870 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:44.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.100+0000 7f29c1df6740 1 --2- 172.21.15.5:0/1483681616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b4cf4d91b0 0x55b4cf8bb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:44.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.100+0000 7f299cff9640 0 client.16086 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:31:44.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.100+0000 7f29c1df6740 1 -- 172.21.15.5:0/1483681616 >> 172.21.15.5:0/1483681616 conn(0x55b4cf4f6460 msgr2=0x55b4cf8a4990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:44.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.100+0000 7f29c1df6740 1 -- 172.21.15.5:0/1483681616 shutdown_connections 2024-08-31T05:31:44.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.100+0000 7f29c1df6740 1 -- 172.21.15.5:0/1483681616 wait complete. 2024-08-31T05:31:44.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.100+0000 7f29c1df6740 20 client.16086 trim_cache size 0 max 16384 2024-08-31T05:31:44.109 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:31:44.109 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T05:31:44.109 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2024-08-31T05:31:44.109 INFO:teuthology.orchestra.run.smithi005.stdout: "ece37b07-9ab2-45f8-bc33-2755a07aac0b": { 2024-08-31T05:31:44.109 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:31:44.109 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "ece37b07-9ab2-45f8-bc33-2755a07aac0b", 2024-08-31T05:31:44.109 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2024-08-31T05:31:44.109 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:31:44.109 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:31:44.109 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_stats": { 2024-08-31T05:31:44.109 INFO:teuthology.orchestra.run.smithi005.stdout: "cda92ac0-b35f-47a5-a3a5-471c888462a5": { 2024-08-31T05:31:44.109 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:53.103905+0000", 2024-08-31T05:31:44.109 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:31:44.109 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:31:44.110 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:31:44.110 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:31:44.110 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:31:44.110 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:31:44.110 INFO:teuthology.orchestra.run.smithi005.stdout: "ece37b07-9ab2-45f8-bc33-2755a07aac0b": { 2024-08-31T05:31:44.110 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:31:41.782407+0000", 2024-08-31T05:31:44.110 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:31:44.110 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:31:44.110 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:31:44.110 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:31:44.110 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:31:44.110 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:31:44.110 INFO:teuthology.orchestra.run.smithi005.stdout: "75d84398-5d9c-4872-b879-2fbce045fa71": { 2024-08-31T05:31:44.110 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:06.642335+0000", 2024-08-31T05:31:44.111 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:31:44.111 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:31:44.111 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:31:44.111 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:31:44.111 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:31:44.111 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:31:44.111 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:31:44.111 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:31:44.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.101+0000 7f29bb881640 1 -- 172.21.15.5:0/1699120389 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f29a00b4ca0 msgr2=0x7f29a00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:44.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.101+0000 7f29bb881640 1 --2- 172.21.15.5:0/1699120389 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f29a00b4ca0 0x7f29a00b71b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f29b00e3220 tx=0x7f29b0003e70 comp rx=0 tx=0).stop 2024-08-31T05:31:44.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.101+0000 7f29bb881640 1 -- 172.21.15.5:0/1699120389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29b4104750 msgr2=0x7f29b419a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:44.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.101+0000 7f29bb881640 1 --2- 172.21.15.5:0/1699120389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29b4104750 0x7f29b419a220 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f29b000e9c0 tx=0x7f29b000ee80 comp rx=0 tx=0).stop 2024-08-31T05:31:44.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.101+0000 7f29bb881640 1 -- 172.21.15.5:0/1699120389 shutdown_connections 2024-08-31T05:31:44.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.101+0000 7f29bb881640 1 --2- 172.21.15.5:0/1699120389 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f29a00b4ca0 0x7f29a00b71b0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:44.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.101+0000 7f29bb881640 1 --2- 172.21.15.5:0/1699120389 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29b410dbb0 0x7f29b419fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:44.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.101+0000 7f29bb881640 1 --2- 172.21.15.5:0/1699120389 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29b41050a0 0x7f29b419a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:44.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.101+0000 7f29bb881640 1 --2- 172.21.15.5:0/1699120389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29b4104750 0x7f29b419a220 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:44.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.101+0000 7f29bb881640 1 -- 172.21.15.5:0/1699120389 >> 172.21.15.5:0/1699120389 conn(0x7f29b40794d0 msgr2=0x7f29b41005c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:44.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.101+0000 7f29bb881640 1 -- 172.21.15.5:0/1699120389 shutdown_connections 2024-08-31T05:31:44.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:31:44.101+0000 7f29bb881640 1 -- 172.21.15.5:0/1699120389 wait complete. 2024-08-31T05:31:44.908 INFO:tasks.workunit.client.0.smithi005.stdout: 1 85284 14.96 MB/sec warmup 32 sec latency 16.519 ms 2024-08-31T05:31:44.910 INFO:tasks.cephfs.filesystem:scrub status for tag:ece37b07-9ab2-45f8-bc33-2755a07aac0b - {'path': '/', 'tag': 'ece37b07-9ab2-45f8-bc33-2755a07aac0b', 'options': 'recursive,force'} 2024-08-31T05:31:45.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:31:45 smithi050 ceph-mon[22146]: pgmap v398: 129 pgs: 129 active+clean; 84 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 877 KiB/s rd, 7.0 MiB/s wr, 266 op/s 2024-08-31T05:31:45.466 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:31:45 smithi005 ceph-mon[18602]: pgmap v398: 129 pgs: 129 active+clean; 84 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 877 KiB/s rd, 7.0 MiB/s wr, 266 op/s 2024-08-31T05:31:45.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:31:45 smithi070 ceph-mon[22316]: pgmap v398: 129 pgs: 129 active+clean; 84 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 877 KiB/s rd, 7.0 MiB/s wr, 266 op/s 2024-08-31T05:31:45.909 INFO:tasks.workunit.client.0.smithi005.stdout: 1 87617 14.76 MB/sec warmup 33 sec latency 13.124 ms 2024-08-31T05:31:46.909 INFO:tasks.workunit.client.0.smithi005.stdout: 1 89798 14.74 MB/sec warmup 34 sec latency 15.438 ms 2024-08-31T05:31:47.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:31:47 smithi050 ceph-mon[22146]: pgmap v399: 129 pgs: 129 active+clean; 44 MiB data, 523 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 7.9 MiB/s wr, 381 op/s 2024-08-31T05:31:47.466 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:31:47 smithi005 ceph-mon[18602]: pgmap v399: 129 pgs: 129 active+clean; 44 MiB data, 523 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 7.9 MiB/s wr, 381 op/s 2024-08-31T05:31:47.585 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:31:47 smithi070 ceph-mon[22316]: pgmap v399: 129 pgs: 129 active+clean; 44 MiB data, 523 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 7.9 MiB/s wr, 381 op/s 2024-08-31T05:31:47.909 INFO:tasks.workunit.client.0.smithi005.stdout: 1 92686 14.81 MB/sec warmup 35 sec latency 14.041 ms 2024-08-31T05:31:48.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:31:48 smithi050 ceph-mon[22146]: scrub summary: idle 2024-08-31T05:31:48.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:31:48 smithi050 ceph-mon[22146]: scrub summary: idle 2024-08-31T05:31:48.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:31:48 smithi005 ceph-mon[18602]: scrub summary: idle 2024-08-31T05:31:48.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:31:48 smithi005 ceph-mon[18602]: scrub summary: idle 2024-08-31T05:31:48.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:31:48 smithi070 ceph-mon[22316]: scrub summary: idle 2024-08-31T05:31:48.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:31:48 smithi070 ceph-mon[22316]: scrub summary: idle 2024-08-31T05:31:48.909 INFO:tasks.workunit.client.0.smithi005.stdout: 1 95776 14.88 MB/sec warmup 36 sec latency 12.121 ms 2024-08-31T05:31:49.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:31:49 smithi050 ceph-mon[22146]: pgmap v400: 129 pgs: 129 active+clean; 49 MiB data, 530 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 7.9 MiB/s wr, 403 op/s 2024-08-31T05:31:49.466 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:31:49 smithi005 ceph-mon[18602]: pgmap v400: 129 pgs: 129 active+clean; 49 MiB data, 530 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 7.9 MiB/s wr, 403 op/s 2024-08-31T05:31:49.585 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:31:49 smithi070 ceph-mon[22316]: pgmap v400: 129 pgs: 129 active+clean; 49 MiB data, 530 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 7.9 MiB/s wr, 403 op/s 2024-08-31T05:31:49.909 INFO:tasks.workunit.client.0.smithi005.stdout: 1 97810 14.67 MB/sec warmup 37 sec latency 12.480 ms 2024-08-31T05:31:50.909 INFO:tasks.workunit.client.0.smithi005.stdout: 1 100146 14.65 MB/sec warmup 38 sec latency 24.083 ms 2024-08-31T05:31:51.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:31:51 smithi050 ceph-mon[22146]: pgmap v401: 129 pgs: 129 active+clean; 52 MiB data, 526 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 8.0 MiB/s wr, 410 op/s 2024-08-31T05:31:51.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:31:51 smithi005 ceph-mon[18602]: pgmap v401: 129 pgs: 129 active+clean; 52 MiB data, 526 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 8.0 MiB/s wr, 410 op/s 2024-08-31T05:31:51.585 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:31:51 smithi070 ceph-mon[22316]: pgmap v401: 129 pgs: 129 active+clean; 52 MiB data, 526 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 8.0 MiB/s wr, 410 op/s 2024-08-31T05:31:51.909 INFO:tasks.workunit.client.0.smithi005.stdout: 1 103232 14.75 MB/sec warmup 39 sec latency 12.618 ms 2024-08-31T05:31:52.909 INFO:tasks.workunit.client.0.smithi005.stdout: 1 105931 14.70 MB/sec warmup 40 sec latency 12.271 ms 2024-08-31T05:31:53.232 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.230+0000 7ff2aecdc640 1 -- 172.21.15.5:0/1692161208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2a81089e0 msgr2=0x7ff2a810f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:53.232 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.230+0000 7ff2aecdc640 1 --2- 172.21.15.5:0/1692161208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2a81089e0 0x7ff2a810f210 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7ff2a0009ca0 tx=0x7ff2a002a8c0 comp rx=0 tx=0).stop 2024-08-31T05:31:53.233 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.230+0000 7ff2aecdc640 1 -- 172.21.15.5:0/1692161208 shutdown_connections 2024-08-31T05:31:53.233 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.230+0000 7ff2aecdc640 1 --2- 172.21.15.5:0/1692161208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2a81089e0 0x7ff2a810f210 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:53.233 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.230+0000 7ff2aecdc640 1 --2- 172.21.15.5:0/1692161208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2a8108090 0x7ff2a81084a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:53.233 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.230+0000 7ff2aecdc640 1 --2- 172.21.15.5:0/1692161208 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2a8102760 0x7ff2a8102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:53.233 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.230+0000 7ff2aecdc640 1 -- 172.21.15.5:0/1692161208 >> 172.21.15.5:0/1692161208 conn(0x7ff2a80fe160 msgr2=0x7ff2a81005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:53.233 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.230+0000 7ff2aecdc640 1 -- 172.21.15.5:0/1692161208 shutdown_connections 2024-08-31T05:31:53.233 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.230+0000 7ff2aecdc640 1 -- 172.21.15.5:0/1692161208 wait complete. 2024-08-31T05:31:53.233 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.230+0000 7ff2aecdc640 1 Processor -- start 2024-08-31T05:31:53.233 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.231+0000 7ff2aecdc640 1 -- start start 2024-08-31T05:31:53.235 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.231+0000 7ff2aecdc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2a8102760 0x7ff2a8199130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:53.235 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.231+0000 7ff2aecdc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2a8108090 0x7ff2a81996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:53.235 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.231+0000 7ff2aecdc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2a81089e0 0x7ff2a819e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:53.235 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.231+0000 7ff2aecdc640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a8112690 con 0x7ff2a8108090 2024-08-31T05:31:53.235 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.231+0000 7ff2aecdc640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a8112510 con 0x7ff2a81089e0 2024-08-31T05:31:53.235 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.231+0000 7ff2aecdc640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a8112810 con 0x7ff2a8102760 2024-08-31T05:31:53.235 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.231+0000 7ff2a7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2a8108090 0x7ff2a81996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:53.235 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.231+0000 7ff2a7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2a8108090 0x7ff2a81996d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38552/0 (socket says 172.21.15.5:38552) 2024-08-31T05:31:53.235 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.231+0000 7ff2aca78640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2a8102760 0x7ff2a8199130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:53.235 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.231+0000 7ff2a7fff640 1 -- 172.21.15.5:0/4292283003 learned_addr learned my addr 172.21.15.5:0/4292283003 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:53.235 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.231+0000 7ff2ad279640 1 --2- 172.21.15.5:0/4292283003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2a81089e0 0x7ff2a819e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:53.235 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.231+0000 7ff2a7fff640 1 -- 172.21.15.5:0/4292283003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2a8102760 msgr2=0x7ff2a8199130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:53.236 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.231+0000 7ff2a7fff640 1 --2- 172.21.15.5:0/4292283003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2a8102760 0x7ff2a8199130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:53.236 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.231+0000 7ff2a7fff640 1 -- 172.21.15.5:0/4292283003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2a81089e0 msgr2=0x7ff2a819e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:53.236 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.231+0000 7ff2a7fff640 1 --2- 172.21.15.5:0/4292283003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2a81089e0 0x7ff2a819e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:53.236 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.231+0000 7ff2a7fff640 1 -- 172.21.15.5:0/4292283003 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2a819f060 con 0x7ff2a8108090 2024-08-31T05:31:53.236 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.231+0000 7ff2a7fff640 1 --2- 172.21.15.5:0/4292283003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2a8108090 0x7ff2a81996d0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7ff29400e9f0 tx=0x7ff29400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:53.236 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.232+0000 7ff2a5ffb640 1 -- 172.21.15.5:0/4292283003 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff29400ccc0 con 0x7ff2a8108090 2024-08-31T05:31:53.236 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.232+0000 7ff2aecdc640 1 -- 172.21.15.5:0/4292283003 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2a819f350 con 0x7ff2a8108090 2024-08-31T05:31:53.236 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.232+0000 7ff2a5ffb640 1 -- 172.21.15.5:0/4292283003 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2940108e0 con 0x7ff2a8108090 2024-08-31T05:31:53.236 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.232+0000 7ff2a5ffb640 1 -- 172.21.15.5:0/4292283003 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff294018860 con 0x7ff2a8108090 2024-08-31T05:31:53.236 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.232+0000 7ff2aecdc640 1 -- 172.21.15.5:0/4292283003 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2a81a5ae0 con 0x7ff2a8108090 2024-08-31T05:31:53.238 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.235+0000 7ff2a5ffb640 1 -- 172.21.15.5:0/4292283003 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7ff294010430 con 0x7ff2a8108090 2024-08-31T05:31:53.238 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.235+0000 7ff2b5c49740 1 Processor -- start 2024-08-31T05:31:53.238 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.235+0000 7ff2b5c49740 1 -- start start 2024-08-31T05:31:53.239 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.235+0000 7ff2b5c49740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8f1ad21b0 0x55d8f1e75ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:53.239 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.235+0000 7ff2b5c49740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d8f1aa92f0 0x55d8f1e76000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:53.239 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.235+0000 7ff2b5c49740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d8f1ab14d0 0x55d8f1e76540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:53.239 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.235+0000 7ff2b5c49740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55d8f1deb000 con 0x55d8f1ad21b0 2024-08-31T05:31:53.239 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.235+0000 7ff2b5c49740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d8f1dda590 con 0x55d8f1aa92f0 2024-08-31T05:31:53.239 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.235+0000 7ff2b5c49740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d8f1dde540 con 0x55d8f1ab14d0 2024-08-31T05:31:53.239 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.235+0000 7ff2ad279640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8f1ad21b0 0x55d8f1e75ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:53.239 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.235+0000 7ff2aca78640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d8f1aa92f0 0x55d8f1e76000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:53.239 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.235+0000 7ff2aca78640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d8f1aa92f0 0x55d8f1e76000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:39540/0 (socket says 172.21.15.5:39540) 2024-08-31T05:31:53.239 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.235+0000 7ff2aca78640 1 -- 172.21.15.5:0/14944549 learned_addr learned my addr 172.21.15.5:0/14944549 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:53.239 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.235+0000 7ff2a7fff640 1 --2- 172.21.15.5:0/14944549 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d8f1ab14d0 0x55d8f1e76540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:53.240 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.236+0000 7ff2aca78640 1 -- 172.21.15.5:0/14944549 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d8f1ab14d0 msgr2=0x55d8f1e76540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:53.240 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.236+0000 7ff2aca78640 1 --2- 172.21.15.5:0/14944549 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d8f1ab14d0 0x55d8f1e76540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:53.240 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.236+0000 7ff2aca78640 1 -- 172.21.15.5:0/14944549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8f1ad21b0 msgr2=0x55d8f1e75ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:53.240 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.236+0000 7ff2aca78640 1 --2- 172.21.15.5:0/14944549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8f1ad21b0 0x55d8f1e75ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:53.240 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.236+0000 7ff2aca78640 1 -- 172.21.15.5:0/14944549 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8f1b3d790 con 0x55d8f1aa92f0 2024-08-31T05:31:53.240 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.236+0000 7ff2a5ffb640 1 --2- 172.21.15.5:0/4292283003 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff2980b4ca0 0x7ff2980b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:53.240 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.236+0000 7ff2aca78640 1 --2- 172.21.15.5:0/14944549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d8f1aa92f0 0x55d8f1e76000 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff29c009d20 tx=0x7ff29c011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc456f7e7423caf8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:53.240 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.236+0000 7ff2ad279640 1 --2- 172.21.15.5:0/4292283003 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff2980b4ca0 0x7ff2980b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:53.240 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.236+0000 7ff2a5ffb640 1 -- 172.21.15.5:0/4292283003 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7ff2940e5ae0 con 0x7ff2a8108090 2024-08-31T05:31:53.240 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.236+0000 7ff292ffd640 1 -- 172.21.15.5:0/14944549 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff29c004230 con 0x55d8f1aa92f0 2024-08-31T05:31:53.240 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.236+0000 7ff292ffd640 1 -- 172.21.15.5:0/14944549 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff29c0043d0 con 0x55d8f1aa92f0 2024-08-31T05:31:53.240 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.236+0000 7ff292ffd640 1 -- 172.21.15.5:0/14944549 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff29c019860 con 0x55d8f1aa92f0 2024-08-31T05:31:53.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.237+0000 7ff2b5c49740 1 -- 172.21.15.5:0/14944549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d8f1aa92f0 msgr2=0x55d8f1e76000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:53.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.237+0000 7ff2ad279640 1 --2- 172.21.15.5:0/4292283003 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff2980b4ca0 0x7ff2980b71b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff2a002f500 tx=0x7ff2a002f310 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:53.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.237+0000 7ff2b5c49740 1 --2- 172.21.15.5:0/14944549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d8f1aa92f0 0x55d8f1e76000 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff29c009d20 tx=0x7ff29c011810 comp rx=0 tx=0).stop 2024-08-31T05:31:53.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.237+0000 7ff2b5c49740 1 -- 172.21.15.5:0/14944549 shutdown_connections 2024-08-31T05:31:53.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.237+0000 7ff2b5c49740 1 --2- 172.21.15.5:0/14944549 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d8f1ab14d0 0x55d8f1e76540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:53.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.237+0000 7ff2b5c49740 1 --2- 172.21.15.5:0/14944549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d8f1aa92f0 0x55d8f1e76000 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:53.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.237+0000 7ff2b5c49740 1 --2- 172.21.15.5:0/14944549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8f1ad21b0 0x55d8f1e75ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:53.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.237+0000 7ff2b5c49740 1 -- 172.21.15.5:0/14944549 >> 172.21.15.5:0/14944549 conn(0x55d8f1ac6300 msgr2=0x55d8f1e739b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:53.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.237+0000 7ff2b5c49740 1 -- 172.21.15.5:0/14944549 shutdown_connections 2024-08-31T05:31:53.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.237+0000 7ff2b5c49740 1 -- 172.21.15.5:0/14944549 wait complete. 2024-08-31T05:31:53.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.237+0000 7ff2b5c49740 1 -- start start 2024-08-31T05:31:53.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.238+0000 7ff2b5c49740 1 Processor -- start 2024-08-31T05:31:53.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.238+0000 7ff2b5c49740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8f1aa92f0 0x55d8f1e81670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:53.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.238+0000 7ff2b5c49740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d8f1ab14d0 0x55d8f1e81bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:53.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.238+0000 7ff2b5c49740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d8f1ad21b0 0x55d8f1e8d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:53.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.238+0000 7ff2b5c49740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55d8f1d13ab0 con 0x55d8f1aa92f0 2024-08-31T05:31:53.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.238+0000 7ff2b5c49740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d8f1d61680 con 0x55d8f1ad21b0 2024-08-31T05:31:53.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.238+0000 7ff2b5c49740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d8f1e84240 con 0x55d8f1ab14d0 2024-08-31T05:31:53.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.238+0000 7ff2b5c49740 10 client.0 _ll_register_callbacks cb 0x55d8f1ae9a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:31:53.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.238+0000 7ff2aca78640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8f1aa92f0 0x55d8f1e81670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:53.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.238+0000 7ff2aca78640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8f1aa92f0 0x55d8f1e81670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38574/0 (socket says 172.21.15.5:38574) 2024-08-31T05:31:53.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.238+0000 7ff2aca78640 1 -- 172.21.15.5:0/490855774 learned_addr learned my addr 172.21.15.5:0/490855774 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:53.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.238+0000 7ff2a7fff640 1 --2- 172.21.15.5:0/490855774 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d8f1ab14d0 0x55d8f1e81bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:53.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.238+0000 7ff2ad279640 1 --2- 172.21.15.5:0/490855774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d8f1ad21b0 0x55d8f1e8d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:53.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.238+0000 7ff2a7fff640 1 -- 172.21.15.5:0/490855774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d8f1ad21b0 msgr2=0x55d8f1e8d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:53.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.238+0000 7ff2a7fff640 1 --2- 172.21.15.5:0/490855774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d8f1ad21b0 0x55d8f1e8d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:53.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.238+0000 7ff2a7fff640 1 -- 172.21.15.5:0/490855774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8f1aa92f0 msgr2=0x55d8f1e81670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:53.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.239+0000 7ff2a7fff640 1 --2- 172.21.15.5:0/490855774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8f1aa92f0 0x55d8f1e81670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:53.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.239+0000 7ff2a7fff640 1 -- 172.21.15.5:0/490855774 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8f1bb6620 con 0x55d8f1ab14d0 2024-08-31T05:31:53.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.239+0000 7ff2aca78640 1 --2- 172.21.15.5:0/490855774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8f1aa92f0 0x55d8f1e81670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:31:53.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.239+0000 7ff2a7fff640 1 --2- 172.21.15.5:0/490855774 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d8f1ab14d0 0x55d8f1e81bb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff2940e2eb0 tx=0x7ff2940096a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c63058700745eda server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:53.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.239+0000 7ff287fff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:31:53.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.239+0000 7ff287fff640 1 -- 172.21.15.5:0/490855774 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2940e3340 con 0x55d8f1ab14d0 2024-08-31T05:31:53.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.239+0000 7ff2b5c49740 1 -- 172.21.15.5:0/490855774 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff29c0043d0 con 0x55d8f1ab14d0 2024-08-31T05:31:53.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.239+0000 7ff287fff640 1 -- 172.21.15.5:0/490855774 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7ff2940930f0 con 0x55d8f1ab14d0 2024-08-31T05:31:53.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.239+0000 7ff287fff640 1 -- 172.21.15.5:0/490855774 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff2940abf00 con 0x55d8f1ab14d0 2024-08-31T05:31:53.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.239+0000 7ff2b5c49740 10 client.25708 fetch_fsmap learned FSMap version 32 2024-08-31T05:31:53.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.239+0000 7ff2b5c49740 1 -- 172.21.15.5:0/490855774 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55d8f1e90220 con 0x55d8f1ab14d0 2024-08-31T05:31:53.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.239+0000 7ff287fff640 1 -- 172.21.15.5:0/490855774 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2940ae070 con 0x55d8f1ab14d0 2024-08-31T05:31:53.248 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.239+0000 7ff287fff640 1 -- 172.21.15.5:0/490855774 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7ff2940a7990 con 0x55d8f1ab14d0 2024-08-31T05:31:53.248 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.240+0000 7ff2b5c49740 10 client.25708 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:31:53.248 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.240+0000 7ff2b5c49740 10 client.25708 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:31:53.248 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.240+0000 7ff2b5c49740 20 client.25708 populate_metadata read hostname 'smithi005' 2024-08-31T05:31:53.248 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.240+0000 7ff2b5c49740 1 --2- 172.21.15.5:0/490855774 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d8f1a90d80 0x55d8f1e937a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:53.248 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.240+0000 7ff2b5c49740 4 client.25708 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:31:53.248 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.240+0000 7ff2b5c49740 1 -- 172.21.15.5:0/490855774 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d8f1decf50 con 0x55d8f1a90d80 2024-08-31T05:31:53.248 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.240+0000 7ff2aca78640 1 --2- 172.21.15.5:0/490855774 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d8f1a90d80 0x55d8f1e937a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:53.248 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.240+0000 7ff287fff640 10 client.25708 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:31:53.248 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.240+0000 7ff2aca78640 1 --2- 172.21.15.5:0/490855774 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d8f1a90d80 0x55d8f1e937a0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb8a39ef719e21e2 server_cookie=e33e00776a2cc2a0 in_seq=0 out_seq=0 2024-08-31T05:31:53.248 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.241+0000 7ff287fff640 1 -- 172.21.15.5:0/490855774 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d8f1decf50 con 0x55d8f1a90d80 2024-08-31T05:31:53.248 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.241+0000 7ff287fff640 10 client.25708 handle_command_reply: tid=0 2024-08-31T05:31:53.248 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.241+0000 7ff2b5c49740 1 client.25708 shutdown 2024-08-31T05:31:53.248 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.241+0000 7ff2b5c49740 1 -- 172.21.15.5:0/490855774 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d8f1ab14d0 msgr2=0x55d8f1e81bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:53.249 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.241+0000 7ff2b5c49740 1 --2- 172.21.15.5:0/490855774 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d8f1ab14d0 0x55d8f1e81bb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff2940e2eb0 tx=0x7ff2940096a0 comp rx=0 tx=0).stop 2024-08-31T05:31:53.249 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.241+0000 7ff2b5c49740 1 -- 172.21.15.5:0/490855774 shutdown_connections 2024-08-31T05:31:53.249 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.241+0000 7ff2b5c49740 1 --2- 172.21.15.5:0/490855774 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d8f1a90d80 0x55d8f1e937a0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:53.249 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.241+0000 7ff2b5c49740 1 --2- 172.21.15.5:0/490855774 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d8f1ad21b0 0x55d8f1e8d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:53.249 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.241+0000 7ff2b5c49740 1 --2- 172.21.15.5:0/490855774 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d8f1ab14d0 0x55d8f1e81bb0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:53.249 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.241+0000 7ff2b5c49740 1 --2- 172.21.15.5:0/490855774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8f1aa92f0 0x55d8f1e81670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:53.249 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.241+0000 7ff287fff640 0 client.25708 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:31:53.249 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.241+0000 7ff2b5c49740 1 -- 172.21.15.5:0/490855774 >> 172.21.15.5:0/490855774 conn(0x55d8f1ac6300 msgr2=0x55d8f1e76af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:53.249 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.242+0000 7ff2b5c49740 1 -- 172.21.15.5:0/490855774 shutdown_connections 2024-08-31T05:31:53.249 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.242+0000 7ff2b5c49740 1 -- 172.21.15.5:0/490855774 wait complete. 2024-08-31T05:31:53.249 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.242+0000 7ff2b5c49740 20 client.25708 trim_cache size 0 max 16384 2024-08-31T05:31:53.262 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.258+0000 7ff2b5c49740 1 Processor -- start 2024-08-31T05:31:53.262 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.258+0000 7ff2b5c49740 1 -- start start 2024-08-31T05:31:53.262 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.259+0000 7ff2b5c49740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8f1aa92f0 0x55d8f1e80cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:53.262 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.259+0000 7ff2b5c49740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d8f1ab14d0 0x55d8f1e732d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:53.262 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.259+0000 7ff2b5c49740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d8f1ad21b0 0x55d8f1e73810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:53.262 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.259+0000 7ff2b5c49740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a81afb70 con 0x55d8f1aa92f0 2024-08-31T05:31:53.262 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.259+0000 7ff2b5c49740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a81b1770 con 0x55d8f1ad21b0 2024-08-31T05:31:53.262 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.259+0000 7ff2b5c49740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a81b0240 con 0x55d8f1ab14d0 2024-08-31T05:31:53.262 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.259+0000 7ff2aca78640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8f1aa92f0 0x55d8f1e80cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:53.262 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.259+0000 7ff2aca78640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8f1aa92f0 0x55d8f1e80cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38578/0 (socket says 172.21.15.5:38578) 2024-08-31T05:31:53.263 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.259+0000 7ff2aca78640 1 -- 172.21.15.5:0/2094494842 learned_addr learned my addr 172.21.15.5:0/2094494842 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:53.263 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.259+0000 7ff2a7fff640 1 --2- 172.21.15.5:0/2094494842 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d8f1ab14d0 0x55d8f1e732d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:53.263 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.259+0000 7ff2ad279640 1 --2- 172.21.15.5:0/2094494842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d8f1ad21b0 0x55d8f1e73810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:53.263 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.259+0000 7ff2aca78640 1 -- 172.21.15.5:0/2094494842 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d8f1ab14d0 msgr2=0x55d8f1e732d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:53.263 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.259+0000 7ff2aca78640 1 --2- 172.21.15.5:0/2094494842 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d8f1ab14d0 0x55d8f1e732d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:53.263 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.259+0000 7ff2aca78640 1 -- 172.21.15.5:0/2094494842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d8f1ad21b0 msgr2=0x55d8f1e73810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:53.263 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.259+0000 7ff2aca78640 1 --2- 172.21.15.5:0/2094494842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d8f1ad21b0 0x55d8f1e73810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:53.263 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.259+0000 7ff2aca78640 1 -- 172.21.15.5:0/2094494842 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8f1e93b50 con 0x55d8f1aa92f0 2024-08-31T05:31:53.263 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.259+0000 7ff2a7fff640 1 --2- 172.21.15.5:0/2094494842 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d8f1ab14d0 0x55d8f1e732d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:31:53.263 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.259+0000 7ff2aca78640 1 --2- 172.21.15.5:0/2094494842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8f1aa92f0 0x55d8f1e80cd0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7ff29c011d10 tx=0x7ff29c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=401b15f464117ce2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:53.264 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.259+0000 7ff2927fc640 1 -- 172.21.15.5:0/2094494842 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff29c02f020 con 0x55d8f1aa92f0 2024-08-31T05:31:53.264 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.260+0000 7ff2927fc640 1 -- 172.21.15.5:0/2094494842 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff29c003a80 con 0x55d8f1aa92f0 2024-08-31T05:31:53.264 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.260+0000 7ff2927fc640 1 -- 172.21.15.5:0/2094494842 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff29c004680 con 0x55d8f1aa92f0 2024-08-31T05:31:53.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.261+0000 7ff2b5c49740 1 -- 172.21.15.5:0/2094494842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8f1aa92f0 msgr2=0x55d8f1e80cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:53.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.261+0000 7ff2b5c49740 1 --2- 172.21.15.5:0/2094494842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8f1aa92f0 0x55d8f1e80cd0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7ff29c011d10 tx=0x7ff29c011810 comp rx=0 tx=0).stop 2024-08-31T05:31:53.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.261+0000 7ff2b5c49740 1 -- 172.21.15.5:0/2094494842 shutdown_connections 2024-08-31T05:31:53.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.261+0000 7ff2b5c49740 1 --2- 172.21.15.5:0/2094494842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d8f1ad21b0 0x55d8f1e73810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:53.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.261+0000 7ff2b5c49740 1 --2- 172.21.15.5:0/2094494842 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d8f1ab14d0 0x55d8f1e732d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:53.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.261+0000 7ff2b5c49740 1 --2- 172.21.15.5:0/2094494842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8f1aa92f0 0x55d8f1e80cd0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:53.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.261+0000 7ff2b5c49740 1 -- 172.21.15.5:0/2094494842 >> 172.21.15.5:0/2094494842 conn(0x55d8f1ac6300 msgr2=0x55d8f1e7c560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:53.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.261+0000 7ff2b5c49740 1 -- 172.21.15.5:0/2094494842 shutdown_connections 2024-08-31T05:31:53.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.261+0000 7ff2b5c49740 1 -- 172.21.15.5:0/2094494842 wait complete. 2024-08-31T05:31:53.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.261+0000 7ff2b5c49740 1 -- start start 2024-08-31T05:31:53.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.261+0000 7ff2b5c49740 1 Processor -- start 2024-08-31T05:31:53.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.262+0000 7ff2b5c49740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d8f1aa92f0 0x55d8f1e85740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:53.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.262+0000 7ff2b5c49740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8f1ab14d0 0x55d8f1e85c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:53.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.262+0000 7ff2b5c49740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d8f1ad21b0 0x55d8f1efd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:53.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.262+0000 7ff2b5c49740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a81b0fe0 con 0x55d8f1ab14d0 2024-08-31T05:31:53.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.262+0000 7ff2b5c49740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a81b0910 con 0x55d8f1aa92f0 2024-08-31T05:31:53.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.262+0000 7ff2b5c49740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a81adb50 con 0x55d8f1ad21b0 2024-08-31T05:31:53.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.262+0000 7ff2b5c49740 10 client.0 _ll_register_callbacks cb 0x7ff2940abdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:31:53.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.262+0000 7ff2a7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8f1ab14d0 0x55d8f1e85c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:53.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.262+0000 7ff2aca78640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d8f1aa92f0 0x55d8f1e85740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:53.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.262+0000 7ff2a7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8f1ab14d0 0x55d8f1e85c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38580/0 (socket says 172.21.15.5:38580) 2024-08-31T05:31:53.269 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.262+0000 7ff2a7fff640 1 -- 172.21.15.5:0/744684412 learned_addr learned my addr 172.21.15.5:0/744684412 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:31:53.269 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.262+0000 7ff2ad279640 1 --2- 172.21.15.5:0/744684412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d8f1ad21b0 0x55d8f1efd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:53.269 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.262+0000 7ff2a7fff640 1 -- 172.21.15.5:0/744684412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d8f1ad21b0 msgr2=0x55d8f1efd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:53.269 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.262+0000 7ff2a7fff640 1 --2- 172.21.15.5:0/744684412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d8f1ad21b0 0x55d8f1efd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:53.269 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.262+0000 7ff2a7fff640 1 -- 172.21.15.5:0/744684412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d8f1aa92f0 msgr2=0x55d8f1e85740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:31:53.269 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.262+0000 7ff2a7fff640 1 --2- 172.21.15.5:0/744684412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d8f1aa92f0 0x55d8f1e85740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:53.269 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.262+0000 7ff2a7fff640 1 -- 172.21.15.5:0/744684412 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8f1e86490 con 0x55d8f1ab14d0 2024-08-31T05:31:53.269 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.262+0000 7ff2aca78640 1 --2- 172.21.15.5:0/744684412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d8f1aa92f0 0x55d8f1e85740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:31:53.269 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.262+0000 7ff2a7fff640 1 --2- 172.21.15.5:0/744684412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8f1ab14d0 0x55d8f1e85c80 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7ff2940a9170 tx=0x7ff2940b0570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a2d46aebc425817 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:31:53.269 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.262+0000 7ff287fff640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:31:53.269 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.262+0000 7ff287fff640 1 -- 172.21.15.5:0/744684412 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2940b5170 con 0x55d8f1ab14d0 2024-08-31T05:31:53.269 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.263+0000 7ff287fff640 1 -- 172.21.15.5:0/744684412 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7ff2940a7a80 con 0x55d8f1ab14d0 2024-08-31T05:31:53.269 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.263+0000 7ff2b5c49740 1 -- 172.21.15.5:0/744684412 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff29c003a80 con 0x55d8f1ab14d0 2024-08-31T05:31:53.270 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.263+0000 7ff287fff640 1 -- 172.21.15.5:0/744684412 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff2940b06c0 con 0x55d8f1ab14d0 2024-08-31T05:31:53.270 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.263+0000 7ff2b5c49740 10 client.16104 fetch_fsmap learned FSMap version 32 2024-08-31T05:31:53.270 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.263+0000 7ff2b5c49740 1 -- 172.21.15.5:0/744684412 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55d8f1efe6b0 con 0x55d8f1ab14d0 2024-08-31T05:31:53.270 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.263+0000 7ff287fff640 1 -- 172.21.15.5:0/744684412 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff29c003a80 con 0x55d8f1ab14d0 2024-08-31T05:31:53.270 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.263+0000 7ff287fff640 1 -- 172.21.15.5:0/744684412 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7ff294093210 con 0x55d8f1ab14d0 2024-08-31T05:31:53.270 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.263+0000 7ff2b5c49740 10 client.16104 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:31:53.270 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.263+0000 7ff2b5c49740 10 client.16104 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:31:53.270 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.263+0000 7ff2b5c49740 20 client.16104 populate_metadata read hostname 'smithi005' 2024-08-31T05:31:53.270 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.263+0000 7ff2b5c49740 1 --2- 172.21.15.5:0/744684412 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d8f1a661c0 0x55d8f1f00e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:31:53.270 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.263+0000 7ff2b5c49740 4 client.16104 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:31:53.270 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.263+0000 7ff2b5c49740 1 -- 172.21.15.5:0/744684412 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d8f1de89f0 con 0x55d8f1a661c0 2024-08-31T05:31:53.270 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.263+0000 7ff2aca78640 1 --2- 172.21.15.5:0/744684412 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d8f1a661c0 0x55d8f1f00e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:31:53.270 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.264+0000 7ff287fff640 10 client.16104 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:31:53.271 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.264+0000 7ff2aca78640 1 --2- 172.21.15.5:0/744684412 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d8f1a661c0 0x55d8f1f00e00 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5fa9ffd2250e1313 server_cookie=3c962566d88b4638 in_seq=0 out_seq=0 2024-08-31T05:31:53.302 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.299+0000 7ff287fff640 1 -- 172.21.15.5:0/744684412 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d8f1de89f0 con 0x55d8f1a661c0 2024-08-31T05:31:53.302 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.299+0000 7ff287fff640 10 client.16104 handle_command_reply: tid=0 2024-08-31T05:31:53.302 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.299+0000 7ff2b5c49740 1 client.16104 shutdown 2024-08-31T05:31:53.302 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.300+0000 7ff2b5c49740 1 -- 172.21.15.5:0/744684412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8f1ab14d0 msgr2=0x55d8f1e85c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:53.302 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.300+0000 7ff2b5c49740 1 --2- 172.21.15.5:0/744684412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8f1ab14d0 0x55d8f1e85c80 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7ff2940a9170 tx=0x7ff2940b0570 comp rx=0 tx=0).stop 2024-08-31T05:31:53.302 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.300+0000 7ff2b5c49740 1 -- 172.21.15.5:0/744684412 shutdown_connections 2024-08-31T05:31:53.303 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.300+0000 7ff2b5c49740 1 --2- 172.21.15.5:0/744684412 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d8f1a661c0 0x55d8f1f00e00 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:53.303 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.300+0000 7ff2b5c49740 1 --2- 172.21.15.5:0/744684412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d8f1ad21b0 0x55d8f1efd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:53.303 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.300+0000 7ff2b5c49740 1 --2- 172.21.15.5:0/744684412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d8f1ab14d0 0x55d8f1e85c80 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:53.303 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.300+0000 7ff287fff640 0 client.16104 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:31:53.303 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.300+0000 7ff2b5c49740 1 --2- 172.21.15.5:0/744684412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d8f1aa92f0 0x55d8f1e85740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:53.303 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.300+0000 7ff2b5c49740 1 -- 172.21.15.5:0/744684412 >> 172.21.15.5:0/744684412 conn(0x55d8f1ac6300 msgr2=0x55d8f1e82910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:53.303 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.300+0000 7ff2b5c49740 1 -- 172.21.15.5:0/744684412 shutdown_connections 2024-08-31T05:31:53.303 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.300+0000 7ff2b5c49740 1 -- 172.21.15.5:0/744684412 wait complete. 2024-08-31T05:31:53.303 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.300+0000 7ff2b5c49740 20 client.16104 trim_cache size 0 max 16384 2024-08-31T05:31:53.303 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:31:53.303 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:31:53.304 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:31:53.304 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:31:53.304 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.301+0000 7ff2aecdc640 1 -- 172.21.15.5:0/4292283003 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff2980b4ca0 msgr2=0x7ff2980b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:53.304 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.301+0000 7ff2aecdc640 1 --2- 172.21.15.5:0/4292283003 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff2980b4ca0 0x7ff2980b71b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff2a002f500 tx=0x7ff2a002f310 comp rx=0 tx=0).stop 2024-08-31T05:31:53.304 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.301+0000 7ff2aecdc640 1 -- 172.21.15.5:0/4292283003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2a8108090 msgr2=0x7ff2a81996d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:31:53.305 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.301+0000 7ff2aecdc640 1 --2- 172.21.15.5:0/4292283003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2a8108090 0x7ff2a81996d0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7ff29400e9f0 tx=0x7ff29400eeb0 comp rx=0 tx=0).stop 2024-08-31T05:31:53.305 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.301+0000 7ff2aecdc640 1 -- 172.21.15.5:0/4292283003 shutdown_connections 2024-08-31T05:31:53.305 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.301+0000 7ff2aecdc640 1 --2- 172.21.15.5:0/4292283003 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff2980b4ca0 0x7ff2980b71b0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:53.305 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.301+0000 7ff2aecdc640 1 --2- 172.21.15.5:0/4292283003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2a81089e0 0x7ff2a819e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:53.305 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.301+0000 7ff2aecdc640 1 --2- 172.21.15.5:0/4292283003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2a8108090 0x7ff2a81996d0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:53.305 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.301+0000 7ff2aecdc640 1 --2- 172.21.15.5:0/4292283003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2a8102760 0x7ff2a8199130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:31:53.305 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.301+0000 7ff2aecdc640 1 -- 172.21.15.5:0/4292283003 >> 172.21.15.5:0/4292283003 conn(0x7ff2a80fe160 msgr2=0x7ff2a8106670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:31:53.305 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.301+0000 7ff2aecdc640 1 -- 172.21.15.5:0/4292283003 shutdown_connections 2024-08-31T05:31:53.305 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:31:53.301+0000 7ff2aecdc640 1 -- 172.21.15.5:0/4292283003 wait complete. 2024-08-31T05:31:53.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:31:53 smithi050 ceph-mon[22146]: pgmap v402: 129 pgs: 129 active+clean; 53 MiB data, 538 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.0 MiB/s wr, 348 op/s 2024-08-31T05:31:53.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:31:53 smithi005 ceph-mon[18602]: pgmap v402: 129 pgs: 129 active+clean; 53 MiB data, 538 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.0 MiB/s wr, 348 op/s 2024-08-31T05:31:53.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:31:53 smithi070 ceph-mon[22316]: pgmap v402: 129 pgs: 129 active+clean; 53 MiB data, 538 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.0 MiB/s wr, 348 op/s 2024-08-31T05:31:53.909 INFO:tasks.workunit.client.0.smithi005.stdout: 1 108226 14.63 MB/sec warmup 41 sec latency 15.901 ms 2024-08-31T05:31:54.909 INFO:tasks.workunit.client.0.smithi005.stdout: 1 110742 14.62 MB/sec warmup 42 sec latency 15.084 ms 2024-08-31T05:31:55.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:31:55 smithi050 ceph-mon[22146]: pgmap v403: 129 pgs: 129 active+clean; 53 MiB data, 562 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 306 op/s 2024-08-31T05:31:55.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:31:55 smithi005 ceph-mon[18602]: pgmap v403: 129 pgs: 129 active+clean; 53 MiB data, 562 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 306 op/s 2024-08-31T05:31:55.585 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:31:55 smithi070 ceph-mon[22316]: pgmap v403: 129 pgs: 129 active+clean; 53 MiB data, 562 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 306 op/s 2024-08-31T05:31:55.909 INFO:tasks.workunit.client.0.smithi005.stdout: 1 113789 14.71 MB/sec warmup 43 sec latency 11.632 ms 2024-08-31T05:31:56.909 INFO:tasks.workunit.client.0.smithi005.stdout: 1 116465 14.67 MB/sec warmup 44 sec latency 13.036 ms 2024-08-31T05:31:57.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:31:57 smithi050 ceph-mon[22146]: pgmap v404: 129 pgs: 129 active+clean; 59 MiB data, 592 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 2.5 MiB/s wr, 335 op/s 2024-08-31T05:31:57.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:31:57 smithi005 ceph-mon[18602]: pgmap v404: 129 pgs: 129 active+clean; 59 MiB data, 592 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 2.5 MiB/s wr, 335 op/s 2024-08-31T05:31:57.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:31:57 smithi070 ceph-mon[22316]: pgmap v404: 129 pgs: 129 active+clean; 59 MiB data, 592 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 2.5 MiB/s wr, 335 op/s 2024-08-31T05:31:57.909 INFO:tasks.workunit.client.0.smithi005.stdout: 1 118699 14.61 MB/sec warmup 45 sec latency 11.624 ms 2024-08-31T05:31:58.909 INFO:tasks.workunit.client.0.smithi005.stdout: 1 121355 14.60 MB/sec warmup 46 sec latency 15.735 ms 2024-08-31T05:31:59.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:31:59 smithi050 ceph-mon[22146]: pgmap v405: 129 pgs: 129 active+clean; 59 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 1.5 MiB/s wr, 221 op/s 2024-08-31T05:31:59.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:31:59 smithi005 ceph-mon[18602]: pgmap v405: 129 pgs: 129 active+clean; 59 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 1.5 MiB/s wr, 221 op/s 2024-08-31T05:31:59.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:31:59 smithi070 ceph-mon[22316]: pgmap v405: 129 pgs: 129 active+clean; 59 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 1.5 MiB/s wr, 221 op/s 2024-08-31T05:31:59.909 INFO:tasks.workunit.client.0.smithi005.stdout: 1 124394 14.68 MB/sec warmup 47 sec latency 20.725 ms 2024-08-31T05:32:00.909 INFO:tasks.workunit.client.0.smithi005.stdout: 1 126936 14.61 MB/sec warmup 48 sec latency 11.683 ms 2024-08-31T05:32:01.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:32:01 smithi050 ceph-mon[22146]: pgmap v406: 129 pgs: 129 active+clean; 63 MiB data, 600 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 1.5 MiB/s wr, 204 op/s 2024-08-31T05:32:01.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:32:01 smithi005 ceph-mon[18602]: pgmap v406: 129 pgs: 129 active+clean; 63 MiB data, 600 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 1.5 MiB/s wr, 204 op/s 2024-08-31T05:32:01.585 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:32:01 smithi070 ceph-mon[22316]: pgmap v406: 129 pgs: 129 active+clean; 63 MiB data, 600 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 1.5 MiB/s wr, 204 op/s 2024-08-31T05:32:01.909 INFO:tasks.workunit.client.0.smithi005.stdout: 1 128119 14.48 MB/sec warmup 49 sec latency 35.901 ms 2024-08-31T05:32:02.909 INFO:tasks.workunit.client.0.smithi005.stdout: 1 131055 14.48 MB/sec warmup 50 sec latency 19.178 ms 2024-08-31T05:32:03.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:32:03 smithi050 ceph-mon[22146]: pgmap v407: 129 pgs: 129 active+clean; 67 MiB data, 597 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 1.5 MiB/s wr, 215 op/s 2024-08-31T05:32:03.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:32:03 smithi005 ceph-mon[18602]: pgmap v407: 129 pgs: 129 active+clean; 67 MiB data, 597 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 1.5 MiB/s wr, 215 op/s 2024-08-31T05:32:03.585 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:32:03 smithi070 ceph-mon[22316]: pgmap v407: 129 pgs: 129 active+clean; 67 MiB data, 597 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 1.5 MiB/s wr, 215 op/s 2024-08-31T05:32:03.909 INFO:tasks.workunit.client.0.smithi005.stdout: 1 133538 14.40 MB/sec warmup 51 sec latency 22.224 ms 2024-08-31T05:32:04.909 INFO:tasks.workunit.client.0.smithi005.stdout: 1 135647 14.39 MB/sec warmup 52 sec latency 21.264 ms 2024-08-31T05:32:05.408 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:32:05 smithi050 ceph-mon[22146]: pgmap v408: 129 pgs: 129 active+clean; 67 MiB data, 597 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 1.5 MiB/s wr, 228 op/s 2024-08-31T05:32:05.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:32:05 smithi005 ceph-mon[18602]: pgmap v408: 129 pgs: 129 active+clean; 67 MiB data, 597 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 1.5 MiB/s wr, 228 op/s 2024-08-31T05:32:05.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:32:05 smithi070 ceph-mon[22316]: pgmap v408: 129 pgs: 129 active+clean; 67 MiB data, 597 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 1.5 MiB/s wr, 228 op/s 2024-08-31T05:32:05.910 INFO:tasks.workunit.client.0.smithi005.stdout: 1 138687 14.46 MB/sec warmup 53 sec latency 12.280 ms 2024-08-31T05:32:06.409 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.407+0000 7f651d539640 1 -- 172.21.15.5:0/386177025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65181089e0 msgr2=0x7f651810f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:06.410 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.407+0000 7f651d539640 1 --2- 172.21.15.5:0/386177025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65181089e0 0x7f651810f210 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f6510009ca0 tx=0x7f651002a8c0 comp rx=0 tx=0).stop 2024-08-31T05:32:06.410 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.407+0000 7f651d539640 1 -- 172.21.15.5:0/386177025 shutdown_connections 2024-08-31T05:32:06.410 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.407+0000 7f651d539640 1 --2- 172.21.15.5:0/386177025 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65181089e0 0x7f651810f210 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:06.410 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.407+0000 7f651d539640 1 --2- 172.21.15.5:0/386177025 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6518108090 0x7f65181084a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:06.410 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.407+0000 7f651d539640 1 --2- 172.21.15.5:0/386177025 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6518102760 0x7f6518102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:06.410 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.407+0000 7f651d539640 1 -- 172.21.15.5:0/386177025 >> 172.21.15.5:0/386177025 conn(0x7f65180fe160 msgr2=0x7f65181005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:06.410 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.407+0000 7f651d539640 1 -- 172.21.15.5:0/386177025 shutdown_connections 2024-08-31T05:32:06.410 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.407+0000 7f651d539640 1 -- 172.21.15.5:0/386177025 wait complete. 2024-08-31T05:32:06.410 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.408+0000 7f651d539640 1 Processor -- start 2024-08-31T05:32:06.412 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.408+0000 7f651d539640 1 -- start start 2024-08-31T05:32:06.412 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.408+0000 7f651d539640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6518102760 0x7f651819b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:06.412 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.408+0000 7f651d539640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6518108090 0x7f651819b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:06.412 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.408+0000 7f651d539640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65181089e0 0x7f651819baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:06.412 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.408+0000 7f651d539640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f65181126b0 con 0x7f6518102760 2024-08-31T05:32:06.412 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.408+0000 7f651d539640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6518112530 con 0x7f6518108090 2024-08-31T05:32:06.412 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.408+0000 7f651d539640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6518112830 con 0x7f65181089e0 2024-08-31T05:32:06.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.409+0000 7f6516ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6518102760 0x7f651819b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:06.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.409+0000 7f6516ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6518102760 0x7f651819b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34952/0 (socket says 172.21.15.5:34952) 2024-08-31T05:32:06.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.409+0000 7f65167fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6518108090 0x7f651819b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:06.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.409+0000 7f6516ffd640 1 -- 172.21.15.5:0/1859318120 learned_addr learned my addr 172.21.15.5:0/1859318120 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:06.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.409+0000 7f65177fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65181089e0 0x7f651819baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:06.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.409+0000 7f6516ffd640 1 -- 172.21.15.5:0/1859318120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65181089e0 msgr2=0x7f651819baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:06.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.409+0000 7f6516ffd640 1 --2- 172.21.15.5:0/1859318120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65181089e0 0x7f651819baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:06.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.409+0000 7f6516ffd640 1 -- 172.21.15.5:0/1859318120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6518108090 msgr2=0x7f651819b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:06.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.409+0000 7f6516ffd640 1 --2- 172.21.15.5:0/1859318120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6518108090 0x7f651819b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:06.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.409+0000 7f6516ffd640 1 -- 172.21.15.5:0/1859318120 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65181a62b0 con 0x7f6518102760 2024-08-31T05:32:06.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.409+0000 7f65167fc640 1 --2- 172.21.15.5:0/1859318120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6518108090 0x7f651819b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:32:06.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.409+0000 7f6516ffd640 1 --2- 172.21.15.5:0/1859318120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6518102760 0x7f651819b020 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f650800e9f0 tx=0x7f650800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:06.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.409+0000 7f64fffff640 1 -- 172.21.15.5:0/1859318120 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f650800cd80 con 0x7f6518102760 2024-08-31T05:32:06.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.409+0000 7f651d539640 1 -- 172.21.15.5:0/1859318120 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65181a65a0 con 0x7f6518102760 2024-08-31T05:32:06.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.409+0000 7f651d539640 1 -- 172.21.15.5:0/1859318120 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65181a6b40 con 0x7f6518102760 2024-08-31T05:32:06.414 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.409+0000 7f64fffff640 1 -- 172.21.15.5:0/1859318120 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f65080108e0 con 0x7f6518102760 2024-08-31T05:32:06.414 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.409+0000 7f64fffff640 1 -- 172.21.15.5:0/1859318120 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65080188e0 con 0x7f6518102760 2024-08-31T05:32:06.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.412+0000 7f65244ad740 1 Processor -- start 2024-08-31T05:32:06.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.412+0000 7f64fffff640 1 -- 172.21.15.5:0/1859318120 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f6508018a80 con 0x7f6518102760 2024-08-31T05:32:06.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.412+0000 7f65244ad740 1 -- start start 2024-08-31T05:32:06.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.412+0000 7f65244ad740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55847ef501b0 0x55847f2f3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:06.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.412+0000 7f65244ad740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55847ef272f0 0x55847f2f4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:06.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.412+0000 7f65244ad740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55847ef2f4d0 0x55847f2f4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:06.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.412+0000 7f65244ad740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55847f269000 con 0x55847ef272f0 2024-08-31T05:32:06.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.412+0000 7f65244ad740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55847f258590 con 0x55847ef501b0 2024-08-31T05:32:06.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.412+0000 7f65244ad740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55847f25c540 con 0x55847ef2f4d0 2024-08-31T05:32:06.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.413+0000 7f65177fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55847ef501b0 0x55847f2f3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:06.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.413+0000 7f6516ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55847ef272f0 0x55847f2f4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:06.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.413+0000 7f65167fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55847ef2f4d0 0x55847f2f4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:06.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.413+0000 7f65177fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55847ef501b0 0x55847f2f3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:40380/0 (socket says 172.21.15.5:40380) 2024-08-31T05:32:06.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.413+0000 7f65177fe640 1 -- 172.21.15.5:0/4097576729 learned_addr learned my addr 172.21.15.5:0/4097576729 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:06.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.413+0000 7f65177fe640 1 -- 172.21.15.5:0/4097576729 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55847ef2f4d0 msgr2=0x55847f2f4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:06.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.413+0000 7f65177fe640 1 --2- 172.21.15.5:0/4097576729 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55847ef2f4d0 0x55847f2f4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:06.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.413+0000 7f65177fe640 1 -- 172.21.15.5:0/4097576729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55847ef272f0 msgr2=0x55847f2f4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:06.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.413+0000 7f65177fe640 1 --2- 172.21.15.5:0/4097576729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55847ef272f0 0x55847f2f4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:06.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.413+0000 7f65177fe640 1 -- 172.21.15.5:0/4097576729 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55847efbb790 con 0x55847ef501b0 2024-08-31T05:32:06.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.413+0000 7f65177fe640 1 --2- 172.21.15.5:0/4097576729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55847ef501b0 0x55847f2f3ac0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f651002f410 tx=0x7f651002f440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f1562280d6d63f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:06.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.413+0000 7f64fffff640 1 --2- 172.21.15.5:0/1859318120 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f65000b4ca0 0x7f65000b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:06.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.413+0000 7f6516ffd640 1 --2- 172.21.15.5:0/1859318120 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f65000b4ca0 0x7f65000b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:06.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.413+0000 7f64fd7fa640 1 -- 172.21.15.5:0/4097576729 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6510031cf0 con 0x55847ef501b0 2024-08-31T05:32:06.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.413+0000 7f64fd7fa640 1 -- 172.21.15.5:0/4097576729 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6510036030 con 0x55847ef501b0 2024-08-31T05:32:06.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.414+0000 7f64fd7fa640 1 -- 172.21.15.5:0/4097576729 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65100042a0 con 0x55847ef501b0 2024-08-31T05:32:06.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.414+0000 7f64fffff640 1 -- 172.21.15.5:0/1859318120 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f65080e5a20 con 0x7f6518102760 2024-08-31T05:32:06.421 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.414+0000 7f65244ad740 1 -- 172.21.15.5:0/4097576729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55847ef501b0 msgr2=0x55847f2f3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:06.421 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.414+0000 7f6516ffd640 1 --2- 172.21.15.5:0/1859318120 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f65000b4ca0 0x7f65000b71b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f65080e2ea0 tx=0x7f65080e94c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.414+0000 7f65244ad740 1 --2- 172.21.15.5:0/4097576729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55847ef501b0 0x55847f2f3ac0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f651002f410 tx=0x7f651002f440 comp rx=0 tx=0).stop 2024-08-31T05:32:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.414+0000 7f65244ad740 1 -- 172.21.15.5:0/4097576729 shutdown_connections 2024-08-31T05:32:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.414+0000 7f65244ad740 1 --2- 172.21.15.5:0/4097576729 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55847ef2f4d0 0x55847f2f4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.414+0000 7f65244ad740 1 --2- 172.21.15.5:0/4097576729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55847ef272f0 0x55847f2f4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.414+0000 7f65244ad740 1 --2- 172.21.15.5:0/4097576729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55847ef501b0 0x55847f2f3ac0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.414+0000 7f65244ad740 1 -- 172.21.15.5:0/4097576729 >> 172.21.15.5:0/4097576729 conn(0x55847ef44300 msgr2=0x55847f2f19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.415+0000 7f65244ad740 1 -- 172.21.15.5:0/4097576729 shutdown_connections 2024-08-31T05:32:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.415+0000 7f65244ad740 1 -- 172.21.15.5:0/4097576729 wait complete. 2024-08-31T05:32:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.415+0000 7f65244ad740 1 -- start start 2024-08-31T05:32:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.415+0000 7f65244ad740 1 Processor -- start 2024-08-31T05:32:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.415+0000 7f65244ad740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55847ef272f0 0x55847f303a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.415+0000 7f65244ad740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55847ef2f4d0 0x55847f303f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.415+0000 7f65244ad740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55847ef501b0 0x55847f30f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.415+0000 7f65244ad740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55847f191ab0 con 0x55847ef501b0 2024-08-31T05:32:06.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.415+0000 7f65244ad740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55847f1df680 con 0x55847ef272f0 2024-08-31T05:32:06.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.415+0000 7f65244ad740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55847f306440 con 0x55847ef2f4d0 2024-08-31T05:32:06.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.415+0000 7f65244ad740 10 client.0 _ll_register_callbacks cb 0x55847ef67a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:32:06.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.415+0000 7f65177fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55847ef501b0 0x55847f30f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:06.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.416+0000 7f65177fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55847ef501b0 0x55847f30f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34978/0 (socket says 172.21.15.5:34978) 2024-08-31T05:32:06.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.416+0000 7f65177fe640 1 -- 172.21.15.5:0/1052423273 learned_addr learned my addr 172.21.15.5:0/1052423273 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:06.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.416+0000 7f65167fc640 1 --2- 172.21.15.5:0/1052423273 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55847ef2f4d0 0x55847f303f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:06.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.416+0000 7f65177fe640 1 --2- 172.21.15.5:0/1052423273 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55847ef272f0 0x55847f303a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:06.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.416+0000 7f65177fe640 1 -- 172.21.15.5:0/1052423273 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55847ef2f4d0 msgr2=0x55847f303f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:06.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.416+0000 7f65177fe640 1 --2- 172.21.15.5:0/1052423273 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55847ef2f4d0 0x55847f303f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:06.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.416+0000 7f65177fe640 1 -- 172.21.15.5:0/1052423273 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55847ef272f0 msgr2=0x55847f303a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:06.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.416+0000 7f65177fe640 1 --2- 172.21.15.5:0/1052423273 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55847ef272f0 0x55847f303a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:06.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.416+0000 7f65177fe640 1 -- 172.21.15.5:0/1052423273 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55847f034620 con 0x55847ef501b0 2024-08-31T05:32:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.416+0000 7f65177fe640 1 --2- 172.21.15.5:0/1052423273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55847ef501b0 0x55847f30f7d0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f6510005c90 tx=0x7f6510003f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=471b8980a553d02e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.416+0000 7f64faff5640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:32:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.416+0000 7f64faff5640 1 -- 172.21.15.5:0/1052423273 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6510059060 con 0x55847ef501b0 2024-08-31T05:32:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.416+0000 7f64faff5640 1 -- 172.21.15.5:0/1052423273 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f65100045e0 con 0x55847ef501b0 2024-08-31T05:32:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.416+0000 7f65244ad740 1 -- 172.21.15.5:0/1052423273 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6510036030 con 0x55847ef501b0 2024-08-31T05:32:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.417+0000 7f64faff5640 1 -- 172.21.15.5:0/1052423273 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f65100047e0 con 0x55847ef501b0 2024-08-31T05:32:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.417+0000 7f65244ad740 10 client.16116 fetch_fsmap learned FSMap version 32 2024-08-31T05:32:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.417+0000 7f65244ad740 1 -- 172.21.15.5:0/1052423273 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55847f312420 con 0x55847ef501b0 2024-08-31T05:32:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.417+0000 7f64faff5640 1 -- 172.21.15.5:0/1052423273 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6510036030 con 0x55847ef501b0 2024-08-31T05:32:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.417+0000 7f64faff5640 1 -- 172.21.15.5:0/1052423273 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f6510043070 con 0x55847ef501b0 2024-08-31T05:32:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.417+0000 7f65244ad740 10 client.16116 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:32:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.417+0000 7f65244ad740 10 client.16116 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:32:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.417+0000 7f65244ad740 20 client.16116 populate_metadata read hostname 'smithi005' 2024-08-31T05:32:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.417+0000 7f65244ad740 1 --2- 172.21.15.5:0/1052423273 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55847ef0ed80 0x55847f315780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:06.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.417+0000 7f65244ad740 4 client.16116 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:32:06.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.417+0000 7f65244ad740 1 -- 172.21.15.5:0/1052423273 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55847f26af50 con 0x55847ef0ed80 2024-08-31T05:32:06.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.417+0000 7f65167fc640 1 --2- 172.21.15.5:0/1052423273 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55847ef0ed80 0x55847f315780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:06.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.418+0000 7f65167fc640 1 --2- 172.21.15.5:0/1052423273 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55847ef0ed80 0x55847f315780 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b68ef7476ddfd99e server_cookie=a78721ab134cf576 in_seq=0 out_seq=0 2024-08-31T05:32:06.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.418+0000 7f64faff5640 10 client.16116 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:32:06.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.419+0000 7f64faff5640 1 -- 172.21.15.5:0/1052423273 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55847f26af50 con 0x55847ef0ed80 2024-08-31T05:32:06.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.419+0000 7f64faff5640 10 client.16116 handle_command_reply: tid=0 2024-08-31T05:32:06.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.419+0000 7f65244ad740 1 client.16116 shutdown 2024-08-31T05:32:06.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.419+0000 7f65244ad740 1 -- 172.21.15.5:0/1052423273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55847ef501b0 msgr2=0x55847f30f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:06.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.419+0000 7f65244ad740 1 --2- 172.21.15.5:0/1052423273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55847ef501b0 0x55847f30f7d0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f6510005c90 tx=0x7f6510003f70 comp rx=0 tx=0).stop 2024-08-31T05:32:06.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.419+0000 7f65244ad740 1 -- 172.21.15.5:0/1052423273 shutdown_connections 2024-08-31T05:32:06.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.419+0000 7f65244ad740 1 --2- 172.21.15.5:0/1052423273 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55847ef0ed80 0x55847f315780 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:06.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.419+0000 7f65244ad740 1 --2- 172.21.15.5:0/1052423273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55847ef501b0 0x55847f30f7d0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:06.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.419+0000 7f65244ad740 1 --2- 172.21.15.5:0/1052423273 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55847ef2f4d0 0x55847f303f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:06.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.419+0000 7f64faff5640 0 client.16116 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:32:06.428 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.419+0000 7f65244ad740 1 --2- 172.21.15.5:0/1052423273 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55847ef272f0 0x55847f303a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:06.428 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.419+0000 7f65244ad740 1 -- 172.21.15.5:0/1052423273 >> 172.21.15.5:0/1052423273 conn(0x55847ef44300 msgr2=0x55847f2f54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:06.428 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.419+0000 7f65244ad740 1 -- 172.21.15.5:0/1052423273 shutdown_connections 2024-08-31T05:32:06.428 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.419+0000 7f65244ad740 1 -- 172.21.15.5:0/1052423273 wait complete. 2024-08-31T05:32:06.428 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.419+0000 7f65244ad740 20 client.16116 trim_cache size 0 max 16384 2024-08-31T05:32:06.438 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.435+0000 7f65244ad740 1 Processor -- start 2024-08-31T05:32:06.438 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.435+0000 7f65244ad740 1 -- start start 2024-08-31T05:32:06.438 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.435+0000 7f65244ad740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55847ef0ed80 0x55847f2f5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:06.438 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.435+0000 7f65244ad740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55847ef272f0 0x55847f30f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:06.438 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.435+0000 7f65244ad740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55847ef2f4d0 0x55847f30fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:06.438 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.435+0000 7f65244ad740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f650400ff50 con 0x55847ef0ed80 2024-08-31T05:32:06.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.435+0000 7f65244ad740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6504011b50 con 0x55847ef272f0 2024-08-31T05:32:06.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.435+0000 7f65244ad740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6504010620 con 0x55847ef2f4d0 2024-08-31T05:32:06.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.436+0000 7f65177fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55847ef0ed80 0x55847f2f5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:06.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.436+0000 7f65177fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55847ef0ed80 0x55847f2f5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34994/0 (socket says 172.21.15.5:34994) 2024-08-31T05:32:06.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.436+0000 7f65177fe640 1 -- 172.21.15.5:0/3324046476 learned_addr learned my addr 172.21.15.5:0/3324046476 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:06.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.436+0000 7f65167fc640 1 --2- 172.21.15.5:0/3324046476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55847ef272f0 0x55847f30f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:06.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.436+0000 7f65177fe640 1 -- 172.21.15.5:0/3324046476 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55847ef2f4d0 msgr2=0x55847f30fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:06.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.436+0000 7f65177fe640 1 --2- 172.21.15.5:0/3324046476 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55847ef2f4d0 0x55847f30fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:06.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.436+0000 7f65177fe640 1 -- 172.21.15.5:0/3324046476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55847ef272f0 msgr2=0x55847f30f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:06.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.436+0000 7f65177fe640 1 --2- 172.21.15.5:0/3324046476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55847ef272f0 0x55847f30f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:06.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.436+0000 7f65177fe640 1 -- 172.21.15.5:0/3324046476 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55847f2f4900 con 0x55847ef0ed80 2024-08-31T05:32:06.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.436+0000 7f65177fe640 1 --2- 172.21.15.5:0/3324046476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55847ef0ed80 0x55847f2f5200 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f651002f6c0 tx=0x7f6510005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf3d63d651d90492 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:06.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.436+0000 7f64fcff9640 1 -- 172.21.15.5:0/3324046476 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6510059040 con 0x55847ef0ed80 2024-08-31T05:32:06.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.436+0000 7f64fcff9640 1 -- 172.21.15.5:0/3324046476 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6510036040 con 0x55847ef0ed80 2024-08-31T05:32:06.440 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.436+0000 7f64fcff9640 1 -- 172.21.15.5:0/3324046476 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65100043c0 con 0x55847ef0ed80 2024-08-31T05:32:06.443 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.437+0000 7f65244ad740 1 -- 172.21.15.5:0/3324046476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55847ef0ed80 msgr2=0x55847f2f5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:06.443 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.437+0000 7f65244ad740 1 --2- 172.21.15.5:0/3324046476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55847ef0ed80 0x55847f2f5200 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f651002f6c0 tx=0x7f6510005de0 comp rx=0 tx=0).stop 2024-08-31T05:32:06.443 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.437+0000 7f65244ad740 1 -- 172.21.15.5:0/3324046476 shutdown_connections 2024-08-31T05:32:06.443 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.437+0000 7f65244ad740 1 --2- 172.21.15.5:0/3324046476 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55847ef2f4d0 0x55847f30fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:06.443 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.437+0000 7f65244ad740 1 --2- 172.21.15.5:0/3324046476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55847ef272f0 0x55847f30f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:06.443 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.437+0000 7f65244ad740 1 --2- 172.21.15.5:0/3324046476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55847ef0ed80 0x55847f2f5200 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:06.443 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.437+0000 7f65244ad740 1 -- 172.21.15.5:0/3324046476 >> 172.21.15.5:0/3324046476 conn(0x55847ef44300 msgr2=0x55847f2f4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:06.443 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.437+0000 7f65244ad740 1 -- 172.21.15.5:0/3324046476 shutdown_connections 2024-08-31T05:32:06.443 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.437+0000 7f65244ad740 1 -- 172.21.15.5:0/3324046476 wait complete. 2024-08-31T05:32:06.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.438+0000 7f65244ad740 1 -- start start 2024-08-31T05:32:06.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.438+0000 7f65244ad740 1 Processor -- start 2024-08-31T05:32:06.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.438+0000 7f65244ad740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55847ef0ed80 0x55847f307ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:06.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.438+0000 7f65244ad740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55847ef272f0 0x55847f308400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:06.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.438+0000 7f65244ad740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55847ef2f4d0 0x55847f37f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:06.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.438+0000 7f65244ad740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f65040113c0 con 0x55847ef2f4d0 2024-08-31T05:32:06.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.438+0000 7f65244ad740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6504010cf0 con 0x55847ef272f0 2024-08-31T05:32:06.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.438+0000 7f65244ad740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f650400df30 con 0x55847ef0ed80 2024-08-31T05:32:06.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.438+0000 7f65244ad740 10 client.0 _ll_register_callbacks cb 0x7f65080ea040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:32:06.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.438+0000 7f65177fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55847ef2f4d0 0x55847f37f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:06.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.438+0000 7f65177fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55847ef2f4d0 0x55847f37f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35010/0 (socket says 172.21.15.5:35010) 2024-08-31T05:32:06.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.438+0000 7f65177fe640 1 -- 172.21.15.5:0/381363550 learned_addr learned my addr 172.21.15.5:0/381363550 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:06.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.438+0000 7f65167fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55847ef272f0 0x55847f308400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:06.445 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.438+0000 7f65177fe640 1 --2- 172.21.15.5:0/381363550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55847ef0ed80 0x55847f307ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:06.445 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.438+0000 7f65167fc640 1 -- 172.21.15.5:0/381363550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55847ef0ed80 msgr2=0x55847f307ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:06.445 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.438+0000 7f65167fc640 1 --2- 172.21.15.5:0/381363550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55847ef0ed80 0x55847f307ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:06.445 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.438+0000 7f65167fc640 1 -- 172.21.15.5:0/381363550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55847ef2f4d0 msgr2=0x55847f37f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:06.445 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.438+0000 7f65167fc640 1 --2- 172.21.15.5:0/381363550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55847ef2f4d0 0x55847f37f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:06.445 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.438+0000 7f65167fc640 1 -- 172.21.15.5:0/381363550 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55847f37f5f0 con 0x55847ef272f0 2024-08-31T05:32:06.445 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.439+0000 7f65167fc640 1 --2- 172.21.15.5:0/381363550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55847ef272f0 0x55847f308400 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x55847f315da0 tx=0x7f650c012b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41b79db274c6f575 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:06.445 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.439+0000 7f64faff5640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:32:06.445 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.439+0000 7f64faff5640 1 -- 172.21.15.5:0/381363550 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f650c005020 con 0x55847ef272f0 2024-08-31T05:32:06.445 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.439+0000 7f65244ad740 1 -- 172.21.15.5:0/381363550 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6510036040 con 0x55847ef272f0 2024-08-31T05:32:06.445 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.439+0000 7f64faff5640 1 -- 172.21.15.5:0/381363550 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f650c0051c0 con 0x55847ef272f0 2024-08-31T05:32:06.445 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.439+0000 7f64faff5640 1 -- 172.21.15.5:0/381363550 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f650c031050 con 0x55847ef272f0 2024-08-31T05:32:06.445 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.439+0000 7f65244ad740 10 client.25721 fetch_fsmap learned FSMap version 32 2024-08-31T05:32:06.445 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.439+0000 7f65244ad740 1 -- 172.21.15.5:0/381363550 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55847f3808e0 con 0x55847ef272f0 2024-08-31T05:32:06.445 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.439+0000 7f64faff5640 1 -- 172.21.15.5:0/381363550 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6510036040 con 0x55847ef272f0 2024-08-31T05:32:06.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.439+0000 7f64faff5640 1 -- 172.21.15.5:0/381363550 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f650c023070 con 0x55847ef272f0 2024-08-31T05:32:06.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.439+0000 7f65244ad740 10 client.25721 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:32:06.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.439+0000 7f65244ad740 10 client.25721 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:32:06.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.440+0000 7f65244ad740 20 client.25721 populate_metadata read hostname 'smithi005' 2024-08-31T05:32:06.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.440+0000 7f65244ad740 1 --2- 172.21.15.5:0/381363550 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55847ef501b0 0x55847f383160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:06.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.440+0000 7f65244ad740 4 client.25721 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:32:06.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.440+0000 7f65244ad740 1 -- 172.21.15.5:0/381363550 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55847f2669f0 con 0x55847ef501b0 2024-08-31T05:32:06.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.440+0000 7f65177fe640 1 --2- 172.21.15.5:0/381363550 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55847ef501b0 0x55847f383160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:06.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.440+0000 7f65177fe640 1 --2- 172.21.15.5:0/381363550 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55847ef501b0 0x55847f383160 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6794b427892dfc69 server_cookie=3edbe0052f3255de in_seq=0 out_seq=0 2024-08-31T05:32:06.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.440+0000 7f64faff5640 10 client.25721 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:32:06.451 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.449+0000 7f64faff5640 1 -- 172.21.15.5:0/381363550 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55847f2669f0 con 0x55847ef501b0 2024-08-31T05:32:06.451 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.449+0000 7f64faff5640 10 client.25721 handle_command_reply: tid=0 2024-08-31T05:32:06.451 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.449+0000 7f65244ad740 1 client.25721 shutdown 2024-08-31T05:32:06.451 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.449+0000 7f65244ad740 1 -- 172.21.15.5:0/381363550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55847ef272f0 msgr2=0x55847f308400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:06.451 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.449+0000 7f65244ad740 1 --2- 172.21.15.5:0/381363550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55847ef272f0 0x55847f308400 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x55847f315da0 tx=0x7f650c012b00 comp rx=0 tx=0).stop 2024-08-31T05:32:06.451 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.449+0000 7f65244ad740 1 -- 172.21.15.5:0/381363550 shutdown_connections 2024-08-31T05:32:06.452 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.449+0000 7f65244ad740 1 --2- 172.21.15.5:0/381363550 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55847ef501b0 0x55847f383160 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:06.452 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.449+0000 7f65244ad740 1 --2- 172.21.15.5:0/381363550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55847ef2f4d0 0x55847f37f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:06.452 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.449+0000 7f65244ad740 1 --2- 172.21.15.5:0/381363550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55847ef272f0 0x55847f308400 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:06.452 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.449+0000 7f65244ad740 1 --2- 172.21.15.5:0/381363550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55847ef0ed80 0x55847f307ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:06.452 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.449+0000 7f64faff5640 0 client.25721 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:32:06.452 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.449+0000 7f65244ad740 1 -- 172.21.15.5:0/381363550 >> 172.21.15.5:0/381363550 conn(0x55847ef44300 msgr2=0x55847f304b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:06.452 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.449+0000 7f65244ad740 1 -- 172.21.15.5:0/381363550 shutdown_connections 2024-08-31T05:32:06.452 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.449+0000 7f65244ad740 1 -- 172.21.15.5:0/381363550 wait complete. 2024-08-31T05:32:06.452 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.449+0000 7f65244ad740 20 client.25721 trim_cache size 0 max 16384 2024-08-31T05:32:06.452 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:32:06.452 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:32:06.453 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:32:06.453 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:32:06.453 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.450+0000 7f651d539640 1 -- 172.21.15.5:0/1859318120 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f65000b4ca0 msgr2=0x7f65000b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:06.453 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.450+0000 7f651d539640 1 --2- 172.21.15.5:0/1859318120 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f65000b4ca0 0x7f65000b71b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f65080e2ea0 tx=0x7f65080e94c0 comp rx=0 tx=0).stop 2024-08-31T05:32:06.453 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.450+0000 7f651d539640 1 -- 172.21.15.5:0/1859318120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6518102760 msgr2=0x7f651819b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:06.454 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.450+0000 7f651d539640 1 --2- 172.21.15.5:0/1859318120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6518102760 0x7f651819b020 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f650800e9f0 tx=0x7f650800eeb0 comp rx=0 tx=0).stop 2024-08-31T05:32:06.454 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.450+0000 7f651d539640 1 -- 172.21.15.5:0/1859318120 shutdown_connections 2024-08-31T05:32:06.454 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.450+0000 7f651d539640 1 --2- 172.21.15.5:0/1859318120 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f65000b4ca0 0x7f65000b71b0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:06.454 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.450+0000 7f651d539640 1 --2- 172.21.15.5:0/1859318120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65181089e0 0x7f651819baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:06.454 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.450+0000 7f651d539640 1 --2- 172.21.15.5:0/1859318120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6518108090 0x7f651819b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:06.454 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.450+0000 7f651d539640 1 --2- 172.21.15.5:0/1859318120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6518102760 0x7f651819b020 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:06.454 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.450+0000 7f651d539640 1 -- 172.21.15.5:0/1859318120 >> 172.21.15.5:0/1859318120 conn(0x7f65180fe160 msgr2=0x7f6518107660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:06.454 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.450+0000 7f651d539640 1 -- 172.21.15.5:0/1859318120 shutdown_connections 2024-08-31T05:32:06.454 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:06.450+0000 7f651d539640 1 -- 172.21.15.5:0/1859318120 wait complete. 2024-08-31T05:32:06.909 INFO:tasks.workunit.client.0.smithi005.stdout: 1 141378 14.43 MB/sec warmup 54 sec latency 18.245 ms 2024-08-31T05:32:07.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:32:07 smithi050 ceph-mon[22146]: pgmap v409: 129 pgs: 129 active+clean; 72 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 2.1 MiB/s wr, 303 op/s 2024-08-31T05:32:07.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:32:07 smithi005 ceph-mon[18602]: pgmap v409: 129 pgs: 129 active+clean; 72 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 2.1 MiB/s wr, 303 op/s 2024-08-31T05:32:07.585 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:32:07 smithi070 ceph-mon[22316]: pgmap v409: 129 pgs: 129 active+clean; 72 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 2.1 MiB/s wr, 303 op/s 2024-08-31T05:32:07.909 INFO:tasks.workunit.client.0.smithi005.stdout: 1 143494 14.38 MB/sec warmup 55 sec latency 15.175 ms 2024-08-31T05:32:08.909 INFO:tasks.workunit.client.0.smithi005.stdout: 1 146126 14.38 MB/sec warmup 56 sec latency 15.862 ms 2024-08-31T05:32:09.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:32:09 smithi050 ceph-mon[22146]: pgmap v410: 129 pgs: 129 active+clean; 73 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 1.5 MiB/s wr, 224 op/s 2024-08-31T05:32:09.466 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:32:09 smithi005 ceph-mon[18602]: pgmap v410: 129 pgs: 129 active+clean; 73 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 1.5 MiB/s wr, 224 op/s 2024-08-31T05:32:09.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:32:09 smithi070 ceph-mon[22316]: pgmap v410: 129 pgs: 129 active+clean; 73 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 1.5 MiB/s wr, 224 op/s 2024-08-31T05:32:09.909 INFO:tasks.workunit.client.0.smithi005.stdout: 1 149218 14.45 MB/sec warmup 57 sec latency 12.917 ms 2024-08-31T05:32:10.910 INFO:tasks.workunit.client.0.smithi005.stdout: 1 151485 14.34 MB/sec warmup 58 sec latency 27.474 ms 2024-08-31T05:32:11.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:32:11 smithi005 ceph-mon[18602]: pgmap v411: 129 pgs: 129 active+clean; 79 MiB data, 640 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 2.1 MiB/s wr, 297 op/s 2024-08-31T05:32:11.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:32:11 smithi070 ceph-mon[22316]: pgmap v411: 129 pgs: 129 active+clean; 79 MiB data, 640 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 2.1 MiB/s wr, 297 op/s 2024-08-31T05:32:11.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:32:11 smithi050 ceph-mon[22146]: pgmap v411: 129 pgs: 129 active+clean; 79 MiB data, 640 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 2.1 MiB/s wr, 297 op/s 2024-08-31T05:32:11.909 INFO:tasks.workunit.client.0.smithi005.stdout: 1 153658 14.33 MB/sec warmup 59 sec latency 15.688 ms 2024-08-31T05:32:12.910 INFO:tasks.workunit.client.0.smithi005.stdout: 1 156568 14.37 MB/sec warmup 60 sec latency 13.872 ms 2024-08-31T05:32:13.459 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:32:13 smithi050 ceph-mon[22146]: pgmap v412: 129 pgs: 129 active+clean; 82 MiB data, 642 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 2.0 MiB/s wr, 281 op/s 2024-08-31T05:32:13.466 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:32:13 smithi005 ceph-mon[18602]: pgmap v412: 129 pgs: 129 active+clean; 82 MiB data, 642 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 2.0 MiB/s wr, 281 op/s 2024-08-31T05:32:13.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:32:13 smithi070 ceph-mon[22316]: pgmap v412: 129 pgs: 129 active+clean; 82 MiB data, 642 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 2.0 MiB/s wr, 281 op/s 2024-08-31T05:32:13.910 INFO:tasks.workunit.client.0.smithi005.stdout: 1 159636 14.42 MB/sec warmup 61 sec latency 13.228 ms 2024-08-31T05:32:14.910 INFO:tasks.workunit.client.0.smithi005.stdout: 1 161988 14.33 MB/sec warmup 62 sec latency 13.655 ms 2024-08-31T05:32:14.910 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T05:32:15.207 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:32:15.216 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:32:15 smithi005 ceph-mon[18602]: pgmap v413: 129 pgs: 129 active+clean; 82 MiB data, 644 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 1.6 MiB/s wr, 224 op/s 2024-08-31T05:32:15.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:32:15 smithi070 ceph-mon[22316]: pgmap v413: 129 pgs: 129 active+clean; 82 MiB data, 644 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 1.6 MiB/s wr, 224 op/s 2024-08-31T05:32:15.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:32:15 smithi050 ceph-mon[22146]: pgmap v413: 129 pgs: 129 active+clean; 82 MiB data, 644 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 1.6 MiB/s wr, 224 op/s 2024-08-31T05:32:15.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.698+0000 7f791b164640 1 -- 172.21.15.5:0/103020219 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7914102800 msgr2=0x7f7914102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:15.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.698+0000 7f791b164640 1 --2- 172.21.15.5:0/103020219 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7914102800 0x7f7914102c10 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f7908009900 tx=0x7f790802a410 comp rx=0 tx=0).stop 2024-08-31T05:32:15.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.698+0000 7f791b164640 1 -- 172.21.15.5:0/103020219 shutdown_connections 2024-08-31T05:32:15.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.698+0000 7f791b164640 1 --2- 172.21.15.5:0/103020219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7914108a90 0x7f791410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:15.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.698+0000 7f791b164640 1 --2- 172.21.15.5:0/103020219 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7914108140 0x7f7914108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:15.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.698+0000 7f791b164640 1 --2- 172.21.15.5:0/103020219 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7914102800 0x7f7914102c10 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:15.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.698+0000 7f791b164640 1 -- 172.21.15.5:0/103020219 >> 172.21.15.5:0/103020219 conn(0x7f79140794d0 msgr2=0x7f79140798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:15.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.698+0000 7f791b164640 1 -- 172.21.15.5:0/103020219 shutdown_connections 2024-08-31T05:32:15.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.698+0000 7f791b164640 1 -- 172.21.15.5:0/103020219 wait complete. 2024-08-31T05:32:15.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.699+0000 7f791b164640 1 Processor -- start 2024-08-31T05:32:15.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.699+0000 7f791b164640 1 -- start start 2024-08-31T05:32:15.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.699+0000 7f791b164640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7914102800 0x7f791419a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:15.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.700+0000 7f791b164640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7914108140 0x7f791419a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:15.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.700+0000 7f791b164640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7914108a90 0x7f791419fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:15.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.700+0000 7f791b164640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7914113820 con 0x7f7914108a90 2024-08-31T05:32:15.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.700+0000 7f791b164640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f79141136a0 con 0x7f7914108140 2024-08-31T05:32:15.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.700+0000 7f791b164640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f79141139a0 con 0x7f7914102800 2024-08-31T05:32:15.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.700+0000 7f7918f00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7914102800 0x7f791419a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:15.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.700+0000 7f7913fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7914108140 0x7f791419a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:15.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.700+0000 7f7918f00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7914102800 0x7f791419a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:48272/0 (socket says 172.21.15.5:48272) 2024-08-31T05:32:15.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.700+0000 7f7913fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7914108140 0x7f791419a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:48602/0 (socket says 172.21.15.5:48602) 2024-08-31T05:32:15.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.700+0000 7f7918f00640 1 -- 172.21.15.5:0/2969797269 learned_addr learned my addr 172.21.15.5:0/2969797269 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:15.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.700+0000 7f7919701640 1 --2- 172.21.15.5:0/2969797269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7914108a90 0x7f791419fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:15.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.700+0000 7f7913fff640 1 -- 172.21.15.5:0/2969797269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7914102800 msgr2=0x7f791419a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:15.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.700+0000 7f7913fff640 1 --2- 172.21.15.5:0/2969797269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7914102800 0x7f791419a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:15.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.700+0000 7f7913fff640 1 -- 172.21.15.5:0/2969797269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7914108a90 msgr2=0x7f791419fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:15.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.700+0000 7f7913fff640 1 --2- 172.21.15.5:0/2969797269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7914108a90 0x7f791419fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:15.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.700+0000 7f7913fff640 1 -- 172.21.15.5:0/2969797269 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79141a0140 con 0x7f7914108140 2024-08-31T05:32:15.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.700+0000 7f7913fff640 1 --2- 172.21.15.5:0/2969797269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7914108140 0x7f791419a770 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f790000e9c0 tx=0x7f790000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:15.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.700+0000 7f7911ffb640 1 -- 172.21.15.5:0/2969797269 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790000cd80 con 0x7f7914108140 2024-08-31T05:32:15.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.700+0000 7f7911ffb640 1 -- 172.21.15.5:0/2969797269 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f79000035f0 con 0x7f7914108140 2024-08-31T05:32:15.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.701+0000 7f791b164640 1 -- 172.21.15.5:0/2969797269 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79141a0430 con 0x7f7914108140 2024-08-31T05:32:15.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.701+0000 7f7911ffb640 1 -- 172.21.15.5:0/2969797269 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7900010690 con 0x7f7914108140 2024-08-31T05:32:15.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.701+0000 7f791b164640 1 -- 172.21.15.5:0/2969797269 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79141a6b90 con 0x7f7914108140 2024-08-31T05:32:15.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.704+0000 7f7911ffb640 1 -- 172.21.15.5:0/2969797269 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f7900010830 con 0x7f7914108140 2024-08-31T05:32:15.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.704+0000 7f79216d9740 1 Processor -- start 2024-08-31T05:32:15.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.705+0000 7f79216d9740 1 -- start start 2024-08-31T05:32:15.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.705+0000 7f7911ffb640 1 --2- 172.21.15.5:0/2969797269 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f79040b9130 0x7f79040bb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:15.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.705+0000 7f7919701640 1 --2- 172.21.15.5:0/2969797269 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f79040b9130 0x7f79040bb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:15.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.705+0000 7f7911ffb640 1 -- 172.21.15.5:0/2969797269 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f79000e5be0 con 0x7f7914108140 2024-08-31T05:32:15.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.705+0000 7f79216d9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d0693a070 0x557d06cdf2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:15.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.705+0000 7f79216d9740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557d069111b0 0x557d06cdf800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:15.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.705+0000 7f79216d9740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d06919390 0x557d06cdfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:15.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.705+0000 7f79216d9740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x557d06c56630 con 0x557d06919390 2024-08-31T05:32:15.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.705+0000 7f79216d9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x557d06c45bc0 con 0x557d0693a070 2024-08-31T05:32:15.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.705+0000 7f79216d9740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557d06c49b70 con 0x557d069111b0 2024-08-31T05:32:15.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.705+0000 7f7918f00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d0693a070 0x557d06cdf2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:15.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.705+0000 7f7913fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557d069111b0 0x557d06cdf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:15.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.705+0000 7f7918f00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d0693a070 0x557d06cdf2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:48612/0 (socket says 172.21.15.5:48612) 2024-08-31T05:32:15.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.705+0000 7f7918f00640 1 -- 172.21.15.5:0/1052733925 learned_addr learned my addr 172.21.15.5:0/1052733925 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:15.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.705+0000 7f7919701640 1 --2- 172.21.15.5:0/1052733925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d06919390 0x557d06cdfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:15.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.706+0000 7f7918f00640 1 -- 172.21.15.5:0/1052733925 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557d069111b0 msgr2=0x557d06cdf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:15.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.706+0000 7f7918f00640 1 --2- 172.21.15.5:0/1052733925 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557d069111b0 0x557d06cdf800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:15.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.706+0000 7f7918f00640 1 -- 172.21.15.5:0/1052733925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d06919390 msgr2=0x557d06cdfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:15.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.706+0000 7f7918f00640 1 --2- 172.21.15.5:0/1052733925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d06919390 0x557d06cdfd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:15.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.706+0000 7f7918f00640 1 -- 172.21.15.5:0/1052733925 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d069a5650 con 0x557d0693a070 2024-08-31T05:32:15.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.706+0000 7f7919701640 1 --2- 172.21.15.5:0/1052733925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d06919390 0x557d06cdfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:32:15.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.706+0000 7f7919701640 1 --2- 172.21.15.5:0/2969797269 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f79040b9130 0x7f79040bb640 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f790c005fd0 tx=0x7f790c011bc0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:15.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.706+0000 7f7918f00640 1 --2- 172.21.15.5:0/1052733925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d0693a070 0x557d06cdf2c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7908000c00 tx=0x7f7908031b10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=906aec9e75ffe0ff server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:15.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.706+0000 7f78feffd640 1 -- 172.21.15.5:0/1052733925 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7908040070 con 0x557d0693a070 2024-08-31T05:32:15.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.706+0000 7f78feffd640 1 -- 172.21.15.5:0/1052733925 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7908004030 con 0x557d0693a070 2024-08-31T05:32:15.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.706+0000 7f78feffd640 1 -- 172.21.15.5:0/1052733925 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7908035040 con 0x557d0693a070 2024-08-31T05:32:15.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.707+0000 7f79216d9740 1 -- 172.21.15.5:0/1052733925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d0693a070 msgr2=0x557d06cdf2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:15.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.707+0000 7f79216d9740 1 --2- 172.21.15.5:0/1052733925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d0693a070 0x557d06cdf2c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7908000c00 tx=0x7f7908031b10 comp rx=0 tx=0).stop 2024-08-31T05:32:15.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.707+0000 7f79216d9740 1 -- 172.21.15.5:0/1052733925 shutdown_connections 2024-08-31T05:32:15.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.707+0000 7f79216d9740 1 --2- 172.21.15.5:0/1052733925 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d06919390 0x557d06cdfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:15.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.707+0000 7f79216d9740 1 --2- 172.21.15.5:0/1052733925 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557d069111b0 0x557d06cdf800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:15.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.707+0000 7f79216d9740 1 --2- 172.21.15.5:0/1052733925 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d0693a070 0x557d06cdf2c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:15.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.707+0000 7f79216d9740 1 -- 172.21.15.5:0/1052733925 >> 172.21.15.5:0/1052733925 conn(0x557d0692e460 msgr2=0x557d06cdd1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:15.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.707+0000 7f79216d9740 1 -- 172.21.15.5:0/1052733925 shutdown_connections 2024-08-31T05:32:15.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.707+0000 7f79216d9740 1 -- 172.21.15.5:0/1052733925 wait complete. 2024-08-31T05:32:15.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.708+0000 7f79216d9740 1 -- start start 2024-08-31T05:32:15.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.708+0000 7f79216d9740 1 Processor -- start 2024-08-31T05:32:15.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.709+0000 7f79216d9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d069111b0 0x557d06ceaa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:15.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.709+0000 7f79216d9740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d06919390 0x557d06ceafd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:15.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.709+0000 7f79216d9740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557d0693a070 0x557d06cf6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:15.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.709+0000 7f79216d9740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x557d06aa8700 con 0x557d06919390 2024-08-31T05:32:15.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.709+0000 7f79216d9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x557d06bcc700 con 0x557d069111b0 2024-08-31T05:32:15.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.709+0000 7f79216d9740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557d06ceda40 con 0x557d0693a070 2024-08-31T05:32:15.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.709+0000 7f7913fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d06919390 0x557d06ceafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:15.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.709+0000 7f7918f00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d069111b0 0x557d06ceaa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:15.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.709+0000 7f7913fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d06919390 0x557d06ceafd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54946/0 (socket says 172.21.15.5:54946) 2024-08-31T05:32:15.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.709+0000 7f79216d9740 10 client.0 _ll_register_callbacks cb 0x557d06bfbdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:32:15.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.709+0000 7f7913fff640 1 -- 172.21.15.5:0/116378756 learned_addr learned my addr 172.21.15.5:0/116378756 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:15.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.709+0000 7f7919701640 1 --2- 172.21.15.5:0/116378756 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557d0693a070 0x557d06cf6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:15.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.709+0000 7f7918f00640 1 -- 172.21.15.5:0/116378756 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557d0693a070 msgr2=0x557d06cf6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:15.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.709+0000 7f7918f00640 1 --2- 172.21.15.5:0/116378756 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557d0693a070 0x557d06cf6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:15.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.709+0000 7f7918f00640 1 -- 172.21.15.5:0/116378756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d06919390 msgr2=0x557d06ceafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:15.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.709+0000 7f7918f00640 1 --2- 172.21.15.5:0/116378756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d06919390 0x557d06ceafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:15.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.709+0000 7f7918f00640 1 -- 172.21.15.5:0/116378756 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d06c058b0 con 0x557d069111b0 2024-08-31T05:32:15.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.709+0000 7f7913fff640 1 --2- 172.21.15.5:0/116378756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d06919390 0x557d06ceafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:32:15.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.710+0000 7f7918f00640 1 --2- 172.21.15.5:0/116378756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d069111b0 0x557d06ceaa90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7908005940 tx=0x7f7908005020 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8475f22a2505d18e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:15.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.710+0000 7f78f3fff640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:32:15.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.710+0000 7f78f3fff640 1 -- 172.21.15.5:0/116378756 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7908040070 con 0x557d069111b0 2024-08-31T05:32:15.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.710+0000 7f78f3fff640 1 -- 172.21.15.5:0/116378756 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f7908005440 con 0x557d069111b0 2024-08-31T05:32:15.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.710+0000 7f79216d9740 1 -- 172.21.15.5:0/116378756 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7908004030 con 0x557d069111b0 2024-08-31T05:32:15.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.710+0000 7f78f3fff640 1 -- 172.21.15.5:0/116378756 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f7908056050 con 0x557d069111b0 2024-08-31T05:32:15.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.710+0000 7f79216d9740 10 client.25733 fetch_fsmap learned FSMap version 32 2024-08-31T05:32:15.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.710+0000 7f79216d9740 1 -- 172.21.15.5:0/116378756 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x557d06cf9870 con 0x557d069111b0 2024-08-31T05:32:15.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.711+0000 7f78f3fff640 1 -- 172.21.15.5:0/116378756 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7908004030 con 0x557d069111b0 2024-08-31T05:32:15.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.711+0000 7f78f3fff640 1 -- 172.21.15.5:0/116378756 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f7908004b80 con 0x557d069111b0 2024-08-31T05:32:15.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.711+0000 7f79216d9740 10 client.25733 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:32:15.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.711+0000 7f79216d9740 10 client.25733 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:32:15.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.711+0000 7f79216d9740 20 client.25733 populate_metadata read hostname 'smithi005' 2024-08-31T05:32:15.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.712+0000 7f79216d9740 1 --2- 172.21.15.5:0/116378756 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x557d068f89f0 0x557d06cfcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:15.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.712+0000 7f79216d9740 4 client.25733 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:32:15.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.712+0000 7f79216d9740 1 -- 172.21.15.5:0/116378756 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557d06c58580 con 0x557d068f89f0 2024-08-31T05:32:15.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.712+0000 7f7913fff640 1 --2- 172.21.15.5:0/116378756 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x557d068f89f0 0x557d06cfcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:15.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.712+0000 7f78f3fff640 10 client.25733 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:32:15.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.712+0000 7f7913fff640 1 --2- 172.21.15.5:0/116378756 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x557d068f89f0 0x557d06cfcbd0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf160fb7a66ed673 server_cookie=55882217e2cd8145 in_seq=0 out_seq=0 2024-08-31T05:32:15.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.713+0000 7f78f3fff640 1 -- 172.21.15.5:0/116378756 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557d06c58580 con 0x557d068f89f0 2024-08-31T05:32:15.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.713+0000 7f78f3fff640 10 client.25733 handle_command_reply: tid=0 2024-08-31T05:32:15.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.713+0000 7f79216d9740 1 client.25733 shutdown 2024-08-31T05:32:15.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.713+0000 7f79216d9740 1 -- 172.21.15.5:0/116378756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d069111b0 msgr2=0x557d06ceaa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:15.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.713+0000 7f79216d9740 1 --2- 172.21.15.5:0/116378756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d069111b0 0x557d06ceaa90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7908005940 tx=0x7f7908005020 comp rx=0 tx=0).stop 2024-08-31T05:32:15.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.713+0000 7f79216d9740 1 -- 172.21.15.5:0/116378756 shutdown_connections 2024-08-31T05:32:15.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.713+0000 7f79216d9740 1 --2- 172.21.15.5:0/116378756 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x557d068f89f0 0x557d06cfcbd0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:15.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.713+0000 7f79216d9740 1 --2- 172.21.15.5:0/116378756 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557d0693a070 0x557d06cf6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:15.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.713+0000 7f78f3fff640 0 client.25733 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:32:15.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.713+0000 7f79216d9740 1 --2- 172.21.15.5:0/116378756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d06919390 0x557d06ceafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:15.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.713+0000 7f79216d9740 1 --2- 172.21.15.5:0/116378756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d069111b0 0x557d06ceaa90 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:15.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.713+0000 7f79216d9740 1 -- 172.21.15.5:0/116378756 >> 172.21.15.5:0/116378756 conn(0x557d0692e460 msgr2=0x557d06ce24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:15.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.713+0000 7f79216d9740 1 -- 172.21.15.5:0/116378756 shutdown_connections 2024-08-31T05:32:15.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.714+0000 7f79216d9740 1 -- 172.21.15.5:0/116378756 wait complete. 2024-08-31T05:32:15.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.714+0000 7f79216d9740 20 client.25733 trim_cache size 0 max 16384 2024-08-31T05:32:15.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.734+0000 7f79216d9740 1 Processor -- start 2024-08-31T05:32:15.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.734+0000 7f79216d9740 1 -- start start 2024-08-31T05:32:15.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.734+0000 7f79216d9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d068f89f0 0x557d06cf6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:15.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.734+0000 7f79216d9740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d069111b0 0x557d06ce2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:15.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.734+0000 7f79216d9740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557d06919390 0x557d06ce28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:15.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.734+0000 7f79216d9740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f79141ae980 con 0x557d069111b0 2024-08-31T05:32:15.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.734+0000 7f79216d9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f79141b0580 con 0x557d068f89f0 2024-08-31T05:32:15.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.734+0000 7f79216d9740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f79141af050 con 0x557d06919390 2024-08-31T05:32:15.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.734+0000 7f7913fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d069111b0 0x557d06ce2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:15.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.734+0000 7f7918f00640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d068f89f0 0x557d06cf6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:15.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.734+0000 7f7913fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d069111b0 0x557d06ce2390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54960/0 (socket says 172.21.15.5:54960) 2024-08-31T05:32:15.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.734+0000 7f7913fff640 1 -- 172.21.15.5:0/1290998383 learned_addr learned my addr 172.21.15.5:0/1290998383 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:15.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.734+0000 7f7919701640 1 --2- 172.21.15.5:0/1290998383 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557d06919390 0x557d06ce28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:15.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.734+0000 7f7918f00640 1 -- 172.21.15.5:0/1290998383 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557d06919390 msgr2=0x557d06ce28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:15.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.734+0000 7f7918f00640 1 --2- 172.21.15.5:0/1290998383 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557d06919390 0x557d06ce28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:15.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.734+0000 7f7918f00640 1 -- 172.21.15.5:0/1290998383 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d069111b0 msgr2=0x557d06ce2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:15.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.734+0000 7f7918f00640 1 --2- 172.21.15.5:0/1290998383 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d069111b0 0x557d06ce2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:15.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.734+0000 7f7918f00640 1 -- 172.21.15.5:0/1290998383 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d06ceb8b0 con 0x557d068f89f0 2024-08-31T05:32:15.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.735+0000 7f7913fff640 1 --2- 172.21.15.5:0/1290998383 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d069111b0 0x557d06ce2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:32:15.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.735+0000 7f7918f00640 1 --2- 172.21.15.5:0/1290998383 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d068f89f0 0x557d06cf6ca0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7908005090 tx=0x7f790802a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3071d773c2295886 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:15.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.735+0000 7f78fe7fc640 1 -- 172.21.15.5:0/1290998383 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7908040070 con 0x557d068f89f0 2024-08-31T05:32:15.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.735+0000 7f78fe7fc640 1 -- 172.21.15.5:0/1290998383 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f790804d070 con 0x557d068f89f0 2024-08-31T05:32:15.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.735+0000 7f78fe7fc640 1 -- 172.21.15.5:0/1290998383 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7908035040 con 0x557d068f89f0 2024-08-31T05:32:15.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.736+0000 7f79216d9740 1 -- 172.21.15.5:0/1290998383 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d068f89f0 msgr2=0x557d06cf6ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:15.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.736+0000 7f79216d9740 1 --2- 172.21.15.5:0/1290998383 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d068f89f0 0x557d06cf6ca0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7908005090 tx=0x7f790802a410 comp rx=0 tx=0).stop 2024-08-31T05:32:15.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.736+0000 7f79216d9740 1 -- 172.21.15.5:0/1290998383 shutdown_connections 2024-08-31T05:32:15.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.736+0000 7f79216d9740 1 --2- 172.21.15.5:0/1290998383 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557d06919390 0x557d06ce28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:15.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.736+0000 7f79216d9740 1 --2- 172.21.15.5:0/1290998383 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d069111b0 0x557d06ce2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:15.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.736+0000 7f79216d9740 1 --2- 172.21.15.5:0/1290998383 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d068f89f0 0x557d06cf6ca0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:15.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.736+0000 7f79216d9740 1 -- 172.21.15.5:0/1290998383 >> 172.21.15.5:0/1290998383 conn(0x557d0692e460 msgr2=0x557d06ce9310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:15.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.736+0000 7f79216d9740 1 -- 172.21.15.5:0/1290998383 shutdown_connections 2024-08-31T05:32:15.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.736+0000 7f79216d9740 1 -- 172.21.15.5:0/1290998383 wait complete. 2024-08-31T05:32:15.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.737+0000 7f79216d9740 1 -- start start 2024-08-31T05:32:15.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.737+0000 7f79216d9740 1 Processor -- start 2024-08-31T05:32:15.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.737+0000 7f79216d9740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d068f89f0 0x557d06cfde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:15.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.737+0000 7f79216d9740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557d069111b0 0x557d06cfe340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:15.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.737+0000 7f79216d9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d06919390 0x557d06cfe880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:15.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.737+0000 7f79216d9740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f79141afdf0 con 0x557d068f89f0 2024-08-31T05:32:15.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.737+0000 7f79216d9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f79141af720 con 0x557d06919390 2024-08-31T05:32:15.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.737+0000 7f79216d9740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f79141ac960 con 0x557d069111b0 2024-08-31T05:32:15.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.738+0000 7f79216d9740 10 client.0 _ll_register_callbacks cb 0x7f7908009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:32:15.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.738+0000 7f7918f00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d068f89f0 0x557d06cfde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:15.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.738+0000 7f7918f00640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d068f89f0 0x557d06cfde00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54972/0 (socket says 172.21.15.5:54972) 2024-08-31T05:32:15.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.738+0000 7f7918f00640 1 -- 172.21.15.5:0/3041235970 learned_addr learned my addr 172.21.15.5:0/3041235970 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:15.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.738+0000 7f7919701640 1 --2- 172.21.15.5:0/3041235970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d06919390 0x557d06cfe880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:15.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.738+0000 7f7913fff640 1 --2- 172.21.15.5:0/3041235970 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557d069111b0 0x557d06cfe340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:15.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.738+0000 7f7918f00640 1 -- 172.21.15.5:0/3041235970 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557d069111b0 msgr2=0x557d06cfe340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:15.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.738+0000 7f7918f00640 1 --2- 172.21.15.5:0/3041235970 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557d069111b0 0x557d06cfe340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:15.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.738+0000 7f7918f00640 1 -- 172.21.15.5:0/3041235970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d06919390 msgr2=0x557d06cfe880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:15.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.738+0000 7f7918f00640 1 --2- 172.21.15.5:0/3041235970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d06919390 0x557d06cfe880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:15.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.738+0000 7f7918f00640 1 -- 172.21.15.5:0/3041235970 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d06d66550 con 0x557d068f89f0 2024-08-31T05:32:15.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.738+0000 7f7918f00640 1 --2- 172.21.15.5:0/3041235970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d068f89f0 0x557d06cfde00 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f7908009a20 tx=0x7f7908031b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adc374a83f346ffd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:15.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.738+0000 7f78f3fff640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:32:15.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.738+0000 7f78f3fff640 1 -- 172.21.15.5:0/3041235970 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7908035040 con 0x557d068f89f0 2024-08-31T05:32:15.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.738+0000 7f78f3fff640 1 -- 172.21.15.5:0/3041235970 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f79080051d0 con 0x557d068f89f0 2024-08-31T05:32:15.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.738+0000 7f79216d9740 1 -- 172.21.15.5:0/3041235970 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f790804d070 con 0x557d068f89f0 2024-08-31T05:32:15.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.739+0000 7f78f3fff640 1 -- 172.21.15.5:0/3041235970 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f7908070050 con 0x557d068f89f0 2024-08-31T05:32:15.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.739+0000 7f79216d9740 10 client.16140 fetch_fsmap learned FSMap version 32 2024-08-31T05:32:15.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.739+0000 7f79216d9740 1 -- 172.21.15.5:0/3041235970 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x557d06d677e0 con 0x557d068f89f0 2024-08-31T05:32:15.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.739+0000 7f78f3fff640 1 -- 172.21.15.5:0/3041235970 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f790804d070 con 0x557d068f89f0 2024-08-31T05:32:15.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.739+0000 7f78f3fff640 1 -- 172.21.15.5:0/3041235970 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f7908003760 con 0x557d068f89f0 2024-08-31T05:32:15.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.739+0000 7f79216d9740 10 client.16140 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:32:15.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.739+0000 7f79216d9740 10 client.16140 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:32:15.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.739+0000 7f79216d9740 20 client.16140 populate_metadata read hostname 'smithi005' 2024-08-31T05:32:15.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.739+0000 7f79216d9740 1 --2- 172.21.15.5:0/3041235970 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x557d0693a070 0x557d06d69f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:15.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.739+0000 7f79216d9740 4 client.16140 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T05:32:15.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.739+0000 7f79216d9740 1 -- 172.21.15.5:0/3041235970 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557d06ce6640 con 0x557d0693a070 2024-08-31T05:32:15.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.739+0000 7f7913fff640 1 --2- 172.21.15.5:0/3041235970 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x557d0693a070 0x557d06d69f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:15.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.740+0000 7f78f3fff640 10 client.16140 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:32:15.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.740+0000 7f7913fff640 1 --2- 172.21.15.5:0/3041235970 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x557d0693a070 0x557d06d69f60 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ed6d2b317ec8cbd server_cookie=188535bdc1021dba in_seq=0 out_seq=0 2024-08-31T05:32:15.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.740+0000 7f78f3fff640 1 -- 172.21.15.5:0/3041235970 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+942 (crc 0 0 0) 0x557d06ce6640 con 0x557d0693a070 2024-08-31T05:32:15.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.740+0000 7f78f3fff640 10 client.16140 handle_command_reply: tid=0 2024-08-31T05:32:15.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.740+0000 7f79216d9740 1 client.16140 shutdown 2024-08-31T05:32:15.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.740+0000 7f79216d9740 1 -- 172.21.15.5:0/3041235970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d068f89f0 msgr2=0x557d06cfde00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:15.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.740+0000 7f79216d9740 1 --2- 172.21.15.5:0/3041235970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d068f89f0 0x557d06cfde00 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f7908009a20 tx=0x7f7908031b80 comp rx=0 tx=0).stop 2024-08-31T05:32:15.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.740+0000 7f79216d9740 1 -- 172.21.15.5:0/3041235970 shutdown_connections 2024-08-31T05:32:15.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.740+0000 7f79216d9740 1 --2- 172.21.15.5:0/3041235970 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x557d0693a070 0x557d06d69f60 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:15.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.740+0000 7f79216d9740 1 --2- 172.21.15.5:0/3041235970 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557d06919390 0x557d06cfe880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:15.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.740+0000 7f79216d9740 1 --2- 172.21.15.5:0/3041235970 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557d069111b0 0x557d06cfe340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:15.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.740+0000 7f78f3fff640 0 client.16140 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:32:15.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.740+0000 7f79216d9740 1 --2- 172.21.15.5:0/3041235970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557d068f89f0 0x557d06cfde00 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:15.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.740+0000 7f79216d9740 1 -- 172.21.15.5:0/3041235970 >> 172.21.15.5:0/3041235970 conn(0x557d0692e460 msgr2=0x557d06ce2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:15.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.741+0000 7f79216d9740 1 -- 172.21.15.5:0/3041235970 shutdown_connections 2024-08-31T05:32:15.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.741+0000 7f79216d9740 1 -- 172.21.15.5:0/3041235970 wait complete. 2024-08-31T05:32:15.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.741+0000 7f79216d9740 20 client.16140 trim_cache size 0 max 16384 2024-08-31T05:32:15.750 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:32:15.750 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "no active scrubs running", 2024-08-31T05:32:15.750 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": {}, 2024-08-31T05:32:15.750 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_stats": { 2024-08-31T05:32:15.750 INFO:teuthology.orchestra.run.smithi005.stdout: "cda92ac0-b35f-47a5-a3a5-471c888462a5": { 2024-08-31T05:32:15.750 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:53.103905+0000", 2024-08-31T05:32:15.750 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:32:15.750 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:32:15.750 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:32:15.750 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:32:15.750 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:32:15.750 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:32:15.751 INFO:teuthology.orchestra.run.smithi005.stdout: "ece37b07-9ab2-45f8-bc33-2755a07aac0b": { 2024-08-31T05:32:15.751 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:31:41.782407+0000", 2024-08-31T05:32:15.751 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:32:15.751 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:32:15.751 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:32:15.751 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:32:15.751 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:32:15.751 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:32:15.751 INFO:teuthology.orchestra.run.smithi005.stdout: "75d84398-5d9c-4872-b879-2fbce045fa71": { 2024-08-31T05:32:15.751 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:06.642335+0000", 2024-08-31T05:32:15.751 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:32:15.751 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:32:15.751 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:32:15.751 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:32:15.751 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:32:15.752 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:32:15.752 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:32:15.752 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:32:15.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.741+0000 7f791b164640 1 -- 172.21.15.5:0/2969797269 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f79040b9130 msgr2=0x7f79040bb640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:15.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.741+0000 7f791b164640 1 --2- 172.21.15.5:0/2969797269 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f79040b9130 0x7f79040bb640 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f790c005fd0 tx=0x7f790c011bc0 comp rx=0 tx=0).stop 2024-08-31T05:32:15.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.741+0000 7f791b164640 1 -- 172.21.15.5:0/2969797269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7914108140 msgr2=0x7f791419a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:15.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.741+0000 7f791b164640 1 --2- 172.21.15.5:0/2969797269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7914108140 0x7f791419a770 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f790000e9c0 tx=0x7f790000ee80 comp rx=0 tx=0).stop 2024-08-31T05:32:15.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.742+0000 7f791b164640 1 -- 172.21.15.5:0/2969797269 shutdown_connections 2024-08-31T05:32:15.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.742+0000 7f791b164640 1 --2- 172.21.15.5:0/2969797269 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f79040b9130 0x7f79040bb640 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:15.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.742+0000 7f791b164640 1 --2- 172.21.15.5:0/2969797269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7914108a90 0x7f791419fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:15.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.742+0000 7f791b164640 1 --2- 172.21.15.5:0/2969797269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7914108140 0x7f791419a770 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:15.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.742+0000 7f791b164640 1 --2- 172.21.15.5:0/2969797269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7914102800 0x7f791419a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:15.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.742+0000 7f791b164640 1 -- 172.21.15.5:0/2969797269 >> 172.21.15.5:0/2969797269 conn(0x7f79140794d0 msgr2=0x7f7914101130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:15.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.742+0000 7f791b164640 1 -- 172.21.15.5:0/2969797269 shutdown_connections 2024-08-31T05:32:15.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:15.742+0000 7f791b164640 1 -- 172.21.15.5:0/2969797269 wait complete. 2024-08-31T05:32:15.910 INFO:tasks.workunit.client.0.smithi005.stdout: 1 163655 14.30 MB/sec warmup 63 sec latency 57.683 ms 2024-08-31T05:32:16.537 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T05:32:16.537 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T05:32:16.821 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:32:16.910 INFO:tasks.workunit.client.0.smithi005.stdout: 1 166551 14.30 MB/sec warmup 64 sec latency 12.799 ms 2024-08-31T05:32:17.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:32:17 smithi005 ceph-mon[18602]: pgmap v414: 129 pgs: 129 active+clean; 85 MiB data, 676 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 2.0 MiB/s wr, 237 op/s 2024-08-31T05:32:17.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.365+0000 7f6061a1c640 1 -- 172.21.15.5:0/4079504506 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f605c108160 msgr2=0x7f605c108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:17.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.365+0000 7f6061a1c640 1 --2- 172.21.15.5:0/4079504506 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f605c108160 0x7f605c108570 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f6044009900 tx=0x7f604402a410 comp rx=0 tx=0).stop 2024-08-31T05:32:17.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.365+0000 7f6061a1c640 1 -- 172.21.15.5:0/4079504506 shutdown_connections 2024-08-31T05:32:17.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.365+0000 7f6061a1c640 1 --2- 172.21.15.5:0/4079504506 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f605c108ab0 0x7f605c10f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:17.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.365+0000 7f6061a1c640 1 --2- 172.21.15.5:0/4079504506 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f605c108160 0x7f605c108570 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:17.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.365+0000 7f6061a1c640 1 --2- 172.21.15.5:0/4079504506 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f605c102820 0x7f605c102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:17.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.365+0000 7f6061a1c640 1 -- 172.21.15.5:0/4079504506 >> 172.21.15.5:0/4079504506 conn(0x7f605c0794e0 msgr2=0x7f605c0798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:17.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.365+0000 7f6061a1c640 1 -- 172.21.15.5:0/4079504506 shutdown_connections 2024-08-31T05:32:17.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.365+0000 7f6061a1c640 1 -- 172.21.15.5:0/4079504506 wait complete. 2024-08-31T05:32:17.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.366+0000 7f6061a1c640 1 Processor -- start 2024-08-31T05:32:17.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.366+0000 7f6061a1c640 1 -- start start 2024-08-31T05:32:17.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.366+0000 7f6061a1c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f605c102820 0x7f605c1991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:17.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.366+0000 7f6061a1c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f605c108160 0x7f605c199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:17.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.366+0000 7f6061a1c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f605c108ab0 0x7f605c19e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:17.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.366+0000 7f6061a1c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f605c112700 con 0x7f605c108160 2024-08-31T05:32:17.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.366+0000 7f6061a1c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f605c112580 con 0x7f605c102820 2024-08-31T05:32:17.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.366+0000 7f6061a1c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f605c112880 con 0x7f605c108ab0 2024-08-31T05:32:17.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.366+0000 7f60527fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f605c108160 0x7f605c199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:17.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.366+0000 7f60527fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f605c108160 0x7f605c199750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54988/0 (socket says 172.21.15.5:54988) 2024-08-31T05:32:17.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.366+0000 7f60527fc640 1 -- 172.21.15.5:0/827648563 learned_addr learned my addr 172.21.15.5:0/827648563 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:17.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.366+0000 7f605b7fe640 1 --2- 172.21.15.5:0/827648563 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f605c108ab0 0x7f605c19e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:17.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.367+0000 7f605affd640 1 --2- 172.21.15.5:0/827648563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f605c102820 0x7f605c1991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:17.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.367+0000 7f60527fc640 1 -- 172.21.15.5:0/827648563 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f605c108ab0 msgr2=0x7f605c19e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:17.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.367+0000 7f60527fc640 1 --2- 172.21.15.5:0/827648563 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f605c108ab0 0x7f605c19e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:17.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.367+0000 7f60527fc640 1 -- 172.21.15.5:0/827648563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f605c102820 msgr2=0x7f605c1991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:17.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.367+0000 7f60527fc640 1 --2- 172.21.15.5:0/827648563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f605c102820 0x7f605c1991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:17.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.367+0000 7f60527fc640 1 -- 172.21.15.5:0/827648563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f605c19f120 con 0x7f605c108160 2024-08-31T05:32:17.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.367+0000 7f605b7fe640 1 --2- 172.21.15.5:0/827648563 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f605c108ab0 0x7f605c19e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:32:17.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.367+0000 7f60527fc640 1 --2- 172.21.15.5:0/827648563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f605c108160 0x7f605c199750 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f6044032fd0 tx=0x7f6044031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:17.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.367+0000 7f6060a1a640 1 -- 172.21.15.5:0/827648563 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f604403f030 con 0x7f605c108160 2024-08-31T05:32:17.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.367+0000 7f6061a1c640 1 -- 172.21.15.5:0/827648563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f605c19f3b0 con 0x7f605c108160 2024-08-31T05:32:17.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.367+0000 7f6060a1a640 1 -- 172.21.15.5:0/827648563 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6044004490 con 0x7f605c108160 2024-08-31T05:32:17.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.367+0000 7f6060a1a640 1 -- 172.21.15.5:0/827648563 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6044035070 con 0x7f605c108160 2024-08-31T05:32:17.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.367+0000 7f6061a1c640 1 -- 172.21.15.5:0/827648563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f605c1a5b70 con 0x7f605c108160 2024-08-31T05:32:17.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.368+0000 7f6061a1c640 1 -- 172.21.15.5:0/827648563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f605c102c30 con 0x7f605c108160 2024-08-31T05:32:17.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.370+0000 7f6060a1a640 1 -- 172.21.15.5:0/827648563 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f6044042030 con 0x7f605c108160 2024-08-31T05:32:17.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.371+0000 7f6060a1a640 1 --2- 172.21.15.5:0/827648563 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f60480b4ca0 0x7f60480b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:17.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.371+0000 7f605affd640 1 --2- 172.21.15.5:0/827648563 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f60480b4ca0 0x7f60480b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:17.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.371+0000 7f6060a1a640 1 -- 172.21.15.5:0/827648563 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f6044106130 con 0x7f605c108160 2024-08-31T05:32:17.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.372+0000 7f605affd640 1 --2- 172.21.15.5:0/827648563 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f60480b4ca0 0x7f60480b71b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f604c009b60 tx=0x7f604c005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:17.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.374+0000 7f6060a1a640 1 -- 172.21.15.5:0/827648563 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f60440ccb40 con 0x7f605c108160 2024-08-31T05:32:17.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:32:17 smithi070 ceph-mon[22316]: pgmap v414: 129 pgs: 129 active+clean; 85 MiB data, 676 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 2.0 MiB/s wr, 237 op/s 2024-08-31T05:32:17.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.620+0000 7f6061a1c640 1 -- 172.21.15.5:0/827648563 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f605c19a2e0 con 0x7f605c108160 2024-08-31T05:32:17.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.621+0000 7f6060a1a640 1 -- 172.21.15.5:0/827648563 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11948 (secure 0 0 0) 0x7f60440cc440 con 0x7f605c108160 2024-08-31T05:32:17.623 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:32:17.623 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":32,"btime":"2024-08-31T05:31:23:083919+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14739,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2024812199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2024812199},{"type":"v1","addr":"172.21.15.5:6835","nonce":2024812199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3629023702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3629023702},{"type":"v1","addr":"172.21.15.5:6837","nonce":3629023702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T05:27:31.929153+0000","modified":"2024-08-31T05:31:22.377433+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24652,"mds_1":24638,"mds_2":24631,"mds_3":24625,"mds_4":24602},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6839/2412701258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":2412701258},{"type":"v1","addr":"172.21.15.5:6839","nonce":2412701258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14820":{"gid":14820,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6841/747057838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":747057838},{"type":"v1","addr":"172.21.15.5:6841","nonce":747057838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6833/1153378982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1153378982},{"type":"v1","addr":"172.21.15.50:6833","nonce":1153378982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6833/364083443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":364083443},{"type":"v1","addr":"172.21.15.70:6833","nonce":364083443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24587":{"gid":24587,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/2346896794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2346896794},{"type":"v1","addr":"172.21.15.50:6835","nonce":2346896794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24602":{"gid":24602,"name":"h","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.50:6837/428759669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":428759669},{"type":"v1","addr":"172.21.15.50:6837","nonce":428759669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.70:6835/2061504114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2061504114},{"type":"v1","addr":"172.21.15.70:6835","nonce":2061504114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.70:6837/2780036414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2780036414},{"type":"v1","addr":"172.21.15.70:6837","nonce":2780036414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.50:6839/98200944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":98200944},{"type":"v1","addr":"172.21.15.50:6839","nonce":98200944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24652":{"gid":24652,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.70:6839/2756569250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":2756569250},{"type":"v1","addr":"172.21.15.70:6839","nonce":2756569250}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24652,"qdb_cluster":[24652,24631,24638,24625,24602]},"id":1}]} 2024-08-31T05:32:17.624 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 32 2024-08-31T05:32:17.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.624+0000 7f6061a1c640 1 -- 172.21.15.5:0/827648563 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f60480b4ca0 msgr2=0x7f60480b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:17.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.624+0000 7f6061a1c640 1 --2- 172.21.15.5:0/827648563 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f60480b4ca0 0x7f60480b71b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f604c009b60 tx=0x7f604c005f90 comp rx=0 tx=0).stop 2024-08-31T05:32:17.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.624+0000 7f6061a1c640 1 -- 172.21.15.5:0/827648563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f605c108160 msgr2=0x7f605c199750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:17.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.624+0000 7f6061a1c640 1 --2- 172.21.15.5:0/827648563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f605c108160 0x7f605c199750 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f6044032fd0 tx=0x7f6044031a20 comp rx=0 tx=0).stop 2024-08-31T05:32:17.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.624+0000 7f6061a1c640 1 -- 172.21.15.5:0/827648563 shutdown_connections 2024-08-31T05:32:17.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.624+0000 7f6061a1c640 1 --2- 172.21.15.5:0/827648563 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f60480b4ca0 0x7f60480b71b0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:17.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.624+0000 7f6061a1c640 1 --2- 172.21.15.5:0/827648563 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f605c108ab0 0x7f605c19e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:17.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.624+0000 7f6061a1c640 1 --2- 172.21.15.5:0/827648563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f605c108160 0x7f605c199750 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:17.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.624+0000 7f6061a1c640 1 --2- 172.21.15.5:0/827648563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f605c102820 0x7f605c1991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:17.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.624+0000 7f6061a1c640 1 -- 172.21.15.5:0/827648563 >> 172.21.15.5:0/827648563 conn(0x7f605c0794e0 msgr2=0x7f605c104220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:17.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.624+0000 7f6061a1c640 1 -- 172.21.15.5:0/827648563 shutdown_connections 2024-08-31T05:32:17.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:17.624+0000 7f6061a1c640 1 -- 172.21.15.5:0/827648563 wait complete. 2024-08-31T05:32:17.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:32:17 smithi050 ceph-mon[22146]: pgmap v414: 129 pgs: 129 active+clean; 85 MiB data, 676 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 2.0 MiB/s wr, 237 op/s 2024-08-31T05:32:17.910 INFO:tasks.workunit.client.0.smithi005.stdout: 1 168610 14.23 MB/sec warmup 65 sec latency 13.781 ms 2024-08-31T05:32:18.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:32:18 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/827648563' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:32:18.410 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-31T05:32:18.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:32:18 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/827648563' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:32:18.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:32:18 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/827648563' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:32:18.678 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:32:18.910 INFO:tasks.workunit.client.0.smithi005.stdout: 1 170983 14.23 MB/sec warmup 66 sec latency 22.261 ms 2024-08-31T05:32:19.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.173+0000 7ff1cb970640 1 -- 172.21.15.5:0/3746120721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1c4109270 msgr2=0x7ff1c4109680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:19.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.173+0000 7ff1cb970640 1 --2- 172.21.15.5:0/3746120721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1c4109270 0x7ff1c4109680 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4009900 tx=0x7ff1b402a410 comp rx=0 tx=0).stop 2024-08-31T05:32:19.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.173+0000 7ff1cb970640 1 -- 172.21.15.5:0/3746120721 shutdown_connections 2024-08-31T05:32:19.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.173+0000 7ff1cb970640 1 --2- 172.21.15.5:0/3746120721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1c4109bc0 0x7ff1c41103f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.173+0000 7ff1cb970640 1 --2- 172.21.15.5:0/3746120721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1c4109270 0x7ff1c4109680 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.173+0000 7ff1cb970640 1 --2- 172.21.15.5:0/3746120721 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1c4103930 0x7ff1c4103d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.173+0000 7ff1cb970640 1 -- 172.21.15.5:0/3746120721 >> 172.21.15.5:0/3746120721 conn(0x7ff1c40ff3a0 msgr2=0x7ff1c41017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:19.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.174+0000 7ff1cb970640 1 -- 172.21.15.5:0/3746120721 shutdown_connections 2024-08-31T05:32:19.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.174+0000 7ff1cb970640 1 -- 172.21.15.5:0/3746120721 wait complete. 2024-08-31T05:32:19.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.174+0000 7ff1cb970640 1 Processor -- start 2024-08-31T05:32:19.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.174+0000 7ff1cb970640 1 -- start start 2024-08-31T05:32:19.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.175+0000 7ff1cb970640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1c4103930 0x7ff1c419a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:19.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.175+0000 7ff1cb970640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1c4109270 0x7ff1c419a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:19.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.175+0000 7ff1cb970640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1c4109bc0 0x7ff1c419fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:19.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.175+0000 7ff1cb970640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c41138d0 con 0x7ff1c4109bc0 2024-08-31T05:32:19.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.175+0000 7ff1cb970640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c4113750 con 0x7ff1c4103930 2024-08-31T05:32:19.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.175+0000 7ff1cb970640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c4113a50 con 0x7ff1c4109270 2024-08-31T05:32:19.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.175+0000 7ff1c9f0d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1c4109bc0 0x7ff1c419fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:19.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.175+0000 7ff1c8f0b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1c4109270 0x7ff1c419a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:19.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.175+0000 7ff1c9f0d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1c4109bc0 0x7ff1c419fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55008/0 (socket says 172.21.15.5:55008) 2024-08-31T05:32:19.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.175+0000 7ff1c9f0d640 1 -- 172.21.15.5:0/2230409467 learned_addr learned my addr 172.21.15.5:0/2230409467 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:19.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.175+0000 7ff1c970c640 1 --2- 172.21.15.5:0/2230409467 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1c4103930 0x7ff1c419a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:19.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.175+0000 7ff1c9f0d640 1 -- 172.21.15.5:0/2230409467 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1c4109270 msgr2=0x7ff1c419a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:19.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.175+0000 7ff1c9f0d640 1 --2- 172.21.15.5:0/2230409467 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1c4109270 0x7ff1c419a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.175+0000 7ff1c9f0d640 1 -- 172.21.15.5:0/2230409467 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1c4103930 msgr2=0x7ff1c419a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:19.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.175+0000 7ff1c9f0d640 1 --2- 172.21.15.5:0/2230409467 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1c4103930 0x7ff1c419a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.175+0000 7ff1c9f0d640 1 -- 172.21.15.5:0/2230409467 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c41a01b0 con 0x7ff1c4109bc0 2024-08-31T05:32:19.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.176+0000 7ff1c9f0d640 1 --2- 172.21.15.5:0/2230409467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1c4109bc0 0x7ff1c419fa80 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc00eb10 tx=0x7ff1bc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:19.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.176+0000 7ff1ba7fc640 1 -- 172.21.15.5:0/2230409467 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc004b20 con 0x7ff1c4109bc0 2024-08-31T05:32:19.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.176+0000 7ff1cb970640 1 -- 172.21.15.5:0/2230409467 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1c41a04a0 con 0x7ff1c4109bc0 2024-08-31T05:32:19.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.176+0000 7ff1ba7fc640 1 -- 172.21.15.5:0/2230409467 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1bc004cc0 con 0x7ff1c4109bc0 2024-08-31T05:32:19.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.176+0000 7ff1ba7fc640 1 -- 172.21.15.5:0/2230409467 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc010670 con 0x7ff1c4109bc0 2024-08-31T05:32:19.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.176+0000 7ff1cb970640 1 -- 172.21.15.5:0/2230409467 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1c4075390 con 0x7ff1c4109bc0 2024-08-31T05:32:19.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.179+0000 7ff1ba7fc640 1 -- 172.21.15.5:0/2230409467 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7ff1bc010810 con 0x7ff1c4109bc0 2024-08-31T05:32:19.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.179+0000 7ff1d1ee5740 1 Processor -- start 2024-08-31T05:32:19.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.179+0000 7ff1d1ee5740 1 -- start start 2024-08-31T05:32:19.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.180+0000 7ff1d1ee5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565104fbb070 0x565105360310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:19.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.180+0000 7ff1d1ee5740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565104f921b0 0x565105360850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:19.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.180+0000 7ff1d1ee5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565104f9a390 0x565105360d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:19.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.180+0000 7ff1d1ee5740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5651052d7680 con 0x565104f921b0 2024-08-31T05:32:19.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.180+0000 7ff1d1ee5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5651052c6c10 con 0x565104f9a390 2024-08-31T05:32:19.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.180+0000 7ff1d1ee5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5651052cabc0 con 0x565104fbb070 2024-08-31T05:32:19.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.180+0000 7ff1c8f0b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565104fbb070 0x565105360310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:19.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.180+0000 7ff1c970c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565104f921b0 0x565105360850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:19.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.180+0000 7ff1ba7fc640 1 --2- 172.21.15.5:0/2230409467 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff1b00b4ca0 0x7ff1b00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:19.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.180+0000 7ff1c8f0b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565104fbb070 0x565105360310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:48342/0 (socket says 172.21.15.5:48342) 2024-08-31T05:32:19.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.180+0000 7ff1c8f0b640 1 -- 172.21.15.5:0/3516832987 learned_addr learned my addr 172.21.15.5:0/3516832987 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:19.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.180+0000 7ff1c8f0b640 1 --2- 172.21.15.5:0/3516832987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565104f9a390 0x565105360d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:19.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.180+0000 7ff1ba7fc640 1 -- 172.21.15.5:0/2230409467 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7ff1bc0e5e30 con 0x7ff1c4109bc0 2024-08-31T05:32:19.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.180+0000 7ff1c970c640 1 -- 172.21.15.5:0/3516832987 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565104fbb070 msgr2=0x565105360310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:19.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.180+0000 7ff1c970c640 1 --2- 172.21.15.5:0/3516832987 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565104fbb070 0x565105360310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.180+0000 7ff1c970c640 1 -- 172.21.15.5:0/3516832987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565104f9a390 msgr2=0x565105360d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:19.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.180+0000 7ff1c970c640 1 --2- 172.21.15.5:0/3516832987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565104f9a390 0x565105360d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.180+0000 7ff1c970c640 1 -- 172.21.15.5:0/3516832987 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565105026650 con 0x565104f921b0 2024-08-31T05:32:19.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.180+0000 7ff1c9f0d640 1 --2- 172.21.15.5:0/2230409467 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff1b00b4ca0 0x7ff1b00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:19.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.181+0000 7ff1c970c640 1 --2- 172.21.15.5:0/3516832987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565104f921b0 0x565105360850 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff1c0009c00 tx=0x7ff1c0011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f98aa94016bcf50 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:19.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.181+0000 7ff1c9f0d640 1 --2- 172.21.15.5:0/2230409467 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff1b00b4ca0 0x7ff1b00b71b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc0e32b0 tx=0x7ff1bc091f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:19.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.181+0000 7ff1af7fe640 1 -- 172.21.15.5:0/3516832987 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c0004230 con 0x565104f921b0 2024-08-31T05:32:19.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.181+0000 7ff1af7fe640 1 -- 172.21.15.5:0/3516832987 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1c00043d0 con 0x565104f921b0 2024-08-31T05:32:19.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.181+0000 7ff1af7fe640 1 -- 172.21.15.5:0/3516832987 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c0004c60 con 0x565104f921b0 2024-08-31T05:32:19.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.182+0000 7ff1d1ee5740 1 -- 172.21.15.5:0/3516832987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565104f921b0 msgr2=0x565105360850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:19.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.182+0000 7ff1d1ee5740 1 --2- 172.21.15.5:0/3516832987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565104f921b0 0x565105360850 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff1c0009c00 tx=0x7ff1c0011810 comp rx=0 tx=0).stop 2024-08-31T05:32:19.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.182+0000 7ff1d1ee5740 1 -- 172.21.15.5:0/3516832987 shutdown_connections 2024-08-31T05:32:19.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.182+0000 7ff1d1ee5740 1 --2- 172.21.15.5:0/3516832987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565104f9a390 0x565105360d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.182+0000 7ff1d1ee5740 1 --2- 172.21.15.5:0/3516832987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565104f921b0 0x565105360850 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.182+0000 7ff1d1ee5740 1 --2- 172.21.15.5:0/3516832987 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565104fbb070 0x565105360310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.182+0000 7ff1d1ee5740 1 -- 172.21.15.5:0/3516832987 >> 172.21.15.5:0/3516832987 conn(0x565104faf460 msgr2=0x56510535e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:19.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.182+0000 7ff1d1ee5740 1 -- 172.21.15.5:0/3516832987 shutdown_connections 2024-08-31T05:32:19.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.182+0000 7ff1d1ee5740 1 -- 172.21.15.5:0/3516832987 wait complete. 2024-08-31T05:32:19.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.182+0000 7ff1d1ee5740 1 -- start start 2024-08-31T05:32:19.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.183+0000 7ff1d1ee5740 1 Processor -- start 2024-08-31T05:32:19.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.183+0000 7ff1d1ee5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565104f921b0 0x56510536ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:19.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.183+0000 7ff1d1ee5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565104f9a390 0x56510536bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:19.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.183+0000 7ff1d1ee5740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565104fbb070 0x565105377de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:19.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.183+0000 7ff1d1ee5740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x565105129700 con 0x565104fbb070 2024-08-31T05:32:19.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.183+0000 7ff1d1ee5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56510524d750 con 0x565104f9a390 2024-08-31T05:32:19.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.183+0000 7ff1d1ee5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56510536eaf0 con 0x565104f921b0 2024-08-31T05:32:19.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.183+0000 7ff1d1ee5740 10 client.0 _ll_register_callbacks cb 0x56510527ce10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:32:19.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.183+0000 7ff1c970c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565104f9a390 0x56510536bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:19.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.183+0000 7ff1c8f0b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565104f921b0 0x56510536ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:19.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.183+0000 7ff1c970c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565104f9a390 0x56510536bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:48694/0 (socket says 172.21.15.5:48694) 2024-08-31T05:32:19.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.183+0000 7ff1c970c640 1 -- 172.21.15.5:0/4040688440 learned_addr learned my addr 172.21.15.5:0/4040688440 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:19.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.183+0000 7ff1c8f0b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565104f921b0 0x56510536ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:48358/0 (socket says 172.21.15.5:48358) 2024-08-31T05:32:19.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.183+0000 7ff1c8f0b640 1 --2- 172.21.15.5:0/4040688440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565104fbb070 0x565105377de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:19.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.184+0000 7ff1c970c640 1 -- 172.21.15.5:0/4040688440 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565104f921b0 msgr2=0x56510536ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:19.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.184+0000 7ff1c970c640 1 --2- 172.21.15.5:0/4040688440 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565104f921b0 0x56510536ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.184+0000 7ff1c970c640 1 -- 172.21.15.5:0/4040688440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565104fbb070 msgr2=0x565105377de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:19.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.184+0000 7ff1c970c640 1 --2- 172.21.15.5:0/4040688440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565104fbb070 0x565105377de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.184+0000 7ff1c970c640 1 -- 172.21.15.5:0/4040688440 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565105286900 con 0x565104f9a390 2024-08-31T05:32:19.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.184+0000 7ff1c970c640 1 --2- 172.21.15.5:0/4040688440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565104f9a390 0x56510536bfb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff1c0004940 tx=0x7ff1c0019ac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f2f393b2df2efe server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:19.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.184+0000 7ff1acff9640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:32:19.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.184+0000 7ff1acff9640 1 -- 172.21.15.5:0/4040688440 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c0028020 con 0x565104f9a390 2024-08-31T05:32:19.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.184+0000 7ff1d1ee5740 1 -- 172.21.15.5:0/4040688440 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1c00043d0 con 0x565104f9a390 2024-08-31T05:32:19.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.184+0000 7ff1acff9640 1 -- 172.21.15.5:0/4040688440 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7ff1c0024420 con 0x565104f9a390 2024-08-31T05:32:19.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.184+0000 7ff1acff9640 1 -- 172.21.15.5:0/4040688440 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff1c0033050 con 0x565104f9a390 2024-08-31T05:32:19.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.184+0000 7ff1d1ee5740 10 client.25757 fetch_fsmap learned FSMap version 32 2024-08-31T05:32:19.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.184+0000 7ff1d1ee5740 1 -- 172.21.15.5:0/4040688440 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56510537a8a0 con 0x565104f9a390 2024-08-31T05:32:19.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.185+0000 7ff1acff9640 1 -- 172.21.15.5:0/4040688440 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1c00043d0 con 0x565104f9a390 2024-08-31T05:32:19.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.185+0000 7ff1acff9640 1 -- 172.21.15.5:0/4040688440 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7ff1c0018070 con 0x565104f9a390 2024-08-31T05:32:19.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.185+0000 7ff1d1ee5740 10 client.25757 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:32:19.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.185+0000 7ff1d1ee5740 10 client.25757 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-31T05:32:19.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.185+0000 7ff1d1ee5740 20 client.25757 populate_metadata read hostname 'smithi005' 2024-08-31T05:32:19.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.185+0000 7ff1d1ee5740 1 --2- 172.21.15.5:0/4040688440 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x565104f799f0 0x56510537dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:19.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.185+0000 7ff1d1ee5740 4 client.25757 mds_command: new command op to 24602 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:32:19.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.185+0000 7ff1d1ee5740 1 -- 172.21.15.5:0/4040688440 --> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5651052d95d0 con 0x565104f799f0 2024-08-31T05:32:19.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.185+0000 7ff1c8f0b640 1 --2- 172.21.15.5:0/4040688440 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x565104f799f0 0x56510537dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:19.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.185+0000 7ff1acff9640 10 client.25757 ms_handle_connect on v2:172.21.15.50:6836/428759669 2024-08-31T05:32:19.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.186+0000 7ff1c8f0b640 1 --2- 172.21.15.5:0/4040688440 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x565104f799f0 0x56510537dcb0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=89278d62e2cadfd9 server_cookie=a378f29ea51ff230 in_seq=0 out_seq=0 2024-08-31T05:32:19.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.186+0000 7ff1acff9640 1 -- 172.21.15.5:0/4040688440 <== mds.4 v2:172.21.15.50:6836/428759669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5651052d95d0 con 0x565104f799f0 2024-08-31T05:32:19.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.186+0000 7ff1acff9640 10 client.25757 handle_command_reply: tid=0 2024-08-31T05:32:19.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.186+0000 7ff1d1ee5740 1 client.25757 shutdown 2024-08-31T05:32:19.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.187+0000 7ff1d1ee5740 1 -- 172.21.15.5:0/4040688440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565104f9a390 msgr2=0x56510536bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:19.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.187+0000 7ff1d1ee5740 1 --2- 172.21.15.5:0/4040688440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565104f9a390 0x56510536bfb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff1c0004940 tx=0x7ff1c0019ac0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.187+0000 7ff1d1ee5740 1 -- 172.21.15.5:0/4040688440 shutdown_connections 2024-08-31T05:32:19.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.187+0000 7ff1d1ee5740 1 --2- 172.21.15.5:0/4040688440 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x565104f799f0 0x56510537dcb0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.187+0000 7ff1d1ee5740 1 --2- 172.21.15.5:0/4040688440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565104fbb070 0x565105377de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.187+0000 7ff1d1ee5740 1 --2- 172.21.15.5:0/4040688440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565104f9a390 0x56510536bfb0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.187+0000 7ff1d1ee5740 1 --2- 172.21.15.5:0/4040688440 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565104f921b0 0x56510536ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.187+0000 7ff1acff9640 0 client.25757 ms_handle_reset on v2:172.21.15.50:6836/428759669 2024-08-31T05:32:19.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.187+0000 7ff1d1ee5740 1 -- 172.21.15.5:0/4040688440 >> 172.21.15.5:0/4040688440 conn(0x565104faf460 msgr2=0x5651053634a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:19.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.187+0000 7ff1d1ee5740 1 -- 172.21.15.5:0/4040688440 shutdown_connections 2024-08-31T05:32:19.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.187+0000 7ff1d1ee5740 1 -- 172.21.15.5:0/4040688440 wait complete. 2024-08-31T05:32:19.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.187+0000 7ff1d1ee5740 20 client.25757 trim_cache size 0 max 16384 2024-08-31T05:32:19.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.202+0000 7ff1d1ee5740 1 Processor -- start 2024-08-31T05:32:19.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.202+0000 7ff1d1ee5740 1 -- start start 2024-08-31T05:32:19.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.202+0000 7ff1d1ee5740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565104f921b0 0x565105361a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:19.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.202+0000 7ff1d1ee5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565104f9a390 0x565105377ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:19.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.202+0000 7ff1d1ee5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565104fbb070 0x565105368c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:19.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.202+0000 7ff1d1ee5740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c41aea90 con 0x565104f921b0 2024-08-31T05:32:19.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.202+0000 7ff1d1ee5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c41b0690 con 0x565104fbb070 2024-08-31T05:32:19.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.202+0000 7ff1d1ee5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c41af160 con 0x565104f9a390 2024-08-31T05:32:19.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.203+0000 7ff1c8f0b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565104f921b0 0x565105361a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:19.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.203+0000 7ff1c8f0b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565104f921b0 0x565105361a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55034/0 (socket says 172.21.15.5:55034) 2024-08-31T05:32:19.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.203+0000 7ff1c970c640 1 --2- 172.21.15.5:0/1183486002 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565104f9a390 0x565105377ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:19.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.203+0000 7ff1c8f0b640 1 -- 172.21.15.5:0/1183486002 learned_addr learned my addr 172.21.15.5:0/1183486002 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:19.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.203+0000 7ff1c8f0b640 1 --2- 172.21.15.5:0/1183486002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565104fbb070 0x565105368c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:19.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.203+0000 7ff1c970c640 1 -- 172.21.15.5:0/1183486002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565104fbb070 msgr2=0x565105368c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:19.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.203+0000 7ff1c970c640 1 --2- 172.21.15.5:0/1183486002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565104fbb070 0x565105368c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.203+0000 7ff1c970c640 1 -- 172.21.15.5:0/1183486002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565104f921b0 msgr2=0x565105361a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:19.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.203+0000 7ff1c970c640 1 --2- 172.21.15.5:0/1183486002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565104f921b0 0x565105361a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.203+0000 7ff1c970c640 1 -- 172.21.15.5:0/1183486002 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565105362830 con 0x565104f9a390 2024-08-31T05:32:19.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.203+0000 7ff1c970c640 1 --2- 172.21.15.5:0/1183486002 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565104f9a390 0x565105377ce0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff1c0001eb0 tx=0x7ff1c0009b70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0e00146816ad89f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:19.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.203+0000 7ff1aeffd640 1 -- 172.21.15.5:0/1183486002 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c003b070 con 0x565104f9a390 2024-08-31T05:32:19.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.203+0000 7ff1aeffd640 1 -- 172.21.15.5:0/1183486002 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1c001f040 con 0x565104f9a390 2024-08-31T05:32:19.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.203+0000 7ff1aeffd640 1 -- 172.21.15.5:0/1183486002 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c0028050 con 0x565104f9a390 2024-08-31T05:32:19.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.204+0000 7ff1d1ee5740 1 -- 172.21.15.5:0/1183486002 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565104f9a390 msgr2=0x565105377ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:19.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.204+0000 7ff1d1ee5740 1 --2- 172.21.15.5:0/1183486002 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565104f9a390 0x565105377ce0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff1c0001eb0 tx=0x7ff1c0009b70 comp rx=0 tx=0).stop 2024-08-31T05:32:19.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.204+0000 7ff1d1ee5740 1 -- 172.21.15.5:0/1183486002 shutdown_connections 2024-08-31T05:32:19.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.204+0000 7ff1d1ee5740 1 --2- 172.21.15.5:0/1183486002 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565104fbb070 0x565105368c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.204+0000 7ff1d1ee5740 1 --2- 172.21.15.5:0/1183486002 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565104f9a390 0x565105377ce0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.204+0000 7ff1d1ee5740 1 --2- 172.21.15.5:0/1183486002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565104f921b0 0x565105361a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.204+0000 7ff1d1ee5740 1 -- 172.21.15.5:0/1183486002 >> 172.21.15.5:0/1183486002 conn(0x565104faf460 msgr2=0x565105361340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:19.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.204+0000 7ff1d1ee5740 1 -- 172.21.15.5:0/1183486002 shutdown_connections 2024-08-31T05:32:19.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.204+0000 7ff1d1ee5740 1 -- 172.21.15.5:0/1183486002 wait complete. 2024-08-31T05:32:19.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.205+0000 7ff1d1ee5740 1 -- start start 2024-08-31T05:32:19.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.205+0000 7ff1d1ee5740 1 Processor -- start 2024-08-31T05:32:19.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.205+0000 7ff1d1ee5740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565104f921b0 0x565105370100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:19.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.205+0000 7ff1d1ee5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565104f9a390 0x565105370660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:19.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.205+0000 7ff1d1ee5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565104fbb070 0x5651053e7510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:19.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.205+0000 7ff1d1ee5740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c41aff00 con 0x565104f921b0 2024-08-31T05:32:19.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.205+0000 7ff1d1ee5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c41af830 con 0x565104fbb070 2024-08-31T05:32:19.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.205+0000 7ff1d1ee5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c41aca70 con 0x565104f9a390 2024-08-31T05:32:19.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.205+0000 7ff1d1ee5740 10 client.0 _ll_register_callbacks cb 0x7ff1b4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:32:19.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.205+0000 7ff1c8f0b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565104f921b0 0x565105370100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:19.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.205+0000 7ff1c8f0b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565104f921b0 0x565105370100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55050/0 (socket says 172.21.15.5:55050) 2024-08-31T05:32:19.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.205+0000 7ff1c8f0b640 1 -- 172.21.15.5:0/2883580178 learned_addr learned my addr 172.21.15.5:0/2883580178 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:19.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.205+0000 7ff1c970c640 1 --2- 172.21.15.5:0/2883580178 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565104f9a390 0x565105370660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:19.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.206+0000 7ff1c8f0b640 1 --2- 172.21.15.5:0/2883580178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565104fbb070 0x5651053e7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:19.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.206+0000 7ff1c8f0b640 1 -- 172.21.15.5:0/2883580178 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565104f9a390 msgr2=0x565105370660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:19.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.206+0000 7ff1c8f0b640 1 --2- 172.21.15.5:0/2883580178 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565104f9a390 0x565105370660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.206+0000 7ff1c8f0b640 1 -- 172.21.15.5:0/2883580178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565104fbb070 msgr2=0x5651053e7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:19.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.206+0000 7ff1c8f0b640 1 --2- 172.21.15.5:0/2883580178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565104fbb070 0x5651053e7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.206+0000 7ff1c8f0b640 1 -- 172.21.15.5:0/2883580178 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651053e7a50 con 0x565104f921b0 2024-08-31T05:32:19.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.206+0000 7ff1c8f0b640 1 --2- 172.21.15.5:0/2883580178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565104f921b0 0x565105370100 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4004650 tx=0x7ff1b4005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30dd6561eae129c0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:19.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.206+0000 7ff1acff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:32:19.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.206+0000 7ff1acff9640 1 -- 172.21.15.5:0/2883580178 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b405d020 con 0x565104f921b0 2024-08-31T05:32:19.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.206+0000 7ff1d1ee5740 1 -- 172.21.15.5:0/2883580178 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1c001f040 con 0x565104f921b0 2024-08-31T05:32:19.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.206+0000 7ff1acff9640 1 -- 172.21.15.5:0/2883580178 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7ff1b403bdf0 con 0x565104f921b0 2024-08-31T05:32:19.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.206+0000 7ff1acff9640 1 -- 172.21.15.5:0/2883580178 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff1b4035040 con 0x565104f921b0 2024-08-31T05:32:19.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.206+0000 7ff1d1ee5740 10 client.16164 fetch_fsmap learned FSMap version 32 2024-08-31T05:32:19.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.206+0000 7ff1d1ee5740 1 -- 172.21.15.5:0/2883580178 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5651053e8b80 con 0x565104f921b0 2024-08-31T05:32:19.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.207+0000 7ff1acff9640 1 -- 172.21.15.5:0/2883580178 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1c001f040 con 0x565104f921b0 2024-08-31T05:32:19.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.207+0000 7ff1acff9640 1 -- 172.21.15.5:0/2883580178 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7ff1b4031700 con 0x565104f921b0 2024-08-31T05:32:19.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.207+0000 7ff1d1ee5740 10 client.16164 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:32:19.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.207+0000 7ff1d1ee5740 10 client.16164 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-31T05:32:19.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.207+0000 7ff1d1ee5740 20 client.16164 populate_metadata read hostname 'smithi005' 2024-08-31T05:32:19.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.207+0000 7ff1d1ee5740 1 --2- 172.21.15.5:0/2883580178 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x565104f4eda0 0x5651053eb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:19.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.207+0000 7ff1d1ee5740 4 client.16164 mds_command: new command op to 24602 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:32:19.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.207+0000 7ff1d1ee5740 1 -- 172.21.15.5:0/2883580178 --> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5651052d5070 con 0x565104f4eda0 2024-08-31T05:32:19.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.207+0000 7ff1c970c640 1 --2- 172.21.15.5:0/2883580178 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x565104f4eda0 0x5651053eb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:19.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.207+0000 7ff1acff9640 10 client.16164 ms_handle_connect on v2:172.21.15.50:6836/428759669 2024-08-31T05:32:19.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.208+0000 7ff1c970c640 1 --2- 172.21.15.5:0/2883580178 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x565104f4eda0 0x5651053eb2b0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e79c7dc1879a1e25 server_cookie=b239a35e834558d2 in_seq=0 out_seq=0 2024-08-31T05:32:19.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.208+0000 7ff1acff9640 1 -- 172.21.15.5:0/2883580178 <== mds.4 v2:172.21.15.50:6836/428759669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5651052d5070 con 0x565104f4eda0 2024-08-31T05:32:19.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.208+0000 7ff1acff9640 10 client.16164 handle_command_reply: tid=0 2024-08-31T05:32:19.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.208+0000 7ff1d1ee5740 1 client.16164 shutdown 2024-08-31T05:32:19.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.208+0000 7ff1d1ee5740 1 -- 172.21.15.5:0/2883580178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565104f921b0 msgr2=0x565105370100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:19.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.208+0000 7ff1d1ee5740 1 --2- 172.21.15.5:0/2883580178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565104f921b0 0x565105370100 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4004650 tx=0x7ff1b4005780 comp rx=0 tx=0).stop 2024-08-31T05:32:19.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.208+0000 7ff1d1ee5740 1 -- 172.21.15.5:0/2883580178 shutdown_connections 2024-08-31T05:32:19.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.208+0000 7ff1d1ee5740 1 --2- 172.21.15.5:0/2883580178 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x565104f4eda0 0x5651053eb2b0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.208+0000 7ff1acff9640 0 client.16164 ms_handle_reset on v2:172.21.15.50:6836/428759669 2024-08-31T05:32:19.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.208+0000 7ff1d1ee5740 1 --2- 172.21.15.5:0/2883580178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x565104fbb070 0x5651053e7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.208+0000 7ff1d1ee5740 1 --2- 172.21.15.5:0/2883580178 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565104f9a390 0x565105370660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.208+0000 7ff1d1ee5740 1 --2- 172.21.15.5:0/2883580178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x565104f921b0 0x565105370100 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.208+0000 7ff1d1ee5740 1 -- 172.21.15.5:0/2883580178 >> 172.21.15.5:0/2883580178 conn(0x565104faf460 msgr2=0x565105361d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:19.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.208+0000 7ff1d1ee5740 1 -- 172.21.15.5:0/2883580178 shutdown_connections 2024-08-31T05:32:19.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.208+0000 7ff1d1ee5740 1 -- 172.21.15.5:0/2883580178 wait complete. 2024-08-31T05:32:19.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.208+0000 7ff1d1ee5740 20 client.16164 trim_cache size 0 max 16384 2024-08-31T05:32:19.215 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:32:19.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.209+0000 7ff1cb970640 1 -- 172.21.15.5:0/2230409467 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff1b00b4ca0 msgr2=0x7ff1b00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:19.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.209+0000 7ff1cb970640 1 --2- 172.21.15.5:0/2230409467 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff1b00b4ca0 0x7ff1b00b71b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc0e32b0 tx=0x7ff1bc091f90 comp rx=0 tx=0).stop 2024-08-31T05:32:19.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.209+0000 7ff1cb970640 1 -- 172.21.15.5:0/2230409467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1c4109bc0 msgr2=0x7ff1c419fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:19.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.209+0000 7ff1cb970640 1 --2- 172.21.15.5:0/2230409467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1c4109bc0 0x7ff1c419fa80 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc00eb10 tx=0x7ff1bc00c2d0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.209+0000 7ff1cb970640 1 -- 172.21.15.5:0/2230409467 shutdown_connections 2024-08-31T05:32:19.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.209+0000 7ff1cb970640 1 --2- 172.21.15.5:0/2230409467 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff1b00b4ca0 0x7ff1b00b71b0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.209+0000 7ff1cb970640 1 --2- 172.21.15.5:0/2230409467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1c4109bc0 0x7ff1c419fa80 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.209+0000 7ff1cb970640 1 --2- 172.21.15.5:0/2230409467 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1c4109270 0x7ff1c419a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.209+0000 7ff1cb970640 1 --2- 172.21.15.5:0/2230409467 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1c4103930 0x7ff1c419a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.209+0000 7ff1cb970640 1 -- 172.21.15.5:0/2230409467 >> 172.21.15.5:0/2230409467 conn(0x7ff1c40ff3a0 msgr2=0x7ff1c41017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:19.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.209+0000 7ff1cb970640 1 -- 172.21.15.5:0/2230409467 shutdown_connections 2024-08-31T05:32:19.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:19.209+0000 7ff1cb970640 1 -- 172.21.15.5:0/2230409467 wait complete. 2024-08-31T05:32:19.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:32:19 smithi005 ceph-mon[18602]: pgmap v415: 129 pgs: 129 active+clean; 92 MiB data, 697 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 2.1 MiB/s wr, 238 op/s 2024-08-31T05:32:19.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.555+0000 7f4d0753a640 1 -- 172.21.15.5:0/1113018606 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d0010db40 msgr2=0x7f4d00110030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:19.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.555+0000 7f4d0753a640 1 --2- 172.21.15.5:0/1113018606 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d0010db40 0x7f4d00110030 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8009ca0 tx=0x7f4cf802a8c0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.555+0000 7f4d0753a640 1 -- 172.21.15.5:0/1113018606 shutdown_connections 2024-08-31T05:32:19.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.555+0000 7f4d0753a640 1 --2- 172.21.15.5:0/1113018606 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d0010db40 0x7f4d00110030 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.555+0000 7f4d0753a640 1 --2- 172.21.15.5:0/1113018606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d00105030 0x7f4d0010d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.555+0000 7f4d0753a640 1 --2- 172.21.15.5:0/1113018606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4d001046e0 0x7f4d00104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.555+0000 7f4d0753a640 1 -- 172.21.15.5:0/1113018606 >> 172.21.15.5:0/1113018606 conn(0x7f4d000fe1d0 msgr2=0x7f4d00100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:19.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.555+0000 7f4d0753a640 1 -- 172.21.15.5:0/1113018606 shutdown_connections 2024-08-31T05:32:19.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.555+0000 7f4d0753a640 1 -- 172.21.15.5:0/1113018606 wait complete. 2024-08-31T05:32:19.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.556+0000 7f4d0753a640 1 Processor -- start 2024-08-31T05:32:19.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.556+0000 7f4d0753a640 1 -- start start 2024-08-31T05:32:19.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.556+0000 7f4d0753a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4d001046e0 0x7f4d0019c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:19.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.556+0000 7f4d0753a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d00105030 0x7f4d0019c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:19.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.556+0000 7f4d0753a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d0010db40 0x7f4d001a1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:19.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.556+0000 7f4d0753a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4d001137c0 con 0x7f4d0010db40 2024-08-31T05:32:19.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.556+0000 7f4d0753a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4d00113640 con 0x7f4d00105030 2024-08-31T05:32:19.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.556+0000 7f4d0753a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4d00113940 con 0x7f4d001046e0 2024-08-31T05:32:19.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.556+0000 7f4d05ad7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d0010db40 0x7f4d001a1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:19.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.556+0000 7f4d05ad7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d0010db40 0x7f4d001a1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55066/0 (socket says 172.21.15.5:55066) 2024-08-31T05:32:19.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.556+0000 7f4d05ad7640 1 -- 172.21.15.5:0/1803120735 learned_addr learned my addr 172.21.15.5:0/1803120735 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:19.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.556+0000 7f4d052d6640 1 --2- 172.21.15.5:0/1803120735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4d001046e0 0x7f4d0019c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:19.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.556+0000 7f4d04ad5640 1 --2- 172.21.15.5:0/1803120735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d00105030 0x7f4d0019c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:19.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.556+0000 7f4d05ad7640 1 -- 172.21.15.5:0/1803120735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4d001046e0 msgr2=0x7f4d0019c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:19.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.557+0000 7f4d05ad7640 1 --2- 172.21.15.5:0/1803120735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4d001046e0 0x7f4d0019c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.557+0000 7f4d05ad7640 1 -- 172.21.15.5:0/1803120735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d00105030 msgr2=0x7f4d0019c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:19.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.557+0000 7f4d05ad7640 1 --2- 172.21.15.5:0/1803120735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d00105030 0x7f4d0019c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.557+0000 7f4d05ad7640 1 -- 172.21.15.5:0/1803120735 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d001a2350 con 0x7f4d0010db40 2024-08-31T05:32:19.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.557+0000 7f4d052d6640 1 --2- 172.21.15.5:0/1803120735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4d001046e0 0x7f4d0019c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:32:19.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.557+0000 7f4d04ad5640 1 --2- 172.21.15.5:0/1803120735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d00105030 0x7f4d0019c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:32:19.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.557+0000 7f4d05ad7640 1 --2- 172.21.15.5:0/1803120735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d0010db40 0x7f4d001a1c50 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8005cc0 tx=0x7f4cf8031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:19.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.557+0000 7f4cf67fc640 1 -- 172.21.15.5:0/1803120735 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf8003b70 con 0x7f4d0010db40 2024-08-31T05:32:19.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.557+0000 7f4d0753a640 1 -- 172.21.15.5:0/1803120735 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d001a25e0 con 0x7f4d0010db40 2024-08-31T05:32:19.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.557+0000 7f4cf67fc640 1 -- 172.21.15.5:0/1803120735 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4cf80318f0 con 0x7f4d0010db40 2024-08-31T05:32:19.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.557+0000 7f4cf67fc640 1 -- 172.21.15.5:0/1803120735 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf802f950 con 0x7f4d0010db40 2024-08-31T05:32:19.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.557+0000 7f4d0753a640 1 -- 172.21.15.5:0/1803120735 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d001a8dd0 con 0x7f4d0010db40 2024-08-31T05:32:19.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.560+0000 7f4d0e4a3740 1 Processor -- start 2024-08-31T05:32:19.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.561+0000 7f4cf67fc640 1 -- 172.21.15.5:0/1803120735 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f4cf802fb50 con 0x7f4d0010db40 2024-08-31T05:32:19.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.561+0000 7f4d0e4a3740 1 -- start start 2024-08-31T05:32:19.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.561+0000 7f4d0e4a3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560404d581b0 0x5604050fbce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:19.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.561+0000 7f4d0e4a3740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560404d2f2f0 0x5604050fc220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:19.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.561+0000 7f4d0e4a3740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560404d374d0 0x5604050fc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:19.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.561+0000 7f4d0e4a3740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x560405071000 con 0x560404d374d0 2024-08-31T05:32:19.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.561+0000 7f4d0e4a3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560405060590 con 0x560404d581b0 2024-08-31T05:32:19.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.561+0000 7f4d0e4a3740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560405064540 con 0x560404d2f2f0 2024-08-31T05:32:19.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.561+0000 7f4d052d6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560404d2f2f0 0x5604050fc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:19.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.561+0000 7f4d04ad5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560404d581b0 0x5604050fbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:19.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.561+0000 7f4d052d6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560404d2f2f0 0x5604050fc220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:48406/0 (socket says 172.21.15.5:48406) 2024-08-31T05:32:19.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.561+0000 7f4d052d6640 1 -- 172.21.15.5:0/3131323428 learned_addr learned my addr 172.21.15.5:0/3131323428 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:19.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.561+0000 7f4d04ad5640 1 --2- 172.21.15.5:0/3131323428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560404d374d0 0x5604050fc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:19.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.561+0000 7f4d052d6640 1 -- 172.21.15.5:0/3131323428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560404d581b0 msgr2=0x5604050fbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:19.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.561+0000 7f4d052d6640 1 --2- 172.21.15.5:0/3131323428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560404d581b0 0x5604050fbce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.561+0000 7f4d052d6640 1 -- 172.21.15.5:0/3131323428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560404d374d0 msgr2=0x5604050fc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:19.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.561+0000 7f4cf67fc640 1 --2- 172.21.15.5:0/1803120735 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4cec0b4ca0 0x7f4cec0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:19.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.561+0000 7f4d052d6640 1 --2- 172.21.15.5:0/3131323428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560404d374d0 0x5604050fc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.561+0000 7f4d052d6640 1 -- 172.21.15.5:0/3131323428 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560404dc3790 con 0x560404d2f2f0 2024-08-31T05:32:19.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.561+0000 7f4d04ad5640 1 --2- 172.21.15.5:0/3131323428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560404d581b0 0x5604050fbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:32:19.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.562+0000 7f4d05ad7640 1 --2- 172.21.15.5:0/1803120735 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4cec0b4ca0 0x7f4cec0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:19.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.562+0000 7f4cf67fc640 1 -- 172.21.15.5:0/1803120735 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f4cf8106ab0 con 0x7f4d0010db40 2024-08-31T05:32:19.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.562+0000 7f4d052d6640 1 --2- 172.21.15.5:0/3131323428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560404d2f2f0 0x5604050fc220 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc0115f0 tx=0x7f4cfc011ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15caf1b226584b75 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:19.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.562+0000 7f4ceb7fe640 1 -- 172.21.15.5:0/3131323428 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc01e070 con 0x560404d2f2f0 2024-08-31T05:32:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.562+0000 7f4ceb7fe640 1 -- 172.21.15.5:0/3131323428 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4cfc00faf0 con 0x560404d2f2f0 2024-08-31T05:32:19.566 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.562+0000 7f4ceb7fe640 1 -- 172.21.15.5:0/3131323428 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc019ad0 con 0x560404d2f2f0 2024-08-31T05:32:19.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.563+0000 7f4d0e4a3740 1 -- 172.21.15.5:0/3131323428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560404d2f2f0 msgr2=0x5604050fc220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:19.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.563+0000 7f4d0e4a3740 1 --2- 172.21.15.5:0/3131323428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560404d2f2f0 0x5604050fc220 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc0115f0 tx=0x7f4cfc011ab0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.563+0000 7f4d05ad7640 1 --2- 172.21.15.5:0/1803120735 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4cec0b4ca0 0x7f4cec0b71b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4cf80ca090 tx=0x7f4cf8099130 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:19.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.563+0000 7f4d0e4a3740 1 -- 172.21.15.5:0/3131323428 shutdown_connections 2024-08-31T05:32:19.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.563+0000 7f4d0e4a3740 1 --2- 172.21.15.5:0/3131323428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560404d374d0 0x5604050fc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.563+0000 7f4d0e4a3740 1 --2- 172.21.15.5:0/3131323428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560404d2f2f0 0x5604050fc220 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.563+0000 7f4d0e4a3740 1 --2- 172.21.15.5:0/3131323428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560404d581b0 0x5604050fbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.563+0000 7f4d0e4a3740 1 -- 172.21.15.5:0/3131323428 >> 172.21.15.5:0/3131323428 conn(0x560404d4c300 msgr2=0x5604050f9bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:19.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.563+0000 7f4d0e4a3740 1 -- 172.21.15.5:0/3131323428 shutdown_connections 2024-08-31T05:32:19.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.563+0000 7f4d0e4a3740 1 -- 172.21.15.5:0/3131323428 wait complete. 2024-08-31T05:32:19.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.563+0000 7f4d0e4a3740 1 -- start start 2024-08-31T05:32:19.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.564+0000 7f4d0e4a3740 1 Processor -- start 2024-08-31T05:32:19.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.564+0000 7f4d0e4a3740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560404d2f2f0 0x5604051078c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:19.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.564+0000 7f4d0e4a3740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560404d374d0 0x560405107e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:19.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.564+0000 7f4d0e4a3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560404d581b0 0x560405113780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:19.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.564+0000 7f4d0e4a3740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x560404f99ab0 con 0x560404d374d0 2024-08-31T05:32:19.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.564+0000 7f4d0e4a3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560404fe7680 con 0x560404d581b0 2024-08-31T05:32:19.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.564+0000 7f4d0e4a3740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56040510a460 con 0x560404d2f2f0 2024-08-31T05:32:19.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.564+0000 7f4d0e4a3740 10 client.0 _ll_register_callbacks cb 0x560404d6fa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:32:19.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.564+0000 7f4d04ad5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560404d2f2f0 0x5604051078c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:19.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.564+0000 7f4d04ad5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560404d2f2f0 0x5604051078c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:48408/0 (socket says 172.21.15.5:48408) 2024-08-31T05:32:19.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.564+0000 7f4d04ad5640 1 -- 172.21.15.5:0/332307439 learned_addr learned my addr 172.21.15.5:0/332307439 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:19.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.564+0000 7f4d052d6640 1 --2- 172.21.15.5:0/332307439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560404d374d0 0x560405107e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:19.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.564+0000 7f4d04ad5640 1 --2- 172.21.15.5:0/332307439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560404d581b0 0x560405113780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:19.571 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.565+0000 7f4d04ad5640 1 -- 172.21.15.5:0/332307439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560404d581b0 msgr2=0x560405113780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:19.571 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.565+0000 7f4d04ad5640 1 --2- 172.21.15.5:0/332307439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560404d581b0 0x560405113780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.571 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.565+0000 7f4d04ad5640 1 -- 172.21.15.5:0/332307439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560404d374d0 msgr2=0x560405107e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:19.571 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.565+0000 7f4d04ad5640 1 --2- 172.21.15.5:0/332307439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560404d374d0 0x560405107e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.571 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.565+0000 7f4d04ad5640 1 -- 172.21.15.5:0/332307439 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560404e3c620 con 0x560404d2f2f0 2024-08-31T05:32:19.571 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.565+0000 7f4d04ad5640 1 --2- 172.21.15.5:0/332307439 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560404d2f2f0 0x5604051078c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0012e50 tx=0x7f4cf0004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82da5ccc109d88bc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:19.571 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.565+0000 7f4ce8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:32:19.571 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.565+0000 7f4ce8ff9640 1 -- 172.21.15.5:0/332307439 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf001b040 con 0x560404d2f2f0 2024-08-31T05:32:19.571 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.565+0000 7f4ce8ff9640 1 -- 172.21.15.5:0/332307439 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f4cf0004220 con 0x560404d2f2f0 2024-08-31T05:32:19.571 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.565+0000 7f4d0e4a3740 1 -- 172.21.15.5:0/332307439 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4cfc00faf0 con 0x560404d2f2f0 2024-08-31T05:32:19.571 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.565+0000 7f4ce8ff9640 1 -- 172.21.15.5:0/332307439 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f4cf0004420 con 0x560404d2f2f0 2024-08-31T05:32:19.571 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.565+0000 7f4d0e4a3740 10 client.25783 fetch_fsmap learned FSMap version 32 2024-08-31T05:32:19.571 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.565+0000 7f4d0e4a3740 1 -- 172.21.15.5:0/332307439 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5604051164b0 con 0x560404d2f2f0 2024-08-31T05:32:19.571 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.565+0000 7f4ce8ff9640 1 -- 172.21.15.5:0/332307439 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4cfc00faf0 con 0x560404d2f2f0 2024-08-31T05:32:19.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.566+0000 7f4ce8ff9640 1 -- 172.21.15.5:0/332307439 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f4cf0004a90 con 0x560404d2f2f0 2024-08-31T05:32:19.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.566+0000 7f4d0e4a3740 10 client.25783 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:32:19.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.566+0000 7f4d0e4a3740 10 client.25783 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:32:19.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.566+0000 7f4d0e4a3740 20 client.25783 populate_metadata read hostname 'smithi005' 2024-08-31T05:32:19.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.566+0000 7f4d0e4a3740 1 --2- 172.21.15.5:0/332307439 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x560404d16d80 0x560405119b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:19.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.566+0000 7f4d0e4a3740 4 client.25783 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:32:19.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.566+0000 7f4d0e4a3740 1 -- 172.21.15.5:0/332307439 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560405072f50 con 0x560404d16d80 2024-08-31T05:32:19.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.566+0000 7f4d052d6640 1 --2- 172.21.15.5:0/332307439 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x560404d16d80 0x560405119b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:19.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.567+0000 7f4ce8ff9640 10 client.25783 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:32:19.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.567+0000 7f4d052d6640 1 --2- 172.21.15.5:0/332307439 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x560404d16d80 0x560405119b50 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de0a161ed83fb635 server_cookie=b6bb245395b20343 in_seq=0 out_seq=0 2024-08-31T05:32:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.567+0000 7f4ce8ff9640 1 -- 172.21.15.5:0/332307439 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560405072f50 con 0x560404d16d80 2024-08-31T05:32:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.567+0000 7f4ce8ff9640 10 client.25783 handle_command_reply: tid=0 2024-08-31T05:32:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.567+0000 7f4d0e4a3740 1 client.25783 shutdown 2024-08-31T05:32:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.568+0000 7f4d0e4a3740 1 -- 172.21.15.5:0/332307439 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560404d2f2f0 msgr2=0x5604051078c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:19.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.568+0000 7f4d0e4a3740 1 --2- 172.21.15.5:0/332307439 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560404d2f2f0 0x5604051078c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0012e50 tx=0x7f4cf0004730 comp rx=0 tx=0).stop 2024-08-31T05:32:19.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.568+0000 7f4d0e4a3740 1 -- 172.21.15.5:0/332307439 shutdown_connections 2024-08-31T05:32:19.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.568+0000 7f4d0e4a3740 1 --2- 172.21.15.5:0/332307439 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x560404d16d80 0x560405119b50 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.568+0000 7f4d0e4a3740 1 --2- 172.21.15.5:0/332307439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560404d581b0 0x560405113780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.568+0000 7f4d0e4a3740 1 --2- 172.21.15.5:0/332307439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560404d374d0 0x560405107e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.568+0000 7f4d0e4a3740 1 --2- 172.21.15.5:0/332307439 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560404d2f2f0 0x5604051078c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.568+0000 7f4ce8ff9640 0 client.25783 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:32:19.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.568+0000 7f4d0e4a3740 1 -- 172.21.15.5:0/332307439 >> 172.21.15.5:0/332307439 conn(0x560404d4c300 msgr2=0x5604050fcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:19.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.568+0000 7f4d0e4a3740 1 -- 172.21.15.5:0/332307439 shutdown_connections 2024-08-31T05:32:19.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.568+0000 7f4d0e4a3740 1 -- 172.21.15.5:0/332307439 wait complete. 2024-08-31T05:32:19.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.568+0000 7f4d0e4a3740 20 client.25783 trim_cache size 0 max 16384 2024-08-31T05:32:19.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:32:19 smithi070 ceph-mon[22316]: pgmap v415: 129 pgs: 129 active+clean; 92 MiB data, 697 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 2.1 MiB/s wr, 238 op/s 2024-08-31T05:32:19.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.584+0000 7f4d0e4a3740 1 Processor -- start 2024-08-31T05:32:19.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.584+0000 7f4d0e4a3740 1 -- start start 2024-08-31T05:32:19.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.584+0000 7f4d0e4a3740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560404d2f2f0 0x560405101410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:19.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.584+0000 7f4d0e4a3740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560404d374d0 0x5604050fd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:19.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.584+0000 7f4d0e4a3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560404d581b0 0x5604050f9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:19.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.584+0000 7f4d0e4a3740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4d001b2e70 con 0x560404d2f2f0 2024-08-31T05:32:19.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.584+0000 7f4d0e4a3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4d001b4a70 con 0x560404d581b0 2024-08-31T05:32:19.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.584+0000 7f4d0e4a3740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4d001b3540 con 0x560404d374d0 2024-08-31T05:32:19.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.584+0000 7f4d04ad5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560404d2f2f0 0x560405101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:19.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.584+0000 7f4d04ad5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560404d2f2f0 0x560405101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55110/0 (socket says 172.21.15.5:55110) 2024-08-31T05:32:19.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.584+0000 7f4d04ad5640 1 -- 172.21.15.5:0/1579205228 learned_addr learned my addr 172.21.15.5:0/1579205228 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:19.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.584+0000 7f4d052d6640 1 --2- 172.21.15.5:0/1579205228 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560404d374d0 0x5604050fd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:19.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.584+0000 7f4d04ad5640 1 --2- 172.21.15.5:0/1579205228 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560404d581b0 0x5604050f9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:19.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.584+0000 7f4d052d6640 1 -- 172.21.15.5:0/1579205228 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560404d581b0 msgr2=0x5604050f9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:19.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.584+0000 7f4d052d6640 1 --2- 172.21.15.5:0/1579205228 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560404d581b0 0x5604050f9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.584+0000 7f4d052d6640 1 -- 172.21.15.5:0/1579205228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560404d2f2f0 msgr2=0x560405101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:19.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.584+0000 7f4d052d6640 1 --2- 172.21.15.5:0/1579205228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560404d2f2f0 0x560405101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.589 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.584+0000 7f4d052d6640 1 -- 172.21.15.5:0/1579205228 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604050fa4d0 con 0x560404d374d0 2024-08-31T05:32:19.589 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.584+0000 7f4d04ad5640 1 --2- 172.21.15.5:0/1579205228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560404d2f2f0 0x560405101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:32:19.589 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.585+0000 7f4d052d6640 1 --2- 172.21.15.5:0/1579205228 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560404d374d0 0x5604050fd420 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc0115c0 tx=0x7f4cfc009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25b951f93c84c6f8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:19.589 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.585+0000 7f4ceaffd640 1 -- 172.21.15.5:0/1579205228 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc01e040 con 0x560404d374d0 2024-08-31T05:32:19.589 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.585+0000 7f4ceaffd640 1 -- 172.21.15.5:0/1579205228 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4cfc00faf0 con 0x560404d374d0 2024-08-31T05:32:19.589 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.585+0000 7f4ceaffd640 1 -- 172.21.15.5:0/1579205228 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc019780 con 0x560404d374d0 2024-08-31T05:32:19.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.586+0000 7f4d0e4a3740 1 -- 172.21.15.5:0/1579205228 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560404d374d0 msgr2=0x5604050fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:19.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.586+0000 7f4d0e4a3740 1 --2- 172.21.15.5:0/1579205228 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560404d374d0 0x5604050fd420 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc0115c0 tx=0x7f4cfc009ca0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.586+0000 7f4d0e4a3740 1 -- 172.21.15.5:0/1579205228 shutdown_connections 2024-08-31T05:32:19.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.586+0000 7f4d0e4a3740 1 --2- 172.21.15.5:0/1579205228 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560404d581b0 0x5604050f9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.586+0000 7f4d0e4a3740 1 --2- 172.21.15.5:0/1579205228 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560404d374d0 0x5604050fd420 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.586+0000 7f4d0e4a3740 1 --2- 172.21.15.5:0/1579205228 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560404d2f2f0 0x560405101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.586+0000 7f4d0e4a3740 1 -- 172.21.15.5:0/1579205228 >> 172.21.15.5:0/1579205228 conn(0x560404d4c300 msgr2=0x5604050fcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:19.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.586+0000 7f4d0e4a3740 1 -- 172.21.15.5:0/1579205228 shutdown_connections 2024-08-31T05:32:19.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.586+0000 7f4d0e4a3740 1 -- 172.21.15.5:0/1579205228 wait complete. 2024-08-31T05:32:19.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.586+0000 7f4d0e4a3740 1 -- start start 2024-08-31T05:32:19.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.586+0000 7f4d0e4a3740 1 Processor -- start 2024-08-31T05:32:19.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.587+0000 7f4d0e4a3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560404d2f2f0 0x56040510c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:19.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.587+0000 7f4d0e4a3740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560404d374d0 0x56040510ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:19.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.587+0000 7f4d0e4a3740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560404d581b0 0x560405182540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:19.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.587+0000 7f4d0e4a3740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4d001b42e0 con 0x560404d581b0 2024-08-31T05:32:19.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.587+0000 7f4d0e4a3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4d001b3c10 con 0x560404d2f2f0 2024-08-31T05:32:19.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.587+0000 7f4d0e4a3740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4d001b0e50 con 0x560404d374d0 2024-08-31T05:32:19.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.587+0000 7f4d0e4a3740 10 client.0 _ll_register_callbacks cb 0x7f4cf0012d10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:32:19.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.587+0000 7f4d052d6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560404d374d0 0x56040510ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:19.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.587+0000 7f4d04ad5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560404d2f2f0 0x56040510c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:19.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.587+0000 7f4d052d6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560404d374d0 0x56040510ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:48430/0 (socket says 172.21.15.5:48430) 2024-08-31T05:32:19.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.587+0000 7f4d052d6640 1 -- 172.21.15.5:0/2919322746 learned_addr learned my addr 172.21.15.5:0/2919322746 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:19.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.587+0000 7f4d04ad5640 1 --2- 172.21.15.5:0/2919322746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560404d581b0 0x560405182540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:19.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.587+0000 7f4d052d6640 1 -- 172.21.15.5:0/2919322746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560404d2f2f0 msgr2=0x56040510c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:19.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.587+0000 7f4d052d6640 1 --2- 172.21.15.5:0/2919322746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560404d2f2f0 0x56040510c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.587+0000 7f4d052d6640 1 -- 172.21.15.5:0/2919322746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560404d581b0 msgr2=0x560405182540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:19.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.587+0000 7f4d052d6640 1 --2- 172.21.15.5:0/2919322746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560404d581b0 0x560405182540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.587+0000 7f4d052d6640 1 -- 172.21.15.5:0/2919322746 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560405182b80 con 0x560404d374d0 2024-08-31T05:32:19.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.588+0000 7f4d052d6640 1 --2- 172.21.15.5:0/2919322746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560404d374d0 0x56040510ca20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc01c040 tx=0x7f4cfc0194a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54b57e665c265a9e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:19.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.588+0000 7f4ce8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:32:19.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.588+0000 7f4ce8ff9640 1 -- 172.21.15.5:0/2919322746 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc031070 con 0x560404d374d0 2024-08-31T05:32:19.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.588+0000 7f4ce8ff9640 1 -- 172.21.15.5:0/2919322746 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f4cfc005550 con 0x560404d374d0 2024-08-31T05:32:19.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.588+0000 7f4d0e4a3740 1 -- 172.21.15.5:0/2919322746 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4cfc00faf0 con 0x560404d374d0 2024-08-31T05:32:19.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.588+0000 7f4ce8ff9640 1 -- 172.21.15.5:0/2919322746 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f4cfc03d050 con 0x560404d374d0 2024-08-31T05:32:19.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.588+0000 7f4d0e4a3740 10 client.25789 fetch_fsmap learned FSMap version 32 2024-08-31T05:32:19.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.588+0000 7f4d0e4a3740 1 -- 172.21.15.5:0/2919322746 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x560405183e10 con 0x560404d374d0 2024-08-31T05:32:19.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.588+0000 7f4ce8ff9640 1 -- 172.21.15.5:0/2919322746 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4cfc00faf0 con 0x560404d374d0 2024-08-31T05:32:19.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.588+0000 7f4ce8ff9640 1 -- 172.21.15.5:0/2919322746 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f4cfc019a90 con 0x560404d374d0 2024-08-31T05:32:19.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.588+0000 7f4d0e4a3740 10 client.25789 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:32:19.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.588+0000 7f4d0e4a3740 10 client.25789 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:32:19.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.588+0000 7f4d0e4a3740 20 client.25789 populate_metadata read hostname 'smithi005' 2024-08-31T05:32:19.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.588+0000 7f4d0e4a3740 1 --2- 172.21.15.5:0/2919322746 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x560404cec1c0 0x5604051863c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:19.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.588+0000 7f4d0e4a3740 4 client.25789 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:32:19.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.588+0000 7f4d0e4a3740 1 -- 172.21.15.5:0/2919322746 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56040506e9f0 con 0x560404cec1c0 2024-08-31T05:32:19.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.589+0000 7f4d04ad5640 1 --2- 172.21.15.5:0/2919322746 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x560404cec1c0 0x5604051863c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:19.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.589+0000 7f4ce8ff9640 10 client.25789 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:32:19.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.589+0000 7f4d04ad5640 1 --2- 172.21.15.5:0/2919322746 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x560404cec1c0 0x5604051863c0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da79e8d609664073 server_cookie=b5aba9b7db7afeba in_seq=0 out_seq=0 2024-08-31T05:32:19.600 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.597+0000 7f4ce8ff9640 1 -- 172.21.15.5:0/2919322746 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56040506e9f0 con 0x560404cec1c0 2024-08-31T05:32:19.600 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.597+0000 7f4ce8ff9640 10 client.25789 handle_command_reply: tid=0 2024-08-31T05:32:19.600 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.597+0000 7f4d0e4a3740 1 client.25789 shutdown 2024-08-31T05:32:19.600 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.598+0000 7f4d0e4a3740 1 -- 172.21.15.5:0/2919322746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560404d374d0 msgr2=0x56040510ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:19.600 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.598+0000 7f4d0e4a3740 1 --2- 172.21.15.5:0/2919322746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560404d374d0 0x56040510ca20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc01c040 tx=0x7f4cfc0194a0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.600 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.598+0000 7f4d0e4a3740 1 -- 172.21.15.5:0/2919322746 shutdown_connections 2024-08-31T05:32:19.600 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.598+0000 7f4d0e4a3740 1 --2- 172.21.15.5:0/2919322746 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x560404cec1c0 0x5604051863c0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.600 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.598+0000 7f4d0e4a3740 1 --2- 172.21.15.5:0/2919322746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560404d581b0 0x560405182540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.601 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.598+0000 7f4d0e4a3740 1 --2- 172.21.15.5:0/2919322746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560404d374d0 0x56040510ca20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.601 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.598+0000 7f4ce8ff9640 0 client.25789 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:32:19.601 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.598+0000 7f4d0e4a3740 1 --2- 172.21.15.5:0/2919322746 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560404d2f2f0 0x56040510c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.601 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.598+0000 7f4d0e4a3740 1 -- 172.21.15.5:0/2919322746 >> 172.21.15.5:0/2919322746 conn(0x560404d4c300 msgr2=0x560405109500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:19.601 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.598+0000 7f4d0e4a3740 1 -- 172.21.15.5:0/2919322746 shutdown_connections 2024-08-31T05:32:19.601 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.598+0000 7f4d0e4a3740 1 -- 172.21.15.5:0/2919322746 wait complete. 2024-08-31T05:32:19.601 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.598+0000 7f4d0e4a3740 20 client.25789 trim_cache size 0 max 16384 2024-08-31T05:32:19.601 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:32:19.601 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:32:19.601 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:32:19.602 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:32:19.602 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.598+0000 7f4d0753a640 1 -- 172.21.15.5:0/1803120735 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4cec0b4ca0 msgr2=0x7f4cec0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:19.602 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.598+0000 7f4d0753a640 1 --2- 172.21.15.5:0/1803120735 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4cec0b4ca0 0x7f4cec0b71b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4cf80ca090 tx=0x7f4cf8099130 comp rx=0 tx=0).stop 2024-08-31T05:32:19.602 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.598+0000 7f4d0753a640 1 -- 172.21.15.5:0/1803120735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d0010db40 msgr2=0x7f4d001a1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:19.602 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.598+0000 7f4d0753a640 1 --2- 172.21.15.5:0/1803120735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d0010db40 0x7f4d001a1c50 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8005cc0 tx=0x7f4cf8031700 comp rx=0 tx=0).stop 2024-08-31T05:32:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.598+0000 7f4d0753a640 1 -- 172.21.15.5:0/1803120735 shutdown_connections 2024-08-31T05:32:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.598+0000 7f4d0753a640 1 --2- 172.21.15.5:0/1803120735 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4cec0b4ca0 0x7f4cec0b71b0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.598+0000 7f4d0753a640 1 --2- 172.21.15.5:0/1803120735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4d0010db40 0x7f4d001a1c50 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.598+0000 7f4d0753a640 1 --2- 172.21.15.5:0/1803120735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4d00105030 0x7f4d0019c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.598+0000 7f4d0753a640 1 --2- 172.21.15.5:0/1803120735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4d001046e0 0x7f4d0019c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.598+0000 7f4d0753a640 1 -- 172.21.15.5:0/1803120735 >> 172.21.15.5:0/1803120735 conn(0x7f4d000fe1d0 msgr2=0x7f4d001022d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.599+0000 7f4d0753a640 1 -- 172.21.15.5:0/1803120735 shutdown_connections 2024-08-31T05:32:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:19.599+0000 7f4d0753a640 1 -- 172.21.15.5:0/1803120735 wait complete. 2024-08-31T05:32:19.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:32:19 smithi050 ceph-mon[22146]: pgmap v415: 129 pgs: 129 active+clean; 92 MiB data, 697 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 2.1 MiB/s wr, 238 op/s 2024-08-31T05:32:19.910 INFO:tasks.workunit.client.0.smithi005.stdout: 1 174055 14.29 MB/sec warmup 67 sec latency 37.151 ms 2024-08-31T05:32:20.910 INFO:tasks.workunit.client.0.smithi005.stdout: 1 175683 14.17 MB/sec warmup 68 sec latency 34.771 ms 2024-08-31T05:32:21.115 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-31T05:32:21.421 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:32:21.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:32:21 smithi005 ceph-mon[18602]: pgmap v416: 129 pgs: 129 active+clean; 92 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 3.0 MiB/s wr, 277 op/s 2024-08-31T05:32:21.585 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:32:21 smithi070 ceph-mon[22316]: pgmap v416: 129 pgs: 129 active+clean; 92 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 3.0 MiB/s wr, 277 op/s 2024-08-31T05:32:21.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:32:21 smithi050 ceph-mon[22146]: pgmap v416: 129 pgs: 129 active+clean; 92 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 3.0 MiB/s wr, 277 op/s 2024-08-31T05:32:21.910 INFO:tasks.workunit.client.0.smithi005.stdout: 1 178150 14.17 MB/sec warmup 69 sec latency 11.430 ms 2024-08-31T05:32:21.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.922+0000 7f0a66059640 1 -- 172.21.15.5:0/2706118252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a60109260 msgr2=0x7f0a60109670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:21.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.922+0000 7f0a66059640 1 --2- 172.21.15.5:0/2706118252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a60109260 0x7f0a60109670 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f0a54009900 tx=0x7f0a5402a410 comp rx=0 tx=0).stop 2024-08-31T05:32:21.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.922+0000 7f0a66059640 1 -- 172.21.15.5:0/2706118252 shutdown_connections 2024-08-31T05:32:21.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.922+0000 7f0a66059640 1 --2- 172.21.15.5:0/2706118252 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a60109bb0 0x7f0a601103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:21.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.922+0000 7f0a66059640 1 --2- 172.21.15.5:0/2706118252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a60109260 0x7f0a60109670 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:21.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.922+0000 7f0a66059640 1 --2- 172.21.15.5:0/2706118252 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a60103920 0x7f0a60103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:21.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.922+0000 7f0a66059640 1 -- 172.21.15.5:0/2706118252 >> 172.21.15.5:0/2706118252 conn(0x7f0a600ff3b0 msgr2=0x7f0a60101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:21.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.922+0000 7f0a66059640 1 -- 172.21.15.5:0/2706118252 shutdown_connections 2024-08-31T05:32:21.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.922+0000 7f0a66059640 1 -- 172.21.15.5:0/2706118252 wait complete. 2024-08-31T05:32:21.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.923+0000 7f0a66059640 1 Processor -- start 2024-08-31T05:32:21.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.923+0000 7f0a66059640 1 -- start start 2024-08-31T05:32:21.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.924+0000 7f0a66059640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a60103920 0x7f0a6019a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:21.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.924+0000 7f0a66059640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a60109260 0x7f0a6019a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:21.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.924+0000 7f0a66059640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a60109bb0 0x7f0a6019faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:21.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.924+0000 7f0a66059640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0a60113870 con 0x7f0a60103920 2024-08-31T05:32:21.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.924+0000 7f0a66059640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0a601136f0 con 0x7f0a60109bb0 2024-08-31T05:32:21.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.924+0000 7f0a66059640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0a601139f0 con 0x7f0a60109260 2024-08-31T05:32:21.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.924+0000 7f0a5f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a60103920 0x7f0a6019a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:21.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.924+0000 7f0a5f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a60103920 0x7f0a6019a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55136/0 (socket says 172.21.15.5:55136) 2024-08-31T05:32:21.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.924+0000 7f0a5f7fe640 1 -- 172.21.15.5:0/261661466 learned_addr learned my addr 172.21.15.5:0/261661466 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:21.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.924+0000 7f0a5effd640 1 --2- 172.21.15.5:0/261661466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a60109260 0x7f0a6019a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:21.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.924+0000 7f0a5ffff640 1 --2- 172.21.15.5:0/261661466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a60109bb0 0x7f0a6019faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:21.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.924+0000 7f0a5ffff640 1 -- 172.21.15.5:0/261661466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a60109260 msgr2=0x7f0a6019a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:21.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.924+0000 7f0a5ffff640 1 --2- 172.21.15.5:0/261661466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a60109260 0x7f0a6019a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:21.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.924+0000 7f0a5ffff640 1 -- 172.21.15.5:0/261661466 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a60103920 msgr2=0x7f0a6019a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:21.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.924+0000 7f0a5ffff640 1 --2- 172.21.15.5:0/261661466 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a60103920 0x7f0a6019a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:21.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.924+0000 7f0a5ffff640 1 -- 172.21.15.5:0/261661466 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a601a01d0 con 0x7f0a60109bb0 2024-08-31T05:32:21.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.924+0000 7f0a5f7fe640 1 --2- 172.21.15.5:0/261661466 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a60103920 0x7f0a6019a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:32:21.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.925+0000 7f0a5ffff640 1 --2- 172.21.15.5:0/261661466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a60109bb0 0x7f0a6019faa0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0a58009fd0 tx=0x7f0a5800ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:21.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.925+0000 7f0a5cff9640 1 -- 172.21.15.5:0/261661466 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a5800ce20 con 0x7f0a60109bb0 2024-08-31T05:32:21.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.925+0000 7f0a5cff9640 1 -- 172.21.15.5:0/261661466 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a58005020 con 0x7f0a60109bb0 2024-08-31T05:32:21.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.925+0000 7f0a66059640 1 -- 172.21.15.5:0/261661466 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a601a04c0 con 0x7f0a60109bb0 2024-08-31T05:32:21.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.925+0000 7f0a5cff9640 1 -- 172.21.15.5:0/261661466 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a58010690 con 0x7f0a60109bb0 2024-08-31T05:32:21.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.925+0000 7f0a66059640 1 -- 172.21.15.5:0/261661466 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a601a6c20 con 0x7f0a60109bb0 2024-08-31T05:32:21.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.927+0000 7f0a5cff9640 1 -- 172.21.15.5:0/261661466 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f0a580054d0 con 0x7f0a60109bb0 2024-08-31T05:32:21.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.927+0000 7f0a6c5ce740 1 Processor -- start 2024-08-31T05:32:21.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.928+0000 7f0a6c5ce740 1 -- start start 2024-08-31T05:32:21.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.928+0000 7f0a6c5ce740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e49aa0070 0x560e49e45310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:21.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.928+0000 7f0a6c5ce740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e49a771b0 0x560e49e45850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:21.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.928+0000 7f0a6c5ce740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e49a7f390 0x560e49e45d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:21.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.928+0000 7f0a6c5ce740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x560e49dbc680 con 0x560e49a7f390 2024-08-31T05:32:21.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.928+0000 7f0a6c5ce740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560e49dabc10 con 0x560e49aa0070 2024-08-31T05:32:21.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.928+0000 7f0a6c5ce740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560e49dafbc0 con 0x560e49a771b0 2024-08-31T05:32:21.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.928+0000 7f0a5effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e49a7f390 0x560e49e45d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:21.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.928+0000 7f0a5effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e49a7f390 0x560e49e45d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55138/0 (socket says 172.21.15.5:55138) 2024-08-31T05:32:21.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.928+0000 7f0a5effd640 1 -- 172.21.15.5:0/3890767553 learned_addr learned my addr 172.21.15.5:0/3890767553 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:21.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.928+0000 7f0a5f7fe640 1 --2- 172.21.15.5:0/3890767553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e49a771b0 0x560e49e45850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:21.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.928+0000 7f0a5effd640 1 --2- 172.21.15.5:0/3890767553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e49aa0070 0x560e49e45310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:21.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.928+0000 7f0a5cff9640 1 --2- 172.21.15.5:0/261661466 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f0a480b4d20 0x7f0a480b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:21.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.928+0000 7f0a5effd640 1 -- 172.21.15.5:0/3890767553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e49a771b0 msgr2=0x560e49e45850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:21.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.928+0000 7f0a5effd640 1 --2- 172.21.15.5:0/3890767553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e49a771b0 0x560e49e45850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:21.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.928+0000 7f0a5effd640 1 -- 172.21.15.5:0/3890767553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e49aa0070 msgr2=0x560e49e45310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:21.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.928+0000 7f0a5effd640 1 --2- 172.21.15.5:0/3890767553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e49aa0070 0x560e49e45310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:21.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.929+0000 7f0a5effd640 1 -- 172.21.15.5:0/3890767553 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e49b0b650 con 0x560e49a7f390 2024-08-31T05:32:21.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.929+0000 7f0a5ffff640 1 --2- 172.21.15.5:0/261661466 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f0a480b4d20 0x7f0a480b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:21.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.929+0000 7f0a5effd640 1 --2- 172.21.15.5:0/3890767553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e49a7f390 0x560e49e45d90 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f0a540057c0 tx=0x7f0a54000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efa071e6deade9b5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:21.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.929+0000 7f0a5cff9640 1 -- 172.21.15.5:0/261661466 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f0a580e5f50 con 0x7f0a60109bb0 2024-08-31T05:32:21.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.929+0000 7f0a45ffb640 1 -- 172.21.15.5:0/3890767553 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a54035070 con 0x560e49a7f390 2024-08-31T05:32:21.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.929+0000 7f0a45ffb640 1 -- 172.21.15.5:0/3890767553 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a54004030 con 0x560e49a7f390 2024-08-31T05:32:21.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.929+0000 7f0a45ffb640 1 -- 172.21.15.5:0/3890767553 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a54005270 con 0x560e49a7f390 2024-08-31T05:32:21.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.930+0000 7f0a6c5ce740 1 -- 172.21.15.5:0/3890767553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e49a7f390 msgr2=0x560e49e45d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:21.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.930+0000 7f0a6c5ce740 1 --2- 172.21.15.5:0/3890767553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e49a7f390 0x560e49e45d90 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f0a540057c0 tx=0x7f0a54000bc0 comp rx=0 tx=0).stop 2024-08-31T05:32:21.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.930+0000 7f0a5ffff640 1 --2- 172.21.15.5:0/261661466 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f0a480b4d20 0x7f0a480b7230 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0a580e33d0 tx=0x7f0a580e3040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:21.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.930+0000 7f0a6c5ce740 1 -- 172.21.15.5:0/3890767553 shutdown_connections 2024-08-31T05:32:21.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.930+0000 7f0a6c5ce740 1 --2- 172.21.15.5:0/3890767553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e49a7f390 0x560e49e45d90 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:21.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.930+0000 7f0a6c5ce740 1 --2- 172.21.15.5:0/3890767553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e49a771b0 0x560e49e45850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:21.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.930+0000 7f0a6c5ce740 1 --2- 172.21.15.5:0/3890767553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e49aa0070 0x560e49e45310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:21.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.930+0000 7f0a6c5ce740 1 -- 172.21.15.5:0/3890767553 >> 172.21.15.5:0/3890767553 conn(0x560e49a94460 msgr2=0x560e49e43200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:21.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.930+0000 7f0a6c5ce740 1 -- 172.21.15.5:0/3890767553 shutdown_connections 2024-08-31T05:32:21.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.930+0000 7f0a6c5ce740 1 -- 172.21.15.5:0/3890767553 wait complete. 2024-08-31T05:32:21.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.931+0000 7f0a6c5ce740 1 -- start start 2024-08-31T05:32:21.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.931+0000 7f0a6c5ce740 1 Processor -- start 2024-08-31T05:32:21.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.931+0000 7f0a6c5ce740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e49a771b0 0x560e49e50af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:21.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.931+0000 7f0a6c5ce740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e49a7f390 0x560e49e51050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:21.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.931+0000 7f0a6c5ce740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e49aa0070 0x560e49e61190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:21.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.931+0000 7f0a6c5ce740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x560e49c0e700 con 0x560e49a771b0 2024-08-31T05:32:21.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.931+0000 7f0a6c5ce740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560e49d32750 con 0x560e49a7f390 2024-08-31T05:32:21.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.931+0000 7f0a6c5ce740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560e49e57ea0 con 0x560e49aa0070 2024-08-31T05:32:21.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.931+0000 7f0a6c5ce740 10 client.0 _ll_register_callbacks cb 0x560e49d61e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:32:21.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.931+0000 7f0a5f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e49a7f390 0x560e49e51050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:21.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.932+0000 7f0a5f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e49a7f390 0x560e49e51050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:48806/0 (socket says 172.21.15.5:48806) 2024-08-31T05:32:21.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.932+0000 7f0a5f7fe640 1 -- 172.21.15.5:0/3109824179 learned_addr learned my addr 172.21.15.5:0/3109824179 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:21.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.932+0000 7f0a5effd640 1 --2- 172.21.15.5:0/3109824179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e49a771b0 0x560e49e50af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:21.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.932+0000 7f0a5effd640 1 -- 172.21.15.5:0/3109824179 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e49aa0070 msgr2=0x560e49e61190 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T05:32:21.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.932+0000 7f0a5effd640 1 --2- 172.21.15.5:0/3109824179 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e49aa0070 0x560e49e61190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:21.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.932+0000 7f0a5effd640 1 -- 172.21.15.5:0/3109824179 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e49a7f390 msgr2=0x560e49e51050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:21.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.932+0000 7f0a5effd640 1 --2- 172.21.15.5:0/3109824179 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e49a7f390 0x560e49e51050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:21.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.932+0000 7f0a5effd640 1 -- 172.21.15.5:0/3109824179 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e49d6b900 con 0x560e49a771b0 2024-08-31T05:32:21.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.933+0000 7f0a5effd640 1 --2- 172.21.15.5:0/3109824179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e49a771b0 0x560e49e50af0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f0a540057c0 tx=0x7f0a54032dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=145f53c8ab6e2801 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:21.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.933+0000 7f0a3effd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:32:21.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.933+0000 7f0a3effd640 1 -- 172.21.15.5:0/3109824179 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a54035050 con 0x560e49a771b0 2024-08-31T05:32:21.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.933+0000 7f0a3effd640 1 -- 172.21.15.5:0/3109824179 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f0a540043e0 con 0x560e49a771b0 2024-08-31T05:32:21.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.933+0000 7f0a6c5ce740 1 -- 172.21.15.5:0/3109824179 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a54004030 con 0x560e49a771b0 2024-08-31T05:32:21.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.933+0000 7f0a3effd640 1 -- 172.21.15.5:0/3109824179 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f0a54058050 con 0x560e49a771b0 2024-08-31T05:32:21.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.933+0000 7f0a6c5ce740 10 client.16194 fetch_fsmap learned FSMap version 32 2024-08-31T05:32:21.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.933+0000 7f0a6c5ce740 1 -- 172.21.15.5:0/3109824179 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x560e49e63ce0 con 0x560e49a771b0 2024-08-31T05:32:21.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.933+0000 7f0a3effd640 1 -- 172.21.15.5:0/3109824179 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a54004030 con 0x560e49a771b0 2024-08-31T05:32:21.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.934+0000 7f0a3effd640 1 -- 172.21.15.5:0/3109824179 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f0a54004aa0 con 0x560e49a771b0 2024-08-31T05:32:21.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.934+0000 7f0a6c5ce740 10 client.16194 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:32:21.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.934+0000 7f0a6c5ce740 10 client.16194 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-31T05:32:21.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.934+0000 7f0a6c5ce740 20 client.16194 populate_metadata read hostname 'smithi005' 2024-08-31T05:32:21.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.934+0000 7f0a6c5ce740 1 --2- 172.21.15.5:0/3109824179 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x560e49a5e9f0 0x560e49e67040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:21.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.934+0000 7f0a6c5ce740 4 client.16194 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:32:21.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.934+0000 7f0a6c5ce740 1 -- 172.21.15.5:0/3109824179 --> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560e49dbe5d0 con 0x560e49a5e9f0 2024-08-31T05:32:21.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.934+0000 7f0a5f7fe640 1 --2- 172.21.15.5:0/3109824179 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x560e49a5e9f0 0x560e49e67040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:21.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.934+0000 7f0a5f7fe640 1 --2- 172.21.15.5:0/3109824179 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x560e49a5e9f0 0x560e49e67040 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9a80fd98ab110341 server_cookie=8d364bf51a92b036 in_seq=0 out_seq=0 2024-08-31T05:32:21.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.934+0000 7f0a3effd640 10 client.16194 ms_handle_connect on v2:172.21.15.70:6834/2061504114 2024-08-31T05:32:21.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.936+0000 7f0a3effd640 1 -- 172.21.15.5:0/3109824179 <== mds.3 v2:172.21.15.70:6834/2061504114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560e49dbe5d0 con 0x560e49a5e9f0 2024-08-31T05:32:21.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.936+0000 7f0a3effd640 10 client.16194 handle_command_reply: tid=0 2024-08-31T05:32:21.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.936+0000 7f0a6c5ce740 1 client.16194 shutdown 2024-08-31T05:32:21.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.936+0000 7f0a6c5ce740 1 -- 172.21.15.5:0/3109824179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e49a771b0 msgr2=0x560e49e50af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:21.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.936+0000 7f0a6c5ce740 1 --2- 172.21.15.5:0/3109824179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e49a771b0 0x560e49e50af0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f0a540057c0 tx=0x7f0a54032dc0 comp rx=0 tx=0).stop 2024-08-31T05:32:21.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.936+0000 7f0a6c5ce740 1 -- 172.21.15.5:0/3109824179 shutdown_connections 2024-08-31T05:32:21.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.936+0000 7f0a6c5ce740 1 --2- 172.21.15.5:0/3109824179 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x560e49a5e9f0 0x560e49e67040 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:21.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.936+0000 7f0a6c5ce740 1 --2- 172.21.15.5:0/3109824179 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e49aa0070 0x560e49e61190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:21.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.936+0000 7f0a3effd640 0 client.16194 ms_handle_reset on v2:172.21.15.70:6834/2061504114 2024-08-31T05:32:21.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.936+0000 7f0a6c5ce740 1 --2- 172.21.15.5:0/3109824179 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e49a7f390 0x560e49e51050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:21.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.936+0000 7f0a6c5ce740 1 --2- 172.21.15.5:0/3109824179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e49a771b0 0x560e49e50af0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:21.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.936+0000 7f0a6c5ce740 1 -- 172.21.15.5:0/3109824179 >> 172.21.15.5:0/3109824179 conn(0x560e49a94460 msgr2=0x560e49e484f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:21.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.936+0000 7f0a6c5ce740 1 -- 172.21.15.5:0/3109824179 shutdown_connections 2024-08-31T05:32:21.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.936+0000 7f0a6c5ce740 1 -- 172.21.15.5:0/3109824179 wait complete. 2024-08-31T05:32:21.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.936+0000 7f0a6c5ce740 20 client.16194 trim_cache size 0 max 16384 2024-08-31T05:32:21.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.951+0000 7f0a6c5ce740 1 Processor -- start 2024-08-31T05:32:21.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.951+0000 7f0a6c5ce740 1 -- start start 2024-08-31T05:32:21.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.951+0000 7f0a6c5ce740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e49a5e9f0 0x560e49e52720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:21.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.951+0000 7f0a6c5ce740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e49a771b0 0x560e49e61100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:21.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.951+0000 7f0a6c5ce740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e49a7f390 0x560e49e4dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:21.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.951+0000 7f0a6c5ce740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0a601aea40 con 0x560e49a5e9f0 2024-08-31T05:32:21.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.951+0000 7f0a6c5ce740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0a601b0640 con 0x560e49a7f390 2024-08-31T05:32:21.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.951+0000 7f0a6c5ce740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0a601af110 con 0x560e49a771b0 2024-08-31T05:32:21.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.951+0000 7f0a5effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e49a5e9f0 0x560e49e52720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:21.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.951+0000 7f0a5f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e49a771b0 0x560e49e61100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:21.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.951+0000 7f0a5effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e49a5e9f0 0x560e49e52720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55154/0 (socket says 172.21.15.5:55154) 2024-08-31T05:32:21.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.952+0000 7f0a5effd640 1 -- 172.21.15.5:0/1547859831 learned_addr learned my addr 172.21.15.5:0/1547859831 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:21.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.952+0000 7f0a5effd640 1 --2- 172.21.15.5:0/1547859831 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e49a7f390 0x560e49e4dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:21.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.952+0000 7f0a5effd640 1 -- 172.21.15.5:0/1547859831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e49a771b0 msgr2=0x560e49e61100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:21.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.952+0000 7f0a5effd640 1 --2- 172.21.15.5:0/1547859831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e49a771b0 0x560e49e61100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:21.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.952+0000 7f0a5effd640 1 -- 172.21.15.5:0/1547859831 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e49a7f390 msgr2=0x560e49e4dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:21.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.952+0000 7f0a5effd640 1 --2- 172.21.15.5:0/1547859831 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e49a7f390 0x560e49e4dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:21.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.952+0000 7f0a5effd640 1 -- 172.21.15.5:0/1547859831 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e49e43af0 con 0x560e49a5e9f0 2024-08-31T05:32:21.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.952+0000 7f0a5effd640 1 --2- 172.21.15.5:0/1547859831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e49a5e9f0 0x560e49e52720 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f0a54000c00 tx=0x7f0a54001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d728b2d5854a5f67 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:21.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.952+0000 7f0a457fa640 1 -- 172.21.15.5:0/1547859831 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a54064070 con 0x560e49a5e9f0 2024-08-31T05:32:21.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.952+0000 7f0a457fa640 1 -- 172.21.15.5:0/1547859831 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a54032e30 con 0x560e49a5e9f0 2024-08-31T05:32:21.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.952+0000 7f0a457fa640 1 -- 172.21.15.5:0/1547859831 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a54035070 con 0x560e49a5e9f0 2024-08-31T05:32:21.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.953+0000 7f0a6c5ce740 1 -- 172.21.15.5:0/1547859831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e49a5e9f0 msgr2=0x560e49e52720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:21.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.953+0000 7f0a6c5ce740 1 --2- 172.21.15.5:0/1547859831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e49a5e9f0 0x560e49e52720 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f0a54000c00 tx=0x7f0a54001e50 comp rx=0 tx=0).stop 2024-08-31T05:32:21.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.953+0000 7f0a6c5ce740 1 -- 172.21.15.5:0/1547859831 shutdown_connections 2024-08-31T05:32:21.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.953+0000 7f0a6c5ce740 1 --2- 172.21.15.5:0/1547859831 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e49a7f390 0x560e49e4dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:21.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.953+0000 7f0a6c5ce740 1 --2- 172.21.15.5:0/1547859831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e49a771b0 0x560e49e61100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:21.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.953+0000 7f0a6c5ce740 1 --2- 172.21.15.5:0/1547859831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e49a5e9f0 0x560e49e52720 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:21.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.953+0000 7f0a6c5ce740 1 -- 172.21.15.5:0/1547859831 >> 172.21.15.5:0/1547859831 conn(0x560e49a94460 msgr2=0x560e49e52010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:21.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.953+0000 7f0a6c5ce740 1 -- 172.21.15.5:0/1547859831 shutdown_connections 2024-08-31T05:32:21.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.953+0000 7f0a6c5ce740 1 -- 172.21.15.5:0/1547859831 wait complete. 2024-08-31T05:32:21.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.954+0000 7f0a6c5ce740 1 -- start start 2024-08-31T05:32:21.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.954+0000 7f0a6c5ce740 1 Processor -- start 2024-08-31T05:32:21.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.954+0000 7f0a6c5ce740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e49a5e9f0 0x560e49e68160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:21.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.954+0000 7f0a6c5ce740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e49a771b0 0x560e49e686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:21.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.954+0000 7f0a6c5ce740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e49a7f390 0x560e49e68be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:21.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.954+0000 7f0a6c5ce740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0a601afeb0 con 0x560e49a5e9f0 2024-08-31T05:32:21.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.954+0000 7f0a6c5ce740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0a601af7e0 con 0x560e49a7f390 2024-08-31T05:32:21.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.954+0000 7f0a6c5ce740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0a601aca20 con 0x560e49a771b0 2024-08-31T05:32:21.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.954+0000 7f0a6c5ce740 10 client.0 _ll_register_callbacks cb 0x7f0a54009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:32:21.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.955+0000 7f0a5effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e49a5e9f0 0x560e49e68160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:21.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.955+0000 7f0a5effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e49a5e9f0 0x560e49e68160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55160/0 (socket says 172.21.15.5:55160) 2024-08-31T05:32:21.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.955+0000 7f0a5effd640 1 -- 172.21.15.5:0/2107593821 learned_addr learned my addr 172.21.15.5:0/2107593821 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:21.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.955+0000 7f0a5f7fe640 1 --2- 172.21.15.5:0/2107593821 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e49a771b0 0x560e49e686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:21.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.955+0000 7f0a5effd640 1 --2- 172.21.15.5:0/2107593821 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e49a7f390 0x560e49e68be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:21.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.955+0000 7f0a5effd640 1 -- 172.21.15.5:0/2107593821 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e49a771b0 msgr2=0x560e49e686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:21.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.955+0000 7f0a5effd640 1 --2- 172.21.15.5:0/2107593821 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e49a771b0 0x560e49e686a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:21.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.955+0000 7f0a5effd640 1 -- 172.21.15.5:0/2107593821 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e49a7f390 msgr2=0x560e49e68be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:21.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.955+0000 7f0a5effd640 1 --2- 172.21.15.5:0/2107593821 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e49a7f390 0x560e49e68be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:21.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.955+0000 7f0a5effd640 1 -- 172.21.15.5:0/2107593821 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e49ed08c0 con 0x560e49a5e9f0 2024-08-31T05:32:21.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.955+0000 7f0a5effd640 1 --2- 172.21.15.5:0/2107593821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e49a5e9f0 0x560e49e68160 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f0a54062040 tx=0x7f0a54005f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=870c8b8bf50b508a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:21.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.955+0000 7f0a3effd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:32:21.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.955+0000 7f0a3effd640 1 -- 172.21.15.5:0/2107593821 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a54064070 con 0x560e49a5e9f0 2024-08-31T05:32:21.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.955+0000 7f0a3effd640 1 -- 172.21.15.5:0/2107593821 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f0a540046c0 con 0x560e49a5e9f0 2024-08-31T05:32:21.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.955+0000 7f0a6c5ce740 1 -- 172.21.15.5:0/2107593821 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a54032e30 con 0x560e49a5e9f0 2024-08-31T05:32:21.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.956+0000 7f0a3effd640 1 -- 172.21.15.5:0/2107593821 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f0a54035040 con 0x560e49a5e9f0 2024-08-31T05:32:21.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.956+0000 7f0a6c5ce740 10 client.16200 fetch_fsmap learned FSMap version 32 2024-08-31T05:32:21.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.956+0000 7f0a6c5ce740 1 -- 172.21.15.5:0/2107593821 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x560e49ed1b40 con 0x560e49a5e9f0 2024-08-31T05:32:21.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.956+0000 7f0a3effd640 1 -- 172.21.15.5:0/2107593821 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a54032e30 con 0x560e49a5e9f0 2024-08-31T05:32:21.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.956+0000 7f0a3effd640 1 -- 172.21.15.5:0/2107593821 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f0a5406a070 con 0x560e49a5e9f0 2024-08-31T05:32:21.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.956+0000 7f0a6c5ce740 10 client.16200 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:32:21.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.956+0000 7f0a6c5ce740 10 client.16200 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-31T05:32:21.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.956+0000 7f0a6c5ce740 20 client.16200 populate_metadata read hostname 'smithi005' 2024-08-31T05:32:21.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.956+0000 7f0a6c5ce740 1 --2- 172.21.15.5:0/2107593821 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x560e49aa0070 0x560e49ed3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:21.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.956+0000 7f0a6c5ce740 4 client.16200 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:32:21.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.956+0000 7f0a6c5ce740 1 -- 172.21.15.5:0/2107593821 --> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560e49dba070 con 0x560e49aa0070 2024-08-31T05:32:21.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.956+0000 7f0a5f7fe640 1 --2- 172.21.15.5:0/2107593821 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x560e49aa0070 0x560e49ed3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:21.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.957+0000 7f0a3effd640 10 client.16200 ms_handle_connect on v2:172.21.15.70:6834/2061504114 2024-08-31T05:32:21.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.957+0000 7f0a5f7fe640 1 --2- 172.21.15.5:0/2107593821 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x560e49aa0070 0x560e49ed3f70 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d5d3cfc2328e018c server_cookie=976836ec183d0b11 in_seq=0 out_seq=0 2024-08-31T05:32:21.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.957+0000 7f0a3effd640 1 -- 172.21.15.5:0/2107593821 <== mds.3 v2:172.21.15.70:6834/2061504114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560e49dba070 con 0x560e49aa0070 2024-08-31T05:32:21.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.957+0000 7f0a3effd640 10 client.16200 handle_command_reply: tid=0 2024-08-31T05:32:21.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.957+0000 7f0a6c5ce740 1 client.16200 shutdown 2024-08-31T05:32:21.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.957+0000 7f0a6c5ce740 1 -- 172.21.15.5:0/2107593821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e49a5e9f0 msgr2=0x560e49e68160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:21.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.957+0000 7f0a6c5ce740 1 --2- 172.21.15.5:0/2107593821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e49a5e9f0 0x560e49e68160 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f0a54062040 tx=0x7f0a54005f30 comp rx=0 tx=0).stop 2024-08-31T05:32:21.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.957+0000 7f0a6c5ce740 1 -- 172.21.15.5:0/2107593821 shutdown_connections 2024-08-31T05:32:21.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.957+0000 7f0a6c5ce740 1 --2- 172.21.15.5:0/2107593821 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x560e49aa0070 0x560e49ed3f70 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:21.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.957+0000 7f0a6c5ce740 1 --2- 172.21.15.5:0/2107593821 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e49a7f390 0x560e49e68be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:21.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.957+0000 7f0a6c5ce740 1 --2- 172.21.15.5:0/2107593821 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e49a771b0 0x560e49e686a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:21.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.957+0000 7f0a6c5ce740 1 --2- 172.21.15.5:0/2107593821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e49a5e9f0 0x560e49e68160 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:21.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.957+0000 7f0a6c5ce740 1 -- 172.21.15.5:0/2107593821 >> 172.21.15.5:0/2107593821 conn(0x560e49a94460 msgr2=0x560e49e48b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:21.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.957+0000 7f0a3effd640 0 client.16200 ms_handle_reset on v2:172.21.15.70:6834/2061504114 2024-08-31T05:32:21.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.957+0000 7f0a6c5ce740 1 -- 172.21.15.5:0/2107593821 shutdown_connections 2024-08-31T05:32:21.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.957+0000 7f0a6c5ce740 1 -- 172.21.15.5:0/2107593821 wait complete. 2024-08-31T05:32:21.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.957+0000 7f0a6c5ce740 20 client.16200 trim_cache size 0 max 16384 2024-08-31T05:32:21.965 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:32:21.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.958+0000 7f0a66059640 1 -- 172.21.15.5:0/261661466 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f0a480b4d20 msgr2=0x7f0a480b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:21.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.958+0000 7f0a66059640 1 --2- 172.21.15.5:0/261661466 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f0a480b4d20 0x7f0a480b7230 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0a580e33d0 tx=0x7f0a580e3040 comp rx=0 tx=0).stop 2024-08-31T05:32:21.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.958+0000 7f0a66059640 1 -- 172.21.15.5:0/261661466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a60109bb0 msgr2=0x7f0a6019faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:21.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.958+0000 7f0a66059640 1 --2- 172.21.15.5:0/261661466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a60109bb0 0x7f0a6019faa0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0a58009fd0 tx=0x7f0a5800ef10 comp rx=0 tx=0).stop 2024-08-31T05:32:21.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.958+0000 7f0a66059640 1 -- 172.21.15.5:0/261661466 shutdown_connections 2024-08-31T05:32:21.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.958+0000 7f0a66059640 1 --2- 172.21.15.5:0/261661466 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f0a480b4d20 0x7f0a480b7230 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:21.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.958+0000 7f0a66059640 1 --2- 172.21.15.5:0/261661466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0a60109bb0 0x7f0a6019faa0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:21.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.958+0000 7f0a66059640 1 --2- 172.21.15.5:0/261661466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a60109260 0x7f0a6019a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:21.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.958+0000 7f0a66059640 1 --2- 172.21.15.5:0/261661466 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a60103920 0x7f0a6019a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:21.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.958+0000 7f0a66059640 1 -- 172.21.15.5:0/261661466 >> 172.21.15.5:0/261661466 conn(0x7f0a600ff3b0 msgr2=0x7f0a601017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:21.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.958+0000 7f0a66059640 1 -- 172.21.15.5:0/261661466 shutdown_connections 2024-08-31T05:32:21.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:21.958+0000 7f0a66059640 1 -- 172.21.15.5:0/261661466 wait complete. 2024-08-31T05:32:22.752 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T05:32:22.910 INFO:tasks.workunit.client.0.smithi005.stdout: 1 181234 14.23 MB/sec warmup 70 sec latency 12.121 ms 2024-08-31T05:32:23.030 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:32:23.445 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:32:23 smithi005 ceph-mon[18602]: pgmap v417: 129 pgs: 129 active+clean; 92 MiB data, 743 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 2.4 MiB/s wr, 209 op/s 2024-08-31T05:32:23.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.541+0000 7f3f1205d640 1 -- 172.21.15.5:0/3897990524 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f0c109b90 msgr2=0x7f3f0c1103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:23.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.541+0000 7f3f1205d640 1 --2- 172.21.15.5:0/3897990524 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f0c109b90 0x7f3f0c1103c0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f3f04009900 tx=0x7f3f0402a3f0 comp rx=0 tx=0).stop 2024-08-31T05:32:23.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.541+0000 7f3f1205d640 1 -- 172.21.15.5:0/3897990524 shutdown_connections 2024-08-31T05:32:23.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.541+0000 7f3f1205d640 1 --2- 172.21.15.5:0/3897990524 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f0c109b90 0x7f3f0c1103c0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:23.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.541+0000 7f3f1205d640 1 --2- 172.21.15.5:0/3897990524 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f0c109240 0x7f3f0c109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:23.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.541+0000 7f3f1205d640 1 --2- 172.21.15.5:0/3897990524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f0c103900 0x7f3f0c103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:23.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.541+0000 7f3f1205d640 1 -- 172.21.15.5:0/3897990524 >> 172.21.15.5:0/3897990524 conn(0x7f3f0c07b5f0 msgr2=0x7f3f0c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:23.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.541+0000 7f3f1205d640 1 -- 172.21.15.5:0/3897990524 shutdown_connections 2024-08-31T05:32:23.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.541+0000 7f3f1205d640 1 -- 172.21.15.5:0/3897990524 wait complete. 2024-08-31T05:32:23.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.541+0000 7f3f1205d640 1 Processor -- start 2024-08-31T05:32:23.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.542+0000 7f3f1205d640 1 -- start start 2024-08-31T05:32:23.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.542+0000 7f3f1205d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f0c103900 0x7f3f0c19c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:23.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.542+0000 7f3f1205d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f0c109240 0x7f3f0c19c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:23.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.542+0000 7f3f1205d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f0c109b90 0x7f3f0c1a1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:23.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.542+0000 7f3f1205d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3f0c115a50 con 0x7f3f0c109240 2024-08-31T05:32:23.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.542+0000 7f3f1205d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3f0c1158d0 con 0x7f3f0c109b90 2024-08-31T05:32:23.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.542+0000 7f3f1205d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3f0c115bd0 con 0x7f3f0c103900 2024-08-31T05:32:23.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.542+0000 7f3f0affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f0c109240 0x7f3f0c19c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:23.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.542+0000 7f3f0affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f0c109240 0x7f3f0c19c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51798/0 (socket says 172.21.15.5:51798) 2024-08-31T05:32:23.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.542+0000 7f3f0affd640 1 -- 172.21.15.5:0/1525832763 learned_addr learned my addr 172.21.15.5:0/1525832763 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:23.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.542+0000 7f3f0b7fe640 1 --2- 172.21.15.5:0/1525832763 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f0c103900 0x7f3f0c19c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:23.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.542+0000 7f3f0bfff640 1 --2- 172.21.15.5:0/1525832763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f0c109b90 0x7f3f0c1a1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:23.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.542+0000 7f3f0affd640 1 -- 172.21.15.5:0/1525832763 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f0c103900 msgr2=0x7f3f0c19c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:23.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.542+0000 7f3f0affd640 1 --2- 172.21.15.5:0/1525832763 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f0c103900 0x7f3f0c19c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:23.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.542+0000 7f3f0affd640 1 -- 172.21.15.5:0/1525832763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f0c109b90 msgr2=0x7f3f0c1a1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:23.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.542+0000 7f3f0affd640 1 --2- 172.21.15.5:0/1525832763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f0c109b90 0x7f3f0c1a1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:23.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.542+0000 7f3f0affd640 1 -- 172.21.15.5:0/1525832763 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f0c1a22b0 con 0x7f3f0c109240 2024-08-31T05:32:23.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.542+0000 7f3f0bfff640 1 --2- 172.21.15.5:0/1525832763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f0c109b90 0x7f3f0c1a1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:32:23.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.543+0000 7f3f0affd640 1 --2- 172.21.15.5:0/1525832763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f0c109240 0x7f3f0c19c9a0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f3f0000e9c0 tx=0x7f3f0000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:23.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.543+0000 7f3f08ff9640 1 -- 172.21.15.5:0/1525832763 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f0000ccc0 con 0x7f3f0c109240 2024-08-31T05:32:23.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.543+0000 7f3f1205d640 1 -- 172.21.15.5:0/1525832763 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f0c1a25a0 con 0x7f3f0c109240 2024-08-31T05:32:23.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.543+0000 7f3f08ff9640 1 -- 172.21.15.5:0/1525832763 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f000054d0 con 0x7f3f0c109240 2024-08-31T05:32:23.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.543+0000 7f3f08ff9640 1 -- 172.21.15.5:0/1525832763 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f00010430 con 0x7f3f0c109240 2024-08-31T05:32:23.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.543+0000 7f3f1205d640 1 -- 172.21.15.5:0/1525832763 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f0c1a8dc0 con 0x7f3f0c109240 2024-08-31T05:32:23.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.546+0000 7f3f185d2740 1 Processor -- start 2024-08-31T05:32:23.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.546+0000 7f3f185d2740 1 -- start start 2024-08-31T05:32:23.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.546+0000 7f3f08ff9640 1 -- 172.21.15.5:0/1525832763 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f3f000105d0 con 0x7f3f0c109240 2024-08-31T05:32:23.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.546+0000 7f3f185d2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56464eee4070 0x56464f289310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:23.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.546+0000 7f3f185d2740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56464eebb1b0 0x56464f289850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:23.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.546+0000 7f3f185d2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56464eec3390 0x56464f289d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:23.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.546+0000 7f3f185d2740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56464f200680 con 0x56464eebb1b0 2024-08-31T05:32:23.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.546+0000 7f3f185d2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56464f1efc10 con 0x56464eec3390 2024-08-31T05:32:23.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.546+0000 7f3f185d2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56464f1f3bc0 con 0x56464eee4070 2024-08-31T05:32:23.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.546+0000 7f3f0b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56464eebb1b0 0x56464f289850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:23.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.546+0000 7f3f0bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56464eee4070 0x56464f289310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:23.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.546+0000 7f3f0b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56464eebb1b0 0x56464f289850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51814/0 (socket says 172.21.15.5:51814) 2024-08-31T05:32:23.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.546+0000 7f3f0bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56464eee4070 0x56464f289310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:55860/0 (socket says 172.21.15.5:55860) 2024-08-31T05:32:23.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.546+0000 7f3f0b7fe640 1 -- 172.21.15.5:0/380478858 learned_addr learned my addr 172.21.15.5:0/380478858 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:23.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.546+0000 7f3f0affd640 1 --2- 172.21.15.5:0/380478858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56464eec3390 0x56464f289d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:23.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.547+0000 7f3f0b7fe640 1 -- 172.21.15.5:0/380478858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56464eee4070 msgr2=0x56464f289310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:23.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.547+0000 7f3f0b7fe640 1 --2- 172.21.15.5:0/380478858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56464eee4070 0x56464f289310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:23.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.547+0000 7f3f0b7fe640 1 -- 172.21.15.5:0/380478858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56464eec3390 msgr2=0x56464f289d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:23.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.547+0000 7f3f0b7fe640 1 --2- 172.21.15.5:0/380478858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56464eec3390 0x56464f289d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:23.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.547+0000 7f3f0b7fe640 1 -- 172.21.15.5:0/380478858 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56464ef4f650 con 0x56464eebb1b0 2024-08-31T05:32:23.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.547+0000 7f3f0bfff640 1 --2- 172.21.15.5:0/380478858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56464eee4070 0x56464f289310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:32:23.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.547+0000 7f3f0b7fe640 1 --2- 172.21.15.5:0/380478858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56464eebb1b0 0x56464f289850 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f3efc007f90 tx=0x7f3efc00f850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b21a02e44b02876e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:23.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.547+0000 7f3f08ff9640 1 --2- 172.21.15.5:0/1525832763 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f3ef40b4cd0 0x7f3ef40b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:23.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.547+0000 7f3ef1ffb640 1 -- 172.21.15.5:0/380478858 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3efc004d20 con 0x56464eebb1b0 2024-08-31T05:32:23.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.547+0000 7f3f0bfff640 1 --2- 172.21.15.5:0/1525832763 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f3ef40b4cd0 0x7f3ef40b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:23.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.547+0000 7f3ef1ffb640 1 -- 172.21.15.5:0/380478858 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3efc010bb0 con 0x56464eebb1b0 2024-08-31T05:32:23.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.547+0000 7f3ef1ffb640 1 -- 172.21.15.5:0/380478858 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3efc0056b0 con 0x56464eebb1b0 2024-08-31T05:32:23.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.547+0000 7f3f08ff9640 1 -- 172.21.15.5:0/1525832763 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f3f000e5cc0 con 0x7f3f0c109240 2024-08-31T05:32:23.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.548+0000 7f3f185d2740 1 -- 172.21.15.5:0/380478858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56464eebb1b0 msgr2=0x56464f289850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:23.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.548+0000 7f3f0bfff640 1 --2- 172.21.15.5:0/1525832763 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f3ef40b4cd0 0x7f3ef40b71e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3f04031440 tx=0x7f3f04005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:23.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.548+0000 7f3f185d2740 1 --2- 172.21.15.5:0/380478858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56464eebb1b0 0x56464f289850 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f3efc007f90 tx=0x7f3efc00f850 comp rx=0 tx=0).stop 2024-08-31T05:32:23.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.548+0000 7f3f185d2740 1 -- 172.21.15.5:0/380478858 shutdown_connections 2024-08-31T05:32:23.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.548+0000 7f3f185d2740 1 --2- 172.21.15.5:0/380478858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56464eec3390 0x56464f289d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:23.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.548+0000 7f3f185d2740 1 --2- 172.21.15.5:0/380478858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56464eebb1b0 0x56464f289850 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:23.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.548+0000 7f3f185d2740 1 --2- 172.21.15.5:0/380478858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56464eee4070 0x56464f289310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:23.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.548+0000 7f3f185d2740 1 -- 172.21.15.5:0/380478858 >> 172.21.15.5:0/380478858 conn(0x56464eed8460 msgr2=0x56464f287200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:23.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.548+0000 7f3f185d2740 1 -- 172.21.15.5:0/380478858 shutdown_connections 2024-08-31T05:32:23.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.548+0000 7f3f185d2740 1 -- 172.21.15.5:0/380478858 wait complete. 2024-08-31T05:32:23.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.549+0000 7f3f185d2740 1 -- start start 2024-08-31T05:32:23.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.549+0000 7f3f185d2740 1 Processor -- start 2024-08-31T05:32:23.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.549+0000 7f3f185d2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56464eebb1b0 0x56464f294a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:23.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.549+0000 7f3f185d2740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56464eec3390 0x56464f294fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:23.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.549+0000 7f3f185d2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56464eee4070 0x56464f2a0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:23.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.549+0000 7f3f185d2740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56464f052700 con 0x56464eec3390 2024-08-31T05:32:23.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.549+0000 7f3f185d2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56464f176750 con 0x56464eee4070 2024-08-31T05:32:23.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.549+0000 7f3f185d2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56464f297af0 con 0x56464eebb1b0 2024-08-31T05:32:23.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.549+0000 7f3f185d2740 10 client.0 _ll_register_callbacks cb 0x56464f1a5e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:32:23.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.549+0000 7f3f0affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56464eec3390 0x56464f294fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:23.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.549+0000 7f3f0affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56464eec3390 0x56464f294fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51830/0 (socket says 172.21.15.5:51830) 2024-08-31T05:32:23.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.549+0000 7f3f0b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56464eebb1b0 0x56464f294a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:23.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.549+0000 7f3f0affd640 1 -- 172.21.15.5:0/3385030486 learned_addr learned my addr 172.21.15.5:0/3385030486 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:23.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.549+0000 7f3f0bfff640 1 --2- 172.21.15.5:0/3385030486 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56464eee4070 0x56464f2a0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:23.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.550+0000 7f3f0affd640 1 -- 172.21.15.5:0/3385030486 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56464eebb1b0 msgr2=0x56464f294a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:23.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.550+0000 7f3f0affd640 1 --2- 172.21.15.5:0/3385030486 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56464eebb1b0 0x56464f294a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:23.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.550+0000 7f3f0affd640 1 -- 172.21.15.5:0/3385030486 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56464eee4070 msgr2=0x56464f2a0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:23.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.550+0000 7f3f0affd640 1 --2- 172.21.15.5:0/3385030486 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56464eee4070 0x56464f2a0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:23.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.550+0000 7f3f0affd640 1 -- 172.21.15.5:0/3385030486 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56464f1af900 con 0x56464eec3390 2024-08-31T05:32:23.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.550+0000 7f3f0affd640 1 --2- 172.21.15.5:0/3385030486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56464eec3390 0x56464f294fb0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f3f0000cfd0 tx=0x7f3f000abec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=378f7a247afab857 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:23.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.550+0000 7f3eeaffd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:32:23.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.550+0000 7f3eeaffd640 1 -- 172.21.15.5:0/3385030486 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f000e7030 con 0x56464eec3390 2024-08-31T05:32:23.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.550+0000 7f3eeaffd640 1 -- 172.21.15.5:0/3385030486 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f3f000b50d0 con 0x56464eec3390 2024-08-31T05:32:23.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.550+0000 7f3f185d2740 1 -- 172.21.15.5:0/3385030486 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3efc010bb0 con 0x56464eec3390 2024-08-31T05:32:23.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.550+0000 7f3eeaffd640 1 -- 172.21.15.5:0/3385030486 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f3f00005680 con 0x56464eec3390 2024-08-31T05:32:23.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.550+0000 7f3f185d2740 10 client.16212 fetch_fsmap learned FSMap version 32 2024-08-31T05:32:23.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.550+0000 7f3f185d2740 1 -- 172.21.15.5:0/3385030486 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56464f2a38e0 con 0x56464eec3390 2024-08-31T05:32:23.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.550+0000 7f3eeaffd640 1 -- 172.21.15.5:0/3385030486 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3efc010bb0 con 0x56464eec3390 2024-08-31T05:32:23.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.551+0000 7f3eeaffd640 1 -- 172.21.15.5:0/3385030486 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f3f00097170 con 0x56464eec3390 2024-08-31T05:32:23.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.551+0000 7f3f185d2740 10 client.16212 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:32:23.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.551+0000 7f3f185d2740 10 client.16212 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-31T05:32:23.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.551+0000 7f3f185d2740 20 client.16212 populate_metadata read hostname 'smithi005' 2024-08-31T05:32:23.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.551+0000 7f3f185d2740 1 --2- 172.21.15.5:0/3385030486 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x56464eea29f0 0x56464f2a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:23.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.551+0000 7f3f185d2740 4 client.16212 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:32:23.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.551+0000 7f3f185d2740 1 -- 172.21.15.5:0/3385030486 --> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56464f2025d0 con 0x56464eea29f0 2024-08-31T05:32:23.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.551+0000 7f3f0b7fe640 1 --2- 172.21.15.5:0/3385030486 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x56464eea29f0 0x56464f2a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:23.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.551+0000 7f3eeaffd640 10 client.16212 ms_handle_connect on v2:172.21.15.70:6836/2780036414 2024-08-31T05:32:23.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.551+0000 7f3f0b7fe640 1 --2- 172.21.15.5:0/3385030486 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x56464eea29f0 0x56464f2a6e30 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9db1beb889fc39c7 server_cookie=97ac3d92fb4e6c9d in_seq=0 out_seq=0 2024-08-31T05:32:23.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.553+0000 7f3eeaffd640 1 -- 172.21.15.5:0/3385030486 <== mds.2 v2:172.21.15.70:6836/2780036414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56464f2025d0 con 0x56464eea29f0 2024-08-31T05:32:23.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.553+0000 7f3eeaffd640 10 client.16212 handle_command_reply: tid=0 2024-08-31T05:32:23.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.553+0000 7f3f185d2740 1 client.16212 shutdown 2024-08-31T05:32:23.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.554+0000 7f3f185d2740 1 -- 172.21.15.5:0/3385030486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56464eec3390 msgr2=0x56464f294fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:23.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.554+0000 7f3f185d2740 1 --2- 172.21.15.5:0/3385030486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56464eec3390 0x56464f294fb0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f3f0000cfd0 tx=0x7f3f000abec0 comp rx=0 tx=0).stop 2024-08-31T05:32:23.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.554+0000 7f3f185d2740 1 -- 172.21.15.5:0/3385030486 shutdown_connections 2024-08-31T05:32:23.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.554+0000 7f3f185d2740 1 --2- 172.21.15.5:0/3385030486 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x56464eea29f0 0x56464f2a6e30 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:23.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.554+0000 7f3f185d2740 1 --2- 172.21.15.5:0/3385030486 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56464eee4070 0x56464f2a0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:23.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.554+0000 7f3f185d2740 1 --2- 172.21.15.5:0/3385030486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56464eec3390 0x56464f294fb0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:23.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.554+0000 7f3f185d2740 1 --2- 172.21.15.5:0/3385030486 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56464eebb1b0 0x56464f294a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:23.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.554+0000 7f3f185d2740 1 -- 172.21.15.5:0/3385030486 >> 172.21.15.5:0/3385030486 conn(0x56464eed8460 msgr2=0x56464f28c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:23.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.554+0000 7f3eeaffd640 0 client.16212 ms_handle_reset on v2:172.21.15.70:6836/2780036414 2024-08-31T05:32:23.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.554+0000 7f3f185d2740 1 -- 172.21.15.5:0/3385030486 shutdown_connections 2024-08-31T05:32:23.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.554+0000 7f3f185d2740 1 -- 172.21.15.5:0/3385030486 wait complete. 2024-08-31T05:32:23.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.554+0000 7f3f185d2740 20 client.16212 trim_cache size 0 max 16384 2024-08-31T05:32:23.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.569+0000 7f3f185d2740 1 Processor -- start 2024-08-31T05:32:23.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.569+0000 7f3f185d2740 1 -- start start 2024-08-31T05:32:23.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.569+0000 7f3f185d2740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56464eebb1b0 0x56464f28cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:23.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.569+0000 7f3f185d2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56464eec3390 0x56464f2a0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:23.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.569+0000 7f3f185d2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56464eee4070 0x56464f286b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:23.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.570+0000 7f3f185d2740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3f0c1b2e50 con 0x56464eebb1b0 2024-08-31T05:32:23.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.570+0000 7f3f185d2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3f0c1b4a50 con 0x56464eec3390 2024-08-31T05:32:23.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.570+0000 7f3f185d2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3f0c1b3520 con 0x56464eee4070 2024-08-31T05:32:23.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.570+0000 7f3f0b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56464eebb1b0 0x56464f28cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:23.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.570+0000 7f3f0affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56464eec3390 0x56464f2a0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:23.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.570+0000 7f3f0affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56464eec3390 0x56464f2a0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:49250/0 (socket says 172.21.15.5:49250) 2024-08-31T05:32:23.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.570+0000 7f3f0b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56464eebb1b0 0x56464f28cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51834/0 (socket says 172.21.15.5:51834) 2024-08-31T05:32:23.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.570+0000 7f3f0affd640 1 -- 172.21.15.5:0/1556501853 learned_addr learned my addr 172.21.15.5:0/1556501853 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:23.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.570+0000 7f3f0bfff640 1 --2- 172.21.15.5:0/1556501853 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56464eee4070 0x56464f286b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:23.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.570+0000 7f3f0affd640 1 -- 172.21.15.5:0/1556501853 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56464eee4070 msgr2=0x56464f286b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:23.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.570+0000 7f3f0affd640 1 --2- 172.21.15.5:0/1556501853 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56464eee4070 0x56464f286b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:23.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.570+0000 7f3f0affd640 1 -- 172.21.15.5:0/1556501853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56464eebb1b0 msgr2=0x56464f28cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:23.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.570+0000 7f3f0affd640 1 --2- 172.21.15.5:0/1556501853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56464eebb1b0 0x56464f28cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:23.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.570+0000 7f3f0affd640 1 -- 172.21.15.5:0/1556501853 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56464f2971b0 con 0x56464eec3390 2024-08-31T05:32:23.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.570+0000 7f3f0affd640 1 --2- 172.21.15.5:0/1556501853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56464eec3390 0x56464f2a0ce0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3f00004650 tx=0x7f3f000a8540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5684e886856969b9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:23.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.570+0000 7f3ef17fa640 1 -- 172.21.15.5:0/1556501853 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f000e8070 con 0x56464eec3390 2024-08-31T05:32:23.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.571+0000 7f3ef17fa640 1 -- 172.21.15.5:0/1556501853 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f000ac730 con 0x56464eec3390 2024-08-31T05:32:23.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.571+0000 7f3ef17fa640 1 -- 172.21.15.5:0/1556501853 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f000050d0 con 0x56464eec3390 2024-08-31T05:32:23.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.571+0000 7f3f185d2740 1 -- 172.21.15.5:0/1556501853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56464eec3390 msgr2=0x56464f2a0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:23.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.571+0000 7f3f185d2740 1 --2- 172.21.15.5:0/1556501853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56464eec3390 0x56464f2a0ce0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3f00004650 tx=0x7f3f000a8540 comp rx=0 tx=0).stop 2024-08-31T05:32:23.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.571+0000 7f3f185d2740 1 -- 172.21.15.5:0/1556501853 shutdown_connections 2024-08-31T05:32:23.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.571+0000 7f3f185d2740 1 --2- 172.21.15.5:0/1556501853 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56464eee4070 0x56464f286b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:23.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.571+0000 7f3f185d2740 1 --2- 172.21.15.5:0/1556501853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56464eec3390 0x56464f2a0ce0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:23.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.572+0000 7f3f185d2740 1 --2- 172.21.15.5:0/1556501853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56464eebb1b0 0x56464f28cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:23.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.572+0000 7f3f185d2740 1 -- 172.21.15.5:0/1556501853 >> 172.21.15.5:0/1556501853 conn(0x56464eed8460 msgr2=0x56464f28c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:23.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.572+0000 7f3f185d2740 1 -- 172.21.15.5:0/1556501853 shutdown_connections 2024-08-31T05:32:23.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.572+0000 7f3f185d2740 1 -- 172.21.15.5:0/1556501853 wait complete. 2024-08-31T05:32:23.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.572+0000 7f3f185d2740 1 -- start start 2024-08-31T05:32:23.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.572+0000 7f3f185d2740 1 Processor -- start 2024-08-31T05:32:23.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.573+0000 7f3f185d2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56464eebb1b0 0x56464f299030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:23.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.573+0000 7f3f185d2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56464eec3390 0x56464f299570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:23.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.573+0000 7f3f185d2740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56464eee4070 0x56464f3107c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:23.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.573+0000 7f3f185d2740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3f0c1b42c0 con 0x56464eee4070 2024-08-31T05:32:23.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.573+0000 7f3f185d2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3f0c1b3bf0 con 0x56464eec3390 2024-08-31T05:32:23.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.573+0000 7f3f185d2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3f0c1b0e30 con 0x56464eebb1b0 2024-08-31T05:32:23.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.573+0000 7f3f185d2740 10 client.0 _ll_register_callbacks cb 0x7f3f00004920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:32:23.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.573+0000 7f3f0b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56464eebb1b0 0x56464f299030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:23.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.573+0000 7f3f0affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56464eec3390 0x56464f299570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:23.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.573+0000 7f3f0bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56464eee4070 0x56464f3107c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:23.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.573+0000 7f3f0b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56464eebb1b0 0x56464f299030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:55882/0 (socket says 172.21.15.5:55882) 2024-08-31T05:32:23.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.573+0000 7f3f0b7fe640 1 -- 172.21.15.5:0/2958429153 learned_addr learned my addr 172.21.15.5:0/2958429153 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:23.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.573+0000 7f3f0b7fe640 1 -- 172.21.15.5:0/2958429153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56464eec3390 msgr2=0x56464f299570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:23.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.573+0000 7f3f0b7fe640 1 --2- 172.21.15.5:0/2958429153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56464eec3390 0x56464f299570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:23.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.573+0000 7f3f0b7fe640 1 -- 172.21.15.5:0/2958429153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56464eee4070 msgr2=0x56464f3107c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:23.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.573+0000 7f3f0b7fe640 1 --2- 172.21.15.5:0/2958429153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56464eee4070 0x56464f3107c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:23.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.573+0000 7f3f0b7fe640 1 -- 172.21.15.5:0/2958429153 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56464f299e10 con 0x56464eebb1b0 2024-08-31T05:32:23.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.573+0000 7f3f0bfff640 1 --2- 172.21.15.5:0/2958429153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56464eee4070 0x56464f3107c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:32:23.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.574+0000 7f3f0b7fe640 1 --2- 172.21.15.5:0/2958429153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56464eebb1b0 0x56464f299030 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3efc013020 tx=0x7f3efc0052d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72960ca367d90f8b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:23.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.574+0000 7f3eeaffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:32:23.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.574+0000 7f3eeaffd640 1 -- 172.21.15.5:0/2958429153 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3efc01d040 con 0x56464eebb1b0 2024-08-31T05:32:23.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.574+0000 7f3eeaffd640 1 -- 172.21.15.5:0/2958429153 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f3efc010a00 con 0x56464eebb1b0 2024-08-31T05:32:23.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.574+0000 7f3f185d2740 1 -- 172.21.15.5:0/2958429153 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f000ac730 con 0x56464eebb1b0 2024-08-31T05:32:23.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.574+0000 7f3eeaffd640 1 -- 172.21.15.5:0/2958429153 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f3efc0049e0 con 0x56464eebb1b0 2024-08-31T05:32:23.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.574+0000 7f3f185d2740 10 client.25822 fetch_fsmap learned FSMap version 32 2024-08-31T05:32:23.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.574+0000 7f3f185d2740 1 -- 172.21.15.5:0/2958429153 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56464f311d80 con 0x56464eebb1b0 2024-08-31T05:32:23.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.574+0000 7f3eeaffd640 1 -- 172.21.15.5:0/2958429153 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f000ac730 con 0x56464eebb1b0 2024-08-31T05:32:23.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.574+0000 7f3eeaffd640 1 -- 172.21.15.5:0/2958429153 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f3efc0057d0 con 0x56464eebb1b0 2024-08-31T05:32:23.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.574+0000 7f3f185d2740 10 client.25822 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:32:23.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.574+0000 7f3f185d2740 10 client.25822 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-31T05:32:23.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.574+0000 7f3f185d2740 20 client.25822 populate_metadata read hostname 'smithi005' 2024-08-31T05:32:23.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.575+0000 7f3f185d2740 1 --2- 172.21.15.5:0/2958429153 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x56464ee77da0 0x56464f314380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:23.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.575+0000 7f3f185d2740 4 client.25822 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:32:23.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.575+0000 7f3f185d2740 1 -- 172.21.15.5:0/2958429153 --> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56464f1fe070 con 0x56464ee77da0 2024-08-31T05:32:23.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.575+0000 7f3f0affd640 1 --2- 172.21.15.5:0/2958429153 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x56464ee77da0 0x56464f314380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:23.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.575+0000 7f3eeaffd640 10 client.25822 ms_handle_connect on v2:172.21.15.70:6836/2780036414 2024-08-31T05:32:23.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.575+0000 7f3f0affd640 1 --2- 172.21.15.5:0/2958429153 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x56464ee77da0 0x56464f314380 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dd826f49c6ab007 server_cookie=3391a5d36ff5e1d5 in_seq=0 out_seq=0 2024-08-31T05:32:23.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.576+0000 7f3eeaffd640 1 -- 172.21.15.5:0/2958429153 <== mds.2 v2:172.21.15.70:6836/2780036414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56464f1fe070 con 0x56464ee77da0 2024-08-31T05:32:23.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.576+0000 7f3eeaffd640 10 client.25822 handle_command_reply: tid=0 2024-08-31T05:32:23.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.576+0000 7f3f185d2740 1 client.25822 shutdown 2024-08-31T05:32:23.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.576+0000 7f3f185d2740 1 -- 172.21.15.5:0/2958429153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56464eebb1b0 msgr2=0x56464f299030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:23.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.576+0000 7f3f185d2740 1 --2- 172.21.15.5:0/2958429153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56464eebb1b0 0x56464f299030 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3efc013020 tx=0x7f3efc0052d0 comp rx=0 tx=0).stop 2024-08-31T05:32:23.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.576+0000 7f3f185d2740 1 -- 172.21.15.5:0/2958429153 shutdown_connections 2024-08-31T05:32:23.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.576+0000 7f3f185d2740 1 --2- 172.21.15.5:0/2958429153 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x56464ee77da0 0x56464f314380 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:23.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.576+0000 7f3f185d2740 1 --2- 172.21.15.5:0/2958429153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56464eee4070 0x56464f3107c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:23.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.576+0000 7f3f185d2740 1 --2- 172.21.15.5:0/2958429153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56464eec3390 0x56464f299570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:23.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.576+0000 7f3f185d2740 1 --2- 172.21.15.5:0/2958429153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56464eebb1b0 0x56464f299030 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:23.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.576+0000 7f3eeaffd640 0 client.25822 ms_handle_reset on v2:172.21.15.70:6836/2780036414 2024-08-31T05:32:23.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.576+0000 7f3f185d2740 1 -- 172.21.15.5:0/2958429153 >> 172.21.15.5:0/2958429153 conn(0x56464eed8460 msgr2=0x56464f28c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:23.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.577+0000 7f3f185d2740 1 -- 172.21.15.5:0/2958429153 shutdown_connections 2024-08-31T05:32:23.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.577+0000 7f3f185d2740 1 -- 172.21.15.5:0/2958429153 wait complete. 2024-08-31T05:32:23.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.577+0000 7f3f185d2740 20 client.25822 trim_cache size 0 max 16384 2024-08-31T05:32:23.591 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:32:23.592 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:32:23 smithi070 ceph-mon[22316]: pgmap v417: 129 pgs: 129 active+clean; 92 MiB data, 743 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 2.4 MiB/s wr, 209 op/s 2024-08-31T05:32:23.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.577+0000 7f3f1205d640 1 -- 172.21.15.5:0/1525832763 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f3ef40b4cd0 msgr2=0x7f3ef40b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:23.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.577+0000 7f3f1205d640 1 --2- 172.21.15.5:0/1525832763 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f3ef40b4cd0 0x7f3ef40b71e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3f04031440 tx=0x7f3f04005a20 comp rx=0 tx=0).stop 2024-08-31T05:32:23.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.577+0000 7f3f1205d640 1 -- 172.21.15.5:0/1525832763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f0c109240 msgr2=0x7f3f0c19c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:23.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.577+0000 7f3f1205d640 1 --2- 172.21.15.5:0/1525832763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f0c109240 0x7f3f0c19c9a0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f3f0000e9c0 tx=0x7f3f0000ee80 comp rx=0 tx=0).stop 2024-08-31T05:32:23.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.577+0000 7f3f1205d640 1 -- 172.21.15.5:0/1525832763 shutdown_connections 2024-08-31T05:32:23.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.577+0000 7f3f1205d640 1 --2- 172.21.15.5:0/1525832763 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f3ef40b4cd0 0x7f3ef40b71e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:23.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.577+0000 7f3f1205d640 1 --2- 172.21.15.5:0/1525832763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f0c109b90 0x7f3f0c1a1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:23.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.577+0000 7f3f1205d640 1 --2- 172.21.15.5:0/1525832763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f0c109240 0x7f3f0c19c9a0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:23.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.577+0000 7f3f1205d640 1 --2- 172.21.15.5:0/1525832763 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f0c103900 0x7f3f0c19c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:23.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.577+0000 7f3f1205d640 1 -- 172.21.15.5:0/1525832763 >> 172.21.15.5:0/1525832763 conn(0x7f3f0c07b5f0 msgr2=0x7f3f0c107290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:23.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.577+0000 7f3f1205d640 1 -- 172.21.15.5:0/1525832763 shutdown_connections 2024-08-31T05:32:23.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:23.577+0000 7f3f1205d640 1 -- 172.21.15.5:0/1525832763 wait complete. 2024-08-31T05:32:23.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:32:23 smithi050 ceph-mon[22146]: pgmap v417: 129 pgs: 129 active+clean; 92 MiB data, 743 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 2.4 MiB/s wr, 209 op/s 2024-08-31T05:32:23.910 INFO:tasks.workunit.client.0.smithi005.stdout: 1 183886 14.21 MB/sec warmup 71 sec latency 51.566 ms 2024-08-31T05:32:24.381 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T05:32:24.664 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:32:24.910 INFO:tasks.workunit.client.0.smithi005.stdout: 1 185986 14.17 MB/sec warmup 72 sec latency 13.350 ms 2024-08-31T05:32:25.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.208+0000 7f3a500c0640 1 -- 172.21.15.5:0/1136168288 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a48108140 msgr2=0x7f3a48108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:25.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.208+0000 7f3a500c0640 1 --2- 172.21.15.5:0/1136168288 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a48108140 0x7f3a48108550 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f3a38009900 tx=0x7f3a3802a3f0 comp rx=0 tx=0).stop 2024-08-31T05:32:25.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.208+0000 7f3a500c0640 1 -- 172.21.15.5:0/1136168288 shutdown_connections 2024-08-31T05:32:25.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.208+0000 7f3a500c0640 1 --2- 172.21.15.5:0/1136168288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a48108a90 0x7f3a4810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:25.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.208+0000 7f3a500c0640 1 --2- 172.21.15.5:0/1136168288 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a48108140 0x7f3a48108550 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:25.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.208+0000 7f3a500c0640 1 --2- 172.21.15.5:0/1136168288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a48102800 0x7f3a48102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:25.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.208+0000 7f3a500c0640 1 -- 172.21.15.5:0/1136168288 >> 172.21.15.5:0/1136168288 conn(0x7f3a480794d0 msgr2=0x7f3a480798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:25.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.208+0000 7f3a500c0640 1 -- 172.21.15.5:0/1136168288 shutdown_connections 2024-08-31T05:32:25.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.208+0000 7f3a500c0640 1 -- 172.21.15.5:0/1136168288 wait complete. 2024-08-31T05:32:25.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.209+0000 7f3a500c0640 1 Processor -- start 2024-08-31T05:32:25.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.209+0000 7f3a500c0640 1 -- start start 2024-08-31T05:32:25.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.209+0000 7f3a500c0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a48102800 0x7f3a4819b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:25.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.209+0000 7f3a500c0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a48108140 0x7f3a4819b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:25.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.209+0000 7f3a500c0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a48108a90 0x7f3a4819bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:25.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.209+0000 7f3a500c0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3a481126c0 con 0x7f3a48108a90 2024-08-31T05:32:25.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.209+0000 7f3a500c0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3a48112540 con 0x7f3a48102800 2024-08-31T05:32:25.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.209+0000 7f3a500c0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3a48112840 con 0x7f3a48108140 2024-08-31T05:32:25.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.209+0000 7f3a4e65d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a48108a90 0x7f3a4819bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:25.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.209+0000 7f3a4de5c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a48102800 0x7f3a4819b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:25.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.209+0000 7f3a4e65d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a48108a90 0x7f3a4819bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51868/0 (socket says 172.21.15.5:51868) 2024-08-31T05:32:25.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.209+0000 7f3a4e65d640 1 -- 172.21.15.5:0/3792383290 learned_addr learned my addr 172.21.15.5:0/3792383290 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:25.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.209+0000 7f3a4d65b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a48108140 0x7f3a4819b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:25.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.210+0000 7f3a4e65d640 1 -- 172.21.15.5:0/3792383290 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a48108140 msgr2=0x7f3a4819b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:25.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.210+0000 7f3a4e65d640 1 --2- 172.21.15.5:0/3792383290 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a48108140 0x7f3a4819b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:25.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.210+0000 7f3a4e65d640 1 -- 172.21.15.5:0/3792383290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a48102800 msgr2=0x7f3a4819b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:25.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.210+0000 7f3a4e65d640 1 --2- 172.21.15.5:0/3792383290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a48102800 0x7f3a4819b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:25.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.210+0000 7f3a4e65d640 1 -- 172.21.15.5:0/3792383290 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a481a62e0 con 0x7f3a48108a90 2024-08-31T05:32:25.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.210+0000 7f3a4de5c640 1 --2- 172.21.15.5:0/3792383290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a48102800 0x7f3a4819b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:32:25.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.210+0000 7f3a4e65d640 1 --2- 172.21.15.5:0/3792383290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a48108a90 0x7f3a4819bad0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f3a40009fd0 tx=0x7f3a4000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:25.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.210+0000 7f3a3effd640 1 -- 172.21.15.5:0/3792383290 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a40017070 con 0x7f3a48108a90 2024-08-31T05:32:25.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.210+0000 7f3a3effd640 1 -- 172.21.15.5:0/3792383290 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a40003e20 con 0x7f3a48108a90 2024-08-31T05:32:25.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.210+0000 7f3a500c0640 1 -- 172.21.15.5:0/3792383290 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a481a65d0 con 0x7f3a48108a90 2024-08-31T05:32:25.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.210+0000 7f3a3effd640 1 -- 172.21.15.5:0/3792383290 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a40010460 con 0x7f3a48108a90 2024-08-31T05:32:25.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.210+0000 7f3a500c0640 1 -- 172.21.15.5:0/3792383290 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a481a6a90 con 0x7f3a48108a90 2024-08-31T05:32:25.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.213+0000 7f3a56635740 1 Processor -- start 2024-08-31T05:32:25.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.213+0000 7f3a3effd640 1 -- 172.21.15.5:0/3792383290 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f3a40010600 con 0x7f3a48108a90 2024-08-31T05:32:25.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.213+0000 7f3a56635740 1 -- start start 2024-08-31T05:32:25.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.213+0000 7f3a56635740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56030b960070 0x56030bd05310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:25.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.213+0000 7f3a56635740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56030b9371b0 0x56030bd05850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:25.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.213+0000 7f3a56635740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56030b93f390 0x56030bd05d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:25.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.213+0000 7f3a56635740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56030bc7c680 con 0x56030b9371b0 2024-08-31T05:32:25.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.213+0000 7f3a56635740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56030bc6bc10 con 0x56030b93f390 2024-08-31T05:32:25.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.213+0000 7f3a56635740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56030bc6fbc0 con 0x56030b960070 2024-08-31T05:32:25.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.213+0000 7f3a4de5c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56030b9371b0 0x56030bd05850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:25.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.213+0000 7f3a4d65b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56030b960070 0x56030bd05310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:25.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.214+0000 7f3a4d65b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56030b960070 0x56030bd05310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:55916/0 (socket says 172.21.15.5:55916) 2024-08-31T05:32:25.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.214+0000 7f3a4d65b640 1 -- 172.21.15.5:0/924488241 learned_addr learned my addr 172.21.15.5:0/924488241 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:25.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.214+0000 7f3a4d65b640 1 --2- 172.21.15.5:0/924488241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56030b93f390 0x56030bd05d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:25.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.214+0000 7f3a3effd640 1 --2- 172.21.15.5:0/3792383290 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f3a340b4cd0 0x7f3a340b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:25.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.214+0000 7f3a4d65b640 1 -- 172.21.15.5:0/924488241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56030b93f390 msgr2=0x56030bd05d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:25.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.214+0000 7f3a4d65b640 1 --2- 172.21.15.5:0/924488241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56030b93f390 0x56030bd05d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:25.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.214+0000 7f3a4d65b640 1 -- 172.21.15.5:0/924488241 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56030b9371b0 msgr2=0x56030bd05850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:25.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.214+0000 7f3a4d65b640 1 --2- 172.21.15.5:0/924488241 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56030b9371b0 0x56030bd05850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:25.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.214+0000 7f3a4d65b640 1 -- 172.21.15.5:0/924488241 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56030b9cb650 con 0x56030b960070 2024-08-31T05:32:25.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.214+0000 7f3a4de5c640 1 --2- 172.21.15.5:0/924488241 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56030b9371b0 0x56030bd05850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:32:25.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.214+0000 7f3a3effd640 1 -- 172.21.15.5:0/3792383290 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f3a400e5590 con 0x7f3a48108a90 2024-08-31T05:32:25.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.214+0000 7f3a4e65d640 1 --2- 172.21.15.5:0/3792383290 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f3a340b4cd0 0x7f3a340b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:25.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.214+0000 7f3a4d65b640 1 --2- 172.21.15.5:0/924488241 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56030b960070 0x56030bd05310 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3a4806a840 tx=0x7f3a38005780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a535b53c3d5c588 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:25.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.215+0000 7f3a33fff640 1 -- 172.21.15.5:0/924488241 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a38035030 con 0x56030b960070 2024-08-31T05:32:25.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.215+0000 7f3a33fff640 1 -- 172.21.15.5:0/924488241 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a380318c0 con 0x56030b960070 2024-08-31T05:32:25.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.215+0000 7f3a33fff640 1 -- 172.21.15.5:0/924488241 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a38003970 con 0x56030b960070 2024-08-31T05:32:25.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.216+0000 7f3a56635740 1 -- 172.21.15.5:0/924488241 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56030b960070 msgr2=0x56030bd05310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:25.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.216+0000 7f3a4e65d640 1 --2- 172.21.15.5:0/3792383290 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f3a340b4cd0 0x7f3a340b71e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3a40003fd0 tx=0x7f3a40004020 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:25.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.216+0000 7f3a56635740 1 --2- 172.21.15.5:0/924488241 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56030b960070 0x56030bd05310 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3a4806a840 tx=0x7f3a38005780 comp rx=0 tx=0).stop 2024-08-31T05:32:25.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.216+0000 7f3a56635740 1 -- 172.21.15.5:0/924488241 shutdown_connections 2024-08-31T05:32:25.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.216+0000 7f3a56635740 1 --2- 172.21.15.5:0/924488241 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56030b93f390 0x56030bd05d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:25.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.216+0000 7f3a56635740 1 --2- 172.21.15.5:0/924488241 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56030b9371b0 0x56030bd05850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:25.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.216+0000 7f3a56635740 1 --2- 172.21.15.5:0/924488241 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56030b960070 0x56030bd05310 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:25.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.216+0000 7f3a56635740 1 -- 172.21.15.5:0/924488241 >> 172.21.15.5:0/924488241 conn(0x56030b954460 msgr2=0x56030bd03200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:25.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.216+0000 7f3a56635740 1 -- 172.21.15.5:0/924488241 shutdown_connections 2024-08-31T05:32:25.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.216+0000 7f3a56635740 1 -- 172.21.15.5:0/924488241 wait complete. 2024-08-31T05:32:25.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.217+0000 7f3a56635740 1 -- start start 2024-08-31T05:32:25.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.217+0000 7f3a56635740 1 Processor -- start 2024-08-31T05:32:25.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.217+0000 7f3a56635740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56030b9371b0 0x56030bd10b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:25.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.217+0000 7f3a56635740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56030b93f390 0x56030bd110f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:25.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.217+0000 7f3a56635740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56030b960070 0x56030bd1ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:25.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.217+0000 7f3a56635740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56030bace700 con 0x56030b960070 2024-08-31T05:32:25.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.217+0000 7f3a56635740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56030bbf2750 con 0x56030b93f390 2024-08-31T05:32:25.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.217+0000 7f3a56635740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56030bd13a90 con 0x56030b9371b0 2024-08-31T05:32:25.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.217+0000 7f3a56635740 10 client.0 _ll_register_callbacks cb 0x56030bc21e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:32:25.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.217+0000 7f3a4d65b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56030b9371b0 0x56030bd10b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:25.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.217+0000 7f3a4d65b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56030b960070 0x56030bd1ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:25.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.217+0000 7f3a4d65b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56030b9371b0 0x56030bd10b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:55932/0 (socket says 172.21.15.5:55932) 2024-08-31T05:32:25.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.217+0000 7f3a4d65b640 1 -- 172.21.15.5:0/1543749534 learned_addr learned my addr 172.21.15.5:0/1543749534 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:25.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.218+0000 7f3a4de5c640 1 --2- 172.21.15.5:0/1543749534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56030b93f390 0x56030bd110f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:25.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.218+0000 7f3a4d65b640 1 -- 172.21.15.5:0/1543749534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56030b93f390 msgr2=0x56030bd110f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:25.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.218+0000 7f3a4d65b640 1 --2- 172.21.15.5:0/1543749534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56030b93f390 0x56030bd110f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:25.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.218+0000 7f3a4d65b640 1 -- 172.21.15.5:0/1543749534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56030b960070 msgr2=0x56030bd1ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:25.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.218+0000 7f3a4d65b640 1 --2- 172.21.15.5:0/1543749534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56030b960070 0x56030bd1ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:25.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.218+0000 7f3a4d65b640 1 -- 172.21.15.5:0/1543749534 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56030bc2b900 con 0x56030b9371b0 2024-08-31T05:32:25.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.218+0000 7f3a4d65b640 1 --2- 172.21.15.5:0/1543749534 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56030b9371b0 0x56030bd10b70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3a38003650 tx=0x7f3a38005db0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11c12608784babd2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:25.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.218+0000 7f3a317fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:32:25.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.218+0000 7f3a317fa640 1 -- 172.21.15.5:0/1543749534 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a38035040 con 0x56030b9371b0 2024-08-31T05:32:25.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.218+0000 7f3a317fa640 1 -- 172.21.15.5:0/1543749534 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f3a38048750 con 0x56030b9371b0 2024-08-31T05:32:25.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.218+0000 7f3a56635740 1 -- 172.21.15.5:0/1543749534 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a380318c0 con 0x56030b9371b0 2024-08-31T05:32:25.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.218+0000 7f3a317fa640 1 -- 172.21.15.5:0/1543749534 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f3a38060050 con 0x56030b9371b0 2024-08-31T05:32:25.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.218+0000 7f3a56635740 10 client.25834 fetch_fsmap learned FSMap version 32 2024-08-31T05:32:25.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.219+0000 7f3a56635740 1 -- 172.21.15.5:0/1543749534 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56030bd1f970 con 0x56030b9371b0 2024-08-31T05:32:25.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.219+0000 7f3a317fa640 1 -- 172.21.15.5:0/1543749534 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a380318c0 con 0x56030b9371b0 2024-08-31T05:32:25.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.219+0000 7f3a317fa640 1 -- 172.21.15.5:0/1543749534 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f3a38057930 con 0x56030b9371b0 2024-08-31T05:32:25.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.219+0000 7f3a56635740 10 client.25834 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:32:25.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.219+0000 7f3a56635740 10 client.25834 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-31T05:32:25.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.219+0000 7f3a56635740 20 client.25834 populate_metadata read hostname 'smithi005' 2024-08-31T05:32:25.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.219+0000 7f3a56635740 1 --2- 172.21.15.5:0/1543749534 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x56030b91e9f0 0x56030bd22cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:25.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.219+0000 7f3a56635740 4 client.25834 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:32:25.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.219+0000 7f3a56635740 1 -- 172.21.15.5:0/1543749534 --> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56030bc7e5d0 con 0x56030b91e9f0 2024-08-31T05:32:25.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.219+0000 7f3a4de5c640 1 --2- 172.21.15.5:0/1543749534 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x56030b91e9f0 0x56030bd22cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:25.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.220+0000 7f3a317fa640 10 client.25834 ms_handle_connect on v2:172.21.15.50:6838/98200944 2024-08-31T05:32:25.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.220+0000 7f3a4de5c640 1 --2- 172.21.15.5:0/1543749534 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x56030b91e9f0 0x56030bd22cd0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3a739f1f0fd99b37 server_cookie=6b319bcbdf12232b in_seq=0 out_seq=0 2024-08-31T05:32:25.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.220+0000 7f3a317fa640 1 -- 172.21.15.5:0/1543749534 <== mds.1 v2:172.21.15.50:6838/98200944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56030bc7e5d0 con 0x56030b91e9f0 2024-08-31T05:32:25.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.220+0000 7f3a317fa640 10 client.25834 handle_command_reply: tid=0 2024-08-31T05:32:25.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.220+0000 7f3a56635740 1 client.25834 shutdown 2024-08-31T05:32:25.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.221+0000 7f3a56635740 1 -- 172.21.15.5:0/1543749534 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56030b9371b0 msgr2=0x56030bd10b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:25.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.221+0000 7f3a56635740 1 --2- 172.21.15.5:0/1543749534 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56030b9371b0 0x56030bd10b70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3a38003650 tx=0x7f3a38005db0 comp rx=0 tx=0).stop 2024-08-31T05:32:25.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.221+0000 7f3a56635740 1 -- 172.21.15.5:0/1543749534 shutdown_connections 2024-08-31T05:32:25.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.221+0000 7f3a56635740 1 --2- 172.21.15.5:0/1543749534 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x56030b91e9f0 0x56030bd22cd0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:25.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.221+0000 7f3a56635740 1 --2- 172.21.15.5:0/1543749534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56030b960070 0x56030bd1ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:25.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.221+0000 7f3a56635740 1 --2- 172.21.15.5:0/1543749534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56030b93f390 0x56030bd110f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:25.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.221+0000 7f3a56635740 1 --2- 172.21.15.5:0/1543749534 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56030b9371b0 0x56030bd10b70 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:25.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.221+0000 7f3a317fa640 0 client.25834 ms_handle_reset on v2:172.21.15.50:6838/98200944 2024-08-31T05:32:25.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.221+0000 7f3a56635740 1 -- 172.21.15.5:0/1543749534 >> 172.21.15.5:0/1543749534 conn(0x56030b954460 msgr2=0x56030bd084a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:25.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.221+0000 7f3a56635740 1 -- 172.21.15.5:0/1543749534 shutdown_connections 2024-08-31T05:32:25.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.221+0000 7f3a56635740 1 -- 172.21.15.5:0/1543749534 wait complete. 2024-08-31T05:32:25.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.221+0000 7f3a56635740 20 client.25834 trim_cache size 0 max 16384 2024-08-31T05:32:25.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.235+0000 7f3a56635740 1 Processor -- start 2024-08-31T05:32:25.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.235+0000 7f3a56635740 1 -- start start 2024-08-31T05:32:25.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.235+0000 7f3a56635740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56030b9371b0 0x56030bd12b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:25.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.236+0000 7f3a56635740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56030b93f390 0x56030bd1cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:25.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.236+0000 7f3a56635740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56030b960070 0x56030bd1d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:25.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.236+0000 7f3a56635740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3a481aeaa0 con 0x56030b9371b0 2024-08-31T05:32:25.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.236+0000 7f3a56635740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3a481b06a0 con 0x56030b93f390 2024-08-31T05:32:25.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.236+0000 7f3a56635740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3a481af170 con 0x56030b960070 2024-08-31T05:32:25.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.236+0000 7f3a4de5c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56030b93f390 0x56030bd1cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:25.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.236+0000 7f3a4de5c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56030b93f390 0x56030bd1cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:49294/0 (socket says 172.21.15.5:49294) 2024-08-31T05:32:25.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.236+0000 7f3a4de5c640 1 -- 172.21.15.5:0/338939979 learned_addr learned my addr 172.21.15.5:0/338939979 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:25.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.236+0000 7f3a4d65b640 1 --2- 172.21.15.5:0/338939979 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56030b9371b0 0x56030bd12b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:25.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.236+0000 7f3a4de5c640 1 -- 172.21.15.5:0/338939979 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56030b960070 msgr2=0x56030bd1d2b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T05:32:25.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.236+0000 7f3a4de5c640 1 --2- 172.21.15.5:0/338939979 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56030b960070 0x56030bd1d2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:25.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.236+0000 7f3a4de5c640 1 -- 172.21.15.5:0/338939979 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56030b9371b0 msgr2=0x56030bd12b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:25.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.237+0000 7f3a4de5c640 1 --2- 172.21.15.5:0/338939979 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56030b9371b0 0x56030bd12b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:25.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.237+0000 7f3a4de5c640 1 -- 172.21.15.5:0/338939979 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56030bd0f070 con 0x56030b93f390 2024-08-31T05:32:25.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.237+0000 7f3a4d65b640 1 --2- 172.21.15.5:0/338939979 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56030b9371b0 0x56030bd12b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:32:25.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.237+0000 7f3a4de5c640 1 --2- 172.21.15.5:0/338939979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56030b93f390 0x56030bd1cd70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3a44000c00 tx=0x7f3a44005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e761fd1b86dbfbed server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:25.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.237+0000 7f3a337fe640 1 -- 172.21.15.5:0/338939979 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a44004250 con 0x56030b93f390 2024-08-31T05:32:25.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.237+0000 7f3a337fe640 1 -- 172.21.15.5:0/338939979 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a44010e10 con 0x56030b93f390 2024-08-31T05:32:25.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.237+0000 7f3a337fe640 1 -- 172.21.15.5:0/338939979 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a440047a0 con 0x56030b93f390 2024-08-31T05:32:25.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.238+0000 7f3a56635740 1 -- 172.21.15.5:0/338939979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56030b93f390 msgr2=0x56030bd1cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:25.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.238+0000 7f3a56635740 1 --2- 172.21.15.5:0/338939979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56030b93f390 0x56030bd1cd70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3a44000c00 tx=0x7f3a44005f90 comp rx=0 tx=0).stop 2024-08-31T05:32:25.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.238+0000 7f3a56635740 1 -- 172.21.15.5:0/338939979 shutdown_connections 2024-08-31T05:32:25.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.238+0000 7f3a56635740 1 --2- 172.21.15.5:0/338939979 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56030b960070 0x56030bd1d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:25.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.238+0000 7f3a56635740 1 --2- 172.21.15.5:0/338939979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56030b93f390 0x56030bd1cd70 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:25.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.238+0000 7f3a56635740 1 --2- 172.21.15.5:0/338939979 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56030b9371b0 0x56030bd12b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:25.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.238+0000 7f3a56635740 1 -- 172.21.15.5:0/338939979 >> 172.21.15.5:0/338939979 conn(0x56030b954460 msgr2=0x56030bd06d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:25.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.239+0000 7f3a56635740 1 -- 172.21.15.5:0/338939979 shutdown_connections 2024-08-31T05:32:25.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.239+0000 7f3a56635740 1 -- 172.21.15.5:0/338939979 wait complete. 2024-08-31T05:32:25.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.239+0000 7f3a56635740 1 -- start start 2024-08-31T05:32:25.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.239+0000 7f3a56635740 1 Processor -- start 2024-08-31T05:32:25.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.239+0000 7f3a56635740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56030b9371b0 0x56030bd84860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:25.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.239+0000 7f3a56635740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56030b93f390 0x56030bd84e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:25.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.239+0000 7f3a56635740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56030b960070 0x56030bd83630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:25.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.239+0000 7f3a56635740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3a481aff10 con 0x56030b960070 2024-08-31T05:32:25.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.239+0000 7f3a56635740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3a481af840 con 0x56030b9371b0 2024-08-31T05:32:25.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.240+0000 7f3a56635740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3a481aca80 con 0x56030b93f390 2024-08-31T05:32:25.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.240+0000 7f3a56635740 10 client.0 _ll_register_callbacks cb 0x7f3a44009570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:32:25.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.240+0000 7f3a4d65b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56030b9371b0 0x56030bd84860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:25.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.240+0000 7f3a4de5c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56030b93f390 0x56030bd84e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:25.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.240+0000 7f3a4de5c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56030b93f390 0x56030bd84e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:55946/0 (socket says 172.21.15.5:55946) 2024-08-31T05:32:25.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.240+0000 7f3a4d65b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56030b9371b0 0x56030bd84860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:49302/0 (socket says 172.21.15.5:49302) 2024-08-31T05:32:25.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.240+0000 7f3a4de5c640 1 -- 172.21.15.5:0/1129280381 learned_addr learned my addr 172.21.15.5:0/1129280381 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:25.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.240+0000 7f3a4d65b640 1 --2- 172.21.15.5:0/1129280381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56030b960070 0x56030bd83630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:25.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.240+0000 7f3a4d65b640 1 -- 172.21.15.5:0/1129280381 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56030b93f390 msgr2=0x56030bd84e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:25.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.240+0000 7f3a4d65b640 1 --2- 172.21.15.5:0/1129280381 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56030b93f390 0x56030bd84e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:25.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.240+0000 7f3a4d65b640 1 -- 172.21.15.5:0/1129280381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56030b960070 msgr2=0x56030bd83630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:25.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.240+0000 7f3a4d65b640 1 --2- 172.21.15.5:0/1129280381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56030b960070 0x56030bd83630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:25.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.240+0000 7f3a4d65b640 1 -- 172.21.15.5:0/1129280381 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56030bd83ca0 con 0x56030b9371b0 2024-08-31T05:32:25.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.240+0000 7f3a4de5c640 1 --2- 172.21.15.5:0/1129280381 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56030b93f390 0x56030bd84e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:32:25.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.240+0000 7f3a4d65b640 1 --2- 172.21.15.5:0/1129280381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56030b9371b0 0x56030bd84860 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3a38057ea0 tx=0x7f3a38031f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=987669952a446da6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:25.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.240+0000 7f3a317fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:32:25.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.240+0000 7f3a317fa640 1 -- 172.21.15.5:0/1129280381 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a38035040 con 0x56030b9371b0 2024-08-31T05:32:25.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.240+0000 7f3a317fa640 1 -- 172.21.15.5:0/1129280381 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f3a38005020 con 0x56030b9371b0 2024-08-31T05:32:25.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.240+0000 7f3a56635740 1 -- 172.21.15.5:0/1129280381 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a44010e10 con 0x56030b9371b0 2024-08-31T05:32:25.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.241+0000 7f3a317fa640 1 -- 172.21.15.5:0/1129280381 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f3a38005220 con 0x56030b9371b0 2024-08-31T05:32:25.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.241+0000 7f3a56635740 10 client.25826 fetch_fsmap learned FSMap version 32 2024-08-31T05:32:25.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.241+0000 7f3a56635740 1 -- 172.21.15.5:0/1129280381 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56030bd8e2b0 con 0x56030b9371b0 2024-08-31T05:32:25.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.241+0000 7f3a317fa640 1 -- 172.21.15.5:0/1129280381 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a44010e10 con 0x56030b9371b0 2024-08-31T05:32:25.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.241+0000 7f3a317fa640 1 -- 172.21.15.5:0/1129280381 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f3a38004750 con 0x56030b9371b0 2024-08-31T05:32:25.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.241+0000 7f3a56635740 10 client.25826 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:32:25.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.241+0000 7f3a56635740 10 client.25826 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-31T05:32:25.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.241+0000 7f3a56635740 20 client.25826 populate_metadata read hostname 'smithi005' 2024-08-31T05:32:25.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.241+0000 7f3a56635740 1 --2- 172.21.15.5:0/1129280381 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x56030b8f3da0 0x56030bd908c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:25.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.241+0000 7f3a56635740 4 client.25826 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:32:25.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.241+0000 7f3a56635740 1 -- 172.21.15.5:0/1129280381 --> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56030bc7a070 con 0x56030b8f3da0 2024-08-31T05:32:25.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.241+0000 7f3a4de5c640 1 --2- 172.21.15.5:0/1129280381 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x56030b8f3da0 0x56030bd908c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:25.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.242+0000 7f3a317fa640 10 client.25826 ms_handle_connect on v2:172.21.15.50:6838/98200944 2024-08-31T05:32:25.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.242+0000 7f3a4de5c640 1 --2- 172.21.15.5:0/1129280381 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x56030b8f3da0 0x56030bd908c0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=66b82d2cf05cc79e server_cookie=9358568e4bd65360 in_seq=0 out_seq=0 2024-08-31T05:32:25.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.242+0000 7f3a317fa640 1 -- 172.21.15.5:0/1129280381 <== mds.1 v2:172.21.15.50:6838/98200944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56030bc7a070 con 0x56030b8f3da0 2024-08-31T05:32:25.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.242+0000 7f3a317fa640 10 client.25826 handle_command_reply: tid=0 2024-08-31T05:32:25.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.242+0000 7f3a56635740 1 client.25826 shutdown 2024-08-31T05:32:25.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.242+0000 7f3a56635740 1 -- 172.21.15.5:0/1129280381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56030b9371b0 msgr2=0x56030bd84860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:25.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.242+0000 7f3a56635740 1 --2- 172.21.15.5:0/1129280381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56030b9371b0 0x56030bd84860 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3a38057ea0 tx=0x7f3a38031f50 comp rx=0 tx=0).stop 2024-08-31T05:32:25.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.242+0000 7f3a56635740 1 -- 172.21.15.5:0/1129280381 shutdown_connections 2024-08-31T05:32:25.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.242+0000 7f3a56635740 1 --2- 172.21.15.5:0/1129280381 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x56030b8f3da0 0x56030bd908c0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:25.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.242+0000 7f3a56635740 1 --2- 172.21.15.5:0/1129280381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56030b960070 0x56030bd83630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:25.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.242+0000 7f3a56635740 1 --2- 172.21.15.5:0/1129280381 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56030b93f390 0x56030bd84e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:25.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.242+0000 7f3a317fa640 0 client.25826 ms_handle_reset on v2:172.21.15.50:6838/98200944 2024-08-31T05:32:25.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.242+0000 7f3a56635740 1 --2- 172.21.15.5:0/1129280381 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56030b9371b0 0x56030bd84860 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:25.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.242+0000 7f3a56635740 1 -- 172.21.15.5:0/1129280381 >> 172.21.15.5:0/1129280381 conn(0x56030b954460 msgr2=0x56030bd1bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:25.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.242+0000 7f3a56635740 1 -- 172.21.15.5:0/1129280381 shutdown_connections 2024-08-31T05:32:25.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.242+0000 7f3a56635740 1 -- 172.21.15.5:0/1129280381 wait complete. 2024-08-31T05:32:25.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.243+0000 7f3a56635740 20 client.25826 trim_cache size 0 max 16384 2024-08-31T05:32:25.249 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:32:25.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.244+0000 7f3a500c0640 1 -- 172.21.15.5:0/3792383290 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f3a340b4cd0 msgr2=0x7f3a340b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:25.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.244+0000 7f3a500c0640 1 --2- 172.21.15.5:0/3792383290 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f3a340b4cd0 0x7f3a340b71e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3a40003fd0 tx=0x7f3a40004020 comp rx=0 tx=0).stop 2024-08-31T05:32:25.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.244+0000 7f3a500c0640 1 -- 172.21.15.5:0/3792383290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a48108a90 msgr2=0x7f3a4819bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:25.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.244+0000 7f3a500c0640 1 --2- 172.21.15.5:0/3792383290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a48108a90 0x7f3a4819bad0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f3a40009fd0 tx=0x7f3a4000b260 comp rx=0 tx=0).stop 2024-08-31T05:32:25.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.244+0000 7f3a500c0640 1 -- 172.21.15.5:0/3792383290 shutdown_connections 2024-08-31T05:32:25.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.244+0000 7f3a500c0640 1 --2- 172.21.15.5:0/3792383290 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f3a340b4cd0 0x7f3a340b71e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:25.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.244+0000 7f3a500c0640 1 --2- 172.21.15.5:0/3792383290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a48108a90 0x7f3a4819bad0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:25.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.244+0000 7f3a500c0640 1 --2- 172.21.15.5:0/3792383290 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a48108140 0x7f3a4819b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:25.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.244+0000 7f3a500c0640 1 --2- 172.21.15.5:0/3792383290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a48102800 0x7f3a4819b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:25.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.244+0000 7f3a500c0640 1 -- 172.21.15.5:0/3792383290 >> 172.21.15.5:0/3792383290 conn(0x7f3a480794d0 msgr2=0x7f3a481050b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:25.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.244+0000 7f3a500c0640 1 -- 172.21.15.5:0/3792383290 shutdown_connections 2024-08-31T05:32:25.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:25.244+0000 7f3a500c0640 1 -- 172.21.15.5:0/3792383290 wait complete. 2024-08-31T05:32:25.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:32:25 smithi005 ceph-mon[18602]: pgmap v418: 129 pgs: 129 active+clean; 95 MiB data, 745 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 2.5 MiB/s wr, 215 op/s 2024-08-31T05:32:25.585 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:32:25 smithi070 ceph-mon[22316]: pgmap v418: 129 pgs: 129 active+clean; 95 MiB data, 745 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 2.5 MiB/s wr, 215 op/s 2024-08-31T05:32:25.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:32:25 smithi050 ceph-mon[22146]: pgmap v418: 129 pgs: 129 active+clean; 95 MiB data, 745 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 2.5 MiB/s wr, 215 op/s 2024-08-31T05:32:25.910 INFO:tasks.workunit.client.0.smithi005.stdout: 1 188389 14.17 MB/sec warmup 73 sec latency 52.201 ms 2024-08-31T05:32:26.479 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T05:32:26.770 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:32:26.910 INFO:tasks.workunit.client.0.smithi005.stdout: 1 190829 14.13 MB/sec warmup 74 sec latency 16.296 ms 2024-08-31T05:32:27.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.294+0000 7f3a728a2640 1 -- 172.21.15.5:0/2180733808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a6c108a90 msgr2=0x7f3a6c10f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:27.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.294+0000 7f3a728a2640 1 --2- 172.21.15.5:0/2180733808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a6c108a90 0x7f3a6c10f2c0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f3a64009ca0 tx=0x7f3a6402a8c0 comp rx=0 tx=0).stop 2024-08-31T05:32:27.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.294+0000 7f3a728a2640 1 -- 172.21.15.5:0/2180733808 shutdown_connections 2024-08-31T05:32:27.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.294+0000 7f3a728a2640 1 --2- 172.21.15.5:0/2180733808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a6c108a90 0x7f3a6c10f2c0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:27.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.294+0000 7f3a728a2640 1 --2- 172.21.15.5:0/2180733808 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a6c108140 0x7f3a6c108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:27.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.294+0000 7f3a728a2640 1 --2- 172.21.15.5:0/2180733808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a6c102800 0x7f3a6c102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:27.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.294+0000 7f3a728a2640 1 -- 172.21.15.5:0/2180733808 >> 172.21.15.5:0/2180733808 conn(0x7f3a6c0794d0 msgr2=0x7f3a6c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:27.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.295+0000 7f3a728a2640 1 -- 172.21.15.5:0/2180733808 shutdown_connections 2024-08-31T05:32:27.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.295+0000 7f3a728a2640 1 -- 172.21.15.5:0/2180733808 wait complete. 2024-08-31T05:32:27.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.295+0000 7f3a728a2640 1 Processor -- start 2024-08-31T05:32:27.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.296+0000 7f3a728a2640 1 -- start start 2024-08-31T05:32:27.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.296+0000 7f3a728a2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a6c102800 0x7f3a6c198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:27.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.296+0000 7f3a728a2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a6c108140 0x7f3a6c199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:27.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.296+0000 7f3a728a2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a6c108a90 0x7f3a6c199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:27.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.296+0000 7f3a728a2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c112710 con 0x7f3a6c108a90 2024-08-31T05:32:27.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.296+0000 7f3a728a2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c112590 con 0x7f3a6c102800 2024-08-31T05:32:27.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.296+0000 7f3a728a2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c112890 con 0x7f3a6c108140 2024-08-31T05:32:27.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.296+0000 7f3a6b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a6c108140 0x7f3a6c199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:27.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.296+0000 7f3a70e3f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a6c108a90 0x7f3a6c199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:27.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.296+0000 7f3a6b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a6c108140 0x7f3a6c199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:55964/0 (socket says 172.21.15.5:55964) 2024-08-31T05:32:27.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.296+0000 7f3a6b7fe640 1 -- 172.21.15.5:0/2896151784 learned_addr learned my addr 172.21.15.5:0/2896151784 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:27.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.296+0000 7f3a6bfff640 1 --2- 172.21.15.5:0/2896151784 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a6c102800 0x7f3a6c198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:27.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.297+0000 7f3a6b7fe640 1 -- 172.21.15.5:0/2896151784 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a6c102800 msgr2=0x7f3a6c198e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:27.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.297+0000 7f3a6b7fe640 1 --2- 172.21.15.5:0/2896151784 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a6c102800 0x7f3a6c198e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:27.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.297+0000 7f3a6b7fe640 1 -- 172.21.15.5:0/2896151784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a6c108a90 msgr2=0x7f3a6c199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:27.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.297+0000 7f3a6b7fe640 1 --2- 172.21.15.5:0/2896151784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a6c108a90 0x7f3a6c199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:27.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.297+0000 7f3a6b7fe640 1 -- 172.21.15.5:0/2896151784 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a6c19e0f0 con 0x7f3a6c108140 2024-08-31T05:32:27.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.297+0000 7f3a6b7fe640 1 --2- 172.21.15.5:0/2896151784 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a6c108140 0x7f3a6c199350 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3a6000e9f0 tx=0x7f3a6000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:27.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.297+0000 7f3a697fa640 1 -- 172.21.15.5:0/2896151784 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6000ccc0 con 0x7f3a6c108140 2024-08-31T05:32:27.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.297+0000 7f3a697fa640 1 -- 172.21.15.5:0/2896151784 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a600054d0 con 0x7f3a6c108140 2024-08-31T05:32:27.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.297+0000 7f3a728a2640 1 -- 172.21.15.5:0/2896151784 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a6c19e3e0 con 0x7f3a6c108140 2024-08-31T05:32:27.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.297+0000 7f3a697fa640 1 -- 172.21.15.5:0/2896151784 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a60010430 con 0x7f3a6c108140 2024-08-31T05:32:27.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.297+0000 7f3a728a2640 1 -- 172.21.15.5:0/2896151784 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a6c19e8d0 con 0x7f3a6c108140 2024-08-31T05:32:27.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.300+0000 7f3a697fa640 1 -- 172.21.15.5:0/2896151784 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f3a600105d0 con 0x7f3a6c108140 2024-08-31T05:32:27.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.300+0000 7f3a78e17740 1 Processor -- start 2024-08-31T05:32:27.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.300+0000 7f3a78e17740 1 -- start start 2024-08-31T05:32:27.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.300+0000 7f3a78e17740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556f33d13070 0x556f340b8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:27.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.300+0000 7f3a78e17740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f33cea1b0 0x556f340b8890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:27.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.300+0000 7f3a78e17740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f33cf2390 0x556f340b8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:27.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.301+0000 7f3a78e17740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x556f3402f680 con 0x556f33d13070 2024-08-31T05:32:27.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.301+0000 7f3a78e17740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x556f3401ec10 con 0x556f33cea1b0 2024-08-31T05:32:27.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.301+0000 7f3a78e17740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556f34022bc0 con 0x556f33cf2390 2024-08-31T05:32:27.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.301+0000 7f3a70e3f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556f33d13070 0x556f340b8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:27.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.301+0000 7f3a70e3f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556f33d13070 0x556f340b8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51916/0 (socket says 172.21.15.5:51916) 2024-08-31T05:32:27.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.301+0000 7f3a70e3f640 1 -- 172.21.15.5:0/3524725696 learned_addr learned my addr 172.21.15.5:0/3524725696 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:27.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.301+0000 7f3a6bfff640 1 --2- 172.21.15.5:0/3524725696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f33cea1b0 0x556f340b8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:27.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.301+0000 7f3a6b7fe640 1 --2- 172.21.15.5:0/3524725696 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f33cf2390 0x556f340b8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:27.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.301+0000 7f3a70e3f640 1 -- 172.21.15.5:0/3524725696 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f33cf2390 msgr2=0x556f340b8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:27.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.301+0000 7f3a70e3f640 1 --2- 172.21.15.5:0/3524725696 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f33cf2390 0x556f340b8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:27.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.301+0000 7f3a70e3f640 1 -- 172.21.15.5:0/3524725696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f33cea1b0 msgr2=0x556f340b8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:27.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.301+0000 7f3a70e3f640 1 --2- 172.21.15.5:0/3524725696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f33cea1b0 0x556f340b8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:27.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.301+0000 7f3a70e3f640 1 -- 172.21.15.5:0/3524725696 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f33d7e650 con 0x556f33d13070 2024-08-31T05:32:27.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.301+0000 7f3a697fa640 1 --2- 172.21.15.5:0/2896151784 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f3a540b4ca0 0x7f3a540b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:27.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.301+0000 7f3a6b7fe640 1 --2- 172.21.15.5:0/3524725696 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f33cf2390 0x556f340b8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:32:27.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.301+0000 7f3a6bfff640 1 --2- 172.21.15.5:0/2896151784 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f3a540b4ca0 0x7f3a540b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:27.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.301+0000 7f3a697fa640 1 -- 172.21.15.5:0/2896151784 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f3a600e5bb0 con 0x7f3a6c108140 2024-08-31T05:32:27.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.301+0000 7f3a70e3f640 1 --2- 172.21.15.5:0/3524725696 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556f33d13070 0x556f340b8350 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f3a64035000 tx=0x7f3a6402f410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e736a9f9ced759c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:27.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.302+0000 7f3a527fc640 1 -- 172.21.15.5:0/3524725696 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a64031cf0 con 0x556f33d13070 2024-08-31T05:32:27.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.302+0000 7f3a527fc640 1 -- 172.21.15.5:0/3524725696 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a64036030 con 0x556f33d13070 2024-08-31T05:32:27.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.302+0000 7f3a527fc640 1 -- 172.21.15.5:0/3524725696 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a64004040 con 0x556f33d13070 2024-08-31T05:32:27.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.303+0000 7f3a78e17740 1 -- 172.21.15.5:0/3524725696 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556f33d13070 msgr2=0x556f340b8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:27.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.303+0000 7f3a6bfff640 1 --2- 172.21.15.5:0/2896151784 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f3a540b4ca0 0x7f3a540b71b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x556f340b6fd0 tx=0x7f3a5c005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:27.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.303+0000 7f3a78e17740 1 --2- 172.21.15.5:0/3524725696 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556f33d13070 0x556f340b8350 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f3a64035000 tx=0x7f3a6402f410 comp rx=0 tx=0).stop 2024-08-31T05:32:27.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.303+0000 7f3a78e17740 1 -- 172.21.15.5:0/3524725696 shutdown_connections 2024-08-31T05:32:27.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.303+0000 7f3a78e17740 1 --2- 172.21.15.5:0/3524725696 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f33cf2390 0x556f340b8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:27.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.303+0000 7f3a78e17740 1 --2- 172.21.15.5:0/3524725696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f33cea1b0 0x556f340b8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:27.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.303+0000 7f3a78e17740 1 --2- 172.21.15.5:0/3524725696 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556f33d13070 0x556f340b8350 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:27.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.303+0000 7f3a78e17740 1 -- 172.21.15.5:0/3524725696 >> 172.21.15.5:0/3524725696 conn(0x556f33d07460 msgr2=0x556f340b6240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:27.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.303+0000 7f3a78e17740 1 -- 172.21.15.5:0/3524725696 shutdown_connections 2024-08-31T05:32:27.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.303+0000 7f3a78e17740 1 -- 172.21.15.5:0/3524725696 wait complete. 2024-08-31T05:32:27.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.304+0000 7f3a78e17740 1 -- start start 2024-08-31T05:32:27.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.304+0000 7f3a78e17740 1 Processor -- start 2024-08-31T05:32:27.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.304+0000 7f3a78e17740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556f33cea1b0 0x556f340c3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:27.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.304+0000 7f3a78e17740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f33cf2390 0x556f340c40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:27.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.304+0000 7f3a78e17740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f33d13070 0x556f340cfc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:27.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.304+0000 7f3a78e17740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x556f33e81700 con 0x556f33cea1b0 2024-08-31T05:32:27.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.304+0000 7f3a78e17740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x556f33fa5750 con 0x556f33cf2390 2024-08-31T05:32:27.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.304+0000 7f3a78e17740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556f340c6950 con 0x556f33d13070 2024-08-31T05:32:27.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.304+0000 7f3a78e17740 10 client.0 _ll_register_callbacks cb 0x556f33fd4e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:32:27.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.305+0000 7f3a6bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556f33cea1b0 0x556f340c3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:27.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.305+0000 7f3a70e3f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f33d13070 0x556f340cfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:27.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.305+0000 7f3a6b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f33cf2390 0x556f340c40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:27.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.305+0000 7f3a6bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556f33cea1b0 0x556f340c3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51932/0 (socket says 172.21.15.5:51932) 2024-08-31T05:32:27.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.305+0000 7f3a6bfff640 1 -- 172.21.15.5:0/328074206 learned_addr learned my addr 172.21.15.5:0/328074206 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:27.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.305+0000 7f3a70e3f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f33d13070 0x556f340cfc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:55976/0 (socket says 172.21.15.5:55976) 2024-08-31T05:32:27.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.305+0000 7f3a6bfff640 1 -- 172.21.15.5:0/328074206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f33d13070 msgr2=0x556f340cfc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:27.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.305+0000 7f3a6bfff640 1 --2- 172.21.15.5:0/328074206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f33d13070 0x556f340cfc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:27.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.305+0000 7f3a6bfff640 1 -- 172.21.15.5:0/328074206 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f33cf2390 msgr2=0x556f340c40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:27.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.305+0000 7f3a6bfff640 1 --2- 172.21.15.5:0/328074206 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f33cf2390 0x556f340c40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:27.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.305+0000 7f3a6bfff640 1 -- 172.21.15.5:0/328074206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f33fde900 con 0x556f33cea1b0 2024-08-31T05:32:27.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.305+0000 7f3a6b7fe640 1 --2- 172.21.15.5:0/328074206 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f33cf2390 0x556f340c40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:32:27.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.305+0000 7f3a6bfff640 1 --2- 172.21.15.5:0/328074206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556f33cea1b0 0x556f340c3b60 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c0058a0 tx=0x7f3a5c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef2f4ae15700d12a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:27.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.305+0000 7f3a4b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:32:27.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.305+0000 7f3a4b7fe640 1 -- 172.21.15.5:0/328074206 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c01f640 con 0x556f33cea1b0 2024-08-31T05:32:27.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.305+0000 7f3a4b7fe640 1 -- 172.21.15.5:0/328074206 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f3a5c01f7e0 con 0x556f33cea1b0 2024-08-31T05:32:27.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.305+0000 7f3a78e17740 1 -- 172.21.15.5:0/328074206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a64036030 con 0x556f33cea1b0 2024-08-31T05:32:27.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.306+0000 7f3a4b7fe640 1 -- 172.21.15.5:0/328074206 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f3a5c01f9e0 con 0x556f33cea1b0 2024-08-31T05:32:27.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.306+0000 7f3a78e17740 10 client.16248 fetch_fsmap learned FSMap version 32 2024-08-31T05:32:27.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.306+0000 7f3a78e17740 1 -- 172.21.15.5:0/328074206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x556f340d27b0 con 0x556f33cea1b0 2024-08-31T05:32:27.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.306+0000 7f3a4b7fe640 1 -- 172.21.15.5:0/328074206 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a64036030 con 0x556f33cea1b0 2024-08-31T05:32:27.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.306+0000 7f3a4b7fe640 1 -- 172.21.15.5:0/328074206 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f3a5c027070 con 0x556f33cea1b0 2024-08-31T05:32:27.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.306+0000 7f3a78e17740 10 client.16248 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:32:27.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.306+0000 7f3a78e17740 10 client.16248 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:32:27.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.306+0000 7f3a78e17740 20 client.16248 populate_metadata read hostname 'smithi005' 2024-08-31T05:32:27.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.306+0000 7f3a78e17740 1 --2- 172.21.15.5:0/328074206 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x556f33cd19f0 0x556f340d5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:27.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.306+0000 7f3a78e17740 4 client.16248 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:32:27.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.306+0000 7f3a78e17740 1 -- 172.21.15.5:0/328074206 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556f340315d0 con 0x556f33cd19f0 2024-08-31T05:32:27.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.306+0000 7f3a6b7fe640 1 --2- 172.21.15.5:0/328074206 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x556f33cd19f0 0x556f340d5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:27.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.307+0000 7f3a4b7fe640 10 client.16248 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:32:27.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.307+0000 7f3a6b7fe640 1 --2- 172.21.15.5:0/328074206 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x556f33cd19f0 0x556f340d5d40 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac2a82a88528bbff server_cookie=b336a063c1e04ded in_seq=0 out_seq=0 2024-08-31T05:32:27.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.308+0000 7f3a4b7fe640 1 -- 172.21.15.5:0/328074206 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556f340315d0 con 0x556f33cd19f0 2024-08-31T05:32:27.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.308+0000 7f3a4b7fe640 10 client.16248 handle_command_reply: tid=0 2024-08-31T05:32:27.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.308+0000 7f3a78e17740 1 client.16248 shutdown 2024-08-31T05:32:27.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.308+0000 7f3a78e17740 1 -- 172.21.15.5:0/328074206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556f33cea1b0 msgr2=0x556f340c3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:27.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.308+0000 7f3a78e17740 1 --2- 172.21.15.5:0/328074206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556f33cea1b0 0x556f340c3b60 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c0058a0 tx=0x7f3a5c004730 comp rx=0 tx=0).stop 2024-08-31T05:32:27.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.308+0000 7f3a78e17740 1 -- 172.21.15.5:0/328074206 shutdown_connections 2024-08-31T05:32:27.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.308+0000 7f3a78e17740 1 --2- 172.21.15.5:0/328074206 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x556f33cd19f0 0x556f340d5d40 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:27.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.308+0000 7f3a78e17740 1 --2- 172.21.15.5:0/328074206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f33d13070 0x556f340cfc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:27.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.308+0000 7f3a78e17740 1 --2- 172.21.15.5:0/328074206 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f33cf2390 0x556f340c40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:27.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.308+0000 7f3a78e17740 1 --2- 172.21.15.5:0/328074206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556f33cea1b0 0x556f340c3b60 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:27.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.308+0000 7f3a4b7fe640 0 client.16248 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:32:27.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.308+0000 7f3a78e17740 1 -- 172.21.15.5:0/328074206 >> 172.21.15.5:0/328074206 conn(0x556f33d07460 msgr2=0x556f340bb530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:27.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.308+0000 7f3a78e17740 1 -- 172.21.15.5:0/328074206 shutdown_connections 2024-08-31T05:32:27.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.308+0000 7f3a78e17740 1 -- 172.21.15.5:0/328074206 wait complete. 2024-08-31T05:32:27.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.309+0000 7f3a78e17740 20 client.16248 trim_cache size 0 max 16384 2024-08-31T05:32:27.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.323+0000 7f3a78e17740 1 Processor -- start 2024-08-31T05:32:27.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.323+0000 7f3a78e17740 1 -- start start 2024-08-31T05:32:27.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.324+0000 7f3a78e17740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f33cea1b0 0x556f340bbb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:27.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.324+0000 7f3a78e17740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556f33cf2390 0x556f340c0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:27.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.324+0000 7f3a78e17740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f33d13070 0x556f340c1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:27.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.324+0000 7f3a78e17740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c1b71e0 con 0x556f33cf2390 2024-08-31T05:32:27.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.324+0000 7f3a78e17740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c1b8de0 con 0x556f33cea1b0 2024-08-31T05:32:27.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.324+0000 7f3a78e17740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c1b78b0 con 0x556f33d13070 2024-08-31T05:32:27.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.324+0000 7f3a6b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556f33cf2390 0x556f340c0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:27.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.324+0000 7f3a70e3f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f33d13070 0x556f340c1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:27.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.324+0000 7f3a6b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556f33cf2390 0x556f340c0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51942/0 (socket says 172.21.15.5:51942) 2024-08-31T05:32:27.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.324+0000 7f3a6b7fe640 1 -- 172.21.15.5:0/1181191591 learned_addr learned my addr 172.21.15.5:0/1181191591 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:27.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.324+0000 7f3a6bfff640 1 --2- 172.21.15.5:0/1181191591 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f33cea1b0 0x556f340bbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:27.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.324+0000 7f3a70e3f640 1 -- 172.21.15.5:0/1181191591 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f33cea1b0 msgr2=0x556f340bbb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:27.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.324+0000 7f3a70e3f640 1 --2- 172.21.15.5:0/1181191591 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f33cea1b0 0x556f340bbb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:27.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.324+0000 7f3a70e3f640 1 -- 172.21.15.5:0/1181191591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556f33cf2390 msgr2=0x556f340c0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:27.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.324+0000 7f3a70e3f640 1 --2- 172.21.15.5:0/1181191591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556f33cf2390 0x556f340c0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:27.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.324+0000 7f3a70e3f640 1 -- 172.21.15.5:0/1181191591 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f340bab50 con 0x556f33d13070 2024-08-31T05:32:27.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.324+0000 7f3a6bfff640 1 --2- 172.21.15.5:0/1181191591 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f33cea1b0 0x556f340bbb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:32:27.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.324+0000 7f3a6b7fe640 1 --2- 172.21.15.5:0/1181191591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556f33cf2390 0x556f340c0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:32:27.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.324+0000 7f3a70e3f640 1 --2- 172.21.15.5:0/1181191591 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f33d13070 0x556f340c1290 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3a6402ade0 tx=0x7f3a64003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c007a8ecedab2f53 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:27.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.325+0000 7f3a51ffb640 1 -- 172.21.15.5:0/1181191591 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a64056070 con 0x556f33d13070 2024-08-31T05:32:27.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.325+0000 7f3a51ffb640 1 -- 172.21.15.5:0/1181191591 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a64036040 con 0x556f33d13070 2024-08-31T05:32:27.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.325+0000 7f3a51ffb640 1 -- 172.21.15.5:0/1181191591 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6404a040 con 0x556f33d13070 2024-08-31T05:32:27.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.326+0000 7f3a78e17740 1 -- 172.21.15.5:0/1181191591 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f33d13070 msgr2=0x556f340c1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:27.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.326+0000 7f3a78e17740 1 --2- 172.21.15.5:0/1181191591 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f33d13070 0x556f340c1290 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3a6402ade0 tx=0x7f3a64003b90 comp rx=0 tx=0).stop 2024-08-31T05:32:27.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.326+0000 7f3a78e17740 1 -- 172.21.15.5:0/1181191591 shutdown_connections 2024-08-31T05:32:27.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.326+0000 7f3a78e17740 1 --2- 172.21.15.5:0/1181191591 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f33d13070 0x556f340c1290 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:27.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.326+0000 7f3a78e17740 1 --2- 172.21.15.5:0/1181191591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556f33cf2390 0x556f340c0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:27.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.326+0000 7f3a78e17740 1 --2- 172.21.15.5:0/1181191591 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f33cea1b0 0x556f340bbb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:27.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.326+0000 7f3a78e17740 1 -- 172.21.15.5:0/1181191591 >> 172.21.15.5:0/1181191591 conn(0x556f33d07460 msgr2=0x556f340bb450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:27.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.326+0000 7f3a78e17740 1 -- 172.21.15.5:0/1181191591 shutdown_connections 2024-08-31T05:32:27.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.326+0000 7f3a78e17740 1 -- 172.21.15.5:0/1181191591 wait complete. 2024-08-31T05:32:27.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.327+0000 7f3a78e17740 1 -- start start 2024-08-31T05:32:27.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.327+0000 7f3a78e17740 1 Processor -- start 2024-08-31T05:32:27.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.327+0000 7f3a78e17740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f33cea1b0 0x556f340cc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:27.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.327+0000 7f3a78e17740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556f33cf2390 0x556f340c8550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:27.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.327+0000 7f3a78e17740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f33d13070 0x556f340c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:27.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.327+0000 7f3a78e17740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c1b8650 con 0x556f33cf2390 2024-08-31T05:32:27.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.327+0000 7f3a78e17740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c1b7f80 con 0x556f33d13070 2024-08-31T05:32:27.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.327+0000 7f3a78e17740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c1b51c0 con 0x556f33cea1b0 2024-08-31T05:32:27.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.327+0000 7f3a78e17740 10 client.0 _ll_register_callbacks cb 0x7f3a5c009ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:32:27.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.327+0000 7f3a6b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556f33cf2390 0x556f340c8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:27.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.327+0000 7f3a6bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f33cea1b0 0x556f340cc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:27.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.327+0000 7f3a6b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556f33cf2390 0x556f340c8550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51958/0 (socket says 172.21.15.5:51958) 2024-08-31T05:32:27.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.327+0000 7f3a6bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f33cea1b0 0x556f340cc090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:56002/0 (socket says 172.21.15.5:56002) 2024-08-31T05:32:27.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.327+0000 7f3a6b7fe640 1 -- 172.21.15.5:0/291125099 learned_addr learned my addr 172.21.15.5:0/291125099 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:27.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.328+0000 7f3a70e3f640 1 --2- 172.21.15.5:0/291125099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f33d13070 0x556f340c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:27.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.328+0000 7f3a6bfff640 1 -- 172.21.15.5:0/291125099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f33d13070 msgr2=0x556f340c8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:27.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.328+0000 7f3a6bfff640 1 --2- 172.21.15.5:0/291125099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f33d13070 0x556f340c8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:27.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.328+0000 7f3a6bfff640 1 -- 172.21.15.5:0/291125099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556f33cf2390 msgr2=0x556f340c8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:27.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.328+0000 7f3a6bfff640 1 --2- 172.21.15.5:0/291125099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556f33cf2390 0x556f340c8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:27.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.328+0000 7f3a6bfff640 1 -- 172.21.15.5:0/291125099 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f340c8fd0 con 0x556f33cea1b0 2024-08-31T05:32:27.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.328+0000 7f3a6b7fe640 1 --2- 172.21.15.5:0/291125099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556f33cf2390 0x556f340c8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:32:27.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.328+0000 7f3a6bfff640 1 --2- 172.21.15.5:0/291125099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f33cea1b0 0x556f340cc090 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c019040 tx=0x7f3a5c01f870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43cd495f25e41e9b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:27.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.328+0000 7f3a4b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:32:27.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.328+0000 7f3a4b7fe640 1 -- 172.21.15.5:0/291125099 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c03b060 con 0x556f33cea1b0 2024-08-31T05:32:27.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.328+0000 7f3a4b7fe640 1 -- 172.21.15.5:0/291125099 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f3a5c029440 con 0x556f33cea1b0 2024-08-31T05:32:27.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.328+0000 7f3a78e17740 1 -- 172.21.15.5:0/291125099 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a64036040 con 0x556f33cea1b0 2024-08-31T05:32:27.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.329+0000 7f3a4b7fe640 1 -- 172.21.15.5:0/291125099 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f3a5c042050 con 0x556f33cea1b0 2024-08-31T05:32:27.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.329+0000 7f3a78e17740 10 client.25855 fetch_fsmap learned FSMap version 32 2024-08-31T05:32:27.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.329+0000 7f3a78e17740 1 -- 172.21.15.5:0/291125099 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x556f34141390 con 0x556f33cea1b0 2024-08-31T05:32:27.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.329+0000 7f3a4b7fe640 1 -- 172.21.15.5:0/291125099 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a64036040 con 0x556f33cea1b0 2024-08-31T05:32:27.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.329+0000 7f3a4b7fe640 1 -- 172.21.15.5:0/291125099 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f3a5c027050 con 0x556f33cea1b0 2024-08-31T05:32:27.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.329+0000 7f3a78e17740 10 client.25855 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:32:27.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.329+0000 7f3a78e17740 10 client.25855 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:32:27.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.329+0000 7f3a78e17740 20 client.25855 populate_metadata read hostname 'smithi005' 2024-08-31T05:32:27.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.329+0000 7f3a78e17740 1 --2- 172.21.15.5:0/291125099 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x556f33ca6da0 0x556f34143c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:27.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.329+0000 7f3a78e17740 4 client.25855 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:32:27.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.329+0000 7f3a78e17740 1 -- 172.21.15.5:0/291125099 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556f3402d070 con 0x556f33ca6da0 2024-08-31T05:32:27.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.329+0000 7f3a6b7fe640 1 --2- 172.21.15.5:0/291125099 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x556f33ca6da0 0x556f34143c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:27.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.330+0000 7f3a4b7fe640 10 client.25855 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:32:27.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.330+0000 7f3a6b7fe640 1 --2- 172.21.15.5:0/291125099 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x556f33ca6da0 0x556f34143c10 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ecf06b3b848286a server_cookie=ed5fa90c912f1c9 in_seq=0 out_seq=0 2024-08-31T05:32:27.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.330+0000 7f3a4b7fe640 1 -- 172.21.15.5:0/291125099 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556f3402d070 con 0x556f33ca6da0 2024-08-31T05:32:27.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.330+0000 7f3a4b7fe640 10 client.25855 handle_command_reply: tid=0 2024-08-31T05:32:27.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.330+0000 7f3a78e17740 1 client.25855 shutdown 2024-08-31T05:32:27.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.330+0000 7f3a78e17740 1 -- 172.21.15.5:0/291125099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f33cea1b0 msgr2=0x556f340cc090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:27.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.330+0000 7f3a78e17740 1 --2- 172.21.15.5:0/291125099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f33cea1b0 0x556f340cc090 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c019040 tx=0x7f3a5c01f870 comp rx=0 tx=0).stop 2024-08-31T05:32:27.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.330+0000 7f3a78e17740 1 -- 172.21.15.5:0/291125099 shutdown_connections 2024-08-31T05:32:27.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.330+0000 7f3a78e17740 1 --2- 172.21.15.5:0/291125099 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x556f33ca6da0 0x556f34143c10 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:27.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.330+0000 7f3a78e17740 1 --2- 172.21.15.5:0/291125099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556f33d13070 0x556f340c8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:27.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.330+0000 7f3a78e17740 1 --2- 172.21.15.5:0/291125099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556f33cf2390 0x556f340c8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:27.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.330+0000 7f3a78e17740 1 --2- 172.21.15.5:0/291125099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556f33cea1b0 0x556f340cc090 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:27.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.330+0000 7f3a78e17740 1 -- 172.21.15.5:0/291125099 >> 172.21.15.5:0/291125099 conn(0x556f33d07460 msgr2=0x556f340b9380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:27.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.330+0000 7f3a4b7fe640 0 client.25855 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:32:27.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.330+0000 7f3a78e17740 1 -- 172.21.15.5:0/291125099 shutdown_connections 2024-08-31T05:32:27.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.330+0000 7f3a78e17740 1 -- 172.21.15.5:0/291125099 wait complete. 2024-08-31T05:32:27.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.330+0000 7f3a78e17740 20 client.25855 trim_cache size 0 max 16384 2024-08-31T05:32:27.338 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:32:27.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.331+0000 7f3a728a2640 1 -- 172.21.15.5:0/2896151784 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f3a540b4ca0 msgr2=0x7f3a540b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:27.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.331+0000 7f3a728a2640 1 --2- 172.21.15.5:0/2896151784 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f3a540b4ca0 0x7f3a540b71b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x556f340b6fd0 tx=0x7f3a5c005f90 comp rx=0 tx=0).stop 2024-08-31T05:32:27.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.331+0000 7f3a728a2640 1 -- 172.21.15.5:0/2896151784 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a6c108140 msgr2=0x7f3a6c199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:27.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.331+0000 7f3a728a2640 1 --2- 172.21.15.5:0/2896151784 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a6c108140 0x7f3a6c199350 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3a6000e9f0 tx=0x7f3a6000eeb0 comp rx=0 tx=0).stop 2024-08-31T05:32:27.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.331+0000 7f3a728a2640 1 -- 172.21.15.5:0/2896151784 shutdown_connections 2024-08-31T05:32:27.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.331+0000 7f3a728a2640 1 --2- 172.21.15.5:0/2896151784 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f3a540b4ca0 0x7f3a540b71b0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:27.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.331+0000 7f3a728a2640 1 --2- 172.21.15.5:0/2896151784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a6c108a90 0x7f3a6c199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:27.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.331+0000 7f3a728a2640 1 --2- 172.21.15.5:0/2896151784 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a6c108140 0x7f3a6c199350 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:27.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.331+0000 7f3a728a2640 1 --2- 172.21.15.5:0/2896151784 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a6c102800 0x7f3a6c198e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:27.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.331+0000 7f3a728a2640 1 -- 172.21.15.5:0/2896151784 >> 172.21.15.5:0/2896151784 conn(0x7f3a6c0794d0 msgr2=0x7f3a6c105040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:27.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.331+0000 7f3a728a2640 1 -- 172.21.15.5:0/2896151784 shutdown_connections 2024-08-31T05:32:27.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:27.331+0000 7f3a728a2640 1 -- 172.21.15.5:0/2896151784 wait complete. 2024-08-31T05:32:27.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:32:27 smithi005 ceph-mon[18602]: pgmap v419: 129 pgs: 129 active+clean; 99 MiB data, 768 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 3.9 MiB/s wr, 301 op/s 2024-08-31T05:32:27.585 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:32:27 smithi070 ceph-mon[22316]: pgmap v419: 129 pgs: 129 active+clean; 99 MiB data, 768 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 3.9 MiB/s wr, 301 op/s 2024-08-31T05:32:27.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:32:27 smithi050 ceph-mon[22146]: pgmap v419: 129 pgs: 129 active+clean; 99 MiB data, 768 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 3.9 MiB/s wr, 301 op/s 2024-08-31T05:32:27.910 INFO:tasks.workunit.client.0.smithi005.stdout: 1 192733 14.08 MB/sec warmup 75 sec latency 32.392 ms 2024-08-31T05:32:28.910 INFO:tasks.workunit.client.0.smithi005.stdout: 1 195692 14.11 MB/sec warmup 76 sec latency 10.721 ms 2024-08-31T05:32:29.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:32:29 smithi005 ceph-mon[18602]: pgmap v420: 129 pgs: 129 active+clean; 99 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.7 MiB/s wr, 278 op/s 2024-08-31T05:32:29.585 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:32:29 smithi070 ceph-mon[22316]: pgmap v420: 129 pgs: 129 active+clean; 99 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.7 MiB/s wr, 278 op/s 2024-08-31T05:32:29.638 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T05:32:29.638 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T05:32:29.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:32:29 smithi050 ceph-mon[22146]: pgmap v420: 129 pgs: 129 active+clean; 99 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.7 MiB/s wr, 278 op/s 2024-08-31T05:32:29.910 INFO:tasks.workunit.client.0.smithi005.stdout: 1 198849 14.18 MB/sec warmup 77 sec latency 13.707 ms 2024-08-31T05:32:29.919 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:32:30.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.518+0000 7ff075dba640 1 -- 172.21.15.5:0/1951679702 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0701047d0 msgr2=0x7ff070104be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:30.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.518+0000 7ff075dba640 1 --2- 172.21.15.5:0/1951679702 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0701047d0 0x7ff070104be0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7ff060009900 tx=0x7ff06002a410 comp rx=0 tx=0).stop 2024-08-31T05:32:30.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.518+0000 7ff075dba640 1 -- 172.21.15.5:0/1951679702 shutdown_connections 2024-08-31T05:32:30.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.518+0000 7ff075dba640 1 --2- 172.21.15.5:0/1951679702 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff07010dc30 0x7ff070110120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:30.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.518+0000 7ff075dba640 1 --2- 172.21.15.5:0/1951679702 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff070105120 0x7ff07010d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:30.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.518+0000 7ff075dba640 1 --2- 172.21.15.5:0/1951679702 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0701047d0 0x7ff070104be0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:30.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.518+0000 7ff075dba640 1 -- 172.21.15.5:0/1951679702 >> 172.21.15.5:0/1951679702 conn(0x7ff070079510 msgr2=0x7ff070079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:30.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.518+0000 7ff075dba640 1 -- 172.21.15.5:0/1951679702 shutdown_connections 2024-08-31T05:32:30.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.518+0000 7ff075dba640 1 -- 172.21.15.5:0/1951679702 wait complete. 2024-08-31T05:32:30.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.519+0000 7ff075dba640 1 Processor -- start 2024-08-31T05:32:30.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.519+0000 7ff075dba640 1 -- start start 2024-08-31T05:32:30.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.519+0000 7ff075dba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0701047d0 0x7ff07019a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:30.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.519+0000 7ff075dba640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff070105120 0x7ff07019a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:30.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.519+0000 7ff075dba640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff07010dc30 0x7ff07019fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:30.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.519+0000 7ff075dba640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff0701138b0 con 0x7ff070105120 2024-08-31T05:32:30.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.519+0000 7ff075dba640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff070113730 con 0x7ff0701047d0 2024-08-31T05:32:30.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.519+0000 7ff075dba640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff070113a30 con 0x7ff07010dc30 2024-08-31T05:32:30.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.519+0000 7ff06effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff070105120 0x7ff07019a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:30.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.519+0000 7ff06f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0701047d0 0x7ff07019a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:30.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.519+0000 7ff06f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0701047d0 0x7ff07019a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:49386/0 (socket says 172.21.15.5:49386) 2024-08-31T05:32:30.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.519+0000 7ff06f7fe640 1 -- 172.21.15.5:0/335946155 learned_addr learned my addr 172.21.15.5:0/335946155 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:30.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.519+0000 7ff06ffff640 1 --2- 172.21.15.5:0/335946155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff07010dc30 0x7ff07019fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:30.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.520+0000 7ff06f7fe640 1 -- 172.21.15.5:0/335946155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff07010dc30 msgr2=0x7ff07019fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:30.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.520+0000 7ff06f7fe640 1 --2- 172.21.15.5:0/335946155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff07010dc30 0x7ff07019fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:30.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.520+0000 7ff06f7fe640 1 -- 172.21.15.5:0/335946155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff070105120 msgr2=0x7ff07019a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:30.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.520+0000 7ff06f7fe640 1 --2- 172.21.15.5:0/335946155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff070105120 0x7ff07019a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:30.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.520+0000 7ff06f7fe640 1 -- 172.21.15.5:0/335946155 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0701a01f0 con 0x7ff0701047d0 2024-08-31T05:32:30.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.520+0000 7ff06effd640 1 --2- 172.21.15.5:0/335946155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff070105120 0x7ff07019a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:32:30.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.520+0000 7ff06f7fe640 1 --2- 172.21.15.5:0/335946155 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0701047d0 0x7ff07019a280 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff060005940 tx=0x7ff0600040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:30.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.520+0000 7ff06cff9640 1 -- 172.21.15.5:0/335946155 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff06003f030 con 0x7ff0701047d0 2024-08-31T05:32:30.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.520+0000 7ff075dba640 1 -- 172.21.15.5:0/335946155 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0701a0480 con 0x7ff0701047d0 2024-08-31T05:32:30.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.520+0000 7ff06cff9640 1 -- 172.21.15.5:0/335946155 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff0600044c0 con 0x7ff0701047d0 2024-08-31T05:32:30.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.520+0000 7ff06cff9640 1 -- 172.21.15.5:0/335946155 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff060035070 con 0x7ff0701047d0 2024-08-31T05:32:30.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.520+0000 7ff075dba640 1 -- 172.21.15.5:0/335946155 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0701a6c40 con 0x7ff0701047d0 2024-08-31T05:32:30.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.523+0000 7ff07c32f740 1 Processor -- start 2024-08-31T05:32:30.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.523+0000 7ff07c32f740 1 -- start start 2024-08-31T05:32:30.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.523+0000 7ff06cff9640 1 -- 172.21.15.5:0/335946155 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7ff060042030 con 0x7ff0701047d0 2024-08-31T05:32:30.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.523+0000 7ff07c32f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1233bc350 0x55f123762780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:30.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.523+0000 7ff07c32f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f123393490 0x55f123762cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:30.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.523+0000 7ff07c32f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f12339b670 0x55f123763200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:30.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.523+0000 7ff07c32f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f1236d85f0 con 0x55f1233bc350 2024-08-31T05:32:30.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.523+0000 7ff07c32f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f1236c7b80 con 0x55f12339b670 2024-08-31T05:32:30.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.523+0000 7ff07c32f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f1236cbb30 con 0x55f123393490 2024-08-31T05:32:30.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.523+0000 7ff06ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1233bc350 0x55f123762780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:30.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.523+0000 7ff06ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1233bc350 0x55f123762780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51986/0 (socket says 172.21.15.5:51986) 2024-08-31T05:32:30.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.523+0000 7ff06effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f12339b670 0x55f123763200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:30.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.523+0000 7ff06ffff640 1 -- 172.21.15.5:0/3873583534 learned_addr learned my addr 172.21.15.5:0/3873583534 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:30.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.523+0000 7ff06f7fe640 1 --2- 172.21.15.5:0/3873583534 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f123393490 0x55f123762cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:30.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.524+0000 7ff06effd640 1 -- 172.21.15.5:0/3873583534 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f123393490 msgr2=0x55f123762cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:30.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.524+0000 7ff06effd640 1 --2- 172.21.15.5:0/3873583534 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f123393490 0x55f123762cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:30.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.524+0000 7ff06effd640 1 -- 172.21.15.5:0/3873583534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1233bc350 msgr2=0x55f123762780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:30.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.524+0000 7ff06effd640 1 --2- 172.21.15.5:0/3873583534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1233bc350 0x55f123762780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:30.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.524+0000 7ff06effd640 1 -- 172.21.15.5:0/3873583534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f123427930 con 0x55f12339b670 2024-08-31T05:32:30.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.524+0000 7ff06ffff640 1 --2- 172.21.15.5:0/3873583534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1233bc350 0x55f123762780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:32:30.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.524+0000 7ff06cff9640 1 --2- 172.21.15.5:0/335946155 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff0580b4ca0 0x7ff0580b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:30.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.524+0000 7ff06effd640 1 --2- 172.21.15.5:0/3873583534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f12339b670 0x55f123763200 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff07006b3f0 tx=0x7ff064010860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a219f0422174f33 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:30.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.524+0000 7ff055ffb640 1 -- 172.21.15.5:0/3873583534 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff064004230 con 0x55f12339b670 2024-08-31T05:32:30.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.524+0000 7ff055ffb640 1 -- 172.21.15.5:0/3873583534 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff0640043d0 con 0x55f12339b670 2024-08-31T05:32:30.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.524+0000 7ff055ffb640 1 -- 172.21.15.5:0/3873583534 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0640035f0 con 0x55f12339b670 2024-08-31T05:32:30.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.524+0000 7ff06ffff640 1 --2- 172.21.15.5:0/335946155 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff0580b4ca0 0x7ff0580b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:30.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.524+0000 7ff06cff9640 1 -- 172.21.15.5:0/335946155 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7ff060105c30 con 0x7ff0701047d0 2024-08-31T05:32:30.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.525+0000 7ff07c32f740 1 -- 172.21.15.5:0/3873583534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f12339b670 msgr2=0x55f123763200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:30.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.525+0000 7ff06ffff640 1 --2- 172.21.15.5:0/335946155 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff0580b4ca0 0x7ff0580b71b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff068003de0 tx=0x7ff068009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:30.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.525+0000 7ff07c32f740 1 --2- 172.21.15.5:0/3873583534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f12339b670 0x55f123763200 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff07006b3f0 tx=0x7ff064010860 comp rx=0 tx=0).stop 2024-08-31T05:32:30.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.525+0000 7ff07c32f740 1 -- 172.21.15.5:0/3873583534 shutdown_connections 2024-08-31T05:32:30.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.525+0000 7ff07c32f740 1 --2- 172.21.15.5:0/3873583534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f12339b670 0x55f123763200 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:30.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.525+0000 7ff07c32f740 1 --2- 172.21.15.5:0/3873583534 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f123393490 0x55f123762cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:30.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.525+0000 7ff07c32f740 1 --2- 172.21.15.5:0/3873583534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1233bc350 0x55f123762780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:30.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.525+0000 7ff07c32f740 1 -- 172.21.15.5:0/3873583534 >> 172.21.15.5:0/3873583534 conn(0x55f1233b0740 msgr2=0x55f123760670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:30.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.525+0000 7ff07c32f740 1 -- 172.21.15.5:0/3873583534 shutdown_connections 2024-08-31T05:32:30.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.525+0000 7ff07c32f740 1 -- 172.21.15.5:0/3873583534 wait complete. 2024-08-31T05:32:30.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.526+0000 7ff07c32f740 1 -- start start 2024-08-31T05:32:30.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.526+0000 7ff07c32f740 1 Processor -- start 2024-08-31T05:32:30.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.526+0000 7ff07c32f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f123393490 0x55f12376dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:30.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.526+0000 7ff07c32f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f12339b670 0x55f12376e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:30.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.526+0000 7ff07c32f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1233bc350 0x55f12377a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:30.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.526+0000 7ff07c32f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f12352a890 con 0x55f12339b670 2024-08-31T05:32:30.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.526+0000 7ff07c32f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f12364e790 con 0x55f123393490 2024-08-31T05:32:30.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.526+0000 7ff07c32f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f123770f60 con 0x55f1233bc350 2024-08-31T05:32:30.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.526+0000 7ff06effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f12339b670 0x55f12376e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:30.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.526+0000 7ff07c32f740 10 client.0 _ll_register_callbacks cb 0x55f1233d3ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:32:30.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.526+0000 7ff06effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f12339b670 0x55f12376e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51990/0 (socket says 172.21.15.5:51990) 2024-08-31T05:32:30.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.526+0000 7ff06effd640 1 -- 172.21.15.5:0/2127360620 learned_addr learned my addr 172.21.15.5:0/2127360620 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:30.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.526+0000 7ff06ffff640 1 --2- 172.21.15.5:0/2127360620 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1233bc350 0x55f12377a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:30.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.527+0000 7ff06f7fe640 1 --2- 172.21.15.5:0/2127360620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f123393490 0x55f12376dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:30.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.527+0000 7ff06effd640 1 -- 172.21.15.5:0/2127360620 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1233bc350 msgr2=0x55f12377a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:30.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.527+0000 7ff06effd640 1 --2- 172.21.15.5:0/2127360620 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1233bc350 0x55f12377a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:30.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.527+0000 7ff06effd640 1 -- 172.21.15.5:0/2127360620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f123393490 msgr2=0x55f12376dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:30.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.527+0000 7ff06effd640 1 --2- 172.21.15.5:0/2127360620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f123393490 0x55f12376dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:30.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.527+0000 7ff06effd640 1 -- 172.21.15.5:0/2127360620 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f123685f30 con 0x55f12339b670 2024-08-31T05:32:30.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.527+0000 7ff06effd640 1 --2- 172.21.15.5:0/2127360620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f12339b670 0x55f12376e400 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7ff064000c00 tx=0x7ff064011730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4600f62f3a4284fd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:30.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.527+0000 7ff04effd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:32:30.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.527+0000 7ff04effd640 1 -- 172.21.15.5:0/2127360620 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff064011d30 con 0x55f12339b670 2024-08-31T05:32:30.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.527+0000 7ff04effd640 1 -- 172.21.15.5:0/2127360620 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7ff064004c60 con 0x55f12339b670 2024-08-31T05:32:30.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.527+0000 7ff07c32f740 1 -- 172.21.15.5:0/2127360620 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff0640043d0 con 0x55f12339b670 2024-08-31T05:32:30.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.527+0000 7ff04effd640 1 -- 172.21.15.5:0/2127360620 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff064032050 con 0x55f12339b670 2024-08-31T05:32:30.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.527+0000 7ff07c32f740 10 client.16266 fetch_fsmap learned FSMap version 32 2024-08-31T05:32:30.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.527+0000 7ff07c32f740 1 -- 172.21.15.5:0/2127360620 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55f12377ccf0 con 0x55f12339b670 2024-08-31T05:32:30.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.528+0000 7ff04effd640 1 -- 172.21.15.5:0/2127360620 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff0640043d0 con 0x55f12339b670 2024-08-31T05:32:30.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.528+0000 7ff04effd640 1 -- 172.21.15.5:0/2127360620 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7ff0640196a0 con 0x55f12339b670 2024-08-31T05:32:30.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.528+0000 7ff07c32f740 10 client.16266 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:32:30.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.528+0000 7ff07c32f740 10 client.16266 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:32:30.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.528+0000 7ff07c32f740 20 client.16266 populate_metadata read hostname 'smithi005' 2024-08-31T05:32:30.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.528+0000 7ff07c32f740 1 --2- 172.21.15.5:0/2127360620 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55f12337acd0 0x55f123780100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:30.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.528+0000 7ff07c32f740 4 client.16266 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:32:30.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.528+0000 7ff07c32f740 1 -- 172.21.15.5:0/2127360620 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f1236da540 con 0x55f12337acd0 2024-08-31T05:32:30.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.528+0000 7ff06f7fe640 1 --2- 172.21.15.5:0/2127360620 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55f12337acd0 0x55f123780100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:30.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.528+0000 7ff04effd640 10 client.16266 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:32:30.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.529+0000 7ff06f7fe640 1 --2- 172.21.15.5:0/2127360620 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55f12337acd0 0x55f123780100 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9746cea8f63a9e91 server_cookie=10f36d36f74109f0 in_seq=0 out_seq=0 2024-08-31T05:32:30.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.529+0000 7ff04effd640 1 -- 172.21.15.5:0/2127360620 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f1236da540 con 0x55f12337acd0 2024-08-31T05:32:30.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.529+0000 7ff04effd640 10 client.16266 handle_command_reply: tid=0 2024-08-31T05:32:30.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.529+0000 7ff07c32f740 1 client.16266 shutdown 2024-08-31T05:32:30.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.530+0000 7ff07c32f740 1 -- 172.21.15.5:0/2127360620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f12339b670 msgr2=0x55f12376e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:30.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.530+0000 7ff07c32f740 1 --2- 172.21.15.5:0/2127360620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f12339b670 0x55f12376e400 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7ff064000c00 tx=0x7ff064011730 comp rx=0 tx=0).stop 2024-08-31T05:32:30.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.530+0000 7ff07c32f740 1 -- 172.21.15.5:0/2127360620 shutdown_connections 2024-08-31T05:32:30.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.530+0000 7ff07c32f740 1 --2- 172.21.15.5:0/2127360620 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55f12337acd0 0x55f123780100 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:30.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.530+0000 7ff07c32f740 1 --2- 172.21.15.5:0/2127360620 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1233bc350 0x55f12377a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:30.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.530+0000 7ff07c32f740 1 --2- 172.21.15.5:0/2127360620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f12339b670 0x55f12376e400 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:30.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.530+0000 7ff07c32f740 1 --2- 172.21.15.5:0/2127360620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f123393490 0x55f12376dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:30.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.530+0000 7ff04effd640 0 client.16266 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:32:30.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.530+0000 7ff07c32f740 1 -- 172.21.15.5:0/2127360620 >> 172.21.15.5:0/2127360620 conn(0x55f1233b0740 msgr2=0x55f123765960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:30.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.530+0000 7ff07c32f740 1 -- 172.21.15.5:0/2127360620 shutdown_connections 2024-08-31T05:32:30.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.530+0000 7ff07c32f740 1 -- 172.21.15.5:0/2127360620 wait complete. 2024-08-31T05:32:30.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.530+0000 7ff07c32f740 20 client.16266 trim_cache size 0 max 16384 2024-08-31T05:32:30.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.548+0000 7ff07c32f740 1 Processor -- start 2024-08-31T05:32:30.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.548+0000 7ff07c32f740 1 -- start start 2024-08-31T05:32:30.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.548+0000 7ff07c32f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f123393490 0x55f123763ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:30.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.548+0000 7ff07c32f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f12339b670 0x55f12377a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:30.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.548+0000 7ff07c32f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1233bc350 0x55f12376b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:30.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.548+0000 7ff07c32f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff0701ae940 con 0x55f1233bc350 2024-08-31T05:32:30.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.548+0000 7ff07c32f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff0701b0540 con 0x55f12339b670 2024-08-31T05:32:30.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.548+0000 7ff07c32f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff0701af010 con 0x55f123393490 2024-08-31T05:32:30.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.548+0000 7ff06ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1233bc350 0x55f12376b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:30.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.548+0000 7ff06ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1233bc350 0x55f12376b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52004/0 (socket says 172.21.15.5:52004) 2024-08-31T05:32:30.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.548+0000 7ff06ffff640 1 -- 172.21.15.5:0/261243831 learned_addr learned my addr 172.21.15.5:0/261243831 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:30.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.548+0000 7ff06effd640 1 --2- 172.21.15.5:0/261243831 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f12339b670 0x55f12377a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:30.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.548+0000 7ff06f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f123393490 0x55f123763ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:30.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.548+0000 7ff06ffff640 1 -- 172.21.15.5:0/261243831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f123393490 msgr2=0x55f123763ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:30.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.548+0000 7ff06ffff640 1 --2- 172.21.15.5:0/261243831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f123393490 0x55f123763ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:30.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.548+0000 7ff06ffff640 1 -- 172.21.15.5:0/261243831 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f12339b670 msgr2=0x55f12377a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:30.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.548+0000 7ff06ffff640 1 --2- 172.21.15.5:0/261243831 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f12339b670 0x55f12377a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:30.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.548+0000 7ff06ffff640 1 -- 172.21.15.5:0/261243831 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f123761270 con 0x55f1233bc350 2024-08-31T05:32:30.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.548+0000 7ff06effd640 1 --2- 172.21.15.5:0/261243831 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f12339b670 0x55f12377a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:32:30.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.549+0000 7ff06ffff640 1 --2- 172.21.15.5:0/261243831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1233bc350 0x55f12376b0b0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7ff06800f740 tx=0x7ff068022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb35ef619719da16 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:30.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.549+0000 7ff0557fa640 1 -- 172.21.15.5:0/261243831 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff068004b20 con 0x55f1233bc350 2024-08-31T05:32:30.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.549+0000 7ff0557fa640 1 -- 172.21.15.5:0/261243831 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff068004cc0 con 0x55f1233bc350 2024-08-31T05:32:30.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.549+0000 7ff0557fa640 1 -- 172.21.15.5:0/261243831 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff068005240 con 0x55f1233bc350 2024-08-31T05:32:30.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.550+0000 7ff07c32f740 1 -- 172.21.15.5:0/261243831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1233bc350 msgr2=0x55f12376b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:30.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.550+0000 7ff07c32f740 1 --2- 172.21.15.5:0/261243831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1233bc350 0x55f12376b0b0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7ff06800f740 tx=0x7ff068022000 comp rx=0 tx=0).stop 2024-08-31T05:32:30.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.550+0000 7ff07c32f740 1 -- 172.21.15.5:0/261243831 shutdown_connections 2024-08-31T05:32:30.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.550+0000 7ff07c32f740 1 --2- 172.21.15.5:0/261243831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1233bc350 0x55f12376b0b0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:30.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.550+0000 7ff07c32f740 1 --2- 172.21.15.5:0/261243831 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f12339b670 0x55f12377a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:30.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.550+0000 7ff07c32f740 1 --2- 172.21.15.5:0/261243831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f123393490 0x55f123763ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:30.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.550+0000 7ff07c32f740 1 -- 172.21.15.5:0/261243831 >> 172.21.15.5:0/261243831 conn(0x55f1233b0740 msgr2=0x55f1237637b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:30.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.550+0000 7ff07c32f740 1 -- 172.21.15.5:0/261243831 shutdown_connections 2024-08-31T05:32:30.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.550+0000 7ff07c32f740 1 -- 172.21.15.5:0/261243831 wait complete. 2024-08-31T05:32:30.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.550+0000 7ff07c32f740 1 -- start start 2024-08-31T05:32:30.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.550+0000 7ff07c32f740 1 Processor -- start 2024-08-31T05:32:30.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.551+0000 7ff07c32f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f123393490 0x55f1237766b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:30.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.551+0000 7ff07c32f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f12339b670 0x55f123772bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:30.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.551+0000 7ff07c32f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1233bc350 0x55f123773100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:30.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.551+0000 7ff07c32f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff0701afdb0 con 0x55f1233bc350 2024-08-31T05:32:30.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.551+0000 7ff07c32f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff0701af6e0 con 0x55f123393490 2024-08-31T05:32:30.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.551+0000 7ff07c32f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff0701ac920 con 0x55f12339b670 2024-08-31T05:32:30.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.551+0000 7ff07c32f740 10 client.0 _ll_register_callbacks cb 0x7ff068009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:32:30.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.551+0000 7ff06effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f12339b670 0x55f123772bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:30.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.551+0000 7ff06f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f123393490 0x55f1237766b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:30.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.551+0000 7ff06effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f12339b670 0x55f123772bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:56042/0 (socket says 172.21.15.5:56042) 2024-08-31T05:32:30.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.551+0000 7ff06effd640 1 -- 172.21.15.5:0/679019724 learned_addr learned my addr 172.21.15.5:0/679019724 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:30.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.551+0000 7ff06ffff640 1 --2- 172.21.15.5:0/679019724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1233bc350 0x55f123773100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:30.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.551+0000 7ff06f7fe640 1 -- 172.21.15.5:0/679019724 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f12339b670 msgr2=0x55f123772bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:30.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.551+0000 7ff06f7fe640 1 --2- 172.21.15.5:0/679019724 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f12339b670 0x55f123772bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:30.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.551+0000 7ff06f7fe640 1 -- 172.21.15.5:0/679019724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1233bc350 msgr2=0x55f123773100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:30.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.551+0000 7ff06f7fe640 1 --2- 172.21.15.5:0/679019724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1233bc350 0x55f123773100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:30.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.551+0000 7ff06f7fe640 1 -- 172.21.15.5:0/679019724 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f123773640 con 0x55f123393490 2024-08-31T05:32:30.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.551+0000 7ff06effd640 1 --2- 172.21.15.5:0/679019724 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f12339b670 0x55f123772bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:32:30.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.551+0000 7ff06ffff640 1 --2- 172.21.15.5:0/679019724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1233bc350 0x55f123773100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:32:30.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.552+0000 7ff06f7fe640 1 --2- 172.21.15.5:0/679019724 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f123393490 0x55f1237766b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff060103000 tx=0x7ff06003b4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5efa3dc701f4188b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:30.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.552+0000 7ff04effd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:32:30.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.552+0000 7ff04effd640 1 -- 172.21.15.5:0/679019724 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff060049040 con 0x55f123393490 2024-08-31T05:32:30.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.552+0000 7ff04effd640 1 -- 172.21.15.5:0/679019724 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7ff0600c82e0 con 0x55f123393490 2024-08-31T05:32:30.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.552+0000 7ff07c32f740 1 -- 172.21.15.5:0/679019724 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff068004cc0 con 0x55f123393490 2024-08-31T05:32:30.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.552+0000 7ff04effd640 1 -- 172.21.15.5:0/679019724 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff0600cb7c0 con 0x55f123393490 2024-08-31T05:32:30.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.552+0000 7ff07c32f740 10 client.25862 fetch_fsmap learned FSMap version 32 2024-08-31T05:32:30.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.552+0000 7ff07c32f740 1 -- 172.21.15.5:0/679019724 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55f1237eb570 con 0x55f123393490 2024-08-31T05:32:30.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.552+0000 7ff04effd640 1 -- 172.21.15.5:0/679019724 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff068004cc0 con 0x55f123393490 2024-08-31T05:32:30.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.552+0000 7ff04effd640 1 -- 172.21.15.5:0/679019724 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7ff0600d0450 con 0x55f123393490 2024-08-31T05:32:30.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.552+0000 7ff07c32f740 10 client.25862 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:32:30.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.552+0000 7ff07c32f740 10 client.25862 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:32:30.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.552+0000 7ff07c32f740 20 client.25862 populate_metadata read hostname 'smithi005' 2024-08-31T05:32:30.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.552+0000 7ff07c32f740 1 --2- 172.21.15.5:0/679019724 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55f123350080 0x55f1237edda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:30.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.552+0000 7ff07c32f740 4 client.25862 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T05:32:30.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.552+0000 7ff07c32f740 1 -- 172.21.15.5:0/679019724 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f1236d5fe0 con 0x55f123350080 2024-08-31T05:32:30.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.553+0000 7ff06effd640 1 --2- 172.21.15.5:0/679019724 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55f123350080 0x55f1237edda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:30.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.553+0000 7ff04effd640 10 client.25862 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:32:30.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.553+0000 7ff06effd640 1 --2- 172.21.15.5:0/679019724 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55f123350080 0x55f1237edda0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=958412e3cdda86d1 server_cookie=9b3442da1b538d68 in_seq=0 out_seq=0 2024-08-31T05:32:30.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.555+0000 7ff04effd640 1 -- 172.21.15.5:0/679019724 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f1236d5fe0 con 0x55f123350080 2024-08-31T05:32:30.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.555+0000 7ff04effd640 10 client.25862 handle_command_reply: tid=0 2024-08-31T05:32:30.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.555+0000 7ff07c32f740 1 client.25862 shutdown 2024-08-31T05:32:30.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.555+0000 7ff07c32f740 1 -- 172.21.15.5:0/679019724 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f123393490 msgr2=0x55f1237766b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:30.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.555+0000 7ff07c32f740 1 --2- 172.21.15.5:0/679019724 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f123393490 0x55f1237766b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff060103000 tx=0x7ff06003b4f0 comp rx=0 tx=0).stop 2024-08-31T05:32:30.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.555+0000 7ff07c32f740 1 -- 172.21.15.5:0/679019724 shutdown_connections 2024-08-31T05:32:30.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.555+0000 7ff07c32f740 1 --2- 172.21.15.5:0/679019724 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55f123350080 0x55f1237edda0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:30.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.555+0000 7ff07c32f740 1 --2- 172.21.15.5:0/679019724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1233bc350 0x55f123773100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:30.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.555+0000 7ff07c32f740 1 --2- 172.21.15.5:0/679019724 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f12339b670 0x55f123772bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:30.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.555+0000 7ff07c32f740 1 --2- 172.21.15.5:0/679019724 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f123393490 0x55f1237766b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:30.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.555+0000 7ff07c32f740 1 -- 172.21.15.5:0/679019724 >> 172.21.15.5:0/679019724 conn(0x55f1233b0740 msgr2=0x55f12376fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:30.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.555+0000 7ff04effd640 0 client.25862 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:32:30.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.555+0000 7ff07c32f740 1 -- 172.21.15.5:0/679019724 shutdown_connections 2024-08-31T05:32:30.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.555+0000 7ff07c32f740 1 -- 172.21.15.5:0/679019724 wait complete. 2024-08-31T05:32:30.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.556+0000 7ff07c32f740 20 client.25862 trim_cache size 0 max 16384 2024-08-31T05:32:30.562 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:32:30.562 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-08-31T05:32:30.563 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "728a42ca-bbef-4151-830f-5fdd411d8fa0", 2024-08-31T05:32:30.563 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-08-31T05:32:30.563 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:32:30.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.556+0000 7ff075dba640 1 -- 172.21.15.5:0/335946155 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff0580b4ca0 msgr2=0x7ff0580b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:30.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.556+0000 7ff075dba640 1 --2- 172.21.15.5:0/335946155 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff0580b4ca0 0x7ff0580b71b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff068003de0 tx=0x7ff068009500 comp rx=0 tx=0).stop 2024-08-31T05:32:30.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.556+0000 7ff075dba640 1 -- 172.21.15.5:0/335946155 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0701047d0 msgr2=0x7ff07019a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:30.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.556+0000 7ff075dba640 1 --2- 172.21.15.5:0/335946155 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0701047d0 0x7ff07019a280 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff060005940 tx=0x7ff0600040c0 comp rx=0 tx=0).stop 2024-08-31T05:32:30.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.556+0000 7ff075dba640 1 -- 172.21.15.5:0/335946155 shutdown_connections 2024-08-31T05:32:30.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.556+0000 7ff075dba640 1 --2- 172.21.15.5:0/335946155 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff0580b4ca0 0x7ff0580b71b0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:30.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.556+0000 7ff075dba640 1 --2- 172.21.15.5:0/335946155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff07010dc30 0x7ff07019fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:30.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.556+0000 7ff075dba640 1 --2- 172.21.15.5:0/335946155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff070105120 0x7ff07019a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:30.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.556+0000 7ff075dba640 1 --2- 172.21.15.5:0/335946155 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0701047d0 0x7ff07019a280 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:30.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.556+0000 7ff075dba640 1 -- 172.21.15.5:0/335946155 >> 172.21.15.5:0/335946155 conn(0x7ff070079510 msgr2=0x7ff0701003d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:30.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.557+0000 7ff075dba640 1 -- 172.21.15.5:0/335946155 shutdown_connections 2024-08-31T05:32:30.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:30.557+0000 7ff075dba640 1 -- 172.21.15.5:0/335946155 wait complete. 2024-08-31T05:32:30.910 INFO:tasks.workunit.client.0.smithi005.stdout: 1 200298 14.06 MB/sec warmup 78 sec latency 98.162 ms 2024-08-31T05:32:31.357 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T05:32:31.379 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:32:31 smithi005 ceph-mon[18602]: pgmap v421: 129 pgs: 129 active+clean; 105 MiB data, 811 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.3 MiB/s wr, 306 op/s 2024-08-31T05:32:31.379 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:32:31 smithi005 ceph-mon[18602]: scrub summary: active paths [/] 2024-08-31T05:32:31.379 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:32:31 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:32:31.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:32:31 smithi070 ceph-mon[22316]: pgmap v421: 129 pgs: 129 active+clean; 105 MiB data, 811 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.3 MiB/s wr, 306 op/s 2024-08-31T05:32:31.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:32:31 smithi070 ceph-mon[22316]: scrub summary: active paths [/] 2024-08-31T05:32:31.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:32:31 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:32:31.629 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:32:31.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:32:31 smithi050 ceph-mon[22146]: pgmap v421: 129 pgs: 129 active+clean; 105 MiB data, 811 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.3 MiB/s wr, 306 op/s 2024-08-31T05:32:31.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:32:31 smithi050 ceph-mon[22146]: scrub summary: active paths [/] 2024-08-31T05:32:31.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:32:31 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:32:31.910 INFO:tasks.workunit.client.0.smithi005.stdout: 1 202862 14.06 MB/sec warmup 79 sec latency 24.172 ms 2024-08-31T05:32:32.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.149+0000 7f4bcd587640 1 -- 172.21.15.5:0/3593473841 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bc8108160 msgr2=0x7f4bc8108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:32.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.149+0000 7f4bcd587640 1 --2- 172.21.15.5:0/3593473841 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bc8108160 0x7f4bc8108570 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc009900 tx=0x7f4bbc02a410 comp rx=0 tx=0).stop 2024-08-31T05:32:32.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.149+0000 7f4bcd587640 1 -- 172.21.15.5:0/3593473841 shutdown_connections 2024-08-31T05:32:32.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.149+0000 7f4bcd587640 1 --2- 172.21.15.5:0/3593473841 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4bc8108ab0 0x7f4bc810f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.149+0000 7f4bcd587640 1 --2- 172.21.15.5:0/3593473841 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bc8108160 0x7f4bc8108570 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.149+0000 7f4bcd587640 1 --2- 172.21.15.5:0/3593473841 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bc8102870 0x7f4bc8102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.149+0000 7f4bcd587640 1 -- 172.21.15.5:0/3593473841 >> 172.21.15.5:0/3593473841 conn(0x7f4bc8079470 msgr2=0x7f4bc8079880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:32.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.149+0000 7f4bcd587640 1 -- 172.21.15.5:0/3593473841 shutdown_connections 2024-08-31T05:32:32.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.149+0000 7f4bcd587640 1 -- 172.21.15.5:0/3593473841 wait complete. 2024-08-31T05:32:32.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.150+0000 7f4bcd587640 1 Processor -- start 2024-08-31T05:32:32.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.150+0000 7f4bcd587640 1 -- start start 2024-08-31T05:32:32.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.150+0000 7f4bcd587640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4bc8102870 0x7f4bc819a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:32.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.151+0000 7f4bcd587640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bc8108160 0x7f4bc819a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:32.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.151+0000 7f4bcd587640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bc8108ab0 0x7f4bc819fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:32.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.151+0000 7f4bcd587640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc8112740 con 0x7f4bc8108ab0 2024-08-31T05:32:32.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.151+0000 7f4bcd587640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc81125c0 con 0x7f4bc8108160 2024-08-31T05:32:32.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.151+0000 7f4bcd587640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc81128c0 con 0x7f4bc8102870 2024-08-31T05:32:32.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.151+0000 7f4bc77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bc8108ab0 0x7f4bc819fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:32.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.151+0000 7f4bc67fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bc8108160 0x7f4bc819a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:32.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.151+0000 7f4bc6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4bc8102870 0x7f4bc819a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:32.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.151+0000 7f4bc67fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bc8108160 0x7f4bc819a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:43530/0 (socket says 172.21.15.5:43530) 2024-08-31T05:32:32.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.151+0000 7f4bc67fc640 1 -- 172.21.15.5:0/298481650 learned_addr learned my addr 172.21.15.5:0/298481650 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:32.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.151+0000 7f4bc6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4bc8102870 0x7f4bc819a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:37656/0 (socket says 172.21.15.5:37656) 2024-08-31T05:32:32.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.151+0000 7f4bc6ffd640 1 -- 172.21.15.5:0/298481650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bc8108160 msgr2=0x7f4bc819a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:32.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.151+0000 7f4bc6ffd640 1 --2- 172.21.15.5:0/298481650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bc8108160 0x7f4bc819a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.151+0000 7f4bc6ffd640 1 -- 172.21.15.5:0/298481650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bc8108ab0 msgr2=0x7f4bc819fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:32.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.151+0000 7f4bc6ffd640 1 --2- 172.21.15.5:0/298481650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bc8108ab0 0x7f4bc819fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.151+0000 7f4bc6ffd640 1 -- 172.21.15.5:0/298481650 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bc81a0270 con 0x7f4bc8102870 2024-08-31T05:32:32.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.151+0000 7f4bc6ffd640 1 --2- 172.21.15.5:0/298481650 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4bc8102870 0x7f4bc819a300 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4bb800e9f0 tx=0x7f4bb800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:32.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.151+0000 7f4baffff640 1 -- 172.21.15.5:0/298481650 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb800ccc0 con 0x7f4bc8102870 2024-08-31T05:32:32.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.152+0000 7f4baffff640 1 -- 172.21.15.5:0/298481650 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4bb80108e0 con 0x7f4bc8102870 2024-08-31T05:32:32.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.152+0000 7f4bcd587640 1 -- 172.21.15.5:0/298481650 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bc81a0560 con 0x7f4bc8102870 2024-08-31T05:32:32.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.152+0000 7f4baffff640 1 -- 172.21.15.5:0/298481650 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb8018880 con 0x7f4bc8102870 2024-08-31T05:32:32.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.152+0000 7f4bcd587640 1 -- 172.21.15.5:0/298481650 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bc81a6cc0 con 0x7f4bc8102870 2024-08-31T05:32:32.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.154+0000 7f4bd3afc740 1 Processor -- start 2024-08-31T05:32:32.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.154+0000 7f4bd3afc740 1 -- start start 2024-08-31T05:32:32.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.155+0000 7f4baffff640 1 -- 172.21.15.5:0/298481650 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f4bb8018a20 con 0x7f4bc8102870 2024-08-31T05:32:32.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.155+0000 7f4bd3afc740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654c1519070 0x5654c18be2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:32.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.155+0000 7f4bd3afc740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654c14f01b0 0x5654c18be800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:32.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.155+0000 7f4bd3afc740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654c14f8390 0x5654c18bed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:32.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.155+0000 7f4bd3afc740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5654c1835630 con 0x5654c14f8390 2024-08-31T05:32:32.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.155+0000 7f4bd3afc740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5654c1824bc0 con 0x5654c1519070 2024-08-31T05:32:32.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.155+0000 7f4bd3afc740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5654c1828b70 con 0x5654c14f01b0 2024-08-31T05:32:32.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.155+0000 7f4bc67fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654c14f8390 0x5654c18bed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:32.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.155+0000 7f4bc6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654c14f01b0 0x5654c18be800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:32.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.155+0000 7f4bc67fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654c14f8390 0x5654c18bed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46056/0 (socket says 172.21.15.5:46056) 2024-08-31T05:32:32.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.155+0000 7f4bc6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654c14f01b0 0x5654c18be800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:37664/0 (socket says 172.21.15.5:37664) 2024-08-31T05:32:32.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.155+0000 7f4bc67fc640 1 -- 172.21.15.5:0/3534960557 learned_addr learned my addr 172.21.15.5:0/3534960557 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:32.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.155+0000 7f4bc77fe640 1 --2- 172.21.15.5:0/3534960557 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654c1519070 0x5654c18be2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:32.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.155+0000 7f4bc67fc640 1 -- 172.21.15.5:0/3534960557 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654c14f01b0 msgr2=0x5654c18be800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:32.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.155+0000 7f4bc67fc640 1 --2- 172.21.15.5:0/3534960557 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654c14f01b0 0x5654c18be800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.155+0000 7f4bc67fc640 1 -- 172.21.15.5:0/3534960557 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654c1519070 msgr2=0x5654c18be2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:32.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.155+0000 7f4bc67fc640 1 --2- 172.21.15.5:0/3534960557 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654c1519070 0x5654c18be2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.155+0000 7f4bc67fc640 1 -- 172.21.15.5:0/3534960557 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654c1584650 con 0x5654c14f8390 2024-08-31T05:32:32.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.156+0000 7f4baffff640 1 --2- 172.21.15.5:0/298481650 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4bb00b90b0 0x7f4bb00bb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:32.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.156+0000 7f4bc67fc640 1 --2- 172.21.15.5:0/3534960557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654c14f8390 0x5654c18bed40 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc009230 tx=0x7f4bbc031b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5793d1e17522701d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:32.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.156+0000 7f4bc77fe640 1 --2- 172.21.15.5:0/298481650 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4bb00b90b0 0x7f4bb00bb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:32.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.156+0000 7f4baffff640 1 -- 172.21.15.5:0/298481650 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f4bb80e5a80 con 0x7f4bc8102870 2024-08-31T05:32:32.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.156+0000 7f4bad7fa640 1 -- 172.21.15.5:0/3534960557 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc040070 con 0x5654c14f8390 2024-08-31T05:32:32.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.156+0000 7f4bad7fa640 1 -- 172.21.15.5:0/3534960557 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4bbc004030 con 0x5654c14f8390 2024-08-31T05:32:32.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.156+0000 7f4bad7fa640 1 -- 172.21.15.5:0/3534960557 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc035040 con 0x5654c14f8390 2024-08-31T05:32:32.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.157+0000 7f4bd3afc740 1 -- 172.21.15.5:0/3534960557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654c14f8390 msgr2=0x5654c18bed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:32.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.157+0000 7f4bd3afc740 1 --2- 172.21.15.5:0/3534960557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654c14f8390 0x5654c18bed40 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc009230 tx=0x7f4bbc031b10 comp rx=0 tx=0).stop 2024-08-31T05:32:32.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.157+0000 7f4bc77fe640 1 --2- 172.21.15.5:0/298481650 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4bb00b90b0 0x7f4bb00bb5c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0005fd0 tx=0x7f4bc0009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:32.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.157+0000 7f4bd3afc740 1 -- 172.21.15.5:0/3534960557 shutdown_connections 2024-08-31T05:32:32.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.157+0000 7f4bd3afc740 1 --2- 172.21.15.5:0/3534960557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654c14f8390 0x5654c18bed40 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.157+0000 7f4bd3afc740 1 --2- 172.21.15.5:0/3534960557 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654c14f01b0 0x5654c18be800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.157+0000 7f4bd3afc740 1 --2- 172.21.15.5:0/3534960557 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654c1519070 0x5654c18be2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.157+0000 7f4bd3afc740 1 -- 172.21.15.5:0/3534960557 >> 172.21.15.5:0/3534960557 conn(0x5654c150d460 msgr2=0x5654c18bc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:32.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.157+0000 7f4bd3afc740 1 -- 172.21.15.5:0/3534960557 shutdown_connections 2024-08-31T05:32:32.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.157+0000 7f4bd3afc740 1 -- 172.21.15.5:0/3534960557 wait complete. 2024-08-31T05:32:32.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.158+0000 7f4bd3afc740 1 -- start start 2024-08-31T05:32:32.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.158+0000 7f4bd3afc740 1 Processor -- start 2024-08-31T05:32:32.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.158+0000 7f4bd3afc740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654c14f01b0 0x5654c18c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:32.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.158+0000 7f4bd3afc740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654c14f8390 0x5654c18c9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:32.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.158+0000 7f4bd3afc740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654c1519070 0x5654c18d5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:32.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.158+0000 7f4bd3afc740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5654c1687700 con 0x5654c14f8390 2024-08-31T05:32:32.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.158+0000 7f4bd3afc740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5654c17ab700 con 0x5654c1519070 2024-08-31T05:32:32.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.158+0000 7f4bd3afc740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5654c18cca40 con 0x5654c14f01b0 2024-08-31T05:32:32.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.158+0000 7f4bd3afc740 10 client.0 _ll_register_callbacks cb 0x5654c17dadc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:32:32.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.159+0000 7f4bc67fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654c14f8390 0x5654c18c9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:32.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.159+0000 7f4bc67fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654c14f8390 0x5654c18c9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46068/0 (socket says 172.21.15.5:46068) 2024-08-31T05:32:32.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.159+0000 7f4bc6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654c14f01b0 0x5654c18c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:32.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.159+0000 7f4bc67fc640 1 -- 172.21.15.5:0/1184241140 learned_addr learned my addr 172.21.15.5:0/1184241140 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:32.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.159+0000 7f4bc77fe640 1 --2- 172.21.15.5:0/1184241140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654c1519070 0x5654c18d5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:32.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.159+0000 7f4bc6ffd640 1 -- 172.21.15.5:0/1184241140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654c1519070 msgr2=0x5654c18d5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:32.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.159+0000 7f4bc6ffd640 1 --2- 172.21.15.5:0/1184241140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654c1519070 0x5654c18d5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.159+0000 7f4bc6ffd640 1 -- 172.21.15.5:0/1184241140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654c14f8390 msgr2=0x5654c18c9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:32.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.159+0000 7f4bc6ffd640 1 --2- 172.21.15.5:0/1184241140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654c14f8390 0x5654c18c9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.159+0000 7f4bc6ffd640 1 -- 172.21.15.5:0/1184241140 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654c17e48b0 con 0x5654c14f01b0 2024-08-31T05:32:32.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.159+0000 7f4bc77fe640 1 --2- 172.21.15.5:0/1184241140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654c1519070 0x5654c18d5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:32:32.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.159+0000 7f4bc67fc640 1 --2- 172.21.15.5:0/1184241140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654c14f8390 0x5654c18c9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:32:32.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.159+0000 7f4bc6ffd640 1 --2- 172.21.15.5:0/1184241140 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654c14f01b0 0x5654c18c9a00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4bb80e2e50 tx=0x7f4bb80e91c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7bf0b5f080b07065 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:32.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.159+0000 7f4baaff5640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:32:32.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.159+0000 7f4baaff5640 1 -- 172.21.15.5:0/1184241140 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb80ed040 con 0x5654c14f01b0 2024-08-31T05:32:32.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.159+0000 7f4baaff5640 1 -- 172.21.15.5:0/1184241140 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f4bb80ab100 con 0x5654c14f01b0 2024-08-31T05:32:32.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.159+0000 7f4bd3afc740 1 -- 172.21.15.5:0/1184241140 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4bbc004030 con 0x5654c14f01b0 2024-08-31T05:32:32.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.160+0000 7f4baaff5640 1 -- 172.21.15.5:0/1184241140 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f4bb80abc70 con 0x5654c14f01b0 2024-08-31T05:32:32.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.160+0000 7f4bd3afc740 10 client.25885 fetch_fsmap learned FSMap version 32 2024-08-31T05:32:32.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.160+0000 7f4bd3afc740 1 -- 172.21.15.5:0/1184241140 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5654c18d87e0 con 0x5654c14f01b0 2024-08-31T05:32:32.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.160+0000 7f4baaff5640 1 -- 172.21.15.5:0/1184241140 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4bbc004030 con 0x5654c14f01b0 2024-08-31T05:32:32.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.160+0000 7f4baaff5640 1 -- 172.21.15.5:0/1184241140 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f4bb80b0250 con 0x5654c14f01b0 2024-08-31T05:32:32.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.160+0000 7f4bd3afc740 10 client.25885 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:32:32.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.160+0000 7f4bd3afc740 10 client.25885 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:32:32.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.160+0000 7f4bd3afc740 20 client.25885 populate_metadata read hostname 'smithi005' 2024-08-31T05:32:32.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.160+0000 7f4bd3afc740 1 --2- 172.21.15.5:0/1184241140 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5654c14d79f0 0x5654c18dbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:32.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.160+0000 7f4bd3afc740 4 client.25885 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:32:32.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.160+0000 7f4bd3afc740 1 -- 172.21.15.5:0/1184241140 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5654c1837580 con 0x5654c14d79f0 2024-08-31T05:32:32.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.160+0000 7f4bc67fc640 1 --2- 172.21.15.5:0/1184241140 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5654c14d79f0 0x5654c18dbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:32.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.161+0000 7f4baaff5640 10 client.25885 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:32:32.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.161+0000 7f4bc67fc640 1 --2- 172.21.15.5:0/1184241140 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5654c14d79f0 0x5654c18dbe50 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ecb9bb3cf8841b97 server_cookie=6e31be9eceee303d in_seq=0 out_seq=0 2024-08-31T05:32:32.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.161+0000 7f4baaff5640 1 -- 172.21.15.5:0/1184241140 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5654c1837580 con 0x5654c14d79f0 2024-08-31T05:32:32.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.161+0000 7f4baaff5640 10 client.25885 handle_command_reply: tid=0 2024-08-31T05:32:32.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.161+0000 7f4bd3afc740 1 client.25885 shutdown 2024-08-31T05:32:32.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.162+0000 7f4bd3afc740 1 -- 172.21.15.5:0/1184241140 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654c14f01b0 msgr2=0x5654c18c9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:32.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.162+0000 7f4bd3afc740 1 --2- 172.21.15.5:0/1184241140 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654c14f01b0 0x5654c18c9a00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4bb80e2e50 tx=0x7f4bb80e91c0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.162+0000 7f4bd3afc740 1 -- 172.21.15.5:0/1184241140 shutdown_connections 2024-08-31T05:32:32.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.162+0000 7f4bd3afc740 1 --2- 172.21.15.5:0/1184241140 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5654c14d79f0 0x5654c18dbe50 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.162+0000 7f4bd3afc740 1 --2- 172.21.15.5:0/1184241140 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654c1519070 0x5654c18d5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.162+0000 7f4bd3afc740 1 --2- 172.21.15.5:0/1184241140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654c14f8390 0x5654c18c9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.162+0000 7f4baaff5640 0 client.25885 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:32:32.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.162+0000 7f4bd3afc740 1 --2- 172.21.15.5:0/1184241140 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654c14f01b0 0x5654c18c9a00 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.162+0000 7f4bd3afc740 1 -- 172.21.15.5:0/1184241140 >> 172.21.15.5:0/1184241140 conn(0x5654c150d460 msgr2=0x5654c18c1450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:32.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.162+0000 7f4bd3afc740 1 -- 172.21.15.5:0/1184241140 shutdown_connections 2024-08-31T05:32:32.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.162+0000 7f4bd3afc740 1 -- 172.21.15.5:0/1184241140 wait complete. 2024-08-31T05:32:32.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.162+0000 7f4bd3afc740 20 client.25885 trim_cache size 0 max 16384 2024-08-31T05:32:32.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.182+0000 7f4bd3afc740 1 Processor -- start 2024-08-31T05:32:32.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.182+0000 7f4bd3afc740 1 -- start start 2024-08-31T05:32:32.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.182+0000 7f4bd3afc740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654c14f01b0 0x5654c18c1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:32.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.182+0000 7f4bd3afc740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654c14f8390 0x5654c18c9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:32.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.182+0000 7f4bd3afc740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654c1519070 0x5654c18c6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:32.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.182+0000 7f4bd3afc740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb400ff40 con 0x5654c1519070 2024-08-31T05:32:32.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.182+0000 7f4bd3afc740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb4011b40 con 0x5654c14f8390 2024-08-31T05:32:32.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.182+0000 7f4bd3afc740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb4010610 con 0x5654c14f01b0 2024-08-31T05:32:32.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.182+0000 7f4bc67fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654c14f8390 0x5654c18c9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:32.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.182+0000 7f4bc6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654c14f01b0 0x5654c18c1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:32.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.182+0000 7f4bc77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654c1519070 0x5654c18c6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:32.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.182+0000 7f4bc6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654c14f01b0 0x5654c18c1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:37694/0 (socket says 172.21.15.5:37694) 2024-08-31T05:32:32.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.182+0000 7f4bc67fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654c14f8390 0x5654c18c9970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:43562/0 (socket says 172.21.15.5:43562) 2024-08-31T05:32:32.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.182+0000 7f4bc6ffd640 1 -- 172.21.15.5:0/3511356554 learned_addr learned my addr 172.21.15.5:0/3511356554 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:32.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.183+0000 7f4bc67fc640 1 -- 172.21.15.5:0/3511356554 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654c14f01b0 msgr2=0x5654c18c1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:32.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.183+0000 7f4bc67fc640 1 --2- 172.21.15.5:0/3511356554 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654c14f01b0 0x5654c18c1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.183+0000 7f4bc67fc640 1 -- 172.21.15.5:0/3511356554 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654c1519070 msgr2=0x5654c18c6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:32.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.183+0000 7f4bc67fc640 1 --2- 172.21.15.5:0/3511356554 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654c1519070 0x5654c18c6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.183+0000 7f4bc67fc640 1 -- 172.21.15.5:0/3511356554 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654c18c8960 con 0x5654c14f8390 2024-08-31T05:32:32.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.183+0000 7f4bc6ffd640 1 --2- 172.21.15.5:0/3511356554 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654c14f01b0 0x5654c18c1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:32:32.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.183+0000 7f4bc67fc640 1 --2- 172.21.15.5:0/3511356554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654c14f8390 0x5654c18c9970 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc0095a0 tx=0x7f4bbc0051a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=220e030f839e7736 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:32.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.183+0000 7f4bacff9640 1 -- 172.21.15.5:0/3511356554 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc040040 con 0x5654c14f8390 2024-08-31T05:32:32.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.183+0000 7f4bacff9640 1 -- 172.21.15.5:0/3511356554 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4bbc031950 con 0x5654c14f8390 2024-08-31T05:32:32.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.183+0000 7f4bacff9640 1 -- 172.21.15.5:0/3511356554 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc035040 con 0x5654c14f8390 2024-08-31T05:32:32.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.184+0000 7f4bd3afc740 1 -- 172.21.15.5:0/3511356554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654c14f8390 msgr2=0x5654c18c9970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:32.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.184+0000 7f4bd3afc740 1 --2- 172.21.15.5:0/3511356554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654c14f8390 0x5654c18c9970 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc0095a0 tx=0x7f4bbc0051a0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.184+0000 7f4bd3afc740 1 -- 172.21.15.5:0/3511356554 shutdown_connections 2024-08-31T05:32:32.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.184+0000 7f4bd3afc740 1 --2- 172.21.15.5:0/3511356554 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654c1519070 0x5654c18c6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.184+0000 7f4bd3afc740 1 --2- 172.21.15.5:0/3511356554 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654c14f8390 0x5654c18c9970 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.184+0000 7f4bd3afc740 1 --2- 172.21.15.5:0/3511356554 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654c14f01b0 0x5654c18c1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.184+0000 7f4bd3afc740 1 -- 172.21.15.5:0/3511356554 >> 172.21.15.5:0/3511356554 conn(0x5654c150d460 msgr2=0x5654c18c13c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:32.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.184+0000 7f4bd3afc740 1 -- 172.21.15.5:0/3511356554 shutdown_connections 2024-08-31T05:32:32.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.184+0000 7f4bd3afc740 1 -- 172.21.15.5:0/3511356554 wait complete. 2024-08-31T05:32:32.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.185+0000 7f4bd3afc740 1 -- start start 2024-08-31T05:32:32.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.185+0000 7f4bd3afc740 1 Processor -- start 2024-08-31T05:32:32.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.185+0000 7f4bd3afc740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654c14f01b0 0x5654c18cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:32.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.185+0000 7f4bd3afc740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654c14f8390 0x5654c18ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:32.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.185+0000 7f4bd3afc740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654c1519070 0x5654c1945810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:32.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.185+0000 7f4bd3afc740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb40113b0 con 0x5654c1519070 2024-08-31T05:32:32.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.185+0000 7f4bd3afc740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb4010ce0 con 0x5654c14f01b0 2024-08-31T05:32:32.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.185+0000 7f4bd3afc740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb400df20 con 0x5654c14f8390 2024-08-31T05:32:32.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.185+0000 7f4bc77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654c1519070 0x5654c1945810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:32.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.185+0000 7f4bc67fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654c14f8390 0x5654c18ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:32.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.185+0000 7f4bc67fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654c14f8390 0x5654c18ce4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:37710/0 (socket says 172.21.15.5:37710) 2024-08-31T05:32:32.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.185+0000 7f4bc77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654c1519070 0x5654c1945810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46084/0 (socket says 172.21.15.5:46084) 2024-08-31T05:32:32.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.185+0000 7f4bc67fc640 1 -- 172.21.15.5:0/3977538798 learned_addr learned my addr 172.21.15.5:0/3977538798 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:32.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.185+0000 7f4bc6ffd640 1 --2- 172.21.15.5:0/3977538798 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654c14f01b0 0x5654c18cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:32.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.185+0000 7f4bd3afc740 10 client.0 _ll_register_callbacks cb 0x7f4bb80e92c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:32:32.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.186+0000 7f4bc6ffd640 1 -- 172.21.15.5:0/3977538798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654c14f8390 msgr2=0x5654c18ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:32.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.186+0000 7f4bc6ffd640 1 --2- 172.21.15.5:0/3977538798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654c14f8390 0x5654c18ce4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.186+0000 7f4bc6ffd640 1 -- 172.21.15.5:0/3977538798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654c1519070 msgr2=0x5654c1945810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:32.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.186+0000 7f4bc6ffd640 1 --2- 172.21.15.5:0/3977538798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654c1519070 0x5654c1945810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.186+0000 7f4bc6ffd640 1 -- 172.21.15.5:0/3977538798 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654c18ced20 con 0x5654c14f01b0 2024-08-31T05:32:32.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.186+0000 7f4bc67fc640 1 --2- 172.21.15.5:0/3977538798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654c14f8390 0x5654c18ce4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:32:32.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.186+0000 7f4bc77fe640 1 --2- 172.21.15.5:0/3977538798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654c1519070 0x5654c1945810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:32:32.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.186+0000 7f4bc6ffd640 1 --2- 172.21.15.5:0/3977538798 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654c14f01b0 0x5654c18cdf90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4bb800e9c0 tx=0x7f4bb80ab4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd416e8ed080855e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:32.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.186+0000 7f4baaff5640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:32:32.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.187+0000 7f4baaff5640 1 -- 172.21.15.5:0/3977538798 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb800ce60 con 0x5654c14f01b0 2024-08-31T05:32:32.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.187+0000 7f4bd3afc740 1 -- 172.21.15.5:0/3977538798 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5654c1833020 con 0x5654c14f01b0 2024-08-31T05:32:32.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.188+0000 7f4baaff5640 1 -- 172.21.15.5:0/3977538798 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f4bb80a8490 con 0x5654c14f01b0 2024-08-31T05:32:32.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.188+0000 7f4baaff5640 1 -- 172.21.15.5:0/3977538798 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f4bb80ab610 con 0x5654c14f01b0 2024-08-31T05:32:32.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.188+0000 7f4bd3afc740 10 client.25880 fetch_fsmap learned FSMap version 32 2024-08-31T05:32:32.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.188+0000 7f4bd3afc740 1 -- 172.21.15.5:0/3977538798 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5654c1946d30 con 0x5654c14f01b0 2024-08-31T05:32:32.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.188+0000 7f4baaff5640 1 -- 172.21.15.5:0/3977538798 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5654c1833020 con 0x5654c14f01b0 2024-08-31T05:32:32.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.188+0000 7f4baaff5640 1 -- 172.21.15.5:0/3977538798 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f4bb80aab70 con 0x5654c14f01b0 2024-08-31T05:32:32.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.188+0000 7f4bd3afc740 10 client.25880 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:32:32.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.188+0000 7f4bd3afc740 10 client.25880 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:32:32.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.188+0000 7f4bd3afc740 20 client.25880 populate_metadata read hostname 'smithi005' 2024-08-31T05:32:32.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.188+0000 7f4bd3afc740 1 --2- 172.21.15.5:0/3977538798 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5654c14acda0 0x5654c1949430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:32.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.188+0000 7f4bd3afc740 4 client.25880 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T05:32:32.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.188+0000 7f4bd3afc740 1 -- 172.21.15.5:0/3977538798 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5654c1830760 con 0x5654c14acda0 2024-08-31T05:32:32.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.189+0000 7f4bc67fc640 1 --2- 172.21.15.5:0/3977538798 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5654c14acda0 0x5654c1949430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:32.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.189+0000 7f4bc67fc640 1 --2- 172.21.15.5:0/3977538798 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5654c14acda0 0x5654c1949430 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1665567a54b6993 server_cookie=3cf507ca01d16037 in_seq=0 out_seq=0 2024-08-31T05:32:32.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.189+0000 7f4baaff5640 10 client.25880 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:32:32.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.190+0000 7f4baaff5640 1 -- 172.21.15.5:0/3977538798 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1422 (crc 0 0 0) 0x5654c1830760 con 0x5654c14acda0 2024-08-31T05:32:32.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.190+0000 7f4baaff5640 10 client.25880 handle_command_reply: tid=0 2024-08-31T05:32:32.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.190+0000 7f4bd3afc740 1 client.25880 shutdown 2024-08-31T05:32:32.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.190+0000 7f4bd3afc740 1 -- 172.21.15.5:0/3977538798 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654c14f01b0 msgr2=0x5654c18cdf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:32.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.190+0000 7f4bd3afc740 1 --2- 172.21.15.5:0/3977538798 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654c14f01b0 0x5654c18cdf90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4bb800e9c0 tx=0x7f4bb80ab4b0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.190+0000 7f4bd3afc740 1 -- 172.21.15.5:0/3977538798 shutdown_connections 2024-08-31T05:32:32.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.190+0000 7f4bd3afc740 1 --2- 172.21.15.5:0/3977538798 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5654c14acda0 0x5654c1949430 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.190+0000 7f4bd3afc740 1 --2- 172.21.15.5:0/3977538798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654c1519070 0x5654c1945810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.190+0000 7f4bd3afc740 1 --2- 172.21.15.5:0/3977538798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654c14f8390 0x5654c18ce4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.190+0000 7f4bd3afc740 1 --2- 172.21.15.5:0/3977538798 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654c14f01b0 0x5654c18cdf90 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.190+0000 7f4bd3afc740 1 -- 172.21.15.5:0/3977538798 >> 172.21.15.5:0/3977538798 conn(0x5654c150d460 msgr2=0x5654c18bf280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:32.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.190+0000 7f4baaff5640 0 client.25880 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:32:32.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.190+0000 7f4bd3afc740 1 -- 172.21.15.5:0/3977538798 shutdown_connections 2024-08-31T05:32:32.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.190+0000 7f4bd3afc740 1 -- 172.21.15.5:0/3977538798 wait complete. 2024-08-31T05:32:32.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.190+0000 7f4bd3afc740 20 client.25880 trim_cache size 0 max 16384 2024-08-31T05:32:32.196 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:32:32.196 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T05:32:32.196 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2024-08-31T05:32:32.196 INFO:teuthology.orchestra.run.smithi005.stdout: "728a42ca-bbef-4151-830f-5fdd411d8fa0": { 2024-08-31T05:32:32.196 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:32:32.196 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "728a42ca-bbef-4151-830f-5fdd411d8fa0", 2024-08-31T05:32:32.196 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2024-08-31T05:32:32.196 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:32:32.196 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:32:32.196 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_stats": { 2024-08-31T05:32:32.197 INFO:teuthology.orchestra.run.smithi005.stdout: "728a42ca-bbef-4151-830f-5fdd411d8fa0": { 2024-08-31T05:32:32.197 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:32:30.554906+0000", 2024-08-31T05:32:32.197 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:32:32.197 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:32:32.197 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:32:32.197 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:32:32.197 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:32:32.197 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:32:32.197 INFO:teuthology.orchestra.run.smithi005.stdout: "cda92ac0-b35f-47a5-a3a5-471c888462a5": { 2024-08-31T05:32:32.197 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:53.103905+0000", 2024-08-31T05:32:32.197 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:32:32.197 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:32:32.197 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:32:32.197 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:32:32.198 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:32:32.198 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:32:32.198 INFO:teuthology.orchestra.run.smithi005.stdout: "ece37b07-9ab2-45f8-bc33-2755a07aac0b": { 2024-08-31T05:32:32.198 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:31:41.782407+0000", 2024-08-31T05:32:32.198 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:32:32.198 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:32:32.198 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:32:32.198 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:32:32.198 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:32:32.198 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:32:32.198 INFO:teuthology.orchestra.run.smithi005.stdout: "75d84398-5d9c-4872-b879-2fbce045fa71": { 2024-08-31T05:32:32.198 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:06.642335+0000", 2024-08-31T05:32:32.198 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:32:32.198 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:32:32.199 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:32:32.199 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:32:32.199 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:32:32.199 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:32:32.199 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:32:32.199 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:32:32.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.191+0000 7f4bcd587640 1 -- 172.21.15.5:0/298481650 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4bb00b90b0 msgr2=0x7f4bb00bb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:32.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.191+0000 7f4bcd587640 1 --2- 172.21.15.5:0/298481650 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4bb00b90b0 0x7f4bb00bb5c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0005fd0 tx=0x7f4bc0009500 comp rx=0 tx=0).stop 2024-08-31T05:32:32.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.191+0000 7f4bcd587640 1 -- 172.21.15.5:0/298481650 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4bc8102870 msgr2=0x7f4bc819a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:32.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.191+0000 7f4bcd587640 1 --2- 172.21.15.5:0/298481650 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4bc8102870 0x7f4bc819a300 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4bb800e9f0 tx=0x7f4bb800eeb0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.191+0000 7f4bcd587640 1 -- 172.21.15.5:0/298481650 shutdown_connections 2024-08-31T05:32:32.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.191+0000 7f4bcd587640 1 --2- 172.21.15.5:0/298481650 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4bb00b90b0 0x7f4bb00bb5c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.191+0000 7f4bcd587640 1 --2- 172.21.15.5:0/298481650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bc8108ab0 0x7f4bc819fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.191+0000 7f4bcd587640 1 --2- 172.21.15.5:0/298481650 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4bc8108160 0x7f4bc819a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.191+0000 7f4bcd587640 1 --2- 172.21.15.5:0/298481650 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4bc8102870 0x7f4bc819a300 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.191+0000 7f4bcd587640 1 -- 172.21.15.5:0/298481650 >> 172.21.15.5:0/298481650 conn(0x7f4bc8079470 msgr2=0x7f4bc81019b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:32.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.191+0000 7f4bcd587640 1 -- 172.21.15.5:0/298481650 shutdown_connections 2024-08-31T05:32:32.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:32:32.191+0000 7f4bcd587640 1 -- 172.21.15.5:0/298481650 wait complete. 2024-08-31T05:32:32.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:32:32 smithi005 ceph-mon[18602]: scrub queued for path: / 2024-08-31T05:32:32.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:32:32 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:32:32.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:32:32 smithi005 ceph-mon[18602]: scrub summary: active paths [/] 2024-08-31T05:32:32.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:32:32 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:32:32.585 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:32:32 smithi070 ceph-mon[22316]: scrub queued for path: / 2024-08-31T05:32:32.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:32:32 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:32:32.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:32:32 smithi070 ceph-mon[22316]: scrub summary: active paths [/] 2024-08-31T05:32:32.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:32:32 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:32:32.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:32:32 smithi050 ceph-mon[22146]: scrub queued for path: / 2024-08-31T05:32:32.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:32:32 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:32:32.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:32:32 smithi050 ceph-mon[22146]: scrub summary: active paths [/] 2024-08-31T05:32:32.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:32:32 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:32:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.709+0000 7f64af339640 1 -- 172.21.15.5:0/2420378281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64a810db60 msgr2=0x7f64a8110050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.709+0000 7f64af339640 1 --2- 172.21.15.5:0/2420378281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64a810db60 0x7f64a8110050 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f64a0009900 tx=0x7f64a002a410 comp rx=0 tx=0).stop 2024-08-31T05:32:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.710+0000 7f64af339640 1 -- 172.21.15.5:0/2420378281 shutdown_connections 2024-08-31T05:32:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.710+0000 7f64af339640 1 --2- 172.21.15.5:0/2420378281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64a810db60 0x7f64a8110050 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.710+0000 7f64af339640 1 --2- 172.21.15.5:0/2420378281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64a8105050 0x7f64a810d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.710+0000 7f64af339640 1 --2- 172.21.15.5:0/2420378281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64a8104700 0x7f64a8104b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.710+0000 7f64af339640 1 -- 172.21.15.5:0/2420378281 >> 172.21.15.5:0/2420378281 conn(0x7f64a80fe1b0 msgr2=0x7f64a8100600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.710+0000 7f64af339640 1 -- 172.21.15.5:0/2420378281 shutdown_connections 2024-08-31T05:32:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.710+0000 7f64af339640 1 -- 172.21.15.5:0/2420378281 wait complete. 2024-08-31T05:32:32.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.710+0000 7f64af339640 1 Processor -- start 2024-08-31T05:32:32.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.710+0000 7f64af339640 1 -- start start 2024-08-31T05:32:32.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.711+0000 7f64af339640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64a8104700 0x7f64a8102430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:32.715 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.711+0000 7f64af339640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64a8105050 0x7f64a8102970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:32.715 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.711+0000 7f64af339640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64a810db60 0x7f64a8102eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:32.715 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.711+0000 7f64af339640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f64a81137d0 con 0x7f64a8105050 2024-08-31T05:32:32.715 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.711+0000 7f64af339640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f64a8113650 con 0x7f64a810db60 2024-08-31T05:32:32.715 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.711+0000 7f64af339640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f64a8113950 con 0x7f64a8104700 2024-08-31T05:32:32.715 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.711+0000 7f64ad0d5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64a8104700 0x7f64a8102430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:32.715 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.711+0000 7f64ac8d4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64a8105050 0x7f64a8102970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:32.715 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.711+0000 7f64ad0d5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64a8104700 0x7f64a8102430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:37736/0 (socket says 172.21.15.5:37736) 2024-08-31T05:32:32.715 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.711+0000 7f64ac8d4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64a8105050 0x7f64a8102970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46098/0 (socket says 172.21.15.5:46098) 2024-08-31T05:32:32.715 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.711+0000 7f64ad0d5640 1 -- 172.21.15.5:0/725108646 learned_addr learned my addr 172.21.15.5:0/725108646 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:32.715 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.711+0000 7f64ad8d6640 1 --2- 172.21.15.5:0/725108646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64a810db60 0x7f64a8102eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:32.715 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.711+0000 7f64ac8d4640 1 -- 172.21.15.5:0/725108646 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64a8104700 msgr2=0x7f64a8102430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:32.715 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.711+0000 7f64ac8d4640 1 --2- 172.21.15.5:0/725108646 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64a8104700 0x7f64a8102430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.716 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.711+0000 7f64ac8d4640 1 -- 172.21.15.5:0/725108646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64a810db60 msgr2=0x7f64a8102eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:32.716 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.711+0000 7f64ac8d4640 1 --2- 172.21.15.5:0/725108646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64a810db60 0x7f64a8102eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.716 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.711+0000 7f64ac8d4640 1 -- 172.21.15.5:0/725108646 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64a81a8460 con 0x7f64a8105050 2024-08-31T05:32:32.716 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.711+0000 7f64ad0d5640 1 --2- 172.21.15.5:0/725108646 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64a8104700 0x7f64a8102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:32:32.716 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.711+0000 7f64ac8d4640 1 --2- 172.21.15.5:0/725108646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64a8105050 0x7f64a8102970 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f64a806b560 tx=0x7f649c00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:32.716 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.712+0000 7f64a67fc640 1 -- 172.21.15.5:0/725108646 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f649c00cc40 con 0x7f64a8105050 2024-08-31T05:32:32.716 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.712+0000 7f64af339640 1 -- 172.21.15.5:0/725108646 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64a81a8750 con 0x7f64a8105050 2024-08-31T05:32:32.716 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.712+0000 7f64a67fc640 1 -- 172.21.15.5:0/725108646 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f649c00cde0 con 0x7f64a8105050 2024-08-31T05:32:32.716 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.712+0000 7f64a67fc640 1 -- 172.21.15.5:0/725108646 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f649c018760 con 0x7f64a8105050 2024-08-31T05:32:32.716 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.712+0000 7f64af339640 1 -- 172.21.15.5:0/725108646 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64a81a8cf0 con 0x7f64a8105050 2024-08-31T05:32:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.714+0000 7f64b62a6740 1 Processor -- start 2024-08-31T05:32:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.715+0000 7f64a67fc640 1 -- 172.21.15.5:0/725108646 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f649c018900 con 0x7f64a8105050 2024-08-31T05:32:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.715+0000 7f64b62a6740 1 -- start start 2024-08-31T05:32:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.715+0000 7f64b62a6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5620e60001b0 0x5620e63a3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.715+0000 7f64b62a6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620e5fd72f0 0x5620e63a4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.715+0000 7f64b62a6740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5620e5fdf4d0 0x5620e63a4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.715+0000 7f64b62a6740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5620e6319000 con 0x5620e5fdf4d0 2024-08-31T05:32:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.715+0000 7f64b62a6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5620e6308590 con 0x5620e5fd72f0 2024-08-31T05:32:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.715+0000 7f64b62a6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5620e630c540 con 0x5620e60001b0 2024-08-31T05:32:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.715+0000 7f64ad8d6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5620e60001b0 0x5620e63a3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.715+0000 7f64ac8d4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5620e5fdf4d0 0x5620e63a4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.715+0000 7f64ad8d6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5620e60001b0 0x5620e63a3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:37750/0 (socket says 172.21.15.5:37750) 2024-08-31T05:32:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.715+0000 7f64ad8d6640 1 -- 172.21.15.5:0/1143112174 learned_addr learned my addr 172.21.15.5:0/1143112174 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.715+0000 7f64ad0d5640 1 --2- 172.21.15.5:0/1143112174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620e5fd72f0 0x5620e63a4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.716+0000 7f64ad8d6640 1 -- 172.21.15.5:0/1143112174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620e5fd72f0 msgr2=0x5620e63a4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:32.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.716+0000 7f64ad8d6640 1 --2- 172.21.15.5:0/1143112174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620e5fd72f0 0x5620e63a4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.716+0000 7f64ad8d6640 1 -- 172.21.15.5:0/1143112174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5620e5fdf4d0 msgr2=0x5620e63a4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:32.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.716+0000 7f64ad8d6640 1 --2- 172.21.15.5:0/1143112174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5620e5fdf4d0 0x5620e63a4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.716+0000 7f64ad8d6640 1 -- 172.21.15.5:0/1143112174 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620e606b790 con 0x5620e60001b0 2024-08-31T05:32:32.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.716+0000 7f64ac8d4640 1 --2- 172.21.15.5:0/1143112174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5620e5fdf4d0 0x5620e63a4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:32:32.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.716+0000 7f64a67fc640 1 --2- 172.21.15.5:0/725108646 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f64900b4cd0 0x7f64900b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:32.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.716+0000 7f64ad8d6640 1 --2- 172.21.15.5:0/1143112174 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5620e60001b0 0x5620e63a3ac0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f64a0033000 tx=0x7f64a0032b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2280556fa4d1676b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:32.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.716+0000 7f64ad0d5640 1 --2- 172.21.15.5:0/725108646 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f64900b4cd0 0x7f64900b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:32.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.716+0000 7f648f7fe640 1 -- 172.21.15.5:0/1143112174 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a0035040 con 0x5620e60001b0 2024-08-31T05:32:32.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.716+0000 7f64a67fc640 1 -- 172.21.15.5:0/725108646 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f649c0e5b80 con 0x7f64a8105050 2024-08-31T05:32:32.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.716+0000 7f648f7fe640 1 -- 172.21.15.5:0/1143112174 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64a0004030 con 0x5620e60001b0 2024-08-31T05:32:32.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.716+0000 7f648f7fe640 1 -- 172.21.15.5:0/1143112174 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a0005590 con 0x5620e60001b0 2024-08-31T05:32:32.725 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.717+0000 7f64b62a6740 1 -- 172.21.15.5:0/1143112174 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5620e60001b0 msgr2=0x5620e63a3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:32.725 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.717+0000 7f64ad0d5640 1 --2- 172.21.15.5:0/725108646 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f64900b4cd0 0x7f64900b71e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x5620e63a2740 tx=0x7f6498009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:32.725 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.717+0000 7f64b62a6740 1 --2- 172.21.15.5:0/1143112174 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5620e60001b0 0x5620e63a3ac0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f64a0033000 tx=0x7f64a0032b20 comp rx=0 tx=0).stop 2024-08-31T05:32:32.725 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.717+0000 7f64b62a6740 1 -- 172.21.15.5:0/1143112174 shutdown_connections 2024-08-31T05:32:32.725 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.717+0000 7f64b62a6740 1 --2- 172.21.15.5:0/1143112174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5620e5fdf4d0 0x5620e63a4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.725 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.717+0000 7f64b62a6740 1 --2- 172.21.15.5:0/1143112174 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620e5fd72f0 0x5620e63a4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.725 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.717+0000 7f64b62a6740 1 --2- 172.21.15.5:0/1143112174 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5620e60001b0 0x5620e63a3ac0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.725 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.717+0000 7f64b62a6740 1 -- 172.21.15.5:0/1143112174 >> 172.21.15.5:0/1143112174 conn(0x5620e5ff4300 msgr2=0x5620e63a19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:32.725 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.717+0000 7f64b62a6740 1 -- 172.21.15.5:0/1143112174 shutdown_connections 2024-08-31T05:32:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.717+0000 7f64b62a6740 1 -- 172.21.15.5:0/1143112174 wait complete. 2024-08-31T05:32:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.718+0000 7f64b62a6740 1 -- start start 2024-08-31T05:32:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.718+0000 7f64b62a6740 1 Processor -- start 2024-08-31T05:32:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.718+0000 7f64b62a6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620e5fd72f0 0x5620e63af660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.718+0000 7f64b62a6740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5620e5fdf4d0 0x5620e63afba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.718+0000 7f64b62a6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5620e60001b0 0x5620e63bb500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.718+0000 7f64b62a6740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5620e6241ab0 con 0x5620e5fdf4d0 2024-08-31T05:32:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.718+0000 7f64b62a6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5620e628f680 con 0x5620e5fd72f0 2024-08-31T05:32:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.718+0000 7f64b62a6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5620e63b21e0 con 0x5620e60001b0 2024-08-31T05:32:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.718+0000 7f64b62a6740 10 client.0 _ll_register_callbacks cb 0x5620e6017a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:32:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.718+0000 7f64ac8d4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5620e5fdf4d0 0x5620e63afba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.718+0000 7f64ac8d4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5620e5fdf4d0 0x5620e63afba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46112/0 (socket says 172.21.15.5:46112) 2024-08-31T05:32:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.718+0000 7f64ac8d4640 1 -- 172.21.15.5:0/3988547711 learned_addr learned my addr 172.21.15.5:0/3988547711 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.718+0000 7f64ad0d5640 1 --2- 172.21.15.5:0/3988547711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620e5fd72f0 0x5620e63af660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.718+0000 7f64ad8d6640 1 --2- 172.21.15.5:0/3988547711 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5620e60001b0 0x5620e63bb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.719+0000 7f64ac8d4640 1 -- 172.21.15.5:0/3988547711 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5620e60001b0 msgr2=0x5620e63bb500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.719+0000 7f64ac8d4640 1 --2- 172.21.15.5:0/3988547711 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5620e60001b0 0x5620e63bb500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.719+0000 7f64ac8d4640 1 -- 172.21.15.5:0/3988547711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620e5fd72f0 msgr2=0x5620e63af660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.719+0000 7f64ac8d4640 1 --2- 172.21.15.5:0/3988547711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620e5fd72f0 0x5620e63af660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.719+0000 7f64ac8d4640 1 -- 172.21.15.5:0/3988547711 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620e60e4620 con 0x5620e5fdf4d0 2024-08-31T05:32:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.719+0000 7f64ad0d5640 1 --2- 172.21.15.5:0/3988547711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620e5fd72f0 0x5620e63af660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:32:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.719+0000 7f64ac8d4640 1 --2- 172.21.15.5:0/3988547711 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5620e5fdf4d0 0x5620e63afba0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f649c0abf30 tx=0x7f649c0ab710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d5bb490e9e8c4ae server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.719+0000 7f648cff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:32:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.719+0000 7f648cff9640 1 -- 172.21.15.5:0/3988547711 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f649c0e9030 con 0x5620e5fdf4d0 2024-08-31T05:32:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.719+0000 7f648cff9640 1 -- 172.21.15.5:0/3988547711 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f649c010a90 con 0x5620e5fdf4d0 2024-08-31T05:32:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.719+0000 7f64b62a6740 1 -- 172.21.15.5:0/3988547711 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f64a0004030 con 0x5620e5fdf4d0 2024-08-31T05:32:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.719+0000 7f648cff9640 1 -- 172.21.15.5:0/3988547711 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f649c0b0760 con 0x5620e5fdf4d0 2024-08-31T05:32:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.719+0000 7f64b62a6740 10 client.16302 fetch_fsmap learned FSMap version 32 2024-08-31T05:32:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.719+0000 7f64b62a6740 1 -- 172.21.15.5:0/3988547711 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5620e63be200 con 0x5620e5fdf4d0 2024-08-31T05:32:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.719+0000 7f648cff9640 1 -- 172.21.15.5:0/3988547711 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64a0004030 con 0x5620e5fdf4d0 2024-08-31T05:32:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.720+0000 7f648cff9640 1 -- 172.21.15.5:0/3988547711 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f649c0a7910 con 0x5620e5fdf4d0 2024-08-31T05:32:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.720+0000 7f64b62a6740 10 client.16302 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:32:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.720+0000 7f64b62a6740 10 client.16302 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:32:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.720+0000 7f64b62a6740 20 client.16302 populate_metadata read hostname 'smithi005' 2024-08-31T05:32:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.720+0000 7f64b62a6740 1 --2- 172.21.15.5:0/3988547711 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5620e5fbed80 0x5620e63c1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.720+0000 7f64b62a6740 4 client.16302 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:32:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.720+0000 7f64b62a6740 1 -- 172.21.15.5:0/3988547711 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5620e631af50 con 0x5620e5fbed80 2024-08-31T05:32:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.721+0000 7f64ad0d5640 1 --2- 172.21.15.5:0/3988547711 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5620e5fbed80 0x5620e63c1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.721+0000 7f64ad0d5640 1 --2- 172.21.15.5:0/3988547711 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5620e5fbed80 0x5620e63c1780 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bad1c7a7d9d17b62 server_cookie=ad1c3d87fda92012 in_seq=0 out_seq=0 2024-08-31T05:32:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.721+0000 7f648cff9640 10 client.16302 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:32:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.722+0000 7f648cff9640 1 -- 172.21.15.5:0/3988547711 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5620e631af50 con 0x5620e5fbed80 2024-08-31T05:32:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.722+0000 7f648cff9640 10 client.16302 handle_command_reply: tid=0 2024-08-31T05:32:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.722+0000 7f64b62a6740 1 client.16302 shutdown 2024-08-31T05:32:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.722+0000 7f64b62a6740 1 -- 172.21.15.5:0/3988547711 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5620e5fdf4d0 msgr2=0x5620e63afba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.722+0000 7f64b62a6740 1 --2- 172.21.15.5:0/3988547711 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5620e5fdf4d0 0x5620e63afba0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f649c0abf30 tx=0x7f649c0ab710 comp rx=0 tx=0).stop 2024-08-31T05:32:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.722+0000 7f64b62a6740 1 -- 172.21.15.5:0/3988547711 shutdown_connections 2024-08-31T05:32:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.722+0000 7f64b62a6740 1 --2- 172.21.15.5:0/3988547711 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5620e5fbed80 0x5620e63c1780 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.722+0000 7f64b62a6740 1 --2- 172.21.15.5:0/3988547711 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5620e60001b0 0x5620e63bb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.722+0000 7f64b62a6740 1 --2- 172.21.15.5:0/3988547711 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5620e5fdf4d0 0x5620e63afba0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.722+0000 7f64b62a6740 1 --2- 172.21.15.5:0/3988547711 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620e5fd72f0 0x5620e63af660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.722+0000 7f64b62a6740 1 -- 172.21.15.5:0/3988547711 >> 172.21.15.5:0/3988547711 conn(0x5620e5ff4300 msgr2=0x5620e63a4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.722+0000 7f648cff9640 0 client.16302 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:32:32.730 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.722+0000 7f64b62a6740 1 -- 172.21.15.5:0/3988547711 shutdown_connections 2024-08-31T05:32:32.730 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.722+0000 7f64b62a6740 1 -- 172.21.15.5:0/3988547711 wait complete. 2024-08-31T05:32:32.730 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.722+0000 7f64b62a6740 20 client.16302 trim_cache size 0 max 16384 2024-08-31T05:32:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.738+0000 7f64b62a6740 1 Processor -- start 2024-08-31T05:32:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.738+0000 7f64b62a6740 1 -- start start 2024-08-31T05:32:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.738+0000 7f64b62a6740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5620e5fd72f0 0x5620e63aa550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.738+0000 7f64b62a6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620e5fdf4d0 0x5620e63aaa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.738+0000 7f64b62a6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5620e60001b0 0x5620e63ac620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.738+0000 7f64b62a6740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f64a81b2da0 con 0x5620e5fd72f0 2024-08-31T05:32:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.738+0000 7f64b62a6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f64a81b49a0 con 0x5620e5fdf4d0 2024-08-31T05:32:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.738+0000 7f64b62a6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f64a81b3470 con 0x5620e60001b0 2024-08-31T05:32:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.738+0000 7f64ad0d5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5620e5fd72f0 0x5620e63aa550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.738+0000 7f64ad0d5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5620e5fd72f0 0x5620e63aa550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46118/0 (socket says 172.21.15.5:46118) 2024-08-31T05:32:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.738+0000 7f64ad0d5640 1 -- 172.21.15.5:0/2610426788 learned_addr learned my addr 172.21.15.5:0/2610426788 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:32.742 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.738+0000 7f64ad8d6640 1 --2- 172.21.15.5:0/2610426788 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5620e60001b0 0x5620e63ac620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:32.742 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.738+0000 7f64ac8d4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620e5fdf4d0 0x5620e63aaa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:32.742 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.738+0000 7f64ad0d5640 1 -- 172.21.15.5:0/2610426788 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5620e60001b0 msgr2=0x5620e63ac620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:32.742 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.738+0000 7f64ad0d5640 1 --2- 172.21.15.5:0/2610426788 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5620e60001b0 0x5620e63ac620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.742 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.738+0000 7f64ad0d5640 1 -- 172.21.15.5:0/2610426788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620e5fdf4d0 msgr2=0x5620e63aaa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:32.742 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.738+0000 7f64ad0d5640 1 --2- 172.21.15.5:0/2610426788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620e5fdf4d0 0x5620e63aaa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.742 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.738+0000 7f64ad0d5640 1 -- 172.21.15.5:0/2610426788 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620e639b800 con 0x5620e5fd72f0 2024-08-31T05:32:32.742 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.738+0000 7f64ac8d4640 1 --2- 172.21.15.5:0/2610426788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620e5fdf4d0 0x5620e63aaa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:32:32.742 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.739+0000 7f64ad0d5640 1 --2- 172.21.15.5:0/2610426788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5620e5fd72f0 0x5620e63aa550 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f6498009dc0 tx=0x7f649801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bedc5b2eee5e398d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:32.742 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.739+0000 7f648effd640 1 -- 172.21.15.5:0/2610426788 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f649801cca0 con 0x5620e5fd72f0 2024-08-31T05:32:32.742 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.739+0000 7f648effd640 1 -- 172.21.15.5:0/2610426788 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f649801ce40 con 0x5620e5fd72f0 2024-08-31T05:32:32.742 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.739+0000 7f648effd640 1 -- 172.21.15.5:0/2610426788 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6498029420 con 0x5620e5fd72f0 2024-08-31T05:32:32.745 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.740+0000 7f64b62a6740 1 -- 172.21.15.5:0/2610426788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5620e5fd72f0 msgr2=0x5620e63aa550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:32.745 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.740+0000 7f64b62a6740 1 --2- 172.21.15.5:0/2610426788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5620e5fd72f0 0x5620e63aa550 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f6498009dc0 tx=0x7f649801a000 comp rx=0 tx=0).stop 2024-08-31T05:32:32.746 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.740+0000 7f64b62a6740 1 -- 172.21.15.5:0/2610426788 shutdown_connections 2024-08-31T05:32:32.746 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.740+0000 7f64b62a6740 1 --2- 172.21.15.5:0/2610426788 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5620e60001b0 0x5620e63ac620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.746 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.740+0000 7f64b62a6740 1 --2- 172.21.15.5:0/2610426788 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620e5fdf4d0 0x5620e63aaa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.746 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.740+0000 7f64b62a6740 1 --2- 172.21.15.5:0/2610426788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5620e5fd72f0 0x5620e63aa550 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.746 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.740+0000 7f64b62a6740 1 -- 172.21.15.5:0/2610426788 >> 172.21.15.5:0/2610426788 conn(0x5620e5ff4300 msgr2=0x5620e63a8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:32.746 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.740+0000 7f64b62a6740 1 -- 172.21.15.5:0/2610426788 shutdown_connections 2024-08-31T05:32:32.746 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.740+0000 7f64b62a6740 1 -- 172.21.15.5:0/2610426788 wait complete. 2024-08-31T05:32:32.746 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.740+0000 7f64b62a6740 1 -- start start 2024-08-31T05:32:32.746 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.740+0000 7f64b62a6740 1 Processor -- start 2024-08-31T05:32:32.746 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.741+0000 7f64b62a6740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5620e5fd72f0 0x5620e63b4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:32.746 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.741+0000 7f64b62a6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5620e5fdf4d0 0x5620e63b5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:32.746 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.741+0000 7f64b62a6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620e60001b0 0x5620e6424110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:32.746 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.741+0000 7f64b62a6740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f64a81b4210 con 0x5620e5fd72f0 2024-08-31T05:32:32.747 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.741+0000 7f64b62a6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f64a81b3b40 con 0x5620e60001b0 2024-08-31T05:32:32.747 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.741+0000 7f64b62a6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f64a81b0d80 con 0x5620e5fdf4d0 2024-08-31T05:32:32.747 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.741+0000 7f64b62a6740 10 client.0 _ll_register_callbacks cb 0x7f649c0abe40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:32:32.747 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.741+0000 7f64ad0d5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5620e5fd72f0 0x5620e63b4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:32.747 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.741+0000 7f64ad0d5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5620e5fd72f0 0x5620e63b4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46120/0 (socket says 172.21.15.5:46120) 2024-08-31T05:32:32.747 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.741+0000 7f64ad0d5640 1 -- 172.21.15.5:0/3607029000 learned_addr learned my addr 172.21.15.5:0/3607029000 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:32.747 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.741+0000 7f64ac8d4640 1 --2- 172.21.15.5:0/3607029000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5620e5fdf4d0 0x5620e63b5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:32.747 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.741+0000 7f64ad8d6640 1 --2- 172.21.15.5:0/3607029000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620e60001b0 0x5620e6424110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:32.747 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.741+0000 7f64ad0d5640 1 -- 172.21.15.5:0/3607029000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5620e5fdf4d0 msgr2=0x5620e63b5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:32.747 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.741+0000 7f64ad0d5640 1 --2- 172.21.15.5:0/3607029000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5620e5fdf4d0 0x5620e63b5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.747 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.741+0000 7f64ad0d5640 1 -- 172.21.15.5:0/3607029000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620e60001b0 msgr2=0x5620e6424110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:32.747 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.741+0000 7f64ad0d5640 1 --2- 172.21.15.5:0/3607029000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620e60001b0 0x5620e6424110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.747 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.741+0000 7f64ad0d5640 1 -- 172.21.15.5:0/3607029000 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620e64247b0 con 0x5620e5fd72f0 2024-08-31T05:32:32.747 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.741+0000 7f64ac8d4640 1 --2- 172.21.15.5:0/3607029000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5620e5fdf4d0 0x5620e63b5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:32:32.748 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.742+0000 7f64ad0d5640 1 --2- 172.21.15.5:0/3607029000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5620e5fd72f0 0x5620e63b4d60 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f649800eeb0 tx=0x7f6498004310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62cd1a5603c54c73 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:32.748 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.742+0000 7f648cff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:32:32.748 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.742+0000 7f648cff9640 1 -- 172.21.15.5:0/3607029000 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f649803e060 con 0x5620e5fd72f0 2024-08-31T05:32:32.748 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.742+0000 7f648cff9640 1 -- 172.21.15.5:0/3607029000 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f6498004760 con 0x5620e5fd72f0 2024-08-31T05:32:32.748 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.742+0000 7f64b62a6740 1 -- 172.21.15.5:0/3607029000 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5620e63169f0 con 0x5620e5fd72f0 2024-08-31T05:32:32.748 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.742+0000 7f648cff9640 1 -- 172.21.15.5:0/3607029000 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f6498045050 con 0x5620e5fd72f0 2024-08-31T05:32:32.748 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.742+0000 7f64b62a6740 10 client.16308 fetch_fsmap learned FSMap version 32 2024-08-31T05:32:32.748 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.742+0000 7f64b62a6740 1 -- 172.21.15.5:0/3607029000 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5620e642bb20 con 0x5620e5fd72f0 2024-08-31T05:32:32.748 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.742+0000 7f648cff9640 1 -- 172.21.15.5:0/3607029000 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5620e63169f0 con 0x5620e5fd72f0 2024-08-31T05:32:32.748 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.743+0000 7f648cff9640 1 -- 172.21.15.5:0/3607029000 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f649802e030 con 0x5620e5fd72f0 2024-08-31T05:32:32.748 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.743+0000 7f64b62a6740 10 client.16308 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:32:32.748 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.743+0000 7f64b62a6740 10 client.16308 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:32:32.748 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.743+0000 7f64b62a6740 20 client.16308 populate_metadata read hostname 'smithi005' 2024-08-31T05:32:32.749 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.743+0000 7f64b62a6740 1 --2- 172.21.15.5:0/3607029000 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5620e5f941c0 0x5620e642e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:32.749 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.743+0000 7f64b62a6740 4 client.16308 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:32:32.749 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.743+0000 7f64b62a6740 1 -- 172.21.15.5:0/3607029000 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5620e6314130 con 0x5620e5f941c0 2024-08-31T05:32:32.749 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.743+0000 7f64ac8d4640 1 --2- 172.21.15.5:0/3607029000 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5620e5f941c0 0x5620e642e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:32.749 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.743+0000 7f648cff9640 10 client.16308 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:32:32.749 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.744+0000 7f64ac8d4640 1 --2- 172.21.15.5:0/3607029000 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5620e5f941c0 0x5620e642e370 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=caece43fe14a1b24 server_cookie=f82bd1f1a91d56a7 in_seq=0 out_seq=0 2024-08-31T05:32:32.755 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.753+0000 7f648cff9640 1 -- 172.21.15.5:0/3607029000 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5620e6314130 con 0x5620e5f941c0 2024-08-31T05:32:32.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.753+0000 7f648cff9640 10 client.16308 handle_command_reply: tid=0 2024-08-31T05:32:32.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.753+0000 7f64b62a6740 1 client.16308 shutdown 2024-08-31T05:32:32.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.753+0000 7f64b62a6740 1 -- 172.21.15.5:0/3607029000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5620e5fd72f0 msgr2=0x5620e63b4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:32.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.753+0000 7f64b62a6740 1 --2- 172.21.15.5:0/3607029000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5620e5fd72f0 0x5620e63b4d60 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f649800eeb0 tx=0x7f6498004310 comp rx=0 tx=0).stop 2024-08-31T05:32:32.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.753+0000 7f64b62a6740 1 -- 172.21.15.5:0/3607029000 shutdown_connections 2024-08-31T05:32:32.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.753+0000 7f64b62a6740 1 --2- 172.21.15.5:0/3607029000 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5620e5f941c0 0x5620e642e370 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.753+0000 7f64b62a6740 1 --2- 172.21.15.5:0/3607029000 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5620e60001b0 0x5620e6424110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.753+0000 7f648cff9640 0 client.16308 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:32:32.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.753+0000 7f64b62a6740 1 --2- 172.21.15.5:0/3607029000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5620e5fdf4d0 0x5620e63b5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.753+0000 7f64b62a6740 1 --2- 172.21.15.5:0/3607029000 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5620e5fd72f0 0x5620e63b4d60 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.753+0000 7f64b62a6740 1 -- 172.21.15.5:0/3607029000 >> 172.21.15.5:0/3607029000 conn(0x5620e5ff4300 msgr2=0x5620e63b0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:32.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.753+0000 7f64b62a6740 1 -- 172.21.15.5:0/3607029000 shutdown_connections 2024-08-31T05:32:32.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.753+0000 7f64b62a6740 1 -- 172.21.15.5:0/3607029000 wait complete. 2024-08-31T05:32:32.757 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.754+0000 7f64b62a6740 20 client.16308 trim_cache size 0 max 16384 2024-08-31T05:32:32.757 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:32:32.757 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:32:32.757 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:32:32.757 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:32:32.758 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.754+0000 7f64af339640 1 -- 172.21.15.5:0/725108646 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f64900b4cd0 msgr2=0x7f64900b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:32.758 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.754+0000 7f64af339640 1 --2- 172.21.15.5:0/725108646 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f64900b4cd0 0x7f64900b71e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x5620e63a2740 tx=0x7f6498009500 comp rx=0 tx=0).stop 2024-08-31T05:32:32.758 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.754+0000 7f64af339640 1 -- 172.21.15.5:0/725108646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64a8105050 msgr2=0x7f64a8102970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:32.758 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.754+0000 7f64af339640 1 --2- 172.21.15.5:0/725108646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64a8105050 0x7f64a8102970 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f64a806b560 tx=0x7f649c00ee50 comp rx=0 tx=0).stop 2024-08-31T05:32:32.758 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.754+0000 7f64af339640 1 -- 172.21.15.5:0/725108646 shutdown_connections 2024-08-31T05:32:32.758 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.754+0000 7f64af339640 1 --2- 172.21.15.5:0/725108646 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f64900b4cd0 0x7f64900b71e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.758 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.754+0000 7f64af339640 1 --2- 172.21.15.5:0/725108646 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64a810db60 0x7f64a8102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.758 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.754+0000 7f64af339640 1 --2- 172.21.15.5:0/725108646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64a8105050 0x7f64a8102970 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.758 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.754+0000 7f64af339640 1 --2- 172.21.15.5:0/725108646 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64a8104700 0x7f64a8102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:32.759 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.754+0000 7f64af339640 1 -- 172.21.15.5:0/725108646 >> 172.21.15.5:0/725108646 conn(0x7f64a80fe1b0 msgr2=0x7f64a8105530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:32.759 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.754+0000 7f64af339640 1 -- 172.21.15.5:0/725108646 shutdown_connections 2024-08-31T05:32:32.759 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:32.754+0000 7f64af339640 1 -- 172.21.15.5:0/725108646 wait complete. 2024-08-31T05:32:32.910 INFO:tasks.workunit.client.0.smithi005.stdout: 1 205889 14.11 MB/sec warmup 80 sec latency 19.297 ms 2024-08-31T05:32:33.106 INFO:tasks.cephfs.filesystem:scrub status for tag:728a42ca-bbef-4151-830f-5fdd411d8fa0 - {'path': '/', 'tag': '728a42ca-bbef-4151-830f-5fdd411d8fa0', 'options': 'recursive,force'} 2024-08-31T05:32:33.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:32:33 smithi005 ceph-mon[18602]: pgmap v422: 129 pgs: 129 active+clean; 104 MiB data, 817 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.4 MiB/s wr, 269 op/s 2024-08-31T05:32:33.585 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:32:33 smithi070 ceph-mon[22316]: pgmap v422: 129 pgs: 129 active+clean; 104 MiB data, 817 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.4 MiB/s wr, 269 op/s 2024-08-31T05:32:33.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:32:33 smithi050 ceph-mon[22146]: pgmap v422: 129 pgs: 129 active+clean; 104 MiB data, 817 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.4 MiB/s wr, 269 op/s 2024-08-31T05:32:33.910 INFO:tasks.workunit.client.0.smithi005.stdout: 1 208226 14.05 MB/sec warmup 81 sec latency 12.022 ms 2024-08-31T05:32:34.910 INFO:tasks.workunit.client.0.smithi005.stdout: 1 210499 14.04 MB/sec warmup 82 sec latency 14.005 ms 2024-08-31T05:32:35.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:32:35 smithi005 ceph-mon[18602]: pgmap v423: 129 pgs: 129 active+clean; 106 MiB data, 817 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.7 MiB/s wr, 280 op/s 2024-08-31T05:32:35.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:32:35 smithi070 ceph-mon[22316]: pgmap v423: 129 pgs: 129 active+clean; 106 MiB data, 817 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.7 MiB/s wr, 280 op/s 2024-08-31T05:32:35.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:32:35 smithi050 ceph-mon[22146]: pgmap v423: 129 pgs: 129 active+clean; 106 MiB data, 817 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.7 MiB/s wr, 280 op/s 2024-08-31T05:32:35.911 INFO:tasks.workunit.client.0.smithi005.stdout: 1 213222 14.08 MB/sec warmup 83 sec latency 67.460 ms 2024-08-31T05:32:36.911 INFO:tasks.workunit.client.0.smithi005.stdout: 1 216076 14.07 MB/sec warmup 84 sec latency 19.878 ms 2024-08-31T05:32:37.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:32:37 smithi005 ceph-mon[18602]: pgmap v424: 129 pgs: 129 active+clean; 108 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.4 MiB/s wr, 317 op/s 2024-08-31T05:32:37.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:32:37 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:32:37.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:32:37 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:32:37.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:32:37 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:32:37.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:32:37 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:32:37.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:32:37 smithi070 ceph-mon[22316]: pgmap v424: 129 pgs: 129 active+clean; 108 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.4 MiB/s wr, 317 op/s 2024-08-31T05:32:37.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:32:37 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:32:37.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:32:37 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:32:37.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:32:37 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:32:37.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:32:37 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:32:37.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:32:37 smithi050 ceph-mon[22146]: pgmap v424: 129 pgs: 129 active+clean; 108 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.4 MiB/s wr, 317 op/s 2024-08-31T05:32:37.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:32:37 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:32:37.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:32:37 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:32:37.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:32:37 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:32:37.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:32:37 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:32:37.911 INFO:tasks.workunit.client.0.smithi005.stdout: 1 218330 14.03 MB/sec warmup 85 sec latency 16.398 ms 2024-08-31T05:32:38.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:32:38 smithi005 ceph-mon[18602]: scrub summary: idle 2024-08-31T05:32:38.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:32:38 smithi005 ceph-mon[18602]: scrub summary: idle 2024-08-31T05:32:38.585 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:32:38 smithi070 ceph-mon[22316]: scrub summary: idle 2024-08-31T05:32:38.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:32:38 smithi070 ceph-mon[22316]: scrub summary: idle 2024-08-31T05:32:38.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:32:38 smithi050 ceph-mon[22146]: scrub summary: idle 2024-08-31T05:32:38.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:32:38 smithi050 ceph-mon[22146]: scrub summary: idle 2024-08-31T05:32:38.911 INFO:tasks.workunit.client.0.smithi005.stdout: 1 220766 14.04 MB/sec warmup 86 sec latency 13.135 ms 2024-08-31T05:32:39.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:32:39 smithi005 ceph-mon[18602]: pgmap v425: 129 pgs: 129 active+clean; 110 MiB data, 839 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.5 MiB/s wr, 271 op/s 2024-08-31T05:32:39.585 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:32:39 smithi070 ceph-mon[22316]: pgmap v425: 129 pgs: 129 active+clean; 110 MiB data, 839 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.5 MiB/s wr, 271 op/s 2024-08-31T05:32:39.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:32:39 smithi050 ceph-mon[22146]: pgmap v425: 129 pgs: 129 active+clean; 110 MiB data, 839 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.5 MiB/s wr, 271 op/s 2024-08-31T05:32:39.911 INFO:tasks.workunit.client.0.smithi005.stdout: 1 223877 14.09 MB/sec warmup 87 sec latency 7.650 ms 2024-08-31T05:32:40.911 INFO:tasks.workunit.client.0.smithi005.stdout: 1 226144 14.02 MB/sec warmup 88 sec latency 50.443 ms 2024-08-31T05:32:41.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:32:41 smithi005 ceph-mon[18602]: pgmap v426: 129 pgs: 129 active+clean; 111 MiB data, 849 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.2 MiB/s wr, 313 op/s 2024-08-31T05:32:41.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:32:41 smithi070 ceph-mon[22316]: pgmap v426: 129 pgs: 129 active+clean; 111 MiB data, 849 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.2 MiB/s wr, 313 op/s 2024-08-31T05:32:41.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:32:41 smithi050 ceph-mon[22146]: pgmap v426: 129 pgs: 129 active+clean; 111 MiB data, 849 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.2 MiB/s wr, 313 op/s 2024-08-31T05:32:41.911 INFO:tasks.workunit.client.0.smithi005.stdout: 1 228287 14.01 MB/sec warmup 89 sec latency 26.174 ms 2024-08-31T05:32:42.911 INFO:tasks.workunit.client.0.smithi005.stdout: 1 231181 14.04 MB/sec warmup 90 sec latency 14.998 ms 2024-08-31T05:32:43.459 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:32:43 smithi050 ceph-mon[22146]: pgmap v427: 129 pgs: 129 active+clean; 115 MiB data, 839 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.3 MiB/s wr, 250 op/s 2024-08-31T05:32:43.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:32:43 smithi005 ceph-mon[18602]: pgmap v427: 129 pgs: 129 active+clean; 115 MiB data, 839 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.3 MiB/s wr, 250 op/s 2024-08-31T05:32:43.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:32:43 smithi070 ceph-mon[22316]: pgmap v427: 129 pgs: 129 active+clean; 115 MiB data, 839 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.3 MiB/s wr, 250 op/s 2024-08-31T05:32:43.911 INFO:tasks.workunit.client.0.smithi005.stdout: 1 234222 14.08 MB/sec warmup 91 sec latency 33.651 ms 2024-08-31T05:32:44.911 INFO:tasks.workunit.client.0.smithi005.stdout: 1 236555 14.02 MB/sec warmup 92 sec latency 15.020 ms 2024-08-31T05:32:45.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:32:45 smithi005 ceph-mon[18602]: pgmap v428: 129 pgs: 129 active+clean; 115 MiB data, 827 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.3 MiB/s wr, 251 op/s 2024-08-31T05:32:45.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:32:45 smithi070 ceph-mon[22316]: pgmap v428: 129 pgs: 129 active+clean; 115 MiB data, 827 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.3 MiB/s wr, 251 op/s 2024-08-31T05:32:45.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:32:45 smithi050 ceph-mon[22146]: pgmap v428: 129 pgs: 129 active+clean; 115 MiB data, 827 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.3 MiB/s wr, 251 op/s 2024-08-31T05:32:45.893 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.890+0000 7f87e4a36640 1 -- 172.21.15.5:0/33145269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87e0103850 msgr2=0x7f87e0103c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:45.893 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.890+0000 7f87e4a36640 1 --2- 172.21.15.5:0/33145269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87e0103850 0x7f87e0103c60 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f87d0009900 tx=0x7f87d002a410 comp rx=0 tx=0).stop 2024-08-31T05:32:45.893 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.891+0000 7f87e4a36640 1 -- 172.21.15.5:0/33145269 shutdown_connections 2024-08-31T05:32:45.893 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.891+0000 7f87e4a36640 1 --2- 172.21.15.5:0/33145269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87e0109ad0 0x7f87e0110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:45.893 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.891+0000 7f87e4a36640 1 --2- 172.21.15.5:0/33145269 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87e0109180 0x7f87e0109590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:45.893 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.891+0000 7f87e4a36640 1 --2- 172.21.15.5:0/33145269 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87e0103850 0x7f87e0103c60 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:45.893 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.891+0000 7f87e4a36640 1 -- 172.21.15.5:0/33145269 >> 172.21.15.5:0/33145269 conn(0x7f87e00ff290 msgr2=0x7f87e01016e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:45.894 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.891+0000 7f87e4a36640 1 -- 172.21.15.5:0/33145269 shutdown_connections 2024-08-31T05:32:45.894 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.891+0000 7f87e4a36640 1 -- 172.21.15.5:0/33145269 wait complete. 2024-08-31T05:32:45.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.891+0000 7f87e4a36640 1 Processor -- start 2024-08-31T05:32:45.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.891+0000 7f87e4a36640 1 -- start start 2024-08-31T05:32:45.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.892+0000 7f87e4a36640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87e0103850 0x7f87e00754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:45.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.892+0000 7f87e4a36640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87e0109180 0x7f87e00759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:45.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.892+0000 7f87e4a36640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87e0109ad0 0x7f87e0075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:45.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.892+0000 7f87e4a36640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f87e0113780 con 0x7f87e0109180 2024-08-31T05:32:45.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.892+0000 7f87e4a36640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f87e0113600 con 0x7f87e0103850 2024-08-31T05:32:45.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.892+0000 7f87e4a36640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f87e0113900 con 0x7f87e0109ad0 2024-08-31T05:32:45.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.892+0000 7f87ddd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87e0109180 0x7f87e00759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:45.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.892+0000 7f87ddd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87e0109180 0x7f87e00759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42270/0 (socket says 172.21.15.5:42270) 2024-08-31T05:32:45.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.892+0000 7f87ddd9b640 1 -- 172.21.15.5:0/3162038957 learned_addr learned my addr 172.21.15.5:0/3162038957 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:45.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.892+0000 7f87ded9d640 1 --2- 172.21.15.5:0/3162038957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87e0109ad0 0x7f87e0075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:45.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.892+0000 7f87de59c640 1 --2- 172.21.15.5:0/3162038957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87e0103850 0x7f87e00754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:45.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.892+0000 7f87ddd9b640 1 -- 172.21.15.5:0/3162038957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87e0109ad0 msgr2=0x7f87e0075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:45.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.892+0000 7f87ddd9b640 1 --2- 172.21.15.5:0/3162038957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87e0109ad0 0x7f87e0075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:45.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.892+0000 7f87ddd9b640 1 -- 172.21.15.5:0/3162038957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87e0103850 msgr2=0x7f87e00754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:45.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.892+0000 7f87ddd9b640 1 --2- 172.21.15.5:0/3162038957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87e0103850 0x7f87e00754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:45.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.892+0000 7f87ddd9b640 1 -- 172.21.15.5:0/3162038957 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87e01a8470 con 0x7f87e0109180 2024-08-31T05:32:45.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.892+0000 7f87de59c640 1 --2- 172.21.15.5:0/3162038957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87e0103850 0x7f87e00754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:32:45.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.892+0000 7f87ddd9b640 1 --2- 172.21.15.5:0/3162038957 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87e0109180 0x7f87e00759f0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f87d400e9f0 tx=0x7f87d400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:45.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.893+0000 7f87cf7fe640 1 -- 172.21.15.5:0/3162038957 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d400ccc0 con 0x7f87e0109180 2024-08-31T05:32:45.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.893+0000 7f87cf7fe640 1 -- 172.21.15.5:0/3162038957 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87d40108e0 con 0x7f87e0109180 2024-08-31T05:32:45.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.893+0000 7f87e4a36640 1 -- 172.21.15.5:0/3162038957 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87e01a8760 con 0x7f87e0109180 2024-08-31T05:32:45.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.893+0000 7f87cf7fe640 1 -- 172.21.15.5:0/3162038957 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d4018860 con 0x7f87e0109180 2024-08-31T05:32:45.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.893+0000 7f87e4a36640 1 -- 172.21.15.5:0/3162038957 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87e01a8cb0 con 0x7f87e0109180 2024-08-31T05:32:45.907 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.895+0000 7f87eba76740 1 Processor -- start 2024-08-31T05:32:45.907 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.895+0000 7f87eba76740 1 -- start start 2024-08-31T05:32:45.907 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.896+0000 7f87cf7fe640 1 -- 172.21.15.5:0/3162038957 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f87d4018a00 con 0x7f87e0109180 2024-08-31T05:32:45.907 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.896+0000 7f87eba76740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e51bcf01b0 0x55e51c093ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:45.907 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.896+0000 7f87eba76740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e51bcc72f0 0x55e51c094000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:45.907 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.896+0000 7f87eba76740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e51bccf4d0 0x55e51c094540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:45.907 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.896+0000 7f87eba76740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55e51c009000 con 0x55e51bcc72f0 2024-08-31T05:32:45.907 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.896+0000 7f87eba76740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e51bff8590 con 0x55e51bccf4d0 2024-08-31T05:32:45.908 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.896+0000 7f87eba76740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e51bffc540 con 0x55e51bcf01b0 2024-08-31T05:32:45.908 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.896+0000 7f87de59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e51bcc72f0 0x55e51c094000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:45.908 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.896+0000 7f87de59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e51bcc72f0 0x55e51c094000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42282/0 (socket says 172.21.15.5:42282) 2024-08-31T05:32:45.908 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.896+0000 7f87ded9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e51bcf01b0 0x55e51c093ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:45.908 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.896+0000 7f87de59c640 1 -- 172.21.15.5:0/2321017785 learned_addr learned my addr 172.21.15.5:0/2321017785 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:45.908 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.896+0000 7f87ddd9b640 1 --2- 172.21.15.5:0/2321017785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e51bccf4d0 0x55e51c094540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:45.908 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.896+0000 7f87ded9d640 1 -- 172.21.15.5:0/2321017785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e51bccf4d0 msgr2=0x55e51c094540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:45.908 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.896+0000 7f87ded9d640 1 --2- 172.21.15.5:0/2321017785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e51bccf4d0 0x55e51c094540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:45.908 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.896+0000 7f87ded9d640 1 -- 172.21.15.5:0/2321017785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e51bcc72f0 msgr2=0x55e51c094000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:45.908 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.896+0000 7f87ded9d640 1 --2- 172.21.15.5:0/2321017785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e51bcc72f0 0x55e51c094000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:45.908 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.896+0000 7f87ded9d640 1 -- 172.21.15.5:0/2321017785 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e51bd5b790 con 0x55e51bcf01b0 2024-08-31T05:32:45.908 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.897+0000 7f87ded9d640 1 --2- 172.21.15.5:0/2321017785 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e51bcf01b0 0x55e51c093ac0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f87d8009f30 tx=0x7f87d80118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6a415c622965bf3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:45.908 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.897+0000 7f87ccff9640 1 -- 172.21.15.5:0/2321017785 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d8004d20 con 0x55e51bcf01b0 2024-08-31T05:32:45.909 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.897+0000 7f87ccff9640 1 -- 172.21.15.5:0/2321017785 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87d8004050 con 0x55e51bcf01b0 2024-08-31T05:32:45.909 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.897+0000 7f87ccff9640 1 -- 172.21.15.5:0/2321017785 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d8005280 con 0x55e51bcf01b0 2024-08-31T05:32:45.909 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.897+0000 7f87cf7fe640 1 --2- 172.21.15.5:0/3162038957 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f87c80b4cd0 0x7f87c80b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:45.909 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.897+0000 7f87de59c640 1 --2- 172.21.15.5:0/3162038957 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f87c80b4cd0 0x7f87c80b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:45.909 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.897+0000 7f87cf7fe640 1 -- 172.21.15.5:0/3162038957 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f87d40e5c70 con 0x7f87e0109180 2024-08-31T05:32:45.909 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.898+0000 7f87eba76740 1 -- 172.21.15.5:0/2321017785 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e51bcf01b0 msgr2=0x55e51c093ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:45.909 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.898+0000 7f87de59c640 1 --2- 172.21.15.5:0/3162038957 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f87c80b4cd0 0x7f87c80b71e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x55e51c092740 tx=0x7f87d00058b0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:45.909 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.898+0000 7f87eba76740 1 --2- 172.21.15.5:0/2321017785 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e51bcf01b0 0x55e51c093ac0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f87d8009f30 tx=0x7f87d80118d0 comp rx=0 tx=0).stop 2024-08-31T05:32:45.909 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.898+0000 7f87eba76740 1 -- 172.21.15.5:0/2321017785 shutdown_connections 2024-08-31T05:32:45.909 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.898+0000 7f87eba76740 1 --2- 172.21.15.5:0/2321017785 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e51bccf4d0 0x55e51c094540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:45.909 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.898+0000 7f87eba76740 1 --2- 172.21.15.5:0/2321017785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e51bcc72f0 0x55e51c094000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:45.909 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.898+0000 7f87eba76740 1 --2- 172.21.15.5:0/2321017785 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e51bcf01b0 0x55e51c093ac0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:45.910 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.898+0000 7f87eba76740 1 -- 172.21.15.5:0/2321017785 >> 172.21.15.5:0/2321017785 conn(0x55e51bce4300 msgr2=0x55e51c0919b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:45.910 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.898+0000 7f87eba76740 1 -- 172.21.15.5:0/2321017785 shutdown_connections 2024-08-31T05:32:45.910 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.898+0000 7f87eba76740 1 -- 172.21.15.5:0/2321017785 wait complete. 2024-08-31T05:32:45.910 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.898+0000 7f87eba76740 1 -- start start 2024-08-31T05:32:45.910 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.898+0000 7f87eba76740 1 Processor -- start 2024-08-31T05:32:45.910 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.899+0000 7f87eba76740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e51bcc72f0 0x55e51c09f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:45.910 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.899+0000 7f87eba76740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e51bccf4d0 0x55e51c09fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:45.910 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.899+0000 7f87eba76740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e51bcf01b0 0x55e51c0ab5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:45.910 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.899+0000 7f87eba76740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55e51bf31ab0 con 0x55e51bcc72f0 2024-08-31T05:32:45.910 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.899+0000 7f87eba76740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e51bf7f680 con 0x55e51bccf4d0 2024-08-31T05:32:45.910 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.899+0000 7f87eba76740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e51c0a2240 con 0x55e51bcf01b0 2024-08-31T05:32:45.911 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.899+0000 7f87de59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e51bcc72f0 0x55e51c09f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:45.911 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.899+0000 7f87eba76740 10 client.0 _ll_register_callbacks cb 0x55e51bd07a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:32:45.911 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.899+0000 7f87ddd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e51bccf4d0 0x55e51c09fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:45.911 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.899+0000 7f87de59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e51bcc72f0 0x55e51c09f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42288/0 (socket says 172.21.15.5:42288) 2024-08-31T05:32:45.911 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.899+0000 7f87de59c640 1 -- 172.21.15.5:0/4125847656 learned_addr learned my addr 172.21.15.5:0/4125847656 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:45.911 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.899+0000 7f87ded9d640 1 --2- 172.21.15.5:0/4125847656 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e51bcf01b0 0x55e51c0ab5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:45.911 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.899+0000 7f87ddd9b640 1 -- 172.21.15.5:0/4125847656 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e51bcf01b0 msgr2=0x55e51c0ab5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:45.911 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.899+0000 7f87ddd9b640 1 --2- 172.21.15.5:0/4125847656 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e51bcf01b0 0x55e51c0ab5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:45.911 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.899+0000 7f87ddd9b640 1 -- 172.21.15.5:0/4125847656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e51bcc72f0 msgr2=0x55e51c09f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:45.911 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.899+0000 7f87ddd9b640 1 --2- 172.21.15.5:0/4125847656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e51bcc72f0 0x55e51c09f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:45.911 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.899+0000 7f87ddd9b640 1 -- 172.21.15.5:0/4125847656 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e51bdd4620 con 0x55e51bccf4d0 2024-08-31T05:32:45.912 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.899+0000 7f87de59c640 1 --2- 172.21.15.5:0/4125847656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e51bcc72f0 0x55e51c09f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:32:45.912 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.899+0000 7f87ddd9b640 1 --2- 172.21.15.5:0/4125847656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e51bccf4d0 0x55e51c09fbd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f87d40e3040 tx=0x7f87d401f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c169002ca389f56 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:45.912 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.899+0000 7f87c5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:32:45.912 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.900+0000 7f87c5ffb640 1 -- 172.21.15.5:0/4125847656 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d40ab750 con 0x55e51bccf4d0 2024-08-31T05:32:45.912 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.900+0000 7f87c5ffb640 1 -- 172.21.15.5:0/4125847656 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f87d40b4e70 con 0x55e51bccf4d0 2024-08-31T05:32:45.912 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.900+0000 7f87eba76740 1 -- 172.21.15.5:0/4125847656 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87d8004050 con 0x55e51bccf4d0 2024-08-31T05:32:45.912 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.900+0000 7f87c5ffb640 1 -- 172.21.15.5:0/4125847656 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f87d40abaf0 con 0x55e51bccf4d0 2024-08-31T05:32:45.912 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.900+0000 7f87eba76740 10 client.25910 fetch_fsmap learned FSMap version 32 2024-08-31T05:32:45.912 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.900+0000 7f87eba76740 1 -- 172.21.15.5:0/4125847656 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e51c0ae310 con 0x55e51bccf4d0 2024-08-31T05:32:45.912 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.900+0000 7f87c5ffb640 1 -- 172.21.15.5:0/4125847656 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87d8004050 con 0x55e51bccf4d0 2024-08-31T05:32:45.912 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.900+0000 7f87c5ffb640 1 -- 172.21.15.5:0/4125847656 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f87d40ab240 con 0x55e51bccf4d0 2024-08-31T05:32:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.900+0000 7f87eba76740 10 client.25910 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:32:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.900+0000 7f87eba76740 10 client.25910 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:32:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.900+0000 7f87eba76740 20 client.25910 populate_metadata read hostname 'smithi005' 2024-08-31T05:32:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.900+0000 7f87eba76740 1 --2- 172.21.15.5:0/4125847656 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55e51bcaed80 0x55e51c0b1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.900+0000 7f87eba76740 4 client.25910 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:32:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.900+0000 7f87eba76740 1 -- 172.21.15.5:0/4125847656 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e51c00af50 con 0x55e51bcaed80 2024-08-31T05:32:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.901+0000 7f87de59c640 1 --2- 172.21.15.5:0/4125847656 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55e51bcaed80 0x55e51c0b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.901+0000 7f87de59c640 1 --2- 172.21.15.5:0/4125847656 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55e51bcaed80 0x55e51c0b1880 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7989b1fc98152d4 server_cookie=f1a8c005350dda76 in_seq=0 out_seq=0 2024-08-31T05:32:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.901+0000 7f87c5ffb640 10 client.25910 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:32:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.902+0000 7f87c5ffb640 1 -- 172.21.15.5:0/4125847656 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e51c00af50 con 0x55e51bcaed80 2024-08-31T05:32:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.902+0000 7f87c5ffb640 10 client.25910 handle_command_reply: tid=0 2024-08-31T05:32:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.902+0000 7f87eba76740 1 client.25910 shutdown 2024-08-31T05:32:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.902+0000 7f87eba76740 1 -- 172.21.15.5:0/4125847656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e51bccf4d0 msgr2=0x55e51c09fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.902+0000 7f87eba76740 1 --2- 172.21.15.5:0/4125847656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e51bccf4d0 0x55e51c09fbd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f87d40e3040 tx=0x7f87d401f000 comp rx=0 tx=0).stop 2024-08-31T05:32:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.902+0000 7f87eba76740 1 -- 172.21.15.5:0/4125847656 shutdown_connections 2024-08-31T05:32:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.902+0000 7f87eba76740 1 --2- 172.21.15.5:0/4125847656 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55e51bcaed80 0x55e51c0b1880 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.902+0000 7f87eba76740 1 --2- 172.21.15.5:0/4125847656 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e51bcf01b0 0x55e51c0ab5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.902+0000 7f87eba76740 1 --2- 172.21.15.5:0/4125847656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e51bccf4d0 0x55e51c09fbd0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.902+0000 7f87eba76740 1 --2- 172.21.15.5:0/4125847656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e51bcc72f0 0x55e51c09f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.902+0000 7f87c5ffb640 0 client.25910 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:32:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.902+0000 7f87eba76740 1 -- 172.21.15.5:0/4125847656 >> 172.21.15.5:0/4125847656 conn(0x55e51bce4300 msgr2=0x55e51c094af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.902+0000 7f87eba76740 1 -- 172.21.15.5:0/4125847656 shutdown_connections 2024-08-31T05:32:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.902+0000 7f87eba76740 1 -- 172.21.15.5:0/4125847656 wait complete. 2024-08-31T05:32:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.902+0000 7f87eba76740 20 client.25910 trim_cache size 0 max 16384 2024-08-31T05:32:45.915 INFO:tasks.workunit.client.0.smithi005.stdout: 1 238358 14.00 MB/sec warmup 93 sec latency 88.952 ms 2024-08-31T05:32:45.921 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.918+0000 7f87eba76740 1 Processor -- start 2024-08-31T05:32:45.921 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.918+0000 7f87eba76740 1 -- start start 2024-08-31T05:32:45.921 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.918+0000 7f87eba76740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e51bcc72f0 0x55e51c09a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:45.921 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.918+0000 7f87eba76740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e51bccf4d0 0x55e51c09aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:45.921 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.918+0000 7f87eba76740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e51bcf01b0 0x55e51c09dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:45.921 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.918+0000 7f87eba76740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f87e01b2df0 con 0x55e51bccf4d0 2024-08-31T05:32:45.921 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.918+0000 7f87eba76740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f87e01b49f0 con 0x55e51bcc72f0 2024-08-31T05:32:45.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.918+0000 7f87eba76740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f87e01b34c0 con 0x55e51bcf01b0 2024-08-31T05:32:45.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.918+0000 7f87ddd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e51bccf4d0 0x55e51c09aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:45.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.918+0000 7f87ddd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e51bccf4d0 0x55e51c09aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42300/0 (socket says 172.21.15.5:42300) 2024-08-31T05:32:45.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.918+0000 7f87ddd9b640 1 -- 172.21.15.5:0/799376640 learned_addr learned my addr 172.21.15.5:0/799376640 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:45.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.918+0000 7f87ded9d640 1 --2- 172.21.15.5:0/799376640 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e51bcf01b0 0x55e51c09dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:45.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.918+0000 7f87de59c640 1 --2- 172.21.15.5:0/799376640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e51bcc72f0 0x55e51c09a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:45.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.919+0000 7f87ddd9b640 1 -- 172.21.15.5:0/799376640 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e51bcf01b0 msgr2=0x55e51c09dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:45.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.919+0000 7f87ddd9b640 1 --2- 172.21.15.5:0/799376640 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e51bcf01b0 0x55e51c09dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:45.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.919+0000 7f87ddd9b640 1 -- 172.21.15.5:0/799376640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e51bcc72f0 msgr2=0x55e51c09a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:45.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.919+0000 7f87ddd9b640 1 --2- 172.21.15.5:0/799376640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e51bcc72f0 0x55e51c09a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:45.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.919+0000 7f87ddd9b640 1 -- 172.21.15.5:0/799376640 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e51c09d960 con 0x55e51bccf4d0 2024-08-31T05:32:45.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.919+0000 7f87ddd9b640 1 --2- 172.21.15.5:0/799376640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e51bccf4d0 0x55e51c09aac0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f87d400c6a0 tx=0x7f87d4009740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac0d7f3224001820 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:45.923 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.919+0000 7f87c7fff640 1 -- 172.21.15.5:0/799376640 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d40a7ea0 con 0x55e51bccf4d0 2024-08-31T05:32:45.923 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.919+0000 7f87c7fff640 1 -- 172.21.15.5:0/799376640 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87d40ac6e0 con 0x55e51bccf4d0 2024-08-31T05:32:45.923 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.919+0000 7f87c7fff640 1 -- 172.21.15.5:0/799376640 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d40b4e70 con 0x55e51bccf4d0 2024-08-31T05:32:45.926 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.920+0000 7f87eba76740 1 -- 172.21.15.5:0/799376640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e51bccf4d0 msgr2=0x55e51c09aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:45.926 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.920+0000 7f87eba76740 1 --2- 172.21.15.5:0/799376640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e51bccf4d0 0x55e51c09aac0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f87d400c6a0 tx=0x7f87d4009740 comp rx=0 tx=0).stop 2024-08-31T05:32:45.926 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.920+0000 7f87eba76740 1 -- 172.21.15.5:0/799376640 shutdown_connections 2024-08-31T05:32:45.926 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.920+0000 7f87eba76740 1 --2- 172.21.15.5:0/799376640 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e51bcf01b0 0x55e51c09dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:45.926 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.920+0000 7f87eba76740 1 --2- 172.21.15.5:0/799376640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e51bccf4d0 0x55e51c09aac0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:45.926 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.920+0000 7f87eba76740 1 --2- 172.21.15.5:0/799376640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e51bcc72f0 0x55e51c09a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:45.926 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.920+0000 7f87eba76740 1 -- 172.21.15.5:0/799376640 >> 172.21.15.5:0/799376640 conn(0x55e51bce4300 msgr2=0x55e51c098bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:45.926 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.920+0000 7f87eba76740 1 -- 172.21.15.5:0/799376640 shutdown_connections 2024-08-31T05:32:45.926 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.920+0000 7f87eba76740 1 -- 172.21.15.5:0/799376640 wait complete. 2024-08-31T05:32:45.926 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.920+0000 7f87eba76740 1 -- start start 2024-08-31T05:32:45.926 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.920+0000 7f87eba76740 1 Processor -- start 2024-08-31T05:32:45.927 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.921+0000 7f87eba76740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e51bcc72f0 0x55e51c0a3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:45.927 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.921+0000 7f87eba76740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e51bccf4d0 0x55e51c0a3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:45.927 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.921+0000 7f87eba76740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e51bcf01b0 0x55e51c0a40b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:45.927 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.921+0000 7f87eba76740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f87e01b4260 con 0x55e51bccf4d0 2024-08-31T05:32:45.927 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.921+0000 7f87eba76740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f87e01b3b90 con 0x55e51bcc72f0 2024-08-31T05:32:45.927 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.921+0000 7f87eba76740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f87e01b0dd0 con 0x55e51bcf01b0 2024-08-31T05:32:45.927 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.921+0000 7f87eba76740 10 client.0 _ll_register_callbacks cb 0x7f87d40e94b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:32:45.927 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.921+0000 7f87ddd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e51bccf4d0 0x55e51c0a3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:45.927 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.921+0000 7f87de59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e51bcc72f0 0x55e51c0a3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:45.927 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.921+0000 7f87ddd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e51bccf4d0 0x55e51c0a3b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42306/0 (socket says 172.21.15.5:42306) 2024-08-31T05:32:45.927 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.921+0000 7f87ddd9b640 1 -- 172.21.15.5:0/94292961 learned_addr learned my addr 172.21.15.5:0/94292961 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:45.927 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.921+0000 7f87de59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e51bcc72f0 0x55e51c0a3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:36314/0 (socket says 172.21.15.5:36314) 2024-08-31T05:32:45.927 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.921+0000 7f87ded9d640 1 --2- 172.21.15.5:0/94292961 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e51bcf01b0 0x55e51c0a40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:45.928 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.921+0000 7f87de59c640 1 -- 172.21.15.5:0/94292961 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e51bcf01b0 msgr2=0x55e51c0a40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:45.928 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.921+0000 7f87de59c640 1 --2- 172.21.15.5:0/94292961 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e51bcf01b0 0x55e51c0a40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:45.928 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.921+0000 7f87de59c640 1 -- 172.21.15.5:0/94292961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e51bccf4d0 msgr2=0x55e51c0a3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:45.928 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.921+0000 7f87de59c640 1 --2- 172.21.15.5:0/94292961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e51bccf4d0 0x55e51c0a3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:45.928 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.921+0000 7f87de59c640 1 -- 172.21.15.5:0/94292961 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e51c11b3a0 con 0x55e51bcc72f0 2024-08-31T05:32:45.928 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.922+0000 7f87de59c640 1 --2- 172.21.15.5:0/94292961 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e51bcc72f0 0x55e51c0a3630 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f87d0000c00 tx=0x7f87d0009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ce8713b8d23311f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:45.928 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.922+0000 7f87c5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:32:45.928 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.922+0000 7f87c5ffb640 1 -- 172.21.15.5:0/94292961 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d0035040 con 0x55e51bcc72f0 2024-08-31T05:32:45.928 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.922+0000 7f87c5ffb640 1 -- 172.21.15.5:0/94292961 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f87d0005450 con 0x55e51bcc72f0 2024-08-31T05:32:45.928 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.922+0000 7f87eba76740 1 -- 172.21.15.5:0/94292961 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87d40ac6e0 con 0x55e51bcc72f0 2024-08-31T05:32:45.928 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.922+0000 7f87c5ffb640 1 -- 172.21.15.5:0/94292961 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f87d0061050 con 0x55e51bcc72f0 2024-08-31T05:32:45.928 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.922+0000 7f87eba76740 10 client.25916 fetch_fsmap learned FSMap version 32 2024-08-31T05:32:45.928 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.922+0000 7f87eba76740 1 -- 172.21.15.5:0/94292961 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e51c11c670 con 0x55e51bcc72f0 2024-08-31T05:32:45.929 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.922+0000 7f87c5ffb640 1 -- 172.21.15.5:0/94292961 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87d40ac6e0 con 0x55e51bcc72f0 2024-08-31T05:32:45.929 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.922+0000 7f87c5ffb640 1 -- 172.21.15.5:0/94292961 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f87d0003860 con 0x55e51bcc72f0 2024-08-31T05:32:45.929 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.922+0000 7f87eba76740 10 client.25916 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:32:45.929 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.922+0000 7f87eba76740 10 client.25916 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:32:45.929 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.922+0000 7f87eba76740 20 client.25916 populate_metadata read hostname 'smithi005' 2024-08-31T05:32:45.929 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.923+0000 7f87eba76740 1 --2- 172.21.15.5:0/94292961 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55e51bc841c0 0x55e51c11eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:45.929 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.923+0000 7f87eba76740 4 client.25916 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:32:45.929 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.923+0000 7f87eba76740 1 -- 172.21.15.5:0/94292961 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e51c0069f0 con 0x55e51bc841c0 2024-08-31T05:32:45.929 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.923+0000 7f87ddd9b640 1 --2- 172.21.15.5:0/94292961 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55e51bc841c0 0x55e51c11eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:45.929 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.923+0000 7f87c5ffb640 10 client.25916 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:32:45.929 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.923+0000 7f87ddd9b640 1 --2- 172.21.15.5:0/94292961 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55e51bc841c0 0x55e51c11eea0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71cf88b698f4a53d server_cookie=272cac85af32da92 in_seq=0 out_seq=0 2024-08-31T05:32:45.934 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.931+0000 7f87c5ffb640 1 -- 172.21.15.5:0/94292961 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e51c0069f0 con 0x55e51bc841c0 2024-08-31T05:32:45.934 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.931+0000 7f87c5ffb640 10 client.25916 handle_command_reply: tid=0 2024-08-31T05:32:45.934 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.931+0000 7f87eba76740 1 client.25916 shutdown 2024-08-31T05:32:45.934 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.931+0000 7f87eba76740 1 -- 172.21.15.5:0/94292961 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e51bcc72f0 msgr2=0x55e51c0a3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:45.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.931+0000 7f87eba76740 1 --2- 172.21.15.5:0/94292961 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e51bcc72f0 0x55e51c0a3630 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f87d0000c00 tx=0x7f87d0009260 comp rx=0 tx=0).stop 2024-08-31T05:32:45.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.931+0000 7f87eba76740 1 -- 172.21.15.5:0/94292961 shutdown_connections 2024-08-31T05:32:45.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.931+0000 7f87eba76740 1 --2- 172.21.15.5:0/94292961 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55e51bc841c0 0x55e51c11eea0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:45.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.931+0000 7f87eba76740 1 --2- 172.21.15.5:0/94292961 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e51bcf01b0 0x55e51c0a40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:45.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.931+0000 7f87eba76740 1 --2- 172.21.15.5:0/94292961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e51bccf4d0 0x55e51c0a3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:45.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.931+0000 7f87eba76740 1 --2- 172.21.15.5:0/94292961 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e51bcc72f0 0x55e51c0a3630 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:45.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.931+0000 7f87c5ffb640 0 client.25916 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:32:45.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.931+0000 7f87eba76740 1 -- 172.21.15.5:0/94292961 >> 172.21.15.5:0/94292961 conn(0x55e51bce4300 msgr2=0x55e51c09db70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:45.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.932+0000 7f87eba76740 1 -- 172.21.15.5:0/94292961 shutdown_connections 2024-08-31T05:32:45.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.932+0000 7f87eba76740 1 -- 172.21.15.5:0/94292961 wait complete. 2024-08-31T05:32:45.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.932+0000 7f87eba76740 20 client.25916 trim_cache size 0 max 16384 2024-08-31T05:32:45.936 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:32:45.936 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:32:45.936 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:32:45.936 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:32:45.937 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.932+0000 7f87e4a36640 1 -- 172.21.15.5:0/3162038957 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f87c80b4cd0 msgr2=0x7f87c80b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:45.937 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.932+0000 7f87e4a36640 1 --2- 172.21.15.5:0/3162038957 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f87c80b4cd0 0x7f87c80b71e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x55e51c092740 tx=0x7f87d00058b0 comp rx=0 tx=0).stop 2024-08-31T05:32:45.937 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.932+0000 7f87e4a36640 1 -- 172.21.15.5:0/3162038957 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87e0109180 msgr2=0x7f87e00759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:45.937 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.932+0000 7f87e4a36640 1 --2- 172.21.15.5:0/3162038957 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87e0109180 0x7f87e00759f0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f87d400e9f0 tx=0x7f87d400eeb0 comp rx=0 tx=0).stop 2024-08-31T05:32:45.937 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.932+0000 7f87e4a36640 1 -- 172.21.15.5:0/3162038957 shutdown_connections 2024-08-31T05:32:45.938 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.932+0000 7f87e4a36640 1 --2- 172.21.15.5:0/3162038957 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f87c80b4cd0 0x7f87c80b71e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:45.938 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.932+0000 7f87e4a36640 1 --2- 172.21.15.5:0/3162038957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87e0109ad0 0x7f87e0075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:45.938 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.932+0000 7f87e4a36640 1 --2- 172.21.15.5:0/3162038957 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87e0109180 0x7f87e00759f0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:45.938 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.932+0000 7f87e4a36640 1 --2- 172.21.15.5:0/3162038957 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f87e0103850 0x7f87e00754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:45.938 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.932+0000 7f87e4a36640 1 -- 172.21.15.5:0/3162038957 >> 172.21.15.5:0/3162038957 conn(0x7f87e00ff290 msgr2=0x7f87e01016b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:45.938 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.932+0000 7f87e4a36640 1 -- 172.21.15.5:0/3162038957 shutdown_connections 2024-08-31T05:32:45.939 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:45.932+0000 7f87e4a36640 1 -- 172.21.15.5:0/3162038957 wait complete. 2024-08-31T05:32:46.911 INFO:tasks.workunit.client.0.smithi005.stdout: 1 241397 14.04 MB/sec warmup 94 sec latency 61.961 ms 2024-08-31T05:32:47.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:32:47 smithi005 ceph-mon[18602]: pgmap v429: 129 pgs: 129 active+clean; 120 MiB data, 836 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.4 MiB/s wr, 328 op/s 2024-08-31T05:32:47.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:32:47 smithi070 ceph-mon[22316]: pgmap v429: 129 pgs: 129 active+clean; 120 MiB data, 836 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.4 MiB/s wr, 328 op/s 2024-08-31T05:32:47.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:32:47 smithi050 ceph-mon[22146]: pgmap v429: 129 pgs: 129 active+clean; 120 MiB data, 836 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.4 MiB/s wr, 328 op/s 2024-08-31T05:32:47.911 INFO:tasks.workunit.client.0.smithi005.stdout: 1 243657 13.98 MB/sec warmup 95 sec latency 27.523 ms 2024-08-31T05:32:48.911 INFO:tasks.workunit.client.0.smithi005.stdout: 1 245858 13.98 MB/sec warmup 96 sec latency 16.368 ms 2024-08-31T05:32:49.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:32:49 smithi005 ceph-mon[18602]: pgmap v430: 129 pgs: 129 active+clean; 121 MiB data, 837 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.6 MiB/s wr, 264 op/s 2024-08-31T05:32:49.585 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:32:49 smithi070 ceph-mon[22316]: pgmap v430: 129 pgs: 129 active+clean; 121 MiB data, 837 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.6 MiB/s wr, 264 op/s 2024-08-31T05:32:49.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:32:49 smithi050 ceph-mon[22146]: pgmap v430: 129 pgs: 129 active+clean; 121 MiB data, 837 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.6 MiB/s wr, 264 op/s 2024-08-31T05:32:49.911 INFO:tasks.workunit.client.0.smithi005.stdout: 1 248786 14.02 MB/sec warmup 97 sec latency 16.365 ms 2024-08-31T05:32:50.911 INFO:tasks.workunit.client.0.smithi005.stdout: 1 251848 14.05 MB/sec warmup 98 sec latency 14.489 ms 2024-08-31T05:32:51.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:32:51 smithi005 ceph-mon[18602]: pgmap v431: 129 pgs: 129 active+clean; 127 MiB data, 905 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.4 MiB/s wr, 323 op/s 2024-08-31T05:32:51.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:32:51 smithi070 ceph-mon[22316]: pgmap v431: 129 pgs: 129 active+clean; 127 MiB data, 905 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.4 MiB/s wr, 323 op/s 2024-08-31T05:32:51.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:32:51 smithi050 ceph-mon[22146]: pgmap v431: 129 pgs: 129 active+clean; 127 MiB data, 905 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.4 MiB/s wr, 323 op/s 2024-08-31T05:32:51.911 INFO:tasks.workunit.client.0.smithi005.stdout: 1 253575 13.98 MB/sec warmup 99 sec latency 121.529 ms 2024-08-31T05:32:52.911 INFO:tasks.workunit.client.0.smithi005.stdout: 1 256082 13.98 MB/sec warmup 100 sec latency 19.067 ms 2024-08-31T05:32:53.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:32:53 smithi005 ceph-mon[18602]: pgmap v432: 129 pgs: 129 active+clean; 126 MiB data, 917 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.6 MiB/s wr, 280 op/s 2024-08-31T05:32:53.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:32:53 smithi070 ceph-mon[22316]: pgmap v432: 129 pgs: 129 active+clean; 126 MiB data, 917 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.6 MiB/s wr, 280 op/s 2024-08-31T05:32:53.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:32:53 smithi050 ceph-mon[22146]: pgmap v432: 129 pgs: 129 active+clean; 126 MiB data, 917 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.6 MiB/s wr, 280 op/s 2024-08-31T05:32:53.912 INFO:tasks.workunit.client.0.smithi005.stdout: 1 259190 14.03 MB/sec warmup 101 sec latency 16.599 ms 2024-08-31T05:32:54.912 INFO:tasks.workunit.client.0.smithi005.stdout: 1 261564 13.97 MB/sec warmup 102 sec latency 17.628 ms 2024-08-31T05:32:55.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:32:55 smithi005 ceph-mon[18602]: pgmap v433: 129 pgs: 129 active+clean; 130 MiB data, 922 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.6 MiB/s wr, 275 op/s 2024-08-31T05:32:55.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:32:55 smithi070 ceph-mon[22316]: pgmap v433: 129 pgs: 129 active+clean; 130 MiB data, 922 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.6 MiB/s wr, 275 op/s 2024-08-31T05:32:55.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:32:55 smithi050 ceph-mon[22146]: pgmap v433: 129 pgs: 129 active+clean; 130 MiB data, 922 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.6 MiB/s wr, 275 op/s 2024-08-31T05:32:55.911 INFO:tasks.workunit.client.0.smithi005.stdout: 1 263696 13.96 MB/sec warmup 103 sec latency 43.270 ms 2024-08-31T05:32:56.911 INFO:tasks.workunit.client.0.smithi005.stdout: 1 266352 13.99 MB/sec warmup 104 sec latency 59.460 ms 2024-08-31T05:32:57.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:32:57 smithi070 ceph-mon[22316]: pgmap v434: 129 pgs: 129 active+clean; 130 MiB data, 945 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.4 MiB/s wr, 317 op/s 2024-08-31T05:32:57.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:32:57 smithi050 ceph-mon[22146]: pgmap v434: 129 pgs: 129 active+clean; 130 MiB data, 945 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.4 MiB/s wr, 317 op/s 2024-08-31T05:32:57.716 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:32:57 smithi005 ceph-mon[18602]: pgmap v434: 129 pgs: 129 active+clean; 130 MiB data, 945 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.4 MiB/s wr, 317 op/s 2024-08-31T05:32:57.911 INFO:tasks.workunit.client.0.smithi005.stdout: 1 268828 13.96 MB/sec warmup 105 sec latency 21.268 ms 2024-08-31T05:32:58.912 INFO:tasks.workunit.client.0.smithi005.stdout: 1 271211 13.96 MB/sec warmup 106 sec latency 11.089 ms 2024-08-31T05:32:59.065 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.062+0000 7fccf952b640 1 -- 172.21.15.5:0/2403054086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccf41080a0 msgr2=0x7fccf41084b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:59.065 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.062+0000 7fccf952b640 1 --2- 172.21.15.5:0/2403054086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccf41080a0 0x7fccf41084b0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fcce8009900 tx=0x7fcce802a410 comp rx=0 tx=0).stop 2024-08-31T05:32:59.065 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.062+0000 7fccf952b640 1 -- 172.21.15.5:0/2403054086 shutdown_connections 2024-08-31T05:32:59.065 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.062+0000 7fccf952b640 1 --2- 172.21.15.5:0/2403054086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccf41089f0 0x7fccf410f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:59.065 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.062+0000 7fccf952b640 1 --2- 172.21.15.5:0/2403054086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccf41080a0 0x7fccf41084b0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:59.066 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.062+0000 7fccf952b640 1 --2- 172.21.15.5:0/2403054086 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fccf4102770 0x7fccf4102b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:59.066 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.063+0000 7fccf952b640 1 -- 172.21.15.5:0/2403054086 >> 172.21.15.5:0/2403054086 conn(0x7fccf407a4b0 msgr2=0x7fccf407a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:59.066 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.063+0000 7fccf952b640 1 -- 172.21.15.5:0/2403054086 shutdown_connections 2024-08-31T05:32:59.066 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.063+0000 7fccf952b640 1 -- 172.21.15.5:0/2403054086 wait complete. 2024-08-31T05:32:59.066 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.063+0000 7fccf952b640 1 Processor -- start 2024-08-31T05:32:59.068 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.064+0000 7fccf952b640 1 -- start start 2024-08-31T05:32:59.068 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.064+0000 7fccf952b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccf4102770 0x7fccf419af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:59.068 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.064+0000 7fccf952b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccf41080a0 0x7fccf419b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:59.068 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.064+0000 7fccf952b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fccf41089f0 0x7fccf419b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:59.068 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.064+0000 7fccf952b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fccf4112690 con 0x7fccf41080a0 2024-08-31T05:32:59.068 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.064+0000 7fccf952b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fccf4112510 con 0x7fccf4102770 2024-08-31T05:32:59.068 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.064+0000 7fccf952b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fccf4112810 con 0x7fccf41089f0 2024-08-31T05:32:59.068 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.064+0000 7fccf27fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccf41080a0 0x7fccf419b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:59.068 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.064+0000 7fccf2ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccf4102770 0x7fccf419af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:59.068 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.064+0000 7fccf27fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccf41080a0 0x7fccf419b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54888/0 (socket says 172.21.15.5:54888) 2024-08-31T05:32:59.068 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.064+0000 7fccf37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fccf41089f0 0x7fccf419b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:59.068 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.064+0000 7fccf27fc640 1 -- 172.21.15.5:0/3516085980 learned_addr learned my addr 172.21.15.5:0/3516085980 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:59.069 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.064+0000 7fccf27fc640 1 -- 172.21.15.5:0/3516085980 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fccf41089f0 msgr2=0x7fccf419b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:59.069 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.064+0000 7fccf27fc640 1 --2- 172.21.15.5:0/3516085980 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fccf41089f0 0x7fccf419b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:59.069 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.064+0000 7fccf27fc640 1 -- 172.21.15.5:0/3516085980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccf4102770 msgr2=0x7fccf419af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:59.069 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.064+0000 7fccf27fc640 1 --2- 172.21.15.5:0/3516085980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccf4102770 0x7fccf419af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:59.069 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.064+0000 7fccf27fc640 1 -- 172.21.15.5:0/3516085980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccf41a6250 con 0x7fccf41080a0 2024-08-31T05:32:59.069 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.064+0000 7fccf2ffd640 1 --2- 172.21.15.5:0/3516085980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccf4102770 0x7fccf419af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:32:59.069 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.065+0000 7fccf27fc640 1 --2- 172.21.15.5:0/3516085980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccf41080a0 0x7fccf419b480 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fcce8005ab0 tx=0x7fcce8003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:59.069 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.065+0000 7fccdbfff640 1 -- 172.21.15.5:0/3516085980 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce803f070 con 0x7fccf41080a0 2024-08-31T05:32:59.069 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.065+0000 7fccf952b640 1 -- 172.21.15.5:0/3516085980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccf41a64e0 con 0x7fccf41080a0 2024-08-31T05:32:59.069 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.065+0000 7fccdbfff640 1 -- 172.21.15.5:0/3516085980 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcce8031b50 con 0x7fccf41080a0 2024-08-31T05:32:59.069 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.065+0000 7fccdbfff640 1 -- 172.21.15.5:0/3516085980 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce8035030 con 0x7fccf41080a0 2024-08-31T05:32:59.070 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.065+0000 7fccf952b640 1 -- 172.21.15.5:0/3516085980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccf41a69d0 con 0x7fccf41080a0 2024-08-31T05:32:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.067+0000 7fcd0049a740 1 Processor -- start 2024-08-31T05:32:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.067+0000 7fcd0049a740 1 -- start start 2024-08-31T05:32:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.068+0000 7fcd0049a740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a159c461b0 0x55a159fe9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.068+0000 7fcd0049a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a159c1d2f0 0x55a159fea220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.068+0000 7fcd0049a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a159c254d0 0x55a159fea760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.068+0000 7fcd0049a740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55a159f5f000 con 0x55a159c461b0 2024-08-31T05:32:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.068+0000 7fcd0049a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a159f4e590 con 0x55a159c254d0 2024-08-31T05:32:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.068+0000 7fcd0049a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a159f52540 con 0x55a159c1d2f0 2024-08-31T05:32:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.068+0000 7fccdbfff640 1 -- 172.21.15.5:0/3516085980 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fcce8042070 con 0x7fccf41080a0 2024-08-31T05:32:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.068+0000 7fccf37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a159c461b0 0x55a159fe9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.068+0000 7fccf2ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a159c1d2f0 0x55a159fea220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.068+0000 7fccf37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a159c461b0 0x55a159fe9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54894/0 (socket says 172.21.15.5:54894) 2024-08-31T05:32:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.068+0000 7fccf37fe640 1 -- 172.21.15.5:0/4105509880 learned_addr learned my addr 172.21.15.5:0/4105509880 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.068+0000 7fccf27fc640 1 --2- 172.21.15.5:0/4105509880 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a159c254d0 0x55a159fea760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.068+0000 7fccf2ffd640 1 -- 172.21.15.5:0/4105509880 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a159c254d0 msgr2=0x55a159fea760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.068+0000 7fccf2ffd640 1 --2- 172.21.15.5:0/4105509880 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a159c254d0 0x55a159fea760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.068+0000 7fccf2ffd640 1 -- 172.21.15.5:0/4105509880 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a159c461b0 msgr2=0x55a159fe9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.068+0000 7fccf2ffd640 1 --2- 172.21.15.5:0/4105509880 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a159c461b0 0x55a159fe9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.068+0000 7fccf2ffd640 1 -- 172.21.15.5:0/4105509880 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a159cb1790 con 0x55a159c1d2f0 2024-08-31T05:32:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.068+0000 7fccf27fc640 1 --2- 172.21.15.5:0/4105509880 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a159c254d0 0x55a159fea760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:32:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.068+0000 7fccf2ffd640 1 --2- 172.21.15.5:0/4105509880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a159c1d2f0 0x55a159fea220 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcce4009fd0 tx=0x7fcce40118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3311246988973aad server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.069+0000 7fccd97fa640 1 -- 172.21.15.5:0/4105509880 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce4004030 con 0x55a159c1d2f0 2024-08-31T05:32:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.069+0000 7fccd97fa640 1 -- 172.21.15.5:0/4105509880 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcce40054d0 con 0x55a159c1d2f0 2024-08-31T05:32:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.069+0000 7fccd97fa640 1 -- 172.21.15.5:0/4105509880 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce4004be0 con 0x55a159c1d2f0 2024-08-31T05:32:59.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.069+0000 7fccdbfff640 1 --2- 172.21.15.5:0/3516085980 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fccdc0b4ca0 0x7fccdc0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:59.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.069+0000 7fccf37fe640 1 --2- 172.21.15.5:0/3516085980 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fccdc0b4ca0 0x7fccdc0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:59.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.069+0000 7fccdbfff640 1 -- 172.21.15.5:0/3516085980 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fcce8105eb0 con 0x7fccf41080a0 2024-08-31T05:32:59.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.070+0000 7fccf37fe640 1 --2- 172.21.15.5:0/3516085980 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fccdc0b4ca0 0x7fccdc0b71b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fccec0116b0 tx=0x7fccec009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:59.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.070+0000 7fcd0049a740 1 -- 172.21.15.5:0/4105509880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a159c1d2f0 msgr2=0x55a159fea220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:59.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.070+0000 7fcd0049a740 1 --2- 172.21.15.5:0/4105509880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a159c1d2f0 0x55a159fea220 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcce4009fd0 tx=0x7fcce40118d0 comp rx=0 tx=0).stop 2024-08-31T05:32:59.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.070+0000 7fcd0049a740 1 -- 172.21.15.5:0/4105509880 shutdown_connections 2024-08-31T05:32:59.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.070+0000 7fcd0049a740 1 --2- 172.21.15.5:0/4105509880 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a159c254d0 0x55a159fea760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:59.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.070+0000 7fcd0049a740 1 --2- 172.21.15.5:0/4105509880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a159c1d2f0 0x55a159fea220 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:59.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.070+0000 7fcd0049a740 1 --2- 172.21.15.5:0/4105509880 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a159c461b0 0x55a159fe9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:59.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.070+0000 7fcd0049a740 1 -- 172.21.15.5:0/4105509880 >> 172.21.15.5:0/4105509880 conn(0x55a159c3a300 msgr2=0x55a159fe7bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:59.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.070+0000 7fcd0049a740 1 -- 172.21.15.5:0/4105509880 shutdown_connections 2024-08-31T05:32:59.079 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.070+0000 7fcd0049a740 1 -- 172.21.15.5:0/4105509880 wait complete. 2024-08-31T05:32:59.079 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.070+0000 7fcd0049a740 1 -- start start 2024-08-31T05:32:59.079 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.070+0000 7fcd0049a740 1 Processor -- start 2024-08-31T05:32:59.079 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.071+0000 7fcd0049a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a159c1d2f0 0x55a159ff58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:59.079 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.071+0000 7fcd0049a740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a159c254d0 0x55a159ff5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:59.079 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.071+0000 7fcd0049a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a159c461b0 0x55a15a0017b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:59.079 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.071+0000 7fcd0049a740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55a159e87ab0 con 0x55a159c254d0 2024-08-31T05:32:59.079 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.071+0000 7fcd0049a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a159ed5680 con 0x55a159c1d2f0 2024-08-31T05:32:59.079 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.071+0000 7fcd0049a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a159ff8460 con 0x55a159c461b0 2024-08-31T05:32:59.079 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.071+0000 7fcd0049a740 10 client.0 _ll_register_callbacks cb 0x55a159c5da00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:32:59.079 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.071+0000 7fccf27fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a159c254d0 0x55a159ff5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:59.079 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.071+0000 7fccf2ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a159c1d2f0 0x55a159ff58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:59.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.071+0000 7fccf27fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a159c254d0 0x55a159ff5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54896/0 (socket says 172.21.15.5:54896) 2024-08-31T05:32:59.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.071+0000 7fccf37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a159c461b0 0x55a15a0017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:59.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.071+0000 7fccf27fc640 1 -- 172.21.15.5:0/779654560 learned_addr learned my addr 172.21.15.5:0/779654560 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:59.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.071+0000 7fccf27fc640 1 -- 172.21.15.5:0/779654560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a159c461b0 msgr2=0x55a15a0017b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:59.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.071+0000 7fccf27fc640 1 --2- 172.21.15.5:0/779654560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a159c461b0 0x55a15a0017b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:59.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.071+0000 7fccf27fc640 1 -- 172.21.15.5:0/779654560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a159c1d2f0 msgr2=0x55a159ff58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:59.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.071+0000 7fccf27fc640 1 --2- 172.21.15.5:0/779654560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a159c1d2f0 0x55a159ff58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:59.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.071+0000 7fccf27fc640 1 -- 172.21.15.5:0/779654560 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a159d2a620 con 0x55a159c254d0 2024-08-31T05:32:59.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.071+0000 7fccf2ffd640 1 --2- 172.21.15.5:0/779654560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a159c1d2f0 0x55a159ff58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:32:59.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.071+0000 7fccf27fc640 1 --2- 172.21.15.5:0/779654560 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a159c254d0 0x55a159ff5e00 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fcce8031440 tx=0x7fcce80c82c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4258a87c8c16fe2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:59.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.071+0000 7fccd6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:32:59.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.071+0000 7fccd6ff5640 1 -- 172.21.15.5:0/779654560 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce8049030 con 0x55a159c254d0 2024-08-31T05:32:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.071+0000 7fccd6ff5640 1 -- 172.21.15.5:0/779654560 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fcce80c8560 con 0x55a159c254d0 2024-08-31T05:32:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.071+0000 7fcd0049a740 1 -- 172.21.15.5:0/779654560 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcce40054d0 con 0x55a159c254d0 2024-08-31T05:32:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.072+0000 7fccd6ff5640 1 -- 172.21.15.5:0/779654560 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fcce80cbde0 con 0x55a159c254d0 2024-08-31T05:32:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.072+0000 7fcd0049a740 10 client.16338 fetch_fsmap learned FSMap version 32 2024-08-31T05:32:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.072+0000 7fcd0049a740 1 -- 172.21.15.5:0/779654560 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55a15a004470 con 0x55a159c254d0 2024-08-31T05:32:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.072+0000 7fccd6ff5640 1 -- 172.21.15.5:0/779654560 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcce40054d0 con 0x55a159c254d0 2024-08-31T05:32:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.072+0000 7fccd6ff5640 1 -- 172.21.15.5:0/779654560 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7fcce80cc530 con 0x55a159c254d0 2024-08-31T05:32:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.072+0000 7fcd0049a740 10 client.16338 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:32:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.072+0000 7fcd0049a740 10 client.16338 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:32:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.072+0000 7fcd0049a740 20 client.16338 populate_metadata read hostname 'smithi005' 2024-08-31T05:32:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.072+0000 7fcd0049a740 1 --2- 172.21.15.5:0/779654560 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a159c04d80 0x55a15a007b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.072+0000 7fcd0049a740 4 client.16338 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:32:59.082 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.072+0000 7fcd0049a740 1 -- 172.21.15.5:0/779654560 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a159f60f50 con 0x55a159c04d80 2024-08-31T05:32:59.082 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.072+0000 7fccf2ffd640 1 --2- 172.21.15.5:0/779654560 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a159c04d80 0x55a15a007b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:59.082 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.073+0000 7fccf2ffd640 1 --2- 172.21.15.5:0/779654560 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a159c04d80 0x55a15a007b60 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a14a03f77f82371 server_cookie=9a87d427acd6359e in_seq=0 out_seq=0 2024-08-31T05:32:59.082 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.073+0000 7fccd6ff5640 10 client.16338 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:32:59.082 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.073+0000 7fccd6ff5640 1 -- 172.21.15.5:0/779654560 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a159f60f50 con 0x55a159c04d80 2024-08-31T05:32:59.082 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.073+0000 7fccd6ff5640 10 client.16338 handle_command_reply: tid=0 2024-08-31T05:32:59.082 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.073+0000 7fcd0049a740 1 client.16338 shutdown 2024-08-31T05:32:59.082 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.073+0000 7fcd0049a740 1 -- 172.21.15.5:0/779654560 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a159c254d0 msgr2=0x55a159ff5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:59.082 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.073+0000 7fcd0049a740 1 --2- 172.21.15.5:0/779654560 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a159c254d0 0x55a159ff5e00 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fcce8031440 tx=0x7fcce80c82c0 comp rx=0 tx=0).stop 2024-08-31T05:32:59.082 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.073+0000 7fcd0049a740 1 -- 172.21.15.5:0/779654560 shutdown_connections 2024-08-31T05:32:59.082 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.073+0000 7fcd0049a740 1 --2- 172.21.15.5:0/779654560 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a159c04d80 0x55a15a007b60 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:59.082 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.073+0000 7fccd6ff5640 0 client.16338 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:32:59.082 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.073+0000 7fcd0049a740 1 --2- 172.21.15.5:0/779654560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a159c461b0 0x55a15a0017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:59.083 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.074+0000 7fcd0049a740 1 --2- 172.21.15.5:0/779654560 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a159c254d0 0x55a159ff5e00 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:59.083 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.074+0000 7fcd0049a740 1 --2- 172.21.15.5:0/779654560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a159c1d2f0 0x55a159ff58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:59.083 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.074+0000 7fcd0049a740 1 -- 172.21.15.5:0/779654560 >> 172.21.15.5:0/779654560 conn(0x55a159c3a300 msgr2=0x55a159fead10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:59.083 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.074+0000 7fcd0049a740 1 -- 172.21.15.5:0/779654560 shutdown_connections 2024-08-31T05:32:59.083 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.074+0000 7fcd0049a740 1 -- 172.21.15.5:0/779654560 wait complete. 2024-08-31T05:32:59.083 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.074+0000 7fcd0049a740 20 client.16338 trim_cache size 0 max 16384 2024-08-31T05:32:59.094 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.090+0000 7fcd0049a740 1 Processor -- start 2024-08-31T05:32:59.094 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.090+0000 7fcd0049a740 1 -- start start 2024-08-31T05:32:59.094 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.090+0000 7fcd0049a740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a159c04d80 0x55a159ff0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:59.094 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.090+0000 7fcd0049a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a159c1d2f0 0x55a159feb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:59.094 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.090+0000 7fcd0049a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a159c254d0 0x55a15a0016b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:59.094 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.090+0000 7fcd0049a740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fccf41b0b90 con 0x55a159c04d80 2024-08-31T05:32:59.094 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.090+0000 7fcd0049a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fccf41b2790 con 0x55a159c1d2f0 2024-08-31T05:32:59.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.090+0000 7fcd0049a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fccf41b1260 con 0x55a159c254d0 2024-08-31T05:32:59.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.090+0000 7fccf2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a159c04d80 0x55a159ff0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:59.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.090+0000 7fccf2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a159c04d80 0x55a159ff0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54898/0 (socket says 172.21.15.5:54898) 2024-08-31T05:32:59.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.090+0000 7fccf27fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a159c1d2f0 0x55a159feb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:59.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.090+0000 7fccf2ffd640 1 -- 172.21.15.5:0/545507110 learned_addr learned my addr 172.21.15.5:0/545507110 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:59.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.090+0000 7fccf37fe640 1 --2- 172.21.15.5:0/545507110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a159c254d0 0x55a15a0016b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:59.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.090+0000 7fccf2ffd640 1 -- 172.21.15.5:0/545507110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a159c254d0 msgr2=0x55a15a0016b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:59.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.090+0000 7fccf2ffd640 1 --2- 172.21.15.5:0/545507110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a159c254d0 0x55a15a0016b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:59.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.090+0000 7fccf2ffd640 1 -- 172.21.15.5:0/545507110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a159c1d2f0 msgr2=0x55a159feb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:59.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.090+0000 7fccf2ffd640 1 --2- 172.21.15.5:0/545507110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a159c1d2f0 0x55a159feb6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:59.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.090+0000 7fccf2ffd640 1 -- 172.21.15.5:0/545507110 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a159fecaf0 con 0x55a159c04d80 2024-08-31T05:32:59.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.090+0000 7fccf27fc640 1 --2- 172.21.15.5:0/545507110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a159c1d2f0 0x55a159feb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:32:59.096 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.091+0000 7fccf2ffd640 1 --2- 172.21.15.5:0/545507110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a159c04d80 0x55a159ff0e20 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fcce4011dd0 tx=0x7fcce40118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c5674cd8ec4a346 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:59.096 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.091+0000 7fccd8ff9640 1 -- 172.21.15.5:0/545507110 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce402f030 con 0x55a159c04d80 2024-08-31T05:32:59.096 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.091+0000 7fccd8ff9640 1 -- 172.21.15.5:0/545507110 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcce4009b50 con 0x55a159c04d80 2024-08-31T05:32:59.096 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.091+0000 7fccd8ff9640 1 -- 172.21.15.5:0/545507110 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce4019b40 con 0x55a159c04d80 2024-08-31T05:32:59.096 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.092+0000 7fcd0049a740 1 -- 172.21.15.5:0/545507110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a159c04d80 msgr2=0x55a159ff0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:59.096 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.092+0000 7fcd0049a740 1 --2- 172.21.15.5:0/545507110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a159c04d80 0x55a159ff0e20 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fcce4011dd0 tx=0x7fcce40118d0 comp rx=0 tx=0).stop 2024-08-31T05:32:59.096 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.092+0000 7fcd0049a740 1 -- 172.21.15.5:0/545507110 shutdown_connections 2024-08-31T05:32:59.096 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.092+0000 7fcd0049a740 1 --2- 172.21.15.5:0/545507110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a159c254d0 0x55a15a0016b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:59.096 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.092+0000 7fcd0049a740 1 --2- 172.21.15.5:0/545507110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a159c1d2f0 0x55a159feb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:59.096 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.092+0000 7fcd0049a740 1 --2- 172.21.15.5:0/545507110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a159c04d80 0x55a159ff0e20 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:59.096 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.092+0000 7fcd0049a740 1 -- 172.21.15.5:0/545507110 >> 172.21.15.5:0/545507110 conn(0x55a159c3a300 msgr2=0x55a159ff6bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:59.096 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.092+0000 7fcd0049a740 1 -- 172.21.15.5:0/545507110 shutdown_connections 2024-08-31T05:32:59.096 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.092+0000 7fcd0049a740 1 -- 172.21.15.5:0/545507110 wait complete. 2024-08-31T05:32:59.097 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.092+0000 7fcd0049a740 1 -- start start 2024-08-31T05:32:59.097 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.092+0000 7fcd0049a740 1 Processor -- start 2024-08-31T05:32:59.099 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.093+0000 7fcd0049a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a159c04d80 0x55a159ff8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:59.099 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.093+0000 7fcd0049a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a159c1d2f0 0x55a159ff9550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:59.099 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.093+0000 7fcd0049a740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a159c254d0 0x55a15a070510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:59.099 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.093+0000 7fcd0049a740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fccf41b2000 con 0x55a159c254d0 2024-08-31T05:32:59.100 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.093+0000 7fcd0049a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fccf41b1930 con 0x55a159c1d2f0 2024-08-31T05:32:59.100 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.093+0000 7fcd0049a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fccf41aeb70 con 0x55a159c04d80 2024-08-31T05:32:59.100 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.093+0000 7fcd0049a740 10 client.0 _ll_register_callbacks cb 0x7fcce8005d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:32:59.100 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.093+0000 7fccf2ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a159c04d80 0x55a159ff8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:59.100 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.093+0000 7fccf27fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a159c1d2f0 0x55a159ff9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:59.100 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.093+0000 7fccf2ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a159c04d80 0x55a159ff8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:36544/0 (socket says 172.21.15.5:36544) 2024-08-31T05:32:59.100 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.093+0000 7fccf2ffd640 1 -- 172.21.15.5:0/967718572 learned_addr learned my addr 172.21.15.5:0/967718572 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:32:59.100 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.093+0000 7fccf27fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a159c1d2f0 0x55a159ff9550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:44726/0 (socket says 172.21.15.5:44726) 2024-08-31T05:32:59.100 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.093+0000 7fccf37fe640 1 --2- 172.21.15.5:0/967718572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a159c254d0 0x55a15a070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:59.100 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.093+0000 7fccf2ffd640 1 -- 172.21.15.5:0/967718572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a159c1d2f0 msgr2=0x55a159ff9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:59.100 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.093+0000 7fccf2ffd640 1 --2- 172.21.15.5:0/967718572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a159c1d2f0 0x55a159ff9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:59.100 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.093+0000 7fccf2ffd640 1 -- 172.21.15.5:0/967718572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a159c254d0 msgr2=0x55a15a070510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:32:59.100 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.093+0000 7fccf2ffd640 1 --2- 172.21.15.5:0/967718572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a159c254d0 0x55a15a070510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.093+0000 7fccf2ffd640 1 -- 172.21.15.5:0/967718572 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a15a070bb0 con 0x55a159c04d80 2024-08-31T05:32:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.093+0000 7fccf2ffd640 1 --2- 172.21.15.5:0/967718572 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a159c04d80 0x55a159ff8f70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcce4009700 tx=0x7fcce400fbb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d79d1940b758fd72 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:32:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.093+0000 7fccd6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:32:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.093+0000 7fccd6ff5640 1 -- 172.21.15.5:0/967718572 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce402f040 con 0x55a159c04d80 2024-08-31T05:32:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.094+0000 7fcd0049a740 1 -- 172.21.15.5:0/967718572 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcce4009b50 con 0x55a159c04d80 2024-08-31T05:32:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.094+0000 7fccd6ff5640 1 -- 172.21.15.5:0/967718572 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fcce4019450 con 0x55a159c04d80 2024-08-31T05:32:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.094+0000 7fccd6ff5640 1 -- 172.21.15.5:0/967718572 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fcce4043050 con 0x55a159c04d80 2024-08-31T05:32:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.094+0000 7fcd0049a740 10 client.25945 fetch_fsmap learned FSMap version 32 2024-08-31T05:32:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.094+0000 7fcd0049a740 1 -- 172.21.15.5:0/967718572 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55a15a071e20 con 0x55a159c04d80 2024-08-31T05:32:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.094+0000 7fccd6ff5640 1 -- 172.21.15.5:0/967718572 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcce4009b50 con 0x55a159c04d80 2024-08-31T05:32:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.094+0000 7fccd6ff5640 1 -- 172.21.15.5:0/967718572 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7fcce40042e0 con 0x55a159c04d80 2024-08-31T05:32:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.094+0000 7fcd0049a740 10 client.25945 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:32:59.101 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.094+0000 7fcd0049a740 10 client.25945 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:32:59.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.094+0000 7fcd0049a740 20 client.25945 populate_metadata read hostname 'smithi005' 2024-08-31T05:32:59.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.094+0000 7fcd0049a740 1 --2- 172.21.15.5:0/967718572 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a159c461b0 0x55a15a0743c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:32:59.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.094+0000 7fcd0049a740 4 client.25945 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:32:59.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.094+0000 7fcd0049a740 1 -- 172.21.15.5:0/967718572 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a159f5c9f0 con 0x55a159c461b0 2024-08-31T05:32:59.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.094+0000 7fccf27fc640 1 --2- 172.21.15.5:0/967718572 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a159c461b0 0x55a15a0743c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:32:59.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.095+0000 7fccd6ff5640 10 client.25945 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:32:59.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.095+0000 7fccf27fc640 1 --2- 172.21.15.5:0/967718572 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a159c461b0 0x55a15a0743c0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd6cd003efea033e server_cookie=ef8c30d77b882ca5 in_seq=0 out_seq=0 2024-08-31T05:32:59.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.103+0000 7fccd6ff5640 1 -- 172.21.15.5:0/967718572 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a159f5c9f0 con 0x55a159c461b0 2024-08-31T05:32:59.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.103+0000 7fccd6ff5640 10 client.25945 handle_command_reply: tid=0 2024-08-31T05:32:59.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.103+0000 7fcd0049a740 1 client.25945 shutdown 2024-08-31T05:32:59.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.104+0000 7fcd0049a740 1 -- 172.21.15.5:0/967718572 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a159c04d80 msgr2=0x55a159ff8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:59.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.104+0000 7fcd0049a740 1 --2- 172.21.15.5:0/967718572 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a159c04d80 0x55a159ff8f70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcce4009700 tx=0x7fcce400fbb0 comp rx=0 tx=0).stop 2024-08-31T05:32:59.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.104+0000 7fcd0049a740 1 -- 172.21.15.5:0/967718572 shutdown_connections 2024-08-31T05:32:59.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.104+0000 7fcd0049a740 1 --2- 172.21.15.5:0/967718572 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a159c461b0 0x55a15a0743c0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:59.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.104+0000 7fcd0049a740 1 --2- 172.21.15.5:0/967718572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a159c254d0 0x55a15a070510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:59.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.104+0000 7fcd0049a740 1 --2- 172.21.15.5:0/967718572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a159c1d2f0 0x55a159ff9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:59.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.104+0000 7fccd6ff5640 0 client.25945 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:32:59.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.104+0000 7fcd0049a740 1 --2- 172.21.15.5:0/967718572 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a159c04d80 0x55a159ff8f70 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:59.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.104+0000 7fcd0049a740 1 -- 172.21.15.5:0/967718572 >> 172.21.15.5:0/967718572 conn(0x55a159c3a300 msgr2=0x55a159ff6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:59.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.104+0000 7fcd0049a740 1 -- 172.21.15.5:0/967718572 shutdown_connections 2024-08-31T05:32:59.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.104+0000 7fcd0049a740 1 -- 172.21.15.5:0/967718572 wait complete. 2024-08-31T05:32:59.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.104+0000 7fcd0049a740 20 client.25945 trim_cache size 0 max 16384 2024-08-31T05:32:59.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:32:59.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:32:59.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:32:59.108 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:32:59.108 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.104+0000 7fccf952b640 1 -- 172.21.15.5:0/3516085980 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fccdc0b4ca0 msgr2=0x7fccdc0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:59.108 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.104+0000 7fccf952b640 1 --2- 172.21.15.5:0/3516085980 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fccdc0b4ca0 0x7fccdc0b71b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fccec0116b0 tx=0x7fccec009500 comp rx=0 tx=0).stop 2024-08-31T05:32:59.109 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.104+0000 7fccf952b640 1 -- 172.21.15.5:0/3516085980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccf41080a0 msgr2=0x7fccf419b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:32:59.109 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.104+0000 7fccf952b640 1 --2- 172.21.15.5:0/3516085980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccf41080a0 0x7fccf419b480 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fcce8005ab0 tx=0x7fcce8003b90 comp rx=0 tx=0).stop 2024-08-31T05:32:59.109 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.104+0000 7fccf952b640 1 -- 172.21.15.5:0/3516085980 shutdown_connections 2024-08-31T05:32:59.109 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.104+0000 7fccf952b640 1 --2- 172.21.15.5:0/3516085980 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fccdc0b4ca0 0x7fccdc0b71b0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:59.109 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.104+0000 7fccf952b640 1 --2- 172.21.15.5:0/3516085980 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fccf41089f0 0x7fccf419b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:59.109 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.104+0000 7fccf952b640 1 --2- 172.21.15.5:0/3516085980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccf41080a0 0x7fccf419b480 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:59.109 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.104+0000 7fccf952b640 1 --2- 172.21.15.5:0/3516085980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fccf4102770 0x7fccf419af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:32:59.109 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.105+0000 7fccf952b640 1 -- 172.21.15.5:0/3516085980 >> 172.21.15.5:0/3516085980 conn(0x7fccf407a4b0 msgr2=0x7fccf41040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:32:59.109 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.105+0000 7fccf952b640 1 -- 172.21.15.5:0/3516085980 shutdown_connections 2024-08-31T05:32:59.109 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:32:59.105+0000 7fccf952b640 1 -- 172.21.15.5:0/3516085980 wait complete. 2024-08-31T05:32:59.585 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:32:59 smithi070 ceph-mon[22316]: pgmap v435: 129 pgs: 129 active+clean; 136 MiB data, 976 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.7 MiB/s wr, 279 op/s 2024-08-31T05:32:59.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:32:59 smithi050 ceph-mon[22146]: pgmap v435: 129 pgs: 129 active+clean; 136 MiB data, 976 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.7 MiB/s wr, 279 op/s 2024-08-31T05:32:59.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:32:59 smithi005 ceph-mon[18602]: pgmap v435: 129 pgs: 129 active+clean; 136 MiB data, 976 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.7 MiB/s wr, 279 op/s 2024-08-31T05:32:59.912 INFO:tasks.workunit.client.0.smithi005.stdout: 1 273837 13.96 MB/sec warmup 107 sec latency 18.532 ms 2024-08-31T05:33:00.912 INFO:tasks.workunit.client.0.smithi005.stdout: 1 276949 14.00 MB/sec warmup 108 sec latency 15.107 ms 2024-08-31T05:33:01.585 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:33:01 smithi070 ceph-mon[22316]: pgmap v436: 129 pgs: 129 active+clean; 138 MiB data, 994 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.5 MiB/s wr, 338 op/s 2024-08-31T05:33:01.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:33:01 smithi050 ceph-mon[22146]: pgmap v436: 129 pgs: 129 active+clean; 138 MiB data, 994 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.5 MiB/s wr, 338 op/s 2024-08-31T05:33:01.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:33:01 smithi005 ceph-mon[18602]: pgmap v436: 129 pgs: 129 active+clean; 138 MiB data, 994 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.5 MiB/s wr, 338 op/s 2024-08-31T05:33:01.912 INFO:tasks.workunit.client.0.smithi005.stdout: 1 277722 13.89 MB/sec warmup 109 sec latency 54.895 ms 2024-08-31T05:33:02.912 INFO:tasks.workunit.client.0.smithi005.stdout: 1 279888 13.87 MB/sec warmup 110 sec latency 91.034 ms 2024-08-31T05:33:03.107 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T05:33:03.369 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:33:03.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:33:03 smithi005 ceph-mon[18602]: pgmap v437: 129 pgs: 129 active+clean; 138 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.2 MiB/s wr, 241 op/s 2024-08-31T05:33:03.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:33:03 smithi070 ceph-mon[22316]: pgmap v437: 129 pgs: 129 active+clean; 138 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.2 MiB/s wr, 241 op/s 2024-08-31T05:33:03.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:33:03 smithi050 ceph-mon[22146]: pgmap v437: 129 pgs: 129 active+clean; 138 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.2 MiB/s wr, 241 op/s 2024-08-31T05:33:03.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.880+0000 7fb425bbd640 1 -- 172.21.15.5:0/819553167 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4201081c0 msgr2=0x7fb4201085d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:03.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.880+0000 7fb425bbd640 1 --2- 172.21.15.5:0/819553167 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4201081c0 0x7fb4201085d0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fb408009860 tx=0x7fb40802a340 comp rx=0 tx=0).stop 2024-08-31T05:33:03.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.880+0000 7fb425bbd640 1 -- 172.21.15.5:0/819553167 shutdown_connections 2024-08-31T05:33:03.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.880+0000 7fb425bbd640 1 --2- 172.21.15.5:0/819553167 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb420108b10 0x7fb42010f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:03.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.880+0000 7fb425bbd640 1 --2- 172.21.15.5:0/819553167 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4201081c0 0x7fb4201085d0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:03.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.880+0000 7fb425bbd640 1 --2- 172.21.15.5:0/819553167 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb420102880 0x7fb420102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:03.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.880+0000 7fb425bbd640 1 -- 172.21.15.5:0/819553167 >> 172.21.15.5:0/819553167 conn(0x7fb420079510 msgr2=0x7fb420079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:03.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.880+0000 7fb425bbd640 1 -- 172.21.15.5:0/819553167 shutdown_connections 2024-08-31T05:33:03.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.880+0000 7fb425bbd640 1 -- 172.21.15.5:0/819553167 wait complete. 2024-08-31T05:33:03.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.881+0000 7fb425bbd640 1 Processor -- start 2024-08-31T05:33:03.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.881+0000 7fb425bbd640 1 -- start start 2024-08-31T05:33:03.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.881+0000 7fb425bbd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb420102880 0x7fb42019c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:03.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.881+0000 7fb425bbd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4201081c0 0x7fb42019ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:03.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.881+0000 7fb425bbd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb420108b10 0x7fb4201a1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:03.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.881+0000 7fb425bbd640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb420112780 con 0x7fb4201081c0 2024-08-31T05:33:03.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.881+0000 7fb425bbd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb420112600 con 0x7fb420102880 2024-08-31T05:33:03.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.881+0000 7fb425bbd640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb420112900 con 0x7fb420108b10 2024-08-31T05:33:03.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.881+0000 7fb41f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb420102880 0x7fb42019c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:03.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.881+0000 7fb41ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb420108b10 0x7fb4201a1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:03.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.881+0000 7fb41effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4201081c0 0x7fb42019ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:03.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.881+0000 7fb41ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb420108b10 0x7fb4201a1ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:58822/0 (socket says 172.21.15.5:58822) 2024-08-31T05:33:03.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.881+0000 7fb41f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb420102880 0x7fb42019c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:38100/0 (socket says 172.21.15.5:38100) 2024-08-31T05:33:03.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.881+0000 7fb41ffff640 1 -- 172.21.15.5:0/2734526104 learned_addr learned my addr 172.21.15.5:0/2734526104 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:03.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.882+0000 7fb41effd640 1 -- 172.21.15.5:0/2734526104 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb420108b10 msgr2=0x7fb4201a1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:03.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.882+0000 7fb41effd640 1 --2- 172.21.15.5:0/2734526104 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb420108b10 0x7fb4201a1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:03.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.882+0000 7fb41effd640 1 -- 172.21.15.5:0/2734526104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb420102880 msgr2=0x7fb42019c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:03.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.882+0000 7fb41effd640 1 --2- 172.21.15.5:0/2734526104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb420102880 0x7fb42019c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:03.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.882+0000 7fb41effd640 1 -- 172.21.15.5:0/2734526104 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4201a2410 con 0x7fb4201081c0 2024-08-31T05:33:03.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.882+0000 7fb41ffff640 1 --2- 172.21.15.5:0/2734526104 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb420108b10 0x7fb4201a1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:03.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.882+0000 7fb41effd640 1 --2- 172.21.15.5:0/2734526104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4201081c0 0x7fb42019ca40 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fb40802a860 tx=0x7fb408032d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:03.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.882+0000 7fb41cff9640 1 -- 172.21.15.5:0/2734526104 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb408040020 con 0x7fb4201081c0 2024-08-31T05:33:03.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.882+0000 7fb425bbd640 1 -- 172.21.15.5:0/2734526104 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4201a26a0 con 0x7fb4201081c0 2024-08-31T05:33:03.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.882+0000 7fb41cff9640 1 -- 172.21.15.5:0/2734526104 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb408030d50 con 0x7fb4201081c0 2024-08-31T05:33:03.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.882+0000 7fb41cff9640 1 -- 172.21.15.5:0/2734526104 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb408037040 con 0x7fb4201081c0 2024-08-31T05:33:03.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.882+0000 7fb425bbd640 1 -- 172.21.15.5:0/2734526104 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4201a8e60 con 0x7fb4201081c0 2024-08-31T05:33:03.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.885+0000 7fb41cff9640 1 -- 172.21.15.5:0/2734526104 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fb408043020 con 0x7fb4201081c0 2024-08-31T05:33:03.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.885+0000 7fb42c132740 1 Processor -- start 2024-08-31T05:33:03.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.885+0000 7fb42c132740 1 -- start start 2024-08-31T05:33:03.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.886+0000 7fb42c132740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55876f544070 0x55876f8e92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:03.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.886+0000 7fb42c132740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55876f51b1b0 0x55876f8e9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:03.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.886+0000 7fb42c132740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55876f523390 0x55876f8e9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:03.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.886+0000 7fb42c132740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55876f860630 con 0x55876f523390 2024-08-31T05:33:03.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.886+0000 7fb42c132740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55876f84fbc0 con 0x55876f51b1b0 2024-08-31T05:33:03.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.886+0000 7fb42c132740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55876f853b70 con 0x55876f544070 2024-08-31T05:33:03.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.886+0000 7fb41ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55876f544070 0x55876f8e92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:03.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.886+0000 7fb41ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55876f544070 0x55876f8e92c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:58824/0 (socket says 172.21.15.5:58824) 2024-08-31T05:33:03.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.886+0000 7fb41effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55876f523390 0x55876f8e9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:03.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.886+0000 7fb41ffff640 1 -- 172.21.15.5:0/1576311178 learned_addr learned my addr 172.21.15.5:0/1576311178 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:03.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.886+0000 7fb41f7fe640 1 --2- 172.21.15.5:0/1576311178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55876f51b1b0 0x55876f8e9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:03.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.886+0000 7fb41ffff640 1 -- 172.21.15.5:0/1576311178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55876f51b1b0 msgr2=0x55876f8e9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:03.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.886+0000 7fb41ffff640 1 --2- 172.21.15.5:0/1576311178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55876f51b1b0 0x55876f8e9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:03.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.886+0000 7fb41ffff640 1 -- 172.21.15.5:0/1576311178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55876f523390 msgr2=0x55876f8e9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:03.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.886+0000 7fb41ffff640 1 --2- 172.21.15.5:0/1576311178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55876f523390 0x55876f8e9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:03.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.886+0000 7fb41ffff640 1 -- 172.21.15.5:0/1576311178 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55876f5af650 con 0x55876f544070 2024-08-31T05:33:03.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.886+0000 7fb41f7fe640 1 --2- 172.21.15.5:0/1576311178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55876f51b1b0 0x55876f8e9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:03.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.886+0000 7fb41ffff640 1 --2- 172.21.15.5:0/1576311178 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55876f544070 0x55876f8e92c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb4180118b0 tx=0x7fb418011d70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e471ac8d342bc438 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:03.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.887+0000 7fb41cff9640 1 --2- 172.21.15.5:0/2734526104 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb40c0b4ca0 0x7fb40c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:03.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.887+0000 7fb415ffb640 1 -- 172.21.15.5:0/1576311178 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb41801e070 con 0x55876f544070 2024-08-31T05:33:03.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.887+0000 7fb415ffb640 1 -- 172.21.15.5:0/1576311178 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb41800fe70 con 0x55876f544070 2024-08-31T05:33:03.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.887+0000 7fb415ffb640 1 -- 172.21.15.5:0/1576311178 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb418019d30 con 0x55876f544070 2024-08-31T05:33:03.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.887+0000 7fb41f7fe640 1 --2- 172.21.15.5:0/2734526104 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb40c0b4ca0 0x7fb40c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:03.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.887+0000 7fb41cff9640 1 -- 172.21.15.5:0/2734526104 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fb4081053e0 con 0x7fb4201081c0 2024-08-31T05:33:03.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.888+0000 7fb42c132740 1 -- 172.21.15.5:0/1576311178 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55876f544070 msgr2=0x55876f8e92c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:03.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.888+0000 7fb41f7fe640 1 --2- 172.21.15.5:0/2734526104 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb40c0b4ca0 0x7fb40c0b71b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x55876f8e7f40 tx=0x7fb410009260 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:03.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.888+0000 7fb42c132740 1 --2- 172.21.15.5:0/1576311178 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55876f544070 0x55876f8e92c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb4180118b0 tx=0x7fb418011d70 comp rx=0 tx=0).stop 2024-08-31T05:33:03.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.888+0000 7fb42c132740 1 -- 172.21.15.5:0/1576311178 shutdown_connections 2024-08-31T05:33:03.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.888+0000 7fb42c132740 1 --2- 172.21.15.5:0/1576311178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55876f523390 0x55876f8e9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:03.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.888+0000 7fb42c132740 1 --2- 172.21.15.5:0/1576311178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55876f51b1b0 0x55876f8e9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:03.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.888+0000 7fb42c132740 1 --2- 172.21.15.5:0/1576311178 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55876f544070 0x55876f8e92c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:03.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.888+0000 7fb42c132740 1 -- 172.21.15.5:0/1576311178 >> 172.21.15.5:0/1576311178 conn(0x55876f538460 msgr2=0x55876f8e71b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:03.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.888+0000 7fb42c132740 1 -- 172.21.15.5:0/1576311178 shutdown_connections 2024-08-31T05:33:03.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.888+0000 7fb42c132740 1 -- 172.21.15.5:0/1576311178 wait complete. 2024-08-31T05:33:03.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.888+0000 7fb42c132740 1 -- start start 2024-08-31T05:33:03.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.888+0000 7fb42c132740 1 Processor -- start 2024-08-31T05:33:03.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.889+0000 7fb42c132740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55876f51b1b0 0x55876f8f4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:03.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.889+0000 7fb42c132740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55876f523390 0x55876f8f4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:03.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.889+0000 7fb42c132740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55876f544070 0x55876f900d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:03.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.889+0000 7fb42c132740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55876f6b2700 con 0x55876f544070 2024-08-31T05:33:03.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.889+0000 7fb42c132740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55876f7d6700 con 0x55876f523390 2024-08-31T05:33:03.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.889+0000 7fb42c132740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55876f8f7aa0 con 0x55876f51b1b0 2024-08-31T05:33:03.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.889+0000 7fb42c132740 10 client.0 _ll_register_callbacks cb 0x55876f805dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:33:03.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.889+0000 7fb41f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55876f51b1b0 0x55876f8f4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:03.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.889+0000 7fb41f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55876f51b1b0 0x55876f8f4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:58836/0 (socket says 172.21.15.5:58836) 2024-08-31T05:33:03.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.889+0000 7fb41f7fe640 1 -- 172.21.15.5:0/3024470265 learned_addr learned my addr 172.21.15.5:0/3024470265 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:03.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.889+0000 7fb41ffff640 1 --2- 172.21.15.5:0/3024470265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55876f544070 0x55876f900d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:03.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.889+0000 7fb41effd640 1 --2- 172.21.15.5:0/3024470265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55876f523390 0x55876f8f4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:03.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.889+0000 7fb41ffff640 1 -- 172.21.15.5:0/3024470265 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55876f51b1b0 msgr2=0x55876f8f4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:03.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.889+0000 7fb41ffff640 1 --2- 172.21.15.5:0/3024470265 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55876f51b1b0 0x55876f8f4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:03.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.889+0000 7fb41ffff640 1 -- 172.21.15.5:0/3024470265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55876f523390 msgr2=0x55876f8f4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:03.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.889+0000 7fb41ffff640 1 --2- 172.21.15.5:0/3024470265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55876f523390 0x55876f8f4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:03.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.889+0000 7fb41ffff640 1 -- 172.21.15.5:0/3024470265 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55876f80f8b0 con 0x55876f544070 2024-08-31T05:33:03.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.889+0000 7fb41ffff640 1 --2- 172.21.15.5:0/3024470265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55876f544070 0x55876f900d90 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fb418011880 tx=0x7fb41800fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c937acf8a79e8838 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:03.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.889+0000 7fb3feffd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:33:03.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.890+0000 7fb3feffd640 1 -- 172.21.15.5:0/3024470265 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb41801e030 con 0x55876f544070 2024-08-31T05:33:03.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.890+0000 7fb3feffd640 1 -- 172.21.15.5:0/3024470265 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fb418004c50 con 0x55876f544070 2024-08-31T05:33:03.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.890+0000 7fb42c132740 1 -- 172.21.15.5:0/3024470265 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb41800fe70 con 0x55876f544070 2024-08-31T05:33:03.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.890+0000 7fb3feffd640 1 -- 172.21.15.5:0/3024470265 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fb418030050 con 0x55876f544070 2024-08-31T05:33:03.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.890+0000 7fb42c132740 10 client.16356 fetch_fsmap learned FSMap version 32 2024-08-31T05:33:03.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.890+0000 7fb42c132740 1 -- 172.21.15.5:0/3024470265 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55876f903850 con 0x55876f544070 2024-08-31T05:33:03.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.890+0000 7fb3feffd640 1 -- 172.21.15.5:0/3024470265 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb41800fe70 con 0x55876f544070 2024-08-31T05:33:03.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.890+0000 7fb3feffd640 1 -- 172.21.15.5:0/3024470265 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7fb4180057d0 con 0x55876f544070 2024-08-31T05:33:03.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.890+0000 7fb42c132740 10 client.16356 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:33:03.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.890+0000 7fb42c132740 10 client.16356 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:33:03.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.890+0000 7fb42c132740 20 client.16356 populate_metadata read hostname 'smithi005' 2024-08-31T05:33:03.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.890+0000 7fb42c132740 1 --2- 172.21.15.5:0/3024470265 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55876f5029f0 0x55876f906c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:03.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.890+0000 7fb42c132740 4 client.16356 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:33:03.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.890+0000 7fb42c132740 1 -- 172.21.15.5:0/3024470265 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55876f862580 con 0x55876f5029f0 2024-08-31T05:33:03.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.891+0000 7fb41f7fe640 1 --2- 172.21.15.5:0/3024470265 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55876f5029f0 0x55876f906c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:03.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.891+0000 7fb3feffd640 10 client.16356 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:33:03.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.891+0000 7fb41f7fe640 1 --2- 172.21.15.5:0/3024470265 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55876f5029f0 0x55876f906c60 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8987803517c886ef server_cookie=41a5c9e2503c4b43 in_seq=0 out_seq=0 2024-08-31T05:33:03.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.892+0000 7fb3feffd640 1 -- 172.21.15.5:0/3024470265 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55876f862580 con 0x55876f5029f0 2024-08-31T05:33:03.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.892+0000 7fb3feffd640 10 client.16356 handle_command_reply: tid=0 2024-08-31T05:33:03.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.892+0000 7fb42c132740 1 client.16356 shutdown 2024-08-31T05:33:03.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.892+0000 7fb42c132740 1 -- 172.21.15.5:0/3024470265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55876f544070 msgr2=0x55876f900d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:03.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.892+0000 7fb42c132740 1 --2- 172.21.15.5:0/3024470265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55876f544070 0x55876f900d90 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fb418011880 tx=0x7fb41800fda0 comp rx=0 tx=0).stop 2024-08-31T05:33:03.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.892+0000 7fb42c132740 1 -- 172.21.15.5:0/3024470265 shutdown_connections 2024-08-31T05:33:03.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.892+0000 7fb42c132740 1 --2- 172.21.15.5:0/3024470265 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55876f5029f0 0x55876f906c60 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:03.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.892+0000 7fb42c132740 1 --2- 172.21.15.5:0/3024470265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55876f544070 0x55876f900d90 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:03.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.892+0000 7fb42c132740 1 --2- 172.21.15.5:0/3024470265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55876f523390 0x55876f8f4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:03.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.892+0000 7fb42c132740 1 --2- 172.21.15.5:0/3024470265 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55876f51b1b0 0x55876f8f4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:03.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.892+0000 7fb42c132740 1 -- 172.21.15.5:0/3024470265 >> 172.21.15.5:0/3024470265 conn(0x55876f538460 msgr2=0x55876f8ec450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:03.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.892+0000 7fb3feffd640 0 client.16356 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:33:03.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.892+0000 7fb42c132740 1 -- 172.21.15.5:0/3024470265 shutdown_connections 2024-08-31T05:33:03.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.892+0000 7fb42c132740 1 -- 172.21.15.5:0/3024470265 wait complete. 2024-08-31T05:33:03.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.892+0000 7fb42c132740 20 client.16356 trim_cache size 0 max 16384 2024-08-31T05:33:03.911 INFO:tasks.workunit.client.0.smithi005.stdout: 1 281928 13.85 MB/sec warmup 111 sec latency 33.324 ms 2024-08-31T05:33:03.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.910+0000 7fb42c132740 1 Processor -- start 2024-08-31T05:33:03.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.910+0000 7fb42c132740 1 -- start start 2024-08-31T05:33:03.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.911+0000 7fb42c132740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55876f51b1b0 0x55876f8f4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:03.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.911+0000 7fb42c132740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55876f523390 0x55876f900c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:03.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.911+0000 7fb42c132740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55876f544070 0x55876f8f1c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:03.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.911+0000 7fb42c132740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb4201b2e00 con 0x55876f544070 2024-08-31T05:33:03.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.911+0000 7fb42c132740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb4201b4a00 con 0x55876f51b1b0 2024-08-31T05:33:03.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.911+0000 7fb42c132740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb4201b34d0 con 0x55876f523390 2024-08-31T05:33:03.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.911+0000 7fb41ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55876f544070 0x55876f8f1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:03.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.911+0000 7fb41f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55876f51b1b0 0x55876f8f4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:03.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.911+0000 7fb41effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55876f523390 0x55876f900c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:03.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.911+0000 7fb41ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55876f544070 0x55876f8f1c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58930/0 (socket says 172.21.15.5:58930) 2024-08-31T05:33:03.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.911+0000 7fb41ffff640 1 -- 172.21.15.5:0/1022520086 learned_addr learned my addr 172.21.15.5:0/1022520086 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:03.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.911+0000 7fb41effd640 1 --2- 172.21.15.5:0/1022520086 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55876f523390 0x55876f900c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:58850/0 (socket says 172.21.15.5:58850) 2024-08-31T05:33:03.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.911+0000 7fb41f7fe640 1 --2- 172.21.15.5:0/1022520086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55876f51b1b0 0x55876f8f4ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:38114/0 (socket says 172.21.15.5:38114) 2024-08-31T05:33:03.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.911+0000 7fb41ffff640 1 -- 172.21.15.5:0/1022520086 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55876f523390 msgr2=0x55876f900c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:03.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.911+0000 7fb41ffff640 1 --2- 172.21.15.5:0/1022520086 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55876f523390 0x55876f900c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:03.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.911+0000 7fb41ffff640 1 -- 172.21.15.5:0/1022520086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55876f51b1b0 msgr2=0x55876f8f4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:03.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.911+0000 7fb41ffff640 1 --2- 172.21.15.5:0/1022520086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55876f51b1b0 0x55876f8f4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:03.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.911+0000 7fb41ffff640 1 -- 172.21.15.5:0/1022520086 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55876f8e2550 con 0x55876f544070 2024-08-31T05:33:03.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.911+0000 7fb41f7fe640 1 --2- 172.21.15.5:0/1022520086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55876f51b1b0 0x55876f8f4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:03.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.911+0000 7fb41ffff640 1 --2- 172.21.15.5:0/1022520086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55876f544070 0x55876f8f1c10 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fb418004a10 tx=0x7fb418023560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50cef96a4576f1c6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:03.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.911+0000 7fb4157fa640 1 -- 172.21.15.5:0/1022520086 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb41801e070 con 0x55876f544070 2024-08-31T05:33:03.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.912+0000 7fb4157fa640 1 -- 172.21.15.5:0/1022520086 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb41801f040 con 0x55876f544070 2024-08-31T05:33:03.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.912+0000 7fb4157fa640 1 -- 172.21.15.5:0/1022520086 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb418011030 con 0x55876f544070 2024-08-31T05:33:03.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.912+0000 7fb42c132740 1 -- 172.21.15.5:0/1022520086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55876f544070 msgr2=0x55876f8f1c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:03.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.912+0000 7fb42c132740 1 --2- 172.21.15.5:0/1022520086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55876f544070 0x55876f8f1c10 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fb418004a10 tx=0x7fb418023560 comp rx=0 tx=0).stop 2024-08-31T05:33:03.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.912+0000 7fb42c132740 1 -- 172.21.15.5:0/1022520086 shutdown_connections 2024-08-31T05:33:03.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.912+0000 7fb42c132740 1 --2- 172.21.15.5:0/1022520086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55876f544070 0x55876f8f1c10 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:03.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.912+0000 7fb42c132740 1 --2- 172.21.15.5:0/1022520086 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55876f523390 0x55876f900c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:03.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.912+0000 7fb42c132740 1 --2- 172.21.15.5:0/1022520086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55876f51b1b0 0x55876f8f4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:03.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.912+0000 7fb42c132740 1 -- 172.21.15.5:0/1022520086 >> 172.21.15.5:0/1022520086 conn(0x55876f538460 msgr2=0x55876f8f47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:03.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.913+0000 7fb42c132740 1 -- 172.21.15.5:0/1022520086 shutdown_connections 2024-08-31T05:33:03.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.913+0000 7fb42c132740 1 -- 172.21.15.5:0/1022520086 wait complete. 2024-08-31T05:33:03.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.913+0000 7fb42c132740 1 -- start start 2024-08-31T05:33:03.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.913+0000 7fb42c132740 1 Processor -- start 2024-08-31T05:33:03.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.913+0000 7fb42c132740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55876f51b1b0 0x55876f8fd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:03.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.914+0000 7fb42c132740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55876f523390 0x55876f8f8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:03.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.914+0000 7fb42c132740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55876f544070 0x55876f8f8b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:03.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.914+0000 7fb42c132740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb4201b4270 con 0x55876f523390 2024-08-31T05:33:03.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.914+0000 7fb42c132740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb4201b3ba0 con 0x55876f51b1b0 2024-08-31T05:33:03.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.914+0000 7fb42c132740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb4201b0de0 con 0x55876f544070 2024-08-31T05:33:03.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.914+0000 7fb42c132740 10 client.0 _ll_register_callbacks cb 0x7fb4100097e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:33:03.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.914+0000 7fb41effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55876f523390 0x55876f8f8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:03.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.914+0000 7fb41f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55876f51b1b0 0x55876f8fd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:03.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.914+0000 7fb41ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55876f544070 0x55876f8f8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:03.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.914+0000 7fb41f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55876f51b1b0 0x55876f8fd1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:38118/0 (socket says 172.21.15.5:38118) 2024-08-31T05:33:03.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.914+0000 7fb41f7fe640 1 -- 172.21.15.5:0/2646720319 learned_addr learned my addr 172.21.15.5:0/2646720319 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:03.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.914+0000 7fb41ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55876f544070 0x55876f8f8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:58854/0 (socket says 172.21.15.5:58854) 2024-08-31T05:33:03.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.914+0000 7fb41effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55876f523390 0x55876f8f8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58932/0 (socket says 172.21.15.5:58932) 2024-08-31T05:33:03.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.914+0000 7fb41effd640 1 -- 172.21.15.5:0/2646720319 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55876f544070 msgr2=0x55876f8f8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:03.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.914+0000 7fb41effd640 1 --2- 172.21.15.5:0/2646720319 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55876f544070 0x55876f8f8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:03.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.914+0000 7fb41effd640 1 -- 172.21.15.5:0/2646720319 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55876f51b1b0 msgr2=0x55876f8fd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:03.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.914+0000 7fb41effd640 1 --2- 172.21.15.5:0/2646720319 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55876f51b1b0 0x55876f8fd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:03.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.914+0000 7fb41effd640 1 -- 172.21.15.5:0/2646720319 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55876f8f90d0 con 0x55876f523390 2024-08-31T05:33:03.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.914+0000 7fb41effd640 1 --2- 172.21.15.5:0/2646720319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55876f523390 0x55876f8f8650 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fb4081027b0 tx=0x7fb408005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7516b4fc772f46d6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:03.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.914+0000 7fb3feffd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:33:03.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.914+0000 7fb3feffd640 1 -- 172.21.15.5:0/2646720319 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4080c7610 con 0x55876f523390 2024-08-31T05:33:03.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.914+0000 7fb3feffd640 1 -- 172.21.15.5:0/2646720319 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fb4080d47f0 con 0x55876f523390 2024-08-31T05:33:03.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.914+0000 7fb42c132740 1 -- 172.21.15.5:0/2646720319 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb41801f040 con 0x55876f523390 2024-08-31T05:33:03.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.915+0000 7fb3feffd640 1 -- 172.21.15.5:0/2646720319 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fb4080caec0 con 0x55876f523390 2024-08-31T05:33:03.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.915+0000 7fb42c132740 10 client.16362 fetch_fsmap learned FSMap version 32 2024-08-31T05:33:03.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.915+0000 7fb42c132740 1 -- 172.21.15.5:0/2646720319 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55876f9711d0 con 0x55876f523390 2024-08-31T05:33:03.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.915+0000 7fb3feffd640 1 -- 172.21.15.5:0/2646720319 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb41801f040 con 0x55876f523390 2024-08-31T05:33:03.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.915+0000 7fb3feffd640 1 -- 172.21.15.5:0/2646720319 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7fb40804d060 con 0x55876f523390 2024-08-31T05:33:03.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.915+0000 7fb42c132740 10 client.16362 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:33:03.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.915+0000 7fb42c132740 10 client.16362 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:33:03.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.915+0000 7fb42c132740 20 client.16362 populate_metadata read hostname 'smithi005' 2024-08-31T05:33:03.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.915+0000 7fb42c132740 1 --2- 172.21.15.5:0/2646720319 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55876f4d7da0 0x55876f9739c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:03.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.915+0000 7fb42c132740 4 client.16362 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T05:33:03.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.915+0000 7fb42c132740 1 -- 172.21.15.5:0/2646720319 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55876f85e020 con 0x55876f4d7da0 2024-08-31T05:33:03.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.915+0000 7fb41f7fe640 1 --2- 172.21.15.5:0/2646720319 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55876f4d7da0 0x55876f9739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:03.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.916+0000 7fb41f7fe640 1 --2- 172.21.15.5:0/2646720319 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55876f4d7da0 0x55876f9739c0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6aed3db24f50678 server_cookie=ccc3dd556ae41dbe in_seq=0 out_seq=0 2024-08-31T05:33:03.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.916+0000 7fb3feffd640 10 client.16362 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:33:03.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.916+0000 7fb3feffd640 1 -- 172.21.15.5:0/2646720319 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1226 (crc 0 0 0) 0x55876f85e020 con 0x55876f4d7da0 2024-08-31T05:33:03.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.916+0000 7fb3feffd640 10 client.16362 handle_command_reply: tid=0 2024-08-31T05:33:03.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.916+0000 7fb42c132740 1 client.16362 shutdown 2024-08-31T05:33:03.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.916+0000 7fb42c132740 1 -- 172.21.15.5:0/2646720319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55876f523390 msgr2=0x55876f8f8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:03.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.916+0000 7fb42c132740 1 --2- 172.21.15.5:0/2646720319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55876f523390 0x55876f8f8650 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fb4081027b0 tx=0x7fb408005bd0 comp rx=0 tx=0).stop 2024-08-31T05:33:03.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.916+0000 7fb42c132740 1 -- 172.21.15.5:0/2646720319 shutdown_connections 2024-08-31T05:33:03.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.916+0000 7fb42c132740 1 --2- 172.21.15.5:0/2646720319 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55876f4d7da0 0x55876f9739c0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:03.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.916+0000 7fb42c132740 1 --2- 172.21.15.5:0/2646720319 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55876f544070 0x55876f8f8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:03.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.916+0000 7fb3feffd640 0 client.16362 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:33:03.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.916+0000 7fb42c132740 1 --2- 172.21.15.5:0/2646720319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55876f523390 0x55876f8f8650 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:03.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.916+0000 7fb42c132740 1 --2- 172.21.15.5:0/2646720319 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55876f51b1b0 0x55876f8fd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:03.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.916+0000 7fb42c132740 1 -- 172.21.15.5:0/2646720319 >> 172.21.15.5:0/2646720319 conn(0x55876f538460 msgr2=0x55876f8f5dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:03.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.916+0000 7fb42c132740 1 -- 172.21.15.5:0/2646720319 shutdown_connections 2024-08-31T05:33:03.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.916+0000 7fb42c132740 1 -- 172.21.15.5:0/2646720319 wait complete. 2024-08-31T05:33:03.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.917+0000 7fb42c132740 20 client.16362 trim_cache size 0 max 16384 2024-08-31T05:33:03.926 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:33:03.926 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "no active scrubs running", 2024-08-31T05:33:03.926 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": {}, 2024-08-31T05:33:03.927 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_stats": { 2024-08-31T05:33:03.927 INFO:teuthology.orchestra.run.smithi005.stdout: "728a42ca-bbef-4151-830f-5fdd411d8fa0": { 2024-08-31T05:33:03.927 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:32:30.554906+0000", 2024-08-31T05:33:03.927 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:33:03.927 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:33:03.927 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:33:03.927 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:33:03.927 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:33:03.927 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:33:03.927 INFO:teuthology.orchestra.run.smithi005.stdout: "cda92ac0-b35f-47a5-a3a5-471c888462a5": { 2024-08-31T05:33:03.927 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:53.103905+0000", 2024-08-31T05:33:03.927 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:33:03.927 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:33:03.927 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:33:03.928 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:33:03.928 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:33:03.928 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:33:03.928 INFO:teuthology.orchestra.run.smithi005.stdout: "ece37b07-9ab2-45f8-bc33-2755a07aac0b": { 2024-08-31T05:33:03.928 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:31:41.782407+0000", 2024-08-31T05:33:03.928 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:33:03.928 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:33:03.928 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:33:03.928 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:33:03.928 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:33:03.928 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:33:03.928 INFO:teuthology.orchestra.run.smithi005.stdout: "75d84398-5d9c-4872-b879-2fbce045fa71": { 2024-08-31T05:33:03.928 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:06.642335+0000", 2024-08-31T05:33:03.929 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:33:03.929 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:33:03.929 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:33:03.929 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:33:03.929 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:33:03.929 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:33:03.929 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:33:03.929 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:33:03.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.917+0000 7fb425bbd640 1 -- 172.21.15.5:0/2734526104 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb40c0b4ca0 msgr2=0x7fb40c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:03.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.917+0000 7fb425bbd640 1 --2- 172.21.15.5:0/2734526104 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb40c0b4ca0 0x7fb40c0b71b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x55876f8e7f40 tx=0x7fb410009260 comp rx=0 tx=0).stop 2024-08-31T05:33:03.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.917+0000 7fb425bbd640 1 -- 172.21.15.5:0/2734526104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4201081c0 msgr2=0x7fb42019ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:03.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.917+0000 7fb425bbd640 1 --2- 172.21.15.5:0/2734526104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4201081c0 0x7fb42019ca40 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fb40802a860 tx=0x7fb408032d50 comp rx=0 tx=0).stop 2024-08-31T05:33:03.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.917+0000 7fb425bbd640 1 -- 172.21.15.5:0/2734526104 shutdown_connections 2024-08-31T05:33:03.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.917+0000 7fb425bbd640 1 --2- 172.21.15.5:0/2734526104 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb40c0b4ca0 0x7fb40c0b71b0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:03.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.917+0000 7fb425bbd640 1 --2- 172.21.15.5:0/2734526104 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb420108b10 0x7fb4201a1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:03.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.917+0000 7fb425bbd640 1 --2- 172.21.15.5:0/2734526104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4201081c0 0x7fb42019ca40 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:03.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.917+0000 7fb425bbd640 1 --2- 172.21.15.5:0/2734526104 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb420102880 0x7fb42019c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:03.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.917+0000 7fb425bbd640 1 -- 172.21.15.5:0/2734526104 >> 172.21.15.5:0/2734526104 conn(0x7fb420079510 msgr2=0x7fb4201063a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:03.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.917+0000 7fb425bbd640 1 -- 172.21.15.5:0/2734526104 shutdown_connections 2024-08-31T05:33:03.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:03.918+0000 7fb425bbd640 1 -- 172.21.15.5:0/2734526104 wait complete. 2024-08-31T05:33:04.699 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T05:33:04.700 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T05:33:04.912 INFO:tasks.workunit.client.0.smithi005.stdout: 1 284502 13.85 MB/sec warmup 112 sec latency 12.166 ms 2024-08-31T05:33:04.970 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:33:05.394 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:33:05 smithi005 ceph-mon[18602]: pgmap v438: 129 pgs: 129 active+clean; 138 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.3 MiB/s wr, 256 op/s 2024-08-31T05:33:05.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.490+0000 7fefe1b80640 1 -- 172.21.15.5:0/3735670407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefdc108a90 msgr2=0x7fefdc10f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:05.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.490+0000 7fefe1b80640 1 --2- 172.21.15.5:0/3735670407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefdc108a90 0x7fefdc10f2c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fefd4009ca0 tx=0x7fefd402a8c0 comp rx=0 tx=0).stop 2024-08-31T05:33:05.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.490+0000 7fefe1b80640 1 -- 172.21.15.5:0/3735670407 shutdown_connections 2024-08-31T05:33:05.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.490+0000 7fefe1b80640 1 --2- 172.21.15.5:0/3735670407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefdc108a90 0x7fefdc10f2c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:05.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.490+0000 7fefe1b80640 1 --2- 172.21.15.5:0/3735670407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefdc108140 0x7fefdc108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:05.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.490+0000 7fefe1b80640 1 --2- 172.21.15.5:0/3735670407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefdc102800 0x7fefdc102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:05.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.490+0000 7fefe1b80640 1 -- 172.21.15.5:0/3735670407 >> 172.21.15.5:0/3735670407 conn(0x7fefdc0794d0 msgr2=0x7fefdc0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:05.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.490+0000 7fefe1b80640 1 -- 172.21.15.5:0/3735670407 shutdown_connections 2024-08-31T05:33:05.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.490+0000 7fefe1b80640 1 -- 172.21.15.5:0/3735670407 wait complete. 2024-08-31T05:33:05.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.491+0000 7fefe1b80640 1 Processor -- start 2024-08-31T05:33:05.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.491+0000 7fefe1b80640 1 -- start start 2024-08-31T05:33:05.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.491+0000 7fefe1b80640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefdc102800 0x7fefdc19afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:05.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.491+0000 7fefe1b80640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefdc108140 0x7fefdc19b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:05.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.491+0000 7fefe1b80640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefdc108a90 0x7fefdc19ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:05.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.491+0000 7fefe1b80640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fefdc112710 con 0x7fefdc102800 2024-08-31T05:33:05.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.491+0000 7fefe1b80640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fefdc112590 con 0x7fefdc108a90 2024-08-31T05:33:05.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.491+0000 7fefe1b80640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fefdc112890 con 0x7fefdc108140 2024-08-31T05:33:05.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.491+0000 7fefdb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefdc102800 0x7fefdc19afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:05.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.491+0000 7fefdb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefdc102800 0x7fefdc19afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58946/0 (socket says 172.21.15.5:58946) 2024-08-31T05:33:05.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.491+0000 7fefdb7fe640 1 -- 172.21.15.5:0/3019363633 learned_addr learned my addr 172.21.15.5:0/3019363633 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:05.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.491+0000 7fefdaffd640 1 --2- 172.21.15.5:0/3019363633 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefdc108140 0x7fefdc19b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:05.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.491+0000 7fefdbfff640 1 --2- 172.21.15.5:0/3019363633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefdc108a90 0x7fefdc19ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:05.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.492+0000 7fefdaffd640 1 -- 172.21.15.5:0/3019363633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefdc108a90 msgr2=0x7fefdc19ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:05.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.492+0000 7fefdaffd640 1 --2- 172.21.15.5:0/3019363633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefdc108a90 0x7fefdc19ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:05.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.492+0000 7fefdaffd640 1 -- 172.21.15.5:0/3019363633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefdc102800 msgr2=0x7fefdc19afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:05.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.492+0000 7fefdaffd640 1 --2- 172.21.15.5:0/3019363633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefdc102800 0x7fefdc19afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:05.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.492+0000 7fefdaffd640 1 -- 172.21.15.5:0/3019363633 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefdc1a6270 con 0x7fefdc108140 2024-08-31T05:33:05.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.492+0000 7fefdb7fe640 1 --2- 172.21.15.5:0/3019363633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefdc102800 0x7fefdc19afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:05.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.492+0000 7fefdaffd640 1 --2- 172.21.15.5:0/3019363633 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefdc108140 0x7fefdc19b520 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fefd000e9c0 tx=0x7fefd000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:05.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.492+0000 7fefd8ff9640 1 -- 172.21.15.5:0/3019363633 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd000ccc0 con 0x7fefdc108140 2024-08-31T05:33:05.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.492+0000 7fefdbfff640 1 --2- 172.21.15.5:0/3019363633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefdc108a90 0x7fefdc19ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:05.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.492+0000 7fefd8ff9640 1 -- 172.21.15.5:0/3019363633 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fefd0005020 con 0x7fefdc108140 2024-08-31T05:33:05.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.492+0000 7fefe1b80640 1 -- 172.21.15.5:0/3019363633 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefdc1a6560 con 0x7fefdc108140 2024-08-31T05:33:05.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.493+0000 7fefd8ff9640 1 -- 172.21.15.5:0/3019363633 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd00049e0 con 0x7fefdc108140 2024-08-31T05:33:05.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.493+0000 7fefe1b80640 1 -- 172.21.15.5:0/3019363633 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefdc1a6aa0 con 0x7fefdc108140 2024-08-31T05:33:05.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.494+0000 7fefe1b80640 1 -- 172.21.15.5:0/3019363633 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefdc102c10 con 0x7fefdc108140 2024-08-31T05:33:05.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.495+0000 7fefd8ff9640 1 -- 172.21.15.5:0/3019363633 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fefd00051d0 con 0x7fefdc108140 2024-08-31T05:33:05.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.496+0000 7fefd8ff9640 1 --2- 172.21.15.5:0/3019363633 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fefc40b4d50 0x7fefc40b7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:05.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.496+0000 7fefdb7fe640 1 --2- 172.21.15.5:0/3019363633 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fefc40b4d50 0x7fefc40b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:05.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.496+0000 7fefd8ff9640 1 -- 172.21.15.5:0/3019363633 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fefd00e5770 con 0x7fefdc108140 2024-08-31T05:33:05.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.497+0000 7fefdb7fe640 1 --2- 172.21.15.5:0/3019363633 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fefc40b4d50 0x7fefc40b7260 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fefdc06b760 tx=0x7fefcc005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:05.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.502+0000 7fefd8ff9640 1 -- 172.21.15.5:0/3019363633 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fefd00ac1e0 con 0x7fefdc108140 2024-08-31T05:33:05.585 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:33:05 smithi070 ceph-mon[22316]: pgmap v438: 129 pgs: 129 active+clean; 138 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.3 MiB/s wr, 256 op/s 2024-08-31T05:33:05.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:33:05 smithi050 ceph-mon[22146]: pgmap v438: 129 pgs: 129 active+clean; 138 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.3 MiB/s wr, 256 op/s 2024-08-31T05:33:05.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.749+0000 7fefe1b80640 1 -- 172.21.15.5:0/3019363633 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fefdc06b010 con 0x7fefdc108140 2024-08-31T05:33:05.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.750+0000 7fefd8ff9640 1 -- 172.21.15.5:0/3019363633 <== mon.1 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11948 (secure 0 0 0) 0x7fefd00abae0 con 0x7fefdc108140 2024-08-31T05:33:05.752 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:33:05.753 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":32,"btime":"2024-08-31T05:31:23:083919+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14739,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2024812199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2024812199},{"type":"v1","addr":"172.21.15.5:6835","nonce":2024812199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3629023702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3629023702},{"type":"v1","addr":"172.21.15.5:6837","nonce":3629023702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T05:27:31.929153+0000","modified":"2024-08-31T05:31:22.377433+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24652,"mds_1":24638,"mds_2":24631,"mds_3":24625,"mds_4":24602},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6839/2412701258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":2412701258},{"type":"v1","addr":"172.21.15.5:6839","nonce":2412701258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14820":{"gid":14820,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6841/747057838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":747057838},{"type":"v1","addr":"172.21.15.5:6841","nonce":747057838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6833/1153378982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1153378982},{"type":"v1","addr":"172.21.15.50:6833","nonce":1153378982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6833/364083443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":364083443},{"type":"v1","addr":"172.21.15.70:6833","nonce":364083443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24587":{"gid":24587,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/2346896794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2346896794},{"type":"v1","addr":"172.21.15.50:6835","nonce":2346896794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24602":{"gid":24602,"name":"h","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.50:6837/428759669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":428759669},{"type":"v1","addr":"172.21.15.50:6837","nonce":428759669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.70:6835/2061504114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2061504114},{"type":"v1","addr":"172.21.15.70:6835","nonce":2061504114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.70:6837/2780036414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2780036414},{"type":"v1","addr":"172.21.15.70:6837","nonce":2780036414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.50:6839/98200944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":98200944},{"type":"v1","addr":"172.21.15.50:6839","nonce":98200944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24652":{"gid":24652,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.70:6839/2756569250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":2756569250},{"type":"v1","addr":"172.21.15.70:6839","nonce":2756569250}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24652,"qdb_cluster":[24652,24631,24638,24625,24602]},"id":1}]} 2024-08-31T05:33:05.753 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 32 2024-08-31T05:33:05.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.752+0000 7fefe1b80640 1 -- 172.21.15.5:0/3019363633 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fefc40b4d50 msgr2=0x7fefc40b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:05.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.752+0000 7fefe1b80640 1 --2- 172.21.15.5:0/3019363633 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fefc40b4d50 0x7fefc40b7260 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fefdc06b760 tx=0x7fefcc005f90 comp rx=0 tx=0).stop 2024-08-31T05:33:05.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.752+0000 7fefe1b80640 1 -- 172.21.15.5:0/3019363633 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefdc108140 msgr2=0x7fefdc19b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:05.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.752+0000 7fefe1b80640 1 --2- 172.21.15.5:0/3019363633 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefdc108140 0x7fefdc19b520 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fefd000e9c0 tx=0x7fefd000ee80 comp rx=0 tx=0).stop 2024-08-31T05:33:05.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.752+0000 7fefe1b80640 1 -- 172.21.15.5:0/3019363633 shutdown_connections 2024-08-31T05:33:05.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.752+0000 7fefe1b80640 1 --2- 172.21.15.5:0/3019363633 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fefc40b4d50 0x7fefc40b7260 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:05.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.752+0000 7fefe1b80640 1 --2- 172.21.15.5:0/3019363633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fefdc108a90 0x7fefdc19ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:05.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.752+0000 7fefe1b80640 1 --2- 172.21.15.5:0/3019363633 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefdc108140 0x7fefdc19b520 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:05.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.752+0000 7fefe1b80640 1 --2- 172.21.15.5:0/3019363633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefdc102800 0x7fefdc19afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:05.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.752+0000 7fefe1b80640 1 -- 172.21.15.5:0/3019363633 >> 172.21.15.5:0/3019363633 conn(0x7fefdc0794d0 msgr2=0x7fefdc105040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:05.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.753+0000 7fefe1b80640 1 -- 172.21.15.5:0/3019363633 shutdown_connections 2024-08-31T05:33:05.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:05.753+0000 7fefe1b80640 1 -- 172.21.15.5:0/3019363633 wait complete. 2024-08-31T05:33:05.912 INFO:tasks.workunit.client.0.smithi005.stdout: 1 287524 13.89 MB/sec warmup 113 sec latency 34.960 ms 2024-08-31T05:33:06.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:33:06 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/3019363633' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:33:06.512 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-31T05:33:06.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:33:06 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/3019363633' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:33:06.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:33:06 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/3019363633' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:33:06.791 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:33:06.912 INFO:tasks.workunit.client.0.smithi005.stdout: 1 289158 13.82 MB/sec warmup 114 sec latency 63.554 ms 2024-08-31T05:33:07.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.416+0000 7f9f06c32640 1 -- 172.21.15.5:0/792952787 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f00104750 msgr2=0x7f9f00104b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:07.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.416+0000 7f9f06c32640 1 --2- 172.21.15.5:0/792952787 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f00104750 0x7f9f00104b60 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4009860 tx=0x7f9ef402a340 comp rx=0 tx=0).stop 2024-08-31T05:33:07.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.416+0000 7f9f06c32640 1 -- 172.21.15.5:0/792952787 shutdown_connections 2024-08-31T05:33:07.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.416+0000 7f9f06c32640 1 --2- 172.21.15.5:0/792952787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f0010dbb0 0x7f9f001100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:07.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.416+0000 7f9f06c32640 1 --2- 172.21.15.5:0/792952787 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9f001050a0 0x7f9f0010d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:07.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.416+0000 7f9f06c32640 1 --2- 172.21.15.5:0/792952787 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f00104750 0x7f9f00104b60 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:07.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.416+0000 7f9f06c32640 1 -- 172.21.15.5:0/792952787 >> 172.21.15.5:0/792952787 conn(0x7f9f000794d0 msgr2=0x7f9f000798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:07.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.416+0000 7f9f06c32640 1 -- 172.21.15.5:0/792952787 shutdown_connections 2024-08-31T05:33:07.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.416+0000 7f9f06c32640 1 -- 172.21.15.5:0/792952787 wait complete. 2024-08-31T05:33:07.419 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:33:07 smithi005 ceph-mon[18602]: pgmap v439: 129 pgs: 129 active+clean; 143 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.2 MiB/s wr, 330 op/s 2024-08-31T05:33:07.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.417+0000 7f9f06c32640 1 Processor -- start 2024-08-31T05:33:07.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.417+0000 7f9f06c32640 1 -- start start 2024-08-31T05:33:07.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.417+0000 7f9f06c32640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9f00104750 0x7f9f0019a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:07.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.417+0000 7f9f06c32640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f001050a0 0x7f9f0019a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:07.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.417+0000 7f9f06c32640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f0010dbb0 0x7f9f0019fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:07.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.417+0000 7f9f06c32640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9f00113810 con 0x7f9f001050a0 2024-08-31T05:33:07.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.417+0000 7f9f06c32640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9f00113690 con 0x7f9f0010dbb0 2024-08-31T05:33:07.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.417+0000 7f9f06c32640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9f00113990 con 0x7f9f00104750 2024-08-31T05:33:07.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.418+0000 7f9f049ce640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9f00104750 0x7f9f0019a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:07.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.418+0000 7f9efffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f001050a0 0x7f9f0019a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:07.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.418+0000 7f9f051cf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f0010dbb0 0x7f9f0019fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:07.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.418+0000 7f9efffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f001050a0 0x7f9f0019a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58968/0 (socket says 172.21.15.5:58968) 2024-08-31T05:33:07.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.418+0000 7f9efffff640 1 -- 172.21.15.5:0/1658941261 learned_addr learned my addr 172.21.15.5:0/1658941261 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:07.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.418+0000 7f9f051cf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f0010dbb0 0x7f9f0019fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:38160/0 (socket says 172.21.15.5:38160) 2024-08-31T05:33:07.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.418+0000 7f9f051cf640 1 -- 172.21.15.5:0/1658941261 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9f00104750 msgr2=0x7f9f0019a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:07.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.418+0000 7f9f051cf640 1 --2- 172.21.15.5:0/1658941261 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9f00104750 0x7f9f0019a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:07.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.418+0000 7f9f051cf640 1 -- 172.21.15.5:0/1658941261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f001050a0 msgr2=0x7f9f0019a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:07.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.418+0000 7f9f051cf640 1 --2- 172.21.15.5:0/1658941261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f001050a0 0x7f9f0019a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:07.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.418+0000 7f9f051cf640 1 -- 172.21.15.5:0/1658941261 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f001a02b0 con 0x7f9f0010dbb0 2024-08-31T05:33:07.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.418+0000 7f9efffff640 1 --2- 172.21.15.5:0/1658941261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f001050a0 0x7f9f0019a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:07.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.418+0000 7f9f049ce640 1 --2- 172.21.15.5:0/1658941261 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9f00104750 0x7f9f0019a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:07.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.418+0000 7f9f051cf640 1 --2- 172.21.15.5:0/1658941261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f0010dbb0 0x7f9f0019fb80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9ef800efc0 tx=0x7f9ef800c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:07.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.418+0000 7f9efdffb640 1 -- 172.21.15.5:0/1658941261 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef8003970 con 0x7f9f0010dbb0 2024-08-31T05:33:07.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.419+0000 7f9f06c32640 1 -- 172.21.15.5:0/1658941261 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f001a05a0 con 0x7f9f0010dbb0 2024-08-31T05:33:07.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.419+0000 7f9efdffb640 1 -- 172.21.15.5:0/1658941261 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ef8004020 con 0x7f9f0010dbb0 2024-08-31T05:33:07.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.419+0000 7f9efdffb640 1 -- 172.21.15.5:0/1658941261 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef800b940 con 0x7f9f0010dbb0 2024-08-31T05:33:07.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.419+0000 7f9f06c32640 1 -- 172.21.15.5:0/1658941261 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f001a6d00 con 0x7f9f0010dbb0 2024-08-31T05:33:07.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.421+0000 7f9f0d1a7740 1 Processor -- start 2024-08-31T05:33:07.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.422+0000 7f9efdffb640 1 -- 172.21.15.5:0/1658941261 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f9ef801d020 con 0x7f9f0010dbb0 2024-08-31T05:33:07.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.422+0000 7f9f0d1a7740 1 -- start start 2024-08-31T05:33:07.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.422+0000 7f9f0d1a7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562dea85f070 0x562deac04310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:07.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.422+0000 7f9f0d1a7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562dea8361b0 0x562deac04850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:07.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.423+0000 7f9f0d1a7740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562dea83e390 0x562deac04d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:07.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.423+0000 7f9f0d1a7740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x562deab7b680 con 0x562dea83e390 2024-08-31T05:33:07.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.423+0000 7f9f0d1a7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562deab6ac10 con 0x562dea8361b0 2024-08-31T05:33:07.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.423+0000 7f9f0d1a7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562deab6ebc0 con 0x562dea85f070 2024-08-31T05:33:07.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.423+0000 7f9efffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562dea85f070 0x562deac04310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:07.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.423+0000 7f9f049ce640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562dea8361b0 0x562deac04850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:07.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.423+0000 7f9f049ce640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562dea8361b0 0x562deac04850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:38162/0 (socket says 172.21.15.5:38162) 2024-08-31T05:33:07.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.423+0000 7f9f049ce640 1 -- 172.21.15.5:0/2815696160 learned_addr learned my addr 172.21.15.5:0/2815696160 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:07.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.423+0000 7f9efffff640 1 --2- 172.21.15.5:0/2815696160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562dea83e390 0x562deac04d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:07.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.423+0000 7f9f049ce640 1 -- 172.21.15.5:0/2815696160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562dea85f070 msgr2=0x562deac04310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:07.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.423+0000 7f9f049ce640 1 --2- 172.21.15.5:0/2815696160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562dea85f070 0x562deac04310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:07.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.423+0000 7f9f049ce640 1 -- 172.21.15.5:0/2815696160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562dea83e390 msgr2=0x562deac04d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:07.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.423+0000 7f9f049ce640 1 --2- 172.21.15.5:0/2815696160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562dea83e390 0x562deac04d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:07.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.423+0000 7f9efdffb640 1 --2- 172.21.15.5:0/1658941261 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9ef00b4ca0 0x7f9ef00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:07.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.423+0000 7f9f049ce640 1 -- 172.21.15.5:0/2815696160 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562dea8ca650 con 0x562dea8361b0 2024-08-31T05:33:07.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.423+0000 7f9efffff640 1 --2- 172.21.15.5:0/2815696160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562dea83e390 0x562deac04d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:33:07.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.423+0000 7f9f051cf640 1 --2- 172.21.15.5:0/1658941261 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9ef00b4ca0 0x7f9ef00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:07.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.423+0000 7f9f049ce640 1 --2- 172.21.15.5:0/2815696160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562dea8361b0 0x562deac04850 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9ef40057c0 tx=0x7f9ef4005d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9962922247484e5a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:07.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.424+0000 7f9efdffb640 1 -- 172.21.15.5:0/1658941261 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f9ef80e5710 con 0x7f9f0010dbb0 2024-08-31T05:33:07.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.424+0000 7f9eeaffd640 1 -- 172.21.15.5:0/2815696160 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef4037040 con 0x562dea8361b0 2024-08-31T05:33:07.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.424+0000 7f9eeaffd640 1 -- 172.21.15.5:0/2815696160 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ef4030450 con 0x562dea8361b0 2024-08-31T05:33:07.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.424+0000 7f9eeaffd640 1 -- 172.21.15.5:0/2815696160 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef4032b50 con 0x562dea8361b0 2024-08-31T05:33:07.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.425+0000 7f9f0d1a7740 1 -- 172.21.15.5:0/2815696160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562dea8361b0 msgr2=0x562deac04850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:07.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.425+0000 7f9f0d1a7740 1 --2- 172.21.15.5:0/2815696160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562dea8361b0 0x562deac04850 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9ef40057c0 tx=0x7f9ef4005d10 comp rx=0 tx=0).stop 2024-08-31T05:33:07.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.425+0000 7f9f051cf640 1 --2- 172.21.15.5:0/1658941261 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9ef00b4ca0 0x7f9ef00b71b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9ef80e2b90 tx=0x7f9ef8077c80 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:07.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.425+0000 7f9f0d1a7740 1 -- 172.21.15.5:0/2815696160 shutdown_connections 2024-08-31T05:33:07.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.425+0000 7f9f0d1a7740 1 --2- 172.21.15.5:0/2815696160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562dea83e390 0x562deac04d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:07.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.425+0000 7f9f0d1a7740 1 --2- 172.21.15.5:0/2815696160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562dea8361b0 0x562deac04850 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:07.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.425+0000 7f9f0d1a7740 1 --2- 172.21.15.5:0/2815696160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562dea85f070 0x562deac04310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:07.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.425+0000 7f9f0d1a7740 1 -- 172.21.15.5:0/2815696160 >> 172.21.15.5:0/2815696160 conn(0x562dea853460 msgr2=0x562deac02200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:07.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.425+0000 7f9f0d1a7740 1 -- 172.21.15.5:0/2815696160 shutdown_connections 2024-08-31T05:33:07.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.425+0000 7f9f0d1a7740 1 -- 172.21.15.5:0/2815696160 wait complete. 2024-08-31T05:33:07.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.425+0000 7f9f0d1a7740 1 -- start start 2024-08-31T05:33:07.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.425+0000 7f9f0d1a7740 1 Processor -- start 2024-08-31T05:33:07.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.426+0000 7f9f0d1a7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562dea8361b0 0x562deac13e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:07.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.426+0000 7f9f0d1a7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562dea83e390 0x562deac14390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:07.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.426+0000 7f9f0d1a7740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562dea85f070 0x562deac200f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:07.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.426+0000 7f9f0d1a7740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x562dea9cd700 con 0x562dea85f070 2024-08-31T05:33:07.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.426+0000 7f9f0d1a7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562deaaf1750 con 0x562dea8361b0 2024-08-31T05:33:07.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.426+0000 7f9f0d1a7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562deac16d90 con 0x562dea83e390 2024-08-31T05:33:07.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.426+0000 7f9f0d1a7740 10 client.0 _ll_register_callbacks cb 0x562deab20e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:33:07.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.426+0000 7f9efffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562dea8361b0 0x562deac13e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:07.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.426+0000 7f9efffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562dea85f070 0x562deac200f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:07.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.426+0000 7f9f049ce640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562dea83e390 0x562deac14390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:07.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.426+0000 7f9efffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562dea85f070 0x562deac200f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58990/0 (socket says 172.21.15.5:58990) 2024-08-31T05:33:07.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.426+0000 7f9efffff640 1 -- 172.21.15.5:0/2325012846 learned_addr learned my addr 172.21.15.5:0/2325012846 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:07.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.426+0000 7f9efffff640 1 -- 172.21.15.5:0/2325012846 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562dea83e390 msgr2=0x562deac14390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:07.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.426+0000 7f9efffff640 1 --2- 172.21.15.5:0/2325012846 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562dea83e390 0x562deac14390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:07.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.426+0000 7f9efffff640 1 -- 172.21.15.5:0/2325012846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562dea8361b0 msgr2=0x562deac13e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:07.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.426+0000 7f9efffff640 1 --2- 172.21.15.5:0/2325012846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562dea8361b0 0x562deac13e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:07.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.427+0000 7f9efffff640 1 -- 172.21.15.5:0/2325012846 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562deab2a900 con 0x562dea85f070 2024-08-31T05:33:07.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.427+0000 7f9f049ce640 1 --2- 172.21.15.5:0/2325012846 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562dea83e390 0x562deac14390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:07.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.427+0000 7f9efffff640 1 --2- 172.21.15.5:0/2325012846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562dea85f070 0x562deac200f0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f9eec011f80 tx=0x7f9eec005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=849b125faf3c81ab server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:07.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.427+0000 7f9edffff640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:33:07.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.427+0000 7f9edffff640 1 -- 172.21.15.5:0/2325012846 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eec011260 con 0x562dea85f070 2024-08-31T05:33:07.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.427+0000 7f9edffff640 1 -- 172.21.15.5:0/2325012846 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f9eec0047a0 con 0x562dea85f070 2024-08-31T05:33:07.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.427+0000 7f9f0d1a7740 1 -- 172.21.15.5:0/2325012846 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ef4030450 con 0x562dea85f070 2024-08-31T05:33:07.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.427+0000 7f9edffff640 1 -- 172.21.15.5:0/2325012846 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f9eec0049a0 con 0x562dea85f070 2024-08-31T05:33:07.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.427+0000 7f9f0d1a7740 10 client.16380 fetch_fsmap learned FSMap version 32 2024-08-31T05:33:07.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.427+0000 7f9f0d1a7740 1 -- 172.21.15.5:0/2325012846 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x562deac22c20 con 0x562dea85f070 2024-08-31T05:33:07.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.428+0000 7f9edffff640 1 -- 172.21.15.5:0/2325012846 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ef4030450 con 0x562dea85f070 2024-08-31T05:33:07.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.428+0000 7f9edffff640 1 -- 172.21.15.5:0/2325012846 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f9eec00e4a0 con 0x562dea85f070 2024-08-31T05:33:07.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.428+0000 7f9f0d1a7740 10 client.16380 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:33:07.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.428+0000 7f9f0d1a7740 10 client.16380 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-31T05:33:07.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.428+0000 7f9f0d1a7740 20 client.16380 populate_metadata read hostname 'smithi005' 2024-08-31T05:33:07.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.428+0000 7f9f0d1a7740 1 --2- 172.21.15.5:0/2325012846 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x562dea81d9f0 0x562deac260f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:07.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.428+0000 7f9f0d1a7740 4 client.16380 mds_command: new command op to 24602 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:33:07.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.428+0000 7f9f0d1a7740 1 -- 172.21.15.5:0/2325012846 --> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562deab7d5d0 con 0x562dea81d9f0 2024-08-31T05:33:07.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.428+0000 7f9f049ce640 1 --2- 172.21.15.5:0/2325012846 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x562dea81d9f0 0x562deac260f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:07.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.429+0000 7f9f049ce640 1 --2- 172.21.15.5:0/2325012846 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x562dea81d9f0 0x562deac260f0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8f0f08348b8d9af6 server_cookie=ceb62615f627a8e2 in_seq=0 out_seq=0 2024-08-31T05:33:07.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.429+0000 7f9edffff640 10 client.16380 ms_handle_connect on v2:172.21.15.50:6836/428759669 2024-08-31T05:33:07.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.429+0000 7f9edffff640 1 -- 172.21.15.5:0/2325012846 <== mds.4 v2:172.21.15.50:6836/428759669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562deab7d5d0 con 0x562dea81d9f0 2024-08-31T05:33:07.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.429+0000 7f9edffff640 10 client.16380 handle_command_reply: tid=0 2024-08-31T05:33:07.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.429+0000 7f9f0d1a7740 1 client.16380 shutdown 2024-08-31T05:33:07.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.430+0000 7f9f0d1a7740 1 -- 172.21.15.5:0/2325012846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562dea85f070 msgr2=0x562deac200f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:07.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.430+0000 7f9f0d1a7740 1 --2- 172.21.15.5:0/2325012846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562dea85f070 0x562deac200f0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f9eec011f80 tx=0x7f9eec005f90 comp rx=0 tx=0).stop 2024-08-31T05:33:07.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.430+0000 7f9f0d1a7740 1 -- 172.21.15.5:0/2325012846 shutdown_connections 2024-08-31T05:33:07.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.430+0000 7f9f0d1a7740 1 --2- 172.21.15.5:0/2325012846 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x562dea81d9f0 0x562deac260f0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:07.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.430+0000 7f9f0d1a7740 1 --2- 172.21.15.5:0/2325012846 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562dea85f070 0x562deac200f0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:07.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.430+0000 7f9f0d1a7740 1 --2- 172.21.15.5:0/2325012846 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562dea83e390 0x562deac14390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:07.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.430+0000 7f9edffff640 0 client.16380 ms_handle_reset on v2:172.21.15.50:6836/428759669 2024-08-31T05:33:07.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.430+0000 7f9f0d1a7740 1 --2- 172.21.15.5:0/2325012846 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562dea8361b0 0x562deac13e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:07.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.430+0000 7f9f0d1a7740 1 -- 172.21.15.5:0/2325012846 >> 172.21.15.5:0/2325012846 conn(0x562dea853460 msgr2=0x562deac05d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:07.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.430+0000 7f9f0d1a7740 1 -- 172.21.15.5:0/2325012846 shutdown_connections 2024-08-31T05:33:07.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.430+0000 7f9f0d1a7740 1 -- 172.21.15.5:0/2325012846 wait complete. 2024-08-31T05:33:07.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.430+0000 7f9f0d1a7740 20 client.16380 trim_cache size 0 max 16384 2024-08-31T05:33:07.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.444+0000 7f9f0d1a7740 1 Processor -- start 2024-08-31T05:33:07.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.444+0000 7f9f0d1a7740 1 -- start start 2024-08-31T05:33:07.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.444+0000 7f9f0d1a7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562dea8361b0 0x562deac11040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:07.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.444+0000 7f9f0d1a7740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562dea83e390 0x562deac11580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:07.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.444+0000 7f9f0d1a7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562dea85f070 0x562deac2b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:07.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.444+0000 7f9f0d1a7740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9f001aea10 con 0x562dea83e390 2024-08-31T05:33:07.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.444+0000 7f9f0d1a7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9f001b0610 con 0x562dea8361b0 2024-08-31T05:33:07.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.445+0000 7f9f0d1a7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9f001af0e0 con 0x562dea85f070 2024-08-31T05:33:07.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.445+0000 7f9f049ce640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562dea83e390 0x562deac11580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:07.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.445+0000 7f9efffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562dea8361b0 0x562deac11040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:07.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.445+0000 7f9efffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562dea8361b0 0x562deac11040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:38188/0 (socket says 172.21.15.5:38188) 2024-08-31T05:33:07.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.445+0000 7f9f049ce640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562dea83e390 0x562deac11580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58998/0 (socket says 172.21.15.5:58998) 2024-08-31T05:33:07.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.445+0000 7f9efffff640 1 -- 172.21.15.5:0/2310239810 learned_addr learned my addr 172.21.15.5:0/2310239810 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:07.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.445+0000 7f9efffff640 1 --2- 172.21.15.5:0/2310239810 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562dea85f070 0x562deac2b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:07.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.445+0000 7f9efffff640 1 -- 172.21.15.5:0/2310239810 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562dea85f070 msgr2=0x562deac2b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:07.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.445+0000 7f9efffff640 1 --2- 172.21.15.5:0/2310239810 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562dea85f070 0x562deac2b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:07.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.445+0000 7f9efffff640 1 -- 172.21.15.5:0/2310239810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562dea83e390 msgr2=0x562deac11580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:07.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.445+0000 7f9efffff640 1 --2- 172.21.15.5:0/2310239810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562dea83e390 0x562deac11580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:07.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.445+0000 7f9efffff640 1 -- 172.21.15.5:0/2310239810 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562deac16590 con 0x562dea8361b0 2024-08-31T05:33:07.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.445+0000 7f9efffff640 1 --2- 172.21.15.5:0/2310239810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562dea8361b0 0x562deac11040 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9eec011d80 tx=0x7f9eec005970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d031c9bba8be192 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:07.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.445+0000 7f9eea7fc640 1 -- 172.21.15.5:0/2310239810 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eec011260 con 0x562dea8361b0 2024-08-31T05:33:07.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.445+0000 7f9eea7fc640 1 -- 172.21.15.5:0/2310239810 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9eec0046c0 con 0x562dea8361b0 2024-08-31T05:33:07.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.445+0000 7f9eea7fc640 1 -- 172.21.15.5:0/2310239810 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eec030900 con 0x562dea8361b0 2024-08-31T05:33:07.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.446+0000 7f9f0d1a7740 1 -- 172.21.15.5:0/2310239810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562dea8361b0 msgr2=0x562deac11040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:07.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.446+0000 7f9f0d1a7740 1 --2- 172.21.15.5:0/2310239810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562dea8361b0 0x562deac11040 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9eec011d80 tx=0x7f9eec005970 comp rx=0 tx=0).stop 2024-08-31T05:33:07.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.446+0000 7f9f0d1a7740 1 -- 172.21.15.5:0/2310239810 shutdown_connections 2024-08-31T05:33:07.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.446+0000 7f9f0d1a7740 1 --2- 172.21.15.5:0/2310239810 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562dea85f070 0x562deac2b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:07.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.446+0000 7f9f0d1a7740 1 --2- 172.21.15.5:0/2310239810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562dea83e390 0x562deac11580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:07.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.446+0000 7f9f0d1a7740 1 --2- 172.21.15.5:0/2310239810 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562dea8361b0 0x562deac11040 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:07.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.446+0000 7f9f0d1a7740 1 -- 172.21.15.5:0/2310239810 >> 172.21.15.5:0/2310239810 conn(0x562dea853460 msgr2=0x562deac126d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:07.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.446+0000 7f9f0d1a7740 1 -- 172.21.15.5:0/2310239810 shutdown_connections 2024-08-31T05:33:07.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.447+0000 7f9f0d1a7740 1 -- 172.21.15.5:0/2310239810 wait complete. 2024-08-31T05:33:07.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.447+0000 7f9f0d1a7740 1 -- start start 2024-08-31T05:33:07.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.447+0000 7f9f0d1a7740 1 Processor -- start 2024-08-31T05:33:07.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.447+0000 7f9f0d1a7740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562dea8361b0 0x562deac18140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:07.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.447+0000 7f9f0d1a7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562dea83e390 0x562deac18680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:07.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.448+0000 7f9f0d1a7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562dea85f070 0x562deac18bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:07.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.448+0000 7f9f0d1a7740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9f001afe80 con 0x562dea8361b0 2024-08-31T05:33:07.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.448+0000 7f9f0d1a7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9f001af7b0 con 0x562dea83e390 2024-08-31T05:33:07.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.448+0000 7f9f0d1a7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9f001ac9f0 con 0x562dea85f070 2024-08-31T05:33:07.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.448+0000 7f9f0d1a7740 10 client.0 _ll_register_callbacks cb 0x7f9eec011e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:33:07.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.448+0000 7f9efffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562dea8361b0 0x562deac18140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:07.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.448+0000 7f9f049ce640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562dea83e390 0x562deac18680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:07.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.448+0000 7f9efffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562dea8361b0 0x562deac18140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59006/0 (socket says 172.21.15.5:59006) 2024-08-31T05:33:07.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.448+0000 7f9efffff640 1 -- 172.21.15.5:0/1393206893 learned_addr learned my addr 172.21.15.5:0/1393206893 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:07.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.448+0000 7f9efffff640 1 -- 172.21.15.5:0/1393206893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562dea85f070 msgr2=0x562deac18bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:07.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.448+0000 7f9efffff640 1 --2- 172.21.15.5:0/1393206893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562dea85f070 0x562deac18bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:07.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.448+0000 7f9efffff640 1 -- 172.21.15.5:0/1393206893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562dea83e390 msgr2=0x562deac18680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:07.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.448+0000 7f9efffff640 1 --2- 172.21.15.5:0/1393206893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562dea83e390 0x562deac18680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:07.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.448+0000 7f9efffff640 1 -- 172.21.15.5:0/1393206893 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562deac8fb20 con 0x562dea8361b0 2024-08-31T05:33:07.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.448+0000 7f9f049ce640 1 --2- 172.21.15.5:0/1393206893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562dea83e390 0x562deac18680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:07.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.448+0000 7f9efffff640 1 --2- 172.21.15.5:0/1393206893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562dea8361b0 0x562deac18140 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f9eec00f010 tx=0x7f9eec011ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2de3b4e7496573ca server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:07.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.448+0000 7f9edffff640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:33:07.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.448+0000 7f9edffff640 1 -- 172.21.15.5:0/1393206893 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eec005a70 con 0x562dea8361b0 2024-08-31T05:33:07.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.449+0000 7f9edffff640 1 -- 172.21.15.5:0/1393206893 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f9eec022430 con 0x562dea8361b0 2024-08-31T05:33:07.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.449+0000 7f9f0d1a7740 1 -- 172.21.15.5:0/1393206893 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9eec0046c0 con 0x562dea8361b0 2024-08-31T05:33:07.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.449+0000 7f9edffff640 1 -- 172.21.15.5:0/1393206893 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f9eec022630 con 0x562dea8361b0 2024-08-31T05:33:07.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.449+0000 7f9f0d1a7740 10 client.16386 fetch_fsmap learned FSMap version 32 2024-08-31T05:33:07.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.449+0000 7f9f0d1a7740 1 -- 172.21.15.5:0/1393206893 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x562deac90d80 con 0x562dea8361b0 2024-08-31T05:33:07.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.449+0000 7f9edffff640 1 -- 172.21.15.5:0/1393206893 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9eec022c80 con 0x562dea8361b0 2024-08-31T05:33:07.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.449+0000 7f9edffff640 1 -- 172.21.15.5:0/1393206893 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f9eec0318b0 con 0x562dea8361b0 2024-08-31T05:33:07.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.449+0000 7f9f0d1a7740 10 client.16386 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:33:07.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.449+0000 7f9f0d1a7740 10 client.16386 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-31T05:33:07.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.449+0000 7f9f0d1a7740 20 client.16386 populate_metadata read hostname 'smithi005' 2024-08-31T05:33:07.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.449+0000 7f9f0d1a7740 1 --2- 172.21.15.5:0/1393206893 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x562dea7f2da0 0x562deac93480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:07.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.449+0000 7f9f0d1a7740 4 client.16386 mds_command: new command op to 24602 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:33:07.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.449+0000 7f9f0d1a7740 1 -- 172.21.15.5:0/1393206893 --> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f9eec0046c0 con 0x562dea7f2da0 2024-08-31T05:33:07.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.450+0000 7f9f049ce640 1 --2- 172.21.15.5:0/1393206893 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x562dea7f2da0 0x562deac93480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:07.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.450+0000 7f9edffff640 10 client.16386 ms_handle_connect on v2:172.21.15.50:6836/428759669 2024-08-31T05:33:07.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.450+0000 7f9f049ce640 1 --2- 172.21.15.5:0/1393206893 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x562dea7f2da0 0x562deac93480 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=31c75388e35df6f6 server_cookie=137ead05752829bd in_seq=0 out_seq=0 2024-08-31T05:33:07.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.450+0000 7f9edffff640 1 -- 172.21.15.5:0/1393206893 <== mds.4 v2:172.21.15.50:6836/428759669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f9eec0046c0 con 0x562dea7f2da0 2024-08-31T05:33:07.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.450+0000 7f9edffff640 10 client.16386 handle_command_reply: tid=0 2024-08-31T05:33:07.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.450+0000 7f9f0d1a7740 1 client.16386 shutdown 2024-08-31T05:33:07.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.451+0000 7f9f0d1a7740 1 -- 172.21.15.5:0/1393206893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562dea8361b0 msgr2=0x562deac18140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:07.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.451+0000 7f9f0d1a7740 1 --2- 172.21.15.5:0/1393206893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562dea8361b0 0x562deac18140 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f9eec00f010 tx=0x7f9eec011ef0 comp rx=0 tx=0).stop 2024-08-31T05:33:07.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.451+0000 7f9f0d1a7740 1 -- 172.21.15.5:0/1393206893 shutdown_connections 2024-08-31T05:33:07.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.451+0000 7f9f0d1a7740 1 --2- 172.21.15.5:0/1393206893 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x562dea7f2da0 0x562deac93480 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:07.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.451+0000 7f9edffff640 0 client.16386 ms_handle_reset on v2:172.21.15.50:6836/428759669 2024-08-31T05:33:07.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.451+0000 7f9f0d1a7740 1 --2- 172.21.15.5:0/1393206893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562dea85f070 0x562deac18bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:07.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.451+0000 7f9f0d1a7740 1 --2- 172.21.15.5:0/1393206893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562dea83e390 0x562deac18680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:07.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.451+0000 7f9f0d1a7740 1 --2- 172.21.15.5:0/1393206893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562dea8361b0 0x562deac18140 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:07.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.451+0000 7f9f0d1a7740 1 -- 172.21.15.5:0/1393206893 >> 172.21.15.5:0/1393206893 conn(0x562dea853460 msgr2=0x562deac05340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:07.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.451+0000 7f9f0d1a7740 1 -- 172.21.15.5:0/1393206893 shutdown_connections 2024-08-31T05:33:07.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.451+0000 7f9f0d1a7740 1 -- 172.21.15.5:0/1393206893 wait complete. 2024-08-31T05:33:07.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.451+0000 7f9f0d1a7740 20 client.16386 trim_cache size 0 max 16384 2024-08-31T05:33:07.458 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:33:07.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.452+0000 7f9f06c32640 1 -- 172.21.15.5:0/1658941261 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9ef00b4ca0 msgr2=0x7f9ef00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:07.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.452+0000 7f9f06c32640 1 --2- 172.21.15.5:0/1658941261 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9ef00b4ca0 0x7f9ef00b71b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9ef80e2b90 tx=0x7f9ef8077c80 comp rx=0 tx=0).stop 2024-08-31T05:33:07.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.452+0000 7f9f06c32640 1 -- 172.21.15.5:0/1658941261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f0010dbb0 msgr2=0x7f9f0019fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:07.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.452+0000 7f9f06c32640 1 --2- 172.21.15.5:0/1658941261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f0010dbb0 0x7f9f0019fb80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9ef800efc0 tx=0x7f9ef800c800 comp rx=0 tx=0).stop 2024-08-31T05:33:07.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.452+0000 7f9f06c32640 1 -- 172.21.15.5:0/1658941261 shutdown_connections 2024-08-31T05:33:07.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.452+0000 7f9f06c32640 1 --2- 172.21.15.5:0/1658941261 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9ef00b4ca0 0x7f9ef00b71b0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:07.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.452+0000 7f9f06c32640 1 --2- 172.21.15.5:0/1658941261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9f0010dbb0 0x7f9f0019fb80 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:07.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.452+0000 7f9f06c32640 1 --2- 172.21.15.5:0/1658941261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9f001050a0 0x7f9f0019a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:07.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.452+0000 7f9f06c32640 1 --2- 172.21.15.5:0/1658941261 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9f00104750 0x7f9f0019a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:07.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.452+0000 7f9f06c32640 1 -- 172.21.15.5:0/1658941261 >> 172.21.15.5:0/1658941261 conn(0x7f9f000794d0 msgr2=0x7f9f00100660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:07.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.452+0000 7f9f06c32640 1 -- 172.21.15.5:0/1658941261 shutdown_connections 2024-08-31T05:33:07.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:07.452+0000 7f9f06c32640 1 -- 172.21.15.5:0/1658941261 wait complete. 2024-08-31T05:33:07.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:33:07 smithi070 ceph-mon[22316]: pgmap v439: 129 pgs: 129 active+clean; 143 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.2 MiB/s wr, 330 op/s 2024-08-31T05:33:07.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:33:07 smithi050 ceph-mon[22146]: pgmap v439: 129 pgs: 129 active+clean; 143 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.2 MiB/s wr, 330 op/s 2024-08-31T05:33:07.912 INFO:tasks.workunit.client.0.smithi005.stdout: 1 291427 13.82 MB/sec warmup 115 sec latency 43.287 ms 2024-08-31T05:33:08.134 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-31T05:33:08.401 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:33:08.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.893+0000 7f3b60afb640 1 -- 172.21.15.5:0/2614006415 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b5c108160 msgr2=0x7f3b5c108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:08.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.893+0000 7f3b60afb640 1 --2- 172.21.15.5:0/2614006415 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b5c108160 0x7f3b5c108570 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f3b50009900 tx=0x7f3b5002a410 comp rx=0 tx=0).stop 2024-08-31T05:33:08.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.893+0000 7f3b60afb640 1 -- 172.21.15.5:0/2614006415 shutdown_connections 2024-08-31T05:33:08.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.893+0000 7f3b60afb640 1 --2- 172.21.15.5:0/2614006415 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b5c108ab0 0x7f3b5c10f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:08.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.893+0000 7f3b60afb640 1 --2- 172.21.15.5:0/2614006415 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b5c108160 0x7f3b5c108570 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:08.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.893+0000 7f3b60afb640 1 --2- 172.21.15.5:0/2614006415 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b5c102820 0x7f3b5c102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:08.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.893+0000 7f3b60afb640 1 -- 172.21.15.5:0/2614006415 >> 172.21.15.5:0/2614006415 conn(0x7f3b5c0794e0 msgr2=0x7f3b5c0798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:08.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.893+0000 7f3b60afb640 1 -- 172.21.15.5:0/2614006415 shutdown_connections 2024-08-31T05:33:08.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.893+0000 7f3b60afb640 1 -- 172.21.15.5:0/2614006415 wait complete. 2024-08-31T05:33:08.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.894+0000 7f3b60afb640 1 Processor -- start 2024-08-31T05:33:08.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.894+0000 7f3b60afb640 1 -- start start 2024-08-31T05:33:08.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.894+0000 7f3b60afb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b5c102820 0x7f3b5c19b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:08.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.894+0000 7f3b60afb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b5c108160 0x7f3b5c19b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:08.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.894+0000 7f3b60afb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b5c108ab0 0x7f3b5c19bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:08.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.894+0000 7f3b60afb640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5c1126e0 con 0x7f3b5c102820 2024-08-31T05:33:08.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.894+0000 7f3b60afb640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5c112560 con 0x7f3b5c108ab0 2024-08-31T05:33:08.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.894+0000 7f3b60afb640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5c112860 con 0x7f3b5c108160 2024-08-31T05:33:08.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.894+0000 7f3b5a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b5c102820 0x7f3b5c19b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:08.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.894+0000 7f3b5a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b5c102820 0x7f3b5c19b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59026/0 (socket says 172.21.15.5:59026) 2024-08-31T05:33:08.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.894+0000 7f3b5a59c640 1 -- 172.21.15.5:0/1916257221 learned_addr learned my addr 172.21.15.5:0/1916257221 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:08.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.894+0000 7f3b59d9b640 1 --2- 172.21.15.5:0/1916257221 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b5c108160 0x7f3b5c19b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:08.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.894+0000 7f3b5ad9d640 1 --2- 172.21.15.5:0/1916257221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b5c108ab0 0x7f3b5c19bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:08.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.895+0000 7f3b59d9b640 1 -- 172.21.15.5:0/1916257221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b5c108ab0 msgr2=0x7f3b5c19bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:08.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.895+0000 7f3b59d9b640 1 --2- 172.21.15.5:0/1916257221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b5c108ab0 0x7f3b5c19bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:08.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.895+0000 7f3b59d9b640 1 -- 172.21.15.5:0/1916257221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b5c102820 msgr2=0x7f3b5c19b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:08.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.895+0000 7f3b59d9b640 1 --2- 172.21.15.5:0/1916257221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b5c102820 0x7f3b5c19b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:08.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.895+0000 7f3b59d9b640 1 -- 172.21.15.5:0/1916257221 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b5c1a6440 con 0x7f3b5c108160 2024-08-31T05:33:08.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.895+0000 7f3b5ad9d640 1 --2- 172.21.15.5:0/1916257221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b5c108ab0 0x7f3b5c19bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:08.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.895+0000 7f3b5a59c640 1 --2- 172.21.15.5:0/1916257221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b5c102820 0x7f3b5c19b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:08.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.895+0000 7f3b59d9b640 1 --2- 172.21.15.5:0/1916257221 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b5c108160 0x7f3b5c19b670 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3b5002a930 tx=0x7f3b50031a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:08.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.895+0000 7f3b4b7fe640 1 -- 172.21.15.5:0/1916257221 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b5003f070 con 0x7f3b5c108160 2024-08-31T05:33:08.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.895+0000 7f3b60afb640 1 -- 172.21.15.5:0/1916257221 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b5c1a66d0 con 0x7f3b5c108160 2024-08-31T05:33:08.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.895+0000 7f3b4b7fe640 1 -- 172.21.15.5:0/1916257221 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b50004490 con 0x7f3b5c108160 2024-08-31T05:33:08.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.895+0000 7f3b4b7fe640 1 -- 172.21.15.5:0/1916257221 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b50035070 con 0x7f3b5c108160 2024-08-31T05:33:08.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.895+0000 7f3b60afb640 1 -- 172.21.15.5:0/1916257221 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b5c1a6c00 con 0x7f3b5c108160 2024-08-31T05:33:08.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.898+0000 7f3b67070740 1 Processor -- start 2024-08-31T05:33:08.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.898+0000 7f3b67070740 1 -- start start 2024-08-31T05:33:08.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.898+0000 7f3b67070740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5563fb436070 0x5563fb7db310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:08.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.898+0000 7f3b67070740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5563fb40d1b0 0x5563fb7db850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:08.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.898+0000 7f3b67070740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5563fb415390 0x5563fb7dbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:08.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.898+0000 7f3b67070740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5563fb752680 con 0x5563fb415390 2024-08-31T05:33:08.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.898+0000 7f3b67070740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5563fb741c10 con 0x5563fb40d1b0 2024-08-31T05:33:08.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.898+0000 7f3b67070740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5563fb745bc0 con 0x5563fb436070 2024-08-31T05:33:08.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.898+0000 7f3b5ad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5563fb436070 0x5563fb7db310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:08.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.898+0000 7f3b5ad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5563fb436070 0x5563fb7db310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:58934/0 (socket says 172.21.15.5:58934) 2024-08-31T05:33:08.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.898+0000 7f3b5ad9d640 1 -- 172.21.15.5:0/286287994 learned_addr learned my addr 172.21.15.5:0/286287994 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:08.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.899+0000 7f3b4b7fe640 1 -- 172.21.15.5:0/1916257221 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f3b5003b460 con 0x7f3b5c108160 2024-08-31T05:33:08.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.899+0000 7f3b5a59c640 1 --2- 172.21.15.5:0/286287994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5563fb40d1b0 0x5563fb7db850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:08.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.899+0000 7f3b59d9b640 1 --2- 172.21.15.5:0/286287994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5563fb415390 0x5563fb7dbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:08.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.899+0000 7f3b5ad9d640 1 -- 172.21.15.5:0/286287994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5563fb40d1b0 msgr2=0x5563fb7db850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:08.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.899+0000 7f3b5ad9d640 1 --2- 172.21.15.5:0/286287994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5563fb40d1b0 0x5563fb7db850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:08.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.899+0000 7f3b5ad9d640 1 -- 172.21.15.5:0/286287994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5563fb415390 msgr2=0x5563fb7dbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:08.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.899+0000 7f3b5ad9d640 1 --2- 172.21.15.5:0/286287994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5563fb415390 0x5563fb7dbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:08.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.899+0000 7f3b5ad9d640 1 -- 172.21.15.5:0/286287994 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563fb4a1650 con 0x5563fb436070 2024-08-31T05:33:08.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.899+0000 7f3b59d9b640 1 --2- 172.21.15.5:0/286287994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5563fb415390 0x5563fb7dbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:33:08.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.899+0000 7f3b5ad9d640 1 --2- 172.21.15.5:0/286287994 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5563fb436070 0x5563fb7db310 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3b54011760 tx=0x7f3b54011c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37e739db7b72c897 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:08.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.899+0000 7f3b48ff9640 1 -- 172.21.15.5:0/286287994 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b54004d20 con 0x5563fb436070 2024-08-31T05:33:08.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.899+0000 7f3b48ff9640 1 -- 172.21.15.5:0/286287994 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b54005020 con 0x5563fb436070 2024-08-31T05:33:08.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.899+0000 7f3b48ff9640 1 -- 172.21.15.5:0/286287994 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b54019670 con 0x5563fb436070 2024-08-31T05:33:08.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.900+0000 7f3b4b7fe640 1 --2- 172.21.15.5:0/1916257221 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f3b440b4ca0 0x7f3b440b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:08.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.900+0000 7f3b5a59c640 1 --2- 172.21.15.5:0/1916257221 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f3b440b4ca0 0x7f3b440b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:08.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.900+0000 7f3b4b7fe640 1 -- 172.21.15.5:0/1916257221 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f3b50105d90 con 0x7f3b5c108160 2024-08-31T05:33:08.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.900+0000 7f3b67070740 1 -- 172.21.15.5:0/286287994 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5563fb436070 msgr2=0x5563fb7db310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:08.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.900+0000 7f3b67070740 1 --2- 172.21.15.5:0/286287994 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5563fb436070 0x5563fb7db310 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3b54011760 tx=0x7f3b54011c20 comp rx=0 tx=0).stop 2024-08-31T05:33:08.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.900+0000 7f3b67070740 1 -- 172.21.15.5:0/286287994 shutdown_connections 2024-08-31T05:33:08.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.900+0000 7f3b67070740 1 --2- 172.21.15.5:0/286287994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5563fb415390 0x5563fb7dbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:08.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.900+0000 7f3b67070740 1 --2- 172.21.15.5:0/286287994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5563fb40d1b0 0x5563fb7db850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:08.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.900+0000 7f3b67070740 1 --2- 172.21.15.5:0/286287994 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5563fb436070 0x5563fb7db310 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:08.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.900+0000 7f3b67070740 1 -- 172.21.15.5:0/286287994 >> 172.21.15.5:0/286287994 conn(0x5563fb42a460 msgr2=0x5563fb7d9200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:08.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.900+0000 7f3b5a59c640 1 --2- 172.21.15.5:0/1916257221 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f3b440b4ca0 0x7f3b440b71b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x5563fb7d9f90 tx=0x7f3b4c005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:08.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.900+0000 7f3b67070740 1 -- 172.21.15.5:0/286287994 shutdown_connections 2024-08-31T05:33:08.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.900+0000 7f3b67070740 1 -- 172.21.15.5:0/286287994 wait complete. 2024-08-31T05:33:08.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.901+0000 7f3b67070740 1 -- start start 2024-08-31T05:33:08.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.901+0000 7f3b67070740 1 Processor -- start 2024-08-31T05:33:08.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.901+0000 7f3b67070740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5563fb40d1b0 0x5563fb7eaf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:08.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.901+0000 7f3b67070740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5563fb415390 0x5563fb7eb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:08.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.901+0000 7f3b67070740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5563fb436070 0x5563fb7f71b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:08.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.901+0000 7f3b67070740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5563fb5a4700 con 0x5563fb436070 2024-08-31T05:33:08.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.901+0000 7f3b67070740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5563fb6c8750 con 0x5563fb415390 2024-08-31T05:33:08.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.901+0000 7f3b67070740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5563fb7ede50 con 0x5563fb40d1b0 2024-08-31T05:33:08.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.901+0000 7f3b67070740 10 client.0 _ll_register_callbacks cb 0x5563fb6f7e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:33:08.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.901+0000 7f3b5ad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5563fb436070 0x5563fb7f71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:08.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.901+0000 7f3b5a59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5563fb40d1b0 0x5563fb7eaf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:08.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.901+0000 7f3b5ad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5563fb436070 0x5563fb7f71b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59044/0 (socket says 172.21.15.5:59044) 2024-08-31T05:33:08.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.901+0000 7f3b59d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5563fb415390 0x5563fb7eb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:08.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.901+0000 7f3b5ad9d640 1 -- 172.21.15.5:0/3035055406 learned_addr learned my addr 172.21.15.5:0/3035055406 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:08.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.902+0000 7f3b59d9b640 1 -- 172.21.15.5:0/3035055406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5563fb40d1b0 msgr2=0x5563fb7eaf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:08.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.902+0000 7f3b59d9b640 1 --2- 172.21.15.5:0/3035055406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5563fb40d1b0 0x5563fb7eaf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:08.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.902+0000 7f3b59d9b640 1 -- 172.21.15.5:0/3035055406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5563fb436070 msgr2=0x5563fb7f71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:08.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.902+0000 7f3b59d9b640 1 --2- 172.21.15.5:0/3035055406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5563fb436070 0x5563fb7f71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:08.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.902+0000 7f3b59d9b640 1 -- 172.21.15.5:0/3035055406 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563fb701900 con 0x5563fb415390 2024-08-31T05:33:08.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.902+0000 7f3b5ad9d640 1 --2- 172.21.15.5:0/3035055406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5563fb436070 0x5563fb7f71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:08.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.902+0000 7f3b5a59c640 1 --2- 172.21.15.5:0/3035055406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5563fb40d1b0 0x5563fb7eaf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:08.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.902+0000 7f3b59d9b640 1 --2- 172.21.15.5:0/3035055406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5563fb415390 0x5563fb7eb440 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3b50103100 tx=0x7f3b500cbaa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fc81164f0bd0ea1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:08.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.902+0000 7f3b41ffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:33:08.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.902+0000 7f3b41ffb640 1 -- 172.21.15.5:0/3035055406 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b50048050 con 0x5563fb415390 2024-08-31T05:33:08.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.902+0000 7f3b67070740 1 -- 172.21.15.5:0/3035055406 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b54005020 con 0x5563fb415390 2024-08-31T05:33:08.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.902+0000 7f3b41ffb640 1 -- 172.21.15.5:0/3035055406 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f3b500cc3b0 con 0x5563fb415390 2024-08-31T05:33:08.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.902+0000 7f3b41ffb640 1 -- 172.21.15.5:0/3035055406 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f3b50103590 con 0x5563fb415390 2024-08-31T05:33:08.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.902+0000 7f3b67070740 10 client.25985 fetch_fsmap learned FSMap version 32 2024-08-31T05:33:08.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.902+0000 7f3b67070740 1 -- 172.21.15.5:0/3035055406 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5563fb7f9bc0 con 0x5563fb415390 2024-08-31T05:33:08.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.902+0000 7f3b41ffb640 1 -- 172.21.15.5:0/3035055406 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b54005020 con 0x5563fb415390 2024-08-31T05:33:08.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.903+0000 7f3b41ffb640 1 -- 172.21.15.5:0/3035055406 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f3b5004b060 con 0x5563fb415390 2024-08-31T05:33:08.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.903+0000 7f3b67070740 10 client.25985 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:33:08.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.903+0000 7f3b67070740 10 client.25985 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-31T05:33:08.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.903+0000 7f3b67070740 20 client.25985 populate_metadata read hostname 'smithi005' 2024-08-31T05:33:08.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.903+0000 7f3b67070740 1 --2- 172.21.15.5:0/3035055406 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5563fb3f49f0 0x5563fb7fd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:08.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.903+0000 7f3b67070740 4 client.25985 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:33:08.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.903+0000 7f3b67070740 1 -- 172.21.15.5:0/3035055406 --> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5563fb7545d0 con 0x5563fb3f49f0 2024-08-31T05:33:08.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.903+0000 7f3b5a59c640 1 --2- 172.21.15.5:0/3035055406 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5563fb3f49f0 0x5563fb7fd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:08.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.903+0000 7f3b5a59c640 1 --2- 172.21.15.5:0/3035055406 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5563fb3f49f0 0x5563fb7fd010 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6bdfb436a7e3b226 server_cookie=a3db67a623789d40 in_seq=0 out_seq=0 2024-08-31T05:33:08.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.903+0000 7f3b41ffb640 10 client.25985 ms_handle_connect on v2:172.21.15.70:6834/2061504114 2024-08-31T05:33:08.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.904+0000 7f3b41ffb640 1 -- 172.21.15.5:0/3035055406 <== mds.3 v2:172.21.15.70:6834/2061504114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5563fb7545d0 con 0x5563fb3f49f0 2024-08-31T05:33:08.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.904+0000 7f3b41ffb640 10 client.25985 handle_command_reply: tid=0 2024-08-31T05:33:08.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.904+0000 7f3b67070740 1 client.25985 shutdown 2024-08-31T05:33:08.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.904+0000 7f3b67070740 1 -- 172.21.15.5:0/3035055406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5563fb415390 msgr2=0x5563fb7eb440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:08.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.904+0000 7f3b67070740 1 --2- 172.21.15.5:0/3035055406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5563fb415390 0x5563fb7eb440 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3b50103100 tx=0x7f3b500cbaa0 comp rx=0 tx=0).stop 2024-08-31T05:33:08.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.904+0000 7f3b67070740 1 -- 172.21.15.5:0/3035055406 shutdown_connections 2024-08-31T05:33:08.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.904+0000 7f3b67070740 1 --2- 172.21.15.5:0/3035055406 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5563fb3f49f0 0x5563fb7fd010 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:08.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.904+0000 7f3b67070740 1 --2- 172.21.15.5:0/3035055406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5563fb436070 0x5563fb7f71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:08.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.904+0000 7f3b67070740 1 --2- 172.21.15.5:0/3035055406 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5563fb415390 0x5563fb7eb440 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:08.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.904+0000 7f3b41ffb640 0 client.25985 ms_handle_reset on v2:172.21.15.70:6834/2061504114 2024-08-31T05:33:08.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.904+0000 7f3b67070740 1 --2- 172.21.15.5:0/3035055406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5563fb40d1b0 0x5563fb7eaf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:08.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.904+0000 7f3b67070740 1 -- 172.21.15.5:0/3035055406 >> 172.21.15.5:0/3035055406 conn(0x5563fb42a460 msgr2=0x5563fb7d77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:08.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.904+0000 7f3b67070740 1 -- 172.21.15.5:0/3035055406 shutdown_connections 2024-08-31T05:33:08.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.904+0000 7f3b67070740 1 -- 172.21.15.5:0/3035055406 wait complete. 2024-08-31T05:33:08.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.904+0000 7f3b67070740 20 client.25985 trim_cache size 0 max 16384 2024-08-31T05:33:08.919 INFO:tasks.workunit.client.0.smithi005.stdout: 1 294251 13.82 MB/sec warmup 116 sec latency 42.533 ms 2024-08-31T05:33:08.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.920+0000 7f3b67070740 1 Processor -- start 2024-08-31T05:33:08.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.920+0000 7f3b67070740 1 -- start start 2024-08-31T05:33:08.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.920+0000 7f3b67070740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5563fb40d1b0 0x5563fb7d9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:08.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.920+0000 7f3b67070740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5563fb415390 0x5563fb7f70b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:08.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.920+0000 7f3b67070740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5563fb436070 0x5563fb7e80f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:08.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.920+0000 7f3b67070740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5c1aea80 con 0x5563fb415390 2024-08-31T05:33:08.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.920+0000 7f3b67070740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5c1b0680 con 0x5563fb40d1b0 2024-08-31T05:33:08.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.920+0000 7f3b67070740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5c1af150 con 0x5563fb436070 2024-08-31T05:33:08.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.920+0000 7f3b59d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5563fb415390 0x5563fb7f70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:08.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.920+0000 7f3b59d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5563fb415390 0x5563fb7f70b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59058/0 (socket says 172.21.15.5:59058) 2024-08-31T05:33:08.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.920+0000 7f3b5a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5563fb40d1b0 0x5563fb7d9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:08.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.920+0000 7f3b59d9b640 1 -- 172.21.15.5:0/1967998468 learned_addr learned my addr 172.21.15.5:0/1967998468 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:08.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.920+0000 7f3b5ad9d640 1 --2- 172.21.15.5:0/1967998468 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5563fb436070 0x5563fb7e80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:08.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.921+0000 7f3b5a59c640 1 -- 172.21.15.5:0/1967998468 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5563fb436070 msgr2=0x5563fb7e80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:08.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.921+0000 7f3b5a59c640 1 --2- 172.21.15.5:0/1967998468 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5563fb436070 0x5563fb7e80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:08.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.921+0000 7f3b5a59c640 1 -- 172.21.15.5:0/1967998468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5563fb415390 msgr2=0x5563fb7f70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:08.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.921+0000 7f3b5a59c640 1 --2- 172.21.15.5:0/1967998468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5563fb415390 0x5563fb7f70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:08.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.921+0000 7f3b5a59c640 1 -- 172.21.15.5:0/1967998468 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563fb7dc100 con 0x5563fb40d1b0 2024-08-31T05:33:08.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.921+0000 7f3b59d9b640 1 --2- 172.21.15.5:0/1967998468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5563fb415390 0x5563fb7f70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:08.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.921+0000 7f3b5a59c640 1 --2- 172.21.15.5:0/1967998468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5563fb40d1b0 0x5563fb7d9230 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x5563fb7fd6f0 tx=0x7f3b4c01b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53320cd02907800f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:08.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.921+0000 7f3b43fff640 1 -- 172.21.15.5:0/1967998468 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c01d8a0 con 0x5563fb40d1b0 2024-08-31T05:33:08.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.921+0000 7f3b43fff640 1 -- 172.21.15.5:0/1967998468 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b4c005020 con 0x5563fb40d1b0 2024-08-31T05:33:08.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.921+0000 7f3b43fff640 1 -- 172.21.15.5:0/1967998468 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c004a90 con 0x5563fb40d1b0 2024-08-31T05:33:08.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.922+0000 7f3b67070740 1 -- 172.21.15.5:0/1967998468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5563fb40d1b0 msgr2=0x5563fb7d9230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:08.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.922+0000 7f3b67070740 1 --2- 172.21.15.5:0/1967998468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5563fb40d1b0 0x5563fb7d9230 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x5563fb7fd6f0 tx=0x7f3b4c01b000 comp rx=0 tx=0).stop 2024-08-31T05:33:08.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.922+0000 7f3b67070740 1 -- 172.21.15.5:0/1967998468 shutdown_connections 2024-08-31T05:33:08.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.922+0000 7f3b67070740 1 --2- 172.21.15.5:0/1967998468 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5563fb436070 0x5563fb7e80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:08.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.922+0000 7f3b67070740 1 --2- 172.21.15.5:0/1967998468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5563fb415390 0x5563fb7f70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:08.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.922+0000 7f3b67070740 1 --2- 172.21.15.5:0/1967998468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5563fb40d1b0 0x5563fb7d9230 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:08.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.922+0000 7f3b67070740 1 -- 172.21.15.5:0/1967998468 >> 172.21.15.5:0/1967998468 conn(0x5563fb42a460 msgr2=0x5563fb7d8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:08.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.922+0000 7f3b67070740 1 -- 172.21.15.5:0/1967998468 shutdown_connections 2024-08-31T05:33:08.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.922+0000 7f3b67070740 1 -- 172.21.15.5:0/1967998468 wait complete. 2024-08-31T05:33:08.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.922+0000 7f3b67070740 1 -- start start 2024-08-31T05:33:08.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.922+0000 7f3b67070740 1 Processor -- start 2024-08-31T05:33:08.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.923+0000 7f3b67070740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5563fb40d1b0 0x5563fb7ef3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:08.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.923+0000 7f3b67070740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5563fb415390 0x5563fb7ef8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:08.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.923+0000 7f3b67070740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5563fb436070 0x5563fb8669b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:08.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.923+0000 7f3b67070740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5c1afef0 con 0x5563fb415390 2024-08-31T05:33:08.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.923+0000 7f3b67070740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5c1af820 con 0x5563fb436070 2024-08-31T05:33:08.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.923+0000 7f3b67070740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5c1aca60 con 0x5563fb40d1b0 2024-08-31T05:33:08.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.923+0000 7f3b67070740 10 client.0 _ll_register_callbacks cb 0x7f3b50003f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:33:08.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.923+0000 7f3b59d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5563fb415390 0x5563fb7ef8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:08.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.923+0000 7f3b5a59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5563fb40d1b0 0x5563fb7ef3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:08.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.923+0000 7f3b5a59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5563fb40d1b0 0x5563fb7ef3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:58960/0 (socket says 172.21.15.5:58960) 2024-08-31T05:33:08.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.923+0000 7f3b5a59c640 1 -- 172.21.15.5:0/2487627792 learned_addr learned my addr 172.21.15.5:0/2487627792 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:08.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.923+0000 7f3b5ad9d640 1 --2- 172.21.15.5:0/2487627792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5563fb436070 0x5563fb8669b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:08.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.923+0000 7f3b59d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5563fb415390 0x5563fb7ef8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59062/0 (socket says 172.21.15.5:59062) 2024-08-31T05:33:08.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.923+0000 7f3b59d9b640 1 -- 172.21.15.5:0/2487627792 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5563fb40d1b0 msgr2=0x5563fb7ef3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:08.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.923+0000 7f3b59d9b640 1 --2- 172.21.15.5:0/2487627792 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5563fb40d1b0 0x5563fb7ef3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:08.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.923+0000 7f3b59d9b640 1 -- 172.21.15.5:0/2487627792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5563fb436070 msgr2=0x5563fb8669b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:08.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.923+0000 7f3b59d9b640 1 --2- 172.21.15.5:0/2487627792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5563fb436070 0x5563fb8669b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:08.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.923+0000 7f3b59d9b640 1 -- 172.21.15.5:0/2487627792 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563fb7f0180 con 0x5563fb415390 2024-08-31T05:33:08.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.924+0000 7f3b59d9b640 1 --2- 172.21.15.5:0/2487627792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5563fb415390 0x5563fb7ef8e0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f3b500d4f90 tx=0x7f3b50005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd922949176461fc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:08.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.924+0000 7f3b41ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:33:08.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.924+0000 7f3b41ffb640 1 -- 172.21.15.5:0/2487627792 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b50048020 con 0x5563fb415390 2024-08-31T05:33:08.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.924+0000 7f3b41ffb640 1 -- 172.21.15.5:0/2487627792 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f3b500cb3b0 con 0x5563fb415390 2024-08-31T05:33:08.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.924+0000 7f3b67070740 1 -- 172.21.15.5:0/2487627792 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b4c005020 con 0x5563fb415390 2024-08-31T05:33:08.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.924+0000 7f3b41ffb640 1 -- 172.21.15.5:0/2487627792 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f3b500e6050 con 0x5563fb415390 2024-08-31T05:33:08.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.924+0000 7f3b67070740 10 client.16401 fetch_fsmap learned FSMap version 32 2024-08-31T05:33:08.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.924+0000 7f3b67070740 1 -- 172.21.15.5:0/2487627792 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5563fb867ee0 con 0x5563fb415390 2024-08-31T05:33:08.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.924+0000 7f3b41ffb640 1 -- 172.21.15.5:0/2487627792 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b500e6e50 con 0x5563fb415390 2024-08-31T05:33:08.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.924+0000 7f3b41ffb640 1 -- 172.21.15.5:0/2487627792 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f3b50031a90 con 0x5563fb415390 2024-08-31T05:33:08.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.924+0000 7f3b67070740 10 client.16401 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:33:08.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.924+0000 7f3b67070740 10 client.16401 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-31T05:33:08.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.924+0000 7f3b67070740 20 client.16401 populate_metadata read hostname 'smithi005' 2024-08-31T05:33:08.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.924+0000 7f3b67070740 1 --2- 172.21.15.5:0/2487627792 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5563fb3c9da0 0x5563fb86a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:08.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.924+0000 7f3b67070740 4 client.16401 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:33:08.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.924+0000 7f3b67070740 1 -- 172.21.15.5:0/2487627792 --> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5563fb750070 con 0x5563fb3c9da0 2024-08-31T05:33:08.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.925+0000 7f3b5a59c640 1 --2- 172.21.15.5:0/2487627792 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5563fb3c9da0 0x5563fb86a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:08.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.925+0000 7f3b41ffb640 10 client.16401 ms_handle_connect on v2:172.21.15.70:6834/2061504114 2024-08-31T05:33:08.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.925+0000 7f3b5a59c640 1 --2- 172.21.15.5:0/2487627792 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5563fb3c9da0 0x5563fb86a590 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f5283f6276158794 server_cookie=64f6c5c9f68d3a33 in_seq=0 out_seq=0 2024-08-31T05:33:08.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.925+0000 7f3b41ffb640 1 -- 172.21.15.5:0/2487627792 <== mds.3 v2:172.21.15.70:6834/2061504114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5563fb750070 con 0x5563fb3c9da0 2024-08-31T05:33:08.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.925+0000 7f3b41ffb640 10 client.16401 handle_command_reply: tid=0 2024-08-31T05:33:08.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.925+0000 7f3b67070740 1 client.16401 shutdown 2024-08-31T05:33:08.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.925+0000 7f3b67070740 1 -- 172.21.15.5:0/2487627792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5563fb415390 msgr2=0x5563fb7ef8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:08.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.925+0000 7f3b67070740 1 --2- 172.21.15.5:0/2487627792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5563fb415390 0x5563fb7ef8e0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f3b500d4f90 tx=0x7f3b50005a20 comp rx=0 tx=0).stop 2024-08-31T05:33:08.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.926+0000 7f3b67070740 1 -- 172.21.15.5:0/2487627792 shutdown_connections 2024-08-31T05:33:08.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.926+0000 7f3b67070740 1 --2- 172.21.15.5:0/2487627792 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5563fb3c9da0 0x5563fb86a590 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:08.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.926+0000 7f3b67070740 1 --2- 172.21.15.5:0/2487627792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5563fb436070 0x5563fb8669b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:08.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.926+0000 7f3b67070740 1 --2- 172.21.15.5:0/2487627792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5563fb415390 0x5563fb7ef8e0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:08.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.926+0000 7f3b67070740 1 --2- 172.21.15.5:0/2487627792 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5563fb40d1b0 0x5563fb7ef3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:08.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.926+0000 7f3b67070740 1 -- 172.21.15.5:0/2487627792 >> 172.21.15.5:0/2487627792 conn(0x5563fb42a460 msgr2=0x5563fb7e04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:08.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.926+0000 7f3b41ffb640 0 client.16401 ms_handle_reset on v2:172.21.15.70:6834/2061504114 2024-08-31T05:33:08.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.926+0000 7f3b67070740 1 -- 172.21.15.5:0/2487627792 shutdown_connections 2024-08-31T05:33:08.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.926+0000 7f3b67070740 1 -- 172.21.15.5:0/2487627792 wait complete. 2024-08-31T05:33:08.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.926+0000 7f3b67070740 20 client.16401 trim_cache size 0 max 16384 2024-08-31T05:33:08.933 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:33:08.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.926+0000 7f3b60afb640 1 -- 172.21.15.5:0/1916257221 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f3b440b4ca0 msgr2=0x7f3b440b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:08.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.926+0000 7f3b60afb640 1 --2- 172.21.15.5:0/1916257221 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f3b440b4ca0 0x7f3b440b71b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x5563fb7d9f90 tx=0x7f3b4c005f90 comp rx=0 tx=0).stop 2024-08-31T05:33:08.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.926+0000 7f3b60afb640 1 -- 172.21.15.5:0/1916257221 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b5c108160 msgr2=0x7f3b5c19b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:08.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.926+0000 7f3b60afb640 1 --2- 172.21.15.5:0/1916257221 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b5c108160 0x7f3b5c19b670 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3b5002a930 tx=0x7f3b50031a20 comp rx=0 tx=0).stop 2024-08-31T05:33:08.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.926+0000 7f3b60afb640 1 -- 172.21.15.5:0/1916257221 shutdown_connections 2024-08-31T05:33:08.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.926+0000 7f3b60afb640 1 --2- 172.21.15.5:0/1916257221 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f3b440b4ca0 0x7f3b440b71b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:08.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.926+0000 7f3b60afb640 1 --2- 172.21.15.5:0/1916257221 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b5c108ab0 0x7f3b5c19bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:08.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.926+0000 7f3b60afb640 1 --2- 172.21.15.5:0/1916257221 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b5c108160 0x7f3b5c19b670 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:08.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.926+0000 7f3b60afb640 1 --2- 172.21.15.5:0/1916257221 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b5c102820 0x7f3b5c19b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:08.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.926+0000 7f3b60afb640 1 -- 172.21.15.5:0/1916257221 >> 172.21.15.5:0/1916257221 conn(0x7f3b5c0794e0 msgr2=0x7f3b5c104330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:08.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.926+0000 7f3b60afb640 1 -- 172.21.15.5:0/1916257221 shutdown_connections 2024-08-31T05:33:08.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:08.926+0000 7f3b60afb640 1 -- 172.21.15.5:0/1916257221 wait complete. 2024-08-31T05:33:09.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:33:09 smithi070 ceph-mon[22316]: pgmap v440: 129 pgs: 129 active+clean; 143 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.5 MiB/s wr, 287 op/s 2024-08-31T05:33:09.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:33:09 smithi050 ceph-mon[22146]: pgmap v440: 129 pgs: 129 active+clean; 143 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.5 MiB/s wr, 287 op/s 2024-08-31T05:33:09.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:33:09 smithi005 ceph-mon[18602]: pgmap v440: 129 pgs: 129 active+clean; 143 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.5 MiB/s wr, 287 op/s 2024-08-31T05:33:09.751 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T05:33:09.912 INFO:tasks.workunit.client.0.smithi005.stdout: 1 296810 13.80 MB/sec warmup 117 sec latency 18.256 ms 2024-08-31T05:33:10.027 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:33:10.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.564+0000 7f73d21e3640 1 -- 172.21.15.5:0/3000043873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73cc109240 msgr2=0x7f73cc109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:10.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.564+0000 7f73d21e3640 1 --2- 172.21.15.5:0/3000043873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73cc109240 0x7f73cc109650 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f73c0009900 tx=0x7f73c002a410 comp rx=0 tx=0).stop 2024-08-31T05:33:10.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.564+0000 7f73d21e3640 1 -- 172.21.15.5:0/3000043873 shutdown_connections 2024-08-31T05:33:10.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.564+0000 7f73d21e3640 1 --2- 172.21.15.5:0/3000043873 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73cc109b90 0x7f73cc1103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:10.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.564+0000 7f73d21e3640 1 --2- 172.21.15.5:0/3000043873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73cc109240 0x7f73cc109650 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:10.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.564+0000 7f73d21e3640 1 --2- 172.21.15.5:0/3000043873 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73cc103900 0x7f73cc103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:10.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.564+0000 7f73d21e3640 1 -- 172.21.15.5:0/3000043873 >> 172.21.15.5:0/3000043873 conn(0x7f73cc07b5f0 msgr2=0x7f73cc07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:10.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.564+0000 7f73d21e3640 1 -- 172.21.15.5:0/3000043873 shutdown_connections 2024-08-31T05:33:10.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.564+0000 7f73d21e3640 1 -- 172.21.15.5:0/3000043873 wait complete. 2024-08-31T05:33:10.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.565+0000 7f73d21e3640 1 Processor -- start 2024-08-31T05:33:10.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.565+0000 7f73d21e3640 1 -- start start 2024-08-31T05:33:10.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.565+0000 7f73d21e3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73cc103900 0x7f73cc19c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:10.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.565+0000 7f73d21e3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73cc109240 0x7f73cc19c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:10.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.565+0000 7f73d21e3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73cc109b90 0x7f73cc1a1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:10.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.565+0000 7f73d21e3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f73cc113850 con 0x7f73cc103900 2024-08-31T05:33:10.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.565+0000 7f73d21e3640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f73cc1136d0 con 0x7f73cc109b90 2024-08-31T05:33:10.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.565+0000 7f73d21e3640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f73cc1139d0 con 0x7f73cc109240 2024-08-31T05:33:10.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.565+0000 7f73cb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73cc103900 0x7f73cc19c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:10.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.565+0000 7f73cb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73cc103900 0x7f73cc19c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59076/0 (socket says 172.21.15.5:59076) 2024-08-31T05:33:10.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.565+0000 7f73cb7fe640 1 -- 172.21.15.5:0/1297389340 learned_addr learned my addr 172.21.15.5:0/1297389340 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:10.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.565+0000 7f73cbfff640 1 --2- 172.21.15.5:0/1297389340 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73cc109b90 0x7f73cc1a1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:10.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.565+0000 7f73caffd640 1 --2- 172.21.15.5:0/1297389340 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73cc109240 0x7f73cc19c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:10.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.566+0000 7f73cb7fe640 1 -- 172.21.15.5:0/1297389340 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73cc109240 msgr2=0x7f73cc19c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:10.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.566+0000 7f73cb7fe640 1 --2- 172.21.15.5:0/1297389340 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73cc109240 0x7f73cc19c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:10.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.566+0000 7f73cb7fe640 1 -- 172.21.15.5:0/1297389340 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73cc109b90 msgr2=0x7f73cc1a1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:10.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.566+0000 7f73cb7fe640 1 --2- 172.21.15.5:0/1297389340 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73cc109b90 0x7f73cc1a1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:10.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.566+0000 7f73cb7fe640 1 -- 172.21.15.5:0/1297389340 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73cc1a2390 con 0x7f73cc103900 2024-08-31T05:33:10.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.566+0000 7f73cb7fe640 1 --2- 172.21.15.5:0/1297389340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73cc103900 0x7f73cc19c420 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f73bc00ea60 tx=0x7f73bc00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:10.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.566+0000 7f73c8ff9640 1 -- 172.21.15.5:0/1297389340 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73bc00cde0 con 0x7f73cc103900 2024-08-31T05:33:10.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.566+0000 7f73c8ff9640 1 -- 172.21.15.5:0/1297389340 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73bc0035f0 con 0x7f73cc103900 2024-08-31T05:33:10.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.566+0000 7f73d21e3640 1 -- 172.21.15.5:0/1297389340 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73cc1a2680 con 0x7f73cc103900 2024-08-31T05:33:10.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.566+0000 7f73c8ff9640 1 -- 172.21.15.5:0/1297389340 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73bc010690 con 0x7f73cc103900 2024-08-31T05:33:10.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.566+0000 7f73d21e3640 1 -- 172.21.15.5:0/1297389340 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73cc1a8de0 con 0x7f73cc103900 2024-08-31T05:33:10.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.569+0000 7f73c8ff9640 1 -- 172.21.15.5:0/1297389340 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f73bc0037a0 con 0x7f73cc103900 2024-08-31T05:33:10.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.569+0000 7f73d8758740 1 Processor -- start 2024-08-31T05:33:10.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.569+0000 7f73d8758740 1 -- start start 2024-08-31T05:33:10.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.569+0000 7f73d8758740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b89a789070 0x55b89ab2e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:10.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.569+0000 7f73d8758740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b89a7601b0 0x55b89ab2e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:10.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.569+0000 7f73d8758740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b89a768390 0x55b89ab2edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:10.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.569+0000 7f73d8758740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55b89aaa5680 con 0x55b89a789070 2024-08-31T05:33:10.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.569+0000 7f73d8758740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b89aa94c10 con 0x55b89a7601b0 2024-08-31T05:33:10.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.569+0000 7f73d8758740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b89aa98bc0 con 0x55b89a768390 2024-08-31T05:33:10.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.569+0000 7f73cbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b89a789070 0x55b89ab2e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:10.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.569+0000 7f73cbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b89a789070 0x55b89ab2e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59092/0 (socket says 172.21.15.5:59092) 2024-08-31T05:33:10.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.569+0000 7f73cbfff640 1 -- 172.21.15.5:0/876083031 learned_addr learned my addr 172.21.15.5:0/876083031 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:10.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.569+0000 7f73caffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b89a768390 0x55b89ab2edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:10.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.569+0000 7f73cb7fe640 1 --2- 172.21.15.5:0/876083031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b89a7601b0 0x55b89ab2e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:10.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.570+0000 7f73cbfff640 1 -- 172.21.15.5:0/876083031 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b89a768390 msgr2=0x55b89ab2edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:10.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.570+0000 7f73cbfff640 1 --2- 172.21.15.5:0/876083031 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b89a768390 0x55b89ab2edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:10.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.570+0000 7f73cbfff640 1 -- 172.21.15.5:0/876083031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b89a7601b0 msgr2=0x55b89ab2e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:10.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.570+0000 7f73cbfff640 1 --2- 172.21.15.5:0/876083031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b89a7601b0 0x55b89ab2e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:10.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.570+0000 7f73c8ff9640 1 --2- 172.21.15.5:0/1297389340 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f73b40b4ca0 0x7f73b40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:10.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.570+0000 7f73cbfff640 1 -- 172.21.15.5:0/876083031 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b89a7f4650 con 0x55b89a789070 2024-08-31T05:33:10.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.570+0000 7f73cb7fe640 1 --2- 172.21.15.5:0/876083031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b89a7601b0 0x55b89ab2e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:33:10.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.570+0000 7f73caffd640 1 --2- 172.21.15.5:0/1297389340 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f73b40b4ca0 0x7f73b40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:10.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.570+0000 7f73c8ff9640 1 -- 172.21.15.5:0/1297389340 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f73bc0e5b70 con 0x7f73cc103900 2024-08-31T05:33:10.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.570+0000 7f73cbfff640 1 --2- 172.21.15.5:0/876083031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b89a789070 0x55b89ab2e350 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f73c4009fd0 tx=0x7f73c40118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66cb4e30bfc91d34 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:10.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.570+0000 7f73b1ffb640 1 -- 172.21.15.5:0/876083031 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c4004d20 con 0x55b89a789070 2024-08-31T05:33:10.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.570+0000 7f73b1ffb640 1 -- 172.21.15.5:0/876083031 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73c4004050 con 0x55b89a789070 2024-08-31T05:33:10.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.570+0000 7f73b1ffb640 1 -- 172.21.15.5:0/876083031 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c4005280 con 0x55b89a789070 2024-08-31T05:33:10.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.571+0000 7f73d8758740 1 -- 172.21.15.5:0/876083031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b89a789070 msgr2=0x55b89ab2e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:10.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.571+0000 7f73caffd640 1 --2- 172.21.15.5:0/1297389340 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f73b40b4ca0 0x7f73b40b71b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f73c0009230 tx=0x7f73c0031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:10.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.571+0000 7f73d8758740 1 --2- 172.21.15.5:0/876083031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b89a789070 0x55b89ab2e350 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f73c4009fd0 tx=0x7f73c40118d0 comp rx=0 tx=0).stop 2024-08-31T05:33:10.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.571+0000 7f73d8758740 1 -- 172.21.15.5:0/876083031 shutdown_connections 2024-08-31T05:33:10.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.571+0000 7f73d8758740 1 --2- 172.21.15.5:0/876083031 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b89a768390 0x55b89ab2edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:10.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.571+0000 7f73d8758740 1 --2- 172.21.15.5:0/876083031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b89a7601b0 0x55b89ab2e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:10.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.571+0000 7f73d8758740 1 --2- 172.21.15.5:0/876083031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b89a789070 0x55b89ab2e350 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:10.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.571+0000 7f73d8758740 1 -- 172.21.15.5:0/876083031 >> 172.21.15.5:0/876083031 conn(0x55b89a77d460 msgr2=0x55b89ab2c240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:10.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.571+0000 7f73d8758740 1 -- 172.21.15.5:0/876083031 shutdown_connections 2024-08-31T05:33:10.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.571+0000 7f73d8758740 1 -- 172.21.15.5:0/876083031 wait complete. 2024-08-31T05:33:10.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.572+0000 7f73d8758740 1 -- start start 2024-08-31T05:33:10.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.572+0000 7f73d8758740 1 Processor -- start 2024-08-31T05:33:10.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.572+0000 7f73d8758740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b89a7601b0 0x55b89ab39b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:10.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.572+0000 7f73d8758740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b89a768390 0x55b89ab3a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:10.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.572+0000 7f73d8758740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b89a789070 0x55b89ab45e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:10.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.572+0000 7f73d8758740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55b89a8f7700 con 0x55b89a768390 2024-08-31T05:33:10.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.572+0000 7f73d8758740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b89aa1b750 con 0x55b89a789070 2024-08-31T05:33:10.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.572+0000 7f73d8758740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b89ab3cb30 con 0x55b89a7601b0 2024-08-31T05:33:10.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.572+0000 7f73d8758740 10 client.0 _ll_register_callbacks cb 0x55b89aa4ae10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:33:10.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.572+0000 7f73caffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b89a768390 0x55b89ab3a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:10.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.572+0000 7f73cb7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b89a7601b0 0x55b89ab39b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:10.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.572+0000 7f73caffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b89a768390 0x55b89ab3a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59104/0 (socket says 172.21.15.5:59104) 2024-08-31T05:33:10.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.572+0000 7f73caffd640 1 -- 172.21.15.5:0/756565068 learned_addr learned my addr 172.21.15.5:0/756565068 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:10.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.572+0000 7f73cbfff640 1 --2- 172.21.15.5:0/756565068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b89a789070 0x55b89ab45e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:10.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.573+0000 7f73cbfff640 1 -- 172.21.15.5:0/756565068 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b89a7601b0 msgr2=0x55b89ab39b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:10.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.573+0000 7f73cbfff640 1 --2- 172.21.15.5:0/756565068 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b89a7601b0 0x55b89ab39b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:10.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.573+0000 7f73cbfff640 1 -- 172.21.15.5:0/756565068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b89a768390 msgr2=0x55b89ab3a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:10.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.573+0000 7f73cbfff640 1 --2- 172.21.15.5:0/756565068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b89a768390 0x55b89ab3a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:10.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.573+0000 7f73cbfff640 1 -- 172.21.15.5:0/756565068 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b89aa54900 con 0x55b89a789070 2024-08-31T05:33:10.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.573+0000 7f73cb7fe640 1 --2- 172.21.15.5:0/756565068 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b89a7601b0 0x55b89ab39b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:10.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.573+0000 7f73caffd640 1 --2- 172.21.15.5:0/756565068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b89a768390 0x55b89ab3a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:10.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.573+0000 7f73cbfff640 1 --2- 172.21.15.5:0/756565068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b89a789070 0x55b89ab45e20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f73c4004970 tx=0x7f73c4004280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f20802cc0fc8600 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:10.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.573+0000 7f73aaffd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:33:10.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.573+0000 7f73aaffd640 1 -- 172.21.15.5:0/756565068 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c4028020 con 0x55b89a789070 2024-08-31T05:33:10.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.573+0000 7f73d8758740 1 -- 172.21.15.5:0/756565068 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73c4004050 con 0x55b89a789070 2024-08-31T05:33:10.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.573+0000 7f73aaffd640 1 -- 172.21.15.5:0/756565068 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f73c4004a40 con 0x55b89a789070 2024-08-31T05:33:10.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.573+0000 7f73aaffd640 1 -- 172.21.15.5:0/756565068 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f73c4033050 con 0x55b89a789070 2024-08-31T05:33:10.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.573+0000 7f73d8758740 10 client.26003 fetch_fsmap learned FSMap version 32 2024-08-31T05:33:10.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.573+0000 7f73d8758740 1 -- 172.21.15.5:0/756565068 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55b89ab48910 con 0x55b89a789070 2024-08-31T05:33:10.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.574+0000 7f73aaffd640 1 -- 172.21.15.5:0/756565068 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73c4004050 con 0x55b89a789070 2024-08-31T05:33:10.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.574+0000 7f73aaffd640 1 -- 172.21.15.5:0/756565068 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f73c400f4e0 con 0x55b89a789070 2024-08-31T05:33:10.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.574+0000 7f73d8758740 10 client.26003 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:33:10.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.574+0000 7f73d8758740 10 client.26003 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-31T05:33:10.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.574+0000 7f73d8758740 20 client.26003 populate_metadata read hostname 'smithi005' 2024-08-31T05:33:10.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.574+0000 7f73d8758740 1 --2- 172.21.15.5:0/756565068 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55b89a7479f0 0x55b89ab4bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:10.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.574+0000 7f73d8758740 4 client.26003 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:33:10.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.574+0000 7f73d8758740 1 -- 172.21.15.5:0/756565068 --> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b89aaa75d0 con 0x55b89a7479f0 2024-08-31T05:33:10.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.574+0000 7f73cb7fe640 1 --2- 172.21.15.5:0/756565068 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55b89a7479f0 0x55b89ab4bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:10.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.574+0000 7f73aaffd640 10 client.26003 ms_handle_connect on v2:172.21.15.70:6836/2780036414 2024-08-31T05:33:10.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.574+0000 7f73cb7fe640 1 --2- 172.21.15.5:0/756565068 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55b89a7479f0 0x55b89ab4bd30 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c382732c44a827c0 server_cookie=18a7053197f02fbf in_seq=0 out_seq=0 2024-08-31T05:33:10.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.575+0000 7f73aaffd640 1 -- 172.21.15.5:0/756565068 <== mds.2 v2:172.21.15.70:6836/2780036414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b89aaa75d0 con 0x55b89a7479f0 2024-08-31T05:33:10.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.575+0000 7f73aaffd640 10 client.26003 handle_command_reply: tid=0 2024-08-31T05:33:10.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.575+0000 7f73d8758740 1 client.26003 shutdown 2024-08-31T05:33:10.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.575+0000 7f73d8758740 1 -- 172.21.15.5:0/756565068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b89a789070 msgr2=0x55b89ab45e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:10.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.575+0000 7f73d8758740 1 --2- 172.21.15.5:0/756565068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b89a789070 0x55b89ab45e20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f73c4004970 tx=0x7f73c4004280 comp rx=0 tx=0).stop 2024-08-31T05:33:10.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.576+0000 7f73d8758740 1 -- 172.21.15.5:0/756565068 shutdown_connections 2024-08-31T05:33:10.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.576+0000 7f73d8758740 1 --2- 172.21.15.5:0/756565068 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55b89a7479f0 0x55b89ab4bd30 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:10.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.576+0000 7f73d8758740 1 --2- 172.21.15.5:0/756565068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b89a789070 0x55b89ab45e20 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:10.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.576+0000 7f73d8758740 1 --2- 172.21.15.5:0/756565068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b89a768390 0x55b89ab3a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:10.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.576+0000 7f73d8758740 1 --2- 172.21.15.5:0/756565068 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b89a7601b0 0x55b89ab39b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:10.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.576+0000 7f73aaffd640 0 client.26003 ms_handle_reset on v2:172.21.15.70:6836/2780036414 2024-08-31T05:33:10.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.576+0000 7f73d8758740 1 -- 172.21.15.5:0/756565068 >> 172.21.15.5:0/756565068 conn(0x55b89a77d460 msgr2=0x55b89ab31530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:10.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.576+0000 7f73d8758740 1 -- 172.21.15.5:0/756565068 shutdown_connections 2024-08-31T05:33:10.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.576+0000 7f73d8758740 1 -- 172.21.15.5:0/756565068 wait complete. 2024-08-31T05:33:10.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.576+0000 7f73d8758740 20 client.26003 trim_cache size 0 max 16384 2024-08-31T05:33:10.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.589+0000 7f73d8758740 1 Processor -- start 2024-08-31T05:33:10.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.589+0000 7f73d8758740 1 -- start start 2024-08-31T05:33:10.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.589+0000 7f73d8758740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b89a77d460 0x55b89ab3a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:10.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.590+0000 7f73d8758740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b89a7601b0 0x55b89ab3b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:10.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.590+0000 7f73d8758740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b89a768390 0x55b89ab45d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:10.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.590+0000 7f73d8758740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f73cc1b2e80 con 0x55b89a7601b0 2024-08-31T05:33:10.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.590+0000 7f73d8758740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f73cc1b4a80 con 0x55b89a768390 2024-08-31T05:33:10.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.590+0000 7f73d8758740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f73cc1b3550 con 0x55b89a77d460 2024-08-31T05:33:10.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.590+0000 7f73caffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b89a7601b0 0x55b89ab3b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:10.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.590+0000 7f73caffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b89a7601b0 0x55b89ab3b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59110/0 (socket says 172.21.15.5:59110) 2024-08-31T05:33:10.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.590+0000 7f73cbfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b89a768390 0x55b89ab45d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:10.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.590+0000 7f73caffd640 1 -- 172.21.15.5:0/3079524388 learned_addr learned my addr 172.21.15.5:0/3079524388 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:10.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.590+0000 7f73cb7fe640 1 --2- 172.21.15.5:0/3079524388 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b89a77d460 0x55b89ab3a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:10.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.590+0000 7f73cbfff640 1 -- 172.21.15.5:0/3079524388 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b89a77d460 msgr2=0x55b89ab3a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:10.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.590+0000 7f73cbfff640 1 --2- 172.21.15.5:0/3079524388 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b89a77d460 0x55b89ab3a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:10.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.590+0000 7f73cbfff640 1 -- 172.21.15.5:0/3079524388 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b89a7601b0 msgr2=0x55b89ab3b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:10.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.590+0000 7f73cbfff640 1 --2- 172.21.15.5:0/3079524388 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b89a7601b0 0x55b89ab3b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:10.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.590+0000 7f73cbfff640 1 -- 172.21.15.5:0/3079524388 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b89ab3adf0 con 0x55b89a768390 2024-08-31T05:33:10.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.590+0000 7f73cbfff640 1 --2- 172.21.15.5:0/3079524388 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b89a768390 0x55b89ab45d20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f73c400faf0 tx=0x7f73c4004720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b872709160b1c8f2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:10.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.590+0000 7f73b17fa640 1 -- 172.21.15.5:0/3079524388 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c4028040 con 0x55b89a768390 2024-08-31T05:33:10.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.590+0000 7f73b17fa640 1 -- 172.21.15.5:0/3079524388 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73c4011dd0 con 0x55b89a768390 2024-08-31T05:33:10.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.590+0000 7f73b17fa640 1 -- 172.21.15.5:0/3079524388 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c4004e10 con 0x55b89a768390 2024-08-31T05:33:10.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.591+0000 7f73d8758740 1 -- 172.21.15.5:0/3079524388 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b89a768390 msgr2=0x55b89ab45d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:10.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.591+0000 7f73d8758740 1 --2- 172.21.15.5:0/3079524388 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b89a768390 0x55b89ab45d20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f73c400faf0 tx=0x7f73c4004720 comp rx=0 tx=0).stop 2024-08-31T05:33:10.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.591+0000 7f73d8758740 1 -- 172.21.15.5:0/3079524388 shutdown_connections 2024-08-31T05:33:10.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.591+0000 7f73d8758740 1 --2- 172.21.15.5:0/3079524388 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b89a768390 0x55b89ab45d20 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:10.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.591+0000 7f73d8758740 1 --2- 172.21.15.5:0/3079524388 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b89a7601b0 0x55b89ab3b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:10.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.591+0000 7f73d8758740 1 --2- 172.21.15.5:0/3079524388 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b89a77d460 0x55b89ab3a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:10.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.591+0000 7f73d8758740 1 -- 172.21.15.5:0/3079524388 >> 172.21.15.5:0/3079524388 conn(0x55b89ab2c540 msgr2=0x55b89ab3b050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:10.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.591+0000 7f73d8758740 1 -- 172.21.15.5:0/3079524388 shutdown_connections 2024-08-31T05:33:10.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.591+0000 7f73d8758740 1 -- 172.21.15.5:0/3079524388 wait complete. 2024-08-31T05:33:10.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.592+0000 7f73d8758740 1 -- start start 2024-08-31T05:33:10.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.592+0000 7f73d8758740 1 Processor -- start 2024-08-31T05:33:10.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.592+0000 7f73d8758740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b89a7601b0 0x55b89ab3dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:10.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.592+0000 7f73d8758740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b89a768390 0x55b89ab3e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:10.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.592+0000 7f73d8758740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b89a77d460 0x55b89ab3e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:10.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.592+0000 7f73d8758740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f73cc1b42f0 con 0x55b89a7601b0 2024-08-31T05:33:10.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.592+0000 7f73d8758740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f73cc1b3c20 con 0x55b89a77d460 2024-08-31T05:33:10.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.592+0000 7f73d8758740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f73cc1b0e60 con 0x55b89a768390 2024-08-31T05:33:10.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.592+0000 7f73d8758740 10 client.0 _ll_register_callbacks cb 0x7f73c40093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:33:10.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.592+0000 7f73cb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b89a7601b0 0x55b89ab3dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:10.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.592+0000 7f73caffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b89a768390 0x55b89ab3e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:10.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.592+0000 7f73cb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b89a7601b0 0x55b89ab3dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59116/0 (socket says 172.21.15.5:59116) 2024-08-31T05:33:10.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.592+0000 7f73cb7fe640 1 -- 172.21.15.5:0/3797678375 learned_addr learned my addr 172.21.15.5:0/3797678375 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:10.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.592+0000 7f73cbfff640 1 --2- 172.21.15.5:0/3797678375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b89a77d460 0x55b89ab3e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:10.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.593+0000 7f73cb7fe640 1 -- 172.21.15.5:0/3797678375 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b89a768390 msgr2=0x55b89ab3e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:10.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.593+0000 7f73cb7fe640 1 --2- 172.21.15.5:0/3797678375 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b89a768390 0x55b89ab3e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:10.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.593+0000 7f73cb7fe640 1 -- 172.21.15.5:0/3797678375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b89a77d460 msgr2=0x55b89ab3e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:10.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.593+0000 7f73cb7fe640 1 --2- 172.21.15.5:0/3797678375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b89a77d460 0x55b89ab3e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:10.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.593+0000 7f73cb7fe640 1 -- 172.21.15.5:0/3797678375 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b89abb55e0 con 0x55b89a7601b0 2024-08-31T05:33:10.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.593+0000 7f73cbfff640 1 --2- 172.21.15.5:0/3797678375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b89a77d460 0x55b89ab3e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:10.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.593+0000 7f73cb7fe640 1 --2- 172.21.15.5:0/3797678375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b89a7601b0 0x55b89ab3dd40 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f73bc000c00 tx=0x7f73bc003cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=709c3c0c7fe57cde server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:10.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.593+0000 7f73aaffd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:33:10.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.593+0000 7f73aaffd640 1 -- 172.21.15.5:0/3797678375 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73bc0ac5e0 con 0x55b89a7601b0 2024-08-31T05:33:10.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.593+0000 7f73aaffd640 1 -- 172.21.15.5:0/3797678375 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f73bc0a84d0 con 0x55b89a7601b0 2024-08-31T05:33:10.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.593+0000 7f73d8758740 1 -- 172.21.15.5:0/3797678375 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73c4011dd0 con 0x55b89a7601b0 2024-08-31T05:33:10.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.593+0000 7f73aaffd640 1 -- 172.21.15.5:0/3797678375 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f73bc0e9030 con 0x55b89a7601b0 2024-08-31T05:33:10.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.593+0000 7f73d8758740 10 client.16419 fetch_fsmap learned FSMap version 32 2024-08-31T05:33:10.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.593+0000 7f73d8758740 1 -- 172.21.15.5:0/3797678375 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55b89abb6840 con 0x55b89a7601b0 2024-08-31T05:33:10.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.594+0000 7f73aaffd640 1 -- 172.21.15.5:0/3797678375 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73c4011dd0 con 0x55b89a7601b0 2024-08-31T05:33:10.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.594+0000 7f73aaffd640 1 -- 172.21.15.5:0/3797678375 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f73bc0970f0 con 0x55b89a7601b0 2024-08-31T05:33:10.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.594+0000 7f73d8758740 10 client.16419 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:33:10.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.594+0000 7f73d8758740 10 client.16419 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-31T05:33:10.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.594+0000 7f73d8758740 20 client.16419 populate_metadata read hostname 'smithi005' 2024-08-31T05:33:10.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.594+0000 7f73d8758740 1 --2- 172.21.15.5:0/3797678375 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55b89a789070 0x55b89abb8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:10.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.594+0000 7f73d8758740 4 client.16419 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:33:10.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.594+0000 7f73d8758740 1 -- 172.21.15.5:0/3797678375 --> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b89aaa3070 con 0x55b89a789070 2024-08-31T05:33:10.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.594+0000 7f73caffd640 1 --2- 172.21.15.5:0/3797678375 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55b89a789070 0x55b89abb8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:10.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.594+0000 7f73aaffd640 10 client.16419 ms_handle_connect on v2:172.21.15.70:6836/2780036414 2024-08-31T05:33:10.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.595+0000 7f73caffd640 1 --2- 172.21.15.5:0/3797678375 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55b89a789070 0x55b89abb8f60 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5c9b862fdaa0bf77 server_cookie=266fa35a3cdcf0bd in_seq=0 out_seq=0 2024-08-31T05:33:10.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.595+0000 7f73aaffd640 1 -- 172.21.15.5:0/3797678375 <== mds.2 v2:172.21.15.70:6836/2780036414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b89aaa3070 con 0x55b89a789070 2024-08-31T05:33:10.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.595+0000 7f73aaffd640 10 client.16419 handle_command_reply: tid=0 2024-08-31T05:33:10.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.595+0000 7f73d8758740 1 client.16419 shutdown 2024-08-31T05:33:10.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.595+0000 7f73d8758740 1 -- 172.21.15.5:0/3797678375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b89a7601b0 msgr2=0x55b89ab3dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:10.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.595+0000 7f73d8758740 1 --2- 172.21.15.5:0/3797678375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b89a7601b0 0x55b89ab3dd40 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f73bc000c00 tx=0x7f73bc003cf0 comp rx=0 tx=0).stop 2024-08-31T05:33:10.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.595+0000 7f73d8758740 1 -- 172.21.15.5:0/3797678375 shutdown_connections 2024-08-31T05:33:10.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.595+0000 7f73d8758740 1 --2- 172.21.15.5:0/3797678375 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55b89a789070 0x55b89abb8f60 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:10.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.595+0000 7f73d8758740 1 --2- 172.21.15.5:0/3797678375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b89a77d460 0x55b89ab3e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:10.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.595+0000 7f73d8758740 1 --2- 172.21.15.5:0/3797678375 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b89a768390 0x55b89ab3e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:10.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.595+0000 7f73d8758740 1 --2- 172.21.15.5:0/3797678375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b89a7601b0 0x55b89ab3dd40 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:10.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.595+0000 7f73d8758740 1 -- 172.21.15.5:0/3797678375 >> 172.21.15.5:0/3797678375 conn(0x55b89ab2c540 msgr2=0x55b89ab3a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:10.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.595+0000 7f73aaffd640 0 client.16419 ms_handle_reset on v2:172.21.15.70:6836/2780036414 2024-08-31T05:33:10.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.595+0000 7f73d8758740 1 -- 172.21.15.5:0/3797678375 shutdown_connections 2024-08-31T05:33:10.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.595+0000 7f73d8758740 1 -- 172.21.15.5:0/3797678375 wait complete. 2024-08-31T05:33:10.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.595+0000 7f73d8758740 20 client.16419 trim_cache size 0 max 16384 2024-08-31T05:33:10.603 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:33:10.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.596+0000 7f73d21e3640 1 -- 172.21.15.5:0/1297389340 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f73b40b4ca0 msgr2=0x7f73b40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:10.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.596+0000 7f73d21e3640 1 --2- 172.21.15.5:0/1297389340 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f73b40b4ca0 0x7f73b40b71b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f73c0009230 tx=0x7f73c0031400 comp rx=0 tx=0).stop 2024-08-31T05:33:10.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.596+0000 7f73d21e3640 1 -- 172.21.15.5:0/1297389340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73cc103900 msgr2=0x7f73cc19c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:10.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.596+0000 7f73d21e3640 1 --2- 172.21.15.5:0/1297389340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73cc103900 0x7f73cc19c420 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f73bc00ea60 tx=0x7f73bc00ef20 comp rx=0 tx=0).stop 2024-08-31T05:33:10.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.596+0000 7f73d21e3640 1 -- 172.21.15.5:0/1297389340 shutdown_connections 2024-08-31T05:33:10.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.596+0000 7f73d21e3640 1 --2- 172.21.15.5:0/1297389340 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f73b40b4ca0 0x7f73b40b71b0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:10.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.596+0000 7f73d21e3640 1 --2- 172.21.15.5:0/1297389340 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f73cc109b90 0x7f73cc1a1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:10.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.596+0000 7f73d21e3640 1 --2- 172.21.15.5:0/1297389340 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73cc109240 0x7f73cc19c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:10.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.596+0000 7f73d21e3640 1 --2- 172.21.15.5:0/1297389340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73cc103900 0x7f73cc19c420 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:10.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.596+0000 7f73d21e3640 1 -- 172.21.15.5:0/1297389340 >> 172.21.15.5:0/1297389340 conn(0x7f73cc07b5f0 msgr2=0x7f73cc107050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:10.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.596+0000 7f73d21e3640 1 -- 172.21.15.5:0/1297389340 shutdown_connections 2024-08-31T05:33:10.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:10.596+0000 7f73d21e3640 1 -- 172.21.15.5:0/1297389340 wait complete. 2024-08-31T05:33:10.912 INFO:tasks.workunit.client.0.smithi005.stdout: 1 298807 13.79 MB/sec warmup 118 sec latency 26.912 ms 2024-08-31T05:33:11.440 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T05:33:11.462 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:33:11 smithi005 ceph-mon[18602]: pgmap v441: 129 pgs: 129 active+clean; 147 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.1 MiB/s wr, 305 op/s 2024-08-31T05:33:11.585 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:33:11 smithi070 ceph-mon[22316]: pgmap v441: 129 pgs: 129 active+clean; 147 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.1 MiB/s wr, 305 op/s 2024-08-31T05:33:11.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:33:11 smithi050 ceph-mon[22146]: pgmap v441: 129 pgs: 129 active+clean; 147 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.1 MiB/s wr, 305 op/s 2024-08-31T05:33:11.699 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:33:11.912 INFO:tasks.workunit.client.0.smithi005.stdout: 1 301678 13.82 MB/sec warmup 119 sec latency 116.722 ms 2024-08-31T05:33:12.242 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.240+0000 7fa71202f640 1 -- 172.21.15.5:0/1647169954 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa70c1089e0 msgr2=0x7fa70c10f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:12.242 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.240+0000 7fa71202f640 1 --2- 172.21.15.5:0/1647169954 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa70c1089e0 0x7fa70c10f210 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fa704009ca0 tx=0x7fa70402a8c0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.243 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.240+0000 7fa71202f640 1 -- 172.21.15.5:0/1647169954 shutdown_connections 2024-08-31T05:33:12.243 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.240+0000 7fa71202f640 1 --2- 172.21.15.5:0/1647169954 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa70c1089e0 0x7fa70c10f210 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.243 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.240+0000 7fa71202f640 1 --2- 172.21.15.5:0/1647169954 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa70c108090 0x7fa70c1084a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.243 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.240+0000 7fa71202f640 1 --2- 172.21.15.5:0/1647169954 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa70c102760 0x7fa70c102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.243 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.240+0000 7fa71202f640 1 -- 172.21.15.5:0/1647169954 >> 172.21.15.5:0/1647169954 conn(0x7fa70c0fe160 msgr2=0x7fa70c1005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:12.243 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.240+0000 7fa71202f640 1 -- 172.21.15.5:0/1647169954 shutdown_connections 2024-08-31T05:33:12.243 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.240+0000 7fa71202f640 1 -- 172.21.15.5:0/1647169954 wait complete. 2024-08-31T05:33:12.243 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.241+0000 7fa71202f640 1 Processor -- start 2024-08-31T05:33:12.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.241+0000 7fa71202f640 1 -- start start 2024-08-31T05:33:12.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.241+0000 7fa71202f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa70c102760 0x7fa70c199080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:12.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.241+0000 7fa71202f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa70c108090 0x7fa70c199620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:12.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.241+0000 7fa71202f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa70c1089e0 0x7fa70c19e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:12.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.241+0000 7fa71202f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa70c1126e0 con 0x7fa70c108090 2024-08-31T05:33:12.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.241+0000 7fa71202f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa70c112560 con 0x7fa70c102760 2024-08-31T05:33:12.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.241+0000 7fa71202f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa70c112860 con 0x7fa70c1089e0 2024-08-31T05:33:12.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.241+0000 7fa70b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa70c102760 0x7fa70c199080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:12.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.241+0000 7fa70affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa70c108090 0x7fa70c199620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:12.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.241+0000 7fa70b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa70c102760 0x7fa70c199080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:53912/0 (socket says 172.21.15.5:53912) 2024-08-31T05:33:12.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.241+0000 7fa70b7fe640 1 -- 172.21.15.5:0/1035449036 learned_addr learned my addr 172.21.15.5:0/1035449036 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:12.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.241+0000 7fa70bfff640 1 --2- 172.21.15.5:0/1035449036 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa70c1089e0 0x7fa70c19e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:12.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.242+0000 7fa70b7fe640 1 -- 172.21.15.5:0/1035449036 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa70c1089e0 msgr2=0x7fa70c19e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:12.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.242+0000 7fa70b7fe640 1 --2- 172.21.15.5:0/1035449036 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa70c1089e0 0x7fa70c19e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.242+0000 7fa70b7fe640 1 -- 172.21.15.5:0/1035449036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa70c108090 msgr2=0x7fa70c199620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:12.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.242+0000 7fa70b7fe640 1 --2- 172.21.15.5:0/1035449036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa70c108090 0x7fa70c199620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.242+0000 7fa70b7fe640 1 -- 172.21.15.5:0/1035449036 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa70c19efb0 con 0x7fa70c102760 2024-08-31T05:33:12.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.242+0000 7fa70b7fe640 1 --2- 172.21.15.5:0/1035449036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa70c102760 0x7fa70c199080 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc00e9f0 tx=0x7fa6fc00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:12.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.242+0000 7fa708ff9640 1 -- 172.21.15.5:0/1035449036 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6fc00cd80 con 0x7fa70c102760 2024-08-31T05:33:12.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.242+0000 7fa708ff9640 1 -- 172.21.15.5:0/1035449036 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6fc0108e0 con 0x7fa70c102760 2024-08-31T05:33:12.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.242+0000 7fa708ff9640 1 -- 172.21.15.5:0/1035449036 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6fc018980 con 0x7fa70c102760 2024-08-31T05:33:12.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.242+0000 7fa71202f640 1 -- 172.21.15.5:0/1035449036 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa70c19f2a0 con 0x7fa70c102760 2024-08-31T05:33:12.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.242+0000 7fa71202f640 1 -- 172.21.15.5:0/1035449036 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa70c1a5a30 con 0x7fa70c102760 2024-08-31T05:33:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.245+0000 7fa708ff9640 1 -- 172.21.15.5:0/1035449036 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fa6fc018b20 con 0x7fa70c102760 2024-08-31T05:33:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.245+0000 7fa71907c740 1 Processor -- start 2024-08-31T05:33:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.245+0000 7fa71907c740 1 -- start start 2024-08-31T05:33:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.245+0000 7fa71907c740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d549db1b0 0x555d54d7eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.245+0000 7fa71907c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d549b22f0 0x555d54d7f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.245+0000 7fa71907c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555d549ba4d0 0x555d54d7f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.245+0000 7fa71907c740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x555d54cf4000 con 0x555d549db1b0 2024-08-31T05:33:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.245+0000 7fa71907c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x555d54ce3590 con 0x555d549b22f0 2024-08-31T05:33:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.245+0000 7fa71907c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555d54ce7540 con 0x555d549ba4d0 2024-08-31T05:33:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.245+0000 7fa70bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d549db1b0 0x555d54d7eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.245+0000 7fa70bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d549db1b0 0x555d54d7eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50948/0 (socket says 172.21.15.5:50948) 2024-08-31T05:33:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.245+0000 7fa70bfff640 1 -- 172.21.15.5:0/1213859651 learned_addr learned my addr 172.21.15.5:0/1213859651 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.246+0000 7fa70b7fe640 1 --2- 172.21.15.5:0/1213859651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d549b22f0 0x555d54d7f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.246+0000 7fa70affd640 1 --2- 172.21.15.5:0/1213859651 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555d549ba4d0 0x555d54d7f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:12.256 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.246+0000 7fa708ff9640 1 --2- 172.21.15.5:0/1035449036 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa6f40b4da0 0x7fa6f40b72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:12.256 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.246+0000 7fa70b7fe640 1 -- 172.21.15.5:0/1213859651 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555d549ba4d0 msgr2=0x555d54d7f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:12.256 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.246+0000 7fa70b7fe640 1 --2- 172.21.15.5:0/1213859651 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555d549ba4d0 0x555d54d7f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.256 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.246+0000 7fa70b7fe640 1 -- 172.21.15.5:0/1213859651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d549db1b0 msgr2=0x555d54d7eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:12.256 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.246+0000 7fa70b7fe640 1 --2- 172.21.15.5:0/1213859651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d549db1b0 0x555d54d7eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.256 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.246+0000 7fa70b7fe640 1 -- 172.21.15.5:0/1213859651 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d54a46790 con 0x555d549b22f0 2024-08-31T05:33:12.256 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.246+0000 7fa70bfff640 1 --2- 172.21.15.5:0/1213859651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d549db1b0 0x555d54d7eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:12.256 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.246+0000 7fa70bfff640 1 --2- 172.21.15.5:0/1035449036 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa6f40b4da0 0x7fa6f40b72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:12.256 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.246+0000 7fa708ff9640 1 -- 172.21.15.5:0/1035449036 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fa6fc0e5c10 con 0x7fa70c102760 2024-08-31T05:33:12.256 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.246+0000 7fa70affd640 1 --2- 172.21.15.5:0/1213859651 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555d549ba4d0 0x555d54d7f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:12.256 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.246+0000 7fa70b7fe640 1 --2- 172.21.15.5:0/1213859651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d549b22f0 0x555d54d7f000 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc0e2f80 tx=0x7fa6fc024000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf3ed0c10cff868 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.246+0000 7fa6f1ffb640 1 -- 172.21.15.5:0/1213859651 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6fc0ea040 con 0x555d549b22f0 2024-08-31T05:33:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.246+0000 7fa70bfff640 1 --2- 172.21.15.5:0/1035449036 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa6f40b4da0 0x7fa6f40b72b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa70402aeb0 tx=0x7fa7040095c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.246+0000 7fa6f1ffb640 1 -- 172.21.15.5:0/1213859651 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6fc0abae0 con 0x555d549b22f0 2024-08-31T05:33:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.246+0000 7fa6f1ffb640 1 -- 172.21.15.5:0/1213859651 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6fc0abfd0 con 0x555d549b22f0 2024-08-31T05:33:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.247+0000 7fa71907c740 1 -- 172.21.15.5:0/1213859651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d549b22f0 msgr2=0x555d54d7f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.247+0000 7fa71907c740 1 --2- 172.21.15.5:0/1213859651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d549b22f0 0x555d54d7f000 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc0e2f80 tx=0x7fa6fc024000 comp rx=0 tx=0).stop 2024-08-31T05:33:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.247+0000 7fa71907c740 1 -- 172.21.15.5:0/1213859651 shutdown_connections 2024-08-31T05:33:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.247+0000 7fa71907c740 1 --2- 172.21.15.5:0/1213859651 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555d549ba4d0 0x555d54d7f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.247+0000 7fa71907c740 1 --2- 172.21.15.5:0/1213859651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d549b22f0 0x555d54d7f000 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.247+0000 7fa71907c740 1 --2- 172.21.15.5:0/1213859651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d549db1b0 0x555d54d7eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.247+0000 7fa71907c740 1 -- 172.21.15.5:0/1213859651 >> 172.21.15.5:0/1213859651 conn(0x555d549cf300 msgr2=0x555d54d7c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.247+0000 7fa71907c740 1 -- 172.21.15.5:0/1213859651 shutdown_connections 2024-08-31T05:33:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.247+0000 7fa71907c740 1 -- 172.21.15.5:0/1213859651 wait complete. 2024-08-31T05:33:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.248+0000 7fa71907c740 1 -- start start 2024-08-31T05:33:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.248+0000 7fa71907c740 1 Processor -- start 2024-08-31T05:33:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.248+0000 7fa71907c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d549b22f0 0x555d54d8aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.249+0000 7fa71907c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555d549ba4d0 0x555d54d8b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.249+0000 7fa71907c740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d549db1b0 0x555d54d90260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.249+0000 7fa71907c740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x555d54c1cab0 con 0x555d549db1b0 2024-08-31T05:33:12.258 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.249+0000 7fa71907c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x555d54c6a680 con 0x555d549b22f0 2024-08-31T05:33:12.259 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.249+0000 7fa71907c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555d54d84fd0 con 0x555d549ba4d0 2024-08-31T05:33:12.259 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.249+0000 7fa71907c740 10 client.0 _ll_register_callbacks cb 0x555d549f2a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:33:12.259 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.249+0000 7fa70b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d549b22f0 0x555d54d8aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:12.259 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.249+0000 7fa70affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555d549ba4d0 0x555d54d8b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:12.259 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.249+0000 7fa70b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d549b22f0 0x555d54d8aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:53932/0 (socket says 172.21.15.5:53932) 2024-08-31T05:33:12.259 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.249+0000 7fa70b7fe640 1 -- 172.21.15.5:0/343111312 learned_addr learned my addr 172.21.15.5:0/343111312 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:12.259 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.249+0000 7fa70bfff640 1 --2- 172.21.15.5:0/343111312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d549db1b0 0x555d54d90260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:12.259 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.249+0000 7fa70b7fe640 1 -- 172.21.15.5:0/343111312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555d549ba4d0 msgr2=0x555d54d8b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:12.259 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.249+0000 7fa70b7fe640 1 --2- 172.21.15.5:0/343111312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555d549ba4d0 0x555d54d8b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.259 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.249+0000 7fa70b7fe640 1 -- 172.21.15.5:0/343111312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d549db1b0 msgr2=0x555d54d90260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:12.259 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.249+0000 7fa70b7fe640 1 --2- 172.21.15.5:0/343111312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d549db1b0 0x555d54d90260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.260 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.249+0000 7fa70b7fe640 1 -- 172.21.15.5:0/343111312 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d54abf620 con 0x555d549b22f0 2024-08-31T05:33:12.260 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.249+0000 7fa70bfff640 1 --2- 172.21.15.5:0/343111312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d549db1b0 0x555d54d90260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:12.260 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.249+0000 7fa70b7fe640 1 --2- 172.21.15.5:0/343111312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d549b22f0 0x555d54d8aae0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc0e5f40 tx=0x7fa6fc018420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c58ee42b3a135090 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:12.260 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.249+0000 7fa6eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:33:12.260 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.250+0000 7fa6eaffd640 1 -- 172.21.15.5:0/343111312 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6fc0b0790 con 0x555d549b22f0 2024-08-31T05:33:12.260 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.250+0000 7fa6eaffd640 1 -- 172.21.15.5:0/343111312 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fa6fc0e3200 con 0x555d549b22f0 2024-08-31T05:33:12.260 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.250+0000 7fa71907c740 1 -- 172.21.15.5:0/343111312 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6fc0abae0 con 0x555d549b22f0 2024-08-31T05:33:12.260 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.250+0000 7fa6eaffd640 1 -- 172.21.15.5:0/343111312 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fa6fc0b5240 con 0x555d549b22f0 2024-08-31T05:33:12.260 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.250+0000 7fa71907c740 10 client.26021 fetch_fsmap learned FSMap version 32 2024-08-31T05:33:12.260 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.250+0000 7fa71907c740 1 -- 172.21.15.5:0/343111312 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x555d54d991b0 con 0x555d549b22f0 2024-08-31T05:33:12.260 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.250+0000 7fa6eaffd640 1 -- 172.21.15.5:0/343111312 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6fc0abae0 con 0x555d549b22f0 2024-08-31T05:33:12.261 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.250+0000 7fa6eaffd640 1 -- 172.21.15.5:0/343111312 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7fa6fc0b03a0 con 0x555d549b22f0 2024-08-31T05:33:12.261 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.250+0000 7fa71907c740 10 client.26021 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:33:12.261 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.250+0000 7fa71907c740 10 client.26021 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:33:12.261 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.250+0000 7fa71907c740 20 client.26021 populate_metadata read hostname 'smithi005' 2024-08-31T05:33:12.261 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.250+0000 7fa71907c740 1 --2- 172.21.15.5:0/343111312 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x555d54999d80 0x555d54d9c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:12.261 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.250+0000 7fa71907c740 4 client.26021 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:33:12.261 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.250+0000 7fa71907c740 1 -- 172.21.15.5:0/343111312 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555d54cf5f50 con 0x555d54999d80 2024-08-31T05:33:12.261 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.250+0000 7fa70affd640 1 --2- 172.21.15.5:0/343111312 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x555d54999d80 0x555d54d9c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:12.261 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.251+0000 7fa6eaffd640 10 client.26021 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:33:12.261 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.251+0000 7fa70affd640 1 --2- 172.21.15.5:0/343111312 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x555d54999d80 0x555d54d9c510 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c39ac2a83c5b95b1 server_cookie=f129aa3d082c3624 in_seq=0 out_seq=0 2024-08-31T05:33:12.261 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.252+0000 7fa6eaffd640 1 -- 172.21.15.5:0/343111312 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555d54cf5f50 con 0x555d54999d80 2024-08-31T05:33:12.262 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.252+0000 7fa6eaffd640 10 client.26021 handle_command_reply: tid=0 2024-08-31T05:33:12.262 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.252+0000 7fa71907c740 1 client.26021 shutdown 2024-08-31T05:33:12.262 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.252+0000 7fa71907c740 1 -- 172.21.15.5:0/343111312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d549b22f0 msgr2=0x555d54d8aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:12.262 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.252+0000 7fa71907c740 1 --2- 172.21.15.5:0/343111312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d549b22f0 0x555d54d8aae0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc0e5f40 tx=0x7fa6fc018420 comp rx=0 tx=0).stop 2024-08-31T05:33:12.262 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.252+0000 7fa71907c740 1 -- 172.21.15.5:0/343111312 shutdown_connections 2024-08-31T05:33:12.262 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.252+0000 7fa71907c740 1 --2- 172.21.15.5:0/343111312 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x555d54999d80 0x555d54d9c510 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.262 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.252+0000 7fa71907c740 1 --2- 172.21.15.5:0/343111312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d549db1b0 0x555d54d90260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.262 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.252+0000 7fa6eaffd640 0 client.26021 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:33:12.262 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.252+0000 7fa71907c740 1 --2- 172.21.15.5:0/343111312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555d549ba4d0 0x555d54d8b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.262 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.252+0000 7fa71907c740 1 --2- 172.21.15.5:0/343111312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d549b22f0 0x555d54d8aae0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.262 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.252+0000 7fa71907c740 1 -- 172.21.15.5:0/343111312 >> 172.21.15.5:0/343111312 conn(0x555d549cf300 msgr2=0x555d54d7ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:12.263 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.252+0000 7fa71907c740 1 -- 172.21.15.5:0/343111312 shutdown_connections 2024-08-31T05:33:12.263 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.252+0000 7fa71907c740 1 -- 172.21.15.5:0/343111312 wait complete. 2024-08-31T05:33:12.263 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.252+0000 7fa71907c740 20 client.26021 trim_cache size 0 max 16384 2024-08-31T05:33:12.271 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.267+0000 7fa71907c740 1 Processor -- start 2024-08-31T05:33:12.271 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.267+0000 7fa71907c740 1 -- start start 2024-08-31T05:33:12.271 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.267+0000 7fa71907c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d549b22f0 0x555d54d7b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:12.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.267+0000 7fa71907c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555d549ba4d0 0x555d54d8a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:12.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.267+0000 7fa71907c740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d549db1b0 0x555d54d8a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:12.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.267+0000 7fa71907c740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa70c1ae9d0 con 0x555d549db1b0 2024-08-31T05:33:12.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.267+0000 7fa71907c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa70c1b05d0 con 0x555d549b22f0 2024-08-31T05:33:12.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.267+0000 7fa71907c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa70c1af0a0 con 0x555d549ba4d0 2024-08-31T05:33:12.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.267+0000 7fa70bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d549db1b0 0x555d54d8a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:12.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.267+0000 7fa70bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d549db1b0 0x555d54d8a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50966/0 (socket says 172.21.15.5:50966) 2024-08-31T05:33:12.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.267+0000 7fa70bfff640 1 -- 172.21.15.5:0/398797606 learned_addr learned my addr 172.21.15.5:0/398797606 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:12.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.267+0000 7fa70b7fe640 1 --2- 172.21.15.5:0/398797606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d549b22f0 0x555d54d7b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:12.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.267+0000 7fa70affd640 1 --2- 172.21.15.5:0/398797606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555d549ba4d0 0x555d54d8a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:12.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.268+0000 7fa70b7fe640 1 -- 172.21.15.5:0/398797606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555d549ba4d0 msgr2=0x555d54d8a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:12.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.268+0000 7fa70b7fe640 1 --2- 172.21.15.5:0/398797606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555d549ba4d0 0x555d54d8a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.268+0000 7fa70b7fe640 1 -- 172.21.15.5:0/398797606 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d549db1b0 msgr2=0x555d54d8a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:12.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.268+0000 7fa70b7fe640 1 --2- 172.21.15.5:0/398797606 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d549db1b0 0x555d54d8a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.268+0000 7fa70b7fe640 1 -- 172.21.15.5:0/398797606 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d54d76800 con 0x555d549b22f0 2024-08-31T05:33:12.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.268+0000 7fa70bfff640 1 --2- 172.21.15.5:0/398797606 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d549db1b0 0x555d54d8a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:12.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.268+0000 7fa70b7fe640 1 --2- 172.21.15.5:0/398797606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d549b22f0 0x555d54d7b310 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc0ac230 tx=0x7fa6fc0ab800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ed999ff24b55830 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:12.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.268+0000 7fa6f17fa640 1 -- 172.21.15.5:0/398797606 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6fc0ab920 con 0x555d549b22f0 2024-08-31T05:33:12.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.268+0000 7fa6f17fa640 1 -- 172.21.15.5:0/398797606 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6fc0abae0 con 0x555d549b22f0 2024-08-31T05:33:12.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.268+0000 7fa6f17fa640 1 -- 172.21.15.5:0/398797606 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6fc0b03a0 con 0x555d549b22f0 2024-08-31T05:33:12.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.269+0000 7fa71907c740 1 -- 172.21.15.5:0/398797606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d549b22f0 msgr2=0x555d54d7b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:12.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.269+0000 7fa71907c740 1 --2- 172.21.15.5:0/398797606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d549b22f0 0x555d54d7b310 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc0ac230 tx=0x7fa6fc0ab800 comp rx=0 tx=0).stop 2024-08-31T05:33:12.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.269+0000 7fa71907c740 1 -- 172.21.15.5:0/398797606 shutdown_connections 2024-08-31T05:33:12.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.269+0000 7fa71907c740 1 --2- 172.21.15.5:0/398797606 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d549db1b0 0x555d54d8a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.269+0000 7fa71907c740 1 --2- 172.21.15.5:0/398797606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555d549ba4d0 0x555d54d8a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.269+0000 7fa71907c740 1 --2- 172.21.15.5:0/398797606 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d549b22f0 0x555d54d7b310 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.269+0000 7fa71907c740 1 -- 172.21.15.5:0/398797606 >> 172.21.15.5:0/398797606 conn(0x555d549cf300 msgr2=0x555d54d7ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:12.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.269+0000 7fa71907c740 1 -- 172.21.15.5:0/398797606 shutdown_connections 2024-08-31T05:33:12.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.269+0000 7fa71907c740 1 -- 172.21.15.5:0/398797606 wait complete. 2024-08-31T05:33:12.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.269+0000 7fa71907c740 1 -- start start 2024-08-31T05:33:12.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.270+0000 7fa71907c740 1 Processor -- start 2024-08-31T05:33:12.277 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.270+0000 7fa71907c740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d549b22f0 0x555d54d93e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:12.277 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.270+0000 7fa71907c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d549ba4d0 0x555d54d943d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:12.277 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.270+0000 7fa71907c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555d549db1b0 0x555d54e04c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:12.277 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.270+0000 7fa71907c740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa70c1afe40 con 0x555d549b22f0 2024-08-31T05:33:12.277 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.270+0000 7fa71907c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa70c1af770 con 0x555d549ba4d0 2024-08-31T05:33:12.277 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.270+0000 7fa71907c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa70c1ac9b0 con 0x555d549db1b0 2024-08-31T05:33:12.277 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.270+0000 7fa71907c740 10 client.0 _ll_register_callbacks cb 0x7fa6fc005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:33:12.277 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.270+0000 7fa70b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d549b22f0 0x555d54d93e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:12.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.270+0000 7fa70b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d549b22f0 0x555d54d93e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50982/0 (socket says 172.21.15.5:50982) 2024-08-31T05:33:12.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.270+0000 7fa70affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d549ba4d0 0x555d54d943d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:12.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.270+0000 7fa70b7fe640 1 -- 172.21.15.5:0/82905719 learned_addr learned my addr 172.21.15.5:0/82905719 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:12.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.270+0000 7fa70bfff640 1 --2- 172.21.15.5:0/82905719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555d549db1b0 0x555d54e04c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:12.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.270+0000 7fa70b7fe640 1 -- 172.21.15.5:0/82905719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555d549db1b0 msgr2=0x555d54e04c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:12.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.270+0000 7fa70b7fe640 1 --2- 172.21.15.5:0/82905719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555d549db1b0 0x555d54e04c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.270+0000 7fa70b7fe640 1 -- 172.21.15.5:0/82905719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d549ba4d0 msgr2=0x555d54d943d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:12.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.270+0000 7fa70b7fe640 1 --2- 172.21.15.5:0/82905719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d549ba4d0 0x555d54d943d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.270+0000 7fa70b7fe640 1 -- 172.21.15.5:0/82905719 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d54e05240 con 0x555d549b22f0 2024-08-31T05:33:12.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.270+0000 7fa70affd640 1 --2- 172.21.15.5:0/82905719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d549ba4d0 0x555d54d943d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:12.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.271+0000 7fa70b7fe640 1 --2- 172.21.15.5:0/82905719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d549b22f0 0x555d54d93e90 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc0b5400 tx=0x7fa6fc0e34b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30bd20eade847a39 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.271+0000 7fa6eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:33:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.271+0000 7fa6eaffd640 1 -- 172.21.15.5:0/82905719 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6fc0ab920 con 0x555d549b22f0 2024-08-31T05:33:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.271+0000 7fa6eaffd640 1 -- 172.21.15.5:0/82905719 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fa6fc0bdb50 con 0x555d549b22f0 2024-08-31T05:33:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.271+0000 7fa71907c740 1 -- 172.21.15.5:0/82905719 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6fc0abae0 con 0x555d549b22f0 2024-08-31T05:33:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.271+0000 7fa6eaffd640 1 -- 172.21.15.5:0/82905719 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fa6fc0abfd0 con 0x555d549b22f0 2024-08-31T05:33:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.271+0000 7fa71907c740 10 client.16437 fetch_fsmap learned FSMap version 32 2024-08-31T05:33:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.271+0000 7fa71907c740 1 -- 172.21.15.5:0/82905719 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x555d54e064d0 con 0x555d549b22f0 2024-08-31T05:33:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.271+0000 7fa6eaffd640 1 -- 172.21.15.5:0/82905719 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6fc0abae0 con 0x555d549b22f0 2024-08-31T05:33:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.271+0000 7fa6eaffd640 1 -- 172.21.15.5:0/82905719 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7fa6fc0ab230 con 0x555d549b22f0 2024-08-31T05:33:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.271+0000 7fa71907c740 10 client.16437 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:33:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.271+0000 7fa71907c740 10 client.16437 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:33:12.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.271+0000 7fa71907c740 20 client.16437 populate_metadata read hostname 'smithi005' 2024-08-31T05:33:12.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.271+0000 7fa71907c740 1 --2- 172.21.15.5:0/82905719 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x555d5496f1c0 0x555d54e089f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:12.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.271+0000 7fa71907c740 4 client.16437 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:33:12.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.271+0000 7fa71907c740 1 -- 172.21.15.5:0/82905719 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555d54cf19f0 con 0x555d5496f1c0 2024-08-31T05:33:12.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.272+0000 7fa70affd640 1 --2- 172.21.15.5:0/82905719 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x555d5496f1c0 0x555d54e089f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:12.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.272+0000 7fa70affd640 1 --2- 172.21.15.5:0/82905719 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x555d5496f1c0 0x555d54e089f0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=855511a912a4b5c server_cookie=4678cf49b0ffd6a1 in_seq=0 out_seq=0 2024-08-31T05:33:12.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.272+0000 7fa6eaffd640 10 client.16437 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:33:12.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.281+0000 7fa6eaffd640 1 -- 172.21.15.5:0/82905719 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555d54cf19f0 con 0x555d5496f1c0 2024-08-31T05:33:12.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.281+0000 7fa6eaffd640 10 client.16437 handle_command_reply: tid=0 2024-08-31T05:33:12.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.281+0000 7fa71907c740 1 client.16437 shutdown 2024-08-31T05:33:12.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.282+0000 7fa71907c740 1 -- 172.21.15.5:0/82905719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d549b22f0 msgr2=0x555d54d93e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:12.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.282+0000 7fa71907c740 1 --2- 172.21.15.5:0/82905719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d549b22f0 0x555d54d93e90 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc0b5400 tx=0x7fa6fc0e34b0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.282+0000 7fa71907c740 1 -- 172.21.15.5:0/82905719 shutdown_connections 2024-08-31T05:33:12.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.282+0000 7fa71907c740 1 --2- 172.21.15.5:0/82905719 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x555d5496f1c0 0x555d54e089f0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.282+0000 7fa71907c740 1 --2- 172.21.15.5:0/82905719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555d549db1b0 0x555d54e04c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.282+0000 7fa71907c740 1 --2- 172.21.15.5:0/82905719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555d549ba4d0 0x555d54d943d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.282+0000 7fa6eaffd640 0 client.16437 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:33:12.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.282+0000 7fa71907c740 1 --2- 172.21.15.5:0/82905719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555d549b22f0 0x555d54d93e90 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.282+0000 7fa71907c740 1 -- 172.21.15.5:0/82905719 >> 172.21.15.5:0/82905719 conn(0x555d549cf300 msgr2=0x555d54d8efc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:12.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.282+0000 7fa71907c740 1 -- 172.21.15.5:0/82905719 shutdown_connections 2024-08-31T05:33:12.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.282+0000 7fa71907c740 1 -- 172.21.15.5:0/82905719 wait complete. 2024-08-31T05:33:12.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.282+0000 7fa71907c740 20 client.16437 trim_cache size 0 max 16384 2024-08-31T05:33:12.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:33:12.286 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:33:12.286 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:33:12.286 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:33:12.286 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.282+0000 7fa71202f640 1 -- 172.21.15.5:0/1035449036 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa6f40b4da0 msgr2=0x7fa6f40b72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:12.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.282+0000 7fa71202f640 1 --2- 172.21.15.5:0/1035449036 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa6f40b4da0 0x7fa6f40b72b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa70402aeb0 tx=0x7fa7040095c0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.282+0000 7fa71202f640 1 -- 172.21.15.5:0/1035449036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa70c102760 msgr2=0x7fa70c199080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:12.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.282+0000 7fa71202f640 1 --2- 172.21.15.5:0/1035449036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa70c102760 0x7fa70c199080 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc00e9f0 tx=0x7fa6fc00eeb0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.283+0000 7fa71202f640 1 -- 172.21.15.5:0/1035449036 shutdown_connections 2024-08-31T05:33:12.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.283+0000 7fa71202f640 1 --2- 172.21.15.5:0/1035449036 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa6f40b4da0 0x7fa6f40b72b0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.283+0000 7fa71202f640 1 --2- 172.21.15.5:0/1035449036 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa70c1089e0 0x7fa70c19e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.283+0000 7fa71202f640 1 --2- 172.21.15.5:0/1035449036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa70c108090 0x7fa70c199620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.283+0000 7fa71202f640 1 --2- 172.21.15.5:0/1035449036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa70c102760 0x7fa70c199080 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.283+0000 7fa71202f640 1 -- 172.21.15.5:0/1035449036 >> 172.21.15.5:0/1035449036 conn(0x7fa70c0fe160 msgr2=0x7fa70c106630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:12.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.283+0000 7fa71202f640 1 -- 172.21.15.5:0/1035449036 shutdown_connections 2024-08-31T05:33:12.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:12.283+0000 7fa71202f640 1 -- 172.21.15.5:0/1035449036 wait complete. 2024-08-31T05:33:12.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.735+0000 7f94eda80640 1 -- 172.21.15.5:0/619242334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94e8104750 msgr2=0x7f94e8104b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:12.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.735+0000 7f94eda80640 1 --2- 172.21.15.5:0/619242334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94e8104750 0x7f94e8104b60 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f94d8009900 tx=0x7f94d802a410 comp rx=0 tx=0).stop 2024-08-31T05:33:12.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.735+0000 7f94eda80640 1 -- 172.21.15.5:0/619242334 shutdown_connections 2024-08-31T05:33:12.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.735+0000 7f94eda80640 1 --2- 172.21.15.5:0/619242334 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94e810dbb0 0x7f94e81100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.735+0000 7f94eda80640 1 --2- 172.21.15.5:0/619242334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94e81050a0 0x7f94e810d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.735+0000 7f94eda80640 1 --2- 172.21.15.5:0/619242334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94e8104750 0x7f94e8104b60 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.735+0000 7f94eda80640 1 -- 172.21.15.5:0/619242334 >> 172.21.15.5:0/619242334 conn(0x7f94e80794d0 msgr2=0x7f94e80798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:12.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.735+0000 7f94eda80640 1 -- 172.21.15.5:0/619242334 shutdown_connections 2024-08-31T05:33:12.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.735+0000 7f94eda80640 1 -- 172.21.15.5:0/619242334 wait complete. 2024-08-31T05:33:12.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.736+0000 7f94eda80640 1 Processor -- start 2024-08-31T05:33:12.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.736+0000 7f94eda80640 1 -- start start 2024-08-31T05:33:12.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.737+0000 7f94eda80640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94e8104750 0x7f94e819a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:12.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.737+0000 7f94eda80640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94e81050a0 0x7f94e819a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:12.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.737+0000 7f94eda80640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94e810dbb0 0x7f94e819fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:12.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.737+0000 7f94eda80640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f94e8113830 con 0x7f94e810dbb0 2024-08-31T05:33:12.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.737+0000 7f94eda80640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f94e81136b0 con 0x7f94e81050a0 2024-08-31T05:33:12.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.737+0000 7f94eda80640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f94e81139b0 con 0x7f94e8104750 2024-08-31T05:33:12.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.737+0000 7f94e7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94e810dbb0 0x7f94e819fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:12.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.737+0000 7f94e7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94e810dbb0 0x7f94e819fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51000/0 (socket says 172.21.15.5:51000) 2024-08-31T05:33:12.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.737+0000 7f94e7fff640 1 -- 172.21.15.5:0/1166661425 learned_addr learned my addr 172.21.15.5:0/1166661425 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:12.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.737+0000 7f94e77fe640 1 --2- 172.21.15.5:0/1166661425 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94e8104750 0x7f94e819a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:12.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.737+0000 7f94e6ffd640 1 --2- 172.21.15.5:0/1166661425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94e81050a0 0x7f94e819a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:12.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.737+0000 7f94e7fff640 1 -- 172.21.15.5:0/1166661425 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94e8104750 msgr2=0x7f94e819a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:12.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.737+0000 7f94e7fff640 1 --2- 172.21.15.5:0/1166661425 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94e8104750 0x7f94e819a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.737+0000 7f94e7fff640 1 -- 172.21.15.5:0/1166661425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94e81050a0 msgr2=0x7f94e819a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:12.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.737+0000 7f94e7fff640 1 --2- 172.21.15.5:0/1166661425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94e81050a0 0x7f94e819a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.737+0000 7f94e7fff640 1 -- 172.21.15.5:0/1166661425 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94e81a02d0 con 0x7f94e810dbb0 2024-08-31T05:33:12.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.737+0000 7f94e77fe640 1 --2- 172.21.15.5:0/1166661425 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94e8104750 0x7f94e819a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:12.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.737+0000 7f94e7fff640 1 --2- 172.21.15.5:0/1166661425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94e810dbb0 0x7f94e819fba0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f94e000eb10 tx=0x7f94e000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:12.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.738+0000 7f94e4ff9640 1 -- 172.21.15.5:0/1166661425 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e0004b20 con 0x7f94e810dbb0 2024-08-31T05:33:12.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.738+0000 7f94eda80640 1 -- 172.21.15.5:0/1166661425 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94e81a05c0 con 0x7f94e810dbb0 2024-08-31T05:33:12.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.738+0000 7f94e4ff9640 1 -- 172.21.15.5:0/1166661425 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94e0004cc0 con 0x7f94e810dbb0 2024-08-31T05:33:12.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.738+0000 7f94e4ff9640 1 -- 172.21.15.5:0/1166661425 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e0010690 con 0x7f94e810dbb0 2024-08-31T05:33:12.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.738+0000 7f94eda80640 1 -- 172.21.15.5:0/1166661425 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94e81a6d20 con 0x7f94e810dbb0 2024-08-31T05:33:12.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.740+0000 7f94f3ff5740 1 Processor -- start 2024-08-31T05:33:12.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.740+0000 7f94e4ff9640 1 -- 172.21.15.5:0/1166661425 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f94e0005020 con 0x7f94e810dbb0 2024-08-31T05:33:12.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.740+0000 7f94f3ff5740 1 -- start start 2024-08-31T05:33:12.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.741+0000 7f94f3ff5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db27e42070 0x55db281e7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:12.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.741+0000 7f94f3ff5740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db27e191b0 0x55db281e7890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:12.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.741+0000 7f94f3ff5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db27e21390 0x55db281e7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:12.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.741+0000 7f94f3ff5740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55db2815e680 con 0x55db27e191b0 2024-08-31T05:33:12.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.741+0000 7f94f3ff5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55db2814dc10 con 0x55db27e21390 2024-08-31T05:33:12.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.741+0000 7f94f3ff5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55db28151bc0 con 0x55db27e42070 2024-08-31T05:33:12.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.741+0000 7f94e6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db27e42070 0x55db281e7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:12.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.741+0000 7f94e77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db27e191b0 0x55db281e7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:12.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.741+0000 7f94e6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db27e42070 0x55db281e7350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:36154/0 (socket says 172.21.15.5:36154) 2024-08-31T05:33:12.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.741+0000 7f94e6ffd640 1 -- 172.21.15.5:0/1516623765 learned_addr learned my addr 172.21.15.5:0/1516623765 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:12.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.741+0000 7f94e77fe640 1 --2- 172.21.15.5:0/1516623765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db27e191b0 0x55db281e7890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51008/0 (socket says 172.21.15.5:51008) 2024-08-31T05:33:12.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.741+0000 7f94e6ffd640 1 --2- 172.21.15.5:0/1516623765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db27e21390 0x55db281e7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:12.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.741+0000 7f94e4ff9640 1 --2- 172.21.15.5:0/1166661425 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f94d00b4ca0 0x7f94d00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:12.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.741+0000 7f94e6ffd640 1 -- 172.21.15.5:0/1516623765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db27e21390 msgr2=0x55db281e7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:12.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.741+0000 7f94e6ffd640 1 --2- 172.21.15.5:0/1516623765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db27e21390 0x55db281e7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.741+0000 7f94e6ffd640 1 -- 172.21.15.5:0/1516623765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db27e191b0 msgr2=0x55db281e7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:12.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.741+0000 7f94e6ffd640 1 --2- 172.21.15.5:0/1516623765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db27e191b0 0x55db281e7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.741+0000 7f94e6ffd640 1 -- 172.21.15.5:0/1516623765 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db27ead650 con 0x55db27e42070 2024-08-31T05:33:12.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.741+0000 7f94e7fff640 1 --2- 172.21.15.5:0/1166661425 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f94d00b4ca0 0x7f94d00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:12.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.742+0000 7f94e6ffd640 1 --2- 172.21.15.5:0/1516623765 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db27e42070 0x55db281e7350 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f94dc0116b0 tx=0x7f94dc00a640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b53a404431bc6863 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:12.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.742+0000 7f94e4ff9640 1 -- 172.21.15.5:0/1166661425 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f94e00e5db0 con 0x7f94e810dbb0 2024-08-31T05:33:12.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.742+0000 7f94cdffb640 1 -- 172.21.15.5:0/1516623765 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94dc004020 con 0x55db27e42070 2024-08-31T05:33:12.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.742+0000 7f94cdffb640 1 -- 172.21.15.5:0/1516623765 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94dc0054d0 con 0x55db27e42070 2024-08-31T05:33:12.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.742+0000 7f94cdffb640 1 -- 172.21.15.5:0/1516623765 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94dc004d00 con 0x55db27e42070 2024-08-31T05:33:12.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.743+0000 7f94f3ff5740 1 -- 172.21.15.5:0/1516623765 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db27e42070 msgr2=0x55db281e7350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:12.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.743+0000 7f94e7fff640 1 --2- 172.21.15.5:0/1166661425 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f94d00b4ca0 0x7f94d00b71b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f94e00e3780 tx=0x7f94e0078320 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:12.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.743+0000 7f94f3ff5740 1 --2- 172.21.15.5:0/1516623765 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db27e42070 0x55db281e7350 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f94dc0116b0 tx=0x7f94dc00a640 comp rx=0 tx=0).stop 2024-08-31T05:33:12.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.743+0000 7f94f3ff5740 1 -- 172.21.15.5:0/1516623765 shutdown_connections 2024-08-31T05:33:12.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.743+0000 7f94f3ff5740 1 --2- 172.21.15.5:0/1516623765 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db27e21390 0x55db281e7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.743+0000 7f94f3ff5740 1 --2- 172.21.15.5:0/1516623765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db27e191b0 0x55db281e7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.743+0000 7f94f3ff5740 1 --2- 172.21.15.5:0/1516623765 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db27e42070 0x55db281e7350 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.743+0000 7f94f3ff5740 1 -- 172.21.15.5:0/1516623765 >> 172.21.15.5:0/1516623765 conn(0x55db27e36460 msgr2=0x55db281e5240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:12.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.743+0000 7f94f3ff5740 1 -- 172.21.15.5:0/1516623765 shutdown_connections 2024-08-31T05:33:12.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.743+0000 7f94f3ff5740 1 -- 172.21.15.5:0/1516623765 wait complete. 2024-08-31T05:33:12.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.743+0000 7f94f3ff5740 1 -- start start 2024-08-31T05:33:12.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.743+0000 7f94f3ff5740 1 Processor -- start 2024-08-31T05:33:12.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.744+0000 7f94f3ff5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db27e191b0 0x55db281f6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:12.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.744+0000 7f94f3ff5740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db27e21390 0x55db281f7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:12.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.744+0000 7f94f3ff5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db27e42070 0x55db28203160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:12.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.744+0000 7f94f3ff5740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55db27fb0700 con 0x55db27e21390 2024-08-31T05:33:12.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.744+0000 7f94f3ff5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55db280d4750 con 0x55db27e42070 2024-08-31T05:33:12.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.744+0000 7f94f3ff5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55db281f9e30 con 0x55db27e191b0 2024-08-31T05:33:12.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.744+0000 7f94f3ff5740 10 client.0 _ll_register_callbacks cb 0x55db28103e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:33:12.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.744+0000 7f94e77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db27e21390 0x55db281f7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:12.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.744+0000 7f94e6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db27e191b0 0x55db281f6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:12.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.744+0000 7f94e77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db27e21390 0x55db281f7430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51012/0 (socket says 172.21.15.5:51012) 2024-08-31T05:33:12.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.744+0000 7f94e6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db27e191b0 0x55db281f6ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:36168/0 (socket says 172.21.15.5:36168) 2024-08-31T05:33:12.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.744+0000 7f94e77fe640 1 -- 172.21.15.5:0/2245014062 learned_addr learned my addr 172.21.15.5:0/2245014062 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:12.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.744+0000 7f94e6ffd640 1 --2- 172.21.15.5:0/2245014062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db27e42070 0x55db28203160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:12.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.744+0000 7f94e77fe640 1 -- 172.21.15.5:0/2245014062 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db27e191b0 msgr2=0x55db281f6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:12.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.744+0000 7f94e77fe640 1 --2- 172.21.15.5:0/2245014062 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db27e191b0 0x55db281f6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.744+0000 7f94e77fe640 1 -- 172.21.15.5:0/2245014062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db27e42070 msgr2=0x55db28203160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:12.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.744+0000 7f94e77fe640 1 --2- 172.21.15.5:0/2245014062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db27e42070 0x55db28203160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.744+0000 7f94e77fe640 1 -- 172.21.15.5:0/2245014062 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db2810d900 con 0x55db27e21390 2024-08-31T05:33:12.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.744+0000 7f94e6ffd640 1 --2- 172.21.15.5:0/2245014062 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db27e191b0 0x55db281f6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:12.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.745+0000 7f94e77fe640 1 --2- 172.21.15.5:0/2245014062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db27e21390 0x55db281f7430 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f94d8009900 tx=0x7f94d8031950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f557c588d5780266 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:12.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.745+0000 7f94c6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:33:12.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.745+0000 7f94c6ffd640 1 -- 172.21.15.5:0/2245014062 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d8035040 con 0x55db27e21390 2024-08-31T05:33:12.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.745+0000 7f94f3ff5740 1 -- 172.21.15.5:0/2245014062 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94dc0054d0 con 0x55db27e21390 2024-08-31T05:33:12.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.745+0000 7f94c6ffd640 1 -- 172.21.15.5:0/2245014062 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f94d8004240 con 0x55db27e21390 2024-08-31T05:33:12.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.745+0000 7f94c6ffd640 1 -- 172.21.15.5:0/2245014062 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f94d804f050 con 0x55db27e21390 2024-08-31T05:33:12.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.745+0000 7f94f3ff5740 10 client.16449 fetch_fsmap learned FSMap version 32 2024-08-31T05:33:12.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.745+0000 7f94f3ff5740 1 -- 172.21.15.5:0/2245014062 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55db28205c20 con 0x55db27e21390 2024-08-31T05:33:12.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.745+0000 7f94c6ffd640 1 -- 172.21.15.5:0/2245014062 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94dc0054d0 con 0x55db27e21390 2024-08-31T05:33:12.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.746+0000 7f94c6ffd640 1 -- 172.21.15.5:0/2245014062 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f94d8004aa0 con 0x55db27e21390 2024-08-31T05:33:12.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.746+0000 7f94f3ff5740 10 client.16449 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:33:12.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.746+0000 7f94f3ff5740 10 client.16449 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-31T05:33:12.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.746+0000 7f94f3ff5740 20 client.16449 populate_metadata read hostname 'smithi005' 2024-08-31T05:33:12.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.746+0000 7f94f3ff5740 1 --2- 172.21.15.5:0/2245014062 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55db27e009f0 0x55db28209140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:12.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.746+0000 7f94f3ff5740 4 client.16449 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:33:12.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.746+0000 7f94f3ff5740 1 -- 172.21.15.5:0/2245014062 --> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55db281605d0 con 0x55db27e009f0 2024-08-31T05:33:12.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.746+0000 7f94e6ffd640 1 --2- 172.21.15.5:0/2245014062 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55db27e009f0 0x55db28209140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:12.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.746+0000 7f94e6ffd640 1 --2- 172.21.15.5:0/2245014062 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55db27e009f0 0x55db28209140 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=faf9152401d55bfa server_cookie=11bf29f3f3ba5063 in_seq=0 out_seq=0 2024-08-31T05:33:12.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.746+0000 7f94c6ffd640 10 client.16449 ms_handle_connect on v2:172.21.15.50:6838/98200944 2024-08-31T05:33:12.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.747+0000 7f94c6ffd640 1 -- 172.21.15.5:0/2245014062 <== mds.1 v2:172.21.15.50:6838/98200944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55db281605d0 con 0x55db27e009f0 2024-08-31T05:33:12.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.747+0000 7f94c6ffd640 10 client.16449 handle_command_reply: tid=0 2024-08-31T05:33:12.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.747+0000 7f94f3ff5740 1 client.16449 shutdown 2024-08-31T05:33:12.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.747+0000 7f94f3ff5740 1 -- 172.21.15.5:0/2245014062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db27e21390 msgr2=0x55db281f7430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:12.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.747+0000 7f94f3ff5740 1 --2- 172.21.15.5:0/2245014062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db27e21390 0x55db281f7430 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f94d8009900 tx=0x7f94d8031950 comp rx=0 tx=0).stop 2024-08-31T05:33:12.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.747+0000 7f94f3ff5740 1 -- 172.21.15.5:0/2245014062 shutdown_connections 2024-08-31T05:33:12.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.747+0000 7f94f3ff5740 1 --2- 172.21.15.5:0/2245014062 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55db27e009f0 0x55db28209140 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.747+0000 7f94f3ff5740 1 --2- 172.21.15.5:0/2245014062 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db27e42070 0x55db28203160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.747+0000 7f94f3ff5740 1 --2- 172.21.15.5:0/2245014062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db27e21390 0x55db281f7430 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.747+0000 7f94c6ffd640 0 client.16449 ms_handle_reset on v2:172.21.15.50:6838/98200944 2024-08-31T05:33:12.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.747+0000 7f94f3ff5740 1 --2- 172.21.15.5:0/2245014062 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db27e191b0 0x55db281f6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.748+0000 7f94f3ff5740 1 -- 172.21.15.5:0/2245014062 >> 172.21.15.5:0/2245014062 conn(0x55db27e36460 msgr2=0x55db281e8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:12.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.748+0000 7f94f3ff5740 1 -- 172.21.15.5:0/2245014062 shutdown_connections 2024-08-31T05:33:12.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.748+0000 7f94f3ff5740 1 -- 172.21.15.5:0/2245014062 wait complete. 2024-08-31T05:33:12.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.748+0000 7f94f3ff5740 20 client.16449 trim_cache size 0 max 16384 2024-08-31T05:33:12.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.762+0000 7f94f3ff5740 1 Processor -- start 2024-08-31T05:33:12.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.762+0000 7f94f3ff5740 1 -- start start 2024-08-31T05:33:12.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.762+0000 7f94f3ff5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db27e191b0 0x55db28203060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:12.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.762+0000 7f94f3ff5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db27e21390 0x55db281f6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:12.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.762+0000 7f94f3ff5740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db27e42070 0x55db281f71e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:12.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.762+0000 7f94f3ff5740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f94e81aea70 con 0x55db27e42070 2024-08-31T05:33:12.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.762+0000 7f94f3ff5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f94e81b0670 con 0x55db27e191b0 2024-08-31T05:33:12.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.762+0000 7f94f3ff5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f94e81af140 con 0x55db27e21390 2024-08-31T05:33:12.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.762+0000 7f94e6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db27e42070 0x55db281f71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:12.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.762+0000 7f94e6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db27e42070 0x55db281f71e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51014/0 (socket says 172.21.15.5:51014) 2024-08-31T05:33:12.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.762+0000 7f94e6ffd640 1 -- 172.21.15.5:0/774496521 learned_addr learned my addr 172.21.15.5:0/774496521 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:12.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.762+0000 7f94e77fe640 1 --2- 172.21.15.5:0/774496521 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db27e21390 0x55db281f6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:12.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.762+0000 7f94e6ffd640 1 --2- 172.21.15.5:0/774496521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db27e191b0 0x55db28203060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:12.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.762+0000 7f94e6ffd640 1 -- 172.21.15.5:0/774496521 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db27e21390 msgr2=0x55db281f6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:12.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.762+0000 7f94e6ffd640 1 --2- 172.21.15.5:0/774496521 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db27e21390 0x55db281f6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.762+0000 7f94e6ffd640 1 -- 172.21.15.5:0/774496521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db27e191b0 msgr2=0x55db28203060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:12.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.762+0000 7f94e6ffd640 1 --2- 172.21.15.5:0/774496521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db27e191b0 0x55db28203060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.762+0000 7f94e6ffd640 1 -- 172.21.15.5:0/774496521 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db281f53f0 con 0x55db27e42070 2024-08-31T05:33:12.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.763+0000 7f94e6ffd640 1 --2- 172.21.15.5:0/774496521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db27e42070 0x55db281f71e0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x55db281ea2f0 tx=0x7f94dc020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bf3d41bda070903 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:12.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.763+0000 7f94cd7fa640 1 -- 172.21.15.5:0/774496521 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94dc004fe0 con 0x55db27e42070 2024-08-31T05:33:12.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.763+0000 7f94cd7fa640 1 -- 172.21.15.5:0/774496521 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94dc005630 con 0x55db27e42070 2024-08-31T05:33:12.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.763+0000 7f94cd7fa640 1 -- 172.21.15.5:0/774496521 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94dc01e470 con 0x55db27e42070 2024-08-31T05:33:12.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.764+0000 7f94f3ff5740 1 -- 172.21.15.5:0/774496521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db27e42070 msgr2=0x55db281f71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:12.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.764+0000 7f94f3ff5740 1 --2- 172.21.15.5:0/774496521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db27e42070 0x55db281f71e0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x55db281ea2f0 tx=0x7f94dc020040 comp rx=0 tx=0).stop 2024-08-31T05:33:12.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.764+0000 7f94f3ff5740 1 -- 172.21.15.5:0/774496521 shutdown_connections 2024-08-31T05:33:12.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.764+0000 7f94f3ff5740 1 --2- 172.21.15.5:0/774496521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db27e42070 0x55db281f71e0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.764+0000 7f94f3ff5740 1 --2- 172.21.15.5:0/774496521 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db27e21390 0x55db281f6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.764+0000 7f94f3ff5740 1 --2- 172.21.15.5:0/774496521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db27e191b0 0x55db28203060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.764+0000 7f94f3ff5740 1 -- 172.21.15.5:0/774496521 >> 172.21.15.5:0/774496521 conn(0x55db27e36460 msgr2=0x55db281f5770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:12.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.764+0000 7f94f3ff5740 1 -- 172.21.15.5:0/774496521 shutdown_connections 2024-08-31T05:33:12.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.764+0000 7f94f3ff5740 1 -- 172.21.15.5:0/774496521 wait complete. 2024-08-31T05:33:12.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.764+0000 7f94f3ff5740 1 -- start start 2024-08-31T05:33:12.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.765+0000 7f94f3ff5740 1 Processor -- start 2024-08-31T05:33:12.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.765+0000 7f94f3ff5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db27e191b0 0x55db281fb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:12.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.765+0000 7f94f3ff5740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db27e21390 0x55db281fb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:12.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.765+0000 7f94f3ff5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db27e42070 0x55db281fbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:12.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.765+0000 7f94f3ff5740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f94e81afee0 con 0x55db27e21390 2024-08-31T05:33:12.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.765+0000 7f94f3ff5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f94e81af810 con 0x55db27e42070 2024-08-31T05:33:12.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.765+0000 7f94f3ff5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f94e81aca50 con 0x55db27e191b0 2024-08-31T05:33:12.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.765+0000 7f94f3ff5740 10 client.0 _ll_register_callbacks cb 0x7f94d8009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:33:12.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.765+0000 7f94e77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db27e21390 0x55db281fb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:12.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.765+0000 7f94e77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db27e21390 0x55db281fb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51020/0 (socket says 172.21.15.5:51020) 2024-08-31T05:33:12.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.765+0000 7f94e77fe640 1 -- 172.21.15.5:0/3818068472 learned_addr learned my addr 172.21.15.5:0/3818068472 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:12.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.765+0000 7f94e6ffd640 1 --2- 172.21.15.5:0/3818068472 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db27e191b0 0x55db281fb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:12.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.765+0000 7f94e6ffd640 1 --2- 172.21.15.5:0/3818068472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db27e42070 0x55db281fbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:12.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.765+0000 7f94e77fe640 1 -- 172.21.15.5:0/3818068472 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db27e191b0 msgr2=0x55db281fb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:12.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.765+0000 7f94e77fe640 1 --2- 172.21.15.5:0/3818068472 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db27e191b0 0x55db281fb230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.765+0000 7f94e77fe640 1 -- 172.21.15.5:0/3818068472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db27e42070 msgr2=0x55db281fbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:12.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.765+0000 7f94e77fe640 1 --2- 172.21.15.5:0/3818068472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db27e42070 0x55db281fbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.765+0000 7f94e77fe640 1 -- 172.21.15.5:0/3818068472 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db28272ca0 con 0x55db27e21390 2024-08-31T05:33:12.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.765+0000 7f94e6ffd640 1 --2- 172.21.15.5:0/3818068472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db27e42070 0x55db281fbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:33:12.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.765+0000 7f94e77fe640 1 --2- 172.21.15.5:0/3818068472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db27e21390 0x55db281fb770 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f94d802a930 tx=0x7f94d80319c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f2a75bf3c87697a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:12.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.765+0000 7f94c6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:33:12.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.766+0000 7f94c6ffd640 1 -- 172.21.15.5:0/3818068472 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d8057020 con 0x55db27e21390 2024-08-31T05:33:12.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.766+0000 7f94c6ffd640 1 -- 172.21.15.5:0/3818068472 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f94d8004770 con 0x55db27e21390 2024-08-31T05:33:12.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.766+0000 7f94f3ff5740 1 -- 172.21.15.5:0/3818068472 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55db2815c070 con 0x55db27e21390 2024-08-31T05:33:12.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.766+0000 7f94c6ffd640 1 -- 172.21.15.5:0/3818068472 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f94d8035070 con 0x55db27e21390 2024-08-31T05:33:12.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.766+0000 7f94f3ff5740 10 client.16455 fetch_fsmap learned FSMap version 32 2024-08-31T05:33:12.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.766+0000 7f94f3ff5740 1 -- 172.21.15.5:0/3818068472 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55db28273f00 con 0x55db27e21390 2024-08-31T05:33:12.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.766+0000 7f94c6ffd640 1 -- 172.21.15.5:0/3818068472 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55db2815c070 con 0x55db27e21390 2024-08-31T05:33:12.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.766+0000 7f94c6ffd640 1 -- 172.21.15.5:0/3818068472 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f94d80051e0 con 0x55db27e21390 2024-08-31T05:33:12.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.766+0000 7f94f3ff5740 10 client.16455 fetch_fsmap finished waiting for FSMap version 32 2024-08-31T05:33:12.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.766+0000 7f94f3ff5740 10 client.16455 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-31T05:33:12.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.766+0000 7f94f3ff5740 20 client.16455 populate_metadata read hostname 'smithi005' 2024-08-31T05:33:12.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.766+0000 7f94f3ff5740 1 --2- 172.21.15.5:0/3818068472 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55db27dd5da0 0x55db282765f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:12.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.766+0000 7f94f3ff5740 4 client.16455 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:33:12.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.766+0000 7f94f3ff5740 1 -- 172.21.15.5:0/3818068472 --> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55db281597b0 con 0x55db27dd5da0 2024-08-31T05:33:12.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.766+0000 7f94e6ffd640 1 --2- 172.21.15.5:0/3818068472 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55db27dd5da0 0x55db282765f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:12.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.767+0000 7f94c6ffd640 10 client.16455 ms_handle_connect on v2:172.21.15.50:6838/98200944 2024-08-31T05:33:12.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.767+0000 7f94e6ffd640 1 --2- 172.21.15.5:0/3818068472 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55db27dd5da0 0x55db282765f0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=df5866f2cc3f90e server_cookie=b66b2cf793006e59 in_seq=0 out_seq=0 2024-08-31T05:33:12.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.767+0000 7f94c6ffd640 1 -- 172.21.15.5:0/3818068472 <== mds.1 v2:172.21.15.50:6838/98200944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55db281597b0 con 0x55db27dd5da0 2024-08-31T05:33:12.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.767+0000 7f94c6ffd640 10 client.16455 handle_command_reply: tid=0 2024-08-31T05:33:12.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.767+0000 7f94f3ff5740 1 client.16455 shutdown 2024-08-31T05:33:12.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.767+0000 7f94f3ff5740 1 -- 172.21.15.5:0/3818068472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db27e21390 msgr2=0x55db281fb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:12.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.767+0000 7f94f3ff5740 1 --2- 172.21.15.5:0/3818068472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db27e21390 0x55db281fb770 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f94d802a930 tx=0x7f94d80319c0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.791 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:33:12.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.767+0000 7f94f3ff5740 1 -- 172.21.15.5:0/3818068472 shutdown_connections 2024-08-31T05:33:12.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.767+0000 7f94f3ff5740 1 --2- 172.21.15.5:0/3818068472 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55db27dd5da0 0x55db282765f0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.767+0000 7f94f3ff5740 1 --2- 172.21.15.5:0/3818068472 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55db27e42070 0x55db281fbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.767+0000 7f94f3ff5740 1 --2- 172.21.15.5:0/3818068472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55db27e21390 0x55db281fb770 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.767+0000 7f94f3ff5740 1 --2- 172.21.15.5:0/3818068472 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55db27e191b0 0x55db281fb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.767+0000 7f94f3ff5740 1 -- 172.21.15.5:0/3818068472 >> 172.21.15.5:0/3818068472 conn(0x55db27e36460 msgr2=0x55db281f5600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:12.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.767+0000 7f94c6ffd640 0 client.16455 ms_handle_reset on v2:172.21.15.50:6838/98200944 2024-08-31T05:33:12.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.767+0000 7f94f3ff5740 1 -- 172.21.15.5:0/3818068472 shutdown_connections 2024-08-31T05:33:12.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.767+0000 7f94f3ff5740 1 -- 172.21.15.5:0/3818068472 wait complete. 2024-08-31T05:33:12.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.767+0000 7f94f3ff5740 20 client.16455 trim_cache size 0 max 16384 2024-08-31T05:33:12.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.768+0000 7f94eda80640 1 -- 172.21.15.5:0/1166661425 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f94d00b4ca0 msgr2=0x7f94d00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:12.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.768+0000 7f94eda80640 1 --2- 172.21.15.5:0/1166661425 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f94d00b4ca0 0x7f94d00b71b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f94e00e3780 tx=0x7f94e0078320 comp rx=0 tx=0).stop 2024-08-31T05:33:12.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.768+0000 7f94eda80640 1 -- 172.21.15.5:0/1166661425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94e810dbb0 msgr2=0x7f94e819fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:12.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.768+0000 7f94eda80640 1 --2- 172.21.15.5:0/1166661425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94e810dbb0 0x7f94e819fba0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f94e000eb10 tx=0x7f94e000c2d0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.768+0000 7f94eda80640 1 -- 172.21.15.5:0/1166661425 shutdown_connections 2024-08-31T05:33:12.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.768+0000 7f94eda80640 1 --2- 172.21.15.5:0/1166661425 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f94d00b4ca0 0x7f94d00b71b0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.768+0000 7f94eda80640 1 --2- 172.21.15.5:0/1166661425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94e810dbb0 0x7f94e819fba0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.768+0000 7f94eda80640 1 --2- 172.21.15.5:0/1166661425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f94e81050a0 0x7f94e819a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.768+0000 7f94eda80640 1 --2- 172.21.15.5:0/1166661425 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94e8104750 0x7f94e819a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:12.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.768+0000 7f94eda80640 1 -- 172.21.15.5:0/1166661425 >> 172.21.15.5:0/1166661425 conn(0x7f94e80794d0 msgr2=0x7f94e80ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:12.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.768+0000 7f94eda80640 1 -- 172.21.15.5:0/1166661425 shutdown_connections 2024-08-31T05:33:12.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:12.768+0000 7f94eda80640 1 -- 172.21.15.5:0/1166661425 wait complete. 2024-08-31T05:33:13.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:33:13 smithi070 ceph-mon[22316]: pgmap v442: 129 pgs: 129 active+clean; 151 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.4 MiB/s wr, 280 op/s 2024-08-31T05:33:13.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:33:13 smithi050 ceph-mon[22146]: pgmap v442: 129 pgs: 129 active+clean; 151 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.4 MiB/s wr, 280 op/s 2024-08-31T05:33:13.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:33:13 smithi005 ceph-mon[18602]: pgmap v442: 129 pgs: 129 active+clean; 151 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.4 MiB/s wr, 280 op/s 2024-08-31T05:33:13.839 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T05:33:13.912 INFO:tasks.workunit.client.0.smithi005.stdout: 1 305892 14.23 MB/sec execute 1 sec latency 40.434 ms 2024-08-31T05:33:14.176 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:33:14.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:33:14 smithi070 ceph-mon[22316]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T05:33:14.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:33:14 smithi050 ceph-mon[22146]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T05:33:14.686 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:33:14 smithi005 ceph-mon[18602]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T05:33:14.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.780+0000 7f1870d7f640 1 -- 172.21.15.5:0/2973512017 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f186c10dc00 msgr2=0x7f186c1100d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:14.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.780+0000 7f1870d7f640 1 --2- 172.21.15.5:0/2973512017 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f186c10dc00 0x7f186c1100d0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f1864009ca0 tx=0x7f186402a8c0 comp rx=0 tx=0).stop 2024-08-31T05:33:14.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.780+0000 7f1870d7f640 1 -- 172.21.15.5:0/2973512017 shutdown_connections 2024-08-31T05:33:14.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.780+0000 7f1870d7f640 1 --2- 172.21.15.5:0/2973512017 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f186c10dc00 0x7f186c1100d0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:14.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.780+0000 7f1870d7f640 1 --2- 172.21.15.5:0/2973512017 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f186c105120 0x7f186c10d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:14.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.780+0000 7f1870d7f640 1 --2- 172.21.15.5:0/2973512017 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f186c1047d0 0x7f186c104be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:14.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.780+0000 7f1870d7f640 1 -- 172.21.15.5:0/2973512017 >> 172.21.15.5:0/2973512017 conn(0x7f186c079530 msgr2=0x7f186c079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:14.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.780+0000 7f1870d7f640 1 -- 172.21.15.5:0/2973512017 shutdown_connections 2024-08-31T05:33:14.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.780+0000 7f1870d7f640 1 -- 172.21.15.5:0/2973512017 wait complete. 2024-08-31T05:33:14.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.781+0000 7f1870d7f640 1 Processor -- start 2024-08-31T05:33:14.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.781+0000 7f1870d7f640 1 -- start start 2024-08-31T05:33:14.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.781+0000 7f1870d7f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f186c1047d0 0x7f186c19a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:14.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.781+0000 7f1870d7f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f186c105120 0x7f186c19a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:14.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.781+0000 7f1870d7f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f186c10dc00 0x7f186c19f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:14.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.781+0000 7f1870d7f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f186c113840 con 0x7f186c105120 2024-08-31T05:33:14.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.781+0000 7f1870d7f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f186c1136c0 con 0x7f186c10dc00 2024-08-31T05:33:14.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.781+0000 7f1870d7f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f186c1139c0 con 0x7f186c1047d0 2024-08-31T05:33:14.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.781+0000 7f1869d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f186c105120 0x7f186c19a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:14.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.782+0000 7f186a59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f186c1047d0 0x7f186c19a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:14.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.782+0000 7f1869d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f186c105120 0x7f186c19a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51046/0 (socket says 172.21.15.5:51046) 2024-08-31T05:33:14.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.782+0000 7f1869d9b640 1 -- 172.21.15.5:0/739656881 learned_addr learned my addr 172.21.15.5:0/739656881 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:14.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.782+0000 7f186ad9d640 1 --2- 172.21.15.5:0/739656881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f186c10dc00 0x7f186c19f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:14.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.782+0000 7f1869d9b640 1 -- 172.21.15.5:0/739656881 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f186c1047d0 msgr2=0x7f186c19a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:14.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.782+0000 7f1869d9b640 1 --2- 172.21.15.5:0/739656881 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f186c1047d0 0x7f186c19a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:14.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.782+0000 7f1869d9b640 1 -- 172.21.15.5:0/739656881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f186c10dc00 msgr2=0x7f186c19f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:14.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.782+0000 7f1869d9b640 1 --2- 172.21.15.5:0/739656881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f186c10dc00 0x7f186c19f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:14.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.782+0000 7f1869d9b640 1 -- 172.21.15.5:0/739656881 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f186c1a0120 con 0x7f186c105120 2024-08-31T05:33:14.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.782+0000 7f186a59c640 1 --2- 172.21.15.5:0/739656881 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f186c1047d0 0x7f186c19a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:14.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.782+0000 7f186ad9d640 1 --2- 172.21.15.5:0/739656881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f186c10dc00 0x7f186c19f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:14.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.782+0000 7f1869d9b640 1 --2- 172.21.15.5:0/739656881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f186c105120 0x7f186c19a750 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f186000e9f0 tx=0x7f186000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:14.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.782+0000 7f185b7fe640 1 -- 172.21.15.5:0/739656881 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f186000ccc0 con 0x7f186c105120 2024-08-31T05:33:14.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.782+0000 7f1870d7f640 1 -- 172.21.15.5:0/739656881 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f186c1a0410 con 0x7f186c105120 2024-08-31T05:33:14.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.782+0000 7f185b7fe640 1 -- 172.21.15.5:0/739656881 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18600108e0 con 0x7f186c105120 2024-08-31T05:33:14.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.782+0000 7f185b7fe640 1 -- 172.21.15.5:0/739656881 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1860018860 con 0x7f186c105120 2024-08-31T05:33:14.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.782+0000 7f1870d7f640 1 -- 172.21.15.5:0/739656881 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f186c1a6b70 con 0x7f186c105120 2024-08-31T05:33:14.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.786+0000 7f185b7fe640 1 -- 172.21.15.5:0/739656881 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f1860018a00 con 0x7f186c105120 2024-08-31T05:33:14.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.786+0000 7f18772f4740 1 Processor -- start 2024-08-31T05:33:14.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.786+0000 7f18772f4740 1 -- start start 2024-08-31T05:33:14.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.786+0000 7f18772f4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5574800ca070 0x55748046f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:14.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.787+0000 7f18772f4740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574800a11b0 0x55748046f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:14.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.787+0000 7f18772f4740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5574800a9390 0x55748046fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:14.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.787+0000 7f18772f4740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5574803e6680 con 0x5574800a9390 2024-08-31T05:33:14.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.787+0000 7f18772f4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5574803d5c10 con 0x5574800ca070 2024-08-31T05:33:14.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.787+0000 7f18772f4740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5574803d9bc0 con 0x5574800a11b0 2024-08-31T05:33:14.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.787+0000 7f186ad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5574800ca070 0x55748046f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:14.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.787+0000 7f186a59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574800a11b0 0x55748046f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:14.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.787+0000 7f186ad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5574800ca070 0x55748046f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:54046/0 (socket says 172.21.15.5:54046) 2024-08-31T05:33:14.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.787+0000 7f186ad9d640 1 -- 172.21.15.5:0/162339412 learned_addr learned my addr 172.21.15.5:0/162339412 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:14.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.787+0000 7f1869d9b640 1 --2- 172.21.15.5:0/162339412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5574800a9390 0x55748046fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:14.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.787+0000 7f186ad9d640 1 -- 172.21.15.5:0/162339412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574800a11b0 msgr2=0x55748046f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:14.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.787+0000 7f186ad9d640 1 --2- 172.21.15.5:0/162339412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574800a11b0 0x55748046f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:14.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.787+0000 7f186ad9d640 1 -- 172.21.15.5:0/162339412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5574800a9390 msgr2=0x55748046fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:14.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.787+0000 7f186ad9d640 1 --2- 172.21.15.5:0/162339412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5574800a9390 0x55748046fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:14.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.787+0000 7f186ad9d640 1 -- 172.21.15.5:0/162339412 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557480135650 con 0x5574800ca070 2024-08-31T05:33:14.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.787+0000 7f1869d9b640 1 --2- 172.21.15.5:0/162339412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5574800a9390 0x55748046fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:33:14.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.787+0000 7f185b7fe640 1 --2- 172.21.15.5:0/739656881 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f18540b4ca0 0x7f18540b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:14.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.787+0000 7f186ad9d640 1 --2- 172.21.15.5:0/162339412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5574800ca070 0x55748046f350 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1864033040 tx=0x7f186402f310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17c46391ddb8d83c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:14.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.787+0000 7f186a59c640 1 --2- 172.21.15.5:0/739656881 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f18540b4ca0 0x7f18540b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:14.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.788+0000 7f185b7fe640 1 -- 172.21.15.5:0/739656881 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f18600e5bd0 con 0x7f186c105120 2024-08-31T05:33:14.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.788+0000 7f1858ff9640 1 -- 172.21.15.5:0/162339412 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1864031650 con 0x5574800ca070 2024-08-31T05:33:14.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.788+0000 7f1858ff9640 1 -- 172.21.15.5:0/162339412 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1864036040 con 0x5574800ca070 2024-08-31T05:33:14.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.788+0000 7f1858ff9640 1 -- 172.21.15.5:0/162339412 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18640044c0 con 0x5574800ca070 2024-08-31T05:33:14.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.788+0000 7f18772f4740 1 -- 172.21.15.5:0/162339412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5574800ca070 msgr2=0x55748046f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:14.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.788+0000 7f18772f4740 1 --2- 172.21.15.5:0/162339412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5574800ca070 0x55748046f350 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1864033040 tx=0x7f186402f310 comp rx=0 tx=0).stop 2024-08-31T05:33:14.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.788+0000 7f186a59c640 1 --2- 172.21.15.5:0/739656881 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f18540b4ca0 0x7f18540b71b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x55748046dfd0 tx=0x7f185c015040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:14.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.789+0000 7f18772f4740 1 -- 172.21.15.5:0/162339412 shutdown_connections 2024-08-31T05:33:14.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.789+0000 7f18772f4740 1 --2- 172.21.15.5:0/162339412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5574800a9390 0x55748046fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:14.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.789+0000 7f18772f4740 1 --2- 172.21.15.5:0/162339412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574800a11b0 0x55748046f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:14.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.789+0000 7f18772f4740 1 --2- 172.21.15.5:0/162339412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5574800ca070 0x55748046f350 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:14.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.789+0000 7f18772f4740 1 -- 172.21.15.5:0/162339412 >> 172.21.15.5:0/162339412 conn(0x5574800be460 msgr2=0x55748046d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:14.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.789+0000 7f18772f4740 1 -- 172.21.15.5:0/162339412 shutdown_connections 2024-08-31T05:33:14.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.789+0000 7f18772f4740 1 -- 172.21.15.5:0/162339412 wait complete. 2024-08-31T05:33:14.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.789+0000 7f18772f4740 1 -- start start 2024-08-31T05:33:14.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.789+0000 7f18772f4740 1 Processor -- start 2024-08-31T05:33:14.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.789+0000 7f18772f4740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574800a11b0 0x55748047aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:14.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.789+0000 7f18772f4740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5574800a9390 0x55748047b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:14.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.789+0000 7f18772f4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5574800ca070 0x557480486c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:14.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.789+0000 7f18772f4740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x557480238700 con 0x5574800a9390 2024-08-31T05:33:14.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.790+0000 7f18772f4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55748035c750 con 0x5574800ca070 2024-08-31T05:33:14.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.790+0000 7f18772f4740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55748047d950 con 0x5574800a11b0 2024-08-31T05:33:14.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.790+0000 7f1869d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5574800a9390 0x55748047b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:14.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.790+0000 7f186a59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574800a11b0 0x55748047aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:14.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.790+0000 7f18772f4740 10 client.0 _ll_register_callbacks cb 0x55748038be10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:33:14.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.790+0000 7f186a59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574800a11b0 0x55748047aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:36206/0 (socket says 172.21.15.5:36206) 2024-08-31T05:33:14.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.790+0000 7f1869d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5574800a9390 0x55748047b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51068/0 (socket says 172.21.15.5:51068) 2024-08-31T05:33:14.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.790+0000 7f186a59c640 1 -- 172.21.15.5:0/425205197 learned_addr learned my addr 172.21.15.5:0/425205197 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:14.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.790+0000 7f186ad9d640 1 --2- 172.21.15.5:0/425205197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5574800ca070 0x557480486c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:14.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.790+0000 7f1869d9b640 1 -- 172.21.15.5:0/425205197 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574800a11b0 msgr2=0x55748047aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:14.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.790+0000 7f1869d9b640 1 --2- 172.21.15.5:0/425205197 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574800a11b0 0x55748047aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:14.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.790+0000 7f1869d9b640 1 -- 172.21.15.5:0/425205197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5574800ca070 msgr2=0x557480486c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:14.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.790+0000 7f1869d9b640 1 --2- 172.21.15.5:0/425205197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5574800ca070 0x557480486c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:14.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.790+0000 7f1869d9b640 1 -- 172.21.15.5:0/425205197 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557480395900 con 0x5574800a9390 2024-08-31T05:33:14.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.790+0000 7f186a59c640 1 --2- 172.21.15.5:0/425205197 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574800a11b0 0x55748047aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:14.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.790+0000 7f186ad9d640 1 --2- 172.21.15.5:0/425205197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5574800ca070 0x557480486c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:14.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.790+0000 7f1869d9b640 1 --2- 172.21.15.5:0/425205197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5574800a9390 0x55748047b030 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f18600e2fa0 tx=0x7f18600aba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88217581f8cfd4c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:14.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.790+0000 7f1851ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:33:14.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.790+0000 7f1851ffb640 1 -- 172.21.15.5:0/425205197 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18600b5260 con 0x5574800a9390 2024-08-31T05:33:14.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.790+0000 7f1851ffb640 1 -- 172.21.15.5:0/425205197 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f18600a83d0 con 0x5574800a9390 2024-08-31T05:33:14.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.790+0000 7f18772f4740 1 -- 172.21.15.5:0/425205197 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1864036040 con 0x5574800a9390 2024-08-31T05:33:14.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.791+0000 7f1851ffb640 1 -- 172.21.15.5:0/425205197 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f1860095e60 con 0x5574800a9390 2024-08-31T05:33:14.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.791+0000 7f18772f4740 10 client.16464 fetch_fsmap learned FSMap version 33 2024-08-31T05:33:14.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.791+0000 7f18772f4740 1 -- 172.21.15.5:0/425205197 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5574804896f0 con 0x5574800a9390 2024-08-31T05:33:14.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.791+0000 7f1851ffb640 1 -- 172.21.15.5:0/425205197 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1864036040 con 0x5574800a9390 2024-08-31T05:33:14.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.791+0000 7f1851ffb640 1 -- 172.21.15.5:0/425205197 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 33) ==== 8374+0+0 (secure 0 0 0) 0x7f18600aae10 con 0x5574800a9390 2024-08-31T05:33:14.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.791+0000 7f18772f4740 10 client.16464 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T05:33:14.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.791+0000 7f18772f4740 10 client.16464 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:33:14.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.791+0000 7f18772f4740 20 client.16464 populate_metadata read hostname 'smithi005' 2024-08-31T05:33:14.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.791+0000 7f18772f4740 1 --2- 172.21.15.5:0/425205197 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5574800889f0 0x55748048cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:14.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.791+0000 7f18772f4740 4 client.16464 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:33:14.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.791+0000 7f18772f4740 1 -- 172.21.15.5:0/425205197 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5574803e85d0 con 0x5574800889f0 2024-08-31T05:33:14.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.791+0000 7f186a59c640 1 --2- 172.21.15.5:0/425205197 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5574800889f0 0x55748048cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:14.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.792+0000 7f186a59c640 1 --2- 172.21.15.5:0/425205197 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5574800889f0 0x55748048cb60 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9486e3977576b430 server_cookie=1be6ac599ae03e4a in_seq=0 out_seq=0 2024-08-31T05:33:14.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.792+0000 7f1851ffb640 10 client.16464 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:33:14.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.792+0000 7f1851ffb640 1 -- 172.21.15.5:0/425205197 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5574803e85d0 con 0x5574800889f0 2024-08-31T05:33:14.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.792+0000 7f1851ffb640 10 client.16464 handle_command_reply: tid=0 2024-08-31T05:33:14.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.792+0000 7f18772f4740 1 client.16464 shutdown 2024-08-31T05:33:14.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.793+0000 7f18772f4740 1 -- 172.21.15.5:0/425205197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5574800a9390 msgr2=0x55748047b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:14.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.793+0000 7f18772f4740 1 --2- 172.21.15.5:0/425205197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5574800a9390 0x55748047b030 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f18600e2fa0 tx=0x7f18600aba90 comp rx=0 tx=0).stop 2024-08-31T05:33:14.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.793+0000 7f18772f4740 1 -- 172.21.15.5:0/425205197 shutdown_connections 2024-08-31T05:33:14.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.793+0000 7f18772f4740 1 --2- 172.21.15.5:0/425205197 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5574800889f0 0x55748048cb60 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:14.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.793+0000 7f18772f4740 1 --2- 172.21.15.5:0/425205197 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5574800ca070 0x557480486c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:14.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.793+0000 7f18772f4740 1 --2- 172.21.15.5:0/425205197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5574800a9390 0x55748047b030 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:14.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.793+0000 7f18772f4740 1 --2- 172.21.15.5:0/425205197 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574800a11b0 0x55748047aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:14.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.793+0000 7f18772f4740 1 -- 172.21.15.5:0/425205197 >> 172.21.15.5:0/425205197 conn(0x5574800be460 msgr2=0x5574804724e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:14.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.793+0000 7f1851ffb640 0 client.16464 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:33:14.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.793+0000 7f18772f4740 1 -- 172.21.15.5:0/425205197 shutdown_connections 2024-08-31T05:33:14.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.793+0000 7f18772f4740 1 -- 172.21.15.5:0/425205197 wait complete. 2024-08-31T05:33:14.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.793+0000 7f18772f4740 20 client.16464 trim_cache size 0 max 16384 2024-08-31T05:33:14.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.807+0000 7f18772f4740 1 Processor -- start 2024-08-31T05:33:14.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.807+0000 7f18772f4740 1 -- start start 2024-08-31T05:33:14.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.807+0000 7f18772f4740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5574800a11b0 0x55748046d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:14.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.807+0000 7f18772f4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5574800a9390 0x557480486b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:14.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.807+0000 7f18772f4740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574800ca070 0x5574804870b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:14.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.807+0000 7f18772f4740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f186c1ae9b0 con 0x5574800a11b0 2024-08-31T05:33:14.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.807+0000 7f18772f4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f186c1b0520 con 0x5574800a9390 2024-08-31T05:33:14.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.807+0000 7f18772f4740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f186c1af080 con 0x5574800ca070 2024-08-31T05:33:14.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.807+0000 7f186a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5574800a11b0 0x55748046d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:14.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.807+0000 7f186a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5574800a11b0 0x55748046d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51076/0 (socket says 172.21.15.5:51076) 2024-08-31T05:33:14.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.807+0000 7f186a59c640 1 -- 172.21.15.5:0/2410727043 learned_addr learned my addr 172.21.15.5:0/2410727043 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:14.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.807+0000 7f1869d9b640 1 --2- 172.21.15.5:0/2410727043 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5574800a9390 0x557480486b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:14.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.807+0000 7f186ad9d640 1 --2- 172.21.15.5:0/2410727043 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574800ca070 0x5574804870b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:14.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.807+0000 7f186a59c640 1 -- 172.21.15.5:0/2410727043 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574800ca070 msgr2=0x5574804870b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:14.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.807+0000 7f186a59c640 1 --2- 172.21.15.5:0/2410727043 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574800ca070 0x5574804870b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:14.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.807+0000 7f186a59c640 1 -- 172.21.15.5:0/2410727043 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5574800a9390 msgr2=0x557480486b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:14.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.807+0000 7f186a59c640 1 --2- 172.21.15.5:0/2410727043 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5574800a9390 0x557480486b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:14.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.807+0000 7f186a59c640 1 -- 172.21.15.5:0/2410727043 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557480088c20 con 0x5574800a11b0 2024-08-31T05:33:14.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.808+0000 7f186a59c640 1 --2- 172.21.15.5:0/2410727043 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5574800a11b0 0x55748046d270 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f185c013fd0 tx=0x7f185c01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=915b450e38ba80b0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:14.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.808+0000 7f1853fff640 1 -- 172.21.15.5:0/2410727043 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f185c004410 con 0x5574800a11b0 2024-08-31T05:33:14.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.808+0000 7f1853fff640 1 -- 172.21.15.5:0/2410727043 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f185c0130d0 con 0x5574800a11b0 2024-08-31T05:33:14.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.808+0000 7f1853fff640 1 -- 172.21.15.5:0/2410727043 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f185c005450 con 0x5574800a11b0 2024-08-31T05:33:14.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.808+0000 7f18772f4740 1 -- 172.21.15.5:0/2410727043 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5574800a11b0 msgr2=0x55748046d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:14.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.808+0000 7f18772f4740 1 --2- 172.21.15.5:0/2410727043 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5574800a11b0 0x55748046d270 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f185c013fd0 tx=0x7f185c01b000 comp rx=0 tx=0).stop 2024-08-31T05:33:14.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.809+0000 7f18772f4740 1 -- 172.21.15.5:0/2410727043 shutdown_connections 2024-08-31T05:33:14.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.809+0000 7f18772f4740 1 --2- 172.21.15.5:0/2410727043 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574800ca070 0x5574804870b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:14.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.809+0000 7f18772f4740 1 --2- 172.21.15.5:0/2410727043 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5574800a9390 0x557480486b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:14.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.809+0000 7f18772f4740 1 --2- 172.21.15.5:0/2410727043 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5574800a11b0 0x55748046d270 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:14.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.809+0000 7f18772f4740 1 -- 172.21.15.5:0/2410727043 >> 172.21.15.5:0/2410727043 conn(0x5574800be460 msgr2=0x55748046cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:14.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.809+0000 7f18772f4740 1 -- 172.21.15.5:0/2410727043 shutdown_connections 2024-08-31T05:33:14.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.809+0000 7f18772f4740 1 -- 172.21.15.5:0/2410727043 wait complete. 2024-08-31T05:33:14.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.809+0000 7f18772f4740 1 -- start start 2024-08-31T05:33:14.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.809+0000 7f18772f4740 1 Processor -- start 2024-08-31T05:33:14.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.809+0000 7f18772f4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5574800a11b0 0x55748047e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:14.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.809+0000 7f18772f4740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574800a9390 0x55748047ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:14.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.809+0000 7f18772f4740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5574800ca070 0x5574804ef5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:14.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.809+0000 7f18772f4740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f186c1afe20 con 0x5574800ca070 2024-08-31T05:33:14.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.809+0000 7f18772f4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f186c1af750 con 0x5574800a11b0 2024-08-31T05:33:14.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.810+0000 7f18772f4740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f186c1ac990 con 0x5574800a9390 2024-08-31T05:33:14.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.810+0000 7f18772f4740 10 client.0 _ll_register_callbacks cb 0x7f186000e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:33:14.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.810+0000 7f186ad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5574800ca070 0x5574804ef5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:14.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.810+0000 7f186a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5574800a11b0 0x55748047e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:14.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.810+0000 7f186ad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5574800ca070 0x5574804ef5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51078/0 (socket says 172.21.15.5:51078) 2024-08-31T05:33:14.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.810+0000 7f1869d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574800a9390 0x55748047ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:14.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.810+0000 7f186ad9d640 1 -- 172.21.15.5:0/1586209114 learned_addr learned my addr 172.21.15.5:0/1586209114 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:14.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.810+0000 7f186a59c640 1 -- 172.21.15.5:0/1586209114 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574800a9390 msgr2=0x55748047ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:14.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.810+0000 7f186a59c640 1 --2- 172.21.15.5:0/1586209114 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574800a9390 0x55748047ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:14.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.810+0000 7f186a59c640 1 -- 172.21.15.5:0/1586209114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5574800ca070 msgr2=0x5574804ef5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:14.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.810+0000 7f186a59c640 1 --2- 172.21.15.5:0/1586209114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5574800ca070 0x5574804ef5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:14.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.810+0000 7f186a59c640 1 -- 172.21.15.5:0/1586209114 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574804efc30 con 0x5574800a11b0 2024-08-31T05:33:14.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.810+0000 7f186ad9d640 1 --2- 172.21.15.5:0/1586209114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5574800ca070 0x5574804ef5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:14.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.810+0000 7f186a59c640 1 --2- 172.21.15.5:0/1586209114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5574800a11b0 0x55748047e6a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f185c00e780 tx=0x7f185c005b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a510fe456924b43 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:14.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.810+0000 7f1851ffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:33:14.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.810+0000 7f1851ffb640 1 -- 172.21.15.5:0/1586209114 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f185c003ac0 con 0x5574800a11b0 2024-08-31T05:33:14.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.810+0000 7f1851ffb640 1 -- 172.21.15.5:0/1586209114 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f185c003c60 con 0x5574800a11b0 2024-08-31T05:33:14.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.810+0000 7f18772f4740 1 -- 172.21.15.5:0/1586209114 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f185c0130d0 con 0x5574800a11b0 2024-08-31T05:33:14.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.811+0000 7f1851ffb640 1 -- 172.21.15.5:0/1586209114 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f185c048050 con 0x5574800a11b0 2024-08-31T05:33:14.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.811+0000 7f18772f4740 10 client.26060 fetch_fsmap learned FSMap version 33 2024-08-31T05:33:14.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.811+0000 7f18772f4740 1 -- 172.21.15.5:0/1586209114 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5574804f7020 con 0x5574800a11b0 2024-08-31T05:33:14.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.811+0000 7f1851ffb640 1 -- 172.21.15.5:0/1586209114 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f185c0130d0 con 0x5574800a11b0 2024-08-31T05:33:14.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.811+0000 7f1851ffb640 1 -- 172.21.15.5:0/1586209114 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 33) ==== 8374+0+0 (secure 0 0 0) 0x7f185c004c20 con 0x5574800a11b0 2024-08-31T05:33:14.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.811+0000 7f18772f4740 10 client.26060 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T05:33:14.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.811+0000 7f18772f4740 10 client.26060 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:33:14.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.811+0000 7f18772f4740 20 client.26060 populate_metadata read hostname 'smithi005' 2024-08-31T05:33:14.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.811+0000 7f18772f4740 1 --2- 172.21.15.5:0/1586209114 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55748005dda0 0x5574804f97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:14.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.811+0000 7f18772f4740 4 client.26060 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:33:14.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.811+0000 7f18772f4740 1 -- 172.21.15.5:0/1586209114 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5574803e4070 con 0x55748005dda0 2024-08-31T05:33:14.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.811+0000 7f1869d9b640 1 --2- 172.21.15.5:0/1586209114 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55748005dda0 0x5574804f97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:14.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.812+0000 7f1869d9b640 1 --2- 172.21.15.5:0/1586209114 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55748005dda0 0x5574804f97d0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4886e12cfc386f00 server_cookie=1c1b71712afc3dcb in_seq=0 out_seq=0 2024-08-31T05:33:14.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.812+0000 7f1851ffb640 10 client.26060 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:33:14.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.812+0000 7f1851ffb640 1 -- 172.21.15.5:0/1586209114 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5574803e4070 con 0x55748005dda0 2024-08-31T05:33:14.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.812+0000 7f1851ffb640 10 client.26060 handle_command_reply: tid=0 2024-08-31T05:33:14.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.812+0000 7f18772f4740 1 client.26060 shutdown 2024-08-31T05:33:14.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.812+0000 7f18772f4740 1 -- 172.21.15.5:0/1586209114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5574800a11b0 msgr2=0x55748047e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:14.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.812+0000 7f18772f4740 1 --2- 172.21.15.5:0/1586209114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5574800a11b0 0x55748047e6a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f185c00e780 tx=0x7f185c005b80 comp rx=0 tx=0).stop 2024-08-31T05:33:14.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.812+0000 7f18772f4740 1 -- 172.21.15.5:0/1586209114 shutdown_connections 2024-08-31T05:33:14.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.812+0000 7f18772f4740 1 --2- 172.21.15.5:0/1586209114 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55748005dda0 0x5574804f97d0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:14.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.812+0000 7f18772f4740 1 --2- 172.21.15.5:0/1586209114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5574800ca070 0x5574804ef5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:14.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.812+0000 7f18772f4740 1 --2- 172.21.15.5:0/1586209114 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574800a9390 0x55748047ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:14.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.812+0000 7f18772f4740 1 --2- 172.21.15.5:0/1586209114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5574800a11b0 0x55748047e6a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:14.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.812+0000 7f1851ffb640 0 client.26060 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:33:14.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.812+0000 7f18772f4740 1 -- 172.21.15.5:0/1586209114 >> 172.21.15.5:0/1586209114 conn(0x5574800be460 msgr2=0x557480470330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:14.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.812+0000 7f18772f4740 1 -- 172.21.15.5:0/1586209114 shutdown_connections 2024-08-31T05:33:14.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.812+0000 7f18772f4740 1 -- 172.21.15.5:0/1586209114 wait complete. 2024-08-31T05:33:14.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.812+0000 7f18772f4740 20 client.26060 trim_cache size 0 max 16384 2024-08-31T05:33:14.820 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:33:14.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.813+0000 7f1870d7f640 1 -- 172.21.15.5:0/739656881 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f18540b4ca0 msgr2=0x7f18540b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:14.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.813+0000 7f1870d7f640 1 --2- 172.21.15.5:0/739656881 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f18540b4ca0 0x7f18540b71b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x55748046dfd0 tx=0x7f185c015040 comp rx=0 tx=0).stop 2024-08-31T05:33:14.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.813+0000 7f1870d7f640 1 -- 172.21.15.5:0/739656881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f186c105120 msgr2=0x7f186c19a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:14.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.813+0000 7f1870d7f640 1 --2- 172.21.15.5:0/739656881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f186c105120 0x7f186c19a750 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f186000e9f0 tx=0x7f186000eeb0 comp rx=0 tx=0).stop 2024-08-31T05:33:14.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.813+0000 7f1870d7f640 1 -- 172.21.15.5:0/739656881 shutdown_connections 2024-08-31T05:33:14.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.813+0000 7f1870d7f640 1 --2- 172.21.15.5:0/739656881 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f18540b4ca0 0x7f18540b71b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:14.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.813+0000 7f1870d7f640 1 --2- 172.21.15.5:0/739656881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f186c10dc00 0x7f186c19f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:14.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.813+0000 7f1870d7f640 1 --2- 172.21.15.5:0/739656881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f186c105120 0x7f186c19a750 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:14.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.813+0000 7f1870d7f640 1 --2- 172.21.15.5:0/739656881 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f186c1047d0 0x7f186c19a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:14.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.813+0000 7f1870d7f640 1 -- 172.21.15.5:0/739656881 >> 172.21.15.5:0/739656881 conn(0x7f186c079530 msgr2=0x7f186c0ff2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:14.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.813+0000 7f1870d7f640 1 -- 172.21.15.5:0/739656881 shutdown_connections 2024-08-31T05:33:14.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:14.813+0000 7f1870d7f640 1 -- 172.21.15.5:0/739656881 wait complete. 2024-08-31T05:33:14.912 INFO:tasks.workunit.client.0.smithi005.stdout: 1 308858 16.25 MB/sec execute 2 sec latency 29.992 ms 2024-08-31T05:33:15.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:33:15 smithi005 ceph-mon[18602]: pgmap v443: 129 pgs: 129 active+clean; 152 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.6 MiB/s wr, 280 op/s 2024-08-31T05:33:15.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:33:15 smithi070 ceph-mon[22316]: pgmap v443: 129 pgs: 129 active+clean; 152 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.6 MiB/s wr, 280 op/s 2024-08-31T05:33:15.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:33:15 smithi050 ceph-mon[22146]: pgmap v443: 129 pgs: 129 active+clean; 152 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.6 MiB/s wr, 280 op/s 2024-08-31T05:33:15.912 INFO:tasks.workunit.client.0.smithi005.stdout: 1 311512 14.90 MB/sec execute 3 sec latency 15.940 ms 2024-08-31T05:33:16.805 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T05:33:16.805 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T05:33:16.912 INFO:tasks.workunit.client.0.smithi005.stdout: 1 313099 13.19 MB/sec execute 4 sec latency 63.912 ms 2024-08-31T05:33:17.080 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:33:17.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:33:17 smithi005 ceph-mon[18602]: pgmap v444: 129 pgs: 129 active+clean; 159 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 5.1 MiB/s wr, 358 op/s 2024-08-31T05:33:17.585 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:33:17 smithi070 ceph-mon[22316]: pgmap v444: 129 pgs: 129 active+clean; 159 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 5.1 MiB/s wr, 358 op/s 2024-08-31T05:33:17.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.643+0000 7f435d56c640 1 -- 172.21.15.5:0/1883317964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4358108140 msgr2=0x7f4358108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:17.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.643+0000 7f435d56c640 1 --2- 172.21.15.5:0/1883317964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4358108140 0x7f4358108550 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f4340009900 tx=0x7f434002a410 comp rx=0 tx=0).stop 2024-08-31T05:33:17.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.643+0000 7f435d56c640 1 -- 172.21.15.5:0/1883317964 shutdown_connections 2024-08-31T05:33:17.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.643+0000 7f435d56c640 1 --2- 172.21.15.5:0/1883317964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4358108a90 0x7f435810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:17.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.643+0000 7f435d56c640 1 --2- 172.21.15.5:0/1883317964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4358108140 0x7f4358108550 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:17.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.643+0000 7f435d56c640 1 --2- 172.21.15.5:0/1883317964 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4358102800 0x7f4358102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:17.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.643+0000 7f435d56c640 1 -- 172.21.15.5:0/1883317964 >> 172.21.15.5:0/1883317964 conn(0x7f43580794d0 msgr2=0x7f43580798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:17.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.643+0000 7f435d56c640 1 -- 172.21.15.5:0/1883317964 shutdown_connections 2024-08-31T05:33:17.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.643+0000 7f435d56c640 1 -- 172.21.15.5:0/1883317964 wait complete. 2024-08-31T05:33:17.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.644+0000 7f435d56c640 1 Processor -- start 2024-08-31T05:33:17.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.644+0000 7f435d56c640 1 -- start start 2024-08-31T05:33:17.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.644+0000 7f435d56c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4358102800 0x7f435819a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:17.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.645+0000 7f435d56c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4358108140 0x7f435819a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:17.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.645+0000 7f435d56c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4358108a90 0x7f435819fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:17.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.645+0000 7f435d56c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f43581126c0 con 0x7f4358108140 2024-08-31T05:33:17.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.645+0000 7f435d56c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4358112540 con 0x7f4358102800 2024-08-31T05:33:17.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.645+0000 7f435d56c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4358112840 con 0x7f4358108a90 2024-08-31T05:33:17.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.645+0000 7f434e7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4358108140 0x7f435819a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:17.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.645+0000 7f4356ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4358102800 0x7f435819a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:17.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.645+0000 7f434e7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4358108140 0x7f435819a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51094/0 (socket says 172.21.15.5:51094) 2024-08-31T05:33:17.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.645+0000 7f434e7fc640 1 -- 172.21.15.5:0/1395508224 learned_addr learned my addr 172.21.15.5:0/1395508224 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:17.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.645+0000 7f43577fe640 1 --2- 172.21.15.5:0/1395508224 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4358108a90 0x7f435819fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:17.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.645+0000 7f4356ffd640 1 -- 172.21.15.5:0/1395508224 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4358108a90 msgr2=0x7f435819fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:17.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.645+0000 7f4356ffd640 1 --2- 172.21.15.5:0/1395508224 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4358108a90 0x7f435819fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:17.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.645+0000 7f4356ffd640 1 -- 172.21.15.5:0/1395508224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4358108140 msgr2=0x7f435819a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:17.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.645+0000 7f4356ffd640 1 --2- 172.21.15.5:0/1395508224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4358108140 0x7f435819a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:17.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.645+0000 7f4356ffd640 1 -- 172.21.15.5:0/1395508224 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43581a01f0 con 0x7f4358102800 2024-08-31T05:33:17.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.645+0000 7f434e7fc640 1 --2- 172.21.15.5:0/1395508224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4358108140 0x7f435819a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:17.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.645+0000 7f4356ffd640 1 --2- 172.21.15.5:0/1395508224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4358102800 0x7f435819a280 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f434800e9f0 tx=0x7f434800edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:17.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.645+0000 7f4354ff9640 1 -- 172.21.15.5:0/1395508224 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f434800ccc0 con 0x7f4358102800 2024-08-31T05:33:17.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.646+0000 7f435d56c640 1 -- 172.21.15.5:0/1395508224 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43581a04e0 con 0x7f4358102800 2024-08-31T05:33:17.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.646+0000 7f4354ff9640 1 -- 172.21.15.5:0/1395508224 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43480108e0 con 0x7f4358102800 2024-08-31T05:33:17.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.646+0000 7f4354ff9640 1 -- 172.21.15.5:0/1395508224 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4348018840 con 0x7f4358102800 2024-08-31T05:33:17.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.646+0000 7f435d56c640 1 -- 172.21.15.5:0/1395508224 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43581a6c40 con 0x7f4358102800 2024-08-31T05:33:17.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.648+0000 7f4363ae1740 1 Processor -- start 2024-08-31T05:33:17.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.648+0000 7f4354ff9640 1 -- 172.21.15.5:0/1395508224 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f4348010430 con 0x7f4358102800 2024-08-31T05:33:17.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.648+0000 7f4363ae1740 1 -- start start 2024-08-31T05:33:17.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.649+0000 7f4363ae1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558d7f687350 0x558d7fa2d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:17.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.649+0000 7f4363ae1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558d7f65e490 0x558d7fa2dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:17.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.649+0000 7f4363ae1740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558d7f666670 0x558d7fa2e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:17.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.649+0000 7f4363ae1740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x558d7f9a35f0 con 0x558d7f666670 2024-08-31T05:33:17.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.649+0000 7f4363ae1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558d7f992b80 con 0x558d7f65e490 2024-08-31T05:33:17.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.649+0000 7f4363ae1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558d7f996b30 con 0x558d7f687350 2024-08-31T05:33:17.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.649+0000 7f434e7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558d7f666670 0x558d7fa2e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:17.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.649+0000 7f4356ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558d7f65e490 0x558d7fa2dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:17.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.649+0000 7f43577fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558d7f687350 0x558d7fa2d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:17.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.649+0000 7f43577fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558d7f687350 0x558d7fa2d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:36240/0 (socket says 172.21.15.5:36240) 2024-08-31T05:33:17.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.649+0000 7f43577fe640 1 -- 172.21.15.5:0/1747417874 learned_addr learned my addr 172.21.15.5:0/1747417874 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:17.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.649+0000 7f43577fe640 1 -- 172.21.15.5:0/1747417874 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558d7f65e490 msgr2=0x558d7fa2dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:17.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.649+0000 7f43577fe640 1 --2- 172.21.15.5:0/1747417874 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558d7f65e490 0x558d7fa2dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:17.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.649+0000 7f43577fe640 1 -- 172.21.15.5:0/1747417874 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558d7f666670 msgr2=0x558d7fa2e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:17.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.649+0000 7f43577fe640 1 --2- 172.21.15.5:0/1747417874 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558d7f666670 0x558d7fa2e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:17.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.649+0000 7f43577fe640 1 -- 172.21.15.5:0/1747417874 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d7f6f2930 con 0x558d7f687350 2024-08-31T05:33:17.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.650+0000 7f4354ff9640 1 --2- 172.21.15.5:0/1395508224 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f43440b4ca0 0x7f43440b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:17.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.650+0000 7f43577fe640 1 --2- 172.21.15.5:0/1747417874 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558d7f687350 0x558d7fa2d780 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4350009f60 tx=0x7f4350009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e69c87b4c2d83d3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:17.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.650+0000 7f4356ffd640 1 --2- 172.21.15.5:0/1395508224 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f43440b4ca0 0x7f43440b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:17.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.650+0000 7f434d7fa640 1 -- 172.21.15.5:0/1747417874 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f435001e070 con 0x558d7f687350 2024-08-31T05:33:17.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.650+0000 7f434d7fa640 1 -- 172.21.15.5:0/1747417874 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4350003c30 con 0x558d7f687350 2024-08-31T05:33:17.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.650+0000 7f434d7fa640 1 -- 172.21.15.5:0/1747417874 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f435000f840 con 0x558d7f687350 2024-08-31T05:33:17.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.650+0000 7f4354ff9640 1 -- 172.21.15.5:0/1395508224 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f43480e5b60 con 0x7f4358102800 2024-08-31T05:33:17.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.651+0000 7f4363ae1740 1 -- 172.21.15.5:0/1747417874 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558d7f687350 msgr2=0x558d7fa2d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:17.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.651+0000 7f4356ffd640 1 --2- 172.21.15.5:0/1395508224 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f43440b4ca0 0x7f43440b71b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x558d7fa2c400 tx=0x7f43480e9610 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:17.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.651+0000 7f4363ae1740 1 --2- 172.21.15.5:0/1747417874 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558d7f687350 0x558d7fa2d780 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4350009f60 tx=0x7f4350009f90 comp rx=0 tx=0).stop 2024-08-31T05:33:17.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.651+0000 7f4363ae1740 1 -- 172.21.15.5:0/1747417874 shutdown_connections 2024-08-31T05:33:17.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.651+0000 7f4363ae1740 1 --2- 172.21.15.5:0/1747417874 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558d7f666670 0x558d7fa2e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:17.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.651+0000 7f4363ae1740 1 --2- 172.21.15.5:0/1747417874 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558d7f65e490 0x558d7fa2dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:17.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.651+0000 7f4363ae1740 1 --2- 172.21.15.5:0/1747417874 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558d7f687350 0x558d7fa2d780 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:17.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.651+0000 7f4363ae1740 1 -- 172.21.15.5:0/1747417874 >> 172.21.15.5:0/1747417874 conn(0x558d7f67b740 msgr2=0x558d7fa2b670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:17.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.651+0000 7f4363ae1740 1 -- 172.21.15.5:0/1747417874 shutdown_connections 2024-08-31T05:33:17.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.651+0000 7f4363ae1740 1 -- 172.21.15.5:0/1747417874 wait complete. 2024-08-31T05:33:17.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.651+0000 7f4363ae1740 1 -- start start 2024-08-31T05:33:17.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.652+0000 7f4363ae1740 1 Processor -- start 2024-08-31T05:33:17.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.652+0000 7f4363ae1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558d7f65e490 0x558d7fa38f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:17.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.652+0000 7f4363ae1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558d7f666670 0x558d7fa39480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:17.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.652+0000 7f4363ae1740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558d7f687350 0x558d7fa45250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:17.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.652+0000 7f4363ae1740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x558d7f7f5890 con 0x558d7f687350 2024-08-31T05:33:17.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.652+0000 7f4363ae1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558d7f919790 con 0x558d7f666670 2024-08-31T05:33:17.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.652+0000 7f4363ae1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558d7fa3bf60 con 0x558d7f65e490 2024-08-31T05:33:17.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.652+0000 7f4363ae1740 10 client.0 _ll_register_callbacks cb 0x558d7f69eba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:33:17.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.652+0000 7f43577fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558d7f687350 0x558d7fa45250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:17.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.652+0000 7f43577fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558d7f65e490 0x558d7fa38f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:17.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.652+0000 7f434e7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558d7f666670 0x558d7fa39480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:17.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.652+0000 7f43577fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558d7f65e490 0x558d7fa38f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:36242/0 (socket says 172.21.15.5:36242) 2024-08-31T05:33:17.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.652+0000 7f43577fe640 1 -- 172.21.15.5:0/771054323 learned_addr learned my addr 172.21.15.5:0/771054323 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:17.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.652+0000 7f43577fe640 1 -- 172.21.15.5:0/771054323 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558d7f65e490 msgr2=0x558d7fa38f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:17.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.652+0000 7f43577fe640 1 --2- 172.21.15.5:0/771054323 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558d7f65e490 0x558d7fa38f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:17.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.652+0000 7f43577fe640 1 -- 172.21.15.5:0/771054323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558d7f666670 msgr2=0x558d7fa39480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:17.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.652+0000 7f43577fe640 1 --2- 172.21.15.5:0/771054323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558d7f666670 0x558d7fa39480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:17.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.652+0000 7f43577fe640 1 -- 172.21.15.5:0/771054323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d7f950f30 con 0x558d7f687350 2024-08-31T05:33:17.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.652+0000 7f434e7fc640 1 --2- 172.21.15.5:0/771054323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558d7f666670 0x558d7fa39480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:17.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.653+0000 7f43577fe640 1 --2- 172.21.15.5:0/771054323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558d7f687350 0x558d7fa45250 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x558d7fa3b790 tx=0x7f435000f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccc96e54c5b28479 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:17.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.653+0000 7f433e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:33:17.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.653+0000 7f433e7fc640 1 -- 172.21.15.5:0/771054323 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f435001e040 con 0x558d7f687350 2024-08-31T05:33:17.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.653+0000 7f433e7fc640 1 -- 172.21.15.5:0/771054323 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f4350004460 con 0x558d7f687350 2024-08-31T05:33:17.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.653+0000 7f4363ae1740 1 -- 172.21.15.5:0/771054323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4350003c30 con 0x558d7f687350 2024-08-31T05:33:17.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.653+0000 7f433e7fc640 1 -- 172.21.15.5:0/771054323 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f435000f600 con 0x558d7f687350 2024-08-31T05:33:17.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.653+0000 7f4363ae1740 10 client.16482 fetch_fsmap learned FSMap version 33 2024-08-31T05:33:17.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.653+0000 7f4363ae1740 1 -- 172.21.15.5:0/771054323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x558d7fa47d70 con 0x558d7f687350 2024-08-31T05:33:17.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.653+0000 7f433e7fc640 1 -- 172.21.15.5:0/771054323 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4350003c30 con 0x558d7f687350 2024-08-31T05:33:17.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.653+0000 7f433e7fc640 1 -- 172.21.15.5:0/771054323 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 33) ==== 8374+0+0 (secure 0 0 0) 0x7f4350005180 con 0x558d7f687350 2024-08-31T05:33:17.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.653+0000 7f4363ae1740 10 client.16482 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T05:33:17.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.653+0000 7f4363ae1740 10 client.16482 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:33:17.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.653+0000 7f4363ae1740 20 client.16482 populate_metadata read hostname 'smithi005' 2024-08-31T05:33:17.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.654+0000 7f4363ae1740 1 --2- 172.21.15.5:0/771054323 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x558d7f645cd0 0x558d7fa4b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:17.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.654+0000 7f4363ae1740 4 client.16482 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:33:17.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.654+0000 7f4363ae1740 1 -- 172.21.15.5:0/771054323 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558d7f9a5540 con 0x558d7f645cd0 2024-08-31T05:33:17.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.654+0000 7f434e7fc640 1 --2- 172.21.15.5:0/771054323 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x558d7f645cd0 0x558d7fa4b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:17.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.654+0000 7f433e7fc640 10 client.16482 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:33:17.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.654+0000 7f434e7fc640 1 --2- 172.21.15.5:0/771054323 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x558d7f645cd0 0x558d7fa4b0d0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb497942dc4db761 server_cookie=f136abe133c59b99 in_seq=0 out_seq=0 2024-08-31T05:33:17.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.655+0000 7f433e7fc640 1 -- 172.21.15.5:0/771054323 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558d7f9a5540 con 0x558d7f645cd0 2024-08-31T05:33:17.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.655+0000 7f433e7fc640 10 client.16482 handle_command_reply: tid=0 2024-08-31T05:33:17.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.655+0000 7f4363ae1740 1 client.16482 shutdown 2024-08-31T05:33:17.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.655+0000 7f4363ae1740 1 -- 172.21.15.5:0/771054323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558d7f687350 msgr2=0x558d7fa45250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:17.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.655+0000 7f4363ae1740 1 --2- 172.21.15.5:0/771054323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558d7f687350 0x558d7fa45250 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x558d7fa3b790 tx=0x7f435000f520 comp rx=0 tx=0).stop 2024-08-31T05:33:17.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.655+0000 7f4363ae1740 1 -- 172.21.15.5:0/771054323 shutdown_connections 2024-08-31T05:33:17.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.655+0000 7f4363ae1740 1 --2- 172.21.15.5:0/771054323 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x558d7f645cd0 0x558d7fa4b0d0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:17.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.655+0000 7f4363ae1740 1 --2- 172.21.15.5:0/771054323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558d7f687350 0x558d7fa45250 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:17.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.655+0000 7f4363ae1740 1 --2- 172.21.15.5:0/771054323 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558d7f666670 0x558d7fa39480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:17.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.655+0000 7f433e7fc640 0 client.16482 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:33:17.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.655+0000 7f4363ae1740 1 --2- 172.21.15.5:0/771054323 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558d7f65e490 0x558d7fa38f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:17.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.655+0000 7f4363ae1740 1 -- 172.21.15.5:0/771054323 >> 172.21.15.5:0/771054323 conn(0x558d7f67b740 msgr2=0x558d7fa30910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:17.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.655+0000 7f4363ae1740 1 -- 172.21.15.5:0/771054323 shutdown_connections 2024-08-31T05:33:17.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.655+0000 7f4363ae1740 1 -- 172.21.15.5:0/771054323 wait complete. 2024-08-31T05:33:17.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.655+0000 7f4363ae1740 20 client.16482 trim_cache size 0 max 16384 2024-08-31T05:33:17.663 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:33:17 smithi050 ceph-mon[22146]: pgmap v444: 129 pgs: 129 active+clean; 159 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 5.1 MiB/s wr, 358 op/s 2024-08-31T05:33:17.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.674+0000 7f4363ae1740 1 Processor -- start 2024-08-31T05:33:17.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.674+0000 7f4363ae1740 1 -- start start 2024-08-31T05:33:17.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.674+0000 7f4363ae1740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558d7f645cd0 0x558d7fa2f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:17.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.674+0000 7f4363ae1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558d7f65e490 0x558d7fa36130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:17.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.674+0000 7f4363ae1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558d7f666670 0x558d7fa36670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:17.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.674+0000 7f4363ae1740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f43581b0cb0 con 0x558d7f645cd0 2024-08-31T05:33:17.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.674+0000 7f4363ae1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f43581b2820 con 0x558d7f666670 2024-08-31T05:33:17.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.674+0000 7f4363ae1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f43581b1380 con 0x558d7f65e490 2024-08-31T05:33:17.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.675+0000 7f43577fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558d7f645cd0 0x558d7fa2f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:17.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.675+0000 7f43577fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558d7f645cd0 0x558d7fa2f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51130/0 (socket says 172.21.15.5:51130) 2024-08-31T05:33:17.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.675+0000 7f43577fe640 1 -- 172.21.15.5:0/3396919074 learned_addr learned my addr 172.21.15.5:0/3396919074 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:17.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.675+0000 7f434e7fc640 1 --2- 172.21.15.5:0/3396919074 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558d7f65e490 0x558d7fa36130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:17.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.675+0000 7f43577fe640 1 --2- 172.21.15.5:0/3396919074 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558d7f666670 0x558d7fa36670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:17.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.675+0000 7f43577fe640 1 -- 172.21.15.5:0/3396919074 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558d7f65e490 msgr2=0x558d7fa36130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:17.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.675+0000 7f43577fe640 1 --2- 172.21.15.5:0/3396919074 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558d7f65e490 0x558d7fa36130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:17.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.675+0000 7f43577fe640 1 -- 172.21.15.5:0/3396919074 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558d7f666670 msgr2=0x558d7fa36670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:17.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.675+0000 7f43577fe640 1 --2- 172.21.15.5:0/3396919074 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558d7f666670 0x558d7fa36670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:17.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.675+0000 7f43577fe640 1 -- 172.21.15.5:0/3396919074 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d7fa259b0 con 0x558d7f645cd0 2024-08-31T05:33:17.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.675+0000 7f434e7fc640 1 --2- 172.21.15.5:0/3396919074 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558d7f65e490 0x558d7fa36130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:17.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.675+0000 7f43577fe640 1 --2- 172.21.15.5:0/3396919074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558d7f645cd0 0x558d7fa2f170 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f4350004a10 tx=0x7f4350005a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f0b3812d6f1a8a4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:17.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.675+0000 7f434cff9640 1 -- 172.21.15.5:0/3396919074 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f435001e040 con 0x558d7f645cd0 2024-08-31T05:33:17.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.675+0000 7f434cff9640 1 -- 172.21.15.5:0/3396919074 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4350003cd0 con 0x558d7f645cd0 2024-08-31T05:33:17.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.675+0000 7f434cff9640 1 -- 172.21.15.5:0/3396919074 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43500046f0 con 0x558d7f645cd0 2024-08-31T05:33:17.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.676+0000 7f4363ae1740 1 -- 172.21.15.5:0/3396919074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558d7f645cd0 msgr2=0x558d7fa2f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:17.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.676+0000 7f4363ae1740 1 --2- 172.21.15.5:0/3396919074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558d7f645cd0 0x558d7fa2f170 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f4350004a10 tx=0x7f4350005a60 comp rx=0 tx=0).stop 2024-08-31T05:33:17.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.676+0000 7f4363ae1740 1 -- 172.21.15.5:0/3396919074 shutdown_connections 2024-08-31T05:33:17.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.676+0000 7f4363ae1740 1 --2- 172.21.15.5:0/3396919074 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558d7f666670 0x558d7fa36670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:17.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.676+0000 7f4363ae1740 1 --2- 172.21.15.5:0/3396919074 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558d7f65e490 0x558d7fa36130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:17.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.676+0000 7f4363ae1740 1 --2- 172.21.15.5:0/3396919074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558d7f645cd0 0x558d7fa2f170 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:17.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.676+0000 7f4363ae1740 1 -- 172.21.15.5:0/3396919074 >> 172.21.15.5:0/3396919074 conn(0x558d7f67b740 msgr2=0x558d7fa30e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:17.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.676+0000 7f4363ae1740 1 -- 172.21.15.5:0/3396919074 shutdown_connections 2024-08-31T05:33:17.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.676+0000 7f4363ae1740 1 -- 172.21.15.5:0/3396919074 wait complete. 2024-08-31T05:33:17.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.677+0000 7f4363ae1740 1 -- start start 2024-08-31T05:33:17.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.677+0000 7f4363ae1740 1 Processor -- start 2024-08-31T05:33:17.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.677+0000 7f4363ae1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558d7f645cd0 0x558d7fa41890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:17.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.677+0000 7f4363ae1740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558d7f65e490 0x558d7fa3edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:17.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.677+0000 7f4363ae1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558d7f666670 0x558d7fa3f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:17.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.677+0000 7f4363ae1740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f43581b2120 con 0x558d7f65e490 2024-08-31T05:33:17.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.677+0000 7f4363ae1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f43581b1a50 con 0x558d7f666670 2024-08-31T05:33:17.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.677+0000 7f4363ae1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f43581aec90 con 0x558d7f645cd0 2024-08-31T05:33:17.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.677+0000 7f4363ae1740 10 client.0 _ll_register_callbacks cb 0x7f435001c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:33:17.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.677+0000 7f43577fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558d7f645cd0 0x558d7fa41890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:17.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.677+0000 7f434e7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558d7f65e490 0x558d7fa3edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:17.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.677+0000 7f43577fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558d7f645cd0 0x558d7fa41890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:36274/0 (socket says 172.21.15.5:36274) 2024-08-31T05:33:17.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.677+0000 7f434e7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558d7f65e490 0x558d7fa3edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51138/0 (socket says 172.21.15.5:51138) 2024-08-31T05:33:17.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.677+0000 7f43577fe640 1 -- 172.21.15.5:0/243541729 learned_addr learned my addr 172.21.15.5:0/243541729 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:17.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.677+0000 7f43577fe640 1 --2- 172.21.15.5:0/243541729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558d7f666670 0x558d7fa3f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:17.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.678+0000 7f434e7fc640 1 -- 172.21.15.5:0/243541729 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558d7f645cd0 msgr2=0x558d7fa41890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:17.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.678+0000 7f434e7fc640 1 --2- 172.21.15.5:0/243541729 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558d7f645cd0 0x558d7fa41890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:17.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.678+0000 7f434e7fc640 1 -- 172.21.15.5:0/243541729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558d7f666670 msgr2=0x558d7fa3f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:17.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.678+0000 7f434e7fc640 1 --2- 172.21.15.5:0/243541729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558d7f666670 0x558d7fa3f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:17.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.678+0000 7f434e7fc640 1 -- 172.21.15.5:0/243541729 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d7fa3f990 con 0x558d7f65e490 2024-08-31T05:33:17.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.678+0000 7f43577fe640 1 --2- 172.21.15.5:0/243541729 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558d7f645cd0 0x558d7fa41890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:17.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.678+0000 7f434e7fc640 1 --2- 172.21.15.5:0/243541729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558d7f65e490 0x558d7fa3edb0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f4340004770 tx=0x7f4340004580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5c8c621096f9451 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:17.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.678+0000 7f433e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:33:17.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.678+0000 7f433e7fc640 1 -- 172.21.15.5:0/243541729 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f434004c030 con 0x558d7f65e490 2024-08-31T05:33:17.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.678+0000 7f433e7fc640 1 -- 172.21.15.5:0/243541729 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f43400038c0 con 0x558d7f65e490 2024-08-31T05:33:17.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.678+0000 7f4363ae1740 1 -- 172.21.15.5:0/243541729 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4350003cd0 con 0x558d7f65e490 2024-08-31T05:33:17.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.678+0000 7f433e7fc640 1 -- 172.21.15.5:0/243541729 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f4340035040 con 0x558d7f65e490 2024-08-31T05:33:17.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.678+0000 7f4363ae1740 10 client.16488 fetch_fsmap learned FSMap version 33 2024-08-31T05:33:17.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.678+0000 7f4363ae1740 1 -- 172.21.15.5:0/243541729 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x558d7fab5960 con 0x558d7f65e490 2024-08-31T05:33:17.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.679+0000 7f433e7fc640 1 -- 172.21.15.5:0/243541729 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4350003cd0 con 0x558d7f65e490 2024-08-31T05:33:17.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.679+0000 7f433e7fc640 1 -- 172.21.15.5:0/243541729 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 33) ==== 8374+0+0 (secure 0 0 0) 0x7f4340031c90 con 0x558d7f65e490 2024-08-31T05:33:17.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.679+0000 7f4363ae1740 10 client.16488 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T05:33:17.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.679+0000 7f4363ae1740 10 client.16488 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:33:17.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.679+0000 7f4363ae1740 20 client.16488 populate_metadata read hostname 'smithi005' 2024-08-31T05:33:17.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.679+0000 7f4363ae1740 1 --2- 172.21.15.5:0/243541729 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x558d7f687350 0x558d7fab8180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:17.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.679+0000 7f4363ae1740 4 client.16488 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T05:33:17.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.679+0000 7f4363ae1740 1 -- 172.21.15.5:0/243541729 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x558d7f9a0fe0 con 0x558d7f687350 2024-08-31T05:33:17.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.679+0000 7f43577fe640 1 --2- 172.21.15.5:0/243541729 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x558d7f687350 0x558d7fab8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:17.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.679+0000 7f433e7fc640 10 client.16488 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:33:17.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.679+0000 7f43577fe640 1 --2- 172.21.15.5:0/243541729 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x558d7f687350 0x558d7fab8180 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2012a21b4e575100 server_cookie=fadf372d3dc60f1f in_seq=0 out_seq=0 2024-08-31T05:33:17.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.681+0000 7f433e7fc640 1 -- 172.21.15.5:0/243541729 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x558d7f9a0fe0 con 0x558d7f687350 2024-08-31T05:33:17.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.681+0000 7f433e7fc640 10 client.16488 handle_command_reply: tid=0 2024-08-31T05:33:17.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.681+0000 7f4363ae1740 1 client.16488 shutdown 2024-08-31T05:33:17.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.682+0000 7f4363ae1740 1 -- 172.21.15.5:0/243541729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558d7f65e490 msgr2=0x558d7fa3edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:17.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.682+0000 7f4363ae1740 1 --2- 172.21.15.5:0/243541729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558d7f65e490 0x558d7fa3edb0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f4340004770 tx=0x7f4340004580 comp rx=0 tx=0).stop 2024-08-31T05:33:17.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.682+0000 7f4363ae1740 1 -- 172.21.15.5:0/243541729 shutdown_connections 2024-08-31T05:33:17.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.682+0000 7f4363ae1740 1 --2- 172.21.15.5:0/243541729 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x558d7f687350 0x558d7fab8180 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:17.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.682+0000 7f4363ae1740 1 --2- 172.21.15.5:0/243541729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558d7f666670 0x558d7fa3f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:17.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.682+0000 7f4363ae1740 1 --2- 172.21.15.5:0/243541729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558d7f65e490 0x558d7fa3edb0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:17.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.682+0000 7f4363ae1740 1 --2- 172.21.15.5:0/243541729 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558d7f645cd0 0x558d7fa41890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:17.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.682+0000 7f4363ae1740 1 -- 172.21.15.5:0/243541729 >> 172.21.15.5:0/243541729 conn(0x558d7f67b740 msgr2=0x558d7fa30e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:17.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.682+0000 7f433e7fc640 0 client.16488 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:33:17.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.682+0000 7f4363ae1740 1 -- 172.21.15.5:0/243541729 shutdown_connections 2024-08-31T05:33:17.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.682+0000 7f4363ae1740 1 -- 172.21.15.5:0/243541729 wait complete. 2024-08-31T05:33:17.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.682+0000 7f4363ae1740 20 client.16488 trim_cache size 0 max 16384 2024-08-31T05:33:17.690 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:33:17.690 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-08-31T05:33:17.690 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "2445fc42-b797-434f-b380-e2da985b4d98", 2024-08-31T05:33:17.691 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-08-31T05:33:17.691 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:33:17.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.683+0000 7f435d56c640 1 -- 172.21.15.5:0/1395508224 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f43440b4ca0 msgr2=0x7f43440b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:17.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.683+0000 7f435d56c640 1 --2- 172.21.15.5:0/1395508224 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f43440b4ca0 0x7f43440b71b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x558d7fa2c400 tx=0x7f43480e9610 comp rx=0 tx=0).stop 2024-08-31T05:33:17.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.683+0000 7f435d56c640 1 -- 172.21.15.5:0/1395508224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4358102800 msgr2=0x7f435819a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:17.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.683+0000 7f435d56c640 1 --2- 172.21.15.5:0/1395508224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4358102800 0x7f435819a280 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f434800e9f0 tx=0x7f434800edf0 comp rx=0 tx=0).stop 2024-08-31T05:33:17.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.683+0000 7f435d56c640 1 -- 172.21.15.5:0/1395508224 shutdown_connections 2024-08-31T05:33:17.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.683+0000 7f435d56c640 1 --2- 172.21.15.5:0/1395508224 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f43440b4ca0 0x7f43440b71b0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:17.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.683+0000 7f435d56c640 1 --2- 172.21.15.5:0/1395508224 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4358108a90 0x7f435819fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:17.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.683+0000 7f435d56c640 1 --2- 172.21.15.5:0/1395508224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4358108140 0x7f435819a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:17.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.683+0000 7f435d56c640 1 --2- 172.21.15.5:0/1395508224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4358102800 0x7f435819a280 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:17.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.683+0000 7f435d56c640 1 -- 172.21.15.5:0/1395508224 >> 172.21.15.5:0/1395508224 conn(0x7f43580794d0 msgr2=0x7f435806b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:17.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.683+0000 7f435d56c640 1 -- 172.21.15.5:0/1395508224 shutdown_connections 2024-08-31T05:33:17.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:17.683+0000 7f435d56c640 1 -- 172.21.15.5:0/1395508224 wait complete. 2024-08-31T05:33:17.912 INFO:tasks.workunit.client.0.smithi005.stdout: 1 315784 13.92 MB/sec execute 5 sec latency 56.237 ms 2024-08-31T05:33:18.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:33:18 smithi005 ceph-mon[18602]: scrub summary: active paths [/] 2024-08-31T05:33:18.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:33:18 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:33:18.542 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T05:33:18.585 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:33:18 smithi070 ceph-mon[22316]: scrub summary: active paths [/] 2024-08-31T05:33:18.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:33:18 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:33:18.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:33:18 smithi050 ceph-mon[22146]: scrub summary: active paths [/] 2024-08-31T05:33:18.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:33:18 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:33:18.797 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:33:18.912 INFO:tasks.workunit.client.0.smithi005.stdout: 1 318195 13.14 MB/sec execute 6 sec latency 9.910 ms 2024-08-31T05:33:19.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.459+0000 7f8ce200b640 1 -- 172.21.15.5:0/679517497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cdc1050b0 msgr2=0x7f8cdc10d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:19.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.459+0000 7f8ce200b640 1 --2- 172.21.15.5:0/679517497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cdc1050b0 0x7f8cdc10d6f0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0009900 tx=0x7f8cd002a410 comp rx=0 tx=0).stop 2024-08-31T05:33:19.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.460+0000 7f8ce200b640 1 -- 172.21.15.5:0/679517497 shutdown_connections 2024-08-31T05:33:19.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.460+0000 7f8ce200b640 1 --2- 172.21.15.5:0/679517497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cdc10dc30 0x7f8cdc110120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:19.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.460+0000 7f8ce200b640 1 --2- 172.21.15.5:0/679517497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cdc1050b0 0x7f8cdc10d6f0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:19.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.460+0000 7f8ce200b640 1 --2- 172.21.15.5:0/679517497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8cdc104680 0x7f8cdc104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:19.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.460+0000 7f8ce200b640 1 -- 172.21.15.5:0/679517497 >> 172.21.15.5:0/679517497 conn(0x7f8cdc079510 msgr2=0x7f8cdc079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:19.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.460+0000 7f8ce200b640 1 -- 172.21.15.5:0/679517497 shutdown_connections 2024-08-31T05:33:19.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.460+0000 7f8ce200b640 1 -- 172.21.15.5:0/679517497 wait complete. 2024-08-31T05:33:19.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.460+0000 7f8ce200b640 1 Processor -- start 2024-08-31T05:33:19.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.461+0000 7f8ce200b640 1 -- start start 2024-08-31T05:33:19.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.461+0000 7f8ce200b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8cdc104680 0x7f8cdc19c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:19.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.461+0000 7f8ce200b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cdc1050b0 0x7f8cdc19ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:19.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.461+0000 7f8ce200b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cdc10dc30 0x7f8cdc1a1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:19.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.461+0000 7f8ce200b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8cdc113890 con 0x7f8cdc10dc30 2024-08-31T05:33:19.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.461+0000 7f8ce200b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8cdc113710 con 0x7f8cdc1050b0 2024-08-31T05:33:19.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.461+0000 7f8ce200b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8cdc113a10 con 0x7f8cdc104680 2024-08-31T05:33:19.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.461+0000 7f8cdbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cdc10dc30 0x7f8cdc1a1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:19.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.461+0000 7f8cdbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cdc10dc30 0x7f8cdc1a1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51162/0 (socket says 172.21.15.5:51162) 2024-08-31T05:33:19.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.461+0000 7f8cdb7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8cdc104680 0x7f8cdc19c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:19.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.461+0000 7f8cdbfff640 1 -- 172.21.15.5:0/410557360 learned_addr learned my addr 172.21.15.5:0/410557360 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:19.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.461+0000 7f8cdaffd640 1 --2- 172.21.15.5:0/410557360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cdc1050b0 0x7f8cdc19ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:19.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.461+0000 7f8cdbfff640 1 -- 172.21.15.5:0/410557360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8cdc104680 msgr2=0x7f8cdc19c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:19.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.461+0000 7f8cdbfff640 1 --2- 172.21.15.5:0/410557360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8cdc104680 0x7f8cdc19c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:19.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.461+0000 7f8cdbfff640 1 -- 172.21.15.5:0/410557360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cdc1050b0 msgr2=0x7f8cdc19ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:19.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.461+0000 7f8cdbfff640 1 --2- 172.21.15.5:0/410557360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cdc1050b0 0x7f8cdc19ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:19.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.461+0000 7f8cdbfff640 1 -- 172.21.15.5:0/410557360 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cdc1a2430 con 0x7f8cdc10dc30 2024-08-31T05:33:19.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.462+0000 7f8cdbfff640 1 --2- 172.21.15.5:0/410557360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cdc10dc30 0x7f8cdc1a1d00 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f8cd400eb10 tx=0x7f8cd400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:19.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.462+0000 7f8cd8ff9640 1 -- 172.21.15.5:0/410557360 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd4004b20 con 0x7f8cdc10dc30 2024-08-31T05:33:19.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.462+0000 7f8ce200b640 1 -- 172.21.15.5:0/410557360 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cdc1a2720 con 0x7f8cdc10dc30 2024-08-31T05:33:19.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.462+0000 7f8cd8ff9640 1 -- 172.21.15.5:0/410557360 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8cd4004cc0 con 0x7f8cdc10dc30 2024-08-31T05:33:19.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.462+0000 7f8cd8ff9640 1 -- 172.21.15.5:0/410557360 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd4010670 con 0x7f8cdc10dc30 2024-08-31T05:33:19.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.462+0000 7f8ce200b640 1 -- 172.21.15.5:0/410557360 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cdc1a8e80 con 0x7f8cdc10dc30 2024-08-31T05:33:19.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.464+0000 7f8cd8ff9640 1 -- 172.21.15.5:0/410557360 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f8cd4010830 con 0x7f8cdc10dc30 2024-08-31T05:33:19.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.465+0000 7f8ce8580740 1 Processor -- start 2024-08-31T05:33:19.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.465+0000 7f8ce8580740 1 -- start start 2024-08-31T05:33:19.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.465+0000 7f8ce8580740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641f7f8d070 0x5641f83322c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:19.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.465+0000 7f8ce8580740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641f7f641b0 0x5641f8332800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:19.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.465+0000 7f8ce8580740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641f7f6c390 0x5641f8332d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:19.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.465+0000 7f8ce8580740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5641f82a9630 con 0x5641f7f6c390 2024-08-31T05:33:19.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.465+0000 7f8ce8580740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5641f8298bc0 con 0x5641f7f641b0 2024-08-31T05:33:19.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.465+0000 7f8ce8580740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5641f829cb70 con 0x5641f7f8d070 2024-08-31T05:33:19.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.465+0000 7f8cdaffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641f7f6c390 0x5641f8332d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:19.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.465+0000 7f8cdaffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641f7f6c390 0x5641f8332d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51166/0 (socket says 172.21.15.5:51166) 2024-08-31T05:33:19.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.465+0000 7f8cdaffd640 1 -- 172.21.15.5:0/2953540403 learned_addr learned my addr 172.21.15.5:0/2953540403 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:19.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.465+0000 7f8cd8ff9640 1 --2- 172.21.15.5:0/410557360 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f8cc40b4ca0 0x7f8cc40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:19.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.465+0000 7f8cdb7fe640 1 --2- 172.21.15.5:0/2953540403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641f7f641b0 0x5641f8332800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:19.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.465+0000 7f8cdaffd640 1 --2- 172.21.15.5:0/2953540403 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641f7f8d070 0x5641f83322c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:19.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.466+0000 7f8cdbfff640 1 --2- 172.21.15.5:0/410557360 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f8cc40b4ca0 0x7f8cc40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:19.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.466+0000 7f8cd8ff9640 1 -- 172.21.15.5:0/410557360 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f8cd40e5e90 con 0x7f8cdc10dc30 2024-08-31T05:33:19.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.466+0000 7f8cdb7fe640 1 -- 172.21.15.5:0/2953540403 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641f7f8d070 msgr2=0x5641f83322c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:19.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.466+0000 7f8cdb7fe640 1 --2- 172.21.15.5:0/2953540403 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641f7f8d070 0x5641f83322c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:19.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.466+0000 7f8cdb7fe640 1 -- 172.21.15.5:0/2953540403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641f7f6c390 msgr2=0x5641f8332d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:19.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.466+0000 7f8cdb7fe640 1 --2- 172.21.15.5:0/2953540403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641f7f6c390 0x5641f8332d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:19.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.466+0000 7f8cdb7fe640 1 -- 172.21.15.5:0/2953540403 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641f7ff8650 con 0x5641f7f641b0 2024-08-31T05:33:19.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.466+0000 7f8cdb7fe640 1 --2- 172.21.15.5:0/2953540403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641f7f641b0 0x5641f8332800 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc009c00 tx=0x7f8ccc011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0080f3d02236063 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:19.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.466+0000 7f8cdbfff640 1 --2- 172.21.15.5:0/410557360 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f8cc40b4ca0 0x7f8cc40b71b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8cd40e3310 tx=0x7f8cd4007840 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:19.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.466+0000 7f8cc1ffb640 1 -- 172.21.15.5:0/2953540403 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc004230 con 0x5641f7f641b0 2024-08-31T05:33:19.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.466+0000 7f8cc1ffb640 1 -- 172.21.15.5:0/2953540403 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ccc0043d0 con 0x5641f7f641b0 2024-08-31T05:33:19.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.466+0000 7f8cc1ffb640 1 -- 172.21.15.5:0/2953540403 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc004b90 con 0x5641f7f641b0 2024-08-31T05:33:19.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.467+0000 7f8ce8580740 1 -- 172.21.15.5:0/2953540403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641f7f641b0 msgr2=0x5641f8332800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:19.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.467+0000 7f8ce8580740 1 --2- 172.21.15.5:0/2953540403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641f7f641b0 0x5641f8332800 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc009c00 tx=0x7f8ccc011810 comp rx=0 tx=0).stop 2024-08-31T05:33:19.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.467+0000 7f8ce8580740 1 -- 172.21.15.5:0/2953540403 shutdown_connections 2024-08-31T05:33:19.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.467+0000 7f8ce8580740 1 --2- 172.21.15.5:0/2953540403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641f7f6c390 0x5641f8332d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:19.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.467+0000 7f8ce8580740 1 --2- 172.21.15.5:0/2953540403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641f7f641b0 0x5641f8332800 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:19.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.467+0000 7f8ce8580740 1 --2- 172.21.15.5:0/2953540403 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641f7f8d070 0x5641f83322c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:19.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.467+0000 7f8ce8580740 1 -- 172.21.15.5:0/2953540403 >> 172.21.15.5:0/2953540403 conn(0x5641f7f81460 msgr2=0x5641f83301b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:19.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.467+0000 7f8ce8580740 1 -- 172.21.15.5:0/2953540403 shutdown_connections 2024-08-31T05:33:19.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.467+0000 7f8ce8580740 1 -- 172.21.15.5:0/2953540403 wait complete. 2024-08-31T05:33:19.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.468+0000 7f8ce8580740 1 -- start start 2024-08-31T05:33:19.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.468+0000 7f8ce8580740 1 Processor -- start 2024-08-31T05:33:19.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.468+0000 7f8ce8580740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641f7f641b0 0x5641f833d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:19.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.468+0000 7f8ce8580740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641f7f6c390 0x5641f833dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:19.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.468+0000 7f8ce8580740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641f7f8d070 0x5641f8349dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:19.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.468+0000 7f8ce8580740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5641f80fb700 con 0x5641f7f641b0 2024-08-31T05:33:19.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.468+0000 7f8ce8580740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5641f821f700 con 0x5641f7f8d070 2024-08-31T05:33:19.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.468+0000 7f8ce8580740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5641f8340aa0 con 0x5641f7f6c390 2024-08-31T05:33:19.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.468+0000 7f8ce8580740 10 client.0 _ll_register_callbacks cb 0x5641f824edc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:33:19.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.468+0000 7f8cdaffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641f7f641b0 0x5641f833d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:19.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.468+0000 7f8cdb7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641f7f6c390 0x5641f833dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:19.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.468+0000 7f8cdaffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641f7f641b0 0x5641f833d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51182/0 (socket says 172.21.15.5:51182) 2024-08-31T05:33:19.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.468+0000 7f8cdaffd640 1 -- 172.21.15.5:0/1059210333 learned_addr learned my addr 172.21.15.5:0/1059210333 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:19.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.468+0000 7f8cdb7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641f7f6c390 0x5641f833dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:36298/0 (socket says 172.21.15.5:36298) 2024-08-31T05:33:19.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.469+0000 7f8cdaffd640 1 --2- 172.21.15.5:0/1059210333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641f7f8d070 0x5641f8349dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:19.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.469+0000 7f8cdb7fe640 1 -- 172.21.15.5:0/1059210333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641f7f8d070 msgr2=0x5641f8349dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:19.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.469+0000 7f8cdb7fe640 1 --2- 172.21.15.5:0/1059210333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641f7f8d070 0x5641f8349dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:19.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.469+0000 7f8cdb7fe640 1 -- 172.21.15.5:0/1059210333 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641f7f641b0 msgr2=0x5641f833d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:19.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.469+0000 7f8cdb7fe640 1 --2- 172.21.15.5:0/1059210333 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641f7f641b0 0x5641f833d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:19.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.469+0000 7f8cdb7fe640 1 -- 172.21.15.5:0/1059210333 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641f82588b0 con 0x5641f7f6c390 2024-08-31T05:33:19.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.469+0000 7f8cdaffd640 1 --2- 172.21.15.5:0/1059210333 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641f7f641b0 0x5641f833d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:19.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.469+0000 7f8cdb7fe640 1 --2- 172.21.15.5:0/1059210333 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641f7f6c390 0x5641f833dee0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc005890 tx=0x7f8ccc019ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a32dd1e29da8478b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:19.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.469+0000 7f8cbaffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:33:19.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.469+0000 7f8cbaffd640 1 -- 172.21.15.5:0/1059210333 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc028020 con 0x5641f7f6c390 2024-08-31T05:33:19.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.469+0000 7f8cbaffd640 1 -- 172.21.15.5:0/1059210333 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f8ccc024620 con 0x5641f7f6c390 2024-08-31T05:33:19.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.469+0000 7f8ce8580740 1 -- 172.21.15.5:0/1059210333 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ccc0043d0 con 0x5641f7f6c390 2024-08-31T05:33:19.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.469+0000 7f8cbaffd640 1 -- 172.21.15.5:0/1059210333 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f8ccc033050 con 0x5641f7f6c390 2024-08-31T05:33:19.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.469+0000 7f8ce8580740 10 client.26104 fetch_fsmap learned FSMap version 33 2024-08-31T05:33:19.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.469+0000 7f8ce8580740 1 -- 172.21.15.5:0/1059210333 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5641f834c810 con 0x5641f7f6c390 2024-08-31T05:33:19.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.470+0000 7f8cbaffd640 1 -- 172.21.15.5:0/1059210333 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ccc0043d0 con 0x5641f7f6c390 2024-08-31T05:33:19.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.470+0000 7f8cbaffd640 1 -- 172.21.15.5:0/1059210333 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 33) ==== 8374+0+0 (secure 0 0 0) 0x7f8ccc018070 con 0x5641f7f6c390 2024-08-31T05:33:19.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.470+0000 7f8ce8580740 10 client.26104 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T05:33:19.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.470+0000 7f8ce8580740 10 client.26104 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:33:19.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.470+0000 7f8ce8580740 20 client.26104 populate_metadata read hostname 'smithi005' 2024-08-31T05:33:19.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.470+0000 7f8ce8580740 1 --2- 172.21.15.5:0/1059210333 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5641f7f4b9f0 0x5641f834fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:19.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.470+0000 7f8ce8580740 4 client.26104 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:33:19.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.470+0000 7f8ce8580740 1 -- 172.21.15.5:0/1059210333 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5641f82ab580 con 0x5641f7f4b9f0 2024-08-31T05:33:19.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.470+0000 7f8cdaffd640 1 --2- 172.21.15.5:0/1059210333 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5641f7f4b9f0 0x5641f834fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:19.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.471+0000 7f8cdaffd640 1 --2- 172.21.15.5:0/1059210333 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5641f7f4b9f0 0x5641f834fc20 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dfd10d072c1c10bd server_cookie=d83a8350721f950e in_seq=0 out_seq=0 2024-08-31T05:33:19.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.471+0000 7f8cbaffd640 10 client.26104 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:33:19.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.471+0000 7f8cbaffd640 1 -- 172.21.15.5:0/1059210333 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5641f82ab580 con 0x5641f7f4b9f0 2024-08-31T05:33:19.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.471+0000 7f8cbaffd640 10 client.26104 handle_command_reply: tid=0 2024-08-31T05:33:19.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.471+0000 7f8ce8580740 1 client.26104 shutdown 2024-08-31T05:33:19.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.471+0000 7f8ce8580740 1 -- 172.21.15.5:0/1059210333 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641f7f6c390 msgr2=0x5641f833dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:19.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.471+0000 7f8ce8580740 1 --2- 172.21.15.5:0/1059210333 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641f7f6c390 0x5641f833dee0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc005890 tx=0x7f8ccc019ad0 comp rx=0 tx=0).stop 2024-08-31T05:33:19.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.471+0000 7f8ce8580740 1 -- 172.21.15.5:0/1059210333 shutdown_connections 2024-08-31T05:33:19.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.471+0000 7f8ce8580740 1 --2- 172.21.15.5:0/1059210333 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5641f7f4b9f0 0x5641f834fc20 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:19.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.471+0000 7f8ce8580740 1 --2- 172.21.15.5:0/1059210333 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641f7f8d070 0x5641f8349dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:19.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.471+0000 7f8ce8580740 1 --2- 172.21.15.5:0/1059210333 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641f7f6c390 0x5641f833dee0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:19.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.471+0000 7f8ce8580740 1 --2- 172.21.15.5:0/1059210333 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641f7f641b0 0x5641f833d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:19.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.471+0000 7f8ce8580740 1 -- 172.21.15.5:0/1059210333 >> 172.21.15.5:0/1059210333 conn(0x5641f7f81460 msgr2=0x5641f8335450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:19.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.472+0000 7f8cbaffd640 0 client.26104 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:33:19.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.472+0000 7f8ce8580740 1 -- 172.21.15.5:0/1059210333 shutdown_connections 2024-08-31T05:33:19.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.472+0000 7f8ce8580740 1 -- 172.21.15.5:0/1059210333 wait complete. 2024-08-31T05:33:19.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.472+0000 7f8ce8580740 20 client.26104 trim_cache size 0 max 16384 2024-08-31T05:33:19.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.489+0000 7f8ce8580740 1 Processor -- start 2024-08-31T05:33:19.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.489+0000 7f8ce8580740 1 -- start start 2024-08-31T05:33:19.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.490+0000 7f8ce8580740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641f7f641b0 0x5641f8333cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:19.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.490+0000 7f8ce8580740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641f7f6c390 0x5641f833f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:19.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.490+0000 7f8ce8580740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641f7f8d070 0x5641f832f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:19.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.490+0000 7f8ce8580740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8cdc1b2e50 con 0x5641f7f6c390 2024-08-31T05:33:19.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.490+0000 7f8ce8580740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8cdc1b49c0 con 0x5641f7f8d070 2024-08-31T05:33:19.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.490+0000 7f8ce8580740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8cdc1b3520 con 0x5641f7f641b0 2024-08-31T05:33:19.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.490+0000 7f8cdaffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641f7f641b0 0x5641f8333cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:19.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.490+0000 7f8cdaffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641f7f641b0 0x5641f8333cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:36300/0 (socket says 172.21.15.5:36300) 2024-08-31T05:33:19.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.490+0000 7f8cdaffd640 1 -- 172.21.15.5:0/870034756 learned_addr learned my addr 172.21.15.5:0/870034756 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:19.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.490+0000 7f8cdb7fe640 1 --2- 172.21.15.5:0/870034756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641f7f6c390 0x5641f833f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:19.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.490+0000 7f8cdaffd640 1 --2- 172.21.15.5:0/870034756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641f7f8d070 0x5641f832f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:19.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.490+0000 7f8cdaffd640 1 -- 172.21.15.5:0/870034756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641f7f8d070 msgr2=0x5641f832f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:19.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.490+0000 7f8cdaffd640 1 --2- 172.21.15.5:0/870034756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641f7f8d070 0x5641f832f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:19.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.490+0000 7f8cdaffd640 1 -- 172.21.15.5:0/870034756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641f7f6c390 msgr2=0x5641f833f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:19.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.490+0000 7f8cdaffd640 1 --2- 172.21.15.5:0/870034756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641f7f6c390 0x5641f833f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:19.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.490+0000 7f8cdaffd640 1 -- 172.21.15.5:0/870034756 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641f833ec60 con 0x5641f7f641b0 2024-08-31T05:33:19.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.490+0000 7f8cdaffd640 1 --2- 172.21.15.5:0/870034756 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641f7f641b0 0x5641f8333cb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0033000 tx=0x7f8cd0005780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a302e4089988f85b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:19.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.490+0000 7f8cc17fa640 1 -- 172.21.15.5:0/870034756 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd0035040 con 0x5641f7f641b0 2024-08-31T05:33:19.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.491+0000 7f8cc17fa640 1 -- 172.21.15.5:0/870034756 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8cd00035f0 con 0x5641f7f641b0 2024-08-31T05:33:19.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.491+0000 7f8cc17fa640 1 -- 172.21.15.5:0/870034756 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd004e650 con 0x5641f7f641b0 2024-08-31T05:33:19.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.491+0000 7f8ce8580740 1 -- 172.21.15.5:0/870034756 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641f7f641b0 msgr2=0x5641f8333cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:19.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.491+0000 7f8ce8580740 1 --2- 172.21.15.5:0/870034756 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641f7f641b0 0x5641f8333cb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0033000 tx=0x7f8cd0005780 comp rx=0 tx=0).stop 2024-08-31T05:33:19.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.491+0000 7f8ce8580740 1 -- 172.21.15.5:0/870034756 shutdown_connections 2024-08-31T05:33:19.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.491+0000 7f8ce8580740 1 --2- 172.21.15.5:0/870034756 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641f7f8d070 0x5641f832f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:19.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.491+0000 7f8ce8580740 1 --2- 172.21.15.5:0/870034756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641f7f6c390 0x5641f833f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:19.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.491+0000 7f8ce8580740 1 --2- 172.21.15.5:0/870034756 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641f7f641b0 0x5641f8333cb0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:19.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.491+0000 7f8ce8580740 1 -- 172.21.15.5:0/870034756 >> 172.21.15.5:0/870034756 conn(0x5641f7f81460 msgr2=0x5641f833eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:19.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.492+0000 7f8ce8580740 1 -- 172.21.15.5:0/870034756 shutdown_connections 2024-08-31T05:33:19.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.492+0000 7f8ce8580740 1 -- 172.21.15.5:0/870034756 wait complete. 2024-08-31T05:33:19.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.492+0000 7f8ce8580740 1 -- start start 2024-08-31T05:33:19.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.492+0000 7f8ce8580740 1 Processor -- start 2024-08-31T05:33:19.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.492+0000 7f8ce8580740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641f7f641b0 0x5641f83462e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:19.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.492+0000 7f8ce8580740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641f7f6c390 0x5641f8341790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:19.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.492+0000 7f8ce8580740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641f7f8d070 0x5641f8341cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:19.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.492+0000 7f8ce8580740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8cdc1b42c0 con 0x5641f7f8d070 2024-08-31T05:33:19.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.492+0000 7f8ce8580740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8cdc1b3bf0 con 0x5641f7f641b0 2024-08-31T05:33:19.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.492+0000 7f8ce8580740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8cdc1b0e30 con 0x5641f7f6c390 2024-08-31T05:33:19.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.492+0000 7f8ce8580740 10 client.0 _ll_register_callbacks cb 0x7f8ccc005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:33:19.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.493+0000 7f8cdaffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641f7f8d070 0x5641f8341cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:19.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.493+0000 7f8cdb7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641f7f6c390 0x5641f8341790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:19.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.493+0000 7f8cdb7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641f7f6c390 0x5641f8341790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:36304/0 (socket says 172.21.15.5:36304) 2024-08-31T05:33:19.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.493+0000 7f8cdb7fe640 1 -- 172.21.15.5:0/752114290 learned_addr learned my addr 172.21.15.5:0/752114290 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:19.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.493+0000 7f8cdaffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641f7f8d070 0x5641f8341cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51202/0 (socket says 172.21.15.5:51202) 2024-08-31T05:33:19.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.493+0000 7f8cdaffd640 1 --2- 172.21.15.5:0/752114290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641f7f641b0 0x5641f83462e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:19.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.493+0000 7f8cdb7fe640 1 -- 172.21.15.5:0/752114290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641f7f641b0 msgr2=0x5641f83462e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:19.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.493+0000 7f8cdb7fe640 1 --2- 172.21.15.5:0/752114290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641f7f641b0 0x5641f83462e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:19.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.493+0000 7f8cdb7fe640 1 -- 172.21.15.5:0/752114290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641f7f8d070 msgr2=0x5641f8341cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:19.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.493+0000 7f8cdb7fe640 1 --2- 172.21.15.5:0/752114290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641f7f8d070 0x5641f8341cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:19.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.493+0000 7f8cdb7fe640 1 -- 172.21.15.5:0/752114290 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641f8342240 con 0x5641f7f6c390 2024-08-31T05:33:19.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.493+0000 7f8cdb7fe640 1 --2- 172.21.15.5:0/752114290 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641f7f6c390 0x5641f8341790 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc009c00 tx=0x7f8ccc011e90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3eb8d59d36be1baa server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:19.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.493+0000 7f8cbaffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:33:19.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.493+0000 7f8cbaffd640 1 -- 172.21.15.5:0/752114290 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc028030 con 0x5641f7f6c390 2024-08-31T05:33:19.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.493+0000 7f8ce8580740 1 -- 172.21.15.5:0/752114290 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8cd00035f0 con 0x5641f7f6c390 2024-08-31T05:33:19.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.493+0000 7f8cbaffd640 1 -- 172.21.15.5:0/752114290 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f8ccc005bb0 con 0x5641f7f6c390 2024-08-31T05:33:19.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.493+0000 7f8cbaffd640 1 -- 172.21.15.5:0/752114290 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f8ccc0054f0 con 0x5641f7f6c390 2024-08-31T05:33:19.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.493+0000 7f8ce8580740 10 client.26110 fetch_fsmap learned FSMap version 33 2024-08-31T05:33:19.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.493+0000 7f8ce8580740 1 -- 172.21.15.5:0/752114290 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5641f83ba230 con 0x5641f7f6c390 2024-08-31T05:33:19.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.494+0000 7f8cbaffd640 1 -- 172.21.15.5:0/752114290 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8cd00035f0 con 0x5641f7f6c390 2024-08-31T05:33:19.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.494+0000 7f8cbaffd640 1 -- 172.21.15.5:0/752114290 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 33) ==== 8374+0+0 (secure 0 0 0) 0x7f8ccc018040 con 0x5641f7f6c390 2024-08-31T05:33:19.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.494+0000 7f8ce8580740 10 client.26110 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T05:33:19.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.494+0000 7f8ce8580740 10 client.26110 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:33:19.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.494+0000 7f8ce8580740 20 client.26110 populate_metadata read hostname 'smithi005' 2024-08-31T05:33:19.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.494+0000 7f8ce8580740 1 --2- 172.21.15.5:0/752114290 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5641f7f20da0 0x5641f83bc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:19.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.494+0000 7f8ce8580740 4 client.26110 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T05:33:19.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.494+0000 7f8ce8580740 1 -- 172.21.15.5:0/752114290 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5641f82a7020 con 0x5641f7f20da0 2024-08-31T05:33:19.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.494+0000 7f8cdaffd640 1 --2- 172.21.15.5:0/752114290 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5641f7f20da0 0x5641f83bc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:19.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.494+0000 7f8cdaffd640 1 --2- 172.21.15.5:0/752114290 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5641f7f20da0 0x5641f83bc950 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d35b589ad6de092 server_cookie=6f576f9c6d651331 in_seq=0 out_seq=0 2024-08-31T05:33:19.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.494+0000 7f8cbaffd640 10 client.26110 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:33:19.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.495+0000 7f8cbaffd640 1 -- 172.21.15.5:0/752114290 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1706 (crc 0 0 0) 0x5641f82a7020 con 0x5641f7f20da0 2024-08-31T05:33:19.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.495+0000 7f8cbaffd640 10 client.26110 handle_command_reply: tid=0 2024-08-31T05:33:19.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.495+0000 7f8ce8580740 1 client.26110 shutdown 2024-08-31T05:33:19.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.495+0000 7f8ce8580740 1 -- 172.21.15.5:0/752114290 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641f7f6c390 msgr2=0x5641f8341790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:19.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.495+0000 7f8ce8580740 1 --2- 172.21.15.5:0/752114290 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641f7f6c390 0x5641f8341790 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc009c00 tx=0x7f8ccc011e90 comp rx=0 tx=0).stop 2024-08-31T05:33:19.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.495+0000 7f8ce8580740 1 -- 172.21.15.5:0/752114290 shutdown_connections 2024-08-31T05:33:19.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.495+0000 7f8ce8580740 1 --2- 172.21.15.5:0/752114290 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5641f7f20da0 0x5641f83bc950 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:19.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.495+0000 7f8ce8580740 1 --2- 172.21.15.5:0/752114290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641f7f8d070 0x5641f8341cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:19.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.495+0000 7f8ce8580740 1 --2- 172.21.15.5:0/752114290 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641f7f6c390 0x5641f8341790 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:19.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.495+0000 7f8cbaffd640 0 client.26110 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:33:19.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.495+0000 7f8ce8580740 1 --2- 172.21.15.5:0/752114290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5641f7f641b0 0x5641f83462e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:19.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.495+0000 7f8ce8580740 1 -- 172.21.15.5:0/752114290 >> 172.21.15.5:0/752114290 conn(0x5641f7f81460 msgr2=0x5641f8333a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:19.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.495+0000 7f8ce8580740 1 -- 172.21.15.5:0/752114290 shutdown_connections 2024-08-31T05:33:19.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.495+0000 7f8ce8580740 1 -- 172.21.15.5:0/752114290 wait complete. 2024-08-31T05:33:19.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.495+0000 7f8ce8580740 20 client.26110 trim_cache size 0 max 16384 2024-08-31T05:33:19.503 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:33:19.503 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T05:33:19.503 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2024-08-31T05:33:19.503 INFO:teuthology.orchestra.run.smithi005.stdout: "2445fc42-b797-434f-b380-e2da985b4d98": { 2024-08-31T05:33:19.503 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:33:19.504 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "2445fc42-b797-434f-b380-e2da985b4d98", 2024-08-31T05:33:19.504 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2024-08-31T05:33:19.504 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:33:19.504 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:33:19.504 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_stats": { 2024-08-31T05:33:19.504 INFO:teuthology.orchestra.run.smithi005.stdout: "728a42ca-bbef-4151-830f-5fdd411d8fa0": { 2024-08-31T05:33:19.504 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:32:30.554906+0000", 2024-08-31T05:33:19.504 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:33:19.504 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:33:19.504 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:33:19.504 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:33:19.504 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:33:19.505 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:33:19.505 INFO:teuthology.orchestra.run.smithi005.stdout: "2445fc42-b797-434f-b380-e2da985b4d98": { 2024-08-31T05:33:19.505 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:33:17.681453+0000", 2024-08-31T05:33:19.505 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:33:19.505 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:33:19.505 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:33:19.505 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:33:19.505 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:33:19.505 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:33:19.505 INFO:teuthology.orchestra.run.smithi005.stdout: "cda92ac0-b35f-47a5-a3a5-471c888462a5": { 2024-08-31T05:33:19.505 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:53.103905+0000", 2024-08-31T05:33:19.505 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:33:19.505 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:33:19.506 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:33:19.506 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:33:19.506 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:33:19.506 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:33:19.506 INFO:teuthology.orchestra.run.smithi005.stdout: "ece37b07-9ab2-45f8-bc33-2755a07aac0b": { 2024-08-31T05:33:19.506 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:31:41.782407+0000", 2024-08-31T05:33:19.506 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:33:19.506 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:33:19.506 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:33:19.506 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:33:19.506 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:33:19.506 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:33:19.506 INFO:teuthology.orchestra.run.smithi005.stdout: "75d84398-5d9c-4872-b879-2fbce045fa71": { 2024-08-31T05:33:19.506 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:06.642335+0000", 2024-08-31T05:33:19.507 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:33:19.507 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:33:19.507 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:33:19.507 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:33:19.507 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:33:19.507 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:33:19.507 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:33:19.507 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:33:19.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.496+0000 7f8ce200b640 1 -- 172.21.15.5:0/410557360 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f8cc40b4ca0 msgr2=0x7f8cc40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:19.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.496+0000 7f8ce200b640 1 --2- 172.21.15.5:0/410557360 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f8cc40b4ca0 0x7f8cc40b71b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8cd40e3310 tx=0x7f8cd4007840 comp rx=0 tx=0).stop 2024-08-31T05:33:19.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.496+0000 7f8ce200b640 1 -- 172.21.15.5:0/410557360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cdc10dc30 msgr2=0x7f8cdc1a1d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:19.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.496+0000 7f8ce200b640 1 --2- 172.21.15.5:0/410557360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cdc10dc30 0x7f8cdc1a1d00 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f8cd400eb10 tx=0x7f8cd400c2d0 comp rx=0 tx=0).stop 2024-08-31T05:33:19.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.496+0000 7f8ce200b640 1 -- 172.21.15.5:0/410557360 shutdown_connections 2024-08-31T05:33:19.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.496+0000 7f8ce200b640 1 --2- 172.21.15.5:0/410557360 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f8cc40b4ca0 0x7f8cc40b71b0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:19.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.496+0000 7f8ce200b640 1 --2- 172.21.15.5:0/410557360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cdc10dc30 0x7f8cdc1a1d00 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:19.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.496+0000 7f8ce200b640 1 --2- 172.21.15.5:0/410557360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8cdc1050b0 0x7f8cdc19ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:19.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.496+0000 7f8ce200b640 1 --2- 172.21.15.5:0/410557360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8cdc104680 0x7f8cdc19c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:19.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.496+0000 7f8ce200b640 1 -- 172.21.15.5:0/410557360 >> 172.21.15.5:0/410557360 conn(0x7f8cdc079510 msgr2=0x7f8cdc100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:19.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.496+0000 7f8ce200b640 1 -- 172.21.15.5:0/410557360 shutdown_connections 2024-08-31T05:33:19.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:19.496+0000 7f8ce200b640 1 -- 172.21.15.5:0/410557360 wait complete. 2024-08-31T05:33:19.509 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:33:19 smithi005 ceph-mon[18602]: pgmap v445: 129 pgs: 129 active+clean; 159 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.9 MiB/s wr, 254 op/s 2024-08-31T05:33:19.509 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:33:19 smithi005 ceph-mon[18602]: scrub queued for path: / 2024-08-31T05:33:19.509 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:33:19 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:33:19.509 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:33:19 smithi005 ceph-mon[18602]: scrub summary: active paths [/] 2024-08-31T05:33:19.509 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:33:19 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:33:19.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:33:19 smithi070 ceph-mon[22316]: pgmap v445: 129 pgs: 129 active+clean; 159 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.9 MiB/s wr, 254 op/s 2024-08-31T05:33:19.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:33:19 smithi070 ceph-mon[22316]: scrub queued for path: / 2024-08-31T05:33:19.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:33:19 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:33:19.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:33:19 smithi070 ceph-mon[22316]: scrub summary: active paths [/] 2024-08-31T05:33:19.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:33:19 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:33:19.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:33:19 smithi050 ceph-mon[22146]: pgmap v445: 129 pgs: 129 active+clean; 159 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.9 MiB/s wr, 254 op/s 2024-08-31T05:33:19.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:33:19 smithi050 ceph-mon[22146]: scrub queued for path: / 2024-08-31T05:33:19.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:33:19 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:33:19.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:33:19 smithi050 ceph-mon[22146]: scrub summary: active paths [/] 2024-08-31T05:33:19.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:33:19 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:33:19.912 INFO:tasks.workunit.client.0.smithi005.stdout: 1 320382 13.17 MB/sec execute 7 sec latency 11.449 ms 2024-08-31T05:33:20.804 INFO:tasks.cephfs.filesystem:scrub status for tag:2445fc42-b797-434f-b380-e2da985b4d98 - {'path': '/', 'tag': '2445fc42-b797-434f-b380-e2da985b4d98', 'options': 'recursive,force'} 2024-08-31T05:33:20.912 INFO:tasks.workunit.client.0.smithi005.stdout: 1 323202 13.66 MB/sec execute 8 sec latency 17.251 ms 2024-08-31T05:33:21.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:33:21 smithi070 ceph-mon[22316]: pgmap v446: 129 pgs: 129 active+clean; 162 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.7 MiB/s wr, 325 op/s 2024-08-31T05:33:21.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:33:21 smithi050 ceph-mon[22146]: pgmap v446: 129 pgs: 129 active+clean; 162 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.7 MiB/s wr, 325 op/s 2024-08-31T05:33:21.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:33:21 smithi005 ceph-mon[18602]: pgmap v446: 129 pgs: 129 active+clean; 162 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.7 MiB/s wr, 325 op/s 2024-08-31T05:33:21.912 INFO:tasks.workunit.client.0.smithi005.stdout: 1 325572 13.37 MB/sec execute 9 sec latency 39.234 ms 2024-08-31T05:33:22.913 INFO:tasks.workunit.client.0.smithi005.stdout: 1 327521 13.05 MB/sec execute 10 sec latency 15.112 ms 2024-08-31T05:33:23.585 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:33:23 smithi070 ceph-mon[22316]: pgmap v447: 129 pgs: 129 active+clean; 165 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.9 MiB/s wr, 274 op/s 2024-08-31T05:33:23.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:33:23 smithi050 ceph-mon[22146]: pgmap v447: 129 pgs: 129 active+clean; 165 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.9 MiB/s wr, 274 op/s 2024-08-31T05:33:23.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:33:23 smithi005 ceph-mon[18602]: pgmap v447: 129 pgs: 129 active+clean; 165 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.9 MiB/s wr, 274 op/s 2024-08-31T05:33:23.913 INFO:tasks.workunit.client.0.smithi005.stdout: 1 330440 13.41 MB/sec execute 11 sec latency 7.383 ms 2024-08-31T05:33:24.913 INFO:tasks.workunit.client.0.smithi005.stdout: 1 333524 13.77 MB/sec execute 12 sec latency 11.849 ms 2024-08-31T05:33:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.384+0000 7f30c7e07640 1 -- 172.21.15.5:0/3862571851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30c01046f0 msgr2=0x7f30c0104b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.384+0000 7f30c7e07640 1 --2- 172.21.15.5:0/3862571851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30c01046f0 0x7f30c0104b00 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f30bc009900 tx=0x7f30bc02a410 comp rx=0 tx=0).stop 2024-08-31T05:33:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.384+0000 7f30c7e07640 1 -- 172.21.15.5:0/3862571851 shutdown_connections 2024-08-31T05:33:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.384+0000 7f30c7e07640 1 --2- 172.21.15.5:0/3862571851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30c010db50 0x7f30c0110040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.384+0000 7f30c7e07640 1 --2- 172.21.15.5:0/3862571851 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30c0105040 0x7f30c010d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.384+0000 7f30c7e07640 1 --2- 172.21.15.5:0/3862571851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30c01046f0 0x7f30c0104b00 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.384+0000 7f30c7e07640 1 -- 172.21.15.5:0/3862571851 >> 172.21.15.5:0/3862571851 conn(0x7f30c007a4b0 msgr2=0x7f30c007a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.384+0000 7f30c7e07640 1 -- 172.21.15.5:0/3862571851 shutdown_connections 2024-08-31T05:33:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.384+0000 7f30c7e07640 1 -- 172.21.15.5:0/3862571851 wait complete. 2024-08-31T05:33:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.385+0000 7f30c7e07640 1 Processor -- start 2024-08-31T05:33:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.385+0000 7f30c7e07640 1 -- start start 2024-08-31T05:33:25.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.385+0000 7f30c7e07640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30c01046f0 0x7f30c019a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:25.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.385+0000 7f30c7e07640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30c0105040 0x7f30c019a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:25.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.385+0000 7f30c7e07640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30c010db50 0x7f30c019f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:25.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.385+0000 7f30c7e07640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f30c01137c0 con 0x7f30c010db50 2024-08-31T05:33:25.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.385+0000 7f30c7e07640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f30c0113640 con 0x7f30c01046f0 2024-08-31T05:33:25.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.385+0000 7f30c7e07640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f30c0113940 con 0x7f30c0105040 2024-08-31T05:33:25.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.385+0000 7f30c53a2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30c0105040 0x7f30c019a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:25.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.385+0000 7f30c5ba3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30c01046f0 0x7f30c019a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:25.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.385+0000 7f30c63a4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30c010db50 0x7f30c019f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:25.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.385+0000 7f30c53a2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30c0105040 0x7f30c019a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:60654/0 (socket says 172.21.15.5:60654) 2024-08-31T05:33:25.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.385+0000 7f30c53a2640 1 -- 172.21.15.5:0/1475500852 learned_addr learned my addr 172.21.15.5:0/1475500852 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:25.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.385+0000 7f30c5ba3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30c01046f0 0x7f30c019a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:42060/0 (socket says 172.21.15.5:42060) 2024-08-31T05:33:25.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.386+0000 7f30c63a4640 1 -- 172.21.15.5:0/1475500852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30c0105040 msgr2=0x7f30c019a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:25.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.386+0000 7f30c63a4640 1 --2- 172.21.15.5:0/1475500852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30c0105040 0x7f30c019a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:25.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.386+0000 7f30c63a4640 1 -- 172.21.15.5:0/1475500852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30c01046f0 msgr2=0x7f30c019a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:25.391 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.386+0000 7f30c63a4640 1 --2- 172.21.15.5:0/1475500852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30c01046f0 0x7f30c019a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:25.391 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.386+0000 7f30c63a4640 1 -- 172.21.15.5:0/1475500852 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30c01a00f0 con 0x7f30c010db50 2024-08-31T05:33:25.391 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.386+0000 7f30c53a2640 1 --2- 172.21.15.5:0/1475500852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30c0105040 0x7f30c019a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:25.391 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.386+0000 7f30c5ba3640 1 --2- 172.21.15.5:0/1475500852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30c01046f0 0x7f30c019a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:25.391 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.386+0000 7f30c63a4640 1 --2- 172.21.15.5:0/1475500852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30c010db50 0x7f30c019f9f0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f30b8009fd0 tx=0x7f30b800ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:25.391 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.386+0000 7f30b6ffd640 1 -- 172.21.15.5:0/1475500852 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b800ce20 con 0x7f30c010db50 2024-08-31T05:33:25.391 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.386+0000 7f30c7e07640 1 -- 172.21.15.5:0/1475500852 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30c01a03e0 con 0x7f30c010db50 2024-08-31T05:33:25.391 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.386+0000 7f30b6ffd640 1 -- 172.21.15.5:0/1475500852 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30b8005020 con 0x7f30c010db50 2024-08-31T05:33:25.391 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.386+0000 7f30b6ffd640 1 -- 172.21.15.5:0/1475500852 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b8010690 con 0x7f30c010db50 2024-08-31T05:33:25.391 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.386+0000 7f30c7e07640 1 -- 172.21.15.5:0/1475500852 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30c01a6b70 con 0x7f30c010db50 2024-08-31T05:33:25.397 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.389+0000 7f30cee4e740 1 Processor -- start 2024-08-31T05:33:25.397 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.389+0000 7f30b6ffd640 1 -- 172.21.15.5:0/1475500852 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f30b8010830 con 0x7f30c010db50 2024-08-31T05:33:25.397 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.389+0000 7f30cee4e740 1 -- start start 2024-08-31T05:33:25.397 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.389+0000 7f30cee4e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f5a90f1b0 0x562f5acb2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:25.397 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.390+0000 7f30cee4e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562f5a8e62f0 0x562f5acb3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:25.397 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.390+0000 7f30cee4e740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562f5a8ee4d0 0x562f5acb3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:25.397 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.390+0000 7f30cee4e740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x562f5ac28000 con 0x562f5a8ee4d0 2024-08-31T05:33:25.397 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.390+0000 7f30cee4e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562f5ac17590 con 0x562f5a8e62f0 2024-08-31T05:33:25.398 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.390+0000 7f30cee4e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562f5ac1b540 con 0x562f5a90f1b0 2024-08-31T05:33:25.398 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.390+0000 7f30c53a2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f5a90f1b0 0x562f5acb2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:25.398 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.390+0000 7f30c5ba3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562f5a8e62f0 0x562f5acb3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:25.398 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.390+0000 7f30c53a2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f5a90f1b0 0x562f5acb2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:60668/0 (socket says 172.21.15.5:60668) 2024-08-31T05:33:25.398 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.390+0000 7f30c5ba3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562f5a8e62f0 0x562f5acb3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:42074/0 (socket says 172.21.15.5:42074) 2024-08-31T05:33:25.398 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.390+0000 7f30c53a2640 1 -- 172.21.15.5:0/3030776790 learned_addr learned my addr 172.21.15.5:0/3030776790 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:25.398 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.390+0000 7f30c53a2640 1 --2- 172.21.15.5:0/3030776790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562f5a8ee4d0 0x562f5acb3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:25.398 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.390+0000 7f30b6ffd640 1 --2- 172.21.15.5:0/1475500852 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f30ac0b4ca0 0x7f30ac0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:25.398 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.390+0000 7f30c5ba3640 1 -- 172.21.15.5:0/3030776790 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f5a90f1b0 msgr2=0x562f5acb2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:25.398 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.390+0000 7f30c5ba3640 1 --2- 172.21.15.5:0/3030776790 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f5a90f1b0 0x562f5acb2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:25.398 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.390+0000 7f30c5ba3640 1 -- 172.21.15.5:0/3030776790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562f5a8ee4d0 msgr2=0x562f5acb3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:25.398 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.390+0000 7f30c5ba3640 1 --2- 172.21.15.5:0/3030776790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562f5a8ee4d0 0x562f5acb3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.390+0000 7f30c5ba3640 1 -- 172.21.15.5:0/3030776790 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f5a97a790 con 0x562f5a8e62f0 2024-08-31T05:33:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.390+0000 7f30c53a2640 1 --2- 172.21.15.5:0/3030776790 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f5a90f1b0 0x562f5acb2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.390+0000 7f30c63a4640 1 --2- 172.21.15.5:0/1475500852 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f30ac0b4ca0 0x7f30ac0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.390+0000 7f30c5ba3640 1 --2- 172.21.15.5:0/3030776790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562f5a8e62f0 0x562f5acb3220 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f30bc006010 tx=0x7f30bc005e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf2899eb0882d1d9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.390+0000 7f30b6ffd640 1 -- 172.21.15.5:0/1475500852 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f30b80e5fb0 con 0x7f30c010db50 2024-08-31T05:33:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.391+0000 7f30abfff640 1 -- 172.21.15.5:0/3030776790 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30bc035040 con 0x562f5a8e62f0 2024-08-31T05:33:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.391+0000 7f30abfff640 1 -- 172.21.15.5:0/3030776790 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30bc031720 con 0x562f5a8e62f0 2024-08-31T05:33:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.391+0000 7f30abfff640 1 -- 172.21.15.5:0/3030776790 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30bc004770 con 0x562f5a8e62f0 2024-08-31T05:33:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.391+0000 7f30cee4e740 1 -- 172.21.15.5:0/3030776790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562f5a8e62f0 msgr2=0x562f5acb3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.391+0000 7f30cee4e740 1 --2- 172.21.15.5:0/3030776790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562f5a8e62f0 0x562f5acb3220 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f30bc006010 tx=0x7f30bc005e20 comp rx=0 tx=0).stop 2024-08-31T05:33:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.391+0000 7f30c63a4640 1 --2- 172.21.15.5:0/1475500852 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f30ac0b4ca0 0x7f30ac0b71b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f30b80a9530 tx=0x7f30b80784c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.391+0000 7f30cee4e740 1 -- 172.21.15.5:0/3030776790 shutdown_connections 2024-08-31T05:33:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.392+0000 7f30cee4e740 1 --2- 172.21.15.5:0/3030776790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562f5a8ee4d0 0x562f5acb3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:25.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.392+0000 7f30cee4e740 1 --2- 172.21.15.5:0/3030776790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562f5a8e62f0 0x562f5acb3220 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:25.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.392+0000 7f30cee4e740 1 --2- 172.21.15.5:0/3030776790 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f5a90f1b0 0x562f5acb2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:25.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.392+0000 7f30cee4e740 1 -- 172.21.15.5:0/3030776790 >> 172.21.15.5:0/3030776790 conn(0x562f5a903300 msgr2=0x562f5acb0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:25.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.392+0000 7f30cee4e740 1 -- 172.21.15.5:0/3030776790 shutdown_connections 2024-08-31T05:33:25.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.392+0000 7f30cee4e740 1 -- 172.21.15.5:0/3030776790 wait complete. 2024-08-31T05:33:25.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.392+0000 7f30cee4e740 1 -- start start 2024-08-31T05:33:25.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.392+0000 7f30cee4e740 1 Processor -- start 2024-08-31T05:33:25.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.393+0000 7f30cee4e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562f5a8e62f0 0x562f5acbe920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:25.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.393+0000 7f30cee4e740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562f5a8ee4d0 0x562f5acbee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:25.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.393+0000 7f30cee4e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f5a90f1b0 0x562f5acca750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:25.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.393+0000 7f30cee4e740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x562f5ab50ab0 con 0x562f5a8ee4d0 2024-08-31T05:33:25.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.393+0000 7f30cee4e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562f5ab9e680 con 0x562f5a8e62f0 2024-08-31T05:33:25.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.393+0000 7f30cee4e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562f5acc1400 con 0x562f5a90f1b0 2024-08-31T05:33:25.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.393+0000 7f30cee4e740 10 client.0 _ll_register_callbacks cb 0x562f5a926a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:33:25.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.393+0000 7f30c5ba3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562f5a8ee4d0 0x562f5acbee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:25.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.393+0000 7f30c53a2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562f5a8e62f0 0x562f5acbe920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:25.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.393+0000 7f30c53a2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562f5a8e62f0 0x562f5acbe920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:42078/0 (socket says 172.21.15.5:42078) 2024-08-31T05:33:25.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.393+0000 7f30c53a2640 1 -- 172.21.15.5:0/911861755 learned_addr learned my addr 172.21.15.5:0/911861755 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:25.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.393+0000 7f30c53a2640 1 --2- 172.21.15.5:0/911861755 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f5a90f1b0 0x562f5acca750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:25.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.393+0000 7f30c5ba3640 1 -- 172.21.15.5:0/911861755 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f5a90f1b0 msgr2=0x562f5acca750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:25.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.393+0000 7f30c5ba3640 1 --2- 172.21.15.5:0/911861755 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f5a90f1b0 0x562f5acca750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:25.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.393+0000 7f30c5ba3640 1 -- 172.21.15.5:0/911861755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562f5a8e62f0 msgr2=0x562f5acbe920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:25.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.393+0000 7f30c5ba3640 1 --2- 172.21.15.5:0/911861755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562f5a8e62f0 0x562f5acbe920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:25.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.393+0000 7f30c5ba3640 1 -- 172.21.15.5:0/911861755 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f5a9f3620 con 0x562f5a8ee4d0 2024-08-31T05:33:25.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.393+0000 7f30c53a2640 1 --2- 172.21.15.5:0/911861755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562f5a8e62f0 0x562f5acbe920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:25.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.393+0000 7f30c5ba3640 1 --2- 172.21.15.5:0/911861755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562f5a8ee4d0 0x562f5acbee60 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f30bc006010 tx=0x7f30bc005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62465468e5878cc1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:25.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.393+0000 7f30a97fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:33:25.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.393+0000 7f30a97fa640 1 -- 172.21.15.5:0/911861755 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30bc04c070 con 0x562f5a8ee4d0 2024-08-31T05:33:25.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.393+0000 7f30a97fa640 1 -- 172.21.15.5:0/911861755 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f30bc004040 con 0x562f5a8ee4d0 2024-08-31T05:33:25.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.393+0000 7f30cee4e740 1 -- 172.21.15.5:0/911861755 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30bc031720 con 0x562f5a8ee4d0 2024-08-31T05:33:25.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.394+0000 7f30a97fa640 1 -- 172.21.15.5:0/911861755 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f30bc058050 con 0x562f5a8ee4d0 2024-08-31T05:33:25.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.394+0000 7f30cee4e740 10 client.16518 fetch_fsmap learned FSMap version 33 2024-08-31T05:33:25.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.394+0000 7f30cee4e740 1 -- 172.21.15.5:0/911861755 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x562f5accd470 con 0x562f5a8ee4d0 2024-08-31T05:33:25.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.394+0000 7f30a97fa640 1 -- 172.21.15.5:0/911861755 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30bc031720 con 0x562f5a8ee4d0 2024-08-31T05:33:25.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.394+0000 7f30a97fa640 1 -- 172.21.15.5:0/911861755 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 33) ==== 8374+0+0 (secure 0 0 0) 0x7f30bc0042d0 con 0x562f5a8ee4d0 2024-08-31T05:33:25.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.394+0000 7f30cee4e740 10 client.16518 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T05:33:25.403 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.394+0000 7f30cee4e740 10 client.16518 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:33:25.403 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.394+0000 7f30cee4e740 20 client.16518 populate_metadata read hostname 'smithi005' 2024-08-31T05:33:25.403 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.394+0000 7f30cee4e740 1 --2- 172.21.15.5:0/911861755 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x562f5a8cdd80 0x562f5acd07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:25.403 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.394+0000 7f30cee4e740 4 client.16518 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:33:25.403 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.394+0000 7f30cee4e740 1 -- 172.21.15.5:0/911861755 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562f5ac29f50 con 0x562f5a8cdd80 2024-08-31T05:33:25.403 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.394+0000 7f30c53a2640 1 --2- 172.21.15.5:0/911861755 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x562f5a8cdd80 0x562f5acd07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:25.403 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.395+0000 7f30c53a2640 1 --2- 172.21.15.5:0/911861755 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x562f5a8cdd80 0x562f5acd07d0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=adf549c6cdad78b server_cookie=dee6cad38884926a in_seq=0 out_seq=0 2024-08-31T05:33:25.403 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.395+0000 7f30a97fa640 10 client.16518 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:33:25.404 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.395+0000 7f30a97fa640 1 -- 172.21.15.5:0/911861755 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562f5ac29f50 con 0x562f5a8cdd80 2024-08-31T05:33:25.404 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.395+0000 7f30a97fa640 10 client.16518 handle_command_reply: tid=0 2024-08-31T05:33:25.404 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.395+0000 7f30cee4e740 1 client.16518 shutdown 2024-08-31T05:33:25.404 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.395+0000 7f30cee4e740 1 -- 172.21.15.5:0/911861755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562f5a8ee4d0 msgr2=0x562f5acbee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.395+0000 7f30cee4e740 1 --2- 172.21.15.5:0/911861755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562f5a8ee4d0 0x562f5acbee60 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f30bc006010 tx=0x7f30bc005780 comp rx=0 tx=0).stop 2024-08-31T05:33:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.396+0000 7f30cee4e740 1 -- 172.21.15.5:0/911861755 shutdown_connections 2024-08-31T05:33:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.396+0000 7f30cee4e740 1 --2- 172.21.15.5:0/911861755 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x562f5a8cdd80 0x562f5acd07d0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.396+0000 7f30cee4e740 1 --2- 172.21.15.5:0/911861755 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f5a90f1b0 0x562f5acca750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.396+0000 7f30cee4e740 1 --2- 172.21.15.5:0/911861755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562f5a8ee4d0 0x562f5acbee60 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.396+0000 7f30cee4e740 1 --2- 172.21.15.5:0/911861755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562f5a8e62f0 0x562f5acbe920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.396+0000 7f30a97fa640 0 client.16518 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:33:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.396+0000 7f30cee4e740 1 -- 172.21.15.5:0/911861755 >> 172.21.15.5:0/911861755 conn(0x562f5a903300 msgr2=0x562f5acb3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.396+0000 7f30cee4e740 1 -- 172.21.15.5:0/911861755 shutdown_connections 2024-08-31T05:33:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.396+0000 7f30cee4e740 1 -- 172.21.15.5:0/911861755 wait complete. 2024-08-31T05:33:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.396+0000 7f30cee4e740 20 client.16518 trim_cache size 0 max 16384 2024-08-31T05:33:25.415 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.413+0000 7f30cee4e740 1 Processor -- start 2024-08-31T05:33:25.415 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.413+0000 7f30cee4e740 1 -- start start 2024-08-31T05:33:25.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.413+0000 7f30cee4e740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562f5a8e62f0 0x562f5acbcf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:25.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.413+0000 7f30cee4e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562f5a8ee4d0 0x562f5acbd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:25.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.413+0000 7f30cee4e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f5a90f1b0 0x562f5acb7e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:25.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.413+0000 7f30cee4e740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f30c01b0ae0 con 0x562f5a8e62f0 2024-08-31T05:33:25.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.413+0000 7f30cee4e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f30c01b2650 con 0x562f5a8ee4d0 2024-08-31T05:33:25.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.413+0000 7f30cee4e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f30c01b11b0 con 0x562f5a90f1b0 2024-08-31T05:33:25.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.413+0000 7f30c53a2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562f5a8e62f0 0x562f5acbcf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:25.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.413+0000 7f30c5ba3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562f5a8ee4d0 0x562f5acbd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:25.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.413+0000 7f30c5ba3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562f5a8ee4d0 0x562f5acbd4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:42088/0 (socket says 172.21.15.5:42088) 2024-08-31T05:33:25.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.413+0000 7f30c5ba3640 1 -- 172.21.15.5:0/775744673 learned_addr learned my addr 172.21.15.5:0/775744673 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:25.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.414+0000 7f30c53a2640 1 --2- 172.21.15.5:0/775744673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f5a90f1b0 0x562f5acb7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:25.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.414+0000 7f30c5ba3640 1 -- 172.21.15.5:0/775744673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f5a90f1b0 msgr2=0x562f5acb7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:25.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.414+0000 7f30c5ba3640 1 --2- 172.21.15.5:0/775744673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f5a90f1b0 0x562f5acb7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:25.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.414+0000 7f30c5ba3640 1 -- 172.21.15.5:0/775744673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562f5a8e62f0 msgr2=0x562f5acbcf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:25.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.414+0000 7f30c5ba3640 1 --2- 172.21.15.5:0/775744673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562f5a8e62f0 0x562f5acbcf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:25.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.414+0000 7f30c5ba3640 1 -- 172.21.15.5:0/775744673 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f5acb1940 con 0x562f5a8ee4d0 2024-08-31T05:33:25.418 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.414+0000 7f30c53a2640 1 --2- 172.21.15.5:0/775744673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f5a90f1b0 0x562f5acb7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:33:25.418 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.414+0000 7f30c5ba3640 1 --2- 172.21.15.5:0/775744673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562f5a8ee4d0 0x562f5acbd4b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f30bc009800 tx=0x7f30bc032ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b32d9f5c23bee993 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:25.418 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.414+0000 7f30ab7fe640 1 -- 172.21.15.5:0/775744673 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30bc055070 con 0x562f5a8ee4d0 2024-08-31T05:33:25.418 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.414+0000 7f30ab7fe640 1 -- 172.21.15.5:0/775744673 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30bc0316a0 con 0x562f5a8ee4d0 2024-08-31T05:33:25.418 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.414+0000 7f30ab7fe640 1 -- 172.21.15.5:0/775744673 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30bc04c050 con 0x562f5a8ee4d0 2024-08-31T05:33:25.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.415+0000 7f30cee4e740 1 -- 172.21.15.5:0/775744673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562f5a8ee4d0 msgr2=0x562f5acbd4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:25.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.415+0000 7f30cee4e740 1 --2- 172.21.15.5:0/775744673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562f5a8ee4d0 0x562f5acbd4b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f30bc009800 tx=0x7f30bc032ed0 comp rx=0 tx=0).stop 2024-08-31T05:33:25.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.415+0000 7f30cee4e740 1 -- 172.21.15.5:0/775744673 shutdown_connections 2024-08-31T05:33:25.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.415+0000 7f30cee4e740 1 --2- 172.21.15.5:0/775744673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f5a90f1b0 0x562f5acb7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:25.421 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.415+0000 7f30cee4e740 1 --2- 172.21.15.5:0/775744673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562f5a8ee4d0 0x562f5acbd4b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:25.421 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.415+0000 7f30cee4e740 1 --2- 172.21.15.5:0/775744673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562f5a8e62f0 0x562f5acbcf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:25.421 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.415+0000 7f30cee4e740 1 -- 172.21.15.5:0/775744673 >> 172.21.15.5:0/775744673 conn(0x562f5a903300 msgr2=0x562f5acb9810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:25.421 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.416+0000 7f30cee4e740 1 -- 172.21.15.5:0/775744673 shutdown_connections 2024-08-31T05:33:25.421 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.416+0000 7f30cee4e740 1 -- 172.21.15.5:0/775744673 wait complete. 2024-08-31T05:33:25.421 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.416+0000 7f30cee4e740 1 -- start start 2024-08-31T05:33:25.421 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.416+0000 7f30cee4e740 1 Processor -- start 2024-08-31T05:33:25.421 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.417+0000 7f30cee4e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f5a8e62f0 0x562f5ad36c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:25.421 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.417+0000 7f30cee4e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562f5a8ee4d0 0x562f5ad330e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:25.421 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.417+0000 7f30cee4e740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562f5a90f1b0 0x562f5ad33640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:25.421 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.417+0000 7f30cee4e740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f30c01b1f50 con 0x562f5a90f1b0 2024-08-31T05:33:25.421 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.417+0000 7f30cee4e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f30c01b1880 con 0x562f5a8ee4d0 2024-08-31T05:33:25.421 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.417+0000 7f30cee4e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f30c01aeac0 con 0x562f5a8e62f0 2024-08-31T05:33:25.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.417+0000 7f30cee4e740 10 client.0 _ll_register_callbacks cb 0x7f30b0011720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:33:25.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.417+0000 7f30c5ba3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562f5a8ee4d0 0x562f5ad330e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:25.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.417+0000 7f30c53a2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f5a8e62f0 0x562f5ad36c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:25.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.417+0000 7f30c5ba3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562f5a8ee4d0 0x562f5ad330e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:42102/0 (socket says 172.21.15.5:42102) 2024-08-31T05:33:25.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.417+0000 7f30c53a2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f5a8e62f0 0x562f5ad36c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:60692/0 (socket says 172.21.15.5:60692) 2024-08-31T05:33:25.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.417+0000 7f30c5ba3640 1 -- 172.21.15.5:0/154694103 learned_addr learned my addr 172.21.15.5:0/154694103 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:25.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.417+0000 7f30c53a2640 1 --2- 172.21.15.5:0/154694103 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562f5a90f1b0 0x562f5ad33640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:25.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.417+0000 7f30c5ba3640 1 -- 172.21.15.5:0/154694103 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f5a8e62f0 msgr2=0x562f5ad36c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:25.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.417+0000 7f30c5ba3640 1 --2- 172.21.15.5:0/154694103 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f5a8e62f0 0x562f5ad36c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:25.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.417+0000 7f30c5ba3640 1 -- 172.21.15.5:0/154694103 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562f5a90f1b0 msgr2=0x562f5ad33640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:25.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.417+0000 7f30c5ba3640 1 --2- 172.21.15.5:0/154694103 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562f5a90f1b0 0x562f5ad33640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:25.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.417+0000 7f30c5ba3640 1 -- 172.21.15.5:0/154694103 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f5ad33dd0 con 0x562f5a8ee4d0 2024-08-31T05:33:25.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.418+0000 7f30c5ba3640 1 --2- 172.21.15.5:0/154694103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562f5a8ee4d0 0x562f5ad330e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f30bc0035f0 tx=0x7f30bc02ab80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac61c5ebdc8db83b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:25.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.418+0000 7f30a97fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:33:25.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.418+0000 7f30a97fa640 1 -- 172.21.15.5:0/154694103 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30bc063070 con 0x562f5a8ee4d0 2024-08-31T05:33:25.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.418+0000 7f30a97fa640 1 -- 172.21.15.5:0/154694103 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f30bc004b80 con 0x562f5a8ee4d0 2024-08-31T05:33:25.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.418+0000 7f30cee4e740 1 -- 172.21.15.5:0/154694103 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30bc0316a0 con 0x562f5a8ee4d0 2024-08-31T05:33:25.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.418+0000 7f30a97fa640 1 -- 172.21.15.5:0/154694103 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f30bc071050 con 0x562f5a8ee4d0 2024-08-31T05:33:25.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.418+0000 7f30cee4e740 10 client.26114 fetch_fsmap learned FSMap version 33 2024-08-31T05:33:25.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.418+0000 7f30cee4e740 1 -- 172.21.15.5:0/154694103 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x562f5acc6660 con 0x562f5a8ee4d0 2024-08-31T05:33:25.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.419+0000 7f30a97fa640 1 -- 172.21.15.5:0/154694103 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30bc0316a0 con 0x562f5a8ee4d0 2024-08-31T05:33:25.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.419+0000 7f30a97fa640 1 -- 172.21.15.5:0/154694103 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 33) ==== 8374+0+0 (secure 0 0 0) 0x7f30bc068460 con 0x562f5a8ee4d0 2024-08-31T05:33:25.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.419+0000 7f30cee4e740 10 client.26114 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T05:33:25.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.419+0000 7f30cee4e740 10 client.26114 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:33:25.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.419+0000 7f30cee4e740 20 client.26114 populate_metadata read hostname 'smithi005' 2024-08-31T05:33:25.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.419+0000 7f30cee4e740 1 --2- 172.21.15.5:0/154694103 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x562f5a8a31c0 0x562f5acc6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:25.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.419+0000 7f30cee4e740 4 client.26114 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:33:25.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.419+0000 7f30cee4e740 1 -- 172.21.15.5:0/154694103 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562f5ac259f0 con 0x562f5a8a31c0 2024-08-31T05:33:25.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.419+0000 7f30c53a2640 1 --2- 172.21.15.5:0/154694103 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x562f5a8a31c0 0x562f5acc6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:25.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.420+0000 7f30a97fa640 10 client.26114 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:33:25.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.420+0000 7f30c53a2640 1 --2- 172.21.15.5:0/154694103 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x562f5a8a31c0 0x562f5acc6e70 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afad99369d97eea5 server_cookie=8b77b1069031d9fb in_seq=0 out_seq=0 2024-08-31T05:33:25.434 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.431+0000 7f30a97fa640 1 -- 172.21.15.5:0/154694103 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562f5ac259f0 con 0x562f5a8a31c0 2024-08-31T05:33:25.434 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.431+0000 7f30a97fa640 10 client.26114 handle_command_reply: tid=0 2024-08-31T05:33:25.434 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.431+0000 7f30cee4e740 1 client.26114 shutdown 2024-08-31T05:33:25.434 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.431+0000 7f30cee4e740 1 -- 172.21.15.5:0/154694103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562f5a8ee4d0 msgr2=0x562f5ad330e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:25.434 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.431+0000 7f30cee4e740 1 --2- 172.21.15.5:0/154694103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562f5a8ee4d0 0x562f5ad330e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f30bc0035f0 tx=0x7f30bc02ab80 comp rx=0 tx=0).stop 2024-08-31T05:33:25.434 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.431+0000 7f30cee4e740 1 -- 172.21.15.5:0/154694103 shutdown_connections 2024-08-31T05:33:25.434 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.431+0000 7f30cee4e740 1 --2- 172.21.15.5:0/154694103 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x562f5a8a31c0 0x562f5acc6e70 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:25.434 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.431+0000 7f30cee4e740 1 --2- 172.21.15.5:0/154694103 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562f5a90f1b0 0x562f5ad33640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:25.434 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.431+0000 7f30cee4e740 1 --2- 172.21.15.5:0/154694103 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562f5a8ee4d0 0x562f5ad330e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:25.434 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.431+0000 7f30cee4e740 1 --2- 172.21.15.5:0/154694103 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f5a8e62f0 0x562f5ad36c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:25.435 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.431+0000 7f30a97fa640 0 client.26114 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:33:25.435 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.431+0000 7f30cee4e740 1 -- 172.21.15.5:0/154694103 >> 172.21.15.5:0/154694103 conn(0x562f5a903300 msgr2=0x562f5acb7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:25.435 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.432+0000 7f30cee4e740 1 -- 172.21.15.5:0/154694103 shutdown_connections 2024-08-31T05:33:25.435 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.432+0000 7f30cee4e740 1 -- 172.21.15.5:0/154694103 wait complete. 2024-08-31T05:33:25.435 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.432+0000 7f30cee4e740 20 client.26114 trim_cache size 0 max 16384 2024-08-31T05:33:25.435 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:33:25.435 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:33:25.435 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:33:25.435 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:33:25.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.432+0000 7f30c7e07640 1 -- 172.21.15.5:0/1475500852 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f30ac0b4ca0 msgr2=0x7f30ac0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:25.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.432+0000 7f30c7e07640 1 --2- 172.21.15.5:0/1475500852 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f30ac0b4ca0 0x7f30ac0b71b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f30b80a9530 tx=0x7f30b80784c0 comp rx=0 tx=0).stop 2024-08-31T05:33:25.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.432+0000 7f30c7e07640 1 -- 172.21.15.5:0/1475500852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30c010db50 msgr2=0x7f30c019f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:25.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.432+0000 7f30c7e07640 1 --2- 172.21.15.5:0/1475500852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30c010db50 0x7f30c019f9f0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f30b8009fd0 tx=0x7f30b800ef10 comp rx=0 tx=0).stop 2024-08-31T05:33:25.437 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.432+0000 7f30c7e07640 1 -- 172.21.15.5:0/1475500852 shutdown_connections 2024-08-31T05:33:25.437 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.432+0000 7f30c7e07640 1 --2- 172.21.15.5:0/1475500852 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f30ac0b4ca0 0x7f30ac0b71b0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:25.437 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.432+0000 7f30c7e07640 1 --2- 172.21.15.5:0/1475500852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30c010db50 0x7f30c019f9f0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:25.437 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.432+0000 7f30c7e07640 1 --2- 172.21.15.5:0/1475500852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30c0105040 0x7f30c019a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:25.437 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.432+0000 7f30c7e07640 1 --2- 172.21.15.5:0/1475500852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f30c01046f0 0x7f30c019a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:25.437 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.432+0000 7f30c7e07640 1 -- 172.21.15.5:0/1475500852 >> 172.21.15.5:0/1475500852 conn(0x7f30c007a4b0 msgr2=0x7f30c01075d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:25.437 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.432+0000 7f30c7e07640 1 -- 172.21.15.5:0/1475500852 shutdown_connections 2024-08-31T05:33:25.437 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:25.432+0000 7f30c7e07640 1 -- 172.21.15.5:0/1475500852 wait complete. 2024-08-31T05:33:25.585 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:33:25 smithi070 ceph-mon[22316]: pgmap v448: 129 pgs: 129 active+clean; 164 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.5 MiB/s wr, 236 op/s 2024-08-31T05:33:25.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:33:25 smithi050 ceph-mon[22146]: pgmap v448: 129 pgs: 129 active+clean; 164 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.5 MiB/s wr, 236 op/s 2024-08-31T05:33:25.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:33:25 smithi005 ceph-mon[18602]: pgmap v448: 129 pgs: 129 active+clean; 164 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.5 MiB/s wr, 236 op/s 2024-08-31T05:33:25.913 INFO:tasks.workunit.client.0.smithi005.stdout: 1 335869 13.37 MB/sec execute 13 sec latency 16.651 ms 2024-08-31T05:33:26.913 INFO:tasks.workunit.client.0.smithi005.stdout: 1 337711 13.29 MB/sec execute 14 sec latency 66.022 ms 2024-08-31T05:33:27.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:33:27 smithi070 ceph-mon[22316]: pgmap v449: 129 pgs: 129 active+clean; 171 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.8 MiB/s wr, 329 op/s 2024-08-31T05:33:27.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:33:27 smithi050 ceph-mon[22146]: pgmap v449: 129 pgs: 129 active+clean; 171 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.8 MiB/s wr, 329 op/s 2024-08-31T05:33:27.913 INFO:tasks.workunit.client.0.smithi005.stdout: 1 340641 13.57 MB/sec execute 15 sec latency 18.190 ms 2024-08-31T05:33:28.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:33:28 smithi070 ceph-mon[22316]: scrub summary: idle 2024-08-31T05:33:28.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:33:28 smithi070 ceph-mon[22316]: scrub summary: idle 2024-08-31T05:33:28.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:33:28 smithi050 ceph-mon[22146]: scrub summary: idle 2024-08-31T05:33:28.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:33:28 smithi050 ceph-mon[22146]: scrub summary: idle 2024-08-31T05:33:28.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:33:27 smithi005 ceph-mon[18602]: pgmap v449: 129 pgs: 129 active+clean; 171 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.8 MiB/s wr, 329 op/s 2024-08-31T05:33:28.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:33:28 smithi005 ceph-mon[18602]: scrub summary: idle 2024-08-31T05:33:28.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:33:28 smithi005 ceph-mon[18602]: scrub summary: idle 2024-08-31T05:33:28.913 INFO:tasks.workunit.client.0.smithi005.stdout: 1 342942 13.25 MB/sec execute 16 sec latency 13.140 ms 2024-08-31T05:33:29.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:33:29 smithi070 ceph-mon[22316]: pgmap v450: 129 pgs: 129 active+clean; 172 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.4 MiB/s wr, 246 op/s 2024-08-31T05:33:29.665 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:33:29 smithi050 ceph-mon[22146]: pgmap v450: 129 pgs: 129 active+clean; 172 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.4 MiB/s wr, 246 op/s 2024-08-31T05:33:29.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:33:29 smithi005 ceph-mon[18602]: pgmap v450: 129 pgs: 129 active+clean; 172 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.4 MiB/s wr, 246 op/s 2024-08-31T05:33:29.913 INFO:tasks.workunit.client.0.smithi005.stdout: 1 345011 13.23 MB/sec execute 17 sec latency 15.686 ms 2024-08-31T05:33:30.913 INFO:tasks.workunit.client.0.smithi005.stdout: 1 347985 13.51 MB/sec execute 18 sec latency 50.938 ms 2024-08-31T05:33:31.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:33:31 smithi070 ceph-mon[22316]: pgmap v451: 129 pgs: 129 active+clean; 175 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.5 MiB/s wr, 308 op/s 2024-08-31T05:33:31.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:33:31 smithi050 ceph-mon[22146]: pgmap v451: 129 pgs: 129 active+clean; 175 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.5 MiB/s wr, 308 op/s 2024-08-31T05:33:31.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:33:31 smithi005 ceph-mon[18602]: pgmap v451: 129 pgs: 129 active+clean; 175 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.5 MiB/s wr, 308 op/s 2024-08-31T05:33:31.913 INFO:tasks.workunit.client.0.smithi005.stdout: 1 350541 13.46 MB/sec execute 19 sec latency 54.067 ms 2024-08-31T05:33:32.913 INFO:tasks.workunit.client.0.smithi005.stdout: 1 352345 13.22 MB/sec execute 20 sec latency 49.624 ms 2024-08-31T05:33:33.585 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:33:33 smithi070 ceph-mon[22316]: pgmap v452: 129 pgs: 129 active+clean; 175 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.7 MiB/s wr, 238 op/s 2024-08-31T05:33:33.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:33:33 smithi050 ceph-mon[22146]: pgmap v452: 129 pgs: 129 active+clean; 175 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.7 MiB/s wr, 238 op/s 2024-08-31T05:33:33.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:33:33 smithi005 ceph-mon[18602]: pgmap v452: 129 pgs: 129 active+clean; 175 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.7 MiB/s wr, 238 op/s 2024-08-31T05:33:33.913 INFO:tasks.workunit.client.0.smithi005.stdout: 1 355267 13.40 MB/sec execute 21 sec latency 13.710 ms 2024-08-31T05:33:34.913 INFO:tasks.workunit.client.0.smithi005.stdout: 1 358340 13.59 MB/sec execute 22 sec latency 14.211 ms 2024-08-31T05:33:35.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:33:35 smithi070 ceph-mon[22316]: pgmap v453: 129 pgs: 129 active+clean; 178 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.6 MiB/s wr, 246 op/s 2024-08-31T05:33:35.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:33:35 smithi050 ceph-mon[22146]: pgmap v453: 129 pgs: 129 active+clean; 178 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.6 MiB/s wr, 246 op/s 2024-08-31T05:33:35.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:33:35 smithi005 ceph-mon[18602]: pgmap v453: 129 pgs: 129 active+clean; 178 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.6 MiB/s wr, 246 op/s 2024-08-31T05:33:35.913 INFO:tasks.workunit.client.0.smithi005.stdout: 1 360740 13.40 MB/sec execute 23 sec latency 16.687 ms 2024-08-31T05:33:36.913 INFO:tasks.workunit.client.0.smithi005.stdout: 1 363009 13.40 MB/sec execute 24 sec latency 11.120 ms 2024-08-31T05:33:37.585 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:33:37 smithi070 ceph-mon[22316]: pgmap v454: 129 pgs: 129 active+clean; 183 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.6 MiB/s wr, 325 op/s 2024-08-31T05:33:37.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:33:37 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:33:37.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:33:37 smithi050 ceph-mon[22146]: pgmap v454: 129 pgs: 129 active+clean; 183 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.6 MiB/s wr, 325 op/s 2024-08-31T05:33:37.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:33:37 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:33:37.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:33:37 smithi005 ceph-mon[18602]: pgmap v454: 129 pgs: 129 active+clean; 183 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.6 MiB/s wr, 325 op/s 2024-08-31T05:33:37.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:33:37 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:33:37.913 INFO:tasks.workunit.client.0.smithi005.stdout: 1 365565 13.54 MB/sec execute 25 sec latency 62.699 ms 2024-08-31T05:33:38.537 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.532+0000 7f137c594640 1 -- 172.21.15.5:0/3421753858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1374108090 msgr2=0x7f13741084a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:38.537 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.532+0000 7f137c594640 1 --2- 172.21.15.5:0/3421753858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1374108090 0x7f13741084a0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f1364009900 tx=0x7f136402a410 comp rx=0 tx=0).stop 2024-08-31T05:33:38.537 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.532+0000 7f137c594640 1 -- 172.21.15.5:0/3421753858 shutdown_connections 2024-08-31T05:33:38.537 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.532+0000 7f137c594640 1 --2- 172.21.15.5:0/3421753858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13741089e0 0x7f137410f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:38.537 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.532+0000 7f137c594640 1 --2- 172.21.15.5:0/3421753858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1374108090 0x7f13741084a0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:38.537 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.533+0000 7f137c594640 1 --2- 172.21.15.5:0/3421753858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1374102760 0x7f1374102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:38.537 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.533+0000 7f137c594640 1 -- 172.21.15.5:0/3421753858 >> 172.21.15.5:0/3421753858 conn(0x7f13740fe160 msgr2=0x7f13741005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:38.537 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.533+0000 7f137c594640 1 -- 172.21.15.5:0/3421753858 shutdown_connections 2024-08-31T05:33:38.538 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.533+0000 7f137c594640 1 -- 172.21.15.5:0/3421753858 wait complete. 2024-08-31T05:33:38.538 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.533+0000 7f137c594640 1 Processor -- start 2024-08-31T05:33:38.538 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.533+0000 7f137c594640 1 -- start start 2024-08-31T05:33:38.538 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.534+0000 7f137c594640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1374102760 0x7f137419b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:38.538 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.534+0000 7f137c594640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1374108090 0x7f137419b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:38.538 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.534+0000 7f137c594640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13741089e0 0x7f137419bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:38.538 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.534+0000 7f137c594640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1374112650 con 0x7f1374102760 2024-08-31T05:33:38.538 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.534+0000 7f137c594640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f13741124d0 con 0x7f13741089e0 2024-08-31T05:33:38.538 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.534+0000 7f137c594640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f13741127d0 con 0x7f1374108090 2024-08-31T05:33:38.538 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.534+0000 7f137a330640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1374102760 0x7f137419b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:38.538 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.534+0000 7f137a330640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1374102760 0x7f137419b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36990/0 (socket says 172.21.15.5:36990) 2024-08-31T05:33:38.538 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.534+0000 7f137a330640 1 -- 172.21.15.5:0/695283675 learned_addr learned my addr 172.21.15.5:0/695283675 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:38.538 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.534+0000 7f1379b2f640 1 --2- 172.21.15.5:0/695283675 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1374108090 0x7f137419b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:38.539 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.534+0000 7f137ab31640 1 --2- 172.21.15.5:0/695283675 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13741089e0 0x7f137419bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:38.539 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.534+0000 7f137a330640 1 -- 172.21.15.5:0/695283675 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1374108090 msgr2=0x7f137419b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:38.539 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.534+0000 7f137a330640 1 --2- 172.21.15.5:0/695283675 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1374108090 0x7f137419b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:38.539 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.534+0000 7f137a330640 1 -- 172.21.15.5:0/695283675 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13741089e0 msgr2=0x7f137419bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:38.539 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.534+0000 7f137a330640 1 --2- 172.21.15.5:0/695283675 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13741089e0 0x7f137419bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:38.539 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.534+0000 7f137a330640 1 -- 172.21.15.5:0/695283675 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13741a62d0 con 0x7f1374102760 2024-08-31T05:33:38.539 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.534+0000 7f137a330640 1 --2- 172.21.15.5:0/695283675 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1374102760 0x7f137419b040 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f137000e9f0 tx=0x7f137000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:38.539 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.534+0000 7f136b7fe640 1 -- 172.21.15.5:0/695283675 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f137000ccc0 con 0x7f1374102760 2024-08-31T05:33:38.539 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.534+0000 7f136b7fe640 1 -- 172.21.15.5:0/695283675 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13700108e0 con 0x7f1374102760 2024-08-31T05:33:38.539 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.534+0000 7f136b7fe640 1 -- 172.21.15.5:0/695283675 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1370018880 con 0x7f1374102760 2024-08-31T05:33:38.539 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.534+0000 7f137c594640 1 -- 172.21.15.5:0/695283675 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13741a65c0 con 0x7f1374102760 2024-08-31T05:33:38.539 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.535+0000 7f137c594640 1 -- 172.21.15.5:0/695283675 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13741a6ae0 con 0x7f1374102760 2024-08-31T05:33:38.542 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.537+0000 7f13835da740 1 Processor -- start 2024-08-31T05:33:38.542 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.537+0000 7f13835da740 1 -- start start 2024-08-31T05:33:38.542 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.537+0000 7f136b7fe640 1 -- 172.21.15.5:0/695283675 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f1370010430 con 0x7f1374102760 2024-08-31T05:33:38.542 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.538+0000 7f13835da740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55df0ace41b0 0x55df0b087ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:38.542 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.538+0000 7f13835da740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55df0acbb2f0 0x55df0b088000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:38.542 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.538+0000 7f13835da740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df0acc34d0 0x55df0b088540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:38.542 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.538+0000 7f13835da740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55df0affd000 con 0x55df0acc34d0 2024-08-31T05:33:38.542 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.538+0000 7f13835da740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55df0afec590 con 0x55df0acbb2f0 2024-08-31T05:33:38.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.538+0000 7f13835da740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55df0aff0540 con 0x55df0ace41b0 2024-08-31T05:33:38.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.538+0000 7f137ab31640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55df0ace41b0 0x55df0b087ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:38.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.538+0000 7f137a330640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55df0acbb2f0 0x55df0b088000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:38.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.538+0000 7f137ab31640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55df0ace41b0 0x55df0b087ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:34162/0 (socket says 172.21.15.5:34162) 2024-08-31T05:33:38.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.538+0000 7f137ab31640 1 -- 172.21.15.5:0/573187920 learned_addr learned my addr 172.21.15.5:0/573187920 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:38.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.538+0000 7f1379b2f640 1 --2- 172.21.15.5:0/573187920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df0acc34d0 0x55df0b088540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:38.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.538+0000 7f137ab31640 1 -- 172.21.15.5:0/573187920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55df0acbb2f0 msgr2=0x55df0b088000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:38.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.538+0000 7f137ab31640 1 --2- 172.21.15.5:0/573187920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55df0acbb2f0 0x55df0b088000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:38.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.538+0000 7f137ab31640 1 -- 172.21.15.5:0/573187920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df0acc34d0 msgr2=0x55df0b088540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:38.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.538+0000 7f137ab31640 1 --2- 172.21.15.5:0/573187920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df0acc34d0 0x55df0b088540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:38.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.538+0000 7f137ab31640 1 -- 172.21.15.5:0/573187920 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df0ad4f790 con 0x55df0ace41b0 2024-08-31T05:33:38.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.538+0000 7f137ab31640 1 --2- 172.21.15.5:0/573187920 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55df0ace41b0 0x55df0b087ac0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f136c011470 tx=0x7f136c011930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=597ce576c7879bca server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:38.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.538+0000 7f136b7fe640 1 --2- 172.21.15.5:0/695283675 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f13600b4ca0 0x7f13600b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:38.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.538+0000 7f1368bfe640 1 -- 172.21.15.5:0/573187920 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f136c01e070 con 0x55df0ace41b0 2024-08-31T05:33:38.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.539+0000 7f1368bfe640 1 -- 172.21.15.5:0/573187920 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f136c003c30 con 0x55df0ace41b0 2024-08-31T05:33:38.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.539+0000 7f137a330640 1 --2- 172.21.15.5:0/695283675 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f13600b4ca0 0x7f13600b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:38.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.539+0000 7f1368bfe640 1 -- 172.21.15.5:0/573187920 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f136c00f980 con 0x55df0ace41b0 2024-08-31T05:33:38.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.539+0000 7f136b7fe640 1 -- 172.21.15.5:0/695283675 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f13700e5d10 con 0x7f1374102760 2024-08-31T05:33:38.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.539+0000 7f13835da740 1 -- 172.21.15.5:0/573187920 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55df0ace41b0 msgr2=0x55df0b087ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:38.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.539+0000 7f137a330640 1 --2- 172.21.15.5:0/695283675 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f13600b4ca0 0x7f13600b71b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f13700e3190 tx=0x7f13700e9860 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:38.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.539+0000 7f13835da740 1 --2- 172.21.15.5:0/573187920 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55df0ace41b0 0x55df0b087ac0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f136c011470 tx=0x7f136c011930 comp rx=0 tx=0).stop 2024-08-31T05:33:38.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.539+0000 7f13835da740 1 -- 172.21.15.5:0/573187920 shutdown_connections 2024-08-31T05:33:38.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.539+0000 7f13835da740 1 --2- 172.21.15.5:0/573187920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df0acc34d0 0x55df0b088540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:38.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.539+0000 7f13835da740 1 --2- 172.21.15.5:0/573187920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55df0acbb2f0 0x55df0b088000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:38.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.539+0000 7f13835da740 1 --2- 172.21.15.5:0/573187920 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55df0ace41b0 0x55df0b087ac0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:38.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.540+0000 7f13835da740 1 -- 172.21.15.5:0/573187920 >> 172.21.15.5:0/573187920 conn(0x55df0acd8300 msgr2=0x55df0b0859b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:38.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.540+0000 7f13835da740 1 -- 172.21.15.5:0/573187920 shutdown_connections 2024-08-31T05:33:38.545 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.540+0000 7f13835da740 1 -- 172.21.15.5:0/573187920 wait complete. 2024-08-31T05:33:38.545 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.540+0000 7f13835da740 1 -- start start 2024-08-31T05:33:38.545 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.540+0000 7f13835da740 1 Processor -- start 2024-08-31T05:33:38.548 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.541+0000 7f13835da740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df0acbb2f0 0x55df0b093670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:38.548 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.541+0000 7f13835da740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55df0acc34d0 0x55df0b093bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:38.548 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.541+0000 7f13835da740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55df0ace41b0 0x55df0b09f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:38.548 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.541+0000 7f13835da740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55df0af25ab0 con 0x55df0acbb2f0 2024-08-31T05:33:38.548 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.541+0000 7f13835da740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55df0af73680 con 0x55df0acc34d0 2024-08-31T05:33:38.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.541+0000 7f13835da740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55df0b096240 con 0x55df0ace41b0 2024-08-31T05:33:38.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.541+0000 7f137ab31640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df0acbb2f0 0x55df0b093670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:38.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.541+0000 7f137ab31640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df0acbb2f0 0x55df0b093670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37000/0 (socket says 172.21.15.5:37000) 2024-08-31T05:33:38.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.541+0000 7f1379b2f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55df0acc34d0 0x55df0b093bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:38.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.541+0000 7f137ab31640 1 -- 172.21.15.5:0/265558303 learned_addr learned my addr 172.21.15.5:0/265558303 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:38.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.541+0000 7f13835da740 10 client.0 _ll_register_callbacks cb 0x55df0acfba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:33:38.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.541+0000 7f137ab31640 1 --2- 172.21.15.5:0/265558303 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55df0ace41b0 0x55df0b09f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:38.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.541+0000 7f137ab31640 1 -- 172.21.15.5:0/265558303 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55df0ace41b0 msgr2=0x55df0b09f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:38.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.541+0000 7f137ab31640 1 --2- 172.21.15.5:0/265558303 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55df0ace41b0 0x55df0b09f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:38.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.541+0000 7f137ab31640 1 -- 172.21.15.5:0/265558303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55df0acc34d0 msgr2=0x55df0b093bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:38.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.541+0000 7f137ab31640 1 --2- 172.21.15.5:0/265558303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55df0acc34d0 0x55df0b093bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:38.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.541+0000 7f137ab31640 1 -- 172.21.15.5:0/265558303 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df0adc8620 con 0x55df0acbb2f0 2024-08-31T05:33:38.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.541+0000 7f1379b2f640 1 --2- 172.21.15.5:0/265558303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55df0acc34d0 0x55df0b093bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:38.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.541+0000 7f137ab31640 1 --2- 172.21.15.5:0/265558303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df0acbb2f0 0x55df0b093670 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f136c011440 tx=0x7f136c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95f9f9a5c504815e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:38.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.541+0000 7f135dffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:33:38.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.541+0000 7f135dffb640 1 -- 172.21.15.5:0/265558303 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f136c01e040 con 0x55df0acbb2f0 2024-08-31T05:33:38.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.541+0000 7f135dffb640 1 -- 172.21.15.5:0/265558303 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f136c003de0 con 0x55df0acbb2f0 2024-08-31T05:33:38.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.541+0000 7f13835da740 1 -- 172.21.15.5:0/265558303 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f136c003c30 con 0x55df0acbb2f0 2024-08-31T05:33:38.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.542+0000 7f135dffb640 1 -- 172.21.15.5:0/265558303 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f136c004a40 con 0x55df0acbb2f0 2024-08-31T05:33:38.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.542+0000 7f13835da740 10 client.16536 fetch_fsmap learned FSMap version 33 2024-08-31T05:33:38.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.542+0000 7f13835da740 1 -- 172.21.15.5:0/265558303 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55df0b0a2290 con 0x55df0acbb2f0 2024-08-31T05:33:38.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.542+0000 7f135dffb640 1 -- 172.21.15.5:0/265558303 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f136c003c30 con 0x55df0acbb2f0 2024-08-31T05:33:38.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.542+0000 7f135dffb640 1 -- 172.21.15.5:0/265558303 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 33) ==== 8374+0+0 (secure 0 0 0) 0x7f136c005020 con 0x55df0acbb2f0 2024-08-31T05:33:38.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.542+0000 7f13835da740 10 client.16536 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T05:33:38.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.542+0000 7f13835da740 10 client.16536 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:33:38.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.542+0000 7f13835da740 20 client.16536 populate_metadata read hostname 'smithi005' 2024-08-31T05:33:38.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.542+0000 7f13835da740 1 --2- 172.21.15.5:0/265558303 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55df0aca2d80 0x55df0b0a5650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:38.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.542+0000 7f13835da740 4 client.16536 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:33:38.551 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.542+0000 7f13835da740 1 -- 172.21.15.5:0/265558303 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55df0affef50 con 0x55df0aca2d80 2024-08-31T05:33:38.551 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.542+0000 7f1379b2f640 1 --2- 172.21.15.5:0/265558303 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55df0aca2d80 0x55df0b0a5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:38.551 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.543+0000 7f1379b2f640 1 --2- 172.21.15.5:0/265558303 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55df0aca2d80 0x55df0b0a5650 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=431e1e3dd02f81b8 server_cookie=9aefafb1f03349ec in_seq=0 out_seq=0 2024-08-31T05:33:38.551 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.543+0000 7f135dffb640 10 client.16536 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:33:38.551 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.543+0000 7f135dffb640 1 -- 172.21.15.5:0/265558303 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55df0affef50 con 0x55df0aca2d80 2024-08-31T05:33:38.551 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.543+0000 7f135dffb640 10 client.16536 handle_command_reply: tid=0 2024-08-31T05:33:38.551 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.543+0000 7f13835da740 1 client.16536 shutdown 2024-08-31T05:33:38.551 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.543+0000 7f13835da740 1 -- 172.21.15.5:0/265558303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df0acbb2f0 msgr2=0x55df0b093670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:38.551 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.543+0000 7f13835da740 1 --2- 172.21.15.5:0/265558303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df0acbb2f0 0x55df0b093670 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f136c011440 tx=0x7f136c014000 comp rx=0 tx=0).stop 2024-08-31T05:33:38.551 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.543+0000 7f13835da740 1 -- 172.21.15.5:0/265558303 shutdown_connections 2024-08-31T05:33:38.551 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.543+0000 7f13835da740 1 --2- 172.21.15.5:0/265558303 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55df0aca2d80 0x55df0b0a5650 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:38.551 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.543+0000 7f13835da740 1 --2- 172.21.15.5:0/265558303 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55df0ace41b0 0x55df0b09f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:38.551 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.543+0000 7f13835da740 1 --2- 172.21.15.5:0/265558303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55df0acc34d0 0x55df0b093bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:38.551 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.543+0000 7f135dffb640 0 client.16536 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:33:38.552 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.544+0000 7f13835da740 1 --2- 172.21.15.5:0/265558303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df0acbb2f0 0x55df0b093670 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:38.552 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.544+0000 7f13835da740 1 -- 172.21.15.5:0/265558303 >> 172.21.15.5:0/265558303 conn(0x55df0acd8300 msgr2=0x55df0b088af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:38.552 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.544+0000 7f13835da740 1 -- 172.21.15.5:0/265558303 shutdown_connections 2024-08-31T05:33:38.552 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.544+0000 7f13835da740 1 -- 172.21.15.5:0/265558303 wait complete. 2024-08-31T05:33:38.552 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.544+0000 7f13835da740 20 client.16536 trim_cache size 0 max 16384 2024-08-31T05:33:38.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.559+0000 7f13835da740 1 Processor -- start 2024-08-31T05:33:38.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.559+0000 7f13835da740 1 -- start start 2024-08-31T05:33:38.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.559+0000 7f13835da740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55df0acbb2f0 0x55df0b08cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:38.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.559+0000 7f13835da740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df0acc34d0 0x55df0b08d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:38.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.559+0000 7f13835da740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55df0ace41b0 0x55df0b090630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:38.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.559+0000 7f13835da740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f13741b0c70 con 0x55df0acc34d0 2024-08-31T05:33:38.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.559+0000 7f13835da740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f13741b27e0 con 0x55df0acbb2f0 2024-08-31T05:33:38.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.559+0000 7f13835da740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f13741b1340 con 0x55df0ace41b0 2024-08-31T05:33:38.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.559+0000 7f1379b2f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df0acc34d0 0x55df0b08d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:38.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.559+0000 7f1379b2f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df0acc34d0 0x55df0b08d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37002/0 (socket says 172.21.15.5:37002) 2024-08-31T05:33:38.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.559+0000 7f1379b2f640 1 -- 172.21.15.5:0/2886810607 learned_addr learned my addr 172.21.15.5:0/2886810607 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:38.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.560+0000 7f137ab31640 1 --2- 172.21.15.5:0/2886810607 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55df0ace41b0 0x55df0b090630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:38.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.560+0000 7f137ab31640 1 --2- 172.21.15.5:0/2886810607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55df0acbb2f0 0x55df0b08cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:38.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.560+0000 7f1379b2f640 1 -- 172.21.15.5:0/2886810607 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55df0ace41b0 msgr2=0x55df0b090630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:38.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.560+0000 7f1379b2f640 1 --2- 172.21.15.5:0/2886810607 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55df0ace41b0 0x55df0b090630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:38.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.560+0000 7f1379b2f640 1 -- 172.21.15.5:0/2886810607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55df0acbb2f0 msgr2=0x55df0b08cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:38.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.560+0000 7f1379b2f640 1 --2- 172.21.15.5:0/2886810607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55df0acbb2f0 0x55df0b08cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:38.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.560+0000 7f1379b2f640 1 -- 172.21.15.5:0/2886810607 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df0b089dc0 con 0x55df0acc34d0 2024-08-31T05:33:38.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.560+0000 7f1379b2f640 1 --2- 172.21.15.5:0/2886810607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df0acc34d0 0x55df0b08d130 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f1364009230 tx=0x7f1364031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb78e3552d4996c5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:38.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.560+0000 7f135ffff640 1 -- 172.21.15.5:0/2886810607 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1364035040 con 0x55df0acc34d0 2024-08-31T05:33:38.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.560+0000 7f135ffff640 1 -- 172.21.15.5:0/2886810607 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13640054f0 con 0x55df0acc34d0 2024-08-31T05:33:38.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.560+0000 7f135ffff640 1 -- 172.21.15.5:0/2886810607 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1364004cb0 con 0x55df0acc34d0 2024-08-31T05:33:38.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.561+0000 7f13835da740 1 -- 172.21.15.5:0/2886810607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df0acc34d0 msgr2=0x55df0b08d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:38.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.561+0000 7f13835da740 1 --2- 172.21.15.5:0/2886810607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df0acc34d0 0x55df0b08d130 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f1364009230 tx=0x7f1364031400 comp rx=0 tx=0).stop 2024-08-31T05:33:38.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.561+0000 7f13835da740 1 -- 172.21.15.5:0/2886810607 shutdown_connections 2024-08-31T05:33:38.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.561+0000 7f13835da740 1 --2- 172.21.15.5:0/2886810607 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55df0ace41b0 0x55df0b090630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:38.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.561+0000 7f13835da740 1 --2- 172.21.15.5:0/2886810607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df0acc34d0 0x55df0b08d130 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:38.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.561+0000 7f13835da740 1 --2- 172.21.15.5:0/2886810607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55df0acbb2f0 0x55df0b08cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:38.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.561+0000 7f13835da740 1 -- 172.21.15.5:0/2886810607 >> 172.21.15.5:0/2886810607 conn(0x55df0acd8300 msgr2=0x55df0b08e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:38.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.561+0000 7f13835da740 1 -- 172.21.15.5:0/2886810607 shutdown_connections 2024-08-31T05:33:38.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.561+0000 7f13835da740 1 -- 172.21.15.5:0/2886810607 wait complete. 2024-08-31T05:33:38.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.561+0000 7f13835da740 1 -- start start 2024-08-31T05:33:38.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.561+0000 7f13835da740 1 Processor -- start 2024-08-31T05:33:38.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.562+0000 7f13835da740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df0acbb2f0 0x55df0b09bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:38.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.562+0000 7f13835da740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55df0acc34d0 0x55df0b0990f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:38.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.562+0000 7f13835da740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55df0ace41b0 0x55df0b099630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:38.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.562+0000 7f13835da740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f13741b20e0 con 0x55df0acbb2f0 2024-08-31T05:33:38.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.562+0000 7f13835da740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f13741b1a10 con 0x55df0acc34d0 2024-08-31T05:33:38.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.562+0000 7f13835da740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f13741aec50 con 0x55df0ace41b0 2024-08-31T05:33:38.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.562+0000 7f13835da740 10 client.0 _ll_register_callbacks cb 0x7f136c01c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:33:38.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.562+0000 7f137ab31640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df0acbb2f0 0x55df0b09bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:38.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.562+0000 7f137ab31640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df0acbb2f0 0x55df0b09bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37014/0 (socket says 172.21.15.5:37014) 2024-08-31T05:33:38.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.562+0000 7f137ab31640 1 -- 172.21.15.5:0/1564633595 learned_addr learned my addr 172.21.15.5:0/1564633595 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:38.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.562+0000 7f1379b2f640 1 --2- 172.21.15.5:0/1564633595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55df0acc34d0 0x55df0b0990f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:38.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.562+0000 7f137ab31640 1 --2- 172.21.15.5:0/1564633595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55df0ace41b0 0x55df0b099630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:38.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.562+0000 7f137ab31640 1 -- 172.21.15.5:0/1564633595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55df0ace41b0 msgr2=0x55df0b099630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:38.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.562+0000 7f137ab31640 1 --2- 172.21.15.5:0/1564633595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55df0ace41b0 0x55df0b099630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:38.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.562+0000 7f137ab31640 1 -- 172.21.15.5:0/1564633595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55df0acc34d0 msgr2=0x55df0b0990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:38.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.562+0000 7f137ab31640 1 --2- 172.21.15.5:0/1564633595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55df0acc34d0 0x55df0b0990f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:38.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.562+0000 7f137ab31640 1 -- 172.21.15.5:0/1564633595 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df0b099d20 con 0x55df0acbb2f0 2024-08-31T05:33:38.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.562+0000 7f135dffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:33:38.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.562+0000 7f137ab31640 1 --2- 172.21.15.5:0/1564633595 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df0acbb2f0 0x55df0b09bc30 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f136c011470 tx=0x7f136c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=183e0bf8420ff9da server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:38.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.563+0000 7f135dffb640 1 -- 172.21.15.5:0/1564633595 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f136c004be0 con 0x55df0acbb2f0 2024-08-31T05:33:38.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.563+0000 7f135dffb640 1 -- 172.21.15.5:0/1564633595 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f136c004d80 con 0x55df0acbb2f0 2024-08-31T05:33:38.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.563+0000 7f13835da740 1 -- 172.21.15.5:0/1564633595 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13640054f0 con 0x55df0acbb2f0 2024-08-31T05:33:38.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.563+0000 7f135dffb640 1 -- 172.21.15.5:0/1564633595 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f136c004f80 con 0x55df0acbb2f0 2024-08-31T05:33:38.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.563+0000 7f13835da740 10 client.16542 fetch_fsmap learned FSMap version 33 2024-08-31T05:33:38.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.563+0000 7f13835da740 1 -- 172.21.15.5:0/1564633595 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55df0b10fe00 con 0x55df0acbb2f0 2024-08-31T05:33:38.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.563+0000 7f135dffb640 1 -- 172.21.15.5:0/1564633595 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13640054f0 con 0x55df0acbb2f0 2024-08-31T05:33:38.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.563+0000 7f135dffb640 1 -- 172.21.15.5:0/1564633595 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 33) ==== 8374+0+0 (secure 0 0 0) 0x7f136c028430 con 0x55df0acbb2f0 2024-08-31T05:33:38.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.563+0000 7f13835da740 10 client.16542 fetch_fsmap finished waiting for FSMap version 33 2024-08-31T05:33:38.571 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.563+0000 7f13835da740 10 client.16542 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:33:38.571 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.563+0000 7f13835da740 20 client.16542 populate_metadata read hostname 'smithi005' 2024-08-31T05:33:38.571 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.563+0000 7f13835da740 1 --2- 172.21.15.5:0/1564633595 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55df0ac781c0 0x55df0b1125c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:38.571 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.563+0000 7f13835da740 4 client.16542 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:33:38.571 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.563+0000 7f13835da740 1 -- 172.21.15.5:0/1564633595 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55df0affa9f0 con 0x55df0ac781c0 2024-08-31T05:33:38.571 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.563+0000 7f1379b2f640 1 --2- 172.21.15.5:0/1564633595 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55df0ac781c0 0x55df0b1125c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:38.571 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.564+0000 7f1379b2f640 1 --2- 172.21.15.5:0/1564633595 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55df0ac781c0 0x55df0b1125c0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47930c33efc1730c server_cookie=2e9afbe3c7b32f03 in_seq=0 out_seq=0 2024-08-31T05:33:38.571 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.564+0000 7f135dffb640 10 client.16542 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:33:38.575 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.572+0000 7f135dffb640 1 -- 172.21.15.5:0/1564633595 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55df0affa9f0 con 0x55df0ac781c0 2024-08-31T05:33:38.575 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.572+0000 7f135dffb640 10 client.16542 handle_command_reply: tid=0 2024-08-31T05:33:38.575 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.573+0000 7f13835da740 1 client.16542 shutdown 2024-08-31T05:33:38.575 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.573+0000 7f13835da740 1 -- 172.21.15.5:0/1564633595 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df0acbb2f0 msgr2=0x55df0b09bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:38.575 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.573+0000 7f13835da740 1 --2- 172.21.15.5:0/1564633595 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df0acbb2f0 0x55df0b09bc30 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f136c011470 tx=0x7f136c014000 comp rx=0 tx=0).stop 2024-08-31T05:33:38.575 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.573+0000 7f13835da740 1 -- 172.21.15.5:0/1564633595 shutdown_connections 2024-08-31T05:33:38.576 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.573+0000 7f13835da740 1 --2- 172.21.15.5:0/1564633595 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55df0ac781c0 0x55df0b1125c0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:38.576 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.573+0000 7f13835da740 1 --2- 172.21.15.5:0/1564633595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55df0ace41b0 0x55df0b099630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:38.576 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.573+0000 7f13835da740 1 --2- 172.21.15.5:0/1564633595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55df0acc34d0 0x55df0b0990f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:38.576 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.573+0000 7f135dffb640 0 client.16542 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:33:38.576 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.573+0000 7f13835da740 1 --2- 172.21.15.5:0/1564633595 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df0acbb2f0 0x55df0b09bc30 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:38.576 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.573+0000 7f13835da740 1 -- 172.21.15.5:0/1564633595 >> 172.21.15.5:0/1564633595 conn(0x55df0acd8300 msgr2=0x55df0b08e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:38.576 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.573+0000 7f13835da740 1 -- 172.21.15.5:0/1564633595 shutdown_connections 2024-08-31T05:33:38.576 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.573+0000 7f13835da740 1 -- 172.21.15.5:0/1564633595 wait complete. 2024-08-31T05:33:38.576 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.573+0000 7f13835da740 20 client.16542 trim_cache size 0 max 16384 2024-08-31T05:33:38.576 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:33:38.576 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:33:38.577 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:33:38.577 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:33:38.578 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.573+0000 7f137c594640 1 -- 172.21.15.5:0/695283675 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f13600b4ca0 msgr2=0x7f13600b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:38.578 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.573+0000 7f137c594640 1 --2- 172.21.15.5:0/695283675 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f13600b4ca0 0x7f13600b71b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f13700e3190 tx=0x7f13700e9860 comp rx=0 tx=0).stop 2024-08-31T05:33:38.578 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.573+0000 7f137c594640 1 -- 172.21.15.5:0/695283675 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1374102760 msgr2=0x7f137419b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:38.578 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.573+0000 7f137c594640 1 --2- 172.21.15.5:0/695283675 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1374102760 0x7f137419b040 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f137000e9f0 tx=0x7f137000edf0 comp rx=0 tx=0).stop 2024-08-31T05:33:38.578 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.574+0000 7f137c594640 1 -- 172.21.15.5:0/695283675 shutdown_connections 2024-08-31T05:33:38.578 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.574+0000 7f137c594640 1 --2- 172.21.15.5:0/695283675 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f13600b4ca0 0x7f13600b71b0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:38.578 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.574+0000 7f137c594640 1 --2- 172.21.15.5:0/695283675 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13741089e0 0x7f137419bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:38.578 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.574+0000 7f137c594640 1 --2- 172.21.15.5:0/695283675 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1374108090 0x7f137419b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:38.578 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.574+0000 7f137c594640 1 --2- 172.21.15.5:0/695283675 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1374102760 0x7f137419b040 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:38.578 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.574+0000 7f137c594640 1 -- 172.21.15.5:0/695283675 >> 172.21.15.5:0/695283675 conn(0x7f13740fe160 msgr2=0x7f1374106770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:38.579 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.574+0000 7f137c594640 1 -- 172.21.15.5:0/695283675 shutdown_connections 2024-08-31T05:33:38.579 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:38.574+0000 7f137c594640 1 -- 172.21.15.5:0/695283675 wait complete. 2024-08-31T05:33:38.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:33:38 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:33:38.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:33:38 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:33:38.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:33:38 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:33:38.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:33:38 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:33:38.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:33:38 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:33:38.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:33:38 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:33:38.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:33:38 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:33:38.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:33:38 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:33:38.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:33:38 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:33:38.913 INFO:tasks.workunit.client.0.smithi005.stdout: 1 367769 13.30 MB/sec execute 26 sec latency 13.158 ms 2024-08-31T05:33:39.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:33:39 smithi070 ceph-mon[22316]: pgmap v455: 129 pgs: 129 active+clean; 184 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.2 MiB/s wr, 229 op/s 2024-08-31T05:33:39.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:33:39 smithi050 ceph-mon[22146]: pgmap v455: 129 pgs: 129 active+clean; 184 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.2 MiB/s wr, 229 op/s 2024-08-31T05:33:39.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:33:39 smithi005 ceph-mon[18602]: pgmap v455: 129 pgs: 129 active+clean; 184 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.2 MiB/s wr, 229 op/s 2024-08-31T05:33:39.913 INFO:tasks.workunit.client.0.smithi005.stdout: 1 369883 13.29 MB/sec execute 27 sec latency 21.281 ms 2024-08-31T05:33:40.913 INFO:tasks.workunit.client.0.smithi005.stdout: 1 372862 13.46 MB/sec execute 28 sec latency 11.829 ms 2024-08-31T05:33:41.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:33:41 smithi070 ceph-mon[22316]: pgmap v456: 129 pgs: 129 active+clean; 191 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.4 MiB/s wr, 313 op/s 2024-08-31T05:33:41.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:33:41 smithi050 ceph-mon[22146]: pgmap v456: 129 pgs: 129 active+clean; 191 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.4 MiB/s wr, 313 op/s 2024-08-31T05:33:41.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:33:41 smithi005 ceph-mon[18602]: pgmap v456: 129 pgs: 129 active+clean; 191 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.4 MiB/s wr, 313 op/s 2024-08-31T05:33:41.913 INFO:tasks.workunit.client.0.smithi005.stdout: 1 375788 13.50 MB/sec execute 29 sec latency 30.361 ms 2024-08-31T05:33:42.914 INFO:tasks.workunit.client.0.smithi005.stdout: 1 377255 13.28 MB/sec execute 30 sec latency 82.409 ms 2024-08-31T05:33:43.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:33:43 smithi070 ceph-mon[22316]: pgmap v457: 129 pgs: 129 active+clean; 191 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.2 MiB/s wr, 250 op/s 2024-08-31T05:33:43.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:33:43 smithi050 ceph-mon[22146]: pgmap v457: 129 pgs: 129 active+clean; 191 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.2 MiB/s wr, 250 op/s 2024-08-31T05:33:43.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:33:43 smithi005 ceph-mon[18602]: pgmap v457: 129 pgs: 129 active+clean; 191 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.2 MiB/s wr, 250 op/s 2024-08-31T05:33:43.913 INFO:tasks.workunit.client.0.smithi005.stdout: 1 380017 13.39 MB/sec execute 31 sec latency 24.251 ms 2024-08-31T05:33:44.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:33:44 smithi070 ceph-mon[22316]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T05:33:44.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:33:44 smithi050 ceph-mon[22146]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T05:33:44.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:33:44 smithi005 ceph-mon[18602]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T05:33:44.913 INFO:tasks.workunit.client.0.smithi005.stdout: 1 382856 13.43 MB/sec execute 32 sec latency 18.605 ms 2024-08-31T05:33:45.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:33:45 smithi070 ceph-mon[22316]: pgmap v458: 129 pgs: 129 active+clean; 191 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.2 MiB/s wr, 250 op/s 2024-08-31T05:33:45.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:33:45 smithi050 ceph-mon[22146]: pgmap v458: 129 pgs: 129 active+clean; 191 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.2 MiB/s wr, 250 op/s 2024-08-31T05:33:45.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:33:45 smithi005 ceph-mon[18602]: pgmap v458: 129 pgs: 129 active+clean; 191 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.2 MiB/s wr, 250 op/s 2024-08-31T05:33:45.914 INFO:tasks.workunit.client.0.smithi005.stdout: 1 385083 13.33 MB/sec execute 33 sec latency 12.254 ms 2024-08-31T05:33:46.914 INFO:tasks.workunit.client.0.smithi005.stdout: 1 387399 13.35 MB/sec execute 34 sec latency 39.061 ms 2024-08-31T05:33:47.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:33:47 smithi070 ceph-mon[22316]: pgmap v459: 129 pgs: 129 active+clean; 198 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.5 MiB/s wr, 315 op/s 2024-08-31T05:33:47.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:33:47 smithi050 ceph-mon[22146]: pgmap v459: 129 pgs: 129 active+clean; 198 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.5 MiB/s wr, 315 op/s 2024-08-31T05:33:47.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:33:47 smithi005 ceph-mon[18602]: pgmap v459: 129 pgs: 129 active+clean; 198 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.5 MiB/s wr, 315 op/s 2024-08-31T05:33:47.914 INFO:tasks.workunit.client.0.smithi005.stdout: 1 390282 13.46 MB/sec execute 35 sec latency 53.508 ms 2024-08-31T05:33:48.914 INFO:tasks.workunit.client.0.smithi005.stdout: 1 392198 13.28 MB/sec execute 36 sec latency 21.962 ms 2024-08-31T05:33:49.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:33:49 smithi070 ceph-mon[22316]: pgmap v460: 129 pgs: 129 active+clean; 197 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.4 MiB/s wr, 235 op/s 2024-08-31T05:33:49.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:33:49 smithi050 ceph-mon[22146]: pgmap v460: 129 pgs: 129 active+clean; 197 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.4 MiB/s wr, 235 op/s 2024-08-31T05:33:49.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:33:49 smithi005 ceph-mon[18602]: pgmap v460: 129 pgs: 129 active+clean; 197 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.4 MiB/s wr, 235 op/s 2024-08-31T05:33:49.914 INFO:tasks.workunit.client.0.smithi005.stdout: 1 394586 13.31 MB/sec execute 37 sec latency 12.187 ms 2024-08-31T05:33:50.805 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T05:33:50.914 INFO:tasks.workunit.client.0.smithi005.stdout: 1 397604 13.44 MB/sec execute 38 sec latency 15.240 ms 2024-08-31T05:33:51.061 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:33:51.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:33:51 smithi005 ceph-mon[18602]: pgmap v461: 129 pgs: 129 active+clean; 202 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.5 MiB/s wr, 313 op/s 2024-08-31T05:33:51.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.568+0000 7f12dfa50640 1 -- 172.21.15.5:0/973851953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12d8109240 msgr2=0x7f12d8109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:51.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.568+0000 7f12dfa50640 1 --2- 172.21.15.5:0/973851953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12d8109240 0x7f12d8109650 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f12c8009900 tx=0x7f12c802a410 comp rx=0 tx=0).stop 2024-08-31T05:33:51.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.568+0000 7f12dfa50640 1 -- 172.21.15.5:0/973851953 shutdown_connections 2024-08-31T05:33:51.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.568+0000 7f12dfa50640 1 --2- 172.21.15.5:0/973851953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12d8109b90 0x7f12d81103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.568+0000 7f12dfa50640 1 --2- 172.21.15.5:0/973851953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12d8109240 0x7f12d8109650 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.568+0000 7f12dfa50640 1 --2- 172.21.15.5:0/973851953 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f12d8103900 0x7f12d8103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.568+0000 7f12dfa50640 1 -- 172.21.15.5:0/973851953 >> 172.21.15.5:0/973851953 conn(0x7f12d807b5f0 msgr2=0x7f12d807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:51.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.568+0000 7f12dfa50640 1 -- 172.21.15.5:0/973851953 shutdown_connections 2024-08-31T05:33:51.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.568+0000 7f12dfa50640 1 -- 172.21.15.5:0/973851953 wait complete. 2024-08-31T05:33:51.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.569+0000 7f12dfa50640 1 Processor -- start 2024-08-31T05:33:51.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.569+0000 7f12dfa50640 1 -- start start 2024-08-31T05:33:51.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.569+0000 7f12dfa50640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12d8103900 0x7f12d819a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:51.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.569+0000 7f12dfa50640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12d8109240 0x7f12d819a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:51.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.569+0000 7f12dfa50640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f12d8109b90 0x7f12d819fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:51.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.569+0000 7f12dfa50640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f12d8113850 con 0x7f12d8103900 2024-08-31T05:33:51.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.569+0000 7f12dfa50640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f12d81136d0 con 0x7f12d8109240 2024-08-31T05:33:51.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.569+0000 7f12dfa50640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f12d81139d0 con 0x7f12d8109b90 2024-08-31T05:33:51.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.569+0000 7f12dd7ec640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12d8103900 0x7f12d819a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:51.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.569+0000 7f12dd7ec640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12d8103900 0x7f12d819a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34216/0 (socket says 172.21.15.5:34216) 2024-08-31T05:33:51.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.569+0000 7f12dcfeb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12d8109240 0x7f12d819a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:51.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.569+0000 7f12dd7ec640 1 -- 172.21.15.5:0/4211692260 learned_addr learned my addr 172.21.15.5:0/4211692260 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:51.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.569+0000 7f12ddfed640 1 --2- 172.21.15.5:0/4211692260 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f12d8109b90 0x7f12d819fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:51.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.570+0000 7f12dd7ec640 1 -- 172.21.15.5:0/4211692260 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f12d8109b90 msgr2=0x7f12d819fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:51.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.570+0000 7f12dd7ec640 1 --2- 172.21.15.5:0/4211692260 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f12d8109b90 0x7f12d819fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.570+0000 7f12dd7ec640 1 -- 172.21.15.5:0/4211692260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12d8109240 msgr2=0x7f12d819a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:51.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.570+0000 7f12dd7ec640 1 --2- 172.21.15.5:0/4211692260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12d8109240 0x7f12d819a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.570+0000 7f12dd7ec640 1 -- 172.21.15.5:0/4211692260 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12d81a0290 con 0x7f12d8103900 2024-08-31T05:33:51.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.570+0000 7f12dcfeb640 1 --2- 172.21.15.5:0/4211692260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12d8109240 0x7f12d819a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:51.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.570+0000 7f12dd7ec640 1 --2- 172.21.15.5:0/4211692260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12d8103900 0x7f12d819a320 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f12d400e9f0 tx=0x7f12d400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:51.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.570+0000 7f12ce7fc640 1 -- 172.21.15.5:0/4211692260 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d400cd80 con 0x7f12d8103900 2024-08-31T05:33:51.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.570+0000 7f12ce7fc640 1 -- 172.21.15.5:0/4211692260 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12d40054d0 con 0x7f12d8103900 2024-08-31T05:33:51.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.570+0000 7f12dfa50640 1 -- 172.21.15.5:0/4211692260 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12d81a0580 con 0x7f12d8103900 2024-08-31T05:33:51.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.570+0000 7f12ce7fc640 1 -- 172.21.15.5:0/4211692260 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d4010690 con 0x7f12d8103900 2024-08-31T05:33:51.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.570+0000 7f12dfa50640 1 -- 172.21.15.5:0/4211692260 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12d81a6ce0 con 0x7f12d8103900 2024-08-31T05:33:51.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.573+0000 7f12e5fc5740 1 Processor -- start 2024-08-31T05:33:51.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.573+0000 7f12e5fc5740 1 -- start start 2024-08-31T05:33:51.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.573+0000 7f12ce7fc640 1 -- 172.21.15.5:0/4211692260 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f12d4010830 con 0x7f12d8103900 2024-08-31T05:33:51.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.573+0000 7f12e5fc5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637305bc070 0x5637309612c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:51.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.574+0000 7f12e5fc5740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5637305931b0 0x563730961800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:51.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.574+0000 7f12e5fc5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56373059b390 0x563730961d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:51.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.574+0000 7f12e5fc5740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5637308d8630 con 0x5637305931b0 2024-08-31T05:33:51.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.574+0000 7f12e5fc5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5637308c7bc0 con 0x5637305bc070 2024-08-31T05:33:51.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.574+0000 7f12e5fc5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5637308cbb70 con 0x56373059b390 2024-08-31T05:33:51.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.574+0000 7f12dd7ec640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5637305931b0 0x563730961800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:51.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.574+0000 7f12dcfeb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56373059b390 0x563730961d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:51.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.574+0000 7f12dcfeb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56373059b390 0x563730961d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:60036/0 (socket says 172.21.15.5:60036) 2024-08-31T05:33:51.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.574+0000 7f12dcfeb640 1 -- 172.21.15.5:0/2393960829 learned_addr learned my addr 172.21.15.5:0/2393960829 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:51.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.574+0000 7f12ddfed640 1 --2- 172.21.15.5:0/2393960829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637305bc070 0x5637309612c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:51.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.574+0000 7f12dd7ec640 1 -- 172.21.15.5:0/2393960829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56373059b390 msgr2=0x563730961d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:51.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.574+0000 7f12dd7ec640 1 --2- 172.21.15.5:0/2393960829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56373059b390 0x563730961d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.574+0000 7f12dd7ec640 1 -- 172.21.15.5:0/2393960829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637305bc070 msgr2=0x5637309612c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:51.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.574+0000 7f12dd7ec640 1 --2- 172.21.15.5:0/2393960829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637305bc070 0x5637309612c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.574+0000 7f12dd7ec640 1 -- 172.21.15.5:0/2393960829 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563730627650 con 0x5637305931b0 2024-08-31T05:33:51.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.574+0000 7f12dcfeb640 1 --2- 172.21.15.5:0/2393960829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56373059b390 0x563730961d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:51.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.574+0000 7f12dd7ec640 1 --2- 172.21.15.5:0/2393960829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5637305931b0 0x563730961800 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f12d40e30b0 tx=0x7f12d40e9e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54c5200a60620016 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:51.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.574+0000 7f12ce7fc640 1 --2- 172.21.15.5:0/4211692260 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f12c40b4ca0 0x7f12c40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:51.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.575+0000 7f12ddfed640 1 --2- 172.21.15.5:0/4211692260 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f12c40b4ca0 0x7f12c40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:51.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.575+0000 7f12c37fe640 1 -- 172.21.15.5:0/2393960829 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d40a86a0 con 0x5637305931b0 2024-08-31T05:33:51.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.575+0000 7f12c37fe640 1 -- 172.21.15.5:0/2393960829 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12d40ac750 con 0x5637305931b0 2024-08-31T05:33:51.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.575+0000 7f12c37fe640 1 -- 172.21.15.5:0/2393960829 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d40ab7c0 con 0x5637305931b0 2024-08-31T05:33:51.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.575+0000 7f12ce7fc640 1 -- 172.21.15.5:0/4211692260 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f12d40e5ce0 con 0x7f12d8103900 2024-08-31T05:33:51.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.576+0000 7f12e5fc5740 1 -- 172.21.15.5:0/2393960829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5637305931b0 msgr2=0x563730961800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:51.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.576+0000 7f12ddfed640 1 --2- 172.21.15.5:0/4211692260 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f12c40b4ca0 0x7f12c40b71b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f12d0005fd0 tx=0x7f12d0009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:51.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.576+0000 7f12e5fc5740 1 --2- 172.21.15.5:0/2393960829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5637305931b0 0x563730961800 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f12d40e30b0 tx=0x7f12d40e9e20 comp rx=0 tx=0).stop 2024-08-31T05:33:51.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.576+0000 7f12e5fc5740 1 -- 172.21.15.5:0/2393960829 shutdown_connections 2024-08-31T05:33:51.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.576+0000 7f12e5fc5740 1 --2- 172.21.15.5:0/2393960829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56373059b390 0x563730961d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.576+0000 7f12e5fc5740 1 --2- 172.21.15.5:0/2393960829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5637305931b0 0x563730961800 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.576+0000 7f12e5fc5740 1 --2- 172.21.15.5:0/2393960829 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637305bc070 0x5637309612c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.576+0000 7f12e5fc5740 1 -- 172.21.15.5:0/2393960829 >> 172.21.15.5:0/2393960829 conn(0x5637305b0460 msgr2=0x56373095f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:51.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.576+0000 7f12e5fc5740 1 -- 172.21.15.5:0/2393960829 shutdown_connections 2024-08-31T05:33:51.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.576+0000 7f12e5fc5740 1 -- 172.21.15.5:0/2393960829 wait complete. 2024-08-31T05:33:51.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.576+0000 7f12e5fc5740 1 -- start start 2024-08-31T05:33:51.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.576+0000 7f12e5fc5740 1 Processor -- start 2024-08-31T05:33:51.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.577+0000 7f12e5fc5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637305931b0 0x56373096ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:51.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.577+0000 7f12e5fc5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56373059b390 0x56373096cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:51.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.577+0000 7f12e5fc5740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5637305bc070 0x563730978d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:51.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.577+0000 7f12e5fc5740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56373072a700 con 0x5637305bc070 2024-08-31T05:33:51.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.577+0000 7f12e5fc5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56373084e700 con 0x5637305931b0 2024-08-31T05:33:51.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.577+0000 7f12e5fc5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56373096faa0 con 0x56373059b390 2024-08-31T05:33:51.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.577+0000 7f12e5fc5740 10 client.0 _ll_register_callbacks cb 0x56373087ddc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:33:51.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.577+0000 7f12dcfeb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56373059b390 0x56373096cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:51.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.577+0000 7f12dd7ec640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637305931b0 0x56373096ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:51.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.577+0000 7f12ddfed640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5637305bc070 0x563730978d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:51.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.577+0000 7f12dcfeb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56373059b390 0x56373096cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:60038/0 (socket says 172.21.15.5:60038) 2024-08-31T05:33:51.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.577+0000 7f12dcfeb640 1 -- 172.21.15.5:0/4263188647 learned_addr learned my addr 172.21.15.5:0/4263188647 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:51.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.577+0000 7f12dd7ec640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637305931b0 0x56373096ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:54626/0 (socket says 172.21.15.5:54626) 2024-08-31T05:33:51.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.577+0000 7f12ddfed640 1 -- 172.21.15.5:0/4263188647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56373059b390 msgr2=0x56373096cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:51.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.577+0000 7f12ddfed640 1 --2- 172.21.15.5:0/4263188647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56373059b390 0x56373096cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.577+0000 7f12ddfed640 1 -- 172.21.15.5:0/4263188647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637305931b0 msgr2=0x56373096ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:51.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.577+0000 7f12ddfed640 1 --2- 172.21.15.5:0/4263188647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637305931b0 0x56373096ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.577+0000 7f12ddfed640 1 -- 172.21.15.5:0/4263188647 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637308878b0 con 0x5637305bc070 2024-08-31T05:33:51.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.578+0000 7f12ddfed640 1 --2- 172.21.15.5:0/4263188647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5637305bc070 0x563730978d90 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f12d0011dd0 tx=0x7f12d0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=524a47f9cc4f1746 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:51.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.578+0000 7f12c0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:33:51.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.578+0000 7f12c0ff9640 1 -- 172.21.15.5:0/4263188647 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d0004b20 con 0x5637305bc070 2024-08-31T05:33:51.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.578+0000 7f12c0ff9640 1 -- 172.21.15.5:0/4263188647 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f12d0004cc0 con 0x5637305bc070 2024-08-31T05:33:51.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.578+0000 7f12e5fc5740 1 -- 172.21.15.5:0/4263188647 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12d40ac750 con 0x5637305bc070 2024-08-31T05:33:51.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.578+0000 7f12c0ff9640 1 -- 172.21.15.5:0/4263188647 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f12d000f810 con 0x5637305bc070 2024-08-31T05:33:51.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.578+0000 7f12e5fc5740 10 client.16554 fetch_fsmap learned FSMap version 34 2024-08-31T05:33:51.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.578+0000 7f12e5fc5740 1 -- 172.21.15.5:0/4263188647 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56373097b8b0 con 0x5637305bc070 2024-08-31T05:33:51.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.578+0000 7f12c0ff9640 1 -- 172.21.15.5:0/4263188647 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12d40ac750 con 0x5637305bc070 2024-08-31T05:33:51.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.578+0000 7f12c0ff9640 1 -- 172.21.15.5:0/4263188647 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f12d0026070 con 0x5637305bc070 2024-08-31T05:33:51.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.579+0000 7f12e5fc5740 10 client.16554 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:33:51.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.579+0000 7f12e5fc5740 10 client.16554 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:33:51.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.579+0000 7f12e5fc5740 20 client.16554 populate_metadata read hostname 'smithi005' 2024-08-31T05:33:51.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.579+0000 7f12e5fc5740 1 --2- 172.21.15.5:0/4263188647 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56373057a9f0 0x56373097ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:51.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.579+0000 7f12e5fc5740 4 client.16554 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:33:51.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.579+0000 7f12e5fc5740 1 -- 172.21.15.5:0/4263188647 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5637308da580 con 0x56373057a9f0 2024-08-31T05:33:51.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.579+0000 7f12dd7ec640 1 --2- 172.21.15.5:0/4263188647 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56373057a9f0 0x56373097ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:51.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.579+0000 7f12c0ff9640 10 client.16554 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:33:51.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.579+0000 7f12dd7ec640 1 --2- 172.21.15.5:0/4263188647 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56373057a9f0 0x56373097ef90 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=482657e5fa116b17 server_cookie=b6877e8718ec7071 in_seq=0 out_seq=0 2024-08-31T05:33:51.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.580+0000 7f12c0ff9640 1 -- 172.21.15.5:0/4263188647 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5637308da580 con 0x56373057a9f0 2024-08-31T05:33:51.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.580+0000 7f12c0ff9640 10 client.16554 handle_command_reply: tid=0 2024-08-31T05:33:51.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.580+0000 7f12e5fc5740 1 client.16554 shutdown 2024-08-31T05:33:51.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.581+0000 7f12e5fc5740 1 -- 172.21.15.5:0/4263188647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5637305bc070 msgr2=0x563730978d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:51.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.581+0000 7f12e5fc5740 1 --2- 172.21.15.5:0/4263188647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5637305bc070 0x563730978d90 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f12d0011dd0 tx=0x7f12d0004ab0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.581+0000 7f12e5fc5740 1 -- 172.21.15.5:0/4263188647 shutdown_connections 2024-08-31T05:33:51.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.581+0000 7f12e5fc5740 1 --2- 172.21.15.5:0/4263188647 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56373057a9f0 0x56373097ef90 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.581+0000 7f12e5fc5740 1 --2- 172.21.15.5:0/4263188647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5637305bc070 0x563730978d90 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.581+0000 7f12e5fc5740 1 --2- 172.21.15.5:0/4263188647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56373059b390 0x56373096cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.581+0000 7f12e5fc5740 1 --2- 172.21.15.5:0/4263188647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637305931b0 0x56373096ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.581+0000 7f12e5fc5740 1 -- 172.21.15.5:0/4263188647 >> 172.21.15.5:0/4263188647 conn(0x5637305b0460 msgr2=0x5637309644a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:51.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.581+0000 7f12c0ff9640 0 client.16554 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:33:51.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.581+0000 7f12e5fc5740 1 -- 172.21.15.5:0/4263188647 shutdown_connections 2024-08-31T05:33:51.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.581+0000 7f12e5fc5740 1 -- 172.21.15.5:0/4263188647 wait complete. 2024-08-31T05:33:51.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.581+0000 7f12e5fc5740 20 client.16554 trim_cache size 0 max 16384 2024-08-31T05:33:51.604 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:33:51 smithi070 ceph-mon[22316]: pgmap v461: 129 pgs: 129 active+clean; 202 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.5 MiB/s wr, 313 op/s 2024-08-31T05:33:51.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.603+0000 7f12e5fc5740 1 Processor -- start 2024-08-31T05:33:51.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.603+0000 7f12e5fc5740 1 -- start start 2024-08-31T05:33:51.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.603+0000 7f12e5fc5740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5637305931b0 0x563730978c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:51.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.603+0000 7f12e5fc5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56373059b390 0x5637309791d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:51.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.603+0000 7f12e5fc5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637305bc070 0x5637309643c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:51.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.603+0000 7f12e5fc5740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f12d81b0d40 con 0x5637305931b0 2024-08-31T05:33:51.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.603+0000 7f12e5fc5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f12d81b2880 con 0x5637305bc070 2024-08-31T05:33:51.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.603+0000 7f12e5fc5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f12d81b1410 con 0x56373059b390 2024-08-31T05:33:51.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.603+0000 7f12dd7ec640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5637305931b0 0x563730978c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:51.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.603+0000 7f12dd7ec640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5637305931b0 0x563730978c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34230/0 (socket says 172.21.15.5:34230) 2024-08-31T05:33:51.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.603+0000 7f12dd7ec640 1 -- 172.21.15.5:0/2791176451 learned_addr learned my addr 172.21.15.5:0/2791176451 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:51.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.603+0000 7f12dcfeb640 1 --2- 172.21.15.5:0/2791176451 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56373059b390 0x5637309791d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:51.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.603+0000 7f12ddfed640 1 --2- 172.21.15.5:0/2791176451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637305bc070 0x5637309643c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:51.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.604+0000 7f12dd7ec640 1 -- 172.21.15.5:0/2791176451 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56373059b390 msgr2=0x5637309791d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:51.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.604+0000 7f12dd7ec640 1 --2- 172.21.15.5:0/2791176451 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56373059b390 0x5637309791d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.604+0000 7f12dd7ec640 1 -- 172.21.15.5:0/2791176451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637305bc070 msgr2=0x5637309643c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:51.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.604+0000 7f12dd7ec640 1 --2- 172.21.15.5:0/2791176451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637305bc070 0x5637309643c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.604+0000 7f12dd7ec640 1 -- 172.21.15.5:0/2791176451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637309635b0 con 0x5637305931b0 2024-08-31T05:33:51.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.604+0000 7f12ddfed640 1 --2- 172.21.15.5:0/2791176451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637305bc070 0x5637309643c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:33:51.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.604+0000 7f12dd7ec640 1 --2- 172.21.15.5:0/2791176451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5637305931b0 0x563730978c90 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f12d40abd50 tx=0x7f12d40e9fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=840c7d948fe19d6b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:51.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.604+0000 7f12c2ffd640 1 -- 172.21.15.5:0/2791176451 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d40ab9a0 con 0x5637305931b0 2024-08-31T05:33:51.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.604+0000 7f12c2ffd640 1 -- 172.21.15.5:0/2791176451 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12d40e9600 con 0x5637305931b0 2024-08-31T05:33:51.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.604+0000 7f12c2ffd640 1 -- 172.21.15.5:0/2791176451 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d40abb90 con 0x5637305931b0 2024-08-31T05:33:51.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.605+0000 7f12e5fc5740 1 -- 172.21.15.5:0/2791176451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5637305931b0 msgr2=0x563730978c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:51.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.605+0000 7f12e5fc5740 1 --2- 172.21.15.5:0/2791176451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5637305931b0 0x563730978c90 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f12d40abd50 tx=0x7f12d40e9fb0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.605+0000 7f12e5fc5740 1 -- 172.21.15.5:0/2791176451 shutdown_connections 2024-08-31T05:33:51.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.605+0000 7f12e5fc5740 1 --2- 172.21.15.5:0/2791176451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637305bc070 0x5637309643c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.605+0000 7f12e5fc5740 1 --2- 172.21.15.5:0/2791176451 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56373059b390 0x5637309791d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.605+0000 7f12e5fc5740 1 --2- 172.21.15.5:0/2791176451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5637305931b0 0x563730978c90 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.605+0000 7f12e5fc5740 1 -- 172.21.15.5:0/2791176451 >> 172.21.15.5:0/2791176451 conn(0x5637305b0460 msgr2=0x56373096b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:51.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.605+0000 7f12e5fc5740 1 -- 172.21.15.5:0/2791176451 shutdown_connections 2024-08-31T05:33:51.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.605+0000 7f12e5fc5740 1 -- 172.21.15.5:0/2791176451 wait complete. 2024-08-31T05:33:51.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.606+0000 7f12e5fc5740 1 -- start start 2024-08-31T05:33:51.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.606+0000 7f12e5fc5740 1 Processor -- start 2024-08-31T05:33:51.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.606+0000 7f12e5fc5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637305931b0 0x563730975180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:51.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.606+0000 7f12e5fc5740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56373059b390 0x563730971690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:51.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.606+0000 7f12e5fc5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637305bc070 0x563730971bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:51.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.606+0000 7f12e5fc5740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f12d81b21b0 con 0x56373059b390 2024-08-31T05:33:51.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.606+0000 7f12e5fc5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f12d81b1ae0 con 0x5637305bc070 2024-08-31T05:33:51.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.606+0000 7f12e5fc5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f12d81aed20 con 0x5637305931b0 2024-08-31T05:33:51.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.606+0000 7f12e5fc5740 10 client.0 _ll_register_callbacks cb 0x7f12d0009e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:33:51.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.606+0000 7f12dd7ec640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637305931b0 0x563730975180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:51.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.606+0000 7f12ddfed640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637305bc070 0x563730971bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:51.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.606+0000 7f12dd7ec640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637305931b0 0x563730975180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:60050/0 (socket says 172.21.15.5:60050) 2024-08-31T05:33:51.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.606+0000 7f12dd7ec640 1 -- 172.21.15.5:0/2254500771 learned_addr learned my addr 172.21.15.5:0/2254500771 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:51.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.606+0000 7f12dcfeb640 1 --2- 172.21.15.5:0/2254500771 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56373059b390 0x563730971690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:51.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.607+0000 7f12ddfed640 1 -- 172.21.15.5:0/2254500771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637305931b0 msgr2=0x563730975180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:51.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.607+0000 7f12ddfed640 1 --2- 172.21.15.5:0/2254500771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637305931b0 0x563730975180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.607+0000 7f12ddfed640 1 -- 172.21.15.5:0/2254500771 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56373059b390 msgr2=0x563730971690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:51.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.607+0000 7f12ddfed640 1 --2- 172.21.15.5:0/2254500771 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56373059b390 0x563730971690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.607+0000 7f12ddfed640 1 -- 172.21.15.5:0/2254500771 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563730972110 con 0x5637305bc070 2024-08-31T05:33:51.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.607+0000 7f12dd7ec640 1 --2- 172.21.15.5:0/2254500771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637305931b0 0x563730975180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:51.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.607+0000 7f12ddfed640 1 --2- 172.21.15.5:0/2254500771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637305bc070 0x563730971bd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f12d0009f10 tx=0x7f12d000ff50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d417cc0f7c53273 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:51.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.607+0000 7f12c0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:33:51.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.607+0000 7f12c0ff9640 1 -- 172.21.15.5:0/2254500771 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d003a060 con 0x5637305bc070 2024-08-31T05:33:51.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.607+0000 7f12c0ff9640 1 -- 172.21.15.5:0/2254500771 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f12d001ea20 con 0x5637305bc070 2024-08-31T05:33:51.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.607+0000 7f12e5fc5740 1 -- 172.21.15.5:0/2254500771 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56373095f710 con 0x5637305bc070 2024-08-31T05:33:51.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.607+0000 7f12c0ff9640 1 -- 172.21.15.5:0/2254500771 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f12d0041050 con 0x5637305bc070 2024-08-31T05:33:51.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.607+0000 7f12e5fc5740 10 client.26150 fetch_fsmap learned FSMap version 34 2024-08-31T05:33:51.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.607+0000 7f12e5fc5740 1 -- 172.21.15.5:0/2254500771 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5637309ea550 con 0x5637305bc070 2024-08-31T05:33:51.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.608+0000 7f12c0ff9640 1 -- 172.21.15.5:0/2254500771 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x56373095f710 con 0x5637305bc070 2024-08-31T05:33:51.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.608+0000 7f12c0ff9640 1 -- 172.21.15.5:0/2254500771 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f12d0026070 con 0x5637305bc070 2024-08-31T05:33:51.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.608+0000 7f12e5fc5740 10 client.26150 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:33:51.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.608+0000 7f12e5fc5740 10 client.26150 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:33:51.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.608+0000 7f12e5fc5740 20 client.26150 populate_metadata read hostname 'smithi005' 2024-08-31T05:33:51.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.608+0000 7f12e5fc5740 1 --2- 172.21.15.5:0/2254500771 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56373054fda0 0x5637309ecd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:51.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.608+0000 7f12e5fc5740 4 client.26150 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T05:33:51.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.608+0000 7f12e5fc5740 1 -- 172.21.15.5:0/2254500771 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563730968620 con 0x56373054fda0 2024-08-31T05:33:51.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.608+0000 7f12dd7ec640 1 --2- 172.21.15.5:0/2254500771 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56373054fda0 0x5637309ecd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:51.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.608+0000 7f12c0ff9640 10 client.26150 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:33:51.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.609+0000 7f12dd7ec640 1 --2- 172.21.15.5:0/2254500771 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56373054fda0 0x5637309ecd40 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb2f5c7b5807c1fd server_cookie=612832eba7aee67a in_seq=0 out_seq=0 2024-08-31T05:33:51.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.609+0000 7f12c0ff9640 1 -- 172.21.15.5:0/2254500771 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1510 (crc 0 0 0) 0x563730968620 con 0x56373054fda0 2024-08-31T05:33:51.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.609+0000 7f12c0ff9640 10 client.26150 handle_command_reply: tid=0 2024-08-31T05:33:51.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.609+0000 7f12e5fc5740 1 client.26150 shutdown 2024-08-31T05:33:51.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.609+0000 7f12e5fc5740 1 -- 172.21.15.5:0/2254500771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637305bc070 msgr2=0x563730971bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:51.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.609+0000 7f12e5fc5740 1 --2- 172.21.15.5:0/2254500771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637305bc070 0x563730971bd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f12d0009f10 tx=0x7f12d000ff50 comp rx=0 tx=0).stop 2024-08-31T05:33:51.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.609+0000 7f12e5fc5740 1 -- 172.21.15.5:0/2254500771 shutdown_connections 2024-08-31T05:33:51.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.609+0000 7f12e5fc5740 1 --2- 172.21.15.5:0/2254500771 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56373054fda0 0x5637309ecd40 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.609+0000 7f12e5fc5740 1 --2- 172.21.15.5:0/2254500771 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5637305bc070 0x563730971bd0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.609+0000 7f12e5fc5740 1 --2- 172.21.15.5:0/2254500771 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56373059b390 0x563730971690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.609+0000 7f12c0ff9640 0 client.26150 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:33:51.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.609+0000 7f12e5fc5740 1 --2- 172.21.15.5:0/2254500771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637305931b0 0x563730975180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.609+0000 7f12e5fc5740 1 -- 172.21.15.5:0/2254500771 >> 172.21.15.5:0/2254500771 conn(0x5637305b0460 msgr2=0x5637309643c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:51.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.609+0000 7f12e5fc5740 1 -- 172.21.15.5:0/2254500771 shutdown_connections 2024-08-31T05:33:51.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.609+0000 7f12e5fc5740 1 -- 172.21.15.5:0/2254500771 wait complete. 2024-08-31T05:33:51.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.610+0000 7f12e5fc5740 20 client.26150 trim_cache size 0 max 16384 2024-08-31T05:33:51.628 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:33:51.628 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "no active scrubs running", 2024-08-31T05:33:51.628 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": {}, 2024-08-31T05:33:51.628 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_stats": { 2024-08-31T05:33:51.628 INFO:teuthology.orchestra.run.smithi005.stdout: "728a42ca-bbef-4151-830f-5fdd411d8fa0": { 2024-08-31T05:33:51.628 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:32:30.554906+0000", 2024-08-31T05:33:51.629 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:33:51.629 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:33:51.629 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:33:51.629 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:33:51.629 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:33:51.629 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:33:51.629 INFO:teuthology.orchestra.run.smithi005.stdout: "2445fc42-b797-434f-b380-e2da985b4d98": { 2024-08-31T05:33:51.629 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:33:17.681453+0000", 2024-08-31T05:33:51.629 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:33:51.629 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:33:51.629 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:33:51.629 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:33:51.630 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:33:51.630 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:33:51.630 INFO:teuthology.orchestra.run.smithi005.stdout: "cda92ac0-b35f-47a5-a3a5-471c888462a5": { 2024-08-31T05:33:51.630 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:53.103905+0000", 2024-08-31T05:33:51.630 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:33:51.630 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:33:51.630 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:33:51.630 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:33:51.630 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:33:51.630 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:33:51.630 INFO:teuthology.orchestra.run.smithi005.stdout: "ece37b07-9ab2-45f8-bc33-2755a07aac0b": { 2024-08-31T05:33:51.630 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:31:41.782407+0000", 2024-08-31T05:33:51.630 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:33:51.630 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:33:51.631 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:33:51.631 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:33:51.631 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:33:51.631 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:33:51.631 INFO:teuthology.orchestra.run.smithi005.stdout: "75d84398-5d9c-4872-b879-2fbce045fa71": { 2024-08-31T05:33:51.631 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:06.642335+0000", 2024-08-31T05:33:51.631 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:33:51.631 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:33:51.631 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:33:51.631 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:33:51.631 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:33:51.631 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:33:51.631 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:33:51.632 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:33:51.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.610+0000 7f12dfa50640 1 -- 172.21.15.5:0/4211692260 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f12c40b4ca0 msgr2=0x7f12c40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:51.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.610+0000 7f12dfa50640 1 --2- 172.21.15.5:0/4211692260 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f12c40b4ca0 0x7f12c40b71b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f12d0005fd0 tx=0x7f12d0009500 comp rx=0 tx=0).stop 2024-08-31T05:33:51.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.610+0000 7f12dfa50640 1 -- 172.21.15.5:0/4211692260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12d8103900 msgr2=0x7f12d819a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:51.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.610+0000 7f12dfa50640 1 --2- 172.21.15.5:0/4211692260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12d8103900 0x7f12d819a320 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f12d400e9f0 tx=0x7f12d400edf0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.610+0000 7f12dfa50640 1 -- 172.21.15.5:0/4211692260 shutdown_connections 2024-08-31T05:33:51.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.610+0000 7f12dfa50640 1 --2- 172.21.15.5:0/4211692260 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f12c40b4ca0 0x7f12c40b71b0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.610+0000 7f12dfa50640 1 --2- 172.21.15.5:0/4211692260 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f12d8109b90 0x7f12d819fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.610+0000 7f12dfa50640 1 --2- 172.21.15.5:0/4211692260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12d8109240 0x7f12d819a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.610+0000 7f12dfa50640 1 --2- 172.21.15.5:0/4211692260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12d8103900 0x7f12d819a320 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.610+0000 7f12dfa50640 1 -- 172.21.15.5:0/4211692260 >> 172.21.15.5:0/4211692260 conn(0x7f12d807b5f0 msgr2=0x7f12d8105320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:51.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.610+0000 7f12dfa50640 1 -- 172.21.15.5:0/4211692260 shutdown_connections 2024-08-31T05:33:51.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:51.611+0000 7f12dfa50640 1 -- 172.21.15.5:0/4211692260 wait complete. 2024-08-31T05:33:51.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:33:51 smithi050 ceph-mon[22146]: pgmap v461: 129 pgs: 129 active+clean; 202 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.5 MiB/s wr, 313 op/s 2024-08-31T05:33:51.684 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.682+0000 7f2c58615640 1 -- 172.21.15.5:0/1564146483 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c501080d0 msgr2=0x7f2c501084e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:51.684 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.682+0000 7f2c58615640 1 --2- 172.21.15.5:0/1564146483 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c501080d0 0x7f2c501084e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2c40009860 tx=0x7f2c4002a340 comp rx=0 tx=0).stop 2024-08-31T05:33:51.684 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.682+0000 7f2c58615640 1 -- 172.21.15.5:0/1564146483 shutdown_connections 2024-08-31T05:33:51.685 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.682+0000 7f2c58615640 1 --2- 172.21.15.5:0/1564146483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c50108a20 0x7f2c5010f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.685 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.682+0000 7f2c58615640 1 --2- 172.21.15.5:0/1564146483 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c501080d0 0x7f2c501084e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.685 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.682+0000 7f2c58615640 1 --2- 172.21.15.5:0/1564146483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c501027a0 0x7f2c50102bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.685 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.682+0000 7f2c58615640 1 -- 172.21.15.5:0/1564146483 >> 172.21.15.5:0/1564146483 conn(0x7f2c5007a4b0 msgr2=0x7f2c5007a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:51.685 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.682+0000 7f2c58615640 1 -- 172.21.15.5:0/1564146483 shutdown_connections 2024-08-31T05:33:51.685 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.682+0000 7f2c58615640 1 -- 172.21.15.5:0/1564146483 wait complete. 2024-08-31T05:33:51.687 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.683+0000 7f2c58615640 1 Processor -- start 2024-08-31T05:33:51.687 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.683+0000 7f2c58615640 1 -- start start 2024-08-31T05:33:51.687 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.683+0000 7f2c58615640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c501027a0 0x7f2c50198d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:51.687 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.683+0000 7f2c58615640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c501080d0 0x7f2c501992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:51.688 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.683+0000 7f2c58615640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c50108a20 0x7f2c50199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:51.688 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.683+0000 7f2c58615640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2c50112690 con 0x7f2c501080d0 2024-08-31T05:33:51.688 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.683+0000 7f2c58615640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2c50112510 con 0x7f2c501027a0 2024-08-31T05:33:51.688 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.683+0000 7f2c58615640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2c50112810 con 0x7f2c50108a20 2024-08-31T05:33:51.688 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.684+0000 7f2c563b1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c501027a0 0x7f2c50198d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:51.688 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.684+0000 7f2c56bb2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c50108a20 0x7f2c50199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:51.688 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.684+0000 7f2c563b1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c501027a0 0x7f2c50198d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:54652/0 (socket says 172.21.15.5:54652) 2024-08-31T05:33:51.688 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.684+0000 7f2c563b1640 1 -- 172.21.15.5:0/704800127 learned_addr learned my addr 172.21.15.5:0/704800127 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:51.688 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.684+0000 7f2c55bb0640 1 --2- 172.21.15.5:0/704800127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c501080d0 0x7f2c501992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:51.688 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.684+0000 7f2c56bb2640 1 -- 172.21.15.5:0/704800127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c501027a0 msgr2=0x7f2c50198d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:51.688 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.684+0000 7f2c56bb2640 1 --2- 172.21.15.5:0/704800127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c501027a0 0x7f2c50198d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.688 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.684+0000 7f2c56bb2640 1 -- 172.21.15.5:0/704800127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c501080d0 msgr2=0x7f2c501992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:51.688 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.684+0000 7f2c56bb2640 1 --2- 172.21.15.5:0/704800127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c501080d0 0x7f2c501992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.688 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.684+0000 7f2c56bb2640 1 -- 172.21.15.5:0/704800127 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c501a8440 con 0x7f2c50108a20 2024-08-31T05:33:51.689 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.684+0000 7f2c563b1640 1 --2- 172.21.15.5:0/704800127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c501027a0 0x7f2c50198d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:51.689 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.684+0000 7f2c55bb0640 1 --2- 172.21.15.5:0/704800127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c501080d0 0x7f2c501992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:51.689 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.684+0000 7f2c56bb2640 1 --2- 172.21.15.5:0/704800127 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c50108a20 0x7f2c50199810 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2c48009fd0 tx=0x7f2c4800ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:51.689 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.685+0000 7f2c477fe640 1 -- 172.21.15.5:0/704800127 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c4800ce20 con 0x7f2c50108a20 2024-08-31T05:33:51.689 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.685+0000 7f2c477fe640 1 -- 172.21.15.5:0/704800127 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c48005020 con 0x7f2c50108a20 2024-08-31T05:33:51.689 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.685+0000 7f2c477fe640 1 -- 172.21.15.5:0/704800127 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c48010690 con 0x7f2c50108a20 2024-08-31T05:33:51.689 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.685+0000 7f2c58615640 1 -- 172.21.15.5:0/704800127 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c501a86d0 con 0x7f2c50108a20 2024-08-31T05:33:51.689 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.685+0000 7f2c58615640 1 -- 172.21.15.5:0/704800127 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c501a8b30 con 0x7f2c50108a20 2024-08-31T05:33:51.690 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.688+0000 7f2c5f661740 1 Processor -- start 2024-08-31T05:33:51.690 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.688+0000 7f2c477fe640 1 -- 172.21.15.5:0/704800127 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f2c480054d0 con 0x7f2c50108a20 2024-08-31T05:33:51.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.689+0000 7f2c5f661740 1 -- start start 2024-08-31T05:33:51.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.689+0000 7f2c5f661740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556c200de1b0 0x556c20481ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:51.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.689+0000 7f2c5f661740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556c200b52f0 0x556c20482000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:51.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.689+0000 7f2c5f661740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556c200bd4d0 0x556c20482540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:51.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.689+0000 7f2c5f661740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x556c203f7000 con 0x556c200bd4d0 2024-08-31T05:33:51.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.689+0000 7f2c5f661740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x556c203e6590 con 0x556c200b52f0 2024-08-31T05:33:51.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.689+0000 7f2c5f661740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556c203ea540 con 0x556c200de1b0 2024-08-31T05:33:51.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.689+0000 7f2c55bb0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556c200de1b0 0x556c20481ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:51.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.689+0000 7f2c55bb0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556c200de1b0 0x556c20481ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:60086/0 (socket says 172.21.15.5:60086) 2024-08-31T05:33:51.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.689+0000 7f2c55bb0640 1 -- 172.21.15.5:0/105759154 learned_addr learned my addr 172.21.15.5:0/105759154 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:51.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.689+0000 7f2c563b1640 1 --2- 172.21.15.5:0/105759154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556c200b52f0 0x556c20482000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:51.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.689+0000 7f2c55bb0640 1 --2- 172.21.15.5:0/105759154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556c200bd4d0 0x556c20482540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:51.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.690+0000 7f2c563b1640 1 -- 172.21.15.5:0/105759154 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556c200de1b0 msgr2=0x556c20481ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:51.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.690+0000 7f2c563b1640 1 --2- 172.21.15.5:0/105759154 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556c200de1b0 0x556c20481ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.690+0000 7f2c563b1640 1 -- 172.21.15.5:0/105759154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556c200bd4d0 msgr2=0x556c20482540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:51.694 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.690+0000 7f2c563b1640 1 --2- 172.21.15.5:0/105759154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556c200bd4d0 0x556c20482540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.694 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.690+0000 7f2c563b1640 1 -- 172.21.15.5:0/105759154 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c20149790 con 0x556c200b52f0 2024-08-31T05:33:51.694 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.690+0000 7f2c55bb0640 1 --2- 172.21.15.5:0/105759154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556c200bd4d0 0x556c20482540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:33:51.694 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.690+0000 7f2c563b1640 1 --2- 172.21.15.5:0/105759154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556c200b52f0 0x556c20482000 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c011510 tx=0x7f2c4c0119d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87ecf8850dae3c6a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:51.694 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.690+0000 7f2c477fe640 1 --2- 172.21.15.5:0/704800127 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2c3c0b4d20 0x7f2c3c0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:51.694 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.690+0000 7f2c44bfe640 1 -- 172.21.15.5:0/105759154 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c005020 con 0x556c200b52f0 2024-08-31T05:33:51.694 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.690+0000 7f2c55bb0640 1 --2- 172.21.15.5:0/704800127 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2c3c0b4d20 0x7f2c3c0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:51.694 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.690+0000 7f2c44bfe640 1 -- 172.21.15.5:0/105759154 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c4c0047a0 con 0x556c200b52f0 2024-08-31T05:33:51.694 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.690+0000 7f2c44bfe640 1 -- 172.21.15.5:0/105759154 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c00f8e0 con 0x556c200b52f0 2024-08-31T05:33:51.694 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.690+0000 7f2c477fe640 1 -- 172.21.15.5:0/704800127 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f2c480e5f80 con 0x7f2c50108a20 2024-08-31T05:33:51.698 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.691+0000 7f2c5f661740 1 -- 172.21.15.5:0/105759154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556c200b52f0 msgr2=0x556c20482000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:51.698 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.691+0000 7f2c5f661740 1 --2- 172.21.15.5:0/105759154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556c200b52f0 0x556c20482000 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c011510 tx=0x7f2c4c0119d0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.699 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.691+0000 7f2c55bb0640 1 --2- 172.21.15.5:0/704800127 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2c3c0b4d20 0x7f2c3c0b7230 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2c400057c0 tx=0x7f2c40030340 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:51.699 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.691+0000 7f2c5f661740 1 -- 172.21.15.5:0/105759154 shutdown_connections 2024-08-31T05:33:51.699 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.691+0000 7f2c5f661740 1 --2- 172.21.15.5:0/105759154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556c200bd4d0 0x556c20482540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.699 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.691+0000 7f2c5f661740 1 --2- 172.21.15.5:0/105759154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556c200b52f0 0x556c20482000 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.699 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.691+0000 7f2c5f661740 1 --2- 172.21.15.5:0/105759154 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556c200de1b0 0x556c20481ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.699 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.691+0000 7f2c5f661740 1 -- 172.21.15.5:0/105759154 >> 172.21.15.5:0/105759154 conn(0x556c200d2300 msgr2=0x556c2047f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:51.699 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.691+0000 7f2c5f661740 1 -- 172.21.15.5:0/105759154 shutdown_connections 2024-08-31T05:33:51.699 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.691+0000 7f2c5f661740 1 -- 172.21.15.5:0/105759154 wait complete. 2024-08-31T05:33:51.699 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.691+0000 7f2c5f661740 1 -- start start 2024-08-31T05:33:51.699 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.692+0000 7f2c5f661740 1 Processor -- start 2024-08-31T05:33:51.699 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.692+0000 7f2c5f661740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556c200b52f0 0x556c2048d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:51.699 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.692+0000 7f2c5f661740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556c200bd4d0 0x556c2048dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:51.700 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.692+0000 7f2c5f661740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556c200de1b0 0x556c20499590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:51.700 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.692+0000 7f2c5f661740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x556c2031fab0 con 0x556c200de1b0 2024-08-31T05:33:51.700 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.692+0000 7f2c5f661740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x556c2036d680 con 0x556c200b52f0 2024-08-31T05:33:51.700 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.692+0000 7f2c5f661740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556c20490240 con 0x556c200bd4d0 2024-08-31T05:33:51.700 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.692+0000 7f2c5f661740 10 client.0 _ll_register_callbacks cb 0x556c200f5a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:33:51.700 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.692+0000 7f2c56bb2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556c200de1b0 0x556c20499590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:51.700 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.692+0000 7f2c56bb2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556c200de1b0 0x556c20499590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34276/0 (socket says 172.21.15.5:34276) 2024-08-31T05:33:51.700 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.692+0000 7f2c56bb2640 1 -- 172.21.15.5:0/213915581 learned_addr learned my addr 172.21.15.5:0/213915581 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:51.700 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.692+0000 7f2c55bb0640 1 --2- 172.21.15.5:0/213915581 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556c200bd4d0 0x556c2048dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:51.700 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.692+0000 7f2c563b1640 1 --2- 172.21.15.5:0/213915581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556c200b52f0 0x556c2048d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:51.700 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.692+0000 7f2c56bb2640 1 -- 172.21.15.5:0/213915581 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556c200bd4d0 msgr2=0x556c2048dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:51.700 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.692+0000 7f2c56bb2640 1 --2- 172.21.15.5:0/213915581 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556c200bd4d0 0x556c2048dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.700 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.692+0000 7f2c56bb2640 1 -- 172.21.15.5:0/213915581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556c200b52f0 msgr2=0x556c2048d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:51.701 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.692+0000 7f2c56bb2640 1 --2- 172.21.15.5:0/213915581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556c200b52f0 0x556c2048d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.701 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.692+0000 7f2c56bb2640 1 -- 172.21.15.5:0/213915581 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c201c2620 con 0x556c200de1b0 2024-08-31T05:33:51.701 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.693+0000 7f2c56bb2640 1 --2- 172.21.15.5:0/213915581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556c200de1b0 0x556c20499590 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f2c48005820 tx=0x7f2c480acb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f673602647b5346 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:51.701 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.693+0000 7f2c39ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:33:51.701 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.693+0000 7f2c39ffb640 1 -- 172.21.15.5:0/213915581 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c480a8580 con 0x556c200de1b0 2024-08-31T05:33:51.701 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.693+0000 7f2c39ffb640 1 -- 172.21.15.5:0/213915581 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f2c480b5180 con 0x556c200de1b0 2024-08-31T05:33:51.701 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.693+0000 7f2c5f661740 1 -- 172.21.15.5:0/213915581 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c4c0047a0 con 0x556c200de1b0 2024-08-31T05:33:51.701 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.693+0000 7f2c39ffb640 1 -- 172.21.15.5:0/213915581 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f2c480a8720 con 0x556c200de1b0 2024-08-31T05:33:51.701 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.693+0000 7f2c5f661740 10 client.16569 fetch_fsmap learned FSMap version 34 2024-08-31T05:33:51.701 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.693+0000 7f2c5f661740 1 -- 172.21.15.5:0/213915581 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x556c2049c2d0 con 0x556c200de1b0 2024-08-31T05:33:51.701 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.693+0000 7f2c39ffb640 1 -- 172.21.15.5:0/213915581 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c4c0047a0 con 0x556c200de1b0 2024-08-31T05:33:51.701 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.693+0000 7f2c39ffb640 1 -- 172.21.15.5:0/213915581 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f2c480aafc0 con 0x556c200de1b0 2024-08-31T05:33:51.701 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.693+0000 7f2c5f661740 10 client.16569 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:33:51.702 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.693+0000 7f2c5f661740 10 client.16569 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:33:51.702 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.693+0000 7f2c5f661740 20 client.16569 populate_metadata read hostname 'smithi005' 2024-08-31T05:33:51.702 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.693+0000 7f2c5f661740 1 --2- 172.21.15.5:0/213915581 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x556c2009cd80 0x556c2049f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:51.702 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.694+0000 7f2c5f661740 4 client.16569 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:33:51.702 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.694+0000 7f2c5f661740 1 -- 172.21.15.5:0/213915581 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556c203f8f50 con 0x556c2009cd80 2024-08-31T05:33:51.702 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.694+0000 7f2c563b1640 1 --2- 172.21.15.5:0/213915581 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x556c2009cd80 0x556c2049f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:51.702 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.694+0000 7f2c563b1640 1 --2- 172.21.15.5:0/213915581 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x556c2009cd80 0x556c2049f7a0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1bbc8570fcc7c3c4 server_cookie=4ed6a49a2047b9fb in_seq=0 out_seq=0 2024-08-31T05:33:51.702 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.694+0000 7f2c39ffb640 10 client.16569 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:33:51.702 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.695+0000 7f2c39ffb640 1 -- 172.21.15.5:0/213915581 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556c203f8f50 con 0x556c2009cd80 2024-08-31T05:33:51.702 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.695+0000 7f2c39ffb640 10 client.16569 handle_command_reply: tid=0 2024-08-31T05:33:51.702 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.695+0000 7f2c5f661740 1 client.16569 shutdown 2024-08-31T05:33:51.702 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.695+0000 7f2c5f661740 1 -- 172.21.15.5:0/213915581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556c200de1b0 msgr2=0x556c20499590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:51.702 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.695+0000 7f2c5f661740 1 --2- 172.21.15.5:0/213915581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556c200de1b0 0x556c20499590 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f2c48005820 tx=0x7f2c480acb30 comp rx=0 tx=0).stop 2024-08-31T05:33:51.702 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.695+0000 7f2c5f661740 1 -- 172.21.15.5:0/213915581 shutdown_connections 2024-08-31T05:33:51.703 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.695+0000 7f2c5f661740 1 --2- 172.21.15.5:0/213915581 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x556c2009cd80 0x556c2049f7a0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.703 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.695+0000 7f2c5f661740 1 --2- 172.21.15.5:0/213915581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556c200de1b0 0x556c20499590 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.703 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.695+0000 7f2c5f661740 1 --2- 172.21.15.5:0/213915581 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556c200bd4d0 0x556c2048dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.703 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.695+0000 7f2c5f661740 1 --2- 172.21.15.5:0/213915581 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556c200b52f0 0x556c2048d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.703 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.695+0000 7f2c39ffb640 0 client.16569 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:33:51.703 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.695+0000 7f2c5f661740 1 -- 172.21.15.5:0/213915581 >> 172.21.15.5:0/213915581 conn(0x556c200d2300 msgr2=0x556c20482af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:51.703 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.695+0000 7f2c5f661740 1 -- 172.21.15.5:0/213915581 shutdown_connections 2024-08-31T05:33:51.703 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.695+0000 7f2c5f661740 1 -- 172.21.15.5:0/213915581 wait complete. 2024-08-31T05:33:51.703 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.695+0000 7f2c5f661740 20 client.16569 trim_cache size 0 max 16384 2024-08-31T05:33:51.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.710+0000 7f2c5f661740 1 Processor -- start 2024-08-31T05:33:51.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.710+0000 7f2c5f661740 1 -- start start 2024-08-31T05:33:51.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.710+0000 7f2c5f661740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556c200b52f0 0x556c20486b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:51.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.710+0000 7f2c5f661740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556c200bd4d0 0x556c204870c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:51.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.710+0000 7f2c5f661740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556c200de1b0 0x556c2048c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:51.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.710+0000 7f2c5f661740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2c501b2c70 con 0x556c200bd4d0 2024-08-31T05:33:51.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.710+0000 7f2c5f661740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2c501b47b0 con 0x556c200b52f0 2024-08-31T05:33:51.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.710+0000 7f2c5f661740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2c501b3340 con 0x556c200de1b0 2024-08-31T05:33:51.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.710+0000 7f2c55bb0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556c200bd4d0 0x556c204870c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:51.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.710+0000 7f2c55bb0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556c200bd4d0 0x556c204870c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34286/0 (socket says 172.21.15.5:34286) 2024-08-31T05:33:51.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.710+0000 7f2c55bb0640 1 -- 172.21.15.5:0/4279574327 learned_addr learned my addr 172.21.15.5:0/4279574327 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:51.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.710+0000 7f2c563b1640 1 --2- 172.21.15.5:0/4279574327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556c200b52f0 0x556c20486b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:51.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.710+0000 7f2c56bb2640 1 --2- 172.21.15.5:0/4279574327 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556c200de1b0 0x556c2048c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:51.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.710+0000 7f2c55bb0640 1 -- 172.21.15.5:0/4279574327 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556c200de1b0 msgr2=0x556c2048c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:51.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.710+0000 7f2c55bb0640 1 --2- 172.21.15.5:0/4279574327 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556c200de1b0 0x556c2048c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.710+0000 7f2c55bb0640 1 -- 172.21.15.5:0/4279574327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556c200b52f0 msgr2=0x556c20486b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:51.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.710+0000 7f2c55bb0640 1 --2- 172.21.15.5:0/4279574327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556c200b52f0 0x556c20486b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.711+0000 7f2c55bb0640 1 -- 172.21.15.5:0/4279574327 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c204802b0 con 0x556c200bd4d0 2024-08-31T05:33:51.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.711+0000 7f2c563b1640 1 --2- 172.21.15.5:0/4279574327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556c200b52f0 0x556c20486b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:51.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.711+0000 7f2c55bb0640 1 --2- 172.21.15.5:0/4279574327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556c200bd4d0 0x556c204870c0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f2c5006b340 tx=0x7f2c4003f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a6acd772a049c54 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:51.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.711+0000 7f2c3bfff640 1 -- 172.21.15.5:0/4279574327 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c40037040 con 0x556c200bd4d0 2024-08-31T05:33:51.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.711+0000 7f2c3bfff640 1 -- 172.21.15.5:0/4279574327 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c400327f0 con 0x556c200bd4d0 2024-08-31T05:33:51.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.711+0000 7f2c3bfff640 1 -- 172.21.15.5:0/4279574327 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c40003950 con 0x556c200bd4d0 2024-08-31T05:33:51.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.712+0000 7f2c5f661740 1 -- 172.21.15.5:0/4279574327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556c200bd4d0 msgr2=0x556c204870c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:51.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.712+0000 7f2c5f661740 1 --2- 172.21.15.5:0/4279574327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556c200bd4d0 0x556c204870c0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f2c5006b340 tx=0x7f2c4003f000 comp rx=0 tx=0).stop 2024-08-31T05:33:51.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.712+0000 7f2c5f661740 1 -- 172.21.15.5:0/4279574327 shutdown_connections 2024-08-31T05:33:51.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.712+0000 7f2c5f661740 1 --2- 172.21.15.5:0/4279574327 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556c200de1b0 0x556c2048c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.712+0000 7f2c5f661740 1 --2- 172.21.15.5:0/4279574327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556c200bd4d0 0x556c204870c0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.712+0000 7f2c5f661740 1 --2- 172.21.15.5:0/4279574327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556c200b52f0 0x556c20486b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.712+0000 7f2c5f661740 1 -- 172.21.15.5:0/4279574327 >> 172.21.15.5:0/4279574327 conn(0x556c200d2300 msgr2=0x556c204885d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:51.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.712+0000 7f2c5f661740 1 -- 172.21.15.5:0/4279574327 shutdown_connections 2024-08-31T05:33:51.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.712+0000 7f2c5f661740 1 -- 172.21.15.5:0/4279574327 wait complete. 2024-08-31T05:33:51.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.712+0000 7f2c5f661740 1 -- start start 2024-08-31T05:33:51.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.712+0000 7f2c5f661740 1 Processor -- start 2024-08-31T05:33:51.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.713+0000 7f2c5f661740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556c200b52f0 0x556c204918d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:51.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.713+0000 7f2c5f661740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556c200bd4d0 0x556c20491e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:51.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.713+0000 7f2c5f661740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556c200de1b0 0x556c20509120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:51.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.713+0000 7f2c5f661740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2c501b40e0 con 0x556c200b52f0 2024-08-31T05:33:51.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.713+0000 7f2c5f661740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2c501b3a10 con 0x556c200de1b0 2024-08-31T05:33:51.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.713+0000 7f2c5f661740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2c501b0c50 con 0x556c200bd4d0 2024-08-31T05:33:51.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.713+0000 7f2c5f661740 10 client.0 _ll_register_callbacks cb 0x7f2c480a81d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:33:51.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.713+0000 7f2c563b1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556c200b52f0 0x556c204918d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:51.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.713+0000 7f2c563b1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556c200b52f0 0x556c204918d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34292/0 (socket says 172.21.15.5:34292) 2024-08-31T05:33:51.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.713+0000 7f2c563b1640 1 -- 172.21.15.5:0/259292187 learned_addr learned my addr 172.21.15.5:0/259292187 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:51.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.713+0000 7f2c55bb0640 1 --2- 172.21.15.5:0/259292187 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556c200bd4d0 0x556c20491e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:51.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.713+0000 7f2c56bb2640 1 --2- 172.21.15.5:0/259292187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556c200de1b0 0x556c20509120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:51.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.713+0000 7f2c563b1640 1 -- 172.21.15.5:0/259292187 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556c200bd4d0 msgr2=0x556c20491e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:51.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.713+0000 7f2c563b1640 1 --2- 172.21.15.5:0/259292187 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556c200bd4d0 0x556c20491e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.713+0000 7f2c563b1640 1 -- 172.21.15.5:0/259292187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556c200de1b0 msgr2=0x556c20509120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:51.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.713+0000 7f2c563b1640 1 --2- 172.21.15.5:0/259292187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556c200de1b0 0x556c20509120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.713+0000 7f2c563b1640 1 -- 172.21.15.5:0/259292187 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c20509660 con 0x556c200b52f0 2024-08-31T05:33:51.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.713+0000 7f2c563b1640 1 --2- 172.21.15.5:0/259292187 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556c200b52f0 0x556c204918d0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x556c20480740 tx=0x7f2c4c009d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4021675aa18c780a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:51.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.713+0000 7f2c39ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:33:51.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.713+0000 7f2c39ffb640 1 -- 172.21.15.5:0/259292187 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c00fa50 con 0x556c200b52f0 2024-08-31T05:33:51.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.714+0000 7f2c39ffb640 1 -- 172.21.15.5:0/259292187 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f2c4c00fbf0 con 0x556c200b52f0 2024-08-31T05:33:51.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.714+0000 7f2c5f661740 1 -- 172.21.15.5:0/259292187 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c400327f0 con 0x556c200b52f0 2024-08-31T05:33:51.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.714+0000 7f2c39ffb640 1 -- 172.21.15.5:0/259292187 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f2c4c03b050 con 0x556c200b52f0 2024-08-31T05:33:51.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.714+0000 7f2c5f661740 10 client.16575 fetch_fsmap learned FSMap version 34 2024-08-31T05:33:51.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.714+0000 7f2c5f661740 1 -- 172.21.15.5:0/259292187 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x556c2050a790 con 0x556c200b52f0 2024-08-31T05:33:51.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.714+0000 7f2c39ffb640 1 -- 172.21.15.5:0/259292187 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c400327f0 con 0x556c200b52f0 2024-08-31T05:33:51.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.714+0000 7f2c39ffb640 1 -- 172.21.15.5:0/259292187 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f2c4c003ab0 con 0x556c200b52f0 2024-08-31T05:33:51.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.714+0000 7f2c5f661740 10 client.16575 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:33:51.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.714+0000 7f2c5f661740 10 client.16575 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:33:51.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.714+0000 7f2c5f661740 20 client.16575 populate_metadata read hostname 'smithi005' 2024-08-31T05:33:51.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.714+0000 7f2c5f661740 1 --2- 172.21.15.5:0/259292187 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x556c200721c0 0x556c2050cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:51.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.714+0000 7f2c5f661740 4 client.16575 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:33:51.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.714+0000 7f2c5f661740 1 -- 172.21.15.5:0/259292187 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556c203f49f0 con 0x556c200721c0 2024-08-31T05:33:51.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.714+0000 7f2c55bb0640 1 --2- 172.21.15.5:0/259292187 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x556c200721c0 0x556c2050cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:51.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.715+0000 7f2c39ffb640 10 client.16575 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:33:51.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.715+0000 7f2c55bb0640 1 --2- 172.21.15.5:0/259292187 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x556c200721c0 0x556c2050cdf0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=338ae9acfbbbcb2d server_cookie=9487c1d8677235fb in_seq=0 out_seq=0 2024-08-31T05:33:51.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.725+0000 7f2c39ffb640 1 -- 172.21.15.5:0/259292187 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556c203f49f0 con 0x556c200721c0 2024-08-31T05:33:51.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.725+0000 7f2c39ffb640 10 client.16575 handle_command_reply: tid=0 2024-08-31T05:33:51.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.725+0000 7f2c5f661740 1 client.16575 shutdown 2024-08-31T05:33:51.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.725+0000 7f2c5f661740 1 -- 172.21.15.5:0/259292187 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556c200b52f0 msgr2=0x556c204918d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:51.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.725+0000 7f2c5f661740 1 --2- 172.21.15.5:0/259292187 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556c200b52f0 0x556c204918d0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x556c20480740 tx=0x7f2c4c009d90 comp rx=0 tx=0).stop 2024-08-31T05:33:51.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.725+0000 7f2c5f661740 1 -- 172.21.15.5:0/259292187 shutdown_connections 2024-08-31T05:33:51.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.725+0000 7f2c5f661740 1 --2- 172.21.15.5:0/259292187 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x556c200721c0 0x556c2050cdf0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.725+0000 7f2c5f661740 1 --2- 172.21.15.5:0/259292187 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556c200de1b0 0x556c20509120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.725+0000 7f2c39ffb640 0 client.16575 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:33:51.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.725+0000 7f2c5f661740 1 --2- 172.21.15.5:0/259292187 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556c200bd4d0 0x556c20491e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.725+0000 7f2c5f661740 1 --2- 172.21.15.5:0/259292187 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556c200b52f0 0x556c204918d0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.725+0000 7f2c5f661740 1 -- 172.21.15.5:0/259292187 >> 172.21.15.5:0/259292187 conn(0x556c200d2300 msgr2=0x556c204885d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:51.729 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.725+0000 7f2c5f661740 1 -- 172.21.15.5:0/259292187 shutdown_connections 2024-08-31T05:33:51.729 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.725+0000 7f2c5f661740 1 -- 172.21.15.5:0/259292187 wait complete. 2024-08-31T05:33:51.729 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.725+0000 7f2c5f661740 20 client.16575 trim_cache size 0 max 16384 2024-08-31T05:33:51.729 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:33:51.729 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:33:51.729 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:33:51.729 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:33:51.730 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.726+0000 7f2c58615640 1 -- 172.21.15.5:0/704800127 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2c3c0b4d20 msgr2=0x7f2c3c0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:51.730 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.726+0000 7f2c58615640 1 --2- 172.21.15.5:0/704800127 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2c3c0b4d20 0x7f2c3c0b7230 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2c400057c0 tx=0x7f2c40030340 comp rx=0 tx=0).stop 2024-08-31T05:33:51.730 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.726+0000 7f2c58615640 1 -- 172.21.15.5:0/704800127 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c50108a20 msgr2=0x7f2c50199810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:51.730 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.726+0000 7f2c58615640 1 --2- 172.21.15.5:0/704800127 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c50108a20 0x7f2c50199810 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2c48009fd0 tx=0x7f2c4800ef10 comp rx=0 tx=0).stop 2024-08-31T05:33:51.730 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.726+0000 7f2c58615640 1 -- 172.21.15.5:0/704800127 shutdown_connections 2024-08-31T05:33:51.730 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.726+0000 7f2c58615640 1 --2- 172.21.15.5:0/704800127 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2c3c0b4d20 0x7f2c3c0b7230 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.731 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.726+0000 7f2c58615640 1 --2- 172.21.15.5:0/704800127 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c50108a20 0x7f2c50199810 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.731 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.726+0000 7f2c58615640 1 --2- 172.21.15.5:0/704800127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c501080d0 0x7f2c501992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.731 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.726+0000 7f2c58615640 1 --2- 172.21.15.5:0/704800127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c501027a0 0x7f2c50198d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:51.731 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.726+0000 7f2c58615640 1 -- 172.21.15.5:0/704800127 >> 172.21.15.5:0/704800127 conn(0x7f2c5007a4b0 msgr2=0x7f2c50106120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:51.731 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.726+0000 7f2c58615640 1 -- 172.21.15.5:0/704800127 shutdown_connections 2024-08-31T05:33:51.731 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:33:51.726+0000 7f2c58615640 1 -- 172.21.15.5:0/704800127 wait complete. 2024-08-31T05:33:51.914 INFO:tasks.workunit.client.0.smithi005.stdout: 1 400087 13.38 MB/sec execute 39 sec latency 22.562 ms 2024-08-31T05:33:52.491 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T05:33:52.491 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T05:33:52.761 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:33:52.914 INFO:tasks.workunit.client.0.smithi005.stdout: 1 401833 13.27 MB/sec execute 40 sec latency 86.497 ms 2024-08-31T05:33:53.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.402+0000 7f577a13b640 1 -- 172.21.15.5:0/3336588169 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5774109250 msgr2=0x7f5774109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:53.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.402+0000 7f577a13b640 1 --2- 172.21.15.5:0/3336588169 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5774109250 0x7f5774109660 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f575c009900 tx=0x7f575c02a410 comp rx=0 tx=0).stop 2024-08-31T05:33:53.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.402+0000 7f577a13b640 1 -- 172.21.15.5:0/3336588169 shutdown_connections 2024-08-31T05:33:53.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.402+0000 7f577a13b640 1 --2- 172.21.15.5:0/3336588169 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5774109ba0 0x7f57741103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:53.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.402+0000 7f577a13b640 1 --2- 172.21.15.5:0/3336588169 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5774109250 0x7f5774109660 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:53.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.402+0000 7f577a13b640 1 --2- 172.21.15.5:0/3336588169 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5774103960 0x7f5774103d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:53.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.402+0000 7f577a13b640 1 -- 172.21.15.5:0/3336588169 >> 172.21.15.5:0/3336588169 conn(0x7f577407b6b0 msgr2=0x7f577407bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:53.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.402+0000 7f577a13b640 1 -- 172.21.15.5:0/3336588169 shutdown_connections 2024-08-31T05:33:53.405 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:33:53 smithi005 ceph-mon[18602]: pgmap v462: 129 pgs: 129 active+clean; 202 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.2 MiB/s wr, 219 op/s 2024-08-31T05:33:53.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.402+0000 7f577a13b640 1 -- 172.21.15.5:0/3336588169 wait complete. 2024-08-31T05:33:53.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.403+0000 7f577a13b640 1 Processor -- start 2024-08-31T05:33:53.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.403+0000 7f577a13b640 1 -- start start 2024-08-31T05:33:53.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.404+0000 7f577a13b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5774103960 0x7f577419a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:53.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.404+0000 7f577a13b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5774109250 0x7f577419a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:53.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.404+0000 7f577a13b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5774109ba0 0x7f577419fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:53.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.404+0000 7f577a13b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5774113860 con 0x7f5774103960 2024-08-31T05:33:53.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.404+0000 7f577a13b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f57741136e0 con 0x7f5774109ba0 2024-08-31T05:33:53.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.404+0000 7f577a13b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f57741139e0 con 0x7f5774109250 2024-08-31T05:33:53.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.404+0000 7f57737fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5774103960 0x7f577419a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:53.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.404+0000 7f576affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5774109250 0x7f577419a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:53.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.404+0000 7f57737fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5774103960 0x7f577419a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50652/0 (socket says 172.21.15.5:50652) 2024-08-31T05:33:53.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.404+0000 7f576affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5774109250 0x7f577419a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:56170/0 (socket says 172.21.15.5:56170) 2024-08-31T05:33:53.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.404+0000 7f57737fe640 1 -- 172.21.15.5:0/4108840080 learned_addr learned my addr 172.21.15.5:0/4108840080 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:53.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.404+0000 7f5773fff640 1 --2- 172.21.15.5:0/4108840080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5774109ba0 0x7f577419fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:53.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.404+0000 7f5773fff640 1 -- 172.21.15.5:0/4108840080 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5774109250 msgr2=0x7f577419a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:53.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.404+0000 7f5773fff640 1 --2- 172.21.15.5:0/4108840080 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5774109250 0x7f577419a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:53.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.404+0000 7f5773fff640 1 -- 172.21.15.5:0/4108840080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5774103960 msgr2=0x7f577419a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:53.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.404+0000 7f5773fff640 1 --2- 172.21.15.5:0/4108840080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5774103960 0x7f577419a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:53.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.404+0000 7f5773fff640 1 -- 172.21.15.5:0/4108840080 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57741a01a0 con 0x7f5774109ba0 2024-08-31T05:33:53.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.404+0000 7f57737fe640 1 --2- 172.21.15.5:0/4108840080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5774103960 0x7f577419a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:53.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.405+0000 7f5773fff640 1 --2- 172.21.15.5:0/4108840080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5774109ba0 0x7f577419fa70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f576c00ec50 tx=0x7f576c00c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:53.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.405+0000 7f57717fa640 1 -- 172.21.15.5:0/4108840080 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576c003b70 con 0x7f5774109ba0 2024-08-31T05:33:53.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.405+0000 7f577a13b640 1 -- 172.21.15.5:0/4108840080 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57741a0490 con 0x7f5774109ba0 2024-08-31T05:33:53.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.405+0000 7f57717fa640 1 -- 172.21.15.5:0/4108840080 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f576c003d10 con 0x7f5774109ba0 2024-08-31T05:33:53.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.405+0000 7f57717fa640 1 -- 172.21.15.5:0/4108840080 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576c010830 con 0x7f5774109ba0 2024-08-31T05:33:53.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.405+0000 7f577a13b640 1 -- 172.21.15.5:0/4108840080 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57741a6bf0 con 0x7f5774109ba0 2024-08-31T05:33:53.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.406+0000 7f577a13b640 1 -- 172.21.15.5:0/4108840080 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5774103d70 con 0x7f5774109ba0 2024-08-31T05:33:53.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.408+0000 7f57717fa640 1 -- 172.21.15.5:0/4108840080 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f576c004b40 con 0x7f5774109ba0 2024-08-31T05:33:53.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.409+0000 7f57717fa640 1 --2- 172.21.15.5:0/4108840080 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f57600b4ca0 0x7f57600b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:53.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.409+0000 7f57737fe640 1 --2- 172.21.15.5:0/4108840080 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f57600b4ca0 0x7f57600b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:53.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.409+0000 7f57717fa640 1 -- 172.21.15.5:0/4108840080 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f576c0e5ea0 con 0x7f5774109ba0 2024-08-31T05:33:53.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.410+0000 7f57737fe640 1 --2- 172.21.15.5:0/4108840080 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f57600b4ca0 0x7f57600b71b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5764011550 tx=0x7f5764005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:53.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.412+0000 7f57717fa640 1 -- 172.21.15.5:0/4108840080 <== mon.2 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f576c0ac9a0 con 0x7f5774109ba0 2024-08-31T05:33:53.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:33:53 smithi070 ceph-mon[22316]: pgmap v462: 129 pgs: 129 active+clean; 202 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.2 MiB/s wr, 219 op/s 2024-08-31T05:33:53.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.654+0000 7f577a13b640 1 -- 172.21.15.5:0/4108840080 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f577419b360 con 0x7f5774109ba0 2024-08-31T05:33:53.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:33:53 smithi050 ceph-mon[22146]: pgmap v462: 129 pgs: 129 active+clean; 202 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.2 MiB/s wr, 219 op/s 2024-08-31T05:33:53.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.655+0000 7f57717fa640 1 -- 172.21.15.5:0/4108840080 <== mon.2 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11941 (secure 0 0 0) 0x7f577419b360 con 0x7f5774109ba0 2024-08-31T05:33:53.657 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:33:53.657 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":34,"btime":"2024-08-31T05:33:43:289944+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14739,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2024812199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2024812199},{"type":"v1","addr":"172.21.15.5:6835","nonce":2024812199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3629023702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3629023702},{"type":"v1","addr":"172.21.15.5:6837","nonce":3629023702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T05:27:31.929153+0000","modified":"2024-08-31T05:33:42.378207+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24652,"mds_1":24638,"mds_2":24631,"mds_3":24625,"mds_4":24602},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6839/2412701258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":2412701258},{"type":"v1","addr":"172.21.15.5:6839","nonce":2412701258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14820":{"gid":14820,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6841/747057838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":747057838},{"type":"v1","addr":"172.21.15.5:6841","nonce":747057838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6833/1153378982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1153378982},{"type":"v1","addr":"172.21.15.50:6833","nonce":1153378982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6833/364083443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":364083443},{"type":"v1","addr":"172.21.15.70:6833","nonce":364083443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24587":{"gid":24587,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/2346896794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2346896794},{"type":"v1","addr":"172.21.15.50:6835","nonce":2346896794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24602":{"gid":24602,"name":"h","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.50:6837/428759669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":428759669},{"type":"v1","addr":"172.21.15.50:6837","nonce":428759669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.70:6835/2061504114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2061504114},{"type":"v1","addr":"172.21.15.70:6835","nonce":2061504114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.70:6837/2780036414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2780036414},{"type":"v1","addr":"172.21.15.70:6837","nonce":2780036414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.50:6839/98200944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":98200944},{"type":"v1","addr":"172.21.15.50:6839","nonce":98200944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24652":{"gid":24652,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.70:6839/2756569250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":2756569250},{"type":"v1","addr":"172.21.15.70:6839","nonce":2756569250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24652,"qdb_cluster":[24652,24631,24638,24625,24602]},"id":1}]} 2024-08-31T05:33:53.658 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 34 2024-08-31T05:33:53.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.657+0000 7f577a13b640 1 -- 172.21.15.5:0/4108840080 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f57600b4ca0 msgr2=0x7f57600b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:53.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.657+0000 7f577a13b640 1 --2- 172.21.15.5:0/4108840080 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f57600b4ca0 0x7f57600b71b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5764011550 tx=0x7f5764005f90 comp rx=0 tx=0).stop 2024-08-31T05:33:53.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.657+0000 7f577a13b640 1 -- 172.21.15.5:0/4108840080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5774109ba0 msgr2=0x7f577419fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:53.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.657+0000 7f577a13b640 1 --2- 172.21.15.5:0/4108840080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5774109ba0 0x7f577419fa70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f576c00ec50 tx=0x7f576c00c6a0 comp rx=0 tx=0).stop 2024-08-31T05:33:53.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.658+0000 7f577a13b640 1 -- 172.21.15.5:0/4108840080 shutdown_connections 2024-08-31T05:33:53.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.658+0000 7f577a13b640 1 --2- 172.21.15.5:0/4108840080 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f57600b4ca0 0x7f57600b71b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:53.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.658+0000 7f577a13b640 1 --2- 172.21.15.5:0/4108840080 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5774109ba0 0x7f577419fa70 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:53.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.658+0000 7f577a13b640 1 --2- 172.21.15.5:0/4108840080 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5774109250 0x7f577419a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:53.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.658+0000 7f577a13b640 1 --2- 172.21.15.5:0/4108840080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5774103960 0x7f577419a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:53.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.658+0000 7f577a13b640 1 -- 172.21.15.5:0/4108840080 >> 172.21.15.5:0/4108840080 conn(0x7f577407b6b0 msgr2=0x7f5774105320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:53.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.658+0000 7f577a13b640 1 -- 172.21.15.5:0/4108840080 shutdown_connections 2024-08-31T05:33:53.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:53.658+0000 7f577a13b640 1 -- 172.21.15.5:0/4108840080 wait complete. 2024-08-31T05:33:53.914 INFO:tasks.workunit.client.0.smithi005.stdout: 1 404620 13.39 MB/sec execute 41 sec latency 38.981 ms 2024-08-31T05:33:54.433 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-31T05:33:54.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:33:54 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/4108840080' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:33:54.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:33:54 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/4108840080' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:33:54.712 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:33:54.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:33:54 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/4108840080' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:33:54.914 INFO:tasks.workunit.client.0.smithi005.stdout: 1 406936 13.26 MB/sec execute 42 sec latency 13.848 ms 2024-08-31T05:33:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.229+0000 7f3b59124640 1 -- 172.21.15.5:0/2746452120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b54102840 msgr2=0x7f3b54102c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.229+0000 7f3b59124640 1 --2- 172.21.15.5:0/2746452120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b54102840 0x7f3b54102c50 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f3b44009900 tx=0x7f3b4402a410 comp rx=0 tx=0).stop 2024-08-31T05:33:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.229+0000 7f3b59124640 1 -- 172.21.15.5:0/2746452120 shutdown_connections 2024-08-31T05:33:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.229+0000 7f3b59124640 1 --2- 172.21.15.5:0/2746452120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b54108ad0 0x7f3b5410f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:55.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.229+0000 7f3b59124640 1 --2- 172.21.15.5:0/2746452120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b54108180 0x7f3b54108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:55.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.229+0000 7f3b59124640 1 --2- 172.21.15.5:0/2746452120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b54102840 0x7f3b54102c50 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:55.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.229+0000 7f3b59124640 1 -- 172.21.15.5:0/2746452120 >> 172.21.15.5:0/2746452120 conn(0x7f3b540794f0 msgr2=0x7f3b54079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:55.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.229+0000 7f3b59124640 1 -- 172.21.15.5:0/2746452120 shutdown_connections 2024-08-31T05:33:55.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.229+0000 7f3b59124640 1 -- 172.21.15.5:0/2746452120 wait complete. 2024-08-31T05:33:55.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.230+0000 7f3b59124640 1 Processor -- start 2024-08-31T05:33:55.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.230+0000 7f3b59124640 1 -- start start 2024-08-31T05:33:55.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.230+0000 7f3b59124640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b54102840 0x7f3b5419a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:55.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.230+0000 7f3b59124640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b54108180 0x7f3b5419a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:55.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.230+0000 7f3b59124640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b54108ad0 0x7f3b5419fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:55.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.230+0000 7f3b59124640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3b541127a0 con 0x7f3b54108ad0 2024-08-31T05:33:55.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.230+0000 7f3b59124640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3b54112620 con 0x7f3b54108180 2024-08-31T05:33:55.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.230+0000 7f3b59124640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3b54112920 con 0x7f3b54102840 2024-08-31T05:33:55.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.230+0000 7f3b52d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b54102840 0x7f3b5419a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:55.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.230+0000 7f3b52d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b54102840 0x7f3b5419a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:56184/0 (socket says 172.21.15.5:56184) 2024-08-31T05:33:55.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.230+0000 7f3b52d9d640 1 -- 172.21.15.5:0/3681159608 learned_addr learned my addr 172.21.15.5:0/3681159608 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:55.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.230+0000 7f3b5359e640 1 --2- 172.21.15.5:0/3681159608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b54108ad0 0x7f3b5419fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:55.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.230+0000 7f3b4bfff640 1 --2- 172.21.15.5:0/3681159608 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b54108180 0x7f3b5419a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:55.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.231+0000 7f3b52d9d640 1 -- 172.21.15.5:0/3681159608 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b54108180 msgr2=0x7f3b5419a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:55.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.231+0000 7f3b52d9d640 1 --2- 172.21.15.5:0/3681159608 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b54108180 0x7f3b5419a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:55.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.231+0000 7f3b52d9d640 1 -- 172.21.15.5:0/3681159608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b54108ad0 msgr2=0x7f3b5419fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:55.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.231+0000 7f3b52d9d640 1 --2- 172.21.15.5:0/3681159608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b54108ad0 0x7f3b5419fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:55.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.231+0000 7f3b52d9d640 1 -- 172.21.15.5:0/3681159608 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b541a01f0 con 0x7f3b54102840 2024-08-31T05:33:55.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.231+0000 7f3b5359e640 1 --2- 172.21.15.5:0/3681159608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b54108ad0 0x7f3b5419fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:55.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.231+0000 7f3b52d9d640 1 --2- 172.21.15.5:0/3681159608 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b54102840 0x7f3b5419a280 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3b44005940 tx=0x7f3b440040c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:55.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.232+0000 7f3b50d99640 1 -- 172.21.15.5:0/3681159608 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4403f030 con 0x7f3b54102840 2024-08-31T05:33:55.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.232+0000 7f3b59124640 1 -- 172.21.15.5:0/3681159608 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b541a0480 con 0x7f3b54102840 2024-08-31T05:33:55.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.232+0000 7f3b50d99640 1 -- 172.21.15.5:0/3681159608 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b440044c0 con 0x7f3b54102840 2024-08-31T05:33:55.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.232+0000 7f3b50d99640 1 -- 172.21.15.5:0/3681159608 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b44035070 con 0x7f3b54102840 2024-08-31T05:33:55.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.232+0000 7f3b59124640 1 -- 172.21.15.5:0/3681159608 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b540ff2f0 con 0x7f3b54102840 2024-08-31T05:33:55.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.234+0000 7f3b5f699740 1 Processor -- start 2024-08-31T05:33:55.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.234+0000 7f3b5f699740 1 -- start start 2024-08-31T05:33:55.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.235+0000 7f3b5f699740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654c841c070 0x5654c87c1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:55.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.235+0000 7f3b5f699740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654c83f31b0 0x5654c87c1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:55.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.235+0000 7f3b5f699740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654c83fb390 0x5654c87c1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:55.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.235+0000 7f3b5f699740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5654c8738680 con 0x5654c83f31b0 2024-08-31T05:33:55.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.235+0000 7f3b5f699740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5654c8727c10 con 0x5654c83fb390 2024-08-31T05:33:55.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.235+0000 7f3b5f699740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5654c872bbc0 con 0x5654c841c070 2024-08-31T05:33:55.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.235+0000 7f3b5359e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654c841c070 0x5654c87c1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:55.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.235+0000 7f3b5359e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654c841c070 0x5654c87c1350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:56186/0 (socket says 172.21.15.5:56186) 2024-08-31T05:33:55.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.235+0000 7f3b5359e640 1 -- 172.21.15.5:0/2579002964 learned_addr learned my addr 172.21.15.5:0/2579002964 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:55.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.235+0000 7f3b50d99640 1 -- 172.21.15.5:0/3681159608 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f3b44042030 con 0x7f3b54102840 2024-08-31T05:33:55.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.235+0000 7f3b4bfff640 1 --2- 172.21.15.5:0/2579002964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654c83fb390 0x5654c87c1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:55.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.235+0000 7f3b52d9d640 1 --2- 172.21.15.5:0/2579002964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654c83f31b0 0x5654c87c1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:55.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.235+0000 7f3b5359e640 1 -- 172.21.15.5:0/2579002964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654c83fb390 msgr2=0x5654c87c1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:55.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.235+0000 7f3b5359e640 1 --2- 172.21.15.5:0/2579002964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654c83fb390 0x5654c87c1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:55.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.235+0000 7f3b5359e640 1 -- 172.21.15.5:0/2579002964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654c83f31b0 msgr2=0x5654c87c1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:55.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.235+0000 7f3b5359e640 1 --2- 172.21.15.5:0/2579002964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654c83f31b0 0x5654c87c1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:55.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.235+0000 7f3b5359e640 1 -- 172.21.15.5:0/2579002964 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654c8487650 con 0x5654c841c070 2024-08-31T05:33:55.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.235+0000 7f3b4bfff640 1 --2- 172.21.15.5:0/2579002964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654c83fb390 0x5654c87c1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:55.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.236+0000 7f3b5359e640 1 --2- 172.21.15.5:0/2579002964 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654c841c070 0x5654c87c1350 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c010a80 tx=0x7f3b4c009500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=514f0234eef91c52 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:55.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.236+0000 7f3b497fa640 1 -- 172.21.15.5:0/2579002964 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c003c30 con 0x5654c841c070 2024-08-31T05:33:55.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.236+0000 7f3b497fa640 1 -- 172.21.15.5:0/2579002964 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b4c01f070 con 0x5654c841c070 2024-08-31T05:33:55.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.236+0000 7f3b497fa640 1 -- 172.21.15.5:0/2579002964 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c004730 con 0x5654c841c070 2024-08-31T05:33:55.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.236+0000 7f3b50d99640 1 --2- 172.21.15.5:0/3681159608 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f3b400b4ca0 0x7f3b400b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:55.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.236+0000 7f3b52d9d640 1 --2- 172.21.15.5:0/3681159608 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f3b400b4ca0 0x7f3b400b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:55.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.236+0000 7f3b50d99640 1 -- 172.21.15.5:0/3681159608 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f3b44105c50 con 0x7f3b54102840 2024-08-31T05:33:55.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.237+0000 7f3b5f699740 1 -- 172.21.15.5:0/2579002964 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654c841c070 msgr2=0x5654c87c1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:55.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.237+0000 7f3b52d9d640 1 --2- 172.21.15.5:0/3681159608 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f3b400b4ca0 0x7f3b400b71b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3b441030d0 tx=0x7f3b4403b4f0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:55.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.237+0000 7f3b5f699740 1 --2- 172.21.15.5:0/2579002964 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654c841c070 0x5654c87c1350 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c010a80 tx=0x7f3b4c009500 comp rx=0 tx=0).stop 2024-08-31T05:33:55.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.237+0000 7f3b5f699740 1 -- 172.21.15.5:0/2579002964 shutdown_connections 2024-08-31T05:33:55.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.237+0000 7f3b5f699740 1 --2- 172.21.15.5:0/2579002964 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654c83fb390 0x5654c87c1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:55.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.237+0000 7f3b5f699740 1 --2- 172.21.15.5:0/2579002964 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654c83f31b0 0x5654c87c1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:55.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.237+0000 7f3b5f699740 1 --2- 172.21.15.5:0/2579002964 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654c841c070 0x5654c87c1350 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:55.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.237+0000 7f3b5f699740 1 -- 172.21.15.5:0/2579002964 >> 172.21.15.5:0/2579002964 conn(0x5654c8410460 msgr2=0x5654c87bf240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:55.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.237+0000 7f3b5f699740 1 -- 172.21.15.5:0/2579002964 shutdown_connections 2024-08-31T05:33:55.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.237+0000 7f3b5f699740 1 -- 172.21.15.5:0/2579002964 wait complete. 2024-08-31T05:33:55.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.238+0000 7f3b5f699740 1 -- start start 2024-08-31T05:33:55.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.238+0000 7f3b5f699740 1 Processor -- start 2024-08-31T05:33:55.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.238+0000 7f3b5f699740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654c83f31b0 0x5654c87cca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:55.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.238+0000 7f3b5f699740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654c83fb390 0x5654c87ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:55.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.238+0000 7f3b5f699740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654c841c070 0x5654c87d8e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:55.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.238+0000 7f3b5f699740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5654c858a700 con 0x5654c841c070 2024-08-31T05:33:55.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.238+0000 7f3b5f699740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5654c86ae750 con 0x5654c83fb390 2024-08-31T05:33:55.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.238+0000 7f3b5f699740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5654c87cfb30 con 0x5654c83f31b0 2024-08-31T05:33:55.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.238+0000 7f3b5f699740 10 client.0 _ll_register_callbacks cb 0x5654c86dde10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:33:55.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.238+0000 7f3b5359e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654c83f31b0 0x5654c87cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:55.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.238+0000 7f3b5359e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654c83f31b0 0x5654c87cca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:56188/0 (socket says 172.21.15.5:56188) 2024-08-31T05:33:55.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.238+0000 7f3b5359e640 1 -- 172.21.15.5:0/571076951 learned_addr learned my addr 172.21.15.5:0/571076951 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:55.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.239+0000 7f3b4bfff640 1 --2- 172.21.15.5:0/571076951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654c83fb390 0x5654c87ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:55.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.239+0000 7f3b5359e640 1 --2- 172.21.15.5:0/571076951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654c841c070 0x5654c87d8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:55.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.239+0000 7f3b4bfff640 1 -- 172.21.15.5:0/571076951 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654c83f31b0 msgr2=0x5654c87cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:55.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.239+0000 7f3b4bfff640 1 --2- 172.21.15.5:0/571076951 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654c83f31b0 0x5654c87cca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:55.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.239+0000 7f3b4bfff640 1 -- 172.21.15.5:0/571076951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654c841c070 msgr2=0x5654c87d8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:55.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.239+0000 7f3b4bfff640 1 --2- 172.21.15.5:0/571076951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654c841c070 0x5654c87d8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:55.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.239+0000 7f3b4bfff640 1 -- 172.21.15.5:0/571076951 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654c86e7900 con 0x5654c83fb390 2024-08-31T05:33:55.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.239+0000 7f3b5359e640 1 --2- 172.21.15.5:0/571076951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654c841c070 0x5654c87d8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:55.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.239+0000 7f3b4bfff640 1 --2- 172.21.15.5:0/571076951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654c83fb390 0x5654c87ccfb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3b5406a630 tx=0x7f3b3c012b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2ca595c9a3be501 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:55.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.239+0000 7f3b3a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:33:55.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.239+0000 7f3b3a7fc640 1 -- 172.21.15.5:0/571076951 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c004030 con 0x5654c83fb390 2024-08-31T05:33:55.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.240+0000 7f3b3a7fc640 1 -- 172.21.15.5:0/571076951 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f3b3c0041d0 con 0x5654c83fb390 2024-08-31T05:33:55.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.240+0000 7f3b5f699740 1 -- 172.21.15.5:0/571076951 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b4c01f070 con 0x5654c83fb390 2024-08-31T05:33:55.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.240+0000 7f3b3a7fc640 1 -- 172.21.15.5:0/571076951 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f3b3c025050 con 0x5654c83fb390 2024-08-31T05:33:55.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.240+0000 7f3b5f699740 10 client.26186 fetch_fsmap learned FSMap version 34 2024-08-31T05:33:55.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.240+0000 7f3b5f699740 1 -- 172.21.15.5:0/571076951 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5654c87db900 con 0x5654c83fb390 2024-08-31T05:33:55.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.240+0000 7f3b3a7fc640 1 -- 172.21.15.5:0/571076951 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b4c01f070 con 0x5654c83fb390 2024-08-31T05:33:55.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.240+0000 7f3b3a7fc640 1 -- 172.21.15.5:0/571076951 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f3b3c003910 con 0x5654c83fb390 2024-08-31T05:33:55.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.240+0000 7f3b5f699740 10 client.26186 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:33:55.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.240+0000 7f3b5f699740 10 client.26186 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-31T05:33:55.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.240+0000 7f3b5f699740 20 client.26186 populate_metadata read hostname 'smithi005' 2024-08-31T05:33:55.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.240+0000 7f3b5f699740 1 --2- 172.21.15.5:0/571076951 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x5654c83da9f0 0x5654c87dee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:55.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.240+0000 7f3b5f699740 4 client.26186 mds_command: new command op to 24602 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:33:55.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.240+0000 7f3b5f699740 1 -- 172.21.15.5:0/571076951 --> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5654c873a5d0 con 0x5654c83da9f0 2024-08-31T05:33:55.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.240+0000 7f3b5359e640 1 --2- 172.21.15.5:0/571076951 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x5654c83da9f0 0x5654c87dee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:55.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.241+0000 7f3b3a7fc640 10 client.26186 ms_handle_connect on v2:172.21.15.50:6836/428759669 2024-08-31T05:33:55.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.241+0000 7f3b5359e640 1 --2- 172.21.15.5:0/571076951 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x5654c83da9f0 0x5654c87dee50 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=dce8a112e5aebb94 server_cookie=60a5ad463790939d in_seq=0 out_seq=0 2024-08-31T05:33:55.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.242+0000 7f3b3a7fc640 1 -- 172.21.15.5:0/571076951 <== mds.4 v2:172.21.15.50:6836/428759669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5654c873a5d0 con 0x5654c83da9f0 2024-08-31T05:33:55.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.242+0000 7f3b3a7fc640 10 client.26186 handle_command_reply: tid=0 2024-08-31T05:33:55.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.242+0000 7f3b5f699740 1 client.26186 shutdown 2024-08-31T05:33:55.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.242+0000 7f3b5f699740 1 -- 172.21.15.5:0/571076951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654c83fb390 msgr2=0x5654c87ccfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:55.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.242+0000 7f3b5f699740 1 --2- 172.21.15.5:0/571076951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654c83fb390 0x5654c87ccfb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3b5406a630 tx=0x7f3b3c012b60 comp rx=0 tx=0).stop 2024-08-31T05:33:55.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.242+0000 7f3b5f699740 1 -- 172.21.15.5:0/571076951 shutdown_connections 2024-08-31T05:33:55.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.242+0000 7f3b5f699740 1 --2- 172.21.15.5:0/571076951 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x5654c83da9f0 0x5654c87dee50 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:55.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.242+0000 7f3b5f699740 1 --2- 172.21.15.5:0/571076951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654c841c070 0x5654c87d8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:55.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.242+0000 7f3b5f699740 1 --2- 172.21.15.5:0/571076951 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654c83fb390 0x5654c87ccfb0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:55.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.242+0000 7f3b5f699740 1 --2- 172.21.15.5:0/571076951 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654c83f31b0 0x5654c87cca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:55.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.242+0000 7f3b3a7fc640 0 client.26186 ms_handle_reset on v2:172.21.15.50:6836/428759669 2024-08-31T05:33:55.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.242+0000 7f3b5f699740 1 -- 172.21.15.5:0/571076951 >> 172.21.15.5:0/571076951 conn(0x5654c8410460 msgr2=0x5654c87c44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:55.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.242+0000 7f3b5f699740 1 -- 172.21.15.5:0/571076951 shutdown_connections 2024-08-31T05:33:55.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.242+0000 7f3b5f699740 1 -- 172.21.15.5:0/571076951 wait complete. 2024-08-31T05:33:55.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.242+0000 7f3b5f699740 20 client.26186 trim_cache size 0 max 16384 2024-08-31T05:33:55.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.258+0000 7f3b5f699740 1 Processor -- start 2024-08-31T05:33:55.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.258+0000 7f3b5f699740 1 -- start start 2024-08-31T05:33:55.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.258+0000 7f3b5f699740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654c83f31b0 0x5654c87ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:55.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.258+0000 7f3b5f699740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654c83fb390 0x5654c87d8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:55.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.258+0000 7f3b5f699740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654c841c070 0x5654c87c4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:55.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.258+0000 7f3b5f699740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3b541aea30 con 0x5654c841c070 2024-08-31T05:33:55.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.258+0000 7f3b5f699740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3b541b0570 con 0x5654c83fb390 2024-08-31T05:33:55.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.258+0000 7f3b5f699740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3b541af100 con 0x5654c83f31b0 2024-08-31T05:33:55.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.259+0000 7f3b5359e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654c83f31b0 0x5654c87ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:55.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.259+0000 7f3b5359e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654c841c070 0x5654c87c4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:55.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.259+0000 7f3b5359e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654c841c070 0x5654c87c4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50684/0 (socket says 172.21.15.5:50684) 2024-08-31T05:33:55.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.259+0000 7f3b5359e640 1 -- 172.21.15.5:0/2152764282 learned_addr learned my addr 172.21.15.5:0/2152764282 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:55.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.259+0000 7f3b4bfff640 1 --2- 172.21.15.5:0/2152764282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654c83fb390 0x5654c87d8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:55.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.259+0000 7f3b5359e640 1 -- 172.21.15.5:0/2152764282 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654c83f31b0 msgr2=0x5654c87ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:55.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.259+0000 7f3b5359e640 1 --2- 172.21.15.5:0/2152764282 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654c83f31b0 0x5654c87ccf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:55.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.259+0000 7f3b5359e640 1 -- 172.21.15.5:0/2152764282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654c83fb390 msgr2=0x5654c87d8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:55.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.259+0000 7f3b5359e640 1 --2- 172.21.15.5:0/2152764282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654c83fb390 0x5654c87d8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:55.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.259+0000 7f3b5359e640 1 -- 172.21.15.5:0/2152764282 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654c87caf70 con 0x5654c841c070 2024-08-31T05:33:55.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.259+0000 7f3b4bfff640 1 --2- 172.21.15.5:0/2152764282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654c83fb390 0x5654c87d8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:55.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.259+0000 7f3b5359e640 1 --2- 172.21.15.5:0/2152764282 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654c841c070 0x5654c87c4450 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c0043d0 tx=0x7f3b4c005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=964d90b3a37a141a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:55.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.260+0000 7f3b48ff9640 1 -- 172.21.15.5:0/2152764282 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c003c50 con 0x5654c841c070 2024-08-31T05:33:55.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.260+0000 7f3b48ff9640 1 -- 172.21.15.5:0/2152764282 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b4c01f040 con 0x5654c841c070 2024-08-31T05:33:55.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.260+0000 7f3b48ff9640 1 -- 172.21.15.5:0/2152764282 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c027690 con 0x5654c841c070 2024-08-31T05:33:55.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.261+0000 7f3b5f699740 1 -- 172.21.15.5:0/2152764282 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654c841c070 msgr2=0x5654c87c4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:55.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.261+0000 7f3b5f699740 1 --2- 172.21.15.5:0/2152764282 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654c841c070 0x5654c87c4450 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c0043d0 tx=0x7f3b4c005fd0 comp rx=0 tx=0).stop 2024-08-31T05:33:55.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.261+0000 7f3b5f699740 1 -- 172.21.15.5:0/2152764282 shutdown_connections 2024-08-31T05:33:55.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.261+0000 7f3b5f699740 1 --2- 172.21.15.5:0/2152764282 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654c841c070 0x5654c87c4450 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:55.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.261+0000 7f3b5f699740 1 --2- 172.21.15.5:0/2152764282 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654c83fb390 0x5654c87d8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:55.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.261+0000 7f3b5f699740 1 --2- 172.21.15.5:0/2152764282 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654c83f31b0 0x5654c87ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:55.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.261+0000 7f3b5f699740 1 -- 172.21.15.5:0/2152764282 >> 172.21.15.5:0/2152764282 conn(0x5654c8410460 msgr2=0x5654c87cc820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:55.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.261+0000 7f3b5f699740 1 -- 172.21.15.5:0/2152764282 shutdown_connections 2024-08-31T05:33:55.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.261+0000 7f3b5f699740 1 -- 172.21.15.5:0/2152764282 wait complete. 2024-08-31T05:33:55.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.261+0000 7f3b5f699740 1 -- start start 2024-08-31T05:33:55.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.261+0000 7f3b5f699740 1 Processor -- start 2024-08-31T05:33:55.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.262+0000 7f3b5f699740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654c83f31b0 0x5654c87d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:55.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.262+0000 7f3b5f699740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654c83fb390 0x5654c87d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:55.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.262+0000 7f3b5f699740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654c841c070 0x5654c87d1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:55.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.262+0000 7f3b5f699740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3b541afea0 con 0x5654c841c070 2024-08-31T05:33:55.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.262+0000 7f3b5f699740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3b541af7d0 con 0x5654c83f31b0 2024-08-31T05:33:55.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.262+0000 7f3b5f699740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3b541aca10 con 0x5654c83fb390 2024-08-31T05:33:55.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.262+0000 7f3b5f699740 10 client.0 _ll_register_callbacks cb 0x7f3b3c009910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:33:55.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.262+0000 7f3b5359e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654c841c070 0x5654c87d1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:55.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.262+0000 7f3b4bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654c83fb390 0x5654c87d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:55.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.262+0000 7f3b5359e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654c83f31b0 0x5654c87d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:55.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.262+0000 7f3b4bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654c83fb390 0x5654c87d1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:56216/0 (socket says 172.21.15.5:56216) 2024-08-31T05:33:55.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.262+0000 7f3b4bfff640 1 -- 172.21.15.5:0/713168287 learned_addr learned my addr 172.21.15.5:0/713168287 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:55.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.262+0000 7f3b4bfff640 1 -- 172.21.15.5:0/713168287 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654c83f31b0 msgr2=0x5654c87d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:55.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.262+0000 7f3b4bfff640 1 --2- 172.21.15.5:0/713168287 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654c83f31b0 0x5654c87d0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:55.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.262+0000 7f3b4bfff640 1 -- 172.21.15.5:0/713168287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654c841c070 msgr2=0x5654c87d1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:55.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.262+0000 7f3b4bfff640 1 --2- 172.21.15.5:0/713168287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654c841c070 0x5654c87d1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:55.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.262+0000 7f3b4bfff640 1 -- 172.21.15.5:0/713168287 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654c8848930 con 0x5654c83fb390 2024-08-31T05:33:55.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.262+0000 7f3b5359e640 1 --2- 172.21.15.5:0/713168287 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654c83f31b0 0x5654c87d0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:55.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.262+0000 7f3b4bfff640 1 --2- 172.21.15.5:0/713168287 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654c83fb390 0x5654c87d1420 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c000c00 tx=0x7f3b3c010430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f7336928c3d6e98 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:55.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.262+0000 7f3b3a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:33:55.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.263+0000 7f3b3a7fc640 1 -- 172.21.15.5:0/713168287 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c022040 con 0x5654c83fb390 2024-08-31T05:33:55.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.263+0000 7f3b3a7fc640 1 -- 172.21.15.5:0/713168287 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f3b3c003800 con 0x5654c83fb390 2024-08-31T05:33:55.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.263+0000 7f3b5f699740 1 -- 172.21.15.5:0/713168287 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b4c01f040 con 0x5654c83fb390 2024-08-31T05:33:55.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.263+0000 7f3b3a7fc640 1 -- 172.21.15.5:0/713168287 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f3b3c037050 con 0x5654c83fb390 2024-08-31T05:33:55.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.263+0000 7f3b5f699740 10 client.26206 fetch_fsmap learned FSMap version 34 2024-08-31T05:33:55.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.263+0000 7f3b5f699740 1 -- 172.21.15.5:0/713168287 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5654c8849be0 con 0x5654c83fb390 2024-08-31T05:33:55.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.263+0000 7f3b3a7fc640 1 -- 172.21.15.5:0/713168287 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b4c01f040 con 0x5654c83fb390 2024-08-31T05:33:55.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.263+0000 7f3b3a7fc640 1 -- 172.21.15.5:0/713168287 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f3b3c0052d0 con 0x5654c83fb390 2024-08-31T05:33:55.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.263+0000 7f3b5f699740 10 client.26206 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:33:55.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.263+0000 7f3b5f699740 10 client.26206 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-31T05:33:55.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.263+0000 7f3b5f699740 20 client.26206 populate_metadata read hostname 'smithi005' 2024-08-31T05:33:55.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.263+0000 7f3b5f699740 1 --2- 172.21.15.5:0/713168287 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x5654c83afda0 0x5654c884c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:55.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.263+0000 7f3b5f699740 4 client.26206 mds_command: new command op to 24602 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:33:55.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.263+0000 7f3b5f699740 1 -- 172.21.15.5:0/713168287 --> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5654c8736070 con 0x5654c83afda0 2024-08-31T05:33:55.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.263+0000 7f3b5359e640 1 --2- 172.21.15.5:0/713168287 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x5654c83afda0 0x5654c884c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:55.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.264+0000 7f3b3a7fc640 10 client.26206 ms_handle_connect on v2:172.21.15.50:6836/428759669 2024-08-31T05:33:55.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.264+0000 7f3b5359e640 1 --2- 172.21.15.5:0/713168287 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x5654c83afda0 0x5654c884c450 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d1ad24da35eb9c94 server_cookie=cbdee2987c64eb31 in_seq=0 out_seq=0 2024-08-31T05:33:55.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.264+0000 7f3b3a7fc640 1 -- 172.21.15.5:0/713168287 <== mds.4 v2:172.21.15.50:6836/428759669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5654c8736070 con 0x5654c83afda0 2024-08-31T05:33:55.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.264+0000 7f3b3a7fc640 10 client.26206 handle_command_reply: tid=0 2024-08-31T05:33:55.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.264+0000 7f3b5f699740 1 client.26206 shutdown 2024-08-31T05:33:55.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.264+0000 7f3b5f699740 1 -- 172.21.15.5:0/713168287 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654c83fb390 msgr2=0x5654c87d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:55.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.264+0000 7f3b5f699740 1 --2- 172.21.15.5:0/713168287 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654c83fb390 0x5654c87d1420 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c000c00 tx=0x7f3b3c010430 comp rx=0 tx=0).stop 2024-08-31T05:33:55.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.265+0000 7f3b5f699740 1 -- 172.21.15.5:0/713168287 shutdown_connections 2024-08-31T05:33:55.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.265+0000 7f3b5f699740 1 --2- 172.21.15.5:0/713168287 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x5654c83afda0 0x5654c884c450 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:55.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.265+0000 7f3b5f699740 1 --2- 172.21.15.5:0/713168287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5654c841c070 0x5654c87d1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:55.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.265+0000 7f3b5f699740 1 --2- 172.21.15.5:0/713168287 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654c83fb390 0x5654c87d1420 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:55.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.265+0000 7f3b5f699740 1 --2- 172.21.15.5:0/713168287 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5654c83f31b0 0x5654c87d0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:55.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.265+0000 7f3b5f699740 1 -- 172.21.15.5:0/713168287 >> 172.21.15.5:0/713168287 conn(0x5654c8410460 msgr2=0x5654c87c4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:55.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.265+0000 7f3b3a7fc640 0 client.26206 ms_handle_reset on v2:172.21.15.50:6836/428759669 2024-08-31T05:33:55.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.265+0000 7f3b5f699740 1 -- 172.21.15.5:0/713168287 shutdown_connections 2024-08-31T05:33:55.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.265+0000 7f3b5f699740 1 -- 172.21.15.5:0/713168287 wait complete. 2024-08-31T05:33:55.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.265+0000 7f3b5f699740 20 client.26206 trim_cache size 0 max 16384 2024-08-31T05:33:55.271 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:33:55.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.266+0000 7f3b59124640 1 -- 172.21.15.5:0/3681159608 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f3b400b4ca0 msgr2=0x7f3b400b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:55.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.266+0000 7f3b59124640 1 --2- 172.21.15.5:0/3681159608 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f3b400b4ca0 0x7f3b400b71b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3b441030d0 tx=0x7f3b4403b4f0 comp rx=0 tx=0).stop 2024-08-31T05:33:55.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.266+0000 7f3b59124640 1 -- 172.21.15.5:0/3681159608 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b54102840 msgr2=0x7f3b5419a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:55.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.266+0000 7f3b59124640 1 --2- 172.21.15.5:0/3681159608 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b54102840 0x7f3b5419a280 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3b44005940 tx=0x7f3b440040c0 comp rx=0 tx=0).stop 2024-08-31T05:33:55.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.266+0000 7f3b59124640 1 -- 172.21.15.5:0/3681159608 shutdown_connections 2024-08-31T05:33:55.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.266+0000 7f3b59124640 1 --2- 172.21.15.5:0/3681159608 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f3b400b4ca0 0x7f3b400b71b0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:55.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.266+0000 7f3b59124640 1 --2- 172.21.15.5:0/3681159608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b54108ad0 0x7f3b5419fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:55.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.266+0000 7f3b59124640 1 --2- 172.21.15.5:0/3681159608 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3b54108180 0x7f3b5419a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:55.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.266+0000 7f3b59124640 1 --2- 172.21.15.5:0/3681159608 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b54102840 0x7f3b5419a280 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:55.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.266+0000 7f3b59124640 1 -- 172.21.15.5:0/3681159608 >> 172.21.15.5:0/3681159608 conn(0x7f3b540794f0 msgr2=0x7f3b54101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:55.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.266+0000 7f3b59124640 1 -- 172.21.15.5:0/3681159608 shutdown_connections 2024-08-31T05:33:55.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:55.266+0000 7f3b59124640 1 -- 172.21.15.5:0/3681159608 wait complete. 2024-08-31T05:33:55.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:33:55 smithi005 ceph-mon[18602]: pgmap v463: 129 pgs: 129 active+clean; 209 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.9 MiB/s wr, 269 op/s 2024-08-31T05:33:55.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:33:55 smithi070 ceph-mon[22316]: pgmap v463: 129 pgs: 129 active+clean; 209 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.9 MiB/s wr, 269 op/s 2024-08-31T05:33:55.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:33:55 smithi050 ceph-mon[22146]: pgmap v463: 129 pgs: 129 active+clean; 209 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.9 MiB/s wr, 269 op/s 2024-08-31T05:33:55.914 INFO:tasks.workunit.client.0.smithi005.stdout: 1 409128 13.26 MB/sec execute 43 sec latency 22.455 ms 2024-08-31T05:33:55.990 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-31T05:33:56.295 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:33:56.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.895+0000 7f729a70d640 1 -- 172.21.15.5:0/349990014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7294109bb0 msgr2=0x7f7294110470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:56.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.895+0000 7f729a70d640 1 --2- 172.21.15.5:0/349990014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7294109bb0 0x7f7294110470 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f728c009ca0 tx=0x7f728c02a8c0 comp rx=0 tx=0).stop 2024-08-31T05:33:56.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.895+0000 7f729a70d640 1 -- 172.21.15.5:0/349990014 shutdown_connections 2024-08-31T05:33:56.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.895+0000 7f729a70d640 1 --2- 172.21.15.5:0/349990014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7294109bb0 0x7f7294110470 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:56.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.895+0000 7f729a70d640 1 --2- 172.21.15.5:0/349990014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7294109260 0x7f7294109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:56.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.895+0000 7f729a70d640 1 --2- 172.21.15.5:0/349990014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7294101db0 0x7f72941021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:56.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.895+0000 7f729a70d640 1 -- 172.21.15.5:0/349990014 >> 172.21.15.5:0/349990014 conn(0x7f7294077a00 msgr2=0x7f7294077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:56.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.895+0000 7f729a70d640 1 -- 172.21.15.5:0/349990014 shutdown_connections 2024-08-31T05:33:56.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.895+0000 7f729a70d640 1 -- 172.21.15.5:0/349990014 wait complete. 2024-08-31T05:33:56.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.896+0000 7f729a70d640 1 Processor -- start 2024-08-31T05:33:56.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.896+0000 7f729a70d640 1 -- start start 2024-08-31T05:33:56.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.896+0000 7f729a70d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7294101db0 0x7f729419a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:56.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.896+0000 7f729a70d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7294109260 0x7f729419a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:56.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.896+0000 7f729a70d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7294109bb0 0x7f729419f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:56.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.896+0000 7f729a70d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7294113860 con 0x7f7294109260 2024-08-31T05:33:56.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.896+0000 7f729a70d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f72941136e0 con 0x7f7294109bb0 2024-08-31T05:33:56.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.896+0000 7f729a70d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f72941139e0 con 0x7f7294101db0 2024-08-31T05:33:56.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.896+0000 7f72937fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7294109260 0x7f729419a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:56.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.897+0000 7f72937fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7294109260 0x7f729419a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50714/0 (socket says 172.21.15.5:50714) 2024-08-31T05:33:56.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.897+0000 7f72937fe640 1 -- 172.21.15.5:0/3302634154 learned_addr learned my addr 172.21.15.5:0/3302634154 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:56.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.897+0000 7f7293fff640 1 --2- 172.21.15.5:0/3302634154 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7294101db0 0x7f729419a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:56.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.897+0000 7f7298caa640 1 --2- 172.21.15.5:0/3302634154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7294109bb0 0x7f729419f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:56.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.897+0000 7f72937fe640 1 -- 172.21.15.5:0/3302634154 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7294101db0 msgr2=0x7f729419a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:56.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.897+0000 7f72937fe640 1 --2- 172.21.15.5:0/3302634154 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7294101db0 0x7f729419a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:56.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.897+0000 7f72937fe640 1 -- 172.21.15.5:0/3302634154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7294109bb0 msgr2=0x7f729419f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:56.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.897+0000 7f72937fe640 1 --2- 172.21.15.5:0/3302634154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7294109bb0 0x7f729419f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:56.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.897+0000 7f72937fe640 1 -- 172.21.15.5:0/3302634154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72941a0120 con 0x7f7294109260 2024-08-31T05:33:56.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.897+0000 7f7293fff640 1 --2- 172.21.15.5:0/3302634154 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7294101db0 0x7f729419a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:56.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.897+0000 7f72937fe640 1 --2- 172.21.15.5:0/3302634154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7294109260 0x7f729419a750 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f728800e9f0 tx=0x7f728800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:56.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.897+0000 7f72917fa640 1 -- 172.21.15.5:0/3302634154 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f728800ccc0 con 0x7f7294109260 2024-08-31T05:33:56.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.897+0000 7f729a70d640 1 -- 172.21.15.5:0/3302634154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72941a0410 con 0x7f7294109260 2024-08-31T05:33:56.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.897+0000 7f72917fa640 1 -- 172.21.15.5:0/3302634154 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72880108e0 con 0x7f7294109260 2024-08-31T05:33:56.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.897+0000 7f72917fa640 1 -- 172.21.15.5:0/3302634154 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7288018860 con 0x7f7294109260 2024-08-31T05:33:56.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.897+0000 7f729a70d640 1 -- 172.21.15.5:0/3302634154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72941a6b70 con 0x7f7294109260 2024-08-31T05:33:56.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.900+0000 7f72917fa640 1 -- 172.21.15.5:0/3302634154 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f7288018a00 con 0x7f7294109260 2024-08-31T05:33:56.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.901+0000 7f72a0c82740 1 Processor -- start 2024-08-31T05:33:56.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.901+0000 7f72a0c82740 1 -- start start 2024-08-31T05:33:56.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.901+0000 7f72a0c82740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562040683070 0x562040a28350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:56.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.901+0000 7f72a0c82740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56204065a1b0 0x562040a28890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:56.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.901+0000 7f72a0c82740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562040662390 0x562040a28dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:56.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.901+0000 7f72a0c82740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56204099f680 con 0x562040662390 2024-08-31T05:33:56.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.901+0000 7f72a0c82740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56204098ec10 con 0x562040683070 2024-08-31T05:33:56.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.901+0000 7f72a0c82740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562040992bc0 con 0x56204065a1b0 2024-08-31T05:33:56.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.901+0000 7f72917fa640 1 --2- 172.21.15.5:0/3302634154 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f727c0b4ca0 0x7f727c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:56.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.901+0000 7f72937fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562040662390 0x562040a28dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:56.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.901+0000 7f7293fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56204065a1b0 0x562040a28890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:56.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.901+0000 7f7293fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56204065a1b0 0x562040a28890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:56234/0 (socket says 172.21.15.5:56234) 2024-08-31T05:33:56.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.901+0000 7f7293fff640 1 -- 172.21.15.5:0/2588458298 learned_addr learned my addr 172.21.15.5:0/2588458298 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:56.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.901+0000 7f7298caa640 1 --2- 172.21.15.5:0/3302634154 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f727c0b4ca0 0x7f727c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:56.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.901+0000 7f7298caa640 1 --2- 172.21.15.5:0/2588458298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562040683070 0x562040a28350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:56.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.902+0000 7f72917fa640 1 -- 172.21.15.5:0/3302634154 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f72880e5bd0 con 0x7f7294109260 2024-08-31T05:33:56.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.902+0000 7f72937fe640 1 -- 172.21.15.5:0/2588458298 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56204065a1b0 msgr2=0x562040a28890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:56.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.902+0000 7f72937fe640 1 --2- 172.21.15.5:0/2588458298 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56204065a1b0 0x562040a28890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:56.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.902+0000 7f72937fe640 1 -- 172.21.15.5:0/2588458298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562040683070 msgr2=0x562040a28350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:56.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.902+0000 7f72937fe640 1 --2- 172.21.15.5:0/2588458298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562040683070 0x562040a28350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:56.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.902+0000 7f72937fe640 1 -- 172.21.15.5:0/2588458298 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620406ee650 con 0x562040662390 2024-08-31T05:33:56.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.902+0000 7f7298caa640 1 --2- 172.21.15.5:0/3302634154 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f727c0b4ca0 0x7f727c0b71b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f728c0094e0 tx=0x7f728c009800 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:56.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.902+0000 7f72937fe640 1 --2- 172.21.15.5:0/2588458298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562040662390 0x562040a28dd0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f72880e2fa0 tx=0x7f728801f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c69974f3ef8680 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:56.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.902+0000 7f727a7fc640 1 -- 172.21.15.5:0/2588458298 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7288026040 con 0x562040662390 2024-08-31T05:33:56.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.902+0000 7f727a7fc640 1 -- 172.21.15.5:0/2588458298 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72880b07b0 con 0x562040662390 2024-08-31T05:33:56.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.902+0000 7f727a7fc640 1 -- 172.21.15.5:0/2588458298 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72880c86a0 con 0x562040662390 2024-08-31T05:33:56.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.903+0000 7f72a0c82740 1 -- 172.21.15.5:0/2588458298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562040662390 msgr2=0x562040a28dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:56.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.903+0000 7f72a0c82740 1 --2- 172.21.15.5:0/2588458298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562040662390 0x562040a28dd0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f72880e2fa0 tx=0x7f728801f000 comp rx=0 tx=0).stop 2024-08-31T05:33:56.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.903+0000 7f72a0c82740 1 -- 172.21.15.5:0/2588458298 shutdown_connections 2024-08-31T05:33:56.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.903+0000 7f72a0c82740 1 --2- 172.21.15.5:0/2588458298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562040662390 0x562040a28dd0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:56.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.903+0000 7f72a0c82740 1 --2- 172.21.15.5:0/2588458298 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56204065a1b0 0x562040a28890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:56.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.903+0000 7f72a0c82740 1 --2- 172.21.15.5:0/2588458298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562040683070 0x562040a28350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:56.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.903+0000 7f72a0c82740 1 -- 172.21.15.5:0/2588458298 >> 172.21.15.5:0/2588458298 conn(0x562040677460 msgr2=0x562040a26240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:56.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.903+0000 7f72a0c82740 1 -- 172.21.15.5:0/2588458298 shutdown_connections 2024-08-31T05:33:56.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.903+0000 7f72a0c82740 1 -- 172.21.15.5:0/2588458298 wait complete. 2024-08-31T05:33:56.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.904+0000 7f72a0c82740 1 -- start start 2024-08-31T05:33:56.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.904+0000 7f72a0c82740 1 Processor -- start 2024-08-31T05:33:56.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.904+0000 7f72a0c82740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56204065a1b0 0x562040a33b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:56.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.904+0000 7f72a0c82740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562040662390 0x562040a340d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:56.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.904+0000 7f72a0c82740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562040683070 0x562040a44170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:56.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.904+0000 7f72a0c82740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5620407f1700 con 0x56204065a1b0 2024-08-31T05:33:56.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.904+0000 7f72a0c82740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562040915750 con 0x562040662390 2024-08-31T05:33:56.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.904+0000 7f72a0c82740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562040a3ae80 con 0x562040683070 2024-08-31T05:33:56.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.904+0000 7f72a0c82740 10 client.0 _ll_register_callbacks cb 0x562040944e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:33:56.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.904+0000 7f7293fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56204065a1b0 0x562040a33b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:56.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.904+0000 7f7293fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56204065a1b0 0x562040a33b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50730/0 (socket says 172.21.15.5:50730) 2024-08-31T05:33:56.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.904+0000 7f7293fff640 1 -- 172.21.15.5:0/4159759126 learned_addr learned my addr 172.21.15.5:0/4159759126 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:56.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.904+0000 7f7298caa640 1 --2- 172.21.15.5:0/4159759126 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562040683070 0x562040a44170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:56.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.904+0000 7f72937fe640 1 --2- 172.21.15.5:0/4159759126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562040662390 0x562040a340d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:56.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.905+0000 7f7293fff640 1 -- 172.21.15.5:0/4159759126 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562040683070 msgr2=0x562040a44170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:56.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.905+0000 7f7293fff640 1 --2- 172.21.15.5:0/4159759126 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562040683070 0x562040a44170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:56.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.905+0000 7f7293fff640 1 -- 172.21.15.5:0/4159759126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562040662390 msgr2=0x562040a340d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:56.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.905+0000 7f7293fff640 1 --2- 172.21.15.5:0/4159759126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562040662390 0x562040a340d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:56.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.905+0000 7f7293fff640 1 -- 172.21.15.5:0/4159759126 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56204094e900 con 0x56204065a1b0 2024-08-31T05:33:56.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.905+0000 7f7293fff640 1 --2- 172.21.15.5:0/4159759126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56204065a1b0 0x562040a33b50 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f7284012d20 tx=0x7f728400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=976aa570577ecae1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:56.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.905+0000 7f72737fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:33:56.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.905+0000 7f72737fe640 1 -- 172.21.15.5:0/4159759126 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7284004050 con 0x56204065a1b0 2024-08-31T05:33:56.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.905+0000 7f72737fe640 1 -- 172.21.15.5:0/4159759126 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f72840041f0 con 0x56204065a1b0 2024-08-31T05:33:56.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.905+0000 7f72a0c82740 1 -- 172.21.15.5:0/4159759126 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72880b07b0 con 0x56204065a1b0 2024-08-31T05:33:56.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.905+0000 7f72737fe640 1 -- 172.21.15.5:0/4159759126 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f7284025050 con 0x56204065a1b0 2024-08-31T05:33:56.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.905+0000 7f72a0c82740 10 client.16611 fetch_fsmap learned FSMap version 34 2024-08-31T05:33:56.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.905+0000 7f72a0c82740 1 -- 172.21.15.5:0/4159759126 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x562040a46d40 con 0x56204065a1b0 2024-08-31T05:33:56.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.905+0000 7f72737fe640 1 -- 172.21.15.5:0/4159759126 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72880b07b0 con 0x56204065a1b0 2024-08-31T05:33:56.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.906+0000 7f72737fe640 1 -- 172.21.15.5:0/4159759126 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f7284010430 con 0x56204065a1b0 2024-08-31T05:33:56.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.906+0000 7f72a0c82740 10 client.16611 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:33:56.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.906+0000 7f72a0c82740 10 client.16611 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-31T05:33:56.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.906+0000 7f72a0c82740 20 client.16611 populate_metadata read hostname 'smithi005' 2024-08-31T05:33:56.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.906+0000 7f72a0c82740 1 --2- 172.21.15.5:0/4159759126 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5620406419f0 0x562040a4a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:56.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.906+0000 7f72a0c82740 4 client.16611 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:33:56.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.906+0000 7f72a0c82740 1 -- 172.21.15.5:0/4159759126 --> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5620409a15d0 con 0x5620406419f0 2024-08-31T05:33:56.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.906+0000 7f72937fe640 1 --2- 172.21.15.5:0/4159759126 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5620406419f0 0x562040a4a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:56.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.906+0000 7f72737fe640 10 client.16611 ms_handle_connect on v2:172.21.15.70:6834/2061504114 2024-08-31T05:33:56.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.906+0000 7f72937fe640 1 --2- 172.21.15.5:0/4159759126 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5620406419f0 0x562040a4a2e0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=36baea60f7f81e7a server_cookie=838c85d3ef1c3c1d in_seq=0 out_seq=0 2024-08-31T05:33:56.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.907+0000 7f72737fe640 1 -- 172.21.15.5:0/4159759126 <== mds.3 v2:172.21.15.70:6834/2061504114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5620409a15d0 con 0x5620406419f0 2024-08-31T05:33:56.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.907+0000 7f72737fe640 10 client.16611 handle_command_reply: tid=0 2024-08-31T05:33:56.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.907+0000 7f72a0c82740 1 client.16611 shutdown 2024-08-31T05:33:56.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.908+0000 7f72a0c82740 1 -- 172.21.15.5:0/4159759126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56204065a1b0 msgr2=0x562040a33b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:56.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.908+0000 7f72a0c82740 1 --2- 172.21.15.5:0/4159759126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56204065a1b0 0x562040a33b50 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f7284012d20 tx=0x7f728400f790 comp rx=0 tx=0).stop 2024-08-31T05:33:56.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.908+0000 7f72a0c82740 1 -- 172.21.15.5:0/4159759126 shutdown_connections 2024-08-31T05:33:56.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.908+0000 7f72a0c82740 1 --2- 172.21.15.5:0/4159759126 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5620406419f0 0x562040a4a2e0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:56.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.908+0000 7f72a0c82740 1 --2- 172.21.15.5:0/4159759126 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562040683070 0x562040a44170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:56.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.908+0000 7f72a0c82740 1 --2- 172.21.15.5:0/4159759126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562040662390 0x562040a340d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:56.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.908+0000 7f72a0c82740 1 --2- 172.21.15.5:0/4159759126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56204065a1b0 0x562040a33b50 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:56.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.908+0000 7f72737fe640 0 client.16611 ms_handle_reset on v2:172.21.15.70:6834/2061504114 2024-08-31T05:33:56.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.908+0000 7f72a0c82740 1 -- 172.21.15.5:0/4159759126 >> 172.21.15.5:0/4159759126 conn(0x562040677460 msgr2=0x562040a29380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:56.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.908+0000 7f72a0c82740 1 -- 172.21.15.5:0/4159759126 shutdown_connections 2024-08-31T05:33:56.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.908+0000 7f72a0c82740 1 -- 172.21.15.5:0/4159759126 wait complete. 2024-08-31T05:33:56.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.908+0000 7f72a0c82740 20 client.16611 trim_cache size 0 max 16384 2024-08-31T05:33:56.915 INFO:tasks.workunit.client.0.smithi005.stdout: 1 411901 13.35 MB/sec execute 44 sec latency 38.906 ms 2024-08-31T05:33:56.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.922+0000 7f72a0c82740 1 Processor -- start 2024-08-31T05:33:56.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.922+0000 7f72a0c82740 1 -- start start 2024-08-31T05:33:56.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.923+0000 7f72a0c82740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56204065a1b0 0x562040a29a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:56.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.923+0000 7f72a0c82740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562040662390 0x562040a44070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:56.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.923+0000 7f72a0c82740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562040683070 0x562040a445b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:56.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.923+0000 7f72a0c82740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f72941aea40 con 0x56204065a1b0 2024-08-31T05:33:56.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.923+0000 7f72a0c82740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f72941b0580 con 0x562040683070 2024-08-31T05:33:56.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.923+0000 7f72a0c82740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f72941af110 con 0x562040662390 2024-08-31T05:33:56.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.923+0000 7f7293fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56204065a1b0 0x562040a29a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:56.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.923+0000 7f72937fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562040662390 0x562040a44070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:56.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.923+0000 7f7293fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56204065a1b0 0x562040a29a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50746/0 (socket says 172.21.15.5:50746) 2024-08-31T05:33:56.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.923+0000 7f7293fff640 1 -- 172.21.15.5:0/785383239 learned_addr learned my addr 172.21.15.5:0/785383239 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:56.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.923+0000 7f7298caa640 1 --2- 172.21.15.5:0/785383239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562040683070 0x562040a445b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:56.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.923+0000 7f72937fe640 1 -- 172.21.15.5:0/785383239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562040683070 msgr2=0x562040a445b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:56.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.923+0000 7f72937fe640 1 --2- 172.21.15.5:0/785383239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562040683070 0x562040a445b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:56.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.923+0000 7f72937fe640 1 -- 172.21.15.5:0/785383239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56204065a1b0 msgr2=0x562040a29a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:56.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.923+0000 7f72937fe640 1 --2- 172.21.15.5:0/785383239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56204065a1b0 0x562040a29a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:56.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.923+0000 7f72937fe640 1 -- 172.21.15.5:0/785383239 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562040a29160 con 0x562040662390 2024-08-31T05:33:56.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.923+0000 7f7293fff640 1 --2- 172.21.15.5:0/785383239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56204065a1b0 0x562040a29a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:56.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.923+0000 7f72937fe640 1 --2- 172.21.15.5:0/785383239 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562040662390 0x562040a44070 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x562040a36700 tx=0x7f72880c8040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9d1eeae43d567cd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:56.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.924+0000 7f7279ffb640 1 -- 172.21.15.5:0/785383239 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72880e3220 con 0x562040662390 2024-08-31T05:33:56.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.924+0000 7f7279ffb640 1 -- 172.21.15.5:0/785383239 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72880a8280 con 0x562040662390 2024-08-31T05:33:56.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.924+0000 7f7279ffb640 1 -- 172.21.15.5:0/785383239 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7288010430 con 0x562040662390 2024-08-31T05:33:56.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.925+0000 7f72a0c82740 1 -- 172.21.15.5:0/785383239 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562040662390 msgr2=0x562040a44070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:56.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.925+0000 7f72a0c82740 1 --2- 172.21.15.5:0/785383239 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562040662390 0x562040a44070 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x562040a36700 tx=0x7f72880c8040 comp rx=0 tx=0).stop 2024-08-31T05:33:56.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.925+0000 7f72a0c82740 1 -- 172.21.15.5:0/785383239 shutdown_connections 2024-08-31T05:33:56.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.925+0000 7f72a0c82740 1 --2- 172.21.15.5:0/785383239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562040683070 0x562040a445b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:56.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.925+0000 7f72a0c82740 1 --2- 172.21.15.5:0/785383239 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562040662390 0x562040a44070 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:56.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.925+0000 7f72a0c82740 1 --2- 172.21.15.5:0/785383239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56204065a1b0 0x562040a29a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:56.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.925+0000 7f72a0c82740 1 -- 172.21.15.5:0/785383239 >> 172.21.15.5:0/785383239 conn(0x562040677460 msgr2=0x562040a29380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:56.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.925+0000 7f72a0c82740 1 -- 172.21.15.5:0/785383239 shutdown_connections 2024-08-31T05:33:56.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.925+0000 7f72a0c82740 1 -- 172.21.15.5:0/785383239 wait complete. 2024-08-31T05:33:56.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.925+0000 7f72a0c82740 1 -- start start 2024-08-31T05:33:56.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.926+0000 7f72a0c82740 1 Processor -- start 2024-08-31T05:33:56.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.926+0000 7f72a0c82740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56204065a1b0 0x562040a3c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:56.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.926+0000 7f72a0c82740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562040662390 0x562040a3c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:56.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.926+0000 7f72a0c82740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562040683070 0x562040ab3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:56.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.926+0000 7f72a0c82740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f72941afeb0 con 0x56204065a1b0 2024-08-31T05:33:56.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.926+0000 7f72a0c82740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f72941af7e0 con 0x562040683070 2024-08-31T05:33:56.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.926+0000 7f72a0c82740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f72941aca20 con 0x562040662390 2024-08-31T05:33:56.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.926+0000 7f7293fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56204065a1b0 0x562040a3c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:56.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.926+0000 7f72937fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562040662390 0x562040a3c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:56.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.926+0000 7f72937fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562040662390 0x562040a3c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:56256/0 (socket says 172.21.15.5:56256) 2024-08-31T05:33:56.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.926+0000 7f7293fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56204065a1b0 0x562040a3c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50754/0 (socket says 172.21.15.5:50754) 2024-08-31T05:33:56.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.926+0000 7f72937fe640 1 -- 172.21.15.5:0/2184192633 learned_addr learned my addr 172.21.15.5:0/2184192633 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:56.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.926+0000 7f72a0c82740 10 client.0 _ll_register_callbacks cb 0x7f7284009d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:33:56.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.927+0000 7f72937fe640 1 -- 172.21.15.5:0/2184192633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562040683070 msgr2=0x562040ab3ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T05:33:56.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.927+0000 7f72937fe640 1 --2- 172.21.15.5:0/2184192633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562040683070 0x562040ab3ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:56.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.927+0000 7f72937fe640 1 -- 172.21.15.5:0/2184192633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56204065a1b0 msgr2=0x562040a3c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:56.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.927+0000 7f72937fe640 1 --2- 172.21.15.5:0/2184192633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56204065a1b0 0x562040a3c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:56.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.927+0000 7f72937fe640 1 -- 172.21.15.5:0/2184192633 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562040ab4220 con 0x562040662390 2024-08-31T05:33:56.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.927+0000 7f7293fff640 1 --2- 172.21.15.5:0/2184192633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56204065a1b0 0x562040a3c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:56.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.927+0000 7f72937fe640 1 --2- 172.21.15.5:0/2184192633 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562040662390 0x562040a3c960 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f72880a9260 tx=0x7f728800ce60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90d04e4cf44a6958 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:56.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.927+0000 7f72737fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:33:56.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.927+0000 7f72737fe640 1 -- 172.21.15.5:0/2184192633 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72880b0410 con 0x562040662390 2024-08-31T05:33:56.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.927+0000 7f72737fe640 1 -- 172.21.15.5:0/2184192633 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f7288097170 con 0x562040662390 2024-08-31T05:33:56.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.927+0000 7f72a0c82740 1 -- 172.21.15.5:0/2184192633 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72880a8280 con 0x562040662390 2024-08-31T05:33:56.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.927+0000 7f72737fe640 1 -- 172.21.15.5:0/2184192633 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f72880cd050 con 0x562040662390 2024-08-31T05:33:56.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.927+0000 7f72a0c82740 10 client.26224 fetch_fsmap learned FSMap version 34 2024-08-31T05:33:56.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.927+0000 7f72a0c82740 1 -- 172.21.15.5:0/2184192633 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x562040ab5280 con 0x562040662390 2024-08-31T05:33:56.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.928+0000 7f72737fe640 1 -- 172.21.15.5:0/2184192633 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72880a8280 con 0x562040662390 2024-08-31T05:33:56.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.928+0000 7f72737fe640 1 -- 172.21.15.5:0/2184192633 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f72880cd1f0 con 0x562040662390 2024-08-31T05:33:56.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.928+0000 7f72a0c82740 10 client.26224 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:33:56.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.928+0000 7f72a0c82740 10 client.26224 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-31T05:33:56.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.928+0000 7f72a0c82740 20 client.26224 populate_metadata read hostname 'smithi005' 2024-08-31T05:33:56.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.928+0000 7f72a0c82740 1 --2- 172.21.15.5:0/2184192633 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x562040616da0 0x562040ab7510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:56.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.928+0000 7f72a0c82740 4 client.26224 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:33:56.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.928+0000 7f72a0c82740 1 -- 172.21.15.5:0/2184192633 --> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56204099d070 con 0x562040616da0 2024-08-31T05:33:56.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.928+0000 7f7293fff640 1 --2- 172.21.15.5:0/2184192633 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x562040616da0 0x562040ab7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:56.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.929+0000 7f72737fe640 10 client.26224 ms_handle_connect on v2:172.21.15.70:6834/2061504114 2024-08-31T05:33:56.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.929+0000 7f7293fff640 1 --2- 172.21.15.5:0/2184192633 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x562040616da0 0x562040ab7510 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a140ece055fdcb58 server_cookie=5c2110298cd54d98 in_seq=0 out_seq=0 2024-08-31T05:33:56.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.929+0000 7f72737fe640 1 -- 172.21.15.5:0/2184192633 <== mds.3 v2:172.21.15.70:6834/2061504114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56204099d070 con 0x562040616da0 2024-08-31T05:33:56.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.929+0000 7f72737fe640 10 client.26224 handle_command_reply: tid=0 2024-08-31T05:33:56.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.929+0000 7f72a0c82740 1 client.26224 shutdown 2024-08-31T05:33:56.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.929+0000 7f72a0c82740 1 -- 172.21.15.5:0/2184192633 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562040662390 msgr2=0x562040a3c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:56.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.929+0000 7f72a0c82740 1 --2- 172.21.15.5:0/2184192633 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562040662390 0x562040a3c960 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f72880a9260 tx=0x7f728800ce60 comp rx=0 tx=0).stop 2024-08-31T05:33:56.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.929+0000 7f72a0c82740 1 -- 172.21.15.5:0/2184192633 shutdown_connections 2024-08-31T05:33:56.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.929+0000 7f72a0c82740 1 --2- 172.21.15.5:0/2184192633 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x562040616da0 0x562040ab7510 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:56.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.929+0000 7f72a0c82740 1 --2- 172.21.15.5:0/2184192633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562040683070 0x562040ab3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:56.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.929+0000 7f72a0c82740 1 --2- 172.21.15.5:0/2184192633 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562040662390 0x562040a3c960 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:56.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.929+0000 7f72737fe640 0 client.26224 ms_handle_reset on v2:172.21.15.70:6834/2061504114 2024-08-31T05:33:56.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.929+0000 7f72a0c82740 1 --2- 172.21.15.5:0/2184192633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56204065a1b0 0x562040a3c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:56.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.929+0000 7f72a0c82740 1 -- 172.21.15.5:0/2184192633 >> 172.21.15.5:0/2184192633 conn(0x562040677460 msgr2=0x562040a25a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:56.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.929+0000 7f72a0c82740 1 -- 172.21.15.5:0/2184192633 shutdown_connections 2024-08-31T05:33:56.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.929+0000 7f72a0c82740 1 -- 172.21.15.5:0/2184192633 wait complete. 2024-08-31T05:33:56.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.929+0000 7f72a0c82740 20 client.26224 trim_cache size 0 max 16384 2024-08-31T05:33:56.936 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:33:56.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.930+0000 7f729a70d640 1 -- 172.21.15.5:0/3302634154 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f727c0b4ca0 msgr2=0x7f727c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:56.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.930+0000 7f729a70d640 1 --2- 172.21.15.5:0/3302634154 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f727c0b4ca0 0x7f727c0b71b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f728c0094e0 tx=0x7f728c009800 comp rx=0 tx=0).stop 2024-08-31T05:33:56.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.930+0000 7f729a70d640 1 -- 172.21.15.5:0/3302634154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7294109260 msgr2=0x7f729419a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:56.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.930+0000 7f729a70d640 1 --2- 172.21.15.5:0/3302634154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7294109260 0x7f729419a750 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f728800e9f0 tx=0x7f728800eeb0 comp rx=0 tx=0).stop 2024-08-31T05:33:56.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.930+0000 7f729a70d640 1 -- 172.21.15.5:0/3302634154 shutdown_connections 2024-08-31T05:33:56.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.930+0000 7f729a70d640 1 --2- 172.21.15.5:0/3302634154 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f727c0b4ca0 0x7f727c0b71b0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:56.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.930+0000 7f729a70d640 1 --2- 172.21.15.5:0/3302634154 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7294109bb0 0x7f729419f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:56.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.930+0000 7f729a70d640 1 --2- 172.21.15.5:0/3302634154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7294109260 0x7f729419a750 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:56.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.930+0000 7f729a70d640 1 --2- 172.21.15.5:0/3302634154 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7294101db0 0x7f729419a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:56.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.930+0000 7f729a70d640 1 -- 172.21.15.5:0/3302634154 >> 172.21.15.5:0/3302634154 conn(0x7f7294077a00 msgr2=0x7f72941051d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:56.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.930+0000 7f729a70d640 1 -- 172.21.15.5:0/3302634154 shutdown_connections 2024-08-31T05:33:56.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:56.930+0000 7f729a70d640 1 -- 172.21.15.5:0/3302634154 wait complete. 2024-08-31T05:33:57.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:33:57 smithi070 ceph-mon[22316]: pgmap v464: 129 pgs: 129 active+clean; 211 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.8 MiB/s wr, 324 op/s 2024-08-31T05:33:57.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:33:57 smithi050 ceph-mon[22146]: pgmap v464: 129 pgs: 129 active+clean; 211 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.8 MiB/s wr, 324 op/s 2024-08-31T05:33:57.698 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:33:57 smithi005 ceph-mon[18602]: pgmap v464: 129 pgs: 129 active+clean; 211 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.8 MiB/s wr, 324 op/s 2024-08-31T05:33:57.727 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T05:33:57.914 INFO:tasks.workunit.client.0.smithi005.stdout: 1 413991 13.23 MB/sec execute 45 sec latency 49.042 ms 2024-08-31T05:33:58.005 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:33:58.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.526+0000 7f8f81b55640 1 -- 172.21.15.5:0/3333303430 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f7c102880 msgr2=0x7f8f7c102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:58.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.526+0000 7f8f81b55640 1 --2- 172.21.15.5:0/3333303430 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f7c102880 0x7f8f7c102c90 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c009900 tx=0x7f8f6c02a410 comp rx=0 tx=0).stop 2024-08-31T05:33:58.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.526+0000 7f8f81b55640 1 -- 172.21.15.5:0/3333303430 shutdown_connections 2024-08-31T05:33:58.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.526+0000 7f8f81b55640 1 --2- 172.21.15.5:0/3333303430 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f7c108b10 0x7f8f7c10f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:58.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.526+0000 7f8f81b55640 1 --2- 172.21.15.5:0/3333303430 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f7c1081c0 0x7f8f7c1085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:58.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.526+0000 7f8f81b55640 1 --2- 172.21.15.5:0/3333303430 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f7c102880 0x7f8f7c102c90 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:58.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.526+0000 7f8f81b55640 1 -- 172.21.15.5:0/3333303430 >> 172.21.15.5:0/3333303430 conn(0x7f8f7c079510 msgr2=0x7f8f7c079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:58.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.526+0000 7f8f81b55640 1 -- 172.21.15.5:0/3333303430 shutdown_connections 2024-08-31T05:33:58.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.526+0000 7f8f81b55640 1 -- 172.21.15.5:0/3333303430 wait complete. 2024-08-31T05:33:58.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.527+0000 7f8f81b55640 1 Processor -- start 2024-08-31T05:33:58.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.527+0000 7f8f81b55640 1 -- start start 2024-08-31T05:33:58.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.528+0000 7f8f81b55640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f7c102880 0x7f8f7c1991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:58.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.528+0000 7f8f81b55640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f7c1081c0 0x7f8f7c199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:58.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.528+0000 7f8f81b55640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f7c108b10 0x7f8f7c19ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:58.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.528+0000 7f8f81b55640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8f7c1127e0 con 0x7f8f7c102880 2024-08-31T05:33:58.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.528+0000 7f8f81b55640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8f7c112660 con 0x7f8f7c108b10 2024-08-31T05:33:58.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.528+0000 7f8f81b55640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8f7c112960 con 0x7f8f7c1081c0 2024-08-31T05:33:58.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.528+0000 7f8f7b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f7c102880 0x7f8f7c1991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:58.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.528+0000 7f8f7b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f7c102880 0x7f8f7c1991f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50772/0 (socket says 172.21.15.5:50772) 2024-08-31T05:33:58.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.528+0000 7f8f7affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f7c1081c0 0x7f8f7c199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:58.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.528+0000 7f8f7b7fe640 1 -- 172.21.15.5:0/3624412836 learned_addr learned my addr 172.21.15.5:0/3624412836 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:58.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.528+0000 7f8f7bfff640 1 --2- 172.21.15.5:0/3624412836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f7c108b10 0x7f8f7c19ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:58.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.528+0000 7f8f7affd640 1 -- 172.21.15.5:0/3624412836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f7c108b10 msgr2=0x7f8f7c19ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:58.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.528+0000 7f8f7affd640 1 --2- 172.21.15.5:0/3624412836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f7c108b10 0x7f8f7c19ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:58.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.528+0000 7f8f7affd640 1 -- 172.21.15.5:0/3624412836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f7c102880 msgr2=0x7f8f7c1991f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:58.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.528+0000 7f8f7affd640 1 --2- 172.21.15.5:0/3624412836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f7c102880 0x7f8f7c1991f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:58.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.528+0000 7f8f7affd640 1 -- 172.21.15.5:0/3624412836 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f7c19f160 con 0x7f8f7c1081c0 2024-08-31T05:33:58.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.528+0000 7f8f7bfff640 1 --2- 172.21.15.5:0/3624412836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f7c108b10 0x7f8f7c19ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:58.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.528+0000 7f8f7b7fe640 1 --2- 172.21.15.5:0/3624412836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f7c102880 0x7f8f7c1991f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:58.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.528+0000 7f8f7affd640 1 --2- 172.21.15.5:0/3624412836 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f7c1081c0 0x7f8f7c199790 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c06b760 tx=0x7f8f7000ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:58.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.529+0000 7f8f78ff9640 1 -- 172.21.15.5:0/3624412836 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f7000cd00 con 0x7f8f7c1081c0 2024-08-31T05:33:58.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.529+0000 7f8f81b55640 1 -- 172.21.15.5:0/3624412836 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f7c19f450 con 0x7f8f7c1081c0 2024-08-31T05:33:58.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.529+0000 7f8f78ff9640 1 -- 172.21.15.5:0/3624412836 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f700035f0 con 0x7f8f7c1081c0 2024-08-31T05:33:58.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.529+0000 7f8f78ff9640 1 -- 172.21.15.5:0/3624412836 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f70010690 con 0x7f8f7c1081c0 2024-08-31T05:33:58.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.529+0000 7f8f81b55640 1 -- 172.21.15.5:0/3624412836 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f7c06b900 con 0x7f8f7c1081c0 2024-08-31T05:33:58.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.531+0000 7f8f880ca740 1 Processor -- start 2024-08-31T05:33:58.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.532+0000 7f8f880ca740 1 -- start start 2024-08-31T05:33:58.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.532+0000 7f8f880ca740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564649f95070 0x56464a33a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:58.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.532+0000 7f8f880ca740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564649f6c1b0 0x56464a33a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:58.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.532+0000 7f8f880ca740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564649f74390 0x56464a33ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:58.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.532+0000 7f8f880ca740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56464a2b1680 con 0x564649f95070 2024-08-31T05:33:58.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.532+0000 7f8f880ca740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56464a2a0c10 con 0x564649f74390 2024-08-31T05:33:58.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.532+0000 7f8f880ca740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56464a2a4bc0 con 0x564649f6c1b0 2024-08-31T05:33:58.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.532+0000 7f8f78ff9640 1 -- 172.21.15.5:0/3624412836 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f8f70010830 con 0x7f8f7c1081c0 2024-08-31T05:33:58.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.532+0000 7f8f7b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564649f6c1b0 0x56464a33a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:58.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.532+0000 7f8f7b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564649f6c1b0 0x56464a33a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:56294/0 (socket says 172.21.15.5:56294) 2024-08-31T05:33:58.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.532+0000 7f8f7b7fe640 1 -- 172.21.15.5:0/2749063254 learned_addr learned my addr 172.21.15.5:0/2749063254 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:58.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.532+0000 7f8f7affd640 1 --2- 172.21.15.5:0/2749063254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564649f74390 0x56464a33ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:58.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.532+0000 7f8f7b7fe640 1 -- 172.21.15.5:0/2749063254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564649f74390 msgr2=0x56464a33ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:58.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.532+0000 7f8f7b7fe640 1 --2- 172.21.15.5:0/2749063254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564649f74390 0x56464a33ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:58.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.532+0000 7f8f7b7fe640 1 -- 172.21.15.5:0/2749063254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564649f95070 msgr2=0x56464a33a310 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T05:33:58.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.533+0000 7f8f7b7fe640 1 --2- 172.21.15.5:0/2749063254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564649f95070 0x56464a33a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:58.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.533+0000 7f8f7b7fe640 1 -- 172.21.15.5:0/2749063254 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56464a000650 con 0x564649f6c1b0 2024-08-31T05:33:58.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.533+0000 7f8f7b7fe640 1 --2- 172.21.15.5:0/2749063254 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564649f6c1b0 0x56464a33a850 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c000c00 tx=0x7f8f6c0058d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1dbd19fb5cf5955b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:58.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.533+0000 7f8f78ff9640 1 --2- 172.21.15.5:0/3624412836 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f8f640b4d20 0x7f8f640b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:58.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.533+0000 7f8f61ffb640 1 -- 172.21.15.5:0/2749063254 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c035040 con 0x564649f6c1b0 2024-08-31T05:33:58.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.533+0000 7f8f61ffb640 1 -- 172.21.15.5:0/2749063254 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f6c004030 con 0x564649f6c1b0 2024-08-31T05:33:58.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.533+0000 7f8f61ffb640 1 -- 172.21.15.5:0/2749063254 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c005640 con 0x564649f6c1b0 2024-08-31T05:33:58.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.533+0000 7f8f7bfff640 1 --2- 172.21.15.5:0/3624412836 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f8f640b4d20 0x7f8f640b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:58.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.533+0000 7f8f78ff9640 1 -- 172.21.15.5:0/3624412836 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f8f700e5b90 con 0x7f8f7c1081c0 2024-08-31T05:33:58.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.534+0000 7f8f880ca740 1 -- 172.21.15.5:0/2749063254 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564649f6c1b0 msgr2=0x56464a33a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:58.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.534+0000 7f8f880ca740 1 --2- 172.21.15.5:0/2749063254 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564649f6c1b0 0x56464a33a850 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c000c00 tx=0x7f8f6c0058d0 comp rx=0 tx=0).stop 2024-08-31T05:33:58.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.534+0000 7f8f7bfff640 1 --2- 172.21.15.5:0/3624412836 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f8f640b4d20 0x7f8f640b7230 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8f74005fd0 tx=0x7f8f74009f00 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:58.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.534+0000 7f8f880ca740 1 -- 172.21.15.5:0/2749063254 shutdown_connections 2024-08-31T05:33:58.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.534+0000 7f8f880ca740 1 --2- 172.21.15.5:0/2749063254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564649f74390 0x56464a33ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:58.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.534+0000 7f8f880ca740 1 --2- 172.21.15.5:0/2749063254 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564649f6c1b0 0x56464a33a850 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:58.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.534+0000 7f8f880ca740 1 --2- 172.21.15.5:0/2749063254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564649f95070 0x56464a33a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:58.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.534+0000 7f8f880ca740 1 -- 172.21.15.5:0/2749063254 >> 172.21.15.5:0/2749063254 conn(0x564649f89460 msgr2=0x56464a338200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:58.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.534+0000 7f8f880ca740 1 -- 172.21.15.5:0/2749063254 shutdown_connections 2024-08-31T05:33:58.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.534+0000 7f8f880ca740 1 -- 172.21.15.5:0/2749063254 wait complete. 2024-08-31T05:33:58.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.535+0000 7f8f880ca740 1 -- start start 2024-08-31T05:33:58.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.535+0000 7f8f880ca740 1 Processor -- start 2024-08-31T05:33:58.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.535+0000 7f8f880ca740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564649f6c1b0 0x56464a345aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:58.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.535+0000 7f8f880ca740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564649f74390 0x56464a345fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:58.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.535+0000 7f8f880ca740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564649f95070 0x56464a3561c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:58.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.535+0000 7f8f880ca740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56464a103700 con 0x564649f6c1b0 2024-08-31T05:33:58.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.535+0000 7f8f880ca740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56464a227750 con 0x564649f74390 2024-08-31T05:33:58.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.535+0000 7f8f880ca740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56464a34cea0 con 0x564649f95070 2024-08-31T05:33:58.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.535+0000 7f8f880ca740 10 client.0 _ll_register_callbacks cb 0x56464a256e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:33:58.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.535+0000 7f8f7b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564649f6c1b0 0x56464a345aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:58.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.535+0000 7f8f7b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564649f6c1b0 0x56464a345aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50784/0 (socket says 172.21.15.5:50784) 2024-08-31T05:33:58.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.535+0000 7f8f7b7fe640 1 -- 172.21.15.5:0/954446641 learned_addr learned my addr 172.21.15.5:0/954446641 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:58.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.535+0000 7f8f7affd640 1 --2- 172.21.15.5:0/954446641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564649f74390 0x56464a345fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:58.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.536+0000 7f8f7bfff640 1 --2- 172.21.15.5:0/954446641 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564649f95070 0x56464a3561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:58.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.536+0000 7f8f7affd640 1 -- 172.21.15.5:0/954446641 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564649f95070 msgr2=0x56464a3561c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:58.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.536+0000 7f8f7affd640 1 --2- 172.21.15.5:0/954446641 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564649f95070 0x56464a3561c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:58.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.536+0000 7f8f7affd640 1 -- 172.21.15.5:0/954446641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564649f6c1b0 msgr2=0x56464a345aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:58.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.536+0000 7f8f7affd640 1 --2- 172.21.15.5:0/954446641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564649f6c1b0 0x56464a345aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:58.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.536+0000 7f8f7affd640 1 -- 172.21.15.5:0/954446641 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56464a260900 con 0x564649f74390 2024-08-31T05:33:58.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.536+0000 7f8f7b7fe640 1 --2- 172.21.15.5:0/954446641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564649f6c1b0 0x56464a345aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:58.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.536+0000 7f8f7affd640 1 --2- 172.21.15.5:0/954446641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564649f74390 0x56464a345fe0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8f700e2f00 tx=0x7f8f70003cf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a8bc5ef92b218cb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:58.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.536+0000 7f8f5affd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:33:58.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.536+0000 7f8f5affd640 1 -- 172.21.15.5:0/954446641 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f700eb070 con 0x564649f74390 2024-08-31T05:33:58.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.536+0000 7f8f5affd640 1 -- 172.21.15.5:0/954446641 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f8f700a8490 con 0x564649f74390 2024-08-31T05:33:58.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.536+0000 7f8f880ca740 1 -- 172.21.15.5:0/954446641 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f6c004030 con 0x564649f74390 2024-08-31T05:33:58.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.536+0000 7f8f5affd640 1 -- 172.21.15.5:0/954446641 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f8f700ab9b0 con 0x564649f74390 2024-08-31T05:33:58.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.536+0000 7f8f880ca740 10 client.26219 fetch_fsmap learned FSMap version 34 2024-08-31T05:33:58.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.536+0000 7f8f880ca740 1 -- 172.21.15.5:0/954446641 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56464a358cc0 con 0x564649f74390 2024-08-31T05:33:58.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.537+0000 7f8f5affd640 1 -- 172.21.15.5:0/954446641 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f6c004030 con 0x564649f74390 2024-08-31T05:33:58.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.537+0000 7f8f5affd640 1 -- 172.21.15.5:0/954446641 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f8f700e3180 con 0x564649f74390 2024-08-31T05:33:58.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.537+0000 7f8f880ca740 10 client.26219 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:33:58.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.537+0000 7f8f880ca740 10 client.26219 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-31T05:33:58.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.537+0000 7f8f880ca740 20 client.26219 populate_metadata read hostname 'smithi005' 2024-08-31T05:33:58.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.537+0000 7f8f880ca740 1 --2- 172.21.15.5:0/954446641 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x564649f539f0 0x56464a35c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:58.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.537+0000 7f8f880ca740 4 client.26219 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:33:58.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.537+0000 7f8f880ca740 1 -- 172.21.15.5:0/954446641 --> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56464a2b35d0 con 0x564649f539f0 2024-08-31T05:33:58.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.537+0000 7f8f7b7fe640 1 --2- 172.21.15.5:0/954446641 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x564649f539f0 0x56464a35c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:58.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.537+0000 7f8f5affd640 10 client.26219 ms_handle_connect on v2:172.21.15.70:6836/2780036414 2024-08-31T05:33:58.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.537+0000 7f8f7b7fe640 1 --2- 172.21.15.5:0/954446641 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x564649f539f0 0x56464a35c0b0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3647da3f75744fd5 server_cookie=ef6435a9fa7148d5 in_seq=0 out_seq=0 2024-08-31T05:33:58.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.538+0000 7f8f5affd640 1 -- 172.21.15.5:0/954446641 <== mds.2 v2:172.21.15.70:6836/2780036414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56464a2b35d0 con 0x564649f539f0 2024-08-31T05:33:58.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.538+0000 7f8f5affd640 10 client.26219 handle_command_reply: tid=0 2024-08-31T05:33:58.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.538+0000 7f8f880ca740 1 client.26219 shutdown 2024-08-31T05:33:58.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.539+0000 7f8f880ca740 1 -- 172.21.15.5:0/954446641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564649f74390 msgr2=0x56464a345fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:58.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.539+0000 7f8f880ca740 1 --2- 172.21.15.5:0/954446641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564649f74390 0x56464a345fe0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8f700e2f00 tx=0x7f8f70003cf0 comp rx=0 tx=0).stop 2024-08-31T05:33:58.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.539+0000 7f8f880ca740 1 -- 172.21.15.5:0/954446641 shutdown_connections 2024-08-31T05:33:58.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.539+0000 7f8f880ca740 1 --2- 172.21.15.5:0/954446641 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x564649f539f0 0x56464a35c0b0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:58.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.539+0000 7f8f880ca740 1 --2- 172.21.15.5:0/954446641 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564649f95070 0x56464a3561c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:58.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.539+0000 7f8f880ca740 1 --2- 172.21.15.5:0/954446641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564649f74390 0x56464a345fe0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:58.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.539+0000 7f8f880ca740 1 --2- 172.21.15.5:0/954446641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564649f6c1b0 0x56464a345aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:58.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.539+0000 7f8f880ca740 1 -- 172.21.15.5:0/954446641 >> 172.21.15.5:0/954446641 conn(0x564649f89460 msgr2=0x56464a33d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:58.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.539+0000 7f8f5affd640 0 client.26219 ms_handle_reset on v2:172.21.15.70:6836/2780036414 2024-08-31T05:33:58.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.539+0000 7f8f880ca740 1 -- 172.21.15.5:0/954446641 shutdown_connections 2024-08-31T05:33:58.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.539+0000 7f8f880ca740 1 -- 172.21.15.5:0/954446641 wait complete. 2024-08-31T05:33:58.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.539+0000 7f8f880ca740 20 client.26219 trim_cache size 0 max 16384 2024-08-31T05:33:58.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.554+0000 7f8f880ca740 1 Processor -- start 2024-08-31T05:33:58.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.554+0000 7f8f880ca740 1 -- start start 2024-08-31T05:33:58.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.554+0000 7f8f880ca740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564649f6c1b0 0x56464a347980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:58.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.554+0000 7f8f880ca740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564649f74390 0x56464a33ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:58.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.554+0000 7f8f880ca740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564649f95070 0x56464a3560c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:58.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.554+0000 7f8f880ca740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8f7c1aea40 con 0x564649f6c1b0 2024-08-31T05:33:58.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.554+0000 7f8f880ca740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8f7c1b0580 con 0x564649f74390 2024-08-31T05:33:58.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.554+0000 7f8f880ca740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8f7c1af110 con 0x564649f95070 2024-08-31T05:33:58.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.554+0000 7f8f7b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564649f6c1b0 0x56464a347980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:58.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.554+0000 7f8f7b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564649f6c1b0 0x56464a347980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50794/0 (socket says 172.21.15.5:50794) 2024-08-31T05:33:58.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.554+0000 7f8f7b7fe640 1 -- 172.21.15.5:0/3702590636 learned_addr learned my addr 172.21.15.5:0/3702590636 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:58.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.554+0000 7f8f7affd640 1 --2- 172.21.15.5:0/3702590636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564649f74390 0x56464a33ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:58.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.554+0000 7f8f7bfff640 1 --2- 172.21.15.5:0/3702590636 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564649f95070 0x56464a3560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:58.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.554+0000 7f8f7b7fe640 1 -- 172.21.15.5:0/3702590636 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564649f95070 msgr2=0x56464a3560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:58.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.554+0000 7f8f7b7fe640 1 --2- 172.21.15.5:0/3702590636 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564649f95070 0x56464a3560c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:58.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.554+0000 7f8f7b7fe640 1 -- 172.21.15.5:0/3702590636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564649f74390 msgr2=0x56464a33ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:58.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.554+0000 7f8f7b7fe640 1 --2- 172.21.15.5:0/3702590636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564649f74390 0x56464a33ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:58.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.554+0000 7f8f7b7fe640 1 -- 172.21.15.5:0/3702590636 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56464a3406d0 con 0x564649f6c1b0 2024-08-31T05:33:58.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.554+0000 7f8f7affd640 1 --2- 172.21.15.5:0/3702590636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564649f74390 0x56464a33ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:58.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.555+0000 7f8f7b7fe640 1 --2- 172.21.15.5:0/3702590636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564649f6c1b0 0x56464a347980 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c005210 tx=0x7f8f6c005240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf630f4123741101 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:58.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.555+0000 7f8f617fa640 1 -- 172.21.15.5:0/3702590636 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c059070 con 0x564649f6c1b0 2024-08-31T05:33:58.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.555+0000 7f8f617fa640 1 -- 172.21.15.5:0/3702590636 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f6c004770 con 0x564649f6c1b0 2024-08-31T05:33:58.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.555+0000 7f8f617fa640 1 -- 172.21.15.5:0/3702590636 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c048040 con 0x564649f6c1b0 2024-08-31T05:33:58.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.556+0000 7f8f880ca740 1 -- 172.21.15.5:0/3702590636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564649f6c1b0 msgr2=0x56464a347980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:58.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.556+0000 7f8f880ca740 1 --2- 172.21.15.5:0/3702590636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564649f6c1b0 0x56464a347980 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c005210 tx=0x7f8f6c005240 comp rx=0 tx=0).stop 2024-08-31T05:33:58.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.556+0000 7f8f880ca740 1 -- 172.21.15.5:0/3702590636 shutdown_connections 2024-08-31T05:33:58.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.556+0000 7f8f880ca740 1 --2- 172.21.15.5:0/3702590636 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564649f95070 0x56464a3560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:58.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.556+0000 7f8f880ca740 1 --2- 172.21.15.5:0/3702590636 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564649f74390 0x56464a33ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:58.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.556+0000 7f8f880ca740 1 --2- 172.21.15.5:0/3702590636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564649f6c1b0 0x56464a347980 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:58.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.556+0000 7f8f880ca740 1 -- 172.21.15.5:0/3702590636 >> 172.21.15.5:0/3702590636 conn(0x564649f89460 msgr2=0x56464a33b340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:58.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.556+0000 7f8f880ca740 1 -- 172.21.15.5:0/3702590636 shutdown_connections 2024-08-31T05:33:58.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.556+0000 7f8f880ca740 1 -- 172.21.15.5:0/3702590636 wait complete. 2024-08-31T05:33:58.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.556+0000 7f8f880ca740 1 -- start start 2024-08-31T05:33:58.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.557+0000 7f8f880ca740 1 Processor -- start 2024-08-31T05:33:58.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.557+0000 7f8f880ca740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564649f6c1b0 0x56464a352a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:58.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.557+0000 7f8f880ca740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564649f74390 0x56464a34fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:58.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.557+0000 7f8f880ca740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564649f95070 0x56464a350540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:58.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.557+0000 7f8f880ca740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8f7c1afeb0 con 0x564649f95070 2024-08-31T05:33:58.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.557+0000 7f8f880ca740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8f7c1af7e0 con 0x564649f74390 2024-08-31T05:33:58.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.557+0000 7f8f880ca740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8f7c1aca20 con 0x564649f6c1b0 2024-08-31T05:33:58.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.557+0000 7f8f880ca740 10 client.0 _ll_register_callbacks cb 0x7f8f700ab7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:33:58.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.557+0000 7f8f7b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564649f6c1b0 0x56464a352a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:58.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.557+0000 7f8f7bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564649f95070 0x56464a350540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:58.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.557+0000 7f8f7b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564649f6c1b0 0x56464a352a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:56328/0 (socket says 172.21.15.5:56328) 2024-08-31T05:33:58.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.557+0000 7f8f7b7fe640 1 -- 172.21.15.5:0/438681574 learned_addr learned my addr 172.21.15.5:0/438681574 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:33:58.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.557+0000 7f8f7affd640 1 --2- 172.21.15.5:0/438681574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564649f74390 0x56464a34fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:58.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.557+0000 7f8f7bfff640 1 -- 172.21.15.5:0/438681574 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564649f6c1b0 msgr2=0x56464a352a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:58.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.557+0000 7f8f7bfff640 1 --2- 172.21.15.5:0/438681574 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564649f6c1b0 0x56464a352a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:58.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.557+0000 7f8f7bfff640 1 -- 172.21.15.5:0/438681574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564649f74390 msgr2=0x56464a34fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:33:58.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.557+0000 7f8f7bfff640 1 --2- 172.21.15.5:0/438681574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564649f74390 0x56464a34fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:58.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.557+0000 7f8f7bfff640 1 -- 172.21.15.5:0/438681574 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56464a350cd0 con 0x564649f95070 2024-08-31T05:33:58.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.557+0000 7f8f7b7fe640 1 --2- 172.21.15.5:0/438681574 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564649f6c1b0 0x56464a352a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:33:58.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.558+0000 7f8f7bfff640 1 --2- 172.21.15.5:0/438681574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564649f95070 0x56464a350540 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f8f74004a80 tx=0x7f8f74009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed18506dfa334f22 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:33:58.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.558+0000 7f8f5affd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:33:58.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.558+0000 7f8f5affd640 1 -- 172.21.15.5:0/438681574 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f740047e0 con 0x564649f95070 2024-08-31T05:33:58.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.558+0000 7f8f5affd640 1 -- 172.21.15.5:0/438681574 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f8f74004b20 con 0x564649f95070 2024-08-31T05:33:58.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.558+0000 7f8f880ca740 1 -- 172.21.15.5:0/438681574 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f6c004770 con 0x564649f95070 2024-08-31T05:33:58.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.558+0000 7f8f5affd640 1 -- 172.21.15.5:0/438681574 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f8f74004d20 con 0x564649f95070 2024-08-31T05:33:58.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.558+0000 7f8f880ca740 10 client.16632 fetch_fsmap learned FSMap version 34 2024-08-31T05:33:58.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.558+0000 7f8f880ca740 1 -- 172.21.15.5:0/438681574 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56464a3c6b60 con 0x564649f95070 2024-08-31T05:33:58.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.558+0000 7f8f5affd640 1 -- 172.21.15.5:0/438681574 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f6c004770 con 0x564649f95070 2024-08-31T05:33:58.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.559+0000 7f8f5affd640 1 -- 172.21.15.5:0/438681574 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f8f7401e420 con 0x564649f95070 2024-08-31T05:33:58.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.559+0000 7f8f880ca740 10 client.16632 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:33:58.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.559+0000 7f8f880ca740 10 client.16632 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-31T05:33:58.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.559+0000 7f8f880ca740 20 client.16632 populate_metadata read hostname 'smithi005' 2024-08-31T05:33:58.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.559+0000 7f8f880ca740 1 --2- 172.21.15.5:0/438681574 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x564649f28da0 0x56464a3c9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:33:58.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.559+0000 7f8f880ca740 4 client.16632 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:33:58.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.559+0000 7f8f880ca740 1 -- 172.21.15.5:0/438681574 --> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56464a2af070 con 0x564649f28da0 2024-08-31T05:33:58.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.559+0000 7f8f7b7fe640 1 --2- 172.21.15.5:0/438681574 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x564649f28da0 0x56464a3c9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:33:58.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.560+0000 7f8f5affd640 10 client.16632 ms_handle_connect on v2:172.21.15.70:6836/2780036414 2024-08-31T05:33:58.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.560+0000 7f8f7b7fe640 1 --2- 172.21.15.5:0/438681574 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x564649f28da0 0x56464a3c9350 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=517251228a91759d server_cookie=255a9890a842b4e2 in_seq=0 out_seq=0 2024-08-31T05:33:58.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.560+0000 7f8f5affd640 1 -- 172.21.15.5:0/438681574 <== mds.2 v2:172.21.15.70:6836/2780036414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56464a2af070 con 0x564649f28da0 2024-08-31T05:33:58.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.560+0000 7f8f5affd640 10 client.16632 handle_command_reply: tid=0 2024-08-31T05:33:58.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.560+0000 7f8f880ca740 1 client.16632 shutdown 2024-08-31T05:33:58.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.560+0000 7f8f880ca740 1 -- 172.21.15.5:0/438681574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564649f95070 msgr2=0x56464a350540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:58.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.560+0000 7f8f880ca740 1 --2- 172.21.15.5:0/438681574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564649f95070 0x56464a350540 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f8f74004a80 tx=0x7f8f74009500 comp rx=0 tx=0).stop 2024-08-31T05:33:58.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.560+0000 7f8f880ca740 1 -- 172.21.15.5:0/438681574 shutdown_connections 2024-08-31T05:33:58.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.560+0000 7f8f880ca740 1 --2- 172.21.15.5:0/438681574 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x564649f28da0 0x56464a3c9350 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:58.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.560+0000 7f8f880ca740 1 --2- 172.21.15.5:0/438681574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564649f95070 0x56464a350540 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:58.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.560+0000 7f8f880ca740 1 --2- 172.21.15.5:0/438681574 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564649f74390 0x56464a34fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:58.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.560+0000 7f8f880ca740 1 --2- 172.21.15.5:0/438681574 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564649f6c1b0 0x56464a352a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:58.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.560+0000 7f8f5affd640 0 client.16632 ms_handle_reset on v2:172.21.15.70:6836/2780036414 2024-08-31T05:33:58.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.560+0000 7f8f880ca740 1 -- 172.21.15.5:0/438681574 >> 172.21.15.5:0/438681574 conn(0x564649f89460 msgr2=0x56464a3476c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:58.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.560+0000 7f8f880ca740 1 -- 172.21.15.5:0/438681574 shutdown_connections 2024-08-31T05:33:58.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.560+0000 7f8f880ca740 1 -- 172.21.15.5:0/438681574 wait complete. 2024-08-31T05:33:58.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.560+0000 7f8f880ca740 20 client.16632 trim_cache size 0 max 16384 2024-08-31T05:33:58.567 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:33:58.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.561+0000 7f8f81b55640 1 -- 172.21.15.5:0/3624412836 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f8f640b4d20 msgr2=0x7f8f640b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:58.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.561+0000 7f8f81b55640 1 --2- 172.21.15.5:0/3624412836 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f8f640b4d20 0x7f8f640b7230 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8f74005fd0 tx=0x7f8f74009f00 comp rx=0 tx=0).stop 2024-08-31T05:33:58.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.561+0000 7f8f81b55640 1 -- 172.21.15.5:0/3624412836 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f7c1081c0 msgr2=0x7f8f7c199790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:33:58.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.561+0000 7f8f81b55640 1 --2- 172.21.15.5:0/3624412836 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f7c1081c0 0x7f8f7c199790 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c06b760 tx=0x7f8f7000ee50 comp rx=0 tx=0).stop 2024-08-31T05:33:58.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.561+0000 7f8f81b55640 1 -- 172.21.15.5:0/3624412836 shutdown_connections 2024-08-31T05:33:58.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.561+0000 7f8f81b55640 1 --2- 172.21.15.5:0/3624412836 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f8f640b4d20 0x7f8f640b7230 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:58.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.561+0000 7f8f81b55640 1 --2- 172.21.15.5:0/3624412836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f7c108b10 0x7f8f7c19ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:58.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.561+0000 7f8f81b55640 1 --2- 172.21.15.5:0/3624412836 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f7c1081c0 0x7f8f7c199790 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:58.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.561+0000 7f8f81b55640 1 --2- 172.21.15.5:0/3624412836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f7c102880 0x7f8f7c1991f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:33:58.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.561+0000 7f8f81b55640 1 -- 172.21.15.5:0/3624412836 >> 172.21.15.5:0/3624412836 conn(0x7f8f7c079510 msgr2=0x7f8f7c1062b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:33:58.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.561+0000 7f8f81b55640 1 -- 172.21.15.5:0/3624412836 shutdown_connections 2024-08-31T05:33:58.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:33:58.561+0000 7f8f81b55640 1 -- 172.21.15.5:0/3624412836 wait complete. 2024-08-31T05:33:58.914 INFO:tasks.workunit.client.0.smithi005.stdout: 1 415914 13.20 MB/sec execute 46 sec latency 64.757 ms 2024-08-31T05:33:59.372 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T05:33:59.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:33:59 smithi005 ceph-mon[18602]: pgmap v465: 129 pgs: 129 active+clean; 212 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.5 MiB/s wr, 253 op/s 2024-08-31T05:33:59.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:33:59 smithi070 ceph-mon[22316]: pgmap v465: 129 pgs: 129 active+clean; 212 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.5 MiB/s wr, 253 op/s 2024-08-31T05:33:59.637 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:33:59.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:33:59 smithi050 ceph-mon[22146]: pgmap v465: 129 pgs: 129 active+clean; 212 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.5 MiB/s wr, 253 op/s 2024-08-31T05:33:59.914 INFO:tasks.workunit.client.0.smithi005.stdout: 1 418915 13.30 MB/sec execute 47 sec latency 11.710 ms 2024-08-31T05:34:00.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.210+0000 7facc675a640 1 -- 172.21.15.5:0/1070750486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facc0108a90 msgr2=0x7facc010f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:00.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.210+0000 7facc675a640 1 --2- 172.21.15.5:0/1070750486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facc0108a90 0x7facc010f2c0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7facb8009ca0 tx=0x7facb802a8c0 comp rx=0 tx=0).stop 2024-08-31T05:34:00.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.211+0000 7facc675a640 1 -- 172.21.15.5:0/1070750486 shutdown_connections 2024-08-31T05:34:00.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.211+0000 7facc675a640 1 --2- 172.21.15.5:0/1070750486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facc0108a90 0x7facc010f2c0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:00.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.211+0000 7facc675a640 1 --2- 172.21.15.5:0/1070750486 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7facc0108140 0x7facc0108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:00.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.211+0000 7facc675a640 1 --2- 172.21.15.5:0/1070750486 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facc0102800 0x7facc0102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:00.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.211+0000 7facc675a640 1 -- 172.21.15.5:0/1070750486 >> 172.21.15.5:0/1070750486 conn(0x7facc00794d0 msgr2=0x7facc00798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:00.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.211+0000 7facc675a640 1 -- 172.21.15.5:0/1070750486 shutdown_connections 2024-08-31T05:34:00.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.211+0000 7facc675a640 1 -- 172.21.15.5:0/1070750486 wait complete. 2024-08-31T05:34:00.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.211+0000 7facc675a640 1 Processor -- start 2024-08-31T05:34:00.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.211+0000 7facc675a640 1 -- start start 2024-08-31T05:34:00.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.212+0000 7facc675a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facc0102800 0x7facc019a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:00.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.212+0000 7facc675a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facc0108140 0x7facc019a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:00.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.212+0000 7facc675a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7facc0108a90 0x7facc019fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:00.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.212+0000 7facc675a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7facc0113810 con 0x7facc0102800 2024-08-31T05:34:00.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.212+0000 7facc675a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7facc0113690 con 0x7facc0108140 2024-08-31T05:34:00.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.212+0000 7facc675a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7facc0113990 con 0x7facc0108a90 2024-08-31T05:34:00.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.212+0000 7facbffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facc0102800 0x7facc019a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:00.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.212+0000 7facbffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facc0102800 0x7facc019a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50810/0 (socket says 172.21.15.5:50810) 2024-08-31T05:34:00.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.212+0000 7facbffff640 1 -- 172.21.15.5:0/304189403 learned_addr learned my addr 172.21.15.5:0/304189403 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:00.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.212+0000 7facbf7fe640 1 --2- 172.21.15.5:0/304189403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facc0108140 0x7facc019a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:00.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.212+0000 7facc4cf7640 1 --2- 172.21.15.5:0/304189403 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7facc0108a90 0x7facc019fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:00.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.212+0000 7facbffff640 1 -- 172.21.15.5:0/304189403 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7facc0108a90 msgr2=0x7facc019fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:00.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.212+0000 7facbffff640 1 --2- 172.21.15.5:0/304189403 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7facc0108a90 0x7facc019fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:00.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.212+0000 7facbffff640 1 -- 172.21.15.5:0/304189403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facc0108140 msgr2=0x7facc019a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:00.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.212+0000 7facbffff640 1 --2- 172.21.15.5:0/304189403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facc0108140 0x7facc019a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:00.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.212+0000 7facbffff640 1 -- 172.21.15.5:0/304189403 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facc01a01b0 con 0x7facc0102800 2024-08-31T05:34:00.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.212+0000 7facbf7fe640 1 --2- 172.21.15.5:0/304189403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facc0108140 0x7facc019a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:34:00.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.213+0000 7facbffff640 1 --2- 172.21.15.5:0/304189403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facc0102800 0x7facc019a240 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7facb000e9f0 tx=0x7facb000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:00.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.213+0000 7facbd7fa640 1 -- 172.21.15.5:0/304189403 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb000cd80 con 0x7facc0102800 2024-08-31T05:34:00.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.213+0000 7facbd7fa640 1 -- 172.21.15.5:0/304189403 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7facb00108e0 con 0x7facc0102800 2024-08-31T05:34:00.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.213+0000 7facc675a640 1 -- 172.21.15.5:0/304189403 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facc01a04a0 con 0x7facc0102800 2024-08-31T05:34:00.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.213+0000 7facbd7fa640 1 -- 172.21.15.5:0/304189403 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb0018980 con 0x7facc0102800 2024-08-31T05:34:00.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.213+0000 7facc675a640 1 -- 172.21.15.5:0/304189403 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facc01a6c00 con 0x7facc0102800 2024-08-31T05:34:00.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.216+0000 7facccccf740 1 Processor -- start 2024-08-31T05:34:00.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.216+0000 7facccccf740 1 -- start start 2024-08-31T05:34:00.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.216+0000 7facbd7fa640 1 -- 172.21.15.5:0/304189403 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7facb0018b20 con 0x7facc0102800 2024-08-31T05:34:00.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.216+0000 7facccccf740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bd952b0070 0x55bd95655310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:00.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.216+0000 7facccccf740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bd952871b0 0x55bd95655850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:00.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.216+0000 7facccccf740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bd9528f390 0x55bd95655d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:00.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.216+0000 7facccccf740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55bd955cc680 con 0x55bd952871b0 2024-08-31T05:34:00.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.216+0000 7facccccf740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55bd955bbc10 con 0x55bd952b0070 2024-08-31T05:34:00.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.216+0000 7facccccf740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55bd955bfbc0 con 0x55bd9528f390 2024-08-31T05:34:00.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.216+0000 7facc4cf7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bd952b0070 0x55bd95655310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:00.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.216+0000 7facbf7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bd9528f390 0x55bd95655d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:00.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.216+0000 7facc4cf7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bd952b0070 0x55bd95655310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:52134/0 (socket says 172.21.15.5:52134) 2024-08-31T05:34:00.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.216+0000 7facc4cf7640 1 -- 172.21.15.5:0/2425886111 learned_addr learned my addr 172.21.15.5:0/2425886111 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:00.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.216+0000 7facbffff640 1 --2- 172.21.15.5:0/2425886111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bd952871b0 0x55bd95655850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:00.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.217+0000 7facc4cf7640 1 -- 172.21.15.5:0/2425886111 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bd9528f390 msgr2=0x55bd95655d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:00.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.217+0000 7facc4cf7640 1 --2- 172.21.15.5:0/2425886111 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bd9528f390 0x55bd95655d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:00.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.217+0000 7facc4cf7640 1 -- 172.21.15.5:0/2425886111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bd952871b0 msgr2=0x55bd95655850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:00.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.217+0000 7facc4cf7640 1 --2- 172.21.15.5:0/2425886111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bd952871b0 0x55bd95655850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:00.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.217+0000 7facc4cf7640 1 -- 172.21.15.5:0/2425886111 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd9531b650 con 0x55bd952b0070 2024-08-31T05:34:00.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.217+0000 7facbffff640 1 --2- 172.21.15.5:0/2425886111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bd952871b0 0x55bd95655850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:34:00.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.217+0000 7facc4cf7640 1 --2- 172.21.15.5:0/2425886111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bd952b0070 0x55bd95655310 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7facb802f410 tx=0x7facb802f440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fdf8f663d02607b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:00.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.217+0000 7faca67fc640 1 -- 172.21.15.5:0/2425886111 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb8031cf0 con 0x55bd952b0070 2024-08-31T05:34:00.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.217+0000 7faca67fc640 1 -- 172.21.15.5:0/2425886111 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7facb8036030 con 0x55bd952b0070 2024-08-31T05:34:00.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.217+0000 7faca67fc640 1 -- 172.21.15.5:0/2425886111 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb80042a0 con 0x55bd952b0070 2024-08-31T05:34:00.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.217+0000 7facbd7fa640 1 --2- 172.21.15.5:0/304189403 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7faca80b4ca0 0x7faca80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:00.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.217+0000 7facbffff640 1 --2- 172.21.15.5:0/304189403 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7faca80b4ca0 0x7faca80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:00.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.218+0000 7facbd7fa640 1 -- 172.21.15.5:0/304189403 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7facb00e5c30 con 0x7facc0102800 2024-08-31T05:34:00.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.218+0000 7facccccf740 1 -- 172.21.15.5:0/2425886111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bd952b0070 msgr2=0x55bd95655310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:00.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.218+0000 7facccccf740 1 --2- 172.21.15.5:0/2425886111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bd952b0070 0x55bd95655310 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7facb802f410 tx=0x7facb802f440 comp rx=0 tx=0).stop 2024-08-31T05:34:00.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.218+0000 7facbffff640 1 --2- 172.21.15.5:0/304189403 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7faca80b4ca0 0x7faca80b71b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7facb00e30b0 tx=0x7facb001fad0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:00.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.218+0000 7facccccf740 1 -- 172.21.15.5:0/2425886111 shutdown_connections 2024-08-31T05:34:00.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.218+0000 7facccccf740 1 --2- 172.21.15.5:0/2425886111 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bd9528f390 0x55bd95655d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:00.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.218+0000 7facccccf740 1 --2- 172.21.15.5:0/2425886111 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bd952871b0 0x55bd95655850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:00.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.218+0000 7facccccf740 1 --2- 172.21.15.5:0/2425886111 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bd952b0070 0x55bd95655310 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:00.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.218+0000 7facccccf740 1 -- 172.21.15.5:0/2425886111 >> 172.21.15.5:0/2425886111 conn(0x55bd952a4460 msgr2=0x55bd95653200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:00.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.218+0000 7facccccf740 1 -- 172.21.15.5:0/2425886111 shutdown_connections 2024-08-31T05:34:00.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.219+0000 7facccccf740 1 -- 172.21.15.5:0/2425886111 wait complete. 2024-08-31T05:34:00.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.219+0000 7facccccf740 1 -- start start 2024-08-31T05:34:00.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.219+0000 7facccccf740 1 Processor -- start 2024-08-31T05:34:00.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.220+0000 7facccccf740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bd952871b0 0x55bd95660b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:00.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.220+0000 7facccccf740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bd9528f390 0x55bd95661040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:00.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.220+0000 7facccccf740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bd952b0070 0x55bd95661580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:00.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.220+0000 7facbf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bd9528f390 0x55bd95661040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:00.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.220+0000 7facc4cf7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bd952871b0 0x55bd95660b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:00.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.220+0000 7facccccf740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55bd9541e700 con 0x55bd9528f390 2024-08-31T05:34:00.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.220+0000 7facccccf740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55bd95542750 con 0x55bd952b0070 2024-08-31T05:34:00.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.220+0000 7facc4cf7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bd952871b0 0x55bd95660b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:56366/0 (socket says 172.21.15.5:56366) 2024-08-31T05:34:00.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.220+0000 7facbf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bd9528f390 0x55bd95661040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50826/0 (socket says 172.21.15.5:50826) 2024-08-31T05:34:00.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.220+0000 7facccccf740 1 -- 172.21.15.5:0/4245530531 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55bd95663910 con 0x55bd952871b0 2024-08-31T05:34:00.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.220+0000 7facc4cf7640 1 -- 172.21.15.5:0/4245530531 learned_addr learned my addr 172.21.15.5:0/4245530531 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:00.339 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:34:00.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.220+0000 7facc4cf7640 1 --2- 172.21.15.5:0/4245530531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bd952b0070 0x55bd95661580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:00.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.220+0000 7facccccf740 10 client.0 _ll_register_callbacks cb 0x55bd95571e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:34:00.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.220+0000 7facc4cf7640 1 -- 172.21.15.5:0/4245530531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bd952b0070 msgr2=0x55bd95661580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:00.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.220+0000 7facc4cf7640 1 --2- 172.21.15.5:0/4245530531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bd952b0070 0x55bd95661580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:00.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.220+0000 7facc4cf7640 1 -- 172.21.15.5:0/4245530531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bd9528f390 msgr2=0x55bd95661040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:00.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.220+0000 7facc4cf7640 1 --2- 172.21.15.5:0/4245530531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bd9528f390 0x55bd95661040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:00.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.220+0000 7facc4cf7640 1 -- 172.21.15.5:0/4245530531 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd9557b900 con 0x55bd952871b0 2024-08-31T05:34:00.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.220+0000 7facccccf740 1 -- 172.21.15.5:0/4245530531 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7facb8036030 con 0x55bd952871b0 2024-08-31T05:34:00.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.221+0000 7facc4cf7640 1 --2- 172.21.15.5:0/4245530531 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bd952871b0 0x55bd95660b00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7facb8009a60 tx=0x7facb8003c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a06f7ec96e20c36 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:00.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.221+0000 7fac9f7fe640 10 client.26254 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:34:00.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.221+0000 7fac9f7fe640 1 -- 172.21.15.5:0/4245530531 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb8059060 con 0x55bd952871b0 2024-08-31T05:34:00.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.221+0000 7fac9f7fe640 1 -- 172.21.15.5:0/4245530531 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7facb802f860 con 0x55bd952871b0 2024-08-31T05:34:00.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.221+0000 7fac9f7fe640 1 -- 172.21.15.5:0/4245530531 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7facb802fa60 con 0x55bd952871b0 2024-08-31T05:34:00.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.221+0000 7facccccf740 10 client.26254 fetch_fsmap learned FSMap version 34 2024-08-31T05:34:00.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.221+0000 7facccccf740 1 -- 172.21.15.5:0/4245530531 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({fsmap=34}) -- 0x55bd95677e70 con 0x55bd952871b0 2024-08-31T05:34:00.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.222+0000 7fac9f7fe640 1 -- 172.21.15.5:0/4245530531 <== mon.1 v2:172.21.15.70:3300/0 4 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7facb8043070 con 0x55bd952871b0 2024-08-31T05:34:00.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.222+0000 7facccccf740 10 client.26254 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:34:00.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.222+0000 7facccccf740 10 client.26254 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-31T05:34:00.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.222+0000 7facccccf740 20 client.26254 populate_metadata read hostname 'smithi005' 2024-08-31T05:34:00.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.222+0000 7facccccf740 1 --2- 172.21.15.5:0/4245530531 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55bd9526e9f0 0x55bd9567b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:00.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.222+0000 7facccccf740 4 client.26254 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:34:00.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.222+0000 7facccccf740 1 -- 172.21.15.5:0/4245530531 --> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bd955ce5d0 con 0x55bd9526e9f0 2024-08-31T05:34:00.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.222+0000 7facbf7fe640 1 --2- 172.21.15.5:0/4245530531 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55bd9526e9f0 0x55bd9567b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:00.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.222+0000 7fac9f7fe640 10 client.26254 ms_handle_connect on v2:172.21.15.50:6838/98200944 2024-08-31T05:34:00.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.222+0000 7facbf7fe640 1 --2- 172.21.15.5:0/4245530531 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55bd9526e9f0 0x55bd9567b1d0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=dff54fa144ac1f66 server_cookie=e4b0c0758d977f2e in_seq=0 out_seq=0 2024-08-31T05:34:00.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.223+0000 7fac9f7fe640 1 -- 172.21.15.5:0/4245530531 <== mds.1 v2:172.21.15.50:6838/98200944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bd955ce5d0 con 0x55bd9526e9f0 2024-08-31T05:34:00.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.223+0000 7fac9f7fe640 10 client.26254 handle_command_reply: tid=0 2024-08-31T05:34:00.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.223+0000 7facccccf740 1 client.26254 shutdown 2024-08-31T05:34:00.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.223+0000 7facccccf740 1 -- 172.21.15.5:0/4245530531 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bd952871b0 msgr2=0x55bd95660b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:00.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.223+0000 7facccccf740 1 --2- 172.21.15.5:0/4245530531 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bd952871b0 0x55bd95660b00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7facb8009a60 tx=0x7facb8003c90 comp rx=0 tx=0).stop 2024-08-31T05:34:00.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.223+0000 7facccccf740 1 -- 172.21.15.5:0/4245530531 shutdown_connections 2024-08-31T05:34:00.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.223+0000 7facccccf740 1 --2- 172.21.15.5:0/4245530531 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55bd9526e9f0 0x55bd9567b1d0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:00.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.223+0000 7facccccf740 1 --2- 172.21.15.5:0/4245530531 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bd952b0070 0x55bd95661580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:00.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.223+0000 7facccccf740 1 --2- 172.21.15.5:0/4245530531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bd9528f390 0x55bd95661040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:00.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.223+0000 7facccccf740 1 --2- 172.21.15.5:0/4245530531 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bd952871b0 0x55bd95660b00 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:00.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.223+0000 7fac9f7fe640 0 client.26254 ms_handle_reset on v2:172.21.15.50:6838/98200944 2024-08-31T05:34:00.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.223+0000 7facccccf740 1 -- 172.21.15.5:0/4245530531 >> 172.21.15.5:0/4245530531 conn(0x55bd952a4460 msgr2=0x55bd956584a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:00.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.223+0000 7facccccf740 1 -- 172.21.15.5:0/4245530531 shutdown_connections 2024-08-31T05:34:00.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.223+0000 7facccccf740 1 -- 172.21.15.5:0/4245530531 wait complete. 2024-08-31T05:34:00.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.224+0000 7facccccf740 20 client.26254 trim_cache size 0 max 16384 2024-08-31T05:34:00.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.239+0000 7facccccf740 1 Processor -- start 2024-08-31T05:34:00.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.239+0000 7facccccf740 1 -- start start 2024-08-31T05:34:00.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.239+0000 7facccccf740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bd952871b0 0x55bd95666b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:00.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.239+0000 7facccccf740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bd9528f390 0x55bd95656a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:00.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.239+0000 7facccccf740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bd952b0070 0x55bd9565dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:00.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.239+0000 7facccccf740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7facc01ae940 con 0x55bd952b0070 2024-08-31T05:34:00.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.239+0000 7facccccf740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7facc01b0480 con 0x55bd952871b0 2024-08-31T05:34:00.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.239+0000 7facccccf740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7facc01af010 con 0x55bd9528f390 2024-08-31T05:34:00.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.240+0000 7facc4cf7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bd952871b0 0x55bd95666b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:00.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.240+0000 7facc4cf7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bd952871b0 0x55bd95666b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:52156/0 (socket says 172.21.15.5:52156) 2024-08-31T05:34:00.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.240+0000 7facc4cf7640 1 -- 172.21.15.5:0/1450454153 learned_addr learned my addr 172.21.15.5:0/1450454153 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:00.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.240+0000 7facbf7fe640 1 --2- 172.21.15.5:0/1450454153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bd9528f390 0x55bd95656a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:00.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.240+0000 7facc4cf7640 1 --2- 172.21.15.5:0/1450454153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bd952b0070 0x55bd9565dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:00.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.240+0000 7facc4cf7640 1 -- 172.21.15.5:0/1450454153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bd9528f390 msgr2=0x55bd95656a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:00.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.240+0000 7facc4cf7640 1 --2- 172.21.15.5:0/1450454153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bd9528f390 0x55bd95656a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:00.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.240+0000 7facc4cf7640 1 -- 172.21.15.5:0/1450454153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bd952b0070 msgr2=0x55bd9565dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:00.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.240+0000 7facc4cf7640 1 --2- 172.21.15.5:0/1450454153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bd952b0070 0x55bd9565dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:00.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.240+0000 7facc4cf7640 1 -- 172.21.15.5:0/1450454153 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd95661dc0 con 0x55bd952871b0 2024-08-31T05:34:00.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.240+0000 7facc4cf7640 1 --2- 172.21.15.5:0/1450454153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bd952871b0 0x55bd95666b70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7facb8009690 tx=0x7facb804f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1cfc87701a4e1768 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:00.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.241+0000 7faca5ffb640 1 -- 172.21.15.5:0/1450454153 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb8064040 con 0x55bd952871b0 2024-08-31T05:34:00.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.241+0000 7faca5ffb640 1 -- 172.21.15.5:0/1450454153 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7facb8036030 con 0x55bd952871b0 2024-08-31T05:34:00.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.241+0000 7faca5ffb640 1 -- 172.21.15.5:0/1450454153 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb8030cd0 con 0x55bd952871b0 2024-08-31T05:34:00.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.242+0000 7facccccf740 1 -- 172.21.15.5:0/1450454153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bd952871b0 msgr2=0x55bd95666b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:00.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.242+0000 7facccccf740 1 --2- 172.21.15.5:0/1450454153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bd952871b0 0x55bd95666b70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7facb8009690 tx=0x7facb804f000 comp rx=0 tx=0).stop 2024-08-31T05:34:00.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.242+0000 7facccccf740 1 -- 172.21.15.5:0/1450454153 shutdown_connections 2024-08-31T05:34:00.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.242+0000 7facccccf740 1 --2- 172.21.15.5:0/1450454153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bd952b0070 0x55bd9565dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:00.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.242+0000 7facccccf740 1 --2- 172.21.15.5:0/1450454153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bd9528f390 0x55bd95656a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:00.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.242+0000 7facccccf740 1 --2- 172.21.15.5:0/1450454153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bd952871b0 0x55bd95666b70 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:00.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.242+0000 7facccccf740 1 -- 172.21.15.5:0/1450454153 >> 172.21.15.5:0/1450454153 conn(0x55bd952a4460 msgr2=0x55bd95656340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:00.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.242+0000 7facccccf740 1 -- 172.21.15.5:0/1450454153 shutdown_connections 2024-08-31T05:34:00.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.242+0000 7facccccf740 1 -- 172.21.15.5:0/1450454153 wait complete. 2024-08-31T05:34:00.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.242+0000 7facccccf740 1 -- start start 2024-08-31T05:34:00.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.242+0000 7facccccf740 1 Processor -- start 2024-08-31T05:34:00.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.242+0000 7facccccf740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bd952871b0 0x55bd95674140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:00.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.243+0000 7facccccf740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bd9528f390 0x55bd95674720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:00.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.243+0000 7facccccf740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bd952b0070 0x55bd956de920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:00.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.243+0000 7facccccf740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7facc01afdb0 con 0x55bd952871b0 2024-08-31T05:34:00.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.243+0000 7facccccf740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7facc01af6e0 con 0x55bd9528f390 2024-08-31T05:34:00.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.243+0000 7facccccf740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7facc01ac920 con 0x55bd952b0070 2024-08-31T05:34:00.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.243+0000 7facccccf740 10 client.0 _ll_register_callbacks cb 0x7facb4009b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:34:00.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.243+0000 7facc4cf7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bd952871b0 0x55bd95674140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:00.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.243+0000 7facbf7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bd9528f390 0x55bd95674720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:00.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.243+0000 7facc4cf7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bd952871b0 0x55bd95674140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50846/0 (socket says 172.21.15.5:50846) 2024-08-31T05:34:00.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.243+0000 7facc4cf7640 1 -- 172.21.15.5:0/205038264 learned_addr learned my addr 172.21.15.5:0/205038264 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:00.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.243+0000 7facc4cf7640 1 --2- 172.21.15.5:0/205038264 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bd952b0070 0x55bd956de920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:00.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.243+0000 7facbf7fe640 1 -- 172.21.15.5:0/205038264 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bd952b0070 msgr2=0x55bd956de920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:00.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.243+0000 7facbf7fe640 1 --2- 172.21.15.5:0/205038264 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bd952b0070 0x55bd956de920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:00.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.243+0000 7facbf7fe640 1 -- 172.21.15.5:0/205038264 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bd952871b0 msgr2=0x55bd95674140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:00.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.243+0000 7facbf7fe640 1 --2- 172.21.15.5:0/205038264 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bd952871b0 0x55bd95674140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:00.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.243+0000 7facbf7fe640 1 -- 172.21.15.5:0/205038264 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd956def90 con 0x55bd9528f390 2024-08-31T05:34:00.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.243+0000 7facc4cf7640 1 --2- 172.21.15.5:0/205038264 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bd952871b0 0x55bd95674140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:34:00.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.243+0000 7facbf7fe640 1 --2- 172.21.15.5:0/205038264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bd9528f390 0x55bd95674720 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x55bd95661c20 tx=0x7facb4012b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=890139fabb0849fc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:00.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.243+0000 7fac9f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:34:00.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.243+0000 7fac9f7fe640 1 -- 172.21.15.5:0/205038264 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb4005220 con 0x55bd9528f390 2024-08-31T05:34:00.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.244+0000 7facccccf740 1 -- 172.21.15.5:0/205038264 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7facb8036030 con 0x55bd9528f390 2024-08-31T05:34:00.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.244+0000 7fac9f7fe640 1 -- 172.21.15.5:0/205038264 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7facb40053c0 con 0x55bd9528f390 2024-08-31T05:34:00.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.244+0000 7fac9f7fe640 1 -- 172.21.15.5:0/205038264 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7facb40055c0 con 0x55bd9528f390 2024-08-31T05:34:00.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.244+0000 7facccccf740 10 client.26243 fetch_fsmap learned FSMap version 34 2024-08-31T05:34:00.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.244+0000 7facccccf740 1 -- 172.21.15.5:0/205038264 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55bd956e61d0 con 0x55bd9528f390 2024-08-31T05:34:00.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.244+0000 7fac9f7fe640 1 -- 172.21.15.5:0/205038264 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7facb8036030 con 0x55bd9528f390 2024-08-31T05:34:00.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.244+0000 7fac9f7fe640 1 -- 172.21.15.5:0/205038264 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7facb401f9c0 con 0x55bd9528f390 2024-08-31T05:34:00.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.244+0000 7facccccf740 10 client.26243 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:34:00.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.244+0000 7facccccf740 10 client.26243 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-31T05:34:00.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.244+0000 7facccccf740 20 client.26243 populate_metadata read hostname 'smithi005' 2024-08-31T05:34:00.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.244+0000 7facccccf740 1 --2- 172.21.15.5:0/205038264 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55bd95243da0 0x55bd956e8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:00.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.244+0000 7facccccf740 4 client.26243 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:34:00.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.244+0000 7facccccf740 1 -- 172.21.15.5:0/205038264 --> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bd955ca070 con 0x55bd95243da0 2024-08-31T05:34:00.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.244+0000 7facc4cf7640 1 --2- 172.21.15.5:0/205038264 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55bd95243da0 0x55bd956e8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:00.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.245+0000 7fac9f7fe640 10 client.26243 ms_handle_connect on v2:172.21.15.50:6838/98200944 2024-08-31T05:34:00.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.245+0000 7facc4cf7640 1 --2- 172.21.15.5:0/205038264 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55bd95243da0 0x55bd956e8900 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=762f4ce35e0665bc server_cookie=3fdf86235841b594 in_seq=0 out_seq=0 2024-08-31T05:34:00.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.245+0000 7fac9f7fe640 1 -- 172.21.15.5:0/205038264 <== mds.1 v2:172.21.15.50:6838/98200944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bd955ca070 con 0x55bd95243da0 2024-08-31T05:34:00.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.245+0000 7fac9f7fe640 10 client.26243 handle_command_reply: tid=0 2024-08-31T05:34:00.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.245+0000 7facccccf740 1 client.26243 shutdown 2024-08-31T05:34:00.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.245+0000 7facccccf740 1 -- 172.21.15.5:0/205038264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bd9528f390 msgr2=0x55bd95674720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:00.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.245+0000 7facccccf740 1 --2- 172.21.15.5:0/205038264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bd9528f390 0x55bd95674720 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x55bd95661c20 tx=0x7facb4012b00 comp rx=0 tx=0).stop 2024-08-31T05:34:00.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.245+0000 7facccccf740 1 -- 172.21.15.5:0/205038264 shutdown_connections 2024-08-31T05:34:00.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.245+0000 7facccccf740 1 --2- 172.21.15.5:0/205038264 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55bd95243da0 0x55bd956e8900 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:00.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.245+0000 7facccccf740 1 --2- 172.21.15.5:0/205038264 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bd952b0070 0x55bd956de920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:00.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.245+0000 7facccccf740 1 --2- 172.21.15.5:0/205038264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bd9528f390 0x55bd95674720 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:00.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.245+0000 7facccccf740 1 --2- 172.21.15.5:0/205038264 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bd952871b0 0x55bd95674140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:00.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.245+0000 7fac9f7fe640 0 client.26243 ms_handle_reset on v2:172.21.15.50:6838/98200944 2024-08-31T05:34:00.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.245+0000 7facccccf740 1 -- 172.21.15.5:0/205038264 >> 172.21.15.5:0/205038264 conn(0x55bd952a4460 msgr2=0x55bd95658ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:00.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.246+0000 7facccccf740 1 -- 172.21.15.5:0/205038264 shutdown_connections 2024-08-31T05:34:00.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.246+0000 7facccccf740 1 -- 172.21.15.5:0/205038264 wait complete. 2024-08-31T05:34:00.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.246+0000 7facccccf740 20 client.26243 trim_cache size 0 max 16384 2024-08-31T05:34:00.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.246+0000 7facc675a640 1 -- 172.21.15.5:0/304189403 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7faca80b4ca0 msgr2=0x7faca80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:00.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.246+0000 7facc675a640 1 --2- 172.21.15.5:0/304189403 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7faca80b4ca0 0x7faca80b71b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7facb00e30b0 tx=0x7facb001fad0 comp rx=0 tx=0).stop 2024-08-31T05:34:00.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.246+0000 7facc675a640 1 -- 172.21.15.5:0/304189403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facc0102800 msgr2=0x7facc019a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:00.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.246+0000 7facc675a640 1 --2- 172.21.15.5:0/304189403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facc0102800 0x7facc019a240 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7facb000e9f0 tx=0x7facb000eeb0 comp rx=0 tx=0).stop 2024-08-31T05:34:00.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.246+0000 7facc675a640 1 -- 172.21.15.5:0/304189403 shutdown_connections 2024-08-31T05:34:00.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.246+0000 7facc675a640 1 --2- 172.21.15.5:0/304189403 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7faca80b4ca0 0x7faca80b71b0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:00.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.246+0000 7facc675a640 1 --2- 172.21.15.5:0/304189403 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7facc0108a90 0x7facc019fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:00.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.246+0000 7facc675a640 1 --2- 172.21.15.5:0/304189403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7facc0108140 0x7facc019a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:00.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.246+0000 7facc675a640 1 --2- 172.21.15.5:0/304189403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7facc0102800 0x7facc019a240 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:00.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.246+0000 7facc675a640 1 -- 172.21.15.5:0/304189403 >> 172.21.15.5:0/304189403 conn(0x7facc00794d0 msgr2=0x7facc0104210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:00.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.246+0000 7facc675a640 1 -- 172.21.15.5:0/304189403 shutdown_connections 2024-08-31T05:34:00.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:00.246+0000 7facc675a640 1 -- 172.21.15.5:0/304189403 wait complete. 2024-08-31T05:34:00.915 INFO:tasks.workunit.client.0.smithi005.stdout: 1 419618 13.07 MB/sec execute 48 sec latency 41.601 ms 2024-08-31T05:34:01.050 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T05:34:01.324 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:34:01 smithi005 ceph-mon[18602]: pgmap v466: 129 pgs: 129 active+clean; 215 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.5 MiB/s wr, 316 op/s 2024-08-31T05:34:01.346 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:34:01.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:34:01 smithi070 ceph-mon[22316]: pgmap v466: 129 pgs: 129 active+clean; 215 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.5 MiB/s wr, 316 op/s 2024-08-31T05:34:01.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:34:01 smithi050 ceph-mon[22146]: pgmap v466: 129 pgs: 129 active+clean; 215 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.5 MiB/s wr, 316 op/s 2024-08-31T05:34:01.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.863+0000 7f9cb0540640 1 -- 172.21.15.5:0/2169112668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ca8102830 msgr2=0x7f9ca8102c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:01.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.863+0000 7f9cb0540640 1 --2- 172.21.15.5:0/2169112668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ca8102830 0x7f9ca8102c40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4009860 tx=0x7f9ca402a340 comp rx=0 tx=0).stop 2024-08-31T05:34:01.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.863+0000 7f9cb0540640 1 -- 172.21.15.5:0/2169112668 shutdown_connections 2024-08-31T05:34:01.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.863+0000 7f9cb0540640 1 --2- 172.21.15.5:0/2169112668 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ca8108ac0 0x7f9ca810f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:01.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.863+0000 7f9cb0540640 1 --2- 172.21.15.5:0/2169112668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ca8108170 0x7f9ca8108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:01.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.864+0000 7f9cb0540640 1 --2- 172.21.15.5:0/2169112668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ca8102830 0x7f9ca8102c40 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:01.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.864+0000 7f9cb0540640 1 -- 172.21.15.5:0/2169112668 >> 172.21.15.5:0/2169112668 conn(0x7f9ca80794d0 msgr2=0x7f9ca80798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:01.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.864+0000 7f9cb0540640 1 -- 172.21.15.5:0/2169112668 shutdown_connections 2024-08-31T05:34:01.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.864+0000 7f9cb0540640 1 -- 172.21.15.5:0/2169112668 wait complete. 2024-08-31T05:34:01.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.865+0000 7f9cb0540640 1 Processor -- start 2024-08-31T05:34:01.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.865+0000 7f9cb0540640 1 -- start start 2024-08-31T05:34:01.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.865+0000 7f9cb0540640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ca8102830 0x7f9ca81a0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:01.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.865+0000 7f9cb0540640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ca8108170 0x7f9ca81a0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:01.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.865+0000 7f9cb0540640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ca8108ac0 0x7f9ca81a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:01.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.865+0000 7f9cb0540640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca8112770 con 0x7f9ca8108ac0 2024-08-31T05:34:01.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.865+0000 7f9cb0540640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca81125f0 con 0x7f9ca8102830 2024-08-31T05:34:01.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.865+0000 7f9cb0540640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca81128f0 con 0x7f9ca8108170 2024-08-31T05:34:01.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.865+0000 7f9caeadd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ca8108ac0 0x7f9ca81a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:01.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.865+0000 7f9cae2dc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ca8102830 0x7f9ca81a0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:01.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.865+0000 7f9caeadd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ca8108ac0 0x7f9ca81a60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50870/0 (socket says 172.21.15.5:50870) 2024-08-31T05:34:01.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.865+0000 7f9cadadb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ca8108170 0x7f9ca81a0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:01.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.865+0000 7f9caeadd640 1 -- 172.21.15.5:0/2297398614 learned_addr learned my addr 172.21.15.5:0/2297398614 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:01.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.866+0000 7f9cae2dc640 1 -- 172.21.15.5:0/2297398614 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ca8108170 msgr2=0x7f9ca81a0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:01.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.866+0000 7f9cae2dc640 1 --2- 172.21.15.5:0/2297398614 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ca8108170 0x7f9ca81a0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:01.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.866+0000 7f9cae2dc640 1 -- 172.21.15.5:0/2297398614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ca8108ac0 msgr2=0x7f9ca81a60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:01.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.866+0000 7f9cae2dc640 1 --2- 172.21.15.5:0/2297398614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ca8108ac0 0x7f9ca81a60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:01.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.866+0000 7f9cae2dc640 1 -- 172.21.15.5:0/2297398614 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ca81a67f0 con 0x7f9ca8102830 2024-08-31T05:34:01.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.866+0000 7f9cadadb640 1 --2- 172.21.15.5:0/2297398614 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ca8108170 0x7f9ca81a0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:34:01.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.866+0000 7f9caeadd640 1 --2- 172.21.15.5:0/2297398614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ca8108ac0 0x7f9ca81a60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:34:01.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.866+0000 7f9cae2dc640 1 --2- 172.21.15.5:0/2297398614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ca8102830 0x7f9ca81a0880 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4035040 tx=0x7f9ca4032d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:01.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.866+0000 7f9c9f7fe640 1 -- 172.21.15.5:0/2297398614 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca4040020 con 0x7f9ca8102830 2024-08-31T05:34:01.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.866+0000 7f9c9f7fe640 1 -- 172.21.15.5:0/2297398614 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ca4030e10 con 0x7f9ca8102830 2024-08-31T05:34:01.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.866+0000 7f9cb0540640 1 -- 172.21.15.5:0/2297398614 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ca81a6a80 con 0x7f9ca8102830 2024-08-31T05:34:01.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.866+0000 7f9c9f7fe640 1 -- 172.21.15.5:0/2297398614 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca4037040 con 0x7f9ca8102830 2024-08-31T05:34:01.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.866+0000 7f9cb0540640 1 -- 172.21.15.5:0/2297398614 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ca81ad240 con 0x7f9ca8102830 2024-08-31T05:34:01.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.869+0000 7f9c9f7fe640 1 -- 172.21.15.5:0/2297398614 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f9ca4043020 con 0x7f9ca8102830 2024-08-31T05:34:01.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.869+0000 7f9cb6ab5740 1 Processor -- start 2024-08-31T05:34:01.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.869+0000 7f9cb6ab5740 1 -- start start 2024-08-31T05:34:01.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.870+0000 7f9cb6ab5740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56183ef74070 0x56183f319310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:01.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.870+0000 7f9cb6ab5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56183ef4b1b0 0x56183f319850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:01.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.870+0000 7f9cb6ab5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56183ef53390 0x56183f319d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:01.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.870+0000 7f9cb6ab5740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56183f290680 con 0x56183ef74070 2024-08-31T05:34:01.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.870+0000 7f9cb6ab5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56183f27fc10 con 0x56183ef53390 2024-08-31T05:34:01.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.870+0000 7f9cb6ab5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56183f283bc0 con 0x56183ef4b1b0 2024-08-31T05:34:01.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.870+0000 7f9caeadd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56183ef74070 0x56183f319310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:01.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.870+0000 7f9cae2dc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56183ef4b1b0 0x56183f319850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:01.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.870+0000 7f9caeadd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56183ef74070 0x56183f319310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50876/0 (socket says 172.21.15.5:50876) 2024-08-31T05:34:01.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.870+0000 7f9caeadd640 1 -- 172.21.15.5:0/1734597729 learned_addr learned my addr 172.21.15.5:0/1734597729 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:01.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.870+0000 7f9cadadb640 1 --2- 172.21.15.5:0/1734597729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56183ef53390 0x56183f319d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:01.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.870+0000 7f9c9f7fe640 1 --2- 172.21.15.5:0/2297398614 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9c940b4d20 0x7f9c940b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:01.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.870+0000 7f9cadadb640 1 -- 172.21.15.5:0/1734597729 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56183ef4b1b0 msgr2=0x56183f319850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:01.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.870+0000 7f9cadadb640 1 --2- 172.21.15.5:0/1734597729 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56183ef4b1b0 0x56183f319850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:01.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.870+0000 7f9cadadb640 1 -- 172.21.15.5:0/1734597729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56183ef74070 msgr2=0x56183f319310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:01.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.870+0000 7f9cadadb640 1 --2- 172.21.15.5:0/1734597729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56183ef74070 0x56183f319310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:01.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.870+0000 7f9cadadb640 1 -- 172.21.15.5:0/1734597729 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56183efdf650 con 0x56183ef53390 2024-08-31T05:34:01.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.870+0000 7f9cae2dc640 1 --2- 172.21.15.5:0/1734597729 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56183ef4b1b0 0x56183f319850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:34:01.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.870+0000 7f9caeadd640 1 --2- 172.21.15.5:0/1734597729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56183ef74070 0x56183f319310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:34:01.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.870+0000 7f9c9f7fe640 1 -- 172.21.15.5:0/2297398614 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f9ca4105600 con 0x7f9ca8102830 2024-08-31T05:34:01.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.870+0000 7f9caeadd640 1 --2- 172.21.15.5:0/2297398614 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9c940b4d20 0x7f9c940b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:01.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.870+0000 7f9cadadb640 1 --2- 172.21.15.5:0/1734597729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56183ef53390 0x56183f319d90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9c98009530 tx=0x7f9c98011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eac56447df6397c4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:01.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.871+0000 7f9c9cff9640 1 -- 172.21.15.5:0/1734597729 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c98004220 con 0x56183ef53390 2024-08-31T05:34:01.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.871+0000 7f9c9cff9640 1 -- 172.21.15.5:0/1734597729 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c980043c0 con 0x56183ef53390 2024-08-31T05:34:01.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.871+0000 7f9c9cff9640 1 -- 172.21.15.5:0/1734597729 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c9800fa30 con 0x56183ef53390 2024-08-31T05:34:01.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.872+0000 7f9cb6ab5740 1 -- 172.21.15.5:0/1734597729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56183ef53390 msgr2=0x56183f319d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:01.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.872+0000 7f9cb6ab5740 1 --2- 172.21.15.5:0/1734597729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56183ef53390 0x56183f319d90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9c98009530 tx=0x7f9c98011810 comp rx=0 tx=0).stop 2024-08-31T05:34:01.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.872+0000 7f9caeadd640 1 --2- 172.21.15.5:0/2297398614 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9c940b4d20 0x7f9c940b7230 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0011880 tx=0x7f9ca0004a40 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:01.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.872+0000 7f9cb6ab5740 1 -- 172.21.15.5:0/1734597729 shutdown_connections 2024-08-31T05:34:01.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.872+0000 7f9cb6ab5740 1 --2- 172.21.15.5:0/1734597729 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56183ef53390 0x56183f319d90 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:01.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.872+0000 7f9cb6ab5740 1 --2- 172.21.15.5:0/1734597729 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56183ef4b1b0 0x56183f319850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:01.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.872+0000 7f9cb6ab5740 1 --2- 172.21.15.5:0/1734597729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56183ef74070 0x56183f319310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:01.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.872+0000 7f9cb6ab5740 1 -- 172.21.15.5:0/1734597729 >> 172.21.15.5:0/1734597729 conn(0x56183ef68460 msgr2=0x56183f317200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:01.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.872+0000 7f9cb6ab5740 1 -- 172.21.15.5:0/1734597729 shutdown_connections 2024-08-31T05:34:01.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.872+0000 7f9cb6ab5740 1 -- 172.21.15.5:0/1734597729 wait complete. 2024-08-31T05:34:01.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.872+0000 7f9cb6ab5740 1 -- start start 2024-08-31T05:34:01.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.872+0000 7f9cb6ab5740 1 Processor -- start 2024-08-31T05:34:01.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.873+0000 7f9cb6ab5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56183ef4b1b0 0x56183f324a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:01.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.873+0000 7f9cb6ab5740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56183ef53390 0x56183f324f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:01.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.873+0000 7f9cb6ab5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56183ef74070 0x56183f330e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:01.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.873+0000 7f9cb6ab5740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56183f0e2700 con 0x56183ef53390 2024-08-31T05:34:01.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.873+0000 7f9cb6ab5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56183f206750 con 0x56183ef4b1b0 2024-08-31T05:34:01.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.873+0000 7f9cb6ab5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56183f327af0 con 0x56183ef74070 2024-08-31T05:34:01.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.873+0000 7f9cadadb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56183ef53390 0x56183f324f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:01.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.873+0000 7f9cae2dc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56183ef4b1b0 0x56183f324a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:01.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.873+0000 7f9cadadb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56183ef53390 0x56183f324f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50880/0 (socket says 172.21.15.5:50880) 2024-08-31T05:34:01.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.873+0000 7f9cadadb640 1 -- 172.21.15.5:0/3362396965 learned_addr learned my addr 172.21.15.5:0/3362396965 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:01.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.873+0000 7f9cb6ab5740 10 client.0 _ll_register_callbacks cb 0x56183f235e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:34:01.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.873+0000 7f9caeadd640 1 --2- 172.21.15.5:0/3362396965 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56183ef74070 0x56183f330e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:01.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.873+0000 7f9cae2dc640 1 -- 172.21.15.5:0/3362396965 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56183ef74070 msgr2=0x56183f330e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:01.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.873+0000 7f9cae2dc640 1 --2- 172.21.15.5:0/3362396965 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56183ef74070 0x56183f330e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:01.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.873+0000 7f9cae2dc640 1 -- 172.21.15.5:0/3362396965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56183ef53390 msgr2=0x56183f324f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:01.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.873+0000 7f9cae2dc640 1 --2- 172.21.15.5:0/3362396965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56183ef53390 0x56183f324f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:01.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.873+0000 7f9cae2dc640 1 -- 172.21.15.5:0/3362396965 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56183f23f900 con 0x56183ef4b1b0 2024-08-31T05:34:01.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.873+0000 7f9cadadb640 1 --2- 172.21.15.5:0/3362396965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56183ef53390 0x56183f324f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:34:01.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.874+0000 7f9cae2dc640 1 --2- 172.21.15.5:0/3362396965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56183ef4b1b0 0x56183f324a20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9ca41029d0 tx=0x7f9ca402a340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa546dddf0a31814 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:01.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.874+0000 7f9c91ffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:34:01.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.874+0000 7f9c91ffb640 1 -- 172.21.15.5:0/3362396965 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca40c7830 con 0x56183ef4b1b0 2024-08-31T05:34:01.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.874+0000 7f9c91ffb640 1 -- 172.21.15.5:0/3362396965 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f9ca40d4a10 con 0x56183ef4b1b0 2024-08-31T05:34:01.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.874+0000 7f9cb6ab5740 1 -- 172.21.15.5:0/3362396965 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c980043c0 con 0x56183ef4b1b0 2024-08-31T05:34:01.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.874+0000 7f9c91ffb640 1 -- 172.21.15.5:0/3362396965 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f9ca40cb0e0 con 0x56183ef4b1b0 2024-08-31T05:34:01.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.874+0000 7f9cb6ab5740 10 client.26255 fetch_fsmap learned FSMap version 34 2024-08-31T05:34:01.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.874+0000 7f9cb6ab5740 1 -- 172.21.15.5:0/3362396965 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56183f333840 con 0x56183ef4b1b0 2024-08-31T05:34:01.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.874+0000 7f9c91ffb640 1 -- 172.21.15.5:0/3362396965 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c980043c0 con 0x56183ef4b1b0 2024-08-31T05:34:01.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.874+0000 7f9c91ffb640 1 -- 172.21.15.5:0/3362396965 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f9ca4105210 con 0x56183ef4b1b0 2024-08-31T05:34:01.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.874+0000 7f9cb6ab5740 10 client.26255 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:34:01.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.874+0000 7f9cb6ab5740 10 client.26255 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:34:01.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.874+0000 7f9cb6ab5740 20 client.26255 populate_metadata read hostname 'smithi005' 2024-08-31T05:34:01.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.874+0000 7f9cb6ab5740 1 --2- 172.21.15.5:0/3362396965 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56183ef329f0 0x56183f336d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:01.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.875+0000 7f9cb6ab5740 4 client.26255 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:34:01.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.875+0000 7f9cb6ab5740 1 -- 172.21.15.5:0/3362396965 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56183f2925d0 con 0x56183ef329f0 2024-08-31T05:34:01.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.875+0000 7f9cadadb640 1 --2- 172.21.15.5:0/3362396965 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56183ef329f0 0x56183f336d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:01.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.875+0000 7f9cadadb640 1 --2- 172.21.15.5:0/3362396965 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56183ef329f0 0x56183f336d80 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48d91c02a818b18b server_cookie=d2c28597f69ace9d in_seq=0 out_seq=0 2024-08-31T05:34:01.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.875+0000 7f9c91ffb640 10 client.26255 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:34:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.876+0000 7f9c91ffb640 1 -- 172.21.15.5:0/3362396965 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56183f2925d0 con 0x56183ef329f0 2024-08-31T05:34:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.876+0000 7f9c91ffb640 10 client.26255 handle_command_reply: tid=0 2024-08-31T05:34:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.876+0000 7f9cb6ab5740 1 client.26255 shutdown 2024-08-31T05:34:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.876+0000 7f9cb6ab5740 1 -- 172.21.15.5:0/3362396965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56183ef4b1b0 msgr2=0x56183f324a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.876+0000 7f9cb6ab5740 1 --2- 172.21.15.5:0/3362396965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56183ef4b1b0 0x56183f324a20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9ca41029d0 tx=0x7f9ca402a340 comp rx=0 tx=0).stop 2024-08-31T05:34:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.876+0000 7f9cb6ab5740 1 -- 172.21.15.5:0/3362396965 shutdown_connections 2024-08-31T05:34:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.876+0000 7f9cb6ab5740 1 --2- 172.21.15.5:0/3362396965 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56183ef329f0 0x56183f336d80 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.876+0000 7f9cb6ab5740 1 --2- 172.21.15.5:0/3362396965 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56183ef74070 0x56183f330e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.876+0000 7f9cb6ab5740 1 --2- 172.21.15.5:0/3362396965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56183ef53390 0x56183f324f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.876+0000 7f9cb6ab5740 1 --2- 172.21.15.5:0/3362396965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56183ef4b1b0 0x56183f324a20 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.876+0000 7f9cb6ab5740 1 -- 172.21.15.5:0/3362396965 >> 172.21.15.5:0/3362396965 conn(0x56183ef68460 msgr2=0x56183f31c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.876+0000 7f9c91ffb640 0 client.26255 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:34:01.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.876+0000 7f9cb6ab5740 1 -- 172.21.15.5:0/3362396965 shutdown_connections 2024-08-31T05:34:01.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.877+0000 7f9cb6ab5740 1 -- 172.21.15.5:0/3362396965 wait complete. 2024-08-31T05:34:01.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.877+0000 7f9cb6ab5740 20 client.26255 trim_cache size 0 max 16384 2024-08-31T05:34:01.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.891+0000 7f9cb6ab5740 1 Processor -- start 2024-08-31T05:34:01.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.891+0000 7f9cb6ab5740 1 -- start start 2024-08-31T05:34:01.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.891+0000 7f9cb6ab5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56183ef4b1b0 0x56183f31c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:01.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.891+0000 7f9cb6ab5740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56183ef53390 0x56183f31c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:01.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.891+0000 7f9cb6ab5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56183ef74070 0x56183f321c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:01.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.891+0000 7f9cb6ab5740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca81b71e0 con 0x56183ef53390 2024-08-31T05:34:01.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.891+0000 7f9cb6ab5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca81b8d20 con 0x56183ef74070 2024-08-31T05:34:01.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.891+0000 7f9cb6ab5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca81b78b0 con 0x56183ef4b1b0 2024-08-31T05:34:01.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.892+0000 7f9cadadb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56183ef53390 0x56183f31c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:01.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.892+0000 7f9caeadd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56183ef74070 0x56183f321c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:01.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.892+0000 7f9cadadb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56183ef53390 0x56183f31c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50886/0 (socket says 172.21.15.5:50886) 2024-08-31T05:34:01.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.892+0000 7f9cae2dc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56183ef4b1b0 0x56183f31c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:01.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.892+0000 7f9cadadb640 1 -- 172.21.15.5:0/4284322856 learned_addr learned my addr 172.21.15.5:0/4284322856 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:01.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.892+0000 7f9cae2dc640 1 -- 172.21.15.5:0/4284322856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56183ef74070 msgr2=0x56183f321c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:01.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.892+0000 7f9cae2dc640 1 --2- 172.21.15.5:0/4284322856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56183ef74070 0x56183f321c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:01.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.892+0000 7f9cae2dc640 1 -- 172.21.15.5:0/4284322856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56183ef53390 msgr2=0x56183f31c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:01.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.892+0000 7f9cae2dc640 1 --2- 172.21.15.5:0/4284322856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56183ef53390 0x56183f31c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:01.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.892+0000 7f9cae2dc640 1 -- 172.21.15.5:0/4284322856 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56183f3125a0 con 0x56183ef4b1b0 2024-08-31T05:34:01.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.892+0000 7f9cadadb640 1 --2- 172.21.15.5:0/4284322856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56183ef53390 0x56183f31c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:34:01.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.892+0000 7f9cae2dc640 1 --2- 172.21.15.5:0/4284322856 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56183ef4b1b0 0x56183f31c410 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9ca40c8be0 tx=0x7f9ca4005c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=281fe3af6abb4bb0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:01.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.892+0000 7f9c93fff640 1 -- 172.21.15.5:0/4284322856 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca40cb2c0 con 0x56183ef4b1b0 2024-08-31T05:34:01.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.892+0000 7f9c93fff640 1 -- 172.21.15.5:0/4284322856 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ca40cb480 con 0x56183ef4b1b0 2024-08-31T05:34:01.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.892+0000 7f9c93fff640 1 -- 172.21.15.5:0/4284322856 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca40cb740 con 0x56183ef4b1b0 2024-08-31T05:34:01.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.893+0000 7f9cb6ab5740 1 -- 172.21.15.5:0/4284322856 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56183ef4b1b0 msgr2=0x56183f31c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:01.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.893+0000 7f9cb6ab5740 1 --2- 172.21.15.5:0/4284322856 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56183ef4b1b0 0x56183f31c410 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9ca40c8be0 tx=0x7f9ca4005c90 comp rx=0 tx=0).stop 2024-08-31T05:34:01.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.893+0000 7f9cb6ab5740 1 -- 172.21.15.5:0/4284322856 shutdown_connections 2024-08-31T05:34:01.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.893+0000 7f9cb6ab5740 1 --2- 172.21.15.5:0/4284322856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56183ef74070 0x56183f321c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:01.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.893+0000 7f9cb6ab5740 1 --2- 172.21.15.5:0/4284322856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56183ef53390 0x56183f31c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:01.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.893+0000 7f9cb6ab5740 1 --2- 172.21.15.5:0/4284322856 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56183ef4b1b0 0x56183f31c410 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:01.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.893+0000 7f9cb6ab5740 1 -- 172.21.15.5:0/4284322856 >> 172.21.15.5:0/4284322856 conn(0x56183ef68460 msgr2=0x56183f3232a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:01.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.893+0000 7f9cb6ab5740 1 -- 172.21.15.5:0/4284322856 shutdown_connections 2024-08-31T05:34:01.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.893+0000 7f9cb6ab5740 1 -- 172.21.15.5:0/4284322856 wait complete. 2024-08-31T05:34:01.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.894+0000 7f9cb6ab5740 1 -- start start 2024-08-31T05:34:01.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.894+0000 7f9cb6ab5740 1 Processor -- start 2024-08-31T05:34:01.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.894+0000 7f9cb6ab5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56183ef4b1b0 0x56183f329000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:01.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.894+0000 7f9cb6ab5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56183ef53390 0x56183f329540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:01.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.894+0000 7f9cb6ab5740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56183ef74070 0x56183f3a0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:01.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.894+0000 7f9cb6ab5740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca81b8650 con 0x56183ef74070 2024-08-31T05:34:01.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.894+0000 7f9cb6ab5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca81b7f80 con 0x56183ef53390 2024-08-31T05:34:01.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.894+0000 7f9cb6ab5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca81b51c0 con 0x56183ef4b1b0 2024-08-31T05:34:01.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.894+0000 7f9cb6ab5740 10 client.0 _ll_register_callbacks cb 0x7f9ca40097b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:34:01.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.894+0000 7f9cae2dc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56183ef4b1b0 0x56183f329000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:01.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.895+0000 7f9cadadb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56183ef53390 0x56183f329540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:01.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.895+0000 7f9cae2dc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56183ef4b1b0 0x56183f329000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:56438/0 (socket says 172.21.15.5:56438) 2024-08-31T05:34:01.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.895+0000 7f9cae2dc640 1 -- 172.21.15.5:0/1993210752 learned_addr learned my addr 172.21.15.5:0/1993210752 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:01.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.895+0000 7f9caeadd640 1 --2- 172.21.15.5:0/1993210752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56183ef74070 0x56183f3a0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:01.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.895+0000 7f9cadadb640 1 -- 172.21.15.5:0/1993210752 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56183ef4b1b0 msgr2=0x56183f329000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:01.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.895+0000 7f9cadadb640 1 --2- 172.21.15.5:0/1993210752 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56183ef4b1b0 0x56183f329000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:01.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.895+0000 7f9cadadb640 1 -- 172.21.15.5:0/1993210752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56183ef74070 msgr2=0x56183f3a0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:01.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.895+0000 7f9cadadb640 1 --2- 172.21.15.5:0/1993210752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56183ef74070 0x56183f3a0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:01.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.895+0000 7f9cadadb640 1 -- 172.21.15.5:0/1993210752 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56183f329d50 con 0x56183ef53390 2024-08-31T05:34:01.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.895+0000 7f9cae2dc640 1 --2- 172.21.15.5:0/1993210752 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56183ef4b1b0 0x56183f329000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:34:01.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.895+0000 7f9cadadb640 1 --2- 172.21.15.5:0/1993210752 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56183ef53390 0x56183f329540 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9c9800f600 tx=0x7f9c98009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9b8ee8a5189a5d3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:01.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.895+0000 7f9c91ffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:34:01.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.895+0000 7f9c91ffb640 1 -- 172.21.15.5:0/1993210752 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c98005630 con 0x56183ef53390 2024-08-31T05:34:01.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.895+0000 7f9c91ffb640 1 -- 172.21.15.5:0/1993210752 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f9c98004020 con 0x56183ef53390 2024-08-31T05:34:01.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.895+0000 7f9cb6ab5740 1 -- 172.21.15.5:0/1993210752 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ca40cb480 con 0x56183ef53390 2024-08-31T05:34:01.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.895+0000 7f9c91ffb640 1 -- 172.21.15.5:0/1993210752 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f9c9803c050 con 0x56183ef53390 2024-08-31T05:34:01.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.895+0000 7f9cb6ab5740 10 client.26261 fetch_fsmap learned FSMap version 34 2024-08-31T05:34:01.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.896+0000 7f9cb6ab5740 1 -- 172.21.15.5:0/1993210752 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56183f3a1c80 con 0x56183ef53390 2024-08-31T05:34:01.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.896+0000 7f9c91ffb640 1 -- 172.21.15.5:0/1993210752 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ca40cb480 con 0x56183ef53390 2024-08-31T05:34:01.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.896+0000 7f9c91ffb640 1 -- 172.21.15.5:0/1993210752 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f9c98004660 con 0x56183ef53390 2024-08-31T05:34:01.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.896+0000 7f9cb6ab5740 10 client.26261 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:34:01.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.896+0000 7f9cb6ab5740 10 client.26261 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:34:01.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.896+0000 7f9cb6ab5740 20 client.26261 populate_metadata read hostname 'smithi005' 2024-08-31T05:34:01.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.896+0000 7f9cb6ab5740 1 --2- 172.21.15.5:0/1993210752 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56183ef07da0 0x56183f3a42e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:01.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.896+0000 7f9cb6ab5740 4 client.26261 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:34:01.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.896+0000 7f9cb6ab5740 1 -- 172.21.15.5:0/1993210752 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56183f28e070 con 0x56183ef07da0 2024-08-31T05:34:01.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.896+0000 7f9cae2dc640 1 --2- 172.21.15.5:0/1993210752 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56183ef07da0 0x56183f3a42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:01.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.897+0000 7f9c91ffb640 10 client.26261 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:34:01.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.897+0000 7f9cae2dc640 1 --2- 172.21.15.5:0/1993210752 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56183ef07da0 0x56183f3a42e0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81c4d6c4bccef2f4 server_cookie=5b2410fecd20cacc in_seq=0 out_seq=0 2024-08-31T05:34:01.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.897+0000 7f9c91ffb640 1 -- 172.21.15.5:0/1993210752 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56183f28e070 con 0x56183ef07da0 2024-08-31T05:34:01.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.897+0000 7f9c91ffb640 10 client.26261 handle_command_reply: tid=0 2024-08-31T05:34:01.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.897+0000 7f9cb6ab5740 1 client.26261 shutdown 2024-08-31T05:34:01.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.897+0000 7f9cb6ab5740 1 -- 172.21.15.5:0/1993210752 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56183ef53390 msgr2=0x56183f329540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:01.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.897+0000 7f9cb6ab5740 1 --2- 172.21.15.5:0/1993210752 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56183ef53390 0x56183f329540 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9c9800f600 tx=0x7f9c98009260 comp rx=0 tx=0).stop 2024-08-31T05:34:01.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.897+0000 7f9cb6ab5740 1 -- 172.21.15.5:0/1993210752 shutdown_connections 2024-08-31T05:34:01.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.897+0000 7f9cb6ab5740 1 --2- 172.21.15.5:0/1993210752 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56183ef07da0 0x56183f3a42e0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:01.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.897+0000 7f9cb6ab5740 1 --2- 172.21.15.5:0/1993210752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56183ef74070 0x56183f3a0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:01.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.897+0000 7f9cb6ab5740 1 --2- 172.21.15.5:0/1993210752 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56183ef53390 0x56183f329540 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:01.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.897+0000 7f9c91ffb640 0 client.26261 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:34:01.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.897+0000 7f9cb6ab5740 1 --2- 172.21.15.5:0/1993210752 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56183ef4b1b0 0x56183f329000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:01.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.897+0000 7f9cb6ab5740 1 -- 172.21.15.5:0/1993210752 >> 172.21.15.5:0/1993210752 conn(0x56183ef68460 msgr2=0x56183f31c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:01.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.897+0000 7f9cb6ab5740 1 -- 172.21.15.5:0/1993210752 shutdown_connections 2024-08-31T05:34:01.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.897+0000 7f9cb6ab5740 1 -- 172.21.15.5:0/1993210752 wait complete. 2024-08-31T05:34:01.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.897+0000 7f9cb6ab5740 20 client.26261 trim_cache size 0 max 16384 2024-08-31T05:34:01.907 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:34:01.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.898+0000 7f9cb0540640 1 -- 172.21.15.5:0/2297398614 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9c940b4d20 msgr2=0x7f9c940b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:01.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.898+0000 7f9cb0540640 1 --2- 172.21.15.5:0/2297398614 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9c940b4d20 0x7f9c940b7230 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0011880 tx=0x7f9ca0004a40 comp rx=0 tx=0).stop 2024-08-31T05:34:01.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.898+0000 7f9cb0540640 1 -- 172.21.15.5:0/2297398614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ca8102830 msgr2=0x7f9ca81a0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:01.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.898+0000 7f9cb0540640 1 --2- 172.21.15.5:0/2297398614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ca8102830 0x7f9ca81a0880 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4035040 tx=0x7f9ca4032d50 comp rx=0 tx=0).stop 2024-08-31T05:34:01.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.898+0000 7f9cb0540640 1 -- 172.21.15.5:0/2297398614 shutdown_connections 2024-08-31T05:34:01.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.898+0000 7f9cb0540640 1 --2- 172.21.15.5:0/2297398614 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9c940b4d20 0x7f9c940b7230 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:01.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.898+0000 7f9cb0540640 1 --2- 172.21.15.5:0/2297398614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ca8108ac0 0x7f9ca81a60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:01.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.898+0000 7f9cb0540640 1 --2- 172.21.15.5:0/2297398614 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ca8108170 0x7f9ca81a0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:01.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.898+0000 7f9cb0540640 1 --2- 172.21.15.5:0/2297398614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ca8102830 0x7f9ca81a0880 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:01.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.898+0000 7f9cb0540640 1 -- 172.21.15.5:0/2297398614 >> 172.21.15.5:0/2297398614 conn(0x7f9ca80794d0 msgr2=0x7f9ca806bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:01.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.898+0000 7f9cb0540640 1 -- 172.21.15.5:0/2297398614 shutdown_connections 2024-08-31T05:34:01.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:01.898+0000 7f9cb0540640 1 -- 172.21.15.5:0/2297398614 wait complete. 2024-08-31T05:34:01.914 INFO:tasks.workunit.client.0.smithi005.stdout: 1 422363 13.15 MB/sec execute 49 sec latency 42.135 ms 2024-08-31T05:34:02.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:34:02 smithi050 ceph-mon[22146]: pgmap v467: 129 pgs: 129 active+clean; 215 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 241 op/s 2024-08-31T05:34:02.700 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:34:02 smithi005 ceph-mon[18602]: pgmap v467: 129 pgs: 129 active+clean; 215 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 241 op/s 2024-08-31T05:34:02.836 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:34:02 smithi070 ceph-mon[22316]: pgmap v467: 129 pgs: 129 active+clean; 215 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 241 op/s 2024-08-31T05:34:02.914 INFO:tasks.workunit.client.0.smithi005.stdout: 1 424479 13.03 MB/sec execute 50 sec latency 50.915 ms 2024-08-31T05:34:03.728 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T05:34:03.728 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T05:34:03.914 INFO:tasks.workunit.client.0.smithi005.stdout: 1 426372 13.02 MB/sec execute 51 sec latency 23.333 ms 2024-08-31T05:34:04.010 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:34:04.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.526+0000 7f55410b5640 1 -- 172.21.15.5:0/1975307226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f553c103930 msgr2=0x7f553c103d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:04.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.526+0000 7f55410b5640 1 --2- 172.21.15.5:0/1975307226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f553c103930 0x7f553c103d40 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f552c009900 tx=0x7f552c02a410 comp rx=0 tx=0).stop 2024-08-31T05:34:04.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.526+0000 7f55410b5640 1 -- 172.21.15.5:0/1975307226 shutdown_connections 2024-08-31T05:34:04.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.526+0000 7f55410b5640 1 --2- 172.21.15.5:0/1975307226 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f553c109bc0 0x7f553c1103f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.526+0000 7f55410b5640 1 --2- 172.21.15.5:0/1975307226 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f553c109270 0x7f553c109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.526+0000 7f55410b5640 1 --2- 172.21.15.5:0/1975307226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f553c103930 0x7f553c103d40 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.526+0000 7f55410b5640 1 -- 172.21.15.5:0/1975307226 >> 172.21.15.5:0/1975307226 conn(0x7f553c0ff380 msgr2=0x7f553c1017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:04.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.527+0000 7f55410b5640 1 -- 172.21.15.5:0/1975307226 shutdown_connections 2024-08-31T05:34:04.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.527+0000 7f55410b5640 1 -- 172.21.15.5:0/1975307226 wait complete. 2024-08-31T05:34:04.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.528+0000 7f55410b5640 1 Processor -- start 2024-08-31T05:34:04.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.529+0000 7f55410b5640 1 -- start start 2024-08-31T05:34:04.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.529+0000 7f55410b5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f553c103930 0x7f553c0754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:04.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.529+0000 7f55410b5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f553c109270 0x7f553c0759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:04.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.529+0000 7f55410b5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f553c109bc0 0x7f553c075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:04.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.529+0000 7f55410b5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f553c113880 con 0x7f553c109bc0 2024-08-31T05:34:04.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.529+0000 7f55410b5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f553c113700 con 0x7f553c109270 2024-08-31T05:34:04.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.529+0000 7f55410b5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f553c113a00 con 0x7f553c103930 2024-08-31T05:34:04.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.529+0000 7f553ad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f553c103930 0x7f553c0754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:04.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.529+0000 7f553ad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f553c103930 0x7f553c0754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:39052/0 (socket says 172.21.15.5:39052) 2024-08-31T05:34:04.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.529+0000 7f553ad9d640 1 -- 172.21.15.5:0/3439898327 learned_addr learned my addr 172.21.15.5:0/3439898327 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:04.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.529+0000 7f553b59e640 1 --2- 172.21.15.5:0/3439898327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f553c109bc0 0x7f553c075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:04.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.529+0000 7f553a59c640 1 --2- 172.21.15.5:0/3439898327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f553c109270 0x7f553c0759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:04.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.530+0000 7f553ad9d640 1 -- 172.21.15.5:0/3439898327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f553c109270 msgr2=0x7f553c0759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:04.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.530+0000 7f553ad9d640 1 --2- 172.21.15.5:0/3439898327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f553c109270 0x7f553c0759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.530+0000 7f553ad9d640 1 -- 172.21.15.5:0/3439898327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f553c109bc0 msgr2=0x7f553c075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:04.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.530+0000 7f553ad9d640 1 --2- 172.21.15.5:0/3439898327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f553c109bc0 0x7f553c075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.530+0000 7f553ad9d640 1 -- 172.21.15.5:0/3439898327 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f553c1a8510 con 0x7f553c103930 2024-08-31T05:34:04.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.530+0000 7f553ad9d640 1 --2- 172.21.15.5:0/3439898327 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f553c103930 0x7f553c0754b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f552c005940 tx=0x7f552c0040c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:04.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.530+0000 7f5523fff640 1 -- 172.21.15.5:0/3439898327 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f552c03f030 con 0x7f553c103930 2024-08-31T05:34:04.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.530+0000 7f5523fff640 1 -- 172.21.15.5:0/3439898327 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f552c0044c0 con 0x7f553c103930 2024-08-31T05:34:04.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.530+0000 7f5523fff640 1 -- 172.21.15.5:0/3439898327 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f552c035070 con 0x7f553c103930 2024-08-31T05:34:04.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.530+0000 7f55410b5640 1 -- 172.21.15.5:0/3439898327 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f553c1a87a0 con 0x7f553c103930 2024-08-31T05:34:04.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.531+0000 7f55410b5640 1 -- 172.21.15.5:0/3439898327 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f553c1a8c30 con 0x7f553c103930 2024-08-31T05:34:04.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.534+0000 7f554762a740 1 Processor -- start 2024-08-31T05:34:04.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.534+0000 7f5523fff640 1 -- 172.21.15.5:0/3439898327 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f552c042030 con 0x7f553c103930 2024-08-31T05:34:04.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.534+0000 7f554762a740 1 -- start start 2024-08-31T05:34:04.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.534+0000 7f554762a740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56540f89e350 0x56540fc44780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:04.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.534+0000 7f554762a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56540f875490 0x56540fc44cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:04.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.534+0000 7f554762a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56540f87d670 0x56540fc45200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:04.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.534+0000 7f554762a740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56540fbba5f0 con 0x56540f89e350 2024-08-31T05:34:04.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.534+0000 7f554762a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56540fba9b80 con 0x56540f87d670 2024-08-31T05:34:04.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.534+0000 7f554762a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56540fbadb30 con 0x56540f875490 2024-08-31T05:34:04.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.535+0000 7f553b59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56540f89e350 0x56540fc44780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:04.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.535+0000 7f553ad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56540f875490 0x56540fc44cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:04.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.535+0000 7f553b59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56540f89e350 0x56540fc44780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40968/0 (socket says 172.21.15.5:40968) 2024-08-31T05:34:04.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.535+0000 7f553b59e640 1 -- 172.21.15.5:0/1541745973 learned_addr learned my addr 172.21.15.5:0/1541745973 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:04.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.535+0000 7f553a59c640 1 --2- 172.21.15.5:0/1541745973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56540f87d670 0x56540fc45200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:04.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.535+0000 7f553b59e640 1 -- 172.21.15.5:0/1541745973 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56540f875490 msgr2=0x56540fc44cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:04.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.535+0000 7f553b59e640 1 --2- 172.21.15.5:0/1541745973 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56540f875490 0x56540fc44cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.535+0000 7f553b59e640 1 -- 172.21.15.5:0/1541745973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56540f87d670 msgr2=0x56540fc45200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:04.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.535+0000 7f553b59e640 1 --2- 172.21.15.5:0/1541745973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56540f87d670 0x56540fc45200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.535+0000 7f553b59e640 1 -- 172.21.15.5:0/1541745973 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56540f909930 con 0x56540f89e350 2024-08-31T05:34:04.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.535+0000 7f5523fff640 1 --2- 172.21.15.5:0/3439898327 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f55240b4d20 0x7f55240b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:04.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.535+0000 7f553b59e640 1 --2- 172.21.15.5:0/1541745973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56540f89e350 0x56540fc44780 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f5534009fd0 tx=0x7f55340118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b55a7ff1bba59fd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:04.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.535+0000 7f553ad9d640 1 --2- 172.21.15.5:0/3439898327 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f55240b4d20 0x7f55240b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:04.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.536+0000 7f5523fff640 1 -- 172.21.15.5:0/3439898327 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f552c105a80 con 0x7f553c103930 2024-08-31T05:34:04.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.536+0000 7f55217fa640 1 -- 172.21.15.5:0/1541745973 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5534004d20 con 0x56540f89e350 2024-08-31T05:34:04.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.536+0000 7f55217fa640 1 -- 172.21.15.5:0/1541745973 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5534004050 con 0x56540f89e350 2024-08-31T05:34:04.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.536+0000 7f55217fa640 1 -- 172.21.15.5:0/1541745973 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5534005280 con 0x56540f89e350 2024-08-31T05:34:04.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.537+0000 7f554762a740 1 -- 172.21.15.5:0/1541745973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56540f89e350 msgr2=0x56540fc44780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:04.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.537+0000 7f554762a740 1 --2- 172.21.15.5:0/1541745973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56540f89e350 0x56540fc44780 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f5534009fd0 tx=0x7f55340118d0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.537+0000 7f553ad9d640 1 --2- 172.21.15.5:0/3439898327 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f55240b4d20 0x7f55240b7230 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f552c102f00 tx=0x7f552c1095d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:04.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.537+0000 7f554762a740 1 -- 172.21.15.5:0/1541745973 shutdown_connections 2024-08-31T05:34:04.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.537+0000 7f554762a740 1 --2- 172.21.15.5:0/1541745973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56540f87d670 0x56540fc45200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.537+0000 7f554762a740 1 --2- 172.21.15.5:0/1541745973 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56540f875490 0x56540fc44cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.537+0000 7f554762a740 1 --2- 172.21.15.5:0/1541745973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56540f89e350 0x56540fc44780 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.537+0000 7f554762a740 1 -- 172.21.15.5:0/1541745973 >> 172.21.15.5:0/1541745973 conn(0x56540f892740 msgr2=0x56540fc42670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:04.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.537+0000 7f554762a740 1 -- 172.21.15.5:0/1541745973 shutdown_connections 2024-08-31T05:34:04.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.537+0000 7f554762a740 1 -- 172.21.15.5:0/1541745973 wait complete. 2024-08-31T05:34:04.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.538+0000 7f554762a740 1 -- start start 2024-08-31T05:34:04.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.538+0000 7f554762a740 1 Processor -- start 2024-08-31T05:34:04.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.538+0000 7f554762a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56540f875490 0x56540fc4ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:04.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.538+0000 7f554762a740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56540f87d670 0x56540fc50480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:04.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.538+0000 7f554762a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56540f89e350 0x56540fc5c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:04.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.538+0000 7f554762a740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56540fa0c890 con 0x56540f87d670 2024-08-31T05:34:04.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.538+0000 7f554762a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56540fb30790 con 0x56540f875490 2024-08-31T05:34:04.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.538+0000 7f554762a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56540fc52f60 con 0x56540f89e350 2024-08-31T05:34:04.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.538+0000 7f554762a740 10 client.0 _ll_register_callbacks cb 0x56540f8b5ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:34:04.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.539+0000 7f553a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56540f87d670 0x56540fc50480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:04.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.539+0000 7f553a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56540f87d670 0x56540fc50480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40970/0 (socket says 172.21.15.5:40970) 2024-08-31T05:34:04.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.539+0000 7f553a59c640 1 -- 172.21.15.5:0/1071324761 learned_addr learned my addr 172.21.15.5:0/1071324761 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:04.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.539+0000 7f553b59e640 1 --2- 172.21.15.5:0/1071324761 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56540f89e350 0x56540fc5c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:04.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.539+0000 7f553b59e640 1 --2- 172.21.15.5:0/1071324761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56540f875490 0x56540fc4ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:04.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.539+0000 7f553a59c640 1 -- 172.21.15.5:0/1071324761 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56540f89e350 msgr2=0x56540fc5c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:04.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.539+0000 7f553a59c640 1 --2- 172.21.15.5:0/1071324761 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56540f89e350 0x56540fc5c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.539+0000 7f553a59c640 1 -- 172.21.15.5:0/1071324761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56540f875490 msgr2=0x56540fc4ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:04.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.539+0000 7f553a59c640 1 --2- 172.21.15.5:0/1071324761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56540f875490 0x56540fc4ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.539+0000 7f553a59c640 1 -- 172.21.15.5:0/1071324761 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56540fb67f30 con 0x56540f87d670 2024-08-31T05:34:04.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.539+0000 7f553b59e640 1 --2- 172.21.15.5:0/1071324761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56540f875490 0x56540fc4ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:34:04.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.540+0000 7f553a59c640 1 --2- 172.21.15.5:0/1071324761 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56540f87d670 0x56540fc50480 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f5530012700 tx=0x7f5530012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aecc8f9f34b6a21 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:04.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.540+0000 7f551eff5640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:34:04.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.540+0000 7f551eff5640 1 -- 172.21.15.5:0/1071324761 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553000f920 con 0x56540f87d670 2024-08-31T05:34:04.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.540+0000 7f551eff5640 1 -- 172.21.15.5:0/1071324761 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f553000fac0 con 0x56540f87d670 2024-08-31T05:34:04.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.540+0000 7f554762a740 1 -- 172.21.15.5:0/1071324761 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5534004050 con 0x56540f87d670 2024-08-31T05:34:04.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.540+0000 7f551eff5640 1 -- 172.21.15.5:0/1071324761 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f553000fcc0 con 0x56540f87d670 2024-08-31T05:34:04.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.540+0000 7f554762a740 10 client.16680 fetch_fsmap learned FSMap version 34 2024-08-31T05:34:04.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.540+0000 7f554762a740 1 -- 172.21.15.5:0/1071324761 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56540fc5ee00 con 0x56540f87d670 2024-08-31T05:34:04.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.540+0000 7f551eff5640 1 -- 172.21.15.5:0/1071324761 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5534004050 con 0x56540f87d670 2024-08-31T05:34:04.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.541+0000 7f551eff5640 1 -- 172.21.15.5:0/1071324761 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f55300052c0 con 0x56540f87d670 2024-08-31T05:34:04.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.541+0000 7f554762a740 10 client.16680 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:34:04.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.541+0000 7f554762a740 10 client.16680 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:34:04.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.541+0000 7f554762a740 20 client.16680 populate_metadata read hostname 'smithi005' 2024-08-31T05:34:04.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.541+0000 7f554762a740 1 --2- 172.21.15.5:0/1071324761 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56540f85ccd0 0x56540fc62480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:04.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.541+0000 7f554762a740 4 client.16680 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:34:04.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.541+0000 7f554762a740 1 -- 172.21.15.5:0/1071324761 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56540fbbc540 con 0x56540f85ccd0 2024-08-31T05:34:04.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.541+0000 7f553b59e640 1 --2- 172.21.15.5:0/1071324761 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56540f85ccd0 0x56540fc62480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:04.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.542+0000 7f551eff5640 10 client.16680 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:34:04.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.542+0000 7f553b59e640 1 --2- 172.21.15.5:0/1071324761 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56540f85ccd0 0x56540fc62480 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2693e386d46b09f server_cookie=993eb3cf622821c in_seq=0 out_seq=0 2024-08-31T05:34:04.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.542+0000 7f551eff5640 1 -- 172.21.15.5:0/1071324761 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56540fbbc540 con 0x56540f85ccd0 2024-08-31T05:34:04.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.542+0000 7f551eff5640 10 client.16680 handle_command_reply: tid=0 2024-08-31T05:34:04.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.543+0000 7f554762a740 1 client.16680 shutdown 2024-08-31T05:34:04.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.543+0000 7f554762a740 1 -- 172.21.15.5:0/1071324761 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56540f87d670 msgr2=0x56540fc50480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:04.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.543+0000 7f554762a740 1 --2- 172.21.15.5:0/1071324761 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56540f87d670 0x56540fc50480 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f5530012700 tx=0x7f5530012bc0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.543+0000 7f554762a740 1 -- 172.21.15.5:0/1071324761 shutdown_connections 2024-08-31T05:34:04.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.543+0000 7f554762a740 1 --2- 172.21.15.5:0/1071324761 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56540f85ccd0 0x56540fc62480 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.543+0000 7f554762a740 1 --2- 172.21.15.5:0/1071324761 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56540f89e350 0x56540fc5c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.543+0000 7f551eff5640 0 client.16680 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:34:04.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.543+0000 7f554762a740 1 --2- 172.21.15.5:0/1071324761 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56540f87d670 0x56540fc50480 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.543+0000 7f554762a740 1 --2- 172.21.15.5:0/1071324761 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56540f875490 0x56540fc4ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.543+0000 7f554762a740 1 -- 172.21.15.5:0/1071324761 >> 172.21.15.5:0/1071324761 conn(0x56540f892740 msgr2=0x56540fc47910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:04.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.543+0000 7f554762a740 1 -- 172.21.15.5:0/1071324761 shutdown_connections 2024-08-31T05:34:04.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.543+0000 7f554762a740 1 -- 172.21.15.5:0/1071324761 wait complete. 2024-08-31T05:34:04.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.543+0000 7f554762a740 20 client.16680 trim_cache size 0 max 16384 2024-08-31T05:34:04.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.578+0000 7f554762a740 1 Processor -- start 2024-08-31T05:34:04.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.578+0000 7f554762a740 1 -- start start 2024-08-31T05:34:04.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.578+0000 7f554762a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56540f85ccd0 0x56540fc4b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:04.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.578+0000 7f554762a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56540f875490 0x56540fc426a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:04.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.578+0000 7f554762a740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56540f87d670 0x56540fc5c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:04.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.578+0000 7f554762a740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f552800ff40 con 0x56540f87d670 2024-08-31T05:34:04.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.578+0000 7f554762a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5528011a80 con 0x56540f875490 2024-08-31T05:34:04.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.578+0000 7f554762a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5528010610 con 0x56540f85ccd0 2024-08-31T05:34:04.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.578+0000 7f553a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56540f875490 0x56540fc426a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:04.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.578+0000 7f553b59e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56540f85ccd0 0x56540fc4b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:04.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.578+0000 7f553a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56540f875490 0x56540fc426a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:50802/0 (socket says 172.21.15.5:50802) 2024-08-31T05:34:04.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.578+0000 7f553b59e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56540f85ccd0 0x56540fc4b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:39070/0 (socket says 172.21.15.5:39070) 2024-08-31T05:34:04.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.578+0000 7f553a59c640 1 -- 172.21.15.5:0/2064913076 learned_addr learned my addr 172.21.15.5:0/2064913076 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:04.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.578+0000 7f553b59e640 1 --2- 172.21.15.5:0/2064913076 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56540f87d670 0x56540fc5c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:04.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.579+0000 7f553a59c640 1 -- 172.21.15.5:0/2064913076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56540f85ccd0 msgr2=0x56540fc4b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:04.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.579+0000 7f553a59c640 1 --2- 172.21.15.5:0/2064913076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56540f85ccd0 0x56540fc4b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.579+0000 7f553a59c640 1 -- 172.21.15.5:0/2064913076 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56540f87d670 msgr2=0x56540fc5c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:04.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.579+0000 7f553a59c640 1 --2- 172.21.15.5:0/2064913076 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56540f87d670 0x56540fc5c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.579+0000 7f553a59c640 1 -- 172.21.15.5:0/2064913076 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56540fc4eea0 con 0x56540f875490 2024-08-31T05:34:04.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.579+0000 7f553a59c640 1 --2- 172.21.15.5:0/2064913076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56540f875490 0x56540fc426a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f55300059f0 tx=0x7f5530009640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f44759b91fb421 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:04.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.579+0000 7f5520ff9640 1 -- 172.21.15.5:0/2064913076 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553000f920 con 0x56540f875490 2024-08-31T05:34:04.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.579+0000 7f5520ff9640 1 -- 172.21.15.5:0/2064913076 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5530010e50 con 0x56540f875490 2024-08-31T05:34:04.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.579+0000 7f5520ff9640 1 -- 172.21.15.5:0/2064913076 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5530004640 con 0x56540f875490 2024-08-31T05:34:04.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.580+0000 7f554762a740 1 -- 172.21.15.5:0/2064913076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56540f875490 msgr2=0x56540fc426a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:04.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.580+0000 7f554762a740 1 --2- 172.21.15.5:0/2064913076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56540f875490 0x56540fc426a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f55300059f0 tx=0x7f5530009640 comp rx=0 tx=0).stop 2024-08-31T05:34:04.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.580+0000 7f554762a740 1 -- 172.21.15.5:0/2064913076 shutdown_connections 2024-08-31T05:34:04.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.580+0000 7f554762a740 1 --2- 172.21.15.5:0/2064913076 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56540f87d670 0x56540fc5c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.580+0000 7f554762a740 1 --2- 172.21.15.5:0/2064913076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56540f875490 0x56540fc426a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.580+0000 7f554762a740 1 --2- 172.21.15.5:0/2064913076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56540f85ccd0 0x56540fc4b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.580+0000 7f554762a740 1 -- 172.21.15.5:0/2064913076 >> 172.21.15.5:0/2064913076 conn(0x56540f892740 msgr2=0x56540fc41f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:04.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.580+0000 7f554762a740 1 -- 172.21.15.5:0/2064913076 shutdown_connections 2024-08-31T05:34:04.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.580+0000 7f554762a740 1 -- 172.21.15.5:0/2064913076 wait complete. 2024-08-31T05:34:04.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.581+0000 7f554762a740 1 -- start start 2024-08-31T05:34:04.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.581+0000 7f554762a740 1 Processor -- start 2024-08-31T05:34:04.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.582+0000 7f554762a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56540f85ccd0 0x56540fc548e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:04.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.582+0000 7f554762a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56540f875490 0x56540fc54e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:04.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.582+0000 7f554762a740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56540f87d670 0x56540fccbe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:04.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.582+0000 7f554762a740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f55280113b0 con 0x56540f87d670 2024-08-31T05:34:04.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.582+0000 7f554762a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5528010ce0 con 0x56540f85ccd0 2024-08-31T05:34:04.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.582+0000 7f554762a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f552800df20 con 0x56540f875490 2024-08-31T05:34:04.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.582+0000 7f554762a740 10 client.0 _ll_register_callbacks cb 0x7f5530009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:34:04.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.582+0000 7f553b59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56540f87d670 0x56540fccbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:04.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.582+0000 7f553a59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56540f875490 0x56540fc54e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:04.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.582+0000 7f553b59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56540f87d670 0x56540fccbe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40994/0 (socket says 172.21.15.5:40994) 2024-08-31T05:34:04.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.582+0000 7f553b59e640 1 -- 172.21.15.5:0/1635603653 learned_addr learned my addr 172.21.15.5:0/1635603653 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:04.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.582+0000 7f553b59e640 1 --2- 172.21.15.5:0/1635603653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56540f85ccd0 0x56540fc548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:04.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.582+0000 7f553b59e640 1 -- 172.21.15.5:0/1635603653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56540f875490 msgr2=0x56540fc54e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:04.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.582+0000 7f553b59e640 1 --2- 172.21.15.5:0/1635603653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56540f875490 0x56540fc54e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.582+0000 7f553b59e640 1 -- 172.21.15.5:0/1635603653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56540f85ccd0 msgr2=0x56540fc548e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:04.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.582+0000 7f553b59e640 1 --2- 172.21.15.5:0/1635603653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56540f85ccd0 0x56540fc548e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.582+0000 7f553b59e640 1 -- 172.21.15.5:0/1635603653 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56540fc50e90 con 0x56540f87d670 2024-08-31T05:34:04.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.582+0000 7f553a59c640 1 --2- 172.21.15.5:0/1635603653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56540f875490 0x56540fc54e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:34:04.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.582+0000 7f553b59e640 1 --2- 172.21.15.5:0/1635603653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56540f87d670 0x56540fccbe40 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f5534003f40 tx=0x7f55340118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb16fe62d8d5821 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:04.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.582+0000 7f551eff5640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:34:04.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.583+0000 7f551eff5640 1 -- 172.21.15.5:0/1635603653 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5534004340 con 0x56540f87d670 2024-08-31T05:34:04.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.583+0000 7f551eff5640 1 -- 172.21.15.5:0/1635603653 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f55340044e0 con 0x56540f87d670 2024-08-31T05:34:04.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.583+0000 7f554762a740 1 -- 172.21.15.5:0/1635603653 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5530010e50 con 0x56540f87d670 2024-08-31T05:34:04.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.583+0000 7f551eff5640 1 -- 172.21.15.5:0/1635603653 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f553400f4e0 con 0x56540f87d670 2024-08-31T05:34:04.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.583+0000 7f554762a740 10 client.16686 fetch_fsmap learned FSMap version 34 2024-08-31T05:34:04.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.583+0000 7f554762a740 1 -- 172.21.15.5:0/1635603653 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56540fccd3d0 con 0x56540f87d670 2024-08-31T05:34:04.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.584+0000 7f551eff5640 1 -- 172.21.15.5:0/1635603653 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5530010e50 con 0x56540f87d670 2024-08-31T05:34:04.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.584+0000 7f551eff5640 1 -- 172.21.15.5:0/1635603653 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f55340284b0 con 0x56540f87d670 2024-08-31T05:34:04.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.584+0000 7f554762a740 10 client.16686 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:34:04.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.584+0000 7f554762a740 10 client.16686 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:34:04.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.584+0000 7f554762a740 20 client.16686 populate_metadata read hostname 'smithi005' 2024-08-31T05:34:04.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.584+0000 7f554762a740 1 --2- 172.21.15.5:0/1635603653 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56540f89e350 0x56540fccf940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:04.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.584+0000 7f554762a740 4 client.16686 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T05:34:04.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.584+0000 7f554762a740 1 -- 172.21.15.5:0/1635603653 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56540fbb7fe0 con 0x56540f89e350 2024-08-31T05:34:04.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.584+0000 7f553a59c640 1 --2- 172.21.15.5:0/1635603653 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56540f89e350 0x56540fccf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:04.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.585+0000 7f551eff5640 10 client.16686 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:34:04.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.585+0000 7f553a59c640 1 --2- 172.21.15.5:0/1635603653 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56540f89e350 0x56540fccf940 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=126dbcba7b4c51f7 server_cookie=a2e7f88bcb79a3 in_seq=0 out_seq=0 2024-08-31T05:34:04.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.587+0000 7f551eff5640 1 -- 172.21.15.5:0/1635603653 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56540fbb7fe0 con 0x56540f89e350 2024-08-31T05:34:04.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.587+0000 7f551eff5640 10 client.16686 handle_command_reply: tid=0 2024-08-31T05:34:04.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.587+0000 7f554762a740 1 client.16686 shutdown 2024-08-31T05:34:04.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.587+0000 7f554762a740 1 -- 172.21.15.5:0/1635603653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56540f87d670 msgr2=0x56540fccbe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:04.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.587+0000 7f554762a740 1 --2- 172.21.15.5:0/1635603653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56540f87d670 0x56540fccbe40 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f5534003f40 tx=0x7f55340118d0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.587+0000 7f554762a740 1 -- 172.21.15.5:0/1635603653 shutdown_connections 2024-08-31T05:34:04.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.587+0000 7f554762a740 1 --2- 172.21.15.5:0/1635603653 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56540f89e350 0x56540fccf940 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.587+0000 7f551eff5640 0 client.16686 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:34:04.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.587+0000 7f554762a740 1 --2- 172.21.15.5:0/1635603653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56540f87d670 0x56540fccbe40 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.587+0000 7f554762a740 1 --2- 172.21.15.5:0/1635603653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56540f875490 0x56540fc54e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.587+0000 7f554762a740 1 --2- 172.21.15.5:0/1635603653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56540f85ccd0 0x56540fc548e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.587+0000 7f554762a740 1 -- 172.21.15.5:0/1635603653 >> 172.21.15.5:0/1635603653 conn(0x56540f892740 msgr2=0x56540fc47880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:04.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.588+0000 7f554762a740 1 -- 172.21.15.5:0/1635603653 shutdown_connections 2024-08-31T05:34:04.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.588+0000 7f554762a740 1 -- 172.21.15.5:0/1635603653 wait complete. 2024-08-31T05:34:04.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.588+0000 7f554762a740 20 client.16686 trim_cache size 0 max 16384 2024-08-31T05:34:04.594 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:34:04.594 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-08-31T05:34:04.594 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "0bb67292-013a-40c7-b5fc-810bdd9715d8", 2024-08-31T05:34:04.594 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-08-31T05:34:04.594 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:34:04.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.588+0000 7f55410b5640 1 -- 172.21.15.5:0/3439898327 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f55240b4d20 msgr2=0x7f55240b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:04.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.588+0000 7f55410b5640 1 --2- 172.21.15.5:0/3439898327 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f55240b4d20 0x7f55240b7230 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f552c102f00 tx=0x7f552c1095d0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.588+0000 7f55410b5640 1 -- 172.21.15.5:0/3439898327 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f553c103930 msgr2=0x7f553c0754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:04.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.588+0000 7f55410b5640 1 --2- 172.21.15.5:0/3439898327 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f553c103930 0x7f553c0754b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f552c005940 tx=0x7f552c0040c0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.589+0000 7f55410b5640 1 -- 172.21.15.5:0/3439898327 shutdown_connections 2024-08-31T05:34:04.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.589+0000 7f55410b5640 1 --2- 172.21.15.5:0/3439898327 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f55240b4d20 0x7f55240b7230 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.589+0000 7f55410b5640 1 --2- 172.21.15.5:0/3439898327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f553c109bc0 0x7f553c075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.589+0000 7f55410b5640 1 --2- 172.21.15.5:0/3439898327 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f553c109270 0x7f553c0759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.589+0000 7f55410b5640 1 --2- 172.21.15.5:0/3439898327 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f553c103930 0x7f553c0754b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.589+0000 7f55410b5640 1 -- 172.21.15.5:0/3439898327 >> 172.21.15.5:0/3439898327 conn(0x7f553c0ff380 msgr2=0x7f553c1017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:04.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.589+0000 7f55410b5640 1 -- 172.21.15.5:0/3439898327 shutdown_connections 2024-08-31T05:34:04.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:04.589+0000 7f55410b5640 1 -- 172.21.15.5:0/3439898327 wait complete. 2024-08-31T05:34:04.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:34:04 smithi005 ceph-mon[18602]: pgmap v468: 129 pgs: 129 active+clean; 216 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.4 MiB/s wr, 265 op/s 2024-08-31T05:34:04.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.838+0000 7f72975e6640 1 -- 172.21.15.5:0/2065206149 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7290102760 msgr2=0x7f7290102b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:04.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.838+0000 7f72975e6640 1 --2- 172.21.15.5:0/2065206149 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7290102760 0x7f7290102b70 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f728c009900 tx=0x7f728c02a410 comp rx=0 tx=0).stop 2024-08-31T05:34:04.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.838+0000 7f72975e6640 1 -- 172.21.15.5:0/2065206149 shutdown_connections 2024-08-31T05:34:04.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.838+0000 7f72975e6640 1 --2- 172.21.15.5:0/2065206149 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72901089e0 0x7f729010f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.838+0000 7f72975e6640 1 --2- 172.21.15.5:0/2065206149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7290108090 0x7f72901084a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.838+0000 7f72975e6640 1 --2- 172.21.15.5:0/2065206149 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7290102760 0x7f7290102b70 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.838+0000 7f72975e6640 1 -- 172.21.15.5:0/2065206149 >> 172.21.15.5:0/2065206149 conn(0x7f72900fe160 msgr2=0x7f72901005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:04.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.839+0000 7f72975e6640 1 -- 172.21.15.5:0/2065206149 shutdown_connections 2024-08-31T05:34:04.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.839+0000 7f72975e6640 1 -- 172.21.15.5:0/2065206149 wait complete. 2024-08-31T05:34:04.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.839+0000 7f72975e6640 1 Processor -- start 2024-08-31T05:34:04.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.840+0000 7f72975e6640 1 -- start start 2024-08-31T05:34:04.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.840+0000 7f72975e6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7290102760 0x7f729019a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:04.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.840+0000 7f72975e6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7290108090 0x7f729019a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:04.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.840+0000 7f72975e6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72901089e0 0x7f729019fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:04.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.840+0000 7f72975e6640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7290112700 con 0x7f7290102760 2024-08-31T05:34:04.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.840+0000 7f72975e6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7290112580 con 0x7f7290108090 2024-08-31T05:34:04.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.840+0000 7f72975e6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7290112880 con 0x7f72901089e0 2024-08-31T05:34:04.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.840+0000 7f7295382640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7290102760 0x7f729019a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:04.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.840+0000 7f7295382640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7290102760 0x7f729019a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41000/0 (socket says 172.21.15.5:41000) 2024-08-31T05:34:04.846 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.840+0000 7f7295382640 1 -- 172.21.15.5:0/2845569471 learned_addr learned my addr 172.21.15.5:0/2845569471 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:04.846 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.840+0000 7f7295b83640 1 --2- 172.21.15.5:0/2845569471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72901089e0 0x7f729019fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:04.846 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.840+0000 7f7294b81640 1 --2- 172.21.15.5:0/2845569471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7290108090 0x7f729019a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:04.846 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.841+0000 7f7295382640 1 -- 172.21.15.5:0/2845569471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72901089e0 msgr2=0x7f729019fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:04.846 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.841+0000 7f7295382640 1 --2- 172.21.15.5:0/2845569471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72901089e0 0x7f729019fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.846 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.841+0000 7f7295382640 1 -- 172.21.15.5:0/2845569471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7290108090 msgr2=0x7f729019a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:04.846 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.841+0000 7f7295382640 1 --2- 172.21.15.5:0/2845569471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7290108090 0x7f729019a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.846 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.841+0000 7f7295382640 1 -- 172.21.15.5:0/2845569471 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72901a0140 con 0x7f7290102760 2024-08-31T05:34:04.846 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.841+0000 7f7295b83640 1 --2- 172.21.15.5:0/2845569471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72901089e0 0x7f729019fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:34:04.846 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.841+0000 7f7295382640 1 --2- 172.21.15.5:0/2845569471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7290102760 0x7f729019a210 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f728c005ab0 tx=0x7f728c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:04.846 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.841+0000 7f72867fc640 1 -- 172.21.15.5:0/2845569471 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f728c03f070 con 0x7f7290102760 2024-08-31T05:34:04.846 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.841+0000 7f72867fc640 1 -- 172.21.15.5:0/2845569471 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f728c031b60 con 0x7f7290102760 2024-08-31T05:34:04.847 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.841+0000 7f72867fc640 1 -- 172.21.15.5:0/2845569471 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f728c035030 con 0x7f7290102760 2024-08-31T05:34:04.847 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.841+0000 7f72975e6640 1 -- 172.21.15.5:0/2845569471 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72901a03d0 con 0x7f7290102760 2024-08-31T05:34:04.847 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.842+0000 7f72975e6640 1 -- 172.21.15.5:0/2845569471 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72901a0870 con 0x7f7290102760 2024-08-31T05:34:04.849 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.845+0000 7f729e62d740 1 Processor -- start 2024-08-31T05:34:04.849 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.845+0000 7f72867fc640 1 -- 172.21.15.5:0/2845569471 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f728c042070 con 0x7f7290102760 2024-08-31T05:34:04.850 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.845+0000 7f729e62d740 1 -- start start 2024-08-31T05:34:04.850 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.845+0000 7f729e62d740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ba0f261b0 0x561ba12c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:04.850 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.845+0000 7f729e62d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561ba0efd2f0 0x561ba12ca000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:04.850 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.845+0000 7f729e62d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba0f054d0 0x561ba12ca540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:04.850 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.846+0000 7f729e62d740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x561ba123f000 con 0x561ba0f261b0 2024-08-31T05:34:04.850 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.846+0000 7f729e62d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x561ba122e590 con 0x561ba0efd2f0 2024-08-31T05:34:04.850 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.846+0000 7f729e62d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561ba1232540 con 0x561ba0f054d0 2024-08-31T05:34:04.850 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.846+0000 7f7295b83640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ba0f261b0 0x561ba12c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:04.850 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.846+0000 7f7294b81640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba0f054d0 0x561ba12ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:04.850 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.846+0000 7f7295b83640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ba0f261b0 0x561ba12c9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41010/0 (socket says 172.21.15.5:41010) 2024-08-31T05:34:04.850 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.846+0000 7f7294b81640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba0f054d0 0x561ba12ca540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:39120/0 (socket says 172.21.15.5:39120) 2024-08-31T05:34:04.850 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.846+0000 7f7295382640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561ba0efd2f0 0x561ba12ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:04.851 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.846+0000 7f7294b81640 1 -- 172.21.15.5:0/239865632 learned_addr learned my addr 172.21.15.5:0/239865632 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:04.851 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.846+0000 7f7294b81640 1 -- 172.21.15.5:0/239865632 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561ba0efd2f0 msgr2=0x561ba12ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:04.851 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.846+0000 7f7294b81640 1 --2- 172.21.15.5:0/239865632 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561ba0efd2f0 0x561ba12ca000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.851 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.846+0000 7f7294b81640 1 -- 172.21.15.5:0/239865632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ba0f261b0 msgr2=0x561ba12c9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:04.851 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.846+0000 7f7294b81640 1 --2- 172.21.15.5:0/239865632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ba0f261b0 0x561ba12c9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.851 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.846+0000 7f7294b81640 1 -- 172.21.15.5:0/239865632 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ba0f91790 con 0x561ba0f054d0 2024-08-31T05:34:04.851 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.846+0000 7f7294b81640 1 --2- 172.21.15.5:0/239865632 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba0f054d0 0x561ba12ca540 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7280009c50 tx=0x7f7280011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afbb8727c2614b03 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:04.851 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.846+0000 7f72867fc640 1 --2- 172.21.15.5:0/2845569471 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f727c0b4d20 0x7f727c0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:04.851 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.846+0000 7f727b7fe640 1 -- 172.21.15.5:0/239865632 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7280004230 con 0x561ba0f054d0 2024-08-31T05:34:04.851 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.846+0000 7f7295b83640 1 --2- 172.21.15.5:0/2845569471 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f727c0b4d20 0x7f727c0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:04.851 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.847+0000 7f727b7fe640 1 -- 172.21.15.5:0/239865632 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72800043d0 con 0x561ba0f054d0 2024-08-31T05:34:04.852 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.847+0000 7f727b7fe640 1 -- 172.21.15.5:0/239865632 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7280004d50 con 0x561ba0f054d0 2024-08-31T05:34:04.852 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.847+0000 7f72867fc640 1 -- 172.21.15.5:0/2845569471 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f728c105c10 con 0x7f7290102760 2024-08-31T05:34:04.854 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.848+0000 7f729e62d740 1 -- 172.21.15.5:0/239865632 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba0f054d0 msgr2=0x561ba12ca540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:04.854 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.848+0000 7f7295b83640 1 --2- 172.21.15.5:0/2845569471 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f727c0b4d20 0x7f727c0b7230 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7288009fd0 tx=0x7f7288009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:04.854 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.848+0000 7f729e62d740 1 --2- 172.21.15.5:0/239865632 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba0f054d0 0x561ba12ca540 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7280009c50 tx=0x7f7280011810 comp rx=0 tx=0).stop 2024-08-31T05:34:04.854 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.848+0000 7f729e62d740 1 -- 172.21.15.5:0/239865632 shutdown_connections 2024-08-31T05:34:04.854 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.848+0000 7f729e62d740 1 --2- 172.21.15.5:0/239865632 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba0f054d0 0x561ba12ca540 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.854 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.848+0000 7f729e62d740 1 --2- 172.21.15.5:0/239865632 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561ba0efd2f0 0x561ba12ca000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.854 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.848+0000 7f729e62d740 1 --2- 172.21.15.5:0/239865632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ba0f261b0 0x561ba12c9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.854 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.848+0000 7f729e62d740 1 -- 172.21.15.5:0/239865632 >> 172.21.15.5:0/239865632 conn(0x561ba0f1a300 msgr2=0x561ba12c79b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:04.854 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.848+0000 7f729e62d740 1 -- 172.21.15.5:0/239865632 shutdown_connections 2024-08-31T05:34:04.855 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.848+0000 7f729e62d740 1 -- 172.21.15.5:0/239865632 wait complete. 2024-08-31T05:34:04.855 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.848+0000 7f729e62d740 1 -- start start 2024-08-31T05:34:04.855 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.848+0000 7f729e62d740 1 Processor -- start 2024-08-31T05:34:04.855 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.849+0000 7f729e62d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561ba0efd2f0 0x561ba12d56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:04.855 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.849+0000 7f729e62d740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ba0f054d0 0x561ba12d5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:04.855 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.849+0000 7f729e62d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba0f261b0 0x561ba12e1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:04.855 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.849+0000 7f729e62d740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x561ba1167ab0 con 0x561ba0f054d0 2024-08-31T05:34:04.855 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.849+0000 7f729e62d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x561ba11b5680 con 0x561ba0efd2f0 2024-08-31T05:34:04.855 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.849+0000 7f729e62d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561ba12d8240 con 0x561ba0f261b0 2024-08-31T05:34:04.855 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.849+0000 7f7294b81640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ba0f054d0 0x561ba12d5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:04.855 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.849+0000 7f7294b81640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ba0f054d0 0x561ba12d5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41016/0 (socket says 172.21.15.5:41016) 2024-08-31T05:34:04.855 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.849+0000 7f7294b81640 1 -- 172.21.15.5:0/752537067 learned_addr learned my addr 172.21.15.5:0/752537067 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:04.855 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.849+0000 7f729e62d740 10 client.0 _ll_register_callbacks cb 0x561ba0f3da00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:34:04.856 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.849+0000 7f7295b83640 1 --2- 172.21.15.5:0/752537067 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba0f261b0 0x561ba12e1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:04.856 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.849+0000 7f7295382640 1 --2- 172.21.15.5:0/752537067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561ba0efd2f0 0x561ba12d56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:04.856 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.850+0000 7f7294b81640 1 -- 172.21.15.5:0/752537067 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba0f261b0 msgr2=0x561ba12e1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:04.856 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.850+0000 7f7294b81640 1 --2- 172.21.15.5:0/752537067 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba0f261b0 0x561ba12e1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.856 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.850+0000 7f7294b81640 1 -- 172.21.15.5:0/752537067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561ba0efd2f0 msgr2=0x561ba12d56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:04.856 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.850+0000 7f7294b81640 1 --2- 172.21.15.5:0/752537067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561ba0efd2f0 0x561ba12d56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.856 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.850+0000 7f7294b81640 1 -- 172.21.15.5:0/752537067 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ba100a620 con 0x561ba0f054d0 2024-08-31T05:34:04.856 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.850+0000 7f7295b83640 1 --2- 172.21.15.5:0/752537067 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba0f261b0 0x561ba12e1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:34:04.856 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.850+0000 7f7294b81640 1 --2- 172.21.15.5:0/752537067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ba0f054d0 0x561ba12d5be0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f72800049b0 tx=0x7f728001aa80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccd34925d384f993 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:04.856 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.850+0000 7f7278ff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:34:04.856 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.850+0000 7f7278ff9640 1 -- 172.21.15.5:0/752537067 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7280028020 con 0x561ba0f054d0 2024-08-31T05:34:04.856 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.850+0000 7f7278ff9640 1 -- 172.21.15.5:0/752537067 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f7280024420 con 0x561ba0f054d0 2024-08-31T05:34:04.856 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.850+0000 7f729e62d740 1 -- 172.21.15.5:0/752537067 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72800043d0 con 0x561ba0f054d0 2024-08-31T05:34:04.857 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.850+0000 7f7278ff9640 1 -- 172.21.15.5:0/752537067 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f7280033050 con 0x561ba0f054d0 2024-08-31T05:34:04.857 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.850+0000 7f729e62d740 10 client.16698 fetch_fsmap learned FSMap version 34 2024-08-31T05:34:04.857 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.850+0000 7f729e62d740 1 -- 172.21.15.5:0/752537067 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x561ba12e42e0 con 0x561ba0f054d0 2024-08-31T05:34:04.857 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.850+0000 7f7278ff9640 1 -- 172.21.15.5:0/752537067 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72800043d0 con 0x561ba0f054d0 2024-08-31T05:34:04.859 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.851+0000 7f7278ff9640 1 -- 172.21.15.5:0/752537067 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f7280018070 con 0x561ba0f054d0 2024-08-31T05:34:04.859 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.851+0000 7f729e62d740 10 client.16698 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:34:04.859 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.851+0000 7f729e62d740 10 client.16698 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:34:04.859 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.851+0000 7f729e62d740 20 client.16698 populate_metadata read hostname 'smithi005' 2024-08-31T05:34:04.859 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.851+0000 7f729e62d740 1 --2- 172.21.15.5:0/752537067 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561ba0ee4d80 0x561ba12e7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:04.859 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.851+0000 7f729e62d740 4 client.16698 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:34:04.859 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.851+0000 7f729e62d740 1 -- 172.21.15.5:0/752537067 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561ba1240f50 con 0x561ba0ee4d80 2024-08-31T05:34:04.859 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.852+0000 7f7295382640 1 --2- 172.21.15.5:0/752537067 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561ba0ee4d80 0x561ba12e7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:04.859 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.852+0000 7f7295382640 1 --2- 172.21.15.5:0/752537067 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561ba0ee4d80 0x561ba12e7640 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c91245a7f8f0794d server_cookie=d18c95ee035f883b in_seq=0 out_seq=0 2024-08-31T05:34:04.859 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.852+0000 7f7278ff9640 10 client.16698 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:34:04.860 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.853+0000 7f7278ff9640 1 -- 172.21.15.5:0/752537067 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561ba1240f50 con 0x561ba0ee4d80 2024-08-31T05:34:04.860 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.853+0000 7f7278ff9640 10 client.16698 handle_command_reply: tid=0 2024-08-31T05:34:04.860 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.853+0000 7f729e62d740 1 client.16698 shutdown 2024-08-31T05:34:04.860 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.853+0000 7f729e62d740 1 -- 172.21.15.5:0/752537067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ba0f054d0 msgr2=0x561ba12d5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:04.860 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.853+0000 7f729e62d740 1 --2- 172.21.15.5:0/752537067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ba0f054d0 0x561ba12d5be0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f72800049b0 tx=0x7f728001aa80 comp rx=0 tx=0).stop 2024-08-31T05:34:04.860 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.853+0000 7f729e62d740 1 -- 172.21.15.5:0/752537067 shutdown_connections 2024-08-31T05:34:04.860 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.853+0000 7f729e62d740 1 --2- 172.21.15.5:0/752537067 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561ba0ee4d80 0x561ba12e7640 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.860 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.853+0000 7f729e62d740 1 --2- 172.21.15.5:0/752537067 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba0f261b0 0x561ba12e1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.860 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.853+0000 7f729e62d740 1 --2- 172.21.15.5:0/752537067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ba0f054d0 0x561ba12d5be0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.860 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.853+0000 7f729e62d740 1 --2- 172.21.15.5:0/752537067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561ba0efd2f0 0x561ba12d56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.860 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.853+0000 7f729e62d740 1 -- 172.21.15.5:0/752537067 >> 172.21.15.5:0/752537067 conn(0x561ba0f1a300 msgr2=0x561ba12caaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:04.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.853+0000 7f7278ff9640 0 client.16698 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:34:04.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.853+0000 7f729e62d740 1 -- 172.21.15.5:0/752537067 shutdown_connections 2024-08-31T05:34:04.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.854+0000 7f729e62d740 1 -- 172.21.15.5:0/752537067 wait complete. 2024-08-31T05:34:04.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.854+0000 7f729e62d740 20 client.16698 trim_cache size 0 max 16384 2024-08-31T05:34:04.876 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.872+0000 7f729e62d740 1 Processor -- start 2024-08-31T05:34:04.876 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.872+0000 7f729e62d740 1 -- start start 2024-08-31T05:34:04.876 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.872+0000 7f729e62d740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ba0efd2f0 0x561ba12d0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:04.876 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.872+0000 7f729e62d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba0f054d0 0x561ba12d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:04.876 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.872+0000 7f729e62d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561ba0f261b0 0x561ba12d3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:04.876 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.872+0000 7f729e62d740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f72901b0be0 con 0x561ba0efd2f0 2024-08-31T05:34:04.876 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.872+0000 7f729e62d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f72901b2720 con 0x561ba0f261b0 2024-08-31T05:34:04.876 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.872+0000 7f729e62d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f72901b12b0 con 0x561ba0f054d0 2024-08-31T05:34:04.876 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.872+0000 7f7295382640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ba0efd2f0 0x561ba12d0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:04.876 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.872+0000 7f7295382640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ba0efd2f0 0x561ba12d0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41020/0 (socket says 172.21.15.5:41020) 2024-08-31T05:34:04.876 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.872+0000 7f7295382640 1 -- 172.21.15.5:0/3522217799 learned_addr learned my addr 172.21.15.5:0/3522217799 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:04.877 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.872+0000 7f7294b81640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba0f054d0 0x561ba12d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:04.877 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.872+0000 7f7295b83640 1 --2- 172.21.15.5:0/3522217799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561ba0f261b0 0x561ba12d3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:04.877 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.873+0000 7f7295382640 1 -- 172.21.15.5:0/3522217799 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba0f054d0 msgr2=0x561ba12d0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:04.877 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.873+0000 7f7295382640 1 --2- 172.21.15.5:0/3522217799 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba0f054d0 0x561ba12d0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.877 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.873+0000 7f7295382640 1 -- 172.21.15.5:0/3522217799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561ba0f261b0 msgr2=0x561ba12d3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:04.877 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.873+0000 7f7295382640 1 --2- 172.21.15.5:0/3522217799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561ba0f261b0 0x561ba12d3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.877 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.873+0000 7f7295382640 1 -- 172.21.15.5:0/3522217799 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ba0ee4fb0 con 0x561ba0efd2f0 2024-08-31T05:34:04.877 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.873+0000 7f7294b81640 1 --2- 172.21.15.5:0/3522217799 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba0f054d0 0x561ba12d0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:34:04.877 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.873+0000 7f7295382640 1 --2- 172.21.15.5:0/3522217799 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ba0efd2f0 0x561ba12d0590 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f728c103040 tx=0x7f728c108120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fb084e9fd0c98fc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:04.882 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.873+0000 7f727affd640 1 -- 172.21.15.5:0/3522217799 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f728c049040 con 0x561ba0efd2f0 2024-08-31T05:34:04.882 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.873+0000 7f727affd640 1 -- 172.21.15.5:0/3522217799 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f728c0cbb40 con 0x561ba0efd2f0 2024-08-31T05:34:04.882 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.873+0000 7f727affd640 1 -- 172.21.15.5:0/3522217799 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f728c103260 con 0x561ba0efd2f0 2024-08-31T05:34:04.882 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.874+0000 7f729e62d740 1 -- 172.21.15.5:0/3522217799 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ba0efd2f0 msgr2=0x561ba12d0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:04.882 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.875+0000 7f729e62d740 1 --2- 172.21.15.5:0/3522217799 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ba0efd2f0 0x561ba12d0590 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f728c103040 tx=0x7f728c108120 comp rx=0 tx=0).stop 2024-08-31T05:34:04.882 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.875+0000 7f729e62d740 1 -- 172.21.15.5:0/3522217799 shutdown_connections 2024-08-31T05:34:04.882 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.875+0000 7f729e62d740 1 --2- 172.21.15.5:0/3522217799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561ba0f261b0 0x561ba12d3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.882 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.875+0000 7f729e62d740 1 --2- 172.21.15.5:0/3522217799 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba0f054d0 0x561ba12d0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.882 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.875+0000 7f729e62d740 1 --2- 172.21.15.5:0/3522217799 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ba0efd2f0 0x561ba12d0590 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.882 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.875+0000 7f729e62d740 1 -- 172.21.15.5:0/3522217799 >> 172.21.15.5:0/3522217799 conn(0x561ba0f1a300 msgr2=0x561ba12cebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:04.882 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.875+0000 7f729e62d740 1 -- 172.21.15.5:0/3522217799 shutdown_connections 2024-08-31T05:34:04.883 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.875+0000 7f729e62d740 1 -- 172.21.15.5:0/3522217799 wait complete. 2024-08-31T05:34:04.883 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.875+0000 7f729e62d740 1 -- start start 2024-08-31T05:34:04.883 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.875+0000 7f729e62d740 1 Processor -- start 2024-08-31T05:34:04.883 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.876+0000 7f729e62d740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ba0efd2f0 0x561ba12d8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:04.883 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.876+0000 7f729e62d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561ba0f054d0 0x561ba12d9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:04.883 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.876+0000 7f729e62d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba0f261b0 0x561ba134ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:04.883 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.876+0000 7f729e62d740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f72901b2050 con 0x561ba0efd2f0 2024-08-31T05:34:04.883 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.876+0000 7f729e62d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f72901b1980 con 0x561ba0f054d0 2024-08-31T05:34:04.883 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.876+0000 7f729e62d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f72901aebc0 con 0x561ba0f261b0 2024-08-31T05:34:04.883 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.876+0000 7f729e62d740 10 client.0 _ll_register_callbacks cb 0x7f7288009ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:34:04.883 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.876+0000 7f7295382640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ba0efd2f0 0x561ba12d8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:04.883 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.876+0000 7f7295382640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ba0efd2f0 0x561ba12d8cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41032/0 (socket says 172.21.15.5:41032) 2024-08-31T05:34:04.883 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.876+0000 7f7295382640 1 -- 172.21.15.5:0/3409473502 learned_addr learned my addr 172.21.15.5:0/3409473502 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:04.883 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.876+0000 7f7295b83640 1 --2- 172.21.15.5:0/3409473502 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba0f261b0 0x561ba134ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:04.884 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.876+0000 7f7294b81640 1 --2- 172.21.15.5:0/3409473502 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561ba0f054d0 0x561ba12d9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:04.884 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.876+0000 7f7295382640 1 -- 172.21.15.5:0/3409473502 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba0f261b0 msgr2=0x561ba134ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:04.884 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.876+0000 7f7295382640 1 --2- 172.21.15.5:0/3409473502 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba0f261b0 0x561ba134ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.884 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.876+0000 7f7295382640 1 -- 172.21.15.5:0/3409473502 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561ba0f054d0 msgr2=0x561ba12d9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:04.884 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.876+0000 7f7295382640 1 --2- 172.21.15.5:0/3409473502 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561ba0f054d0 0x561ba12d9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.884 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.876+0000 7f7295382640 1 -- 172.21.15.5:0/3409473502 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ba1350500 con 0x561ba0efd2f0 2024-08-31T05:34:04.884 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.877+0000 7f7295382640 1 --2- 172.21.15.5:0/3409473502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ba0efd2f0 0x561ba12d8cf0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f728c1035e0 tx=0x7f728c0cb980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8da242d3f91c2a1b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:04.884 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.877+0000 7f7278ff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:34:04.884 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.877+0000 7f7278ff9640 1 -- 172.21.15.5:0/3409473502 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f728c049070 con 0x561ba0efd2f0 2024-08-31T05:34:04.884 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.877+0000 7f7278ff9640 1 -- 172.21.15.5:0/3409473502 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f728c0c8620 con 0x561ba0efd2f0 2024-08-31T05:34:04.884 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.877+0000 7f729e62d740 1 -- 172.21.15.5:0/3409473502 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f728c0cbb40 con 0x561ba0efd2f0 2024-08-31T05:34:04.884 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.877+0000 7f7278ff9640 1 -- 172.21.15.5:0/3409473502 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f728c0cb7a0 con 0x561ba0efd2f0 2024-08-31T05:34:04.885 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.877+0000 7f729e62d740 10 client.16704 fetch_fsmap learned FSMap version 34 2024-08-31T05:34:04.885 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.877+0000 7f729e62d740 1 -- 172.21.15.5:0/3409473502 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x561ba13517c0 con 0x561ba0efd2f0 2024-08-31T05:34:04.885 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.877+0000 7f7278ff9640 1 -- 172.21.15.5:0/3409473502 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f728c0cbb40 con 0x561ba0efd2f0 2024-08-31T05:34:04.885 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.877+0000 7f7278ff9640 1 -- 172.21.15.5:0/3409473502 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f728c04c060 con 0x561ba0efd2f0 2024-08-31T05:34:04.885 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.877+0000 7f729e62d740 10 client.16704 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:34:04.885 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.877+0000 7f729e62d740 10 client.16704 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:34:04.885 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.877+0000 7f729e62d740 20 client.16704 populate_metadata read hostname 'smithi005' 2024-08-31T05:34:04.885 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.877+0000 7f729e62d740 1 --2- 172.21.15.5:0/3409473502 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561ba0eba1c0 0x561ba1353ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:04.885 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.877+0000 7f729e62d740 4 client.16704 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:34:04.885 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.877+0000 7f729e62d740 1 -- 172.21.15.5:0/3409473502 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561ba123c9f0 con 0x561ba0eba1c0 2024-08-31T05:34:04.885 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.878+0000 7f7294b81640 1 --2- 172.21.15.5:0/3409473502 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561ba0eba1c0 0x561ba1353ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:04.885 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.878+0000 7f7278ff9640 10 client.16704 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:34:04.886 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.878+0000 7f7294b81640 1 --2- 172.21.15.5:0/3409473502 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561ba0eba1c0 0x561ba1353ef0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56af2525aea48e80 server_cookie=3f58168c630276b in_seq=0 out_seq=0 2024-08-31T05:34:04.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.888+0000 7f7278ff9640 1 -- 172.21.15.5:0/3409473502 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561ba123c9f0 con 0x561ba0eba1c0 2024-08-31T05:34:04.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.888+0000 7f7278ff9640 10 client.16704 handle_command_reply: tid=0 2024-08-31T05:34:04.892 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.888+0000 7f729e62d740 1 client.16704 shutdown 2024-08-31T05:34:04.892 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.888+0000 7f729e62d740 1 -- 172.21.15.5:0/3409473502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ba0efd2f0 msgr2=0x561ba12d8cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:04.892 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.888+0000 7f729e62d740 1 --2- 172.21.15.5:0/3409473502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ba0efd2f0 0x561ba12d8cf0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f728c1035e0 tx=0x7f728c0cb980 comp rx=0 tx=0).stop 2024-08-31T05:34:04.892 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.888+0000 7f729e62d740 1 -- 172.21.15.5:0/3409473502 shutdown_connections 2024-08-31T05:34:04.892 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.888+0000 7f729e62d740 1 --2- 172.21.15.5:0/3409473502 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561ba0eba1c0 0x561ba1353ef0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.892 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.888+0000 7f729e62d740 1 --2- 172.21.15.5:0/3409473502 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561ba0f261b0 0x561ba134ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.892 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.888+0000 7f729e62d740 1 --2- 172.21.15.5:0/3409473502 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561ba0f054d0 0x561ba12d9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.892 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.888+0000 7f729e62d740 1 --2- 172.21.15.5:0/3409473502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561ba0efd2f0 0x561ba12d8cf0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.892 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.888+0000 7f7278ff9640 0 client.16704 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:34:04.892 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.888+0000 7f729e62d740 1 -- 172.21.15.5:0/3409473502 >> 172.21.15.5:0/3409473502 conn(0x561ba0f1a300 msgr2=0x561ba12d3c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:04.892 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.888+0000 7f729e62d740 1 -- 172.21.15.5:0/3409473502 shutdown_connections 2024-08-31T05:34:04.892 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.888+0000 7f729e62d740 1 -- 172.21.15.5:0/3409473502 wait complete. 2024-08-31T05:34:04.892 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.889+0000 7f729e62d740 20 client.16704 trim_cache size 0 max 16384 2024-08-31T05:34:04.893 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:34:04.893 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:34:04.893 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:34:04.893 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:34:04.894 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.889+0000 7f72975e6640 1 -- 172.21.15.5:0/2845569471 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f727c0b4d20 msgr2=0x7f727c0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:04.894 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.889+0000 7f72975e6640 1 --2- 172.21.15.5:0/2845569471 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f727c0b4d20 0x7f727c0b7230 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7288009fd0 tx=0x7f7288009500 comp rx=0 tx=0).stop 2024-08-31T05:34:04.895 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.889+0000 7f72975e6640 1 -- 172.21.15.5:0/2845569471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7290102760 msgr2=0x7f729019a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:04.895 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.890+0000 7f72975e6640 1 --2- 172.21.15.5:0/2845569471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7290102760 0x7f729019a210 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f728c005ab0 tx=0x7f728c003c10 comp rx=0 tx=0).stop 2024-08-31T05:34:04.895 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.890+0000 7f72975e6640 1 -- 172.21.15.5:0/2845569471 shutdown_connections 2024-08-31T05:34:04.895 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.890+0000 7f72975e6640 1 --2- 172.21.15.5:0/2845569471 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f727c0b4d20 0x7f727c0b7230 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.895 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.890+0000 7f72975e6640 1 --2- 172.21.15.5:0/2845569471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72901089e0 0x7f729019fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.895 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.890+0000 7f72975e6640 1 --2- 172.21.15.5:0/2845569471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7290108090 0x7f729019a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.895 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.890+0000 7f72975e6640 1 --2- 172.21.15.5:0/2845569471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7290102760 0x7f729019a210 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:04.895 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.890+0000 7f72975e6640 1 -- 172.21.15.5:0/2845569471 >> 172.21.15.5:0/2845569471 conn(0x7f72900fe160 msgr2=0x7f7290107750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:04.895 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.890+0000 7f72975e6640 1 -- 172.21.15.5:0/2845569471 shutdown_connections 2024-08-31T05:34:04.895 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:04.890+0000 7f72975e6640 1 -- 172.21.15.5:0/2845569471 wait complete. 2024-08-31T05:34:04.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:34:04 smithi050 ceph-mon[22146]: pgmap v468: 129 pgs: 129 active+clean; 216 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.4 MiB/s wr, 265 op/s 2024-08-31T05:34:04.914 INFO:tasks.workunit.client.0.smithi005.stdout: 1 428843 13.02 MB/sec execute 52 sec latency 31.903 ms 2024-08-31T05:34:05.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:34:04 smithi070 ceph-mon[22316]: pgmap v468: 129 pgs: 129 active+clean; 216 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.4 MiB/s wr, 265 op/s 2024-08-31T05:34:05.442 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T05:34:05.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:34:05 smithi005 ceph-mon[18602]: scrub queued for path: / 2024-08-31T05:34:05.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:34:05 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:34:05.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:34:05 smithi005 ceph-mon[18602]: scrub summary: active paths [/] 2024-08-31T05:34:05.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:34:05 smithi005 ceph-mon[18602]: scrub summary: active paths [/] 2024-08-31T05:34:05.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:34:05 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:34:05.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:34:05 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:34:05.745 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:34:05.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:34:05 smithi050 ceph-mon[22146]: scrub queued for path: / 2024-08-31T05:34:05.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:34:05 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:34:05.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:34:05 smithi050 ceph-mon[22146]: scrub summary: active paths [/] 2024-08-31T05:34:05.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:34:05 smithi050 ceph-mon[22146]: scrub summary: active paths [/] 2024-08-31T05:34:05.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:34:05 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:34:05.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:34:05 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:34:05.914 INFO:tasks.workunit.client.0.smithi005.stdout: 1 430831 12.98 MB/sec execute 53 sec latency 13.284 ms 2024-08-31T05:34:06.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:34:05 smithi070 ceph-mon[22316]: scrub queued for path: / 2024-08-31T05:34:06.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:34:05 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:34:06.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:34:05 smithi070 ceph-mon[22316]: scrub summary: active paths [/] 2024-08-31T05:34:06.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:34:05 smithi070 ceph-mon[22316]: scrub summary: active paths [/] 2024-08-31T05:34:06.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:34:05 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:34:06.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:34:05 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:34:06.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.619+0000 7fc1ff667640 1 -- 172.21.15.5:0/2481842059 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc1f8102800 msgr2=0x7fc1f8102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:06.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.619+0000 7fc1ff667640 1 --2- 172.21.15.5:0/2481842059 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc1f8102800 0x7fc1f8102c10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc1f4009900 tx=0x7fc1f402a410 comp rx=0 tx=0).stop 2024-08-31T05:34:06.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.619+0000 7fc1ff667640 1 -- 172.21.15.5:0/2481842059 shutdown_connections 2024-08-31T05:34:06.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.619+0000 7fc1ff667640 1 --2- 172.21.15.5:0/2481842059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1f8108a90 0x7fc1f810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:06.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.619+0000 7fc1ff667640 1 --2- 172.21.15.5:0/2481842059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1f8108140 0x7fc1f8108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:06.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.619+0000 7fc1ff667640 1 --2- 172.21.15.5:0/2481842059 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc1f8102800 0x7fc1f8102c10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:06.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.619+0000 7fc1ff667640 1 -- 172.21.15.5:0/2481842059 >> 172.21.15.5:0/2481842059 conn(0x7fc1f80794d0 msgr2=0x7fc1f80798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:06.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.619+0000 7fc1ff667640 1 -- 172.21.15.5:0/2481842059 shutdown_connections 2024-08-31T05:34:06.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.619+0000 7fc1ff667640 1 -- 172.21.15.5:0/2481842059 wait complete. 2024-08-31T05:34:06.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.620+0000 7fc1ff667640 1 Processor -- start 2024-08-31T05:34:06.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.620+0000 7fc1ff667640 1 -- start start 2024-08-31T05:34:06.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.620+0000 7fc1ff667640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1f8102800 0x7fc1f819b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:06.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.620+0000 7fc1ff667640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc1f8108140 0x7fc1f819b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:06.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.620+0000 7fc1ff667640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1f8108a90 0x7fc1f819bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:06.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.620+0000 7fc1ff667640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f8112740 con 0x7fc1f8108a90 2024-08-31T05:34:06.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.620+0000 7fc1ff667640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f81125c0 con 0x7fc1f8102800 2024-08-31T05:34:06.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.620+0000 7fc1ff667640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f81128c0 con 0x7fc1f8108140 2024-08-31T05:34:06.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.620+0000 7fc1fcc02640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc1f8108140 0x7fc1f819b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:06.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.620+0000 7fc1fd403640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1f8102800 0x7fc1f819b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:06.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.620+0000 7fc1fcc02640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc1f8108140 0x7fc1f819b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:39170/0 (socket says 172.21.15.5:39170) 2024-08-31T05:34:06.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.620+0000 7fc1fcc02640 1 -- 172.21.15.5:0/154246112 learned_addr learned my addr 172.21.15.5:0/154246112 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:06.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.621+0000 7fc1fdc04640 1 --2- 172.21.15.5:0/154246112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1f8108a90 0x7fc1f819bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:06.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.621+0000 7fc1fcc02640 1 -- 172.21.15.5:0/154246112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1f8102800 msgr2=0x7fc1f819b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:06.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.621+0000 7fc1fcc02640 1 --2- 172.21.15.5:0/154246112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1f8102800 0x7fc1f819b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:06.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.621+0000 7fc1fcc02640 1 -- 172.21.15.5:0/154246112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1f8108a90 msgr2=0x7fc1f819bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:06.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.621+0000 7fc1fcc02640 1 --2- 172.21.15.5:0/154246112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1f8108a90 0x7fc1f819bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:06.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.621+0000 7fc1fcc02640 1 -- 172.21.15.5:0/154246112 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1f81a6350 con 0x7fc1f8108140 2024-08-31T05:34:06.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.621+0000 7fc1fd403640 1 --2- 172.21.15.5:0/154246112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1f8102800 0x7fc1f819b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:34:06.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.621+0000 7fc1fcc02640 1 --2- 172.21.15.5:0/154246112 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc1f8108140 0x7fc1f819b5d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc1e800e9c0 tx=0x7fc1e800ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:06.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.621+0000 7fc1ee7fc640 1 -- 172.21.15.5:0/154246112 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e800cd80 con 0x7fc1f8108140 2024-08-31T05:34:06.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.621+0000 7fc1ee7fc640 1 -- 172.21.15.5:0/154246112 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1e80054d0 con 0x7fc1f8108140 2024-08-31T05:34:06.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.621+0000 7fc1ff667640 1 -- 172.21.15.5:0/154246112 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1f8198ee0 con 0x7fc1f8108140 2024-08-31T05:34:06.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.621+0000 7fc1ee7fc640 1 -- 172.21.15.5:0/154246112 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e8010430 con 0x7fc1f8108140 2024-08-31T05:34:06.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.622+0000 7fc1ff667640 1 -- 172.21.15.5:0/154246112 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1f81993f0 con 0x7fc1f8108140 2024-08-31T05:34:06.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.624+0000 7fc205bdc740 1 Processor -- start 2024-08-31T05:34:06.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.624+0000 7fc1ee7fc640 1 -- 172.21.15.5:0/154246112 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fc1e80105d0 con 0x7fc1f8108140 2024-08-31T05:34:06.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.624+0000 7fc205bdc740 1 -- start start 2024-08-31T05:34:06.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.624+0000 7fc205bdc740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aec88ce070 0x55aec8c73300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:06.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.624+0000 7fc205bdc740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aec88a51b0 0x55aec8c73840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:06.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.624+0000 7fc205bdc740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aec88ad390 0x55aec8c73d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:06.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.625+0000 7fc205bdc740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55aec8bea630 con 0x55aec88ad390 2024-08-31T05:34:06.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.625+0000 7fc205bdc740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55aec8bd9bc0 con 0x55aec88a51b0 2024-08-31T05:34:06.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.625+0000 7fc205bdc740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55aec8bddb70 con 0x55aec88ce070 2024-08-31T05:34:06.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.625+0000 7fc1fd403640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aec88a51b0 0x55aec8c73840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:06.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.625+0000 7fc1fdc04640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aec88ce070 0x55aec8c73300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:06.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.625+0000 7fc1fd403640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aec88a51b0 0x55aec8c73840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:50888/0 (socket says 172.21.15.5:50888) 2024-08-31T05:34:06.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.625+0000 7fc1fd403640 1 -- 172.21.15.5:0/3198894003 learned_addr learned my addr 172.21.15.5:0/3198894003 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:06.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.625+0000 7fc1fcc02640 1 --2- 172.21.15.5:0/3198894003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aec88ad390 0x55aec8c73d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:06.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.625+0000 7fc1fd403640 1 -- 172.21.15.5:0/3198894003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aec88ce070 msgr2=0x55aec8c73300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:06.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.625+0000 7fc1fd403640 1 --2- 172.21.15.5:0/3198894003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aec88ce070 0x55aec8c73300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:06.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.625+0000 7fc1fd403640 1 -- 172.21.15.5:0/3198894003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aec88ad390 msgr2=0x55aec8c73d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:06.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.625+0000 7fc1fd403640 1 --2- 172.21.15.5:0/3198894003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aec88ad390 0x55aec8c73d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:06.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.625+0000 7fc1fd403640 1 -- 172.21.15.5:0/3198894003 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aec8939650 con 0x55aec88a51b0 2024-08-31T05:34:06.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.625+0000 7fc1fdc04640 1 --2- 172.21.15.5:0/3198894003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aec88ce070 0x55aec8c73300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:34:06.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.625+0000 7fc1ee7fc640 1 --2- 172.21.15.5:0/154246112 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc1e40b4ca0 0x7fc1e40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:06.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.625+0000 7fc1fdc04640 1 --2- 172.21.15.5:0/154246112 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc1e40b4ca0 0x7fc1e40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:06.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.625+0000 7fc1fd403640 1 --2- 172.21.15.5:0/3198894003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aec88a51b0 0x55aec8c73840 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc1f4009230 tx=0x7fc1f4004470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16049098b3506f77 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:06.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.625+0000 7fc1ee7fc640 1 -- 172.21.15.5:0/154246112 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fc1e80e5d10 con 0x7fc1f8108140 2024-08-31T05:34:06.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.626+0000 7fc1e37fe640 1 -- 172.21.15.5:0/3198894003 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f4035040 con 0x55aec88a51b0 2024-08-31T05:34:06.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.626+0000 7fc1e37fe640 1 -- 172.21.15.5:0/3198894003 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1f4004770 con 0x55aec88a51b0 2024-08-31T05:34:06.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.626+0000 7fc1e37fe640 1 -- 172.21.15.5:0/3198894003 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f4003a10 con 0x55aec88a51b0 2024-08-31T05:34:06.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.627+0000 7fc205bdc740 1 -- 172.21.15.5:0/3198894003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aec88a51b0 msgr2=0x55aec8c73840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:06.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.627+0000 7fc1fdc04640 1 --2- 172.21.15.5:0/154246112 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc1e40b4ca0 0x7fc1e40b71b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc1f0009fd0 tx=0x7fc1f0009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:06.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.627+0000 7fc205bdc740 1 --2- 172.21.15.5:0/3198894003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aec88a51b0 0x55aec8c73840 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc1f4009230 tx=0x7fc1f4004470 comp rx=0 tx=0).stop 2024-08-31T05:34:06.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.627+0000 7fc205bdc740 1 -- 172.21.15.5:0/3198894003 shutdown_connections 2024-08-31T05:34:06.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.627+0000 7fc205bdc740 1 --2- 172.21.15.5:0/3198894003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aec88ad390 0x55aec8c73d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:06.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.627+0000 7fc205bdc740 1 --2- 172.21.15.5:0/3198894003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aec88a51b0 0x55aec8c73840 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:06.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.627+0000 7fc205bdc740 1 --2- 172.21.15.5:0/3198894003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aec88ce070 0x55aec8c73300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:06.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.627+0000 7fc205bdc740 1 -- 172.21.15.5:0/3198894003 >> 172.21.15.5:0/3198894003 conn(0x55aec88c2460 msgr2=0x55aec8c711f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:06.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.627+0000 7fc205bdc740 1 -- 172.21.15.5:0/3198894003 shutdown_connections 2024-08-31T05:34:06.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.627+0000 7fc205bdc740 1 -- 172.21.15.5:0/3198894003 wait complete. 2024-08-31T05:34:06.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.627+0000 7fc205bdc740 1 -- start start 2024-08-31T05:34:06.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.627+0000 7fc205bdc740 1 Processor -- start 2024-08-31T05:34:06.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.628+0000 7fc205bdc740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aec88a51b0 0x55aec8c7ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:06.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.628+0000 7fc205bdc740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aec88ad390 0x55aec8c7efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:06.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.628+0000 7fc205bdc740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aec88ce070 0x55aec8c8ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:06.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.628+0000 7fc205bdc740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55aec8a3c700 con 0x55aec88a51b0 2024-08-31T05:34:06.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.628+0000 7fc205bdc740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55aec8b60700 con 0x55aec88ad390 2024-08-31T05:34:06.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.628+0000 7fc205bdc740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55aec8c81a80 con 0x55aec88ce070 2024-08-31T05:34:06.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.628+0000 7fc205bdc740 10 client.0 _ll_register_callbacks cb 0x55aec8b8fdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:34:06.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.628+0000 7fc1fcc02640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aec88ad390 0x55aec8c7efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:06.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.628+0000 7fc1fcc02640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aec88ad390 0x55aec8c7efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:50894/0 (socket says 172.21.15.5:50894) 2024-08-31T05:34:06.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.628+0000 7fc1fdc04640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aec88ce070 0x55aec8c8ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:06.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.628+0000 7fc1fd403640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aec88a51b0 0x55aec8c7ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:06.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.628+0000 7fc1fcc02640 1 -- 172.21.15.5:0/1634571779 learned_addr learned my addr 172.21.15.5:0/1634571779 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:06.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.629+0000 7fc1fdc04640 1 -- 172.21.15.5:0/1634571779 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aec88ad390 msgr2=0x55aec8c7efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:06.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.629+0000 7fc1fdc04640 1 --2- 172.21.15.5:0/1634571779 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aec88ad390 0x55aec8c7efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:06.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.629+0000 7fc1fdc04640 1 -- 172.21.15.5:0/1634571779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aec88a51b0 msgr2=0x55aec8c7ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:06.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.629+0000 7fc1fdc04640 1 --2- 172.21.15.5:0/1634571779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aec88a51b0 0x55aec8c7ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:06.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.629+0000 7fc1fdc04640 1 -- 172.21.15.5:0/1634571779 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aec8b998b0 con 0x55aec88ce070 2024-08-31T05:34:06.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.629+0000 7fc1fcc02640 1 --2- 172.21.15.5:0/1634571779 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aec88ad390 0x55aec8c7efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:34:06.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.629+0000 7fc1fd403640 1 --2- 172.21.15.5:0/1634571779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aec88a51b0 0x55aec8c7ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:34:06.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.629+0000 7fc1fdc04640 1 --2- 172.21.15.5:0/1634571779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aec88ce070 0x55aec8c8ad70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc1f0009d20 tx=0x7fc1f0004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56452a4cd4a50059 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:06.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.629+0000 7fc1e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:34:06.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.629+0000 7fc1e0ff9640 1 -- 172.21.15.5:0/1634571779 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f0003c40 con 0x55aec88ce070 2024-08-31T05:34:06.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.629+0000 7fc1e0ff9640 1 -- 172.21.15.5:0/1634571779 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fc1f0017030 con 0x55aec88ce070 2024-08-31T05:34:06.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.629+0000 7fc205bdc740 1 -- 172.21.15.5:0/1634571779 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1f4004770 con 0x55aec88ce070 2024-08-31T05:34:06.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.629+0000 7fc1e0ff9640 1 -- 172.21.15.5:0/1634571779 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc1f0003de0 con 0x55aec88ce070 2024-08-31T05:34:06.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.629+0000 7fc205bdc740 10 client.26323 fetch_fsmap learned FSMap version 34 2024-08-31T05:34:06.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.629+0000 7fc205bdc740 1 -- 172.21.15.5:0/1634571779 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55aec8c8d910 con 0x55aec88ce070 2024-08-31T05:34:06.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.630+0000 7fc1e0ff9640 1 -- 172.21.15.5:0/1634571779 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1f4004770 con 0x55aec88ce070 2024-08-31T05:34:06.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.630+0000 7fc1e0ff9640 1 -- 172.21.15.5:0/1634571779 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fc1f001f8d0 con 0x55aec88ce070 2024-08-31T05:34:06.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.630+0000 7fc205bdc740 10 client.26323 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:34:06.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.630+0000 7fc205bdc740 10 client.26323 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:34:06.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.630+0000 7fc205bdc740 20 client.26323 populate_metadata read hostname 'smithi005' 2024-08-31T05:34:06.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.630+0000 7fc205bdc740 1 --2- 172.21.15.5:0/1634571779 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55aec888c9f0 0x55aec8c90ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:06.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.630+0000 7fc205bdc740 4 client.26323 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:34:06.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.630+0000 7fc205bdc740 1 -- 172.21.15.5:0/1634571779 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aec8bec580 con 0x55aec888c9f0 2024-08-31T05:34:06.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.630+0000 7fc1fd403640 1 --2- 172.21.15.5:0/1634571779 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55aec888c9f0 0x55aec8c90ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:06.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.630+0000 7fc1e0ff9640 10 client.26323 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:34:06.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.630+0000 7fc1fd403640 1 --2- 172.21.15.5:0/1634571779 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55aec888c9f0 0x55aec8c90ee0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3aded4d58b5385e6 server_cookie=731a0d641a63c937 in_seq=0 out_seq=0 2024-08-31T05:34:06.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.631+0000 7fc1e0ff9640 1 -- 172.21.15.5:0/1634571779 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55aec8bec580 con 0x55aec888c9f0 2024-08-31T05:34:06.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.631+0000 7fc1e0ff9640 10 client.26323 handle_command_reply: tid=0 2024-08-31T05:34:06.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.631+0000 7fc205bdc740 1 client.26323 shutdown 2024-08-31T05:34:06.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.631+0000 7fc205bdc740 1 -- 172.21.15.5:0/1634571779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aec88ce070 msgr2=0x55aec8c8ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:06.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.631+0000 7fc205bdc740 1 --2- 172.21.15.5:0/1634571779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aec88ce070 0x55aec8c8ad70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc1f0009d20 tx=0x7fc1f0004ab0 comp rx=0 tx=0).stop 2024-08-31T05:34:06.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.631+0000 7fc205bdc740 1 -- 172.21.15.5:0/1634571779 shutdown_connections 2024-08-31T05:34:06.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.631+0000 7fc205bdc740 1 --2- 172.21.15.5:0/1634571779 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55aec888c9f0 0x55aec8c90ee0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:06.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.631+0000 7fc205bdc740 1 --2- 172.21.15.5:0/1634571779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aec88ce070 0x55aec8c8ad70 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:06.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.631+0000 7fc205bdc740 1 --2- 172.21.15.5:0/1634571779 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aec88ad390 0x55aec8c7efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:06.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.631+0000 7fc205bdc740 1 --2- 172.21.15.5:0/1634571779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aec88a51b0 0x55aec8c7ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:06.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.631+0000 7fc1e0ff9640 0 client.26323 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:34:06.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.631+0000 7fc205bdc740 1 -- 172.21.15.5:0/1634571779 >> 172.21.15.5:0/1634571779 conn(0x55aec88c2460 msgr2=0x55aec8c76490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:06.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.631+0000 7fc205bdc740 1 -- 172.21.15.5:0/1634571779 shutdown_connections 2024-08-31T05:34:06.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.631+0000 7fc205bdc740 1 -- 172.21.15.5:0/1634571779 wait complete. 2024-08-31T05:34:06.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.632+0000 7fc205bdc740 20 client.26323 trim_cache size 0 max 16384 2024-08-31T05:34:06.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.651+0000 7fc205bdc740 1 Processor -- start 2024-08-31T05:34:06.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.651+0000 7fc205bdc740 1 -- start start 2024-08-31T05:34:06.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.651+0000 7fc205bdc740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aec88a51b0 0x55aec8c76b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:06.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.651+0000 7fc205bdc740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aec88ad390 0x55aec8c7e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:06.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.651+0000 7fc205bdc740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aec88ce070 0x55aec8c7bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:06.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.651+0000 7fc205bdc740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f81b2e30 con 0x55aec88a51b0 2024-08-31T05:34:06.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.651+0000 7fc205bdc740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f81b4970 con 0x55aec88ce070 2024-08-31T05:34:06.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.651+0000 7fc205bdc740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f81b3500 con 0x55aec88ad390 2024-08-31T05:34:06.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.651+0000 7fc1fd403640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aec88a51b0 0x55aec8c76b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:06.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.651+0000 7fc1fd403640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aec88a51b0 0x55aec8c76b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41068/0 (socket says 172.21.15.5:41068) 2024-08-31T05:34:06.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.651+0000 7fc1fcc02640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aec88ad390 0x55aec8c7e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:06.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.651+0000 7fc1fd403640 1 -- 172.21.15.5:0/3125421256 learned_addr learned my addr 172.21.15.5:0/3125421256 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:06.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.651+0000 7fc1fdc04640 1 --2- 172.21.15.5:0/3125421256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aec88ce070 0x55aec8c7bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:06.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.652+0000 7fc1fcc02640 1 -- 172.21.15.5:0/3125421256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aec88ce070 msgr2=0x55aec8c7bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:06.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.652+0000 7fc1fcc02640 1 --2- 172.21.15.5:0/3125421256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aec88ce070 0x55aec8c7bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:06.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.652+0000 7fc1fcc02640 1 -- 172.21.15.5:0/3125421256 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aec88a51b0 msgr2=0x55aec8c76b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:06.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.652+0000 7fc1fcc02640 1 --2- 172.21.15.5:0/3125421256 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aec88a51b0 0x55aec8c76b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:06.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.652+0000 7fc1fcc02640 1 -- 172.21.15.5:0/3125421256 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aec8c7d9e0 con 0x55aec88ad390 2024-08-31T05:34:06.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.652+0000 7fc1fd403640 1 --2- 172.21.15.5:0/3125421256 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aec88a51b0 0x55aec8c76b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:34:06.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.652+0000 7fc1fdc04640 1 --2- 172.21.15.5:0/3125421256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aec88ce070 0x55aec8c7bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:34:06.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.652+0000 7fc1fcc02640 1 --2- 172.21.15.5:0/3125421256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aec88ad390 0x55aec8c7e9f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc1e800c6a0 tx=0x7fc1e8005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fdfd0a0de74de8b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:06.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.652+0000 7fc1e2ffd640 1 -- 172.21.15.5:0/3125421256 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e80ab7f0 con 0x55aec88ad390 2024-08-31T05:34:06.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.652+0000 7fc1e2ffd640 1 -- 172.21.15.5:0/3125421256 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1e80046c0 con 0x55aec88ad390 2024-08-31T05:34:06.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.652+0000 7fc1e2ffd640 1 -- 172.21.15.5:0/3125421256 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e80e3570 con 0x55aec88ad390 2024-08-31T05:34:06.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.653+0000 7fc205bdc740 1 -- 172.21.15.5:0/3125421256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aec88ad390 msgr2=0x55aec8c7e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:06.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.653+0000 7fc205bdc740 1 --2- 172.21.15.5:0/3125421256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aec88ad390 0x55aec8c7e9f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc1e800c6a0 tx=0x7fc1e8005880 comp rx=0 tx=0).stop 2024-08-31T05:34:06.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.653+0000 7fc205bdc740 1 -- 172.21.15.5:0/3125421256 shutdown_connections 2024-08-31T05:34:06.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.653+0000 7fc205bdc740 1 --2- 172.21.15.5:0/3125421256 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aec88ce070 0x55aec8c7bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:06.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.653+0000 7fc205bdc740 1 --2- 172.21.15.5:0/3125421256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aec88ad390 0x55aec8c7e9f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:06.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.653+0000 7fc205bdc740 1 --2- 172.21.15.5:0/3125421256 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aec88a51b0 0x55aec8c76b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:06.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.653+0000 7fc205bdc740 1 -- 172.21.15.5:0/3125421256 >> 172.21.15.5:0/3125421256 conn(0x55aec88c2460 msgr2=0x55aec8c76400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:06.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.653+0000 7fc205bdc740 1 -- 172.21.15.5:0/3125421256 shutdown_connections 2024-08-31T05:34:06.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.653+0000 7fc205bdc740 1 -- 172.21.15.5:0/3125421256 wait complete. 2024-08-31T05:34:06.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.653+0000 7fc205bdc740 1 -- start start 2024-08-31T05:34:06.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.653+0000 7fc205bdc740 1 Processor -- start 2024-08-31T05:34:06.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.654+0000 7fc205bdc740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aec88a51b0 0x55aec8c82fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:06.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.654+0000 7fc205bdc740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aec88ad390 0x55aec8c83520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:06.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.654+0000 7fc205bdc740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aec88ce070 0x55aec8cfa8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:06.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.654+0000 7fc205bdc740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f81b42a0 con 0x55aec88ad390 2024-08-31T05:34:06.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.654+0000 7fc205bdc740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f81b3bd0 con 0x55aec88a51b0 2024-08-31T05:34:06.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.654+0000 7fc205bdc740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f81b0e10 con 0x55aec88ce070 2024-08-31T05:34:06.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.654+0000 7fc205bdc740 10 client.0 _ll_register_callbacks cb 0x7fc1f0009be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:34:06.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.654+0000 7fc1fcc02640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aec88ad390 0x55aec8c83520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:06.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.654+0000 7fc1fd403640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aec88a51b0 0x55aec8c82fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:06.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.654+0000 7fc1fcc02640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aec88ad390 0x55aec8c83520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41076/0 (socket says 172.21.15.5:41076) 2024-08-31T05:34:06.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.654+0000 7fc1fcc02640 1 -- 172.21.15.5:0/145645704 learned_addr learned my addr 172.21.15.5:0/145645704 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:06.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.654+0000 7fc1fdc04640 1 --2- 172.21.15.5:0/145645704 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aec88ce070 0x55aec8cfa8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:06.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.654+0000 7fc1fd403640 1 -- 172.21.15.5:0/145645704 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aec88ce070 msgr2=0x55aec8cfa8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:06.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.654+0000 7fc1fd403640 1 --2- 172.21.15.5:0/145645704 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aec88ce070 0x55aec8cfa8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:06.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.654+0000 7fc1fd403640 1 -- 172.21.15.5:0/145645704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aec88ad390 msgr2=0x55aec8c83520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:06.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.654+0000 7fc1fd403640 1 --2- 172.21.15.5:0/145645704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aec88ad390 0x55aec8c83520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:06.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.654+0000 7fc1fd403640 1 -- 172.21.15.5:0/145645704 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aec8c83df0 con 0x55aec88a51b0 2024-08-31T05:34:06.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.654+0000 7fc1fcc02640 1 --2- 172.21.15.5:0/145645704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aec88ad390 0x55aec8c83520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:34:06.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.655+0000 7fc1fd403640 1 --2- 172.21.15.5:0/145645704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aec88a51b0 0x55aec8c82fe0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc1f4005ec0 tx=0x7fc1f4009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ffe25662c9b5a22 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:06.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.655+0000 7fc1e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:34:06.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.655+0000 7fc1e0ff9640 1 -- 172.21.15.5:0/145645704 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f4035040 con 0x55aec88a51b0 2024-08-31T05:34:06.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.655+0000 7fc1e0ff9640 1 -- 172.21.15.5:0/145645704 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fc1f40046e0 con 0x55aec88a51b0 2024-08-31T05:34:06.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.655+0000 7fc205bdc740 1 -- 172.21.15.5:0/145645704 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55aec8be8020 con 0x55aec88a51b0 2024-08-31T05:34:06.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.655+0000 7fc1e0ff9640 1 -- 172.21.15.5:0/145645704 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc1f40048e0 con 0x55aec88a51b0 2024-08-31T05:34:06.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.655+0000 7fc205bdc740 10 client.26315 fetch_fsmap learned FSMap version 34 2024-08-31T05:34:06.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.655+0000 7fc205bdc740 1 -- 172.21.15.5:0/145645704 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55aec8cfbe70 con 0x55aec88a51b0 2024-08-31T05:34:06.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.655+0000 7fc1e0ff9640 1 -- 172.21.15.5:0/145645704 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55aec8be8020 con 0x55aec88a51b0 2024-08-31T05:34:06.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.656+0000 7fc1e0ff9640 1 -- 172.21.15.5:0/145645704 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fc1f4003c30 con 0x55aec88a51b0 2024-08-31T05:34:06.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.656+0000 7fc205bdc740 10 client.26315 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:34:06.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.656+0000 7fc205bdc740 10 client.26315 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:34:06.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.656+0000 7fc205bdc740 20 client.26315 populate_metadata read hostname 'smithi005' 2024-08-31T05:34:06.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.656+0000 7fc205bdc740 1 --2- 172.21.15.5:0/145645704 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55aec8861da0 0x55aec8cfe1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:06.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.656+0000 7fc205bdc740 4 client.26315 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T05:34:06.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.656+0000 7fc205bdc740 1 -- 172.21.15.5:0/145645704 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55aec8be5760 con 0x55aec8861da0 2024-08-31T05:34:06.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.656+0000 7fc1fcc02640 1 --2- 172.21.15.5:0/145645704 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55aec8861da0 0x55aec8cfe1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:06.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.656+0000 7fc1e0ff9640 10 client.26315 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:34:06.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.656+0000 7fc1fcc02640 1 --2- 172.21.15.5:0/145645704 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55aec8861da0 0x55aec8cfe1c0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a348ac226319dc81 server_cookie=ed546e95cf027ef0 in_seq=0 out_seq=0 2024-08-31T05:34:06.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.657+0000 7fc1e0ff9640 1 -- 172.21.15.5:0/145645704 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1990 (crc 0 0 0) 0x55aec8be5760 con 0x55aec8861da0 2024-08-31T05:34:06.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.657+0000 7fc1e0ff9640 10 client.26315 handle_command_reply: tid=0 2024-08-31T05:34:06.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.657+0000 7fc205bdc740 1 client.26315 shutdown 2024-08-31T05:34:06.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.657+0000 7fc205bdc740 1 -- 172.21.15.5:0/145645704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aec88a51b0 msgr2=0x55aec8c82fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:06.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.657+0000 7fc205bdc740 1 --2- 172.21.15.5:0/145645704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aec88a51b0 0x55aec8c82fe0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc1f4005ec0 tx=0x7fc1f4009260 comp rx=0 tx=0).stop 2024-08-31T05:34:06.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.657+0000 7fc205bdc740 1 -- 172.21.15.5:0/145645704 shutdown_connections 2024-08-31T05:34:06.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.657+0000 7fc205bdc740 1 --2- 172.21.15.5:0/145645704 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55aec8861da0 0x55aec8cfe1c0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:06.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.657+0000 7fc1e0ff9640 0 client.26315 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:34:06.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.657+0000 7fc205bdc740 1 --2- 172.21.15.5:0/145645704 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aec88ce070 0x55aec8cfa8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:06.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.657+0000 7fc205bdc740 1 --2- 172.21.15.5:0/145645704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aec88ad390 0x55aec8c83520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:06.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.657+0000 7fc205bdc740 1 --2- 172.21.15.5:0/145645704 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aec88a51b0 0x55aec8c82fe0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:06.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.657+0000 7fc205bdc740 1 -- 172.21.15.5:0/145645704 >> 172.21.15.5:0/145645704 conn(0x55aec88c2460 msgr2=0x55aec8c7ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:06.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.657+0000 7fc205bdc740 1 -- 172.21.15.5:0/145645704 shutdown_connections 2024-08-31T05:34:06.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.657+0000 7fc205bdc740 1 -- 172.21.15.5:0/145645704 wait complete. 2024-08-31T05:34:06.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.657+0000 7fc205bdc740 20 client.26315 trim_cache size 0 max 16384 2024-08-31T05:34:06.666 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:34:06.666 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T05:34:06.666 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2024-08-31T05:34:06.667 INFO:teuthology.orchestra.run.smithi005.stdout: "0bb67292-013a-40c7-b5fc-810bdd9715d8": { 2024-08-31T05:34:06.667 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:34:06.667 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "0bb67292-013a-40c7-b5fc-810bdd9715d8", 2024-08-31T05:34:06.667 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2024-08-31T05:34:06.667 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:34:06.667 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:34:06.667 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_stats": { 2024-08-31T05:34:06.667 INFO:teuthology.orchestra.run.smithi005.stdout: "0bb67292-013a-40c7-b5fc-810bdd9715d8": { 2024-08-31T05:34:06.667 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:34:04.586008+0000", 2024-08-31T05:34:06.668 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:34:06.668 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:34:06.668 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:34:06.668 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:34:06.668 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:34:06.668 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:34:06.668 INFO:teuthology.orchestra.run.smithi005.stdout: "728a42ca-bbef-4151-830f-5fdd411d8fa0": { 2024-08-31T05:34:06.668 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:32:30.554906+0000", 2024-08-31T05:34:06.668 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:34:06.668 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:34:06.669 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:34:06.669 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:34:06.669 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:34:06.669 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:34:06.669 INFO:teuthology.orchestra.run.smithi005.stdout: "2445fc42-b797-434f-b380-e2da985b4d98": { 2024-08-31T05:34:06.669 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:33:17.681453+0000", 2024-08-31T05:34:06.669 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:34:06.669 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:34:06.669 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:34:06.669 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:34:06.670 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:34:06.670 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:34:06.670 INFO:teuthology.orchestra.run.smithi005.stdout: "cda92ac0-b35f-47a5-a3a5-471c888462a5": { 2024-08-31T05:34:06.670 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:53.103905+0000", 2024-08-31T05:34:06.670 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:34:06.670 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:34:06.670 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:34:06.670 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:34:06.670 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:34:06.670 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:34:06.670 INFO:teuthology.orchestra.run.smithi005.stdout: "ece37b07-9ab2-45f8-bc33-2755a07aac0b": { 2024-08-31T05:34:06.670 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:31:41.782407+0000", 2024-08-31T05:34:06.670 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:34:06.671 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:34:06.671 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:34:06.671 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:34:06.671 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:34:06.671 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:34:06.671 INFO:teuthology.orchestra.run.smithi005.stdout: "75d84398-5d9c-4872-b879-2fbce045fa71": { 2024-08-31T05:34:06.671 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:06.642335+0000", 2024-08-31T05:34:06.671 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:34:06.671 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:34:06.671 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:34:06.671 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:34:06.672 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:34:06.672 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:34:06.672 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:34:06.672 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:34:06.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.658+0000 7fc1ff667640 1 -- 172.21.15.5:0/154246112 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc1e40b4ca0 msgr2=0x7fc1e40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:06.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.658+0000 7fc1ff667640 1 --2- 172.21.15.5:0/154246112 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc1e40b4ca0 0x7fc1e40b71b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc1f0009fd0 tx=0x7fc1f0009500 comp rx=0 tx=0).stop 2024-08-31T05:34:06.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.658+0000 7fc1ff667640 1 -- 172.21.15.5:0/154246112 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc1f8108140 msgr2=0x7fc1f819b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:06.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.658+0000 7fc1ff667640 1 --2- 172.21.15.5:0/154246112 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc1f8108140 0x7fc1f819b5d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc1e800e9c0 tx=0x7fc1e800ee80 comp rx=0 tx=0).stop 2024-08-31T05:34:06.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.658+0000 7fc1ff667640 1 -- 172.21.15.5:0/154246112 shutdown_connections 2024-08-31T05:34:06.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.658+0000 7fc1ff667640 1 --2- 172.21.15.5:0/154246112 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc1e40b4ca0 0x7fc1e40b71b0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:06.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.658+0000 7fc1ff667640 1 --2- 172.21.15.5:0/154246112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1f8108a90 0x7fc1f819bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:06.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.658+0000 7fc1ff667640 1 --2- 172.21.15.5:0/154246112 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc1f8108140 0x7fc1f819b5d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:06.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.658+0000 7fc1ff667640 1 --2- 172.21.15.5:0/154246112 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc1f8102800 0x7fc1f819b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:06.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.658+0000 7fc1ff667640 1 -- 172.21.15.5:0/154246112 >> 172.21.15.5:0/154246112 conn(0x7fc1f80794d0 msgr2=0x7fc1f81011d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:06.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.658+0000 7fc1ff667640 1 -- 172.21.15.5:0/154246112 shutdown_connections 2024-08-31T05:34:06.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:06.658+0000 7fc1ff667640 1 -- 172.21.15.5:0/154246112 wait complete. 2024-08-31T05:34:06.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:34:06 smithi050 ceph-mon[22146]: pgmap v469: 129 pgs: 129 active+clean; 221 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.1 MiB/s wr, 311 op/s 2024-08-31T05:34:06.915 INFO:tasks.workunit.client.0.smithi005.stdout: 1 433364 13.00 MB/sec execute 54 sec latency 47.573 ms 2024-08-31T05:34:06.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:34:06 smithi005 ceph-mon[18602]: pgmap v469: 129 pgs: 129 active+clean; 221 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.1 MiB/s wr, 311 op/s 2024-08-31T05:34:07.085 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:34:06 smithi070 ceph-mon[22316]: pgmap v469: 129 pgs: 129 active+clean; 221 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.1 MiB/s wr, 311 op/s 2024-08-31T05:34:07.743 INFO:tasks.cephfs.filesystem:scrub status for tag:0bb67292-013a-40c7-b5fc-810bdd9715d8 - {'path': '/', 'tag': '0bb67292-013a-40c7-b5fc-810bdd9715d8', 'options': 'recursive,force'} 2024-08-31T05:34:07.915 INFO:tasks.workunit.client.0.smithi005.stdout: 1 435356 12.91 MB/sec execute 55 sec latency 83.138 ms 2024-08-31T05:34:08.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:34:08 smithi050 ceph-mon[22146]: pgmap v470: 129 pgs: 129 active+clean; 221 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.3 MiB/s wr, 258 op/s 2024-08-31T05:34:08.915 INFO:tasks.workunit.client.0.smithi005.stdout: 1 437354 12.91 MB/sec execute 56 sec latency 19.684 ms 2024-08-31T05:34:08.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:34:08 smithi005 ceph-mon[18602]: pgmap v470: 129 pgs: 129 active+clean; 221 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.3 MiB/s wr, 258 op/s 2024-08-31T05:34:09.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:34:08 smithi070 ceph-mon[22316]: pgmap v470: 129 pgs: 129 active+clean; 221 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.3 MiB/s wr, 258 op/s 2024-08-31T05:34:09.915 INFO:tasks.workunit.client.0.smithi005.stdout: 1 440291 12.99 MB/sec execute 57 sec latency 9.075 ms 2024-08-31T05:34:10.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:34:10 smithi050 ceph-mon[22146]: pgmap v471: 129 pgs: 129 active+clean; 228 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.4 MiB/s wr, 339 op/s 2024-08-31T05:34:10.915 INFO:tasks.workunit.client.0.smithi005.stdout: 1 443030 12.99 MB/sec execute 58 sec latency 13.887 ms 2024-08-31T05:34:10.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:34:10 smithi005 ceph-mon[18602]: pgmap v471: 129 pgs: 129 active+clean; 228 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.4 MiB/s wr, 339 op/s 2024-08-31T05:34:11.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:34:10 smithi070 ceph-mon[22316]: pgmap v471: 129 pgs: 129 active+clean; 228 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.4 MiB/s wr, 339 op/s 2024-08-31T05:34:11.915 INFO:tasks.workunit.client.0.smithi005.stdout: 1 445384 12.97 MB/sec execute 59 sec latency 11.372 ms 2024-08-31T05:34:12.888 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:34:12 smithi070 ceph-mon[22316]: pgmap v472: 129 pgs: 129 active+clean; 228 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.6 MiB/s wr, 277 op/s 2024-08-31T05:34:12.888 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:34:12 smithi070 ceph-mon[22316]: scrub summary: idle 2024-08-31T05:34:12.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:34:12 smithi050 ceph-mon[22146]: pgmap v472: 129 pgs: 129 active+clean; 228 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.6 MiB/s wr, 277 op/s 2024-08-31T05:34:12.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:34:12 smithi050 ceph-mon[22146]: scrub summary: idle 2024-08-31T05:34:12.915 INFO:tasks.workunit.client.0.smithi005.stdout: 1 447484 12.98 MB/sec execute 60 sec latency 48.152 ms 2024-08-31T05:34:12.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:34:12 smithi005 ceph-mon[18602]: pgmap v472: 129 pgs: 129 active+clean; 228 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.6 MiB/s wr, 277 op/s 2024-08-31T05:34:12.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:34:12 smithi005 ceph-mon[18602]: scrub summary: idle 2024-08-31T05:34:13.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:34:13 smithi050 ceph-mon[22146]: scrub summary: idle 2024-08-31T05:34:13.915 INFO:tasks.workunit.client.0.smithi005.stdout: 1 449845 12.96 MB/sec execute 61 sec latency 67.117 ms 2024-08-31T05:34:13.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:34:13 smithi005 ceph-mon[18602]: scrub summary: idle 2024-08-31T05:34:14.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:34:13 smithi070 ceph-mon[22316]: scrub summary: idle 2024-08-31T05:34:14.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:34:14 smithi050 ceph-mon[22146]: pgmap v473: 129 pgs: 129 active+clean; 228 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.6 MiB/s wr, 276 op/s 2024-08-31T05:34:14.915 INFO:tasks.workunit.client.0.smithi005.stdout: 1 452004 12.95 MB/sec execute 62 sec latency 14.452 ms 2024-08-31T05:34:14.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:34:14 smithi005 ceph-mon[18602]: pgmap v473: 129 pgs: 129 active+clean; 228 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.6 MiB/s wr, 276 op/s 2024-08-31T05:34:15.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:34:14 smithi070 ceph-mon[22316]: pgmap v473: 129 pgs: 129 active+clean; 228 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.6 MiB/s wr, 276 op/s 2024-08-31T05:34:15.915 INFO:tasks.workunit.client.0.smithi005.stdout: 1 454657 12.97 MB/sec execute 63 sec latency 15.150 ms 2024-08-31T05:34:16.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:34:16 smithi050 ceph-mon[22146]: pgmap v474: 129 pgs: 129 active+clean; 239 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.2 MiB/s wr, 356 op/s 2024-08-31T05:34:16.915 INFO:tasks.workunit.client.0.smithi005.stdout: 1 457818 13.06 MB/sec execute 64 sec latency 11.648 ms 2024-08-31T05:34:16.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:34:16 smithi005 ceph-mon[18602]: pgmap v474: 129 pgs: 129 active+clean; 239 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.2 MiB/s wr, 356 op/s 2024-08-31T05:34:17.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:34:16 smithi070 ceph-mon[22316]: pgmap v474: 129 pgs: 129 active+clean; 239 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.2 MiB/s wr, 356 op/s 2024-08-31T05:34:17.915 INFO:tasks.workunit.client.0.smithi005.stdout: 1 459246 13.20 MB/sec execute 65 sec latency 51.684 ms 2024-08-31T05:34:18.038 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.033+0000 7f0063fb0640 1 -- 172.21.15.5:0/3840111894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f005c109c30 msgr2=0x7f005c110480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:18.038 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.033+0000 7f0063fb0640 1 --2- 172.21.15.5:0/3840111894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f005c109c30 0x7f005c110480 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f0054009ca0 tx=0x7f005402a8c0 comp rx=0 tx=0).stop 2024-08-31T05:34:18.038 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.033+0000 7f0063fb0640 1 -- 172.21.15.5:0/3840111894 shutdown_connections 2024-08-31T05:34:18.038 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.033+0000 7f0063fb0640 1 --2- 172.21.15.5:0/3840111894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f005c109c30 0x7f005c110480 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:18.038 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.033+0000 7f0063fb0640 1 --2- 172.21.15.5:0/3840111894 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f005c1092e0 0x7f005c1096f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:18.038 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.033+0000 7f0063fb0640 1 --2- 172.21.15.5:0/3840111894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f005c101dc0 0x7f005c1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:18.038 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.033+0000 7f0063fb0640 1 -- 172.21.15.5:0/3840111894 >> 172.21.15.5:0/3840111894 conn(0x7f005c079bf0 msgr2=0x7f005c07a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:18.038 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.033+0000 7f0063fb0640 1 -- 172.21.15.5:0/3840111894 shutdown_connections 2024-08-31T05:34:18.038 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.033+0000 7f0063fb0640 1 -- 172.21.15.5:0/3840111894 wait complete. 2024-08-31T05:34:18.039 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.034+0000 7f0063fb0640 1 Processor -- start 2024-08-31T05:34:18.039 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.034+0000 7f0063fb0640 1 -- start start 2024-08-31T05:34:18.039 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.034+0000 7f0063fb0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f005c101dc0 0x7f005c19a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:18.039 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.034+0000 7f0063fb0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f005c1092e0 0x7f005c19a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:18.039 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.034+0000 7f0063fb0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f005c109c30 0x7f005c19fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:18.039 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.034+0000 7f0063fb0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f005c1138e0 con 0x7f005c1092e0 2024-08-31T05:34:18.039 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.034+0000 7f0063fb0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f005c113760 con 0x7f005c109c30 2024-08-31T05:34:18.039 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.034+0000 7f0063fb0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f005c113a60 con 0x7f005c101dc0 2024-08-31T05:34:18.039 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.034+0000 7f006154b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f005c1092e0 0x7f005c19a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:18.039 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.034+0000 7f006154b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f005c1092e0 0x7f005c19a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54916/0 (socket says 172.21.15.5:54916) 2024-08-31T05:34:18.039 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.034+0000 7f006154b640 1 -- 172.21.15.5:0/3429036298 learned_addr learned my addr 172.21.15.5:0/3429036298 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:18.039 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.034+0000 7f0061d4c640 1 --2- 172.21.15.5:0/3429036298 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f005c101dc0 0x7f005c19a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:18.039 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.034+0000 7f006254d640 1 --2- 172.21.15.5:0/3429036298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f005c109c30 0x7f005c19fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:18.039 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.035+0000 7f006154b640 1 -- 172.21.15.5:0/3429036298 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f005c101dc0 msgr2=0x7f005c19a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:18.040 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.035+0000 7f006154b640 1 --2- 172.21.15.5:0/3429036298 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f005c101dc0 0x7f005c19a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:18.040 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.035+0000 7f006154b640 1 -- 172.21.15.5:0/3429036298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f005c109c30 msgr2=0x7f005c19fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:18.040 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.035+0000 7f006154b640 1 --2- 172.21.15.5:0/3429036298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f005c109c30 0x7f005c19fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:18.040 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.035+0000 7f006154b640 1 -- 172.21.15.5:0/3429036298 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f005c1a0270 con 0x7f005c1092e0 2024-08-31T05:34:18.040 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.035+0000 7f006154b640 1 --2- 172.21.15.5:0/3429036298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f005c1092e0 0x7f005c19a8e0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f004c00e9c0 tx=0x7f004c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:18.040 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.035+0000 7f0052ffd640 1 -- 172.21.15.5:0/3429036298 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c00ccc0 con 0x7f005c1092e0 2024-08-31T05:34:18.040 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.035+0000 7f0063fb0640 1 -- 172.21.15.5:0/3429036298 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f005c1a0560 con 0x7f005c1092e0 2024-08-31T05:34:18.040 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.035+0000 7f0052ffd640 1 -- 172.21.15.5:0/3429036298 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f004c0054d0 con 0x7f005c1092e0 2024-08-31T05:34:18.040 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.035+0000 7f0052ffd640 1 -- 172.21.15.5:0/3429036298 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c010430 con 0x7f005c1092e0 2024-08-31T05:34:18.040 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.035+0000 7f0063fb0640 1 -- 172.21.15.5:0/3429036298 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f005c1a6cf0 con 0x7f005c1092e0 2024-08-31T05:34:18.046 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.038+0000 7f006aff4740 1 Processor -- start 2024-08-31T05:34:18.046 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.038+0000 7f006aff4740 1 -- start start 2024-08-31T05:34:18.047 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.038+0000 7f0052ffd640 1 -- 172.21.15.5:0/3429036298 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f004c005020 con 0x7f005c1092e0 2024-08-31T05:34:18.047 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.038+0000 7f006aff4740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591a2a741b0 0x5591a2e17ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:18.047 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.038+0000 7f006aff4740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591a2a4b2f0 0x5591a2e18000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:18.047 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.038+0000 7f006aff4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5591a2a534d0 0x5591a2e18540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:18.047 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.038+0000 7f006aff4740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5591a2d8d000 con 0x5591a2a741b0 2024-08-31T05:34:18.047 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.038+0000 7f006aff4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5591a2d7c590 con 0x5591a2a534d0 2024-08-31T05:34:18.047 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.038+0000 7f006aff4740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5591a2d80540 con 0x5591a2a4b2f0 2024-08-31T05:34:18.047 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.038+0000 7f006254d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591a2a741b0 0x5591a2e17ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:18.047 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.038+0000 7f006254d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591a2a741b0 0x5591a2e17ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54918/0 (socket says 172.21.15.5:54918) 2024-08-31T05:34:18.047 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.038+0000 7f006254d640 1 -- 172.21.15.5:0/1129063596 learned_addr learned my addr 172.21.15.5:0/1129063596 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:18.048 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.038+0000 7f0061d4c640 1 --2- 172.21.15.5:0/1129063596 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591a2a4b2f0 0x5591a2e18000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:18.048 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.038+0000 7f006154b640 1 --2- 172.21.15.5:0/1129063596 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5591a2a534d0 0x5591a2e18540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:18.048 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.039+0000 7f006254d640 1 -- 172.21.15.5:0/1129063596 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591a2a4b2f0 msgr2=0x5591a2e18000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:18.048 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.039+0000 7f006254d640 1 --2- 172.21.15.5:0/1129063596 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591a2a4b2f0 0x5591a2e18000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:18.048 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.039+0000 7f006254d640 1 -- 172.21.15.5:0/1129063596 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5591a2a534d0 msgr2=0x5591a2e18540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:18.048 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.039+0000 7f006254d640 1 --2- 172.21.15.5:0/1129063596 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5591a2a534d0 0x5591a2e18540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:18.048 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.039+0000 7f006254d640 1 -- 172.21.15.5:0/1129063596 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591a2adf790 con 0x5591a2a741b0 2024-08-31T05:34:18.048 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.039+0000 7f006254d640 1 --2- 172.21.15.5:0/1129063596 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591a2a741b0 0x5591a2e17ac0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f005402f4c0 tx=0x7f0054009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a728c0802c4bdda7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:18.048 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.039+0000 7f0052ffd640 1 --2- 172.21.15.5:0/3429036298 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f00480b4ca0 0x7f00480b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:18.048 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.039+0000 7f0047fff640 1 -- 172.21.15.5:0/1129063596 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0054031cf0 con 0x5591a2a741b0 2024-08-31T05:34:18.048 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.039+0000 7f0047fff640 1 -- 172.21.15.5:0/1129063596 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0054036030 con 0x5591a2a741b0 2024-08-31T05:34:18.048 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.039+0000 7f0047fff640 1 -- 172.21.15.5:0/1129063596 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00540042a0 con 0x5591a2a741b0 2024-08-31T05:34:18.048 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.039+0000 7f0061d4c640 1 --2- 172.21.15.5:0/3429036298 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f00480b4ca0 0x7f00480b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:18.049 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.039+0000 7f0052ffd640 1 -- 172.21.15.5:0/3429036298 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f004c0e5b80 con 0x7f005c1092e0 2024-08-31T05:34:18.049 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.040+0000 7f006aff4740 1 -- 172.21.15.5:0/1129063596 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591a2a741b0 msgr2=0x5591a2e17ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:18.049 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.040+0000 7f0061d4c640 1 --2- 172.21.15.5:0/3429036298 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f00480b4ca0 0x7f00480b71b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x5591a2e16740 tx=0x7f005800b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:18.049 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.040+0000 7f006aff4740 1 --2- 172.21.15.5:0/1129063596 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591a2a741b0 0x5591a2e17ac0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f005402f4c0 tx=0x7f0054009800 comp rx=0 tx=0).stop 2024-08-31T05:34:18.049 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.040+0000 7f006aff4740 1 -- 172.21.15.5:0/1129063596 shutdown_connections 2024-08-31T05:34:18.049 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.040+0000 7f006aff4740 1 --2- 172.21.15.5:0/1129063596 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5591a2a534d0 0x5591a2e18540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:18.049 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.040+0000 7f006aff4740 1 --2- 172.21.15.5:0/1129063596 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591a2a4b2f0 0x5591a2e18000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:18.049 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.040+0000 7f006aff4740 1 --2- 172.21.15.5:0/1129063596 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591a2a741b0 0x5591a2e17ac0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:18.049 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.040+0000 7f006aff4740 1 -- 172.21.15.5:0/1129063596 >> 172.21.15.5:0/1129063596 conn(0x5591a2a68300 msgr2=0x5591a2e159b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:18.049 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.040+0000 7f006aff4740 1 -- 172.21.15.5:0/1129063596 shutdown_connections 2024-08-31T05:34:18.049 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.040+0000 7f006aff4740 1 -- 172.21.15.5:0/1129063596 wait complete. 2024-08-31T05:34:18.049 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.041+0000 7f006aff4740 1 -- start start 2024-08-31T05:34:18.049 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.041+0000 7f006aff4740 1 Processor -- start 2024-08-31T05:34:18.049 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.041+0000 7f006aff4740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591a2a4b2f0 0x5591a2e235b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:18.050 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.041+0000 7f006aff4740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591a2a534d0 0x5591a2e23af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:18.050 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.041+0000 7f006aff4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5591a2a741b0 0x5591a2e2f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:18.050 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.041+0000 7f006aff4740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5591a2cb5ab0 con 0x5591a2a4b2f0 2024-08-31T05:34:18.050 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.041+0000 7f006aff4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5591a2d03680 con 0x5591a2a741b0 2024-08-31T05:34:18.050 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.041+0000 7f006aff4740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5591a2e26060 con 0x5591a2a534d0 2024-08-31T05:34:18.050 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.041+0000 7f006aff4740 10 client.0 _ll_register_callbacks cb 0x5591a2a8ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:34:18.050 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.041+0000 7f0061d4c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591a2a4b2f0 0x5591a2e235b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:18.050 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.041+0000 7f006154b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591a2a534d0 0x5591a2e23af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:18.050 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.041+0000 7f0061d4c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591a2a4b2f0 0x5591a2e235b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54922/0 (socket says 172.21.15.5:54922) 2024-08-31T05:34:18.050 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.041+0000 7f0061d4c640 1 -- 172.21.15.5:0/1799666545 learned_addr learned my addr 172.21.15.5:0/1799666545 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:18.050 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.042+0000 7f006254d640 1 --2- 172.21.15.5:0/1799666545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5591a2a741b0 0x5591a2e2f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:18.050 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.042+0000 7f0061d4c640 1 -- 172.21.15.5:0/1799666545 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591a2a534d0 msgr2=0x5591a2e23af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:18.050 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.042+0000 7f0061d4c640 1 --2- 172.21.15.5:0/1799666545 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591a2a534d0 0x5591a2e23af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:18.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.042+0000 7f0061d4c640 1 -- 172.21.15.5:0/1799666545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5591a2a741b0 msgr2=0x5591a2e2f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:18.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.042+0000 7f0061d4c640 1 --2- 172.21.15.5:0/1799666545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5591a2a741b0 0x5591a2e2f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:18.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.042+0000 7f0061d4c640 1 -- 172.21.15.5:0/1799666545 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591a2b58620 con 0x5591a2a4b2f0 2024-08-31T05:34:18.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.042+0000 7f006154b640 1 --2- 172.21.15.5:0/1799666545 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591a2a534d0 0x5591a2e23af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:34:18.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.042+0000 7f0061d4c640 1 --2- 172.21.15.5:0/1799666545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591a2a4b2f0 0x5591a2e235b0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f0058003c80 tx=0x7f00580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8198867d82eb6941 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:18.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.042+0000 7f00457fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:34:18.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.042+0000 7f00457fa640 1 -- 172.21.15.5:0/1799666545 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f005802c060 con 0x5591a2a4b2f0 2024-08-31T05:34:18.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.042+0000 7f00457fa640 1 -- 172.21.15.5:0/1799666545 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f0058017030 con 0x5591a2a4b2f0 2024-08-31T05:34:18.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.042+0000 7f006aff4740 1 -- 172.21.15.5:0/1799666545 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0054036030 con 0x5591a2a4b2f0 2024-08-31T05:34:18.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.042+0000 7f00457fa640 1 -- 172.21.15.5:0/1799666545 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f0058033050 con 0x5591a2a4b2f0 2024-08-31T05:34:18.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.042+0000 7f006aff4740 10 client.16734 fetch_fsmap learned FSMap version 34 2024-08-31T05:34:18.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.042+0000 7f006aff4740 1 -- 172.21.15.5:0/1799666545 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5591a2e32100 con 0x5591a2a4b2f0 2024-08-31T05:34:18.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.043+0000 7f00457fa640 1 -- 172.21.15.5:0/1799666545 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0054036030 con 0x5591a2a4b2f0 2024-08-31T05:34:18.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.043+0000 7f00457fa640 1 -- 172.21.15.5:0/1799666545 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f005801c3f0 con 0x5591a2a4b2f0 2024-08-31T05:34:18.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.043+0000 7f006aff4740 10 client.16734 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:34:18.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.043+0000 7f006aff4740 10 client.16734 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:34:18.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.043+0000 7f006aff4740 20 client.16734 populate_metadata read hostname 'smithi005' 2024-08-31T05:34:18.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.043+0000 7f006aff4740 1 --2- 172.21.15.5:0/1799666545 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5591a2a32d80 0x5591a2e356b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:18.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.043+0000 7f006aff4740 4 client.16734 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:34:18.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.043+0000 7f006aff4740 1 -- 172.21.15.5:0/1799666545 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5591a2d8ef50 con 0x5591a2a32d80 2024-08-31T05:34:18.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.043+0000 7f006154b640 1 --2- 172.21.15.5:0/1799666545 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5591a2a32d80 0x5591a2e356b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:18.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.044+0000 7f00457fa640 10 client.16734 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:34:18.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.044+0000 7f006154b640 1 --2- 172.21.15.5:0/1799666545 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5591a2a32d80 0x5591a2e356b0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=122649ead6e4f333 server_cookie=bb5e9df1942f4b57 in_seq=0 out_seq=0 2024-08-31T05:34:18.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.044+0000 7f00457fa640 1 -- 172.21.15.5:0/1799666545 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5591a2d8ef50 con 0x5591a2a32d80 2024-08-31T05:34:18.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.044+0000 7f00457fa640 10 client.16734 handle_command_reply: tid=0 2024-08-31T05:34:18.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.044+0000 7f006aff4740 1 client.16734 shutdown 2024-08-31T05:34:18.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.044+0000 7f006aff4740 1 -- 172.21.15.5:0/1799666545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591a2a4b2f0 msgr2=0x5591a2e235b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:18.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.044+0000 7f006aff4740 1 --2- 172.21.15.5:0/1799666545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591a2a4b2f0 0x5591a2e235b0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f0058003c80 tx=0x7f00580046c0 comp rx=0 tx=0).stop 2024-08-31T05:34:18.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.044+0000 7f006aff4740 1 -- 172.21.15.5:0/1799666545 shutdown_connections 2024-08-31T05:34:18.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.044+0000 7f006aff4740 1 --2- 172.21.15.5:0/1799666545 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5591a2a32d80 0x5591a2e356b0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:18.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.044+0000 7f006aff4740 1 --2- 172.21.15.5:0/1799666545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5591a2a741b0 0x5591a2e2f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:18.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.044+0000 7f006aff4740 1 --2- 172.21.15.5:0/1799666545 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591a2a534d0 0x5591a2e23af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:18.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.044+0000 7f00457fa640 0 client.16734 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:34:18.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.044+0000 7f006aff4740 1 --2- 172.21.15.5:0/1799666545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591a2a4b2f0 0x5591a2e235b0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:18.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.044+0000 7f006aff4740 1 -- 172.21.15.5:0/1799666545 >> 172.21.15.5:0/1799666545 conn(0x5591a2a68300 msgr2=0x5591a2e18af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:18.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.045+0000 7f006aff4740 1 -- 172.21.15.5:0/1799666545 shutdown_connections 2024-08-31T05:34:18.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.045+0000 7f006aff4740 1 -- 172.21.15.5:0/1799666545 wait complete. 2024-08-31T05:34:18.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.045+0000 7f006aff4740 20 client.16734 trim_cache size 0 max 16384 2024-08-31T05:34:18.063 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.059+0000 7f006aff4740 1 Processor -- start 2024-08-31T05:34:18.063 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.059+0000 7f006aff4740 1 -- start start 2024-08-31T05:34:18.063 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.060+0000 7f006aff4740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591a2a4b2f0 0x5591a2e3ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:18.063 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.060+0000 7f006aff4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5591a2a534d0 0x5591a2e3b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:18.064 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.060+0000 7f006aff4740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591a2a741b0 0x5591a2e2b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:18.064 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.060+0000 7f006aff4740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f005c1b0b20 con 0x5591a2a4b2f0 2024-08-31T05:34:18.064 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.060+0000 7f006aff4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f005c1b2660 con 0x5591a2a534d0 2024-08-31T05:34:18.064 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.060+0000 7f006aff4740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f005c1b11f0 con 0x5591a2a741b0 2024-08-31T05:34:18.064 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.060+0000 7f0061d4c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591a2a4b2f0 0x5591a2e3ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:18.064 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.060+0000 7f0061d4c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591a2a4b2f0 0x5591a2e3ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54924/0 (socket says 172.21.15.5:54924) 2024-08-31T05:34:18.064 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.060+0000 7f0061d4c640 1 -- 172.21.15.5:0/2291658450 learned_addr learned my addr 172.21.15.5:0/2291658450 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:18.064 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.060+0000 7f006254d640 1 --2- 172.21.15.5:0/2291658450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591a2a741b0 0x5591a2e2b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:18.064 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.060+0000 7f006154b640 1 --2- 172.21.15.5:0/2291658450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5591a2a534d0 0x5591a2e3b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:18.064 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.060+0000 7f0061d4c640 1 -- 172.21.15.5:0/2291658450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591a2a741b0 msgr2=0x5591a2e2b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:18.064 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.060+0000 7f0061d4c640 1 --2- 172.21.15.5:0/2291658450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591a2a741b0 0x5591a2e2b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:18.064 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.060+0000 7f0061d4c640 1 -- 172.21.15.5:0/2291658450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5591a2a534d0 msgr2=0x5591a2e3b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:18.065 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.060+0000 7f0061d4c640 1 --2- 172.21.15.5:0/2291658450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5591a2a534d0 0x5591a2e3b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:18.065 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.060+0000 7f0061d4c640 1 -- 172.21.15.5:0/2291658450 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591a2e19dc0 con 0x5591a2a4b2f0 2024-08-31T05:34:18.065 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.060+0000 7f006154b640 1 --2- 172.21.15.5:0/2291658450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5591a2a534d0 0x5591a2e3b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:34:18.065 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.060+0000 7f0061d4c640 1 --2- 172.21.15.5:0/2291658450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591a2a4b2f0 0x5591a2e3ae70 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f0058018040 tx=0x7f005801fd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81193cd8bb70b00c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:18.065 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.060+0000 7f00477fe640 1 -- 172.21.15.5:0/2291658450 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f005801ca30 con 0x5591a2a4b2f0 2024-08-31T05:34:18.065 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.060+0000 7f00477fe640 1 -- 172.21.15.5:0/2291658450 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0058005520 con 0x5591a2a4b2f0 2024-08-31T05:34:18.065 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.060+0000 7f00477fe640 1 -- 172.21.15.5:0/2291658450 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0058004990 con 0x5591a2a4b2f0 2024-08-31T05:34:18.065 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.061+0000 7f006aff4740 1 -- 172.21.15.5:0/2291658450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591a2a4b2f0 msgr2=0x5591a2e3ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:18.065 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.061+0000 7f006aff4740 1 --2- 172.21.15.5:0/2291658450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591a2a4b2f0 0x5591a2e3ae70 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f0058018040 tx=0x7f005801fd50 comp rx=0 tx=0).stop 2024-08-31T05:34:18.065 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.061+0000 7f006aff4740 1 -- 172.21.15.5:0/2291658450 shutdown_connections 2024-08-31T05:34:18.065 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.061+0000 7f006aff4740 1 --2- 172.21.15.5:0/2291658450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591a2a741b0 0x5591a2e2b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:18.065 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.061+0000 7f006aff4740 1 --2- 172.21.15.5:0/2291658450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5591a2a534d0 0x5591a2e3b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:18.065 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.061+0000 7f006aff4740 1 --2- 172.21.15.5:0/2291658450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591a2a4b2f0 0x5591a2e3ae70 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:18.066 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.061+0000 7f006aff4740 1 -- 172.21.15.5:0/2291658450 >> 172.21.15.5:0/2291658450 conn(0x5591a2a68300 msgr2=0x5591a2e1e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:18.066 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.061+0000 7f006aff4740 1 -- 172.21.15.5:0/2291658450 shutdown_connections 2024-08-31T05:34:18.066 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.061+0000 7f006aff4740 1 -- 172.21.15.5:0/2291658450 wait complete. 2024-08-31T05:34:18.066 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.061+0000 7f006aff4740 1 -- start start 2024-08-31T05:34:18.066 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.062+0000 7f006aff4740 1 Processor -- start 2024-08-31T05:34:18.069 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.062+0000 7f006aff4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5591a2a4b2f0 0x5591a2e29350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:18.069 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.062+0000 7f006aff4740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591a2a534d0 0x5591a2e29890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:18.069 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.062+0000 7f006aff4740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591a2a741b0 0x5591a2e29dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:18.069 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.062+0000 7f006aff4740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f005c1b1f90 con 0x5591a2a741b0 2024-08-31T05:34:18.069 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.062+0000 7f006aff4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f005c1b18c0 con 0x5591a2a4b2f0 2024-08-31T05:34:18.069 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.062+0000 7f006aff4740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f005c1aeb00 con 0x5591a2a534d0 2024-08-31T05:34:18.069 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.062+0000 7f006aff4740 10 client.0 _ll_register_callbacks cb 0x7f0058005c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:34:18.069 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.062+0000 7f006254d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591a2a741b0 0x5591a2e29dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:18.069 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.062+0000 7f006254d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591a2a741b0 0x5591a2e29dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54940/0 (socket says 172.21.15.5:54940) 2024-08-31T05:34:18.069 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.062+0000 7f006254d640 1 -- 172.21.15.5:0/4117085260 learned_addr learned my addr 172.21.15.5:0/4117085260 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:18.069 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.062+0000 7f006154b640 1 --2- 172.21.15.5:0/4117085260 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591a2a534d0 0x5591a2e29890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:18.069 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.062+0000 7f0061d4c640 1 --2- 172.21.15.5:0/4117085260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5591a2a4b2f0 0x5591a2e29350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:18.069 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.063+0000 7f006254d640 1 -- 172.21.15.5:0/4117085260 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591a2a534d0 msgr2=0x5591a2e29890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:18.070 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.063+0000 7f006254d640 1 --2- 172.21.15.5:0/4117085260 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591a2a534d0 0x5591a2e29890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:18.070 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.063+0000 7f006254d640 1 -- 172.21.15.5:0/4117085260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5591a2a4b2f0 msgr2=0x5591a2e29350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:18.070 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.063+0000 7f006254d640 1 --2- 172.21.15.5:0/4117085260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5591a2a4b2f0 0x5591a2e29350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:18.070 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.063+0000 7f006254d640 1 -- 172.21.15.5:0/4117085260 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591a2e9f0b0 con 0x5591a2a741b0 2024-08-31T05:34:18.070 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.063+0000 7f006154b640 1 --2- 172.21.15.5:0/4117085260 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591a2a534d0 0x5591a2e29890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:34:18.070 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.063+0000 7f006254d640 1 --2- 172.21.15.5:0/4117085260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591a2a741b0 0x5591a2e29dd0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f0054003d00 tx=0x7f00540094a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c6a1d5c23b34173 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:18.070 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.063+0000 7f00457fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:34:18.070 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.063+0000 7f00457fa640 1 -- 172.21.15.5:0/4117085260 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0054054030 con 0x5591a2a741b0 2024-08-31T05:34:18.070 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.063+0000 7f00457fa640 1 -- 172.21.15.5:0/4117085260 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f0054031450 con 0x5591a2a741b0 2024-08-31T05:34:18.070 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.063+0000 7f006aff4740 1 -- 172.21.15.5:0/4117085260 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0058005520 con 0x5591a2a741b0 2024-08-31T05:34:18.070 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.063+0000 7f00457fa640 1 -- 172.21.15.5:0/4117085260 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f005404a040 con 0x5591a2a741b0 2024-08-31T05:34:18.070 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.063+0000 7f006aff4740 10 client.16740 fetch_fsmap learned FSMap version 34 2024-08-31T05:34:18.070 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.063+0000 7f006aff4740 1 -- 172.21.15.5:0/4117085260 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5591a2ea0370 con 0x5591a2a741b0 2024-08-31T05:34:18.071 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.063+0000 7f00457fa640 1 -- 172.21.15.5:0/4117085260 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0058005520 con 0x5591a2a741b0 2024-08-31T05:34:18.071 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.063+0000 7f00457fa640 1 -- 172.21.15.5:0/4117085260 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f0054043070 con 0x5591a2a741b0 2024-08-31T05:34:18.071 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.064+0000 7f006aff4740 10 client.16740 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:34:18.071 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.064+0000 7f006aff4740 10 client.16740 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:34:18.071 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.064+0000 7f006aff4740 20 client.16740 populate_metadata read hostname 'smithi005' 2024-08-31T05:34:18.071 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.064+0000 7f006aff4740 1 --2- 172.21.15.5:0/4117085260 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5591a2a081c0 0x5591a2ea28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:18.071 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.064+0000 7f006aff4740 4 client.16740 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:34:18.071 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.064+0000 7f006aff4740 1 -- 172.21.15.5:0/4117085260 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5591a2d8a9f0 con 0x5591a2a081c0 2024-08-31T05:34:18.071 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.064+0000 7f0061d4c640 1 --2- 172.21.15.5:0/4117085260 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5591a2a081c0 0x5591a2ea28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:18.071 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.064+0000 7f00457fa640 10 client.16740 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:34:18.071 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.064+0000 7f0061d4c640 1 --2- 172.21.15.5:0/4117085260 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5591a2a081c0 0x5591a2ea28f0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6189485571e5921 server_cookie=5dc30247648aa5f1 in_seq=0 out_seq=0 2024-08-31T05:34:18.077 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.075+0000 7f00457fa640 1 -- 172.21.15.5:0/4117085260 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5591a2d8a9f0 con 0x5591a2a081c0 2024-08-31T05:34:18.077 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.075+0000 7f00457fa640 10 client.16740 handle_command_reply: tid=0 2024-08-31T05:34:18.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.075+0000 7f006aff4740 1 client.16740 shutdown 2024-08-31T05:34:18.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.075+0000 7f006aff4740 1 -- 172.21.15.5:0/4117085260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591a2a741b0 msgr2=0x5591a2e29dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:18.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.075+0000 7f006aff4740 1 --2- 172.21.15.5:0/4117085260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591a2a741b0 0x5591a2e29dd0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f0054003d00 tx=0x7f00540094a0 comp rx=0 tx=0).stop 2024-08-31T05:34:18.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.075+0000 7f006aff4740 1 -- 172.21.15.5:0/4117085260 shutdown_connections 2024-08-31T05:34:18.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.075+0000 7f006aff4740 1 --2- 172.21.15.5:0/4117085260 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5591a2a081c0 0x5591a2ea28f0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:18.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.075+0000 7f006aff4740 1 --2- 172.21.15.5:0/4117085260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5591a2a741b0 0x5591a2e29dd0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:18.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.075+0000 7f00457fa640 0 client.16740 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:34:18.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.075+0000 7f006aff4740 1 --2- 172.21.15.5:0/4117085260 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5591a2a534d0 0x5591a2e29890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:18.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.075+0000 7f006aff4740 1 --2- 172.21.15.5:0/4117085260 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5591a2a4b2f0 0x5591a2e29350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:18.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.075+0000 7f006aff4740 1 -- 172.21.15.5:0/4117085260 >> 172.21.15.5:0/4117085260 conn(0x5591a2a68300 msgr2=0x5591a2e24740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:18.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.075+0000 7f006aff4740 1 -- 172.21.15.5:0/4117085260 shutdown_connections 2024-08-31T05:34:18.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.075+0000 7f006aff4740 1 -- 172.21.15.5:0/4117085260 wait complete. 2024-08-31T05:34:18.078 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.075+0000 7f006aff4740 20 client.16740 trim_cache size 0 max 16384 2024-08-31T05:34:18.079 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:34:18.079 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:34:18.079 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:34:18.079 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:34:18.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.076+0000 7f0063fb0640 1 -- 172.21.15.5:0/3429036298 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f00480b4ca0 msgr2=0x7f00480b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:18.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.076+0000 7f0063fb0640 1 --2- 172.21.15.5:0/3429036298 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f00480b4ca0 0x7f00480b71b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x5591a2e16740 tx=0x7f005800b390 comp rx=0 tx=0).stop 2024-08-31T05:34:18.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.076+0000 7f0063fb0640 1 -- 172.21.15.5:0/3429036298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f005c1092e0 msgr2=0x7f005c19a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:18.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.076+0000 7f0063fb0640 1 --2- 172.21.15.5:0/3429036298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f005c1092e0 0x7f005c19a8e0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f004c00e9c0 tx=0x7f004c00ee80 comp rx=0 tx=0).stop 2024-08-31T05:34:18.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.076+0000 7f0063fb0640 1 -- 172.21.15.5:0/3429036298 shutdown_connections 2024-08-31T05:34:18.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.076+0000 7f0063fb0640 1 --2- 172.21.15.5:0/3429036298 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f00480b4ca0 0x7f00480b71b0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:18.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.076+0000 7f0063fb0640 1 --2- 172.21.15.5:0/3429036298 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f005c109c30 0x7f005c19fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:18.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.076+0000 7f0063fb0640 1 --2- 172.21.15.5:0/3429036298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f005c1092e0 0x7f005c19a8e0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:18.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.076+0000 7f0063fb0640 1 --2- 172.21.15.5:0/3429036298 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f005c101dc0 0x7f005c19a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:18.081 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.076+0000 7f0063fb0640 1 -- 172.21.15.5:0/3429036298 >> 172.21.15.5:0/3429036298 conn(0x7f005c079bf0 msgr2=0x7f005c1072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:18.081 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.076+0000 7f0063fb0640 1 -- 172.21.15.5:0/3429036298 shutdown_connections 2024-08-31T05:34:18.081 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:18.076+0000 7f0063fb0640 1 -- 172.21.15.5:0/3429036298 wait complete. 2024-08-31T05:34:18.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:34:18 smithi050 ceph-mon[22146]: pgmap v475: 129 pgs: 129 active+clean; 239 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.0 MiB/s wr, 261 op/s 2024-08-31T05:34:18.915 INFO:tasks.workunit.client.0.smithi005.stdout: 1 461703 13.21 MB/sec execute 66 sec latency 107.452 ms 2024-08-31T05:34:18.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:34:18 smithi005 ceph-mon[18602]: pgmap v475: 129 pgs: 129 active+clean; 239 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.0 MiB/s wr, 261 op/s 2024-08-31T05:34:19.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:34:18 smithi070 ceph-mon[22316]: pgmap v475: 129 pgs: 129 active+clean; 239 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.0 MiB/s wr, 261 op/s 2024-08-31T05:34:19.915 INFO:tasks.workunit.client.0.smithi005.stdout: 1 464332 13.18 MB/sec execute 67 sec latency 11.478 ms 2024-08-31T05:34:20.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:34:20 smithi050 ceph-mon[22146]: pgmap v476: 129 pgs: 129 active+clean; 239 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.6 MiB/s wr, 299 op/s 2024-08-31T05:34:20.915 INFO:tasks.workunit.client.0.smithi005.stdout: 1 466625 13.20 MB/sec execute 68 sec latency 14.044 ms 2024-08-31T05:34:20.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:34:20 smithi005 ceph-mon[18602]: pgmap v476: 129 pgs: 129 active+clean; 239 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.6 MiB/s wr, 299 op/s 2024-08-31T05:34:21.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:34:20 smithi070 ceph-mon[22316]: pgmap v476: 129 pgs: 129 active+clean; 239 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.6 MiB/s wr, 299 op/s 2024-08-31T05:34:21.915 INFO:tasks.workunit.client.0.smithi005.stdout: 1 469578 13.25 MB/sec execute 69 sec latency 7.559 ms 2024-08-31T05:34:22.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:34:22 smithi050 ceph-mon[22146]: pgmap v477: 129 pgs: 129 active+clean; 245 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.8 MiB/s wr, 237 op/s 2024-08-31T05:34:22.915 INFO:tasks.workunit.client.0.smithi005.stdout: 1 472775 13.33 MB/sec execute 70 sec latency 18.950 ms 2024-08-31T05:34:22.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:34:22 smithi005 ceph-mon[18602]: pgmap v477: 129 pgs: 129 active+clean; 245 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.8 MiB/s wr, 237 op/s 2024-08-31T05:34:23.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:34:22 smithi070 ceph-mon[22316]: pgmap v477: 129 pgs: 129 active+clean; 245 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.8 MiB/s wr, 237 op/s 2024-08-31T05:34:23.916 INFO:tasks.workunit.client.0.smithi005.stdout: 1 474347 13.23 MB/sec execute 71 sec latency 78.706 ms 2024-08-31T05:34:24.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:34:24 smithi050 ceph-mon[22146]: pgmap v478: 129 pgs: 129 active+clean; 249 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.2 MiB/s wr, 273 op/s 2024-08-31T05:34:24.915 INFO:tasks.workunit.client.0.smithi005.stdout: 1 477000 13.24 MB/sec execute 72 sec latency 17.084 ms 2024-08-31T05:34:24.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:34:24 smithi005 ceph-mon[18602]: pgmap v478: 129 pgs: 129 active+clean; 249 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.2 MiB/s wr, 273 op/s 2024-08-31T05:34:25.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:34:24 smithi070 ceph-mon[22316]: pgmap v478: 129 pgs: 129 active+clean; 249 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.2 MiB/s wr, 273 op/s 2024-08-31T05:34:25.916 INFO:tasks.workunit.client.0.smithi005.stdout: 1 480072 13.31 MB/sec execute 73 sec latency 10.287 ms 2024-08-31T05:34:26.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:34:26 smithi050 ceph-mon[22146]: pgmap v479: 129 pgs: 129 active+clean; 252 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.2 MiB/s wr, 326 op/s 2024-08-31T05:34:26.916 INFO:tasks.workunit.client.0.smithi005.stdout: 1 483216 13.37 MB/sec execute 74 sec latency 14.085 ms 2024-08-31T05:34:26.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:34:26 smithi005 ceph-mon[18602]: pgmap v479: 129 pgs: 129 active+clean; 252 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.2 MiB/s wr, 326 op/s 2024-08-31T05:34:27.085 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:34:26 smithi070 ceph-mon[22316]: pgmap v479: 129 pgs: 129 active+clean; 252 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.2 MiB/s wr, 326 op/s 2024-08-31T05:34:27.916 INFO:tasks.workunit.client.0.smithi005.stdout: 1 485697 13.32 MB/sec execute 75 sec latency 11.055 ms 2024-08-31T05:34:28.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:34:28 smithi050 ceph-mon[22146]: pgmap v480: 129 pgs: 129 active+clean; 252 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.5 MiB/s wr, 222 op/s 2024-08-31T05:34:28.916 INFO:tasks.workunit.client.0.smithi005.stdout: 1 487493 13.30 MB/sec execute 76 sec latency 59.856 ms 2024-08-31T05:34:28.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:34:28 smithi005 ceph-mon[18602]: pgmap v480: 129 pgs: 129 active+clean; 252 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.5 MiB/s wr, 222 op/s 2024-08-31T05:34:29.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:34:28 smithi070 ceph-mon[22316]: pgmap v480: 129 pgs: 129 active+clean; 252 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.5 MiB/s wr, 222 op/s 2024-08-31T05:34:29.916 INFO:tasks.workunit.client.0.smithi005.stdout: 1 490535 13.36 MB/sec execute 77 sec latency 19.727 ms 2024-08-31T05:34:30.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:34:30 smithi050 ceph-mon[22146]: pgmap v481: 129 pgs: 129 active+clean; 267 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.8 MiB/s wr, 293 op/s 2024-08-31T05:34:30.916 INFO:tasks.workunit.client.0.smithi005.stdout: 1 492870 13.30 MB/sec execute 78 sec latency 11.593 ms 2024-08-31T05:34:30.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:34:30 smithi005 ceph-mon[18602]: pgmap v481: 129 pgs: 129 active+clean; 267 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.8 MiB/s wr, 293 op/s 2024-08-31T05:34:31.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:34:30 smithi070 ceph-mon[22316]: pgmap v481: 129 pgs: 129 active+clean; 267 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.8 MiB/s wr, 293 op/s 2024-08-31T05:34:31.178 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.176+0000 7f5acf31a640 1 -- 172.21.15.5:0/527698129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ac8101f30 msgr2=0x7f5ac8102340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:31.179 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.176+0000 7f5acf31a640 1 --2- 172.21.15.5:0/527698129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ac8101f30 0x7f5ac8102340 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f5ab800aa10 tx=0x7f5ab802b720 comp rx=0 tx=0).stop 2024-08-31T05:34:31.179 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.176+0000 7f5acf31a640 1 -- 172.21.15.5:0/527698129 shutdown_connections 2024-08-31T05:34:31.179 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.176+0000 7f5acf31a640 1 --2- 172.21.15.5:0/527698129 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ac81081b0 0x7f5ac810e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:31.179 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.176+0000 7f5acf31a640 1 --2- 172.21.15.5:0/527698129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ac8107860 0x7f5ac8107c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:31.179 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.176+0000 7f5acf31a640 1 --2- 172.21.15.5:0/527698129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ac8101f30 0x7f5ac8102340 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:31.179 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.176+0000 7f5acf31a640 1 -- 172.21.15.5:0/527698129 >> 172.21.15.5:0/527698129 conn(0x7f5ac8079a80 msgr2=0x7f5ac8079ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:31.179 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.176+0000 7f5acf31a640 1 -- 172.21.15.5:0/527698129 shutdown_connections 2024-08-31T05:34:31.179 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.176+0000 7f5acf31a640 1 -- 172.21.15.5:0/527698129 wait complete. 2024-08-31T05:34:31.179 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.177+0000 7f5acf31a640 1 Processor -- start 2024-08-31T05:34:31.179 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.177+0000 7f5acf31a640 1 -- start start 2024-08-31T05:34:31.181 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.177+0000 7f5acf31a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ac8101f30 0x7f5ac819a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:31.181 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.177+0000 7f5acf31a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ac8107860 0x7f5ac819a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:31.181 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.177+0000 7f5acf31a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ac81081b0 0x7f5ac819fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:31.181 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.177+0000 7f5acf31a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac81115f0 con 0x7f5ac8107860 2024-08-31T05:34:31.182 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.177+0000 7f5acf31a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac8111470 con 0x7f5ac81081b0 2024-08-31T05:34:31.182 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.177+0000 7f5acf31a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac8111770 con 0x7f5ac8101f30 2024-08-31T05:34:31.182 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.177+0000 7f5acc8b5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ac8107860 0x7f5ac819a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:31.182 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.177+0000 7f5acd0b6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ac8101f30 0x7f5ac819a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:31.182 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.177+0000 7f5acd0b6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ac8101f30 0x7f5ac819a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:56308/0 (socket says 172.21.15.5:56308) 2024-08-31T05:34:31.182 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.177+0000 7f5acc8b5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ac8107860 0x7f5ac819a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54012/0 (socket says 172.21.15.5:54012) 2024-08-31T05:34:31.182 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.177+0000 7f5acd0b6640 1 -- 172.21.15.5:0/442997317 learned_addr learned my addr 172.21.15.5:0/442997317 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:31.182 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.177+0000 7f5acd8b7640 1 --2- 172.21.15.5:0/442997317 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ac81081b0 0x7f5ac819fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:31.182 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.177+0000 7f5acd0b6640 1 -- 172.21.15.5:0/442997317 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ac81081b0 msgr2=0x7f5ac819fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:31.182 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.177+0000 7f5acd0b6640 1 --2- 172.21.15.5:0/442997317 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ac81081b0 0x7f5ac819fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:31.182 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.177+0000 7f5acd0b6640 1 -- 172.21.15.5:0/442997317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ac8107860 msgr2=0x7f5ac819a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:31.182 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.177+0000 7f5acd0b6640 1 --2- 172.21.15.5:0/442997317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ac8107860 0x7f5ac819a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:31.182 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.177+0000 7f5acd0b6640 1 -- 172.21.15.5:0/442997317 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac81a01d0 con 0x7f5ac8101f30 2024-08-31T05:34:31.183 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.177+0000 7f5acc8b5640 1 --2- 172.21.15.5:0/442997317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ac8107860 0x7f5ac819a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:34:31.183 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.178+0000 7f5acd0b6640 1 --2- 172.21.15.5:0/442997317 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ac8101f30 0x7f5ac819a2a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8005940 tx=0x7f5ab8004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:31.183 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.178+0000 7f5ac67fc640 1 -- 172.21.15.5:0/442997317 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab803f070 con 0x7f5ac8101f30 2024-08-31T05:34:31.183 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.178+0000 7f5acf31a640 1 -- 172.21.15.5:0/442997317 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ac81a0460 con 0x7f5ac8101f30 2024-08-31T05:34:31.183 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.178+0000 7f5ac67fc640 1 -- 172.21.15.5:0/442997317 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ab8003ca0 con 0x7f5ac8101f30 2024-08-31T05:34:31.183 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.178+0000 7f5acf31a640 1 -- 172.21.15.5:0/442997317 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ac81a6c50 con 0x7f5ac8101f30 2024-08-31T05:34:31.183 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.178+0000 7f5ac67fc640 1 -- 172.21.15.5:0/442997317 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab8036040 con 0x7f5ac8101f30 2024-08-31T05:34:31.190 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.180+0000 7f5ad627f740 1 Processor -- start 2024-08-31T05:34:31.190 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.181+0000 7f5ad627f740 1 -- start start 2024-08-31T05:34:31.190 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.181+0000 7f5ad627f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f468591b0 0x563f46bfcac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:31.190 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.181+0000 7f5ad627f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563f468302f0 0x563f46bfd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:31.190 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.181+0000 7f5ad627f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563f468384d0 0x563f46bfd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:31.190 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.181+0000 7f5ad627f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x563f46b72000 con 0x563f468384d0 2024-08-31T05:34:31.190 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.181+0000 7f5ad627f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x563f46b61590 con 0x563f468302f0 2024-08-31T05:34:31.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.181+0000 7f5ad627f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563f46b65540 con 0x563f468591b0 2024-08-31T05:34:31.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.181+0000 7f5acd8b7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f468591b0 0x563f46bfcac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:31.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.181+0000 7f5acd8b7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f468591b0 0x563f46bfcac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:56324/0 (socket says 172.21.15.5:56324) 2024-08-31T05:34:31.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.181+0000 7f5acd8b7640 1 -- 172.21.15.5:0/2689847511 learned_addr learned my addr 172.21.15.5:0/2689847511 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:31.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.181+0000 7f5acc8b5640 1 --2- 172.21.15.5:0/2689847511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563f468384d0 0x563f46bfd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:31.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.181+0000 7f5acd8b7640 1 -- 172.21.15.5:0/2689847511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563f468302f0 msgr2=0x563f46bfd000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T05:34:31.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.181+0000 7f5acd8b7640 1 --2- 172.21.15.5:0/2689847511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563f468302f0 0x563f46bfd000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:31.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.181+0000 7f5acd8b7640 1 -- 172.21.15.5:0/2689847511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563f468384d0 msgr2=0x563f46bfd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:31.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.181+0000 7f5acd8b7640 1 --2- 172.21.15.5:0/2689847511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563f468384d0 0x563f46bfd540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:31.192 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.181+0000 7f5acd8b7640 1 -- 172.21.15.5:0/2689847511 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f468c4790 con 0x563f468591b0 2024-08-31T05:34:31.192 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.181+0000 7f5acc8b5640 1 --2- 172.21.15.5:0/2689847511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563f468384d0 0x563f46bfd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:34:31.192 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.181+0000 7f5ac67fc640 1 -- 172.21.15.5:0/442997317 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f5ab8042070 con 0x7f5ac8101f30 2024-08-31T05:34:31.192 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.181+0000 7f5acd8b7640 1 --2- 172.21.15.5:0/2689847511 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f468591b0 0x563f46bfcac0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0009f80 tx=0x7f5ac00118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=261f2ecf79f860e2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:31.192 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.182+0000 7f5aaf7fe640 1 -- 172.21.15.5:0/2689847511 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac0004b20 con 0x563f468591b0 2024-08-31T05:34:31.192 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.182+0000 7f5aaf7fe640 1 -- 172.21.15.5:0/2689847511 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ac0004cc0 con 0x563f468591b0 2024-08-31T05:34:31.192 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.182+0000 7f5aaf7fe640 1 -- 172.21.15.5:0/2689847511 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac0005020 con 0x563f468591b0 2024-08-31T05:34:31.192 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.182+0000 7f5ac67fc640 1 --2- 172.21.15.5:0/442997317 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5ab00b4ca0 0x7f5ab00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:31.192 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.182+0000 7f5acd0b6640 1 --2- 172.21.15.5:0/442997317 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5ab00b4ca0 0x7f5ab00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:31.193 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.182+0000 7f5ac67fc640 1 -- 172.21.15.5:0/442997317 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f5ab8105bc0 con 0x7f5ac8101f30 2024-08-31T05:34:31.193 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.182+0000 7f5ad627f740 1 -- 172.21.15.5:0/2689847511 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f468591b0 msgr2=0x563f46bfcac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:31.193 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.182+0000 7f5ad627f740 1 --2- 172.21.15.5:0/2689847511 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f468591b0 0x563f46bfcac0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0009f80 tx=0x7f5ac00118d0 comp rx=0 tx=0).stop 2024-08-31T05:34:31.193 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.183+0000 7f5ad627f740 1 -- 172.21.15.5:0/2689847511 shutdown_connections 2024-08-31T05:34:31.193 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.183+0000 7f5ad627f740 1 --2- 172.21.15.5:0/2689847511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563f468384d0 0x563f46bfd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:31.193 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.183+0000 7f5ad627f740 1 --2- 172.21.15.5:0/2689847511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563f468302f0 0x563f46bfd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:31.193 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.183+0000 7f5ad627f740 1 --2- 172.21.15.5:0/2689847511 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f468591b0 0x563f46bfcac0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:31.193 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.183+0000 7f5ad627f740 1 -- 172.21.15.5:0/2689847511 >> 172.21.15.5:0/2689847511 conn(0x563f4684d300 msgr2=0x563f46bfa9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:31.193 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.183+0000 7f5ad627f740 1 -- 172.21.15.5:0/2689847511 shutdown_connections 2024-08-31T05:34:31.194 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.183+0000 7f5ad627f740 1 -- 172.21.15.5:0/2689847511 wait complete. 2024-08-31T05:34:31.194 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.183+0000 7f5acd0b6640 1 --2- 172.21.15.5:0/442997317 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5ab00b4ca0 0x7f5ab00b71b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x563f46bfb740 tx=0x7f5ab8090e30 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:31.194 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.183+0000 7f5ad627f740 1 -- start start 2024-08-31T05:34:31.194 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.183+0000 7f5ad627f740 1 Processor -- start 2024-08-31T05:34:31.194 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.184+0000 7f5ad627f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563f468302f0 0x563f46c086c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:31.194 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.184+0000 7f5ad627f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563f468384d0 0x563f46c08c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:31.194 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.184+0000 7f5ad627f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f468591b0 0x563f46c14560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:31.194 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.184+0000 7f5ad627f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x563f46a9aab0 con 0x563f468384d0 2024-08-31T05:34:31.194 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.184+0000 7f5ad627f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x563f46ae8680 con 0x563f468302f0 2024-08-31T05:34:31.194 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.184+0000 7f5ad627f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563f46c0b240 con 0x563f468591b0 2024-08-31T05:34:31.194 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.184+0000 7f5acc8b5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563f468384d0 0x563f46c08c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:31.194 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.184+0000 7f5ad627f740 10 client.0 _ll_register_callbacks cb 0x563f46870a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:34:31.194 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.184+0000 7f5acc8b5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563f468384d0 0x563f46c08c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54024/0 (socket says 172.21.15.5:54024) 2024-08-31T05:34:31.195 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.184+0000 7f5acc8b5640 1 -- 172.21.15.5:0/4065196516 learned_addr learned my addr 172.21.15.5:0/4065196516 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:31.195 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.184+0000 7f5acd8b7640 1 --2- 172.21.15.5:0/4065196516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f468591b0 0x563f46c14560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:31.195 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.184+0000 7f5acd8b7640 1 --2- 172.21.15.5:0/4065196516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563f468302f0 0x563f46c086c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:31.195 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.184+0000 7f5acc8b5640 1 -- 172.21.15.5:0/4065196516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f468591b0 msgr2=0x563f46c14560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:31.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.184+0000 7f5acc8b5640 1 --2- 172.21.15.5:0/4065196516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f468591b0 0x563f46c14560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:31.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.184+0000 7f5acc8b5640 1 -- 172.21.15.5:0/4065196516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563f468302f0 msgr2=0x563f46c086c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:31.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.184+0000 7f5acc8b5640 1 --2- 172.21.15.5:0/4065196516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563f468302f0 0x563f46c086c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:31.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.184+0000 7f5acc8b5640 1 -- 172.21.15.5:0/4065196516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f4693d620 con 0x563f468384d0 2024-08-31T05:34:31.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.184+0000 7f5acc8b5640 1 --2- 172.21.15.5:0/4065196516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563f468384d0 0x563f46c08c40 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f5abc012d20 tx=0x7f5abc00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4824c4f5ab6be010 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:31.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.184+0000 7f5aacff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:34:31.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.184+0000 7f5aacff9640 1 -- 172.21.15.5:0/4065196516 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5abc0120d0 con 0x563f468384d0 2024-08-31T05:34:31.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.184+0000 7f5aacff9640 1 -- 172.21.15.5:0/4065196516 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f5abc004030 con 0x563f468384d0 2024-08-31T05:34:31.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.185+0000 7f5ad627f740 1 -- 172.21.15.5:0/4065196516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ac0004cc0 con 0x563f468384d0 2024-08-31T05:34:31.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.185+0000 7f5aacff9640 1 -- 172.21.15.5:0/4065196516 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f5abc012270 con 0x563f468384d0 2024-08-31T05:34:31.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.185+0000 7f5ad627f740 10 client.16752 fetch_fsmap learned FSMap version 34 2024-08-31T05:34:31.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.185+0000 7f5ad627f740 1 -- 172.21.15.5:0/4065196516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x563f46c17390 con 0x563f468384d0 2024-08-31T05:34:31.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.185+0000 7f5aacff9640 1 -- 172.21.15.5:0/4065196516 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ac0004cc0 con 0x563f468384d0 2024-08-31T05:34:31.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.185+0000 7f5aacff9640 1 -- 172.21.15.5:0/4065196516 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f5abc01c460 con 0x563f468384d0 2024-08-31T05:34:31.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.185+0000 7f5ad627f740 10 client.16752 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:34:31.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.185+0000 7f5ad627f740 10 client.16752 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:34:31.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.185+0000 7f5ad627f740 20 client.16752 populate_metadata read hostname 'smithi005' 2024-08-31T05:34:31.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.185+0000 7f5ad627f740 1 --2- 172.21.15.5:0/4065196516 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x563f46817d80 0x563f46c1a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:31.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.185+0000 7f5ad627f740 4 client.16752 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:34:31.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.185+0000 7f5ad627f740 1 -- 172.21.15.5:0/4065196516 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563f46b73f50 con 0x563f46817d80 2024-08-31T05:34:31.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.185+0000 7f5acd8b7640 1 --2- 172.21.15.5:0/4065196516 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x563f46817d80 0x563f46c1a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:31.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.186+0000 7f5aacff9640 10 client.16752 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:34:31.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.186+0000 7f5acd8b7640 1 --2- 172.21.15.5:0/4065196516 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x563f46817d80 0x563f46c1a8b0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c89068c55f5eb7cf server_cookie=39399f6e073e1dcb in_seq=0 out_seq=0 2024-08-31T05:34:31.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.186+0000 7f5aacff9640 1 -- 172.21.15.5:0/4065196516 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563f46b73f50 con 0x563f46817d80 2024-08-31T05:34:31.198 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.186+0000 7f5aacff9640 10 client.16752 handle_command_reply: tid=0 2024-08-31T05:34:31.198 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.186+0000 7f5ad627f740 1 client.16752 shutdown 2024-08-31T05:34:31.198 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.187+0000 7f5ad627f740 1 -- 172.21.15.5:0/4065196516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563f468384d0 msgr2=0x563f46c08c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:31.198 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.187+0000 7f5ad627f740 1 --2- 172.21.15.5:0/4065196516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563f468384d0 0x563f46c08c40 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f5abc012d20 tx=0x7f5abc00f790 comp rx=0 tx=0).stop 2024-08-31T05:34:31.198 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.187+0000 7f5ad627f740 1 -- 172.21.15.5:0/4065196516 shutdown_connections 2024-08-31T05:34:31.198 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.187+0000 7f5ad627f740 1 --2- 172.21.15.5:0/4065196516 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x563f46817d80 0x563f46c1a8b0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:31.198 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.187+0000 7f5ad627f740 1 --2- 172.21.15.5:0/4065196516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f468591b0 0x563f46c14560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:31.198 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.187+0000 7f5ad627f740 1 --2- 172.21.15.5:0/4065196516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563f468384d0 0x563f46c08c40 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:31.198 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.187+0000 7f5aacff9640 0 client.16752 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:34:31.198 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.187+0000 7f5ad627f740 1 --2- 172.21.15.5:0/4065196516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563f468302f0 0x563f46c086c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:31.198 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.187+0000 7f5ad627f740 1 -- 172.21.15.5:0/4065196516 >> 172.21.15.5:0/4065196516 conn(0x563f4684d300 msgr2=0x563f46bfdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:31.198 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.187+0000 7f5ad627f740 1 -- 172.21.15.5:0/4065196516 shutdown_connections 2024-08-31T05:34:31.198 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.187+0000 7f5ad627f740 1 -- 172.21.15.5:0/4065196516 wait complete. 2024-08-31T05:34:31.199 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.187+0000 7f5ad627f740 20 client.16752 trim_cache size 0 max 16384 2024-08-31T05:34:31.205 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.202+0000 7f5ad627f740 1 Processor -- start 2024-08-31T05:34:31.205 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.202+0000 7f5ad627f740 1 -- start start 2024-08-31T05:34:31.205 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.202+0000 7f5ad627f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563f468302f0 0x563f46c01b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:31.206 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.202+0000 7f5ad627f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563f468384d0 0x563f46c020c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:31.206 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.202+0000 7f5ad627f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f468591b0 0x563f46c07980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:31.206 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.202+0000 7f5ad627f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac81b0cd0 con 0x563f468302f0 2024-08-31T05:34:31.206 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.202+0000 7f5ad627f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac81b2810 con 0x563f468384d0 2024-08-31T05:34:31.206 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.202+0000 7f5ad627f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac81b13a0 con 0x563f468591b0 2024-08-31T05:34:31.206 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.202+0000 7f5acd8b7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563f468302f0 0x563f46c01b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:31.206 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.202+0000 7f5acd8b7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563f468302f0 0x563f46c01b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54034/0 (socket says 172.21.15.5:54034) 2024-08-31T05:34:31.206 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.202+0000 7f5acd8b7640 1 -- 172.21.15.5:0/2032911110 learned_addr learned my addr 172.21.15.5:0/2032911110 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:31.206 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.203+0000 7f5acc8b5640 1 --2- 172.21.15.5:0/2032911110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563f468384d0 0x563f46c020c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:31.206 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.203+0000 7f5acd8b7640 1 --2- 172.21.15.5:0/2032911110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f468591b0 0x563f46c07980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:31.206 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.203+0000 7f5acd8b7640 1 -- 172.21.15.5:0/2032911110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f468591b0 msgr2=0x563f46c07980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:31.206 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.203+0000 7f5acd8b7640 1 --2- 172.21.15.5:0/2032911110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f468591b0 0x563f46c07980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:31.206 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.203+0000 7f5acd8b7640 1 -- 172.21.15.5:0/2032911110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563f468384d0 msgr2=0x563f46c020c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:31.207 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.203+0000 7f5acd8b7640 1 --2- 172.21.15.5:0/2032911110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563f468384d0 0x563f46c020c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:31.207 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.203+0000 7f5acd8b7640 1 -- 172.21.15.5:0/2032911110 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f46bff8d0 con 0x563f468302f0 2024-08-31T05:34:31.207 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.203+0000 7f5acd8b7640 1 --2- 172.21.15.5:0/2032911110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563f468302f0 0x563f46c01b80 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0011910 tx=0x7f5ac0009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70b7a3b18ddae1ac server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:31.207 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.203+0000 7f5aaeffd640 1 -- 172.21.15.5:0/2032911110 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac0004cc0 con 0x563f468302f0 2024-08-31T05:34:31.207 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.203+0000 7f5aaeffd640 1 -- 172.21.15.5:0/2032911110 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ac0003ee0 con 0x563f468302f0 2024-08-31T05:34:31.207 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.203+0000 7f5aaeffd640 1 -- 172.21.15.5:0/2032911110 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac000fa30 con 0x563f468302f0 2024-08-31T05:34:31.210 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.204+0000 7f5ad627f740 1 -- 172.21.15.5:0/2032911110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563f468302f0 msgr2=0x563f46c01b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:31.210 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.204+0000 7f5ad627f740 1 --2- 172.21.15.5:0/2032911110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563f468302f0 0x563f46c01b80 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0011910 tx=0x7f5ac0009500 comp rx=0 tx=0).stop 2024-08-31T05:34:31.210 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.204+0000 7f5ad627f740 1 -- 172.21.15.5:0/2032911110 shutdown_connections 2024-08-31T05:34:31.211 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.204+0000 7f5ad627f740 1 --2- 172.21.15.5:0/2032911110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f468591b0 0x563f46c07980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:31.211 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.204+0000 7f5ad627f740 1 --2- 172.21.15.5:0/2032911110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563f468384d0 0x563f46c020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:31.211 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.204+0000 7f5ad627f740 1 --2- 172.21.15.5:0/2032911110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563f468302f0 0x563f46c01b80 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:31.211 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.204+0000 7f5ad627f740 1 -- 172.21.15.5:0/2032911110 >> 172.21.15.5:0/2032911110 conn(0x563f4684d300 msgr2=0x563f46c03620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:31.211 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.204+0000 7f5ad627f740 1 -- 172.21.15.5:0/2032911110 shutdown_connections 2024-08-31T05:34:31.211 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.204+0000 7f5ad627f740 1 -- 172.21.15.5:0/2032911110 wait complete. 2024-08-31T05:34:31.211 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.204+0000 7f5ad627f740 1 -- start start 2024-08-31T05:34:31.211 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.204+0000 7f5ad627f740 1 Processor -- start 2024-08-31T05:34:31.211 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.205+0000 7f5ad627f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563f468302f0 0x563f46c10bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:31.211 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.205+0000 7f5ad627f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f468384d0 0x563f46c0d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:31.211 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.205+0000 7f5ad627f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563f468591b0 0x563f46c0d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:31.212 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.205+0000 7f5ad627f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac81b2140 con 0x563f468302f0 2024-08-31T05:34:31.212 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.205+0000 7f5ad627f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac81b1a70 con 0x563f468591b0 2024-08-31T05:34:31.212 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.205+0000 7f5ad627f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac81aecb0 con 0x563f468384d0 2024-08-31T05:34:31.212 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.205+0000 7f5ad627f740 10 client.0 _ll_register_callbacks cb 0x7f5abc009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:34:31.212 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.205+0000 7f5acd8b7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563f468302f0 0x563f46c10bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:31.212 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.205+0000 7f5acc8b5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f468384d0 0x563f46c0d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:31.212 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.205+0000 7f5acc8b5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f468384d0 0x563f46c0d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:56360/0 (socket says 172.21.15.5:56360) 2024-08-31T05:34:31.212 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.205+0000 7f5acd8b7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563f468302f0 0x563f46c10bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54038/0 (socket says 172.21.15.5:54038) 2024-08-31T05:34:31.212 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.205+0000 7f5acc8b5640 1 -- 172.21.15.5:0/2144470024 learned_addr learned my addr 172.21.15.5:0/2144470024 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:31.212 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.205+0000 7f5acd8b7640 1 --2- 172.21.15.5:0/2144470024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563f468591b0 0x563f46c0d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:31.212 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.205+0000 7f5acd8b7640 1 -- 172.21.15.5:0/2144470024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f468384d0 msgr2=0x563f46c0d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:31.212 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.205+0000 7f5acd8b7640 1 --2- 172.21.15.5:0/2144470024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f468384d0 0x563f46c0d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:31.212 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.205+0000 7f5acd8b7640 1 -- 172.21.15.5:0/2144470024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563f468591b0 msgr2=0x563f46c0d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:31.213 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.205+0000 7f5acd8b7640 1 --2- 172.21.15.5:0/2144470024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563f468591b0 0x563f46c0d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:31.213 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.205+0000 7f5acd8b7640 1 -- 172.21.15.5:0/2144470024 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f46c0dc50 con 0x563f468302f0 2024-08-31T05:34:31.213 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.205+0000 7f5acc8b5640 1 --2- 172.21.15.5:0/2144470024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f468384d0 0x563f46c0d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:34:31.213 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.205+0000 7f5acd8b7640 1 --2- 172.21.15.5:0/2144470024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563f468302f0 0x563f46c10bc0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0011f50 tx=0x7f5ac0000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fc561af900d6a3f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:31.213 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.205+0000 7f5aacff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:34:31.213 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.206+0000 7f5aacff9640 1 -- 172.21.15.5:0/2144470024 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac0004090 con 0x563f468302f0 2024-08-31T05:34:31.213 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.206+0000 7f5aacff9640 1 -- 172.21.15.5:0/2144470024 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f5ac0016070 con 0x563f468302f0 2024-08-31T05:34:31.213 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.206+0000 7f5ad627f740 1 -- 172.21.15.5:0/2144470024 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ac0003ee0 con 0x563f468302f0 2024-08-31T05:34:31.213 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.206+0000 7f5aacff9640 1 -- 172.21.15.5:0/2144470024 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f5ac000f4e0 con 0x563f468302f0 2024-08-31T05:34:31.213 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.206+0000 7f5ad627f740 10 client.16758 fetch_fsmap learned FSMap version 34 2024-08-31T05:34:31.213 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.206+0000 7f5ad627f740 1 -- 172.21.15.5:0/2144470024 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x563f46c860e0 con 0x563f468302f0 2024-08-31T05:34:31.213 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.206+0000 7f5aacff9640 1 -- 172.21.15.5:0/2144470024 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ac0003ee0 con 0x563f468302f0 2024-08-31T05:34:31.213 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.206+0000 7f5aacff9640 1 -- 172.21.15.5:0/2144470024 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f5ac000fc20 con 0x563f468302f0 2024-08-31T05:34:31.214 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.206+0000 7f5ad627f740 10 client.16758 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:34:31.214 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.206+0000 7f5ad627f740 10 client.16758 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:34:31.214 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.206+0000 7f5ad627f740 20 client.16758 populate_metadata read hostname 'smithi005' 2024-08-31T05:34:31.214 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.206+0000 7f5ad627f740 1 --2- 172.21.15.5:0/2144470024 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x563f467ed1c0 0x563f46c88560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:31.214 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.206+0000 7f5ad627f740 4 client.16758 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:34:31.214 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.206+0000 7f5ad627f740 1 -- 172.21.15.5:0/2144470024 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563f46b6f9f0 con 0x563f467ed1c0 2024-08-31T05:34:31.214 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.206+0000 7f5acc8b5640 1 --2- 172.21.15.5:0/2144470024 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x563f467ed1c0 0x563f46c88560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:31.214 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.207+0000 7f5aacff9640 10 client.16758 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:34:31.214 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.207+0000 7f5acc8b5640 1 --2- 172.21.15.5:0/2144470024 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x563f467ed1c0 0x563f46c88560 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eeb94206ce5a7208 server_cookie=fc8d0e4b2f1a9984 in_seq=0 out_seq=0 2024-08-31T05:34:31.219 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.217+0000 7f5aacff9640 1 -- 172.21.15.5:0/2144470024 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563f46b6f9f0 con 0x563f467ed1c0 2024-08-31T05:34:31.219 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.217+0000 7f5aacff9640 10 client.16758 handle_command_reply: tid=0 2024-08-31T05:34:31.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.217+0000 7f5ad627f740 1 client.16758 shutdown 2024-08-31T05:34:31.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.217+0000 7f5ad627f740 1 -- 172.21.15.5:0/2144470024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563f468302f0 msgr2=0x563f46c10bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:31.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.217+0000 7f5ad627f740 1 --2- 172.21.15.5:0/2144470024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563f468302f0 0x563f46c10bc0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0011f50 tx=0x7f5ac0000f40 comp rx=0 tx=0).stop 2024-08-31T05:34:31.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.217+0000 7f5ad627f740 1 -- 172.21.15.5:0/2144470024 shutdown_connections 2024-08-31T05:34:31.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.217+0000 7f5ad627f740 1 --2- 172.21.15.5:0/2144470024 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x563f467ed1c0 0x563f46c88560 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:31.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.217+0000 7f5ad627f740 1 --2- 172.21.15.5:0/2144470024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563f468591b0 0x563f46c0d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:31.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.217+0000 7f5ad627f740 1 --2- 172.21.15.5:0/2144470024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563f468384d0 0x563f46c0d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:31.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.217+0000 7f5aacff9640 0 client.16758 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:34:31.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.217+0000 7f5ad627f740 1 --2- 172.21.15.5:0/2144470024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563f468302f0 0x563f46c10bc0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:31.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.217+0000 7f5ad627f740 1 -- 172.21.15.5:0/2144470024 >> 172.21.15.5:0/2144470024 conn(0x563f4684d300 msgr2=0x563f46c03620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:31.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.217+0000 7f5ad627f740 1 -- 172.21.15.5:0/2144470024 shutdown_connections 2024-08-31T05:34:31.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.217+0000 7f5ad627f740 1 -- 172.21.15.5:0/2144470024 wait complete. 2024-08-31T05:34:31.221 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.217+0000 7f5ad627f740 20 client.16758 trim_cache size 0 max 16384 2024-08-31T05:34:31.221 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:34:31.221 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:34:31.221 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:34:31.221 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:34:31.222 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.218+0000 7f5acf31a640 1 -- 172.21.15.5:0/442997317 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5ab00b4ca0 msgr2=0x7f5ab00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:31.222 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.218+0000 7f5acf31a640 1 --2- 172.21.15.5:0/442997317 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5ab00b4ca0 0x7f5ab00b71b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x563f46bfb740 tx=0x7f5ab8090e30 comp rx=0 tx=0).stop 2024-08-31T05:34:31.222 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.218+0000 7f5acf31a640 1 -- 172.21.15.5:0/442997317 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ac8101f30 msgr2=0x7f5ac819a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:31.222 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.218+0000 7f5acf31a640 1 --2- 172.21.15.5:0/442997317 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ac8101f30 0x7f5ac819a2a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8005940 tx=0x7f5ab8004270 comp rx=0 tx=0).stop 2024-08-31T05:34:31.222 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.218+0000 7f5acf31a640 1 -- 172.21.15.5:0/442997317 shutdown_connections 2024-08-31T05:34:31.222 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.218+0000 7f5acf31a640 1 --2- 172.21.15.5:0/442997317 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5ab00b4ca0 0x7f5ab00b71b0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:31.222 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.218+0000 7f5acf31a640 1 --2- 172.21.15.5:0/442997317 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ac81081b0 0x7f5ac819fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:31.222 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.218+0000 7f5acf31a640 1 --2- 172.21.15.5:0/442997317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ac8107860 0x7f5ac819a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:31.222 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.218+0000 7f5acf31a640 1 --2- 172.21.15.5:0/442997317 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ac8101f30 0x7f5ac819a2a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:31.223 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.218+0000 7f5acf31a640 1 -- 172.21.15.5:0/442997317 >> 172.21.15.5:0/442997317 conn(0x7f5ac8079a80 msgr2=0x7f5ac81059b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:31.223 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.218+0000 7f5acf31a640 1 -- 172.21.15.5:0/442997317 shutdown_connections 2024-08-31T05:34:31.223 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:31.218+0000 7f5acf31a640 1 -- 172.21.15.5:0/442997317 wait complete. 2024-08-31T05:34:31.916 INFO:tasks.workunit.client.0.smithi005.stdout: 1 495036 13.30 MB/sec execute 79 sec latency 13.590 ms 2024-08-31T05:34:32.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:34:32 smithi050 ceph-mon[22146]: pgmap v482: 129 pgs: 129 active+clean; 267 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.0 MiB/s wr, 252 op/s 2024-08-31T05:34:32.916 INFO:tasks.workunit.client.0.smithi005.stdout: 1 497860 13.34 MB/sec execute 80 sec latency 7.762 ms 2024-08-31T05:34:32.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:34:32 smithi005 ceph-mon[18602]: pgmap v482: 129 pgs: 129 active+clean; 267 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.0 MiB/s wr, 252 op/s 2024-08-31T05:34:33.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:34:32 smithi070 ceph-mon[22316]: pgmap v482: 129 pgs: 129 active+clean; 267 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.0 MiB/s wr, 252 op/s 2024-08-31T05:34:33.916 INFO:tasks.workunit.client.0.smithi005.stdout: 1 500575 13.34 MB/sec execute 81 sec latency 70.451 ms 2024-08-31T05:34:34.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:34:34 smithi050 ceph-mon[22146]: pgmap v483: 129 pgs: 129 active+clean; 274 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.1 MiB/s wr, 267 op/s 2024-08-31T05:34:34.916 INFO:tasks.workunit.client.0.smithi005.stdout: 1 502450 13.31 MB/sec execute 82 sec latency 20.680 ms 2024-08-31T05:34:34.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:34:34 smithi005 ceph-mon[18602]: pgmap v483: 129 pgs: 129 active+clean; 274 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.1 MiB/s wr, 267 op/s 2024-08-31T05:34:35.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:34:34 smithi070 ceph-mon[22316]: pgmap v483: 129 pgs: 129 active+clean; 274 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.1 MiB/s wr, 267 op/s 2024-08-31T05:34:35.916 INFO:tasks.workunit.client.0.smithi005.stdout: 1 505173 13.32 MB/sec execute 83 sec latency 14.934 ms 2024-08-31T05:34:36.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:34:36 smithi050 ceph-mon[22146]: pgmap v484: 129 pgs: 129 active+clean; 271 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.2 MiB/s wr, 257 op/s 2024-08-31T05:34:36.916 INFO:tasks.workunit.client.0.smithi005.stdout: 1 508294 13.39 MB/sec execute 84 sec latency 10.660 ms 2024-08-31T05:34:36.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:34:36 smithi005 ceph-mon[18602]: pgmap v484: 129 pgs: 129 active+clean; 271 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.2 MiB/s wr, 257 op/s 2024-08-31T05:34:37.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:34:36 smithi070 ceph-mon[22316]: pgmap v484: 129 pgs: 129 active+clean; 271 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.2 MiB/s wr, 257 op/s 2024-08-31T05:34:37.744 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T05:34:37.916 INFO:tasks.workunit.client.0.smithi005.stdout: 1 511043 13.38 MB/sec execute 85 sec latency 13.479 ms 2024-08-31T05:34:38.026 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:34:38.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.599+0000 7fafdb855640 1 -- 172.21.15.5:0/1869392937 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafd4108aa0 msgr2=0x7fafd410f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:38.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.599+0000 7fafdb855640 1 --2- 172.21.15.5:0/1869392937 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafd4108aa0 0x7fafd410f2d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fafcc009be0 tx=0x7fafcc02a6c0 comp rx=0 tx=0).stop 2024-08-31T05:34:38.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.599+0000 7fafdb855640 1 -- 172.21.15.5:0/1869392937 shutdown_connections 2024-08-31T05:34:38.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.599+0000 7fafdb855640 1 --2- 172.21.15.5:0/1869392937 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafd4108aa0 0x7fafd410f2d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:38.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.599+0000 7fafdb855640 1 --2- 172.21.15.5:0/1869392937 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafd4108150 0x7fafd4108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:38.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.599+0000 7fafdb855640 1 --2- 172.21.15.5:0/1869392937 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafd4102ee0 0x7fafd41032f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:38.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.599+0000 7fafdb855640 1 -- 172.21.15.5:0/1869392937 >> 172.21.15.5:0/1869392937 conn(0x7fafd4077a00 msgr2=0x7fafd4077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:38.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.599+0000 7fafdb855640 1 -- 172.21.15.5:0/1869392937 shutdown_connections 2024-08-31T05:34:38.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.599+0000 7fafdb855640 1 -- 172.21.15.5:0/1869392937 wait complete. 2024-08-31T05:34:38.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.600+0000 7fafdb855640 1 Processor -- start 2024-08-31T05:34:38.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.600+0000 7fafdb855640 1 -- start start 2024-08-31T05:34:38.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.600+0000 7fafdb855640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafd4102ee0 0x7fafd419a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:38.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.601+0000 7fafdb855640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafd4108150 0x7fafd419a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:38.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.601+0000 7fafdb855640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafd4108aa0 0x7fafd419f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:38.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.601+0000 7fafd95f1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafd4102ee0 0x7fafd419a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:38.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.601+0000 7fafd95f1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafd4102ee0 0x7fafd419a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43462/0 (socket says 172.21.15.5:43462) 2024-08-31T05:34:38.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.601+0000 7fafd8df0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafd4108150 0x7fafd419a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:38.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.601+0000 7fafd95f1640 1 -- 172.21.15.5:0/438491445 learned_addr learned my addr 172.21.15.5:0/438491445 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:38.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.601+0000 7fafdb855640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fafd4112750 con 0x7fafd4102ee0 2024-08-31T05:34:38.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.601+0000 7fafdb855640 1 -- 172.21.15.5:0/438491445 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fafd41125d0 con 0x7fafd4108aa0 2024-08-31T05:34:38.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.601+0000 7fafdb855640 1 -- 172.21.15.5:0/438491445 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fafd41128d0 con 0x7fafd4108150 2024-08-31T05:34:38.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.601+0000 7fafd9df2640 1 --2- 172.21.15.5:0/438491445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafd4108aa0 0x7fafd419f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:38.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.601+0000 7fafd8df0640 1 -- 172.21.15.5:0/438491445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafd4108aa0 msgr2=0x7fafd419f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:38.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.601+0000 7fafd8df0640 1 --2- 172.21.15.5:0/438491445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafd4108aa0 0x7fafd419f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:38.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.601+0000 7fafd8df0640 1 -- 172.21.15.5:0/438491445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafd4102ee0 msgr2=0x7fafd419a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:38.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.601+0000 7fafd8df0640 1 --2- 172.21.15.5:0/438491445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafd4102ee0 0x7fafd419a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:38.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.601+0000 7fafd8df0640 1 -- 172.21.15.5:0/438491445 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd419ffc0 con 0x7fafd4108150 2024-08-31T05:34:38.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.601+0000 7fafd95f1640 1 --2- 172.21.15.5:0/438491445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafd4102ee0 0x7fafd419a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:34:38.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.601+0000 7fafd8df0640 1 --2- 172.21.15.5:0/438491445 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafd4108150 0x7fafd419a5f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fafd40755c0 tx=0x7fafc400ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:38.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.602+0000 7fafca7fc640 1 -- 172.21.15.5:0/438491445 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc400ccd0 con 0x7fafd4108150 2024-08-31T05:34:38.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.602+0000 7fafca7fc640 1 -- 172.21.15.5:0/438491445 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fafc40035f0 con 0x7fafd4108150 2024-08-31T05:34:38.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.602+0000 7fafca7fc640 1 -- 172.21.15.5:0/438491445 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc4010690 con 0x7fafd4108150 2024-08-31T05:34:38.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.602+0000 7fafdb855640 1 -- 172.21.15.5:0/438491445 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafd41a02b0 con 0x7fafd4108150 2024-08-31T05:34:38.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.603+0000 7fafdb855640 1 -- 172.21.15.5:0/438491445 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafd41a6a10 con 0x7fafd4108150 2024-08-31T05:34:38.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.606+0000 7fafe1dca740 1 Processor -- start 2024-08-31T05:34:38.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.606+0000 7fafe1dca740 1 -- start start 2024-08-31T05:34:38.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.606+0000 7fafca7fc640 1 -- 172.21.15.5:0/438491445 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fafc4003a60 con 0x7fafd4108150 2024-08-31T05:34:38.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.606+0000 7fafe1dca740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561e29338070 0x561e296dd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:38.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.606+0000 7fafe1dca740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561e2930f1b0 0x561e296dd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:38.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.606+0000 7fafe1dca740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e29317390 0x561e296ddd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:38.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.606+0000 7fafe1dca740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x561e29654630 con 0x561e29338070 2024-08-31T05:34:38.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.606+0000 7fafe1dca740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x561e29643bc0 con 0x561e29317390 2024-08-31T05:34:38.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.606+0000 7fafe1dca740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561e29647b70 con 0x561e2930f1b0 2024-08-31T05:34:38.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.606+0000 7fafd95f1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561e2930f1b0 0x561e296dd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:38.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.606+0000 7fafd95f1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561e2930f1b0 0x561e296dd800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:58818/0 (socket says 172.21.15.5:58818) 2024-08-31T05:34:38.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.606+0000 7fafd95f1640 1 -- 172.21.15.5:0/1218520678 learned_addr learned my addr 172.21.15.5:0/1218520678 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:38.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.607+0000 7fafd8df0640 1 --2- 172.21.15.5:0/1218520678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e29317390 0x561e296ddd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:38.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.607+0000 7fafd9df2640 1 --2- 172.21.15.5:0/1218520678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561e29338070 0x561e296dd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:38.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.607+0000 7fafd95f1640 1 -- 172.21.15.5:0/1218520678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e29317390 msgr2=0x561e296ddd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:38.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.607+0000 7fafd95f1640 1 --2- 172.21.15.5:0/1218520678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e29317390 0x561e296ddd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:38.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.607+0000 7fafd95f1640 1 -- 172.21.15.5:0/1218520678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561e29338070 msgr2=0x561e296dd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:38.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.607+0000 7fafd95f1640 1 --2- 172.21.15.5:0/1218520678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561e29338070 0x561e296dd2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:38.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.607+0000 7fafd95f1640 1 -- 172.21.15.5:0/1218520678 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e293a3650 con 0x561e2930f1b0 2024-08-31T05:34:38.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.607+0000 7fafd95f1640 1 --2- 172.21.15.5:0/1218520678 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561e2930f1b0 0x561e296dd800 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fafd000be10 tx=0x7fafd000f730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=927380116fee5b53 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:38.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.607+0000 7fafbf7fe640 1 -- 172.21.15.5:0/1218520678 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafd0015070 con 0x561e2930f1b0 2024-08-31T05:34:38.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.608+0000 7fafbf7fe640 1 -- 172.21.15.5:0/1218520678 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fafd00118f0 con 0x561e2930f1b0 2024-08-31T05:34:38.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.608+0000 7fafbf7fe640 1 -- 172.21.15.5:0/1218520678 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafd0010770 con 0x561e2930f1b0 2024-08-31T05:34:38.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.608+0000 7fafca7fc640 1 --2- 172.21.15.5:0/438491445 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fafc00b4ca0 0x7fafc00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:38.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.608+0000 7fafd9df2640 1 --2- 172.21.15.5:0/438491445 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fafc00b4ca0 0x7fafc00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:38.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.609+0000 7fafca7fc640 1 -- 172.21.15.5:0/438491445 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fafc40e5af0 con 0x7fafd4108150 2024-08-31T05:34:38.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.609+0000 7fafe1dca740 1 -- 172.21.15.5:0/1218520678 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561e2930f1b0 msgr2=0x561e296dd800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:38.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.609+0000 7fafe1dca740 1 --2- 172.21.15.5:0/1218520678 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561e2930f1b0 0x561e296dd800 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fafd000be10 tx=0x7fafd000f730 comp rx=0 tx=0).stop 2024-08-31T05:34:38.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.609+0000 7fafe1dca740 1 -- 172.21.15.5:0/1218520678 shutdown_connections 2024-08-31T05:34:38.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.609+0000 7fafe1dca740 1 --2- 172.21.15.5:0/1218520678 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e29317390 0x561e296ddd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:38.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.609+0000 7fafe1dca740 1 --2- 172.21.15.5:0/1218520678 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561e2930f1b0 0x561e296dd800 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:38.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.609+0000 7fafe1dca740 1 --2- 172.21.15.5:0/1218520678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561e29338070 0x561e296dd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:38.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.609+0000 7fafe1dca740 1 -- 172.21.15.5:0/1218520678 >> 172.21.15.5:0/1218520678 conn(0x561e2932c460 msgr2=0x561e296db1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:38.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.609+0000 7fafe1dca740 1 -- 172.21.15.5:0/1218520678 shutdown_connections 2024-08-31T05:34:38.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.609+0000 7fafe1dca740 1 -- 172.21.15.5:0/1218520678 wait complete. 2024-08-31T05:34:38.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.609+0000 7fafd9df2640 1 --2- 172.21.15.5:0/438491445 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fafc00b4ca0 0x7fafc00b71b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fafcc009370 tx=0x7fafcc00b040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:38.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.609+0000 7fafe1dca740 1 -- start start 2024-08-31T05:34:38.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.610+0000 7fafe1dca740 1 Processor -- start 2024-08-31T05:34:38.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.610+0000 7fafe1dca740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561e2930f1b0 0x561e296e8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:38.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.610+0000 7fafe1dca740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561e29317390 0x561e296e8f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:38.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.610+0000 7fafe1dca740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e29338070 0x561e296f4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:38.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.610+0000 7fafe1dca740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x561e294a6700 con 0x561e2930f1b0 2024-08-31T05:34:38.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.610+0000 7fafe1dca740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x561e295ca700 con 0x561e29338070 2024-08-31T05:34:38.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.610+0000 7fafe1dca740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561e296ebaa0 con 0x561e29317390 2024-08-31T05:34:38.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.610+0000 7fafe1dca740 10 client.0 _ll_register_callbacks cb 0x561e295f9dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:34:38.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.610+0000 7fafd95f1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561e2930f1b0 0x561e296e8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:38.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.610+0000 7fafd95f1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561e2930f1b0 0x561e296e8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43474/0 (socket says 172.21.15.5:43474) 2024-08-31T05:34:38.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.610+0000 7fafd95f1640 1 -- 172.21.15.5:0/2555165806 learned_addr learned my addr 172.21.15.5:0/2555165806 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:38.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.611+0000 7fafd8df0640 1 --2- 172.21.15.5:0/2555165806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561e29317390 0x561e296e8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:38.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.611+0000 7fafd9df2640 1 --2- 172.21.15.5:0/2555165806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e29338070 0x561e296f4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:38.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.611+0000 7fafd8df0640 1 -- 172.21.15.5:0/2555165806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e29338070 msgr2=0x561e296f4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:38.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.611+0000 7fafd8df0640 1 --2- 172.21.15.5:0/2555165806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e29338070 0x561e296f4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:38.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.611+0000 7fafd8df0640 1 -- 172.21.15.5:0/2555165806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561e2930f1b0 msgr2=0x561e296e8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:38.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.611+0000 7fafd8df0640 1 --2- 172.21.15.5:0/2555165806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561e2930f1b0 0x561e296e8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:38.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.611+0000 7fafd8df0640 1 -- 172.21.15.5:0/2555165806 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e296038b0 con 0x561e29317390 2024-08-31T05:34:38.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.611+0000 7fafd95f1640 1 --2- 172.21.15.5:0/2555165806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561e2930f1b0 0x561e296e8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:34:38.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.611+0000 7fafd8df0640 1 --2- 172.21.15.5:0/2555165806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561e29317390 0x561e296e8f90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fafc40e2e60 tx=0x7fafc40e33d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1fe3a636b614390 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:38.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.611+0000 7fafbcff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:34:38.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.611+0000 7fafbcff9640 1 -- 172.21.15.5:0/2555165806 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc40ab750 con 0x561e29317390 2024-08-31T05:34:38.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.612+0000 7fafe1dca740 1 -- 172.21.15.5:0/2555165806 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fafd00118f0 con 0x561e29317390 2024-08-31T05:34:38.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.612+0000 7fafbcff9640 1 -- 172.21.15.5:0/2555165806 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fafc40b4c90 con 0x561e29317390 2024-08-31T05:34:38.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.612+0000 7fafbcff9640 1 -- 172.21.15.5:0/2555165806 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fafc40ab570 con 0x561e29317390 2024-08-31T05:34:38.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.612+0000 7fafe1dca740 10 client.26377 fetch_fsmap learned FSMap version 34 2024-08-31T05:34:38.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.612+0000 7fafe1dca740 1 -- 172.21.15.5:0/2555165806 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x561e296f7930 con 0x561e29317390 2024-08-31T05:34:38.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.612+0000 7fafbcff9640 1 -- 172.21.15.5:0/2555165806 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fafc40ab910 con 0x561e29317390 2024-08-31T05:34:38.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.612+0000 7fafbcff9640 1 -- 172.21.15.5:0/2555165806 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fafc40b02b0 con 0x561e29317390 2024-08-31T05:34:38.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.612+0000 7fafe1dca740 10 client.26377 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:34:38.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.612+0000 7fafe1dca740 10 client.26377 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:34:38.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.613+0000 7fafe1dca740 20 client.26377 populate_metadata read hostname 'smithi005' 2024-08-31T05:34:38.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.613+0000 7fafe1dca740 1 --2- 172.21.15.5:0/2555165806 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561e292f69f0 0x561e296fada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:38.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.613+0000 7fafe1dca740 4 client.26377 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:34:38.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.613+0000 7fafe1dca740 1 -- 172.21.15.5:0/2555165806 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fafd00118f0 con 0x561e292f69f0 2024-08-31T05:34:38.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.613+0000 7fafd95f1640 1 --2- 172.21.15.5:0/2555165806 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561e292f69f0 0x561e296fada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:38.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.613+0000 7fafbcff9640 10 client.26377 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:34:38.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.613+0000 7fafd95f1640 1 --2- 172.21.15.5:0/2555165806 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561e292f69f0 0x561e296fada0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e24e79ef93188800 server_cookie=b3eac01622298e19 in_seq=0 out_seq=0 2024-08-31T05:34:38.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.614+0000 7fafbcff9640 1 -- 172.21.15.5:0/2555165806 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fafd00118f0 con 0x561e292f69f0 2024-08-31T05:34:38.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.614+0000 7fafbcff9640 10 client.26377 handle_command_reply: tid=0 2024-08-31T05:34:38.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.614+0000 7fafe1dca740 1 client.26377 shutdown 2024-08-31T05:34:38.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.614+0000 7fafe1dca740 1 -- 172.21.15.5:0/2555165806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561e29317390 msgr2=0x561e296e8f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:38.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.614+0000 7fafe1dca740 1 --2- 172.21.15.5:0/2555165806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561e29317390 0x561e296e8f90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fafc40e2e60 tx=0x7fafc40e33d0 comp rx=0 tx=0).stop 2024-08-31T05:34:38.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.614+0000 7fafe1dca740 1 -- 172.21.15.5:0/2555165806 shutdown_connections 2024-08-31T05:34:38.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.614+0000 7fafe1dca740 1 --2- 172.21.15.5:0/2555165806 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561e292f69f0 0x561e296fada0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:38.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.614+0000 7fafe1dca740 1 --2- 172.21.15.5:0/2555165806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e29338070 0x561e296f4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:38.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.614+0000 7fafe1dca740 1 --2- 172.21.15.5:0/2555165806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561e29317390 0x561e296e8f90 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:38.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.614+0000 7fafe1dca740 1 --2- 172.21.15.5:0/2555165806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561e2930f1b0 0x561e296e8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:38.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.614+0000 7fafe1dca740 1 -- 172.21.15.5:0/2555165806 >> 172.21.15.5:0/2555165806 conn(0x561e2932c460 msgr2=0x561e296e04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:38.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.614+0000 7fafbcff9640 0 client.26377 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:34:38.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.615+0000 7fafe1dca740 1 -- 172.21.15.5:0/2555165806 shutdown_connections 2024-08-31T05:34:38.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.615+0000 7fafe1dca740 1 -- 172.21.15.5:0/2555165806 wait complete. 2024-08-31T05:34:38.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.615+0000 7fafe1dca740 20 client.26377 trim_cache size 0 max 16384 2024-08-31T05:34:38.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.634+0000 7fafe1dca740 1 Processor -- start 2024-08-31T05:34:38.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.634+0000 7fafe1dca740 1 -- start start 2024-08-31T05:34:38.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.634+0000 7fafe1dca740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561e2930f1b0 0x561e296ea680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:38.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.634+0000 7fafe1dca740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e29317390 0x561e296e5c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:38.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.634+0000 7fafe1dca740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561e29338070 0x561e296e6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:38.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.634+0000 7fafe1dca740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fafd41ae9e0 con 0x561e29338070 2024-08-31T05:34:38.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.634+0000 7fafe1dca740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fafd41b0520 con 0x561e29317390 2024-08-31T05:34:38.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.634+0000 7fafe1dca740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fafd41af0b0 con 0x561e2930f1b0 2024-08-31T05:34:38.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.635+0000 7fafd9df2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561e29338070 0x561e296e6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:38.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.635+0000 7fafd9df2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561e29338070 0x561e296e6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43490/0 (socket says 172.21.15.5:43490) 2024-08-31T05:34:38.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.635+0000 7fafd9df2640 1 -- 172.21.15.5:0/3801651503 learned_addr learned my addr 172.21.15.5:0/3801651503 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:38.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.635+0000 7fafd95f1640 1 --2- 172.21.15.5:0/3801651503 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561e2930f1b0 0x561e296ea680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:38.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.635+0000 7fafd8df0640 1 --2- 172.21.15.5:0/3801651503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e29317390 0x561e296e5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:38.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.635+0000 7fafd9df2640 1 -- 172.21.15.5:0/3801651503 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561e2930f1b0 msgr2=0x561e296ea680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:38.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.635+0000 7fafd9df2640 1 --2- 172.21.15.5:0/3801651503 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561e2930f1b0 0x561e296ea680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:38.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.635+0000 7fafd9df2640 1 -- 172.21.15.5:0/3801651503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e29317390 msgr2=0x561e296e5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:38.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.635+0000 7fafd9df2640 1 --2- 172.21.15.5:0/3801651503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e29317390 0x561e296e5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:38.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.635+0000 7fafd9df2640 1 -- 172.21.15.5:0/3801651503 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e296d5380 con 0x561e29338070 2024-08-31T05:34:38.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.635+0000 7fafd8df0640 1 --2- 172.21.15.5:0/3801651503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e29317390 0x561e296e5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:34:38.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.635+0000 7fafd9df2640 1 --2- 172.21.15.5:0/3801651503 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561e29338070 0x561e296e6180 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fafcc009be0 tx=0x7fafcc040070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f633404be4bb48a5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:38.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.635+0000 7fafbeffd640 1 -- 172.21.15.5:0/3801651503 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafcc036040 con 0x561e29338070 2024-08-31T05:34:38.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.636+0000 7fafbeffd640 1 -- 172.21.15.5:0/3801651503 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fafcc050070 con 0x561e29338070 2024-08-31T05:34:38.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.636+0000 7fafbeffd640 1 -- 172.21.15.5:0/3801651503 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafcc0556d0 con 0x561e29338070 2024-08-31T05:34:38.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.637+0000 7fafe1dca740 1 -- 172.21.15.5:0/3801651503 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561e29338070 msgr2=0x561e296e6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:38.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.637+0000 7fafe1dca740 1 --2- 172.21.15.5:0/3801651503 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561e29338070 0x561e296e6180 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fafcc009be0 tx=0x7fafcc040070 comp rx=0 tx=0).stop 2024-08-31T05:34:38.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.637+0000 7fafe1dca740 1 -- 172.21.15.5:0/3801651503 shutdown_connections 2024-08-31T05:34:38.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.637+0000 7fafe1dca740 1 --2- 172.21.15.5:0/3801651503 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561e29338070 0x561e296e6180 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:38.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.637+0000 7fafe1dca740 1 --2- 172.21.15.5:0/3801651503 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e29317390 0x561e296e5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:38.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.637+0000 7fafe1dca740 1 --2- 172.21.15.5:0/3801651503 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561e2930f1b0 0x561e296ea680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:38.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.637+0000 7fafe1dca740 1 -- 172.21.15.5:0/3801651503 >> 172.21.15.5:0/3801651503 conn(0x561e2932c460 msgr2=0x561e296e9f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:38.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.637+0000 7fafe1dca740 1 -- 172.21.15.5:0/3801651503 shutdown_connections 2024-08-31T05:34:38.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.637+0000 7fafe1dca740 1 -- 172.21.15.5:0/3801651503 wait complete. 2024-08-31T05:34:38.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.637+0000 7fafe1dca740 1 -- start start 2024-08-31T05:34:38.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.637+0000 7fafe1dca740 1 Processor -- start 2024-08-31T05:34:38.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.638+0000 7fafe1dca740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e2930f1b0 0x561e296f1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:38.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.638+0000 7fafe1dca740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561e29317390 0x561e296ee820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:38.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.638+0000 7fafe1dca740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561e29338070 0x561e296eed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:38.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.638+0000 7fafe1dca740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fafd41afe50 con 0x561e29317390 2024-08-31T05:34:38.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.638+0000 7fafe1dca740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fafd41af780 con 0x561e2930f1b0 2024-08-31T05:34:38.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.638+0000 7fafe1dca740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fafd41ac9c0 con 0x561e29338070 2024-08-31T05:34:38.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.638+0000 7fafd8df0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561e29317390 0x561e296ee820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:38.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.638+0000 7fafd8df0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561e29317390 0x561e296ee820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43500/0 (socket says 172.21.15.5:43500) 2024-08-31T05:34:38.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.638+0000 7fafd95f1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e2930f1b0 0x561e296f1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:38.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.638+0000 7fafd8df0640 1 -- 172.21.15.5:0/1139736931 learned_addr learned my addr 172.21.15.5:0/1139736931 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:38.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.638+0000 7fafd9df2640 1 --2- 172.21.15.5:0/1139736931 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561e29338070 0x561e296eed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:38.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.638+0000 7fafe1dca740 10 client.0 _ll_register_callbacks cb 0x7fafc40ed6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:34:38.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.638+0000 7fafd8df0640 1 -- 172.21.15.5:0/1139736931 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561e29338070 msgr2=0x561e296eed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:38.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.638+0000 7fafd8df0640 1 --2- 172.21.15.5:0/1139736931 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561e29338070 0x561e296eed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:38.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.638+0000 7fafd8df0640 1 -- 172.21.15.5:0/1139736931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e2930f1b0 msgr2=0x561e296f1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:38.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.638+0000 7fafd8df0640 1 --2- 172.21.15.5:0/1139736931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e2930f1b0 0x561e296f1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:38.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.638+0000 7fafd8df0640 1 -- 172.21.15.5:0/1139736931 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e296ef3a0 con 0x561e29317390 2024-08-31T05:34:38.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.638+0000 7fafd95f1640 1 --2- 172.21.15.5:0/1139736931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e2930f1b0 0x561e296f1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:34:38.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.638+0000 7fafd8df0640 1 --2- 172.21.15.5:0/1139736931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561e29317390 0x561e296ee820 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fafc40b5090 tx=0x7fafc40a7cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7f82427a83db576 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:38.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.638+0000 7fafbcff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:34:38.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.639+0000 7fafbcff9640 1 -- 172.21.15.5:0/1139736931 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc40d2060 con 0x561e29317390 2024-08-31T05:34:38.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.639+0000 7fafbcff9640 1 -- 172.21.15.5:0/1139736931 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fafc40a83f0 con 0x561e29317390 2024-08-31T05:34:38.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.639+0000 7fafe1dca740 1 -- 172.21.15.5:0/1139736931 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fafcc050070 con 0x561e29317390 2024-08-31T05:34:38.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.639+0000 7fafbcff9640 1 -- 172.21.15.5:0/1139736931 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fafc40ab750 con 0x561e29317390 2024-08-31T05:34:38.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.639+0000 7fafe1dca740 10 client.16776 fetch_fsmap learned FSMap version 34 2024-08-31T05:34:38.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.639+0000 7fafe1dca740 1 -- 172.21.15.5:0/1139736931 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x561e297654f0 con 0x561e29317390 2024-08-31T05:34:38.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.639+0000 7fafbcff9640 1 -- 172.21.15.5:0/1139736931 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fafcc050070 con 0x561e29317390 2024-08-31T05:34:38.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.639+0000 7fafbcff9640 1 -- 172.21.15.5:0/1139736931 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fafc40aaad0 con 0x561e29317390 2024-08-31T05:34:38.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.639+0000 7fafe1dca740 10 client.16776 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:34:38.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.639+0000 7fafe1dca740 10 client.16776 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:34:38.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.639+0000 7fafe1dca740 20 client.16776 populate_metadata read hostname 'smithi005' 2024-08-31T05:34:38.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.639+0000 7fafe1dca740 1 --2- 172.21.15.5:0/1139736931 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561e292cbda0 0x561e29767b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:38.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.639+0000 7fafe1dca740 4 client.16776 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T05:34:38.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.639+0000 7fafe1dca740 1 -- 172.21.15.5:0/1139736931 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561e29656580 con 0x561e292cbda0 2024-08-31T05:34:38.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.640+0000 7fafd95f1640 1 --2- 172.21.15.5:0/1139736931 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561e292cbda0 0x561e29767b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:38.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.640+0000 7fafbcff9640 10 client.16776 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:34:38.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.640+0000 7fafd95f1640 1 --2- 172.21.15.5:0/1139736931 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561e292cbda0 0x561e29767b20 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=add9df6a3e509228 server_cookie=95968aacc67d01fe in_seq=0 out_seq=0 2024-08-31T05:34:38.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.640+0000 7fafbcff9640 1 -- 172.21.15.5:0/1139736931 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1794 (crc 0 0 0) 0x561e29656580 con 0x561e292cbda0 2024-08-31T05:34:38.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.640+0000 7fafbcff9640 10 client.16776 handle_command_reply: tid=0 2024-08-31T05:34:38.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.640+0000 7fafe1dca740 1 client.16776 shutdown 2024-08-31T05:34:38.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.640+0000 7fafe1dca740 1 -- 172.21.15.5:0/1139736931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561e29317390 msgr2=0x561e296ee820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:38.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.640+0000 7fafe1dca740 1 --2- 172.21.15.5:0/1139736931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561e29317390 0x561e296ee820 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fafc40b5090 tx=0x7fafc40a7cc0 comp rx=0 tx=0).stop 2024-08-31T05:34:38.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.641+0000 7fafe1dca740 1 -- 172.21.15.5:0/1139736931 shutdown_connections 2024-08-31T05:34:38.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.641+0000 7fafe1dca740 1 --2- 172.21.15.5:0/1139736931 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561e292cbda0 0x561e29767b20 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:38.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.641+0000 7fafe1dca740 1 --2- 172.21.15.5:0/1139736931 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561e29338070 0x561e296eed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:38.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.641+0000 7fafe1dca740 1 --2- 172.21.15.5:0/1139736931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561e29317390 0x561e296ee820 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:38.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.641+0000 7fafbcff9640 0 client.16776 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:34:38.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.641+0000 7fafe1dca740 1 --2- 172.21.15.5:0/1139736931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561e2930f1b0 0x561e296f1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:38.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.641+0000 7fafe1dca740 1 -- 172.21.15.5:0/1139736931 >> 172.21.15.5:0/1139736931 conn(0x561e2932c460 msgr2=0x561e296e9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:38.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.641+0000 7fafe1dca740 1 -- 172.21.15.5:0/1139736931 shutdown_connections 2024-08-31T05:34:38.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.641+0000 7fafe1dca740 1 -- 172.21.15.5:0/1139736931 wait complete. 2024-08-31T05:34:38.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.641+0000 7fafe1dca740 20 client.16776 trim_cache size 0 max 16384 2024-08-31T05:34:38.647 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:34:38.647 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "no active scrubs running", 2024-08-31T05:34:38.647 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": {}, 2024-08-31T05:34:38.647 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_stats": { 2024-08-31T05:34:38.647 INFO:teuthology.orchestra.run.smithi005.stdout: "0bb67292-013a-40c7-b5fc-810bdd9715d8": { 2024-08-31T05:34:38.647 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:34:04.586008+0000", 2024-08-31T05:34:38.648 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:34:38.648 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:34:38.648 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:34:38.648 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:34:38.648 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:34:38.648 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:34:38.648 INFO:teuthology.orchestra.run.smithi005.stdout: "728a42ca-bbef-4151-830f-5fdd411d8fa0": { 2024-08-31T05:34:38.648 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:32:30.554906+0000", 2024-08-31T05:34:38.648 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:34:38.648 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:34:38.648 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:34:38.648 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:34:38.648 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:34:38.649 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:34:38.649 INFO:teuthology.orchestra.run.smithi005.stdout: "2445fc42-b797-434f-b380-e2da985b4d98": { 2024-08-31T05:34:38.649 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:33:17.681453+0000", 2024-08-31T05:34:38.649 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:34:38.649 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:34:38.649 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:34:38.649 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:34:38.649 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:34:38.649 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:34:38.649 INFO:teuthology.orchestra.run.smithi005.stdout: "cda92ac0-b35f-47a5-a3a5-471c888462a5": { 2024-08-31T05:34:38.649 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:53.103905+0000", 2024-08-31T05:34:38.649 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:34:38.649 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:34:38.649 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:34:38.649 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:34:38.650 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:34:38.650 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:34:38.650 INFO:teuthology.orchestra.run.smithi005.stdout: "ece37b07-9ab2-45f8-bc33-2755a07aac0b": { 2024-08-31T05:34:38.650 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:31:41.782407+0000", 2024-08-31T05:34:38.650 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:34:38.650 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:34:38.650 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:34:38.650 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:34:38.650 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:34:38.650 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:34:38.650 INFO:teuthology.orchestra.run.smithi005.stdout: "75d84398-5d9c-4872-b879-2fbce045fa71": { 2024-08-31T05:34:38.650 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:06.642335+0000", 2024-08-31T05:34:38.650 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:34:38.651 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:34:38.651 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:34:38.651 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:34:38.651 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:34:38.651 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:34:38.651 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:34:38.651 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:34:38.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.641+0000 7fafdb855640 1 -- 172.21.15.5:0/438491445 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fafc00b4ca0 msgr2=0x7fafc00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:38.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.641+0000 7fafdb855640 1 --2- 172.21.15.5:0/438491445 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fafc00b4ca0 0x7fafc00b71b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fafcc009370 tx=0x7fafcc00b040 comp rx=0 tx=0).stop 2024-08-31T05:34:38.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.641+0000 7fafdb855640 1 -- 172.21.15.5:0/438491445 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafd4108150 msgr2=0x7fafd419a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:38.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.641+0000 7fafdb855640 1 --2- 172.21.15.5:0/438491445 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafd4108150 0x7fafd419a5f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fafd40755c0 tx=0x7fafc400ee50 comp rx=0 tx=0).stop 2024-08-31T05:34:38.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.641+0000 7fafdb855640 1 -- 172.21.15.5:0/438491445 shutdown_connections 2024-08-31T05:34:38.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.641+0000 7fafdb855640 1 --2- 172.21.15.5:0/438491445 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fafc00b4ca0 0x7fafc00b71b0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:38.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.641+0000 7fafdb855640 1 --2- 172.21.15.5:0/438491445 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fafd4108aa0 0x7fafd419f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:38.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.641+0000 7fafdb855640 1 --2- 172.21.15.5:0/438491445 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafd4108150 0x7fafd419a5f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:38.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.641+0000 7fafdb855640 1 --2- 172.21.15.5:0/438491445 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fafd4102ee0 0x7fafd419a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:38.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.641+0000 7fafdb855640 1 -- 172.21.15.5:0/438491445 >> 172.21.15.5:0/438491445 conn(0x7fafd4077a00 msgr2=0x7fafd4104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:38.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.642+0000 7fafdb855640 1 -- 172.21.15.5:0/438491445 shutdown_connections 2024-08-31T05:34:38.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:38.642+0000 7fafdb855640 1 -- 172.21.15.5:0/438491445 wait complete. 2024-08-31T05:34:38.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:34:38 smithi005 ceph-mon[18602]: pgmap v485: 129 pgs: 129 active+clean; 275 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.5 MiB/s wr, 237 op/s 2024-08-31T05:34:38.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:34:38 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:34:38.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:34:38 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:34:38.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:34:38 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:34:38.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:34:38 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:34:38.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:34:38 smithi050 ceph-mon[22146]: pgmap v485: 129 pgs: 129 active+clean; 275 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.5 MiB/s wr, 237 op/s 2024-08-31T05:34:38.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:34:38 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:34:38.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:34:38 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:34:38.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:34:38 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:34:38.907 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:34:38 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:34:38.916 INFO:tasks.workunit.client.0.smithi005.stdout: 1 512504 13.31 MB/sec execute 86 sec latency 82.118 ms 2024-08-31T05:34:39.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:34:38 smithi070 ceph-mon[22316]: pgmap v485: 129 pgs: 129 active+clean; 275 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.5 MiB/s wr, 237 op/s 2024-08-31T05:34:39.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:34:38 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:34:39.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:34:38 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:34:39.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:34:38 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:34:39.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:34:38 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:34:39.859 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T05:34:39.860 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T05:34:39.916 INFO:tasks.workunit.client.0.smithi005.stdout: 1 515512 13.37 MB/sec execute 87 sec latency 16.158 ms 2024-08-31T05:34:40.122 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:34:40.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:40.640+0000 7f916aeeb640 1 -- 172.21.15.5:0/3375185227 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9164104750 msgr2=0x7f9164104b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:40.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:40.640+0000 7f916aeeb640 1 --2- 172.21.15.5:0/3375185227 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9164104750 0x7f9164104b60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9158009860 tx=0x7f915802a340 comp rx=0 tx=0).stop 2024-08-31T05:34:40.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:40.640+0000 7f916aeeb640 1 -- 172.21.15.5:0/3375185227 shutdown_connections 2024-08-31T05:34:40.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:40.640+0000 7f916aeeb640 1 --2- 172.21.15.5:0/3375185227 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f916410dbb0 0x7f91641100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:40.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:40.640+0000 7f916aeeb640 1 --2- 172.21.15.5:0/3375185227 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91641050a0 0x7f916410d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:40.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:40.640+0000 7f916aeeb640 1 --2- 172.21.15.5:0/3375185227 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9164104750 0x7f9164104b60 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:40.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:40.640+0000 7f916aeeb640 1 -- 172.21.15.5:0/3375185227 >> 172.21.15.5:0/3375185227 conn(0x7f91640794d0 msgr2=0x7f91640798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:40.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:40.640+0000 7f916aeeb640 1 -- 172.21.15.5:0/3375185227 shutdown_connections 2024-08-31T05:34:40.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:40.640+0000 7f916aeeb640 1 -- 172.21.15.5:0/3375185227 wait complete. 2024-08-31T05:34:40.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:40.641+0000 7f916aeeb640 1 Processor -- start 2024-08-31T05:34:40.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:40.641+0000 7f916aeeb640 1 -- start start 2024-08-31T05:34:40.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:40.641+0000 7f916aeeb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9164104750 0x7f916419a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:40.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:40.641+0000 7f916aeeb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91641050a0 0x7f916419a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:40.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:40.641+0000 7f916aeeb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f916410dbb0 0x7f916419fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:40.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:40.641+0000 7f916aeeb640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9164113810 con 0x7f91641050a0 2024-08-31T05:34:40.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:40.641+0000 7f916aeeb640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9164113690 con 0x7f9164104750 2024-08-31T05:34:40.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:40.641+0000 7f916aeeb640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9164113990 con 0x7f916410dbb0 2024-08-31T05:34:40.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:40.641+0000 7f9163fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91641050a0 0x7f916419a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:40.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:40.641+0000 7f9163fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91641050a0 0x7f916419a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43520/0 (socket says 172.21.15.5:43520) 2024-08-31T05:34:40.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:40.641+0000 7f9163fff640 1 -- 172.21.15.5:0/771372144 learned_addr learned my addr 172.21.15.5:0/771372144 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:40.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:40.641+0000 7f9168c87640 1 --2- 172.21.15.5:0/771372144 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9164104750 0x7f916419a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:40.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:40.641+0000 7f9169488640 1 --2- 172.21.15.5:0/771372144 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f916410dbb0 0x7f916419fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:40.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:40.641+0000 7f9163fff640 1 -- 172.21.15.5:0/771372144 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f916410dbb0 msgr2=0x7f916419fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:40.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:40.641+0000 7f9163fff640 1 --2- 172.21.15.5:0/771372144 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f916410dbb0 0x7f916419fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:40.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:40.641+0000 7f9163fff640 1 -- 172.21.15.5:0/771372144 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9164104750 msgr2=0x7f916419a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:40.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:40.641+0000 7f9163fff640 1 --2- 172.21.15.5:0/771372144 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9164104750 0x7f916419a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:40.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:40.641+0000 7f9163fff640 1 -- 172.21.15.5:0/771372144 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91641a01f0 con 0x7f91641050a0 2024-08-31T05:34:40.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:40.642+0000 7f9163fff640 1 --2- 172.21.15.5:0/771372144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91641050a0 0x7f916419a820 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f91500058c0 tx=0x7f915000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:40.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:40.642+0000 7f9161ffb640 1 -- 172.21.15.5:0/771372144 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f915000cd30 con 0x7f91641050a0 2024-08-31T05:34:40.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:40.642+0000 7f916aeeb640 1 -- 172.21.15.5:0/771372144 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91641a04e0 con 0x7f91641050a0 2024-08-31T05:34:40.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:40.642+0000 7f9161ffb640 1 -- 172.21.15.5:0/771372144 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91500035f0 con 0x7f91641050a0 2024-08-31T05:34:40.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:40.642+0000 7f9161ffb640 1 -- 172.21.15.5:0/771372144 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91500044e0 con 0x7f91641050a0 2024-08-31T05:34:40.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:40.642+0000 7f916aeeb640 1 -- 172.21.15.5:0/771372144 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91641a6c40 con 0x7f91641050a0 2024-08-31T05:34:40.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:40.643+0000 7f916aeeb640 1 -- 172.21.15.5:0/771372144 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9164104b60 con 0x7f91641050a0 2024-08-31T05:34:40.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:40.645+0000 7f9161ffb640 1 -- 172.21.15.5:0/771372144 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f9150003a50 con 0x7f91641050a0 2024-08-31T05:34:40.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:40.645+0000 7f9161ffb640 1 --2- 172.21.15.5:0/771372144 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f91540b4ca0 0x7f91540b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:40.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:40.645+0000 7f9168c87640 1 --2- 172.21.15.5:0/771372144 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f91540b4ca0 0x7f91540b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:40.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:40.645+0000 7f9161ffb640 1 -- 172.21.15.5:0/771372144 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f91500e5bc0 con 0x7f91641050a0 2024-08-31T05:34:40.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:40.646+0000 7f9168c87640 1 --2- 172.21.15.5:0/771372144 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f91540b4ca0 0x7f91540b71b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9158009830 tx=0x7f91580058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:40.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:40.649+0000 7f9161ffb640 1 -- 172.21.15.5:0/771372144 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f91500ac6c0 con 0x7f91641050a0 2024-08-31T05:34:40.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:40.884+0000 7f916aeeb640 1 -- 172.21.15.5:0/771372144 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9164108d10 con 0x7f91641050a0 2024-08-31T05:34:40.887 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:34:40 smithi005 ceph-mon[18602]: pgmap v486: 129 pgs: 129 active+clean; 282 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.5 MiB/s wr, 302 op/s 2024-08-31T05:34:40.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:40.885+0000 7f9161ffb640 1 -- 172.21.15.5:0/771372144 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11941 (secure 0 0 0) 0x7f91500abfc0 con 0x7f91641050a0 2024-08-31T05:34:40.888 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:34:40.888 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":34,"btime":"2024-08-31T05:33:43:289944+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14739,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2024812199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2024812199},{"type":"v1","addr":"172.21.15.5:6835","nonce":2024812199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3629023702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3629023702},{"type":"v1","addr":"172.21.15.5:6837","nonce":3629023702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T05:27:31.929153+0000","modified":"2024-08-31T05:33:42.378207+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24652,"mds_1":24638,"mds_2":24631,"mds_3":24625,"mds_4":24602},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6839/2412701258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":2412701258},{"type":"v1","addr":"172.21.15.5:6839","nonce":2412701258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14820":{"gid":14820,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6841/747057838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":747057838},{"type":"v1","addr":"172.21.15.5:6841","nonce":747057838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6833/1153378982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1153378982},{"type":"v1","addr":"172.21.15.50:6833","nonce":1153378982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6833/364083443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":364083443},{"type":"v1","addr":"172.21.15.70:6833","nonce":364083443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24587":{"gid":24587,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/2346896794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2346896794},{"type":"v1","addr":"172.21.15.50:6835","nonce":2346896794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24602":{"gid":24602,"name":"h","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.50:6837/428759669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":428759669},{"type":"v1","addr":"172.21.15.50:6837","nonce":428759669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.70:6835/2061504114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2061504114},{"type":"v1","addr":"172.21.15.70:6835","nonce":2061504114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.70:6837/2780036414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2780036414},{"type":"v1","addr":"172.21.15.70:6837","nonce":2780036414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.50:6839/98200944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":98200944},{"type":"v1","addr":"172.21.15.50:6839","nonce":98200944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24652":{"gid":24652,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.70:6839/2756569250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":2756569250},{"type":"v1","addr":"172.21.15.70:6839","nonce":2756569250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24652,"qdb_cluster":[24652,24631,24638,24625,24602]},"id":1}]} 2024-08-31T05:34:40.888 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 34 2024-08-31T05:34:40.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:40.887+0000 7f916aeeb640 1 -- 172.21.15.5:0/771372144 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f91540b4ca0 msgr2=0x7f91540b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:40.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:40.887+0000 7f916aeeb640 1 --2- 172.21.15.5:0/771372144 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f91540b4ca0 0x7f91540b71b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9158009830 tx=0x7f91580058d0 comp rx=0 tx=0).stop 2024-08-31T05:34:40.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:40.887+0000 7f916aeeb640 1 -- 172.21.15.5:0/771372144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91641050a0 msgr2=0x7f916419a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:40.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:40.887+0000 7f916aeeb640 1 --2- 172.21.15.5:0/771372144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91641050a0 0x7f916419a820 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f91500058c0 tx=0x7f915000ee50 comp rx=0 tx=0).stop 2024-08-31T05:34:40.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:40.888+0000 7f916aeeb640 1 -- 172.21.15.5:0/771372144 shutdown_connections 2024-08-31T05:34:40.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:40.888+0000 7f916aeeb640 1 --2- 172.21.15.5:0/771372144 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f91540b4ca0 0x7f91540b71b0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:40.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:40.888+0000 7f916aeeb640 1 --2- 172.21.15.5:0/771372144 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f916410dbb0 0x7f916419fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:40.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:40.888+0000 7f916aeeb640 1 --2- 172.21.15.5:0/771372144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91641050a0 0x7f916419a820 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:40.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:40.888+0000 7f916aeeb640 1 --2- 172.21.15.5:0/771372144 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9164104750 0x7f916419a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:40.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:40.888+0000 7f916aeeb640 1 -- 172.21.15.5:0/771372144 >> 172.21.15.5:0/771372144 conn(0x7f91640794d0 msgr2=0x7f9164100550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:40.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:40.888+0000 7f916aeeb640 1 -- 172.21.15.5:0/771372144 shutdown_connections 2024-08-31T05:34:40.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:40.888+0000 7f916aeeb640 1 -- 172.21.15.5:0/771372144 wait complete. 2024-08-31T05:34:40.906 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:34:40 smithi050 ceph-mon[22146]: pgmap v486: 129 pgs: 129 active+clean; 282 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.5 MiB/s wr, 302 op/s 2024-08-31T05:34:40.916 INFO:tasks.workunit.client.0.smithi005.stdout: 1 518329 13.37 MB/sec execute 88 sec latency 43.192 ms 2024-08-31T05:34:41.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:34:40 smithi070 ceph-mon[22316]: pgmap v486: 129 pgs: 129 active+clean; 282 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.5 MiB/s wr, 302 op/s 2024-08-31T05:34:41.640 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-31T05:34:41.914 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:34:41.916 INFO:tasks.workunit.client.0.smithi005.stdout: 1 520923 13.35 MB/sec execute 89 sec latency 19.088 ms 2024-08-31T05:34:41.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:34:41 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/771372144' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:34:42.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:34:41 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/771372144' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:34:42.156 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:34:41 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/771372144' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:34:42.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.467+0000 7f2cecbcb640 1 -- 172.21.15.5:0/1302463855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ce8108140 msgr2=0x7f2ce8108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:42.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.467+0000 7f2cecbcb640 1 --2- 172.21.15.5:0/1302463855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ce8108140 0x7f2ce8108550 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f2cd0009900 tx=0x7f2cd002a400 comp rx=0 tx=0).stop 2024-08-31T05:34:42.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.467+0000 7f2cecbcb640 1 -- 172.21.15.5:0/1302463855 shutdown_connections 2024-08-31T05:34:42.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.467+0000 7f2cecbcb640 1 --2- 172.21.15.5:0/1302463855 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ce8108a90 0x7f2ce810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:42.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.467+0000 7f2cecbcb640 1 --2- 172.21.15.5:0/1302463855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ce8108140 0x7f2ce8108550 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:42.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.467+0000 7f2cecbcb640 1 --2- 172.21.15.5:0/1302463855 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ce8102800 0x7f2ce8102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:42.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.467+0000 7f2cecbcb640 1 -- 172.21.15.5:0/1302463855 >> 172.21.15.5:0/1302463855 conn(0x7f2ce80794d0 msgr2=0x7f2ce80798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:42.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.467+0000 7f2cecbcb640 1 -- 172.21.15.5:0/1302463855 shutdown_connections 2024-08-31T05:34:42.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.467+0000 7f2cecbcb640 1 -- 172.21.15.5:0/1302463855 wait complete. 2024-08-31T05:34:42.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.469+0000 7f2cecbcb640 1 Processor -- start 2024-08-31T05:34:42.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.469+0000 7f2cecbcb640 1 -- start start 2024-08-31T05:34:42.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.470+0000 7f2cecbcb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ce8102800 0x7f2ce819a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:42.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.470+0000 7f2cecbcb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ce8108140 0x7f2ce819a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:42.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.470+0000 7f2cecbcb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ce8108a90 0x7f2ce819fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:42.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.470+0000 7f2cecbcb640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce8113820 con 0x7f2ce8108a90 2024-08-31T05:34:42.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.470+0000 7f2cecbcb640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce81136a0 con 0x7f2ce8108140 2024-08-31T05:34:42.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.470+0000 7f2cecbcb640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce81139a0 con 0x7f2ce8102800 2024-08-31T05:34:42.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.470+0000 7f2cdffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ce8108140 0x7f2ce819a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:42.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.470+0000 7f2ce6d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ce8108a90 0x7f2ce819fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:42.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.471+0000 7f2ce6d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ce8108a90 0x7f2ce819fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40168/0 (socket says 172.21.15.5:40168) 2024-08-31T05:34:42.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.471+0000 7f2ce6d9d640 1 -- 172.21.15.5:0/856444031 learned_addr learned my addr 172.21.15.5:0/856444031 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:42.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.471+0000 7f2ce659c640 1 --2- 172.21.15.5:0/856444031 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ce8102800 0x7f2ce819a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:42.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.471+0000 7f2ce659c640 1 -- 172.21.15.5:0/856444031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ce8108140 msgr2=0x7f2ce819a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:42.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.471+0000 7f2ce659c640 1 --2- 172.21.15.5:0/856444031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ce8108140 0x7f2ce819a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:42.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.471+0000 7f2ce659c640 1 -- 172.21.15.5:0/856444031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ce8108a90 msgr2=0x7f2ce819fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:42.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.471+0000 7f2ce659c640 1 --2- 172.21.15.5:0/856444031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ce8108a90 0x7f2ce819fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:42.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.471+0000 7f2ce659c640 1 -- 172.21.15.5:0/856444031 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ce81a0180 con 0x7f2ce8102800 2024-08-31T05:34:42.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.471+0000 7f2cdffff640 1 --2- 172.21.15.5:0/856444031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ce8108140 0x7f2ce819a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:34:42.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.472+0000 7f2ce659c640 1 --2- 172.21.15.5:0/856444031 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ce8102800 0x7f2ce819a210 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2cd8009e90 tx=0x7f2cd800ed90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:42.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.474+0000 7f2cdf7fe640 1 -- 172.21.15.5:0/856444031 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd8020070 con 0x7f2ce8102800 2024-08-31T05:34:42.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.474+0000 7f2cdf7fe640 1 -- 172.21.15.5:0/856444031 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2cd8013c80 con 0x7f2ce8102800 2024-08-31T05:34:42.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.474+0000 7f2cdf7fe640 1 -- 172.21.15.5:0/856444031 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd801ba90 con 0x7f2ce8102800 2024-08-31T05:34:42.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.474+0000 7f2cecbcb640 1 -- 172.21.15.5:0/856444031 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ce81a0470 con 0x7f2ce8102800 2024-08-31T05:34:42.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.474+0000 7f2cecbcb640 1 -- 172.21.15.5:0/856444031 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ce810fc30 con 0x7f2ce8102800 2024-08-31T05:34:42.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.479+0000 7f2cf3140740 1 Processor -- start 2024-08-31T05:34:42.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.479+0000 7f2cf3140740 1 -- start start 2024-08-31T05:34:42.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.480+0000 7f2cf3140740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dc865c3070 0x55dc86968310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:42.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.480+0000 7f2cf3140740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc8659a1b0 0x55dc86968850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:42.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.480+0000 7f2ce6d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dc865c3070 0x55dc86968310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:42.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.480+0000 7f2ce6d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dc865c3070 0x55dc86968310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:50568/0 (socket says 172.21.15.5:50568) 2024-08-31T05:34:42.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.480+0000 7f2cf3140740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc865a2390 0x55dc86968d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:42.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.480+0000 7f2ce6d9d640 1 -- 172.21.15.5:0/1050261363 learned_addr learned my addr 172.21.15.5:0/1050261363 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:42.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.481+0000 7f2cf3140740 1 -- 172.21.15.5:0/1050261363 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55dc868df680 con 0x55dc865a2390 2024-08-31T05:34:42.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.481+0000 7f2cdf7fe640 1 -- 172.21.15.5:0/856444031 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f2cd8023070 con 0x7f2ce8102800 2024-08-31T05:34:42.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.481+0000 7f2cdffff640 1 --2- 172.21.15.5:0/1050261363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc865a2390 0x55dc86968d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:42.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.481+0000 7f2cf3140740 1 -- 172.21.15.5:0/1050261363 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55dc868cec10 con 0x55dc865c3070 2024-08-31T05:34:42.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.481+0000 7f2cf3140740 1 -- 172.21.15.5:0/1050261363 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55dc868d2bc0 con 0x55dc8659a1b0 2024-08-31T05:34:42.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.481+0000 7f2ce659c640 1 --2- 172.21.15.5:0/1050261363 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc8659a1b0 0x55dc86968850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:42.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.481+0000 7f2ce6d9d640 1 -- 172.21.15.5:0/1050261363 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc8659a1b0 msgr2=0x55dc86968850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:42.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.481+0000 7f2ce6d9d640 1 --2- 172.21.15.5:0/1050261363 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc8659a1b0 0x55dc86968850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:42.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.481+0000 7f2ce6d9d640 1 -- 172.21.15.5:0/1050261363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc865a2390 msgr2=0x55dc86968d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:42.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.481+0000 7f2ce6d9d640 1 --2- 172.21.15.5:0/1050261363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc865a2390 0x55dc86968d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:42.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.481+0000 7f2ce6d9d640 1 -- 172.21.15.5:0/1050261363 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc8662e650 con 0x55dc865c3070 2024-08-31T05:34:42.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.482+0000 7f2ce659c640 1 --2- 172.21.15.5:0/1050261363 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc8659a1b0 0x55dc86968850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:34:42.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.482+0000 7f2ce6d9d640 1 --2- 172.21.15.5:0/1050261363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dc865c3070 0x55dc86968310 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2ce00104d0 tx=0x7f2ce0010990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6be150157b543b2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:42.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.482+0000 7f2cdf7fe640 1 --2- 172.21.15.5:0/856444031 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2cd40b4da0 0x7f2cd40b72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:42.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.482+0000 7f2cdcff9640 1 -- 172.21.15.5:0/1050261363 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce0011760 con 0x55dc865c3070 2024-08-31T05:34:42.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.482+0000 7f2cdcff9640 1 -- 172.21.15.5:0/1050261363 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ce0011db0 con 0x55dc865c3070 2024-08-31T05:34:42.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.482+0000 7f2cdcff9640 1 -- 172.21.15.5:0/1050261363 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce00193d0 con 0x55dc865c3070 2024-08-31T05:34:42.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.482+0000 7f2ce659c640 1 --2- 172.21.15.5:0/856444031 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2cd40b4da0 0x7f2cd40b72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:42.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.483+0000 7f2cf3140740 1 -- 172.21.15.5:0/1050261363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dc865c3070 msgr2=0x55dc86968310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:42.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.483+0000 7f2cf3140740 1 --2- 172.21.15.5:0/1050261363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dc865c3070 0x55dc86968310 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2ce00104d0 tx=0x7f2ce0010990 comp rx=0 tx=0).stop 2024-08-31T05:34:42.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.483+0000 7f2cf3140740 1 -- 172.21.15.5:0/1050261363 shutdown_connections 2024-08-31T05:34:42.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.483+0000 7f2cf3140740 1 --2- 172.21.15.5:0/1050261363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc865a2390 0x55dc86968d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:42.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.483+0000 7f2cf3140740 1 --2- 172.21.15.5:0/1050261363 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc8659a1b0 0x55dc86968850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:42.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.483+0000 7f2cf3140740 1 --2- 172.21.15.5:0/1050261363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dc865c3070 0x55dc86968310 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:42.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.483+0000 7f2cf3140740 1 -- 172.21.15.5:0/1050261363 >> 172.21.15.5:0/1050261363 conn(0x55dc865b7460 msgr2=0x55dc86966200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:42.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.484+0000 7f2cdf7fe640 1 -- 172.21.15.5:0/856444031 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f2cd80e98c0 con 0x7f2ce8102800 2024-08-31T05:34:42.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.484+0000 7f2ce659c640 1 --2- 172.21.15.5:0/856444031 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2cd40b4da0 0x7f2cd40b72b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x55dc86966f90 tx=0x7f2cd8028000 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:42.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.486+0000 7f2cf3140740 1 -- 172.21.15.5:0/1050261363 shutdown_connections 2024-08-31T05:34:42.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.486+0000 7f2cf3140740 1 -- 172.21.15.5:0/1050261363 wait complete. 2024-08-31T05:34:42.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.487+0000 7f2cf3140740 1 -- start start 2024-08-31T05:34:42.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.487+0000 7f2cf3140740 1 Processor -- start 2024-08-31T05:34:42.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.487+0000 7f2cf3140740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc8659a1b0 0x55dc86973aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:42.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.488+0000 7f2cf3140740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dc865a2390 0x55dc86973fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:42.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.488+0000 7f2cf3140740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc865c3070 0x55dc8697fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:42.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.488+0000 7f2cf3140740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55dc86731700 con 0x55dc8659a1b0 2024-08-31T05:34:42.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.488+0000 7f2cf3140740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55dc86855750 con 0x55dc865a2390 2024-08-31T05:34:42.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.488+0000 7f2cf3140740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55dc86976af0 con 0x55dc865c3070 2024-08-31T05:34:42.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.488+0000 7f2cf3140740 10 client.0 _ll_register_callbacks cb 0x55dc86884e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:34:42.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.488+0000 7f2cdffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dc865a2390 0x55dc86973fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:42.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.488+0000 7f2cdffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dc865a2390 0x55dc86973fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:50582/0 (socket says 172.21.15.5:50582) 2024-08-31T05:34:42.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.488+0000 7f2cdffff640 1 -- 172.21.15.5:0/141325537 learned_addr learned my addr 172.21.15.5:0/141325537 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:42.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.488+0000 7f2ce6d9d640 1 --2- 172.21.15.5:0/141325537 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc865c3070 0x55dc8697fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:42.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.488+0000 7f2ce6d9d640 1 --2- 172.21.15.5:0/141325537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc8659a1b0 0x55dc86973aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:42.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.489+0000 7f2ce6d9d640 1 -- 172.21.15.5:0/141325537 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc865c3070 msgr2=0x55dc8697fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:42.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.489+0000 7f2ce6d9d640 1 --2- 172.21.15.5:0/141325537 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc865c3070 0x55dc8697fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:42.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.489+0000 7f2ce6d9d640 1 -- 172.21.15.5:0/141325537 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dc865a2390 msgr2=0x55dc86973fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:42.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.489+0000 7f2ce6d9d640 1 --2- 172.21.15.5:0/141325537 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dc865a2390 0x55dc86973fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:42.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.489+0000 7f2ce6d9d640 1 -- 172.21.15.5:0/141325537 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc8688e900 con 0x55dc8659a1b0 2024-08-31T05:34:42.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.489+0000 7f2ce6d9d640 1 --2- 172.21.15.5:0/141325537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc8659a1b0 0x55dc86973aa0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f2ce000eb70 tx=0x7f2ce0011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fa6e4786d290ca2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:42.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.489+0000 7f2ccdffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:34:42.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.489+0000 7f2ccdffb640 1 -- 172.21.15.5:0/141325537 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce001f040 con 0x55dc8659a1b0 2024-08-31T05:34:42.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.489+0000 7f2ccdffb640 1 -- 172.21.15.5:0/141325537 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f2ce0004a40 con 0x55dc8659a1b0 2024-08-31T05:34:42.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.489+0000 7f2cf3140740 1 -- 172.21.15.5:0/141325537 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ce0011db0 con 0x55dc8659a1b0 2024-08-31T05:34:42.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.490+0000 7f2ccdffb640 1 -- 172.21.15.5:0/141325537 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f2ce0003970 con 0x55dc8659a1b0 2024-08-31T05:34:42.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.490+0000 7f2cf3140740 10 client.16794 fetch_fsmap learned FSMap version 34 2024-08-31T05:34:42.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.490+0000 7f2cf3140740 1 -- 172.21.15.5:0/141325537 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55dc86982900 con 0x55dc8659a1b0 2024-08-31T05:34:42.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.492+0000 7f2ccdffb640 1 -- 172.21.15.5:0/141325537 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ce0011560 con 0x55dc8659a1b0 2024-08-31T05:34:42.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.492+0000 7f2ccdffb640 1 -- 172.21.15.5:0/141325537 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f2ce0004020 con 0x55dc8659a1b0 2024-08-31T05:34:42.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.492+0000 7f2cf3140740 10 client.16794 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:34:42.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.492+0000 7f2cf3140740 10 client.16794 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-31T05:34:42.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.492+0000 7f2cf3140740 20 client.16794 populate_metadata read hostname 'smithi005' 2024-08-31T05:34:42.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.492+0000 7f2cf3140740 1 --2- 172.21.15.5:0/141325537 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55dc865819f0 0x55dc86985d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:42.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.492+0000 7f2cf3140740 4 client.16794 mds_command: new command op to 24602 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:34:42.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.492+0000 7f2cf3140740 1 -- 172.21.15.5:0/141325537 --> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f2ce0011db0 con 0x55dc865819f0 2024-08-31T05:34:42.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.492+0000 7f2cdffff640 1 --2- 172.21.15.5:0/141325537 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55dc865819f0 0x55dc86985d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:42.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.493+0000 7f2cdffff640 1 --2- 172.21.15.5:0/141325537 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55dc865819f0 0x55dc86985d70 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=bf72b0da07a9c03b server_cookie=78d21f6a72d25876 in_seq=0 out_seq=0 2024-08-31T05:34:42.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.494+0000 7f2ccdffb640 10 client.16794 ms_handle_connect on v2:172.21.15.50:6836/428759669 2024-08-31T05:34:42.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.494+0000 7f2ccdffb640 1 -- 172.21.15.5:0/141325537 <== mds.4 v2:172.21.15.50:6836/428759669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f2ce0011db0 con 0x55dc865819f0 2024-08-31T05:34:42.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.494+0000 7f2ccdffb640 10 client.16794 handle_command_reply: tid=0 2024-08-31T05:34:42.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.494+0000 7f2cf3140740 1 client.16794 shutdown 2024-08-31T05:34:42.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.495+0000 7f2cf3140740 1 -- 172.21.15.5:0/141325537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc8659a1b0 msgr2=0x55dc86973aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:42.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.495+0000 7f2cf3140740 1 --2- 172.21.15.5:0/141325537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc8659a1b0 0x55dc86973aa0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f2ce000eb70 tx=0x7f2ce0011f60 comp rx=0 tx=0).stop 2024-08-31T05:34:42.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.495+0000 7f2cf3140740 1 -- 172.21.15.5:0/141325537 shutdown_connections 2024-08-31T05:34:42.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.495+0000 7f2cf3140740 1 --2- 172.21.15.5:0/141325537 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55dc865819f0 0x55dc86985d70 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:42.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.495+0000 7f2cf3140740 1 --2- 172.21.15.5:0/141325537 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc865c3070 0x55dc8697fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:42.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.495+0000 7f2cf3140740 1 --2- 172.21.15.5:0/141325537 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dc865a2390 0x55dc86973fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:42.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.495+0000 7f2cf3140740 1 --2- 172.21.15.5:0/141325537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc8659a1b0 0x55dc86973aa0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:42.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.495+0000 7f2cf3140740 1 -- 172.21.15.5:0/141325537 >> 172.21.15.5:0/141325537 conn(0x55dc865b7460 msgr2=0x55dc8696b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:42.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.495+0000 7f2ccdffb640 0 client.16794 ms_handle_reset on v2:172.21.15.50:6836/428759669 2024-08-31T05:34:42.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.496+0000 7f2cf3140740 1 -- 172.21.15.5:0/141325537 shutdown_connections 2024-08-31T05:34:42.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.496+0000 7f2cf3140740 1 -- 172.21.15.5:0/141325537 wait complete. 2024-08-31T05:34:42.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.496+0000 7f2cf3140740 20 client.16794 trim_cache size 0 max 16384 2024-08-31T05:34:42.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.517+0000 7f2cf3140740 1 Processor -- start 2024-08-31T05:34:42.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.517+0000 7f2cf3140740 1 -- start start 2024-08-31T05:34:42.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.518+0000 7f2cf3140740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc8659a1b0 0x55dc8696bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:42.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.518+0000 7f2cf3140740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dc865a2390 0x55dc8697fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:42.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.518+0000 7f2cf3140740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc865c3070 0x55dc86980250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:42.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.518+0000 7f2cf3140740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce81aeb30 con 0x55dc865c3070 2024-08-31T05:34:42.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.518+0000 7f2cf3140740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce81b0670 con 0x55dc865a2390 2024-08-31T05:34:42.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.518+0000 7f2cf3140740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce81af200 con 0x55dc8659a1b0 2024-08-31T05:34:42.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.518+0000 7f2ce6d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc865c3070 0x55dc86980250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:42.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.518+0000 7f2ce6d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc8659a1b0 0x55dc8696bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:42.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.518+0000 7f2ce6d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc8659a1b0 0x55dc8696bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:41352/0 (socket says 172.21.15.5:41352) 2024-08-31T05:34:42.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.518+0000 7f2ce6d9d640 1 -- 172.21.15.5:0/780004437 learned_addr learned my addr 172.21.15.5:0/780004437 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:42.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.518+0000 7f2cdffff640 1 --2- 172.21.15.5:0/780004437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dc865a2390 0x55dc8697fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:42.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.518+0000 7f2ce6d9d640 1 -- 172.21.15.5:0/780004437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dc865a2390 msgr2=0x55dc8697fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:42.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.518+0000 7f2ce6d9d640 1 --2- 172.21.15.5:0/780004437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dc865a2390 0x55dc8697fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:42.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.518+0000 7f2ce6d9d640 1 -- 172.21.15.5:0/780004437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc865c3070 msgr2=0x55dc86980250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:42.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.518+0000 7f2ce6d9d640 1 --2- 172.21.15.5:0/780004437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc865c3070 0x55dc86980250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:42.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.518+0000 7f2ce6d9d640 1 -- 172.21.15.5:0/780004437 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc8696a830 con 0x55dc8659a1b0 2024-08-31T05:34:42.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.519+0000 7f2ce6d9d640 1 --2- 172.21.15.5:0/780004437 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc8659a1b0 0x55dc8696bb20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2ce00043f0 tx=0x7f2ce0009d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d65357d09a0a801a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:42.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.519+0000 7f2ccffff640 1 -- 172.21.15.5:0/780004437 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce0009890 con 0x55dc8659a1b0 2024-08-31T05:34:42.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.519+0000 7f2ccffff640 1 -- 172.21.15.5:0/780004437 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ce000e7a0 con 0x55dc8659a1b0 2024-08-31T05:34:42.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.519+0000 7f2ccffff640 1 -- 172.21.15.5:0/780004437 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce0011560 con 0x55dc8659a1b0 2024-08-31T05:34:42.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.520+0000 7f2cf3140740 1 -- 172.21.15.5:0/780004437 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc8659a1b0 msgr2=0x55dc8696bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:42.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.520+0000 7f2cf3140740 1 --2- 172.21.15.5:0/780004437 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc8659a1b0 0x55dc8696bb20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2ce00043f0 tx=0x7f2ce0009d00 comp rx=0 tx=0).stop 2024-08-31T05:34:42.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.520+0000 7f2cf3140740 1 -- 172.21.15.5:0/780004437 shutdown_connections 2024-08-31T05:34:42.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.520+0000 7f2cf3140740 1 --2- 172.21.15.5:0/780004437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc865c3070 0x55dc86980250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:42.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.520+0000 7f2cf3140740 1 --2- 172.21.15.5:0/780004437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dc865a2390 0x55dc8697fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:42.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.520+0000 7f2cf3140740 1 --2- 172.21.15.5:0/780004437 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc8659a1b0 0x55dc8696bb20 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:42.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.520+0000 7f2cf3140740 1 -- 172.21.15.5:0/780004437 >> 172.21.15.5:0/780004437 conn(0x55dc865b7460 msgr2=0x55dc8696b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:42.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.520+0000 7f2cf3140740 1 -- 172.21.15.5:0/780004437 shutdown_connections 2024-08-31T05:34:42.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.520+0000 7f2cf3140740 1 -- 172.21.15.5:0/780004437 wait complete. 2024-08-31T05:34:42.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.521+0000 7f2cf3140740 1 -- start start 2024-08-31T05:34:42.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.521+0000 7f2cf3140740 1 Processor -- start 2024-08-31T05:34:42.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.521+0000 7f2cf3140740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dc8659a1b0 0x55dc8697c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:42.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.521+0000 7f2cf3140740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc865a2390 0x55dc86977950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:42.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.521+0000 7f2cf3140740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc865c3070 0x55dc86977e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:42.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.521+0000 7f2cf3140740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce81affa0 con 0x55dc865c3070 2024-08-31T05:34:42.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.521+0000 7f2cf3140740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce81af8d0 con 0x55dc8659a1b0 2024-08-31T05:34:42.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.521+0000 7f2cf3140740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce81acb10 con 0x55dc865a2390 2024-08-31T05:34:42.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.521+0000 7f2cdffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc865a2390 0x55dc86977950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:42.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.521+0000 7f2cdffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc865a2390 0x55dc86977950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:41360/0 (socket says 172.21.15.5:41360) 2024-08-31T05:34:42.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.521+0000 7f2cdffff640 1 -- 172.21.15.5:0/3004992261 learned_addr learned my addr 172.21.15.5:0/3004992261 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:42.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.521+0000 7f2cf3140740 10 client.0 _ll_register_callbacks cb 0x7f2cd0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:34:42.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.522+0000 7f2ce6d9d640 1 --2- 172.21.15.5:0/3004992261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dc8659a1b0 0x55dc8697c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:42.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.522+0000 7f2ce6d9d640 1 --2- 172.21.15.5:0/3004992261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc865c3070 0x55dc86977e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:42.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.522+0000 7f2cdffff640 1 -- 172.21.15.5:0/3004992261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dc8659a1b0 msgr2=0x55dc8697c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:42.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.522+0000 7f2cdffff640 1 --2- 172.21.15.5:0/3004992261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dc8659a1b0 0x55dc8697c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:42.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.522+0000 7f2cdffff640 1 -- 172.21.15.5:0/3004992261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc865c3070 msgr2=0x55dc86977e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:42.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.522+0000 7f2cdffff640 1 --2- 172.21.15.5:0/3004992261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc865c3070 0x55dc86977e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:42.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.522+0000 7f2cdffff640 1 -- 172.21.15.5:0/3004992261 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc86978580 con 0x55dc865a2390 2024-08-31T05:34:42.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.522+0000 7f2cdffff640 1 --2- 172.21.15.5:0/3004992261 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc865a2390 0x55dc86977950 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2cd0009230 tx=0x7f2cd0000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5827d3c0dce059d0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:42.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.522+0000 7f2ccdffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:34:42.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.522+0000 7f2ccdffb640 1 -- 172.21.15.5:0/3004992261 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd0035040 con 0x55dc865a2390 2024-08-31T05:34:42.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.522+0000 7f2cf3140740 1 -- 172.21.15.5:0/3004992261 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ce000e7a0 con 0x55dc865a2390 2024-08-31T05:34:42.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.522+0000 7f2ccdffb640 1 -- 172.21.15.5:0/3004992261 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f2cd0005240 con 0x55dc865a2390 2024-08-31T05:34:42.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.523+0000 7f2ccdffb640 1 -- 172.21.15.5:0/3004992261 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f2cd0005440 con 0x55dc865a2390 2024-08-31T05:34:42.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.523+0000 7f2cf3140740 10 client.26407 fetch_fsmap learned FSMap version 34 2024-08-31T05:34:42.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.523+0000 7f2cf3140740 1 -- 172.21.15.5:0/3004992261 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55dc869f03e0 con 0x55dc865a2390 2024-08-31T05:34:42.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.523+0000 7f2ccdffb640 1 -- 172.21.15.5:0/3004992261 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ce000e7a0 con 0x55dc865a2390 2024-08-31T05:34:42.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.523+0000 7f2ccdffb640 1 -- 172.21.15.5:0/3004992261 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f2cd0031870 con 0x55dc865a2390 2024-08-31T05:34:42.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.523+0000 7f2cf3140740 10 client.26407 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:34:42.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.523+0000 7f2cf3140740 10 client.26407 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-31T05:34:42.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.523+0000 7f2cf3140740 20 client.26407 populate_metadata read hostname 'smithi005' 2024-08-31T05:34:42.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.523+0000 7f2cf3140740 1 --2- 172.21.15.5:0/3004992261 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55dc86556da0 0x55dc869f2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:42.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.523+0000 7f2cf3140740 4 client.26407 mds_command: new command op to 24602 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:34:42.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.523+0000 7f2cf3140740 1 -- 172.21.15.5:0/3004992261 --> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55dc868e15d0 con 0x55dc86556da0 2024-08-31T05:34:42.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.523+0000 7f2ce6d9d640 1 --2- 172.21.15.5:0/3004992261 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55dc86556da0 0x55dc869f2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:42.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.524+0000 7f2ce6d9d640 1 --2- 172.21.15.5:0/3004992261 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55dc86556da0 0x55dc869f2ba0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=cf2fdfb9e3563ec7 server_cookie=47666eb10e41e200 in_seq=0 out_seq=0 2024-08-31T05:34:42.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.524+0000 7f2ccdffb640 10 client.26407 ms_handle_connect on v2:172.21.15.50:6836/428759669 2024-08-31T05:34:42.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.524+0000 7f2ccdffb640 1 -- 172.21.15.5:0/3004992261 <== mds.4 v2:172.21.15.50:6836/428759669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55dc868e15d0 con 0x55dc86556da0 2024-08-31T05:34:42.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.524+0000 7f2ccdffb640 10 client.26407 handle_command_reply: tid=0 2024-08-31T05:34:42.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.524+0000 7f2cf3140740 1 client.26407 shutdown 2024-08-31T05:34:42.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.524+0000 7f2cf3140740 1 -- 172.21.15.5:0/3004992261 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc865a2390 msgr2=0x55dc86977950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:42.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.524+0000 7f2cf3140740 1 --2- 172.21.15.5:0/3004992261 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc865a2390 0x55dc86977950 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2cd0009230 tx=0x7f2cd0000bc0 comp rx=0 tx=0).stop 2024-08-31T05:34:42.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.524+0000 7f2cf3140740 1 -- 172.21.15.5:0/3004992261 shutdown_connections 2024-08-31T05:34:42.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.524+0000 7f2cf3140740 1 --2- 172.21.15.5:0/3004992261 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55dc86556da0 0x55dc869f2ba0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:42.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.524+0000 7f2cf3140740 1 --2- 172.21.15.5:0/3004992261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55dc865c3070 0x55dc86977e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:42.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.524+0000 7f2cf3140740 1 --2- 172.21.15.5:0/3004992261 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc865a2390 0x55dc86977950 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:42.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.524+0000 7f2ccdffb640 0 client.26407 ms_handle_reset on v2:172.21.15.50:6836/428759669 2024-08-31T05:34:42.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.524+0000 7f2cf3140740 1 --2- 172.21.15.5:0/3004992261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55dc8659a1b0 0x55dc8697c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:42.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.524+0000 7f2cf3140740 1 -- 172.21.15.5:0/3004992261 >> 172.21.15.5:0/3004992261 conn(0x55dc865b7460 msgr2=0x55dc86975830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:42.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.524+0000 7f2cf3140740 1 -- 172.21.15.5:0/3004992261 shutdown_connections 2024-08-31T05:34:42.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.524+0000 7f2cf3140740 1 -- 172.21.15.5:0/3004992261 wait complete. 2024-08-31T05:34:42.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.525+0000 7f2cf3140740 20 client.26407 trim_cache size 0 max 16384 2024-08-31T05:34:42.532 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:34:42.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.525+0000 7f2cecbcb640 1 -- 172.21.15.5:0/856444031 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2cd40b4da0 msgr2=0x7f2cd40b72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:42.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.525+0000 7f2cecbcb640 1 --2- 172.21.15.5:0/856444031 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2cd40b4da0 0x7f2cd40b72b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x55dc86966f90 tx=0x7f2cd8028000 comp rx=0 tx=0).stop 2024-08-31T05:34:42.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.525+0000 7f2cecbcb640 1 -- 172.21.15.5:0/856444031 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ce8102800 msgr2=0x7f2ce819a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:42.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.525+0000 7f2cecbcb640 1 --2- 172.21.15.5:0/856444031 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ce8102800 0x7f2ce819a210 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2cd8009e90 tx=0x7f2cd800ed90 comp rx=0 tx=0).stop 2024-08-31T05:34:42.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.525+0000 7f2cecbcb640 1 -- 172.21.15.5:0/856444031 shutdown_connections 2024-08-31T05:34:42.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.525+0000 7f2cecbcb640 1 --2- 172.21.15.5:0/856444031 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2cd40b4da0 0x7f2cd40b72b0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:42.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.525+0000 7f2cecbcb640 1 --2- 172.21.15.5:0/856444031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ce8108a90 0x7f2ce819fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:42.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.525+0000 7f2cecbcb640 1 --2- 172.21.15.5:0/856444031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ce8108140 0x7f2ce819a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:42.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.525+0000 7f2cecbcb640 1 --2- 172.21.15.5:0/856444031 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ce8102800 0x7f2ce819a210 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:42.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.526+0000 7f2cecbcb640 1 -- 172.21.15.5:0/856444031 >> 172.21.15.5:0/856444031 conn(0x7f2ce80794d0 msgr2=0x7f2ce8105040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:42.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.526+0000 7f2cecbcb640 1 -- 172.21.15.5:0/856444031 shutdown_connections 2024-08-31T05:34:42.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:42.526+0000 7f2cecbcb640 1 -- 172.21.15.5:0/856444031 wait complete. 2024-08-31T05:34:42.916 INFO:tasks.workunit.client.0.smithi005.stdout: 1 522799 13.35 MB/sec execute 90 sec latency 42.900 ms 2024-08-31T05:34:42.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:34:42 smithi005 ceph-mon[18602]: pgmap v487: 129 pgs: 129 active+clean; 282 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.3 MiB/s wr, 228 op/s 2024-08-31T05:34:42.987 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:34:42 smithi070 ceph-mon[22316]: pgmap v487: 129 pgs: 129 active+clean; 282 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.3 MiB/s wr, 228 op/s 2024-08-31T05:34:43.058 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:34:42 smithi050 ceph-mon[22146]: pgmap v487: 129 pgs: 129 active+clean; 282 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.3 MiB/s wr, 228 op/s 2024-08-31T05:34:43.916 INFO:tasks.workunit.client.0.smithi005.stdout: 1 525389 13.35 MB/sec execute 91 sec latency 58.578 ms 2024-08-31T05:34:44.054 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-31T05:34:44.328 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:34:44.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.332+0000 7ff2c568b640 1 -- 172.21.15.5:0/3996083681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2c01046b0 msgr2=0x7ff2c0104ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:44.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.332+0000 7ff2c568b640 1 --2- 172.21.15.5:0/3996083681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2c01046b0 0x7ff2c0104ac0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff2b0009860 tx=0x7ff2b002a340 comp rx=0 tx=0).stop 2024-08-31T05:34:44.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.332+0000 7ff2c568b640 1 -- 172.21.15.5:0/3996083681 shutdown_connections 2024-08-31T05:34:44.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.332+0000 7ff2c568b640 1 --2- 172.21.15.5:0/3996083681 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2c010db10 0x7ff2c0110000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:44.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.332+0000 7ff2c568b640 1 --2- 172.21.15.5:0/3996083681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2c0105000 0x7ff2c010d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:44.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.332+0000 7ff2c568b640 1 --2- 172.21.15.5:0/3996083681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2c01046b0 0x7ff2c0104ac0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:44.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.332+0000 7ff2c568b640 1 -- 172.21.15.5:0/3996083681 >> 172.21.15.5:0/3996083681 conn(0x7ff2c00fe160 msgr2=0x7ff2c01005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:44.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.332+0000 7ff2c568b640 1 -- 172.21.15.5:0/3996083681 shutdown_connections 2024-08-31T05:34:44.335 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.332+0000 7ff2c568b640 1 -- 172.21.15.5:0/3996083681 wait complete. 2024-08-31T05:34:44.336 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.333+0000 7ff2c568b640 1 Processor -- start 2024-08-31T05:34:44.336 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.333+0000 7ff2c568b640 1 -- start start 2024-08-31T05:34:44.337 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.333+0000 7ff2c568b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2c01046b0 0x7ff2c019a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:44.337 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.333+0000 7ff2c568b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2c0105000 0x7ff2c019a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:44.337 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.333+0000 7ff2c568b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2c010db10 0x7ff2c019fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:44.337 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.333+0000 7ff2c568b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c01137a0 con 0x7ff2c0105000 2024-08-31T05:34:44.337 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.333+0000 7ff2c568b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c0113620 con 0x7ff2c01046b0 2024-08-31T05:34:44.337 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.333+0000 7ff2c568b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c0113920 con 0x7ff2c010db10 2024-08-31T05:34:44.337 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.333+0000 7ff2b7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2c0105000 0x7ff2c019a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:44.337 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.333+0000 7ff2beffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2c01046b0 0x7ff2c019a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:44.337 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.333+0000 7ff2b7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2c0105000 0x7ff2c019a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40236/0 (socket says 172.21.15.5:40236) 2024-08-31T05:34:44.337 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.333+0000 7ff2b7fff640 1 -- 172.21.15.5:0/998260849 learned_addr learned my addr 172.21.15.5:0/998260849 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:44.337 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.333+0000 7ff2bf7fe640 1 --2- 172.21.15.5:0/998260849 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2c010db10 0x7ff2c019fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:44.337 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.334+0000 7ff2beffd640 1 -- 172.21.15.5:0/998260849 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2c010db10 msgr2=0x7ff2c019fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:44.338 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.334+0000 7ff2beffd640 1 --2- 172.21.15.5:0/998260849 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2c010db10 0x7ff2c019fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:44.338 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.334+0000 7ff2beffd640 1 -- 172.21.15.5:0/998260849 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2c0105000 msgr2=0x7ff2c019a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:44.338 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.334+0000 7ff2beffd640 1 --2- 172.21.15.5:0/998260849 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2c0105000 0x7ff2c019a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:44.338 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.334+0000 7ff2beffd640 1 -- 172.21.15.5:0/998260849 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2c01a0130 con 0x7ff2c01046b0 2024-08-31T05:34:44.338 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.334+0000 7ff2beffd640 1 --2- 172.21.15.5:0/998260849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2c01046b0 0x7ff2c019a200 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff2b0035040 tx=0x7ff2b0032d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:44.338 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.334+0000 7ff2bcff9640 1 -- 172.21.15.5:0/998260849 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b0040020 con 0x7ff2c01046b0 2024-08-31T05:34:44.338 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.334+0000 7ff2bcff9640 1 -- 172.21.15.5:0/998260849 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2b0030e10 con 0x7ff2c01046b0 2024-08-31T05:34:44.338 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.334+0000 7ff2bcff9640 1 -- 172.21.15.5:0/998260849 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b0037040 con 0x7ff2c01046b0 2024-08-31T05:34:44.338 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.334+0000 7ff2c568b640 1 -- 172.21.15.5:0/998260849 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2c01a03c0 con 0x7ff2c01046b0 2024-08-31T05:34:44.338 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.334+0000 7ff2c568b640 1 -- 172.21.15.5:0/998260849 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2c01a0860 con 0x7ff2c01046b0 2024-08-31T05:34:44.340 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.337+0000 7ff2cc5f5740 1 Processor -- start 2024-08-31T05:34:44.340 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.337+0000 7ff2cc5f5740 1 -- start start 2024-08-31T05:34:44.340 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.337+0000 7ff2bcff9640 1 -- 172.21.15.5:0/998260849 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7ff2b0043020 con 0x7ff2c01046b0 2024-08-31T05:34:44.340 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.337+0000 7ff2cc5f5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2be9501b0 0x55c2becf3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:44.340 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.337+0000 7ff2cc5f5740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c2be9272f0 0x55c2becf4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:44.341 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.337+0000 7ff2cc5f5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2be92f4d0 0x55c2becf4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:44.341 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.337+0000 7ff2cc5f5740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55c2bec69000 con 0x55c2be9272f0 2024-08-31T05:34:44.341 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.337+0000 7ff2cc5f5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55c2bec58590 con 0x55c2be9501b0 2024-08-31T05:34:44.341 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.337+0000 7ff2cc5f5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c2bec5c540 con 0x55c2be92f4d0 2024-08-31T05:34:44.341 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.337+0000 7ff2beffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c2be9272f0 0x55c2becf4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:44.341 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.337+0000 7ff2b7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2be92f4d0 0x55c2becf4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:44.341 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.338+0000 7ff2beffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c2be9272f0 0x55c2becf4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40246/0 (socket says 172.21.15.5:40246) 2024-08-31T05:34:44.341 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.338+0000 7ff2beffd640 1 -- 172.21.15.5:0/2658970631 learned_addr learned my addr 172.21.15.5:0/2658970631 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:44.341 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.338+0000 7ff2bf7fe640 1 --2- 172.21.15.5:0/2658970631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2be9501b0 0x55c2becf3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:44.341 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.338+0000 7ff2b7fff640 1 -- 172.21.15.5:0/2658970631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2be9501b0 msgr2=0x55c2becf3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:44.341 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.338+0000 7ff2b7fff640 1 --2- 172.21.15.5:0/2658970631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2be9501b0 0x55c2becf3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:44.341 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.338+0000 7ff2b7fff640 1 -- 172.21.15.5:0/2658970631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c2be9272f0 msgr2=0x55c2becf4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:44.341 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.338+0000 7ff2b7fff640 1 --2- 172.21.15.5:0/2658970631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c2be9272f0 0x55c2becf4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:44.342 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.338+0000 7ff2b7fff640 1 -- 172.21.15.5:0/2658970631 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2be9bb790 con 0x55c2be92f4d0 2024-08-31T05:34:44.342 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.338+0000 7ff2bcff9640 1 --2- 172.21.15.5:0/998260849 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff2ac0b4ca0 0x7ff2ac0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:44.342 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.338+0000 7ff2b7fff640 1 --2- 172.21.15.5:0/2658970631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2be92f4d0 0x55c2becf4540 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff2a8009530 tx=0x7ff2a8011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2579c3502459e28 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:44.342 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.338+0000 7ff2bf7fe640 1 --2- 172.21.15.5:0/998260849 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff2ac0b4ca0 0x7ff2ac0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:44.342 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.338+0000 7ff2bcff9640 1 -- 172.21.15.5:0/998260849 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7ff2b01056a0 con 0x7ff2c01046b0 2024-08-31T05:34:44.342 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.338+0000 7ff2b57fa640 1 -- 172.21.15.5:0/2658970631 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a8005220 con 0x55c2be92f4d0 2024-08-31T05:34:44.342 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.338+0000 7ff2b57fa640 1 -- 172.21.15.5:0/2658970631 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2a8009e10 con 0x55c2be92f4d0 2024-08-31T05:34:44.342 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.338+0000 7ff2b57fa640 1 -- 172.21.15.5:0/2658970631 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a80197b0 con 0x55c2be92f4d0 2024-08-31T05:34:44.343 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.339+0000 7ff2cc5f5740 1 -- 172.21.15.5:0/2658970631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2be92f4d0 msgr2=0x55c2becf4540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:44.343 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.339+0000 7ff2bf7fe640 1 --2- 172.21.15.5:0/998260849 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff2ac0b4ca0 0x7ff2ac0b71b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8005fd0 tx=0x7ff2b8009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:44.343 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.339+0000 7ff2cc5f5740 1 --2- 172.21.15.5:0/2658970631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2be92f4d0 0x55c2becf4540 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff2a8009530 tx=0x7ff2a8011810 comp rx=0 tx=0).stop 2024-08-31T05:34:44.343 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.340+0000 7ff2cc5f5740 1 -- 172.21.15.5:0/2658970631 shutdown_connections 2024-08-31T05:34:44.343 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.340+0000 7ff2cc5f5740 1 --2- 172.21.15.5:0/2658970631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2be92f4d0 0x55c2becf4540 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:44.343 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.340+0000 7ff2cc5f5740 1 --2- 172.21.15.5:0/2658970631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c2be9272f0 0x55c2becf4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:44.343 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.340+0000 7ff2cc5f5740 1 --2- 172.21.15.5:0/2658970631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2be9501b0 0x55c2becf3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:44.343 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.340+0000 7ff2cc5f5740 1 -- 172.21.15.5:0/2658970631 >> 172.21.15.5:0/2658970631 conn(0x55c2be944300 msgr2=0x55c2becf19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:44.343 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.340+0000 7ff2cc5f5740 1 -- 172.21.15.5:0/2658970631 shutdown_connections 2024-08-31T05:34:44.343 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.340+0000 7ff2cc5f5740 1 -- 172.21.15.5:0/2658970631 wait complete. 2024-08-31T05:34:44.344 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.340+0000 7ff2cc5f5740 1 -- start start 2024-08-31T05:34:44.344 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.341+0000 7ff2cc5f5740 1 Processor -- start 2024-08-31T05:34:44.345 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.341+0000 7ff2cc5f5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2be9272f0 0x55c2becff390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:44.345 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.341+0000 7ff2cc5f5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2be92f4d0 0x55c2becff8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:44.345 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.341+0000 7ff2cc5f5740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c2be9501b0 0x55c2becffe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:44.345 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.341+0000 7ff2cc5f5740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55c2beb91ab0 con 0x55c2be9501b0 2024-08-31T05:34:44.345 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.341+0000 7ff2cc5f5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55c2bebdf680 con 0x55c2be9272f0 2024-08-31T05:34:44.345 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.341+0000 7ff2cc5f5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c2bed06620 con 0x55c2be92f4d0 2024-08-31T05:34:44.345 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.341+0000 7ff2cc5f5740 10 client.0 _ll_register_callbacks cb 0x55c2be967a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:34:44.345 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.342+0000 7ff2bf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c2be9501b0 0x55c2becffe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:44.345 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.342+0000 7ff2bf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c2be9501b0 0x55c2becffe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40254/0 (socket says 172.21.15.5:40254) 2024-08-31T05:34:44.345 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.342+0000 7ff2bf7fe640 1 -- 172.21.15.5:0/3791191899 learned_addr learned my addr 172.21.15.5:0/3791191899 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:44.345 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.342+0000 7ff2bf7fe640 1 -- 172.21.15.5:0/3791191899 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2be92f4d0 msgr2=0x55c2becff8d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T05:34:44.345 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.342+0000 7ff2bf7fe640 1 --2- 172.21.15.5:0/3791191899 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2be92f4d0 0x55c2becff8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:44.346 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.342+0000 7ff2bf7fe640 1 -- 172.21.15.5:0/3791191899 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2be9272f0 msgr2=0x55c2becff390 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T05:34:44.346 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.342+0000 7ff2beffd640 1 --2- 172.21.15.5:0/3791191899 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2be9272f0 0x55c2becff390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:44.346 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.343+0000 7ff2bf7fe640 1 --2- 172.21.15.5:0/3791191899 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2be9272f0 0x55c2becff390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:44.346 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.343+0000 7ff2bf7fe640 1 -- 172.21.15.5:0/3791191899 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2bea34620 con 0x55c2be9501b0 2024-08-31T05:34:44.346 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.343+0000 7ff2beffd640 1 --2- 172.21.15.5:0/3791191899 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2be9272f0 0x55c2becff390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:34:44.346 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.343+0000 7ff2bf7fe640 1 --2- 172.21.15.5:0/3791191899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c2be9501b0 0x55c2becffe10 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8003fd0 tx=0x7ff2b8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de5e2f05794cdcac server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:44.347 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.343+0000 7ff2a67fc640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:34:44.347 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.343+0000 7ff2a67fc640 1 -- 172.21.15.5:0/3791191899 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b800f8b0 con 0x55c2be9501b0 2024-08-31T05:34:44.347 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.343+0000 7ff2a67fc640 1 -- 172.21.15.5:0/3791191899 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7ff2b800fa50 con 0x55c2be9501b0 2024-08-31T05:34:44.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.343+0000 7ff2cc5f5740 1 -- 172.21.15.5:0/3791191899 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2a8009e10 con 0x55c2be9501b0 2024-08-31T05:34:44.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.344+0000 7ff2a67fc640 1 -- 172.21.15.5:0/3791191899 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ff2b800fc50 con 0x55c2be9501b0 2024-08-31T05:34:44.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.344+0000 7ff2cc5f5740 10 client.16812 fetch_fsmap learned FSMap version 34 2024-08-31T05:34:44.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.344+0000 7ff2cc5f5740 1 -- 172.21.15.5:0/3791191899 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55c2bed16ac0 con 0x55c2be9501b0 2024-08-31T05:34:44.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.344+0000 7ff2a67fc640 1 -- 172.21.15.5:0/3791191899 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2a8009e10 con 0x55c2be9501b0 2024-08-31T05:34:44.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.345+0000 7ff2a67fc640 1 -- 172.21.15.5:0/3791191899 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7ff2b8026070 con 0x55c2be9501b0 2024-08-31T05:34:44.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.345+0000 7ff2cc5f5740 10 client.16812 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:34:44.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.345+0000 7ff2cc5f5740 10 client.16812 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:34:44.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.345+0000 7ff2cc5f5740 20 client.16812 populate_metadata read hostname 'smithi005' 2024-08-31T05:34:44.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.345+0000 7ff2cc5f5740 1 --2- 172.21.15.5:0/3791191899 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55c2be90ed80 0x55c2bed1a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:44.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.345+0000 7ff2cc5f5740 4 client.16812 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:34:44.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.345+0000 7ff2cc5f5740 1 -- 172.21.15.5:0/3791191899 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c2bec6af50 con 0x55c2be90ed80 2024-08-31T05:34:44.349 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.346+0000 7ff2beffd640 1 --2- 172.21.15.5:0/3791191899 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55c2be90ed80 0x55c2bed1a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:44.349 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.347+0000 7ff2a67fc640 10 client.16812 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:34:44.349 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.347+0000 7ff2beffd640 1 --2- 172.21.15.5:0/3791191899 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55c2be90ed80 0x55c2bed1a120 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80a7b0f280078d1c server_cookie=d1112cdf38f07c66 in_seq=0 out_seq=0 2024-08-31T05:34:44.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.349+0000 7ff2a67fc640 1 -- 172.21.15.5:0/3791191899 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c2bec6af50 con 0x55c2be90ed80 2024-08-31T05:34:44.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.349+0000 7ff2a67fc640 10 client.16812 handle_command_reply: tid=0 2024-08-31T05:34:44.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.349+0000 7ff2cc5f5740 1 client.16812 shutdown 2024-08-31T05:34:44.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.349+0000 7ff2cc5f5740 1 -- 172.21.15.5:0/3791191899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c2be9501b0 msgr2=0x55c2becffe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:44.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.349+0000 7ff2cc5f5740 1 --2- 172.21.15.5:0/3791191899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c2be9501b0 0x55c2becffe10 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8003fd0 tx=0x7ff2b8004ab0 comp rx=0 tx=0).stop 2024-08-31T05:34:44.352 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.350+0000 7ff2cc5f5740 1 -- 172.21.15.5:0/3791191899 shutdown_connections 2024-08-31T05:34:44.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.350+0000 7ff2cc5f5740 1 --2- 172.21.15.5:0/3791191899 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55c2be90ed80 0x55c2bed1a120 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:44.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.350+0000 7ff2cc5f5740 1 --2- 172.21.15.5:0/3791191899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c2be9501b0 0x55c2becffe10 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:44.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.350+0000 7ff2cc5f5740 1 --2- 172.21.15.5:0/3791191899 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2be92f4d0 0x55c2becff8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:44.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.350+0000 7ff2cc5f5740 1 --2- 172.21.15.5:0/3791191899 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2be9272f0 0x55c2becff390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:44.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.350+0000 7ff2cc5f5740 1 -- 172.21.15.5:0/3791191899 >> 172.21.15.5:0/3791191899 conn(0x55c2be944300 msgr2=0x55c2becefc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:44.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.350+0000 7ff2a67fc640 0 client.16812 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:34:44.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.350+0000 7ff2cc5f5740 1 -- 172.21.15.5:0/3791191899 shutdown_connections 2024-08-31T05:34:44.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.351+0000 7ff2cc5f5740 1 -- 172.21.15.5:0/3791191899 wait complete. 2024-08-31T05:34:44.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.352+0000 7ff2cc5f5740 20 client.16812 trim_cache size 0 max 16384 2024-08-31T05:34:44.386 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.384+0000 7ff2cc5f5740 1 Processor -- start 2024-08-31T05:34:44.386 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.384+0000 7ff2cc5f5740 1 -- start start 2024-08-31T05:34:44.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.385+0000 7ff2cc5f5740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c2be9272f0 0x55c2becefb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:44.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.385+0000 7ff2cc5f5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2be92f4d0 0x55c2becf00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:44.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.385+0000 7ff2cc5f5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2be9501b0 0x55c2becff300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:44.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.385+0000 7ff2cc5f5740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c01ae9b0 con 0x55c2be9272f0 2024-08-31T05:34:44.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.385+0000 7ff2cc5f5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c01b04f0 con 0x55c2be92f4d0 2024-08-31T05:34:44.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.385+0000 7ff2cc5f5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c01af080 con 0x55c2be9501b0 2024-08-31T05:34:44.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.385+0000 7ff2beffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c2be9272f0 0x55c2becefb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:44.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.385+0000 7ff2beffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c2be9272f0 0x55c2becefb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40256/0 (socket says 172.21.15.5:40256) 2024-08-31T05:34:44.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.385+0000 7ff2beffd640 1 -- 172.21.15.5:0/3798083299 learned_addr learned my addr 172.21.15.5:0/3798083299 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:44.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.385+0000 7ff2b7fff640 1 --2- 172.21.15.5:0/3798083299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2be92f4d0 0x55c2becf00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:44.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.385+0000 7ff2bf7fe640 1 --2- 172.21.15.5:0/3798083299 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2be9501b0 0x55c2becff300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:44.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.386+0000 7ff2b7fff640 1 -- 172.21.15.5:0/3798083299 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2be9501b0 msgr2=0x55c2becff300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:44.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.386+0000 7ff2b7fff640 1 --2- 172.21.15.5:0/3798083299 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2be9501b0 0x55c2becff300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:44.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.386+0000 7ff2b7fff640 1 -- 172.21.15.5:0/3798083299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c2be9272f0 msgr2=0x55c2becefb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:44.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.386+0000 7ff2b7fff640 1 --2- 172.21.15.5:0/3798083299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c2be9272f0 0x55c2becefb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:44.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.386+0000 7ff2b7fff640 1 -- 172.21.15.5:0/3798083299 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2becfaec0 con 0x55c2be92f4d0 2024-08-31T05:34:44.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.386+0000 7ff2b7fff640 1 --2- 172.21.15.5:0/3798083299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2be92f4d0 0x55c2becf00a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff2a80058c0 tx=0x7ff2a80097d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b6503c41c21020e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:44.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.387+0000 7ff2b4ff9640 1 -- 172.21.15.5:0/3798083299 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a8005240 con 0x55c2be92f4d0 2024-08-31T05:34:44.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.387+0000 7ff2b4ff9640 1 -- 172.21.15.5:0/3798083299 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2a80053e0 con 0x55c2be92f4d0 2024-08-31T05:34:44.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.387+0000 7ff2b4ff9640 1 -- 172.21.15.5:0/3798083299 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a80256d0 con 0x55c2be92f4d0 2024-08-31T05:34:44.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.388+0000 7ff2cc5f5740 1 -- 172.21.15.5:0/3798083299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2be92f4d0 msgr2=0x55c2becf00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:44.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.388+0000 7ff2cc5f5740 1 --2- 172.21.15.5:0/3798083299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2be92f4d0 0x55c2becf00a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff2a80058c0 tx=0x7ff2a80097d0 comp rx=0 tx=0).stop 2024-08-31T05:34:44.391 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.389+0000 7ff2cc5f5740 1 -- 172.21.15.5:0/3798083299 shutdown_connections 2024-08-31T05:34:44.391 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.389+0000 7ff2cc5f5740 1 --2- 172.21.15.5:0/3798083299 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2be9501b0 0x55c2becff300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:44.391 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.389+0000 7ff2cc5f5740 1 --2- 172.21.15.5:0/3798083299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2be92f4d0 0x55c2becf00a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:44.391 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.389+0000 7ff2cc5f5740 1 --2- 172.21.15.5:0/3798083299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c2be9272f0 0x55c2becefb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:44.391 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.389+0000 7ff2cc5f5740 1 -- 172.21.15.5:0/3798083299 >> 172.21.15.5:0/3798083299 conn(0x55c2be944300 msgr2=0x55c2becfdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:44.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.390+0000 7ff2cc5f5740 1 -- 172.21.15.5:0/3798083299 shutdown_connections 2024-08-31T05:34:44.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.390+0000 7ff2cc5f5740 1 -- 172.21.15.5:0/3798083299 wait complete. 2024-08-31T05:34:44.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.391+0000 7ff2cc5f5740 1 -- start start 2024-08-31T05:34:44.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.391+0000 7ff2cc5f5740 1 Processor -- start 2024-08-31T05:34:44.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.391+0000 7ff2cc5f5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2be9272f0 0x55c2bed14970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:44.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.391+0000 7ff2cc5f5740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c2be92f4d0 0x55c2bed037a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:44.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.391+0000 7ff2cc5f5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2be9501b0 0x55c2bed03ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:44.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.391+0000 7ff2cc5f5740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c01afe20 con 0x55c2be92f4d0 2024-08-31T05:34:44.394 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.391+0000 7ff2cc5f5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c01af750 con 0x55c2be9501b0 2024-08-31T05:34:44.394 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.391+0000 7ff2cc5f5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c01ac990 con 0x55c2be9272f0 2024-08-31T05:34:44.394 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.391+0000 7ff2cc5f5740 10 client.0 _ll_register_callbacks cb 0x7ff2b8009e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:34:44.395 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.392+0000 7ff2bf7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2be9501b0 0x55c2bed03ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:44.395 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.392+0000 7ff2bf7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2be9501b0 0x55c2bed03ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:50678/0 (socket says 172.21.15.5:50678) 2024-08-31T05:34:44.395 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.392+0000 7ff2bf7fe640 1 -- 172.21.15.5:0/2906101740 learned_addr learned my addr 172.21.15.5:0/2906101740 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:44.395 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.392+0000 7ff2b7fff640 1 --2- 172.21.15.5:0/2906101740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c2be92f4d0 0x55c2bed037a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:44.395 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.392+0000 7ff2beffd640 1 --2- 172.21.15.5:0/2906101740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2be9272f0 0x55c2bed14970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:44.395 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.392+0000 7ff2beffd640 1 -- 172.21.15.5:0/2906101740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2be9501b0 msgr2=0x55c2bed03ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:44.395 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.392+0000 7ff2beffd640 1 --2- 172.21.15.5:0/2906101740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2be9501b0 0x55c2bed03ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:44.395 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.392+0000 7ff2beffd640 1 -- 172.21.15.5:0/2906101740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c2be92f4d0 msgr2=0x55c2bed037a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:44.395 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.392+0000 7ff2beffd640 1 --2- 172.21.15.5:0/2906101740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c2be92f4d0 0x55c2bed037a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:44.395 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.392+0000 7ff2beffd640 1 -- 172.21.15.5:0/2906101740 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2bed043d0 con 0x55c2be9272f0 2024-08-31T05:34:44.395 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.393+0000 7ff2beffd640 1 --2- 172.21.15.5:0/2906101740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2be9272f0 0x55c2bed14970 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff2b002a860 tx=0x7ff2b0107bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=311e09ff91cd5809 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:44.396 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.393+0000 7ff2a67fc640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:34:44.396 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.393+0000 7ff2a67fc640 1 -- 172.21.15.5:0/2906101740 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b00cb360 con 0x55c2be9272f0 2024-08-31T05:34:44.396 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.393+0000 7ff2a67fc640 1 -- 172.21.15.5:0/2906101740 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7ff2b0030450 con 0x55c2be9272f0 2024-08-31T05:34:44.396 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.393+0000 7ff2cc5f5740 1 -- 172.21.15.5:0/2906101740 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2a80053e0 con 0x55c2be9272f0 2024-08-31T05:34:44.396 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.394+0000 7ff2a67fc640 1 -- 172.21.15.5:0/2906101740 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ff2b00c71a0 con 0x55c2be9272f0 2024-08-31T05:34:44.397 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.395+0000 7ff2cc5f5740 10 client.26422 fetch_fsmap learned FSMap version 34 2024-08-31T05:34:44.397 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.395+0000 7ff2cc5f5740 1 -- 172.21.15.5:0/2906101740 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55c2bed84b20 con 0x55c2be9272f0 2024-08-31T05:34:44.398 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.396+0000 7ff2a67fc640 1 -- 172.21.15.5:0/2906101740 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2a80053e0 con 0x55c2be9272f0 2024-08-31T05:34:44.398 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.396+0000 7ff2a67fc640 1 -- 172.21.15.5:0/2906101740 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7ff2b01052f0 con 0x55c2be9272f0 2024-08-31T05:34:44.398 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.396+0000 7ff2cc5f5740 10 client.26422 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:34:44.398 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.396+0000 7ff2cc5f5740 10 client.26422 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:34:44.398 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.396+0000 7ff2cc5f5740 20 client.26422 populate_metadata read hostname 'smithi005' 2024-08-31T05:34:44.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.396+0000 7ff2cc5f5740 1 --2- 172.21.15.5:0/2906101740 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55c2be8e41c0 0x55c2bed872f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:44.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.396+0000 7ff2cc5f5740 4 client.26422 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:34:44.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.396+0000 7ff2cc5f5740 1 -- 172.21.15.5:0/2906101740 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c2bec669f0 con 0x55c2be8e41c0 2024-08-31T05:34:44.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.396+0000 7ff2b7fff640 1 --2- 172.21.15.5:0/2906101740 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55c2be8e41c0 0x55c2bed872f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:44.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.397+0000 7ff2b7fff640 1 --2- 172.21.15.5:0/2906101740 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55c2be8e41c0 0x55c2bed872f0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b2d8dd7aac1ec90 server_cookie=76ad1fcc65529897 in_seq=0 out_seq=0 2024-08-31T05:34:44.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.397+0000 7ff2a67fc640 10 client.26422 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:34:44.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.414+0000 7ff2a67fc640 1 -- 172.21.15.5:0/2906101740 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c2bec669f0 con 0x55c2be8e41c0 2024-08-31T05:34:44.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.414+0000 7ff2a67fc640 10 client.26422 handle_command_reply: tid=0 2024-08-31T05:34:44.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.415+0000 7ff2cc5f5740 1 client.26422 shutdown 2024-08-31T05:34:44.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.415+0000 7ff2cc5f5740 1 -- 172.21.15.5:0/2906101740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2be9272f0 msgr2=0x55c2bed14970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:44.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.415+0000 7ff2cc5f5740 1 --2- 172.21.15.5:0/2906101740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2be9272f0 0x55c2bed14970 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff2b002a860 tx=0x7ff2b0107bb0 comp rx=0 tx=0).stop 2024-08-31T05:34:44.418 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.415+0000 7ff2cc5f5740 1 -- 172.21.15.5:0/2906101740 shutdown_connections 2024-08-31T05:34:44.418 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.415+0000 7ff2cc5f5740 1 --2- 172.21.15.5:0/2906101740 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55c2be8e41c0 0x55c2bed872f0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:44.418 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.415+0000 7ff2cc5f5740 1 --2- 172.21.15.5:0/2906101740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2be9501b0 0x55c2bed03ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:44.418 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.415+0000 7ff2cc5f5740 1 --2- 172.21.15.5:0/2906101740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c2be92f4d0 0x55c2bed037a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:44.418 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.415+0000 7ff2cc5f5740 1 --2- 172.21.15.5:0/2906101740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2be9272f0 0x55c2bed14970 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:44.418 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.415+0000 7ff2cc5f5740 1 -- 172.21.15.5:0/2906101740 >> 172.21.15.5:0/2906101740 conn(0x55c2be944300 msgr2=0x55c2becefb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:44.418 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.415+0000 7ff2a67fc640 0 client.26422 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:34:44.418 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.415+0000 7ff2cc5f5740 1 -- 172.21.15.5:0/2906101740 shutdown_connections 2024-08-31T05:34:44.418 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.415+0000 7ff2cc5f5740 1 -- 172.21.15.5:0/2906101740 wait complete. 2024-08-31T05:34:44.418 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.416+0000 7ff2cc5f5740 20 client.26422 trim_cache size 0 max 16384 2024-08-31T05:34:44.419 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:34:44.419 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:34:44.419 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:34:44.419 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:34:44.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.416+0000 7ff2c568b640 1 -- 172.21.15.5:0/998260849 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff2ac0b4ca0 msgr2=0x7ff2ac0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:44.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.416+0000 7ff2c568b640 1 --2- 172.21.15.5:0/998260849 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff2ac0b4ca0 0x7ff2ac0b71b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8005fd0 tx=0x7ff2b8009500 comp rx=0 tx=0).stop 2024-08-31T05:34:44.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.416+0000 7ff2c568b640 1 -- 172.21.15.5:0/998260849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2c01046b0 msgr2=0x7ff2c019a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:44.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.416+0000 7ff2c568b640 1 --2- 172.21.15.5:0/998260849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2c01046b0 0x7ff2c019a200 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff2b0035040 tx=0x7ff2b0032d50 comp rx=0 tx=0).stop 2024-08-31T05:34:44.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.417+0000 7ff2c568b640 1 -- 172.21.15.5:0/998260849 shutdown_connections 2024-08-31T05:34:44.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.417+0000 7ff2c568b640 1 --2- 172.21.15.5:0/998260849 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff2ac0b4ca0 0x7ff2ac0b71b0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:44.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.417+0000 7ff2c568b640 1 --2- 172.21.15.5:0/998260849 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2c010db10 0x7ff2c019fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:44.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.417+0000 7ff2c568b640 1 --2- 172.21.15.5:0/998260849 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2c0105000 0x7ff2c019a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:44.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.417+0000 7ff2c568b640 1 --2- 172.21.15.5:0/998260849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff2c01046b0 0x7ff2c019a200 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:44.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.417+0000 7ff2c568b640 1 -- 172.21.15.5:0/998260849 >> 172.21.15.5:0/998260849 conn(0x7ff2c00fe160 msgr2=0x7ff2c0107620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:44.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.417+0000 7ff2c568b640 1 -- 172.21.15.5:0/998260849 shutdown_connections 2024-08-31T05:34:44.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:44.417+0000 7ff2c568b640 1 -- 172.21.15.5:0/998260849 wait complete. 2024-08-31T05:34:44.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:34:44 smithi005 ceph-mon[18602]: pgmap v488: 129 pgs: 129 active+clean; 282 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.2 MiB/s wr, 230 op/s 2024-08-31T05:34:44.917 INFO:tasks.workunit.client.0.smithi005.stdout: 1 527216 13.32 MB/sec execute 92 sec latency 23.306 ms 2024-08-31T05:34:45.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.006+0000 7f249aff1640 1 -- 172.21.15.5:0/2333887220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2494108150 msgr2=0x7f2494108560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:45.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.006+0000 7f249aff1640 1 --2- 172.21.15.5:0/2333887220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2494108150 0x7f2494108560 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f2480009900 tx=0x7f248002a410 comp rx=0 tx=0).stop 2024-08-31T05:34:45.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.007+0000 7f249aff1640 1 -- 172.21.15.5:0/2333887220 shutdown_connections 2024-08-31T05:34:45.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.007+0000 7f249aff1640 1 --2- 172.21.15.5:0/2333887220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2494108aa0 0x7f249410f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:45.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.007+0000 7f249aff1640 1 --2- 172.21.15.5:0/2333887220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2494108150 0x7f2494108560 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:45.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.007+0000 7f249aff1640 1 --2- 172.21.15.5:0/2333887220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2494102810 0x7f2494102c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:45.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.007+0000 7f249aff1640 1 -- 172.21.15.5:0/2333887220 >> 172.21.15.5:0/2333887220 conn(0x7f24940794b0 msgr2=0x7f24940798c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:45.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.007+0000 7f249aff1640 1 -- 172.21.15.5:0/2333887220 shutdown_connections 2024-08-31T05:34:45.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.007+0000 7f249aff1640 1 -- 172.21.15.5:0/2333887220 wait complete. 2024-08-31T05:34:45.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.007+0000 7f249aff1640 1 Processor -- start 2024-08-31T05:34:45.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.007+0000 7f249aff1640 1 -- start start 2024-08-31T05:34:45.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.008+0000 7f249aff1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2494102810 0x7f249419a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:45.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.008+0000 7f249aff1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2494108150 0x7f249419a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:45.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.008+0000 7f249aff1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2494108aa0 0x7f249419fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:45.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.008+0000 7f249aff1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2494113850 con 0x7f2494108aa0 2024-08-31T05:34:45.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.008+0000 7f249aff1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f24941136d0 con 0x7f2494108150 2024-08-31T05:34:45.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.008+0000 7f249aff1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f24941139d0 con 0x7f2494102810 2024-08-31T05:34:45.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.008+0000 7f2498d8d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2494102810 0x7f249419a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:45.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.008+0000 7f249958e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2494108aa0 0x7f249419fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:45.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.008+0000 7f2498d8d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2494102810 0x7f249419a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:41426/0 (socket says 172.21.15.5:41426) 2024-08-31T05:34:45.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.008+0000 7f2498d8d640 1 -- 172.21.15.5:0/1171952997 learned_addr learned my addr 172.21.15.5:0/1171952997 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:45.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.008+0000 7f2493fff640 1 --2- 172.21.15.5:0/1171952997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2494108150 0x7f249419a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:45.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.008+0000 7f2498d8d640 1 -- 172.21.15.5:0/1171952997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2494108150 msgr2=0x7f249419a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:45.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.008+0000 7f2498d8d640 1 --2- 172.21.15.5:0/1171952997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2494108150 0x7f249419a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:45.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.008+0000 7f2498d8d640 1 -- 172.21.15.5:0/1171952997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2494108aa0 msgr2=0x7f249419fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:45.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.008+0000 7f2498d8d640 1 --2- 172.21.15.5:0/1171952997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2494108aa0 0x7f249419fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:45.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.008+0000 7f2498d8d640 1 -- 172.21.15.5:0/1171952997 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24941a0210 con 0x7f2494102810 2024-08-31T05:34:45.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.008+0000 7f249958e640 1 --2- 172.21.15.5:0/1171952997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2494108aa0 0x7f249419fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:34:45.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.009+0000 7f2498d8d640 1 --2- 172.21.15.5:0/1171952997 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2494102810 0x7f249419a2a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f248800e9f0 tx=0x7f248800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:45.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.009+0000 7f2491ffb640 1 -- 172.21.15.5:0/1171952997 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248800cd80 con 0x7f2494102810 2024-08-31T05:34:45.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.009+0000 7f2491ffb640 1 -- 172.21.15.5:0/1171952997 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f24880108e0 con 0x7f2494102810 2024-08-31T05:34:45.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.009+0000 7f2491ffb640 1 -- 172.21.15.5:0/1171952997 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2488018980 con 0x7f2494102810 2024-08-31T05:34:45.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.009+0000 7f249aff1640 1 -- 172.21.15.5:0/1171952997 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24941a0500 con 0x7f2494102810 2024-08-31T05:34:45.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.009+0000 7f249aff1640 1 -- 172.21.15.5:0/1171952997 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24941a6c60 con 0x7f2494102810 2024-08-31T05:34:45.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.012+0000 7f24a1566740 1 Processor -- start 2024-08-31T05:34:45.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.012+0000 7f2491ffb640 1 -- 172.21.15.5:0/1171952997 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f2488010430 con 0x7f2494102810 2024-08-31T05:34:45.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.012+0000 7f24a1566740 1 -- start start 2024-08-31T05:34:45.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.012+0000 7f24a1566740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5557bec22070 0x5557befc7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:45.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.012+0000 7f24a1566740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557bebf91b0 0x5557befc7890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:45.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.012+0000 7f24a1566740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557bec01390 0x5557befc7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:45.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.012+0000 7f24a1566740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5557bef3e680 con 0x5557bebf91b0 2024-08-31T05:34:45.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.012+0000 7f24a1566740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5557bef2dc10 con 0x5557bec01390 2024-08-31T05:34:45.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.012+0000 7f24a1566740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5557bef31bc0 con 0x5557bec22070 2024-08-31T05:34:45.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.012+0000 7f249958e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5557bec22070 0x5557befc7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:45.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.012+0000 7f249958e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5557bec22070 0x5557befc7350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:41428/0 (socket says 172.21.15.5:41428) 2024-08-31T05:34:45.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.012+0000 7f249958e640 1 -- 172.21.15.5:0/3451099714 learned_addr learned my addr 172.21.15.5:0/3451099714 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:45.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.012+0000 7f2493fff640 1 --2- 172.21.15.5:0/3451099714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557bec01390 0x5557befc7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:45.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.012+0000 7f2498d8d640 1 --2- 172.21.15.5:0/3451099714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557bebf91b0 0x5557befc7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:45.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.013+0000 7f249958e640 1 -- 172.21.15.5:0/3451099714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557bec01390 msgr2=0x5557befc7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:45.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.013+0000 7f249958e640 1 --2- 172.21.15.5:0/3451099714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557bec01390 0x5557befc7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:45.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.013+0000 7f249958e640 1 -- 172.21.15.5:0/3451099714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557bebf91b0 msgr2=0x5557befc7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:45.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.013+0000 7f249958e640 1 --2- 172.21.15.5:0/3451099714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557bebf91b0 0x5557befc7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:45.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.013+0000 7f249958e640 1 -- 172.21.15.5:0/3451099714 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557bec8d650 con 0x5557bec22070 2024-08-31T05:34:45.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.013+0000 7f2493fff640 1 --2- 172.21.15.5:0/3451099714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557bec01390 0x5557befc7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:34:45.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.013+0000 7f2491ffb640 1 --2- 172.21.15.5:0/1171952997 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f24840b4ca0 0x7f24840b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:45.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.013+0000 7f2498d8d640 1 --2- 172.21.15.5:0/1171952997 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f24840b4ca0 0x7f24840b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:45.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.013+0000 7f249958e640 1 --2- 172.21.15.5:0/3451099714 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5557bec22070 0x5557befc7350 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f248c0107e0 tx=0x7f248c010ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1ee06681c18cbf2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:45.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.013+0000 7f2491ffb640 1 -- 172.21.15.5:0/1171952997 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f24880e5bd0 con 0x7f2494102810 2024-08-31T05:34:45.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.013+0000 7f247effd640 1 -- 172.21.15.5:0/3451099714 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248c003b70 con 0x5557bec22070 2024-08-31T05:34:45.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.013+0000 7f247effd640 1 -- 172.21.15.5:0/3451099714 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f248c00ede0 con 0x5557bec22070 2024-08-31T05:34:45.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.013+0000 7f247effd640 1 -- 172.21.15.5:0/3451099714 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248c0046b0 con 0x5557bec22070 2024-08-31T05:34:45.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.014+0000 7f24a1566740 1 -- 172.21.15.5:0/3451099714 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5557bec22070 msgr2=0x5557befc7350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:45.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.014+0000 7f2498d8d640 1 --2- 172.21.15.5:0/1171952997 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f24840b4ca0 0x7f24840b71b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f24880e3050 tx=0x7f24880e9720 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:45.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.014+0000 7f24a1566740 1 --2- 172.21.15.5:0/3451099714 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5557bec22070 0x5557befc7350 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f248c0107e0 tx=0x7f248c010ca0 comp rx=0 tx=0).stop 2024-08-31T05:34:45.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.014+0000 7f24a1566740 1 -- 172.21.15.5:0/3451099714 shutdown_connections 2024-08-31T05:34:45.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.014+0000 7f24a1566740 1 --2- 172.21.15.5:0/3451099714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557bec01390 0x5557befc7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:45.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.014+0000 7f24a1566740 1 --2- 172.21.15.5:0/3451099714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557bebf91b0 0x5557befc7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:45.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.014+0000 7f24a1566740 1 --2- 172.21.15.5:0/3451099714 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5557bec22070 0x5557befc7350 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:45.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.014+0000 7f24a1566740 1 -- 172.21.15.5:0/3451099714 >> 172.21.15.5:0/3451099714 conn(0x5557bec16460 msgr2=0x5557befc5240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:45.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.014+0000 7f24a1566740 1 -- 172.21.15.5:0/3451099714 shutdown_connections 2024-08-31T05:34:45.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.015+0000 7f24a1566740 1 -- 172.21.15.5:0/3451099714 wait complete. 2024-08-31T05:34:45.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.015+0000 7f24a1566740 1 -- start start 2024-08-31T05:34:45.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.015+0000 7f24a1566740 1 Processor -- start 2024-08-31T05:34:45.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.015+0000 7f24a1566740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5557bebf91b0 0x5557befd2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:45.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.015+0000 7f24a1566740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557bec01390 0x5557befd3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:45.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.015+0000 7f24a1566740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557bec22070 0x5557befdee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:45.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.016+0000 7f24a1566740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5557bed90700 con 0x5557bec01390 2024-08-31T05:34:45.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.016+0000 7f24a1566740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5557beeb4750 con 0x5557bec22070 2024-08-31T05:34:45.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.016+0000 7f24a1566740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5557befd5b30 con 0x5557bebf91b0 2024-08-31T05:34:45.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.016+0000 7f24a1566740 10 client.0 _ll_register_callbacks cb 0x5557beee3e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:34:45.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.016+0000 7f249958e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5557bebf91b0 0x5557befd2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:45.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.016+0000 7f2493fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557bec01390 0x5557befd3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:45.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.016+0000 7f249958e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5557bebf91b0 0x5557befd2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:41440/0 (socket says 172.21.15.5:41440) 2024-08-31T05:34:45.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.016+0000 7f249958e640 1 -- 172.21.15.5:0/2583349763 learned_addr learned my addr 172.21.15.5:0/2583349763 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:45.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.016+0000 7f249958e640 1 --2- 172.21.15.5:0/2583349763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557bec22070 0x5557befdee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:45.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.016+0000 7f249958e640 1 -- 172.21.15.5:0/2583349763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557bec22070 msgr2=0x5557befdee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:45.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.016+0000 7f249958e640 1 --2- 172.21.15.5:0/2583349763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557bec22070 0x5557befdee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:45.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.016+0000 7f249958e640 1 -- 172.21.15.5:0/2583349763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557bec01390 msgr2=0x5557befd3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:45.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.016+0000 7f249958e640 1 --2- 172.21.15.5:0/2583349763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557bec01390 0x5557befd3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:45.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.016+0000 7f249958e640 1 -- 172.21.15.5:0/2583349763 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557beeed900 con 0x5557bebf91b0 2024-08-31T05:34:45.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.016+0000 7f249958e640 1 --2- 172.21.15.5:0/2583349763 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5557bebf91b0 0x5557befd2b00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f248c00eb20 tx=0x7f248c009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3241bddc2b56d1e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:45.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.016+0000 7f2473fff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:34:45.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.016+0000 7f2473fff640 1 -- 172.21.15.5:0/2583349763 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248c023070 con 0x5557bebf91b0 2024-08-31T05:34:45.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.016+0000 7f24a1566740 1 -- 172.21.15.5:0/2583349763 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f248c00ede0 con 0x5557bebf91b0 2024-08-31T05:34:45.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.016+0000 7f2473fff640 1 -- 172.21.15.5:0/2583349763 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f248c004c40 con 0x5557bebf91b0 2024-08-31T05:34:45.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.017+0000 7f2473fff640 1 -- 172.21.15.5:0/2583349763 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f248c032050 con 0x5557bebf91b0 2024-08-31T05:34:45.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.017+0000 7f24a1566740 10 client.26434 fetch_fsmap learned FSMap version 34 2024-08-31T05:34:45.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.017+0000 7f24a1566740 1 -- 172.21.15.5:0/2583349763 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5557befe1960 con 0x5557bebf91b0 2024-08-31T05:34:45.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.017+0000 7f2473fff640 1 -- 172.21.15.5:0/2583349763 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f248c00ede0 con 0x5557bebf91b0 2024-08-31T05:34:45.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.017+0000 7f2473fff640 1 -- 172.21.15.5:0/2583349763 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f248c005030 con 0x5557bebf91b0 2024-08-31T05:34:45.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.017+0000 7f24a1566740 10 client.26434 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:34:45.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.017+0000 7f24a1566740 10 client.26434 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-31T05:34:45.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.017+0000 7f24a1566740 20 client.26434 populate_metadata read hostname 'smithi005' 2024-08-31T05:34:45.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.017+0000 7f24a1566740 1 --2- 172.21.15.5:0/2583349763 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5557bebe09f0 0x5557befe4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:45.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.017+0000 7f24a1566740 4 client.26434 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:34:45.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.017+0000 7f24a1566740 1 -- 172.21.15.5:0/2583349763 --> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5557bef405d0 con 0x5557bebe09f0 2024-08-31T05:34:45.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.017+0000 7f2493fff640 1 --2- 172.21.15.5:0/2583349763 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5557bebe09f0 0x5557befe4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:45.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.018+0000 7f2473fff640 10 client.26434 ms_handle_connect on v2:172.21.15.70:6834/2061504114 2024-08-31T05:34:45.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.018+0000 7f2493fff640 1 --2- 172.21.15.5:0/2583349763 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5557bebe09f0 0x5557befe4d80 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=154f8eaddf0364d server_cookie=33996eacedfd3d3c in_seq=0 out_seq=0 2024-08-31T05:34:45.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.019+0000 7f2473fff640 1 -- 172.21.15.5:0/2583349763 <== mds.3 v2:172.21.15.70:6834/2061504114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5557bef405d0 con 0x5557bebe09f0 2024-08-31T05:34:45.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.019+0000 7f2473fff640 10 client.26434 handle_command_reply: tid=0 2024-08-31T05:34:45.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.019+0000 7f24a1566740 1 client.26434 shutdown 2024-08-31T05:34:45.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.019+0000 7f24a1566740 1 -- 172.21.15.5:0/2583349763 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5557bebf91b0 msgr2=0x5557befd2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:45.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.019+0000 7f24a1566740 1 --2- 172.21.15.5:0/2583349763 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5557bebf91b0 0x5557befd2b00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f248c00eb20 tx=0x7f248c009920 comp rx=0 tx=0).stop 2024-08-31T05:34:45.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.019+0000 7f24a1566740 1 -- 172.21.15.5:0/2583349763 shutdown_connections 2024-08-31T05:34:45.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.019+0000 7f24a1566740 1 --2- 172.21.15.5:0/2583349763 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5557bebe09f0 0x5557befe4d80 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:45.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.019+0000 7f24a1566740 1 --2- 172.21.15.5:0/2583349763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557bec22070 0x5557befdee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:45.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.019+0000 7f24a1566740 1 --2- 172.21.15.5:0/2583349763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557bec01390 0x5557befd3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:45.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.019+0000 7f2473fff640 0 client.26434 ms_handle_reset on v2:172.21.15.70:6834/2061504114 2024-08-31T05:34:45.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.019+0000 7f24a1566740 1 --2- 172.21.15.5:0/2583349763 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5557bebf91b0 0x5557befd2b00 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:45.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.019+0000 7f24a1566740 1 -- 172.21.15.5:0/2583349763 >> 172.21.15.5:0/2583349763 conn(0x5557bec16460 msgr2=0x5557befca4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:45.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.019+0000 7f24a1566740 1 -- 172.21.15.5:0/2583349763 shutdown_connections 2024-08-31T05:34:45.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.019+0000 7f24a1566740 1 -- 172.21.15.5:0/2583349763 wait complete. 2024-08-31T05:34:45.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.019+0000 7f24a1566740 20 client.26434 trim_cache size 0 max 16384 2024-08-31T05:34:45.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.034+0000 7f24a1566740 1 Processor -- start 2024-08-31T05:34:45.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.034+0000 7f24a1566740 1 -- start start 2024-08-31T05:34:45.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.034+0000 7f24a1566740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557bebf91b0 0x5557befd4730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:45.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.034+0000 7f24a1566740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5557bec01390 0x5557befdedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:45.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.034+0000 7f24a1566740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557bec22070 0x5557befcfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:45.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.034+0000 7f24a1566740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f24941b0c20 con 0x5557bebf91b0 2024-08-31T05:34:45.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.034+0000 7f24a1566740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f24941b2760 con 0x5557bec22070 2024-08-31T05:34:45.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.034+0000 7f24a1566740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f24941b12f0 con 0x5557bec01390 2024-08-31T05:34:45.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.035+0000 7f249958e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557bebf91b0 0x5557befd4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:45.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.035+0000 7f2493fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5557bec01390 0x5557befdedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:45.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.035+0000 7f249958e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557bebf91b0 0x5557befd4730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40304/0 (socket says 172.21.15.5:40304) 2024-08-31T05:34:45.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.035+0000 7f249958e640 1 -- 172.21.15.5:0/1556583071 learned_addr learned my addr 172.21.15.5:0/1556583071 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:45.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.035+0000 7f249958e640 1 --2- 172.21.15.5:0/1556583071 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557bec22070 0x5557befcfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:45.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.035+0000 7f2493fff640 1 -- 172.21.15.5:0/1556583071 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557bec22070 msgr2=0x5557befcfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:45.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.035+0000 7f2493fff640 1 --2- 172.21.15.5:0/1556583071 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557bec22070 0x5557befcfcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:45.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.035+0000 7f2493fff640 1 -- 172.21.15.5:0/1556583071 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557bebf91b0 msgr2=0x5557befd4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:45.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.035+0000 7f2493fff640 1 --2- 172.21.15.5:0/1556583071 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557bebf91b0 0x5557befd4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:45.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.035+0000 7f2493fff640 1 -- 172.21.15.5:0/1556583071 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557befd3dc0 con 0x5557bec01390 2024-08-31T05:34:45.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.035+0000 7f2493fff640 1 --2- 172.21.15.5:0/1556583071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5557bec01390 0x5557befdedc0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f248002a930 tx=0x7f2480031400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac2db582a91afd06 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:45.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.035+0000 7f247e7fc640 1 -- 172.21.15.5:0/1556583071 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2480035040 con 0x5557bec01390 2024-08-31T05:34:45.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.035+0000 7f247e7fc640 1 -- 172.21.15.5:0/1556583071 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f24800054f0 con 0x5557bec01390 2024-08-31T05:34:45.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.035+0000 7f247e7fc640 1 -- 172.21.15.5:0/1556583071 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2480004cb0 con 0x5557bec01390 2024-08-31T05:34:45.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.036+0000 7f24a1566740 1 -- 172.21.15.5:0/1556583071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5557bec01390 msgr2=0x5557befdedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:45.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.036+0000 7f24a1566740 1 --2- 172.21.15.5:0/1556583071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5557bec01390 0x5557befdedc0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f248002a930 tx=0x7f2480031400 comp rx=0 tx=0).stop 2024-08-31T05:34:45.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.036+0000 7f24a1566740 1 -- 172.21.15.5:0/1556583071 shutdown_connections 2024-08-31T05:34:45.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.036+0000 7f24a1566740 1 --2- 172.21.15.5:0/1556583071 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557bec22070 0x5557befcfcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:45.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.036+0000 7f24a1566740 1 --2- 172.21.15.5:0/1556583071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5557bec01390 0x5557befdedc0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:45.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.036+0000 7f24a1566740 1 --2- 172.21.15.5:0/1556583071 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557bebf91b0 0x5557befd4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:45.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.036+0000 7f24a1566740 1 -- 172.21.15.5:0/1556583071 >> 172.21.15.5:0/1556583071 conn(0x5557bec16460 msgr2=0x5557befd4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:45.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.036+0000 7f24a1566740 1 -- 172.21.15.5:0/1556583071 shutdown_connections 2024-08-31T05:34:45.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.036+0000 7f24a1566740 1 -- 172.21.15.5:0/1556583071 wait complete. 2024-08-31T05:34:45.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.037+0000 7f24a1566740 1 -- start start 2024-08-31T05:34:45.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.037+0000 7f24a1566740 1 Processor -- start 2024-08-31T05:34:45.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.038+0000 7f24a1566740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5557bebf91b0 0x5557befe6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:45.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.038+0000 7f24a1566740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557bec01390 0x5557befe6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:45.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.038+0000 7f24a1566740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557bec22070 0x5557bf0484d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:45.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.038+0000 7f24a1566740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f24941b2090 con 0x5557bec22070 2024-08-31T05:34:45.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.038+0000 7f24a1566740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f24941b19c0 con 0x5557bec01390 2024-08-31T05:34:45.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.038+0000 7f24a1566740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f24941aec00 con 0x5557bebf91b0 2024-08-31T05:34:45.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.038+0000 7f24a1566740 10 client.0 _ll_register_callbacks cb 0x7f248c020040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:34:45.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.038+0000 7f249958e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557bec22070 0x5557bf0484d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:45.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.038+0000 7f249958e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5557bebf91b0 0x5557befe6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:45.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.038+0000 7f249958e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5557bebf91b0 0x5557befe6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:41454/0 (socket says 172.21.15.5:41454) 2024-08-31T05:34:45.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.038+0000 7f2493fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557bec01390 0x5557befe6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:45.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.038+0000 7f249958e640 1 -- 172.21.15.5:0/3381493763 learned_addr learned my addr 172.21.15.5:0/3381493763 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:45.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.038+0000 7f249958e640 1 -- 172.21.15.5:0/3381493763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557bec01390 msgr2=0x5557befe6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:45.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.038+0000 7f249958e640 1 --2- 172.21.15.5:0/3381493763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557bec01390 0x5557befe6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:45.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.038+0000 7f249958e640 1 -- 172.21.15.5:0/3381493763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557bec22070 msgr2=0x5557bf0484d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:45.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.038+0000 7f249958e640 1 --2- 172.21.15.5:0/3381493763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557bec22070 0x5557bf0484d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:45.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.038+0000 7f249958e640 1 -- 172.21.15.5:0/3381493763 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557bf048b40 con 0x5557bebf91b0 2024-08-31T05:34:45.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.038+0000 7f2493fff640 1 --2- 172.21.15.5:0/3381493763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557bec01390 0x5557befe6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:34:45.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.038+0000 7f249958e640 1 --2- 172.21.15.5:0/3381493763 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5557bebf91b0 0x5557befe6730 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f248c000f80 tx=0x7f248c0096a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=297ecf2a62ab4fa6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:45.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.038+0000 7f2473fff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:34:45.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.038+0000 7f2473fff640 1 -- 172.21.15.5:0/3381493763 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248c023040 con 0x5557bebf91b0 2024-08-31T05:34:45.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.039+0000 7f2473fff640 1 -- 172.21.15.5:0/3381493763 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f248c042040 con 0x5557bebf91b0 2024-08-31T05:34:45.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.039+0000 7f24a1566740 1 -- 172.21.15.5:0/3381493763 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f24800054f0 con 0x5557bebf91b0 2024-08-31T05:34:45.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.039+0000 7f2473fff640 1 -- 172.21.15.5:0/3381493763 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f248c005820 con 0x5557bebf91b0 2024-08-31T05:34:45.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.039+0000 7f24a1566740 10 client.26440 fetch_fsmap learned FSMap version 34 2024-08-31T05:34:45.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.039+0000 7f24a1566740 1 -- 172.21.15.5:0/3381493763 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5557bf054320 con 0x5557bebf91b0 2024-08-31T05:34:45.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.039+0000 7f2473fff640 1 -- 172.21.15.5:0/3381493763 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f24800054f0 con 0x5557bebf91b0 2024-08-31T05:34:45.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.039+0000 7f2473fff640 1 -- 172.21.15.5:0/3381493763 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f248c01a850 con 0x5557bebf91b0 2024-08-31T05:34:45.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.039+0000 7f24a1566740 10 client.26440 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:34:45.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.039+0000 7f24a1566740 10 client.26440 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-31T05:34:45.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.039+0000 7f24a1566740 20 client.26440 populate_metadata read hostname 'smithi005' 2024-08-31T05:34:45.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.039+0000 7f24a1566740 1 --2- 172.21.15.5:0/3381493763 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5557bebb5da0 0x5557bf056940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:45.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.039+0000 7f24a1566740 4 client.26440 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:34:45.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.039+0000 7f24a1566740 1 -- 172.21.15.5:0/3381493763 --> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5557bef3c070 con 0x5557bebb5da0 2024-08-31T05:34:45.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.039+0000 7f2493fff640 1 --2- 172.21.15.5:0/3381493763 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5557bebb5da0 0x5557bf056940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:45.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.040+0000 7f2473fff640 10 client.26440 ms_handle_connect on v2:172.21.15.70:6834/2061504114 2024-08-31T05:34:45.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.040+0000 7f2493fff640 1 --2- 172.21.15.5:0/3381493763 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5557bebb5da0 0x5557bf056940 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=cd24923283657d03 server_cookie=18cad789f6ee46f9 in_seq=0 out_seq=0 2024-08-31T05:34:45.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.040+0000 7f2473fff640 1 -- 172.21.15.5:0/3381493763 <== mds.3 v2:172.21.15.70:6834/2061504114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5557bef3c070 con 0x5557bebb5da0 2024-08-31T05:34:45.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.040+0000 7f2473fff640 10 client.26440 handle_command_reply: tid=0 2024-08-31T05:34:45.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.040+0000 7f24a1566740 1 client.26440 shutdown 2024-08-31T05:34:45.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.040+0000 7f24a1566740 1 -- 172.21.15.5:0/3381493763 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5557bebf91b0 msgr2=0x5557befe6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:45.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.040+0000 7f24a1566740 1 --2- 172.21.15.5:0/3381493763 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5557bebf91b0 0x5557befe6730 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f248c000f80 tx=0x7f248c0096a0 comp rx=0 tx=0).stop 2024-08-31T05:34:45.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.040+0000 7f24a1566740 1 -- 172.21.15.5:0/3381493763 shutdown_connections 2024-08-31T05:34:45.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.040+0000 7f24a1566740 1 --2- 172.21.15.5:0/3381493763 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5557bebb5da0 0x5557bf056940 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:45.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.040+0000 7f24a1566740 1 --2- 172.21.15.5:0/3381493763 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557bec22070 0x5557bf0484d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:45.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.040+0000 7f24a1566740 1 --2- 172.21.15.5:0/3381493763 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557bec01390 0x5557befe6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:45.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.040+0000 7f2473fff640 0 client.26440 ms_handle_reset on v2:172.21.15.70:6834/2061504114 2024-08-31T05:34:45.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.040+0000 7f24a1566740 1 --2- 172.21.15.5:0/3381493763 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5557bebf91b0 0x5557befe6730 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:45.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.040+0000 7f24a1566740 1 -- 172.21.15.5:0/3381493763 >> 172.21.15.5:0/3381493763 conn(0x5557bec16460 msgr2=0x5557befcabe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:45.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.040+0000 7f24a1566740 1 -- 172.21.15.5:0/3381493763 shutdown_connections 2024-08-31T05:34:45.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.040+0000 7f24a1566740 1 -- 172.21.15.5:0/3381493763 wait complete. 2024-08-31T05:34:45.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.041+0000 7f24a1566740 20 client.26440 trim_cache size 0 max 16384 2024-08-31T05:34:45.047 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:34:45.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.041+0000 7f249aff1640 1 -- 172.21.15.5:0/1171952997 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f24840b4ca0 msgr2=0x7f24840b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:45.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.041+0000 7f249aff1640 1 --2- 172.21.15.5:0/1171952997 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f24840b4ca0 0x7f24840b71b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f24880e3050 tx=0x7f24880e9720 comp rx=0 tx=0).stop 2024-08-31T05:34:45.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.041+0000 7f249aff1640 1 -- 172.21.15.5:0/1171952997 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2494102810 msgr2=0x7f249419a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:45.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.041+0000 7f249aff1640 1 --2- 172.21.15.5:0/1171952997 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2494102810 0x7f249419a2a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f248800e9f0 tx=0x7f248800eeb0 comp rx=0 tx=0).stop 2024-08-31T05:34:45.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.041+0000 7f249aff1640 1 -- 172.21.15.5:0/1171952997 shutdown_connections 2024-08-31T05:34:45.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.041+0000 7f249aff1640 1 --2- 172.21.15.5:0/1171952997 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f24840b4ca0 0x7f24840b71b0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:45.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.041+0000 7f249aff1640 1 --2- 172.21.15.5:0/1171952997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2494108aa0 0x7f249419fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:45.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.041+0000 7f249aff1640 1 --2- 172.21.15.5:0/1171952997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2494108150 0x7f249419a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:45.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.041+0000 7f249aff1640 1 --2- 172.21.15.5:0/1171952997 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2494102810 0x7f249419a2a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:45.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.041+0000 7f249aff1640 1 -- 172.21.15.5:0/1171952997 >> 172.21.15.5:0/1171952997 conn(0x7f24940794b0 msgr2=0x7f2494104230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:45.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.041+0000 7f249aff1640 1 -- 172.21.15.5:0/1171952997 shutdown_connections 2024-08-31T05:34:45.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:45.041+0000 7f249aff1640 1 -- 172.21.15.5:0/1171952997 wait complete. 2024-08-31T05:34:45.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:34:44 smithi070 ceph-mon[22316]: pgmap v488: 129 pgs: 129 active+clean; 282 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.2 MiB/s wr, 230 op/s 2024-08-31T05:34:45.156 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:34:44 smithi050 ceph-mon[22146]: pgmap v488: 129 pgs: 129 active+clean; 282 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.2 MiB/s wr, 230 op/s 2024-08-31T05:34:45.916 INFO:tasks.workunit.client.0.smithi005.stdout: 1 530028 13.33 MB/sec execute 93 sec latency 11.889 ms 2024-08-31T05:34:46.390 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T05:34:46.656 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:34:46.917 INFO:tasks.workunit.client.0.smithi005.stdout: 1 533188 13.39 MB/sec execute 94 sec latency 8.519 ms 2024-08-31T05:34:46.926 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:34:46 smithi005 ceph-mon[18602]: pgmap v489: 129 pgs: 129 active+clean; 290 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.9 MiB/s wr, 253 op/s 2024-08-31T05:34:47.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:34:46 smithi070 ceph-mon[22316]: pgmap v489: 129 pgs: 129 active+clean; 290 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.9 MiB/s wr, 253 op/s 2024-08-31T05:34:47.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:34:46 smithi050 ceph-mon[22146]: pgmap v489: 129 pgs: 129 active+clean; 290 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.9 MiB/s wr, 253 op/s 2024-08-31T05:34:47.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.182+0000 7fb0386c1640 1 -- 172.21.15.5:0/3061516666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb030105910 msgr2=0x7fb03010f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:47.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.182+0000 7fb0386c1640 1 --2- 172.21.15.5:0/3061516666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb030105910 0x7fb03010f380 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fb028009ca0 tx=0x7fb02802a8c0 comp rx=0 tx=0).stop 2024-08-31T05:34:47.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.182+0000 7fb0386c1640 1 -- 172.21.15.5:0/3061516666 shutdown_connections 2024-08-31T05:34:47.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.182+0000 7fb0386c1640 1 --2- 172.21.15.5:0/3061516666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb030105910 0x7fb03010f380 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:47.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.182+0000 7fb0386c1640 1 --2- 172.21.15.5:0/3061516666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb030104fc0 0x7fb0301053d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:47.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.182+0000 7fb0386c1640 1 --2- 172.21.15.5:0/3061516666 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb030102fb0 0x7fb0301033c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:47.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.182+0000 7fb0386c1640 1 -- 172.21.15.5:0/3061516666 >> 172.21.15.5:0/3061516666 conn(0x7fb030079c60 msgr2=0x7fb03007a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:47.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.182+0000 7fb0386c1640 1 -- 172.21.15.5:0/3061516666 shutdown_connections 2024-08-31T05:34:47.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.182+0000 7fb0386c1640 1 -- 172.21.15.5:0/3061516666 wait complete. 2024-08-31T05:34:47.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.183+0000 7fb0386c1640 1 Processor -- start 2024-08-31T05:34:47.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.183+0000 7fb0386c1640 1 -- start start 2024-08-31T05:34:47.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.183+0000 7fb0386c1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb030102fb0 0x7fb03019a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:47.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.183+0000 7fb0386c1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb030104fc0 0x7fb03019a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:47.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.183+0000 7fb0386c1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb030105910 0x7fb03019fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:47.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.184+0000 7fb0386c1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb030112800 con 0x7fb030104fc0 2024-08-31T05:34:47.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.184+0000 7fb0386c1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb030112680 con 0x7fb030105910 2024-08-31T05:34:47.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.184+0000 7fb0386c1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb030112980 con 0x7fb030102fb0 2024-08-31T05:34:47.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.184+0000 7fb03645d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb030102fb0 0x7fb03019a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:47.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.184+0000 7fb035c5c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb030104fc0 0x7fb03019a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:47.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.184+0000 7fb03645d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb030102fb0 0x7fb03019a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:41466/0 (socket says 172.21.15.5:41466) 2024-08-31T05:34:47.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.184+0000 7fb03645d640 1 -- 172.21.15.5:0/3331988305 learned_addr learned my addr 172.21.15.5:0/3331988305 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:47.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.184+0000 7fb036c5e640 1 --2- 172.21.15.5:0/3331988305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb030105910 0x7fb03019fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:47.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.184+0000 7fb03645d640 1 -- 172.21.15.5:0/3331988305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb030105910 msgr2=0x7fb03019fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:47.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.184+0000 7fb03645d640 1 --2- 172.21.15.5:0/3331988305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb030105910 0x7fb03019fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:47.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.184+0000 7fb03645d640 1 -- 172.21.15.5:0/3331988305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb030104fc0 msgr2=0x7fb03019a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:47.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.184+0000 7fb03645d640 1 --2- 172.21.15.5:0/3331988305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb030104fc0 0x7fb03019a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:47.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.184+0000 7fb03645d640 1 -- 172.21.15.5:0/3331988305 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0301a0250 con 0x7fb030102fb0 2024-08-31T05:34:47.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.184+0000 7fb035c5c640 1 --2- 172.21.15.5:0/3331988305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb030104fc0 0x7fb03019a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:34:47.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.184+0000 7fb036c5e640 1 --2- 172.21.15.5:0/3331988305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb030105910 0x7fb03019fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:34:47.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.184+0000 7fb03645d640 1 --2- 172.21.15.5:0/3331988305 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb030102fb0 0x7fb03019a2e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb02c00e9f0 tx=0x7fb02c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:47.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.184+0000 7fb0277fe640 1 -- 172.21.15.5:0/3331988305 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb02c00cd80 con 0x7fb030102fb0 2024-08-31T05:34:47.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.184+0000 7fb0386c1640 1 -- 172.21.15.5:0/3331988305 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0301a0540 con 0x7fb030102fb0 2024-08-31T05:34:47.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.185+0000 7fb0277fe640 1 -- 172.21.15.5:0/3331988305 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb02c0108e0 con 0x7fb030102fb0 2024-08-31T05:34:47.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.185+0000 7fb0386c1640 1 -- 172.21.15.5:0/3331988305 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0301a6ca0 con 0x7fb030102fb0 2024-08-31T05:34:47.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.185+0000 7fb0277fe640 1 -- 172.21.15.5:0/3331988305 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb02c018980 con 0x7fb030102fb0 2024-08-31T05:34:47.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.187+0000 7fb03ec36740 1 Processor -- start 2024-08-31T05:34:47.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.187+0000 7fb03ec36740 1 -- start start 2024-08-31T05:34:47.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.187+0000 7fb0277fe640 1 -- 172.21.15.5:0/3331988305 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fb02c010430 con 0x7fb030102fb0 2024-08-31T05:34:47.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.188+0000 7fb03ec36740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56064747f070 0x560647824350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:47.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.188+0000 7fb03ec36740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5606474561b0 0x560647824890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:47.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.188+0000 7fb03ec36740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56064745e390 0x560647824dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:47.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.188+0000 7fb03ec36740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56064779b680 con 0x56064747f070 2024-08-31T05:34:47.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.188+0000 7fb03ec36740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56064778ac10 con 0x5606474561b0 2024-08-31T05:34:47.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.188+0000 7fb03ec36740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56064778ebc0 con 0x56064745e390 2024-08-31T05:34:47.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.188+0000 7fb036c5e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56064747f070 0x560647824350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:47.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.188+0000 7fb036c5e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56064747f070 0x560647824350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40346/0 (socket says 172.21.15.5:40346) 2024-08-31T05:34:47.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.188+0000 7fb036c5e640 1 -- 172.21.15.5:0/4072377707 learned_addr learned my addr 172.21.15.5:0/4072377707 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:47.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.188+0000 7fb03645d640 1 --2- 172.21.15.5:0/4072377707 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5606474561b0 0x560647824890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:47.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.188+0000 7fb035c5c640 1 --2- 172.21.15.5:0/4072377707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56064745e390 0x560647824dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:47.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.188+0000 7fb036c5e640 1 -- 172.21.15.5:0/4072377707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56064745e390 msgr2=0x560647824dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:47.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.188+0000 7fb036c5e640 1 --2- 172.21.15.5:0/4072377707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56064745e390 0x560647824dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:47.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.188+0000 7fb036c5e640 1 -- 172.21.15.5:0/4072377707 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5606474561b0 msgr2=0x560647824890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:47.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.188+0000 7fb036c5e640 1 --2- 172.21.15.5:0/4072377707 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5606474561b0 0x560647824890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:47.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.188+0000 7fb036c5e640 1 -- 172.21.15.5:0/4072377707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606474ea650 con 0x56064747f070 2024-08-31T05:34:47.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.188+0000 7fb0277fe640 1 --2- 172.21.15.5:0/3331988305 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb01c0b4ca0 0x7fb01c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:47.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.188+0000 7fb036c5e640 1 --2- 172.21.15.5:0/4072377707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56064747f070 0x560647824350 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fb028009470 tx=0x7fb0280094a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ace1f1fe9827ed97 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:47.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.189+0000 7fb0277fe640 1 -- 172.21.15.5:0/3331988305 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fb02c0e5ce0 con 0x7fb030102fb0 2024-08-31T05:34:47.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.189+0000 7fb03645d640 1 --2- 172.21.15.5:0/3331988305 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb01c0b4ca0 0x7fb01c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:47.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.189+0000 7fb024ff9640 1 -- 172.21.15.5:0/4072377707 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb028031cf0 con 0x56064747f070 2024-08-31T05:34:47.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.189+0000 7fb024ff9640 1 -- 172.21.15.5:0/4072377707 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb028036040 con 0x56064747f070 2024-08-31T05:34:47.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.189+0000 7fb024ff9640 1 -- 172.21.15.5:0/4072377707 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0280042a0 con 0x56064747f070 2024-08-31T05:34:47.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.190+0000 7fb03ec36740 1 -- 172.21.15.5:0/4072377707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56064747f070 msgr2=0x560647824350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:47.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.190+0000 7fb03ec36740 1 --2- 172.21.15.5:0/4072377707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56064747f070 0x560647824350 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fb028009470 tx=0x7fb0280094a0 comp rx=0 tx=0).stop 2024-08-31T05:34:47.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.190+0000 7fb03645d640 1 --2- 172.21.15.5:0/3331988305 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb01c0b4ca0 0x7fb01c0b71b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x560647822fd0 tx=0x7fb02c0e9790 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:47.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.190+0000 7fb03ec36740 1 -- 172.21.15.5:0/4072377707 shutdown_connections 2024-08-31T05:34:47.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.190+0000 7fb03ec36740 1 --2- 172.21.15.5:0/4072377707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56064745e390 0x560647824dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:47.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.190+0000 7fb03ec36740 1 --2- 172.21.15.5:0/4072377707 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5606474561b0 0x560647824890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:47.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.190+0000 7fb03ec36740 1 --2- 172.21.15.5:0/4072377707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56064747f070 0x560647824350 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:47.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.190+0000 7fb03ec36740 1 -- 172.21.15.5:0/4072377707 >> 172.21.15.5:0/4072377707 conn(0x560647473460 msgr2=0x560647822240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:47.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.190+0000 7fb03ec36740 1 -- 172.21.15.5:0/4072377707 shutdown_connections 2024-08-31T05:34:47.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.190+0000 7fb03ec36740 1 -- 172.21.15.5:0/4072377707 wait complete. 2024-08-31T05:34:47.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.191+0000 7fb03ec36740 1 -- start start 2024-08-31T05:34:47.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.191+0000 7fb03ec36740 1 Processor -- start 2024-08-31T05:34:47.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.191+0000 7fb03ec36740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5606474561b0 0x56064782fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:47.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.191+0000 7fb03ec36740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56064745e390 0x560647830090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:47.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.191+0000 7fb03ec36740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56064747f070 0x56064783bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:47.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.191+0000 7fb03ec36740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5606475ed700 con 0x5606474561b0 2024-08-31T05:34:47.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.191+0000 7fb03ec36740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560647711750 con 0x56064747f070 2024-08-31T05:34:47.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.191+0000 7fb03ec36740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560647832ad0 con 0x56064745e390 2024-08-31T05:34:47.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.191+0000 7fb03ec36740 10 client.0 _ll_register_callbacks cb 0x560647740e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:34:47.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.191+0000 7fb036c5e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5606474561b0 0x56064782fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:47.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.191+0000 7fb036c5e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5606474561b0 0x56064782fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40358/0 (socket says 172.21.15.5:40358) 2024-08-31T05:34:47.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.191+0000 7fb036c5e640 1 -- 172.21.15.5:0/2953185875 learned_addr learned my addr 172.21.15.5:0/2953185875 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:47.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.191+0000 7fb035c5c640 1 --2- 172.21.15.5:0/2953185875 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56064745e390 0x560647830090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:47.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.191+0000 7fb036c5e640 1 --2- 172.21.15.5:0/2953185875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56064747f070 0x56064783bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:47.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.192+0000 7fb036c5e640 1 -- 172.21.15.5:0/2953185875 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56064745e390 msgr2=0x560647830090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:47.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.192+0000 7fb036c5e640 1 --2- 172.21.15.5:0/2953185875 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56064745e390 0x560647830090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:47.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.192+0000 7fb036c5e640 1 -- 172.21.15.5:0/2953185875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56064747f070 msgr2=0x56064783bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:47.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.192+0000 7fb036c5e640 1 --2- 172.21.15.5:0/2953185875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56064747f070 0x56064783bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:47.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.192+0000 7fb036c5e640 1 -- 172.21.15.5:0/2953185875 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56064774a900 con 0x5606474561b0 2024-08-31T05:34:47.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.192+0000 7fb035c5c640 1 --2- 172.21.15.5:0/2953185875 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56064745e390 0x560647830090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:34:47.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.192+0000 7fb036c5e640 1 --2- 172.21.15.5:0/2953185875 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5606474561b0 0x56064782fb50 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fb02802a900 tx=0x7fb028003e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96dd310bcc0bb7c3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:47.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.192+0000 7fb019ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:34:47.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.192+0000 7fb019ffb640 1 -- 172.21.15.5:0/2953185875 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb028031450 con 0x5606474561b0 2024-08-31T05:34:47.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.192+0000 7fb019ffb640 1 -- 172.21.15.5:0/2953185875 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fb0280315f0 con 0x5606474561b0 2024-08-31T05:34:47.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.192+0000 7fb03ec36740 1 -- 172.21.15.5:0/2953185875 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb028036040 con 0x5606474561b0 2024-08-31T05:34:47.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.192+0000 7fb019ffb640 1 -- 172.21.15.5:0/2953185875 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fb0280317f0 con 0x5606474561b0 2024-08-31T05:34:47.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.192+0000 7fb03ec36740 10 client.16848 fetch_fsmap learned FSMap version 34 2024-08-31T05:34:47.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.192+0000 7fb03ec36740 1 -- 172.21.15.5:0/2953185875 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56064783e8d0 con 0x5606474561b0 2024-08-31T05:34:47.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.192+0000 7fb019ffb640 1 -- 172.21.15.5:0/2953185875 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb028036040 con 0x5606474561b0 2024-08-31T05:34:47.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.193+0000 7fb019ffb640 1 -- 172.21.15.5:0/2953185875 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fb028003fe0 con 0x5606474561b0 2024-08-31T05:34:47.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.193+0000 7fb03ec36740 10 client.16848 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:34:47.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.193+0000 7fb03ec36740 10 client.16848 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-31T05:34:47.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.193+0000 7fb03ec36740 20 client.16848 populate_metadata read hostname 'smithi005' 2024-08-31T05:34:47.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.193+0000 7fb03ec36740 1 --2- 172.21.15.5:0/2953185875 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x56064743d9f0 0x560647841c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:47.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.193+0000 7fb03ec36740 4 client.16848 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:34:47.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.193+0000 7fb03ec36740 1 -- 172.21.15.5:0/2953185875 --> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56064779d5d0 con 0x56064743d9f0 2024-08-31T05:34:47.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.193+0000 7fb035c5c640 1 --2- 172.21.15.5:0/2953185875 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x56064743d9f0 0x560647841c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:47.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.193+0000 7fb035c5c640 1 --2- 172.21.15.5:0/2953185875 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x56064743d9f0 0x560647841c30 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d58075877349bb28 server_cookie=448921b77be5f271 in_seq=0 out_seq=0 2024-08-31T05:34:47.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.193+0000 7fb019ffb640 10 client.16848 ms_handle_connect on v2:172.21.15.70:6836/2780036414 2024-08-31T05:34:47.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.195+0000 7fb019ffb640 1 -- 172.21.15.5:0/2953185875 <== mds.2 v2:172.21.15.70:6836/2780036414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56064779d5d0 con 0x56064743d9f0 2024-08-31T05:34:47.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.195+0000 7fb019ffb640 10 client.16848 handle_command_reply: tid=0 2024-08-31T05:34:47.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.195+0000 7fb03ec36740 1 client.16848 shutdown 2024-08-31T05:34:47.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.195+0000 7fb03ec36740 1 -- 172.21.15.5:0/2953185875 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5606474561b0 msgr2=0x56064782fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:47.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.195+0000 7fb03ec36740 1 --2- 172.21.15.5:0/2953185875 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5606474561b0 0x56064782fb50 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fb02802a900 tx=0x7fb028003e50 comp rx=0 tx=0).stop 2024-08-31T05:34:47.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.195+0000 7fb03ec36740 1 -- 172.21.15.5:0/2953185875 shutdown_connections 2024-08-31T05:34:47.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.195+0000 7fb03ec36740 1 --2- 172.21.15.5:0/2953185875 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x56064743d9f0 0x560647841c30 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:47.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.195+0000 7fb03ec36740 1 --2- 172.21.15.5:0/2953185875 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56064747f070 0x56064783bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:47.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.195+0000 7fb019ffb640 0 client.16848 ms_handle_reset on v2:172.21.15.70:6836/2780036414 2024-08-31T05:34:47.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.195+0000 7fb03ec36740 1 --2- 172.21.15.5:0/2953185875 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56064745e390 0x560647830090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:47.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.195+0000 7fb03ec36740 1 --2- 172.21.15.5:0/2953185875 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5606474561b0 0x56064782fb50 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:47.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.195+0000 7fb03ec36740 1 -- 172.21.15.5:0/2953185875 >> 172.21.15.5:0/2953185875 conn(0x560647473460 msgr2=0x560647827530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:47.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.195+0000 7fb03ec36740 1 -- 172.21.15.5:0/2953185875 shutdown_connections 2024-08-31T05:34:47.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.195+0000 7fb03ec36740 1 -- 172.21.15.5:0/2953185875 wait complete. 2024-08-31T05:34:47.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.195+0000 7fb03ec36740 20 client.16848 trim_cache size 0 max 16384 2024-08-31T05:34:47.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.209+0000 7fb03ec36740 1 Processor -- start 2024-08-31T05:34:47.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.210+0000 7fb03ec36740 1 -- start start 2024-08-31T05:34:47.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.210+0000 7fb03ec36740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56064743d9f0 0x560647831a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:47.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.210+0000 7fb03ec36740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5606474561b0 0x56064783bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:47.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.210+0000 7fb03ec36740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56064745e390 0x560647825720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:47.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.210+0000 7fb03ec36740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb0301b0d50 con 0x56064743d9f0 2024-08-31T05:34:47.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.210+0000 7fb03ec36740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb0301b2890 con 0x5606474561b0 2024-08-31T05:34:47.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.210+0000 7fb03ec36740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb0301b1420 con 0x56064745e390 2024-08-31T05:34:47.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.210+0000 7fb036c5e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56064743d9f0 0x560647831a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:47.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.210+0000 7fb035c5c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5606474561b0 0x56064783bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:47.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.210+0000 7fb035c5c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5606474561b0 0x56064783bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:50770/0 (socket says 172.21.15.5:50770) 2024-08-31T05:34:47.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.210+0000 7fb036c5e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56064743d9f0 0x560647831a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40368/0 (socket says 172.21.15.5:40368) 2024-08-31T05:34:47.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.210+0000 7fb035c5c640 1 -- 172.21.15.5:0/2726311198 learned_addr learned my addr 172.21.15.5:0/2726311198 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:47.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.210+0000 7fb036c5e640 1 --2- 172.21.15.5:0/2726311198 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56064745e390 0x560647825720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:47.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.210+0000 7fb035c5c640 1 -- 172.21.15.5:0/2726311198 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56064745e390 msgr2=0x560647825720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:47.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.210+0000 7fb035c5c640 1 --2- 172.21.15.5:0/2726311198 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56064745e390 0x560647825720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:47.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.210+0000 7fb035c5c640 1 -- 172.21.15.5:0/2726311198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56064743d9f0 msgr2=0x560647831a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:47.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.210+0000 7fb035c5c640 1 --2- 172.21.15.5:0/2726311198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56064743d9f0 0x560647831a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:47.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.210+0000 7fb035c5c640 1 -- 172.21.15.5:0/2726311198 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560647822bb0 con 0x5606474561b0 2024-08-31T05:34:47.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.211+0000 7fb035c5c640 1 --2- 172.21.15.5:0/2726311198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5606474561b0 0x56064783bd30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb030075800 tx=0x7fb02000b390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e80036b12c1c2fc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:47.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.211+0000 7fb01bfff640 1 -- 172.21.15.5:0/2726311198 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb020004020 con 0x5606474561b0 2024-08-31T05:34:47.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.211+0000 7fb01bfff640 1 -- 172.21.15.5:0/2726311198 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb020010e20 con 0x5606474561b0 2024-08-31T05:34:47.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.211+0000 7fb01bfff640 1 -- 172.21.15.5:0/2726311198 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb020003b20 con 0x5606474561b0 2024-08-31T05:34:47.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.212+0000 7fb03ec36740 1 -- 172.21.15.5:0/2726311198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5606474561b0 msgr2=0x56064783bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:47.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.212+0000 7fb03ec36740 1 --2- 172.21.15.5:0/2726311198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5606474561b0 0x56064783bd30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb030075800 tx=0x7fb02000b390 comp rx=0 tx=0).stop 2024-08-31T05:34:47.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.212+0000 7fb03ec36740 1 -- 172.21.15.5:0/2726311198 shutdown_connections 2024-08-31T05:34:47.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.212+0000 7fb03ec36740 1 --2- 172.21.15.5:0/2726311198 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56064745e390 0x560647825720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:47.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.212+0000 7fb03ec36740 1 --2- 172.21.15.5:0/2726311198 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5606474561b0 0x56064783bd30 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:47.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.212+0000 7fb03ec36740 1 --2- 172.21.15.5:0/2726311198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56064743d9f0 0x560647831a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:47.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.212+0000 7fb03ec36740 1 -- 172.21.15.5:0/2726311198 >> 172.21.15.5:0/2726311198 conn(0x560647473460 msgr2=0x560647825010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:47.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.212+0000 7fb03ec36740 1 -- 172.21.15.5:0/2726311198 shutdown_connections 2024-08-31T05:34:47.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.212+0000 7fb03ec36740 1 -- 172.21.15.5:0/2726311198 wait complete. 2024-08-31T05:34:47.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.212+0000 7fb03ec36740 1 -- start start 2024-08-31T05:34:47.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.212+0000 7fb03ec36740 1 Processor -- start 2024-08-31T05:34:47.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.212+0000 7fb03ec36740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56064743d9f0 0x5606478449f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:47.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.212+0000 7fb03ec36740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5606474561b0 0x560647844fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:47.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.212+0000 7fb03ec36740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56064745e390 0x5606478a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:47.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.213+0000 7fb03ec36740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb0301b21c0 con 0x56064745e390 2024-08-31T05:34:47.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.213+0000 7fb03ec36740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb0301b1af0 con 0x56064743d9f0 2024-08-31T05:34:47.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.213+0000 7fb03ec36740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb0301aed30 con 0x5606474561b0 2024-08-31T05:34:47.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.213+0000 7fb03ec36740 10 client.0 _ll_register_callbacks cb 0x7fb02c0e9660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:34:47.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.213+0000 7fb036c5e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56064745e390 0x5606478a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:47.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.213+0000 7fb035c5c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5606474561b0 0x560647844fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:47.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.213+0000 7fb035c5c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5606474561b0 0x560647844fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:41508/0 (socket says 172.21.15.5:41508) 2024-08-31T05:34:47.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.213+0000 7fb035c5c640 1 -- 172.21.15.5:0/3988002735 learned_addr learned my addr 172.21.15.5:0/3988002735 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:47.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.213+0000 7fb036c5e640 1 --2- 172.21.15.5:0/3988002735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56064745e390 0x5606478a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40376/0 (socket says 172.21.15.5:40376) 2024-08-31T05:34:47.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.213+0000 7fb036c5e640 1 --2- 172.21.15.5:0/3988002735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56064743d9f0 0x5606478449f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:47.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.213+0000 7fb035c5c640 1 -- 172.21.15.5:0/3988002735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56064743d9f0 msgr2=0x5606478449f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:47.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.213+0000 7fb035c5c640 1 --2- 172.21.15.5:0/3988002735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56064743d9f0 0x5606478449f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:47.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.213+0000 7fb035c5c640 1 -- 172.21.15.5:0/3988002735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56064745e390 msgr2=0x5606478a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:47.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.213+0000 7fb035c5c640 1 --2- 172.21.15.5:0/3988002735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56064745e390 0x5606478a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:47.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.213+0000 7fb035c5c640 1 -- 172.21.15.5:0/3988002735 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606478a1b80 con 0x5606474561b0 2024-08-31T05:34:47.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.213+0000 7fb036c5e640 1 --2- 172.21.15.5:0/3988002735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56064745e390 0x5606478a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:34:47.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.213+0000 7fb035c5c640 1 --2- 172.21.15.5:0/3988002735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5606474561b0 0x560647844fd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb020011010 tx=0x7fb0200058d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97276b52dd52e595 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:47.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.213+0000 7fb019ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:34:47.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.213+0000 7fb019ffb640 1 -- 172.21.15.5:0/3988002735 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb020004020 con 0x5606474561b0 2024-08-31T05:34:47.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.213+0000 7fb019ffb640 1 -- 172.21.15.5:0/3988002735 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fb020029070 con 0x5606474561b0 2024-08-31T05:34:47.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.213+0000 7fb03ec36740 1 -- 172.21.15.5:0/3988002735 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb020010e20 con 0x5606474561b0 2024-08-31T05:34:47.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.214+0000 7fb019ffb640 1 -- 172.21.15.5:0/3988002735 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fb020039050 con 0x5606474561b0 2024-08-31T05:34:47.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.214+0000 7fb03ec36740 10 client.26458 fetch_fsmap learned FSMap version 34 2024-08-31T05:34:47.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.214+0000 7fb03ec36740 1 -- 172.21.15.5:0/3988002735 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5606478ac1b0 con 0x5606474561b0 2024-08-31T05:34:47.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.214+0000 7fb019ffb640 1 -- 172.21.15.5:0/3988002735 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb020010e20 con 0x5606474561b0 2024-08-31T05:34:47.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.214+0000 7fb019ffb640 1 -- 172.21.15.5:0/3988002735 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fb020024500 con 0x5606474561b0 2024-08-31T05:34:47.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.214+0000 7fb03ec36740 10 client.26458 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:34:47.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.214+0000 7fb03ec36740 10 client.26458 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-31T05:34:47.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.214+0000 7fb03ec36740 20 client.26458 populate_metadata read hostname 'smithi005' 2024-08-31T05:34:47.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.214+0000 7fb03ec36740 1 --2- 172.21.15.5:0/3988002735 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x56064747f070 0x5606478ae880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:47.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.214+0000 7fb03ec36740 4 client.26458 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:34:47.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.214+0000 7fb03ec36740 1 -- 172.21.15.5:0/3988002735 --> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560647799070 con 0x56064747f070 2024-08-31T05:34:47.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.214+0000 7fb036c5e640 1 --2- 172.21.15.5:0/3988002735 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x56064747f070 0x5606478ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:47.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.215+0000 7fb019ffb640 10 client.26458 ms_handle_connect on v2:172.21.15.70:6836/2780036414 2024-08-31T05:34:47.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.215+0000 7fb036c5e640 1 --2- 172.21.15.5:0/3988002735 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x56064747f070 0x5606478ae880 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e9872abbabf38b2 server_cookie=da49ea1cec2df3c8 in_seq=0 out_seq=0 2024-08-31T05:34:47.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.218+0000 7fb019ffb640 1 -- 172.21.15.5:0/3988002735 <== mds.2 v2:172.21.15.70:6836/2780036414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560647799070 con 0x56064747f070 2024-08-31T05:34:47.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.218+0000 7fb019ffb640 10 client.26458 handle_command_reply: tid=0 2024-08-31T05:34:47.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.218+0000 7fb03ec36740 1 client.26458 shutdown 2024-08-31T05:34:47.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.218+0000 7fb03ec36740 1 -- 172.21.15.5:0/3988002735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5606474561b0 msgr2=0x560647844fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:47.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.218+0000 7fb03ec36740 1 --2- 172.21.15.5:0/3988002735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5606474561b0 0x560647844fd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb020011010 tx=0x7fb0200058d0 comp rx=0 tx=0).stop 2024-08-31T05:34:47.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.218+0000 7fb03ec36740 1 -- 172.21.15.5:0/3988002735 shutdown_connections 2024-08-31T05:34:47.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.218+0000 7fb03ec36740 1 --2- 172.21.15.5:0/3988002735 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x56064747f070 0x5606478ae880 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:47.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.218+0000 7fb03ec36740 1 --2- 172.21.15.5:0/3988002735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56064745e390 0x5606478a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:47.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.218+0000 7fb03ec36740 1 --2- 172.21.15.5:0/3988002735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5606474561b0 0x560647844fd0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:47.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.218+0000 7fb03ec36740 1 --2- 172.21.15.5:0/3988002735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56064743d9f0 0x5606478449f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:47.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.218+0000 7fb019ffb640 0 client.26458 ms_handle_reset on v2:172.21.15.70:6836/2780036414 2024-08-31T05:34:47.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.218+0000 7fb03ec36740 1 -- 172.21.15.5:0/3988002735 >> 172.21.15.5:0/3988002735 conn(0x560647473460 msgr2=0x560647825010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:47.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.218+0000 7fb03ec36740 1 -- 172.21.15.5:0/3988002735 shutdown_connections 2024-08-31T05:34:47.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.218+0000 7fb03ec36740 1 -- 172.21.15.5:0/3988002735 wait complete. 2024-08-31T05:34:47.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.218+0000 7fb03ec36740 20 client.26458 trim_cache size 0 max 16384 2024-08-31T05:34:47.224 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:34:47.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.219+0000 7fb0386c1640 1 -- 172.21.15.5:0/3331988305 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb01c0b4ca0 msgr2=0x7fb01c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:47.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.219+0000 7fb0386c1640 1 --2- 172.21.15.5:0/3331988305 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb01c0b4ca0 0x7fb01c0b71b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x560647822fd0 tx=0x7fb02c0e9790 comp rx=0 tx=0).stop 2024-08-31T05:34:47.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.219+0000 7fb0386c1640 1 -- 172.21.15.5:0/3331988305 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb030102fb0 msgr2=0x7fb03019a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:47.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.219+0000 7fb0386c1640 1 --2- 172.21.15.5:0/3331988305 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb030102fb0 0x7fb03019a2e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb02c00e9f0 tx=0x7fb02c00eeb0 comp rx=0 tx=0).stop 2024-08-31T05:34:47.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.219+0000 7fb0386c1640 1 -- 172.21.15.5:0/3331988305 shutdown_connections 2024-08-31T05:34:47.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.219+0000 7fb0386c1640 1 --2- 172.21.15.5:0/3331988305 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb01c0b4ca0 0x7fb01c0b71b0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:47.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.219+0000 7fb0386c1640 1 --2- 172.21.15.5:0/3331988305 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb030105910 0x7fb03019fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:47.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.219+0000 7fb0386c1640 1 --2- 172.21.15.5:0/3331988305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb030104fc0 0x7fb03019a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:47.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.219+0000 7fb0386c1640 1 --2- 172.21.15.5:0/3331988305 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb030102fb0 0x7fb03019a2e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:47.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.219+0000 7fb0386c1640 1 -- 172.21.15.5:0/3331988305 >> 172.21.15.5:0/3331988305 conn(0x7fb030079c60 msgr2=0x7fb0301010d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:47.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.219+0000 7fb0386c1640 1 -- 172.21.15.5:0/3331988305 shutdown_connections 2024-08-31T05:34:47.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:47.219+0000 7fb0386c1640 1 -- 172.21.15.5:0/3331988305 wait complete. 2024-08-31T05:34:47.917 INFO:tasks.workunit.client.0.smithi005.stdout: 1 535470 13.33 MB/sec execute 95 sec latency 26.656 ms 2024-08-31T05:34:48.088 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T05:34:48.360 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:34:48.845 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:34:48 smithi005 ceph-mon[18602]: pgmap v490: 129 pgs: 129 active+clean; 290 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.4 MiB/s wr, 229 op/s 2024-08-31T05:34:48.917 INFO:tasks.workunit.client.0.smithi005.stdout: 1 537147 13.31 MB/sec execute 96 sec latency 72.353 ms 2024-08-31T05:34:48.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.944+0000 7fcd6133f640 1 -- 172.21.15.5:0/1160689686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd5c108ac0 msgr2=0x7fcd5c10f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:48.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.944+0000 7fcd6133f640 1 --2- 172.21.15.5:0/1160689686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd5c108ac0 0x7fcd5c10f2f0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fcd54009ca0 tx=0x7fcd5402a8c0 comp rx=0 tx=0).stop 2024-08-31T05:34:48.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.944+0000 7fcd6133f640 1 -- 172.21.15.5:0/1160689686 shutdown_connections 2024-08-31T05:34:48.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.944+0000 7fcd6133f640 1 --2- 172.21.15.5:0/1160689686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd5c108ac0 0x7fcd5c10f2f0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:48.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.944+0000 7fcd6133f640 1 --2- 172.21.15.5:0/1160689686 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd5c108170 0x7fcd5c108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:48.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.944+0000 7fcd6133f640 1 --2- 172.21.15.5:0/1160689686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd5c102880 0x7fcd5c102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:48.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.944+0000 7fcd6133f640 1 -- 172.21.15.5:0/1160689686 >> 172.21.15.5:0/1160689686 conn(0x7fcd5c079530 msgr2=0x7fcd5c079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:48.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.944+0000 7fcd6133f640 1 -- 172.21.15.5:0/1160689686 shutdown_connections 2024-08-31T05:34:48.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.944+0000 7fcd6133f640 1 -- 172.21.15.5:0/1160689686 wait complete. 2024-08-31T05:34:48.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.945+0000 7fcd6133f640 1 Processor -- start 2024-08-31T05:34:48.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.945+0000 7fcd6133f640 1 -- start start 2024-08-31T05:34:48.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.945+0000 7fcd6133f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd5c102880 0x7fcd5c19a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:48.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.945+0000 7fcd6133f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd5c108170 0x7fcd5c19a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:48.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.945+0000 7fcd6133f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd5c108ac0 0x7fcd5c19fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:48.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.945+0000 7fcd6133f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fcd5c112770 con 0x7fcd5c102880 2024-08-31T05:34:48.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.945+0000 7fcd6133f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcd5c1125f0 con 0x7fcd5c108170 2024-08-31T05:34:48.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.945+0000 7fcd6133f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcd5c1128f0 con 0x7fcd5c108ac0 2024-08-31T05:34:48.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.945+0000 7fcd5affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd5c102880 0x7fcd5c19a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:48.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.945+0000 7fcd5affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd5c102880 0x7fcd5c19a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40398/0 (socket says 172.21.15.5:40398) 2024-08-31T05:34:48.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.945+0000 7fcd5affd640 1 -- 172.21.15.5:0/3012654618 learned_addr learned my addr 172.21.15.5:0/3012654618 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:48.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.945+0000 7fcd5b7fe640 1 --2- 172.21.15.5:0/3012654618 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd5c108ac0 0x7fcd5c19fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:48.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.946+0000 7fcd5a7fc640 1 --2- 172.21.15.5:0/3012654618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd5c108170 0x7fcd5c19a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:48.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.946+0000 7fcd5affd640 1 -- 172.21.15.5:0/3012654618 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd5c108ac0 msgr2=0x7fcd5c19fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:48.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.946+0000 7fcd5affd640 1 --2- 172.21.15.5:0/3012654618 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd5c108ac0 0x7fcd5c19fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:48.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.946+0000 7fcd5affd640 1 -- 172.21.15.5:0/3012654618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd5c108170 msgr2=0x7fcd5c19a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:48.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.946+0000 7fcd5affd640 1 --2- 172.21.15.5:0/3012654618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd5c108170 0x7fcd5c19a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:48.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.946+0000 7fcd5affd640 1 -- 172.21.15.5:0/3012654618 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd5c1a0140 con 0x7fcd5c102880 2024-08-31T05:34:48.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.946+0000 7fcd5affd640 1 --2- 172.21.15.5:0/3012654618 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd5c102880 0x7fcd5c19a1d0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c00e9f0 tx=0x7fcd4c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:48.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.946+0000 7fcd43fff640 1 -- 172.21.15.5:0/3012654618 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c00cd80 con 0x7fcd5c102880 2024-08-31T05:34:48.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.946+0000 7fcd6133f640 1 -- 172.21.15.5:0/3012654618 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd5c1a0430 con 0x7fcd5c102880 2024-08-31T05:34:48.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.946+0000 7fcd6133f640 1 -- 172.21.15.5:0/3012654618 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd5c1a6b90 con 0x7fcd5c102880 2024-08-31T05:34:48.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.946+0000 7fcd43fff640 1 -- 172.21.15.5:0/3012654618 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd4c0108e0 con 0x7fcd5c102880 2024-08-31T05:34:48.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.947+0000 7fcd43fff640 1 -- 172.21.15.5:0/3012654618 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c018980 con 0x7fcd5c102880 2024-08-31T05:34:48.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.949+0000 7fcd678b4740 1 Processor -- start 2024-08-31T05:34:48.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.949+0000 7fcd678b4740 1 -- start start 2024-08-31T05:34:48.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.950+0000 7fcd43fff640 1 -- 172.21.15.5:0/3012654618 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fcd4c018b20 con 0x7fcd5c102880 2024-08-31T05:34:48.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.950+0000 7fcd678b4740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de6ff36070 0x55de702db310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:48.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.950+0000 7fcd678b4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55de6ff0d1b0 0x55de702db850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:48.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.950+0000 7fcd678b4740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de6ff15390 0x55de702dbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:48.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.950+0000 7fcd678b4740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55de70252680 con 0x55de6ff36070 2024-08-31T05:34:48.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.950+0000 7fcd678b4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55de70241c10 con 0x55de6ff0d1b0 2024-08-31T05:34:48.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.950+0000 7fcd678b4740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55de70245bc0 con 0x55de6ff15390 2024-08-31T05:34:48.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.950+0000 7fcd5b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de6ff36070 0x55de702db310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:48.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.950+0000 7fcd5affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55de6ff0d1b0 0x55de702db850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:48.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.950+0000 7fcd5b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de6ff36070 0x55de702db310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40404/0 (socket says 172.21.15.5:40404) 2024-08-31T05:34:48.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.950+0000 7fcd5a7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de6ff15390 0x55de702dbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:48.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.950+0000 7fcd5b7fe640 1 -- 172.21.15.5:0/1039805719 learned_addr learned my addr 172.21.15.5:0/1039805719 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:48.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.950+0000 7fcd5b7fe640 1 -- 172.21.15.5:0/1039805719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de6ff15390 msgr2=0x55de702dbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:48.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.950+0000 7fcd5b7fe640 1 --2- 172.21.15.5:0/1039805719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de6ff15390 0x55de702dbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:48.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.950+0000 7fcd5b7fe640 1 -- 172.21.15.5:0/1039805719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55de6ff0d1b0 msgr2=0x55de702db850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:48.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.950+0000 7fcd5b7fe640 1 --2- 172.21.15.5:0/1039805719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55de6ff0d1b0 0x55de702db850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:48.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.950+0000 7fcd5b7fe640 1 -- 172.21.15.5:0/1039805719 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de6ffa1650 con 0x55de6ff36070 2024-08-31T05:34:48.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.950+0000 7fcd5affd640 1 --2- 172.21.15.5:0/1039805719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55de6ff0d1b0 0x55de702db850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:34:48.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.951+0000 7fcd5b7fe640 1 --2- 172.21.15.5:0/1039805719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de6ff36070 0x55de702db310 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fcd5402f410 tx=0x7fcd5402f440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6585215078898326 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:48.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.951+0000 7fcd43fff640 1 --2- 172.21.15.5:0/3012654618 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fcd440b4d20 0x7fcd440b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:48.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.951+0000 7fcd417fa640 1 -- 172.21.15.5:0/1039805719 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd54031cf0 con 0x55de6ff36070 2024-08-31T05:34:48.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.951+0000 7fcd5affd640 1 --2- 172.21.15.5:0/3012654618 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fcd440b4d20 0x7fcd440b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:48.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.951+0000 7fcd417fa640 1 -- 172.21.15.5:0/1039805719 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd54036030 con 0x55de6ff36070 2024-08-31T05:34:48.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.951+0000 7fcd417fa640 1 -- 172.21.15.5:0/1039805719 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd540042a0 con 0x55de6ff36070 2024-08-31T05:34:48.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.951+0000 7fcd43fff640 1 -- 172.21.15.5:0/3012654618 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fcd4c0e5ba0 con 0x7fcd5c102880 2024-08-31T05:34:48.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.952+0000 7fcd678b4740 1 -- 172.21.15.5:0/1039805719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de6ff36070 msgr2=0x55de702db310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:48.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.952+0000 7fcd5affd640 1 --2- 172.21.15.5:0/3012654618 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fcd440b4d20 0x7fcd440b7230 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c0e3020 tx=0x7fcd4c0e96f0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:48.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.952+0000 7fcd678b4740 1 --2- 172.21.15.5:0/1039805719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de6ff36070 0x55de702db310 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fcd5402f410 tx=0x7fcd5402f440 comp rx=0 tx=0).stop 2024-08-31T05:34:48.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.952+0000 7fcd678b4740 1 -- 172.21.15.5:0/1039805719 shutdown_connections 2024-08-31T05:34:48.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.952+0000 7fcd678b4740 1 --2- 172.21.15.5:0/1039805719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de6ff15390 0x55de702dbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:48.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.952+0000 7fcd678b4740 1 --2- 172.21.15.5:0/1039805719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55de6ff0d1b0 0x55de702db850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:48.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.952+0000 7fcd678b4740 1 --2- 172.21.15.5:0/1039805719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de6ff36070 0x55de702db310 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:48.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.952+0000 7fcd678b4740 1 -- 172.21.15.5:0/1039805719 >> 172.21.15.5:0/1039805719 conn(0x55de6ff2a460 msgr2=0x55de702d9200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:48.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.952+0000 7fcd678b4740 1 -- 172.21.15.5:0/1039805719 shutdown_connections 2024-08-31T05:34:48.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.952+0000 7fcd678b4740 1 -- 172.21.15.5:0/1039805719 wait complete. 2024-08-31T05:34:48.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.952+0000 7fcd678b4740 1 -- start start 2024-08-31T05:34:48.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.953+0000 7fcd678b4740 1 Processor -- start 2024-08-31T05:34:48.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.953+0000 7fcd678b4740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de6ff0d1b0 0x55de702eae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:48.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.953+0000 7fcd678b4740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de6ff15390 0x55de702eb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:48.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.953+0000 7fcd678b4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55de6ff36070 0x55de702f6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:48.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.953+0000 7fcd678b4740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55de700a4700 con 0x55de6ff15390 2024-08-31T05:34:48.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.953+0000 7fcd678b4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55de701c8750 con 0x55de6ff36070 2024-08-31T05:34:48.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.953+0000 7fcd678b4740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55de702edc70 con 0x55de6ff0d1b0 2024-08-31T05:34:48.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.953+0000 7fcd678b4740 10 client.0 _ll_register_callbacks cb 0x55de701f7e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:34:48.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.953+0000 7fcd5b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de6ff0d1b0 0x55de702eae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:48.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.953+0000 7fcd5b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55de6ff36070 0x55de702f6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:48.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.953+0000 7fcd5b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de6ff0d1b0 0x55de702eae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:41554/0 (socket says 172.21.15.5:41554) 2024-08-31T05:34:48.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.953+0000 7fcd5b7fe640 1 -- 172.21.15.5:0/2491941948 learned_addr learned my addr 172.21.15.5:0/2491941948 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:48.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.953+0000 7fcd5a7fc640 1 --2- 172.21.15.5:0/2491941948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de6ff15390 0x55de702eb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:48.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.954+0000 7fcd5a7fc640 1 -- 172.21.15.5:0/2491941948 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de6ff0d1b0 msgr2=0x55de702eae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:48.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.954+0000 7fcd5a7fc640 1 --2- 172.21.15.5:0/2491941948 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de6ff0d1b0 0x55de702eae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:48.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.954+0000 7fcd5a7fc640 1 -- 172.21.15.5:0/2491941948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55de6ff36070 msgr2=0x55de702f6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:48.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.954+0000 7fcd5a7fc640 1 --2- 172.21.15.5:0/2491941948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55de6ff36070 0x55de702f6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:48.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.954+0000 7fcd5a7fc640 1 -- 172.21.15.5:0/2491941948 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de70201900 con 0x55de6ff15390 2024-08-31T05:34:48.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.954+0000 7fcd5a7fc640 1 --2- 172.21.15.5:0/2491941948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de6ff15390 0x55de702eb3b0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c06a630 tx=0x7fcd50012b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1df82dc6a92a70eb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:48.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.954+0000 7fcd3eff5640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:34:48.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.954+0000 7fcd3eff5640 1 -- 172.21.15.5:0/2491941948 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd5000f890 con 0x55de6ff15390 2024-08-31T05:34:48.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.954+0000 7fcd3eff5640 1 -- 172.21.15.5:0/2491941948 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fcd5000fa30 con 0x55de6ff15390 2024-08-31T05:34:48.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.954+0000 7fcd678b4740 1 -- 172.21.15.5:0/2491941948 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd54036030 con 0x55de6ff15390 2024-08-31T05:34:48.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.955+0000 7fcd3eff5640 1 -- 172.21.15.5:0/2491941948 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fcd5000fc30 con 0x55de6ff15390 2024-08-31T05:34:48.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.955+0000 7fcd678b4740 10 client.16866 fetch_fsmap learned FSMap version 34 2024-08-31T05:34:48.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.955+0000 7fcd678b4740 1 -- 172.21.15.5:0/2491941948 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55de702f9a80 con 0x55de6ff15390 2024-08-31T05:34:48.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.955+0000 7fcd3eff5640 1 -- 172.21.15.5:0/2491941948 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd54036030 con 0x55de6ff15390 2024-08-31T05:34:48.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.955+0000 7fcd3eff5640 1 -- 172.21.15.5:0/2491941948 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fcd5001c420 con 0x55de6ff15390 2024-08-31T05:34:48.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.955+0000 7fcd678b4740 10 client.16866 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:34:48.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.955+0000 7fcd678b4740 10 client.16866 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-31T05:34:48.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.955+0000 7fcd678b4740 20 client.16866 populate_metadata read hostname 'smithi005' 2024-08-31T05:34:48.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.955+0000 7fcd678b4740 1 --2- 172.21.15.5:0/2491941948 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55de6fef49f0 0x55de702fd440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:48.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.955+0000 7fcd678b4740 4 client.16866 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:34:48.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.955+0000 7fcd678b4740 1 -- 172.21.15.5:0/2491941948 --> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55de702545d0 con 0x55de6fef49f0 2024-08-31T05:34:48.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.956+0000 7fcd5b7fe640 1 --2- 172.21.15.5:0/2491941948 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55de6fef49f0 0x55de702fd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:48.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.956+0000 7fcd3eff5640 10 client.16866 ms_handle_connect on v2:172.21.15.50:6838/98200944 2024-08-31T05:34:48.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.956+0000 7fcd5b7fe640 1 --2- 172.21.15.5:0/2491941948 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55de6fef49f0 0x55de702fd440 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8bb54852266b388d server_cookie=f96a4468f9bd5353 in_seq=0 out_seq=0 2024-08-31T05:34:48.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.957+0000 7fcd3eff5640 1 -- 172.21.15.5:0/2491941948 <== mds.1 v2:172.21.15.50:6838/98200944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55de702545d0 con 0x55de6fef49f0 2024-08-31T05:34:48.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.957+0000 7fcd3eff5640 10 client.16866 handle_command_reply: tid=0 2024-08-31T05:34:48.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.957+0000 7fcd678b4740 1 client.16866 shutdown 2024-08-31T05:34:48.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.957+0000 7fcd678b4740 1 -- 172.21.15.5:0/2491941948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de6ff15390 msgr2=0x55de702eb3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:48.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.957+0000 7fcd678b4740 1 --2- 172.21.15.5:0/2491941948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de6ff15390 0x55de702eb3b0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c06a630 tx=0x7fcd50012b60 comp rx=0 tx=0).stop 2024-08-31T05:34:48.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.957+0000 7fcd678b4740 1 -- 172.21.15.5:0/2491941948 shutdown_connections 2024-08-31T05:34:48.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.957+0000 7fcd678b4740 1 --2- 172.21.15.5:0/2491941948 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55de6fef49f0 0x55de702fd440 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:48.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.957+0000 7fcd678b4740 1 --2- 172.21.15.5:0/2491941948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55de6ff36070 0x55de702f6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:48.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.957+0000 7fcd3eff5640 0 client.16866 ms_handle_reset on v2:172.21.15.50:6838/98200944 2024-08-31T05:34:48.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.957+0000 7fcd678b4740 1 --2- 172.21.15.5:0/2491941948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de6ff15390 0x55de702eb3b0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:48.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.957+0000 7fcd678b4740 1 --2- 172.21.15.5:0/2491941948 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de6ff0d1b0 0x55de702eae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:48.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.957+0000 7fcd678b4740 1 -- 172.21.15.5:0/2491941948 >> 172.21.15.5:0/2491941948 conn(0x55de6ff2a460 msgr2=0x55de702dcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:48.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.957+0000 7fcd678b4740 1 -- 172.21.15.5:0/2491941948 shutdown_connections 2024-08-31T05:34:48.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.957+0000 7fcd678b4740 1 -- 172.21.15.5:0/2491941948 wait complete. 2024-08-31T05:34:48.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.957+0000 7fcd678b4740 20 client.16866 trim_cache size 0 max 16384 2024-08-31T05:34:48.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.972+0000 7fcd678b4740 1 Processor -- start 2024-08-31T05:34:48.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.972+0000 7fcd678b4740 1 -- start start 2024-08-31T05:34:48.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.972+0000 7fcd678b4740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de6fef49f0 0x55de702f6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:48.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.972+0000 7fcd678b4740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de6ff0d1b0 0x55de702e96f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:48.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.972+0000 7fcd678b4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55de6ff15390 0x55de702e9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:48.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.972+0000 7fcd678b4740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fcd5c1aea20 con 0x55de6ff0d1b0 2024-08-31T05:34:48.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.972+0000 7fcd678b4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcd5c1b0560 con 0x55de6ff15390 2024-08-31T05:34:48.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.972+0000 7fcd678b4740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcd5c1af0f0 con 0x55de6fef49f0 2024-08-31T05:34:48.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.973+0000 7fcd5a7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de6ff0d1b0 0x55de702e96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:48.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.973+0000 7fcd5b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de6fef49f0 0x55de702f6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:48.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.973+0000 7fcd5b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de6fef49f0 0x55de702f6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:41566/0 (socket says 172.21.15.5:41566) 2024-08-31T05:34:48.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.973+0000 7fcd5b7fe640 1 -- 172.21.15.5:0/2048281755 learned_addr learned my addr 172.21.15.5:0/2048281755 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:48.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.973+0000 7fcd5b7fe640 1 --2- 172.21.15.5:0/2048281755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55de6ff15390 0x55de702e9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:48.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.973+0000 7fcd5b7fe640 1 -- 172.21.15.5:0/2048281755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55de6ff15390 msgr2=0x55de702e9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:48.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.973+0000 7fcd5b7fe640 1 --2- 172.21.15.5:0/2048281755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55de6ff15390 0x55de702e9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:48.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.973+0000 7fcd5b7fe640 1 -- 172.21.15.5:0/2048281755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de6ff0d1b0 msgr2=0x55de702e96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:48.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.973+0000 7fcd5b7fe640 1 --2- 172.21.15.5:0/2048281755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de6ff0d1b0 0x55de702e96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:48.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.973+0000 7fcd5b7fe640 1 -- 172.21.15.5:0/2048281755 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de702dda40 con 0x55de6fef49f0 2024-08-31T05:34:48.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.973+0000 7fcd5b7fe640 1 --2- 172.21.15.5:0/2048281755 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de6fef49f0 0x55de702f6ea0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcd54006010 tx=0x7fcd5402f440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e102c623f63529b3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:48.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.974+0000 7fcd40ff9640 1 -- 172.21.15.5:0/2048281755 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd5404a040 con 0x55de6fef49f0 2024-08-31T05:34:48.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.974+0000 7fcd40ff9640 1 -- 172.21.15.5:0/2048281755 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd54036070 con 0x55de6fef49f0 2024-08-31T05:34:48.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.974+0000 7fcd40ff9640 1 -- 172.21.15.5:0/2048281755 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd54031870 con 0x55de6fef49f0 2024-08-31T05:34:48.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.975+0000 7fcd678b4740 1 -- 172.21.15.5:0/2048281755 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de6fef49f0 msgr2=0x55de702f6ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:48.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.975+0000 7fcd678b4740 1 --2- 172.21.15.5:0/2048281755 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de6fef49f0 0x55de702f6ea0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcd54006010 tx=0x7fcd5402f440 comp rx=0 tx=0).stop 2024-08-31T05:34:48.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.975+0000 7fcd678b4740 1 -- 172.21.15.5:0/2048281755 shutdown_connections 2024-08-31T05:34:48.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.975+0000 7fcd678b4740 1 --2- 172.21.15.5:0/2048281755 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55de6ff15390 0x55de702e9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:48.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.975+0000 7fcd678b4740 1 --2- 172.21.15.5:0/2048281755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de6ff0d1b0 0x55de702e96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:48.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.975+0000 7fcd678b4740 1 --2- 172.21.15.5:0/2048281755 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de6fef49f0 0x55de702f6ea0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:48.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.975+0000 7fcd678b4740 1 -- 172.21.15.5:0/2048281755 >> 172.21.15.5:0/2048281755 conn(0x55de6ff2a460 msgr2=0x55de702e5fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:48.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.975+0000 7fcd678b4740 1 -- 172.21.15.5:0/2048281755 shutdown_connections 2024-08-31T05:34:48.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.975+0000 7fcd678b4740 1 -- 172.21.15.5:0/2048281755 wait complete. 2024-08-31T05:34:48.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.975+0000 7fcd678b4740 1 -- start start 2024-08-31T05:34:48.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.976+0000 7fcd678b4740 1 Processor -- start 2024-08-31T05:34:48.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.976+0000 7fcd678b4740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55de6fef49f0 0x55de702f34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:48.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.976+0000 7fcd678b4740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de6ff0d1b0 0x55de702ee9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:48.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.976+0000 7fcd678b4740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de6ff15390 0x55de702eeee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:48.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.976+0000 7fcd678b4740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fcd5c1afe90 con 0x55de6ff0d1b0 2024-08-31T05:34:48.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.976+0000 7fcd678b4740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcd5c1af7c0 con 0x55de6fef49f0 2024-08-31T05:34:48.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.976+0000 7fcd678b4740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcd5c1aca00 con 0x55de6ff15390 2024-08-31T05:34:48.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.976+0000 7fcd678b4740 10 client.0 _ll_register_callbacks cb 0x7fcd50009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:34:48.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.976+0000 7fcd5a7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de6ff0d1b0 0x55de702ee9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:48.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.976+0000 7fcd5b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55de6fef49f0 0x55de702f34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:48.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.976+0000 7fcd5a7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de6ff0d1b0 0x55de702ee9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40442/0 (socket says 172.21.15.5:40442) 2024-08-31T05:34:48.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.976+0000 7fcd5a7fc640 1 -- 172.21.15.5:0/2408026185 learned_addr learned my addr 172.21.15.5:0/2408026185 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:48.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.976+0000 7fcd5b7fe640 1 --2- 172.21.15.5:0/2408026185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de6ff15390 0x55de702eeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:48.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.977+0000 7fcd5b7fe640 1 -- 172.21.15.5:0/2408026185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de6ff15390 msgr2=0x55de702eeee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:48.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.977+0000 7fcd5b7fe640 1 --2- 172.21.15.5:0/2408026185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de6ff15390 0x55de702eeee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:48.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.977+0000 7fcd5b7fe640 1 -- 172.21.15.5:0/2408026185 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de6ff0d1b0 msgr2=0x55de702ee9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:48.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.977+0000 7fcd5b7fe640 1 --2- 172.21.15.5:0/2408026185 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de6ff0d1b0 0x55de702ee9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:48.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.977+0000 7fcd5b7fe640 1 -- 172.21.15.5:0/2408026185 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de702ef470 con 0x55de6fef49f0 2024-08-31T05:34:48.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.977+0000 7fcd5a7fc640 1 --2- 172.21.15.5:0/2408026185 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de6ff0d1b0 0x55de702ee9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:34:48.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.977+0000 7fcd5b7fe640 1 --2- 172.21.15.5:0/2408026185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55de6fef49f0 0x55de702f34f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcd54006010 tx=0x7fcd54031450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=361ec8eb65b75163 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:48.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.977+0000 7fcd3eff5640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:34:48.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.977+0000 7fcd3eff5640 1 -- 172.21.15.5:0/2408026185 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd5405f040 con 0x55de6fef49f0 2024-08-31T05:34:48.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.977+0000 7fcd3eff5640 1 -- 172.21.15.5:0/2408026185 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fcd54031d10 con 0x55de6fef49f0 2024-08-31T05:34:48.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.977+0000 7fcd678b4740 1 -- 172.21.15.5:0/2408026185 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd54036070 con 0x55de6fef49f0 2024-08-31T05:34:48.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.977+0000 7fcd3eff5640 1 -- 172.21.15.5:0/2408026185 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fcd540314f0 con 0x55de6fef49f0 2024-08-31T05:34:48.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.977+0000 7fcd678b4740 10 client.26459 fetch_fsmap learned FSMap version 34 2024-08-31T05:34:48.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.977+0000 7fcd678b4740 1 -- 172.21.15.5:0/2408026185 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55de70367b60 con 0x55de6fef49f0 2024-08-31T05:34:48.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.978+0000 7fcd3eff5640 1 -- 172.21.15.5:0/2408026185 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd54036070 con 0x55de6fef49f0 2024-08-31T05:34:48.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.978+0000 7fcd3eff5640 1 -- 172.21.15.5:0/2408026185 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fcd54065040 con 0x55de6fef49f0 2024-08-31T05:34:48.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.978+0000 7fcd678b4740 10 client.26459 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:34:48.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.978+0000 7fcd678b4740 10 client.26459 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-31T05:34:48.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.978+0000 7fcd678b4740 20 client.26459 populate_metadata read hostname 'smithi005' 2024-08-31T05:34:48.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.978+0000 7fcd678b4740 1 --2- 172.21.15.5:0/2408026185 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55de6ff36070 0x55de70369f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:48.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.978+0000 7fcd678b4740 4 client.26459 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:34:48.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.978+0000 7fcd678b4740 1 -- 172.21.15.5:0/2408026185 --> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55de70250070 con 0x55de6ff36070 2024-08-31T05:34:48.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.978+0000 7fcd5a7fc640 1 --2- 172.21.15.5:0/2408026185 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55de6ff36070 0x55de70369f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:48.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.979+0000 7fcd3eff5640 10 client.26459 ms_handle_connect on v2:172.21.15.50:6838/98200944 2024-08-31T05:34:48.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.979+0000 7fcd5a7fc640 1 --2- 172.21.15.5:0/2408026185 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55de6ff36070 0x55de70369f50 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3615caaec904de5d server_cookie=a88159b4e64e475b in_seq=0 out_seq=0 2024-08-31T05:34:48.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.979+0000 7fcd3eff5640 1 -- 172.21.15.5:0/2408026185 <== mds.1 v2:172.21.15.50:6838/98200944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55de70250070 con 0x55de6ff36070 2024-08-31T05:34:48.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.979+0000 7fcd3eff5640 10 client.26459 handle_command_reply: tid=0 2024-08-31T05:34:48.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.979+0000 7fcd678b4740 1 client.26459 shutdown 2024-08-31T05:34:48.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.979+0000 7fcd678b4740 1 -- 172.21.15.5:0/2408026185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55de6fef49f0 msgr2=0x55de702f34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:48.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.979+0000 7fcd678b4740 1 --2- 172.21.15.5:0/2408026185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55de6fef49f0 0x55de702f34f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcd54006010 tx=0x7fcd54031450 comp rx=0 tx=0).stop 2024-08-31T05:34:48.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.979+0000 7fcd678b4740 1 -- 172.21.15.5:0/2408026185 shutdown_connections 2024-08-31T05:34:48.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.980+0000 7fcd678b4740 1 --2- 172.21.15.5:0/2408026185 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55de6ff36070 0x55de70369f50 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:48.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.980+0000 7fcd678b4740 1 --2- 172.21.15.5:0/2408026185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de6ff15390 0x55de702eeee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:48.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.980+0000 7fcd3eff5640 0 client.26459 ms_handle_reset on v2:172.21.15.50:6838/98200944 2024-08-31T05:34:48.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.980+0000 7fcd678b4740 1 --2- 172.21.15.5:0/2408026185 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55de6ff0d1b0 0x55de702ee9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:48.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.980+0000 7fcd678b4740 1 --2- 172.21.15.5:0/2408026185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55de6fef49f0 0x55de702f34f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:48.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.980+0000 7fcd678b4740 1 -- 172.21.15.5:0/2408026185 >> 172.21.15.5:0/2408026185 conn(0x55de6ff2a460 msgr2=0x55de702e5fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:48.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.980+0000 7fcd678b4740 1 -- 172.21.15.5:0/2408026185 shutdown_connections 2024-08-31T05:34:48.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.980+0000 7fcd678b4740 1 -- 172.21.15.5:0/2408026185 wait complete. 2024-08-31T05:34:48.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.980+0000 7fcd678b4740 20 client.26459 trim_cache size 0 max 16384 2024-08-31T05:34:48.987 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:34:48.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.981+0000 7fcd6133f640 1 -- 172.21.15.5:0/3012654618 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fcd440b4d20 msgr2=0x7fcd440b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:48.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.981+0000 7fcd6133f640 1 --2- 172.21.15.5:0/3012654618 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fcd440b4d20 0x7fcd440b7230 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c0e3020 tx=0x7fcd4c0e96f0 comp rx=0 tx=0).stop 2024-08-31T05:34:48.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.981+0000 7fcd6133f640 1 -- 172.21.15.5:0/3012654618 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd5c102880 msgr2=0x7fcd5c19a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:48.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.981+0000 7fcd6133f640 1 --2- 172.21.15.5:0/3012654618 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd5c102880 0x7fcd5c19a1d0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c00e9f0 tx=0x7fcd4c00eeb0 comp rx=0 tx=0).stop 2024-08-31T05:34:48.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.981+0000 7fcd6133f640 1 -- 172.21.15.5:0/3012654618 shutdown_connections 2024-08-31T05:34:48.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.981+0000 7fcd6133f640 1 --2- 172.21.15.5:0/3012654618 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fcd440b4d20 0x7fcd440b7230 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:48.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.981+0000 7fcd6133f640 1 --2- 172.21.15.5:0/3012654618 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd5c108ac0 0x7fcd5c19fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:48.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.981+0000 7fcd6133f640 1 --2- 172.21.15.5:0/3012654618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd5c108170 0x7fcd5c19a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:48.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.981+0000 7fcd6133f640 1 --2- 172.21.15.5:0/3012654618 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd5c102880 0x7fcd5c19a1d0 secure :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c00e9f0 tx=0x7fcd4c00eeb0 comp rx=0 tx=0).stop 2024-08-31T05:34:48.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.981+0000 7fcd6133f640 1 -- 172.21.15.5:0/3012654618 >> 172.21.15.5:0/3012654618 conn(0x7fcd5c079530 msgr2=0x7fcd5c06b900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:48.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.981+0000 7fcd6133f640 1 -- 172.21.15.5:0/3012654618 shutdown_connections 2024-08-31T05:34:48.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:48.981+0000 7fcd6133f640 1 -- 172.21.15.5:0/3012654618 wait complete. 2024-08-31T05:34:49.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:34:48 smithi070 ceph-mon[22316]: pgmap v490: 129 pgs: 129 active+clean; 290 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.4 MiB/s wr, 229 op/s 2024-08-31T05:34:49.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:34:48 smithi050 ceph-mon[22146]: pgmap v490: 129 pgs: 129 active+clean; 290 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.4 MiB/s wr, 229 op/s 2024-08-31T05:34:49.917 INFO:tasks.workunit.client.0.smithi005.stdout: 1 540047 13.36 MB/sec execute 97 sec latency 19.933 ms 2024-08-31T05:34:50.132 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T05:34:50.401 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:34:50.782 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:34:50 smithi005 ceph-mon[18602]: pgmap v491: 129 pgs: 129 active+clean; 310 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 5.5 MiB/s wr, 271 op/s 2024-08-31T05:34:50.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.876+0000 7f43adf4c640 1 -- 172.21.15.5:0/2484858284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43a8102880 msgr2=0x7f43a8102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:50.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.876+0000 7f43adf4c640 1 --2- 172.21.15.5:0/2484858284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43a8102880 0x7f43a8102c90 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f4398009900 tx=0x7f439802a410 comp rx=0 tx=0).stop 2024-08-31T05:34:50.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.876+0000 7f43adf4c640 1 -- 172.21.15.5:0/2484858284 shutdown_connections 2024-08-31T05:34:50.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.876+0000 7f43adf4c640 1 --2- 172.21.15.5:0/2484858284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43a8108ac0 0x7f43a810f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:50.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.876+0000 7f43adf4c640 1 --2- 172.21.15.5:0/2484858284 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43a8108170 0x7f43a8108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:50.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.876+0000 7f43adf4c640 1 --2- 172.21.15.5:0/2484858284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43a8102880 0x7f43a8102c90 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:50.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.876+0000 7f43adf4c640 1 -- 172.21.15.5:0/2484858284 >> 172.21.15.5:0/2484858284 conn(0x7f43a8079550 msgr2=0x7f43a8079960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:50.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.876+0000 7f43adf4c640 1 -- 172.21.15.5:0/2484858284 shutdown_connections 2024-08-31T05:34:50.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.876+0000 7f43adf4c640 1 -- 172.21.15.5:0/2484858284 wait complete. 2024-08-31T05:34:50.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.877+0000 7f43adf4c640 1 Processor -- start 2024-08-31T05:34:50.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.877+0000 7f43adf4c640 1 -- start start 2024-08-31T05:34:50.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.878+0000 7f43adf4c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43a8102880 0x7f43a819a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:50.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.878+0000 7f43adf4c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43a8108170 0x7f43a819a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:50.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.878+0000 7f43adf4c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43a8108ac0 0x7f43a819fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:50.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.878+0000 7f43adf4c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f43a8112790 con 0x7f43a8108170 2024-08-31T05:34:50.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.878+0000 7f43adf4c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f43a8112610 con 0x7f43a8108ac0 2024-08-31T05:34:50.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.878+0000 7f43adf4c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f43a8112910 con 0x7f43a8102880 2024-08-31T05:34:50.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.878+0000 7f43a6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43a8108170 0x7f43a819a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:50.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.878+0000 7f43a6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43a8108170 0x7f43a819a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40462/0 (socket says 172.21.15.5:40462) 2024-08-31T05:34:50.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.878+0000 7f43a77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43a8102880 0x7f43a819a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:50.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.878+0000 7f43a6ffd640 1 -- 172.21.15.5:0/1565776938 learned_addr learned my addr 172.21.15.5:0/1565776938 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:50.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.878+0000 7f43a7fff640 1 --2- 172.21.15.5:0/1565776938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43a8108ac0 0x7f43a819fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:50.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.878+0000 7f43a6ffd640 1 -- 172.21.15.5:0/1565776938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43a8102880 msgr2=0x7f43a819a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:50.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.878+0000 7f43a6ffd640 1 --2- 172.21.15.5:0/1565776938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43a8102880 0x7f43a819a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:50.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.878+0000 7f43a6ffd640 1 -- 172.21.15.5:0/1565776938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43a8108ac0 msgr2=0x7f43a819fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:50.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.878+0000 7f43a6ffd640 1 --2- 172.21.15.5:0/1565776938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43a8108ac0 0x7f43a819fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:50.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.878+0000 7f43a6ffd640 1 -- 172.21.15.5:0/1565776938 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43a81a0260 con 0x7f43a8108170 2024-08-31T05:34:50.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.878+0000 7f43a77fe640 1 --2- 172.21.15.5:0/1565776938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43a8102880 0x7f43a819a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:34:50.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.878+0000 7f43a6ffd640 1 --2- 172.21.15.5:0/1565776938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43a8108170 0x7f43a819a890 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f439c00e9c0 tx=0x7f439c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:50.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.878+0000 7f43a4ff9640 1 -- 172.21.15.5:0/1565776938 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f439c00ccc0 con 0x7f43a8108170 2024-08-31T05:34:50.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.878+0000 7f43a4ff9640 1 -- 172.21.15.5:0/1565776938 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f439c0054d0 con 0x7f43a8108170 2024-08-31T05:34:50.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.879+0000 7f43adf4c640 1 -- 172.21.15.5:0/1565776938 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43a81a0550 con 0x7f43a8108170 2024-08-31T05:34:50.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.879+0000 7f43a4ff9640 1 -- 172.21.15.5:0/1565776938 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f439c010430 con 0x7f43a8108170 2024-08-31T05:34:50.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.879+0000 7f43adf4c640 1 -- 172.21.15.5:0/1565776938 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43a81a6cb0 con 0x7f43a8108170 2024-08-31T05:34:50.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.881+0000 7f43a4ff9640 1 -- 172.21.15.5:0/1565776938 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f439c005020 con 0x7f43a8108170 2024-08-31T05:34:50.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.882+0000 7f43b44c1740 1 Processor -- start 2024-08-31T05:34:50.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.882+0000 7f43b44c1740 1 -- start start 2024-08-31T05:34:50.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.882+0000 7f43b44c1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7a5580070 0x55b7a5925310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:50.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.882+0000 7f43b44c1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7a55571b0 0x55b7a5925850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:50.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.882+0000 7f43b44c1740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b7a555f390 0x55b7a5925d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:50.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.882+0000 7f43b44c1740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55b7a589c680 con 0x55b7a555f390 2024-08-31T05:34:50.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.882+0000 7f43b44c1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b7a588bc10 con 0x55b7a5580070 2024-08-31T05:34:50.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.882+0000 7f43b44c1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b7a588fbc0 con 0x55b7a55571b0 2024-08-31T05:34:50.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.882+0000 7f43a77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7a55571b0 0x55b7a5925850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:50.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.882+0000 7f43a6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b7a555f390 0x55b7a5925d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:50.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.882+0000 7f43a7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7a5580070 0x55b7a5925310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:50.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.882+0000 7f43a77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7a55571b0 0x55b7a5925850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:41606/0 (socket says 172.21.15.5:41606) 2024-08-31T05:34:50.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.882+0000 7f43a77fe640 1 -- 172.21.15.5:0/3977171997 learned_addr learned my addr 172.21.15.5:0/3977171997 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:50.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.882+0000 7f43a4ff9640 1 --2- 172.21.15.5:0/1565776938 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f43900b4ca0 0x7f43900b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:50.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.883+0000 7f43a7fff640 1 -- 172.21.15.5:0/3977171997 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7a55571b0 msgr2=0x55b7a5925850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:50.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.883+0000 7f43a7fff640 1 --2- 172.21.15.5:0/3977171997 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7a55571b0 0x55b7a5925850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:50.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.883+0000 7f43a7fff640 1 -- 172.21.15.5:0/3977171997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b7a555f390 msgr2=0x55b7a5925d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:50.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.883+0000 7f43a7fff640 1 --2- 172.21.15.5:0/3977171997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b7a555f390 0x55b7a5925d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.883+0000 7f43a7fff640 1 -- 172.21.15.5:0/3977171997 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7a55eb650 con 0x55b7a5580070 2024-08-31T05:34:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.883+0000 7f43a77fe640 1 --2- 172.21.15.5:0/3977171997 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7a55571b0 0x55b7a5925850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:34:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.883+0000 7f43a7fff640 1 --2- 172.21.15.5:0/1565776938 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f43900b4ca0 0x7f43900b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.883+0000 7f43a4ff9640 1 -- 172.21.15.5:0/1565776938 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f439c0e5c80 con 0x7f43a8108170 2024-08-31T05:34:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.883+0000 7f43a7fff640 1 --2- 172.21.15.5:0/3977171997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7a5580070 0x55b7a5925310 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f43a0009fa0 tx=0x7f43a0013c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c30a289c93bb2b4a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.883+0000 7f438dffb640 1 -- 172.21.15.5:0/3977171997 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a0004040 con 0x55b7a5580070 2024-08-31T05:34:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.883+0000 7f43a7fff640 1 --2- 172.21.15.5:0/1565776938 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f43900b4ca0 0x7f43900b71b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f43a0026000 tx=0x7f43a0023000 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.883+0000 7f438dffb640 1 -- 172.21.15.5:0/3977171997 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43a0004690 con 0x55b7a5580070 2024-08-31T05:34:50.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.883+0000 7f438dffb640 1 -- 172.21.15.5:0/3977171997 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a0029af0 con 0x55b7a5580070 2024-08-31T05:34:50.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.884+0000 7f43b44c1740 1 -- 172.21.15.5:0/3977171997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7a5580070 msgr2=0x55b7a5925310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:50.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.884+0000 7f43b44c1740 1 --2- 172.21.15.5:0/3977171997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7a5580070 0x55b7a5925310 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f43a0009fa0 tx=0x7f43a0013c60 comp rx=0 tx=0).stop 2024-08-31T05:34:50.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.884+0000 7f43b44c1740 1 -- 172.21.15.5:0/3977171997 shutdown_connections 2024-08-31T05:34:50.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.884+0000 7f43b44c1740 1 --2- 172.21.15.5:0/3977171997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b7a555f390 0x55b7a5925d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:50.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.884+0000 7f43b44c1740 1 --2- 172.21.15.5:0/3977171997 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7a55571b0 0x55b7a5925850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:50.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.884+0000 7f43b44c1740 1 --2- 172.21.15.5:0/3977171997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7a5580070 0x55b7a5925310 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:50.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.884+0000 7f43b44c1740 1 -- 172.21.15.5:0/3977171997 >> 172.21.15.5:0/3977171997 conn(0x55b7a5574460 msgr2=0x55b7a5923200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:50.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.884+0000 7f43b44c1740 1 -- 172.21.15.5:0/3977171997 shutdown_connections 2024-08-31T05:34:50.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.884+0000 7f43b44c1740 1 -- 172.21.15.5:0/3977171997 wait complete. 2024-08-31T05:34:50.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.885+0000 7f43b44c1740 1 -- start start 2024-08-31T05:34:50.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.885+0000 7f43b44c1740 1 Processor -- start 2024-08-31T05:34:50.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.885+0000 7f43b44c1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7a55571b0 0x55b7a5930b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:50.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.885+0000 7f43b44c1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7a555f390 0x55b7a5931080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:50.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.885+0000 7f43b44c1740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b7a5580070 0x55b7a593ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:50.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.885+0000 7f43b44c1740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55b7a56ee700 con 0x55b7a5580070 2024-08-31T05:34:50.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.885+0000 7f43b44c1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b7a5812750 con 0x55b7a555f390 2024-08-31T05:34:50.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.885+0000 7f43b44c1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b7a5933af0 con 0x55b7a55571b0 2024-08-31T05:34:50.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.885+0000 7f43b44c1740 10 client.0 _ll_register_callbacks cb 0x55b7a5841e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:34:50.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.885+0000 7f43a77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7a55571b0 0x55b7a5930b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:50.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.885+0000 7f43a6ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7a555f390 0x55b7a5931080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:50.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.885+0000 7f43a77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7a55571b0 0x55b7a5930b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:41616/0 (socket says 172.21.15.5:41616) 2024-08-31T05:34:50.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.885+0000 7f43a6ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7a555f390 0x55b7a5931080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:50886/0 (socket says 172.21.15.5:50886) 2024-08-31T05:34:50.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.885+0000 7f43a77fe640 1 -- 172.21.15.5:0/4094371244 learned_addr learned my addr 172.21.15.5:0/4094371244 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:50.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.885+0000 7f43a7fff640 1 --2- 172.21.15.5:0/4094371244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b7a5580070 0x55b7a593ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:50.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.886+0000 7f43a6ffd640 1 -- 172.21.15.5:0/4094371244 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7a55571b0 msgr2=0x55b7a5930b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:50.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.886+0000 7f43a6ffd640 1 --2- 172.21.15.5:0/4094371244 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7a55571b0 0x55b7a5930b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:50.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.886+0000 7f43a6ffd640 1 -- 172.21.15.5:0/4094371244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b7a5580070 msgr2=0x55b7a593ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:50.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.886+0000 7f43a6ffd640 1 --2- 172.21.15.5:0/4094371244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b7a5580070 0x55b7a593ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:50.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.886+0000 7f43a6ffd640 1 -- 172.21.15.5:0/4094371244 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7a584b900 con 0x55b7a555f390 2024-08-31T05:34:50.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.886+0000 7f43a77fe640 1 --2- 172.21.15.5:0/4094371244 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7a55571b0 0x55b7a5930b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:34:50.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.886+0000 7f43a6ffd640 1 --2- 172.21.15.5:0/4094371244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7a555f390 0x55b7a5931080 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f439c0e2ff0 tx=0x7f439c0e35b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29faf5678e236d9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:50.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.886+0000 7f4386ffd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:34:50.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.886+0000 7f4386ffd640 1 -- 172.21.15.5:0/4094371244 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f439c0ab700 con 0x55b7a555f390 2024-08-31T05:34:50.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.886+0000 7f4386ffd640 1 -- 172.21.15.5:0/4094371244 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f439c0be320 con 0x55b7a555f390 2024-08-31T05:34:50.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.886+0000 7f43b44c1740 1 -- 172.21.15.5:0/4094371244 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43a0004690 con 0x55b7a555f390 2024-08-31T05:34:50.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.886+0000 7f4386ffd640 1 -- 172.21.15.5:0/4094371244 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f439c00ce60 con 0x55b7a555f390 2024-08-31T05:34:50.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.886+0000 7f43b44c1740 10 client.26471 fetch_fsmap learned FSMap version 34 2024-08-31T05:34:50.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.886+0000 7f43b44c1740 1 -- 172.21.15.5:0/4094371244 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55b7a593fa10 con 0x55b7a555f390 2024-08-31T05:34:50.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.887+0000 7f4386ffd640 1 -- 172.21.15.5:0/4094371244 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43a0004690 con 0x55b7a555f390 2024-08-31T05:34:50.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.887+0000 7f4386ffd640 1 -- 172.21.15.5:0/4094371244 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f439c0ed040 con 0x55b7a555f390 2024-08-31T05:34:50.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.887+0000 7f43b44c1740 10 client.26471 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:34:50.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.887+0000 7f43b44c1740 10 client.26471 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:34:50.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.887+0000 7f43b44c1740 20 client.26471 populate_metadata read hostname 'smithi005' 2024-08-31T05:34:50.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.887+0000 7f43b44c1740 1 --2- 172.21.15.5:0/4094371244 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55b7a553e9f0 0x55b7a5942f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:50.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.887+0000 7f43b44c1740 4 client.26471 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:34:50.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.887+0000 7f43b44c1740 1 -- 172.21.15.5:0/4094371244 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b7a589e5d0 con 0x55b7a553e9f0 2024-08-31T05:34:50.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.887+0000 7f43a77fe640 1 --2- 172.21.15.5:0/4094371244 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55b7a553e9f0 0x55b7a5942f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:50.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.887+0000 7f4386ffd640 10 client.26471 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:34:50.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.887+0000 7f43a77fe640 1 --2- 172.21.15.5:0/4094371244 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55b7a553e9f0 0x55b7a5942f80 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc4c122d7b4debb3 server_cookie=20c42e175c4bbc8e in_seq=0 out_seq=0 2024-08-31T05:34:50.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.888+0000 7f4386ffd640 1 -- 172.21.15.5:0/4094371244 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b7a589e5d0 con 0x55b7a553e9f0 2024-08-31T05:34:50.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.888+0000 7f4386ffd640 10 client.26471 handle_command_reply: tid=0 2024-08-31T05:34:50.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.888+0000 7f43b44c1740 1 client.26471 shutdown 2024-08-31T05:34:50.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.889+0000 7f43b44c1740 1 -- 172.21.15.5:0/4094371244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7a555f390 msgr2=0x55b7a5931080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:50.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.889+0000 7f43b44c1740 1 --2- 172.21.15.5:0/4094371244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7a555f390 0x55b7a5931080 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f439c0e2ff0 tx=0x7f439c0e35b0 comp rx=0 tx=0).stop 2024-08-31T05:34:50.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.889+0000 7f43b44c1740 1 -- 172.21.15.5:0/4094371244 shutdown_connections 2024-08-31T05:34:50.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.889+0000 7f43b44c1740 1 --2- 172.21.15.5:0/4094371244 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55b7a553e9f0 0x55b7a5942f80 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:50.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.889+0000 7f43b44c1740 1 --2- 172.21.15.5:0/4094371244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b7a5580070 0x55b7a593ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:50.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.889+0000 7f4386ffd640 0 client.26471 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:34:50.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.889+0000 7f43b44c1740 1 --2- 172.21.15.5:0/4094371244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7a555f390 0x55b7a5931080 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:50.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.889+0000 7f43b44c1740 1 --2- 172.21.15.5:0/4094371244 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7a55571b0 0x55b7a5930b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:50.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.889+0000 7f43b44c1740 1 -- 172.21.15.5:0/4094371244 >> 172.21.15.5:0/4094371244 conn(0x55b7a5574460 msgr2=0x55b7a59284a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:50.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.889+0000 7f43b44c1740 1 -- 172.21.15.5:0/4094371244 shutdown_connections 2024-08-31T05:34:50.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.889+0000 7f43b44c1740 1 -- 172.21.15.5:0/4094371244 wait complete. 2024-08-31T05:34:50.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.889+0000 7f43b44c1740 20 client.26471 trim_cache size 0 max 16384 2024-08-31T05:34:50.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.903+0000 7f43b44c1740 1 Processor -- start 2024-08-31T05:34:50.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.903+0000 7f43b44c1740 1 -- start start 2024-08-31T05:34:50.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.903+0000 7f43b44c1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7a55571b0 0x55b7a5928b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:50.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.903+0000 7f43b44c1740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b7a555f390 0x55b7a593cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:50.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.903+0000 7f43b44c1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7a5580070 0x55b7a593d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:50.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.903+0000 7f43b44c1740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f43a81aea10 con 0x55b7a555f390 2024-08-31T05:34:50.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.903+0000 7f43b44c1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f43a81b0550 con 0x55b7a55571b0 2024-08-31T05:34:50.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.903+0000 7f43b44c1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f43a81af0e0 con 0x55b7a5580070 2024-08-31T05:34:50.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.903+0000 7f43a6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b7a555f390 0x55b7a593cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:50.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.903+0000 7f43a6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b7a555f390 0x55b7a593cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40500/0 (socket says 172.21.15.5:40500) 2024-08-31T05:34:50.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.903+0000 7f43a6ffd640 1 -- 172.21.15.5:0/4169200224 learned_addr learned my addr 172.21.15.5:0/4169200224 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:50.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.903+0000 7f43a7fff640 1 --2- 172.21.15.5:0/4169200224 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7a5580070 0x55b7a593d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:50.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.903+0000 7f43a77fe640 1 --2- 172.21.15.5:0/4169200224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7a55571b0 0x55b7a5928b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:50.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.904+0000 7f43a6ffd640 1 -- 172.21.15.5:0/4169200224 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7a5580070 msgr2=0x55b7a593d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:50.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.904+0000 7f43a6ffd640 1 --2- 172.21.15.5:0/4169200224 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7a5580070 0x55b7a593d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:50.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.904+0000 7f43a6ffd640 1 -- 172.21.15.5:0/4169200224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7a55571b0 msgr2=0x55b7a5928b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:50.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.904+0000 7f43a6ffd640 1 --2- 172.21.15.5:0/4169200224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7a55571b0 0x55b7a5928b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:50.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.904+0000 7f43a6ffd640 1 -- 172.21.15.5:0/4169200224 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7a5931dc0 con 0x55b7a555f390 2024-08-31T05:34:50.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.904+0000 7f43a6ffd640 1 --2- 172.21.15.5:0/4169200224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b7a555f390 0x55b7a593cd40 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f439c00c6a0 tx=0x7f439c0b08b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8ae2443dee90877 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:50.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.904+0000 7f438d7fa640 1 -- 172.21.15.5:0/4169200224 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f439c0ab700 con 0x55b7a555f390 2024-08-31T05:34:50.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.904+0000 7f438d7fa640 1 -- 172.21.15.5:0/4169200224 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f439c005310 con 0x55b7a555f390 2024-08-31T05:34:50.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.904+0000 7f438d7fa640 1 -- 172.21.15.5:0/4169200224 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f439c0b5300 con 0x55b7a555f390 2024-08-31T05:34:50.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.905+0000 7f43b44c1740 1 -- 172.21.15.5:0/4169200224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b7a555f390 msgr2=0x55b7a593cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:50.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.905+0000 7f43b44c1740 1 --2- 172.21.15.5:0/4169200224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b7a555f390 0x55b7a593cd40 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f439c00c6a0 tx=0x7f439c0b08b0 comp rx=0 tx=0).stop 2024-08-31T05:34:50.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.905+0000 7f43b44c1740 1 -- 172.21.15.5:0/4169200224 shutdown_connections 2024-08-31T05:34:50.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.905+0000 7f43b44c1740 1 --2- 172.21.15.5:0/4169200224 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7a5580070 0x55b7a593d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:50.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.905+0000 7f43b44c1740 1 --2- 172.21.15.5:0/4169200224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b7a555f390 0x55b7a593cd40 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:50.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.905+0000 7f43b44c1740 1 --2- 172.21.15.5:0/4169200224 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7a55571b0 0x55b7a5928b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:50.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.905+0000 7f43b44c1740 1 -- 172.21.15.5:0/4169200224 >> 172.21.15.5:0/4169200224 conn(0x55b7a5574460 msgr2=0x55b7a5928410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:50.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.905+0000 7f43b44c1740 1 -- 172.21.15.5:0/4169200224 shutdown_connections 2024-08-31T05:34:50.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.905+0000 7f43b44c1740 1 -- 172.21.15.5:0/4169200224 wait complete. 2024-08-31T05:34:50.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.905+0000 7f43b44c1740 1 -- start start 2024-08-31T05:34:50.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.906+0000 7f43b44c1740 1 Processor -- start 2024-08-31T05:34:50.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.906+0000 7f43b44c1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7a55571b0 0x55b7a59358b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:50.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.906+0000 7f43b44c1740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b7a555f390 0x55b7a5935e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:50.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.906+0000 7f43b44c1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7a5580070 0x55b7a59a6a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:50.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.906+0000 7f43b44c1740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f43a81afe80 con 0x55b7a555f390 2024-08-31T05:34:50.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.906+0000 7f43b44c1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f43a81af7b0 con 0x55b7a5580070 2024-08-31T05:34:50.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.906+0000 7f43b44c1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f43a81ac9f0 con 0x55b7a55571b0 2024-08-31T05:34:50.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.906+0000 7f43b44c1740 10 client.0 _ll_register_callbacks cb 0x7f439c004920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:34:50.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.906+0000 7f43a6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b7a555f390 0x55b7a5935e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:50.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.906+0000 7f43a77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7a55571b0 0x55b7a59358b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:50.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.906+0000 7f43a6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b7a555f390 0x55b7a5935e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40508/0 (socket says 172.21.15.5:40508) 2024-08-31T05:34:50.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.906+0000 7f43a77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7a55571b0 0x55b7a59358b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:41630/0 (socket says 172.21.15.5:41630) 2024-08-31T05:34:50.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.906+0000 7f43a6ffd640 1 -- 172.21.15.5:0/3186566895 learned_addr learned my addr 172.21.15.5:0/3186566895 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:50.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.906+0000 7f43a7fff640 1 --2- 172.21.15.5:0/3186566895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7a5580070 0x55b7a59a6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:50.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.906+0000 7f43a6ffd640 1 -- 172.21.15.5:0/3186566895 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7a55571b0 msgr2=0x55b7a59358b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:50.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.906+0000 7f43a6ffd640 1 --2- 172.21.15.5:0/3186566895 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7a55571b0 0x55b7a59358b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:50.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.906+0000 7f43a6ffd640 1 -- 172.21.15.5:0/3186566895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7a5580070 msgr2=0x55b7a59a6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:50.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.906+0000 7f43a6ffd640 1 --2- 172.21.15.5:0/3186566895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7a5580070 0x55b7a59a6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:50.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.906+0000 7f43a6ffd640 1 -- 172.21.15.5:0/3186566895 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7a59a70f0 con 0x55b7a555f390 2024-08-31T05:34:50.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.907+0000 7f43a6ffd640 1 --2- 172.21.15.5:0/3186566895 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b7a555f390 0x55b7a5935e50 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f439c0049d0 tx=0x7f439c0b0720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=699e7e372268557b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:50.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.907+0000 7f4386ffd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:34:50.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.907+0000 7f4386ffd640 1 -- 172.21.15.5:0/3186566895 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f439c0a7e50 con 0x55b7a555f390 2024-08-31T05:34:50.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.907+0000 7f4386ffd640 1 -- 172.21.15.5:0/3186566895 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f439c0b3b80 con 0x55b7a555f390 2024-08-31T05:34:50.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.907+0000 7f43b44c1740 1 -- 172.21.15.5:0/3186566895 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b7a589a070 con 0x55b7a555f390 2024-08-31T05:34:50.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.907+0000 7f4386ffd640 1 -- 172.21.15.5:0/3186566895 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f439c0ab700 con 0x55b7a555f390 2024-08-31T05:34:50.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.907+0000 7f43b44c1740 10 client.16890 fetch_fsmap learned FSMap version 34 2024-08-31T05:34:50.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.907+0000 7f43b44c1740 1 -- 172.21.15.5:0/3186566895 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55b7a59ae4e0 con 0x55b7a555f390 2024-08-31T05:34:50.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.907+0000 7f4386ffd640 1 -- 172.21.15.5:0/3186566895 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55b7a589a070 con 0x55b7a555f390 2024-08-31T05:34:50.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.908+0000 7f4386ffd640 1 -- 172.21.15.5:0/3186566895 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f439c0930c0 con 0x55b7a555f390 2024-08-31T05:34:50.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.908+0000 7f43b44c1740 10 client.16890 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:34:50.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.908+0000 7f43b44c1740 10 client.16890 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:34:50.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.908+0000 7f43b44c1740 20 client.16890 populate_metadata read hostname 'smithi005' 2024-08-31T05:34:50.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.908+0000 7f43b44c1740 1 --2- 172.21.15.5:0/3186566895 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55b7a5513da0 0x55b7a59b0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:50.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.908+0000 7f43b44c1740 4 client.16890 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:34:50.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.908+0000 7f43b44c1740 1 -- 172.21.15.5:0/3186566895 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b7a58977b0 con 0x55b7a5513da0 2024-08-31T05:34:50.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.908+0000 7f43a77fe640 1 --2- 172.21.15.5:0/3186566895 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55b7a5513da0 0x55b7a59b0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:50.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.908+0000 7f4386ffd640 10 client.16890 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:34:50.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.908+0000 7f43a77fe640 1 --2- 172.21.15.5:0/3186566895 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55b7a5513da0 0x55b7a59b0840 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6f6c8c42c1665c3 server_cookie=612d59a04bfa742c in_seq=0 out_seq=0 2024-08-31T05:34:50.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.908+0000 7f4386ffd640 1 -- 172.21.15.5:0/3186566895 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b7a58977b0 con 0x55b7a5513da0 2024-08-31T05:34:50.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.908+0000 7f4386ffd640 10 client.16890 handle_command_reply: tid=0 2024-08-31T05:34:50.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.908+0000 7f43b44c1740 1 client.16890 shutdown 2024-08-31T05:34:50.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.909+0000 7f43b44c1740 1 -- 172.21.15.5:0/3186566895 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b7a555f390 msgr2=0x55b7a5935e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:50.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.909+0000 7f43b44c1740 1 --2- 172.21.15.5:0/3186566895 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b7a555f390 0x55b7a5935e50 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f439c0049d0 tx=0x7f439c0b0720 comp rx=0 tx=0).stop 2024-08-31T05:34:50.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.909+0000 7f43b44c1740 1 -- 172.21.15.5:0/3186566895 shutdown_connections 2024-08-31T05:34:50.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.909+0000 7f43b44c1740 1 --2- 172.21.15.5:0/3186566895 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55b7a5513da0 0x55b7a59b0840 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:50.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.909+0000 7f43b44c1740 1 --2- 172.21.15.5:0/3186566895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b7a5580070 0x55b7a59a6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:50.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.909+0000 7f43b44c1740 1 --2- 172.21.15.5:0/3186566895 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b7a555f390 0x55b7a5935e50 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:50.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.909+0000 7f4386ffd640 0 client.16890 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:34:50.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.909+0000 7f43b44c1740 1 --2- 172.21.15.5:0/3186566895 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7a55571b0 0x55b7a59358b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:50.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.909+0000 7f43b44c1740 1 -- 172.21.15.5:0/3186566895 >> 172.21.15.5:0/3186566895 conn(0x55b7a5574460 msgr2=0x55b7a5928ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:50.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.909+0000 7f43b44c1740 1 -- 172.21.15.5:0/3186566895 shutdown_connections 2024-08-31T05:34:50.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.909+0000 7f43b44c1740 1 -- 172.21.15.5:0/3186566895 wait complete. 2024-08-31T05:34:50.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.909+0000 7f43b44c1740 20 client.16890 trim_cache size 0 max 16384 2024-08-31T05:34:50.917 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:34:50.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.909+0000 7f43adf4c640 1 -- 172.21.15.5:0/1565776938 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f43900b4ca0 msgr2=0x7f43900b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:50.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.910+0000 7f43adf4c640 1 --2- 172.21.15.5:0/1565776938 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f43900b4ca0 0x7f43900b71b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f43a0026000 tx=0x7f43a0023000 comp rx=0 tx=0).stop 2024-08-31T05:34:50.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.910+0000 7f43adf4c640 1 -- 172.21.15.5:0/1565776938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43a8108170 msgr2=0x7f43a819a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:50.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.910+0000 7f43adf4c640 1 --2- 172.21.15.5:0/1565776938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43a8108170 0x7f43a819a890 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f439c00e9c0 tx=0x7f439c00ee80 comp rx=0 tx=0).stop 2024-08-31T05:34:50.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.910+0000 7f43adf4c640 1 -- 172.21.15.5:0/1565776938 shutdown_connections 2024-08-31T05:34:50.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.910+0000 7f43adf4c640 1 --2- 172.21.15.5:0/1565776938 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f43900b4ca0 0x7f43900b71b0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:50.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.910+0000 7f43adf4c640 1 --2- 172.21.15.5:0/1565776938 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f43a8108ac0 0x7f43a819fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:50.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.910+0000 7f43adf4c640 1 --2- 172.21.15.5:0/1565776938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43a8108170 0x7f43a819a890 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:50.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.910+0000 7f43adf4c640 1 --2- 172.21.15.5:0/1565776938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43a8102880 0x7f43a819a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:50.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.910+0000 7f43adf4c640 1 -- 172.21.15.5:0/1565776938 >> 172.21.15.5:0/1565776938 conn(0x7f43a8079550 msgr2=0x7f43a81017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:50.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.910+0000 7f43adf4c640 1 -- 172.21.15.5:0/1565776938 shutdown_connections 2024-08-31T05:34:50.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:50.910+0000 7f43adf4c640 1 -- 172.21.15.5:0/1565776938 wait complete. 2024-08-31T05:34:50.919 INFO:tasks.workunit.client.0.smithi005.stdout: 1 542314 13.30 MB/sec execute 98 sec latency 20.313 ms 2024-08-31T05:34:51.085 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:34:50 smithi070 ceph-mon[22316]: pgmap v491: 129 pgs: 129 active+clean; 310 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 5.5 MiB/s wr, 271 op/s 2024-08-31T05:34:51.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:34:50 smithi050 ceph-mon[22146]: pgmap v491: 129 pgs: 129 active+clean; 310 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 5.5 MiB/s wr, 271 op/s 2024-08-31T05:34:51.917 INFO:tasks.workunit.client.0.smithi005.stdout: 1 544326 13.30 MB/sec execute 99 sec latency 18.553 ms 2024-08-31T05:34:52.809 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T05:34:52.809 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T05:34:52.917 INFO:tasks.workunit.client.0.smithi005.stdout: 1 547354 13.35 MB/sec execute 100 sec latency 16.458 ms 2024-08-31T05:34:52.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:34:52 smithi005 ceph-mon[18602]: pgmap v492: 129 pgs: 129 active+clean; 312 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.5 MiB/s wr, 214 op/s 2024-08-31T05:34:53.064 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:34:53.085 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:34:52 smithi070 ceph-mon[22316]: pgmap v492: 129 pgs: 129 active+clean; 312 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.5 MiB/s wr, 214 op/s 2024-08-31T05:34:53.156 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:34:52 smithi050 ceph-mon[22146]: pgmap v492: 129 pgs: 129 active+clean; 312 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.5 MiB/s wr, 214 op/s 2024-08-31T05:34:53.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.573+0000 7f6f7ecf5640 1 -- 172.21.15.5:0/3428855652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f781045e0 msgr2=0x7f6f781049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:53.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.573+0000 7f6f7ecf5640 1 --2- 172.21.15.5:0/3428855652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f781045e0 0x7f6f781049f0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f6f68009ca0 tx=0x7f6f6802a8c0 comp rx=0 tx=0).stop 2024-08-31T05:34:53.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.573+0000 7f6f7ecf5640 1 -- 172.21.15.5:0/3428855652 shutdown_connections 2024-08-31T05:34:53.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.573+0000 7f6f7ecf5640 1 --2- 172.21.15.5:0/3428855652 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f7810db90 0x7f6f781100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:53.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.573+0000 7f6f7ecf5640 1 --2- 172.21.15.5:0/3428855652 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f78105010 0x7f6f7810d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:53.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.573+0000 7f6f7ecf5640 1 --2- 172.21.15.5:0/3428855652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f781045e0 0x7f6f781049f0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:53.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.573+0000 7f6f7ecf5640 1 -- 172.21.15.5:0/3428855652 >> 172.21.15.5:0/3428855652 conn(0x7f6f780794d0 msgr2=0x7f6f780798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:53.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.573+0000 7f6f7ecf5640 1 -- 172.21.15.5:0/3428855652 shutdown_connections 2024-08-31T05:34:53.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.573+0000 7f6f7ecf5640 1 -- 172.21.15.5:0/3428855652 wait complete. 2024-08-31T05:34:53.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.574+0000 7f6f7ecf5640 1 Processor -- start 2024-08-31T05:34:53.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.574+0000 7f6f7ecf5640 1 -- start start 2024-08-31T05:34:53.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.574+0000 7f6f7ecf5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f781045e0 0x7f6f7819a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:53.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.574+0000 7f6f7ecf5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f78105010 0x7f6f7819a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:53.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.574+0000 7f6f7ecf5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f7810db90 0x7f6f7819faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:53.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.574+0000 7f6f7ecf5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6f78113830 con 0x7f6f78105010 2024-08-31T05:34:53.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.574+0000 7f6f7ecf5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6f781136b0 con 0x7f6f781045e0 2024-08-31T05:34:53.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.574+0000 7f6f7ecf5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6f781139b0 con 0x7f6f7810db90 2024-08-31T05:34:53.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.574+0000 7f6f77fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f78105010 0x7f6f7819a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:53.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.574+0000 7f6f77fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f78105010 0x7f6f7819a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55106/0 (socket says 172.21.15.5:55106) 2024-08-31T05:34:53.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.574+0000 7f6f77fff640 1 -- 172.21.15.5:0/3436050234 learned_addr learned my addr 172.21.15.5:0/3436050234 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:53.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.574+0000 7f6f7d292640 1 --2- 172.21.15.5:0/3436050234 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f7810db90 0x7f6f7819faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:53.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.575+0000 7f6f7ca91640 1 --2- 172.21.15.5:0/3436050234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f781045e0 0x7f6f7819a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:53.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.575+0000 7f6f7d292640 1 -- 172.21.15.5:0/3436050234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f781045e0 msgr2=0x7f6f7819a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:53.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.575+0000 7f6f7d292640 1 --2- 172.21.15.5:0/3436050234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f781045e0 0x7f6f7819a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:53.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.575+0000 7f6f7d292640 1 -- 172.21.15.5:0/3436050234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f78105010 msgr2=0x7f6f7819a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:53.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.575+0000 7f6f7d292640 1 --2- 172.21.15.5:0/3436050234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f78105010 0x7f6f7819a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:53.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.575+0000 7f6f7d292640 1 -- 172.21.15.5:0/3436050234 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f781a01d0 con 0x7f6f7810db90 2024-08-31T05:34:53.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.575+0000 7f6f77fff640 1 --2- 172.21.15.5:0/3436050234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f78105010 0x7f6f7819a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:34:53.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.575+0000 7f6f7d292640 1 --2- 172.21.15.5:0/3436050234 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f7810db90 0x7f6f7819faa0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6f7000e970 tx=0x7f6f7000ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:53.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.575+0000 7f6f75ffb640 1 -- 172.21.15.5:0/3436050234 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f7000ccc0 con 0x7f6f7810db90 2024-08-31T05:34:53.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.575+0000 7f6f7ecf5640 1 -- 172.21.15.5:0/3436050234 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f781a04c0 con 0x7f6f7810db90 2024-08-31T05:34:53.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.575+0000 7f6f75ffb640 1 -- 172.21.15.5:0/3436050234 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f70005020 con 0x7f6f7810db90 2024-08-31T05:34:53.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.575+0000 7f6f75ffb640 1 -- 172.21.15.5:0/3436050234 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f70004a00 con 0x7f6f7810db90 2024-08-31T05:34:53.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.576+0000 7f6f7ecf5640 1 -- 172.21.15.5:0/3436050234 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f781a6c20 con 0x7f6f7810db90 2024-08-31T05:34:53.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.579+0000 7f6f75ffb640 1 -- 172.21.15.5:0/3436050234 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f6f70004ba0 con 0x7f6f7810db90 2024-08-31T05:34:53.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.579+0000 7f6f8526a740 1 Processor -- start 2024-08-31T05:34:53.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.579+0000 7f6f8526a740 1 -- start start 2024-08-31T05:34:53.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.579+0000 7f6f8526a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b6a2361350 0x55b6a270bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:53.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.579+0000 7f6f8526a740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b6a2338490 0x55b6a270c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:53.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.579+0000 7f6f8526a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b6a2340670 0x55b6a270c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:53.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.579+0000 7f6f8526a740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55b6a267d5f0 con 0x55b6a2338490 2024-08-31T05:34:53.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.579+0000 7f6f8526a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b6a266cb80 con 0x55b6a2340670 2024-08-31T05:34:53.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.579+0000 7f6f8526a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b6a2670b30 con 0x55b6a2361350 2024-08-31T05:34:53.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.580+0000 7f6f77fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b6a2361350 0x55b6a270bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:53.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.580+0000 7f6f77fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b6a2361350 0x55b6a270bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:55978/0 (socket says 172.21.15.5:55978) 2024-08-31T05:34:53.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.580+0000 7f6f77fff640 1 -- 172.21.15.5:0/2386732587 learned_addr learned my addr 172.21.15.5:0/2386732587 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:53.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.580+0000 7f6f77fff640 1 --2- 172.21.15.5:0/2386732587 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b6a2340670 0x55b6a270c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:53.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.580+0000 7f6f7ca91640 1 --2- 172.21.15.5:0/2386732587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b6a2338490 0x55b6a270c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:53.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.580+0000 7f6f75ffb640 1 --2- 172.21.15.5:0/3436050234 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f6f600b4d20 0x7f6f600b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:53.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.580+0000 7f6f77fff640 1 -- 172.21.15.5:0/2386732587 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b6a2340670 msgr2=0x55b6a270c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:53.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.580+0000 7f6f77fff640 1 --2- 172.21.15.5:0/2386732587 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b6a2340670 0x55b6a270c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:53.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.580+0000 7f6f77fff640 1 -- 172.21.15.5:0/2386732587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b6a2338490 msgr2=0x55b6a270c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:53.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.580+0000 7f6f77fff640 1 --2- 172.21.15.5:0/2386732587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b6a2338490 0x55b6a270c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:53.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.580+0000 7f6f77fff640 1 -- 172.21.15.5:0/2386732587 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6a23cc930 con 0x55b6a2361350 2024-08-31T05:34:53.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.580+0000 7f6f7ca91640 1 --2- 172.21.15.5:0/2386732587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b6a2338490 0x55b6a270c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:34:53.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.580+0000 7f6f75ffb640 1 -- 172.21.15.5:0/3436050234 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f6f700e5880 con 0x7f6f7810db90 2024-08-31T05:34:53.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.580+0000 7f6f7d292640 1 --2- 172.21.15.5:0/3436050234 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f6f600b4d20 0x7f6f600b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:53.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.581+0000 7f6f77fff640 1 --2- 172.21.15.5:0/2386732587 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b6a2361350 0x55b6a270bb90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c011c60 tx=0x7f6f6c009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1146b2fdac07c926 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:53.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.581+0000 7f6f5effd640 1 -- 172.21.15.5:0/2386732587 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c00fc50 con 0x55b6a2361350 2024-08-31T05:34:53.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.581+0000 7f6f5effd640 1 -- 172.21.15.5:0/2386732587 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f6c00fdf0 con 0x55b6a2361350 2024-08-31T05:34:53.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.581+0000 7f6f5effd640 1 -- 172.21.15.5:0/2386732587 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c00e610 con 0x55b6a2361350 2024-08-31T05:34:53.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.582+0000 7f6f8526a740 1 -- 172.21.15.5:0/2386732587 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b6a2361350 msgr2=0x55b6a270bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:53.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.582+0000 7f6f7d292640 1 --2- 172.21.15.5:0/3436050234 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f6f600b4d20 0x7f6f600b7230 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6f700e5b60 tx=0x7f6f700e5ad0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:53.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.582+0000 7f6f8526a740 1 --2- 172.21.15.5:0/2386732587 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b6a2361350 0x55b6a270bb90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c011c60 tx=0x7f6f6c009c20 comp rx=0 tx=0).stop 2024-08-31T05:34:53.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.582+0000 7f6f8526a740 1 -- 172.21.15.5:0/2386732587 shutdown_connections 2024-08-31T05:34:53.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.582+0000 7f6f8526a740 1 --2- 172.21.15.5:0/2386732587 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b6a2340670 0x55b6a270c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:53.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.582+0000 7f6f8526a740 1 --2- 172.21.15.5:0/2386732587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b6a2338490 0x55b6a270c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:53.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.582+0000 7f6f8526a740 1 --2- 172.21.15.5:0/2386732587 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b6a2361350 0x55b6a270bb90 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:53.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.582+0000 7f6f8526a740 1 -- 172.21.15.5:0/2386732587 >> 172.21.15.5:0/2386732587 conn(0x55b6a2355740 msgr2=0x55b6a2709a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:53.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.582+0000 7f6f8526a740 1 -- 172.21.15.5:0/2386732587 shutdown_connections 2024-08-31T05:34:53.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.582+0000 7f6f8526a740 1 -- 172.21.15.5:0/2386732587 wait complete. 2024-08-31T05:34:53.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.583+0000 7f6f8526a740 1 -- start start 2024-08-31T05:34:53.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.583+0000 7f6f8526a740 1 Processor -- start 2024-08-31T05:34:53.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.583+0000 7f6f8526a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b6a2338490 0x55b6a2717380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:53.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.583+0000 7f6f8526a740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b6a2340670 0x55b6a2717900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:53.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.583+0000 7f6f8526a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b6a2361350 0x55b6a2723660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:53.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.583+0000 7f6f8526a740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55b6a24cf890 con 0x55b6a2340670 2024-08-31T05:34:53.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.583+0000 7f6f8526a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b6a25f3790 con 0x55b6a2361350 2024-08-31T05:34:53.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.583+0000 7f6f8526a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b6a271a370 con 0x55b6a2338490 2024-08-31T05:34:53.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.583+0000 7f6f8526a740 10 client.0 _ll_register_callbacks cb 0x55b6a2378ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:34:53.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.584+0000 7f6f7ca91640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b6a2340670 0x55b6a2717900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:53.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.584+0000 7f6f7ca91640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b6a2340670 0x55b6a2717900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55118/0 (socket says 172.21.15.5:55118) 2024-08-31T05:34:53.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.584+0000 7f6f7ca91640 1 -- 172.21.15.5:0/1750297246 learned_addr learned my addr 172.21.15.5:0/1750297246 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:53.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.584+0000 7f6f77fff640 1 --2- 172.21.15.5:0/1750297246 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b6a2338490 0x55b6a2717380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:53.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.584+0000 7f6f77fff640 1 --2- 172.21.15.5:0/1750297246 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b6a2361350 0x55b6a2723660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:53.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.584+0000 7f6f7ca91640 1 -- 172.21.15.5:0/1750297246 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b6a2338490 msgr2=0x55b6a2717380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:53.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.584+0000 7f6f7ca91640 1 --2- 172.21.15.5:0/1750297246 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b6a2338490 0x55b6a2717380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:53.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.584+0000 7f6f7ca91640 1 -- 172.21.15.5:0/1750297246 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b6a2361350 msgr2=0x55b6a2723660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:53.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.584+0000 7f6f7ca91640 1 --2- 172.21.15.5:0/1750297246 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b6a2361350 0x55b6a2723660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:53.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.584+0000 7f6f7ca91640 1 -- 172.21.15.5:0/1750297246 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6a262af30 con 0x55b6a2340670 2024-08-31T05:34:53.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.584+0000 7f6f77fff640 1 --2- 172.21.15.5:0/1750297246 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b6a2338490 0x55b6a2717380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:34:53.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.584+0000 7f6f7ca91640 1 --2- 172.21.15.5:0/1750297246 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b6a2340670 0x55b6a2717900 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f6f68009ca0 tx=0x7f6f680093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87523f80b44772fe server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:53.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.584+0000 7f6f57fff640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:34:53.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.584+0000 7f6f57fff640 1 -- 172.21.15.5:0/1750297246 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f68031660 con 0x55b6a2340670 2024-08-31T05:34:53.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.584+0000 7f6f8526a740 1 -- 172.21.15.5:0/1750297246 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f6c00fdf0 con 0x55b6a2340670 2024-08-31T05:34:53.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.584+0000 7f6f57fff640 1 -- 172.21.15.5:0/1750297246 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f6f68031800 con 0x55b6a2340670 2024-08-31T05:34:53.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.585+0000 7f6f57fff640 1 -- 172.21.15.5:0/1750297246 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f6f68004b40 con 0x55b6a2340670 2024-08-31T05:34:53.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.585+0000 7f6f8526a740 10 client.16902 fetch_fsmap learned FSMap version 34 2024-08-31T05:34:53.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.585+0000 7f6f8526a740 1 -- 172.21.15.5:0/1750297246 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55b6a27261d0 con 0x55b6a2340670 2024-08-31T05:34:53.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.585+0000 7f6f57fff640 1 -- 172.21.15.5:0/1750297246 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f6c00fdf0 con 0x55b6a2340670 2024-08-31T05:34:53.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.585+0000 7f6f57fff640 1 -- 172.21.15.5:0/1750297246 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f6f680042e0 con 0x55b6a2340670 2024-08-31T05:34:53.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.585+0000 7f6f8526a740 10 client.16902 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:34:53.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.585+0000 7f6f8526a740 10 client.16902 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:34:53.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.585+0000 7f6f8526a740 20 client.16902 populate_metadata read hostname 'smithi005' 2024-08-31T05:34:53.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.585+0000 7f6f8526a740 1 --2- 172.21.15.5:0/1750297246 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55b6a231fcd0 0x55b6a2729740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:53.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.585+0000 7f6f8526a740 4 client.16902 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:34:53.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.585+0000 7f6f8526a740 1 -- 172.21.15.5:0/1750297246 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b6a267f540 con 0x55b6a231fcd0 2024-08-31T05:34:53.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.585+0000 7f6f77fff640 1 --2- 172.21.15.5:0/1750297246 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55b6a231fcd0 0x55b6a2729740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:53.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.586+0000 7f6f57fff640 10 client.16902 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:34:53.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.586+0000 7f6f77fff640 1 --2- 172.21.15.5:0/1750297246 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55b6a231fcd0 0x55b6a2729740 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8733cd51170c22a4 server_cookie=a4411e03cd312d2f in_seq=0 out_seq=0 2024-08-31T05:34:53.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.587+0000 7f6f57fff640 1 -- 172.21.15.5:0/1750297246 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b6a267f540 con 0x55b6a231fcd0 2024-08-31T05:34:53.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.587+0000 7f6f57fff640 10 client.16902 handle_command_reply: tid=0 2024-08-31T05:34:53.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.587+0000 7f6f8526a740 1 client.16902 shutdown 2024-08-31T05:34:53.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.587+0000 7f6f8526a740 1 -- 172.21.15.5:0/1750297246 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b6a2340670 msgr2=0x55b6a2717900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:53.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.587+0000 7f6f8526a740 1 --2- 172.21.15.5:0/1750297246 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b6a2340670 0x55b6a2717900 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f6f68009ca0 tx=0x7f6f680093d0 comp rx=0 tx=0).stop 2024-08-31T05:34:53.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.587+0000 7f6f8526a740 1 -- 172.21.15.5:0/1750297246 shutdown_connections 2024-08-31T05:34:53.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.587+0000 7f6f8526a740 1 --2- 172.21.15.5:0/1750297246 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55b6a231fcd0 0x55b6a2729740 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:53.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.587+0000 7f6f8526a740 1 --2- 172.21.15.5:0/1750297246 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b6a2361350 0x55b6a2723660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:53.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.587+0000 7f6f8526a740 1 --2- 172.21.15.5:0/1750297246 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b6a2340670 0x55b6a2717900 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:53.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.587+0000 7f6f8526a740 1 --2- 172.21.15.5:0/1750297246 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b6a2338490 0x55b6a2717380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:53.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.587+0000 7f6f57fff640 0 client.16902 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:34:53.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.587+0000 7f6f8526a740 1 -- 172.21.15.5:0/1750297246 >> 172.21.15.5:0/1750297246 conn(0x55b6a2355740 msgr2=0x55b6a270ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:53.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.587+0000 7f6f8526a740 1 -- 172.21.15.5:0/1750297246 shutdown_connections 2024-08-31T05:34:53.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.587+0000 7f6f8526a740 1 -- 172.21.15.5:0/1750297246 wait complete. 2024-08-31T05:34:53.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.587+0000 7f6f8526a740 20 client.16902 trim_cache size 0 max 16384 2024-08-31T05:34:53.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.608+0000 7f6f8526a740 1 Processor -- start 2024-08-31T05:34:53.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.608+0000 7f6f8526a740 1 -- start start 2024-08-31T05:34:53.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.608+0000 7f6f8526a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b6a2338490 0x55b6a2716310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:53.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.608+0000 7f6f8526a740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b6a2361350 0x55b6a2723560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:53.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.608+0000 7f6f8526a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b6a22f5080 0x55b6a2723aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:53.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.608+0000 7f6f8526a740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6f781aea40 con 0x55b6a2361350 2024-08-31T05:34:53.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.608+0000 7f6f8526a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6f781b0580 con 0x55b6a22f5080 2024-08-31T05:34:53.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.608+0000 7f6f8526a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6f781af110 con 0x55b6a2338490 2024-08-31T05:34:53.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.608+0000 7f6f7ca91640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b6a2361350 0x55b6a2723560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:53.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.608+0000 7f6f7ca91640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b6a2361350 0x55b6a2723560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55120/0 (socket says 172.21.15.5:55120) 2024-08-31T05:34:53.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.608+0000 7f6f7ca91640 1 -- 172.21.15.5:0/2505747275 learned_addr learned my addr 172.21.15.5:0/2505747275 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:53.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.608+0000 7f6f77fff640 1 --2- 172.21.15.5:0/2505747275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b6a22f5080 0x55b6a2723aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:53.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.608+0000 7f6f77fff640 1 --2- 172.21.15.5:0/2505747275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b6a2338490 0x55b6a2716310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:53.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.609+0000 7f6f7ca91640 1 -- 172.21.15.5:0/2505747275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b6a2338490 msgr2=0x55b6a2716310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:53.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.609+0000 7f6f7ca91640 1 --2- 172.21.15.5:0/2505747275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b6a2338490 0x55b6a2716310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:53.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.609+0000 7f6f7ca91640 1 -- 172.21.15.5:0/2505747275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b6a22f5080 msgr2=0x55b6a2723aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:53.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.609+0000 7f6f7ca91640 1 --2- 172.21.15.5:0/2505747275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b6a22f5080 0x55b6a2723aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:53.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.609+0000 7f6f7ca91640 1 -- 172.21.15.5:0/2505747275 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6a2709f80 con 0x55b6a2361350 2024-08-31T05:34:53.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.609+0000 7f6f77fff640 1 --2- 172.21.15.5:0/2505747275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b6a22f5080 0x55b6a2723aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:34:53.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.609+0000 7f6f7ca91640 1 --2- 172.21.15.5:0/2505747275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b6a2361350 0x55b6a2723560 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f6f68000f80 tx=0x7f6f6802a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d11442b1ce0047c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:53.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.609+0000 7f6f5e7fc640 1 -- 172.21.15.5:0/2505747275 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f68059070 con 0x55b6a2361350 2024-08-31T05:34:53.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.609+0000 7f6f5e7fc640 1 -- 172.21.15.5:0/2505747275 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f68036050 con 0x55b6a2361350 2024-08-31T05:34:53.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.609+0000 7f6f5e7fc640 1 -- 172.21.15.5:0/2505747275 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f680040f0 con 0x55b6a2361350 2024-08-31T05:34:53.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.610+0000 7f6f8526a740 1 -- 172.21.15.5:0/2505747275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b6a2361350 msgr2=0x55b6a2723560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:53.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.610+0000 7f6f8526a740 1 --2- 172.21.15.5:0/2505747275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b6a2361350 0x55b6a2723560 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f6f68000f80 tx=0x7f6f6802a8c0 comp rx=0 tx=0).stop 2024-08-31T05:34:53.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.610+0000 7f6f8526a740 1 -- 172.21.15.5:0/2505747275 shutdown_connections 2024-08-31T05:34:53.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.610+0000 7f6f8526a740 1 --2- 172.21.15.5:0/2505747275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b6a22f5080 0x55b6a2723aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:53.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.610+0000 7f6f8526a740 1 --2- 172.21.15.5:0/2505747275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b6a2361350 0x55b6a2723560 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:53.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.610+0000 7f6f8526a740 1 --2- 172.21.15.5:0/2505747275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b6a2338490 0x55b6a2716310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:53.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.610+0000 7f6f8526a740 1 -- 172.21.15.5:0/2505747275 >> 172.21.15.5:0/2505747275 conn(0x55b6a2355740 msgr2=0x55b6a2715c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:53.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.610+0000 7f6f8526a740 1 -- 172.21.15.5:0/2505747275 shutdown_connections 2024-08-31T05:34:53.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.610+0000 7f6f8526a740 1 -- 172.21.15.5:0/2505747275 wait complete. 2024-08-31T05:34:53.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.610+0000 7f6f8526a740 1 -- start start 2024-08-31T05:34:53.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.610+0000 7f6f8526a740 1 Processor -- start 2024-08-31T05:34:53.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.611+0000 7f6f8526a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b6a22f5080 0x55b6a271f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:53.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.611+0000 7f6f8526a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b6a2338490 0x55b6a271fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:53.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.611+0000 7f6f8526a740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b6a2361350 0x55b6a271a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:53.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.611+0000 7f6f8526a740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6f781afeb0 con 0x55b6a2361350 2024-08-31T05:34:53.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.611+0000 7f6f8526a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6f781af7e0 con 0x55b6a22f5080 2024-08-31T05:34:53.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.611+0000 7f6f8526a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6f781aca70 con 0x55b6a2338490 2024-08-31T05:34:53.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.611+0000 7f6f8526a740 10 client.0 _ll_register_callbacks cb 0x7f6f6c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:34:53.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.611+0000 7f6f77fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b6a2361350 0x55b6a271a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:53.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.611+0000 7f6f77fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b6a2361350 0x55b6a271a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55136/0 (socket says 172.21.15.5:55136) 2024-08-31T05:34:53.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.611+0000 7f6f7ca91640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b6a2338490 0x55b6a271fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:53.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.611+0000 7f6f77fff640 1 -- 172.21.15.5:0/1142610758 learned_addr learned my addr 172.21.15.5:0/1142610758 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:53.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.611+0000 7f6f77fff640 1 --2- 172.21.15.5:0/1142610758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b6a22f5080 0x55b6a271f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:53.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.611+0000 7f6f77fff640 1 -- 172.21.15.5:0/1142610758 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b6a2338490 msgr2=0x55b6a271fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:53.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.611+0000 7f6f77fff640 1 --2- 172.21.15.5:0/1142610758 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b6a2338490 0x55b6a271fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:53.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.611+0000 7f6f77fff640 1 -- 172.21.15.5:0/1142610758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b6a22f5080 msgr2=0x55b6a271f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:53.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.611+0000 7f6f77fff640 1 --2- 172.21.15.5:0/1142610758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b6a22f5080 0x55b6a271f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:53.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.611+0000 7f6f77fff640 1 -- 172.21.15.5:0/1142610758 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6a271aac0 con 0x55b6a2361350 2024-08-31T05:34:53.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.611+0000 7f6f7ca91640 1 --2- 172.21.15.5:0/1142610758 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b6a2338490 0x55b6a271fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:34:53.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.612+0000 7f6f77fff640 1 --2- 172.21.15.5:0/1142610758 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b6a2361350 0x55b6a271a580 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c023010 tx=0x7f6f6c011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec30f39c52d34526 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:53.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.612+0000 7f6f57fff640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:34:53.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.612+0000 7f6f57fff640 1 -- 172.21.15.5:0/1142610758 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c03c070 con 0x55b6a2361350 2024-08-31T05:34:53.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.612+0000 7f6f57fff640 1 -- 172.21.15.5:0/1142610758 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f6f6c019040 con 0x55b6a2361350 2024-08-31T05:34:53.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.612+0000 7f6f8526a740 1 -- 172.21.15.5:0/1142610758 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f68036050 con 0x55b6a2361350 2024-08-31T05:34:53.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.612+0000 7f6f57fff640 1 -- 172.21.15.5:0/1142610758 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f6f6c048050 con 0x55b6a2361350 2024-08-31T05:34:53.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.612+0000 7f6f8526a740 10 client.16908 fetch_fsmap learned FSMap version 34 2024-08-31T05:34:53.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.612+0000 7f6f8526a740 1 -- 172.21.15.5:0/1142610758 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55b6a2794770 con 0x55b6a2361350 2024-08-31T05:34:53.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.613+0000 7f6f57fff640 1 -- 172.21.15.5:0/1142610758 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f6c004b30 con 0x55b6a2361350 2024-08-31T05:34:53.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.613+0000 7f6f57fff640 1 -- 172.21.15.5:0/1142610758 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f6f6c035040 con 0x55b6a2361350 2024-08-31T05:34:53.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.613+0000 7f6f8526a740 10 client.16908 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:34:53.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.613+0000 7f6f8526a740 10 client.16908 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:34:53.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.613+0000 7f6f8526a740 20 client.16908 populate_metadata read hostname 'smithi005' 2024-08-31T05:34:53.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.613+0000 7f6f8526a740 1 --2- 172.21.15.5:0/1142610758 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55b6a2794bf0 0x55b6a2797010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:53.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.613+0000 7f6f8526a740 4 client.16908 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T05:34:53.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.613+0000 7f6f8526a740 1 -- 172.21.15.5:0/1142610758 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f6f68036050 con 0x55b6a2794bf0 2024-08-31T05:34:53.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.613+0000 7f6f7ca91640 1 --2- 172.21.15.5:0/1142610758 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55b6a2794bf0 0x55b6a2797010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:53.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.613+0000 7f6f57fff640 10 client.16908 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:34:53.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.614+0000 7f6f7ca91640 1 --2- 172.21.15.5:0/1142610758 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55b6a2794bf0 0x55b6a2797010 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=876bc7064c01f02f server_cookie=3ed887c7781319ee in_seq=0 out_seq=0 2024-08-31T05:34:53.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.615+0000 7f6f57fff640 1 -- 172.21.15.5:0/1142610758 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f6f68036050 con 0x55b6a2794bf0 2024-08-31T05:34:53.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.615+0000 7f6f57fff640 10 client.16908 handle_command_reply: tid=0 2024-08-31T05:34:53.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.615+0000 7f6f8526a740 1 client.16908 shutdown 2024-08-31T05:34:53.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.615+0000 7f6f8526a740 1 -- 172.21.15.5:0/1142610758 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b6a2361350 msgr2=0x55b6a271a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:53.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.615+0000 7f6f8526a740 1 --2- 172.21.15.5:0/1142610758 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b6a2361350 0x55b6a271a580 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c023010 tx=0x7f6f6c011440 comp rx=0 tx=0).stop 2024-08-31T05:34:53.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.615+0000 7f6f8526a740 1 -- 172.21.15.5:0/1142610758 shutdown_connections 2024-08-31T05:34:53.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.615+0000 7f6f8526a740 1 --2- 172.21.15.5:0/1142610758 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55b6a2794bf0 0x55b6a2797010 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:53.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.616+0000 7f6f57fff640 0 client.16908 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:34:53.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.616+0000 7f6f8526a740 1 --2- 172.21.15.5:0/1142610758 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b6a2361350 0x55b6a271a580 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:53.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.616+0000 7f6f8526a740 1 --2- 172.21.15.5:0/1142610758 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b6a2338490 0x55b6a271fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:53.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.616+0000 7f6f8526a740 1 --2- 172.21.15.5:0/1142610758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b6a22f5080 0x55b6a271f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:53.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.616+0000 7f6f8526a740 1 -- 172.21.15.5:0/1142610758 >> 172.21.15.5:0/1142610758 conn(0x55b6a2355740 msgr2=0x55b6a2703c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:53.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.616+0000 7f6f8526a740 1 -- 172.21.15.5:0/1142610758 shutdown_connections 2024-08-31T05:34:53.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.616+0000 7f6f8526a740 1 -- 172.21.15.5:0/1142610758 wait complete. 2024-08-31T05:34:53.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.616+0000 7f6f8526a740 20 client.16908 trim_cache size 0 max 16384 2024-08-31T05:34:53.620 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:34:53.621 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-08-31T05:34:53.621 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "de9731c7-ae4a-42fe-8146-e4752cdc40d4", 2024-08-31T05:34:53.621 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-08-31T05:34:53.621 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:34:53.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.616+0000 7f6f7ecf5640 1 -- 172.21.15.5:0/3436050234 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f6f600b4d20 msgr2=0x7f6f600b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:53.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.616+0000 7f6f7ecf5640 1 --2- 172.21.15.5:0/3436050234 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f6f600b4d20 0x7f6f600b7230 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6f700e5b60 tx=0x7f6f700e5ad0 comp rx=0 tx=0).stop 2024-08-31T05:34:53.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.616+0000 7f6f7ecf5640 1 -- 172.21.15.5:0/3436050234 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f7810db90 msgr2=0x7f6f7819faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:53.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.616+0000 7f6f7ecf5640 1 --2- 172.21.15.5:0/3436050234 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f7810db90 0x7f6f7819faa0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6f7000e970 tx=0x7f6f7000ee30 comp rx=0 tx=0).stop 2024-08-31T05:34:53.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.617+0000 7f6f7ecf5640 1 -- 172.21.15.5:0/3436050234 shutdown_connections 2024-08-31T05:34:53.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.617+0000 7f6f7ecf5640 1 --2- 172.21.15.5:0/3436050234 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f6f600b4d20 0x7f6f600b7230 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:53.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.617+0000 7f6f7ecf5640 1 --2- 172.21.15.5:0/3436050234 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6f7810db90 0x7f6f7819faa0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:53.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.617+0000 7f6f7ecf5640 1 --2- 172.21.15.5:0/3436050234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f78105010 0x7f6f7819a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:53.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.617+0000 7f6f7ecf5640 1 --2- 172.21.15.5:0/3436050234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6f781045e0 0x7f6f7819a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:53.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.617+0000 7f6f7ecf5640 1 -- 172.21.15.5:0/3436050234 >> 172.21.15.5:0/3436050234 conn(0x7f6f780794d0 msgr2=0x7f6f78107710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:53.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.617+0000 7f6f7ecf5640 1 -- 172.21.15.5:0/3436050234 shutdown_connections 2024-08-31T05:34:53.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:53.617+0000 7f6f7ecf5640 1 -- 172.21.15.5:0/3436050234 wait complete. 2024-08-31T05:34:53.917 INFO:tasks.workunit.client.0.smithi005.stdout: 1 549161 13.28 MB/sec execute 101 sec latency 67.738 ms 2024-08-31T05:34:54.648 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T05:34:54.915 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:34:54.917 INFO:tasks.workunit.client.0.smithi005.stdout: 1 551275 13.28 MB/sec execute 102 sec latency 28.547 ms 2024-08-31T05:34:54.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:34:54 smithi005 ceph-mon[18602]: pgmap v493: 129 pgs: 129 active+clean; 320 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.1 MiB/s wr, 245 op/s 2024-08-31T05:34:54.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:34:54 smithi005 ceph-mon[18602]: scrub queued for path: / 2024-08-31T05:34:54.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:34:54 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:34:54.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:34:54 smithi005 ceph-mon[18602]: scrub summary: active paths [/] 2024-08-31T05:34:54.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:34:54 smithi005 ceph-mon[18602]: scrub summary: active paths [/] 2024-08-31T05:34:54.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:34:54 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:34:54.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:34:54 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:34:55.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:34:54 smithi070 ceph-mon[22316]: pgmap v493: 129 pgs: 129 active+clean; 320 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.1 MiB/s wr, 245 op/s 2024-08-31T05:34:55.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:34:54 smithi070 ceph-mon[22316]: scrub queued for path: / 2024-08-31T05:34:55.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:34:54 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:34:55.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:34:54 smithi070 ceph-mon[22316]: scrub summary: active paths [/] 2024-08-31T05:34:55.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:34:54 smithi070 ceph-mon[22316]: scrub summary: active paths [/] 2024-08-31T05:34:55.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:34:54 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:34:55.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:34:54 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:34:55.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:34:54 smithi050 ceph-mon[22146]: pgmap v493: 129 pgs: 129 active+clean; 320 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.1 MiB/s wr, 245 op/s 2024-08-31T05:34:55.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:34:54 smithi050 ceph-mon[22146]: scrub queued for path: / 2024-08-31T05:34:55.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:34:54 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:34:55.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:34:54 smithi050 ceph-mon[22146]: scrub summary: active paths [/] 2024-08-31T05:34:55.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:34:54 smithi050 ceph-mon[22146]: scrub summary: active paths [/] 2024-08-31T05:34:55.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:34:54 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:34:55.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:34:54 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:34:55.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.441+0000 7f6a989ad640 1 -- 172.21.15.5:0/1558574934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a94102810 msgr2=0x7f6a94102c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:55.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.441+0000 7f6a989ad640 1 --2- 172.21.15.5:0/1558574934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a94102810 0x7f6a94102c20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6a84009900 tx=0x7f6a8402a410 comp rx=0 tx=0).stop 2024-08-31T05:34:55.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.441+0000 7f6a989ad640 1 -- 172.21.15.5:0/1558574934 shutdown_connections 2024-08-31T05:34:55.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.441+0000 7f6a989ad640 1 --2- 172.21.15.5:0/1558574934 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a94108aa0 0x7f6a9410f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:55.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.441+0000 7f6a989ad640 1 --2- 172.21.15.5:0/1558574934 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a94108150 0x7f6a94108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:55.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.441+0000 7f6a989ad640 1 --2- 172.21.15.5:0/1558574934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a94102810 0x7f6a94102c20 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:55.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.441+0000 7f6a989ad640 1 -- 172.21.15.5:0/1558574934 >> 172.21.15.5:0/1558574934 conn(0x7f6a940794d0 msgr2=0x7f6a940798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:55.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.441+0000 7f6a989ad640 1 -- 172.21.15.5:0/1558574934 shutdown_connections 2024-08-31T05:34:55.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.441+0000 7f6a989ad640 1 -- 172.21.15.5:0/1558574934 wait complete. 2024-08-31T05:34:55.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.442+0000 7f6a989ad640 1 Processor -- start 2024-08-31T05:34:55.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.442+0000 7f6a989ad640 1 -- start start 2024-08-31T05:34:55.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.443+0000 7f6a989ad640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a94102810 0x7f6a94199130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:55.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.443+0000 7f6a989ad640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a94108150 0x7f6a941996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:55.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.443+0000 7f6a989ad640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a94108aa0 0x7f6a9419e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:55.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.443+0000 7f6a989ad640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6a94112700 con 0x7f6a94102810 2024-08-31T05:34:55.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.443+0000 7f6a989ad640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6a94112580 con 0x7f6a94108150 2024-08-31T05:34:55.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.443+0000 7f6a989ad640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6a94112880 con 0x7f6a94108aa0 2024-08-31T05:34:55.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.443+0000 7f6a91d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a94108150 0x7f6a941996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:55.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.443+0000 7f6a9259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a94102810 0x7f6a94199130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:55.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.443+0000 7f6a91d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a94108150 0x7f6a941996d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:56716/0 (socket says 172.21.15.5:56716) 2024-08-31T05:34:55.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.443+0000 7f6a91d9b640 1 -- 172.21.15.5:0/4087427354 learned_addr learned my addr 172.21.15.5:0/4087427354 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:55.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.443+0000 7f6a92d9d640 1 --2- 172.21.15.5:0/4087427354 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a94108aa0 0x7f6a9419e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:55.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.443+0000 7f6a91d9b640 1 -- 172.21.15.5:0/4087427354 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a94108aa0 msgr2=0x7f6a9419e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:55.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.443+0000 7f6a91d9b640 1 --2- 172.21.15.5:0/4087427354 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a94108aa0 0x7f6a9419e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:55.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.443+0000 7f6a91d9b640 1 -- 172.21.15.5:0/4087427354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a94102810 msgr2=0x7f6a94199130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:55.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.443+0000 7f6a91d9b640 1 --2- 172.21.15.5:0/4087427354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a94102810 0x7f6a94199130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:55.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.443+0000 7f6a91d9b640 1 -- 172.21.15.5:0/4087427354 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a9419f0a0 con 0x7f6a94108150 2024-08-31T05:34:55.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.443+0000 7f6a92d9d640 1 --2- 172.21.15.5:0/4087427354 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a94108aa0 0x7f6a9419e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:34:55.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.444+0000 7f6a91d9b640 1 --2- 172.21.15.5:0/4087427354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a94108150 0x7f6a941996d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6a88005fd0 tx=0x7f6a8800dd20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:55.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.444+0000 7f6a837fe640 1 -- 172.21.15.5:0/4087427354 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a88016070 con 0x7f6a94108150 2024-08-31T05:34:55.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.444+0000 7f6a837fe640 1 -- 172.21.15.5:0/4087427354 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6a88009c30 con 0x7f6a94108150 2024-08-31T05:34:55.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.444+0000 7f6a837fe640 1 -- 172.21.15.5:0/4087427354 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a88003d10 con 0x7f6a94108150 2024-08-31T05:34:55.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.444+0000 7f6a989ad640 1 -- 172.21.15.5:0/4087427354 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a9419f390 con 0x7f6a94108150 2024-08-31T05:34:55.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.444+0000 7f6a989ad640 1 -- 172.21.15.5:0/4087427354 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a9406b880 con 0x7f6a94108150 2024-08-31T05:34:55.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.447+0000 7f6a9ef22740 1 Processor -- start 2024-08-31T05:34:55.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.447+0000 7f6a9ef22740 1 -- start start 2024-08-31T05:34:55.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.447+0000 7f6a837fe640 1 -- 172.21.15.5:0/4087427354 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f6a88010560 con 0x7f6a94108150 2024-08-31T05:34:55.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.447+0000 7f6a9ef22740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2aa99f070 0x55b2aad442c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:55.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.447+0000 7f6a9ef22740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b2aa9761b0 0x55b2aad44800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:55.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.447+0000 7f6a9ef22740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2aa97e390 0x55b2aad44d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:55.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.447+0000 7f6a9ef22740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55b2aacbb630 con 0x55b2aa97e390 2024-08-31T05:34:55.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.447+0000 7f6a9ef22740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b2aacaabc0 con 0x55b2aa99f070 2024-08-31T05:34:55.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.447+0000 7f6a9ef22740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b2aacaeb70 con 0x55b2aa9761b0 2024-08-31T05:34:55.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.447+0000 7f6a9259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b2aa9761b0 0x55b2aad44800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:55.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.447+0000 7f6a91d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2aa97e390 0x55b2aad44d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:55.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.447+0000 7f6a92d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2aa99f070 0x55b2aad442c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:55.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.447+0000 7f6a92d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2aa99f070 0x55b2aad442c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:56732/0 (socket says 172.21.15.5:56732) 2024-08-31T05:34:55.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.447+0000 7f6a9259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b2aa9761b0 0x55b2aad44800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:56018/0 (socket says 172.21.15.5:56018) 2024-08-31T05:34:55.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.447+0000 7f6a92d9d640 1 -- 172.21.15.5:0/2963649287 learned_addr learned my addr 172.21.15.5:0/2963649287 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:55.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.448+0000 7f6a92d9d640 1 -- 172.21.15.5:0/2963649287 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b2aa9761b0 msgr2=0x55b2aad44800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:55.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.448+0000 7f6a92d9d640 1 --2- 172.21.15.5:0/2963649287 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b2aa9761b0 0x55b2aad44800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:55.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.448+0000 7f6a92d9d640 1 -- 172.21.15.5:0/2963649287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2aa97e390 msgr2=0x55b2aad44d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:55.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.448+0000 7f6a92d9d640 1 --2- 172.21.15.5:0/2963649287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2aa97e390 0x55b2aad44d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:55.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.448+0000 7f6a92d9d640 1 -- 172.21.15.5:0/2963649287 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2aaa0a650 con 0x55b2aa99f070 2024-08-31T05:34:55.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.448+0000 7f6a92d9d640 1 --2- 172.21.15.5:0/2963649287 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2aa99f070 0x55b2aad442c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c005f40 tx=0x7f6a8c010860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1313f5e3ba991521 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:55.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.448+0000 7f6a80ff9640 1 -- 172.21.15.5:0/2963649287 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c011700 con 0x55b2aa99f070 2024-08-31T05:34:55.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.448+0000 7f6a80ff9640 1 -- 172.21.15.5:0/2963649287 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6a8c011d50 con 0x55b2aa99f070 2024-08-31T05:34:55.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.448+0000 7f6a80ff9640 1 -- 172.21.15.5:0/2963649287 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c00e3c0 con 0x55b2aa99f070 2024-08-31T05:34:55.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.448+0000 7f6a837fe640 1 --2- 172.21.15.5:0/4087427354 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f6a7c0b4d20 0x7f6a7c0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:55.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.449+0000 7f6a9259c640 1 --2- 172.21.15.5:0/4087427354 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f6a7c0b4d20 0x7f6a7c0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:55.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.449+0000 7f6a837fe640 1 -- 172.21.15.5:0/4087427354 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f6a880e4f70 con 0x7f6a94108150 2024-08-31T05:34:55.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.449+0000 7f6a9ef22740 1 -- 172.21.15.5:0/2963649287 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2aa99f070 msgr2=0x55b2aad442c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:55.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.449+0000 7f6a9ef22740 1 --2- 172.21.15.5:0/2963649287 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2aa99f070 0x55b2aad442c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c005f40 tx=0x7f6a8c010860 comp rx=0 tx=0).stop 2024-08-31T05:34:55.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.449+0000 7f6a9ef22740 1 -- 172.21.15.5:0/2963649287 shutdown_connections 2024-08-31T05:34:55.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.449+0000 7f6a9ef22740 1 --2- 172.21.15.5:0/2963649287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2aa97e390 0x55b2aad44d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:55.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.449+0000 7f6a9ef22740 1 --2- 172.21.15.5:0/2963649287 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b2aa9761b0 0x55b2aad44800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:55.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.449+0000 7f6a9ef22740 1 --2- 172.21.15.5:0/2963649287 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2aa99f070 0x55b2aad442c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:55.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.449+0000 7f6a9ef22740 1 -- 172.21.15.5:0/2963649287 >> 172.21.15.5:0/2963649287 conn(0x55b2aa993460 msgr2=0x55b2aad421b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:55.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.450+0000 7f6a9ef22740 1 -- 172.21.15.5:0/2963649287 shutdown_connections 2024-08-31T05:34:55.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.450+0000 7f6a9259c640 1 --2- 172.21.15.5:0/4087427354 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f6a7c0b4d20 0x7f6a7c0b7230 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6a84031440 tx=0x7f6a84009560 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:55.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.450+0000 7f6a9ef22740 1 -- 172.21.15.5:0/2963649287 wait complete. 2024-08-31T05:34:55.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.450+0000 7f6a9ef22740 1 -- start start 2024-08-31T05:34:55.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.450+0000 7f6a9ef22740 1 Processor -- start 2024-08-31T05:34:55.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.451+0000 7f6a9ef22740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2aa9761b0 0x55b2aad4fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:55.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.451+0000 7f6a9ef22740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b2aa97e390 0x55b2aad50440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:55.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.451+0000 7f6a9ef22740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2aa99f070 0x55b2aad55650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:55.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.451+0000 7f6a9259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2aa9761b0 0x55b2aad4fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:55.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.451+0000 7f6a9ef22740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55b2aab0d700 con 0x55b2aa9761b0 2024-08-31T05:34:55.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.451+0000 7f6a9ef22740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b2aac31700 con 0x55b2aa99f070 2024-08-31T05:34:55.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.451+0000 7f6a9ef22740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b2aad4a7d0 con 0x55b2aa97e390 2024-08-31T05:34:55.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.451+0000 7f6a9259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2aa9761b0 0x55b2aad4fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55178/0 (socket says 172.21.15.5:55178) 2024-08-31T05:34:55.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.451+0000 7f6a9259c640 1 -- 172.21.15.5:0/348893278 learned_addr learned my addr 172.21.15.5:0/348893278 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:55.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.451+0000 7f6a9ef22740 10 client.0 _ll_register_callbacks cb 0x55b2aac60dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:34:55.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.451+0000 7f6a91d9b640 1 --2- 172.21.15.5:0/348893278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b2aa97e390 0x55b2aad50440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:55.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.451+0000 7f6a92d9d640 1 --2- 172.21.15.5:0/348893278 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2aa99f070 0x55b2aad55650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:55.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.451+0000 7f6a9259c640 1 -- 172.21.15.5:0/348893278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b2aa97e390 msgr2=0x55b2aad50440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:55.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.451+0000 7f6a9259c640 1 --2- 172.21.15.5:0/348893278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b2aa97e390 0x55b2aad50440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:55.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.451+0000 7f6a9259c640 1 -- 172.21.15.5:0/348893278 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2aa99f070 msgr2=0x55b2aad55650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:55.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.451+0000 7f6a9259c640 1 --2- 172.21.15.5:0/348893278 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2aa99f070 0x55b2aad55650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:55.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.451+0000 7f6a9259c640 1 -- 172.21.15.5:0/348893278 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2aac6a8b0 con 0x55b2aa9761b0 2024-08-31T05:34:55.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.451+0000 7f6a92d9d640 1 --2- 172.21.15.5:0/348893278 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2aa99f070 0x55b2aad55650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:34:55.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.452+0000 7f6a9259c640 1 --2- 172.21.15.5:0/348893278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2aa9761b0 0x55b2aad4fec0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f6a84009900 tx=0x7f6a84009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f640b69e4c2bb40c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:55.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.452+0000 7f6a79ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:34:55.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.452+0000 7f6a79ffb640 1 -- 172.21.15.5:0/348893278 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a8404d070 con 0x55b2aa9761b0 2024-08-31T05:34:55.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.452+0000 7f6a9ef22740 1 -- 172.21.15.5:0/348893278 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a8c011d50 con 0x55b2aa9761b0 2024-08-31T05:34:55.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.452+0000 7f6a79ffb640 1 -- 172.21.15.5:0/348893278 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f6a84005030 con 0x55b2aa9761b0 2024-08-31T05:34:55.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.452+0000 7f6a79ffb640 1 -- 172.21.15.5:0/348893278 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f6a84059050 con 0x55b2aa9761b0 2024-08-31T05:34:55.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.452+0000 7f6a9ef22740 10 client.16920 fetch_fsmap learned FSMap version 34 2024-08-31T05:34:55.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.452+0000 7f6a9ef22740 1 -- 172.21.15.5:0/348893278 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55b2aad66fb0 con 0x55b2aa9761b0 2024-08-31T05:34:55.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.452+0000 7f6a79ffb640 1 -- 172.21.15.5:0/348893278 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6a8c011d50 con 0x55b2aa9761b0 2024-08-31T05:34:55.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.453+0000 7f6a79ffb640 1 -- 172.21.15.5:0/348893278 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f6a840035f0 con 0x55b2aa9761b0 2024-08-31T05:34:55.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.453+0000 7f6a9ef22740 10 client.16920 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:34:55.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.453+0000 7f6a9ef22740 10 client.16920 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:34:55.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.453+0000 7f6a9ef22740 20 client.16920 populate_metadata read hostname 'smithi005' 2024-08-31T05:34:55.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.453+0000 7f6a9ef22740 1 --2- 172.21.15.5:0/348893278 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55b2aa95d9f0 0x55b2aad6a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:55.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.453+0000 7f6a9ef22740 4 client.16920 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:34:55.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.453+0000 7f6a9ef22740 1 -- 172.21.15.5:0/348893278 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b2aacbd580 con 0x55b2aa95d9f0 2024-08-31T05:34:55.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.453+0000 7f6a91d9b640 1 --2- 172.21.15.5:0/348893278 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55b2aa95d9f0 0x55b2aad6a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:55.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.453+0000 7f6a79ffb640 10 client.16920 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:34:55.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.453+0000 7f6a91d9b640 1 --2- 172.21.15.5:0/348893278 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55b2aa95d9f0 0x55b2aad6a8e0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f8e37fbe5c38b75 server_cookie=3095e3393e9ad042 in_seq=0 out_seq=0 2024-08-31T05:34:55.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.454+0000 7f6a79ffb640 1 -- 172.21.15.5:0/348893278 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b2aacbd580 con 0x55b2aa95d9f0 2024-08-31T05:34:55.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.454+0000 7f6a79ffb640 10 client.16920 handle_command_reply: tid=0 2024-08-31T05:34:55.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.454+0000 7f6a9ef22740 1 client.16920 shutdown 2024-08-31T05:34:55.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.454+0000 7f6a9ef22740 1 -- 172.21.15.5:0/348893278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2aa9761b0 msgr2=0x55b2aad4fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:55.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.454+0000 7f6a9ef22740 1 --2- 172.21.15.5:0/348893278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2aa9761b0 0x55b2aad4fec0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f6a84009900 tx=0x7f6a84009260 comp rx=0 tx=0).stop 2024-08-31T05:34:55.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.455+0000 7f6a9ef22740 1 -- 172.21.15.5:0/348893278 shutdown_connections 2024-08-31T05:34:55.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.455+0000 7f6a9ef22740 1 --2- 172.21.15.5:0/348893278 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55b2aa95d9f0 0x55b2aad6a8e0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:55.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.455+0000 7f6a9ef22740 1 --2- 172.21.15.5:0/348893278 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2aa99f070 0x55b2aad55650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:55.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.455+0000 7f6a9ef22740 1 --2- 172.21.15.5:0/348893278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b2aa97e390 0x55b2aad50440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:55.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.455+0000 7f6a9ef22740 1 --2- 172.21.15.5:0/348893278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2aa9761b0 0x55b2aad4fec0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:55.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.455+0000 7f6a9ef22740 1 -- 172.21.15.5:0/348893278 >> 172.21.15.5:0/348893278 conn(0x55b2aa993460 msgr2=0x55b2aad40770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:55.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.455+0000 7f6a79ffb640 0 client.16920 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:34:55.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.455+0000 7f6a9ef22740 1 -- 172.21.15.5:0/348893278 shutdown_connections 2024-08-31T05:34:55.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.455+0000 7f6a9ef22740 1 -- 172.21.15.5:0/348893278 wait complete. 2024-08-31T05:34:55.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.455+0000 7f6a9ef22740 20 client.16920 trim_cache size 0 max 16384 2024-08-31T05:34:55.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.476+0000 7f6a9ef22740 1 Processor -- start 2024-08-31T05:34:55.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.476+0000 7f6a9ef22740 1 -- start start 2024-08-31T05:34:55.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.476+0000 7f6a9ef22740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2aa9761b0 0x55b2aad4d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:55.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.476+0000 7f6a9ef22740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b2aa97e390 0x55b2aad4d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:55.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.476+0000 7f6a9ef22740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2aa99f070 0x55b2aad700e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:55.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.476+0000 7f6a9ef22740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6a941ae990 con 0x55b2aa99f070 2024-08-31T05:34:55.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.476+0000 7f6a9ef22740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6a941b04d0 con 0x55b2aa9761b0 2024-08-31T05:34:55.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.476+0000 7f6a9ef22740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6a941af060 con 0x55b2aa97e390 2024-08-31T05:34:55.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.476+0000 7f6a92d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2aa99f070 0x55b2aad700e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:55.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.476+0000 7f6a92d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2aa99f070 0x55b2aad700e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55182/0 (socket says 172.21.15.5:55182) 2024-08-31T05:34:55.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.476+0000 7f6a91d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b2aa97e390 0x55b2aad4d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:55.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.476+0000 7f6a92d9d640 1 -- 172.21.15.5:0/860693131 learned_addr learned my addr 172.21.15.5:0/860693131 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:55.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.477+0000 7f6a9259c640 1 --2- 172.21.15.5:0/860693131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2aa9761b0 0x55b2aad4d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:55.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.477+0000 7f6a92d9d640 1 -- 172.21.15.5:0/860693131 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b2aa97e390 msgr2=0x55b2aad4d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:55.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.477+0000 7f6a92d9d640 1 --2- 172.21.15.5:0/860693131 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b2aa97e390 0x55b2aad4d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:55.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.477+0000 7f6a92d9d640 1 -- 172.21.15.5:0/860693131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2aa9761b0 msgr2=0x55b2aad4d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:55.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.477+0000 7f6a92d9d640 1 --2- 172.21.15.5:0/860693131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2aa9761b0 0x55b2aad4d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:55.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.477+0000 7f6a92d9d640 1 -- 172.21.15.5:0/860693131 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2aad6aea0 con 0x55b2aa99f070 2024-08-31T05:34:55.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.477+0000 7f6a92d9d640 1 --2- 172.21.15.5:0/860693131 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2aa99f070 0x55b2aad700e0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c005f10 tx=0x7f6a8c004a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c8512d7f71cab67 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:55.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.477+0000 7f6a7bfff640 1 -- 172.21.15.5:0/860693131 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c029070 con 0x55b2aa99f070 2024-08-31T05:34:55.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.477+0000 7f6a7bfff640 1 -- 172.21.15.5:0/860693131 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6a8c003e20 con 0x55b2aa99f070 2024-08-31T05:34:55.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.477+0000 7f6a7bfff640 1 -- 172.21.15.5:0/860693131 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c011500 con 0x55b2aa99f070 2024-08-31T05:34:55.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.478+0000 7f6a9ef22740 1 -- 172.21.15.5:0/860693131 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2aa99f070 msgr2=0x55b2aad700e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:55.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.478+0000 7f6a9ef22740 1 --2- 172.21.15.5:0/860693131 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2aa99f070 0x55b2aad700e0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c005f10 tx=0x7f6a8c004a00 comp rx=0 tx=0).stop 2024-08-31T05:34:55.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.478+0000 7f6a9ef22740 1 -- 172.21.15.5:0/860693131 shutdown_connections 2024-08-31T05:34:55.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.478+0000 7f6a9ef22740 1 --2- 172.21.15.5:0/860693131 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2aa99f070 0x55b2aad700e0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:55.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.478+0000 7f6a9ef22740 1 --2- 172.21.15.5:0/860693131 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b2aa97e390 0x55b2aad4d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:55.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.478+0000 7f6a9ef22740 1 --2- 172.21.15.5:0/860693131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2aa9761b0 0x55b2aad4d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:55.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.478+0000 7f6a9ef22740 1 -- 172.21.15.5:0/860693131 >> 172.21.15.5:0/860693131 conn(0x55b2aa993460 msgr2=0x55b2aad4e740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:55.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.478+0000 7f6a9ef22740 1 -- 172.21.15.5:0/860693131 shutdown_connections 2024-08-31T05:34:55.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.478+0000 7f6a9ef22740 1 -- 172.21.15.5:0/860693131 wait complete. 2024-08-31T05:34:55.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.479+0000 7f6a9ef22740 1 -- start start 2024-08-31T05:34:55.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.479+0000 7f6a9ef22740 1 Processor -- start 2024-08-31T05:34:55.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.479+0000 7f6a9ef22740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2aa9761b0 0x55b2aad64e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:55.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.479+0000 7f6a9ef22740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b2aa97e390 0x55b2aad60320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:55.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.479+0000 7f6a9ef22740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2aa99f070 0x55b2aad60a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:55.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.479+0000 7f6a9ef22740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6a941afe00 con 0x55b2aa99f070 2024-08-31T05:34:55.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.479+0000 7f6a9ef22740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6a941af730 con 0x55b2aa9761b0 2024-08-31T05:34:55.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.479+0000 7f6a9ef22740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6a941ac970 con 0x55b2aa97e390 2024-08-31T05:34:55.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.479+0000 7f6a9ef22740 10 client.0 _ll_register_callbacks cb 0x7f6a84032f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:34:55.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.479+0000 7f6a91d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b2aa97e390 0x55b2aad60320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:55.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.480+0000 7f6a91d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b2aa97e390 0x55b2aad60320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:56060/0 (socket says 172.21.15.5:56060) 2024-08-31T05:34:55.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.480+0000 7f6a91d9b640 1 -- 172.21.15.5:0/4255952747 learned_addr learned my addr 172.21.15.5:0/4255952747 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:55.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.480+0000 7f6a9259c640 1 --2- 172.21.15.5:0/4255952747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2aa9761b0 0x55b2aad64e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:55.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.480+0000 7f6a92d9d640 1 --2- 172.21.15.5:0/4255952747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2aa99f070 0x55b2aad60a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:55.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.480+0000 7f6a91d9b640 1 -- 172.21.15.5:0/4255952747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2aa9761b0 msgr2=0x55b2aad64e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:55.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.480+0000 7f6a91d9b640 1 --2- 172.21.15.5:0/4255952747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2aa9761b0 0x55b2aad64e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:55.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.480+0000 7f6a91d9b640 1 -- 172.21.15.5:0/4255952747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2aa99f070 msgr2=0x55b2aad60a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:55.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.480+0000 7f6a91d9b640 1 --2- 172.21.15.5:0/4255952747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2aa99f070 0x55b2aad60a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:55.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.480+0000 7f6a91d9b640 1 -- 172.21.15.5:0/4255952747 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2aadd42e0 con 0x55b2aa97e390 2024-08-31T05:34:55.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.480+0000 7f6a92d9d640 1 --2- 172.21.15.5:0/4255952747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2aa99f070 0x55b2aad60a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:34:55.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.480+0000 7f6a91d9b640 1 --2- 172.21.15.5:0/4255952747 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b2aa97e390 0x55b2aad60320 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6a880e2340 tx=0x7f6a880e89a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=295e9b375eeb9f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:55.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.480+0000 7f6a79ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:34:55.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.480+0000 7f6a79ffb640 1 -- 172.21.15.5:0/4255952747 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a8801e040 con 0x55b2aa97e390 2024-08-31T05:34:55.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.480+0000 7f6a79ffb640 1 -- 172.21.15.5:0/4255952747 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f6a880d00b0 con 0x55b2aa97e390 2024-08-31T05:34:55.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.480+0000 7f6a9ef22740 1 -- 172.21.15.5:0/4255952747 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a8c003e20 con 0x55b2aa97e390 2024-08-31T05:34:55.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.481+0000 7f6a79ffb640 1 -- 172.21.15.5:0/4255952747 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f6a880d02b0 con 0x55b2aa97e390 2024-08-31T05:34:55.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.481+0000 7f6a9ef22740 10 client.26530 fetch_fsmap learned FSMap version 34 2024-08-31T05:34:55.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.481+0000 7f6a9ef22740 1 -- 172.21.15.5:0/4255952747 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55b2aadd5420 con 0x55b2aa97e390 2024-08-31T05:34:55.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.481+0000 7f6a79ffb640 1 -- 172.21.15.5:0/4255952747 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6a8c003e20 con 0x55b2aa97e390 2024-08-31T05:34:55.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.481+0000 7f6a79ffb640 1 -- 172.21.15.5:0/4255952747 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f6a880e2560 con 0x55b2aa97e390 2024-08-31T05:34:55.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.481+0000 7f6a9ef22740 10 client.26530 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:34:55.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.481+0000 7f6a9ef22740 10 client.26530 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:34:55.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.481+0000 7f6a9ef22740 20 client.26530 populate_metadata read hostname 'smithi005' 2024-08-31T05:34:55.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.481+0000 7f6a9ef22740 1 --2- 172.21.15.5:0/4255952747 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55b2aa932da0 0x55b2aadd7b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:55.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.481+0000 7f6a9ef22740 4 client.26530 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T05:34:55.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.481+0000 7f6a9ef22740 1 -- 172.21.15.5:0/4255952747 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b2aacb9020 con 0x55b2aa932da0 2024-08-31T05:34:55.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.482+0000 7f6a9259c640 1 --2- 172.21.15.5:0/4255952747 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55b2aa932da0 0x55b2aadd7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:55.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.482+0000 7f6a9259c640 1 --2- 172.21.15.5:0/4255952747 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55b2aa932da0 0x55b2aadd7b10 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6bd9b00091fed884 server_cookie=67408ce660c41ea3 in_seq=0 out_seq=0 2024-08-31T05:34:55.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.482+0000 7f6a79ffb640 10 client.26530 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:34:55.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.483+0000 7f6a79ffb640 1 -- 172.21.15.5:0/4255952747 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2274 (crc 0 0 0) 0x55b2aacb9020 con 0x55b2aa932da0 2024-08-31T05:34:55.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.483+0000 7f6a79ffb640 10 client.26530 handle_command_reply: tid=0 2024-08-31T05:34:55.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.483+0000 7f6a9ef22740 1 client.26530 shutdown 2024-08-31T05:34:55.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.483+0000 7f6a9ef22740 1 -- 172.21.15.5:0/4255952747 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b2aa97e390 msgr2=0x55b2aad60320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:55.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.483+0000 7f6a9ef22740 1 --2- 172.21.15.5:0/4255952747 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b2aa97e390 0x55b2aad60320 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6a880e2340 tx=0x7f6a880e89a0 comp rx=0 tx=0).stop 2024-08-31T05:34:55.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.483+0000 7f6a9ef22740 1 -- 172.21.15.5:0/4255952747 shutdown_connections 2024-08-31T05:34:55.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.483+0000 7f6a9ef22740 1 --2- 172.21.15.5:0/4255952747 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55b2aa932da0 0x55b2aadd7b10 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:55.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.483+0000 7f6a9ef22740 1 --2- 172.21.15.5:0/4255952747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b2aa99f070 0x55b2aad60a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:55.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.483+0000 7f6a9ef22740 1 --2- 172.21.15.5:0/4255952747 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b2aa97e390 0x55b2aad60320 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:55.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.483+0000 7f6a9ef22740 1 --2- 172.21.15.5:0/4255952747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b2aa9761b0 0x55b2aad64e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:55.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.483+0000 7f6a79ffb640 0 client.26530 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:34:55.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.483+0000 7f6a9ef22740 1 -- 172.21.15.5:0/4255952747 >> 172.21.15.5:0/4255952747 conn(0x55b2aa993460 msgr2=0x55b2aad452f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:55.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.484+0000 7f6a9ef22740 1 -- 172.21.15.5:0/4255952747 shutdown_connections 2024-08-31T05:34:55.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.484+0000 7f6a9ef22740 1 -- 172.21.15.5:0/4255952747 wait complete. 2024-08-31T05:34:55.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.484+0000 7f6a9ef22740 20 client.26530 trim_cache size 0 max 16384 2024-08-31T05:34:55.490 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:34:55.490 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T05:34:55.490 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2024-08-31T05:34:55.490 INFO:teuthology.orchestra.run.smithi005.stdout: "de9731c7-ae4a-42fe-8146-e4752cdc40d4": { 2024-08-31T05:34:55.490 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:34:55.490 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "de9731c7-ae4a-42fe-8146-e4752cdc40d4", 2024-08-31T05:34:55.490 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2024-08-31T05:34:55.490 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:34:55.491 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:34:55.491 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_stats": { 2024-08-31T05:34:55.491 INFO:teuthology.orchestra.run.smithi005.stdout: "de9731c7-ae4a-42fe-8146-e4752cdc40d4": { 2024-08-31T05:34:55.491 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:34:53.614499+0000", 2024-08-31T05:34:55.491 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:34:55.491 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:34:55.491 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:34:55.491 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:34:55.491 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:34:55.491 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:34:55.491 INFO:teuthology.orchestra.run.smithi005.stdout: "0bb67292-013a-40c7-b5fc-810bdd9715d8": { 2024-08-31T05:34:55.491 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:34:04.586008+0000", 2024-08-31T05:34:55.491 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:34:55.492 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:34:55.492 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:34:55.492 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:34:55.492 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:34:55.492 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:34:55.492 INFO:teuthology.orchestra.run.smithi005.stdout: "728a42ca-bbef-4151-830f-5fdd411d8fa0": { 2024-08-31T05:34:55.492 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:32:30.554906+0000", 2024-08-31T05:34:55.492 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:34:55.492 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:34:55.492 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:34:55.492 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:34:55.492 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:34:55.492 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:34:55.493 INFO:teuthology.orchestra.run.smithi005.stdout: "2445fc42-b797-434f-b380-e2da985b4d98": { 2024-08-31T05:34:55.493 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:33:17.681453+0000", 2024-08-31T05:34:55.493 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:34:55.493 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:34:55.493 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:34:55.493 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:34:55.493 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:34:55.493 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:34:55.493 INFO:teuthology.orchestra.run.smithi005.stdout: "cda92ac0-b35f-47a5-a3a5-471c888462a5": { 2024-08-31T05:34:55.493 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:53.103905+0000", 2024-08-31T05:34:55.493 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:34:55.493 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:34:55.493 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:34:55.493 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:34:55.494 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:34:55.494 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:34:55.494 INFO:teuthology.orchestra.run.smithi005.stdout: "ece37b07-9ab2-45f8-bc33-2755a07aac0b": { 2024-08-31T05:34:55.494 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:31:41.782407+0000", 2024-08-31T05:34:55.494 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:34:55.494 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:34:55.494 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:34:55.494 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:34:55.494 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:34:55.494 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:34:55.494 INFO:teuthology.orchestra.run.smithi005.stdout: "75d84398-5d9c-4872-b879-2fbce045fa71": { 2024-08-31T05:34:55.494 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:06.642335+0000", 2024-08-31T05:34:55.494 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:34:55.494 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:34:55.495 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:34:55.495 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:34:55.495 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:34:55.495 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:34:55.495 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:34:55.495 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:34:55.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.485+0000 7f6a989ad640 1 -- 172.21.15.5:0/4087427354 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f6a7c0b4d20 msgr2=0x7f6a7c0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:55.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.485+0000 7f6a989ad640 1 --2- 172.21.15.5:0/4087427354 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f6a7c0b4d20 0x7f6a7c0b7230 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6a84031440 tx=0x7f6a84009560 comp rx=0 tx=0).stop 2024-08-31T05:34:55.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.485+0000 7f6a989ad640 1 -- 172.21.15.5:0/4087427354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a94108150 msgr2=0x7f6a941996d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:55.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.485+0000 7f6a989ad640 1 --2- 172.21.15.5:0/4087427354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a94108150 0x7f6a941996d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6a88005fd0 tx=0x7f6a8800dd20 comp rx=0 tx=0).stop 2024-08-31T05:34:55.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.485+0000 7f6a989ad640 1 -- 172.21.15.5:0/4087427354 shutdown_connections 2024-08-31T05:34:55.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.485+0000 7f6a989ad640 1 --2- 172.21.15.5:0/4087427354 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f6a7c0b4d20 0x7f6a7c0b7230 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:55.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.485+0000 7f6a989ad640 1 --2- 172.21.15.5:0/4087427354 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a94108aa0 0x7f6a9419e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:55.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.485+0000 7f6a989ad640 1 --2- 172.21.15.5:0/4087427354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6a94108150 0x7f6a941996d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:55.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.485+0000 7f6a989ad640 1 --2- 172.21.15.5:0/4087427354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a94102810 0x7f6a94199130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:55.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.485+0000 7f6a989ad640 1 -- 172.21.15.5:0/4087427354 >> 172.21.15.5:0/4087427354 conn(0x7f6a940794d0 msgr2=0x7f6a941012e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:55.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.485+0000 7f6a989ad640 1 -- 172.21.15.5:0/4087427354 shutdown_connections 2024-08-31T05:34:55.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:34:55.485+0000 7f6a989ad640 1 -- 172.21.15.5:0/4087427354 wait complete. 2024-08-31T05:34:55.917 INFO:tasks.workunit.client.0.smithi005.stdout: 1 553983 13.29 MB/sec execute 103 sec latency 39.458 ms 2024-08-31T05:34:56.199 INFO:tasks.cephfs.filesystem:scrub status for tag:de9731c7-ae4a-42fe-8146-e4752cdc40d4 - {'path': '/', 'tag': 'de9731c7-ae4a-42fe-8146-e4752cdc40d4', 'options': 'recursive,force'} 2024-08-31T05:34:56.917 INFO:tasks.workunit.client.0.smithi005.stdout: 1 556499 13.27 MB/sec execute 104 sec latency 11.942 ms 2024-08-31T05:34:56.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:34:56 smithi005 ceph-mon[18602]: pgmap v494: 129 pgs: 129 active+clean; 321 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.0 MiB/s wr, 279 op/s 2024-08-31T05:34:57.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:34:56 smithi070 ceph-mon[22316]: pgmap v494: 129 pgs: 129 active+clean; 321 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.0 MiB/s wr, 279 op/s 2024-08-31T05:34:57.156 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:34:56 smithi050 ceph-mon[22146]: pgmap v494: 129 pgs: 129 active+clean; 321 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.0 MiB/s wr, 279 op/s 2024-08-31T05:34:57.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.541+0000 7f971762f640 1 -- 172.21.15.5:0/4179111719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f971010f7d0 msgr2=0x7f971010fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:57.544 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.541+0000 7f971762f640 1 --2- 172.21.15.5:0/4179111719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f971010f7d0 0x7f971010fbe0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9708009be0 tx=0x7f970802a6d0 comp rx=0 tx=0).stop 2024-08-31T05:34:57.545 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.543+0000 7f971762f640 1 -- 172.21.15.5:0/4179111719 shutdown_connections 2024-08-31T05:34:57.545 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.543+0000 7f971762f640 1 --2- 172.21.15.5:0/4179111719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9710110120 0x7f9710116950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:57.545 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.543+0000 7f971762f640 1 --2- 172.21.15.5:0/4179111719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f971010f7d0 0x7f971010fbe0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:57.545 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.543+0000 7f971762f640 1 --2- 172.21.15.5:0/4179111719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9710109ea0 0x7f971010a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:57.546 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.543+0000 7f971762f640 1 -- 172.21.15.5:0/4179111719 >> 172.21.15.5:0/4179111719 conn(0x7f9710079480 msgr2=0x7f9710107f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:57.546 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.544+0000 7f971762f640 1 -- 172.21.15.5:0/4179111719 shutdown_connections 2024-08-31T05:34:57.546 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.544+0000 7f971762f640 1 -- 172.21.15.5:0/4179111719 wait complete. 2024-08-31T05:34:57.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.545+0000 7f971762f640 1 Processor -- start 2024-08-31T05:34:57.548 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.546+0000 7f971762f640 1 -- start start 2024-08-31T05:34:57.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.546+0000 7f971762f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9710109ea0 0x7f97101a0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:57.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.546+0000 7f971762f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f971010f7d0 0x7f97101a0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:57.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.546+0000 7f971762f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9710110120 0x7f97101a6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:57.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.546+0000 7f971762f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9710119de0 con 0x7f9710110120 2024-08-31T05:34:57.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.547+0000 7f971762f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9710119c60 con 0x7f9710109ea0 2024-08-31T05:34:57.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.547+0000 7f971762f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9710119f60 con 0x7f971010f7d0 2024-08-31T05:34:57.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.547+0000 7f9714bca640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f971010f7d0 0x7f97101a0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:57.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.547+0000 7f9714bca640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f971010f7d0 0x7f97101a0dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:56084/0 (socket says 172.21.15.5:56084) 2024-08-31T05:34:57.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.547+0000 7f9714bca640 1 -- 172.21.15.5:0/3987383865 learned_addr learned my addr 172.21.15.5:0/3987383865 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:57.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.547+0000 7f97153cb640 1 --2- 172.21.15.5:0/3987383865 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9710109ea0 0x7f97101a0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:57.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.547+0000 7f9714bca640 1 -- 172.21.15.5:0/3987383865 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9710109ea0 msgr2=0x7f97101a0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:57.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.547+0000 7f9714bca640 1 --2- 172.21.15.5:0/3987383865 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9710109ea0 0x7f97101a0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:57.551 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.547+0000 7f9714bca640 1 -- 172.21.15.5:0/3987383865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9710110120 msgr2=0x7f97101a6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:57.551 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.547+0000 7f9714bca640 1 --2- 172.21.15.5:0/3987383865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9710110120 0x7f97101a6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:57.551 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.547+0000 7f9714bca640 1 -- 172.21.15.5:0/3987383865 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97101a6750 con 0x7f971010f7d0 2024-08-31T05:34:57.551 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.548+0000 7f9714bca640 1 --2- 172.21.15.5:0/3987383865 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f971010f7d0 0x7f97101a0dc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9708000f80 tx=0x7f9708003ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:57.551 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.548+0000 7f97067fc640 1 -- 172.21.15.5:0/3987383865 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9708041020 con 0x7f971010f7d0 2024-08-31T05:34:57.551 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.548+0000 7f97067fc640 1 -- 172.21.15.5:0/3987383865 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97080318f0 con 0x7f971010f7d0 2024-08-31T05:34:57.551 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.548+0000 7f97067fc640 1 -- 172.21.15.5:0/3987383865 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9708036040 con 0x7f971010f7d0 2024-08-31T05:34:57.551 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.549+0000 7f971762f640 1 -- 172.21.15.5:0/3987383865 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97101a69e0 con 0x7f971010f7d0 2024-08-31T05:34:57.551 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.549+0000 7f971762f640 1 -- 172.21.15.5:0/3987383865 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97101a6e80 con 0x7f971010f7d0 2024-08-31T05:34:57.555 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.553+0000 7f971e67a740 1 Processor -- start 2024-08-31T05:34:57.555 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.553+0000 7f971e67a740 1 -- start start 2024-08-31T05:34:57.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.553+0000 7f971e67a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56529d39c1b0 0x56529d73fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:57.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.553+0000 7f971e67a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56529d3732f0 0x56529d740000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:57.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.553+0000 7f971e67a740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56529d37b4d0 0x56529d740540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:57.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.553+0000 7f971e67a740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56529d6b5000 con 0x56529d37b4d0 2024-08-31T05:34:57.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.553+0000 7f971e67a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56529d6a4590 con 0x56529d3732f0 2024-08-31T05:34:57.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.553+0000 7f971e67a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56529d6a8540 con 0x56529d39c1b0 2024-08-31T05:34:57.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.553+0000 7f97153cb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56529d3732f0 0x56529d740000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:57.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.553+0000 7f97153cb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56529d3732f0 0x56529d740000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:56786/0 (socket says 172.21.15.5:56786) 2024-08-31T05:34:57.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.553+0000 7f97153cb640 1 -- 172.21.15.5:0/1502563490 learned_addr learned my addr 172.21.15.5:0/1502563490 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:57.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.554+0000 7f97067fc640 1 -- 172.21.15.5:0/3987383865 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f9708044020 con 0x7f971010f7d0 2024-08-31T05:34:57.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.554+0000 7f9715bcc640 1 --2- 172.21.15.5:0/1502563490 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56529d39c1b0 0x56529d73fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:57.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.554+0000 7f97153cb640 1 -- 172.21.15.5:0/1502563490 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56529d39c1b0 msgr2=0x56529d73fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:57.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.554+0000 7f97153cb640 1 --2- 172.21.15.5:0/1502563490 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56529d39c1b0 0x56529d73fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:57.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.554+0000 7f97153cb640 1 -- 172.21.15.5:0/1502563490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56529d37b4d0 msgr2=0x56529d740540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:57.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.554+0000 7f97153cb640 1 --2- 172.21.15.5:0/1502563490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56529d37b4d0 0x56529d740540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:57.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.554+0000 7f97153cb640 1 -- 172.21.15.5:0/1502563490 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56529d407790 con 0x56529d3732f0 2024-08-31T05:34:57.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.554+0000 7f97153cb640 1 --2- 172.21.15.5:0/1502563490 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56529d3732f0 0x56529d740000 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f970c009c80 tx=0x7f970c010740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3660524f01f6f2e9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:57.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.554+0000 7f96fb7fe640 1 -- 172.21.15.5:0/1502563490 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f970c004020 con 0x56529d3732f0 2024-08-31T05:34:57.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.554+0000 7f96fb7fe640 1 -- 172.21.15.5:0/1502563490 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f970c0041c0 con 0x56529d3732f0 2024-08-31T05:34:57.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.554+0000 7f96fb7fe640 1 -- 172.21.15.5:0/1502563490 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f970c0126b0 con 0x56529d3732f0 2024-08-31T05:34:57.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.555+0000 7f97067fc640 1 --2- 172.21.15.5:0/3987383865 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f96fc0b4d20 0x7f96fc0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:57.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.555+0000 7f9715bcc640 1 --2- 172.21.15.5:0/3987383865 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f96fc0b4d20 0x7f96fc0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:57.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.555+0000 7f97067fc640 1 -- 172.21.15.5:0/3987383865 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f9708105ff0 con 0x7f971010f7d0 2024-08-31T05:34:57.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.555+0000 7f971e67a740 1 -- 172.21.15.5:0/1502563490 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56529d3732f0 msgr2=0x56529d740000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:57.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.555+0000 7f971e67a740 1 --2- 172.21.15.5:0/1502563490 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56529d3732f0 0x56529d740000 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f970c009c80 tx=0x7f970c010740 comp rx=0 tx=0).stop 2024-08-31T05:34:57.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.555+0000 7f971e67a740 1 -- 172.21.15.5:0/1502563490 shutdown_connections 2024-08-31T05:34:57.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.555+0000 7f971e67a740 1 --2- 172.21.15.5:0/1502563490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56529d37b4d0 0x56529d740540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:57.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.555+0000 7f971e67a740 1 --2- 172.21.15.5:0/1502563490 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56529d3732f0 0x56529d740000 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:57.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.555+0000 7f971e67a740 1 --2- 172.21.15.5:0/1502563490 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56529d39c1b0 0x56529d73fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:57.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.555+0000 7f971e67a740 1 -- 172.21.15.5:0/1502563490 >> 172.21.15.5:0/1502563490 conn(0x56529d390300 msgr2=0x56529d73d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:57.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.556+0000 7f971e67a740 1 -- 172.21.15.5:0/1502563490 shutdown_connections 2024-08-31T05:34:57.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.556+0000 7f9715bcc640 1 --2- 172.21.15.5:0/3987383865 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f96fc0b4d20 0x7f96fc0b7230 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9700005fd0 tx=0x7f9700009660 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:57.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.556+0000 7f971e67a740 1 -- 172.21.15.5:0/1502563490 wait complete. 2024-08-31T05:34:57.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.556+0000 7f971e67a740 1 -- start start 2024-08-31T05:34:57.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.556+0000 7f971e67a740 1 Processor -- start 2024-08-31T05:34:57.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.557+0000 7f971e67a740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56529d3732f0 0x56529d74b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:57.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.557+0000 7f971e67a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56529d37b4d0 0x56529d74bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:57.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.557+0000 7f971e67a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56529d39c1b0 0x56529d751530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:57.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.557+0000 7f971e67a740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56529d5ddab0 con 0x56529d3732f0 2024-08-31T05:34:57.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.557+0000 7f971e67a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56529d62b680 con 0x56529d39c1b0 2024-08-31T05:34:57.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.557+0000 7f971e67a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56529d74e240 con 0x56529d37b4d0 2024-08-31T05:34:57.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.557+0000 7f971e67a740 10 client.0 _ll_register_callbacks cb 0x56529d3b3a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:34:57.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.557+0000 7f9714bca640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56529d37b4d0 0x56529d74bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:57.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.557+0000 7f9715bcc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56529d39c1b0 0x56529d751530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:57.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.557+0000 7f9714bca640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56529d37b4d0 0x56529d74bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:56102/0 (socket says 172.21.15.5:56102) 2024-08-31T05:34:57.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.557+0000 7f9714bca640 1 -- 172.21.15.5:0/433613405 learned_addr learned my addr 172.21.15.5:0/433613405 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:57.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.557+0000 7f97153cb640 1 --2- 172.21.15.5:0/433613405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56529d3732f0 0x56529d74b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:57.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.557+0000 7f9715bcc640 1 -- 172.21.15.5:0/433613405 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56529d37b4d0 msgr2=0x56529d74bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:57.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.557+0000 7f9715bcc640 1 --2- 172.21.15.5:0/433613405 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56529d37b4d0 0x56529d74bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:57.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.557+0000 7f9715bcc640 1 -- 172.21.15.5:0/433613405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56529d3732f0 msgr2=0x56529d74b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:57.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.557+0000 7f9715bcc640 1 --2- 172.21.15.5:0/433613405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56529d3732f0 0x56529d74b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:57.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.557+0000 7f9715bcc640 1 -- 172.21.15.5:0/433613405 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56529d480620 con 0x56529d39c1b0 2024-08-31T05:34:57.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.558+0000 7f9715bcc640 1 --2- 172.21.15.5:0/433613405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56529d39c1b0 0x56529d751530 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f970000fe00 tx=0x7f9700009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f42f9802f08f467a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:57.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.558+0000 7f96f8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:34:57.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.558+0000 7f96f8ff9640 1 -- 172.21.15.5:0/433613405 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9700022070 con 0x56529d39c1b0 2024-08-31T05:34:57.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.558+0000 7f96f8ff9640 1 -- 172.21.15.5:0/433613405 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f9700004220 con 0x56529d39c1b0 2024-08-31T05:34:57.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.558+0000 7f971e67a740 1 -- 172.21.15.5:0/433613405 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f970c0041c0 con 0x56529d39c1b0 2024-08-31T05:34:57.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.558+0000 7f96f8ff9640 1 -- 172.21.15.5:0/433613405 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f970002d050 con 0x56529d39c1b0 2024-08-31T05:34:57.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.558+0000 7f971e67a740 10 client.26522 fetch_fsmap learned FSMap version 34 2024-08-31T05:34:57.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.558+0000 7f971e67a740 1 -- 172.21.15.5:0/433613405 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56529d75a410 con 0x56529d39c1b0 2024-08-31T05:34:57.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.558+0000 7f96f8ff9640 1 -- 172.21.15.5:0/433613405 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f970c0041c0 con 0x56529d39c1b0 2024-08-31T05:34:57.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.558+0000 7f96f8ff9640 1 -- 172.21.15.5:0/433613405 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f970001e4e0 con 0x56529d39c1b0 2024-08-31T05:34:57.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.559+0000 7f971e67a740 10 client.26522 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:34:57.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.559+0000 7f971e67a740 10 client.26522 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:34:57.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.559+0000 7f971e67a740 20 client.26522 populate_metadata read hostname 'smithi005' 2024-08-31T05:34:57.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.559+0000 7f971e67a740 1 --2- 172.21.15.5:0/433613405 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56529d35ad80 0x56529d75d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:57.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.559+0000 7f971e67a740 4 client.26522 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:34:57.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.559+0000 7f971e67a740 1 -- 172.21.15.5:0/433613405 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56529d6b6f50 con 0x56529d35ad80 2024-08-31T05:34:57.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.559+0000 7f97153cb640 1 --2- 172.21.15.5:0/433613405 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56529d35ad80 0x56529d75d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:57.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.559+0000 7f97153cb640 1 --2- 172.21.15.5:0/433613405 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56529d35ad80 0x56529d75d930 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b2069f2ad97bfc9 server_cookie=819899ad0cc2437c in_seq=0 out_seq=0 2024-08-31T05:34:57.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.559+0000 7f96f8ff9640 10 client.26522 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:34:57.566 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.560+0000 7f96f8ff9640 1 -- 172.21.15.5:0/433613405 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56529d6b6f50 con 0x56529d35ad80 2024-08-31T05:34:57.566 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.560+0000 7f96f8ff9640 10 client.26522 handle_command_reply: tid=0 2024-08-31T05:34:57.566 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.560+0000 7f971e67a740 1 client.26522 shutdown 2024-08-31T05:34:57.566 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.560+0000 7f971e67a740 1 -- 172.21.15.5:0/433613405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56529d39c1b0 msgr2=0x56529d751530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:57.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.560+0000 7f971e67a740 1 --2- 172.21.15.5:0/433613405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56529d39c1b0 0x56529d751530 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f970000fe00 tx=0x7f9700009260 comp rx=0 tx=0).stop 2024-08-31T05:34:57.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.560+0000 7f971e67a740 1 -- 172.21.15.5:0/433613405 shutdown_connections 2024-08-31T05:34:57.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.561+0000 7f971e67a740 1 --2- 172.21.15.5:0/433613405 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56529d35ad80 0x56529d75d930 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:57.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.561+0000 7f971e67a740 1 --2- 172.21.15.5:0/433613405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56529d39c1b0 0x56529d751530 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:57.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.561+0000 7f971e67a740 1 --2- 172.21.15.5:0/433613405 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56529d37b4d0 0x56529d74bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:57.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.561+0000 7f971e67a740 1 --2- 172.21.15.5:0/433613405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56529d3732f0 0x56529d74b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:57.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.561+0000 7f971e67a740 1 -- 172.21.15.5:0/433613405 >> 172.21.15.5:0/433613405 conn(0x56529d390300 msgr2=0x56529d740af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:57.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.561+0000 7f96f8ff9640 0 client.26522 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:34:57.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.561+0000 7f971e67a740 1 -- 172.21.15.5:0/433613405 shutdown_connections 2024-08-31T05:34:57.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.561+0000 7f971e67a740 1 -- 172.21.15.5:0/433613405 wait complete. 2024-08-31T05:34:57.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.561+0000 7f971e67a740 20 client.26522 trim_cache size 0 max 16384 2024-08-31T05:34:57.579 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.577+0000 7f971e67a740 1 Processor -- start 2024-08-31T05:34:57.579 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.577+0000 7f971e67a740 1 -- start start 2024-08-31T05:34:57.580 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.577+0000 7f971e67a740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56529d3732f0 0x56529d758330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:57.580 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.577+0000 7f971e67a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56529d37b4d0 0x56529d744bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:57.580 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.577+0000 7f971e67a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56529d39c1b0 0x56529d745130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:57.580 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.577+0000 7f971e67a740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f97101b72d0 con 0x56529d3732f0 2024-08-31T05:34:57.580 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.577+0000 7f971e67a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f97101b8e10 con 0x56529d39c1b0 2024-08-31T05:34:57.580 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.577+0000 7f971e67a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f97101b79a0 con 0x56529d37b4d0 2024-08-31T05:34:57.580 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.577+0000 7f97153cb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56529d3732f0 0x56529d758330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:57.580 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.577+0000 7f97153cb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56529d3732f0 0x56529d758330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55220/0 (socket says 172.21.15.5:55220) 2024-08-31T05:34:57.580 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.577+0000 7f97153cb640 1 -- 172.21.15.5:0/2425781010 learned_addr learned my addr 172.21.15.5:0/2425781010 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:57.580 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.577+0000 7f9715bcc640 1 --2- 172.21.15.5:0/2425781010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56529d39c1b0 0x56529d745130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:57.580 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.577+0000 7f9714bca640 1 --2- 172.21.15.5:0/2425781010 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56529d37b4d0 0x56529d744bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:57.580 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.578+0000 7f97153cb640 1 -- 172.21.15.5:0/2425781010 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56529d37b4d0 msgr2=0x56529d744bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:57.580 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.578+0000 7f97153cb640 1 --2- 172.21.15.5:0/2425781010 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56529d37b4d0 0x56529d744bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:57.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.578+0000 7f97153cb640 1 -- 172.21.15.5:0/2425781010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56529d39c1b0 msgr2=0x56529d745130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:57.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.578+0000 7f97153cb640 1 --2- 172.21.15.5:0/2425781010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56529d39c1b0 0x56529d745130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:57.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.578+0000 7f97153cb640 1 -- 172.21.15.5:0/2425781010 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56529d74b590 con 0x56529d3732f0 2024-08-31T05:34:57.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.578+0000 7f97153cb640 1 --2- 172.21.15.5:0/2425781010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56529d3732f0 0x56529d758330 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f970c010c40 tx=0x7f970c003e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9876f0916f7e667e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:57.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.578+0000 7f96faffd640 1 -- 172.21.15.5:0/2425781010 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f970c009d70 con 0x56529d3732f0 2024-08-31T05:34:57.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.578+0000 7f96faffd640 1 -- 172.21.15.5:0/2425781010 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f970c003e70 con 0x56529d3732f0 2024-08-31T05:34:57.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.578+0000 7f96faffd640 1 -- 172.21.15.5:0/2425781010 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f970c005330 con 0x56529d3732f0 2024-08-31T05:34:57.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.579+0000 7f971e67a740 1 -- 172.21.15.5:0/2425781010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56529d3732f0 msgr2=0x56529d758330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:57.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.579+0000 7f971e67a740 1 --2- 172.21.15.5:0/2425781010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56529d3732f0 0x56529d758330 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f970c010c40 tx=0x7f970c003e00 comp rx=0 tx=0).stop 2024-08-31T05:34:57.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.579+0000 7f971e67a740 1 -- 172.21.15.5:0/2425781010 shutdown_connections 2024-08-31T05:34:57.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.579+0000 7f971e67a740 1 --2- 172.21.15.5:0/2425781010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56529d39c1b0 0x56529d745130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:57.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.579+0000 7f971e67a740 1 --2- 172.21.15.5:0/2425781010 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56529d37b4d0 0x56529d744bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:57.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.579+0000 7f971e67a740 1 --2- 172.21.15.5:0/2425781010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56529d3732f0 0x56529d758330 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:57.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.579+0000 7f971e67a740 1 -- 172.21.15.5:0/2425781010 >> 172.21.15.5:0/2425781010 conn(0x56529d390300 msgr2=0x56529d749dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:57.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.579+0000 7f971e67a740 1 -- 172.21.15.5:0/2425781010 shutdown_connections 2024-08-31T05:34:57.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.579+0000 7f971e67a740 1 -- 172.21.15.5:0/2425781010 wait complete. 2024-08-31T05:34:57.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.579+0000 7f971e67a740 1 -- start start 2024-08-31T05:34:57.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.580+0000 7f971e67a740 1 Processor -- start 2024-08-31T05:34:57.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.580+0000 7f971e67a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56529d3732f0 0x56529d753150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:57.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.580+0000 7f971e67a740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56529d37b4d0 0x56529d7536f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:57.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.580+0000 7f971e67a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56529d39c1b0 0x56529d7c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:57.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.580+0000 7f971e67a740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f97101b8740 con 0x56529d37b4d0 2024-08-31T05:34:57.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.580+0000 7f971e67a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f97101b8070 con 0x56529d39c1b0 2024-08-31T05:34:57.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.580+0000 7f971e67a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f97101b52b0 con 0x56529d3732f0 2024-08-31T05:34:57.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.580+0000 7f971e67a740 10 client.0 _ll_register_callbacks cb 0x7f9700015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:34:57.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.580+0000 7f9714bca640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56529d37b4d0 0x56529d7536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:57.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.580+0000 7f9714bca640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56529d37b4d0 0x56529d7536f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55226/0 (socket says 172.21.15.5:55226) 2024-08-31T05:34:57.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.580+0000 7f9714bca640 1 -- 172.21.15.5:0/792050279 learned_addr learned my addr 172.21.15.5:0/792050279 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:34:57.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.580+0000 7f97153cb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56529d3732f0 0x56529d753150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:57.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.580+0000 7f9715bcc640 1 --2- 172.21.15.5:0/792050279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56529d39c1b0 0x56529d7c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:57.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.581+0000 7f9714bca640 1 -- 172.21.15.5:0/792050279 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56529d3732f0 msgr2=0x56529d753150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:57.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.581+0000 7f9714bca640 1 --2- 172.21.15.5:0/792050279 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56529d3732f0 0x56529d753150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:57.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.581+0000 7f9714bca640 1 -- 172.21.15.5:0/792050279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56529d39c1b0 msgr2=0x56529d7c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:34:57.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.581+0000 7f9714bca640 1 --2- 172.21.15.5:0/792050279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56529d39c1b0 0x56529d7c6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:57.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.581+0000 7f9714bca640 1 -- 172.21.15.5:0/792050279 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56529d7c6960 con 0x56529d37b4d0 2024-08-31T05:34:57.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.581+0000 7f97153cb640 1 --2- 172.21.15.5:0/792050279 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56529d3732f0 0x56529d753150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:34:57.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.581+0000 7f9715bcc640 1 --2- 172.21.15.5:0/792050279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56529d39c1b0 0x56529d7c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:34:57.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.581+0000 7f9714bca640 1 --2- 172.21.15.5:0/792050279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56529d37b4d0 0x56529d7536f0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f9708106290 tx=0x7f97080cbb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cceb3b4b9b600ef server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:34:57.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.581+0000 7f96f8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:34:57.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.581+0000 7f96f8ff9640 1 -- 172.21.15.5:0/792050279 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97081037f0 con 0x56529d37b4d0 2024-08-31T05:34:57.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.581+0000 7f96f8ff9640 1 -- 172.21.15.5:0/792050279 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f97080d5190 con 0x56529d37b4d0 2024-08-31T05:34:57.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.581+0000 7f971e67a740 1 -- 172.21.15.5:0/792050279 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f970c003e70 con 0x56529d37b4d0 2024-08-31T05:34:57.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.581+0000 7f96f8ff9640 1 -- 172.21.15.5:0/792050279 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f97080cca00 con 0x56529d37b4d0 2024-08-31T05:34:57.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.581+0000 7f971e67a740 10 client.16938 fetch_fsmap learned FSMap version 34 2024-08-31T05:34:57.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.581+0000 7f971e67a740 1 -- 172.21.15.5:0/792050279 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56529d7c7c80 con 0x56529d37b4d0 2024-08-31T05:34:57.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.581+0000 7f96f8ff9640 1 -- 172.21.15.5:0/792050279 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f970c003e70 con 0x56529d37b4d0 2024-08-31T05:34:57.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.582+0000 7f96f8ff9640 1 -- 172.21.15.5:0/792050279 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f9708004b40 con 0x56529d37b4d0 2024-08-31T05:34:57.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.582+0000 7f971e67a740 10 client.16938 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:34:57.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.582+0000 7f971e67a740 10 client.16938 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:34:57.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.582+0000 7f971e67a740 20 client.16938 populate_metadata read hostname 'smithi005' 2024-08-31T05:34:57.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.582+0000 7f971e67a740 1 --2- 172.21.15.5:0/792050279 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56529d3301c0 0x56529d7ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:34:57.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.582+0000 7f971e67a740 4 client.16938 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:34:57.589 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.582+0000 7f971e67a740 1 -- 172.21.15.5:0/792050279 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56529d6b29f0 con 0x56529d3301c0 2024-08-31T05:34:57.589 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.582+0000 7f97153cb640 1 --2- 172.21.15.5:0/792050279 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56529d3301c0 0x56529d7ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:34:57.589 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.582+0000 7f97153cb640 1 --2- 172.21.15.5:0/792050279 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56529d3301c0 0x56529d7ca490 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=413e1c9a24985c09 server_cookie=90b4c709561dc539 in_seq=0 out_seq=0 2024-08-31T05:34:57.589 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.582+0000 7f96f8ff9640 10 client.16938 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:34:57.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.592+0000 7f96f8ff9640 1 -- 172.21.15.5:0/792050279 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56529d6b29f0 con 0x56529d3301c0 2024-08-31T05:34:57.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.592+0000 7f96f8ff9640 10 client.16938 handle_command_reply: tid=0 2024-08-31T05:34:57.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.592+0000 7f971e67a740 1 client.16938 shutdown 2024-08-31T05:34:57.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.592+0000 7f971e67a740 1 -- 172.21.15.5:0/792050279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56529d37b4d0 msgr2=0x56529d7536f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:57.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.592+0000 7f971e67a740 1 --2- 172.21.15.5:0/792050279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56529d37b4d0 0x56529d7536f0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f9708106290 tx=0x7f97080cbb30 comp rx=0 tx=0).stop 2024-08-31T05:34:57.596 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.593+0000 7f971e67a740 1 -- 172.21.15.5:0/792050279 shutdown_connections 2024-08-31T05:34:57.596 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.593+0000 7f971e67a740 1 --2- 172.21.15.5:0/792050279 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56529d3301c0 0x56529d7ca490 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:57.596 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.593+0000 7f971e67a740 1 --2- 172.21.15.5:0/792050279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56529d39c1b0 0x56529d7c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:57.596 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.593+0000 7f971e67a740 1 --2- 172.21.15.5:0/792050279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56529d37b4d0 0x56529d7536f0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:57.596 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.593+0000 7f971e67a740 1 --2- 172.21.15.5:0/792050279 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56529d3732f0 0x56529d753150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:57.596 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.593+0000 7f96f8ff9640 0 client.16938 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:34:57.596 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.593+0000 7f971e67a740 1 -- 172.21.15.5:0/792050279 >> 172.21.15.5:0/792050279 conn(0x56529d390300 msgr2=0x56529d744bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:57.596 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.593+0000 7f971e67a740 1 -- 172.21.15.5:0/792050279 shutdown_connections 2024-08-31T05:34:57.596 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.593+0000 7f971e67a740 1 -- 172.21.15.5:0/792050279 wait complete. 2024-08-31T05:34:57.596 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.593+0000 7f971e67a740 20 client.16938 trim_cache size 0 max 16384 2024-08-31T05:34:57.597 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:34:57.597 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:34:57.597 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:34:57.597 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:34:57.598 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.593+0000 7f971762f640 1 -- 172.21.15.5:0/3987383865 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f96fc0b4d20 msgr2=0x7f96fc0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:57.598 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.593+0000 7f971762f640 1 --2- 172.21.15.5:0/3987383865 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f96fc0b4d20 0x7f96fc0b7230 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9700005fd0 tx=0x7f9700009660 comp rx=0 tx=0).stop 2024-08-31T05:34:57.598 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.593+0000 7f971762f640 1 -- 172.21.15.5:0/3987383865 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f971010f7d0 msgr2=0x7f97101a0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:34:57.598 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.593+0000 7f971762f640 1 --2- 172.21.15.5:0/3987383865 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f971010f7d0 0x7f97101a0dc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9708000f80 tx=0x7f9708003ba0 comp rx=0 tx=0).stop 2024-08-31T05:34:57.598 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.594+0000 7f971762f640 1 -- 172.21.15.5:0/3987383865 shutdown_connections 2024-08-31T05:34:57.598 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.594+0000 7f971762f640 1 --2- 172.21.15.5:0/3987383865 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f96fc0b4d20 0x7f96fc0b7230 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:57.598 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.594+0000 7f971762f640 1 --2- 172.21.15.5:0/3987383865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9710110120 0x7f97101a6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:57.598 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.594+0000 7f971762f640 1 --2- 172.21.15.5:0/3987383865 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f971010f7d0 0x7f97101a0dc0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:57.598 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.594+0000 7f971762f640 1 --2- 172.21.15.5:0/3987383865 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9710109ea0 0x7f97101a0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:34:57.598 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.594+0000 7f971762f640 1 -- 172.21.15.5:0/3987383865 >> 172.21.15.5:0/3987383865 conn(0x7f9710079480 msgr2=0x7f971010d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:34:57.598 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.594+0000 7f971762f640 1 -- 172.21.15.5:0/3987383865 shutdown_connections 2024-08-31T05:34:57.599 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:34:57.594+0000 7f971762f640 1 -- 172.21.15.5:0/3987383865 wait complete. 2024-08-31T05:34:57.917 INFO:tasks.workunit.client.0.smithi005.stdout: 1 558372 13.26 MB/sec execute 105 sec latency 135.408 ms 2024-08-31T05:34:58.917 INFO:tasks.workunit.client.0.smithi005.stdout: 1 561337 13.30 MB/sec execute 106 sec latency 18.701 ms 2024-08-31T05:34:58.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:34:58 smithi005 ceph-mon[18602]: pgmap v495: 129 pgs: 129 active+clean; 328 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.4 MiB/s wr, 257 op/s 2024-08-31T05:34:59.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:34:58 smithi070 ceph-mon[22316]: pgmap v495: 129 pgs: 129 active+clean; 328 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.4 MiB/s wr, 257 op/s 2024-08-31T05:34:59.156 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:34:58 smithi050 ceph-mon[22146]: pgmap v495: 129 pgs: 129 active+clean; 328 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.4 MiB/s wr, 257 op/s 2024-08-31T05:34:59.917 INFO:tasks.workunit.client.0.smithi005.stdout: 1 562763 13.24 MB/sec execute 107 sec latency 107.270 ms 2024-08-31T05:35:00.917 INFO:tasks.workunit.client.0.smithi005.stdout: 1 564512 13.20 MB/sec execute 108 sec latency 42.361 ms 2024-08-31T05:35:00.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:35:00 smithi005 ceph-mon[18602]: pgmap v496: 129 pgs: 129 active+clean; 333 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 6.6 MiB/s wr, 323 op/s 2024-08-31T05:35:01.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:35:00 smithi070 ceph-mon[22316]: pgmap v496: 129 pgs: 129 active+clean; 333 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 6.6 MiB/s wr, 323 op/s 2024-08-31T05:35:01.156 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:35:00 smithi050 ceph-mon[22146]: pgmap v496: 129 pgs: 129 active+clean; 333 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 6.6 MiB/s wr, 323 op/s 2024-08-31T05:35:01.917 INFO:tasks.workunit.client.0.smithi005.stdout: 1 566480 13.18 MB/sec execute 109 sec latency 42.564 ms 2024-08-31T05:35:02.917 INFO:tasks.workunit.client.0.smithi005.stdout: 1 568950 13.18 MB/sec execute 110 sec latency 15.269 ms 2024-08-31T05:35:02.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:35:02 smithi005 ceph-mon[18602]: pgmap v497: 129 pgs: 129 active+clean; 333 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.1 MiB/s wr, 250 op/s 2024-08-31T05:35:02.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:35:02 smithi005 ceph-mon[18602]: scrub summary: idle 2024-08-31T05:35:03.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:35:02 smithi070 ceph-mon[22316]: pgmap v497: 129 pgs: 129 active+clean; 333 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.1 MiB/s wr, 250 op/s 2024-08-31T05:35:03.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:35:02 smithi070 ceph-mon[22316]: scrub summary: idle 2024-08-31T05:35:03.156 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:35:02 smithi050 ceph-mon[22146]: pgmap v497: 129 pgs: 129 active+clean; 333 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.1 MiB/s wr, 250 op/s 2024-08-31T05:35:03.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:35:02 smithi050 ceph-mon[22146]: scrub summary: idle 2024-08-31T05:35:03.917 INFO:tasks.workunit.client.0.smithi005.stdout: 1 571868 13.22 MB/sec execute 111 sec latency 15.816 ms 2024-08-31T05:35:03.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:35:03 smithi005 ceph-mon[18602]: scrub summary: idle 2024-08-31T05:35:04.085 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:35:03 smithi070 ceph-mon[22316]: scrub summary: idle 2024-08-31T05:35:04.156 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:35:03 smithi050 ceph-mon[22146]: scrub summary: idle 2024-08-31T05:35:04.917 INFO:tasks.workunit.client.0.smithi005.stdout: 1 573042 13.14 MB/sec execute 112 sec latency 117.125 ms 2024-08-31T05:35:04.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:35:04 smithi005 ceph-mon[18602]: pgmap v498: 129 pgs: 129 active+clean; 335 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.2 MiB/s wr, 269 op/s 2024-08-31T05:35:05.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:35:04 smithi070 ceph-mon[22316]: pgmap v498: 129 pgs: 129 active+clean; 335 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.2 MiB/s wr, 269 op/s 2024-08-31T05:35:05.156 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:35:04 smithi050 ceph-mon[22146]: pgmap v498: 129 pgs: 129 active+clean; 335 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.2 MiB/s wr, 269 op/s 2024-08-31T05:35:05.917 INFO:tasks.workunit.client.0.smithi005.stdout: 1 575960 13.17 MB/sec execute 113 sec latency 7.319 ms 2024-08-31T05:35:06.918 INFO:tasks.workunit.client.0.smithi005.stdout: 1 578630 13.17 MB/sec execute 114 sec latency 31.142 ms 2024-08-31T05:35:06.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:35:06 smithi005 ceph-mon[18602]: pgmap v499: 129 pgs: 129 active+clean; 334 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.5 MiB/s wr, 316 op/s 2024-08-31T05:35:07.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:35:06 smithi070 ceph-mon[22316]: pgmap v499: 129 pgs: 129 active+clean; 334 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.5 MiB/s wr, 316 op/s 2024-08-31T05:35:07.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:35:06 smithi050 ceph-mon[22146]: pgmap v499: 129 pgs: 129 active+clean; 334 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.5 MiB/s wr, 316 op/s 2024-08-31T05:35:07.918 INFO:tasks.workunit.client.0.smithi005.stdout: 1 579571 13.11 MB/sec execute 115 sec latency 498.167 ms 2024-08-31T05:35:08.918 INFO:tasks.workunit.client.0.smithi005.stdout: 1 579571 12.99 MB/sec execute 116 sec latency 1498.280 ms 2024-08-31T05:35:08.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:35:08 smithi005 ceph-mon[18602]: pgmap v500: 129 pgs: 129 active+clean; 334 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.7 MiB/s wr, 283 op/s 2024-08-31T05:35:09.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:35:08 smithi070 ceph-mon[22316]: pgmap v500: 129 pgs: 129 active+clean; 334 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.7 MiB/s wr, 283 op/s 2024-08-31T05:35:09.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:35:08 smithi050 ceph-mon[22146]: pgmap v500: 129 pgs: 129 active+clean; 334 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.7 MiB/s wr, 283 op/s 2024-08-31T05:35:09.918 INFO:tasks.workunit.client.0.smithi005.stdout: 1 579571 12.88 MB/sec execute 117 sec latency 2498.359 ms 2024-08-31T05:35:10.709 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.706+0000 7fa3c5794640 1 -- 172.21.15.5:0/2411242737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3c0104560 msgr2=0x7fa3c0104970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:10.709 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.706+0000 7fa3c5794640 1 --2- 172.21.15.5:0/2411242737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3c0104560 0x7fa3c0104970 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0009900 tx=0x7fa3b002a410 comp rx=0 tx=0).stop 2024-08-31T05:35:10.709 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.706+0000 7fa3c5794640 1 -- 172.21.15.5:0/2411242737 shutdown_connections 2024-08-31T05:35:10.709 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.706+0000 7fa3c5794640 1 --2- 172.21.15.5:0/2411242737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3c010db10 0x7fa3c0110020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:10.709 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.706+0000 7fa3c5794640 1 --2- 172.21.15.5:0/2411242737 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3c0104f90 0x7fa3c010d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:10.709 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.706+0000 7fa3c5794640 1 --2- 172.21.15.5:0/2411242737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3c0104560 0x7fa3c0104970 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:10.709 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.706+0000 7fa3c5794640 1 -- 172.21.15.5:0/2411242737 >> 172.21.15.5:0/2411242737 conn(0x7fa3c007a4b0 msgr2=0x7fa3c007a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:10.709 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.706+0000 7fa3c5794640 1 -- 172.21.15.5:0/2411242737 shutdown_connections 2024-08-31T05:35:10.709 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.706+0000 7fa3c5794640 1 -- 172.21.15.5:0/2411242737 wait complete. 2024-08-31T05:35:10.709 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.707+0000 7fa3c5794640 1 Processor -- start 2024-08-31T05:35:10.711 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.707+0000 7fa3c5794640 1 -- start start 2024-08-31T05:35:10.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.707+0000 7fa3c5794640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3c0104560 0x7fa3c019a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:10.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.707+0000 7fa3c5794640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3c0104f90 0x7fa3c019a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:10.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.708+0000 7fa3c5794640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3c010db10 0x7fa3c019fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:10.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.708+0000 7fa3c5794640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c01137c0 con 0x7fa3c010db10 2024-08-31T05:35:10.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.708+0000 7fa3c5794640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c0113640 con 0x7fa3c0104560 2024-08-31T05:35:10.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.708+0000 7fa3c5794640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c0113940 con 0x7fa3c0104f90 2024-08-31T05:35:10.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.708+0000 7fa3bf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3c010db10 0x7fa3c019fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:10.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.708+0000 7fa3bf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3c010db10 0x7fa3c019fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57070/0 (socket says 172.21.15.5:57070) 2024-08-31T05:35:10.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.708+0000 7fa3bf7fe640 1 -- 172.21.15.5:0/1915730464 learned_addr learned my addr 172.21.15.5:0/1915730464 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:10.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.708+0000 7fa3be7fc640 1 --2- 172.21.15.5:0/1915730464 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3c0104f90 0x7fa3c019a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:10.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.708+0000 7fa3beffd640 1 --2- 172.21.15.5:0/1915730464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3c0104560 0x7fa3c019a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:10.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.708+0000 7fa3bf7fe640 1 -- 172.21.15.5:0/1915730464 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3c0104f90 msgr2=0x7fa3c019a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:10.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.708+0000 7fa3bf7fe640 1 --2- 172.21.15.5:0/1915730464 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3c0104f90 0x7fa3c019a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:10.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.708+0000 7fa3bf7fe640 1 -- 172.21.15.5:0/1915730464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3c0104560 msgr2=0x7fa3c019a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:10.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.708+0000 7fa3bf7fe640 1 --2- 172.21.15.5:0/1915730464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3c0104560 0x7fa3c019a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:10.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.708+0000 7fa3bf7fe640 1 -- 172.21.15.5:0/1915730464 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3c01a0170 con 0x7fa3c010db10 2024-08-31T05:35:10.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.708+0000 7fa3beffd640 1 --2- 172.21.15.5:0/1915730464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3c0104560 0x7fa3c019a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:35:10.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.708+0000 7fa3bf7fe640 1 --2- 172.21.15.5:0/1915730464 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3c010db10 0x7fa3c019fa70 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fa3b800d950 tx=0x7fa3b800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:10.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.708+0000 7fa3a7fff640 1 -- 172.21.15.5:0/1915730464 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b8017030 con 0x7fa3c010db10 2024-08-31T05:35:10.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.708+0000 7fa3c5794640 1 -- 172.21.15.5:0/1915730464 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3c01a0460 con 0x7fa3c010db10 2024-08-31T05:35:10.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.708+0000 7fa3a7fff640 1 -- 172.21.15.5:0/1915730464 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3b8004020 con 0x7fa3c010db10 2024-08-31T05:35:10.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.708+0000 7fa3a7fff640 1 -- 172.21.15.5:0/1915730464 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b8003b50 con 0x7fa3c010db10 2024-08-31T05:35:10.713 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.708+0000 7fa3c5794640 1 -- 172.21.15.5:0/1915730464 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3c01a6bf0 con 0x7fa3c010db10 2024-08-31T05:35:10.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.711+0000 7fa3cc7d2740 1 Processor -- start 2024-08-31T05:35:10.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.711+0000 7fa3a7fff640 1 -- 172.21.15.5:0/1915730464 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fa3b801a070 con 0x7fa3c010db10 2024-08-31T05:35:10.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.711+0000 7fa3cc7d2740 1 -- start start 2024-08-31T05:35:10.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.712+0000 7fa3cc7d2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56328fbae1b0 0x56328ff51ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:10.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.712+0000 7fa3cc7d2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56328fb852f0 0x56328ff52000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:10.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.712+0000 7fa3cc7d2740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56328fb8d4d0 0x56328ff52540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:10.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.712+0000 7fa3cc7d2740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56328fec7000 con 0x56328fb8d4d0 2024-08-31T05:35:10.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.712+0000 7fa3cc7d2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56328feb6590 con 0x56328fbae1b0 2024-08-31T05:35:10.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.712+0000 7fa3cc7d2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56328feba540 con 0x56328fb852f0 2024-08-31T05:35:10.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.712+0000 7fa3be7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56328fb8d4d0 0x56328ff52540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:10.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.712+0000 7fa3be7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56328fb8d4d0 0x56328ff52540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57072/0 (socket says 172.21.15.5:57072) 2024-08-31T05:35:10.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.712+0000 7fa3be7fc640 1 -- 172.21.15.5:0/1971661915 learned_addr learned my addr 172.21.15.5:0/1971661915 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:10.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.712+0000 7fa3be7fc640 1 --2- 172.21.15.5:0/1971661915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56328fbae1b0 0x56328ff51ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:10.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.712+0000 7fa3beffd640 1 --2- 172.21.15.5:0/1971661915 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56328fb852f0 0x56328ff52000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:10.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.712+0000 7fa3be7fc640 1 -- 172.21.15.5:0/1971661915 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56328fb852f0 msgr2=0x56328ff52000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:10.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.712+0000 7fa3be7fc640 1 --2- 172.21.15.5:0/1971661915 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56328fb852f0 0x56328ff52000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:10.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.712+0000 7fa3be7fc640 1 -- 172.21.15.5:0/1971661915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56328fbae1b0 msgr2=0x56328ff51ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:10.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.712+0000 7fa3be7fc640 1 --2- 172.21.15.5:0/1971661915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56328fbae1b0 0x56328ff51ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:10.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.712+0000 7fa3be7fc640 1 -- 172.21.15.5:0/1971661915 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56328fc19790 con 0x56328fb8d4d0 2024-08-31T05:35:10.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.712+0000 7fa3a7fff640 1 --2- 172.21.15.5:0/1915730464 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa3a80b4ca0 0x7fa3a80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:10.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.712+0000 7fa3beffd640 1 --2- 172.21.15.5:0/1971661915 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56328fb852f0 0x56328ff52000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:35:10.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.712+0000 7fa3beffd640 1 --2- 172.21.15.5:0/1915730464 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa3a80b4ca0 0x7fa3a80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:10.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.713+0000 7fa3be7fc640 1 --2- 172.21.15.5:0/1971661915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56328fb8d4d0 0x56328ff52540 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fa3b4012aa0 tx=0x7fa3b4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=719013e10dd39ec5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:10.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.713+0000 7fa3a7fff640 1 -- 172.21.15.5:0/1915730464 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fa3b80e5090 con 0x7fa3c010db10 2024-08-31T05:35:10.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.713+0000 7fa3a57fa640 1 -- 172.21.15.5:0/1971661915 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b4003970 con 0x56328fb8d4d0 2024-08-31T05:35:10.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.713+0000 7fa3a57fa640 1 -- 172.21.15.5:0/1971661915 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3b4010830 con 0x56328fb8d4d0 2024-08-31T05:35:10.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.713+0000 7fa3a57fa640 1 -- 172.21.15.5:0/1971661915 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b4004490 con 0x56328fb8d4d0 2024-08-31T05:35:10.721 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.714+0000 7fa3cc7d2740 1 -- 172.21.15.5:0/1971661915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56328fb8d4d0 msgr2=0x56328ff52540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:10.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.714+0000 7fa3beffd640 1 --2- 172.21.15.5:0/1915730464 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa3a80b4ca0 0x7fa3a80b71b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0000c00 tx=0x7fa3b00058b0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:10.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.714+0000 7fa3cc7d2740 1 --2- 172.21.15.5:0/1971661915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56328fb8d4d0 0x56328ff52540 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fa3b4012aa0 tx=0x7fa3b4004ab0 comp rx=0 tx=0).stop 2024-08-31T05:35:10.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.714+0000 7fa3cc7d2740 1 -- 172.21.15.5:0/1971661915 shutdown_connections 2024-08-31T05:35:10.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.714+0000 7fa3cc7d2740 1 --2- 172.21.15.5:0/1971661915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56328fb8d4d0 0x56328ff52540 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:10.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.714+0000 7fa3cc7d2740 1 --2- 172.21.15.5:0/1971661915 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56328fb852f0 0x56328ff52000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:10.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.714+0000 7fa3cc7d2740 1 --2- 172.21.15.5:0/1971661915 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56328fbae1b0 0x56328ff51ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:10.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.714+0000 7fa3cc7d2740 1 -- 172.21.15.5:0/1971661915 >> 172.21.15.5:0/1971661915 conn(0x56328fba2300 msgr2=0x56328ff4f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:10.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.714+0000 7fa3cc7d2740 1 -- 172.21.15.5:0/1971661915 shutdown_connections 2024-08-31T05:35:10.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.714+0000 7fa3cc7d2740 1 -- 172.21.15.5:0/1971661915 wait complete. 2024-08-31T05:35:10.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.714+0000 7fa3cc7d2740 1 -- start start 2024-08-31T05:35:10.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.714+0000 7fa3cc7d2740 1 Processor -- start 2024-08-31T05:35:10.722 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.715+0000 7fa3cc7d2740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56328fb852f0 0x56328ff5d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:10.723 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.715+0000 7fa3cc7d2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56328fb8d4d0 0x56328ff5db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:10.723 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.715+0000 7fa3cc7d2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56328fbae1b0 0x56328ff69590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:10.723 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.715+0000 7fa3cc7d2740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56328fdefab0 con 0x56328fb852f0 2024-08-31T05:35:10.723 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.715+0000 7fa3cc7d2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56328fe3d680 con 0x56328fb8d4d0 2024-08-31T05:35:10.723 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.715+0000 7fa3cc7d2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56328ff60240 con 0x56328fbae1b0 2024-08-31T05:35:10.723 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.715+0000 7fa3cc7d2740 10 client.0 _ll_register_callbacks cb 0x56328fbc5a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:35:10.723 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.715+0000 7fa3beffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56328fb852f0 0x56328ff5d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:10.723 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.715+0000 7fa3beffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56328fb852f0 0x56328ff5d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57088/0 (socket says 172.21.15.5:57088) 2024-08-31T05:35:10.723 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.715+0000 7fa3beffd640 1 -- 172.21.15.5:0/497341489 learned_addr learned my addr 172.21.15.5:0/497341489 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:10.723 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.715+0000 7fa3be7fc640 1 --2- 172.21.15.5:0/497341489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56328fb8d4d0 0x56328ff5db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:10.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.715+0000 7fa3bf7fe640 1 --2- 172.21.15.5:0/497341489 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56328fbae1b0 0x56328ff69590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:10.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.715+0000 7fa3beffd640 1 -- 172.21.15.5:0/497341489 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56328fbae1b0 msgr2=0x56328ff69590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:10.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.715+0000 7fa3beffd640 1 --2- 172.21.15.5:0/497341489 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56328fbae1b0 0x56328ff69590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:10.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.715+0000 7fa3beffd640 1 -- 172.21.15.5:0/497341489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56328fb8d4d0 msgr2=0x56328ff5db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:10.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.715+0000 7fa3beffd640 1 --2- 172.21.15.5:0/497341489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56328fb8d4d0 0x56328ff5db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:10.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.715+0000 7fa3beffd640 1 -- 172.21.15.5:0/497341489 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56328fc92620 con 0x56328fb852f0 2024-08-31T05:35:10.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.715+0000 7fa3be7fc640 1 --2- 172.21.15.5:0/497341489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56328fb8d4d0 0x56328ff5db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:35:10.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.715+0000 7fa3beffd640 1 --2- 172.21.15.5:0/497341489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56328fb852f0 0x56328ff5d5f0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0032fd0 tx=0x7fa3b0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=329bcc51da97bcea server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:10.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.715+0000 7fa3a2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:35:10.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.715+0000 7fa3a2ff5640 1 -- 172.21.15.5:0/497341489 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b004b030 con 0x56328fb852f0 2024-08-31T05:35:10.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.715+0000 7fa3a2ff5640 1 -- 172.21.15.5:0/497341489 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fa3b0003800 con 0x56328fb852f0 2024-08-31T05:35:10.724 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.715+0000 7fa3cc7d2740 1 -- 172.21.15.5:0/497341489 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3b4010830 con 0x56328fb852f0 2024-08-31T05:35:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.716+0000 7fa3a2ff5640 1 -- 172.21.15.5:0/497341489 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fa3b0058050 con 0x56328fb852f0 2024-08-31T05:35:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.716+0000 7fa3cc7d2740 10 client.16950 fetch_fsmap learned FSMap version 34 2024-08-31T05:35:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.716+0000 7fa3cc7d2740 1 -- 172.21.15.5:0/497341489 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56328ff6c220 con 0x56328fb852f0 2024-08-31T05:35:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.716+0000 7fa3a2ff5640 1 -- 172.21.15.5:0/497341489 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3b4010830 con 0x56328fb852f0 2024-08-31T05:35:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.716+0000 7fa3a2ff5640 1 -- 172.21.15.5:0/497341489 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fa3b0047970 con 0x56328fb852f0 2024-08-31T05:35:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.716+0000 7fa3cc7d2740 10 client.16950 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:35:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.716+0000 7fa3cc7d2740 10 client.16950 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:35:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.716+0000 7fa3cc7d2740 20 client.16950 populate_metadata read hostname 'smithi005' 2024-08-31T05:35:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.716+0000 7fa3cc7d2740 1 --2- 172.21.15.5:0/497341489 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56328fb6cd80 0x56328ff6f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.716+0000 7fa3cc7d2740 4 client.16950 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:35:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.716+0000 7fa3cc7d2740 1 -- 172.21.15.5:0/497341489 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56328fec8f50 con 0x56328fb6cd80 2024-08-31T05:35:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.717+0000 7fa3be7fc640 1 --2- 172.21.15.5:0/497341489 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56328fb6cd80 0x56328ff6f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:10.725 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.717+0000 7fa3a2ff5640 10 client.16950 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:35:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.717+0000 7fa3be7fc640 1 --2- 172.21.15.5:0/497341489 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56328fb6cd80 0x56328ff6f860 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e26de0882dac39b5 server_cookie=d0ac9dfca6c14706 in_seq=0 out_seq=0 2024-08-31T05:35:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.718+0000 7fa3a2ff5640 1 -- 172.21.15.5:0/497341489 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56328fec8f50 con 0x56328fb6cd80 2024-08-31T05:35:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.718+0000 7fa3a2ff5640 10 client.16950 handle_command_reply: tid=0 2024-08-31T05:35:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.718+0000 7fa3cc7d2740 1 client.16950 shutdown 2024-08-31T05:35:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.718+0000 7fa3cc7d2740 1 -- 172.21.15.5:0/497341489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56328fb852f0 msgr2=0x56328ff5d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.718+0000 7fa3cc7d2740 1 --2- 172.21.15.5:0/497341489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56328fb852f0 0x56328ff5d5f0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0032fd0 tx=0x7fa3b0009260 comp rx=0 tx=0).stop 2024-08-31T05:35:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.718+0000 7fa3cc7d2740 1 -- 172.21.15.5:0/497341489 shutdown_connections 2024-08-31T05:35:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.718+0000 7fa3cc7d2740 1 --2- 172.21.15.5:0/497341489 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56328fb6cd80 0x56328ff6f860 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.718+0000 7fa3cc7d2740 1 --2- 172.21.15.5:0/497341489 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56328fbae1b0 0x56328ff69590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.718+0000 7fa3cc7d2740 1 --2- 172.21.15.5:0/497341489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56328fb8d4d0 0x56328ff5db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.718+0000 7fa3a2ff5640 0 client.16950 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:35:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.718+0000 7fa3cc7d2740 1 --2- 172.21.15.5:0/497341489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56328fb852f0 0x56328ff5d5f0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.718+0000 7fa3cc7d2740 1 -- 172.21.15.5:0/497341489 >> 172.21.15.5:0/497341489 conn(0x56328fba2300 msgr2=0x56328ff52af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.718+0000 7fa3cc7d2740 1 -- 172.21.15.5:0/497341489 shutdown_connections 2024-08-31T05:35:10.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.718+0000 7fa3cc7d2740 1 -- 172.21.15.5:0/497341489 wait complete. 2024-08-31T05:35:10.728 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.718+0000 7fa3cc7d2740 20 client.16950 trim_cache size 0 max 16384 2024-08-31T05:35:10.736 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.733+0000 7fa3cc7d2740 1 Processor -- start 2024-08-31T05:35:10.736 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.733+0000 7fa3cc7d2740 1 -- start start 2024-08-31T05:35:10.736 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.733+0000 7fa3cc7d2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56328fb852f0 0x56328ff75020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:10.736 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.733+0000 7fa3cc7d2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56328fb8d4d0 0x56328ff75560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:10.736 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.733+0000 7fa3cc7d2740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56328fbae1b0 0x56328ff654f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:10.736 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.733+0000 7fa3cc7d2740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c01b0b70 con 0x56328fbae1b0 2024-08-31T05:35:10.737 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.733+0000 7fa3cc7d2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c01b26b0 con 0x56328fb8d4d0 2024-08-31T05:35:10.737 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.733+0000 7fa3cc7d2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c01b1240 con 0x56328fb852f0 2024-08-31T05:35:10.737 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.733+0000 7fa3bf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56328fbae1b0 0x56328ff654f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:10.737 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.733+0000 7fa3bf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56328fbae1b0 0x56328ff654f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57094/0 (socket says 172.21.15.5:57094) 2024-08-31T05:35:10.737 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.733+0000 7fa3bf7fe640 1 -- 172.21.15.5:0/459418456 learned_addr learned my addr 172.21.15.5:0/459418456 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:10.737 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.734+0000 7fa3be7fc640 1 --2- 172.21.15.5:0/459418456 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56328fb8d4d0 0x56328ff75560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:10.737 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.734+0000 7fa3beffd640 1 --2- 172.21.15.5:0/459418456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56328fb852f0 0x56328ff75020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:10.737 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.734+0000 7fa3bf7fe640 1 -- 172.21.15.5:0/459418456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56328fb852f0 msgr2=0x56328ff75020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:10.737 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.734+0000 7fa3bf7fe640 1 --2- 172.21.15.5:0/459418456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56328fb852f0 0x56328ff75020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:10.737 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.734+0000 7fa3bf7fe640 1 -- 172.21.15.5:0/459418456 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56328fb8d4d0 msgr2=0x56328ff75560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:10.737 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.734+0000 7fa3bf7fe640 1 --2- 172.21.15.5:0/459418456 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56328fb8d4d0 0x56328ff75560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:10.737 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.734+0000 7fa3bf7fe640 1 -- 172.21.15.5:0/459418456 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56328ff50740 con 0x56328fbae1b0 2024-08-31T05:35:10.737 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.734+0000 7fa3bf7fe640 1 --2- 172.21.15.5:0/459418456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56328fbae1b0 0x56328ff654f0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fa3b80a8670 tx=0x7fa3b80ab300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8381c5896b9c52a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:10.737 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.734+0000 7fa3a4ff9640 1 -- 172.21.15.5:0/459418456 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b80b4070 con 0x56328fbae1b0 2024-08-31T05:35:10.738 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.734+0000 7fa3a4ff9640 1 -- 172.21.15.5:0/459418456 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3b80afc70 con 0x56328fbae1b0 2024-08-31T05:35:10.738 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.734+0000 7fa3a4ff9640 1 -- 172.21.15.5:0/459418456 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b80a7690 con 0x56328fbae1b0 2024-08-31T05:35:10.741 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.735+0000 7fa3cc7d2740 1 -- 172.21.15.5:0/459418456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56328fbae1b0 msgr2=0x56328ff654f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:10.741 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.735+0000 7fa3cc7d2740 1 --2- 172.21.15.5:0/459418456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56328fbae1b0 0x56328ff654f0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fa3b80a8670 tx=0x7fa3b80ab300 comp rx=0 tx=0).stop 2024-08-31T05:35:10.741 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.735+0000 7fa3cc7d2740 1 -- 172.21.15.5:0/459418456 shutdown_connections 2024-08-31T05:35:10.741 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.735+0000 7fa3cc7d2740 1 --2- 172.21.15.5:0/459418456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56328fbae1b0 0x56328ff654f0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:10.741 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.735+0000 7fa3cc7d2740 1 --2- 172.21.15.5:0/459418456 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56328fb8d4d0 0x56328ff75560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:10.741 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.735+0000 7fa3cc7d2740 1 --2- 172.21.15.5:0/459418456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56328fb852f0 0x56328ff75020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:10.741 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.735+0000 7fa3cc7d2740 1 -- 172.21.15.5:0/459418456 >> 172.21.15.5:0/459418456 conn(0x56328fba2300 msgr2=0x56328ff58530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:10.741 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.735+0000 7fa3cc7d2740 1 -- 172.21.15.5:0/459418456 shutdown_connections 2024-08-31T05:35:10.741 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.735+0000 7fa3cc7d2740 1 -- 172.21.15.5:0/459418456 wait complete. 2024-08-31T05:35:10.741 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.735+0000 7fa3cc7d2740 1 -- start start 2024-08-31T05:35:10.741 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.735+0000 7fa3cc7d2740 1 Processor -- start 2024-08-31T05:35:10.742 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.736+0000 7fa3cc7d2740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56328fb852f0 0x56328ff65e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:10.742 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.736+0000 7fa3cc7d2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56328fb8d4d0 0x56328ff63320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:10.742 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.736+0000 7fa3cc7d2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56328fbae1b0 0x56328ff63a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:10.742 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.736+0000 7fa3cc7d2740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c01b1fe0 con 0x56328fb852f0 2024-08-31T05:35:10.742 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.736+0000 7fa3cc7d2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c01b1910 con 0x56328fb8d4d0 2024-08-31T05:35:10.742 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.736+0000 7fa3cc7d2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c01aeb50 con 0x56328fbae1b0 2024-08-31T05:35:10.742 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.736+0000 7fa3cc7d2740 10 client.0 _ll_register_callbacks cb 0x7fa3b0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:35:10.742 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.736+0000 7fa3beffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56328fb852f0 0x56328ff65e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:10.742 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.736+0000 7fa3beffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56328fb852f0 0x56328ff65e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57110/0 (socket says 172.21.15.5:57110) 2024-08-31T05:35:10.742 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.736+0000 7fa3beffd640 1 -- 172.21.15.5:0/4106356979 learned_addr learned my addr 172.21.15.5:0/4106356979 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:10.742 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.736+0000 7fa3bf7fe640 1 --2- 172.21.15.5:0/4106356979 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56328fbae1b0 0x56328ff63a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:10.742 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.736+0000 7fa3be7fc640 1 --2- 172.21.15.5:0/4106356979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56328fb8d4d0 0x56328ff63320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:10.742 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.736+0000 7fa3beffd640 1 -- 172.21.15.5:0/4106356979 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56328fbae1b0 msgr2=0x56328ff63a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:10.742 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.736+0000 7fa3beffd640 1 --2- 172.21.15.5:0/4106356979 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56328fbae1b0 0x56328ff63a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:10.742 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.736+0000 7fa3beffd640 1 -- 172.21.15.5:0/4106356979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56328fb8d4d0 msgr2=0x56328ff63320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:10.743 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.736+0000 7fa3beffd640 1 --2- 172.21.15.5:0/4106356979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56328fb8d4d0 0x56328ff63320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:10.743 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.736+0000 7fa3beffd640 1 -- 172.21.15.5:0/4106356979 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56328ffd9230 con 0x56328fb852f0 2024-08-31T05:35:10.743 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.736+0000 7fa3beffd640 1 --2- 172.21.15.5:0/4106356979 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56328fb852f0 0x56328ff65e60 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0031440 tx=0x7fa3b0003a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5187723ae09c9048 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:10.743 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.736+0000 7fa3a2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:35:10.743 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.737+0000 7fa3a2ff5640 1 -- 172.21.15.5:0/4106356979 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b0060070 con 0x56328fb852f0 2024-08-31T05:35:10.743 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.737+0000 7fa3a2ff5640 1 -- 172.21.15.5:0/4106356979 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fa3b0047440 con 0x56328fb852f0 2024-08-31T05:35:10.743 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.737+0000 7fa3cc7d2740 1 -- 172.21.15.5:0/4106356979 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3b80afc70 con 0x56328fb852f0 2024-08-31T05:35:10.743 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.737+0000 7fa3a2ff5640 1 -- 172.21.15.5:0/4106356979 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fa3b0069050 con 0x56328fb852f0 2024-08-31T05:35:10.743 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.737+0000 7fa3cc7d2740 10 client.16956 fetch_fsmap learned FSMap version 34 2024-08-31T05:35:10.743 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.737+0000 7fa3cc7d2740 1 -- 172.21.15.5:0/4106356979 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56328ffda310 con 0x56328fb852f0 2024-08-31T05:35:10.743 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.737+0000 7fa3a2ff5640 1 -- 172.21.15.5:0/4106356979 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3b80afc70 con 0x56328fb852f0 2024-08-31T05:35:10.743 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.737+0000 7fa3a2ff5640 1 -- 172.21.15.5:0/4106356979 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fa3b0063020 con 0x56328fb852f0 2024-08-31T05:35:10.743 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.737+0000 7fa3cc7d2740 10 client.16956 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:35:10.743 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.737+0000 7fa3cc7d2740 10 client.16956 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:35:10.743 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.737+0000 7fa3cc7d2740 20 client.16956 populate_metadata read hostname 'smithi005' 2024-08-31T05:35:10.744 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.737+0000 7fa3cc7d2740 1 --2- 172.21.15.5:0/4106356979 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56328fb421c0 0x56328ffdcac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:10.744 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.737+0000 7fa3cc7d2740 4 client.16956 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:35:10.744 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.737+0000 7fa3cc7d2740 1 -- 172.21.15.5:0/4106356979 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56328fec49f0 con 0x56328fb421c0 2024-08-31T05:35:10.744 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.738+0000 7fa3be7fc640 1 --2- 172.21.15.5:0/4106356979 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56328fb421c0 0x56328ffdcac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:10.744 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.738+0000 7fa3a2ff5640 10 client.16956 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:35:10.744 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.738+0000 7fa3be7fc640 1 --2- 172.21.15.5:0/4106356979 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56328fb421c0 0x56328ffdcac0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e44325e9d7d32e45 server_cookie=7d3a58578e145a23 in_seq=0 out_seq=0 2024-08-31T05:35:10.753 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.750+0000 7fa3a2ff5640 1 -- 172.21.15.5:0/4106356979 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56328fec49f0 con 0x56328fb421c0 2024-08-31T05:35:10.753 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.750+0000 7fa3a2ff5640 10 client.16956 handle_command_reply: tid=0 2024-08-31T05:35:10.753 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.750+0000 7fa3cc7d2740 1 client.16956 shutdown 2024-08-31T05:35:10.753 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.750+0000 7fa3cc7d2740 1 -- 172.21.15.5:0/4106356979 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56328fb852f0 msgr2=0x56328ff65e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:10.753 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.750+0000 7fa3cc7d2740 1 --2- 172.21.15.5:0/4106356979 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56328fb852f0 0x56328ff65e60 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0031440 tx=0x7fa3b0003a30 comp rx=0 tx=0).stop 2024-08-31T05:35:10.754 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.750+0000 7fa3cc7d2740 1 -- 172.21.15.5:0/4106356979 shutdown_connections 2024-08-31T05:35:10.754 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.750+0000 7fa3cc7d2740 1 --2- 172.21.15.5:0/4106356979 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56328fb421c0 0x56328ffdcac0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:10.754 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.750+0000 7fa3cc7d2740 1 --2- 172.21.15.5:0/4106356979 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56328fbae1b0 0x56328ff63a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:10.754 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.750+0000 7fa3cc7d2740 1 --2- 172.21.15.5:0/4106356979 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56328fb8d4d0 0x56328ff63320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:10.754 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.750+0000 7fa3cc7d2740 1 --2- 172.21.15.5:0/4106356979 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56328fb852f0 0x56328ff65e60 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:10.754 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.750+0000 7fa3a2ff5640 0 client.16956 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:35:10.754 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.750+0000 7fa3cc7d2740 1 -- 172.21.15.5:0/4106356979 >> 172.21.15.5:0/4106356979 conn(0x56328fba2300 msgr2=0x56328ff5e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:10.754 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.751+0000 7fa3cc7d2740 1 -- 172.21.15.5:0/4106356979 shutdown_connections 2024-08-31T05:35:10.754 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.751+0000 7fa3cc7d2740 1 -- 172.21.15.5:0/4106356979 wait complete. 2024-08-31T05:35:10.754 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.751+0000 7fa3cc7d2740 20 client.16956 trim_cache size 0 max 16384 2024-08-31T05:35:10.754 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:35:10.755 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:35:10.755 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:35:10.755 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:35:10.755 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.751+0000 7fa3c5794640 1 -- 172.21.15.5:0/1915730464 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa3a80b4ca0 msgr2=0x7fa3a80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:10.755 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.751+0000 7fa3c5794640 1 --2- 172.21.15.5:0/1915730464 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa3a80b4ca0 0x7fa3a80b71b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0000c00 tx=0x7fa3b00058b0 comp rx=0 tx=0).stop 2024-08-31T05:35:10.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.751+0000 7fa3c5794640 1 -- 172.21.15.5:0/1915730464 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3c010db10 msgr2=0x7fa3c019fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:10.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.751+0000 7fa3c5794640 1 --2- 172.21.15.5:0/1915730464 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3c010db10 0x7fa3c019fa70 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fa3b800d950 tx=0x7fa3b800de10 comp rx=0 tx=0).stop 2024-08-31T05:35:10.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.751+0000 7fa3c5794640 1 -- 172.21.15.5:0/1915730464 shutdown_connections 2024-08-31T05:35:10.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.751+0000 7fa3c5794640 1 --2- 172.21.15.5:0/1915730464 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa3a80b4ca0 0x7fa3a80b71b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:10.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.751+0000 7fa3c5794640 1 --2- 172.21.15.5:0/1915730464 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3c010db10 0x7fa3c019fa70 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:10.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.751+0000 7fa3c5794640 1 --2- 172.21.15.5:0/1915730464 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3c0104f90 0x7fa3c019a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:10.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.751+0000 7fa3c5794640 1 --2- 172.21.15.5:0/1915730464 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3c0104560 0x7fa3c019a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:10.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.751+0000 7fa3c5794640 1 -- 172.21.15.5:0/1915730464 >> 172.21.15.5:0/1915730464 conn(0x7fa3c007a4b0 msgr2=0x7fa3c0100580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:10.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.751+0000 7fa3c5794640 1 -- 172.21.15.5:0/1915730464 shutdown_connections 2024-08-31T05:35:10.756 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:10.751+0000 7fa3c5794640 1 -- 172.21.15.5:0/1915730464 wait complete. 2024-08-31T05:35:10.918 INFO:tasks.workunit.client.0.smithi005.stdout: 1 579571 12.77 MB/sec execute 118 sec latency 3498.442 ms 2024-08-31T05:35:11.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:35:10 smithi070 ceph-mon[22316]: pgmap v501: 129 pgs: 129 active+clean; 338 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.2 MiB/s wr, 298 op/s 2024-08-31T05:35:11.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:35:10 smithi050 ceph-mon[22146]: pgmap v501: 129 pgs: 129 active+clean; 338 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.2 MiB/s wr, 298 op/s 2024-08-31T05:35:11.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:35:10 smithi005 ceph-mon[18602]: pgmap v501: 129 pgs: 129 active+clean; 338 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.2 MiB/s wr, 298 op/s 2024-08-31T05:35:11.918 INFO:tasks.workunit.client.0.smithi005.stdout: 1 579571 12.67 MB/sec execute 119 sec latency 4498.555 ms 2024-08-31T05:35:12.918 INFO:tasks.workunit.client.0.smithi005.stdout: 1 579571 12.56 MB/sec execute 120 sec latency 5498.646 ms 2024-08-31T05:35:13.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:35:12 smithi070 ceph-mon[22316]: pgmap v502: 129 pgs: 129 active+clean; 339 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 232 op/s 2024-08-31T05:35:13.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:35:12 smithi050 ceph-mon[22146]: pgmap v502: 129 pgs: 129 active+clean; 339 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 232 op/s 2024-08-31T05:35:13.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:35:12 smithi005 ceph-mon[18602]: pgmap v502: 129 pgs: 129 active+clean; 339 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 232 op/s 2024-08-31T05:35:13.918 INFO:tasks.workunit.client.0.smithi005.stdout: 1 579571 12.46 MB/sec execute 121 sec latency 6498.773 ms 2024-08-31T05:35:14.918 INFO:tasks.workunit.client.0.smithi005.stdout: 1 579571 12.36 MB/sec execute 122 sec latency 7498.874 ms 2024-08-31T05:35:15.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:35:14 smithi070 ceph-mon[22316]: pgmap v503: 129 pgs: 129 active+clean; 339 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.0 MiB/s wr, 229 op/s 2024-08-31T05:35:15.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:35:14 smithi050 ceph-mon[22146]: pgmap v503: 129 pgs: 129 active+clean; 339 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.0 MiB/s wr, 229 op/s 2024-08-31T05:35:15.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:35:14 smithi005 ceph-mon[18602]: pgmap v503: 129 pgs: 129 active+clean; 339 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.0 MiB/s wr, 229 op/s 2024-08-31T05:35:15.920 INFO:tasks.workunit.client.0.smithi005.stdout: 1 579571 12.25 MB/sec execute 123 sec latency 8498.961 ms 2024-08-31T05:35:16.919 INFO:tasks.workunit.client.0.smithi005.stdout: 1 579571 12.16 MB/sec execute 124 sec latency 9499.094 ms 2024-08-31T05:35:17.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:35:16 smithi070 ceph-mon[22316]: pgmap v504: 129 pgs: 129 active+clean; 338 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.4 MiB/s wr, 218 op/s 2024-08-31T05:35:17.156 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:35:16 smithi050 ceph-mon[22146]: pgmap v504: 129 pgs: 129 active+clean; 338 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.4 MiB/s wr, 218 op/s 2024-08-31T05:35:17.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:35:16 smithi005 ceph-mon[18602]: pgmap v504: 129 pgs: 129 active+clean; 338 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.4 MiB/s wr, 218 op/s 2024-08-31T05:35:17.918 INFO:tasks.workunit.client.0.smithi005.stdout: 1 581118 12.10 MB/sec execute 125 sec latency 9687.962 ms 2024-08-31T05:35:18.919 INFO:tasks.workunit.client.0.smithi005.stdout: 1 583410 12.12 MB/sec execute 126 sec latency 11.611 ms 2024-08-31T05:35:19.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:35:18 smithi070 ceph-mon[22316]: pgmap v505: 129 pgs: 129 active+clean; 338 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.4 MiB/s wr, 140 op/s 2024-08-31T05:35:19.156 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:35:18 smithi050 ceph-mon[22146]: pgmap v505: 129 pgs: 129 active+clean; 338 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.4 MiB/s wr, 140 op/s 2024-08-31T05:35:19.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:35:18 smithi005 ceph-mon[18602]: pgmap v505: 129 pgs: 129 active+clean; 338 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.4 MiB/s wr, 140 op/s 2024-08-31T05:35:19.919 INFO:tasks.workunit.client.0.smithi005.stdout: 1 585527 12.12 MB/sec execute 127 sec latency 162.897 ms 2024-08-31T05:35:20.919 INFO:tasks.workunit.client.0.smithi005.stdout: 1 587319 12.09 MB/sec execute 128 sec latency 33.574 ms 2024-08-31T05:35:21.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:35:20 smithi070 ceph-mon[22316]: pgmap v506: 129 pgs: 129 active+clean; 335 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.0 MiB/s wr, 171 op/s 2024-08-31T05:35:21.156 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:35:20 smithi050 ceph-mon[22146]: pgmap v506: 129 pgs: 129 active+clean; 335 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.0 MiB/s wr, 171 op/s 2024-08-31T05:35:21.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:35:20 smithi005 ceph-mon[18602]: pgmap v506: 129 pgs: 129 active+clean; 335 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.0 MiB/s wr, 171 op/s 2024-08-31T05:35:21.919 INFO:tasks.workunit.client.0.smithi005.stdout: 1 589896 12.13 MB/sec execute 129 sec latency 14.049 ms 2024-08-31T05:35:22.919 INFO:tasks.workunit.client.0.smithi005.stdout: 1 591713 12.08 MB/sec execute 130 sec latency 17.043 ms 2024-08-31T05:35:23.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:35:22 smithi070 ceph-mon[22316]: pgmap v507: 129 pgs: 129 active+clean; 337 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 2.1 MiB/s wr, 108 op/s 2024-08-31T05:35:23.156 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:35:22 smithi050 ceph-mon[22146]: pgmap v507: 129 pgs: 129 active+clean; 337 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 2.1 MiB/s wr, 108 op/s 2024-08-31T05:35:23.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:35:22 smithi005 ceph-mon[18602]: pgmap v507: 129 pgs: 129 active+clean; 337 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 2.1 MiB/s wr, 108 op/s 2024-08-31T05:35:23.855 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.851+0000 7f208972b640 1 -- 172.21.15.5:0/421626819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20841080b0 msgr2=0x7f20841084c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:23.855 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.851+0000 7f208972b640 1 --2- 172.21.15.5:0/421626819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20841080b0 0x7f20841084c0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f206c009900 tx=0x7f206c02a410 comp rx=0 tx=0).stop 2024-08-31T05:35:23.855 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.851+0000 7f208972b640 1 -- 172.21.15.5:0/421626819 shutdown_connections 2024-08-31T05:35:23.855 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.851+0000 7f208972b640 1 --2- 172.21.15.5:0/421626819 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2084108a00 0x7f208410f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:23.855 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.851+0000 7f208972b640 1 --2- 172.21.15.5:0/421626819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20841080b0 0x7f20841084c0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:23.855 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.851+0000 7f208972b640 1 --2- 172.21.15.5:0/421626819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2084102780 0x7f2084102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:23.856 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.851+0000 7f208972b640 1 -- 172.21.15.5:0/421626819 >> 172.21.15.5:0/421626819 conn(0x7f20840fe180 msgr2=0x7f20841005d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:23.856 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.851+0000 7f208972b640 1 -- 172.21.15.5:0/421626819 shutdown_connections 2024-08-31T05:35:23.856 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.851+0000 7f208972b640 1 -- 172.21.15.5:0/421626819 wait complete. 2024-08-31T05:35:23.856 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.851+0000 7f208972b640 1 Processor -- start 2024-08-31T05:35:23.856 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.852+0000 7f208972b640 1 -- start start 2024-08-31T05:35:23.856 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.852+0000 7f208972b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2084102780 0x7f208419b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:23.856 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.852+0000 7f208972b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20841080b0 0x7f208419b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:23.856 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.852+0000 7f208972b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2084108a00 0x7f208419ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:23.856 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.852+0000 7f208972b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2084112690 con 0x7f20841080b0 2024-08-31T05:35:23.856 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.852+0000 7f208972b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2084112510 con 0x7f2084108a00 2024-08-31T05:35:23.856 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.852+0000 7f208972b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2084112810 con 0x7f2084102780 2024-08-31T05:35:23.856 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.852+0000 7f207bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20841080b0 0x7f208419b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:23.857 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.852+0000 7f207bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20841080b0 0x7f208419b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47548/0 (socket says 172.21.15.5:47548) 2024-08-31T05:35:23.857 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.852+0000 7f207bfff640 1 -- 172.21.15.5:0/177129014 learned_addr learned my addr 172.21.15.5:0/177129014 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:23.857 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.852+0000 7f2082ffd640 1 --2- 172.21.15.5:0/177129014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2084102780 0x7f208419b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:23.857 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.852+0000 7f20837fe640 1 --2- 172.21.15.5:0/177129014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2084108a00 0x7f208419ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:23.857 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.852+0000 7f207bfff640 1 -- 172.21.15.5:0/177129014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2084102780 msgr2=0x7f208419b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:23.857 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.852+0000 7f207bfff640 1 --2- 172.21.15.5:0/177129014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2084102780 0x7f208419b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:23.857 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.852+0000 7f207bfff640 1 -- 172.21.15.5:0/177129014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2084108a00 msgr2=0x7f208419ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:23.857 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.852+0000 7f207bfff640 1 --2- 172.21.15.5:0/177129014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2084108a00 0x7f208419ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:23.857 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.852+0000 7f207bfff640 1 -- 172.21.15.5:0/177129014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20841a62c0 con 0x7f20841080b0 2024-08-31T05:35:23.857 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.852+0000 7f207bfff640 1 --2- 172.21.15.5:0/177129014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20841080b0 0x7f208419b540 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f206c02a930 tx=0x7f206c031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:23.857 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.853+0000 7f2080ff9640 1 -- 172.21.15.5:0/177129014 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f206c03f030 con 0x7f20841080b0 2024-08-31T05:35:23.857 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.853+0000 7f2080ff9640 1 -- 172.21.15.5:0/177129014 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f206c004490 con 0x7f20841080b0 2024-08-31T05:35:23.857 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.853+0000 7f2080ff9640 1 -- 172.21.15.5:0/177129014 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f206c035070 con 0x7f20841080b0 2024-08-31T05:35:23.858 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.853+0000 7f208972b640 1 -- 172.21.15.5:0/177129014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20841a6550 con 0x7f20841080b0 2024-08-31T05:35:23.858 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.853+0000 7f208972b640 1 -- 172.21.15.5:0/177129014 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20841a6a90 con 0x7f20841080b0 2024-08-31T05:35:23.863 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.855+0000 7f209069a740 1 Processor -- start 2024-08-31T05:35:23.863 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.855+0000 7f209069a740 1 -- start start 2024-08-31T05:35:23.863 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.855+0000 7f2080ff9640 1 -- 172.21.15.5:0/177129014 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f206c042030 con 0x7f20841080b0 2024-08-31T05:35:23.864 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.856+0000 7f209069a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5e2ee01b0 0x55b5e3283ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:23.864 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.856+0000 7f209069a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5e2eb72f0 0x55b5e3284000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:23.864 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.856+0000 7f209069a740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b5e2ebf4d0 0x55b5e3284540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:23.864 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.856+0000 7f209069a740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55b5e31f9000 con 0x55b5e2ebf4d0 2024-08-31T05:35:23.864 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.856+0000 7f209069a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b5e31e8590 con 0x55b5e2ee01b0 2024-08-31T05:35:23.864 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.856+0000 7f209069a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b5e31ec540 con 0x55b5e2eb72f0 2024-08-31T05:35:23.864 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.856+0000 7f2082ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5e2eb72f0 0x55b5e3284000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:23.864 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.856+0000 7f207bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b5e2ebf4d0 0x55b5e3284540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:23.864 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.856+0000 7f20837fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5e2ee01b0 0x55b5e3283ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:23.864 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.856+0000 7f2082ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5e2eb72f0 0x55b5e3284000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:52298/0 (socket says 172.21.15.5:52298) 2024-08-31T05:35:23.864 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.856+0000 7f2082ffd640 1 -- 172.21.15.5:0/3781046740 learned_addr learned my addr 172.21.15.5:0/3781046740 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:23.864 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.856+0000 7f2082ffd640 1 -- 172.21.15.5:0/3781046740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5e2ee01b0 msgr2=0x55b5e3283ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:23.865 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.856+0000 7f2082ffd640 1 --2- 172.21.15.5:0/3781046740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5e2ee01b0 0x55b5e3283ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:23.865 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.856+0000 7f2082ffd640 1 -- 172.21.15.5:0/3781046740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b5e2ebf4d0 msgr2=0x55b5e3284540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:23.865 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.856+0000 7f2082ffd640 1 --2- 172.21.15.5:0/3781046740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b5e2ebf4d0 0x55b5e3284540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:23.865 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.856+0000 7f2082ffd640 1 -- 172.21.15.5:0/3781046740 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5e2f4b790 con 0x55b5e2eb72f0 2024-08-31T05:35:23.865 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.856+0000 7f20837fe640 1 --2- 172.21.15.5:0/3781046740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5e2ee01b0 0x55b5e3283ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:35:23.865 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.856+0000 7f2082ffd640 1 --2- 172.21.15.5:0/3781046740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5e2eb72f0 0x55b5e3284000 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2074009cc0 tx=0x7f2074011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f3f29d09aa9d42f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:23.865 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.856+0000 7f2080ff9640 1 --2- 172.21.15.5:0/177129014 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f20700b4d20 0x7f20700b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:23.865 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.856+0000 7f20797fa640 1 -- 172.21.15.5:0/3781046740 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2074005220 con 0x55b5e2eb72f0 2024-08-31T05:35:23.865 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.857+0000 7f20797fa640 1 -- 172.21.15.5:0/3781046740 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2074004c50 con 0x55b5e2eb72f0 2024-08-31T05:35:23.865 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.857+0000 7f20797fa640 1 -- 172.21.15.5:0/3781046740 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2074019720 con 0x55b5e2eb72f0 2024-08-31T05:35:23.865 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.857+0000 7f20837fe640 1 --2- 172.21.15.5:0/177129014 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f20700b4d20 0x7f20700b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:23.865 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.857+0000 7f2080ff9640 1 -- 172.21.15.5:0/177129014 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f206c105bf0 con 0x7f20841080b0 2024-08-31T05:35:23.865 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.857+0000 7f209069a740 1 -- 172.21.15.5:0/3781046740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5e2eb72f0 msgr2=0x55b5e3284000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:23.865 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.857+0000 7f20837fe640 1 --2- 172.21.15.5:0/177129014 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f20700b4d20 0x7f20700b7230 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f207c005fd0 tx=0x7f207c009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:23.866 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.857+0000 7f209069a740 1 --2- 172.21.15.5:0/3781046740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5e2eb72f0 0x55b5e3284000 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2074009cc0 tx=0x7f2074011810 comp rx=0 tx=0).stop 2024-08-31T05:35:23.866 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.858+0000 7f209069a740 1 -- 172.21.15.5:0/3781046740 shutdown_connections 2024-08-31T05:35:23.866 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.858+0000 7f209069a740 1 --2- 172.21.15.5:0/3781046740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b5e2ebf4d0 0x55b5e3284540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:23.866 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.858+0000 7f209069a740 1 --2- 172.21.15.5:0/3781046740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5e2eb72f0 0x55b5e3284000 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:23.866 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.858+0000 7f209069a740 1 --2- 172.21.15.5:0/3781046740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5e2ee01b0 0x55b5e3283ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:23.866 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.858+0000 7f209069a740 1 -- 172.21.15.5:0/3781046740 >> 172.21.15.5:0/3781046740 conn(0x55b5e2ed4300 msgr2=0x55b5e32819b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:23.866 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.858+0000 7f209069a740 1 -- 172.21.15.5:0/3781046740 shutdown_connections 2024-08-31T05:35:23.866 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.858+0000 7f209069a740 1 -- 172.21.15.5:0/3781046740 wait complete. 2024-08-31T05:35:23.866 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.858+0000 7f209069a740 1 -- start start 2024-08-31T05:35:23.866 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.858+0000 7f209069a740 1 Processor -- start 2024-08-31T05:35:23.866 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.858+0000 7f209069a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5e2eb72f0 0x55b5e328f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:23.866 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.858+0000 7f209069a740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b5e2ebf4d0 0x55b5e328fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:23.866 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.858+0000 7f209069a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5e2ee01b0 0x55b5e329b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:23.867 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.858+0000 7f209069a740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55b5e3121ab0 con 0x55b5e2ebf4d0 2024-08-31T05:35:23.867 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.858+0000 7f209069a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55b5e316f680 con 0x55b5e2ee01b0 2024-08-31T05:35:23.867 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.858+0000 7f209069a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b5e3292240 con 0x55b5e2eb72f0 2024-08-31T05:35:23.867 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.858+0000 7f209069a740 10 client.0 _ll_register_callbacks cb 0x55b5e2ef7a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:35:23.867 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.858+0000 7f207bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b5e2ebf4d0 0x55b5e328fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:23.867 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.858+0000 7f207bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b5e2ebf4d0 0x55b5e328fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47558/0 (socket says 172.21.15.5:47558) 2024-08-31T05:35:23.867 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.858+0000 7f207bfff640 1 -- 172.21.15.5:0/4177637521 learned_addr learned my addr 172.21.15.5:0/4177637521 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:23.867 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.858+0000 7f2082ffd640 1 --2- 172.21.15.5:0/4177637521 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5e2eb72f0 0x55b5e328f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:23.867 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.858+0000 7f20837fe640 1 --2- 172.21.15.5:0/4177637521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5e2ee01b0 0x55b5e329b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:23.867 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.859+0000 7f207bfff640 1 -- 172.21.15.5:0/4177637521 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5e2eb72f0 msgr2=0x55b5e328f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:23.867 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.859+0000 7f207bfff640 1 --2- 172.21.15.5:0/4177637521 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5e2eb72f0 0x55b5e328f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:23.867 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.859+0000 7f207bfff640 1 -- 172.21.15.5:0/4177637521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5e2ee01b0 msgr2=0x55b5e329b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:23.867 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.859+0000 7f207bfff640 1 --2- 172.21.15.5:0/4177637521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5e2ee01b0 0x55b5e329b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:23.868 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.859+0000 7f207bfff640 1 -- 172.21.15.5:0/4177637521 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5e2fc4620 con 0x55b5e2ebf4d0 2024-08-31T05:35:23.868 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.859+0000 7f2082ffd640 1 --2- 172.21.15.5:0/4177637521 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5e2eb72f0 0x55b5e328f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:35:23.868 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.859+0000 7f207bfff640 1 --2- 172.21.15.5:0/4177637521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b5e2ebf4d0 0x55b5e328fb70 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f206c103020 tx=0x7f206c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8060e56eb16f408 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:23.868 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.859+0000 7f206a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:35:23.868 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.859+0000 7f206a7fc640 1 -- 172.21.15.5:0/4177637521 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f206c049070 con 0x55b5e2ebf4d0 2024-08-31T05:35:23.868 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.859+0000 7f206a7fc640 1 -- 172.21.15.5:0/4177637521 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f206c0cc1c0 con 0x55b5e2ebf4d0 2024-08-31T05:35:23.868 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.859+0000 7f209069a740 1 -- 172.21.15.5:0/4177637521 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2074004c50 con 0x55b5e2ebf4d0 2024-08-31T05:35:23.868 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.859+0000 7f206a7fc640 1 -- 172.21.15.5:0/4177637521 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f206c0cbd30 con 0x55b5e2ebf4d0 2024-08-31T05:35:23.868 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.859+0000 7f209069a740 10 client.16968 fetch_fsmap learned FSMap version 34 2024-08-31T05:35:23.868 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.859+0000 7f209069a740 1 -- 172.21.15.5:0/4177637521 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55b5e329e290 con 0x55b5e2ebf4d0 2024-08-31T05:35:23.868 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.859+0000 7f206a7fc640 1 -- 172.21.15.5:0/4177637521 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2074004c50 con 0x55b5e2ebf4d0 2024-08-31T05:35:23.868 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.860+0000 7f206a7fc640 1 -- 172.21.15.5:0/4177637521 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f206c0d03b0 con 0x55b5e2ebf4d0 2024-08-31T05:35:23.868 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.860+0000 7f209069a740 10 client.16968 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:35:23.869 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.860+0000 7f209069a740 10 client.16968 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:35:23.869 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.860+0000 7f209069a740 20 client.16968 populate_metadata read hostname 'smithi005' 2024-08-31T05:35:23.869 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.860+0000 7f209069a740 1 --2- 172.21.15.5:0/4177637521 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55b5e2e9ed80 0x55b5e32a1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:23.869 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.860+0000 7f209069a740 4 client.16968 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:35:23.869 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.860+0000 7f209069a740 1 -- 172.21.15.5:0/4177637521 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b5e31faf50 con 0x55b5e2e9ed80 2024-08-31T05:35:23.869 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.860+0000 7f2082ffd640 1 --2- 172.21.15.5:0/4177637521 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55b5e2e9ed80 0x55b5e32a1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:23.869 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.860+0000 7f2082ffd640 1 --2- 172.21.15.5:0/4177637521 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55b5e2e9ed80 0x55b5e32a1800 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6b7905d5ff2ae34 server_cookie=d122a779afbafca1 in_seq=0 out_seq=0 2024-08-31T05:35:23.869 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.860+0000 7f206a7fc640 10 client.16968 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:35:23.869 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.861+0000 7f206a7fc640 1 -- 172.21.15.5:0/4177637521 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b5e31faf50 con 0x55b5e2e9ed80 2024-08-31T05:35:23.869 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.861+0000 7f206a7fc640 10 client.16968 handle_command_reply: tid=0 2024-08-31T05:35:23.869 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.861+0000 7f209069a740 1 client.16968 shutdown 2024-08-31T05:35:23.869 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.861+0000 7f209069a740 1 -- 172.21.15.5:0/4177637521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b5e2ebf4d0 msgr2=0x55b5e328fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:23.869 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.861+0000 7f209069a740 1 --2- 172.21.15.5:0/4177637521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b5e2ebf4d0 0x55b5e328fb70 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f206c103020 tx=0x7f206c009260 comp rx=0 tx=0).stop 2024-08-31T05:35:23.869 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.861+0000 7f209069a740 1 -- 172.21.15.5:0/4177637521 shutdown_connections 2024-08-31T05:35:23.870 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.861+0000 7f209069a740 1 --2- 172.21.15.5:0/4177637521 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55b5e2e9ed80 0x55b5e32a1800 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:23.870 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.861+0000 7f209069a740 1 --2- 172.21.15.5:0/4177637521 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5e2ee01b0 0x55b5e329b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:23.870 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.861+0000 7f209069a740 1 --2- 172.21.15.5:0/4177637521 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b5e2ebf4d0 0x55b5e328fb70 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:23.870 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.861+0000 7f206a7fc640 0 client.16968 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:35:23.870 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.861+0000 7f209069a740 1 --2- 172.21.15.5:0/4177637521 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5e2eb72f0 0x55b5e328f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:23.870 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.861+0000 7f209069a740 1 -- 172.21.15.5:0/4177637521 >> 172.21.15.5:0/4177637521 conn(0x55b5e2ed4300 msgr2=0x55b5e3284af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:23.870 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.861+0000 7f209069a740 1 -- 172.21.15.5:0/4177637521 shutdown_connections 2024-08-31T05:35:23.870 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.861+0000 7f209069a740 1 -- 172.21.15.5:0/4177637521 wait complete. 2024-08-31T05:35:23.870 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.861+0000 7f209069a740 20 client.16968 trim_cache size 0 max 16384 2024-08-31T05:35:23.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.877+0000 7f209069a740 1 Processor -- start 2024-08-31T05:35:23.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.877+0000 7f209069a740 1 -- start start 2024-08-31T05:35:23.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.878+0000 7f209069a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5e2e9ed80 0x55b5e3288b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:23.881 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.878+0000 7f209069a740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b5e2eb72f0 0x55b5e32890c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:23.881 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.878+0000 7f209069a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5e2ebf4d0 0x55b5e328e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:23.881 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.878+0000 7f209069a740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f20841b0bc0 con 0x55b5e2eb72f0 2024-08-31T05:35:23.881 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.878+0000 7f209069a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f20841b2700 con 0x55b5e2e9ed80 2024-08-31T05:35:23.881 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.878+0000 7f209069a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f20841b1290 con 0x55b5e2ebf4d0 2024-08-31T05:35:23.881 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.878+0000 7f207bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b5e2eb72f0 0x55b5e32890c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:23.881 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.878+0000 7f207bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b5e2eb72f0 0x55b5e32890c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47568/0 (socket says 172.21.15.5:47568) 2024-08-31T05:35:23.881 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.878+0000 7f207bfff640 1 -- 172.21.15.5:0/4297167 learned_addr learned my addr 172.21.15.5:0/4297167 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:23.881 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.878+0000 7f2082ffd640 1 --2- 172.21.15.5:0/4297167 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5e2e9ed80 0x55b5e3288b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:23.881 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.878+0000 7f20837fe640 1 --2- 172.21.15.5:0/4297167 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5e2ebf4d0 0x55b5e328e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:23.881 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.878+0000 7f2082ffd640 1 -- 172.21.15.5:0/4297167 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5e2ebf4d0 msgr2=0x55b5e328e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:23.881 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.878+0000 7f2082ffd640 1 --2- 172.21.15.5:0/4297167 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5e2ebf4d0 0x55b5e328e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:23.881 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.878+0000 7f2082ffd640 1 -- 172.21.15.5:0/4297167 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b5e2eb72f0 msgr2=0x55b5e32890c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:23.882 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.878+0000 7f2082ffd640 1 --2- 172.21.15.5:0/4297167 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b5e2eb72f0 0x55b5e32890c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:23.882 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.878+0000 7f2082ffd640 1 -- 172.21.15.5:0/4297167 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5e32906e0 con 0x55b5e2e9ed80 2024-08-31T05:35:23.882 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.878+0000 7f207bfff640 1 --2- 172.21.15.5:0/4297167 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b5e2eb72f0 0x55b5e32890c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:35:23.882 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.878+0000 7f2082ffd640 1 --2- 172.21.15.5:0/4297167 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5e2e9ed80 0x55b5e3288b80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f207401b040 tx=0x7f2074009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8c59c250808dc6a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:23.882 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.878+0000 7f2078ff9640 1 -- 172.21.15.5:0/4297167 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20740042a0 con 0x55b5e2e9ed80 2024-08-31T05:35:23.882 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.879+0000 7f2078ff9640 1 -- 172.21.15.5:0/4297167 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2074004440 con 0x55b5e2e9ed80 2024-08-31T05:35:23.882 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.879+0000 7f2078ff9640 1 -- 172.21.15.5:0/4297167 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2074003da0 con 0x55b5e2e9ed80 2024-08-31T05:35:23.885 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.879+0000 7f209069a740 1 -- 172.21.15.5:0/4297167 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5e2e9ed80 msgr2=0x55b5e3288b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:23.885 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.879+0000 7f209069a740 1 --2- 172.21.15.5:0/4297167 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5e2e9ed80 0x55b5e3288b80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f207401b040 tx=0x7f2074009310 comp rx=0 tx=0).stop 2024-08-31T05:35:23.885 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.879+0000 7f209069a740 1 -- 172.21.15.5:0/4297167 shutdown_connections 2024-08-31T05:35:23.886 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.879+0000 7f209069a740 1 --2- 172.21.15.5:0/4297167 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5e2ebf4d0 0x55b5e328e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:23.886 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.879+0000 7f209069a740 1 --2- 172.21.15.5:0/4297167 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b5e2eb72f0 0x55b5e32890c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:23.886 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.879+0000 7f209069a740 1 --2- 172.21.15.5:0/4297167 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5e2e9ed80 0x55b5e3288b80 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:23.886 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.879+0000 7f209069a740 1 -- 172.21.15.5:0/4297167 >> 172.21.15.5:0/4297167 conn(0x55b5e2ed4300 msgr2=0x55b5e328dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:23.886 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.879+0000 7f209069a740 1 -- 172.21.15.5:0/4297167 shutdown_connections 2024-08-31T05:35:23.886 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.880+0000 7f209069a740 1 -- 172.21.15.5:0/4297167 wait complete. 2024-08-31T05:35:23.886 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.880+0000 7f209069a740 1 -- start start 2024-08-31T05:35:23.886 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.880+0000 7f209069a740 1 Processor -- start 2024-08-31T05:35:23.886 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.880+0000 7f209069a740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b5e2e9ed80 0x55b5e3295590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:23.886 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.880+0000 7f209069a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5e2eb72f0 0x55b5e3295ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:23.886 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.880+0000 7f209069a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5e2ebf4d0 0x55b5e3296010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:23.886 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.880+0000 7f209069a740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f20841b2030 con 0x55b5e2e9ed80 2024-08-31T05:35:23.886 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.880+0000 7f209069a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f20841b1960 con 0x55b5e2eb72f0 2024-08-31T05:35:23.887 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.880+0000 7f209069a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f20841aeba0 con 0x55b5e2ebf4d0 2024-08-31T05:35:23.887 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.880+0000 7f209069a740 10 client.0 _ll_register_callbacks cb 0x7f206c005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:35:23.887 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.880+0000 7f2082ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b5e2e9ed80 0x55b5e3295590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:23.887 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.880+0000 7f207bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5e2eb72f0 0x55b5e3295ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:23.887 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.880+0000 7f2082ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b5e2e9ed80 0x55b5e3295590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47578/0 (socket says 172.21.15.5:47578) 2024-08-31T05:35:23.887 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.880+0000 7f2082ffd640 1 -- 172.21.15.5:0/3745963576 learned_addr learned my addr 172.21.15.5:0/3745963576 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:23.887 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.880+0000 7f20837fe640 1 --2- 172.21.15.5:0/3745963576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5e2ebf4d0 0x55b5e3296010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:23.887 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.881+0000 7f207bfff640 1 -- 172.21.15.5:0/3745963576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5e2ebf4d0 msgr2=0x55b5e3296010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:23.887 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.881+0000 7f207bfff640 1 --2- 172.21.15.5:0/3745963576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5e2ebf4d0 0x55b5e3296010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:23.887 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.881+0000 7f207bfff640 1 -- 172.21.15.5:0/3745963576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b5e2e9ed80 msgr2=0x55b5e3295590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:23.887 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.881+0000 7f207bfff640 1 --2- 172.21.15.5:0/3745963576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b5e2e9ed80 0x55b5e3295590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:23.887 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.881+0000 7f207bfff640 1 -- 172.21.15.5:0/3745963576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5e330b1d0 con 0x55b5e2eb72f0 2024-08-31T05:35:23.887 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.881+0000 7f2082ffd640 1 --2- 172.21.15.5:0/3745963576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b5e2e9ed80 0x55b5e3295590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:35:23.888 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.881+0000 7f207bfff640 1 --2- 172.21.15.5:0/3745963576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5e2eb72f0 0x55b5e3295ad0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f206c031440 tx=0x7f206c105f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdb9a177554ca970 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:23.888 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.881+0000 7f206a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:35:23.888 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.881+0000 7f206a7fc640 1 -- 172.21.15.5:0/3745963576 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f206c049070 con 0x55b5e2eb72f0 2024-08-31T05:35:23.888 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.881+0000 7f209069a740 1 -- 172.21.15.5:0/3745963576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2074004440 con 0x55b5e2eb72f0 2024-08-31T05:35:23.888 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.881+0000 7f206a7fc640 1 -- 172.21.15.5:0/3745963576 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f206c0d4f60 con 0x55b5e2eb72f0 2024-08-31T05:35:23.888 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.881+0000 7f206a7fc640 1 -- 172.21.15.5:0/3745963576 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f206c0e6050 con 0x55b5e2eb72f0 2024-08-31T05:35:23.888 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.881+0000 7f209069a740 10 client.26561 fetch_fsmap learned FSMap version 34 2024-08-31T05:35:23.888 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.881+0000 7f209069a740 1 -- 172.21.15.5:0/3745963576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55b5e330c460 con 0x55b5e2eb72f0 2024-08-31T05:35:23.888 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.881+0000 7f206a7fc640 1 -- 172.21.15.5:0/3745963576 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2074004440 con 0x55b5e2eb72f0 2024-08-31T05:35:23.888 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.882+0000 7f206a7fc640 1 -- 172.21.15.5:0/3745963576 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f206c0d03b0 con 0x55b5e2eb72f0 2024-08-31T05:35:23.888 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.882+0000 7f209069a740 10 client.26561 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:35:23.888 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.882+0000 7f209069a740 10 client.26561 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:35:23.888 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.882+0000 7f209069a740 20 client.26561 populate_metadata read hostname 'smithi005' 2024-08-31T05:35:23.888 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.882+0000 7f209069a740 1 --2- 172.21.15.5:0/3745963576 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55b5e2ee01b0 0x55b5e330ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:23.888 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.882+0000 7f209069a740 4 client.26561 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:35:23.889 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.882+0000 7f209069a740 1 -- 172.21.15.5:0/3745963576 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b5e31f69f0 con 0x55b5e2ee01b0 2024-08-31T05:35:23.889 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.882+0000 7f2082ffd640 1 --2- 172.21.15.5:0/3745963576 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55b5e2ee01b0 0x55b5e330ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:23.889 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.882+0000 7f206a7fc640 10 client.26561 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:35:23.889 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.882+0000 7f2082ffd640 1 --2- 172.21.15.5:0/3745963576 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55b5e2ee01b0 0x55b5e330ea30 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ec8094462916e96 server_cookie=185c8fce685897d5 in_seq=0 out_seq=0 2024-08-31T05:35:23.895 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.893+0000 7f206a7fc640 1 -- 172.21.15.5:0/3745963576 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b5e31f69f0 con 0x55b5e2ee01b0 2024-08-31T05:35:23.895 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.893+0000 7f206a7fc640 10 client.26561 handle_command_reply: tid=0 2024-08-31T05:35:23.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.893+0000 7f209069a740 1 client.26561 shutdown 2024-08-31T05:35:23.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.893+0000 7f209069a740 1 -- 172.21.15.5:0/3745963576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5e2eb72f0 msgr2=0x55b5e3295ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:23.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.893+0000 7f209069a740 1 --2- 172.21.15.5:0/3745963576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5e2eb72f0 0x55b5e3295ad0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f206c031440 tx=0x7f206c105f80 comp rx=0 tx=0).stop 2024-08-31T05:35:23.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.893+0000 7f209069a740 1 -- 172.21.15.5:0/3745963576 shutdown_connections 2024-08-31T05:35:23.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.893+0000 7f209069a740 1 --2- 172.21.15.5:0/3745963576 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55b5e2ee01b0 0x55b5e330ea30 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:23.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.893+0000 7f209069a740 1 --2- 172.21.15.5:0/3745963576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5e2ebf4d0 0x55b5e3296010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:23.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.893+0000 7f209069a740 1 --2- 172.21.15.5:0/3745963576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55b5e2eb72f0 0x55b5e3295ad0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:23.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.893+0000 7f209069a740 1 --2- 172.21.15.5:0/3745963576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55b5e2e9ed80 0x55b5e3295590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:23.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.893+0000 7f206a7fc640 0 client.26561 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:35:23.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.893+0000 7f209069a740 1 -- 172.21.15.5:0/3745963576 >> 172.21.15.5:0/3745963576 conn(0x55b5e2ed4300 msgr2=0x55b5e3288b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:23.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.893+0000 7f209069a740 1 -- 172.21.15.5:0/3745963576 shutdown_connections 2024-08-31T05:35:23.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.893+0000 7f209069a740 1 -- 172.21.15.5:0/3745963576 wait complete. 2024-08-31T05:35:23.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.893+0000 7f209069a740 20 client.26561 trim_cache size 0 max 16384 2024-08-31T05:35:23.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:35:23.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:35:23.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:35:23.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:35:23.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.894+0000 7f208972b640 1 -- 172.21.15.5:0/177129014 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f20700b4d20 msgr2=0x7f20700b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:23.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.894+0000 7f208972b640 1 --2- 172.21.15.5:0/177129014 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f20700b4d20 0x7f20700b7230 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f207c005fd0 tx=0x7f207c009500 comp rx=0 tx=0).stop 2024-08-31T05:35:23.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.894+0000 7f208972b640 1 -- 172.21.15.5:0/177129014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20841080b0 msgr2=0x7f208419b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:23.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.894+0000 7f208972b640 1 --2- 172.21.15.5:0/177129014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20841080b0 0x7f208419b540 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f206c02a930 tx=0x7f206c031a20 comp rx=0 tx=0).stop 2024-08-31T05:35:23.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.894+0000 7f208972b640 1 -- 172.21.15.5:0/177129014 shutdown_connections 2024-08-31T05:35:23.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.894+0000 7f208972b640 1 --2- 172.21.15.5:0/177129014 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f20700b4d20 0x7f20700b7230 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:23.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.894+0000 7f208972b640 1 --2- 172.21.15.5:0/177129014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2084108a00 0x7f208419ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:23.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.894+0000 7f208972b640 1 --2- 172.21.15.5:0/177129014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20841080b0 0x7f208419b540 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:23.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.894+0000 7f208972b640 1 --2- 172.21.15.5:0/177129014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2084102780 0x7f208419b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:23.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.894+0000 7f208972b640 1 -- 172.21.15.5:0/177129014 >> 172.21.15.5:0/177129014 conn(0x7f20840fe180 msgr2=0x7f2084107790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:23.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.894+0000 7f208972b640 1 -- 172.21.15.5:0/177129014 shutdown_connections 2024-08-31T05:35:23.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:23.894+0000 7f208972b640 1 -- 172.21.15.5:0/177129014 wait complete. 2024-08-31T05:35:23.919 INFO:tasks.workunit.client.0.smithi005.stdout: 1 593882 12.09 MB/sec execute 131 sec latency 20.066 ms 2024-08-31T05:35:24.919 INFO:tasks.workunit.client.0.smithi005.stdout: 1 595773 12.06 MB/sec execute 132 sec latency 137.013 ms 2024-08-31T05:35:25.086 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:35:24 smithi070 ceph-mon[22316]: pgmap v508: 129 pgs: 129 active+clean; 337 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 2.1 MiB/s wr, 104 op/s 2024-08-31T05:35:25.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:35:24 smithi050 ceph-mon[22146]: pgmap v508: 129 pgs: 129 active+clean; 337 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 2.1 MiB/s wr, 104 op/s 2024-08-31T05:35:25.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:35:24 smithi005 ceph-mon[18602]: pgmap v508: 129 pgs: 129 active+clean; 337 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 2.1 MiB/s wr, 104 op/s 2024-08-31T05:35:25.919 INFO:tasks.workunit.client.0.smithi005.stdout: 1 597691 12.06 MB/sec execute 133 sec latency 27.888 ms 2024-08-31T05:35:26.200 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T05:35:26.471 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:35:26.892 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:35:26 smithi005 ceph-mon[18602]: pgmap v509: 129 pgs: 129 active+clean; 345 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.4 MiB/s wr, 187 op/s 2024-08-31T05:35:26.919 INFO:tasks.workunit.client.0.smithi005.stdout: 1 600334 12.09 MB/sec execute 134 sec latency 17.267 ms 2024-08-31T05:35:26.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.987+0000 7fdee9d39640 1 -- 172.21.15.5:0/3864664838 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdee4108a90 msgr2=0x7fdee410f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:26.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.987+0000 7fdee9d39640 1 --2- 172.21.15.5:0/3864664838 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdee4108a90 0x7fdee410f2c0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fdedc009ca0 tx=0x7fdedc02a8c0 comp rx=0 tx=0).stop 2024-08-31T05:35:26.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.988+0000 7fdee9d39640 1 -- 172.21.15.5:0/3864664838 shutdown_connections 2024-08-31T05:35:26.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.988+0000 7fdee9d39640 1 --2- 172.21.15.5:0/3864664838 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdee4108a90 0x7fdee410f2c0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:26.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.988+0000 7fdee9d39640 1 --2- 172.21.15.5:0/3864664838 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdee4108140 0x7fdee4108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:26.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.988+0000 7fdee9d39640 1 --2- 172.21.15.5:0/3864664838 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdee4102800 0x7fdee4102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:26.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.988+0000 7fdee9d39640 1 -- 172.21.15.5:0/3864664838 >> 172.21.15.5:0/3864664838 conn(0x7fdee40794d0 msgr2=0x7fdee40798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:26.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.988+0000 7fdee9d39640 1 -- 172.21.15.5:0/3864664838 shutdown_connections 2024-08-31T05:35:26.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.988+0000 7fdee9d39640 1 -- 172.21.15.5:0/3864664838 wait complete. 2024-08-31T05:35:26.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.988+0000 7fdee9d39640 1 Processor -- start 2024-08-31T05:35:26.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.989+0000 7fdee9d39640 1 -- start start 2024-08-31T05:35:26.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.989+0000 7fdee9d39640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdee4102800 0x7fdee4104e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:26.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.989+0000 7fdee9d39640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdee4108140 0x7fdee41053c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:26.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.989+0000 7fdee9d39640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdee4108a90 0x7fdee4105900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:26.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.989+0000 7fdee9d39640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdee4112710 con 0x7fdee4108a90 2024-08-31T05:35:26.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.989+0000 7fdee9d39640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdee4112590 con 0x7fdee4102800 2024-08-31T05:35:26.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.989+0000 7fdee9d39640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdee4112890 con 0x7fdee4108140 2024-08-31T05:35:26.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.989+0000 7fdee37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdee4102800 0x7fdee4104e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:26.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.989+0000 7fdee3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdee4108a90 0x7fdee4105900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:26.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.989+0000 7fdee3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdee4108a90 0x7fdee4105900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47596/0 (socket says 172.21.15.5:47596) 2024-08-31T05:35:26.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.989+0000 7fdee2ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdee4108140 0x7fdee41053c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:26.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.989+0000 7fdee3fff640 1 -- 172.21.15.5:0/2202334735 learned_addr learned my addr 172.21.15.5:0/2202334735 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:26.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.989+0000 7fdee37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdee4102800 0x7fdee4104e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:48346/0 (socket says 172.21.15.5:48346) 2024-08-31T05:35:26.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.989+0000 7fdee3fff640 1 -- 172.21.15.5:0/2202334735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdee4108140 msgr2=0x7fdee41053c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:26.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.989+0000 7fdee3fff640 1 --2- 172.21.15.5:0/2202334735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdee4108140 0x7fdee41053c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:26.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.989+0000 7fdee3fff640 1 -- 172.21.15.5:0/2202334735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdee4102800 msgr2=0x7fdee4104e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:26.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.989+0000 7fdee3fff640 1 --2- 172.21.15.5:0/2202334735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdee4102800 0x7fdee4104e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:26.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.989+0000 7fdee3fff640 1 -- 172.21.15.5:0/2202334735 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdee41a8480 con 0x7fdee4108a90 2024-08-31T05:35:26.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.990+0000 7fdee3fff640 1 --2- 172.21.15.5:0/2202334735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdee4108a90 0x7fdee4105900 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fdedc005cc0 tx=0x7fdedc031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:26.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.990+0000 7fdee0ff9640 1 -- 172.21.15.5:0/2202334735 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdedc003b70 con 0x7fdee4108a90 2024-08-31T05:35:26.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.990+0000 7fdee0ff9640 1 -- 172.21.15.5:0/2202334735 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdedc0318f0 con 0x7fdee4108a90 2024-08-31T05:35:26.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.990+0000 7fdee9d39640 1 -- 172.21.15.5:0/2202334735 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdee41a8710 con 0x7fdee4108a90 2024-08-31T05:35:26.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.990+0000 7fdee0ff9640 1 -- 172.21.15.5:0/2202334735 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdedc02f950 con 0x7fdee4108a90 2024-08-31T05:35:26.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.990+0000 7fdee9d39640 1 -- 172.21.15.5:0/2202334735 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdee41a8c50 con 0x7fdee4108a90 2024-08-31T05:35:26.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.993+0000 7fdef02ae740 1 Processor -- start 2024-08-31T05:35:26.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.993+0000 7fdee0ff9640 1 -- 172.21.15.5:0/2202334735 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fdedc02fb50 con 0x7fdee4108a90 2024-08-31T05:35:26.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.993+0000 7fdef02ae740 1 -- start start 2024-08-31T05:35:26.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.993+0000 7fdef02ae740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56101556f070 0x5610159142c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:26.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.993+0000 7fdef02ae740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5610155461b0 0x561015914800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:26.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.993+0000 7fdef02ae740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56101554e390 0x561015914d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:26.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.993+0000 7fdef02ae740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56101588b630 con 0x56101554e390 2024-08-31T05:35:26.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.993+0000 7fdef02ae740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56101587abc0 con 0x56101556f070 2024-08-31T05:35:26.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.993+0000 7fdef02ae740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56101587eb70 con 0x5610155461b0 2024-08-31T05:35:26.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.993+0000 7fdee2ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56101556f070 0x5610159142c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:26.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.993+0000 7fdee37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5610155461b0 0x561015914800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:26.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.994+0000 7fdee37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5610155461b0 0x561015914800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:52350/0 (socket says 172.21.15.5:52350) 2024-08-31T05:35:26.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.994+0000 7fdee37fe640 1 -- 172.21.15.5:0/3780011541 learned_addr learned my addr 172.21.15.5:0/3780011541 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:26.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.994+0000 7fdee2ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56101556f070 0x5610159142c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:48360/0 (socket says 172.21.15.5:48360) 2024-08-31T05:35:26.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.994+0000 7fdee2ffd640 1 --2- 172.21.15.5:0/3780011541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56101554e390 0x561015914d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:26.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.994+0000 7fdee37fe640 1 -- 172.21.15.5:0/3780011541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56101556f070 msgr2=0x5610159142c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:26.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.994+0000 7fdee37fe640 1 --2- 172.21.15.5:0/3780011541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56101556f070 0x5610159142c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:26.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.994+0000 7fdee37fe640 1 -- 172.21.15.5:0/3780011541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56101554e390 msgr2=0x561015914d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:26.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.994+0000 7fdee37fe640 1 --2- 172.21.15.5:0/3780011541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56101554e390 0x561015914d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:26.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.994+0000 7fdee37fe640 1 -- 172.21.15.5:0/3780011541 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610155da650 con 0x5610155461b0 2024-08-31T05:35:26.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.994+0000 7fdee2ffd640 1 --2- 172.21.15.5:0/3780011541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56101554e390 0x561015914d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:35:26.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.994+0000 7fdee0ff9640 1 --2- 172.21.15.5:0/2202334735 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fdecc0b4ca0 0x7fdecc0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:26.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.994+0000 7fdee37fe640 1 --2- 172.21.15.5:0/3780011541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5610155461b0 0x561015914800 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fded4009c70 tx=0x7fded4011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e622d397d85b6e7d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:27.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.994+0000 7fdee2ffd640 1 --2- 172.21.15.5:0/2202334735 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fdecc0b4ca0 0x7fdecc0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:27.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.994+0000 7fdee0ff9640 1 -- 172.21.15.5:0/2202334735 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fdedc106a40 con 0x7fdee4108a90 2024-08-31T05:35:27.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.994+0000 7fdec9ffb640 1 -- 172.21.15.5:0/3780011541 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded401e070 con 0x5610155461b0 2024-08-31T05:35:27.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.994+0000 7fdec9ffb640 1 -- 172.21.15.5:0/3780011541 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fded4019ae0 con 0x5610155461b0 2024-08-31T05:35:27.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.994+0000 7fdec9ffb640 1 -- 172.21.15.5:0/3780011541 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded400e990 con 0x5610155461b0 2024-08-31T05:35:27.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.995+0000 7fdef02ae740 1 -- 172.21.15.5:0/3780011541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5610155461b0 msgr2=0x561015914800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:27.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.995+0000 7fdef02ae740 1 --2- 172.21.15.5:0/3780011541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5610155461b0 0x561015914800 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fded4009c70 tx=0x7fded4011810 comp rx=0 tx=0).stop 2024-08-31T05:35:27.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.995+0000 7fdee2ffd640 1 --2- 172.21.15.5:0/2202334735 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fdecc0b4ca0 0x7fdecc0b71b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fdee4107800 tx=0x7fded8013040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:27.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.995+0000 7fdef02ae740 1 -- 172.21.15.5:0/3780011541 shutdown_connections 2024-08-31T05:35:27.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.995+0000 7fdef02ae740 1 --2- 172.21.15.5:0/3780011541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56101554e390 0x561015914d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:27.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.995+0000 7fdef02ae740 1 --2- 172.21.15.5:0/3780011541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5610155461b0 0x561015914800 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:27.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.995+0000 7fdef02ae740 1 --2- 172.21.15.5:0/3780011541 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56101556f070 0x5610159142c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:27.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.995+0000 7fdef02ae740 1 -- 172.21.15.5:0/3780011541 >> 172.21.15.5:0/3780011541 conn(0x561015563460 msgr2=0x5610159121b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:27.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.996+0000 7fdef02ae740 1 -- 172.21.15.5:0/3780011541 shutdown_connections 2024-08-31T05:35:27.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.996+0000 7fdef02ae740 1 -- 172.21.15.5:0/3780011541 wait complete. 2024-08-31T05:35:27.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.996+0000 7fdef02ae740 1 -- start start 2024-08-31T05:35:27.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.996+0000 7fdef02ae740 1 Processor -- start 2024-08-31T05:35:27.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.997+0000 7fdef02ae740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610155461b0 0x56101591fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:27.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.997+0000 7fdef02ae740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56101554e390 0x56101591ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:27.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.997+0000 7fdef02ae740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56101556f070 0x56101592bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:27.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.997+0000 7fdef02ae740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5610156dd700 con 0x56101556f070 2024-08-31T05:35:27.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.997+0000 7fdef02ae740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x561015801700 con 0x5610155461b0 2024-08-31T05:35:27.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.997+0000 7fdef02ae740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561015922aa0 con 0x56101554e390 2024-08-31T05:35:27.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.997+0000 7fdef02ae740 10 client.0 _ll_register_callbacks cb 0x561015830dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:35:27.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.997+0000 7fdee3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56101556f070 0x56101592bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:27.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.997+0000 7fdee3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56101556f070 0x56101592bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47606/0 (socket says 172.21.15.5:47606) 2024-08-31T05:35:27.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.997+0000 7fdee3fff640 1 -- 172.21.15.5:0/2629050458 learned_addr learned my addr 172.21.15.5:0/2629050458 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:27.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.997+0000 7fdee2ffd640 1 --2- 172.21.15.5:0/2629050458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56101554e390 0x56101591ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:27.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.997+0000 7fdee37fe640 1 --2- 172.21.15.5:0/2629050458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610155461b0 0x56101591fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:27.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.997+0000 7fdee3fff640 1 -- 172.21.15.5:0/2629050458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56101554e390 msgr2=0x56101591ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:27.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.997+0000 7fdee3fff640 1 --2- 172.21.15.5:0/2629050458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56101554e390 0x56101591ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:27.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.997+0000 7fdee3fff640 1 -- 172.21.15.5:0/2629050458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610155461b0 msgr2=0x56101591fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:27.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.997+0000 7fdee3fff640 1 --2- 172.21.15.5:0/2629050458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610155461b0 0x56101591fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:27.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.997+0000 7fdee3fff640 1 -- 172.21.15.5:0/2629050458 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56101583a8b0 con 0x56101556f070 2024-08-31T05:35:27.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.997+0000 7fdee3fff640 1 --2- 172.21.15.5:0/2629050458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56101556f070 0x56101592bd90 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fdedc0c8dd0 tx=0x7fdedc0cc950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0c089541df070c6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:27.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.997+0000 7fdec2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:35:27.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.997+0000 7fdec2ffd640 1 -- 172.21.15.5:0/2629050458 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdedc0d6070 con 0x56101556f070 2024-08-31T05:35:27.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.998+0000 7fdef02ae740 1 -- 172.21.15.5:0/2629050458 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fded4019ae0 con 0x56101556f070 2024-08-31T05:35:27.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.998+0000 7fdec2ffd640 1 -- 172.21.15.5:0/2629050458 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fdedc104030 con 0x56101556f070 2024-08-31T05:35:27.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.998+0000 7fdec2ffd640 1 -- 172.21.15.5:0/2629050458 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fdedc0c8fe0 con 0x56101556f070 2024-08-31T05:35:27.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.998+0000 7fdef02ae740 10 client.16986 fetch_fsmap learned FSMap version 34 2024-08-31T05:35:27.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.998+0000 7fdef02ae740 1 -- 172.21.15.5:0/2629050458 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56101592e8a0 con 0x56101556f070 2024-08-31T05:35:27.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.998+0000 7fdec2ffd640 1 -- 172.21.15.5:0/2629050458 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fded4019ae0 con 0x56101556f070 2024-08-31T05:35:27.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.998+0000 7fdec2ffd640 1 -- 172.21.15.5:0/2629050458 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fdedc0b4160 con 0x56101556f070 2024-08-31T05:35:27.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.998+0000 7fdef02ae740 10 client.16986 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:35:27.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.998+0000 7fdef02ae740 10 client.16986 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:35:27.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.998+0000 7fdef02ae740 20 client.16986 populate_metadata read hostname 'smithi005' 2024-08-31T05:35:27.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.998+0000 7fdef02ae740 1 --2- 172.21.15.5:0/2629050458 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56101552d9f0 0x561015931e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:27.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.998+0000 7fdef02ae740 4 client.16986 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:35:27.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.998+0000 7fdef02ae740 1 -- 172.21.15.5:0/2629050458 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56101588d580 con 0x56101552d9f0 2024-08-31T05:35:27.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.998+0000 7fdee37fe640 1 --2- 172.21.15.5:0/2629050458 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56101552d9f0 0x561015931e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:27.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.999+0000 7fdec2ffd640 10 client.16986 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:35:27.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:26.999+0000 7fdee37fe640 1 --2- 172.21.15.5:0/2629050458 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56101552d9f0 0x561015931e20 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c77af5e91564ad75 server_cookie=56765b8b0f0ff677 in_seq=0 out_seq=0 2024-08-31T05:35:27.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.000+0000 7fdec2ffd640 1 -- 172.21.15.5:0/2629050458 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56101588d580 con 0x56101552d9f0 2024-08-31T05:35:27.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.000+0000 7fdec2ffd640 10 client.16986 handle_command_reply: tid=0 2024-08-31T05:35:27.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.000+0000 7fdef02ae740 1 client.16986 shutdown 2024-08-31T05:35:27.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.000+0000 7fdef02ae740 1 -- 172.21.15.5:0/2629050458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56101556f070 msgr2=0x56101592bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:27.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.000+0000 7fdef02ae740 1 --2- 172.21.15.5:0/2629050458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56101556f070 0x56101592bd90 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fdedc0c8dd0 tx=0x7fdedc0cc950 comp rx=0 tx=0).stop 2024-08-31T05:35:27.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.000+0000 7fdef02ae740 1 -- 172.21.15.5:0/2629050458 shutdown_connections 2024-08-31T05:35:27.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.000+0000 7fdef02ae740 1 --2- 172.21.15.5:0/2629050458 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56101552d9f0 0x561015931e20 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:27.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.000+0000 7fdef02ae740 1 --2- 172.21.15.5:0/2629050458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56101556f070 0x56101592bd90 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:27.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.000+0000 7fdef02ae740 1 --2- 172.21.15.5:0/2629050458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56101554e390 0x56101591ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:27.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.000+0000 7fdef02ae740 1 --2- 172.21.15.5:0/2629050458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610155461b0 0x56101591fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:27.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.000+0000 7fdef02ae740 1 -- 172.21.15.5:0/2629050458 >> 172.21.15.5:0/2629050458 conn(0x561015563460 msgr2=0x5610159174a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:27.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.000+0000 7fdec2ffd640 0 client.16986 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:35:27.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.001+0000 7fdef02ae740 1 -- 172.21.15.5:0/2629050458 shutdown_connections 2024-08-31T05:35:27.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.001+0000 7fdef02ae740 1 -- 172.21.15.5:0/2629050458 wait complete. 2024-08-31T05:35:27.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.001+0000 7fdef02ae740 20 client.16986 trim_cache size 0 max 16384 2024-08-31T05:35:27.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.019+0000 7fdef02ae740 1 Processor -- start 2024-08-31T05:35:27.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.019+0000 7fdef02ae740 1 -- start start 2024-08-31T05:35:27.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.019+0000 7fdef02ae740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5610155461b0 0x5610159121e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:27.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.019+0000 7fdef02ae740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56101554e390 0x56101592bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:27.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.019+0000 7fdef02ae740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56101556f070 0x56101592c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:27.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.019+0000 7fdef02ae740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdee41b2d60 con 0x56101556f070 2024-08-31T05:35:27.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.019+0000 7fdef02ae740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdee41b48a0 con 0x56101554e390 2024-08-31T05:35:27.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.019+0000 7fdef02ae740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdee41b3430 con 0x5610155461b0 2024-08-31T05:35:27.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.020+0000 7fdee3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56101556f070 0x56101592c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:27.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.020+0000 7fdee37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5610155461b0 0x5610159121e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:27.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.020+0000 7fdee2ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56101554e390 0x56101592bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:27.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.020+0000 7fdee3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56101556f070 0x56101592c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47622/0 (socket says 172.21.15.5:47622) 2024-08-31T05:35:27.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.020+0000 7fdee37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5610155461b0 0x5610159121e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:52376/0 (socket says 172.21.15.5:52376) 2024-08-31T05:35:27.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.020+0000 7fdee3fff640 1 -- 172.21.15.5:0/155544674 learned_addr learned my addr 172.21.15.5:0/155544674 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:27.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.020+0000 7fdee37fe640 1 -- 172.21.15.5:0/155544674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56101554e390 msgr2=0x56101592bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:27.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.020+0000 7fdee37fe640 1 --2- 172.21.15.5:0/155544674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56101554e390 0x56101592bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:27.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.020+0000 7fdee37fe640 1 -- 172.21.15.5:0/155544674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56101556f070 msgr2=0x56101592c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:27.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.020+0000 7fdee37fe640 1 --2- 172.21.15.5:0/155544674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56101556f070 0x56101592c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:27.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.020+0000 7fdee37fe640 1 -- 172.21.15.5:0/155544674 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56101591e9c0 con 0x5610155461b0 2024-08-31T05:35:27.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.020+0000 7fdee3fff640 1 --2- 172.21.15.5:0/155544674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56101556f070 0x56101592c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:35:27.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.020+0000 7fdee37fe640 1 --2- 172.21.15.5:0/155544674 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5610155461b0 0x5610159121e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x5610159222b0 tx=0x7fded40096c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7f6eee809a5978c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:27.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.020+0000 7fdec97fa640 1 -- 172.21.15.5:0/155544674 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded401e070 con 0x5610155461b0 2024-08-31T05:35:27.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.020+0000 7fdec97fa640 1 -- 172.21.15.5:0/155544674 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fded401f040 con 0x5610155461b0 2024-08-31T05:35:27.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.020+0000 7fdec97fa640 1 -- 172.21.15.5:0/155544674 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded4019a70 con 0x5610155461b0 2024-08-31T05:35:27.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.021+0000 7fdef02ae740 1 -- 172.21.15.5:0/155544674 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5610155461b0 msgr2=0x5610159121e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:27.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.021+0000 7fdef02ae740 1 --2- 172.21.15.5:0/155544674 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5610155461b0 0x5610159121e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x5610159222b0 tx=0x7fded40096c0 comp rx=0 tx=0).stop 2024-08-31T05:35:27.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.021+0000 7fdef02ae740 1 -- 172.21.15.5:0/155544674 shutdown_connections 2024-08-31T05:35:27.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.021+0000 7fdef02ae740 1 --2- 172.21.15.5:0/155544674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56101556f070 0x56101592c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:27.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.021+0000 7fdef02ae740 1 --2- 172.21.15.5:0/155544674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56101554e390 0x56101592bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:27.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.021+0000 7fdef02ae740 1 --2- 172.21.15.5:0/155544674 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5610155461b0 0x5610159121e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:27.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.021+0000 7fdef02ae740 1 -- 172.21.15.5:0/155544674 >> 172.21.15.5:0/155544674 conn(0x561015563460 msgr2=0x561015911ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:27.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.021+0000 7fdef02ae740 1 -- 172.21.15.5:0/155544674 shutdown_connections 2024-08-31T05:35:27.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.021+0000 7fdef02ae740 1 -- 172.21.15.5:0/155544674 wait complete. 2024-08-31T05:35:27.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.022+0000 7fdef02ae740 1 -- start start 2024-08-31T05:35:27.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.022+0000 7fdef02ae740 1 Processor -- start 2024-08-31T05:35:27.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.022+0000 7fdef02ae740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610155461b0 0x5610159240b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:27.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.022+0000 7fdef02ae740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56101554e390 0x5610159245f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:27.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.022+0000 7fdef02ae740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56101556f070 0x56101599b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:27.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.022+0000 7fdef02ae740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdee41b41d0 con 0x56101554e390 2024-08-31T05:35:27.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.022+0000 7fdef02ae740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdee41b3b00 con 0x5610155461b0 2024-08-31T05:35:27.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.022+0000 7fdef02ae740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdee41b0d40 con 0x56101556f070 2024-08-31T05:35:27.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.022+0000 7fdef02ae740 10 client.0 _ll_register_callbacks cb 0x7fdedc0099c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:35:27.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.023+0000 7fdee2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56101554e390 0x5610159245f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:27.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.023+0000 7fdee3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56101556f070 0x56101599b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:27.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.023+0000 7fdee37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610155461b0 0x5610159240b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:27.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.023+0000 7fdee3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56101556f070 0x56101599b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:52386/0 (socket says 172.21.15.5:52386) 2024-08-31T05:35:27.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.023+0000 7fdee3fff640 1 -- 172.21.15.5:0/3630583585 learned_addr learned my addr 172.21.15.5:0/3630583585 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:27.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.023+0000 7fdee37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610155461b0 0x5610159240b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:48390/0 (socket says 172.21.15.5:48390) 2024-08-31T05:35:27.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.023+0000 7fdee2ffd640 1 --2- 172.21.15.5:0/3630583585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56101554e390 0x5610159245f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47636/0 (socket says 172.21.15.5:47636) 2024-08-31T05:35:27.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.023+0000 7fdee3fff640 1 -- 172.21.15.5:0/3630583585 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610155461b0 msgr2=0x5610159240b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:27.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.023+0000 7fdee3fff640 1 --2- 172.21.15.5:0/3630583585 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610155461b0 0x5610159240b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:27.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.023+0000 7fdee3fff640 1 -- 172.21.15.5:0/3630583585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56101554e390 msgr2=0x5610159245f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:27.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.023+0000 7fdee3fff640 1 --2- 172.21.15.5:0/3630583585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56101554e390 0x5610159245f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:27.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.023+0000 7fdee3fff640 1 -- 172.21.15.5:0/3630583585 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56101599bd20 con 0x56101556f070 2024-08-31T05:35:27.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.023+0000 7fdee3fff640 1 --2- 172.21.15.5:0/3630583585 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56101556f070 0x56101599b7e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdedc006010 tx=0x7fdedc0c8c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2344517e2774334 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:27.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.023+0000 7fdec2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:35:27.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.023+0000 7fdec2ffd640 1 -- 172.21.15.5:0/3630583585 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdedc0ccb20 con 0x56101556f070 2024-08-31T05:35:27.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.023+0000 7fdec2ffd640 1 -- 172.21.15.5:0/3630583585 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fdedc0b40d0 con 0x56101556f070 2024-08-31T05:35:27.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.023+0000 7fdef02ae740 1 -- 172.21.15.5:0/3630583585 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fded401f040 con 0x56101556f070 2024-08-31T05:35:27.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.023+0000 7fdec2ffd640 1 -- 172.21.15.5:0/3630583585 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fdedc0cc4c0 con 0x56101556f070 2024-08-31T05:35:27.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.023+0000 7fdef02ae740 10 client.26596 fetch_fsmap learned FSMap version 34 2024-08-31T05:35:27.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.023+0000 7fdef02ae740 1 -- 172.21.15.5:0/3630583585 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56101599bd20 con 0x56101556f070 2024-08-31T05:35:27.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.024+0000 7fdec2ffd640 1 -- 172.21.15.5:0/3630583585 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fded401f040 con 0x56101556f070 2024-08-31T05:35:27.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.024+0000 7fdec2ffd640 1 -- 172.21.15.5:0/3630583585 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fdedc0cbfb0 con 0x56101556f070 2024-08-31T05:35:27.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.024+0000 7fdef02ae740 10 client.26596 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:35:27.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.024+0000 7fdef02ae740 10 client.26596 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:35:27.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.024+0000 7fdef02ae740 20 client.26596 populate_metadata read hostname 'smithi005' 2024-08-31T05:35:27.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.024+0000 7fdef02ae740 1 --2- 172.21.15.5:0/3630583585 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561015502da0 0x56101599f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:27.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.024+0000 7fdef02ae740 4 client.26596 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T05:35:27.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.024+0000 7fdef02ae740 1 -- 172.21.15.5:0/3630583585 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561015889020 con 0x561015502da0 2024-08-31T05:35:27.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.024+0000 7fdee37fe640 1 --2- 172.21.15.5:0/3630583585 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561015502da0 0x56101599f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:27.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.024+0000 7fdec2ffd640 10 client.26596 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:35:27.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.025+0000 7fdee37fe640 1 --2- 172.21.15.5:0/3630583585 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561015502da0 0x56101599f210 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3d34374769890d server_cookie=62f62d24944467ce in_seq=0 out_seq=0 2024-08-31T05:35:27.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.025+0000 7fdec2ffd640 1 -- 172.21.15.5:0/3630583585 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2078 (crc 0 0 0) 0x561015889020 con 0x561015502da0 2024-08-31T05:35:27.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.025+0000 7fdec2ffd640 10 client.26596 handle_command_reply: tid=0 2024-08-31T05:35:27.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.025+0000 7fdef02ae740 1 client.26596 shutdown 2024-08-31T05:35:27.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.025+0000 7fdef02ae740 1 -- 172.21.15.5:0/3630583585 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56101556f070 msgr2=0x56101599b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:27.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.025+0000 7fdef02ae740 1 --2- 172.21.15.5:0/3630583585 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56101556f070 0x56101599b7e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdedc006010 tx=0x7fdedc0c8c50 comp rx=0 tx=0).stop 2024-08-31T05:35:27.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.025+0000 7fdef02ae740 1 -- 172.21.15.5:0/3630583585 shutdown_connections 2024-08-31T05:35:27.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.025+0000 7fdef02ae740 1 --2- 172.21.15.5:0/3630583585 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561015502da0 0x56101599f210 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:27.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.025+0000 7fdef02ae740 1 --2- 172.21.15.5:0/3630583585 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56101556f070 0x56101599b7e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:27.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.025+0000 7fdec2ffd640 0 client.26596 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:35:27.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.025+0000 7fdef02ae740 1 --2- 172.21.15.5:0/3630583585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56101554e390 0x5610159245f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:27.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.025+0000 7fdef02ae740 1 --2- 172.21.15.5:0/3630583585 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5610155461b0 0x5610159240b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:27.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.025+0000 7fdef02ae740 1 -- 172.21.15.5:0/3630583585 >> 172.21.15.5:0/3630583585 conn(0x561015563460 msgr2=0x5610159152f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:27.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.025+0000 7fdef02ae740 1 -- 172.21.15.5:0/3630583585 shutdown_connections 2024-08-31T05:35:27.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.025+0000 7fdef02ae740 1 -- 172.21.15.5:0/3630583585 wait complete. 2024-08-31T05:35:27.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.025+0000 7fdef02ae740 20 client.26596 trim_cache size 0 max 16384 2024-08-31T05:35:27.033 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:35:27.033 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "no active scrubs running", 2024-08-31T05:35:27.033 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": {}, 2024-08-31T05:35:27.033 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_stats": { 2024-08-31T05:35:27.033 INFO:teuthology.orchestra.run.smithi005.stdout: "de9731c7-ae4a-42fe-8146-e4752cdc40d4": { 2024-08-31T05:35:27.033 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:34:53.614499+0000", 2024-08-31T05:35:27.034 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:35:27.034 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:35:27.034 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:35:27.034 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:35:27.034 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:35:27.034 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:35:27.034 INFO:teuthology.orchestra.run.smithi005.stdout: "0bb67292-013a-40c7-b5fc-810bdd9715d8": { 2024-08-31T05:35:27.034 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:34:04.586008+0000", 2024-08-31T05:35:27.034 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:35:27.034 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:35:27.034 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:35:27.034 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:35:27.035 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:35:27.035 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:35:27.035 INFO:teuthology.orchestra.run.smithi005.stdout: "728a42ca-bbef-4151-830f-5fdd411d8fa0": { 2024-08-31T05:35:27.035 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:32:30.554906+0000", 2024-08-31T05:35:27.035 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:35:27.035 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:35:27.035 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:35:27.035 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:35:27.035 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:35:27.035 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:35:27.035 INFO:teuthology.orchestra.run.smithi005.stdout: "2445fc42-b797-434f-b380-e2da985b4d98": { 2024-08-31T05:35:27.035 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:33:17.681453+0000", 2024-08-31T05:35:27.035 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:35:27.036 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:35:27.036 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:35:27.036 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:35:27.036 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:35:27.036 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:35:27.036 INFO:teuthology.orchestra.run.smithi005.stdout: "cda92ac0-b35f-47a5-a3a5-471c888462a5": { 2024-08-31T05:35:27.036 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:53.103905+0000", 2024-08-31T05:35:27.036 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:35:27.036 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:35:27.036 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:35:27.036 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:35:27.036 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:35:27.036 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:35:27.036 INFO:teuthology.orchestra.run.smithi005.stdout: "ece37b07-9ab2-45f8-bc33-2755a07aac0b": { 2024-08-31T05:35:27.037 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:31:41.782407+0000", 2024-08-31T05:35:27.037 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:35:27.037 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:35:27.037 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:35:27.037 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:35:27.037 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:35:27.037 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:35:27.037 INFO:teuthology.orchestra.run.smithi005.stdout: "75d84398-5d9c-4872-b879-2fbce045fa71": { 2024-08-31T05:35:27.037 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:06.642335+0000", 2024-08-31T05:35:27.037 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:35:27.037 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:35:27.038 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:35:27.038 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:35:27.038 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:35:27.038 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:35:27.038 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:35:27.038 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:35:27.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.026+0000 7fdee9d39640 1 -- 172.21.15.5:0/2202334735 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fdecc0b4ca0 msgr2=0x7fdecc0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:27.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.026+0000 7fdee9d39640 1 --2- 172.21.15.5:0/2202334735 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fdecc0b4ca0 0x7fdecc0b71b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fdee4107800 tx=0x7fded8013040 comp rx=0 tx=0).stop 2024-08-31T05:35:27.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.026+0000 7fdee9d39640 1 -- 172.21.15.5:0/2202334735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdee4108a90 msgr2=0x7fdee4105900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:27.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.026+0000 7fdee9d39640 1 --2- 172.21.15.5:0/2202334735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdee4108a90 0x7fdee4105900 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fdedc005cc0 tx=0x7fdedc031700 comp rx=0 tx=0).stop 2024-08-31T05:35:27.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.026+0000 7fdee9d39640 1 -- 172.21.15.5:0/2202334735 shutdown_connections 2024-08-31T05:35:27.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.026+0000 7fdee9d39640 1 --2- 172.21.15.5:0/2202334735 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fdecc0b4ca0 0x7fdecc0b71b0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:27.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.026+0000 7fdee9d39640 1 --2- 172.21.15.5:0/2202334735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdee4108a90 0x7fdee4105900 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:27.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.026+0000 7fdee9d39640 1 --2- 172.21.15.5:0/2202334735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdee4108140 0x7fdee41053c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:27.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.026+0000 7fdee9d39640 1 --2- 172.21.15.5:0/2202334735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdee4102800 0x7fdee4104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:27.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.026+0000 7fdee9d39640 1 -- 172.21.15.5:0/2202334735 >> 172.21.15.5:0/2202334735 conn(0x7fdee40794d0 msgr2=0x7fdee406af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:27.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.026+0000 7fdee9d39640 1 -- 172.21.15.5:0/2202334735 shutdown_connections 2024-08-31T05:35:27.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:27.026+0000 7fdee9d39640 1 -- 172.21.15.5:0/2202334735 wait complete. 2024-08-31T05:35:27.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:35:26 smithi050 ceph-mon[22146]: pgmap v509: 129 pgs: 129 active+clean; 345 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.4 MiB/s wr, 187 op/s 2024-08-31T05:35:27.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:35:26 smithi070 ceph-mon[22316]: pgmap v509: 129 pgs: 129 active+clean; 345 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.4 MiB/s wr, 187 op/s 2024-08-31T05:35:27.919 INFO:tasks.workunit.client.0.smithi005.stdout: 1 601947 12.05 MB/sec execute 135 sec latency 44.228 ms 2024-08-31T05:35:28.440 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T05:35:28.440 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T05:35:28.723 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:35:28.919 INFO:tasks.workunit.client.0.smithi005.stdout: 1 604355 12.07 MB/sec execute 136 sec latency 14.071 ms 2024-08-31T05:35:29.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:35:28 smithi005 ceph-mon[18602]: pgmap v510: 129 pgs: 129 active+clean; 345 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.9 MiB/s wr, 170 op/s 2024-08-31T05:35:29.156 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:35:28 smithi050 ceph-mon[22146]: pgmap v510: 129 pgs: 129 active+clean; 345 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.9 MiB/s wr, 170 op/s 2024-08-31T05:35:29.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:29.227+0000 7f1c96e34640 1 -- 172.21.15.5:0/4067410026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c90109bc0 msgr2=0x7f1c901103f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:29.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:29.227+0000 7f1c96e34640 1 --2- 172.21.15.5:0/4067410026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c90109bc0 0x7f1c901103f0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f1c88009ca0 tx=0x7f1c8802a8c0 comp rx=0 tx=0).stop 2024-08-31T05:35:29.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:29.227+0000 7f1c96e34640 1 -- 172.21.15.5:0/4067410026 shutdown_connections 2024-08-31T05:35:29.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:29.227+0000 7f1c96e34640 1 --2- 172.21.15.5:0/4067410026 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c90109bc0 0x7f1c901103f0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:29.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:29.227+0000 7f1c96e34640 1 --2- 172.21.15.5:0/4067410026 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c90109270 0x7f1c90109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:29.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:29.227+0000 7f1c96e34640 1 --2- 172.21.15.5:0/4067410026 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c90103930 0x7f1c90103d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:29.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:29.227+0000 7f1c96e34640 1 -- 172.21.15.5:0/4067410026 >> 172.21.15.5:0/4067410026 conn(0x7f1c900ff3a0 msgr2=0x7f1c901017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:29.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:29.227+0000 7f1c96e34640 1 -- 172.21.15.5:0/4067410026 shutdown_connections 2024-08-31T05:35:29.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:29.227+0000 7f1c96e34640 1 -- 172.21.15.5:0/4067410026 wait complete. 2024-08-31T05:35:29.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:29.228+0000 7f1c96e34640 1 Processor -- start 2024-08-31T05:35:29.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:29.228+0000 7f1c96e34640 1 -- start start 2024-08-31T05:35:29.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:29.228+0000 7f1c96e34640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c90103930 0x7f1c9019a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:29.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:29.228+0000 7f1c96e34640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c90109270 0x7f1c9019a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:29.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:29.228+0000 7f1c96e34640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c90109bc0 0x7f1c9019fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:29.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:29.228+0000 7f1c96e34640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1c90113880 con 0x7f1c90103930 2024-08-31T05:35:29.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:29.228+0000 7f1c96e34640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1c90113700 con 0x7f1c90109270 2024-08-31T05:35:29.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:29.228+0000 7f1c96e34640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1c90113a00 con 0x7f1c90109bc0 2024-08-31T05:35:29.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:29.228+0000 7f1c94bd0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c90103930 0x7f1c9019a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:29.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:29.228+0000 7f1c94bd0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c90103930 0x7f1c9019a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47664/0 (socket says 172.21.15.5:47664) 2024-08-31T05:35:29.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:29.228+0000 7f1c94bd0640 1 -- 172.21.15.5:0/4140826310 learned_addr learned my addr 172.21.15.5:0/4140826310 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:29.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:29.228+0000 7f1c8ffff640 1 --2- 172.21.15.5:0/4140826310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c90109270 0x7f1c9019a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:29.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:29.228+0000 7f1c953d1640 1 --2- 172.21.15.5:0/4140826310 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c90109bc0 0x7f1c9019fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:29.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:29.228+0000 7f1c94bd0640 1 -- 172.21.15.5:0/4140826310 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c90109bc0 msgr2=0x7f1c9019fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:29.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:29.228+0000 7f1c94bd0640 1 --2- 172.21.15.5:0/4140826310 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c90109bc0 0x7f1c9019fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:29.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:29.228+0000 7f1c94bd0640 1 -- 172.21.15.5:0/4140826310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c90109270 msgr2=0x7f1c9019a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:29.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:29.228+0000 7f1c94bd0640 1 --2- 172.21.15.5:0/4140826310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c90109270 0x7f1c9019a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:29.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:29.228+0000 7f1c94bd0640 1 -- 172.21.15.5:0/4140826310 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c901a0160 con 0x7f1c90103930 2024-08-31T05:35:29.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:29.229+0000 7f1c94bd0640 1 --2- 172.21.15.5:0/4140826310 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c90103930 0x7f1c9019a1f0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f1c8400e9f0 tx=0x7f1c8400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:29.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:29.229+0000 7f1c8dffb640 1 -- 172.21.15.5:0/4140826310 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c8400cd80 con 0x7f1c90103930 2024-08-31T05:35:29.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:29.229+0000 7f1c8dffb640 1 -- 172.21.15.5:0/4140826310 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c840108e0 con 0x7f1c90103930 2024-08-31T05:35:29.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:29.229+0000 7f1c96e34640 1 -- 172.21.15.5:0/4140826310 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c901a0450 con 0x7f1c90103930 2024-08-31T05:35:29.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:29.229+0000 7f1c8dffb640 1 -- 172.21.15.5:0/4140826310 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c84018980 con 0x7f1c90103930 2024-08-31T05:35:29.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:29.229+0000 7f1c96e34640 1 -- 172.21.15.5:0/4140826310 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c901a6bb0 con 0x7f1c90103930 2024-08-31T05:35:29.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:29.230+0000 7f1c96e34640 1 -- 172.21.15.5:0/4140826310 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c90103d40 con 0x7f1c90103930 2024-08-31T05:35:29.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:29.232+0000 7f1c8dffb640 1 -- 172.21.15.5:0/4140826310 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f1c84010430 con 0x7f1c90103930 2024-08-31T05:35:29.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:29.232+0000 7f1c8dffb640 1 --2- 172.21.15.5:0/4140826310 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f1c800b4ca0 0x7f1c800b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:29.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:29.232+0000 7f1c8ffff640 1 --2- 172.21.15.5:0/4140826310 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f1c800b4ca0 0x7f1c800b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:29.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:29.232+0000 7f1c8dffb640 1 -- 172.21.15.5:0/4140826310 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f1c840e60c0 con 0x7f1c90103930 2024-08-31T05:35:29.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:29.233+0000 7f1c8ffff640 1 --2- 172.21.15.5:0/4140826310 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f1c800b4ca0 0x7f1c800b71b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1c90107c60 tx=0x7f1c7c005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:29.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:29.236+0000 7f1c8dffb640 1 -- 172.21.15.5:0/4140826310 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f1c840ac4e0 con 0x7f1c90103930 2024-08-31T05:35:29.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:35:28 smithi070 ceph-mon[22316]: pgmap v510: 129 pgs: 129 active+clean; 345 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.9 MiB/s wr, 170 op/s 2024-08-31T05:35:29.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:29.487+0000 7f1c96e34640 1 -- 172.21.15.5:0/4140826310 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1c9019b320 con 0x7f1c90103930 2024-08-31T05:35:29.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:29.489+0000 7f1c8dffb640 1 -- 172.21.15.5:0/4140826310 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11941 (secure 0 0 0) 0x7f1c840b5070 con 0x7f1c90103930 2024-08-31T05:35:29.492 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:35:29.492 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":34,"btime":"2024-08-31T05:33:43:289944+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14739,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2024812199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2024812199},{"type":"v1","addr":"172.21.15.5:6835","nonce":2024812199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3629023702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3629023702},{"type":"v1","addr":"172.21.15.5:6837","nonce":3629023702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T05:27:31.929153+0000","modified":"2024-08-31T05:33:42.378207+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24652,"mds_1":24638,"mds_2":24631,"mds_3":24625,"mds_4":24602},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6839/2412701258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":2412701258},{"type":"v1","addr":"172.21.15.5:6839","nonce":2412701258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14820":{"gid":14820,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6841/747057838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":747057838},{"type":"v1","addr":"172.21.15.5:6841","nonce":747057838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6833/1153378982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1153378982},{"type":"v1","addr":"172.21.15.50:6833","nonce":1153378982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6833/364083443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":364083443},{"type":"v1","addr":"172.21.15.70:6833","nonce":364083443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24587":{"gid":24587,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/2346896794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2346896794},{"type":"v1","addr":"172.21.15.50:6835","nonce":2346896794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24602":{"gid":24602,"name":"h","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.50:6837/428759669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":428759669},{"type":"v1","addr":"172.21.15.50:6837","nonce":428759669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.70:6835/2061504114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2061504114},{"type":"v1","addr":"172.21.15.70:6835","nonce":2061504114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.70:6837/2780036414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2780036414},{"type":"v1","addr":"172.21.15.70:6837","nonce":2780036414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.50:6839/98200944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":98200944},{"type":"v1","addr":"172.21.15.50:6839","nonce":98200944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24652":{"gid":24652,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.70:6839/2756569250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":2756569250},{"type":"v1","addr":"172.21.15.70:6839","nonce":2756569250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24652,"qdb_cluster":[24652,24631,24638,24625,24602]},"id":1}]} 2024-08-31T05:35:29.493 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 34 2024-08-31T05:35:29.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:29.493+0000 7f1c96e34640 1 -- 172.21.15.5:0/4140826310 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f1c800b4ca0 msgr2=0x7f1c800b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:29.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:29.493+0000 7f1c96e34640 1 --2- 172.21.15.5:0/4140826310 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f1c800b4ca0 0x7f1c800b71b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1c90107c60 tx=0x7f1c7c005f90 comp rx=0 tx=0).stop 2024-08-31T05:35:29.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:29.493+0000 7f1c96e34640 1 -- 172.21.15.5:0/4140826310 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c90103930 msgr2=0x7f1c9019a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:29.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:29.493+0000 7f1c96e34640 1 --2- 172.21.15.5:0/4140826310 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c90103930 0x7f1c9019a1f0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f1c8400e9f0 tx=0x7f1c8400eeb0 comp rx=0 tx=0).stop 2024-08-31T05:35:29.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:29.493+0000 7f1c96e34640 1 -- 172.21.15.5:0/4140826310 shutdown_connections 2024-08-31T05:35:29.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:29.493+0000 7f1c96e34640 1 --2- 172.21.15.5:0/4140826310 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f1c800b4ca0 0x7f1c800b71b0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:29.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:29.493+0000 7f1c96e34640 1 --2- 172.21.15.5:0/4140826310 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c90109bc0 0x7f1c9019fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:29.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:29.493+0000 7f1c96e34640 1 --2- 172.21.15.5:0/4140826310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1c90109270 0x7f1c9019a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:29.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:29.493+0000 7f1c96e34640 1 --2- 172.21.15.5:0/4140826310 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c90103930 0x7f1c9019a1f0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:29.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:29.493+0000 7f1c96e34640 1 -- 172.21.15.5:0/4140826310 >> 172.21.15.5:0/4140826310 conn(0x7f1c900ff3a0 msgr2=0x7f1c901017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:29.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:29.494+0000 7f1c96e34640 1 -- 172.21.15.5:0/4140826310 shutdown_connections 2024-08-31T05:35:29.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:29.494+0000 7f1c96e34640 1 -- 172.21.15.5:0/4140826310 wait complete. 2024-08-31T05:35:29.919 INFO:tasks.workunit.client.0.smithi005.stdout: 1 606194 12.03 MB/sec execute 137 sec latency 115.317 ms 2024-08-31T05:35:30.156 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:35:29 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/4140826310' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:35:30.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:35:29 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/4140826310' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:35:30.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:35:29 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/4140826310' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:35:30.390 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-31T05:35:30.709 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:35:30.919 INFO:tasks.workunit.client.0.smithi005.stdout: 1 608135 12.03 MB/sec execute 138 sec latency 18.214 ms 2024-08-31T05:35:31.099 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:35:30 smithi005 ceph-mon[18602]: pgmap v511: 129 pgs: 129 active+clean; 351 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.2 MiB/s wr, 252 op/s 2024-08-31T05:35:31.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:35:30 smithi050 ceph-mon[22146]: pgmap v511: 129 pgs: 129 active+clean; 351 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.2 MiB/s wr, 252 op/s 2024-08-31T05:35:31.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.192+0000 7fb16207b640 1 -- 172.21.15.5:0/258334675 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb15c1045f0 msgr2=0x7fb15c104a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:31.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.192+0000 7fb16207b640 1 --2- 172.21.15.5:0/258334675 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb15c1045f0 0x7fb15c104a00 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fb14c009900 tx=0x7fb14c02a410 comp rx=0 tx=0).stop 2024-08-31T05:35:31.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.193+0000 7fb16207b640 1 -- 172.21.15.5:0/258334675 shutdown_connections 2024-08-31T05:35:31.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.193+0000 7fb16207b640 1 --2- 172.21.15.5:0/258334675 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb15c10dba0 0x7fb15c1100b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:31.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.193+0000 7fb16207b640 1 --2- 172.21.15.5:0/258334675 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb15c105020 0x7fb15c10d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:31.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.193+0000 7fb16207b640 1 --2- 172.21.15.5:0/258334675 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb15c1045f0 0x7fb15c104a00 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:31.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.193+0000 7fb16207b640 1 -- 172.21.15.5:0/258334675 >> 172.21.15.5:0/258334675 conn(0x7fb15c0794d0 msgr2=0x7fb15c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:31.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.193+0000 7fb16207b640 1 -- 172.21.15.5:0/258334675 shutdown_connections 2024-08-31T05:35:31.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.193+0000 7fb16207b640 1 -- 172.21.15.5:0/258334675 wait complete. 2024-08-31T05:35:31.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.193+0000 7fb16207b640 1 Processor -- start 2024-08-31T05:35:31.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.193+0000 7fb16207b640 1 -- start start 2024-08-31T05:35:31.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.194+0000 7fb16207b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb15c1045f0 0x7fb15c19a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:31.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.194+0000 7fb16207b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb15c105020 0x7fb15c19a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:31.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.194+0000 7fb16207b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb15c10dba0 0x7fb15c19fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:31.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.194+0000 7fb16207b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb15c113840 con 0x7fb15c10dba0 2024-08-31T05:35:31.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.194+0000 7fb16207b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb15c1136c0 con 0x7fb15c105020 2024-08-31T05:35:31.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.194+0000 7fb16207b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb15c1139c0 con 0x7fb15c1045f0 2024-08-31T05:35:31.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.194+0000 7fb15bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb15c10dba0 0x7fb15c19fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:31.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.194+0000 7fb15affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb15c105020 0x7fb15c19a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:31.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.194+0000 7fb15b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb15c1045f0 0x7fb15c19a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:31.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.194+0000 7fb15affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb15c105020 0x7fb15c19a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:48426/0 (socket says 172.21.15.5:48426) 2024-08-31T05:35:31.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.194+0000 7fb15b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb15c1045f0 0x7fb15c19a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:52430/0 (socket says 172.21.15.5:52430) 2024-08-31T05:35:31.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.194+0000 7fb15affd640 1 -- 172.21.15.5:0/3865144590 learned_addr learned my addr 172.21.15.5:0/3865144590 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:31.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.194+0000 7fb15affd640 1 -- 172.21.15.5:0/3865144590 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb15c1045f0 msgr2=0x7fb15c19a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:31.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.194+0000 7fb15affd640 1 --2- 172.21.15.5:0/3865144590 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb15c1045f0 0x7fb15c19a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:31.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.194+0000 7fb15affd640 1 -- 172.21.15.5:0/3865144590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb15c10dba0 msgr2=0x7fb15c19fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:31.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.194+0000 7fb15affd640 1 --2- 172.21.15.5:0/3865144590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb15c10dba0 0x7fb15c19fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:31.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.194+0000 7fb15affd640 1 -- 172.21.15.5:0/3865144590 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb15c1a0260 con 0x7fb15c105020 2024-08-31T05:35:31.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.194+0000 7fb15b7fe640 1 --2- 172.21.15.5:0/3865144590 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb15c1045f0 0x7fb15c19a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:35:31.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.194+0000 7fb15bfff640 1 --2- 172.21.15.5:0/3865144590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb15c10dba0 0x7fb15c19fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:35:31.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.194+0000 7fb15affd640 1 --2- 172.21.15.5:0/3865144590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb15c105020 0x7fb15c19a890 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb15000e9c0 tx=0x7fb15000edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:31.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.195+0000 7fb158ff9640 1 -- 172.21.15.5:0/3865144590 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb15000ccc0 con 0x7fb15c105020 2024-08-31T05:35:31.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.195+0000 7fb16207b640 1 -- 172.21.15.5:0/3865144590 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb15c1a0550 con 0x7fb15c105020 2024-08-31T05:35:31.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.195+0000 7fb158ff9640 1 -- 172.21.15.5:0/3865144590 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb1500054d0 con 0x7fb15c105020 2024-08-31T05:35:31.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.195+0000 7fb158ff9640 1 -- 172.21.15.5:0/3865144590 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb150010430 con 0x7fb15c105020 2024-08-31T05:35:31.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.195+0000 7fb16207b640 1 -- 172.21.15.5:0/3865144590 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb15c1a6cb0 con 0x7fb15c105020 2024-08-31T05:35:31.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.197+0000 7fb1685f0740 1 Processor -- start 2024-08-31T05:35:31.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.197+0000 7fb1685f0740 1 -- start start 2024-08-31T05:35:31.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.197+0000 7fb158ff9640 1 -- 172.21.15.5:0/3865144590 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fb150004f40 con 0x7fb15c105020 2024-08-31T05:35:31.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.198+0000 7fb1685f0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56483c95d070 0x56483cd02350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:31.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.198+0000 7fb1685f0740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56483c9341b0 0x56483cd02890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:31.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.198+0000 7fb1685f0740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56483c93c390 0x56483cd02dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:31.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.198+0000 7fb1685f0740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56483cc79680 con 0x56483c93c390 2024-08-31T05:35:31.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.198+0000 7fb1685f0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56483cc68c10 con 0x56483c95d070 2024-08-31T05:35:31.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.198+0000 7fb1685f0740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56483cc6cbc0 con 0x56483c9341b0 2024-08-31T05:35:31.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.198+0000 7fb15bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56483c95d070 0x56483cd02350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:31.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.198+0000 7fb15bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56483c95d070 0x56483cd02350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:48438/0 (socket says 172.21.15.5:48438) 2024-08-31T05:35:31.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.198+0000 7fb15b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56483c9341b0 0x56483cd02890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:31.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.198+0000 7fb15bfff640 1 -- 172.21.15.5:0/2997734633 learned_addr learned my addr 172.21.15.5:0/2997734633 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:31.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.198+0000 7fb15affd640 1 --2- 172.21.15.5:0/2997734633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56483c93c390 0x56483cd02dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:31.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.198+0000 7fb15bfff640 1 -- 172.21.15.5:0/2997734633 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56483c9341b0 msgr2=0x56483cd02890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:31.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.198+0000 7fb15bfff640 1 --2- 172.21.15.5:0/2997734633 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56483c9341b0 0x56483cd02890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:31.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.198+0000 7fb15bfff640 1 -- 172.21.15.5:0/2997734633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56483c93c390 msgr2=0x56483cd02dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:31.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.198+0000 7fb15bfff640 1 --2- 172.21.15.5:0/2997734633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56483c93c390 0x56483cd02dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:31.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.198+0000 7fb15bfff640 1 -- 172.21.15.5:0/2997734633 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56483c9c8650 con 0x56483c95d070 2024-08-31T05:35:31.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.198+0000 7fb15b7fe640 1 --2- 172.21.15.5:0/2997734633 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56483c9341b0 0x56483cd02890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:35:31.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.198+0000 7fb158ff9640 1 --2- 172.21.15.5:0/3865144590 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb1440b4ca0 0x7fb1440b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:31.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.199+0000 7fb15bfff640 1 --2- 172.21.15.5:0/2997734633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56483c95d070 0x56483cd02350 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb154011810 tx=0x7fb154011cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fee568d3131dcff server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:31.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.199+0000 7fb15b7fe640 1 --2- 172.21.15.5:0/3865144590 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb1440b4ca0 0x7fb1440b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:31.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.199+0000 7fb158ff9640 1 -- 172.21.15.5:0/3865144590 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fb1500e5d10 con 0x7fb15c105020 2024-08-31T05:35:31.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.199+0000 7fb141ffb640 1 -- 172.21.15.5:0/2997734633 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb154011310 con 0x56483c95d070 2024-08-31T05:35:31.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.199+0000 7fb141ffb640 1 -- 172.21.15.5:0/2997734633 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb15400f9a0 con 0x56483c95d070 2024-08-31T05:35:31.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.199+0000 7fb141ffb640 1 -- 172.21.15.5:0/2997734633 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb154005700 con 0x56483c95d070 2024-08-31T05:35:31.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.200+0000 7fb1685f0740 1 -- 172.21.15.5:0/2997734633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56483c95d070 msgr2=0x56483cd02350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:31.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.200+0000 7fb1685f0740 1 --2- 172.21.15.5:0/2997734633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56483c95d070 0x56483cd02350 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb154011810 tx=0x7fb154011cd0 comp rx=0 tx=0).stop 2024-08-31T05:35:31.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.200+0000 7fb15b7fe640 1 --2- 172.21.15.5:0/3865144590 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb1440b4ca0 0x7fb1440b71b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb14c000c00 tx=0x7fb14c031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:31.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.200+0000 7fb1685f0740 1 -- 172.21.15.5:0/2997734633 shutdown_connections 2024-08-31T05:35:31.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.200+0000 7fb1685f0740 1 --2- 172.21.15.5:0/2997734633 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56483c93c390 0x56483cd02dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:31.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.200+0000 7fb1685f0740 1 --2- 172.21.15.5:0/2997734633 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56483c9341b0 0x56483cd02890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:31.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.200+0000 7fb1685f0740 1 --2- 172.21.15.5:0/2997734633 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56483c95d070 0x56483cd02350 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:31.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.200+0000 7fb1685f0740 1 -- 172.21.15.5:0/2997734633 >> 172.21.15.5:0/2997734633 conn(0x56483c951460 msgr2=0x56483cd00240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:31.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.200+0000 7fb1685f0740 1 -- 172.21.15.5:0/2997734633 shutdown_connections 2024-08-31T05:35:31.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.200+0000 7fb1685f0740 1 -- 172.21.15.5:0/2997734633 wait complete. 2024-08-31T05:35:31.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.200+0000 7fb1685f0740 1 -- start start 2024-08-31T05:35:31.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.200+0000 7fb1685f0740 1 Processor -- start 2024-08-31T05:35:31.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.201+0000 7fb1685f0740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56483c9341b0 0x56483cd11eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:31.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.201+0000 7fb1685f0740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56483c93c390 0x56483cd123f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:31.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.201+0000 7fb1685f0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56483c95d070 0x56483cd1e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:31.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.201+0000 7fb1685f0740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56483cacb700 con 0x56483c93c390 2024-08-31T05:35:31.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.201+0000 7fb1685f0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56483cbef750 con 0x56483c95d070 2024-08-31T05:35:31.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.201+0000 7fb1685f0740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56483cd14e60 con 0x56483c9341b0 2024-08-31T05:35:31.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.201+0000 7fb1685f0740 10 client.0 _ll_register_callbacks cb 0x56483cc1ee10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:35:31.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.201+0000 7fb15affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56483c93c390 0x56483cd123f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:31.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.201+0000 7fb15b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56483c9341b0 0x56483cd11eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:31.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.201+0000 7fb15affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56483c93c390 0x56483cd123f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47696/0 (socket says 172.21.15.5:47696) 2024-08-31T05:35:31.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.201+0000 7fb15affd640 1 -- 172.21.15.5:0/686961255 learned_addr learned my addr 172.21.15.5:0/686961255 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:31.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.201+0000 7fb15bfff640 1 --2- 172.21.15.5:0/686961255 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56483c95d070 0x56483cd1e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:31.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.201+0000 7fb15affd640 1 -- 172.21.15.5:0/686961255 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56483c9341b0 msgr2=0x56483cd11eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:31.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.201+0000 7fb15affd640 1 --2- 172.21.15.5:0/686961255 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56483c9341b0 0x56483cd11eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:31.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.201+0000 7fb15affd640 1 -- 172.21.15.5:0/686961255 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56483c95d070 msgr2=0x56483cd1e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:31.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.201+0000 7fb15affd640 1 --2- 172.21.15.5:0/686961255 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56483c95d070 0x56483cd1e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:31.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.201+0000 7fb15affd640 1 -- 172.21.15.5:0/686961255 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56483cc28900 con 0x56483c93c390 2024-08-31T05:35:31.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.201+0000 7fb15b7fe640 1 --2- 172.21.15.5:0/686961255 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56483c9341b0 0x56483cd11eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:35:31.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.202+0000 7fb15affd640 1 --2- 172.21.15.5:0/686961255 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56483c93c390 0x56483cd123f0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fb1500a8100 tx=0x7fb150009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83f75bbcb9744ce5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:31.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.202+0000 7fb13affd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:35:31.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.202+0000 7fb13affd640 1 -- 172.21.15.5:0/686961255 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1500abe50 con 0x56483c93c390 2024-08-31T05:35:31.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.202+0000 7fb13affd640 1 -- 172.21.15.5:0/686961255 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fb1500b4f10 con 0x56483c93c390 2024-08-31T05:35:31.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.202+0000 7fb1685f0740 1 -- 172.21.15.5:0/686961255 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb15400f9a0 con 0x56483c93c390 2024-08-31T05:35:31.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.202+0000 7fb13affd640 1 -- 172.21.15.5:0/686961255 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fb1500e3570 con 0x56483c93c390 2024-08-31T05:35:31.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.202+0000 7fb1685f0740 10 client.17010 fetch_fsmap learned FSMap version 34 2024-08-31T05:35:31.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.202+0000 7fb1685f0740 1 -- 172.21.15.5:0/686961255 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56483cd20ce0 con 0x56483c93c390 2024-08-31T05:35:31.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.202+0000 7fb13affd640 1 -- 172.21.15.5:0/686961255 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb15400f9a0 con 0x56483c93c390 2024-08-31T05:35:31.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.202+0000 7fb13affd640 1 -- 172.21.15.5:0/686961255 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fb150097190 con 0x56483c93c390 2024-08-31T05:35:31.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.202+0000 7fb1685f0740 10 client.17010 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:35:31.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.202+0000 7fb1685f0740 10 client.17010 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-31T05:35:31.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.202+0000 7fb1685f0740 20 client.17010 populate_metadata read hostname 'smithi005' 2024-08-31T05:35:31.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.202+0000 7fb1685f0740 1 --2- 172.21.15.5:0/686961255 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x56483c91b9f0 0x56483cd24220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:31.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.202+0000 7fb1685f0740 4 client.17010 mds_command: new command op to 24602 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:35:31.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.202+0000 7fb1685f0740 1 -- 172.21.15.5:0/686961255 --> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56483cc7b5d0 con 0x56483c91b9f0 2024-08-31T05:35:31.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.203+0000 7fb15b7fe640 1 --2- 172.21.15.5:0/686961255 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x56483c91b9f0 0x56483cd24220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:31.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.203+0000 7fb13affd640 10 client.17010 ms_handle_connect on v2:172.21.15.50:6836/428759669 2024-08-31T05:35:31.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.203+0000 7fb15b7fe640 1 --2- 172.21.15.5:0/686961255 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x56483c91b9f0 0x56483cd24220 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9d7a14367da42854 server_cookie=d01c61982e2863e5 in_seq=0 out_seq=0 2024-08-31T05:35:31.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.204+0000 7fb13affd640 1 -- 172.21.15.5:0/686961255 <== mds.4 v2:172.21.15.50:6836/428759669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56483cc7b5d0 con 0x56483c91b9f0 2024-08-31T05:35:31.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.204+0000 7fb13affd640 10 client.17010 handle_command_reply: tid=0 2024-08-31T05:35:31.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.204+0000 7fb1685f0740 1 client.17010 shutdown 2024-08-31T05:35:31.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.204+0000 7fb1685f0740 1 -- 172.21.15.5:0/686961255 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56483c93c390 msgr2=0x56483cd123f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:31.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.204+0000 7fb1685f0740 1 --2- 172.21.15.5:0/686961255 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56483c93c390 0x56483cd123f0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fb1500a8100 tx=0x7fb150009310 comp rx=0 tx=0).stop 2024-08-31T05:35:31.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.204+0000 7fb1685f0740 1 -- 172.21.15.5:0/686961255 shutdown_connections 2024-08-31T05:35:31.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.204+0000 7fb1685f0740 1 --2- 172.21.15.5:0/686961255 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x56483c91b9f0 0x56483cd24220 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:31.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.204+0000 7fb1685f0740 1 --2- 172.21.15.5:0/686961255 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56483c95d070 0x56483cd1e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:31.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.204+0000 7fb1685f0740 1 --2- 172.21.15.5:0/686961255 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56483c93c390 0x56483cd123f0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:31.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.204+0000 7fb1685f0740 1 --2- 172.21.15.5:0/686961255 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56483c9341b0 0x56483cd11eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:31.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.204+0000 7fb1685f0740 1 -- 172.21.15.5:0/686961255 >> 172.21.15.5:0/686961255 conn(0x56483c951460 msgr2=0x56483cd054a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:31.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.204+0000 7fb13affd640 0 client.17010 ms_handle_reset on v2:172.21.15.50:6836/428759669 2024-08-31T05:35:31.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.204+0000 7fb1685f0740 1 -- 172.21.15.5:0/686961255 shutdown_connections 2024-08-31T05:35:31.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.204+0000 7fb1685f0740 1 -- 172.21.15.5:0/686961255 wait complete. 2024-08-31T05:35:31.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.204+0000 7fb1685f0740 20 client.17010 trim_cache size 0 max 16384 2024-08-31T05:35:31.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.218+0000 7fb1685f0740 1 Processor -- start 2024-08-31T05:35:31.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.218+0000 7fb1685f0740 1 -- start start 2024-08-31T05:35:31.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.218+0000 7fb1685f0740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56483c9341b0 0x56483cd054a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:31.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.218+0000 7fb1685f0740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56483c93c390 0x56483cd059e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:31.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.218+0000 7fb1685f0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56483c95d070 0x56483cd0f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:31.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.218+0000 7fb1685f0740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb15c1aea20 con 0x56483c93c390 2024-08-31T05:35:31.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.218+0000 7fb1685f0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb15c1b0560 con 0x56483c95d070 2024-08-31T05:35:31.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.218+0000 7fb1685f0740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb15c1af0f0 con 0x56483c9341b0 2024-08-31T05:35:31.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.219+0000 7fb15affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56483c93c390 0x56483cd059e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:31.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.219+0000 7fb15b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56483c9341b0 0x56483cd054a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:31.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.219+0000 7fb15bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56483c95d070 0x56483cd0f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:31.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.219+0000 7fb15affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56483c93c390 0x56483cd059e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47702/0 (socket says 172.21.15.5:47702) 2024-08-31T05:35:31.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.219+0000 7fb15affd640 1 -- 172.21.15.5:0/3954172100 learned_addr learned my addr 172.21.15.5:0/3954172100 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:31.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.219+0000 7fb15b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56483c9341b0 0x56483cd054a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:52470/0 (socket says 172.21.15.5:52470) 2024-08-31T05:35:31.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.219+0000 7fb15affd640 1 -- 172.21.15.5:0/3954172100 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56483c9341b0 msgr2=0x56483cd054a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:31.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.219+0000 7fb15affd640 1 --2- 172.21.15.5:0/3954172100 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56483c9341b0 0x56483cd054a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:31.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.219+0000 7fb15affd640 1 -- 172.21.15.5:0/3954172100 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56483c95d070 msgr2=0x56483cd0f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:31.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.219+0000 7fb15affd640 1 --2- 172.21.15.5:0/3954172100 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56483c95d070 0x56483cd0f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:31.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.219+0000 7fb15affd640 1 -- 172.21.15.5:0/3954172100 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56483ccfb5e0 con 0x56483c93c390 2024-08-31T05:35:31.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.219+0000 7fb15affd640 1 --2- 172.21.15.5:0/3954172100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56483c93c390 0x56483cd059e0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fb1500abd80 tx=0x7fb1500b08f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0c65b33ba050d9d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:31.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.219+0000 7fb1417fa640 1 -- 172.21.15.5:0/3954172100 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1500ab7f0 con 0x56483c93c390 2024-08-31T05:35:31.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.219+0000 7fb1417fa640 1 -- 172.21.15.5:0/3954172100 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb1500ac080 con 0x56483c93c390 2024-08-31T05:35:31.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.219+0000 7fb1417fa640 1 -- 172.21.15.5:0/3954172100 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1500ab9d0 con 0x56483c93c390 2024-08-31T05:35:31.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.220+0000 7fb1685f0740 1 -- 172.21.15.5:0/3954172100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56483c93c390 msgr2=0x56483cd059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:31.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.220+0000 7fb1685f0740 1 --2- 172.21.15.5:0/3954172100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56483c93c390 0x56483cd059e0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fb1500abd80 tx=0x7fb1500b08f0 comp rx=0 tx=0).stop 2024-08-31T05:35:31.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.220+0000 7fb1685f0740 1 -- 172.21.15.5:0/3954172100 shutdown_connections 2024-08-31T05:35:31.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.220+0000 7fb1685f0740 1 --2- 172.21.15.5:0/3954172100 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56483c95d070 0x56483cd0f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:31.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.221+0000 7fb1685f0740 1 --2- 172.21.15.5:0/3954172100 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56483c93c390 0x56483cd059e0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:31.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.221+0000 7fb1685f0740 1 --2- 172.21.15.5:0/3954172100 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56483c9341b0 0x56483cd054a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:31.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.221+0000 7fb1685f0740 1 -- 172.21.15.5:0/3954172100 >> 172.21.15.5:0/3954172100 conn(0x56483c951460 msgr2=0x56483cd10730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:31.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.221+0000 7fb1685f0740 1 -- 172.21.15.5:0/3954172100 shutdown_connections 2024-08-31T05:35:31.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.221+0000 7fb1685f0740 1 -- 172.21.15.5:0/3954172100 wait complete. 2024-08-31T05:35:31.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.221+0000 7fb1685f0740 1 -- start start 2024-08-31T05:35:31.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.221+0000 7fb1685f0740 1 Processor -- start 2024-08-31T05:35:31.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.222+0000 7fb1685f0740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56483c9341b0 0x56483cd16460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:31.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.222+0000 7fb1685f0740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56483c93c390 0x56483cd169a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:31.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.222+0000 7fb1685f0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56483c95d070 0x56483cd8dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:31.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.222+0000 7fb1685f0740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb15c1afe90 con 0x56483c93c390 2024-08-31T05:35:31.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.222+0000 7fb1685f0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb15c1af7c0 con 0x56483c95d070 2024-08-31T05:35:31.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.222+0000 7fb1685f0740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb15c1aca00 con 0x56483c9341b0 2024-08-31T05:35:31.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.222+0000 7fb1685f0740 10 client.0 _ll_register_callbacks cb 0x7fb15000eef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:35:31.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.222+0000 7fb15b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56483c9341b0 0x56483cd16460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:31.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.222+0000 7fb15b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56483c9341b0 0x56483cd16460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:52474/0 (socket says 172.21.15.5:52474) 2024-08-31T05:35:31.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.222+0000 7fb15b7fe640 1 -- 172.21.15.5:0/2938391532 learned_addr learned my addr 172.21.15.5:0/2938391532 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:31.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.222+0000 7fb15affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56483c93c390 0x56483cd169a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:31.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.222+0000 7fb15bfff640 1 --2- 172.21.15.5:0/2938391532 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56483c95d070 0x56483cd8dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:31.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.222+0000 7fb15b7fe640 1 -- 172.21.15.5:0/2938391532 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56483c95d070 msgr2=0x56483cd8dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:31.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.222+0000 7fb15b7fe640 1 --2- 172.21.15.5:0/2938391532 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56483c95d070 0x56483cd8dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:31.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.222+0000 7fb15b7fe640 1 -- 172.21.15.5:0/2938391532 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56483c93c390 msgr2=0x56483cd169a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:31.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.222+0000 7fb15b7fe640 1 --2- 172.21.15.5:0/2938391532 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56483c93c390 0x56483cd169a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:31.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.222+0000 7fb15b7fe640 1 -- 172.21.15.5:0/2938391532 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56483cd17290 con 0x56483c9341b0 2024-08-31T05:35:31.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.222+0000 7fb15affd640 1 --2- 172.21.15.5:0/2938391532 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56483c93c390 0x56483cd169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:35:31.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.222+0000 7fb15b7fe640 1 --2- 172.21.15.5:0/2938391532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56483c9341b0 0x56483cd16460 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb14c009900 tx=0x7fb14c02a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ab126ab9dfff139 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:31.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.222+0000 7fb13affd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:35:31.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.223+0000 7fb13affd640 1 -- 172.21.15.5:0/2938391532 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb14c05f060 con 0x56483c9341b0 2024-08-31T05:35:31.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.223+0000 7fb13affd640 1 -- 172.21.15.5:0/2938391532 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fb14c005450 con 0x56483c9341b0 2024-08-31T05:35:31.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.223+0000 7fb1685f0740 1 -- 172.21.15.5:0/2938391532 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56483cc77070 con 0x56483c9341b0 2024-08-31T05:35:31.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.223+0000 7fb13affd640 1 -- 172.21.15.5:0/2938391532 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fb14c066050 con 0x56483c9341b0 2024-08-31T05:35:31.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.223+0000 7fb1685f0740 10 client.26620 fetch_fsmap learned FSMap version 34 2024-08-31T05:35:31.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.223+0000 7fb1685f0740 1 -- 172.21.15.5:0/2938391532 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56483cd8f260 con 0x56483c9341b0 2024-08-31T05:35:31.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.223+0000 7fb13affd640 1 -- 172.21.15.5:0/2938391532 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x56483cc77070 con 0x56483c9341b0 2024-08-31T05:35:31.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.223+0000 7fb13affd640 1 -- 172.21.15.5:0/2938391532 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fb14c0038f0 con 0x56483c9341b0 2024-08-31T05:35:31.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.223+0000 7fb1685f0740 10 client.26620 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:35:31.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.223+0000 7fb1685f0740 10 client.26620 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-31T05:35:31.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.223+0000 7fb1685f0740 20 client.26620 populate_metadata read hostname 'smithi005' 2024-08-31T05:35:31.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.223+0000 7fb1685f0740 1 --2- 172.21.15.5:0/2938391532 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x56483c8f0da0 0x56483cd91a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:31.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.223+0000 7fb1685f0740 4 client.26620 mds_command: new command op to 24602 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:35:31.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.223+0000 7fb1685f0740 1 -- 172.21.15.5:0/2938391532 --> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56483cc747b0 con 0x56483c8f0da0 2024-08-31T05:35:31.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.224+0000 7fb15affd640 1 --2- 172.21.15.5:0/2938391532 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x56483c8f0da0 0x56483cd91a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:31.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.224+0000 7fb13affd640 10 client.26620 ms_handle_connect on v2:172.21.15.50:6836/428759669 2024-08-31T05:35:31.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.224+0000 7fb15affd640 1 --2- 172.21.15.5:0/2938391532 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x56483c8f0da0 0x56483cd91a00 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=402e17e1a38c941d server_cookie=be1f24e0e4e29c3f in_seq=0 out_seq=0 2024-08-31T05:35:31.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.224+0000 7fb13affd640 1 -- 172.21.15.5:0/2938391532 <== mds.4 v2:172.21.15.50:6836/428759669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56483cc747b0 con 0x56483c8f0da0 2024-08-31T05:35:31.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.224+0000 7fb13affd640 10 client.26620 handle_command_reply: tid=0 2024-08-31T05:35:31.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.224+0000 7fb1685f0740 1 client.26620 shutdown 2024-08-31T05:35:31.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.224+0000 7fb1685f0740 1 -- 172.21.15.5:0/2938391532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56483c9341b0 msgr2=0x56483cd16460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:31.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.224+0000 7fb1685f0740 1 --2- 172.21.15.5:0/2938391532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56483c9341b0 0x56483cd16460 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb14c009900 tx=0x7fb14c02a410 comp rx=0 tx=0).stop 2024-08-31T05:35:31.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.224+0000 7fb1685f0740 1 -- 172.21.15.5:0/2938391532 shutdown_connections 2024-08-31T05:35:31.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.224+0000 7fb1685f0740 1 --2- 172.21.15.5:0/2938391532 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x56483c8f0da0 0x56483cd91a00 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:31.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.224+0000 7fb1685f0740 1 --2- 172.21.15.5:0/2938391532 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56483c95d070 0x56483cd8dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:31.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.224+0000 7fb1685f0740 1 --2- 172.21.15.5:0/2938391532 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56483c93c390 0x56483cd169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:31.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.224+0000 7fb13affd640 0 client.26620 ms_handle_reset on v2:172.21.15.50:6836/428759669 2024-08-31T05:35:31.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.224+0000 7fb1685f0740 1 --2- 172.21.15.5:0/2938391532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56483c9341b0 0x56483cd16460 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:31.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.224+0000 7fb1685f0740 1 -- 172.21.15.5:0/2938391532 >> 172.21.15.5:0/2938391532 conn(0x56483c951460 msgr2=0x56483cd054a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:31.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.225+0000 7fb1685f0740 1 -- 172.21.15.5:0/2938391532 shutdown_connections 2024-08-31T05:35:31.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.225+0000 7fb1685f0740 1 -- 172.21.15.5:0/2938391532 wait complete. 2024-08-31T05:35:31.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.225+0000 7fb1685f0740 20 client.26620 trim_cache size 0 max 16384 2024-08-31T05:35:31.233 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:35:31.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.225+0000 7fb16207b640 1 -- 172.21.15.5:0/3865144590 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb1440b4ca0 msgr2=0x7fb1440b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:31.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.225+0000 7fb16207b640 1 --2- 172.21.15.5:0/3865144590 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb1440b4ca0 0x7fb1440b71b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb14c000c00 tx=0x7fb14c031400 comp rx=0 tx=0).stop 2024-08-31T05:35:31.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.225+0000 7fb16207b640 1 -- 172.21.15.5:0/3865144590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb15c105020 msgr2=0x7fb15c19a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:31.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.225+0000 7fb16207b640 1 --2- 172.21.15.5:0/3865144590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb15c105020 0x7fb15c19a890 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb15000e9c0 tx=0x7fb15000edc0 comp rx=0 tx=0).stop 2024-08-31T05:35:31.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.225+0000 7fb16207b640 1 -- 172.21.15.5:0/3865144590 shutdown_connections 2024-08-31T05:35:31.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.225+0000 7fb16207b640 1 --2- 172.21.15.5:0/3865144590 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb1440b4ca0 0x7fb1440b71b0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:31.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.225+0000 7fb16207b640 1 --2- 172.21.15.5:0/3865144590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb15c10dba0 0x7fb15c19fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:31.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.225+0000 7fb16207b640 1 --2- 172.21.15.5:0/3865144590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb15c105020 0x7fb15c19a890 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:31.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.225+0000 7fb16207b640 1 --2- 172.21.15.5:0/3865144590 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb15c1045f0 0x7fb15c19a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:31.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.225+0000 7fb16207b640 1 -- 172.21.15.5:0/3865144590 >> 172.21.15.5:0/3865144590 conn(0x7fb15c0794d0 msgr2=0x7fb15c1005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:31.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.225+0000 7fb16207b640 1 -- 172.21.15.5:0/3865144590 shutdown_connections 2024-08-31T05:35:31.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:31.225+0000 7fb16207b640 1 -- 172.21.15.5:0/3865144590 wait complete. 2024-08-31T05:35:31.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:35:30 smithi070 ceph-mon[22316]: pgmap v511: 129 pgs: 129 active+clean; 351 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.2 MiB/s wr, 252 op/s 2024-08-31T05:35:31.919 INFO:tasks.workunit.client.0.smithi005.stdout: 1 610608 12.05 MB/sec execute 139 sec latency 28.907 ms 2024-08-31T05:35:31.945 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-31T05:35:32.208 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:35:32.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.723+0000 7fc4fd629640 1 -- 172.21.15.5:0/55909385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4f8105010 msgr2=0x7fc4f810d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:32.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.723+0000 7fc4fd629640 1 --2- 172.21.15.5:0/55909385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4f8105010 0x7fc4f810d650 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fc4e0009900 tx=0x7fc4e002a410 comp rx=0 tx=0).stop 2024-08-31T05:35:32.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.723+0000 7fc4fd629640 1 -- 172.21.15.5:0/55909385 shutdown_connections 2024-08-31T05:35:32.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.723+0000 7fc4fd629640 1 --2- 172.21.15.5:0/55909385 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4f810db90 0x7fc4f81100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:32.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.723+0000 7fc4fd629640 1 --2- 172.21.15.5:0/55909385 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4f8105010 0x7fc4f810d650 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:32.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.723+0000 7fc4fd629640 1 --2- 172.21.15.5:0/55909385 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4f81045e0 0x7fc4f81049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:32.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.724+0000 7fc4fd629640 1 -- 172.21.15.5:0/55909385 >> 172.21.15.5:0/55909385 conn(0x7fc4f80794d0 msgr2=0x7fc4f80798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:32.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.724+0000 7fc4fd629640 1 -- 172.21.15.5:0/55909385 shutdown_connections 2024-08-31T05:35:32.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.724+0000 7fc4fd629640 1 -- 172.21.15.5:0/55909385 wait complete. 2024-08-31T05:35:32.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.724+0000 7fc4fd629640 1 Processor -- start 2024-08-31T05:35:32.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.724+0000 7fc4fd629640 1 -- start start 2024-08-31T05:35:32.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.725+0000 7fc4fd629640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4f81045e0 0x7fc4f819a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:32.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.725+0000 7fc4fd629640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4f8105010 0x7fc4f819a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:32.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.725+0000 7fc4fd629640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4f810db90 0x7fc4f819fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:32.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.725+0000 7fc4fd629640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f8113820 con 0x7fc4f810db90 2024-08-31T05:35:32.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.725+0000 7fc4fd629640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f81136a0 con 0x7fc4f81045e0 2024-08-31T05:35:32.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.725+0000 7fc4fd629640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f81139a0 con 0x7fc4f8105010 2024-08-31T05:35:32.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.725+0000 7fc4f77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4f810db90 0x7fc4f819fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:32.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.725+0000 7fc4effff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4f8105010 0x7fc4f819a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:32.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.725+0000 7fc4f77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4f810db90 0x7fc4f819fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43402/0 (socket says 172.21.15.5:43402) 2024-08-31T05:35:32.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.725+0000 7fc4effff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4f8105010 0x7fc4f819a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:41916/0 (socket says 172.21.15.5:41916) 2024-08-31T05:35:32.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.725+0000 7fc4f6ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4f81045e0 0x7fc4f819a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:32.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.725+0000 7fc4f77fe640 1 -- 172.21.15.5:0/2289654064 learned_addr learned my addr 172.21.15.5:0/2289654064 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:32.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.725+0000 7fc4f77fe640 1 -- 172.21.15.5:0/2289654064 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4f8105010 msgr2=0x7fc4f819a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:32.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.725+0000 7fc4f77fe640 1 --2- 172.21.15.5:0/2289654064 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4f8105010 0x7fc4f819a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:32.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.725+0000 7fc4f77fe640 1 -- 172.21.15.5:0/2289654064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4f81045e0 msgr2=0x7fc4f819a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:32.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.725+0000 7fc4f77fe640 1 --2- 172.21.15.5:0/2289654064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4f81045e0 0x7fc4f819a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:32.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.725+0000 7fc4f77fe640 1 -- 172.21.15.5:0/2289654064 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4f81a0180 con 0x7fc4f810db90 2024-08-31T05:35:32.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.725+0000 7fc4effff640 1 --2- 172.21.15.5:0/2289654064 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4f8105010 0x7fc4f819a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:35:32.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.725+0000 7fc4f6ffd640 1 --2- 172.21.15.5:0/2289654064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4f81045e0 0x7fc4f819a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:35:32.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.725+0000 7fc4f77fe640 1 --2- 172.21.15.5:0/2289654064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4f810db90 0x7fc4f819fa50 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fc4f000eb10 tx=0x7fc4f000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:32.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.726+0000 7fc4f4ff9640 1 -- 172.21.15.5:0/2289654064 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4f0004b20 con 0x7fc4f810db90 2024-08-31T05:35:32.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.726+0000 7fc4fd629640 1 -- 172.21.15.5:0/2289654064 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4f81a0470 con 0x7fc4f810db90 2024-08-31T05:35:32.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.726+0000 7fc4f4ff9640 1 -- 172.21.15.5:0/2289654064 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4f0004cc0 con 0x7fc4f810db90 2024-08-31T05:35:32.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.726+0000 7fc4f4ff9640 1 -- 172.21.15.5:0/2289654064 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4f0010670 con 0x7fc4f810db90 2024-08-31T05:35:32.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.726+0000 7fc4fd629640 1 -- 172.21.15.5:0/2289654064 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4f81a6bd0 con 0x7fc4f810db90 2024-08-31T05:35:32.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.728+0000 7fc503b9e740 1 Processor -- start 2024-08-31T05:35:32.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.729+0000 7fc4f4ff9640 1 -- 172.21.15.5:0/2289654064 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fc4f0005020 con 0x7fc4f810db90 2024-08-31T05:35:32.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.729+0000 7fc503b9e740 1 -- start start 2024-08-31T05:35:32.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.729+0000 7fc503b9e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5584ed4fa070 0x5584ed89f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:32.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.729+0000 7fc503b9e740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5584ed4d11b0 0x5584ed89f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:32.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.729+0000 7fc503b9e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5584ed4d9390 0x5584ed89fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:32.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.729+0000 7fc503b9e740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5584ed816680 con 0x5584ed4d11b0 2024-08-31T05:35:32.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.729+0000 7fc503b9e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5584ed805c10 con 0x5584ed4d9390 2024-08-31T05:35:32.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.729+0000 7fc503b9e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5584ed809bc0 con 0x5584ed4fa070 2024-08-31T05:35:32.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.729+0000 7fc4f6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5584ed4d11b0 0x5584ed89f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:32.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.729+0000 7fc4effff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5584ed4fa070 0x5584ed89f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:32.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.729+0000 7fc4effff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5584ed4d9390 0x5584ed89fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:32.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.729+0000 7fc4f6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5584ed4d11b0 0x5584ed89f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43404/0 (socket says 172.21.15.5:43404) 2024-08-31T05:35:32.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.729+0000 7fc4f6ffd640 1 -- 172.21.15.5:0/2558676908 learned_addr learned my addr 172.21.15.5:0/2558676908 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:32.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.730+0000 7fc4f6ffd640 1 -- 172.21.15.5:0/2558676908 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5584ed4fa070 msgr2=0x5584ed89f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:32.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.730+0000 7fc4f6ffd640 1 --2- 172.21.15.5:0/2558676908 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5584ed4fa070 0x5584ed89f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:32.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.730+0000 7fc4f6ffd640 1 -- 172.21.15.5:0/2558676908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5584ed4d9390 msgr2=0x5584ed89fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:32.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.730+0000 7fc4f6ffd640 1 --2- 172.21.15.5:0/2558676908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5584ed4d9390 0x5584ed89fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:32.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.730+0000 7fc4f6ffd640 1 -- 172.21.15.5:0/2558676908 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584ed565650 con 0x5584ed4d11b0 2024-08-31T05:35:32.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.730+0000 7fc4effff640 1 --2- 172.21.15.5:0/2558676908 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5584ed4fa070 0x5584ed89f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:35:32.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.730+0000 7fc4f4ff9640 1 --2- 172.21.15.5:0/2289654064 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc4e40b4ca0 0x7fc4e40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:32.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.730+0000 7fc4effff640 1 --2- 172.21.15.5:0/2289654064 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc4e40b4ca0 0x7fc4e40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:32.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.730+0000 7fc4f6ffd640 1 --2- 172.21.15.5:0/2558676908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5584ed4d11b0 0x5584ed89f850 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fc4e8013800 tx=0x7fc4e8013cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b22b36039d2a94b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:32.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.730+0000 7fc4f4ff9640 1 -- 172.21.15.5:0/2289654064 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fc4f00e5f10 con 0x7fc4f810db90 2024-08-31T05:35:32.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.731+0000 7fc4ed7fa640 1 -- 172.21.15.5:0/2558676908 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e8021070 con 0x5584ed4d11b0 2024-08-31T05:35:32.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.731+0000 7fc4ed7fa640 1 -- 172.21.15.5:0/2558676908 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4e800ee40 con 0x5584ed4d11b0 2024-08-31T05:35:32.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.731+0000 7fc4ed7fa640 1 -- 172.21.15.5:0/2558676908 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e801b370 con 0x5584ed4d11b0 2024-08-31T05:35:32.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.732+0000 7fc503b9e740 1 -- 172.21.15.5:0/2558676908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5584ed4d11b0 msgr2=0x5584ed89f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:32.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.732+0000 7fc503b9e740 1 --2- 172.21.15.5:0/2558676908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5584ed4d11b0 0x5584ed89f850 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fc4e8013800 tx=0x7fc4e8013cc0 comp rx=0 tx=0).stop 2024-08-31T05:35:32.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.732+0000 7fc4effff640 1 --2- 172.21.15.5:0/2289654064 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc4e40b4ca0 0x7fc4e40b71b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc4e002aa00 tx=0x7fc4e0041040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:32.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.732+0000 7fc503b9e740 1 -- 172.21.15.5:0/2558676908 shutdown_connections 2024-08-31T05:35:32.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.732+0000 7fc503b9e740 1 --2- 172.21.15.5:0/2558676908 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5584ed4d9390 0x5584ed89fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:32.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.732+0000 7fc503b9e740 1 --2- 172.21.15.5:0/2558676908 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5584ed4d11b0 0x5584ed89f850 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:32.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.732+0000 7fc503b9e740 1 --2- 172.21.15.5:0/2558676908 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5584ed4fa070 0x5584ed89f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:32.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.732+0000 7fc503b9e740 1 -- 172.21.15.5:0/2558676908 >> 172.21.15.5:0/2558676908 conn(0x5584ed4ee460 msgr2=0x5584ed89d200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:32.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.732+0000 7fc503b9e740 1 -- 172.21.15.5:0/2558676908 shutdown_connections 2024-08-31T05:35:32.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.732+0000 7fc503b9e740 1 -- 172.21.15.5:0/2558676908 wait complete. 2024-08-31T05:35:32.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.732+0000 7fc503b9e740 1 -- start start 2024-08-31T05:35:32.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.732+0000 7fc503b9e740 1 Processor -- start 2024-08-31T05:35:32.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.733+0000 7fc503b9e740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5584ed4d11b0 0x5584ed8aaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:32.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.733+0000 7fc503b9e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5584ed4d9390 0x5584ed8aafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:32.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.733+0000 7fc503b9e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5584ed4fa070 0x5584ed8b6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:32.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.733+0000 7fc503b9e740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5584ed668700 con 0x5584ed4d11b0 2024-08-31T05:35:32.819 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:35:32.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.733+0000 7fc503b9e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5584ed78c750 con 0x5584ed4fa070 2024-08-31T05:35:32.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.733+0000 7fc503b9e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5584ed8adaf0 con 0x5584ed4d9390 2024-08-31T05:35:32.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.733+0000 7fc4f6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5584ed4d11b0 0x5584ed8aaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:32.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.733+0000 7fc503b9e740 10 client.0 _ll_register_callbacks cb 0x5584ed7bbe10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:35:32.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.733+0000 7fc4f6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5584ed4d11b0 0x5584ed8aaa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43412/0 (socket says 172.21.15.5:43412) 2024-08-31T05:35:32.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.733+0000 7fc4f6ffd640 1 -- 172.21.15.5:0/2958800160 learned_addr learned my addr 172.21.15.5:0/2958800160 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:32.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.733+0000 7fc4effff640 1 --2- 172.21.15.5:0/2958800160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5584ed4d9390 0x5584ed8aafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:32.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.733+0000 7fc4f77fe640 1 --2- 172.21.15.5:0/2958800160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5584ed4fa070 0x5584ed8b6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:32.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.733+0000 7fc4f6ffd640 1 -- 172.21.15.5:0/2958800160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5584ed4d9390 msgr2=0x5584ed8aafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:32.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.733+0000 7fc4f6ffd640 1 --2- 172.21.15.5:0/2958800160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5584ed4d9390 0x5584ed8aafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:32.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.733+0000 7fc4f6ffd640 1 -- 172.21.15.5:0/2958800160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5584ed4fa070 msgr2=0x5584ed8b6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:32.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.733+0000 7fc4f6ffd640 1 --2- 172.21.15.5:0/2958800160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5584ed4fa070 0x5584ed8b6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:32.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.733+0000 7fc4f6ffd640 1 -- 172.21.15.5:0/2958800160 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584ed7c5900 con 0x5584ed4d11b0 2024-08-31T05:35:32.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.733+0000 7fc4effff640 1 --2- 172.21.15.5:0/2958800160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5584ed4d9390 0x5584ed8aafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:35:32.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.733+0000 7fc4f6ffd640 1 --2- 172.21.15.5:0/2958800160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5584ed4d11b0 0x5584ed8aaa70 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fc4e801ca60 tx=0x7fc4e800ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9994a45b7514be07 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:32.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.733+0000 7fc4de7fc640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:35:32.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.733+0000 7fc4de7fc640 1 -- 172.21.15.5:0/2958800160 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e8029020 con 0x5584ed4d11b0 2024-08-31T05:35:32.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.733+0000 7fc4de7fc640 1 -- 172.21.15.5:0/2958800160 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fc4e801c410 con 0x5584ed4d11b0 2024-08-31T05:35:32.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.733+0000 7fc503b9e740 1 -- 172.21.15.5:0/2958800160 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5584ed8185d0 con 0x5584ed4d11b0 2024-08-31T05:35:32.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.734+0000 7fc4de7fc640 1 -- 172.21.15.5:0/2958800160 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc4e8034050 con 0x5584ed4d11b0 2024-08-31T05:35:32.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.734+0000 7fc503b9e740 10 client.17028 fetch_fsmap learned FSMap version 34 2024-08-31T05:35:32.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.734+0000 7fc503b9e740 1 -- 172.21.15.5:0/2958800160 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5584ed8b9890 con 0x5584ed4d11b0 2024-08-31T05:35:32.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.734+0000 7fc4de7fc640 1 -- 172.21.15.5:0/2958800160 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5584ed8185d0 con 0x5584ed4d11b0 2024-08-31T05:35:32.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.734+0000 7fc4de7fc640 1 -- 172.21.15.5:0/2958800160 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fc4e8024030 con 0x5584ed4d11b0 2024-08-31T05:35:32.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.734+0000 7fc503b9e740 10 client.17028 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:35:32.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.734+0000 7fc503b9e740 10 client.17028 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-31T05:35:32.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.734+0000 7fc503b9e740 20 client.17028 populate_metadata read hostname 'smithi005' 2024-08-31T05:35:32.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.734+0000 7fc503b9e740 1 --2- 172.21.15.5:0/2958800160 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5584ed4b89f0 0x5584ed8bcca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:32.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.734+0000 7fc503b9e740 4 client.17028 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:35:32.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.734+0000 7fc503b9e740 1 -- 172.21.15.5:0/2958800160 --> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5584ed814070 con 0x5584ed4b89f0 2024-08-31T05:35:32.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.734+0000 7fc4effff640 1 --2- 172.21.15.5:0/2958800160 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5584ed4b89f0 0x5584ed8bcca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:32.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.735+0000 7fc4de7fc640 10 client.17028 ms_handle_connect on v2:172.21.15.70:6834/2061504114 2024-08-31T05:35:32.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.735+0000 7fc4effff640 1 --2- 172.21.15.5:0/2958800160 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5584ed4b89f0 0x5584ed8bcca0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ae8f8301e588a4d3 server_cookie=a37ef7843b5ecd0d in_seq=0 out_seq=0 2024-08-31T05:35:32.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.735+0000 7fc4de7fc640 1 -- 172.21.15.5:0/2958800160 <== mds.3 v2:172.21.15.70:6834/2061504114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5584ed814070 con 0x5584ed4b89f0 2024-08-31T05:35:32.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.735+0000 7fc4de7fc640 10 client.17028 handle_command_reply: tid=0 2024-08-31T05:35:32.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.735+0000 7fc503b9e740 1 client.17028 shutdown 2024-08-31T05:35:32.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.736+0000 7fc503b9e740 1 -- 172.21.15.5:0/2958800160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5584ed4d11b0 msgr2=0x5584ed8aaa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:32.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.736+0000 7fc503b9e740 1 --2- 172.21.15.5:0/2958800160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5584ed4d11b0 0x5584ed8aaa70 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fc4e801ca60 tx=0x7fc4e800ebc0 comp rx=0 tx=0).stop 2024-08-31T05:35:32.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.736+0000 7fc503b9e740 1 -- 172.21.15.5:0/2958800160 shutdown_connections 2024-08-31T05:35:32.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.736+0000 7fc503b9e740 1 --2- 172.21.15.5:0/2958800160 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5584ed4b89f0 0x5584ed8bcca0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:32.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.736+0000 7fc503b9e740 1 --2- 172.21.15.5:0/2958800160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5584ed4fa070 0x5584ed8b6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:32.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.736+0000 7fc4de7fc640 0 client.17028 ms_handle_reset on v2:172.21.15.70:6834/2061504114 2024-08-31T05:35:32.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.736+0000 7fc503b9e740 1 --2- 172.21.15.5:0/2958800160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5584ed4d9390 0x5584ed8aafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:32.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.736+0000 7fc503b9e740 1 --2- 172.21.15.5:0/2958800160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5584ed4d11b0 0x5584ed8aaa70 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:32.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.736+0000 7fc503b9e740 1 -- 172.21.15.5:0/2958800160 >> 172.21.15.5:0/2958800160 conn(0x5584ed4ee460 msgr2=0x5584ed8a24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:32.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.736+0000 7fc503b9e740 1 -- 172.21.15.5:0/2958800160 shutdown_connections 2024-08-31T05:35:32.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.736+0000 7fc503b9e740 1 -- 172.21.15.5:0/2958800160 wait complete. 2024-08-31T05:35:32.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.736+0000 7fc503b9e740 20 client.17028 trim_cache size 0 max 16384 2024-08-31T05:35:32.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.751+0000 7fc503b9e740 1 Processor -- start 2024-08-31T05:35:32.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.751+0000 7fc503b9e740 1 -- start start 2024-08-31T05:35:32.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.752+0000 7fc503b9e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5584ed4d11b0 0x5584ed8a92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:32.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.752+0000 7fc503b9e740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5584ed4d9390 0x5584ed8a9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:32.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.752+0000 7fc503b9e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5584ed4fa070 0x5584ed8a2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:32.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.752+0000 7fc503b9e740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f81ae9f0 con 0x5584ed4d9390 2024-08-31T05:35:32.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.752+0000 7fc503b9e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f81b0530 con 0x5584ed4fa070 2024-08-31T05:35:32.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.752+0000 7fc503b9e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f81af0c0 con 0x5584ed4d11b0 2024-08-31T05:35:32.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.752+0000 7fc4effff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5584ed4d9390 0x5584ed8a9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:32.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.752+0000 7fc4f6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5584ed4d11b0 0x5584ed8a92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:32.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.752+0000 7fc4effff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5584ed4d9390 0x5584ed8a9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43420/0 (socket says 172.21.15.5:43420) 2024-08-31T05:35:32.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.752+0000 7fc4effff640 1 -- 172.21.15.5:0/1971988306 learned_addr learned my addr 172.21.15.5:0/1971988306 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:32.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.752+0000 7fc4f6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5584ed4d11b0 0x5584ed8a92f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:41948/0 (socket says 172.21.15.5:41948) 2024-08-31T05:35:32.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.752+0000 7fc4f77fe640 1 --2- 172.21.15.5:0/1971988306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5584ed4fa070 0x5584ed8a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:32.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.752+0000 7fc4effff640 1 -- 172.21.15.5:0/1971988306 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5584ed4d11b0 msgr2=0x5584ed8a92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:32.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.752+0000 7fc4effff640 1 --2- 172.21.15.5:0/1971988306 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5584ed4d11b0 0x5584ed8a92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:32.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.752+0000 7fc4effff640 1 -- 172.21.15.5:0/1971988306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5584ed4fa070 msgr2=0x5584ed8a2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:32.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.752+0000 7fc4effff640 1 --2- 172.21.15.5:0/1971988306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5584ed4fa070 0x5584ed8a2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:32.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.752+0000 7fc4effff640 1 -- 172.21.15.5:0/1971988306 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584ed8abb10 con 0x5584ed4d9390 2024-08-31T05:35:32.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.752+0000 7fc4f77fe640 1 --2- 172.21.15.5:0/1971988306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5584ed4fa070 0x5584ed8a2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:35:32.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.753+0000 7fc4effff640 1 --2- 172.21.15.5:0/1971988306 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5584ed4d9390 0x5584ed8a9830 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fc4e0031440 tx=0x7fc4e0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=360e366f65f7857a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:32.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.753+0000 7fc4ecff9640 1 -- 172.21.15.5:0/1971988306 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e0035070 con 0x5584ed4d9390 2024-08-31T05:35:32.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.753+0000 7fc4ecff9640 1 -- 172.21.15.5:0/1971988306 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4e0004c70 con 0x5584ed4d9390 2024-08-31T05:35:32.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.753+0000 7fc4ecff9640 1 -- 172.21.15.5:0/1971988306 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e0055710 con 0x5584ed4d9390 2024-08-31T05:35:32.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.754+0000 7fc503b9e740 1 -- 172.21.15.5:0/1971988306 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5584ed4d9390 msgr2=0x5584ed8a9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:32.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.754+0000 7fc503b9e740 1 --2- 172.21.15.5:0/1971988306 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5584ed4d9390 0x5584ed8a9830 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fc4e0031440 tx=0x7fc4e0000bc0 comp rx=0 tx=0).stop 2024-08-31T05:35:32.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.754+0000 7fc503b9e740 1 -- 172.21.15.5:0/1971988306 shutdown_connections 2024-08-31T05:35:32.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.754+0000 7fc503b9e740 1 --2- 172.21.15.5:0/1971988306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5584ed4fa070 0x5584ed8a2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:32.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.754+0000 7fc503b9e740 1 --2- 172.21.15.5:0/1971988306 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5584ed4d9390 0x5584ed8a9830 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:32.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.754+0000 7fc503b9e740 1 --2- 172.21.15.5:0/1971988306 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5584ed4d11b0 0x5584ed8a92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:32.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.754+0000 7fc503b9e740 1 -- 172.21.15.5:0/1971988306 >> 172.21.15.5:0/1971988306 conn(0x5584ed4ee460 msgr2=0x5584ed8a5bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:32.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.754+0000 7fc503b9e740 1 -- 172.21.15.5:0/1971988306 shutdown_connections 2024-08-31T05:35:32.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.754+0000 7fc503b9e740 1 -- 172.21.15.5:0/1971988306 wait complete. 2024-08-31T05:35:32.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.755+0000 7fc503b9e740 1 -- start start 2024-08-31T05:35:32.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.755+0000 7fc503b9e740 1 Processor -- start 2024-08-31T05:35:32.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.755+0000 7fc503b9e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5584ed4d11b0 0x5584ed8bd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:32.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.755+0000 7fc503b9e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5584ed4d9390 0x5584ed8bdce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:32.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.755+0000 7fc503b9e740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5584ed4fa070 0x5584ed91e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:32.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.755+0000 7fc503b9e740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f81afe60 con 0x5584ed4fa070 2024-08-31T05:35:32.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.755+0000 7fc503b9e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f81af790 con 0x5584ed4d9390 2024-08-31T05:35:32.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.755+0000 7fc503b9e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f81ac9d0 con 0x5584ed4d11b0 2024-08-31T05:35:32.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.755+0000 7fc503b9e740 10 client.0 _ll_register_callbacks cb 0x7fc4e801f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:35:32.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.755+0000 7fc4f77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5584ed4fa070 0x5584ed91e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:32.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.755+0000 7fc4f77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5584ed4fa070 0x5584ed91e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43432/0 (socket says 172.21.15.5:43432) 2024-08-31T05:35:32.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.755+0000 7fc4f77fe640 1 -- 172.21.15.5:0/17843952 learned_addr learned my addr 172.21.15.5:0/17843952 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:32.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.755+0000 7fc4f6ffd640 1 --2- 172.21.15.5:0/17843952 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5584ed4d11b0 0x5584ed8bd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:32.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.755+0000 7fc4effff640 1 --2- 172.21.15.5:0/17843952 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5584ed4d9390 0x5584ed8bdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:32.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.756+0000 7fc4f77fe640 1 -- 172.21.15.5:0/17843952 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5584ed4d11b0 msgr2=0x5584ed8bd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:32.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.756+0000 7fc4f77fe640 1 --2- 172.21.15.5:0/17843952 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5584ed4d11b0 0x5584ed8bd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:32.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.756+0000 7fc4f77fe640 1 -- 172.21.15.5:0/17843952 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5584ed4d9390 msgr2=0x5584ed8bdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:32.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.756+0000 7fc4f77fe640 1 --2- 172.21.15.5:0/17843952 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5584ed4d9390 0x5584ed8bdce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:32.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.756+0000 7fc4f77fe640 1 -- 172.21.15.5:0/17843952 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584ed91ea40 con 0x5584ed4fa070 2024-08-31T05:35:32.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.756+0000 7fc4f77fe640 1 --2- 172.21.15.5:0/17843952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5584ed4fa070 0x5584ed91e3d0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fc4f00a82a0 tx=0x7fc4f0005650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3280ea9a917ae0b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:32.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.756+0000 7fc4de7fc640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:35:32.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.756+0000 7fc4de7fc640 1 -- 172.21.15.5:0/17843952 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4f00ac920 con 0x5584ed4fa070 2024-08-31T05:35:32.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.756+0000 7fc4de7fc640 1 -- 172.21.15.5:0/17843952 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fc4f00b52c0 con 0x5584ed4fa070 2024-08-31T05:35:32.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.756+0000 7fc503b9e740 1 -- 172.21.15.5:0/17843952 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4e0004c70 con 0x5584ed4fa070 2024-08-31T05:35:32.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.756+0000 7fc4de7fc640 1 -- 172.21.15.5:0/17843952 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc4f00ac220 con 0x5584ed4fa070 2024-08-31T05:35:32.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.756+0000 7fc503b9e740 10 client.17034 fetch_fsmap learned FSMap version 34 2024-08-31T05:35:32.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.756+0000 7fc503b9e740 1 -- 172.21.15.5:0/17843952 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5584ed926f60 con 0x5584ed4fa070 2024-08-31T05:35:32.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.757+0000 7fc4de7fc640 1 -- 172.21.15.5:0/17843952 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4e0004c70 con 0x5584ed4fa070 2024-08-31T05:35:32.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.757+0000 7fc4de7fc640 1 -- 172.21.15.5:0/17843952 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fc4f00aaef0 con 0x5584ed4fa070 2024-08-31T05:35:32.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.757+0000 7fc503b9e740 10 client.17034 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:35:32.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.757+0000 7fc503b9e740 10 client.17034 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-31T05:35:32.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.757+0000 7fc503b9e740 20 client.17034 populate_metadata read hostname 'smithi005' 2024-08-31T05:35:32.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.757+0000 7fc503b9e740 1 --2- 172.21.15.5:0/17843952 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5584ed48dda0 0x5584ed9296f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:32.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.757+0000 7fc503b9e740 4 client.17034 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:35:32.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.757+0000 7fc503b9e740 1 -- 172.21.15.5:0/17843952 --> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5584ed8117b0 con 0x5584ed48dda0 2024-08-31T05:35:32.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.757+0000 7fc4f6ffd640 1 --2- 172.21.15.5:0/17843952 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5584ed48dda0 0x5584ed9296f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:32.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.757+0000 7fc4de7fc640 10 client.17034 ms_handle_connect on v2:172.21.15.70:6834/2061504114 2024-08-31T05:35:32.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.757+0000 7fc4f6ffd640 1 --2- 172.21.15.5:0/17843952 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5584ed48dda0 0x5584ed9296f0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3bea03f611ad0983 server_cookie=d2b10835fe636a37 in_seq=0 out_seq=0 2024-08-31T05:35:32.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.758+0000 7fc4de7fc640 1 -- 172.21.15.5:0/17843952 <== mds.3 v2:172.21.15.70:6834/2061504114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5584ed8117b0 con 0x5584ed48dda0 2024-08-31T05:35:32.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.758+0000 7fc4de7fc640 10 client.17034 handle_command_reply: tid=0 2024-08-31T05:35:32.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.758+0000 7fc503b9e740 1 client.17034 shutdown 2024-08-31T05:35:32.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.758+0000 7fc503b9e740 1 -- 172.21.15.5:0/17843952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5584ed4fa070 msgr2=0x5584ed91e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:32.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.758+0000 7fc503b9e740 1 --2- 172.21.15.5:0/17843952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5584ed4fa070 0x5584ed91e3d0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fc4f00a82a0 tx=0x7fc4f0005650 comp rx=0 tx=0).stop 2024-08-31T05:35:32.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.758+0000 7fc503b9e740 1 -- 172.21.15.5:0/17843952 shutdown_connections 2024-08-31T05:35:32.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.758+0000 7fc503b9e740 1 --2- 172.21.15.5:0/17843952 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5584ed48dda0 0x5584ed9296f0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:32.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.758+0000 7fc503b9e740 1 --2- 172.21.15.5:0/17843952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5584ed4fa070 0x5584ed91e3d0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:32.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.758+0000 7fc503b9e740 1 --2- 172.21.15.5:0/17843952 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5584ed4d9390 0x5584ed8bdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:32.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.758+0000 7fc4de7fc640 0 client.17034 ms_handle_reset on v2:172.21.15.70:6834/2061504114 2024-08-31T05:35:32.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.758+0000 7fc503b9e740 1 --2- 172.21.15.5:0/17843952 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5584ed4d11b0 0x5584ed8bd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:32.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.758+0000 7fc503b9e740 1 -- 172.21.15.5:0/17843952 >> 172.21.15.5:0/17843952 conn(0x5584ed4ee460 msgr2=0x5584ed8a5bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:32.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.758+0000 7fc503b9e740 1 -- 172.21.15.5:0/17843952 shutdown_connections 2024-08-31T05:35:32.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.758+0000 7fc503b9e740 1 -- 172.21.15.5:0/17843952 wait complete. 2024-08-31T05:35:32.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.758+0000 7fc503b9e740 20 client.17034 trim_cache size 0 max 16384 2024-08-31T05:35:32.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.759+0000 7fc4fd629640 1 -- 172.21.15.5:0/2289654064 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc4e40b4ca0 msgr2=0x7fc4e40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:32.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.759+0000 7fc4fd629640 1 --2- 172.21.15.5:0/2289654064 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc4e40b4ca0 0x7fc4e40b71b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc4e002aa00 tx=0x7fc4e0041040 comp rx=0 tx=0).stop 2024-08-31T05:35:32.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.759+0000 7fc4fd629640 1 -- 172.21.15.5:0/2289654064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4f810db90 msgr2=0x7fc4f819fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:32.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.759+0000 7fc4fd629640 1 --2- 172.21.15.5:0/2289654064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4f810db90 0x7fc4f819fa50 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fc4f000eb10 tx=0x7fc4f000c2d0 comp rx=0 tx=0).stop 2024-08-31T05:35:32.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.759+0000 7fc4fd629640 1 -- 172.21.15.5:0/2289654064 shutdown_connections 2024-08-31T05:35:32.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.759+0000 7fc4fd629640 1 --2- 172.21.15.5:0/2289654064 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc4e40b4ca0 0x7fc4e40b71b0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:32.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.759+0000 7fc4fd629640 1 --2- 172.21.15.5:0/2289654064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4f810db90 0x7fc4f819fa50 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:32.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.759+0000 7fc4fd629640 1 --2- 172.21.15.5:0/2289654064 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4f8105010 0x7fc4f819a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:32.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.759+0000 7fc4fd629640 1 --2- 172.21.15.5:0/2289654064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc4f81045e0 0x7fc4f819a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:32.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.759+0000 7fc4fd629640 1 -- 172.21.15.5:0/2289654064 >> 172.21.15.5:0/2289654064 conn(0x7fc4f80794d0 msgr2=0x7fc4f8100540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:32.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.759+0000 7fc4fd629640 1 -- 172.21.15.5:0/2289654064 shutdown_connections 2024-08-31T05:35:32.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:32.759+0000 7fc4fd629640 1 -- 172.21.15.5:0/2289654064 wait complete. 2024-08-31T05:35:32.919 INFO:tasks.workunit.client.0.smithi005.stdout: 1 612347 12.03 MB/sec execute 140 sec latency 20.484 ms 2024-08-31T05:35:32.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:35:32 smithi005 ceph-mon[18602]: pgmap v512: 129 pgs: 129 active+clean; 351 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.5 MiB/s wr, 215 op/s 2024-08-31T05:35:33.156 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:35:32 smithi050 ceph-mon[22146]: pgmap v512: 129 pgs: 129 active+clean; 351 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.5 MiB/s wr, 215 op/s 2024-08-31T05:35:33.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:35:32 smithi070 ceph-mon[22316]: pgmap v512: 129 pgs: 129 active+clean; 351 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.5 MiB/s wr, 215 op/s 2024-08-31T05:35:33.579 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T05:35:33.849 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:35:33.920 INFO:tasks.workunit.client.0.smithi005.stdout: 1 614730 12.04 MB/sec execute 141 sec latency 18.056 ms 2024-08-31T05:35:34.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.422+0000 7f09e1084640 1 -- 172.21.15.5:0/3112734837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09dc103920 msgr2=0x7f09dc103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:34.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.422+0000 7f09e1084640 1 --2- 172.21.15.5:0/3112734837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09dc103920 0x7f09dc103d30 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f09cc009900 tx=0x7f09cc02a410 comp rx=0 tx=0).stop 2024-08-31T05:35:34.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.422+0000 7f09e1084640 1 -- 172.21.15.5:0/3112734837 shutdown_connections 2024-08-31T05:35:34.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.422+0000 7f09e1084640 1 --2- 172.21.15.5:0/3112734837 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09dc109bb0 0x7f09dc1103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:34.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.422+0000 7f09e1084640 1 --2- 172.21.15.5:0/3112734837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09dc109260 0x7f09dc109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:34.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.422+0000 7f09e1084640 1 --2- 172.21.15.5:0/3112734837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09dc103920 0x7f09dc103d30 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:34.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.422+0000 7f09e1084640 1 -- 172.21.15.5:0/3112734837 >> 172.21.15.5:0/3112734837 conn(0x7f09dc0ff350 msgr2=0x7f09dc1017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:34.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.422+0000 7f09e1084640 1 -- 172.21.15.5:0/3112734837 shutdown_connections 2024-08-31T05:35:34.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.422+0000 7f09e1084640 1 -- 172.21.15.5:0/3112734837 wait complete. 2024-08-31T05:35:34.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.423+0000 7f09e1084640 1 Processor -- start 2024-08-31T05:35:34.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.423+0000 7f09e1084640 1 -- start start 2024-08-31T05:35:34.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.424+0000 7f09e1084640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09dc103920 0x7f09dc19a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:34.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.424+0000 7f09e1084640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09dc109260 0x7f09dc19a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:34.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.424+0000 7f09e1084640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09dc109bb0 0x7f09dc19fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:34.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.424+0000 7f09e1084640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f09dc113870 con 0x7f09dc109260 2024-08-31T05:35:34.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.424+0000 7f09e1084640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f09dc1136f0 con 0x7f09dc109bb0 2024-08-31T05:35:34.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.424+0000 7f09e1084640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f09dc1139f0 con 0x7f09dc103920 2024-08-31T05:35:34.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.424+0000 7f09da59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09dc109260 0x7f09dc19a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:34.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.424+0000 7f09dad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09dc103920 0x7f09dc19a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:34.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.424+0000 7f09da59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09dc109260 0x7f09dc19a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43446/0 (socket says 172.21.15.5:43446) 2024-08-31T05:35:34.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.424+0000 7f09da59c640 1 -- 172.21.15.5:0/278855003 learned_addr learned my addr 172.21.15.5:0/278855003 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:34.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.424+0000 7f09db59e640 1 --2- 172.21.15.5:0/278855003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09dc109bb0 0x7f09dc19fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:34.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.424+0000 7f09db59e640 1 -- 172.21.15.5:0/278855003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09dc103920 msgr2=0x7f09dc19a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:34.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.424+0000 7f09db59e640 1 --2- 172.21.15.5:0/278855003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09dc103920 0x7f09dc19a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:34.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.424+0000 7f09db59e640 1 -- 172.21.15.5:0/278855003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09dc109260 msgr2=0x7f09dc19a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:34.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.424+0000 7f09db59e640 1 --2- 172.21.15.5:0/278855003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09dc109260 0x7f09dc19a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:34.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.424+0000 7f09db59e640 1 -- 172.21.15.5:0/278855003 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09dc1a0210 con 0x7f09dc109bb0 2024-08-31T05:35:34.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.424+0000 7f09da59c640 1 --2- 172.21.15.5:0/278855003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09dc109260 0x7f09dc19a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:35:34.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.425+0000 7f09db59e640 1 --2- 172.21.15.5:0/278855003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09dc109bb0 0x7f09dc19fae0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f09d4009fd0 tx=0x7f09d400ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:34.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.425+0000 7f09d3fff640 1 -- 172.21.15.5:0/278855003 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d400ce20 con 0x7f09dc109bb0 2024-08-31T05:35:34.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.425+0000 7f09e1084640 1 -- 172.21.15.5:0/278855003 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09dc1a0500 con 0x7f09dc109bb0 2024-08-31T05:35:34.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.425+0000 7f09d3fff640 1 -- 172.21.15.5:0/278855003 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09d4005020 con 0x7f09dc109bb0 2024-08-31T05:35:34.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.425+0000 7f09d3fff640 1 -- 172.21.15.5:0/278855003 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d4010690 con 0x7f09dc109bb0 2024-08-31T05:35:34.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.425+0000 7f09e1084640 1 -- 172.21.15.5:0/278855003 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09dc075390 con 0x7f09dc109bb0 2024-08-31T05:35:34.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.428+0000 7f09e75f9740 1 Processor -- start 2024-08-31T05:35:34.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.428+0000 7f09d3fff640 1 -- 172.21.15.5:0/278855003 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f09d4010830 con 0x7f09dc109bb0 2024-08-31T05:35:34.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.428+0000 7f09e75f9740 1 -- start start 2024-08-31T05:35:34.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.428+0000 7f09e75f9740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c87dbc070 0x560c88161310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:34.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.428+0000 7f09e75f9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c87d931b0 0x560c88161850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:34.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.428+0000 7f09e75f9740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c87d9b390 0x560c88161d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:34.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.428+0000 7f09e75f9740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x560c880d8680 con 0x560c87d9b390 2024-08-31T05:35:34.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.428+0000 7f09e75f9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560c880c7c10 con 0x560c87d931b0 2024-08-31T05:35:34.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.428+0000 7f09e75f9740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560c880cbbc0 con 0x560c87dbc070 2024-08-31T05:35:34.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.428+0000 7f09dad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c87d931b0 0x560c88161850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:34.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.428+0000 7f09da59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c87dbc070 0x560c88161310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:34.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.428+0000 7f09dad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c87d931b0 0x560c88161850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:39186/0 (socket says 172.21.15.5:39186) 2024-08-31T05:35:34.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.428+0000 7f09dad9d640 1 -- 172.21.15.5:0/2206667188 learned_addr learned my addr 172.21.15.5:0/2206667188 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:34.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.429+0000 7f09da59c640 1 --2- 172.21.15.5:0/2206667188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c87d9b390 0x560c88161d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:34.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.429+0000 7f09dad9d640 1 -- 172.21.15.5:0/2206667188 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c87dbc070 msgr2=0x560c88161310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:34.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.429+0000 7f09dad9d640 1 --2- 172.21.15.5:0/2206667188 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c87dbc070 0x560c88161310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:34.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.429+0000 7f09dad9d640 1 -- 172.21.15.5:0/2206667188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c87d9b390 msgr2=0x560c88161d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:34.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.429+0000 7f09dad9d640 1 --2- 172.21.15.5:0/2206667188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c87d9b390 0x560c88161d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:34.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.429+0000 7f09dad9d640 1 -- 172.21.15.5:0/2206667188 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c87e27650 con 0x560c87d931b0 2024-08-31T05:35:34.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.429+0000 7f09da59c640 1 --2- 172.21.15.5:0/2206667188 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c87dbc070 0x560c88161310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:35:34.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.429+0000 7f09dad9d640 1 --2- 172.21.15.5:0/2206667188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c87d931b0 0x560c88161850 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f09cc009900 tx=0x7f09cc032b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8f061261735e596 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:34.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.429+0000 7f09d3fff640 1 --2- 172.21.15.5:0/278855003 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f09c80b4ca0 0x7f09c80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:34.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.429+0000 7f09d17fa640 1 -- 172.21.15.5:0/2206667188 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09cc040070 con 0x560c87d931b0 2024-08-31T05:35:34.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.429+0000 7f09da59c640 1 --2- 172.21.15.5:0/278855003 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f09c80b4ca0 0x7f09c80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:34.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.429+0000 7f09d17fa640 1 -- 172.21.15.5:0/2206667188 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09cc004030 con 0x560c87d931b0 2024-08-31T05:35:34.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.430+0000 7f09d17fa640 1 -- 172.21.15.5:0/2206667188 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09cc035040 con 0x560c87d931b0 2024-08-31T05:35:34.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.430+0000 7f09d3fff640 1 -- 172.21.15.5:0/278855003 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f09d40e60e0 con 0x7f09dc109bb0 2024-08-31T05:35:34.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.431+0000 7f09e75f9740 1 -- 172.21.15.5:0/2206667188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c87d931b0 msgr2=0x560c88161850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:34.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.431+0000 7f09da59c640 1 --2- 172.21.15.5:0/278855003 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f09c80b4ca0 0x7f09c80b71b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f09dc102b30 tx=0x7f09c4005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:34.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.431+0000 7f09e75f9740 1 --2- 172.21.15.5:0/2206667188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c87d931b0 0x560c88161850 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f09cc009900 tx=0x7f09cc032b90 comp rx=0 tx=0).stop 2024-08-31T05:35:34.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.431+0000 7f09e75f9740 1 -- 172.21.15.5:0/2206667188 shutdown_connections 2024-08-31T05:35:34.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.431+0000 7f09e75f9740 1 --2- 172.21.15.5:0/2206667188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c87d9b390 0x560c88161d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:34.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.431+0000 7f09e75f9740 1 --2- 172.21.15.5:0/2206667188 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c87d931b0 0x560c88161850 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:34.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.431+0000 7f09e75f9740 1 --2- 172.21.15.5:0/2206667188 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c87dbc070 0x560c88161310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:34.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.431+0000 7f09e75f9740 1 -- 172.21.15.5:0/2206667188 >> 172.21.15.5:0/2206667188 conn(0x560c87db0460 msgr2=0x560c8815f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:34.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.431+0000 7f09e75f9740 1 -- 172.21.15.5:0/2206667188 shutdown_connections 2024-08-31T05:35:34.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.431+0000 7f09e75f9740 1 -- 172.21.15.5:0/2206667188 wait complete. 2024-08-31T05:35:34.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.431+0000 7f09e75f9740 1 -- start start 2024-08-31T05:35:34.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.431+0000 7f09e75f9740 1 Processor -- start 2024-08-31T05:35:34.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.432+0000 7f09e75f9740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c87d931b0 0x560c8816ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:34.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.432+0000 7f09e75f9740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c87d9b390 0x560c8816cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:34.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.432+0000 7f09e75f9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c87dbc070 0x560c88178db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:34.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.432+0000 7f09e75f9740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x560c87f2a700 con 0x560c87d931b0 2024-08-31T05:35:34.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.432+0000 7f09e75f9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560c8804e750 con 0x560c87dbc070 2024-08-31T05:35:34.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.432+0000 7f09e75f9740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560c8816fa90 con 0x560c87d9b390 2024-08-31T05:35:34.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.432+0000 7f09dad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c87d931b0 0x560c8816ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:34.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.432+0000 7f09dad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c87d931b0 0x560c8816ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43464/0 (socket says 172.21.15.5:43464) 2024-08-31T05:35:34.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.432+0000 7f09db59e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c87dbc070 0x560c88178db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:34.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.432+0000 7f09dad9d640 1 -- 172.21.15.5:0/2168732436 learned_addr learned my addr 172.21.15.5:0/2168732436 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:34.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.432+0000 7f09e75f9740 10 client.0 _ll_register_callbacks cb 0x560c8807de10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:35:34.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.432+0000 7f09da59c640 1 --2- 172.21.15.5:0/2168732436 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c87d9b390 0x560c8816cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:34.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.432+0000 7f09dad9d640 1 -- 172.21.15.5:0/2168732436 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c87d9b390 msgr2=0x560c8816cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:34.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.432+0000 7f09dad9d640 1 --2- 172.21.15.5:0/2168732436 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c87d9b390 0x560c8816cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:34.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.432+0000 7f09dad9d640 1 -- 172.21.15.5:0/2168732436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c87dbc070 msgr2=0x560c88178db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:34.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.432+0000 7f09dad9d640 1 --2- 172.21.15.5:0/2168732436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c87dbc070 0x560c88178db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:34.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.432+0000 7f09dad9d640 1 -- 172.21.15.5:0/2168732436 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c88087900 con 0x560c87d931b0 2024-08-31T05:35:34.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.432+0000 7f09db59e640 1 --2- 172.21.15.5:0/2168732436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c87dbc070 0x560c88178db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:35:34.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.432+0000 7f09dad9d640 1 --2- 172.21.15.5:0/2168732436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c87d931b0 0x560c8816ca80 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f09cc006010 tx=0x7f09cc02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=558bdf8ecdd62aaf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:34.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.432+0000 7f09c27fc640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:35:34.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.432+0000 7f09c27fc640 1 -- 172.21.15.5:0/2168732436 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09cc040070 con 0x560c87d931b0 2024-08-31T05:35:34.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.433+0000 7f09e75f9740 1 -- 172.21.15.5:0/2168732436 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f09cc004030 con 0x560c87d931b0 2024-08-31T05:35:34.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.433+0000 7f09c27fc640 1 -- 172.21.15.5:0/2168732436 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f09cc0316a0 con 0x560c87d931b0 2024-08-31T05:35:34.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.433+0000 7f09c27fc640 1 -- 172.21.15.5:0/2168732436 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f09cc056050 con 0x560c87d931b0 2024-08-31T05:35:34.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.433+0000 7f09e75f9740 10 client.17046 fetch_fsmap learned FSMap version 34 2024-08-31T05:35:34.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.433+0000 7f09e75f9740 1 -- 172.21.15.5:0/2168732436 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x560c8817b890 con 0x560c87d931b0 2024-08-31T05:35:34.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.433+0000 7f09c27fc640 1 -- 172.21.15.5:0/2168732436 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09cc004030 con 0x560c87d931b0 2024-08-31T05:35:34.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.433+0000 7f09c27fc640 1 -- 172.21.15.5:0/2168732436 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f09cc004b60 con 0x560c87d931b0 2024-08-31T05:35:34.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.433+0000 7f09e75f9740 10 client.17046 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:35:34.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.433+0000 7f09e75f9740 10 client.17046 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-31T05:35:34.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.433+0000 7f09e75f9740 20 client.17046 populate_metadata read hostname 'smithi005' 2024-08-31T05:35:34.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.433+0000 7f09e75f9740 1 --2- 172.21.15.5:0/2168732436 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x560c87d7a9f0 0x560c8817ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:34.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.433+0000 7f09e75f9740 4 client.17046 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:35:34.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.433+0000 7f09e75f9740 1 -- 172.21.15.5:0/2168732436 --> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560c880da5d0 con 0x560c87d7a9f0 2024-08-31T05:35:34.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.433+0000 7f09da59c640 1 --2- 172.21.15.5:0/2168732436 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x560c87d7a9f0 0x560c8817ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:34.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.434+0000 7f09c27fc640 10 client.17046 ms_handle_connect on v2:172.21.15.70:6836/2780036414 2024-08-31T05:35:34.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.434+0000 7f09da59c640 1 --2- 172.21.15.5:0/2168732436 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x560c87d7a9f0 0x560c8817ebf0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=575ecccd4435bc1f server_cookie=fcb540de4c9a712b in_seq=0 out_seq=0 2024-08-31T05:35:34.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.436+0000 7f09c27fc640 1 -- 172.21.15.5:0/2168732436 <== mds.2 v2:172.21.15.70:6836/2780036414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560c880da5d0 con 0x560c87d7a9f0 2024-08-31T05:35:34.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.436+0000 7f09c27fc640 10 client.17046 handle_command_reply: tid=0 2024-08-31T05:35:34.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.436+0000 7f09e75f9740 1 client.17046 shutdown 2024-08-31T05:35:34.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.436+0000 7f09e75f9740 1 -- 172.21.15.5:0/2168732436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c87d931b0 msgr2=0x560c8816ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:34.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.436+0000 7f09e75f9740 1 --2- 172.21.15.5:0/2168732436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c87d931b0 0x560c8816ca80 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f09cc006010 tx=0x7f09cc02a410 comp rx=0 tx=0).stop 2024-08-31T05:35:34.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.436+0000 7f09e75f9740 1 -- 172.21.15.5:0/2168732436 shutdown_connections 2024-08-31T05:35:34.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.436+0000 7f09e75f9740 1 --2- 172.21.15.5:0/2168732436 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x560c87d7a9f0 0x560c8817ebf0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:34.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.436+0000 7f09e75f9740 1 --2- 172.21.15.5:0/2168732436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c87dbc070 0x560c88178db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:34.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.436+0000 7f09e75f9740 1 --2- 172.21.15.5:0/2168732436 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c87d9b390 0x560c8816cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:34.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.436+0000 7f09c27fc640 0 client.17046 ms_handle_reset on v2:172.21.15.70:6836/2780036414 2024-08-31T05:35:34.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.436+0000 7f09e75f9740 1 --2- 172.21.15.5:0/2168732436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c87d931b0 0x560c8816ca80 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:34.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.436+0000 7f09e75f9740 1 -- 172.21.15.5:0/2168732436 >> 172.21.15.5:0/2168732436 conn(0x560c87db0460 msgr2=0x560c881644a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:34.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.436+0000 7f09e75f9740 1 -- 172.21.15.5:0/2168732436 shutdown_connections 2024-08-31T05:35:34.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.436+0000 7f09e75f9740 1 -- 172.21.15.5:0/2168732436 wait complete. 2024-08-31T05:35:34.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.436+0000 7f09e75f9740 20 client.17046 trim_cache size 0 max 16384 2024-08-31T05:35:34.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.451+0000 7f09e75f9740 1 Processor -- start 2024-08-31T05:35:34.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.451+0000 7f09e75f9740 1 -- start start 2024-08-31T05:35:34.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.451+0000 7f09e75f9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c87d931b0 0x560c8816e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:34.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.451+0000 7f09e75f9740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c87d9b390 0x560c88169c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:34.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.451+0000 7f09e75f9740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c87dbc070 0x560c8816a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:34.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.451+0000 7f09e75f9740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f09dc1b2e40 con 0x560c87dbc070 2024-08-31T05:35:34.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.451+0000 7f09e75f9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f09dc1b4980 con 0x560c87d931b0 2024-08-31T05:35:34.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.451+0000 7f09e75f9740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f09dc1b3510 con 0x560c87d9b390 2024-08-31T05:35:34.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.452+0000 7f09dad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c87d931b0 0x560c8816e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:34.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.452+0000 7f09dad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c87d931b0 0x560c8816e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:39212/0 (socket says 172.21.15.5:39212) 2024-08-31T05:35:34.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.452+0000 7f09dad9d640 1 -- 172.21.15.5:0/3847825364 learned_addr learned my addr 172.21.15.5:0/3847825364 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:34.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.452+0000 7f09db59e640 1 --2- 172.21.15.5:0/3847825364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c87dbc070 0x560c8816a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:34.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.452+0000 7f09da59c640 1 --2- 172.21.15.5:0/3847825364 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c87d9b390 0x560c88169c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:34.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.452+0000 7f09dad9d640 1 -- 172.21.15.5:0/3847825364 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c87d9b390 msgr2=0x560c88169c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:34.475 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:35:34.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.452+0000 7f09dad9d640 1 --2- 172.21.15.5:0/3847825364 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c87d9b390 0x560c88169c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:34.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.452+0000 7f09dad9d640 1 -- 172.21.15.5:0/3847825364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c87dbc070 msgr2=0x560c8816a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:34.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.452+0000 7f09dad9d640 1 --2- 172.21.15.5:0/3847825364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c87dbc070 0x560c8816a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:34.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.452+0000 7f09dad9d640 1 -- 172.21.15.5:0/3847825364 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c88163600 con 0x560c87d931b0 2024-08-31T05:35:34.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.452+0000 7f09dad9d640 1 --2- 172.21.15.5:0/3847825364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c87d931b0 0x560c8816e6b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f09cc004f80 tx=0x7f09cc003670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=386bf7fe0f1d6698 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:34.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.452+0000 7f09d0ff9640 1 -- 172.21.15.5:0/3847825364 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09cc05f070 con 0x560c87d931b0 2024-08-31T05:35:34.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.452+0000 7f09d0ff9640 1 -- 172.21.15.5:0/3847825364 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09cc04d070 con 0x560c87d931b0 2024-08-31T05:35:34.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.452+0000 7f09d0ff9640 1 -- 172.21.15.5:0/3847825364 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09cc040030 con 0x560c87d931b0 2024-08-31T05:35:34.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.453+0000 7f09e75f9740 1 -- 172.21.15.5:0/3847825364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c87d931b0 msgr2=0x560c8816e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:34.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.453+0000 7f09e75f9740 1 --2- 172.21.15.5:0/3847825364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c87d931b0 0x560c8816e6b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f09cc004f80 tx=0x7f09cc003670 comp rx=0 tx=0).stop 2024-08-31T05:35:34.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.453+0000 7f09e75f9740 1 -- 172.21.15.5:0/3847825364 shutdown_connections 2024-08-31T05:35:34.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.453+0000 7f09e75f9740 1 --2- 172.21.15.5:0/3847825364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c87dbc070 0x560c8816a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:34.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.453+0000 7f09e75f9740 1 --2- 172.21.15.5:0/3847825364 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c87d9b390 0x560c88169c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:34.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.453+0000 7f09e75f9740 1 --2- 172.21.15.5:0/3847825364 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c87d931b0 0x560c8816e6b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:34.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.453+0000 7f09e75f9740 1 -- 172.21.15.5:0/3847825364 >> 172.21.15.5:0/3847825364 conn(0x560c87db0460 msgr2=0x560c8816dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:34.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.454+0000 7f09e75f9740 1 -- 172.21.15.5:0/3847825364 shutdown_connections 2024-08-31T05:35:34.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.454+0000 7f09e75f9740 1 -- 172.21.15.5:0/3847825364 wait complete. 2024-08-31T05:35:34.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.454+0000 7f09e75f9740 1 -- start start 2024-08-31T05:35:34.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.454+0000 7f09e75f9740 1 Processor -- start 2024-08-31T05:35:34.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.454+0000 7f09e75f9740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c87d931b0 0x560c881dd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:34.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.454+0000 7f09e75f9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c87d9b390 0x560c881dd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:34.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.454+0000 7f09e75f9740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c87dbc070 0x560c881ddd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:34.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.454+0000 7f09e75f9740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f09dc1b42b0 con 0x560c87dbc070 2024-08-31T05:35:34.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.454+0000 7f09e75f9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f09dc1b3be0 con 0x560c87d9b390 2024-08-31T05:35:34.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.454+0000 7f09e75f9740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f09dc1b0e20 con 0x560c87d931b0 2024-08-31T05:35:34.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.454+0000 7f09e75f9740 10 client.0 _ll_register_callbacks cb 0x7f09c4009e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:35:34.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.455+0000 7f09da59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c87d9b390 0x560c881dd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:34.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.455+0000 7f09db59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c87dbc070 0x560c881ddd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:34.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.455+0000 7f09dad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c87d931b0 0x560c881dd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:34.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.455+0000 7f09da59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c87d9b390 0x560c881dd840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:39216/0 (socket says 172.21.15.5:39216) 2024-08-31T05:35:34.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.455+0000 7f09da59c640 1 -- 172.21.15.5:0/1917745254 learned_addr learned my addr 172.21.15.5:0/1917745254 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:34.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.455+0000 7f09dad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c87d931b0 0x560c881dd300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:41994/0 (socket says 172.21.15.5:41994) 2024-08-31T05:35:34.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.455+0000 7f09db59e640 1 -- 172.21.15.5:0/1917745254 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c87d931b0 msgr2=0x560c881dd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:34.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.455+0000 7f09db59e640 1 --2- 172.21.15.5:0/1917745254 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c87d931b0 0x560c881dd300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:34.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.455+0000 7f09db59e640 1 -- 172.21.15.5:0/1917745254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c87d9b390 msgr2=0x560c881dd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:34.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.455+0000 7f09db59e640 1 --2- 172.21.15.5:0/1917745254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c87d9b390 0x560c881dd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:34.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.455+0000 7f09db59e640 1 -- 172.21.15.5:0/1917745254 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c881e8380 con 0x560c87dbc070 2024-08-31T05:35:34.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.455+0000 7f09da59c640 1 --2- 172.21.15.5:0/1917745254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c87d9b390 0x560c881dd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:35:34.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.455+0000 7f09db59e640 1 --2- 172.21.15.5:0/1917745254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c87dbc070 0x560c881ddd80 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f09d40e3450 tx=0x7f09d40b51a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=158ba0f6adbb4427 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:34.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.455+0000 7f09c27fc640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:35:34.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.455+0000 7f09c27fc640 1 -- 172.21.15.5:0/1917745254 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d40b0c60 con 0x560c87dbc070 2024-08-31T05:35:34.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.455+0000 7f09c27fc640 1 -- 172.21.15.5:0/1917745254 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f09d40b5280 con 0x560c87dbc070 2024-08-31T05:35:34.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.455+0000 7f09e75f9740 1 -- 172.21.15.5:0/1917745254 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f09cc04d070 con 0x560c87dbc070 2024-08-31T05:35:34.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.455+0000 7f09c27fc640 1 -- 172.21.15.5:0/1917745254 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f09d40b5710 con 0x560c87dbc070 2024-08-31T05:35:34.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.455+0000 7f09e75f9740 10 client.17052 fetch_fsmap learned FSMap version 34 2024-08-31T05:35:34.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.455+0000 7f09e75f9740 1 -- 172.21.15.5:0/1917745254 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x560c881e9590 con 0x560c87dbc070 2024-08-31T05:35:34.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.456+0000 7f09c27fc640 1 -- 172.21.15.5:0/1917745254 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09cc04d070 con 0x560c87dbc070 2024-08-31T05:35:34.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.456+0000 7f09c27fc640 1 -- 172.21.15.5:0/1917745254 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f09d4095c20 con 0x560c87dbc070 2024-08-31T05:35:34.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.456+0000 7f09e75f9740 10 client.17052 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:35:34.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.456+0000 7f09e75f9740 10 client.17052 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-31T05:35:34.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.456+0000 7f09e75f9740 20 client.17052 populate_metadata read hostname 'smithi005' 2024-08-31T05:35:34.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.456+0000 7f09e75f9740 1 --2- 172.21.15.5:0/1917745254 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x560c87d4fda0 0x560c881ebda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:34.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.456+0000 7f09e75f9740 4 client.17052 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:35:34.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.456+0000 7f09e75f9740 1 -- 172.21.15.5:0/1917745254 --> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560c880d6070 con 0x560c87d4fda0 2024-08-31T05:35:34.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.456+0000 7f09dad9d640 1 --2- 172.21.15.5:0/1917745254 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x560c87d4fda0 0x560c881ebda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:34.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.457+0000 7f09c27fc640 10 client.17052 ms_handle_connect on v2:172.21.15.70:6836/2780036414 2024-08-31T05:35:34.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.457+0000 7f09dad9d640 1 --2- 172.21.15.5:0/1917745254 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x560c87d4fda0 0x560c881ebda0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c5dd88f10f20441d server_cookie=5f2bc2506716c4fd in_seq=0 out_seq=0 2024-08-31T05:35:34.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.457+0000 7f09c27fc640 1 -- 172.21.15.5:0/1917745254 <== mds.2 v2:172.21.15.70:6836/2780036414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560c880d6070 con 0x560c87d4fda0 2024-08-31T05:35:34.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.457+0000 7f09c27fc640 10 client.17052 handle_command_reply: tid=0 2024-08-31T05:35:34.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.457+0000 7f09e75f9740 1 client.17052 shutdown 2024-08-31T05:35:34.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.457+0000 7f09e75f9740 1 -- 172.21.15.5:0/1917745254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c87dbc070 msgr2=0x560c881ddd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:34.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.457+0000 7f09e75f9740 1 --2- 172.21.15.5:0/1917745254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c87dbc070 0x560c881ddd80 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f09d40e3450 tx=0x7f09d40b51a0 comp rx=0 tx=0).stop 2024-08-31T05:35:34.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.457+0000 7f09e75f9740 1 -- 172.21.15.5:0/1917745254 shutdown_connections 2024-08-31T05:35:34.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.457+0000 7f09e75f9740 1 --2- 172.21.15.5:0/1917745254 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x560c87d4fda0 0x560c881ebda0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:34.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.457+0000 7f09c27fc640 0 client.17052 ms_handle_reset on v2:172.21.15.70:6836/2780036414 2024-08-31T05:35:34.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.457+0000 7f09e75f9740 1 --2- 172.21.15.5:0/1917745254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560c87dbc070 0x560c881ddd80 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:34.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.457+0000 7f09e75f9740 1 --2- 172.21.15.5:0/1917745254 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560c87d9b390 0x560c881dd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:34.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.457+0000 7f09e75f9740 1 --2- 172.21.15.5:0/1917745254 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c87d931b0 0x560c881dd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:34.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.457+0000 7f09e75f9740 1 -- 172.21.15.5:0/1917745254 >> 172.21.15.5:0/1917745254 conn(0x560c87db0460 msgr2=0x560c88164b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:34.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.457+0000 7f09e75f9740 1 -- 172.21.15.5:0/1917745254 shutdown_connections 2024-08-31T05:35:34.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.457+0000 7f09e75f9740 1 -- 172.21.15.5:0/1917745254 wait complete. 2024-08-31T05:35:34.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.457+0000 7f09e75f9740 20 client.17052 trim_cache size 0 max 16384 2024-08-31T05:35:34.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.458+0000 7f09e1084640 1 -- 172.21.15.5:0/278855003 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f09c80b4ca0 msgr2=0x7f09c80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:34.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.458+0000 7f09e1084640 1 --2- 172.21.15.5:0/278855003 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f09c80b4ca0 0x7f09c80b71b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f09dc102b30 tx=0x7f09c4005f90 comp rx=0 tx=0).stop 2024-08-31T05:35:34.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.458+0000 7f09e1084640 1 -- 172.21.15.5:0/278855003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09dc109bb0 msgr2=0x7f09dc19fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:34.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.458+0000 7f09e1084640 1 --2- 172.21.15.5:0/278855003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09dc109bb0 0x7f09dc19fae0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f09d4009fd0 tx=0x7f09d400ef10 comp rx=0 tx=0).stop 2024-08-31T05:35:34.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.458+0000 7f09e1084640 1 -- 172.21.15.5:0/278855003 shutdown_connections 2024-08-31T05:35:34.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.458+0000 7f09e1084640 1 --2- 172.21.15.5:0/278855003 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f09c80b4ca0 0x7f09c80b71b0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:34.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.458+0000 7f09e1084640 1 --2- 172.21.15.5:0/278855003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f09dc109bb0 0x7f09dc19fae0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:34.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.458+0000 7f09e1084640 1 --2- 172.21.15.5:0/278855003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09dc109260 0x7f09dc19a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:34.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.458+0000 7f09e1084640 1 --2- 172.21.15.5:0/278855003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09dc103920 0x7f09dc19a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:34.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.458+0000 7f09e1084640 1 -- 172.21.15.5:0/278855003 >> 172.21.15.5:0/278855003 conn(0x7f09dc0ff350 msgr2=0x7f09dc1088f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:34.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.458+0000 7f09e1084640 1 -- 172.21.15.5:0/278855003 shutdown_connections 2024-08-31T05:35:34.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:34.458+0000 7f09e1084640 1 -- 172.21.15.5:0/278855003 wait complete. 2024-08-31T05:35:34.919 INFO:tasks.workunit.client.0.smithi005.stdout: 1 616216 12.00 MB/sec execute 142 sec latency 61.944 ms 2024-08-31T05:35:35.156 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:35:34 smithi050 ceph-mon[22146]: pgmap v513: 129 pgs: 129 active+clean; 354 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.8 MiB/s wr, 234 op/s 2024-08-31T05:35:35.163 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:35:34 smithi005 ceph-mon[18602]: pgmap v513: 129 pgs: 129 active+clean; 354 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.8 MiB/s wr, 234 op/s 2024-08-31T05:35:35.193 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T05:35:35.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:35:34 smithi070 ceph-mon[22316]: pgmap v513: 129 pgs: 129 active+clean; 354 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.8 MiB/s wr, 234 op/s 2024-08-31T05:35:35.479 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:35:35.919 INFO:tasks.workunit.client.0.smithi005.stdout: 1 618424 12.01 MB/sec execute 143 sec latency 22.922 ms 2024-08-31T05:35:36.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.005+0000 7f1f66464640 1 -- 172.21.15.5:0/2613292808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f60108140 msgr2=0x7f1f60108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:36.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.005+0000 7f1f66464640 1 --2- 172.21.15.5:0/2613292808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f60108140 0x7f1f60108550 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1f54009900 tx=0x7f1f5402a410 comp rx=0 tx=0).stop 2024-08-31T05:35:36.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.005+0000 7f1f66464640 1 -- 172.21.15.5:0/2613292808 shutdown_connections 2024-08-31T05:35:36.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.005+0000 7f1f66464640 1 --2- 172.21.15.5:0/2613292808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f60108a90 0x7f1f6010f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:36.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.005+0000 7f1f66464640 1 --2- 172.21.15.5:0/2613292808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f60108140 0x7f1f60108550 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:36.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.005+0000 7f1f66464640 1 --2- 172.21.15.5:0/2613292808 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f60102800 0x7f1f60102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:36.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.005+0000 7f1f66464640 1 -- 172.21.15.5:0/2613292808 >> 172.21.15.5:0/2613292808 conn(0x7f1f600794d0 msgr2=0x7f1f600798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:36.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.005+0000 7f1f66464640 1 -- 172.21.15.5:0/2613292808 shutdown_connections 2024-08-31T05:35:36.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.005+0000 7f1f66464640 1 -- 172.21.15.5:0/2613292808 wait complete. 2024-08-31T05:35:36.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.006+0000 7f1f66464640 1 Processor -- start 2024-08-31T05:35:36.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.006+0000 7f1f66464640 1 -- start start 2024-08-31T05:35:36.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.006+0000 7f1f66464640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f60102800 0x7f1f6019a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:36.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.006+0000 7f1f66464640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f60108140 0x7f1f6019a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:36.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.006+0000 7f1f66464640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f60108a90 0x7f1f6019fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:36.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.006+0000 7f1f66464640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1f601126e0 con 0x7f1f60102800 2024-08-31T05:35:36.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.006+0000 7f1f66464640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1f60112560 con 0x7f1f60108a90 2024-08-31T05:35:36.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.006+0000 7f1f66464640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1f60112860 con 0x7f1f60108140 2024-08-31T05:35:36.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.006+0000 7f1f5ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f60102800 0x7f1f6019a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:36.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.006+0000 7f1f5f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f60108140 0x7f1f6019a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:36.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.006+0000 7f1f5ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f60102800 0x7f1f6019a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43506/0 (socket says 172.21.15.5:43506) 2024-08-31T05:35:36.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.006+0000 7f1f5f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f60108140 0x7f1f6019a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:42006/0 (socket says 172.21.15.5:42006) 2024-08-31T05:35:36.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.006+0000 7f1f5ffff640 1 -- 172.21.15.5:0/2162109611 learned_addr learned my addr 172.21.15.5:0/2162109611 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:36.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.006+0000 7f1f64a01640 1 --2- 172.21.15.5:0/2162109611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f60108a90 0x7f1f6019fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:36.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.007+0000 7f1f5ffff640 1 -- 172.21.15.5:0/2162109611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f60108140 msgr2=0x7f1f6019a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:36.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.007+0000 7f1f5ffff640 1 --2- 172.21.15.5:0/2162109611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f60108140 0x7f1f6019a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:36.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.007+0000 7f1f5ffff640 1 -- 172.21.15.5:0/2162109611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f60108a90 msgr2=0x7f1f6019fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:36.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.007+0000 7f1f5ffff640 1 --2- 172.21.15.5:0/2162109611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f60108a90 0x7f1f6019fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:36.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.007+0000 7f1f5ffff640 1 -- 172.21.15.5:0/2162109611 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f601a0170 con 0x7f1f60102800 2024-08-31T05:35:36.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.007+0000 7f1f5f7fe640 1 --2- 172.21.15.5:0/2162109611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f60108140 0x7f1f6019a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:35:36.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.007+0000 7f1f5ffff640 1 --2- 172.21.15.5:0/2162109611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f60102800 0x7f1f6019a200 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f1f5000e9f0 tx=0x7f1f5000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:36.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.007+0000 7f1f5d7fa640 1 -- 172.21.15.5:0/2162109611 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f5000cd80 con 0x7f1f60102800 2024-08-31T05:35:36.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.007+0000 7f1f66464640 1 -- 172.21.15.5:0/2162109611 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f601a0460 con 0x7f1f60102800 2024-08-31T05:35:36.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.007+0000 7f1f5d7fa640 1 -- 172.21.15.5:0/2162109611 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f500054d0 con 0x7f1f60102800 2024-08-31T05:35:36.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.007+0000 7f1f66464640 1 -- 172.21.15.5:0/2162109611 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f601a6bc0 con 0x7f1f60102800 2024-08-31T05:35:36.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.007+0000 7f1f5d7fa640 1 -- 172.21.15.5:0/2162109611 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f50010690 con 0x7f1f60102800 2024-08-31T05:35:36.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.010+0000 7f1f6c9d9740 1 Processor -- start 2024-08-31T05:35:36.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.010+0000 7f1f6c9d9740 1 -- start start 2024-08-31T05:35:36.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.010+0000 7f1f6c9d9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0a1771070 0x55a0a1b16310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:36.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.010+0000 7f1f6c9d9740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0a17481b0 0x55a0a1b16850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:36.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.010+0000 7f1f6c9d9740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0a1750390 0x55a0a1b16d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:36.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.010+0000 7f1f6c9d9740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55a0a1a8d680 con 0x55a0a1750390 2024-08-31T05:35:36.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.010+0000 7f1f6c9d9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a0a1a7cc10 con 0x55a0a1771070 2024-08-31T05:35:36.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.010+0000 7f1f6c9d9740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a0a1a80bc0 con 0x55a0a17481b0 2024-08-31T05:35:36.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.010+0000 7f1f5f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0a1750390 0x55a0a1b16d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:36.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.010+0000 7f1f5f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0a1750390 0x55a0a1b16d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43512/0 (socket says 172.21.15.5:43512) 2024-08-31T05:35:36.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.010+0000 7f1f5f7fe640 1 -- 172.21.15.5:0/1884265639 learned_addr learned my addr 172.21.15.5:0/1884265639 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:36.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.010+0000 7f1f64a01640 1 --2- 172.21.15.5:0/1884265639 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0a1771070 0x55a0a1b16310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:36.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.010+0000 7f1f5d7fa640 1 -- 172.21.15.5:0/2162109611 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f1f50004e90 con 0x7f1f60102800 2024-08-31T05:35:36.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.010+0000 7f1f5f7fe640 1 -- 172.21.15.5:0/1884265639 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0a17481b0 msgr2=0x55a0a1b16850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T05:35:36.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.010+0000 7f1f5f7fe640 1 --2- 172.21.15.5:0/1884265639 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0a17481b0 0x55a0a1b16850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:36.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.010+0000 7f1f5f7fe640 1 -- 172.21.15.5:0/1884265639 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0a1771070 msgr2=0x55a0a1b16310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:36.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.010+0000 7f1f5f7fe640 1 --2- 172.21.15.5:0/1884265639 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0a1771070 0x55a0a1b16310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:36.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.010+0000 7f1f5f7fe640 1 -- 172.21.15.5:0/1884265639 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0a17dc650 con 0x55a0a1750390 2024-08-31T05:35:36.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.011+0000 7f1f5f7fe640 1 --2- 172.21.15.5:0/1884265639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0a1750390 0x55a0a1b16d90 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f1f54009900 tx=0x7f1f54005e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1c0095d26500f66 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:36.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.011+0000 7f1f467fc640 1 -- 172.21.15.5:0/1884265639 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f54040070 con 0x55a0a1750390 2024-08-31T05:35:36.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.011+0000 7f1f467fc640 1 -- 172.21.15.5:0/1884265639 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f54031720 con 0x55a0a1750390 2024-08-31T05:35:36.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.011+0000 7f1f467fc640 1 -- 172.21.15.5:0/1884265639 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f54035040 con 0x55a0a1750390 2024-08-31T05:35:36.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.011+0000 7f1f5d7fa640 1 --2- 172.21.15.5:0/2162109611 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f1f480b4ca0 0x7f1f480b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:36.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.011+0000 7f1f64a01640 1 --2- 172.21.15.5:0/2162109611 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f1f480b4ca0 0x7f1f480b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:36.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.011+0000 7f1f5d7fa640 1 -- 172.21.15.5:0/2162109611 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f1f500e5d00 con 0x7f1f60102800 2024-08-31T05:35:36.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.012+0000 7f1f6c9d9740 1 -- 172.21.15.5:0/1884265639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0a1750390 msgr2=0x55a0a1b16d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:36.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.012+0000 7f1f6c9d9740 1 --2- 172.21.15.5:0/1884265639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0a1750390 0x55a0a1b16d90 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f1f54009900 tx=0x7f1f54005e20 comp rx=0 tx=0).stop 2024-08-31T05:35:36.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.012+0000 7f1f64a01640 1 --2- 172.21.15.5:0/2162109611 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f1f480b4ca0 0x7f1f480b71b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1f58005fd0 tx=0x7f1f58009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:36.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.012+0000 7f1f6c9d9740 1 -- 172.21.15.5:0/1884265639 shutdown_connections 2024-08-31T05:35:36.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.012+0000 7f1f6c9d9740 1 --2- 172.21.15.5:0/1884265639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0a1750390 0x55a0a1b16d90 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:36.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.012+0000 7f1f6c9d9740 1 --2- 172.21.15.5:0/1884265639 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0a17481b0 0x55a0a1b16850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:36.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.012+0000 7f1f6c9d9740 1 --2- 172.21.15.5:0/1884265639 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0a1771070 0x55a0a1b16310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:36.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.012+0000 7f1f6c9d9740 1 -- 172.21.15.5:0/1884265639 >> 172.21.15.5:0/1884265639 conn(0x55a0a1765460 msgr2=0x55a0a1b14200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:36.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.012+0000 7f1f6c9d9740 1 -- 172.21.15.5:0/1884265639 shutdown_connections 2024-08-31T05:35:36.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.012+0000 7f1f6c9d9740 1 -- 172.21.15.5:0/1884265639 wait complete. 2024-08-31T05:35:36.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.012+0000 7f1f6c9d9740 1 -- start start 2024-08-31T05:35:36.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.013+0000 7f1f6c9d9740 1 Processor -- start 2024-08-31T05:35:36.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.013+0000 7f1f6c9d9740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0a17481b0 0x55a0a1b21a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:36.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.013+0000 7f1f6c9d9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0a1750390 0x55a0a1b21f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:36.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.013+0000 7f1f6c9d9740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0a1771070 0x55a0a1b2ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:36.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.013+0000 7f1f6c9d9740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55a0a18df700 con 0x55a0a1771070 2024-08-31T05:35:36.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.013+0000 7f1f6c9d9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a0a1a03750 con 0x55a0a1750390 2024-08-31T05:35:36.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.013+0000 7f1f6c9d9740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a0a1b24a90 con 0x55a0a17481b0 2024-08-31T05:35:36.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.013+0000 7f1f6c9d9740 10 client.0 _ll_register_callbacks cb 0x55a0a1a32e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:35:36.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.013+0000 7f1f64a01640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0a1771070 0x55a0a1b2ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:36.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.013+0000 7f1f5ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0a17481b0 0x55a0a1b21a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:36.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.013+0000 7f1f5ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0a17481b0 0x55a0a1b21a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:42016/0 (socket says 172.21.15.5:42016) 2024-08-31T05:35:36.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.013+0000 7f1f5ffff640 1 -- 172.21.15.5:0/4227080866 learned_addr learned my addr 172.21.15.5:0/4227080866 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:36.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.013+0000 7f1f5f7fe640 1 --2- 172.21.15.5:0/4227080866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0a1750390 0x55a0a1b21f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:36.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.013+0000 7f1f64a01640 1 -- 172.21.15.5:0/4227080866 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0a17481b0 msgr2=0x55a0a1b21a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:36.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.013+0000 7f1f64a01640 1 --2- 172.21.15.5:0/4227080866 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0a17481b0 0x55a0a1b21a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:36.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.013+0000 7f1f64a01640 1 -- 172.21.15.5:0/4227080866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0a1750390 msgr2=0x55a0a1b21f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:36.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.013+0000 7f1f64a01640 1 --2- 172.21.15.5:0/4227080866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0a1750390 0x55a0a1b21f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:36.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.013+0000 7f1f64a01640 1 -- 172.21.15.5:0/4227080866 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0a1a3c900 con 0x55a0a1771070 2024-08-31T05:35:36.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.013+0000 7f1f5ffff640 1 --2- 172.21.15.5:0/4227080866 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0a17481b0 0x55a0a1b21a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:35:36.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.014+0000 7f1f5f7fe640 1 --2- 172.21.15.5:0/4227080866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0a1750390 0x55a0a1b21f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:35:36.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.014+0000 7f1f64a01640 1 --2- 172.21.15.5:0/4227080866 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0a1771070 0x55a0a1b2ddb0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f1f58009e80 tx=0x7f1f58004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d04a78b9d15179e9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:36.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.014+0000 7f1f3f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:35:36.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.014+0000 7f1f3f7fe640 1 -- 172.21.15.5:0/4227080866 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f5800f830 con 0x55a0a1771070 2024-08-31T05:35:36.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.014+0000 7f1f3f7fe640 1 -- 172.21.15.5:0/4227080866 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f1f5800f9d0 con 0x55a0a1771070 2024-08-31T05:35:36.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.014+0000 7f1f6c9d9740 1 -- 172.21.15.5:0/4227080866 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f54031720 con 0x55a0a1771070 2024-08-31T05:35:36.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.014+0000 7f1f3f7fe640 1 -- 172.21.15.5:0/4227080866 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f1f5800fbd0 con 0x55a0a1771070 2024-08-31T05:35:36.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.014+0000 7f1f6c9d9740 10 client.17064 fetch_fsmap learned FSMap version 34 2024-08-31T05:35:36.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.014+0000 7f1f6c9d9740 1 -- 172.21.15.5:0/4227080866 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a0a1b308b0 con 0x55a0a1771070 2024-08-31T05:35:36.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.014+0000 7f1f3f7fe640 1 -- 172.21.15.5:0/4227080866 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f54031720 con 0x55a0a1771070 2024-08-31T05:35:36.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.015+0000 7f1f3f7fe640 1 -- 172.21.15.5:0/4227080866 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f1f58027070 con 0x55a0a1771070 2024-08-31T05:35:36.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.015+0000 7f1f6c9d9740 10 client.17064 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:35:36.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.015+0000 7f1f6c9d9740 10 client.17064 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-31T05:35:36.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.015+0000 7f1f6c9d9740 20 client.17064 populate_metadata read hostname 'smithi005' 2024-08-31T05:35:36.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.015+0000 7f1f6c9d9740 1 --2- 172.21.15.5:0/4227080866 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55a0a172f9f0 0x55a0a1b33df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:36.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.015+0000 7f1f6c9d9740 4 client.17064 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:35:36.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.015+0000 7f1f6c9d9740 1 -- 172.21.15.5:0/4227080866 --> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a0a1a8f5d0 con 0x55a0a172f9f0 2024-08-31T05:35:36.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.015+0000 7f1f5ffff640 1 --2- 172.21.15.5:0/4227080866 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55a0a172f9f0 0x55a0a1b33df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:36.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.015+0000 7f1f5ffff640 1 --2- 172.21.15.5:0/4227080866 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55a0a172f9f0 0x55a0a1b33df0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d227c3c298ae85c7 server_cookie=407f2994370a0989 in_seq=0 out_seq=0 2024-08-31T05:35:36.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.015+0000 7f1f3f7fe640 10 client.17064 ms_handle_connect on v2:172.21.15.50:6838/98200944 2024-08-31T05:35:36.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.016+0000 7f1f3f7fe640 1 -- 172.21.15.5:0/4227080866 <== mds.1 v2:172.21.15.50:6838/98200944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a0a1a8f5d0 con 0x55a0a172f9f0 2024-08-31T05:35:36.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.016+0000 7f1f3f7fe640 10 client.17064 handle_command_reply: tid=0 2024-08-31T05:35:36.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.016+0000 7f1f6c9d9740 1 client.17064 shutdown 2024-08-31T05:35:36.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.016+0000 7f1f6c9d9740 1 -- 172.21.15.5:0/4227080866 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0a1771070 msgr2=0x55a0a1b2ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:36.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.016+0000 7f1f6c9d9740 1 --2- 172.21.15.5:0/4227080866 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0a1771070 0x55a0a1b2ddb0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f1f58009e80 tx=0x7f1f58004a40 comp rx=0 tx=0).stop 2024-08-31T05:35:36.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.016+0000 7f1f6c9d9740 1 -- 172.21.15.5:0/4227080866 shutdown_connections 2024-08-31T05:35:36.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.016+0000 7f1f6c9d9740 1 --2- 172.21.15.5:0/4227080866 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55a0a172f9f0 0x55a0a1b33df0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:36.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.016+0000 7f1f6c9d9740 1 --2- 172.21.15.5:0/4227080866 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0a1771070 0x55a0a1b2ddb0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:36.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.016+0000 7f1f6c9d9740 1 --2- 172.21.15.5:0/4227080866 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0a1750390 0x55a0a1b21f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:36.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.016+0000 7f1f6c9d9740 1 --2- 172.21.15.5:0/4227080866 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0a17481b0 0x55a0a1b21a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:36.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.016+0000 7f1f6c9d9740 1 -- 172.21.15.5:0/4227080866 >> 172.21.15.5:0/4227080866 conn(0x55a0a1765460 msgr2=0x55a0a1b194a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:36.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.016+0000 7f1f3f7fe640 0 client.17064 ms_handle_reset on v2:172.21.15.50:6838/98200944 2024-08-31T05:35:36.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.016+0000 7f1f6c9d9740 1 -- 172.21.15.5:0/4227080866 shutdown_connections 2024-08-31T05:35:36.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.016+0000 7f1f6c9d9740 1 -- 172.21.15.5:0/4227080866 wait complete. 2024-08-31T05:35:36.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.017+0000 7f1f6c9d9740 20 client.17064 trim_cache size 0 max 16384 2024-08-31T05:35:36.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.030+0000 7f1f6c9d9740 1 Processor -- start 2024-08-31T05:35:36.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.030+0000 7f1f6c9d9740 1 -- start start 2024-08-31T05:35:36.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.030+0000 7f1f6c9d9740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0a17481b0 0x55a0a1b219c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:36.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.031+0000 7f1f6c9d9740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0a1750390 0x55a0a1b21f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:36.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.031+0000 7f1f6c9d9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0a1771070 0x55a0a1b19410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:36.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.031+0000 7f1f6c9d9740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1f601b0bb0 con 0x55a0a17481b0 2024-08-31T05:35:36.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.031+0000 7f1f6c9d9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1f601b26f0 con 0x55a0a1771070 2024-08-31T05:35:36.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.031+0000 7f1f6c9d9740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1f601b1280 con 0x55a0a1750390 2024-08-31T05:35:36.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.031+0000 7f1f5ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0a17481b0 0x55a0a1b219c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:36.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.031+0000 7f1f5ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0a17481b0 0x55a0a1b219c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43530/0 (socket says 172.21.15.5:43530) 2024-08-31T05:35:36.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.031+0000 7f1f5ffff640 1 -- 172.21.15.5:0/1307183868 learned_addr learned my addr 172.21.15.5:0/1307183868 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:36.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.031+0000 7f1f5f7fe640 1 --2- 172.21.15.5:0/1307183868 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0a1750390 0x55a0a1b21f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:36.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.031+0000 7f1f64a01640 1 --2- 172.21.15.5:0/1307183868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0a1771070 0x55a0a1b19410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:36.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.031+0000 7f1f5ffff640 1 -- 172.21.15.5:0/1307183868 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0a1750390 msgr2=0x55a0a1b21f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:36.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.031+0000 7f1f5ffff640 1 --2- 172.21.15.5:0/1307183868 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0a1750390 0x55a0a1b21f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:36.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.031+0000 7f1f5ffff640 1 -- 172.21.15.5:0/1307183868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0a1771070 msgr2=0x55a0a1b19410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:36.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.031+0000 7f1f5ffff640 1 --2- 172.21.15.5:0/1307183868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0a1771070 0x55a0a1b19410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:36.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.031+0000 7f1f5ffff640 1 -- 172.21.15.5:0/1307183868 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0a1b22440 con 0x55a0a17481b0 2024-08-31T05:35:36.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.031+0000 7f1f5ffff640 1 --2- 172.21.15.5:0/1307183868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0a17481b0 0x55a0a1b219c0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f1f500abd70 tx=0x7f1f50009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2279cac049f58229 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:36.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.031+0000 7f1f45ffb640 1 -- 172.21.15.5:0/1307183868 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f50091e60 con 0x55a0a17481b0 2024-08-31T05:35:36.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.031+0000 7f1f45ffb640 1 -- 172.21.15.5:0/1307183868 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f500ac770 con 0x55a0a17481b0 2024-08-31T05:35:36.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.031+0000 7f1f45ffb640 1 -- 172.21.15.5:0/1307183868 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f500ac2d0 con 0x55a0a17481b0 2024-08-31T05:35:36.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.032+0000 7f1f6c9d9740 1 -- 172.21.15.5:0/1307183868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0a17481b0 msgr2=0x55a0a1b219c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:36.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.032+0000 7f1f6c9d9740 1 --2- 172.21.15.5:0/1307183868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0a17481b0 0x55a0a1b219c0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f1f500abd70 tx=0x7f1f50009310 comp rx=0 tx=0).stop 2024-08-31T05:35:36.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.032+0000 7f1f6c9d9740 1 -- 172.21.15.5:0/1307183868 shutdown_connections 2024-08-31T05:35:36.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.032+0000 7f1f6c9d9740 1 --2- 172.21.15.5:0/1307183868 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0a1771070 0x55a0a1b19410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:36.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.032+0000 7f1f6c9d9740 1 --2- 172.21.15.5:0/1307183868 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0a1750390 0x55a0a1b21f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:36.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.032+0000 7f1f6c9d9740 1 --2- 172.21.15.5:0/1307183868 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0a17481b0 0x55a0a1b219c0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:36.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.032+0000 7f1f6c9d9740 1 -- 172.21.15.5:0/1307183868 >> 172.21.15.5:0/1307183868 conn(0x55a0a1765460 msgr2=0x55a0a1b202d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:36.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.032+0000 7f1f6c9d9740 1 -- 172.21.15.5:0/1307183868 shutdown_connections 2024-08-31T05:35:36.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.032+0000 7f1f6c9d9740 1 -- 172.21.15.5:0/1307183868 wait complete. 2024-08-31T05:35:36.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.033+0000 7f1f6c9d9740 1 -- start start 2024-08-31T05:35:36.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.033+0000 7f1f6c9d9740 1 Processor -- start 2024-08-31T05:35:36.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.033+0000 7f1f6c9d9740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0a17481b0 0x55a0a1b2a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:36.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.033+0000 7f1f6c9d9740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0a1750390 0x55a0a1b25820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:36.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.033+0000 7f1f6c9d9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0a1771070 0x55a0a1b25d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:36.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.033+0000 7f1f6c9d9740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1f601b2020 con 0x55a0a1750390 2024-08-31T05:35:36.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.033+0000 7f1f6c9d9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1f601b1950 con 0x55a0a1771070 2024-08-31T05:35:36.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.033+0000 7f1f6c9d9740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1f601aeb90 con 0x55a0a17481b0 2024-08-31T05:35:36.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.033+0000 7f1f6c9d9740 10 client.0 _ll_register_callbacks cb 0x7f1f58009cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:35:36.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.033+0000 7f1f5f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0a1750390 0x55a0a1b25820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:36.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.033+0000 7f1f5ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0a17481b0 0x55a0a1b2a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:36.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.034+0000 7f1f5ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0a17481b0 0x55a0a1b2a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:42040/0 (socket says 172.21.15.5:42040) 2024-08-31T05:35:36.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.034+0000 7f1f5ffff640 1 -- 172.21.15.5:0/3133291450 learned_addr learned my addr 172.21.15.5:0/3133291450 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:36.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.034+0000 7f1f64a01640 1 --2- 172.21.15.5:0/3133291450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0a1771070 0x55a0a1b25d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:36.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.034+0000 7f1f5ffff640 1 -- 172.21.15.5:0/3133291450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0a1771070 msgr2=0x55a0a1b25d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:36.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.034+0000 7f1f5ffff640 1 --2- 172.21.15.5:0/3133291450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0a1771070 0x55a0a1b25d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:36.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.034+0000 7f1f5ffff640 1 -- 172.21.15.5:0/3133291450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0a1750390 msgr2=0x55a0a1b25820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:36.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.034+0000 7f1f5ffff640 1 --2- 172.21.15.5:0/3133291450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0a1750390 0x55a0a1b25820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:36.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.034+0000 7f1f5ffff640 1 -- 172.21.15.5:0/3133291450 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0a1b264f0 con 0x55a0a17481b0 2024-08-31T05:35:36.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.034+0000 7f1f64a01640 1 --2- 172.21.15.5:0/3133291450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0a1771070 0x55a0a1b25d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:35:36.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.034+0000 7f1f5f7fe640 1 --2- 172.21.15.5:0/3133291450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0a1750390 0x55a0a1b25820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:35:36.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.034+0000 7f1f5ffff640 1 --2- 172.21.15.5:0/3133291450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0a17481b0 0x55a0a1b2a5a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1f500e3180 tx=0x7f1f50005680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89047948e55dc231 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:36.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.034+0000 7f1f3f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:35:36.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.034+0000 7f1f3f7fe640 1 -- 172.21.15.5:0/3133291450 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f50091e60 con 0x55a0a17481b0 2024-08-31T05:35:36.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.034+0000 7f1f6c9d9740 1 -- 172.21.15.5:0/3133291450 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f500ac770 con 0x55a0a17481b0 2024-08-31T05:35:36.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.034+0000 7f1f3f7fe640 1 -- 172.21.15.5:0/3133291450 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f1f500971e0 con 0x55a0a17481b0 2024-08-31T05:35:36.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.035+0000 7f1f3f7fe640 1 -- 172.21.15.5:0/3133291450 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f1f50097040 con 0x55a0a17481b0 2024-08-31T05:35:36.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.035+0000 7f1f6c9d9740 10 client.26671 fetch_fsmap learned FSMap version 34 2024-08-31T05:35:36.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.035+0000 7f1f6c9d9740 1 -- 172.21.15.5:0/3133291450 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a0a1ba6f10 con 0x55a0a17481b0 2024-08-31T05:35:36.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.035+0000 7f1f3f7fe640 1 -- 172.21.15.5:0/3133291450 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f500ac770 con 0x55a0a17481b0 2024-08-31T05:35:36.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.035+0000 7f1f3f7fe640 1 -- 172.21.15.5:0/3133291450 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f1f500b4f00 con 0x55a0a17481b0 2024-08-31T05:35:36.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.035+0000 7f1f6c9d9740 10 client.26671 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:35:36.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.035+0000 7f1f6c9d9740 10 client.26671 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-31T05:35:36.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.035+0000 7f1f6c9d9740 20 client.26671 populate_metadata read hostname 'smithi005' 2024-08-31T05:35:36.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.035+0000 7f1f6c9d9740 1 --2- 172.21.15.5:0/3133291450 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55a0a1704da0 0x55a0a1ba9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:36.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.035+0000 7f1f6c9d9740 4 client.26671 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:35:36.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.035+0000 7f1f6c9d9740 1 -- 172.21.15.5:0/3133291450 --> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a0a1a8b070 con 0x55a0a1704da0 2024-08-31T05:35:36.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.035+0000 7f1f5f7fe640 1 --2- 172.21.15.5:0/3133291450 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55a0a1704da0 0x55a0a1ba9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:36.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.036+0000 7f1f3f7fe640 10 client.26671 ms_handle_connect on v2:172.21.15.50:6838/98200944 2024-08-31T05:35:36.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.036+0000 7f1f5f7fe640 1 --2- 172.21.15.5:0/3133291450 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55a0a1704da0 0x55a0a1ba9680 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c1029b2ba02b738b server_cookie=c6b0f435fc2195e8 in_seq=0 out_seq=0 2024-08-31T05:35:36.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.036+0000 7f1f3f7fe640 1 -- 172.21.15.5:0/3133291450 <== mds.1 v2:172.21.15.50:6838/98200944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a0a1a8b070 con 0x55a0a1704da0 2024-08-31T05:35:36.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.036+0000 7f1f3f7fe640 10 client.26671 handle_command_reply: tid=0 2024-08-31T05:35:36.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.036+0000 7f1f6c9d9740 1 client.26671 shutdown 2024-08-31T05:35:36.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.036+0000 7f1f6c9d9740 1 -- 172.21.15.5:0/3133291450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0a17481b0 msgr2=0x55a0a1b2a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:36.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.036+0000 7f1f6c9d9740 1 --2- 172.21.15.5:0/3133291450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0a17481b0 0x55a0a1b2a5a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1f500e3180 tx=0x7f1f50005680 comp rx=0 tx=0).stop 2024-08-31T05:35:36.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.036+0000 7f1f6c9d9740 1 -- 172.21.15.5:0/3133291450 shutdown_connections 2024-08-31T05:35:36.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.036+0000 7f1f6c9d9740 1 --2- 172.21.15.5:0/3133291450 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55a0a1704da0 0x55a0a1ba9680 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:36.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.036+0000 7f1f6c9d9740 1 --2- 172.21.15.5:0/3133291450 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0a1771070 0x55a0a1b25d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:36.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.036+0000 7f1f6c9d9740 1 --2- 172.21.15.5:0/3133291450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0a1750390 0x55a0a1b25820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:36.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.036+0000 7f1f3f7fe640 0 client.26671 ms_handle_reset on v2:172.21.15.50:6838/98200944 2024-08-31T05:35:36.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.036+0000 7f1f6c9d9740 1 --2- 172.21.15.5:0/3133291450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0a17481b0 0x55a0a1b2a5a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:36.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.036+0000 7f1f6c9d9740 1 -- 172.21.15.5:0/3133291450 >> 172.21.15.5:0/3133291450 conn(0x55a0a1765460 msgr2=0x55a0a1b20240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:36.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.036+0000 7f1f6c9d9740 1 -- 172.21.15.5:0/3133291450 shutdown_connections 2024-08-31T05:35:36.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.036+0000 7f1f6c9d9740 1 -- 172.21.15.5:0/3133291450 wait complete. 2024-08-31T05:35:36.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.036+0000 7f1f6c9d9740 20 client.26671 trim_cache size 0 max 16384 2024-08-31T05:35:36.053 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:35:36.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.037+0000 7f1f66464640 1 -- 172.21.15.5:0/2162109611 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f1f480b4ca0 msgr2=0x7f1f480b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:36.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.037+0000 7f1f66464640 1 --2- 172.21.15.5:0/2162109611 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f1f480b4ca0 0x7f1f480b71b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1f58005fd0 tx=0x7f1f58009500 comp rx=0 tx=0).stop 2024-08-31T05:35:36.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.037+0000 7f1f66464640 1 -- 172.21.15.5:0/2162109611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f60102800 msgr2=0x7f1f6019a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:36.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.037+0000 7f1f66464640 1 --2- 172.21.15.5:0/2162109611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f60102800 0x7f1f6019a200 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f1f5000e9f0 tx=0x7f1f5000edf0 comp rx=0 tx=0).stop 2024-08-31T05:35:36.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.037+0000 7f1f66464640 1 -- 172.21.15.5:0/2162109611 shutdown_connections 2024-08-31T05:35:36.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.037+0000 7f1f66464640 1 --2- 172.21.15.5:0/2162109611 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f1f480b4ca0 0x7f1f480b71b0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:36.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.037+0000 7f1f66464640 1 --2- 172.21.15.5:0/2162109611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1f60108a90 0x7f1f6019fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:36.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.037+0000 7f1f66464640 1 --2- 172.21.15.5:0/2162109611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f60108140 0x7f1f6019a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:36.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.037+0000 7f1f66464640 1 --2- 172.21.15.5:0/2162109611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f60102800 0x7f1f6019a200 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:36.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.037+0000 7f1f66464640 1 -- 172.21.15.5:0/2162109611 >> 172.21.15.5:0/2162109611 conn(0x7f1f600794d0 msgr2=0x7f1f6006afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:36.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.037+0000 7f1f66464640 1 -- 172.21.15.5:0/2162109611 shutdown_connections 2024-08-31T05:35:36.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:36.037+0000 7f1f66464640 1 -- 172.21.15.5:0/2162109611 wait complete. 2024-08-31T05:35:36.745 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T05:35:36.919 INFO:tasks.workunit.client.0.smithi005.stdout: 1 620413 11.98 MB/sec execute 144 sec latency 25.083 ms 2024-08-31T05:35:36.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:35:36 smithi005 ceph-mon[18602]: pgmap v514: 129 pgs: 129 active+clean; 358 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.6 MiB/s wr, 289 op/s 2024-08-31T05:35:37.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.009+0000 7f29c50fa640 1 -- 172.21.15.5:0/429233050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29c0101dc0 msgr2=0x7f29c01021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:37.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.009+0000 7f29c50fa640 1 --2- 172.21.15.5:0/429233050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29c0101dc0 0x7f29c01021d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f29b0009860 tx=0x7f29b002a340 comp rx=0 tx=0).stop 2024-08-31T05:35:37.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.009+0000 7f29c50fa640 1 -- 172.21.15.5:0/429233050 shutdown_connections 2024-08-31T05:35:37.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.009+0000 7f29c50fa640 1 --2- 172.21.15.5:0/429233050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29c0109c30 0x7f29c0110480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.009+0000 7f29c50fa640 1 --2- 172.21.15.5:0/429233050 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29c01092e0 0x7f29c01096f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.009+0000 7f29c50fa640 1 --2- 172.21.15.5:0/429233050 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29c0101dc0 0x7f29c01021d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.009+0000 7f29c50fa640 1 -- 172.21.15.5:0/429233050 >> 172.21.15.5:0/429233050 conn(0x7f29c0079bf0 msgr2=0x7f29c007a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:37.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.009+0000 7f29c50fa640 1 -- 172.21.15.5:0/429233050 shutdown_connections 2024-08-31T05:35:37.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.009+0000 7f29c50fa640 1 -- 172.21.15.5:0/429233050 wait complete. 2024-08-31T05:35:37.014 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.010+0000 7f29c50fa640 1 Processor -- start 2024-08-31T05:35:37.014 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.011+0000 7f29c50fa640 1 -- start start 2024-08-31T05:35:37.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.011+0000 7f29c50fa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29c0101dc0 0x7f29c019a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:37.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.011+0000 7f29c50fa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29c01092e0 0x7f29c019a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:37.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.011+0000 7f29c50fa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29c0109c30 0x7f29c019fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:37.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.011+0000 7f29c50fa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f29c01138c0 con 0x7f29c0109c30 2024-08-31T05:35:37.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.011+0000 7f29c50fa640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f29c0113740 con 0x7f29c0101dc0 2024-08-31T05:35:37.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.011+0000 7f29c50fa640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f29c0113a40 con 0x7f29c01092e0 2024-08-31T05:35:37.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.012+0000 7f29bf59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29c0109c30 0x7f29c019fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:37.015 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.012+0000 7f29bf59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29c0109c30 0x7f29c019fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43570/0 (socket says 172.21.15.5:43570) 2024-08-31T05:35:37.016 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.012+0000 7f29bed9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29c0101dc0 0x7f29c019a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:37.016 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.012+0000 7f29bf59e640 1 -- 172.21.15.5:0/566893156 learned_addr learned my addr 172.21.15.5:0/566893156 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:37.016 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.012+0000 7f29be59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29c01092e0 0x7f29c019a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:37.017 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.012+0000 7f29bed9d640 1 -- 172.21.15.5:0/566893156 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29c01092e0 msgr2=0x7f29c019a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:37.017 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.012+0000 7f29bed9d640 1 --2- 172.21.15.5:0/566893156 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29c01092e0 0x7f29c019a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.017 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.012+0000 7f29bed9d640 1 -- 172.21.15.5:0/566893156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29c0109c30 msgr2=0x7f29c019fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:37.017 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.012+0000 7f29bed9d640 1 --2- 172.21.15.5:0/566893156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29c0109c30 0x7f29c019fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.017 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.012+0000 7f29bed9d640 1 -- 172.21.15.5:0/566893156 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29c01a0250 con 0x7f29c0101dc0 2024-08-31T05:35:37.017 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.012+0000 7f29bf59e640 1 --2- 172.21.15.5:0/566893156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29c0109c30 0x7f29c019fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:35:37.017 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.012+0000 7f29bed9d640 1 --2- 172.21.15.5:0/566893156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29c0101dc0 0x7f29c019a320 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f29b0035040 tx=0x7f29b0032d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:37.017 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.013+0000 7f29a7fff640 1 -- 172.21.15.5:0/566893156 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b0040020 con 0x7f29c0101dc0 2024-08-31T05:35:37.017 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.013+0000 7f29a7fff640 1 -- 172.21.15.5:0/566893156 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29b0030e10 con 0x7f29c0101dc0 2024-08-31T05:35:37.018 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.013+0000 7f29a7fff640 1 -- 172.21.15.5:0/566893156 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b0037040 con 0x7f29c0101dc0 2024-08-31T05:35:37.018 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.013+0000 7f29c50fa640 1 -- 172.21.15.5:0/566893156 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29c01a04e0 con 0x7f29c0101dc0 2024-08-31T05:35:37.018 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.013+0000 7f29c50fa640 1 -- 172.21.15.5:0/566893156 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29c0102c30 con 0x7f29c0101dc0 2024-08-31T05:35:37.020 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.015+0000 7f29a7fff640 1 -- 172.21.15.5:0/566893156 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f29b0043020 con 0x7f29c0101dc0 2024-08-31T05:35:37.020 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.015+0000 7f29cc063740 1 Processor -- start 2024-08-31T05:35:37.020 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.015+0000 7f29cc063740 1 -- start start 2024-08-31T05:35:37.021 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.016+0000 7f29cc063740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624b332e1b0 0x5624b36d1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:37.021 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.016+0000 7f29cc063740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624b33052f0 0x5624b36d2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:37.021 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.016+0000 7f29cc063740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5624b330d4d0 0x5624b36d2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:37.021 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.016+0000 7f29cc063740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5624b3647000 con 0x5624b330d4d0 2024-08-31T05:35:37.021 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.016+0000 7f29cc063740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5624b3636590 con 0x5624b332e1b0 2024-08-31T05:35:37.021 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.016+0000 7f29cc063740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5624b363a540 con 0x5624b33052f0 2024-08-31T05:35:37.022 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.016+0000 7f29be59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5624b330d4d0 0x5624b36d2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:37.022 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.016+0000 7f29bed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624b33052f0 0x5624b36d2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:37.022 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.016+0000 7f29be59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5624b330d4d0 0x5624b36d2540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43582/0 (socket says 172.21.15.5:43582) 2024-08-31T05:35:37.022 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.016+0000 7f29be59c640 1 -- 172.21.15.5:0/3634844196 learned_addr learned my addr 172.21.15.5:0/3634844196 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:37.022 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.016+0000 7f29bf59e640 1 --2- 172.21.15.5:0/3634844196 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624b332e1b0 0x5624b36d1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:37.022 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.016+0000 7f29bed9d640 1 -- 172.21.15.5:0/3634844196 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624b332e1b0 msgr2=0x5624b36d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:37.022 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.016+0000 7f29bed9d640 1 --2- 172.21.15.5:0/3634844196 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624b332e1b0 0x5624b36d1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.022 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.016+0000 7f29bed9d640 1 -- 172.21.15.5:0/3634844196 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5624b330d4d0 msgr2=0x5624b36d2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:37.022 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.016+0000 7f29bed9d640 1 --2- 172.21.15.5:0/3634844196 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5624b330d4d0 0x5624b36d2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.022 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.016+0000 7f29bed9d640 1 -- 172.21.15.5:0/3634844196 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624b3399790 con 0x5624b33052f0 2024-08-31T05:35:37.022 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.016+0000 7f29bed9d640 1 --2- 172.21.15.5:0/3634844196 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624b33052f0 0x5624b36d2000 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f29b0102640 tx=0x7f29b010d370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbe90942911dcae7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:37.022 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.017+0000 7f29a57fa640 1 -- 172.21.15.5:0/3634844196 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b0107110 con 0x5624b33052f0 2024-08-31T05:35:37.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.017+0000 7f29a57fa640 1 -- 172.21.15.5:0/3634844196 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29b0105bd0 con 0x5624b33052f0 2024-08-31T05:35:37.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.017+0000 7f29a57fa640 1 -- 172.21.15.5:0/3634844196 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b01166b0 con 0x5624b33052f0 2024-08-31T05:35:37.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.017+0000 7f29a7fff640 1 --2- 172.21.15.5:0/566893156 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f29a80b4d20 0x7f29a80b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:37.024 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.017+0000 7f29bf59e640 1 --2- 172.21.15.5:0/566893156 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f29a80b4d20 0x7f29a80b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:37.024 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.017+0000 7f29a7fff640 1 -- 172.21.15.5:0/566893156 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f29b01052a0 con 0x7f29c0101dc0 2024-08-31T05:35:37.028 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.018+0000 7f29cc063740 1 -- 172.21.15.5:0/3634844196 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624b33052f0 msgr2=0x5624b36d2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:37.029 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.018+0000 7f29cc063740 1 --2- 172.21.15.5:0/3634844196 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624b33052f0 0x5624b36d2000 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f29b0102640 tx=0x7f29b010d370 comp rx=0 tx=0).stop 2024-08-31T05:35:37.029 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.019+0000 7f29bf59e640 1 --2- 172.21.15.5:0/566893156 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f29a80b4d20 0x7f29a80b7230 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f29b80049d0 tx=0x7f29b8009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:37.029 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.019+0000 7f29cc063740 1 -- 172.21.15.5:0/3634844196 shutdown_connections 2024-08-31T05:35:37.029 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.019+0000 7f29cc063740 1 --2- 172.21.15.5:0/3634844196 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5624b330d4d0 0x5624b36d2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.029 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.019+0000 7f29cc063740 1 --2- 172.21.15.5:0/3634844196 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624b33052f0 0x5624b36d2000 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.029 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.019+0000 7f29cc063740 1 --2- 172.21.15.5:0/3634844196 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624b332e1b0 0x5624b36d1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.029 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.019+0000 7f29cc063740 1 -- 172.21.15.5:0/3634844196 >> 172.21.15.5:0/3634844196 conn(0x5624b3322300 msgr2=0x5624b36cf9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:37.030 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.019+0000 7f29cc063740 1 -- 172.21.15.5:0/3634844196 shutdown_connections 2024-08-31T05:35:37.030 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.019+0000 7f29cc063740 1 -- 172.21.15.5:0/3634844196 wait complete. 2024-08-31T05:35:37.030 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.020+0000 7f29cc063740 1 -- start start 2024-08-31T05:35:37.030 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.020+0000 7f29cc063740 1 Processor -- start 2024-08-31T05:35:37.030 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.020+0000 7f29cc063740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5624b33052f0 0x5624b36dd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:37.030 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.020+0000 7f29cc063740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624b330d4d0 0x5624b36ddb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:37.030 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.020+0000 7f29cc063740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624b332e1b0 0x5624b36e92b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:37.030 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.020+0000 7f29cc063740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5624b356fab0 con 0x5624b33052f0 2024-08-31T05:35:37.031 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.020+0000 7f29cc063740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5624b35bd680 con 0x5624b332e1b0 2024-08-31T05:35:37.031 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.020+0000 7f29cc063740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5624b36e0000 con 0x5624b330d4d0 2024-08-31T05:35:37.031 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.020+0000 7f29bed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5624b33052f0 0x5624b36dd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:37.031 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.020+0000 7f29be59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624b330d4d0 0x5624b36ddb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:37.031 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.020+0000 7f29bed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5624b33052f0 0x5624b36dd5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43586/0 (socket says 172.21.15.5:43586) 2024-08-31T05:35:37.031 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.020+0000 7f29bed9d640 1 -- 172.21.15.5:0/3426328209 learned_addr learned my addr 172.21.15.5:0/3426328209 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:37.031 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.020+0000 7f29cc063740 10 client.0 _ll_register_callbacks cb 0x5624b3345a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:35:37.031 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.020+0000 7f29bf59e640 1 --2- 172.21.15.5:0/3426328209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624b332e1b0 0x5624b36e92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:37.031 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.021+0000 7f29bed9d640 1 -- 172.21.15.5:0/3426328209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624b330d4d0 msgr2=0x5624b36ddb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:37.031 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.021+0000 7f29bed9d640 1 --2- 172.21.15.5:0/3426328209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624b330d4d0 0x5624b36ddb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.031 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.021+0000 7f29bed9d640 1 -- 172.21.15.5:0/3426328209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624b332e1b0 msgr2=0x5624b36e92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:37.032 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.021+0000 7f29bed9d640 1 --2- 172.21.15.5:0/3426328209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624b332e1b0 0x5624b36e92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.032 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.021+0000 7f29bed9d640 1 -- 172.21.15.5:0/3426328209 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624b3412620 con 0x5624b33052f0 2024-08-31T05:35:37.032 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.021+0000 7f29be59c640 1 --2- 172.21.15.5:0/3426328209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624b330d4d0 0x5624b36ddb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:35:37.032 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.021+0000 7f29bed9d640 1 --2- 172.21.15.5:0/3426328209 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5624b33052f0 0x5624b36dd5c0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f29b0102720 tx=0x7f29b0004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cd2752886cafd04 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:37.032 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.021+0000 7f29a2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:35:37.032 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.021+0000 7f29a2ff5640 1 -- 172.21.15.5:0/3426328209 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b00c74d0 con 0x5624b33052f0 2024-08-31T05:35:37.032 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.021+0000 7f29a2ff5640 1 -- 172.21.15.5:0/3426328209 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f29b010dd80 con 0x5624b33052f0 2024-08-31T05:35:37.032 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.021+0000 7f29cc063740 1 -- 172.21.15.5:0/3426328209 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29b0105bd0 con 0x5624b33052f0 2024-08-31T05:35:37.032 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.021+0000 7f29a2ff5640 1 -- 172.21.15.5:0/3426328209 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f29b00cad80 con 0x5624b33052f0 2024-08-31T05:35:37.032 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.021+0000 7f29cc063740 10 client.17082 fetch_fsmap learned FSMap version 34 2024-08-31T05:35:37.032 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.021+0000 7f29cc063740 1 -- 172.21.15.5:0/3426328209 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5624b36ebee0 con 0x5624b33052f0 2024-08-31T05:35:37.032 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.021+0000 7f29a2ff5640 1 -- 172.21.15.5:0/3426328209 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29b00cb120 con 0x5624b33052f0 2024-08-31T05:35:37.032 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.022+0000 7f29a2ff5640 1 -- 172.21.15.5:0/3426328209 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f29b00c78a0 con 0x5624b33052f0 2024-08-31T05:35:37.033 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.022+0000 7f29cc063740 10 client.17082 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:35:37.033 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.022+0000 7f29cc063740 10 client.17082 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:35:37.033 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.022+0000 7f29cc063740 20 client.17082 populate_metadata read hostname 'smithi005' 2024-08-31T05:35:37.033 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.022+0000 7f29cc063740 1 --2- 172.21.15.5:0/3426328209 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5624b32ecd80 0x5624b36ef240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:37.033 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.022+0000 7f29cc063740 4 client.17082 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:35:37.033 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.022+0000 7f29cc063740 1 -- 172.21.15.5:0/3426328209 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f29b0105bd0 con 0x5624b32ecd80 2024-08-31T05:35:37.033 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.022+0000 7f29be59c640 1 --2- 172.21.15.5:0/3426328209 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5624b32ecd80 0x5624b36ef240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:37.033 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.022+0000 7f29a2ff5640 10 client.17082 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:35:37.033 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.022+0000 7f29be59c640 1 --2- 172.21.15.5:0/3426328209 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5624b32ecd80 0x5624b36ef240 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2362430d82b7f1ff server_cookie=faaa1d7c82470ebe in_seq=0 out_seq=0 2024-08-31T05:35:37.033 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.023+0000 7f29a2ff5640 1 -- 172.21.15.5:0/3426328209 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f29b0105bd0 con 0x5624b32ecd80 2024-08-31T05:35:37.034 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.023+0000 7f29a2ff5640 10 client.17082 handle_command_reply: tid=0 2024-08-31T05:35:37.034 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.023+0000 7f29cc063740 1 client.17082 shutdown 2024-08-31T05:35:37.034 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.023+0000 7f29cc063740 1 -- 172.21.15.5:0/3426328209 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5624b33052f0 msgr2=0x5624b36dd5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:37.034 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.023+0000 7f29cc063740 1 --2- 172.21.15.5:0/3426328209 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5624b33052f0 0x5624b36dd5c0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f29b0102720 tx=0x7f29b0004610 comp rx=0 tx=0).stop 2024-08-31T05:35:37.034 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.023+0000 7f29cc063740 1 -- 172.21.15.5:0/3426328209 shutdown_connections 2024-08-31T05:35:37.034 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.023+0000 7f29cc063740 1 --2- 172.21.15.5:0/3426328209 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5624b32ecd80 0x5624b36ef240 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.034 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.023+0000 7f29cc063740 1 --2- 172.21.15.5:0/3426328209 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624b332e1b0 0x5624b36e92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.035 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.023+0000 7f29cc063740 1 --2- 172.21.15.5:0/3426328209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624b330d4d0 0x5624b36ddb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.035 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.023+0000 7f29a2ff5640 0 client.17082 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:35:37.035 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.023+0000 7f29cc063740 1 --2- 172.21.15.5:0/3426328209 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5624b33052f0 0x5624b36dd5c0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.035 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.023+0000 7f29cc063740 1 -- 172.21.15.5:0/3426328209 >> 172.21.15.5:0/3426328209 conn(0x5624b3322300 msgr2=0x5624b36d2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:37.035 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.023+0000 7f29cc063740 1 -- 172.21.15.5:0/3426328209 shutdown_connections 2024-08-31T05:35:37.035 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.024+0000 7f29cc063740 1 -- 172.21.15.5:0/3426328209 wait complete. 2024-08-31T05:35:37.036 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.024+0000 7f29cc063740 20 client.17082 trim_cache size 0 max 16384 2024-08-31T05:35:37.036 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:35:37.049 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.044+0000 7f29cc063740 1 Processor -- start 2024-08-31T05:35:37.049 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.044+0000 7f29cc063740 1 -- start start 2024-08-31T05:35:37.049 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.044+0000 7f29cc063740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5624b32ecd80 0x5624b36d8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:37.049 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.044+0000 7f29cc063740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624b33052f0 0x5624b36d6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:37.049 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.044+0000 7f29cc063740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624b330d4d0 0x5624b36da580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:37.049 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.045+0000 7f29cc063740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f29c01b7190 con 0x5624b32ecd80 2024-08-31T05:35:37.050 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.045+0000 7f29cc063740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f29c01b8cd0 con 0x5624b330d4d0 2024-08-31T05:35:37.050 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.045+0000 7f29cc063740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f29c01b7860 con 0x5624b33052f0 2024-08-31T05:35:37.050 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.045+0000 7f29bf59e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624b330d4d0 0x5624b36da580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:37.050 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.045+0000 7f29bf59e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624b330d4d0 0x5624b36da580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:39330/0 (socket says 172.21.15.5:39330) 2024-08-31T05:35:37.050 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.045+0000 7f29bf59e640 1 -- 172.21.15.5:0/563786551 learned_addr learned my addr 172.21.15.5:0/563786551 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:37.050 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.045+0000 7f29bed9d640 1 --2- 172.21.15.5:0/563786551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5624b32ecd80 0x5624b36d8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:37.050 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.045+0000 7f29be59c640 1 --2- 172.21.15.5:0/563786551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624b33052f0 0x5624b36d6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:37.050 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.045+0000 7f29bf59e640 1 -- 172.21.15.5:0/563786551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624b33052f0 msgr2=0x5624b36d6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:37.050 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.045+0000 7f29bf59e640 1 --2- 172.21.15.5:0/563786551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624b33052f0 0x5624b36d6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.050 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.045+0000 7f29bf59e640 1 -- 172.21.15.5:0/563786551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5624b32ecd80 msgr2=0x5624b36d8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:37.050 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.045+0000 7f29bf59e640 1 --2- 172.21.15.5:0/563786551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5624b32ecd80 0x5624b36d8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.050 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.045+0000 7f29bf59e640 1 -- 172.21.15.5:0/563786551 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624b36db890 con 0x5624b330d4d0 2024-08-31T05:35:37.050 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.045+0000 7f29be59c640 1 --2- 172.21.15.5:0/563786551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624b33052f0 0x5624b36d6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:35:37.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.046+0000 7f29bed9d640 1 --2- 172.21.15.5:0/563786551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5624b32ecd80 0x5624b36d8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:35:37.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.046+0000 7f29bf59e640 1 --2- 172.21.15.5:0/563786551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624b330d4d0 0x5624b36da580 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f29b800fb30 tx=0x7f29b801a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a82d7fa7e57ea58 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:37.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.046+0000 7f29a4ff9640 1 -- 172.21.15.5:0/563786551 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b8011ac0 con 0x5624b330d4d0 2024-08-31T05:35:37.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.046+0000 7f29a4ff9640 1 -- 172.21.15.5:0/563786551 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29b8011c60 con 0x5624b330d4d0 2024-08-31T05:35:37.051 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.046+0000 7f29a4ff9640 1 -- 172.21.15.5:0/563786551 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b801d650 con 0x5624b330d4d0 2024-08-31T05:35:37.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.047+0000 7f29cc063740 1 -- 172.21.15.5:0/563786551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624b330d4d0 msgr2=0x5624b36da580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:37.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.047+0000 7f29cc063740 1 --2- 172.21.15.5:0/563786551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624b330d4d0 0x5624b36da580 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f29b800fb30 tx=0x7f29b801a000 comp rx=0 tx=0).stop 2024-08-31T05:35:37.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.047+0000 7f29cc063740 1 -- 172.21.15.5:0/563786551 shutdown_connections 2024-08-31T05:35:37.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.047+0000 7f29cc063740 1 --2- 172.21.15.5:0/563786551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624b330d4d0 0x5624b36da580 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.047+0000 7f29cc063740 1 --2- 172.21.15.5:0/563786551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624b33052f0 0x5624b36d6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.047+0000 7f29cc063740 1 --2- 172.21.15.5:0/563786551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5624b32ecd80 0x5624b36d8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.047+0000 7f29cc063740 1 -- 172.21.15.5:0/563786551 >> 172.21.15.5:0/563786551 conn(0x5624b3322300 msgr2=0x5624b36d68e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:37.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.047+0000 7f29cc063740 1 -- 172.21.15.5:0/563786551 shutdown_connections 2024-08-31T05:35:37.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.047+0000 7f29cc063740 1 -- 172.21.15.5:0/563786551 wait complete. 2024-08-31T05:35:37.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.047+0000 7f29cc063740 1 -- start start 2024-08-31T05:35:37.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.047+0000 7f29cc063740 1 Processor -- start 2024-08-31T05:35:37.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.048+0000 7f29cc063740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624b32ecd80 0x5624b36e3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:37.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.048+0000 7f29cc063740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624b33052f0 0x5624b36e3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:37.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.048+0000 7f29cc063740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5624b330d4d0 0x5624b3758b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:37.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.048+0000 7f29cc063740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f29c01b8600 con 0x5624b330d4d0 2024-08-31T05:35:37.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.048+0000 7f29cc063740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f29c01b7f30 con 0x5624b33052f0 2024-08-31T05:35:37.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.048+0000 7f29cc063740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f29c01aae40 con 0x5624b32ecd80 2024-08-31T05:35:37.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.048+0000 7f29cc063740 10 client.0 _ll_register_callbacks cb 0x7f29b4009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:35:37.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.048+0000 7f29bed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624b32ecd80 0x5624b36e3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:37.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.048+0000 7f29bed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624b32ecd80 0x5624b36e3510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:42104/0 (socket says 172.21.15.5:42104) 2024-08-31T05:35:37.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.048+0000 7f29be59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624b33052f0 0x5624b36e3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:37.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.048+0000 7f29bed9d640 1 -- 172.21.15.5:0/149897851 learned_addr learned my addr 172.21.15.5:0/149897851 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:37.057 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.048+0000 7f29bf59e640 1 --2- 172.21.15.5:0/149897851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5624b330d4d0 0x5624b3758b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:37.057 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.048+0000 7f29be59c640 1 -- 172.21.15.5:0/149897851 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624b32ecd80 msgr2=0x5624b36e3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:37.057 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.048+0000 7f29be59c640 1 --2- 172.21.15.5:0/149897851 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624b32ecd80 0x5624b36e3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.057 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.048+0000 7f29be59c640 1 -- 172.21.15.5:0/149897851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5624b330d4d0 msgr2=0x5624b3758b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:37.057 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.048+0000 7f29be59c640 1 --2- 172.21.15.5:0/149897851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5624b330d4d0 0x5624b3758b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.057 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.048+0000 7f29be59c640 1 -- 172.21.15.5:0/149897851 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624b36e42d0 con 0x5624b33052f0 2024-08-31T05:35:37.057 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.049+0000 7f29be59c640 1 --2- 172.21.15.5:0/149897851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624b33052f0 0x5624b36e3a50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x5624b36ef830 tx=0x7f29b4012c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d7e07fca4867ec server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:37.057 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.049+0000 7f29a2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:35:37.057 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.049+0000 7f29a2ff5640 1 -- 172.21.15.5:0/149897851 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b4011910 con 0x5624b33052f0 2024-08-31T05:35:37.057 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.049+0000 7f29a2ff5640 1 -- 172.21.15.5:0/149897851 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f29b4011ab0 con 0x5624b33052f0 2024-08-31T05:35:37.057 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.049+0000 7f29cc063740 1 -- 172.21.15.5:0/149897851 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29b8011c60 con 0x5624b33052f0 2024-08-31T05:35:37.057 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.049+0000 7f29a2ff5640 1 -- 172.21.15.5:0/149897851 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f29b4032050 con 0x5624b33052f0 2024-08-31T05:35:37.057 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.049+0000 7f29cc063740 10 client.26675 fetch_fsmap learned FSMap version 34 2024-08-31T05:35:37.058 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.049+0000 7f29cc063740 1 -- 172.21.15.5:0/149897851 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5624b375a0c0 con 0x5624b33052f0 2024-08-31T05:35:37.058 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.049+0000 7f29a2ff5640 1 -- 172.21.15.5:0/149897851 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29b8011c60 con 0x5624b33052f0 2024-08-31T05:35:37.058 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.049+0000 7f29a2ff5640 1 -- 172.21.15.5:0/149897851 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f29b401e3f0 con 0x5624b33052f0 2024-08-31T05:35:37.058 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.050+0000 7f29cc063740 10 client.26675 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:35:37.058 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.050+0000 7f29cc063740 10 client.26675 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:35:37.058 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.050+0000 7f29cc063740 20 client.26675 populate_metadata read hostname 'smithi005' 2024-08-31T05:35:37.058 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.050+0000 7f29cc063740 1 --2- 172.21.15.5:0/149897851 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5624b332e1b0 0x5624b375c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:37.058 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.050+0000 7f29cc063740 4 client.26675 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:35:37.058 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.050+0000 7f29cc063740 1 -- 172.21.15.5:0/149897851 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5624b3648f50 con 0x5624b332e1b0 2024-08-31T05:35:37.058 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.050+0000 7f29bed9d640 1 --2- 172.21.15.5:0/149897851 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5624b332e1b0 0x5624b375c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:37.059 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.051+0000 7f29a2ff5640 10 client.26675 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:35:37.059 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.051+0000 7f29bed9d640 1 --2- 172.21.15.5:0/149897851 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5624b332e1b0 0x5624b375c850 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ad6fff1c72035bb server_cookie=db5ba301ccea9613 in_seq=0 out_seq=0 2024-08-31T05:35:37.066 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.061+0000 7f29a2ff5640 1 -- 172.21.15.5:0/149897851 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5624b3648f50 con 0x5624b332e1b0 2024-08-31T05:35:37.066 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.061+0000 7f29a2ff5640 10 client.26675 handle_command_reply: tid=0 2024-08-31T05:35:37.067 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.061+0000 7f29cc063740 1 client.26675 shutdown 2024-08-31T05:35:37.067 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.061+0000 7f29cc063740 1 -- 172.21.15.5:0/149897851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624b33052f0 msgr2=0x5624b36e3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:37.067 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.061+0000 7f29cc063740 1 --2- 172.21.15.5:0/149897851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624b33052f0 0x5624b36e3a50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x5624b36ef830 tx=0x7f29b4012c20 comp rx=0 tx=0).stop 2024-08-31T05:35:37.067 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.061+0000 7f29cc063740 1 -- 172.21.15.5:0/149897851 shutdown_connections 2024-08-31T05:35:37.067 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.061+0000 7f29cc063740 1 --2- 172.21.15.5:0/149897851 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5624b332e1b0 0x5624b375c850 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.068 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.061+0000 7f29cc063740 1 --2- 172.21.15.5:0/149897851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5624b330d4d0 0x5624b3758b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.068 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.061+0000 7f29cc063740 1 --2- 172.21.15.5:0/149897851 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5624b33052f0 0x5624b36e3a50 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.068 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.061+0000 7f29cc063740 1 --2- 172.21.15.5:0/149897851 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624b32ecd80 0x5624b36e3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.069 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.061+0000 7f29cc063740 1 -- 172.21.15.5:0/149897851 >> 172.21.15.5:0/149897851 conn(0x5624b3322300 msgr2=0x5624b36de860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:37.069 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.061+0000 7f29a2ff5640 0 client.26675 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:35:37.069 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.061+0000 7f29cc063740 1 -- 172.21.15.5:0/149897851 shutdown_connections 2024-08-31T05:35:37.069 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.061+0000 7f29cc063740 1 -- 172.21.15.5:0/149897851 wait complete. 2024-08-31T05:35:37.069 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.061+0000 7f29cc063740 20 client.26675 trim_cache size 0 max 16384 2024-08-31T05:35:37.070 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:35:37.070 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:35:37.071 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:35:37.071 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:35:37.072 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.062+0000 7f29c50fa640 1 -- 172.21.15.5:0/566893156 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f29a80b4d20 msgr2=0x7f29a80b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:37.072 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.062+0000 7f29c50fa640 1 --2- 172.21.15.5:0/566893156 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f29a80b4d20 0x7f29a80b7230 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f29b80049d0 tx=0x7f29b8009500 comp rx=0 tx=0).stop 2024-08-31T05:35:37.073 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.062+0000 7f29c50fa640 1 -- 172.21.15.5:0/566893156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29c0101dc0 msgr2=0x7f29c019a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:37.073 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.062+0000 7f29c50fa640 1 --2- 172.21.15.5:0/566893156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29c0101dc0 0x7f29c019a320 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f29b0035040 tx=0x7f29b0032d50 comp rx=0 tx=0).stop 2024-08-31T05:35:37.073 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.062+0000 7f29c50fa640 1 -- 172.21.15.5:0/566893156 shutdown_connections 2024-08-31T05:35:37.073 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.062+0000 7f29c50fa640 1 --2- 172.21.15.5:0/566893156 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f29a80b4d20 0x7f29a80b7230 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.074 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.062+0000 7f29c50fa640 1 --2- 172.21.15.5:0/566893156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29c0109c30 0x7f29c019fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.074 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.062+0000 7f29c50fa640 1 --2- 172.21.15.5:0/566893156 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29c01092e0 0x7f29c019a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.074 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.062+0000 7f29c50fa640 1 --2- 172.21.15.5:0/566893156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29c0101dc0 0x7f29c019a320 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.074 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.062+0000 7f29c50fa640 1 -- 172.21.15.5:0/566893156 >> 172.21.15.5:0/566893156 conn(0x7f29c0079bf0 msgr2=0x7f29c0107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:37.074 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.062+0000 7f29c50fa640 1 -- 172.21.15.5:0/566893156 shutdown_connections 2024-08-31T05:35:37.075 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:37.062+0000 7f29c50fa640 1 -- 172.21.15.5:0/566893156 wait complete. 2024-08-31T05:35:37.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:35:36 smithi050 ceph-mon[22146]: pgmap v514: 129 pgs: 129 active+clean; 358 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.6 MiB/s wr, 289 op/s 2024-08-31T05:35:37.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:35:36 smithi070 ceph-mon[22316]: pgmap v514: 129 pgs: 129 active+clean; 358 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.6 MiB/s wr, 289 op/s 2024-08-31T05:35:37.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.609+0000 7fbf8147b640 1 -- 172.21.15.5:0/2866373944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf7c103920 msgr2=0x7fbf7c103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:37.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.609+0000 7fbf8147b640 1 --2- 172.21.15.5:0/2866373944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf7c103920 0x7fbf7c103d30 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c009900 tx=0x7fbf6c02a410 comp rx=0 tx=0).stop 2024-08-31T05:35:37.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.609+0000 7fbf8147b640 1 -- 172.21.15.5:0/2866373944 shutdown_connections 2024-08-31T05:35:37.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.609+0000 7fbf8147b640 1 --2- 172.21.15.5:0/2866373944 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf7c109bb0 0x7fbf7c1103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.609+0000 7fbf8147b640 1 --2- 172.21.15.5:0/2866373944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf7c109260 0x7fbf7c109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.609+0000 7fbf8147b640 1 --2- 172.21.15.5:0/2866373944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf7c103920 0x7fbf7c103d30 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.609+0000 7fbf8147b640 1 -- 172.21.15.5:0/2866373944 >> 172.21.15.5:0/2866373944 conn(0x7fbf7c0ff330 msgr2=0x7fbf7c101780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:37.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.609+0000 7fbf8147b640 1 -- 172.21.15.5:0/2866373944 shutdown_connections 2024-08-31T05:35:37.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.609+0000 7fbf8147b640 1 -- 172.21.15.5:0/2866373944 wait complete. 2024-08-31T05:35:37.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.610+0000 7fbf8147b640 1 Processor -- start 2024-08-31T05:35:37.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.610+0000 7fbf8147b640 1 -- start start 2024-08-31T05:35:37.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.611+0000 7fbf8147b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf7c103920 0x7fbf7c0754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:37.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.611+0000 7fbf8147b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf7c109260 0x7fbf7c0759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:37.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.611+0000 7fbf8147b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf7c109bb0 0x7fbf7c075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:37.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.611+0000 7fbf8147b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7c113870 con 0x7fbf7c109260 2024-08-31T05:35:37.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.611+0000 7fbf8147b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7c1136f0 con 0x7fbf7c103920 2024-08-31T05:35:37.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.611+0000 7fbf8147b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7c1139f0 con 0x7fbf7c109bb0 2024-08-31T05:35:37.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.611+0000 7fbf7a7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf7c109260 0x7fbf7c0759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:37.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.611+0000 7fbf7b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf7c109bb0 0x7fbf7c075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:37.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.611+0000 7fbf7affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf7c103920 0x7fbf7c0754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:37.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.611+0000 7fbf7a7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf7c109260 0x7fbf7c0759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43630/0 (socket says 172.21.15.5:43630) 2024-08-31T05:35:37.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.611+0000 7fbf7b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf7c109bb0 0x7fbf7c075f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:42134/0 (socket says 172.21.15.5:42134) 2024-08-31T05:35:37.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.611+0000 7fbf7a7fc640 1 -- 172.21.15.5:0/4147896682 learned_addr learned my addr 172.21.15.5:0/4147896682 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:37.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.611+0000 7fbf7affd640 1 -- 172.21.15.5:0/4147896682 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf7c109bb0 msgr2=0x7fbf7c075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:37.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.611+0000 7fbf7affd640 1 --2- 172.21.15.5:0/4147896682 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf7c109bb0 0x7fbf7c075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.611+0000 7fbf7affd640 1 -- 172.21.15.5:0/4147896682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf7c109260 msgr2=0x7fbf7c0759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:37.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.611+0000 7fbf7affd640 1 --2- 172.21.15.5:0/4147896682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf7c109260 0x7fbf7c0759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.611+0000 7fbf7affd640 1 -- 172.21.15.5:0/4147896682 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf7c1a8540 con 0x7fbf7c103920 2024-08-31T05:35:37.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.611+0000 7fbf7b7fe640 1 --2- 172.21.15.5:0/4147896682 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf7c109bb0 0x7fbf7c075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:35:37.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.611+0000 7fbf7affd640 1 --2- 172.21.15.5:0/4147896682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf7c103920 0x7fbf7c0754b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c02a930 tx=0x7fbf6c031a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:37.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.612+0000 7fbf63fff640 1 -- 172.21.15.5:0/4147896682 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf6c03f030 con 0x7fbf7c103920 2024-08-31T05:35:37.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.612+0000 7fbf63fff640 1 -- 172.21.15.5:0/4147896682 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf6c004490 con 0x7fbf7c103920 2024-08-31T05:35:37.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.612+0000 7fbf8147b640 1 -- 172.21.15.5:0/4147896682 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf7c1a87d0 con 0x7fbf7c103920 2024-08-31T05:35:37.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.612+0000 7fbf63fff640 1 -- 172.21.15.5:0/4147896682 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf6c035070 con 0x7fbf7c103920 2024-08-31T05:35:37.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.612+0000 7fbf8147b640 1 -- 172.21.15.5:0/4147896682 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf7c1a8cb0 con 0x7fbf7c103920 2024-08-31T05:35:37.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.615+0000 7fbf879f0740 1 Processor -- start 2024-08-31T05:35:37.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.615+0000 7fbf63fff640 1 -- 172.21.15.5:0/4147896682 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fbf6c042030 con 0x7fbf7c103920 2024-08-31T05:35:37.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.615+0000 7fbf879f0740 1 -- start start 2024-08-31T05:35:37.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.615+0000 7fbf879f0740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555becdf4070 0x555bed199350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:37.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.615+0000 7fbf879f0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555becdcb1b0 0x555bed199890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:37.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.615+0000 7fbf879f0740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555becdd3390 0x555bed199dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:37.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.615+0000 7fbf879f0740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x555bed110680 con 0x555becdd3390 2024-08-31T05:35:37.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.615+0000 7fbf879f0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x555bed0ffc10 con 0x555becdcb1b0 2024-08-31T05:35:37.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.615+0000 7fbf879f0740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555bed103bc0 con 0x555becdf4070 2024-08-31T05:35:37.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.615+0000 7fbf7affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555becdcb1b0 0x555bed199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:37.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.615+0000 7fbf7a7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555becdd3390 0x555bed199dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:37.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.615+0000 7fbf7affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555becdcb1b0 0x555bed199890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:39368/0 (socket says 172.21.15.5:39368) 2024-08-31T05:35:37.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.615+0000 7fbf7affd640 1 -- 172.21.15.5:0/3519461324 learned_addr learned my addr 172.21.15.5:0/3519461324 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:37.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.616+0000 7fbf7b7fe640 1 --2- 172.21.15.5:0/3519461324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555becdf4070 0x555bed199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:37.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.616+0000 7fbf7a7fc640 1 -- 172.21.15.5:0/3519461324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555becdf4070 msgr2=0x555bed199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:37.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.616+0000 7fbf7a7fc640 1 --2- 172.21.15.5:0/3519461324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555becdf4070 0x555bed199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.616+0000 7fbf7a7fc640 1 -- 172.21.15.5:0/3519461324 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555becdcb1b0 msgr2=0x555bed199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:37.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.616+0000 7fbf7a7fc640 1 --2- 172.21.15.5:0/3519461324 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555becdcb1b0 0x555bed199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.616+0000 7fbf7a7fc640 1 -- 172.21.15.5:0/3519461324 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bece5f650 con 0x555becdd3390 2024-08-31T05:35:37.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.616+0000 7fbf7a7fc640 1 --2- 172.21.15.5:0/3519461324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555becdd3390 0x555bed199dd0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fbf70009c20 tx=0x7fbf70011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac77b2fa1b32685d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:37.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.616+0000 7fbf63fff640 1 --2- 172.21.15.5:0/4147896682 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fbf640b4ca0 0x7fbf640b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:37.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.616+0000 7fbf7b7fe640 1 --2- 172.21.15.5:0/4147896682 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fbf640b4ca0 0x7fbf640b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:37.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.616+0000 7fbf617fa640 1 -- 172.21.15.5:0/3519461324 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf70005220 con 0x555becdd3390 2024-08-31T05:35:37.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.617+0000 7fbf617fa640 1 -- 172.21.15.5:0/3519461324 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf70004c50 con 0x555becdd3390 2024-08-31T05:35:37.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.617+0000 7fbf617fa640 1 -- 172.21.15.5:0/3519461324 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf70019690 con 0x555becdd3390 2024-08-31T05:35:37.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.617+0000 7fbf63fff640 1 -- 172.21.15.5:0/4147896682 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fbf6c105860 con 0x7fbf7c103920 2024-08-31T05:35:37.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.618+0000 7fbf879f0740 1 -- 172.21.15.5:0/3519461324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555becdd3390 msgr2=0x555bed199dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:37.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.618+0000 7fbf879f0740 1 --2- 172.21.15.5:0/3519461324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555becdd3390 0x555bed199dd0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fbf70009c20 tx=0x7fbf70011810 comp rx=0 tx=0).stop 2024-08-31T05:35:37.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.618+0000 7fbf7b7fe640 1 --2- 172.21.15.5:0/4147896682 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fbf640b4ca0 0x7fbf640b71b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fbf74005fd0 tx=0x7fbf74009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:37.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.618+0000 7fbf879f0740 1 -- 172.21.15.5:0/3519461324 shutdown_connections 2024-08-31T05:35:37.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.618+0000 7fbf879f0740 1 --2- 172.21.15.5:0/3519461324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555becdd3390 0x555bed199dd0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.618+0000 7fbf879f0740 1 --2- 172.21.15.5:0/3519461324 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555becdcb1b0 0x555bed199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.618+0000 7fbf879f0740 1 --2- 172.21.15.5:0/3519461324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555becdf4070 0x555bed199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.618+0000 7fbf879f0740 1 -- 172.21.15.5:0/3519461324 >> 172.21.15.5:0/3519461324 conn(0x555becde8460 msgr2=0x555bed197240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:37.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.618+0000 7fbf879f0740 1 -- 172.21.15.5:0/3519461324 shutdown_connections 2024-08-31T05:35:37.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.618+0000 7fbf879f0740 1 -- 172.21.15.5:0/3519461324 wait complete. 2024-08-31T05:35:37.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.618+0000 7fbf879f0740 1 -- start start 2024-08-31T05:35:37.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.618+0000 7fbf879f0740 1 Processor -- start 2024-08-31T05:35:37.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.619+0000 7fbf879f0740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555becdcb1b0 0x555bed1a4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:37.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.619+0000 7fbf879f0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555becdd3390 0x555bed1a4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:37.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.619+0000 7fbf879f0740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555becdf4070 0x555bed1a53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:37.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.619+0000 7fbf879f0740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x555becf62700 con 0x555becdf4070 2024-08-31T05:35:37.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.619+0000 7fbf879f0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x555bed086750 con 0x555becdd3390 2024-08-31T05:35:37.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.619+0000 7fbf879f0740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555bed1a7b30 con 0x555becdcb1b0 2024-08-31T05:35:37.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.619+0000 7fbf879f0740 10 client.0 _ll_register_callbacks cb 0x555bed0b5e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:35:37.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.619+0000 7fbf7affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555becdcb1b0 0x555bed1a4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:37.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.619+0000 7fbf7a7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555becdd3390 0x555bed1a4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:37.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.619+0000 7fbf7affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555becdcb1b0 0x555bed1a4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:42154/0 (socket says 172.21.15.5:42154) 2024-08-31T05:35:37.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.619+0000 7fbf7affd640 1 -- 172.21.15.5:0/2159127147 learned_addr learned my addr 172.21.15.5:0/2159127147 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:37.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.619+0000 7fbf7b7fe640 1 --2- 172.21.15.5:0/2159127147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555becdf4070 0x555bed1a53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:37.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.619+0000 7fbf7affd640 1 -- 172.21.15.5:0/2159127147 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555becdd3390 msgr2=0x555bed1a4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:37.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.619+0000 7fbf7affd640 1 --2- 172.21.15.5:0/2159127147 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555becdd3390 0x555bed1a4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.619+0000 7fbf7affd640 1 -- 172.21.15.5:0/2159127147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555becdf4070 msgr2=0x555bed1a53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:37.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.619+0000 7fbf7affd640 1 --2- 172.21.15.5:0/2159127147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555becdf4070 0x555bed1a53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.619+0000 7fbf7affd640 1 -- 172.21.15.5:0/2159127147 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555bed0bf900 con 0x555becdcb1b0 2024-08-31T05:35:37.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.619+0000 7fbf7affd640 1 --2- 172.21.15.5:0/2159127147 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555becdcb1b0 0x555bed1a4950 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c0c7ca0 tx=0x7fbf6c102b70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e925ece1cd52f55 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:37.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.619+0000 7fbf5eff5640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:35:37.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.619+0000 7fbf5eff5640 1 -- 172.21.15.5:0/2159127147 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf6c049070 con 0x555becdcb1b0 2024-08-31T05:35:37.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.620+0000 7fbf5eff5640 1 -- 172.21.15.5:0/2159127147 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fbf6c105410 con 0x555becdcb1b0 2024-08-31T05:35:37.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.620+0000 7fbf879f0740 1 -- 172.21.15.5:0/2159127147 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf70004c50 con 0x555becdcb1b0 2024-08-31T05:35:37.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.620+0000 7fbf5eff5640 1 -- 172.21.15.5:0/2159127147 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fbf6c0c7ae0 con 0x555becdcb1b0 2024-08-31T05:35:37.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.620+0000 7fbf879f0740 10 client.26698 fetch_fsmap learned FSMap version 34 2024-08-31T05:35:37.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.620+0000 7fbf879f0740 1 -- 172.21.15.5:0/2159127147 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x555bed1b37e0 con 0x555becdcb1b0 2024-08-31T05:35:37.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.620+0000 7fbf5eff5640 1 -- 172.21.15.5:0/2159127147 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf70004c50 con 0x555becdcb1b0 2024-08-31T05:35:37.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.620+0000 7fbf5eff5640 1 -- 172.21.15.5:0/2159127147 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fbf6c0cbe80 con 0x555becdcb1b0 2024-08-31T05:35:37.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.620+0000 7fbf879f0740 10 client.26698 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:35:37.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.620+0000 7fbf879f0740 10 client.26698 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:35:37.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.620+0000 7fbf879f0740 20 client.26698 populate_metadata read hostname 'smithi005' 2024-08-31T05:35:37.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.620+0000 7fbf879f0740 1 --2- 172.21.15.5:0/2159127147 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x555becdb29f0 0x555bed1b6d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:37.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.620+0000 7fbf879f0740 4 client.26698 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:35:37.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.620+0000 7fbf879f0740 1 -- 172.21.15.5:0/2159127147 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555bed1125d0 con 0x555becdb29f0 2024-08-31T05:35:37.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.620+0000 7fbf7a7fc640 1 --2- 172.21.15.5:0/2159127147 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x555becdb29f0 0x555bed1b6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:37.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.621+0000 7fbf7a7fc640 1 --2- 172.21.15.5:0/2159127147 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x555becdb29f0 0x555bed1b6d50 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba598ddeb17eebcd server_cookie=51f6646cc69e292e in_seq=0 out_seq=0 2024-08-31T05:35:37.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.621+0000 7fbf5eff5640 10 client.26698 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:35:37.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.621+0000 7fbf5eff5640 1 -- 172.21.15.5:0/2159127147 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555bed1125d0 con 0x555becdb29f0 2024-08-31T05:35:37.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.621+0000 7fbf5eff5640 10 client.26698 handle_command_reply: tid=0 2024-08-31T05:35:37.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.621+0000 7fbf879f0740 1 client.26698 shutdown 2024-08-31T05:35:37.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.622+0000 7fbf879f0740 1 -- 172.21.15.5:0/2159127147 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555becdcb1b0 msgr2=0x555bed1a4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:37.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.622+0000 7fbf879f0740 1 --2- 172.21.15.5:0/2159127147 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555becdcb1b0 0x555bed1a4950 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c0c7ca0 tx=0x7fbf6c102b70 comp rx=0 tx=0).stop 2024-08-31T05:35:37.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.622+0000 7fbf879f0740 1 -- 172.21.15.5:0/2159127147 shutdown_connections 2024-08-31T05:35:37.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.622+0000 7fbf879f0740 1 --2- 172.21.15.5:0/2159127147 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x555becdb29f0 0x555bed1b6d50 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.622+0000 7fbf879f0740 1 --2- 172.21.15.5:0/2159127147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555becdf4070 0x555bed1a53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.622+0000 7fbf879f0740 1 --2- 172.21.15.5:0/2159127147 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555becdd3390 0x555bed1a4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.622+0000 7fbf5eff5640 0 client.26698 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:35:37.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.622+0000 7fbf879f0740 1 --2- 172.21.15.5:0/2159127147 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555becdcb1b0 0x555bed1a4950 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.622+0000 7fbf879f0740 1 -- 172.21.15.5:0/2159127147 >> 172.21.15.5:0/2159127147 conn(0x555becde8460 msgr2=0x555bed19c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:37.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.622+0000 7fbf879f0740 1 -- 172.21.15.5:0/2159127147 shutdown_connections 2024-08-31T05:35:37.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.622+0000 7fbf879f0740 1 -- 172.21.15.5:0/2159127147 wait complete. 2024-08-31T05:35:37.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.622+0000 7fbf879f0740 20 client.26698 trim_cache size 0 max 16384 2024-08-31T05:35:37.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.637+0000 7fbf879f0740 1 Processor -- start 2024-08-31T05:35:37.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.637+0000 7fbf879f0740 1 -- start start 2024-08-31T05:35:37.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.638+0000 7fbf879f0740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555becdb29f0 0x555bed19aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:37.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.638+0000 7fbf879f0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555becdcb1b0 0x555bed1a1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:37.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.638+0000 7fbf879f0740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555becdd3390 0x555bed1a2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:37.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.638+0000 7fbf879f0740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7c1b2e40 con 0x555becdb29f0 2024-08-31T05:35:37.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.638+0000 7fbf879f0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7c1b4980 con 0x555becdcb1b0 2024-08-31T05:35:37.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.638+0000 7fbf879f0740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7c1b3510 con 0x555becdd3390 2024-08-31T05:35:37.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.638+0000 7fbf7affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555becdb29f0 0x555bed19aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:37.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.638+0000 7fbf7b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555becdd3390 0x555bed1a2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:37.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.638+0000 7fbf7a7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555becdcb1b0 0x555bed1a1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:37.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.638+0000 7fbf7affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555becdb29f0 0x555bed19aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43664/0 (socket says 172.21.15.5:43664) 2024-08-31T05:35:37.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.638+0000 7fbf7affd640 1 -- 172.21.15.5:0/504439706 learned_addr learned my addr 172.21.15.5:0/504439706 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:37.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.638+0000 7fbf7b7fe640 1 -- 172.21.15.5:0/504439706 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555becdcb1b0 msgr2=0x555bed1a1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:37.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.638+0000 7fbf7b7fe640 1 --2- 172.21.15.5:0/504439706 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555becdcb1b0 0x555bed1a1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.638+0000 7fbf7b7fe640 1 -- 172.21.15.5:0/504439706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555becdb29f0 msgr2=0x555bed19aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:37.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.638+0000 7fbf7b7fe640 1 --2- 172.21.15.5:0/504439706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555becdb29f0 0x555bed19aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.638+0000 7fbf7b7fe640 1 -- 172.21.15.5:0/504439706 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bed1a2e50 con 0x555becdd3390 2024-08-31T05:35:37.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.638+0000 7fbf7affd640 1 --2- 172.21.15.5:0/504439706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555becdb29f0 0x555bed19aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:35:37.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.638+0000 7fbf7b7fe640 1 --2- 172.21.15.5:0/504439706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555becdd3390 0x555bed1a2080 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbf74011cd0 tx=0x7fbf74016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a7d5bcf2e38c9d7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:37.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.639+0000 7fbf60ff9640 1 -- 172.21.15.5:0/504439706 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf740045c0 con 0x555becdd3390 2024-08-31T05:35:37.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.639+0000 7fbf60ff9640 1 -- 172.21.15.5:0/504439706 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf74025070 con 0x555becdd3390 2024-08-31T05:35:37.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.639+0000 7fbf60ff9640 1 -- 172.21.15.5:0/504439706 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf74020430 con 0x555becdd3390 2024-08-31T05:35:37.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.640+0000 7fbf879f0740 1 -- 172.21.15.5:0/504439706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555becdd3390 msgr2=0x555bed1a2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:37.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.640+0000 7fbf879f0740 1 --2- 172.21.15.5:0/504439706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555becdd3390 0x555bed1a2080 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbf74011cd0 tx=0x7fbf74016000 comp rx=0 tx=0).stop 2024-08-31T05:35:37.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.640+0000 7fbf879f0740 1 -- 172.21.15.5:0/504439706 shutdown_connections 2024-08-31T05:35:37.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.640+0000 7fbf879f0740 1 --2- 172.21.15.5:0/504439706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555becdd3390 0x555bed1a2080 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.640+0000 7fbf879f0740 1 --2- 172.21.15.5:0/504439706 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555becdcb1b0 0x555bed1a1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.640+0000 7fbf879f0740 1 --2- 172.21.15.5:0/504439706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555becdb29f0 0x555bed19aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.640+0000 7fbf879f0740 1 -- 172.21.15.5:0/504439706 >> 172.21.15.5:0/504439706 conn(0x555becde8460 msgr2=0x555bed19a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:37.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.640+0000 7fbf879f0740 1 -- 172.21.15.5:0/504439706 shutdown_connections 2024-08-31T05:35:37.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.640+0000 7fbf879f0740 1 -- 172.21.15.5:0/504439706 wait complete. 2024-08-31T05:35:37.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.640+0000 7fbf879f0740 1 -- start start 2024-08-31T05:35:37.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.640+0000 7fbf879f0740 1 Processor -- start 2024-08-31T05:35:37.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.641+0000 7fbf879f0740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555becdb29f0 0x555bed1a94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:37.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.641+0000 7fbf879f0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555becdcb1b0 0x555bed1a99e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:37.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.641+0000 7fbf879f0740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555becdd3390 0x555bed220710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:37.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.641+0000 7fbf879f0740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7c1b42b0 con 0x555becdd3390 2024-08-31T05:35:37.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.641+0000 7fbf879f0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7c1b3be0 con 0x555becdcb1b0 2024-08-31T05:35:37.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.641+0000 7fbf879f0740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7c1b0e20 con 0x555becdb29f0 2024-08-31T05:35:37.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.641+0000 7fbf879f0740 10 client.0 _ll_register_callbacks cb 0x7fbf6c03b460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:35:37.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.641+0000 7fbf7b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555becdd3390 0x555bed220710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:37.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.641+0000 7fbf7a7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555becdcb1b0 0x555bed1a99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:37.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.641+0000 7fbf7affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555becdb29f0 0x555bed1a94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:37.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.641+0000 7fbf7affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555becdb29f0 0x555bed1a94a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:42176/0 (socket says 172.21.15.5:42176) 2024-08-31T05:35:37.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.641+0000 7fbf7affd640 1 -- 172.21.15.5:0/2150969721 learned_addr learned my addr 172.21.15.5:0/2150969721 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:37.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.641+0000 7fbf7b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555becdd3390 0x555bed220710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43680/0 (socket says 172.21.15.5:43680) 2024-08-31T05:35:37.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.641+0000 7fbf7a7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555becdcb1b0 0x555bed1a99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:39394/0 (socket says 172.21.15.5:39394) 2024-08-31T05:35:37.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.641+0000 7fbf7affd640 1 -- 172.21.15.5:0/2150969721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555becdcb1b0 msgr2=0x555bed1a99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:37.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.641+0000 7fbf7affd640 1 --2- 172.21.15.5:0/2150969721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555becdcb1b0 0x555bed1a99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.641+0000 7fbf7affd640 1 -- 172.21.15.5:0/2150969721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555becdd3390 msgr2=0x555bed220710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:37.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.641+0000 7fbf7affd640 1 --2- 172.21.15.5:0/2150969721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555becdd3390 0x555bed220710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.641+0000 7fbf7affd640 1 -- 172.21.15.5:0/2150969721 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555bed231c60 con 0x555becdb29f0 2024-08-31T05:35:37.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.641+0000 7fbf7affd640 1 --2- 172.21.15.5:0/2150969721 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555becdb29f0 0x555bed1a94a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c005ab0 tx=0x7fbf6c105640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f26cfd86d94128d4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:37.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.641+0000 7fbf5eff5640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:35:37.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.642+0000 7fbf5eff5640 1 -- 172.21.15.5:0/2150969721 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf6c0f2060 con 0x555becdb29f0 2024-08-31T05:35:37.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.642+0000 7fbf5eff5640 1 -- 172.21.15.5:0/2150969721 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fbf6c0d4a00 con 0x555becdb29f0 2024-08-31T05:35:37.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.642+0000 7fbf879f0740 1 -- 172.21.15.5:0/2150969721 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf74025070 con 0x555becdb29f0 2024-08-31T05:35:37.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.642+0000 7fbf5eff5640 1 -- 172.21.15.5:0/2150969721 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fbf6c049050 con 0x555becdb29f0 2024-08-31T05:35:37.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.642+0000 7fbf879f0740 10 client.26704 fetch_fsmap learned FSMap version 34 2024-08-31T05:35:37.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.642+0000 7fbf879f0740 1 -- 172.21.15.5:0/2150969721 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x555bed232e90 con 0x555becdb29f0 2024-08-31T05:35:37.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.642+0000 7fbf5eff5640 1 -- 172.21.15.5:0/2150969721 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf6c0b30b0 con 0x555becdb29f0 2024-08-31T05:35:37.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.642+0000 7fbf5eff5640 1 -- 172.21.15.5:0/2150969721 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fbf6c0c7590 con 0x555becdb29f0 2024-08-31T05:35:37.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.642+0000 7fbf879f0740 10 client.26704 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:35:37.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.642+0000 7fbf879f0740 10 client.26704 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:35:37.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.642+0000 7fbf879f0740 20 client.26704 populate_metadata read hostname 'smithi005' 2024-08-31T05:35:37.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.642+0000 7fbf879f0740 1 --2- 172.21.15.5:0/2150969721 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x555becdf4070 0x555bed235400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:37.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.642+0000 7fbf879f0740 4 client.26704 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:35:37.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.642+0000 7fbf879f0740 1 -- 172.21.15.5:0/2150969721 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fbf74025070 con 0x555becdf4070 2024-08-31T05:35:37.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.643+0000 7fbf7a7fc640 1 --2- 172.21.15.5:0/2150969721 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x555becdf4070 0x555bed235400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:37.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.643+0000 7fbf5eff5640 10 client.26704 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:35:37.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.643+0000 7fbf7a7fc640 1 --2- 172.21.15.5:0/2150969721 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x555becdf4070 0x555bed235400 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d6434a405e7e5ad server_cookie=ee9d1e54dff40a77 in_seq=0 out_seq=0 2024-08-31T05:35:37.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.644+0000 7fbf5eff5640 1 -- 172.21.15.5:0/2150969721 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fbf74025070 con 0x555becdf4070 2024-08-31T05:35:37.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.644+0000 7fbf5eff5640 10 client.26704 handle_command_reply: tid=0 2024-08-31T05:35:37.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.644+0000 7fbf879f0740 1 client.26704 shutdown 2024-08-31T05:35:37.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.644+0000 7fbf879f0740 1 -- 172.21.15.5:0/2150969721 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555becdb29f0 msgr2=0x555bed1a94a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:37.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.644+0000 7fbf879f0740 1 --2- 172.21.15.5:0/2150969721 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555becdb29f0 0x555bed1a94a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c005ab0 tx=0x7fbf6c105640 comp rx=0 tx=0).stop 2024-08-31T05:35:37.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.644+0000 7fbf879f0740 1 -- 172.21.15.5:0/2150969721 shutdown_connections 2024-08-31T05:35:37.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.644+0000 7fbf879f0740 1 --2- 172.21.15.5:0/2150969721 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x555becdf4070 0x555bed235400 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.644+0000 7fbf879f0740 1 --2- 172.21.15.5:0/2150969721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555becdd3390 0x555bed220710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.644+0000 7fbf879f0740 1 --2- 172.21.15.5:0/2150969721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555becdcb1b0 0x555bed1a99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.644+0000 7fbf5eff5640 0 client.26704 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:35:37.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.644+0000 7fbf879f0740 1 --2- 172.21.15.5:0/2150969721 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555becdb29f0 0x555bed1a94a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.644+0000 7fbf879f0740 1 -- 172.21.15.5:0/2150969721 >> 172.21.15.5:0/2150969721 conn(0x555becde8460 msgr2=0x555bed1afd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:37.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.644+0000 7fbf879f0740 1 -- 172.21.15.5:0/2150969721 shutdown_connections 2024-08-31T05:35:37.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.644+0000 7fbf879f0740 1 -- 172.21.15.5:0/2150969721 wait complete. 2024-08-31T05:35:37.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.644+0000 7fbf879f0740 20 client.26704 trim_cache size 0 max 16384 2024-08-31T05:35:37.660 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:35:37.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.645+0000 7fbf8147b640 1 -- 172.21.15.5:0/4147896682 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fbf640b4ca0 msgr2=0x7fbf640b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:37.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.645+0000 7fbf8147b640 1 --2- 172.21.15.5:0/4147896682 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fbf640b4ca0 0x7fbf640b71b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fbf74005fd0 tx=0x7fbf74009500 comp rx=0 tx=0).stop 2024-08-31T05:35:37.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.645+0000 7fbf8147b640 1 -- 172.21.15.5:0/4147896682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf7c103920 msgr2=0x7fbf7c0754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:37.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.645+0000 7fbf8147b640 1 --2- 172.21.15.5:0/4147896682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf7c103920 0x7fbf7c0754b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c02a930 tx=0x7fbf6c031a20 comp rx=0 tx=0).stop 2024-08-31T05:35:37.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.645+0000 7fbf8147b640 1 -- 172.21.15.5:0/4147896682 shutdown_connections 2024-08-31T05:35:37.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.645+0000 7fbf8147b640 1 --2- 172.21.15.5:0/4147896682 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fbf640b4ca0 0x7fbf640b71b0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.645+0000 7fbf8147b640 1 --2- 172.21.15.5:0/4147896682 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf7c109bb0 0x7fbf7c075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.645+0000 7fbf8147b640 1 --2- 172.21.15.5:0/4147896682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf7c109260 0x7fbf7c0759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.645+0000 7fbf8147b640 1 --2- 172.21.15.5:0/4147896682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbf7c103920 0x7fbf7c0754b0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:37.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.645+0000 7fbf8147b640 1 -- 172.21.15.5:0/4147896682 >> 172.21.15.5:0/4147896682 conn(0x7fbf7c0ff330 msgr2=0x7fbf7c102700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:37.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.645+0000 7fbf8147b640 1 -- 172.21.15.5:0/4147896682 shutdown_connections 2024-08-31T05:35:37.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:37.645+0000 7fbf8147b640 1 -- 172.21.15.5:0/4147896682 wait complete. 2024-08-31T05:35:37.919 INFO:tasks.workunit.client.0.smithi005.stdout: 1 622308 11.98 MB/sec execute 145 sec latency 35.231 ms 2024-08-31T05:35:38.919 INFO:tasks.workunit.client.0.smithi005.stdout: 1 623944 11.94 MB/sec execute 146 sec latency 23.195 ms 2024-08-31T05:35:39.156 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:35:38 smithi050 ceph-mon[22146]: pgmap v515: 129 pgs: 129 active+clean; 358 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.3 MiB/s wr, 208 op/s 2024-08-31T05:35:39.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:35:38 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:35:39.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:35:38 smithi005 ceph-mon[18602]: pgmap v515: 129 pgs: 129 active+clean; 358 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.3 MiB/s wr, 208 op/s 2024-08-31T05:35:39.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:35:38 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:35:39.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:35:38 smithi070 ceph-mon[22316]: pgmap v515: 129 pgs: 129 active+clean; 358 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.3 MiB/s wr, 208 op/s 2024-08-31T05:35:39.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:35:38 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:35:39.397 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T05:35:39.398 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T05:35:39.657 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:35:39.919 INFO:tasks.workunit.client.0.smithi005.stdout: 1 625990 11.95 MB/sec execute 147 sec latency 55.907 ms 2024-08-31T05:35:40.057 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:35:39 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:35:40.057 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:35:39 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:35:40.057 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:35:39 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:35:40.156 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:35:39 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:35:40.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:35:39 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:35:40.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:35:39 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:35:40.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.152+0000 7fd731498640 1 -- 172.21.15.5:0/70360302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd72c104790 msgr2=0x7fd72c104ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:40.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.152+0000 7fd731498640 1 --2- 172.21.15.5:0/70360302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd72c104790 0x7fd72c104ba0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fd71c009900 tx=0x7fd71c02a410 comp rx=0 tx=0).stop 2024-08-31T05:35:40.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.152+0000 7fd731498640 1 -- 172.21.15.5:0/70360302 shutdown_connections 2024-08-31T05:35:40.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.152+0000 7fd731498640 1 --2- 172.21.15.5:0/70360302 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd72c10dbf0 0x7fd72c1100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:40.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.152+0000 7fd731498640 1 --2- 172.21.15.5:0/70360302 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd72c1050e0 0x7fd72c10d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:40.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.152+0000 7fd731498640 1 --2- 172.21.15.5:0/70360302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd72c104790 0x7fd72c104ba0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:40.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.152+0000 7fd731498640 1 -- 172.21.15.5:0/70360302 >> 172.21.15.5:0/70360302 conn(0x7fd72c079580 msgr2=0x7fd72c079990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:40.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.152+0000 7fd731498640 1 -- 172.21.15.5:0/70360302 shutdown_connections 2024-08-31T05:35:40.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.152+0000 7fd731498640 1 -- 172.21.15.5:0/70360302 wait complete. 2024-08-31T05:35:40.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.153+0000 7fd731498640 1 Processor -- start 2024-08-31T05:35:40.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.153+0000 7fd731498640 1 -- start start 2024-08-31T05:35:40.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.154+0000 7fd731498640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd72c104790 0x7fd72c19a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:40.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.154+0000 7fd731498640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd72c1050e0 0x7fd72c19a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:40.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.154+0000 7fd731498640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd72c10dbf0 0x7fd72c19fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:40.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.154+0000 7fd731498640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd72c113870 con 0x7fd72c104790 2024-08-31T05:35:40.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.154+0000 7fd731498640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd72c1136f0 con 0x7fd72c1050e0 2024-08-31T05:35:40.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.154+0000 7fd731498640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd72c1139f0 con 0x7fd72c10dbf0 2024-08-31T05:35:40.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.154+0000 7fd72affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd72c104790 0x7fd72c19a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:40.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.154+0000 7fd72affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd72c104790 0x7fd72c19a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43688/0 (socket says 172.21.15.5:43688) 2024-08-31T05:35:40.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.154+0000 7fd72affd640 1 -- 172.21.15.5:0/1851135074 learned_addr learned my addr 172.21.15.5:0/1851135074 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:40.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.154+0000 7fd72b7fe640 1 --2- 172.21.15.5:0/1851135074 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd72c10dbf0 0x7fd72c19fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:40.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.154+0000 7fd723fff640 1 --2- 172.21.15.5:0/1851135074 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd72c1050e0 0x7fd72c19a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:40.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.154+0000 7fd72affd640 1 -- 172.21.15.5:0/1851135074 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd72c10dbf0 msgr2=0x7fd72c19fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:40.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.154+0000 7fd72affd640 1 --2- 172.21.15.5:0/1851135074 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd72c10dbf0 0x7fd72c19fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:40.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.154+0000 7fd72affd640 1 -- 172.21.15.5:0/1851135074 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd72c1050e0 msgr2=0x7fd72c19a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:40.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.154+0000 7fd72affd640 1 --2- 172.21.15.5:0/1851135074 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd72c1050e0 0x7fd72c19a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:40.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.154+0000 7fd72affd640 1 -- 172.21.15.5:0/1851135074 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd72c1a0210 con 0x7fd72c104790 2024-08-31T05:35:40.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.154+0000 7fd72affd640 1 --2- 172.21.15.5:0/1851135074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd72c104790 0x7fd72c19a2a0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fd71c032fd0 tx=0x7fd71c031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:40.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.154+0000 7fd728ff9640 1 -- 172.21.15.5:0/1851135074 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd71c03f030 con 0x7fd72c104790 2024-08-31T05:35:40.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.154+0000 7fd728ff9640 1 -- 172.21.15.5:0/1851135074 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd71c004490 con 0x7fd72c104790 2024-08-31T05:35:40.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.155+0000 7fd731498640 1 -- 172.21.15.5:0/1851135074 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd72c1a04a0 con 0x7fd72c104790 2024-08-31T05:35:40.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.155+0000 7fd728ff9640 1 -- 172.21.15.5:0/1851135074 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd71c035070 con 0x7fd72c104790 2024-08-31T05:35:40.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.155+0000 7fd731498640 1 -- 172.21.15.5:0/1851135074 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd72c1a6c60 con 0x7fd72c104790 2024-08-31T05:35:40.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.157+0000 7fd737a0d740 1 Processor -- start 2024-08-31T05:35:40.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.157+0000 7fd728ff9640 1 -- 172.21.15.5:0/1851135074 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fd71c042030 con 0x7fd72c104790 2024-08-31T05:35:40.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.157+0000 7fd737a0d740 1 -- start start 2024-08-31T05:35:40.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.158+0000 7fd737a0d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a9797c350 0x561a97d22780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:40.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.158+0000 7fd737a0d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a97953490 0x561a97d22cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:40.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.158+0000 7fd737a0d740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561a9795b670 0x561a97d23200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:40.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.158+0000 7fd737a0d740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x561a97c985f0 con 0x561a9795b670 2024-08-31T05:35:40.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.158+0000 7fd737a0d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x561a97c87b80 con 0x561a9797c350 2024-08-31T05:35:40.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.158+0000 7fd737a0d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561a97c8bb30 con 0x561a97953490 2024-08-31T05:35:40.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.158+0000 7fd72b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a9797c350 0x561a97d22780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:40.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.158+0000 7fd723fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561a9795b670 0x561a97d23200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:40.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.158+0000 7fd72b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a9797c350 0x561a97d22780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:39426/0 (socket says 172.21.15.5:39426) 2024-08-31T05:35:40.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.158+0000 7fd72b7fe640 1 -- 172.21.15.5:0/1335807466 learned_addr learned my addr 172.21.15.5:0/1335807466 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:40.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.158+0000 7fd72affd640 1 --2- 172.21.15.5:0/1335807466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a97953490 0x561a97d22cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:40.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.159+0000 7fd72b7fe640 1 -- 172.21.15.5:0/1335807466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a97953490 msgr2=0x561a97d22cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:40.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.159+0000 7fd72b7fe640 1 --2- 172.21.15.5:0/1335807466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a97953490 0x561a97d22cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:40.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.159+0000 7fd72b7fe640 1 -- 172.21.15.5:0/1335807466 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561a9795b670 msgr2=0x561a97d23200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:40.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.159+0000 7fd72b7fe640 1 --2- 172.21.15.5:0/1335807466 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561a9795b670 0x561a97d23200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:40.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.159+0000 7fd72b7fe640 1 -- 172.21.15.5:0/1335807466 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a979e7930 con 0x561a9797c350 2024-08-31T05:35:40.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.159+0000 7fd723fff640 1 --2- 172.21.15.5:0/1335807466 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561a9795b670 0x561a97d23200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:35:40.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.159+0000 7fd72affd640 1 --2- 172.21.15.5:0/1335807466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a97953490 0x561a97d22cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:35:40.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.159+0000 7fd728ff9640 1 --2- 172.21.15.5:0/1851135074 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd7180b4ca0 0x7fd7180b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:40.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.159+0000 7fd72b7fe640 1 --2- 172.21.15.5:0/1335807466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a9797c350 0x561a97d22780 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd724009fd0 tx=0x7fd7240118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb405cb2900cf05c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:40.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.159+0000 7fd72affd640 1 --2- 172.21.15.5:0/1851135074 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd7180b4ca0 0x7fd7180b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:40.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.159+0000 7fd7217fa640 1 -- 172.21.15.5:0/1335807466 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd724004d20 con 0x561a9797c350 2024-08-31T05:35:40.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.159+0000 7fd728ff9640 1 -- 172.21.15.5:0/1851135074 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fd71c105c60 con 0x7fd72c104790 2024-08-31T05:35:40.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.159+0000 7fd7217fa640 1 -- 172.21.15.5:0/1335807466 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd724004050 con 0x561a9797c350 2024-08-31T05:35:40.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.159+0000 7fd7217fa640 1 -- 172.21.15.5:0/1335807466 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd724005280 con 0x561a9797c350 2024-08-31T05:35:40.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.160+0000 7fd737a0d740 1 -- 172.21.15.5:0/1335807466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a9797c350 msgr2=0x561a97d22780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:40.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.160+0000 7fd72affd640 1 --2- 172.21.15.5:0/1851135074 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd7180b4ca0 0x7fd7180b71b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x561a97d21400 tx=0x7fd71c0b3040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:40.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.160+0000 7fd737a0d740 1 --2- 172.21.15.5:0/1335807466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a9797c350 0x561a97d22780 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd724009fd0 tx=0x7fd7240118d0 comp rx=0 tx=0).stop 2024-08-31T05:35:40.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.160+0000 7fd737a0d740 1 -- 172.21.15.5:0/1335807466 shutdown_connections 2024-08-31T05:35:40.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.160+0000 7fd737a0d740 1 --2- 172.21.15.5:0/1335807466 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561a9795b670 0x561a97d23200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:40.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.160+0000 7fd737a0d740 1 --2- 172.21.15.5:0/1335807466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a97953490 0x561a97d22cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:40.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.160+0000 7fd737a0d740 1 --2- 172.21.15.5:0/1335807466 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a9797c350 0x561a97d22780 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:40.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.161+0000 7fd737a0d740 1 -- 172.21.15.5:0/1335807466 >> 172.21.15.5:0/1335807466 conn(0x561a97970740 msgr2=0x561a97d20670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:40.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.161+0000 7fd737a0d740 1 -- 172.21.15.5:0/1335807466 shutdown_connections 2024-08-31T05:35:40.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.161+0000 7fd737a0d740 1 -- 172.21.15.5:0/1335807466 wait complete. 2024-08-31T05:35:40.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.161+0000 7fd737a0d740 1 -- start start 2024-08-31T05:35:40.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.161+0000 7fd737a0d740 1 Processor -- start 2024-08-31T05:35:40.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.162+0000 7fd737a0d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a97953490 0x561a97d2df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:40.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.162+0000 7fd737a0d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a9795b670 0x561a97d2e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:40.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.162+0000 7fd737a0d740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561a9797c350 0x561a97d3a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:40.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.162+0000 7fd737a0d740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x561a97aea890 con 0x561a9797c350 2024-08-31T05:35:40.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.162+0000 7fd737a0d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x561a97c0e790 con 0x561a9795b670 2024-08-31T05:35:40.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.162+0000 7fd737a0d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561a97d30f60 con 0x561a97953490 2024-08-31T05:35:40.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.162+0000 7fd737a0d740 10 client.0 _ll_register_callbacks cb 0x561a97993ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:35:40.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.162+0000 7fd72b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561a9797c350 0x561a97d3a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:40.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.162+0000 7fd72b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a97953490 0x561a97d2df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:40.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.162+0000 7fd72b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a97953490 0x561a97d2df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:42214/0 (socket says 172.21.15.5:42214) 2024-08-31T05:35:40.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.162+0000 7fd72b7fe640 1 -- 172.21.15.5:0/962552935 learned_addr learned my addr 172.21.15.5:0/962552935 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:40.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.162+0000 7fd723fff640 1 --2- 172.21.15.5:0/962552935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a9795b670 0x561a97d2e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:40.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.162+0000 7fd72b7fe640 1 -- 172.21.15.5:0/962552935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a9795b670 msgr2=0x561a97d2e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:40.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.162+0000 7fd72b7fe640 1 --2- 172.21.15.5:0/962552935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a9795b670 0x561a97d2e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:40.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.162+0000 7fd72b7fe640 1 -- 172.21.15.5:0/962552935 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561a9797c350 msgr2=0x561a97d3a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:40.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.162+0000 7fd72b7fe640 1 --2- 172.21.15.5:0/962552935 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561a9797c350 0x561a97d3a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:40.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.162+0000 7fd72b7fe640 1 -- 172.21.15.5:0/962552935 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a97c45f30 con 0x561a97953490 2024-08-31T05:35:40.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.162+0000 7fd723fff640 1 --2- 172.21.15.5:0/962552935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a9795b670 0x561a97d2e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:35:40.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.162+0000 7fd72b7fe640 1 --2- 172.21.15.5:0/962552935 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a97953490 0x561a97d2df40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd724009fa0 tx=0x7fd7240118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=489d7d7914bc810f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:40.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.162+0000 7fd7127fc640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:35:40.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.163+0000 7fd7127fc640 1 -- 172.21.15.5:0/962552935 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd724004c40 con 0x561a97953490 2024-08-31T05:35:40.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.163+0000 7fd7127fc640 1 -- 172.21.15.5:0/962552935 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fd724004de0 con 0x561a97953490 2024-08-31T05:35:40.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.163+0000 7fd737a0d740 1 -- 172.21.15.5:0/962552935 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd724004050 con 0x561a97953490 2024-08-31T05:35:40.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.163+0000 7fd7127fc640 1 -- 172.21.15.5:0/962552935 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fd724036050 con 0x561a97953490 2024-08-31T05:35:40.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.163+0000 7fd737a0d740 10 client.26716 fetch_fsmap learned FSMap version 34 2024-08-31T05:35:40.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.163+0000 7fd737a0d740 1 -- 172.21.15.5:0/962552935 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x561a97d3cdc0 con 0x561a97953490 2024-08-31T05:35:40.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.163+0000 7fd7127fc640 1 -- 172.21.15.5:0/962552935 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd724004050 con 0x561a97953490 2024-08-31T05:35:40.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.164+0000 7fd7127fc640 1 -- 172.21.15.5:0/962552935 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fd724028450 con 0x561a97953490 2024-08-31T05:35:40.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.164+0000 7fd737a0d740 10 client.26716 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:35:40.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.164+0000 7fd737a0d740 10 client.26716 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:35:40.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.164+0000 7fd737a0d740 20 client.26716 populate_metadata read hostname 'smithi005' 2024-08-31T05:35:40.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.164+0000 7fd737a0d740 1 --2- 172.21.15.5:0/962552935 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561a9793acd0 0x561a97d401d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:40.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.164+0000 7fd737a0d740 4 client.26716 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:35:40.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.164+0000 7fd737a0d740 1 -- 172.21.15.5:0/962552935 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561a97c9a540 con 0x561a9793acd0 2024-08-31T05:35:40.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.164+0000 7fd723fff640 1 --2- 172.21.15.5:0/962552935 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561a9793acd0 0x561a97d401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:40.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.164+0000 7fd7127fc640 10 client.26716 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:35:40.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.164+0000 7fd723fff640 1 --2- 172.21.15.5:0/962552935 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561a9793acd0 0x561a97d401d0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54371fbe0d2ec3e7 server_cookie=aa91464fa4fbbda1 in_seq=0 out_seq=0 2024-08-31T05:35:40.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.165+0000 7fd7127fc640 1 -- 172.21.15.5:0/962552935 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561a97c9a540 con 0x561a9793acd0 2024-08-31T05:35:40.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.165+0000 7fd7127fc640 10 client.26716 handle_command_reply: tid=0 2024-08-31T05:35:40.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.165+0000 7fd737a0d740 1 client.26716 shutdown 2024-08-31T05:35:40.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.165+0000 7fd737a0d740 1 -- 172.21.15.5:0/962552935 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a97953490 msgr2=0x561a97d2df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:40.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.165+0000 7fd737a0d740 1 --2- 172.21.15.5:0/962552935 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a97953490 0x561a97d2df40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd724009fa0 tx=0x7fd7240118d0 comp rx=0 tx=0).stop 2024-08-31T05:35:40.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.165+0000 7fd737a0d740 1 -- 172.21.15.5:0/962552935 shutdown_connections 2024-08-31T05:35:40.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.165+0000 7fd737a0d740 1 --2- 172.21.15.5:0/962552935 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561a9793acd0 0x561a97d401d0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:40.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.165+0000 7fd737a0d740 1 --2- 172.21.15.5:0/962552935 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561a9797c350 0x561a97d3a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:40.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.165+0000 7fd737a0d740 1 --2- 172.21.15.5:0/962552935 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a9795b670 0x561a97d2e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:40.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.165+0000 7fd7127fc640 0 client.26716 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:35:40.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.165+0000 7fd737a0d740 1 --2- 172.21.15.5:0/962552935 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a97953490 0x561a97d2df40 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:40.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.165+0000 7fd737a0d740 1 -- 172.21.15.5:0/962552935 >> 172.21.15.5:0/962552935 conn(0x561a97970740 msgr2=0x561a97d25910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:40.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.166+0000 7fd737a0d740 1 -- 172.21.15.5:0/962552935 shutdown_connections 2024-08-31T05:35:40.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.166+0000 7fd737a0d740 1 -- 172.21.15.5:0/962552935 wait complete. 2024-08-31T05:35:40.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.166+0000 7fd737a0d740 20 client.26716 trim_cache size 0 max 16384 2024-08-31T05:35:40.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.184+0000 7fd737a0d740 1 Processor -- start 2024-08-31T05:35:40.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.184+0000 7fd737a0d740 1 -- start start 2024-08-31T05:35:40.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.185+0000 7fd737a0d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a97953490 0x561a97d2e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:40.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.185+0000 7fd737a0d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a9795b670 0x561a97d25f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:40.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.185+0000 7fd737a0d740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561a9797c350 0x561a97d2b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:40.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.185+0000 7fd737a0d740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd72c1aea80 con 0x561a9797c350 2024-08-31T05:35:40.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.185+0000 7fd737a0d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd72c1b05c0 con 0x561a9795b670 2024-08-31T05:35:40.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.185+0000 7fd737a0d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd72c1af150 con 0x561a97953490 2024-08-31T05:35:40.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.185+0000 7fd72b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a97953490 0x561a97d2e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:40.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.185+0000 7fd723fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a9795b670 0x561a97d25f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:40.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.185+0000 7fd72b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a97953490 0x561a97d2e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:42228/0 (socket says 172.21.15.5:42228) 2024-08-31T05:35:40.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.185+0000 7fd723fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a9795b670 0x561a97d25f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:39452/0 (socket says 172.21.15.5:39452) 2024-08-31T05:35:40.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.185+0000 7fd72b7fe640 1 -- 172.21.15.5:0/673523696 learned_addr learned my addr 172.21.15.5:0/673523696 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:40.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.185+0000 7fd72b7fe640 1 --2- 172.21.15.5:0/673523696 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561a9797c350 0x561a97d2b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:40.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.185+0000 7fd72b7fe640 1 -- 172.21.15.5:0/673523696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a9795b670 msgr2=0x561a97d25f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:40.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.185+0000 7fd72b7fe640 1 --2- 172.21.15.5:0/673523696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a9795b670 0x561a97d25f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:40.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.185+0000 7fd72b7fe640 1 -- 172.21.15.5:0/673523696 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561a9797c350 msgr2=0x561a97d2b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:40.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.185+0000 7fd72b7fe640 1 --2- 172.21.15.5:0/673523696 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561a9797c350 0x561a97d2b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:40.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.185+0000 7fd72b7fe640 1 -- 172.21.15.5:0/673523696 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a97d264d0 con 0x561a97953490 2024-08-31T05:35:40.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.185+0000 7fd723fff640 1 --2- 172.21.15.5:0/673523696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a9795b670 0x561a97d25f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:35:40.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.186+0000 7fd72b7fe640 1 --2- 172.21.15.5:0/673523696 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a97953490 0x561a97d2e520 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd724009bb0 tx=0x7fd724005cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a56324998a77898 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:40.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.186+0000 7fd720ff9640 1 -- 172.21.15.5:0/673523696 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd724028450 con 0x561a97953490 2024-08-31T05:35:40.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.186+0000 7fd720ff9640 1 -- 172.21.15.5:0/673523696 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd72402d070 con 0x561a97953490 2024-08-31T05:35:40.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.186+0000 7fd720ff9640 1 -- 172.21.15.5:0/673523696 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd724004d50 con 0x561a97953490 2024-08-31T05:35:40.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.187+0000 7fd737a0d740 1 -- 172.21.15.5:0/673523696 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a97953490 msgr2=0x561a97d2e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:40.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.187+0000 7fd737a0d740 1 --2- 172.21.15.5:0/673523696 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a97953490 0x561a97d2e520 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd724009bb0 tx=0x7fd724005cf0 comp rx=0 tx=0).stop 2024-08-31T05:35:40.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.187+0000 7fd737a0d740 1 -- 172.21.15.5:0/673523696 shutdown_connections 2024-08-31T05:35:40.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.187+0000 7fd737a0d740 1 --2- 172.21.15.5:0/673523696 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561a9797c350 0x561a97d2b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:40.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.187+0000 7fd737a0d740 1 --2- 172.21.15.5:0/673523696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a9795b670 0x561a97d25f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:40.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.187+0000 7fd737a0d740 1 --2- 172.21.15.5:0/673523696 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a97953490 0x561a97d2e520 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:40.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.187+0000 7fd737a0d740 1 -- 172.21.15.5:0/673523696 >> 172.21.15.5:0/673523696 conn(0x561a97970740 msgr2=0x561a97d25880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:40.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.187+0000 7fd737a0d740 1 -- 172.21.15.5:0/673523696 shutdown_connections 2024-08-31T05:35:40.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.187+0000 7fd737a0d740 1 -- 172.21.15.5:0/673523696 wait complete. 2024-08-31T05:35:40.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.187+0000 7fd737a0d740 1 -- start start 2024-08-31T05:35:40.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.187+0000 7fd737a0d740 1 Processor -- start 2024-08-31T05:35:40.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.188+0000 7fd737a0d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a97953490 0x561a97d322b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:40.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.188+0000 7fd737a0d740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561a9795b670 0x561a97d327f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:40.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.188+0000 7fd737a0d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a9797c350 0x561a97d32d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:40.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.188+0000 7fd737a0d740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd72c1afef0 con 0x561a9795b670 2024-08-31T05:35:40.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.188+0000 7fd737a0d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd72c1af820 con 0x561a97953490 2024-08-31T05:35:40.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.188+0000 7fd737a0d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd72c1aca60 con 0x561a9797c350 2024-08-31T05:35:40.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.188+0000 7fd737a0d740 10 client.0 _ll_register_callbacks cb 0x7fd7140137d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:35:40.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.188+0000 7fd723fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561a9795b670 0x561a97d327f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:40.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.188+0000 7fd72b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a97953490 0x561a97d322b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:40.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.188+0000 7fd723fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561a9795b670 0x561a97d327f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43716/0 (socket says 172.21.15.5:43716) 2024-08-31T05:35:40.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.188+0000 7fd723fff640 1 -- 172.21.15.5:0/1693157037 learned_addr learned my addr 172.21.15.5:0/1693157037 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:40.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.188+0000 7fd72b7fe640 1 --2- 172.21.15.5:0/1693157037 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a9797c350 0x561a97d32d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:40.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.188+0000 7fd723fff640 1 -- 172.21.15.5:0/1693157037 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a9797c350 msgr2=0x561a97d32d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:40.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.188+0000 7fd723fff640 1 --2- 172.21.15.5:0/1693157037 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a9797c350 0x561a97d32d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:40.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.188+0000 7fd723fff640 1 -- 172.21.15.5:0/1693157037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a97953490 msgr2=0x561a97d322b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:40.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.188+0000 7fd723fff640 1 --2- 172.21.15.5:0/1693157037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a97953490 0x561a97d322b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:40.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.188+0000 7fd723fff640 1 -- 172.21.15.5:0/1693157037 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a97da9bd0 con 0x561a9795b670 2024-08-31T05:35:40.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.188+0000 7fd723fff640 1 --2- 172.21.15.5:0/1693157037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561a9795b670 0x561a97d327f0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fd72c06a840 tx=0x7fd714004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85b6984f96bb0a2e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:40.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.188+0000 7fd7127fc640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:35:40.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.189+0000 7fd7127fc640 1 -- 172.21.15.5:0/1693157037 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd714005020 con 0x561a9795b670 2024-08-31T05:35:40.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.189+0000 7fd737a0d740 1 -- 172.21.15.5:0/1693157037 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd72402d070 con 0x561a9795b670 2024-08-31T05:35:40.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.189+0000 7fd7127fc640 1 -- 172.21.15.5:0/1693157037 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fd7140051c0 con 0x561a9795b670 2024-08-31T05:35:40.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.189+0000 7fd7127fc640 1 -- 172.21.15.5:0/1693157037 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fd714038050 con 0x561a9795b670 2024-08-31T05:35:40.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.189+0000 7fd737a0d740 10 client.17124 fetch_fsmap learned FSMap version 34 2024-08-31T05:35:40.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.189+0000 7fd737a0d740 1 -- 172.21.15.5:0/1693157037 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x561a97daaef0 con 0x561a9795b670 2024-08-31T05:35:40.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.189+0000 7fd7127fc640 1 -- 172.21.15.5:0/1693157037 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd72402d070 con 0x561a9795b670 2024-08-31T05:35:40.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.189+0000 7fd7127fc640 1 -- 172.21.15.5:0/1693157037 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fd7140284e0 con 0x561a9795b670 2024-08-31T05:35:40.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.189+0000 7fd737a0d740 10 client.17124 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:35:40.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.189+0000 7fd737a0d740 10 client.17124 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:35:40.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.189+0000 7fd737a0d740 20 client.17124 populate_metadata read hostname 'smithi005' 2024-08-31T05:35:40.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.189+0000 7fd737a0d740 1 --2- 172.21.15.5:0/1693157037 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561a97910080 0x561a97dad680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:40.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.190+0000 7fd737a0d740 4 client.17124 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T05:35:40.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.190+0000 7fd737a0d740 1 -- 172.21.15.5:0/1693157037 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x561a97c95fe0 con 0x561a97910080 2024-08-31T05:35:40.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.190+0000 7fd72b7fe640 1 --2- 172.21.15.5:0/1693157037 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561a97910080 0x561a97dad680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:40.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.190+0000 7fd72b7fe640 1 --2- 172.21.15.5:0/1693157037 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561a97910080 0x561a97dad680 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3389cf82eb06bd08 server_cookie=46f6ed8bdef05c36 in_seq=0 out_seq=0 2024-08-31T05:35:40.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.190+0000 7fd7127fc640 10 client.17124 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:35:40.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.192+0000 7fd7127fc640 1 -- 172.21.15.5:0/1693157037 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x561a97c95fe0 con 0x561a97910080 2024-08-31T05:35:40.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.192+0000 7fd7127fc640 10 client.17124 handle_command_reply: tid=0 2024-08-31T05:35:40.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.192+0000 7fd737a0d740 1 client.17124 shutdown 2024-08-31T05:35:40.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.193+0000 7fd737a0d740 1 -- 172.21.15.5:0/1693157037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561a9795b670 msgr2=0x561a97d327f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:40.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.193+0000 7fd737a0d740 1 --2- 172.21.15.5:0/1693157037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561a9795b670 0x561a97d327f0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fd72c06a840 tx=0x7fd714004410 comp rx=0 tx=0).stop 2024-08-31T05:35:40.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.193+0000 7fd737a0d740 1 -- 172.21.15.5:0/1693157037 shutdown_connections 2024-08-31T05:35:40.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.193+0000 7fd737a0d740 1 --2- 172.21.15.5:0/1693157037 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561a97910080 0x561a97dad680 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:40.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.193+0000 7fd737a0d740 1 --2- 172.21.15.5:0/1693157037 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a9797c350 0x561a97d32d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:40.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.193+0000 7fd737a0d740 1 --2- 172.21.15.5:0/1693157037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561a9795b670 0x561a97d327f0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:40.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.193+0000 7fd737a0d740 1 --2- 172.21.15.5:0/1693157037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561a97953490 0x561a97d322b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:40.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.193+0000 7fd737a0d740 1 -- 172.21.15.5:0/1693157037 >> 172.21.15.5:0/1693157037 conn(0x561a97970740 msgr2=0x561a97d2f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:40.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.193+0000 7fd7127fc640 0 client.17124 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:35:40.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.193+0000 7fd737a0d740 1 -- 172.21.15.5:0/1693157037 shutdown_connections 2024-08-31T05:35:40.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.193+0000 7fd737a0d740 1 -- 172.21.15.5:0/1693157037 wait complete. 2024-08-31T05:35:40.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.193+0000 7fd737a0d740 20 client.17124 trim_cache size 0 max 16384 2024-08-31T05:35:40.198 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:35:40.198 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-08-31T05:35:40.198 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "095ccc7a-f368-4bc6-9563-5930e21f9b4a", 2024-08-31T05:35:40.198 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-08-31T05:35:40.198 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:35:40.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.194+0000 7fd731498640 1 -- 172.21.15.5:0/1851135074 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd7180b4ca0 msgr2=0x7fd7180b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:40.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.194+0000 7fd731498640 1 --2- 172.21.15.5:0/1851135074 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd7180b4ca0 0x7fd7180b71b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x561a97d21400 tx=0x7fd71c0b3040 comp rx=0 tx=0).stop 2024-08-31T05:35:40.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.194+0000 7fd731498640 1 -- 172.21.15.5:0/1851135074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd72c104790 msgr2=0x7fd72c19a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:40.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.194+0000 7fd731498640 1 --2- 172.21.15.5:0/1851135074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd72c104790 0x7fd72c19a2a0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fd71c032fd0 tx=0x7fd71c031a20 comp rx=0 tx=0).stop 2024-08-31T05:35:40.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.194+0000 7fd731498640 1 -- 172.21.15.5:0/1851135074 shutdown_connections 2024-08-31T05:35:40.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.194+0000 7fd731498640 1 --2- 172.21.15.5:0/1851135074 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd7180b4ca0 0x7fd7180b71b0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:40.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.194+0000 7fd731498640 1 --2- 172.21.15.5:0/1851135074 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd72c10dbf0 0x7fd72c19fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:40.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.194+0000 7fd731498640 1 --2- 172.21.15.5:0/1851135074 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd72c1050e0 0x7fd72c19a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:40.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.194+0000 7fd731498640 1 --2- 172.21.15.5:0/1851135074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd72c104790 0x7fd72c19a2a0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:40.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.194+0000 7fd731498640 1 -- 172.21.15.5:0/1851135074 >> 172.21.15.5:0/1851135074 conn(0x7fd72c079580 msgr2=0x7fd72c0ff2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:40.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.194+0000 7fd731498640 1 -- 172.21.15.5:0/1851135074 shutdown_connections 2024-08-31T05:35:40.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:40.194+0000 7fd731498640 1 -- 172.21.15.5:0/1851135074 wait complete. 2024-08-31T05:35:40.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:35:39 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:35:40.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:35:39 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:35:40.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:35:39 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:35:40.919 INFO:tasks.workunit.client.0.smithi005.stdout: 1 627954 11.94 MB/sec execute 148 sec latency 124.777 ms 2024-08-31T05:35:41.080 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T05:35:41.341 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:35:41.462 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:35:41 smithi005 ceph-mon[18602]: pgmap v516: 129 pgs: 129 active+clean; 363 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.4 MiB/s wr, 275 op/s 2024-08-31T05:35:41.462 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:35:41 smithi005 ceph-mon[18602]: scrub queued for path: / 2024-08-31T05:35:41.462 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:35:41 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:35:41.462 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:35:41 smithi005 ceph-mon[18602]: scrub summary: active paths [/] 2024-08-31T05:35:41.462 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:35:41 smithi005 ceph-mon[18602]: scrub summary: active paths [/] 2024-08-31T05:35:41.462 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:35:41 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:35:41.462 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:35:41 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:35:41.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:35:41 smithi070 ceph-mon[22316]: pgmap v516: 129 pgs: 129 active+clean; 363 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.4 MiB/s wr, 275 op/s 2024-08-31T05:35:41.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:35:41 smithi070 ceph-mon[22316]: scrub queued for path: / 2024-08-31T05:35:41.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:35:41 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:35:41.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:35:41 smithi070 ceph-mon[22316]: scrub summary: active paths [/] 2024-08-31T05:35:41.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:35:41 smithi070 ceph-mon[22316]: scrub summary: active paths [/] 2024-08-31T05:35:41.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:35:41 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:35:41.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:35:41 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:35:41.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:35:41 smithi050 ceph-mon[22146]: pgmap v516: 129 pgs: 129 active+clean; 363 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.4 MiB/s wr, 275 op/s 2024-08-31T05:35:41.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:35:41 smithi050 ceph-mon[22146]: scrub queued for path: / 2024-08-31T05:35:41.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:35:41 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:35:41.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:35:41 smithi050 ceph-mon[22146]: scrub summary: active paths [/] 2024-08-31T05:35:41.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:35:41 smithi050 ceph-mon[22146]: scrub summary: active paths [/] 2024-08-31T05:35:41.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:35:41 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:35:41.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:35:41 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:35:41.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.882+0000 7fc347b94640 1 -- 172.21.15.5:0/548313787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc340109bd0 msgr2=0x7fc340110400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:41.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.882+0000 7fc347b94640 1 --2- 172.21.15.5:0/548313787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc340109bd0 0x7fc340110400 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc338009ca0 tx=0x7fc33802a8c0 comp rx=0 tx=0).stop 2024-08-31T05:35:41.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.882+0000 7fc347b94640 1 -- 172.21.15.5:0/548313787 shutdown_connections 2024-08-31T05:35:41.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.882+0000 7fc347b94640 1 --2- 172.21.15.5:0/548313787 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc340109bd0 0x7fc340110400 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:41.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.882+0000 7fc347b94640 1 --2- 172.21.15.5:0/548313787 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc340109280 0x7fc340109690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:41.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.882+0000 7fc347b94640 1 --2- 172.21.15.5:0/548313787 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc340103940 0x7fc340103d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:41.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.882+0000 7fc347b94640 1 -- 172.21.15.5:0/548313787 >> 172.21.15.5:0/548313787 conn(0x7fc3400ff3d0 msgr2=0x7fc340101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:41.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.882+0000 7fc347b94640 1 -- 172.21.15.5:0/548313787 shutdown_connections 2024-08-31T05:35:41.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.882+0000 7fc347b94640 1 -- 172.21.15.5:0/548313787 wait complete. 2024-08-31T05:35:41.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.883+0000 7fc347b94640 1 Processor -- start 2024-08-31T05:35:41.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.883+0000 7fc347b94640 1 -- start start 2024-08-31T05:35:41.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.883+0000 7fc347b94640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc340103940 0x7fc34019a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:41.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.883+0000 7fc347b94640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc340109280 0x7fc34019a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:41.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.883+0000 7fc347b94640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc340109bd0 0x7fc34019faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:41.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.883+0000 7fc347b94640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc340113890 con 0x7fc340109280 2024-08-31T05:35:41.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.883+0000 7fc347b94640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc340113710 con 0x7fc340103940 2024-08-31T05:35:41.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.883+0000 7fc347b94640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc340113a10 con 0x7fc340109bd0 2024-08-31T05:35:41.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.883+0000 7fc34512f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc340109280 0x7fc34019a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:41.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.883+0000 7fc34512f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc340109280 0x7fc34019a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43728/0 (socket says 172.21.15.5:43728) 2024-08-31T05:35:41.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.883+0000 7fc34512f640 1 -- 172.21.15.5:0/1307861573 learned_addr learned my addr 172.21.15.5:0/1307861573 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:41.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.883+0000 7fc345930640 1 --2- 172.21.15.5:0/1307861573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc340103940 0x7fc34019a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:41.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.883+0000 7fc346131640 1 --2- 172.21.15.5:0/1307861573 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc340109bd0 0x7fc34019faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:41.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.884+0000 7fc345930640 1 -- 172.21.15.5:0/1307861573 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc340109bd0 msgr2=0x7fc34019faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:41.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.884+0000 7fc345930640 1 --2- 172.21.15.5:0/1307861573 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc340109bd0 0x7fc34019faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:41.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.884+0000 7fc345930640 1 -- 172.21.15.5:0/1307861573 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc340109280 msgr2=0x7fc34019a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:41.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.884+0000 7fc345930640 1 --2- 172.21.15.5:0/1307861573 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc340109280 0x7fc34019a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:41.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.884+0000 7fc345930640 1 -- 172.21.15.5:0/1307861573 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3401a01d0 con 0x7fc340103940 2024-08-31T05:35:41.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.884+0000 7fc34512f640 1 --2- 172.21.15.5:0/1307861573 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc340109280 0x7fc34019a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:35:41.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.884+0000 7fc345930640 1 --2- 172.21.15.5:0/1307861573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc340103940 0x7fc34019a260 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc33c009d20 tx=0x7fc33c00c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:41.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.884+0000 7fc336ffd640 1 -- 172.21.15.5:0/1307861573 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc33c01f070 con 0x7fc340103940 2024-08-31T05:35:41.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.884+0000 7fc336ffd640 1 -- 172.21.15.5:0/1307861573 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc33c011750 con 0x7fc340103940 2024-08-31T05:35:41.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.884+0000 7fc347b94640 1 -- 172.21.15.5:0/1307861573 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3401a04c0 con 0x7fc340103940 2024-08-31T05:35:41.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.884+0000 7fc336ffd640 1 -- 172.21.15.5:0/1307861573 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc33c01a690 con 0x7fc340103940 2024-08-31T05:35:41.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.884+0000 7fc347b94640 1 -- 172.21.15.5:0/1307861573 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc340075390 con 0x7fc340103940 2024-08-31T05:35:41.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.887+0000 7fc34e109740 1 Processor -- start 2024-08-31T05:35:41.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.887+0000 7fc34e109740 1 -- start start 2024-08-31T05:35:41.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.887+0000 7fc336ffd640 1 -- 172.21.15.5:0/1307861573 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fc33c022070 con 0x7fc340103940 2024-08-31T05:35:41.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.888+0000 7fc34e109740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557faceb7070 0x557fad25c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:41.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.888+0000 7fc34e109740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557face8e1b0 0x557fad25c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:41.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.888+0000 7fc34e109740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557face96390 0x557fad25cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:41.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.888+0000 7fc34e109740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x557fad1d3630 con 0x557face96390 2024-08-31T05:35:41.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.888+0000 7fc34e109740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x557fad1c2bc0 con 0x557faceb7070 2024-08-31T05:35:41.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.888+0000 7fc34e109740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557fad1c6b70 con 0x557face8e1b0 2024-08-31T05:35:41.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.888+0000 7fc345930640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557face8e1b0 0x557fad25c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:41.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.888+0000 7fc346131640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557faceb7070 0x557fad25c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:41.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.888+0000 7fc346131640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557faceb7070 0x557fad25c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:39486/0 (socket says 172.21.15.5:39486) 2024-08-31T05:35:41.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.888+0000 7fc346131640 1 -- 172.21.15.5:0/4084517881 learned_addr learned my addr 172.21.15.5:0/4084517881 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:41.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.888+0000 7fc34512f640 1 --2- 172.21.15.5:0/4084517881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557face96390 0x557fad25cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:41.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.888+0000 7fc346131640 1 -- 172.21.15.5:0/4084517881 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557face8e1b0 msgr2=0x557fad25c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:41.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.888+0000 7fc346131640 1 --2- 172.21.15.5:0/4084517881 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557face8e1b0 0x557fad25c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:41.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.888+0000 7fc346131640 1 -- 172.21.15.5:0/4084517881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557face96390 msgr2=0x557fad25cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:41.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.888+0000 7fc346131640 1 --2- 172.21.15.5:0/4084517881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557face96390 0x557fad25cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:41.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.888+0000 7fc346131640 1 -- 172.21.15.5:0/4084517881 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557facf22650 con 0x557faceb7070 2024-08-31T05:35:41.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.888+0000 7fc34512f640 1 --2- 172.21.15.5:0/4084517881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557face96390 0x557fad25cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:35:41.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.888+0000 7fc336ffd640 1 --2- 172.21.15.5:0/1307861573 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc32c0b4ca0 0x7fc32c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:41.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.888+0000 7fc346131640 1 --2- 172.21.15.5:0/4084517881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557faceb7070 0x557fad25c2c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc33802f410 tx=0x7fc33802f440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e1f74178d8099f6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:41.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.889+0000 7fc345930640 1 --2- 172.21.15.5:0/1307861573 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc32c0b4ca0 0x7fc32c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:41.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.889+0000 7fc32bfff640 1 -- 172.21.15.5:0/4084517881 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc338031cf0 con 0x557faceb7070 2024-08-31T05:35:41.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.889+0000 7fc336ffd640 1 -- 172.21.15.5:0/1307861573 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fc33c0e9650 con 0x7fc340103940 2024-08-31T05:35:41.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.889+0000 7fc32bfff640 1 -- 172.21.15.5:0/4084517881 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc338036030 con 0x557faceb7070 2024-08-31T05:35:41.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.889+0000 7fc32bfff640 1 -- 172.21.15.5:0/4084517881 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc338004240 con 0x557faceb7070 2024-08-31T05:35:41.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.890+0000 7fc34e109740 1 -- 172.21.15.5:0/4084517881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557faceb7070 msgr2=0x557fad25c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:41.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.890+0000 7fc345930640 1 --2- 172.21.15.5:0/1307861573 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc32c0b4ca0 0x7fc32c0b71b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc33c0e6ad0 tx=0x7fc33c0ef4a0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:41.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.890+0000 7fc34e109740 1 --2- 172.21.15.5:0/4084517881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557faceb7070 0x557fad25c2c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc33802f410 tx=0x7fc33802f440 comp rx=0 tx=0).stop 2024-08-31T05:35:41.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.890+0000 7fc34e109740 1 -- 172.21.15.5:0/4084517881 shutdown_connections 2024-08-31T05:35:41.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.890+0000 7fc34e109740 1 --2- 172.21.15.5:0/4084517881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557face96390 0x557fad25cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:41.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.890+0000 7fc34e109740 1 --2- 172.21.15.5:0/4084517881 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557face8e1b0 0x557fad25c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:41.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.890+0000 7fc34e109740 1 --2- 172.21.15.5:0/4084517881 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557faceb7070 0x557fad25c2c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:41.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.890+0000 7fc34e109740 1 -- 172.21.15.5:0/4084517881 >> 172.21.15.5:0/4084517881 conn(0x557faceab460 msgr2=0x557fad25a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:41.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.890+0000 7fc34e109740 1 -- 172.21.15.5:0/4084517881 shutdown_connections 2024-08-31T05:35:41.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.890+0000 7fc34e109740 1 -- 172.21.15.5:0/4084517881 wait complete. 2024-08-31T05:35:41.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.890+0000 7fc34e109740 1 -- start start 2024-08-31T05:35:41.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.890+0000 7fc34e109740 1 Processor -- start 2024-08-31T05:35:41.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.891+0000 7fc34e109740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557face8e1b0 0x557fad267a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:41.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.891+0000 7fc34e109740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557face96390 0x557fad267f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:41.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.891+0000 7fc34e109740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557faceb7070 0x557fad273bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:41.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.891+0000 7fc34e109740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x557fad025700 con 0x557faceb7070 2024-08-31T05:35:41.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.891+0000 7fc34e109740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x557fad149700 con 0x557face8e1b0 2024-08-31T05:35:41.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.891+0000 7fc34e109740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557fad26a8c0 con 0x557face96390 2024-08-31T05:35:41.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.891+0000 7fc346131640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557face8e1b0 0x557fad267a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:41.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.891+0000 7fc34512f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557face96390 0x557fad267f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:41.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.891+0000 7fc346131640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557face8e1b0 0x557fad267a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:39500/0 (socket says 172.21.15.5:39500) 2024-08-31T05:35:41.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.891+0000 7fc34e109740 10 client.0 _ll_register_callbacks cb 0x557fad178dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:35:41.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.891+0000 7fc346131640 1 -- 172.21.15.5:0/2995083067 learned_addr learned my addr 172.21.15.5:0/2995083067 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:41.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.891+0000 7fc34512f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557face96390 0x557fad267f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:42280/0 (socket says 172.21.15.5:42280) 2024-08-31T05:35:41.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.891+0000 7fc346131640 1 --2- 172.21.15.5:0/2995083067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557faceb7070 0x557fad273bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:41.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.891+0000 7fc346131640 1 -- 172.21.15.5:0/2995083067 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557face96390 msgr2=0x557fad267f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:41.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.892+0000 7fc346131640 1 --2- 172.21.15.5:0/2995083067 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557face96390 0x557fad267f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:41.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.892+0000 7fc346131640 1 -- 172.21.15.5:0/2995083067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557faceb7070 msgr2=0x557fad273bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:41.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.892+0000 7fc346131640 1 --2- 172.21.15.5:0/2995083067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557faceb7070 0x557fad273bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:41.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.892+0000 7fc346131640 1 -- 172.21.15.5:0/2995083067 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fad1828b0 con 0x557face8e1b0 2024-08-31T05:35:41.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.892+0000 7fc34512f640 1 --2- 172.21.15.5:0/2995083067 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557face96390 0x557fad267f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:35:41.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.892+0000 7fc346131640 1 --2- 172.21.15.5:0/2995083067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557face8e1b0 0x557fad267a50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc338009a60 tx=0x7fc338003d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc7a222c1acdc6f3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:41.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.892+0000 7fc3297fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:35:41.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.892+0000 7fc3297fa640 1 -- 172.21.15.5:0/2995083067 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc338059060 con 0x557face8e1b0 2024-08-31T05:35:41.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.892+0000 7fc34e109740 1 -- 172.21.15.5:0/2995083067 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc338036030 con 0x557face8e1b0 2024-08-31T05:35:41.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.892+0000 7fc3297fa640 1 -- 172.21.15.5:0/2995083067 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fc338004620 con 0x557face8e1b0 2024-08-31T05:35:41.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.892+0000 7fc3297fa640 1 -- 172.21.15.5:0/2995083067 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc338004820 con 0x557face8e1b0 2024-08-31T05:35:41.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.892+0000 7fc34e109740 10 client.26723 fetch_fsmap learned FSMap version 34 2024-08-31T05:35:41.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.892+0000 7fc34e109740 1 -- 172.21.15.5:0/2995083067 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x557fad2766a0 con 0x557face8e1b0 2024-08-31T05:35:41.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.892+0000 7fc3297fa640 1 -- 172.21.15.5:0/2995083067 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc338036030 con 0x557face8e1b0 2024-08-31T05:35:41.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.893+0000 7fc3297fa640 1 -- 172.21.15.5:0/2995083067 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fc338043070 con 0x557face8e1b0 2024-08-31T05:35:41.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.893+0000 7fc34e109740 10 client.26723 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:35:41.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.893+0000 7fc34e109740 10 client.26723 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:35:41.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.893+0000 7fc34e109740 20 client.26723 populate_metadata read hostname 'smithi005' 2024-08-31T05:35:41.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.893+0000 7fc34e109740 1 --2- 172.21.15.5:0/2995083067 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x557face759f0 0x557fad279a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:41.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.893+0000 7fc34e109740 4 client.26723 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:35:41.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.893+0000 7fc34e109740 1 -- 172.21.15.5:0/2995083067 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557fad1d5580 con 0x557face759f0 2024-08-31T05:35:41.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.893+0000 7fc34512f640 1 --2- 172.21.15.5:0/2995083067 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x557face759f0 0x557fad279a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:41.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.893+0000 7fc34512f640 1 --2- 172.21.15.5:0/2995083067 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x557face759f0 0x557fad279a00 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ced69e439d096d1 server_cookie=811906ce1fb9b183 in_seq=0 out_seq=0 2024-08-31T05:35:41.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.893+0000 7fc3297fa640 10 client.26723 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:35:41.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.894+0000 7fc3297fa640 1 -- 172.21.15.5:0/2995083067 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557fad1d5580 con 0x557face759f0 2024-08-31T05:35:41.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.894+0000 7fc3297fa640 10 client.26723 handle_command_reply: tid=0 2024-08-31T05:35:41.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.894+0000 7fc34e109740 1 client.26723 shutdown 2024-08-31T05:35:41.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.895+0000 7fc34e109740 1 -- 172.21.15.5:0/2995083067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557face8e1b0 msgr2=0x557fad267a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:41.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.895+0000 7fc34e109740 1 --2- 172.21.15.5:0/2995083067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557face8e1b0 0x557fad267a50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc338009a60 tx=0x7fc338003d70 comp rx=0 tx=0).stop 2024-08-31T05:35:41.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.895+0000 7fc34e109740 1 -- 172.21.15.5:0/2995083067 shutdown_connections 2024-08-31T05:35:41.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.895+0000 7fc34e109740 1 --2- 172.21.15.5:0/2995083067 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x557face759f0 0x557fad279a00 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:41.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.895+0000 7fc34e109740 1 --2- 172.21.15.5:0/2995083067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557faceb7070 0x557fad273bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:41.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.895+0000 7fc34e109740 1 --2- 172.21.15.5:0/2995083067 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557face96390 0x557fad267f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:41.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.895+0000 7fc34e109740 1 --2- 172.21.15.5:0/2995083067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557face8e1b0 0x557fad267a50 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:41.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.895+0000 7fc3297fa640 0 client.26723 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:35:41.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.895+0000 7fc34e109740 1 -- 172.21.15.5:0/2995083067 >> 172.21.15.5:0/2995083067 conn(0x557faceab460 msgr2=0x557fad25f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:41.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.895+0000 7fc34e109740 1 -- 172.21.15.5:0/2995083067 shutdown_connections 2024-08-31T05:35:41.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.895+0000 7fc34e109740 1 -- 172.21.15.5:0/2995083067 wait complete. 2024-08-31T05:35:41.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.895+0000 7fc34e109740 20 client.26723 trim_cache size 0 max 16384 2024-08-31T05:35:41.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.913+0000 7fc34e109740 1 Processor -- start 2024-08-31T05:35:41.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.913+0000 7fc34e109740 1 -- start start 2024-08-31T05:35:41.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.914+0000 7fc34e109740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557face8e1b0 0x557fad262dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:41.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.914+0000 7fc34e109740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557face96390 0x557fad25fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:41.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.914+0000 7fc34e109740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557faceb7070 0x557fad264c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:41.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.914+0000 7fc34e109740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc3401aea60 con 0x557face8e1b0 2024-08-31T05:35:41.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.914+0000 7fc34e109740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc3401b05a0 con 0x557face96390 2024-08-31T05:35:41.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.914+0000 7fc34e109740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc3401af130 con 0x557faceb7070 2024-08-31T05:35:41.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.914+0000 7fc346131640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557face8e1b0 0x557fad262dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:41.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.914+0000 7fc346131640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557face8e1b0 0x557fad262dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43760/0 (socket says 172.21.15.5:43760) 2024-08-31T05:35:41.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.914+0000 7fc346131640 1 -- 172.21.15.5:0/564678205 learned_addr learned my addr 172.21.15.5:0/564678205 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:41.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.914+0000 7fc34512f640 1 --2- 172.21.15.5:0/564678205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557face96390 0x557fad25fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:41.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.914+0000 7fc346131640 1 --2- 172.21.15.5:0/564678205 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557faceb7070 0x557fad264c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:41.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.914+0000 7fc346131640 1 -- 172.21.15.5:0/564678205 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557faceb7070 msgr2=0x557fad264c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:41.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.914+0000 7fc346131640 1 --2- 172.21.15.5:0/564678205 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557faceb7070 0x557fad264c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:41.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.914+0000 7fc346131640 1 -- 172.21.15.5:0/564678205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557face96390 msgr2=0x557fad25fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:41.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.914+0000 7fc346131640 1 --2- 172.21.15.5:0/564678205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557face96390 0x557fad25fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:41.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.914+0000 7fc346131640 1 -- 172.21.15.5:0/564678205 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fad2669b0 con 0x557face8e1b0 2024-08-31T05:35:41.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.914+0000 7fc34512f640 1 --2- 172.21.15.5:0/564678205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557face96390 0x557fad25fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:35:41.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.914+0000 7fc346131640 1 --2- 172.21.15.5:0/564678205 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557face8e1b0 0x557fad262dc0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fc33802ade0 tx=0x7fc33802a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25a77c2896f34721 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:41.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.915+0000 7fc32b7fe640 1 -- 172.21.15.5:0/564678205 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc338059040 con 0x557face8e1b0 2024-08-31T05:35:41.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.915+0000 7fc32b7fe640 1 -- 172.21.15.5:0/564678205 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc338036070 con 0x557face8e1b0 2024-08-31T05:35:41.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.915+0000 7fc32b7fe640 1 -- 172.21.15.5:0/564678205 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3380043e0 con 0x557face8e1b0 2024-08-31T05:35:41.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.916+0000 7fc34e109740 1 -- 172.21.15.5:0/564678205 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557face8e1b0 msgr2=0x557fad262dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:41.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.916+0000 7fc34e109740 1 --2- 172.21.15.5:0/564678205 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557face8e1b0 0x557fad262dc0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fc33802ade0 tx=0x7fc33802a8c0 comp rx=0 tx=0).stop 2024-08-31T05:35:41.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.916+0000 7fc34e109740 1 -- 172.21.15.5:0/564678205 shutdown_connections 2024-08-31T05:35:41.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.916+0000 7fc34e109740 1 --2- 172.21.15.5:0/564678205 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557faceb7070 0x557fad264c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:41.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.916+0000 7fc34e109740 1 --2- 172.21.15.5:0/564678205 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557face96390 0x557fad25fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:41.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.916+0000 7fc34e109740 1 --2- 172.21.15.5:0/564678205 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557face8e1b0 0x557fad262dc0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:41.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.916+0000 7fc34e109740 1 -- 172.21.15.5:0/564678205 >> 172.21.15.5:0/564678205 conn(0x557faceab460 msgr2=0x557fad25f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:41.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.916+0000 7fc34e109740 1 -- 172.21.15.5:0/564678205 shutdown_connections 2024-08-31T05:35:41.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.916+0000 7fc34e109740 1 -- 172.21.15.5:0/564678205 wait complete. 2024-08-31T05:35:41.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.916+0000 7fc34e109740 1 -- start start 2024-08-31T05:35:41.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.916+0000 7fc34e109740 1 Processor -- start 2024-08-31T05:35:41.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.917+0000 7fc34e109740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557face8e1b0 0x557fad27b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:41.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.917+0000 7fc34e109740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557face96390 0x557fad27bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:41.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.917+0000 7fc34e109740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557faceb7070 0x557fad2dc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:41.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.917+0000 7fc34e109740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc3401afed0 con 0x557faceb7070 2024-08-31T05:35:41.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.917+0000 7fc34e109740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc3401af800 con 0x557face96390 2024-08-31T05:35:41.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.917+0000 7fc34e109740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc3401aca40 con 0x557face8e1b0 2024-08-31T05:35:41.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.917+0000 7fc34e109740 10 client.0 _ll_register_callbacks cb 0x7fc330009470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:35:41.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.917+0000 7fc346131640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557faceb7070 0x557fad2dc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:41.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.917+0000 7fc34512f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557face96390 0x557fad27bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:41.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.917+0000 7fc346131640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557faceb7070 0x557fad2dc1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43764/0 (socket says 172.21.15.5:43764) 2024-08-31T05:35:41.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.917+0000 7fc34512f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557face96390 0x557fad27bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:39518/0 (socket says 172.21.15.5:39518) 2024-08-31T05:35:41.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.917+0000 7fc346131640 1 -- 172.21.15.5:0/579676066 learned_addr learned my addr 172.21.15.5:0/579676066 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:41.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.917+0000 7fc346131640 1 --2- 172.21.15.5:0/579676066 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557face8e1b0 0x557fad27b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:41.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.917+0000 7fc34512f640 1 -- 172.21.15.5:0/579676066 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557face8e1b0 msgr2=0x557fad27b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:41.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.917+0000 7fc34512f640 1 --2- 172.21.15.5:0/579676066 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557face8e1b0 0x557fad27b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:41.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.917+0000 7fc34512f640 1 -- 172.21.15.5:0/579676066 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557faceb7070 msgr2=0x557fad2dc1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:41.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.917+0000 7fc34512f640 1 --2- 172.21.15.5:0/579676066 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557faceb7070 0x557fad2dc1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:41.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.917+0000 7fc34512f640 1 -- 172.21.15.5:0/579676066 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fad2dc820 con 0x557face96390 2024-08-31T05:35:41.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.917+0000 7fc346131640 1 --2- 172.21.15.5:0/579676066 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557faceb7070 0x557fad2dc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:35:41.923 INFO:tasks.workunit.client.0.smithi005.stdout: 1 629876 11.93 MB/sec execute 149 sec latency 42.844 ms 2024-08-31T05:35:41.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.918+0000 7fc34512f640 1 --2- 172.21.15.5:0/579676066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557face96390 0x557fad27bb00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x557fad1d36c0 tx=0x7fc3300207d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8413ce9c50a75e5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:41.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.918+0000 7fc3297fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:35:41.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.918+0000 7fc3297fa640 1 -- 172.21.15.5:0/579676066 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc33002a030 con 0x557face96390 2024-08-31T05:35:41.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.918+0000 7fc34e109740 1 -- 172.21.15.5:0/579676066 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc338036070 con 0x557face96390 2024-08-31T05:35:41.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.918+0000 7fc3297fa640 1 -- 172.21.15.5:0/579676066 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fc330004020 con 0x557face96390 2024-08-31T05:35:41.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.918+0000 7fc3297fa640 1 -- 172.21.15.5:0/579676066 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc330004220 con 0x557face96390 2024-08-31T05:35:41.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.918+0000 7fc34e109740 10 client.26729 fetch_fsmap learned FSMap version 34 2024-08-31T05:35:41.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.918+0000 7fc34e109740 1 -- 172.21.15.5:0/579676066 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x557fad2e4d90 con 0x557face96390 2024-08-31T05:35:41.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.918+0000 7fc3297fa640 1 -- 172.21.15.5:0/579676066 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc338036070 con 0x557face96390 2024-08-31T05:35:41.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.918+0000 7fc3297fa640 1 -- 172.21.15.5:0/579676066 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fc330004910 con 0x557face96390 2024-08-31T05:35:41.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.918+0000 7fc34e109740 10 client.26729 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:35:41.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.918+0000 7fc34e109740 10 client.26729 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:35:41.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.918+0000 7fc34e109740 20 client.26729 populate_metadata read hostname 'smithi005' 2024-08-31T05:35:41.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.918+0000 7fc34e109740 1 --2- 172.21.15.5:0/579676066 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x557face4ada0 0x557fad2e7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:41.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.918+0000 7fc34e109740 4 client.26729 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T05:35:41.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.918+0000 7fc34e109740 1 -- 172.21.15.5:0/579676066 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557fad1d1020 con 0x557face4ada0 2024-08-31T05:35:41.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.919+0000 7fc346131640 1 --2- 172.21.15.5:0/579676066 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x557face4ada0 0x557fad2e7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:41.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.919+0000 7fc3297fa640 10 client.26729 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:35:41.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.919+0000 7fc346131640 1 --2- 172.21.15.5:0/579676066 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x557face4ada0 0x557fad2e7520 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8ac1fd1760d3845 server_cookie=501a0eccfd1c8705 in_seq=0 out_seq=0 2024-08-31T05:35:41.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.919+0000 7fc3297fa640 1 -- 172.21.15.5:0/579676066 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2558 (crc 0 0 0) 0x557fad1d1020 con 0x557face4ada0 2024-08-31T05:35:41.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.919+0000 7fc3297fa640 10 client.26729 handle_command_reply: tid=0 2024-08-31T05:35:41.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.919+0000 7fc34e109740 1 client.26729 shutdown 2024-08-31T05:35:41.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.920+0000 7fc34e109740 1 -- 172.21.15.5:0/579676066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557face96390 msgr2=0x557fad27bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:41.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.920+0000 7fc34e109740 1 --2- 172.21.15.5:0/579676066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557face96390 0x557fad27bb00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x557fad1d36c0 tx=0x7fc3300207d0 comp rx=0 tx=0).stop 2024-08-31T05:35:41.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.920+0000 7fc34e109740 1 -- 172.21.15.5:0/579676066 shutdown_connections 2024-08-31T05:35:41.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.920+0000 7fc34e109740 1 --2- 172.21.15.5:0/579676066 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x557face4ada0 0x557fad2e7520 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:41.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.920+0000 7fc34e109740 1 --2- 172.21.15.5:0/579676066 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557faceb7070 0x557fad2dc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:41.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.920+0000 7fc34e109740 1 --2- 172.21.15.5:0/579676066 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557face96390 0x557fad27bb00 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:41.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.920+0000 7fc3297fa640 0 client.26729 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:35:41.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.920+0000 7fc34e109740 1 --2- 172.21.15.5:0/579676066 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557face8e1b0 0x557fad27b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:41.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.920+0000 7fc34e109740 1 -- 172.21.15.5:0/579676066 >> 172.21.15.5:0/579676066 conn(0x557faceab460 msgr2=0x557fad25d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:41.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.920+0000 7fc34e109740 1 -- 172.21.15.5:0/579676066 shutdown_connections 2024-08-31T05:35:41.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.920+0000 7fc34e109740 1 -- 172.21.15.5:0/579676066 wait complete. 2024-08-31T05:35:41.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.920+0000 7fc34e109740 20 client.26729 trim_cache size 0 max 16384 2024-08-31T05:35:41.927 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:35:41.927 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T05:35:41.927 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2024-08-31T05:35:41.927 INFO:teuthology.orchestra.run.smithi005.stdout: "095ccc7a-f368-4bc6-9563-5930e21f9b4a": { 2024-08-31T05:35:41.927 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:35:41.927 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "095ccc7a-f368-4bc6-9563-5930e21f9b4a", 2024-08-31T05:35:41.928 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2024-08-31T05:35:41.928 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:35:41.928 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:35:41.928 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_stats": { 2024-08-31T05:35:41.928 INFO:teuthology.orchestra.run.smithi005.stdout: "095ccc7a-f368-4bc6-9563-5930e21f9b4a": { 2024-08-31T05:35:41.928 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:35:40.190069+0000", 2024-08-31T05:35:41.928 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:35:41.928 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:35:41.928 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:35:41.928 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:35:41.928 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:35:41.928 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:35:41.928 INFO:teuthology.orchestra.run.smithi005.stdout: "de9731c7-ae4a-42fe-8146-e4752cdc40d4": { 2024-08-31T05:35:41.928 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:34:53.614499+0000", 2024-08-31T05:35:41.928 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:35:41.929 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:35:41.929 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:35:41.929 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:35:41.929 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:35:41.929 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:35:41.929 INFO:teuthology.orchestra.run.smithi005.stdout: "0bb67292-013a-40c7-b5fc-810bdd9715d8": { 2024-08-31T05:35:41.929 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:34:04.586008+0000", 2024-08-31T05:35:41.929 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:35:41.929 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:35:41.929 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:35:41.929 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:35:41.929 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:35:41.929 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:35:41.929 INFO:teuthology.orchestra.run.smithi005.stdout: "728a42ca-bbef-4151-830f-5fdd411d8fa0": { 2024-08-31T05:35:41.930 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:32:30.554906+0000", 2024-08-31T05:35:41.930 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:35:41.930 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:35:41.930 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:35:41.930 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:35:41.930 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:35:41.930 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:35:41.930 INFO:teuthology.orchestra.run.smithi005.stdout: "2445fc42-b797-434f-b380-e2da985b4d98": { 2024-08-31T05:35:41.930 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:33:17.681453+0000", 2024-08-31T05:35:41.930 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:35:41.930 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:35:41.930 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:35:41.930 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:35:41.930 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:35:41.930 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:35:41.930 INFO:teuthology.orchestra.run.smithi005.stdout: "cda92ac0-b35f-47a5-a3a5-471c888462a5": { 2024-08-31T05:35:41.931 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:53.103905+0000", 2024-08-31T05:35:41.931 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:35:41.931 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:35:41.931 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:35:41.931 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:35:41.931 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:35:41.931 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:35:41.931 INFO:teuthology.orchestra.run.smithi005.stdout: "ece37b07-9ab2-45f8-bc33-2755a07aac0b": { 2024-08-31T05:35:41.931 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:31:41.782407+0000", 2024-08-31T05:35:41.931 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:35:41.932 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:35:41.932 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:35:41.932 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:35:41.932 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:35:41.932 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:35:41.932 INFO:teuthology.orchestra.run.smithi005.stdout: "75d84398-5d9c-4872-b879-2fbce045fa71": { 2024-08-31T05:35:41.932 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:06.642335+0000", 2024-08-31T05:35:41.932 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:35:41.932 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:35:41.932 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:35:41.932 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:35:41.932 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:35:41.932 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:35:41.932 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:35:41.933 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:35:41.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.921+0000 7fc347b94640 1 -- 172.21.15.5:0/1307861573 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc32c0b4ca0 msgr2=0x7fc32c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:41.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.921+0000 7fc347b94640 1 --2- 172.21.15.5:0/1307861573 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc32c0b4ca0 0x7fc32c0b71b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc33c0e6ad0 tx=0x7fc33c0ef4a0 comp rx=0 tx=0).stop 2024-08-31T05:35:41.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.921+0000 7fc347b94640 1 -- 172.21.15.5:0/1307861573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc340103940 msgr2=0x7fc34019a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:41.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.921+0000 7fc347b94640 1 --2- 172.21.15.5:0/1307861573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc340103940 0x7fc34019a260 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc33c009d20 tx=0x7fc33c00c6a0 comp rx=0 tx=0).stop 2024-08-31T05:35:41.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.921+0000 7fc347b94640 1 -- 172.21.15.5:0/1307861573 shutdown_connections 2024-08-31T05:35:41.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.921+0000 7fc347b94640 1 --2- 172.21.15.5:0/1307861573 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc32c0b4ca0 0x7fc32c0b71b0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:41.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.921+0000 7fc347b94640 1 --2- 172.21.15.5:0/1307861573 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc340109bd0 0x7fc34019faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:41.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.921+0000 7fc347b94640 1 --2- 172.21.15.5:0/1307861573 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc340109280 0x7fc34019a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:41.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.921+0000 7fc347b94640 1 --2- 172.21.15.5:0/1307861573 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc340103940 0x7fc34019a260 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:41.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.921+0000 7fc347b94640 1 -- 172.21.15.5:0/1307861573 >> 172.21.15.5:0/1307861573 conn(0x7fc3400ff3d0 msgr2=0x7fc340106810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:41.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.921+0000 7fc347b94640 1 -- 172.21.15.5:0/1307861573 shutdown_connections 2024-08-31T05:35:41.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:35:41.921+0000 7fc347b94640 1 -- 172.21.15.5:0/1307861573 wait complete. 2024-08-31T05:35:42.814 INFO:tasks.cephfs.filesystem:scrub status for tag:095ccc7a-f368-4bc6-9563-5930e21f9b4a - {'path': '/', 'tag': '095ccc7a-f368-4bc6-9563-5930e21f9b4a', 'options': 'recursive,force'} 2024-08-31T05:35:42.919 INFO:tasks.workunit.client.0.smithi005.stdout: 1 632375 11.96 MB/sec execute 150 sec latency 38.695 ms 2024-08-31T05:35:43.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:35:43 smithi005 ceph-mon[18602]: pgmap v517: 129 pgs: 129 active+clean; 364 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.1 MiB/s wr, 205 op/s 2024-08-31T05:35:43.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:35:43 smithi070 ceph-mon[22316]: pgmap v517: 129 pgs: 129 active+clean; 364 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.1 MiB/s wr, 205 op/s 2024-08-31T05:35:43.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:35:43 smithi050 ceph-mon[22146]: pgmap v517: 129 pgs: 129 active+clean; 364 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.1 MiB/s wr, 205 op/s 2024-08-31T05:35:43.920 INFO:tasks.workunit.client.0.smithi005.stdout: 1 634081 11.92 MB/sec execute 151 sec latency 16.188 ms 2024-08-31T05:35:44.920 INFO:tasks.workunit.client.0.smithi005.stdout: 1 636396 11.93 MB/sec execute 152 sec latency 15.244 ms 2024-08-31T05:35:45.459 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:35:45 smithi050 ceph-mon[22146]: pgmap v518: 129 pgs: 129 active+clean; 365 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.1 MiB/s wr, 208 op/s 2024-08-31T05:35:45.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:35:45 smithi005 ceph-mon[18602]: pgmap v518: 129 pgs: 129 active+clean; 365 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.1 MiB/s wr, 208 op/s 2024-08-31T05:35:45.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:35:45 smithi070 ceph-mon[22316]: pgmap v518: 129 pgs: 129 active+clean; 365 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.1 MiB/s wr, 208 op/s 2024-08-31T05:35:45.919 INFO:tasks.workunit.client.0.smithi005.stdout: 1 638893 11.94 MB/sec execute 153 sec latency 25.701 ms 2024-08-31T05:35:46.920 INFO:tasks.workunit.client.0.smithi005.stdout: 1 640744 11.93 MB/sec execute 154 sec latency 27.985 ms 2024-08-31T05:35:47.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:35:47 smithi005 ceph-mon[18602]: pgmap v519: 129 pgs: 129 active+clean; 367 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.6 MiB/s wr, 245 op/s 2024-08-31T05:35:47.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:35:47 smithi070 ceph-mon[22316]: pgmap v519: 129 pgs: 129 active+clean; 367 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.6 MiB/s wr, 245 op/s 2024-08-31T05:35:47.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:35:47 smithi050 ceph-mon[22146]: pgmap v519: 129 pgs: 129 active+clean; 367 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.6 MiB/s wr, 245 op/s 2024-08-31T05:35:47.920 INFO:tasks.workunit.client.0.smithi005.stdout: 1 643202 11.95 MB/sec execute 155 sec latency 13.519 ms 2024-08-31T05:35:48.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:35:48 smithi005 ceph-mon[18602]: scrub summary: idle 2024-08-31T05:35:48.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:35:48 smithi005 ceph-mon[18602]: scrub summary: idle 2024-08-31T05:35:48.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:35:48 smithi070 ceph-mon[22316]: scrub summary: idle 2024-08-31T05:35:48.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:35:48 smithi070 ceph-mon[22316]: scrub summary: idle 2024-08-31T05:35:48.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:35:48 smithi050 ceph-mon[22146]: scrub summary: idle 2024-08-31T05:35:48.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:35:48 smithi050 ceph-mon[22146]: scrub summary: idle 2024-08-31T05:35:48.920 INFO:tasks.workunit.client.0.smithi005.stdout: 1 645229 11.91 MB/sec execute 156 sec latency 24.184 ms 2024-08-31T05:35:49.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:35:49 smithi005 ceph-mon[18602]: pgmap v520: 129 pgs: 129 active+clean; 355 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.7 MiB/s wr, 184 op/s 2024-08-31T05:35:49.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:35:49 smithi070 ceph-mon[22316]: pgmap v520: 129 pgs: 129 active+clean; 355 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.7 MiB/s wr, 184 op/s 2024-08-31T05:35:49.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:35:49 smithi050 ceph-mon[22146]: pgmap v520: 129 pgs: 129 active+clean; 355 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.7 MiB/s wr, 184 op/s 2024-08-31T05:35:49.920 INFO:tasks.workunit.client.0.smithi005.stdout: 1 647399 11.93 MB/sec execute 157 sec latency 11.552 ms 2024-08-31T05:35:50.194 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.190+0000 7fdbb4053640 1 -- 172.21.15.5:0/4093145834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbac1089f0 msgr2=0x7fdbac10f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:50.195 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.190+0000 7fdbb4053640 1 --2- 172.21.15.5:0/4093145834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbac1089f0 0x7fdbac10f220 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fdba4009ca0 tx=0x7fdba402a8c0 comp rx=0 tx=0).stop 2024-08-31T05:35:50.195 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.190+0000 7fdbb4053640 1 -- 172.21.15.5:0/4093145834 shutdown_connections 2024-08-31T05:35:50.195 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.190+0000 7fdbb4053640 1 --2- 172.21.15.5:0/4093145834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbac1089f0 0x7fdbac10f220 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:50.195 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.190+0000 7fdbb4053640 1 --2- 172.21.15.5:0/4093145834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbac1080a0 0x7fdbac1084b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:50.195 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.190+0000 7fdbb4053640 1 --2- 172.21.15.5:0/4093145834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdbac102770 0x7fdbac102b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:50.195 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.190+0000 7fdbb4053640 1 -- 172.21.15.5:0/4093145834 >> 172.21.15.5:0/4093145834 conn(0x7fdbac07a4b0 msgr2=0x7fdbac07a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:50.195 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.190+0000 7fdbb4053640 1 -- 172.21.15.5:0/4093145834 shutdown_connections 2024-08-31T05:35:50.195 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.190+0000 7fdbb4053640 1 -- 172.21.15.5:0/4093145834 wait complete. 2024-08-31T05:35:50.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.190+0000 7fdbb4053640 1 Processor -- start 2024-08-31T05:35:50.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.191+0000 7fdbb4053640 1 -- start start 2024-08-31T05:35:50.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.191+0000 7fdbb4053640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbac102770 0x7fdbac19b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:50.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.191+0000 7fdbb4053640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbac1080a0 0x7fdbac19b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:50.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.191+0000 7fdbb4053640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdbac1089f0 0x7fdbac19bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:50.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.191+0000 7fdbb4053640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdbac112660 con 0x7fdbac102770 2024-08-31T05:35:50.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.191+0000 7fdbb4053640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdbac1124e0 con 0x7fdbac1080a0 2024-08-31T05:35:50.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.191+0000 7fdbb4053640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdbac1127e0 con 0x7fdbac1089f0 2024-08-31T05:35:50.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.191+0000 7fdbb1def640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbac102770 0x7fdbac19b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:50.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.191+0000 7fdbb1def640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbac102770 0x7fdbac19b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55404/0 (socket says 172.21.15.5:55404) 2024-08-31T05:35:50.196 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.191+0000 7fdbb1def640 1 -- 172.21.15.5:0/910558894 learned_addr learned my addr 172.21.15.5:0/910558894 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:50.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.191+0000 7fdbb15ee640 1 --2- 172.21.15.5:0/910558894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbac1080a0 0x7fdbac19b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:50.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.191+0000 7fdbb25f0640 1 --2- 172.21.15.5:0/910558894 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdbac1089f0 0x7fdbac19bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:50.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.191+0000 7fdbb1def640 1 -- 172.21.15.5:0/910558894 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdbac1089f0 msgr2=0x7fdbac19bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:50.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.191+0000 7fdbb1def640 1 --2- 172.21.15.5:0/910558894 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdbac1089f0 0x7fdbac19bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:50.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.191+0000 7fdbb1def640 1 -- 172.21.15.5:0/910558894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbac1080a0 msgr2=0x7fdbac19b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:50.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.191+0000 7fdbb1def640 1 --2- 172.21.15.5:0/910558894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbac1080a0 0x7fdbac19b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:50.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.191+0000 7fdbb1def640 1 -- 172.21.15.5:0/910558894 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbac1a6340 con 0x7fdbac102770 2024-08-31T05:35:50.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.191+0000 7fdbb15ee640 1 --2- 172.21.15.5:0/910558894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbac1080a0 0x7fdbac19b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:35:50.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.192+0000 7fdbb1def640 1 --2- 172.21.15.5:0/910558894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbac102770 0x7fdbac19b0b0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fdba800e9f0 tx=0x7fdba800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:50.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.192+0000 7fdb9effd640 1 -- 172.21.15.5:0/910558894 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba800cd80 con 0x7fdbac102770 2024-08-31T05:35:50.197 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.192+0000 7fdb9effd640 1 -- 172.21.15.5:0/910558894 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdba80108e0 con 0x7fdbac102770 2024-08-31T05:35:50.198 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.192+0000 7fdbb4053640 1 -- 172.21.15.5:0/910558894 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbac1a6630 con 0x7fdbac102770 2024-08-31T05:35:50.198 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.192+0000 7fdb9effd640 1 -- 172.21.15.5:0/910558894 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba8018980 con 0x7fdbac102770 2024-08-31T05:35:50.198 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.192+0000 7fdbb4053640 1 -- 172.21.15.5:0/910558894 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbac1a6b80 con 0x7fdbac102770 2024-08-31T05:35:50.205 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.195+0000 7fdbbafc0740 1 Processor -- start 2024-08-31T05:35:50.205 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.195+0000 7fdbbafc0740 1 -- start start 2024-08-31T05:35:50.205 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.195+0000 7fdbbafc0740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556991b231b0 0x556991ec6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:50.205 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.195+0000 7fdbbafc0740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556991afa2f0 0x556991ec7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:50.205 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.195+0000 7fdbbafc0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556991b024d0 0x556991ec7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:50.206 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.195+0000 7fdbbafc0740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x556991e3c000 con 0x556991afa2f0 2024-08-31T05:35:50.206 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.195+0000 7fdbbafc0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x556991e2b590 con 0x556991b024d0 2024-08-31T05:35:50.206 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.195+0000 7fdbbafc0740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556991e2f540 con 0x556991b231b0 2024-08-31T05:35:50.206 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.195+0000 7fdb9effd640 1 -- 172.21.15.5:0/910558894 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fdba8010430 con 0x7fdbac102770 2024-08-31T05:35:50.206 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.196+0000 7fdbb25f0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556991b231b0 0x556991ec6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:50.206 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.196+0000 7fdbb25f0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556991b231b0 0x556991ec6ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:37372/0 (socket says 172.21.15.5:37372) 2024-08-31T05:35:50.206 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.196+0000 7fdbb25f0640 1 -- 172.21.15.5:0/4137991622 learned_addr learned my addr 172.21.15.5:0/4137991622 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:50.206 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.196+0000 7fdbb15ee640 1 --2- 172.21.15.5:0/4137991622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556991b024d0 0x556991ec7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:50.206 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.196+0000 7fdbb1def640 1 --2- 172.21.15.5:0/4137991622 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556991afa2f0 0x556991ec7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:50.206 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.196+0000 7fdbb25f0640 1 -- 172.21.15.5:0/4137991622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556991b024d0 msgr2=0x556991ec7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:50.206 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.196+0000 7fdbb25f0640 1 --2- 172.21.15.5:0/4137991622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556991b024d0 0x556991ec7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:50.206 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.196+0000 7fdbb25f0640 1 -- 172.21.15.5:0/4137991622 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556991afa2f0 msgr2=0x556991ec7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:50.206 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.196+0000 7fdbb25f0640 1 --2- 172.21.15.5:0/4137991622 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556991afa2f0 0x556991ec7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:50.207 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.196+0000 7fdbb25f0640 1 -- 172.21.15.5:0/4137991622 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556991b8e790 con 0x556991b231b0 2024-08-31T05:35:50.207 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.196+0000 7fdbb1def640 1 --2- 172.21.15.5:0/4137991622 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556991afa2f0 0x556991ec7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:35:50.207 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.196+0000 7fdbb25f0640 1 --2- 172.21.15.5:0/4137991622 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556991b231b0 0x556991ec6ce0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdba402f440 tx=0x7fdba402f470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b0f15540a4683b0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:50.207 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.196+0000 7fdb9effd640 1 --2- 172.21.15.5:0/910558894 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fdb980b4ca0 0x7fdb980b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:50.207 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.196+0000 7fdb97fff640 1 -- 172.21.15.5:0/4137991622 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba4031cf0 con 0x556991b231b0 2024-08-31T05:35:50.207 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.196+0000 7fdb97fff640 1 -- 172.21.15.5:0/4137991622 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdba4036070 con 0x556991b231b0 2024-08-31T05:35:50.207 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.196+0000 7fdb97fff640 1 -- 172.21.15.5:0/4137991622 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba40042a0 con 0x556991b231b0 2024-08-31T05:35:50.207 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.196+0000 7fdbb1def640 1 --2- 172.21.15.5:0/910558894 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fdb980b4ca0 0x7fdb980b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:50.207 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.197+0000 7fdb9effd640 1 -- 172.21.15.5:0/910558894 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fdba80e5bd0 con 0x7fdbac102770 2024-08-31T05:35:50.207 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.197+0000 7fdbbafc0740 1 -- 172.21.15.5:0/4137991622 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556991b231b0 msgr2=0x556991ec6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:50.207 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.197+0000 7fdbb1def640 1 --2- 172.21.15.5:0/910558894 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fdb980b4ca0 0x7fdb980b71b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fdba80e3050 tx=0x7fdba8000bc0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:50.207 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.197+0000 7fdbbafc0740 1 --2- 172.21.15.5:0/4137991622 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556991b231b0 0x556991ec6ce0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdba402f440 tx=0x7fdba402f470 comp rx=0 tx=0).stop 2024-08-31T05:35:50.207 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.197+0000 7fdbbafc0740 1 -- 172.21.15.5:0/4137991622 shutdown_connections 2024-08-31T05:35:50.207 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.197+0000 7fdbbafc0740 1 --2- 172.21.15.5:0/4137991622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556991b024d0 0x556991ec7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:50.208 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.197+0000 7fdbbafc0740 1 --2- 172.21.15.5:0/4137991622 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556991afa2f0 0x556991ec7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:50.208 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.197+0000 7fdbbafc0740 1 --2- 172.21.15.5:0/4137991622 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556991b231b0 0x556991ec6ce0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:50.208 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.197+0000 7fdbbafc0740 1 -- 172.21.15.5:0/4137991622 >> 172.21.15.5:0/4137991622 conn(0x556991b17300 msgr2=0x556991ec4bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:50.208 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.197+0000 7fdbbafc0740 1 -- 172.21.15.5:0/4137991622 shutdown_connections 2024-08-31T05:35:50.208 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.197+0000 7fdbbafc0740 1 -- 172.21.15.5:0/4137991622 wait complete. 2024-08-31T05:35:50.208 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.198+0000 7fdbbafc0740 1 -- start start 2024-08-31T05:35:50.208 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.198+0000 7fdbbafc0740 1 Processor -- start 2024-08-31T05:35:50.208 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.198+0000 7fdbbafc0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556991afa2f0 0x556991ed2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:50.208 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.198+0000 7fdbbafc0740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556991b024d0 0x556991ed2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:50.208 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.198+0000 7fdbbafc0740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556991b231b0 0x556991ede5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:50.208 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.198+0000 7fdbbafc0740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x556991d64ab0 con 0x556991b024d0 2024-08-31T05:35:50.208 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.198+0000 7fdbbafc0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x556991db2680 con 0x556991afa2f0 2024-08-31T05:35:50.208 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.198+0000 7fdbbafc0740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556991ed5280 con 0x556991b231b0 2024-08-31T05:35:50.209 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.198+0000 7fdbbafc0740 10 client.0 _ll_register_callbacks cb 0x556991b3aa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:35:50.209 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.198+0000 7fdbb15ee640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556991b024d0 0x556991ed2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:50.209 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.198+0000 7fdbb15ee640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556991b024d0 0x556991ed2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55418/0 (socket says 172.21.15.5:55418) 2024-08-31T05:35:50.209 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.198+0000 7fdbb15ee640 1 -- 172.21.15.5:0/3729783042 learned_addr learned my addr 172.21.15.5:0/3729783042 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:50.209 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.199+0000 7fdbb25f0640 1 --2- 172.21.15.5:0/3729783042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556991b231b0 0x556991ede5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:50.209 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.199+0000 7fdbb25f0640 1 --2- 172.21.15.5:0/3729783042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556991afa2f0 0x556991ed2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:50.209 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.199+0000 7fdbb15ee640 1 -- 172.21.15.5:0/3729783042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556991b231b0 msgr2=0x556991ede5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:50.209 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.199+0000 7fdbb15ee640 1 --2- 172.21.15.5:0/3729783042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556991b231b0 0x556991ede5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:50.209 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.199+0000 7fdbb15ee640 1 -- 172.21.15.5:0/3729783042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556991afa2f0 msgr2=0x556991ed2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:50.209 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.199+0000 7fdbb15ee640 1 --2- 172.21.15.5:0/3729783042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556991afa2f0 0x556991ed2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:50.209 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.199+0000 7fdbb15ee640 1 -- 172.21.15.5:0/3729783042 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556991c07620 con 0x556991b024d0 2024-08-31T05:35:50.209 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.199+0000 7fdbb15ee640 1 --2- 172.21.15.5:0/3729783042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556991b024d0 0x556991ed2dd0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fdba0012d00 tx=0x7fdba000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35d18b9148fe8710 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:50.209 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.199+0000 7fdb957fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:35:50.209 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.199+0000 7fdb957fa640 1 -- 172.21.15.5:0/3729783042 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba0009d90 con 0x556991b024d0 2024-08-31T05:35:50.210 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.199+0000 7fdb957fa640 1 -- 172.21.15.5:0/3729783042 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fdba0012110 con 0x556991b024d0 2024-08-31T05:35:50.210 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.199+0000 7fdbbafc0740 1 -- 172.21.15.5:0/3729783042 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdba4036070 con 0x556991b024d0 2024-08-31T05:35:50.210 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.199+0000 7fdb957fa640 1 -- 172.21.15.5:0/3729783042 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fdba0004050 con 0x556991b024d0 2024-08-31T05:35:50.210 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.199+0000 7fdbbafc0740 10 client.17154 fetch_fsmap learned FSMap version 34 2024-08-31T05:35:50.210 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.199+0000 7fdbbafc0740 1 -- 172.21.15.5:0/3729783042 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x556991ee1320 con 0x556991b024d0 2024-08-31T05:35:50.210 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.200+0000 7fdb957fa640 1 -- 172.21.15.5:0/3729783042 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdba4036070 con 0x556991b024d0 2024-08-31T05:35:50.210 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.200+0000 7fdb957fa640 1 -- 172.21.15.5:0/3729783042 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fdba0010430 con 0x556991b024d0 2024-08-31T05:35:50.210 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.200+0000 7fdbbafc0740 10 client.17154 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:35:50.210 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.200+0000 7fdbbafc0740 10 client.17154 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:35:50.210 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.200+0000 7fdbbafc0740 20 client.17154 populate_metadata read hostname 'smithi005' 2024-08-31T05:35:50.210 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.200+0000 7fdbbafc0740 1 --2- 172.21.15.5:0/3729783042 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x556991ae1d80 0x556991ee47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:50.210 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.200+0000 7fdbbafc0740 4 client.17154 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:35:50.210 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.200+0000 7fdbbafc0740 1 -- 172.21.15.5:0/3729783042 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556991e3df50 con 0x556991ae1d80 2024-08-31T05:35:50.210 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.200+0000 7fdbb25f0640 1 --2- 172.21.15.5:0/3729783042 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x556991ae1d80 0x556991ee47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:50.210 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.200+0000 7fdb957fa640 10 client.17154 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:35:50.211 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.200+0000 7fdbb25f0640 1 --2- 172.21.15.5:0/3729783042 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x556991ae1d80 0x556991ee47f0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce74238c1bc64eba server_cookie=da891df7d5fc0257 in_seq=0 out_seq=0 2024-08-31T05:35:50.211 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.201+0000 7fdb957fa640 1 -- 172.21.15.5:0/3729783042 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556991e3df50 con 0x556991ae1d80 2024-08-31T05:35:50.211 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.201+0000 7fdb957fa640 10 client.17154 handle_command_reply: tid=0 2024-08-31T05:35:50.211 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.201+0000 7fdbbafc0740 1 client.17154 shutdown 2024-08-31T05:35:50.211 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.201+0000 7fdbbafc0740 1 -- 172.21.15.5:0/3729783042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556991b024d0 msgr2=0x556991ed2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:50.211 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.201+0000 7fdbbafc0740 1 --2- 172.21.15.5:0/3729783042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556991b024d0 0x556991ed2dd0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fdba0012d00 tx=0x7fdba000f790 comp rx=0 tx=0).stop 2024-08-31T05:35:50.211 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.201+0000 7fdbbafc0740 1 -- 172.21.15.5:0/3729783042 shutdown_connections 2024-08-31T05:35:50.211 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.201+0000 7fdbbafc0740 1 --2- 172.21.15.5:0/3729783042 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x556991ae1d80 0x556991ee47f0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:50.211 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.201+0000 7fdbbafc0740 1 --2- 172.21.15.5:0/3729783042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556991b231b0 0x556991ede5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:50.211 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.201+0000 7fdbbafc0740 1 --2- 172.21.15.5:0/3729783042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556991b024d0 0x556991ed2dd0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:50.211 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.201+0000 7fdb957fa640 0 client.17154 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:35:50.211 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.201+0000 7fdbbafc0740 1 --2- 172.21.15.5:0/3729783042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556991afa2f0 0x556991ed2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:50.211 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.201+0000 7fdbbafc0740 1 -- 172.21.15.5:0/3729783042 >> 172.21.15.5:0/3729783042 conn(0x556991b17300 msgr2=0x556991ec7d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:50.212 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.201+0000 7fdbbafc0740 1 -- 172.21.15.5:0/3729783042 shutdown_connections 2024-08-31T05:35:50.212 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.201+0000 7fdbbafc0740 1 -- 172.21.15.5:0/3729783042 wait complete. 2024-08-31T05:35:50.212 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.202+0000 7fdbbafc0740 20 client.17154 trim_cache size 0 max 16384 2024-08-31T05:35:50.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.216+0000 7fdbbafc0740 1 Processor -- start 2024-08-31T05:35:50.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.216+0000 7fdbbafc0740 1 -- start start 2024-08-31T05:35:50.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.217+0000 7fdbbafc0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556991ae1d80 0x556991ed2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:50.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.217+0000 7fdbbafc0740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556991afa2f0 0x556991ec4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:50.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.217+0000 7fdbbafc0740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556991b024d0 0x556991ec46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:50.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.217+0000 7fdbbafc0740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdbac1b0bc0 con 0x556991afa2f0 2024-08-31T05:35:50.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.217+0000 7fdbbafc0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdbac1b2700 con 0x556991ae1d80 2024-08-31T05:35:50.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.217+0000 7fdbbafc0740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdbac1b1290 con 0x556991b024d0 2024-08-31T05:35:50.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.217+0000 7fdbb15ee640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556991afa2f0 0x556991ec4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:50.220 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.217+0000 7fdbb15ee640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556991afa2f0 0x556991ec4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55428/0 (socket says 172.21.15.5:55428) 2024-08-31T05:35:50.221 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.217+0000 7fdbb15ee640 1 -- 172.21.15.5:0/1790789441 learned_addr learned my addr 172.21.15.5:0/1790789441 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:50.221 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.217+0000 7fdbb25f0640 1 --2- 172.21.15.5:0/1790789441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556991ae1d80 0x556991ed2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:50.221 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.217+0000 7fdbb25f0640 1 --2- 172.21.15.5:0/1790789441 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556991b024d0 0x556991ec46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:50.221 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.217+0000 7fdbb15ee640 1 -- 172.21.15.5:0/1790789441 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556991b024d0 msgr2=0x556991ec46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:50.221 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.217+0000 7fdbb15ee640 1 --2- 172.21.15.5:0/1790789441 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556991b024d0 0x556991ec46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:50.221 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.217+0000 7fdbb15ee640 1 -- 172.21.15.5:0/1790789441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556991ae1d80 msgr2=0x556991ed2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:50.221 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.217+0000 7fdbb15ee640 1 --2- 172.21.15.5:0/1790789441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556991ae1d80 0x556991ed2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:50.221 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.217+0000 7fdbb15ee640 1 -- 172.21.15.5:0/1790789441 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556991ed0b60 con 0x556991afa2f0 2024-08-31T05:35:50.221 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.217+0000 7fdbb25f0640 1 --2- 172.21.15.5:0/1790789441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556991ae1d80 0x556991ed2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:35:50.221 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.217+0000 7fdbb15ee640 1 --2- 172.21.15.5:0/1790789441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556991afa2f0 0x556991ec4180 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fdba0010850 tx=0x7fdba000fd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=796638b5669309bc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:50.221 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.217+0000 7fdb977fe640 1 -- 172.21.15.5:0/1790789441 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba002d030 con 0x556991afa2f0 2024-08-31T05:35:50.221 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.218+0000 7fdb977fe640 1 -- 172.21.15.5:0/1790789441 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdba0012110 con 0x556991afa2f0 2024-08-31T05:35:50.222 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.218+0000 7fdb977fe640 1 -- 172.21.15.5:0/1790789441 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba0010430 con 0x556991afa2f0 2024-08-31T05:35:50.225 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.218+0000 7fdbbafc0740 1 -- 172.21.15.5:0/1790789441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556991afa2f0 msgr2=0x556991ec4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:50.225 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.218+0000 7fdbbafc0740 1 --2- 172.21.15.5:0/1790789441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556991afa2f0 0x556991ec4180 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fdba0010850 tx=0x7fdba000fd10 comp rx=0 tx=0).stop 2024-08-31T05:35:50.225 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.218+0000 7fdbbafc0740 1 -- 172.21.15.5:0/1790789441 shutdown_connections 2024-08-31T05:35:50.225 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.218+0000 7fdbbafc0740 1 --2- 172.21.15.5:0/1790789441 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556991b024d0 0x556991ec46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:50.225 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.218+0000 7fdbbafc0740 1 --2- 172.21.15.5:0/1790789441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556991afa2f0 0x556991ec4180 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:50.225 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.218+0000 7fdbbafc0740 1 --2- 172.21.15.5:0/1790789441 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556991ae1d80 0x556991ed2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:50.226 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.218+0000 7fdbbafc0740 1 -- 172.21.15.5:0/1790789441 >> 172.21.15.5:0/1790789441 conn(0x556991b17300 msgr2=0x556991ed1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:50.226 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.218+0000 7fdbbafc0740 1 -- 172.21.15.5:0/1790789441 shutdown_connections 2024-08-31T05:35:50.226 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.218+0000 7fdbbafc0740 1 -- 172.21.15.5:0/1790789441 wait complete. 2024-08-31T05:35:50.226 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.219+0000 7fdbbafc0740 1 -- start start 2024-08-31T05:35:50.226 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.219+0000 7fdbbafc0740 1 Processor -- start 2024-08-31T05:35:50.226 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.219+0000 7fdbbafc0740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556991ae1d80 0x556991ed6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:50.226 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.219+0000 7fdbbafc0740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556991afa2f0 0x556991ed6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:50.226 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.219+0000 7fdbbafc0740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556991b024d0 0x556991ed6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:50.226 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.219+0000 7fdbbafc0740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdbac1b2030 con 0x556991b024d0 2024-08-31T05:35:50.226 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.219+0000 7fdbbafc0740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdbac1b1960 con 0x556991ae1d80 2024-08-31T05:35:50.226 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.219+0000 7fdbbafc0740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdbac1aeba0 con 0x556991afa2f0 2024-08-31T05:35:50.227 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.219+0000 7fdbbafc0740 10 client.0 _ll_register_callbacks cb 0x7fdba0009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:35:50.227 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.219+0000 7fdbb25f0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556991ae1d80 0x556991ed6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:50.227 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.219+0000 7fdbb25f0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556991b024d0 0x556991ed6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:50.227 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.219+0000 7fdbb15ee640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556991afa2f0 0x556991ed6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:50.227 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.219+0000 7fdbb15ee640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556991afa2f0 0x556991ed6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:37400/0 (socket says 172.21.15.5:37400) 2024-08-31T05:35:50.227 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.219+0000 7fdbb15ee640 1 -- 172.21.15.5:0/1658376719 learned_addr learned my addr 172.21.15.5:0/1658376719 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:35:50.227 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.220+0000 7fdbb25f0640 1 -- 172.21.15.5:0/1658376719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556991afa2f0 msgr2=0x556991ed6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:50.227 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.220+0000 7fdbb25f0640 1 --2- 172.21.15.5:0/1658376719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556991afa2f0 0x556991ed6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:50.227 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.220+0000 7fdbb25f0640 1 -- 172.21.15.5:0/1658376719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556991ae1d80 msgr2=0x556991ed6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:35:50.227 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.220+0000 7fdbb25f0640 1 --2- 172.21.15.5:0/1658376719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556991ae1d80 0x556991ed6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:50.228 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.220+0000 7fdbb25f0640 1 -- 172.21.15.5:0/1658376719 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556991f4e190 con 0x556991b024d0 2024-08-31T05:35:50.228 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.220+0000 7fdbb15ee640 1 --2- 172.21.15.5:0/1658376719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556991afa2f0 0x556991ed6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:35:50.228 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.220+0000 7fdbb25f0640 1 --2- 172.21.15.5:0/1658376719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556991b024d0 0x556991ed6ea0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fdba4009bf0 tx=0x7fdba402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0579c6ece63cdc1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:35:50.228 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.220+0000 7fdb957fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:35:50.228 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.220+0000 7fdb957fa640 1 -- 172.21.15.5:0/1658376719 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba4064060 con 0x556991b024d0 2024-08-31T05:35:50.228 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.220+0000 7fdbbafc0740 1 -- 172.21.15.5:0/1658376719 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdba0012110 con 0x556991b024d0 2024-08-31T05:35:50.228 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.220+0000 7fdb957fa640 1 -- 172.21.15.5:0/1658376719 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fdba4031450 con 0x556991b024d0 2024-08-31T05:35:50.228 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.220+0000 7fdb957fa640 1 -- 172.21.15.5:0/1658376719 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fdba4031650 con 0x556991b024d0 2024-08-31T05:35:50.228 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.220+0000 7fdbbafc0740 10 client.17160 fetch_fsmap learned FSMap version 34 2024-08-31T05:35:50.228 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.220+0000 7fdbbafc0740 1 -- 172.21.15.5:0/1658376719 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x556991f4f360 con 0x556991b024d0 2024-08-31T05:35:50.228 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.221+0000 7fdb957fa640 1 -- 172.21.15.5:0/1658376719 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdba0012110 con 0x556991b024d0 2024-08-31T05:35:50.228 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.221+0000 7fdb957fa640 1 -- 172.21.15.5:0/1658376719 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fdba4043020 con 0x556991b024d0 2024-08-31T05:35:50.228 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.221+0000 7fdbbafc0740 10 client.17160 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:35:50.229 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.221+0000 7fdbbafc0740 10 client.17160 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:35:50.229 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.221+0000 7fdbbafc0740 20 client.17160 populate_metadata read hostname 'smithi005' 2024-08-31T05:35:50.229 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.221+0000 7fdbbafc0740 1 --2- 172.21.15.5:0/1658376719 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x556991b231b0 0x556991f51760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:35:50.229 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.221+0000 7fdbbafc0740 4 client.17160 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:35:50.229 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.221+0000 7fdbbafc0740 1 -- 172.21.15.5:0/1658376719 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556991e399f0 con 0x556991b231b0 2024-08-31T05:35:50.229 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.221+0000 7fdbb15ee640 1 --2- 172.21.15.5:0/1658376719 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x556991b231b0 0x556991f51760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:35:50.229 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.221+0000 7fdbb15ee640 1 --2- 172.21.15.5:0/1658376719 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x556991b231b0 0x556991f51760 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a6ca7045ce14a36 server_cookie=135bd5171696b328 in_seq=0 out_seq=0 2024-08-31T05:35:50.229 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.221+0000 7fdb957fa640 10 client.17160 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:35:50.235 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.232+0000 7fdb957fa640 1 -- 172.21.15.5:0/1658376719 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556991e399f0 con 0x556991b231b0 2024-08-31T05:35:50.235 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.232+0000 7fdb957fa640 10 client.17160 handle_command_reply: tid=0 2024-08-31T05:35:50.235 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.232+0000 7fdbbafc0740 1 client.17160 shutdown 2024-08-31T05:35:50.235 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.232+0000 7fdbbafc0740 1 -- 172.21.15.5:0/1658376719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556991b024d0 msgr2=0x556991ed6ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:50.235 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.232+0000 7fdbbafc0740 1 --2- 172.21.15.5:0/1658376719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556991b024d0 0x556991ed6ea0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fdba4009bf0 tx=0x7fdba402a8c0 comp rx=0 tx=0).stop 2024-08-31T05:35:50.235 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.232+0000 7fdbbafc0740 1 -- 172.21.15.5:0/1658376719 shutdown_connections 2024-08-31T05:35:50.235 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.232+0000 7fdbbafc0740 1 --2- 172.21.15.5:0/1658376719 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x556991b231b0 0x556991f51760 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:50.236 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.232+0000 7fdbbafc0740 1 --2- 172.21.15.5:0/1658376719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556991b024d0 0x556991ed6ea0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:50.236 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.232+0000 7fdbbafc0740 1 --2- 172.21.15.5:0/1658376719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556991afa2f0 0x556991ed6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:50.236 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.233+0000 7fdb957fa640 0 client.17160 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:35:50.236 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.233+0000 7fdbbafc0740 1 --2- 172.21.15.5:0/1658376719 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556991ae1d80 0x556991ed6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:50.236 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.233+0000 7fdbbafc0740 1 -- 172.21.15.5:0/1658376719 >> 172.21.15.5:0/1658376719 conn(0x556991b17300 msgr2=0x556991ec7d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:50.236 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.233+0000 7fdbbafc0740 1 -- 172.21.15.5:0/1658376719 shutdown_connections 2024-08-31T05:35:50.236 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.233+0000 7fdbbafc0740 1 -- 172.21.15.5:0/1658376719 wait complete. 2024-08-31T05:35:50.236 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.233+0000 7fdbbafc0740 20 client.17160 trim_cache size 0 max 16384 2024-08-31T05:35:50.237 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:35:50.237 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:35:50.237 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:35:50.237 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:35:50.238 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.233+0000 7fdbb4053640 1 -- 172.21.15.5:0/910558894 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fdb980b4ca0 msgr2=0x7fdb980b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:50.238 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.233+0000 7fdbb4053640 1 --2- 172.21.15.5:0/910558894 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fdb980b4ca0 0x7fdb980b71b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fdba80e3050 tx=0x7fdba8000bc0 comp rx=0 tx=0).stop 2024-08-31T05:35:50.238 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.233+0000 7fdbb4053640 1 -- 172.21.15.5:0/910558894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbac102770 msgr2=0x7fdbac19b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:35:50.238 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.233+0000 7fdbb4053640 1 --2- 172.21.15.5:0/910558894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbac102770 0x7fdbac19b0b0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fdba800e9f0 tx=0x7fdba800eeb0 comp rx=0 tx=0).stop 2024-08-31T05:35:50.238 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.233+0000 7fdbb4053640 1 -- 172.21.15.5:0/910558894 shutdown_connections 2024-08-31T05:35:50.239 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.233+0000 7fdbb4053640 1 --2- 172.21.15.5:0/910558894 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fdb980b4ca0 0x7fdb980b71b0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:50.239 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.233+0000 7fdbb4053640 1 --2- 172.21.15.5:0/910558894 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdbac1089f0 0x7fdbac19bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:50.239 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.233+0000 7fdbb4053640 1 --2- 172.21.15.5:0/910558894 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdbac1080a0 0x7fdbac19b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:50.239 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.233+0000 7fdbb4053640 1 --2- 172.21.15.5:0/910558894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdbac102770 0x7fdbac19b0b0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:35:50.239 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.233+0000 7fdbb4053640 1 -- 172.21.15.5:0/910558894 >> 172.21.15.5:0/910558894 conn(0x7fdbac07a4b0 msgr2=0x7fdbac104110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:35:50.239 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.233+0000 7fdbb4053640 1 -- 172.21.15.5:0/910558894 shutdown_connections 2024-08-31T05:35:50.239 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:35:50.233+0000 7fdbb4053640 1 -- 172.21.15.5:0/910558894 wait complete. 2024-08-31T05:35:50.920 INFO:tasks.workunit.client.0.smithi005.stdout: 1 649516 11.92 MB/sec execute 158 sec latency 94.626 ms 2024-08-31T05:35:51.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:35:51 smithi005 ceph-mon[18602]: pgmap v521: 129 pgs: 129 active+clean; 354 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.2 MiB/s wr, 234 op/s 2024-08-31T05:35:51.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:35:51 smithi070 ceph-mon[22316]: pgmap v521: 129 pgs: 129 active+clean; 354 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.2 MiB/s wr, 234 op/s 2024-08-31T05:35:51.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:35:51 smithi050 ceph-mon[22146]: pgmap v521: 129 pgs: 129 active+clean; 354 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.2 MiB/s wr, 234 op/s 2024-08-31T05:35:51.920 INFO:tasks.workunit.client.0.smithi005.stdout: 1 651410 11.92 MB/sec execute 159 sec latency 20.818 ms 2024-08-31T05:35:52.920 INFO:tasks.workunit.client.0.smithi005.stdout: 1 653832 11.93 MB/sec execute 160 sec latency 15.369 ms 2024-08-31T05:35:53.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:35:53 smithi005 ceph-mon[18602]: pgmap v522: 129 pgs: 129 active+clean; 358 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 188 op/s 2024-08-31T05:35:53.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:35:53 smithi070 ceph-mon[22316]: pgmap v522: 129 pgs: 129 active+clean; 358 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 188 op/s 2024-08-31T05:35:53.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:35:53 smithi050 ceph-mon[22146]: pgmap v522: 129 pgs: 129 active+clean; 358 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 188 op/s 2024-08-31T05:35:53.920 INFO:tasks.workunit.client.0.smithi005.stdout: 1 655829 11.90 MB/sec execute 161 sec latency 23.403 ms 2024-08-31T05:35:54.920 INFO:tasks.workunit.client.0.smithi005.stdout: 1 657885 11.91 MB/sec execute 162 sec latency 12.637 ms 2024-08-31T05:35:55.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:35:55 smithi005 ceph-mon[18602]: pgmap v523: 129 pgs: 129 active+clean; 361 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 195 op/s 2024-08-31T05:35:55.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:35:55 smithi070 ceph-mon[22316]: pgmap v523: 129 pgs: 129 active+clean; 361 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 195 op/s 2024-08-31T05:35:55.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:35:55 smithi050 ceph-mon[22146]: pgmap v523: 129 pgs: 129 active+clean; 361 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 195 op/s 2024-08-31T05:35:55.920 INFO:tasks.workunit.client.0.smithi005.stdout: 1 659742 11.90 MB/sec execute 163 sec latency 106.678 ms 2024-08-31T05:35:56.920 INFO:tasks.workunit.client.0.smithi005.stdout: 1 661751 11.89 MB/sec execute 164 sec latency 16.471 ms 2024-08-31T05:35:57.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:35:57 smithi005 ceph-mon[18602]: pgmap v524: 129 pgs: 129 active+clean; 361 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.1 MiB/s wr, 219 op/s 2024-08-31T05:35:57.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:35:57 smithi070 ceph-mon[22316]: pgmap v524: 129 pgs: 129 active+clean; 361 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.1 MiB/s wr, 219 op/s 2024-08-31T05:35:57.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:35:57 smithi050 ceph-mon[22146]: pgmap v524: 129 pgs: 129 active+clean; 361 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.1 MiB/s wr, 219 op/s 2024-08-31T05:35:57.920 INFO:tasks.workunit.client.0.smithi005.stdout: 1 664285 11.91 MB/sec execute 165 sec latency 19.893 ms 2024-08-31T05:35:58.920 INFO:tasks.workunit.client.0.smithi005.stdout: 1 665807 11.88 MB/sec execute 166 sec latency 17.622 ms 2024-08-31T05:35:59.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:35:59 smithi005 ceph-mon[18602]: pgmap v525: 129 pgs: 129 active+clean; 362 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 167 op/s 2024-08-31T05:35:59.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:35:59 smithi070 ceph-mon[22316]: pgmap v525: 129 pgs: 129 active+clean; 362 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 167 op/s 2024-08-31T05:35:59.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:35:59 smithi050 ceph-mon[22146]: pgmap v525: 129 pgs: 129 active+clean; 362 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 167 op/s 2024-08-31T05:35:59.920 INFO:tasks.workunit.client.0.smithi005.stdout: 1 668216 11.89 MB/sec execute 167 sec latency 15.403 ms 2024-08-31T05:36:00.920 INFO:tasks.workunit.client.0.smithi005.stdout: 1 669602 11.85 MB/sec execute 168 sec latency 120.056 ms 2024-08-31T05:36:01.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:01 smithi005 ceph-mon[18602]: pgmap v526: 129 pgs: 129 active+clean; 367 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.3 MiB/s wr, 227 op/s 2024-08-31T05:36:01.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:01 smithi070 ceph-mon[22316]: pgmap v526: 129 pgs: 129 active+clean; 367 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.3 MiB/s wr, 227 op/s 2024-08-31T05:36:01.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:01 smithi050 ceph-mon[22146]: pgmap v526: 129 pgs: 129 active+clean; 367 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.3 MiB/s wr, 227 op/s 2024-08-31T05:36:01.920 INFO:tasks.workunit.client.0.smithi005.stdout: 1 670796 11.83 MB/sec execute 169 sec latency 45.736 ms 2024-08-31T05:36:02.921 INFO:tasks.workunit.client.0.smithi005.stdout: 1 672682 11.82 MB/sec execute 170 sec latency 14.174 ms 2024-08-31T05:36:03.340 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.337+0000 7f0621bad640 1 -- 172.21.15.5:0/2475345132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f061c102760 msgr2=0x7f061c102b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:03.340 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.337+0000 7f0621bad640 1 --2- 172.21.15.5:0/2475345132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f061c102760 0x7f061c102b70 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f060c009900 tx=0x7f060c02a410 comp rx=0 tx=0).stop 2024-08-31T05:36:03.340 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.337+0000 7f0621bad640 1 -- 172.21.15.5:0/2475345132 shutdown_connections 2024-08-31T05:36:03.340 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.337+0000 7f0621bad640 1 --2- 172.21.15.5:0/2475345132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f061c1089e0 0x7f061c10f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:03.340 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.337+0000 7f0621bad640 1 --2- 172.21.15.5:0/2475345132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f061c108090 0x7f061c1084a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:03.340 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.337+0000 7f0621bad640 1 --2- 172.21.15.5:0/2475345132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f061c102760 0x7f061c102b70 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:03.340 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.337+0000 7f0621bad640 1 -- 172.21.15.5:0/2475345132 >> 172.21.15.5:0/2475345132 conn(0x7f061c0fe160 msgr2=0x7f061c1005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:03.340 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.337+0000 7f0621bad640 1 -- 172.21.15.5:0/2475345132 shutdown_connections 2024-08-31T05:36:03.340 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.337+0000 7f0621bad640 1 -- 172.21.15.5:0/2475345132 wait complete. 2024-08-31T05:36:03.340 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.338+0000 7f0621bad640 1 Processor -- start 2024-08-31T05:36:03.340 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.338+0000 7f0621bad640 1 -- start start 2024-08-31T05:36:03.342 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.338+0000 7f0621bad640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f061c102760 0x7f061c19a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:03.343 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.338+0000 7f0621bad640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f061c108090 0x7f061c19a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:03.343 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.338+0000 7f0621bad640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f061c1089e0 0x7f061c19fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:03.343 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.338+0000 7f0621bad640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f061c112690 con 0x7f061c108090 2024-08-31T05:36:03.343 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.338+0000 7f0621bad640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f061c112510 con 0x7f061c102760 2024-08-31T05:36:03.343 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.338+0000 7f0621bad640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f061c112810 con 0x7f061c1089e0 2024-08-31T05:36:03.343 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.338+0000 7f0612ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f061c108090 0x7f061c19a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:03.343 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.339+0000 7f0612ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f061c108090 0x7f061c19a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34622/0 (socket says 172.21.15.5:34622) 2024-08-31T05:36:03.343 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.339+0000 7f0612ffd640 1 -- 172.21.15.5:0/2021862700 learned_addr learned my addr 172.21.15.5:0/2021862700 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:03.343 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.339+0000 7f061b7fe640 1 --2- 172.21.15.5:0/2021862700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f061c102760 0x7f061c19a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:03.343 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.339+0000 7f061bfff640 1 --2- 172.21.15.5:0/2021862700 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f061c1089e0 0x7f061c19fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:03.343 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.339+0000 7f0612ffd640 1 -- 172.21.15.5:0/2021862700 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f061c1089e0 msgr2=0x7f061c19fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:03.343 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.339+0000 7f0612ffd640 1 --2- 172.21.15.5:0/2021862700 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f061c1089e0 0x7f061c19fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:03.343 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.339+0000 7f0612ffd640 1 -- 172.21.15.5:0/2021862700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f061c102760 msgr2=0x7f061c19a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:03.344 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.339+0000 7f0612ffd640 1 --2- 172.21.15.5:0/2021862700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f061c102760 0x7f061c19a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:03.344 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.339+0000 7f0612ffd640 1 -- 172.21.15.5:0/2021862700 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f061c1a0110 con 0x7f061c108090 2024-08-31T05:36:03.344 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.339+0000 7f061b7fe640 1 --2- 172.21.15.5:0/2021862700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f061c102760 0x7f061c19a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:36:03.344 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.339+0000 7f0612ffd640 1 --2- 172.21.15.5:0/2021862700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f061c108090 0x7f061c19a780 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f060400e970 tx=0x7f060400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:03.344 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.339+0000 7f06197fa640 1 -- 172.21.15.5:0/2021862700 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f060400ccc0 con 0x7f061c108090 2024-08-31T05:36:03.344 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.339+0000 7f0621bad640 1 -- 172.21.15.5:0/2021862700 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f061c1a0400 con 0x7f061c108090 2024-08-31T05:36:03.344 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.339+0000 7f06197fa640 1 -- 172.21.15.5:0/2021862700 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06040035f0 con 0x7f061c108090 2024-08-31T05:36:03.344 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.339+0000 7f06197fa640 1 -- 172.21.15.5:0/2021862700 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f060400ce60 con 0x7f061c108090 2024-08-31T05:36:03.344 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.339+0000 7f0621bad640 1 -- 172.21.15.5:0/2021862700 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f061c1a6b90 con 0x7f061c108090 2024-08-31T05:36:03.345 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.343+0000 7f0628bfd740 1 Processor -- start 2024-08-31T05:36:03.345 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.343+0000 7f0628bfd740 1 -- start start 2024-08-31T05:36:03.347 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.343+0000 7f0628bfd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56323c4d81b0 0x56323c87bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:03.347 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.343+0000 7f0628bfd740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56323c4af2f0 0x56323c87c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:03.347 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.343+0000 7f0628bfd740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56323c4b74d0 0x56323c87c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:03.347 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.343+0000 7f0628bfd740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56323c7f1000 con 0x56323c4b74d0 2024-08-31T05:36:03.347 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.343+0000 7f0628bfd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56323c7e0590 con 0x56323c4d81b0 2024-08-31T05:36:03.347 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.343+0000 7f0628bfd740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56323c7e4540 con 0x56323c4af2f0 2024-08-31T05:36:03.347 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.343+0000 7f06197fa640 1 -- 172.21.15.5:0/2021862700 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f0604003aa0 con 0x7f061c108090 2024-08-31T05:36:03.347 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.344+0000 7f061bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56323c4d81b0 0x56323c87bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:03.347 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.344+0000 7f061bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56323c4d81b0 0x56323c87bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:36328/0 (socket says 172.21.15.5:36328) 2024-08-31T05:36:03.347 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.344+0000 7f061b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56323c4af2f0 0x56323c87c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:03.347 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.344+0000 7f061bfff640 1 -- 172.21.15.5:0/1524147681 learned_addr learned my addr 172.21.15.5:0/1524147681 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:03.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.344+0000 7f0612ffd640 1 --2- 172.21.15.5:0/1524147681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56323c4b74d0 0x56323c87c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:03.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.344+0000 7f061bfff640 1 -- 172.21.15.5:0/1524147681 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56323c4af2f0 msgr2=0x56323c87c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:03.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.344+0000 7f061bfff640 1 --2- 172.21.15.5:0/1524147681 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56323c4af2f0 0x56323c87c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:03.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.344+0000 7f061bfff640 1 -- 172.21.15.5:0/1524147681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56323c4b74d0 msgr2=0x56323c87c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:03.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.344+0000 7f061bfff640 1 --2- 172.21.15.5:0/1524147681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56323c4b74d0 0x56323c87c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:03.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.344+0000 7f061bfff640 1 -- 172.21.15.5:0/1524147681 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56323c543790 con 0x56323c4d81b0 2024-08-31T05:36:03.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.344+0000 7f061bfff640 1 --2- 172.21.15.5:0/1524147681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56323c4d81b0 0x56323c87bac0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0614011470 tx=0x7f0614011930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67acb51858995386 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:03.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.344+0000 7f0611ffb640 1 -- 172.21.15.5:0/1524147681 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f061401e070 con 0x56323c4d81b0 2024-08-31T05:36:03.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.344+0000 7f0611ffb640 1 -- 172.21.15.5:0/1524147681 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0614003c30 con 0x56323c4d81b0 2024-08-31T05:36:03.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.344+0000 7f0611ffb640 1 -- 172.21.15.5:0/1524147681 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f061400f920 con 0x56323c4d81b0 2024-08-31T05:36:03.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.344+0000 7f06197fa640 1 --2- 172.21.15.5:0/2021862700 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f06080b4ca0 0x7f06080b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:03.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.345+0000 7f061b7fe640 1 --2- 172.21.15.5:0/2021862700 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f06080b4ca0 0x7f06080b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:03.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.345+0000 7f06197fa640 1 -- 172.21.15.5:0/2021862700 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f06040e5b60 con 0x7f061c108090 2024-08-31T05:36:03.352 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.345+0000 7f0628bfd740 1 -- 172.21.15.5:0/1524147681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56323c4d81b0 msgr2=0x56323c87bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:03.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.345+0000 7f061b7fe640 1 --2- 172.21.15.5:0/2021862700 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f06080b4ca0 0x7f06080b71b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f060c031440 tx=0x7f060c032ed0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:03.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.345+0000 7f0628bfd740 1 --2- 172.21.15.5:0/1524147681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56323c4d81b0 0x56323c87bac0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0614011470 tx=0x7f0614011930 comp rx=0 tx=0).stop 2024-08-31T05:36:03.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.345+0000 7f0628bfd740 1 -- 172.21.15.5:0/1524147681 shutdown_connections 2024-08-31T05:36:03.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.345+0000 7f0628bfd740 1 --2- 172.21.15.5:0/1524147681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56323c4b74d0 0x56323c87c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:03.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.345+0000 7f0628bfd740 1 --2- 172.21.15.5:0/1524147681 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56323c4af2f0 0x56323c87c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:03.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.345+0000 7f0628bfd740 1 --2- 172.21.15.5:0/1524147681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56323c4d81b0 0x56323c87bac0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:03.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.345+0000 7f0628bfd740 1 -- 172.21.15.5:0/1524147681 >> 172.21.15.5:0/1524147681 conn(0x56323c4cc300 msgr2=0x56323c8799b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:03.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.345+0000 7f0628bfd740 1 -- 172.21.15.5:0/1524147681 shutdown_connections 2024-08-31T05:36:03.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.345+0000 7f0628bfd740 1 -- 172.21.15.5:0/1524147681 wait complete. 2024-08-31T05:36:03.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.346+0000 7f0628bfd740 1 -- start start 2024-08-31T05:36:03.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.346+0000 7f0628bfd740 1 Processor -- start 2024-08-31T05:36:03.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.346+0000 7f0628bfd740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56323c4af2f0 0x56323c887670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:03.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.346+0000 7f0628bfd740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56323c4b74d0 0x56323c887bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:03.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.346+0000 7f0628bfd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56323c4d81b0 0x56323c893590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:03.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.346+0000 7f0628bfd740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56323c719ab0 con 0x56323c4b74d0 2024-08-31T05:36:03.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.346+0000 7f0628bfd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56323c767680 con 0x56323c4d81b0 2024-08-31T05:36:03.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.346+0000 7f0628bfd740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56323c88a240 con 0x56323c4af2f0 2024-08-31T05:36:03.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.346+0000 7f0628bfd740 10 client.0 _ll_register_callbacks cb 0x56323c4efa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:36:03.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.346+0000 7f0612ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56323c4b74d0 0x56323c887bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:03.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.346+0000 7f0612ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56323c4b74d0 0x56323c887bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34628/0 (socket says 172.21.15.5:34628) 2024-08-31T05:36:03.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.346+0000 7f0612ffd640 1 -- 172.21.15.5:0/1189908988 learned_addr learned my addr 172.21.15.5:0/1189908988 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:03.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.346+0000 7f061b7fe640 1 --2- 172.21.15.5:0/1189908988 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56323c4af2f0 0x56323c887670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:03.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.347+0000 7f061bfff640 1 --2- 172.21.15.5:0/1189908988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56323c4d81b0 0x56323c893590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:03.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.347+0000 7f0612ffd640 1 -- 172.21.15.5:0/1189908988 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56323c4af2f0 msgr2=0x56323c887670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:03.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.347+0000 7f0612ffd640 1 --2- 172.21.15.5:0/1189908988 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56323c4af2f0 0x56323c887670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:03.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.347+0000 7f0612ffd640 1 -- 172.21.15.5:0/1189908988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56323c4d81b0 msgr2=0x56323c893590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:03.355 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.347+0000 7f0612ffd640 1 --2- 172.21.15.5:0/1189908988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56323c4d81b0 0x56323c893590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:03.355 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.347+0000 7f0612ffd640 1 -- 172.21.15.5:0/1189908988 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56323c5bc620 con 0x56323c4b74d0 2024-08-31T05:36:03.355 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.347+0000 7f0612ffd640 1 --2- 172.21.15.5:0/1189908988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56323c4b74d0 0x56323c887bb0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f060400c6a0 tx=0x7f06040abca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a3306870f184abb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:03.355 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.347+0000 7f05faffd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:36:03.355 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.347+0000 7f05faffd640 1 -- 172.21.15.5:0/1189908988 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06040ab9e0 con 0x56323c4b74d0 2024-08-31T05:36:03.355 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.347+0000 7f05faffd640 1 -- 172.21.15.5:0/1189908988 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f06040b4f70 con 0x56323c4b74d0 2024-08-31T05:36:03.355 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.347+0000 7f0628bfd740 1 -- 172.21.15.5:0/1189908988 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0614003c30 con 0x56323c4b74d0 2024-08-31T05:36:03.355 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.347+0000 7f05faffd640 1 -- 172.21.15.5:0/1189908988 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f06040ac5d0 con 0x56323c4b74d0 2024-08-31T05:36:03.355 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.347+0000 7f0628bfd740 10 client.17172 fetch_fsmap learned FSMap version 34 2024-08-31T05:36:03.355 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.347+0000 7f0628bfd740 1 -- 172.21.15.5:0/1189908988 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56323c896310 con 0x56323c4b74d0 2024-08-31T05:36:03.355 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.347+0000 7f05faffd640 1 -- 172.21.15.5:0/1189908988 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0614003c30 con 0x56323c4b74d0 2024-08-31T05:36:03.355 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.348+0000 7f05faffd640 1 -- 172.21.15.5:0/1189908988 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f06040b0060 con 0x56323c4b74d0 2024-08-31T05:36:03.355 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.348+0000 7f0628bfd740 10 client.17172 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:36:03.355 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.348+0000 7f0628bfd740 10 client.17172 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:36:03.355 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.348+0000 7f0628bfd740 20 client.17172 populate_metadata read hostname 'smithi005' 2024-08-31T05:36:03.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.348+0000 7f0628bfd740 1 --2- 172.21.15.5:0/1189908988 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56323c496d80 0x56323c899850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:03.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.348+0000 7f0628bfd740 4 client.17172 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:36:03.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.348+0000 7f0628bfd740 1 -- 172.21.15.5:0/1189908988 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56323c7f2f50 con 0x56323c496d80 2024-08-31T05:36:03.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.348+0000 7f061b7fe640 1 --2- 172.21.15.5:0/1189908988 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56323c496d80 0x56323c899850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:03.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.348+0000 7f05faffd640 10 client.17172 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:36:03.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.348+0000 7f061b7fe640 1 --2- 172.21.15.5:0/1189908988 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56323c496d80 0x56323c899850 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2ea1cbee4658575 server_cookie=8e7092274756d392 in_seq=0 out_seq=0 2024-08-31T05:36:03.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.349+0000 7f05faffd640 1 -- 172.21.15.5:0/1189908988 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56323c7f2f50 con 0x56323c496d80 2024-08-31T05:36:03.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.349+0000 7f05faffd640 10 client.17172 handle_command_reply: tid=0 2024-08-31T05:36:03.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.349+0000 7f0628bfd740 1 client.17172 shutdown 2024-08-31T05:36:03.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.349+0000 7f0628bfd740 1 -- 172.21.15.5:0/1189908988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56323c4b74d0 msgr2=0x56323c887bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:03.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.349+0000 7f0628bfd740 1 --2- 172.21.15.5:0/1189908988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56323c4b74d0 0x56323c887bb0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f060400c6a0 tx=0x7f06040abca0 comp rx=0 tx=0).stop 2024-08-31T05:36:03.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.349+0000 7f0628bfd740 1 -- 172.21.15.5:0/1189908988 shutdown_connections 2024-08-31T05:36:03.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.349+0000 7f0628bfd740 1 --2- 172.21.15.5:0/1189908988 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56323c496d80 0x56323c899850 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:03.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.349+0000 7f0628bfd740 1 --2- 172.21.15.5:0/1189908988 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56323c4d81b0 0x56323c893590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:03.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.349+0000 7f0628bfd740 1 --2- 172.21.15.5:0/1189908988 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56323c4b74d0 0x56323c887bb0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:03.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.349+0000 7f0628bfd740 1 --2- 172.21.15.5:0/1189908988 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56323c4af2f0 0x56323c887670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:03.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.349+0000 7f05faffd640 0 client.17172 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:36:03.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.349+0000 7f0628bfd740 1 -- 172.21.15.5:0/1189908988 >> 172.21.15.5:0/1189908988 conn(0x56323c4cc300 msgr2=0x56323c87caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:03.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.349+0000 7f0628bfd740 1 -- 172.21.15.5:0/1189908988 shutdown_connections 2024-08-31T05:36:03.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.349+0000 7f0628bfd740 1 -- 172.21.15.5:0/1189908988 wait complete. 2024-08-31T05:36:03.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.349+0000 7f0628bfd740 20 client.17172 trim_cache size 0 max 16384 2024-08-31T05:36:03.373 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.365+0000 7f0628bfd740 1 Processor -- start 2024-08-31T05:36:03.374 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.365+0000 7f0628bfd740 1 -- start start 2024-08-31T05:36:03.374 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.365+0000 7f0628bfd740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56323c496d80 0x56323c881300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:03.374 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.365+0000 7f0628bfd740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56323c4af2f0 0x56323c886cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:03.374 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.365+0000 7f0628bfd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56323c4b74d0 0x56323c8792f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:03.374 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.365+0000 7f0628bfd740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f061c1b0c10 con 0x56323c4af2f0 2024-08-31T05:36:03.374 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.365+0000 7f0628bfd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f061c1b2750 con 0x56323c4b74d0 2024-08-31T05:36:03.374 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.365+0000 7f0628bfd740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f061c1b12e0 con 0x56323c496d80 2024-08-31T05:36:03.374 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.365+0000 7f0612ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56323c4af2f0 0x56323c886cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:03.374 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.365+0000 7f0612ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56323c4af2f0 0x56323c886cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34644/0 (socket says 172.21.15.5:34644) 2024-08-31T05:36:03.374 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.365+0000 7f061bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56323c4b74d0 0x56323c8792f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:03.375 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.365+0000 7f0612ffd640 1 -- 172.21.15.5:0/987967090 learned_addr learned my addr 172.21.15.5:0/987967090 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:03.375 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.365+0000 7f061b7fe640 1 --2- 172.21.15.5:0/987967090 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56323c496d80 0x56323c881300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:03.375 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.366+0000 7f061bfff640 1 -- 172.21.15.5:0/987967090 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56323c496d80 msgr2=0x56323c881300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:03.375 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.366+0000 7f061bfff640 1 --2- 172.21.15.5:0/987967090 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56323c496d80 0x56323c881300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:03.375 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.366+0000 7f061bfff640 1 -- 172.21.15.5:0/987967090 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56323c4af2f0 msgr2=0x56323c886cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:03.375 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.366+0000 7f061bfff640 1 --2- 172.21.15.5:0/987967090 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56323c4af2f0 0x56323c886cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:03.375 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.366+0000 7f061bfff640 1 -- 172.21.15.5:0/987967090 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56323c882f90 con 0x56323c4b74d0 2024-08-31T05:36:03.375 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.366+0000 7f0612ffd640 1 --2- 172.21.15.5:0/987967090 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56323c4af2f0 0x56323c886cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:36:03.375 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.366+0000 7f061bfff640 1 --2- 172.21.15.5:0/987967090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56323c4b74d0 0x56323c8792f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f061401c040 tx=0x7f0614009a90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c78629e3543aa1d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:03.375 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.366+0000 7f06117fa640 1 -- 172.21.15.5:0/987967090 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f061401e040 con 0x56323c4b74d0 2024-08-31T05:36:03.375 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.366+0000 7f06117fa640 1 -- 172.21.15.5:0/987967090 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0614003d30 con 0x56323c4b74d0 2024-08-31T05:36:03.375 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.366+0000 7f06117fa640 1 -- 172.21.15.5:0/987967090 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f061400f540 con 0x56323c4b74d0 2024-08-31T05:36:03.376 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.367+0000 7f0628bfd740 1 -- 172.21.15.5:0/987967090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56323c4b74d0 msgr2=0x56323c8792f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:03.376 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.367+0000 7f0628bfd740 1 --2- 172.21.15.5:0/987967090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56323c4b74d0 0x56323c8792f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f061401c040 tx=0x7f0614009a90 comp rx=0 tx=0).stop 2024-08-31T05:36:03.376 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.367+0000 7f0628bfd740 1 -- 172.21.15.5:0/987967090 shutdown_connections 2024-08-31T05:36:03.376 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.367+0000 7f0628bfd740 1 --2- 172.21.15.5:0/987967090 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56323c4b74d0 0x56323c8792f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:03.376 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.367+0000 7f0628bfd740 1 --2- 172.21.15.5:0/987967090 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56323c4af2f0 0x56323c886cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:03.376 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.367+0000 7f0628bfd740 1 --2- 172.21.15.5:0/987967090 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56323c496d80 0x56323c881300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:03.376 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.367+0000 7f0628bfd740 1 -- 172.21.15.5:0/987967090 >> 172.21.15.5:0/987967090 conn(0x56323c4cc300 msgr2=0x56323c880bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:03.376 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.367+0000 7f0628bfd740 1 -- 172.21.15.5:0/987967090 shutdown_connections 2024-08-31T05:36:03.376 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.367+0000 7f0628bfd740 1 -- 172.21.15.5:0/987967090 wait complete. 2024-08-31T05:36:03.376 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.367+0000 7f0628bfd740 1 -- start start 2024-08-31T05:36:03.376 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.368+0000 7f0628bfd740 1 Processor -- start 2024-08-31T05:36:03.376 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.368+0000 7f0628bfd740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56323c496d80 0x56323c88bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:03.376 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.368+0000 7f0628bfd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56323c4af2f0 0x56323c88c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.368+0000 7f0628bfd740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56323c4b74d0 0x56323c8fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.368+0000 7f0628bfd740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f061c1b2080 con 0x56323c496d80 2024-08-31T05:36:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.368+0000 7f0628bfd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f061c1b19b0 con 0x56323c4af2f0 2024-08-31T05:36:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.368+0000 7f0628bfd740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f061c1aebf0 con 0x56323c4b74d0 2024-08-31T05:36:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.368+0000 7f0628bfd740 10 client.0 _ll_register_callbacks cb 0x7f06040a7d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:36:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.368+0000 7f061b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56323c496d80 0x56323c88bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.368+0000 7f061b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56323c496d80 0x56323c88bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34658/0 (socket says 172.21.15.5:34658) 2024-08-31T05:36:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.368+0000 7f061b7fe640 1 -- 172.21.15.5:0/3964960804 learned_addr learned my addr 172.21.15.5:0/3964960804 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.368+0000 7f061bfff640 1 --2- 172.21.15.5:0/3964960804 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56323c4b74d0 0x56323c8fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.368+0000 7f0612ffd640 1 --2- 172.21.15.5:0/3964960804 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56323c4af2f0 0x56323c88c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.368+0000 7f061b7fe640 1 -- 172.21.15.5:0/3964960804 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56323c4b74d0 msgr2=0x56323c8fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.368+0000 7f061b7fe640 1 --2- 172.21.15.5:0/3964960804 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56323c4b74d0 0x56323c8fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:03.378 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.368+0000 7f061b7fe640 1 -- 172.21.15.5:0/3964960804 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56323c4af2f0 msgr2=0x56323c88c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:03.378 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.368+0000 7f061b7fe640 1 --2- 172.21.15.5:0/3964960804 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56323c4af2f0 0x56323c88c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:03.378 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.368+0000 7f061b7fe640 1 -- 172.21.15.5:0/3964960804 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56323c8fd830 con 0x56323c496d80 2024-08-31T05:36:03.378 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.368+0000 7f061bfff640 1 --2- 172.21.15.5:0/3964960804 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56323c4b74d0 0x56323c8fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:36:03.378 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.369+0000 7f061b7fe640 1 --2- 172.21.15.5:0/3964960804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56323c496d80 0x56323c88bdb0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f060c02a930 tx=0x7f060c03f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ebdeadb12149723 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:03.378 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.369+0000 7f05faffd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:36:03.378 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.369+0000 7f05faffd640 1 -- 172.21.15.5:0/3964960804 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f060c035040 con 0x56323c496d80 2024-08-31T05:36:03.378 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.369+0000 7f05faffd640 1 -- 172.21.15.5:0/3964960804 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f060c005510 con 0x56323c496d80 2024-08-31T05:36:03.378 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.369+0000 7f0628bfd740 1 -- 172.21.15.5:0/3964960804 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0614003d30 con 0x56323c496d80 2024-08-31T05:36:03.378 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.369+0000 7f05faffd640 1 -- 172.21.15.5:0/3964960804 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f060c062050 con 0x56323c496d80 2024-08-31T05:36:03.378 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.369+0000 7f0628bfd740 10 client.17178 fetch_fsmap learned FSMap version 34 2024-08-31T05:36:03.378 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.369+0000 7f0628bfd740 1 -- 172.21.15.5:0/3964960804 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56323c904c10 con 0x56323c496d80 2024-08-31T05:36:03.378 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.369+0000 7f05faffd640 1 -- 172.21.15.5:0/3964960804 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0614003d30 con 0x56323c496d80 2024-08-31T05:36:03.378 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.369+0000 7f05faffd640 1 -- 172.21.15.5:0/3964960804 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f060c003890 con 0x56323c496d80 2024-08-31T05:36:03.379 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.369+0000 7f0628bfd740 10 client.17178 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:36:03.379 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.369+0000 7f0628bfd740 10 client.17178 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:36:03.379 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.370+0000 7f0628bfd740 20 client.17178 populate_metadata read hostname 'smithi005' 2024-08-31T05:36:03.379 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.370+0000 7f0628bfd740 1 --2- 172.21.15.5:0/3964960804 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56323c4d81b0 0x56323c907400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:03.379 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.370+0000 7f0628bfd740 4 client.17178 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:36:03.379 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.370+0000 7f0628bfd740 1 -- 172.21.15.5:0/3964960804 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56323c7ee9f0 con 0x56323c4d81b0 2024-08-31T05:36:03.379 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.370+0000 7f0612ffd640 1 --2- 172.21.15.5:0/3964960804 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56323c4d81b0 0x56323c907400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:03.379 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.370+0000 7f05faffd640 10 client.17178 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:36:03.379 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.370+0000 7f0612ffd640 1 --2- 172.21.15.5:0/3964960804 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56323c4d81b0 0x56323c907400 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ac75a6580e2d16e server_cookie=27fe9d5cda207e8f in_seq=0 out_seq=0 2024-08-31T05:36:03.385 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.382+0000 7f05faffd640 1 -- 172.21.15.5:0/3964960804 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56323c7ee9f0 con 0x56323c4d81b0 2024-08-31T05:36:03.385 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.382+0000 7f05faffd640 10 client.17178 handle_command_reply: tid=0 2024-08-31T05:36:03.385 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.382+0000 7f0628bfd740 1 client.17178 shutdown 2024-08-31T05:36:03.385 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.382+0000 7f0628bfd740 1 -- 172.21.15.5:0/3964960804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56323c496d80 msgr2=0x56323c88bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:03.385 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.382+0000 7f0628bfd740 1 --2- 172.21.15.5:0/3964960804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56323c496d80 0x56323c88bdb0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f060c02a930 tx=0x7f060c03f070 comp rx=0 tx=0).stop 2024-08-31T05:36:03.385 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.382+0000 7f0628bfd740 1 -- 172.21.15.5:0/3964960804 shutdown_connections 2024-08-31T05:36:03.385 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.382+0000 7f0628bfd740 1 --2- 172.21.15.5:0/3964960804 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56323c4d81b0 0x56323c907400 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:03.385 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.382+0000 7f0628bfd740 1 --2- 172.21.15.5:0/3964960804 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56323c4b74d0 0x56323c8fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:03.385 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.382+0000 7f0628bfd740 1 --2- 172.21.15.5:0/3964960804 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56323c4af2f0 0x56323c88c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.382+0000 7f05faffd640 0 client.17178 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:36:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.382+0000 7f0628bfd740 1 --2- 172.21.15.5:0/3964960804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56323c496d80 0x56323c88bdb0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.382+0000 7f0628bfd740 1 -- 172.21.15.5:0/3964960804 >> 172.21.15.5:0/3964960804 conn(0x56323c4cc300 msgr2=0x56323c888910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.382+0000 7f0628bfd740 1 -- 172.21.15.5:0/3964960804 shutdown_connections 2024-08-31T05:36:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.382+0000 7f0628bfd740 1 -- 172.21.15.5:0/3964960804 wait complete. 2024-08-31T05:36:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.383+0000 7f0628bfd740 20 client.17178 trim_cache size 0 max 16384 2024-08-31T05:36:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:36:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:36:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:36:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:36:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.383+0000 7f0621bad640 1 -- 172.21.15.5:0/2021862700 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f06080b4ca0 msgr2=0x7f06080b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.383+0000 7f0621bad640 1 --2- 172.21.15.5:0/2021862700 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f06080b4ca0 0x7f06080b71b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f060c031440 tx=0x7f060c032ed0 comp rx=0 tx=0).stop 2024-08-31T05:36:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.383+0000 7f0621bad640 1 -- 172.21.15.5:0/2021862700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f061c108090 msgr2=0x7f061c19a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.383+0000 7f0621bad640 1 --2- 172.21.15.5:0/2021862700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f061c108090 0x7f061c19a780 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f060400e970 tx=0x7f060400ed70 comp rx=0 tx=0).stop 2024-08-31T05:36:03.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.383+0000 7f0621bad640 1 -- 172.21.15.5:0/2021862700 shutdown_connections 2024-08-31T05:36:03.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.383+0000 7f0621bad640 1 --2- 172.21.15.5:0/2021862700 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f06080b4ca0 0x7f06080b71b0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:03.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.383+0000 7f0621bad640 1 --2- 172.21.15.5:0/2021862700 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f061c1089e0 0x7f061c19fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:03.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.383+0000 7f0621bad640 1 --2- 172.21.15.5:0/2021862700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f061c108090 0x7f061c19a780 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:03.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.383+0000 7f0621bad640 1 --2- 172.21.15.5:0/2021862700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f061c102760 0x7f061c19a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:03.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.383+0000 7f0621bad640 1 -- 172.21.15.5:0/2021862700 >> 172.21.15.5:0/2021862700 conn(0x7f061c0fe160 msgr2=0x7f061c06b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:03.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.383+0000 7f0621bad640 1 -- 172.21.15.5:0/2021862700 shutdown_connections 2024-08-31T05:36:03.388 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:03.383+0000 7f0621bad640 1 -- 172.21.15.5:0/2021862700 wait complete. 2024-08-31T05:36:03.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:03 smithi005 ceph-mon[18602]: pgmap v527: 129 pgs: 129 active+clean; 371 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.1 MiB/s wr, 207 op/s 2024-08-31T05:36:03.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:03 smithi070 ceph-mon[22316]: pgmap v527: 129 pgs: 129 active+clean; 371 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.1 MiB/s wr, 207 op/s 2024-08-31T05:36:03.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:03 smithi050 ceph-mon[22146]: pgmap v527: 129 pgs: 129 active+clean; 371 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.1 MiB/s wr, 207 op/s 2024-08-31T05:36:03.920 INFO:tasks.workunit.client.0.smithi005.stdout: 1 675146 11.83 MB/sec execute 171 sec latency 16.800 ms 2024-08-31T05:36:04.921 INFO:tasks.workunit.client.0.smithi005.stdout: 1 677015 11.80 MB/sec execute 172 sec latency 32.793 ms 2024-08-31T05:36:05.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:05 smithi005 ceph-mon[18602]: pgmap v528: 129 pgs: 129 active+clean; 371 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.9 MiB/s wr, 199 op/s 2024-08-31T05:36:05.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:05 smithi070 ceph-mon[22316]: pgmap v528: 129 pgs: 129 active+clean; 371 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.9 MiB/s wr, 199 op/s 2024-08-31T05:36:05.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:05 smithi050 ceph-mon[22146]: pgmap v528: 129 pgs: 129 active+clean; 371 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.9 MiB/s wr, 199 op/s 2024-08-31T05:36:05.920 INFO:tasks.workunit.client.0.smithi005.stdout: 1 678929 11.81 MB/sec execute 173 sec latency 65.183 ms 2024-08-31T05:36:06.921 INFO:tasks.workunit.client.0.smithi005.stdout: 1 681068 11.80 MB/sec execute 174 sec latency 31.558 ms 2024-08-31T05:36:07.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:07 smithi005 ceph-mon[18602]: pgmap v529: 129 pgs: 129 active+clean; 376 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.9 MiB/s wr, 265 op/s 2024-08-31T05:36:07.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:07 smithi070 ceph-mon[22316]: pgmap v529: 129 pgs: 129 active+clean; 376 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.9 MiB/s wr, 265 op/s 2024-08-31T05:36:07.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:07 smithi050 ceph-mon[22146]: pgmap v529: 129 pgs: 129 active+clean; 376 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.9 MiB/s wr, 265 op/s 2024-08-31T05:36:07.921 INFO:tasks.workunit.client.0.smithi005.stdout: 1 683258 11.81 MB/sec execute 175 sec latency 14.667 ms 2024-08-31T05:36:08.921 INFO:tasks.workunit.client.0.smithi005.stdout: 1 685679 11.82 MB/sec execute 176 sec latency 17.469 ms 2024-08-31T05:36:09.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:09 smithi005 ceph-mon[18602]: pgmap v530: 129 pgs: 129 active+clean; 376 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.4 MiB/s wr, 240 op/s 2024-08-31T05:36:09.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:09 smithi070 ceph-mon[22316]: pgmap v530: 129 pgs: 129 active+clean; 376 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.4 MiB/s wr, 240 op/s 2024-08-31T05:36:09.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:09 smithi050 ceph-mon[22146]: pgmap v530: 129 pgs: 129 active+clean; 376 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.4 MiB/s wr, 240 op/s 2024-08-31T05:36:09.921 INFO:tasks.workunit.client.0.smithi005.stdout: 1 687292 11.79 MB/sec execute 177 sec latency 54.480 ms 2024-08-31T05:36:10.921 INFO:tasks.workunit.client.0.smithi005.stdout: 1 689505 11.80 MB/sec execute 178 sec latency 47.944 ms 2024-08-31T05:36:11.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:11 smithi005 ceph-mon[18602]: pgmap v531: 129 pgs: 129 active+clean; 384 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.4 MiB/s wr, 309 op/s 2024-08-31T05:36:11.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:11 smithi070 ceph-mon[22316]: pgmap v531: 129 pgs: 129 active+clean; 384 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.4 MiB/s wr, 309 op/s 2024-08-31T05:36:11.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:11 smithi050 ceph-mon[22146]: pgmap v531: 129 pgs: 129 active+clean; 384 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.4 MiB/s wr, 309 op/s 2024-08-31T05:36:11.921 INFO:tasks.workunit.client.0.smithi005.stdout: 1 691434 11.78 MB/sec execute 179 sec latency 40.658 ms 2024-08-31T05:36:12.814 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T05:36:12.921 INFO:tasks.workunit.client.0.smithi005.stdout: 1 693550 11.78 MB/sec execute 180 sec latency 29.329 ms 2024-08-31T05:36:13.088 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:36:13.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:13 smithi005 ceph-mon[18602]: pgmap v532: 129 pgs: 129 active+clean; 384 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.5 MiB/s wr, 251 op/s 2024-08-31T05:36:13.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:13 smithi070 ceph-mon[22316]: pgmap v532: 129 pgs: 129 active+clean; 384 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.5 MiB/s wr, 251 op/s 2024-08-31T05:36:13.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:13 smithi050 ceph-mon[22146]: pgmap v532: 129 pgs: 129 active+clean; 384 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.5 MiB/s wr, 251 op/s 2024-08-31T05:36:13.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.747+0000 7ffab1343640 1 -- 172.21.15.5:0/3598112844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffaac108140 msgr2=0x7ffaac108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:13.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.747+0000 7ffab1343640 1 --2- 172.21.15.5:0/3598112844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffaac108140 0x7ffaac108550 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0009900 tx=0x7ffaa002a410 comp rx=0 tx=0).stop 2024-08-31T05:36:13.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.747+0000 7ffab1343640 1 -- 172.21.15.5:0/3598112844 shutdown_connections 2024-08-31T05:36:13.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.747+0000 7ffab1343640 1 --2- 172.21.15.5:0/3598112844 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffaac108a90 0x7ffaac10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:13.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.747+0000 7ffab1343640 1 --2- 172.21.15.5:0/3598112844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffaac108140 0x7ffaac108550 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:13.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.747+0000 7ffab1343640 1 --2- 172.21.15.5:0/3598112844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffaac102800 0x7ffaac102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:13.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.747+0000 7ffab1343640 1 -- 172.21.15.5:0/3598112844 >> 172.21.15.5:0/3598112844 conn(0x7ffaac0794d0 msgr2=0x7ffaac0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:13.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.747+0000 7ffab1343640 1 -- 172.21.15.5:0/3598112844 shutdown_connections 2024-08-31T05:36:13.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.747+0000 7ffab1343640 1 -- 172.21.15.5:0/3598112844 wait complete. 2024-08-31T05:36:13.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.748+0000 7ffab1343640 1 Processor -- start 2024-08-31T05:36:13.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.748+0000 7ffab1343640 1 -- start start 2024-08-31T05:36:13.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.748+0000 7ffab1343640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffaac102800 0x7ffaac19b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:13.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.748+0000 7ffab1343640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffaac108140 0x7ffaac19b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:13.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.748+0000 7ffab1343640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffaac108a90 0x7ffaac19bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:13.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.748+0000 7ffab1343640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ffaac1126e0 con 0x7ffaac102800 2024-08-31T05:36:13.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.749+0000 7ffab1343640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ffaac112560 con 0x7ffaac108a90 2024-08-31T05:36:13.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.749+0000 7ffab1343640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ffaac112860 con 0x7ffaac108140 2024-08-31T05:36:13.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.749+0000 7ffaaaffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffaac102800 0x7ffaac19b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:13.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.749+0000 7ffaaaffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffaac102800 0x7ffaac19b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58770/0 (socket says 172.21.15.5:58770) 2024-08-31T05:36:13.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.749+0000 7ffaaaffd640 1 -- 172.21.15.5:0/587329666 learned_addr learned my addr 172.21.15.5:0/587329666 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:13.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.749+0000 7ffaaa7fc640 1 --2- 172.21.15.5:0/587329666 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffaac108140 0x7ffaac19b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:13.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.749+0000 7ffaab7fe640 1 --2- 172.21.15.5:0/587329666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffaac108a90 0x7ffaac19bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:13.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.749+0000 7ffaaaffd640 1 -- 172.21.15.5:0/587329666 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffaac108140 msgr2=0x7ffaac19b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:13.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.749+0000 7ffaaaffd640 1 --2- 172.21.15.5:0/587329666 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffaac108140 0x7ffaac19b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:13.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.749+0000 7ffaaaffd640 1 -- 172.21.15.5:0/587329666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffaac108a90 msgr2=0x7ffaac19bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:13.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.749+0000 7ffaaaffd640 1 --2- 172.21.15.5:0/587329666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffaac108a90 0x7ffaac19bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:13.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.749+0000 7ffaaaffd640 1 -- 172.21.15.5:0/587329666 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaac1a62f0 con 0x7ffaac102800 2024-08-31T05:36:13.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.749+0000 7ffaaaffd640 1 --2- 172.21.15.5:0/587329666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffaac102800 0x7ffaac19b030 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c00e9f0 tx=0x7ffa9c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:13.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.749+0000 7ffa93fff640 1 -- 172.21.15.5:0/587329666 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c00cd80 con 0x7ffaac102800 2024-08-31T05:36:13.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.749+0000 7ffab1343640 1 -- 172.21.15.5:0/587329666 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaac198e80 con 0x7ffaac102800 2024-08-31T05:36:13.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.750+0000 7ffab1343640 1 -- 172.21.15.5:0/587329666 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaac199390 con 0x7ffaac102800 2024-08-31T05:36:13.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.750+0000 7ffa93fff640 1 -- 172.21.15.5:0/587329666 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa9c0054d0 con 0x7ffaac102800 2024-08-31T05:36:13.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.750+0000 7ffa93fff640 1 -- 172.21.15.5:0/587329666 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c010430 con 0x7ffaac102800 2024-08-31T05:36:13.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.752+0000 7ffa93fff640 1 -- 172.21.15.5:0/587329666 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7ffa9c0105d0 con 0x7ffaac102800 2024-08-31T05:36:13.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.753+0000 7ffab78b8740 1 Processor -- start 2024-08-31T05:36:13.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.753+0000 7ffab78b8740 1 -- start start 2024-08-31T05:36:13.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.753+0000 7ffab78b8740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d25dc02070 0x55d25dfa72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:13.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.753+0000 7ffab78b8740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d25dbd91b0 0x55d25dfa7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:13.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.753+0000 7ffab78b8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d25dbe1390 0x55d25dfa7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:13.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.753+0000 7ffab78b8740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55d25df1e630 con 0x55d25dc02070 2024-08-31T05:36:13.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.753+0000 7ffab78b8740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d25df0dbc0 con 0x55d25dbd91b0 2024-08-31T05:36:13.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.753+0000 7ffab78b8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d25df11b70 con 0x55d25dbe1390 2024-08-31T05:36:13.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.753+0000 7ffaab7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d25dc02070 0x55d25dfa72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:13.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.753+0000 7ffaaa7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d25dbe1390 0x55d25dfa7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:13.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.753+0000 7ffaab7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d25dc02070 0x55d25dfa72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58778/0 (socket says 172.21.15.5:58778) 2024-08-31T05:36:13.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.753+0000 7ffaab7fe640 1 -- 172.21.15.5:0/976800057 learned_addr learned my addr 172.21.15.5:0/976800057 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:13.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.753+0000 7ffaaaffd640 1 --2- 172.21.15.5:0/976800057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d25dbd91b0 0x55d25dfa7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:13.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.754+0000 7ffaab7fe640 1 -- 172.21.15.5:0/976800057 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d25dbe1390 msgr2=0x55d25dfa7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:13.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.754+0000 7ffaab7fe640 1 --2- 172.21.15.5:0/976800057 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d25dbe1390 0x55d25dfa7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:13.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.754+0000 7ffaab7fe640 1 -- 172.21.15.5:0/976800057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d25dbd91b0 msgr2=0x55d25dfa7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:13.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.754+0000 7ffaab7fe640 1 --2- 172.21.15.5:0/976800057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d25dbd91b0 0x55d25dfa7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:13.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.754+0000 7ffaab7fe640 1 -- 172.21.15.5:0/976800057 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d25dc6d650 con 0x55d25dc02070 2024-08-31T05:36:13.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.754+0000 7ffaaaffd640 1 --2- 172.21.15.5:0/976800057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d25dbd91b0 0x55d25dfa7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:36:13.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.754+0000 7ffa93fff640 1 --2- 172.21.15.5:0/587329666 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ffa940b4ca0 0x7ffa940b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:13.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.754+0000 7ffaaaffd640 1 --2- 172.21.15.5:0/587329666 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ffa940b4ca0 0x7ffa940b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:13.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.754+0000 7ffaab7fe640 1 --2- 172.21.15.5:0/976800057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d25dc02070 0x55d25dfa72c0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4009fd0 tx=0x7ffaa40118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eba7cbe1fbd95930 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:13.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.754+0000 7ffa93fff640 1 -- 172.21.15.5:0/587329666 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7ffa9c0e59f0 con 0x7ffaac102800 2024-08-31T05:36:13.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.754+0000 7ffa917fa640 1 -- 172.21.15.5:0/976800057 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa4004d20 con 0x55d25dc02070 2024-08-31T05:36:13.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.754+0000 7ffa917fa640 1 -- 172.21.15.5:0/976800057 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffaa4004050 con 0x55d25dc02070 2024-08-31T05:36:13.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.754+0000 7ffa917fa640 1 -- 172.21.15.5:0/976800057 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa4005280 con 0x55d25dc02070 2024-08-31T05:36:13.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.755+0000 7ffab78b8740 1 -- 172.21.15.5:0/976800057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d25dc02070 msgr2=0x55d25dfa72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:13.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.755+0000 7ffaaaffd640 1 --2- 172.21.15.5:0/587329666 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ffa940b4ca0 0x7ffa940b71b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c0e2e70 tx=0x7ffa9c093040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:13.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.755+0000 7ffab78b8740 1 --2- 172.21.15.5:0/976800057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d25dc02070 0x55d25dfa72c0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4009fd0 tx=0x7ffaa40118d0 comp rx=0 tx=0).stop 2024-08-31T05:36:13.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.755+0000 7ffab78b8740 1 -- 172.21.15.5:0/976800057 shutdown_connections 2024-08-31T05:36:13.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.755+0000 7ffab78b8740 1 --2- 172.21.15.5:0/976800057 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d25dbe1390 0x55d25dfa7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:13.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.755+0000 7ffab78b8740 1 --2- 172.21.15.5:0/976800057 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d25dbd91b0 0x55d25dfa7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:13.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.755+0000 7ffab78b8740 1 --2- 172.21.15.5:0/976800057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d25dc02070 0x55d25dfa72c0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:13.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.755+0000 7ffab78b8740 1 -- 172.21.15.5:0/976800057 >> 172.21.15.5:0/976800057 conn(0x55d25dbf6460 msgr2=0x55d25dfa51b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:13.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.755+0000 7ffab78b8740 1 -- 172.21.15.5:0/976800057 shutdown_connections 2024-08-31T05:36:13.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.755+0000 7ffab78b8740 1 -- 172.21.15.5:0/976800057 wait complete. 2024-08-31T05:36:13.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.756+0000 7ffab78b8740 1 -- start start 2024-08-31T05:36:13.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.756+0000 7ffab78b8740 1 Processor -- start 2024-08-31T05:36:13.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.756+0000 7ffab78b8740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d25dbd91b0 0x55d25dfb29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:13.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.756+0000 7ffab78b8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d25dbe1390 0x55d25dfb2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:13.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.756+0000 7ffab78b8740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d25dc02070 0x55d25dfbedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:13.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.756+0000 7ffab78b8740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55d25dd70700 con 0x55d25dc02070 2024-08-31T05:36:13.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.756+0000 7ffab78b8740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d25de94700 con 0x55d25dbd91b0 2024-08-31T05:36:13.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.756+0000 7ffab78b8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d25dfb5aa0 con 0x55d25dbe1390 2024-08-31T05:36:13.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.756+0000 7ffab78b8740 10 client.0 _ll_register_callbacks cb 0x55d25dec3dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:36:13.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.756+0000 7ffaaa7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d25dbe1390 0x55d25dfb2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:13.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.756+0000 7ffaaa7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d25dbe1390 0x55d25dfb2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:49584/0 (socket says 172.21.15.5:49584) 2024-08-31T05:36:13.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.756+0000 7ffaab7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d25dbd91b0 0x55d25dfb29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:13.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.756+0000 7ffaaa7fc640 1 -- 172.21.15.5:0/24879059 learned_addr learned my addr 172.21.15.5:0/24879059 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:13.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.756+0000 7ffaab7fe640 1 --2- 172.21.15.5:0/24879059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d25dc02070 0x55d25dfbedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:13.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.757+0000 7ffaaa7fc640 1 -- 172.21.15.5:0/24879059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d25dbd91b0 msgr2=0x55d25dfb29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:13.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.757+0000 7ffaaa7fc640 1 --2- 172.21.15.5:0/24879059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d25dbd91b0 0x55d25dfb29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:13.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.757+0000 7ffaaa7fc640 1 -- 172.21.15.5:0/24879059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d25dc02070 msgr2=0x55d25dfbedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:13.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.757+0000 7ffaaa7fc640 1 --2- 172.21.15.5:0/24879059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d25dc02070 0x55d25dfbedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:13.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.757+0000 7ffaaa7fc640 1 -- 172.21.15.5:0/24879059 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d25decd8b0 con 0x55d25dbe1390 2024-08-31T05:36:13.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.757+0000 7ffaaa7fc640 1 --2- 172.21.15.5:0/24879059 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d25dbe1390 0x55d25dfb2f00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0009900 tx=0x7ffaa0032e90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a818284ef3bf1e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:13.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.757+0000 7ffa8eff5640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:36:13.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.757+0000 7ffa8eff5640 1 -- 172.21.15.5:0/24879059 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa0035040 con 0x55d25dbe1390 2024-08-31T05:36:13.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.757+0000 7ffa8eff5640 1 -- 172.21.15.5:0/24879059 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7ffaa0031760 con 0x55d25dbe1390 2024-08-31T05:36:13.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.757+0000 7ffab78b8740 1 -- 172.21.15.5:0/24879059 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffaa4004050 con 0x55d25dbe1390 2024-08-31T05:36:13.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.758+0000 7ffa8eff5640 1 -- 172.21.15.5:0/24879059 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ffaa004f050 con 0x55d25dbe1390 2024-08-31T05:36:13.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.758+0000 7ffab78b8740 10 client.26788 fetch_fsmap learned FSMap version 34 2024-08-31T05:36:13.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.758+0000 7ffab78b8740 1 -- 172.21.15.5:0/24879059 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55d25dfc1820 con 0x55d25dbe1390 2024-08-31T05:36:13.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.758+0000 7ffa8eff5640 1 -- 172.21.15.5:0/24879059 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffaa4004050 con 0x55d25dbe1390 2024-08-31T05:36:13.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.758+0000 7ffa8eff5640 1 -- 172.21.15.5:0/24879059 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7ffaa0004750 con 0x55d25dbe1390 2024-08-31T05:36:13.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.758+0000 7ffab78b8740 10 client.26788 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:36:13.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.758+0000 7ffab78b8740 10 client.26788 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:36:13.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.758+0000 7ffab78b8740 20 client.26788 populate_metadata read hostname 'smithi005' 2024-08-31T05:36:13.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.758+0000 7ffab78b8740 1 --2- 172.21.15.5:0/24879059 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d25dbc09f0 0x55d25dfc4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:13.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.758+0000 7ffab78b8740 4 client.26788 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:36:13.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.758+0000 7ffab78b8740 1 -- 172.21.15.5:0/24879059 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d25df20580 con 0x55d25dbc09f0 2024-08-31T05:36:13.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.758+0000 7ffaab7fe640 1 --2- 172.21.15.5:0/24879059 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d25dbc09f0 0x55d25dfc4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:13.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.759+0000 7ffa8eff5640 10 client.26788 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:36:13.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.759+0000 7ffaab7fe640 1 --2- 172.21.15.5:0/24879059 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d25dbc09f0 0x55d25dfc4e10 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d2cd2a5fec0879f server_cookie=1bfe0c6297c69bfc in_seq=0 out_seq=0 2024-08-31T05:36:13.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.759+0000 7ffa8eff5640 1 -- 172.21.15.5:0/24879059 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d25df20580 con 0x55d25dbc09f0 2024-08-31T05:36:13.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.759+0000 7ffa8eff5640 10 client.26788 handle_command_reply: tid=0 2024-08-31T05:36:13.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.760+0000 7ffab78b8740 1 client.26788 shutdown 2024-08-31T05:36:13.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.760+0000 7ffab78b8740 1 -- 172.21.15.5:0/24879059 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d25dbe1390 msgr2=0x55d25dfb2f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:13.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.760+0000 7ffab78b8740 1 --2- 172.21.15.5:0/24879059 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d25dbe1390 0x55d25dfb2f00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0009900 tx=0x7ffaa0032e90 comp rx=0 tx=0).stop 2024-08-31T05:36:13.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.760+0000 7ffab78b8740 1 -- 172.21.15.5:0/24879059 shutdown_connections 2024-08-31T05:36:13.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.760+0000 7ffab78b8740 1 --2- 172.21.15.5:0/24879059 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d25dbc09f0 0x55d25dfc4e10 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:13.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.760+0000 7ffab78b8740 1 --2- 172.21.15.5:0/24879059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d25dc02070 0x55d25dfbedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:13.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.760+0000 7ffab78b8740 1 --2- 172.21.15.5:0/24879059 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d25dbe1390 0x55d25dfb2f00 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:13.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.760+0000 7ffab78b8740 1 --2- 172.21.15.5:0/24879059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d25dbd91b0 0x55d25dfb29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:13.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.760+0000 7ffa8eff5640 0 client.26788 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:36:13.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.760+0000 7ffab78b8740 1 -- 172.21.15.5:0/24879059 >> 172.21.15.5:0/24879059 conn(0x55d25dbf6460 msgr2=0x55d25dfaa450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:13.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.760+0000 7ffab78b8740 1 -- 172.21.15.5:0/24879059 shutdown_connections 2024-08-31T05:36:13.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.760+0000 7ffab78b8740 1 -- 172.21.15.5:0/24879059 wait complete. 2024-08-31T05:36:13.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.760+0000 7ffab78b8740 20 client.26788 trim_cache size 0 max 16384 2024-08-31T05:36:13.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.778+0000 7ffab78b8740 1 Processor -- start 2024-08-31T05:36:13.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.779+0000 7ffab78b8740 1 -- start start 2024-08-31T05:36:13.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.779+0000 7ffab78b8740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d25dbd91b0 0x55d25dfaaad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:13.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.779+0000 7ffab78b8740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d25dbe1390 0x55d25dfbecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:13.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.779+0000 7ffab78b8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d25dc02070 0x55d25dfa4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:13.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.779+0000 7ffab78b8740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ffa9800ff40 con 0x55d25dbe1390 2024-08-31T05:36:13.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.779+0000 7ffab78b8740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ffa98011a80 con 0x55d25dbd91b0 2024-08-31T05:36:13.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.779+0000 7ffab78b8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ffa98010610 con 0x55d25dc02070 2024-08-31T05:36:13.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.779+0000 7ffaaa7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d25dbe1390 0x55d25dfbecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:13.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.780+0000 7ffaab7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d25dbd91b0 0x55d25dfaaad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:13.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.780+0000 7ffaab7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d25dbd91b0 0x55d25dfaaad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:42920/0 (socket says 172.21.15.5:42920) 2024-08-31T05:36:13.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.780+0000 7ffaab7fe640 1 -- 172.21.15.5:0/3416982230 learned_addr learned my addr 172.21.15.5:0/3416982230 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:13.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.780+0000 7ffaab7fe640 1 --2- 172.21.15.5:0/3416982230 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d25dc02070 0x55d25dfa4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:13.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.780+0000 7ffaaa7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d25dbe1390 0x55d25dfbecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58796/0 (socket says 172.21.15.5:58796) 2024-08-31T05:36:13.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.780+0000 7ffaab7fe640 1 -- 172.21.15.5:0/3416982230 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d25dc02070 msgr2=0x55d25dfa4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:13.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.780+0000 7ffaab7fe640 1 --2- 172.21.15.5:0/3416982230 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d25dc02070 0x55d25dfa4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:13.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.780+0000 7ffaab7fe640 1 -- 172.21.15.5:0/3416982230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d25dbe1390 msgr2=0x55d25dfbecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:13.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.780+0000 7ffaab7fe640 1 --2- 172.21.15.5:0/3416982230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d25dbe1390 0x55d25dfbecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:13.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.780+0000 7ffaab7fe640 1 -- 172.21.15.5:0/3416982230 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d25dfa08f0 con 0x55d25dbd91b0 2024-08-31T05:36:13.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.780+0000 7ffaab7fe640 1 --2- 172.21.15.5:0/3416982230 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d25dbd91b0 0x55d25dfaaad0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4000f80 tx=0x7ffaa40118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=125d5d5a95c2a026 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:13.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.781+0000 7ffa90ff9640 1 -- 172.21.15.5:0/3416982230 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa4003af0 con 0x55d25dbd91b0 2024-08-31T05:36:13.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.781+0000 7ffa90ff9640 1 -- 172.21.15.5:0/3416982230 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffaa4004000 con 0x55d25dbd91b0 2024-08-31T05:36:13.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.781+0000 7ffa90ff9640 1 -- 172.21.15.5:0/3416982230 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa4005110 con 0x55d25dbd91b0 2024-08-31T05:36:13.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.782+0000 7ffab78b8740 1 -- 172.21.15.5:0/3416982230 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d25dbd91b0 msgr2=0x55d25dfaaad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:13.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.782+0000 7ffab78b8740 1 --2- 172.21.15.5:0/3416982230 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d25dbd91b0 0x55d25dfaaad0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4000f80 tx=0x7ffaa40118d0 comp rx=0 tx=0).stop 2024-08-31T05:36:13.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.782+0000 7ffab78b8740 1 -- 172.21.15.5:0/3416982230 shutdown_connections 2024-08-31T05:36:13.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.782+0000 7ffab78b8740 1 --2- 172.21.15.5:0/3416982230 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d25dc02070 0x55d25dfa4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:13.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.782+0000 7ffab78b8740 1 --2- 172.21.15.5:0/3416982230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d25dbe1390 0x55d25dfbecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:13.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.782+0000 7ffab78b8740 1 --2- 172.21.15.5:0/3416982230 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d25dbd91b0 0x55d25dfaaad0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:13.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.782+0000 7ffab78b8740 1 -- 172.21.15.5:0/3416982230 >> 172.21.15.5:0/3416982230 conn(0x55d25dbf6460 msgr2=0x55d25dfaa3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:13.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.782+0000 7ffab78b8740 1 -- 172.21.15.5:0/3416982230 shutdown_connections 2024-08-31T05:36:13.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.782+0000 7ffab78b8740 1 -- 172.21.15.5:0/3416982230 wait complete. 2024-08-31T05:36:13.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.782+0000 7ffab78b8740 1 -- start start 2024-08-31T05:36:13.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.782+0000 7ffab78b8740 1 Processor -- start 2024-08-31T05:36:13.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.783+0000 7ffab78b8740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d25dbd91b0 0x55d25dfb7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:13.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.783+0000 7ffab78b8740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d25dbe1390 0x55d25dfb79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:13.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.783+0000 7ffab78b8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d25dc02070 0x55d25e02e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:13.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.783+0000 7ffab78b8740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ffa980113b0 con 0x55d25dbd91b0 2024-08-31T05:36:13.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.783+0000 7ffab78b8740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ffa98010ce0 con 0x55d25dbe1390 2024-08-31T05:36:13.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.783+0000 7ffab78b8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ffa9800df20 con 0x55d25dc02070 2024-08-31T05:36:13.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.783+0000 7ffab78b8740 10 client.0 _ll_register_callbacks cb 0x7ffaa0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:36:13.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.783+0000 7ffaab7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d25dbd91b0 0x55d25dfb7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:13.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.783+0000 7ffaab7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d25dbd91b0 0x55d25dfb7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58810/0 (socket says 172.21.15.5:58810) 2024-08-31T05:36:13.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.783+0000 7ffaab7fe640 1 -- 172.21.15.5:0/3317037346 learned_addr learned my addr 172.21.15.5:0/3317037346 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:13.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.783+0000 7ffaab7fe640 1 --2- 172.21.15.5:0/3317037346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d25dc02070 0x55d25e02e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:13.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.783+0000 7ffaaa7fc640 1 --2- 172.21.15.5:0/3317037346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d25dbe1390 0x55d25dfb79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:13.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.783+0000 7ffaab7fe640 1 -- 172.21.15.5:0/3317037346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d25dc02070 msgr2=0x55d25e02e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:13.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.783+0000 7ffaab7fe640 1 --2- 172.21.15.5:0/3317037346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d25dc02070 0x55d25e02e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:13.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.783+0000 7ffaab7fe640 1 -- 172.21.15.5:0/3317037346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d25dbe1390 msgr2=0x55d25dfb79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:13.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.783+0000 7ffaab7fe640 1 --2- 172.21.15.5:0/3317037346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d25dbe1390 0x55d25dfb79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:13.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.783+0000 7ffaab7fe640 1 -- 172.21.15.5:0/3317037346 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d25e02ed20 con 0x55d25dbd91b0 2024-08-31T05:36:13.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.783+0000 7ffaaa7fc640 1 --2- 172.21.15.5:0/3317037346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d25dbe1390 0x55d25dfb79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:36:13.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.784+0000 7ffaab7fe640 1 --2- 172.21.15.5:0/3317037346 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d25dbd91b0 0x55d25dfb7480 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4009560 tx=0x7ffaa40096c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae6dc28c164aa094 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:13.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.784+0000 7ffa8eff5640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:36:13.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.784+0000 7ffa8eff5640 1 -- 172.21.15.5:0/3317037346 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa4004510 con 0x55d25dbd91b0 2024-08-31T05:36:13.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.784+0000 7ffa8eff5640 1 -- 172.21.15.5:0/3317037346 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7ffaa40049a0 con 0x55d25dbd91b0 2024-08-31T05:36:13.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.784+0000 7ffab78b8740 1 -- 172.21.15.5:0/3317037346 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffaa4004000 con 0x55d25dbd91b0 2024-08-31T05:36:13.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.784+0000 7ffa8eff5640 1 -- 172.21.15.5:0/3317037346 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ffaa4004ba0 con 0x55d25dbd91b0 2024-08-31T05:36:13.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.784+0000 7ffab78b8740 10 client.17196 fetch_fsmap learned FSMap version 34 2024-08-31T05:36:13.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.784+0000 7ffab78b8740 1 -- 172.21.15.5:0/3317037346 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55d25e02ffb0 con 0x55d25dbd91b0 2024-08-31T05:36:13.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.784+0000 7ffa8eff5640 1 -- 172.21.15.5:0/3317037346 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffaa4004000 con 0x55d25dbd91b0 2024-08-31T05:36:13.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.784+0000 7ffa8eff5640 1 -- 172.21.15.5:0/3317037346 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7ffaa400f4e0 con 0x55d25dbd91b0 2024-08-31T05:36:13.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.784+0000 7ffab78b8740 10 client.17196 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:36:13.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.784+0000 7ffab78b8740 10 client.17196 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:36:13.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.784+0000 7ffab78b8740 20 client.17196 populate_metadata read hostname 'smithi005' 2024-08-31T05:36:13.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.785+0000 7ffab78b8740 1 --2- 172.21.15.5:0/3317037346 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d25db95da0 0x55d25e0324a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:13.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.785+0000 7ffab78b8740 4 client.17196 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T05:36:13.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.785+0000 7ffab78b8740 1 -- 172.21.15.5:0/3317037346 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d25df1c020 con 0x55d25db95da0 2024-08-31T05:36:13.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.785+0000 7ffaaa7fc640 1 --2- 172.21.15.5:0/3317037346 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d25db95da0 0x55d25e0324a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:13.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.785+0000 7ffa8eff5640 10 client.17196 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:36:13.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.785+0000 7ffaaa7fc640 1 --2- 172.21.15.5:0/3317037346 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d25db95da0 0x55d25e0324a0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1d571ad80e157d8 server_cookie=add2c0f917adf277 in_seq=0 out_seq=0 2024-08-31T05:36:13.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.785+0000 7ffa8eff5640 1 -- 172.21.15.5:0/3317037346 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2362 (crc 0 0 0) 0x55d25df1c020 con 0x55d25db95da0 2024-08-31T05:36:13.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.785+0000 7ffa8eff5640 10 client.17196 handle_command_reply: tid=0 2024-08-31T05:36:13.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.785+0000 7ffab78b8740 1 client.17196 shutdown 2024-08-31T05:36:13.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.786+0000 7ffab78b8740 1 -- 172.21.15.5:0/3317037346 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d25dbd91b0 msgr2=0x55d25dfb7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:13.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.786+0000 7ffab78b8740 1 --2- 172.21.15.5:0/3317037346 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d25dbd91b0 0x55d25dfb7480 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4009560 tx=0x7ffaa40096c0 comp rx=0 tx=0).stop 2024-08-31T05:36:13.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.786+0000 7ffab78b8740 1 -- 172.21.15.5:0/3317037346 shutdown_connections 2024-08-31T05:36:13.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.786+0000 7ffab78b8740 1 --2- 172.21.15.5:0/3317037346 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d25db95da0 0x55d25e0324a0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:13.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.786+0000 7ffa8eff5640 0 client.17196 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:36:13.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.786+0000 7ffab78b8740 1 --2- 172.21.15.5:0/3317037346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d25dc02070 0x55d25e02e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:13.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.786+0000 7ffab78b8740 1 --2- 172.21.15.5:0/3317037346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d25dbe1390 0x55d25dfb79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:13.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.786+0000 7ffab78b8740 1 --2- 172.21.15.5:0/3317037346 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d25dbd91b0 0x55d25dfb7480 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:13.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.786+0000 7ffab78b8740 1 -- 172.21.15.5:0/3317037346 >> 172.21.15.5:0/3317037346 conn(0x55d25dbf6460 msgr2=0x55d25dfa4990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:13.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.786+0000 7ffab78b8740 1 -- 172.21.15.5:0/3317037346 shutdown_connections 2024-08-31T05:36:13.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.786+0000 7ffab78b8740 1 -- 172.21.15.5:0/3317037346 wait complete. 2024-08-31T05:36:13.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.786+0000 7ffab78b8740 20 client.17196 trim_cache size 0 max 16384 2024-08-31T05:36:13.793 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:36:13.793 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "no active scrubs running", 2024-08-31T05:36:13.793 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": {}, 2024-08-31T05:36:13.793 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_stats": { 2024-08-31T05:36:13.793 INFO:teuthology.orchestra.run.smithi005.stdout: "095ccc7a-f368-4bc6-9563-5930e21f9b4a": { 2024-08-31T05:36:13.794 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:35:40.190069+0000", 2024-08-31T05:36:13.794 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:36:13.794 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:36:13.794 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:36:13.794 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:36:13.794 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:36:13.794 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:36:13.794 INFO:teuthology.orchestra.run.smithi005.stdout: "de9731c7-ae4a-42fe-8146-e4752cdc40d4": { 2024-08-31T05:36:13.794 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:34:53.614499+0000", 2024-08-31T05:36:13.794 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:36:13.794 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:36:13.794 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:36:13.794 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:36:13.794 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:36:13.795 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:36:13.795 INFO:teuthology.orchestra.run.smithi005.stdout: "0bb67292-013a-40c7-b5fc-810bdd9715d8": { 2024-08-31T05:36:13.795 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:34:04.586008+0000", 2024-08-31T05:36:13.795 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:36:13.795 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:36:13.795 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:36:13.795 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:36:13.795 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:36:13.795 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:36:13.795 INFO:teuthology.orchestra.run.smithi005.stdout: "728a42ca-bbef-4151-830f-5fdd411d8fa0": { 2024-08-31T05:36:13.795 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:32:30.554906+0000", 2024-08-31T05:36:13.795 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:36:13.795 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:36:13.795 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:36:13.795 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:36:13.796 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:36:13.796 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:36:13.796 INFO:teuthology.orchestra.run.smithi005.stdout: "2445fc42-b797-434f-b380-e2da985b4d98": { 2024-08-31T05:36:13.796 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:33:17.681453+0000", 2024-08-31T05:36:13.796 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:36:13.796 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:36:13.796 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:36:13.796 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:36:13.796 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:36:13.796 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:36:13.796 INFO:teuthology.orchestra.run.smithi005.stdout: "cda92ac0-b35f-47a5-a3a5-471c888462a5": { 2024-08-31T05:36:13.796 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:53.103905+0000", 2024-08-31T05:36:13.796 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:36:13.797 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:36:13.797 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:36:13.797 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:36:13.797 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:36:13.797 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:36:13.797 INFO:teuthology.orchestra.run.smithi005.stdout: "ece37b07-9ab2-45f8-bc33-2755a07aac0b": { 2024-08-31T05:36:13.797 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:31:41.782407+0000", 2024-08-31T05:36:13.797 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:36:13.797 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:36:13.797 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:36:13.797 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:36:13.797 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:36:13.797 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:36:13.797 INFO:teuthology.orchestra.run.smithi005.stdout: "75d84398-5d9c-4872-b879-2fbce045fa71": { 2024-08-31T05:36:13.797 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:06.642335+0000", 2024-08-31T05:36:13.798 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:36:13.798 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:36:13.798 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:36:13.798 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:36:13.798 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:36:13.798 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:36:13.798 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:36:13.798 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:36:13.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.786+0000 7ffab1343640 1 -- 172.21.15.5:0/587329666 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ffa940b4ca0 msgr2=0x7ffa940b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:13.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.786+0000 7ffab1343640 1 --2- 172.21.15.5:0/587329666 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ffa940b4ca0 0x7ffa940b71b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c0e2e70 tx=0x7ffa9c093040 comp rx=0 tx=0).stop 2024-08-31T05:36:13.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.787+0000 7ffab1343640 1 -- 172.21.15.5:0/587329666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffaac102800 msgr2=0x7ffaac19b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:13.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.787+0000 7ffab1343640 1 --2- 172.21.15.5:0/587329666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffaac102800 0x7ffaac19b030 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c00e9f0 tx=0x7ffa9c00edf0 comp rx=0 tx=0).stop 2024-08-31T05:36:13.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.787+0000 7ffab1343640 1 -- 172.21.15.5:0/587329666 shutdown_connections 2024-08-31T05:36:13.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.787+0000 7ffab1343640 1 --2- 172.21.15.5:0/587329666 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ffa940b4ca0 0x7ffa940b71b0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:13.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.787+0000 7ffab1343640 1 --2- 172.21.15.5:0/587329666 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ffaac108a90 0x7ffaac19bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:13.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.787+0000 7ffab1343640 1 --2- 172.21.15.5:0/587329666 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffaac108140 0x7ffaac19b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:13.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.787+0000 7ffab1343640 1 --2- 172.21.15.5:0/587329666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffaac102800 0x7ffaac19b030 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:13.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.787+0000 7ffab1343640 1 -- 172.21.15.5:0/587329666 >> 172.21.15.5:0/587329666 conn(0x7ffaac0794d0 msgr2=0x7ffaac105040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:13.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.787+0000 7ffab1343640 1 -- 172.21.15.5:0/587329666 shutdown_connections 2024-08-31T05:36:13.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:13.787+0000 7ffab1343640 1 -- 172.21.15.5:0/587329666 wait complete. 2024-08-31T05:36:13.921 INFO:tasks.workunit.client.0.smithi005.stdout: 1 695867 11.79 MB/sec execute 181 sec latency 34.181 ms 2024-08-31T05:36:14.779 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T05:36:14.779 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T05:36:14.921 INFO:tasks.workunit.client.0.smithi005.stdout: 1 697570 11.78 MB/sec execute 182 sec latency 17.084 ms 2024-08-31T05:36:15.046 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:36:15.459 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:15 smithi050 ceph-mon[22146]: pgmap v533: 129 pgs: 129 active+clean; 385 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.2 MiB/s wr, 222 op/s 2024-08-31T05:36:15.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:15 smithi005 ceph-mon[18602]: pgmap v533: 129 pgs: 129 active+clean; 385 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.2 MiB/s wr, 222 op/s 2024-08-31T05:36:15.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:15 smithi070 ceph-mon[22316]: pgmap v533: 129 pgs: 129 active+clean; 385 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.2 MiB/s wr, 222 op/s 2024-08-31T05:36:15.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.586+0000 7f77edd64640 1 -- 172.21.15.5:0/629031782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77e8102870 msgr2=0x7f77e8102c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:15.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.586+0000 7f77edd64640 1 --2- 172.21.15.5:0/629031782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77e8102870 0x7f77e8102c80 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f77d8009900 tx=0x7f77d802a410 comp rx=0 tx=0).stop 2024-08-31T05:36:15.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.586+0000 7f77edd64640 1 -- 172.21.15.5:0/629031782 shutdown_connections 2024-08-31T05:36:15.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.586+0000 7f77edd64640 1 --2- 172.21.15.5:0/629031782 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77e8108ab0 0x7f77e810f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:15.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.586+0000 7f77edd64640 1 --2- 172.21.15.5:0/629031782 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77e8108160 0x7f77e8108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:15.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.586+0000 7f77edd64640 1 --2- 172.21.15.5:0/629031782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77e8102870 0x7f77e8102c80 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:15.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.586+0000 7f77edd64640 1 -- 172.21.15.5:0/629031782 >> 172.21.15.5:0/629031782 conn(0x7f77e8079470 msgr2=0x7f77e8079880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:15.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.586+0000 7f77edd64640 1 -- 172.21.15.5:0/629031782 shutdown_connections 2024-08-31T05:36:15.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.586+0000 7f77edd64640 1 -- 172.21.15.5:0/629031782 wait complete. 2024-08-31T05:36:15.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.587+0000 7f77edd64640 1 Processor -- start 2024-08-31T05:36:15.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.587+0000 7f77edd64640 1 -- start start 2024-08-31T05:36:15.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.588+0000 7f77edd64640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77e8102870 0x7f77e819a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:15.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.588+0000 7f77edd64640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77e8108160 0x7f77e819a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:15.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.588+0000 7f77edd64640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77e8108ab0 0x7f77e819fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:15.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.588+0000 7f77edd64640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f77e8112780 con 0x7f77e8102870 2024-08-31T05:36:15.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.588+0000 7f77edd64640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f77e8112600 con 0x7f77e8108160 2024-08-31T05:36:15.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.588+0000 7f77edd64640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f77e8112900 con 0x7f77e8108ab0 2024-08-31T05:36:15.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.588+0000 7f77e6ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77e8108160 0x7f77e819a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:15.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.588+0000 7f77e77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77e8102870 0x7f77e819a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:15.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.588+0000 7f77e6ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77e8108160 0x7f77e819a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:42948/0 (socket says 172.21.15.5:42948) 2024-08-31T05:36:15.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.588+0000 7f77e6ffd640 1 -- 172.21.15.5:0/3287795958 learned_addr learned my addr 172.21.15.5:0/3287795958 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:15.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.588+0000 7f77e7fff640 1 --2- 172.21.15.5:0/3287795958 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77e8108ab0 0x7f77e819fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:15.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.588+0000 7f77e6ffd640 1 -- 172.21.15.5:0/3287795958 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77e8108ab0 msgr2=0x7f77e819fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:15.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.588+0000 7f77e6ffd640 1 --2- 172.21.15.5:0/3287795958 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77e8108ab0 0x7f77e819fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:15.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.588+0000 7f77e6ffd640 1 -- 172.21.15.5:0/3287795958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77e8102870 msgr2=0x7f77e819a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:15.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.588+0000 7f77e6ffd640 1 --2- 172.21.15.5:0/3287795958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77e8102870 0x7f77e819a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:15.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.588+0000 7f77e6ffd640 1 -- 172.21.15.5:0/3287795958 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77e81a0250 con 0x7f77e8108160 2024-08-31T05:36:15.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.588+0000 7f77e7fff640 1 --2- 172.21.15.5:0/3287795958 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77e8108ab0 0x7f77e819fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:36:15.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.589+0000 7f77e6ffd640 1 --2- 172.21.15.5:0/3287795958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77e8108160 0x7f77e819a880 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f77dc00e9c0 tx=0x7f77dc00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:15.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.589+0000 7f77e4ff9640 1 -- 172.21.15.5:0/3287795958 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77dc00ccc0 con 0x7f77e8108160 2024-08-31T05:36:15.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.589+0000 7f77edd64640 1 -- 172.21.15.5:0/3287795958 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77e81a0540 con 0x7f77e8108160 2024-08-31T05:36:15.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.589+0000 7f77e4ff9640 1 -- 172.21.15.5:0/3287795958 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77dc0054d0 con 0x7f77e8108160 2024-08-31T05:36:15.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.589+0000 7f77e4ff9640 1 -- 172.21.15.5:0/3287795958 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77dc010430 con 0x7f77e8108160 2024-08-31T05:36:15.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.589+0000 7f77edd64640 1 -- 172.21.15.5:0/3287795958 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77e81092b0 con 0x7f77e8108160 2024-08-31T05:36:15.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.590+0000 7f77edd64640 1 -- 172.21.15.5:0/3287795958 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77e8103aa0 con 0x7f77e8108160 2024-08-31T05:36:15.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.592+0000 7f77e4ff9640 1 -- 172.21.15.5:0/3287795958 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f77dc005000 con 0x7f77e8108160 2024-08-31T05:36:15.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.592+0000 7f77e4ff9640 1 --2- 172.21.15.5:0/3287795958 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f77d00b4ca0 0x7f77d00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:15.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.593+0000 7f77e77fe640 1 --2- 172.21.15.5:0/3287795958 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f77d00b4ca0 0x7f77d00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:15.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.593+0000 7f77e4ff9640 1 -- 172.21.15.5:0/3287795958 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f77dc0e5ea0 con 0x7f77e8108160 2024-08-31T05:36:15.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.593+0000 7f77e77fe640 1 --2- 172.21.15.5:0/3287795958 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f77d00b4ca0 0x7f77d00b71b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f77d8031440 tx=0x7f77d803c040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:15.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.595+0000 7f77e4ff9640 1 -- 172.21.15.5:0/3287795958 <== mon.2 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f77dc056130 con 0x7f77e8108160 2024-08-31T05:36:15.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.879+0000 7f77edd64640 1 -- 172.21.15.5:0/3287795958 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f77e8102c80 con 0x7f77e8108160 2024-08-31T05:36:15.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.880+0000 7f77e4ff9640 1 -- 172.21.15.5:0/3287795958 <== mon.2 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11941 (secure 0 0 0) 0x7f77dc0052f0 con 0x7f77e8108160 2024-08-31T05:36:15.883 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:36:15.883 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":34,"btime":"2024-08-31T05:33:43:289944+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14739,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2024812199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2024812199},{"type":"v1","addr":"172.21.15.5:6835","nonce":2024812199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3629023702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3629023702},{"type":"v1","addr":"172.21.15.5:6837","nonce":3629023702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T05:27:31.929153+0000","modified":"2024-08-31T05:33:42.378207+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24652,"mds_1":24638,"mds_2":24631,"mds_3":24625,"mds_4":24602},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6839/2412701258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":2412701258},{"type":"v1","addr":"172.21.15.5:6839","nonce":2412701258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14820":{"gid":14820,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6841/747057838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":747057838},{"type":"v1","addr":"172.21.15.5:6841","nonce":747057838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6833/1153378982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1153378982},{"type":"v1","addr":"172.21.15.50:6833","nonce":1153378982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6833/364083443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":364083443},{"type":"v1","addr":"172.21.15.70:6833","nonce":364083443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24587":{"gid":24587,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/2346896794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2346896794},{"type":"v1","addr":"172.21.15.50:6835","nonce":2346896794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24602":{"gid":24602,"name":"h","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.50:6837/428759669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":428759669},{"type":"v1","addr":"172.21.15.50:6837","nonce":428759669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.70:6835/2061504114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2061504114},{"type":"v1","addr":"172.21.15.70:6835","nonce":2061504114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.70:6837/2780036414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2780036414},{"type":"v1","addr":"172.21.15.70:6837","nonce":2780036414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.50:6839/98200944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":98200944},{"type":"v1","addr":"172.21.15.50:6839","nonce":98200944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24652":{"gid":24652,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.70:6839/2756569250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":2756569250},{"type":"v1","addr":"172.21.15.70:6839","nonce":2756569250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24652,"qdb_cluster":[24652,24631,24638,24625,24602]},"id":1}]} 2024-08-31T05:36:15.883 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 34 2024-08-31T05:36:15.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.882+0000 7f77edd64640 1 -- 172.21.15.5:0/3287795958 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f77d00b4ca0 msgr2=0x7f77d00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:15.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.882+0000 7f77edd64640 1 --2- 172.21.15.5:0/3287795958 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f77d00b4ca0 0x7f77d00b71b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f77d8031440 tx=0x7f77d803c040 comp rx=0 tx=0).stop 2024-08-31T05:36:15.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.883+0000 7f77edd64640 1 -- 172.21.15.5:0/3287795958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77e8108160 msgr2=0x7f77e819a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:15.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.883+0000 7f77edd64640 1 --2- 172.21.15.5:0/3287795958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77e8108160 0x7f77e819a880 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f77dc00e9c0 tx=0x7f77dc00ee80 comp rx=0 tx=0).stop 2024-08-31T05:36:15.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.883+0000 7f77edd64640 1 -- 172.21.15.5:0/3287795958 shutdown_connections 2024-08-31T05:36:15.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.883+0000 7f77edd64640 1 --2- 172.21.15.5:0/3287795958 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f77d00b4ca0 0x7f77d00b71b0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:15.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.883+0000 7f77edd64640 1 --2- 172.21.15.5:0/3287795958 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77e8108ab0 0x7f77e819fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:15.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.883+0000 7f77edd64640 1 --2- 172.21.15.5:0/3287795958 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77e8108160 0x7f77e819a880 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:15.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.883+0000 7f77edd64640 1 --2- 172.21.15.5:0/3287795958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77e8102870 0x7f77e819a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:15.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.883+0000 7f77edd64640 1 -- 172.21.15.5:0/3287795958 >> 172.21.15.5:0/3287795958 conn(0x7f77e8079470 msgr2=0x7f77e806b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:15.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.883+0000 7f77edd64640 1 -- 172.21.15.5:0/3287795958 shutdown_connections 2024-08-31T05:36:15.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:15.883+0000 7f77edd64640 1 -- 172.21.15.5:0/3287795958 wait complete. 2024-08-31T05:36:15.921 INFO:tasks.workunit.client.0.smithi005.stdout: 1 699590 11.78 MB/sec execute 183 sec latency 82.482 ms 2024-08-31T05:36:16.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:16 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/3287795958' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:36:16.485 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.483+0000 7f07b3b1a640 1 -- 172.21.15.5:0/3052923876 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07ac1081d0 msgr2=0x7f07ac1085e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:16.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.483+0000 7f07b3b1a640 1 --2- 172.21.15.5:0/3052923876 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07ac1081d0 0x7f07ac1085e0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f079c009860 tx=0x7f079c02a340 comp rx=0 tx=0).stop 2024-08-31T05:36:16.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.483+0000 7f07b3b1a640 1 -- 172.21.15.5:0/3052923876 shutdown_connections 2024-08-31T05:36:16.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.483+0000 7f07b3b1a640 1 --2- 172.21.15.5:0/3052923876 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07ac108b20 0x7f07ac10f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:16.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.483+0000 7f07b3b1a640 1 --2- 172.21.15.5:0/3052923876 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07ac1081d0 0x7f07ac1085e0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:16.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.483+0000 7f07b3b1a640 1 --2- 172.21.15.5:0/3052923876 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07ac102ed0 0x7f07ac1032e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:16.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.483+0000 7f07b3b1a640 1 -- 172.21.15.5:0/3052923876 >> 172.21.15.5:0/3052923876 conn(0x7f07ac079bf0 msgr2=0x7f07ac07a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:16.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.483+0000 7f07b3b1a640 1 -- 172.21.15.5:0/3052923876 shutdown_connections 2024-08-31T05:36:16.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.483+0000 7f07b3b1a640 1 -- 172.21.15.5:0/3052923876 wait complete. 2024-08-31T05:36:16.488 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.484+0000 7f07b3b1a640 1 Processor -- start 2024-08-31T05:36:16.488 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.484+0000 7f07b3b1a640 1 -- start start 2024-08-31T05:36:16.488 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.484+0000 7f07b3b1a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07ac102ed0 0x7f07ac19b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:16.488 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.484+0000 7f07b3b1a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07ac1081d0 0x7f07ac19b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:16.488 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.484+0000 7f07b3b1a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07ac108b20 0x7f07ac19bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:16.489 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.484+0000 7f07b3b1a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f07ac112780 con 0x7f07ac102ed0 2024-08-31T05:36:16.489 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.484+0000 7f07b3b1a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f07ac112600 con 0x7f07ac108b20 2024-08-31T05:36:16.489 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.484+0000 7f07b3b1a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f07ac112900 con 0x7f07ac1081d0 2024-08-31T05:36:16.489 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.485+0000 7f07b18b6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07ac102ed0 0x7f07ac19b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:16.489 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.485+0000 7f07b18b6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07ac102ed0 0x7f07ac19b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58824/0 (socket says 172.21.15.5:58824) 2024-08-31T05:36:16.489 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.485+0000 7f07b18b6640 1 -- 172.21.15.5:0/3543844368 learned_addr learned my addr 172.21.15.5:0/3543844368 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:16.489 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.485+0000 7f07b10b5640 1 --2- 172.21.15.5:0/3543844368 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07ac1081d0 0x7f07ac19b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:16.489 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.485+0000 7f07b20b7640 1 --2- 172.21.15.5:0/3543844368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07ac108b20 0x7f07ac19bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:16.489 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.485+0000 7f07b18b6640 1 -- 172.21.15.5:0/3543844368 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07ac1081d0 msgr2=0x7f07ac19b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:16.489 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.485+0000 7f07b18b6640 1 --2- 172.21.15.5:0/3543844368 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07ac1081d0 0x7f07ac19b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:16.489 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.485+0000 7f07b18b6640 1 -- 172.21.15.5:0/3543844368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07ac108b20 msgr2=0x7f07ac19bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:16.489 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.485+0000 7f07b18b6640 1 --2- 172.21.15.5:0/3543844368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07ac108b20 0x7f07ac19bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:16.489 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.485+0000 7f07b18b6640 1 -- 172.21.15.5:0/3543844368 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07ac1a6390 con 0x7f07ac102ed0 2024-08-31T05:36:16.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.485+0000 7f07b18b6640 1 --2- 172.21.15.5:0/3543844368 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07ac102ed0 0x7f07ac19b0d0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f07a800ea60 tx=0x7f07a800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:16.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.485+0000 7f07a2ffd640 1 -- 172.21.15.5:0/3543844368 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07a800cde0 con 0x7f07ac102ed0 2024-08-31T05:36:16.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.485+0000 7f07a2ffd640 1 -- 172.21.15.5:0/3543844368 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07a80035f0 con 0x7f07ac102ed0 2024-08-31T05:36:16.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.485+0000 7f07b3b1a640 1 -- 172.21.15.5:0/3543844368 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07ac1a6680 con 0x7f07ac102ed0 2024-08-31T05:36:16.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.485+0000 7f07a2ffd640 1 -- 172.21.15.5:0/3543844368 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07a8010690 con 0x7f07ac102ed0 2024-08-31T05:36:16.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.485+0000 7f07b3b1a640 1 -- 172.21.15.5:0/3543844368 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07ac1a6bf0 con 0x7f07ac102ed0 2024-08-31T05:36:16.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.488+0000 7f07baa80740 1 Processor -- start 2024-08-31T05:36:16.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.488+0000 7f07baa80740 1 -- start start 2024-08-31T05:36:16.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.489+0000 7f07a2ffd640 1 -- 172.21.15.5:0/3543844368 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f07a80037a0 con 0x7f07ac102ed0 2024-08-31T05:36:16.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.489+0000 7f07baa80740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d4c5ace1b0 0x55d4c5e71ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:16.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.489+0000 7f07baa80740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d4c5aa52f0 0x55d4c5e72220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:16.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.489+0000 7f07baa80740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4c5aad4d0 0x55d4c5e72760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:16.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.489+0000 7f07baa80740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55d4c5de7000 con 0x55d4c5aad4d0 2024-08-31T05:36:16.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.489+0000 7f07baa80740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d4c5dd6590 con 0x55d4c5aa52f0 2024-08-31T05:36:16.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.489+0000 7f07baa80740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d4c5dda540 con 0x55d4c5ace1b0 2024-08-31T05:36:16.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.489+0000 7f07b18b6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d4c5aa52f0 0x55d4c5e72220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:16.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.489+0000 7f07b20b7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d4c5ace1b0 0x55d4c5e71ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:16.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.489+0000 7f07b10b5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4c5aad4d0 0x55d4c5e72760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:16.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.489+0000 7f07b20b7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d4c5ace1b0 0x55d4c5e71ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:49644/0 (socket says 172.21.15.5:49644) 2024-08-31T05:36:16.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.489+0000 7f07b20b7640 1 -- 172.21.15.5:0/3956214842 learned_addr learned my addr 172.21.15.5:0/3956214842 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:16.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.489+0000 7f07b20b7640 1 -- 172.21.15.5:0/3956214842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d4c5aa52f0 msgr2=0x55d4c5e72220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:16.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.489+0000 7f07b20b7640 1 --2- 172.21.15.5:0/3956214842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d4c5aa52f0 0x55d4c5e72220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:16.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.489+0000 7f07b20b7640 1 -- 172.21.15.5:0/3956214842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4c5aad4d0 msgr2=0x55d4c5e72760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:16.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.489+0000 7f07b20b7640 1 --2- 172.21.15.5:0/3956214842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4c5aad4d0 0x55d4c5e72760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:16.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.489+0000 7f07b20b7640 1 -- 172.21.15.5:0/3956214842 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4c5b39790 con 0x55d4c5ace1b0 2024-08-31T05:36:16.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.489+0000 7f07b18b6640 1 --2- 172.21.15.5:0/3956214842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d4c5aa52f0 0x55d4c5e72220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:36:16.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.489+0000 7f07b20b7640 1 --2- 172.21.15.5:0/3956214842 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d4c5ace1b0 0x55d4c5e71ce0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f07a400e480 tx=0x7f07a40095c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff7dab0c28deaf52 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:16.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.490+0000 7f07a2ffd640 1 --2- 172.21.15.5:0/3543844368 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f07980b4d20 0x7f07980b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:16.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.490+0000 7f0797fff640 1 -- 172.21.15.5:0/3956214842 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07a400d910 con 0x55d4c5ace1b0 2024-08-31T05:36:16.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.490+0000 7f07b18b6640 1 --2- 172.21.15.5:0/3543844368 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f07980b4d20 0x7f07980b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:16.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.490+0000 7f0797fff640 1 -- 172.21.15.5:0/3956214842 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07a401c070 con 0x55d4c5ace1b0 2024-08-31T05:36:16.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.490+0000 7f0797fff640 1 -- 172.21.15.5:0/3956214842 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07a4017de0 con 0x55d4c5ace1b0 2024-08-31T05:36:16.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.490+0000 7f07a2ffd640 1 -- 172.21.15.5:0/3543844368 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f07a80e5b60 con 0x7f07ac102ed0 2024-08-31T05:36:16.498 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.491+0000 7f07baa80740 1 -- 172.21.15.5:0/3956214842 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d4c5ace1b0 msgr2=0x55d4c5e71ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:16.498 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.491+0000 7f07baa80740 1 --2- 172.21.15.5:0/3956214842 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d4c5ace1b0 0x55d4c5e71ce0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f07a400e480 tx=0x7f07a40095c0 comp rx=0 tx=0).stop 2024-08-31T05:36:16.498 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.491+0000 7f07b18b6640 1 --2- 172.21.15.5:0/3543844368 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f07980b4d20 0x7f07980b7230 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f07a80e2fe0 tx=0x7f07a8093040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:16.498 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.491+0000 7f07baa80740 1 -- 172.21.15.5:0/3956214842 shutdown_connections 2024-08-31T05:36:16.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.491+0000 7f07baa80740 1 --2- 172.21.15.5:0/3956214842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4c5aad4d0 0x55d4c5e72760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:16.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.491+0000 7f07baa80740 1 --2- 172.21.15.5:0/3956214842 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d4c5aa52f0 0x55d4c5e72220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:16.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.491+0000 7f07baa80740 1 --2- 172.21.15.5:0/3956214842 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d4c5ace1b0 0x55d4c5e71ce0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:16.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.491+0000 7f07baa80740 1 -- 172.21.15.5:0/3956214842 >> 172.21.15.5:0/3956214842 conn(0x55d4c5ac2300 msgr2=0x55d4c5e6fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:16.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.491+0000 7f07baa80740 1 -- 172.21.15.5:0/3956214842 shutdown_connections 2024-08-31T05:36:16.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.491+0000 7f07baa80740 1 -- 172.21.15.5:0/3956214842 wait complete. 2024-08-31T05:36:16.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.491+0000 7f07baa80740 1 -- start start 2024-08-31T05:36:16.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.491+0000 7f07baa80740 1 Processor -- start 2024-08-31T05:36:16.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.492+0000 7f07baa80740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d4c5aa52f0 0x55d4c5e7d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:16.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.492+0000 7f07baa80740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d4c5aad4d0 0x55d4c5e7ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:16.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.492+0000 7f07baa80740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4c5ace1b0 0x55d4c5e89780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:16.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.492+0000 7f07baa80740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55d4c5d0fab0 con 0x55d4c5ace1b0 2024-08-31T05:36:16.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.492+0000 7f07baa80740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d4c5d5d680 con 0x55d4c5aad4d0 2024-08-31T05:36:16.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.492+0000 7f07baa80740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d4c5e80460 con 0x55d4c5aa52f0 2024-08-31T05:36:16.500 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.492+0000 7f07baa80740 10 client.0 _ll_register_callbacks cb 0x55d4c5ae5a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:36:16.500 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.492+0000 7f07b20b7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d4c5aa52f0 0x55d4c5e7d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:16.500 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.492+0000 7f07b20b7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d4c5aa52f0 0x55d4c5e7d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:49650/0 (socket says 172.21.15.5:49650) 2024-08-31T05:36:16.500 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.492+0000 7f07b20b7640 1 -- 172.21.15.5:0/3830483693 learned_addr learned my addr 172.21.15.5:0/3830483693 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:16.500 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.492+0000 7f07b20b7640 1 --2- 172.21.15.5:0/3830483693 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4c5ace1b0 0x55d4c5e89780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:16.500 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.492+0000 7f07b10b5640 1 --2- 172.21.15.5:0/3830483693 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d4c5aad4d0 0x55d4c5e7ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:16.500 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.492+0000 7f07b20b7640 1 -- 172.21.15.5:0/3830483693 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d4c5aad4d0 msgr2=0x55d4c5e7ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:16.500 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.492+0000 7f07b20b7640 1 --2- 172.21.15.5:0/3830483693 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d4c5aad4d0 0x55d4c5e7ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:16.500 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.492+0000 7f07b20b7640 1 -- 172.21.15.5:0/3830483693 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4c5ace1b0 msgr2=0x55d4c5e89780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:16.500 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.492+0000 7f07b20b7640 1 --2- 172.21.15.5:0/3830483693 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4c5ace1b0 0x55d4c5e89780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:16.500 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.492+0000 7f07b20b7640 1 -- 172.21.15.5:0/3830483693 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4c5bb2620 con 0x55d4c5aa52f0 2024-08-31T05:36:16.500 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.493+0000 7f07b20b7640 1 --2- 172.21.15.5:0/3830483693 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d4c5aa52f0 0x55d4c5e7d8b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f07a40178c0 tx=0x7f07a40179c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbefe989b7de3fec server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:16.500 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.493+0000 7f07957fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:36:16.501 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.493+0000 7f07957fa640 1 -- 172.21.15.5:0/3830483693 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07a4003970 con 0x55d4c5aa52f0 2024-08-31T05:36:16.501 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.493+0000 7f07baa80740 1 -- 172.21.15.5:0/3830483693 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f07a401c070 con 0x55d4c5aa52f0 2024-08-31T05:36:16.501 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.493+0000 7f07957fa640 1 -- 172.21.15.5:0/3830483693 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f07a4003b10 con 0x55d4c5aa52f0 2024-08-31T05:36:16.501 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.493+0000 7f07957fa640 1 -- 172.21.15.5:0/3830483693 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f07a4003d10 con 0x55d4c5aa52f0 2024-08-31T05:36:16.501 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.493+0000 7f07baa80740 10 client.26812 fetch_fsmap learned FSMap version 34 2024-08-31T05:36:16.501 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.493+0000 7f07baa80740 1 -- 172.21.15.5:0/3830483693 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55d4c5e8c520 con 0x55d4c5aa52f0 2024-08-31T05:36:16.501 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.493+0000 7f07957fa640 1 -- 172.21.15.5:0/3830483693 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07a401c070 con 0x55d4c5aa52f0 2024-08-31T05:36:16.501 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.493+0000 7f07957fa640 1 -- 172.21.15.5:0/3830483693 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f07a400b040 con 0x55d4c5aa52f0 2024-08-31T05:36:16.501 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.493+0000 7f07baa80740 10 client.26812 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:36:16.501 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.493+0000 7f07baa80740 10 client.26812 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:36:16.501 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.493+0000 7f07baa80740 20 client.26812 populate_metadata read hostname 'smithi005' 2024-08-31T05:36:16.501 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.494+0000 7f07baa80740 1 --2- 172.21.15.5:0/3830483693 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d4c5a8cd80 0x55d4c5e8f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:16.501 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.494+0000 7f07baa80740 4 client.26812 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:36:16.501 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.494+0000 7f07baa80740 1 -- 172.21.15.5:0/3830483693 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d4c5de8f50 con 0x55d4c5a8cd80 2024-08-31T05:36:16.502 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.494+0000 7f07b10b5640 1 --2- 172.21.15.5:0/3830483693 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d4c5a8cd80 0x55d4c5e8f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:16.502 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.494+0000 7f07957fa640 10 client.26812 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:36:16.502 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.494+0000 7f07b10b5640 1 --2- 172.21.15.5:0/3830483693 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d4c5a8cd80 0x55d4c5e8f940 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f622cc5474a21c89 server_cookie=898211394e6b7e11 in_seq=0 out_seq=0 2024-08-31T05:36:16.502 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.495+0000 7f07957fa640 1 -- 172.21.15.5:0/3830483693 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d4c5de8f50 con 0x55d4c5a8cd80 2024-08-31T05:36:16.502 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.495+0000 7f07957fa640 10 client.26812 handle_command_reply: tid=0 2024-08-31T05:36:16.502 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.495+0000 7f07baa80740 1 client.26812 shutdown 2024-08-31T05:36:16.502 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.495+0000 7f07baa80740 1 -- 172.21.15.5:0/3830483693 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d4c5aa52f0 msgr2=0x55d4c5e7d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:16.502 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.495+0000 7f07baa80740 1 --2- 172.21.15.5:0/3830483693 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d4c5aa52f0 0x55d4c5e7d8b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f07a40178c0 tx=0x7f07a40179c0 comp rx=0 tx=0).stop 2024-08-31T05:36:16.502 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.495+0000 7f07baa80740 1 -- 172.21.15.5:0/3830483693 shutdown_connections 2024-08-31T05:36:16.502 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.495+0000 7f07baa80740 1 --2- 172.21.15.5:0/3830483693 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d4c5a8cd80 0x55d4c5e8f940 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:16.502 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.495+0000 7f07baa80740 1 --2- 172.21.15.5:0/3830483693 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4c5ace1b0 0x55d4c5e89780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:16.502 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.495+0000 7f07baa80740 1 --2- 172.21.15.5:0/3830483693 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d4c5aad4d0 0x55d4c5e7ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:16.502 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.495+0000 7f07baa80740 1 --2- 172.21.15.5:0/3830483693 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d4c5aa52f0 0x55d4c5e7d8b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:16.503 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.495+0000 7f07957fa640 0 client.26812 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:36:16.503 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.495+0000 7f07baa80740 1 -- 172.21.15.5:0/3830483693 >> 172.21.15.5:0/3830483693 conn(0x55d4c5ac2300 msgr2=0x55d4c5e72d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:16.503 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.495+0000 7f07baa80740 1 -- 172.21.15.5:0/3830483693 shutdown_connections 2024-08-31T05:36:16.503 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.495+0000 7f07baa80740 1 -- 172.21.15.5:0/3830483693 wait complete. 2024-08-31T05:36:16.503 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.495+0000 7f07baa80740 20 client.26812 trim_cache size 0 max 16384 2024-08-31T05:36:16.514 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.510+0000 7f07baa80740 1 Processor -- start 2024-08-31T05:36:16.514 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.510+0000 7f07baa80740 1 -- start start 2024-08-31T05:36:16.514 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.511+0000 7f07baa80740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d4c5aa52f0 0x55d4c5e7f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:16.514 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.511+0000 7f07baa80740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4c5aad4d0 0x55d4c5e6f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:16.514 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.511+0000 7f07baa80740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d4c5ace1b0 0x55d4c5e6f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:16.514 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.511+0000 7f07baa80740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f07ac1b0ce0 con 0x55d4c5aad4d0 2024-08-31T05:36:16.514 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.511+0000 7f07baa80740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f07ac1b2820 con 0x55d4c5aa52f0 2024-08-31T05:36:16.514 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.511+0000 7f07baa80740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f07ac1b13b0 con 0x55d4c5ace1b0 2024-08-31T05:36:16.514 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.511+0000 7f07b10b5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4c5aad4d0 0x55d4c5e6f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:16.514 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.511+0000 7f07b10b5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4c5aad4d0 0x55d4c5e6f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58848/0 (socket says 172.21.15.5:58848) 2024-08-31T05:36:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.511+0000 7f07b10b5640 1 -- 172.21.15.5:0/172797617 learned_addr learned my addr 172.21.15.5:0/172797617 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.511+0000 7f07b20b7640 1 --2- 172.21.15.5:0/172797617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d4c5aa52f0 0x55d4c5e7f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.511+0000 7f07b20b7640 1 --2- 172.21.15.5:0/172797617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d4c5ace1b0 0x55d4c5e6f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.511+0000 7f07b10b5640 1 -- 172.21.15.5:0/172797617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d4c5ace1b0 msgr2=0x55d4c5e6f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.511+0000 7f07b10b5640 1 --2- 172.21.15.5:0/172797617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d4c5ace1b0 0x55d4c5e6f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.511+0000 7f07b10b5640 1 -- 172.21.15.5:0/172797617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d4c5aa52f0 msgr2=0x55d4c5e7f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.511+0000 7f07b10b5640 1 --2- 172.21.15.5:0/172797617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d4c5aa52f0 0x55d4c5e7f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.511+0000 7f07b10b5640 1 -- 172.21.15.5:0/172797617 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4c5e69980 con 0x55d4c5aad4d0 2024-08-31T05:36:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.511+0000 7f07b10b5640 1 --2- 172.21.15.5:0/172797617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4c5aad4d0 0x55d4c5e6f180 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f079c009830 tx=0x7f079c005e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=853515552b44fdc0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.512+0000 7f07977fe640 1 -- 172.21.15.5:0/172797617 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f079c037040 con 0x55d4c5aad4d0 2024-08-31T05:36:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.512+0000 7f07977fe640 1 -- 172.21.15.5:0/172797617 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f079c030450 con 0x55d4c5aad4d0 2024-08-31T05:36:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.512+0000 7f07977fe640 1 -- 172.21.15.5:0/172797617 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f079c003b20 con 0x55d4c5aad4d0 2024-08-31T05:36:16.519 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.512+0000 7f07baa80740 1 -- 172.21.15.5:0/172797617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4c5aad4d0 msgr2=0x55d4c5e6f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:16.519 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.512+0000 7f07baa80740 1 --2- 172.21.15.5:0/172797617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4c5aad4d0 0x55d4c5e6f180 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f079c009830 tx=0x7f079c005e70 comp rx=0 tx=0).stop 2024-08-31T05:36:16.519 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.512+0000 7f07baa80740 1 -- 172.21.15.5:0/172797617 shutdown_connections 2024-08-31T05:36:16.519 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.512+0000 7f07baa80740 1 --2- 172.21.15.5:0/172797617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d4c5ace1b0 0x55d4c5e6f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:16.519 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.512+0000 7f07baa80740 1 --2- 172.21.15.5:0/172797617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4c5aad4d0 0x55d4c5e6f180 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:16.519 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.512+0000 7f07baa80740 1 --2- 172.21.15.5:0/172797617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d4c5aa52f0 0x55d4c5e7f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:16.519 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.512+0000 7f07baa80740 1 -- 172.21.15.5:0/172797617 >> 172.21.15.5:0/172797617 conn(0x55d4c5ac2300 msgr2=0x55d4c5e7cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:16.519 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.513+0000 7f07baa80740 1 -- 172.21.15.5:0/172797617 shutdown_connections 2024-08-31T05:36:16.519 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.513+0000 7f07baa80740 1 -- 172.21.15.5:0/172797617 wait complete. 2024-08-31T05:36:16.519 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.513+0000 7f07baa80740 1 -- start start 2024-08-31T05:36:16.519 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.513+0000 7f07baa80740 1 Processor -- start 2024-08-31T05:36:16.519 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.513+0000 7f07baa80740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d4c5aa52f0 0x55d4c5e85ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:16.520 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.513+0000 7f07baa80740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4c5aad4d0 0x55d4c5e86090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:16.520 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.513+0000 7f07baa80740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d4c5ace1b0 0x55d4c5e810b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:16.520 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.513+0000 7f07baa80740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f07ac1b2150 con 0x55d4c5aad4d0 2024-08-31T05:36:16.520 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.513+0000 7f07baa80740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f07ac1b1a80 con 0x55d4c5aa52f0 2024-08-31T05:36:16.520 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.513+0000 7f07baa80740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f07ac1aecc0 con 0x55d4c5ace1b0 2024-08-31T05:36:16.520 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.513+0000 7f07baa80740 10 client.0 _ll_register_callbacks cb 0x7f07a8005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:36:16.520 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.514+0000 7f07b10b5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4c5aad4d0 0x55d4c5e86090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:16.520 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.514+0000 7f07b20b7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d4c5aa52f0 0x55d4c5e85ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:16.520 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.514+0000 7f07b20b7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d4c5aa52f0 0x55d4c5e85ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:42984/0 (socket says 172.21.15.5:42984) 2024-08-31T05:36:16.520 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.514+0000 7f07b20b7640 1 -- 172.21.15.5:0/1812245706 learned_addr learned my addr 172.21.15.5:0/1812245706 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:16.520 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.514+0000 7f07b20b7640 1 --2- 172.21.15.5:0/1812245706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d4c5ace1b0 0x55d4c5e810b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:16.520 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.514+0000 7f07b10b5640 1 -- 172.21.15.5:0/1812245706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d4c5ace1b0 msgr2=0x55d4c5e810b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:16.520 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.514+0000 7f07b10b5640 1 --2- 172.21.15.5:0/1812245706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d4c5ace1b0 0x55d4c5e810b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:16.521 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.514+0000 7f07b10b5640 1 -- 172.21.15.5:0/1812245706 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d4c5aa52f0 msgr2=0x55d4c5e85ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:16.521 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.514+0000 7f07b10b5640 1 --2- 172.21.15.5:0/1812245706 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d4c5aa52f0 0x55d4c5e85ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:16.521 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.514+0000 7f07b10b5640 1 -- 172.21.15.5:0/1812245706 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4c5e8fda0 con 0x55d4c5aad4d0 2024-08-31T05:36:16.521 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.514+0000 7f07b20b7640 1 --2- 172.21.15.5:0/1812245706 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d4c5aa52f0 0x55d4c5e85ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:36:16.521 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.514+0000 7f07b10b5640 1 --2- 172.21.15.5:0/1812245706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4c5aad4d0 0x55d4c5e86090 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f079c02a860 tx=0x7f079c0035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b603d000108ce7e4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:16.521 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.514+0000 7f07957fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:36:16.521 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.514+0000 7f07957fa640 1 -- 172.21.15.5:0/1812245706 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f079c055060 con 0x55d4c5aad4d0 2024-08-31T05:36:16.521 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.514+0000 7f07957fa640 1 -- 172.21.15.5:0/1812245706 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f079c046440 con 0x55d4c5aad4d0 2024-08-31T05:36:16.521 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.514+0000 7f07baa80740 1 -- 172.21.15.5:0/1812245706 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f079c030450 con 0x55d4c5aad4d0 2024-08-31T05:36:16.521 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.514+0000 7f07957fa640 1 -- 172.21.15.5:0/1812245706 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f079c05c050 con 0x55d4c5aad4d0 2024-08-31T05:36:16.521 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.514+0000 7f07baa80740 10 client.17220 fetch_fsmap learned FSMap version 34 2024-08-31T05:36:16.521 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.514+0000 7f07baa80740 1 -- 172.21.15.5:0/1812245706 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55d4c5ef9b60 con 0x55d4c5aad4d0 2024-08-31T05:36:16.521 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.515+0000 7f07957fa640 1 -- 172.21.15.5:0/1812245706 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f079c030450 con 0x55d4c5aad4d0 2024-08-31T05:36:16.521 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.515+0000 7f07957fa640 1 -- 172.21.15.5:0/1812245706 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f079c044070 con 0x55d4c5aad4d0 2024-08-31T05:36:16.522 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.515+0000 7f07baa80740 10 client.17220 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:36:16.522 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.515+0000 7f07baa80740 10 client.17220 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:36:16.522 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.515+0000 7f07baa80740 20 client.17220 populate_metadata read hostname 'smithi005' 2024-08-31T05:36:16.522 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.515+0000 7f07baa80740 1 --2- 172.21.15.5:0/1812245706 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d4c5a621c0 0x55d4c5efc240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:16.522 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.515+0000 7f07baa80740 4 client.17220 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:36:16.522 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.515+0000 7f07baa80740 1 -- 172.21.15.5:0/1812245706 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d4c5de49f0 con 0x55d4c5a621c0 2024-08-31T05:36:16.522 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.515+0000 7f07b20b7640 1 --2- 172.21.15.5:0/1812245706 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d4c5a621c0 0x55d4c5efc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:16.522 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.515+0000 7f07957fa640 10 client.17220 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:36:16.522 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.515+0000 7f07b20b7640 1 --2- 172.21.15.5:0/1812245706 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d4c5a621c0 0x55d4c5efc240 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ebeef7077b91f64 server_cookie=dcfba0d4240cae17 in_seq=0 out_seq=0 2024-08-31T05:36:16.529 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.527+0000 7f07957fa640 1 -- 172.21.15.5:0/1812245706 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d4c5de49f0 con 0x55d4c5a621c0 2024-08-31T05:36:16.529 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.527+0000 7f07957fa640 10 client.17220 handle_command_reply: tid=0 2024-08-31T05:36:16.529 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.527+0000 7f07baa80740 1 client.17220 shutdown 2024-08-31T05:36:16.529 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.527+0000 7f07baa80740 1 -- 172.21.15.5:0/1812245706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4c5aad4d0 msgr2=0x55d4c5e86090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:16.530 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.527+0000 7f07baa80740 1 --2- 172.21.15.5:0/1812245706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4c5aad4d0 0x55d4c5e86090 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f079c02a860 tx=0x7f079c0035f0 comp rx=0 tx=0).stop 2024-08-31T05:36:16.530 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.527+0000 7f07baa80740 1 -- 172.21.15.5:0/1812245706 shutdown_connections 2024-08-31T05:36:16.530 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.527+0000 7f07baa80740 1 --2- 172.21.15.5:0/1812245706 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d4c5a621c0 0x55d4c5efc240 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:16.530 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.527+0000 7f07baa80740 1 --2- 172.21.15.5:0/1812245706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d4c5ace1b0 0x55d4c5e810b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:16.530 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.527+0000 7f07baa80740 1 --2- 172.21.15.5:0/1812245706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d4c5aad4d0 0x55d4c5e86090 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:16.530 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.527+0000 7f07baa80740 1 --2- 172.21.15.5:0/1812245706 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d4c5aa52f0 0x55d4c5e85ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:16.530 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.527+0000 7f07baa80740 1 -- 172.21.15.5:0/1812245706 >> 172.21.15.5:0/1812245706 conn(0x55d4c5ac2300 msgr2=0x55d4c5e7f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:16.530 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.527+0000 7f07957fa640 0 client.17220 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:36:16.530 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.527+0000 7f07baa80740 1 -- 172.21.15.5:0/1812245706 shutdown_connections 2024-08-31T05:36:16.530 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.527+0000 7f07baa80740 1 -- 172.21.15.5:0/1812245706 wait complete. 2024-08-31T05:36:16.530 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.527+0000 7f07baa80740 20 client.17220 trim_cache size 0 max 16384 2024-08-31T05:36:16.531 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:36:16.531 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:36:16.531 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:36:16.531 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:36:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.528+0000 7f07b3b1a640 1 -- 172.21.15.5:0/3543844368 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f07980b4d20 msgr2=0x7f07980b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.528+0000 7f07b3b1a640 1 --2- 172.21.15.5:0/3543844368 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f07980b4d20 0x7f07980b7230 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f07a80e2fe0 tx=0x7f07a8093040 comp rx=0 tx=0).stop 2024-08-31T05:36:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.528+0000 7f07b3b1a640 1 -- 172.21.15.5:0/3543844368 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07ac102ed0 msgr2=0x7f07ac19b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.528+0000 7f07b3b1a640 1 --2- 172.21.15.5:0/3543844368 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07ac102ed0 0x7f07ac19b0d0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f07a800ea60 tx=0x7f07a800ef20 comp rx=0 tx=0).stop 2024-08-31T05:36:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.528+0000 7f07b3b1a640 1 -- 172.21.15.5:0/3543844368 shutdown_connections 2024-08-31T05:36:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.528+0000 7f07b3b1a640 1 --2- 172.21.15.5:0/3543844368 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f07980b4d20 0x7f07980b7230 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.528+0000 7f07b3b1a640 1 --2- 172.21.15.5:0/3543844368 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f07ac108b20 0x7f07ac19bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.528+0000 7f07b3b1a640 1 --2- 172.21.15.5:0/3543844368 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07ac1081d0 0x7f07ac19b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.528+0000 7f07b3b1a640 1 --2- 172.21.15.5:0/3543844368 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07ac102ed0 0x7f07ac19b0d0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.528+0000 7f07b3b1a640 1 -- 172.21.15.5:0/3543844368 >> 172.21.15.5:0/3543844368 conn(0x7f07ac079bf0 msgr2=0x7f07ac1062c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.528+0000 7f07b3b1a640 1 -- 172.21.15.5:0/3543844368 shutdown_connections 2024-08-31T05:36:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:16.528+0000 7f07b3b1a640 1 -- 172.21.15.5:0/3543844368 wait complete. 2024-08-31T05:36:16.572 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-31T05:36:16.585 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:16 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/3287795958' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:36:16.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:16 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/3287795958' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:36:16.890 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:36:16.921 INFO:tasks.workunit.client.0.smithi005.stdout: 1 701152 11.75 MB/sec execute 184 sec latency 19.893 ms 2024-08-31T05:36:17.339 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:17 smithi005 ceph-mon[18602]: pgmap v534: 129 pgs: 129 active+clean; 393 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.2 MiB/s wr, 283 op/s 2024-08-31T05:36:17.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.430+0000 7fbc647cd640 1 -- 172.21.15.5:0/4245377721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc5c108ac0 msgr2=0x7fbc5c10f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:17.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.430+0000 7fbc647cd640 1 --2- 172.21.15.5:0/4245377721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc5c108ac0 0x7fbc5c10f2f0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fbc54009ca0 tx=0x7fbc5402a8c0 comp rx=0 tx=0).stop 2024-08-31T05:36:17.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.430+0000 7fbc647cd640 1 -- 172.21.15.5:0/4245377721 shutdown_connections 2024-08-31T05:36:17.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.430+0000 7fbc647cd640 1 --2- 172.21.15.5:0/4245377721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc5c108ac0 0x7fbc5c10f2f0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:17.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.430+0000 7fbc647cd640 1 --2- 172.21.15.5:0/4245377721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc5c108170 0x7fbc5c108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:17.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.430+0000 7fbc647cd640 1 --2- 172.21.15.5:0/4245377721 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbc5c102880 0x7fbc5c102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:17.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.430+0000 7fbc647cd640 1 -- 172.21.15.5:0/4245377721 >> 172.21.15.5:0/4245377721 conn(0x7fbc5c079500 msgr2=0x7fbc5c079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:17.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.430+0000 7fbc647cd640 1 -- 172.21.15.5:0/4245377721 shutdown_connections 2024-08-31T05:36:17.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.430+0000 7fbc647cd640 1 -- 172.21.15.5:0/4245377721 wait complete. 2024-08-31T05:36:17.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.431+0000 7fbc647cd640 1 Processor -- start 2024-08-31T05:36:17.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.431+0000 7fbc647cd640 1 -- start start 2024-08-31T05:36:17.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.431+0000 7fbc647cd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbc5c102880 0x7fbc5c19afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:17.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.431+0000 7fbc647cd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc5c108170 0x7fbc5c19b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:17.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.431+0000 7fbc647cd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc5c108ac0 0x7fbc5c19ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:17.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.431+0000 7fbc647cd640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbc5c112740 con 0x7fbc5c108ac0 2024-08-31T05:36:17.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.431+0000 7fbc647cd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbc5c1125c0 con 0x7fbc5c108170 2024-08-31T05:36:17.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.431+0000 7fbc647cd640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbc5c1128c0 con 0x7fbc5c102880 2024-08-31T05:36:17.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.431+0000 7fbc62d6a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc5c108ac0 0x7fbc5c19ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:17.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.431+0000 7fbc62569640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbc5c102880 0x7fbc5c19afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:17.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.431+0000 7fbc62d6a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc5c108ac0 0x7fbc5c19ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58888/0 (socket says 172.21.15.5:58888) 2024-08-31T05:36:17.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.431+0000 7fbc62569640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbc5c102880 0x7fbc5c19afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:49692/0 (socket says 172.21.15.5:49692) 2024-08-31T05:36:17.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.431+0000 7fbc62d6a640 1 -- 172.21.15.5:0/3636547931 learned_addr learned my addr 172.21.15.5:0/3636547931 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:17.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.431+0000 7fbc61d68640 1 --2- 172.21.15.5:0/3636547931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc5c108170 0x7fbc5c19b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:17.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.431+0000 7fbc62d6a640 1 -- 172.21.15.5:0/3636547931 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbc5c102880 msgr2=0x7fbc5c19afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:17.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.431+0000 7fbc62d6a640 1 --2- 172.21.15.5:0/3636547931 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbc5c102880 0x7fbc5c19afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:17.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.431+0000 7fbc62d6a640 1 -- 172.21.15.5:0/3636547931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc5c108170 msgr2=0x7fbc5c19b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:17.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.431+0000 7fbc62d6a640 1 --2- 172.21.15.5:0/3636547931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc5c108170 0x7fbc5c19b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:17.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.431+0000 7fbc62d6a640 1 -- 172.21.15.5:0/3636547931 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc5c1a6240 con 0x7fbc5c108ac0 2024-08-31T05:36:17.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.432+0000 7fbc62d6a640 1 --2- 172.21.15.5:0/3636547931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc5c108ac0 0x7fbc5c19ba30 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fbc54005cc0 tx=0x7fbc54031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:17.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.432+0000 7fbc537fe640 1 -- 172.21.15.5:0/3636547931 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc54003b70 con 0x7fbc5c108ac0 2024-08-31T05:36:17.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.432+0000 7fbc537fe640 1 -- 172.21.15.5:0/3636547931 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc540318f0 con 0x7fbc5c108ac0 2024-08-31T05:36:17.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.432+0000 7fbc537fe640 1 -- 172.21.15.5:0/3636547931 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc5402f950 con 0x7fbc5c108ac0 2024-08-31T05:36:17.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.432+0000 7fbc647cd640 1 -- 172.21.15.5:0/3636547931 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc5c1a64d0 con 0x7fbc5c108ac0 2024-08-31T05:36:17.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.432+0000 7fbc647cd640 1 -- 172.21.15.5:0/3636547931 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc5c1a6a10 con 0x7fbc5c108ac0 2024-08-31T05:36:17.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.435+0000 7fbc6ad42740 1 Processor -- start 2024-08-31T05:36:17.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.435+0000 7fbc537fe640 1 -- 172.21.15.5:0/3636547931 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fbc5402faf0 con 0x7fbc5c108ac0 2024-08-31T05:36:17.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.435+0000 7fbc6ad42740 1 -- start start 2024-08-31T05:36:17.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.435+0000 7fbc6ad42740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fad8efc070 0x55fad92a1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:17.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.435+0000 7fbc6ad42740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fad8ed31b0 0x55fad92a1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:17.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.435+0000 7fbc6ad42740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fad8edb390 0x55fad92a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:17.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.435+0000 7fbc6ad42740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55fad9218680 con 0x55fad8edb390 2024-08-31T05:36:17.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.435+0000 7fbc6ad42740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55fad9207c10 con 0x55fad8efc070 2024-08-31T05:36:17.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.435+0000 7fbc6ad42740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fad920bbc0 con 0x55fad8ed31b0 2024-08-31T05:36:17.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.435+0000 7fbc61d68640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fad8efc070 0x55fad92a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:17.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.435+0000 7fbc62569640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fad8ed31b0 0x55fad92a1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:17.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.435+0000 7fbc62569640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fad8ed31b0 0x55fad92a1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:49698/0 (socket says 172.21.15.5:49698) 2024-08-31T05:36:17.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.435+0000 7fbc62569640 1 -- 172.21.15.5:0/1993026444 learned_addr learned my addr 172.21.15.5:0/1993026444 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:17.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.435+0000 7fbc61d68640 1 --2- 172.21.15.5:0/1993026444 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fad8edb390 0x55fad92a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:17.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.436+0000 7fbc537fe640 1 --2- 172.21.15.5:0/3636547931 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fbc480b4cd0 0x7fbc480b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:17.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.436+0000 7fbc62569640 1 -- 172.21.15.5:0/1993026444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fad8efc070 msgr2=0x55fad92a1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:17.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.436+0000 7fbc62569640 1 --2- 172.21.15.5:0/1993026444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fad8efc070 0x55fad92a1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:17.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.436+0000 7fbc62569640 1 -- 172.21.15.5:0/1993026444 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fad8edb390 msgr2=0x55fad92a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:17.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.436+0000 7fbc62569640 1 --2- 172.21.15.5:0/1993026444 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fad8edb390 0x55fad92a1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:17.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.436+0000 7fbc62569640 1 -- 172.21.15.5:0/1993026444 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fad8f67650 con 0x55fad8ed31b0 2024-08-31T05:36:17.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.436+0000 7fbc62d6a640 1 --2- 172.21.15.5:0/3636547931 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fbc480b4cd0 0x7fbc480b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:17.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.436+0000 7fbc62569640 1 --2- 172.21.15.5:0/1993026444 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fad8ed31b0 0x55fad92a1850 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbc58009ca0 tx=0x7fbc58011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5202f3f0b7afefbd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:17.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.436+0000 7fbc537fe640 1 -- 172.21.15.5:0/3636547931 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fbc54106a00 con 0x7fbc5c108ac0 2024-08-31T05:36:17.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.436+0000 7fbc50ff9640 1 -- 172.21.15.5:0/1993026444 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc58005220 con 0x55fad8ed31b0 2024-08-31T05:36:17.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.436+0000 7fbc50ff9640 1 -- 172.21.15.5:0/1993026444 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc58004c50 con 0x55fad8ed31b0 2024-08-31T05:36:17.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.436+0000 7fbc50ff9640 1 -- 172.21.15.5:0/1993026444 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc58019670 con 0x55fad8ed31b0 2024-08-31T05:36:17.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.437+0000 7fbc6ad42740 1 -- 172.21.15.5:0/1993026444 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fad8ed31b0 msgr2=0x55fad92a1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:17.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.437+0000 7fbc6ad42740 1 --2- 172.21.15.5:0/1993026444 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fad8ed31b0 0x55fad92a1850 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbc58009ca0 tx=0x7fbc58011810 comp rx=0 tx=0).stop 2024-08-31T05:36:17.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.437+0000 7fbc62d6a640 1 --2- 172.21.15.5:0/3636547931 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fbc480b4cd0 0x7fbc480b71e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fbc54103e80 tx=0x7fbc540a2040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:17.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.437+0000 7fbc6ad42740 1 -- 172.21.15.5:0/1993026444 shutdown_connections 2024-08-31T05:36:17.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.437+0000 7fbc6ad42740 1 --2- 172.21.15.5:0/1993026444 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fad8edb390 0x55fad92a1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:17.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.437+0000 7fbc6ad42740 1 --2- 172.21.15.5:0/1993026444 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fad8ed31b0 0x55fad92a1850 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:17.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.437+0000 7fbc6ad42740 1 --2- 172.21.15.5:0/1993026444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fad8efc070 0x55fad92a1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:17.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.437+0000 7fbc6ad42740 1 -- 172.21.15.5:0/1993026444 >> 172.21.15.5:0/1993026444 conn(0x55fad8ef0460 msgr2=0x55fad929f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:17.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.437+0000 7fbc6ad42740 1 -- 172.21.15.5:0/1993026444 shutdown_connections 2024-08-31T05:36:17.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.437+0000 7fbc6ad42740 1 -- 172.21.15.5:0/1993026444 wait complete. 2024-08-31T05:36:17.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.438+0000 7fbc6ad42740 1 -- start start 2024-08-31T05:36:17.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.438+0000 7fbc6ad42740 1 Processor -- start 2024-08-31T05:36:17.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.438+0000 7fbc6ad42740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fad8ed31b0 0x55fad92acaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:17.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.438+0000 7fbc6ad42740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fad8edb390 0x55fad92acfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:17.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.438+0000 7fbc6ad42740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fad8efc070 0x55fad92b8de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:17.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.438+0000 7fbc6ad42740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55fad906a700 con 0x55fad8edb390 2024-08-31T05:36:17.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.438+0000 7fbc6ad42740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55fad918e750 con 0x55fad8efc070 2024-08-31T05:36:17.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.438+0000 7fbc6ad42740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fad92afaf0 con 0x55fad8ed31b0 2024-08-31T05:36:17.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.438+0000 7fbc6ad42740 10 client.0 _ll_register_callbacks cb 0x55fad91bde10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:36:17.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.438+0000 7fbc62569640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fad8edb390 0x55fad92acfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:17.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.438+0000 7fbc62569640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fad8edb390 0x55fad92acfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58908/0 (socket says 172.21.15.5:58908) 2024-08-31T05:36:17.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.438+0000 7fbc62569640 1 -- 172.21.15.5:0/3877900483 learned_addr learned my addr 172.21.15.5:0/3877900483 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:17.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.438+0000 7fbc61d68640 1 --2- 172.21.15.5:0/3877900483 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fad8ed31b0 0x55fad92acaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:17.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.438+0000 7fbc61d68640 1 --2- 172.21.15.5:0/3877900483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fad8efc070 0x55fad92b8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:17.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.439+0000 7fbc62569640 1 -- 172.21.15.5:0/3877900483 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fad8ed31b0 msgr2=0x55fad92acaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:17.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.439+0000 7fbc62569640 1 --2- 172.21.15.5:0/3877900483 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fad8ed31b0 0x55fad92acaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:17.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.439+0000 7fbc62569640 1 -- 172.21.15.5:0/3877900483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fad8efc070 msgr2=0x55fad92b8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:17.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.439+0000 7fbc62569640 1 --2- 172.21.15.5:0/3877900483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fad8efc070 0x55fad92b8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:17.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.439+0000 7fbc62569640 1 -- 172.21.15.5:0/3877900483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fad91c7900 con 0x55fad8edb390 2024-08-31T05:36:17.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.439+0000 7fbc61d68640 1 --2- 172.21.15.5:0/3877900483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fad8efc070 0x55fad92b8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:36:17.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.439+0000 7fbc62569640 1 --2- 172.21.15.5:0/3877900483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fad8edb390 0x55fad92acfe0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fbc58005230 tx=0x7fbc58005260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=201accb0fe7e20bf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:17.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.439+0000 7fbc45ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:36:17.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.439+0000 7fbc45ffb640 1 -- 172.21.15.5:0/3877900483 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc58029070 con 0x55fad8edb390 2024-08-31T05:36:17.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.439+0000 7fbc45ffb640 1 -- 172.21.15.5:0/3877900483 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fbc58023630 con 0x55fad8edb390 2024-08-31T05:36:17.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.439+0000 7fbc6ad42740 1 -- 172.21.15.5:0/3877900483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc58004c50 con 0x55fad8edb390 2024-08-31T05:36:17.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.439+0000 7fbc45ffb640 1 -- 172.21.15.5:0/3877900483 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fbc58035050 con 0x55fad8edb390 2024-08-31T05:36:17.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.439+0000 7fbc6ad42740 10 client.17232 fetch_fsmap learned FSMap version 34 2024-08-31T05:36:17.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.439+0000 7fbc6ad42740 1 -- 172.21.15.5:0/3877900483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55fad92bb8d0 con 0x55fad8edb390 2024-08-31T05:36:17.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.439+0000 7fbc45ffb640 1 -- 172.21.15.5:0/3877900483 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc58004c50 con 0x55fad8edb390 2024-08-31T05:36:17.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.440+0000 7fbc45ffb640 1 -- 172.21.15.5:0/3877900483 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fbc58019430 con 0x55fad8edb390 2024-08-31T05:36:17.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.440+0000 7fbc6ad42740 10 client.17232 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:36:17.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.440+0000 7fbc6ad42740 10 client.17232 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-31T05:36:17.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.440+0000 7fbc6ad42740 20 client.17232 populate_metadata read hostname 'smithi005' 2024-08-31T05:36:17.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.440+0000 7fbc6ad42740 1 --2- 172.21.15.5:0/3877900483 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55fad8eba9f0 0x55fad92bec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:17.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.440+0000 7fbc6ad42740 4 client.17232 mds_command: new command op to 24602 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:36:17.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.440+0000 7fbc6ad42740 1 -- 172.21.15.5:0/3877900483 --> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fad921a5d0 con 0x55fad8eba9f0 2024-08-31T05:36:17.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.440+0000 7fbc61d68640 1 --2- 172.21.15.5:0/3877900483 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55fad8eba9f0 0x55fad92bec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:17.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.440+0000 7fbc61d68640 1 --2- 172.21.15.5:0/3877900483 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55fad8eba9f0 0x55fad92bec30 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=37c4281a7f39e3a9 server_cookie=248b4f0bd9b8649b in_seq=0 out_seq=0 2024-08-31T05:36:17.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.440+0000 7fbc45ffb640 10 client.17232 ms_handle_connect on v2:172.21.15.50:6836/428759669 2024-08-31T05:36:17.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.441+0000 7fbc45ffb640 1 -- 172.21.15.5:0/3877900483 <== mds.4 v2:172.21.15.50:6836/428759669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fad921a5d0 con 0x55fad8eba9f0 2024-08-31T05:36:17.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.441+0000 7fbc45ffb640 10 client.17232 handle_command_reply: tid=0 2024-08-31T05:36:17.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.441+0000 7fbc6ad42740 1 client.17232 shutdown 2024-08-31T05:36:17.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.441+0000 7fbc6ad42740 1 -- 172.21.15.5:0/3877900483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fad8edb390 msgr2=0x55fad92acfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:17.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.441+0000 7fbc6ad42740 1 --2- 172.21.15.5:0/3877900483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fad8edb390 0x55fad92acfe0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fbc58005230 tx=0x7fbc58005260 comp rx=0 tx=0).stop 2024-08-31T05:36:17.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.442+0000 7fbc6ad42740 1 -- 172.21.15.5:0/3877900483 shutdown_connections 2024-08-31T05:36:17.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.442+0000 7fbc6ad42740 1 --2- 172.21.15.5:0/3877900483 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55fad8eba9f0 0x55fad92bec30 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:17.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.442+0000 7fbc6ad42740 1 --2- 172.21.15.5:0/3877900483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fad8efc070 0x55fad92b8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:17.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.442+0000 7fbc6ad42740 1 --2- 172.21.15.5:0/3877900483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fad8edb390 0x55fad92acfe0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:17.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.442+0000 7fbc6ad42740 1 --2- 172.21.15.5:0/3877900483 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fad8ed31b0 0x55fad92acaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:17.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.442+0000 7fbc6ad42740 1 -- 172.21.15.5:0/3877900483 >> 172.21.15.5:0/3877900483 conn(0x55fad8ef0460 msgr2=0x55fad92a44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:17.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.442+0000 7fbc45ffb640 0 client.17232 ms_handle_reset on v2:172.21.15.50:6836/428759669 2024-08-31T05:36:17.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.442+0000 7fbc6ad42740 1 -- 172.21.15.5:0/3877900483 shutdown_connections 2024-08-31T05:36:17.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.442+0000 7fbc6ad42740 1 -- 172.21.15.5:0/3877900483 wait complete. 2024-08-31T05:36:17.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.442+0000 7fbc6ad42740 20 client.17232 trim_cache size 0 max 16384 2024-08-31T05:36:17.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.456+0000 7fbc6ad42740 1 Processor -- start 2024-08-31T05:36:17.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.456+0000 7fbc6ad42740 1 -- start start 2024-08-31T05:36:17.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.456+0000 7fbc6ad42740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fad8ed31b0 0x55fad92ae6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:17.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.456+0000 7fbc6ad42740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fad8edb390 0x55fad92b8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:17.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.456+0000 7fbc6ad42740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fad8efc070 0x55fad92b9220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:17.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.456+0000 7fbc6ad42740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbc5c1b0be0 con 0x55fad8ed31b0 2024-08-31T05:36:17.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.456+0000 7fbc6ad42740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbc5c1b2720 con 0x55fad8efc070 2024-08-31T05:36:17.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.456+0000 7fbc6ad42740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbc5c1b12b0 con 0x55fad8edb390 2024-08-31T05:36:17.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.456+0000 7fbc61d68640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fad8ed31b0 0x55fad92ae6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:17.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.457+0000 7fbc61d68640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fad8ed31b0 0x55fad92ae6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58914/0 (socket says 172.21.15.5:58914) 2024-08-31T05:36:17.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.457+0000 7fbc62569640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fad8edb390 0x55fad92b8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:17.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.457+0000 7fbc61d68640 1 -- 172.21.15.5:0/3926642426 learned_addr learned my addr 172.21.15.5:0/3926642426 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:17.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.457+0000 7fbc61d68640 1 --2- 172.21.15.5:0/3926642426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fad8efc070 0x55fad92b9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:17.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.457+0000 7fbc61d68640 1 -- 172.21.15.5:0/3926642426 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fad8edb390 msgr2=0x55fad92b8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:17.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.457+0000 7fbc61d68640 1 --2- 172.21.15.5:0/3926642426 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fad8edb390 0x55fad92b8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:17.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.457+0000 7fbc61d68640 1 -- 172.21.15.5:0/3926642426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fad8efc070 msgr2=0x55fad92b9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:17.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.457+0000 7fbc61d68640 1 --2- 172.21.15.5:0/3926642426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fad8efc070 0x55fad92b9220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:17.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.457+0000 7fbc61d68640 1 -- 172.21.15.5:0/3926642426 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fad92a4170 con 0x55fad8ed31b0 2024-08-31T05:36:17.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.457+0000 7fbc62569640 1 --2- 172.21.15.5:0/3926642426 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fad8edb390 0x55fad92b8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:36:17.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.457+0000 7fbc61d68640 1 --2- 172.21.15.5:0/3926642426 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fad8ed31b0 0x55fad92ae6d0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c000c00 tx=0x7fbc4c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d7dd7042b68372d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:17.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.457+0000 7fbc47fff640 1 -- 172.21.15.5:0/3926642426 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c0043f0 con 0x55fad8ed31b0 2024-08-31T05:36:17.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.457+0000 7fbc47fff640 1 -- 172.21.15.5:0/3926642426 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc4c00ec90 con 0x55fad8ed31b0 2024-08-31T05:36:17.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.457+0000 7fbc47fff640 1 -- 172.21.15.5:0/3926642426 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c011ca0 con 0x55fad8ed31b0 2024-08-31T05:36:17.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.458+0000 7fbc6ad42740 1 -- 172.21.15.5:0/3926642426 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fad8ed31b0 msgr2=0x55fad92ae6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:17.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.458+0000 7fbc6ad42740 1 --2- 172.21.15.5:0/3926642426 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fad8ed31b0 0x55fad92ae6d0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c000c00 tx=0x7fbc4c005f90 comp rx=0 tx=0).stop 2024-08-31T05:36:17.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.458+0000 7fbc6ad42740 1 -- 172.21.15.5:0/3926642426 shutdown_connections 2024-08-31T05:36:17.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.458+0000 7fbc6ad42740 1 --2- 172.21.15.5:0/3926642426 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fad8efc070 0x55fad92b9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:17.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.458+0000 7fbc6ad42740 1 --2- 172.21.15.5:0/3926642426 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fad8edb390 0x55fad92b8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:17.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.458+0000 7fbc6ad42740 1 --2- 172.21.15.5:0/3926642426 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fad8ed31b0 0x55fad92ae6d0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:17.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.458+0000 7fbc6ad42740 1 -- 172.21.15.5:0/3926642426 >> 172.21.15.5:0/3926642426 conn(0x55fad8ef0460 msgr2=0x55fad92adfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:17.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.458+0000 7fbc6ad42740 1 -- 172.21.15.5:0/3926642426 shutdown_connections 2024-08-31T05:36:17.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.458+0000 7fbc6ad42740 1 -- 172.21.15.5:0/3926642426 wait complete. 2024-08-31T05:36:17.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.459+0000 7fbc6ad42740 1 -- start start 2024-08-31T05:36:17.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.459+0000 7fbc6ad42740 1 Processor -- start 2024-08-31T05:36:17.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.459+0000 7fbc6ad42740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fad8ed31b0 0x55fad92b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:17.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.459+0000 7fbc6ad42740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fad8edb390 0x55fad92b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:17.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.459+0000 7fbc6ad42740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fad8efc070 0x55fad92b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:17.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.459+0000 7fbc6ad42740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbc5c1b2050 con 0x55fad8ed31b0 2024-08-31T05:36:17.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.459+0000 7fbc6ad42740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbc5c1b1980 con 0x55fad8efc070 2024-08-31T05:36:17.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.459+0000 7fbc6ad42740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbc5c1aebc0 con 0x55fad8edb390 2024-08-31T05:36:17.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.459+0000 7fbc6ad42740 10 client.0 _ll_register_callbacks cb 0x7fbc4c009e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:36:17.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.459+0000 7fbc61d68640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fad8ed31b0 0x55fad92b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:17.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.459+0000 7fbc62569640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fad8edb390 0x55fad92b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:17.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.459+0000 7fbc61d68640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fad8ed31b0 0x55fad92b0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58920/0 (socket says 172.21.15.5:58920) 2024-08-31T05:36:17.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.459+0000 7fbc61d68640 1 -- 172.21.15.5:0/1999750248 learned_addr learned my addr 172.21.15.5:0/1999750248 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:17.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.460+0000 7fbc61d68640 1 --2- 172.21.15.5:0/1999750248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fad8efc070 0x55fad92b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:17.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.460+0000 7fbc62569640 1 -- 172.21.15.5:0/1999750248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fad8efc070 msgr2=0x55fad92b18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:17.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.460+0000 7fbc62569640 1 --2- 172.21.15.5:0/1999750248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fad8efc070 0x55fad92b18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:17.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.460+0000 7fbc62569640 1 -- 172.21.15.5:0/1999750248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fad8ed31b0 msgr2=0x55fad92b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:17.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.460+0000 7fbc62569640 1 --2- 172.21.15.5:0/1999750248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fad8ed31b0 0x55fad92b0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:17.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.460+0000 7fbc62569640 1 -- 172.21.15.5:0/1999750248 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fad9328620 con 0x55fad8edb390 2024-08-31T05:36:17.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.460+0000 7fbc61d68640 1 --2- 172.21.15.5:0/1999750248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fad8ed31b0 0x55fad92b0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:36:17.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.460+0000 7fbc62569640 1 --2- 172.21.15.5:0/1999750248 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fad8edb390 0x55fad92b13a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbc58009250 tx=0x7fbc58005dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95e3a93253662564 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:17.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.460+0000 7fbc45ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:36:17.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.460+0000 7fbc45ffb640 1 -- 172.21.15.5:0/1999750248 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc5803e060 con 0x55fad8edb390 2024-08-31T05:36:17.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.460+0000 7fbc6ad42740 1 -- 172.21.15.5:0/1999750248 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc4c00ec90 con 0x55fad8edb390 2024-08-31T05:36:17.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.460+0000 7fbc45ffb640 1 -- 172.21.15.5:0/1999750248 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fbc58019a70 con 0x55fad8edb390 2024-08-31T05:36:17.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.460+0000 7fbc45ffb640 1 -- 172.21.15.5:0/1999750248 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fbc58045050 con 0x55fad8edb390 2024-08-31T05:36:17.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.460+0000 7fbc6ad42740 10 client.26836 fetch_fsmap learned FSMap version 34 2024-08-31T05:36:17.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.460+0000 7fbc6ad42740 1 -- 172.21.15.5:0/1999750248 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55fad9329880 con 0x55fad8edb390 2024-08-31T05:36:17.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.461+0000 7fbc45ffb640 1 -- 172.21.15.5:0/1999750248 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc4c00ec90 con 0x55fad8edb390 2024-08-31T05:36:17.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.461+0000 7fbc45ffb640 1 -- 172.21.15.5:0/1999750248 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fbc58004150 con 0x55fad8edb390 2024-08-31T05:36:17.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.461+0000 7fbc6ad42740 10 client.26836 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:36:17.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.461+0000 7fbc6ad42740 10 client.26836 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-31T05:36:17.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.461+0000 7fbc6ad42740 20 client.26836 populate_metadata read hostname 'smithi005' 2024-08-31T05:36:17.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.461+0000 7fbc6ad42740 1 --2- 172.21.15.5:0/1999750248 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55fad8e8fda0 0x55fad932bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:17.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.461+0000 7fbc6ad42740 4 client.26836 mds_command: new command op to 24602 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:36:17.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.461+0000 7fbc6ad42740 1 -- 172.21.15.5:0/1999750248 --> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fad9216070 con 0x55fad8e8fda0 2024-08-31T05:36:17.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.461+0000 7fbc61d68640 1 --2- 172.21.15.5:0/1999750248 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55fad8e8fda0 0x55fad932bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:17.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.462+0000 7fbc45ffb640 10 client.26836 ms_handle_connect on v2:172.21.15.50:6836/428759669 2024-08-31T05:36:17.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.462+0000 7fbc61d68640 1 --2- 172.21.15.5:0/1999750248 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55fad8e8fda0 0x55fad932bf50 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e5027d4e78db213c server_cookie=60bed3631d566f19 in_seq=0 out_seq=0 2024-08-31T05:36:17.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.462+0000 7fbc45ffb640 1 -- 172.21.15.5:0/1999750248 <== mds.4 v2:172.21.15.50:6836/428759669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fad9216070 con 0x55fad8e8fda0 2024-08-31T05:36:17.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.462+0000 7fbc45ffb640 10 client.26836 handle_command_reply: tid=0 2024-08-31T05:36:17.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.462+0000 7fbc6ad42740 1 client.26836 shutdown 2024-08-31T05:36:17.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.462+0000 7fbc6ad42740 1 -- 172.21.15.5:0/1999750248 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fad8edb390 msgr2=0x55fad92b13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:17.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.462+0000 7fbc6ad42740 1 --2- 172.21.15.5:0/1999750248 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fad8edb390 0x55fad92b13a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbc58009250 tx=0x7fbc58005dc0 comp rx=0 tx=0).stop 2024-08-31T05:36:17.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.462+0000 7fbc6ad42740 1 -- 172.21.15.5:0/1999750248 shutdown_connections 2024-08-31T05:36:17.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.462+0000 7fbc6ad42740 1 --2- 172.21.15.5:0/1999750248 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55fad8e8fda0 0x55fad932bf50 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:17.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.462+0000 7fbc45ffb640 0 client.26836 ms_handle_reset on v2:172.21.15.50:6836/428759669 2024-08-31T05:36:17.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.462+0000 7fbc6ad42740 1 --2- 172.21.15.5:0/1999750248 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fad8efc070 0x55fad92b18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:17.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.462+0000 7fbc6ad42740 1 --2- 172.21.15.5:0/1999750248 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fad8edb390 0x55fad92b13a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:17.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.462+0000 7fbc6ad42740 1 --2- 172.21.15.5:0/1999750248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fad8ed31b0 0x55fad92b0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:17.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.462+0000 7fbc6ad42740 1 -- 172.21.15.5:0/1999750248 >> 172.21.15.5:0/1999750248 conn(0x55fad8ef0460 msgr2=0x55fad92a4b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:17.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.462+0000 7fbc6ad42740 1 -- 172.21.15.5:0/1999750248 shutdown_connections 2024-08-31T05:36:17.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.462+0000 7fbc6ad42740 1 -- 172.21.15.5:0/1999750248 wait complete. 2024-08-31T05:36:17.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.462+0000 7fbc6ad42740 20 client.26836 trim_cache size 0 max 16384 2024-08-31T05:36:17.482 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:36:17.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.463+0000 7fbc647cd640 1 -- 172.21.15.5:0/3636547931 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fbc480b4cd0 msgr2=0x7fbc480b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:17.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.463+0000 7fbc647cd640 1 --2- 172.21.15.5:0/3636547931 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fbc480b4cd0 0x7fbc480b71e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fbc54103e80 tx=0x7fbc540a2040 comp rx=0 tx=0).stop 2024-08-31T05:36:17.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.463+0000 7fbc647cd640 1 -- 172.21.15.5:0/3636547931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc5c108ac0 msgr2=0x7fbc5c19ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:17.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.463+0000 7fbc647cd640 1 --2- 172.21.15.5:0/3636547931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc5c108ac0 0x7fbc5c19ba30 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fbc54005cc0 tx=0x7fbc54031700 comp rx=0 tx=0).stop 2024-08-31T05:36:17.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.463+0000 7fbc647cd640 1 -- 172.21.15.5:0/3636547931 shutdown_connections 2024-08-31T05:36:17.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.463+0000 7fbc647cd640 1 --2- 172.21.15.5:0/3636547931 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fbc480b4cd0 0x7fbc480b71e0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:17.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.463+0000 7fbc647cd640 1 --2- 172.21.15.5:0/3636547931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc5c108ac0 0x7fbc5c19ba30 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:17.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.463+0000 7fbc647cd640 1 --2- 172.21.15.5:0/3636547931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbc5c108170 0x7fbc5c19b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:17.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.463+0000 7fbc647cd640 1 --2- 172.21.15.5:0/3636547931 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbc5c102880 0x7fbc5c19afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:17.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.463+0000 7fbc647cd640 1 -- 172.21.15.5:0/3636547931 >> 172.21.15.5:0/3636547931 conn(0x7fbc5c079500 msgr2=0x7fbc5c105010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:17.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.463+0000 7fbc647cd640 1 -- 172.21.15.5:0/3636547931 shutdown_connections 2024-08-31T05:36:17.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:17.463+0000 7fbc647cd640 1 -- 172.21.15.5:0/3636547931 wait complete. 2024-08-31T05:36:17.585 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:17 smithi070 ceph-mon[22316]: pgmap v534: 129 pgs: 129 active+clean; 393 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.2 MiB/s wr, 283 op/s 2024-08-31T05:36:17.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:17 smithi050 ceph-mon[22146]: pgmap v534: 129 pgs: 129 active+clean; 393 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.2 MiB/s wr, 283 op/s 2024-08-31T05:36:17.921 INFO:tasks.workunit.client.0.smithi005.stdout: 1 703558 11.77 MB/sec execute 185 sec latency 26.169 ms 2024-08-31T05:36:18.594 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-31T05:36:18.888 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:36:18.921 INFO:tasks.workunit.client.0.smithi005.stdout: 1 705508 11.74 MB/sec execute 186 sec latency 25.228 ms 2024-08-31T05:36:19.308 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:19 smithi005 ceph-mon[18602]: pgmap v535: 129 pgs: 129 active+clean; 393 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.1 MiB/s wr, 201 op/s 2024-08-31T05:36:19.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.405+0000 7fe0a23b1640 1 -- 172.21.15.5:0/3553675725 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe09c108aa0 msgr2=0x7fe09c10f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:19.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.405+0000 7fe0a23b1640 1 --2- 172.21.15.5:0/3553675725 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe09c108aa0 0x7fe09c10f2d0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fe094009ca0 tx=0x7fe09402a8c0 comp rx=0 tx=0).stop 2024-08-31T05:36:19.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.405+0000 7fe0a23b1640 1 -- 172.21.15.5:0/3553675725 shutdown_connections 2024-08-31T05:36:19.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.405+0000 7fe0a23b1640 1 --2- 172.21.15.5:0/3553675725 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe09c108aa0 0x7fe09c10f2d0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:19.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.405+0000 7fe0a23b1640 1 --2- 172.21.15.5:0/3553675725 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe09c108150 0x7fe09c108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:19.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.405+0000 7fe0a23b1640 1 --2- 172.21.15.5:0/3553675725 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe09c102810 0x7fe09c102c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:19.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.405+0000 7fe0a23b1640 1 -- 172.21.15.5:0/3553675725 >> 172.21.15.5:0/3553675725 conn(0x7fe09c0794b0 msgr2=0x7fe09c0798c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:19.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.405+0000 7fe0a23b1640 1 -- 172.21.15.5:0/3553675725 shutdown_connections 2024-08-31T05:36:19.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.405+0000 7fe0a23b1640 1 -- 172.21.15.5:0/3553675725 wait complete. 2024-08-31T05:36:19.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.405+0000 7fe0a23b1640 1 Processor -- start 2024-08-31T05:36:19.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.406+0000 7fe0a23b1640 1 -- start start 2024-08-31T05:36:19.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.406+0000 7fe0a23b1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe09c102810 0x7fe09c19b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:19.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.406+0000 7fe0a23b1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe09c108150 0x7fe09c19b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:19.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.406+0000 7fe0a23b1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe09c108aa0 0x7fe09c19bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:19.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.406+0000 7fe0a23b1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe09c112790 con 0x7fe09c108150 2024-08-31T05:36:19.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.406+0000 7fe0a23b1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe09c112610 con 0x7fe09c108aa0 2024-08-31T05:36:19.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.406+0000 7fe0a23b1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe09c112910 con 0x7fe09c102810 2024-08-31T05:36:19.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.406+0000 7fe09bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe09c102810 0x7fe09c19b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:19.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.406+0000 7fe09b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe09c108150 0x7fe09c19b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:19.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.406+0000 7fe09bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe09c102810 0x7fe09c19b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:49748/0 (socket says 172.21.15.5:49748) 2024-08-31T05:36:19.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.406+0000 7fe09bfff640 1 -- 172.21.15.5:0/3305560403 learned_addr learned my addr 172.21.15.5:0/3305560403 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:19.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.406+0000 7fe0a094e640 1 --2- 172.21.15.5:0/3305560403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe09c108aa0 0x7fe09c19bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:19.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.407+0000 7fe09bfff640 1 -- 172.21.15.5:0/3305560403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe09c108aa0 msgr2=0x7fe09c19bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:19.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.407+0000 7fe09bfff640 1 --2- 172.21.15.5:0/3305560403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe09c108aa0 0x7fe09c19bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:19.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.407+0000 7fe09bfff640 1 -- 172.21.15.5:0/3305560403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe09c108150 msgr2=0x7fe09c19b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:19.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.407+0000 7fe09bfff640 1 --2- 172.21.15.5:0/3305560403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe09c108150 0x7fe09c19b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:19.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.407+0000 7fe09bfff640 1 -- 172.21.15.5:0/3305560403 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe09c1a6370 con 0x7fe09c102810 2024-08-31T05:36:19.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.407+0000 7fe09bfff640 1 --2- 172.21.15.5:0/3305560403 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe09c102810 0x7fe09c19b0e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe08c00e9f0 tx=0x7fe08c00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:19.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.407+0000 7fe0997fa640 1 -- 172.21.15.5:0/3305560403 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe08c00cd80 con 0x7fe09c102810 2024-08-31T05:36:19.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.407+0000 7fe0a23b1640 1 -- 172.21.15.5:0/3305560403 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe09c1a6660 con 0x7fe09c102810 2024-08-31T05:36:19.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.407+0000 7fe0997fa640 1 -- 172.21.15.5:0/3305560403 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe08c0054d0 con 0x7fe09c102810 2024-08-31T05:36:19.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.407+0000 7fe0997fa640 1 -- 172.21.15.5:0/3305560403 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe08c010690 con 0x7fe09c102810 2024-08-31T05:36:19.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.407+0000 7fe0a23b1640 1 -- 172.21.15.5:0/3305560403 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe09c1a6ba0 con 0x7fe09c102810 2024-08-31T05:36:19.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.410+0000 7fe0a8926740 1 Processor -- start 2024-08-31T05:36:19.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.410+0000 7fe0a8926740 1 -- start start 2024-08-31T05:36:19.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.410+0000 7fe0a8926740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ff61e85070 0x55ff6222a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:19.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.410+0000 7fe0a8926740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff61e5c1b0 0x55ff6222a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:19.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.410+0000 7fe0a8926740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff61e64390 0x55ff6222ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:19.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.410+0000 7fe0a8926740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55ff621a1680 con 0x55ff61e5c1b0 2024-08-31T05:36:19.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.410+0000 7fe0a8926740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ff62190c10 con 0x55ff61e64390 2024-08-31T05:36:19.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.410+0000 7fe0a8926740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ff62194bc0 con 0x55ff61e85070 2024-08-31T05:36:19.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.410+0000 7fe0997fa640 1 -- 172.21.15.5:0/3305560403 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fe08c004e50 con 0x7fe09c102810 2024-08-31T05:36:19.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.410+0000 7fe0a094e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ff61e85070 0x55ff6222a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:19.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.410+0000 7fe0a094e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ff61e85070 0x55ff6222a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:49762/0 (socket says 172.21.15.5:49762) 2024-08-31T05:36:19.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.410+0000 7fe0a094e640 1 -- 172.21.15.5:0/3530145114 learned_addr learned my addr 172.21.15.5:0/3530145114 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:19.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.410+0000 7fe09bfff640 1 --2- 172.21.15.5:0/3530145114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff61e5c1b0 0x55ff6222a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:19.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.411+0000 7fe09b7fe640 1 --2- 172.21.15.5:0/3530145114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff61e64390 0x55ff6222ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:19.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.411+0000 7fe0a094e640 1 -- 172.21.15.5:0/3530145114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff61e64390 msgr2=0x55ff6222ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:19.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.411+0000 7fe0a094e640 1 --2- 172.21.15.5:0/3530145114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff61e64390 0x55ff6222ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:19.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.411+0000 7fe0a094e640 1 -- 172.21.15.5:0/3530145114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff61e5c1b0 msgr2=0x55ff6222a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:19.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.411+0000 7fe0a094e640 1 --2- 172.21.15.5:0/3530145114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff61e5c1b0 0x55ff6222a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:19.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.411+0000 7fe0a094e640 1 -- 172.21.15.5:0/3530145114 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff61ef0650 con 0x55ff61e85070 2024-08-31T05:36:19.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.411+0000 7fe0a094e640 1 --2- 172.21.15.5:0/3530145114 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ff61e85070 0x55ff6222a310 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe09402f420 tx=0x7fe09402f450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c27d458b52cf932a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:19.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.411+0000 7fe0827fc640 1 -- 172.21.15.5:0/3530145114 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe094031cf0 con 0x55ff61e85070 2024-08-31T05:36:19.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.411+0000 7fe0997fa640 1 --2- 172.21.15.5:0/3305560403 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe0840b4cd0 0x7fe0840b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:19.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.411+0000 7fe0827fc640 1 -- 172.21.15.5:0/3530145114 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe094040070 con 0x55ff61e85070 2024-08-31T05:36:19.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.411+0000 7fe0827fc640 1 -- 172.21.15.5:0/3530145114 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe094004040 con 0x55ff61e85070 2024-08-31T05:36:19.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.412+0000 7fe0997fa640 1 -- 172.21.15.5:0/3305560403 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fe08c0e5e00 con 0x7fe09c102810 2024-08-31T05:36:19.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.412+0000 7fe09bfff640 1 --2- 172.21.15.5:0/3305560403 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe0840b4cd0 0x7fe0840b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:19.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.412+0000 7fe09bfff640 1 --2- 172.21.15.5:0/3305560403 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe0840b4cd0 0x7fe0840b71e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe08c0ac0a0 tx=0x7fe08c0e98b0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:19.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.412+0000 7fe0a8926740 1 -- 172.21.15.5:0/3530145114 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ff61e85070 msgr2=0x55ff6222a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:19.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.412+0000 7fe0a8926740 1 --2- 172.21.15.5:0/3530145114 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ff61e85070 0x55ff6222a310 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe09402f420 tx=0x7fe09402f450 comp rx=0 tx=0).stop 2024-08-31T05:36:19.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.412+0000 7fe0a8926740 1 -- 172.21.15.5:0/3530145114 shutdown_connections 2024-08-31T05:36:19.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.412+0000 7fe0a8926740 1 --2- 172.21.15.5:0/3530145114 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff61e64390 0x55ff6222ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:19.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.412+0000 7fe0a8926740 1 --2- 172.21.15.5:0/3530145114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff61e5c1b0 0x55ff6222a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:19.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.412+0000 7fe0a8926740 1 --2- 172.21.15.5:0/3530145114 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ff61e85070 0x55ff6222a310 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:19.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.412+0000 7fe0a8926740 1 -- 172.21.15.5:0/3530145114 >> 172.21.15.5:0/3530145114 conn(0x55ff61e79460 msgr2=0x55ff62228200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:19.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.412+0000 7fe0a8926740 1 -- 172.21.15.5:0/3530145114 shutdown_connections 2024-08-31T05:36:19.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.412+0000 7fe0a8926740 1 -- 172.21.15.5:0/3530145114 wait complete. 2024-08-31T05:36:19.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.413+0000 7fe0a8926740 1 -- start start 2024-08-31T05:36:19.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.413+0000 7fe0a8926740 1 Processor -- start 2024-08-31T05:36:19.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.413+0000 7fe0a8926740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff61e5c1b0 0x55ff62239e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:19.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.413+0000 7fe0a8926740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff61e64390 0x55ff6223a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:19.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.413+0000 7fe0a8926740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ff61e85070 0x55ff62246120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:19.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.413+0000 7fe0a8926740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55ff61ff3700 con 0x55ff61e5c1b0 2024-08-31T05:36:19.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.413+0000 7fe0a8926740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ff62117750 con 0x55ff61e64390 2024-08-31T05:36:19.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.414+0000 7fe0a8926740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ff6223cdc0 con 0x55ff61e85070 2024-08-31T05:36:19.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.414+0000 7fe09b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff61e64390 0x55ff6223a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:19.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.414+0000 7fe0a8926740 10 client.0 _ll_register_callbacks cb 0x55ff62146e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:36:19.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.414+0000 7fe09b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff61e64390 0x55ff6223a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:43080/0 (socket says 172.21.15.5:43080) 2024-08-31T05:36:19.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.414+0000 7fe09b7fe640 1 -- 172.21.15.5:0/406749653 learned_addr learned my addr 172.21.15.5:0/406749653 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:19.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.414+0000 7fe0a094e640 1 --2- 172.21.15.5:0/406749653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff61e5c1b0 0x55ff62239e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:19.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.414+0000 7fe0a094e640 1 --2- 172.21.15.5:0/406749653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ff61e85070 0x55ff62246120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:19.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.414+0000 7fe09b7fe640 1 -- 172.21.15.5:0/406749653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ff61e85070 msgr2=0x55ff62246120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:19.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.414+0000 7fe09b7fe640 1 --2- 172.21.15.5:0/406749653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ff61e85070 0x55ff62246120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:19.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.414+0000 7fe09b7fe640 1 -- 172.21.15.5:0/406749653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff61e5c1b0 msgr2=0x55ff62239e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:19.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.414+0000 7fe09b7fe640 1 --2- 172.21.15.5:0/406749653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff61e5c1b0 0x55ff62239e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:19.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.414+0000 7fe09b7fe640 1 -- 172.21.15.5:0/406749653 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff62150900 con 0x55ff61e64390 2024-08-31T05:36:19.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.414+0000 7fe0a094e640 1 --2- 172.21.15.5:0/406749653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ff61e85070 0x55ff62246120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:36:19.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.414+0000 7fe09b7fe640 1 --2- 172.21.15.5:0/406749653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff61e64390 0x55ff6223a3d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe090012700 tx=0x7fe090012bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc04d99014bf4772 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:19.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.414+0000 7fe07b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:36:19.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.414+0000 7fe07b7fe640 1 -- 172.21.15.5:0/406749653 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe090004050 con 0x55ff61e64390 2024-08-31T05:36:19.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.415+0000 7fe0a8926740 1 -- 172.21.15.5:0/406749653 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe094040070 con 0x55ff61e64390 2024-08-31T05:36:19.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.415+0000 7fe07b7fe640 1 -- 172.21.15.5:0/406749653 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fe0900041f0 con 0x55ff61e64390 2024-08-31T05:36:19.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.415+0000 7fe07b7fe640 1 -- 172.21.15.5:0/406749653 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe0900043f0 con 0x55ff61e64390 2024-08-31T05:36:19.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.415+0000 7fe0a8926740 10 client.26837 fetch_fsmap learned FSMap version 34 2024-08-31T05:36:19.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.415+0000 7fe0a8926740 1 -- 172.21.15.5:0/406749653 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55ff62248cb0 con 0x55ff61e64390 2024-08-31T05:36:19.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.415+0000 7fe07b7fe640 1 -- 172.21.15.5:0/406749653 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe094040070 con 0x55ff61e64390 2024-08-31T05:36:19.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.415+0000 7fe07b7fe640 1 -- 172.21.15.5:0/406749653 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fe090003b20 con 0x55ff61e64390 2024-08-31T05:36:19.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.415+0000 7fe0a8926740 10 client.26837 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:36:19.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.415+0000 7fe0a8926740 10 client.26837 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-31T05:36:19.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.415+0000 7fe0a8926740 20 client.26837 populate_metadata read hostname 'smithi005' 2024-08-31T05:36:19.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.415+0000 7fe0a8926740 1 --2- 172.21.15.5:0/406749653 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x55ff61e439f0 0x55ff6224c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:19.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.415+0000 7fe0a8926740 4 client.26837 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:36:19.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.415+0000 7fe0a8926740 1 -- 172.21.15.5:0/406749653 --> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ff621a35d0 con 0x55ff61e439f0 2024-08-31T05:36:19.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.415+0000 7fe0a094e640 1 --2- 172.21.15.5:0/406749653 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x55ff61e439f0 0x55ff6224c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:19.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.416+0000 7fe0a094e640 1 --2- 172.21.15.5:0/406749653 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x55ff61e439f0 0x55ff6224c200 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=bd9542e52e63967f server_cookie=aaf7b9c82fafc85f in_seq=0 out_seq=0 2024-08-31T05:36:19.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.416+0000 7fe07b7fe640 10 client.26837 ms_handle_connect on v2:172.21.15.70:6834/2061504114 2024-08-31T05:36:19.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.416+0000 7fe07b7fe640 1 -- 172.21.15.5:0/406749653 <== mds.3 v2:172.21.15.70:6834/2061504114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ff621a35d0 con 0x55ff61e439f0 2024-08-31T05:36:19.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.417+0000 7fe07b7fe640 10 client.26837 handle_command_reply: tid=0 2024-08-31T05:36:19.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.417+0000 7fe0a8926740 1 client.26837 shutdown 2024-08-31T05:36:19.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.417+0000 7fe0a8926740 1 -- 172.21.15.5:0/406749653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff61e64390 msgr2=0x55ff6223a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:19.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.417+0000 7fe0a8926740 1 --2- 172.21.15.5:0/406749653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff61e64390 0x55ff6223a3d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe090012700 tx=0x7fe090012bc0 comp rx=0 tx=0).stop 2024-08-31T05:36:19.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.417+0000 7fe0a8926740 1 -- 172.21.15.5:0/406749653 shutdown_connections 2024-08-31T05:36:19.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.417+0000 7fe0a8926740 1 --2- 172.21.15.5:0/406749653 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x55ff61e439f0 0x55ff6224c200 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:19.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.417+0000 7fe0a8926740 1 --2- 172.21.15.5:0/406749653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ff61e85070 0x55ff62246120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:19.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.417+0000 7fe0a8926740 1 --2- 172.21.15.5:0/406749653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff61e64390 0x55ff6223a3d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:19.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.417+0000 7fe0a8926740 1 --2- 172.21.15.5:0/406749653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff61e5c1b0 0x55ff62239e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:19.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.417+0000 7fe07b7fe640 0 client.26837 ms_handle_reset on v2:172.21.15.70:6834/2061504114 2024-08-31T05:36:19.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.417+0000 7fe0a8926740 1 -- 172.21.15.5:0/406749653 >> 172.21.15.5:0/406749653 conn(0x55ff61e79460 msgr2=0x55ff6222d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:19.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.417+0000 7fe0a8926740 1 -- 172.21.15.5:0/406749653 shutdown_connections 2024-08-31T05:36:19.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.417+0000 7fe0a8926740 1 -- 172.21.15.5:0/406749653 wait complete. 2024-08-31T05:36:19.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.417+0000 7fe0a8926740 20 client.26837 trim_cache size 0 max 16384 2024-08-31T05:36:19.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.431+0000 7fe0a8926740 1 Processor -- start 2024-08-31T05:36:19.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.431+0000 7fe0a8926740 1 -- start start 2024-08-31T05:36:19.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.431+0000 7fe0a8926740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff61e5c1b0 0x55ff6223bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:19.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.431+0000 7fe0a8926740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff61e64390 0x55ff6222ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:19.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.431+0000 7fe0a8926740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ff61e85070 0x55ff62246020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:19.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.431+0000 7fe0a8926740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe09c1aea70 con 0x55ff61e5c1b0 2024-08-31T05:36:19.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.431+0000 7fe0a8926740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe09c1b05b0 con 0x55ff61e64390 2024-08-31T05:36:19.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.431+0000 7fe0a8926740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe09c1af140 con 0x55ff61e85070 2024-08-31T05:36:19.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.431+0000 7fe0a094e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff61e5c1b0 0x55ff6223bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:19.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.431+0000 7fe0a094e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff61e5c1b0 0x55ff6223bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58964/0 (socket says 172.21.15.5:58964) 2024-08-31T05:36:19.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.431+0000 7fe0a094e640 1 -- 172.21.15.5:0/889919837 learned_addr learned my addr 172.21.15.5:0/889919837 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:19.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.432+0000 7fe09b7fe640 1 --2- 172.21.15.5:0/889919837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff61e64390 0x55ff6222ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:19.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.432+0000 7fe0a094e640 1 --2- 172.21.15.5:0/889919837 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ff61e85070 0x55ff62246020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:19.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.432+0000 7fe0a094e640 1 -- 172.21.15.5:0/889919837 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ff61e85070 msgr2=0x55ff62246020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:19.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.432+0000 7fe0a094e640 1 --2- 172.21.15.5:0/889919837 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ff61e85070 0x55ff62246020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:19.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.432+0000 7fe0a094e640 1 -- 172.21.15.5:0/889919837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff61e64390 msgr2=0x55ff6222ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:19.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.432+0000 7fe0a094e640 1 --2- 172.21.15.5:0/889919837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff61e64390 0x55ff6222ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:19.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.432+0000 7fe0a094e640 1 -- 172.21.15.5:0/889919837 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff6223c5d0 con 0x55ff61e5c1b0 2024-08-31T05:36:19.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.432+0000 7fe0a094e640 1 --2- 172.21.15.5:0/889919837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff61e5c1b0 0x55ff6223bd70 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fe094000f80 tx=0x7fe09403e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc92eb1130c5bcc6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:19.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.432+0000 7fe081ffb640 1 -- 172.21.15.5:0/889919837 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe094059040 con 0x55ff61e5c1b0 2024-08-31T05:36:19.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.432+0000 7fe081ffb640 1 -- 172.21.15.5:0/889919837 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe094040030 con 0x55ff61e5c1b0 2024-08-31T05:36:19.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.432+0000 7fe081ffb640 1 -- 172.21.15.5:0/889919837 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe09402fe60 con 0x55ff61e5c1b0 2024-08-31T05:36:19.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.433+0000 7fe0a8926740 1 -- 172.21.15.5:0/889919837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff61e5c1b0 msgr2=0x55ff6223bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:19.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.433+0000 7fe0a8926740 1 --2- 172.21.15.5:0/889919837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff61e5c1b0 0x55ff6223bd70 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fe094000f80 tx=0x7fe09403e040 comp rx=0 tx=0).stop 2024-08-31T05:36:19.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.433+0000 7fe0a8926740 1 -- 172.21.15.5:0/889919837 shutdown_connections 2024-08-31T05:36:19.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.433+0000 7fe0a8926740 1 --2- 172.21.15.5:0/889919837 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ff61e85070 0x55ff62246020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:19.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.433+0000 7fe0a8926740 1 --2- 172.21.15.5:0/889919837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff61e64390 0x55ff6222ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:19.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.433+0000 7fe0a8926740 1 --2- 172.21.15.5:0/889919837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff61e5c1b0 0x55ff6223bd70 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:19.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.433+0000 7fe0a8926740 1 -- 172.21.15.5:0/889919837 >> 172.21.15.5:0/889919837 conn(0x55ff61e79460 msgr2=0x55ff6222b340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:19.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.433+0000 7fe0a8926740 1 -- 172.21.15.5:0/889919837 shutdown_connections 2024-08-31T05:36:19.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.433+0000 7fe0a8926740 1 -- 172.21.15.5:0/889919837 wait complete. 2024-08-31T05:36:19.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.434+0000 7fe0a8926740 1 -- start start 2024-08-31T05:36:19.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.434+0000 7fe0a8926740 1 Processor -- start 2024-08-31T05:36:19.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.434+0000 7fe0a8926740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff61e5c1b0 0x55ff622408b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:19.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.434+0000 7fe0a8926740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff61e64390 0x55ff62240e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:19.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.434+0000 7fe0a8926740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ff61e85070 0x55ff622b5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:19.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.434+0000 7fe0a8926740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe09c1afee0 con 0x55ff61e64390 2024-08-31T05:36:19.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.434+0000 7fe0a8926740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe09c1af810 con 0x55ff61e5c1b0 2024-08-31T05:36:19.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.434+0000 7fe0a8926740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe09c1aca50 con 0x55ff61e85070 2024-08-31T05:36:19.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.434+0000 7fe0a8926740 10 client.0 _ll_register_callbacks cb 0x7fe090009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:36:19.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.435+0000 7fe0a094e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff61e5c1b0 0x55ff622408b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:19.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.435+0000 7fe09b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff61e64390 0x55ff62240e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:19.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.435+0000 7fe0a094e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff61e5c1b0 0x55ff622408b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:43098/0 (socket says 172.21.15.5:43098) 2024-08-31T05:36:19.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.435+0000 7fe0a094e640 1 -- 172.21.15.5:0/2880349517 learned_addr learned my addr 172.21.15.5:0/2880349517 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:19.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.435+0000 7fe0a094e640 1 --2- 172.21.15.5:0/2880349517 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ff61e85070 0x55ff622b5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:19.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.435+0000 7fe0a094e640 1 -- 172.21.15.5:0/2880349517 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ff61e85070 msgr2=0x55ff622b5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:19.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.435+0000 7fe0a094e640 1 --2- 172.21.15.5:0/2880349517 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ff61e85070 0x55ff622b5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:19.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.435+0000 7fe0a094e640 1 -- 172.21.15.5:0/2880349517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff61e64390 msgr2=0x55ff62240e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:19.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.435+0000 7fe0a094e640 1 --2- 172.21.15.5:0/2880349517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff61e64390 0x55ff62240e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:19.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.435+0000 7fe0a094e640 1 -- 172.21.15.5:0/2880349517 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff622b6210 con 0x55ff61e5c1b0 2024-08-31T05:36:19.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.435+0000 7fe09b7fe640 1 --2- 172.21.15.5:0/2880349517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff61e64390 0x55ff62240e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:36:19.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.435+0000 7fe0a094e640 1 --2- 172.21.15.5:0/2880349517 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff61e5c1b0 0x55ff622408b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe094002230 tx=0x7fe09402a8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b41c8097260d3696 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:19.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.435+0000 7fe07b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:36:19.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.435+0000 7fe07b7fe640 1 -- 172.21.15.5:0/2880349517 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe09402fbe0 con 0x55ff61e5c1b0 2024-08-31T05:36:19.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.435+0000 7fe07b7fe640 1 -- 172.21.15.5:0/2880349517 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fe09402fd80 con 0x55ff61e5c1b0 2024-08-31T05:36:19.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.435+0000 7fe0a8926740 1 -- 172.21.15.5:0/2880349517 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe094040030 con 0x55ff61e5c1b0 2024-08-31T05:36:19.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.436+0000 7fe07b7fe640 1 -- 172.21.15.5:0/2880349517 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe09402f660 con 0x55ff61e5c1b0 2024-08-31T05:36:19.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.436+0000 7fe0a8926740 10 client.26843 fetch_fsmap learned FSMap version 34 2024-08-31T05:36:19.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.436+0000 7fe0a8926740 1 -- 172.21.15.5:0/2880349517 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55ff622b7490 con 0x55ff61e5c1b0 2024-08-31T05:36:19.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.436+0000 7fe07b7fe640 1 -- 172.21.15.5:0/2880349517 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe094040030 con 0x55ff61e5c1b0 2024-08-31T05:36:19.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.436+0000 7fe07b7fe640 1 -- 172.21.15.5:0/2880349517 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fe094030780 con 0x55ff61e5c1b0 2024-08-31T05:36:19.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.436+0000 7fe0a8926740 10 client.26843 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:36:19.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.436+0000 7fe0a8926740 10 client.26843 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-31T05:36:19.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.436+0000 7fe0a8926740 20 client.26843 populate_metadata read hostname 'smithi005' 2024-08-31T05:36:19.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.436+0000 7fe0a8926740 1 --2- 172.21.15.5:0/2880349517 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x55ff61e18da0 0x55ff622b9720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:19.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.436+0000 7fe0a8926740 4 client.26843 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:36:19.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.436+0000 7fe0a8926740 1 -- 172.21.15.5:0/2880349517 --> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ff6219f070 con 0x55ff61e18da0 2024-08-31T05:36:19.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.436+0000 7fe09b7fe640 1 --2- 172.21.15.5:0/2880349517 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x55ff61e18da0 0x55ff622b9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:19.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.437+0000 7fe07b7fe640 10 client.26843 ms_handle_connect on v2:172.21.15.70:6834/2061504114 2024-08-31T05:36:19.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.437+0000 7fe09b7fe640 1 --2- 172.21.15.5:0/2880349517 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x55ff61e18da0 0x55ff622b9720 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d095293d9f3bcab8 server_cookie=42bf303ba0f3aec3 in_seq=0 out_seq=0 2024-08-31T05:36:19.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.437+0000 7fe07b7fe640 1 -- 172.21.15.5:0/2880349517 <== mds.3 v2:172.21.15.70:6834/2061504114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ff6219f070 con 0x55ff61e18da0 2024-08-31T05:36:19.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.437+0000 7fe07b7fe640 10 client.26843 handle_command_reply: tid=0 2024-08-31T05:36:19.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.437+0000 7fe0a8926740 1 client.26843 shutdown 2024-08-31T05:36:19.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.437+0000 7fe0a8926740 1 -- 172.21.15.5:0/2880349517 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff61e5c1b0 msgr2=0x55ff622408b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:19.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.437+0000 7fe0a8926740 1 --2- 172.21.15.5:0/2880349517 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff61e5c1b0 0x55ff622408b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe094002230 tx=0x7fe09402a8c0 comp rx=0 tx=0).stop 2024-08-31T05:36:19.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.437+0000 7fe0a8926740 1 -- 172.21.15.5:0/2880349517 shutdown_connections 2024-08-31T05:36:19.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.437+0000 7fe0a8926740 1 --2- 172.21.15.5:0/2880349517 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x55ff61e18da0 0x55ff622b9720 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:19.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.437+0000 7fe0a8926740 1 --2- 172.21.15.5:0/2880349517 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ff61e85070 0x55ff622b5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:19.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.437+0000 7fe0a8926740 1 --2- 172.21.15.5:0/2880349517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff61e64390 0x55ff62240e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:19.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.437+0000 7fe07b7fe640 0 client.26843 ms_handle_reset on v2:172.21.15.70:6834/2061504114 2024-08-31T05:36:19.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.437+0000 7fe0a8926740 1 --2- 172.21.15.5:0/2880349517 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ff61e5c1b0 0x55ff622408b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:19.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.437+0000 7fe0a8926740 1 -- 172.21.15.5:0/2880349517 >> 172.21.15.5:0/2880349517 conn(0x55ff61e79460 msgr2=0x55ff6222bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:19.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.437+0000 7fe0a8926740 1 -- 172.21.15.5:0/2880349517 shutdown_connections 2024-08-31T05:36:19.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.438+0000 7fe0a8926740 1 -- 172.21.15.5:0/2880349517 wait complete. 2024-08-31T05:36:19.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.438+0000 7fe0a8926740 20 client.26843 trim_cache size 0 max 16384 2024-08-31T05:36:19.444 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:36:19.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.438+0000 7fe0a23b1640 1 -- 172.21.15.5:0/3305560403 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe0840b4cd0 msgr2=0x7fe0840b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:19.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.438+0000 7fe0a23b1640 1 --2- 172.21.15.5:0/3305560403 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe0840b4cd0 0x7fe0840b71e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe08c0ac0a0 tx=0x7fe08c0e98b0 comp rx=0 tx=0).stop 2024-08-31T05:36:19.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.438+0000 7fe0a23b1640 1 -- 172.21.15.5:0/3305560403 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe09c102810 msgr2=0x7fe09c19b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:19.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.438+0000 7fe0a23b1640 1 --2- 172.21.15.5:0/3305560403 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe09c102810 0x7fe09c19b0e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe08c00e9f0 tx=0x7fe08c00edf0 comp rx=0 tx=0).stop 2024-08-31T05:36:19.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.438+0000 7fe0a23b1640 1 -- 172.21.15.5:0/3305560403 shutdown_connections 2024-08-31T05:36:19.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.438+0000 7fe0a23b1640 1 --2- 172.21.15.5:0/3305560403 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe0840b4cd0 0x7fe0840b71e0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:19.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.438+0000 7fe0a23b1640 1 --2- 172.21.15.5:0/3305560403 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe09c108aa0 0x7fe09c19bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:19.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.438+0000 7fe0a23b1640 1 --2- 172.21.15.5:0/3305560403 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe09c108150 0x7fe09c19b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:19.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.438+0000 7fe0a23b1640 1 --2- 172.21.15.5:0/3305560403 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe09c102810 0x7fe09c19b0e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:19.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.438+0000 7fe0a23b1640 1 -- 172.21.15.5:0/3305560403 >> 172.21.15.5:0/3305560403 conn(0x7fe09c0794b0 msgr2=0x7fe09c104180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:19.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.438+0000 7fe0a23b1640 1 -- 172.21.15.5:0/3305560403 shutdown_connections 2024-08-31T05:36:19.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:19.438+0000 7fe0a23b1640 1 -- 172.21.15.5:0/3305560403 wait complete. 2024-08-31T05:36:19.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:19 smithi070 ceph-mon[22316]: pgmap v535: 129 pgs: 129 active+clean; 393 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.1 MiB/s wr, 201 op/s 2024-08-31T05:36:19.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:19 smithi050 ceph-mon[22146]: pgmap v535: 129 pgs: 129 active+clean; 393 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.1 MiB/s wr, 201 op/s 2024-08-31T05:36:19.921 INFO:tasks.workunit.client.0.smithi005.stdout: 1 707557 11.75 MB/sec execute 187 sec latency 18.040 ms 2024-08-31T05:36:20.183 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T05:36:20.444 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:36:20.921 INFO:tasks.workunit.client.0.smithi005.stdout: 1 709841 11.75 MB/sec execute 188 sec latency 45.251 ms 2024-08-31T05:36:21.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.146+0000 7f5937c91640 1 -- 172.21.15.5:0/2876665167 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5930105b50 msgr2=0x7f5930105f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:21.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.146+0000 7f5937c91640 1 --2- 172.21.15.5:0/2876665167 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5930105b50 0x7f5930105f60 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f5928009ca0 tx=0x7f592802a8c0 comp rx=0 tx=0).stop 2024-08-31T05:36:21.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.146+0000 7f5937c91640 1 -- 172.21.15.5:0/2876665167 shutdown_connections 2024-08-31T05:36:21.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.146+0000 7f5937c91640 1 --2- 172.21.15.5:0/2876665167 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f593010bde0 0x7f5930112610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:21.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.146+0000 7f5937c91640 1 --2- 172.21.15.5:0/2876665167 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f593010b490 0x7f593010b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:21.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.146+0000 7f5937c91640 1 --2- 172.21.15.5:0/2876665167 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5930105b50 0x7f5930105f60 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:21.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.146+0000 7f5937c91640 1 -- 172.21.15.5:0/2876665167 >> 172.21.15.5:0/2876665167 conn(0x7f59301015a0 msgr2=0x7f59301039f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:21.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.146+0000 7f5937c91640 1 -- 172.21.15.5:0/2876665167 shutdown_connections 2024-08-31T05:36:21.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.146+0000 7f5937c91640 1 -- 172.21.15.5:0/2876665167 wait complete. 2024-08-31T05:36:21.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.147+0000 7f5937c91640 1 Processor -- start 2024-08-31T05:36:21.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.147+0000 7f5937c91640 1 -- start start 2024-08-31T05:36:21.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.147+0000 7f5937c91640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5930105b50 0x7f593019c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:21.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.147+0000 7f5937c91640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f593010b490 0x7f593019ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:21.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.147+0000 7f5937c91640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f593010bde0 0x7f59301a1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:21.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.147+0000 7f5937c91640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5930115aa0 con 0x7f593010bde0 2024-08-31T05:36:21.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.147+0000 7f5937c91640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5930115920 con 0x7f5930105b50 2024-08-31T05:36:21.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.147+0000 7f5937c91640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5930115c20 con 0x7f593010b490 2024-08-31T05:36:21.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.147+0000 7f5935a2d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5930105b50 0x7f593019c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:21.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.148+0000 7f593622e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f593010bde0 0x7f59301a1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:21.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.148+0000 7f5935a2d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5930105b50 0x7f593019c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:43114/0 (socket says 172.21.15.5:43114) 2024-08-31T05:36:21.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.148+0000 7f5935a2d640 1 -- 172.21.15.5:0/196383297 learned_addr learned my addr 172.21.15.5:0/196383297 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:21.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.148+0000 7f593522c640 1 --2- 172.21.15.5:0/196383297 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f593010b490 0x7f593019ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:21.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.148+0000 7f593622e640 1 -- 172.21.15.5:0/196383297 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f593010b490 msgr2=0x7f593019ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:21.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.148+0000 7f593622e640 1 --2- 172.21.15.5:0/196383297 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f593010b490 0x7f593019ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:21.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.148+0000 7f593622e640 1 -- 172.21.15.5:0/196383297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5930105b50 msgr2=0x7f593019c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:21.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.148+0000 7f593622e640 1 --2- 172.21.15.5:0/196383297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5930105b50 0x7f593019c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:21.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.148+0000 7f593622e640 1 -- 172.21.15.5:0/196383297 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59301a23e0 con 0x7f593010bde0 2024-08-31T05:36:21.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.149+0000 7f593622e640 1 --2- 172.21.15.5:0/196383297 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f593010bde0 0x7f59301a1cb0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f592c00e970 tx=0x7f592c00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:21.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.149+0000 7f5926ffd640 1 -- 172.21.15.5:0/196383297 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f592c00ccc0 con 0x7f593010bde0 2024-08-31T05:36:21.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.149+0000 7f5937c91640 1 -- 172.21.15.5:0/196383297 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59301a26d0 con 0x7f593010bde0 2024-08-31T05:36:21.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.149+0000 7f5937c91640 1 -- 172.21.15.5:0/196383297 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59301a8e30 con 0x7f593010bde0 2024-08-31T05:36:21.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.149+0000 7f5926ffd640 1 -- 172.21.15.5:0/196383297 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f592c005020 con 0x7f593010bde0 2024-08-31T05:36:21.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.149+0000 7f5926ffd640 1 -- 172.21.15.5:0/196383297 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f592c004a00 con 0x7f593010bde0 2024-08-31T05:36:21.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.152+0000 7f593e206740 1 Processor -- start 2024-08-31T05:36:21.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.153+0000 7f5926ffd640 1 -- 172.21.15.5:0/196383297 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f592c004ba0 con 0x7f593010bde0 2024-08-31T05:36:21.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.153+0000 7f593e206740 1 -- start start 2024-08-31T05:36:21.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.153+0000 7f593e206740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee9f568070 0x55ee9f90d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:21.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.153+0000 7f593e206740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee9f53f1b0 0x55ee9f90d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:21.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.154+0000 7f593e206740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee9f547390 0x55ee9f90ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:21.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.154+0000 7f593e206740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55ee9f884680 con 0x55ee9f547390 2024-08-31T05:36:21.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.154+0000 7f593e206740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ee9f873c10 con 0x55ee9f53f1b0 2024-08-31T05:36:21.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.154+0000 7f593e206740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ee9f877bc0 con 0x55ee9f568070 2024-08-31T05:36:21.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.154+0000 7f5935a2d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee9f53f1b0 0x55ee9f90d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:21.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.154+0000 7f593522c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee9f568070 0x55ee9f90d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:21.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.154+0000 7f5935a2d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee9f53f1b0 0x55ee9f90d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:43124/0 (socket says 172.21.15.5:43124) 2024-08-31T05:36:21.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.154+0000 7f5935a2d640 1 -- 172.21.15.5:0/2138210360 learned_addr learned my addr 172.21.15.5:0/2138210360 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:21.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.154+0000 7f593522c640 1 --2- 172.21.15.5:0/2138210360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee9f547390 0x55ee9f90ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:21.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.154+0000 7f5926ffd640 1 --2- 172.21.15.5:0/196383297 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f591c0b4df0 0x7f591c0b7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:21.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.154+0000 7f5935a2d640 1 -- 172.21.15.5:0/2138210360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee9f568070 msgr2=0x55ee9f90d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:21.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.154+0000 7f5935a2d640 1 --2- 172.21.15.5:0/2138210360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee9f568070 0x55ee9f90d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:21.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.154+0000 7f5935a2d640 1 -- 172.21.15.5:0/2138210360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee9f547390 msgr2=0x55ee9f90ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:21.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.154+0000 7f5935a2d640 1 --2- 172.21.15.5:0/2138210360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee9f547390 0x55ee9f90ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:21.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.154+0000 7f5935a2d640 1 -- 172.21.15.5:0/2138210360 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee9f5d3650 con 0x55ee9f53f1b0 2024-08-31T05:36:21.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.154+0000 7f593522c640 1 --2- 172.21.15.5:0/2138210360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee9f568070 0x55ee9f90d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:36:21.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.154+0000 7f593622e640 1 --2- 172.21.15.5:0/196383297 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f591c0b4df0 0x7f591c0b7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:21.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.154+0000 7f5926ffd640 1 -- 172.21.15.5:0/196383297 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f592c0e5630 con 0x7f593010bde0 2024-08-31T05:36:21.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.154+0000 7f5935a2d640 1 --2- 172.21.15.5:0/2138210360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee9f53f1b0 0x55ee9f90d890 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5928005cc0 tx=0x7f59280094a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9faeb80f10b39252 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:21.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.155+0000 7f593622e640 1 --2- 172.21.15.5:0/196383297 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f591c0b4df0 0x7f591c0b7300 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f592c0e2ab0 tx=0x7f592c013000 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:21.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.155+0000 7f591bfff640 1 -- 172.21.15.5:0/2138210360 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5928031cf0 con 0x55ee9f53f1b0 2024-08-31T05:36:21.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.155+0000 7f591bfff640 1 -- 172.21.15.5:0/2138210360 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5928036040 con 0x55ee9f53f1b0 2024-08-31T05:36:21.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.155+0000 7f591bfff640 1 -- 172.21.15.5:0/2138210360 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59280042a0 con 0x55ee9f53f1b0 2024-08-31T05:36:21.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.156+0000 7f593e206740 1 -- 172.21.15.5:0/2138210360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee9f53f1b0 msgr2=0x55ee9f90d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:21.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.156+0000 7f593e206740 1 --2- 172.21.15.5:0/2138210360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee9f53f1b0 0x55ee9f90d890 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5928005cc0 tx=0x7f59280094a0 comp rx=0 tx=0).stop 2024-08-31T05:36:21.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.156+0000 7f593e206740 1 -- 172.21.15.5:0/2138210360 shutdown_connections 2024-08-31T05:36:21.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.156+0000 7f593e206740 1 --2- 172.21.15.5:0/2138210360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee9f547390 0x55ee9f90ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:21.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.156+0000 7f593e206740 1 --2- 172.21.15.5:0/2138210360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee9f53f1b0 0x55ee9f90d890 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:21.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.156+0000 7f593e206740 1 --2- 172.21.15.5:0/2138210360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee9f568070 0x55ee9f90d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:21.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.156+0000 7f593e206740 1 -- 172.21.15.5:0/2138210360 >> 172.21.15.5:0/2138210360 conn(0x55ee9f55c460 msgr2=0x55ee9f90b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:21.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.156+0000 7f593e206740 1 -- 172.21.15.5:0/2138210360 shutdown_connections 2024-08-31T05:36:21.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.156+0000 7f593e206740 1 -- 172.21.15.5:0/2138210360 wait complete. 2024-08-31T05:36:21.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.156+0000 7f593e206740 1 -- start start 2024-08-31T05:36:21.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.156+0000 7f593e206740 1 Processor -- start 2024-08-31T05:36:21.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.157+0000 7f593e206740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee9f53f1b0 0x55ee9f918b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:21.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.157+0000 7f593e206740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee9f547390 0x55ee9f919040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:21.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.157+0000 7f593e206740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee9f568070 0x55ee9f924e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:21.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.157+0000 7f593e206740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55ee9f6d6700 con 0x55ee9f547390 2024-08-31T05:36:21.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.157+0000 7f593e206740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ee9f7fa750 con 0x55ee9f568070 2024-08-31T05:36:21.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.157+0000 7f593e206740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ee9f91bad0 con 0x55ee9f53f1b0 2024-08-31T05:36:21.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.157+0000 7f593e206740 10 client.0 _ll_register_callbacks cb 0x55ee9f829e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:36:21.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.157+0000 7f5935a2d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee9f547390 0x55ee9f919040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:21.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.157+0000 7f593522c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee9f53f1b0 0x55ee9f918b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:21.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.157+0000 7f5935a2d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee9f547390 0x55ee9f919040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58998/0 (socket says 172.21.15.5:58998) 2024-08-31T05:36:21.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.157+0000 7f593522c640 1 --2- 172.21.15.5:0/1453630485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee9f568070 0x55ee9f924e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:21.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.157+0000 7f5935a2d640 1 -- 172.21.15.5:0/1453630485 learned_addr learned my addr 172.21.15.5:0/1453630485 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:21.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.157+0000 7f593522c640 1 -- 172.21.15.5:0/1453630485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee9f568070 msgr2=0x55ee9f924e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:21.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.157+0000 7f593522c640 1 --2- 172.21.15.5:0/1453630485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee9f568070 0x55ee9f924e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:21.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.157+0000 7f593522c640 1 -- 172.21.15.5:0/1453630485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee9f547390 msgr2=0x55ee9f919040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:21.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.157+0000 7f593522c640 1 --2- 172.21.15.5:0/1453630485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee9f547390 0x55ee9f919040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:21.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.157+0000 7f593522c640 1 -- 172.21.15.5:0/1453630485 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee9f833900 con 0x55ee9f53f1b0 2024-08-31T05:36:21.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.158+0000 7f593522c640 1 --2- 172.21.15.5:0/1453630485 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee9f53f1b0 0x55ee9f918b00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f593006b640 tx=0x7f59200046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35d8ec8511bd27fa server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:21.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.158+0000 7f59197fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:36:21.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.158+0000 7f59197fa640 1 -- 172.21.15.5:0/1453630485 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f592001b040 con 0x55ee9f53f1b0 2024-08-31T05:36:21.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.158+0000 7f59197fa640 1 -- 172.21.15.5:0/1453630485 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f5920004230 con 0x55ee9f53f1b0 2024-08-31T05:36:21.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.158+0000 7f593e206740 1 -- 172.21.15.5:0/1453630485 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5928036040 con 0x55ee9f53f1b0 2024-08-31T05:36:21.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.158+0000 7f59197fa640 1 -- 172.21.15.5:0/1453630485 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f592002a050 con 0x55ee9f53f1b0 2024-08-31T05:36:21.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.158+0000 7f593e206740 10 client.26863 fetch_fsmap learned FSMap version 34 2024-08-31T05:36:21.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.158+0000 7f593e206740 1 -- 172.21.15.5:0/1453630485 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55ee9f9300c0 con 0x55ee9f53f1b0 2024-08-31T05:36:21.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.158+0000 7f59197fa640 1 -- 172.21.15.5:0/1453630485 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5928036040 con 0x55ee9f53f1b0 2024-08-31T05:36:21.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.159+0000 7f59197fa640 1 -- 172.21.15.5:0/1453630485 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f5920024500 con 0x55ee9f53f1b0 2024-08-31T05:36:21.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.159+0000 7f593e206740 10 client.26863 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:36:21.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.159+0000 7f593e206740 10 client.26863 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-31T05:36:21.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.159+0000 7f593e206740 20 client.26863 populate_metadata read hostname 'smithi005' 2024-08-31T05:36:21.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.159+0000 7f593e206740 1 --2- 172.21.15.5:0/1453630485 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55ee9f5269f0 0x55ee9f933590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:21.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.159+0000 7f593e206740 4 client.26863 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:36:21.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.159+0000 7f593e206740 1 -- 172.21.15.5:0/1453630485 --> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee9f8865d0 con 0x55ee9f5269f0 2024-08-31T05:36:21.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.159+0000 7f5935a2d640 1 --2- 172.21.15.5:0/1453630485 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55ee9f5269f0 0x55ee9f933590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:21.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.159+0000 7f59197fa640 10 client.26863 ms_handle_connect on v2:172.21.15.70:6836/2780036414 2024-08-31T05:36:21.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.159+0000 7f5935a2d640 1 --2- 172.21.15.5:0/1453630485 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55ee9f5269f0 0x55ee9f933590 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=50a8c239ac2cea74 server_cookie=f38a08b988613e11 in_seq=0 out_seq=0 2024-08-31T05:36:21.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.160+0000 7f59197fa640 1 -- 172.21.15.5:0/1453630485 <== mds.2 v2:172.21.15.70:6836/2780036414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ee9f8865d0 con 0x55ee9f5269f0 2024-08-31T05:36:21.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.160+0000 7f59197fa640 10 client.26863 handle_command_reply: tid=0 2024-08-31T05:36:21.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.160+0000 7f593e206740 1 client.26863 shutdown 2024-08-31T05:36:21.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.160+0000 7f593e206740 1 -- 172.21.15.5:0/1453630485 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee9f53f1b0 msgr2=0x55ee9f918b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:21.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.160+0000 7f593e206740 1 --2- 172.21.15.5:0/1453630485 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee9f53f1b0 0x55ee9f918b00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f593006b640 tx=0x7f59200046c0 comp rx=0 tx=0).stop 2024-08-31T05:36:21.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.161+0000 7f593e206740 1 -- 172.21.15.5:0/1453630485 shutdown_connections 2024-08-31T05:36:21.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.161+0000 7f593e206740 1 --2- 172.21.15.5:0/1453630485 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55ee9f5269f0 0x55ee9f933590 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:21.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.161+0000 7f59197fa640 0 client.26863 ms_handle_reset on v2:172.21.15.70:6836/2780036414 2024-08-31T05:36:21.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.161+0000 7f593e206740 1 --2- 172.21.15.5:0/1453630485 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee9f568070 0x55ee9f924e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:21.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.161+0000 7f593e206740 1 --2- 172.21.15.5:0/1453630485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee9f547390 0x55ee9f919040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:21.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.161+0000 7f593e206740 1 --2- 172.21.15.5:0/1453630485 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee9f53f1b0 0x55ee9f918b00 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:21.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.161+0000 7f593e206740 1 -- 172.21.15.5:0/1453630485 >> 172.21.15.5:0/1453630485 conn(0x55ee9f55c460 msgr2=0x55ee9f9104e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:21.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.161+0000 7f593e206740 1 -- 172.21.15.5:0/1453630485 shutdown_connections 2024-08-31T05:36:21.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.161+0000 7f593e206740 1 -- 172.21.15.5:0/1453630485 wait complete. 2024-08-31T05:36:21.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.161+0000 7f593e206740 20 client.26863 trim_cache size 0 max 16384 2024-08-31T05:36:21.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.176+0000 7f593e206740 1 Processor -- start 2024-08-31T05:36:21.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.176+0000 7f593e206740 1 -- start start 2024-08-31T05:36:21.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.177+0000 7f593e206740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee9f5269f0 0x55ee9f918fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:21.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.177+0000 7f593e206740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee9f53f1b0 0x55ee9f910450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:21.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.177+0000 7f593e206740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee9f547390 0x55ee9f910990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:21.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.177+0000 7f593e206740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f591400ff40 con 0x55ee9f547390 2024-08-31T05:36:21.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.177+0000 7f593e206740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5914011a80 con 0x55ee9f5269f0 2024-08-31T05:36:21.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.177+0000 7f593e206740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5914010610 con 0x55ee9f53f1b0 2024-08-31T05:36:21.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.177+0000 7f593522c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee9f547390 0x55ee9f910990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:21.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.177+0000 7f593522c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee9f547390 0x55ee9f910990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59014/0 (socket says 172.21.15.5:59014) 2024-08-31T05:36:21.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.177+0000 7f593522c640 1 -- 172.21.15.5:0/2609927276 learned_addr learned my addr 172.21.15.5:0/2609927276 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:21.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.177+0000 7f5935a2d640 1 --2- 172.21.15.5:0/2609927276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee9f53f1b0 0x55ee9f910450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:21.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.177+0000 7f593522c640 1 --2- 172.21.15.5:0/2609927276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee9f5269f0 0x55ee9f918fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:21.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.177+0000 7f5935a2d640 1 -- 172.21.15.5:0/2609927276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee9f5269f0 msgr2=0x55ee9f918fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:21.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.177+0000 7f5935a2d640 1 --2- 172.21.15.5:0/2609927276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee9f5269f0 0x55ee9f918fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:21.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.178+0000 7f5935a2d640 1 -- 172.21.15.5:0/2609927276 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee9f547390 msgr2=0x55ee9f910990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:21.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.178+0000 7f5935a2d640 1 --2- 172.21.15.5:0/2609927276 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee9f547390 0x55ee9f910990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:21.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.178+0000 7f5935a2d640 1 -- 172.21.15.5:0/2609927276 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee9f9101b0 con 0x55ee9f53f1b0 2024-08-31T05:36:21.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.178+0000 7f593522c640 1 --2- 172.21.15.5:0/2609927276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee9f5269f0 0x55ee9f918fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:36:21.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.178+0000 7f5935a2d640 1 --2- 172.21.15.5:0/2609927276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee9f53f1b0 0x55ee9f910450 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f592802a900 tx=0x7f592802afb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a940053baf31b07f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:21.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.178+0000 7f591b7fe640 1 -- 172.21.15.5:0/2609927276 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f592805c070 con 0x55ee9f53f1b0 2024-08-31T05:36:21.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.178+0000 7f591b7fe640 1 -- 172.21.15.5:0/2609927276 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5928036040 con 0x55ee9f53f1b0 2024-08-31T05:36:21.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.178+0000 7f591b7fe640 1 -- 172.21.15.5:0/2609927276 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f592804a040 con 0x55ee9f53f1b0 2024-08-31T05:36:21.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.179+0000 7f593e206740 1 -- 172.21.15.5:0/2609927276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee9f53f1b0 msgr2=0x55ee9f910450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:21.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.179+0000 7f593e206740 1 --2- 172.21.15.5:0/2609927276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee9f53f1b0 0x55ee9f910450 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f592802a900 tx=0x7f592802afb0 comp rx=0 tx=0).stop 2024-08-31T05:36:21.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.179+0000 7f593e206740 1 -- 172.21.15.5:0/2609927276 shutdown_connections 2024-08-31T05:36:21.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.179+0000 7f593e206740 1 --2- 172.21.15.5:0/2609927276 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee9f547390 0x55ee9f910990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:21.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.179+0000 7f593e206740 1 --2- 172.21.15.5:0/2609927276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee9f53f1b0 0x55ee9f910450 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:21.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.179+0000 7f593e206740 1 --2- 172.21.15.5:0/2609927276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee9f5269f0 0x55ee9f918fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:21.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.179+0000 7f593e206740 1 -- 172.21.15.5:0/2609927276 >> 172.21.15.5:0/2609927276 conn(0x55ee9f55c460 msgr2=0x55ee9f9188b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:21.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.179+0000 7f593e206740 1 -- 172.21.15.5:0/2609927276 shutdown_connections 2024-08-31T05:36:21.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.179+0000 7f593e206740 1 -- 172.21.15.5:0/2609927276 wait complete. 2024-08-31T05:36:21.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.180+0000 7f593e206740 1 -- start start 2024-08-31T05:36:21.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.180+0000 7f593e206740 1 Processor -- start 2024-08-31T05:36:21.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.180+0000 7f593e206740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee9f5269f0 0x55ee9f91d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:21.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.180+0000 7f593e206740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee9f53f1b0 0x55ee9f91d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:21.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.180+0000 7f593e206740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee9f547390 0x55ee9f99cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:21.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.180+0000 7f593e206740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f59140113b0 con 0x55ee9f53f1b0 2024-08-31T05:36:21.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.180+0000 7f593e206740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5914010ce0 con 0x55ee9f5269f0 2024-08-31T05:36:21.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.180+0000 7f593e206740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f591400df20 con 0x55ee9f547390 2024-08-31T05:36:21.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.181+0000 7f593e206740 10 client.0 _ll_register_callbacks cb 0x7f5920009530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:36:21.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.181+0000 7f5935a2d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee9f53f1b0 0x55ee9f91d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:21.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.181+0000 7f593522c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee9f5269f0 0x55ee9f91d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:21.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.181+0000 7f593522c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee9f5269f0 0x55ee9f91d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:43154/0 (socket says 172.21.15.5:43154) 2024-08-31T05:36:21.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.181+0000 7f5935a2d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee9f53f1b0 0x55ee9f91d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59028/0 (socket says 172.21.15.5:59028) 2024-08-31T05:36:21.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.181+0000 7f593522c640 1 -- 172.21.15.5:0/2143936346 learned_addr learned my addr 172.21.15.5:0/2143936346 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:21.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.181+0000 7f593522c640 1 --2- 172.21.15.5:0/2143936346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee9f547390 0x55ee9f99cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:21.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.181+0000 7f593522c640 1 -- 172.21.15.5:0/2143936346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee9f547390 msgr2=0x55ee9f99cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:21.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.181+0000 7f593522c640 1 --2- 172.21.15.5:0/2143936346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee9f547390 0x55ee9f99cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:21.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.181+0000 7f593522c640 1 -- 172.21.15.5:0/2143936346 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee9f53f1b0 msgr2=0x55ee9f91d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:21.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.181+0000 7f593522c640 1 --2- 172.21.15.5:0/2143936346 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee9f53f1b0 0x55ee9f91d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:21.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.181+0000 7f593522c640 1 -- 172.21.15.5:0/2143936346 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee9f99d4d0 con 0x55ee9f5269f0 2024-08-31T05:36:21.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.181+0000 7f593522c640 1 --2- 172.21.15.5:0/2143936346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee9f5269f0 0x55ee9f91d490 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f59200057c0 tx=0x7f5920024040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e3c033632fe9464 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:21.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.181+0000 7f59197fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:36:21.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.181+0000 7f59197fa640 1 -- 172.21.15.5:0/2143936346 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5920005220 con 0x55ee9f5269f0 2024-08-31T05:36:21.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.181+0000 7f59197fa640 1 -- 172.21.15.5:0/2143936346 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f59200053c0 con 0x55ee9f5269f0 2024-08-31T05:36:21.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.181+0000 7f593e206740 1 -- 172.21.15.5:0/2143936346 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5928036040 con 0x55ee9f5269f0 2024-08-31T05:36:21.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.182+0000 7f59197fa640 1 -- 172.21.15.5:0/2143936346 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f592003b050 con 0x55ee9f5269f0 2024-08-31T05:36:21.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.182+0000 7f593e206740 10 client.26861 fetch_fsmap learned FSMap version 34 2024-08-31T05:36:21.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.182+0000 7f593e206740 1 -- 172.21.15.5:0/2143936346 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55ee9f99e720 con 0x55ee9f5269f0 2024-08-31T05:36:21.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.182+0000 7f59197fa640 1 -- 172.21.15.5:0/2143936346 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5928036040 con 0x55ee9f5269f0 2024-08-31T05:36:21.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.182+0000 7f59197fa640 1 -- 172.21.15.5:0/2143936346 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f5920004930 con 0x55ee9f5269f0 2024-08-31T05:36:21.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.182+0000 7f593e206740 10 client.26861 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:36:21.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.182+0000 7f593e206740 10 client.26861 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-31T05:36:21.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.182+0000 7f593e206740 20 client.26861 populate_metadata read hostname 'smithi005' 2024-08-31T05:36:21.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.182+0000 7f593e206740 1 --2- 172.21.15.5:0/2143936346 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55ee9f568070 0x55ee9f9a0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:21.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.182+0000 7f593e206740 4 client.26861 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:36:21.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.182+0000 7f593e206740 1 -- 172.21.15.5:0/2143936346 --> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ee9f882070 con 0x55ee9f568070 2024-08-31T05:36:21.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.182+0000 7f5935a2d640 1 --2- 172.21.15.5:0/2143936346 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55ee9f568070 0x55ee9f9a0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:21.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.183+0000 7f59197fa640 10 client.26861 ms_handle_connect on v2:172.21.15.70:6836/2780036414 2024-08-31T05:36:21.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.183+0000 7f5935a2d640 1 --2- 172.21.15.5:0/2143936346 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55ee9f568070 0x55ee9f9a0ee0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f5083e048c220847 server_cookie=c66fbca809d9dc99 in_seq=0 out_seq=0 2024-08-31T05:36:21.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.183+0000 7f59197fa640 1 -- 172.21.15.5:0/2143936346 <== mds.2 v2:172.21.15.70:6836/2780036414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ee9f882070 con 0x55ee9f568070 2024-08-31T05:36:21.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.183+0000 7f59197fa640 10 client.26861 handle_command_reply: tid=0 2024-08-31T05:36:21.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.183+0000 7f593e206740 1 client.26861 shutdown 2024-08-31T05:36:21.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.183+0000 7f593e206740 1 -- 172.21.15.5:0/2143936346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee9f5269f0 msgr2=0x55ee9f91d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:21.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.183+0000 7f593e206740 1 --2- 172.21.15.5:0/2143936346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee9f5269f0 0x55ee9f91d490 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f59200057c0 tx=0x7f5920024040 comp rx=0 tx=0).stop 2024-08-31T05:36:21.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.184+0000 7f593e206740 1 -- 172.21.15.5:0/2143936346 shutdown_connections 2024-08-31T05:36:21.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.184+0000 7f593e206740 1 --2- 172.21.15.5:0/2143936346 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55ee9f568070 0x55ee9f9a0ee0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:21.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.184+0000 7f593e206740 1 --2- 172.21.15.5:0/2143936346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ee9f547390 0x55ee9f99cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:21.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.184+0000 7f593e206740 1 --2- 172.21.15.5:0/2143936346 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee9f53f1b0 0x55ee9f91d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:21.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.184+0000 7f593e206740 1 --2- 172.21.15.5:0/2143936346 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ee9f5269f0 0x55ee9f91d490 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:21.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.184+0000 7f593e206740 1 -- 172.21.15.5:0/2143936346 >> 172.21.15.5:0/2143936346 conn(0x55ee9f55c460 msgr2=0x55ee9f910420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:21.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.184+0000 7f59197fa640 0 client.26861 ms_handle_reset on v2:172.21.15.70:6836/2780036414 2024-08-31T05:36:21.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.184+0000 7f593e206740 1 -- 172.21.15.5:0/2143936346 shutdown_connections 2024-08-31T05:36:21.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.184+0000 7f593e206740 1 -- 172.21.15.5:0/2143936346 wait complete. 2024-08-31T05:36:21.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.184+0000 7f593e206740 20 client.26861 trim_cache size 0 max 16384 2024-08-31T05:36:21.191 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:36:21.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.185+0000 7f5937c91640 1 -- 172.21.15.5:0/196383297 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f591c0b4df0 msgr2=0x7f591c0b7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:21.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.185+0000 7f5937c91640 1 --2- 172.21.15.5:0/196383297 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f591c0b4df0 0x7f591c0b7300 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f592c0e2ab0 tx=0x7f592c013000 comp rx=0 tx=0).stop 2024-08-31T05:36:21.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.185+0000 7f5937c91640 1 -- 172.21.15.5:0/196383297 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f593010bde0 msgr2=0x7f59301a1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:21.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.185+0000 7f5937c91640 1 --2- 172.21.15.5:0/196383297 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f593010bde0 0x7f59301a1cb0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f592c00e970 tx=0x7f592c00ee30 comp rx=0 tx=0).stop 2024-08-31T05:36:21.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.185+0000 7f5937c91640 1 -- 172.21.15.5:0/196383297 shutdown_connections 2024-08-31T05:36:21.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.185+0000 7f5937c91640 1 --2- 172.21.15.5:0/196383297 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f591c0b4df0 0x7f591c0b7300 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:21.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.185+0000 7f5937c91640 1 --2- 172.21.15.5:0/196383297 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f593010bde0 0x7f59301a1cb0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:21.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.185+0000 7f5937c91640 1 --2- 172.21.15.5:0/196383297 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f593010b490 0x7f593019ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:21.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.185+0000 7f5937c91640 1 --2- 172.21.15.5:0/196383297 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5930105b50 0x7f593019c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:21.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.185+0000 7f5937c91640 1 -- 172.21.15.5:0/196383297 >> 172.21.15.5:0/196383297 conn(0x7f59301015a0 msgr2=0x7f59301039c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:21.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.185+0000 7f5937c91640 1 -- 172.21.15.5:0/196383297 shutdown_connections 2024-08-31T05:36:21.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:21.185+0000 7f5937c91640 1 -- 172.21.15.5:0/196383297 wait complete. 2024-08-31T05:36:21.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:21 smithi005 ceph-mon[18602]: pgmap v536: 129 pgs: 129 active+clean; 399 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.3 MiB/s wr, 270 op/s 2024-08-31T05:36:21.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:21 smithi070 ceph-mon[22316]: pgmap v536: 129 pgs: 129 active+clean; 399 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.3 MiB/s wr, 270 op/s 2024-08-31T05:36:21.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:21 smithi050 ceph-mon[22146]: pgmap v536: 129 pgs: 129 active+clean; 399 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.3 MiB/s wr, 270 op/s 2024-08-31T05:36:21.898 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T05:36:21.921 INFO:tasks.workunit.client.0.smithi005.stdout: 1 711387 11.73 MB/sec execute 189 sec latency 63.117 ms 2024-08-31T05:36:22.168 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:36:22.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.681+0000 7f5acf844640 1 -- 172.21.15.5:0/1836260869 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ac8104750 msgr2=0x7f5ac8104b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:22.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.681+0000 7f5acf844640 1 --2- 172.21.15.5:0/1836260869 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ac8104750 0x7f5ac8104b60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4009900 tx=0x7f5ac402a3f0 comp rx=0 tx=0).stop 2024-08-31T05:36:22.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.681+0000 7f5acf844640 1 -- 172.21.15.5:0/1836260869 shutdown_connections 2024-08-31T05:36:22.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.681+0000 7f5acf844640 1 --2- 172.21.15.5:0/1836260869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ac810dbb0 0x7f5ac81100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:22.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.681+0000 7f5acf844640 1 --2- 172.21.15.5:0/1836260869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ac81050a0 0x7f5ac810d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:22.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.681+0000 7f5acf844640 1 --2- 172.21.15.5:0/1836260869 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ac8104750 0x7f5ac8104b60 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:22.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.681+0000 7f5acf844640 1 -- 172.21.15.5:0/1836260869 >> 172.21.15.5:0/1836260869 conn(0x7f5ac80794d0 msgr2=0x7f5ac80798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:22.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.682+0000 7f5acf844640 1 -- 172.21.15.5:0/1836260869 shutdown_connections 2024-08-31T05:36:22.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.682+0000 7f5acf844640 1 -- 172.21.15.5:0/1836260869 wait complete. 2024-08-31T05:36:22.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.682+0000 7f5acf844640 1 Processor -- start 2024-08-31T05:36:22.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.682+0000 7f5acf844640 1 -- start start 2024-08-31T05:36:22.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.683+0000 7f5acf844640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ac8104750 0x7f5ac819a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:22.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.683+0000 7f5acf844640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ac81050a0 0x7f5ac819a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:22.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.683+0000 7f5acf844640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ac810dbb0 0x7f5ac819fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:22.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.683+0000 7f5acf844640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac8113830 con 0x7f5ac81050a0 2024-08-31T05:36:22.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.683+0000 7f5acf844640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac81136b0 con 0x7f5ac8104750 2024-08-31T05:36:22.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.683+0000 7f5acf844640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac81139b0 con 0x7f5ac810dbb0 2024-08-31T05:36:22.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.683+0000 7f5accddf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ac81050a0 0x7f5ac819a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:22.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.683+0000 7f5accddf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ac81050a0 0x7f5ac819a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51464/0 (socket says 172.21.15.5:51464) 2024-08-31T05:36:22.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.683+0000 7f5accddf640 1 -- 172.21.15.5:0/2669790665 learned_addr learned my addr 172.21.15.5:0/2669790665 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:22.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.683+0000 7f5acdde1640 1 --2- 172.21.15.5:0/2669790665 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ac810dbb0 0x7f5ac819fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:22.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.683+0000 7f5acd5e0640 1 --2- 172.21.15.5:0/2669790665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ac8104750 0x7f5ac819a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:22.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.683+0000 7f5accddf640 1 -- 172.21.15.5:0/2669790665 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ac810dbb0 msgr2=0x7f5ac819fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:22.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.683+0000 7f5accddf640 1 --2- 172.21.15.5:0/2669790665 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ac810dbb0 0x7f5ac819fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:22.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.683+0000 7f5accddf640 1 -- 172.21.15.5:0/2669790665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ac8104750 msgr2=0x7f5ac819a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:22.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.683+0000 7f5accddf640 1 --2- 172.21.15.5:0/2669790665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ac8104750 0x7f5ac819a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:22.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.683+0000 7f5accddf640 1 -- 172.21.15.5:0/2669790665 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac81a0210 con 0x7f5ac81050a0 2024-08-31T05:36:22.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.683+0000 7f5acdde1640 1 --2- 172.21.15.5:0/2669790665 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ac810dbb0 0x7f5ac819fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:36:22.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.684+0000 7f5accddf640 1 --2- 172.21.15.5:0/2669790665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ac81050a0 0x7f5ac819a840 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f5ab800e970 tx=0x7f5ab800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:22.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.684+0000 7f5abe7fc640 1 -- 172.21.15.5:0/2669790665 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab800cd80 con 0x7f5ac81050a0 2024-08-31T05:36:22.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.684+0000 7f5abe7fc640 1 -- 172.21.15.5:0/2669790665 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ab80035f0 con 0x7f5ac81050a0 2024-08-31T05:36:22.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.684+0000 7f5abe7fc640 1 -- 172.21.15.5:0/2669790665 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab8010690 con 0x7f5ac81050a0 2024-08-31T05:36:22.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.684+0000 7f5acf844640 1 -- 172.21.15.5:0/2669790665 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ac81a0500 con 0x7f5ac81050a0 2024-08-31T05:36:22.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.684+0000 7f5acf844640 1 -- 172.21.15.5:0/2669790665 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ac8102370 con 0x7f5ac81050a0 2024-08-31T05:36:22.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.688+0000 7f5ad5db9740 1 Processor -- start 2024-08-31T05:36:22.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.688+0000 7f5ad5db9740 1 -- start start 2024-08-31T05:36:22.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.688+0000 7f5abe7fc640 1 -- 172.21.15.5:0/2669790665 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f5ab8003aa0 con 0x7f5ac81050a0 2024-08-31T05:36:22.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.688+0000 7f5ad5db9740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55778cb45070 0x55778ceea310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:22.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.688+0000 7f5ad5db9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55778cb1c1b0 0x55778ceea850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:22.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.688+0000 7f5ad5db9740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55778cb24390 0x55778ceead90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:22.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.688+0000 7f5ad5db9740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55778ce61680 con 0x55778cb45070 2024-08-31T05:36:22.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.688+0000 7f5ad5db9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55778ce50c10 con 0x55778cb1c1b0 2024-08-31T05:36:22.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.688+0000 7f5ad5db9740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55778ce54bc0 con 0x55778cb24390 2024-08-31T05:36:22.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.688+0000 7f5acdde1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55778cb45070 0x55778ceea310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:22.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.688+0000 7f5acdde1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55778cb45070 0x55778ceea310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51478/0 (socket says 172.21.15.5:51478) 2024-08-31T05:36:22.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.688+0000 7f5acdde1640 1 -- 172.21.15.5:0/45574558 learned_addr learned my addr 172.21.15.5:0/45574558 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:22.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.688+0000 7f5acd5e0640 1 --2- 172.21.15.5:0/45574558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55778cb1c1b0 0x55778ceea850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:22.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.688+0000 7f5accddf640 1 --2- 172.21.15.5:0/45574558 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55778cb24390 0x55778ceead90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:22.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.689+0000 7f5acdde1640 1 -- 172.21.15.5:0/45574558 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55778cb24390 msgr2=0x55778ceead90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:22.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.689+0000 7f5acdde1640 1 --2- 172.21.15.5:0/45574558 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55778cb24390 0x55778ceead90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:22.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.689+0000 7f5acdde1640 1 -- 172.21.15.5:0/45574558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55778cb1c1b0 msgr2=0x55778ceea850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:22.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.689+0000 7f5acdde1640 1 --2- 172.21.15.5:0/45574558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55778cb1c1b0 0x55778ceea850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:22.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.689+0000 7f5acdde1640 1 -- 172.21.15.5:0/45574558 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55778cbb0650 con 0x55778cb45070 2024-08-31T05:36:22.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.689+0000 7f5acdde1640 1 --2- 172.21.15.5:0/45574558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55778cb45070 0x55778ceea310 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f5ac00117e0 tx=0x7f5ac0011ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32c197e33cb009a0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:22.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.689+0000 7f5abe7fc640 1 --2- 172.21.15.5:0/2669790665 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5ab40b4df0 0x7f5ab40b7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:22.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.689+0000 7f5acd5e0640 1 --2- 172.21.15.5:0/2669790665 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5ab40b4df0 0x7f5ab40b7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:22.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.689+0000 7f5abe7fc640 1 -- 172.21.15.5:0/2669790665 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f5ab80e5a70 con 0x7f5ac81050a0 2024-08-31T05:36:22.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.689+0000 7f5ab37fe640 1 -- 172.21.15.5:0/45574558 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac0011310 con 0x55778cb45070 2024-08-31T05:36:22.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.689+0000 7f5ab37fe640 1 -- 172.21.15.5:0/45574558 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ac0003e20 con 0x55778cb45070 2024-08-31T05:36:22.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.689+0000 7f5ab37fe640 1 -- 172.21.15.5:0/45574558 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac00044f0 con 0x55778cb45070 2024-08-31T05:36:22.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.690+0000 7f5ad5db9740 1 -- 172.21.15.5:0/45574558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55778cb45070 msgr2=0x55778ceea310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:22.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.690+0000 7f5acd5e0640 1 --2- 172.21.15.5:0/2669790665 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5ab40b4df0 0x7f5ab40b7300 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4000c00 tx=0x7f5ac4031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:22.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.690+0000 7f5ad5db9740 1 --2- 172.21.15.5:0/45574558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55778cb45070 0x55778ceea310 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f5ac00117e0 tx=0x7f5ac0011ca0 comp rx=0 tx=0).stop 2024-08-31T05:36:22.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.690+0000 7f5ad5db9740 1 -- 172.21.15.5:0/45574558 shutdown_connections 2024-08-31T05:36:22.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.690+0000 7f5ad5db9740 1 --2- 172.21.15.5:0/45574558 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55778cb24390 0x55778ceead90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:22.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.690+0000 7f5ad5db9740 1 --2- 172.21.15.5:0/45574558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55778cb1c1b0 0x55778ceea850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:22.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.690+0000 7f5ad5db9740 1 --2- 172.21.15.5:0/45574558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55778cb45070 0x55778ceea310 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:22.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.690+0000 7f5ad5db9740 1 -- 172.21.15.5:0/45574558 >> 172.21.15.5:0/45574558 conn(0x55778cb39460 msgr2=0x55778cee8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:22.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.690+0000 7f5ad5db9740 1 -- 172.21.15.5:0/45574558 shutdown_connections 2024-08-31T05:36:22.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.690+0000 7f5ad5db9740 1 -- 172.21.15.5:0/45574558 wait complete. 2024-08-31T05:36:22.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.691+0000 7f5ad5db9740 1 -- start start 2024-08-31T05:36:22.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.691+0000 7f5ad5db9740 1 Processor -- start 2024-08-31T05:36:22.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.692+0000 7f5ad5db9740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55778cb1c1b0 0x55778cef5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:22.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.692+0000 7f5ad5db9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55778cb24390 0x55778cef5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:22.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.692+0000 7f5ad5db9740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55778cb45070 0x55778cf01de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:22.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.692+0000 7f5ad5db9740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55778ccb3700 con 0x55778cb1c1b0 2024-08-31T05:36:22.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.692+0000 7f5ad5db9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55778cdd7750 con 0x55778cb24390 2024-08-31T05:36:22.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.692+0000 7f5ad5db9740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55778cef8af0 con 0x55778cb45070 2024-08-31T05:36:22.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.692+0000 7f5ad5db9740 10 client.0 _ll_register_callbacks cb 0x55778ce06e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:36:22.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.692+0000 7f5acd5e0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55778cb1c1b0 0x55778cef5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:22.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.692+0000 7f5acdde1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55778cb45070 0x55778cf01de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:22.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.692+0000 7f5acd5e0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55778cb1c1b0 0x55778cef5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51494/0 (socket says 172.21.15.5:51494) 2024-08-31T05:36:22.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.692+0000 7f5acd5e0640 1 -- 172.21.15.5:0/3776601351 learned_addr learned my addr 172.21.15.5:0/3776601351 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:22.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.692+0000 7f5accddf640 1 --2- 172.21.15.5:0/3776601351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55778cb24390 0x55778cef5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:22.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.692+0000 7f5accddf640 1 -- 172.21.15.5:0/3776601351 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55778cb45070 msgr2=0x55778cf01de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:22.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.692+0000 7f5accddf640 1 --2- 172.21.15.5:0/3776601351 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55778cb45070 0x55778cf01de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:22.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.692+0000 7f5accddf640 1 -- 172.21.15.5:0/3776601351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55778cb1c1b0 msgr2=0x55778cef5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:22.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.692+0000 7f5accddf640 1 --2- 172.21.15.5:0/3776601351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55778cb1c1b0 0x55778cef5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:22.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.692+0000 7f5accddf640 1 -- 172.21.15.5:0/3776601351 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55778ce10900 con 0x55778cb24390 2024-08-31T05:36:22.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.692+0000 7f5acdde1640 1 --2- 172.21.15.5:0/3776601351 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55778cb45070 0x55778cf01de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:36:22.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.692+0000 7f5accddf640 1 --2- 172.21.15.5:0/3776601351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55778cb24390 0x55778cef5fb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5ab80e2e40 tx=0x7f5ab80a7d60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=761e4f7ea7727778 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:22.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.693+0000 7f5ab0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:36:22.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.693+0000 7f5ab0ff9640 1 -- 172.21.15.5:0/3776601351 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab80ab550 con 0x55778cb24390 2024-08-31T05:36:22.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.693+0000 7f5ad5db9740 1 -- 172.21.15.5:0/3776601351 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ac0003e20 con 0x55778cb24390 2024-08-31T05:36:22.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.693+0000 7f5ab0ff9640 1 -- 172.21.15.5:0/3776601351 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f5ab80a83d0 con 0x55778cb24390 2024-08-31T05:36:22.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.693+0000 7f5ab0ff9640 1 -- 172.21.15.5:0/3776601351 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f5ab80ab8f0 con 0x55778cb24390 2024-08-31T05:36:22.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.693+0000 7f5ad5db9740 10 client.26873 fetch_fsmap learned FSMap version 34 2024-08-31T05:36:22.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.693+0000 7f5ad5db9740 1 -- 172.21.15.5:0/3776601351 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55778cf04950 con 0x55778cb24390 2024-08-31T05:36:22.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.693+0000 7f5ab0ff9640 1 -- 172.21.15.5:0/3776601351 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ac0003e20 con 0x55778cb24390 2024-08-31T05:36:22.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.693+0000 7f5ab0ff9640 1 -- 172.21.15.5:0/3776601351 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f5ab80b4c70 con 0x55778cb24390 2024-08-31T05:36:22.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.694+0000 7f5ad5db9740 10 client.26873 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:36:22.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.694+0000 7f5ad5db9740 10 client.26873 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-31T05:36:22.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.694+0000 7f5ad5db9740 20 client.26873 populate_metadata read hostname 'smithi005' 2024-08-31T05:36:22.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.694+0000 7f5ad5db9740 1 --2- 172.21.15.5:0/3776601351 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55778cb039f0 0x55778cf07d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:22.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.694+0000 7f5ad5db9740 4 client.26873 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:36:22.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.694+0000 7f5ad5db9740 1 -- 172.21.15.5:0/3776601351 --> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55778ce635d0 con 0x55778cb039f0 2024-08-31T05:36:22.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.694+0000 7f5acd5e0640 1 --2- 172.21.15.5:0/3776601351 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55778cb039f0 0x55778cf07d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:22.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.694+0000 7f5ab0ff9640 10 client.26873 ms_handle_connect on v2:172.21.15.50:6838/98200944 2024-08-31T05:36:22.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.694+0000 7f5acd5e0640 1 --2- 172.21.15.5:0/3776601351 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55778cb039f0 0x55778cf07d90 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ca9fe52a64805e1e server_cookie=5c657e79251020ff in_seq=0 out_seq=0 2024-08-31T05:36:22.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.695+0000 7f5ab0ff9640 1 -- 172.21.15.5:0/3776601351 <== mds.1 v2:172.21.15.50:6838/98200944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55778ce635d0 con 0x55778cb039f0 2024-08-31T05:36:22.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.695+0000 7f5ab0ff9640 10 client.26873 handle_command_reply: tid=0 2024-08-31T05:36:22.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.695+0000 7f5ad5db9740 1 client.26873 shutdown 2024-08-31T05:36:22.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.695+0000 7f5ad5db9740 1 -- 172.21.15.5:0/3776601351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55778cb24390 msgr2=0x55778cef5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:22.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.695+0000 7f5ad5db9740 1 --2- 172.21.15.5:0/3776601351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55778cb24390 0x55778cef5fb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5ab80e2e40 tx=0x7f5ab80a7d60 comp rx=0 tx=0).stop 2024-08-31T05:36:22.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.695+0000 7f5ad5db9740 1 -- 172.21.15.5:0/3776601351 shutdown_connections 2024-08-31T05:36:22.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.695+0000 7f5ad5db9740 1 --2- 172.21.15.5:0/3776601351 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55778cb039f0 0x55778cf07d90 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:22.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.695+0000 7f5ad5db9740 1 --2- 172.21.15.5:0/3776601351 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55778cb45070 0x55778cf01de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:22.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.695+0000 7f5ad5db9740 1 --2- 172.21.15.5:0/3776601351 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55778cb24390 0x55778cef5fb0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:22.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.695+0000 7f5ab0ff9640 0 client.26873 ms_handle_reset on v2:172.21.15.50:6838/98200944 2024-08-31T05:36:22.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.695+0000 7f5ad5db9740 1 --2- 172.21.15.5:0/3776601351 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55778cb1c1b0 0x55778cef5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:22.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.695+0000 7f5ad5db9740 1 -- 172.21.15.5:0/3776601351 >> 172.21.15.5:0/3776601351 conn(0x55778cb39460 msgr2=0x55778ceed4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:22.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.696+0000 7f5ad5db9740 1 -- 172.21.15.5:0/3776601351 shutdown_connections 2024-08-31T05:36:22.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.696+0000 7f5ad5db9740 1 -- 172.21.15.5:0/3776601351 wait complete. 2024-08-31T05:36:22.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.696+0000 7f5ad5db9740 20 client.26873 trim_cache size 0 max 16384 2024-08-31T05:36:22.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.711+0000 7f5ad5db9740 1 Processor -- start 2024-08-31T05:36:22.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.711+0000 7f5ad5db9740 1 -- start start 2024-08-31T05:36:22.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.711+0000 7f5ad5db9740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55778cb039f0 0x55778cee8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:22.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.711+0000 7f5ad5db9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55778cb1c1b0 0x55778cf01ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:22.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.711+0000 7f5ad5db9740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55778cb24390 0x55778cf02220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:22.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.711+0000 7f5ad5db9740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac81b2e00 con 0x55778cb24390 2024-08-31T05:36:22.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.711+0000 7f5ad5db9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac81b4940 con 0x55778cb1c1b0 2024-08-31T05:36:22.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.711+0000 7f5ad5db9740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac81b34d0 con 0x55778cb039f0 2024-08-31T05:36:22.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.711+0000 7f5acd5e0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55778cb039f0 0x55778cee8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:22.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.711+0000 7f5acdde1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55778cb24390 0x55778cf02220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:22.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.711+0000 7f5acd5e0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55778cb039f0 0x55778cee8300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:55626/0 (socket says 172.21.15.5:55626) 2024-08-31T05:36:22.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.711+0000 7f5acd5e0640 1 -- 172.21.15.5:0/623785887 learned_addr learned my addr 172.21.15.5:0/623785887 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:22.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.711+0000 7f5accddf640 1 --2- 172.21.15.5:0/623785887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55778cb1c1b0 0x55778cf01ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:22.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.712+0000 7f5acd5e0640 1 -- 172.21.15.5:0/623785887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55778cb1c1b0 msgr2=0x55778cf01ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:22.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.712+0000 7f5acd5e0640 1 --2- 172.21.15.5:0/623785887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55778cb1c1b0 0x55778cf01ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:22.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.712+0000 7f5acd5e0640 1 -- 172.21.15.5:0/623785887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55778cb24390 msgr2=0x55778cf02220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:22.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.712+0000 7f5acd5e0640 1 --2- 172.21.15.5:0/623785887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55778cb24390 0x55778cf02220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:22.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.712+0000 7f5acd5e0640 1 -- 172.21.15.5:0/623785887 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55778cf082d0 con 0x55778cb039f0 2024-08-31T05:36:22.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.712+0000 7f5acd5e0640 1 --2- 172.21.15.5:0/623785887 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55778cb039f0 0x55778cee8300 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4006010 tx=0x7f5ac403f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b390540cc2bdb823 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:22.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.712+0000 7f5ab2ffd640 1 -- 172.21.15.5:0/623785887 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac4057070 con 0x55778cb039f0 2024-08-31T05:36:22.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.712+0000 7f5ab2ffd640 1 -- 172.21.15.5:0/623785887 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ac4005610 con 0x55778cb039f0 2024-08-31T05:36:22.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.712+0000 7f5ab2ffd640 1 -- 172.21.15.5:0/623785887 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac4035040 con 0x55778cb039f0 2024-08-31T05:36:22.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.713+0000 7f5ad5db9740 1 -- 172.21.15.5:0/623785887 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55778cb039f0 msgr2=0x55778cee8300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:22.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.713+0000 7f5ad5db9740 1 --2- 172.21.15.5:0/623785887 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55778cb039f0 0x55778cee8300 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4006010 tx=0x7f5ac403f000 comp rx=0 tx=0).stop 2024-08-31T05:36:22.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.713+0000 7f5ad5db9740 1 -- 172.21.15.5:0/623785887 shutdown_connections 2024-08-31T05:36:22.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.713+0000 7f5ad5db9740 1 --2- 172.21.15.5:0/623785887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55778cb24390 0x55778cf02220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:22.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.713+0000 7f5ad5db9740 1 --2- 172.21.15.5:0/623785887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55778cb1c1b0 0x55778cf01ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:22.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.713+0000 7f5ad5db9740 1 --2- 172.21.15.5:0/623785887 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55778cb039f0 0x55778cee8300 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:22.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.713+0000 7f5ad5db9740 1 -- 172.21.15.5:0/623785887 >> 172.21.15.5:0/623785887 conn(0x55778cb39460 msgr2=0x55778cee7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:22.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.713+0000 7f5ad5db9740 1 -- 172.21.15.5:0/623785887 shutdown_connections 2024-08-31T05:36:22.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.713+0000 7f5ad5db9740 1 -- 172.21.15.5:0/623785887 wait complete. 2024-08-31T05:36:22.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.713+0000 7f5ad5db9740 1 -- start start 2024-08-31T05:36:22.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.714+0000 7f5ad5db9740 1 Processor -- start 2024-08-31T05:36:22.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.714+0000 7f5ad5db9740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55778cb039f0 0x55778cef9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:22.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.714+0000 7f5ad5db9740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55778cb1c1b0 0x55778cefa430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:22.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.714+0000 7f5ad5db9740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55778cb24390 0x55778cefa970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:22.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.714+0000 7f5ad5db9740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac81b4270 con 0x55778cb24390 2024-08-31T05:36:22.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.714+0000 7f5ad5db9740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac81b3ba0 con 0x55778cb039f0 2024-08-31T05:36:22.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.714+0000 7f5ad5db9740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac81b0de0 con 0x55778cb1c1b0 2024-08-31T05:36:22.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.714+0000 7f5ad5db9740 10 client.0 _ll_register_callbacks cb 0x7f5ab8009490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:36:22.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.714+0000 7f5acd5e0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55778cb039f0 0x55778cef9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:22.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.714+0000 7f5acdde1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55778cb24390 0x55778cefa970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:22.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.714+0000 7f5acd5e0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55778cb039f0 0x55778cef9ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:55438/0 (socket says 172.21.15.5:55438) 2024-08-31T05:36:22.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.714+0000 7f5acd5e0640 1 -- 172.21.15.5:0/3470631961 learned_addr learned my addr 172.21.15.5:0/3470631961 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:22.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.714+0000 7f5accddf640 1 --2- 172.21.15.5:0/3470631961 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55778cb1c1b0 0x55778cefa430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:22.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.715+0000 7f5accddf640 1 -- 172.21.15.5:0/3470631961 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55778cb039f0 msgr2=0x55778cef9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:22.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.715+0000 7f5accddf640 1 --2- 172.21.15.5:0/3470631961 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55778cb039f0 0x55778cef9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:22.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.715+0000 7f5accddf640 1 -- 172.21.15.5:0/3470631961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55778cb24390 msgr2=0x55778cefa970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:22.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.715+0000 7f5accddf640 1 --2- 172.21.15.5:0/3470631961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55778cb24390 0x55778cefa970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:22.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.715+0000 7f5accddf640 1 -- 172.21.15.5:0/3470631961 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55778cf71950 con 0x55778cb1c1b0 2024-08-31T05:36:22.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.716+0000 7f5acd5e0640 1 --2- 172.21.15.5:0/3470631961 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55778cb039f0 0x55778cef9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:36:22.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.716+0000 7f5acdde1640 1 --2- 172.21.15.5:0/3470631961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55778cb24390 0x55778cefa970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:36:22.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.716+0000 7f5accddf640 1 --2- 172.21.15.5:0/3470631961 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55778cb1c1b0 0x55778cefa430 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5ab80098c0 tx=0x7f5ab80b0580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1837445547f1dbb5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:22.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.716+0000 7f5ab0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:36:22.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.716+0000 7f5ab0ff9640 1 -- 172.21.15.5:0/3470631961 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab80ab550 con 0x55778cb1c1b0 2024-08-31T05:36:22.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.716+0000 7f5ab0ff9640 1 -- 172.21.15.5:0/3470631961 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f5ab80a83d0 con 0x55778cb1c1b0 2024-08-31T05:36:22.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.716+0000 7f5ad5db9740 1 -- 172.21.15.5:0/3470631961 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ac4005610 con 0x55778cb1c1b0 2024-08-31T05:36:22.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.717+0000 7f5ab0ff9640 1 -- 172.21.15.5:0/3470631961 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f5ab80ac4e0 con 0x55778cb1c1b0 2024-08-31T05:36:22.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.717+0000 7f5ad5db9740 10 client.26887 fetch_fsmap learned FSMap version 34 2024-08-31T05:36:22.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.717+0000 7f5ad5db9740 1 -- 172.21.15.5:0/3470631961 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55778cf72bb0 con 0x55778cb1c1b0 2024-08-31T05:36:22.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.717+0000 7f5ab0ff9640 1 -- 172.21.15.5:0/3470631961 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ac4005610 con 0x55778cb1c1b0 2024-08-31T05:36:22.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.717+0000 7f5ab0ff9640 1 -- 172.21.15.5:0/3470631961 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f5ab80b17e0 con 0x55778cb1c1b0 2024-08-31T05:36:22.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.717+0000 7f5ad5db9740 10 client.26887 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:36:22.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.717+0000 7f5ad5db9740 10 client.26887 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-31T05:36:22.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.717+0000 7f5ad5db9740 20 client.26887 populate_metadata read hostname 'smithi005' 2024-08-31T05:36:22.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.717+0000 7f5ad5db9740 1 --2- 172.21.15.5:0/3470631961 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55778cb45070 0x55778cf75340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:22.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.717+0000 7f5ad5db9740 4 client.26887 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:36:22.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.717+0000 7f5ad5db9740 1 -- 172.21.15.5:0/3470631961 --> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55778ce5f070 con 0x55778cb45070 2024-08-31T05:36:22.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.717+0000 7f5acd5e0640 1 --2- 172.21.15.5:0/3470631961 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55778cb45070 0x55778cf75340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:22.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.718+0000 7f5acd5e0640 1 --2- 172.21.15.5:0/3470631961 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55778cb45070 0x55778cf75340 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6c0f575716227b3c server_cookie=e38d7e2e2e7bbed8 in_seq=0 out_seq=0 2024-08-31T05:36:22.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.718+0000 7f5ab0ff9640 10 client.26887 ms_handle_connect on v2:172.21.15.50:6838/98200944 2024-08-31T05:36:22.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.718+0000 7f5ab0ff9640 1 -- 172.21.15.5:0/3470631961 <== mds.1 v2:172.21.15.50:6838/98200944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55778ce5f070 con 0x55778cb45070 2024-08-31T05:36:22.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.718+0000 7f5ab0ff9640 10 client.26887 handle_command_reply: tid=0 2024-08-31T05:36:22.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.718+0000 7f5ad5db9740 1 client.26887 shutdown 2024-08-31T05:36:22.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.718+0000 7f5ad5db9740 1 -- 172.21.15.5:0/3470631961 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55778cb1c1b0 msgr2=0x55778cefa430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:22.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.718+0000 7f5ad5db9740 1 --2- 172.21.15.5:0/3470631961 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55778cb1c1b0 0x55778cefa430 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5ab80098c0 tx=0x7f5ab80b0580 comp rx=0 tx=0).stop 2024-08-31T05:36:22.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.718+0000 7f5ad5db9740 1 -- 172.21.15.5:0/3470631961 shutdown_connections 2024-08-31T05:36:22.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.718+0000 7f5ad5db9740 1 --2- 172.21.15.5:0/3470631961 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55778cb45070 0x55778cf75340 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:22.831 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:36:22.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.718+0000 7f5ad5db9740 1 --2- 172.21.15.5:0/3470631961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55778cb24390 0x55778cefa970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:22.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.718+0000 7f5ad5db9740 1 --2- 172.21.15.5:0/3470631961 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55778cb1c1b0 0x55778cefa430 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:22.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.718+0000 7f5ad5db9740 1 --2- 172.21.15.5:0/3470631961 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55778cb039f0 0x55778cef9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:22.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.718+0000 7f5ab0ff9640 0 client.26887 ms_handle_reset on v2:172.21.15.50:6838/98200944 2024-08-31T05:36:22.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.718+0000 7f5ad5db9740 1 -- 172.21.15.5:0/3470631961 >> 172.21.15.5:0/3470631961 conn(0x55778cb39460 msgr2=0x55778ceed410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:22.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.719+0000 7f5ad5db9740 1 -- 172.21.15.5:0/3470631961 shutdown_connections 2024-08-31T05:36:22.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.719+0000 7f5ad5db9740 1 -- 172.21.15.5:0/3470631961 wait complete. 2024-08-31T05:36:22.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.719+0000 7f5ad5db9740 20 client.26887 trim_cache size 0 max 16384 2024-08-31T05:36:22.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.719+0000 7f5acf844640 1 -- 172.21.15.5:0/2669790665 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5ab40b4df0 msgr2=0x7f5ab40b7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:22.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.719+0000 7f5acf844640 1 --2- 172.21.15.5:0/2669790665 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5ab40b4df0 0x7f5ab40b7300 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4000c00 tx=0x7f5ac4031400 comp rx=0 tx=0).stop 2024-08-31T05:36:22.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.719+0000 7f5acf844640 1 -- 172.21.15.5:0/2669790665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ac81050a0 msgr2=0x7f5ac819a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:22.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.719+0000 7f5acf844640 1 --2- 172.21.15.5:0/2669790665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ac81050a0 0x7f5ac819a840 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f5ab800e970 tx=0x7f5ab800ee30 comp rx=0 tx=0).stop 2024-08-31T05:36:22.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.719+0000 7f5acf844640 1 -- 172.21.15.5:0/2669790665 shutdown_connections 2024-08-31T05:36:22.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.719+0000 7f5acf844640 1 --2- 172.21.15.5:0/2669790665 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5ab40b4df0 0x7f5ab40b7300 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:22.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.719+0000 7f5acf844640 1 --2- 172.21.15.5:0/2669790665 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ac810dbb0 0x7f5ac819fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:22.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.719+0000 7f5acf844640 1 --2- 172.21.15.5:0/2669790665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ac81050a0 0x7f5ac819a840 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:22.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.719+0000 7f5acf844640 1 --2- 172.21.15.5:0/2669790665 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ac8104750 0x7f5ac819a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:22.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.719+0000 7f5acf844640 1 -- 172.21.15.5:0/2669790665 >> 172.21.15.5:0/2669790665 conn(0x7f5ac80794d0 msgr2=0x7f5ac81005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:22.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.719+0000 7f5acf844640 1 -- 172.21.15.5:0/2669790665 shutdown_connections 2024-08-31T05:36:22.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:22.719+0000 7f5acf844640 1 -- 172.21.15.5:0/2669790665 wait complete. 2024-08-31T05:36:22.921 INFO:tasks.workunit.client.0.smithi005.stdout: 1 713849 11.75 MB/sec execute 190 sec latency 40.495 ms 2024-08-31T05:36:23.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:23 smithi005 ceph-mon[18602]: pgmap v537: 129 pgs: 129 active+clean; 399 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 188 op/s 2024-08-31T05:36:23.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:23 smithi070 ceph-mon[22316]: pgmap v537: 129 pgs: 129 active+clean; 399 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 188 op/s 2024-08-31T05:36:23.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:23 smithi050 ceph-mon[22146]: pgmap v537: 129 pgs: 129 active+clean; 399 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 188 op/s 2024-08-31T05:36:23.922 INFO:tasks.workunit.client.0.smithi005.stdout: 1 715295 11.72 MB/sec execute 191 sec latency 98.342 ms 2024-08-31T05:36:24.039 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T05:36:24.341 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:36:24.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.826+0000 7ff8864da640 1 -- 172.21.15.5:0/362381694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff880103960 msgr2=0x7ff880103d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:24.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.826+0000 7ff8864da640 1 --2- 172.21.15.5:0/362381694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff880103960 0x7ff880103d70 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7ff870009900 tx=0x7ff87002a3f0 comp rx=0 tx=0).stop 2024-08-31T05:36:24.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.826+0000 7ff8864da640 1 -- 172.21.15.5:0/362381694 shutdown_connections 2024-08-31T05:36:24.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.826+0000 7ff8864da640 1 --2- 172.21.15.5:0/362381694 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff880109ba0 0x7ff8801103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:24.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.826+0000 7ff8864da640 1 --2- 172.21.15.5:0/362381694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff880109250 0x7ff880109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:24.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.826+0000 7ff8864da640 1 --2- 172.21.15.5:0/362381694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff880103960 0x7ff880103d70 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:24.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.826+0000 7ff8864da640 1 -- 172.21.15.5:0/362381694 >> 172.21.15.5:0/362381694 conn(0x7ff88007b6b0 msgr2=0x7ff88007bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:24.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.826+0000 7ff8864da640 1 -- 172.21.15.5:0/362381694 shutdown_connections 2024-08-31T05:36:24.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.826+0000 7ff8864da640 1 -- 172.21.15.5:0/362381694 wait complete. 2024-08-31T05:36:24.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.827+0000 7ff8864da640 1 Processor -- start 2024-08-31T05:36:24.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.827+0000 7ff8864da640 1 -- start start 2024-08-31T05:36:24.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.827+0000 7ff8864da640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff880103960 0x7ff88019a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:24.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.827+0000 7ff8864da640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff880109250 0x7ff88019a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:24.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.827+0000 7ff8864da640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff880109ba0 0x7ff88019fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:24.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.827+0000 7ff8864da640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff880113860 con 0x7ff880103960 2024-08-31T05:36:24.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.827+0000 7ff8864da640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff8801136e0 con 0x7ff880109250 2024-08-31T05:36:24.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.827+0000 7ff8864da640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff8801139e0 con 0x7ff880109ba0 2024-08-31T05:36:24.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.827+0000 7ff87ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff880103960 0x7ff88019a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:24.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.827+0000 7ff87ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff880103960 0x7ff88019a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51542/0 (socket says 172.21.15.5:51542) 2024-08-31T05:36:24.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.827+0000 7ff87ffff640 1 -- 172.21.15.5:0/2879331902 learned_addr learned my addr 172.21.15.5:0/2879331902 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:24.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.828+0000 7ff877fff640 1 --2- 172.21.15.5:0/2879331902 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff880109250 0x7ff88019a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:24.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.828+0000 7ff884a77640 1 --2- 172.21.15.5:0/2879331902 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff880109ba0 0x7ff88019fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:24.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.828+0000 7ff87ffff640 1 -- 172.21.15.5:0/2879331902 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff880109ba0 msgr2=0x7ff88019fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:24.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.828+0000 7ff87ffff640 1 --2- 172.21.15.5:0/2879331902 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff880109ba0 0x7ff88019fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:24.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.828+0000 7ff87ffff640 1 -- 172.21.15.5:0/2879331902 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff880109250 msgr2=0x7ff88019a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:24.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.828+0000 7ff87ffff640 1 --2- 172.21.15.5:0/2879331902 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff880109250 0x7ff88019a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:24.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.828+0000 7ff87ffff640 1 -- 172.21.15.5:0/2879331902 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8801a01e0 con 0x7ff880103960 2024-08-31T05:36:24.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.828+0000 7ff87ffff640 1 --2- 172.21.15.5:0/2879331902 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff880103960 0x7ff88019a270 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7ff870005940 tx=0x7ff8700040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:24.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.828+0000 7ff87dffb640 1 -- 172.21.15.5:0/2879331902 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff87003f030 con 0x7ff880103960 2024-08-31T05:36:24.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.828+0000 7ff87dffb640 1 -- 172.21.15.5:0/2879331902 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff8700044c0 con 0x7ff880103960 2024-08-31T05:36:24.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.828+0000 7ff8864da640 1 -- 172.21.15.5:0/2879331902 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8801a0470 con 0x7ff880103960 2024-08-31T05:36:24.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.828+0000 7ff87dffb640 1 -- 172.21.15.5:0/2879331902 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff870035070 con 0x7ff880103960 2024-08-31T05:36:24.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.828+0000 7ff8864da640 1 -- 172.21.15.5:0/2879331902 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8801a6c30 con 0x7ff880103960 2024-08-31T05:36:24.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.831+0000 7ff88ca4f740 1 Processor -- start 2024-08-31T05:36:24.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.831+0000 7ff88ca4f740 1 -- start start 2024-08-31T05:36:24.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.831+0000 7ff87dffb640 1 -- 172.21.15.5:0/2879331902 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7ff870042030 con 0x7ff880103960 2024-08-31T05:36:24.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.831+0000 7ff88ca4f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c886e2d070 0x55c8871d2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:24.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.831+0000 7ff88ca4f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c886e041b0 0x55c8871d2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:24.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.831+0000 7ff88ca4f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c886e0c390 0x55c8871d2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:24.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.831+0000 7ff88ca4f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55c887149680 con 0x55c886e041b0 2024-08-31T05:36:24.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.831+0000 7ff88ca4f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55c887138c10 con 0x55c886e0c390 2024-08-31T05:36:24.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.831+0000 7ff88ca4f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c88713cbc0 con 0x55c886e2d070 2024-08-31T05:36:24.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.832+0000 7ff87ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c886e041b0 0x55c8871d2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:24.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.832+0000 7ff884a77640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c886e2d070 0x55c8871d2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:24.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.832+0000 7ff877fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c886e0c390 0x55c8871d2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:24.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.832+0000 7ff884a77640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c886e2d070 0x55c8871d2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:55658/0 (socket says 172.21.15.5:55658) 2024-08-31T05:36:24.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.832+0000 7ff87ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c886e041b0 0x55c8871d2890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51552/0 (socket says 172.21.15.5:51552) 2024-08-31T05:36:24.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.832+0000 7ff884a77640 1 -- 172.21.15.5:0/1033886365 learned_addr learned my addr 172.21.15.5:0/1033886365 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:24.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.832+0000 7ff877fff640 1 --2- 172.21.15.5:0/1033886365 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c886e0c390 0x55c8871d2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:55456/0 (socket says 172.21.15.5:55456) 2024-08-31T05:36:24.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.832+0000 7ff884a77640 1 -- 172.21.15.5:0/1033886365 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c886e0c390 msgr2=0x55c8871d2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:24.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.832+0000 7ff884a77640 1 --2- 172.21.15.5:0/1033886365 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c886e0c390 0x55c8871d2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:24.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.832+0000 7ff884a77640 1 -- 172.21.15.5:0/1033886365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c886e041b0 msgr2=0x55c8871d2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:24.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.832+0000 7ff884a77640 1 --2- 172.21.15.5:0/1033886365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c886e041b0 0x55c8871d2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:24.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.832+0000 7ff884a77640 1 -- 172.21.15.5:0/1033886365 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c886e98650 con 0x55c886e2d070 2024-08-31T05:36:24.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.832+0000 7ff877fff640 1 --2- 172.21.15.5:0/1033886365 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c886e0c390 0x55c8871d2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:36:24.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.832+0000 7ff87dffb640 1 --2- 172.21.15.5:0/2879331902 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff86c0b4d20 0x7ff86c0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:24.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.832+0000 7ff884a77640 1 --2- 172.21.15.5:0/1033886365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c886e2d070 0x55c8871d2350 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff878009f50 tx=0x7ff8780118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25048ced876eee6c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:24.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.832+0000 7ff87ffff640 1 --2- 172.21.15.5:0/2879331902 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff86c0b4d20 0x7ff86c0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:24.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.832+0000 7ff87dffb640 1 -- 172.21.15.5:0/2879331902 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7ff870105860 con 0x7ff880103960 2024-08-31T05:36:24.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.832+0000 7ff8767fc640 1 -- 172.21.15.5:0/1033886365 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff878004d20 con 0x55c886e2d070 2024-08-31T05:36:24.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.833+0000 7ff8767fc640 1 -- 172.21.15.5:0/1033886365 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff878004050 con 0x55c886e2d070 2024-08-31T05:36:24.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.833+0000 7ff8767fc640 1 -- 172.21.15.5:0/1033886365 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff878005280 con 0x55c886e2d070 2024-08-31T05:36:24.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.833+0000 7ff88ca4f740 1 -- 172.21.15.5:0/1033886365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c886e2d070 msgr2=0x55c8871d2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:24.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.833+0000 7ff87ffff640 1 --2- 172.21.15.5:0/2879331902 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff86c0b4d20 0x7ff86c0b7230 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff870102ce0 tx=0x7ff87010b550 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:24.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.833+0000 7ff88ca4f740 1 --2- 172.21.15.5:0/1033886365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c886e2d070 0x55c8871d2350 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff878009f50 tx=0x7ff8780118d0 comp rx=0 tx=0).stop 2024-08-31T05:36:24.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.834+0000 7ff88ca4f740 1 -- 172.21.15.5:0/1033886365 shutdown_connections 2024-08-31T05:36:24.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.834+0000 7ff88ca4f740 1 --2- 172.21.15.5:0/1033886365 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c886e0c390 0x55c8871d2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:24.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.834+0000 7ff88ca4f740 1 --2- 172.21.15.5:0/1033886365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c886e041b0 0x55c8871d2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:24.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.834+0000 7ff88ca4f740 1 --2- 172.21.15.5:0/1033886365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c886e2d070 0x55c8871d2350 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:24.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.834+0000 7ff88ca4f740 1 -- 172.21.15.5:0/1033886365 >> 172.21.15.5:0/1033886365 conn(0x55c886e21460 msgr2=0x55c8871d0240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:24.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.834+0000 7ff88ca4f740 1 -- 172.21.15.5:0/1033886365 shutdown_connections 2024-08-31T05:36:24.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.834+0000 7ff88ca4f740 1 -- 172.21.15.5:0/1033886365 wait complete. 2024-08-31T05:36:24.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.834+0000 7ff88ca4f740 1 -- start start 2024-08-31T05:36:24.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.834+0000 7ff88ca4f740 1 Processor -- start 2024-08-31T05:36:24.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.835+0000 7ff88ca4f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c886e041b0 0x55c8871dda90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:24.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.835+0000 7ff88ca4f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c886e0c390 0x55c8871ddfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:24.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.835+0000 7ff88ca4f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c886e2d070 0x55c8871e9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:24.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.835+0000 7ff88ca4f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55c886f9b700 con 0x55c886e041b0 2024-08-31T05:36:24.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.835+0000 7ff88ca4f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55c8870bf750 con 0x55c886e0c390 2024-08-31T05:36:24.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.835+0000 7ff88ca4f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c8871e0b30 con 0x55c886e2d070 2024-08-31T05:36:24.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.835+0000 7ff88ca4f740 10 client.0 _ll_register_callbacks cb 0x55c8870eee10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:36:24.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.835+0000 7ff884a77640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c886e041b0 0x55c8871dda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:24.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.835+0000 7ff884a77640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c886e041b0 0x55c8871dda90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51560/0 (socket says 172.21.15.5:51560) 2024-08-31T05:36:24.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.835+0000 7ff884a77640 1 -- 172.21.15.5:0/870256571 learned_addr learned my addr 172.21.15.5:0/870256571 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:24.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.835+0000 7ff877fff640 1 --2- 172.21.15.5:0/870256571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c886e0c390 0x55c8871ddfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:24.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.835+0000 7ff884a77640 1 --2- 172.21.15.5:0/870256571 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c886e2d070 0x55c8871e9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:24.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.835+0000 7ff884a77640 1 -- 172.21.15.5:0/870256571 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c886e2d070 msgr2=0x55c8871e9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:24.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.835+0000 7ff884a77640 1 --2- 172.21.15.5:0/870256571 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c886e2d070 0x55c8871e9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:24.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.835+0000 7ff884a77640 1 -- 172.21.15.5:0/870256571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c886e0c390 msgr2=0x55c8871ddfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:24.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.835+0000 7ff884a77640 1 --2- 172.21.15.5:0/870256571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c886e0c390 0x55c8871ddfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:24.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.835+0000 7ff884a77640 1 -- 172.21.15.5:0/870256571 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8870f8900 con 0x55c886e041b0 2024-08-31T05:36:24.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.835+0000 7ff877fff640 1 --2- 172.21.15.5:0/870256571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c886e0c390 0x55c8871ddfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:36:24.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.835+0000 7ff884a77640 1 --2- 172.21.15.5:0/870256571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c886e041b0 0x55c8871dda90 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7ff878003fd0 tx=0x7ff878004930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2cd06c7f9c00897 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:24.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.835+0000 7ff85f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:36:24.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.836+0000 7ff85f7fe640 1 -- 172.21.15.5:0/870256571 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff878004a40 con 0x55c886e041b0 2024-08-31T05:36:24.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.836+0000 7ff85f7fe640 1 -- 172.21.15.5:0/870256571 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7ff878004be0 con 0x55c886e041b0 2024-08-31T05:36:24.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.836+0000 7ff88ca4f740 1 -- 172.21.15.5:0/870256571 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff878004050 con 0x55c886e041b0 2024-08-31T05:36:24.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.836+0000 7ff85f7fe640 1 -- 172.21.15.5:0/870256571 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ff878036050 con 0x55c886e041b0 2024-08-31T05:36:24.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.836+0000 7ff88ca4f740 10 client.17304 fetch_fsmap learned FSMap version 34 2024-08-31T05:36:24.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.836+0000 7ff88ca4f740 1 -- 172.21.15.5:0/870256571 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55c8871ec8c0 con 0x55c886e041b0 2024-08-31T05:36:24.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.836+0000 7ff85f7fe640 1 -- 172.21.15.5:0/870256571 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff878004050 con 0x55c886e041b0 2024-08-31T05:36:24.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.836+0000 7ff85f7fe640 1 -- 172.21.15.5:0/870256571 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7ff8780274d0 con 0x55c886e041b0 2024-08-31T05:36:24.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.836+0000 7ff88ca4f740 10 client.17304 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:36:24.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.836+0000 7ff88ca4f740 10 client.17304 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:36:24.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.836+0000 7ff88ca4f740 20 client.17304 populate_metadata read hostname 'smithi005' 2024-08-31T05:36:24.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.836+0000 7ff88ca4f740 1 --2- 172.21.15.5:0/870256571 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55c886deb9f0 0x55c8871efcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:24.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.836+0000 7ff88ca4f740 4 client.17304 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:36:24.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.836+0000 7ff88ca4f740 1 -- 172.21.15.5:0/870256571 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c88714b5d0 con 0x55c886deb9f0 2024-08-31T05:36:24.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.837+0000 7ff877fff640 1 --2- 172.21.15.5:0/870256571 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55c886deb9f0 0x55c8871efcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:24.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.837+0000 7ff877fff640 1 --2- 172.21.15.5:0/870256571 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55c886deb9f0 0x55c8871efcd0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4aa8dd55fe4bb42 server_cookie=dd202b846194d51c in_seq=0 out_seq=0 2024-08-31T05:36:24.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.837+0000 7ff85f7fe640 10 client.17304 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:36:24.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.838+0000 7ff85f7fe640 1 -- 172.21.15.5:0/870256571 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c88714b5d0 con 0x55c886deb9f0 2024-08-31T05:36:24.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.838+0000 7ff85f7fe640 10 client.17304 handle_command_reply: tid=0 2024-08-31T05:36:24.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.838+0000 7ff88ca4f740 1 client.17304 shutdown 2024-08-31T05:36:24.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.838+0000 7ff88ca4f740 1 -- 172.21.15.5:0/870256571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c886e041b0 msgr2=0x55c8871dda90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:24.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.838+0000 7ff88ca4f740 1 --2- 172.21.15.5:0/870256571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c886e041b0 0x55c8871dda90 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7ff878003fd0 tx=0x7ff878004930 comp rx=0 tx=0).stop 2024-08-31T05:36:24.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.838+0000 7ff88ca4f740 1 -- 172.21.15.5:0/870256571 shutdown_connections 2024-08-31T05:36:24.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.838+0000 7ff88ca4f740 1 --2- 172.21.15.5:0/870256571 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55c886deb9f0 0x55c8871efcd0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:24.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.838+0000 7ff88ca4f740 1 --2- 172.21.15.5:0/870256571 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c886e2d070 0x55c8871e9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:24.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.838+0000 7ff85f7fe640 0 client.17304 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:36:24.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.838+0000 7ff88ca4f740 1 --2- 172.21.15.5:0/870256571 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c886e0c390 0x55c8871ddfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:24.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.838+0000 7ff88ca4f740 1 --2- 172.21.15.5:0/870256571 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c886e041b0 0x55c8871dda90 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:24.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.838+0000 7ff88ca4f740 1 -- 172.21.15.5:0/870256571 >> 172.21.15.5:0/870256571 conn(0x55c886e21460 msgr2=0x55c8871d54e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:24.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.838+0000 7ff88ca4f740 1 -- 172.21.15.5:0/870256571 shutdown_connections 2024-08-31T05:36:24.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.838+0000 7ff88ca4f740 1 -- 172.21.15.5:0/870256571 wait complete. 2024-08-31T05:36:24.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.839+0000 7ff88ca4f740 20 client.17304 trim_cache size 0 max 16384 2024-08-31T05:36:24.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.853+0000 7ff88ca4f740 1 Processor -- start 2024-08-31T05:36:24.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.853+0000 7ff88ca4f740 1 -- start start 2024-08-31T05:36:24.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.853+0000 7ff88ca4f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c886deb9f0 0x55c8871e9d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:24.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.853+0000 7ff88ca4f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c886e041b0 0x55c8871cfb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:24.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.853+0000 7ff88ca4f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c886e0c390 0x55c8871d00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:24.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.853+0000 7ff88ca4f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff8801b0c90 con 0x55c886e041b0 2024-08-31T05:36:24.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.853+0000 7ff88ca4f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff8801b27d0 con 0x55c886deb9f0 2024-08-31T05:36:24.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.853+0000 7ff88ca4f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff8801b1360 con 0x55c886e0c390 2024-08-31T05:36:24.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.853+0000 7ff877fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c886e041b0 0x55c8871cfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:24.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.853+0000 7ff877fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c886e041b0 0x55c8871cfb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51564/0 (socket says 172.21.15.5:51564) 2024-08-31T05:36:24.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.853+0000 7ff877fff640 1 -- 172.21.15.5:0/808639626 learned_addr learned my addr 172.21.15.5:0/808639626 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:24.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.853+0000 7ff884a77640 1 --2- 172.21.15.5:0/808639626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c886deb9f0 0x55c8871e9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:24.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.853+0000 7ff884a77640 1 --2- 172.21.15.5:0/808639626 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c886e0c390 0x55c8871d00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:24.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.853+0000 7ff877fff640 1 -- 172.21.15.5:0/808639626 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c886e0c390 msgr2=0x55c8871d00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:24.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.853+0000 7ff877fff640 1 --2- 172.21.15.5:0/808639626 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c886e0c390 0x55c8871d00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:24.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.853+0000 7ff877fff640 1 -- 172.21.15.5:0/808639626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c886deb9f0 msgr2=0x55c8871e9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:24.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.853+0000 7ff877fff640 1 --2- 172.21.15.5:0/808639626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c886deb9f0 0x55c8871e9d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:24.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.853+0000 7ff877fff640 1 -- 172.21.15.5:0/808639626 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8871ded50 con 0x55c886e041b0 2024-08-31T05:36:24.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.853+0000 7ff884a77640 1 --2- 172.21.15.5:0/808639626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c886deb9f0 0x55c8871e9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:36:24.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.854+0000 7ff877fff640 1 --2- 172.21.15.5:0/808639626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c886e041b0 0x55c8871cfb60 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7ff88006b640 tx=0x7ff868005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78b9a6cc6606a0b1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:24.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.854+0000 7ff875ffb640 1 -- 172.21.15.5:0/808639626 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff86800f790 con 0x55c886e041b0 2024-08-31T05:36:24.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.854+0000 7ff875ffb640 1 -- 172.21.15.5:0/808639626 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff86800fde0 con 0x55c886e041b0 2024-08-31T05:36:24.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.854+0000 7ff875ffb640 1 -- 172.21.15.5:0/808639626 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff868010e00 con 0x55c886e041b0 2024-08-31T05:36:24.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.855+0000 7ff88ca4f740 1 -- 172.21.15.5:0/808639626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c886e041b0 msgr2=0x55c8871cfb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:24.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.855+0000 7ff88ca4f740 1 --2- 172.21.15.5:0/808639626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c886e041b0 0x55c8871cfb60 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7ff88006b640 tx=0x7ff868005f90 comp rx=0 tx=0).stop 2024-08-31T05:36:24.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.855+0000 7ff88ca4f740 1 -- 172.21.15.5:0/808639626 shutdown_connections 2024-08-31T05:36:24.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.855+0000 7ff88ca4f740 1 --2- 172.21.15.5:0/808639626 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c886e0c390 0x55c8871d00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:24.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.855+0000 7ff88ca4f740 1 --2- 172.21.15.5:0/808639626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c886e041b0 0x55c8871cfb60 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:24.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.855+0000 7ff88ca4f740 1 --2- 172.21.15.5:0/808639626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c886deb9f0 0x55c8871e9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:24.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.855+0000 7ff88ca4f740 1 -- 172.21.15.5:0/808639626 >> 172.21.15.5:0/808639626 conn(0x55c886e21460 msgr2=0x55c8871dc310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:24.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.855+0000 7ff88ca4f740 1 -- 172.21.15.5:0/808639626 shutdown_connections 2024-08-31T05:36:24.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.855+0000 7ff88ca4f740 1 -- 172.21.15.5:0/808639626 wait complete. 2024-08-31T05:36:24.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.855+0000 7ff88ca4f740 1 -- start start 2024-08-31T05:36:24.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.855+0000 7ff88ca4f740 1 Processor -- start 2024-08-31T05:36:24.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.856+0000 7ff88ca4f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c886deb9f0 0x55c8871e1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:24.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.856+0000 7ff88ca4f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c886e041b0 0x55c8871e23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:24.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.856+0000 7ff88ca4f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c886e0c390 0x55c8871e28e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:24.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.856+0000 7ff88ca4f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff8801b2100 con 0x55c886e0c390 2024-08-31T05:36:24.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.856+0000 7ff88ca4f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff8801b1a30 con 0x55c886e041b0 2024-08-31T05:36:24.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.856+0000 7ff88ca4f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff8801aec70 con 0x55c886deb9f0 2024-08-31T05:36:24.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.856+0000 7ff88ca4f740 10 client.0 _ll_register_callbacks cb 0x7ff87010b420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:36:24.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.856+0000 7ff884a77640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c886e0c390 0x55c8871e28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:24.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.856+0000 7ff884a77640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c886e0c390 0x55c8871e28e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51566/0 (socket says 172.21.15.5:51566) 2024-08-31T05:36:24.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.856+0000 7ff884a77640 1 -- 172.21.15.5:0/2582071998 learned_addr learned my addr 172.21.15.5:0/2582071998 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:24.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.856+0000 7ff877fff640 1 --2- 172.21.15.5:0/2582071998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c886e041b0 0x55c8871e23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:24.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.856+0000 7ff884a77640 1 --2- 172.21.15.5:0/2582071998 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c886deb9f0 0x55c8871e1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:24.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.856+0000 7ff884a77640 1 -- 172.21.15.5:0/2582071998 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c886deb9f0 msgr2=0x55c8871e1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:24.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.856+0000 7ff884a77640 1 --2- 172.21.15.5:0/2582071998 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c886deb9f0 0x55c8871e1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:24.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.856+0000 7ff884a77640 1 -- 172.21.15.5:0/2582071998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c886e041b0 msgr2=0x55c8871e23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:24.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.856+0000 7ff884a77640 1 --2- 172.21.15.5:0/2582071998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c886e041b0 0x55c8871e23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:24.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.856+0000 7ff884a77640 1 -- 172.21.15.5:0/2582071998 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c887259600 con 0x55c886e0c390 2024-08-31T05:36:24.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.856+0000 7ff884a77640 1 --2- 172.21.15.5:0/2582071998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c886e0c390 0x55c8871e28e0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7ff878009270 tx=0x7ff878004710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43a0941db83734fe server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:24.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.856+0000 7ff85f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:36:24.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.856+0000 7ff85f7fe640 1 -- 172.21.15.5:0/2582071998 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff878027cc0 con 0x55c886e0c390 2024-08-31T05:36:24.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.856+0000 7ff88ca4f740 1 -- 172.21.15.5:0/2582071998 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff86800fde0 con 0x55c886e0c390 2024-08-31T05:36:24.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.857+0000 7ff85f7fe640 1 -- 172.21.15.5:0/2582071998 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7ff878027440 con 0x55c886e0c390 2024-08-31T05:36:24.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.857+0000 7ff85f7fe640 1 -- 172.21.15.5:0/2582071998 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ff878027640 con 0x55c886e0c390 2024-08-31T05:36:24.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.857+0000 7ff88ca4f740 10 client.17310 fetch_fsmap learned FSMap version 34 2024-08-31T05:36:24.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.857+0000 7ff88ca4f740 1 -- 172.21.15.5:0/2582071998 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55c88725a880 con 0x55c886e0c390 2024-08-31T05:36:24.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.857+0000 7ff85f7fe640 1 -- 172.21.15.5:0/2582071998 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff86800fde0 con 0x55c886e0c390 2024-08-31T05:36:24.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.857+0000 7ff85f7fe640 1 -- 172.21.15.5:0/2582071998 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7ff878004cc0 con 0x55c886e0c390 2024-08-31T05:36:24.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.857+0000 7ff88ca4f740 10 client.17310 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:36:24.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.857+0000 7ff88ca4f740 10 client.17310 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:36:24.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.857+0000 7ff88ca4f740 20 client.17310 populate_metadata read hostname 'smithi005' 2024-08-31T05:36:24.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.857+0000 7ff88ca4f740 1 --2- 172.21.15.5:0/2582071998 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55c886e2d070 0x55c88725cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:24.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.857+0000 7ff88ca4f740 4 client.17310 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:36:24.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.857+0000 7ff88ca4f740 1 -- 172.21.15.5:0/2582071998 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c887147070 con 0x55c886e2d070 2024-08-31T05:36:24.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.857+0000 7ff877fff640 1 --2- 172.21.15.5:0/2582071998 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55c886e2d070 0x55c88725cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:24.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.858+0000 7ff85f7fe640 10 client.17310 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:36:24.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.858+0000 7ff877fff640 1 --2- 172.21.15.5:0/2582071998 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55c886e2d070 0x55c88725cf00 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d05fab3bb04a57ed server_cookie=63e538cb2c53fa64 in_seq=0 out_seq=0 2024-08-31T05:36:24.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.858+0000 7ff85f7fe640 1 -- 172.21.15.5:0/2582071998 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c887147070 con 0x55c886e2d070 2024-08-31T05:36:24.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.858+0000 7ff85f7fe640 10 client.17310 handle_command_reply: tid=0 2024-08-31T05:36:24.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.858+0000 7ff88ca4f740 1 client.17310 shutdown 2024-08-31T05:36:24.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.858+0000 7ff88ca4f740 1 -- 172.21.15.5:0/2582071998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c886e0c390 msgr2=0x55c8871e28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:24.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.858+0000 7ff88ca4f740 1 --2- 172.21.15.5:0/2582071998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c886e0c390 0x55c8871e28e0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7ff878009270 tx=0x7ff878004710 comp rx=0 tx=0).stop 2024-08-31T05:36:24.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.858+0000 7ff88ca4f740 1 -- 172.21.15.5:0/2582071998 shutdown_connections 2024-08-31T05:36:24.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.858+0000 7ff88ca4f740 1 --2- 172.21.15.5:0/2582071998 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55c886e2d070 0x55c88725cf00 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:24.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.858+0000 7ff88ca4f740 1 --2- 172.21.15.5:0/2582071998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c886e0c390 0x55c8871e28e0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:24.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.858+0000 7ff88ca4f740 1 --2- 172.21.15.5:0/2582071998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c886e041b0 0x55c8871e23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:24.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.858+0000 7ff88ca4f740 1 --2- 172.21.15.5:0/2582071998 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c886deb9f0 0x55c8871e1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:24.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.858+0000 7ff88ca4f740 1 -- 172.21.15.5:0/2582071998 >> 172.21.15.5:0/2582071998 conn(0x55c886e21460 msgr2=0x55c8871cfb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:24.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.858+0000 7ff85f7fe640 0 client.17310 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:36:24.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.858+0000 7ff88ca4f740 1 -- 172.21.15.5:0/2582071998 shutdown_connections 2024-08-31T05:36:24.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.858+0000 7ff88ca4f740 1 -- 172.21.15.5:0/2582071998 wait complete. 2024-08-31T05:36:24.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.859+0000 7ff88ca4f740 20 client.17310 trim_cache size 0 max 16384 2024-08-31T05:36:24.869 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:36:24.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.859+0000 7ff8864da640 1 -- 172.21.15.5:0/2879331902 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff86c0b4d20 msgr2=0x7ff86c0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:24.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.859+0000 7ff8864da640 1 --2- 172.21.15.5:0/2879331902 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff86c0b4d20 0x7ff86c0b7230 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff870102ce0 tx=0x7ff87010b550 comp rx=0 tx=0).stop 2024-08-31T05:36:24.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.859+0000 7ff8864da640 1 -- 172.21.15.5:0/2879331902 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff880103960 msgr2=0x7ff88019a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:24.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.859+0000 7ff8864da640 1 --2- 172.21.15.5:0/2879331902 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff880103960 0x7ff88019a270 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7ff870005940 tx=0x7ff8700040c0 comp rx=0 tx=0).stop 2024-08-31T05:36:24.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.859+0000 7ff8864da640 1 -- 172.21.15.5:0/2879331902 shutdown_connections 2024-08-31T05:36:24.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.859+0000 7ff8864da640 1 --2- 172.21.15.5:0/2879331902 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff86c0b4d20 0x7ff86c0b7230 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:24.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.859+0000 7ff8864da640 1 --2- 172.21.15.5:0/2879331902 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff880109ba0 0x7ff88019fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:24.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.859+0000 7ff8864da640 1 --2- 172.21.15.5:0/2879331902 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff880109250 0x7ff88019a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:24.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.859+0000 7ff8864da640 1 --2- 172.21.15.5:0/2879331902 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff880103960 0x7ff88019a270 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:24.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.859+0000 7ff8864da640 1 -- 172.21.15.5:0/2879331902 >> 172.21.15.5:0/2879331902 conn(0x7ff88007b6b0 msgr2=0x7ff880107300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:24.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.859+0000 7ff8864da640 1 -- 172.21.15.5:0/2879331902 shutdown_connections 2024-08-31T05:36:24.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:24.859+0000 7ff8864da640 1 -- 172.21.15.5:0/2879331902 wait complete. 2024-08-31T05:36:24.921 INFO:tasks.workunit.client.0.smithi005.stdout: 1 717698 11.73 MB/sec execute 192 sec latency 40.429 ms 2024-08-31T05:36:25.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:25 smithi005 ceph-mon[18602]: pgmap v538: 129 pgs: 129 active+clean; 403 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 218 op/s 2024-08-31T05:36:25.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:25 smithi070 ceph-mon[22316]: pgmap v538: 129 pgs: 129 active+clean; 403 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 218 op/s 2024-08-31T05:36:25.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:25 smithi050 ceph-mon[22146]: pgmap v538: 129 pgs: 129 active+clean; 403 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 218 op/s 2024-08-31T05:36:25.922 INFO:tasks.workunit.client.0.smithi005.stdout: 1 719707 11.71 MB/sec execute 193 sec latency 16.732 ms 2024-08-31T05:36:26.612 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T05:36:26.613 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T05:36:26.922 INFO:tasks.workunit.client.0.smithi005.stdout: 1 721313 11.71 MB/sec execute 194 sec latency 44.042 ms 2024-08-31T05:36:26.963 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:36:27.380 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:27 smithi005 ceph-mon[18602]: pgmap v539: 129 pgs: 129 active+clean; 408 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.5 MiB/s wr, 279 op/s 2024-08-31T05:36:27.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.476+0000 7f9c87f85640 1 -- 172.21.15.5:0/1388894516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c80108ab0 msgr2=0x7f9c8010f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:27.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.476+0000 7f9c87f85640 1 --2- 172.21.15.5:0/1388894516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c80108ab0 0x7f9c8010f2e0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f9c78009ca0 tx=0x7f9c7802a8c0 comp rx=0 tx=0).stop 2024-08-31T05:36:27.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.476+0000 7f9c87f85640 1 -- 172.21.15.5:0/1388894516 shutdown_connections 2024-08-31T05:36:27.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.476+0000 7f9c87f85640 1 --2- 172.21.15.5:0/1388894516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c80108ab0 0x7f9c8010f2e0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:27.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.476+0000 7f9c87f85640 1 --2- 172.21.15.5:0/1388894516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9c80108160 0x7f9c80108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:27.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.476+0000 7f9c87f85640 1 --2- 172.21.15.5:0/1388894516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c80102820 0x7f9c80102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:27.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.476+0000 7f9c87f85640 1 -- 172.21.15.5:0/1388894516 >> 172.21.15.5:0/1388894516 conn(0x7f9c800794e0 msgr2=0x7f9c800798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:27.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.476+0000 7f9c87f85640 1 -- 172.21.15.5:0/1388894516 shutdown_connections 2024-08-31T05:36:27.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.477+0000 7f9c87f85640 1 -- 172.21.15.5:0/1388894516 wait complete. 2024-08-31T05:36:27.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.477+0000 7f9c87f85640 1 Processor -- start 2024-08-31T05:36:27.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.477+0000 7f9c87f85640 1 -- start start 2024-08-31T05:36:27.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.477+0000 7f9c87f85640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c80102820 0x7f9c80104ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:27.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.477+0000 7f9c87f85640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c80108160 0x7f9c801053e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:27.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.477+0000 7f9c87f85640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9c80108ab0 0x7f9c80105920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:27.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.478+0000 7f9c87f85640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9c80112730 con 0x7f9c80108160 2024-08-31T05:36:27.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.478+0000 7f9c87f85640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9c801125b0 con 0x7f9c80102820 2024-08-31T05:36:27.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.478+0000 7f9c87f85640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9c801128b0 con 0x7f9c80108ab0 2024-08-31T05:36:27.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.478+0000 7f9c85520640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c80108160 0x7f9c801053e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:27.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.478+0000 7f9c85520640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c80108160 0x7f9c801053e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51586/0 (socket says 172.21.15.5:51586) 2024-08-31T05:36:27.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.478+0000 7f9c85d21640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c80102820 0x7f9c80104ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:27.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.478+0000 7f9c85520640 1 -- 172.21.15.5:0/1076940316 learned_addr learned my addr 172.21.15.5:0/1076940316 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:27.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.478+0000 7f9c86522640 1 --2- 172.21.15.5:0/1076940316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9c80108ab0 0x7f9c80105920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:27.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.478+0000 7f9c85520640 1 -- 172.21.15.5:0/1076940316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9c80108ab0 msgr2=0x7f9c80105920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:27.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.478+0000 7f9c85520640 1 --2- 172.21.15.5:0/1076940316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9c80108ab0 0x7f9c80105920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:27.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.478+0000 7f9c85520640 1 -- 172.21.15.5:0/1076940316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c80102820 msgr2=0x7f9c80104ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:27.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.478+0000 7f9c85520640 1 --2- 172.21.15.5:0/1076940316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c80102820 0x7f9c80104ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:27.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.478+0000 7f9c85520640 1 -- 172.21.15.5:0/1076940316 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c801a8460 con 0x7f9c80108160 2024-08-31T05:36:27.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.478+0000 7f9c85d21640 1 --2- 172.21.15.5:0/1076940316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c80102820 0x7f9c80104ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:36:27.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.478+0000 7f9c85520640 1 --2- 172.21.15.5:0/1076940316 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c80108160 0x7f9c801053e0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f9c7000e9f0 tx=0x7f9c7000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:27.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.478+0000 7f9c76ffd640 1 -- 172.21.15.5:0/1076940316 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7000ccc0 con 0x7f9c80108160 2024-08-31T05:36:27.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.478+0000 7f9c87f85640 1 -- 172.21.15.5:0/1076940316 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c801a8750 con 0x7f9c80108160 2024-08-31T05:36:27.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.478+0000 7f9c76ffd640 1 -- 172.21.15.5:0/1076940316 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c700054d0 con 0x7f9c80108160 2024-08-31T05:36:27.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.479+0000 7f9c76ffd640 1 -- 172.21.15.5:0/1076940316 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c70010430 con 0x7f9c80108160 2024-08-31T05:36:27.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.479+0000 7f9c87f85640 1 -- 172.21.15.5:0/1076940316 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c801a8c90 con 0x7f9c80108160 2024-08-31T05:36:27.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.481+0000 7f9c8e4fa740 1 Processor -- start 2024-08-31T05:36:27.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.481+0000 7f9c8e4fa740 1 -- start start 2024-08-31T05:36:27.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.482+0000 7f9c76ffd640 1 -- 172.21.15.5:0/1076940316 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f9c700046c0 con 0x7f9c80108160 2024-08-31T05:36:27.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.482+0000 7f9c8e4fa740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a906142350 0x55a9064e8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:27.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.482+0000 7f9c8e4fa740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a906119490 0x55a9064e8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:27.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.482+0000 7f9c8e4fa740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a906121670 0x55a9064e9200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:27.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.482+0000 7f9c8e4fa740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55a90645e5f0 con 0x55a906121670 2024-08-31T05:36:27.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.482+0000 7f9c8e4fa740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a90644db80 con 0x55a906142350 2024-08-31T05:36:27.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.482+0000 7f9c8e4fa740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a906451b30 con 0x55a906119490 2024-08-31T05:36:27.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.482+0000 7f9c86522640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a906142350 0x55a9064e8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:27.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.482+0000 7f9c85d21640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a906119490 0x55a9064e8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:27.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.482+0000 7f9c85520640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a906121670 0x55a9064e9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:27.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.482+0000 7f9c86522640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a906142350 0x55a9064e8780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:55510/0 (socket says 172.21.15.5:55510) 2024-08-31T05:36:27.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.482+0000 7f9c85d21640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a906119490 0x55a9064e8cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:55728/0 (socket says 172.21.15.5:55728) 2024-08-31T05:36:27.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.482+0000 7f9c86522640 1 -- 172.21.15.5:0/3852215152 learned_addr learned my addr 172.21.15.5:0/3852215152 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:27.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.482+0000 7f9c85d21640 1 -- 172.21.15.5:0/3852215152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a906142350 msgr2=0x55a9064e8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:27.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.482+0000 7f9c85d21640 1 --2- 172.21.15.5:0/3852215152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a906142350 0x55a9064e8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:27.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.482+0000 7f9c85d21640 1 -- 172.21.15.5:0/3852215152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a906121670 msgr2=0x55a9064e9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:27.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.482+0000 7f9c85d21640 1 --2- 172.21.15.5:0/3852215152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a906121670 0x55a9064e9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:27.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.482+0000 7f9c85d21640 1 -- 172.21.15.5:0/3852215152 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9061ad930 con 0x55a906119490 2024-08-31T05:36:27.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.482+0000 7f9c85d21640 1 --2- 172.21.15.5:0/3852215152 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a906119490 0x55a9064e8cc0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c009fa0 tx=0x7f9c7c0118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=133a7040f6560b2a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:27.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.483+0000 7f9c76ffd640 1 --2- 172.21.15.5:0/1076940316 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9c6c0b4ca0 0x7f9c6c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:27.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.483+0000 7f9c6bfff640 1 -- 172.21.15.5:0/3852215152 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c004030 con 0x55a906119490 2024-08-31T05:36:27.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.483+0000 7f9c86522640 1 --2- 172.21.15.5:0/1076940316 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9c6c0b4ca0 0x7f9c6c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:27.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.483+0000 7f9c76ffd640 1 -- 172.21.15.5:0/1076940316 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f9c700e5c00 con 0x7f9c80108160 2024-08-31T05:36:27.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.483+0000 7f9c6bfff640 1 -- 172.21.15.5:0/3852215152 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c7c0054d0 con 0x55a906119490 2024-08-31T05:36:27.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.483+0000 7f9c6bfff640 1 -- 172.21.15.5:0/3852215152 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c004be0 con 0x55a906119490 2024-08-31T05:36:27.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.484+0000 7f9c8e4fa740 1 -- 172.21.15.5:0/3852215152 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a906119490 msgr2=0x55a9064e8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:27.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.484+0000 7f9c86522640 1 --2- 172.21.15.5:0/1076940316 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9c6c0b4ca0 0x7f9c6c0b71b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9c7802f500 tx=0x7f9c7802f310 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:27.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.484+0000 7f9c8e4fa740 1 --2- 172.21.15.5:0/3852215152 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a906119490 0x55a9064e8cc0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c009fa0 tx=0x7f9c7c0118d0 comp rx=0 tx=0).stop 2024-08-31T05:36:27.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.484+0000 7f9c8e4fa740 1 -- 172.21.15.5:0/3852215152 shutdown_connections 2024-08-31T05:36:27.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.484+0000 7f9c8e4fa740 1 --2- 172.21.15.5:0/3852215152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a906121670 0x55a9064e9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:27.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.484+0000 7f9c8e4fa740 1 --2- 172.21.15.5:0/3852215152 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a906119490 0x55a9064e8cc0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:27.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.484+0000 7f9c8e4fa740 1 --2- 172.21.15.5:0/3852215152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a906142350 0x55a9064e8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:27.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.484+0000 7f9c8e4fa740 1 -- 172.21.15.5:0/3852215152 >> 172.21.15.5:0/3852215152 conn(0x55a906136740 msgr2=0x55a9064e6670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:27.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.484+0000 7f9c8e4fa740 1 -- 172.21.15.5:0/3852215152 shutdown_connections 2024-08-31T05:36:27.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.484+0000 7f9c8e4fa740 1 -- 172.21.15.5:0/3852215152 wait complete. 2024-08-31T05:36:27.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.484+0000 7f9c8e4fa740 1 -- start start 2024-08-31T05:36:27.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.484+0000 7f9c8e4fa740 1 Processor -- start 2024-08-31T05:36:27.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.485+0000 7f9c8e4fa740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a906119490 0x55a9064f3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:27.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.485+0000 7f9c8e4fa740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a906121670 0x55a9064f4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:27.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.485+0000 7f9c8e4fa740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a906142350 0x55a906500250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:27.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.485+0000 7f9c8e4fa740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55a9062b0890 con 0x55a906121670 2024-08-31T05:36:27.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.485+0000 7f9c8e4fa740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a9063d4790 con 0x55a906142350 2024-08-31T05:36:27.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.485+0000 7f9c8e4fa740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a9064f6f60 con 0x55a906119490 2024-08-31T05:36:27.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.485+0000 7f9c8e4fa740 10 client.0 _ll_register_callbacks cb 0x55a906159ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:36:27.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.485+0000 7f9c85520640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a906121670 0x55a9064f4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:27.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.485+0000 7f9c85d21640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a906119490 0x55a9064f3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:27.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.485+0000 7f9c85520640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a906121670 0x55a9064f4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51610/0 (socket says 172.21.15.5:51610) 2024-08-31T05:36:27.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.485+0000 7f9c85520640 1 -- 172.21.15.5:0/4002360 learned_addr learned my addr 172.21.15.5:0/4002360 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:27.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.485+0000 7f9c86522640 1 --2- 172.21.15.5:0/4002360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a906142350 0x55a906500250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:27.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.485+0000 7f9c85d21640 1 -- 172.21.15.5:0/4002360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a906142350 msgr2=0x55a906500250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:27.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.485+0000 7f9c85d21640 1 --2- 172.21.15.5:0/4002360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a906142350 0x55a906500250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:27.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.485+0000 7f9c85d21640 1 -- 172.21.15.5:0/4002360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a906121670 msgr2=0x55a9064f4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:27.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.485+0000 7f9c85d21640 1 --2- 172.21.15.5:0/4002360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a906121670 0x55a9064f4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:27.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.485+0000 7f9c85d21640 1 -- 172.21.15.5:0/4002360 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a90640bf30 con 0x55a906119490 2024-08-31T05:36:27.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.486+0000 7f9c85d21640 1 --2- 172.21.15.5:0/4002360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a906119490 0x55a9064f3ed0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c01b040 tx=0x7f9c7c00fc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a92d9f153fbfe68 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:27.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.486+0000 7f9c697fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:36:27.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.486+0000 7f9c697fa640 1 -- 172.21.15.5:0/4002360 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c028020 con 0x55a906119490 2024-08-31T05:36:27.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.486+0000 7f9c697fa640 1 -- 172.21.15.5:0/4002360 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f9c7c023470 con 0x55a906119490 2024-08-31T05:36:27.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.486+0000 7f9c8e4fa740 1 -- 172.21.15.5:0/4002360 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c7c0054d0 con 0x55a906119490 2024-08-31T05:36:27.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.486+0000 7f9c697fa640 1 -- 172.21.15.5:0/4002360 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f9c7c033050 con 0x55a906119490 2024-08-31T05:36:27.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.486+0000 7f9c8e4fa740 10 client.26917 fetch_fsmap learned FSMap version 34 2024-08-31T05:36:27.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.486+0000 7f9c8e4fa740 1 -- 172.21.15.5:0/4002360 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a906502d10 con 0x55a906119490 2024-08-31T05:36:27.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.486+0000 7f9c697fa640 1 -- 172.21.15.5:0/4002360 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c7c0054d0 con 0x55a906119490 2024-08-31T05:36:27.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.487+0000 7f9c697fa640 1 -- 172.21.15.5:0/4002360 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f9c7c004920 con 0x55a906119490 2024-08-31T05:36:27.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.487+0000 7f9c8e4fa740 10 client.26917 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:36:27.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.487+0000 7f9c8e4fa740 10 client.26917 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:36:27.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.487+0000 7f9c8e4fa740 20 client.26917 populate_metadata read hostname 'smithi005' 2024-08-31T05:36:27.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.487+0000 7f9c8e4fa740 1 --2- 172.21.15.5:0/4002360 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a906100cd0 0x55a906506180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:27.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.487+0000 7f9c8e4fa740 4 client.26917 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:36:27.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.487+0000 7f9c8e4fa740 1 -- 172.21.15.5:0/4002360 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a906460540 con 0x55a906100cd0 2024-08-31T05:36:27.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.487+0000 7f9c85520640 1 --2- 172.21.15.5:0/4002360 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a906100cd0 0x55a906506180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:27.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.487+0000 7f9c85520640 1 --2- 172.21.15.5:0/4002360 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a906100cd0 0x55a906506180 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d550bed5fb257ab server_cookie=a5d8fb63795f4c92 in_seq=0 out_seq=0 2024-08-31T05:36:27.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.487+0000 7f9c697fa640 10 client.26917 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:36:27.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.488+0000 7f9c697fa640 1 -- 172.21.15.5:0/4002360 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a906460540 con 0x55a906100cd0 2024-08-31T05:36:27.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.488+0000 7f9c697fa640 10 client.26917 handle_command_reply: tid=0 2024-08-31T05:36:27.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.488+0000 7f9c8e4fa740 1 client.26917 shutdown 2024-08-31T05:36:27.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.488+0000 7f9c8e4fa740 1 -- 172.21.15.5:0/4002360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a906119490 msgr2=0x55a9064f3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:27.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.488+0000 7f9c8e4fa740 1 --2- 172.21.15.5:0/4002360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a906119490 0x55a9064f3ed0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c01b040 tx=0x7f9c7c00fc80 comp rx=0 tx=0).stop 2024-08-31T05:36:27.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.489+0000 7f9c8e4fa740 1 -- 172.21.15.5:0/4002360 shutdown_connections 2024-08-31T05:36:27.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.489+0000 7f9c8e4fa740 1 --2- 172.21.15.5:0/4002360 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a906100cd0 0x55a906506180 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:27.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.489+0000 7f9c8e4fa740 1 --2- 172.21.15.5:0/4002360 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a906142350 0x55a906500250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:27.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.489+0000 7f9c8e4fa740 1 --2- 172.21.15.5:0/4002360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a906121670 0x55a9064f4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:27.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.489+0000 7f9c8e4fa740 1 --2- 172.21.15.5:0/4002360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a906119490 0x55a9064f3ed0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:27.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.489+0000 7f9c697fa640 0 client.26917 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:36:27.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.489+0000 7f9c8e4fa740 1 -- 172.21.15.5:0/4002360 >> 172.21.15.5:0/4002360 conn(0x55a906136740 msgr2=0x55a9064eb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:27.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.489+0000 7f9c8e4fa740 1 -- 172.21.15.5:0/4002360 shutdown_connections 2024-08-31T05:36:27.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.489+0000 7f9c8e4fa740 1 -- 172.21.15.5:0/4002360 wait complete. 2024-08-31T05:36:27.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.489+0000 7f9c8e4fa740 20 client.26917 trim_cache size 0 max 16384 2024-08-31T05:36:27.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.507+0000 7f9c8e4fa740 1 Processor -- start 2024-08-31T05:36:27.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.507+0000 7f9c8e4fa740 1 -- start start 2024-08-31T05:36:27.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.507+0000 7f9c8e4fa740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a906119490 0x55a9064ef6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:27.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.507+0000 7f9c8e4fa740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a906121670 0x55a9064ea170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:27.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.507+0000 7f9c8e4fa740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a906142350 0x55a906500150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:27.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.507+0000 7f9c8e4fa740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9c801b2da0 con 0x55a906121670 2024-08-31T05:36:27.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.507+0000 7f9c8e4fa740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9c801b48e0 con 0x55a906119490 2024-08-31T05:36:27.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.507+0000 7f9c8e4fa740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9c801b3470 con 0x55a906142350 2024-08-31T05:36:27.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.507+0000 7f9c85520640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a906121670 0x55a9064ea170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:27.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.507+0000 7f9c85d21640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a906119490 0x55a9064ef6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:27.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.507+0000 7f9c85520640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a906121670 0x55a9064ea170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51616/0 (socket says 172.21.15.5:51616) 2024-08-31T05:36:27.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.507+0000 7f9c85520640 1 -- 172.21.15.5:0/1587664524 learned_addr learned my addr 172.21.15.5:0/1587664524 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:27.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.507+0000 7f9c86522640 1 --2- 172.21.15.5:0/1587664524 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a906142350 0x55a906500150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:27.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.508+0000 7f9c85d21640 1 -- 172.21.15.5:0/1587664524 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a906142350 msgr2=0x55a906500150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:27.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.508+0000 7f9c85d21640 1 --2- 172.21.15.5:0/1587664524 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a906142350 0x55a906500150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:27.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.508+0000 7f9c85d21640 1 -- 172.21.15.5:0/1587664524 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a906121670 msgr2=0x55a9064ea170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:27.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.508+0000 7f9c85d21640 1 --2- 172.21.15.5:0/1587664524 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a906121670 0x55a9064ea170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:27.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.508+0000 7f9c85d21640 1 -- 172.21.15.5:0/1587664524 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9064f2e30 con 0x55a906119490 2024-08-31T05:36:27.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.508+0000 7f9c86522640 1 --2- 172.21.15.5:0/1587664524 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a906142350 0x55a906500150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:36:27.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.508+0000 7f9c85d21640 1 --2- 172.21.15.5:0/1587664524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a906119490 0x55a9064ef6b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c009730 tx=0x7f9c7c00fbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59eb5028e80b89af server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:27.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.508+0000 7f9c6b7fe640 1 -- 172.21.15.5:0/1587664524 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c028070 con 0x55a906119490 2024-08-31T05:36:27.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.508+0000 7f9c6b7fe640 1 -- 172.21.15.5:0/1587664524 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c7c0044e0 con 0x55a906119490 2024-08-31T05:36:27.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.508+0000 7f9c6b7fe640 1 -- 172.21.15.5:0/1587664524 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c01d040 con 0x55a906119490 2024-08-31T05:36:27.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.509+0000 7f9c8e4fa740 1 -- 172.21.15.5:0/1587664524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a906119490 msgr2=0x55a9064ef6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:27.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.509+0000 7f9c8e4fa740 1 --2- 172.21.15.5:0/1587664524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a906119490 0x55a9064ef6b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c009730 tx=0x7f9c7c00fbe0 comp rx=0 tx=0).stop 2024-08-31T05:36:27.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.509+0000 7f9c8e4fa740 1 -- 172.21.15.5:0/1587664524 shutdown_connections 2024-08-31T05:36:27.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.509+0000 7f9c8e4fa740 1 --2- 172.21.15.5:0/1587664524 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a906142350 0x55a906500150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:27.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.509+0000 7f9c8e4fa740 1 --2- 172.21.15.5:0/1587664524 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a906121670 0x55a9064ea170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:27.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.509+0000 7f9c8e4fa740 1 --2- 172.21.15.5:0/1587664524 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a906119490 0x55a9064ef6b0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:27.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.509+0000 7f9c8e4fa740 1 -- 172.21.15.5:0/1587664524 >> 172.21.15.5:0/1587664524 conn(0x55a906136740 msgr2=0x55a9064ed890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:27.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.509+0000 7f9c8e4fa740 1 -- 172.21.15.5:0/1587664524 shutdown_connections 2024-08-31T05:36:27.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.509+0000 7f9c8e4fa740 1 -- 172.21.15.5:0/1587664524 wait complete. 2024-08-31T05:36:27.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.510+0000 7f9c8e4fa740 1 -- start start 2024-08-31T05:36:27.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.510+0000 7f9c8e4fa740 1 Processor -- start 2024-08-31T05:36:27.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.510+0000 7f9c8e4fa740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a906119490 0x55a9064f84a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:27.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.510+0000 7f9c8e4fa740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a906121670 0x55a9064f89e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:27.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.510+0000 7f9c8e4fa740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a906142350 0x55a90656f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:27.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.510+0000 7f9c8e4fa740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9c801b4210 con 0x55a906142350 2024-08-31T05:36:27.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.510+0000 7f9c8e4fa740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9c801b3b40 con 0x55a906119490 2024-08-31T05:36:27.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.510+0000 7f9c8e4fa740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9c801b0d80 con 0x55a906121670 2024-08-31T05:36:27.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.510+0000 7f9c8e4fa740 10 client.0 _ll_register_callbacks cb 0x7f9c700e9620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:36:27.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.510+0000 7f9c86522640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a906142350 0x55a90656f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:27.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.510+0000 7f9c86522640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a906142350 0x55a90656f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51624/0 (socket says 172.21.15.5:51624) 2024-08-31T05:36:27.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.510+0000 7f9c85520640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a906121670 0x55a9064f89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:27.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.510+0000 7f9c86522640 1 -- 172.21.15.5:0/846529826 learned_addr learned my addr 172.21.15.5:0/846529826 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:27.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.510+0000 7f9c85d21640 1 --2- 172.21.15.5:0/846529826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a906119490 0x55a9064f84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:27.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.511+0000 7f9c86522640 1 -- 172.21.15.5:0/846529826 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a906121670 msgr2=0x55a9064f89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:27.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.511+0000 7f9c86522640 1 --2- 172.21.15.5:0/846529826 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a906121670 0x55a9064f89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:27.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.511+0000 7f9c86522640 1 -- 172.21.15.5:0/846529826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a906119490 msgr2=0x55a9064f84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:27.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.511+0000 7f9c86522640 1 --2- 172.21.15.5:0/846529826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a906119490 0x55a9064f84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:27.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.511+0000 7f9c86522640 1 -- 172.21.15.5:0/846529826 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9064f9280 con 0x55a906142350 2024-08-31T05:36:27.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.511+0000 7f9c85d21640 1 --2- 172.21.15.5:0/846529826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a906119490 0x55a9064f84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:36:27.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.511+0000 7f9c86522640 1 --2- 172.21.15.5:0/846529826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a906142350 0x55a90656f9e0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f9c780316e0 tx=0x7f9c780095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a892113f7917ab6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:27.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.511+0000 7f9c697fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:36:27.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.511+0000 7f9c697fa640 1 -- 172.21.15.5:0/846529826 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c78057060 con 0x55a906142350 2024-08-31T05:36:27.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.511+0000 7f9c8e4fa740 1 -- 172.21.15.5:0/846529826 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c7c0044e0 con 0x55a906142350 2024-08-31T05:36:27.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.511+0000 7f9c697fa640 1 -- 172.21.15.5:0/846529826 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f9c78004040 con 0x55a906142350 2024-08-31T05:36:27.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.511+0000 7f9c697fa640 1 -- 172.21.15.5:0/846529826 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f9c7805e050 con 0x55a906142350 2024-08-31T05:36:27.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.511+0000 7f9c8e4fa740 10 client.17328 fetch_fsmap learned FSMap version 34 2024-08-31T05:36:27.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.511+0000 7f9c8e4fa740 1 -- 172.21.15.5:0/846529826 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a906571000 con 0x55a906142350 2024-08-31T05:36:27.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.512+0000 7f9c697fa640 1 -- 172.21.15.5:0/846529826 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c7c0044e0 con 0x55a906142350 2024-08-31T05:36:27.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.512+0000 7f9c697fa640 1 -- 172.21.15.5:0/846529826 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f9c7802fb20 con 0x55a906142350 2024-08-31T05:36:27.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.512+0000 7f9c8e4fa740 10 client.17328 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:36:27.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.512+0000 7f9c8e4fa740 10 client.17328 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:36:27.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.512+0000 7f9c8e4fa740 20 client.17328 populate_metadata read hostname 'smithi005' 2024-08-31T05:36:27.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.512+0000 7f9c8e4fa740 1 --2- 172.21.15.5:0/846529826 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a9060d6080 0x55a9065737d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:27.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.512+0000 7f9c8e4fa740 4 client.17328 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T05:36:27.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.512+0000 7f9c8e4fa740 1 -- 172.21.15.5:0/846529826 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a90645bfe0 con 0x55a9060d6080 2024-08-31T05:36:27.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.512+0000 7f9c85d21640 1 --2- 172.21.15.5:0/846529826 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a9060d6080 0x55a9065737d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:27.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.512+0000 7f9c697fa640 10 client.17328 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:36:27.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.512+0000 7f9c85d21640 1 --2- 172.21.15.5:0/846529826 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a9060d6080 0x55a9065737d0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=259fc5faa27f13cd server_cookie=2223dd7538b18923 in_seq=0 out_seq=0 2024-08-31T05:36:27.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.514+0000 7f9c697fa640 1 -- 172.21.15.5:0/846529826 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a90645bfe0 con 0x55a9060d6080 2024-08-31T05:36:27.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.514+0000 7f9c697fa640 10 client.17328 handle_command_reply: tid=0 2024-08-31T05:36:27.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.514+0000 7f9c8e4fa740 1 client.17328 shutdown 2024-08-31T05:36:27.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.514+0000 7f9c8e4fa740 1 -- 172.21.15.5:0/846529826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a906142350 msgr2=0x55a90656f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:27.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.514+0000 7f9c8e4fa740 1 --2- 172.21.15.5:0/846529826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a906142350 0x55a90656f9e0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f9c780316e0 tx=0x7f9c780095c0 comp rx=0 tx=0).stop 2024-08-31T05:36:27.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.514+0000 7f9c8e4fa740 1 -- 172.21.15.5:0/846529826 shutdown_connections 2024-08-31T05:36:27.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.514+0000 7f9c8e4fa740 1 --2- 172.21.15.5:0/846529826 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a9060d6080 0x55a9065737d0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:27.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.514+0000 7f9c8e4fa740 1 --2- 172.21.15.5:0/846529826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a906142350 0x55a90656f9e0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:27.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.514+0000 7f9c8e4fa740 1 --2- 172.21.15.5:0/846529826 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a906121670 0x55a9064f89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:27.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.514+0000 7f9c697fa640 0 client.17328 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:36:27.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.514+0000 7f9c8e4fa740 1 --2- 172.21.15.5:0/846529826 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a906119490 0x55a9064f84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:27.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.514+0000 7f9c8e4fa740 1 -- 172.21.15.5:0/846529826 >> 172.21.15.5:0/846529826 conn(0x55a906136740 msgr2=0x55a9064e9f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:27.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.514+0000 7f9c8e4fa740 1 -- 172.21.15.5:0/846529826 shutdown_connections 2024-08-31T05:36:27.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.515+0000 7f9c8e4fa740 1 -- 172.21.15.5:0/846529826 wait complete. 2024-08-31T05:36:27.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.515+0000 7f9c8e4fa740 20 client.17328 trim_cache size 0 max 16384 2024-08-31T05:36:27.521 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:36:27.521 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-08-31T05:36:27.521 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "94c23057-592d-4a8b-82d7-da2d84f8740b", 2024-08-31T05:36:27.521 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-08-31T05:36:27.521 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:36:27.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.515+0000 7f9c87f85640 1 -- 172.21.15.5:0/1076940316 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9c6c0b4ca0 msgr2=0x7f9c6c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:27.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.515+0000 7f9c87f85640 1 --2- 172.21.15.5:0/1076940316 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9c6c0b4ca0 0x7f9c6c0b71b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9c7802f500 tx=0x7f9c7802f310 comp rx=0 tx=0).stop 2024-08-31T05:36:27.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.515+0000 7f9c87f85640 1 -- 172.21.15.5:0/1076940316 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c80108160 msgr2=0x7f9c801053e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:27.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.515+0000 7f9c87f85640 1 --2- 172.21.15.5:0/1076940316 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c80108160 0x7f9c801053e0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f9c7000e9f0 tx=0x7f9c7000eeb0 comp rx=0 tx=0).stop 2024-08-31T05:36:27.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.515+0000 7f9c87f85640 1 -- 172.21.15.5:0/1076940316 shutdown_connections 2024-08-31T05:36:27.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.515+0000 7f9c87f85640 1 --2- 172.21.15.5:0/1076940316 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9c6c0b4ca0 0x7f9c6c0b71b0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:27.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.515+0000 7f9c87f85640 1 --2- 172.21.15.5:0/1076940316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9c80108ab0 0x7f9c80105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:27.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.515+0000 7f9c87f85640 1 --2- 172.21.15.5:0/1076940316 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c80108160 0x7f9c801053e0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:27.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.515+0000 7f9c87f85640 1 --2- 172.21.15.5:0/1076940316 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9c80102820 0x7f9c80104ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:27.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.515+0000 7f9c87f85640 1 -- 172.21.15.5:0/1076940316 >> 172.21.15.5:0/1076940316 conn(0x7f9c800794e0 msgr2=0x7f9c8006bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:27.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.515+0000 7f9c87f85640 1 -- 172.21.15.5:0/1076940316 shutdown_connections 2024-08-31T05:36:27.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:27.515+0000 7f9c87f85640 1 -- 172.21.15.5:0/1076940316 wait complete. 2024-08-31T05:36:27.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:27 smithi070 ceph-mon[22316]: pgmap v539: 129 pgs: 129 active+clean; 408 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.5 MiB/s wr, 279 op/s 2024-08-31T05:36:27.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:27 smithi050 ceph-mon[22146]: pgmap v539: 129 pgs: 129 active+clean; 408 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.5 MiB/s wr, 279 op/s 2024-08-31T05:36:27.921 INFO:tasks.workunit.client.0.smithi005.stdout: 1 722751 11.68 MB/sec execute 195 sec latency 102.566 ms 2024-08-31T05:36:28.341 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T05:36:28.364 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:28 smithi005 ceph-mon[18602]: scrub summary: active paths [/] 2024-08-31T05:36:28.364 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:28 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:36:28.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:28 smithi070 ceph-mon[22316]: scrub summary: active paths [/] 2024-08-31T05:36:28.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:28 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:36:28.607 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:36:28.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:28 smithi050 ceph-mon[22146]: scrub summary: active paths [/] 2024-08-31T05:36:28.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:28 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:36:28.924 INFO:tasks.workunit.client.0.smithi005.stdout: 1 724989 11.69 MB/sec execute 196 sec latency 37.530 ms 2024-08-31T05:36:29.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.117+0000 7eff688cd640 1 -- 172.21.15.5:0/23606157 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff64104fc0 msgr2=0x7eff641053d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:29.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.117+0000 7eff688cd640 1 --2- 172.21.15.5:0/23606157 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff64104fc0 0x7eff641053d0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7eff58009900 tx=0x7eff5802a410 comp rx=0 tx=0).stop 2024-08-31T05:36:29.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.117+0000 7eff688cd640 1 -- 172.21.15.5:0/23606157 shutdown_connections 2024-08-31T05:36:29.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.117+0000 7eff688cd640 1 --2- 172.21.15.5:0/23606157 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff64105910 0x7eff6410f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.117+0000 7eff688cd640 1 --2- 172.21.15.5:0/23606157 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff64104fc0 0x7eff641053d0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.117+0000 7eff688cd640 1 --2- 172.21.15.5:0/23606157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff64102fb0 0x7eff641033c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.117+0000 7eff688cd640 1 -- 172.21.15.5:0/23606157 >> 172.21.15.5:0/23606157 conn(0x7eff64079c60 msgr2=0x7eff6407a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:29.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.117+0000 7eff688cd640 1 -- 172.21.15.5:0/23606157 shutdown_connections 2024-08-31T05:36:29.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.117+0000 7eff688cd640 1 -- 172.21.15.5:0/23606157 wait complete. 2024-08-31T05:36:29.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.118+0000 7eff688cd640 1 Processor -- start 2024-08-31T05:36:29.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.118+0000 7eff688cd640 1 -- start start 2024-08-31T05:36:29.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.118+0000 7eff688cd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff64102fb0 0x7eff6419a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:29.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.118+0000 7eff688cd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff64104fc0 0x7eff6419a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:29.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.118+0000 7eff688cd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff64105910 0x7eff6419fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:29.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.118+0000 7eff688cd640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7eff641127b0 con 0x7eff64105910 2024-08-31T05:36:29.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.118+0000 7eff688cd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7eff64112630 con 0x7eff64104fc0 2024-08-31T05:36:29.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.118+0000 7eff688cd640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7eff64112930 con 0x7eff64102fb0 2024-08-31T05:36:29.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.118+0000 7eff62d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff64105910 0x7eff6419fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:29.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.118+0000 7eff6259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff64102fb0 0x7eff6419a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:29.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.118+0000 7eff62d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff64105910 0x7eff6419fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51650/0 (socket says 172.21.15.5:51650) 2024-08-31T05:36:29.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.118+0000 7eff6259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff64102fb0 0x7eff6419a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:55768/0 (socket says 172.21.15.5:55768) 2024-08-31T05:36:29.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.118+0000 7eff62d9d640 1 -- 172.21.15.5:0/665115028 learned_addr learned my addr 172.21.15.5:0/665115028 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:29.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.118+0000 7eff61d9b640 1 --2- 172.21.15.5:0/665115028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff64104fc0 0x7eff6419a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:29.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.119+0000 7eff62d9d640 1 -- 172.21.15.5:0/665115028 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff64102fb0 msgr2=0x7eff6419a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:29.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.119+0000 7eff62d9d640 1 --2- 172.21.15.5:0/665115028 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff64102fb0 0x7eff6419a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.119+0000 7eff62d9d640 1 -- 172.21.15.5:0/665115028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff64104fc0 msgr2=0x7eff6419a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:29.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.119+0000 7eff62d9d640 1 --2- 172.21.15.5:0/665115028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff64104fc0 0x7eff6419a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.119+0000 7eff62d9d640 1 -- 172.21.15.5:0/665115028 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff641a0280 con 0x7eff64105910 2024-08-31T05:36:29.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.119+0000 7eff62d9d640 1 --2- 172.21.15.5:0/665115028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff64105910 0x7eff6419fb50 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7eff5c00eb10 tx=0x7eff5c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:29.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.119+0000 7eff537fe640 1 -- 172.21.15.5:0/665115028 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5c004b20 con 0x7eff64105910 2024-08-31T05:36:29.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.119+0000 7eff537fe640 1 -- 172.21.15.5:0/665115028 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff5c004cc0 con 0x7eff64105910 2024-08-31T05:36:29.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.119+0000 7eff688cd640 1 -- 172.21.15.5:0/665115028 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff641a0570 con 0x7eff64105910 2024-08-31T05:36:29.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.119+0000 7eff537fe640 1 -- 172.21.15.5:0/665115028 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5c010670 con 0x7eff64105910 2024-08-31T05:36:29.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.119+0000 7eff688cd640 1 -- 172.21.15.5:0/665115028 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff641a6cd0 con 0x7eff64105910 2024-08-31T05:36:29.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.122+0000 7eff6ee42740 1 Processor -- start 2024-08-31T05:36:29.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.123+0000 7eff537fe640 1 -- 172.21.15.5:0/665115028 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7eff5c005020 con 0x7eff64105910 2024-08-31T05:36:29.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.123+0000 7eff6ee42740 1 -- start start 2024-08-31T05:36:29.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.123+0000 7eff6ee42740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561664010070 0x5616643b5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:29.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.123+0000 7eff6ee42740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561663fe71b0 0x5616643b5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:29.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.123+0000 7eff6ee42740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561663fef390 0x5616643b5d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:29.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.123+0000 7eff6ee42740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56166432c630 con 0x561664010070 2024-08-31T05:36:29.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.123+0000 7eff6ee42740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56166431bbc0 con 0x561663fef390 2024-08-31T05:36:29.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.123+0000 7eff6ee42740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56166431fb70 con 0x561663fe71b0 2024-08-31T05:36:29.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.124+0000 7eff6259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561663fe71b0 0x5616643b5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:29.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.124+0000 7eff6259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561663fe71b0 0x5616643b5840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:55776/0 (socket says 172.21.15.5:55776) 2024-08-31T05:36:29.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.124+0000 7eff61d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561664010070 0x5616643b5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:29.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.124+0000 7eff6259c640 1 -- 172.21.15.5:0/682360987 learned_addr learned my addr 172.21.15.5:0/682360987 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:29.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.124+0000 7eff61d9b640 1 --2- 172.21.15.5:0/682360987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561663fef390 0x5616643b5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:29.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.124+0000 7eff6259c640 1 -- 172.21.15.5:0/682360987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561663fef390 msgr2=0x5616643b5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:29.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.124+0000 7eff6259c640 1 --2- 172.21.15.5:0/682360987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561663fef390 0x5616643b5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.124+0000 7eff6259c640 1 -- 172.21.15.5:0/682360987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561664010070 msgr2=0x5616643b5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:29.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.124+0000 7eff6259c640 1 --2- 172.21.15.5:0/682360987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561664010070 0x5616643b5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.124+0000 7eff537fe640 1 --2- 172.21.15.5:0/665115028 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7eff4c0b4ca0 0x7eff4c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:29.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.124+0000 7eff6259c640 1 -- 172.21.15.5:0/682360987 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56166407b650 con 0x561663fe71b0 2024-08-31T05:36:29.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.124+0000 7eff61d9b640 1 --2- 172.21.15.5:0/665115028 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7eff4c0b4ca0 0x7eff4c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:29.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.124+0000 7eff6259c640 1 --2- 172.21.15.5:0/682360987 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561663fe71b0 0x5616643b5840 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7eff5400bd10 tx=0x7eff540107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=234fc9e80962bc95 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:29.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.124+0000 7eff537fe640 1 -- 172.21.15.5:0/665115028 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7eff5c0e5df0 con 0x7eff64105910 2024-08-31T05:36:29.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.124+0000 7eff50ff9640 1 -- 172.21.15.5:0/682360987 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff54004030 con 0x561663fe71b0 2024-08-31T05:36:29.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.124+0000 7eff50ff9640 1 -- 172.21.15.5:0/682360987 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff540035f0 con 0x561663fe71b0 2024-08-31T05:36:29.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.124+0000 7eff50ff9640 1 -- 172.21.15.5:0/682360987 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff54011660 con 0x561663fe71b0 2024-08-31T05:36:29.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.125+0000 7eff6ee42740 1 -- 172.21.15.5:0/682360987 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561663fe71b0 msgr2=0x5616643b5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:29.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.125+0000 7eff61d9b640 1 --2- 172.21.15.5:0/665115028 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7eff4c0b4ca0 0x7eff4c0b71b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7eff58009230 tx=0x7eff58000bc0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:29.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.125+0000 7eff6ee42740 1 --2- 172.21.15.5:0/682360987 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561663fe71b0 0x5616643b5840 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7eff5400bd10 tx=0x7eff540107a0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.125+0000 7eff6ee42740 1 -- 172.21.15.5:0/682360987 shutdown_connections 2024-08-31T05:36:29.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.125+0000 7eff6ee42740 1 --2- 172.21.15.5:0/682360987 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561663fef390 0x5616643b5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.125+0000 7eff6ee42740 1 --2- 172.21.15.5:0/682360987 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561663fe71b0 0x5616643b5840 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.125+0000 7eff6ee42740 1 --2- 172.21.15.5:0/682360987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561664010070 0x5616643b5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.125+0000 7eff6ee42740 1 -- 172.21.15.5:0/682360987 >> 172.21.15.5:0/682360987 conn(0x561664004460 msgr2=0x5616643b31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:29.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.126+0000 7eff6ee42740 1 -- 172.21.15.5:0/682360987 shutdown_connections 2024-08-31T05:36:29.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.126+0000 7eff6ee42740 1 -- 172.21.15.5:0/682360987 wait complete. 2024-08-31T05:36:29.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.126+0000 7eff6ee42740 1 -- start start 2024-08-31T05:36:29.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.126+0000 7eff6ee42740 1 Processor -- start 2024-08-31T05:36:29.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.126+0000 7eff6ee42740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561663fe71b0 0x5616643c0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:29.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.126+0000 7eff6ee42740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561663fef390 0x5616643c0f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:29.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.126+0000 7eff6ee42740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561664010070 0x5616643cce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:29.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.126+0000 7eff6ee42740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56166417e700 con 0x561664010070 2024-08-31T05:36:29.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.126+0000 7eff6ee42740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5616642a2700 con 0x561663fe71b0 2024-08-31T05:36:29.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.126+0000 7eff6ee42740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5616643c3ae0 con 0x561663fef390 2024-08-31T05:36:29.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.127+0000 7eff6ee42740 10 client.0 _ll_register_callbacks cb 0x5616642d1dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:36:29.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.127+0000 7eff61d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561663fef390 0x5616643c0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:29.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.127+0000 7eff62d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561664010070 0x5616643cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:29.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.127+0000 7eff6259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561663fe71b0 0x5616643c0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:29.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.127+0000 7eff6259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561663fe71b0 0x5616643c0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:55568/0 (socket says 172.21.15.5:55568) 2024-08-31T05:36:29.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.127+0000 7eff62d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561664010070 0x5616643cce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51668/0 (socket says 172.21.15.5:51668) 2024-08-31T05:36:29.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.127+0000 7eff6259c640 1 -- 172.21.15.5:0/3607451608 learned_addr learned my addr 172.21.15.5:0/3607451608 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:29.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.127+0000 7eff61d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561663fef390 0x5616643c0f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:55792/0 (socket says 172.21.15.5:55792) 2024-08-31T05:36:29.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.127+0000 7eff62d9d640 1 -- 172.21.15.5:0/3607451608 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561663fef390 msgr2=0x5616643c0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:29.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.127+0000 7eff62d9d640 1 --2- 172.21.15.5:0/3607451608 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561663fef390 0x5616643c0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.127+0000 7eff62d9d640 1 -- 172.21.15.5:0/3607451608 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561663fe71b0 msgr2=0x5616643c0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:29.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.127+0000 7eff62d9d640 1 --2- 172.21.15.5:0/3607451608 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561663fe71b0 0x5616643c0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.127+0000 7eff62d9d640 1 -- 172.21.15.5:0/3607451608 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616642db8b0 con 0x561664010070 2024-08-31T05:36:29.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.127+0000 7eff62d9d640 1 --2- 172.21.15.5:0/3607451608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561664010070 0x5616643cce00 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7eff5c0e31c0 tx=0x7eff5c0ac060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=398e493ef29d278c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:29.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.127+0000 7eff49ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:36:29.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.127+0000 7eff49ffb640 1 -- 172.21.15.5:0/3607451608 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5c0ac860 con 0x561664010070 2024-08-31T05:36:29.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.127+0000 7eff6ee42740 1 -- 172.21.15.5:0/3607451608 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff540035f0 con 0x561664010070 2024-08-31T05:36:29.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.127+0000 7eff49ffb640 1 -- 172.21.15.5:0/3607451608 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7eff5c0ac5d0 con 0x561664010070 2024-08-31T05:36:29.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.127+0000 7eff49ffb640 1 -- 172.21.15.5:0/3607451608 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7eff5c0ac160 con 0x561664010070 2024-08-31T05:36:29.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.127+0000 7eff6ee42740 10 client.17340 fetch_fsmap learned FSMap version 34 2024-08-31T05:36:29.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.128+0000 7eff6ee42740 1 -- 172.21.15.5:0/3607451608 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5616643cf8b0 con 0x561664010070 2024-08-31T05:36:29.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.128+0000 7eff49ffb640 1 -- 172.21.15.5:0/3607451608 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff540035f0 con 0x561664010070 2024-08-31T05:36:29.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.128+0000 7eff49ffb640 1 -- 172.21.15.5:0/3607451608 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7eff5c0a7ad0 con 0x561664010070 2024-08-31T05:36:29.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.128+0000 7eff6ee42740 10 client.17340 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:36:29.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.128+0000 7eff6ee42740 10 client.17340 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:36:29.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.128+0000 7eff6ee42740 20 client.17340 populate_metadata read hostname 'smithi005' 2024-08-31T05:36:29.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.128+0000 7eff6ee42740 1 --2- 172.21.15.5:0/3607451608 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561663fce9f0 0x5616643d2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:29.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.128+0000 7eff6ee42740 4 client.17340 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:36:29.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.128+0000 7eff6ee42740 1 -- 172.21.15.5:0/3607451608 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56166432e580 con 0x561663fce9f0 2024-08-31T05:36:29.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.129+0000 7eff6259c640 1 --2- 172.21.15.5:0/3607451608 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561663fce9f0 0x5616643d2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:29.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.129+0000 7eff6259c640 1 --2- 172.21.15.5:0/3607451608 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561663fce9f0 0x5616643d2e20 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=477780494f31c001 server_cookie=3257e47e07553d5c in_seq=0 out_seq=0 2024-08-31T05:36:29.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.129+0000 7eff49ffb640 10 client.17340 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:36:29.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.130+0000 7eff49ffb640 1 -- 172.21.15.5:0/3607451608 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56166432e580 con 0x561663fce9f0 2024-08-31T05:36:29.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.130+0000 7eff49ffb640 10 client.17340 handle_command_reply: tid=0 2024-08-31T05:36:29.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.130+0000 7eff6ee42740 1 client.17340 shutdown 2024-08-31T05:36:29.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.130+0000 7eff6ee42740 1 -- 172.21.15.5:0/3607451608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561664010070 msgr2=0x5616643cce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:29.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.130+0000 7eff6ee42740 1 --2- 172.21.15.5:0/3607451608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561664010070 0x5616643cce00 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7eff5c0e31c0 tx=0x7eff5c0ac060 comp rx=0 tx=0).stop 2024-08-31T05:36:29.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.130+0000 7eff6ee42740 1 -- 172.21.15.5:0/3607451608 shutdown_connections 2024-08-31T05:36:29.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.130+0000 7eff6ee42740 1 --2- 172.21.15.5:0/3607451608 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561663fce9f0 0x5616643d2e20 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.130+0000 7eff6ee42740 1 --2- 172.21.15.5:0/3607451608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561664010070 0x5616643cce00 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.130+0000 7eff49ffb640 0 client.17340 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:36:29.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.130+0000 7eff6ee42740 1 --2- 172.21.15.5:0/3607451608 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561663fef390 0x5616643c0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.130+0000 7eff6ee42740 1 --2- 172.21.15.5:0/3607451608 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561663fe71b0 0x5616643c0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.130+0000 7eff6ee42740 1 -- 172.21.15.5:0/3607451608 >> 172.21.15.5:0/3607451608 conn(0x561664004460 msgr2=0x5616643b84e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:29.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.130+0000 7eff6ee42740 1 -- 172.21.15.5:0/3607451608 shutdown_connections 2024-08-31T05:36:29.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.130+0000 7eff6ee42740 1 -- 172.21.15.5:0/3607451608 wait complete. 2024-08-31T05:36:29.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.131+0000 7eff6ee42740 20 client.17340 trim_cache size 0 max 16384 2024-08-31T05:36:29.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.149+0000 7eff6ee42740 1 Processor -- start 2024-08-31T05:36:29.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.149+0000 7eff6ee42740 1 -- start start 2024-08-31T05:36:29.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.149+0000 7eff6ee42740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561663fce9f0 0x5616643b8b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:29.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.149+0000 7eff6ee42740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561663fe71b0 0x5616643bdc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:29.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.149+0000 7eff6ee42740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561663fef390 0x5616643be170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:29.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.149+0000 7eff6ee42740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7eff641aea30 con 0x561663fef390 2024-08-31T05:36:29.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.149+0000 7eff6ee42740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7eff641b0570 con 0x561663fce9f0 2024-08-31T05:36:29.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.149+0000 7eff6ee42740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7eff641af100 con 0x561663fe71b0 2024-08-31T05:36:29.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.149+0000 7eff62d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561663fef390 0x5616643be170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:29.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.149+0000 7eff6259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561663fce9f0 0x5616643b8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:29.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.149+0000 7eff62d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561663fef390 0x5616643be170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51684/0 (socket says 172.21.15.5:51684) 2024-08-31T05:36:29.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.150+0000 7eff62d9d640 1 -- 172.21.15.5:0/2741463560 learned_addr learned my addr 172.21.15.5:0/2741463560 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:29.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.150+0000 7eff61d9b640 1 --2- 172.21.15.5:0/2741463560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561663fe71b0 0x5616643bdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:29.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.150+0000 7eff62d9d640 1 -- 172.21.15.5:0/2741463560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561663fe71b0 msgr2=0x5616643bdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:29.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.150+0000 7eff62d9d640 1 --2- 172.21.15.5:0/2741463560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561663fe71b0 0x5616643bdc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.150+0000 7eff62d9d640 1 -- 172.21.15.5:0/2741463560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561663fce9f0 msgr2=0x5616643b8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:29.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.150+0000 7eff62d9d640 1 --2- 172.21.15.5:0/2741463560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561663fce9f0 0x5616643b8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.150+0000 7eff62d9d640 1 -- 172.21.15.5:0/2741463560 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616643b9050 con 0x561663fef390 2024-08-31T05:36:29.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.150+0000 7eff6259c640 1 --2- 172.21.15.5:0/2741463560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561663fce9f0 0x5616643b8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:36:29.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.150+0000 7eff62d9d640 1 --2- 172.21.15.5:0/2741463560 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561663fef390 0x5616643be170 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7eff5c0a81e0 tx=0x7eff5c00efd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65a3ef0ec4b93631 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:29.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.150+0000 7eff4bfff640 1 -- 172.21.15.5:0/2741463560 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5c0ab8d0 con 0x561663fef390 2024-08-31T05:36:29.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.150+0000 7eff4bfff640 1 -- 172.21.15.5:0/2741463560 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff5c0ac860 con 0x561663fef390 2024-08-31T05:36:29.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.150+0000 7eff4bfff640 1 -- 172.21.15.5:0/2741463560 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5c0a7ad0 con 0x561663fef390 2024-08-31T05:36:29.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.151+0000 7eff6ee42740 1 -- 172.21.15.5:0/2741463560 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561663fef390 msgr2=0x5616643be170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:29.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.151+0000 7eff6ee42740 1 --2- 172.21.15.5:0/2741463560 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561663fef390 0x5616643be170 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7eff5c0a81e0 tx=0x7eff5c00efd0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.151+0000 7eff6ee42740 1 -- 172.21.15.5:0/2741463560 shutdown_connections 2024-08-31T05:36:29.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.151+0000 7eff6ee42740 1 --2- 172.21.15.5:0/2741463560 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561663fef390 0x5616643be170 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.151+0000 7eff6ee42740 1 --2- 172.21.15.5:0/2741463560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561663fe71b0 0x5616643bdc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.151+0000 7eff6ee42740 1 --2- 172.21.15.5:0/2741463560 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561663fce9f0 0x5616643b8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.151+0000 7eff6ee42740 1 -- 172.21.15.5:0/2741463560 >> 172.21.15.5:0/2741463560 conn(0x561664004460 msgr2=0x5616643b8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:29.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.151+0000 7eff6ee42740 1 -- 172.21.15.5:0/2741463560 shutdown_connections 2024-08-31T05:36:29.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.151+0000 7eff6ee42740 1 -- 172.21.15.5:0/2741463560 wait complete. 2024-08-31T05:36:29.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.152+0000 7eff6ee42740 1 -- start start 2024-08-31T05:36:29.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.152+0000 7eff6ee42740 1 Processor -- start 2024-08-31T05:36:29.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.152+0000 7eff6ee42740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561663fce9f0 0x5616643c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:29.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.152+0000 7eff6ee42740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561663fe71b0 0x5616643c5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:29.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.152+0000 7eff6ee42740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561663fef390 0x5616643c5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:29.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.152+0000 7eff6ee42740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7eff641afea0 con 0x561663fce9f0 2024-08-31T05:36:29.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.152+0000 7eff6ee42740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7eff641af7d0 con 0x561663fe71b0 2024-08-31T05:36:29.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.152+0000 7eff6ee42740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7eff641aca10 con 0x561663fef390 2024-08-31T05:36:29.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.152+0000 7eff6ee42740 10 client.0 _ll_register_callbacks cb 0x7eff5c0a8090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:36:29.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.152+0000 7eff61d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561663fe71b0 0x5616643c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:29.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.152+0000 7eff61d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561663fe71b0 0x5616643c5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:55574/0 (socket says 172.21.15.5:55574) 2024-08-31T05:36:29.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.153+0000 7eff61d9b640 1 -- 172.21.15.5:0/2733589576 learned_addr learned my addr 172.21.15.5:0/2733589576 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:29.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.153+0000 7eff6259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561663fce9f0 0x5616643c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:29.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.153+0000 7eff62d9d640 1 --2- 172.21.15.5:0/2733589576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561663fef390 0x5616643c5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:29.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.153+0000 7eff61d9b640 1 -- 172.21.15.5:0/2733589576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561663fef390 msgr2=0x5616643c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:29.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.153+0000 7eff61d9b640 1 --2- 172.21.15.5:0/2733589576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561663fef390 0x5616643c5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.153+0000 7eff61d9b640 1 -- 172.21.15.5:0/2733589576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561663fce9f0 msgr2=0x5616643c92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:29.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.153+0000 7eff61d9b640 1 --2- 172.21.15.5:0/2733589576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561663fce9f0 0x5616643c92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.153+0000 7eff61d9b640 1 -- 172.21.15.5:0/2733589576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616643c6210 con 0x561663fe71b0 2024-08-31T05:36:29.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.153+0000 7eff6259c640 1 --2- 172.21.15.5:0/2733589576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561663fce9f0 0x5616643c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:36:29.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.153+0000 7eff61d9b640 1 --2- 172.21.15.5:0/2733589576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561663fe71b0 0x5616643c5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7eff58032fd0 tx=0x7eff5802a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d2bbcbf503cfa9e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:29.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.153+0000 7eff49ffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:36:29.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.153+0000 7eff49ffb640 1 -- 172.21.15.5:0/2733589576 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5805b060 con 0x561663fe71b0 2024-08-31T05:36:29.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.153+0000 7eff49ffb640 1 -- 172.21.15.5:0/2733589576 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7eff58005450 con 0x561663fe71b0 2024-08-31T05:36:29.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.153+0000 7eff6ee42740 1 -- 172.21.15.5:0/2733589576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff5c0ac860 con 0x561663fe71b0 2024-08-31T05:36:29.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.154+0000 7eff49ffb640 1 -- 172.21.15.5:0/2733589576 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7eff58062050 con 0x561663fe71b0 2024-08-31T05:36:29.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.154+0000 7eff6ee42740 10 client.26933 fetch_fsmap learned FSMap version 34 2024-08-31T05:36:29.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.154+0000 7eff6ee42740 1 -- 172.21.15.5:0/2733589576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56166443e4c0 con 0x561663fe71b0 2024-08-31T05:36:29.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.154+0000 7eff49ffb640 1 -- 172.21.15.5:0/2733589576 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff58004c00 con 0x561663fe71b0 2024-08-31T05:36:29.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.154+0000 7eff49ffb640 1 -- 172.21.15.5:0/2733589576 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7eff5804bc10 con 0x561663fe71b0 2024-08-31T05:36:29.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.154+0000 7eff6ee42740 10 client.26933 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:36:29.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.154+0000 7eff6ee42740 10 client.26933 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:36:29.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.154+0000 7eff6ee42740 20 client.26933 populate_metadata read hostname 'smithi005' 2024-08-31T05:36:29.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.154+0000 7eff6ee42740 1 --2- 172.21.15.5:0/2733589576 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561664010070 0x561664440cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:29.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.154+0000 7eff6ee42740 4 client.26933 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T05:36:29.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.154+0000 7eff6ee42740 1 -- 172.21.15.5:0/2733589576 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7eff5c0ac860 con 0x561664010070 2024-08-31T05:36:29.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.155+0000 7eff6259c640 1 --2- 172.21.15.5:0/2733589576 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561664010070 0x561664440cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:29.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.155+0000 7eff49ffb640 10 client.26933 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:36:29.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.155+0000 7eff6259c640 1 --2- 172.21.15.5:0/2733589576 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561664010070 0x561664440cb0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e916a141f513660 server_cookie=16d92ca9bca2403b in_seq=0 out_seq=0 2024-08-31T05:36:29.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.155+0000 7eff49ffb640 1 -- 172.21.15.5:0/2733589576 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2842 (crc 0 0 0) 0x7eff5c0ac860 con 0x561664010070 2024-08-31T05:36:29.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.155+0000 7eff49ffb640 10 client.26933 handle_command_reply: tid=0 2024-08-31T05:36:29.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.155+0000 7eff6ee42740 1 client.26933 shutdown 2024-08-31T05:36:29.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.155+0000 7eff6ee42740 1 -- 172.21.15.5:0/2733589576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561663fe71b0 msgr2=0x5616643c5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:29.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.155+0000 7eff6ee42740 1 --2- 172.21.15.5:0/2733589576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561663fe71b0 0x5616643c5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7eff58032fd0 tx=0x7eff5802a410 comp rx=0 tx=0).stop 2024-08-31T05:36:29.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.155+0000 7eff6ee42740 1 -- 172.21.15.5:0/2733589576 shutdown_connections 2024-08-31T05:36:29.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.155+0000 7eff6ee42740 1 --2- 172.21.15.5:0/2733589576 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561664010070 0x561664440cb0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.155+0000 7eff6ee42740 1 --2- 172.21.15.5:0/2733589576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561663fef390 0x5616643c5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.155+0000 7eff6ee42740 1 --2- 172.21.15.5:0/2733589576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561663fe71b0 0x5616643c5790 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.156+0000 7eff6ee42740 1 --2- 172.21.15.5:0/2733589576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561663fce9f0 0x5616643c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.156+0000 7eff6ee42740 1 -- 172.21.15.5:0/2733589576 >> 172.21.15.5:0/2733589576 conn(0x561664004460 msgr2=0x5616643b62f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:29.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.156+0000 7eff49ffb640 0 client.26933 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:36:29.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.156+0000 7eff6ee42740 1 -- 172.21.15.5:0/2733589576 shutdown_connections 2024-08-31T05:36:29.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.156+0000 7eff6ee42740 1 -- 172.21.15.5:0/2733589576 wait complete. 2024-08-31T05:36:29.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.156+0000 7eff6ee42740 20 client.26933 trim_cache size 0 max 16384 2024-08-31T05:36:29.162 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:36:29.162 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T05:36:29.162 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2024-08-31T05:36:29.162 INFO:teuthology.orchestra.run.smithi005.stdout: "94c23057-592d-4a8b-82d7-da2d84f8740b": { 2024-08-31T05:36:29.163 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:36:29.163 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "94c23057-592d-4a8b-82d7-da2d84f8740b", 2024-08-31T05:36:29.163 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2024-08-31T05:36:29.163 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:36:29.163 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:36:29.163 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_stats": { 2024-08-31T05:36:29.163 INFO:teuthology.orchestra.run.smithi005.stdout: "94c23057-592d-4a8b-82d7-da2d84f8740b": { 2024-08-31T05:36:29.163 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:36:27.513638+0000", 2024-08-31T05:36:29.163 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:36:29.163 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:36:29.163 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:36:29.163 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:36:29.163 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:36:29.164 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:36:29.164 INFO:teuthology.orchestra.run.smithi005.stdout: "095ccc7a-f368-4bc6-9563-5930e21f9b4a": { 2024-08-31T05:36:29.164 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:35:40.190069+0000", 2024-08-31T05:36:29.164 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:36:29.164 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:36:29.164 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:36:29.164 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:36:29.164 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:36:29.164 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:36:29.164 INFO:teuthology.orchestra.run.smithi005.stdout: "de9731c7-ae4a-42fe-8146-e4752cdc40d4": { 2024-08-31T05:36:29.164 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:34:53.614499+0000", 2024-08-31T05:36:29.164 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:36:29.164 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:36:29.164 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:36:29.165 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:36:29.165 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:36:29.165 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:36:29.165 INFO:teuthology.orchestra.run.smithi005.stdout: "0bb67292-013a-40c7-b5fc-810bdd9715d8": { 2024-08-31T05:36:29.165 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:34:04.586008+0000", 2024-08-31T05:36:29.165 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:36:29.165 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:36:29.165 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:36:29.165 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:36:29.165 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:36:29.165 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:36:29.165 INFO:teuthology.orchestra.run.smithi005.stdout: "728a42ca-bbef-4151-830f-5fdd411d8fa0": { 2024-08-31T05:36:29.165 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:32:30.554906+0000", 2024-08-31T05:36:29.165 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:36:29.166 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:36:29.166 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:36:29.166 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:36:29.166 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:36:29.166 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:36:29.166 INFO:teuthology.orchestra.run.smithi005.stdout: "2445fc42-b797-434f-b380-e2da985b4d98": { 2024-08-31T05:36:29.166 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:33:17.681453+0000", 2024-08-31T05:36:29.166 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:36:29.166 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:36:29.166 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:36:29.166 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:36:29.166 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:36:29.166 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:36:29.167 INFO:teuthology.orchestra.run.smithi005.stdout: "cda92ac0-b35f-47a5-a3a5-471c888462a5": { 2024-08-31T05:36:29.167 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:53.103905+0000", 2024-08-31T05:36:29.167 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:36:29.167 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:36:29.167 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:36:29.167 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:36:29.167 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:36:29.167 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:36:29.167 INFO:teuthology.orchestra.run.smithi005.stdout: "ece37b07-9ab2-45f8-bc33-2755a07aac0b": { 2024-08-31T05:36:29.168 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:31:41.782407+0000", 2024-08-31T05:36:29.168 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:36:29.168 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:36:29.168 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:36:29.168 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:36:29.168 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:36:29.168 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:36:29.168 INFO:teuthology.orchestra.run.smithi005.stdout: "75d84398-5d9c-4872-b879-2fbce045fa71": { 2024-08-31T05:36:29.168 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:06.642335+0000", 2024-08-31T05:36:29.168 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:36:29.168 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:36:29.168 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:36:29.168 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:36:29.168 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:36:29.169 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:36:29.169 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:36:29.169 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:36:29.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.156+0000 7eff688cd640 1 -- 172.21.15.5:0/665115028 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7eff4c0b4ca0 msgr2=0x7eff4c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:29.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.156+0000 7eff688cd640 1 --2- 172.21.15.5:0/665115028 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7eff4c0b4ca0 0x7eff4c0b71b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7eff58009230 tx=0x7eff58000bc0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.156+0000 7eff688cd640 1 -- 172.21.15.5:0/665115028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff64105910 msgr2=0x7eff6419fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:29.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.156+0000 7eff688cd640 1 --2- 172.21.15.5:0/665115028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff64105910 0x7eff6419fb50 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7eff5c00eb10 tx=0x7eff5c00c2d0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.157+0000 7eff688cd640 1 -- 172.21.15.5:0/665115028 shutdown_connections 2024-08-31T05:36:29.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.157+0000 7eff688cd640 1 --2- 172.21.15.5:0/665115028 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7eff4c0b4ca0 0x7eff4c0b71b0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.157+0000 7eff688cd640 1 --2- 172.21.15.5:0/665115028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff64105910 0x7eff6419fb50 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.157+0000 7eff688cd640 1 --2- 172.21.15.5:0/665115028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7eff64104fc0 0x7eff6419a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.157+0000 7eff688cd640 1 --2- 172.21.15.5:0/665115028 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff64102fb0 0x7eff6419a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.157+0000 7eff688cd640 1 -- 172.21.15.5:0/665115028 >> 172.21.15.5:0/665115028 conn(0x7eff64079c60 msgr2=0x7eff64101160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:29.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.157+0000 7eff688cd640 1 -- 172.21.15.5:0/665115028 shutdown_connections 2024-08-31T05:36:29.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:36:29.157+0000 7eff688cd640 1 -- 172.21.15.5:0/665115028 wait complete. 2024-08-31T05:36:29.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:29 smithi005 ceph-mon[18602]: scrub queued for path: / 2024-08-31T05:36:29.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:29 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:36:29.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:29 smithi005 ceph-mon[18602]: scrub summary: active paths [/] 2024-08-31T05:36:29.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:29 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:36:29.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:29 smithi005 ceph-mon[18602]: pgmap v540: 129 pgs: 129 active+clean; 405 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.5 MiB/s wr, 203 op/s 2024-08-31T05:36:29.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:29 smithi070 ceph-mon[22316]: scrub queued for path: / 2024-08-31T05:36:29.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:29 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:36:29.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:29 smithi070 ceph-mon[22316]: scrub summary: active paths [/] 2024-08-31T05:36:29.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:29 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:36:29.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:29 smithi070 ceph-mon[22316]: pgmap v540: 129 pgs: 129 active+clean; 405 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.5 MiB/s wr, 203 op/s 2024-08-31T05:36:29.638 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.636+0000 7fb36b5f1640 1 -- 172.21.15.5:0/910060338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3641027a0 msgr2=0x7fb364102bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:29.639 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.636+0000 7fb36b5f1640 1 --2- 172.21.15.5:0/910060338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3641027a0 0x7fb364102bb0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fb35c009ca0 tx=0x7fb35c02a8c0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.640 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.638+0000 7fb36b5f1640 1 -- 172.21.15.5:0/910060338 shutdown_connections 2024-08-31T05:36:29.641 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.638+0000 7fb36b5f1640 1 --2- 172.21.15.5:0/910060338 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb364108a20 0x7fb36410f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.641 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.638+0000 7fb36b5f1640 1 --2- 172.21.15.5:0/910060338 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb3641080d0 0x7fb3641084e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.641 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.638+0000 7fb36b5f1640 1 --2- 172.21.15.5:0/910060338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb3641027a0 0x7fb364102bb0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.641 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.638+0000 7fb36b5f1640 1 -- 172.21.15.5:0/910060338 >> 172.21.15.5:0/910060338 conn(0x7fb3640fe1a0 msgr2=0x7fb3641005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:29.641 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.639+0000 7fb36b5f1640 1 -- 172.21.15.5:0/910060338 shutdown_connections 2024-08-31T05:36:29.641 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.639+0000 7fb36b5f1640 1 -- 172.21.15.5:0/910060338 wait complete. 2024-08-31T05:36:29.642 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.640+0000 7fb36b5f1640 1 Processor -- start 2024-08-31T05:36:29.642 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.640+0000 7fb36b5f1640 1 -- start start 2024-08-31T05:36:29.643 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.640+0000 7fb36b5f1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb3641027a0 0x7fb36419a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:29.643 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.640+0000 7fb36b5f1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3641080d0 0x7fb36419a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:29.643 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.640+0000 7fb36b5f1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb364108a20 0x7fb36419fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:29.643 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.640+0000 7fb36b5f1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb3641126d0 con 0x7fb364108a20 2024-08-31T05:36:29.644 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.640+0000 7fb36b5f1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb364112550 con 0x7fb3641080d0 2024-08-31T05:36:29.644 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.640+0000 7fb36b5f1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb364112850 con 0x7fb3641027a0 2024-08-31T05:36:29.644 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.641+0000 7fb369b8e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb364108a20 0x7fb36419fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:29.644 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.641+0000 7fb369b8e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb364108a20 0x7fb36419fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51716/0 (socket says 172.21.15.5:51716) 2024-08-31T05:36:29.644 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.641+0000 7fb369b8e640 1 -- 172.21.15.5:0/763124680 learned_addr learned my addr 172.21.15.5:0/763124680 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:29.644 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.641+0000 7fb369b8e640 1 -- 172.21.15.5:0/763124680 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb3641027a0 msgr2=0x7fb36419a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:29.644 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.641+0000 7fb369b8e640 1 --2- 172.21.15.5:0/763124680 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb3641027a0 0x7fb36419a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.644 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.641+0000 7fb369b8e640 1 -- 172.21.15.5:0/763124680 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3641080d0 msgr2=0x7fb36419a780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-31T05:36:29.644 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.641+0000 7fb369b8e640 1 --2- 172.21.15.5:0/763124680 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3641080d0 0x7fb36419a780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.644 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.641+0000 7fb369b8e640 1 -- 172.21.15.5:0/763124680 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3641a0110 con 0x7fb364108a20 2024-08-31T05:36:29.645 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.642+0000 7fb369b8e640 1 --2- 172.21.15.5:0/763124680 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb364108a20 0x7fb36419fa10 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fb36000e970 tx=0x7fb36000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:29.645 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.642+0000 7fb35a7fc640 1 -- 172.21.15.5:0/763124680 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb36000ccc0 con 0x7fb364108a20 2024-08-31T05:36:29.645 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.642+0000 7fb35a7fc640 1 -- 172.21.15.5:0/763124680 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb36000ce60 con 0x7fb364108a20 2024-08-31T05:36:29.645 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.642+0000 7fb35a7fc640 1 -- 172.21.15.5:0/763124680 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb360010430 con 0x7fb364108a20 2024-08-31T05:36:29.645 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.642+0000 7fb36b5f1640 1 -- 172.21.15.5:0/763124680 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3641a0400 con 0x7fb364108a20 2024-08-31T05:36:29.645 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.642+0000 7fb36b5f1640 1 -- 172.21.15.5:0/763124680 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3641a0870 con 0x7fb364108a20 2024-08-31T05:36:29.648 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.646+0000 7fb372635740 1 Processor -- start 2024-08-31T05:36:29.650 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.648+0000 7fb35a7fc640 1 -- 172.21.15.5:0/763124680 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fb3600046c0 con 0x7fb364108a20 2024-08-31T05:36:29.651 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.649+0000 7fb372635740 1 -- start start 2024-08-31T05:36:29.652 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.650+0000 7fb372635740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a1398b71b0 0x55a139c5aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:29.652 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.650+0000 7fb372635740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a13988e2f0 0x55a139c5b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:29.652 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.650+0000 7fb372635740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1398964d0 0x55a139c5b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:29.652 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.650+0000 7fb372635740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55a139bd0000 con 0x55a1398b71b0 2024-08-31T05:36:29.652 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.650+0000 7fb372635740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a139bbf590 con 0x55a13988e2f0 2024-08-31T05:36:29.652 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.650+0000 7fb372635740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a139bc3540 con 0x55a1398964d0 2024-08-31T05:36:29.652 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.650+0000 7fb368b8c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a1398b71b0 0x55a139c5aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:29.652 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.650+0000 7fb368b8c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a1398b71b0 0x55a139c5aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51720/0 (socket says 172.21.15.5:51720) 2024-08-31T05:36:29.653 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.650+0000 7fb368b8c640 1 -- 172.21.15.5:0/3414670299 learned_addr learned my addr 172.21.15.5:0/3414670299 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:29.653 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.650+0000 7fb35a7fc640 1 --2- 172.21.15.5:0/763124680 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb3500b4d20 0x7fb3500b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:29.653 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.650+0000 7fb368b8c640 1 --2- 172.21.15.5:0/3414670299 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1398964d0 0x55a139c5b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:29.653 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.650+0000 7fb368b8c640 1 -- 172.21.15.5:0/3414670299 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1398964d0 msgr2=0x55a139c5b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:29.653 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.650+0000 7fb368b8c640 1 --2- 172.21.15.5:0/3414670299 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1398964d0 0x55a139c5b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.654 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.650+0000 7fb368b8c640 1 -- 172.21.15.5:0/3414670299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a13988e2f0 msgr2=0x55a139c5b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:29.654 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.650+0000 7fb368b8c640 1 --2- 172.21.15.5:0/3414670299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a13988e2f0 0x55a139c5b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.654 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.650+0000 7fb368b8c640 1 -- 172.21.15.5:0/3414670299 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a139922790 con 0x55a1398b71b0 2024-08-31T05:36:29.654 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.650+0000 7fb35a7fc640 1 -- 172.21.15.5:0/763124680 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fb3600e5d30 con 0x7fb364108a20 2024-08-31T05:36:29.654 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.650+0000 7fb369b8e640 1 --2- 172.21.15.5:0/763124680 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb3500b4d20 0x7fb3500b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:29.654 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.651+0000 7fb368b8c640 1 --2- 172.21.15.5:0/3414670299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a1398b71b0 0x55a139c5aac0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fb3540136d0 tx=0x7fb354009670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2851ff6a9d6800f1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:29.654 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.651+0000 7fb369b8e640 1 --2- 172.21.15.5:0/763124680 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb3500b4d20 0x7fb3500b7230 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb3600e31b0 tx=0x7fb36001bd20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:29.654 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.651+0000 7fb34f7fe640 1 -- 172.21.15.5:0/3414670299 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb354004030 con 0x55a1398b71b0 2024-08-31T05:36:29.654 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.651+0000 7fb34f7fe640 1 -- 172.21.15.5:0/3414670299 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb35400e6f0 con 0x55a1398b71b0 2024-08-31T05:36:29.654 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.651+0000 7fb34f7fe640 1 -- 172.21.15.5:0/3414670299 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb354003810 con 0x55a1398b71b0 2024-08-31T05:36:29.655 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.653+0000 7fb372635740 1 -- 172.21.15.5:0/3414670299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a1398b71b0 msgr2=0x55a139c5aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:29.655 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.653+0000 7fb372635740 1 --2- 172.21.15.5:0/3414670299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a1398b71b0 0x55a139c5aac0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fb3540136d0 tx=0x7fb354009670 comp rx=0 tx=0).stop 2024-08-31T05:36:29.655 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.653+0000 7fb372635740 1 -- 172.21.15.5:0/3414670299 shutdown_connections 2024-08-31T05:36:29.655 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.653+0000 7fb372635740 1 --2- 172.21.15.5:0/3414670299 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1398964d0 0x55a139c5b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.655 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.653+0000 7fb372635740 1 --2- 172.21.15.5:0/3414670299 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a13988e2f0 0x55a139c5b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.655 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.653+0000 7fb372635740 1 --2- 172.21.15.5:0/3414670299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a1398b71b0 0x55a139c5aac0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.655 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.653+0000 7fb372635740 1 -- 172.21.15.5:0/3414670299 >> 172.21.15.5:0/3414670299 conn(0x55a1398ab300 msgr2=0x55a139c589b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:29.656 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.653+0000 7fb372635740 1 -- 172.21.15.5:0/3414670299 shutdown_connections 2024-08-31T05:36:29.656 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.653+0000 7fb372635740 1 -- 172.21.15.5:0/3414670299 wait complete. 2024-08-31T05:36:29.656 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.654+0000 7fb372635740 1 -- start start 2024-08-31T05:36:29.656 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.654+0000 7fb372635740 1 Processor -- start 2024-08-31T05:36:29.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:29 smithi050 ceph-mon[22146]: scrub queued for path: / 2024-08-31T05:36:29.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:29 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:36:29.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:29 smithi050 ceph-mon[22146]: scrub summary: active paths [/] 2024-08-31T05:36:29.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:29 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:36:29.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:29 smithi050 ceph-mon[22146]: pgmap v540: 129 pgs: 129 active+clean; 405 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.5 MiB/s wr, 203 op/s 2024-08-31T05:36:29.658 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.655+0000 7fb372635740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a13988e2f0 0x55a139c66770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:29.658 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.655+0000 7fb372635740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1398964d0 0x55a139c66d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:29.658 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.655+0000 7fb372635740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a139875d80 0x55a139c6c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:29.658 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.655+0000 7fb372635740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55a139af8ab0 con 0x55a13988e2f0 2024-08-31T05:36:29.659 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.655+0000 7fb372635740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a139b46680 con 0x55a139875d80 2024-08-31T05:36:29.659 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.655+0000 7fb372635740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a139c691e0 con 0x55a1398964d0 2024-08-31T05:36:29.659 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.655+0000 7fb368b8c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a13988e2f0 0x55a139c66770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:29.659 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.655+0000 7fb372635740 10 client.0 _ll_register_callbacks cb 0x55a1398cea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:36:29.659 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.655+0000 7fb368b8c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a13988e2f0 0x55a139c66770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51722/0 (socket says 172.21.15.5:51722) 2024-08-31T05:36:29.659 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.655+0000 7fb368b8c640 1 -- 172.21.15.5:0/330813204 learned_addr learned my addr 172.21.15.5:0/330813204 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:29.659 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.655+0000 7fb368b8c640 1 --2- 172.21.15.5:0/330813204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a139875d80 0x55a139c6c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:29.659 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.656+0000 7fb368b8c640 1 -- 172.21.15.5:0/330813204 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1398964d0 msgr2=0x55a139c66d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:29.659 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.656+0000 7fb368b8c640 1 --2- 172.21.15.5:0/330813204 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1398964d0 0x55a139c66d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.659 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.656+0000 7fb368b8c640 1 -- 172.21.15.5:0/330813204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a139875d80 msgr2=0x55a139c6c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:29.659 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.656+0000 7fb368b8c640 1 --2- 172.21.15.5:0/330813204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a139875d80 0x55a139c6c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.659 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.656+0000 7fb368b8c640 1 -- 172.21.15.5:0/330813204 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a13999b620 con 0x55a13988e2f0 2024-08-31T05:36:29.659 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.656+0000 7fb368b8c640 1 --2- 172.21.15.5:0/330813204 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a13988e2f0 0x55a139c66770 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fb354009770 tx=0x7fb35400ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aea2f991e0fb952 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:29.660 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.656+0000 7fb34cff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:36:29.660 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.656+0000 7fb34cff9640 1 -- 172.21.15.5:0/330813204 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb354028040 con 0x55a13988e2f0 2024-08-31T05:36:29.660 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.656+0000 7fb34cff9640 1 -- 172.21.15.5:0/330813204 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fb354013220 con 0x55a13988e2f0 2024-08-31T05:36:29.660 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.656+0000 7fb372635740 1 -- 172.21.15.5:0/330813204 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb35400e6f0 con 0x55a13988e2f0 2024-08-31T05:36:29.661 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.658+0000 7fb34cff9640 1 -- 172.21.15.5:0/330813204 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fb354032050 con 0x55a13988e2f0 2024-08-31T05:36:29.661 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.658+0000 7fb372635740 10 client.17358 fetch_fsmap learned FSMap version 34 2024-08-31T05:36:29.661 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.658+0000 7fb372635740 1 -- 172.21.15.5:0/330813204 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a139c75360 con 0x55a13988e2f0 2024-08-31T05:36:29.661 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.658+0000 7fb34cff9640 1 -- 172.21.15.5:0/330813204 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb35400e6f0 con 0x55a13988e2f0 2024-08-31T05:36:29.661 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.658+0000 7fb34cff9640 1 -- 172.21.15.5:0/330813204 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fb35401d070 con 0x55a13988e2f0 2024-08-31T05:36:29.661 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.658+0000 7fb372635740 10 client.17358 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:36:29.661 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.658+0000 7fb372635740 10 client.17358 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:36:29.661 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.658+0000 7fb372635740 20 client.17358 populate_metadata read hostname 'smithi005' 2024-08-31T05:36:29.661 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.658+0000 7fb372635740 1 --2- 172.21.15.5:0/330813204 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a13984b1c0 0x55a139c786c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:29.661 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.659+0000 7fb372635740 4 client.17358 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:36:29.661 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.659+0000 7fb372635740 1 -- 172.21.15.5:0/330813204 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a139bd1f50 con 0x55a13984b1c0 2024-08-31T05:36:29.661 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.659+0000 7fb36938d640 1 --2- 172.21.15.5:0/330813204 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a13984b1c0 0x55a139c786c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:29.662 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.659+0000 7fb34cff9640 10 client.17358 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:36:29.662 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.659+0000 7fb36938d640 1 --2- 172.21.15.5:0/330813204 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a13984b1c0 0x55a139c786c0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=226fafce1b3fe22b server_cookie=fc054fac915263a8 in_seq=0 out_seq=0 2024-08-31T05:36:29.663 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.660+0000 7fb34cff9640 1 -- 172.21.15.5:0/330813204 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a139bd1f50 con 0x55a13984b1c0 2024-08-31T05:36:29.663 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.661+0000 7fb34cff9640 10 client.17358 handle_command_reply: tid=0 2024-08-31T05:36:29.663 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.661+0000 7fb372635740 1 client.17358 shutdown 2024-08-31T05:36:29.663 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.661+0000 7fb372635740 1 -- 172.21.15.5:0/330813204 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a13988e2f0 msgr2=0x55a139c66770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:29.663 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.661+0000 7fb372635740 1 --2- 172.21.15.5:0/330813204 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a13988e2f0 0x55a139c66770 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fb354009770 tx=0x7fb35400ed90 comp rx=0 tx=0).stop 2024-08-31T05:36:29.663 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.661+0000 7fb372635740 1 -- 172.21.15.5:0/330813204 shutdown_connections 2024-08-31T05:36:29.663 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.661+0000 7fb372635740 1 --2- 172.21.15.5:0/330813204 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a13984b1c0 0x55a139c786c0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.663 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.661+0000 7fb372635740 1 --2- 172.21.15.5:0/330813204 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a139875d80 0x55a139c6c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.663 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.661+0000 7fb372635740 1 --2- 172.21.15.5:0/330813204 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1398964d0 0x55a139c66d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.664 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.661+0000 7fb372635740 1 --2- 172.21.15.5:0/330813204 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a13988e2f0 0x55a139c66770 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.664 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.661+0000 7fb372635740 1 -- 172.21.15.5:0/330813204 >> 172.21.15.5:0/330813204 conn(0x55a1398ab300 msgr2=0x55a139c5baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:29.664 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.661+0000 7fb34cff9640 0 client.17358 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:36:29.664 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.661+0000 7fb372635740 1 -- 172.21.15.5:0/330813204 shutdown_connections 2024-08-31T05:36:29.664 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.661+0000 7fb372635740 1 -- 172.21.15.5:0/330813204 wait complete. 2024-08-31T05:36:29.664 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.662+0000 7fb372635740 20 client.17358 trim_cache size 0 max 16384 2024-08-31T05:36:29.687 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.684+0000 7fb372635740 1 Processor -- start 2024-08-31T05:36:29.687 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.684+0000 7fb372635740 1 -- start start 2024-08-31T05:36:29.687 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.684+0000 7fb372635740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a139875d80 0x55a139c6c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:29.687 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.684+0000 7fb372635740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a13988e2f0 0x55a139c5fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:29.687 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.684+0000 7fb372635740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1398964d0 0x55a139c600c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:29.687 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.684+0000 7fb372635740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb3641b72e0 con 0x55a13988e2f0 2024-08-31T05:36:29.687 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.684+0000 7fb372635740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb3641b8e20 con 0x55a1398964d0 2024-08-31T05:36:29.687 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.684+0000 7fb372635740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb3641b79b0 con 0x55a139875d80 2024-08-31T05:36:29.687 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.684+0000 7fb36938d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a13988e2f0 0x55a139c5fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:29.688 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.684+0000 7fb368b8c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a139875d80 0x55a139c6c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:29.688 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.684+0000 7fb368b8c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a139875d80 0x55a139c6c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:55872/0 (socket says 172.21.15.5:55872) 2024-08-31T05:36:29.688 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.684+0000 7fb368b8c640 1 -- 172.21.15.5:0/1802138073 learned_addr learned my addr 172.21.15.5:0/1802138073 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:29.688 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.684+0000 7fb368b8c640 1 --2- 172.21.15.5:0/1802138073 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1398964d0 0x55a139c600c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:29.688 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.684+0000 7fb368b8c640 1 -- 172.21.15.5:0/1802138073 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1398964d0 msgr2=0x55a139c600c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:29.688 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.684+0000 7fb368b8c640 1 --2- 172.21.15.5:0/1802138073 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1398964d0 0x55a139c600c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.688 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.684+0000 7fb368b8c640 1 -- 172.21.15.5:0/1802138073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a13988e2f0 msgr2=0x55a139c5fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:29.688 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.684+0000 7fb368b8c640 1 --2- 172.21.15.5:0/1802138073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a13988e2f0 0x55a139c5fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.688 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.684+0000 7fb368b8c640 1 -- 172.21.15.5:0/1802138073 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a139c52840 con 0x55a139875d80 2024-08-31T05:36:29.688 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.684+0000 7fb36938d640 1 --2- 172.21.15.5:0/1802138073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a13988e2f0 0x55a139c5fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:36:29.688 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.685+0000 7fb368b8c640 1 --2- 172.21.15.5:0/1802138073 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a139875d80 0x55a139c6c4a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb35400ed10 tx=0x7fb354015040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe2ea7dc5966321a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:29.688 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.685+0000 7fb34effd640 1 -- 172.21.15.5:0/1802138073 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb354004bf0 con 0x55a139875d80 2024-08-31T05:36:29.689 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.685+0000 7fb34effd640 1 -- 172.21.15.5:0/1802138073 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb354004620 con 0x55a139875d80 2024-08-31T05:36:29.689 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.685+0000 7fb34effd640 1 -- 172.21.15.5:0/1802138073 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb354003850 con 0x55a139875d80 2024-08-31T05:36:29.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.686+0000 7fb372635740 1 -- 172.21.15.5:0/1802138073 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a139875d80 msgr2=0x55a139c6c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:29.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.686+0000 7fb372635740 1 --2- 172.21.15.5:0/1802138073 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a139875d80 0x55a139c6c4a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb35400ed10 tx=0x7fb354015040 comp rx=0 tx=0).stop 2024-08-31T05:36:29.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.686+0000 7fb372635740 1 -- 172.21.15.5:0/1802138073 shutdown_connections 2024-08-31T05:36:29.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.686+0000 7fb372635740 1 --2- 172.21.15.5:0/1802138073 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1398964d0 0x55a139c600c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.686+0000 7fb372635740 1 --2- 172.21.15.5:0/1802138073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a13988e2f0 0x55a139c5fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.686+0000 7fb372635740 1 --2- 172.21.15.5:0/1802138073 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a139875d80 0x55a139c6c4a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.686+0000 7fb372635740 1 -- 172.21.15.5:0/1802138073 >> 172.21.15.5:0/1802138073 conn(0x55a1398ab300 msgr2=0x55a139c64dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:29.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.686+0000 7fb372635740 1 -- 172.21.15.5:0/1802138073 shutdown_connections 2024-08-31T05:36:29.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.686+0000 7fb372635740 1 -- 172.21.15.5:0/1802138073 wait complete. 2024-08-31T05:36:29.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.686+0000 7fb372635740 1 -- start start 2024-08-31T05:36:29.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.686+0000 7fb372635740 1 Processor -- start 2024-08-31T05:36:29.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.687+0000 7fb372635740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a139875d80 0x55a139c73020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:29.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.687+0000 7fb372635740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a13988e2f0 0x55a139c6e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:29.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.687+0000 7fb372635740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1398964d0 0x55a139c6ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:29.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.687+0000 7fb372635740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb3641b8750 con 0x55a13988e2f0 2024-08-31T05:36:29.694 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.687+0000 7fb372635740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb3641b8080 con 0x55a1398964d0 2024-08-31T05:36:29.694 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.687+0000 7fb36938d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a13988e2f0 0x55a139c6e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:29.694 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.687+0000 7fb372635740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb3641b52c0 con 0x55a139875d80 2024-08-31T05:36:29.694 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.687+0000 7fb368b8c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a139875d80 0x55a139c73020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:29.694 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.687+0000 7fb36938d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a13988e2f0 0x55a139c6e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51728/0 (socket says 172.21.15.5:51728) 2024-08-31T05:36:29.694 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.687+0000 7fb36938d640 1 -- 172.21.15.5:0/1622358148 learned_addr learned my addr 172.21.15.5:0/1622358148 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:29.694 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.687+0000 7fb372635740 10 client.0 _ll_register_callbacks cb 0x7fb354009cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:36:29.694 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.687+0000 7fb368b8c640 1 --2- 172.21.15.5:0/1622358148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1398964d0 0x55a139c6ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:29.694 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.687+0000 7fb36938d640 1 -- 172.21.15.5:0/1622358148 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a139875d80 msgr2=0x55a139c73020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:29.694 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.687+0000 7fb36938d640 1 --2- 172.21.15.5:0/1622358148 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a139875d80 0x55a139c73020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.694 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.687+0000 7fb36938d640 1 -- 172.21.15.5:0/1622358148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1398964d0 msgr2=0x55a139c6ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:29.694 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.687+0000 7fb36938d640 1 --2- 172.21.15.5:0/1622358148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1398964d0 0x55a139c6ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.694 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.687+0000 7fb36938d640 1 -- 172.21.15.5:0/1622358148 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a139c6f060 con 0x55a13988e2f0 2024-08-31T05:36:29.695 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.687+0000 7fb368b8c640 1 --2- 172.21.15.5:0/1622358148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1398964d0 0x55a139c6ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:36:29.695 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.688+0000 7fb36938d640 1 --2- 172.21.15.5:0/1622358148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a13988e2f0 0x55a139c6e510 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fb35c02f550 tx=0x7fb35c009850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ab22072be194bd0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:29.695 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.688+0000 7fb34cff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:36:29.695 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.688+0000 7fb34cff9640 1 -- 172.21.15.5:0/1622358148 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb35c031450 con 0x55a13988e2f0 2024-08-31T05:36:29.695 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.688+0000 7fb34cff9640 1 -- 172.21.15.5:0/1622358148 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fb35c0315f0 con 0x55a13988e2f0 2024-08-31T05:36:29.695 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.688+0000 7fb372635740 1 -- 172.21.15.5:0/1622358148 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb354004620 con 0x55a13988e2f0 2024-08-31T05:36:29.695 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.688+0000 7fb34cff9640 1 -- 172.21.15.5:0/1622358148 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fb35c055050 con 0x55a13988e2f0 2024-08-31T05:36:29.695 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.688+0000 7fb372635740 10 client.17364 fetch_fsmap learned FSMap version 34 2024-08-31T05:36:29.695 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.688+0000 7fb372635740 1 -- 172.21.15.5:0/1622358148 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a139ce2d00 con 0x55a13988e2f0 2024-08-31T05:36:29.695 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.688+0000 7fb34cff9640 1 -- 172.21.15.5:0/1622358148 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb354004620 con 0x55a13988e2f0 2024-08-31T05:36:29.695 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.688+0000 7fb34cff9640 1 -- 172.21.15.5:0/1622358148 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fb35c0043b0 con 0x55a13988e2f0 2024-08-31T05:36:29.695 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.689+0000 7fb372635740 10 client.17364 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:36:29.695 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.689+0000 7fb372635740 10 client.17364 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:36:29.696 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.689+0000 7fb372635740 20 client.17364 populate_metadata read hostname 'smithi005' 2024-08-31T05:36:29.696 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.689+0000 7fb372635740 1 --2- 172.21.15.5:0/1622358148 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a139ce3460 0x55a139ce58b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:29.696 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.689+0000 7fb372635740 4 client.17364 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:36:29.696 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.689+0000 7fb372635740 1 -- 172.21.15.5:0/1622358148 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a139bcd9f0 con 0x55a139ce3460 2024-08-31T05:36:29.696 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.689+0000 7fb368b8c640 1 --2- 172.21.15.5:0/1622358148 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a139ce3460 0x55a139ce58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:29.696 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.689+0000 7fb34cff9640 10 client.17364 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:36:29.696 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.689+0000 7fb368b8c640 1 --2- 172.21.15.5:0/1622358148 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a139ce3460 0x55a139ce58b0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37051b60047cc57c server_cookie=99139bfb487f31c3 in_seq=0 out_seq=0 2024-08-31T05:36:29.705 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.702+0000 7fb34cff9640 1 -- 172.21.15.5:0/1622358148 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a139bcd9f0 con 0x55a139ce3460 2024-08-31T05:36:29.705 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.702+0000 7fb34cff9640 10 client.17364 handle_command_reply: tid=0 2024-08-31T05:36:29.705 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.702+0000 7fb372635740 1 client.17364 shutdown 2024-08-31T05:36:29.705 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.703+0000 7fb372635740 1 -- 172.21.15.5:0/1622358148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a13988e2f0 msgr2=0x55a139c6e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:29.705 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.703+0000 7fb372635740 1 --2- 172.21.15.5:0/1622358148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a13988e2f0 0x55a139c6e510 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fb35c02f550 tx=0x7fb35c009850 comp rx=0 tx=0).stop 2024-08-31T05:36:29.706 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.703+0000 7fb372635740 1 -- 172.21.15.5:0/1622358148 shutdown_connections 2024-08-31T05:36:29.706 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.703+0000 7fb372635740 1 --2- 172.21.15.5:0/1622358148 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a139ce3460 0x55a139ce58b0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.706 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.703+0000 7fb372635740 1 --2- 172.21.15.5:0/1622358148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a1398964d0 0x55a139c6ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.706 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.703+0000 7fb34cff9640 0 client.17364 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:36:29.706 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.703+0000 7fb372635740 1 --2- 172.21.15.5:0/1622358148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a13988e2f0 0x55a139c6e510 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.706 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.703+0000 7fb372635740 1 --2- 172.21.15.5:0/1622358148 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a139875d80 0x55a139c73020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.706 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.703+0000 7fb372635740 1 -- 172.21.15.5:0/1622358148 >> 172.21.15.5:0/1622358148 conn(0x55a1398ab300 msgr2=0x55a139c64d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:29.706 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.703+0000 7fb372635740 1 -- 172.21.15.5:0/1622358148 shutdown_connections 2024-08-31T05:36:29.706 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.703+0000 7fb372635740 1 -- 172.21.15.5:0/1622358148 wait complete. 2024-08-31T05:36:29.706 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.703+0000 7fb372635740 20 client.17364 trim_cache size 0 max 16384 2024-08-31T05:36:29.707 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:36:29.707 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:36:29.707 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:36:29.707 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:36:29.708 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.703+0000 7fb36b5f1640 1 -- 172.21.15.5:0/763124680 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb3500b4d20 msgr2=0x7fb3500b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:29.708 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.704+0000 7fb36b5f1640 1 --2- 172.21.15.5:0/763124680 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb3500b4d20 0x7fb3500b7230 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb3600e31b0 tx=0x7fb36001bd20 comp rx=0 tx=0).stop 2024-08-31T05:36:29.708 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.704+0000 7fb36b5f1640 1 -- 172.21.15.5:0/763124680 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb364108a20 msgr2=0x7fb36419fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:29.708 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.704+0000 7fb36b5f1640 1 --2- 172.21.15.5:0/763124680 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb364108a20 0x7fb36419fa10 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fb36000e970 tx=0x7fb36000ed70 comp rx=0 tx=0).stop 2024-08-31T05:36:29.708 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.704+0000 7fb36b5f1640 1 -- 172.21.15.5:0/763124680 shutdown_connections 2024-08-31T05:36:29.708 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.704+0000 7fb36b5f1640 1 --2- 172.21.15.5:0/763124680 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb3500b4d20 0x7fb3500b7230 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.708 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.704+0000 7fb36b5f1640 1 --2- 172.21.15.5:0/763124680 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb364108a20 0x7fb36419fa10 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.708 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.704+0000 7fb36b5f1640 1 --2- 172.21.15.5:0/763124680 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb3641080d0 0x7fb36419a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.708 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.704+0000 7fb36b5f1640 1 --2- 172.21.15.5:0/763124680 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb3641027a0 0x7fb36419a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:29.708 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.704+0000 7fb36b5f1640 1 -- 172.21.15.5:0/763124680 >> 172.21.15.5:0/763124680 conn(0x7fb3640fe1a0 msgr2=0x7fb36406bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:29.708 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.704+0000 7fb36b5f1640 1 -- 172.21.15.5:0/763124680 shutdown_connections 2024-08-31T05:36:29.708 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:29.704+0000 7fb36b5f1640 1 -- 172.21.15.5:0/763124680 wait complete. 2024-08-31T05:36:29.924 INFO:tasks.workunit.client.0.smithi005.stdout: 1 727012 11.67 MB/sec execute 197 sec latency 37.532 ms 2024-08-31T05:36:30.078 INFO:tasks.cephfs.filesystem:scrub status for tag:94c23057-592d-4a8b-82d7-da2d84f8740b - {'path': '/', 'tag': '94c23057-592d-4a8b-82d7-da2d84f8740b', 'options': 'recursive,force'} 2024-08-31T05:36:30.924 INFO:tasks.workunit.client.0.smithi005.stdout: 1 729101 11.68 MB/sec execute 198 sec latency 12.764 ms 2024-08-31T05:36:31.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:31 smithi070 ceph-mon[22316]: pgmap v541: 129 pgs: 129 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.6 MiB/s wr, 272 op/s 2024-08-31T05:36:31.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:31 smithi050 ceph-mon[22146]: pgmap v541: 129 pgs: 129 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.6 MiB/s wr, 272 op/s 2024-08-31T05:36:31.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:31 smithi005 ceph-mon[18602]: pgmap v541: 129 pgs: 129 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.6 MiB/s wr, 272 op/s 2024-08-31T05:36:31.924 INFO:tasks.workunit.client.0.smithi005.stdout: 1 730956 11.67 MB/sec execute 199 sec latency 113.163 ms 2024-08-31T05:36:32.924 INFO:tasks.workunit.client.0.smithi005.stdout: 1 732988 11.67 MB/sec execute 200 sec latency 14.287 ms 2024-08-31T05:36:33.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:33 smithi070 ceph-mon[22316]: pgmap v542: 129 pgs: 129 active+clean; 383 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.3 MiB/s wr, 200 op/s 2024-08-31T05:36:33.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:33 smithi050 ceph-mon[22146]: pgmap v542: 129 pgs: 129 active+clean; 383 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.3 MiB/s wr, 200 op/s 2024-08-31T05:36:33.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:33 smithi005 ceph-mon[18602]: pgmap v542: 129 pgs: 129 active+clean; 383 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.3 MiB/s wr, 200 op/s 2024-08-31T05:36:33.924 INFO:tasks.workunit.client.0.smithi005.stdout: 1 735436 11.68 MB/sec execute 201 sec latency 13.783 ms 2024-08-31T05:36:34.925 INFO:tasks.workunit.client.0.smithi005.stdout: 1 737178 11.66 MB/sec execute 202 sec latency 30.314 ms 2024-08-31T05:36:35.519 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:35 smithi005 ceph-mon[18602]: pgmap v543: 129 pgs: 129 active+clean; 387 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.7 MiB/s wr, 227 op/s 2024-08-31T05:36:35.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:35 smithi070 ceph-mon[22316]: pgmap v543: 129 pgs: 129 active+clean; 387 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.7 MiB/s wr, 227 op/s 2024-08-31T05:36:35.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:35 smithi050 ceph-mon[22146]: pgmap v543: 129 pgs: 129 active+clean; 387 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.7 MiB/s wr, 227 op/s 2024-08-31T05:36:35.924 INFO:tasks.workunit.client.0.smithi005.stdout: 1 739460 11.67 MB/sec execute 203 sec latency 12.869 ms 2024-08-31T05:36:36.925 INFO:tasks.workunit.client.0.smithi005.stdout: 1 741370 11.66 MB/sec execute 204 sec latency 110.690 ms 2024-08-31T05:36:37.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:37 smithi070 ceph-mon[22316]: pgmap v544: 129 pgs: 129 active+clean; 391 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.3 MiB/s wr, 255 op/s 2024-08-31T05:36:37.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:37 smithi050 ceph-mon[22146]: pgmap v544: 129 pgs: 129 active+clean; 391 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.3 MiB/s wr, 255 op/s 2024-08-31T05:36:37.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:37 smithi005 ceph-mon[18602]: pgmap v544: 129 pgs: 129 active+clean; 391 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.3 MiB/s wr, 255 op/s 2024-08-31T05:36:37.925 INFO:tasks.workunit.client.0.smithi005.stdout: 1 743538 11.67 MB/sec execute 205 sec latency 12.395 ms 2024-08-31T05:36:38.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:38 smithi070 ceph-mon[22316]: scrub summary: idle 2024-08-31T05:36:38.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:38 smithi070 ceph-mon[22316]: scrub summary: idle 2024-08-31T05:36:38.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:38 smithi050 ceph-mon[22146]: scrub summary: idle 2024-08-31T05:36:38.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:38 smithi050 ceph-mon[22146]: scrub summary: idle 2024-08-31T05:36:38.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:38 smithi005 ceph-mon[18602]: scrub summary: idle 2024-08-31T05:36:38.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:38 smithi005 ceph-mon[18602]: scrub summary: idle 2024-08-31T05:36:38.925 INFO:tasks.workunit.client.0.smithi005.stdout: 1 745973 11.68 MB/sec execute 206 sec latency 15.107 ms 2024-08-31T05:36:39.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:39 smithi070 ceph-mon[22316]: pgmap v545: 129 pgs: 129 active+clean; 391 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.2 MiB/s wr, 192 op/s 2024-08-31T05:36:39.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:39 smithi050 ceph-mon[22146]: pgmap v545: 129 pgs: 129 active+clean; 391 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.2 MiB/s wr, 192 op/s 2024-08-31T05:36:39.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:39 smithi005 ceph-mon[18602]: pgmap v545: 129 pgs: 129 active+clean; 391 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.2 MiB/s wr, 192 op/s 2024-08-31T05:36:39.925 INFO:tasks.workunit.client.0.smithi005.stdout: 1 747502 11.65 MB/sec execute 207 sec latency 33.526 ms 2024-08-31T05:36:40.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:40 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:36:40.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:40 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T05:36:40.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:40 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T05:36:40.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:40 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T05:36:40.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:40 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T05:36:40.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:40 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T05:36:40.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:40 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T05:36:40.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:40 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T05:36:40.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:40 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T05:36:40.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:40 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T05:36:40.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:40 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-31T05:36:40.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:40 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-31T05:36:40.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:40 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-31T05:36:40.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:40 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:36:40.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:40 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:36:40.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:40 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:36:40.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:40 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:36:40.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:40 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T05:36:40.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:40 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T05:36:40.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:40 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T05:36:40.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:40 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T05:36:40.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:40 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T05:36:40.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:40 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T05:36:40.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:40 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T05:36:40.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:40 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T05:36:40.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:40 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T05:36:40.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:40 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-31T05:36:40.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:40 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-31T05:36:40.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:40 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-31T05:36:40.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:40 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:36:40.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:40 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:36:40.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:40 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:36:40.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:40 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:36:40.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:40 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T05:36:40.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:40 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T05:36:40.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:40 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T05:36:40.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:40 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T05:36:40.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:40 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T05:36:40.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:40 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T05:36:40.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:40 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T05:36:40.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:40 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T05:36:40.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:40 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T05:36:40.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:40 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-31T05:36:40.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:40 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-31T05:36:40.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:40 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-31T05:36:40.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:40 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:36:40.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:40 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:36:40.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:40 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:36:40.925 INFO:tasks.workunit.client.0.smithi005.stdout: 1 749896 11.66 MB/sec execute 208 sec latency 17.003 ms 2024-08-31T05:36:41.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:41 smithi070 ceph-mon[22316]: pgmap v546: 129 pgs: 129 active+clean; 399 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.4 MiB/s wr, 270 op/s 2024-08-31T05:36:41.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:41 smithi070 ceph-mon[22316]: Adjusting osd_memory_target on smithi070 to 176.0M 2024-08-31T05:36:41.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:41 smithi070 ceph-mon[22316]: Adjusting osd_memory_target on smithi050 to 177.0M 2024-08-31T05:36:41.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:41 smithi070 ceph-mon[22316]: Adjusting osd_memory_target on smithi005 to 177.0M 2024-08-31T05:36:41.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:41 smithi070 ceph-mon[22316]: Unable to set osd_memory_target on smithi070 to 184573132: error parsing value: Value '184573132' is below minimum 939524096 2024-08-31T05:36:41.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:41 smithi070 ceph-mon[22316]: Unable to set osd_memory_target on smithi050 to 185698508: error parsing value: Value '185698508' is below minimum 939524096 2024-08-31T05:36:41.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:41 smithi070 ceph-mon[22316]: Unable to set osd_memory_target on smithi005 to 185700659: error parsing value: Value '185700659' is below minimum 939524096 2024-08-31T05:36:41.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:41 smithi050 ceph-mon[22146]: pgmap v546: 129 pgs: 129 active+clean; 399 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.4 MiB/s wr, 270 op/s 2024-08-31T05:36:41.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:41 smithi050 ceph-mon[22146]: Adjusting osd_memory_target on smithi070 to 176.0M 2024-08-31T05:36:41.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:41 smithi050 ceph-mon[22146]: Adjusting osd_memory_target on smithi050 to 177.0M 2024-08-31T05:36:41.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:41 smithi050 ceph-mon[22146]: Adjusting osd_memory_target on smithi005 to 177.0M 2024-08-31T05:36:41.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:41 smithi050 ceph-mon[22146]: Unable to set osd_memory_target on smithi070 to 184573132: error parsing value: Value '184573132' is below minimum 939524096 2024-08-31T05:36:41.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:41 smithi050 ceph-mon[22146]: Unable to set osd_memory_target on smithi050 to 185698508: error parsing value: Value '185698508' is below minimum 939524096 2024-08-31T05:36:41.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:41 smithi050 ceph-mon[22146]: Unable to set osd_memory_target on smithi005 to 185700659: error parsing value: Value '185700659' is below minimum 939524096 2024-08-31T05:36:41.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:41 smithi005 ceph-mon[18602]: pgmap v546: 129 pgs: 129 active+clean; 399 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.4 MiB/s wr, 270 op/s 2024-08-31T05:36:41.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:41 smithi005 ceph-mon[18602]: Adjusting osd_memory_target on smithi070 to 176.0M 2024-08-31T05:36:41.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:41 smithi005 ceph-mon[18602]: Adjusting osd_memory_target on smithi050 to 177.0M 2024-08-31T05:36:41.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:41 smithi005 ceph-mon[18602]: Adjusting osd_memory_target on smithi005 to 177.0M 2024-08-31T05:36:41.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:41 smithi005 ceph-mon[18602]: Unable to set osd_memory_target on smithi070 to 184573132: error parsing value: Value '184573132' is below minimum 939524096 2024-08-31T05:36:41.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:41 smithi005 ceph-mon[18602]: Unable to set osd_memory_target on smithi050 to 185698508: error parsing value: Value '185698508' is below minimum 939524096 2024-08-31T05:36:41.718 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:41 smithi005 ceph-mon[18602]: Unable to set osd_memory_target on smithi005 to 185700659: error parsing value: Value '185700659' is below minimum 939524096 2024-08-31T05:36:41.925 INFO:tasks.workunit.client.0.smithi005.stdout: 1 751565 11.64 MB/sec execute 209 sec latency 120.884 ms 2024-08-31T05:36:42.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.807+0000 7fb9dca53640 1 -- 172.21.15.5:0/1586734265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9d8103870 msgr2=0x7fb9d8103c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:42.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.807+0000 7fb9dca53640 1 --2- 172.21.15.5:0/1586734265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9d8103870 0x7fb9d8103c80 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc009900 tx=0x7fb9cc02a410 comp rx=0 tx=0).stop 2024-08-31T05:36:42.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.807+0000 7fb9dca53640 1 -- 172.21.15.5:0/1586734265 shutdown_connections 2024-08-31T05:36:42.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.807+0000 7fb9dca53640 1 --2- 172.21.15.5:0/1586734265 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9d8109af0 0x7fb9d8110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:42.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.807+0000 7fb9dca53640 1 --2- 172.21.15.5:0/1586734265 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9d81091a0 0x7fb9d81095b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:42.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.807+0000 7fb9dca53640 1 --2- 172.21.15.5:0/1586734265 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9d8103870 0x7fb9d8103c80 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:42.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.807+0000 7fb9dca53640 1 -- 172.21.15.5:0/1586734265 >> 172.21.15.5:0/1586734265 conn(0x7fb9d80ff270 msgr2=0x7fb9d81016c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:42.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.807+0000 7fb9dca53640 1 -- 172.21.15.5:0/1586734265 shutdown_connections 2024-08-31T05:36:42.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.807+0000 7fb9dca53640 1 -- 172.21.15.5:0/1586734265 wait complete. 2024-08-31T05:36:42.811 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.808+0000 7fb9dca53640 1 Processor -- start 2024-08-31T05:36:42.812 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.808+0000 7fb9dca53640 1 -- start start 2024-08-31T05:36:42.812 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.808+0000 7fb9dca53640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9d8103870 0x7fb9d819a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:42.812 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.808+0000 7fb9dca53640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9d81091a0 0x7fb9d819a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:42.812 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.808+0000 7fb9dca53640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9d8109af0 0x7fb9d819fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:42.812 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.808+0000 7fb9dca53640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d8113810 con 0x7fb9d81091a0 2024-08-31T05:36:42.812 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.808+0000 7fb9dca53640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d8113690 con 0x7fb9d8109af0 2024-08-31T05:36:42.812 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.808+0000 7fb9dca53640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d8113990 con 0x7fb9d8103870 2024-08-31T05:36:42.812 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.808+0000 7fb9d659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9d8103870 0x7fb9d819a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:42.812 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.808+0000 7fb9d5d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9d81091a0 0x7fb9d819a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:42.812 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.808+0000 7fb9d5d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9d81091a0 0x7fb9d819a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47216/0 (socket says 172.21.15.5:47216) 2024-08-31T05:36:42.812 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.808+0000 7fb9d659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9d8103870 0x7fb9d819a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:50636/0 (socket says 172.21.15.5:50636) 2024-08-31T05:36:42.812 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.808+0000 7fb9d5d9b640 1 -- 172.21.15.5:0/449134192 learned_addr learned my addr 172.21.15.5:0/449134192 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:42.812 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.808+0000 7fb9d6d9d640 1 --2- 172.21.15.5:0/449134192 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9d8109af0 0x7fb9d819fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:42.813 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.809+0000 7fb9d659c640 1 -- 172.21.15.5:0/449134192 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9d8109af0 msgr2=0x7fb9d819fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:42.813 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.809+0000 7fb9d659c640 1 --2- 172.21.15.5:0/449134192 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9d8109af0 0x7fb9d819fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:42.813 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.809+0000 7fb9d659c640 1 -- 172.21.15.5:0/449134192 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9d81091a0 msgr2=0x7fb9d819a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:42.813 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.809+0000 7fb9d659c640 1 --2- 172.21.15.5:0/449134192 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9d81091a0 0x7fb9d819a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:42.813 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.809+0000 7fb9d659c640 1 -- 172.21.15.5:0/449134192 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9d81a01c0 con 0x7fb9d8103870 2024-08-31T05:36:42.813 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.809+0000 7fb9d5d9b640 1 --2- 172.21.15.5:0/449134192 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9d81091a0 0x7fb9d819a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:36:42.813 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.809+0000 7fb9d659c640 1 --2- 172.21.15.5:0/449134192 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9d8103870 0x7fb9d819a290 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc02aa00 tx=0x7fb9cc003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:42.813 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.809+0000 7fb9c77fe640 1 -- 172.21.15.5:0/449134192 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc03f070 con 0x7fb9d8103870 2024-08-31T05:36:42.813 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.809+0000 7fb9dca53640 1 -- 172.21.15.5:0/449134192 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9d81a0450 con 0x7fb9d8103870 2024-08-31T05:36:42.813 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.809+0000 7fb9dca53640 1 -- 172.21.15.5:0/449134192 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9d81a6c40 con 0x7fb9d8103870 2024-08-31T05:36:42.813 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.810+0000 7fb9c77fe640 1 -- 172.21.15.5:0/449134192 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9cc031b50 con 0x7fb9d8103870 2024-08-31T05:36:42.814 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.810+0000 7fb9c77fe640 1 -- 172.21.15.5:0/449134192 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc035030 con 0x7fb9d8103870 2024-08-31T05:36:42.814 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.812+0000 7fb9c77fe640 1 -- 172.21.15.5:0/449134192 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fb9cc042070 con 0x7fb9d8103870 2024-08-31T05:36:42.815 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.813+0000 7fb9e39c1740 1 Processor -- start 2024-08-31T05:36:42.815 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.813+0000 7fb9e39c1740 1 -- start start 2024-08-31T05:36:42.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.813+0000 7fb9e39c1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56145d7ad1b0 0x56145db50ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:42.818 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.813+0000 7fb9e39c1740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56145d7842f0 0x56145db51000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:42.818 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.813+0000 7fb9e39c1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56145d78c4d0 0x56145db51540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:42.818 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.813+0000 7fb9e39c1740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56145dac6000 con 0x56145d7842f0 2024-08-31T05:36:42.818 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.813+0000 7fb9e39c1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56145dab5590 con 0x56145d7ad1b0 2024-08-31T05:36:42.818 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.813+0000 7fb9e39c1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56145dab9540 con 0x56145d78c4d0 2024-08-31T05:36:42.818 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.813+0000 7fb9d6d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56145d7ad1b0 0x56145db50ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:42.818 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.813+0000 7fb9d5d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56145d78c4d0 0x56145db51540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:42.818 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.813+0000 7fb9d6d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56145d7ad1b0 0x56145db50ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:42134/0 (socket says 172.21.15.5:42134) 2024-08-31T05:36:42.818 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.813+0000 7fb9d659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56145d7842f0 0x56145db51000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:42.818 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.813+0000 7fb9d6d9d640 1 -- 172.21.15.5:0/1985814217 learned_addr learned my addr 172.21.15.5:0/1985814217 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:42.818 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.814+0000 7fb9c77fe640 1 --2- 172.21.15.5:0/449134192 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb9c00b4d20 0x7fb9c00b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:42.818 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.814+0000 7fb9d6d9d640 1 -- 172.21.15.5:0/1985814217 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56145d78c4d0 msgr2=0x56145db51540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:42.818 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.814+0000 7fb9d6d9d640 1 --2- 172.21.15.5:0/1985814217 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56145d78c4d0 0x56145db51540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:42.819 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.814+0000 7fb9d6d9d640 1 -- 172.21.15.5:0/1985814217 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56145d7842f0 msgr2=0x56145db51000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:42.819 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.814+0000 7fb9d6d9d640 1 --2- 172.21.15.5:0/1985814217 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56145d7842f0 0x56145db51000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:42.819 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.814+0000 7fb9d6d9d640 1 -- 172.21.15.5:0/1985814217 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56145d818790 con 0x56145d7ad1b0 2024-08-31T05:36:42.819 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.814+0000 7fb9d5d9b640 1 --2- 172.21.15.5:0/1985814217 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56145d78c4d0 0x56145db51540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:36:42.819 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.814+0000 7fb9d6d9d640 1 --2- 172.21.15.5:0/449134192 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb9c00b4d20 0x7fb9c00b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:42.819 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.814+0000 7fb9c77fe640 1 -- 172.21.15.5:0/449134192 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fb9cc105c20 con 0x7fb9d8103870 2024-08-31T05:36:42.819 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.814+0000 7fb9d6d9d640 1 --2- 172.21.15.5:0/1985814217 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56145d7ad1b0 0x56145db50ac0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0011590 tx=0x7fb9d0009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0107b1673c32bdb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:42.819 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.814+0000 7fb9c4ff9640 1 -- 172.21.15.5:0/1985814217 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d0017050 con 0x56145d7ad1b0 2024-08-31T05:36:42.819 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.814+0000 7fb9d6d9d640 1 --2- 172.21.15.5:0/449134192 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb9c00b4d20 0x7fb9c00b7230 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0023000 tx=0x7fb9d0024000 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:42.819 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.814+0000 7fb9c4ff9640 1 -- 172.21.15.5:0/1985814217 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9d001bbf0 con 0x56145d7ad1b0 2024-08-31T05:36:42.819 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.814+0000 7fb9c4ff9640 1 -- 172.21.15.5:0/1985814217 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d000ebb0 con 0x56145d7ad1b0 2024-08-31T05:36:42.819 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.815+0000 7fb9e39c1740 1 -- 172.21.15.5:0/1985814217 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56145d7ad1b0 msgr2=0x56145db50ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:42.819 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.815+0000 7fb9e39c1740 1 --2- 172.21.15.5:0/1985814217 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56145d7ad1b0 0x56145db50ac0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0011590 tx=0x7fb9d0009f90 comp rx=0 tx=0).stop 2024-08-31T05:36:42.819 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.815+0000 7fb9e39c1740 1 -- 172.21.15.5:0/1985814217 shutdown_connections 2024-08-31T05:36:42.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.815+0000 7fb9e39c1740 1 --2- 172.21.15.5:0/1985814217 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56145d78c4d0 0x56145db51540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:42.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.815+0000 7fb9e39c1740 1 --2- 172.21.15.5:0/1985814217 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56145d7842f0 0x56145db51000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:42.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.815+0000 7fb9e39c1740 1 --2- 172.21.15.5:0/1985814217 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56145d7ad1b0 0x56145db50ac0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:42.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.815+0000 7fb9e39c1740 1 -- 172.21.15.5:0/1985814217 >> 172.21.15.5:0/1985814217 conn(0x56145d7a1300 msgr2=0x56145db4e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:42.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.815+0000 7fb9e39c1740 1 -- 172.21.15.5:0/1985814217 shutdown_connections 2024-08-31T05:36:42.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.815+0000 7fb9e39c1740 1 -- 172.21.15.5:0/1985814217 wait complete. 2024-08-31T05:36:42.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.816+0000 7fb9e39c1740 1 -- start start 2024-08-31T05:36:42.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.816+0000 7fb9e39c1740 1 Processor -- start 2024-08-31T05:36:42.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.816+0000 7fb9e39c1740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56145d7842f0 0x56145db60ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:42.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.816+0000 7fb9e39c1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56145d78c4d0 0x56145db61050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:42.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.816+0000 7fb9e39c1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56145d7ad1b0 0x56145db6c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:42.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.816+0000 7fb9e39c1740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56145d9eeab0 con 0x56145d7842f0 2024-08-31T05:36:42.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.816+0000 7fb9e39c1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56145da3c680 con 0x56145d7ad1b0 2024-08-31T05:36:42.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.816+0000 7fb9e39c1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56145db63620 con 0x56145d78c4d0 2024-08-31T05:36:42.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.816+0000 7fb9e39c1740 10 client.0 _ll_register_callbacks cb 0x56145d7c4a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:36:42.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.816+0000 7fb9d659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56145d7842f0 0x56145db60ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:42.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.816+0000 7fb9d659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56145d7842f0 0x56145db60ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47236/0 (socket says 172.21.15.5:47236) 2024-08-31T05:36:42.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.816+0000 7fb9d659c640 1 -- 172.21.15.5:0/1502614516 learned_addr learned my addr 172.21.15.5:0/1502614516 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:42.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.816+0000 7fb9d5d9b640 1 --2- 172.21.15.5:0/1502614516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56145d78c4d0 0x56145db61050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:42.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.816+0000 7fb9d6d9d640 1 --2- 172.21.15.5:0/1502614516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56145d7ad1b0 0x56145db6c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:42.825 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.816+0000 7fb9d659c640 1 -- 172.21.15.5:0/1502614516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56145d78c4d0 msgr2=0x56145db61050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:42.825 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.816+0000 7fb9d659c640 1 --2- 172.21.15.5:0/1502614516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56145d78c4d0 0x56145db61050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:42.825 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.816+0000 7fb9d659c640 1 -- 172.21.15.5:0/1502614516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56145d7ad1b0 msgr2=0x56145db6c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:42.825 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.816+0000 7fb9d659c640 1 --2- 172.21.15.5:0/1502614516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56145d7ad1b0 0x56145db6c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:42.825 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.816+0000 7fb9d659c640 1 -- 172.21.15.5:0/1502614516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56145d891620 con 0x56145d7842f0 2024-08-31T05:36:42.825 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.817+0000 7fb9d659c640 1 --2- 172.21.15.5:0/1502614516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56145d7842f0 0x56145db60ad0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc103050 tx=0x7fb9cc02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4406b9b31af9931e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:42.825 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.817+0000 7fb9bdffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:36:42.825 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.817+0000 7fb9bdffb640 1 -- 172.21.15.5:0/1502614516 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc049070 con 0x56145d7842f0 2024-08-31T05:36:42.825 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.817+0000 7fb9bdffb640 1 -- 172.21.15.5:0/1502614516 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fb9cc0cc1f0 con 0x56145d7842f0 2024-08-31T05:36:42.825 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.817+0000 7fb9e39c1740 1 -- 172.21.15.5:0/1502614516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9d001bbf0 con 0x56145d7842f0 2024-08-31T05:36:42.825 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.817+0000 7fb9bdffb640 1 -- 172.21.15.5:0/1502614516 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fb9cc0c7e50 con 0x56145d7842f0 2024-08-31T05:36:42.825 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.817+0000 7fb9e39c1740 10 client.17376 fetch_fsmap learned FSMap version 34 2024-08-31T05:36:42.825 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.817+0000 7fb9e39c1740 1 -- 172.21.15.5:0/1502614516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56145db6f730 con 0x56145d7842f0 2024-08-31T05:36:42.825 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.817+0000 7fb9bdffb640 1 -- 172.21.15.5:0/1502614516 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9d001bbf0 con 0x56145d7842f0 2024-08-31T05:36:42.826 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.817+0000 7fb9bdffb640 1 -- 172.21.15.5:0/1502614516 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fb9cc10b030 con 0x56145d7842f0 2024-08-31T05:36:42.826 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.817+0000 7fb9e39c1740 10 client.17376 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:36:42.826 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.817+0000 7fb9e39c1740 10 client.17376 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:36:42.826 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.817+0000 7fb9e39c1740 20 client.17376 populate_metadata read hostname 'smithi005' 2024-08-31T05:36:42.826 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.817+0000 7fb9e39c1740 1 --2- 172.21.15.5:0/1502614516 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56145d76bd80 0x56145db72cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:42.826 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.817+0000 7fb9e39c1740 4 client.17376 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:36:42.826 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.817+0000 7fb9e39c1740 1 -- 172.21.15.5:0/1502614516 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56145dac7f50 con 0x56145d76bd80 2024-08-31T05:36:42.826 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.818+0000 7fb9d5d9b640 1 --2- 172.21.15.5:0/1502614516 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56145d76bd80 0x56145db72cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:42.826 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.818+0000 7fb9d5d9b640 1 --2- 172.21.15.5:0/1502614516 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56145d76bd80 0x56145db72cc0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8884a2ad55ce007 server_cookie=a9d5605047f98285 in_seq=0 out_seq=0 2024-08-31T05:36:42.826 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.818+0000 7fb9bdffb640 10 client.17376 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:36:42.826 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.819+0000 7fb9bdffb640 1 -- 172.21.15.5:0/1502614516 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56145dac7f50 con 0x56145d76bd80 2024-08-31T05:36:42.826 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.819+0000 7fb9bdffb640 10 client.17376 handle_command_reply: tid=0 2024-08-31T05:36:42.826 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.819+0000 7fb9e39c1740 1 client.17376 shutdown 2024-08-31T05:36:42.826 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.819+0000 7fb9e39c1740 1 -- 172.21.15.5:0/1502614516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56145d7842f0 msgr2=0x56145db60ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:42.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.819+0000 7fb9e39c1740 1 --2- 172.21.15.5:0/1502614516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56145d7842f0 0x56145db60ad0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc103050 tx=0x7fb9cc02a410 comp rx=0 tx=0).stop 2024-08-31T05:36:42.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.819+0000 7fb9e39c1740 1 -- 172.21.15.5:0/1502614516 shutdown_connections 2024-08-31T05:36:42.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.819+0000 7fb9e39c1740 1 --2- 172.21.15.5:0/1502614516 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56145d76bd80 0x56145db72cc0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:42.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.819+0000 7fb9e39c1740 1 --2- 172.21.15.5:0/1502614516 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56145d7ad1b0 0x56145db6c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:42.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.819+0000 7fb9bdffb640 0 client.17376 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:36:42.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.819+0000 7fb9e39c1740 1 --2- 172.21.15.5:0/1502614516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56145d78c4d0 0x56145db61050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:42.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.819+0000 7fb9e39c1740 1 --2- 172.21.15.5:0/1502614516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56145d7842f0 0x56145db60ad0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:42.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.819+0000 7fb9e39c1740 1 -- 172.21.15.5:0/1502614516 >> 172.21.15.5:0/1502614516 conn(0x56145d7a1300 msgr2=0x56145db524b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:42.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.819+0000 7fb9e39c1740 1 -- 172.21.15.5:0/1502614516 shutdown_connections 2024-08-31T05:36:42.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.819+0000 7fb9e39c1740 1 -- 172.21.15.5:0/1502614516 wait complete. 2024-08-31T05:36:42.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.819+0000 7fb9e39c1740 20 client.17376 trim_cache size 0 max 16384 2024-08-31T05:36:42.837 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.834+0000 7fb9e39c1740 1 Processor -- start 2024-08-31T05:36:42.838 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.834+0000 7fb9e39c1740 1 -- start start 2024-08-31T05:36:42.838 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.834+0000 7fb9e39c1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56145d76bd80 0x56145db56090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:42.838 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.834+0000 7fb9e39c1740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56145d7842f0 0x56145db4db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:42.838 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.834+0000 7fb9e39c1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56145d78c4d0 0x56145db60da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:42.838 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.834+0000 7fb9e39c1740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b800ff50 con 0x56145d7842f0 2024-08-31T05:36:42.838 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.834+0000 7fb9e39c1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b8011a90 con 0x56145d78c4d0 2024-08-31T05:36:42.838 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.835+0000 7fb9e39c1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b8010620 con 0x56145d76bd80 2024-08-31T05:36:42.838 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.835+0000 7fb9d5d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56145d7842f0 0x56145db4db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:42.838 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.835+0000 7fb9d5d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56145d7842f0 0x56145db4db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47248/0 (socket says 172.21.15.5:47248) 2024-08-31T05:36:42.839 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.835+0000 7fb9d5d9b640 1 -- 172.21.15.5:0/4216545444 learned_addr learned my addr 172.21.15.5:0/4216545444 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:42.839 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.835+0000 7fb9d6d9d640 1 --2- 172.21.15.5:0/4216545444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56145d78c4d0 0x56145db60da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:42.839 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.835+0000 7fb9d659c640 1 --2- 172.21.15.5:0/4216545444 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56145d76bd80 0x56145db56090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:42.839 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.835+0000 7fb9d5d9b640 1 -- 172.21.15.5:0/4216545444 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56145d76bd80 msgr2=0x56145db56090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:42.839 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.835+0000 7fb9d5d9b640 1 --2- 172.21.15.5:0/4216545444 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56145d76bd80 0x56145db56090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:42.839 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.835+0000 7fb9d5d9b640 1 -- 172.21.15.5:0/4216545444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56145d78c4d0 msgr2=0x56145db60da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:42.839 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.835+0000 7fb9d5d9b640 1 --2- 172.21.15.5:0/4216545444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56145d78c4d0 0x56145db60da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:42.839 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.835+0000 7fb9d5d9b640 1 -- 172.21.15.5:0/4216545444 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56145db48800 con 0x56145d7842f0 2024-08-31T05:36:42.839 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.835+0000 7fb9d6d9d640 1 --2- 172.21.15.5:0/4216545444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56145d78c4d0 0x56145db60da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:36:42.839 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.835+0000 7fb9d5d9b640 1 --2- 172.21.15.5:0/4216545444 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56145d7842f0 0x56145db4db70 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8102970 tx=0x7fb9c8005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26303e37b9c90d03 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:42.839 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.835+0000 7fb9bffff640 1 -- 172.21.15.5:0/4216545444 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c800f8d0 con 0x56145d7842f0 2024-08-31T05:36:42.839 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.835+0000 7fb9bffff640 1 -- 172.21.15.5:0/4216545444 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9c8005020 con 0x56145d7842f0 2024-08-31T05:36:42.839 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.835+0000 7fb9bffff640 1 -- 172.21.15.5:0/4216545444 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c8004b20 con 0x56145d7842f0 2024-08-31T05:36:42.843 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.836+0000 7fb9e39c1740 1 -- 172.21.15.5:0/4216545444 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56145d7842f0 msgr2=0x56145db4db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:42.843 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.836+0000 7fb9e39c1740 1 --2- 172.21.15.5:0/4216545444 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56145d7842f0 0x56145db4db70 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8102970 tx=0x7fb9c8005f90 comp rx=0 tx=0).stop 2024-08-31T05:36:42.843 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.836+0000 7fb9e39c1740 1 -- 172.21.15.5:0/4216545444 shutdown_connections 2024-08-31T05:36:42.843 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.836+0000 7fb9e39c1740 1 --2- 172.21.15.5:0/4216545444 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56145d78c4d0 0x56145db60da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:42.843 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.836+0000 7fb9e39c1740 1 --2- 172.21.15.5:0/4216545444 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56145d7842f0 0x56145db4db70 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:42.843 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.836+0000 7fb9e39c1740 1 --2- 172.21.15.5:0/4216545444 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56145d76bd80 0x56145db56090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:42.843 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.836+0000 7fb9e39c1740 1 -- 172.21.15.5:0/4216545444 >> 172.21.15.5:0/4216545444 conn(0x56145d7a1300 msgr2=0x56145db55980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:42.844 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.836+0000 7fb9e39c1740 1 -- 172.21.15.5:0/4216545444 shutdown_connections 2024-08-31T05:36:42.844 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.836+0000 7fb9e39c1740 1 -- 172.21.15.5:0/4216545444 wait complete. 2024-08-31T05:36:42.844 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.837+0000 7fb9e39c1740 1 -- start start 2024-08-31T05:36:42.844 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.837+0000 7fb9e39c1740 1 Processor -- start 2024-08-31T05:36:42.844 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.837+0000 7fb9e39c1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56145d76bd80 0x56145db69210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:42.844 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.837+0000 7fb9e39c1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56145d7842f0 0x56145db78140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:42.844 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.837+0000 7fb9e39c1740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56145d78c4d0 0x56145db78790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:42.844 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.837+0000 7fb9e39c1740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b80113c0 con 0x56145d78c4d0 2024-08-31T05:36:42.844 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.837+0000 7fb9e39c1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b8010cf0 con 0x56145d7842f0 2024-08-31T05:36:42.844 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.837+0000 7fb9e39c1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b800df30 con 0x56145d76bd80 2024-08-31T05:36:42.844 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.837+0000 7fb9e39c1740 10 client.0 _ll_register_callbacks cb 0x7fb9cc005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:36:42.844 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.837+0000 7fb9d6d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56145d78c4d0 0x56145db78790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:42.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.837+0000 7fb9d6d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56145d78c4d0 0x56145db78790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47262/0 (socket says 172.21.15.5:47262) 2024-08-31T05:36:42.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.837+0000 7fb9d659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56145d76bd80 0x56145db69210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:42.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.837+0000 7fb9d6d9d640 1 -- 172.21.15.5:0/3166211620 learned_addr learned my addr 172.21.15.5:0/3166211620 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:42.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.837+0000 7fb9d5d9b640 1 --2- 172.21.15.5:0/3166211620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56145d7842f0 0x56145db78140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:42.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.837+0000 7fb9d6d9d640 1 -- 172.21.15.5:0/3166211620 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56145d76bd80 msgr2=0x56145db69210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:42.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.837+0000 7fb9d6d9d640 1 --2- 172.21.15.5:0/3166211620 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56145d76bd80 0x56145db69210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:42.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.837+0000 7fb9d6d9d640 1 -- 172.21.15.5:0/3166211620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56145d7842f0 msgr2=0x56145db78140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:42.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.838+0000 7fb9d6d9d640 1 --2- 172.21.15.5:0/3166211620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56145d7842f0 0x56145db78140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:42.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.838+0000 7fb9d6d9d640 1 -- 172.21.15.5:0/3166211620 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56145db518b0 con 0x56145d78c4d0 2024-08-31T05:36:42.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.838+0000 7fb9d6d9d640 1 --2- 172.21.15.5:0/3166211620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56145d78c4d0 0x56145db78790 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fb9d000e760 tx=0x7fb9d000efd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a607f440104f25d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:42.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.838+0000 7fb9bdffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:36:42.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.838+0000 7fb9bdffb640 1 -- 172.21.15.5:0/3166211620 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d0009820 con 0x56145d78c4d0 2024-08-31T05:36:42.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.838+0000 7fb9bdffb640 1 -- 172.21.15.5:0/3166211620 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fb9d001b540 con 0x56145d78c4d0 2024-08-31T05:36:42.846 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.838+0000 7fb9e39c1740 1 -- 172.21.15.5:0/3166211620 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9c8005020 con 0x56145d78c4d0 2024-08-31T05:36:42.846 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.838+0000 7fb9bdffb640 1 -- 172.21.15.5:0/3166211620 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fb9d0017020 con 0x56145d78c4d0 2024-08-31T05:36:42.846 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.838+0000 7fb9e39c1740 10 client.17382 fetch_fsmap learned FSMap version 34 2024-08-31T05:36:42.846 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.838+0000 7fb9e39c1740 1 -- 172.21.15.5:0/3166211620 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56145db68c10 con 0x56145d78c4d0 2024-08-31T05:36:42.846 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.838+0000 7fb9bdffb640 1 -- 172.21.15.5:0/3166211620 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9c8005020 con 0x56145d78c4d0 2024-08-31T05:36:42.846 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.838+0000 7fb9bdffb640 1 -- 172.21.15.5:0/3166211620 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fb9d0026600 con 0x56145d78c4d0 2024-08-31T05:36:42.846 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.838+0000 7fb9e39c1740 10 client.17382 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:36:42.846 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.838+0000 7fb9e39c1740 10 client.17382 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:36:42.846 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.839+0000 7fb9e39c1740 20 client.17382 populate_metadata read hostname 'smithi005' 2024-08-31T05:36:42.846 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.839+0000 7fb9e39c1740 1 --2- 172.21.15.5:0/3166211620 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56145d7ad1b0 0x56145dbdfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:42.846 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.839+0000 7fb9e39c1740 4 client.17382 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:36:42.846 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.839+0000 7fb9e39c1740 1 -- 172.21.15.5:0/3166211620 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56145dac39f0 con 0x56145d7ad1b0 2024-08-31T05:36:42.846 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.839+0000 7fb9d659c640 1 --2- 172.21.15.5:0/3166211620 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56145d7ad1b0 0x56145dbdfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:42.847 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.839+0000 7fb9bdffb640 10 client.17382 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:36:42.847 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.839+0000 7fb9d659c640 1 --2- 172.21.15.5:0/3166211620 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56145d7ad1b0 0x56145dbdfaf0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4cdf9805236dd5e5 server_cookie=6ef6d3d6e1c1fb37 in_seq=0 out_seq=0 2024-08-31T05:36:42.854 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.851+0000 7fb9bdffb640 1 -- 172.21.15.5:0/3166211620 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56145dac39f0 con 0x56145d7ad1b0 2024-08-31T05:36:42.854 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.851+0000 7fb9bdffb640 10 client.17382 handle_command_reply: tid=0 2024-08-31T05:36:42.854 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.851+0000 7fb9e39c1740 1 client.17382 shutdown 2024-08-31T05:36:42.854 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.851+0000 7fb9e39c1740 1 -- 172.21.15.5:0/3166211620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56145d78c4d0 msgr2=0x56145db78790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:42.854 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.851+0000 7fb9e39c1740 1 --2- 172.21.15.5:0/3166211620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56145d78c4d0 0x56145db78790 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fb9d000e760 tx=0x7fb9d000efd0 comp rx=0 tx=0).stop 2024-08-31T05:36:42.854 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.852+0000 7fb9e39c1740 1 -- 172.21.15.5:0/3166211620 shutdown_connections 2024-08-31T05:36:42.854 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.852+0000 7fb9e39c1740 1 --2- 172.21.15.5:0/3166211620 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56145d7ad1b0 0x56145dbdfaf0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:42.854 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.852+0000 7fb9bdffb640 0 client.17382 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:36:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.852+0000 7fb9e39c1740 1 --2- 172.21.15.5:0/3166211620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56145d78c4d0 0x56145db78790 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.852+0000 7fb9e39c1740 1 --2- 172.21.15.5:0/3166211620 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56145d7842f0 0x56145db78140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.852+0000 7fb9e39c1740 1 --2- 172.21.15.5:0/3166211620 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56145d76bd80 0x56145db69210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.852+0000 7fb9e39c1740 1 -- 172.21.15.5:0/3166211620 >> 172.21.15.5:0/3166211620 conn(0x56145d7a1300 msgr2=0x56145db4e260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.852+0000 7fb9e39c1740 1 -- 172.21.15.5:0/3166211620 shutdown_connections 2024-08-31T05:36:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.852+0000 7fb9e39c1740 1 -- 172.21.15.5:0/3166211620 wait complete. 2024-08-31T05:36:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.852+0000 7fb9e39c1740 20 client.17382 trim_cache size 0 max 16384 2024-08-31T05:36:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:36:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:36:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:36:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:36:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.852+0000 7fb9dca53640 1 -- 172.21.15.5:0/449134192 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb9c00b4d20 msgr2=0x7fb9c00b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.852+0000 7fb9dca53640 1 --2- 172.21.15.5:0/449134192 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb9c00b4d20 0x7fb9c00b7230 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0023000 tx=0x7fb9d0024000 comp rx=0 tx=0).stop 2024-08-31T05:36:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.852+0000 7fb9dca53640 1 -- 172.21.15.5:0/449134192 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9d8103870 msgr2=0x7fb9d819a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.852+0000 7fb9dca53640 1 --2- 172.21.15.5:0/449134192 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9d8103870 0x7fb9d819a290 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc02aa00 tx=0x7fb9cc003b90 comp rx=0 tx=0).stop 2024-08-31T05:36:42.857 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.852+0000 7fb9dca53640 1 -- 172.21.15.5:0/449134192 shutdown_connections 2024-08-31T05:36:42.857 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.852+0000 7fb9dca53640 1 --2- 172.21.15.5:0/449134192 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb9c00b4d20 0x7fb9c00b7230 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:42.857 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.852+0000 7fb9dca53640 1 --2- 172.21.15.5:0/449134192 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9d8109af0 0x7fb9d819fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:42.857 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.852+0000 7fb9dca53640 1 --2- 172.21.15.5:0/449134192 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9d81091a0 0x7fb9d819a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:42.857 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.852+0000 7fb9dca53640 1 --2- 172.21.15.5:0/449134192 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9d8103870 0x7fb9d819a290 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:42.857 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.853+0000 7fb9dca53640 1 -- 172.21.15.5:0/449134192 >> 172.21.15.5:0/449134192 conn(0x7fb9d80ff270 msgr2=0x7fb9d8108810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:42.857 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.853+0000 7fb9dca53640 1 -- 172.21.15.5:0/449134192 shutdown_connections 2024-08-31T05:36:42.857 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:42.853+0000 7fb9dca53640 1 -- 172.21.15.5:0/449134192 wait complete. 2024-08-31T05:36:42.925 INFO:tasks.workunit.client.0.smithi005.stdout: 1 753652 11.64 MB/sec execute 210 sec latency 20.456 ms 2024-08-31T05:36:43.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:43 smithi070 ceph-mon[22316]: pgmap v547: 129 pgs: 129 active+clean; 399 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.1 MiB/s wr, 195 op/s 2024-08-31T05:36:43.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:43 smithi050 ceph-mon[22146]: pgmap v547: 129 pgs: 129 active+clean; 399 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.1 MiB/s wr, 195 op/s 2024-08-31T05:36:43.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:43 smithi005 ceph-mon[18602]: pgmap v547: 129 pgs: 129 active+clean; 399 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.1 MiB/s wr, 195 op/s 2024-08-31T05:36:43.925 INFO:tasks.workunit.client.0.smithi005.stdout: 1 756319 11.67 MB/sec execute 211 sec latency 15.302 ms 2024-08-31T05:36:44.925 INFO:tasks.workunit.client.0.smithi005.stdout: 1 757926 11.64 MB/sec execute 212 sec latency 18.653 ms 2024-08-31T05:36:45.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:45 smithi070 ceph-mon[22316]: pgmap v548: 129 pgs: 129 active+clean; 399 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.2 MiB/s wr, 199 op/s 2024-08-31T05:36:45.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:45 smithi050 ceph-mon[22146]: pgmap v548: 129 pgs: 129 active+clean; 399 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.2 MiB/s wr, 199 op/s 2024-08-31T05:36:45.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:45 smithi005 ceph-mon[18602]: pgmap v548: 129 pgs: 129 active+clean; 399 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.2 MiB/s wr, 199 op/s 2024-08-31T05:36:45.925 INFO:tasks.workunit.client.0.smithi005.stdout: 1 760369 11.65 MB/sec execute 213 sec latency 15.648 ms 2024-08-31T05:36:46.925 INFO:tasks.workunit.client.0.smithi005.stdout: 1 761645 11.63 MB/sec execute 214 sec latency 116.428 ms 2024-08-31T05:36:47.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:47 smithi070 ceph-mon[22316]: pgmap v549: 129 pgs: 129 active+clean; 404 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.9 MiB/s wr, 231 op/s 2024-08-31T05:36:47.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:47 smithi050 ceph-mon[22146]: pgmap v549: 129 pgs: 129 active+clean; 404 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.9 MiB/s wr, 231 op/s 2024-08-31T05:36:47.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:47 smithi005 ceph-mon[18602]: pgmap v549: 129 pgs: 129 active+clean; 404 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.9 MiB/s wr, 231 op/s 2024-08-31T05:36:47.925 INFO:tasks.workunit.client.0.smithi005.stdout: 1 764029 11.64 MB/sec execute 215 sec latency 16.399 ms 2024-08-31T05:36:48.925 INFO:tasks.workunit.client.0.smithi005.stdout: 1 766186 11.63 MB/sec execute 216 sec latency 28.762 ms 2024-08-31T05:36:49.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:49 smithi070 ceph-mon[22316]: pgmap v550: 129 pgs: 129 active+clean; 408 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.3 MiB/s wr, 205 op/s 2024-08-31T05:36:49.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:49 smithi050 ceph-mon[22146]: pgmap v550: 129 pgs: 129 active+clean; 408 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.3 MiB/s wr, 205 op/s 2024-08-31T05:36:49.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:49 smithi005 ceph-mon[18602]: pgmap v550: 129 pgs: 129 active+clean; 408 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.3 MiB/s wr, 205 op/s 2024-08-31T05:36:49.925 INFO:tasks.workunit.client.0.smithi005.stdout: 1 768346 11.64 MB/sec execute 217 sec latency 18.444 ms 2024-08-31T05:36:50.925 INFO:tasks.workunit.client.0.smithi005.stdout: 1 770622 11.64 MB/sec execute 218 sec latency 57.987 ms 2024-08-31T05:36:51.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:51 smithi070 ceph-mon[22316]: pgmap v551: 129 pgs: 129 active+clean; 414 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.4 MiB/s wr, 276 op/s 2024-08-31T05:36:51.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:51 smithi050 ceph-mon[22146]: pgmap v551: 129 pgs: 129 active+clean; 414 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.4 MiB/s wr, 276 op/s 2024-08-31T05:36:51.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:51 smithi005 ceph-mon[18602]: pgmap v551: 129 pgs: 129 active+clean; 414 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.4 MiB/s wr, 276 op/s 2024-08-31T05:36:51.925 INFO:tasks.workunit.client.0.smithi005.stdout: 1 771934 11.62 MB/sec execute 219 sec latency 57.901 ms 2024-08-31T05:36:52.925 INFO:tasks.workunit.client.0.smithi005.stdout: 1 774368 11.63 MB/sec execute 220 sec latency 16.250 ms 2024-08-31T05:36:53.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:53 smithi070 ceph-mon[22316]: pgmap v552: 129 pgs: 129 active+clean; 414 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.2 MiB/s wr, 195 op/s 2024-08-31T05:36:53.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:53 smithi050 ceph-mon[22146]: pgmap v552: 129 pgs: 129 active+clean; 414 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.2 MiB/s wr, 195 op/s 2024-08-31T05:36:53.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:53 smithi005 ceph-mon[18602]: pgmap v552: 129 pgs: 129 active+clean; 414 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.2 MiB/s wr, 195 op/s 2024-08-31T05:36:53.925 INFO:tasks.workunit.client.0.smithi005.stdout: 1 776190 11.60 MB/sec execute 221 sec latency 30.632 ms 2024-08-31T05:36:54.925 INFO:tasks.workunit.client.0.smithi005.stdout: 1 778328 11.61 MB/sec execute 222 sec latency 17.636 ms 2024-08-31T05:36:55.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:55 smithi070 ceph-mon[22316]: pgmap v553: 129 pgs: 129 active+clean; 415 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.3 MiB/s wr, 202 op/s 2024-08-31T05:36:55.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:55 smithi050 ceph-mon[22146]: pgmap v553: 129 pgs: 129 active+clean; 415 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.3 MiB/s wr, 202 op/s 2024-08-31T05:36:55.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:55 smithi005 ceph-mon[18602]: pgmap v553: 129 pgs: 129 active+clean; 415 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.3 MiB/s wr, 202 op/s 2024-08-31T05:36:55.928 INFO:tasks.workunit.client.0.smithi005.stdout: 1 780890 11.63 MB/sec execute 223 sec latency 15.262 ms 2024-08-31T05:36:55.954 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.952+0000 7fdafc453640 1 -- 172.21.15.5:0/858883717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaf41045a0 msgr2=0x7fdaf41049b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:55.954 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.952+0000 7fdafc453640 1 --2- 172.21.15.5:0/858883717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaf41045a0 0x7fdaf41049b0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fdae4009ca0 tx=0x7fdae402a8c0 comp rx=0 tx=0).stop 2024-08-31T05:36:55.955 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.952+0000 7fdafc453640 1 -- 172.21.15.5:0/858883717 shutdown_connections 2024-08-31T05:36:55.955 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.952+0000 7fdafc453640 1 --2- 172.21.15.5:0/858883717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdaf410db50 0x7fdaf4110060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:55.955 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.952+0000 7fdafc453640 1 --2- 172.21.15.5:0/858883717 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdaf4104fd0 0x7fdaf410d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:55.955 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.952+0000 7fdafc453640 1 --2- 172.21.15.5:0/858883717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaf41045a0 0x7fdaf41049b0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:55.955 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.952+0000 7fdafc453640 1 -- 172.21.15.5:0/858883717 >> 172.21.15.5:0/858883717 conn(0x7fdaf40fe1b0 msgr2=0x7fdaf4100600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:55.955 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.952+0000 7fdafc453640 1 -- 172.21.15.5:0/858883717 shutdown_connections 2024-08-31T05:36:55.955 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.952+0000 7fdafc453640 1 -- 172.21.15.5:0/858883717 wait complete. 2024-08-31T05:36:55.957 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.953+0000 7fdafc453640 1 Processor -- start 2024-08-31T05:36:55.957 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.953+0000 7fdafc453640 1 -- start start 2024-08-31T05:36:55.957 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.953+0000 7fdafc453640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdaf41045a0 0x7fdaf419a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:55.957 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.953+0000 7fdafc453640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaf4104fd0 0x7fdaf419a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:55.957 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.953+0000 7fdafc453640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdaf410db50 0x7fdaf419fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:55.957 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.953+0000 7fdafc453640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf4113800 con 0x7fdaf4104fd0 2024-08-31T05:36:55.958 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.953+0000 7fdafc453640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf4113680 con 0x7fdaf41045a0 2024-08-31T05:36:55.958 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.953+0000 7fdafc453640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf4113980 con 0x7fdaf410db50 2024-08-31T05:36:55.958 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.953+0000 7fdaf99ee640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaf4104fd0 0x7fdaf419a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:55.958 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.953+0000 7fdaf99ee640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaf4104fd0 0x7fdaf419a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38050/0 (socket says 172.21.15.5:38050) 2024-08-31T05:36:55.958 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.953+0000 7fdaf99ee640 1 -- 172.21.15.5:0/1909077634 learned_addr learned my addr 172.21.15.5:0/1909077634 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:55.958 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.953+0000 7fdafa1ef640 1 --2- 172.21.15.5:0/1909077634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdaf41045a0 0x7fdaf419a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:55.958 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.953+0000 7fdafa9f0640 1 --2- 172.21.15.5:0/1909077634 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdaf410db50 0x7fdaf419fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:55.958 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.954+0000 7fdaf99ee640 1 -- 172.21.15.5:0/1909077634 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdaf410db50 msgr2=0x7fdaf419fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:55.958 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.954+0000 7fdaf99ee640 1 --2- 172.21.15.5:0/1909077634 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdaf410db50 0x7fdaf419fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:55.958 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.954+0000 7fdaf99ee640 1 -- 172.21.15.5:0/1909077634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdaf41045a0 msgr2=0x7fdaf419a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:55.958 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.954+0000 7fdaf99ee640 1 --2- 172.21.15.5:0/1909077634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdaf41045a0 0x7fdaf419a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:55.958 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.954+0000 7fdaf99ee640 1 -- 172.21.15.5:0/1909077634 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaf41a0250 con 0x7fdaf4104fd0 2024-08-31T05:36:55.958 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.954+0000 7fdaf99ee640 1 --2- 172.21.15.5:0/1909077634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaf4104fd0 0x7fdaf419a8c0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fdae800e9c0 tx=0x7fdae800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:55.959 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.954+0000 7fdaf37fe640 1 -- 172.21.15.5:0/1909077634 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae800ccc0 con 0x7fdaf4104fd0 2024-08-31T05:36:55.959 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.954+0000 7fdafc453640 1 -- 172.21.15.5:0/1909077634 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaf41a0540 con 0x7fdaf4104fd0 2024-08-31T05:36:55.959 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.954+0000 7fdaf37fe640 1 -- 172.21.15.5:0/1909077634 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdae80054d0 con 0x7fdaf4104fd0 2024-08-31T05:36:55.959 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.954+0000 7fdaf37fe640 1 -- 172.21.15.5:0/1909077634 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae8010430 con 0x7fdaf4104fd0 2024-08-31T05:36:55.959 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.954+0000 7fdafc453640 1 -- 172.21.15.5:0/1909077634 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaf41a6cd0 con 0x7fdaf4104fd0 2024-08-31T05:36:55.965 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.957+0000 7fdb033c3740 1 Processor -- start 2024-08-31T05:36:55.965 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.957+0000 7fdb033c3740 1 -- start start 2024-08-31T05:36:55.965 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.957+0000 7fdaf37fe640 1 -- 172.21.15.5:0/1909077634 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fdae8005020 con 0x7fdaf4104fd0 2024-08-31T05:36:55.965 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.957+0000 7fdb033c3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ef064fe1b0 0x55ef068a1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:55.965 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.957+0000 7fdb033c3740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ef064d52f0 0x55ef068a2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:55.965 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.957+0000 7fdb033c3740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ef064dd4d0 0x55ef068a2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:55.965 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.957+0000 7fdb033c3740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55ef06817000 con 0x55ef064d52f0 2024-08-31T05:36:55.965 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.957+0000 7fdb033c3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ef06806590 con 0x55ef064fe1b0 2024-08-31T05:36:55.965 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.957+0000 7fdb033c3740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ef0680a540 con 0x55ef064dd4d0 2024-08-31T05:36:55.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.957+0000 7fdafa9f0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ef064fe1b0 0x55ef068a1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:55.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.957+0000 7fdafa1ef640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ef064d52f0 0x55ef068a2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:55.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.958+0000 7fdafa9f0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ef064fe1b0 0x55ef068a1ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:34950/0 (socket says 172.21.15.5:34950) 2024-08-31T05:36:55.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.958+0000 7fdafa9f0640 1 -- 172.21.15.5:0/1907916416 learned_addr learned my addr 172.21.15.5:0/1907916416 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:55.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.958+0000 7fdaf99ee640 1 --2- 172.21.15.5:0/1907916416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ef064dd4d0 0x55ef068a2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:55.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.958+0000 7fdafa9f0640 1 -- 172.21.15.5:0/1907916416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ef064dd4d0 msgr2=0x55ef068a2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:55.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.958+0000 7fdafa9f0640 1 --2- 172.21.15.5:0/1907916416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ef064dd4d0 0x55ef068a2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:55.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.958+0000 7fdafa9f0640 1 -- 172.21.15.5:0/1907916416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ef064d52f0 msgr2=0x55ef068a2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:55.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.958+0000 7fdafa9f0640 1 --2- 172.21.15.5:0/1907916416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ef064d52f0 0x55ef068a2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:55.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.958+0000 7fdafa9f0640 1 -- 172.21.15.5:0/1907916416 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef06569790 con 0x55ef064fe1b0 2024-08-31T05:36:55.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.958+0000 7fdaf37fe640 1 --2- 172.21.15.5:0/1909077634 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fdadc0b4ca0 0x7fdadc0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:55.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.958+0000 7fdafa9f0640 1 --2- 172.21.15.5:0/1907916416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ef064fe1b0 0x55ef068a1ce0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdaec009c50 tx=0x7fdaec011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c517e97bb5670adb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:55.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.958+0000 7fdafa1ef640 1 --2- 172.21.15.5:0/1909077634 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fdadc0b4ca0 0x7fdadc0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:55.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.958+0000 7fdaf37fe640 1 -- 172.21.15.5:0/1909077634 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fdae80e5c20 con 0x7fdaf4104fd0 2024-08-31T05:36:55.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.958+0000 7fdaf0bfe640 1 -- 172.21.15.5:0/1907916416 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaec01e070 con 0x55ef064fe1b0 2024-08-31T05:36:55.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.958+0000 7fdaf0bfe640 1 -- 172.21.15.5:0/1907916416 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdaec019ae0 con 0x55ef064fe1b0 2024-08-31T05:36:55.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.958+0000 7fdaf0bfe640 1 -- 172.21.15.5:0/1907916416 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaec00e9f0 con 0x55ef064fe1b0 2024-08-31T05:36:55.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.959+0000 7fdb033c3740 1 -- 172.21.15.5:0/1907916416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ef064fe1b0 msgr2=0x55ef068a1ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:55.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.959+0000 7fdb033c3740 1 --2- 172.21.15.5:0/1907916416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ef064fe1b0 0x55ef068a1ce0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdaec009c50 tx=0x7fdaec011810 comp rx=0 tx=0).stop 2024-08-31T05:36:55.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.959+0000 7fdafa1ef640 1 --2- 172.21.15.5:0/1909077634 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fdadc0b4ca0 0x7fdadc0b71b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x55ef068a0960 tx=0x7fdae4009360 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:55.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.959+0000 7fdb033c3740 1 -- 172.21.15.5:0/1907916416 shutdown_connections 2024-08-31T05:36:55.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.959+0000 7fdb033c3740 1 --2- 172.21.15.5:0/1907916416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ef064dd4d0 0x55ef068a2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:55.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.959+0000 7fdb033c3740 1 --2- 172.21.15.5:0/1907916416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ef064d52f0 0x55ef068a2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:55.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.959+0000 7fdb033c3740 1 --2- 172.21.15.5:0/1907916416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ef064fe1b0 0x55ef068a1ce0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:55.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.959+0000 7fdb033c3740 1 -- 172.21.15.5:0/1907916416 >> 172.21.15.5:0/1907916416 conn(0x55ef064f2300 msgr2=0x55ef0689fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:55.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.959+0000 7fdb033c3740 1 -- 172.21.15.5:0/1907916416 shutdown_connections 2024-08-31T05:36:55.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.959+0000 7fdb033c3740 1 -- 172.21.15.5:0/1907916416 wait complete. 2024-08-31T05:36:55.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.960+0000 7fdb033c3740 1 -- start start 2024-08-31T05:36:55.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.960+0000 7fdb033c3740 1 Processor -- start 2024-08-31T05:36:55.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.960+0000 7fdb033c3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ef064d52f0 0x55ef068ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:55.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.960+0000 7fdb033c3740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ef064dd4d0 0x55ef068ade70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:55.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.960+0000 7fdb033c3740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ef064fe1b0 0x55ef068b97b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:55.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.960+0000 7fdb033c3740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55ef0673fab0 con 0x55ef064fe1b0 2024-08-31T05:36:55.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.960+0000 7fdb033c3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ef0678d680 con 0x55ef064d52f0 2024-08-31T05:36:55.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.960+0000 7fdb033c3740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ef068b0460 con 0x55ef064dd4d0 2024-08-31T05:36:55.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.960+0000 7fdb033c3740 10 client.0 _ll_register_callbacks cb 0x55ef06515a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:36:55.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.960+0000 7fdafa9f0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ef064fe1b0 0x55ef068b97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:55.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.960+0000 7fdaf99ee640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ef064dd4d0 0x55ef068ade70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:55.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.960+0000 7fdafa9f0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ef064fe1b0 0x55ef068b97b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38054/0 (socket says 172.21.15.5:38054) 2024-08-31T05:36:55.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.960+0000 7fdaf99ee640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ef064dd4d0 0x55ef068ade70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:44826/0 (socket says 172.21.15.5:44826) 2024-08-31T05:36:55.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.960+0000 7fdafa1ef640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ef064d52f0 0x55ef068ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:55.969 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.960+0000 7fdafa9f0640 1 -- 172.21.15.5:0/1978293096 learned_addr learned my addr 172.21.15.5:0/1978293096 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:55.969 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.961+0000 7fdafa9f0640 1 -- 172.21.15.5:0/1978293096 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ef064dd4d0 msgr2=0x55ef068ade70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:55.969 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.961+0000 7fdafa9f0640 1 --2- 172.21.15.5:0/1978293096 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ef064dd4d0 0x55ef068ade70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:55.969 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.961+0000 7fdafa9f0640 1 -- 172.21.15.5:0/1978293096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ef064d52f0 msgr2=0x55ef068ad8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:55.969 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.961+0000 7fdafa9f0640 1 --2- 172.21.15.5:0/1978293096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ef064d52f0 0x55ef068ad8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:55.969 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.961+0000 7fdafa9f0640 1 -- 172.21.15.5:0/1978293096 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef065e2620 con 0x55ef064fe1b0 2024-08-31T05:36:55.969 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.961+0000 7fdaf99ee640 1 --2- 172.21.15.5:0/1978293096 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ef064dd4d0 0x55ef068ade70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:36:55.969 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.961+0000 7fdafa9f0640 1 --2- 172.21.15.5:0/1978293096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ef064fe1b0 0x55ef068b97b0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fdaec000c00 tx=0x7fdaec009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9b0a271b03268ae server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:55.969 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.961+0000 7fdad9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:36:55.969 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.961+0000 7fdad9ffb640 1 -- 172.21.15.5:0/1978293096 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaec027070 con 0x55ef064fe1b0 2024-08-31T05:36:55.969 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.961+0000 7fdad9ffb640 1 -- 172.21.15.5:0/1978293096 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fdaec019840 con 0x55ef064fe1b0 2024-08-31T05:36:55.969 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.961+0000 7fdb033c3740 1 -- 172.21.15.5:0/1978293096 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdaec019ae0 con 0x55ef064fe1b0 2024-08-31T05:36:55.970 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.961+0000 7fdad9ffb640 1 -- 172.21.15.5:0/1978293096 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fdaec032050 con 0x55ef064fe1b0 2024-08-31T05:36:55.970 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.961+0000 7fdb033c3740 10 client.17394 fetch_fsmap learned FSMap version 34 2024-08-31T05:36:55.970 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.961+0000 7fdb033c3740 1 -- 172.21.15.5:0/1978293096 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55ef068bc530 con 0x55ef064fe1b0 2024-08-31T05:36:55.970 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.961+0000 7fdad9ffb640 1 -- 172.21.15.5:0/1978293096 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdaec019ae0 con 0x55ef064fe1b0 2024-08-31T05:36:55.970 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.962+0000 7fdad9ffb640 1 -- 172.21.15.5:0/1978293096 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fdaec004b00 con 0x55ef064fe1b0 2024-08-31T05:36:55.970 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.962+0000 7fdb033c3740 10 client.17394 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:36:55.970 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.962+0000 7fdb033c3740 10 client.17394 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:36:55.970 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.962+0000 7fdb033c3740 20 client.17394 populate_metadata read hostname 'smithi005' 2024-08-31T05:36:55.970 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.962+0000 7fdb033c3740 1 --2- 172.21.15.5:0/1978293096 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55ef064bcd80 0x55ef068bf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:55.970 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.962+0000 7fdb033c3740 4 client.17394 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:36:55.970 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.962+0000 7fdb033c3740 1 -- 172.21.15.5:0/1978293096 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ef06818f50 con 0x55ef064bcd80 2024-08-31T05:36:55.970 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.962+0000 7fdafa1ef640 1 --2- 172.21.15.5:0/1978293096 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55ef064bcd80 0x55ef068bf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:55.970 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.962+0000 7fdad9ffb640 10 client.17394 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:36:55.970 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.962+0000 7fdafa1ef640 1 --2- 172.21.15.5:0/1978293096 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55ef064bcd80 0x55ef068bf8f0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a3b8208e8c08af0 server_cookie=b9e28ef62aa8429e in_seq=0 out_seq=0 2024-08-31T05:36:55.971 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.963+0000 7fdad9ffb640 1 -- 172.21.15.5:0/1978293096 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ef06818f50 con 0x55ef064bcd80 2024-08-31T05:36:55.972 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.963+0000 7fdad9ffb640 10 client.17394 handle_command_reply: tid=0 2024-08-31T05:36:55.972 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.963+0000 7fdb033c3740 1 client.17394 shutdown 2024-08-31T05:36:55.972 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.964+0000 7fdb033c3740 1 -- 172.21.15.5:0/1978293096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ef064fe1b0 msgr2=0x55ef068b97b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:55.972 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.964+0000 7fdb033c3740 1 --2- 172.21.15.5:0/1978293096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ef064fe1b0 0x55ef068b97b0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fdaec000c00 tx=0x7fdaec009ec0 comp rx=0 tx=0).stop 2024-08-31T05:36:55.972 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.964+0000 7fdb033c3740 1 -- 172.21.15.5:0/1978293096 shutdown_connections 2024-08-31T05:36:55.972 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.964+0000 7fdb033c3740 1 --2- 172.21.15.5:0/1978293096 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55ef064bcd80 0x55ef068bf8f0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:55.972 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.964+0000 7fdb033c3740 1 --2- 172.21.15.5:0/1978293096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ef064fe1b0 0x55ef068b97b0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:55.972 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.964+0000 7fdb033c3740 1 --2- 172.21.15.5:0/1978293096 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ef064dd4d0 0x55ef068ade70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:55.972 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.964+0000 7fdad9ffb640 0 client.17394 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:36:55.972 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.964+0000 7fdb033c3740 1 --2- 172.21.15.5:0/1978293096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ef064d52f0 0x55ef068ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:55.972 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.964+0000 7fdb033c3740 1 -- 172.21.15.5:0/1978293096 >> 172.21.15.5:0/1978293096 conn(0x55ef064f2300 msgr2=0x55ef068a2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:55.972 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.964+0000 7fdb033c3740 1 -- 172.21.15.5:0/1978293096 shutdown_connections 2024-08-31T05:36:55.973 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.964+0000 7fdb033c3740 1 -- 172.21.15.5:0/1978293096 wait complete. 2024-08-31T05:36:55.973 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.964+0000 7fdb033c3740 20 client.17394 trim_cache size 0 max 16384 2024-08-31T05:36:55.982 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.978+0000 7fdb033c3740 1 Processor -- start 2024-08-31T05:36:55.982 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.979+0000 7fdb033c3740 1 -- start start 2024-08-31T05:36:55.982 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.979+0000 7fdb033c3740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ef064d52f0 0x55ef068a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:55.982 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.979+0000 7fdb033c3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ef064dd4d0 0x55ef068a8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:55.982 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.979+0000 7fdb033c3740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ef064fe1b0 0x55ef068a7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:55.982 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.979+0000 7fdb033c3740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf41b0ce0 con 0x55ef064fe1b0 2024-08-31T05:36:55.982 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.979+0000 7fdb033c3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf41b2820 con 0x55ef064dd4d0 2024-08-31T05:36:55.982 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.979+0000 7fdb033c3740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf41b13b0 con 0x55ef064d52f0 2024-08-31T05:36:55.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.979+0000 7fdafa9f0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ef064fe1b0 0x55ef068a7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:55.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.979+0000 7fdafa1ef640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ef064d52f0 0x55ef068a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:55.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.979+0000 7fdafa9f0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ef064fe1b0 0x55ef068a7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38068/0 (socket says 172.21.15.5:38068) 2024-08-31T05:36:55.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.979+0000 7fdafa9f0640 1 -- 172.21.15.5:0/1333190681 learned_addr learned my addr 172.21.15.5:0/1333190681 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:55.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.979+0000 7fdaf99ee640 1 --2- 172.21.15.5:0/1333190681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ef064dd4d0 0x55ef068a8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:55.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.979+0000 7fdafa9f0640 1 -- 172.21.15.5:0/1333190681 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ef064d52f0 msgr2=0x55ef068a36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:55.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.979+0000 7fdafa9f0640 1 --2- 172.21.15.5:0/1333190681 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ef064d52f0 0x55ef068a36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:55.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.979+0000 7fdafa9f0640 1 -- 172.21.15.5:0/1333190681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ef064dd4d0 msgr2=0x55ef068a8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:55.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.979+0000 7fdafa9f0640 1 --2- 172.21.15.5:0/1333190681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ef064dd4d0 0x55ef068a8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:55.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.979+0000 7fdafa9f0640 1 -- 172.21.15.5:0/1333190681 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef068a3fe0 con 0x55ef064fe1b0 2024-08-31T05:36:55.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.979+0000 7fdaf99ee640 1 --2- 172.21.15.5:0/1333190681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ef064dd4d0 0x55ef068a8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:36:55.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.980+0000 7fdafa9f0640 1 --2- 172.21.15.5:0/1333190681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ef064fe1b0 0x55ef068a7db0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fdaec004f00 tx=0x7fdaec009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bee36ef70f898b0a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:55.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.980+0000 7fdadbfff640 1 -- 172.21.15.5:0/1333190681 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaec027070 con 0x55ef064fe1b0 2024-08-31T05:36:55.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.980+0000 7fdadbfff640 1 -- 172.21.15.5:0/1333190681 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdaec0054f0 con 0x55ef064fe1b0 2024-08-31T05:36:55.984 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.980+0000 7fdadbfff640 1 -- 172.21.15.5:0/1333190681 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaec01e040 con 0x55ef064fe1b0 2024-08-31T05:36:55.987 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.981+0000 7fdb033c3740 1 -- 172.21.15.5:0/1333190681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ef064fe1b0 msgr2=0x55ef068a7db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:55.987 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.981+0000 7fdb033c3740 1 --2- 172.21.15.5:0/1333190681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ef064fe1b0 0x55ef068a7db0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fdaec004f00 tx=0x7fdaec009f30 comp rx=0 tx=0).stop 2024-08-31T05:36:55.987 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.981+0000 7fdb033c3740 1 -- 172.21.15.5:0/1333190681 shutdown_connections 2024-08-31T05:36:55.987 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.981+0000 7fdb033c3740 1 --2- 172.21.15.5:0/1333190681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ef064fe1b0 0x55ef068a7db0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:55.987 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.981+0000 7fdb033c3740 1 --2- 172.21.15.5:0/1333190681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ef064dd4d0 0x55ef068a8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:55.987 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.981+0000 7fdb033c3740 1 --2- 172.21.15.5:0/1333190681 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ef064d52f0 0x55ef068a36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:55.987 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.981+0000 7fdb033c3740 1 -- 172.21.15.5:0/1333190681 >> 172.21.15.5:0/1333190681 conn(0x55ef064f2300 msgr2=0x55ef068aec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:55.987 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.981+0000 7fdb033c3740 1 -- 172.21.15.5:0/1333190681 shutdown_connections 2024-08-31T05:36:55.987 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.981+0000 7fdb033c3740 1 -- 172.21.15.5:0/1333190681 wait complete. 2024-08-31T05:36:55.987 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.981+0000 7fdb033c3740 1 -- start start 2024-08-31T05:36:55.987 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.981+0000 7fdb033c3740 1 Processor -- start 2024-08-31T05:36:55.987 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.981+0000 7fdb033c3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ef064d52f0 0x55ef068b0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:55.987 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.981+0000 7fdb033c3740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ef064dd4d0 0x55ef068b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:55.988 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.981+0000 7fdb033c3740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ef064fe1b0 0x55ef06928170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:55.988 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.981+0000 7fdb033c3740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf41b2150 con 0x55ef064fe1b0 2024-08-31T05:36:55.988 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.981+0000 7fdb033c3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf41b1a80 con 0x55ef064d52f0 2024-08-31T05:36:55.988 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.981+0000 7fdb033c3740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf41aecc0 con 0x55ef064dd4d0 2024-08-31T05:36:55.988 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.982+0000 7fdb033c3740 10 client.0 _ll_register_callbacks cb 0x7fdaec01c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:36:55.988 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.982+0000 7fdafa9f0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ef064fe1b0 0x55ef06928170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:55.988 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.982+0000 7fdafa9f0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ef064fe1b0 0x55ef06928170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38078/0 (socket says 172.21.15.5:38078) 2024-08-31T05:36:55.988 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.982+0000 7fdafa9f0640 1 -- 172.21.15.5:0/1188009685 learned_addr learned my addr 172.21.15.5:0/1188009685 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:36:55.988 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.982+0000 7fdaf99ee640 1 --2- 172.21.15.5:0/1188009685 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ef064dd4d0 0x55ef068b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:55.988 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.982+0000 7fdafa1ef640 1 --2- 172.21.15.5:0/1188009685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ef064d52f0 0x55ef068b0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:55.988 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.982+0000 7fdafa9f0640 1 -- 172.21.15.5:0/1188009685 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ef064dd4d0 msgr2=0x55ef068b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:55.988 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.982+0000 7fdafa9f0640 1 --2- 172.21.15.5:0/1188009685 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ef064dd4d0 0x55ef068b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:55.988 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.982+0000 7fdafa9f0640 1 -- 172.21.15.5:0/1188009685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ef064d52f0 msgr2=0x55ef068b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:36:55.988 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.982+0000 7fdafa9f0640 1 --2- 172.21.15.5:0/1188009685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ef064d52f0 0x55ef068b0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:55.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.982+0000 7fdafa9f0640 1 -- 172.21.15.5:0/1188009685 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef069286b0 con 0x55ef064fe1b0 2024-08-31T05:36:55.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.982+0000 7fdafa9f0640 1 --2- 172.21.15.5:0/1188009685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ef064fe1b0 0x55ef06928170 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fdaec000c00 tx=0x7fdaec005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a1ed562f41d0cb7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:36:55.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.982+0000 7fdad9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:36:55.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.982+0000 7fdad9ffb640 1 -- 172.21.15.5:0/1188009685 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaec027070 con 0x55ef064fe1b0 2024-08-31T05:36:55.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.982+0000 7fdad9ffb640 1 -- 172.21.15.5:0/1188009685 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7fdaec00ec80 con 0x55ef064fe1b0 2024-08-31T05:36:55.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.982+0000 7fdb033c3740 1 -- 172.21.15.5:0/1188009685 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdaec0054f0 con 0x55ef064fe1b0 2024-08-31T05:36:55.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.982+0000 7fdad9ffb640 1 -- 172.21.15.5:0/1188009685 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fdaec046050 con 0x55ef064fe1b0 2024-08-31T05:36:55.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.982+0000 7fdb033c3740 10 client.17400 fetch_fsmap learned FSMap version 34 2024-08-31T05:36:55.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.982+0000 7fdb033c3740 1 -- 172.21.15.5:0/1188009685 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55ef06929780 con 0x55ef064fe1b0 2024-08-31T05:36:55.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.983+0000 7fdad9ffb640 1 -- 172.21.15.5:0/1188009685 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdaec0054f0 con 0x55ef064fe1b0 2024-08-31T05:36:55.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.983+0000 7fdad9ffb640 1 -- 172.21.15.5:0/1188009685 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fdaec019be0 con 0x55ef064fe1b0 2024-08-31T05:36:55.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.983+0000 7fdb033c3740 10 client.17400 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:36:55.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.983+0000 7fdb033c3740 10 client.17400 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:36:55.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.983+0000 7fdb033c3740 20 client.17400 populate_metadata read hostname 'smithi005' 2024-08-31T05:36:55.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.983+0000 7fdb033c3740 1 --2- 172.21.15.5:0/1188009685 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55ef064921c0 0x55ef0692be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:36:55.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.983+0000 7fdb033c3740 4 client.17400 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:36:55.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.983+0000 7fdb033c3740 1 -- 172.21.15.5:0/1188009685 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ef068149f0 con 0x55ef064921c0 2024-08-31T05:36:55.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.983+0000 7fdafa1ef640 1 --2- 172.21.15.5:0/1188009685 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55ef064921c0 0x55ef0692be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:36:55.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.983+0000 7fdad9ffb640 10 client.17400 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:36:55.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.983+0000 7fdafa1ef640 1 --2- 172.21.15.5:0/1188009685 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55ef064921c0 0x55ef0692be50 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24a34d8827e1aa31 server_cookie=7aa1a87babf3ede1 in_seq=0 out_seq=0 2024-08-31T05:36:55.998 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.995+0000 7fdad9ffb640 1 -- 172.21.15.5:0/1188009685 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ef068149f0 con 0x55ef064921c0 2024-08-31T05:36:55.998 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.995+0000 7fdad9ffb640 10 client.17400 handle_command_reply: tid=0 2024-08-31T05:36:55.998 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.995+0000 7fdb033c3740 1 client.17400 shutdown 2024-08-31T05:36:55.998 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.995+0000 7fdb033c3740 1 -- 172.21.15.5:0/1188009685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ef064fe1b0 msgr2=0x55ef06928170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:55.998 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.995+0000 7fdb033c3740 1 --2- 172.21.15.5:0/1188009685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ef064fe1b0 0x55ef06928170 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fdaec000c00 tx=0x7fdaec005fa0 comp rx=0 tx=0).stop 2024-08-31T05:36:55.998 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.995+0000 7fdb033c3740 1 -- 172.21.15.5:0/1188009685 shutdown_connections 2024-08-31T05:36:55.998 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.995+0000 7fdb033c3740 1 --2- 172.21.15.5:0/1188009685 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55ef064921c0 0x55ef0692be50 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:55.998 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.995+0000 7fdb033c3740 1 --2- 172.21.15.5:0/1188009685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ef064fe1b0 0x55ef06928170 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:55.998 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.995+0000 7fdb033c3740 1 --2- 172.21.15.5:0/1188009685 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ef064dd4d0 0x55ef068b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:55.998 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.995+0000 7fdb033c3740 1 --2- 172.21.15.5:0/1188009685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ef064d52f0 0x55ef068b0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:55.998 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.995+0000 7fdad9ffb640 0 client.17400 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:36:55.999 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.995+0000 7fdb033c3740 1 -- 172.21.15.5:0/1188009685 >> 172.21.15.5:0/1188009685 conn(0x55ef064f2300 msgr2=0x55ef068a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:55.999 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.995+0000 7fdb033c3740 1 -- 172.21.15.5:0/1188009685 shutdown_connections 2024-08-31T05:36:55.999 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.995+0000 7fdb033c3740 1 -- 172.21.15.5:0/1188009685 wait complete. 2024-08-31T05:36:55.999 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.995+0000 7fdb033c3740 20 client.17400 trim_cache size 0 max 16384 2024-08-31T05:36:55.999 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:36:55.999 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:36:55.999 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:36:55.999 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:36:56.000 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.996+0000 7fdafc453640 1 -- 172.21.15.5:0/1909077634 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fdadc0b4ca0 msgr2=0x7fdadc0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:56.000 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.996+0000 7fdafc453640 1 --2- 172.21.15.5:0/1909077634 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fdadc0b4ca0 0x7fdadc0b71b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x55ef068a0960 tx=0x7fdae4009360 comp rx=0 tx=0).stop 2024-08-31T05:36:56.000 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.996+0000 7fdafc453640 1 -- 172.21.15.5:0/1909077634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaf4104fd0 msgr2=0x7fdaf419a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:36:56.000 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.996+0000 7fdafc453640 1 --2- 172.21.15.5:0/1909077634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaf4104fd0 0x7fdaf419a8c0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fdae800e9c0 tx=0x7fdae800ee80 comp rx=0 tx=0).stop 2024-08-31T05:36:56.000 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.996+0000 7fdafc453640 1 -- 172.21.15.5:0/1909077634 shutdown_connections 2024-08-31T05:36:56.000 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.996+0000 7fdafc453640 1 --2- 172.21.15.5:0/1909077634 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fdadc0b4ca0 0x7fdadc0b71b0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:56.000 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.996+0000 7fdafc453640 1 --2- 172.21.15.5:0/1909077634 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdaf410db50 0x7fdaf419fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:56.000 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.996+0000 7fdafc453640 1 --2- 172.21.15.5:0/1909077634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdaf4104fd0 0x7fdaf419a8c0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:56.001 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.996+0000 7fdafc453640 1 --2- 172.21.15.5:0/1909077634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdaf41045a0 0x7fdaf419a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:36:56.001 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.996+0000 7fdafc453640 1 -- 172.21.15.5:0/1909077634 >> 172.21.15.5:0/1909077634 conn(0x7fdaf40fe1b0 msgr2=0x7fdaf41065e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:36:56.001 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.996+0000 7fdafc453640 1 -- 172.21.15.5:0/1909077634 shutdown_connections 2024-08-31T05:36:56.001 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:36:55.996+0000 7fdafc453640 1 -- 172.21.15.5:0/1909077634 wait complete. 2024-08-31T05:36:56.925 INFO:tasks.workunit.client.0.smithi005.stdout: 1 782274 11.60 MB/sec execute 224 sec latency 132.665 ms 2024-08-31T05:36:57.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:57 smithi070 ceph-mon[22316]: pgmap v554: 129 pgs: 129 active+clean; 420 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.4 MiB/s wr, 261 op/s 2024-08-31T05:36:57.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:57 smithi050 ceph-mon[22146]: pgmap v554: 129 pgs: 129 active+clean; 420 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.4 MiB/s wr, 261 op/s 2024-08-31T05:36:57.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:57 smithi005 ceph-mon[18602]: pgmap v554: 129 pgs: 129 active+clean; 420 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.4 MiB/s wr, 261 op/s 2024-08-31T05:36:57.925 INFO:tasks.workunit.client.0.smithi005.stdout: 1 784797 11.62 MB/sec execute 225 sec latency 20.479 ms 2024-08-31T05:36:58.926 INFO:tasks.workunit.client.0.smithi005.stdout: 1 786116 11.60 MB/sec execute 226 sec latency 149.585 ms 2024-08-31T05:36:59.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:36:59 smithi070 ceph-mon[22316]: pgmap v555: 129 pgs: 129 active+clean; 427 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.9 MiB/s wr, 244 op/s 2024-08-31T05:36:59.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:36:59 smithi050 ceph-mon[22146]: pgmap v555: 129 pgs: 129 active+clean; 427 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.9 MiB/s wr, 244 op/s 2024-08-31T05:36:59.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:36:59 smithi005 ceph-mon[18602]: pgmap v555: 129 pgs: 129 active+clean; 427 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.9 MiB/s wr, 244 op/s 2024-08-31T05:36:59.925 INFO:tasks.workunit.client.0.smithi005.stdout: 1 788367 11.60 MB/sec execute 227 sec latency 43.616 ms 2024-08-31T05:37:00.079 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T05:37:00.344 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:37:00.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.849+0000 7f8a8196e640 1 -- 172.21.15.5:0/949637694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a7c109f30 msgr2=0x7f8a7c10a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:00.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.849+0000 7f8a8196e640 1 --2- 172.21.15.5:0/949637694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a7c109f30 0x7f8a7c10a340 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c009900 tx=0x7f8a6c02a410 comp rx=0 tx=0).stop 2024-08-31T05:37:00.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.849+0000 7f8a8196e640 1 -- 172.21.15.5:0/949637694 shutdown_connections 2024-08-31T05:37:00.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.849+0000 7f8a8196e640 1 --2- 172.21.15.5:0/949637694 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a7c1101c0 0x7f8a7c1169f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:00.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.849+0000 7f8a8196e640 1 --2- 172.21.15.5:0/949637694 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a7c10f870 0x7f8a7c10fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:00.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.849+0000 7f8a8196e640 1 --2- 172.21.15.5:0/949637694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a7c109f30 0x7f8a7c10a340 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:00.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.849+0000 7f8a8196e640 1 -- 172.21.15.5:0/949637694 >> 172.21.15.5:0/949637694 conn(0x7f8a7c077f10 msgr2=0x7f8a7c107f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:00.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.849+0000 7f8a8196e640 1 -- 172.21.15.5:0/949637694 shutdown_connections 2024-08-31T05:37:00.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.849+0000 7f8a8196e640 1 -- 172.21.15.5:0/949637694 wait complete. 2024-08-31T05:37:00.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.850+0000 7f8a8196e640 1 Processor -- start 2024-08-31T05:37:00.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.850+0000 7f8a8196e640 1 -- start start 2024-08-31T05:37:00.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.850+0000 7f8a8196e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a7c109f30 0x7f8a7c1a0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:00.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.850+0000 7f8a8196e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a7c10f870 0x7f8a7c1a0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:00.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.850+0000 7f8a8196e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a7c1101c0 0x7f8a7c1a6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:00.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.850+0000 7f8a8196e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8a7c119e80 con 0x7f8a7c109f30 2024-08-31T05:37:00.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.850+0000 7f8a8196e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8a7c119d00 con 0x7f8a7c10f870 2024-08-31T05:37:00.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.850+0000 7f8a8196e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8a7c11a000 con 0x7f8a7c1101c0 2024-08-31T05:37:00.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.851+0000 7f8a7affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a7c109f30 0x7f8a7c1a0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:00.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.851+0000 7f8a7affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a7c109f30 0x7f8a7c1a0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38090/0 (socket says 172.21.15.5:38090) 2024-08-31T05:37:00.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.851+0000 7f8a7affd640 1 -- 172.21.15.5:0/354214258 learned_addr learned my addr 172.21.15.5:0/354214258 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:00.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.851+0000 7f8a7b7fe640 1 --2- 172.21.15.5:0/354214258 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a7c1101c0 0x7f8a7c1a6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:00.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.851+0000 7f8a7a7fc640 1 --2- 172.21.15.5:0/354214258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a7c10f870 0x7f8a7c1a0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:00.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.851+0000 7f8a7affd640 1 -- 172.21.15.5:0/354214258 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a7c1101c0 msgr2=0x7f8a7c1a6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:00.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.851+0000 7f8a7affd640 1 --2- 172.21.15.5:0/354214258 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a7c1101c0 0x7f8a7c1a6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:00.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.851+0000 7f8a7affd640 1 -- 172.21.15.5:0/354214258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a7c10f870 msgr2=0x7f8a7c1a0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:00.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.851+0000 7f8a7affd640 1 --2- 172.21.15.5:0/354214258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a7c10f870 0x7f8a7c1a0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:00.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.851+0000 7f8a7affd640 1 -- 172.21.15.5:0/354214258 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a7c1a6880 con 0x7f8a7c109f30 2024-08-31T05:37:00.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.851+0000 7f8a7b7fe640 1 --2- 172.21.15.5:0/354214258 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a7c1101c0 0x7f8a7c1a6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:37:00.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.851+0000 7f8a7affd640 1 --2- 172.21.15.5:0/354214258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a7c109f30 0x7f8a7c1a0910 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c005940 tx=0x7f8a6c0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:00.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.852+0000 7f8a8096c640 1 -- 172.21.15.5:0/354214258 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c03f030 con 0x7f8a7c109f30 2024-08-31T05:37:00.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.852+0000 7f8a8196e640 1 -- 172.21.15.5:0/354214258 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a7c1a6b10 con 0x7f8a7c109f30 2024-08-31T05:37:00.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.852+0000 7f8a8196e640 1 -- 172.21.15.5:0/354214258 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a7c1ad2d0 con 0x7f8a7c109f30 2024-08-31T05:37:00.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.852+0000 7f8a8096c640 1 -- 172.21.15.5:0/354214258 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a6c0044c0 con 0x7f8a7c109f30 2024-08-31T05:37:00.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.852+0000 7f8a8096c640 1 -- 172.21.15.5:0/354214258 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c035070 con 0x7f8a7c109f30 2024-08-31T05:37:00.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.855+0000 7f8a87ee3740 1 Processor -- start 2024-08-31T05:37:00.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.855+0000 7f8a87ee3740 1 -- start start 2024-08-31T05:37:00.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.855+0000 7f8a87ee3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec46b7b070 0x55ec46f202c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:00.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.855+0000 7f8a87ee3740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec46b521b0 0x55ec46f20800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:00.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.855+0000 7f8a87ee3740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec46b5a390 0x55ec46f20d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:00.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.855+0000 7f8a87ee3740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55ec46e97630 con 0x55ec46b521b0 2024-08-31T05:37:00.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.855+0000 7f8a87ee3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ec46e86bc0 con 0x55ec46b7b070 2024-08-31T05:37:00.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.855+0000 7f8a87ee3740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ec46e8ab70 con 0x55ec46b5a390 2024-08-31T05:37:00.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.855+0000 7f8a7a7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec46b5a390 0x55ec46f20d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:00.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.855+0000 7f8a7b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec46b7b070 0x55ec46f202c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:00.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.855+0000 7f8a7a7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec46b5a390 0x55ec46f20d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:44850/0 (socket says 172.21.15.5:44850) 2024-08-31T05:37:00.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.855+0000 7f8a7a7fc640 1 -- 172.21.15.5:0/3301911152 learned_addr learned my addr 172.21.15.5:0/3301911152 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:00.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.856+0000 7f8a7a7fc640 1 -- 172.21.15.5:0/3301911152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec46b7b070 msgr2=0x55ec46f202c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:00.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.856+0000 7f8a7a7fc640 1 --2- 172.21.15.5:0/3301911152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec46b7b070 0x55ec46f202c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:00.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.856+0000 7f8a7a7fc640 1 -- 172.21.15.5:0/3301911152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec46b521b0 msgr2=0x55ec46f20800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T05:37:00.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.856+0000 7f8a7a7fc640 1 --2- 172.21.15.5:0/3301911152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec46b521b0 0x55ec46f20800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:00.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.856+0000 7f8a7a7fc640 1 -- 172.21.15.5:0/3301911152 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec46be6650 con 0x55ec46b5a390 2024-08-31T05:37:00.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.856+0000 7f8a7b7fe640 1 --2- 172.21.15.5:0/3301911152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec46b7b070 0x55ec46f202c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:37:00.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.856+0000 7f8a7a7fc640 1 --2- 172.21.15.5:0/3301911152 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec46b5a390 0x55ec46f20d40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8a70009c20 tx=0x7f8a70011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6ffb81c21254b2d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:00.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.856+0000 7f8a61ffb640 1 -- 172.21.15.5:0/3301911152 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a70004230 con 0x55ec46b5a390 2024-08-31T05:37:00.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.856+0000 7f8a61ffb640 1 -- 172.21.15.5:0/3301911152 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a700043d0 con 0x55ec46b5a390 2024-08-31T05:37:00.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.856+0000 7f8a61ffb640 1 -- 172.21.15.5:0/3301911152 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a70019620 con 0x55ec46b5a390 2024-08-31T05:37:00.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.857+0000 7f8a8096c640 1 -- 172.21.15.5:0/354214258 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f8a6c042030 con 0x7f8a7c109f30 2024-08-31T05:37:00.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.857+0000 7f8a87ee3740 1 -- 172.21.15.5:0/3301911152 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec46b5a390 msgr2=0x55ec46f20d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:00.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.857+0000 7f8a87ee3740 1 --2- 172.21.15.5:0/3301911152 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec46b5a390 0x55ec46f20d40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8a70009c20 tx=0x7f8a70011810 comp rx=0 tx=0).stop 2024-08-31T05:37:00.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.858+0000 7f8a87ee3740 1 -- 172.21.15.5:0/3301911152 shutdown_connections 2024-08-31T05:37:00.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.858+0000 7f8a87ee3740 1 --2- 172.21.15.5:0/3301911152 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec46b5a390 0x55ec46f20d40 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:00.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.858+0000 7f8a87ee3740 1 --2- 172.21.15.5:0/3301911152 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec46b521b0 0x55ec46f20800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:00.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.858+0000 7f8a87ee3740 1 --2- 172.21.15.5:0/3301911152 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec46b7b070 0x55ec46f202c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:00.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.858+0000 7f8a87ee3740 1 -- 172.21.15.5:0/3301911152 >> 172.21.15.5:0/3301911152 conn(0x55ec46b6f460 msgr2=0x55ec46f1e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:00.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.858+0000 7f8a87ee3740 1 -- 172.21.15.5:0/3301911152 shutdown_connections 2024-08-31T05:37:00.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.858+0000 7f8a87ee3740 1 -- 172.21.15.5:0/3301911152 wait complete. 2024-08-31T05:37:00.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.858+0000 7f8a8096c640 1 --2- 172.21.15.5:0/354214258 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f8a640b4bb0 0x7f8a640b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:00.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.858+0000 7f8a7a7fc640 1 --2- 172.21.15.5:0/354214258 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f8a640b4bb0 0x7f8a640b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:00.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.858+0000 7f8a87ee3740 1 -- start start 2024-08-31T05:37:00.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.858+0000 7f8a8096c640 1 -- 172.21.15.5:0/354214258 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f8a6c105b50 con 0x7f8a7c109f30 2024-08-31T05:37:00.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.859+0000 7f8a87ee3740 1 Processor -- start 2024-08-31T05:37:00.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.859+0000 7f8a7a7fc640 1 --2- 172.21.15.5:0/354214258 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f8a640b4bb0 0x7f8a640b70c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8a700099b0 tx=0x7f8a70003e70 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:00.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.859+0000 7f8a87ee3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec46b521b0 0x55ec46f2b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:00.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.859+0000 7f8a87ee3740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec46b5a390 0x55ec46f2beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:00.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.859+0000 7f8a87ee3740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec46b7b070 0x55ec46f2c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:00.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.859+0000 7f8a7b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec46b7b070 0x55ec46f2c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:00.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.859+0000 7f8a7a7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec46b5a390 0x55ec46f2beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:00.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.859+0000 7f8a7affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec46b521b0 0x55ec46f2b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:00.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.859+0000 7f8a7b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec46b7b070 0x55ec46f2c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38096/0 (socket says 172.21.15.5:38096) 2024-08-31T05:37:00.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.859+0000 7f8a7affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec46b521b0 0x55ec46f2b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:35022/0 (socket says 172.21.15.5:35022) 2024-08-31T05:37:00.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.859+0000 7f8a7a7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec46b5a390 0x55ec46f2beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:44862/0 (socket says 172.21.15.5:44862) 2024-08-31T05:37:00.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.859+0000 7f8a7b7fe640 1 -- 172.21.15.5:0/3338638693 learned_addr learned my addr 172.21.15.5:0/3338638693 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:00.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.859+0000 7f8a87ee3740 1 -- 172.21.15.5:0/3338638693 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55ec46ce9700 con 0x55ec46b7b070 2024-08-31T05:37:00.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.859+0000 7f8a87ee3740 1 -- 172.21.15.5:0/3338638693 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ec46e0d700 con 0x55ec46b521b0 2024-08-31T05:37:00.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.859+0000 7f8a87ee3740 1 -- 172.21.15.5:0/3338638693 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ec46f2eaf0 con 0x55ec46b5a390 2024-08-31T05:37:00.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.859+0000 7f8a87ee3740 10 client.0 _ll_register_callbacks cb 0x55ec46e3cdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:37:00.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.860+0000 7f8a7b7fe640 1 -- 172.21.15.5:0/3338638693 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec46b5a390 msgr2=0x55ec46f2beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:00.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.860+0000 7f8a7b7fe640 1 --2- 172.21.15.5:0/3338638693 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec46b5a390 0x55ec46f2beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:00.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.860+0000 7f8a7b7fe640 1 -- 172.21.15.5:0/3338638693 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec46b521b0 msgr2=0x55ec46f2b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:00.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.860+0000 7f8a7b7fe640 1 --2- 172.21.15.5:0/3338638693 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec46b521b0 0x55ec46f2b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:00.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.860+0000 7f8a7b7fe640 1 -- 172.21.15.5:0/3338638693 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec46e468b0 con 0x55ec46b7b070 2024-08-31T05:37:00.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.860+0000 7f8a7affd640 1 --2- 172.21.15.5:0/3338638693 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec46b521b0 0x55ec46f2b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:37:00.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.860+0000 7f8a7b7fe640 1 --2- 172.21.15.5:0/3338638693 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec46b7b070 0x55ec46f2c430 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f8a7400fe20 tx=0x7f8a74012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3697504035ceef71 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:00.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.860+0000 7f8a5affd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:37:00.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.860+0000 7f8a5affd640 1 -- 172.21.15.5:0/3338638693 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a74003970 con 0x55ec46b7b070 2024-08-31T05:37:00.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.860+0000 7f8a5affd640 1 -- 172.21.15.5:0/3338638693 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f8a74003b10 con 0x55ec46b7b070 2024-08-31T05:37:00.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.860+0000 7f8a87ee3740 1 -- 172.21.15.5:0/3338638693 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a700043d0 con 0x55ec46b7b070 2024-08-31T05:37:00.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.860+0000 7f8a5affd640 1 -- 172.21.15.5:0/3338638693 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f8a74003d50 con 0x55ec46b7b070 2024-08-31T05:37:00.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.861+0000 7f8a87ee3740 10 client.17409 fetch_fsmap learned FSMap version 34 2024-08-31T05:37:00.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.861+0000 7f8a87ee3740 1 -- 172.21.15.5:0/3338638693 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55ec46f3a800 con 0x55ec46b7b070 2024-08-31T05:37:00.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.861+0000 7f8a5affd640 1 -- 172.21.15.5:0/3338638693 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a700043d0 con 0x55ec46b7b070 2024-08-31T05:37:00.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.861+0000 7f8a5affd640 1 -- 172.21.15.5:0/3338638693 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f8a74010610 con 0x55ec46b7b070 2024-08-31T05:37:00.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.861+0000 7f8a87ee3740 10 client.17409 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:37:00.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.861+0000 7f8a87ee3740 10 client.17409 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:37:00.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.861+0000 7f8a87ee3740 20 client.17409 populate_metadata read hostname 'smithi005' 2024-08-31T05:37:00.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.861+0000 7f8a87ee3740 1 --2- 172.21.15.5:0/3338638693 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55ec46b399f0 0x55ec46f3dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:00.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.861+0000 7f8a87ee3740 4 client.17409 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:37:00.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.861+0000 7f8a87ee3740 1 -- 172.21.15.5:0/3338638693 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ec46e99580 con 0x55ec46b399f0 2024-08-31T05:37:00.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.862+0000 7f8a7affd640 1 --2- 172.21.15.5:0/3338638693 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55ec46b399f0 0x55ec46f3dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:00.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.862+0000 7f8a5affd640 10 client.17409 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:37:00.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.862+0000 7f8a7affd640 1 --2- 172.21.15.5:0/3338638693 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55ec46b399f0 0x55ec46f3dc60 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57895e5b18ff37b1 server_cookie=8f53884dace76d76 in_seq=0 out_seq=0 2024-08-31T05:37:00.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.863+0000 7f8a5affd640 1 -- 172.21.15.5:0/3338638693 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ec46e99580 con 0x55ec46b399f0 2024-08-31T05:37:00.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.863+0000 7f8a5affd640 10 client.17409 handle_command_reply: tid=0 2024-08-31T05:37:00.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.863+0000 7f8a87ee3740 1 client.17409 shutdown 2024-08-31T05:37:00.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.864+0000 7f8a87ee3740 1 -- 172.21.15.5:0/3338638693 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec46b7b070 msgr2=0x55ec46f2c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:00.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.864+0000 7f8a87ee3740 1 --2- 172.21.15.5:0/3338638693 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec46b7b070 0x55ec46f2c430 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f8a7400fe20 tx=0x7f8a74012820 comp rx=0 tx=0).stop 2024-08-31T05:37:00.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.864+0000 7f8a87ee3740 1 -- 172.21.15.5:0/3338638693 shutdown_connections 2024-08-31T05:37:00.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.864+0000 7f8a87ee3740 1 --2- 172.21.15.5:0/3338638693 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55ec46b399f0 0x55ec46f3dc60 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:00.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.864+0000 7f8a5affd640 0 client.17409 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:37:00.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.864+0000 7f8a87ee3740 1 --2- 172.21.15.5:0/3338638693 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec46b7b070 0x55ec46f2c430 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:00.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.864+0000 7f8a87ee3740 1 --2- 172.21.15.5:0/3338638693 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec46b5a390 0x55ec46f2beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:00.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.864+0000 7f8a87ee3740 1 --2- 172.21.15.5:0/3338638693 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec46b521b0 0x55ec46f2b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:00.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.864+0000 7f8a87ee3740 1 -- 172.21.15.5:0/3338638693 >> 172.21.15.5:0/3338638693 conn(0x55ec46b6f460 msgr2=0x55ec46f23450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:00.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.864+0000 7f8a87ee3740 1 -- 172.21.15.5:0/3338638693 shutdown_connections 2024-08-31T05:37:00.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.864+0000 7f8a87ee3740 1 -- 172.21.15.5:0/3338638693 wait complete. 2024-08-31T05:37:00.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.864+0000 7f8a87ee3740 20 client.17409 trim_cache size 0 max 16384 2024-08-31T05:37:00.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.888+0000 7f8a87ee3740 1 Processor -- start 2024-08-31T05:37:00.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.888+0000 7f8a87ee3740 1 -- start start 2024-08-31T05:37:00.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.888+0000 7f8a87ee3740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec46b399f0 0x55ec46f2d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:00.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.889+0000 7f8a87ee3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec46b521b0 0x55ec46f1d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:00.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.889+0000 7f8a87ee3740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec46b5a390 0x55ec46f1dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:00.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.889+0000 7f8a87ee3740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8a7c1b72b0 con 0x55ec46b5a390 2024-08-31T05:37:00.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.889+0000 7f8a87ee3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8a7c1b8df0 con 0x55ec46b521b0 2024-08-31T05:37:00.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.889+0000 7f8a87ee3740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8a7c1b7980 con 0x55ec46b399f0 2024-08-31T05:37:00.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.889+0000 7f8a7affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec46b399f0 0x55ec46f2d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:00.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.889+0000 7f8a7b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec46b5a390 0x55ec46f1dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:00.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.889+0000 7f8a7affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec46b399f0 0x55ec46f2d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:44866/0 (socket says 172.21.15.5:44866) 2024-08-31T05:37:00.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.889+0000 7f8a7affd640 1 -- 172.21.15.5:0/3781753934 learned_addr learned my addr 172.21.15.5:0/3781753934 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:00.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.889+0000 7f8a7a7fc640 1 --2- 172.21.15.5:0/3781753934 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec46b521b0 0x55ec46f1d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:00.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.889+0000 7f8a7b7fe640 1 -- 172.21.15.5:0/3781753934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec46b399f0 msgr2=0x55ec46f2d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:00.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.889+0000 7f8a7b7fe640 1 --2- 172.21.15.5:0/3781753934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec46b399f0 0x55ec46f2d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:00.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.889+0000 7f8a7b7fe640 1 -- 172.21.15.5:0/3781753934 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec46b521b0 msgr2=0x55ec46f1d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:00.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.889+0000 7f8a7b7fe640 1 --2- 172.21.15.5:0/3781753934 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec46b521b0 0x55ec46f1d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:00.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.889+0000 7f8a7b7fe640 1 -- 172.21.15.5:0/3781753934 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec46f1eaa0 con 0x55ec46b5a390 2024-08-31T05:37:00.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.889+0000 7f8a7b7fe640 1 --2- 172.21.15.5:0/3781753934 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec46b5a390 0x55ec46f1dcc0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f8a74006010 tx=0x7f8a74009fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=180b802055e40536 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:00.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.890+0000 7f8a617fa640 1 -- 172.21.15.5:0/3781753934 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a74010430 con 0x55ec46b5a390 2024-08-31T05:37:00.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.890+0000 7f8a617fa640 1 -- 172.21.15.5:0/3781753934 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a740105d0 con 0x55ec46b5a390 2024-08-31T05:37:00.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.890+0000 7f8a617fa640 1 -- 172.21.15.5:0/3781753934 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a7401ce20 con 0x55ec46b5a390 2024-08-31T05:37:00.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.891+0000 7f8a87ee3740 1 -- 172.21.15.5:0/3781753934 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec46b5a390 msgr2=0x55ec46f1dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:00.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.891+0000 7f8a87ee3740 1 --2- 172.21.15.5:0/3781753934 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec46b5a390 0x55ec46f1dcc0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f8a74006010 tx=0x7f8a74009fd0 comp rx=0 tx=0).stop 2024-08-31T05:37:00.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.891+0000 7f8a87ee3740 1 -- 172.21.15.5:0/3781753934 shutdown_connections 2024-08-31T05:37:00.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.891+0000 7f8a87ee3740 1 --2- 172.21.15.5:0/3781753934 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec46b5a390 0x55ec46f1dcc0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:00.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.891+0000 7f8a87ee3740 1 --2- 172.21.15.5:0/3781753934 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec46b521b0 0x55ec46f1d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:00.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.891+0000 7f8a87ee3740 1 --2- 172.21.15.5:0/3781753934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec46b399f0 0x55ec46f2d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:00.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.891+0000 7f8a87ee3740 1 -- 172.21.15.5:0/3781753934 >> 172.21.15.5:0/3781753934 conn(0x55ec46b6f460 msgr2=0x55ec46f21cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:00.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.891+0000 7f8a87ee3740 1 -- 172.21.15.5:0/3781753934 shutdown_connections 2024-08-31T05:37:00.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.891+0000 7f8a87ee3740 1 -- 172.21.15.5:0/3781753934 wait complete. 2024-08-31T05:37:00.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.892+0000 7f8a87ee3740 1 -- start start 2024-08-31T05:37:00.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.892+0000 7f8a87ee3740 1 Processor -- start 2024-08-31T05:37:00.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.892+0000 7f8a87ee3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec46b399f0 0x55ec46f30880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:00.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.893+0000 7f8a87ee3740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec46b521b0 0x55ec46f30e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:00.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.893+0000 7f8a87ee3740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec46b5a390 0x55ec46fa1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:00.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.893+0000 7f8a7affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec46b399f0 0x55ec46f30880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:00.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.893+0000 7f8a7a7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec46b521b0 0x55ec46f30e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:00.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.893+0000 7f8a7affd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec46b399f0 0x55ec46f30880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:35046/0 (socket says 172.21.15.5:35046) 2024-08-31T05:37:00.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.893+0000 7f8a7affd640 1 -- 172.21.15.5:0/3163602412 learned_addr learned my addr 172.21.15.5:0/3163602412 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:00.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.893+0000 7f8a87ee3740 1 -- 172.21.15.5:0/3163602412 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8a7c1b8720 con 0x55ec46b521b0 2024-08-31T05:37:00.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.893+0000 7f8a87ee3740 1 -- 172.21.15.5:0/3163602412 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8a7c1b8050 con 0x55ec46b399f0 2024-08-31T05:37:00.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.893+0000 7f8a87ee3740 1 -- 172.21.15.5:0/3163602412 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8a7c1b5290 con 0x55ec46b5a390 2024-08-31T05:37:00.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.893+0000 7f8a87ee3740 10 client.0 _ll_register_callbacks cb 0x7f8a7400f4a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:37:00.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.893+0000 7f8a7b7fe640 1 --2- 172.21.15.5:0/3163602412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec46b5a390 0x55ec46fa1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:00.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.893+0000 7f8a7b7fe640 1 -- 172.21.15.5:0/3163602412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec46b399f0 msgr2=0x55ec46f30880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:00.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.893+0000 7f8a7b7fe640 1 --2- 172.21.15.5:0/3163602412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec46b399f0 0x55ec46f30880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:00.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.893+0000 7f8a7b7fe640 1 -- 172.21.15.5:0/3163602412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec46b521b0 msgr2=0x55ec46f30e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:00.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.893+0000 7f8a7b7fe640 1 --2- 172.21.15.5:0/3163602412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec46b521b0 0x55ec46f30e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:00.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.893+0000 7f8a7b7fe640 1 -- 172.21.15.5:0/3163602412 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec46fa1d90 con 0x55ec46b5a390 2024-08-31T05:37:00.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.894+0000 7f8a7b7fe640 1 --2- 172.21.15.5:0/3163602412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec46b5a390 0x55ec46fa1720 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8a74010b00 tx=0x7f8a7401cf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=362201710c91f87d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:00.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.894+0000 7f8a5affd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:37:00.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.894+0000 7f8a5affd640 1 -- 172.21.15.5:0/3163602412 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a74038060 con 0x55ec46b5a390 2024-08-31T05:37:00.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.894+0000 7f8a5affd640 1 -- 172.21.15.5:0/3163602412 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f8a7401c420 con 0x55ec46b5a390 2024-08-31T05:37:00.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.894+0000 7f8a87ee3740 1 -- 172.21.15.5:0/3163602412 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a740105d0 con 0x55ec46b5a390 2024-08-31T05:37:00.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.894+0000 7f8a5affd640 1 -- 172.21.15.5:0/3163602412 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f8a74010430 con 0x55ec46b5a390 2024-08-31T05:37:00.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.894+0000 7f8a87ee3740 10 client.27007 fetch_fsmap learned FSMap version 34 2024-08-31T05:37:00.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.894+0000 7f8a87ee3740 1 -- 172.21.15.5:0/3163602412 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55ec46fa9170 con 0x55ec46b5a390 2024-08-31T05:37:00.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.895+0000 7f8a5affd640 1 -- 172.21.15.5:0/3163602412 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a740105d0 con 0x55ec46b5a390 2024-08-31T05:37:00.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.895+0000 7f8a5affd640 1 -- 172.21.15.5:0/3163602412 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f8a74033a30 con 0x55ec46b5a390 2024-08-31T05:37:00.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.895+0000 7f8a87ee3740 10 client.27007 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:37:00.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.895+0000 7f8a87ee3740 10 client.27007 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:37:00.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.895+0000 7f8a87ee3740 20 client.27007 populate_metadata read hostname 'smithi005' 2024-08-31T05:37:00.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.895+0000 7f8a87ee3740 1 --2- 172.21.15.5:0/3163602412 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55ec46b7b070 0x55ec46fab7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:00.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.895+0000 7f8a87ee3740 4 client.27007 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T05:37:00.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.895+0000 7f8a87ee3740 1 -- 172.21.15.5:0/3163602412 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ec46e95020 con 0x55ec46b7b070 2024-08-31T05:37:00.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.895+0000 7f8a7affd640 1 --2- 172.21.15.5:0/3163602412 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55ec46b7b070 0x55ec46fab7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:00.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.896+0000 7f8a5affd640 10 client.27007 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:37:00.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.896+0000 7f8a7affd640 1 --2- 172.21.15.5:0/3163602412 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55ec46b7b070 0x55ec46fab7f0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d045fd6404feded server_cookie=db9849d7e7d2522d in_seq=0 out_seq=0 2024-08-31T05:37:00.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.896+0000 7f8a5affd640 1 -- 172.21.15.5:0/3163602412 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2646 (crc 0 0 0) 0x55ec46e95020 con 0x55ec46b7b070 2024-08-31T05:37:00.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.896+0000 7f8a5affd640 10 client.27007 handle_command_reply: tid=0 2024-08-31T05:37:00.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.896+0000 7f8a87ee3740 1 client.27007 shutdown 2024-08-31T05:37:00.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.896+0000 7f8a87ee3740 1 -- 172.21.15.5:0/3163602412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec46b5a390 msgr2=0x55ec46fa1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:00.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.896+0000 7f8a87ee3740 1 --2- 172.21.15.5:0/3163602412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec46b5a390 0x55ec46fa1720 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8a74010b00 tx=0x7f8a7401cf90 comp rx=0 tx=0).stop 2024-08-31T05:37:00.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.896+0000 7f8a87ee3740 1 -- 172.21.15.5:0/3163602412 shutdown_connections 2024-08-31T05:37:00.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.896+0000 7f8a87ee3740 1 --2- 172.21.15.5:0/3163602412 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55ec46b7b070 0x55ec46fab7f0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:00.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.896+0000 7f8a87ee3740 1 --2- 172.21.15.5:0/3163602412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec46b5a390 0x55ec46fa1720 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:00.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.896+0000 7f8a87ee3740 1 --2- 172.21.15.5:0/3163602412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ec46b521b0 0x55ec46f30e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:00.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.896+0000 7f8a87ee3740 1 --2- 172.21.15.5:0/3163602412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ec46b399f0 0x55ec46f30880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:00.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.896+0000 7f8a87ee3740 1 -- 172.21.15.5:0/3163602412 >> 172.21.15.5:0/3163602412 conn(0x55ec46b6f460 msgr2=0x55ec46f21a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:00.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.896+0000 7f8a5affd640 0 client.27007 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:37:00.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.897+0000 7f8a87ee3740 1 -- 172.21.15.5:0/3163602412 shutdown_connections 2024-08-31T05:37:00.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.897+0000 7f8a87ee3740 1 -- 172.21.15.5:0/3163602412 wait complete. 2024-08-31T05:37:00.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.897+0000 7f8a87ee3740 20 client.27007 trim_cache size 0 max 16384 2024-08-31T05:37:00.903 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:37:00.903 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "no active scrubs running", 2024-08-31T05:37:00.903 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": {}, 2024-08-31T05:37:00.903 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_stats": { 2024-08-31T05:37:00.903 INFO:teuthology.orchestra.run.smithi005.stdout: "94c23057-592d-4a8b-82d7-da2d84f8740b": { 2024-08-31T05:37:00.903 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:36:27.513638+0000", 2024-08-31T05:37:00.903 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:37:00.903 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:37:00.903 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:37:00.903 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:37:00.904 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:37:00.904 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:37:00.904 INFO:teuthology.orchestra.run.smithi005.stdout: "095ccc7a-f368-4bc6-9563-5930e21f9b4a": { 2024-08-31T05:37:00.904 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:35:40.190069+0000", 2024-08-31T05:37:00.904 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:37:00.904 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:37:00.904 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:37:00.904 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:37:00.904 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:37:00.904 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:37:00.904 INFO:teuthology.orchestra.run.smithi005.stdout: "de9731c7-ae4a-42fe-8146-e4752cdc40d4": { 2024-08-31T05:37:00.904 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:34:53.614499+0000", 2024-08-31T05:37:00.904 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:37:00.904 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:37:00.905 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:37:00.905 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:37:00.905 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:37:00.905 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:37:00.905 INFO:teuthology.orchestra.run.smithi005.stdout: "0bb67292-013a-40c7-b5fc-810bdd9715d8": { 2024-08-31T05:37:00.905 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:34:04.586008+0000", 2024-08-31T05:37:00.905 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:37:00.905 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:37:00.905 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:37:00.905 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:37:00.905 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:37:00.905 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:37:00.905 INFO:teuthology.orchestra.run.smithi005.stdout: "728a42ca-bbef-4151-830f-5fdd411d8fa0": { 2024-08-31T05:37:00.905 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:32:30.554906+0000", 2024-08-31T05:37:00.905 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:37:00.906 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:37:00.906 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:37:00.906 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:37:00.906 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:37:00.906 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:37:00.906 INFO:teuthology.orchestra.run.smithi005.stdout: "2445fc42-b797-434f-b380-e2da985b4d98": { 2024-08-31T05:37:00.906 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:33:17.681453+0000", 2024-08-31T05:37:00.906 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:37:00.906 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:37:00.906 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:37:00.906 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:37:00.906 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:37:00.906 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:37:00.906 INFO:teuthology.orchestra.run.smithi005.stdout: "cda92ac0-b35f-47a5-a3a5-471c888462a5": { 2024-08-31T05:37:00.906 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:53.103905+0000", 2024-08-31T05:37:00.907 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:37:00.907 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:37:00.907 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:37:00.907 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:37:00.907 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:37:00.907 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:37:00.907 INFO:teuthology.orchestra.run.smithi005.stdout: "ece37b07-9ab2-45f8-bc33-2755a07aac0b": { 2024-08-31T05:37:00.907 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:31:41.782407+0000", 2024-08-31T05:37:00.907 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:37:00.907 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:37:00.907 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:37:00.907 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:37:00.907 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:37:00.907 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:37:00.908 INFO:teuthology.orchestra.run.smithi005.stdout: "75d84398-5d9c-4872-b879-2fbce045fa71": { 2024-08-31T05:37:00.908 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:06.642335+0000", 2024-08-31T05:37:00.908 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:37:00.908 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:37:00.908 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:37:00.908 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:37:00.908 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:37:00.908 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:37:00.908 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:37:00.908 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:37:00.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.897+0000 7f8a8196e640 1 -- 172.21.15.5:0/354214258 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f8a640b4bb0 msgr2=0x7f8a640b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:00.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.897+0000 7f8a8196e640 1 --2- 172.21.15.5:0/354214258 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f8a640b4bb0 0x7f8a640b70c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8a700099b0 tx=0x7f8a70003e70 comp rx=0 tx=0).stop 2024-08-31T05:37:00.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.897+0000 7f8a8196e640 1 -- 172.21.15.5:0/354214258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a7c109f30 msgr2=0x7f8a7c1a0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:00.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.897+0000 7f8a8196e640 1 --2- 172.21.15.5:0/354214258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a7c109f30 0x7f8a7c1a0910 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c005940 tx=0x7f8a6c0040c0 comp rx=0 tx=0).stop 2024-08-31T05:37:00.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.897+0000 7f8a8196e640 1 -- 172.21.15.5:0/354214258 shutdown_connections 2024-08-31T05:37:00.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.897+0000 7f8a8196e640 1 --2- 172.21.15.5:0/354214258 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f8a640b4bb0 0x7f8a640b70c0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:00.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.897+0000 7f8a8196e640 1 --2- 172.21.15.5:0/354214258 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a7c1101c0 0x7f8a7c1a6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:00.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.897+0000 7f8a8196e640 1 --2- 172.21.15.5:0/354214258 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8a7c10f870 0x7f8a7c1a0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:00.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.897+0000 7f8a8196e640 1 --2- 172.21.15.5:0/354214258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a7c109f30 0x7f8a7c1a0910 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:00.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.898+0000 7f8a8196e640 1 -- 172.21.15.5:0/354214258 >> 172.21.15.5:0/354214258 conn(0x7f8a7c077f10 msgr2=0x7f8a7c1083d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:00.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.898+0000 7f8a8196e640 1 -- 172.21.15.5:0/354214258 shutdown_connections 2024-08-31T05:37:00.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:00.898+0000 7f8a8196e640 1 -- 172.21.15.5:0/354214258 wait complete. 2024-08-31T05:37:00.925 INFO:tasks.workunit.client.0.smithi005.stdout: 1 789247 11.56 MB/sec execute 228 sec latency 91.111 ms 2024-08-31T05:37:01.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:37:01 smithi005 ceph-mon[18602]: pgmap v556: 129 pgs: 129 active+clean; 429 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.4 MiB/s wr, 261 op/s 2024-08-31T05:37:01.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:37:01 smithi070 ceph-mon[22316]: pgmap v556: 129 pgs: 129 active+clean; 429 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.4 MiB/s wr, 261 op/s 2024-08-31T05:37:01.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:37:01 smithi050 ceph-mon[22146]: pgmap v556: 129 pgs: 129 active+clean; 429 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.4 MiB/s wr, 261 op/s 2024-08-31T05:37:01.874 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T05:37:01.874 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T05:37:01.925 INFO:tasks.workunit.client.0.smithi005.stdout: 1 790005 11.53 MB/sec execute 229 sec latency 117.190 ms 2024-08-31T05:37:02.160 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:37:02.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:02.682+0000 7f5efc751640 1 -- 172.21.15.5:0/865230591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ef41050a0 msgr2=0x7f5ef410d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:02.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:02.682+0000 7f5efc751640 1 --2- 172.21.15.5:0/865230591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ef41050a0 0x7f5ef410d5f0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f5ee4009900 tx=0x7f5ee402a410 comp rx=0 tx=0).stop 2024-08-31T05:37:02.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:02.682+0000 7f5efc751640 1 -- 172.21.15.5:0/865230591 shutdown_connections 2024-08-31T05:37:02.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:02.682+0000 7f5efc751640 1 --2- 172.21.15.5:0/865230591 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ef410dbb0 0x7f5ef41100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:02.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:02.682+0000 7f5efc751640 1 --2- 172.21.15.5:0/865230591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ef41050a0 0x7f5ef410d5f0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:02.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:02.682+0000 7f5efc751640 1 --2- 172.21.15.5:0/865230591 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ef4104750 0x7f5ef4104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:02.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:02.682+0000 7f5efc751640 1 -- 172.21.15.5:0/865230591 >> 172.21.15.5:0/865230591 conn(0x7f5ef40794d0 msgr2=0x7f5ef40798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:02.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:02.682+0000 7f5efc751640 1 -- 172.21.15.5:0/865230591 shutdown_connections 2024-08-31T05:37:02.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:02.682+0000 7f5efc751640 1 -- 172.21.15.5:0/865230591 wait complete. 2024-08-31T05:37:02.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:02.682+0000 7f5efc751640 1 Processor -- start 2024-08-31T05:37:02.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:02.683+0000 7f5efc751640 1 -- start start 2024-08-31T05:37:02.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:02.683+0000 7f5efc751640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ef4104750 0x7f5ef4102490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:02.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:02.683+0000 7f5efc751640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ef41050a0 0x7f5ef41029d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:02.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:02.683+0000 7f5efc751640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ef410dbb0 0x7f5ef4102f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:02.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:02.683+0000 7f5efc751640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef41137d0 con 0x7f5ef41050a0 2024-08-31T05:37:02.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:02.683+0000 7f5efc751640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef4113650 con 0x7f5ef4104750 2024-08-31T05:37:02.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:02.683+0000 7f5efc751640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef4113950 con 0x7f5ef410dbb0 2024-08-31T05:37:02.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:02.683+0000 7f5ef9cec640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ef41050a0 0x7f5ef41029d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:02.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:02.683+0000 7f5ef9cec640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ef41050a0 0x7f5ef41029d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55938/0 (socket says 172.21.15.5:55938) 2024-08-31T05:37:02.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:02.683+0000 7f5ef9cec640 1 -- 172.21.15.5:0/2472771994 learned_addr learned my addr 172.21.15.5:0/2472771994 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:02.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:02.683+0000 7f5efacee640 1 --2- 172.21.15.5:0/2472771994 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ef410dbb0 0x7f5ef4102f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:02.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:02.683+0000 7f5efa4ed640 1 --2- 172.21.15.5:0/2472771994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ef4104750 0x7f5ef4102490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:02.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:02.683+0000 7f5ef9cec640 1 -- 172.21.15.5:0/2472771994 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ef410dbb0 msgr2=0x7f5ef4102f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:02.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:02.683+0000 7f5ef9cec640 1 --2- 172.21.15.5:0/2472771994 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ef410dbb0 0x7f5ef4102f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:02.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:02.683+0000 7f5ef9cec640 1 -- 172.21.15.5:0/2472771994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ef4104750 msgr2=0x7f5ef4102490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:02.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:02.683+0000 7f5ef9cec640 1 --2- 172.21.15.5:0/2472771994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ef4104750 0x7f5ef4102490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:02.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:02.683+0000 7f5ef9cec640 1 -- 172.21.15.5:0/2472771994 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ef41a84c0 con 0x7f5ef41050a0 2024-08-31T05:37:02.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:02.684+0000 7f5ef9cec640 1 --2- 172.21.15.5:0/2472771994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ef41050a0 0x7f5ef41029d0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f5ee4006010 tx=0x7f5ee4004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:02.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:02.684+0000 7f5eeb7fe640 1 -- 172.21.15.5:0/2472771994 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee403f030 con 0x7f5ef41050a0 2024-08-31T05:37:02.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:02.684+0000 7f5eeb7fe640 1 -- 172.21.15.5:0/2472771994 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ee4003aa0 con 0x7f5ef41050a0 2024-08-31T05:37:02.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:02.684+0000 7f5efc751640 1 -- 172.21.15.5:0/2472771994 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ef41a8750 con 0x7f5ef41050a0 2024-08-31T05:37:02.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:02.684+0000 7f5eeb7fe640 1 -- 172.21.15.5:0/2472771994 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee4035070 con 0x7f5ef41050a0 2024-08-31T05:37:02.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:02.684+0000 7f5efc751640 1 -- 172.21.15.5:0/2472771994 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ef41a8c80 con 0x7f5ef41050a0 2024-08-31T05:37:02.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:02.685+0000 7f5efc751640 1 -- 172.21.15.5:0/2472771994 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ef4104b60 con 0x7f5ef41050a0 2024-08-31T05:37:02.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:02.686+0000 7f5eeb7fe640 1 -- 172.21.15.5:0/2472771994 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f5ee4042030 con 0x7f5ef41050a0 2024-08-31T05:37:02.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:02.687+0000 7f5eeb7fe640 1 --2- 172.21.15.5:0/2472771994 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5ee00b4d20 0x7f5ee00b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:02.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:02.687+0000 7f5eeb7fe640 1 -- 172.21.15.5:0/2472771994 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f5ee4105cd0 con 0x7f5ef41050a0 2024-08-31T05:37:02.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:02.687+0000 7f5efa4ed640 1 --2- 172.21.15.5:0/2472771994 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5ee00b4d20 0x7f5ee00b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:02.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:02.688+0000 7f5efa4ed640 1 --2- 172.21.15.5:0/2472771994 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5ee00b4d20 0x7f5ee00b7230 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4103ee0 tx=0x7f5ef0005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:02.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:02.692+0000 7f5eeb7fe640 1 -- 172.21.15.5:0/2472771994 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5ee40cc0f0 con 0x7f5ef41050a0 2024-08-31T05:37:02.926 INFO:tasks.workunit.client.0.smithi005.stdout: 1 792155 11.54 MB/sec execute 230 sec latency 18.921 ms 2024-08-31T05:37:03.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:02.999+0000 7f5efc751640 1 -- 172.21.15.5:0/2472771994 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ef4108d10 con 0x7f5ef41050a0 2024-08-31T05:37:03.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:02.999+0000 7f5eeb7fe640 1 -- 172.21.15.5:0/2472771994 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11941 (secure 0 0 0) 0x7f5ee40d08b0 con 0x7f5ef41050a0 2024-08-31T05:37:03.002 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:37:03.002 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":34,"btime":"2024-08-31T05:33:43:289944+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14739,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2024812199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2024812199},{"type":"v1","addr":"172.21.15.5:6835","nonce":2024812199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3629023702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3629023702},{"type":"v1","addr":"172.21.15.5:6837","nonce":3629023702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T05:27:31.929153+0000","modified":"2024-08-31T05:33:42.378207+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24652,"mds_1":24638,"mds_2":24631,"mds_3":24625,"mds_4":24602},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6839/2412701258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":2412701258},{"type":"v1","addr":"172.21.15.5:6839","nonce":2412701258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14820":{"gid":14820,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6841/747057838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":747057838},{"type":"v1","addr":"172.21.15.5:6841","nonce":747057838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6833/1153378982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1153378982},{"type":"v1","addr":"172.21.15.50:6833","nonce":1153378982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6833/364083443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":364083443},{"type":"v1","addr":"172.21.15.70:6833","nonce":364083443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24587":{"gid":24587,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/2346896794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2346896794},{"type":"v1","addr":"172.21.15.50:6835","nonce":2346896794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24602":{"gid":24602,"name":"h","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.50:6837/428759669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":428759669},{"type":"v1","addr":"172.21.15.50:6837","nonce":428759669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.70:6835/2061504114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2061504114},{"type":"v1","addr":"172.21.15.70:6835","nonce":2061504114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.70:6837/2780036414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2780036414},{"type":"v1","addr":"172.21.15.70:6837","nonce":2780036414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.50:6839/98200944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":98200944},{"type":"v1","addr":"172.21.15.50:6839","nonce":98200944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24652":{"gid":24652,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.70:6839/2756569250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":2756569250},{"type":"v1","addr":"172.21.15.70:6839","nonce":2756569250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24652,"qdb_cluster":[24652,24631,24638,24625,24602]},"id":1}]} 2024-08-31T05:37:03.002 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 34 2024-08-31T05:37:03.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:03.002+0000 7f5efc751640 1 -- 172.21.15.5:0/2472771994 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5ee00b4d20 msgr2=0x7f5ee00b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:03.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:03.002+0000 7f5efc751640 1 --2- 172.21.15.5:0/2472771994 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5ee00b4d20 0x7f5ee00b7230 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4103ee0 tx=0x7f5ef0005f90 comp rx=0 tx=0).stop 2024-08-31T05:37:03.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:03.002+0000 7f5efc751640 1 -- 172.21.15.5:0/2472771994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ef41050a0 msgr2=0x7f5ef41029d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:03.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:03.002+0000 7f5efc751640 1 --2- 172.21.15.5:0/2472771994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ef41050a0 0x7f5ef41029d0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f5ee4006010 tx=0x7f5ee4004060 comp rx=0 tx=0).stop 2024-08-31T05:37:03.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:03.002+0000 7f5efc751640 1 -- 172.21.15.5:0/2472771994 shutdown_connections 2024-08-31T05:37:03.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:03.002+0000 7f5efc751640 1 --2- 172.21.15.5:0/2472771994 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5ee00b4d20 0x7f5ee00b7230 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:03.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:03.002+0000 7f5efc751640 1 --2- 172.21.15.5:0/2472771994 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5ef410dbb0 0x7f5ef4102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:03.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:03.002+0000 7f5efc751640 1 --2- 172.21.15.5:0/2472771994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ef41050a0 0x7f5ef41029d0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:03.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:03.002+0000 7f5efc751640 1 --2- 172.21.15.5:0/2472771994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5ef4104750 0x7f5ef4102490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:03.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:03.002+0000 7f5efc751640 1 -- 172.21.15.5:0/2472771994 >> 172.21.15.5:0/2472771994 conn(0x7f5ef40794d0 msgr2=0x7f5ef41005c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:03.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:03.002+0000 7f5efc751640 1 -- 172.21.15.5:0/2472771994 shutdown_connections 2024-08-31T05:37:03.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:03.002+0000 7f5efc751640 1 -- 172.21.15.5:0/2472771994 wait complete. 2024-08-31T05:37:03.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:37:03 smithi070 ceph-mon[22316]: pgmap v557: 129 pgs: 129 active+clean; 431 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.3 MiB/s wr, 199 op/s 2024-08-31T05:37:03.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:37:03 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/2472771994' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:37:03.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:37:03 smithi050 ceph-mon[22146]: pgmap v557: 129 pgs: 129 active+clean; 431 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.3 MiB/s wr, 199 op/s 2024-08-31T05:37:03.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:37:03 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/2472771994' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:37:03.699 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:37:03 smithi005 ceph-mon[18602]: pgmap v557: 129 pgs: 129 active+clean; 431 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.3 MiB/s wr, 199 op/s 2024-08-31T05:37:03.699 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:37:03 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/2472771994' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:37:03.726 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-31T05:37:03.926 INFO:tasks.workunit.client.0.smithi005.stdout: 1 793972 11.52 MB/sec execute 231 sec latency 28.205 ms 2024-08-31T05:37:04.011 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:37:04.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.498+0000 7f4c765a9640 1 -- 172.21.15.5:0/4221588523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c7010dbd0 msgr2=0x7f4c701100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:04.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.498+0000 7f4c765a9640 1 --2- 172.21.15.5:0/4221588523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c7010dbd0 0x7f4c701100a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4c68009be0 tx=0x7f4c6802a6c0 comp rx=0 tx=0).stop 2024-08-31T05:37:04.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.499+0000 7f4c765a9640 1 -- 172.21.15.5:0/4221588523 shutdown_connections 2024-08-31T05:37:04.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.499+0000 7f4c765a9640 1 --2- 172.21.15.5:0/4221588523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c7010dbd0 0x7f4c701100a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:04.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.499+0000 7f4c765a9640 1 --2- 172.21.15.5:0/4221588523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c70105050 0x7f4c7010d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:04.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.499+0000 7f4c765a9640 1 --2- 172.21.15.5:0/4221588523 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c70104620 0x7f4c70104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:04.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.499+0000 7f4c765a9640 1 -- 172.21.15.5:0/4221588523 >> 172.21.15.5:0/4221588523 conn(0x7f4c700794d0 msgr2=0x7f4c700798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:04.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.499+0000 7f4c765a9640 1 -- 172.21.15.5:0/4221588523 shutdown_connections 2024-08-31T05:37:04.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.499+0000 7f4c765a9640 1 -- 172.21.15.5:0/4221588523 wait complete. 2024-08-31T05:37:04.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.499+0000 7f4c765a9640 1 Processor -- start 2024-08-31T05:37:04.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.500+0000 7f4c765a9640 1 -- start start 2024-08-31T05:37:04.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.500+0000 7f4c765a9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c70104620 0x7f4c7019a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:04.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.500+0000 7f4c765a9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c70105050 0x7f4c7019a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:04.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.500+0000 7f4c765a9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c7010dbd0 0x7f4c7019f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:04.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.500+0000 7f4c765a9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4c701137f0 con 0x7f4c7010dbd0 2024-08-31T05:37:04.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.500+0000 7f4c765a9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4c70113670 con 0x7f4c70104620 2024-08-31T05:37:04.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.500+0000 7f4c765a9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4c70113970 con 0x7f4c70105050 2024-08-31T05:37:04.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.500+0000 7f4c6ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c70104620 0x7f4c7019a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:04.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.500+0000 7f4c74b46640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c7010dbd0 0x7f4c7019f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:04.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.500+0000 7f4c6ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c70104620 0x7f4c7019a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:45874/0 (socket says 172.21.15.5:45874) 2024-08-31T05:37:04.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.500+0000 7f4c6f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c70105050 0x7f4c7019a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:04.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.500+0000 7f4c74b46640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c7010dbd0 0x7f4c7019f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55956/0 (socket says 172.21.15.5:55956) 2024-08-31T05:37:04.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.500+0000 7f4c6ffff640 1 -- 172.21.15.5:0/2257922003 learned_addr learned my addr 172.21.15.5:0/2257922003 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:04.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.501+0000 7f4c6f7fe640 1 -- 172.21.15.5:0/2257922003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c70104620 msgr2=0x7f4c7019a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:04.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.501+0000 7f4c6f7fe640 1 --2- 172.21.15.5:0/2257922003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c70104620 0x7f4c7019a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:04.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.501+0000 7f4c6f7fe640 1 -- 172.21.15.5:0/2257922003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c7010dbd0 msgr2=0x7f4c7019f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:04.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.501+0000 7f4c6f7fe640 1 --2- 172.21.15.5:0/2257922003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c7010dbd0 0x7f4c7019f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:04.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.501+0000 7f4c6f7fe640 1 -- 172.21.15.5:0/2257922003 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c701a00f0 con 0x7f4c70105050 2024-08-31T05:37:04.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.501+0000 7f4c74b46640 1 --2- 172.21.15.5:0/2257922003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c7010dbd0 0x7f4c7019f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:37:04.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.501+0000 7f4c6f7fe640 1 --2- 172.21.15.5:0/2257922003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c70105050 0x7f4c7019a720 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4c7006aad0 tx=0x7f4c6400ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:04.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.502+0000 7f4c6d7fa640 1 -- 172.21.15.5:0/2257922003 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c6400ccd0 con 0x7f4c70105050 2024-08-31T05:37:04.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.502+0000 7f4c6d7fa640 1 -- 172.21.15.5:0/2257922003 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c640035f0 con 0x7f4c70105050 2024-08-31T05:37:04.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.502+0000 7f4c765a9640 1 -- 172.21.15.5:0/2257922003 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c701a03e0 con 0x7f4c70105050 2024-08-31T05:37:04.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.502+0000 7f4c6d7fa640 1 -- 172.21.15.5:0/2257922003 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c64010690 con 0x7f4c70105050 2024-08-31T05:37:04.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.502+0000 7f4c765a9640 1 -- 172.21.15.5:0/2257922003 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c701a6b40 con 0x7f4c70105050 2024-08-31T05:37:04.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.505+0000 7f4c6d7fa640 1 -- 172.21.15.5:0/2257922003 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f4c64010830 con 0x7f4c70105050 2024-08-31T05:37:04.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.505+0000 7f4c7cb1e740 1 Processor -- start 2024-08-31T05:37:04.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.505+0000 7f4c7cb1e740 1 -- start start 2024-08-31T05:37:04.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.505+0000 7f4c7cb1e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a756226070 0x55a7565cb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:04.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.505+0000 7f4c7cb1e740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7561fd1b0 0x55a7565cb850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:04.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.505+0000 7f4c7cb1e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a756205390 0x55a7565cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:04.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.505+0000 7f4c7cb1e740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55a756542680 con 0x55a7561fd1b0 2024-08-31T05:37:04.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.505+0000 7f4c7cb1e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a756531c10 con 0x55a756205390 2024-08-31T05:37:04.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.505+0000 7f4c7cb1e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a756535bc0 con 0x55a756226070 2024-08-31T05:37:04.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.505+0000 7f4c6ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7561fd1b0 0x55a7565cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:04.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.505+0000 7f4c6d7fa640 1 --2- 172.21.15.5:0/2257922003 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4c580b4d20 0x7f4c580b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:04.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.505+0000 7f4c74b46640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a756226070 0x55a7565cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:04.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.505+0000 7f4c6f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a756205390 0x55a7565cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:04.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.505+0000 7f4c6ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7561fd1b0 0x55a7565cb850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55968/0 (socket says 172.21.15.5:55968) 2024-08-31T05:37:04.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.505+0000 7f4c74b46640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a756226070 0x55a7565cb310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:39656/0 (socket says 172.21.15.5:39656) 2024-08-31T05:37:04.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.505+0000 7f4c6ffff640 1 -- 172.21.15.5:0/3668711914 learned_addr learned my addr 172.21.15.5:0/3668711914 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:04.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.506+0000 7f4c74b46640 1 --2- 172.21.15.5:0/2257922003 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4c580b4d20 0x7f4c580b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:04.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.506+0000 7f4c74b46640 1 -- 172.21.15.5:0/3668711914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a756205390 msgr2=0x55a7565cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:04.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.506+0000 7f4c74b46640 1 --2- 172.21.15.5:0/3668711914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a756205390 0x55a7565cbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:04.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.506+0000 7f4c74b46640 1 -- 172.21.15.5:0/3668711914 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7561fd1b0 msgr2=0x55a7565cb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:04.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.506+0000 7f4c74b46640 1 --2- 172.21.15.5:0/3668711914 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7561fd1b0 0x55a7565cb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:04.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.506+0000 7f4c74b46640 1 -- 172.21.15.5:0/3668711914 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a756291650 con 0x55a756226070 2024-08-31T05:37:04.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.506+0000 7f4c6d7fa640 1 -- 172.21.15.5:0/2257922003 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f4c640e5a80 con 0x7f4c70105050 2024-08-31T05:37:04.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.506+0000 7f4c74b46640 1 --2- 172.21.15.5:0/3668711914 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a756226070 0x55a7565cb310 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4c6802abe0 tx=0x7f4c68003a70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a439d0958e75815c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:04.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.506+0000 7f4c567fc640 1 -- 172.21.15.5:0/3668711914 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c6804e070 con 0x55a756226070 2024-08-31T05:37:04.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.506+0000 7f4c567fc640 1 -- 172.21.15.5:0/3668711914 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c68004d40 con 0x55a756226070 2024-08-31T05:37:04.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.506+0000 7f4c567fc640 1 -- 172.21.15.5:0/3668711914 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c68036040 con 0x55a756226070 2024-08-31T05:37:04.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.507+0000 7f4c7cb1e740 1 -- 172.21.15.5:0/3668711914 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a756226070 msgr2=0x55a7565cb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:04.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.507+0000 7f4c74b46640 1 --2- 172.21.15.5:0/2257922003 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4c580b4d20 0x7f4c580b7230 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4c68047000 tx=0x7f4c68045000 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:04.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.507+0000 7f4c7cb1e740 1 --2- 172.21.15.5:0/3668711914 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a756226070 0x55a7565cb310 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4c6802abe0 tx=0x7f4c68003a70 comp rx=0 tx=0).stop 2024-08-31T05:37:04.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.507+0000 7f4c7cb1e740 1 -- 172.21.15.5:0/3668711914 shutdown_connections 2024-08-31T05:37:04.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.507+0000 7f4c7cb1e740 1 --2- 172.21.15.5:0/3668711914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a756205390 0x55a7565cbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:04.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.507+0000 7f4c7cb1e740 1 --2- 172.21.15.5:0/3668711914 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7561fd1b0 0x55a7565cb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:04.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.507+0000 7f4c7cb1e740 1 --2- 172.21.15.5:0/3668711914 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a756226070 0x55a7565cb310 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:04.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.507+0000 7f4c7cb1e740 1 -- 172.21.15.5:0/3668711914 >> 172.21.15.5:0/3668711914 conn(0x55a75621a460 msgr2=0x55a7565c9200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:04.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.507+0000 7f4c7cb1e740 1 -- 172.21.15.5:0/3668711914 shutdown_connections 2024-08-31T05:37:04.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.507+0000 7f4c7cb1e740 1 -- 172.21.15.5:0/3668711914 wait complete. 2024-08-31T05:37:04.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.508+0000 7f4c7cb1e740 1 -- start start 2024-08-31T05:37:04.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.508+0000 7f4c7cb1e740 1 Processor -- start 2024-08-31T05:37:04.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.508+0000 7f4c7cb1e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7561fd1b0 0x55a7565d6a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:04.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.508+0000 7f4c7cb1e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a756205390 0x55a7565d6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:04.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.508+0000 7f4c7cb1e740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a756226070 0x55a7565e2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:04.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.508+0000 7f4c6f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a756205390 0x55a7565d6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:04.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.508+0000 7f4c6ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7561fd1b0 0x55a7565d6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:04.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.509+0000 7f4c7cb1e740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55a756394700 con 0x55a756226070 2024-08-31T05:37:04.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.509+0000 7f4c7cb1e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a7564b8750 con 0x55a7561fd1b0 2024-08-31T05:37:04.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.509+0000 7f4c74b46640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a756226070 0x55a7565e2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:04.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.509+0000 7f4c7cb1e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a7565d9af0 con 0x55a756205390 2024-08-31T05:37:04.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.509+0000 7f4c6ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7561fd1b0 0x55a7565d6a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:45892/0 (socket says 172.21.15.5:45892) 2024-08-31T05:37:04.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.509+0000 7f4c6ffff640 1 -- 172.21.15.5:0/3713089164 learned_addr learned my addr 172.21.15.5:0/3713089164 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:04.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.509+0000 7f4c6f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a756205390 0x55a7565d6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:39672/0 (socket says 172.21.15.5:39672) 2024-08-31T05:37:04.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.509+0000 7f4c7cb1e740 10 client.0 _ll_register_callbacks cb 0x55a7564e7e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:37:04.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.509+0000 7f4c6ffff640 1 -- 172.21.15.5:0/3713089164 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a756205390 msgr2=0x55a7565d6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:04.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.509+0000 7f4c6ffff640 1 --2- 172.21.15.5:0/3713089164 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a756205390 0x55a7565d6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:04.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.509+0000 7f4c6ffff640 1 -- 172.21.15.5:0/3713089164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a756226070 msgr2=0x55a7565e2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:04.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.509+0000 7f4c6ffff640 1 --2- 172.21.15.5:0/3713089164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a756226070 0x55a7565e2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:04.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.509+0000 7f4c6ffff640 1 -- 172.21.15.5:0/3713089164 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7564f1900 con 0x55a7561fd1b0 2024-08-31T05:37:04.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.509+0000 7f4c6f7fe640 1 --2- 172.21.15.5:0/3713089164 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a756205390 0x55a7565d6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:37:04.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.509+0000 7f4c6ffff640 1 --2- 172.21.15.5:0/3713089164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7561fd1b0 0x55a7565d6a80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4c60012810 tx=0x7f4c60012cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6517d5646b178ad8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:04.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.509+0000 7f4c4f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:37:04.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.509+0000 7f4c4f7fe640 1 -- 172.21.15.5:0/3713089164 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c6000f920 con 0x55a7561fd1b0 2024-08-31T05:37:04.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.509+0000 7f4c7cb1e740 1 -- 172.21.15.5:0/3713089164 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c68004d40 con 0x55a7561fd1b0 2024-08-31T05:37:04.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.509+0000 7f4c4f7fe640 1 -- 172.21.15.5:0/3713089164 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f4c6000fac0 con 0x55a7561fd1b0 2024-08-31T05:37:04.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.510+0000 7f4c4f7fe640 1 -- 172.21.15.5:0/3713089164 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f4c6000fcc0 con 0x55a7561fd1b0 2024-08-31T05:37:04.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.510+0000 7f4c7cb1e740 10 client.27017 fetch_fsmap learned FSMap version 34 2024-08-31T05:37:04.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.510+0000 7f4c7cb1e740 1 -- 172.21.15.5:0/3713089164 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a7565e58e0 con 0x55a7561fd1b0 2024-08-31T05:37:04.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.510+0000 7f4c4f7fe640 1 -- 172.21.15.5:0/3713089164 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c68004d40 con 0x55a7561fd1b0 2024-08-31T05:37:04.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.510+0000 7f4c4f7fe640 1 -- 172.21.15.5:0/3713089164 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f4c6001c420 con 0x55a7561fd1b0 2024-08-31T05:37:04.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.510+0000 7f4c7cb1e740 10 client.27017 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:37:04.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.510+0000 7f4c7cb1e740 10 client.27017 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-31T05:37:04.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.510+0000 7f4c7cb1e740 20 client.27017 populate_metadata read hostname 'smithi005' 2024-08-31T05:37:04.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.510+0000 7f4c7cb1e740 1 --2- 172.21.15.5:0/3713089164 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55a7561e49f0 0x55a7565e8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:04.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.510+0000 7f4c7cb1e740 4 client.27017 mds_command: new command op to 24602 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:37:04.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.510+0000 7f4c7cb1e740 1 -- 172.21.15.5:0/3713089164 --> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a7565445d0 con 0x55a7561e49f0 2024-08-31T05:37:04.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.510+0000 7f4c6f7fe640 1 --2- 172.21.15.5:0/3713089164 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55a7561e49f0 0x55a7565e8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:04.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.511+0000 7f4c4f7fe640 10 client.27017 ms_handle_connect on v2:172.21.15.50:6836/428759669 2024-08-31T05:37:04.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.511+0000 7f4c6f7fe640 1 --2- 172.21.15.5:0/3713089164 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55a7561e49f0 0x55a7565e8eb0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3ffaa6e8c1de3f47 server_cookie=ee71d505aced2acf in_seq=0 out_seq=0 2024-08-31T05:37:04.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.511+0000 7f4c4f7fe640 1 -- 172.21.15.5:0/3713089164 <== mds.4 v2:172.21.15.50:6836/428759669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a7565445d0 con 0x55a7561e49f0 2024-08-31T05:37:04.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.511+0000 7f4c4f7fe640 10 client.27017 handle_command_reply: tid=0 2024-08-31T05:37:04.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.511+0000 7f4c7cb1e740 1 client.27017 shutdown 2024-08-31T05:37:04.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.512+0000 7f4c7cb1e740 1 -- 172.21.15.5:0/3713089164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7561fd1b0 msgr2=0x55a7565d6a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:04.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.512+0000 7f4c7cb1e740 1 --2- 172.21.15.5:0/3713089164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7561fd1b0 0x55a7565d6a80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4c60012810 tx=0x7f4c60012cd0 comp rx=0 tx=0).stop 2024-08-31T05:37:04.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.512+0000 7f4c7cb1e740 1 -- 172.21.15.5:0/3713089164 shutdown_connections 2024-08-31T05:37:04.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.512+0000 7f4c7cb1e740 1 --2- 172.21.15.5:0/3713089164 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55a7561e49f0 0x55a7565e8eb0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:04.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.512+0000 7f4c4f7fe640 0 client.27017 ms_handle_reset on v2:172.21.15.50:6836/428759669 2024-08-31T05:37:04.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.512+0000 7f4c7cb1e740 1 --2- 172.21.15.5:0/3713089164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a756226070 0x55a7565e2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:04.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.512+0000 7f4c7cb1e740 1 --2- 172.21.15.5:0/3713089164 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a756205390 0x55a7565d6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:04.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.512+0000 7f4c7cb1e740 1 --2- 172.21.15.5:0/3713089164 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7561fd1b0 0x55a7565d6a80 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:04.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.512+0000 7f4c7cb1e740 1 -- 172.21.15.5:0/3713089164 >> 172.21.15.5:0/3713089164 conn(0x55a75621a460 msgr2=0x55a7565ce4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:04.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.512+0000 7f4c7cb1e740 1 -- 172.21.15.5:0/3713089164 shutdown_connections 2024-08-31T05:37:04.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.512+0000 7f4c7cb1e740 1 -- 172.21.15.5:0/3713089164 wait complete. 2024-08-31T05:37:04.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.512+0000 7f4c7cb1e740 20 client.27017 trim_cache size 0 max 16384 2024-08-31T05:37:04.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.525+0000 7f4c7cb1e740 1 Processor -- start 2024-08-31T05:37:04.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.526+0000 7f4c7cb1e740 1 -- start start 2024-08-31T05:37:04.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.526+0000 7f4c7cb1e740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7561e49f0 0x55a7565e2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:04.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.526+0000 7f4c7cb1e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7561fd1b0 0x55a7565e3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:04.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.526+0000 7f4c7cb1e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a756205390 0x55a7565ce410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:04.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.526+0000 7f4c7cb1e740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4c701b0c20 con 0x55a7561e49f0 2024-08-31T05:37:04.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.526+0000 7f4c7cb1e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4c701b2760 con 0x55a7561fd1b0 2024-08-31T05:37:04.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.526+0000 7f4c7cb1e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4c701b12f0 con 0x55a756205390 2024-08-31T05:37:04.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.526+0000 7f4c6ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7561e49f0 0x55a7565e2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:04.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.526+0000 7f4c6ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7561e49f0 0x55a7565e2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55980/0 (socket says 172.21.15.5:55980) 2024-08-31T05:37:04.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.526+0000 7f4c6ffff640 1 -- 172.21.15.5:0/125120974 learned_addr learned my addr 172.21.15.5:0/125120974 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:04.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.526+0000 7f4c6f7fe640 1 --2- 172.21.15.5:0/125120974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7561fd1b0 0x55a7565e3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:04.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.526+0000 7f4c74b46640 1 --2- 172.21.15.5:0/125120974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a756205390 0x55a7565ce410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:04.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.526+0000 7f4c6ffff640 1 -- 172.21.15.5:0/125120974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a756205390 msgr2=0x55a7565ce410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:04.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.526+0000 7f4c6ffff640 1 --2- 172.21.15.5:0/125120974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a756205390 0x55a7565ce410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:04.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.526+0000 7f4c6ffff640 1 -- 172.21.15.5:0/125120974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7561fd1b0 msgr2=0x55a7565e3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:04.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.526+0000 7f4c6ffff640 1 --2- 172.21.15.5:0/125120974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7561fd1b0 0x55a7565e3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:04.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.526+0000 7f4c6ffff640 1 -- 172.21.15.5:0/125120974 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7565d4f80 con 0x55a7561e49f0 2024-08-31T05:37:04.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.526+0000 7f4c6f7fe640 1 --2- 172.21.15.5:0/125120974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7561fd1b0 0x55a7565e3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:37:04.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.527+0000 7f4c6ffff640 1 --2- 172.21.15.5:0/125120974 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7561e49f0 0x55a7565e2ce0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f4c60000c00 tx=0x7f4c60009540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2e1a1a46af34fda server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:04.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.527+0000 7f4c55ffb640 1 -- 172.21.15.5:0/125120974 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c6000f920 con 0x55a7561e49f0 2024-08-31T05:37:04.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.527+0000 7f4c55ffb640 1 -- 172.21.15.5:0/125120974 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c6000fac0 con 0x55a7561e49f0 2024-08-31T05:37:04.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.527+0000 7f4c55ffb640 1 -- 172.21.15.5:0/125120974 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c60005600 con 0x55a7561e49f0 2024-08-31T05:37:04.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.528+0000 7f4c7cb1e740 1 -- 172.21.15.5:0/125120974 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7561e49f0 msgr2=0x55a7565e2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:04.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.528+0000 7f4c7cb1e740 1 --2- 172.21.15.5:0/125120974 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7561e49f0 0x55a7565e2ce0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f4c60000c00 tx=0x7f4c60009540 comp rx=0 tx=0).stop 2024-08-31T05:37:04.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.528+0000 7f4c7cb1e740 1 -- 172.21.15.5:0/125120974 shutdown_connections 2024-08-31T05:37:04.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.528+0000 7f4c7cb1e740 1 --2- 172.21.15.5:0/125120974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a756205390 0x55a7565ce410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:04.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.528+0000 7f4c7cb1e740 1 --2- 172.21.15.5:0/125120974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7561fd1b0 0x55a7565e3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:04.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.528+0000 7f4c7cb1e740 1 --2- 172.21.15.5:0/125120974 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7561e49f0 0x55a7565e2ce0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:04.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.528+0000 7f4c7cb1e740 1 -- 172.21.15.5:0/125120974 >> 172.21.15.5:0/125120974 conn(0x55a75621a460 msgr2=0x55a7565d69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:04.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.528+0000 7f4c7cb1e740 1 -- 172.21.15.5:0/125120974 shutdown_connections 2024-08-31T05:37:04.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.528+0000 7f4c7cb1e740 1 -- 172.21.15.5:0/125120974 wait complete. 2024-08-31T05:37:04.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.528+0000 7f4c7cb1e740 1 -- start start 2024-08-31T05:37:04.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.529+0000 7f4c7cb1e740 1 Processor -- start 2024-08-31T05:37:04.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.529+0000 7f4c7cb1e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a7561e49f0 0x55a7565df680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:04.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.529+0000 7f4c7cb1e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7561fd1b0 0x55a7565dab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:04.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.529+0000 7f4c7cb1e740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a756205390 0x55a7565db220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:04.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.529+0000 7f4c7cb1e740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4c701b2090 con 0x55a756205390 2024-08-31T05:37:04.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.529+0000 7f4c7cb1e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4c701b19c0 con 0x55a7561fd1b0 2024-08-31T05:37:04.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.529+0000 7f4c7cb1e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4c701aec00 con 0x55a7561e49f0 2024-08-31T05:37:04.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.529+0000 7f4c7cb1e740 10 client.0 _ll_register_callbacks cb 0x7f4c60009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:37:04.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.529+0000 7f4c74b46640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a756205390 0x55a7565db220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:04.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.529+0000 7f4c6f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7561fd1b0 0x55a7565dab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:04.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.529+0000 7f4c74b46640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a756205390 0x55a7565db220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55982/0 (socket says 172.21.15.5:55982) 2024-08-31T05:37:04.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.529+0000 7f4c6f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7561fd1b0 0x55a7565dab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:45916/0 (socket says 172.21.15.5:45916) 2024-08-31T05:37:04.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.529+0000 7f4c74b46640 1 -- 172.21.15.5:0/2923618031 learned_addr learned my addr 172.21.15.5:0/2923618031 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:04.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.529+0000 7f4c6ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a7561e49f0 0x55a7565df680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:04.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.530+0000 7f4c6ffff640 1 -- 172.21.15.5:0/2923618031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7561fd1b0 msgr2=0x55a7565dab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:04.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.530+0000 7f4c6ffff640 1 --2- 172.21.15.5:0/2923618031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7561fd1b0 0x55a7565dab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:04.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.530+0000 7f4c6ffff640 1 -- 172.21.15.5:0/2923618031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a756205390 msgr2=0x55a7565db220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:04.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.530+0000 7f4c6ffff640 1 --2- 172.21.15.5:0/2923618031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a756205390 0x55a7565db220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:04.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.530+0000 7f4c6ffff640 1 -- 172.21.15.5:0/2923618031 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7565db9b0 con 0x55a7561e49f0 2024-08-31T05:37:04.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.530+0000 7f4c74b46640 1 --2- 172.21.15.5:0/2923618031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a756205390 0x55a7565db220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:37:04.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.530+0000 7f4c6f7fe640 1 --2- 172.21.15.5:0/2923618031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7561fd1b0 0x55a7565dab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:37:04.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.530+0000 7f4c6ffff640 1 --2- 172.21.15.5:0/2923618031 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a7561e49f0 0x55a7565df680 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4c6001c890 tx=0x7f4c6001ddc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=755cc6d066927af server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:04.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.530+0000 7f4c4f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:37:04.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.530+0000 7f4c4f7fe640 1 -- 172.21.15.5:0/2923618031 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c6000f920 con 0x55a7561e49f0 2024-08-31T05:37:04.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.530+0000 7f4c7cb1e740 1 -- 172.21.15.5:0/2923618031 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c6000fac0 con 0x55a7561e49f0 2024-08-31T05:37:04.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.530+0000 7f4c4f7fe640 1 -- 172.21.15.5:0/2923618031 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f4c60018070 con 0x55a7561e49f0 2024-08-31T05:37:04.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.530+0000 7f4c4f7fe640 1 -- 172.21.15.5:0/2923618031 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f4c60005490 con 0x55a7561e49f0 2024-08-31T05:37:04.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.530+0000 7f4c7cb1e740 10 client.27031 fetch_fsmap learned FSMap version 34 2024-08-31T05:37:04.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.530+0000 7f4c7cb1e740 1 -- 172.21.15.5:0/2923618031 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a756653960 con 0x55a7561e49f0 2024-08-31T05:37:04.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.530+0000 7f4c4f7fe640 1 -- 172.21.15.5:0/2923618031 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c6000fac0 con 0x55a7561e49f0 2024-08-31T05:37:04.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.531+0000 7f4c4f7fe640 1 -- 172.21.15.5:0/2923618031 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f4c60033070 con 0x55a7561e49f0 2024-08-31T05:37:04.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.531+0000 7f4c7cb1e740 10 client.27031 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:37:04.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.531+0000 7f4c7cb1e740 10 client.27031 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-31T05:37:04.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.531+0000 7f4c7cb1e740 20 client.27031 populate_metadata read hostname 'smithi005' 2024-08-31T05:37:04.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.531+0000 7f4c7cb1e740 1 --2- 172.21.15.5:0/2923618031 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55a756226070 0x55a7566560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:04.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.531+0000 7f4c7cb1e740 4 client.27031 mds_command: new command op to 24602 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:37:04.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.531+0000 7f4c7cb1e740 1 -- 172.21.15.5:0/2923618031 --> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a756540070 con 0x55a756226070 2024-08-31T05:37:04.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.531+0000 7f4c6f7fe640 1 --2- 172.21.15.5:0/2923618031 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55a756226070 0x55a7566560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:04.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.531+0000 7f4c4f7fe640 10 client.27031 ms_handle_connect on v2:172.21.15.50:6836/428759669 2024-08-31T05:37:04.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.531+0000 7f4c6f7fe640 1 --2- 172.21.15.5:0/2923618031 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55a756226070 0x55a7566560f0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=4a934a2d6d8a0cbf server_cookie=f8a982d09ef4949e in_seq=0 out_seq=0 2024-08-31T05:37:04.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.532+0000 7f4c4f7fe640 1 -- 172.21.15.5:0/2923618031 <== mds.4 v2:172.21.15.50:6836/428759669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a756540070 con 0x55a756226070 2024-08-31T05:37:04.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.532+0000 7f4c4f7fe640 10 client.27031 handle_command_reply: tid=0 2024-08-31T05:37:04.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.532+0000 7f4c7cb1e740 1 client.27031 shutdown 2024-08-31T05:37:04.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.532+0000 7f4c7cb1e740 1 -- 172.21.15.5:0/2923618031 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a7561e49f0 msgr2=0x55a7565df680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:04.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.532+0000 7f4c7cb1e740 1 --2- 172.21.15.5:0/2923618031 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a7561e49f0 0x55a7565df680 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4c6001c890 tx=0x7f4c6001ddc0 comp rx=0 tx=0).stop 2024-08-31T05:37:04.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.532+0000 7f4c7cb1e740 1 -- 172.21.15.5:0/2923618031 shutdown_connections 2024-08-31T05:37:04.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.532+0000 7f4c7cb1e740 1 --2- 172.21.15.5:0/2923618031 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55a756226070 0x55a7566560f0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:04.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.532+0000 7f4c7cb1e740 1 --2- 172.21.15.5:0/2923618031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a756205390 0x55a7565db220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:04.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.532+0000 7f4c7cb1e740 1 --2- 172.21.15.5:0/2923618031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7561fd1b0 0x55a7565dab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:04.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.532+0000 7f4c4f7fe640 0 client.27031 ms_handle_reset on v2:172.21.15.50:6836/428759669 2024-08-31T05:37:04.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.532+0000 7f4c7cb1e740 1 --2- 172.21.15.5:0/2923618031 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a7561e49f0 0x55a7565df680 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:04.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.532+0000 7f4c7cb1e740 1 -- 172.21.15.5:0/2923618031 >> 172.21.15.5:0/2923618031 conn(0x55a75621a460 msgr2=0x55a7565c8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:04.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.532+0000 7f4c7cb1e740 1 -- 172.21.15.5:0/2923618031 shutdown_connections 2024-08-31T05:37:04.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.532+0000 7f4c7cb1e740 1 -- 172.21.15.5:0/2923618031 wait complete. 2024-08-31T05:37:04.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.532+0000 7f4c7cb1e740 20 client.27031 trim_cache size 0 max 16384 2024-08-31T05:37:04.540 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:37:04.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.533+0000 7f4c765a9640 1 -- 172.21.15.5:0/2257922003 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4c580b4d20 msgr2=0x7f4c580b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:04.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.533+0000 7f4c765a9640 1 --2- 172.21.15.5:0/2257922003 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4c580b4d20 0x7f4c580b7230 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4c68047000 tx=0x7f4c68045000 comp rx=0 tx=0).stop 2024-08-31T05:37:04.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.533+0000 7f4c765a9640 1 -- 172.21.15.5:0/2257922003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c70105050 msgr2=0x7f4c7019a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:04.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.533+0000 7f4c765a9640 1 --2- 172.21.15.5:0/2257922003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c70105050 0x7f4c7019a720 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4c7006aad0 tx=0x7f4c6400ee50 comp rx=0 tx=0).stop 2024-08-31T05:37:04.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.533+0000 7f4c765a9640 1 -- 172.21.15.5:0/2257922003 shutdown_connections 2024-08-31T05:37:04.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.533+0000 7f4c765a9640 1 --2- 172.21.15.5:0/2257922003 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4c580b4d20 0x7f4c580b7230 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:04.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.533+0000 7f4c765a9640 1 --2- 172.21.15.5:0/2257922003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4c7010dbd0 0x7f4c7019f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:04.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.533+0000 7f4c765a9640 1 --2- 172.21.15.5:0/2257922003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c70105050 0x7f4c7019a720 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:04.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.533+0000 7f4c765a9640 1 --2- 172.21.15.5:0/2257922003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4c70104620 0x7f4c7019a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:04.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.533+0000 7f4c765a9640 1 -- 172.21.15.5:0/2257922003 >> 172.21.15.5:0/2257922003 conn(0x7f4c700794d0 msgr2=0x7f4c701003d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:04.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.533+0000 7f4c765a9640 1 -- 172.21.15.5:0/2257922003 shutdown_connections 2024-08-31T05:37:04.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:04.533+0000 7f4c765a9640 1 -- 172.21.15.5:0/2257922003 wait complete. 2024-08-31T05:37:04.926 INFO:tasks.workunit.client.0.smithi005.stdout: 1 796042 11.53 MB/sec execute 232 sec latency 27.406 ms 2024-08-31T05:37:05.236 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-31T05:37:05.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:37:05 smithi005 ceph-mon[18602]: pgmap v558: 129 pgs: 129 active+clean; 433 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.5 MiB/s wr, 230 op/s 2024-08-31T05:37:05.500 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:37:05.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:37:05 smithi070 ceph-mon[22316]: pgmap v558: 129 pgs: 129 active+clean; 433 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.5 MiB/s wr, 230 op/s 2024-08-31T05:37:05.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:37:05 smithi050 ceph-mon[22146]: pgmap v558: 129 pgs: 129 active+clean; 433 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.5 MiB/s wr, 230 op/s 2024-08-31T05:37:05.926 INFO:tasks.workunit.client.0.smithi005.stdout: 1 798302 11.53 MB/sec execute 233 sec latency 37.753 ms 2024-08-31T05:37:06.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.046+0000 7f09205ba640 1 -- 172.21.15.5:0/851556237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0918108a90 msgr2=0x7f091810f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:06.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.046+0000 7f09205ba640 1 --2- 172.21.15.5:0/851556237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0918108a90 0x7f091810f2c0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f0910009ca0 tx=0x7f091002a8c0 comp rx=0 tx=0).stop 2024-08-31T05:37:06.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.046+0000 7f09205ba640 1 -- 172.21.15.5:0/851556237 shutdown_connections 2024-08-31T05:37:06.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.046+0000 7f09205ba640 1 --2- 172.21.15.5:0/851556237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0918108a90 0x7f091810f2c0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:06.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.046+0000 7f09205ba640 1 --2- 172.21.15.5:0/851556237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0918108140 0x7f0918108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:06.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.046+0000 7f09205ba640 1 --2- 172.21.15.5:0/851556237 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0918102800 0x7f0918102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:06.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.046+0000 7f09205ba640 1 -- 172.21.15.5:0/851556237 >> 172.21.15.5:0/851556237 conn(0x7f09180794d0 msgr2=0x7f09180798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:06.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.046+0000 7f09205ba640 1 -- 172.21.15.5:0/851556237 shutdown_connections 2024-08-31T05:37:06.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.046+0000 7f09205ba640 1 -- 172.21.15.5:0/851556237 wait complete. 2024-08-31T05:37:06.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.047+0000 7f09205ba640 1 Processor -- start 2024-08-31T05:37:06.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.047+0000 7f09205ba640 1 -- start start 2024-08-31T05:37:06.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.047+0000 7f09205ba640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0918102800 0x7f091819a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:06.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.047+0000 7f09205ba640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0918108140 0x7f091819a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:06.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.047+0000 7f09205ba640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0918108a90 0x7f091819fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:06.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.047+0000 7f09205ba640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0918112710 con 0x7f0918108140 2024-08-31T05:37:06.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.047+0000 7f09205ba640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0918112590 con 0x7f0918102800 2024-08-31T05:37:06.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.047+0000 7f09205ba640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0918112890 con 0x7f0918108a90 2024-08-31T05:37:06.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.047+0000 7f091db55640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0918108140 0x7f091819a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:06.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.047+0000 7f091db55640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0918108140 0x7f091819a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55998/0 (socket says 172.21.15.5:55998) 2024-08-31T05:37:06.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.047+0000 7f091e356640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0918102800 0x7f091819a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:06.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.047+0000 7f091db55640 1 -- 172.21.15.5:0/626943132 learned_addr learned my addr 172.21.15.5:0/626943132 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:06.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.047+0000 7f091eb57640 1 --2- 172.21.15.5:0/626943132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0918108a90 0x7f091819fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:06.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.047+0000 7f091db55640 1 -- 172.21.15.5:0/626943132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0918108a90 msgr2=0x7f091819fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:06.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.047+0000 7f091db55640 1 --2- 172.21.15.5:0/626943132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0918108a90 0x7f091819fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:06.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.047+0000 7f091db55640 1 -- 172.21.15.5:0/626943132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0918102800 msgr2=0x7f091819a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:06.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.047+0000 7f091db55640 1 --2- 172.21.15.5:0/626943132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0918102800 0x7f091819a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:06.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.047+0000 7f091db55640 1 -- 172.21.15.5:0/626943132 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09181a0140 con 0x7f0918108140 2024-08-31T05:37:06.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.047+0000 7f091e356640 1 --2- 172.21.15.5:0/626943132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0918102800 0x7f091819a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:37:06.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.048+0000 7f091db55640 1 --2- 172.21.15.5:0/626943132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0918108140 0x7f091819a770 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f0908005fd0 tx=0x7f090800dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:06.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.048+0000 7f090f7fe640 1 -- 172.21.15.5:0/626943132 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0908017070 con 0x7f0918108140 2024-08-31T05:37:06.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.048+0000 7f09205ba640 1 -- 172.21.15.5:0/626943132 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09181a0430 con 0x7f0918108140 2024-08-31T05:37:06.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.048+0000 7f090f7fe640 1 -- 172.21.15.5:0/626943132 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0908009c30 con 0x7f0918108140 2024-08-31T05:37:06.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.048+0000 7f090f7fe640 1 -- 172.21.15.5:0/626943132 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0908003d30 con 0x7f0918108140 2024-08-31T05:37:06.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.048+0000 7f09205ba640 1 -- 172.21.15.5:0/626943132 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09181a6b90 con 0x7f0918108140 2024-08-31T05:37:06.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.051+0000 7f090f7fe640 1 -- 172.21.15.5:0/626943132 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f0908003ed0 con 0x7f0918108140 2024-08-31T05:37:06.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.051+0000 7f0926b2f740 1 Processor -- start 2024-08-31T05:37:06.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.051+0000 7f0926b2f740 1 -- start start 2024-08-31T05:37:06.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.051+0000 7f0926b2f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557687717070 0x557687abc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:06.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.051+0000 7f0926b2f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5576876ee1b0 0x557687abc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:06.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.051+0000 7f0926b2f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5576876f6390 0x557687abcdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:06.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.051+0000 7f0926b2f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x557687a33680 con 0x5576876ee1b0 2024-08-31T05:37:06.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.051+0000 7f0926b2f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x557687a22c10 con 0x557687717070 2024-08-31T05:37:06.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.051+0000 7f0926b2f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557687a26bc0 con 0x5576876f6390 2024-08-31T05:37:06.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.051+0000 7f091e356640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5576876ee1b0 0x557687abc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:06.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.051+0000 7f091db55640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5576876f6390 0x557687abcdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:06.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.051+0000 7f091eb57640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557687717070 0x557687abc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:06.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.051+0000 7f091eb57640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557687717070 0x557687abc350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:45936/0 (socket says 172.21.15.5:45936) 2024-08-31T05:37:06.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.051+0000 7f091db55640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5576876f6390 0x557687abcdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:39704/0 (socket says 172.21.15.5:39704) 2024-08-31T05:37:06.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.051+0000 7f091eb57640 1 -- 172.21.15.5:0/1346136725 learned_addr learned my addr 172.21.15.5:0/1346136725 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:06.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.052+0000 7f091eb57640 1 -- 172.21.15.5:0/1346136725 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5576876f6390 msgr2=0x557687abcdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:06.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.052+0000 7f091eb57640 1 --2- 172.21.15.5:0/1346136725 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5576876f6390 0x557687abcdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:06.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.052+0000 7f091eb57640 1 -- 172.21.15.5:0/1346136725 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5576876ee1b0 msgr2=0x557687abc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:06.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.052+0000 7f090f7fe640 1 --2- 172.21.15.5:0/626943132 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f09040b4ca0 0x7f09040b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:06.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.052+0000 7f091eb57640 1 --2- 172.21.15.5:0/1346136725 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5576876ee1b0 0x557687abc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:06.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.052+0000 7f091eb57640 1 -- 172.21.15.5:0/1346136725 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557687782650 con 0x557687717070 2024-08-31T05:37:06.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.052+0000 7f090f7fe640 1 -- 172.21.15.5:0/626943132 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f09080e5440 con 0x7f0918108140 2024-08-31T05:37:06.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.052+0000 7f091eb57640 1 --2- 172.21.15.5:0/626943132 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f09040b4ca0 0x7f09040b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:06.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.052+0000 7f091eb57640 1 --2- 172.21.15.5:0/1346136725 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557687717070 0x557687abc350 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f091002f4c0 tx=0x7f0910009800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e199f3a4fe356f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:06.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.052+0000 7f090cff9640 1 -- 172.21.15.5:0/1346136725 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f091004a070 con 0x557687717070 2024-08-31T05:37:06.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.052+0000 7f090cff9640 1 -- 172.21.15.5:0/1346136725 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0910036030 con 0x557687717070 2024-08-31T05:37:06.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.052+0000 7f090cff9640 1 -- 172.21.15.5:0/1346136725 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0910004640 con 0x557687717070 2024-08-31T05:37:06.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.053+0000 7f0926b2f740 1 -- 172.21.15.5:0/1346136725 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557687717070 msgr2=0x557687abc350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:06.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.053+0000 7f0926b2f740 1 --2- 172.21.15.5:0/1346136725 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557687717070 0x557687abc350 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f091002f4c0 tx=0x7f0910009800 comp rx=0 tx=0).stop 2024-08-31T05:37:06.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.053+0000 7f091eb57640 1 --2- 172.21.15.5:0/626943132 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f09040b4ca0 0x7f09040b71b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0910009a60 tx=0x7f09100048a0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:06.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.053+0000 7f0926b2f740 1 -- 172.21.15.5:0/1346136725 shutdown_connections 2024-08-31T05:37:06.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.053+0000 7f0926b2f740 1 --2- 172.21.15.5:0/1346136725 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5576876f6390 0x557687abcdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:06.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.053+0000 7f0926b2f740 1 --2- 172.21.15.5:0/1346136725 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5576876ee1b0 0x557687abc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:06.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.053+0000 7f0926b2f740 1 --2- 172.21.15.5:0/1346136725 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557687717070 0x557687abc350 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:06.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.053+0000 7f0926b2f740 1 -- 172.21.15.5:0/1346136725 >> 172.21.15.5:0/1346136725 conn(0x55768770b460 msgr2=0x557687aba240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:06.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.053+0000 7f0926b2f740 1 -- 172.21.15.5:0/1346136725 shutdown_connections 2024-08-31T05:37:06.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.053+0000 7f0926b2f740 1 -- 172.21.15.5:0/1346136725 wait complete. 2024-08-31T05:37:06.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.054+0000 7f0926b2f740 1 -- start start 2024-08-31T05:37:06.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.054+0000 7f0926b2f740 1 Processor -- start 2024-08-31T05:37:06.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.054+0000 7f0926b2f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5576876ee1b0 0x557687acbe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:06.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.054+0000 7f0926b2f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5576876f6390 0x557687acc370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:06.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.054+0000 7f0926b2f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557687717070 0x557687ad7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:06.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.054+0000 7f0926b2f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x557687885700 con 0x5576876f6390 2024-08-31T05:37:06.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.054+0000 7f0926b2f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5576879a9750 con 0x557687717070 2024-08-31T05:37:06.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.054+0000 7f0926b2f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557687acec50 con 0x5576876ee1b0 2024-08-31T05:37:06.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.054+0000 7f0926b2f740 10 client.0 _ll_register_callbacks cb 0x5576879d8e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:37:06.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.054+0000 7f091db55640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5576876f6390 0x557687acc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:06.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.054+0000 7f091e356640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5576876ee1b0 0x557687acbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:06.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.054+0000 7f091db55640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5576876f6390 0x557687acc370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56022/0 (socket says 172.21.15.5:56022) 2024-08-31T05:37:06.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.054+0000 7f091db55640 1 -- 172.21.15.5:0/3174221379 learned_addr learned my addr 172.21.15.5:0/3174221379 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:06.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.054+0000 7f091eb57640 1 --2- 172.21.15.5:0/3174221379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557687717070 0x557687ad7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:06.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.055+0000 7f091db55640 1 -- 172.21.15.5:0/3174221379 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5576876ee1b0 msgr2=0x557687acbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:06.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.055+0000 7f091db55640 1 --2- 172.21.15.5:0/3174221379 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5576876ee1b0 0x557687acbe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:06.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.055+0000 7f091db55640 1 -- 172.21.15.5:0/3174221379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557687717070 msgr2=0x557687ad7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:06.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.055+0000 7f091db55640 1 --2- 172.21.15.5:0/3174221379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557687717070 0x557687ad7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:06.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.055+0000 7f091db55640 1 -- 172.21.15.5:0/3174221379 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576879e2900 con 0x5576876f6390 2024-08-31T05:37:06.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.055+0000 7f091e356640 1 --2- 172.21.15.5:0/3174221379 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5576876ee1b0 0x557687acbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:37:06.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.055+0000 7f091db55640 1 --2- 172.21.15.5:0/3174221379 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5576876f6390 0x557687acc370 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f0908009610 tx=0x7f09080a7840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b78b08da33bb281f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:06.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.055+0000 7f0901ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:37:06.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.055+0000 7f0901ffb640 1 -- 172.21.15.5:0/3174221379 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09080ab360 con 0x5576876f6390 2024-08-31T05:37:06.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.055+0000 7f0901ffb640 1 -- 172.21.15.5:0/3174221379 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f09080041c0 con 0x5576876f6390 2024-08-31T05:37:06.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.055+0000 7f0926b2f740 1 -- 172.21.15.5:0/3174221379 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0910036030 con 0x5576876f6390 2024-08-31T05:37:06.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.055+0000 7f0901ffb640 1 -- 172.21.15.5:0/3174221379 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f0908009de0 con 0x5576876f6390 2024-08-31T05:37:06.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.055+0000 7f0926b2f740 10 client.17451 fetch_fsmap learned FSMap version 34 2024-08-31T05:37:06.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.055+0000 7f0926b2f740 1 -- 172.21.15.5:0/3174221379 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x557687ada9e0 con 0x5576876f6390 2024-08-31T05:37:06.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.056+0000 7f0901ffb640 1 -- 172.21.15.5:0/3174221379 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0910036030 con 0x5576876f6390 2024-08-31T05:37:06.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.056+0000 7f0901ffb640 1 -- 172.21.15.5:0/3174221379 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f09080e50d0 con 0x5576876f6390 2024-08-31T05:37:06.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.056+0000 7f0926b2f740 10 client.17451 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:37:06.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.056+0000 7f0926b2f740 10 client.17451 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-31T05:37:06.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.056+0000 7f0926b2f740 20 client.17451 populate_metadata read hostname 'smithi005' 2024-08-31T05:37:06.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.056+0000 7f0926b2f740 1 --2- 172.21.15.5:0/3174221379 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5576876d59f0 0x557687addeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:06.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.056+0000 7f0926b2f740 4 client.17451 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:37:06.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.056+0000 7f0926b2f740 1 -- 172.21.15.5:0/3174221379 --> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557687a355d0 con 0x5576876d59f0 2024-08-31T05:37:06.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.056+0000 7f091e356640 1 --2- 172.21.15.5:0/3174221379 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5576876d59f0 0x557687addeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:06.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.057+0000 7f0901ffb640 10 client.17451 ms_handle_connect on v2:172.21.15.70:6834/2061504114 2024-08-31T05:37:06.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.057+0000 7f091e356640 1 --2- 172.21.15.5:0/3174221379 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5576876d59f0 0x557687addeb0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=db81cd7cdfafcec8 server_cookie=86dee1c489f72630 in_seq=0 out_seq=0 2024-08-31T05:37:06.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.057+0000 7f0901ffb640 1 -- 172.21.15.5:0/3174221379 <== mds.3 v2:172.21.15.70:6834/2061504114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557687a355d0 con 0x5576876d59f0 2024-08-31T05:37:06.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.057+0000 7f0901ffb640 10 client.17451 handle_command_reply: tid=0 2024-08-31T05:37:06.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.057+0000 7f0926b2f740 1 client.17451 shutdown 2024-08-31T05:37:06.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.057+0000 7f0926b2f740 1 -- 172.21.15.5:0/3174221379 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5576876f6390 msgr2=0x557687acc370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:06.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.057+0000 7f0926b2f740 1 --2- 172.21.15.5:0/3174221379 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5576876f6390 0x557687acc370 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f0908009610 tx=0x7f09080a7840 comp rx=0 tx=0).stop 2024-08-31T05:37:06.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.057+0000 7f0926b2f740 1 -- 172.21.15.5:0/3174221379 shutdown_connections 2024-08-31T05:37:06.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.057+0000 7f0926b2f740 1 --2- 172.21.15.5:0/3174221379 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5576876d59f0 0x557687addeb0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:06.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.057+0000 7f0926b2f740 1 --2- 172.21.15.5:0/3174221379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557687717070 0x557687ad7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:06.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.057+0000 7f0926b2f740 1 --2- 172.21.15.5:0/3174221379 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5576876f6390 0x557687acc370 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:06.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.057+0000 7f0926b2f740 1 --2- 172.21.15.5:0/3174221379 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5576876ee1b0 0x557687acbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:06.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.057+0000 7f0926b2f740 1 -- 172.21.15.5:0/3174221379 >> 172.21.15.5:0/3174221379 conn(0x55768770b460 msgr2=0x557687ab8800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:06.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.058+0000 7f0901ffb640 0 client.17451 ms_handle_reset on v2:172.21.15.70:6834/2061504114 2024-08-31T05:37:06.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.058+0000 7f0926b2f740 1 -- 172.21.15.5:0/3174221379 shutdown_connections 2024-08-31T05:37:06.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.058+0000 7f0926b2f740 1 -- 172.21.15.5:0/3174221379 wait complete. 2024-08-31T05:37:06.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.058+0000 7f0926b2f740 20 client.17451 trim_cache size 0 max 16384 2024-08-31T05:37:06.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.072+0000 7f0926b2f740 1 Processor -- start 2024-08-31T05:37:06.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.072+0000 7f0926b2f740 1 -- start start 2024-08-31T05:37:06.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.072+0000 7f0926b2f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5576876ee1b0 0x557687abda90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:06.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.072+0000 7f0926b2f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5576876f6390 0x557687ad7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:06.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.072+0000 7f0926b2f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557687717070 0x557687ac9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:06.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.072+0000 7f0926b2f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f09181ae980 con 0x5576876f6390 2024-08-31T05:37:06.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.072+0000 7f0926b2f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f09181b04c0 con 0x557687717070 2024-08-31T05:37:06.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.072+0000 7f0926b2f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f09181af050 con 0x5576876ee1b0 2024-08-31T05:37:06.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.072+0000 7f091db55640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5576876f6390 0x557687ad7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:06.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.072+0000 7f091e356640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5576876ee1b0 0x557687abda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:06.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.072+0000 7f091db55640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5576876f6390 0x557687ad7eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56038/0 (socket says 172.21.15.5:56038) 2024-08-31T05:37:06.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.072+0000 7f091db55640 1 -- 172.21.15.5:0/1520359416 learned_addr learned my addr 172.21.15.5:0/1520359416 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:06.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.072+0000 7f091eb57640 1 --2- 172.21.15.5:0/1520359416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557687717070 0x557687ac9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:06.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.072+0000 7f091db55640 1 -- 172.21.15.5:0/1520359416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5576876ee1b0 msgr2=0x557687abda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:06.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.072+0000 7f091db55640 1 --2- 172.21.15.5:0/1520359416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5576876ee1b0 0x557687abda90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:06.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.072+0000 7f091db55640 1 -- 172.21.15.5:0/1520359416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557687717070 msgr2=0x557687ac9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:06.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.072+0000 7f091db55640 1 --2- 172.21.15.5:0/1520359416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557687717070 0x557687ac9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:06.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.072+0000 7f091db55640 1 -- 172.21.15.5:0/1520359416 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557687abf180 con 0x5576876f6390 2024-08-31T05:37:06.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.072+0000 7f091e356640 1 --2- 172.21.15.5:0/1520359416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5576876ee1b0 0x557687abda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:37:06.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.072+0000 7f091eb57640 1 --2- 172.21.15.5:0/1520359416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557687717070 0x557687ac9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:37:06.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.073+0000 7f091db55640 1 --2- 172.21.15.5:0/1520359416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5576876f6390 0x557687ad7eb0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f09080a7750 tx=0x7f09080b4c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9e4f6444637bdb5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:06.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.073+0000 7f0903fff640 1 -- 172.21.15.5:0/1520359416 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09080ab1a0 con 0x5576876f6390 2024-08-31T05:37:06.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.073+0000 7f0903fff640 1 -- 172.21.15.5:0/1520359416 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09080ab360 con 0x5576876f6390 2024-08-31T05:37:06.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.073+0000 7f0903fff640 1 -- 172.21.15.5:0/1520359416 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09080e50d0 con 0x5576876f6390 2024-08-31T05:37:06.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.074+0000 7f0926b2f740 1 -- 172.21.15.5:0/1520359416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5576876f6390 msgr2=0x557687ad7eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:06.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.074+0000 7f0926b2f740 1 --2- 172.21.15.5:0/1520359416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5576876f6390 0x557687ad7eb0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f09080a7750 tx=0x7f09080b4c50 comp rx=0 tx=0).stop 2024-08-31T05:37:06.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.074+0000 7f0926b2f740 1 -- 172.21.15.5:0/1520359416 shutdown_connections 2024-08-31T05:37:06.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.074+0000 7f0926b2f740 1 --2- 172.21.15.5:0/1520359416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557687717070 0x557687ac9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:06.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.074+0000 7f0926b2f740 1 --2- 172.21.15.5:0/1520359416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5576876f6390 0x557687ad7eb0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:06.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.074+0000 7f0926b2f740 1 --2- 172.21.15.5:0/1520359416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5576876ee1b0 0x557687abda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:06.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.074+0000 7f0926b2f740 1 -- 172.21.15.5:0/1520359416 >> 172.21.15.5:0/1520359416 conn(0x55768770b460 msgr2=0x557687abd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:06.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.074+0000 7f0926b2f740 1 -- 172.21.15.5:0/1520359416 shutdown_connections 2024-08-31T05:37:06.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.074+0000 7f0926b2f740 1 -- 172.21.15.5:0/1520359416 wait complete. 2024-08-31T05:37:06.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.074+0000 7f0926b2f740 1 -- start start 2024-08-31T05:37:06.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.074+0000 7f0926b2f740 1 Processor -- start 2024-08-31T05:37:06.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.075+0000 7f0926b2f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5576876ee1b0 0x557687ad4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:06.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.075+0000 7f0926b2f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576876f6390 0x557687ad0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:06.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.075+0000 7f0926b2f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557687717070 0x557687ad0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:06.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.075+0000 7f0926b2f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f09181afdf0 con 0x557687717070 2024-08-31T05:37:06.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.075+0000 7f0926b2f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f09181af720 con 0x5576876f6390 2024-08-31T05:37:06.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.075+0000 7f0926b2f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f09181ac960 con 0x5576876ee1b0 2024-08-31T05:37:06.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.075+0000 7f0926b2f740 10 client.0 _ll_register_callbacks cb 0x7f0908005bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:37:06.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.075+0000 7f091db55640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576876f6390 0x557687ad0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:06.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.075+0000 7f091eb57640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557687717070 0x557687ad0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:06.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.075+0000 7f091db55640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576876f6390 0x557687ad0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:45968/0 (socket says 172.21.15.5:45968) 2024-08-31T05:37:06.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.075+0000 7f091db55640 1 -- 172.21.15.5:0/4010902268 learned_addr learned my addr 172.21.15.5:0/4010902268 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:06.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.075+0000 7f091e356640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5576876ee1b0 0x557687ad4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:06.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.075+0000 7f091db55640 1 -- 172.21.15.5:0/4010902268 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5576876ee1b0 msgr2=0x557687ad4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:06.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.075+0000 7f091db55640 1 --2- 172.21.15.5:0/4010902268 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5576876ee1b0 0x557687ad4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:06.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.075+0000 7f091db55640 1 -- 172.21.15.5:0/4010902268 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557687717070 msgr2=0x557687ad0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:06.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.075+0000 7f091db55640 1 --2- 172.21.15.5:0/4010902268 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557687717070 0x557687ad0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:06.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.075+0000 7f091db55640 1 -- 172.21.15.5:0/4010902268 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557687ad13c0 con 0x5576876f6390 2024-08-31T05:37:06.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.075+0000 7f091eb57640 1 --2- 172.21.15.5:0/4010902268 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557687717070 0x557687ad0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:37:06.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.075+0000 7f091e356640 1 --2- 172.21.15.5:0/4010902268 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5576876ee1b0 0x557687ad4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:37:06.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.076+0000 7f091db55640 1 --2- 172.21.15.5:0/4010902268 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576876f6390 0x557687ad0940 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f09080b4ce0 tx=0x7f09080b4bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=778a9ccbfc4f79d5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:06.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.076+0000 7f0901ffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:37:06.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.076+0000 7f0901ffb640 1 -- 172.21.15.5:0/4010902268 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09080ab1a0 con 0x5576876f6390 2024-08-31T05:37:06.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.076+0000 7f0901ffb640 1 -- 172.21.15.5:0/4010902268 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f09080a7e40 con 0x5576876f6390 2024-08-31T05:37:06.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.076+0000 7f0926b2f740 1 -- 172.21.15.5:0/4010902268 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f09080ab360 con 0x5576876f6390 2024-08-31T05:37:06.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.076+0000 7f0901ffb640 1 -- 172.21.15.5:0/4010902268 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f09080ab850 con 0x5576876f6390 2024-08-31T05:37:06.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.076+0000 7f0926b2f740 10 client.27041 fetch_fsmap learned FSMap version 34 2024-08-31T05:37:06.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.076+0000 7f0926b2f740 1 -- 172.21.15.5:0/4010902268 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x557687b49520 con 0x5576876f6390 2024-08-31T05:37:06.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.076+0000 7f0901ffb640 1 -- 172.21.15.5:0/4010902268 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09080ab360 con 0x5576876f6390 2024-08-31T05:37:06.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.077+0000 7f0901ffb640 1 -- 172.21.15.5:0/4010902268 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f09080b1250 con 0x5576876f6390 2024-08-31T05:37:06.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.077+0000 7f0926b2f740 10 client.27041 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:37:06.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.077+0000 7f0926b2f740 10 client.27041 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-31T05:37:06.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.077+0000 7f0926b2f740 20 client.27041 populate_metadata read hostname 'smithi005' 2024-08-31T05:37:06.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.077+0000 7f0926b2f740 1 --2- 172.21.15.5:0/4010902268 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5576876aada0 0x557687b4b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:06.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.077+0000 7f0926b2f740 4 client.27041 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:37:06.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.077+0000 7f0926b2f740 1 -- 172.21.15.5:0/4010902268 --> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557687a31070 con 0x5576876aada0 2024-08-31T05:37:06.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.077+0000 7f091e356640 1 --2- 172.21.15.5:0/4010902268 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5576876aada0 0x557687b4b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:06.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.077+0000 7f0901ffb640 10 client.27041 ms_handle_connect on v2:172.21.15.70:6834/2061504114 2024-08-31T05:37:06.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.077+0000 7f091e356640 1 --2- 172.21.15.5:0/4010902268 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5576876aada0 0x557687b4b940 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=db35e68c7291fb75 server_cookie=1e8074a48cd287a3 in_seq=0 out_seq=0 2024-08-31T05:37:06.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.078+0000 7f0901ffb640 1 -- 172.21.15.5:0/4010902268 <== mds.3 v2:172.21.15.70:6834/2061504114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557687a31070 con 0x5576876aada0 2024-08-31T05:37:06.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.078+0000 7f0901ffb640 10 client.27041 handle_command_reply: tid=0 2024-08-31T05:37:06.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.078+0000 7f0926b2f740 1 client.27041 shutdown 2024-08-31T05:37:06.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.078+0000 7f0926b2f740 1 -- 172.21.15.5:0/4010902268 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576876f6390 msgr2=0x557687ad0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:06.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.078+0000 7f0926b2f740 1 --2- 172.21.15.5:0/4010902268 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576876f6390 0x557687ad0940 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f09080b4ce0 tx=0x7f09080b4bc0 comp rx=0 tx=0).stop 2024-08-31T05:37:06.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.078+0000 7f0926b2f740 1 -- 172.21.15.5:0/4010902268 shutdown_connections 2024-08-31T05:37:06.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.078+0000 7f0926b2f740 1 --2- 172.21.15.5:0/4010902268 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5576876aada0 0x557687b4b940 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:06.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.078+0000 7f0901ffb640 0 client.27041 ms_handle_reset on v2:172.21.15.70:6834/2061504114 2024-08-31T05:37:06.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.078+0000 7f0926b2f740 1 --2- 172.21.15.5:0/4010902268 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557687717070 0x557687ad0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:06.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.078+0000 7f0926b2f740 1 --2- 172.21.15.5:0/4010902268 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576876f6390 0x557687ad0940 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:06.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.078+0000 7f0926b2f740 1 --2- 172.21.15.5:0/4010902268 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5576876ee1b0 0x557687ad4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:06.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.078+0000 7f0926b2f740 1 -- 172.21.15.5:0/4010902268 >> 172.21.15.5:0/4010902268 conn(0x55768770b460 msgr2=0x557687abdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:06.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.078+0000 7f0926b2f740 1 -- 172.21.15.5:0/4010902268 shutdown_connections 2024-08-31T05:37:06.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.078+0000 7f0926b2f740 1 -- 172.21.15.5:0/4010902268 wait complete. 2024-08-31T05:37:06.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.078+0000 7f0926b2f740 20 client.27041 trim_cache size 0 max 16384 2024-08-31T05:37:06.088 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:37:06.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.079+0000 7f09205ba640 1 -- 172.21.15.5:0/626943132 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f09040b4ca0 msgr2=0x7f09040b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:06.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.079+0000 7f09205ba640 1 --2- 172.21.15.5:0/626943132 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f09040b4ca0 0x7f09040b71b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0910009a60 tx=0x7f09100048a0 comp rx=0 tx=0).stop 2024-08-31T05:37:06.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.079+0000 7f09205ba640 1 -- 172.21.15.5:0/626943132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0918108140 msgr2=0x7f091819a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:06.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.079+0000 7f09205ba640 1 --2- 172.21.15.5:0/626943132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0918108140 0x7f091819a770 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f0908005fd0 tx=0x7f090800dde0 comp rx=0 tx=0).stop 2024-08-31T05:37:06.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.079+0000 7f09205ba640 1 -- 172.21.15.5:0/626943132 shutdown_connections 2024-08-31T05:37:06.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.079+0000 7f09205ba640 1 --2- 172.21.15.5:0/626943132 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f09040b4ca0 0x7f09040b71b0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:06.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.079+0000 7f09205ba640 1 --2- 172.21.15.5:0/626943132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0918108a90 0x7f091819fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:06.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.079+0000 7f09205ba640 1 --2- 172.21.15.5:0/626943132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0918108140 0x7f091819a770 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:06.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.079+0000 7f09205ba640 1 --2- 172.21.15.5:0/626943132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0918102800 0x7f091819a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:06.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.079+0000 7f09205ba640 1 -- 172.21.15.5:0/626943132 >> 172.21.15.5:0/626943132 conn(0x7f09180794d0 msgr2=0x7f091806af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:06.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.079+0000 7f09205ba640 1 -- 172.21.15.5:0/626943132 shutdown_connections 2024-08-31T05:37:06.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:06.079+0000 7f09205ba640 1 -- 172.21.15.5:0/626943132 wait complete. 2024-08-31T05:37:06.808 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T05:37:06.926 INFO:tasks.workunit.client.0.smithi005.stdout: 1 800017 11.52 MB/sec execute 234 sec latency 37.367 ms 2024-08-31T05:37:07.117 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:37:07.532 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:37:07 smithi005 ceph-mon[18602]: pgmap v559: 129 pgs: 129 active+clean; 435 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.4 MiB/s wr, 294 op/s 2024-08-31T05:37:07.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:37:07 smithi070 ceph-mon[22316]: pgmap v559: 129 pgs: 129 active+clean; 435 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.4 MiB/s wr, 294 op/s 2024-08-31T05:37:07.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.623+0000 7f5f97fc2640 1 -- 172.21.15.5:0/416213662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f90108170 msgr2=0x7f5f90108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:07.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.623+0000 7f5f97fc2640 1 --2- 172.21.15.5:0/416213662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f90108170 0x7f5f90108580 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f5f84009900 tx=0x7f5f8402a410 comp rx=0 tx=0).stop 2024-08-31T05:37:07.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.623+0000 7f5f97fc2640 1 -- 172.21.15.5:0/416213662 shutdown_connections 2024-08-31T05:37:07.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.623+0000 7f5f97fc2640 1 --2- 172.21.15.5:0/416213662 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f90108ac0 0x7f5f9010f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:07.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.623+0000 7f5f97fc2640 1 --2- 172.21.15.5:0/416213662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f90108170 0x7f5f90108580 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:07.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.623+0000 7f5f97fc2640 1 --2- 172.21.15.5:0/416213662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f90102830 0x7f5f90102c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:07.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.623+0000 7f5f97fc2640 1 -- 172.21.15.5:0/416213662 >> 172.21.15.5:0/416213662 conn(0x7f5f900794d0 msgr2=0x7f5f900798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:07.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.623+0000 7f5f97fc2640 1 -- 172.21.15.5:0/416213662 shutdown_connections 2024-08-31T05:37:07.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.623+0000 7f5f97fc2640 1 -- 172.21.15.5:0/416213662 wait complete. 2024-08-31T05:37:07.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.624+0000 7f5f97fc2640 1 Processor -- start 2024-08-31T05:37:07.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.624+0000 7f5f97fc2640 1 -- start start 2024-08-31T05:37:07.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.624+0000 7f5f97fc2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f90102830 0x7f5f9019c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:07.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.624+0000 7f5f97fc2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f90108170 0x7f5f9019caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:07.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.624+0000 7f5f97fc2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f90108ac0 0x7f5f901a1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:07.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.624+0000 7f5f97fc2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5f90112750 con 0x7f5f90102830 2024-08-31T05:37:07.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.624+0000 7f5f97fc2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5f901125d0 con 0x7f5f90108170 2024-08-31T05:37:07.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.624+0000 7f5f97fc2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5f901128d0 con 0x7f5f90108ac0 2024-08-31T05:37:07.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.624+0000 7f5f95d5e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f90102830 0x7f5f9019c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:07.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.624+0000 7f5f95d5e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f90102830 0x7f5f9019c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56052/0 (socket says 172.21.15.5:56052) 2024-08-31T05:37:07.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.624+0000 7f5f95d5e640 1 -- 172.21.15.5:0/3481997496 learned_addr learned my addr 172.21.15.5:0/3481997496 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:07.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.624+0000 7f5f9555d640 1 --2- 172.21.15.5:0/3481997496 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f90108170 0x7f5f9019caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:07.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.624+0000 7f5f9655f640 1 --2- 172.21.15.5:0/3481997496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f90108ac0 0x7f5f901a1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:07.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.625+0000 7f5f95d5e640 1 -- 172.21.15.5:0/3481997496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f90108ac0 msgr2=0x7f5f901a1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:07.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.625+0000 7f5f95d5e640 1 --2- 172.21.15.5:0/3481997496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f90108ac0 0x7f5f901a1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:07.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.625+0000 7f5f95d5e640 1 -- 172.21.15.5:0/3481997496 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f90108170 msgr2=0x7f5f9019caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:07.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.625+0000 7f5f95d5e640 1 --2- 172.21.15.5:0/3481997496 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f90108170 0x7f5f9019caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:07.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.625+0000 7f5f95d5e640 1 -- 172.21.15.5:0/3481997496 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f901a2470 con 0x7f5f90102830 2024-08-31T05:37:07.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.625+0000 7f5f9555d640 1 --2- 172.21.15.5:0/3481997496 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f90108170 0x7f5f9019caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:37:07.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.625+0000 7f5f95d5e640 1 --2- 172.21.15.5:0/3481997496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f90102830 0x7f5f9019c500 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f5f80009d50 tx=0x7f5f8000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:07.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.625+0000 7f5f8effd640 1 -- 172.21.15.5:0/3481997496 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f80003b70 con 0x7f5f90102830 2024-08-31T05:37:07.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.625+0000 7f5f97fc2640 1 -- 172.21.15.5:0/3481997496 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f901a2760 con 0x7f5f90102830 2024-08-31T05:37:07.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.625+0000 7f5f8effd640 1 -- 172.21.15.5:0/3481997496 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f80003d10 con 0x7f5f90102830 2024-08-31T05:37:07.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.625+0000 7f5f8effd640 1 -- 172.21.15.5:0/3481997496 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f800108b0 con 0x7f5f90102830 2024-08-31T05:37:07.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.625+0000 7f5f97fc2640 1 -- 172.21.15.5:0/3481997496 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f901a8ec0 con 0x7f5f90102830 2024-08-31T05:37:07.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.628+0000 7f5f9e537740 1 Processor -- start 2024-08-31T05:37:07.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.628+0000 7f5f9e537740 1 -- start start 2024-08-31T05:37:07.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.628+0000 7f5f8effd640 1 -- 172.21.15.5:0/3481997496 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f5f80010a50 con 0x7f5f90102830 2024-08-31T05:37:07.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.628+0000 7f5f9e537740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ddf4018070 0x55ddf43bd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:07.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.628+0000 7f5f9e537740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ddf3fef1b0 0x55ddf43bd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:07.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.628+0000 7f5f9e537740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ddf3ff7390 0x55ddf43bdd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:07.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.628+0000 7f5f9e537740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55ddf4334680 con 0x55ddf4018070 2024-08-31T05:37:07.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.628+0000 7f5f9e537740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ddf4323c10 con 0x55ddf3fef1b0 2024-08-31T05:37:07.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.628+0000 7f5f9e537740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ddf4327bc0 con 0x55ddf3ff7390 2024-08-31T05:37:07.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.628+0000 7f5f9655f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ddf4018070 0x55ddf43bd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:07.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.628+0000 7f5f9655f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ddf4018070 0x55ddf43bd310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56056/0 (socket says 172.21.15.5:56056) 2024-08-31T05:37:07.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.628+0000 7f5f9655f640 1 -- 172.21.15.5:0/521511428 learned_addr learned my addr 172.21.15.5:0/521511428 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:07.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.629+0000 7f5f9555d640 1 --2- 172.21.15.5:0/521511428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ddf3ff7390 0x55ddf43bdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:07.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.629+0000 7f5f95d5e640 1 --2- 172.21.15.5:0/521511428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ddf3fef1b0 0x55ddf43bd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:07.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.629+0000 7f5f9655f640 1 -- 172.21.15.5:0/521511428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ddf3ff7390 msgr2=0x55ddf43bdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:07.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.629+0000 7f5f9655f640 1 --2- 172.21.15.5:0/521511428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ddf3ff7390 0x55ddf43bdd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:07.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.629+0000 7f5f9655f640 1 -- 172.21.15.5:0/521511428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ddf3fef1b0 msgr2=0x55ddf43bd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:07.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.629+0000 7f5f9655f640 1 --2- 172.21.15.5:0/521511428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ddf3fef1b0 0x55ddf43bd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:07.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.629+0000 7f5f9655f640 1 -- 172.21.15.5:0/521511428 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddf4083650 con 0x55ddf4018070 2024-08-31T05:37:07.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.629+0000 7f5f9555d640 1 --2- 172.21.15.5:0/521511428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ddf3ff7390 0x55ddf43bdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:37:07.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.629+0000 7f5f95d5e640 1 --2- 172.21.15.5:0/521511428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ddf3fef1b0 0x55ddf43bd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:37:07.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.629+0000 7f5f9655f640 1 --2- 172.21.15.5:0/521511428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ddf4018070 0x55ddf43bd310 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f5f88009c20 tx=0x7f5f88011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2e49b5db1988637 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:07.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.629+0000 7f5f8effd640 1 --2- 172.21.15.5:0/3481997496 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5f780b4ca0 0x7f5f780b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:07.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.629+0000 7f5f77fff640 1 -- 172.21.15.5:0/521511428 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8801e070 con 0x55ddf4018070 2024-08-31T05:37:07.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.629+0000 7f5f77fff640 1 -- 172.21.15.5:0/521511428 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f88019ae0 con 0x55ddf4018070 2024-08-31T05:37:07.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.629+0000 7f5f77fff640 1 -- 172.21.15.5:0/521511428 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8800e960 con 0x55ddf4018070 2024-08-31T05:37:07.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.630+0000 7f5f95d5e640 1 --2- 172.21.15.5:0/3481997496 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5f780b4ca0 0x7f5f780b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:07.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.630+0000 7f5f8effd640 1 -- 172.21.15.5:0/3481997496 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f5f800e5f70 con 0x7f5f90102830 2024-08-31T05:37:07.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.630+0000 7f5f9e537740 1 -- 172.21.15.5:0/521511428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ddf4018070 msgr2=0x55ddf43bd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:07.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.630+0000 7f5f95d5e640 1 --2- 172.21.15.5:0/3481997496 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5f780b4ca0 0x7f5f780b71b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5f800e33f0 tx=0x7f5f80004930 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:07.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.630+0000 7f5f9e537740 1 --2- 172.21.15.5:0/521511428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ddf4018070 0x55ddf43bd310 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f5f88009c20 tx=0x7f5f88011810 comp rx=0 tx=0).stop 2024-08-31T05:37:07.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.630+0000 7f5f9e537740 1 -- 172.21.15.5:0/521511428 shutdown_connections 2024-08-31T05:37:07.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.630+0000 7f5f9e537740 1 --2- 172.21.15.5:0/521511428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ddf3ff7390 0x55ddf43bdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:07.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.630+0000 7f5f9e537740 1 --2- 172.21.15.5:0/521511428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ddf3fef1b0 0x55ddf43bd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:07.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.630+0000 7f5f9e537740 1 --2- 172.21.15.5:0/521511428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ddf4018070 0x55ddf43bd310 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:07.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.630+0000 7f5f9e537740 1 -- 172.21.15.5:0/521511428 >> 172.21.15.5:0/521511428 conn(0x55ddf400c460 msgr2=0x55ddf43bb200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:07.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.631+0000 7f5f9e537740 1 -- 172.21.15.5:0/521511428 shutdown_connections 2024-08-31T05:37:07.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.631+0000 7f5f9e537740 1 -- 172.21.15.5:0/521511428 wait complete. 2024-08-31T05:37:07.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.631+0000 7f5f9e537740 1 -- start start 2024-08-31T05:37:07.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.631+0000 7f5f9e537740 1 Processor -- start 2024-08-31T05:37:07.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.631+0000 7f5f9e537740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ddf3fef1b0 0x55ddf43c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:07.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.632+0000 7f5f9e537740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ddf3ff7390 0x55ddf43c8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:07.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.632+0000 7f5f9e537740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ddf4018070 0x55ddf43d4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:07.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.632+0000 7f5f9e537740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55ddf4186700 con 0x55ddf3fef1b0 2024-08-31T05:37:07.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.632+0000 7f5f9e537740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ddf42aa750 con 0x55ddf3ff7390 2024-08-31T05:37:07.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.632+0000 7f5f9e537740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ddf43cbaf0 con 0x55ddf4018070 2024-08-31T05:37:07.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.632+0000 7f5f9e537740 10 client.0 _ll_register_callbacks cb 0x55ddf42d9e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:37:07.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.632+0000 7f5f9655f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ddf3fef1b0 0x55ddf43c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:07.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.632+0000 7f5f9655f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ddf3fef1b0 0x55ddf43c8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56062/0 (socket says 172.21.15.5:56062) 2024-08-31T05:37:07.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.632+0000 7f5f9655f640 1 -- 172.21.15.5:0/3388368365 learned_addr learned my addr 172.21.15.5:0/3388368365 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:07.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.632+0000 7f5f9555d640 1 --2- 172.21.15.5:0/3388368365 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ddf3ff7390 0x55ddf43c8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:07.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.632+0000 7f5f9655f640 1 --2- 172.21.15.5:0/3388368365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ddf4018070 0x55ddf43d4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:07.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.632+0000 7f5f9555d640 1 -- 172.21.15.5:0/3388368365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ddf4018070 msgr2=0x55ddf43d4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:07.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.632+0000 7f5f9555d640 1 --2- 172.21.15.5:0/3388368365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ddf4018070 0x55ddf43d4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:07.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.632+0000 7f5f9555d640 1 -- 172.21.15.5:0/3388368365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ddf3fef1b0 msgr2=0x55ddf43c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:07.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.632+0000 7f5f9555d640 1 --2- 172.21.15.5:0/3388368365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ddf3fef1b0 0x55ddf43c8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:07.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.632+0000 7f5f9555d640 1 -- 172.21.15.5:0/3388368365 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddf42e3900 con 0x55ddf3ff7390 2024-08-31T05:37:07.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.632+0000 7f5f9555d640 1 --2- 172.21.15.5:0/3388368365 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ddf3ff7390 0x55ddf43c8fb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5f8402a930 tx=0x7f5f840316d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4834e673f1614b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:07.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.632+0000 7f5f757fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:37:07.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.632+0000 7f5f757fa640 1 -- 172.21.15.5:0/3388368365 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f84035040 con 0x55ddf3ff7390 2024-08-31T05:37:07.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.632+0000 7f5f757fa640 1 -- 172.21.15.5:0/3388368365 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f5f84004040 con 0x55ddf3ff7390 2024-08-31T05:37:07.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.632+0000 7f5f9e537740 1 -- 172.21.15.5:0/3388368365 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f88019ae0 con 0x55ddf3ff7390 2024-08-31T05:37:07.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.633+0000 7f5f757fa640 1 -- 172.21.15.5:0/3388368365 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f5f8404f050 con 0x55ddf3ff7390 2024-08-31T05:37:07.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.633+0000 7f5f9e537740 10 client.27053 fetch_fsmap learned FSMap version 34 2024-08-31T05:37:07.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.633+0000 7f5f9e537740 1 -- 172.21.15.5:0/3388368365 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55ddf43d7890 con 0x55ddf3ff7390 2024-08-31T05:37:07.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.633+0000 7f5f757fa640 1 -- 172.21.15.5:0/3388368365 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f88019ae0 con 0x55ddf3ff7390 2024-08-31T05:37:07.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.633+0000 7f5f757fa640 1 -- 172.21.15.5:0/3388368365 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f5f84004930 con 0x55ddf3ff7390 2024-08-31T05:37:07.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.633+0000 7f5f9e537740 10 client.27053 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:37:07.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.633+0000 7f5f9e537740 10 client.27053 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-31T05:37:07.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.633+0000 7f5f9e537740 20 client.27053 populate_metadata read hostname 'smithi005' 2024-08-31T05:37:07.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.633+0000 7f5f9e537740 1 --2- 172.21.15.5:0/3388368365 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55ddf3fd69f0 0x55ddf43dadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:07.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.633+0000 7f5f9e537740 4 client.27053 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:37:07.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.633+0000 7f5f9e537740 1 -- 172.21.15.5:0/3388368365 --> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ddf43365d0 con 0x55ddf3fd69f0 2024-08-31T05:37:07.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.633+0000 7f5f9655f640 1 --2- 172.21.15.5:0/3388368365 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55ddf3fd69f0 0x55ddf43dadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:07.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.634+0000 7f5f757fa640 10 client.27053 ms_handle_connect on v2:172.21.15.70:6836/2780036414 2024-08-31T05:37:07.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.634+0000 7f5f9655f640 1 --2- 172.21.15.5:0/3388368365 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55ddf3fd69f0 0x55ddf43dadd0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=26d89774101e58a server_cookie=1d16b7dd88a7de04 in_seq=0 out_seq=0 2024-08-31T05:37:07.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.635+0000 7f5f757fa640 1 -- 172.21.15.5:0/3388368365 <== mds.2 v2:172.21.15.70:6836/2780036414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ddf43365d0 con 0x55ddf3fd69f0 2024-08-31T05:37:07.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.635+0000 7f5f757fa640 10 client.27053 handle_command_reply: tid=0 2024-08-31T05:37:07.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.635+0000 7f5f9e537740 1 client.27053 shutdown 2024-08-31T05:37:07.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.635+0000 7f5f9e537740 1 -- 172.21.15.5:0/3388368365 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ddf3ff7390 msgr2=0x55ddf43c8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:07.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.635+0000 7f5f9e537740 1 --2- 172.21.15.5:0/3388368365 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ddf3ff7390 0x55ddf43c8fb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5f8402a930 tx=0x7f5f840316d0 comp rx=0 tx=0).stop 2024-08-31T05:37:07.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.635+0000 7f5f9e537740 1 -- 172.21.15.5:0/3388368365 shutdown_connections 2024-08-31T05:37:07.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.635+0000 7f5f9e537740 1 --2- 172.21.15.5:0/3388368365 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55ddf3fd69f0 0x55ddf43dadd0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:07.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.635+0000 7f5f9e537740 1 --2- 172.21.15.5:0/3388368365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ddf4018070 0x55ddf43d4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:07.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.635+0000 7f5f9e537740 1 --2- 172.21.15.5:0/3388368365 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ddf3ff7390 0x55ddf43c8fb0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:07.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.635+0000 7f5f9e537740 1 --2- 172.21.15.5:0/3388368365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ddf3fef1b0 0x55ddf43c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:07.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.635+0000 7f5f757fa640 0 client.27053 ms_handle_reset on v2:172.21.15.70:6836/2780036414 2024-08-31T05:37:07.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.635+0000 7f5f9e537740 1 -- 172.21.15.5:0/3388368365 >> 172.21.15.5:0/3388368365 conn(0x55ddf400c460 msgr2=0x55ddf43c04f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:07.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.635+0000 7f5f9e537740 1 -- 172.21.15.5:0/3388368365 shutdown_connections 2024-08-31T05:37:07.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.635+0000 7f5f9e537740 1 -- 172.21.15.5:0/3388368365 wait complete. 2024-08-31T05:37:07.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.635+0000 7f5f9e537740 20 client.27053 trim_cache size 0 max 16384 2024-08-31T05:37:07.660 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:37:07 smithi050 ceph-mon[22146]: pgmap v559: 129 pgs: 129 active+clean; 435 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.4 MiB/s wr, 294 op/s 2024-08-31T05:37:07.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.649+0000 7f5f9e537740 1 Processor -- start 2024-08-31T05:37:07.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.650+0000 7f5f9e537740 1 -- start start 2024-08-31T05:37:07.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.650+0000 7f5f9e537740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ddf3fef1b0 0x55ddf43c0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:07.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.650+0000 7f5f9e537740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ddf3ff7390 0x55ddf43c0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:07.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.650+0000 7f5f9e537740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ddf4018070 0x55ddf43c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:07.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.650+0000 7f5f9e537740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5f901b2e50 con 0x55ddf4018070 2024-08-31T05:37:07.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.650+0000 7f5f9e537740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5f901b4990 con 0x55ddf3ff7390 2024-08-31T05:37:07.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.650+0000 7f5f9e537740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5f901b3520 con 0x55ddf3fef1b0 2024-08-31T05:37:07.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.650+0000 7f5f9555d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ddf3ff7390 0x55ddf43c0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:07.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.650+0000 7f5f9655f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ddf4018070 0x55ddf43c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:07.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.650+0000 7f5f9555d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ddf3ff7390 0x55ddf43c0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:46014/0 (socket says 172.21.15.5:46014) 2024-08-31T05:37:07.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.650+0000 7f5f9555d640 1 -- 172.21.15.5:0/2781848262 learned_addr learned my addr 172.21.15.5:0/2781848262 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:07.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.650+0000 7f5f9655f640 1 --2- 172.21.15.5:0/2781848262 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ddf3fef1b0 0x55ddf43c0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:07.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.650+0000 7f5f9555d640 1 -- 172.21.15.5:0/2781848262 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ddf3fef1b0 msgr2=0x55ddf43c0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:07.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.650+0000 7f5f9555d640 1 --2- 172.21.15.5:0/2781848262 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ddf3fef1b0 0x55ddf43c0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:07.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.650+0000 7f5f9555d640 1 -- 172.21.15.5:0/2781848262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ddf4018070 msgr2=0x55ddf43c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:07.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.650+0000 7f5f9555d640 1 --2- 172.21.15.5:0/2781848262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ddf4018070 0x55ddf43c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:07.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.650+0000 7f5f9555d640 1 -- 172.21.15.5:0/2781848262 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddf43c9600 con 0x55ddf3ff7390 2024-08-31T05:37:07.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.650+0000 7f5f9655f640 1 --2- 172.21.15.5:0/2781848262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ddf4018070 0x55ddf43c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:37:07.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.651+0000 7f5f9555d640 1 --2- 172.21.15.5:0/2781848262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ddf3ff7390 0x55ddf43c0950 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5f84006010 tx=0x7f5f84004ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5e3ea11d4abf908 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:07.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.651+0000 7f5f777fe640 1 -- 172.21.15.5:0/2781848262 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f84035030 con 0x55ddf3ff7390 2024-08-31T05:37:07.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.651+0000 7f5f777fe640 1 -- 172.21.15.5:0/2781848262 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f840035f0 con 0x55ddf3ff7390 2024-08-31T05:37:07.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.651+0000 7f5f777fe640 1 -- 172.21.15.5:0/2781848262 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f84046470 con 0x55ddf3ff7390 2024-08-31T05:37:07.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.652+0000 7f5f9e537740 1 -- 172.21.15.5:0/2781848262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ddf3ff7390 msgr2=0x55ddf43c0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:07.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.652+0000 7f5f9e537740 1 --2- 172.21.15.5:0/2781848262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ddf3ff7390 0x55ddf43c0950 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5f84006010 tx=0x7f5f84004ef0 comp rx=0 tx=0).stop 2024-08-31T05:37:07.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.652+0000 7f5f9e537740 1 -- 172.21.15.5:0/2781848262 shutdown_connections 2024-08-31T05:37:07.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.652+0000 7f5f9e537740 1 --2- 172.21.15.5:0/2781848262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ddf4018070 0x55ddf43c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:07.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.652+0000 7f5f9e537740 1 --2- 172.21.15.5:0/2781848262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ddf3ff7390 0x55ddf43c0950 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:07.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.652+0000 7f5f9e537740 1 --2- 172.21.15.5:0/2781848262 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ddf3fef1b0 0x55ddf43c0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:07.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.652+0000 7f5f9e537740 1 -- 172.21.15.5:0/2781848262 >> 172.21.15.5:0/2781848262 conn(0x55ddf400c460 msgr2=0x55ddf43c72f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:07.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.652+0000 7f5f9e537740 1 -- 172.21.15.5:0/2781848262 shutdown_connections 2024-08-31T05:37:07.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.652+0000 7f5f9e537740 1 -- 172.21.15.5:0/2781848262 wait complete. 2024-08-31T05:37:07.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.652+0000 7f5f9e537740 1 -- start start 2024-08-31T05:37:07.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.652+0000 7f5f9e537740 1 Processor -- start 2024-08-31T05:37:07.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.653+0000 7f5f9e537740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ddf3fef1b0 0x55ddf43cd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:07.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.653+0000 7f5f9e537740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ddf3ff7390 0x55ddf43cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:07.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.653+0000 7f5f9e537740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ddf4018070 0x55ddf44447d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:07.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.653+0000 7f5f9e537740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5f901b42c0 con 0x55ddf3fef1b0 2024-08-31T05:37:07.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.653+0000 7f5f9e537740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5f901b3bf0 con 0x55ddf4018070 2024-08-31T05:37:07.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.653+0000 7f5f9e537740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5f901b0e30 con 0x55ddf3ff7390 2024-08-31T05:37:07.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.653+0000 7f5f9e537740 10 client.0 _ll_register_callbacks cb 0x7f5f84009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:37:07.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.653+0000 7f5f9555d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ddf3ff7390 0x55ddf43cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:07.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.653+0000 7f5f9655f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ddf3fef1b0 0x55ddf43cd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:07.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.653+0000 7f5f9555d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ddf3ff7390 0x55ddf43cd7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:39796/0 (socket says 172.21.15.5:39796) 2024-08-31T05:37:07.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.653+0000 7f5f9655f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ddf3fef1b0 0x55ddf43cd1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56082/0 (socket says 172.21.15.5:56082) 2024-08-31T05:37:07.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.653+0000 7f5f9555d640 1 -- 172.21.15.5:0/2822900281 learned_addr learned my addr 172.21.15.5:0/2822900281 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:07.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.653+0000 7f5f9655f640 1 --2- 172.21.15.5:0/2822900281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ddf4018070 0x55ddf44447d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:07.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.654+0000 7f5f9655f640 1 -- 172.21.15.5:0/2822900281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ddf3ff7390 msgr2=0x55ddf43cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:07.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.654+0000 7f5f9655f640 1 --2- 172.21.15.5:0/2822900281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ddf3ff7390 0x55ddf43cd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:07.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.654+0000 7f5f9655f640 1 -- 172.21.15.5:0/2822900281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ddf4018070 msgr2=0x55ddf44447d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:07.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.654+0000 7f5f9655f640 1 --2- 172.21.15.5:0/2822900281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ddf4018070 0x55ddf44447d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:07.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.654+0000 7f5f9655f640 1 -- 172.21.15.5:0/2822900281 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddf4444d10 con 0x55ddf3fef1b0 2024-08-31T05:37:07.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.654+0000 7f5f9655f640 1 --2- 172.21.15.5:0/2822900281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ddf3fef1b0 0x55ddf43cd1e0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x55ddf43cb2c0 tx=0x7f5f88011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=350c740a34fba440 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:07.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.654+0000 7f5f757fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:37:07.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.654+0000 7f5f757fa640 1 -- 172.21.15.5:0/2822900281 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8801e040 con 0x55ddf3fef1b0 2024-08-31T05:37:07.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.654+0000 7f5f757fa640 1 -- 172.21.15.5:0/2822900281 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9423+0+0 (secure 0 0 0) 0x7f5f880055b0 con 0x55ddf3fef1b0 2024-08-31T05:37:07.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.654+0000 7f5f9e537740 1 -- 172.21.15.5:0/2822900281 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f840035f0 con 0x55ddf3fef1b0 2024-08-31T05:37:07.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.655+0000 7f5f757fa640 1 -- 172.21.15.5:0/2822900281 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f5f8803a770 con 0x55ddf3fef1b0 2024-08-31T05:37:07.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.655+0000 7f5f9e537740 10 client.17475 fetch_fsmap learned FSMap version 34 2024-08-31T05:37:07.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.655+0000 7f5f9e537740 1 -- 172.21.15.5:0/2822900281 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55ddf4445ea0 con 0x55ddf3fef1b0 2024-08-31T05:37:07.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.655+0000 7f5f757fa640 1 -- 172.21.15.5:0/2822900281 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f840035f0 con 0x55ddf3fef1b0 2024-08-31T05:37:07.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.655+0000 7f5f757fa640 1 -- 172.21.15.5:0/2822900281 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f5f8803a070 con 0x55ddf3fef1b0 2024-08-31T05:37:07.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.655+0000 7f5f9e537740 10 client.17475 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:37:07.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.655+0000 7f5f9e537740 10 client.17475 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-31T05:37:07.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.655+0000 7f5f9e537740 20 client.17475 populate_metadata read hostname 'smithi005' 2024-08-31T05:37:07.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.655+0000 7f5f9e537740 1 --2- 172.21.15.5:0/2822900281 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55ddf3fabda0 0x55ddf44483a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:07.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.655+0000 7f5f9e537740 4 client.17475 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:37:07.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.655+0000 7f5f9e537740 1 -- 172.21.15.5:0/2822900281 --> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ddf4332070 con 0x55ddf3fabda0 2024-08-31T05:37:07.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.656+0000 7f5f9555d640 1 --2- 172.21.15.5:0/2822900281 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55ddf3fabda0 0x55ddf44483a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:07.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.656+0000 7f5f757fa640 10 client.17475 ms_handle_connect on v2:172.21.15.70:6836/2780036414 2024-08-31T05:37:07.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.656+0000 7f5f9555d640 1 --2- 172.21.15.5:0/2822900281 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55ddf3fabda0 0x55ddf44483a0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8d417eb0d8c58e9a server_cookie=b177cad2196cd9ee in_seq=0 out_seq=0 2024-08-31T05:37:07.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.656+0000 7f5f757fa640 1 -- 172.21.15.5:0/2822900281 <== mds.2 v2:172.21.15.70:6836/2780036414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ddf4332070 con 0x55ddf3fabda0 2024-08-31T05:37:07.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.656+0000 7f5f757fa640 10 client.17475 handle_command_reply: tid=0 2024-08-31T05:37:07.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.656+0000 7f5f9e537740 1 client.17475 shutdown 2024-08-31T05:37:07.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.656+0000 7f5f9e537740 1 -- 172.21.15.5:0/2822900281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ddf3fef1b0 msgr2=0x55ddf43cd1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:07.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.656+0000 7f5f9e537740 1 --2- 172.21.15.5:0/2822900281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ddf3fef1b0 0x55ddf43cd1e0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x55ddf43cb2c0 tx=0x7f5f88011810 comp rx=0 tx=0).stop 2024-08-31T05:37:07.669 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:37:07.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.657+0000 7f5f9e537740 1 -- 172.21.15.5:0/2822900281 shutdown_connections 2024-08-31T05:37:07.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.657+0000 7f5f9e537740 1 --2- 172.21.15.5:0/2822900281 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55ddf3fabda0 0x55ddf44483a0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:07.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.657+0000 7f5f9e537740 1 --2- 172.21.15.5:0/2822900281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ddf4018070 0x55ddf44447d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:07.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.657+0000 7f5f9e537740 1 --2- 172.21.15.5:0/2822900281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ddf3ff7390 0x55ddf43cd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:07.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.657+0000 7f5f9e537740 1 --2- 172.21.15.5:0/2822900281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ddf3fef1b0 0x55ddf43cd1e0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:07.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.657+0000 7f5f757fa640 0 client.17475 ms_handle_reset on v2:172.21.15.70:6836/2780036414 2024-08-31T05:37:07.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.657+0000 7f5f9e537740 1 -- 172.21.15.5:0/2822900281 >> 172.21.15.5:0/2822900281 conn(0x55ddf400c460 msgr2=0x55ddf43c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:07.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.657+0000 7f5f9e537740 1 -- 172.21.15.5:0/2822900281 shutdown_connections 2024-08-31T05:37:07.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.657+0000 7f5f9e537740 1 -- 172.21.15.5:0/2822900281 wait complete. 2024-08-31T05:37:07.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.657+0000 7f5f9e537740 20 client.17475 trim_cache size 0 max 16384 2024-08-31T05:37:07.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.657+0000 7f5f97fc2640 1 -- 172.21.15.5:0/3481997496 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5f780b4ca0 msgr2=0x7f5f780b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:07.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.657+0000 7f5f97fc2640 1 --2- 172.21.15.5:0/3481997496 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5f780b4ca0 0x7f5f780b71b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5f800e33f0 tx=0x7f5f80004930 comp rx=0 tx=0).stop 2024-08-31T05:37:07.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.657+0000 7f5f97fc2640 1 -- 172.21.15.5:0/3481997496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f90102830 msgr2=0x7f5f9019c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:07.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.657+0000 7f5f97fc2640 1 --2- 172.21.15.5:0/3481997496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f90102830 0x7f5f9019c500 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f5f80009d50 tx=0x7f5f8000c6a0 comp rx=0 tx=0).stop 2024-08-31T05:37:07.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.658+0000 7f5f97fc2640 1 -- 172.21.15.5:0/3481997496 shutdown_connections 2024-08-31T05:37:07.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.658+0000 7f5f97fc2640 1 --2- 172.21.15.5:0/3481997496 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5f780b4ca0 0x7f5f780b71b0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:07.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.658+0000 7f5f97fc2640 1 --2- 172.21.15.5:0/3481997496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f90108ac0 0x7f5f901a1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:07.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.658+0000 7f5f97fc2640 1 --2- 172.21.15.5:0/3481997496 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5f90108170 0x7f5f9019caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:07.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.658+0000 7f5f97fc2640 1 --2- 172.21.15.5:0/3481997496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f90102830 0x7f5f9019c500 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:07.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.658+0000 7f5f97fc2640 1 -- 172.21.15.5:0/3481997496 >> 172.21.15.5:0/3481997496 conn(0x7f5f900794d0 msgr2=0x7f5f9006bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:07.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.658+0000 7f5f97fc2640 1 -- 172.21.15.5:0/3481997496 shutdown_connections 2024-08-31T05:37:07.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:07.658+0000 7f5f97fc2640 1 -- 172.21.15.5:0/3481997496 wait complete. 2024-08-31T05:37:07.926 INFO:tasks.workunit.client.0.smithi005.stdout: 1 801834 11.51 MB/sec execute 235 sec latency 100.985 ms 2024-08-31T05:37:08.868 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T05:37:08.926 INFO:tasks.workunit.client.0.smithi005.stdout: 1 803504 11.50 MB/sec execute 236 sec latency 32.230 ms 2024-08-31T05:37:09.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.100+0000 7fd611750640 1 -- 172.21.15.5:0/4015303353 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd60c102760 msgr2=0x7fd60c102b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:09.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.100+0000 7fd611750640 1 --2- 172.21.15.5:0/4015303353 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd60c102760 0x7fd60c102b70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc009860 tx=0x7fd5fc02a340 comp rx=0 tx=0).stop 2024-08-31T05:37:09.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.100+0000 7fd611750640 1 -- 172.21.15.5:0/4015303353 shutdown_connections 2024-08-31T05:37:09.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.100+0000 7fd611750640 1 --2- 172.21.15.5:0/4015303353 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd60c1089e0 0x7fd60c10f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.100+0000 7fd611750640 1 --2- 172.21.15.5:0/4015303353 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd60c108090 0x7fd60c1084a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.100+0000 7fd611750640 1 --2- 172.21.15.5:0/4015303353 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd60c102760 0x7fd60c102b70 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.100+0000 7fd611750640 1 -- 172.21.15.5:0/4015303353 >> 172.21.15.5:0/4015303353 conn(0x7fd60c0fe160 msgr2=0x7fd60c1005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:09.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.100+0000 7fd611750640 1 -- 172.21.15.5:0/4015303353 shutdown_connections 2024-08-31T05:37:09.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.100+0000 7fd611750640 1 -- 172.21.15.5:0/4015303353 wait complete. 2024-08-31T05:37:09.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.101+0000 7fd611750640 1 Processor -- start 2024-08-31T05:37:09.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.101+0000 7fd611750640 1 -- start start 2024-08-31T05:37:09.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.101+0000 7fd611750640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd60c102760 0x7fd60c19b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:09.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.101+0000 7fd611750640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd60c108090 0x7fd60c19b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:09.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.101+0000 7fd611750640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd60c1089e0 0x7fd60c19baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:09.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.101+0000 7fd611750640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd60c1126b0 con 0x7fd60c1089e0 2024-08-31T05:37:09.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.101+0000 7fd611750640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd60c112530 con 0x7fd60c108090 2024-08-31T05:37:09.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.101+0000 7fd611750640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd60c112830 con 0x7fd60c102760 2024-08-31T05:37:09.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.101+0000 7fd60b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd60c1089e0 0x7fd60c19baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:09.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.101+0000 7fd60affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd60c102760 0x7fd60c19b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:09.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.101+0000 7fd603fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd60c108090 0x7fd60c19b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:09.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.101+0000 7fd60b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd60c1089e0 0x7fd60c19baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56094/0 (socket says 172.21.15.5:56094) 2024-08-31T05:37:09.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.101+0000 7fd60b7fe640 1 -- 172.21.15.5:0/1523681872 learned_addr learned my addr 172.21.15.5:0/1523681872 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:09.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.101+0000 7fd60b7fe640 1 -- 172.21.15.5:0/1523681872 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd60c102760 msgr2=0x7fd60c19b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:09.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.101+0000 7fd60b7fe640 1 --2- 172.21.15.5:0/1523681872 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd60c102760 0x7fd60c19b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.101+0000 7fd60b7fe640 1 -- 172.21.15.5:0/1523681872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd60c108090 msgr2=0x7fd60c19b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:09.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.101+0000 7fd60b7fe640 1 --2- 172.21.15.5:0/1523681872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd60c108090 0x7fd60c19b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.101+0000 7fd60b7fe640 1 -- 172.21.15.5:0/1523681872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd60c1a62b0 con 0x7fd60c1089e0 2024-08-31T05:37:09.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.101+0000 7fd60affd640 1 --2- 172.21.15.5:0/1523681872 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd60c102760 0x7fd60c19b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:37:09.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.102+0000 7fd60b7fe640 1 --2- 172.21.15.5:0/1523681872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd60c1089e0 0x7fd60c19baa0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fd60400efc0 tx=0x7fd60400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:09.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.102+0000 7fd608ff9640 1 -- 172.21.15.5:0/1523681872 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd604003970 con 0x7fd60c1089e0 2024-08-31T05:37:09.108 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.102+0000 7fd608ff9640 1 -- 172.21.15.5:0/1523681872 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd604004020 con 0x7fd60c1089e0 2024-08-31T05:37:09.108 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.102+0000 7fd611750640 1 -- 172.21.15.5:0/1523681872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd60c1a65a0 con 0x7fd60c1089e0 2024-08-31T05:37:09.108 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.102+0000 7fd608ff9640 1 -- 172.21.15.5:0/1523681872 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd60400b940 con 0x7fd60c1089e0 2024-08-31T05:37:09.108 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.102+0000 7fd611750640 1 -- 172.21.15.5:0/1523681872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd60c1a6af0 con 0x7fd60c1089e0 2024-08-31T05:37:09.110 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.105+0000 7fd6186bc740 1 Processor -- start 2024-08-31T05:37:09.110 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.105+0000 7fd608ff9640 1 -- 172.21.15.5:0/1523681872 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fd60401d020 con 0x7fd60c1089e0 2024-08-31T05:37:09.110 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.105+0000 7fd6186bc740 1 -- start start 2024-08-31T05:37:09.110 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.106+0000 7fd6186bc740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bbbf4c41b0 0x55bbbf867ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:09.110 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.106+0000 7fd6186bc740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bbbf49b2f0 0x55bbbf868000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:09.110 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.106+0000 7fd6186bc740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbbf4a34d0 0x55bbbf868540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:09.110 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.106+0000 7fd6186bc740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55bbbf7dd000 con 0x55bbbf49b2f0 2024-08-31T05:37:09.110 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.106+0000 7fd6186bc740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55bbbf7cc590 con 0x55bbbf4c41b0 2024-08-31T05:37:09.110 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.106+0000 7fd6186bc740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55bbbf7d0540 con 0x55bbbf4a34d0 2024-08-31T05:37:09.110 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.106+0000 7fd603fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bbbf4c41b0 0x55bbbf867ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:09.111 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.106+0000 7fd60affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bbbf49b2f0 0x55bbbf868000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:09.111 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.106+0000 7fd603fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bbbf4c41b0 0x55bbbf867ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:46054/0 (socket says 172.21.15.5:46054) 2024-08-31T05:37:09.111 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.106+0000 7fd603fff640 1 -- 172.21.15.5:0/3691337270 learned_addr learned my addr 172.21.15.5:0/3691337270 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:09.111 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.106+0000 7fd603fff640 1 --2- 172.21.15.5:0/3691337270 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbbf4a34d0 0x55bbbf868540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:09.111 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.106+0000 7fd608ff9640 1 --2- 172.21.15.5:0/1523681872 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd5f80b4ca0 0x7fd5f80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:09.111 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.106+0000 7fd603fff640 1 -- 172.21.15.5:0/3691337270 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbbf4a34d0 msgr2=0x55bbbf868540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:09.111 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.106+0000 7fd603fff640 1 --2- 172.21.15.5:0/3691337270 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbbf4a34d0 0x55bbbf868540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.111 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.106+0000 7fd603fff640 1 -- 172.21.15.5:0/3691337270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bbbf49b2f0 msgr2=0x55bbbf868000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:09.111 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.106+0000 7fd603fff640 1 --2- 172.21.15.5:0/3691337270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bbbf49b2f0 0x55bbbf868000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.111 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.106+0000 7fd603fff640 1 -- 172.21.15.5:0/3691337270 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbbf52f790 con 0x55bbbf4c41b0 2024-08-31T05:37:09.111 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.106+0000 7fd60b7fe640 1 --2- 172.21.15.5:0/1523681872 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd5f80b4ca0 0x7fd5f80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:09.111 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.106+0000 7fd60affd640 1 --2- 172.21.15.5:0/3691337270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bbbf49b2f0 0x55bbbf868000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:37:09.111 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.106+0000 7fd608ff9640 1 -- 172.21.15.5:0/1523681872 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9599+0+0 (secure 0 0 0) 0x7fd6040e5910 con 0x7fd60c1089e0 2024-08-31T05:37:09.112 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.107+0000 7fd603fff640 1 --2- 172.21.15.5:0/3691337270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bbbf4c41b0 0x55bbbf867ac0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4005d00 tx=0x7fd5f4005c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7857481b7322ae22 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:09.112 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.107+0000 7fd6017fa640 1 -- 172.21.15.5:0/3691337270 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f4012ca0 con 0x55bbbf4c41b0 2024-08-31T05:37:09.112 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.107+0000 7fd6017fa640 1 -- 172.21.15.5:0/3691337270 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5f4012e40 con 0x55bbbf4c41b0 2024-08-31T05:37:09.112 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.107+0000 7fd6017fa640 1 -- 172.21.15.5:0/3691337270 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f40049a0 con 0x55bbbf4c41b0 2024-08-31T05:37:09.116 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.108+0000 7fd6186bc740 1 -- 172.21.15.5:0/3691337270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bbbf4c41b0 msgr2=0x55bbbf867ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:09.116 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.108+0000 7fd60b7fe640 1 --2- 172.21.15.5:0/1523681872 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd5f80b4ca0 0x7fd5f80b71b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd6040abb60 tx=0x7fd604018040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:09.117 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.108+0000 7fd6186bc740 1 --2- 172.21.15.5:0/3691337270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bbbf4c41b0 0x55bbbf867ac0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4005d00 tx=0x7fd5f4005c90 comp rx=0 tx=0).stop 2024-08-31T05:37:09.117 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.108+0000 7fd6186bc740 1 -- 172.21.15.5:0/3691337270 shutdown_connections 2024-08-31T05:37:09.117 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.108+0000 7fd6186bc740 1 --2- 172.21.15.5:0/3691337270 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbbf4a34d0 0x55bbbf868540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.117 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.108+0000 7fd6186bc740 1 --2- 172.21.15.5:0/3691337270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bbbf49b2f0 0x55bbbf868000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.117 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.108+0000 7fd6186bc740 1 --2- 172.21.15.5:0/3691337270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bbbf4c41b0 0x55bbbf867ac0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.117 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.108+0000 7fd6186bc740 1 -- 172.21.15.5:0/3691337270 >> 172.21.15.5:0/3691337270 conn(0x55bbbf4b8300 msgr2=0x55bbbf8659b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:09.117 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.108+0000 7fd6186bc740 1 -- 172.21.15.5:0/3691337270 shutdown_connections 2024-08-31T05:37:09.117 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.108+0000 7fd6186bc740 1 -- 172.21.15.5:0/3691337270 wait complete. 2024-08-31T05:37:09.117 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.109+0000 7fd6186bc740 1 -- start start 2024-08-31T05:37:09.117 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.109+0000 7fd6186bc740 1 Processor -- start 2024-08-31T05:37:09.117 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.109+0000 7fd6186bc740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bbbf49b2f0 0x55bbbf877b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:09.117 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.109+0000 7fd6186bc740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbbf4a34d0 0x55bbbf8780b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:09.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.109+0000 7fd6186bc740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bbbf4c41b0 0x55bbbf883980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:09.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.109+0000 7fd6186bc740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55bbbf705ab0 con 0x55bbbf49b2f0 2024-08-31T05:37:09.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.109+0000 7fd6186bc740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55bbbf753680 con 0x55bbbf4c41b0 2024-08-31T05:37:09.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.109+0000 7fd6186bc740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55bbbf87a620 con 0x55bbbf4a34d0 2024-08-31T05:37:09.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.109+0000 7fd6186bc740 10 client.0 _ll_register_callbacks cb 0x55bbbf4dba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:37:09.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.109+0000 7fd603fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bbbf49b2f0 0x55bbbf877b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:09.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.109+0000 7fd60affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbbf4a34d0 0x55bbbf8780b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:09.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.109+0000 7fd603fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bbbf49b2f0 0x55bbbf877b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56102/0 (socket says 172.21.15.5:56102) 2024-08-31T05:37:09.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.109+0000 7fd603fff640 1 -- 172.21.15.5:0/2446411667 learned_addr learned my addr 172.21.15.5:0/2446411667 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:09.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.109+0000 7fd60affd640 1 --2- 172.21.15.5:0/2446411667 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbbf4a34d0 0x55bbbf8780b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:39830/0 (socket says 172.21.15.5:39830) 2024-08-31T05:37:09.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.109+0000 7fd603fff640 1 --2- 172.21.15.5:0/2446411667 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bbbf4c41b0 0x55bbbf883980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:09.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.109+0000 7fd60affd640 1 -- 172.21.15.5:0/2446411667 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bbbf4c41b0 msgr2=0x55bbbf883980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:09.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.109+0000 7fd60affd640 1 --2- 172.21.15.5:0/2446411667 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bbbf4c41b0 0x55bbbf883980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.109+0000 7fd60affd640 1 -- 172.21.15.5:0/2446411667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bbbf49b2f0 msgr2=0x55bbbf877b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:09.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.109+0000 7fd60affd640 1 --2- 172.21.15.5:0/2446411667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bbbf49b2f0 0x55bbbf877b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.109+0000 7fd60affd640 1 -- 172.21.15.5:0/2446411667 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbbf5a8620 con 0x55bbbf4a34d0 2024-08-31T05:37:09.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.109+0000 7fd603fff640 1 --2- 172.21.15.5:0/2446411667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bbbf49b2f0 0x55bbbf877b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:37:09.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.110+0000 7fd60affd640 1 --2- 172.21.15.5:0/2446411667 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbbf4a34d0 0x55bbbf8780b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc005940 tx=0x7fd5fc004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a1fbdf56b633e91 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:09.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.110+0000 7fd5f27fc640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:37:09.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.110+0000 7fd5f27fc640 1 -- 172.21.15.5:0/2446411667 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc041070 con 0x55bbbf4a34d0 2024-08-31T05:37:09.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.110+0000 7fd5f27fc640 1 -- 172.21.15.5:0/2446411667 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9599+0+0 (secure 0 0 0) 0x7fd5fc030650 con 0x55bbbf4a34d0 2024-08-31T05:37:09.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.110+0000 7fd6186bc740 1 -- 172.21.15.5:0/2446411667 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bbbf7def50 con 0x55bbbf4a34d0 2024-08-31T05:37:09.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.110+0000 7fd5f27fc640 1 -- 172.21.15.5:0/2446411667 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fd5fc037040 con 0x55bbbf4a34d0 2024-08-31T05:37:09.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.110+0000 7fd6186bc740 10 client.27079 fetch_fsmap learned FSMap version 34 2024-08-31T05:37:09.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.110+0000 7fd6186bc740 1 -- 172.21.15.5:0/2446411667 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55bbbf886700 con 0x55bbbf4a34d0 2024-08-31T05:37:09.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.110+0000 7fd5f27fc640 1 -- 172.21.15.5:0/2446411667 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55bbbf7def50 con 0x55bbbf4a34d0 2024-08-31T05:37:09.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.111+0000 7fd5f27fc640 1 -- 172.21.15.5:0/2446411667 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fd5fc0037b0 con 0x55bbbf4a34d0 2024-08-31T05:37:09.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.111+0000 7fd6186bc740 10 client.27079 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:37:09.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.111+0000 7fd6186bc740 10 client.27079 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:37:09.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.111+0000 7fd6186bc740 20 client.27079 populate_metadata read hostname 'smithi005' 2024-08-31T05:37:09.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.111+0000 7fd6186bc740 1 --2- 172.21.15.5:0/2446411667 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55bbbf482d80 0x55bbbf889bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:09.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.111+0000 7fd6186bc740 4 client.27079 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:37:09.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.111+0000 7fd6186bc740 1 -- 172.21.15.5:0/2446411667 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bbbf7da9f0 con 0x55bbbf482d80 2024-08-31T05:37:09.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.111+0000 7fd603fff640 1 --2- 172.21.15.5:0/2446411667 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55bbbf482d80 0x55bbbf889bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:09.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.111+0000 7fd5f27fc640 10 client.27079 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:37:09.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.111+0000 7fd603fff640 1 --2- 172.21.15.5:0/2446411667 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55bbbf482d80 0x55bbbf889bd0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f4ea86bccee622c server_cookie=c89f6bf812587bf7 in_seq=0 out_seq=0 2024-08-31T05:37:09.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.112+0000 7fd5f27fc640 1 -- 172.21.15.5:0/2446411667 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bbbf7da9f0 con 0x55bbbf482d80 2024-08-31T05:37:09.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.112+0000 7fd5f27fc640 10 client.27079 handle_command_reply: tid=0 2024-08-31T05:37:09.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.112+0000 7fd6186bc740 1 client.27079 shutdown 2024-08-31T05:37:09.121 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.112+0000 7fd6186bc740 1 -- 172.21.15.5:0/2446411667 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbbf4a34d0 msgr2=0x55bbbf8780b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:09.121 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.112+0000 7fd6186bc740 1 --2- 172.21.15.5:0/2446411667 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbbf4a34d0 0x55bbbf8780b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc005940 tx=0x7fd5fc004270 comp rx=0 tx=0).stop 2024-08-31T05:37:09.121 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.112+0000 7fd6186bc740 1 -- 172.21.15.5:0/2446411667 shutdown_connections 2024-08-31T05:37:09.121 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.112+0000 7fd6186bc740 1 --2- 172.21.15.5:0/2446411667 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55bbbf482d80 0x55bbbf889bd0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.121 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.112+0000 7fd6186bc740 1 --2- 172.21.15.5:0/2446411667 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bbbf4c41b0 0x55bbbf883980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.121 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.112+0000 7fd6186bc740 1 --2- 172.21.15.5:0/2446411667 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbbf4a34d0 0x55bbbf8780b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.121 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.112+0000 7fd5f27fc640 0 client.27079 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:37:09.121 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.112+0000 7fd6186bc740 1 --2- 172.21.15.5:0/2446411667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bbbf49b2f0 0x55bbbf877b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.121 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.112+0000 7fd6186bc740 1 -- 172.21.15.5:0/2446411667 >> 172.21.15.5:0/2446411667 conn(0x55bbbf4b8300 msgr2=0x55bbbf86ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:09.121 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.112+0000 7fd6186bc740 1 -- 172.21.15.5:0/2446411667 shutdown_connections 2024-08-31T05:37:09.121 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.113+0000 7fd6186bc740 1 -- 172.21.15.5:0/2446411667 wait complete. 2024-08-31T05:37:09.121 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.113+0000 7fd6186bc740 20 client.27079 trim_cache size 0 max 16384 2024-08-31T05:37:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.129+0000 7fd6186bc740 1 Processor -- start 2024-08-31T05:37:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.129+0000 7fd6186bc740 1 -- start start 2024-08-31T05:37:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.129+0000 7fd6186bc740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bbbf49b2f0 0x55bbbf867980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.129+0000 7fd6186bc740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbbf4a34d0 0x55bbbf867ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.129+0000 7fd6186bc740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bbbf4c41b0 0x55bbbf876df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:09.134 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.129+0000 7fd6186bc740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd60c1aec00 con 0x55bbbf4c41b0 2024-08-31T05:37:09.134 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.129+0000 7fd6186bc740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd60c1b0740 con 0x55bbbf49b2f0 2024-08-31T05:37:09.134 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.129+0000 7fd6186bc740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd60c1af2d0 con 0x55bbbf4a34d0 2024-08-31T05:37:09.134 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.129+0000 7fd60affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbbf4a34d0 0x55bbbf867ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:09.134 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.129+0000 7fd603fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bbbf49b2f0 0x55bbbf867980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:09.134 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.129+0000 7fd60affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbbf4a34d0 0x55bbbf867ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:39836/0 (socket says 172.21.15.5:39836) 2024-08-31T05:37:09.134 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.129+0000 7fd60affd640 1 -- 172.21.15.5:0/3870169177 learned_addr learned my addr 172.21.15.5:0/3870169177 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:09.134 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.130+0000 7fd603fff640 1 --2- 172.21.15.5:0/3870169177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bbbf4c41b0 0x55bbbf876df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:09.134 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.130+0000 7fd60affd640 1 -- 172.21.15.5:0/3870169177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bbbf49b2f0 msgr2=0x55bbbf867980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:09.134 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.130+0000 7fd60affd640 1 --2- 172.21.15.5:0/3870169177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bbbf49b2f0 0x55bbbf867980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.134 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.130+0000 7fd60affd640 1 -- 172.21.15.5:0/3870169177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bbbf4c41b0 msgr2=0x55bbbf876df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:09.134 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.130+0000 7fd60affd640 1 --2- 172.21.15.5:0/3870169177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bbbf4c41b0 0x55bbbf876df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.135 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.130+0000 7fd60affd640 1 -- 172.21.15.5:0/3870169177 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbbf8662b0 con 0x55bbbf4a34d0 2024-08-31T05:37:09.135 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.130+0000 7fd60affd640 1 --2- 172.21.15.5:0/3870169177 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbbf4a34d0 0x55bbbf867ec0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc035040 tx=0x7fd5fc000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f00f6cbe491eb2f2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:09.135 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.130+0000 7fd600ff9640 1 -- 172.21.15.5:0/3870169177 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc041040 con 0x55bbbf4a34d0 2024-08-31T05:37:09.135 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.130+0000 7fd600ff9640 1 -- 172.21.15.5:0/3870169177 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5fc005d10 con 0x55bbbf4a34d0 2024-08-31T05:37:09.135 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.130+0000 7fd600ff9640 1 -- 172.21.15.5:0/3870169177 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc005280 con 0x55bbbf4a34d0 2024-08-31T05:37:09.135 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:37:09.139 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.131+0000 7fd6186bc740 1 -- 172.21.15.5:0/3870169177 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbbf4a34d0 msgr2=0x55bbbf867ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:09.139 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.131+0000 7fd6186bc740 1 --2- 172.21.15.5:0/3870169177 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbbf4a34d0 0x55bbbf867ec0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc035040 tx=0x7fd5fc000bc0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.139 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.131+0000 7fd6186bc740 1 -- 172.21.15.5:0/3870169177 shutdown_connections 2024-08-31T05:37:09.139 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.131+0000 7fd6186bc740 1 --2- 172.21.15.5:0/3870169177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bbbf4c41b0 0x55bbbf876df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.139 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.131+0000 7fd6186bc740 1 --2- 172.21.15.5:0/3870169177 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbbf4a34d0 0x55bbbf867ec0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.139 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.131+0000 7fd6186bc740 1 --2- 172.21.15.5:0/3870169177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bbbf49b2f0 0x55bbbf867980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.139 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.131+0000 7fd6186bc740 1 -- 172.21.15.5:0/3870169177 >> 172.21.15.5:0/3870169177 conn(0x55bbbf4b8300 msgr2=0x55bbbf876180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:09.139 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.131+0000 7fd6186bc740 1 -- 172.21.15.5:0/3870169177 shutdown_connections 2024-08-31T05:37:09.139 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.131+0000 7fd6186bc740 1 -- 172.21.15.5:0/3870169177 wait complete. 2024-08-31T05:37:09.139 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.132+0000 7fd6186bc740 1 -- start start 2024-08-31T05:37:09.139 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.132+0000 7fd6186bc740 1 Processor -- start 2024-08-31T05:37:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.132+0000 7fd6186bc740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bbbf49b2f0 0x55bbbf87bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.132+0000 7fd6186bc740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbbf4a34d0 0x55bbbf87c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.132+0000 7fd6186bc740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bbbf4c41b0 0x55bbbf8f3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.132+0000 7fd6186bc740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd60c1b0070 con 0x55bbbf49b2f0 2024-08-31T05:37:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.132+0000 7fd6186bc740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd60c1af9a0 con 0x55bbbf4c41b0 2024-08-31T05:37:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.132+0000 7fd6186bc740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd60c1acc00 con 0x55bbbf4a34d0 2024-08-31T05:37:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.132+0000 7fd6186bc740 10 client.0 _ll_register_callbacks cb 0x7fd5fc0096b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:37:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.132+0000 7fd603fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bbbf49b2f0 0x55bbbf87bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.132+0000 7fd603fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bbbf49b2f0 0x55bbbf87bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56108/0 (socket says 172.21.15.5:56108) 2024-08-31T05:37:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.132+0000 7fd603fff640 1 -- 172.21.15.5:0/3489044687 learned_addr learned my addr 172.21.15.5:0/3489044687 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.132+0000 7fd60affd640 1 --2- 172.21.15.5:0/3489044687 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbbf4a34d0 0x55bbbf87c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.132+0000 7fd603fff640 1 --2- 172.21.15.5:0/3489044687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bbbf4c41b0 0x55bbbf8f3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.132+0000 7fd603fff640 1 -- 172.21.15.5:0/3489044687 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbbf4a34d0 msgr2=0x55bbbf87c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.132+0000 7fd603fff640 1 --2- 172.21.15.5:0/3489044687 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbbf4a34d0 0x55bbbf87c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.141 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.132+0000 7fd603fff640 1 -- 172.21.15.5:0/3489044687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bbbf4c41b0 msgr2=0x55bbbf8f3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:09.141 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.132+0000 7fd603fff640 1 --2- 172.21.15.5:0/3489044687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bbbf4c41b0 0x55bbbf8f3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.141 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.133+0000 7fd603fff640 1 -- 172.21.15.5:0/3489044687 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbbf8f3a60 con 0x55bbbf49b2f0 2024-08-31T05:37:09.141 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.133+0000 7fd603fff640 1 --2- 172.21.15.5:0/3489044687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bbbf49b2f0 0x55bbbf87bf50 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fd5f400b620 tx=0x7fd5f4024040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c593d259c17e6c8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:09.141 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.133+0000 7fd5f27fc640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:37:09.141 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.133+0000 7fd5f27fc640 1 -- 172.21.15.5:0/3489044687 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f4010950 con 0x55bbbf49b2f0 2024-08-31T05:37:09.141 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.133+0000 7fd5f27fc640 1 -- 172.21.15.5:0/3489044687 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9599+0+0 (secure 0 0 0) 0x7fd5f402df90 con 0x55bbbf49b2f0 2024-08-31T05:37:09.141 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.133+0000 7fd6186bc740 1 -- 172.21.15.5:0/3489044687 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5fc005d10 con 0x55bbbf49b2f0 2024-08-31T05:37:09.141 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.133+0000 7fd5f27fc640 1 -- 172.21.15.5:0/3489044687 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fd5f4010af0 con 0x55bbbf49b2f0 2024-08-31T05:37:09.141 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.133+0000 7fd6186bc740 10 client.17493 fetch_fsmap learned FSMap version 34 2024-08-31T05:37:09.141 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.133+0000 7fd6186bc740 1 -- 172.21.15.5:0/3489044687 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55bbbf8f4c50 con 0x55bbbf49b2f0 2024-08-31T05:37:09.141 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.133+0000 7fd5f27fc640 1 -- 172.21.15.5:0/3489044687 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5fc005d10 con 0x55bbbf49b2f0 2024-08-31T05:37:09.142 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.134+0000 7fd5f27fc640 1 -- 172.21.15.5:0/3489044687 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fd5f401f470 con 0x55bbbf49b2f0 2024-08-31T05:37:09.142 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.134+0000 7fd6186bc740 10 client.17493 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:37:09.142 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.134+0000 7fd6186bc740 10 client.17493 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:37:09.142 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.134+0000 7fd6186bc740 20 client.17493 populate_metadata read hostname 'smithi005' 2024-08-31T05:37:09.142 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.134+0000 7fd6186bc740 1 --2- 172.21.15.5:0/3489044687 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55bbbf4581c0 0x55bbbf8f7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:09.142 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.134+0000 7fd6186bc740 4 client.17493 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:37:09.142 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.134+0000 7fd6186bc740 1 -- 172.21.15.5:0/3489044687 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bbbf7d8130 con 0x55bbbf4581c0 2024-08-31T05:37:09.142 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.134+0000 7fd60affd640 1 --2- 172.21.15.5:0/3489044687 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55bbbf4581c0 0x55bbbf8f7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:09.142 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.134+0000 7fd5f27fc640 10 client.17493 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:37:09.142 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.135+0000 7fd60affd640 1 --2- 172.21.15.5:0/3489044687 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55bbbf4581c0 0x55bbbf8f7190 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5fd41bf2bd9ed623 server_cookie=d522f94401ad44c5 in_seq=0 out_seq=0 2024-08-31T05:37:09.150 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.147+0000 7fd5f27fc640 1 -- 172.21.15.5:0/3489044687 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bbbf7d8130 con 0x55bbbf4581c0 2024-08-31T05:37:09.150 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.147+0000 7fd5f27fc640 10 client.17493 handle_command_reply: tid=0 2024-08-31T05:37:09.150 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.147+0000 7fd6186bc740 1 client.17493 shutdown 2024-08-31T05:37:09.150 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.147+0000 7fd6186bc740 1 -- 172.21.15.5:0/3489044687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bbbf49b2f0 msgr2=0x55bbbf87bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:09.151 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.147+0000 7fd6186bc740 1 --2- 172.21.15.5:0/3489044687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bbbf49b2f0 0x55bbbf87bf50 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fd5f400b620 tx=0x7fd5f4024040 comp rx=0 tx=0).stop 2024-08-31T05:37:09.151 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.147+0000 7fd6186bc740 1 -- 172.21.15.5:0/3489044687 shutdown_connections 2024-08-31T05:37:09.151 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.147+0000 7fd6186bc740 1 --2- 172.21.15.5:0/3489044687 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55bbbf4581c0 0x55bbbf8f7190 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.151 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.147+0000 7fd6186bc740 1 --2- 172.21.15.5:0/3489044687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bbbf4c41b0 0x55bbbf8f3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.151 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.147+0000 7fd6186bc740 1 --2- 172.21.15.5:0/3489044687 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbbf4a34d0 0x55bbbf87c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.151 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.147+0000 7fd5f27fc640 0 client.17493 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:37:09.151 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.147+0000 7fd6186bc740 1 --2- 172.21.15.5:0/3489044687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bbbf49b2f0 0x55bbbf87bf50 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.151 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.147+0000 7fd6186bc740 1 -- 172.21.15.5:0/3489044687 >> 172.21.15.5:0/3489044687 conn(0x55bbbf4b8300 msgr2=0x55bbbf8694b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:09.151 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.147+0000 7fd6186bc740 1 -- 172.21.15.5:0/3489044687 shutdown_connections 2024-08-31T05:37:09.151 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.147+0000 7fd6186bc740 1 -- 172.21.15.5:0/3489044687 wait complete. 2024-08-31T05:37:09.151 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.147+0000 7fd6186bc740 20 client.17493 trim_cache size 0 max 16384 2024-08-31T05:37:09.152 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:37:09.152 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:37:09.152 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:37:09.152 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:37:09.152 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.148+0000 7fd611750640 1 -- 172.21.15.5:0/1523681872 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd5f80b4ca0 msgr2=0x7fd5f80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:09.152 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.148+0000 7fd611750640 1 --2- 172.21.15.5:0/1523681872 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd5f80b4ca0 0x7fd5f80b71b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd6040abb60 tx=0x7fd604018040 comp rx=0 tx=0).stop 2024-08-31T05:37:09.153 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.148+0000 7fd611750640 1 -- 172.21.15.5:0/1523681872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd60c1089e0 msgr2=0x7fd60c19baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:09.153 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.148+0000 7fd611750640 1 --2- 172.21.15.5:0/1523681872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd60c1089e0 0x7fd60c19baa0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fd60400efc0 tx=0x7fd60400c800 comp rx=0 tx=0).stop 2024-08-31T05:37:09.153 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.148+0000 7fd611750640 1 -- 172.21.15.5:0/1523681872 shutdown_connections 2024-08-31T05:37:09.153 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.148+0000 7fd611750640 1 --2- 172.21.15.5:0/1523681872 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd5f80b4ca0 0x7fd5f80b71b0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.153 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.148+0000 7fd611750640 1 --2- 172.21.15.5:0/1523681872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd60c1089e0 0x7fd60c19baa0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.153 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.148+0000 7fd611750640 1 --2- 172.21.15.5:0/1523681872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd60c108090 0x7fd60c19b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.153 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.148+0000 7fd611750640 1 --2- 172.21.15.5:0/1523681872 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd60c102760 0x7fd60c19b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.156 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.148+0000 7fd611750640 1 -- 172.21.15.5:0/1523681872 >> 172.21.15.5:0/1523681872 conn(0x7fd60c0fe160 msgr2=0x7fd60c100580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:09.156 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.148+0000 7fd611750640 1 -- 172.21.15.5:0/1523681872 shutdown_connections 2024-08-31T05:37:09.156 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:09.148+0000 7fd611750640 1 -- 172.21.15.5:0/1523681872 wait complete. 2024-08-31T05:37:09.569 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:37:09 smithi005 ceph-mon[18602]: pgmap v560: 129 pgs: 129 active+clean; 437 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 242 op/s 2024-08-31T05:37:09.569 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:37:09 smithi005 ceph-mon[18602]: osdmap e88: 12 total, 12 up, 12 in 2024-08-31T05:37:09.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:37:09 smithi070 ceph-mon[22316]: pgmap v560: 129 pgs: 129 active+clean; 437 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 242 op/s 2024-08-31T05:37:09.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:37:09 smithi070 ceph-mon[22316]: osdmap e88: 12 total, 12 up, 12 in 2024-08-31T05:37:09.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:37:09 smithi050 ceph-mon[22146]: pgmap v560: 129 pgs: 129 active+clean; 437 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 242 op/s 2024-08-31T05:37:09.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:37:09 smithi050 ceph-mon[22146]: osdmap e88: 12 total, 12 up, 12 in 2024-08-31T05:37:09.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.663+0000 7f49ed9c9640 1 -- 172.21.15.5:0/3443414126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49e8108140 msgr2=0x7f49e8108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:09.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.663+0000 7f49ed9c9640 1 --2- 172.21.15.5:0/3443414126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49e8108140 0x7f49e8108550 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f49dc009900 tx=0x7f49dc02a410 comp rx=0 tx=0).stop 2024-08-31T05:37:09.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.663+0000 7f49ed9c9640 1 -- 172.21.15.5:0/3443414126 shutdown_connections 2024-08-31T05:37:09.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.663+0000 7f49ed9c9640 1 --2- 172.21.15.5:0/3443414126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49e8108a90 0x7f49e810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.663+0000 7f49ed9c9640 1 --2- 172.21.15.5:0/3443414126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49e8108140 0x7f49e8108550 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.663+0000 7f49ed9c9640 1 --2- 172.21.15.5:0/3443414126 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49e8102800 0x7f49e8102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.663+0000 7f49ed9c9640 1 -- 172.21.15.5:0/3443414126 >> 172.21.15.5:0/3443414126 conn(0x7f49e80794d0 msgr2=0x7f49e80798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:09.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.663+0000 7f49ed9c9640 1 -- 172.21.15.5:0/3443414126 shutdown_connections 2024-08-31T05:37:09.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.663+0000 7f49ed9c9640 1 -- 172.21.15.5:0/3443414126 wait complete. 2024-08-31T05:37:09.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.664+0000 7f49ed9c9640 1 Processor -- start 2024-08-31T05:37:09.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.664+0000 7f49ed9c9640 1 -- start start 2024-08-31T05:37:09.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.665+0000 7f49ed9c9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49e8102800 0x7f49e819a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:09.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.665+0000 7f49ed9c9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49e8108140 0x7f49e819a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:09.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.665+0000 7f49ed9c9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49e8108a90 0x7f49e819fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:09.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.665+0000 7f49ed9c9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f49e81126e0 con 0x7f49e8102800 2024-08-31T05:37:09.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.665+0000 7f49ed9c9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f49e8112560 con 0x7f49e8108140 2024-08-31T05:37:09.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.665+0000 7f49ed9c9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f49e8112860 con 0x7f49e8108a90 2024-08-31T05:37:09.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.665+0000 7f49e6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49e8102800 0x7f49e819a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:09.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.665+0000 7f49e6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49e8102800 0x7f49e819a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56118/0 (socket says 172.21.15.5:56118) 2024-08-31T05:37:09.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.665+0000 7f49e6ffd640 1 -- 172.21.15.5:0/80473924 learned_addr learned my addr 172.21.15.5:0/80473924 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:09.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.665+0000 7f49e77fe640 1 --2- 172.21.15.5:0/80473924 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49e8108a90 0x7f49e819fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:09.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.665+0000 7f49e67fc640 1 --2- 172.21.15.5:0/80473924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49e8108140 0x7f49e819a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:09.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.665+0000 7f49e6ffd640 1 -- 172.21.15.5:0/80473924 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49e8108a90 msgr2=0x7f49e819fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:09.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.665+0000 7f49e6ffd640 1 --2- 172.21.15.5:0/80473924 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49e8108a90 0x7f49e819fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.665+0000 7f49e6ffd640 1 -- 172.21.15.5:0/80473924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49e8108140 msgr2=0x7f49e819a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:09.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.665+0000 7f49e6ffd640 1 --2- 172.21.15.5:0/80473924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49e8108140 0x7f49e819a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.665+0000 7f49e6ffd640 1 -- 172.21.15.5:0/80473924 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49e81a01b0 con 0x7f49e8102800 2024-08-31T05:37:09.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.665+0000 7f49e6ffd640 1 --2- 172.21.15.5:0/80473924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49e8102800 0x7f49e819a240 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f49d800e9f0 tx=0x7f49d800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:09.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.666+0000 7f49ec9c7640 1 -- 172.21.15.5:0/80473924 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d800cd80 con 0x7f49e8102800 2024-08-31T05:37:09.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.666+0000 7f49ec9c7640 1 -- 172.21.15.5:0/80473924 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49d80054d0 con 0x7f49e8102800 2024-08-31T05:37:09.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.666+0000 7f49ed9c9640 1 -- 172.21.15.5:0/80473924 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49e81a04a0 con 0x7f49e8102800 2024-08-31T05:37:09.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.666+0000 7f49ec9c7640 1 -- 172.21.15.5:0/80473924 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d8010690 con 0x7f49e8102800 2024-08-31T05:37:09.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.666+0000 7f49ed9c9640 1 -- 172.21.15.5:0/80473924 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49e81a6c00 con 0x7f49e8102800 2024-08-31T05:37:09.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.668+0000 7f49f3f3e740 1 Processor -- start 2024-08-31T05:37:09.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.668+0000 7f49ec9c7640 1 -- 172.21.15.5:0/80473924 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f49d8004e90 con 0x7f49e8102800 2024-08-31T05:37:09.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.669+0000 7f49f3f3e740 1 -- start start 2024-08-31T05:37:09.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.669+0000 7f49f3f3e740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e2a14da070 0x55e2a187f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:09.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.669+0000 7f49f3f3e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2a14b11b0 0x55e2a187f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:09.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.669+0000 7f49f3f3e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e2a14b9390 0x55e2a187fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:09.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.669+0000 7f49f3f3e740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55e2a17f6680 con 0x55e2a14da070 2024-08-31T05:37:09.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.669+0000 7f49f3f3e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e2a17e5c10 con 0x55e2a14b9390 2024-08-31T05:37:09.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.669+0000 7f49f3f3e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e2a17e9bc0 con 0x55e2a14b11b0 2024-08-31T05:37:09.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.669+0000 7f49e77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e2a14da070 0x55e2a187f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:09.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.669+0000 7f49e6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2a14b11b0 0x55e2a187f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:09.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.669+0000 7f49e67fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e2a14b9390 0x55e2a187fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:09.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.669+0000 7f49e77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e2a14da070 0x55e2a187f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56122/0 (socket says 172.21.15.5:56122) 2024-08-31T05:37:09.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.669+0000 7f49e77fe640 1 -- 172.21.15.5:0/1329582005 learned_addr learned my addr 172.21.15.5:0/1329582005 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:09.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.669+0000 7f49e67fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e2a14b9390 0x55e2a187fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:46092/0 (socket says 172.21.15.5:46092) 2024-08-31T05:37:09.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.669+0000 7f49e6ffd640 1 -- 172.21.15.5:0/1329582005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e2a14b9390 msgr2=0x55e2a187fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:09.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.669+0000 7f49e6ffd640 1 --2- 172.21.15.5:0/1329582005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e2a14b9390 0x55e2a187fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.669+0000 7f49e6ffd640 1 -- 172.21.15.5:0/1329582005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e2a14da070 msgr2=0x55e2a187f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:09.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.669+0000 7f49e6ffd640 1 --2- 172.21.15.5:0/1329582005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e2a14da070 0x55e2a187f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.669+0000 7f49e6ffd640 1 -- 172.21.15.5:0/1329582005 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2a1545650 con 0x55e2a14b11b0 2024-08-31T05:37:09.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.669+0000 7f49e77fe640 1 --2- 172.21.15.5:0/1329582005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e2a14da070 0x55e2a187f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:37:09.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.669+0000 7f49ec9c7640 1 --2- 172.21.15.5:0/80473924 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f49d00b4ca0 0x7f49d00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:09.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.670+0000 7f49e77fe640 1 --2- 172.21.15.5:0/80473924 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f49d00b4ca0 0x7f49d00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:09.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.670+0000 7f49e6ffd640 1 --2- 172.21.15.5:0/1329582005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2a14b11b0 0x55e2a187f850 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f49d80e30e0 tx=0x7f49d80e9e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f758ab4fdf57bb6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:09.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.670+0000 7f49ec9c7640 1 -- 172.21.15.5:0/80473924 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9599+0+0 (secure 0 0 0) 0x7f49d80e5dc0 con 0x7f49e8102800 2024-08-31T05:37:09.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.670+0000 7f49cdffb640 1 -- 172.21.15.5:0/1329582005 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d80a7f40 con 0x55e2a14b11b0 2024-08-31T05:37:09.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.670+0000 7f49cdffb640 1 -- 172.21.15.5:0/1329582005 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49d80abb90 con 0x55e2a14b11b0 2024-08-31T05:37:09.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.670+0000 7f49cdffb640 1 -- 172.21.15.5:0/1329582005 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d8005180 con 0x55e2a14b11b0 2024-08-31T05:37:09.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.671+0000 7f49f3f3e740 1 -- 172.21.15.5:0/1329582005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2a14b11b0 msgr2=0x55e2a187f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:09.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.671+0000 7f49e77fe640 1 --2- 172.21.15.5:0/80473924 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f49d00b4ca0 0x7f49d00b71b0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f49e0011890 tx=0x7f49e0009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:09.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.671+0000 7f49f3f3e740 1 --2- 172.21.15.5:0/1329582005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2a14b11b0 0x55e2a187f850 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f49d80e30e0 tx=0x7f49d80e9e70 comp rx=0 tx=0).stop 2024-08-31T05:37:09.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.671+0000 7f49f3f3e740 1 -- 172.21.15.5:0/1329582005 shutdown_connections 2024-08-31T05:37:09.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.671+0000 7f49f3f3e740 1 --2- 172.21.15.5:0/1329582005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e2a14b9390 0x55e2a187fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.671+0000 7f49f3f3e740 1 --2- 172.21.15.5:0/1329582005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2a14b11b0 0x55e2a187f850 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.671+0000 7f49f3f3e740 1 --2- 172.21.15.5:0/1329582005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e2a14da070 0x55e2a187f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.671+0000 7f49f3f3e740 1 -- 172.21.15.5:0/1329582005 >> 172.21.15.5:0/1329582005 conn(0x55e2a14ce460 msgr2=0x55e2a187d200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:09.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.671+0000 7f49f3f3e740 1 -- 172.21.15.5:0/1329582005 shutdown_connections 2024-08-31T05:37:09.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.671+0000 7f49f3f3e740 1 -- 172.21.15.5:0/1329582005 wait complete. 2024-08-31T05:37:09.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.671+0000 7f49f3f3e740 1 -- start start 2024-08-31T05:37:09.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.672+0000 7f49f3f3e740 1 Processor -- start 2024-08-31T05:37:09.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.672+0000 7f49f3f3e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2a14b11b0 0x55e2a188aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:09.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.672+0000 7f49f3f3e740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e2a14b9390 0x55e2a188b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:09.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.672+0000 7f49f3f3e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e2a14da070 0x55e2a189b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:09.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.672+0000 7f49f3f3e740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55e2a1648700 con 0x55e2a14b9390 2024-08-31T05:37:09.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.672+0000 7f49f3f3e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e2a176c750 con 0x55e2a14da070 2024-08-31T05:37:09.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.672+0000 7f49f3f3e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e2a1891f00 con 0x55e2a14b11b0 2024-08-31T05:37:09.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.672+0000 7f49f3f3e740 10 client.0 _ll_register_callbacks cb 0x55e2a179be10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:37:09.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.672+0000 7f49e6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2a14b11b0 0x55e2a188aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:09.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.672+0000 7f49e6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2a14b11b0 0x55e2a188aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:39898/0 (socket says 172.21.15.5:39898) 2024-08-31T05:37:09.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.672+0000 7f49e6ffd640 1 -- 172.21.15.5:0/3638414490 learned_addr learned my addr 172.21.15.5:0/3638414490 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:09.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.672+0000 7f49e67fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e2a14b9390 0x55e2a188b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:09.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.672+0000 7f49e77fe640 1 --2- 172.21.15.5:0/3638414490 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e2a14da070 0x55e2a189b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:09.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.673+0000 7f49e6ffd640 1 -- 172.21.15.5:0/3638414490 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e2a14da070 msgr2=0x55e2a189b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:09.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.673+0000 7f49e6ffd640 1 --2- 172.21.15.5:0/3638414490 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e2a14da070 0x55e2a189b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.673+0000 7f49e6ffd640 1 -- 172.21.15.5:0/3638414490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e2a14b9390 msgr2=0x55e2a188b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:09.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.673+0000 7f49e6ffd640 1 --2- 172.21.15.5:0/3638414490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e2a14b9390 0x55e2a188b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.673+0000 7f49e6ffd640 1 -- 172.21.15.5:0/3638414490 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2a17a5900 con 0x55e2a14b11b0 2024-08-31T05:37:09.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.673+0000 7f49e6ffd640 1 --2- 172.21.15.5:0/3638414490 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2a14b11b0 0x55e2a188aaf0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f49d80e36e0 tx=0x7f49d80048f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de6e28682a889c5b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:09.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.673+0000 7f49c6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:37:09.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.673+0000 7f49c6ffd640 1 -- 172.21.15.5:0/3638414490 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d80ab7f0 con 0x55e2a14b11b0 2024-08-31T05:37:09.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.673+0000 7f49c6ffd640 1 -- 172.21.15.5:0/3638414490 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9599+0+0 (secure 0 0 0) 0x7f49d80ac4f0 con 0x55e2a14b11b0 2024-08-31T05:37:09.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.673+0000 7f49f3f3e740 1 -- 172.21.15.5:0/3638414490 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f49d80abb90 con 0x55e2a14b11b0 2024-08-31T05:37:09.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.673+0000 7f49c6ffd640 1 -- 172.21.15.5:0/3638414490 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f49d80ab9d0 con 0x55e2a14b11b0 2024-08-31T05:37:09.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.673+0000 7f49f3f3e740 10 client.27097 fetch_fsmap learned FSMap version 34 2024-08-31T05:37:09.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.673+0000 7f49f3f3e740 1 -- 172.21.15.5:0/3638414490 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55e2a189dd90 con 0x55e2a14b11b0 2024-08-31T05:37:09.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.673+0000 7f49c6ffd640 1 -- 172.21.15.5:0/3638414490 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49d80abb90 con 0x55e2a14b11b0 2024-08-31T05:37:09.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.674+0000 7f49c6ffd640 1 -- 172.21.15.5:0/3638414490 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f49d80b4f10 con 0x55e2a14b11b0 2024-08-31T05:37:09.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.674+0000 7f49f3f3e740 10 client.27097 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:37:09.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.674+0000 7f49f3f3e740 10 client.27097 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-31T05:37:09.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.674+0000 7f49f3f3e740 20 client.27097 populate_metadata read hostname 'smithi005' 2024-08-31T05:37:09.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.674+0000 7f49f3f3e740 1 --2- 172.21.15.5:0/3638414490 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55e2a14989f0 0x55e2a18a10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:09.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.674+0000 7f49f3f3e740 4 client.27097 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:37:09.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.674+0000 7f49f3f3e740 1 -- 172.21.15.5:0/3638414490 --> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e2a17f85d0 con 0x55e2a14989f0 2024-08-31T05:37:09.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.674+0000 7f49e67fc640 1 --2- 172.21.15.5:0/3638414490 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55e2a14989f0 0x55e2a18a10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:09.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.674+0000 7f49c6ffd640 10 client.27097 ms_handle_connect on v2:172.21.15.50:6838/98200944 2024-08-31T05:37:09.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.674+0000 7f49e67fc640 1 --2- 172.21.15.5:0/3638414490 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55e2a14989f0 0x55e2a18a10f0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c1853ae71daa92c4 server_cookie=a67bb9dc6fe24733 in_seq=0 out_seq=0 2024-08-31T05:37:09.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.675+0000 7f49c6ffd640 1 -- 172.21.15.5:0/3638414490 <== mds.1 v2:172.21.15.50:6838/98200944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e2a17f85d0 con 0x55e2a14989f0 2024-08-31T05:37:09.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.675+0000 7f49c6ffd640 10 client.27097 handle_command_reply: tid=0 2024-08-31T05:37:09.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.675+0000 7f49f3f3e740 1 client.27097 shutdown 2024-08-31T05:37:09.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.675+0000 7f49f3f3e740 1 -- 172.21.15.5:0/3638414490 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2a14b11b0 msgr2=0x55e2a188aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:09.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.675+0000 7f49f3f3e740 1 --2- 172.21.15.5:0/3638414490 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2a14b11b0 0x55e2a188aaf0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f49d80e36e0 tx=0x7f49d80048f0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.675+0000 7f49f3f3e740 1 -- 172.21.15.5:0/3638414490 shutdown_connections 2024-08-31T05:37:09.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.675+0000 7f49f3f3e740 1 --2- 172.21.15.5:0/3638414490 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55e2a14989f0 0x55e2a18a10f0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.675+0000 7f49f3f3e740 1 --2- 172.21.15.5:0/3638414490 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e2a14da070 0x55e2a189b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.675+0000 7f49f3f3e740 1 --2- 172.21.15.5:0/3638414490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e2a14b9390 0x55e2a188b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.675+0000 7f49c6ffd640 0 client.27097 ms_handle_reset on v2:172.21.15.50:6838/98200944 2024-08-31T05:37:09.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.675+0000 7f49f3f3e740 1 --2- 172.21.15.5:0/3638414490 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2a14b11b0 0x55e2a188aaf0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.675+0000 7f49f3f3e740 1 -- 172.21.15.5:0/3638414490 >> 172.21.15.5:0/3638414490 conn(0x55e2a14ce460 msgr2=0x55e2a18824f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:09.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.675+0000 7f49f3f3e740 1 -- 172.21.15.5:0/3638414490 shutdown_connections 2024-08-31T05:37:09.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.675+0000 7f49f3f3e740 1 -- 172.21.15.5:0/3638414490 wait complete. 2024-08-31T05:37:09.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.676+0000 7f49f3f3e740 20 client.27097 trim_cache size 0 max 16384 2024-08-31T05:37:09.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.690+0000 7f49f3f3e740 1 Processor -- start 2024-08-31T05:37:09.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.690+0000 7f49f3f3e740 1 -- start start 2024-08-31T05:37:09.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.690+0000 7f49f3f3e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2a14b11b0 0x55e2a187d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:09.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.690+0000 7f49f3f3e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e2a14b9390 0x55e2a189b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:09.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.690+0000 7f49f3f3e740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e2a14da070 0x55e2a1882410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:09.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.690+0000 7f49f3f3e740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f49e81aec60 con 0x55e2a14da070 2024-08-31T05:37:09.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.690+0000 7f49f3f3e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f49e81b07a0 con 0x55e2a14b9390 2024-08-31T05:37:09.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.690+0000 7f49f3f3e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f49e81af330 con 0x55e2a14b11b0 2024-08-31T05:37:09.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.690+0000 7f49e77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e2a14da070 0x55e2a1882410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:09.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.690+0000 7f49e67fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e2a14b9390 0x55e2a189b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:09.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.690+0000 7f49e77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e2a14da070 0x55e2a1882410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56138/0 (socket says 172.21.15.5:56138) 2024-08-31T05:37:09.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.690+0000 7f49e77fe640 1 -- 172.21.15.5:0/4092765284 learned_addr learned my addr 172.21.15.5:0/4092765284 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:09.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.690+0000 7f49e67fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e2a14b9390 0x55e2a189b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:46106/0 (socket says 172.21.15.5:46106) 2024-08-31T05:37:09.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.690+0000 7f49e6ffd640 1 --2- 172.21.15.5:0/4092765284 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2a14b11b0 0x55e2a187d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:09.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.691+0000 7f49e77fe640 1 -- 172.21.15.5:0/4092765284 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2a14b11b0 msgr2=0x55e2a187d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:09.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.691+0000 7f49e77fe640 1 --2- 172.21.15.5:0/4092765284 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2a14b11b0 0x55e2a187d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.691+0000 7f49e77fe640 1 -- 172.21.15.5:0/4092765284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e2a14b9390 msgr2=0x55e2a189b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:09.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.691+0000 7f49e77fe640 1 --2- 172.21.15.5:0/4092765284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e2a14b9390 0x55e2a189b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.691+0000 7f49e77fe640 1 -- 172.21.15.5:0/4092765284 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2a1881600 con 0x55e2a14da070 2024-08-31T05:37:09.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.691+0000 7f49e6ffd640 1 --2- 172.21.15.5:0/4092765284 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2a14b11b0 0x55e2a187d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:37:09.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.691+0000 7f49e77fe640 1 --2- 172.21.15.5:0/4092765284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e2a14da070 0x55e2a1882410 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f49e000fad0 tx=0x7f49e0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=636945d19b2a1146 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:09.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.691+0000 7f49cd7fa640 1 -- 172.21.15.5:0/4092765284 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e0004b20 con 0x55e2a14da070 2024-08-31T05:37:09.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.691+0000 7f49cd7fa640 1 -- 172.21.15.5:0/4092765284 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49e0004cc0 con 0x55e2a14da070 2024-08-31T05:37:09.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.691+0000 7f49cd7fa640 1 -- 172.21.15.5:0/4092765284 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e0005240 con 0x55e2a14da070 2024-08-31T05:37:09.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.692+0000 7f49f3f3e740 1 -- 172.21.15.5:0/4092765284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e2a14da070 msgr2=0x55e2a1882410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:09.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.692+0000 7f49f3f3e740 1 --2- 172.21.15.5:0/4092765284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e2a14da070 0x55e2a1882410 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f49e000fad0 tx=0x7f49e0016000 comp rx=0 tx=0).stop 2024-08-31T05:37:09.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.692+0000 7f49f3f3e740 1 -- 172.21.15.5:0/4092765284 shutdown_connections 2024-08-31T05:37:09.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.692+0000 7f49f3f3e740 1 --2- 172.21.15.5:0/4092765284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e2a14da070 0x55e2a1882410 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.692+0000 7f49f3f3e740 1 --2- 172.21.15.5:0/4092765284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e2a14b9390 0x55e2a189b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.692+0000 7f49f3f3e740 1 --2- 172.21.15.5:0/4092765284 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2a14b11b0 0x55e2a187d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.692+0000 7f49f3f3e740 1 -- 172.21.15.5:0/4092765284 >> 172.21.15.5:0/4092765284 conn(0x55e2a14ce460 msgr2=0x55e2a187cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:09.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.692+0000 7f49f3f3e740 1 -- 172.21.15.5:0/4092765284 shutdown_connections 2024-08-31T05:37:09.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.692+0000 7f49f3f3e740 1 -- 172.21.15.5:0/4092765284 wait complete. 2024-08-31T05:37:09.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.693+0000 7f49f3f3e740 1 -- start start 2024-08-31T05:37:09.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.693+0000 7f49f3f3e740 1 Processor -- start 2024-08-31T05:37:09.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.693+0000 7f49f3f3e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e2a14b11b0 0x55e2a18a2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:09.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.693+0000 7f49f3f3e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2a14b9390 0x55e2a18a2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:09.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.693+0000 7f49f3f3e740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e2a14da070 0x55e2a190a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:09.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.693+0000 7f49f3f3e740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f49e81b00d0 con 0x55e2a14da070 2024-08-31T05:37:09.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.693+0000 7f49f3f3e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f49e81afa00 con 0x55e2a14b11b0 2024-08-31T05:37:09.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.693+0000 7f49f3f3e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f49e81acc60 con 0x55e2a14b9390 2024-08-31T05:37:09.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.693+0000 7f49f3f3e740 10 client.0 _ll_register_callbacks cb 0x7f49e0009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:37:09.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.693+0000 7f49e6ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e2a14b11b0 0x55e2a18a2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:09.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.693+0000 7f49e67fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2a14b9390 0x55e2a18a2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:09.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.693+0000 7f49e6ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e2a14b11b0 0x55e2a18a2520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:46116/0 (socket says 172.21.15.5:46116) 2024-08-31T05:37:09.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.694+0000 7f49e6ffd640 1 -- 172.21.15.5:0/1613590950 learned_addr learned my addr 172.21.15.5:0/1613590950 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:09.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.694+0000 7f49e67fc640 1 --2- 172.21.15.5:0/1613590950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2a14b9390 0x55e2a18a2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:39908/0 (socket says 172.21.15.5:39908) 2024-08-31T05:37:09.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.694+0000 7f49e77fe640 1 --2- 172.21.15.5:0/1613590950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e2a14da070 0x55e2a190a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:09.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.694+0000 7f49e67fc640 1 -- 172.21.15.5:0/1613590950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e2a14b11b0 msgr2=0x55e2a18a2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:09.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.694+0000 7f49e67fc640 1 --2- 172.21.15.5:0/1613590950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e2a14b11b0 0x55e2a18a2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.694+0000 7f49e67fc640 1 -- 172.21.15.5:0/1613590950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e2a14da070 msgr2=0x55e2a190a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:09.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.694+0000 7f49e67fc640 1 --2- 172.21.15.5:0/1613590950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e2a14da070 0x55e2a190a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.694+0000 7f49e67fc640 1 -- 172.21.15.5:0/1613590950 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2a190adb0 con 0x55e2a14b9390 2024-08-31T05:37:09.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.694+0000 7f49e67fc640 1 --2- 172.21.15.5:0/1613590950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2a14b9390 0x55e2a18a2a60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f49dc006010 tx=0x7f49dc02abc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=338bdcb2785ddb45 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:09.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.694+0000 7f49c6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:37:09.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.694+0000 7f49c6ffd640 1 -- 172.21.15.5:0/1613590950 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49dc035040 con 0x55e2a14b9390 2024-08-31T05:37:09.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.694+0000 7f49c6ffd640 1 -- 172.21.15.5:0/1613590950 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9599+0+0 (secure 0 0 0) 0x7f49dc005040 con 0x55e2a14b9390 2024-08-31T05:37:09.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.694+0000 7f49f3f3e740 1 -- 172.21.15.5:0/1613590950 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f49e0004cc0 con 0x55e2a14b9390 2024-08-31T05:37:09.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.695+0000 7f49c6ffd640 1 -- 172.21.15.5:0/1613590950 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f49dc056050 con 0x55e2a14b9390 2024-08-31T05:37:09.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.695+0000 7f49f3f3e740 10 client.27103 fetch_fsmap learned FSMap version 34 2024-08-31T05:37:09.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.695+0000 7f49f3f3e740 1 -- 172.21.15.5:0/1613590950 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55e2a190bf00 con 0x55e2a14b9390 2024-08-31T05:37:09.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.695+0000 7f49c6ffd640 1 -- 172.21.15.5:0/1613590950 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49e0004cc0 con 0x55e2a14b9390 2024-08-31T05:37:09.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.695+0000 7f49c6ffd640 1 -- 172.21.15.5:0/1613590950 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f49dc0035f0 con 0x55e2a14b9390 2024-08-31T05:37:09.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.695+0000 7f49f3f3e740 10 client.27103 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:37:09.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.695+0000 7f49f3f3e740 10 client.27103 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-31T05:37:09.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.695+0000 7f49f3f3e740 20 client.27103 populate_metadata read hostname 'smithi005' 2024-08-31T05:37:09.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.695+0000 7f49f3f3e740 1 --2- 172.21.15.5:0/1613590950 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55e2a146dda0 0x55e2a190e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:09.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.695+0000 7f49f3f3e740 4 client.27103 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:37:09.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.695+0000 7f49f3f3e740 1 -- 172.21.15.5:0/1613590950 --> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e2a17f4070 con 0x55e2a146dda0 2024-08-31T05:37:09.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.695+0000 7f49e6ffd640 1 --2- 172.21.15.5:0/1613590950 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55e2a146dda0 0x55e2a190e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:09.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.696+0000 7f49c6ffd640 10 client.27103 ms_handle_connect on v2:172.21.15.50:6838/98200944 2024-08-31T05:37:09.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.696+0000 7f49e6ffd640 1 --2- 172.21.15.5:0/1613590950 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55e2a146dda0 0x55e2a190e740 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e2b2449b40a6e079 server_cookie=d0a9669b007c606 in_seq=0 out_seq=0 2024-08-31T05:37:09.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.696+0000 7f49c6ffd640 1 -- 172.21.15.5:0/1613590950 <== mds.1 v2:172.21.15.50:6838/98200944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e2a17f4070 con 0x55e2a146dda0 2024-08-31T05:37:09.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.696+0000 7f49c6ffd640 10 client.27103 handle_command_reply: tid=0 2024-08-31T05:37:09.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.696+0000 7f49f3f3e740 1 client.27103 shutdown 2024-08-31T05:37:09.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.696+0000 7f49f3f3e740 1 -- 172.21.15.5:0/1613590950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2a14b9390 msgr2=0x55e2a18a2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:09.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.696+0000 7f49f3f3e740 1 --2- 172.21.15.5:0/1613590950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2a14b9390 0x55e2a18a2a60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f49dc006010 tx=0x7f49dc02abc0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.696+0000 7f49f3f3e740 1 -- 172.21.15.5:0/1613590950 shutdown_connections 2024-08-31T05:37:09.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.696+0000 7f49f3f3e740 1 --2- 172.21.15.5:0/1613590950 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55e2a146dda0 0x55e2a190e740 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.696+0000 7f49f3f3e740 1 --2- 172.21.15.5:0/1613590950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e2a14da070 0x55e2a190a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.696+0000 7f49f3f3e740 1 --2- 172.21.15.5:0/1613590950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2a14b9390 0x55e2a18a2a60 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.696+0000 7f49c6ffd640 0 client.27103 ms_handle_reset on v2:172.21.15.50:6838/98200944 2024-08-31T05:37:09.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.696+0000 7f49f3f3e740 1 --2- 172.21.15.5:0/1613590950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e2a14b11b0 0x55e2a18a2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.696+0000 7f49f3f3e740 1 -- 172.21.15.5:0/1613590950 >> 172.21.15.5:0/1613590950 conn(0x55e2a14ce460 msgr2=0x55e2a1882410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:09.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.696+0000 7f49f3f3e740 1 -- 172.21.15.5:0/1613590950 shutdown_connections 2024-08-31T05:37:09.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.696+0000 7f49f3f3e740 1 -- 172.21.15.5:0/1613590950 wait complete. 2024-08-31T05:37:09.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.696+0000 7f49f3f3e740 20 client.27103 trim_cache size 0 max 16384 2024-08-31T05:37:09.704 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:37:09.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.697+0000 7f49ed9c9640 1 -- 172.21.15.5:0/80473924 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f49d00b4ca0 msgr2=0x7f49d00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:09.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.697+0000 7f49ed9c9640 1 --2- 172.21.15.5:0/80473924 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f49d00b4ca0 0x7f49d00b71b0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f49e0011890 tx=0x7f49e0009500 comp rx=0 tx=0).stop 2024-08-31T05:37:09.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.697+0000 7f49ed9c9640 1 -- 172.21.15.5:0/80473924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49e8102800 msgr2=0x7f49e819a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:09.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.697+0000 7f49ed9c9640 1 --2- 172.21.15.5:0/80473924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49e8102800 0x7f49e819a240 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f49d800e9f0 tx=0x7f49d800edf0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.697+0000 7f49ed9c9640 1 -- 172.21.15.5:0/80473924 shutdown_connections 2024-08-31T05:37:09.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.697+0000 7f49ed9c9640 1 --2- 172.21.15.5:0/80473924 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f49d00b4ca0 0x7f49d00b71b0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.697+0000 7f49ed9c9640 1 --2- 172.21.15.5:0/80473924 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49e8108a90 0x7f49e819fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.697+0000 7f49ed9c9640 1 --2- 172.21.15.5:0/80473924 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49e8108140 0x7f49e819a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.697+0000 7f49ed9c9640 1 --2- 172.21.15.5:0/80473924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49e8102800 0x7f49e819a240 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:09.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.697+0000 7f49ed9c9640 1 -- 172.21.15.5:0/80473924 >> 172.21.15.5:0/80473924 conn(0x7f49e80794d0 msgr2=0x7f49e806afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:09.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.697+0000 7f49ed9c9640 1 -- 172.21.15.5:0/80473924 shutdown_connections 2024-08-31T05:37:09.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:09.697+0000 7f49ed9c9640 1 -- 172.21.15.5:0/80473924 wait complete. 2024-08-31T05:37:09.926 INFO:tasks.workunit.client.0.smithi005.stdout: 1 806069 11.52 MB/sec execute 237 sec latency 19.776 ms 2024-08-31T05:37:10.478 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T05:37:10.742 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:37:10.926 INFO:tasks.workunit.client.0.smithi005.stdout: 1 807646 11.50 MB/sec execute 238 sec latency 29.771 ms 2024-08-31T05:37:11.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.466+0000 7fca02db6640 1 -- 172.21.15.5:0/3368189783 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9fc104750 msgr2=0x7fc9fc104b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:11.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.466+0000 7fca02db6640 1 --2- 172.21.15.5:0/3368189783 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9fc104750 0x7fc9fc104b60 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0009900 tx=0x7fc9f002a410 comp rx=0 tx=0).stop 2024-08-31T05:37:11.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.466+0000 7fca02db6640 1 -- 172.21.15.5:0/3368189783 shutdown_connections 2024-08-31T05:37:11.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.466+0000 7fca02db6640 1 --2- 172.21.15.5:0/3368189783 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9fc10dbb0 0x7fc9fc1100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:11.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.466+0000 7fca02db6640 1 --2- 172.21.15.5:0/3368189783 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9fc1050a0 0x7fc9fc10d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:11.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.466+0000 7fca02db6640 1 --2- 172.21.15.5:0/3368189783 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9fc104750 0x7fc9fc104b60 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:11.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.466+0000 7fca02db6640 1 -- 172.21.15.5:0/3368189783 >> 172.21.15.5:0/3368189783 conn(0x7fc9fc0794d0 msgr2=0x7fc9fc0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:11.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.466+0000 7fca02db6640 1 -- 172.21.15.5:0/3368189783 shutdown_connections 2024-08-31T05:37:11.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.466+0000 7fca02db6640 1 -- 172.21.15.5:0/3368189783 wait complete. 2024-08-31T05:37:11.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.467+0000 7fca02db6640 1 Processor -- start 2024-08-31T05:37:11.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.467+0000 7fca02db6640 1 -- start start 2024-08-31T05:37:11.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.467+0000 7fca02db6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9fc104750 0x7fc9fc19a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:11.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.467+0000 7fca02db6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9fc1050a0 0x7fc9fc19a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:11.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.467+0000 7fca02db6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9fc10dbb0 0x7fc9fc19fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:11.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.467+0000 7fca02db6640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc9fc113830 con 0x7fc9fc10dbb0 2024-08-31T05:37:11.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.467+0000 7fca02db6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc9fc1136b0 con 0x7fc9fc1050a0 2024-08-31T05:37:11.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.467+0000 7fca02db6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc9fc1139b0 con 0x7fc9fc104750 2024-08-31T05:37:11.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.467+0000 7fca00b52640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9fc104750 0x7fc9fc19a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:11.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.467+0000 7fca01353640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9fc10dbb0 0x7fc9fc19fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:11.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.467+0000 7fca00b52640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9fc104750 0x7fc9fc19a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:39924/0 (socket says 172.21.15.5:39924) 2024-08-31T05:37:11.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.467+0000 7fca00b52640 1 -- 172.21.15.5:0/328331944 learned_addr learned my addr 172.21.15.5:0/328331944 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:11.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.467+0000 7fc9fbfff640 1 --2- 172.21.15.5:0/328331944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9fc1050a0 0x7fc9fc19a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:11.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.468+0000 7fca00b52640 1 -- 172.21.15.5:0/328331944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9fc1050a0 msgr2=0x7fc9fc19a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:11.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.468+0000 7fca00b52640 1 --2- 172.21.15.5:0/328331944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9fc1050a0 0x7fc9fc19a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:11.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.468+0000 7fca00b52640 1 -- 172.21.15.5:0/328331944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9fc10dbb0 msgr2=0x7fc9fc19fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:11.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.468+0000 7fca00b52640 1 --2- 172.21.15.5:0/328331944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9fc10dbb0 0x7fc9fc19fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:11.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.468+0000 7fca00b52640 1 -- 172.21.15.5:0/328331944 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9fc1a02d0 con 0x7fc9fc104750 2024-08-31T05:37:11.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.468+0000 7fca01353640 1 --2- 172.21.15.5:0/328331944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9fc10dbb0 0x7fc9fc19fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:37:11.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.468+0000 7fca00b52640 1 --2- 172.21.15.5:0/328331944 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9fc104750 0x7fc9fc19a360 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0032fd0 tx=0x7fc9f0031a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:11.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.468+0000 7fc9f9ffb640 1 -- 172.21.15.5:0/328331944 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f003f030 con 0x7fc9fc104750 2024-08-31T05:37:11.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.468+0000 7fca02db6640 1 -- 172.21.15.5:0/328331944 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9fc1a0560 con 0x7fc9fc104750 2024-08-31T05:37:11.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.468+0000 7fc9f9ffb640 1 -- 172.21.15.5:0/328331944 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9f0004490 con 0x7fc9fc104750 2024-08-31T05:37:11.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.468+0000 7fc9f9ffb640 1 -- 172.21.15.5:0/328331944 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f0035070 con 0x7fc9fc104750 2024-08-31T05:37:11.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.468+0000 7fca02db6640 1 -- 172.21.15.5:0/328331944 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9fc1a6d20 con 0x7fc9fc104750 2024-08-31T05:37:11.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.471+0000 7fc9f9ffb640 1 -- 172.21.15.5:0/328331944 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fc9f0042030 con 0x7fc9fc104750 2024-08-31T05:37:11.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.471+0000 7fca0932b740 1 Processor -- start 2024-08-31T05:37:11.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.471+0000 7fca0932b740 1 -- start start 2024-08-31T05:37:11.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.472+0000 7fca0932b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648ca280070 0x5648ca625310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:11.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.472+0000 7fca0932b740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5648ca2571b0 0x5648ca625850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:11.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.472+0000 7fca0932b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648ca25f390 0x5648ca625d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:11.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.472+0000 7fca0932b740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5648ca59c680 con 0x5648ca2571b0 2024-08-31T05:37:11.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.472+0000 7fca0932b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5648ca58bc10 con 0x5648ca25f390 2024-08-31T05:37:11.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.472+0000 7fca0932b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5648ca58fbc0 con 0x5648ca280070 2024-08-31T05:37:11.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.472+0000 7fca01353640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648ca280070 0x5648ca625310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:11.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.472+0000 7fca00b52640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5648ca2571b0 0x5648ca625850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:11.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.472+0000 7fca01353640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648ca280070 0x5648ca625310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:39926/0 (socket says 172.21.15.5:39926) 2024-08-31T05:37:11.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.472+0000 7fca01353640 1 -- 172.21.15.5:0/3555600120 learned_addr learned my addr 172.21.15.5:0/3555600120 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:11.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.472+0000 7fc9fbfff640 1 --2- 172.21.15.5:0/3555600120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648ca25f390 0x5648ca625d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:11.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.472+0000 7fca01353640 1 -- 172.21.15.5:0/3555600120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648ca25f390 msgr2=0x5648ca625d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:11.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.472+0000 7fca01353640 1 --2- 172.21.15.5:0/3555600120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648ca25f390 0x5648ca625d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:11.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.472+0000 7fca01353640 1 -- 172.21.15.5:0/3555600120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5648ca2571b0 msgr2=0x5648ca625850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:11.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.472+0000 7fca01353640 1 --2- 172.21.15.5:0/3555600120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5648ca2571b0 0x5648ca625850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:11.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.472+0000 7fca01353640 1 -- 172.21.15.5:0/3555600120 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648ca2eb650 con 0x5648ca280070 2024-08-31T05:37:11.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.472+0000 7fc9fbfff640 1 --2- 172.21.15.5:0/3555600120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648ca25f390 0x5648ca625d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:37:11.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.473+0000 7fc9f9ffb640 1 --2- 172.21.15.5:0/328331944 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc9ec0b4ca0 0x7fc9ec0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:11.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.473+0000 7fca01353640 1 --2- 172.21.15.5:0/3555600120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648ca280070 0x5648ca625310 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc9f4011790 tx=0x7fc9f4011c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28d5afe6a6c87950 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:11.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.473+0000 7fca00b52640 1 --2- 172.21.15.5:0/328331944 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc9ec0b4ca0 0x7fc9ec0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:11.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.473+0000 7fc9e6ffd640 1 -- 172.21.15.5:0/3555600120 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f4003c30 con 0x5648ca280070 2024-08-31T05:37:11.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.473+0000 7fc9f9ffb640 1 -- 172.21.15.5:0/328331944 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9599+0+0 (secure 0 0 0) 0x7fc9f0105c60 con 0x7fc9fc104750 2024-08-31T05:37:11.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.473+0000 7fc9e6ffd640 1 -- 172.21.15.5:0/3555600120 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9f4003dd0 con 0x5648ca280070 2024-08-31T05:37:11.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.473+0000 7fc9e6ffd640 1 -- 172.21.15.5:0/3555600120 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f40193e0 con 0x5648ca280070 2024-08-31T05:37:11.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.474+0000 7fca0932b740 1 -- 172.21.15.5:0/3555600120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648ca280070 msgr2=0x5648ca625310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:11.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.474+0000 7fca0932b740 1 --2- 172.21.15.5:0/3555600120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648ca280070 0x5648ca625310 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc9f4011790 tx=0x7fc9f4011c50 comp rx=0 tx=0).stop 2024-08-31T05:37:11.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.474+0000 7fca00b52640 1 --2- 172.21.15.5:0/328331944 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc9ec0b4ca0 0x7fc9ec0b71b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0103030 tx=0x7fc9f01097b0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:11.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.474+0000 7fca0932b740 1 -- 172.21.15.5:0/3555600120 shutdown_connections 2024-08-31T05:37:11.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.474+0000 7fca0932b740 1 --2- 172.21.15.5:0/3555600120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648ca25f390 0x5648ca625d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:11.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.474+0000 7fca0932b740 1 --2- 172.21.15.5:0/3555600120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5648ca2571b0 0x5648ca625850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:11.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.474+0000 7fca0932b740 1 --2- 172.21.15.5:0/3555600120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648ca280070 0x5648ca625310 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:11.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.474+0000 7fca0932b740 1 -- 172.21.15.5:0/3555600120 >> 172.21.15.5:0/3555600120 conn(0x5648ca274460 msgr2=0x5648ca623200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:11.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.474+0000 7fca0932b740 1 -- 172.21.15.5:0/3555600120 shutdown_connections 2024-08-31T05:37:11.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.474+0000 7fca0932b740 1 -- 172.21.15.5:0/3555600120 wait complete. 2024-08-31T05:37:11.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.474+0000 7fca0932b740 1 -- start start 2024-08-31T05:37:11.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.474+0000 7fca0932b740 1 Processor -- start 2024-08-31T05:37:11.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.475+0000 7fca0932b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648ca2571b0 0x5648ca634eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:11.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.475+0000 7fca0932b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648ca25f390 0x5648ca6353f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:11.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.475+0000 7fca0932b740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5648ca280070 0x5648ca641180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:11.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.475+0000 7fca0932b740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5648ca3ee700 con 0x5648ca280070 2024-08-31T05:37:11.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.475+0000 7fca0932b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5648ca512750 con 0x5648ca25f390 2024-08-31T05:37:11.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.475+0000 7fca0932b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5648ca637e50 con 0x5648ca2571b0 2024-08-31T05:37:11.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.475+0000 7fca0932b740 10 client.0 _ll_register_callbacks cb 0x5648ca541e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:37:11.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.475+0000 7fca01353640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648ca2571b0 0x5648ca634eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:11.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.475+0000 7fca01353640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648ca2571b0 0x5648ca634eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:39942/0 (socket says 172.21.15.5:39942) 2024-08-31T05:37:11.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.475+0000 7fca01353640 1 -- 172.21.15.5:0/2629499742 learned_addr learned my addr 172.21.15.5:0/2629499742 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:11.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.475+0000 7fca01353640 1 --2- 172.21.15.5:0/2629499742 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5648ca280070 0x5648ca641180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:11.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.475+0000 7fc9fbfff640 1 --2- 172.21.15.5:0/2629499742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648ca25f390 0x5648ca6353f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:11.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.476+0000 7fca01353640 1 -- 172.21.15.5:0/2629499742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648ca25f390 msgr2=0x5648ca6353f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:11.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.476+0000 7fca01353640 1 --2- 172.21.15.5:0/2629499742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648ca25f390 0x5648ca6353f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:11.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.476+0000 7fca01353640 1 -- 172.21.15.5:0/2629499742 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5648ca280070 msgr2=0x5648ca641180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:11.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.476+0000 7fca01353640 1 --2- 172.21.15.5:0/2629499742 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5648ca280070 0x5648ca641180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:11.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.476+0000 7fca01353640 1 -- 172.21.15.5:0/2629499742 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648ca54b900 con 0x5648ca2571b0 2024-08-31T05:37:11.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.476+0000 7fca01353640 1 --2- 172.21.15.5:0/2629499742 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648ca2571b0 0x5648ca634eb0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc9f40115a0 tx=0x7fc9f4004490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c5fe830478b54df server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:11.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.476+0000 7fc9dbfff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:37:11.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.476+0000 7fc9dbfff640 1 -- 172.21.15.5:0/2629499742 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f402d060 con 0x5648ca2571b0 2024-08-31T05:37:11.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.476+0000 7fc9dbfff640 1 -- 172.21.15.5:0/2629499742 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9599+0+0 (secure 0 0 0) 0x7fc9f4011260 con 0x5648ca2571b0 2024-08-31T05:37:11.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.476+0000 7fca0932b740 1 -- 172.21.15.5:0/2629499742 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9f4003dd0 con 0x5648ca2571b0 2024-08-31T05:37:11.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.476+0000 7fc9dbfff640 1 -- 172.21.15.5:0/2629499742 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc9f4034050 con 0x5648ca2571b0 2024-08-31T05:37:11.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.476+0000 7fca0932b740 10 client.27115 fetch_fsmap learned FSMap version 34 2024-08-31T05:37:11.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.476+0000 7fca0932b740 1 -- 172.21.15.5:0/2629499742 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5648ca643c20 con 0x5648ca2571b0 2024-08-31T05:37:11.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.477+0000 7fc9dbfff640 1 -- 172.21.15.5:0/2629499742 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9f4003dd0 con 0x5648ca2571b0 2024-08-31T05:37:11.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.477+0000 7fc9dbfff640 1 -- 172.21.15.5:0/2629499742 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fc9f4018070 con 0x5648ca2571b0 2024-08-31T05:37:11.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.477+0000 7fca0932b740 10 client.27115 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:37:11.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.477+0000 7fca0932b740 10 client.27115 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:37:11.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.477+0000 7fca0932b740 20 client.27115 populate_metadata read hostname 'smithi005' 2024-08-31T05:37:11.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.477+0000 7fca0932b740 1 --2- 172.21.15.5:0/2629499742 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5648ca23e9f0 0x5648ca647090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:11.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.477+0000 7fca0932b740 4 client.27115 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:37:11.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.477+0000 7fca0932b740 1 -- 172.21.15.5:0/2629499742 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5648ca59e5d0 con 0x5648ca23e9f0 2024-08-31T05:37:11.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.477+0000 7fc9fbfff640 1 --2- 172.21.15.5:0/2629499742 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5648ca23e9f0 0x5648ca647090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:11.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.478+0000 7fc9dbfff640 10 client.27115 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:37:11.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.478+0000 7fc9fbfff640 1 --2- 172.21.15.5:0/2629499742 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5648ca23e9f0 0x5648ca647090 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c725afefda0929b server_cookie=9e5d6da4961f8eaf in_seq=0 out_seq=0 2024-08-31T05:37:11.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.479+0000 7fc9dbfff640 1 -- 172.21.15.5:0/2629499742 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5648ca59e5d0 con 0x5648ca23e9f0 2024-08-31T05:37:11.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.479+0000 7fc9dbfff640 10 client.27115 handle_command_reply: tid=0 2024-08-31T05:37:11.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.479+0000 7fca0932b740 1 client.27115 shutdown 2024-08-31T05:37:11.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.479+0000 7fca0932b740 1 -- 172.21.15.5:0/2629499742 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648ca2571b0 msgr2=0x5648ca634eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:11.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.479+0000 7fca0932b740 1 --2- 172.21.15.5:0/2629499742 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648ca2571b0 0x5648ca634eb0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc9f40115a0 tx=0x7fc9f4004490 comp rx=0 tx=0).stop 2024-08-31T05:37:11.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.479+0000 7fca0932b740 1 -- 172.21.15.5:0/2629499742 shutdown_connections 2024-08-31T05:37:11.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.479+0000 7fca0932b740 1 --2- 172.21.15.5:0/2629499742 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5648ca23e9f0 0x5648ca647090 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:11.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.479+0000 7fca0932b740 1 --2- 172.21.15.5:0/2629499742 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5648ca280070 0x5648ca641180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:11.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.479+0000 7fca0932b740 1 --2- 172.21.15.5:0/2629499742 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648ca25f390 0x5648ca6353f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:11.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.479+0000 7fca0932b740 1 --2- 172.21.15.5:0/2629499742 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648ca2571b0 0x5648ca634eb0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:11.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.479+0000 7fc9dbfff640 0 client.27115 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:37:11.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.479+0000 7fca0932b740 1 -- 172.21.15.5:0/2629499742 >> 172.21.15.5:0/2629499742 conn(0x5648ca274460 msgr2=0x5648ca626d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:11.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.479+0000 7fca0932b740 1 -- 172.21.15.5:0/2629499742 shutdown_connections 2024-08-31T05:37:11.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.479+0000 7fca0932b740 1 -- 172.21.15.5:0/2629499742 wait complete. 2024-08-31T05:37:11.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.479+0000 7fca0932b740 20 client.27115 trim_cache size 0 max 16384 2024-08-31T05:37:11.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.494+0000 7fca0932b740 1 Processor -- start 2024-08-31T05:37:11.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.495+0000 7fca0932b740 1 -- start start 2024-08-31T05:37:11.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.495+0000 7fca0932b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648ca2571b0 0x5648ca641080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:11.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.495+0000 7fca0932b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648ca25f390 0x5648ca633730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:11.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.495+0000 7fca0932b740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5648ca280070 0x5648ca633c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:11.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.495+0000 7fca0932b740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc9fc1aed10 con 0x5648ca280070 2024-08-31T05:37:11.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.495+0000 7fca0932b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc9fc1b0850 con 0x5648ca2571b0 2024-08-31T05:37:11.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.495+0000 7fca0932b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc9fc1af3e0 con 0x5648ca25f390 2024-08-31T05:37:11.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.495+0000 7fc9fbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648ca25f390 0x5648ca633730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:11.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.495+0000 7fca01353640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5648ca280070 0x5648ca633c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:11.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.495+0000 7fca01353640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5648ca280070 0x5648ca633c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56208/0 (socket says 172.21.15.5:56208) 2024-08-31T05:37:11.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.495+0000 7fc9fbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648ca25f390 0x5648ca633730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:39946/0 (socket says 172.21.15.5:39946) 2024-08-31T05:37:11.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.495+0000 7fca01353640 1 -- 172.21.15.5:0/926825849 learned_addr learned my addr 172.21.15.5:0/926825849 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:11.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.495+0000 7fca01353640 1 --2- 172.21.15.5:0/926825849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648ca2571b0 0x5648ca641080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:11.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.495+0000 7fca01353640 1 -- 172.21.15.5:0/926825849 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648ca25f390 msgr2=0x5648ca633730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:11.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.495+0000 7fca01353640 1 --2- 172.21.15.5:0/926825849 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648ca25f390 0x5648ca633730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:11.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.495+0000 7fca01353640 1 -- 172.21.15.5:0/926825849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648ca2571b0 msgr2=0x5648ca641080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:11.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.495+0000 7fca01353640 1 --2- 172.21.15.5:0/926825849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648ca2571b0 0x5648ca641080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:11.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.495+0000 7fca01353640 1 -- 172.21.15.5:0/926825849 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648ca6357e0 con 0x5648ca280070 2024-08-31T05:37:11.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.496+0000 7fca01353640 1 --2- 172.21.15.5:0/926825849 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5648ca280070 0x5648ca633c70 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fc9f400fb10 tx=0x7fc9f4011c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d13df78731a97fe server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:11.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.496+0000 7fc9e67fc640 1 -- 172.21.15.5:0/926825849 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f402d070 con 0x5648ca280070 2024-08-31T05:37:11.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.496+0000 7fc9e67fc640 1 -- 172.21.15.5:0/926825849 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9f4004530 con 0x5648ca280070 2024-08-31T05:37:11.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.496+0000 7fc9e67fc640 1 -- 172.21.15.5:0/926825849 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f4005270 con 0x5648ca280070 2024-08-31T05:37:11.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.497+0000 7fca0932b740 1 -- 172.21.15.5:0/926825849 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5648ca280070 msgr2=0x5648ca633c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:11.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.497+0000 7fca0932b740 1 --2- 172.21.15.5:0/926825849 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5648ca280070 0x5648ca633c70 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fc9f400fb10 tx=0x7fc9f4011c50 comp rx=0 tx=0).stop 2024-08-31T05:37:11.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.497+0000 7fca0932b740 1 -- 172.21.15.5:0/926825849 shutdown_connections 2024-08-31T05:37:11.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.497+0000 7fca0932b740 1 --2- 172.21.15.5:0/926825849 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5648ca280070 0x5648ca633c70 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:11.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.497+0000 7fca0932b740 1 --2- 172.21.15.5:0/926825849 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648ca25f390 0x5648ca633730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:11.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.497+0000 7fca0932b740 1 --2- 172.21.15.5:0/926825849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648ca2571b0 0x5648ca641080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:11.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.497+0000 7fca0932b740 1 -- 172.21.15.5:0/926825849 >> 172.21.15.5:0/926825849 conn(0x5648ca274460 msgr2=0x5648ca62fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:11.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.497+0000 7fca0932b740 1 -- 172.21.15.5:0/926825849 shutdown_connections 2024-08-31T05:37:11.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.497+0000 7fca0932b740 1 -- 172.21.15.5:0/926825849 wait complete. 2024-08-31T05:37:11.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.498+0000 7fca0932b740 1 -- start start 2024-08-31T05:37:11.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.498+0000 7fca0932b740 1 Processor -- start 2024-08-31T05:37:11.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.498+0000 7fca0932b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648ca2571b0 0x5648ca639130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:11.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.498+0000 7fca0932b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648ca25f390 0x5648ca639670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:11.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.498+0000 7fca0932b740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5648ca280070 0x5648ca639bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:11.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.498+0000 7fca0932b740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc9fc1b0180 con 0x5648ca280070 2024-08-31T05:37:11.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.498+0000 7fca0932b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc9fc1afab0 con 0x5648ca2571b0 2024-08-31T05:37:11.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.498+0000 7fca0932b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc9fc1acd10 con 0x5648ca25f390 2024-08-31T05:37:11.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.498+0000 7fca0932b740 10 client.0 _ll_register_callbacks cb 0x7fc9f0109680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:37:11.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.498+0000 7fc9fbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648ca25f390 0x5648ca639670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:11.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.498+0000 7fca01353640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648ca2571b0 0x5648ca639130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:11.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.498+0000 7fc9fbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648ca25f390 0x5648ca639670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:39950/0 (socket says 172.21.15.5:39950) 2024-08-31T05:37:11.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.498+0000 7fca01353640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5648ca280070 0x5648ca639bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:11.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.498+0000 7fc9fbfff640 1 -- 172.21.15.5:0/1449931520 learned_addr learned my addr 172.21.15.5:0/1449931520 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:11.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.499+0000 7fc9fbfff640 1 -- 172.21.15.5:0/1449931520 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648ca2571b0 msgr2=0x5648ca639130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:11.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.499+0000 7fc9fbfff640 1 --2- 172.21.15.5:0/1449931520 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648ca2571b0 0x5648ca639130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:11.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.499+0000 7fc9fbfff640 1 -- 172.21.15.5:0/1449931520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5648ca280070 msgr2=0x5648ca639bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:11.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.499+0000 7fc9fbfff640 1 --2- 172.21.15.5:0/1449931520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5648ca280070 0x5648ca639bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:11.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.499+0000 7fc9fbfff640 1 -- 172.21.15.5:0/1449931520 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648ca6b08e0 con 0x5648ca25f390 2024-08-31T05:37:11.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.499+0000 7fc9fbfff640 1 --2- 172.21.15.5:0/1449931520 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648ca25f390 0x5648ca639670 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc06aad0 tx=0x7fc9e80039c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d549abb75a2df4d0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:11.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.499+0000 7fc9dbfff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:37:11.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.499+0000 7fc9dbfff640 1 -- 172.21.15.5:0/1449931520 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e8029060 con 0x5648ca25f390 2024-08-31T05:37:11.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.499+0000 7fc9dbfff640 1 -- 172.21.15.5:0/1449931520 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9599+0+0 (secure 0 0 0) 0x7fc9e8010630 con 0x5648ca25f390 2024-08-31T05:37:11.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.499+0000 7fca0932b740 1 -- 172.21.15.5:0/1449931520 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9f4004530 con 0x5648ca25f390 2024-08-31T05:37:11.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.500+0000 7fc9dbfff640 1 -- 172.21.15.5:0/1449931520 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc9e8005020 con 0x5648ca25f390 2024-08-31T05:37:11.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.500+0000 7fca0932b740 10 client.27121 fetch_fsmap learned FSMap version 34 2024-08-31T05:37:11.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.500+0000 7fca0932b740 1 -- 172.21.15.5:0/1449931520 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5648ca6b1bc0 con 0x5648ca25f390 2024-08-31T05:37:11.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.500+0000 7fc9dbfff640 1 -- 172.21.15.5:0/1449931520 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9f4004530 con 0x5648ca25f390 2024-08-31T05:37:11.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.500+0000 7fc9dbfff640 1 -- 172.21.15.5:0/1449931520 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fc9e8023030 con 0x5648ca25f390 2024-08-31T05:37:11.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.500+0000 7fca0932b740 10 client.27121 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:37:11.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.500+0000 7fca0932b740 10 client.27121 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:37:11.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.500+0000 7fca0932b740 20 client.27121 populate_metadata read hostname 'smithi005' 2024-08-31T05:37:11.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.500+0000 7fca0932b740 1 --2- 172.21.15.5:0/1449931520 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5648ca213da0 0x5648ca6b4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:11.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.500+0000 7fca0932b740 4 client.27121 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:37:11.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.500+0000 7fca0932b740 1 -- 172.21.15.5:0/1449931520 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5648ca59a070 con 0x5648ca213da0 2024-08-31T05:37:11.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.501+0000 7fca01353640 1 --2- 172.21.15.5:0/1449931520 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5648ca213da0 0x5648ca6b4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:11.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.501+0000 7fca01353640 1 --2- 172.21.15.5:0/1449931520 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5648ca213da0 0x5648ca6b4360 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cede44df8981abca server_cookie=dfbfb7ffc8982ff in_seq=0 out_seq=0 2024-08-31T05:37:11.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.501+0000 7fc9dbfff640 10 client.27121 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:37:11.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.501+0000 7fc9dbfff640 1 -- 172.21.15.5:0/1449931520 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5648ca59a070 con 0x5648ca213da0 2024-08-31T05:37:11.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.501+0000 7fc9dbfff640 10 client.27121 handle_command_reply: tid=0 2024-08-31T05:37:11.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.501+0000 7fca0932b740 1 client.27121 shutdown 2024-08-31T05:37:11.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.501+0000 7fca0932b740 1 -- 172.21.15.5:0/1449931520 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648ca25f390 msgr2=0x5648ca639670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:11.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.501+0000 7fca0932b740 1 --2- 172.21.15.5:0/1449931520 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648ca25f390 0x5648ca639670 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc06aad0 tx=0x7fc9e80039c0 comp rx=0 tx=0).stop 2024-08-31T05:37:11.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.501+0000 7fca0932b740 1 -- 172.21.15.5:0/1449931520 shutdown_connections 2024-08-31T05:37:11.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.501+0000 7fca0932b740 1 --2- 172.21.15.5:0/1449931520 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5648ca213da0 0x5648ca6b4360 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:11.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.501+0000 7fca0932b740 1 --2- 172.21.15.5:0/1449931520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5648ca280070 0x5648ca639bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:11.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.501+0000 7fca0932b740 1 --2- 172.21.15.5:0/1449931520 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648ca25f390 0x5648ca639670 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:11.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.501+0000 7fca0932b740 1 --2- 172.21.15.5:0/1449931520 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648ca2571b0 0x5648ca639130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:11.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.501+0000 7fc9dbfff640 0 client.27121 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:37:11.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.501+0000 7fca0932b740 1 -- 172.21.15.5:0/1449931520 >> 172.21.15.5:0/1449931520 conn(0x5648ca274460 msgr2=0x5648ca633660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:11.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.502+0000 7fca0932b740 1 -- 172.21.15.5:0/1449931520 shutdown_connections 2024-08-31T05:37:11.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.502+0000 7fca0932b740 1 -- 172.21.15.5:0/1449931520 wait complete. 2024-08-31T05:37:11.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.502+0000 7fca0932b740 20 client.27121 trim_cache size 0 max 16384 2024-08-31T05:37:11.509 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:37:11.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.502+0000 7fca02db6640 1 -- 172.21.15.5:0/328331944 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc9ec0b4ca0 msgr2=0x7fc9ec0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:11.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.502+0000 7fca02db6640 1 --2- 172.21.15.5:0/328331944 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc9ec0b4ca0 0x7fc9ec0b71b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0103030 tx=0x7fc9f01097b0 comp rx=0 tx=0).stop 2024-08-31T05:37:11.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.502+0000 7fca02db6640 1 -- 172.21.15.5:0/328331944 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9fc104750 msgr2=0x7fc9fc19a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:11.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.502+0000 7fca02db6640 1 --2- 172.21.15.5:0/328331944 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9fc104750 0x7fc9fc19a360 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0032fd0 tx=0x7fc9f0031a20 comp rx=0 tx=0).stop 2024-08-31T05:37:11.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.503+0000 7fca02db6640 1 -- 172.21.15.5:0/328331944 shutdown_connections 2024-08-31T05:37:11.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.503+0000 7fca02db6640 1 --2- 172.21.15.5:0/328331944 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc9ec0b4ca0 0x7fc9ec0b71b0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:11.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.503+0000 7fca02db6640 1 --2- 172.21.15.5:0/328331944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc9fc10dbb0 0x7fc9fc19fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:11.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.503+0000 7fca02db6640 1 --2- 172.21.15.5:0/328331944 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc9fc1050a0 0x7fc9fc19a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:11.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.503+0000 7fca02db6640 1 --2- 172.21.15.5:0/328331944 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9fc104750 0x7fc9fc19a360 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:11.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.503+0000 7fca02db6640 1 -- 172.21.15.5:0/328331944 >> 172.21.15.5:0/328331944 conn(0x7fc9fc0794d0 msgr2=0x7fc9fc0ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:11.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.503+0000 7fca02db6640 1 -- 172.21.15.5:0/328331944 shutdown_connections 2024-08-31T05:37:11.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:11.503+0000 7fca02db6640 1 -- 172.21.15.5:0/328331944 wait complete. 2024-08-31T05:37:11.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:37:11 smithi070 ceph-mon[22316]: pgmap v562: 129 pgs: 129 active+clean; 446 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.8 MiB/s wr, 272 op/s 2024-08-31T05:37:11.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:37:11 smithi050 ceph-mon[22146]: pgmap v562: 129 pgs: 129 active+clean; 446 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.8 MiB/s wr, 272 op/s 2024-08-31T05:37:11.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:37:11 smithi005 ceph-mon[18602]: pgmap v562: 129 pgs: 129 active+clean; 446 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.8 MiB/s wr, 272 op/s 2024-08-31T05:37:11.926 INFO:tasks.workunit.client.0.smithi005.stdout: 1 810038 11.51 MB/sec execute 239 sec latency 23.755 ms 2024-08-31T05:37:12.926 INFO:tasks.workunit.client.0.smithi005.stdout: 1 811417 11.48 MB/sec execute 240 sec latency 73.833 ms 2024-08-31T05:37:13.188 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T05:37:13.188 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T05:37:13.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:37:13 smithi005 ceph-mon[18602]: pgmap v563: 129 pgs: 129 active+clean; 446 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.7 MiB/s wr, 261 op/s 2024-08-31T05:37:13.472 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:37:13.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:37:13 smithi070 ceph-mon[22316]: pgmap v563: 129 pgs: 129 active+clean; 446 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.7 MiB/s wr, 261 op/s 2024-08-31T05:37:13.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:37:13 smithi050 ceph-mon[22146]: pgmap v563: 129 pgs: 129 active+clean; 446 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.7 MiB/s wr, 261 op/s 2024-08-31T05:37:13.926 INFO:tasks.workunit.client.0.smithi005.stdout: 1 813529 11.49 MB/sec execute 241 sec latency 32.396 ms 2024-08-31T05:37:13.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.981+0000 7f66c536d640 1 -- 172.21.15.5:0/2288488674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66c0102840 msgr2=0x7f66c0102c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:13.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.981+0000 7f66c536d640 1 --2- 172.21.15.5:0/2288488674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66c0102840 0x7f66c0102c50 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f66b0009ca0 tx=0x7f66b002a8c0 comp rx=0 tx=0).stop 2024-08-31T05:37:13.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.981+0000 7f66c536d640 1 -- 172.21.15.5:0/2288488674 shutdown_connections 2024-08-31T05:37:13.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.981+0000 7f66c536d640 1 --2- 172.21.15.5:0/2288488674 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66c0108ad0 0x7f66c010f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:13.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.981+0000 7f66c536d640 1 --2- 172.21.15.5:0/2288488674 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66c0108180 0x7f66c0108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:13.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.981+0000 7f66c536d640 1 --2- 172.21.15.5:0/2288488674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66c0102840 0x7f66c0102c50 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:13.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.981+0000 7f66c536d640 1 -- 172.21.15.5:0/2288488674 >> 172.21.15.5:0/2288488674 conn(0x7f66c0079580 msgr2=0x7f66c0079990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:13.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.981+0000 7f66c536d640 1 -- 172.21.15.5:0/2288488674 shutdown_connections 2024-08-31T05:37:13.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.981+0000 7f66c536d640 1 -- 172.21.15.5:0/2288488674 wait complete. 2024-08-31T05:37:13.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.982+0000 7f66c536d640 1 Processor -- start 2024-08-31T05:37:13.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.982+0000 7f66c536d640 1 -- start start 2024-08-31T05:37:13.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.982+0000 7f66c536d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66c0102840 0x7f66c019b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:13.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.982+0000 7f66c536d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66c0108180 0x7f66c019b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:13.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.982+0000 7f66c536d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66c0108ad0 0x7f66c019baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:13.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.982+0000 7f66c536d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f66c0112750 con 0x7f66c0108ad0 2024-08-31T05:37:13.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.982+0000 7f66c536d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f66c01125d0 con 0x7f66c0108180 2024-08-31T05:37:13.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.982+0000 7f66c536d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f66c01128d0 con 0x7f66c0102840 2024-08-31T05:37:13.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.982+0000 7f66bf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66c0108ad0 0x7f66c019baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:13.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.982+0000 7f66beffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66c0102840 0x7f66c019b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:13.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.982+0000 7f66beffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66c0102840 0x7f66c019b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:40724/0 (socket says 172.21.15.5:40724) 2024-08-31T05:37:13.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.982+0000 7f66beffd640 1 -- 172.21.15.5:0/1172087590 learned_addr learned my addr 172.21.15.5:0/1172087590 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:13.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.982+0000 7f66bf7fe640 1 --2- 172.21.15.5:0/1172087590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66c0108ad0 0x7f66c019baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37900/0 (socket says 172.21.15.5:37900) 2024-08-31T05:37:13.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.982+0000 7f66be7fc640 1 --2- 172.21.15.5:0/1172087590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66c0108180 0x7f66c019b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:13.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.983+0000 7f66beffd640 1 -- 172.21.15.5:0/1172087590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66c0108180 msgr2=0x7f66c019b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:13.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.983+0000 7f66beffd640 1 --2- 172.21.15.5:0/1172087590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66c0108180 0x7f66c019b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:13.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.983+0000 7f66beffd640 1 -- 172.21.15.5:0/1172087590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66c0108ad0 msgr2=0x7f66c019baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:13.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.983+0000 7f66beffd640 1 --2- 172.21.15.5:0/1172087590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66c0108ad0 0x7f66c019baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:13.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.983+0000 7f66beffd640 1 -- 172.21.15.5:0/1172087590 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66c01a6330 con 0x7f66c0102840 2024-08-31T05:37:13.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.983+0000 7f66beffd640 1 --2- 172.21.15.5:0/1172087590 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66c0102840 0x7f66c019b020 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f66b002ade0 tx=0x7f66b0031770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:13.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.983+0000 7f66b7fff640 1 -- 172.21.15.5:0/1172087590 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b0003b70 con 0x7f66c0102840 2024-08-31T05:37:13.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.983+0000 7f66c536d640 1 -- 172.21.15.5:0/1172087590 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66c01a65c0 con 0x7f66c0102840 2024-08-31T05:37:13.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.983+0000 7f66b7fff640 1 -- 172.21.15.5:0/1172087590 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66b0003d10 con 0x7f66c0102840 2024-08-31T05:37:13.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.983+0000 7f66b7fff640 1 -- 172.21.15.5:0/1172087590 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b002fa50 con 0x7f66c0102840 2024-08-31T05:37:13.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.983+0000 7f66c536d640 1 -- 172.21.15.5:0/1172087590 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66c01a6b50 con 0x7f66c0102840 2024-08-31T05:37:13.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.986+0000 7f66cb8e2740 1 Processor -- start 2024-08-31T05:37:13.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.986+0000 7f66cb8e2740 1 -- start start 2024-08-31T05:37:13.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.987+0000 7f66cb8e2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b3cfd3350 0x559b3d379780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:13.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.987+0000 7f66cb8e2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b3cfaa490 0x559b3d379cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:13.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.987+0000 7f66cb8e2740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559b3cfb2670 0x559b3d37a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:13.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.987+0000 7f66cb8e2740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x559b3d2ef5f0 con 0x559b3cfb2670 2024-08-31T05:37:13.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.987+0000 7f66cb8e2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559b3d2deb80 con 0x559b3cfd3350 2024-08-31T05:37:13.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.987+0000 7f66cb8e2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559b3d2e2b30 con 0x559b3cfaa490 2024-08-31T05:37:13.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.987+0000 7f66bf7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b3cfd3350 0x559b3d379780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:13.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.987+0000 7f66bf7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b3cfd3350 0x559b3d379780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:47286/0 (socket says 172.21.15.5:47286) 2024-08-31T05:37:13.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.987+0000 7f66bf7fe640 1 -- 172.21.15.5:0/2878380229 learned_addr learned my addr 172.21.15.5:0/2878380229 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:13.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.987+0000 7f66be7fc640 1 --2- 172.21.15.5:0/2878380229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559b3cfb2670 0x559b3d37a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:13.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.987+0000 7f66b7fff640 1 -- 172.21.15.5:0/1172087590 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f66b002fc30 con 0x7f66c0102840 2024-08-31T05:37:13.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.988+0000 7f66bf7fe640 1 -- 172.21.15.5:0/2878380229 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b3cfaa490 msgr2=0x559b3d379cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:13.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.988+0000 7f66bf7fe640 1 --2- 172.21.15.5:0/2878380229 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b3cfaa490 0x559b3d379cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:13.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.988+0000 7f66bf7fe640 1 -- 172.21.15.5:0/2878380229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559b3cfb2670 msgr2=0x559b3d37a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:13.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.988+0000 7f66bf7fe640 1 --2- 172.21.15.5:0/2878380229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559b3cfb2670 0x559b3d37a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:13.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.988+0000 7f66bf7fe640 1 -- 172.21.15.5:0/2878380229 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b3d03e930 con 0x559b3cfd3350 2024-08-31T05:37:13.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.988+0000 7f66bf7fe640 1 --2- 172.21.15.5:0/2878380229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b3cfd3350 0x559b3d379780 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f66b800b680 tx=0x7f66b800bb40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0a6980c4ff91b81 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:13.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.988+0000 7f66b57fa640 1 -- 172.21.15.5:0/2878380229 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b8003bd0 con 0x559b3cfd3350 2024-08-31T05:37:13.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.988+0000 7f66b57fa640 1 -- 172.21.15.5:0/2878380229 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66b8015070 con 0x559b3cfd3350 2024-08-31T05:37:13.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.988+0000 7f66b57fa640 1 -- 172.21.15.5:0/2878380229 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b80106a0 con 0x559b3cfd3350 2024-08-31T05:37:13.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.988+0000 7f66b7fff640 1 --2- 172.21.15.5:0/1172087590 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f66ac0b4ca0 0x7f66ac0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:13.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.988+0000 7f66beffd640 1 --2- 172.21.15.5:0/1172087590 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f66ac0b4ca0 0x7f66ac0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:13.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.989+0000 7f66b7fff640 1 -- 172.21.15.5:0/1172087590 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9599+0+0 (secure 0 0 0) 0x7f66b0106cd0 con 0x7f66c0102840 2024-08-31T05:37:13.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.989+0000 7f66cb8e2740 1 -- 172.21.15.5:0/2878380229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b3cfd3350 msgr2=0x559b3d379780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:13.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.989+0000 7f66cb8e2740 1 --2- 172.21.15.5:0/2878380229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b3cfd3350 0x559b3d379780 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f66b800b680 tx=0x7f66b800bb40 comp rx=0 tx=0).stop 2024-08-31T05:37:13.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.989+0000 7f66beffd640 1 --2- 172.21.15.5:0/1172087590 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f66ac0b4ca0 0x7f66ac0b71b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x559b3d378400 tx=0x7f66b0004920 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:13.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.989+0000 7f66cb8e2740 1 -- 172.21.15.5:0/2878380229 shutdown_connections 2024-08-31T05:37:13.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.989+0000 7f66cb8e2740 1 --2- 172.21.15.5:0/2878380229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559b3cfb2670 0x559b3d37a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:13.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.989+0000 7f66cb8e2740 1 --2- 172.21.15.5:0/2878380229 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b3cfaa490 0x559b3d379cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:13.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.989+0000 7f66cb8e2740 1 --2- 172.21.15.5:0/2878380229 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b3cfd3350 0x559b3d379780 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:13.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.989+0000 7f66cb8e2740 1 -- 172.21.15.5:0/2878380229 >> 172.21.15.5:0/2878380229 conn(0x559b3cfc7740 msgr2=0x559b3d377670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:13.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.989+0000 7f66cb8e2740 1 -- 172.21.15.5:0/2878380229 shutdown_connections 2024-08-31T05:37:13.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.989+0000 7f66cb8e2740 1 -- 172.21.15.5:0/2878380229 wait complete. 2024-08-31T05:37:13.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.990+0000 7f66cb8e2740 1 -- start start 2024-08-31T05:37:13.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.990+0000 7f66cb8e2740 1 Processor -- start 2024-08-31T05:37:14.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.990+0000 7f66cb8e2740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559b3cfaa490 0x559b3d384f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:14.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.990+0000 7f66cb8e2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b3cfb2670 0x559b3d3854c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:14.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.990+0000 7f66cb8e2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b3cfd3350 0x559b3d391250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:14.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.990+0000 7f66cb8e2740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x559b3d141890 con 0x559b3cfaa490 2024-08-31T05:37:14.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.990+0000 7f66cb8e2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559b3d265790 con 0x559b3cfb2670 2024-08-31T05:37:14.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.990+0000 7f66cb8e2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559b3d387f60 con 0x559b3cfd3350 2024-08-31T05:37:14.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.990+0000 7f66cb8e2740 10 client.0 _ll_register_callbacks cb 0x559b3cfeaba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:37:14.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.990+0000 7f66be7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b3cfb2670 0x559b3d3854c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:14.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.990+0000 7f66bf7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b3cfd3350 0x559b3d391250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:14.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.990+0000 7f66bf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559b3cfaa490 0x559b3d384f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:14.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.990+0000 7f66be7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b3cfb2670 0x559b3d3854c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:47290/0 (socket says 172.21.15.5:47290) 2024-08-31T05:37:14.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.990+0000 7f66be7fc640 1 -- 172.21.15.5:0/2767066933 learned_addr learned my addr 172.21.15.5:0/2767066933 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:14.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.991+0000 7f66bf7fe640 1 -- 172.21.15.5:0/2767066933 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b3cfd3350 msgr2=0x559b3d391250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:14.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.991+0000 7f66bf7fe640 1 --2- 172.21.15.5:0/2767066933 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b3cfd3350 0x559b3d391250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:14.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.991+0000 7f66bf7fe640 1 -- 172.21.15.5:0/2767066933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b3cfb2670 msgr2=0x559b3d3854c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:14.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.991+0000 7f66bf7fe640 1 --2- 172.21.15.5:0/2767066933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b3cfb2670 0x559b3d3854c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:14.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.991+0000 7f66bf7fe640 1 -- 172.21.15.5:0/2767066933 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b3d29cf30 con 0x559b3cfaa490 2024-08-31T05:37:14.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.991+0000 7f66be7fc640 1 --2- 172.21.15.5:0/2767066933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b3cfb2670 0x559b3d3854c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:37:14.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.991+0000 7f66bf7fe640 1 --2- 172.21.15.5:0/2767066933 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559b3cfaa490 0x559b3d384f60 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f66b800b680 tx=0x7f66b8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec2ddf74be9ef992 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:14.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.991+0000 7f66a67fc640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:37:14.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.991+0000 7f66a67fc640 1 -- 172.21.15.5:0/2767066933 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b8023040 con 0x559b3cfaa490 2024-08-31T05:37:14.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.991+0000 7f66cb8e2740 1 -- 172.21.15.5:0/2767066933 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66b8015070 con 0x559b3cfaa490 2024-08-31T05:37:14.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.991+0000 7f66a67fc640 1 -- 172.21.15.5:0/2767066933 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9599+0+0 (secure 0 0 0) 0x7f66b8011640 con 0x559b3cfaa490 2024-08-31T05:37:14.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.991+0000 7f66a67fc640 1 -- 172.21.15.5:0/2767066933 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f66b8003e50 con 0x559b3cfaa490 2024-08-31T05:37:14.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.991+0000 7f66cb8e2740 10 client.17541 fetch_fsmap learned FSMap version 34 2024-08-31T05:37:14.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.991+0000 7f66cb8e2740 1 -- 172.21.15.5:0/2767066933 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x559b3d393da0 con 0x559b3cfaa490 2024-08-31T05:37:14.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.991+0000 7f66a67fc640 1 -- 172.21.15.5:0/2767066933 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66b8015070 con 0x559b3cfaa490 2024-08-31T05:37:14.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.992+0000 7f66a67fc640 1 -- 172.21.15.5:0/2767066933 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f66b802a430 con 0x559b3cfaa490 2024-08-31T05:37:14.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.992+0000 7f66cb8e2740 10 client.17541 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:37:14.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.992+0000 7f66cb8e2740 10 client.17541 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:37:14.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.992+0000 7f66cb8e2740 20 client.17541 populate_metadata read hostname 'smithi005' 2024-08-31T05:37:14.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.992+0000 7f66cb8e2740 1 --2- 172.21.15.5:0/2767066933 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x559b3cf91cd0 0x559b3d397160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:14.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.992+0000 7f66cb8e2740 4 client.17541 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:37:14.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.992+0000 7f66cb8e2740 1 -- 172.21.15.5:0/2767066933 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559b3d2f1540 con 0x559b3cf91cd0 2024-08-31T05:37:14.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.992+0000 7f66be7fc640 1 --2- 172.21.15.5:0/2767066933 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x559b3cf91cd0 0x559b3d397160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:14.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.992+0000 7f66a67fc640 10 client.17541 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:37:14.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.992+0000 7f66be7fc640 1 --2- 172.21.15.5:0/2767066933 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x559b3cf91cd0 0x559b3d397160 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ce5d44bb6140a54 server_cookie=2aff13af74cf2ea2 in_seq=0 out_seq=0 2024-08-31T05:37:14.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.993+0000 7f66a67fc640 1 -- 172.21.15.5:0/2767066933 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559b3d2f1540 con 0x559b3cf91cd0 2024-08-31T05:37:14.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.993+0000 7f66a67fc640 10 client.17541 handle_command_reply: tid=0 2024-08-31T05:37:14.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.993+0000 7f66cb8e2740 1 client.17541 shutdown 2024-08-31T05:37:14.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.993+0000 7f66cb8e2740 1 -- 172.21.15.5:0/2767066933 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559b3cfaa490 msgr2=0x559b3d384f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:14.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.993+0000 7f66cb8e2740 1 --2- 172.21.15.5:0/2767066933 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559b3cfaa490 0x559b3d384f60 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f66b800b680 tx=0x7f66b8000bc0 comp rx=0 tx=0).stop 2024-08-31T05:37:14.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.993+0000 7f66cb8e2740 1 -- 172.21.15.5:0/2767066933 shutdown_connections 2024-08-31T05:37:14.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.993+0000 7f66cb8e2740 1 --2- 172.21.15.5:0/2767066933 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x559b3cf91cd0 0x559b3d397160 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:14.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.993+0000 7f66cb8e2740 1 --2- 172.21.15.5:0/2767066933 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b3cfd3350 0x559b3d391250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:14.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.993+0000 7f66a67fc640 0 client.17541 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:37:14.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.993+0000 7f66cb8e2740 1 --2- 172.21.15.5:0/2767066933 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b3cfb2670 0x559b3d3854c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:14.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.993+0000 7f66cb8e2740 1 --2- 172.21.15.5:0/2767066933 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559b3cfaa490 0x559b3d384f60 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:14.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.993+0000 7f66cb8e2740 1 -- 172.21.15.5:0/2767066933 >> 172.21.15.5:0/2767066933 conn(0x559b3cfc7740 msgr2=0x559b3d37c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:14.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.993+0000 7f66cb8e2740 1 -- 172.21.15.5:0/2767066933 shutdown_connections 2024-08-31T05:37:14.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.994+0000 7f66cb8e2740 1 -- 172.21.15.5:0/2767066933 wait complete. 2024-08-31T05:37:14.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:13.994+0000 7f66cb8e2740 20 client.17541 trim_cache size 0 max 16384 2024-08-31T05:37:14.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.013+0000 7f66cb8e2740 1 Processor -- start 2024-08-31T05:37:14.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.013+0000 7f66cb8e2740 1 -- start start 2024-08-31T05:37:14.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.014+0000 7f66cb8e2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b3cf91cd0 0x559b3d386b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:14.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.014+0000 7f66cb8e2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b3cfaa490 0x559b3d391150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:14.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.014+0000 7f66cb8e2740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559b3cfb2670 0x559b3d391690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:14.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.014+0000 7f66cb8e2740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f66c01b0ee0 con 0x559b3cfb2670 2024-08-31T05:37:14.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.014+0000 7f66cb8e2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f66c01b2a20 con 0x559b3cf91cd0 2024-08-31T05:37:14.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.014+0000 7f66cb8e2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f66c01b15b0 con 0x559b3cfaa490 2024-08-31T05:37:14.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.014+0000 7f66bf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559b3cfb2670 0x559b3d391690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:14.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.014+0000 7f66bf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559b3cfb2670 0x559b3d391690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37920/0 (socket says 172.21.15.5:37920) 2024-08-31T05:37:14.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.014+0000 7f66bf7fe640 1 -- 172.21.15.5:0/1650414918 learned_addr learned my addr 172.21.15.5:0/1650414918 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:14.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.014+0000 7f66be7fc640 1 --2- 172.21.15.5:0/1650414918 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b3cfaa490 0x559b3d391150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:14.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.014+0000 7f66bf7fe640 1 --2- 172.21.15.5:0/1650414918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b3cf91cd0 0x559b3d386b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:14.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.014+0000 7f66be7fc640 1 -- 172.21.15.5:0/1650414918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b3cf91cd0 msgr2=0x559b3d386b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:14.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.014+0000 7f66be7fc640 1 --2- 172.21.15.5:0/1650414918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b3cf91cd0 0x559b3d386b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:14.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.014+0000 7f66be7fc640 1 -- 172.21.15.5:0/1650414918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559b3cfb2670 msgr2=0x559b3d391690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:14.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.014+0000 7f66be7fc640 1 --2- 172.21.15.5:0/1650414918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559b3cfb2670 0x559b3d391690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:14.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.014+0000 7f66be7fc640 1 -- 172.21.15.5:0/1650414918 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b3d37c5e0 con 0x559b3cfaa490 2024-08-31T05:37:14.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.015+0000 7f66be7fc640 1 --2- 172.21.15.5:0/1650414918 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b3cfaa490 0x559b3d391150 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x559b3d397700 tx=0x7f66a8005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e81cff13ef11e71 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:14.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.015+0000 7f66b4ff9640 1 -- 172.21.15.5:0/1650414918 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a8005220 con 0x559b3cfaa490 2024-08-31T05:37:14.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.015+0000 7f66b4ff9640 1 -- 172.21.15.5:0/1650414918 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66a8011d20 con 0x559b3cfaa490 2024-08-31T05:37:14.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.015+0000 7f66b4ff9640 1 -- 172.21.15.5:0/1650414918 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a8004d70 con 0x559b3cfaa490 2024-08-31T05:37:14.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.016+0000 7f66cb8e2740 1 -- 172.21.15.5:0/1650414918 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b3cfaa490 msgr2=0x559b3d391150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:14.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.016+0000 7f66cb8e2740 1 --2- 172.21.15.5:0/1650414918 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b3cfaa490 0x559b3d391150 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x559b3d397700 tx=0x7f66a8005f90 comp rx=0 tx=0).stop 2024-08-31T05:37:14.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.016+0000 7f66cb8e2740 1 -- 172.21.15.5:0/1650414918 shutdown_connections 2024-08-31T05:37:14.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.016+0000 7f66cb8e2740 1 --2- 172.21.15.5:0/1650414918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559b3cfb2670 0x559b3d391690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:14.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.016+0000 7f66cb8e2740 1 --2- 172.21.15.5:0/1650414918 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b3cfaa490 0x559b3d391150 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:14.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.016+0000 7f66cb8e2740 1 --2- 172.21.15.5:0/1650414918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b3cf91cd0 0x559b3d386b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:14.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.016+0000 7f66cb8e2740 1 -- 172.21.15.5:0/1650414918 >> 172.21.15.5:0/1650414918 conn(0x559b3cfc7740 msgr2=0x559b3d386480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:14.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.016+0000 7f66cb8e2740 1 -- 172.21.15.5:0/1650414918 shutdown_connections 2024-08-31T05:37:14.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.016+0000 7f66cb8e2740 1 -- 172.21.15.5:0/1650414918 wait complete. 2024-08-31T05:37:14.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.016+0000 7f66cb8e2740 1 -- start start 2024-08-31T05:37:14.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.016+0000 7f66cb8e2740 1 Processor -- start 2024-08-31T05:37:14.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.017+0000 7f66cb8e2740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559b3cf91cd0 0x559b3d389570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:14.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.017+0000 7f66cb8e2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b3cfaa490 0x559b3d389ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:14.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.017+0000 7f66cb8e2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b3cfb2670 0x559b3d400990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:14.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.017+0000 7f66cb8e2740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f66c01b2350 con 0x559b3cf91cd0 2024-08-31T05:37:14.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.017+0000 7f66cb8e2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f66c01b1c80 con 0x559b3cfb2670 2024-08-31T05:37:14.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.017+0000 7f66cb8e2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f66c01aeee0 con 0x559b3cfaa490 2024-08-31T05:37:14.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.017+0000 7f66cb8e2740 10 client.0 _ll_register_callbacks cb 0x7f66a8009590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:37:14.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.017+0000 7f66bf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559b3cf91cd0 0x559b3d389570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:14.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.017+0000 7f66bf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559b3cf91cd0 0x559b3d389570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37932/0 (socket says 172.21.15.5:37932) 2024-08-31T05:37:14.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.017+0000 7f66bf7fe640 1 -- 172.21.15.5:0/3406450634 learned_addr learned my addr 172.21.15.5:0/3406450634 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:14.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.017+0000 7f66be7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b3cfaa490 0x559b3d389ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:14.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.017+0000 7f66bf7fe640 1 --2- 172.21.15.5:0/3406450634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b3cfb2670 0x559b3d400990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:14.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.017+0000 7f66bf7fe640 1 -- 172.21.15.5:0/3406450634 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b3cfaa490 msgr2=0x559b3d389ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:14.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.017+0000 7f66bf7fe640 1 --2- 172.21.15.5:0/3406450634 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b3cfaa490 0x559b3d389ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:14.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.017+0000 7f66bf7fe640 1 -- 172.21.15.5:0/3406450634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b3cfb2670 msgr2=0x559b3d400990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:14.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.017+0000 7f66bf7fe640 1 --2- 172.21.15.5:0/3406450634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b3cfb2670 0x559b3d400990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:14.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.017+0000 7f66bf7fe640 1 -- 172.21.15.5:0/3406450634 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b3d400ed0 con 0x559b3cf91cd0 2024-08-31T05:37:14.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.017+0000 7f66bf7fe640 1 --2- 172.21.15.5:0/3406450634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559b3cf91cd0 0x559b3d389570 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f66b800c010 tx=0x7f66b801c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a608355031bd8df server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:14.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.017+0000 7f66a67fc640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:37:14.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.018+0000 7f66a67fc640 1 -- 172.21.15.5:0/3406450634 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b80039c0 con 0x559b3cf91cd0 2024-08-31T05:37:14.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.018+0000 7f66a67fc640 1 -- 172.21.15.5:0/3406450634 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9599+0+0 (secure 0 0 0) 0x7f66b8005030 con 0x559b3cf91cd0 2024-08-31T05:37:14.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.018+0000 7f66cb8e2740 1 -- 172.21.15.5:0/3406450634 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66a8011d20 con 0x559b3cf91cd0 2024-08-31T05:37:14.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.018+0000 7f66a67fc640 1 -- 172.21.15.5:0/3406450634 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f66b802a660 con 0x559b3cf91cd0 2024-08-31T05:37:14.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.018+0000 7f66cb8e2740 10 client.17547 fetch_fsmap learned FSMap version 34 2024-08-31T05:37:14.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.018+0000 7f66cb8e2740 1 -- 172.21.15.5:0/3406450634 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x559b3d402040 con 0x559b3cf91cd0 2024-08-31T05:37:14.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.018+0000 7f66a67fc640 1 -- 172.21.15.5:0/3406450634 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66a8011d20 con 0x559b3cf91cd0 2024-08-31T05:37:14.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.018+0000 7f66a67fc640 1 -- 172.21.15.5:0/3406450634 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f66b80045b0 con 0x559b3cf91cd0 2024-08-31T05:37:14.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.018+0000 7f66cb8e2740 10 client.17547 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:37:14.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.018+0000 7f66cb8e2740 10 client.17547 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:37:14.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.018+0000 7f66cb8e2740 20 client.17547 populate_metadata read hostname 'smithi005' 2024-08-31T05:37:14.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.018+0000 7f66cb8e2740 1 --2- 172.21.15.5:0/3406450634 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x559b3cfd3350 0x559b3d4047a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:14.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.018+0000 7f66cb8e2740 4 client.17547 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T05:37:14.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.018+0000 7f66cb8e2740 1 -- 172.21.15.5:0/3406450634 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x559b3d2ecfe0 con 0x559b3cfd3350 2024-08-31T05:37:14.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.018+0000 7f66be7fc640 1 --2- 172.21.15.5:0/3406450634 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x559b3cfd3350 0x559b3d4047a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:14.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.019+0000 7f66be7fc640 1 --2- 172.21.15.5:0/3406450634 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x559b3cfd3350 0x559b3d4047a0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54dfca6a8d465ff1 server_cookie=371ac81da225acd9 in_seq=0 out_seq=0 2024-08-31T05:37:14.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.019+0000 7f66a67fc640 10 client.17547 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:37:14.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.021+0000 7f66a67fc640 1 -- 172.21.15.5:0/3406450634 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559b3d2ecfe0 con 0x559b3cfd3350 2024-08-31T05:37:14.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.021+0000 7f66a67fc640 10 client.17547 handle_command_reply: tid=0 2024-08-31T05:37:14.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.021+0000 7f66cb8e2740 1 client.17547 shutdown 2024-08-31T05:37:14.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.021+0000 7f66cb8e2740 1 -- 172.21.15.5:0/3406450634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559b3cf91cd0 msgr2=0x559b3d389570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:14.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.021+0000 7f66cb8e2740 1 --2- 172.21.15.5:0/3406450634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559b3cf91cd0 0x559b3d389570 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f66b800c010 tx=0x7f66b801c040 comp rx=0 tx=0).stop 2024-08-31T05:37:14.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.021+0000 7f66cb8e2740 1 -- 172.21.15.5:0/3406450634 shutdown_connections 2024-08-31T05:37:14.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.021+0000 7f66cb8e2740 1 --2- 172.21.15.5:0/3406450634 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x559b3cfd3350 0x559b3d4047a0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:14.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.021+0000 7f66a67fc640 0 client.17547 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:37:14.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.021+0000 7f66cb8e2740 1 --2- 172.21.15.5:0/3406450634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559b3cfb2670 0x559b3d400990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:14.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.021+0000 7f66cb8e2740 1 --2- 172.21.15.5:0/3406450634 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b3cfaa490 0x559b3d389ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:14.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.021+0000 7f66cb8e2740 1 --2- 172.21.15.5:0/3406450634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559b3cf91cd0 0x559b3d389570 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:14.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.021+0000 7f66cb8e2740 1 -- 172.21.15.5:0/3406450634 >> 172.21.15.5:0/3406450634 conn(0x559b3cfc7740 msgr2=0x559b3d37d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:14.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.021+0000 7f66cb8e2740 1 -- 172.21.15.5:0/3406450634 shutdown_connections 2024-08-31T05:37:14.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.021+0000 7f66cb8e2740 1 -- 172.21.15.5:0/3406450634 wait complete. 2024-08-31T05:37:14.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.021+0000 7f66cb8e2740 20 client.17547 trim_cache size 0 max 16384 2024-08-31T05:37:14.027 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:37:14.028 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-08-31T05:37:14.028 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "297c26f3-7b4d-4245-abb0-f854248e5e1b", 2024-08-31T05:37:14.028 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-08-31T05:37:14.028 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:37:14.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.022+0000 7f66c536d640 1 -- 172.21.15.5:0/1172087590 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f66ac0b4ca0 msgr2=0x7f66ac0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:14.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.022+0000 7f66c536d640 1 --2- 172.21.15.5:0/1172087590 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f66ac0b4ca0 0x7f66ac0b71b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x559b3d378400 tx=0x7f66b0004920 comp rx=0 tx=0).stop 2024-08-31T05:37:14.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.022+0000 7f66c536d640 1 -- 172.21.15.5:0/1172087590 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66c0102840 msgr2=0x7f66c019b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:14.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.022+0000 7f66c536d640 1 --2- 172.21.15.5:0/1172087590 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66c0102840 0x7f66c019b020 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f66b002ade0 tx=0x7f66b0031770 comp rx=0 tx=0).stop 2024-08-31T05:37:14.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.022+0000 7f66c536d640 1 -- 172.21.15.5:0/1172087590 shutdown_connections 2024-08-31T05:37:14.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.022+0000 7f66c536d640 1 --2- 172.21.15.5:0/1172087590 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f66ac0b4ca0 0x7f66ac0b71b0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:14.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.022+0000 7f66c536d640 1 --2- 172.21.15.5:0/1172087590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66c0108ad0 0x7f66c019baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:14.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.022+0000 7f66c536d640 1 --2- 172.21.15.5:0/1172087590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66c0108180 0x7f66c019b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:14.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.022+0000 7f66c536d640 1 --2- 172.21.15.5:0/1172087590 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66c0102840 0x7f66c019b020 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:14.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.022+0000 7f66c536d640 1 -- 172.21.15.5:0/1172087590 >> 172.21.15.5:0/1172087590 conn(0x7f66c0079580 msgr2=0x7f66c0101270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:14.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.022+0000 7f66c536d640 1 -- 172.21.15.5:0/1172087590 shutdown_connections 2024-08-31T05:37:14.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:14.022+0000 7f66c536d640 1 -- 172.21.15.5:0/1172087590 wait complete. 2024-08-31T05:37:14.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:37:14 smithi070 ceph-mon[22316]: scrub summary: active paths [/] 2024-08-31T05:37:14.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:37:14 smithi050 ceph-mon[22146]: scrub summary: active paths [/] 2024-08-31T05:37:14.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:37:14 smithi005 ceph-mon[18602]: scrub summary: active paths [/] 2024-08-31T05:37:14.926 INFO:tasks.workunit.client.0.smithi005.stdout: 1 815245 11.47 MB/sec execute 242 sec latency 42.346 ms 2024-08-31T05:37:15.352 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T05:37:15.558 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:37:15 smithi050 ceph-mon[22146]: pgmap v564: 129 pgs: 129 active+clean; 440 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.6 MiB/s wr, 230 op/s 2024-08-31T05:37:15.558 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:37:15 smithi050 ceph-mon[22146]: scrub queued for path: / 2024-08-31T05:37:15.558 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:37:15 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:37:15.558 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:37:15 smithi050 ceph-mon[22146]: scrub summary: active paths [/] 2024-08-31T05:37:15.558 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:37:15 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:37:15.558 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:37:15 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:37:15.558 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:37:15 smithi050 ceph-mon[22146]: osdmap e89: 12 total, 12 up, 12 in 2024-08-31T05:37:15.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:37:15 smithi070 ceph-mon[22316]: pgmap v564: 129 pgs: 129 active+clean; 440 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.6 MiB/s wr, 230 op/s 2024-08-31T05:37:15.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:37:15 smithi070 ceph-mon[22316]: scrub queued for path: / 2024-08-31T05:37:15.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:37:15 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:37:15.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:37:15 smithi070 ceph-mon[22316]: scrub summary: active paths [/] 2024-08-31T05:37:15.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:37:15 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:37:15.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:37:15 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:37:15.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:37:15 smithi070 ceph-mon[22316]: osdmap e89: 12 total, 12 up, 12 in 2024-08-31T05:37:15.613 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:37:15.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:37:15 smithi005 ceph-mon[18602]: pgmap v564: 129 pgs: 129 active+clean; 440 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.6 MiB/s wr, 230 op/s 2024-08-31T05:37:15.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:37:15 smithi005 ceph-mon[18602]: scrub queued for path: / 2024-08-31T05:37:15.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:37:15 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:37:15.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:37:15 smithi005 ceph-mon[18602]: scrub summary: active paths [/] 2024-08-31T05:37:15.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:37:15 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:37:15.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:37:15 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:37:15.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:37:15 smithi005 ceph-mon[18602]: osdmap e89: 12 total, 12 up, 12 in 2024-08-31T05:37:15.926 INFO:tasks.workunit.client.0.smithi005.stdout: 1 817270 11.48 MB/sec execute 243 sec latency 15.930 ms 2024-08-31T05:37:16.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.131+0000 7f547ef88640 1 -- 172.21.15.5:0/4105272132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5478105040 msgr2=0x7f547810d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:16.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.131+0000 7f547ef88640 1 --2- 172.21.15.5:0/4105272132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5478105040 0x7f547810d6d0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f5464009900 tx=0x7f546402a410 comp rx=0 tx=0).stop 2024-08-31T05:37:16.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.131+0000 7f547ef88640 1 -- 172.21.15.5:0/4105272132 shutdown_connections 2024-08-31T05:37:16.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.131+0000 7f547ef88640 1 --2- 172.21.15.5:0/4105272132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f547810dc10 0x7f54781100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:16.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.131+0000 7f547ef88640 1 --2- 172.21.15.5:0/4105272132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5478105040 0x7f547810d6d0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:16.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.131+0000 7f547ef88640 1 --2- 172.21.15.5:0/4105272132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5478104660 0x7f5478104a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:16.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.131+0000 7f547ef88640 1 -- 172.21.15.5:0/4105272132 >> 172.21.15.5:0/4105272132 conn(0x7f5478079550 msgr2=0x7f5478079960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:16.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.131+0000 7f547ef88640 1 -- 172.21.15.5:0/4105272132 shutdown_connections 2024-08-31T05:37:16.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.131+0000 7f547ef88640 1 -- 172.21.15.5:0/4105272132 wait complete. 2024-08-31T05:37:16.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.132+0000 7f547ef88640 1 Processor -- start 2024-08-31T05:37:16.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.132+0000 7f547ef88640 1 -- start start 2024-08-31T05:37:16.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.132+0000 7f547ef88640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5478104660 0x7f547819a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:16.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.132+0000 7f547ef88640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5478105040 0x7f547819a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:16.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.132+0000 7f547ef88640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f547810dc10 0x7f547819fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:16.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.132+0000 7f547ef88640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5478113850 con 0x7f547810dc10 2024-08-31T05:37:16.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.132+0000 7f547ef88640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f54781136d0 con 0x7f5478105040 2024-08-31T05:37:16.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.132+0000 7f547ef88640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f54781139d0 con 0x7f5478104660 2024-08-31T05:37:16.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.132+0000 7f547cd24640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5478104660 0x7f547819a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:16.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.132+0000 7f5477fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5478105040 0x7f547819a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:16.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.132+0000 7f547d525640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f547810dc10 0x7f547819fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:16.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.132+0000 7f5477fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5478105040 0x7f547819a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:47330/0 (socket says 172.21.15.5:47330) 2024-08-31T05:37:16.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.132+0000 7f5477fff640 1 -- 172.21.15.5:0/2047214211 learned_addr learned my addr 172.21.15.5:0/2047214211 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:16.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.133+0000 7f5477fff640 1 -- 172.21.15.5:0/2047214211 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5478104660 msgr2=0x7f547819a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:16.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.133+0000 7f5477fff640 1 --2- 172.21.15.5:0/2047214211 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5478104660 0x7f547819a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:16.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.133+0000 7f5477fff640 1 -- 172.21.15.5:0/2047214211 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f547810dc10 msgr2=0x7f547819fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:16.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.133+0000 7f5477fff640 1 --2- 172.21.15.5:0/2047214211 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f547810dc10 0x7f547819fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:16.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.133+0000 7f5477fff640 1 -- 172.21.15.5:0/2047214211 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54781a0250 con 0x7f5478105040 2024-08-31T05:37:16.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.133+0000 7f547d525640 1 --2- 172.21.15.5:0/2047214211 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f547810dc10 0x7f547819fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:37:16.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.133+0000 7f5477fff640 1 --2- 172.21.15.5:0/2047214211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5478105040 0x7f547819a880 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f546402a930 tx=0x7f5464031a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:16.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.133+0000 7f5475ffb640 1 -- 172.21.15.5:0/2047214211 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546403f030 con 0x7f5478105040 2024-08-31T05:37:16.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.133+0000 7f547ef88640 1 -- 172.21.15.5:0/2047214211 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54781a04e0 con 0x7f5478105040 2024-08-31T05:37:16.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.133+0000 7f5475ffb640 1 -- 172.21.15.5:0/2047214211 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54640043d0 con 0x7f5478105040 2024-08-31T05:37:16.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.133+0000 7f5475ffb640 1 -- 172.21.15.5:0/2047214211 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5464035070 con 0x7f5478105040 2024-08-31T05:37:16.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.134+0000 7f547ef88640 1 -- 172.21.15.5:0/2047214211 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54781a6ca0 con 0x7f5478105040 2024-08-31T05:37:16.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.136+0000 7f54854fd740 1 Processor -- start 2024-08-31T05:37:16.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.136+0000 7f54854fd740 1 -- start start 2024-08-31T05:37:16.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.137+0000 7f54854fd740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56289d8ff070 0x56289dca42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:16.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.137+0000 7f54854fd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56289d8d61b0 0x56289dca4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:16.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.137+0000 7f54854fd740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56289d8de390 0x56289dca4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:16.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.137+0000 7f54854fd740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56289dc1b630 con 0x56289d8ff070 2024-08-31T05:37:16.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.137+0000 7f54854fd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56289dc0abc0 con 0x56289d8d61b0 2024-08-31T05:37:16.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.137+0000 7f54854fd740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56289dc0eb70 con 0x56289d8de390 2024-08-31T05:37:16.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.137+0000 7f547cd24640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56289d8d61b0 0x56289dca4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:16.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.137+0000 7f547d525640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56289d8ff070 0x56289dca42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:16.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.137+0000 7f547d525640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56289d8ff070 0x56289dca42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37954/0 (socket says 172.21.15.5:37954) 2024-08-31T05:37:16.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.137+0000 7f547cd24640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56289d8d61b0 0x56289dca4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:47340/0 (socket says 172.21.15.5:47340) 2024-08-31T05:37:16.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.137+0000 7f547d525640 1 -- 172.21.15.5:0/2531820222 learned_addr learned my addr 172.21.15.5:0/2531820222 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:16.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.137+0000 7f547cd24640 1 -- 172.21.15.5:0/2531820222 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56289d8de390 msgr2=0x56289dca4d40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T05:37:16.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.137+0000 7f547cd24640 1 --2- 172.21.15.5:0/2531820222 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56289d8de390 0x56289dca4d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:16.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.137+0000 7f547cd24640 1 -- 172.21.15.5:0/2531820222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56289d8ff070 msgr2=0x56289dca42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:16.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.137+0000 7f547cd24640 1 --2- 172.21.15.5:0/2531820222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56289d8ff070 0x56289dca42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:16.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.137+0000 7f547cd24640 1 -- 172.21.15.5:0/2531820222 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56289d96a650 con 0x56289d8d61b0 2024-08-31T05:37:16.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.138+0000 7f5475ffb640 1 -- 172.21.15.5:0/2047214211 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f5464042030 con 0x7f5478105040 2024-08-31T05:37:16.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.138+0000 7f547cd24640 1 --2- 172.21.15.5:0/2531820222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56289d8d61b0 0x56289dca4800 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f546c009c20 tx=0x7f546c011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79838400ec92702d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:16.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.138+0000 7f5462ffd640 1 -- 172.21.15.5:0/2531820222 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546c009dd0 con 0x56289d8d61b0 2024-08-31T05:37:16.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.138+0000 7f5462ffd640 1 -- 172.21.15.5:0/2531820222 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f546c005020 con 0x56289d8d61b0 2024-08-31T05:37:16.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.138+0000 7f5462ffd640 1 -- 172.21.15.5:0/2531820222 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546c004ac0 con 0x56289d8d61b0 2024-08-31T05:37:16.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.138+0000 7f5475ffb640 1 --2- 172.21.15.5:0/2047214211 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f54680b4ca0 0x7f54680b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:16.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.139+0000 7f547d525640 1 --2- 172.21.15.5:0/2047214211 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f54680b4ca0 0x7f54680b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:16.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.139+0000 7f5475ffb640 1 -- 172.21.15.5:0/2047214211 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7f5464105be0 con 0x7f5478105040 2024-08-31T05:37:16.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.139+0000 7f547d525640 1 --2- 172.21.15.5:0/2047214211 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f54680b4ca0 0x7f54680b71b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f54700129c0 tx=0x7f5470009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:16.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.139+0000 7f54854fd740 1 -- 172.21.15.5:0/2531820222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56289d8d61b0 msgr2=0x56289dca4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:16.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.139+0000 7f54854fd740 1 --2- 172.21.15.5:0/2531820222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56289d8d61b0 0x56289dca4800 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f546c009c20 tx=0x7f546c011810 comp rx=0 tx=0).stop 2024-08-31T05:37:16.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.139+0000 7f54854fd740 1 -- 172.21.15.5:0/2531820222 shutdown_connections 2024-08-31T05:37:16.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.139+0000 7f54854fd740 1 --2- 172.21.15.5:0/2531820222 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56289d8de390 0x56289dca4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:16.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.139+0000 7f54854fd740 1 --2- 172.21.15.5:0/2531820222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56289d8d61b0 0x56289dca4800 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:16.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.139+0000 7f54854fd740 1 --2- 172.21.15.5:0/2531820222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56289d8ff070 0x56289dca42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:16.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.139+0000 7f54854fd740 1 -- 172.21.15.5:0/2531820222 >> 172.21.15.5:0/2531820222 conn(0x56289d8f3460 msgr2=0x56289dca21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:16.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.139+0000 7f54854fd740 1 -- 172.21.15.5:0/2531820222 shutdown_connections 2024-08-31T05:37:16.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.139+0000 7f54854fd740 1 -- 172.21.15.5:0/2531820222 wait complete. 2024-08-31T05:37:16.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.140+0000 7f54854fd740 1 -- start start 2024-08-31T05:37:16.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.140+0000 7f54854fd740 1 Processor -- start 2024-08-31T05:37:16.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.141+0000 7f54854fd740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56289d8d61b0 0x56289dcafb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:16.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.141+0000 7f54854fd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56289d8de390 0x56289dcb0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:16.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.141+0000 7f54854fd740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56289d8ff070 0x56289dcc01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:16.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.141+0000 7f54854fd740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56289da6d700 con 0x56289d8ff070 2024-08-31T05:37:16.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.141+0000 7f54854fd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56289db91700 con 0x56289d8de390 2024-08-31T05:37:16.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.141+0000 7f54854fd740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56289dcb6eb0 con 0x56289d8d61b0 2024-08-31T05:37:16.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.141+0000 7f54854fd740 10 client.0 _ll_register_callbacks cb 0x56289dbc0dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:37:16.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.141+0000 7f5477fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56289d8de390 0x56289dcb0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:16.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.141+0000 7f547d525640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56289d8ff070 0x56289dcc01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:16.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.141+0000 7f547d525640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56289d8ff070 0x56289dcc01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37962/0 (socket says 172.21.15.5:37962) 2024-08-31T05:37:16.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.141+0000 7f547cd24640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56289d8d61b0 0x56289dcafb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:16.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.141+0000 7f547d525640 1 -- 172.21.15.5:0/506998293 learned_addr learned my addr 172.21.15.5:0/506998293 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:16.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.141+0000 7f547cd24640 1 -- 172.21.15.5:0/506998293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56289d8de390 msgr2=0x56289dcb0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:16.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.141+0000 7f547cd24640 1 --2- 172.21.15.5:0/506998293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56289d8de390 0x56289dcb0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:16.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.141+0000 7f547cd24640 1 -- 172.21.15.5:0/506998293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56289d8ff070 msgr2=0x56289dcc01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:16.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.141+0000 7f547cd24640 1 --2- 172.21.15.5:0/506998293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56289d8ff070 0x56289dcc01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:16.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.141+0000 7f547cd24640 1 -- 172.21.15.5:0/506998293 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56289dbca8b0 con 0x56289d8d61b0 2024-08-31T05:37:16.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.142+0000 7f547d525640 1 --2- 172.21.15.5:0/506998293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56289d8ff070 0x56289dcc01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:37:16.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.142+0000 7f547cd24640 1 --2- 172.21.15.5:0/506998293 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56289d8d61b0 0x56289dcafb20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f546c000c00 tx=0x7f546c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1da6472ca8af7ee server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:16.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.142+0000 7f5457fff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:37:16.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.142+0000 7f5457fff640 1 -- 172.21.15.5:0/506998293 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546c029020 con 0x56289d8d61b0 2024-08-31T05:37:16.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.142+0000 7f5457fff640 1 -- 172.21.15.5:0/506998293 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7f546c004ab0 con 0x56289d8d61b0 2024-08-31T05:37:16.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.142+0000 7f54854fd740 1 -- 172.21.15.5:0/506998293 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f546c005020 con 0x56289d8d61b0 2024-08-31T05:37:16.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.142+0000 7f5457fff640 1 -- 172.21.15.5:0/506998293 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f546c034050 con 0x56289d8d61b0 2024-08-31T05:37:16.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.142+0000 7f54854fd740 10 client.27145 fetch_fsmap learned FSMap version 34 2024-08-31T05:37:16.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.142+0000 7f54854fd740 1 -- 172.21.15.5:0/506998293 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56289dcc2cc0 con 0x56289d8d61b0 2024-08-31T05:37:16.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.143+0000 7f5457fff640 1 -- 172.21.15.5:0/506998293 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f546c005020 con 0x56289d8d61b0 2024-08-31T05:37:16.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.143+0000 7f5457fff640 1 -- 172.21.15.5:0/506998293 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f546c023420 con 0x56289d8d61b0 2024-08-31T05:37:16.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.143+0000 7f54854fd740 10 client.27145 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:37:16.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.143+0000 7f54854fd740 10 client.27145 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:37:16.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.143+0000 7f54854fd740 20 client.27145 populate_metadata read hostname 'smithi005' 2024-08-31T05:37:16.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.143+0000 7f54854fd740 1 --2- 172.21.15.5:0/506998293 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56289d8bd9f0 0x56289dcc6080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:16.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.143+0000 7f54854fd740 4 client.27145 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:37:16.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.143+0000 7f54854fd740 1 -- 172.21.15.5:0/506998293 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56289dc1d580 con 0x56289d8bd9f0 2024-08-31T05:37:16.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.143+0000 7f5477fff640 1 --2- 172.21.15.5:0/506998293 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56289d8bd9f0 0x56289dcc6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:16.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.143+0000 7f5457fff640 10 client.27145 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:37:16.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.144+0000 7f5477fff640 1 --2- 172.21.15.5:0/506998293 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56289d8bd9f0 0x56289dcc6080 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=989970eda126d6df server_cookie=db98c89e28d68b0f in_seq=0 out_seq=0 2024-08-31T05:37:16.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.145+0000 7f5457fff640 1 -- 172.21.15.5:0/506998293 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56289dc1d580 con 0x56289d8bd9f0 2024-08-31T05:37:16.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.145+0000 7f5457fff640 10 client.27145 handle_command_reply: tid=0 2024-08-31T05:37:16.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.145+0000 7f54854fd740 1 client.27145 shutdown 2024-08-31T05:37:16.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.145+0000 7f54854fd740 1 -- 172.21.15.5:0/506998293 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56289d8d61b0 msgr2=0x56289dcafb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:16.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.145+0000 7f54854fd740 1 --2- 172.21.15.5:0/506998293 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56289d8d61b0 0x56289dcafb20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f546c000c00 tx=0x7f546c0046c0 comp rx=0 tx=0).stop 2024-08-31T05:37:16.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.145+0000 7f54854fd740 1 -- 172.21.15.5:0/506998293 shutdown_connections 2024-08-31T05:37:16.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.145+0000 7f54854fd740 1 --2- 172.21.15.5:0/506998293 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56289d8bd9f0 0x56289dcc6080 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:16.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.145+0000 7f54854fd740 1 --2- 172.21.15.5:0/506998293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56289d8ff070 0x56289dcc01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:16.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.145+0000 7f54854fd740 1 --2- 172.21.15.5:0/506998293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56289d8de390 0x56289dcb0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:16.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.145+0000 7f5457fff640 0 client.27145 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:37:16.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.145+0000 7f54854fd740 1 --2- 172.21.15.5:0/506998293 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56289d8d61b0 0x56289dcafb20 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:16.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.145+0000 7f54854fd740 1 -- 172.21.15.5:0/506998293 >> 172.21.15.5:0/506998293 conn(0x56289d8f3460 msgr2=0x56289dca74a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:16.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.145+0000 7f54854fd740 1 -- 172.21.15.5:0/506998293 shutdown_connections 2024-08-31T05:37:16.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.145+0000 7f54854fd740 1 -- 172.21.15.5:0/506998293 wait complete. 2024-08-31T05:37:16.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.145+0000 7f54854fd740 20 client.27145 trim_cache size 0 max 16384 2024-08-31T05:37:16.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.166+0000 7f54854fd740 1 Processor -- start 2024-08-31T05:37:16.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.166+0000 7f54854fd740 1 -- start start 2024-08-31T05:37:16.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.166+0000 7f54854fd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56289d8bd9f0 0x56289dca7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:16.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.166+0000 7f54854fd740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56289d8d61b0 0x56289dca5a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:16.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.166+0000 7f54854fd740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56289d8de390 0x56289dcc00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:16.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.167+0000 7f54854fd740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f54781aeb80 con 0x56289d8d61b0 2024-08-31T05:37:16.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.167+0000 7f54854fd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f54781b06c0 con 0x56289d8bd9f0 2024-08-31T05:37:16.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.167+0000 7f54854fd740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f54781af250 con 0x56289d8de390 2024-08-31T05:37:16.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.167+0000 7f5477fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56289d8d61b0 0x56289dca5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:16.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.167+0000 7f547cd24640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56289d8bd9f0 0x56289dca7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:16.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.167+0000 7f5477fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56289d8d61b0 0x56289dca5a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37964/0 (socket says 172.21.15.5:37964) 2024-08-31T05:37:16.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.167+0000 7f5477fff640 1 -- 172.21.15.5:0/526905738 learned_addr learned my addr 172.21.15.5:0/526905738 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:16.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.167+0000 7f547d525640 1 --2- 172.21.15.5:0/526905738 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56289d8de390 0x56289dcc00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:16.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.167+0000 7f547cd24640 1 -- 172.21.15.5:0/526905738 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56289d8de390 msgr2=0x56289dcc00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:16.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.167+0000 7f547cd24640 1 --2- 172.21.15.5:0/526905738 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56289d8de390 0x56289dcc00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:16.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.167+0000 7f547cd24640 1 -- 172.21.15.5:0/526905738 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56289d8d61b0 msgr2=0x56289dca5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:16.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.167+0000 7f547cd24640 1 --2- 172.21.15.5:0/526905738 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56289d8d61b0 0x56289dca5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:16.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.167+0000 7f547cd24640 1 -- 172.21.15.5:0/526905738 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56289dcb0de0 con 0x56289d8bd9f0 2024-08-31T05:37:16.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.167+0000 7f5477fff640 1 --2- 172.21.15.5:0/526905738 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56289d8d61b0 0x56289dca5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:37:16.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.167+0000 7f547cd24640 1 --2- 172.21.15.5:0/526905738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56289d8bd9f0 0x56289dca7d80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f546c023a30 tx=0x7f546c0096f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c36b67e37338cb34 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:16.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.167+0000 7f54627fc640 1 -- 172.21.15.5:0/526905738 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546c029070 con 0x56289d8bd9f0 2024-08-31T05:37:16.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.168+0000 7f54627fc640 1 -- 172.21.15.5:0/526905738 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f546c023420 con 0x56289d8bd9f0 2024-08-31T05:37:16.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.168+0000 7f54627fc640 1 -- 172.21.15.5:0/526905738 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546c004ab0 con 0x56289d8bd9f0 2024-08-31T05:37:16.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.168+0000 7f54854fd740 1 -- 172.21.15.5:0/526905738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56289d8bd9f0 msgr2=0x56289dca7d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:16.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.168+0000 7f54854fd740 1 --2- 172.21.15.5:0/526905738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56289d8bd9f0 0x56289dca7d80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f546c023a30 tx=0x7f546c0096f0 comp rx=0 tx=0).stop 2024-08-31T05:37:16.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.168+0000 7f54854fd740 1 -- 172.21.15.5:0/526905738 shutdown_connections 2024-08-31T05:37:16.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.168+0000 7f54854fd740 1 --2- 172.21.15.5:0/526905738 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56289d8de390 0x56289dcc00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:16.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.169+0000 7f54854fd740 1 --2- 172.21.15.5:0/526905738 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56289d8d61b0 0x56289dca5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:16.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.169+0000 7f54854fd740 1 --2- 172.21.15.5:0/526905738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56289d8bd9f0 0x56289dca7d80 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:16.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.169+0000 7f54854fd740 1 -- 172.21.15.5:0/526905738 >> 172.21.15.5:0/526905738 conn(0x56289d8f3460 msgr2=0x56289dca52f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:16.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.169+0000 7f54854fd740 1 -- 172.21.15.5:0/526905738 shutdown_connections 2024-08-31T05:37:16.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.169+0000 7f54854fd740 1 -- 172.21.15.5:0/526905738 wait complete. 2024-08-31T05:37:16.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.169+0000 7f54854fd740 1 -- start start 2024-08-31T05:37:16.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.169+0000 7f54854fd740 1 Processor -- start 2024-08-31T05:37:16.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.170+0000 7f54854fd740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56289d8d61b0 0x56289dcb8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:16.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.170+0000 7f54854fd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56289d8de390 0x56289dcb8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:16.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.170+0000 7f54854fd740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56289d8ff070 0x56289dd2f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:16.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.170+0000 7f54854fd740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f54781afff0 con 0x56289d8ff070 2024-08-31T05:37:16.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.170+0000 7f54854fd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f54781af920 con 0x56289d8de390 2024-08-31T05:37:16.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.170+0000 7f54854fd740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f54781acb80 con 0x56289d8d61b0 2024-08-31T05:37:16.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.170+0000 7f54854fd740 10 client.0 _ll_register_callbacks cb 0x7f5470009900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:37:16.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.170+0000 7f5477fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56289d8de390 0x56289dcb8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:16.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.170+0000 7f5477fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56289d8de390 0x56289dcb8ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:47364/0 (socket says 172.21.15.5:47364) 2024-08-31T05:37:16.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.170+0000 7f5477fff640 1 -- 172.21.15.5:0/370003790 learned_addr learned my addr 172.21.15.5:0/370003790 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:16.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.170+0000 7f547d525640 1 --2- 172.21.15.5:0/370003790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56289d8ff070 0x56289dd2f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:16.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.170+0000 7f547cd24640 1 --2- 172.21.15.5:0/370003790 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56289d8d61b0 0x56289dcb8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:16.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.170+0000 7f5477fff640 1 -- 172.21.15.5:0/370003790 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56289d8d61b0 msgr2=0x56289dcb8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:16.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.170+0000 7f5477fff640 1 --2- 172.21.15.5:0/370003790 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56289d8d61b0 0x56289dcb8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:16.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.170+0000 7f5477fff640 1 -- 172.21.15.5:0/370003790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56289d8ff070 msgr2=0x56289dd2f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:16.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.170+0000 7f5477fff640 1 --2- 172.21.15.5:0/370003790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56289d8ff070 0x56289dd2f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:16.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.170+0000 7f5477fff640 1 -- 172.21.15.5:0/370003790 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56289dd2ff30 con 0x56289d8de390 2024-08-31T05:37:16.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.170+0000 7f547cd24640 1 --2- 172.21.15.5:0/370003790 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56289d8d61b0 0x56289dcb8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:37:16.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.170+0000 7f5477fff640 1 --2- 172.21.15.5:0/370003790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56289d8de390 0x56289dcb8ae0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5464004650 tx=0x7f546402a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99ca6937885c39d6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:16.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.170+0000 7f5457fff640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:37:16.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.171+0000 7f5457fff640 1 -- 172.21.15.5:0/370003790 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5464049070 con 0x56289d8de390 2024-08-31T05:37:16.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.171+0000 7f5457fff640 1 -- 172.21.15.5:0/370003790 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7f54640d03c0 con 0x56289d8de390 2024-08-31T05:37:16.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.171+0000 7f54854fd740 1 -- 172.21.15.5:0/370003790 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f546c023420 con 0x56289d8de390 2024-08-31T05:37:16.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.171+0000 7f5457fff640 1 -- 172.21.15.5:0/370003790 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f54640d0760 con 0x56289d8de390 2024-08-31T05:37:16.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.171+0000 7f54854fd740 10 client.27149 fetch_fsmap learned FSMap version 34 2024-08-31T05:37:16.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.171+0000 7f54854fd740 1 -- 172.21.15.5:0/370003790 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56289dd31120 con 0x56289d8de390 2024-08-31T05:37:16.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.171+0000 7f5457fff640 1 -- 172.21.15.5:0/370003790 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f546c023420 con 0x56289d8de390 2024-08-31T05:37:16.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.171+0000 7f5457fff640 1 -- 172.21.15.5:0/370003790 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f54640b1ce0 con 0x56289d8de390 2024-08-31T05:37:16.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.171+0000 7f54854fd740 10 client.27149 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:37:16.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.171+0000 7f54854fd740 10 client.27149 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:37:16.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.172+0000 7f54854fd740 20 client.27149 populate_metadata read hostname 'smithi005' 2024-08-31T05:37:16.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.172+0000 7f54854fd740 1 --2- 172.21.15.5:0/370003790 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56289d892da0 0x56289dd338e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:16.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.172+0000 7f54854fd740 4 client.27149 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T05:37:16.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.172+0000 7f54854fd740 1 -- 172.21.15.5:0/370003790 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56289dc19020 con 0x56289d892da0 2024-08-31T05:37:16.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.172+0000 7f547cd24640 1 --2- 172.21.15.5:0/370003790 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56289d892da0 0x56289dd338e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:16.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.172+0000 7f5457fff640 10 client.27149 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:37:16.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.172+0000 7f547cd24640 1 --2- 172.21.15.5:0/370003790 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56289d892da0 0x56289dd338e0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ab7c3754223fd86 server_cookie=ae1e2006bf1b552b in_seq=0 out_seq=0 2024-08-31T05:37:16.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.173+0000 7f5457fff640 1 -- 172.21.15.5:0/370003790 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3126 (crc 0 0 0) 0x56289dc19020 con 0x56289d892da0 2024-08-31T05:37:16.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.173+0000 7f5457fff640 10 client.27149 handle_command_reply: tid=0 2024-08-31T05:37:16.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.173+0000 7f54854fd740 1 client.27149 shutdown 2024-08-31T05:37:16.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.173+0000 7f54854fd740 1 -- 172.21.15.5:0/370003790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56289d8de390 msgr2=0x56289dcb8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:16.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.173+0000 7f54854fd740 1 --2- 172.21.15.5:0/370003790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56289d8de390 0x56289dcb8ae0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5464004650 tx=0x7f546402a410 comp rx=0 tx=0).stop 2024-08-31T05:37:16.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.173+0000 7f54854fd740 1 -- 172.21.15.5:0/370003790 shutdown_connections 2024-08-31T05:37:16.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.173+0000 7f54854fd740 1 --2- 172.21.15.5:0/370003790 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56289d892da0 0x56289dd338e0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:16.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.173+0000 7f54854fd740 1 --2- 172.21.15.5:0/370003790 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56289d8ff070 0x56289dd2f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:16.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.173+0000 7f5457fff640 0 client.27149 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:37:16.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.173+0000 7f54854fd740 1 --2- 172.21.15.5:0/370003790 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56289d8de390 0x56289dcb8ae0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:16.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.173+0000 7f54854fd740 1 --2- 172.21.15.5:0/370003790 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56289d8d61b0 0x56289dcb8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:16.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.173+0000 7f54854fd740 1 -- 172.21.15.5:0/370003790 >> 172.21.15.5:0/370003790 conn(0x56289d8f3460 msgr2=0x56289dca7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:16.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.173+0000 7f54854fd740 1 -- 172.21.15.5:0/370003790 shutdown_connections 2024-08-31T05:37:16.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.173+0000 7f54854fd740 1 -- 172.21.15.5:0/370003790 wait complete. 2024-08-31T05:37:16.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.174+0000 7f54854fd740 20 client.27149 trim_cache size 0 max 16384 2024-08-31T05:37:16.192 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:37:16.192 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T05:37:16.192 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2024-08-31T05:37:16.192 INFO:teuthology.orchestra.run.smithi005.stdout: "297c26f3-7b4d-4245-abb0-f854248e5e1b": { 2024-08-31T05:37:16.192 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:37:16.192 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "297c26f3-7b4d-4245-abb0-f854248e5e1b", 2024-08-31T05:37:16.193 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2024-08-31T05:37:16.193 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:37:16.193 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:37:16.193 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_stats": { 2024-08-31T05:37:16.193 INFO:teuthology.orchestra.run.smithi005.stdout: "94c23057-592d-4a8b-82d7-da2d84f8740b": { 2024-08-31T05:37:16.193 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:36:27.513638+0000", 2024-08-31T05:37:16.196 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:37:16.196 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:37:16.196 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:37:16.196 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:37:16.196 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:37:16.196 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:37:16.196 INFO:teuthology.orchestra.run.smithi005.stdout: "095ccc7a-f368-4bc6-9563-5930e21f9b4a": { 2024-08-31T05:37:16.197 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:35:40.190069+0000", 2024-08-31T05:37:16.197 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:37:16.197 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:37:16.197 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:37:16.197 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:37:16.197 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:37:16.197 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:37:16.197 INFO:teuthology.orchestra.run.smithi005.stdout: "297c26f3-7b4d-4245-abb0-f854248e5e1b": { 2024-08-31T05:37:16.197 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:37:14.019244+0000", 2024-08-31T05:37:16.197 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:37:16.197 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:37:16.197 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:37:16.197 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:37:16.198 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:37:16.198 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:37:16.198 INFO:teuthology.orchestra.run.smithi005.stdout: "de9731c7-ae4a-42fe-8146-e4752cdc40d4": { 2024-08-31T05:37:16.198 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:34:53.614499+0000", 2024-08-31T05:37:16.198 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:37:16.198 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:37:16.198 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:37:16.198 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:37:16.198 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:37:16.198 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:37:16.198 INFO:teuthology.orchestra.run.smithi005.stdout: "0bb67292-013a-40c7-b5fc-810bdd9715d8": { 2024-08-31T05:37:16.198 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:34:04.586008+0000", 2024-08-31T05:37:16.198 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:37:16.198 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:37:16.199 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:37:16.199 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:37:16.199 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:37:16.199 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:37:16.199 INFO:teuthology.orchestra.run.smithi005.stdout: "728a42ca-bbef-4151-830f-5fdd411d8fa0": { 2024-08-31T05:37:16.199 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:32:30.554906+0000", 2024-08-31T05:37:16.199 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:37:16.199 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:37:16.199 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:37:16.199 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:37:16.199 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:37:16.200 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:37:16.200 INFO:teuthology.orchestra.run.smithi005.stdout: "2445fc42-b797-434f-b380-e2da985b4d98": { 2024-08-31T05:37:16.200 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:33:17.681453+0000", 2024-08-31T05:37:16.200 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:37:16.200 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:37:16.200 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:37:16.200 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:37:16.200 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:37:16.200 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:37:16.200 INFO:teuthology.orchestra.run.smithi005.stdout: "cda92ac0-b35f-47a5-a3a5-471c888462a5": { 2024-08-31T05:37:16.200 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:53.103905+0000", 2024-08-31T05:37:16.200 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:37:16.200 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:37:16.201 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:37:16.201 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:37:16.201 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:37:16.201 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:37:16.201 INFO:teuthology.orchestra.run.smithi005.stdout: "ece37b07-9ab2-45f8-bc33-2755a07aac0b": { 2024-08-31T05:37:16.202 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:31:41.782407+0000", 2024-08-31T05:37:16.202 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:37:16.202 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:37:16.202 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:37:16.202 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:37:16.202 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:37:16.202 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:37:16.202 INFO:teuthology.orchestra.run.smithi005.stdout: "75d84398-5d9c-4872-b879-2fbce045fa71": { 2024-08-31T05:37:16.202 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:06.642335+0000", 2024-08-31T05:37:16.202 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:37:16.202 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:37:16.202 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:37:16.202 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:37:16.203 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:37:16.203 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:37:16.203 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:37:16.203 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:37:16.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.174+0000 7f547ef88640 1 -- 172.21.15.5:0/2047214211 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f54680b4ca0 msgr2=0x7f54680b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:16.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.174+0000 7f547ef88640 1 --2- 172.21.15.5:0/2047214211 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f54680b4ca0 0x7f54680b71b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f54700129c0 tx=0x7f5470009500 comp rx=0 tx=0).stop 2024-08-31T05:37:16.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.174+0000 7f547ef88640 1 -- 172.21.15.5:0/2047214211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5478105040 msgr2=0x7f547819a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:16.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.174+0000 7f547ef88640 1 --2- 172.21.15.5:0/2047214211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5478105040 0x7f547819a880 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f546402a930 tx=0x7f5464031a20 comp rx=0 tx=0).stop 2024-08-31T05:37:16.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.175+0000 7f547ef88640 1 -- 172.21.15.5:0/2047214211 shutdown_connections 2024-08-31T05:37:16.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.175+0000 7f547ef88640 1 --2- 172.21.15.5:0/2047214211 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f54680b4ca0 0x7f54680b71b0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:16.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.175+0000 7f547ef88640 1 --2- 172.21.15.5:0/2047214211 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f547810dc10 0x7f547819fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:16.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.175+0000 7f547ef88640 1 --2- 172.21.15.5:0/2047214211 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5478105040 0x7f547819a880 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:16.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.175+0000 7f547ef88640 1 --2- 172.21.15.5:0/2047214211 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5478104660 0x7f547819a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:16.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.175+0000 7f547ef88640 1 -- 172.21.15.5:0/2047214211 >> 172.21.15.5:0/2047214211 conn(0x7f5478079550 msgr2=0x7f5478100700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:16.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.176+0000 7f547ef88640 1 -- 172.21.15.5:0/2047214211 shutdown_connections 2024-08-31T05:37:16.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:16.176+0000 7f547ef88640 1 -- 172.21.15.5:0/2047214211 wait complete. 2024-08-31T05:37:16.926 INFO:tasks.workunit.client.0.smithi005.stdout: 1 819311 11.47 MB/sec execute 244 sec latency 25.996 ms 2024-08-31T05:37:17.388 INFO:tasks.cephfs.filesystem:scrub status for tag:297c26f3-7b4d-4245-abb0-f854248e5e1b - {'path': '/', 'tag': '297c26f3-7b4d-4245-abb0-f854248e5e1b', 'options': 'recursive,force'} 2024-08-31T05:37:17.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:37:17 smithi070 ceph-mon[22316]: pgmap v566: 129 pgs: 129 active+clean; 418 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.4 MiB/s wr, 253 op/s 2024-08-31T05:37:17.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:37:17 smithi050 ceph-mon[22146]: pgmap v566: 129 pgs: 129 active+clean; 418 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.4 MiB/s wr, 253 op/s 2024-08-31T05:37:17.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:37:17 smithi005 ceph-mon[18602]: pgmap v566: 129 pgs: 129 active+clean; 418 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.4 MiB/s wr, 253 op/s 2024-08-31T05:37:17.926 INFO:tasks.workunit.client.0.smithi005.stdout: 1 820895 11.46 MB/sec execute 245 sec latency 52.107 ms 2024-08-31T05:37:18.926 INFO:tasks.workunit.client.0.smithi005.stdout: 1 823408 11.47 MB/sec execute 246 sec latency 15.474 ms 2024-08-31T05:37:19.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:37:19 smithi070 ceph-mon[22316]: pgmap v567: 129 pgs: 129 active+clean; 420 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.4 MiB/s wr, 257 op/s 2024-08-31T05:37:19.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:37:19 smithi050 ceph-mon[22146]: pgmap v567: 129 pgs: 129 active+clean; 420 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.4 MiB/s wr, 257 op/s 2024-08-31T05:37:19.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:37:19 smithi005 ceph-mon[18602]: pgmap v567: 129 pgs: 129 active+clean; 420 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.4 MiB/s wr, 257 op/s 2024-08-31T05:37:19.927 INFO:tasks.workunit.client.0.smithi005.stdout: 1 825243 11.46 MB/sec execute 247 sec latency 18.706 ms 2024-08-31T05:37:20.926 INFO:tasks.workunit.client.0.smithi005.stdout: 1 827614 11.47 MB/sec execute 248 sec latency 14.958 ms 2024-08-31T05:37:21.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:37:21 smithi070 ceph-mon[22316]: pgmap v568: 129 pgs: 129 active+clean; 427 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.0 MiB/s wr, 228 op/s 2024-08-31T05:37:21.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:37:21 smithi050 ceph-mon[22146]: pgmap v568: 129 pgs: 129 active+clean; 427 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.0 MiB/s wr, 228 op/s 2024-08-31T05:37:21.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:37:21 smithi005 ceph-mon[18602]: pgmap v568: 129 pgs: 129 active+clean; 427 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.0 MiB/s wr, 228 op/s 2024-08-31T05:37:21.926 INFO:tasks.workunit.client.0.smithi005.stdout: 1 829597 11.46 MB/sec execute 249 sec latency 19.002 ms 2024-08-31T05:37:22.291 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.287+0000 7ff39bfff640 1 -- 172.21.15.5:0/2713722921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff39409a9a0 msgr2=0x7ff39409adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:22.292 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.287+0000 7ff39bfff640 1 --2- 172.21.15.5:0/2713722921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff39409a9a0 0x7ff39409adb0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7ff39c066220 tx=0x7ff39c097e10 comp rx=0 tx=0).stop 2024-08-31T05:37:22.292 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.288+0000 7ff39bfff640 1 -- 172.21.15.5:0/2713722921 shutdown_connections 2024-08-31T05:37:22.292 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.288+0000 7ff39bfff640 1 --2- 172.21.15.5:0/2713722921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff39409b2f0 0x7ff394004780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:22.292 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.288+0000 7ff39bfff640 1 --2- 172.21.15.5:0/2713722921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff39409a9a0 0x7ff39409adb0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:22.292 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.288+0000 7ff39bfff640 1 --2- 172.21.15.5:0/2713722921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff394095070 0x7ff394095480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:22.292 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.288+0000 7ff39bfff640 1 -- 172.21.15.5:0/2713722921 >> 172.21.15.5:0/2713722921 conn(0x7ff39400cd80 msgr2=0x7ff39400d190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:22.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.291+0000 7ff39bfff640 1 -- 172.21.15.5:0/2713722921 shutdown_connections 2024-08-31T05:37:22.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.291+0000 7ff39bfff640 1 -- 172.21.15.5:0/2713722921 wait complete. 2024-08-31T05:37:22.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.292+0000 7ff39bfff640 1 Processor -- start 2024-08-31T05:37:22.298 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.293+0000 7ff39bfff640 1 -- start start 2024-08-31T05:37:22.298 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.293+0000 7ff39bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff394095070 0x7ff3940a7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:22.298 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.293+0000 7ff39bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff39409a9a0 0x7ff3940a3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:22.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.293+0000 7ff39bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff39409b2f0 0x7ff3940a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:22.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.293+0000 7ff39bfff640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff3940b9370 con 0x7ff39409b2f0 2024-08-31T05:37:22.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.293+0000 7ff39bfff640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff3940b91f0 con 0x7ff39409a9a0 2024-08-31T05:37:22.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.293+0000 7ff39bfff640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff3940b94f0 con 0x7ff394095070 2024-08-31T05:37:22.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.293+0000 7ff39affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff394095070 0x7ff3940a7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:22.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.294+0000 7ff39affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff394095070 0x7ff3940a7b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:33192/0 (socket says 172.21.15.5:33192) 2024-08-31T05:37:22.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.294+0000 7ff39affd640 1 -- 172.21.15.5:0/3348015180 learned_addr learned my addr 172.21.15.5:0/3348015180 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:22.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.294+0000 7ff39a7fc640 1 --2- 172.21.15.5:0/3348015180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff39409a9a0 0x7ff3940a3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:22.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.295+0000 7ff39a7fc640 1 -- 172.21.15.5:0/3348015180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff394095070 msgr2=0x7ff3940a7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:22.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.295+0000 7ff39a7fc640 1 --2- 172.21.15.5:0/3348015180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff394095070 0x7ff3940a7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:22.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.295+0000 7ff39a7fc640 1 -- 172.21.15.5:0/3348015180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff39409b2f0 msgr2=0x7ff3940a4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:22.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.295+0000 7ff39a7fc640 1 --2- 172.21.15.5:0/3348015180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff39409b2f0 0x7ff3940a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:22.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.295+0000 7ff39a7fc640 1 -- 172.21.15.5:0/3348015180 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff39413fb00 con 0x7ff39409a9a0 2024-08-31T05:37:22.300 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.297+0000 7ff39a7fc640 1 --2- 172.21.15.5:0/3348015180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff39409a9a0 0x7ff3940a3e50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff39c051f70 tx=0x7ff39c098d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:22.304 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.300+0000 7ff383fff640 1 -- 172.21.15.5:0/3348015180 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff39c0a5070 con 0x7ff39409a9a0 2024-08-31T05:37:22.304 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.300+0000 7ff383fff640 1 -- 172.21.15.5:0/3348015180 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff39c077c40 con 0x7ff39409a9a0 2024-08-31T05:37:22.304 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.300+0000 7ff383fff640 1 -- 172.21.15.5:0/3348015180 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff39c0a0c40 con 0x7ff39409a9a0 2024-08-31T05:37:22.304 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.300+0000 7ff39bfff640 1 -- 172.21.15.5:0/3348015180 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff39413fd90 con 0x7ff39409a9a0 2024-08-31T05:37:22.304 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.300+0000 7ff39bfff640 1 -- 172.21.15.5:0/3348015180 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff394140140 con 0x7ff39409a9a0 2024-08-31T05:37:22.308 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.304+0000 7ff3a861f740 1 Processor -- start 2024-08-31T05:37:22.312 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.308+0000 7ff383fff640 1 -- 172.21.15.5:0/3348015180 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7ff39c077790 con 0x7ff39409a9a0 2024-08-31T05:37:22.312 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.309+0000 7ff383fff640 1 --2- 172.21.15.5:0/3348015180 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff3840b4eb0 0x7ff3840b73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:22.312 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.310+0000 7ff383fff640 1 -- 172.21.15.5:0/3348015180 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7ff39c1698b0 con 0x7ff39409a9a0 2024-08-31T05:37:22.316 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.311+0000 7ff3a861f740 1 -- start start 2024-08-31T05:37:22.316 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.311+0000 7ff3a861f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ba516f1b0 0x564ba5512cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:22.316 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.311+0000 7ff3a861f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ba51462f0 0x564ba5513200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:22.316 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.311+0000 7ff3a861f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ba514e4d0 0x564ba5513740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:22.316 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.311+0000 7ff3a861f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x564ba5488000 con 0x564ba51462f0 2024-08-31T05:37:22.316 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.311+0000 7ff3a861f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564ba5477590 con 0x564ba516f1b0 2024-08-31T05:37:22.316 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.311+0000 7ff3a861f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564ba547b540 con 0x564ba514e4d0 2024-08-31T05:37:22.316 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.311+0000 7ff39b7fe640 1 --2- 172.21.15.5:0/3348015180 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff3840b4eb0 0x7ff3840b73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:22.317 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.311+0000 7ff39a7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ba51462f0 0x564ba5513200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:22.317 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.311+0000 7ff39a7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ba51462f0 0x564ba5513200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59360/0 (socket says 172.21.15.5:59360) 2024-08-31T05:37:22.317 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.311+0000 7ff39a7fc640 1 -- 172.21.15.5:0/814381398 learned_addr learned my addr 172.21.15.5:0/814381398 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:22.317 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.311+0000 7ff39b7fe640 1 --2- 172.21.15.5:0/814381398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ba514e4d0 0x564ba5513740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:22.317 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.312+0000 7ff39a7fc640 1 -- 172.21.15.5:0/814381398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ba514e4d0 msgr2=0x564ba5513740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:22.317 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.312+0000 7ff39a7fc640 1 --2- 172.21.15.5:0/814381398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ba514e4d0 0x564ba5513740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:22.317 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.312+0000 7ff39a7fc640 1 -- 172.21.15.5:0/814381398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ba516f1b0 msgr2=0x564ba5512cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:22.317 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.312+0000 7ff39a7fc640 1 --2- 172.21.15.5:0/814381398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ba516f1b0 0x564ba5512cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:22.317 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.312+0000 7ff39a7fc640 1 -- 172.21.15.5:0/814381398 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ba51da790 con 0x564ba51462f0 2024-08-31T05:37:22.317 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.312+0000 7ff39a7fc640 1 --2- 172.21.15.5:0/814381398 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ba51462f0 0x564ba5513200 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7ff39c02e9f0 tx=0x7ff39c12faf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa565e1d6f2308f1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:22.317 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.313+0000 7ff39b7fe640 1 --2- 172.21.15.5:0/3348015180 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff3840b4eb0 0x7ff3840b73c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff38c009d30 tx=0x7ff38c009670 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:22.317 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.313+0000 7ff3817fa640 1 -- 172.21.15.5:0/814381398 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff39c12fc10 con 0x564ba51462f0 2024-08-31T05:37:22.318 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.313+0000 7ff3817fa640 1 -- 172.21.15.5:0/814381398 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff39c09c040 con 0x564ba51462f0 2024-08-31T05:37:22.318 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.313+0000 7ff3817fa640 1 -- 172.21.15.5:0/814381398 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff39c169410 con 0x564ba51462f0 2024-08-31T05:37:22.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.314+0000 7ff3a861f740 1 -- 172.21.15.5:0/814381398 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ba51462f0 msgr2=0x564ba5513200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:22.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.314+0000 7ff3a861f740 1 --2- 172.21.15.5:0/814381398 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ba51462f0 0x564ba5513200 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7ff39c02e9f0 tx=0x7ff39c12faf0 comp rx=0 tx=0).stop 2024-08-31T05:37:22.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.314+0000 7ff3a861f740 1 -- 172.21.15.5:0/814381398 shutdown_connections 2024-08-31T05:37:22.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.314+0000 7ff3a861f740 1 --2- 172.21.15.5:0/814381398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ba514e4d0 0x564ba5513740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:22.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.314+0000 7ff3a861f740 1 --2- 172.21.15.5:0/814381398 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ba51462f0 0x564ba5513200 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:22.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.314+0000 7ff3a861f740 1 --2- 172.21.15.5:0/814381398 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ba516f1b0 0x564ba5512cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:22.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.314+0000 7ff3a861f740 1 -- 172.21.15.5:0/814381398 >> 172.21.15.5:0/814381398 conn(0x564ba5163300 msgr2=0x564ba5510bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:22.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.315+0000 7ff3a861f740 1 -- 172.21.15.5:0/814381398 shutdown_connections 2024-08-31T05:37:22.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.315+0000 7ff3a861f740 1 -- 172.21.15.5:0/814381398 wait complete. 2024-08-31T05:37:22.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.315+0000 7ff3a861f740 1 -- start start 2024-08-31T05:37:22.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.316+0000 7ff3a861f740 1 Processor -- start 2024-08-31T05:37:22.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.316+0000 7ff3a861f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ba51462f0 0x564ba551e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:22.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.316+0000 7ff3a861f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ba514e4d0 0x564ba551ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:22.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.316+0000 7ff3a861f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ba516f1b0 0x564ba55243f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:22.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.316+0000 7ff3a861f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x564ba53b0ab0 con 0x564ba516f1b0 2024-08-31T05:37:22.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.316+0000 7ff3a861f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564ba53fe680 con 0x564ba514e4d0 2024-08-31T05:37:22.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.316+0000 7ff3a861f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564ba5521200 con 0x564ba51462f0 2024-08-31T05:37:22.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.316+0000 7ff3a861f740 10 client.0 _ll_register_callbacks cb 0x564ba5186a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:37:22.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.317+0000 7ff39a7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ba514e4d0 0x564ba551ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:22.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.317+0000 7ff39a7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ba514e4d0 0x564ba551ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:43538/0 (socket says 172.21.15.5:43538) 2024-08-31T05:37:22.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.317+0000 7ff39a7fc640 1 -- 172.21.15.5:0/30104630 learned_addr learned my addr 172.21.15.5:0/30104630 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:22.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.317+0000 7ff39affd640 1 --2- 172.21.15.5:0/30104630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ba51462f0 0x564ba551e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:22.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.317+0000 7ff39b7fe640 1 --2- 172.21.15.5:0/30104630 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ba516f1b0 0x564ba55243f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:22.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.317+0000 7ff39affd640 1 -- 172.21.15.5:0/30104630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ba514e4d0 msgr2=0x564ba551ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:22.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.317+0000 7ff39affd640 1 --2- 172.21.15.5:0/30104630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ba514e4d0 0x564ba551ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:22.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.317+0000 7ff39affd640 1 -- 172.21.15.5:0/30104630 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ba516f1b0 msgr2=0x564ba55243f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:22.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.317+0000 7ff39affd640 1 --2- 172.21.15.5:0/30104630 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ba516f1b0 0x564ba55243f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:22.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.317+0000 7ff39affd640 1 -- 172.21.15.5:0/30104630 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ba5253620 con 0x564ba51462f0 2024-08-31T05:37:22.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.318+0000 7ff39affd640 1 --2- 172.21.15.5:0/30104630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ba51462f0 0x564ba551e9b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff3940a78c0 tx=0x7ff39000e8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75181a962e94735c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:22.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.318+0000 7ff37eff5640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:37:22.323 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.319+0000 7ff37eff5640 1 -- 172.21.15.5:0/30104630 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff390017070 con 0x564ba51462f0 2024-08-31T05:37:22.324 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.319+0000 7ff3a861f740 1 -- 172.21.15.5:0/30104630 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff39c09c040 con 0x564ba51462f0 2024-08-31T05:37:22.324 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.319+0000 7ff37eff5640 1 -- 172.21.15.5:0/30104630 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7ff390013680 con 0x564ba51462f0 2024-08-31T05:37:22.324 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.319+0000 7ff37eff5640 1 -- 172.21.15.5:0/30104630 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ff390023050 con 0x564ba51462f0 2024-08-31T05:37:22.324 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.319+0000 7ff3a861f740 10 client.27157 fetch_fsmap learned FSMap version 34 2024-08-31T05:37:22.324 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.319+0000 7ff3a861f740 1 -- 172.21.15.5:0/30104630 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x564ba552d320 con 0x564ba51462f0 2024-08-31T05:37:22.325 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.320+0000 7ff37eff5640 1 -- 172.21.15.5:0/30104630 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff39c09c040 con 0x564ba51462f0 2024-08-31T05:37:22.325 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.320+0000 7ff37eff5640 1 -- 172.21.15.5:0/30104630 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7ff390012960 con 0x564ba51462f0 2024-08-31T05:37:22.325 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.320+0000 7ff3a861f740 10 client.27157 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:37:22.325 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.320+0000 7ff3a861f740 10 client.27157 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:37:22.325 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.320+0000 7ff3a861f740 20 client.27157 populate_metadata read hostname 'smithi005' 2024-08-31T05:37:22.325 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.320+0000 7ff3a861f740 1 --2- 172.21.15.5:0/30104630 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x564ba512dd80 0x564ba5530cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:22.325 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.320+0000 7ff3a861f740 4 client.27157 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:37:22.325 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.320+0000 7ff3a861f740 1 -- 172.21.15.5:0/30104630 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ba5489f50 con 0x564ba512dd80 2024-08-31T05:37:22.325 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.320+0000 7ff39a7fc640 1 --2- 172.21.15.5:0/30104630 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x564ba512dd80 0x564ba5530cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:22.325 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.321+0000 7ff37eff5640 10 client.27157 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:37:22.326 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.321+0000 7ff39a7fc640 1 --2- 172.21.15.5:0/30104630 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x564ba512dd80 0x564ba5530cc0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23b714f402a59277 server_cookie=3022291f64ebb647 in_seq=0 out_seq=0 2024-08-31T05:37:22.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.322+0000 7ff37eff5640 1 -- 172.21.15.5:0/30104630 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564ba5489f50 con 0x564ba512dd80 2024-08-31T05:37:22.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.322+0000 7ff37eff5640 10 client.27157 handle_command_reply: tid=0 2024-08-31T05:37:22.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.322+0000 7ff3a861f740 1 client.27157 shutdown 2024-08-31T05:37:22.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.322+0000 7ff3a861f740 1 -- 172.21.15.5:0/30104630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ba51462f0 msgr2=0x564ba551e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:22.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.322+0000 7ff3a861f740 1 --2- 172.21.15.5:0/30104630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ba51462f0 0x564ba551e9b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff3940a78c0 tx=0x7ff39000e8e0 comp rx=0 tx=0).stop 2024-08-31T05:37:22.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.322+0000 7ff3a861f740 1 -- 172.21.15.5:0/30104630 shutdown_connections 2024-08-31T05:37:22.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.322+0000 7ff3a861f740 1 --2- 172.21.15.5:0/30104630 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x564ba512dd80 0x564ba5530cc0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:22.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.322+0000 7ff3a861f740 1 --2- 172.21.15.5:0/30104630 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ba516f1b0 0x564ba55243f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:22.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.322+0000 7ff3a861f740 1 --2- 172.21.15.5:0/30104630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ba514e4d0 0x564ba551ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:22.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.322+0000 7ff3a861f740 1 --2- 172.21.15.5:0/30104630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ba51462f0 0x564ba551e9b0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:22.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.322+0000 7ff3a861f740 1 -- 172.21.15.5:0/30104630 >> 172.21.15.5:0/30104630 conn(0x564ba5163300 msgr2=0x564ba5513cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:22.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.322+0000 7ff37eff5640 0 client.27157 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:37:22.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.322+0000 7ff3a861f740 1 -- 172.21.15.5:0/30104630 shutdown_connections 2024-08-31T05:37:22.327 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.323+0000 7ff3a861f740 1 -- 172.21.15.5:0/30104630 wait complete. 2024-08-31T05:37:22.328 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.323+0000 7ff3a861f740 20 client.27157 trim_cache size 0 max 16384 2024-08-31T05:37:22.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.341+0000 7ff3a861f740 1 Processor -- start 2024-08-31T05:37:22.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.341+0000 7ff3a861f740 1 -- start start 2024-08-31T05:37:22.348 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.341+0000 7ff3a861f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ba51462f0 0x564ba55103c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:22.349 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.341+0000 7ff3a861f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ba514e4d0 0x564ba5510900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:22.349 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.341+0000 7ff3a861f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ba516f1b0 0x564ba5517d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:22.349 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.341+0000 7ff3a861f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff394163370 con 0x564ba516f1b0 2024-08-31T05:37:22.349 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.341+0000 7ff3a861f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff394164eb0 con 0x564ba514e4d0 2024-08-31T05:37:22.349 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.341+0000 7ff3a861f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff394163a40 con 0x564ba51462f0 2024-08-31T05:37:22.349 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.341+0000 7ff39b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ba516f1b0 0x564ba5517d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:22.349 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.341+0000 7ff39b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ba516f1b0 0x564ba5517d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59376/0 (socket says 172.21.15.5:59376) 2024-08-31T05:37:22.349 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.341+0000 7ff39b7fe640 1 -- 172.21.15.5:0/2447061107 learned_addr learned my addr 172.21.15.5:0/2447061107 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:22.349 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.341+0000 7ff39affd640 1 --2- 172.21.15.5:0/2447061107 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ba51462f0 0x564ba55103c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:22.349 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.341+0000 7ff39a7fc640 1 --2- 172.21.15.5:0/2447061107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ba514e4d0 0x564ba5510900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:22.349 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.341+0000 7ff39b7fe640 1 -- 172.21.15.5:0/2447061107 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ba51462f0 msgr2=0x564ba55103c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:22.349 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.341+0000 7ff39b7fe640 1 --2- 172.21.15.5:0/2447061107 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ba51462f0 0x564ba55103c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:22.350 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.341+0000 7ff39b7fe640 1 -- 172.21.15.5:0/2447061107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ba514e4d0 msgr2=0x564ba5510900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:22.350 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.341+0000 7ff39b7fe640 1 --2- 172.21.15.5:0/2447061107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ba514e4d0 0x564ba5510900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:22.350 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.341+0000 7ff39b7fe640 1 -- 172.21.15.5:0/2447061107 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ba550bcf0 con 0x564ba516f1b0 2024-08-31T05:37:22.350 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.342+0000 7ff39b7fe640 1 --2- 172.21.15.5:0/2447061107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ba516f1b0 0x564ba5517d80 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7ff38c009f50 tx=0x7ff38c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6878063e9de57cf8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:22.350 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.342+0000 7ff380ff9640 1 -- 172.21.15.5:0/2447061107 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff38c00f070 con 0x564ba516f1b0 2024-08-31T05:37:22.350 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.342+0000 7ff380ff9640 1 -- 172.21.15.5:0/2447061107 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff38c018bb0 con 0x564ba516f1b0 2024-08-31T05:37:22.350 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.342+0000 7ff380ff9640 1 -- 172.21.15.5:0/2447061107 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff38c022e50 con 0x564ba516f1b0 2024-08-31T05:37:22.350 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.343+0000 7ff3a861f740 1 -- 172.21.15.5:0/2447061107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ba516f1b0 msgr2=0x564ba5517d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:22.350 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.343+0000 7ff3a861f740 1 --2- 172.21.15.5:0/2447061107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ba516f1b0 0x564ba5517d80 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7ff38c009f50 tx=0x7ff38c019000 comp rx=0 tx=0).stop 2024-08-31T05:37:22.350 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.343+0000 7ff3a861f740 1 -- 172.21.15.5:0/2447061107 shutdown_connections 2024-08-31T05:37:22.350 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.343+0000 7ff3a861f740 1 --2- 172.21.15.5:0/2447061107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ba516f1b0 0x564ba5517d80 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:22.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.343+0000 7ff3a861f740 1 --2- 172.21.15.5:0/2447061107 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ba514e4d0 0x564ba5510900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:22.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.343+0000 7ff3a861f740 1 --2- 172.21.15.5:0/2447061107 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ba51462f0 0x564ba55103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:22.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.343+0000 7ff3a861f740 1 -- 172.21.15.5:0/2447061107 >> 172.21.15.5:0/2447061107 conn(0x564ba5163300 msgr2=0x564ba551d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:22.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.343+0000 7ff3a861f740 1 -- 172.21.15.5:0/2447061107 shutdown_connections 2024-08-31T05:37:22.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.343+0000 7ff3a861f740 1 -- 172.21.15.5:0/2447061107 wait complete. 2024-08-31T05:37:22.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.343+0000 7ff3a861f740 1 -- start start 2024-08-31T05:37:22.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.343+0000 7ff3a861f740 1 Processor -- start 2024-08-31T05:37:22.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.344+0000 7ff3a861f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ba51462f0 0x564ba55260d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:22.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.344+0000 7ff3a861f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ba514e4d0 0x564ba55266b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:22.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.344+0000 7ff3a861f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ba516f1b0 0x564ba5593720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:22.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.344+0000 7ff3a861f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff3941647e0 con 0x564ba516f1b0 2024-08-31T05:37:22.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.344+0000 7ff3a861f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff394164110 con 0x564ba514e4d0 2024-08-31T05:37:22.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.344+0000 7ff3a861f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff3940a5150 con 0x564ba51462f0 2024-08-31T05:37:22.352 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.344+0000 7ff39affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ba51462f0 0x564ba55260d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:22.352 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.344+0000 7ff39affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ba51462f0 0x564ba55260d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:33230/0 (socket says 172.21.15.5:33230) 2024-08-31T05:37:22.352 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.344+0000 7ff39affd640 1 -- 172.21.15.5:0/3787401095 learned_addr learned my addr 172.21.15.5:0/3787401095 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:22.352 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.344+0000 7ff3a861f740 10 client.0 _ll_register_callbacks cb 0x7ff390009420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:37:22.352 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.344+0000 7ff39a7fc640 1 --2- 172.21.15.5:0/3787401095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ba514e4d0 0x564ba55266b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:22.352 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.344+0000 7ff39b7fe640 1 --2- 172.21.15.5:0/3787401095 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ba516f1b0 0x564ba5593720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:22.352 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.344+0000 7ff39affd640 1 -- 172.21.15.5:0/3787401095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ba514e4d0 msgr2=0x564ba55266b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:22.352 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.344+0000 7ff39affd640 1 --2- 172.21.15.5:0/3787401095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ba514e4d0 0x564ba55266b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:22.352 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.344+0000 7ff39affd640 1 -- 172.21.15.5:0/3787401095 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ba516f1b0 msgr2=0x564ba5593720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:22.352 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.344+0000 7ff39affd640 1 --2- 172.21.15.5:0/3787401095 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ba516f1b0 0x564ba5593720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:22.352 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.344+0000 7ff39affd640 1 -- 172.21.15.5:0/3787401095 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ba5510e40 con 0x564ba51462f0 2024-08-31T05:37:22.352 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.344+0000 7ff39b7fe640 1 --2- 172.21.15.5:0/3787401095 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ba516f1b0 0x564ba5593720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:37:22.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.344+0000 7ff39a7fc640 1 --2- 172.21.15.5:0/3787401095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ba514e4d0 0x564ba55266b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:37:22.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.345+0000 7ff39affd640 1 --2- 172.21.15.5:0/3787401095 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ba51462f0 0x564ba55260d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff39000efd0 tx=0x7ff390004250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f6b5e8c266d780 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:22.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.345+0000 7ff37eff5640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:37:22.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.345+0000 7ff37eff5640 1 -- 172.21.15.5:0/3787401095 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff39002c060 con 0x564ba51462f0 2024-08-31T05:37:22.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.345+0000 7ff37eff5640 1 -- 172.21.15.5:0/3787401095 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7ff390005b70 con 0x564ba51462f0 2024-08-31T05:37:22.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.345+0000 7ff3a861f740 1 -- 172.21.15.5:0/3787401095 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff38c018bb0 con 0x564ba51462f0 2024-08-31T05:37:22.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.345+0000 7ff37eff5640 1 -- 172.21.15.5:0/3787401095 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ff390033050 con 0x564ba51462f0 2024-08-31T05:37:22.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.345+0000 7ff3a861f740 10 client.27163 fetch_fsmap learned FSMap version 34 2024-08-31T05:37:22.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.345+0000 7ff3a861f740 1 -- 172.21.15.5:0/3787401095 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x564ba559af50 con 0x564ba51462f0 2024-08-31T05:37:22.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.345+0000 7ff37eff5640 1 -- 172.21.15.5:0/3787401095 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff38c018bb0 con 0x564ba51462f0 2024-08-31T05:37:22.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.345+0000 7ff37eff5640 1 -- 172.21.15.5:0/3787401095 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7ff3900128a0 con 0x564ba51462f0 2024-08-31T05:37:22.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.346+0000 7ff3a861f740 10 client.27163 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:37:22.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.346+0000 7ff3a861f740 10 client.27163 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:37:22.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.346+0000 7ff3a861f740 20 client.27163 populate_metadata read hostname 'smithi005' 2024-08-31T05:37:22.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.346+0000 7ff3a861f740 1 --2- 172.21.15.5:0/3787401095 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x564ba51031c0 0x564ba559d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:22.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.346+0000 7ff3a861f740 4 client.27163 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:37:22.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.346+0000 7ff3a861f740 1 -- 172.21.15.5:0/3787401095 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564ba54859f0 con 0x564ba51031c0 2024-08-31T05:37:22.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.346+0000 7ff39a7fc640 1 --2- 172.21.15.5:0/3787401095 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x564ba51031c0 0x564ba559d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:22.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.346+0000 7ff37eff5640 10 client.27163 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:37:22.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.346+0000 7ff39a7fc640 1 --2- 172.21.15.5:0/3787401095 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x564ba51031c0 0x564ba559d740 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44cb527d6dfd5df1 server_cookie=379c75ee2393dec9 in_seq=0 out_seq=0 2024-08-31T05:37:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.358+0000 7ff37eff5640 1 -- 172.21.15.5:0/3787401095 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564ba54859f0 con 0x564ba51031c0 2024-08-31T05:37:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.358+0000 7ff37eff5640 10 client.27163 handle_command_reply: tid=0 2024-08-31T05:37:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.358+0000 7ff3a861f740 1 client.27163 shutdown 2024-08-31T05:37:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.358+0000 7ff3a861f740 1 -- 172.21.15.5:0/3787401095 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ba51462f0 msgr2=0x564ba55260d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.358+0000 7ff3a861f740 1 --2- 172.21.15.5:0/3787401095 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ba51462f0 0x564ba55260d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff39000efd0 tx=0x7ff390004250 comp rx=0 tx=0).stop 2024-08-31T05:37:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.358+0000 7ff3a861f740 1 -- 172.21.15.5:0/3787401095 shutdown_connections 2024-08-31T05:37:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.358+0000 7ff3a861f740 1 --2- 172.21.15.5:0/3787401095 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x564ba51031c0 0x564ba559d740 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.358+0000 7ff3a861f740 1 --2- 172.21.15.5:0/3787401095 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ba516f1b0 0x564ba5593720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.358+0000 7ff37eff5640 0 client.27163 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:37:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.358+0000 7ff3a861f740 1 --2- 172.21.15.5:0/3787401095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ba514e4d0 0x564ba55266b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.358+0000 7ff3a861f740 1 --2- 172.21.15.5:0/3787401095 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ba51462f0 0x564ba55260d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.358+0000 7ff3a861f740 1 -- 172.21.15.5:0/3787401095 >> 172.21.15.5:0/3787401095 conn(0x564ba5163300 msgr2=0x564ba5519910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.358+0000 7ff3a861f740 1 -- 172.21.15.5:0/3787401095 shutdown_connections 2024-08-31T05:37:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.358+0000 7ff3a861f740 1 -- 172.21.15.5:0/3787401095 wait complete. 2024-08-31T05:37:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.358+0000 7ff3a861f740 20 client.27163 trim_cache size 0 max 16384 2024-08-31T05:37:22.362 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:37:22.362 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:37:22.362 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:37:22.362 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:37:22.363 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.359+0000 7ff39bfff640 1 -- 172.21.15.5:0/3348015180 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff3840b4eb0 msgr2=0x7ff3840b73c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:22.363 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.359+0000 7ff39bfff640 1 --2- 172.21.15.5:0/3348015180 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff3840b4eb0 0x7ff3840b73c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff38c009d30 tx=0x7ff38c009670 comp rx=0 tx=0).stop 2024-08-31T05:37:22.363 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.359+0000 7ff39bfff640 1 -- 172.21.15.5:0/3348015180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff39409a9a0 msgr2=0x7ff3940a3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:22.363 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.359+0000 7ff39bfff640 1 --2- 172.21.15.5:0/3348015180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff39409a9a0 0x7ff3940a3e50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff39c051f70 tx=0x7ff39c098d00 comp rx=0 tx=0).stop 2024-08-31T05:37:22.363 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.359+0000 7ff39bfff640 1 -- 172.21.15.5:0/3348015180 shutdown_connections 2024-08-31T05:37:22.363 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.359+0000 7ff39bfff640 1 --2- 172.21.15.5:0/3348015180 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff3840b4eb0 0x7ff3840b73c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:22.363 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.359+0000 7ff39bfff640 1 --2- 172.21.15.5:0/3348015180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff39409b2f0 0x7ff3940a4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:22.364 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.359+0000 7ff39bfff640 1 --2- 172.21.15.5:0/3348015180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff39409a9a0 0x7ff3940a3e50 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:22.364 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.359+0000 7ff39bfff640 1 --2- 172.21.15.5:0/3348015180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff394095070 0x7ff3940a7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:22.364 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.359+0000 7ff39bfff640 1 -- 172.21.15.5:0/3348015180 >> 172.21.15.5:0/3348015180 conn(0x7ff39400cd80 msgr2=0x7ff394093ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:22.364 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.359+0000 7ff39bfff640 1 -- 172.21.15.5:0/3348015180 shutdown_connections 2024-08-31T05:37:22.364 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:22.359+0000 7ff39bfff640 1 -- 172.21.15.5:0/3348015180 wait complete. 2024-08-31T05:37:22.927 INFO:tasks.workunit.client.0.smithi005.stdout: 1 831377 11.46 MB/sec execute 250 sec latency 55.948 ms 2024-08-31T05:37:23.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:37:23 smithi070 ceph-mon[22316]: pgmap v569: 129 pgs: 129 active+clean; 427 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.8 MiB/s wr, 226 op/s 2024-08-31T05:37:23.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:37:23 smithi070 ceph-mon[22316]: scrub summary: idle 2024-08-31T05:37:23.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:37:23 smithi070 ceph-mon[22316]: scrub summary: idle 2024-08-31T05:37:23.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:37:23 smithi050 ceph-mon[22146]: pgmap v569: 129 pgs: 129 active+clean; 427 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.8 MiB/s wr, 226 op/s 2024-08-31T05:37:23.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:37:23 smithi050 ceph-mon[22146]: scrub summary: idle 2024-08-31T05:37:23.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:37:23 smithi050 ceph-mon[22146]: scrub summary: idle 2024-08-31T05:37:23.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:37:23 smithi005 ceph-mon[18602]: pgmap v569: 129 pgs: 129 active+clean; 427 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.8 MiB/s wr, 226 op/s 2024-08-31T05:37:23.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:37:23 smithi005 ceph-mon[18602]: scrub summary: idle 2024-08-31T05:37:23.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:37:23 smithi005 ceph-mon[18602]: scrub summary: idle 2024-08-31T05:37:23.927 INFO:tasks.workunit.client.0.smithi005.stdout: 1 833766 11.46 MB/sec execute 251 sec latency 28.758 ms 2024-08-31T05:37:24.927 INFO:tasks.workunit.client.0.smithi005.stdout: 1 835728 11.46 MB/sec execute 252 sec latency 20.193 ms 2024-08-31T05:37:25.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:37:25 smithi070 ceph-mon[22316]: pgmap v570: 129 pgs: 129 active+clean; 428 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.8 MiB/s wr, 224 op/s 2024-08-31T05:37:25.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:37:25 smithi050 ceph-mon[22146]: pgmap v570: 129 pgs: 129 active+clean; 428 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.8 MiB/s wr, 224 op/s 2024-08-31T05:37:25.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:37:25 smithi005 ceph-mon[18602]: pgmap v570: 129 pgs: 129 active+clean; 428 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.8 MiB/s wr, 224 op/s 2024-08-31T05:37:25.927 INFO:tasks.workunit.client.0.smithi005.stdout: 1 838198 11.47 MB/sec execute 253 sec latency 17.879 ms 2024-08-31T05:37:26.927 INFO:tasks.workunit.client.0.smithi005.stdout: 1 839902 11.45 MB/sec execute 254 sec latency 28.095 ms 2024-08-31T05:37:27.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:37:27 smithi070 ceph-mon[22316]: pgmap v571: 129 pgs: 129 active+clean; 438 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.0 MiB/s wr, 234 op/s 2024-08-31T05:37:27.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:37:27 smithi050 ceph-mon[22146]: pgmap v571: 129 pgs: 129 active+clean; 438 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.0 MiB/s wr, 234 op/s 2024-08-31T05:37:27.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:37:27 smithi005 ceph-mon[18602]: pgmap v571: 129 pgs: 129 active+clean; 438 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.0 MiB/s wr, 234 op/s 2024-08-31T05:37:27.927 INFO:tasks.workunit.client.0.smithi005.stdout: 1 841915 11.46 MB/sec execute 255 sec latency 75.700 ms 2024-08-31T05:37:28.927 INFO:tasks.workunit.client.0.smithi005.stdout: 1 843010 11.44 MB/sec execute 256 sec latency 147.511 ms 2024-08-31T05:37:29.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:37:29 smithi070 ceph-mon[22316]: pgmap v572: 129 pgs: 129 active+clean; 438 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.7 MiB/s wr, 216 op/s 2024-08-31T05:37:29.656 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:37:29 smithi050 ceph-mon[22146]: pgmap v572: 129 pgs: 129 active+clean; 438 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.7 MiB/s wr, 216 op/s 2024-08-31T05:37:29.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:37:29 smithi005 ceph-mon[18602]: pgmap v572: 129 pgs: 129 active+clean; 438 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.7 MiB/s wr, 216 op/s 2024-08-31T05:37:29.927 INFO:tasks.workunit.client.0.smithi005.stdout: 1 845444 11.45 MB/sec execute 257 sec latency 129.534 ms 2024-08-31T05:37:30.927 INFO:tasks.workunit.client.0.smithi005.stdout: 1 847220 11.42 MB/sec execute 258 sec latency 37.383 ms 2024-08-31T05:37:31.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:37:31 smithi070 ceph-mon[22316]: pgmap v573: 129 pgs: 129 active+clean; 441 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.4 MiB/s wr, 243 op/s 2024-08-31T05:37:31.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:37:31 smithi050 ceph-mon[22146]: pgmap v573: 129 pgs: 129 active+clean; 441 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.4 MiB/s wr, 243 op/s 2024-08-31T05:37:31.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:37:31 smithi005 ceph-mon[18602]: pgmap v573: 129 pgs: 129 active+clean; 441 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.4 MiB/s wr, 243 op/s 2024-08-31T05:37:31.927 INFO:tasks.workunit.client.0.smithi005.stdout: 1 849431 11.43 MB/sec execute 259 sec latency 19.794 ms 2024-08-31T05:37:32.927 INFO:tasks.workunit.client.0.smithi005.stdout: 1 851153 11.42 MB/sec execute 260 sec latency 50.352 ms 2024-08-31T05:37:33.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:37:33 smithi070 ceph-mon[22316]: pgmap v574: 129 pgs: 129 active+clean; 446 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.5 MiB/s wr, 194 op/s 2024-08-31T05:37:33.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:37:33 smithi050 ceph-mon[22146]: pgmap v574: 129 pgs: 129 active+clean; 446 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.5 MiB/s wr, 194 op/s 2024-08-31T05:37:33.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:37:33 smithi005 ceph-mon[18602]: pgmap v574: 129 pgs: 129 active+clean; 446 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.5 MiB/s wr, 194 op/s 2024-08-31T05:37:33.927 INFO:tasks.workunit.client.0.smithi005.stdout: 1 853025 11.42 MB/sec execute 261 sec latency 18.124 ms 2024-08-31T05:37:34.927 INFO:tasks.workunit.client.0.smithi005.stdout: 1 855717 11.44 MB/sec execute 262 sec latency 20.524 ms 2024-08-31T05:37:35.469 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.467+0000 7fa0bccde640 1 -- 172.21.15.5:0/3089344890 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0b8102790 msgr2=0x7fa0b8102ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:35.470 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.467+0000 7fa0bccde640 1 --2- 172.21.15.5:0/3089344890 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0b8102790 0x7fa0b8102ba0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0009900 tx=0x7fa0b002a410 comp rx=0 tx=0).stop 2024-08-31T05:37:35.470 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.467+0000 7fa0bccde640 1 -- 172.21.15.5:0/3089344890 shutdown_connections 2024-08-31T05:37:35.470 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.467+0000 7fa0bccde640 1 --2- 172.21.15.5:0/3089344890 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0b8108a10 0x7fa0b810f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:35.470 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.467+0000 7fa0bccde640 1 --2- 172.21.15.5:0/3089344890 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0b81080c0 0x7fa0b81084d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:35.470 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.467+0000 7fa0bccde640 1 --2- 172.21.15.5:0/3089344890 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0b8102790 0x7fa0b8102ba0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:35.470 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.467+0000 7fa0bccde640 1 -- 172.21.15.5:0/3089344890 >> 172.21.15.5:0/3089344890 conn(0x7fa0b80fe150 msgr2=0x7fa0b81005c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:35.470 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.467+0000 7fa0bccde640 1 -- 172.21.15.5:0/3089344890 shutdown_connections 2024-08-31T05:37:35.470 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.467+0000 7fa0bccde640 1 -- 172.21.15.5:0/3089344890 wait complete. 2024-08-31T05:37:35.472 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.468+0000 7fa0bccde640 1 Processor -- start 2024-08-31T05:37:35.472 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.468+0000 7fa0bccde640 1 -- start start 2024-08-31T05:37:35.473 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.468+0000 7fa0bccde640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0b8102790 0x7fa0b819a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:35.473 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.468+0000 7fa0bccde640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0b81080c0 0x7fa0b819a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:35.473 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.468+0000 7fa0bccde640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0b8108a10 0x7fa0b819fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:35.473 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.468+0000 7fa0bccde640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b8112710 con 0x7fa0b81080c0 2024-08-31T05:37:35.473 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.468+0000 7fa0bccde640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b8112590 con 0x7fa0b8108a10 2024-08-31T05:37:35.473 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.468+0000 7fa0bccde640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b8112890 con 0x7fa0b8102790 2024-08-31T05:37:35.473 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.468+0000 7fa0b5d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0b81080c0 0x7fa0b819a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:35.473 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.468+0000 7fa0b659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0b8102790 0x7fa0b819a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:35.473 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.468+0000 7fa0b5d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0b81080c0 0x7fa0b819a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60170/0 (socket says 172.21.15.5:60170) 2024-08-31T05:37:35.473 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.468+0000 7fa0b5d9b640 1 -- 172.21.15.5:0/3679098020 learned_addr learned my addr 172.21.15.5:0/3679098020 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:35.473 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.469+0000 7fa0b6d9d640 1 --2- 172.21.15.5:0/3679098020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0b8108a10 0x7fa0b819fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:35.473 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.469+0000 7fa0b659c640 1 -- 172.21.15.5:0/3679098020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0b8108a10 msgr2=0x7fa0b819fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:35.473 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.469+0000 7fa0b659c640 1 --2- 172.21.15.5:0/3679098020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0b8108a10 0x7fa0b819fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:35.474 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.469+0000 7fa0b659c640 1 -- 172.21.15.5:0/3679098020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0b81080c0 msgr2=0x7fa0b819a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:35.474 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.469+0000 7fa0b659c640 1 --2- 172.21.15.5:0/3679098020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0b81080c0 0x7fa0b819a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:35.474 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.469+0000 7fa0b659c640 1 -- 172.21.15.5:0/3679098020 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0b81a0130 con 0x7fa0b8102790 2024-08-31T05:37:35.474 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.469+0000 7fa0b5d9b640 1 --2- 172.21.15.5:0/3679098020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0b81080c0 0x7fa0b819a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:37:35.474 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.469+0000 7fa0b6d9d640 1 --2- 172.21.15.5:0/3679098020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0b8108a10 0x7fa0b819fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:37:35.474 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.469+0000 7fa0b659c640 1 --2- 172.21.15.5:0/3679098020 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0b8102790 0x7fa0b819a200 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa0b002aa00 tx=0x7fa0b0003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:35.474 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.469+0000 7fa0af7fe640 1 -- 172.21.15.5:0/3679098020 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b003f070 con 0x7fa0b8102790 2024-08-31T05:37:35.474 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.469+0000 7fa0af7fe640 1 -- 172.21.15.5:0/3679098020 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0b0031b50 con 0x7fa0b8102790 2024-08-31T05:37:35.474 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.469+0000 7fa0bccde640 1 -- 172.21.15.5:0/3679098020 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0b81a03c0 con 0x7fa0b8102790 2024-08-31T05:37:35.474 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.469+0000 7fa0af7fe640 1 -- 172.21.15.5:0/3679098020 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b0035030 con 0x7fa0b8102790 2024-08-31T05:37:35.474 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.470+0000 7fa0bccde640 1 -- 172.21.15.5:0/3679098020 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0b81a6bb0 con 0x7fa0b8102790 2024-08-31T05:37:35.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.472+0000 7fa0c3c53740 1 Processor -- start 2024-08-31T05:37:35.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.472+0000 7fa0c3c53740 1 -- start start 2024-08-31T05:37:35.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.472+0000 7fa0af7fe640 1 -- 172.21.15.5:0/3679098020 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fa0b0042070 con 0x7fa0b8102790 2024-08-31T05:37:35.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.472+0000 7fa0c3c53740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5559c4e3a1b0 0x5559c51ddac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:35.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.472+0000 7fa0c3c53740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5559c4e112f0 0x5559c51de000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:35.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.472+0000 7fa0c3c53740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5559c4e194d0 0x5559c51de540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:35.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.472+0000 7fa0c3c53740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5559c5153000 con 0x5559c4e112f0 2024-08-31T05:37:35.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.472+0000 7fa0c3c53740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5559c5142590 con 0x5559c4e3a1b0 2024-08-31T05:37:35.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.472+0000 7fa0c3c53740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5559c5146540 con 0x5559c4e194d0 2024-08-31T05:37:35.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.473+0000 7fa0b6d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5559c4e3a1b0 0x5559c51ddac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:35.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.473+0000 7fa0b659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5559c4e112f0 0x5559c51de000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:35.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.473+0000 7fa0b6d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5559c4e3a1b0 0x5559c51ddac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:59458/0 (socket says 172.21.15.5:59458) 2024-08-31T05:37:35.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.473+0000 7fa0b5d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5559c4e194d0 0x5559c51de540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:35.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.473+0000 7fa0b6d9d640 1 -- 172.21.15.5:0/4189492917 learned_addr learned my addr 172.21.15.5:0/4189492917 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:35.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.473+0000 7fa0b6d9d640 1 -- 172.21.15.5:0/4189492917 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5559c4e194d0 msgr2=0x5559c51de540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.473+0000 7fa0b6d9d640 1 --2- 172.21.15.5:0/4189492917 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5559c4e194d0 0x5559c51de540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.473+0000 7fa0b6d9d640 1 -- 172.21.15.5:0/4189492917 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5559c4e112f0 msgr2=0x5559c51de000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.473+0000 7fa0b6d9d640 1 --2- 172.21.15.5:0/4189492917 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5559c4e112f0 0x5559c51de000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.473+0000 7fa0b6d9d640 1 -- 172.21.15.5:0/4189492917 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559c4ea5790 con 0x5559c4e3a1b0 2024-08-31T05:37:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.473+0000 7fa0b6d9d640 1 --2- 172.21.15.5:0/4189492917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5559c4e3a1b0 0x5559c51ddac0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8011810 tx=0x7fa0a8011c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95a72126c848ef53 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.473+0000 7fa0af7fe640 1 --2- 172.21.15.5:0/3679098020 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa0a40b4ca0 0x7fa0a40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.473+0000 7fa0acff9640 1 -- 172.21.15.5:0/4189492917 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a8011e60 con 0x5559c4e3a1b0 2024-08-31T05:37:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.473+0000 7fa0acff9640 1 -- 172.21.15.5:0/4189492917 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0a8011310 con 0x5559c4e3a1b0 2024-08-31T05:37:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.473+0000 7fa0acff9640 1 -- 172.21.15.5:0/4189492917 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a80043b0 con 0x5559c4e3a1b0 2024-08-31T05:37:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.473+0000 7fa0b659c640 1 --2- 172.21.15.5:0/3679098020 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa0a40b4ca0 0x7fa0a40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.474+0000 7fa0af7fe640 1 -- 172.21.15.5:0/3679098020 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7fa0b0105e40 con 0x7fa0b8102790 2024-08-31T05:37:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.474+0000 7fa0c3c53740 1 -- 172.21.15.5:0/4189492917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5559c4e3a1b0 msgr2=0x5559c51ddac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.474+0000 7fa0b659c640 1 --2- 172.21.15.5:0/3679098020 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa0a40b4ca0 0x7fa0a40b71b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0103260 tx=0x7fa0b0109990 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.474+0000 7fa0c3c53740 1 --2- 172.21.15.5:0/4189492917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5559c4e3a1b0 0x5559c51ddac0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8011810 tx=0x7fa0a8011c10 comp rx=0 tx=0).stop 2024-08-31T05:37:35.482 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.474+0000 7fa0c3c53740 1 -- 172.21.15.5:0/4189492917 shutdown_connections 2024-08-31T05:37:35.482 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.474+0000 7fa0c3c53740 1 --2- 172.21.15.5:0/4189492917 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5559c4e194d0 0x5559c51de540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:35.482 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.474+0000 7fa0c3c53740 1 --2- 172.21.15.5:0/4189492917 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5559c4e112f0 0x5559c51de000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:35.482 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.474+0000 7fa0c3c53740 1 --2- 172.21.15.5:0/4189492917 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5559c4e3a1b0 0x5559c51ddac0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:35.482 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.474+0000 7fa0c3c53740 1 -- 172.21.15.5:0/4189492917 >> 172.21.15.5:0/4189492917 conn(0x5559c4e2e300 msgr2=0x5559c51db9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:35.482 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.475+0000 7fa0c3c53740 1 -- 172.21.15.5:0/4189492917 shutdown_connections 2024-08-31T05:37:35.482 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.475+0000 7fa0c3c53740 1 -- 172.21.15.5:0/4189492917 wait complete. 2024-08-31T05:37:35.482 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.475+0000 7fa0c3c53740 1 -- start start 2024-08-31T05:37:35.482 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.475+0000 7fa0c3c53740 1 Processor -- start 2024-08-31T05:37:35.482 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.475+0000 7fa0c3c53740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5559c4e112f0 0x5559c51e9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:35.482 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.475+0000 7fa0c3c53740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5559c4e194d0 0x5559c51e9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:35.482 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.475+0000 7fa0c3c53740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5559c4e3a1b0 0x5559c51f5590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:35.482 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.475+0000 7fa0c3c53740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5559c507bab0 con 0x5559c4e112f0 2024-08-31T05:37:35.482 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.475+0000 7fa0c3c53740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5559c50c9680 con 0x5559c4e3a1b0 2024-08-31T05:37:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.475+0000 7fa0c3c53740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5559c51ec240 con 0x5559c4e194d0 2024-08-31T05:37:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.475+0000 7fa0c3c53740 10 client.0 _ll_register_callbacks cb 0x5559c4e51a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:37:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.476+0000 7fa0b6d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5559c4e112f0 0x5559c51e9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.476+0000 7fa0b6d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5559c4e112f0 0x5559c51e9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60180/0 (socket says 172.21.15.5:60180) 2024-08-31T05:37:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.476+0000 7fa0b6d9d640 1 -- 172.21.15.5:0/106332158 learned_addr learned my addr 172.21.15.5:0/106332158 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.476+0000 7fa0b6d9d640 1 --2- 172.21.15.5:0/106332158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5559c4e3a1b0 0x5559c51f5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.476+0000 7fa0b6d9d640 1 -- 172.21.15.5:0/106332158 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5559c4e194d0 msgr2=0x5559c51e9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.476+0000 7fa0b6d9d640 1 --2- 172.21.15.5:0/106332158 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5559c4e194d0 0x5559c51e9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.476+0000 7fa0b6d9d640 1 -- 172.21.15.5:0/106332158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5559c4e3a1b0 msgr2=0x5559c51f5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.476+0000 7fa0b6d9d640 1 --2- 172.21.15.5:0/106332158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5559c4e3a1b0 0x5559c51f5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.476+0000 7fa0b6d9d640 1 -- 172.21.15.5:0/106332158 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559c4f1e620 con 0x5559c4e112f0 2024-08-31T05:37:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.476+0000 7fa0b6d9d640 1 --2- 172.21.15.5:0/106332158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5559c4e112f0 0x5559c51e9700 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8014040 tx=0x7fa0a800fea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f986d8cba1eee10f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.476+0000 7fa09dffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:37:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.476+0000 7fa09dffb640 1 -- 172.21.15.5:0/106332158 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a8011e60 con 0x5559c4e112f0 2024-08-31T05:37:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.476+0000 7fa0c3c53740 1 -- 172.21.15.5:0/106332158 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0a8011310 con 0x5559c4e112f0 2024-08-31T05:37:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.476+0000 7fa09dffb640 1 -- 172.21.15.5:0/106332158 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7fa0a8004c50 con 0x5559c4e112f0 2024-08-31T05:37:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.477+0000 7fa09dffb640 1 -- 172.21.15.5:0/106332158 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fa0a8033050 con 0x5559c4e112f0 2024-08-31T05:37:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.477+0000 7fa0c3c53740 10 client.17592 fetch_fsmap learned FSMap version 34 2024-08-31T05:37:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.477+0000 7fa0c3c53740 1 -- 172.21.15.5:0/106332158 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5559c51f8330 con 0x5559c4e112f0 2024-08-31T05:37:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.477+0000 7fa09dffb640 1 -- 172.21.15.5:0/106332158 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0a8011310 con 0x5559c4e112f0 2024-08-31T05:37:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.477+0000 7fa09dffb640 1 -- 172.21.15.5:0/106332158 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fa0a8018020 con 0x5559c4e112f0 2024-08-31T05:37:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.477+0000 7fa0c3c53740 10 client.17592 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:37:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.477+0000 7fa0c3c53740 10 client.17592 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:37:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.477+0000 7fa0c3c53740 20 client.17592 populate_metadata read hostname 'smithi005' 2024-08-31T05:37:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.477+0000 7fa0c3c53740 1 --2- 172.21.15.5:0/106332158 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5559c4df8d80 0x5559c51fb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.477+0000 7fa0c3c53740 4 client.17592 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:37:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.477+0000 7fa0c3c53740 1 -- 172.21.15.5:0/106332158 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5559c5154f50 con 0x5559c4df8d80 2024-08-31T05:37:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.477+0000 7fa0b5d9b640 1 --2- 172.21.15.5:0/106332158 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5559c4df8d80 0x5559c51fb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.478+0000 7fa09dffb640 10 client.17592 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:37:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.478+0000 7fa0b5d9b640 1 --2- 172.21.15.5:0/106332158 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5559c4df8d80 0x5559c51fb770 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d1ab81015ea05c7 server_cookie=8b16873c3bb9258e in_seq=0 out_seq=0 2024-08-31T05:37:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.479+0000 7fa09dffb640 1 -- 172.21.15.5:0/106332158 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5559c5154f50 con 0x5559c4df8d80 2024-08-31T05:37:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.479+0000 7fa09dffb640 10 client.17592 handle_command_reply: tid=0 2024-08-31T05:37:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.479+0000 7fa0c3c53740 1 client.17592 shutdown 2024-08-31T05:37:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.479+0000 7fa0c3c53740 1 -- 172.21.15.5:0/106332158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5559c4e112f0 msgr2=0x5559c51e9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.479+0000 7fa0c3c53740 1 --2- 172.21.15.5:0/106332158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5559c4e112f0 0x5559c51e9700 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8014040 tx=0x7fa0a800fea0 comp rx=0 tx=0).stop 2024-08-31T05:37:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.479+0000 7fa0c3c53740 1 -- 172.21.15.5:0/106332158 shutdown_connections 2024-08-31T05:37:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.479+0000 7fa0c3c53740 1 --2- 172.21.15.5:0/106332158 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5559c4df8d80 0x5559c51fb770 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:35.487 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.479+0000 7fa0c3c53740 1 --2- 172.21.15.5:0/106332158 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5559c4e3a1b0 0x5559c51f5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:35.487 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.479+0000 7fa09dffb640 0 client.17592 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:37:35.487 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.479+0000 7fa0c3c53740 1 --2- 172.21.15.5:0/106332158 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5559c4e194d0 0x5559c51e9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:35.487 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.479+0000 7fa0c3c53740 1 --2- 172.21.15.5:0/106332158 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5559c4e112f0 0x5559c51e9700 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:35.487 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.479+0000 7fa0c3c53740 1 -- 172.21.15.5:0/106332158 >> 172.21.15.5:0/106332158 conn(0x5559c4e2e300 msgr2=0x5559c51deaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:35.487 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.479+0000 7fa0c3c53740 1 -- 172.21.15.5:0/106332158 shutdown_connections 2024-08-31T05:37:35.487 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.479+0000 7fa0c3c53740 1 -- 172.21.15.5:0/106332158 wait complete. 2024-08-31T05:37:35.487 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.479+0000 7fa0c3c53740 20 client.17592 trim_cache size 0 max 16384 2024-08-31T05:37:35.498 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.496+0000 7fa0c3c53740 1 Processor -- start 2024-08-31T05:37:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.496+0000 7fa0c3c53740 1 -- start start 2024-08-31T05:37:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.496+0000 7fa0c3c53740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5559c4df8d80 0x5559c51e2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.496+0000 7fa0c3c53740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5559c4e112f0 0x5559c51e3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.496+0000 7fa0c3c53740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5559c4e194d0 0x5559c51e66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.496+0000 7fa0c3c53740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b81b0d40 con 0x5559c4e194d0 2024-08-31T05:37:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.496+0000 7fa0c3c53740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b81b2880 con 0x5559c4df8d80 2024-08-31T05:37:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.496+0000 7fa0c3c53740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b81b1410 con 0x5559c4e112f0 2024-08-31T05:37:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.496+0000 7fa0b5d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5559c4e112f0 0x5559c51e3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.496+0000 7fa0b6d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5559c4df8d80 0x5559c51e2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.496+0000 7fa0b5d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5559c4e112f0 0x5559c51e3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:38094/0 (socket says 172.21.15.5:38094) 2024-08-31T05:37:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.496+0000 7fa0b6d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5559c4df8d80 0x5559c51e2bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:59472/0 (socket says 172.21.15.5:59472) 2024-08-31T05:37:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.496+0000 7fa0b5d9b640 1 -- 172.21.15.5:0/2038455815 learned_addr learned my addr 172.21.15.5:0/2038455815 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.497+0000 7fa0b6d9d640 1 --2- 172.21.15.5:0/2038455815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5559c4e194d0 0x5559c51e66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.497+0000 7fa0b5d9b640 1 -- 172.21.15.5:0/2038455815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5559c4df8d80 msgr2=0x5559c51e2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.497+0000 7fa0b5d9b640 1 --2- 172.21.15.5:0/2038455815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5559c4df8d80 0x5559c51e2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.497+0000 7fa0b5d9b640 1 -- 172.21.15.5:0/2038455815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5559c4e194d0 msgr2=0x5559c51e66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.497+0000 7fa0b5d9b640 1 --2- 172.21.15.5:0/2038455815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5559c4e194d0 0x5559c51e66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.497+0000 7fa0b5d9b640 1 -- 172.21.15.5:0/2038455815 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559c51df9a0 con 0x5559c4e112f0 2024-08-31T05:37:35.502 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.497+0000 7fa0b5d9b640 1 --2- 172.21.15.5:0/2038455815 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5559c4e112f0 0x5559c51e3130 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0012370 tx=0x7fa0a0004410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f063ae83ff21c6df server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:35.502 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.497+0000 7fa09ffff640 1 -- 172.21.15.5:0/2038455815 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a0021070 con 0x5559c4e112f0 2024-08-31T05:37:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.497+0000 7fa09ffff640 1 -- 172.21.15.5:0/2038455815 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0a0013e40 con 0x5559c4e112f0 2024-08-31T05:37:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.497+0000 7fa09ffff640 1 -- 172.21.15.5:0/2038455815 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a001f800 con 0x5559c4e112f0 2024-08-31T05:37:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.498+0000 7fa0c3c53740 1 -- 172.21.15.5:0/2038455815 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5559c4e112f0 msgr2=0x5559c51e3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.498+0000 7fa0c3c53740 1 --2- 172.21.15.5:0/2038455815 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5559c4e112f0 0x5559c51e3130 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0012370 tx=0x7fa0a0004410 comp rx=0 tx=0).stop 2024-08-31T05:37:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.498+0000 7fa0c3c53740 1 -- 172.21.15.5:0/2038455815 shutdown_connections 2024-08-31T05:37:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.498+0000 7fa0c3c53740 1 --2- 172.21.15.5:0/2038455815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5559c4e194d0 0x5559c51e66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.498+0000 7fa0c3c53740 1 --2- 172.21.15.5:0/2038455815 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5559c4e112f0 0x5559c51e3130 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.498+0000 7fa0c3c53740 1 --2- 172.21.15.5:0/2038455815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5559c4df8d80 0x5559c51e2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.498+0000 7fa0c3c53740 1 -- 172.21.15.5:0/2038455815 >> 172.21.15.5:0/2038455815 conn(0x5559c4e2e300 msgr2=0x5559c51e7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.498+0000 7fa0c3c53740 1 -- 172.21.15.5:0/2038455815 shutdown_connections 2024-08-31T05:37:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.498+0000 7fa0c3c53740 1 -- 172.21.15.5:0/2038455815 wait complete. 2024-08-31T05:37:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.499+0000 7fa0c3c53740 1 -- start start 2024-08-31T05:37:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.499+0000 7fa0c3c53740 1 Processor -- start 2024-08-31T05:37:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.499+0000 7fa0c3c53740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5559c4df8d80 0x5559c51ef050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.499+0000 7fa0c3c53740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5559c4e112f0 0x5559c51ef630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.499+0000 7fa0c3c53740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5559c4e194d0 0x5559c525e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.499+0000 7fa0c3c53740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b81b21b0 con 0x5559c4e194d0 2024-08-31T05:37:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.499+0000 7fa0c3c53740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b81b1ae0 con 0x5559c4df8d80 2024-08-31T05:37:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.499+0000 7fa0c3c53740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b81aed40 con 0x5559c4e112f0 2024-08-31T05:37:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.499+0000 7fa0c3c53740 10 client.0 _ll_register_callbacks cb 0x7fa0b0109860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:37:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.499+0000 7fa0b6d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5559c4e194d0 0x5559c525e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.499+0000 7fa0b6d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5559c4e194d0 0x5559c525e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60198/0 (socket says 172.21.15.5:60198) 2024-08-31T05:37:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.499+0000 7fa0b6d9d640 1 -- 172.21.15.5:0/3450143110 learned_addr learned my addr 172.21.15.5:0/3450143110 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.499+0000 7fa0b5d9b640 1 --2- 172.21.15.5:0/3450143110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5559c4e112f0 0x5559c51ef630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.499+0000 7fa0b6d9d640 1 --2- 172.21.15.5:0/3450143110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5559c4df8d80 0x5559c51ef050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.500+0000 7fa0b6d9d640 1 -- 172.21.15.5:0/3450143110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5559c4e112f0 msgr2=0x5559c51ef630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.500+0000 7fa0b6d9d640 1 --2- 172.21.15.5:0/3450143110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5559c4e112f0 0x5559c51ef630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.500+0000 7fa0b6d9d640 1 -- 172.21.15.5:0/3450143110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5559c4df8d80 msgr2=0x5559c51ef050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.500+0000 7fa0b6d9d640 1 --2- 172.21.15.5:0/3450143110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5559c4df8d80 0x5559c51ef050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.500+0000 7fa0b6d9d640 1 -- 172.21.15.5:0/3450143110 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559c525e990 con 0x5559c4e194d0 2024-08-31T05:37:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.500+0000 7fa0b6d9d640 1 --2- 172.21.15.5:0/3450143110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5559c4e194d0 0x5559c525e2f0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8004710 tx=0x7fa0a800fea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f320a9c37e53e889 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.500+0000 7fa09dffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:37:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.500+0000 7fa09dffb640 1 -- 172.21.15.5:0/3450143110 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a8011200 con 0x5559c4e194d0 2024-08-31T05:37:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.500+0000 7fa09dffb640 1 -- 172.21.15.5:0/3450143110 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7fa0a8030040 con 0x5559c4e194d0 2024-08-31T05:37:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.500+0000 7fa0c3c53740 1 -- 172.21.15.5:0/3450143110 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5559c51509f0 con 0x5559c4e194d0 2024-08-31T05:37:35.506 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.501+0000 7fa09dffb640 1 -- 172.21.15.5:0/3450143110 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fa0a804a050 con 0x5559c4e194d0 2024-08-31T05:37:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.501+0000 7fa0c3c53740 10 client.17598 fetch_fsmap learned FSMap version 34 2024-08-31T05:37:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.501+0000 7fa0c3c53740 1 -- 172.21.15.5:0/3450143110 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5559c526a190 con 0x5559c4e194d0 2024-08-31T05:37:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.501+0000 7fa09dffb640 1 -- 172.21.15.5:0/3450143110 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5559c51509f0 con 0x5559c4e194d0 2024-08-31T05:37:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.502+0000 7fa09dffb640 1 -- 172.21.15.5:0/3450143110 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fa0a8018070 con 0x5559c4e194d0 2024-08-31T05:37:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.502+0000 7fa0c3c53740 10 client.17598 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:37:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.502+0000 7fa0c3c53740 10 client.17598 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:37:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.502+0000 7fa0c3c53740 20 client.17598 populate_metadata read hostname 'smithi005' 2024-08-31T05:37:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.502+0000 7fa0c3c53740 1 --2- 172.21.15.5:0/3450143110 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5559c4e3a1b0 0x5559c526c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.502+0000 7fa0c3c53740 4 client.17598 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:37:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.502+0000 7fa0c3c53740 1 -- 172.21.15.5:0/3450143110 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5559c514e130 con 0x5559c4e3a1b0 2024-08-31T05:37:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.502+0000 7fa0b5d9b640 1 --2- 172.21.15.5:0/3450143110 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5559c4e3a1b0 0x5559c526c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.502+0000 7fa09dffb640 10 client.17598 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:37:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.502+0000 7fa0b5d9b640 1 --2- 172.21.15.5:0/3450143110 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5559c4e3a1b0 0x5559c526c870 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65d20277e5fca19 server_cookie=b0744a4603a20c6c in_seq=0 out_seq=0 2024-08-31T05:37:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.514+0000 7fa09dffb640 1 -- 172.21.15.5:0/3450143110 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5559c514e130 con 0x5559c4e3a1b0 2024-08-31T05:37:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.514+0000 7fa09dffb640 10 client.17598 handle_command_reply: tid=0 2024-08-31T05:37:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.514+0000 7fa0c3c53740 1 client.17598 shutdown 2024-08-31T05:37:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.514+0000 7fa0c3c53740 1 -- 172.21.15.5:0/3450143110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5559c4e194d0 msgr2=0x5559c525e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.514+0000 7fa0c3c53740 1 --2- 172.21.15.5:0/3450143110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5559c4e194d0 0x5559c525e2f0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8004710 tx=0x7fa0a800fea0 comp rx=0 tx=0).stop 2024-08-31T05:37:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.514+0000 7fa0c3c53740 1 -- 172.21.15.5:0/3450143110 shutdown_connections 2024-08-31T05:37:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.514+0000 7fa0c3c53740 1 --2- 172.21.15.5:0/3450143110 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5559c4e3a1b0 0x5559c526c870 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.514+0000 7fa0c3c53740 1 --2- 172.21.15.5:0/3450143110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5559c4e194d0 0x5559c525e2f0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.514+0000 7fa0c3c53740 1 --2- 172.21.15.5:0/3450143110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5559c4e112f0 0x5559c51ef630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.514+0000 7fa09dffb640 0 client.17598 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:37:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.514+0000 7fa0c3c53740 1 --2- 172.21.15.5:0/3450143110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5559c4df8d80 0x5559c51ef050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.514+0000 7fa0c3c53740 1 -- 172.21.15.5:0/3450143110 >> 172.21.15.5:0/3450143110 conn(0x5559c4e2e300 msgr2=0x5559c51e7920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.514+0000 7fa0c3c53740 1 -- 172.21.15.5:0/3450143110 shutdown_connections 2024-08-31T05:37:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.514+0000 7fa0c3c53740 1 -- 172.21.15.5:0/3450143110 wait complete. 2024-08-31T05:37:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.514+0000 7fa0c3c53740 20 client.17598 trim_cache size 0 max 16384 2024-08-31T05:37:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:37:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:37:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:37:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:37:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.515+0000 7fa0bccde640 1 -- 172.21.15.5:0/3679098020 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa0a40b4ca0 msgr2=0x7fa0a40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.515+0000 7fa0bccde640 1 --2- 172.21.15.5:0/3679098020 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa0a40b4ca0 0x7fa0a40b71b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0103260 tx=0x7fa0b0109990 comp rx=0 tx=0).stop 2024-08-31T05:37:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.515+0000 7fa0bccde640 1 -- 172.21.15.5:0/3679098020 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0b8102790 msgr2=0x7fa0b819a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.515+0000 7fa0bccde640 1 --2- 172.21.15.5:0/3679098020 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0b8102790 0x7fa0b819a200 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa0b002aa00 tx=0x7fa0b0003b90 comp rx=0 tx=0).stop 2024-08-31T05:37:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.515+0000 7fa0bccde640 1 -- 172.21.15.5:0/3679098020 shutdown_connections 2024-08-31T05:37:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.515+0000 7fa0bccde640 1 --2- 172.21.15.5:0/3679098020 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa0a40b4ca0 0x7fa0a40b71b0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.515+0000 7fa0bccde640 1 --2- 172.21.15.5:0/3679098020 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0b8108a10 0x7fa0b819fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.515+0000 7fa0bccde640 1 --2- 172.21.15.5:0/3679098020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0b81080c0 0x7fa0b819a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.515+0000 7fa0bccde640 1 --2- 172.21.15.5:0/3679098020 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0b8102790 0x7fa0b819a200 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.515+0000 7fa0bccde640 1 -- 172.21.15.5:0/3679098020 >> 172.21.15.5:0/3679098020 conn(0x7fa0b80fe150 msgr2=0x7fa0b806bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.515+0000 7fa0bccde640 1 -- 172.21.15.5:0/3679098020 shutdown_connections 2024-08-31T05:37:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:35.515+0000 7fa0bccde640 1 -- 172.21.15.5:0/3679098020 wait complete. 2024-08-31T05:37:35.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:37:35 smithi070 ceph-mon[22316]: pgmap v575: 129 pgs: 129 active+clean; 445 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.5 MiB/s wr, 195 op/s 2024-08-31T05:37:35.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:37:35 smithi050 ceph-mon[22146]: pgmap v575: 129 pgs: 129 active+clean; 445 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.5 MiB/s wr, 195 op/s 2024-08-31T05:37:35.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:37:35 smithi005 ceph-mon[18602]: pgmap v575: 129 pgs: 129 active+clean; 445 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.5 MiB/s wr, 195 op/s 2024-08-31T05:37:35.927 INFO:tasks.workunit.client.0.smithi005.stdout: 1 857226 11.42 MB/sec execute 263 sec latency 30.386 ms 2024-08-31T05:37:36.928 INFO:tasks.workunit.client.0.smithi005.stdout: 1 859647 11.43 MB/sec execute 264 sec latency 13.812 ms 2024-08-31T05:37:37.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:37:37 smithi070 ceph-mon[22316]: pgmap v576: 129 pgs: 129 active+clean; 453 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.8 MiB/s wr, 263 op/s 2024-08-31T05:37:37.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:37:37 smithi050 ceph-mon[22146]: pgmap v576: 129 pgs: 129 active+clean; 453 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.8 MiB/s wr, 263 op/s 2024-08-31T05:37:37.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:37:37 smithi005 ceph-mon[18602]: pgmap v576: 129 pgs: 129 active+clean; 453 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.8 MiB/s wr, 263 op/s 2024-08-31T05:37:37.928 INFO:tasks.workunit.client.0.smithi005.stdout: 1 860898 11.41 MB/sec execute 265 sec latency 146.542 ms 2024-08-31T05:37:38.928 INFO:tasks.workunit.client.0.smithi005.stdout: 1 863222 11.42 MB/sec execute 266 sec latency 27.125 ms 2024-08-31T05:37:39.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:37:39 smithi070 ceph-mon[22316]: pgmap v577: 129 pgs: 129 active+clean; 453 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.3 MiB/s wr, 182 op/s 2024-08-31T05:37:39.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:37:39 smithi050 ceph-mon[22146]: pgmap v577: 129 pgs: 129 active+clean; 453 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.3 MiB/s wr, 182 op/s 2024-08-31T05:37:39.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:37:39 smithi005 ceph-mon[18602]: pgmap v577: 129 pgs: 129 active+clean; 453 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.3 MiB/s wr, 182 op/s 2024-08-31T05:37:39.928 INFO:tasks.workunit.client.0.smithi005.stdout: 1 865492 11.42 MB/sec execute 267 sec latency 27.740 ms 2024-08-31T05:37:40.928 INFO:tasks.workunit.client.0.smithi005.stdout: 1 867216 11.41 MB/sec execute 268 sec latency 48.104 ms 2024-08-31T05:37:41.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:37:40 smithi050 ceph-mon[22146]: pgmap v578: 129 pgs: 129 active+clean; 460 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.4 MiB/s wr, 254 op/s 2024-08-31T05:37:41.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:37:40 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:37:41.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:37:40 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:37:41.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:37:40 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:37:41.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:37:40 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:37:41.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:37:40 smithi005 ceph-mon[18602]: pgmap v578: 129 pgs: 129 active+clean; 460 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.4 MiB/s wr, 254 op/s 2024-08-31T05:37:41.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:37:40 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:37:41.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:37:40 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:37:41.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:37:40 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:37:41.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:37:40 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:37:41.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:37:40 smithi070 ceph-mon[22316]: pgmap v578: 129 pgs: 129 active+clean; 460 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.4 MiB/s wr, 254 op/s 2024-08-31T05:37:41.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:37:40 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:37:41.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:37:40 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:37:41.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:37:40 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:37:41.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:37:40 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:37:41.928 INFO:tasks.workunit.client.0.smithi005.stdout: 1 869290 11.41 MB/sec execute 269 sec latency 67.904 ms 2024-08-31T05:37:42.928 INFO:tasks.workunit.client.0.smithi005.stdout: 1 870779 11.39 MB/sec execute 270 sec latency 96.851 ms 2024-08-31T05:37:43.138 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:37:42 smithi070 ceph-mon[22316]: pgmap v579: 129 pgs: 129 active+clean; 461 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.3 MiB/s wr, 199 op/s 2024-08-31T05:37:43.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:37:42 smithi050 ceph-mon[22146]: pgmap v579: 129 pgs: 129 active+clean; 461 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.3 MiB/s wr, 199 op/s 2024-08-31T05:37:43.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:37:42 smithi005 ceph-mon[18602]: pgmap v579: 129 pgs: 129 active+clean; 461 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.3 MiB/s wr, 199 op/s 2024-08-31T05:37:43.928 INFO:tasks.workunit.client.0.smithi005.stdout: 1 873193 11.40 MB/sec execute 271 sec latency 16.896 ms 2024-08-31T05:37:44.928 INFO:tasks.workunit.client.0.smithi005.stdout: 1 874878 11.40 MB/sec execute 272 sec latency 29.173 ms 2024-08-31T05:37:45.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:37:44 smithi050 ceph-mon[22146]: pgmap v580: 129 pgs: 129 active+clean; 465 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.3 MiB/s wr, 205 op/s 2024-08-31T05:37:45.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:37:44 smithi005 ceph-mon[18602]: pgmap v580: 129 pgs: 129 active+clean; 465 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.3 MiB/s wr, 205 op/s 2024-08-31T05:37:45.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:37:44 smithi070 ceph-mon[22316]: pgmap v580: 129 pgs: 129 active+clean; 465 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.3 MiB/s wr, 205 op/s 2024-08-31T05:37:45.928 INFO:tasks.workunit.client.0.smithi005.stdout: 1 876936 11.40 MB/sec execute 273 sec latency 233.784 ms 2024-08-31T05:37:46.928 INFO:tasks.workunit.client.0.smithi005.stdout: 1 878622 11.38 MB/sec execute 274 sec latency 16.367 ms 2024-08-31T05:37:47.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:37:46 smithi050 ceph-mon[22146]: pgmap v581: 129 pgs: 129 active+clean; 470 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.5 MiB/s wr, 263 op/s 2024-08-31T05:37:47.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:37:46 smithi005 ceph-mon[18602]: pgmap v581: 129 pgs: 129 active+clean; 470 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.5 MiB/s wr, 263 op/s 2024-08-31T05:37:47.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:37:46 smithi070 ceph-mon[22316]: pgmap v581: 129 pgs: 129 active+clean; 470 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.5 MiB/s wr, 263 op/s 2024-08-31T05:37:47.390 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T05:37:47.668 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:37:47.928 INFO:tasks.workunit.client.0.smithi005.stdout: 1 880847 11.39 MB/sec execute 275 sec latency 64.699 ms 2024-08-31T05:37:48.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.303+0000 7ff10e5c0640 1 -- 172.21.15.5:0/3227865021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff108109240 msgr2=0x7ff108109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:48.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.303+0000 7ff10e5c0640 1 --2- 172.21.15.5:0/3227865021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff108109240 0x7ff108109650 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0009900 tx=0x7ff0f002a410 comp rx=0 tx=0).stop 2024-08-31T05:37:48.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.303+0000 7ff10e5c0640 1 -- 172.21.15.5:0/3227865021 shutdown_connections 2024-08-31T05:37:48.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.303+0000 7ff10e5c0640 1 --2- 172.21.15.5:0/3227865021 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff108109b90 0x7ff1081103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.303+0000 7ff10e5c0640 1 --2- 172.21.15.5:0/3227865021 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff108109240 0x7ff108109650 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.303+0000 7ff10e5c0640 1 --2- 172.21.15.5:0/3227865021 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff108103900 0x7ff108103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.303+0000 7ff10e5c0640 1 -- 172.21.15.5:0/3227865021 >> 172.21.15.5:0/3227865021 conn(0x7ff10807b5f0 msgr2=0x7ff10807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:48.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.303+0000 7ff10e5c0640 1 -- 172.21.15.5:0/3227865021 shutdown_connections 2024-08-31T05:37:48.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.303+0000 7ff10e5c0640 1 -- 172.21.15.5:0/3227865021 wait complete. 2024-08-31T05:37:48.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.304+0000 7ff10e5c0640 1 Processor -- start 2024-08-31T05:37:48.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.304+0000 7ff10e5c0640 1 -- start start 2024-08-31T05:37:48.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.305+0000 7ff10e5c0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff108103900 0x7ff10819c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:48.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.305+0000 7ff10e5c0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff108109240 0x7ff10819c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:48.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.305+0000 7ff10e5c0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff108109b90 0x7ff1081a1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:48.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.305+0000 7ff10e5c0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff108115a70 con 0x7ff108103900 2024-08-31T05:37:48.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.305+0000 7ff10e5c0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff1081158f0 con 0x7ff108109b90 2024-08-31T05:37:48.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.305+0000 7ff10e5c0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff108115bf0 con 0x7ff108109240 2024-08-31T05:37:48.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.305+0000 7ff107fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff108103900 0x7ff10819c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:48.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.305+0000 7ff107fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff108103900 0x7ff10819c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49472/0 (socket says 172.21.15.5:49472) 2024-08-31T05:37:48.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.305+0000 7ff107fff640 1 -- 172.21.15.5:0/3995828969 learned_addr learned my addr 172.21.15.5:0/3995828969 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:48.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.305+0000 7ff0ff7fe640 1 --2- 172.21.15.5:0/3995828969 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff108109240 0x7ff10819c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:48.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.305+0000 7ff10cb5d640 1 --2- 172.21.15.5:0/3995828969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff108109b90 0x7ff1081a1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:48.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.305+0000 7ff107fff640 1 -- 172.21.15.5:0/3995828969 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff108109240 msgr2=0x7ff10819c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:48.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.305+0000 7ff107fff640 1 --2- 172.21.15.5:0/3995828969 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff108109240 0x7ff10819c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.305+0000 7ff107fff640 1 -- 172.21.15.5:0/3995828969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff108109b90 msgr2=0x7ff1081a1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:48.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.305+0000 7ff107fff640 1 --2- 172.21.15.5:0/3995828969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff108109b90 0x7ff1081a1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.305+0000 7ff107fff640 1 -- 172.21.15.5:0/3995828969 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1081a23b0 con 0x7ff108103900 2024-08-31T05:37:48.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.306+0000 7ff107fff640 1 --2- 172.21.15.5:0/3995828969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff108103900 0x7ff10819c440 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7ff0f800ebc0 tx=0x7ff0f800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:48.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.306+0000 7ff105ffb640 1 -- 172.21.15.5:0/3995828969 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f8010630 con 0x7ff108103900 2024-08-31T05:37:48.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.306+0000 7ff105ffb640 1 -- 172.21.15.5:0/3995828969 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff0f8010c80 con 0x7ff108103900 2024-08-31T05:37:48.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.306+0000 7ff10e5c0640 1 -- 172.21.15.5:0/3995828969 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1081a26a0 con 0x7ff108103900 2024-08-31T05:37:48.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.306+0000 7ff105ffb640 1 -- 172.21.15.5:0/3995828969 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f8018b60 con 0x7ff108103900 2024-08-31T05:37:48.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.306+0000 7ff10e5c0640 1 -- 172.21.15.5:0/3995828969 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1081a8e00 con 0x7ff108103900 2024-08-31T05:37:48.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.309+0000 7ff114b35740 1 Processor -- start 2024-08-31T05:37:48.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.309+0000 7ff105ffb640 1 -- 172.21.15.5:0/3995828969 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7ff0f8018d00 con 0x7ff108103900 2024-08-31T05:37:48.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.309+0000 7ff114b35740 1 -- start start 2024-08-31T05:37:48.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.309+0000 7ff114b35740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bfec6be070 0x55bfeca632c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:48.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.309+0000 7ff114b35740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bfec6951b0 0x55bfeca63800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:48.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.309+0000 7ff114b35740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bfec69d390 0x55bfeca63d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:48.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.309+0000 7ff114b35740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55bfec9da630 con 0x55bfec6be070 2024-08-31T05:37:48.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.309+0000 7ff114b35740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55bfec9c9bc0 con 0x55bfec69d390 2024-08-31T05:37:48.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.309+0000 7ff114b35740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55bfec9cdb70 con 0x55bfec6951b0 2024-08-31T05:37:48.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.310+0000 7ff10cb5d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bfec6be070 0x55bfeca632c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:48.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.310+0000 7ff10cb5d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bfec6be070 0x55bfeca632c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49476/0 (socket says 172.21.15.5:49476) 2024-08-31T05:37:48.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.310+0000 7ff10cb5d640 1 -- 172.21.15.5:0/1824991824 learned_addr learned my addr 172.21.15.5:0/1824991824 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:48.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.310+0000 7ff0ff7fe640 1 --2- 172.21.15.5:0/1824991824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bfec69d390 0x55bfeca63d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:48.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.310+0000 7ff107fff640 1 --2- 172.21.15.5:0/1824991824 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bfec6951b0 0x55bfeca63800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:48.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.310+0000 7ff10cb5d640 1 -- 172.21.15.5:0/1824991824 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bfec6951b0 msgr2=0x55bfeca63800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:48.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.310+0000 7ff10cb5d640 1 --2- 172.21.15.5:0/1824991824 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bfec6951b0 0x55bfeca63800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.310+0000 7ff10cb5d640 1 -- 172.21.15.5:0/1824991824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bfec69d390 msgr2=0x55bfeca63d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:48.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.310+0000 7ff10cb5d640 1 --2- 172.21.15.5:0/1824991824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bfec69d390 0x55bfeca63d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.310+0000 7ff10cb5d640 1 -- 172.21.15.5:0/1824991824 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfec729650 con 0x55bfec6be070 2024-08-31T05:37:48.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.310+0000 7ff0ff7fe640 1 --2- 172.21.15.5:0/1824991824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bfec69d390 0x55bfeca63d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:37:48.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.310+0000 7ff105ffb640 1 --2- 172.21.15.5:0/3995828969 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff0f40b4d20 0x7ff0f40b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:48.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.310+0000 7ff10cb5d640 1 --2- 172.21.15.5:0/1824991824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bfec6be070 0x55bfeca632c0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7ff100009ca0 tx=0x7ff100011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd3dab3b627654b7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:48.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.310+0000 7ff107fff640 1 --2- 172.21.15.5:0/3995828969 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff0f40b4d20 0x7ff0f40b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:48.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.310+0000 7ff0fe7fc640 1 -- 172.21.15.5:0/1824991824 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff10001e070 con 0x55bfec6be070 2024-08-31T05:37:48.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.311+0000 7ff0fe7fc640 1 -- 172.21.15.5:0/1824991824 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff100009e50 con 0x55bfec6be070 2024-08-31T05:37:48.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.311+0000 7ff0fe7fc640 1 -- 172.21.15.5:0/1824991824 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff10000ea10 con 0x55bfec6be070 2024-08-31T05:37:48.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.311+0000 7ff105ffb640 1 -- 172.21.15.5:0/3995828969 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7ff0f80e5ea0 con 0x7ff108103900 2024-08-31T05:37:48.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.311+0000 7ff114b35740 1 -- 172.21.15.5:0/1824991824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bfec6be070 msgr2=0x55bfeca632c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:48.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.311+0000 7ff114b35740 1 --2- 172.21.15.5:0/1824991824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bfec6be070 0x55bfeca632c0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7ff100009ca0 tx=0x7ff100011810 comp rx=0 tx=0).stop 2024-08-31T05:37:48.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.311+0000 7ff107fff640 1 --2- 172.21.15.5:0/3995828969 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff0f40b4d20 0x7ff0f40b7230 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff0f80e32c0 tx=0x7ff0f80eb040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:48.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.312+0000 7ff114b35740 1 -- 172.21.15.5:0/1824991824 shutdown_connections 2024-08-31T05:37:48.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.312+0000 7ff114b35740 1 --2- 172.21.15.5:0/1824991824 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bfec69d390 0x55bfeca63d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.312+0000 7ff114b35740 1 --2- 172.21.15.5:0/1824991824 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bfec6951b0 0x55bfeca63800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.312+0000 7ff114b35740 1 --2- 172.21.15.5:0/1824991824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bfec6be070 0x55bfeca632c0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.312+0000 7ff114b35740 1 -- 172.21.15.5:0/1824991824 >> 172.21.15.5:0/1824991824 conn(0x55bfec6b2460 msgr2=0x55bfeca611b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:48.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.312+0000 7ff114b35740 1 -- 172.21.15.5:0/1824991824 shutdown_connections 2024-08-31T05:37:48.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.312+0000 7ff114b35740 1 -- 172.21.15.5:0/1824991824 wait complete. 2024-08-31T05:37:48.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.312+0000 7ff114b35740 1 -- start start 2024-08-31T05:37:48.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.312+0000 7ff114b35740 1 Processor -- start 2024-08-31T05:37:48.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.313+0000 7ff114b35740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bfec6951b0 0x55bfeca6eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:48.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.313+0000 7ff114b35740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bfec69d390 0x55bfeca6f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:48.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.313+0000 7ff114b35740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bfec6be070 0x55bfeca835a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:48.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.313+0000 7ff114b35740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55bfec82c700 con 0x55bfec6be070 2024-08-31T05:37:48.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.313+0000 7ff114b35740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55bfec950700 con 0x55bfec69d390 2024-08-31T05:37:48.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.313+0000 7ff114b35740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55bfeca71aa0 con 0x55bfec6951b0 2024-08-31T05:37:48.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.313+0000 7ff114b35740 10 client.0 _ll_register_callbacks cb 0x55bfec97fdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:37:48.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.313+0000 7ff10cb5d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bfec6be070 0x55bfeca835a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:48.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.313+0000 7ff0ff7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bfec69d390 0x55bfeca6f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:48.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.313+0000 7ff10cb5d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bfec6be070 0x55bfeca835a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49492/0 (socket says 172.21.15.5:49492) 2024-08-31T05:37:48.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.313+0000 7ff10cb5d640 1 -- 172.21.15.5:0/1954221740 learned_addr learned my addr 172.21.15.5:0/1954221740 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:48.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.313+0000 7ff10cb5d640 1 --2- 172.21.15.5:0/1954221740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bfec6951b0 0x55bfeca6eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:48.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.313+0000 7ff0ff7fe640 1 -- 172.21.15.5:0/1954221740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bfec6951b0 msgr2=0x55bfeca6eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:48.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.313+0000 7ff0ff7fe640 1 --2- 172.21.15.5:0/1954221740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bfec6951b0 0x55bfeca6eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.313+0000 7ff0ff7fe640 1 -- 172.21.15.5:0/1954221740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bfec6be070 msgr2=0x55bfeca835a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:48.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.313+0000 7ff0ff7fe640 1 --2- 172.21.15.5:0/1954221740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bfec6be070 0x55bfeca835a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.313+0000 7ff0ff7fe640 1 -- 172.21.15.5:0/1954221740 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bfec9898b0 con 0x55bfec69d390 2024-08-31T05:37:48.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.313+0000 7ff10cb5d640 1 --2- 172.21.15.5:0/1954221740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bfec6be070 0x55bfeca835a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:37:48.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.314+0000 7ff0ff7fe640 1 --2- 172.21.15.5:0/1954221740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bfec69d390 0x55bfeca6f0c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff0f002a930 tx=0x7ff0f0032e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d6eaf7925ca4577 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:48.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.314+0000 7ff0e77fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:37:48.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.314+0000 7ff0e77fe640 1 -- 172.21.15.5:0/1954221740 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f0035040 con 0x55bfec69d390 2024-08-31T05:37:48.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.314+0000 7ff114b35740 1 -- 172.21.15.5:0/1954221740 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff100009e50 con 0x55bfec69d390 2024-08-31T05:37:48.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.314+0000 7ff0e77fe640 1 -- 172.21.15.5:0/1954221740 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7ff0f0031760 con 0x55bfec69d390 2024-08-31T05:37:48.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.314+0000 7ff0e77fe640 1 -- 172.21.15.5:0/1954221740 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ff0f004f050 con 0x55bfec69d390 2024-08-31T05:37:48.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.314+0000 7ff114b35740 10 client.27191 fetch_fsmap learned FSMap version 34 2024-08-31T05:37:48.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.314+0000 7ff114b35740 1 -- 172.21.15.5:0/1954221740 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55bfeca861a0 con 0x55bfec69d390 2024-08-31T05:37:48.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.314+0000 7ff0e77fe640 1 -- 172.21.15.5:0/1954221740 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff100009e50 con 0x55bfec69d390 2024-08-31T05:37:48.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.315+0000 7ff0e77fe640 1 -- 172.21.15.5:0/1954221740 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7ff0f0004750 con 0x55bfec69d390 2024-08-31T05:37:48.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.315+0000 7ff114b35740 10 client.27191 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:37:48.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.315+0000 7ff114b35740 10 client.27191 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:37:48.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.315+0000 7ff114b35740 20 client.27191 populate_metadata read hostname 'smithi005' 2024-08-31T05:37:48.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.315+0000 7ff114b35740 1 --2- 172.21.15.5:0/1954221740 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55bfec67c9f0 0x55bfeca89610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:48.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.315+0000 7ff114b35740 4 client.27191 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:37:48.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.315+0000 7ff114b35740 1 -- 172.21.15.5:0/1954221740 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bfec9dc580 con 0x55bfec67c9f0 2024-08-31T05:37:48.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.315+0000 7ff10cb5d640 1 --2- 172.21.15.5:0/1954221740 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55bfec67c9f0 0x55bfeca89610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:48.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.315+0000 7ff0e77fe640 10 client.27191 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:37:48.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.316+0000 7ff10cb5d640 1 --2- 172.21.15.5:0/1954221740 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55bfec67c9f0 0x55bfeca89610 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=990cd11cccb8b1eb server_cookie=14b71cfb30c36a1a in_seq=0 out_seq=0 2024-08-31T05:37:48.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.317+0000 7ff0e77fe640 1 -- 172.21.15.5:0/1954221740 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bfec9dc580 con 0x55bfec67c9f0 2024-08-31T05:37:48.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.317+0000 7ff0e77fe640 10 client.27191 handle_command_reply: tid=0 2024-08-31T05:37:48.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.317+0000 7ff114b35740 1 client.27191 shutdown 2024-08-31T05:37:48.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.317+0000 7ff114b35740 1 -- 172.21.15.5:0/1954221740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bfec69d390 msgr2=0x55bfeca6f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:48.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.317+0000 7ff114b35740 1 --2- 172.21.15.5:0/1954221740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bfec69d390 0x55bfeca6f0c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff0f002a930 tx=0x7ff0f0032e90 comp rx=0 tx=0).stop 2024-08-31T05:37:48.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.317+0000 7ff114b35740 1 -- 172.21.15.5:0/1954221740 shutdown_connections 2024-08-31T05:37:48.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.317+0000 7ff114b35740 1 --2- 172.21.15.5:0/1954221740 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55bfec67c9f0 0x55bfeca89610 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.317+0000 7ff114b35740 1 --2- 172.21.15.5:0/1954221740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bfec6be070 0x55bfeca835a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.317+0000 7ff114b35740 1 --2- 172.21.15.5:0/1954221740 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bfec69d390 0x55bfeca6f0c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.317+0000 7ff0e77fe640 0 client.27191 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:37:48.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.317+0000 7ff114b35740 1 --2- 172.21.15.5:0/1954221740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bfec6951b0 0x55bfeca6eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.317+0000 7ff114b35740 1 -- 172.21.15.5:0/1954221740 >> 172.21.15.5:0/1954221740 conn(0x55bfec6b2460 msgr2=0x55bfeca664a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:48.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.317+0000 7ff114b35740 1 -- 172.21.15.5:0/1954221740 shutdown_connections 2024-08-31T05:37:48.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.317+0000 7ff114b35740 1 -- 172.21.15.5:0/1954221740 wait complete. 2024-08-31T05:37:48.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.317+0000 7ff114b35740 20 client.27191 trim_cache size 0 max 16384 2024-08-31T05:37:48.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.338+0000 7ff114b35740 1 Processor -- start 2024-08-31T05:37:48.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.338+0000 7ff114b35740 1 -- start start 2024-08-31T05:37:48.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.339+0000 7ff114b35740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bfec6951b0 0x55bfeca70730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:48.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.339+0000 7ff114b35740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bfec69d390 0x55bfeca83520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:48.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.339+0000 7ff114b35740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bfec6be070 0x55bfeca83a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:48.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.339+0000 7ff114b35740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff1081aeb40 con 0x55bfec6be070 2024-08-31T05:37:48.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.339+0000 7ff114b35740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff1081b0680 con 0x55bfec69d390 2024-08-31T05:37:48.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.339+0000 7ff114b35740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff1081af210 con 0x55bfec6951b0 2024-08-31T05:37:48.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.339+0000 7ff10cb5d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bfec6be070 0x55bfeca83a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:48.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.339+0000 7ff10cb5d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bfec6be070 0x55bfeca83a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49508/0 (socket says 172.21.15.5:49508) 2024-08-31T05:37:48.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.339+0000 7ff10cb5d640 1 -- 172.21.15.5:0/3973194412 learned_addr learned my addr 172.21.15.5:0/3973194412 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:48.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.339+0000 7ff0ff7fe640 1 --2- 172.21.15.5:0/3973194412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bfec69d390 0x55bfeca83520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:48.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.339+0000 7ff10cb5d640 1 --2- 172.21.15.5:0/3973194412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bfec6951b0 0x55bfeca70730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:48.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.339+0000 7ff10cb5d640 1 -- 172.21.15.5:0/3973194412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bfec6951b0 msgr2=0x55bfeca70730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:48.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.339+0000 7ff10cb5d640 1 --2- 172.21.15.5:0/3973194412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bfec6951b0 0x55bfeca70730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.339+0000 7ff10cb5d640 1 -- 172.21.15.5:0/3973194412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bfec69d390 msgr2=0x55bfeca83520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:48.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.339+0000 7ff10cb5d640 1 --2- 172.21.15.5:0/3973194412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bfec69d390 0x55bfeca83520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.339+0000 7ff10cb5d640 1 -- 172.21.15.5:0/3973194412 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfeca6fdc0 con 0x55bfec6be070 2024-08-31T05:37:48.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.339+0000 7ff0ff7fe640 1 --2- 172.21.15.5:0/3973194412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bfec69d390 0x55bfeca83520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:37:48.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.339+0000 7ff10cb5d640 1 --2- 172.21.15.5:0/3973194412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bfec6be070 0x55bfeca83a60 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7ff10000e520 tx=0x7ff100005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd90965448bc8828 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:48.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.340+0000 7ff0fdffb640 1 -- 172.21.15.5:0/3973194412 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff10001e040 con 0x55bfec6be070 2024-08-31T05:37:48.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.340+0000 7ff0fdffb640 1 -- 172.21.15.5:0/3973194412 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff10001f040 con 0x55bfec6be070 2024-08-31T05:37:48.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.340+0000 7ff0fdffb640 1 -- 172.21.15.5:0/3973194412 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff100003a10 con 0x55bfec6be070 2024-08-31T05:37:48.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.340+0000 7ff114b35740 1 -- 172.21.15.5:0/3973194412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bfec6be070 msgr2=0x55bfeca83a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:48.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.340+0000 7ff114b35740 1 --2- 172.21.15.5:0/3973194412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bfec6be070 0x55bfeca83a60 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7ff10000e520 tx=0x7ff100005f90 comp rx=0 tx=0).stop 2024-08-31T05:37:48.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.341+0000 7ff114b35740 1 -- 172.21.15.5:0/3973194412 shutdown_connections 2024-08-31T05:37:48.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.341+0000 7ff114b35740 1 --2- 172.21.15.5:0/3973194412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bfec6be070 0x55bfeca83a60 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.341+0000 7ff114b35740 1 --2- 172.21.15.5:0/3973194412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bfec69d390 0x55bfeca83520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.341+0000 7ff114b35740 1 --2- 172.21.15.5:0/3973194412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bfec6951b0 0x55bfeca70730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.341+0000 7ff114b35740 1 -- 172.21.15.5:0/3973194412 >> 172.21.15.5:0/3973194412 conn(0x55bfec6b2460 msgr2=0x55bfeca70020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:48.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.341+0000 7ff114b35740 1 -- 172.21.15.5:0/3973194412 shutdown_connections 2024-08-31T05:37:48.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.341+0000 7ff114b35740 1 -- 172.21.15.5:0/3973194412 wait complete. 2024-08-31T05:37:48.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.341+0000 7ff114b35740 1 -- start start 2024-08-31T05:37:48.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.341+0000 7ff114b35740 1 Processor -- start 2024-08-31T05:37:48.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.342+0000 7ff114b35740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bfec6951b0 0x55bfeca7b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:48.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.342+0000 7ff114b35740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bfec69d390 0x55bfeca7ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:48.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.342+0000 7ff114b35740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bfec6be070 0x55bfeca7bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:48.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.342+0000 7ff114b35740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff1081affb0 con 0x55bfec6be070 2024-08-31T05:37:48.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.342+0000 7ff114b35740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff1081af8e0 con 0x55bfec69d390 2024-08-31T05:37:48.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.342+0000 7ff114b35740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff1081acb40 con 0x55bfec6951b0 2024-08-31T05:37:48.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.342+0000 7ff114b35740 10 client.0 _ll_register_callbacks cb 0x7ff0f0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:37:48.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.342+0000 7ff10cb5d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bfec6be070 0x55bfeca7bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:48.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.342+0000 7ff0ff7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bfec69d390 0x55bfeca7ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:48.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.342+0000 7ff10cb5d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bfec6be070 0x55bfeca7bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49512/0 (socket says 172.21.15.5:49512) 2024-08-31T05:37:48.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.342+0000 7ff10cb5d640 1 -- 172.21.15.5:0/3769911252 learned_addr learned my addr 172.21.15.5:0/3769911252 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:48.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.342+0000 7ff10cb5d640 1 --2- 172.21.15.5:0/3769911252 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bfec6951b0 0x55bfeca7b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:48.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.342+0000 7ff0ff7fe640 1 -- 172.21.15.5:0/3769911252 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bfec6951b0 msgr2=0x55bfeca7b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:48.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.342+0000 7ff0ff7fe640 1 --2- 172.21.15.5:0/3769911252 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bfec6951b0 0x55bfeca7b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.342+0000 7ff0ff7fe640 1 -- 172.21.15.5:0/3769911252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bfec6be070 msgr2=0x55bfeca7bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:48.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.342+0000 7ff0ff7fe640 1 --2- 172.21.15.5:0/3769911252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bfec6be070 0x55bfeca7bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.342+0000 7ff0ff7fe640 1 -- 172.21.15.5:0/3769911252 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bfecaf2fb0 con 0x55bfec69d390 2024-08-31T05:37:48.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.342+0000 7ff10cb5d640 1 --2- 172.21.15.5:0/3769911252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bfec6be070 0x55bfeca7bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:37:48.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.342+0000 7ff0ff7fe640 1 --2- 172.21.15.5:0/3769911252 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bfec69d390 0x55bfeca7ba20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff0f00096c0 tx=0x7ff0f00048f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6fb9bce05782c05 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:48.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.342+0000 7ff0e77fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:37:48.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.342+0000 7ff0e77fe640 1 -- 172.21.15.5:0/3769911252 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f0058060 con 0x55bfec69d390 2024-08-31T05:37:48.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.342+0000 7ff0e77fe640 1 -- 172.21.15.5:0/3769911252 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7ff0f00055f0 con 0x55bfec69d390 2024-08-31T05:37:48.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.343+0000 7ff114b35740 1 -- 172.21.15.5:0/3769911252 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff10001f040 con 0x55bfec69d390 2024-08-31T05:37:48.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.343+0000 7ff0e77fe640 1 -- 172.21.15.5:0/3769911252 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ff0f005f050 con 0x55bfec69d390 2024-08-31T05:37:48.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.343+0000 7ff114b35740 10 client.27197 fetch_fsmap learned FSMap version 34 2024-08-31T05:37:48.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.343+0000 7ff114b35740 1 -- 172.21.15.5:0/3769911252 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55bfecaf41d0 con 0x55bfec69d390 2024-08-31T05:37:48.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.343+0000 7ff0e77fe640 1 -- 172.21.15.5:0/3769911252 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff10001f040 con 0x55bfec69d390 2024-08-31T05:37:48.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.343+0000 7ff0e77fe640 1 -- 172.21.15.5:0/3769911252 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7ff0f0004140 con 0x55bfec69d390 2024-08-31T05:37:48.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.343+0000 7ff114b35740 10 client.27197 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:37:48.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.343+0000 7ff114b35740 10 client.27197 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:37:48.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.343+0000 7ff114b35740 20 client.27197 populate_metadata read hostname 'smithi005' 2024-08-31T05:37:48.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.343+0000 7ff114b35740 1 --2- 172.21.15.5:0/3769911252 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55bfec651da0 0x55bfecaf6930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:48.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.343+0000 7ff114b35740 4 client.27197 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T05:37:48.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.343+0000 7ff114b35740 1 -- 172.21.15.5:0/3769911252 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55bfec9d8020 con 0x55bfec651da0 2024-08-31T05:37:48.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.343+0000 7ff10cb5d640 1 --2- 172.21.15.5:0/3769911252 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55bfec651da0 0x55bfecaf6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:48.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.344+0000 7ff10cb5d640 1 --2- 172.21.15.5:0/3769911252 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55bfec651da0 0x55bfecaf6930 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=481ec2ae9684e284 server_cookie=b1fa2f24787411cd in_seq=0 out_seq=0 2024-08-31T05:37:48.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.344+0000 7ff0e77fe640 10 client.27197 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:37:48.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.344+0000 7ff0e77fe640 1 -- 172.21.15.5:0/3769911252 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2930 (crc 0 0 0) 0x55bfec9d8020 con 0x55bfec651da0 2024-08-31T05:37:48.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.344+0000 7ff0e77fe640 10 client.27197 handle_command_reply: tid=0 2024-08-31T05:37:48.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.344+0000 7ff114b35740 1 client.27197 shutdown 2024-08-31T05:37:48.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.344+0000 7ff114b35740 1 -- 172.21.15.5:0/3769911252 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bfec69d390 msgr2=0x55bfeca7ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:48.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.344+0000 7ff114b35740 1 --2- 172.21.15.5:0/3769911252 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bfec69d390 0x55bfeca7ba20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff0f00096c0 tx=0x7ff0f00048f0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.344+0000 7ff114b35740 1 -- 172.21.15.5:0/3769911252 shutdown_connections 2024-08-31T05:37:48.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.344+0000 7ff114b35740 1 --2- 172.21.15.5:0/3769911252 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55bfec651da0 0x55bfecaf6930 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.344+0000 7ff114b35740 1 --2- 172.21.15.5:0/3769911252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55bfec6be070 0x55bfeca7bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.344+0000 7ff114b35740 1 --2- 172.21.15.5:0/3769911252 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55bfec69d390 0x55bfeca7ba20 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.344+0000 7ff114b35740 1 --2- 172.21.15.5:0/3769911252 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bfec6951b0 0x55bfeca7b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.344+0000 7ff0e77fe640 0 client.27197 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:37:48.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.344+0000 7ff114b35740 1 -- 172.21.15.5:0/3769911252 >> 172.21.15.5:0/3769911252 conn(0x55bfec6b2460 msgr2=0x55bfeca66b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:48.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.345+0000 7ff114b35740 1 -- 172.21.15.5:0/3769911252 shutdown_connections 2024-08-31T05:37:48.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.345+0000 7ff114b35740 1 -- 172.21.15.5:0/3769911252 wait complete. 2024-08-31T05:37:48.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.345+0000 7ff114b35740 20 client.27197 trim_cache size 0 max 16384 2024-08-31T05:37:48.352 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:37:48.352 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "no active scrubs running", 2024-08-31T05:37:48.352 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": {}, 2024-08-31T05:37:48.352 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_stats": { 2024-08-31T05:37:48.352 INFO:teuthology.orchestra.run.smithi005.stdout: "94c23057-592d-4a8b-82d7-da2d84f8740b": { 2024-08-31T05:37:48.352 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:36:27.513638+0000", 2024-08-31T05:37:48.352 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:37:48.352 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:37:48.352 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:37:48.353 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:37:48.353 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:37:48.353 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:37:48.353 INFO:teuthology.orchestra.run.smithi005.stdout: "095ccc7a-f368-4bc6-9563-5930e21f9b4a": { 2024-08-31T05:37:48.353 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:35:40.190069+0000", 2024-08-31T05:37:48.353 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:37:48.353 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:37:48.353 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:37:48.353 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:37:48.353 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:37:48.353 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:37:48.353 INFO:teuthology.orchestra.run.smithi005.stdout: "297c26f3-7b4d-4245-abb0-f854248e5e1b": { 2024-08-31T05:37:48.353 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:37:14.019244+0000", 2024-08-31T05:37:48.354 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:37:48.354 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:37:48.354 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:37:48.354 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:37:48.354 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:37:48.354 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:37:48.354 INFO:teuthology.orchestra.run.smithi005.stdout: "de9731c7-ae4a-42fe-8146-e4752cdc40d4": { 2024-08-31T05:37:48.354 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:34:53.614499+0000", 2024-08-31T05:37:48.354 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:37:48.354 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:37:48.354 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:37:48.356 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:37:48.356 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:37:48.356 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:37:48.356 INFO:teuthology.orchestra.run.smithi005.stdout: "0bb67292-013a-40c7-b5fc-810bdd9715d8": { 2024-08-31T05:37:48.356 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:34:04.586008+0000", 2024-08-31T05:37:48.356 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:37:48.356 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:37:48.356 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:37:48.356 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:37:48.356 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:37:48.356 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:37:48.356 INFO:teuthology.orchestra.run.smithi005.stdout: "728a42ca-bbef-4151-830f-5fdd411d8fa0": { 2024-08-31T05:37:48.356 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:32:30.554906+0000", 2024-08-31T05:37:48.357 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:37:48.357 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:37:48.357 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:37:48.357 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:37:48.357 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:37:48.357 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:37:48.357 INFO:teuthology.orchestra.run.smithi005.stdout: "2445fc42-b797-434f-b380-e2da985b4d98": { 2024-08-31T05:37:48.357 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:33:17.681453+0000", 2024-08-31T05:37:48.357 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:37:48.357 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:37:48.357 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:37:48.357 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:37:48.357 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:37:48.358 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:37:48.358 INFO:teuthology.orchestra.run.smithi005.stdout: "cda92ac0-b35f-47a5-a3a5-471c888462a5": { 2024-08-31T05:37:48.358 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:53.103905+0000", 2024-08-31T05:37:48.358 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:37:48.358 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:37:48.358 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:37:48.358 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:37:48.358 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:37:48.358 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:37:48.358 INFO:teuthology.orchestra.run.smithi005.stdout: "ece37b07-9ab2-45f8-bc33-2755a07aac0b": { 2024-08-31T05:37:48.358 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:31:41.782407+0000", 2024-08-31T05:37:48.358 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:37:48.358 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:37:48.358 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:37:48.359 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:37:48.359 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:37:48.359 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:37:48.359 INFO:teuthology.orchestra.run.smithi005.stdout: "75d84398-5d9c-4872-b879-2fbce045fa71": { 2024-08-31T05:37:48.359 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:06.642335+0000", 2024-08-31T05:37:48.359 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:37:48.359 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:37:48.359 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:37:48.359 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:37:48.359 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:37:48.359 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:37:48.359 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:37:48.359 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:37:48.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.345+0000 7ff10e5c0640 1 -- 172.21.15.5:0/3995828969 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff0f40b4d20 msgr2=0x7ff0f40b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:48.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.345+0000 7ff10e5c0640 1 --2- 172.21.15.5:0/3995828969 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff0f40b4d20 0x7ff0f40b7230 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff0f80e32c0 tx=0x7ff0f80eb040 comp rx=0 tx=0).stop 2024-08-31T05:37:48.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.345+0000 7ff10e5c0640 1 -- 172.21.15.5:0/3995828969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff108103900 msgr2=0x7ff10819c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:48.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.345+0000 7ff10e5c0640 1 --2- 172.21.15.5:0/3995828969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff108103900 0x7ff10819c440 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7ff0f800ebc0 tx=0x7ff0f800c6a0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.345+0000 7ff10e5c0640 1 -- 172.21.15.5:0/3995828969 shutdown_connections 2024-08-31T05:37:48.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.345+0000 7ff10e5c0640 1 --2- 172.21.15.5:0/3995828969 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff0f40b4d20 0x7ff0f40b7230 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.345+0000 7ff10e5c0640 1 --2- 172.21.15.5:0/3995828969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff108109b90 0x7ff1081a1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.345+0000 7ff10e5c0640 1 --2- 172.21.15.5:0/3995828969 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff108109240 0x7ff10819c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.345+0000 7ff10e5c0640 1 --2- 172.21.15.5:0/3995828969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff108103900 0x7ff10819c440 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.345+0000 7ff10e5c0640 1 -- 172.21.15.5:0/3995828969 >> 172.21.15.5:0/3995828969 conn(0x7ff10807b5f0 msgr2=0x7ff1081052c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:48.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.346+0000 7ff10e5c0640 1 -- 172.21.15.5:0/3995828969 shutdown_connections 2024-08-31T05:37:48.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:48.346+0000 7ff10e5c0640 1 -- 172.21.15.5:0/3995828969 wait complete. 2024-08-31T05:37:48.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.621+0000 7f6dfbdc1640 1 -- 172.21.15.5:0/3561546872 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6df410db10 msgr2=0x7f6df4110000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:48.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.621+0000 7f6dfbdc1640 1 --2- 172.21.15.5:0/3561546872 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6df410db10 0x7f6df4110000 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6dec009be0 tx=0x7f6dec02a6c0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.621+0000 7f6dfbdc1640 1 -- 172.21.15.5:0/3561546872 shutdown_connections 2024-08-31T05:37:48.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.621+0000 7f6dfbdc1640 1 --2- 172.21.15.5:0/3561546872 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6df410db10 0x7f6df4110000 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.621+0000 7f6dfbdc1640 1 --2- 172.21.15.5:0/3561546872 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6df4105000 0x7f6df410d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.625 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.621+0000 7f6dfbdc1640 1 --2- 172.21.15.5:0/3561546872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6df41046b0 0x7f6df4104ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.625 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.621+0000 7f6dfbdc1640 1 -- 172.21.15.5:0/3561546872 >> 172.21.15.5:0/3561546872 conn(0x7f6df40fe160 msgr2=0x7f6df41005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:48.625 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.621+0000 7f6dfbdc1640 1 -- 172.21.15.5:0/3561546872 shutdown_connections 2024-08-31T05:37:48.625 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.621+0000 7f6dfbdc1640 1 -- 172.21.15.5:0/3561546872 wait complete. 2024-08-31T05:37:48.625 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.622+0000 7f6dfbdc1640 1 Processor -- start 2024-08-31T05:37:48.625 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.622+0000 7f6dfbdc1640 1 -- start start 2024-08-31T05:37:48.627 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.622+0000 7f6dfbdc1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6df41046b0 0x7f6df419a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:48.627 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.622+0000 7f6dfbdc1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6df4105000 0x7f6df419a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:48.627 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.623+0000 7f6dfbdc1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6df410db10 0x7f6df419f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:48.627 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.623+0000 7f6dfbdc1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6df4113780 con 0x7f6df4105000 2024-08-31T05:37:48.627 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.623+0000 7f6dfbdc1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6df4113600 con 0x7f6df41046b0 2024-08-31T05:37:48.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.623+0000 7f6dfbdc1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6df4113900 con 0x7f6df410db10 2024-08-31T05:37:48.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.623+0000 7f6df9b5d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6df41046b0 0x7f6df419a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:48.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.623+0000 7f6df935c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6df4105000 0x7f6df419a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:48.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.623+0000 7f6dfa35e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6df410db10 0x7f6df419f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:48.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.623+0000 7f6df9b5d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6df41046b0 0x7f6df419a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:35712/0 (socket says 172.21.15.5:35712) 2024-08-31T05:37:48.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.623+0000 7f6df935c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6df4105000 0x7f6df419a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49534/0 (socket says 172.21.15.5:49534) 2024-08-31T05:37:48.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.623+0000 7f6df9b5d640 1 -- 172.21.15.5:0/1471950128 learned_addr learned my addr 172.21.15.5:0/1471950128 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:48.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.623+0000 7f6dfa35e640 1 -- 172.21.15.5:0/1471950128 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6df41046b0 msgr2=0x7f6df419a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:48.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.623+0000 7f6dfa35e640 1 --2- 172.21.15.5:0/1471950128 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6df41046b0 0x7f6df419a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.623+0000 7f6dfa35e640 1 -- 172.21.15.5:0/1471950128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6df4105000 msgr2=0x7f6df419a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:48.629 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.623+0000 7f6dfa35e640 1 --2- 172.21.15.5:0/1471950128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6df4105000 0x7f6df419a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.629 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.623+0000 7f6dfa35e640 1 -- 172.21.15.5:0/1471950128 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6df41a0030 con 0x7f6df410db10 2024-08-31T05:37:48.629 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.623+0000 7f6dfa35e640 1 --2- 172.21.15.5:0/1471950128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6df410db10 0x7f6df419f930 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6dec02abe0 tx=0x7f6dec003c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:48.629 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.624+0000 7f6deaffd640 1 -- 172.21.15.5:0/1471950128 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dec041020 con 0x7f6df410db10 2024-08-31T05:37:48.629 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.624+0000 7f6deaffd640 1 -- 172.21.15.5:0/1471950128 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6dec003e10 con 0x7f6df410db10 2024-08-31T05:37:48.629 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.624+0000 7f6dfbdc1640 1 -- 172.21.15.5:0/1471950128 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6df41a02c0 con 0x7f6df410db10 2024-08-31T05:37:48.629 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.624+0000 7f6deaffd640 1 -- 172.21.15.5:0/1471950128 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dec036040 con 0x7f6df410db10 2024-08-31T05:37:48.629 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.624+0000 7f6dfbdc1640 1 -- 172.21.15.5:0/1471950128 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6df41a6ab0 con 0x7f6df410db10 2024-08-31T05:37:48.630 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.627+0000 7f6e02e06740 1 Processor -- start 2024-08-31T05:37:48.630 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.628+0000 7f6deaffd640 1 -- 172.21.15.5:0/1471950128 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f6dec044020 con 0x7f6df410db10 2024-08-31T05:37:48.630 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.628+0000 7f6e02e06740 1 -- start start 2024-08-31T05:37:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.628+0000 7f6e02e06740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d53c6ef1b0 0x55d53ca92ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.628+0000 7f6e02e06740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d53c6c62f0 0x55d53ca93220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.629+0000 7f6e02e06740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d53c6ce4d0 0x55d53ca93760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.629+0000 7f6e02e06740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55d53ca08000 con 0x55d53c6c62f0 2024-08-31T05:37:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.629+0000 7f6e02e06740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d53c9f7590 con 0x55d53c6ef1b0 2024-08-31T05:37:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.629+0000 7f6e02e06740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d53c9fb540 con 0x55d53c6ce4d0 2024-08-31T05:37:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.629+0000 7f6df935c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d53c6ef1b0 0x55d53ca92ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.629+0000 7f6df9b5d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d53c6c62f0 0x55d53ca93220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.629+0000 7f6df935c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d53c6ef1b0 0x55d53ca92ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:35726/0 (socket says 172.21.15.5:35726) 2024-08-31T05:37:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.629+0000 7f6df935c640 1 -- 172.21.15.5:0/122123596 learned_addr learned my addr 172.21.15.5:0/122123596 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.629+0000 7f6df935c640 1 --2- 172.21.15.5:0/122123596 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d53c6ce4d0 0x55d53ca93760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.629+0000 7f6deaffd640 1 --2- 172.21.15.5:0/1471950128 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f6de00b4d20 0x7f6de00b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.629+0000 7f6dfa35e640 1 --2- 172.21.15.5:0/1471950128 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f6de00b4d20 0x7f6de00b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.629+0000 7f6df935c640 1 -- 172.21.15.5:0/122123596 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d53c6ce4d0 msgr2=0x55d53ca93760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.629+0000 7f6df935c640 1 --2- 172.21.15.5:0/122123596 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d53c6ce4d0 0x55d53ca93760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.629+0000 7f6df935c640 1 -- 172.21.15.5:0/122123596 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d53c6c62f0 msgr2=0x55d53ca93220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.629+0000 7f6df935c640 1 --2- 172.21.15.5:0/122123596 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d53c6c62f0 0x55d53ca93220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.629+0000 7f6df935c640 1 -- 172.21.15.5:0/122123596 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d53c75a790 con 0x55d53c6ef1b0 2024-08-31T05:37:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.629+0000 7f6df9b5d640 1 --2- 172.21.15.5:0/122123596 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d53c6c62f0 0x55d53ca93220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:37:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.629+0000 7f6deaffd640 1 -- 172.21.15.5:0/1471950128 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7f6dec106350 con 0x7f6df410db10 2024-08-31T05:37:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.629+0000 7f6df935c640 1 --2- 172.21.15.5:0/122123596 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d53c6ef1b0 0x55d53ca92ce0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6de40117a0 tx=0x7f6de4009770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2676caebe82e16f9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.630+0000 7f6ddffff640 1 -- 172.21.15.5:0/122123596 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de4004050 con 0x55d53c6ef1b0 2024-08-31T05:37:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.630+0000 7f6dfa35e640 1 --2- 172.21.15.5:0/1471950128 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f6de00b4d20 0x7f6de00b7230 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6dec103770 tx=0x7f6dec009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.630+0000 7f6ddffff640 1 -- 172.21.15.5:0/122123596 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6de400fc70 con 0x55d53c6ef1b0 2024-08-31T05:37:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.630+0000 7f6ddffff640 1 -- 172.21.15.5:0/122123596 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de4003910 con 0x55d53c6ef1b0 2024-08-31T05:37:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.630+0000 7f6e02e06740 1 -- 172.21.15.5:0/122123596 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d53c6ef1b0 msgr2=0x55d53ca92ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.630+0000 7f6e02e06740 1 --2- 172.21.15.5:0/122123596 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d53c6ef1b0 0x55d53ca92ce0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6de40117a0 tx=0x7f6de4009770 comp rx=0 tx=0).stop 2024-08-31T05:37:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.630+0000 7f6e02e06740 1 -- 172.21.15.5:0/122123596 shutdown_connections 2024-08-31T05:37:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.630+0000 7f6e02e06740 1 --2- 172.21.15.5:0/122123596 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d53c6ce4d0 0x55d53ca93760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.630+0000 7f6e02e06740 1 --2- 172.21.15.5:0/122123596 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d53c6c62f0 0x55d53ca93220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.630+0000 7f6e02e06740 1 --2- 172.21.15.5:0/122123596 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d53c6ef1b0 0x55d53ca92ce0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.639 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.630+0000 7f6e02e06740 1 -- 172.21.15.5:0/122123596 >> 172.21.15.5:0/122123596 conn(0x55d53c6e3300 msgr2=0x55d53ca90bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:48.639 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.631+0000 7f6e02e06740 1 -- 172.21.15.5:0/122123596 shutdown_connections 2024-08-31T05:37:48.639 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.631+0000 7f6e02e06740 1 -- 172.21.15.5:0/122123596 wait complete. 2024-08-31T05:37:48.639 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.631+0000 7f6e02e06740 1 -- start start 2024-08-31T05:37:48.639 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.631+0000 7f6e02e06740 1 Processor -- start 2024-08-31T05:37:48.639 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.632+0000 7f6e02e06740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d53c6c62f0 0x55d53ca9e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:48.639 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.632+0000 7f6e02e06740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d53c6ce4d0 0x55d53ca9ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:48.639 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.632+0000 7f6e02e06740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d53c6ef1b0 0x55d53caaa750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:48.639 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.632+0000 7f6e02e06740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55d53c930ab0 con 0x55d53c6ef1b0 2024-08-31T05:37:48.639 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.632+0000 7f6e02e06740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d53c97e680 con 0x55d53c6c62f0 2024-08-31T05:37:48.639 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.632+0000 7f6e02e06740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d53caa1460 con 0x55d53c6ce4d0 2024-08-31T05:37:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.632+0000 7f6e02e06740 10 client.0 _ll_register_callbacks cb 0x55d53c706a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:37:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.632+0000 7f6df9b5d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d53c6ce4d0 0x55d53ca9ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.632+0000 7f6df935c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d53c6c62f0 0x55d53ca9e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.632+0000 7f6df9b5d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d53c6ce4d0 0x55d53ca9ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:39800/0 (socket says 172.21.15.5:39800) 2024-08-31T05:37:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.632+0000 7f6df935c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d53c6c62f0 0x55d53ca9e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:35730/0 (socket says 172.21.15.5:35730) 2024-08-31T05:37:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.632+0000 7f6df9b5d640 1 -- 172.21.15.5:0/3274314629 learned_addr learned my addr 172.21.15.5:0/3274314629 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.632+0000 7f6df935c640 1 --2- 172.21.15.5:0/3274314629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d53c6ef1b0 0x55d53caaa750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.632+0000 7f6df935c640 1 -- 172.21.15.5:0/3274314629 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d53c6ce4d0 msgr2=0x55d53ca9ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.632+0000 7f6df935c640 1 --2- 172.21.15.5:0/3274314629 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d53c6ce4d0 0x55d53ca9ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.632+0000 7f6df935c640 1 -- 172.21.15.5:0/3274314629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d53c6ef1b0 msgr2=0x55d53caaa750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.632+0000 7f6df935c640 1 --2- 172.21.15.5:0/3274314629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d53c6ef1b0 0x55d53caaa750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.632+0000 7f6df935c640 1 -- 172.21.15.5:0/3274314629 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d53c7d3620 con 0x55d53c6c62f0 2024-08-31T05:37:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.632+0000 7f6df9b5d640 1 --2- 172.21.15.5:0/3274314629 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d53c6ce4d0 0x55d53ca9ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:37:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.632+0000 7f6df935c640 1 --2- 172.21.15.5:0/3274314629 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d53c6c62f0 0x55d53ca9e990 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6de4009fd0 tx=0x7f6de40035f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77708314199ae28a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.632+0000 7f6ddd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:37:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.633+0000 7f6ddd7fa640 1 -- 172.21.15.5:0/3274314629 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de400f9e0 con 0x55d53c6c62f0 2024-08-31T05:37:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.633+0000 7f6e02e06740 1 -- 172.21.15.5:0/3274314629 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6de400fc70 con 0x55d53c6c62f0 2024-08-31T05:37:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.633+0000 7f6ddd7fa640 1 -- 172.21.15.5:0/3274314629 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7f6de4003a70 con 0x55d53c6c62f0 2024-08-31T05:37:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.633+0000 7f6ddd7fa640 1 -- 172.21.15.5:0/3274314629 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f6de4036050 con 0x55d53c6c62f0 2024-08-31T05:37:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.633+0000 7f6e02e06740 10 client.27209 fetch_fsmap learned FSMap version 34 2024-08-31T05:37:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.633+0000 7f6e02e06740 1 -- 172.21.15.5:0/3274314629 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55d53caad4f0 con 0x55d53c6c62f0 2024-08-31T05:37:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.633+0000 7f6ddd7fa640 1 -- 172.21.15.5:0/3274314629 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6de400fc70 con 0x55d53c6c62f0 2024-08-31T05:37:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.633+0000 7f6ddd7fa640 1 -- 172.21.15.5:0/3274314629 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f6de401f5f0 con 0x55d53c6c62f0 2024-08-31T05:37:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.633+0000 7f6e02e06740 10 client.27209 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:37:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.633+0000 7f6e02e06740 10 client.27209 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:37:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.633+0000 7f6e02e06740 20 client.27209 populate_metadata read hostname 'smithi005' 2024-08-31T05:37:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.633+0000 7f6e02e06740 1 --2- 172.21.15.5:0/3274314629 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d53c6add80 0x55d53cab0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.633+0000 7f6e02e06740 4 client.27209 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:37:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.633+0000 7f6e02e06740 1 -- 172.21.15.5:0/3274314629 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d53ca09f50 con 0x55d53c6add80 2024-08-31T05:37:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.633+0000 7f6df9b5d640 1 --2- 172.21.15.5:0/3274314629 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d53c6add80 0x55d53cab0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.634+0000 7f6df9b5d640 1 --2- 172.21.15.5:0/3274314629 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d53c6add80 0x55d53cab0850 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f5799d6a3109d8 server_cookie=212fb6b8024b9e87 in_seq=0 out_seq=0 2024-08-31T05:37:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.634+0000 7f6ddd7fa640 10 client.27209 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:37:48.643 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.635+0000 7f6ddd7fa640 1 -- 172.21.15.5:0/3274314629 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d53ca09f50 con 0x55d53c6add80 2024-08-31T05:37:48.643 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.635+0000 7f6ddd7fa640 10 client.27209 handle_command_reply: tid=0 2024-08-31T05:37:48.644 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.635+0000 7f6e02e06740 1 client.27209 shutdown 2024-08-31T05:37:48.644 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.635+0000 7f6e02e06740 1 -- 172.21.15.5:0/3274314629 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d53c6c62f0 msgr2=0x55d53ca9e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:48.644 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.635+0000 7f6e02e06740 1 --2- 172.21.15.5:0/3274314629 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d53c6c62f0 0x55d53ca9e990 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6de4009fd0 tx=0x7f6de40035f0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.644 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.635+0000 7f6e02e06740 1 -- 172.21.15.5:0/3274314629 shutdown_connections 2024-08-31T05:37:48.644 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.635+0000 7f6e02e06740 1 --2- 172.21.15.5:0/3274314629 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d53c6add80 0x55d53cab0850 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.644 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.635+0000 7f6e02e06740 1 --2- 172.21.15.5:0/3274314629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d53c6ef1b0 0x55d53caaa750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.644 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.635+0000 7f6e02e06740 1 --2- 172.21.15.5:0/3274314629 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d53c6ce4d0 0x55d53ca9ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.644 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.635+0000 7f6ddd7fa640 0 client.27209 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:37:48.644 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.635+0000 7f6e02e06740 1 --2- 172.21.15.5:0/3274314629 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d53c6c62f0 0x55d53ca9e990 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.644 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.635+0000 7f6e02e06740 1 -- 172.21.15.5:0/3274314629 >> 172.21.15.5:0/3274314629 conn(0x55d53c6e3300 msgr2=0x55d53ca93d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:48.644 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.635+0000 7f6e02e06740 1 -- 172.21.15.5:0/3274314629 shutdown_connections 2024-08-31T05:37:48.645 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.635+0000 7f6e02e06740 1 -- 172.21.15.5:0/3274314629 wait complete. 2024-08-31T05:37:48.645 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.635+0000 7f6e02e06740 20 client.27209 trim_cache size 0 max 16384 2024-08-31T05:37:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.650+0000 7f6e02e06740 1 Processor -- start 2024-08-31T05:37:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.650+0000 7f6e02e06740 1 -- start start 2024-08-31T05:37:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.650+0000 7f6e02e06740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d53c6c62f0 0x55d53ca984b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.650+0000 7f6e02e06740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d53c6ce4d0 0x55d53caaa650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.650+0000 7f6e02e06740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d53c6ef1b0 0x55d53caaab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.650+0000 7f6e02e06740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6df41b0c20 con 0x55d53c6ef1b0 2024-08-31T05:37:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.650+0000 7f6e02e06740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6df41b2760 con 0x55d53c6c62f0 2024-08-31T05:37:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.650+0000 7f6e02e06740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6df41b12f0 con 0x55d53c6ce4d0 2024-08-31T05:37:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.651+0000 7f6df935c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d53c6c62f0 0x55d53ca984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.651+0000 7f6df9b5d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d53c6ce4d0 0x55d53caaa650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.651+0000 7f6df935c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d53c6c62f0 0x55d53ca984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:35732/0 (socket says 172.21.15.5:35732) 2024-08-31T05:37:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.651+0000 7f6df935c640 1 -- 172.21.15.5:0/313944558 learned_addr learned my addr 172.21.15.5:0/313944558 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.651+0000 7f6df935c640 1 --2- 172.21.15.5:0/313944558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d53c6ef1b0 0x55d53caaab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.651+0000 7f6df9b5d640 1 -- 172.21.15.5:0/313944558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d53c6c62f0 msgr2=0x55d53ca984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.651+0000 7f6df9b5d640 1 --2- 172.21.15.5:0/313944558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d53c6c62f0 0x55d53ca984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.651+0000 7f6df9b5d640 1 -- 172.21.15.5:0/313944558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d53c6ef1b0 msgr2=0x55d53caaab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.651+0000 7f6df9b5d640 1 --2- 172.21.15.5:0/313944558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d53c6ef1b0 0x55d53caaab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.651+0000 7f6df9b5d640 1 -- 172.21.15.5:0/313944558 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d53ca9cc60 con 0x55d53c6ce4d0 2024-08-31T05:37:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.651+0000 7f6df935c640 1 --2- 172.21.15.5:0/313944558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d53c6c62f0 0x55d53ca984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:37:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.651+0000 7f6df9b5d640 1 --2- 172.21.15.5:0/313944558 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d53c6ce4d0 0x55d53caaa650 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x55d53caa10b0 tx=0x7f6df0009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24c9af25d6ed7a5f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.651+0000 7f6ddf7fe640 1 -- 172.21.15.5:0/313944558 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df0004020 con 0x55d53c6ce4d0 2024-08-31T05:37:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.651+0000 7f6ddf7fe640 1 -- 172.21.15.5:0/313944558 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6df000fd40 con 0x55d53c6ce4d0 2024-08-31T05:37:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.651+0000 7f6ddf7fe640 1 -- 172.21.15.5:0/313944558 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df00039b0 con 0x55d53c6ce4d0 2024-08-31T05:37:48.658 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.652+0000 7f6e02e06740 1 -- 172.21.15.5:0/313944558 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d53c6ce4d0 msgr2=0x55d53caaa650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:48.658 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.652+0000 7f6e02e06740 1 --2- 172.21.15.5:0/313944558 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d53c6ce4d0 0x55d53caaa650 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x55d53caa10b0 tx=0x7f6df0009260 comp rx=0 tx=0).stop 2024-08-31T05:37:48.659 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.652+0000 7f6e02e06740 1 -- 172.21.15.5:0/313944558 shutdown_connections 2024-08-31T05:37:48.659 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.652+0000 7f6e02e06740 1 --2- 172.21.15.5:0/313944558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d53c6ef1b0 0x55d53caaab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.659 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.652+0000 7f6e02e06740 1 --2- 172.21.15.5:0/313944558 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d53c6ce4d0 0x55d53caaa650 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.659 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.652+0000 7f6e02e06740 1 --2- 172.21.15.5:0/313944558 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d53c6c62f0 0x55d53ca984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.659 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.652+0000 7f6e02e06740 1 -- 172.21.15.5:0/313944558 >> 172.21.15.5:0/313944558 conn(0x55d53c6e3300 msgr2=0x55d53ca97da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:48.659 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.652+0000 7f6e02e06740 1 -- 172.21.15.5:0/313944558 shutdown_connections 2024-08-31T05:37:48.659 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.652+0000 7f6e02e06740 1 -- 172.21.15.5:0/313944558 wait complete. 2024-08-31T05:37:48.659 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.653+0000 7f6e02e06740 1 -- start start 2024-08-31T05:37:48.659 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.653+0000 7f6e02e06740 1 Processor -- start 2024-08-31T05:37:48.659 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.654+0000 7f6e02e06740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d53c6c62f0 0x55d53caa6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:48.659 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.654+0000 7f6e02e06740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d53c6ce4d0 0x55d53caa70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:48.659 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.654+0000 7f6e02e06740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d53c6ef1b0 0x55d53caa21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:48.659 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.654+0000 7f6e02e06740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6df41b2090 con 0x55d53c6c62f0 2024-08-31T05:37:48.659 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.654+0000 7f6e02e06740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6df41b19c0 con 0x55d53c6ef1b0 2024-08-31T05:37:48.660 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.654+0000 7f6e02e06740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6df41aec20 con 0x55d53c6ce4d0 2024-08-31T05:37:48.660 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.654+0000 7f6e02e06740 10 client.0 _ll_register_callbacks cb 0x7f6df0009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:37:48.660 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.654+0000 7f6df935c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d53c6c62f0 0x55d53caa6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:48.660 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.654+0000 7f6df935c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d53c6c62f0 0x55d53caa6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49576/0 (socket says 172.21.15.5:49576) 2024-08-31T05:37:48.660 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.654+0000 7f6df935c640 1 -- 172.21.15.5:0/2835736673 learned_addr learned my addr 172.21.15.5:0/2835736673 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:48.660 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.654+0000 7f6df9b5d640 1 --2- 172.21.15.5:0/2835736673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d53c6ce4d0 0x55d53caa70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:48.660 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.654+0000 7f6df935c640 1 --2- 172.21.15.5:0/2835736673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d53c6ef1b0 0x55d53caa21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:48.660 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.654+0000 7f6df935c640 1 -- 172.21.15.5:0/2835736673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d53c6ce4d0 msgr2=0x55d53caa70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:48.660 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.654+0000 7f6df935c640 1 --2- 172.21.15.5:0/2835736673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d53c6ce4d0 0x55d53caa70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.660 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.654+0000 7f6df935c640 1 -- 172.21.15.5:0/2835736673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d53c6ef1b0 msgr2=0x55d53caa21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:48.660 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.654+0000 7f6df935c640 1 --2- 172.21.15.5:0/2835736673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d53c6ef1b0 0x55d53caa21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.660 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.654+0000 7f6df935c640 1 -- 172.21.15.5:0/2835736673 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d53caa2970 con 0x55d53c6c62f0 2024-08-31T05:37:48.660 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.654+0000 7f6df935c640 1 --2- 172.21.15.5:0/2835736673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d53c6c62f0 0x55d53caa6b20 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f6de40117a0 tx=0x7f6de4009cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd5931bf2040d365 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:48.660 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.654+0000 7f6ddd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:37:48.661 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.654+0000 7f6ddd7fa640 1 -- 172.21.15.5:0/2835736673 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de400fbf0 con 0x55d53c6c62f0 2024-08-31T05:37:48.661 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.654+0000 7f6ddd7fa640 1 -- 172.21.15.5:0/2835736673 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7f6de4011070 con 0x55d53c6c62f0 2024-08-31T05:37:48.661 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.654+0000 7f6e02e06740 1 -- 172.21.15.5:0/2835736673 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6df000fd40 con 0x55d53c6c62f0 2024-08-31T05:37:48.661 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.655+0000 7f6ddd7fa640 1 -- 172.21.15.5:0/2835736673 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f6de4042070 con 0x55d53c6c62f0 2024-08-31T05:37:48.661 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.655+0000 7f6e02e06740 10 client.17634 fetch_fsmap learned FSMap version 34 2024-08-31T05:37:48.661 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.655+0000 7f6e02e06740 1 -- 172.21.15.5:0/2835736673 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55d53cb1acf0 con 0x55d53c6c62f0 2024-08-31T05:37:48.661 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.655+0000 7f6ddd7fa640 1 -- 172.21.15.5:0/2835736673 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6df000fd40 con 0x55d53c6c62f0 2024-08-31T05:37:48.661 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.655+0000 7f6ddd7fa640 1 -- 172.21.15.5:0/2835736673 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f6de40051d0 con 0x55d53c6c62f0 2024-08-31T05:37:48.661 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.655+0000 7f6e02e06740 10 client.17634 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:37:48.661 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.655+0000 7f6e02e06740 10 client.17634 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:37:48.661 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.655+0000 7f6e02e06740 20 client.17634 populate_metadata read hostname 'smithi005' 2024-08-31T05:37:48.661 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.655+0000 7f6e02e06740 1 --2- 172.21.15.5:0/2835736673 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d53c6831c0 0x55d53cb1d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:48.662 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.655+0000 7f6e02e06740 4 client.17634 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:37:48.662 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.655+0000 7f6e02e06740 1 -- 172.21.15.5:0/2835736673 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d53ca059f0 con 0x55d53c6831c0 2024-08-31T05:37:48.662 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.655+0000 7f6df9b5d640 1 --2- 172.21.15.5:0/2835736673 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d53c6831c0 0x55d53cb1d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:48.662 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.656+0000 7f6ddd7fa640 10 client.17634 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:37:48.662 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.656+0000 7f6df9b5d640 1 --2- 172.21.15.5:0/2835736673 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d53c6831c0 0x55d53cb1d340 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5acb5b324ea8a68 server_cookie=878896df12b21007 in_seq=0 out_seq=0 2024-08-31T05:37:48.670 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.667+0000 7f6ddd7fa640 1 -- 172.21.15.5:0/2835736673 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d53ca059f0 con 0x55d53c6831c0 2024-08-31T05:37:48.670 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.667+0000 7f6ddd7fa640 10 client.17634 handle_command_reply: tid=0 2024-08-31T05:37:48.670 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.667+0000 7f6e02e06740 1 client.17634 shutdown 2024-08-31T05:37:48.670 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.667+0000 7f6e02e06740 1 -- 172.21.15.5:0/2835736673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d53c6c62f0 msgr2=0x55d53caa6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:48.670 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.667+0000 7f6e02e06740 1 --2- 172.21.15.5:0/2835736673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d53c6c62f0 0x55d53caa6b20 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f6de40117a0 tx=0x7f6de4009cf0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.670 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.668+0000 7f6e02e06740 1 -- 172.21.15.5:0/2835736673 shutdown_connections 2024-08-31T05:37:48.670 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.668+0000 7f6e02e06740 1 --2- 172.21.15.5:0/2835736673 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d53c6831c0 0x55d53cb1d340 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.670 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.668+0000 7f6e02e06740 1 --2- 172.21.15.5:0/2835736673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d53c6ef1b0 0x55d53caa21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.670 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.668+0000 7f6e02e06740 1 --2- 172.21.15.5:0/2835736673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d53c6ce4d0 0x55d53caa70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.671 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.668+0000 7f6e02e06740 1 --2- 172.21.15.5:0/2835736673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d53c6c62f0 0x55d53caa6b20 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.671 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.668+0000 7f6e02e06740 1 -- 172.21.15.5:0/2835736673 >> 172.21.15.5:0/2835736673 conn(0x55d53c6e3300 msgr2=0x55d53ca903c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:48.671 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.668+0000 7f6ddd7fa640 0 client.17634 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:37:48.671 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.668+0000 7f6e02e06740 1 -- 172.21.15.5:0/2835736673 shutdown_connections 2024-08-31T05:37:48.671 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.668+0000 7f6e02e06740 1 -- 172.21.15.5:0/2835736673 wait complete. 2024-08-31T05:37:48.671 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.668+0000 7f6e02e06740 20 client.17634 trim_cache size 0 max 16384 2024-08-31T05:37:48.671 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:37:48.671 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:37:48.671 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:37:48.671 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:37:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.669+0000 7f6dfbdc1640 1 -- 172.21.15.5:0/1471950128 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f6de00b4d20 msgr2=0x7f6de00b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.669+0000 7f6dfbdc1640 1 --2- 172.21.15.5:0/1471950128 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f6de00b4d20 0x7f6de00b7230 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6dec103770 tx=0x7f6dec009500 comp rx=0 tx=0).stop 2024-08-31T05:37:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.669+0000 7f6dfbdc1640 1 -- 172.21.15.5:0/1471950128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6df410db10 msgr2=0x7f6df419f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.669+0000 7f6dfbdc1640 1 --2- 172.21.15.5:0/1471950128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6df410db10 0x7f6df419f930 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6dec02abe0 tx=0x7f6dec003c20 comp rx=0 tx=0).stop 2024-08-31T05:37:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.669+0000 7f6dfbdc1640 1 -- 172.21.15.5:0/1471950128 shutdown_connections 2024-08-31T05:37:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.669+0000 7f6dfbdc1640 1 --2- 172.21.15.5:0/1471950128 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f6de00b4d20 0x7f6de00b7230 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.673 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.669+0000 7f6dfbdc1640 1 --2- 172.21.15.5:0/1471950128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6df410db10 0x7f6df419f930 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.673 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.669+0000 7f6dfbdc1640 1 --2- 172.21.15.5:0/1471950128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6df4105000 0x7f6df419a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.673 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.669+0000 7f6dfbdc1640 1 --2- 172.21.15.5:0/1471950128 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6df41046b0 0x7f6df419a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:48.673 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.669+0000 7f6dfbdc1640 1 -- 172.21.15.5:0/1471950128 >> 172.21.15.5:0/1471950128 conn(0x7f6df40fe160 msgr2=0x7f6df41054e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:48.673 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.669+0000 7f6dfbdc1640 1 -- 172.21.15.5:0/1471950128 shutdown_connections 2024-08-31T05:37:48.673 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:37:48.669+0000 7f6dfbdc1640 1 -- 172.21.15.5:0/1471950128 wait complete. 2024-08-31T05:37:48.928 INFO:tasks.workunit.client.0.smithi005.stdout: 1 882253 11.37 MB/sec execute 276 sec latency 134.545 ms 2024-08-31T05:37:48.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:37:48 smithi005 ceph-mon[18602]: pgmap v582: 129 pgs: 129 active+clean; 470 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.1 MiB/s wr, 194 op/s 2024-08-31T05:37:49.156 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:37:48 smithi050 ceph-mon[22146]: pgmap v582: 129 pgs: 129 active+clean; 470 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.1 MiB/s wr, 194 op/s 2024-08-31T05:37:49.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:37:48 smithi070 ceph-mon[22316]: pgmap v582: 129 pgs: 129 active+clean; 470 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.1 MiB/s wr, 194 op/s 2024-08-31T05:37:49.372 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T05:37:49.372 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T05:37:49.638 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:37:49.928 INFO:tasks.workunit.client.0.smithi005.stdout: 1 884388 11.38 MB/sec execute 277 sec latency 106.461 ms 2024-08-31T05:37:50.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:50.136+0000 7fa3f71b1640 1 -- 172.21.15.5:0/3762806113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3f0108a90 msgr2=0x7fa3f010f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:50.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:50.136+0000 7fa3f71b1640 1 --2- 172.21.15.5:0/3762806113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3f0108a90 0x7fa3f010f2c0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8009900 tx=0x7fa3d802a410 comp rx=0 tx=0).stop 2024-08-31T05:37:50.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:50.136+0000 7fa3f71b1640 1 -- 172.21.15.5:0/3762806113 shutdown_connections 2024-08-31T05:37:50.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:50.136+0000 7fa3f71b1640 1 --2- 172.21.15.5:0/3762806113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3f0108a90 0x7fa3f010f2c0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:50.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:50.136+0000 7fa3f71b1640 1 --2- 172.21.15.5:0/3762806113 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3f0108140 0x7fa3f0108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:50.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:50.136+0000 7fa3f71b1640 1 --2- 172.21.15.5:0/3762806113 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3f0102800 0x7fa3f0102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:50.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:50.136+0000 7fa3f71b1640 1 -- 172.21.15.5:0/3762806113 >> 172.21.15.5:0/3762806113 conn(0x7fa3f00794d0 msgr2=0x7fa3f00798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:50.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:50.136+0000 7fa3f71b1640 1 -- 172.21.15.5:0/3762806113 shutdown_connections 2024-08-31T05:37:50.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:50.136+0000 7fa3f71b1640 1 -- 172.21.15.5:0/3762806113 wait complete. 2024-08-31T05:37:50.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:50.137+0000 7fa3f71b1640 1 Processor -- start 2024-08-31T05:37:50.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:50.137+0000 7fa3f71b1640 1 -- start start 2024-08-31T05:37:50.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:50.137+0000 7fa3f71b1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3f0102800 0x7fa3f0100e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:50.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:50.137+0000 7fa3f71b1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3f0108140 0x7fa3f00ff410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:50.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:50.137+0000 7fa3f71b1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3f0108a90 0x7fa3f00ff950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:50.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:50.137+0000 7fa3f71b1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f0112710 con 0x7fa3f0102800 2024-08-31T05:37:50.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:50.137+0000 7fa3f71b1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f0112590 con 0x7fa3f0108140 2024-08-31T05:37:50.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:50.137+0000 7fa3f71b1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f0112890 con 0x7fa3f0108a90 2024-08-31T05:37:50.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:50.137+0000 7fa3f4f4d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3f0102800 0x7fa3f0100e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:50.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:50.137+0000 7fa3f4f4d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3f0102800 0x7fa3f0100e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49594/0 (socket says 172.21.15.5:49594) 2024-08-31T05:37:50.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:50.137+0000 7fa3f4f4d640 1 -- 172.21.15.5:0/2226351653 learned_addr learned my addr 172.21.15.5:0/2226351653 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:50.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:50.137+0000 7fa3effff640 1 --2- 172.21.15.5:0/2226351653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3f0108140 0x7fa3f00ff410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:50.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:50.137+0000 7fa3f574e640 1 --2- 172.21.15.5:0/2226351653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3f0108a90 0x7fa3f00ff950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:50.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:50.138+0000 7fa3f4f4d640 1 -- 172.21.15.5:0/2226351653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3f0108a90 msgr2=0x7fa3f00ff950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:50.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:50.138+0000 7fa3f4f4d640 1 --2- 172.21.15.5:0/2226351653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3f0108a90 0x7fa3f00ff950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:50.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:50.138+0000 7fa3f4f4d640 1 -- 172.21.15.5:0/2226351653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3f0108140 msgr2=0x7fa3f00ff410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:50.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:50.138+0000 7fa3f4f4d640 1 --2- 172.21.15.5:0/2226351653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3f0108140 0x7fa3f00ff410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:50.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:50.138+0000 7fa3f4f4d640 1 -- 172.21.15.5:0/2226351653 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3f0100170 con 0x7fa3f0102800 2024-08-31T05:37:50.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:50.138+0000 7fa3f4f4d640 1 --2- 172.21.15.5:0/2226351653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3f0102800 0x7fa3f0100e20 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fa3e800ebc0 tx=0x7fa3e800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:50.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:50.138+0000 7fa3edffb640 1 -- 172.21.15.5:0/2226351653 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e8010630 con 0x7fa3f0102800 2024-08-31T05:37:50.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:50.138+0000 7fa3edffb640 1 -- 172.21.15.5:0/2226351653 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3e8010c80 con 0x7fa3f0102800 2024-08-31T05:37:50.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:50.138+0000 7fa3f71b1640 1 -- 172.21.15.5:0/2226351653 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3f01acc10 con 0x7fa3f0102800 2024-08-31T05:37:50.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:50.138+0000 7fa3edffb640 1 -- 172.21.15.5:0/2226351653 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e8018b60 con 0x7fa3f0102800 2024-08-31T05:37:50.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:50.138+0000 7fa3f71b1640 1 -- 172.21.15.5:0/2226351653 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3f01ad120 con 0x7fa3f0102800 2024-08-31T05:37:50.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:50.139+0000 7fa3f71b1640 1 -- 172.21.15.5:0/2226351653 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3f0102c10 con 0x7fa3f0102800 2024-08-31T05:37:50.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:50.141+0000 7fa3edffb640 1 -- 172.21.15.5:0/2226351653 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fa3e8018d00 con 0x7fa3f0102800 2024-08-31T05:37:50.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:50.142+0000 7fa3edffb640 1 --2- 172.21.15.5:0/2226351653 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa3dc0b4ca0 0x7fa3dc0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:50.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:50.142+0000 7fa3effff640 1 --2- 172.21.15.5:0/2226351653 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa3dc0b4ca0 0x7fa3dc0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:50.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:50.142+0000 7fa3edffb640 1 -- 172.21.15.5:0/2226351653 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7fa3e80e6430 con 0x7fa3f0102800 2024-08-31T05:37:50.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:50.143+0000 7fa3effff640 1 --2- 172.21.15.5:0/2226351653 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa3dc0b4ca0 0x7fa3dc0b71b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa3f0079ad0 tx=0x7fa3e0005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:50.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:50.145+0000 7fa3edffb640 1 -- 172.21.15.5:0/2226351653 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa3e80ac790 con 0x7fa3f0102800 2024-08-31T05:37:50.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:50.398+0000 7fa3f71b1640 1 -- 172.21.15.5:0/2226351653 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa3f0100710 con 0x7fa3f0102800 2024-08-31T05:37:50.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:50.399+0000 7fa3edffb640 1 -- 172.21.15.5:0/2226351653 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11941 (secure 0 0 0) 0x7fa3f0100710 con 0x7fa3f0102800 2024-08-31T05:37:50.401 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:37:50.401 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":34,"btime":"2024-08-31T05:33:43:289944+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14739,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2024812199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2024812199},{"type":"v1","addr":"172.21.15.5:6835","nonce":2024812199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3629023702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3629023702},{"type":"v1","addr":"172.21.15.5:6837","nonce":3629023702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T05:27:31.929153+0000","modified":"2024-08-31T05:33:42.378207+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24652,"mds_1":24638,"mds_2":24631,"mds_3":24625,"mds_4":24602},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6839/2412701258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":2412701258},{"type":"v1","addr":"172.21.15.5:6839","nonce":2412701258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14820":{"gid":14820,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6841/747057838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":747057838},{"type":"v1","addr":"172.21.15.5:6841","nonce":747057838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6833/1153378982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1153378982},{"type":"v1","addr":"172.21.15.50:6833","nonce":1153378982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6833/364083443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":364083443},{"type":"v1","addr":"172.21.15.70:6833","nonce":364083443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24587":{"gid":24587,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/2346896794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2346896794},{"type":"v1","addr":"172.21.15.50:6835","nonce":2346896794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24602":{"gid":24602,"name":"h","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.50:6837/428759669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":428759669},{"type":"v1","addr":"172.21.15.50:6837","nonce":428759669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.70:6835/2061504114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2061504114},{"type":"v1","addr":"172.21.15.70:6835","nonce":2061504114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.70:6837/2780036414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2780036414},{"type":"v1","addr":"172.21.15.70:6837","nonce":2780036414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.50:6839/98200944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":98200944},{"type":"v1","addr":"172.21.15.50:6839","nonce":98200944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24652":{"gid":24652,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.70:6839/2756569250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":2756569250},{"type":"v1","addr":"172.21.15.70:6839","nonce":2756569250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24652,"qdb_cluster":[24652,24631,24638,24625,24602]},"id":1}]} 2024-08-31T05:37:50.402 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 34 2024-08-31T05:37:50.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:50.401+0000 7fa3f71b1640 1 -- 172.21.15.5:0/2226351653 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa3dc0b4ca0 msgr2=0x7fa3dc0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:50.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:50.401+0000 7fa3f71b1640 1 --2- 172.21.15.5:0/2226351653 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa3dc0b4ca0 0x7fa3dc0b71b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa3f0079ad0 tx=0x7fa3e0005f90 comp rx=0 tx=0).stop 2024-08-31T05:37:50.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:50.401+0000 7fa3f71b1640 1 -- 172.21.15.5:0/2226351653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3f0102800 msgr2=0x7fa3f0100e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:50.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:50.401+0000 7fa3f71b1640 1 --2- 172.21.15.5:0/2226351653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3f0102800 0x7fa3f0100e20 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fa3e800ebc0 tx=0x7fa3e800c6a0 comp rx=0 tx=0).stop 2024-08-31T05:37:50.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:50.401+0000 7fa3f71b1640 1 -- 172.21.15.5:0/2226351653 shutdown_connections 2024-08-31T05:37:50.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:50.401+0000 7fa3f71b1640 1 --2- 172.21.15.5:0/2226351653 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa3dc0b4ca0 0x7fa3dc0b71b0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:50.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:50.401+0000 7fa3f71b1640 1 --2- 172.21.15.5:0/2226351653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3f0108a90 0x7fa3f00ff950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:50.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:50.401+0000 7fa3f71b1640 1 --2- 172.21.15.5:0/2226351653 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3f0108140 0x7fa3f00ff410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:50.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:50.401+0000 7fa3f71b1640 1 --2- 172.21.15.5:0/2226351653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3f0102800 0x7fa3f0100e20 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:50.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:50.401+0000 7fa3f71b1640 1 -- 172.21.15.5:0/2226351653 >> 172.21.15.5:0/2226351653 conn(0x7fa3f00794d0 msgr2=0x7fa3f0101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:50.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:50.401+0000 7fa3f71b1640 1 -- 172.21.15.5:0/2226351653 shutdown_connections 2024-08-31T05:37:50.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:50.402+0000 7fa3f71b1640 1 -- 172.21.15.5:0/2226351653 wait complete. 2024-08-31T05:37:50.928 INFO:tasks.workunit.client.0.smithi005.stdout: 1 886158 11.36 MB/sec execute 278 sec latency 41.606 ms 2024-08-31T05:37:51.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:37:50 smithi050 ceph-mon[22146]: pgmap v583: 129 pgs: 129 active+clean; 480 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.3 MiB/s wr, 253 op/s 2024-08-31T05:37:51.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:37:50 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/2226351653' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:37:51.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:37:50 smithi005 ceph-mon[18602]: pgmap v583: 129 pgs: 129 active+clean; 480 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.3 MiB/s wr, 253 op/s 2024-08-31T05:37:51.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:37:50 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/2226351653' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:37:51.270 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-31T05:37:51.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:37:50 smithi070 ceph-mon[22316]: pgmap v583: 129 pgs: 129 active+clean; 480 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.3 MiB/s wr, 253 op/s 2024-08-31T05:37:51.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:37:50 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/2226351653' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:37:51.531 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:37:51.928 INFO:tasks.workunit.client.0.smithi005.stdout: 1 888160 11.37 MB/sec execute 279 sec latency 59.203 ms 2024-08-31T05:37:52.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.051+0000 7f55eaa29640 1 -- 172.21.15.5:0/1776419336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55e4108140 msgr2=0x7f55e4108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:52.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.051+0000 7f55eaa29640 1 --2- 172.21.15.5:0/1776419336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55e4108140 0x7f55e4108550 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f55d8009900 tx=0x7f55d802a410 comp rx=0 tx=0).stop 2024-08-31T05:37:52.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.051+0000 7f55eaa29640 1 -- 172.21.15.5:0/1776419336 shutdown_connections 2024-08-31T05:37:52.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.051+0000 7f55eaa29640 1 --2- 172.21.15.5:0/1776419336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55e4108a90 0x7f55e410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:52.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.051+0000 7f55eaa29640 1 --2- 172.21.15.5:0/1776419336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55e4108140 0x7f55e4108550 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:52.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.051+0000 7f55eaa29640 1 --2- 172.21.15.5:0/1776419336 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55e4102800 0x7f55e4102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:52.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.051+0000 7f55eaa29640 1 -- 172.21.15.5:0/1776419336 >> 172.21.15.5:0/1776419336 conn(0x7f55e40794d0 msgr2=0x7f55e40798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:52.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.051+0000 7f55eaa29640 1 -- 172.21.15.5:0/1776419336 shutdown_connections 2024-08-31T05:37:52.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.051+0000 7f55eaa29640 1 -- 172.21.15.5:0/1776419336 wait complete. 2024-08-31T05:37:52.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.052+0000 7f55eaa29640 1 Processor -- start 2024-08-31T05:37:52.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.052+0000 7f55eaa29640 1 -- start start 2024-08-31T05:37:52.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.053+0000 7f55eaa29640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55e4102800 0x7f55e419a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:52.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.053+0000 7f55eaa29640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55e4108140 0x7f55e419a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:52.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.053+0000 7f55eaa29640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55e4108a90 0x7f55e419fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:52.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.053+0000 7f55eaa29640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f55e41126e0 con 0x7f55e4108a90 2024-08-31T05:37:52.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.053+0000 7f55eaa29640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f55e4112560 con 0x7f55e4102800 2024-08-31T05:37:52.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.053+0000 7f55eaa29640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f55e4112860 con 0x7f55e4108140 2024-08-31T05:37:52.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.053+0000 7f55e8fc6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55e4108a90 0x7f55e419fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:52.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.053+0000 7f55e3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55e4102800 0x7f55e419a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:52.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.054+0000 7f55e37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55e4108140 0x7f55e419a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:52.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.054+0000 7f55e3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55e4102800 0x7f55e419a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:57534/0 (socket says 172.21.15.5:57534) 2024-08-31T05:37:52.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.054+0000 7f55e3fff640 1 -- 172.21.15.5:0/329193093 learned_addr learned my addr 172.21.15.5:0/329193093 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:52.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.054+0000 7f55e37fe640 1 -- 172.21.15.5:0/329193093 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55e4102800 msgr2=0x7f55e419a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:52.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.054+0000 7f55e37fe640 1 --2- 172.21.15.5:0/329193093 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55e4102800 0x7f55e419a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:52.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.054+0000 7f55e37fe640 1 -- 172.21.15.5:0/329193093 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55e4108a90 msgr2=0x7f55e419fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:52.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.054+0000 7f55e37fe640 1 --2- 172.21.15.5:0/329193093 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55e4108a90 0x7f55e419fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:52.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.054+0000 7f55e37fe640 1 -- 172.21.15.5:0/329193093 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55e41a0230 con 0x7f55e4108140 2024-08-31T05:37:52.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.054+0000 7f55e8fc6640 1 --2- 172.21.15.5:0/329193093 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55e4108a90 0x7f55e419fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:37:52.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.054+0000 7f55e37fe640 1 --2- 172.21.15.5:0/329193093 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55e4108140 0x7f55e419a860 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f55d802a930 tx=0x7f55d8031a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:52.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.054+0000 7f55e17fa640 1 -- 172.21.15.5:0/329193093 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d803f070 con 0x7f55e4108140 2024-08-31T05:37:52.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.054+0000 7f55eaa29640 1 -- 172.21.15.5:0/329193093 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55e41a04c0 con 0x7f55e4108140 2024-08-31T05:37:52.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.054+0000 7f55e17fa640 1 -- 172.21.15.5:0/329193093 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55d8004490 con 0x7f55e4108140 2024-08-31T05:37:52.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.054+0000 7f55e17fa640 1 -- 172.21.15.5:0/329193093 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d8035070 con 0x7f55e4108140 2024-08-31T05:37:52.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.055+0000 7f55eaa29640 1 -- 172.21.15.5:0/329193093 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55e41a6c80 con 0x7f55e4108140 2024-08-31T05:37:52.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.057+0000 7f55f0f9e740 1 Processor -- start 2024-08-31T05:37:52.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.057+0000 7f55f0f9e740 1 -- start start 2024-08-31T05:37:52.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.057+0000 7f55e17fa640 1 -- 172.21.15.5:0/329193093 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f55d8043400 con 0x7f55e4108140 2024-08-31T05:37:52.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.057+0000 7f55f0f9e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642d40b5070 0x5642d445a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:52.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.057+0000 7f55f0f9e740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5642d408c1b0 0x5642d445a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:52.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.057+0000 7f55f0f9e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5642d4094390 0x5642d445ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:52.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.057+0000 7f55f0f9e740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5642d43d1680 con 0x5642d408c1b0 2024-08-31T05:37:52.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.057+0000 7f55f0f9e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5642d43c0c10 con 0x5642d4094390 2024-08-31T05:37:52.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.057+0000 7f55f0f9e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5642d43c4bc0 con 0x5642d40b5070 2024-08-31T05:37:52.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.057+0000 7f55e3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5642d408c1b0 0x5642d445a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:52.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.058+0000 7f55e3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5642d408c1b0 0x5642d445a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50264/0 (socket says 172.21.15.5:50264) 2024-08-31T05:37:52.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.058+0000 7f55e3fff640 1 -- 172.21.15.5:0/3715527028 learned_addr learned my addr 172.21.15.5:0/3715527028 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:52.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.058+0000 7f55e8fc6640 1 --2- 172.21.15.5:0/3715527028 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642d40b5070 0x5642d445a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:52.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.058+0000 7f55e37fe640 1 --2- 172.21.15.5:0/3715527028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5642d4094390 0x5642d445ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:52.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.058+0000 7f55e3fff640 1 -- 172.21.15.5:0/3715527028 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642d40b5070 msgr2=0x5642d445a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:52.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.058+0000 7f55e3fff640 1 --2- 172.21.15.5:0/3715527028 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642d40b5070 0x5642d445a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:52.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.058+0000 7f55e3fff640 1 -- 172.21.15.5:0/3715527028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5642d4094390 msgr2=0x5642d445ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:52.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.058+0000 7f55e3fff640 1 --2- 172.21.15.5:0/3715527028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5642d4094390 0x5642d445ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:52.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.058+0000 7f55e3fff640 1 -- 172.21.15.5:0/3715527028 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642d4120650 con 0x5642d408c1b0 2024-08-31T05:37:52.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.058+0000 7f55e37fe640 1 --2- 172.21.15.5:0/3715527028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5642d4094390 0x5642d445ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:37:52.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.058+0000 7f55e3fff640 1 --2- 172.21.15.5:0/3715527028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5642d408c1b0 0x5642d445a850 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f55d4009e10 tx=0x7f55d4011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=651329af85e08b27 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:52.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.058+0000 7f55ca7fc640 1 -- 172.21.15.5:0/3715527028 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d401e070 con 0x5642d408c1b0 2024-08-31T05:37:52.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.058+0000 7f55e17fa640 1 --2- 172.21.15.5:0/329193093 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f55cc0b4ca0 0x7f55cc0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:52.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.058+0000 7f55ca7fc640 1 -- 172.21.15.5:0/3715527028 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55d4019ae0 con 0x5642d408c1b0 2024-08-31T05:37:52.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.058+0000 7f55ca7fc640 1 -- 172.21.15.5:0/3715527028 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d400fb30 con 0x5642d408c1b0 2024-08-31T05:37:52.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.059+0000 7f55e8fc6640 1 --2- 172.21.15.5:0/329193093 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f55cc0b4ca0 0x7f55cc0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:52.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.059+0000 7f55e17fa640 1 -- 172.21.15.5:0/329193093 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7f55d8105e60 con 0x7f55e4108140 2024-08-31T05:37:52.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.059+0000 7f55f0f9e740 1 -- 172.21.15.5:0/3715527028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5642d408c1b0 msgr2=0x5642d445a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:52.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.059+0000 7f55e8fc6640 1 --2- 172.21.15.5:0/329193093 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f55cc0b4ca0 0x7f55cc0b71b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f55dc009fd0 tx=0x7f55dc009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:52.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.059+0000 7f55f0f9e740 1 --2- 172.21.15.5:0/3715527028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5642d408c1b0 0x5642d445a850 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f55d4009e10 tx=0x7f55d4011810 comp rx=0 tx=0).stop 2024-08-31T05:37:52.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.059+0000 7f55f0f9e740 1 -- 172.21.15.5:0/3715527028 shutdown_connections 2024-08-31T05:37:52.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.059+0000 7f55f0f9e740 1 --2- 172.21.15.5:0/3715527028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5642d4094390 0x5642d445ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:52.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.059+0000 7f55f0f9e740 1 --2- 172.21.15.5:0/3715527028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5642d408c1b0 0x5642d445a850 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:52.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.059+0000 7f55f0f9e740 1 --2- 172.21.15.5:0/3715527028 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642d40b5070 0x5642d445a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:52.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.059+0000 7f55f0f9e740 1 -- 172.21.15.5:0/3715527028 >> 172.21.15.5:0/3715527028 conn(0x5642d40a9460 msgr2=0x5642d4458200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:52.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.059+0000 7f55f0f9e740 1 -- 172.21.15.5:0/3715527028 shutdown_connections 2024-08-31T05:37:52.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.059+0000 7f55f0f9e740 1 -- 172.21.15.5:0/3715527028 wait complete. 2024-08-31T05:37:52.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.060+0000 7f55f0f9e740 1 -- start start 2024-08-31T05:37:52.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.060+0000 7f55f0f9e740 1 Processor -- start 2024-08-31T05:37:52.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.060+0000 7f55f0f9e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5642d408c1b0 0x5642d4465a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:52.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.060+0000 7f55f0f9e740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5642d4094390 0x5642d4465fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:52.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.060+0000 7f55f0f9e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642d40b5070 0x5642d4471de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:52.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.060+0000 7f55f0f9e740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5642d4223700 con 0x5642d4094390 2024-08-31T05:37:52.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.060+0000 7f55f0f9e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5642d4347750 con 0x5642d408c1b0 2024-08-31T05:37:52.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.060+0000 7f55f0f9e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5642d4468af0 con 0x5642d40b5070 2024-08-31T05:37:52.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.060+0000 7f55f0f9e740 10 client.0 _ll_register_callbacks cb 0x5642d4376e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:37:52.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.060+0000 7f55e37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5642d4094390 0x5642d4465fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:52.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.061+0000 7f55e37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5642d4094390 0x5642d4465fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50280/0 (socket says 172.21.15.5:50280) 2024-08-31T05:37:52.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.061+0000 7f55e37fe640 1 -- 172.21.15.5:0/3875425656 learned_addr learned my addr 172.21.15.5:0/3875425656 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:52.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.061+0000 7f55e8fc6640 1 --2- 172.21.15.5:0/3875425656 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642d40b5070 0x5642d4471de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:52.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.061+0000 7f55e3fff640 1 --2- 172.21.15.5:0/3875425656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5642d408c1b0 0x5642d4465a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:52.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.061+0000 7f55e37fe640 1 -- 172.21.15.5:0/3875425656 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642d40b5070 msgr2=0x5642d4471de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:52.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.061+0000 7f55e37fe640 1 --2- 172.21.15.5:0/3875425656 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642d40b5070 0x5642d4471de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:52.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.061+0000 7f55e37fe640 1 -- 172.21.15.5:0/3875425656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5642d408c1b0 msgr2=0x5642d4465a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:52.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.061+0000 7f55e37fe640 1 --2- 172.21.15.5:0/3875425656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5642d408c1b0 0x5642d4465a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:52.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.061+0000 7f55e37fe640 1 -- 172.21.15.5:0/3875425656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642d4380900 con 0x5642d4094390 2024-08-31T05:37:52.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.061+0000 7f55e37fe640 1 --2- 172.21.15.5:0/3875425656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5642d4094390 0x5642d4465fc0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f55d8003fd0 tx=0x7f55d80c8140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea0f7908136bd689 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:52.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.061+0000 7f55c37fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:37:52.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.061+0000 7f55c37fe640 1 -- 172.21.15.5:0/3875425656 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d8048070 con 0x5642d4094390 2024-08-31T05:37:52.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.061+0000 7f55c37fe640 1 -- 172.21.15.5:0/3875425656 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7f55d80cc420 con 0x5642d4094390 2024-08-31T05:37:52.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.061+0000 7f55f0f9e740 1 -- 172.21.15.5:0/3875425656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55d4019ae0 con 0x5642d4094390 2024-08-31T05:37:52.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.061+0000 7f55c37fe640 1 -- 172.21.15.5:0/3875425656 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f55d8103600 con 0x5642d4094390 2024-08-31T05:37:52.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.061+0000 7f55f0f9e740 10 client.17652 fetch_fsmap learned FSMap version 34 2024-08-31T05:37:52.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.061+0000 7f55f0f9e740 1 -- 172.21.15.5:0/3875425656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5642d44748c0 con 0x5642d4094390 2024-08-31T05:37:52.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.062+0000 7f55c37fe640 1 -- 172.21.15.5:0/3875425656 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55d4019ae0 con 0x5642d4094390 2024-08-31T05:37:52.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.062+0000 7f55c37fe640 1 -- 172.21.15.5:0/3875425656 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f55d804b060 con 0x5642d4094390 2024-08-31T05:37:52.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.062+0000 7f55f0f9e740 10 client.17652 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:37:52.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.062+0000 7f55f0f9e740 10 client.17652 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-31T05:37:52.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.062+0000 7f55f0f9e740 20 client.17652 populate_metadata read hostname 'smithi005' 2024-08-31T05:37:52.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.062+0000 7f55f0f9e740 1 --2- 172.21.15.5:0/3875425656 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x5642d40739f0 0x5642d4477d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:52.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.062+0000 7f55f0f9e740 4 client.17652 mds_command: new command op to 24602 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:37:52.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.062+0000 7f55f0f9e740 1 -- 172.21.15.5:0/3875425656 --> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5642d43d35d0 con 0x5642d40739f0 2024-08-31T05:37:52.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.062+0000 7f55e3fff640 1 --2- 172.21.15.5:0/3875425656 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x5642d40739f0 0x5642d4477d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:52.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.063+0000 7f55e3fff640 1 --2- 172.21.15.5:0/3875425656 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x5642d40739f0 0x5642d4477d40 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d2525cc5f14b8b76 server_cookie=ded17a101a072f51 in_seq=0 out_seq=0 2024-08-31T05:37:52.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.063+0000 7f55c37fe640 10 client.17652 ms_handle_connect on v2:172.21.15.50:6836/428759669 2024-08-31T05:37:52.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.064+0000 7f55c37fe640 1 -- 172.21.15.5:0/3875425656 <== mds.4 v2:172.21.15.50:6836/428759669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5642d43d35d0 con 0x5642d40739f0 2024-08-31T05:37:52.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.064+0000 7f55c37fe640 10 client.17652 handle_command_reply: tid=0 2024-08-31T05:37:52.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.064+0000 7f55f0f9e740 1 client.17652 shutdown 2024-08-31T05:37:52.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.064+0000 7f55f0f9e740 1 -- 172.21.15.5:0/3875425656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5642d4094390 msgr2=0x5642d4465fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:52.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.064+0000 7f55f0f9e740 1 --2- 172.21.15.5:0/3875425656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5642d4094390 0x5642d4465fc0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f55d8003fd0 tx=0x7f55d80c8140 comp rx=0 tx=0).stop 2024-08-31T05:37:52.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.064+0000 7f55f0f9e740 1 -- 172.21.15.5:0/3875425656 shutdown_connections 2024-08-31T05:37:52.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.064+0000 7f55f0f9e740 1 --2- 172.21.15.5:0/3875425656 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x5642d40739f0 0x5642d4477d40 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:52.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.064+0000 7f55f0f9e740 1 --2- 172.21.15.5:0/3875425656 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642d40b5070 0x5642d4471de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:52.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.064+0000 7f55f0f9e740 1 --2- 172.21.15.5:0/3875425656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5642d4094390 0x5642d4465fc0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:52.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.064+0000 7f55f0f9e740 1 --2- 172.21.15.5:0/3875425656 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5642d408c1b0 0x5642d4465a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:52.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.064+0000 7f55c37fe640 0 client.17652 ms_handle_reset on v2:172.21.15.50:6836/428759669 2024-08-31T05:37:52.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.064+0000 7f55f0f9e740 1 -- 172.21.15.5:0/3875425656 >> 172.21.15.5:0/3875425656 conn(0x5642d40a9460 msgr2=0x5642d445d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:52.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.064+0000 7f55f0f9e740 1 -- 172.21.15.5:0/3875425656 shutdown_connections 2024-08-31T05:37:52.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.064+0000 7f55f0f9e740 1 -- 172.21.15.5:0/3875425656 wait complete. 2024-08-31T05:37:52.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.064+0000 7f55f0f9e740 20 client.17652 trim_cache size 0 max 16384 2024-08-31T05:37:52.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.078+0000 7f55f0f9e740 1 Processor -- start 2024-08-31T05:37:52.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.078+0000 7f55f0f9e740 1 -- start start 2024-08-31T05:37:52.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.078+0000 7f55f0f9e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642d408c1b0 0x5642d44676b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:52.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.078+0000 7f55f0f9e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5642d4094390 0x5642d4471ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:52.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.078+0000 7f55f0f9e740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5642d40b5070 0x5642d4462c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:52.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.078+0000 7f55f0f9e740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f55e41b0d00 con 0x5642d40b5070 2024-08-31T05:37:52.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.078+0000 7f55f0f9e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f55e41b2840 con 0x5642d4094390 2024-08-31T05:37:52.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.078+0000 7f55f0f9e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f55e41b13d0 con 0x5642d408c1b0 2024-08-31T05:37:52.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.078+0000 7f55e8fc6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5642d40b5070 0x5642d4462c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:52.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.078+0000 7f55e3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642d408c1b0 0x5642d44676b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:52.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.078+0000 7f55e8fc6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5642d40b5070 0x5642d4462c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50288/0 (socket says 172.21.15.5:50288) 2024-08-31T05:37:52.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.078+0000 7f55e8fc6640 1 -- 172.21.15.5:0/3054487798 learned_addr learned my addr 172.21.15.5:0/3054487798 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:52.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.078+0000 7f55e37fe640 1 --2- 172.21.15.5:0/3054487798 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5642d4094390 0x5642d4471ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:52.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.078+0000 7f55e8fc6640 1 -- 172.21.15.5:0/3054487798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642d408c1b0 msgr2=0x5642d44676b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:52.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.078+0000 7f55e8fc6640 1 --2- 172.21.15.5:0/3054487798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642d408c1b0 0x5642d44676b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:52.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.078+0000 7f55e8fc6640 1 -- 172.21.15.5:0/3054487798 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5642d4094390 msgr2=0x5642d4471ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:52.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.078+0000 7f55e8fc6640 1 --2- 172.21.15.5:0/3054487798 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5642d4094390 0x5642d4471ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:52.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.078+0000 7f55e8fc6640 1 -- 172.21.15.5:0/3054487798 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642d445cba0 con 0x5642d40b5070 2024-08-31T05:37:52.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.079+0000 7f55e8fc6640 1 --2- 172.21.15.5:0/3054487798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5642d40b5070 0x5642d4462c70 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f55dc003eb0 tx=0x7f55dc01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4218fc696463fbbf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:52.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.079+0000 7f55c9ffb640 1 -- 172.21.15.5:0/3054487798 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55dc00fe60 con 0x5642d40b5070 2024-08-31T05:37:52.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.079+0000 7f55c9ffb640 1 -- 172.21.15.5:0/3054487798 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55dc0045c0 con 0x5642d40b5070 2024-08-31T05:37:52.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.079+0000 7f55c9ffb640 1 -- 172.21.15.5:0/3054487798 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55dc005970 con 0x5642d40b5070 2024-08-31T05:37:52.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.080+0000 7f55f0f9e740 1 -- 172.21.15.5:0/3054487798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5642d40b5070 msgr2=0x5642d4462c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:52.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.080+0000 7f55f0f9e740 1 --2- 172.21.15.5:0/3054487798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5642d40b5070 0x5642d4462c70 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f55dc003eb0 tx=0x7f55dc01b000 comp rx=0 tx=0).stop 2024-08-31T05:37:52.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.080+0000 7f55f0f9e740 1 -- 172.21.15.5:0/3054487798 shutdown_connections 2024-08-31T05:37:52.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.080+0000 7f55f0f9e740 1 --2- 172.21.15.5:0/3054487798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5642d40b5070 0x5642d4462c70 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:52.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.080+0000 7f55f0f9e740 1 --2- 172.21.15.5:0/3054487798 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5642d4094390 0x5642d4471ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:52.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.080+0000 7f55f0f9e740 1 --2- 172.21.15.5:0/3054487798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642d408c1b0 0x5642d44676b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:52.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.080+0000 7f55f0f9e740 1 -- 172.21.15.5:0/3054487798 >> 172.21.15.5:0/3054487798 conn(0x5642d40a9460 msgr2=0x5642d4466fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:52.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.080+0000 7f55f0f9e740 1 -- 172.21.15.5:0/3054487798 shutdown_connections 2024-08-31T05:37:52.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.080+0000 7f55f0f9e740 1 -- 172.21.15.5:0/3054487798 wait complete. 2024-08-31T05:37:52.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.080+0000 7f55f0f9e740 1 -- start start 2024-08-31T05:37:52.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.080+0000 7f55f0f9e740 1 Processor -- start 2024-08-31T05:37:52.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.081+0000 7f55f0f9e740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5642d408c1b0 0x5642d446a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:52.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.081+0000 7f55f0f9e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5642d4094390 0x5642d446ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:52.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.081+0000 7f55f0f9e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642d40b5070 0x5642d44db710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:52.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.081+0000 7f55f0f9e740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f55e41b2170 con 0x5642d408c1b0 2024-08-31T05:37:52.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.081+0000 7f55f0f9e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f55e41b1aa0 con 0x5642d4094390 2024-08-31T05:37:52.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.081+0000 7f55e3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5642d408c1b0 0x5642d446a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:52.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.081+0000 7f55f0f9e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f55e41aed00 con 0x5642d40b5070 2024-08-31T05:37:52.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.081+0000 7f55e3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5642d408c1b0 0x5642d446a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50294/0 (socket says 172.21.15.5:50294) 2024-08-31T05:37:52.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.081+0000 7f55f0f9e740 10 client.0 _ll_register_callbacks cb 0x7f55d8005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:37:52.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.081+0000 7f55e3fff640 1 -- 172.21.15.5:0/3085781597 learned_addr learned my addr 172.21.15.5:0/3085781597 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:52.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.081+0000 7f55e8fc6640 1 --2- 172.21.15.5:0/3085781597 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642d40b5070 0x5642d44db710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:52.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.081+0000 7f55e37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5642d4094390 0x5642d446ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:52.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.081+0000 7f55e3fff640 1 -- 172.21.15.5:0/3085781597 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642d40b5070 msgr2=0x5642d44db710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:52.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.081+0000 7f55e3fff640 1 --2- 172.21.15.5:0/3085781597 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642d40b5070 0x5642d44db710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:52.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.081+0000 7f55e3fff640 1 -- 172.21.15.5:0/3085781597 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5642d4094390 msgr2=0x5642d446ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:52.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.081+0000 7f55e3fff640 1 --2- 172.21.15.5:0/3085781597 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5642d4094390 0x5642d446ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:52.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.081+0000 7f55e3fff640 1 -- 172.21.15.5:0/3085781597 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642d44dbd80 con 0x5642d408c1b0 2024-08-31T05:37:52.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.081+0000 7f55e8fc6640 1 --2- 172.21.15.5:0/3085781597 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642d40b5070 0x5642d44db710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:37:52.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.082+0000 7f55e3fff640 1 --2- 172.21.15.5:0/3085781597 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5642d408c1b0 0x5642d446a6c0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f55d4011d10 tx=0x7f55d4009720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40277a7cbf1865e4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:52.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.082+0000 7f55c37fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:37:52.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.082+0000 7f55c37fe640 1 -- 172.21.15.5:0/3085781597 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d401e040 con 0x5642d408c1b0 2024-08-31T05:37:52.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.082+0000 7f55c37fe640 1 -- 172.21.15.5:0/3085781597 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7f55d4005240 con 0x5642d408c1b0 2024-08-31T05:37:52.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.082+0000 7f55f0f9e740 1 -- 172.21.15.5:0/3085781597 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55dc0045c0 con 0x5642d408c1b0 2024-08-31T05:37:52.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.082+0000 7f55c37fe640 1 -- 172.21.15.5:0/3085781597 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f55d403d050 con 0x5642d408c1b0 2024-08-31T05:37:52.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.082+0000 7f55f0f9e740 10 client.17658 fetch_fsmap learned FSMap version 34 2024-08-31T05:37:52.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.082+0000 7f55f0f9e740 1 -- 172.21.15.5:0/3085781597 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5642d44e3150 con 0x5642d408c1b0 2024-08-31T05:37:52.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.082+0000 7f55c37fe640 1 -- 172.21.15.5:0/3085781597 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55dc0045c0 con 0x5642d408c1b0 2024-08-31T05:37:52.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.082+0000 7f55c37fe640 1 -- 172.21.15.5:0/3085781597 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f55d4019430 con 0x5642d408c1b0 2024-08-31T05:37:52.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.082+0000 7f55f0f9e740 10 client.17658 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:37:52.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.082+0000 7f55f0f9e740 10 client.17658 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-31T05:37:52.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.082+0000 7f55f0f9e740 20 client.17658 populate_metadata read hostname 'smithi005' 2024-08-31T05:37:52.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.082+0000 7f55f0f9e740 1 --2- 172.21.15.5:0/3085781597 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x5642d4048da0 0x5642d44e5720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:52.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.082+0000 7f55f0f9e740 4 client.17658 mds_command: new command op to 24602 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:37:52.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.082+0000 7f55f0f9e740 1 -- 172.21.15.5:0/3085781597 --> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5642d43cf070 con 0x5642d4048da0 2024-08-31T05:37:52.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.083+0000 7f55e37fe640 1 --2- 172.21.15.5:0/3085781597 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x5642d4048da0 0x5642d44e5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:52.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.083+0000 7f55e37fe640 1 --2- 172.21.15.5:0/3085781597 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x5642d4048da0 0x5642d44e5720 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7f7c22095f4e7e42 server_cookie=a05dedaf6bc9f345 in_seq=0 out_seq=0 2024-08-31T05:37:52.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.083+0000 7f55c37fe640 10 client.17658 ms_handle_connect on v2:172.21.15.50:6836/428759669 2024-08-31T05:37:52.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.083+0000 7f55c37fe640 1 -- 172.21.15.5:0/3085781597 <== mds.4 v2:172.21.15.50:6836/428759669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5642d43cf070 con 0x5642d4048da0 2024-08-31T05:37:52.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.083+0000 7f55c37fe640 10 client.17658 handle_command_reply: tid=0 2024-08-31T05:37:52.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.083+0000 7f55f0f9e740 1 client.17658 shutdown 2024-08-31T05:37:52.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.083+0000 7f55f0f9e740 1 -- 172.21.15.5:0/3085781597 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5642d408c1b0 msgr2=0x5642d446a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:52.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.083+0000 7f55f0f9e740 1 --2- 172.21.15.5:0/3085781597 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5642d408c1b0 0x5642d446a6c0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f55d4011d10 tx=0x7f55d4009720 comp rx=0 tx=0).stop 2024-08-31T05:37:52.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.083+0000 7f55f0f9e740 1 -- 172.21.15.5:0/3085781597 shutdown_connections 2024-08-31T05:37:52.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.083+0000 7f55f0f9e740 1 --2- 172.21.15.5:0/3085781597 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x5642d4048da0 0x5642d44e5720 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:52.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.083+0000 7f55c37fe640 0 client.17658 ms_handle_reset on v2:172.21.15.50:6836/428759669 2024-08-31T05:37:52.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.083+0000 7f55f0f9e740 1 --2- 172.21.15.5:0/3085781597 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642d40b5070 0x5642d44db710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:52.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.084+0000 7f55f0f9e740 1 --2- 172.21.15.5:0/3085781597 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5642d4094390 0x5642d446ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:52.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.084+0000 7f55f0f9e740 1 --2- 172.21.15.5:0/3085781597 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5642d408c1b0 0x5642d446a6c0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:52.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.084+0000 7f55f0f9e740 1 -- 172.21.15.5:0/3085781597 >> 172.21.15.5:0/3085781597 conn(0x5642d40a9460 msgr2=0x5642d4467880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:52.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.084+0000 7f55f0f9e740 1 -- 172.21.15.5:0/3085781597 shutdown_connections 2024-08-31T05:37:52.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.084+0000 7f55f0f9e740 1 -- 172.21.15.5:0/3085781597 wait complete. 2024-08-31T05:37:52.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.084+0000 7f55f0f9e740 20 client.17658 trim_cache size 0 max 16384 2024-08-31T05:37:52.091 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:37:52.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.084+0000 7f55eaa29640 1 -- 172.21.15.5:0/329193093 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f55cc0b4ca0 msgr2=0x7f55cc0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.084+0000 7f55eaa29640 1 --2- 172.21.15.5:0/329193093 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f55cc0b4ca0 0x7f55cc0b71b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f55dc009fd0 tx=0x7f55dc009500 comp rx=0 tx=0).stop 2024-08-31T05:37:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.084+0000 7f55eaa29640 1 -- 172.21.15.5:0/329193093 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55e4108140 msgr2=0x7f55e419a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.084+0000 7f55eaa29640 1 --2- 172.21.15.5:0/329193093 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55e4108140 0x7f55e419a860 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f55d802a930 tx=0x7f55d8031a20 comp rx=0 tx=0).stop 2024-08-31T05:37:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.084+0000 7f55eaa29640 1 -- 172.21.15.5:0/329193093 shutdown_connections 2024-08-31T05:37:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.084+0000 7f55eaa29640 1 --2- 172.21.15.5:0/329193093 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f55cc0b4ca0 0x7f55cc0b71b0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.084+0000 7f55eaa29640 1 --2- 172.21.15.5:0/329193093 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f55e4108a90 0x7f55e419fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.084+0000 7f55eaa29640 1 --2- 172.21.15.5:0/329193093 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55e4108140 0x7f55e419a860 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.084+0000 7f55eaa29640 1 --2- 172.21.15.5:0/329193093 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f55e4102800 0x7f55e419a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.084+0000 7f55eaa29640 1 -- 172.21.15.5:0/329193093 >> 172.21.15.5:0/329193093 conn(0x7f55e40794d0 msgr2=0x7f55e406b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.084+0000 7f55eaa29640 1 -- 172.21.15.5:0/329193093 shutdown_connections 2024-08-31T05:37:52.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:52.085+0000 7f55eaa29640 1 -- 172.21.15.5:0/329193093 wait complete. 2024-08-31T05:37:52.889 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-31T05:37:52.928 INFO:tasks.workunit.client.0.smithi005.stdout: 1 890167 11.35 MB/sec execute 280 sec latency 24.912 ms 2024-08-31T05:37:53.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:37:52 smithi050 ceph-mon[22146]: pgmap v584: 129 pgs: 129 active+clean; 484 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.5 MiB/s wr, 204 op/s 2024-08-31T05:37:53.185 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:37:53.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:37:52 smithi005 ceph-mon[18602]: pgmap v584: 129 pgs: 129 active+clean; 484 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.5 MiB/s wr, 204 op/s 2024-08-31T05:37:53.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:37:52 smithi070 ceph-mon[22316]: pgmap v584: 129 pgs: 129 active+clean; 484 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.5 MiB/s wr, 204 op/s 2024-08-31T05:37:53.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.757+0000 7f17b464c640 1 -- 172.21.15.5:0/3318829921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17ac108a90 msgr2=0x7f17ac10f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:53.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.757+0000 7f17b464c640 1 --2- 172.21.15.5:0/3318829921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17ac108a90 0x7f17ac10f2c0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f17a400fb10 tx=0x7f17a402e570 comp rx=0 tx=0).stop 2024-08-31T05:37:53.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.757+0000 7f17b464c640 1 -- 172.21.15.5:0/3318829921 shutdown_connections 2024-08-31T05:37:53.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.757+0000 7f17b464c640 1 --2- 172.21.15.5:0/3318829921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17ac108a90 0x7f17ac10f2c0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:53.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.757+0000 7f17b464c640 1 --2- 172.21.15.5:0/3318829921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17ac108140 0x7f17ac108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:53.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.757+0000 7f17b464c640 1 --2- 172.21.15.5:0/3318829921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17ac102800 0x7f17ac102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:53.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.757+0000 7f17b464c640 1 -- 172.21.15.5:0/3318829921 >> 172.21.15.5:0/3318829921 conn(0x7f17ac0794d0 msgr2=0x7f17ac0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:53.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.758+0000 7f17b464c640 1 -- 172.21.15.5:0/3318829921 shutdown_connections 2024-08-31T05:37:53.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.758+0000 7f17b464c640 1 -- 172.21.15.5:0/3318829921 wait complete. 2024-08-31T05:37:53.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.758+0000 7f17b464c640 1 Processor -- start 2024-08-31T05:37:53.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.758+0000 7f17b464c640 1 -- start start 2024-08-31T05:37:53.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.759+0000 7f17b464c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17ac102800 0x7f17ac197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:53.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.759+0000 7f17b464c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17ac108140 0x7f17ac198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:53.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.759+0000 7f17b464c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17ac108a90 0x7f17ac19d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:53.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.759+0000 7f17b464c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f17ac111640 con 0x7f17ac108a90 2024-08-31T05:37:53.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.759+0000 7f17b464c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f17ac1114c0 con 0x7f17ac108140 2024-08-31T05:37:53.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.759+0000 7f17b464c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f17ac1117c0 con 0x7f17ac102800 2024-08-31T05:37:53.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.759+0000 7f17b23e8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17ac102800 0x7f17ac197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:53.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.759+0000 7f17b23e8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17ac102800 0x7f17ac197f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:33530/0 (socket says 172.21.15.5:33530) 2024-08-31T05:37:53.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.759+0000 7f17b23e8640 1 -- 172.21.15.5:0/4139794476 learned_addr learned my addr 172.21.15.5:0/4139794476 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:53.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.759+0000 7f17b2be9640 1 --2- 172.21.15.5:0/4139794476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17ac108a90 0x7f17ac19d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:53.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.759+0000 7f17b1be7640 1 --2- 172.21.15.5:0/4139794476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17ac108140 0x7f17ac198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:53.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.759+0000 7f17b23e8640 1 -- 172.21.15.5:0/4139794476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17ac108140 msgr2=0x7f17ac198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:53.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.759+0000 7f17b23e8640 1 --2- 172.21.15.5:0/4139794476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17ac108140 0x7f17ac198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:53.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.759+0000 7f17b23e8640 1 -- 172.21.15.5:0/4139794476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17ac108a90 msgr2=0x7f17ac19d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:53.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.759+0000 7f17b23e8640 1 --2- 172.21.15.5:0/4139794476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17ac108a90 0x7f17ac19d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:53.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.759+0000 7f17b23e8640 1 -- 172.21.15.5:0/4139794476 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17ac19dee0 con 0x7f17ac102800 2024-08-31T05:37:53.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.759+0000 7f17b23e8640 1 --2- 172.21.15.5:0/4139794476 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17ac102800 0x7f17ac197f70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f179c00ebc0 tx=0x7f179c00c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:53.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.759+0000 7f17ab7fe640 1 -- 172.21.15.5:0/4139794476 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f179c010630 con 0x7f17ac102800 2024-08-31T05:37:53.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.759+0000 7f17b464c640 1 -- 172.21.15.5:0/4139794476 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17ac19e1d0 con 0x7f17ac102800 2024-08-31T05:37:53.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.759+0000 7f17ab7fe640 1 -- 172.21.15.5:0/4139794476 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f179c010c80 con 0x7f17ac102800 2024-08-31T05:37:53.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.760+0000 7f17ab7fe640 1 -- 172.21.15.5:0/4139794476 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f179c018b60 con 0x7f17ac102800 2024-08-31T05:37:53.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.760+0000 7f17b464c640 1 -- 172.21.15.5:0/4139794476 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17ac1a4930 con 0x7f17ac102800 2024-08-31T05:37:53.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.762+0000 7f17ab7fe640 1 -- 172.21.15.5:0/4139794476 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f179c018d00 con 0x7f17ac102800 2024-08-31T05:37:53.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.762+0000 7f17babc1740 1 Processor -- start 2024-08-31T05:37:53.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.763+0000 7f17babc1740 1 -- start start 2024-08-31T05:37:53.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.763+0000 7f17babc1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561960856070 0x561960bfb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:53.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.763+0000 7f17babc1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56196082d1b0 0x561960bfb850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:53.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.763+0000 7f17babc1740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561960835390 0x561960bfbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:53.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.763+0000 7f17babc1740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x561960b72680 con 0x561960835390 2024-08-31T05:37:53.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.763+0000 7f17babc1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x561960b61c10 con 0x56196082d1b0 2024-08-31T05:37:53.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.763+0000 7f17babc1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561960b65bc0 con 0x561960856070 2024-08-31T05:37:53.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.763+0000 7f17ab7fe640 1 --2- 172.21.15.5:0/4139794476 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f17940b4ca0 0x7f17940b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:53.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.763+0000 7f17b1be7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561960835390 0x561960bfbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:53.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.763+0000 7f17b2be9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561960856070 0x561960bfb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:53.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.763+0000 7f17b1be7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561960835390 0x561960bfbd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50310/0 (socket says 172.21.15.5:50310) 2024-08-31T05:37:53.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.763+0000 7f17b1be7640 1 -- 172.21.15.5:0/1919191278 learned_addr learned my addr 172.21.15.5:0/1919191278 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:53.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.763+0000 7f17b2be9640 1 --2- 172.21.15.5:0/4139794476 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f17940b4ca0 0x7f17940b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:53.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.763+0000 7f17b23e8640 1 --2- 172.21.15.5:0/1919191278 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56196082d1b0 0x561960bfb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:53.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.763+0000 7f17ab7fe640 1 -- 172.21.15.5:0/4139794476 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7f179c0e6060 con 0x7f17ac102800 2024-08-31T05:37:53.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.764+0000 7f17b2be9640 1 -- 172.21.15.5:0/1919191278 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56196082d1b0 msgr2=0x561960bfb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:53.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.764+0000 7f17b2be9640 1 --2- 172.21.15.5:0/1919191278 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56196082d1b0 0x561960bfb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:53.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.764+0000 7f17b2be9640 1 -- 172.21.15.5:0/1919191278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561960835390 msgr2=0x561960bfbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:53.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.764+0000 7f17b2be9640 1 --2- 172.21.15.5:0/1919191278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561960835390 0x561960bfbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:53.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.764+0000 7f17b2be9640 1 -- 172.21.15.5:0/1919191278 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619608c1650 con 0x561960856070 2024-08-31T05:37:53.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.764+0000 7f17b1be7640 1 --2- 172.21.15.5:0/1919191278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561960835390 0x561960bfbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:37:53.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.764+0000 7f17b2be9640 1 --2- 172.21.15.5:0/1919191278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561960856070 0x561960bfb310 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f17a402ea90 tx=0x7f17a400eda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=537eb3faf8bad3cc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:53.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.764+0000 7f17b2be9640 1 --2- 172.21.15.5:0/4139794476 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f17940b4ca0 0x7f17940b71b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f17a4037040 tx=0x7f17a4046000 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:53.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.764+0000 7f17a8ff9640 1 -- 172.21.15.5:0/1919191278 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a4004030 con 0x561960856070 2024-08-31T05:37:53.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.764+0000 7f17a8ff9640 1 -- 172.21.15.5:0/1919191278 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17a4044820 con 0x561960856070 2024-08-31T05:37:53.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.764+0000 7f17a8ff9640 1 -- 172.21.15.5:0/1919191278 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a4003850 con 0x561960856070 2024-08-31T05:37:53.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.765+0000 7f17babc1740 1 -- 172.21.15.5:0/1919191278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561960856070 msgr2=0x561960bfb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:53.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.765+0000 7f17babc1740 1 --2- 172.21.15.5:0/1919191278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561960856070 0x561960bfb310 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f17a402ea90 tx=0x7f17a400eda0 comp rx=0 tx=0).stop 2024-08-31T05:37:53.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.765+0000 7f17babc1740 1 -- 172.21.15.5:0/1919191278 shutdown_connections 2024-08-31T05:37:53.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.765+0000 7f17babc1740 1 --2- 172.21.15.5:0/1919191278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561960835390 0x561960bfbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:53.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.765+0000 7f17babc1740 1 --2- 172.21.15.5:0/1919191278 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56196082d1b0 0x561960bfb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:53.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.765+0000 7f17babc1740 1 --2- 172.21.15.5:0/1919191278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561960856070 0x561960bfb310 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:53.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.765+0000 7f17babc1740 1 -- 172.21.15.5:0/1919191278 >> 172.21.15.5:0/1919191278 conn(0x56196084a460 msgr2=0x561960bf9200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:53.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.765+0000 7f17babc1740 1 -- 172.21.15.5:0/1919191278 shutdown_connections 2024-08-31T05:37:53.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.765+0000 7f17babc1740 1 -- 172.21.15.5:0/1919191278 wait complete. 2024-08-31T05:37:53.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.766+0000 7f17babc1740 1 -- start start 2024-08-31T05:37:53.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.766+0000 7f17babc1740 1 Processor -- start 2024-08-31T05:37:53.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.766+0000 7f17babc1740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56196082d1b0 0x561960c06b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:53.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.766+0000 7f17babc1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561960835390 0x561960c07120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:53.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.766+0000 7f17babc1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561960856070 0x561960c12d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:53.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.766+0000 7f17babc1740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5619609c4700 con 0x56196082d1b0 2024-08-31T05:37:53.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.766+0000 7f17babc1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x561960ae8750 con 0x561960835390 2024-08-31T05:37:53.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.766+0000 7f17babc1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561960c09a90 con 0x561960856070 2024-08-31T05:37:53.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.766+0000 7f17babc1740 10 client.0 _ll_register_callbacks cb 0x561960b17e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:37:53.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.766+0000 7f17b2be9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561960856070 0x561960c12d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:53.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.766+0000 7f17b1be7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561960835390 0x561960c07120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:53.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.766+0000 7f17b23e8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56196082d1b0 0x561960c06b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:53.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.766+0000 7f17b2be9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561960856070 0x561960c12d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:33552/0 (socket says 172.21.15.5:33552) 2024-08-31T05:37:53.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.766+0000 7f17b2be9640 1 -- 172.21.15.5:0/3603156156 learned_addr learned my addr 172.21.15.5:0/3603156156 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:53.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.767+0000 7f17b1be7640 1 -- 172.21.15.5:0/3603156156 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561960856070 msgr2=0x561960c12d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:53.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.767+0000 7f17b1be7640 1 --2- 172.21.15.5:0/3603156156 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561960856070 0x561960c12d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:53.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.767+0000 7f17b1be7640 1 -- 172.21.15.5:0/3603156156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56196082d1b0 msgr2=0x561960c06b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:53.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.767+0000 7f17b1be7640 1 --2- 172.21.15.5:0/3603156156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56196082d1b0 0x561960c06b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:53.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.767+0000 7f17b1be7640 1 -- 172.21.15.5:0/3603156156 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561960b21900 con 0x561960835390 2024-08-31T05:37:53.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.767+0000 7f17b1be7640 1 --2- 172.21.15.5:0/3603156156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561960835390 0x561960c07120 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f17a000bd90 tx=0x7f17a00039c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87cb76fadeb4eabe server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:53.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.767+0000 7f1791ffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:37:53.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.767+0000 7f1791ffb640 1 -- 172.21.15.5:0/3603156156 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a001b070 con 0x561960835390 2024-08-31T05:37:53.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.767+0000 7f17babc1740 1 -- 172.21.15.5:0/3603156156 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17a4044820 con 0x561960835390 2024-08-31T05:37:53.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.767+0000 7f1791ffb640 1 -- 172.21.15.5:0/3603156156 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7f17a0017830 con 0x561960835390 2024-08-31T05:37:53.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.767+0000 7f1791ffb640 1 -- 172.21.15.5:0/3603156156 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f17a0027050 con 0x561960835390 2024-08-31T05:37:53.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.767+0000 7f17babc1740 10 client.27251 fetch_fsmap learned FSMap version 34 2024-08-31T05:37:53.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.767+0000 7f17babc1740 1 -- 172.21.15.5:0/3603156156 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x561960c159e0 con 0x561960835390 2024-08-31T05:37:53.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.768+0000 7f1791ffb640 1 -- 172.21.15.5:0/3603156156 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17a4044820 con 0x561960835390 2024-08-31T05:37:53.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.768+0000 7f1791ffb640 1 -- 172.21.15.5:0/3603156156 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f17a001fc40 con 0x561960835390 2024-08-31T05:37:53.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.768+0000 7f17babc1740 10 client.27251 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:37:53.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.768+0000 7f17babc1740 10 client.27251 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-31T05:37:53.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.768+0000 7f17babc1740 20 client.27251 populate_metadata read hostname 'smithi005' 2024-08-31T05:37:53.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.768+0000 7f17babc1740 1 --2- 172.21.15.5:0/3603156156 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5619608149f0 0x561960c18eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:53.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.768+0000 7f17babc1740 4 client.27251 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:37:53.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.768+0000 7f17babc1740 1 -- 172.21.15.5:0/3603156156 --> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561960b745d0 con 0x5619608149f0 2024-08-31T05:37:53.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.768+0000 7f17b23e8640 1 --2- 172.21.15.5:0/3603156156 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5619608149f0 0x561960c18eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:53.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.768+0000 7f1791ffb640 10 client.27251 ms_handle_connect on v2:172.21.15.70:6834/2061504114 2024-08-31T05:37:53.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.768+0000 7f17b23e8640 1 --2- 172.21.15.5:0/3603156156 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5619608149f0 0x561960c18eb0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c83aba1e6e3ac631 server_cookie=f29cae954ea4c2b6 in_seq=0 out_seq=0 2024-08-31T05:37:53.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.769+0000 7f1791ffb640 1 -- 172.21.15.5:0/3603156156 <== mds.3 v2:172.21.15.70:6834/2061504114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561960b745d0 con 0x5619608149f0 2024-08-31T05:37:53.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.769+0000 7f1791ffb640 10 client.27251 handle_command_reply: tid=0 2024-08-31T05:37:53.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.769+0000 7f17babc1740 1 client.27251 shutdown 2024-08-31T05:37:53.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.769+0000 7f17babc1740 1 -- 172.21.15.5:0/3603156156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561960835390 msgr2=0x561960c07120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:53.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.769+0000 7f17babc1740 1 --2- 172.21.15.5:0/3603156156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561960835390 0x561960c07120 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f17a000bd90 tx=0x7f17a00039c0 comp rx=0 tx=0).stop 2024-08-31T05:37:53.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.769+0000 7f17babc1740 1 -- 172.21.15.5:0/3603156156 shutdown_connections 2024-08-31T05:37:53.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.769+0000 7f17babc1740 1 --2- 172.21.15.5:0/3603156156 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5619608149f0 0x561960c18eb0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:53.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.769+0000 7f17babc1740 1 --2- 172.21.15.5:0/3603156156 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561960856070 0x561960c12d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:53.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.769+0000 7f17babc1740 1 --2- 172.21.15.5:0/3603156156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561960835390 0x561960c07120 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:53.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.769+0000 7f1791ffb640 0 client.27251 ms_handle_reset on v2:172.21.15.70:6834/2061504114 2024-08-31T05:37:53.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.769+0000 7f17babc1740 1 --2- 172.21.15.5:0/3603156156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56196082d1b0 0x561960c06b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:53.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.769+0000 7f17babc1740 1 -- 172.21.15.5:0/3603156156 >> 172.21.15.5:0/3603156156 conn(0x56196084a460 msgr2=0x561960bfe4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:53.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.769+0000 7f17babc1740 1 -- 172.21.15.5:0/3603156156 shutdown_connections 2024-08-31T05:37:53.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.769+0000 7f17babc1740 1 -- 172.21.15.5:0/3603156156 wait complete. 2024-08-31T05:37:53.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.770+0000 7f17babc1740 20 client.27251 trim_cache size 0 max 16384 2024-08-31T05:37:53.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.783+0000 7f17babc1740 1 Processor -- start 2024-08-31T05:37:53.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.783+0000 7f17babc1740 1 -- start start 2024-08-31T05:37:53.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.784+0000 7f17babc1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619608149f0 0x561960c08a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:53.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.784+0000 7f17babc1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56196082d1b0 0x561960bfca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:53.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.784+0000 7f17babc1740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561960835390 0x561960c12c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:53.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.784+0000 7f17babc1740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f17ac1aea80 con 0x561960835390 2024-08-31T05:37:53.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.784+0000 7f17babc1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f17ac1b05c0 con 0x56196082d1b0 2024-08-31T05:37:53.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.784+0000 7f17babc1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f17ac1af150 con 0x5619608149f0 2024-08-31T05:37:53.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.784+0000 7f17b23e8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619608149f0 0x561960c08a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:53.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.784+0000 7f17b2be9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561960835390 0x561960c12c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:53.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.784+0000 7f17b23e8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619608149f0 0x561960c08a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:33562/0 (socket says 172.21.15.5:33562) 2024-08-31T05:37:53.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.784+0000 7f17b23e8640 1 -- 172.21.15.5:0/227920049 learned_addr learned my addr 172.21.15.5:0/227920049 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:53.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.784+0000 7f17b1be7640 1 --2- 172.21.15.5:0/227920049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56196082d1b0 0x561960bfca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:53.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.784+0000 7f17b23e8640 1 -- 172.21.15.5:0/227920049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56196082d1b0 msgr2=0x561960bfca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:53.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.784+0000 7f17b23e8640 1 --2- 172.21.15.5:0/227920049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56196082d1b0 0x561960bfca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:53.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.784+0000 7f17b23e8640 1 -- 172.21.15.5:0/227920049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561960835390 msgr2=0x561960c12c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:53.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.784+0000 7f17b23e8640 1 --2- 172.21.15.5:0/227920049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561960835390 0x561960c12c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:53.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.784+0000 7f17b23e8640 1 -- 172.21.15.5:0/227920049 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561960bf9af0 con 0x5619608149f0 2024-08-31T05:37:53.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.784+0000 7f17b23e8640 1 --2- 172.21.15.5:0/227920049 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619608149f0 0x561960c08a40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f179c0e3480 tx=0x7f179c0754e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=317f2c7ae28682a0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:53.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.785+0000 7f1793fff640 1 -- 172.21.15.5:0/227920049 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f179c0abe80 con 0x5619608149f0 2024-08-31T05:37:53.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.785+0000 7f1793fff640 1 -- 172.21.15.5:0/227920049 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f179c071180 con 0x5619608149f0 2024-08-31T05:37:53.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.785+0000 7f1793fff640 1 -- 172.21.15.5:0/227920049 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f179c0cf180 con 0x5619608149f0 2024-08-31T05:37:53.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.785+0000 7f17babc1740 1 -- 172.21.15.5:0/227920049 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619608149f0 msgr2=0x561960c08a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:53.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.785+0000 7f17babc1740 1 --2- 172.21.15.5:0/227920049 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619608149f0 0x561960c08a40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f179c0e3480 tx=0x7f179c0754e0 comp rx=0 tx=0).stop 2024-08-31T05:37:53.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.786+0000 7f17babc1740 1 -- 172.21.15.5:0/227920049 shutdown_connections 2024-08-31T05:37:53.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.786+0000 7f17babc1740 1 --2- 172.21.15.5:0/227920049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561960835390 0x561960c12c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:53.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.786+0000 7f17babc1740 1 --2- 172.21.15.5:0/227920049 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56196082d1b0 0x561960bfca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:53.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.786+0000 7f17babc1740 1 --2- 172.21.15.5:0/227920049 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619608149f0 0x561960c08a40 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:53.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.786+0000 7f17babc1740 1 -- 172.21.15.5:0/227920049 >> 172.21.15.5:0/227920049 conn(0x56196084a460 msgr2=0x561960bfc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:53.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.786+0000 7f17babc1740 1 -- 172.21.15.5:0/227920049 shutdown_connections 2024-08-31T05:37:53.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.786+0000 7f17babc1740 1 -- 172.21.15.5:0/227920049 wait complete. 2024-08-31T05:37:53.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.786+0000 7f17babc1740 1 -- start start 2024-08-31T05:37:53.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.786+0000 7f17babc1740 1 Processor -- start 2024-08-31T05:37:53.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.786+0000 7f17babc1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5619608149f0 0x561960c0d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:53.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.786+0000 7f17babc1740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56196082d1b0 0x561960c0dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:53.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.786+0000 7f17babc1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561960835390 0x561960c7c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:53.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.786+0000 7f17babc1740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f17ac1afef0 con 0x56196082d1b0 2024-08-31T05:37:53.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.786+0000 7f17babc1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f17ac1af820 con 0x5619608149f0 2024-08-31T05:37:53.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.786+0000 7f17babc1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f17ac1aca80 con 0x561960835390 2024-08-31T05:37:53.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.787+0000 7f17babc1740 10 client.0 _ll_register_callbacks cb 0x7f17a000b9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:37:53.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.787+0000 7f17b1be7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56196082d1b0 0x561960c0dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:53.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.787+0000 7f17b2be9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561960835390 0x561960c7c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:53.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.787+0000 7f17b1be7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56196082d1b0 0x561960c0dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50332/0 (socket says 172.21.15.5:50332) 2024-08-31T05:37:53.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.787+0000 7f17b1be7640 1 -- 172.21.15.5:0/667524841 learned_addr learned my addr 172.21.15.5:0/667524841 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:53.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.787+0000 7f17b23e8640 1 --2- 172.21.15.5:0/667524841 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5619608149f0 0x561960c0d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:53.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.787+0000 7f17b1be7640 1 -- 172.21.15.5:0/667524841 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561960835390 msgr2=0x561960c7c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:53.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.787+0000 7f17b1be7640 1 --2- 172.21.15.5:0/667524841 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561960835390 0x561960c7c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:53.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.787+0000 7f17b1be7640 1 -- 172.21.15.5:0/667524841 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5619608149f0 msgr2=0x561960c0d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:53.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.787+0000 7f17b1be7640 1 --2- 172.21.15.5:0/667524841 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5619608149f0 0x561960c0d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:53.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.787+0000 7f17b1be7640 1 -- 172.21.15.5:0/667524841 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561960c7cec0 con 0x56196082d1b0 2024-08-31T05:37:53.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.787+0000 7f17b1be7640 1 --2- 172.21.15.5:0/667524841 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56196082d1b0 0x561960c0dcc0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f17a00163d0 tx=0x7f17a00052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87178d481a1f53d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:53.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.787+0000 7f1791ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:37:53.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.787+0000 7f1791ffb640 1 -- 172.21.15.5:0/667524841 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a001b040 con 0x56196082d1b0 2024-08-31T05:37:53.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.787+0000 7f1791ffb640 1 -- 172.21.15.5:0/667524841 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7f17a000b230 con 0x56196082d1b0 2024-08-31T05:37:53.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.787+0000 7f17babc1740 1 -- 172.21.15.5:0/667524841 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f179c071180 con 0x56196082d1b0 2024-08-31T05:37:53.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.788+0000 7f1791ffb640 1 -- 172.21.15.5:0/667524841 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f17a003b050 con 0x56196082d1b0 2024-08-31T05:37:53.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.788+0000 7f17babc1740 10 client.17676 fetch_fsmap learned FSMap version 34 2024-08-31T05:37:53.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.788+0000 7f17babc1740 1 -- 172.21.15.5:0/667524841 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x561960c842b0 con 0x56196082d1b0 2024-08-31T05:37:53.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.788+0000 7f1791ffb640 1 -- 172.21.15.5:0/667524841 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17a002f020 con 0x56196082d1b0 2024-08-31T05:37:53.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.788+0000 7f1791ffb640 1 -- 172.21.15.5:0/667524841 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f17a0004850 con 0x56196082d1b0 2024-08-31T05:37:53.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.788+0000 7f17babc1740 10 client.17676 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:37:53.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.788+0000 7f17babc1740 10 client.17676 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-31T05:37:53.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.788+0000 7f17babc1740 20 client.17676 populate_metadata read hostname 'smithi005' 2024-08-31T05:37:53.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.788+0000 7f17babc1740 1 --2- 172.21.15.5:0/667524841 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x561960856070 0x561960c86a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:53.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.788+0000 7f17babc1740 4 client.17676 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:37:53.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.788+0000 7f17babc1740 1 -- 172.21.15.5:0/667524841 --> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561960b70070 con 0x561960856070 2024-08-31T05:37:53.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.788+0000 7f17b23e8640 1 --2- 172.21.15.5:0/667524841 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x561960856070 0x561960c86a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:53.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.789+0000 7f1791ffb640 10 client.17676 ms_handle_connect on v2:172.21.15.70:6834/2061504114 2024-08-31T05:37:53.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.789+0000 7f17b23e8640 1 --2- 172.21.15.5:0/667524841 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x561960856070 0x561960c86a90 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5cfad1283989952e server_cookie=d43ecbf17c86f282 in_seq=0 out_seq=0 2024-08-31T05:37:53.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.789+0000 7f1791ffb640 1 -- 172.21.15.5:0/667524841 <== mds.3 v2:172.21.15.70:6834/2061504114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561960b70070 con 0x561960856070 2024-08-31T05:37:53.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.789+0000 7f1791ffb640 10 client.17676 handle_command_reply: tid=0 2024-08-31T05:37:53.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.789+0000 7f17babc1740 1 client.17676 shutdown 2024-08-31T05:37:53.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.789+0000 7f17babc1740 1 -- 172.21.15.5:0/667524841 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56196082d1b0 msgr2=0x561960c0dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:53.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.789+0000 7f17babc1740 1 --2- 172.21.15.5:0/667524841 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56196082d1b0 0x561960c0dcc0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f17a00163d0 tx=0x7f17a00052f0 comp rx=0 tx=0).stop 2024-08-31T05:37:53.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.789+0000 7f17babc1740 1 -- 172.21.15.5:0/667524841 shutdown_connections 2024-08-31T05:37:53.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.789+0000 7f17babc1740 1 --2- 172.21.15.5:0/667524841 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x561960856070 0x561960c86a90 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:53.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.789+0000 7f17babc1740 1 --2- 172.21.15.5:0/667524841 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561960835390 0x561960c7c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:53.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.789+0000 7f1791ffb640 0 client.17676 ms_handle_reset on v2:172.21.15.70:6834/2061504114 2024-08-31T05:37:53.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.789+0000 7f17babc1740 1 --2- 172.21.15.5:0/667524841 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56196082d1b0 0x561960c0dcc0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:53.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.789+0000 7f17babc1740 1 --2- 172.21.15.5:0/667524841 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5619608149f0 0x561960c0d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:53.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.789+0000 7f17babc1740 1 -- 172.21.15.5:0/667524841 >> 172.21.15.5:0/667524841 conn(0x56196084a460 msgr2=0x561960bfcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:53.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.789+0000 7f17babc1740 1 -- 172.21.15.5:0/667524841 shutdown_connections 2024-08-31T05:37:53.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.789+0000 7f17babc1740 1 -- 172.21.15.5:0/667524841 wait complete. 2024-08-31T05:37:53.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.789+0000 7f17babc1740 20 client.17676 trim_cache size 0 max 16384 2024-08-31T05:37:53.796 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:37:53.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.790+0000 7f17b464c640 1 -- 172.21.15.5:0/4139794476 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f17940b4ca0 msgr2=0x7f17940b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:53.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.790+0000 7f17b464c640 1 --2- 172.21.15.5:0/4139794476 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f17940b4ca0 0x7f17940b71b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f17a4037040 tx=0x7f17a4046000 comp rx=0 tx=0).stop 2024-08-31T05:37:53.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.790+0000 7f17b464c640 1 -- 172.21.15.5:0/4139794476 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17ac102800 msgr2=0x7f17ac197f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:53.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.790+0000 7f17b464c640 1 --2- 172.21.15.5:0/4139794476 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17ac102800 0x7f17ac197f70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f179c00ebc0 tx=0x7f179c00c6a0 comp rx=0 tx=0).stop 2024-08-31T05:37:53.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.790+0000 7f17b464c640 1 -- 172.21.15.5:0/4139794476 shutdown_connections 2024-08-31T05:37:53.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.790+0000 7f17b464c640 1 --2- 172.21.15.5:0/4139794476 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f17940b4ca0 0x7f17940b71b0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:53.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.790+0000 7f17b464c640 1 --2- 172.21.15.5:0/4139794476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17ac108a90 0x7f17ac19d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:53.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.790+0000 7f17b464c640 1 --2- 172.21.15.5:0/4139794476 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f17ac108140 0x7f17ac198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:53.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.790+0000 7f17b464c640 1 --2- 172.21.15.5:0/4139794476 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17ac102800 0x7f17ac197f70 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:53.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.790+0000 7f17b464c640 1 -- 172.21.15.5:0/4139794476 >> 172.21.15.5:0/4139794476 conn(0x7f17ac0794d0 msgr2=0x7f17ac1040d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:53.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.790+0000 7f17b464c640 1 -- 172.21.15.5:0/4139794476 shutdown_connections 2024-08-31T05:37:53.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:53.790+0000 7f17b464c640 1 -- 172.21.15.5:0/4139794476 wait complete. 2024-08-31T05:37:53.928 INFO:tasks.workunit.client.0.smithi005.stdout: 1 891851 11.35 MB/sec execute 281 sec latency 47.651 ms 2024-08-31T05:37:54.506 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T05:37:54.803 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:37:54.928 INFO:tasks.workunit.client.0.smithi005.stdout: 1 893982 11.35 MB/sec execute 282 sec latency 17.659 ms 2024-08-31T05:37:55.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:37:54 smithi050 ceph-mon[22146]: pgmap v585: 129 pgs: 129 active+clean; 488 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.0 MiB/s wr, 228 op/s 2024-08-31T05:37:55.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:37:54 smithi005 ceph-mon[18602]: pgmap v585: 129 pgs: 129 active+clean; 488 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.0 MiB/s wr, 228 op/s 2024-08-31T05:37:55.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:37:54 smithi070 ceph-mon[22316]: pgmap v585: 129 pgs: 129 active+clean; 488 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.0 MiB/s wr, 228 op/s 2024-08-31T05:37:55.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.348+0000 7fa365426640 1 -- 172.21.15.5:0/4033691856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa360109290 msgr2=0x7fa3601096a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:55.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.348+0000 7fa365426640 1 --2- 172.21.15.5:0/4033691856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa360109290 0x7fa3601096a0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fa354009900 tx=0x7fa35402a410 comp rx=0 tx=0).stop 2024-08-31T05:37:55.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.348+0000 7fa365426640 1 -- 172.21.15.5:0/4033691856 shutdown_connections 2024-08-31T05:37:55.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.348+0000 7fa365426640 1 --2- 172.21.15.5:0/4033691856 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa360109be0 0x7fa360110410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:55.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.348+0000 7fa365426640 1 --2- 172.21.15.5:0/4033691856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa360109290 0x7fa3601096a0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:55.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.348+0000 7fa365426640 1 --2- 172.21.15.5:0/4033691856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa360103950 0x7fa360103d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:55.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.348+0000 7fa365426640 1 -- 172.21.15.5:0/4033691856 >> 172.21.15.5:0/4033691856 conn(0x7fa3600ff3a0 msgr2=0x7fa3601017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:55.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.348+0000 7fa365426640 1 -- 172.21.15.5:0/4033691856 shutdown_connections 2024-08-31T05:37:55.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.348+0000 7fa365426640 1 -- 172.21.15.5:0/4033691856 wait complete. 2024-08-31T05:37:55.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.348+0000 7fa365426640 1 Processor -- start 2024-08-31T05:37:55.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.349+0000 7fa365426640 1 -- start start 2024-08-31T05:37:55.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.349+0000 7fa365426640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa360103950 0x7fa36019a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:55.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.349+0000 7fa365426640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa360109290 0x7fa36019a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:55.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.349+0000 7fa365426640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa360109be0 0x7fa36019fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:55.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.349+0000 7fa365426640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa3601138f0 con 0x7fa360109290 2024-08-31T05:37:55.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.349+0000 7fa365426640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa360113770 con 0x7fa360103950 2024-08-31T05:37:55.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.349+0000 7fa365426640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa360113a70 con 0x7fa360109be0 2024-08-31T05:37:55.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.349+0000 7fa35e7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa360109290 0x7fa36019a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:55.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.349+0000 7fa35e7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa360109290 0x7fa36019a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50336/0 (socket says 172.21.15.5:50336) 2024-08-31T05:37:55.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.349+0000 7fa35effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa360103950 0x7fa36019a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:55.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.349+0000 7fa35e7fc640 1 -- 172.21.15.5:0/379466869 learned_addr learned my addr 172.21.15.5:0/379466869 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:55.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.349+0000 7fa35f7fe640 1 --2- 172.21.15.5:0/379466869 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa360109be0 0x7fa36019fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:55.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.349+0000 7fa35e7fc640 1 -- 172.21.15.5:0/379466869 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa360109be0 msgr2=0x7fa36019fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:55.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.349+0000 7fa35e7fc640 1 --2- 172.21.15.5:0/379466869 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa360109be0 0x7fa36019fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:55.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.349+0000 7fa35e7fc640 1 -- 172.21.15.5:0/379466869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa360103950 msgr2=0x7fa36019a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:55.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.349+0000 7fa35e7fc640 1 --2- 172.21.15.5:0/379466869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa360103950 0x7fa36019a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:55.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.349+0000 7fa35e7fc640 1 -- 172.21.15.5:0/379466869 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3601a0210 con 0x7fa360109290 2024-08-31T05:37:55.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.350+0000 7fa35e7fc640 1 --2- 172.21.15.5:0/379466869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa360109290 0x7fa36019a840 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fa354005ab0 tx=0x7fa354003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:55.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.350+0000 7fa347fff640 1 -- 172.21.15.5:0/379466869 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa35403f070 con 0x7fa360109290 2024-08-31T05:37:55.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.350+0000 7fa365426640 1 -- 172.21.15.5:0/379466869 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3601a04a0 con 0x7fa360109290 2024-08-31T05:37:55.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.350+0000 7fa347fff640 1 -- 172.21.15.5:0/379466869 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa354031b50 con 0x7fa360109290 2024-08-31T05:37:55.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.350+0000 7fa347fff640 1 -- 172.21.15.5:0/379466869 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa354035030 con 0x7fa360109290 2024-08-31T05:37:55.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.350+0000 7fa365426640 1 -- 172.21.15.5:0/379466869 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3601a6c60 con 0x7fa360109290 2024-08-31T05:37:55.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.352+0000 7fa36b99b740 1 Processor -- start 2024-08-31T05:37:55.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.352+0000 7fa36b99b740 1 -- start start 2024-08-31T05:37:55.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.353+0000 7fa36b99b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55be1ba07070 0x55be1bdac310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:55.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.353+0000 7fa36b99b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55be1b9de1b0 0x55be1bdac850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:55.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.353+0000 7fa36b99b740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55be1b9e6390 0x55be1bdacd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:55.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.353+0000 7fa36b99b740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55be1bd23680 con 0x55be1b9e6390 2024-08-31T05:37:55.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.353+0000 7fa36b99b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55be1bd12c10 con 0x55be1ba07070 2024-08-31T05:37:55.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.353+0000 7fa36b99b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55be1bd16bc0 con 0x55be1b9de1b0 2024-08-31T05:37:55.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.353+0000 7fa347fff640 1 -- 172.21.15.5:0/379466869 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fa354042070 con 0x7fa360109290 2024-08-31T05:37:55.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.353+0000 7fa35f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55be1ba07070 0x55be1bdac310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:55.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.353+0000 7fa35effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55be1b9de1b0 0x55be1bdac850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:55.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.353+0000 7fa35f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55be1ba07070 0x55be1bdac310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:57652/0 (socket says 172.21.15.5:57652) 2024-08-31T05:37:55.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.353+0000 7fa35f7fe640 1 -- 172.21.15.5:0/2396013071 learned_addr learned my addr 172.21.15.5:0/2396013071 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:55.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.353+0000 7fa35e7fc640 1 --2- 172.21.15.5:0/2396013071 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55be1b9e6390 0x55be1bdacd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:55.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.353+0000 7fa35f7fe640 1 -- 172.21.15.5:0/2396013071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55be1b9de1b0 msgr2=0x55be1bdac850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:55.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.353+0000 7fa35f7fe640 1 --2- 172.21.15.5:0/2396013071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55be1b9de1b0 0x55be1bdac850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:55.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.353+0000 7fa35f7fe640 1 -- 172.21.15.5:0/2396013071 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55be1b9e6390 msgr2=0x55be1bdacd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:55.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.353+0000 7fa35f7fe640 1 --2- 172.21.15.5:0/2396013071 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55be1b9e6390 0x55be1bdacd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:55.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.353+0000 7fa35f7fe640 1 -- 172.21.15.5:0/2396013071 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be1ba72650 con 0x55be1ba07070 2024-08-31T05:37:55.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.353+0000 7fa35e7fc640 1 --2- 172.21.15.5:0/2396013071 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55be1b9e6390 0x55be1bdacd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:37:55.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.354+0000 7fa35f7fe640 1 --2- 172.21.15.5:0/2396013071 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55be1ba07070 0x55be1bdac310 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa358009fd0 tx=0x7fa3580118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f6bf4a15363bd11 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:55.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.354+0000 7fa347fff640 1 --2- 172.21.15.5:0/379466869 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa3480b4ca0 0x7fa3480b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:55.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.354+0000 7fa3457fa640 1 -- 172.21.15.5:0/2396013071 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa358004d20 con 0x55be1ba07070 2024-08-31T05:37:55.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.354+0000 7fa35effd640 1 --2- 172.21.15.5:0/379466869 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa3480b4ca0 0x7fa3480b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:55.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.354+0000 7fa347fff640 1 -- 172.21.15.5:0/379466869 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7fa354105ef0 con 0x7fa360109290 2024-08-31T05:37:55.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.354+0000 7fa3457fa640 1 -- 172.21.15.5:0/2396013071 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa358004050 con 0x55be1ba07070 2024-08-31T05:37:55.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.354+0000 7fa3457fa640 1 -- 172.21.15.5:0/2396013071 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa358005280 con 0x55be1ba07070 2024-08-31T05:37:55.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.355+0000 7fa36b99b740 1 -- 172.21.15.5:0/2396013071 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55be1ba07070 msgr2=0x55be1bdac310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:55.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.355+0000 7fa36b99b740 1 --2- 172.21.15.5:0/2396013071 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55be1ba07070 0x55be1bdac310 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa358009fd0 tx=0x7fa3580118d0 comp rx=0 tx=0).stop 2024-08-31T05:37:55.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.355+0000 7fa35effd640 1 --2- 172.21.15.5:0/379466869 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa3480b4ca0 0x7fa3480b71b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x55be1bdaaf90 tx=0x7fa350015040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:55.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.355+0000 7fa36b99b740 1 -- 172.21.15.5:0/2396013071 shutdown_connections 2024-08-31T05:37:55.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.355+0000 7fa36b99b740 1 --2- 172.21.15.5:0/2396013071 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55be1b9e6390 0x55be1bdacd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:55.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.355+0000 7fa36b99b740 1 --2- 172.21.15.5:0/2396013071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55be1b9de1b0 0x55be1bdac850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:55.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.355+0000 7fa36b99b740 1 --2- 172.21.15.5:0/2396013071 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55be1ba07070 0x55be1bdac310 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:55.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.355+0000 7fa36b99b740 1 -- 172.21.15.5:0/2396013071 >> 172.21.15.5:0/2396013071 conn(0x55be1b9fb460 msgr2=0x55be1bdaa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:55.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.355+0000 7fa36b99b740 1 -- 172.21.15.5:0/2396013071 shutdown_connections 2024-08-31T05:37:55.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.355+0000 7fa36b99b740 1 -- 172.21.15.5:0/2396013071 wait complete. 2024-08-31T05:37:55.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.355+0000 7fa36b99b740 1 -- start start 2024-08-31T05:37:55.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.356+0000 7fa36b99b740 1 Processor -- start 2024-08-31T05:37:55.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.356+0000 7fa36b99b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55be1b9de1b0 0x55be1bdb7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:55.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.356+0000 7fa36b99b740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55be1b9e6390 0x55be1bdb7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:55.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.356+0000 7fa36b99b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55be1ba07070 0x55be1bdc3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:55.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.356+0000 7fa36b99b740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55be1bb75700 con 0x55be1b9e6390 2024-08-31T05:37:55.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.356+0000 7fa36b99b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55be1bc99750 con 0x55be1b9de1b0 2024-08-31T05:37:55.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.356+0000 7fa36b99b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55be1bdbaaf0 con 0x55be1ba07070 2024-08-31T05:37:55.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.356+0000 7fa36b99b740 10 client.0 _ll_register_callbacks cb 0x55be1bcc8e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:37:55.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.356+0000 7fa35e7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55be1b9e6390 0x55be1bdb7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:55.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.356+0000 7fa35e7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55be1b9e6390 0x55be1bdb7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50352/0 (socket says 172.21.15.5:50352) 2024-08-31T05:37:55.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.356+0000 7fa35effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55be1b9de1b0 0x55be1bdb7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:55.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.356+0000 7fa35e7fc640 1 -- 172.21.15.5:0/2592504052 learned_addr learned my addr 172.21.15.5:0/2592504052 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:55.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.356+0000 7fa35f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55be1ba07070 0x55be1bdc3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:55.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.356+0000 7fa35e7fc640 1 -- 172.21.15.5:0/2592504052 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55be1ba07070 msgr2=0x55be1bdc3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:55.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.356+0000 7fa35e7fc640 1 --2- 172.21.15.5:0/2592504052 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55be1ba07070 0x55be1bdc3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:55.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.356+0000 7fa35e7fc640 1 -- 172.21.15.5:0/2592504052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55be1b9de1b0 msgr2=0x55be1bdb7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:55.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.356+0000 7fa35e7fc640 1 --2- 172.21.15.5:0/2592504052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55be1b9de1b0 0x55be1bdb7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:55.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.356+0000 7fa35e7fc640 1 -- 172.21.15.5:0/2592504052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be1bcd2900 con 0x55be1b9e6390 2024-08-31T05:37:55.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.356+0000 7fa35effd640 1 --2- 172.21.15.5:0/2592504052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55be1b9de1b0 0x55be1bdb7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:37:55.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.357+0000 7fa35e7fc640 1 --2- 172.21.15.5:0/2592504052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55be1b9e6390 0x55be1bdb7fd0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fa354006010 tx=0x7fa354000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f39349b8c75cd3f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:55.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.357+0000 7fa342ff5640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:37:55.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.357+0000 7fa342ff5640 1 -- 172.21.15.5:0/2592504052 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa354049030 con 0x55be1b9e6390 2024-08-31T05:37:55.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.357+0000 7fa36b99b740 1 -- 172.21.15.5:0/2592504052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa358004050 con 0x55be1b9e6390 2024-08-31T05:37:55.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.357+0000 7fa342ff5640 1 -- 172.21.15.5:0/2592504052 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7fa354103480 con 0x55be1b9e6390 2024-08-31T05:37:55.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.357+0000 7fa342ff5640 1 -- 172.21.15.5:0/2592504052 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fa3540cb9c0 con 0x55be1b9e6390 2024-08-31T05:37:55.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.357+0000 7fa36b99b740 10 client.17688 fetch_fsmap learned FSMap version 34 2024-08-31T05:37:55.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.357+0000 7fa36b99b740 1 -- 172.21.15.5:0/2592504052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55be1bdc6900 con 0x55be1b9e6390 2024-08-31T05:37:55.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.357+0000 7fa342ff5640 1 -- 172.21.15.5:0/2592504052 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa358004050 con 0x55be1b9e6390 2024-08-31T05:37:55.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.357+0000 7fa342ff5640 1 -- 172.21.15.5:0/2592504052 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fa3540cc4b0 con 0x55be1b9e6390 2024-08-31T05:37:55.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.357+0000 7fa36b99b740 10 client.17688 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:37:55.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.357+0000 7fa36b99b740 10 client.17688 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-31T05:37:55.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.357+0000 7fa36b99b740 20 client.17688 populate_metadata read hostname 'smithi005' 2024-08-31T05:37:55.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.358+0000 7fa36b99b740 1 --2- 172.21.15.5:0/2592504052 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55be1b9c59f0 0x55be1bdc9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:55.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.358+0000 7fa36b99b740 4 client.17688 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:37:55.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.358+0000 7fa36b99b740 1 -- 172.21.15.5:0/2592504052 --> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55be1bd255d0 con 0x55be1b9c59f0 2024-08-31T05:37:55.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.358+0000 7fa35effd640 1 --2- 172.21.15.5:0/2592504052 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55be1b9c59f0 0x55be1bdc9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:55.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.358+0000 7fa35effd640 1 --2- 172.21.15.5:0/2592504052 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55be1b9c59f0 0x55be1bdc9d40 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fcfbfa85120c90ba server_cookie=ca568cb147069e33 in_seq=0 out_seq=0 2024-08-31T05:37:55.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.358+0000 7fa342ff5640 10 client.17688 ms_handle_connect on v2:172.21.15.70:6836/2780036414 2024-08-31T05:37:55.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.359+0000 7fa342ff5640 1 -- 172.21.15.5:0/2592504052 <== mds.2 v2:172.21.15.70:6836/2780036414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55be1bd255d0 con 0x55be1b9c59f0 2024-08-31T05:37:55.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.359+0000 7fa342ff5640 10 client.17688 handle_command_reply: tid=0 2024-08-31T05:37:55.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.360+0000 7fa36b99b740 1 client.17688 shutdown 2024-08-31T05:37:55.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.360+0000 7fa36b99b740 1 -- 172.21.15.5:0/2592504052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55be1b9e6390 msgr2=0x55be1bdb7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:55.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.360+0000 7fa36b99b740 1 --2- 172.21.15.5:0/2592504052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55be1b9e6390 0x55be1bdb7fd0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fa354006010 tx=0x7fa354000bc0 comp rx=0 tx=0).stop 2024-08-31T05:37:55.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.360+0000 7fa36b99b740 1 -- 172.21.15.5:0/2592504052 shutdown_connections 2024-08-31T05:37:55.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.360+0000 7fa36b99b740 1 --2- 172.21.15.5:0/2592504052 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55be1b9c59f0 0x55be1bdc9d40 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:55.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.360+0000 7fa36b99b740 1 --2- 172.21.15.5:0/2592504052 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55be1ba07070 0x55be1bdc3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:55.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.360+0000 7fa36b99b740 1 --2- 172.21.15.5:0/2592504052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55be1b9e6390 0x55be1bdb7fd0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:55.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.360+0000 7fa36b99b740 1 --2- 172.21.15.5:0/2592504052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55be1b9de1b0 0x55be1bdb7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:55.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.360+0000 7fa36b99b740 1 -- 172.21.15.5:0/2592504052 >> 172.21.15.5:0/2592504052 conn(0x55be1b9fb460 msgr2=0x55be1bdaf4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:55.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.360+0000 7fa342ff5640 0 client.17688 ms_handle_reset on v2:172.21.15.70:6836/2780036414 2024-08-31T05:37:55.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.360+0000 7fa36b99b740 1 -- 172.21.15.5:0/2592504052 shutdown_connections 2024-08-31T05:37:55.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.360+0000 7fa36b99b740 1 -- 172.21.15.5:0/2592504052 wait complete. 2024-08-31T05:37:55.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.360+0000 7fa36b99b740 20 client.17688 trim_cache size 0 max 16384 2024-08-31T05:37:55.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.373+0000 7fa36b99b740 1 Processor -- start 2024-08-31T05:37:55.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.373+0000 7fa36b99b740 1 -- start start 2024-08-31T05:37:55.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.374+0000 7fa36b99b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55be1b9de1b0 0x55be1bdaf410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:55.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.374+0000 7fa36b99b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55be1b9e6390 0x55be1bdaf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:55.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.374+0000 7fa36b99b740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55be1ba07070 0x55be1bdb4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:55.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.374+0000 7fa36b99b740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa3601aeaa0 con 0x55be1ba07070 2024-08-31T05:37:55.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.374+0000 7fa36b99b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa3601b05e0 con 0x55be1b9de1b0 2024-08-31T05:37:55.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.374+0000 7fa36b99b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa3601af170 con 0x55be1b9e6390 2024-08-31T05:37:55.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.374+0000 7fa35effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55be1b9de1b0 0x55be1bdaf410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:55.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.374+0000 7fa35f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55be1ba07070 0x55be1bdb4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:55.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.374+0000 7fa35e7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55be1b9e6390 0x55be1bdaf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:55.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.374+0000 7fa35f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55be1ba07070 0x55be1bdb4c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50364/0 (socket says 172.21.15.5:50364) 2024-08-31T05:37:55.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.374+0000 7fa35effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55be1b9de1b0 0x55be1bdaf410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:57668/0 (socket says 172.21.15.5:57668) 2024-08-31T05:37:55.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.374+0000 7fa35f7fe640 1 -- 172.21.15.5:0/1986239132 learned_addr learned my addr 172.21.15.5:0/1986239132 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:55.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.374+0000 7fa35f7fe640 1 -- 172.21.15.5:0/1986239132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55be1b9e6390 msgr2=0x55be1bdaf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:55.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.374+0000 7fa35f7fe640 1 --2- 172.21.15.5:0/1986239132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55be1b9e6390 0x55be1bdaf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:55.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.374+0000 7fa35f7fe640 1 -- 172.21.15.5:0/1986239132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55be1b9de1b0 msgr2=0x55be1bdaf410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:55.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.374+0000 7fa35f7fe640 1 --2- 172.21.15.5:0/1986239132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55be1b9de1b0 0x55be1bdaf410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:55.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.374+0000 7fa35f7fe640 1 -- 172.21.15.5:0/1986239132 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be1bdba1d0 con 0x55be1ba07070 2024-08-31T05:37:55.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.374+0000 7fa35effd640 1 --2- 172.21.15.5:0/1986239132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55be1b9de1b0 0x55be1bdaf410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:37:55.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.374+0000 7fa35f7fe640 1 --2- 172.21.15.5:0/1986239132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55be1ba07070 0x55be1bdb4c80 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fa358006010 tx=0x7fa358009be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4248ff4d03bf7dd9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:55.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.375+0000 7fa344ff9640 1 -- 172.21.15.5:0/1986239132 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa358003a30 con 0x55be1ba07070 2024-08-31T05:37:55.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.375+0000 7fa344ff9640 1 -- 172.21.15.5:0/1986239132 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa358004e50 con 0x55be1ba07070 2024-08-31T05:37:55.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.375+0000 7fa344ff9640 1 -- 172.21.15.5:0/1986239132 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa358005030 con 0x55be1ba07070 2024-08-31T05:37:55.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.375+0000 7fa36b99b740 1 -- 172.21.15.5:0/1986239132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55be1ba07070 msgr2=0x55be1bdb4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:55.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.375+0000 7fa36b99b740 1 --2- 172.21.15.5:0/1986239132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55be1ba07070 0x55be1bdb4c80 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fa358006010 tx=0x7fa358009be0 comp rx=0 tx=0).stop 2024-08-31T05:37:55.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.376+0000 7fa36b99b740 1 -- 172.21.15.5:0/1986239132 shutdown_connections 2024-08-31T05:37:55.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.376+0000 7fa36b99b740 1 --2- 172.21.15.5:0/1986239132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55be1ba07070 0x55be1bdb4c80 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:55.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.376+0000 7fa36b99b740 1 --2- 172.21.15.5:0/1986239132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55be1b9e6390 0x55be1bdaf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:55.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.376+0000 7fa36b99b740 1 --2- 172.21.15.5:0/1986239132 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55be1b9de1b0 0x55be1bdaf410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:55.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.376+0000 7fa36b99b740 1 -- 172.21.15.5:0/1986239132 >> 172.21.15.5:0/1986239132 conn(0x55be1b9fb460 msgr2=0x55be1bdb7a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:55.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.376+0000 7fa36b99b740 1 -- 172.21.15.5:0/1986239132 shutdown_connections 2024-08-31T05:37:55.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.376+0000 7fa36b99b740 1 -- 172.21.15.5:0/1986239132 wait complete. 2024-08-31T05:37:55.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.376+0000 7fa36b99b740 1 -- start start 2024-08-31T05:37:55.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.376+0000 7fa36b99b740 1 Processor -- start 2024-08-31T05:37:55.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.376+0000 7fa36b99b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55be1b9de1b0 0x55be1bdbbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:55.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.376+0000 7fa36b99b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55be1b9e6390 0x55be1bdbc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:55.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.376+0000 7fa36b99b740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55be1ba07070 0x55be1bdbc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:55.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.376+0000 7fa36b99b740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa3601aff10 con 0x55be1ba07070 2024-08-31T05:37:55.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.376+0000 7fa36b99b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa3601af840 con 0x55be1b9e6390 2024-08-31T05:37:55.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.376+0000 7fa36b99b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa3601acaa0 con 0x55be1b9de1b0 2024-08-31T05:37:55.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.376+0000 7fa36b99b740 10 client.0 _ll_register_callbacks cb 0x7fa354005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:37:55.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.377+0000 7fa35effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55be1b9de1b0 0x55be1bdbbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:55.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.377+0000 7fa35e7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55be1b9e6390 0x55be1bdbc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:55.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.377+0000 7fa35effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55be1b9de1b0 0x55be1bdbbf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:33610/0 (socket says 172.21.15.5:33610) 2024-08-31T05:37:55.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.377+0000 7fa35f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55be1ba07070 0x55be1bdbc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:55.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.377+0000 7fa35effd640 1 -- 172.21.15.5:0/1530658973 learned_addr learned my addr 172.21.15.5:0/1530658973 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:55.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.377+0000 7fa35e7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55be1b9e6390 0x55be1bdbc460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:57678/0 (socket says 172.21.15.5:57678) 2024-08-31T05:37:55.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.377+0000 7fa35effd640 1 -- 172.21.15.5:0/1530658973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55be1b9e6390 msgr2=0x55be1bdbc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:55.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.377+0000 7fa35effd640 1 --2- 172.21.15.5:0/1530658973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55be1b9e6390 0x55be1bdbc460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:55.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.377+0000 7fa35effd640 1 -- 172.21.15.5:0/1530658973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55be1ba07070 msgr2=0x55be1bdbc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:55.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.377+0000 7fa35effd640 1 --2- 172.21.15.5:0/1530658973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55be1ba07070 0x55be1bdbc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:55.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.377+0000 7fa35effd640 1 -- 172.21.15.5:0/1530658973 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be1be33900 con 0x55be1b9de1b0 2024-08-31T05:37:55.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.377+0000 7fa35e7fc640 1 --2- 172.21.15.5:0/1530658973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55be1b9e6390 0x55be1bdbc460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:37:55.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.377+0000 7fa35effd640 1 --2- 172.21.15.5:0/1530658973 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55be1b9de1b0 0x55be1bdbbf20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa350003760 tx=0x7fa3500046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56566955ace2d405 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:55.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.377+0000 7fa342ff5640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:37:55.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.377+0000 7fa342ff5640 1 -- 172.21.15.5:0/1530658973 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa350025040 con 0x55be1b9de1b0 2024-08-31T05:37:55.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.377+0000 7fa342ff5640 1 -- 172.21.15.5:0/1530658973 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7fa35000ea00 con 0x55be1b9de1b0 2024-08-31T05:37:55.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.377+0000 7fa36b99b740 1 -- 172.21.15.5:0/1530658973 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa358004e50 con 0x55be1b9de1b0 2024-08-31T05:37:55.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.378+0000 7fa342ff5640 1 -- 172.21.15.5:0/1530658973 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fa350044050 con 0x55be1b9de1b0 2024-08-31T05:37:55.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.378+0000 7fa36b99b740 10 client.27274 fetch_fsmap learned FSMap version 34 2024-08-31T05:37:55.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.378+0000 7fa36b99b740 1 -- 172.21.15.5:0/1530658973 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55be1be34bf0 con 0x55be1b9de1b0 2024-08-31T05:37:55.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.378+0000 7fa342ff5640 1 -- 172.21.15.5:0/1530658973 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa358004e50 con 0x55be1b9de1b0 2024-08-31T05:37:55.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.378+0000 7fa342ff5640 1 -- 172.21.15.5:0/1530658973 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fa35002c430 con 0x55be1b9de1b0 2024-08-31T05:37:55.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.378+0000 7fa36b99b740 10 client.27274 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:37:55.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.378+0000 7fa36b99b740 10 client.27274 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-31T05:37:55.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.378+0000 7fa36b99b740 20 client.27274 populate_metadata read hostname 'smithi005' 2024-08-31T05:37:55.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.378+0000 7fa36b99b740 1 --2- 172.21.15.5:0/1530658973 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55be1b99ada0 0x55be1be37410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:55.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.378+0000 7fa36b99b740 4 client.27274 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:37:55.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.378+0000 7fa36b99b740 1 -- 172.21.15.5:0/1530658973 --> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55be1bd21070 con 0x55be1b99ada0 2024-08-31T05:37:55.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.378+0000 7fa35e7fc640 1 --2- 172.21.15.5:0/1530658973 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55be1b99ada0 0x55be1be37410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:55.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.379+0000 7fa35e7fc640 1 --2- 172.21.15.5:0/1530658973 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55be1b99ada0 0x55be1be37410 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6bf1848d4aa62eb9 server_cookie=d8e4d0c148facb67 in_seq=0 out_seq=0 2024-08-31T05:37:55.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.379+0000 7fa342ff5640 10 client.27274 ms_handle_connect on v2:172.21.15.70:6836/2780036414 2024-08-31T05:37:55.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.379+0000 7fa342ff5640 1 -- 172.21.15.5:0/1530658973 <== mds.2 v2:172.21.15.70:6836/2780036414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55be1bd21070 con 0x55be1b99ada0 2024-08-31T05:37:55.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.379+0000 7fa342ff5640 10 client.27274 handle_command_reply: tid=0 2024-08-31T05:37:55.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.379+0000 7fa36b99b740 1 client.27274 shutdown 2024-08-31T05:37:55.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.379+0000 7fa36b99b740 1 -- 172.21.15.5:0/1530658973 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55be1b9de1b0 msgr2=0x55be1bdbbf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:55.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.379+0000 7fa36b99b740 1 --2- 172.21.15.5:0/1530658973 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55be1b9de1b0 0x55be1bdbbf20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa350003760 tx=0x7fa3500046c0 comp rx=0 tx=0).stop 2024-08-31T05:37:55.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.379+0000 7fa36b99b740 1 -- 172.21.15.5:0/1530658973 shutdown_connections 2024-08-31T05:37:55.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.379+0000 7fa36b99b740 1 --2- 172.21.15.5:0/1530658973 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55be1b99ada0 0x55be1be37410 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:55.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.379+0000 7fa36b99b740 1 --2- 172.21.15.5:0/1530658973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55be1ba07070 0x55be1bdbc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:55.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.379+0000 7fa36b99b740 1 --2- 172.21.15.5:0/1530658973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55be1b9e6390 0x55be1bdbc460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:55.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.379+0000 7fa342ff5640 0 client.27274 ms_handle_reset on v2:172.21.15.70:6836/2780036414 2024-08-31T05:37:55.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.379+0000 7fa36b99b740 1 --2- 172.21.15.5:0/1530658973 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55be1b9de1b0 0x55be1bdbbf20 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:55.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.379+0000 7fa36b99b740 1 -- 172.21.15.5:0/1530658973 >> 172.21.15.5:0/1530658973 conn(0x55be1b9fb460 msgr2=0x55be1bdaf410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:55.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.379+0000 7fa36b99b740 1 -- 172.21.15.5:0/1530658973 shutdown_connections 2024-08-31T05:37:55.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.379+0000 7fa36b99b740 1 -- 172.21.15.5:0/1530658973 wait complete. 2024-08-31T05:37:55.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.379+0000 7fa36b99b740 20 client.27274 trim_cache size 0 max 16384 2024-08-31T05:37:55.397 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:37:55.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.380+0000 7fa365426640 1 -- 172.21.15.5:0/379466869 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa3480b4ca0 msgr2=0x7fa3480b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:55.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.380+0000 7fa365426640 1 --2- 172.21.15.5:0/379466869 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa3480b4ca0 0x7fa3480b71b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x55be1bdaaf90 tx=0x7fa350015040 comp rx=0 tx=0).stop 2024-08-31T05:37:55.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.380+0000 7fa365426640 1 -- 172.21.15.5:0/379466869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa360109290 msgr2=0x7fa36019a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:55.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.380+0000 7fa365426640 1 --2- 172.21.15.5:0/379466869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa360109290 0x7fa36019a840 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fa354005ab0 tx=0x7fa354003b90 comp rx=0 tx=0).stop 2024-08-31T05:37:55.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.380+0000 7fa365426640 1 -- 172.21.15.5:0/379466869 shutdown_connections 2024-08-31T05:37:55.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.380+0000 7fa365426640 1 --2- 172.21.15.5:0/379466869 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa3480b4ca0 0x7fa3480b71b0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:55.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.380+0000 7fa365426640 1 --2- 172.21.15.5:0/379466869 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa360109be0 0x7fa36019fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:55.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.380+0000 7fa365426640 1 --2- 172.21.15.5:0/379466869 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa360109290 0x7fa36019a840 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:55.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.380+0000 7fa365426640 1 --2- 172.21.15.5:0/379466869 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa360103950 0x7fa36019a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:55.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.380+0000 7fa365426640 1 -- 172.21.15.5:0/379466869 >> 172.21.15.5:0/379466869 conn(0x7fa3600ff3a0 msgr2=0x7fa3601017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:55.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.380+0000 7fa365426640 1 -- 172.21.15.5:0/379466869 shutdown_connections 2024-08-31T05:37:55.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:55.380+0000 7fa365426640 1 -- 172.21.15.5:0/379466869 wait complete. 2024-08-31T05:37:55.928 INFO:tasks.workunit.client.0.smithi005.stdout: 1 895707 11.35 MB/sec execute 283 sec latency 57.163 ms 2024-08-31T05:37:56.177 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T05:37:56.444 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:37:56.929 INFO:tasks.workunit.client.0.smithi005.stdout: 1 898272 11.36 MB/sec execute 284 sec latency 41.308 ms 2024-08-31T05:37:57.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.078+0000 7fd104bbd640 1 -- 172.21.15.5:0/1830127462 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd100108a90 msgr2=0x7fd10010f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:57.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.078+0000 7fd104bbd640 1 --2- 172.21.15.5:0/1830127462 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd100108a90 0x7fd10010f2c0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fd0f8009ca0 tx=0x7fd0f802a8c0 comp rx=0 tx=0).stop 2024-08-31T05:37:57.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.079+0000 7fd104bbd640 1 -- 172.21.15.5:0/1830127462 shutdown_connections 2024-08-31T05:37:57.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.079+0000 7fd104bbd640 1 --2- 172.21.15.5:0/1830127462 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd100108a90 0x7fd10010f2c0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:57.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.079+0000 7fd104bbd640 1 --2- 172.21.15.5:0/1830127462 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd100108140 0x7fd100108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:57.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.079+0000 7fd104bbd640 1 --2- 172.21.15.5:0/1830127462 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd100102800 0x7fd100102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:57.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.079+0000 7fd104bbd640 1 -- 172.21.15.5:0/1830127462 >> 172.21.15.5:0/1830127462 conn(0x7fd1000794d0 msgr2=0x7fd1000798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:57.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.079+0000 7fd104bbd640 1 -- 172.21.15.5:0/1830127462 shutdown_connections 2024-08-31T05:37:57.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.079+0000 7fd104bbd640 1 -- 172.21.15.5:0/1830127462 wait complete. 2024-08-31T05:37:57.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.079+0000 7fd104bbd640 1 Processor -- start 2024-08-31T05:37:57.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.080+0000 7fd104bbd640 1 -- start start 2024-08-31T05:37:57.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.080+0000 7fd104bbd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd100102800 0x7fd10019b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:57.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.080+0000 7fd104bbd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd100108140 0x7fd10019b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:57.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.080+0000 7fd104bbd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd100108a90 0x7fd10019bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:57.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.080+0000 7fd104bbd640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd100112710 con 0x7fd100108140 2024-08-31T05:37:57.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.080+0000 7fd104bbd640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd100112590 con 0x7fd100108a90 2024-08-31T05:37:57.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.080+0000 7fd104bbd640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd100112890 con 0x7fd100102800 2024-08-31T05:37:57.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.080+0000 7fd0fdd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd100108140 0x7fd10019b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:57.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.080+0000 7fd0fe59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd100102800 0x7fd10019b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:57.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.080+0000 7fd0fe59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd100102800 0x7fd10019b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:33618/0 (socket says 172.21.15.5:33618) 2024-08-31T05:37:57.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.080+0000 7fd0fe59c640 1 -- 172.21.15.5:0/2300551526 learned_addr learned my addr 172.21.15.5:0/2300551526 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:57.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.080+0000 7fd0fdd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd100108140 0x7fd10019b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50392/0 (socket says 172.21.15.5:50392) 2024-08-31T05:37:57.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.080+0000 7fd0fed9d640 1 --2- 172.21.15.5:0/2300551526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd100108a90 0x7fd10019bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:57.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.080+0000 7fd0fdd9b640 1 -- 172.21.15.5:0/2300551526 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd100102800 msgr2=0x7fd10019b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:57.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.080+0000 7fd0fdd9b640 1 --2- 172.21.15.5:0/2300551526 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd100102800 0x7fd10019b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:57.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.080+0000 7fd0fdd9b640 1 -- 172.21.15.5:0/2300551526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd100108a90 msgr2=0x7fd10019bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:57.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.080+0000 7fd0fdd9b640 1 --2- 172.21.15.5:0/2300551526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd100108a90 0x7fd10019bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:57.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.080+0000 7fd0fdd9b640 1 -- 172.21.15.5:0/2300551526 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd100198e70 con 0x7fd100108140 2024-08-31T05:37:57.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.080+0000 7fd0fe59c640 1 --2- 172.21.15.5:0/2300551526 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd100102800 0x7fd10019b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:37:57.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.081+0000 7fd0fdd9b640 1 --2- 172.21.15.5:0/2300551526 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd100108140 0x7fd10019b5c0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fd0f400e9c0 tx=0x7fd0f400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:57.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.081+0000 7fd0ef7fe640 1 -- 172.21.15.5:0/2300551526 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f400ccc0 con 0x7fd100108140 2024-08-31T05:37:57.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.081+0000 7fd0ef7fe640 1 -- 172.21.15.5:0/2300551526 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0f4005020 con 0x7fd100108140 2024-08-31T05:37:57.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.081+0000 7fd0ef7fe640 1 -- 172.21.15.5:0/2300551526 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f4004a00 con 0x7fd100108140 2024-08-31T05:37:57.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.081+0000 7fd104bbd640 1 -- 172.21.15.5:0/2300551526 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd100199160 con 0x7fd100108140 2024-08-31T05:37:57.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.081+0000 7fd104bbd640 1 -- 172.21.15.5:0/2300551526 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd100199650 con 0x7fd100108140 2024-08-31T05:37:57.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.084+0000 7fd10b132740 1 Processor -- start 2024-08-31T05:37:57.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.084+0000 7fd0ef7fe640 1 -- 172.21.15.5:0/2300551526 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fd0f4004ba0 con 0x7fd100108140 2024-08-31T05:37:57.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.084+0000 7fd10b132740 1 -- start start 2024-08-31T05:37:57.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.085+0000 7fd10b132740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588357ae070 0x558835b53310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:57.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.085+0000 7fd10b132740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588357851b0 0x558835b53850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:57.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.085+0000 7fd10b132740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55883578d390 0x558835b53d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:57.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.085+0000 7fd10b132740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x558835aca680 con 0x55883578d390 2024-08-31T05:37:57.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.085+0000 7fd10b132740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558835ab9c10 con 0x5588357851b0 2024-08-31T05:37:57.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.085+0000 7fd10b132740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558835abdbc0 con 0x5588357ae070 2024-08-31T05:37:57.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.085+0000 7fd0fed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588357ae070 0x558835b53310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:57.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.085+0000 7fd0fe59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588357851b0 0x558835b53850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:57.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.085+0000 7fd0fdd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55883578d390 0x558835b53d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:57.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.085+0000 7fd0fe59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588357851b0 0x558835b53850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:57710/0 (socket says 172.21.15.5:57710) 2024-08-31T05:37:57.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.085+0000 7fd0fe59c640 1 -- 172.21.15.5:0/3274004567 learned_addr learned my addr 172.21.15.5:0/3274004567 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:57.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.085+0000 7fd0fed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588357ae070 0x558835b53310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:33626/0 (socket says 172.21.15.5:33626) 2024-08-31T05:37:57.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.085+0000 7fd0fe59c640 1 -- 172.21.15.5:0/3274004567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588357ae070 msgr2=0x558835b53310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:57.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.085+0000 7fd0fe59c640 1 --2- 172.21.15.5:0/3274004567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588357ae070 0x558835b53310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:57.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.085+0000 7fd0fe59c640 1 -- 172.21.15.5:0/3274004567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55883578d390 msgr2=0x558835b53d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:57.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.085+0000 7fd0fe59c640 1 --2- 172.21.15.5:0/3274004567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55883578d390 0x558835b53d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:57.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.085+0000 7fd0fe59c640 1 -- 172.21.15.5:0/3274004567 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558835819650 con 0x5588357851b0 2024-08-31T05:37:57.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.085+0000 7fd0ef7fe640 1 --2- 172.21.15.5:0/2300551526 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd0e80b4cd0 0x7fd0e80b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:57.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.085+0000 7fd0fed9d640 1 --2- 172.21.15.5:0/3274004567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588357ae070 0x558835b53310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:37:57.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.085+0000 7fd0fe59c640 1 --2- 172.21.15.5:0/3274004567 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588357851b0 0x558835b53850 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd0f0010580 tx=0x7fd0f0010a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c23c4ee001cec47a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:57.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.085+0000 7fd0fed9d640 1 --2- 172.21.15.5:0/2300551526 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd0e80b4cd0 0x7fd0e80b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:57.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.085+0000 7fd0ef7fe640 1 -- 172.21.15.5:0/2300551526 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7fd0f40e5800 con 0x7fd100108140 2024-08-31T05:37:57.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.086+0000 7fd0ecff9640 1 -- 172.21.15.5:0/3274004567 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f000e830 con 0x5588357851b0 2024-08-31T05:37:57.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.086+0000 7fd0ecff9640 1 -- 172.21.15.5:0/3274004567 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0f000ee80 con 0x5588357851b0 2024-08-31T05:37:57.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.086+0000 7fd0ecff9640 1 -- 172.21.15.5:0/3274004567 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f001b430 con 0x5588357851b0 2024-08-31T05:37:57.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.087+0000 7fd10b132740 1 -- 172.21.15.5:0/3274004567 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588357851b0 msgr2=0x558835b53850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:57.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.087+0000 7fd0fed9d640 1 --2- 172.21.15.5:0/2300551526 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd0e80b4cd0 0x7fd0e80b71e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd0f8009a60 tx=0x7fd0f802f470 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:57.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.087+0000 7fd10b132740 1 --2- 172.21.15.5:0/3274004567 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588357851b0 0x558835b53850 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd0f0010580 tx=0x7fd0f0010a40 comp rx=0 tx=0).stop 2024-08-31T05:37:57.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.087+0000 7fd10b132740 1 -- 172.21.15.5:0/3274004567 shutdown_connections 2024-08-31T05:37:57.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.087+0000 7fd10b132740 1 --2- 172.21.15.5:0/3274004567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55883578d390 0x558835b53d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:57.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.087+0000 7fd10b132740 1 --2- 172.21.15.5:0/3274004567 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588357851b0 0x558835b53850 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:57.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.087+0000 7fd10b132740 1 --2- 172.21.15.5:0/3274004567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588357ae070 0x558835b53310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:57.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.087+0000 7fd10b132740 1 -- 172.21.15.5:0/3274004567 >> 172.21.15.5:0/3274004567 conn(0x5588357a2460 msgr2=0x558835b51200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:57.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.087+0000 7fd10b132740 1 -- 172.21.15.5:0/3274004567 shutdown_connections 2024-08-31T05:37:57.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.087+0000 7fd10b132740 1 -- 172.21.15.5:0/3274004567 wait complete. 2024-08-31T05:37:57.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.087+0000 7fd10b132740 1 -- start start 2024-08-31T05:37:57.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.087+0000 7fd10b132740 1 Processor -- start 2024-08-31T05:37:57.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.088+0000 7fd10b132740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588357851b0 0x558835b5e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:57.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.088+0000 7fd10b132740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55883578d390 0x558835b5ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:57.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.088+0000 7fd10b132740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588357ae070 0x558835b6ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:57.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.088+0000 7fd10b132740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55883591c700 con 0x5588357851b0 2024-08-31T05:37:57.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.088+0000 7fd10b132740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558835a40750 con 0x5588357ae070 2024-08-31T05:37:57.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.088+0000 7fd10b132740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558835b61af0 con 0x55883578d390 2024-08-31T05:37:57.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.088+0000 7fd0fe59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588357851b0 0x558835b5e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:57.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.088+0000 7fd10b132740 10 client.0 _ll_register_callbacks cb 0x558835a6fe10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:37:57.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.088+0000 7fd0fe59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588357851b0 0x558835b5e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50400/0 (socket says 172.21.15.5:50400) 2024-08-31T05:37:57.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.088+0000 7fd0fe59c640 1 -- 172.21.15.5:0/820264489 learned_addr learned my addr 172.21.15.5:0/820264489 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:57.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.088+0000 7fd0fdd9b640 1 --2- 172.21.15.5:0/820264489 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55883578d390 0x558835b5ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:57.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.088+0000 7fd0fed9d640 1 --2- 172.21.15.5:0/820264489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588357ae070 0x558835b6ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:57.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.088+0000 7fd0fe59c640 1 -- 172.21.15.5:0/820264489 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55883578d390 msgr2=0x558835b5ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:57.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.088+0000 7fd0fe59c640 1 --2- 172.21.15.5:0/820264489 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55883578d390 0x558835b5ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:57.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.088+0000 7fd0fe59c640 1 -- 172.21.15.5:0/820264489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588357ae070 msgr2=0x558835b6ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:57.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.088+0000 7fd0fe59c640 1 --2- 172.21.15.5:0/820264489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588357ae070 0x558835b6ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:57.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.088+0000 7fd0fe59c640 1 -- 172.21.15.5:0/820264489 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558835a79900 con 0x5588357851b0 2024-08-31T05:37:57.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.088+0000 7fd0fe59c640 1 --2- 172.21.15.5:0/820264489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588357851b0 0x558835b5e9f0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fd0f000b740 tx=0x7fd0f0011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a323cf8e7bac027 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:57.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.088+0000 7fd0e5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:37:57.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.089+0000 7fd0e5ffb640 1 -- 172.21.15.5:0/820264489 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f002a060 con 0x5588357851b0 2024-08-31T05:37:57.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.089+0000 7fd10b132740 1 -- 172.21.15.5:0/820264489 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558835acc5d0 con 0x5588357851b0 2024-08-31T05:37:57.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.089+0000 7fd0e5ffb640 1 -- 172.21.15.5:0/820264489 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7fd0f0005040 con 0x5588357851b0 2024-08-31T05:37:57.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.089+0000 7fd0e5ffb640 1 -- 172.21.15.5:0/820264489 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fd0f0031050 con 0x5588357851b0 2024-08-31T05:37:57.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.089+0000 7fd10b132740 10 client.17706 fetch_fsmap learned FSMap version 34 2024-08-31T05:37:57.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.089+0000 7fd10b132740 1 -- 172.21.15.5:0/820264489 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x558835b6d830 con 0x5588357851b0 2024-08-31T05:37:57.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.089+0000 7fd0e5ffb640 1 -- 172.21.15.5:0/820264489 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x558835acc5d0 con 0x5588357851b0 2024-08-31T05:37:57.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.089+0000 7fd0e5ffb640 1 -- 172.21.15.5:0/820264489 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fd0f00046c0 con 0x5588357851b0 2024-08-31T05:37:57.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.089+0000 7fd10b132740 10 client.17706 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:37:57.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.089+0000 7fd10b132740 10 client.17706 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-31T05:37:57.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.089+0000 7fd10b132740 20 client.17706 populate_metadata read hostname 'smithi005' 2024-08-31T05:37:57.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.089+0000 7fd10b132740 1 --2- 172.21.15.5:0/820264489 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55883576c9f0 0x558835b70bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:57.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.089+0000 7fd10b132740 4 client.17706 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:37:57.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.089+0000 7fd10b132740 1 -- 172.21.15.5:0/820264489 --> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558835ac8070 con 0x55883576c9f0 2024-08-31T05:37:57.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.090+0000 7fd0fdd9b640 1 --2- 172.21.15.5:0/820264489 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55883576c9f0 0x558835b70bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:57.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.090+0000 7fd0fdd9b640 1 --2- 172.21.15.5:0/820264489 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55883576c9f0 0x558835b70bf0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b8e6a9da7b9ab383 server_cookie=3aa95f6720c849e4 in_seq=0 out_seq=0 2024-08-31T05:37:57.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.090+0000 7fd0e5ffb640 10 client.17706 ms_handle_connect on v2:172.21.15.50:6838/98200944 2024-08-31T05:37:57.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.091+0000 7fd0e5ffb640 1 -- 172.21.15.5:0/820264489 <== mds.1 v2:172.21.15.50:6838/98200944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558835ac8070 con 0x55883576c9f0 2024-08-31T05:37:57.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.091+0000 7fd0e5ffb640 10 client.17706 handle_command_reply: tid=0 2024-08-31T05:37:57.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.091+0000 7fd10b132740 1 client.17706 shutdown 2024-08-31T05:37:57.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.091+0000 7fd10b132740 1 -- 172.21.15.5:0/820264489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588357851b0 msgr2=0x558835b5e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:57.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.091+0000 7fd10b132740 1 --2- 172.21.15.5:0/820264489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588357851b0 0x558835b5e9f0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fd0f000b740 tx=0x7fd0f0011f20 comp rx=0 tx=0).stop 2024-08-31T05:37:57.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.091+0000 7fd10b132740 1 -- 172.21.15.5:0/820264489 shutdown_connections 2024-08-31T05:37:57.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.091+0000 7fd10b132740 1 --2- 172.21.15.5:0/820264489 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55883576c9f0 0x558835b70bf0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:57.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.091+0000 7fd10b132740 1 --2- 172.21.15.5:0/820264489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588357ae070 0x558835b6ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:57.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.091+0000 7fd10b132740 1 --2- 172.21.15.5:0/820264489 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55883578d390 0x558835b5ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:57.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.091+0000 7fd10b132740 1 --2- 172.21.15.5:0/820264489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588357851b0 0x558835b5e9f0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:57.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.091+0000 7fd10b132740 1 -- 172.21.15.5:0/820264489 >> 172.21.15.5:0/820264489 conn(0x5588357a2460 msgr2=0x558835b564a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:57.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.091+0000 7fd0e5ffb640 0 client.17706 ms_handle_reset on v2:172.21.15.50:6838/98200944 2024-08-31T05:37:57.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.091+0000 7fd10b132740 1 -- 172.21.15.5:0/820264489 shutdown_connections 2024-08-31T05:37:57.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.091+0000 7fd10b132740 1 -- 172.21.15.5:0/820264489 wait complete. 2024-08-31T05:37:57.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.091+0000 7fd10b132740 20 client.17706 trim_cache size 0 max 16384 2024-08-31T05:37:57.099 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:37:56 smithi005 ceph-mon[18602]: pgmap v586: 129 pgs: 129 active+clean; 462 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.5 MiB/s wr, 243 op/s 2024-08-31T05:37:57.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.105+0000 7fd10b132740 1 Processor -- start 2024-08-31T05:37:57.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.105+0000 7fd10b132740 1 -- start start 2024-08-31T05:37:57.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.106+0000 7fd10b132740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588357851b0 0x558835b54a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:57.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.106+0000 7fd10b132740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55883578d390 0x558835b5bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:57.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.106+0000 7fd10b132740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588357ae070 0x558835b5c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:57.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.106+0000 7fd10b132740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd1001b2f60 con 0x55883578d390 2024-08-31T05:37:57.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.106+0000 7fd10b132740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd1001b4aa0 con 0x5588357851b0 2024-08-31T05:37:57.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.106+0000 7fd10b132740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd1001b3630 con 0x5588357ae070 2024-08-31T05:37:57.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.106+0000 7fd0fdd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55883578d390 0x558835b5bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:57.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.106+0000 7fd0fdd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55883578d390 0x558835b5bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50406/0 (socket says 172.21.15.5:50406) 2024-08-31T05:37:57.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.106+0000 7fd0fdd9b640 1 -- 172.21.15.5:0/3737446118 learned_addr learned my addr 172.21.15.5:0/3737446118 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:57.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.106+0000 7fd0fed9d640 1 --2- 172.21.15.5:0/3737446118 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588357ae070 0x558835b5c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:57.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.106+0000 7fd0fe59c640 1 --2- 172.21.15.5:0/3737446118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588357851b0 0x558835b54a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:57.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.106+0000 7fd0fdd9b640 1 -- 172.21.15.5:0/3737446118 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588357ae070 msgr2=0x558835b5c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:57.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.106+0000 7fd0fdd9b640 1 --2- 172.21.15.5:0/3737446118 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588357ae070 0x558835b5c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:57.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.106+0000 7fd0fdd9b640 1 -- 172.21.15.5:0/3737446118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588357851b0 msgr2=0x558835b54a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:57.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.106+0000 7fd0fdd9b640 1 --2- 172.21.15.5:0/3737446118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588357851b0 0x558835b54a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:57.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.106+0000 7fd0fdd9b640 1 -- 172.21.15.5:0/3737446118 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558835b56170 con 0x55883578d390 2024-08-31T05:37:57.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.106+0000 7fd0fe59c640 1 --2- 172.21.15.5:0/3737446118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588357851b0 0x558835b54a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:37:57.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.106+0000 7fd0fdd9b640 1 --2- 172.21.15.5:0/3737446118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55883578d390 0x558835b5bbe0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fd0f40a7b90 tx=0x7fd0f40eb550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a8f8ad5a18a00c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:57.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.106+0000 7fd0e7fff640 1 -- 172.21.15.5:0/3737446118 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f401c040 con 0x55883578d390 2024-08-31T05:37:57.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.107+0000 7fd0e7fff640 1 -- 172.21.15.5:0/3737446118 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0f40ab620 con 0x55883578d390 2024-08-31T05:37:57.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.107+0000 7fd0e7fff640 1 -- 172.21.15.5:0/3737446118 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f40e8e60 con 0x55883578d390 2024-08-31T05:37:57.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.107+0000 7fd10b132740 1 -- 172.21.15.5:0/3737446118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55883578d390 msgr2=0x558835b5bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:57.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.107+0000 7fd10b132740 1 --2- 172.21.15.5:0/3737446118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55883578d390 0x558835b5bbe0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fd0f40a7b90 tx=0x7fd0f40eb550 comp rx=0 tx=0).stop 2024-08-31T05:37:57.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.107+0000 7fd10b132740 1 -- 172.21.15.5:0/3737446118 shutdown_connections 2024-08-31T05:37:57.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.107+0000 7fd10b132740 1 --2- 172.21.15.5:0/3737446118 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588357ae070 0x558835b5c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:57.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.107+0000 7fd10b132740 1 --2- 172.21.15.5:0/3737446118 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55883578d390 0x558835b5bbe0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:57.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.107+0000 7fd10b132740 1 --2- 172.21.15.5:0/3737446118 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588357851b0 0x558835b54a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:57.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.107+0000 7fd10b132740 1 -- 172.21.15.5:0/3737446118 >> 172.21.15.5:0/3737446118 conn(0x5588357a2460 msgr2=0x558835b54340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:57.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.108+0000 7fd10b132740 1 -- 172.21.15.5:0/3737446118 shutdown_connections 2024-08-31T05:37:57.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.108+0000 7fd10b132740 1 -- 172.21.15.5:0/3737446118 wait complete. 2024-08-31T05:37:57.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.108+0000 7fd10b132740 1 -- start start 2024-08-31T05:37:57.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.108+0000 7fd10b132740 1 Processor -- start 2024-08-31T05:37:57.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.108+0000 7fd10b132740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588357851b0 0x558835bcf300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:57.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.108+0000 7fd10b132740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55883578d390 0x558835bcf840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:57.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.108+0000 7fd10b132740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588357ae070 0x558835bcfd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:57.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.108+0000 7fd10b132740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd1001b43d0 con 0x5588357ae070 2024-08-31T05:37:57.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.108+0000 7fd10b132740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd1001b3d00 con 0x55883578d390 2024-08-31T05:37:57.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.108+0000 7fd10b132740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd1001b0f60 con 0x5588357851b0 2024-08-31T05:37:57.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.108+0000 7fd10b132740 10 client.0 _ll_register_callbacks cb 0x7fd0f40eb420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:37:57.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.108+0000 7fd0fed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588357ae070 0x558835bcfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:57.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.108+0000 7fd0fe59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588357851b0 0x558835bcf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:57.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.108+0000 7fd0fed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588357ae070 0x558835bcfd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50420/0 (socket says 172.21.15.5:50420) 2024-08-31T05:37:57.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.109+0000 7fd0fed9d640 1 -- 172.21.15.5:0/1860381471 learned_addr learned my addr 172.21.15.5:0/1860381471 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:57.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.109+0000 7fd0fdd9b640 1 --2- 172.21.15.5:0/1860381471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55883578d390 0x558835bcf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:57.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.109+0000 7fd0fed9d640 1 -- 172.21.15.5:0/1860381471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588357851b0 msgr2=0x558835bcf300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:57.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.109+0000 7fd0fed9d640 1 --2- 172.21.15.5:0/1860381471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588357851b0 0x558835bcf300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:57.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.109+0000 7fd0fed9d640 1 -- 172.21.15.5:0/1860381471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55883578d390 msgr2=0x558835bcf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:57.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.109+0000 7fd0fed9d640 1 --2- 172.21.15.5:0/1860381471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55883578d390 0x558835bcf840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:57.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.109+0000 7fd0fed9d640 1 -- 172.21.15.5:0/1860381471 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558835bda380 con 0x5588357ae070 2024-08-31T05:37:57.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.109+0000 7fd0fe59c640 1 --2- 172.21.15.5:0/1860381471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588357851b0 0x558835bcf300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:37:57.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.109+0000 7fd0fdd9b640 1 --2- 172.21.15.5:0/1860381471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55883578d390 0x558835bcf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:37:57.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.109+0000 7fd0fed9d640 1 --2- 172.21.15.5:0/1860381471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588357ae070 0x558835bcfd80 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fd0f8009ca0 tx=0x7fd0f80095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce4eefa187744d4b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:57.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.109+0000 7fd0e5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:37:57.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.109+0000 7fd0e5ffb640 1 -- 172.21.15.5:0/1860381471 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f8058060 con 0x5588357ae070 2024-08-31T05:37:57.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.109+0000 7fd0e5ffb640 1 -- 172.21.15.5:0/1860381471 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7fd0f8004040 con 0x5588357ae070 2024-08-31T05:37:57.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.109+0000 7fd10b132740 1 -- 172.21.15.5:0/1860381471 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0f40ab620 con 0x5588357ae070 2024-08-31T05:37:57.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.109+0000 7fd0e5ffb640 1 -- 172.21.15.5:0/1860381471 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fd0f805f050 con 0x5588357ae070 2024-08-31T05:37:57.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.109+0000 7fd10b132740 10 client.17712 fetch_fsmap learned FSMap version 34 2024-08-31T05:37:57.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.109+0000 7fd10b132740 1 -- 172.21.15.5:0/1860381471 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x558835bdb5b0 con 0x5588357ae070 2024-08-31T05:37:57.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.110+0000 7fd0e5ffb640 1 -- 172.21.15.5:0/1860381471 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0f40ab620 con 0x5588357ae070 2024-08-31T05:37:57.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.110+0000 7fd0e5ffb640 1 -- 172.21.15.5:0/1860381471 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fd0f802faa0 con 0x5588357ae070 2024-08-31T05:37:57.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.110+0000 7fd10b132740 10 client.17712 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:37:57.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.110+0000 7fd10b132740 10 client.17712 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-31T05:37:57.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.110+0000 7fd10b132740 20 client.17712 populate_metadata read hostname 'smithi005' 2024-08-31T05:37:57.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.110+0000 7fd10b132740 1 --2- 172.21.15.5:0/1860381471 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x558835741da0 0x558835bdddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:57.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.110+0000 7fd10b132740 4 client.17712 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:37:57.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.110+0000 7fd10b132740 1 -- 172.21.15.5:0/1860381471 --> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558835ac57b0 con 0x558835741da0 2024-08-31T05:37:57.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.110+0000 7fd0fe59c640 1 --2- 172.21.15.5:0/1860381471 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x558835741da0 0x558835bdddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:57.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.111+0000 7fd0e5ffb640 10 client.17712 ms_handle_connect on v2:172.21.15.50:6838/98200944 2024-08-31T05:37:57.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.111+0000 7fd0fe59c640 1 --2- 172.21.15.5:0/1860381471 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x558835741da0 0x558835bdddd0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6537cb10cf0e64e server_cookie=d5b2ca79c34e60f5 in_seq=0 out_seq=0 2024-08-31T05:37:57.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.111+0000 7fd0e5ffb640 1 -- 172.21.15.5:0/1860381471 <== mds.1 v2:172.21.15.50:6838/98200944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558835ac57b0 con 0x558835741da0 2024-08-31T05:37:57.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.111+0000 7fd0e5ffb640 10 client.17712 handle_command_reply: tid=0 2024-08-31T05:37:57.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.111+0000 7fd10b132740 1 client.17712 shutdown 2024-08-31T05:37:57.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.111+0000 7fd10b132740 1 -- 172.21.15.5:0/1860381471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588357ae070 msgr2=0x558835bcfd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:57.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.111+0000 7fd10b132740 1 --2- 172.21.15.5:0/1860381471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588357ae070 0x558835bcfd80 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fd0f8009ca0 tx=0x7fd0f80095c0 comp rx=0 tx=0).stop 2024-08-31T05:37:57.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.111+0000 7fd10b132740 1 -- 172.21.15.5:0/1860381471 shutdown_connections 2024-08-31T05:37:57.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.111+0000 7fd10b132740 1 --2- 172.21.15.5:0/1860381471 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x558835741da0 0x558835bdddd0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:57.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.111+0000 7fd10b132740 1 --2- 172.21.15.5:0/1860381471 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588357ae070 0x558835bcfd80 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:57.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.111+0000 7fd10b132740 1 --2- 172.21.15.5:0/1860381471 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55883578d390 0x558835bcf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:57.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.111+0000 7fd10b132740 1 --2- 172.21.15.5:0/1860381471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588357851b0 0x558835bcf300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:57.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.111+0000 7fd0e5ffb640 0 client.17712 ms_handle_reset on v2:172.21.15.50:6838/98200944 2024-08-31T05:37:57.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.111+0000 7fd10b132740 1 -- 172.21.15.5:0/1860381471 >> 172.21.15.5:0/1860381471 conn(0x5588357a2460 msgr2=0x558835b54d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:57.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.111+0000 7fd10b132740 1 -- 172.21.15.5:0/1860381471 shutdown_connections 2024-08-31T05:37:57.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.111+0000 7fd10b132740 1 -- 172.21.15.5:0/1860381471 wait complete. 2024-08-31T05:37:57.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.111+0000 7fd10b132740 20 client.17712 trim_cache size 0 max 16384 2024-08-31T05:37:57.120 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:37:57.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.112+0000 7fd104bbd640 1 -- 172.21.15.5:0/2300551526 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd0e80b4cd0 msgr2=0x7fd0e80b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:57.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.112+0000 7fd104bbd640 1 --2- 172.21.15.5:0/2300551526 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd0e80b4cd0 0x7fd0e80b71e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd0f8009a60 tx=0x7fd0f802f470 comp rx=0 tx=0).stop 2024-08-31T05:37:57.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.112+0000 7fd104bbd640 1 -- 172.21.15.5:0/2300551526 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd100108140 msgr2=0x7fd10019b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:57.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.112+0000 7fd104bbd640 1 --2- 172.21.15.5:0/2300551526 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd100108140 0x7fd10019b5c0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fd0f400e9c0 tx=0x7fd0f400ee80 comp rx=0 tx=0).stop 2024-08-31T05:37:57.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.112+0000 7fd104bbd640 1 -- 172.21.15.5:0/2300551526 shutdown_connections 2024-08-31T05:37:57.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.112+0000 7fd104bbd640 1 --2- 172.21.15.5:0/2300551526 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd0e80b4cd0 0x7fd0e80b71e0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:57.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.112+0000 7fd104bbd640 1 --2- 172.21.15.5:0/2300551526 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd100108a90 0x7fd10019bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:57.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.112+0000 7fd104bbd640 1 --2- 172.21.15.5:0/2300551526 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd100108140 0x7fd10019b5c0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:57.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.112+0000 7fd104bbd640 1 --2- 172.21.15.5:0/2300551526 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd100102800 0x7fd10019b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:57.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.112+0000 7fd104bbd640 1 -- 172.21.15.5:0/2300551526 >> 172.21.15.5:0/2300551526 conn(0x7fd1000794d0 msgr2=0x7fd100105040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:57.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.112+0000 7fd104bbd640 1 -- 172.21.15.5:0/2300551526 shutdown_connections 2024-08-31T05:37:57.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:57.112+0000 7fd104bbd640 1 -- 172.21.15.5:0/2300551526 wait complete. 2024-08-31T05:37:57.156 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:37:56 smithi050 ceph-mon[22146]: pgmap v586: 129 pgs: 129 active+clean; 462 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.5 MiB/s wr, 243 op/s 2024-08-31T05:37:57.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:37:56 smithi070 ceph-mon[22316]: pgmap v586: 129 pgs: 129 active+clean; 462 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.5 MiB/s wr, 243 op/s 2024-08-31T05:37:57.861 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T05:37:57.929 INFO:tasks.workunit.client.0.smithi005.stdout: 1 899761 11.35 MB/sec execute 285 sec latency 32.364 ms 2024-08-31T05:37:58.210 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:37:58.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.802+0000 7fd7943ad640 1 -- 172.21.15.5:0/2833142592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd78c108aa0 msgr2=0x7fd78c10f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:58.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.802+0000 7fd7943ad640 1 --2- 172.21.15.5:0/2833142592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd78c108aa0 0x7fd78c10f2d0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fd784009ca0 tx=0x7fd78402a8c0 comp rx=0 tx=0).stop 2024-08-31T05:37:58.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.802+0000 7fd7943ad640 1 -- 172.21.15.5:0/2833142592 shutdown_connections 2024-08-31T05:37:58.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.802+0000 7fd7943ad640 1 --2- 172.21.15.5:0/2833142592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd78c108aa0 0x7fd78c10f2d0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:58.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.802+0000 7fd7943ad640 1 --2- 172.21.15.5:0/2833142592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd78c108150 0x7fd78c108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:58.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.802+0000 7fd7943ad640 1 --2- 172.21.15.5:0/2833142592 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd78c102810 0x7fd78c102c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:58.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.802+0000 7fd7943ad640 1 -- 172.21.15.5:0/2833142592 >> 172.21.15.5:0/2833142592 conn(0x7fd78c0794b0 msgr2=0x7fd78c0798c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:58.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.802+0000 7fd7943ad640 1 -- 172.21.15.5:0/2833142592 shutdown_connections 2024-08-31T05:37:58.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.802+0000 7fd7943ad640 1 -- 172.21.15.5:0/2833142592 wait complete. 2024-08-31T05:37:58.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.803+0000 7fd7943ad640 1 Processor -- start 2024-08-31T05:37:58.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.803+0000 7fd7943ad640 1 -- start start 2024-08-31T05:37:58.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.803+0000 7fd7943ad640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd78c102810 0x7fd78c19c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:58.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.803+0000 7fd7943ad640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd78c108150 0x7fd78c19c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:58.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.803+0000 7fd7943ad640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd78c108aa0 0x7fd78c1a1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:58.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.803+0000 7fd7943ad640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd78c112770 con 0x7fd78c108150 2024-08-31T05:37:58.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.803+0000 7fd7943ad640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd78c1125f0 con 0x7fd78c108aa0 2024-08-31T05:37:58.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.803+0000 7fd7943ad640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd78c1128f0 con 0x7fd78c102810 2024-08-31T05:37:58.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.803+0000 7fd791948640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd78c108150 0x7fd78c19c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:58.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.803+0000 7fd791948640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd78c108150 0x7fd78c19c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50434/0 (socket says 172.21.15.5:50434) 2024-08-31T05:37:58.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.803+0000 7fd791948640 1 -- 172.21.15.5:0/3786860458 learned_addr learned my addr 172.21.15.5:0/3786860458 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:58.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.803+0000 7fd792149640 1 --2- 172.21.15.5:0/3786860458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd78c102810 0x7fd78c19c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:58.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.803+0000 7fd79294a640 1 --2- 172.21.15.5:0/3786860458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd78c108aa0 0x7fd78c1a1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:58.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.803+0000 7fd791948640 1 -- 172.21.15.5:0/3786860458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd78c102810 msgr2=0x7fd78c19c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:58.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.803+0000 7fd791948640 1 --2- 172.21.15.5:0/3786860458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd78c102810 0x7fd78c19c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:58.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.803+0000 7fd791948640 1 -- 172.21.15.5:0/3786860458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd78c108aa0 msgr2=0x7fd78c1a1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:58.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.803+0000 7fd791948640 1 --2- 172.21.15.5:0/3786860458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd78c108aa0 0x7fd78c1a1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:58.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.804+0000 7fd791948640 1 -- 172.21.15.5:0/3786860458 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd78c1a2380 con 0x7fd78c108150 2024-08-31T05:37:58.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.804+0000 7fd792149640 1 --2- 172.21.15.5:0/3786860458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd78c102810 0x7fd78c19c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:37:58.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.804+0000 7fd791948640 1 --2- 172.21.15.5:0/3786860458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd78c108150 0x7fd78c19c9b0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fd77c00d950 tx=0x7fd77c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:58.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.804+0000 7fd7837fe640 1 -- 172.21.15.5:0/3786860458 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd77c017070 con 0x7fd78c108150 2024-08-31T05:37:58.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.804+0000 7fd7943ad640 1 -- 172.21.15.5:0/3786860458 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd78c1a2670 con 0x7fd78c108150 2024-08-31T05:37:58.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.804+0000 7fd7837fe640 1 -- 172.21.15.5:0/3786860458 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd77c009c30 con 0x7fd78c108150 2024-08-31T05:37:58.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.804+0000 7fd7837fe640 1 -- 172.21.15.5:0/3786860458 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd77c0047a0 con 0x7fd78c108150 2024-08-31T05:37:58.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.804+0000 7fd7943ad640 1 -- 172.21.15.5:0/3786860458 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd78c1a8dd0 con 0x7fd78c108150 2024-08-31T05:37:58.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.806+0000 7fd79a922740 1 Processor -- start 2024-08-31T05:37:58.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.807+0000 7fd79a922740 1 -- start start 2024-08-31T05:37:58.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.807+0000 7fd79a922740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589def1b070 0x5589df2c0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:58.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.807+0000 7fd79a922740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589deef21b0 0x5589df2c0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:58.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.807+0000 7fd79a922740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589deefa390 0x5589df2c0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:58.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.807+0000 7fd79a922740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5589df237680 con 0x5589deefa390 2024-08-31T05:37:58.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.807+0000 7fd79a922740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5589df226c10 con 0x5589def1b070 2024-08-31T05:37:58.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.807+0000 7fd79a922740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5589df22abc0 con 0x5589deef21b0 2024-08-31T05:37:58.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.807+0000 7fd7837fe640 1 -- 172.21.15.5:0/3786860458 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fd77c004020 con 0x7fd78c108150 2024-08-31T05:37:58.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.807+0000 7fd791948640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589deefa390 0x5589df2c0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:58.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.807+0000 7fd792149640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589deef21b0 0x5589df2c0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:58.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.807+0000 7fd792149640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589deef21b0 0x5589df2c0850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:33674/0 (socket says 172.21.15.5:33674) 2024-08-31T05:37:58.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.807+0000 7fd791948640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589deefa390 0x5589df2c0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50448/0 (socket says 172.21.15.5:50448) 2024-08-31T05:37:58.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.807+0000 7fd792149640 1 -- 172.21.15.5:0/1241183180 learned_addr learned my addr 172.21.15.5:0/1241183180 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:58.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.807+0000 7fd79294a640 1 --2- 172.21.15.5:0/1241183180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589def1b070 0x5589df2c0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:58.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.807+0000 7fd792149640 1 -- 172.21.15.5:0/1241183180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589def1b070 msgr2=0x5589df2c0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:58.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.807+0000 7fd792149640 1 --2- 172.21.15.5:0/1241183180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589def1b070 0x5589df2c0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:58.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.808+0000 7fd792149640 1 -- 172.21.15.5:0/1241183180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589deefa390 msgr2=0x5589df2c0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:58.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.808+0000 7fd792149640 1 --2- 172.21.15.5:0/1241183180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589deefa390 0x5589df2c0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:58.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.808+0000 7fd792149640 1 -- 172.21.15.5:0/1241183180 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589def86650 con 0x5589deef21b0 2024-08-31T05:37:58.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.808+0000 7fd792149640 1 --2- 172.21.15.5:0/1241183180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589deef21b0 0x5589df2c0850 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd7880104d0 tx=0x7fd788010990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26ea80c43fae2fdf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:58.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.808+0000 7fd7837fe640 1 --2- 172.21.15.5:0/3786860458 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd7780b4ca0 0x7fd7780b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:58.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.808+0000 7fd780d9a640 1 -- 172.21.15.5:0/1241183180 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd788011760 con 0x5589deef21b0 2024-08-31T05:37:58.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.808+0000 7fd79294a640 1 --2- 172.21.15.5:0/3786860458 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd7780b4ca0 0x7fd7780b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:58.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.808+0000 7fd780d9a640 1 -- 172.21.15.5:0/1241183180 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd788011db0 con 0x5589deef21b0 2024-08-31T05:37:58.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.808+0000 7fd780d9a640 1 -- 172.21.15.5:0/1241183180 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd78801cdf0 con 0x5589deef21b0 2024-08-31T05:37:58.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.808+0000 7fd7837fe640 1 -- 172.21.15.5:0/3786860458 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7fd77c0e54e0 con 0x7fd78c108150 2024-08-31T05:37:58.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.809+0000 7fd79a922740 1 -- 172.21.15.5:0/1241183180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589deef21b0 msgr2=0x5589df2c0850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:58.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.809+0000 7fd79a922740 1 --2- 172.21.15.5:0/1241183180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589deef21b0 0x5589df2c0850 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd7880104d0 tx=0x7fd788010990 comp rx=0 tx=0).stop 2024-08-31T05:37:58.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.809+0000 7fd79294a640 1 --2- 172.21.15.5:0/3786860458 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd7780b4ca0 0x7fd7780b71b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd78402f500 tx=0x7fd78402f370 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:58.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.809+0000 7fd79a922740 1 -- 172.21.15.5:0/1241183180 shutdown_connections 2024-08-31T05:37:58.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.809+0000 7fd79a922740 1 --2- 172.21.15.5:0/1241183180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589deefa390 0x5589df2c0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:58.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.809+0000 7fd79a922740 1 --2- 172.21.15.5:0/1241183180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589deef21b0 0x5589df2c0850 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:58.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.809+0000 7fd79a922740 1 --2- 172.21.15.5:0/1241183180 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589def1b070 0x5589df2c0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:58.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.809+0000 7fd79a922740 1 -- 172.21.15.5:0/1241183180 >> 172.21.15.5:0/1241183180 conn(0x5589def0f460 msgr2=0x5589df2be200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:58.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.809+0000 7fd79a922740 1 -- 172.21.15.5:0/1241183180 shutdown_connections 2024-08-31T05:37:58.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.809+0000 7fd79a922740 1 -- 172.21.15.5:0/1241183180 wait complete. 2024-08-31T05:37:58.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.810+0000 7fd79a922740 1 -- start start 2024-08-31T05:37:58.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.810+0000 7fd79a922740 1 Processor -- start 2024-08-31T05:37:58.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.810+0000 7fd79a922740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589deef21b0 0x5589df2cba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:58.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.810+0000 7fd79a922740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589deefa390 0x5589df2cbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:58.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.810+0000 7fd79a922740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589def1b070 0x5589df2d7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:58.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.810+0000 7fd79a922740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5589df089700 con 0x5589deefa390 2024-08-31T05:37:58.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.810+0000 7fd79a922740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5589df1ad750 con 0x5589def1b070 2024-08-31T05:37:58.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.810+0000 7fd79a922740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5589df2ceaf0 con 0x5589deef21b0 2024-08-31T05:37:58.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.810+0000 7fd79a922740 10 client.0 _ll_register_callbacks cb 0x5589df1dce10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:37:58.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.810+0000 7fd791948640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589deefa390 0x5589df2cbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:58.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.810+0000 7fd791948640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589deefa390 0x5589df2cbfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50454/0 (socket says 172.21.15.5:50454) 2024-08-31T05:37:58.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.810+0000 7fd791948640 1 -- 172.21.15.5:0/2299746041 learned_addr learned my addr 172.21.15.5:0/2299746041 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:58.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.810+0000 7fd79294a640 1 --2- 172.21.15.5:0/2299746041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589def1b070 0x5589df2d7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:58.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.810+0000 7fd792149640 1 --2- 172.21.15.5:0/2299746041 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589deef21b0 0x5589df2cba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:58.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.811+0000 7fd791948640 1 -- 172.21.15.5:0/2299746041 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589deef21b0 msgr2=0x5589df2cba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:58.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.811+0000 7fd791948640 1 --2- 172.21.15.5:0/2299746041 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589deef21b0 0x5589df2cba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:58.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.811+0000 7fd791948640 1 -- 172.21.15.5:0/2299746041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589def1b070 msgr2=0x5589df2d7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:58.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.811+0000 7fd791948640 1 --2- 172.21.15.5:0/2299746041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589def1b070 0x5589df2d7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:58.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.811+0000 7fd791948640 1 -- 172.21.15.5:0/2299746041 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589df1e6900 con 0x5589deefa390 2024-08-31T05:37:58.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.811+0000 7fd79294a640 1 --2- 172.21.15.5:0/2299746041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589def1b070 0x5589df2d7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:37:58.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.811+0000 7fd791948640 1 --2- 172.21.15.5:0/2299746041 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589deefa390 0x5589df2cbfa0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fd77c000c00 tx=0x7fd77c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7102b63b0e48678 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:58.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.811+0000 7fd775ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:37:58.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.811+0000 7fd775ffb640 1 -- 172.21.15.5:0/2299746041 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd77c0ab5c0 con 0x5589deefa390 2024-08-31T05:37:58.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.811+0000 7fd775ffb640 1 -- 172.21.15.5:0/2299746041 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7fd77c0a7a80 con 0x5589deefa390 2024-08-31T05:37:58.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.811+0000 7fd79a922740 1 -- 172.21.15.5:0/2299746041 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd788011db0 con 0x5589deefa390 2024-08-31T05:37:58.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.811+0000 7fd775ffb640 1 -- 172.21.15.5:0/2299746041 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fd77c0aaf60 con 0x5589deefa390 2024-08-31T05:37:58.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.811+0000 7fd79a922740 10 client.17724 fetch_fsmap learned FSMap version 34 2024-08-31T05:37:58.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.811+0000 7fd79a922740 1 -- 172.21.15.5:0/2299746041 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5589df2da900 con 0x5589deefa390 2024-08-31T05:37:58.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.811+0000 7fd775ffb640 1 -- 172.21.15.5:0/2299746041 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd788011db0 con 0x5589deefa390 2024-08-31T05:37:58.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.812+0000 7fd775ffb640 1 -- 172.21.15.5:0/2299746041 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fd77c0e5130 con 0x5589deefa390 2024-08-31T05:37:58.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.812+0000 7fd79a922740 10 client.17724 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:37:58.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.812+0000 7fd79a922740 10 client.17724 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:37:58.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.812+0000 7fd79a922740 20 client.17724 populate_metadata read hostname 'smithi005' 2024-08-31T05:37:58.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.812+0000 7fd79a922740 1 --2- 172.21.15.5:0/2299746041 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5589deed99f0 0x5589df2ddd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:58.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.812+0000 7fd79a922740 4 client.17724 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:37:58.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.812+0000 7fd79a922740 1 -- 172.21.15.5:0/2299746041 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5589df2395d0 con 0x5589deed99f0 2024-08-31T05:37:58.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.812+0000 7fd792149640 1 --2- 172.21.15.5:0/2299746041 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5589deed99f0 0x5589df2ddd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:58.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.812+0000 7fd775ffb640 10 client.17724 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:37:58.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.812+0000 7fd792149640 1 --2- 172.21.15.5:0/2299746041 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5589deed99f0 0x5589df2ddd00 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53d6e18bb1893311 server_cookie=9a7a817157a8e94f in_seq=0 out_seq=0 2024-08-31T05:37:58.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.813+0000 7fd775ffb640 1 -- 172.21.15.5:0/2299746041 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5589df2395d0 con 0x5589deed99f0 2024-08-31T05:37:58.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.813+0000 7fd775ffb640 10 client.17724 handle_command_reply: tid=0 2024-08-31T05:37:58.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.813+0000 7fd79a922740 1 client.17724 shutdown 2024-08-31T05:37:58.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.813+0000 7fd79a922740 1 -- 172.21.15.5:0/2299746041 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589deefa390 msgr2=0x5589df2cbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:58.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.813+0000 7fd79a922740 1 --2- 172.21.15.5:0/2299746041 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589deefa390 0x5589df2cbfa0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fd77c000c00 tx=0x7fd77c0046c0 comp rx=0 tx=0).stop 2024-08-31T05:37:58.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.813+0000 7fd79a922740 1 -- 172.21.15.5:0/2299746041 shutdown_connections 2024-08-31T05:37:58.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.813+0000 7fd79a922740 1 --2- 172.21.15.5:0/2299746041 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5589deed99f0 0x5589df2ddd00 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:58.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.813+0000 7fd79a922740 1 --2- 172.21.15.5:0/2299746041 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589def1b070 0x5589df2d7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:58.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.813+0000 7fd79a922740 1 --2- 172.21.15.5:0/2299746041 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589deefa390 0x5589df2cbfa0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:58.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.813+0000 7fd775ffb640 0 client.17724 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:37:58.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.813+0000 7fd79a922740 1 --2- 172.21.15.5:0/2299746041 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589deef21b0 0x5589df2cba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:58.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.813+0000 7fd79a922740 1 -- 172.21.15.5:0/2299746041 >> 172.21.15.5:0/2299746041 conn(0x5589def0f460 msgr2=0x5589df2c34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:58.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.813+0000 7fd79a922740 1 -- 172.21.15.5:0/2299746041 shutdown_connections 2024-08-31T05:37:58.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.813+0000 7fd79a922740 1 -- 172.21.15.5:0/2299746041 wait complete. 2024-08-31T05:37:58.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.813+0000 7fd79a922740 20 client.17724 trim_cache size 0 max 16384 2024-08-31T05:37:58.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.827+0000 7fd79a922740 1 Processor -- start 2024-08-31T05:37:58.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.827+0000 7fd79a922740 1 -- start start 2024-08-31T05:37:58.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.827+0000 7fd79a922740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589deef21b0 0x5589df2c1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:58.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.827+0000 7fd79a922740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589deefa390 0x5589df2d7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:58.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.827+0000 7fd79a922740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589def1b070 0x5589df2c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:58.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.827+0000 7fd79a922740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd78c1b2df0 con 0x5589def1b070 2024-08-31T05:37:58.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.827+0000 7fd79a922740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd78c1b4930 con 0x5589deef21b0 2024-08-31T05:37:58.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.827+0000 7fd79a922740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd78c1b34c0 con 0x5589deefa390 2024-08-31T05:37:58.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.827+0000 7fd79294a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589def1b070 0x5589df2c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:58.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.827+0000 7fd79294a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589def1b070 0x5589df2c8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50460/0 (socket says 172.21.15.5:50460) 2024-08-31T05:37:58.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.827+0000 7fd79294a640 1 -- 172.21.15.5:0/2120253222 learned_addr learned my addr 172.21.15.5:0/2120253222 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:58.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.827+0000 7fd791948640 1 --2- 172.21.15.5:0/2120253222 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589deefa390 0x5589df2d7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:58.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.827+0000 7fd792149640 1 --2- 172.21.15.5:0/2120253222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589deef21b0 0x5589df2c1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:58.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.828+0000 7fd791948640 1 -- 172.21.15.5:0/2120253222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589deef21b0 msgr2=0x5589df2c1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:58.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.828+0000 7fd791948640 1 --2- 172.21.15.5:0/2120253222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589deef21b0 0x5589df2c1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:58.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.828+0000 7fd791948640 1 -- 172.21.15.5:0/2120253222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589def1b070 msgr2=0x5589df2c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:58.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.828+0000 7fd791948640 1 --2- 172.21.15.5:0/2120253222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589def1b070 0x5589df2c8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:58.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.828+0000 7fd791948640 1 -- 172.21.15.5:0/2120253222 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589df2c2ba0 con 0x5589deefa390 2024-08-31T05:37:58.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.828+0000 7fd79294a640 1 --2- 172.21.15.5:0/2120253222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589def1b070 0x5589df2c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:37:58.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.828+0000 7fd791948640 1 --2- 172.21.15.5:0/2120253222 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589deefa390 0x5589df2d7d40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd77c0ab780 tx=0x7fd77c0a70b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e2b85f25e222cf9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:58.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.828+0000 7fd777fff640 1 -- 172.21.15.5:0/2120253222 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd77c0ab140 con 0x5589deefa390 2024-08-31T05:37:58.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.828+0000 7fd777fff640 1 -- 172.21.15.5:0/2120253222 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd77c0ab300 con 0x5589deefa390 2024-08-31T05:37:58.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.828+0000 7fd777fff640 1 -- 172.21.15.5:0/2120253222 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd77c0a7a80 con 0x5589deefa390 2024-08-31T05:37:58.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.829+0000 7fd79a922740 1 -- 172.21.15.5:0/2120253222 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589deefa390 msgr2=0x5589df2d7d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:58.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.829+0000 7fd79a922740 1 --2- 172.21.15.5:0/2120253222 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589deefa390 0x5589df2d7d40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd77c0ab780 tx=0x7fd77c0a70b0 comp rx=0 tx=0).stop 2024-08-31T05:37:58.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.829+0000 7fd79a922740 1 -- 172.21.15.5:0/2120253222 shutdown_connections 2024-08-31T05:37:58.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.829+0000 7fd79a922740 1 --2- 172.21.15.5:0/2120253222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589def1b070 0x5589df2c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:58.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.829+0000 7fd79a922740 1 --2- 172.21.15.5:0/2120253222 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589deefa390 0x5589df2d7d40 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:58.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.829+0000 7fd79a922740 1 --2- 172.21.15.5:0/2120253222 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589deef21b0 0x5589df2c1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:58.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.829+0000 7fd79a922740 1 -- 172.21.15.5:0/2120253222 >> 172.21.15.5:0/2120253222 conn(0x5589def0f460 msgr2=0x5589df2c1340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:58.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.829+0000 7fd79a922740 1 -- 172.21.15.5:0/2120253222 shutdown_connections 2024-08-31T05:37:58.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.829+0000 7fd79a922740 1 -- 172.21.15.5:0/2120253222 wait complete. 2024-08-31T05:37:58.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.829+0000 7fd79a922740 1 -- start start 2024-08-31T05:37:58.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.829+0000 7fd79a922740 1 Processor -- start 2024-08-31T05:37:58.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.830+0000 7fd79a922740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589deef21b0 0x5589df2cffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:58.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.830+0000 7fd79a922740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589deefa390 0x5589df2d0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:58.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.830+0000 7fd79a922740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589def1b070 0x5589df3476c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:58.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.830+0000 7fd79a922740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd78c1b4260 con 0x5589deef21b0 2024-08-31T05:37:58.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.830+0000 7fd79a922740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd78c1b3b90 con 0x5589def1b070 2024-08-31T05:37:58.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.830+0000 7fd79a922740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd78c1b0df0 con 0x5589deefa390 2024-08-31T05:37:58.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.830+0000 7fd79a922740 10 client.0 _ll_register_callbacks cb 0x7fd77c00bf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:37:58.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.830+0000 7fd792149640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589deef21b0 0x5589df2cffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:58.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.830+0000 7fd792149640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589deef21b0 0x5589df2cffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50470/0 (socket says 172.21.15.5:50470) 2024-08-31T05:37:58.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.830+0000 7fd792149640 1 -- 172.21.15.5:0/2933232458 learned_addr learned my addr 172.21.15.5:0/2933232458 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:37:58.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.830+0000 7fd791948640 1 --2- 172.21.15.5:0/2933232458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589deefa390 0x5589df2d0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:58.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.830+0000 7fd79294a640 1 --2- 172.21.15.5:0/2933232458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589def1b070 0x5589df3476c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:58.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.830+0000 7fd792149640 1 -- 172.21.15.5:0/2933232458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589deefa390 msgr2=0x5589df2d0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:58.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.830+0000 7fd792149640 1 --2- 172.21.15.5:0/2933232458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589deefa390 0x5589df2d0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:58.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.830+0000 7fd792149640 1 -- 172.21.15.5:0/2933232458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589def1b070 msgr2=0x5589df3476c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:37:58.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.830+0000 7fd792149640 1 --2- 172.21.15.5:0/2933232458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589def1b070 0x5589df3476c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:58.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.830+0000 7fd792149640 1 -- 172.21.15.5:0/2933232458 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589df2d0d10 con 0x5589deef21b0 2024-08-31T05:37:58.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.830+0000 7fd791948640 1 --2- 172.21.15.5:0/2933232458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589deefa390 0x5589df2d0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:37:58.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.830+0000 7fd792149640 1 --2- 172.21.15.5:0/2933232458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589deef21b0 0x5589df2cffe0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fd788010e90 tx=0x7fd78800bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ddd4b85bf9f8226 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:37:58.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.830+0000 7fd775ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:37:58.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.830+0000 7fd775ffb640 1 -- 172.21.15.5:0/2933232458 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd78801c680 con 0x5589deef21b0 2024-08-31T05:37:58.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.830+0000 7fd775ffb640 1 -- 172.21.15.5:0/2933232458 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7fd788005040 con 0x5589deef21b0 2024-08-31T05:37:58.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.830+0000 7fd79a922740 1 -- 172.21.15.5:0/2933232458 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd77c0ab300 con 0x5589deef21b0 2024-08-31T05:37:58.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.831+0000 7fd775ffb640 1 -- 172.21.15.5:0/2933232458 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fd788005240 con 0x5589deef21b0 2024-08-31T05:37:58.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.831+0000 7fd79a922740 10 client.17730 fetch_fsmap learned FSMap version 34 2024-08-31T05:37:58.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.831+0000 7fd79a922740 1 -- 172.21.15.5:0/2933232458 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5589df348bb0 con 0x5589deef21b0 2024-08-31T05:37:58.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.831+0000 7fd775ffb640 1 -- 172.21.15.5:0/2933232458 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd77c0ab300 con 0x5589deef21b0 2024-08-31T05:37:58.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.831+0000 7fd775ffb640 1 -- 172.21.15.5:0/2933232458 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fd788011560 con 0x5589deef21b0 2024-08-31T05:37:58.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.831+0000 7fd79a922740 10 client.17730 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:37:58.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.831+0000 7fd79a922740 10 client.17730 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:37:58.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.831+0000 7fd79a922740 20 client.17730 populate_metadata read hostname 'smithi005' 2024-08-31T05:37:58.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.831+0000 7fd79a922740 1 --2- 172.21.15.5:0/2933232458 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5589deeaeda0 0x5589df34b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:37:58.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.831+0000 7fd79a922740 4 client.17730 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:37:58.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.831+0000 7fd79a922740 1 -- 172.21.15.5:0/2933232458 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5589df235070 con 0x5589deeaeda0 2024-08-31T05:37:58.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.831+0000 7fd791948640 1 --2- 172.21.15.5:0/2933232458 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5589deeaeda0 0x5589df34b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:37:58.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.832+0000 7fd775ffb640 10 client.17730 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:37:58.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.832+0000 7fd791948640 1 --2- 172.21.15.5:0/2933232458 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5589deeaeda0 0x5589df34b2b0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af2c7c2ee66ab376 server_cookie=202ee5044cbfe377 in_seq=0 out_seq=0 2024-08-31T05:37:58.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.832+0000 7fd775ffb640 1 -- 172.21.15.5:0/2933232458 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5589df235070 con 0x5589deeaeda0 2024-08-31T05:37:58.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.832+0000 7fd775ffb640 10 client.17730 handle_command_reply: tid=0 2024-08-31T05:37:58.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.832+0000 7fd79a922740 1 client.17730 shutdown 2024-08-31T05:37:58.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.832+0000 7fd79a922740 1 -- 172.21.15.5:0/2933232458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589deef21b0 msgr2=0x5589df2cffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:58.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.832+0000 7fd79a922740 1 --2- 172.21.15.5:0/2933232458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589deef21b0 0x5589df2cffe0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fd788010e90 tx=0x7fd78800bd90 comp rx=0 tx=0).stop 2024-08-31T05:37:58.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.832+0000 7fd79a922740 1 -- 172.21.15.5:0/2933232458 shutdown_connections 2024-08-31T05:37:58.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.832+0000 7fd79a922740 1 --2- 172.21.15.5:0/2933232458 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5589deeaeda0 0x5589df34b2b0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:58.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.832+0000 7fd79a922740 1 --2- 172.21.15.5:0/2933232458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589def1b070 0x5589df3476c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:58.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.832+0000 7fd79a922740 1 --2- 172.21.15.5:0/2933232458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589deefa390 0x5589df2d0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:58.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.832+0000 7fd79a922740 1 --2- 172.21.15.5:0/2933232458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589deef21b0 0x5589df2cffe0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:58.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.832+0000 7fd775ffb640 0 client.17730 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:37:58.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.832+0000 7fd79a922740 1 -- 172.21.15.5:0/2933232458 >> 172.21.15.5:0/2933232458 conn(0x5589def0f460 msgr2=0x5589df2ccea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:58.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.832+0000 7fd79a922740 1 -- 172.21.15.5:0/2933232458 shutdown_connections 2024-08-31T05:37:58.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.832+0000 7fd79a922740 1 -- 172.21.15.5:0/2933232458 wait complete. 2024-08-31T05:37:58.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.832+0000 7fd79a922740 20 client.17730 trim_cache size 0 max 16384 2024-08-31T05:37:58.844 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:37:58.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.833+0000 7fd7943ad640 1 -- 172.21.15.5:0/3786860458 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd7780b4ca0 msgr2=0x7fd7780b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:58.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.833+0000 7fd7943ad640 1 --2- 172.21.15.5:0/3786860458 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd7780b4ca0 0x7fd7780b71b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd78402f500 tx=0x7fd78402f370 comp rx=0 tx=0).stop 2024-08-31T05:37:58.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.833+0000 7fd7943ad640 1 -- 172.21.15.5:0/3786860458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd78c108150 msgr2=0x7fd78c19c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:37:58.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.833+0000 7fd7943ad640 1 --2- 172.21.15.5:0/3786860458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd78c108150 0x7fd78c19c9b0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fd77c00d950 tx=0x7fd77c00de10 comp rx=0 tx=0).stop 2024-08-31T05:37:58.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.833+0000 7fd7943ad640 1 -- 172.21.15.5:0/3786860458 shutdown_connections 2024-08-31T05:37:58.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.833+0000 7fd7943ad640 1 --2- 172.21.15.5:0/3786860458 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd7780b4ca0 0x7fd7780b71b0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:58.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.833+0000 7fd7943ad640 1 --2- 172.21.15.5:0/3786860458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd78c108aa0 0x7fd78c1a1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:58.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.833+0000 7fd7943ad640 1 --2- 172.21.15.5:0/3786860458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd78c108150 0x7fd78c19c9b0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:58.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.833+0000 7fd7943ad640 1 --2- 172.21.15.5:0/3786860458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd78c102810 0x7fd78c19c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:37:58.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.833+0000 7fd7943ad640 1 -- 172.21.15.5:0/3786860458 >> 172.21.15.5:0/3786860458 conn(0x7fd78c0794b0 msgr2=0x7fd78c1041a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:37:58.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.833+0000 7fd7943ad640 1 -- 172.21.15.5:0/3786860458 shutdown_connections 2024-08-31T05:37:58.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:37:58.833+0000 7fd7943ad640 1 -- 172.21.15.5:0/3786860458 wait complete. 2024-08-31T05:37:58.929 INFO:tasks.workunit.client.0.smithi005.stdout: 1 901409 11.33 MB/sec execute 286 sec latency 246.480 ms 2024-08-31T05:37:58.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:37:58 smithi005 ceph-mon[18602]: pgmap v587: 129 pgs: 129 active+clean; 454 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.4 MiB/s wr, 189 op/s 2024-08-31T05:37:59.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:37:58 smithi050 ceph-mon[22146]: pgmap v587: 129 pgs: 129 active+clean; 454 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.4 MiB/s wr, 189 op/s 2024-08-31T05:37:59.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:37:58 smithi070 ceph-mon[22316]: pgmap v587: 129 pgs: 129 active+clean; 454 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.4 MiB/s wr, 189 op/s 2024-08-31T05:37:59.929 INFO:tasks.workunit.client.0.smithi005.stdout: 1 903158 11.33 MB/sec execute 287 sec latency 54.157 ms 2024-08-31T05:38:00.547 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T05:38:00.547 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T05:38:00.828 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:38:00.929 INFO:tasks.workunit.client.0.smithi005.stdout: 1 904990 11.32 MB/sec execute 288 sec latency 51.237 ms 2024-08-31T05:38:01.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:38:00 smithi050 ceph-mon[22146]: pgmap v588: 129 pgs: 129 active+clean; 462 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.6 MiB/s wr, 264 op/s 2024-08-31T05:38:01.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:38:00 smithi005 ceph-mon[18602]: pgmap v588: 129 pgs: 129 active+clean; 462 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.6 MiB/s wr, 264 op/s 2024-08-31T05:38:01.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:38:00 smithi070 ceph-mon[22316]: pgmap v588: 129 pgs: 129 active+clean; 462 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.6 MiB/s wr, 264 op/s 2024-08-31T05:38:01.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.343+0000 7f427ea39640 1 -- 172.21.15.5:0/1604430312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4278103900 msgr2=0x7f4278103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:01.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.343+0000 7f427ea39640 1 --2- 172.21.15.5:0/1604430312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4278103900 0x7f4278103d10 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f4268009900 tx=0x7f426802a410 comp rx=0 tx=0).stop 2024-08-31T05:38:01.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.343+0000 7f427ea39640 1 -- 172.21.15.5:0/1604430312 shutdown_connections 2024-08-31T05:38:01.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.343+0000 7f427ea39640 1 --2- 172.21.15.5:0/1604430312 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4278109b90 0x7f42781103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.343+0000 7f427ea39640 1 --2- 172.21.15.5:0/1604430312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4278109240 0x7f4278109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.343+0000 7f427ea39640 1 --2- 172.21.15.5:0/1604430312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4278103900 0x7f4278103d10 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.343+0000 7f427ea39640 1 -- 172.21.15.5:0/1604430312 >> 172.21.15.5:0/1604430312 conn(0x7f427807b5f0 msgr2=0x7f427807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:01.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.343+0000 7f427ea39640 1 -- 172.21.15.5:0/1604430312 shutdown_connections 2024-08-31T05:38:01.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.343+0000 7f427ea39640 1 -- 172.21.15.5:0/1604430312 wait complete. 2024-08-31T05:38:01.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.344+0000 7f427ea39640 1 Processor -- start 2024-08-31T05:38:01.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.344+0000 7f427ea39640 1 -- start start 2024-08-31T05:38:01.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.344+0000 7f427ea39640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4278103900 0x7f42780754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:01.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.344+0000 7f427ea39640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4278109240 0x7f42780759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:01.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.344+0000 7f427ea39640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4278109b90 0x7f4278075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:01.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.344+0000 7f427ea39640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4278113850 con 0x7f4278109b90 2024-08-31T05:38:01.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.344+0000 7f427ea39640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f42781136d0 con 0x7f4278103900 2024-08-31T05:38:01.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.344+0000 7f427ea39640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f42781139d0 con 0x7f4278109240 2024-08-31T05:38:01.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.344+0000 7f427cfd6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4278109b90 0x7f4278075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:01.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.344+0000 7f42777fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4278109240 0x7f42780759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:01.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.344+0000 7f427cfd6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4278109b90 0x7f4278075f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50486/0 (socket says 172.21.15.5:50486) 2024-08-31T05:38:01.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.344+0000 7f427cfd6640 1 -- 172.21.15.5:0/177451663 learned_addr learned my addr 172.21.15.5:0/177451663 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:01.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.344+0000 7f4277fff640 1 --2- 172.21.15.5:0/177451663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4278103900 0x7f42780754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:01.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.345+0000 7f427cfd6640 1 -- 172.21.15.5:0/177451663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4278109240 msgr2=0x7f42780759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:01.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.345+0000 7f427cfd6640 1 --2- 172.21.15.5:0/177451663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4278109240 0x7f42780759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.345+0000 7f427cfd6640 1 -- 172.21.15.5:0/177451663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4278103900 msgr2=0x7f42780754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:01.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.345+0000 7f427cfd6640 1 --2- 172.21.15.5:0/177451663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4278103900 0x7f42780754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.345+0000 7f427cfd6640 1 -- 172.21.15.5:0/177451663 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42781a8500 con 0x7f4278109b90 2024-08-31T05:38:01.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.345+0000 7f427cfd6640 1 --2- 172.21.15.5:0/177451663 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4278109b90 0x7f4278075f30 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f427000eaa0 tx=0x7f427000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:01.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.345+0000 7f42757fa640 1 -- 172.21.15.5:0/177451663 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f427000cdb0 con 0x7f4278109b90 2024-08-31T05:38:01.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.345+0000 7f42757fa640 1 -- 172.21.15.5:0/177451663 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4270005020 con 0x7f4278109b90 2024-08-31T05:38:01.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.345+0000 7f427ea39640 1 -- 172.21.15.5:0/177451663 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42781a87f0 con 0x7f4278109b90 2024-08-31T05:38:01.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.345+0000 7f42757fa640 1 -- 172.21.15.5:0/177451663 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42700116d0 con 0x7f4278109b90 2024-08-31T05:38:01.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.345+0000 7f427ea39640 1 -- 172.21.15.5:0/177451663 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42781a8d30 con 0x7f4278109b90 2024-08-31T05:38:01.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.348+0000 7f4284fae740 1 Processor -- start 2024-08-31T05:38:01.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.348+0000 7f42757fa640 1 -- 172.21.15.5:0/177451663 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f4270011870 con 0x7f4278109b90 2024-08-31T05:38:01.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.348+0000 7f4284fae740 1 -- start start 2024-08-31T05:38:01.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.348+0000 7f4284fae740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56265009e350 0x562650444780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:01.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.348+0000 7f4284fae740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562650075490 0x562650444cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:01.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.348+0000 7f4284fae740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56265007d670 0x562650445200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:01.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.348+0000 7f4284fae740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5626503ba5f0 con 0x56265009e350 2024-08-31T05:38:01.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.348+0000 7f4284fae740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5626503a9b80 con 0x56265007d670 2024-08-31T05:38:01.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.348+0000 7f4284fae740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5626503adb30 con 0x562650075490 2024-08-31T05:38:01.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.348+0000 7f42777fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56265009e350 0x562650444780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:01.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.348+0000 7f4277fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562650075490 0x562650444cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:01.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.348+0000 7f42777fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56265009e350 0x562650444780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50490/0 (socket says 172.21.15.5:50490) 2024-08-31T05:38:01.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.348+0000 7f42777fe640 1 -- 172.21.15.5:0/2952968667 learned_addr learned my addr 172.21.15.5:0/2952968667 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:01.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.349+0000 7f42777fe640 1 --2- 172.21.15.5:0/2952968667 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56265007d670 0x562650445200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:01.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.349+0000 7f42757fa640 1 --2- 172.21.15.5:0/177451663 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f42600b4d20 0x7f42600b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:01.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.349+0000 7f4277fff640 1 -- 172.21.15.5:0/2952968667 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56265007d670 msgr2=0x562650445200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:01.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.349+0000 7f4277fff640 1 --2- 172.21.15.5:0/2952968667 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56265007d670 0x562650445200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.349+0000 7f4277fff640 1 -- 172.21.15.5:0/2952968667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56265009e350 msgr2=0x562650444780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:01.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.349+0000 7f4277fff640 1 --2- 172.21.15.5:0/2952968667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56265009e350 0x562650444780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.349+0000 7f4277fff640 1 -- 172.21.15.5:0/2952968667 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562650109930 con 0x562650075490 2024-08-31T05:38:01.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.349+0000 7f42777fe640 1 --2- 172.21.15.5:0/2952968667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56265009e350 0x562650444780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:38:01.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.349+0000 7f427cfd6640 1 --2- 172.21.15.5:0/177451663 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f42600b4d20 0x7f42600b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:01.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.349+0000 7f42757fa640 1 -- 172.21.15.5:0/177451663 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7f42700e59c0 con 0x7f4278109b90 2024-08-31T05:38:01.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.349+0000 7f4277fff640 1 --2- 172.21.15.5:0/2952968667 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562650075490 0x562650444cc0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4278076f00 tx=0x7f4268032c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e29426834f54c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:01.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.349+0000 7f425e7fc640 1 -- 172.21.15.5:0/2952968667 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4268040070 con 0x562650075490 2024-08-31T05:38:01.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.349+0000 7f425e7fc640 1 -- 172.21.15.5:0/2952968667 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4268032e50 con 0x562650075490 2024-08-31T05:38:01.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.349+0000 7f425e7fc640 1 -- 172.21.15.5:0/2952968667 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4268035040 con 0x562650075490 2024-08-31T05:38:01.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.350+0000 7f4284fae740 1 -- 172.21.15.5:0/2952968667 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562650075490 msgr2=0x562650444cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:01.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.350+0000 7f427cfd6640 1 --2- 172.21.15.5:0/177451663 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f42600b4d20 0x7f42600b7230 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f42700e3330 tx=0x7f4270021f60 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:01.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.350+0000 7f4284fae740 1 --2- 172.21.15.5:0/2952968667 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562650075490 0x562650444cc0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4278076f00 tx=0x7f4268032c60 comp rx=0 tx=0).stop 2024-08-31T05:38:01.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.350+0000 7f4284fae740 1 -- 172.21.15.5:0/2952968667 shutdown_connections 2024-08-31T05:38:01.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.350+0000 7f4284fae740 1 --2- 172.21.15.5:0/2952968667 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56265007d670 0x562650445200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.350+0000 7f4284fae740 1 --2- 172.21.15.5:0/2952968667 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562650075490 0x562650444cc0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.350+0000 7f4284fae740 1 --2- 172.21.15.5:0/2952968667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56265009e350 0x562650444780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.350+0000 7f4284fae740 1 -- 172.21.15.5:0/2952968667 >> 172.21.15.5:0/2952968667 conn(0x562650092740 msgr2=0x562650442670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:01.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.350+0000 7f4284fae740 1 -- 172.21.15.5:0/2952968667 shutdown_connections 2024-08-31T05:38:01.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.350+0000 7f4284fae740 1 -- 172.21.15.5:0/2952968667 wait complete. 2024-08-31T05:38:01.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.351+0000 7f4284fae740 1 -- start start 2024-08-31T05:38:01.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.351+0000 7f4284fae740 1 Processor -- start 2024-08-31T05:38:01.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.351+0000 7f4284fae740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562650075490 0x56265044ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:01.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.351+0000 7f4284fae740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56265007d670 0x562650450490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:01.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.351+0000 7f4284fae740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56265009e350 0x56265045c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:01.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.351+0000 7f4284fae740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56265020c890 con 0x56265007d670 2024-08-31T05:38:01.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.351+0000 7f4284fae740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562650330790 con 0x562650075490 2024-08-31T05:38:01.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.351+0000 7f4284fae740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562650452f00 con 0x56265009e350 2024-08-31T05:38:01.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.351+0000 7f4277fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56265007d670 0x562650450490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:01.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.352+0000 7f42777fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562650075490 0x56265044ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:01.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.351+0000 7f4284fae740 10 client.0 _ll_register_callbacks cb 0x5626500b5ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:38:01.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.352+0000 7f4277fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56265007d670 0x562650450490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50492/0 (socket says 172.21.15.5:50492) 2024-08-31T05:38:01.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.352+0000 7f42777fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562650075490 0x56265044ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:57822/0 (socket says 172.21.15.5:57822) 2024-08-31T05:38:01.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.352+0000 7f4277fff640 1 -- 172.21.15.5:0/3755335237 learned_addr learned my addr 172.21.15.5:0/3755335237 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:01.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.352+0000 7f42777fe640 1 --2- 172.21.15.5:0/3755335237 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56265009e350 0x56265045c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:01.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.352+0000 7f4277fff640 1 -- 172.21.15.5:0/3755335237 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56265009e350 msgr2=0x56265045c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:01.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.352+0000 7f4277fff640 1 --2- 172.21.15.5:0/3755335237 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56265009e350 0x56265045c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.352+0000 7f4277fff640 1 -- 172.21.15.5:0/3755335237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562650075490 msgr2=0x56265044ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:01.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.352+0000 7f4277fff640 1 --2- 172.21.15.5:0/3755335237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562650075490 0x56265044ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.352+0000 7f4277fff640 1 -- 172.21.15.5:0/3755335237 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562650367f30 con 0x56265007d670 2024-08-31T05:38:01.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.352+0000 7f42777fe640 1 --2- 172.21.15.5:0/3755335237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562650075490 0x56265044ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:38:01.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.352+0000 7f4277fff640 1 --2- 172.21.15.5:0/3755335237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56265007d670 0x562650450490 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f42680054e0 tx=0x7f4268005510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc5d488dcf1b052a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:01.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.352+0000 7f42577fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:38:01.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.352+0000 7f42577fe640 1 -- 172.21.15.5:0/3755335237 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f426804b020 con 0x56265007d670 2024-08-31T05:38:01.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.352+0000 7f42577fe640 1 -- 172.21.15.5:0/3755335237 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7f4268004040 con 0x56265007d670 2024-08-31T05:38:01.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.352+0000 7f4284fae740 1 -- 172.21.15.5:0/3755335237 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4268032e50 con 0x56265007d670 2024-08-31T05:38:01.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.352+0000 7f42577fe640 1 -- 172.21.15.5:0/3755335237 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f4268056050 con 0x56265007d670 2024-08-31T05:38:01.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.353+0000 7f4284fae740 10 client.17742 fetch_fsmap learned FSMap version 34 2024-08-31T05:38:01.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.353+0000 7f4284fae740 1 -- 172.21.15.5:0/3755335237 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56265045ed30 con 0x56265007d670 2024-08-31T05:38:01.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.353+0000 7f42577fe640 1 -- 172.21.15.5:0/3755335237 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4268032e50 con 0x56265007d670 2024-08-31T05:38:01.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.353+0000 7f42577fe640 1 -- 172.21.15.5:0/3755335237 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f4268004c90 con 0x56265007d670 2024-08-31T05:38:01.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.353+0000 7f4284fae740 10 client.17742 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:38:01.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.353+0000 7f4284fae740 10 client.17742 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:38:01.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.353+0000 7f4284fae740 20 client.17742 populate_metadata read hostname 'smithi005' 2024-08-31T05:38:01.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.353+0000 7f4284fae740 1 --2- 172.21.15.5:0/3755335237 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56265005ccd0 0x562650462090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:01.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.353+0000 7f4284fae740 4 client.17742 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:38:01.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.353+0000 7f4284fae740 1 -- 172.21.15.5:0/3755335237 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5626503bc540 con 0x56265005ccd0 2024-08-31T05:38:01.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.353+0000 7f42777fe640 1 --2- 172.21.15.5:0/3755335237 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56265005ccd0 0x562650462090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:01.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.354+0000 7f42777fe640 1 --2- 172.21.15.5:0/3755335237 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56265005ccd0 0x562650462090 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6522f2739e2cdfdf server_cookie=f883d77a4d63c9f6 in_seq=0 out_seq=0 2024-08-31T05:38:01.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.354+0000 7f42577fe640 10 client.17742 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:38:01.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.354+0000 7f42577fe640 1 -- 172.21.15.5:0/3755335237 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5626503bc540 con 0x56265005ccd0 2024-08-31T05:38:01.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.354+0000 7f42577fe640 10 client.17742 handle_command_reply: tid=0 2024-08-31T05:38:01.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.354+0000 7f4284fae740 1 client.17742 shutdown 2024-08-31T05:38:01.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.355+0000 7f4284fae740 1 -- 172.21.15.5:0/3755335237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56265007d670 msgr2=0x562650450490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:01.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.355+0000 7f4284fae740 1 --2- 172.21.15.5:0/3755335237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56265007d670 0x562650450490 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f42680054e0 tx=0x7f4268005510 comp rx=0 tx=0).stop 2024-08-31T05:38:01.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.355+0000 7f4284fae740 1 -- 172.21.15.5:0/3755335237 shutdown_connections 2024-08-31T05:38:01.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.355+0000 7f4284fae740 1 --2- 172.21.15.5:0/3755335237 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56265005ccd0 0x562650462090 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.355+0000 7f4284fae740 1 --2- 172.21.15.5:0/3755335237 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56265009e350 0x56265045c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.355+0000 7f4284fae740 1 --2- 172.21.15.5:0/3755335237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56265007d670 0x562650450490 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.355+0000 7f4284fae740 1 --2- 172.21.15.5:0/3755335237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562650075490 0x56265044ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.355+0000 7f4284fae740 1 -- 172.21.15.5:0/3755335237 >> 172.21.15.5:0/3755335237 conn(0x562650092740 msgr2=0x562650447960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:01.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.355+0000 7f42577fe640 0 client.17742 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:38:01.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.355+0000 7f4284fae740 1 -- 172.21.15.5:0/3755335237 shutdown_connections 2024-08-31T05:38:01.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.355+0000 7f4284fae740 1 -- 172.21.15.5:0/3755335237 wait complete. 2024-08-31T05:38:01.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.355+0000 7f4284fae740 20 client.17742 trim_cache size 0 max 16384 2024-08-31T05:38:01.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.373+0000 7f4284fae740 1 Processor -- start 2024-08-31T05:38:01.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.373+0000 7f4284fae740 1 -- start start 2024-08-31T05:38:01.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.373+0000 7f4284fae740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562650075490 0x562650447f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:01.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.373+0000 7f4284fae740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56265007d670 0x56265044d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:01.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.373+0000 7f4284fae740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56265009e350 0x56265044d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:01.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.373+0000 7f4284fae740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f42781b2f50 con 0x562650075490 2024-08-31T05:38:01.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.373+0000 7f4284fae740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f42781b4a90 con 0x56265009e350 2024-08-31T05:38:01.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.373+0000 7f4284fae740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f42781b3620 con 0x56265007d670 2024-08-31T05:38:01.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.373+0000 7f42777fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562650075490 0x562650447f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:01.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.373+0000 7f42777fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562650075490 0x562650447f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50494/0 (socket says 172.21.15.5:50494) 2024-08-31T05:38:01.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.373+0000 7f42777fe640 1 -- 172.21.15.5:0/2512801828 learned_addr learned my addr 172.21.15.5:0/2512801828 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:01.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.373+0000 7f4277fff640 1 --2- 172.21.15.5:0/2512801828 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56265007d670 0x56265044d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:01.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.373+0000 7f42777fe640 1 --2- 172.21.15.5:0/2512801828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56265009e350 0x56265044d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:01.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.373+0000 7f42777fe640 1 -- 172.21.15.5:0/2512801828 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56265007d670 msgr2=0x56265044d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:01.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.373+0000 7f42777fe640 1 --2- 172.21.15.5:0/2512801828 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56265007d670 0x56265044d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.373+0000 7f42777fe640 1 -- 172.21.15.5:0/2512801828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56265009e350 msgr2=0x56265044d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:01.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.373+0000 7f42777fe640 1 --2- 172.21.15.5:0/2512801828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56265009e350 0x56265044d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.373+0000 7f42777fe640 1 -- 172.21.15.5:0/2512801828 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56265044eeb0 con 0x562650075490 2024-08-31T05:38:01.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.374+0000 7f42777fe640 1 --2- 172.21.15.5:0/2512801828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562650075490 0x562650447f90 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x5626504527a0 tx=0x7f426c00b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49115f5b82d2b47f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:01.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.374+0000 7f425dffb640 1 -- 172.21.15.5:0/2512801828 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f426c010db0 con 0x562650075490 2024-08-31T05:38:01.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.374+0000 7f425dffb640 1 -- 172.21.15.5:0/2512801828 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f426c005020 con 0x562650075490 2024-08-31T05:38:01.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.374+0000 7f425dffb640 1 -- 172.21.15.5:0/2512801828 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f426c0047a0 con 0x562650075490 2024-08-31T05:38:01.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.375+0000 7f4284fae740 1 -- 172.21.15.5:0/2512801828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562650075490 msgr2=0x562650447f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:01.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.375+0000 7f4284fae740 1 --2- 172.21.15.5:0/2512801828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562650075490 0x562650447f90 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x5626504527a0 tx=0x7f426c00b410 comp rx=0 tx=0).stop 2024-08-31T05:38:01.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.375+0000 7f4284fae740 1 -- 172.21.15.5:0/2512801828 shutdown_connections 2024-08-31T05:38:01.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.375+0000 7f4284fae740 1 --2- 172.21.15.5:0/2512801828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56265009e350 0x56265044d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.375+0000 7f4284fae740 1 --2- 172.21.15.5:0/2512801828 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56265007d670 0x56265044d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.375+0000 7f4284fae740 1 --2- 172.21.15.5:0/2512801828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562650075490 0x562650447f90 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.375+0000 7f4284fae740 1 -- 172.21.15.5:0/2512801828 >> 172.21.15.5:0/2512801828 conn(0x562650092740 msgr2=0x562650447880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:01.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.375+0000 7f4284fae740 1 -- 172.21.15.5:0/2512801828 shutdown_connections 2024-08-31T05:38:01.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.375+0000 7f4284fae740 1 -- 172.21.15.5:0/2512801828 wait complete. 2024-08-31T05:38:01.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.375+0000 7f4284fae740 1 -- start start 2024-08-31T05:38:01.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.375+0000 7f4284fae740 1 Processor -- start 2024-08-31T05:38:01.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.376+0000 7f4284fae740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562650075490 0x562650463060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:01.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.376+0000 7f4284fae740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56265007d670 0x5626504635a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:01.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.376+0000 7f4284fae740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56265009e350 0x562650463ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:01.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.376+0000 7f4284fae740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f42781b43c0 con 0x56265007d670 2024-08-31T05:38:01.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.376+0000 7f4284fae740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f42781b3cf0 con 0x56265009e350 2024-08-31T05:38:01.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.376+0000 7f4284fae740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f42781b0f50 con 0x562650075490 2024-08-31T05:38:01.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.376+0000 7f4284fae740 10 client.0 _ll_register_callbacks cb 0x7f426c00bb10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:38:01.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.376+0000 7f4277fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56265007d670 0x5626504635a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:01.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.376+0000 7f42777fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562650075490 0x562650463060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:01.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.376+0000 7f4277fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56265007d670 0x5626504635a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50500/0 (socket says 172.21.15.5:50500) 2024-08-31T05:38:01.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.376+0000 7f4277fff640 1 -- 172.21.15.5:0/3369340024 learned_addr learned my addr 172.21.15.5:0/3369340024 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:01.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.376+0000 7f42777fe640 1 --2- 172.21.15.5:0/3369340024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56265009e350 0x562650463ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:01.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.376+0000 7f4277fff640 1 -- 172.21.15.5:0/3369340024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562650075490 msgr2=0x562650463060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:01.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.376+0000 7f4277fff640 1 --2- 172.21.15.5:0/3369340024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562650075490 0x562650463060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.376+0000 7f4277fff640 1 -- 172.21.15.5:0/3369340024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56265009e350 msgr2=0x562650463ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:01.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.376+0000 7f4277fff640 1 --2- 172.21.15.5:0/3369340024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56265009e350 0x562650463ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.376+0000 7f4277fff640 1 -- 172.21.15.5:0/3369340024 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626504d4020 con 0x56265007d670 2024-08-31T05:38:01.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.376+0000 7f42777fe640 1 --2- 172.21.15.5:0/3369340024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562650075490 0x562650463060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:38:01.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.376+0000 7f4277fff640 1 --2- 172.21.15.5:0/3369340024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56265007d670 0x5626504635a0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f4268009900 tx=0x7f42680051c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f756dfdaf3ad9626 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:01.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.376+0000 7f42577fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:38:01.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.376+0000 7f42577fe640 1 -- 172.21.15.5:0/3369340024 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f426805f060 con 0x56265007d670 2024-08-31T05:38:01.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.377+0000 7f42577fe640 1 -- 172.21.15.5:0/3369340024 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7f4268031a90 con 0x56265007d670 2024-08-31T05:38:01.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.377+0000 7f4284fae740 1 -- 172.21.15.5:0/3369340024 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f426c005020 con 0x56265007d670 2024-08-31T05:38:01.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.377+0000 7f42577fe640 1 -- 172.21.15.5:0/3369340024 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f4268066050 con 0x56265007d670 2024-08-31T05:38:01.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.377+0000 7f4284fae740 10 client.17748 fetch_fsmap learned FSMap version 34 2024-08-31T05:38:01.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.377+0000 7f4284fae740 1 -- 172.21.15.5:0/3369340024 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5626504d5280 con 0x56265007d670 2024-08-31T05:38:01.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.377+0000 7f42577fe640 1 -- 172.21.15.5:0/3369340024 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f426c005020 con 0x56265007d670 2024-08-31T05:38:01.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.377+0000 7f42577fe640 1 -- 172.21.15.5:0/3369340024 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f4268004d00 con 0x56265007d670 2024-08-31T05:38:01.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.377+0000 7f4284fae740 10 client.17748 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:38:01.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.377+0000 7f4284fae740 10 client.17748 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:38:01.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.377+0000 7f4284fae740 20 client.17748 populate_metadata read hostname 'smithi005' 2024-08-31T05:38:01.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.377+0000 7f4284fae740 1 --2- 172.21.15.5:0/3369340024 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x562650032080 0x5626504d7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:01.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.377+0000 7f4284fae740 4 client.17748 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T05:38:01.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.377+0000 7f4284fae740 1 -- 172.21.15.5:0/3369340024 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5626503b7fe0 con 0x562650032080 2024-08-31T05:38:01.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.377+0000 7f42777fe640 1 --2- 172.21.15.5:0/3369340024 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x562650032080 0x5626504d7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:01.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.378+0000 7f42777fe640 1 --2- 172.21.15.5:0/3369340024 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x562650032080 0x5626504d7980 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30711dffe30d60fd server_cookie=44d3293373209095 in_seq=0 out_seq=0 2024-08-31T05:38:01.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.378+0000 7f42577fe640 10 client.17748 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:38:01.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.380+0000 7f42577fe640 1 -- 172.21.15.5:0/3369340024 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5626503b7fe0 con 0x562650032080 2024-08-31T05:38:01.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.380+0000 7f42577fe640 10 client.17748 handle_command_reply: tid=0 2024-08-31T05:38:01.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.380+0000 7f4284fae740 1 client.17748 shutdown 2024-08-31T05:38:01.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.380+0000 7f4284fae740 1 -- 172.21.15.5:0/3369340024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56265007d670 msgr2=0x5626504635a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:01.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.380+0000 7f4284fae740 1 --2- 172.21.15.5:0/3369340024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56265007d670 0x5626504635a0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f4268009900 tx=0x7f42680051c0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.380+0000 7f4284fae740 1 -- 172.21.15.5:0/3369340024 shutdown_connections 2024-08-31T05:38:01.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.380+0000 7f4284fae740 1 --2- 172.21.15.5:0/3369340024 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x562650032080 0x5626504d7980 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.380+0000 7f4284fae740 1 --2- 172.21.15.5:0/3369340024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56265009e350 0x562650463ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.380+0000 7f4284fae740 1 --2- 172.21.15.5:0/3369340024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56265007d670 0x5626504635a0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.380+0000 7f4284fae740 1 --2- 172.21.15.5:0/3369340024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562650075490 0x562650463060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.380+0000 7f4284fae740 1 -- 172.21.15.5:0/3369340024 >> 172.21.15.5:0/3369340024 conn(0x562650092740 msgr2=0x5626504457b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:01.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.380+0000 7f42577fe640 0 client.17748 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:38:01.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.380+0000 7f4284fae740 1 -- 172.21.15.5:0/3369340024 shutdown_connections 2024-08-31T05:38:01.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.380+0000 7f4284fae740 1 -- 172.21.15.5:0/3369340024 wait complete. 2024-08-31T05:38:01.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.380+0000 7f4284fae740 20 client.17748 trim_cache size 0 max 16384 2024-08-31T05:38:01.386 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:38:01.386 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-08-31T05:38:01.386 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "a4d4cf74-2477-4dd9-a3a2-3762b4dd87e4", 2024-08-31T05:38:01.386 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-08-31T05:38:01.387 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:38:01.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.381+0000 7f427ea39640 1 -- 172.21.15.5:0/177451663 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f42600b4d20 msgr2=0x7f42600b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:01.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.381+0000 7f427ea39640 1 --2- 172.21.15.5:0/177451663 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f42600b4d20 0x7f42600b7230 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f42700e3330 tx=0x7f4270021f60 comp rx=0 tx=0).stop 2024-08-31T05:38:01.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.381+0000 7f427ea39640 1 -- 172.21.15.5:0/177451663 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4278109b90 msgr2=0x7f4278075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:01.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.381+0000 7f427ea39640 1 --2- 172.21.15.5:0/177451663 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4278109b90 0x7f4278075f30 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f427000eaa0 tx=0x7f427000ef60 comp rx=0 tx=0).stop 2024-08-31T05:38:01.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.381+0000 7f427ea39640 1 -- 172.21.15.5:0/177451663 shutdown_connections 2024-08-31T05:38:01.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.381+0000 7f427ea39640 1 --2- 172.21.15.5:0/177451663 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f42600b4d20 0x7f42600b7230 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.381+0000 7f427ea39640 1 --2- 172.21.15.5:0/177451663 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4278109b90 0x7f4278075f30 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.381+0000 7f427ea39640 1 --2- 172.21.15.5:0/177451663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4278109240 0x7f42780759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.381+0000 7f427ea39640 1 --2- 172.21.15.5:0/177451663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4278103900 0x7f42780754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.381+0000 7f427ea39640 1 -- 172.21.15.5:0/177451663 >> 172.21.15.5:0/177451663 conn(0x7f427807b5f0 msgr2=0x7f42781072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:01.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.381+0000 7f427ea39640 1 -- 172.21.15.5:0/177451663 shutdown_connections 2024-08-31T05:38:01.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:01.381+0000 7f427ea39640 1 -- 172.21.15.5:0/177451663 wait complete. 2024-08-31T05:38:01.771 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.769+0000 7ff4e282f640 1 -- 172.21.15.5:0/1452349758 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4dc1046d0 msgr2=0x7ff4dc104ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:01.772 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.769+0000 7ff4e282f640 1 --2- 172.21.15.5:0/1452349758 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4dc1046d0 0x7ff4dc104ae0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc009900 tx=0x7ff4cc02a410 comp rx=0 tx=0).stop 2024-08-31T05:38:01.772 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.769+0000 7ff4e282f640 1 -- 172.21.15.5:0/1452349758 shutdown_connections 2024-08-31T05:38:01.772 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.769+0000 7ff4e282f640 1 --2- 172.21.15.5:0/1452349758 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4dc10db30 0x7ff4dc110020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.772 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.769+0000 7ff4e282f640 1 --2- 172.21.15.5:0/1452349758 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4dc105020 0x7ff4dc10d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.772 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.769+0000 7ff4e282f640 1 --2- 172.21.15.5:0/1452349758 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4dc1046d0 0x7ff4dc104ae0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.772 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.769+0000 7ff4e282f640 1 -- 172.21.15.5:0/1452349758 >> 172.21.15.5:0/1452349758 conn(0x7ff4dc0fe180 msgr2=0x7ff4dc1005d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:01.772 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.769+0000 7ff4e282f640 1 -- 172.21.15.5:0/1452349758 shutdown_connections 2024-08-31T05:38:01.772 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.769+0000 7ff4e282f640 1 -- 172.21.15.5:0/1452349758 wait complete. 2024-08-31T05:38:01.772 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.769+0000 7ff4e282f640 1 Processor -- start 2024-08-31T05:38:01.772 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.770+0000 7ff4e282f640 1 -- start start 2024-08-31T05:38:01.774 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.770+0000 7ff4e282f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4dc1046d0 0x7ff4dc19a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:01.774 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.770+0000 7ff4e282f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4dc105020 0x7ff4dc19a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:01.774 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.770+0000 7ff4e282f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4dc10db30 0x7ff4dc19fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:01.774 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.770+0000 7ff4e282f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff4dc1137c0 con 0x7ff4dc1046d0 2024-08-31T05:38:01.774 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.770+0000 7ff4e282f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff4dc113640 con 0x7ff4dc105020 2024-08-31T05:38:01.774 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.770+0000 7ff4e282f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff4dc113940 con 0x7ff4dc10db30 2024-08-31T05:38:01.775 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.770+0000 7ff4dbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4dc1046d0 0x7ff4dc19a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:01.775 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.770+0000 7ff4dbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4dc1046d0 0x7ff4dc19a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50522/0 (socket says 172.21.15.5:50522) 2024-08-31T05:38:01.775 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.770+0000 7ff4dbfff640 1 -- 172.21.15.5:0/999552497 learned_addr learned my addr 172.21.15.5:0/999552497 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:01.775 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.770+0000 7ff4db7fe640 1 --2- 172.21.15.5:0/999552497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4dc105020 0x7ff4dc19a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:01.775 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.770+0000 7ff4e0dcc640 1 --2- 172.21.15.5:0/999552497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4dc10db30 0x7ff4dc19fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:01.775 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.770+0000 7ff4dbfff640 1 -- 172.21.15.5:0/999552497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4dc10db30 msgr2=0x7ff4dc19fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:01.775 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.770+0000 7ff4dbfff640 1 --2- 172.21.15.5:0/999552497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4dc10db30 0x7ff4dc19fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.775 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.770+0000 7ff4dbfff640 1 -- 172.21.15.5:0/999552497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4dc105020 msgr2=0x7ff4dc19a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:01.775 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.770+0000 7ff4dbfff640 1 --2- 172.21.15.5:0/999552497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4dc105020 0x7ff4dc19a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.775 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.770+0000 7ff4dbfff640 1 -- 172.21.15.5:0/999552497 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4dc1a0170 con 0x7ff4dc1046d0 2024-08-31T05:38:01.775 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.771+0000 7ff4dbfff640 1 --2- 172.21.15.5:0/999552497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4dc1046d0 0x7ff4dc19a240 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc005940 tx=0x7ff4cc0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:01.775 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.771+0000 7ff4d97fa640 1 -- 172.21.15.5:0/999552497 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc03f030 con 0x7ff4dc1046d0 2024-08-31T05:38:01.775 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.771+0000 7ff4e282f640 1 -- 172.21.15.5:0/999552497 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4dc1a0400 con 0x7ff4dc1046d0 2024-08-31T05:38:01.776 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.771+0000 7ff4d97fa640 1 -- 172.21.15.5:0/999552497 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4cc0044c0 con 0x7ff4dc1046d0 2024-08-31T05:38:01.776 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.771+0000 7ff4d97fa640 1 -- 172.21.15.5:0/999552497 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc035070 con 0x7ff4dc1046d0 2024-08-31T05:38:01.776 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.771+0000 7ff4e282f640 1 -- 172.21.15.5:0/999552497 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4dc1a6bf0 con 0x7ff4dc1046d0 2024-08-31T05:38:01.778 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.774+0000 7ff4e987c740 1 Processor -- start 2024-08-31T05:38:01.778 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.774+0000 7ff4e987c740 1 -- start start 2024-08-31T05:38:01.778 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.774+0000 7ff4d97fa640 1 -- 172.21.15.5:0/999552497 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7ff4cc042030 con 0x7ff4dc1046d0 2024-08-31T05:38:01.778 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.774+0000 7ff4e987c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aea30e21b0 0x55aea3485ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.774+0000 7ff4e987c740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aea30b92f0 0x55aea3486000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.774+0000 7ff4e987c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aea30c14d0 0x55aea3486540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.774+0000 7ff4e987c740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55aea33fb000 con 0x55aea30b92f0 2024-08-31T05:38:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.774+0000 7ff4e987c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55aea33ea590 con 0x55aea30c14d0 2024-08-31T05:38:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.774+0000 7ff4e987c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55aea33ee540 con 0x55aea30e21b0 2024-08-31T05:38:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.774+0000 7ff4dbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aea30b92f0 0x55aea3486000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.774+0000 7ff4db7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aea30c14d0 0x55aea3486540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.774+0000 7ff4e0dcc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aea30e21b0 0x55aea3485ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.774+0000 7ff4e0dcc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aea30e21b0 0x55aea3485ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:33774/0 (socket says 172.21.15.5:33774) 2024-08-31T05:38:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.774+0000 7ff4db7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aea30c14d0 0x55aea3486540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:57874/0 (socket says 172.21.15.5:57874) 2024-08-31T05:38:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.774+0000 7ff4e0dcc640 1 -- 172.21.15.5:0/3529761559 learned_addr learned my addr 172.21.15.5:0/3529761559 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.775+0000 7ff4e0dcc640 1 -- 172.21.15.5:0/3529761559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aea30c14d0 msgr2=0x55aea3486540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:01.780 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.775+0000 7ff4e0dcc640 1 --2- 172.21.15.5:0/3529761559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aea30c14d0 0x55aea3486540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.780 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.775+0000 7ff4e0dcc640 1 -- 172.21.15.5:0/3529761559 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aea30b92f0 msgr2=0x55aea3486000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:01.780 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.775+0000 7ff4e0dcc640 1 --2- 172.21.15.5:0/3529761559 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aea30b92f0 0x55aea3486000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.780 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.775+0000 7ff4e0dcc640 1 -- 172.21.15.5:0/3529761559 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aea314d790 con 0x55aea30e21b0 2024-08-31T05:38:01.780 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.775+0000 7ff4db7fe640 1 --2- 172.21.15.5:0/3529761559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aea30c14d0 0x55aea3486540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:38:01.780 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.775+0000 7ff4e0dcc640 1 --2- 172.21.15.5:0/3529761559 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aea30e21b0 0x55aea3485ac0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff4d4011440 tx=0x7ff4d4011900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9eebddcfa2b1fcaf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:01.780 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.775+0000 7ff4d97fa640 1 --2- 172.21.15.5:0/999552497 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff4c40b4ca0 0x7ff4c40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:01.780 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.775+0000 7ff4c27fc640 1 -- 172.21.15.5:0/3529761559 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d4004d20 con 0x55aea30e21b0 2024-08-31T05:38:01.780 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.775+0000 7ff4c27fc640 1 -- 172.21.15.5:0/3529761559 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4d4004050 con 0x55aea30e21b0 2024-08-31T05:38:01.780 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.775+0000 7ff4c27fc640 1 -- 172.21.15.5:0/3529761559 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d400f7a0 con 0x55aea30e21b0 2024-08-31T05:38:01.780 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.775+0000 7ff4dbfff640 1 --2- 172.21.15.5:0/999552497 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff4c40b4ca0 0x7ff4c40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:01.780 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.775+0000 7ff4d97fa640 1 -- 172.21.15.5:0/999552497 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7ff4cc105cc0 con 0x7ff4dc1046d0 2024-08-31T05:38:01.780 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.776+0000 7ff4e987c740 1 -- 172.21.15.5:0/3529761559 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aea30e21b0 msgr2=0x55aea3485ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:01.781 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.776+0000 7ff4dbfff640 1 --2- 172.21.15.5:0/999552497 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff4c40b4ca0 0x7ff4c40b71b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc1030e0 tx=0x7ff4cc109810 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:01.781 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.776+0000 7ff4e987c740 1 --2- 172.21.15.5:0/3529761559 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aea30e21b0 0x55aea3485ac0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff4d4011440 tx=0x7ff4d4011900 comp rx=0 tx=0).stop 2024-08-31T05:38:01.781 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.776+0000 7ff4e987c740 1 -- 172.21.15.5:0/3529761559 shutdown_connections 2024-08-31T05:38:01.781 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.776+0000 7ff4e987c740 1 --2- 172.21.15.5:0/3529761559 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aea30c14d0 0x55aea3486540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.781 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.776+0000 7ff4e987c740 1 --2- 172.21.15.5:0/3529761559 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aea30b92f0 0x55aea3486000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.781 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.776+0000 7ff4e987c740 1 --2- 172.21.15.5:0/3529761559 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aea30e21b0 0x55aea3485ac0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.781 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.776+0000 7ff4e987c740 1 -- 172.21.15.5:0/3529761559 >> 172.21.15.5:0/3529761559 conn(0x55aea30d6300 msgr2=0x55aea34839b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:01.781 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.776+0000 7ff4e987c740 1 -- 172.21.15.5:0/3529761559 shutdown_connections 2024-08-31T05:38:01.781 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.776+0000 7ff4e987c740 1 -- 172.21.15.5:0/3529761559 wait complete. 2024-08-31T05:38:01.781 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.776+0000 7ff4e987c740 1 -- start start 2024-08-31T05:38:01.785 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.777+0000 7ff4e987c740 1 Processor -- start 2024-08-31T05:38:01.785 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.777+0000 7ff4e987c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aea30b92f0 0x55aea3491650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:01.785 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.777+0000 7ff4e987c740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aea30c14d0 0x55aea3491b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:01.785 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.777+0000 7ff4e987c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aea30e21b0 0x55aea349d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:01.785 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.777+0000 7ff4e987c740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55aea3323ab0 con 0x55aea30c14d0 2024-08-31T05:38:01.785 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.777+0000 7ff4e987c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55aea3371680 con 0x55aea30b92f0 2024-08-31T05:38:01.785 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.777+0000 7ff4e987c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55aea3494240 con 0x55aea30e21b0 2024-08-31T05:38:01.785 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.777+0000 7ff4e987c740 10 client.0 _ll_register_callbacks cb 0x55aea30f9a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:38:01.785 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.777+0000 7ff4db7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aea30c14d0 0x55aea3491b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:01.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.777+0000 7ff4db7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aea30c14d0 0x55aea3491b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50542/0 (socket says 172.21.15.5:50542) 2024-08-31T05:38:01.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.777+0000 7ff4db7fe640 1 -- 172.21.15.5:0/2227834974 learned_addr learned my addr 172.21.15.5:0/2227834974 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:01.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.777+0000 7ff4e0dcc640 1 --2- 172.21.15.5:0/2227834974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aea30b92f0 0x55aea3491650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:01.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.777+0000 7ff4e0dcc640 1 --2- 172.21.15.5:0/2227834974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aea30e21b0 0x55aea349d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:01.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.777+0000 7ff4db7fe640 1 -- 172.21.15.5:0/2227834974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aea30e21b0 msgr2=0x55aea349d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:01.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.777+0000 7ff4db7fe640 1 --2- 172.21.15.5:0/2227834974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aea30e21b0 0x55aea349d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.777+0000 7ff4db7fe640 1 -- 172.21.15.5:0/2227834974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aea30b92f0 msgr2=0x55aea3491650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:01.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.777+0000 7ff4db7fe640 1 --2- 172.21.15.5:0/2227834974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aea30b92f0 0x55aea3491650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.777+0000 7ff4db7fe640 1 -- 172.21.15.5:0/2227834974 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aea31c6620 con 0x55aea30c14d0 2024-08-31T05:38:01.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.778+0000 7ff4db7fe640 1 --2- 172.21.15.5:0/2227834974 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aea30c14d0 0x55aea3491b90 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7ff4d0012700 tx=0x7ff4d0012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd4f05b8a8c821da server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:01.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.778+0000 7ff4bb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:38:01.787 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.778+0000 7ff4bb7fe640 1 -- 172.21.15.5:0/2227834974 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d0004050 con 0x55aea30c14d0 2024-08-31T05:38:01.787 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.778+0000 7ff4bb7fe640 1 -- 172.21.15.5:0/2227834974 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7ff4d00041f0 con 0x55aea30c14d0 2024-08-31T05:38:01.787 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.778+0000 7ff4e987c740 1 -- 172.21.15.5:0/2227834974 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4d4004050 con 0x55aea30c14d0 2024-08-31T05:38:01.787 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.778+0000 7ff4bb7fe640 1 -- 172.21.15.5:0/2227834974 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ff4d0025050 con 0x55aea30c14d0 2024-08-31T05:38:01.787 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.778+0000 7ff4e987c740 10 client.17760 fetch_fsmap learned FSMap version 34 2024-08-31T05:38:01.787 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.778+0000 7ff4e987c740 1 -- 172.21.15.5:0/2227834974 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55aea34a02f0 con 0x55aea30c14d0 2024-08-31T05:38:01.787 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.778+0000 7ff4bb7fe640 1 -- 172.21.15.5:0/2227834974 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4d4004050 con 0x55aea30c14d0 2024-08-31T05:38:01.787 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.778+0000 7ff4bb7fe640 1 -- 172.21.15.5:0/2227834974 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7ff4d0003a00 con 0x55aea30c14d0 2024-08-31T05:38:01.787 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.778+0000 7ff4e987c740 10 client.17760 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:38:01.787 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.778+0000 7ff4e987c740 10 client.17760 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:38:01.787 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.779+0000 7ff4e987c740 20 client.17760 populate_metadata read hostname 'smithi005' 2024-08-31T05:38:01.787 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.779+0000 7ff4e987c740 1 --2- 172.21.15.5:0/2227834974 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55aea30a0d80 0x55aea34a3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:01.787 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.779+0000 7ff4e987c740 4 client.17760 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:38:01.788 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.779+0000 7ff4e987c740 1 -- 172.21.15.5:0/2227834974 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aea33fcf50 con 0x55aea30a0d80 2024-08-31T05:38:01.788 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.779+0000 7ff4e0dcc640 1 --2- 172.21.15.5:0/2227834974 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55aea30a0d80 0x55aea34a3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:01.788 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.779+0000 7ff4bb7fe640 10 client.17760 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:38:01.788 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.779+0000 7ff4e0dcc640 1 --2- 172.21.15.5:0/2227834974 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55aea30a0d80 0x55aea34a3800 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae2bca554134bb6a server_cookie=6398950e5e62ee73 in_seq=0 out_seq=0 2024-08-31T05:38:01.788 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.780+0000 7ff4bb7fe640 1 -- 172.21.15.5:0/2227834974 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55aea33fcf50 con 0x55aea30a0d80 2024-08-31T05:38:01.788 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.780+0000 7ff4bb7fe640 10 client.17760 handle_command_reply: tid=0 2024-08-31T05:38:01.788 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.780+0000 7ff4e987c740 1 client.17760 shutdown 2024-08-31T05:38:01.788 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.780+0000 7ff4e987c740 1 -- 172.21.15.5:0/2227834974 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aea30c14d0 msgr2=0x55aea3491b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:01.788 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.780+0000 7ff4e987c740 1 --2- 172.21.15.5:0/2227834974 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aea30c14d0 0x55aea3491b90 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7ff4d0012700 tx=0x7ff4d0012bc0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.788 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.780+0000 7ff4e987c740 1 -- 172.21.15.5:0/2227834974 shutdown_connections 2024-08-31T05:38:01.788 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.780+0000 7ff4e987c740 1 --2- 172.21.15.5:0/2227834974 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55aea30a0d80 0x55aea34a3800 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.788 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.780+0000 7ff4e987c740 1 --2- 172.21.15.5:0/2227834974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aea30e21b0 0x55aea349d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.788 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.780+0000 7ff4e987c740 1 --2- 172.21.15.5:0/2227834974 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aea30c14d0 0x55aea3491b90 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.789 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.780+0000 7ff4bb7fe640 0 client.17760 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:38:01.789 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.780+0000 7ff4e987c740 1 --2- 172.21.15.5:0/2227834974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aea30b92f0 0x55aea3491650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.789 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.780+0000 7ff4e987c740 1 -- 172.21.15.5:0/2227834974 >> 172.21.15.5:0/2227834974 conn(0x55aea30d6300 msgr2=0x55aea3486af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:01.789 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.780+0000 7ff4e987c740 1 -- 172.21.15.5:0/2227834974 shutdown_connections 2024-08-31T05:38:01.789 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.781+0000 7ff4e987c740 1 -- 172.21.15.5:0/2227834974 wait complete. 2024-08-31T05:38:01.789 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.781+0000 7ff4e987c740 20 client.17760 trim_cache size 0 max 16384 2024-08-31T05:38:01.800 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.796+0000 7ff4e987c740 1 Processor -- start 2024-08-31T05:38:01.800 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.796+0000 7ff4e987c740 1 -- start start 2024-08-31T05:38:01.800 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.796+0000 7ff4e987c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aea30b92f0 0x55aea348abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:01.800 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.796+0000 7ff4e987c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aea30c14d0 0x55aea348b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:01.800 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.796+0000 7ff4e987c740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aea30e21b0 0x55aea348e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:01.800 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.796+0000 7ff4e987c740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff4dc1b0cf0 con 0x55aea30e21b0 2024-08-31T05:38:01.800 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.796+0000 7ff4e987c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff4dc1b2830 con 0x55aea30b92f0 2024-08-31T05:38:01.800 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.796+0000 7ff4e987c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff4dc1b13c0 con 0x55aea30c14d0 2024-08-31T05:38:01.801 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.796+0000 7ff4e0dcc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aea30e21b0 0x55aea348e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:01.801 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.796+0000 7ff4db7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aea30c14d0 0x55aea348b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:01.801 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.796+0000 7ff4e0dcc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aea30e21b0 0x55aea348e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50550/0 (socket says 172.21.15.5:50550) 2024-08-31T05:38:01.801 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.796+0000 7ff4e0dcc640 1 -- 172.21.15.5:0/32158416 learned_addr learned my addr 172.21.15.5:0/32158416 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:01.801 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.796+0000 7ff4db7fe640 1 --2- 172.21.15.5:0/32158416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aea30c14d0 0x55aea348b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:33796/0 (socket says 172.21.15.5:33796) 2024-08-31T05:38:01.801 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.796+0000 7ff4e0dcc640 1 --2- 172.21.15.5:0/32158416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aea30b92f0 0x55aea348abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:01.801 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.796+0000 7ff4db7fe640 1 -- 172.21.15.5:0/32158416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aea30b92f0 msgr2=0x55aea348abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:01.801 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.796+0000 7ff4db7fe640 1 --2- 172.21.15.5:0/32158416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aea30b92f0 0x55aea348abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.801 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.796+0000 7ff4db7fe640 1 -- 172.21.15.5:0/32158416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aea30e21b0 msgr2=0x55aea348e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:01.801 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.796+0000 7ff4db7fe640 1 --2- 172.21.15.5:0/32158416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aea30e21b0 0x55aea348e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.801 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.796+0000 7ff4db7fe640 1 -- 172.21.15.5:0/32158416 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aea3493c30 con 0x55aea30c14d0 2024-08-31T05:38:01.801 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.796+0000 7ff4e0dcc640 1 --2- 172.21.15.5:0/32158416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aea30e21b0 0x55aea348e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:38:01.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.797+0000 7ff4db7fe640 1 --2- 172.21.15.5:0/32158416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aea30c14d0 0x55aea348b130 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff4d000a010 tx=0x7ff4d00059b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6880da2d24e5cb72 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:01.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.797+0000 7ff4c1ffb640 1 -- 172.21.15.5:0/32158416 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d000f920 con 0x55aea30c14d0 2024-08-31T05:38:01.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.797+0000 7ff4c1ffb640 1 -- 172.21.15.5:0/32158416 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4d00035f0 con 0x55aea30c14d0 2024-08-31T05:38:01.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.797+0000 7ff4c1ffb640 1 -- 172.21.15.5:0/32158416 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d0005110 con 0x55aea30c14d0 2024-08-31T05:38:01.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.798+0000 7ff4e987c740 1 -- 172.21.15.5:0/32158416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aea30c14d0 msgr2=0x55aea348b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:01.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.798+0000 7ff4e987c740 1 --2- 172.21.15.5:0/32158416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aea30c14d0 0x55aea348b130 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff4d000a010 tx=0x7ff4d00059b0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.798+0000 7ff4e987c740 1 -- 172.21.15.5:0/32158416 shutdown_connections 2024-08-31T05:38:01.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.798+0000 7ff4e987c740 1 --2- 172.21.15.5:0/32158416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aea30e21b0 0x55aea348e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.798+0000 7ff4e987c740 1 --2- 172.21.15.5:0/32158416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aea30c14d0 0x55aea348b130 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.798+0000 7ff4e987c740 1 --2- 172.21.15.5:0/32158416 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aea30b92f0 0x55aea348abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.798+0000 7ff4e987c740 1 -- 172.21.15.5:0/32158416 >> 172.21.15.5:0/32158416 conn(0x55aea30d6300 msgr2=0x55aea348c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:01.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.798+0000 7ff4e987c740 1 -- 172.21.15.5:0/32158416 shutdown_connections 2024-08-31T05:38:01.803 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.798+0000 7ff4e987c740 1 -- 172.21.15.5:0/32158416 wait complete. 2024-08-31T05:38:01.803 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.798+0000 7ff4e987c740 1 -- start start 2024-08-31T05:38:01.806 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.798+0000 7ff4e987c740 1 Processor -- start 2024-08-31T05:38:01.806 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.799+0000 7ff4e987c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aea30b92f0 0x55aea34977f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:01.806 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.799+0000 7ff4e987c740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aea30c14d0 0x55aea3497d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:01.806 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.799+0000 7ff4e987c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aea30e21b0 0x55aea350d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:01.806 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.799+0000 7ff4e987c740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff4dc1b2160 con 0x55aea30c14d0 2024-08-31T05:38:01.806 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.799+0000 7ff4e987c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff4dc1b1a90 con 0x55aea30b92f0 2024-08-31T05:38:01.806 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.799+0000 7ff4e987c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff4dc1aecf0 con 0x55aea30e21b0 2024-08-31T05:38:01.806 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.799+0000 7ff4e987c740 10 client.0 _ll_register_callbacks cb 0x7ff4d0009910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:38:01.806 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.799+0000 7ff4db7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aea30c14d0 0x55aea3497d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:01.807 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.799+0000 7ff4db7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aea30c14d0 0x55aea3497d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50562/0 (socket says 172.21.15.5:50562) 2024-08-31T05:38:01.807 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.799+0000 7ff4db7fe640 1 -- 172.21.15.5:0/1657323240 learned_addr learned my addr 172.21.15.5:0/1657323240 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:01.807 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.799+0000 7ff4e0dcc640 1 --2- 172.21.15.5:0/1657323240 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aea30e21b0 0x55aea350d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:01.807 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.799+0000 7ff4e0dcc640 1 --2- 172.21.15.5:0/1657323240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aea30b92f0 0x55aea34977f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:01.807 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.799+0000 7ff4db7fe640 1 -- 172.21.15.5:0/1657323240 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aea30e21b0 msgr2=0x55aea350d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:01.807 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.799+0000 7ff4db7fe640 1 --2- 172.21.15.5:0/1657323240 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aea30e21b0 0x55aea350d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.807 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.799+0000 7ff4db7fe640 1 -- 172.21.15.5:0/1657323240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aea30b92f0 msgr2=0x55aea34977f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:01.807 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.799+0000 7ff4db7fe640 1 --2- 172.21.15.5:0/1657323240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aea30b92f0 0x55aea34977f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.807 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.799+0000 7ff4db7fe640 1 -- 172.21.15.5:0/1657323240 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aea34985d0 con 0x55aea30c14d0 2024-08-31T05:38:01.807 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.799+0000 7ff4db7fe640 1 --2- 172.21.15.5:0/1657323240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aea30c14d0 0x55aea3497d30 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7ff4d00126d0 tx=0x7ff4d0003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ff337e731ea01d8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:01.807 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.799+0000 7ff4bb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:38:01.807 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.799+0000 7ff4bb7fe640 1 -- 172.21.15.5:0/1657323240 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d0036060 con 0x55aea30c14d0 2024-08-31T05:38:01.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.799+0000 7ff4bb7fe640 1 -- 172.21.15.5:0/1657323240 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7ff4d0022040 con 0x55aea30c14d0 2024-08-31T05:38:01.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.799+0000 7ff4e987c740 1 -- 172.21.15.5:0/1657323240 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4d00035f0 con 0x55aea30c14d0 2024-08-31T05:38:01.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.800+0000 7ff4bb7fe640 1 -- 172.21.15.5:0/1657323240 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ff4d003d050 con 0x55aea30c14d0 2024-08-31T05:38:01.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.800+0000 7ff4e987c740 10 client.17766 fetch_fsmap learned FSMap version 34 2024-08-31T05:38:01.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.800+0000 7ff4e987c740 1 -- 172.21.15.5:0/1657323240 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55aea350e7c0 con 0x55aea30c14d0 2024-08-31T05:38:01.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.800+0000 7ff4bb7fe640 1 -- 172.21.15.5:0/1657323240 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4d00035f0 con 0x55aea30c14d0 2024-08-31T05:38:01.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.800+0000 7ff4bb7fe640 1 -- 172.21.15.5:0/1657323240 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7ff4d0010810 con 0x55aea30c14d0 2024-08-31T05:38:01.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.800+0000 7ff4e987c740 10 client.17766 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:38:01.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.800+0000 7ff4e987c740 10 client.17766 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:38:01.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.800+0000 7ff4e987c740 20 client.17766 populate_metadata read hostname 'smithi005' 2024-08-31T05:38:01.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.800+0000 7ff4e987c740 1 --2- 172.21.15.5:0/1657323240 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55aea30761c0 0x55aea3510e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:01.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.800+0000 7ff4e987c740 4 client.17766 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:38:01.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.800+0000 7ff4e987c740 1 -- 172.21.15.5:0/1657323240 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55aea33f89f0 con 0x55aea30761c0 2024-08-31T05:38:01.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.800+0000 7ff4e0dcc640 1 --2- 172.21.15.5:0/1657323240 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55aea30761c0 0x55aea3510e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:01.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.801+0000 7ff4e0dcc640 1 --2- 172.21.15.5:0/1657323240 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55aea30761c0 0x55aea3510e90 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a72566ee747e8515 server_cookie=3a8a4b6ab0924d47 in_seq=0 out_seq=0 2024-08-31T05:38:01.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.801+0000 7ff4bb7fe640 10 client.17766 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:38:01.815 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.813+0000 7ff4bb7fe640 1 -- 172.21.15.5:0/1657323240 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55aea33f89f0 con 0x55aea30761c0 2024-08-31T05:38:01.815 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.813+0000 7ff4bb7fe640 10 client.17766 handle_command_reply: tid=0 2024-08-31T05:38:01.815 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.813+0000 7ff4e987c740 1 client.17766 shutdown 2024-08-31T05:38:01.816 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.813+0000 7ff4e987c740 1 -- 172.21.15.5:0/1657323240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aea30c14d0 msgr2=0x55aea3497d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:01.816 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.813+0000 7ff4e987c740 1 --2- 172.21.15.5:0/1657323240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aea30c14d0 0x55aea3497d30 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7ff4d00126d0 tx=0x7ff4d0003820 comp rx=0 tx=0).stop 2024-08-31T05:38:01.816 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.813+0000 7ff4e987c740 1 -- 172.21.15.5:0/1657323240 shutdown_connections 2024-08-31T05:38:01.816 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.813+0000 7ff4e987c740 1 --2- 172.21.15.5:0/1657323240 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55aea30761c0 0x55aea3510e90 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.816 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.813+0000 7ff4e987c740 1 --2- 172.21.15.5:0/1657323240 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aea30e21b0 0x55aea350d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.816 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.813+0000 7ff4bb7fe640 0 client.17766 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:38:01.816 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.813+0000 7ff4e987c740 1 --2- 172.21.15.5:0/1657323240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aea30c14d0 0x55aea3497d30 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.816 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.813+0000 7ff4e987c740 1 --2- 172.21.15.5:0/1657323240 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aea30b92f0 0x55aea34977f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.816 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.813+0000 7ff4e987c740 1 -- 172.21.15.5:0/1657323240 >> 172.21.15.5:0/1657323240 conn(0x55aea30d6300 msgr2=0x55aea3491630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:01.816 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.813+0000 7ff4e987c740 1 -- 172.21.15.5:0/1657323240 shutdown_connections 2024-08-31T05:38:01.816 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.813+0000 7ff4e987c740 1 -- 172.21.15.5:0/1657323240 wait complete. 2024-08-31T05:38:01.816 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.813+0000 7ff4e987c740 20 client.17766 trim_cache size 0 max 16384 2024-08-31T05:38:01.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:38:01.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:38:01.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:38:01.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:38:01.818 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.814+0000 7ff4e282f640 1 -- 172.21.15.5:0/999552497 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff4c40b4ca0 msgr2=0x7ff4c40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:01.818 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.814+0000 7ff4e282f640 1 --2- 172.21.15.5:0/999552497 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff4c40b4ca0 0x7ff4c40b71b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc1030e0 tx=0x7ff4cc109810 comp rx=0 tx=0).stop 2024-08-31T05:38:01.818 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.814+0000 7ff4e282f640 1 -- 172.21.15.5:0/999552497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4dc1046d0 msgr2=0x7ff4dc19a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:01.818 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.814+0000 7ff4e282f640 1 --2- 172.21.15.5:0/999552497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4dc1046d0 0x7ff4dc19a240 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc005940 tx=0x7ff4cc0040c0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.818 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.814+0000 7ff4e282f640 1 -- 172.21.15.5:0/999552497 shutdown_connections 2024-08-31T05:38:01.818 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.814+0000 7ff4e282f640 1 --2- 172.21.15.5:0/999552497 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff4c40b4ca0 0x7ff4c40b71b0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.818 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.814+0000 7ff4e282f640 1 --2- 172.21.15.5:0/999552497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4dc10db30 0x7ff4dc19fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.818 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.814+0000 7ff4e282f640 1 --2- 172.21.15.5:0/999552497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff4dc105020 0x7ff4dc19a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.818 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.814+0000 7ff4e282f640 1 --2- 172.21.15.5:0/999552497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4dc1046d0 0x7ff4dc19a240 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:01.818 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.814+0000 7ff4e282f640 1 -- 172.21.15.5:0/999552497 >> 172.21.15.5:0/999552497 conn(0x7ff4dc0fe180 msgr2=0x7ff4dc107620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:01.819 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.814+0000 7ff4e282f640 1 -- 172.21.15.5:0/999552497 shutdown_connections 2024-08-31T05:38:01.819 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:01.814+0000 7ff4e282f640 1 -- 172.21.15.5:0/999552497 wait complete. 2024-08-31T05:38:01.929 INFO:tasks.workunit.client.0.smithi005.stdout: 1 905726 11.30 MB/sec execute 289 sec latency 79.232 ms 2024-08-31T05:38:02.135 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T05:38:02.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:38:01 smithi050 ceph-mon[22146]: scrub queued for path: / 2024-08-31T05:38:02.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:38:01 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:38:02.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:38:01 smithi050 ceph-mon[22146]: scrub summary: active paths [/] 2024-08-31T05:38:02.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:38:01 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:38:02.158 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:38:01 smithi005 ceph-mon[18602]: scrub queued for path: / 2024-08-31T05:38:02.158 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:38:01 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:38:02.158 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:38:01 smithi005 ceph-mon[18602]: scrub summary: active paths [/] 2024-08-31T05:38:02.158 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:38:01 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:38:02.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:38:01 smithi070 ceph-mon[22316]: scrub queued for path: / 2024-08-31T05:38:02.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:38:01 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:38:02.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:38:01 smithi070 ceph-mon[22316]: scrub summary: active paths [/] 2024-08-31T05:38:02.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:38:01 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:38:02.404 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:38:02.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.898+0000 7f757059c640 1 -- 172.21.15.5:0/3267340723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7568109310 msgr2=0x7f7568109720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:02.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.898+0000 7f757059c640 1 --2- 172.21.15.5:0/3267340723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7568109310 0x7f7568109720 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f7558009900 tx=0x7f755802a410 comp rx=0 tx=0).stop 2024-08-31T05:38:02.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.898+0000 7f757059c640 1 -- 172.21.15.5:0/3267340723 shutdown_connections 2024-08-31T05:38:02.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.898+0000 7f757059c640 1 --2- 172.21.15.5:0/3267340723 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7568109c60 0x7f7568110490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:02.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.898+0000 7f757059c640 1 --2- 172.21.15.5:0/3267340723 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7568109310 0x7f7568109720 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:02.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.898+0000 7f757059c640 1 --2- 172.21.15.5:0/3267340723 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75681039d0 0x7f7568103de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:02.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.898+0000 7f757059c640 1 -- 172.21.15.5:0/3267340723 >> 172.21.15.5:0/3267340723 conn(0x7f756807b670 msgr2=0x7f756807ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:02.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.898+0000 7f757059c640 1 -- 172.21.15.5:0/3267340723 shutdown_connections 2024-08-31T05:38:02.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.898+0000 7f757059c640 1 -- 172.21.15.5:0/3267340723 wait complete. 2024-08-31T05:38:02.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.899+0000 7f757059c640 1 Processor -- start 2024-08-31T05:38:02.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.899+0000 7f757059c640 1 -- start start 2024-08-31T05:38:02.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.900+0000 7f757059c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75681039d0 0x7f756819a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:02.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.900+0000 7f757059c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7568109310 0x7f756819a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:02.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.900+0000 7f757059c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7568109c60 0x7f756819fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:02.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.900+0000 7f757059c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7568113880 con 0x7f7568109c60 2024-08-31T05:38:02.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.900+0000 7f757059c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7568113700 con 0x7f7568109310 2024-08-31T05:38:02.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.900+0000 7f757059c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7568113a00 con 0x7f75681039d0 2024-08-31T05:38:02.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.900+0000 7f756e338640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75681039d0 0x7f756819a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:02.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.900+0000 7f756e338640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75681039d0 0x7f756819a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:56554/0 (socket says 172.21.15.5:56554) 2024-08-31T05:38:02.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.900+0000 7f756e338640 1 -- 172.21.15.5:0/932288281 learned_addr learned my addr 172.21.15.5:0/932288281 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:02.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.900+0000 7f756db37640 1 --2- 172.21.15.5:0/932288281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7568109310 0x7f756819a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:02.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.900+0000 7f756eb39640 1 --2- 172.21.15.5:0/932288281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7568109c60 0x7f756819fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:02.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.900+0000 7f756db37640 1 -- 172.21.15.5:0/932288281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75681039d0 msgr2=0x7f756819a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:02.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.900+0000 7f756db37640 1 --2- 172.21.15.5:0/932288281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75681039d0 0x7f756819a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:02.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.900+0000 7f756db37640 1 -- 172.21.15.5:0/932288281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7568109c60 msgr2=0x7f756819fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:02.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.900+0000 7f756db37640 1 --2- 172.21.15.5:0/932288281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7568109c60 0x7f756819fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:02.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.900+0000 7f756db37640 1 -- 172.21.15.5:0/932288281 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75681a0140 con 0x7f7568109310 2024-08-31T05:38:02.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.900+0000 7f756e338640 1 --2- 172.21.15.5:0/932288281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75681039d0 0x7f756819a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:38:02.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.901+0000 7f756db37640 1 --2- 172.21.15.5:0/932288281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7568109310 0x7f756819a830 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f755802a930 tx=0x7f7558004060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:02.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.901+0000 7f755f7fe640 1 -- 172.21.15.5:0/932288281 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755803f070 con 0x7f7568109310 2024-08-31T05:38:02.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.901+0000 7f757059c640 1 -- 172.21.15.5:0/932288281 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75681a03d0 con 0x7f7568109310 2024-08-31T05:38:02.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.901+0000 7f757059c640 1 -- 172.21.15.5:0/932288281 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75681a08d0 con 0x7f7568109310 2024-08-31T05:38:02.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.901+0000 7f755f7fe640 1 -- 172.21.15.5:0/932288281 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7558003ca0 con 0x7f7568109310 2024-08-31T05:38:02.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.901+0000 7f755f7fe640 1 -- 172.21.15.5:0/932288281 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7558048060 con 0x7f7568109310 2024-08-31T05:38:02.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.904+0000 7f7576b11740 1 Processor -- start 2024-08-31T05:38:02.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.905+0000 7f7576b11740 1 -- start start 2024-08-31T05:38:02.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.905+0000 7f755f7fe640 1 -- 172.21.15.5:0/932288281 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f755803aa60 con 0x7f7568109310 2024-08-31T05:38:02.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.905+0000 7f7576b11740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561bad240070 0x561bad5e52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:02.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.905+0000 7f7576b11740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561bad2171b0 0x561bad5e5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:02.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.905+0000 7f7576b11740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bad21f390 0x561bad5e5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:02.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.905+0000 7f7576b11740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x561bad55c630 con 0x561bad21f390 2024-08-31T05:38:02.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.905+0000 7f7576b11740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x561bad54bbc0 con 0x561bad240070 2024-08-31T05:38:02.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.905+0000 7f7576b11740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561bad54fb70 con 0x561bad2171b0 2024-08-31T05:38:02.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.905+0000 7f756e338640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561bad2171b0 0x561bad5e5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:02.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.905+0000 7f756e338640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561bad2171b0 0x561bad5e5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:56558/0 (socket says 172.21.15.5:56558) 2024-08-31T05:38:02.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.905+0000 7f756eb39640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561bad240070 0x561bad5e52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:02.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.905+0000 7f756e338640 1 -- 172.21.15.5:0/2817361290 learned_addr learned my addr 172.21.15.5:0/2817361290 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:02.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.905+0000 7f756db37640 1 --2- 172.21.15.5:0/2817361290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bad21f390 0x561bad5e5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:02.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.905+0000 7f756e338640 1 -- 172.21.15.5:0/2817361290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561bad240070 msgr2=0x561bad5e52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:02.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.905+0000 7f756e338640 1 --2- 172.21.15.5:0/2817361290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561bad240070 0x561bad5e52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:02.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.905+0000 7f756e338640 1 -- 172.21.15.5:0/2817361290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bad21f390 msgr2=0x561bad5e5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:02.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.905+0000 7f756e338640 1 --2- 172.21.15.5:0/2817361290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bad21f390 0x561bad5e5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:02.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.906+0000 7f756e338640 1 -- 172.21.15.5:0/2817361290 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bad2ab650 con 0x561bad2171b0 2024-08-31T05:38:02.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.906+0000 7f756db37640 1 --2- 172.21.15.5:0/2817361290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bad21f390 0x561bad5e5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:38:02.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.906+0000 7f756e338640 1 --2- 172.21.15.5:0/2817361290 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561bad2171b0 0x561bad5e5800 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7564011650 tx=0x7f7564009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b34826cabeb7dcc5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:02.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.906+0000 7f755f7fe640 1 --2- 172.21.15.5:0/932288281 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f75540b4dd0 0x7f75540b72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:02.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.906+0000 7f756eb39640 1 --2- 172.21.15.5:0/932288281 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f75540b4dd0 0x7f75540b72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:02.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.906+0000 7f755f7fe640 1 -- 172.21.15.5:0/932288281 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7f7558105970 con 0x7f7568109310 2024-08-31T05:38:02.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.906+0000 7f755cff9640 1 -- 172.21.15.5:0/2817361290 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f756401e070 con 0x561bad2171b0 2024-08-31T05:38:02.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.907+0000 7f755cff9640 1 -- 172.21.15.5:0/2817361290 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f756400fb70 con 0x561bad2171b0 2024-08-31T05:38:02.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.907+0000 7f755cff9640 1 -- 172.21.15.5:0/2817361290 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7564019c60 con 0x561bad2171b0 2024-08-31T05:38:02.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.907+0000 7f7576b11740 1 -- 172.21.15.5:0/2817361290 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561bad2171b0 msgr2=0x561bad5e5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:02.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.907+0000 7f7576b11740 1 --2- 172.21.15.5:0/2817361290 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561bad2171b0 0x561bad5e5800 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7564011650 tx=0x7f7564009f90 comp rx=0 tx=0).stop 2024-08-31T05:38:02.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.907+0000 7f756eb39640 1 --2- 172.21.15.5:0/932288281 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f75540b4dd0 0x7f75540b72e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f7560007f80 tx=0x7f7560007520 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:02.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.907+0000 7f7576b11740 1 -- 172.21.15.5:0/2817361290 shutdown_connections 2024-08-31T05:38:02.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.907+0000 7f7576b11740 1 --2- 172.21.15.5:0/2817361290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bad21f390 0x561bad5e5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:02.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.907+0000 7f7576b11740 1 --2- 172.21.15.5:0/2817361290 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561bad2171b0 0x561bad5e5800 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:02.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.907+0000 7f7576b11740 1 --2- 172.21.15.5:0/2817361290 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561bad240070 0x561bad5e52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:02.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.907+0000 7f7576b11740 1 -- 172.21.15.5:0/2817361290 >> 172.21.15.5:0/2817361290 conn(0x561bad234460 msgr2=0x561bad5e31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:02.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.908+0000 7f7576b11740 1 -- 172.21.15.5:0/2817361290 shutdown_connections 2024-08-31T05:38:02.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.908+0000 7f7576b11740 1 -- 172.21.15.5:0/2817361290 wait complete. 2024-08-31T05:38:02.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.908+0000 7f7576b11740 1 -- start start 2024-08-31T05:38:02.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.908+0000 7f7576b11740 1 Processor -- start 2024-08-31T05:38:02.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.908+0000 7f7576b11740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561bad2171b0 0x561bad5f0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:02.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.908+0000 7f7576b11740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561bad21f390 0x561bad5f0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:02.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.908+0000 7f7576b11740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bad240070 0x561bad5fce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:02.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.909+0000 7f7576b11740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x561bad3ae700 con 0x561bad240070 2024-08-31T05:38:02.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.909+0000 7f7576b11740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x561bad4d2700 con 0x561bad2171b0 2024-08-31T05:38:02.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.909+0000 7f7576b11740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561bad5f3aa0 con 0x561bad21f390 2024-08-31T05:38:02.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.909+0000 7f756e338640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561bad2171b0 0x561bad5f0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:02.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.909+0000 7f7576b11740 10 client.0 _ll_register_callbacks cb 0x561bad501dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:38:02.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.909+0000 7f756e338640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561bad2171b0 0x561bad5f0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:56376/0 (socket says 172.21.15.5:56376) 2024-08-31T05:38:02.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.909+0000 7f756e338640 1 -- 172.21.15.5:0/1630055625 learned_addr learned my addr 172.21.15.5:0/1630055625 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:02.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.909+0000 7f756eb39640 1 --2- 172.21.15.5:0/1630055625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bad240070 0x561bad5fce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:02.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.909+0000 7f756e338640 1 -- 172.21.15.5:0/1630055625 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561bad21f390 msgr2=0x561bad5f0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:02.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.909+0000 7f756e338640 1 --2- 172.21.15.5:0/1630055625 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561bad21f390 0x561bad5f0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:02.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.909+0000 7f756e338640 1 -- 172.21.15.5:0/1630055625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bad240070 msgr2=0x561bad5fce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:02.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.909+0000 7f756e338640 1 --2- 172.21.15.5:0/1630055625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bad240070 0x561bad5fce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:02.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.909+0000 7f756e338640 1 -- 172.21.15.5:0/1630055625 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561bad50b8b0 con 0x561bad2171b0 2024-08-31T05:38:02.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.909+0000 7f756e338640 1 --2- 172.21.15.5:0/1630055625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561bad2171b0 0x561bad5f0a60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f75640097f0 tx=0x7f7564009ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f585f9ff07ab8eb1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:02.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.909+0000 7f7551ffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:38:02.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.909+0000 7f7551ffb640 1 -- 172.21.15.5:0/1630055625 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7564027060 con 0x561bad2171b0 2024-08-31T05:38:02.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.909+0000 7f7551ffb640 1 -- 172.21.15.5:0/1630055625 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9511+0+0 (secure 0 0 0) 0x7f756400f740 con 0x561bad2171b0 2024-08-31T05:38:02.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.909+0000 7f7576b11740 1 -- 172.21.15.5:0/1630055625 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f756400fb70 con 0x561bad2171b0 2024-08-31T05:38:02.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.917+0000 7f7551ffb640 1 -- 172.21.15.5:0/1630055625 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f756402e050 con 0x561bad2171b0 2024-08-31T05:38:02.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.918+0000 7f7576b11740 10 client.27353 fetch_fsmap learned FSMap version 34 2024-08-31T05:38:02.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.918+0000 7f7576b11740 1 -- 172.21.15.5:0/1630055625 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x561bad5ff830 con 0x561bad2171b0 2024-08-31T05:38:02.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.919+0000 7f7551ffb640 1 -- 172.21.15.5:0/1630055625 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f756400fb70 con 0x561bad2171b0 2024-08-31T05:38:02.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.919+0000 7f7551ffb640 1 -- 172.21.15.5:0/1630055625 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f7564021030 con 0x561bad2171b0 2024-08-31T05:38:02.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.922+0000 7f7576b11740 10 client.27353 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:38:02.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.922+0000 7f7576b11740 10 client.27353 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:38:02.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.922+0000 7f7576b11740 20 client.27353 populate_metadata read hostname 'smithi005' 2024-08-31T05:38:02.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.922+0000 7f7576b11740 1 --2- 172.21.15.5:0/1630055625 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561bad1fe9f0 0x561bad602b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:02.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.922+0000 7f7576b11740 4 client.27353 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:38:02.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.922+0000 7f7576b11740 1 -- 172.21.15.5:0/1630055625 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561bad55e580 con 0x561bad1fe9f0 2024-08-31T05:38:02.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.926+0000 7f756db37640 1 --2- 172.21.15.5:0/1630055625 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561bad1fe9f0 0x561bad602b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:02.928 INFO:tasks.workunit.client.0.smithi005.stdout: 1 907626 11.29 MB/sec execute 290 sec latency 28.297 ms 2024-08-31T05:38:02.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.929+0000 7f756db37640 1 --2- 172.21.15.5:0/1630055625 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561bad1fe9f0 0x561bad602b90 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ccc526d813f93ff server_cookie=205637e17784ee81 in_seq=0 out_seq=0 2024-08-31T05:38:02.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.929+0000 7f7551ffb640 10 client.27353 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:38:02.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.930+0000 7f7551ffb640 1 -- 172.21.15.5:0/1630055625 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561bad55e580 con 0x561bad1fe9f0 2024-08-31T05:38:02.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.930+0000 7f7551ffb640 10 client.27353 handle_command_reply: tid=0 2024-08-31T05:38:02.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.931+0000 7f7576b11740 1 client.27353 shutdown 2024-08-31T05:38:02.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.931+0000 7f7576b11740 1 -- 172.21.15.5:0/1630055625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561bad2171b0 msgr2=0x561bad5f0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:02.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.931+0000 7f7576b11740 1 --2- 172.21.15.5:0/1630055625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561bad2171b0 0x561bad5f0a60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f75640097f0 tx=0x7f7564009ef0 comp rx=0 tx=0).stop 2024-08-31T05:38:02.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.936+0000 7f7576b11740 1 -- 172.21.15.5:0/1630055625 shutdown_connections 2024-08-31T05:38:02.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.936+0000 7f7576b11740 1 --2- 172.21.15.5:0/1630055625 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561bad1fe9f0 0x561bad602b90 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:02.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.936+0000 7f7576b11740 1 --2- 172.21.15.5:0/1630055625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bad240070 0x561bad5fce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:02.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.937+0000 7f7576b11740 1 --2- 172.21.15.5:0/1630055625 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561bad21f390 0x561bad5f0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:02.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.937+0000 7f7576b11740 1 --2- 172.21.15.5:0/1630055625 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561bad2171b0 0x561bad5f0a60 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:02.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.937+0000 7f7576b11740 1 -- 172.21.15.5:0/1630055625 >> 172.21.15.5:0/1630055625 conn(0x561bad234460 msgr2=0x561bad5e8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:02.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.937+0000 7f7551ffb640 0 client.27353 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:38:02.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.937+0000 7f7576b11740 1 -- 172.21.15.5:0/1630055625 shutdown_connections 2024-08-31T05:38:02.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.937+0000 7f7576b11740 1 -- 172.21.15.5:0/1630055625 wait complete. 2024-08-31T05:38:02.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.938+0000 7f7576b11740 20 client.27353 trim_cache size 0 max 16384 2024-08-31T05:38:02.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.974+0000 7f7576b11740 1 Processor -- start 2024-08-31T05:38:02.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.975+0000 7f7576b11740 1 -- start start 2024-08-31T05:38:02.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.976+0000 7f7576b11740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561bad2171b0 0x561bad5e8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:02.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.976+0000 7f7576b11740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561bad21f390 0x561bad5f09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:02.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.976+0000 7f7576b11740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bad240070 0x561bad5fcd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:02.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.976+0000 7f756db37640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561bad21f390 0x561bad5f09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:02.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.976+0000 7f756db37640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561bad21f390 0x561bad5f09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:56380/0 (socket says 172.21.15.5:56380) 2024-08-31T05:38:02.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.977+0000 7f756e338640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561bad2171b0 0x561bad5e8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:02.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.977+0000 7f756e338640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561bad2171b0 0x561bad5e8ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:56588/0 (socket says 172.21.15.5:56588) 2024-08-31T05:38:02.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.977+0000 7f756db37640 1 -- 172.21.15.5:0/456856993 learned_addr learned my addr 172.21.15.5:0/456856993 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:02.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.977+0000 7f7576b11740 1 -- 172.21.15.5:0/456856993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f754c010080 con 0x561bad240070 2024-08-31T05:38:02.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.977+0000 7f7576b11740 1 -- 172.21.15.5:0/456856993 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f754c011bc0 con 0x561bad21f390 2024-08-31T05:38:02.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.977+0000 7f7576b11740 1 -- 172.21.15.5:0/456856993 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f754c010750 con 0x561bad2171b0 2024-08-31T05:38:02.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.977+0000 7f756eb39640 1 --2- 172.21.15.5:0/456856993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bad240070 0x561bad5fcd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:02.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.977+0000 7f756e338640 1 -- 172.21.15.5:0/456856993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561bad21f390 msgr2=0x561bad5f09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:02.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.978+0000 7f756e338640 1 --2- 172.21.15.5:0/456856993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561bad21f390 0x561bad5f09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:02.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.978+0000 7f756e338640 1 -- 172.21.15.5:0/456856993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bad240070 msgr2=0x561bad5fcd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:02.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.978+0000 7f756e338640 1 --2- 172.21.15.5:0/456856993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bad240070 0x561bad5fcd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:02.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.978+0000 7f756e338640 1 -- 172.21.15.5:0/456856993 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bad5ef9c0 con 0x561bad2171b0 2024-08-31T05:38:02.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.978+0000 7f756e338640 1 --2- 172.21.15.5:0/456856993 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561bad2171b0 0x561bad5e8ad0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7564004620 tx=0x7f7564005970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37709d2326f752ee server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:02.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.978+0000 7f7553fff640 1 -- 172.21.15.5:0/456856993 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7564027030 con 0x561bad2171b0 2024-08-31T05:38:02.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.978+0000 7f7553fff640 1 -- 172.21.15.5:0/456856993 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f75640114d0 con 0x561bad2171b0 2024-08-31T05:38:02.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.978+0000 7f7553fff640 1 -- 172.21.15.5:0/456856993 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f756401e040 con 0x561bad2171b0 2024-08-31T05:38:02.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.980+0000 7f7576b11740 1 -- 172.21.15.5:0/456856993 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561bad2171b0 msgr2=0x561bad5e8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:02.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.980+0000 7f7576b11740 1 --2- 172.21.15.5:0/456856993 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561bad2171b0 0x561bad5e8ad0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7564004620 tx=0x7f7564005970 comp rx=0 tx=0).stop 2024-08-31T05:38:02.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.980+0000 7f7576b11740 1 -- 172.21.15.5:0/456856993 shutdown_connections 2024-08-31T05:38:02.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.980+0000 7f7576b11740 1 --2- 172.21.15.5:0/456856993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bad240070 0x561bad5fcd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:02.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.980+0000 7f7576b11740 1 --2- 172.21.15.5:0/456856993 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561bad21f390 0x561bad5f09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:02.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.980+0000 7f7576b11740 1 --2- 172.21.15.5:0/456856993 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561bad2171b0 0x561bad5e8ad0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:02.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.980+0000 7f7576b11740 1 -- 172.21.15.5:0/456856993 >> 172.21.15.5:0/456856993 conn(0x561bad234460 msgr2=0x561bad5e83c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:02.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.980+0000 7f7576b11740 1 -- 172.21.15.5:0/456856993 shutdown_connections 2024-08-31T05:38:02.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.980+0000 7f7576b11740 1 -- 172.21.15.5:0/456856993 wait complete. 2024-08-31T05:38:02.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.981+0000 7f7576b11740 1 -- start start 2024-08-31T05:38:02.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.981+0000 7f7576b11740 1 Processor -- start 2024-08-31T05:38:02.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.982+0000 7f7576b11740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561bad2171b0 0x561bad5f4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:02.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.982+0000 7f7576b11740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bad21f390 0x561bad5f5320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:02.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.982+0000 7f756e338640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561bad2171b0 0x561bad5f4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:02.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.982+0000 7f756e338640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561bad2171b0 0x561bad5f4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:56394/0 (socket says 172.21.15.5:56394) 2024-08-31T05:38:02.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.983+0000 7f756e338640 1 -- 172.21.15.5:0/4040723262 learned_addr learned my addr 172.21.15.5:0/4040723262 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:02.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.983+0000 7f7576b11740 1 --2- 172.21.15.5:0/4040723262 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561bad240070 0x561bad5f5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:02.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.983+0000 7f7576b11740 1 -- 172.21.15.5:0/4040723262 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f754c0114f0 con 0x561bad21f390 2024-08-31T05:38:02.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.983+0000 7f7576b11740 1 -- 172.21.15.5:0/4040723262 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f754c010e20 con 0x561bad2171b0 2024-08-31T05:38:02.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.983+0000 7f7576b11740 1 -- 172.21.15.5:0/4040723262 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f754c00e080 con 0x561bad240070 2024-08-31T05:38:02.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.983+0000 7f7576b11740 10 client.0 _ll_register_callbacks cb 0x7f756401c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:38:02.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.983+0000 7f756eb39640 1 --2- 172.21.15.5:0/4040723262 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561bad240070 0x561bad5f5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:02.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.983+0000 7f756e338640 1 -- 172.21.15.5:0/4040723262 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561bad240070 msgr2=0x561bad5f5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:02.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.984+0000 7f756e338640 1 --2- 172.21.15.5:0/4040723262 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561bad240070 0x561bad5f5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:02.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.984+0000 7f756e338640 1 -- 172.21.15.5:0/4040723262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bad21f390 msgr2=0x561bad5f5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:02.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.984+0000 7f756e338640 1 --2- 172.21.15.5:0/4040723262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bad21f390 0x561bad5f5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:02.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.984+0000 7f756e338640 1 -- 172.21.15.5:0/4040723262 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561bad66c530 con 0x561bad2171b0 2024-08-31T05:38:02.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.984+0000 7f756eb39640 1 --2- 172.21.15.5:0/4040723262 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561bad240070 0x561bad5f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:38:02.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.985+0000 7f756e338640 1 --2- 172.21.15.5:0/4040723262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561bad2171b0 0x561bad5f4de0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7564019900 tx=0x7f7564019930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2eca73ec9fd83b28 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:02.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.985+0000 7f7551ffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:38:02.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.986+0000 7f7551ffb640 1 -- 172.21.15.5:0/4040723262 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7564027070 con 0x561bad2171b0 2024-08-31T05:38:02.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.986+0000 7f7551ffb640 1 -- 172.21.15.5:0/4040723262 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9599+0+0 (secure 0 0 0) 0x7f756400fad0 con 0x561bad2171b0 2024-08-31T05:38:03.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.987+0000 7f7576b11740 1 -- 172.21.15.5:0/4040723262 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75640114d0 con 0x561bad2171b0 2024-08-31T05:38:03.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.987+0000 7f7551ffb640 1 -- 172.21.15.5:0/4040723262 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f756401e040 con 0x561bad2171b0 2024-08-31T05:38:03.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.988+0000 7f7576b11740 10 client.27359 fetch_fsmap learned FSMap version 34 2024-08-31T05:38:03.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.988+0000 7f7576b11740 1 -- 172.21.15.5:0/4040723262 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x561bad66d7a0 con 0x561bad2171b0 2024-08-31T05:38:03.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.989+0000 7f7551ffb640 1 -- 172.21.15.5:0/4040723262 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7564039070 con 0x561bad2171b0 2024-08-31T05:38:03.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.989+0000 7f7551ffb640 1 -- 172.21.15.5:0/4040723262 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f7564021070 con 0x561bad2171b0 2024-08-31T05:38:03.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.990+0000 7f7576b11740 10 client.27359 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:38:03.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.990+0000 7f7576b11740 10 client.27359 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:38:03.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.990+0000 7f7576b11740 20 client.27359 populate_metadata read hostname 'smithi005' 2024-08-31T05:38:03.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.990+0000 7f7576b11740 1 --2- 172.21.15.5:0/4040723262 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561bad1d3da0 0x561bad66fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:03.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.990+0000 7f7576b11740 4 client.27359 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T05:38:03.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.990+0000 7f7576b11740 1 -- 172.21.15.5:0/4040723262 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f75640114d0 con 0x561bad1d3da0 2024-08-31T05:38:03.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.990+0000 7f756db37640 1 --2- 172.21.15.5:0/4040723262 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561bad1d3da0 0x561bad66fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:03.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.992+0000 7f756db37640 1 --2- 172.21.15.5:0/4040723262 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561bad1d3da0 0x561bad66fe50 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44464d1035c2c341 server_cookie=619e4767364c0526 in_seq=0 out_seq=0 2024-08-31T05:38:03.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.992+0000 7f7551ffb640 10 client.27359 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:38:03.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.992+0000 7f7551ffb640 1 -- 172.21.15.5:0/4040723262 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3410 (crc 0 0 0) 0x7f75640114d0 con 0x561bad1d3da0 2024-08-31T05:38:03.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.992+0000 7f7551ffb640 10 client.27359 handle_command_reply: tid=0 2024-08-31T05:38:03.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.992+0000 7f7576b11740 1 client.27359 shutdown 2024-08-31T05:38:03.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.993+0000 7f7576b11740 1 -- 172.21.15.5:0/4040723262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561bad2171b0 msgr2=0x561bad5f4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:03.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.993+0000 7f7576b11740 1 --2- 172.21.15.5:0/4040723262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561bad2171b0 0x561bad5f4de0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7564019900 tx=0x7f7564019930 comp rx=0 tx=0).stop 2024-08-31T05:38:03.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.993+0000 7f7576b11740 1 -- 172.21.15.5:0/4040723262 shutdown_connections 2024-08-31T05:38:03.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.993+0000 7f7576b11740 1 --2- 172.21.15.5:0/4040723262 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561bad1d3da0 0x561bad66fe50 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:03.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.993+0000 7f7551ffb640 0 client.27359 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:38:03.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.993+0000 7f7576b11740 1 --2- 172.21.15.5:0/4040723262 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561bad240070 0x561bad5f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:03.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.993+0000 7f7576b11740 1 --2- 172.21.15.5:0/4040723262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561bad21f390 0x561bad5f5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:03.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.993+0000 7f7576b11740 1 --2- 172.21.15.5:0/4040723262 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561bad2171b0 0x561bad5f4de0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:03.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.993+0000 7f7576b11740 1 -- 172.21.15.5:0/4040723262 >> 172.21.15.5:0/4040723262 conn(0x561bad234460 msgr2=0x561bad5e83c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:03.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.993+0000 7f7576b11740 1 -- 172.21.15.5:0/4040723262 shutdown_connections 2024-08-31T05:38:03.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.993+0000 7f7576b11740 1 -- 172.21.15.5:0/4040723262 wait complete. 2024-08-31T05:38:03.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.993+0000 7f7576b11740 20 client.27359 trim_cache size 0 max 16384 2024-08-31T05:38:03.009 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:38:03.009 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T05:38:03.009 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2024-08-31T05:38:03.009 INFO:teuthology.orchestra.run.smithi005.stdout: "a4d4cf74-2477-4dd9-a3a2-3762b4dd87e4": { 2024-08-31T05:38:03.009 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:38:03.009 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "a4d4cf74-2477-4dd9-a3a2-3762b4dd87e4", 2024-08-31T05:38:03.009 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2024-08-31T05:38:03.009 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:38:03.009 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:38:03.009 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_stats": { 2024-08-31T05:38:03.010 INFO:teuthology.orchestra.run.smithi005.stdout: "94c23057-592d-4a8b-82d7-da2d84f8740b": { 2024-08-31T05:38:03.010 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:36:27.513638+0000", 2024-08-31T05:38:03.010 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:38:03.010 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:38:03.010 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:38:03.010 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:38:03.010 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:38:03.011 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:38:03.011 INFO:teuthology.orchestra.run.smithi005.stdout: "a4d4cf74-2477-4dd9-a3a2-3762b4dd87e4": { 2024-08-31T05:38:03.011 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:38:01.378833+0000", 2024-08-31T05:38:03.011 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:38:03.011 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:38:03.011 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:38:03.012 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:38:03.012 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:38:03.012 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:38:03.012 INFO:teuthology.orchestra.run.smithi005.stdout: "095ccc7a-f368-4bc6-9563-5930e21f9b4a": { 2024-08-31T05:38:03.012 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:35:40.190069+0000", 2024-08-31T05:38:03.012 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:38:03.013 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:38:03.013 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:38:03.013 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:38:03.013 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:38:03.013 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:38:03.014 INFO:teuthology.orchestra.run.smithi005.stdout: "297c26f3-7b4d-4245-abb0-f854248e5e1b": { 2024-08-31T05:38:03.014 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:37:14.019244+0000", 2024-08-31T05:38:03.014 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:38:03.014 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:38:03.014 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:38:03.014 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:38:03.015 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:38:03.015 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:38:03.015 INFO:teuthology.orchestra.run.smithi005.stdout: "de9731c7-ae4a-42fe-8146-e4752cdc40d4": { 2024-08-31T05:38:03.015 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:34:53.614499+0000", 2024-08-31T05:38:03.015 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:38:03.015 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:38:03.016 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:38:03.016 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:38:03.016 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:38:03.016 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:38:03.016 INFO:teuthology.orchestra.run.smithi005.stdout: "0bb67292-013a-40c7-b5fc-810bdd9715d8": { 2024-08-31T05:38:03.016 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:34:04.586008+0000", 2024-08-31T05:38:03.016 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:38:03.017 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:38:03.017 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:38:03.017 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:38:03.017 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:38:03.017 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:38:03.017 INFO:teuthology.orchestra.run.smithi005.stdout: "728a42ca-bbef-4151-830f-5fdd411d8fa0": { 2024-08-31T05:38:03.017 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:32:30.554906+0000", 2024-08-31T05:38:03.017 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:38:03.017 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:38:03.017 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:38:03.017 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:38:03.017 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:38:03.018 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:38:03.018 INFO:teuthology.orchestra.run.smithi005.stdout: "2445fc42-b797-434f-b380-e2da985b4d98": { 2024-08-31T05:38:03.018 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:33:17.681453+0000", 2024-08-31T05:38:03.018 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:38:03.018 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:38:03.018 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:38:03.018 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:38:03.019 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:38:03.019 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:38:03.019 INFO:teuthology.orchestra.run.smithi005.stdout: "cda92ac0-b35f-47a5-a3a5-471c888462a5": { 2024-08-31T05:38:03.019 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:53.103905+0000", 2024-08-31T05:38:03.019 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:38:03.019 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:38:03.020 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:38:03.020 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:38:03.020 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:38:03.020 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:38:03.020 INFO:teuthology.orchestra.run.smithi005.stdout: "ece37b07-9ab2-45f8-bc33-2755a07aac0b": { 2024-08-31T05:38:03.020 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:31:41.782407+0000", 2024-08-31T05:38:03.020 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:38:03.021 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:38:03.021 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:38:03.021 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:38:03.021 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:38:03.021 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:38:03.021 INFO:teuthology.orchestra.run.smithi005.stdout: "75d84398-5d9c-4872-b879-2fbce045fa71": { 2024-08-31T05:38:03.021 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:06.642335+0000", 2024-08-31T05:38:03.021 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:38:03.022 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:38:03.022 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:38:03.022 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:38:03.022 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:38:03.022 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:38:03.022 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:38:03.023 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:38:03.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.994+0000 7f757059c640 1 -- 172.21.15.5:0/932288281 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f75540b4dd0 msgr2=0x7f75540b72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:03.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.994+0000 7f757059c640 1 --2- 172.21.15.5:0/932288281 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f75540b4dd0 0x7f75540b72e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f7560007f80 tx=0x7f7560007520 comp rx=0 tx=0).stop 2024-08-31T05:38:03.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.995+0000 7f757059c640 1 -- 172.21.15.5:0/932288281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7568109310 msgr2=0x7f756819a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:03.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.995+0000 7f757059c640 1 --2- 172.21.15.5:0/932288281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7568109310 0x7f756819a830 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f755802a930 tx=0x7f7558004060 comp rx=0 tx=0).stop 2024-08-31T05:38:03.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.995+0000 7f757059c640 1 -- 172.21.15.5:0/932288281 shutdown_connections 2024-08-31T05:38:03.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.995+0000 7f757059c640 1 --2- 172.21.15.5:0/932288281 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f75540b4dd0 0x7f75540b72e0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:03.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.995+0000 7f757059c640 1 --2- 172.21.15.5:0/932288281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7568109c60 0x7f756819fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:03.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.995+0000 7f757059c640 1 --2- 172.21.15.5:0/932288281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7568109310 0x7f756819a830 secure :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f755802a930 tx=0x7f7558004060 comp rx=0 tx=0).stop 2024-08-31T05:38:03.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.995+0000 7f757059c640 1 --2- 172.21.15.5:0/932288281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75681039d0 0x7f756819a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:03.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.995+0000 7f757059c640 1 -- 172.21.15.5:0/932288281 >> 172.21.15.5:0/932288281 conn(0x7f756807b670 msgr2=0x7f75681053d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:03.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.995+0000 7f757059c640 1 -- 172.21.15.5:0/932288281 shutdown_connections 2024-08-31T05:38:03.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:02.995+0000 7f757059c640 1 -- 172.21.15.5:0/932288281 wait complete. 2024-08-31T05:38:03.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:38:02 smithi050 ceph-mon[22146]: scrub summary: active paths [/] 2024-08-31T05:38:03.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:38:02 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:38:03.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:38:02 smithi050 ceph-mon[22146]: pgmap v589: 129 pgs: 129 active+clean; 462 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.4 MiB/s wr, 201 op/s 2024-08-31T05:38:03.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:38:02 smithi005 ceph-mon[18602]: scrub summary: active paths [/] 2024-08-31T05:38:03.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:38:02 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:38:03.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:38:02 smithi005 ceph-mon[18602]: pgmap v589: 129 pgs: 129 active+clean; 462 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.4 MiB/s wr, 201 op/s 2024-08-31T05:38:03.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:38:02 smithi070 ceph-mon[22316]: scrub summary: active paths [/] 2024-08-31T05:38:03.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:38:02 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:38:03.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:38:02 smithi070 ceph-mon[22316]: pgmap v589: 129 pgs: 129 active+clean; 462 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.4 MiB/s wr, 201 op/s 2024-08-31T05:38:03.912 INFO:tasks.cephfs.filesystem:scrub status for tag:a4d4cf74-2477-4dd9-a3a2-3762b4dd87e4 - {'path': '/', 'tag': 'a4d4cf74-2477-4dd9-a3a2-3762b4dd87e4', 'options': 'recursive,force'} 2024-08-31T05:38:03.929 INFO:tasks.workunit.client.0.smithi005.stdout: 1 909270 11.29 MB/sec execute 291 sec latency 79.896 ms 2024-08-31T05:38:04.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:38:03 smithi005 ceph-mon[18602]: osdmap e90: 12 total, 12 up, 12 in 2024-08-31T05:38:04.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:38:03 smithi070 ceph-mon[22316]: osdmap e90: 12 total, 12 up, 12 in 2024-08-31T05:38:04.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:38:03 smithi050 ceph-mon[22146]: osdmap e90: 12 total, 12 up, 12 in 2024-08-31T05:38:04.929 INFO:tasks.workunit.client.0.smithi005.stdout: 1 911208 11.28 MB/sec execute 292 sec latency 18.818 ms 2024-08-31T05:38:05.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:38:04 smithi005 ceph-mon[18602]: pgmap v591: 129 pgs: 129 active+clean; 462 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.2 MiB/s wr, 199 op/s 2024-08-31T05:38:05.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:38:04 smithi070 ceph-mon[22316]: pgmap v591: 129 pgs: 129 active+clean; 462 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.2 MiB/s wr, 199 op/s 2024-08-31T05:38:05.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:38:04 smithi050 ceph-mon[22146]: pgmap v591: 129 pgs: 129 active+clean; 462 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.2 MiB/s wr, 199 op/s 2024-08-31T05:38:05.929 INFO:tasks.workunit.client.0.smithi005.stdout: 1 913255 11.28 MB/sec execute 293 sec latency 13.035 ms 2024-08-31T05:38:06.929 INFO:tasks.workunit.client.0.smithi005.stdout: 1 915751 11.29 MB/sec execute 294 sec latency 19.086 ms 2024-08-31T05:38:07.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:38:06 smithi005 ceph-mon[18602]: pgmap v592: 129 pgs: 129 active+clean; 469 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.9 MiB/s wr, 279 op/s 2024-08-31T05:38:07.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:38:06 smithi070 ceph-mon[22316]: pgmap v592: 129 pgs: 129 active+clean; 469 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.9 MiB/s wr, 279 op/s 2024-08-31T05:38:07.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:38:06 smithi050 ceph-mon[22146]: pgmap v592: 129 pgs: 129 active+clean; 469 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.9 MiB/s wr, 279 op/s 2024-08-31T05:38:07.929 INFO:tasks.workunit.client.0.smithi005.stdout: 1 917093 11.32 MB/sec execute 295 sec latency 58.282 ms 2024-08-31T05:38:08.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:38:07 smithi005 ceph-mon[18602]: scrub summary: idle 2024-08-31T05:38:08.337 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:38:07 smithi070 ceph-mon[22316]: scrub summary: idle 2024-08-31T05:38:08.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:38:07 smithi050 ceph-mon[22146]: scrub summary: idle 2024-08-31T05:38:08.929 INFO:tasks.workunit.client.0.smithi005.stdout: 1 918458 11.32 MB/sec execute 296 sec latency 70.412 ms 2024-08-31T05:38:09.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:38:08 smithi005 ceph-mon[18602]: scrub summary: idle 2024-08-31T05:38:09.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:38:08 smithi005 ceph-mon[18602]: pgmap v593: 129 pgs: 129 active+clean; 471 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.3 MiB/s wr, 288 op/s 2024-08-31T05:38:09.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:38:08 smithi070 ceph-mon[22316]: scrub summary: idle 2024-08-31T05:38:09.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:38:08 smithi070 ceph-mon[22316]: pgmap v593: 129 pgs: 129 active+clean; 471 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.3 MiB/s wr, 288 op/s 2024-08-31T05:38:09.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:38:08 smithi050 ceph-mon[22146]: scrub summary: idle 2024-08-31T05:38:09.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:38:08 smithi050 ceph-mon[22146]: pgmap v593: 129 pgs: 129 active+clean; 471 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.3 MiB/s wr, 288 op/s 2024-08-31T05:38:09.929 INFO:tasks.workunit.client.0.smithi005.stdout: 1 920687 11.33 MB/sec execute 297 sec latency 26.264 ms 2024-08-31T05:38:10.929 INFO:tasks.workunit.client.0.smithi005.stdout: 1 922676 11.31 MB/sec execute 298 sec latency 25.162 ms 2024-08-31T05:38:11.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:38:10 smithi050 ceph-mon[22146]: pgmap v594: 129 pgs: 129 active+clean; 473 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.4 MiB/s wr, 234 op/s 2024-08-31T05:38:11.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:38:10 smithi050 ceph-mon[22146]: osdmap e91: 12 total, 12 up, 12 in 2024-08-31T05:38:11.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:38:10 smithi005 ceph-mon[18602]: pgmap v594: 129 pgs: 129 active+clean; 473 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.4 MiB/s wr, 234 op/s 2024-08-31T05:38:11.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:38:10 smithi005 ceph-mon[18602]: osdmap e91: 12 total, 12 up, 12 in 2024-08-31T05:38:11.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:38:10 smithi070 ceph-mon[22316]: pgmap v594: 129 pgs: 129 active+clean; 473 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.4 MiB/s wr, 234 op/s 2024-08-31T05:38:11.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:38:10 smithi070 ceph-mon[22316]: osdmap e91: 12 total, 12 up, 12 in 2024-08-31T05:38:11.929 INFO:tasks.workunit.client.0.smithi005.stdout: 1 924676 11.32 MB/sec execute 299 sec latency 34.728 ms 2024-08-31T05:38:12.929 INFO:tasks.workunit.client.0.smithi005.stdout: 1 927151 11.33 MB/sec execute 300 sec latency 20.551 ms 2024-08-31T05:38:13.138 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:38:12 smithi070 ceph-mon[22316]: pgmap v596: 129 pgs: 129 active+clean; 479 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.5 MiB/s wr, 279 op/s 2024-08-31T05:38:13.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:38:12 smithi050 ceph-mon[22146]: pgmap v596: 129 pgs: 129 active+clean; 479 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.5 MiB/s wr, 279 op/s 2024-08-31T05:38:13.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:38:12 smithi005 ceph-mon[18602]: pgmap v596: 129 pgs: 129 active+clean; 479 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.5 MiB/s wr, 279 op/s 2024-08-31T05:38:13.929 INFO:tasks.workunit.client.0.smithi005.stdout: 1 928595 11.31 MB/sec execute 301 sec latency 84.962 ms 2024-08-31T05:38:14.919 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.917+0000 7fde0fc86640 1 -- 172.21.15.5:0/4181333230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde081089e0 msgr2=0x7fde0810f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:14.920 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.917+0000 7fde0fc86640 1 --2- 172.21.15.5:0/4181333230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde081089e0 0x7fde0810f210 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fde00009ca0 tx=0x7fde0002a8c0 comp rx=0 tx=0).stop 2024-08-31T05:38:14.920 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.917+0000 7fde0fc86640 1 -- 172.21.15.5:0/4181333230 shutdown_connections 2024-08-31T05:38:14.920 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.917+0000 7fde0fc86640 1 --2- 172.21.15.5:0/4181333230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde081089e0 0x7fde0810f210 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:14.920 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.917+0000 7fde0fc86640 1 --2- 172.21.15.5:0/4181333230 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde08108090 0x7fde081084a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:14.920 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.917+0000 7fde0fc86640 1 --2- 172.21.15.5:0/4181333230 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde08102760 0x7fde08102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:14.920 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.917+0000 7fde0fc86640 1 -- 172.21.15.5:0/4181333230 >> 172.21.15.5:0/4181333230 conn(0x7fde080fe160 msgr2=0x7fde081005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:14.920 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.917+0000 7fde0fc86640 1 -- 172.21.15.5:0/4181333230 shutdown_connections 2024-08-31T05:38:14.920 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.917+0000 7fde0fc86640 1 -- 172.21.15.5:0/4181333230 wait complete. 2024-08-31T05:38:14.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.918+0000 7fde0fc86640 1 Processor -- start 2024-08-31T05:38:14.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.918+0000 7fde0fc86640 1 -- start start 2024-08-31T05:38:14.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.918+0000 7fde0fc86640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde08102760 0x7fde0819afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:14.922 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.918+0000 7fde0fc86640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde08108090 0x7fde0819b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:14.923 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.918+0000 7fde0fc86640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde081089e0 0x7fde0819ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:14.923 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.918+0000 7fde0fc86640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fde081126b0 con 0x7fde08102760 2024-08-31T05:38:14.923 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.918+0000 7fde0fc86640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fde08112530 con 0x7fde08108090 2024-08-31T05:38:14.923 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.918+0000 7fde0fc86640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fde08112830 con 0x7fde081089e0 2024-08-31T05:38:14.923 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.918+0000 7fde0da22640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde08102760 0x7fde0819afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:14.923 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.918+0000 7fde0da22640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde08102760 0x7fde0819afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33936/0 (socket says 172.21.15.5:33936) 2024-08-31T05:38:14.923 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.918+0000 7fde0da22640 1 -- 172.21.15.5:0/1107529096 learned_addr learned my addr 172.21.15.5:0/1107529096 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:14.923 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.918+0000 7fde0e223640 1 --2- 172.21.15.5:0/1107529096 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde081089e0 0x7fde0819ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:14.923 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.918+0000 7fde0d221640 1 --2- 172.21.15.5:0/1107529096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde08108090 0x7fde0819b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:14.924 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.919+0000 7fde0da22640 1 -- 172.21.15.5:0/1107529096 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde081089e0 msgr2=0x7fde0819ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:14.924 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.919+0000 7fde0da22640 1 --2- 172.21.15.5:0/1107529096 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde081089e0 0x7fde0819ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:14.924 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.919+0000 7fde0da22640 1 -- 172.21.15.5:0/1107529096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde08108090 msgr2=0x7fde0819b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:14.924 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.919+0000 7fde0da22640 1 --2- 172.21.15.5:0/1107529096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde08108090 0x7fde0819b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:14.924 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.919+0000 7fde0da22640 1 -- 172.21.15.5:0/1107529096 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde081a6250 con 0x7fde08102760 2024-08-31T05:38:14.924 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.919+0000 7fde0da22640 1 --2- 172.21.15.5:0/1107529096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde08102760 0x7fde0819afc0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fde0400e9f0 tx=0x7fde0400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:14.924 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.919+0000 7fddfeffd640 1 -- 172.21.15.5:0/1107529096 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde0400cd80 con 0x7fde08102760 2024-08-31T05:38:14.924 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.919+0000 7fddfeffd640 1 -- 172.21.15.5:0/1107529096 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde040054d0 con 0x7fde08102760 2024-08-31T05:38:14.924 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.919+0000 7fde0fc86640 1 -- 172.21.15.5:0/1107529096 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde081a6540 con 0x7fde08102760 2024-08-31T05:38:14.924 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.919+0000 7fddfeffd640 1 -- 172.21.15.5:0/1107529096 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde04010690 con 0x7fde08102760 2024-08-31T05:38:14.924 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.919+0000 7fde0fc86640 1 -- 172.21.15.5:0/1107529096 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde081a6a40 con 0x7fde08102760 2024-08-31T05:38:14.929 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.922+0000 7fddfeffd640 1 -- 172.21.15.5:0/1107529096 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fde04004e90 con 0x7fde08102760 2024-08-31T05:38:14.929 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.922+0000 7fde16bed740 1 Processor -- start 2024-08-31T05:38:14.930 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.922+0000 7fde16bed740 1 -- start start 2024-08-31T05:38:14.930 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.922+0000 7fde16bed740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564665c9b1b0 0x56466603ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:14.930 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.922+0000 7fde16bed740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564665c722f0 0x56466603f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:14.930 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.923+0000 7fde16bed740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564665c7a4d0 0x56466603f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:14.930 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.923+0000 7fde16bed740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x564665fb4000 con 0x564665c9b1b0 2024-08-31T05:38:14.930 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.923+0000 7fde16bed740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564665fa3590 con 0x564665c7a4d0 2024-08-31T05:38:14.930 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.923+0000 7fde16bed740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564665fa7540 con 0x564665c722f0 2024-08-31T05:38:14.930 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.923+0000 7fde0e223640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564665c9b1b0 0x56466603ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:14.930 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.923+0000 7fde0e223640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564665c9b1b0 0x56466603ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33948/0 (socket says 172.21.15.5:33948) 2024-08-31T05:38:14.930 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.923+0000 7fde0e223640 1 -- 172.21.15.5:0/4191352597 learned_addr learned my addr 172.21.15.5:0/4191352597 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:14.930 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.923+0000 7fde0da22640 1 --2- 172.21.15.5:0/4191352597 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564665c722f0 0x56466603f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:14.930 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.923+0000 7fde0d221640 1 --2- 172.21.15.5:0/4191352597 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564665c7a4d0 0x56466603f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:14.930 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.923+0000 7fddfeffd640 1 --2- 172.21.15.5:0/1107529096 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fddf40b4ca0 0x7fddf40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:14.931 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.923+0000 7fde0e223640 1 -- 172.21.15.5:0/4191352597 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564665c722f0 msgr2=0x56466603f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:14.931 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.923+0000 7fde0e223640 1 --2- 172.21.15.5:0/4191352597 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564665c722f0 0x56466603f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:14.931 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.923+0000 7fde0e223640 1 -- 172.21.15.5:0/4191352597 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564665c7a4d0 msgr2=0x56466603f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:14.931 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.923+0000 7fde0e223640 1 --2- 172.21.15.5:0/4191352597 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564665c7a4d0 0x56466603f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:14.931 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.923+0000 7fde0e223640 1 -- 172.21.15.5:0/4191352597 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564665d06790 con 0x564665c9b1b0 2024-08-31T05:38:14.931 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.923+0000 7fde0d221640 1 --2- 172.21.15.5:0/4191352597 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564665c7a4d0 0x56466603f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:38:14.931 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.923+0000 7fde0e223640 1 --2- 172.21.15.5:0/1107529096 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fddf40b4ca0 0x7fddf40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:14.931 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.923+0000 7fddfeffd640 1 -- 172.21.15.5:0/1107529096 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7fde040e5dd0 con 0x7fde08102760 2024-08-31T05:38:14.931 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.923+0000 7fde0e223640 1 --2- 172.21.15.5:0/4191352597 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564665c9b1b0 0x56466603ece0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fde00009480 tx=0x7fde00009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc1276300fd46dc0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:14.931 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.924+0000 7fddf3fff640 1 -- 172.21.15.5:0/4191352597 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde00042040 con 0x564665c9b1b0 2024-08-31T05:38:14.931 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.924+0000 7fddf3fff640 1 -- 172.21.15.5:0/4191352597 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde00036070 con 0x564665c9b1b0 2024-08-31T05:38:14.931 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.924+0000 7fddf3fff640 1 -- 172.21.15.5:0/4191352597 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde00004780 con 0x564665c9b1b0 2024-08-31T05:38:14.931 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.924+0000 7fde16bed740 1 -- 172.21.15.5:0/4191352597 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564665c9b1b0 msgr2=0x56466603ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:14.932 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.924+0000 7fde16bed740 1 --2- 172.21.15.5:0/4191352597 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564665c9b1b0 0x56466603ece0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fde00009480 tx=0x7fde00009800 comp rx=0 tx=0).stop 2024-08-31T05:38:14.932 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.924+0000 7fde0e223640 1 --2- 172.21.15.5:0/1107529096 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fddf40b4ca0 0x7fddf40b71b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fde0004d000 tx=0x7fde0004e000 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:14.932 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.925+0000 7fde16bed740 1 -- 172.21.15.5:0/4191352597 shutdown_connections 2024-08-31T05:38:14.932 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.925+0000 7fde16bed740 1 --2- 172.21.15.5:0/4191352597 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564665c7a4d0 0x56466603f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:14.932 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.925+0000 7fde16bed740 1 --2- 172.21.15.5:0/4191352597 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564665c722f0 0x56466603f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:14.932 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.925+0000 7fde16bed740 1 --2- 172.21.15.5:0/4191352597 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564665c9b1b0 0x56466603ece0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:14.932 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.925+0000 7fde16bed740 1 -- 172.21.15.5:0/4191352597 >> 172.21.15.5:0/4191352597 conn(0x564665c8f300 msgr2=0x56466603cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:14.932 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.925+0000 7fde16bed740 1 -- 172.21.15.5:0/4191352597 shutdown_connections 2024-08-31T05:38:14.932 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.925+0000 7fde16bed740 1 -- 172.21.15.5:0/4191352597 wait complete. 2024-08-31T05:38:14.932 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.925+0000 7fde16bed740 1 -- start start 2024-08-31T05:38:14.932 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.925+0000 7fde16bed740 1 Processor -- start 2024-08-31T05:38:14.932 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.926+0000 7fde16bed740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564665c722f0 0x56466604a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:14.933 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.926+0000 7fde16bed740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564665c7a4d0 0x56466604adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:14.933 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.926+0000 7fde16bed740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564665c9b1b0 0x564666056750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:14.933 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.926+0000 7fde16bed740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x564665edcab0 con 0x564665c7a4d0 2024-08-31T05:38:14.933 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.926+0000 7fde16bed740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564665f2a680 con 0x564665c9b1b0 2024-08-31T05:38:14.933 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.926+0000 7fde16bed740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56466604d460 con 0x564665c722f0 2024-08-31T05:38:14.933 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.926+0000 7fde16bed740 10 client.0 _ll_register_callbacks cb 0x564665cb2a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:38:14.933 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.926+0000 7fde0d221640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564665c7a4d0 0x56466604adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:14.933 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.926+0000 7fde0da22640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564665c722f0 0x56466604a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:14.933 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.926+0000 7fde0e223640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564665c9b1b0 0x564666056750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:14.933 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.926+0000 7fde0d221640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564665c7a4d0 0x56466604adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33960/0 (socket says 172.21.15.5:33960) 2024-08-31T05:38:14.933 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.926+0000 7fde0d221640 1 -- 172.21.15.5:0/2576845096 learned_addr learned my addr 172.21.15.5:0/2576845096 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:14.933 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.926+0000 7fde0e223640 1 -- 172.21.15.5:0/2576845096 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564665c722f0 msgr2=0x56466604a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:14.933 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.926+0000 7fde0e223640 1 --2- 172.21.15.5:0/2576845096 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564665c722f0 0x56466604a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:14.934 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.926+0000 7fde0e223640 1 -- 172.21.15.5:0/2576845096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564665c7a4d0 msgr2=0x56466604adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:14.934 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.926+0000 7fde0e223640 1 --2- 172.21.15.5:0/2576845096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564665c7a4d0 0x56466604adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:14.934 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.926+0000 7fde0e223640 1 -- 172.21.15.5:0/2576845096 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564665d7f620 con 0x564665c9b1b0 2024-08-31T05:38:14.934 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.926+0000 7fde0e223640 1 --2- 172.21.15.5:0/2576845096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564665c9b1b0 0x564666056750 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fde0002ade0 tx=0x7fde00004340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbadc374cb41b9b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:14.934 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.926+0000 7fddf17fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:38:14.934 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.926+0000 7fddf17fa640 1 -- 172.21.15.5:0/2576845096 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde00059060 con 0x564665c9b1b0 2024-08-31T05:38:14.934 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.926+0000 7fddf17fa640 1 -- 172.21.15.5:0/2576845096 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7fde00003b70 con 0x564665c9b1b0 2024-08-31T05:38:14.934 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.926+0000 7fde16bed740 1 -- 172.21.15.5:0/2576845096 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde00036070 con 0x564665c9b1b0 2024-08-31T05:38:14.934 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.927+0000 7fddf17fa640 1 -- 172.21.15.5:0/2576845096 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fde00042050 con 0x564665c9b1b0 2024-08-31T05:38:14.934 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.927+0000 7fde16bed740 10 client.27371 fetch_fsmap learned FSMap version 34 2024-08-31T05:38:14.934 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.927+0000 7fde16bed740 1 -- 172.21.15.5:0/2576845096 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x564666059450 con 0x564665c9b1b0 2024-08-31T05:38:14.934 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.927+0000 7fddf17fa640 1 -- 172.21.15.5:0/2576845096 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde00036070 con 0x564665c9b1b0 2024-08-31T05:38:14.934 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.927+0000 7fddf17fa640 1 -- 172.21.15.5:0/2576845096 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fde0002fcf0 con 0x564665c9b1b0 2024-08-31T05:38:14.934 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.927+0000 7fde16bed740 10 client.27371 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:38:14.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.927+0000 7fde16bed740 10 client.27371 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:38:14.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.927+0000 7fde16bed740 20 client.27371 populate_metadata read hostname 'smithi005' 2024-08-31T05:38:14.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.927+0000 7fde16bed740 1 --2- 172.21.15.5:0/2576845096 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x564665c59d80 0x56466605c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:14.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.927+0000 7fde16bed740 4 client.27371 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:38:14.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.927+0000 7fde16bed740 1 -- 172.21.15.5:0/2576845096 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564665fb5f50 con 0x564665c59d80 2024-08-31T05:38:14.935 INFO:tasks.workunit.client.0.smithi005.stdout: 1 930992 11.33 MB/sec execute 302 sec latency 40.514 ms 2024-08-31T05:38:14.936 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.927+0000 7fde0da22640 1 --2- 172.21.15.5:0/2576845096 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x564665c59d80 0x56466605c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:14.936 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.928+0000 7fde0da22640 1 --2- 172.21.15.5:0/2576845096 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x564665c59d80 0x56466605c7b0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a76f1fb0c3593374 server_cookie=7d52b4158c111928 in_seq=0 out_seq=0 2024-08-31T05:38:14.936 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.928+0000 7fddf17fa640 10 client.27371 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:38:14.936 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.928+0000 7fddf17fa640 1 -- 172.21.15.5:0/2576845096 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564665fb5f50 con 0x564665c59d80 2024-08-31T05:38:14.936 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.928+0000 7fddf17fa640 10 client.27371 handle_command_reply: tid=0 2024-08-31T05:38:14.937 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.928+0000 7fde16bed740 1 client.27371 shutdown 2024-08-31T05:38:14.937 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.928+0000 7fde16bed740 1 -- 172.21.15.5:0/2576845096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564665c9b1b0 msgr2=0x564666056750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:14.937 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.928+0000 7fde16bed740 1 --2- 172.21.15.5:0/2576845096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564665c9b1b0 0x564666056750 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fde0002ade0 tx=0x7fde00004340 comp rx=0 tx=0).stop 2024-08-31T05:38:14.937 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.929+0000 7fde16bed740 1 -- 172.21.15.5:0/2576845096 shutdown_connections 2024-08-31T05:38:14.937 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.929+0000 7fde16bed740 1 --2- 172.21.15.5:0/2576845096 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x564665c59d80 0x56466605c7b0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:14.937 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.929+0000 7fde16bed740 1 --2- 172.21.15.5:0/2576845096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564665c9b1b0 0x564666056750 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:14.937 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.929+0000 7fde16bed740 1 --2- 172.21.15.5:0/2576845096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564665c7a4d0 0x56466604adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:14.937 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.929+0000 7fde16bed740 1 --2- 172.21.15.5:0/2576845096 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564665c722f0 0x56466604a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:14.937 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.929+0000 7fddf17fa640 0 client.27371 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:38:14.937 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.929+0000 7fde16bed740 1 -- 172.21.15.5:0/2576845096 >> 172.21.15.5:0/2576845096 conn(0x564665c8f300 msgr2=0x56466603fd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:14.937 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.929+0000 7fde16bed740 1 -- 172.21.15.5:0/2576845096 shutdown_connections 2024-08-31T05:38:14.937 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.929+0000 7fde16bed740 1 -- 172.21.15.5:0/2576845096 wait complete. 2024-08-31T05:38:14.937 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.929+0000 7fde16bed740 20 client.27371 trim_cache size 0 max 16384 2024-08-31T05:38:14.947 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.944+0000 7fde16bed740 1 Processor -- start 2024-08-31T05:38:14.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.944+0000 7fde16bed740 1 -- start start 2024-08-31T05:38:14.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.945+0000 7fde16bed740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564665c722f0 0x5646660566c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:14.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.945+0000 7fde16bed740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564665c7a4d0 0x564666056c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:14.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.945+0000 7fde16bed740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564665c9b1b0 0x564666047830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:14.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.945+0000 7fde16bed740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fde081b0d10 con 0x564665c722f0 2024-08-31T05:38:14.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.945+0000 7fde16bed740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fde081b2850 con 0x564665c9b1b0 2024-08-31T05:38:14.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.945+0000 7fde16bed740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fde081b13e0 con 0x564665c7a4d0 2024-08-31T05:38:14.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.945+0000 7fde0da22640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564665c722f0 0x5646660566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:14.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.945+0000 7fde0da22640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564665c722f0 0x5646660566c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33976/0 (socket says 172.21.15.5:33976) 2024-08-31T05:38:14.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.945+0000 7fde0da22640 1 -- 172.21.15.5:0/3694818794 learned_addr learned my addr 172.21.15.5:0/3694818794 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:14.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.945+0000 7fde0e223640 1 --2- 172.21.15.5:0/3694818794 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564665c9b1b0 0x564666047830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:14.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.945+0000 7fde0d221640 1 --2- 172.21.15.5:0/3694818794 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564665c7a4d0 0x564666056c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:14.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.945+0000 7fde0da22640 1 -- 172.21.15.5:0/3694818794 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564665c7a4d0 msgr2=0x564666056c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:14.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.945+0000 7fde0da22640 1 --2- 172.21.15.5:0/3694818794 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564665c7a4d0 0x564666056c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:14.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.945+0000 7fde0da22640 1 -- 172.21.15.5:0/3694818794 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564665c9b1b0 msgr2=0x564666047830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:14.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.945+0000 7fde0da22640 1 --2- 172.21.15.5:0/3694818794 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564665c9b1b0 0x564666047830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:14.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.945+0000 7fde0da22640 1 -- 172.21.15.5:0/3694818794 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564665c59fb0 con 0x564665c722f0 2024-08-31T05:38:14.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.945+0000 7fde0da22640 1 --2- 172.21.15.5:0/3694818794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564665c722f0 0x5646660566c0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fde0400e9c0 tx=0x7fde040e8220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50b4c05552acb299 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:14.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.945+0000 7fddf37fe640 1 -- 172.21.15.5:0/3694818794 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde04005180 con 0x564665c722f0 2024-08-31T05:38:14.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.946+0000 7fddf37fe640 1 -- 172.21.15.5:0/3694818794 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde040abb90 con 0x564665c722f0 2024-08-31T05:38:14.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.946+0000 7fddf37fe640 1 -- 172.21.15.5:0/3694818794 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde040a7f40 con 0x564665c722f0 2024-08-31T05:38:14.952 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.946+0000 7fde16bed740 1 -- 172.21.15.5:0/3694818794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564665c722f0 msgr2=0x5646660566c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:14.952 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.946+0000 7fde16bed740 1 --2- 172.21.15.5:0/3694818794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564665c722f0 0x5646660566c0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fde0400e9c0 tx=0x7fde040e8220 comp rx=0 tx=0).stop 2024-08-31T05:38:14.953 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.946+0000 7fde16bed740 1 -- 172.21.15.5:0/3694818794 shutdown_connections 2024-08-31T05:38:14.953 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.946+0000 7fde16bed740 1 --2- 172.21.15.5:0/3694818794 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564665c9b1b0 0x564666047830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:14.953 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.946+0000 7fde16bed740 1 --2- 172.21.15.5:0/3694818794 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564665c7a4d0 0x564666056c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:14.953 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.946+0000 7fde16bed740 1 --2- 172.21.15.5:0/3694818794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564665c722f0 0x5646660566c0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:14.953 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.946+0000 7fde16bed740 1 -- 172.21.15.5:0/3694818794 >> 172.21.15.5:0/3694818794 conn(0x564665c8f300 msgr2=0x564666048ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:14.953 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.946+0000 7fde16bed740 1 -- 172.21.15.5:0/3694818794 shutdown_connections 2024-08-31T05:38:14.953 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.946+0000 7fde16bed740 1 -- 172.21.15.5:0/3694818794 wait complete. 2024-08-31T05:38:14.953 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.947+0000 7fde16bed740 1 -- start start 2024-08-31T05:38:14.953 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.947+0000 7fde16bed740 1 Processor -- start 2024-08-31T05:38:14.953 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.947+0000 7fde16bed740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564665c722f0 0x56466605d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:14.953 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.947+0000 7fde16bed740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564665c7a4d0 0x56466605dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:14.953 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.947+0000 7fde16bed740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564665c9b1b0 0x56466605e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:14.953 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.947+0000 7fde16bed740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fde081b2180 con 0x564665c9b1b0 2024-08-31T05:38:14.953 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.947+0000 7fde16bed740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fde081b1ab0 con 0x564665c722f0 2024-08-31T05:38:14.954 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.947+0000 7fde16bed740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fde081aed10 con 0x564665c7a4d0 2024-08-31T05:38:14.954 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.947+0000 7fde16bed740 10 client.0 _ll_register_callbacks cb 0x7fddf80097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:38:14.954 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.948+0000 7fde0da22640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564665c722f0 0x56466605d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:14.954 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.948+0000 7fde0e223640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564665c9b1b0 0x56466605e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:14.954 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.948+0000 7fde0d221640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564665c7a4d0 0x56466605dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:14.954 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.948+0000 7fde0da22640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564665c722f0 0x56466605d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:45666/0 (socket says 172.21.15.5:45666) 2024-08-31T05:38:14.954 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.948+0000 7fde0e223640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564665c9b1b0 0x56466605e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33990/0 (socket says 172.21.15.5:33990) 2024-08-31T05:38:14.954 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.948+0000 7fde0da22640 1 -- 172.21.15.5:0/4254112617 learned_addr learned my addr 172.21.15.5:0/4254112617 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:14.954 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.948+0000 7fde0d221640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564665c7a4d0 0x56466605dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:45562/0 (socket says 172.21.15.5:45562) 2024-08-31T05:38:14.954 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.948+0000 7fde0da22640 1 -- 172.21.15.5:0/4254112617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564665c7a4d0 msgr2=0x56466605dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:14.954 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.948+0000 7fde0da22640 1 --2- 172.21.15.5:0/4254112617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564665c7a4d0 0x56466605dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:14.954 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.948+0000 7fde0da22640 1 -- 172.21.15.5:0/4254112617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564665c9b1b0 msgr2=0x56466605e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:14.954 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.948+0000 7fde0da22640 1 --2- 172.21.15.5:0/4254112617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564665c9b1b0 0x56466605e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:14.954 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.948+0000 7fde0da22640 1 -- 172.21.15.5:0/4254112617 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646660ca3f0 con 0x564665c722f0 2024-08-31T05:38:14.954 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.948+0000 7fde0e223640 1 --2- 172.21.15.5:0/4254112617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564665c9b1b0 0x56466605e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:38:14.955 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.948+0000 7fde0d221640 1 --2- 172.21.15.5:0/4254112617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564665c7a4d0 0x56466605dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:38:14.955 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.948+0000 7fde0da22640 1 --2- 172.21.15.5:0/4254112617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564665c722f0 0x56466605d860 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fde040ac010 tx=0x7fde04004990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d82945329a5a4650 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:14.955 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.948+0000 7fddf17fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:38:14.955 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.948+0000 7fddf17fa640 1 -- 172.21.15.5:0/4254112617 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde040a7f40 con 0x564665c722f0 2024-08-31T05:38:14.955 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.948+0000 7fde16bed740 1 -- 172.21.15.5:0/4254112617 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde040abb90 con 0x564665c722f0 2024-08-31T05:38:14.955 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.948+0000 7fddf17fa640 1 -- 172.21.15.5:0/4254112617 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7fde040ac2e0 con 0x564665c722f0 2024-08-31T05:38:14.955 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.948+0000 7fddf17fa640 1 -- 172.21.15.5:0/4254112617 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fde04005180 con 0x564665c722f0 2024-08-31T05:38:14.955 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.948+0000 7fde16bed740 10 client.27377 fetch_fsmap learned FSMap version 34 2024-08-31T05:38:14.955 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.948+0000 7fde16bed740 1 -- 172.21.15.5:0/4254112617 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5646660cb660 con 0x564665c722f0 2024-08-31T05:38:14.955 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.949+0000 7fddf17fa640 1 -- 172.21.15.5:0/4254112617 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde040abb90 con 0x564665c722f0 2024-08-31T05:38:14.955 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.949+0000 7fddf17fa640 1 -- 172.21.15.5:0/4254112617 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fde040b4f10 con 0x564665c722f0 2024-08-31T05:38:14.955 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.949+0000 7fde16bed740 10 client.27377 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:38:14.955 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.949+0000 7fde16bed740 10 client.27377 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:38:14.955 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.949+0000 7fde16bed740 20 client.27377 populate_metadata read hostname 'smithi005' 2024-08-31T05:38:14.956 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.949+0000 7fde16bed740 1 --2- 172.21.15.5:0/4254112617 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x564665c2f1c0 0x5646660cdd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:14.956 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.949+0000 7fde16bed740 4 client.27377 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:38:14.956 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.949+0000 7fde16bed740 1 -- 172.21.15.5:0/4254112617 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564665fb19f0 con 0x564665c2f1c0 2024-08-31T05:38:14.956 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.949+0000 7fde0d221640 1 --2- 172.21.15.5:0/4254112617 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x564665c2f1c0 0x5646660cdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:14.956 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.949+0000 7fde0d221640 1 --2- 172.21.15.5:0/4254112617 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x564665c2f1c0 0x5646660cdd90 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16f9f8f10ea5a1e2 server_cookie=98507b4bb65defc0 in_seq=0 out_seq=0 2024-08-31T05:38:14.956 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.949+0000 7fddf17fa640 10 client.27377 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:38:14.965 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.963+0000 7fddf17fa640 1 -- 172.21.15.5:0/4254112617 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564665fb19f0 con 0x564665c2f1c0 2024-08-31T05:38:14.965 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.963+0000 7fddf17fa640 10 client.27377 handle_command_reply: tid=0 2024-08-31T05:38:14.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.963+0000 7fde16bed740 1 client.27377 shutdown 2024-08-31T05:38:14.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.963+0000 7fde16bed740 1 -- 172.21.15.5:0/4254112617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564665c722f0 msgr2=0x56466605d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:14.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.963+0000 7fde16bed740 1 --2- 172.21.15.5:0/4254112617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564665c722f0 0x56466605d860 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fde040ac010 tx=0x7fde04004990 comp rx=0 tx=0).stop 2024-08-31T05:38:14.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.963+0000 7fde16bed740 1 -- 172.21.15.5:0/4254112617 shutdown_connections 2024-08-31T05:38:14.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.963+0000 7fde16bed740 1 --2- 172.21.15.5:0/4254112617 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x564665c2f1c0 0x5646660cdd90 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:14.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.963+0000 7fde16bed740 1 --2- 172.21.15.5:0/4254112617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564665c9b1b0 0x56466605e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:14.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.963+0000 7fddf17fa640 0 client.27377 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:38:14.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.963+0000 7fde16bed740 1 --2- 172.21.15.5:0/4254112617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564665c7a4d0 0x56466605dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:14.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.963+0000 7fde16bed740 1 --2- 172.21.15.5:0/4254112617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564665c722f0 0x56466605d860 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:14.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.963+0000 7fde16bed740 1 -- 172.21.15.5:0/4254112617 >> 172.21.15.5:0/4254112617 conn(0x564665c8f300 msgr2=0x56466604bb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:14.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.963+0000 7fde16bed740 1 -- 172.21.15.5:0/4254112617 shutdown_connections 2024-08-31T05:38:14.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.963+0000 7fde16bed740 1 -- 172.21.15.5:0/4254112617 wait complete. 2024-08-31T05:38:14.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.963+0000 7fde16bed740 20 client.27377 trim_cache size 0 max 16384 2024-08-31T05:38:14.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:38:14.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:38:14.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:38:14.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:38:14.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.964+0000 7fde0fc86640 1 -- 172.21.15.5:0/1107529096 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fddf40b4ca0 msgr2=0x7fddf40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:14.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.964+0000 7fde0fc86640 1 --2- 172.21.15.5:0/1107529096 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fddf40b4ca0 0x7fddf40b71b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fde0004d000 tx=0x7fde0004e000 comp rx=0 tx=0).stop 2024-08-31T05:38:14.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.964+0000 7fde0fc86640 1 -- 172.21.15.5:0/1107529096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde08102760 msgr2=0x7fde0819afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:14.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.964+0000 7fde0fc86640 1 --2- 172.21.15.5:0/1107529096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde08102760 0x7fde0819afc0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fde0400e9f0 tx=0x7fde0400edf0 comp rx=0 tx=0).stop 2024-08-31T05:38:14.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.964+0000 7fde0fc86640 1 -- 172.21.15.5:0/1107529096 shutdown_connections 2024-08-31T05:38:14.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.964+0000 7fde0fc86640 1 --2- 172.21.15.5:0/1107529096 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fddf40b4ca0 0x7fddf40b71b0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:14.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.964+0000 7fde0fc86640 1 --2- 172.21.15.5:0/1107529096 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde081089e0 0x7fde0819ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:14.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.964+0000 7fde0fc86640 1 --2- 172.21.15.5:0/1107529096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde08108090 0x7fde0819b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:14.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.964+0000 7fde0fc86640 1 --2- 172.21.15.5:0/1107529096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde08102760 0x7fde0819afc0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:14.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.964+0000 7fde0fc86640 1 -- 172.21.15.5:0/1107529096 >> 172.21.15.5:0/1107529096 conn(0x7fde080fe160 msgr2=0x7fde08105600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:14.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.964+0000 7fde0fc86640 1 -- 172.21.15.5:0/1107529096 shutdown_connections 2024-08-31T05:38:14.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:14.964+0000 7fde0fc86640 1 -- 172.21.15.5:0/1107529096 wait complete. 2024-08-31T05:38:15.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:38:14 smithi050 ceph-mon[22146]: pgmap v597: 129 pgs: 129 active+clean; 479 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.0 MiB/s wr, 249 op/s 2024-08-31T05:38:15.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:38:14 smithi005 ceph-mon[18602]: pgmap v597: 129 pgs: 129 active+clean; 479 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.0 MiB/s wr, 249 op/s 2024-08-31T05:38:15.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:38:14 smithi070 ceph-mon[22316]: pgmap v597: 129 pgs: 129 active+clean; 479 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.0 MiB/s wr, 249 op/s 2024-08-31T05:38:15.929 INFO:tasks.workunit.client.0.smithi005.stdout: 1 932587 11.31 MB/sec execute 303 sec latency 18.537 ms 2024-08-31T05:38:16.929 INFO:tasks.workunit.client.0.smithi005.stdout: 1 934992 11.32 MB/sec execute 304 sec latency 14.533 ms 2024-08-31T05:38:17.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:38:16 smithi050 ceph-mon[22146]: pgmap v598: 129 pgs: 129 active+clean; 486 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.6 MiB/s wr, 185 op/s 2024-08-31T05:38:17.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:38:16 smithi005 ceph-mon[18602]: pgmap v598: 129 pgs: 129 active+clean; 486 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.6 MiB/s wr, 185 op/s 2024-08-31T05:38:17.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:38:16 smithi070 ceph-mon[22316]: pgmap v598: 129 pgs: 129 active+clean; 486 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.6 MiB/s wr, 185 op/s 2024-08-31T05:38:17.929 INFO:tasks.workunit.client.0.smithi005.stdout: 1 937189 11.32 MB/sec execute 305 sec latency 30.989 ms 2024-08-31T05:38:18.929 INFO:tasks.workunit.client.0.smithi005.stdout: 1 938839 11.31 MB/sec execute 306 sec latency 72.720 ms 2024-08-31T05:38:19.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:38:18 smithi050 ceph-mon[22146]: pgmap v599: 129 pgs: 129 active+clean; 490 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.7 MiB/s wr, 195 op/s 2024-08-31T05:38:19.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:38:18 smithi005 ceph-mon[18602]: pgmap v599: 129 pgs: 129 active+clean; 490 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.7 MiB/s wr, 195 op/s 2024-08-31T05:38:19.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:38:18 smithi070 ceph-mon[22316]: pgmap v599: 129 pgs: 129 active+clean; 490 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.7 MiB/s wr, 195 op/s 2024-08-31T05:38:19.929 INFO:tasks.workunit.client.0.smithi005.stdout: 1 940153 11.29 MB/sec execute 307 sec latency 321.029 ms 2024-08-31T05:38:20.929 INFO:tasks.workunit.client.0.smithi005.stdout: 1 942352 11.30 MB/sec execute 308 sec latency 17.339 ms 2024-08-31T05:38:21.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:38:20 smithi050 ceph-mon[22146]: pgmap v600: 129 pgs: 129 active+clean; 495 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.3 MiB/s wr, 219 op/s 2024-08-31T05:38:21.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:38:20 smithi005 ceph-mon[18602]: pgmap v600: 129 pgs: 129 active+clean; 495 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.3 MiB/s wr, 219 op/s 2024-08-31T05:38:21.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:38:20 smithi070 ceph-mon[22316]: pgmap v600: 129 pgs: 129 active+clean; 495 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.3 MiB/s wr, 219 op/s 2024-08-31T05:38:21.930 INFO:tasks.workunit.client.0.smithi005.stdout: 1 944923 11.31 MB/sec execute 309 sec latency 15.217 ms 2024-08-31T05:38:22.930 INFO:tasks.workunit.client.0.smithi005.stdout: 1 946624 11.30 MB/sec execute 310 sec latency 65.547 ms 2024-08-31T05:38:23.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:38:22 smithi050 ceph-mon[22146]: pgmap v601: 129 pgs: 129 active+clean; 501 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.2 MiB/s wr, 223 op/s 2024-08-31T05:38:23.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:38:22 smithi005 ceph-mon[18602]: pgmap v601: 129 pgs: 129 active+clean; 501 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.2 MiB/s wr, 223 op/s 2024-08-31T05:38:23.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:38:22 smithi070 ceph-mon[22316]: pgmap v601: 129 pgs: 129 active+clean; 501 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.2 MiB/s wr, 223 op/s 2024-08-31T05:38:23.929 INFO:tasks.workunit.client.0.smithi005.stdout: 1 948854 11.31 MB/sec execute 311 sec latency 81.509 ms 2024-08-31T05:38:24.930 INFO:tasks.workunit.client.0.smithi005.stdout: 1 950344 11.29 MB/sec execute 312 sec latency 20.395 ms 2024-08-31T05:38:25.156 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:38:24 smithi050 ceph-mon[22146]: pgmap v602: 129 pgs: 129 active+clean; 502 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.7 MiB/s wr, 195 op/s 2024-08-31T05:38:25.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:38:24 smithi005 ceph-mon[18602]: pgmap v602: 129 pgs: 129 active+clean; 502 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.7 MiB/s wr, 195 op/s 2024-08-31T05:38:25.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:38:24 smithi070 ceph-mon[22316]: pgmap v602: 129 pgs: 129 active+clean; 502 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.7 MiB/s wr, 195 op/s 2024-08-31T05:38:25.930 INFO:tasks.workunit.client.0.smithi005.stdout: 1 952769 11.30 MB/sec execute 313 sec latency 15.536 ms 2024-08-31T05:38:26.930 INFO:tasks.workunit.client.0.smithi005.stdout: 1 955110 11.30 MB/sec execute 314 sec latency 17.508 ms 2024-08-31T05:38:27.156 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:38:26 smithi050 ceph-mon[22146]: pgmap v603: 129 pgs: 129 active+clean; 502 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.6 MiB/s wr, 227 op/s 2024-08-31T05:38:27.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:38:26 smithi005 ceph-mon[18602]: pgmap v603: 129 pgs: 129 active+clean; 502 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.6 MiB/s wr, 227 op/s 2024-08-31T05:38:27.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:38:26 smithi070 ceph-mon[22316]: pgmap v603: 129 pgs: 129 active+clean; 502 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.6 MiB/s wr, 227 op/s 2024-08-31T05:38:27.930 INFO:tasks.workunit.client.0.smithi005.stdout: 1 957197 11.30 MB/sec execute 315 sec latency 15.116 ms 2024-08-31T05:38:28.079 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.077+0000 7f6c28c27640 1 -- 172.21.15.5:0/3023928867 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c24108090 msgr2=0x7f6c241084a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:28.079 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.077+0000 7f6c28c27640 1 --2- 172.21.15.5:0/3023928867 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c24108090 0x7f6c241084a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6c18009860 tx=0x7f6c1802a340 comp rx=0 tx=0).stop 2024-08-31T05:38:28.079 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.077+0000 7f6c28c27640 1 -- 172.21.15.5:0/3023928867 shutdown_connections 2024-08-31T05:38:28.079 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.077+0000 7f6c28c27640 1 --2- 172.21.15.5:0/3023928867 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c241089e0 0x7f6c2410f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:28.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.077+0000 7f6c28c27640 1 --2- 172.21.15.5:0/3023928867 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c24108090 0x7f6c241084a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:28.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.077+0000 7f6c28c27640 1 --2- 172.21.15.5:0/3023928867 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c24102760 0x7f6c24102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:28.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.077+0000 7f6c28c27640 1 -- 172.21.15.5:0/3023928867 >> 172.21.15.5:0/3023928867 conn(0x7f6c240fe160 msgr2=0x7f6c241005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:28.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.077+0000 7f6c28c27640 1 -- 172.21.15.5:0/3023928867 shutdown_connections 2024-08-31T05:38:28.080 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.077+0000 7f6c28c27640 1 -- 172.21.15.5:0/3023928867 wait complete. 2024-08-31T05:38:28.081 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.078+0000 7f6c28c27640 1 Processor -- start 2024-08-31T05:38:28.081 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.078+0000 7f6c28c27640 1 -- start start 2024-08-31T05:38:28.081 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.078+0000 7f6c28c27640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c24102760 0x7f6c2419c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:28.081 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.079+0000 7f6c28c27640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c24108090 0x7f6c2419c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:28.081 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.079+0000 7f6c28c27640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c241089e0 0x7f6c241a1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:28.081 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.079+0000 7f6c28c27640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6c241115a0 con 0x7f6c24108090 2024-08-31T05:38:28.081 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.079+0000 7f6c28c27640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6c24111420 con 0x7f6c24102760 2024-08-31T05:38:28.081 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.079+0000 7f6c28c27640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6c24111720 con 0x7f6c241089e0 2024-08-31T05:38:28.082 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.079+0000 7f6c22d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c241089e0 0x7f6c241a1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:28.082 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.079+0000 7f6c22d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c241089e0 0x7f6c241a1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:43438/0 (socket says 172.21.15.5:43438) 2024-08-31T05:38:28.083 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.079+0000 7f6c22d9d640 1 -- 172.21.15.5:0/2156501309 learned_addr learned my addr 172.21.15.5:0/2156501309 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:28.083 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.079+0000 7f6c21d9b640 1 --2- 172.21.15.5:0/2156501309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c24108090 0x7f6c2419c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:28.083 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.079+0000 7f6c2259c640 1 --2- 172.21.15.5:0/2156501309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c24102760 0x7f6c2419c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:28.083 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.080+0000 7f6c22d9d640 1 -- 172.21.15.5:0/2156501309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c24102760 msgr2=0x7f6c2419c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:28.083 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.080+0000 7f6c22d9d640 1 --2- 172.21.15.5:0/2156501309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c24102760 0x7f6c2419c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:28.083 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.080+0000 7f6c22d9d640 1 -- 172.21.15.5:0/2156501309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c24108090 msgr2=0x7f6c2419c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:28.083 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.080+0000 7f6c22d9d640 1 --2- 172.21.15.5:0/2156501309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c24108090 0x7f6c2419c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:28.083 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.080+0000 7f6c22d9d640 1 -- 172.21.15.5:0/2156501309 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c241a2340 con 0x7f6c241089e0 2024-08-31T05:38:28.083 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.080+0000 7f6c22d9d640 1 --2- 172.21.15.5:0/2156501309 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c241089e0 0x7f6c241a1c40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c00eb10 tx=0x7f6c1c00ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:28.083 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.080+0000 7f6c137fe640 1 -- 172.21.15.5:0/2156501309 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c1c00ce20 con 0x7f6c241089e0 2024-08-31T05:38:28.083 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.080+0000 7f6c28c27640 1 -- 172.21.15.5:0/2156501309 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c241a2630 con 0x7f6c241089e0 2024-08-31T05:38:28.083 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.080+0000 7f6c28c27640 1 -- 172.21.15.5:0/2156501309 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c241a8dc0 con 0x7f6c241089e0 2024-08-31T05:38:28.083 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.080+0000 7f6c137fe640 1 -- 172.21.15.5:0/2156501309 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c1c005020 con 0x7f6c241089e0 2024-08-31T05:38:28.083 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.080+0000 7f6c137fe640 1 -- 172.21.15.5:0/2156501309 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c1c010690 con 0x7f6c241089e0 2024-08-31T05:38:28.085 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.083+0000 7f6c2fc6c740 1 Processor -- start 2024-08-31T05:38:28.087 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.085+0000 7f6c137fe640 1 -- 172.21.15.5:0/2156501309 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f6c1c004b20 con 0x7f6c241089e0 2024-08-31T05:38:28.087 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.085+0000 7f6c2fc6c740 1 -- start start 2024-08-31T05:38:28.089 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.086+0000 7f6c137fe640 1 --2- 172.21.15.5:0/2156501309 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f6c0c0b4ca0 0x7f6c0c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:28.089 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.087+0000 7f6c2fc6c740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c2ce4041b0 0x55c2ce7a7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:28.089 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.087+0000 7f6c2fc6c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2ce3db2f0 0x55c2ce7a8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:28.089 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.087+0000 7f6c2fc6c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2ce3e34d0 0x55c2ce7a8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:28.089 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.087+0000 7f6c2fc6c740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55c2ce71d000 con 0x55c2ce4041b0 2024-08-31T05:38:28.089 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.087+0000 7f6c2fc6c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55c2ce70c590 con 0x55c2ce3db2f0 2024-08-31T05:38:28.089 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.087+0000 7f6c2fc6c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c2ce710540 con 0x55c2ce3e34d0 2024-08-31T05:38:28.089 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.087+0000 7f6c137fe640 1 -- 172.21.15.5:0/2156501309 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7f6c1c0e5dc0 con 0x7f6c241089e0 2024-08-31T05:38:28.090 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.087+0000 7f6c21d9b640 1 --2- 172.21.15.5:0/2156501309 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f6c0c0b4ca0 0x7f6c0c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:28.090 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.087+0000 7f6c21d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2ce3db2f0 0x55c2ce7a8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:28.090 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.087+0000 7f6c22d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2ce3e34d0 0x55c2ce7a8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:28.090 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.087+0000 7f6c22d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2ce3e34d0 0x55c2ce7a8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:43452/0 (socket says 172.21.15.5:43452) 2024-08-31T05:38:28.090 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.087+0000 7f6c22d9d640 1 -- 172.21.15.5:0/4214409702 learned_addr learned my addr 172.21.15.5:0/4214409702 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:28.091 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.087+0000 7f6c2259c640 1 --2- 172.21.15.5:0/4214409702 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c2ce4041b0 0x55c2ce7a7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:28.091 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.088+0000 7f6c21d9b640 1 -- 172.21.15.5:0/4214409702 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2ce3e34d0 msgr2=0x55c2ce7a8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:28.091 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.088+0000 7f6c21d9b640 1 --2- 172.21.15.5:0/4214409702 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2ce3e34d0 0x55c2ce7a8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:28.091 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.088+0000 7f6c21d9b640 1 -- 172.21.15.5:0/4214409702 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c2ce4041b0 msgr2=0x55c2ce7a7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:28.091 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.088+0000 7f6c21d9b640 1 --2- 172.21.15.5:0/4214409702 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c2ce4041b0 0x55c2ce7a7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:28.091 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.088+0000 7f6c21d9b640 1 -- 172.21.15.5:0/4214409702 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2ce46f790 con 0x55c2ce3db2f0 2024-08-31T05:38:28.091 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.088+0000 7f6c2259c640 1 --2- 172.21.15.5:0/4214409702 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c2ce4041b0 0x55c2ce7a7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:38:28.091 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.088+0000 7f6c21d9b640 1 --2- 172.21.15.5:0/4214409702 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2ce3db2f0 0x55c2ce7a8220 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6c2406a480 tx=0x7f6c18004420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2c1bf7f5104ee7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:28.091 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.088+0000 7f6c21d9b640 1 --2- 172.21.15.5:0/2156501309 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f6c0c0b4ca0 0x7f6c0c0b71b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6c18009830 tx=0x7f6c1802c000 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:28.094 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.089+0000 7f6c10ff9640 1 -- 172.21.15.5:0/4214409702 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c18037040 con 0x55c2ce3db2f0 2024-08-31T05:38:28.094 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.089+0000 7f6c10ff9640 1 -- 172.21.15.5:0/4214409702 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c18003ca0 con 0x55c2ce3db2f0 2024-08-31T05:38:28.094 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.089+0000 7f6c10ff9640 1 -- 172.21.15.5:0/4214409702 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c180327c0 con 0x55c2ce3db2f0 2024-08-31T05:38:28.094 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.090+0000 7f6c2fc6c740 1 -- 172.21.15.5:0/4214409702 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2ce3db2f0 msgr2=0x55c2ce7a8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:28.094 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.090+0000 7f6c2fc6c740 1 --2- 172.21.15.5:0/4214409702 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2ce3db2f0 0x55c2ce7a8220 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6c2406a480 tx=0x7f6c18004420 comp rx=0 tx=0).stop 2024-08-31T05:38:28.094 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.090+0000 7f6c2fc6c740 1 -- 172.21.15.5:0/4214409702 shutdown_connections 2024-08-31T05:38:28.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.090+0000 7f6c2fc6c740 1 --2- 172.21.15.5:0/4214409702 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2ce3e34d0 0x55c2ce7a8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:28.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.090+0000 7f6c2fc6c740 1 --2- 172.21.15.5:0/4214409702 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2ce3db2f0 0x55c2ce7a8220 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:28.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.090+0000 7f6c2fc6c740 1 --2- 172.21.15.5:0/4214409702 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c2ce4041b0 0x55c2ce7a7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:28.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.090+0000 7f6c2fc6c740 1 -- 172.21.15.5:0/4214409702 >> 172.21.15.5:0/4214409702 conn(0x55c2ce3f8300 msgr2=0x55c2ce7a5bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:28.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.090+0000 7f6c2fc6c740 1 -- 172.21.15.5:0/4214409702 shutdown_connections 2024-08-31T05:38:28.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.090+0000 7f6c2fc6c740 1 -- 172.21.15.5:0/4214409702 wait complete. 2024-08-31T05:38:28.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.091+0000 7f6c2fc6c740 1 -- start start 2024-08-31T05:38:28.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.091+0000 7f6c2fc6c740 1 Processor -- start 2024-08-31T05:38:28.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.091+0000 7f6c2fc6c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2ce3db2f0 0x55c2ce7b3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:28.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.091+0000 7f6c2fc6c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2ce3e34d0 0x55c2ce7b3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:28.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.091+0000 7f6c2fc6c740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c2ce4041b0 0x55c2ce7bf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:28.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.092+0000 7f6c2fc6c740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55c2ce645ab0 con 0x55c2ce4041b0 2024-08-31T05:38:28.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.092+0000 7f6c2fc6c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55c2ce693680 con 0x55c2ce3db2f0 2024-08-31T05:38:28.096 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.092+0000 7f6c22d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c2ce4041b0 0x55c2ce7bf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:28.096 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.092+0000 7f6c21d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2ce3e34d0 0x55c2ce7b3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:28.096 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.092+0000 7f6c2fc6c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c2ce7b6400 con 0x55c2ce3e34d0 2024-08-31T05:38:28.096 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.092+0000 7f6c22d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c2ce4041b0 0x55c2ce7bf750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44230/0 (socket says 172.21.15.5:44230) 2024-08-31T05:38:28.096 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.092+0000 7f6c21d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2ce3e34d0 0x55c2ce7b3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:43458/0 (socket says 172.21.15.5:43458) 2024-08-31T05:38:28.096 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.092+0000 7f6c2259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2ce3db2f0 0x55c2ce7b3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:28.096 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.092+0000 7f6c22d9d640 1 -- 172.21.15.5:0/3691873757 learned_addr learned my addr 172.21.15.5:0/3691873757 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:28.096 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.092+0000 7f6c2fc6c740 10 client.0 _ll_register_callbacks cb 0x55c2ce41ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:38:28.098 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.092+0000 7f6c21d9b640 1 -- 172.21.15.5:0/3691873757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2ce3db2f0 msgr2=0x55c2ce7b3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:28.098 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.092+0000 7f6c21d9b640 1 --2- 172.21.15.5:0/3691873757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2ce3db2f0 0x55c2ce7b3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:28.098 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.092+0000 7f6c21d9b640 1 -- 172.21.15.5:0/3691873757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c2ce4041b0 msgr2=0x55c2ce7bf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:28.098 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.092+0000 7f6c21d9b640 1 --2- 172.21.15.5:0/3691873757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c2ce4041b0 0x55c2ce7bf750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:28.099 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.092+0000 7f6c21d9b640 1 -- 172.21.15.5:0/3691873757 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2ce4e8620 con 0x55c2ce3e34d0 2024-08-31T05:38:28.099 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.092+0000 7f6c2259c640 1 --2- 172.21.15.5:0/3691873757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2ce3db2f0 0x55c2ce7b3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:38:28.099 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.093+0000 7f6c21d9b640 1 --2- 172.21.15.5:0/3691873757 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2ce3e34d0 0x55c2ce7b3ec0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6c18035040 tx=0x7f6c1802a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=836ced3e3ae5a046 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:28.099 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.093+0000 7f6c09ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:38:28.099 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.093+0000 7f6c09ffb640 1 -- 172.21.15.5:0/3691873757 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c18037070 con 0x55c2ce3e34d0 2024-08-31T05:38:28.099 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.093+0000 7f6c09ffb640 1 -- 172.21.15.5:0/3691873757 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7f6c1804b650 con 0x55c2ce3e34d0 2024-08-31T05:38:28.099 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.093+0000 7f6c2fc6c740 1 -- 172.21.15.5:0/3691873757 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c18003ca0 con 0x55c2ce3e34d0 2024-08-31T05:38:28.099 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.094+0000 7f6c09ffb640 1 -- 172.21.15.5:0/3691873757 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f6c18061050 con 0x55c2ce3e34d0 2024-08-31T05:38:28.099 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.094+0000 7f6c2fc6c740 10 client.27391 fetch_fsmap learned FSMap version 34 2024-08-31T05:38:28.099 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.094+0000 7f6c2fc6c740 1 -- 172.21.15.5:0/3691873757 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55c2ce7c24d0 con 0x55c2ce3e34d0 2024-08-31T05:38:28.099 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.094+0000 7f6c09ffb640 1 -- 172.21.15.5:0/3691873757 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c18058070 con 0x55c2ce3e34d0 2024-08-31T05:38:28.099 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.094+0000 7f6c09ffb640 1 -- 172.21.15.5:0/3691873757 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f6c18049070 con 0x55c2ce3e34d0 2024-08-31T05:38:28.099 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.095+0000 7f6c2fc6c740 10 client.27391 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:38:28.099 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.095+0000 7f6c2fc6c740 10 client.27391 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:38:28.099 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.095+0000 7f6c2fc6c740 20 client.27391 populate_metadata read hostname 'smithi005' 2024-08-31T05:38:28.100 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.095+0000 7f6c2fc6c740 1 --2- 172.21.15.5:0/3691873757 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55c2ce3c2d80 0x55c2ce7c5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:28.100 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.095+0000 7f6c2fc6c740 4 client.27391 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:38:28.100 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.095+0000 7f6c2fc6c740 1 -- 172.21.15.5:0/3691873757 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f6c18003ca0 con 0x55c2ce3c2d80 2024-08-31T05:38:28.100 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.095+0000 7f6c2259c640 1 --2- 172.21.15.5:0/3691873757 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55c2ce3c2d80 0x55c2ce7c5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:28.100 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.096+0000 7f6c2259c640 1 --2- 172.21.15.5:0/3691873757 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55c2ce3c2d80 0x55c2ce7c5830 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fff6a52e33d663a2 server_cookie=17fd5d9e162543ee in_seq=0 out_seq=0 2024-08-31T05:38:28.100 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.096+0000 7f6c09ffb640 10 client.27391 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:38:28.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.097+0000 7f6c09ffb640 1 -- 172.21.15.5:0/3691873757 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f6c18003ca0 con 0x55c2ce3c2d80 2024-08-31T05:38:28.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.097+0000 7f6c09ffb640 10 client.27391 handle_command_reply: tid=0 2024-08-31T05:38:28.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.097+0000 7f6c2fc6c740 1 client.27391 shutdown 2024-08-31T05:38:28.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.098+0000 7f6c2fc6c740 1 -- 172.21.15.5:0/3691873757 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2ce3e34d0 msgr2=0x55c2ce7b3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:28.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.098+0000 7f6c2fc6c740 1 --2- 172.21.15.5:0/3691873757 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2ce3e34d0 0x55c2ce7b3ec0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6c18035040 tx=0x7f6c1802a340 comp rx=0 tx=0).stop 2024-08-31T05:38:28.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.098+0000 7f6c2fc6c740 1 -- 172.21.15.5:0/3691873757 shutdown_connections 2024-08-31T05:38:28.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.098+0000 7f6c2fc6c740 1 --2- 172.21.15.5:0/3691873757 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55c2ce3c2d80 0x55c2ce7c5830 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:28.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.098+0000 7f6c2fc6c740 1 --2- 172.21.15.5:0/3691873757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c2ce4041b0 0x55c2ce7bf750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:28.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.098+0000 7f6c09ffb640 0 client.27391 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:38:28.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.098+0000 7f6c2fc6c740 1 --2- 172.21.15.5:0/3691873757 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2ce3e34d0 0x55c2ce7b3ec0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:28.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.098+0000 7f6c2fc6c740 1 --2- 172.21.15.5:0/3691873757 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2ce3db2f0 0x55c2ce7b3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:28.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.098+0000 7f6c2fc6c740 1 -- 172.21.15.5:0/3691873757 >> 172.21.15.5:0/3691873757 conn(0x55c2ce3f8300 msgr2=0x55c2ce7a8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:28.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.099+0000 7f6c2fc6c740 1 -- 172.21.15.5:0/3691873757 shutdown_connections 2024-08-31T05:38:28.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.099+0000 7f6c2fc6c740 1 -- 172.21.15.5:0/3691873757 wait complete. 2024-08-31T05:38:28.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.100+0000 7f6c2fc6c740 20 client.27391 trim_cache size 0 max 16384 2024-08-31T05:38:28.126 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.124+0000 7f6c2fc6c740 1 Processor -- start 2024-08-31T05:38:28.126 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.124+0000 7f6c2fc6c740 1 -- start start 2024-08-31T05:38:28.127 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.124+0000 7f6c2fc6c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2ce3c2d80 0x55c2ce7b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:28.127 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.124+0000 7f6c2fc6c740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c2ce3db2f0 0x55c2ce7a5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:28.127 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.124+0000 7f6c2fc6c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2ce3e34d0 0x55c2ce7a56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:28.127 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.124+0000 7f6c2fc6c740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6c04010060 con 0x55c2ce3db2f0 2024-08-31T05:38:28.127 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.124+0000 7f6c2fc6c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6c04011ba0 con 0x55c2ce3e34d0 2024-08-31T05:38:28.127 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.124+0000 7f6c2fc6c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6c04010730 con 0x55c2ce3c2d80 2024-08-31T05:38:28.127 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.124+0000 7f6c21d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c2ce3db2f0 0x55c2ce7a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:28.127 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.124+0000 7f6c21d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c2ce3db2f0 0x55c2ce7a5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44246/0 (socket says 172.21.15.5:44246) 2024-08-31T05:38:28.127 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.124+0000 7f6c21d9b640 1 -- 172.21.15.5:0/2850339959 learned_addr learned my addr 172.21.15.5:0/2850339959 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:28.127 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.124+0000 7f6c22d9d640 1 --2- 172.21.15.5:0/2850339959 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2ce3e34d0 0x55c2ce7a56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:28.127 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.124+0000 7f6c2259c640 1 --2- 172.21.15.5:0/2850339959 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2ce3c2d80 0x55c2ce7b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:28.128 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.125+0000 7f6c21d9b640 1 -- 172.21.15.5:0/2850339959 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2ce3c2d80 msgr2=0x55c2ce7b32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:28.128 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.125+0000 7f6c21d9b640 1 --2- 172.21.15.5:0/2850339959 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2ce3c2d80 0x55c2ce7b32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:28.128 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.125+0000 7f6c21d9b640 1 -- 172.21.15.5:0/2850339959 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2ce3e34d0 msgr2=0x55c2ce7a56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:28.128 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.125+0000 7f6c21d9b640 1 --2- 172.21.15.5:0/2850339959 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2ce3e34d0 0x55c2ce7a56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:28.128 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.125+0000 7f6c21d9b640 1 -- 172.21.15.5:0/2850339959 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2ce7a64d0 con 0x55c2ce3db2f0 2024-08-31T05:38:28.128 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.125+0000 7f6c22d9d640 1 --2- 172.21.15.5:0/2850339959 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2ce3e34d0 0x55c2ce7a56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:38:28.128 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.125+0000 7f6c21d9b640 1 --2- 172.21.15.5:0/2850339959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c2ce3db2f0 0x55c2ce7a5180 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f6c1802a860 tx=0x7f6c18005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c572ffc9ec25a96a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:28.129 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.125+0000 7f6c0bfff640 1 -- 172.21.15.5:0/2850339959 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c18037040 con 0x55c2ce3db2f0 2024-08-31T05:38:28.129 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.126+0000 7f6c0bfff640 1 -- 172.21.15.5:0/2850339959 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c18058040 con 0x55c2ce3db2f0 2024-08-31T05:38:28.129 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.126+0000 7f6c0bfff640 1 -- 172.21.15.5:0/2850339959 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c18032660 con 0x55c2ce3db2f0 2024-08-31T05:38:28.130 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.127+0000 7f6c2fc6c740 1 -- 172.21.15.5:0/2850339959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c2ce3db2f0 msgr2=0x55c2ce7a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:28.130 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.127+0000 7f6c2fc6c740 1 --2- 172.21.15.5:0/2850339959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c2ce3db2f0 0x55c2ce7a5180 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f6c1802a860 tx=0x7f6c18005fd0 comp rx=0 tx=0).stop 2024-08-31T05:38:28.130 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.127+0000 7f6c2fc6c740 1 -- 172.21.15.5:0/2850339959 shutdown_connections 2024-08-31T05:38:28.130 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.127+0000 7f6c2fc6c740 1 --2- 172.21.15.5:0/2850339959 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2ce3e34d0 0x55c2ce7a56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:28.130 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.127+0000 7f6c2fc6c740 1 --2- 172.21.15.5:0/2850339959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c2ce3db2f0 0x55c2ce7a5180 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:28.130 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.127+0000 7f6c2fc6c740 1 --2- 172.21.15.5:0/2850339959 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2ce3c2d80 0x55c2ce7b32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:28.130 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.127+0000 7f6c2fc6c740 1 -- 172.21.15.5:0/2850339959 >> 172.21.15.5:0/2850339959 conn(0x55c2ce3f8300 msgr2=0x55c2ce7b2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:28.130 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.128+0000 7f6c2fc6c740 1 -- 172.21.15.5:0/2850339959 shutdown_connections 2024-08-31T05:38:28.131 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.128+0000 7f6c2fc6c740 1 -- 172.21.15.5:0/2850339959 wait complete. 2024-08-31T05:38:28.131 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.128+0000 7f6c2fc6c740 1 -- start start 2024-08-31T05:38:28.132 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.128+0000 7f6c2fc6c740 1 Processor -- start 2024-08-31T05:38:28.132 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.129+0000 7f6c2fc6c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2ce3c2d80 0x55c2ce7bc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:28.132 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.129+0000 7f6c2fc6c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2ce3db2f0 0x55c2ce7b75e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:28.132 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.129+0000 7f6c2fc6c740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c2ce3e34d0 0x55c2ce7b7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:28.132 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.129+0000 7f6c2fc6c740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6c040114d0 con 0x55c2ce3e34d0 2024-08-31T05:38:28.132 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.129+0000 7f6c2fc6c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6c04010e00 con 0x55c2ce3c2d80 2024-08-31T05:38:28.132 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.129+0000 7f6c2fc6c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6c0400e060 con 0x55c2ce3db2f0 2024-08-31T05:38:28.132 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.129+0000 7f6c2fc6c740 10 client.0 _ll_register_callbacks cb 0x7f6c14004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:38:28.132 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.129+0000 7f6c2259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2ce3c2d80 0x55c2ce7bc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:28.132 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.129+0000 7f6c2259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2ce3c2d80 0x55c2ce7bc0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:38554/0 (socket says 172.21.15.5:38554) 2024-08-31T05:38:28.132 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.129+0000 7f6c2259c640 1 -- 172.21.15.5:0/3380916992 learned_addr learned my addr 172.21.15.5:0/3380916992 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:28.133 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.129+0000 7f6c22d9d640 1 --2- 172.21.15.5:0/3380916992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c2ce3e34d0 0x55c2ce7b7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:28.133 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.129+0000 7f6c21d9b640 1 --2- 172.21.15.5:0/3380916992 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2ce3db2f0 0x55c2ce7b75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:28.133 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.130+0000 7f6c2259c640 1 -- 172.21.15.5:0/3380916992 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2ce3db2f0 msgr2=0x55c2ce7b75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:28.133 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.130+0000 7f6c2259c640 1 --2- 172.21.15.5:0/3380916992 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2ce3db2f0 0x55c2ce7b75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:28.133 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.130+0000 7f6c2259c640 1 -- 172.21.15.5:0/3380916992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c2ce3e34d0 msgr2=0x55c2ce7b7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:28.133 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.130+0000 7f6c2259c640 1 --2- 172.21.15.5:0/3380916992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c2ce3e34d0 0x55c2ce7b7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:28.133 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.130+0000 7f6c2259c640 1 -- 172.21.15.5:0/3380916992 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2ce82f060 con 0x55c2ce3c2d80 2024-08-31T05:38:28.133 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.130+0000 7f6c22d9d640 1 --2- 172.21.15.5:0/3380916992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c2ce3e34d0 0x55c2ce7b7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:38:28.134 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.130+0000 7f6c2259c640 1 --2- 172.21.15.5:0/3380916992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2ce3c2d80 0x55c2ce7bc0b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x55c2ce7c5dd0 tx=0x7f6c1400b470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c1dcc58a0306449 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:28.134 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.130+0000 7f6c09ffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:38:28.134 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.131+0000 7f6c09ffb640 1 -- 172.21.15.5:0/3380916992 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c14005050 con 0x55c2ce3c2d80 2024-08-31T05:38:28.134 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.131+0000 7f6c2fc6c740 1 -- 172.21.15.5:0/3380916992 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c18058040 con 0x55c2ce3c2d80 2024-08-31T05:38:28.134 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.131+0000 7f6c09ffb640 1 -- 172.21.15.5:0/3380916992 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7f6c140051f0 con 0x55c2ce3c2d80 2024-08-31T05:38:28.135 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.131+0000 7f6c09ffb640 1 -- 172.21.15.5:0/3380916992 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f6c14030050 con 0x55c2ce3c2d80 2024-08-31T05:38:28.135 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.131+0000 7f6c2fc6c740 10 client.27392 fetch_fsmap learned FSMap version 34 2024-08-31T05:38:28.135 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.131+0000 7f6c2fc6c740 1 -- 172.21.15.5:0/3380916992 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55c2ce830250 con 0x55c2ce3c2d80 2024-08-31T05:38:28.135 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.132+0000 7f6c09ffb640 1 -- 172.21.15.5:0/3380916992 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c18058040 con 0x55c2ce3c2d80 2024-08-31T05:38:28.135 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.132+0000 7f6c09ffb640 1 -- 172.21.15.5:0/3380916992 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f6c140285c0 con 0x55c2ce3c2d80 2024-08-31T05:38:28.135 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.132+0000 7f6c2fc6c740 10 client.27392 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:38:28.135 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.132+0000 7f6c2fc6c740 10 client.27392 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:38:28.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.132+0000 7f6c2fc6c740 20 client.27392 populate_metadata read hostname 'smithi005' 2024-08-31T05:38:28.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.132+0000 7f6c2fc6c740 1 --2- 172.21.15.5:0/3380916992 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55c2ce4041b0 0x55c2ce8329f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:28.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.132+0000 7f6c2fc6c740 4 client.27392 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:38:28.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.132+0000 7f6c2fc6c740 1 -- 172.21.15.5:0/3380916992 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c2ce71ef50 con 0x55c2ce4041b0 2024-08-31T05:38:28.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.133+0000 7f6c21d9b640 1 --2- 172.21.15.5:0/3380916992 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55c2ce4041b0 0x55c2ce8329f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:28.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.133+0000 7f6c09ffb640 10 client.27392 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:38:28.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.133+0000 7f6c21d9b640 1 --2- 172.21.15.5:0/3380916992 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55c2ce4041b0 0x55c2ce8329f0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74847f5afb7a2111 server_cookie=ff18cc2aeda8dd3b in_seq=0 out_seq=0 2024-08-31T05:38:28.153 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.151+0000 7f6c09ffb640 1 -- 172.21.15.5:0/3380916992 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c2ce71ef50 con 0x55c2ce4041b0 2024-08-31T05:38:28.153 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.151+0000 7f6c09ffb640 10 client.27392 handle_command_reply: tid=0 2024-08-31T05:38:28.153 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.151+0000 7f6c2fc6c740 1 client.27392 shutdown 2024-08-31T05:38:28.154 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.152+0000 7f6c2fc6c740 1 -- 172.21.15.5:0/3380916992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2ce3c2d80 msgr2=0x55c2ce7bc0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:28.154 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.152+0000 7f6c2fc6c740 1 --2- 172.21.15.5:0/3380916992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2ce3c2d80 0x55c2ce7bc0b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x55c2ce7c5dd0 tx=0x7f6c1400b470 comp rx=0 tx=0).stop 2024-08-31T05:38:28.155 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.153+0000 7f6c2fc6c740 1 -- 172.21.15.5:0/3380916992 shutdown_connections 2024-08-31T05:38:28.155 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.153+0000 7f6c2fc6c740 1 --2- 172.21.15.5:0/3380916992 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55c2ce4041b0 0x55c2ce8329f0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:28.155 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.153+0000 7f6c2fc6c740 1 --2- 172.21.15.5:0/3380916992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c2ce3e34d0 0x55c2ce7b7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:28.155 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.153+0000 7f6c2fc6c740 1 --2- 172.21.15.5:0/3380916992 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c2ce3db2f0 0x55c2ce7b75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:28.155 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.153+0000 7f6c2fc6c740 1 --2- 172.21.15.5:0/3380916992 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c2ce3c2d80 0x55c2ce7bc0b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:28.155 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.153+0000 7f6c2fc6c740 1 -- 172.21.15.5:0/3380916992 >> 172.21.15.5:0/3380916992 conn(0x55c2ce3f8300 msgr2=0x55c2ce7a8cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:28.155 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.153+0000 7f6c09ffb640 0 client.27392 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:38:28.156 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.153+0000 7f6c2fc6c740 1 -- 172.21.15.5:0/3380916992 shutdown_connections 2024-08-31T05:38:28.156 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.153+0000 7f6c2fc6c740 1 -- 172.21.15.5:0/3380916992 wait complete. 2024-08-31T05:38:28.156 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.154+0000 7f6c2fc6c740 20 client.27392 trim_cache size 0 max 16384 2024-08-31T05:38:28.156 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:38:28.156 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:38:28.156 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:38:28.157 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:38:28.158 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.154+0000 7f6c28c27640 1 -- 172.21.15.5:0/2156501309 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f6c0c0b4ca0 msgr2=0x7f6c0c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:28.158 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.154+0000 7f6c28c27640 1 --2- 172.21.15.5:0/2156501309 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f6c0c0b4ca0 0x7f6c0c0b71b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6c18009830 tx=0x7f6c1802c000 comp rx=0 tx=0).stop 2024-08-31T05:38:28.158 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.155+0000 7f6c28c27640 1 -- 172.21.15.5:0/2156501309 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c241089e0 msgr2=0x7f6c241a1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:28.158 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.155+0000 7f6c28c27640 1 --2- 172.21.15.5:0/2156501309 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c241089e0 0x7f6c241a1c40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c00eb10 tx=0x7f6c1c00ef10 comp rx=0 tx=0).stop 2024-08-31T05:38:28.158 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.155+0000 7f6c28c27640 1 -- 172.21.15.5:0/2156501309 shutdown_connections 2024-08-31T05:38:28.158 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.155+0000 7f6c28c27640 1 --2- 172.21.15.5:0/2156501309 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f6c0c0b4ca0 0x7f6c0c0b71b0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:28.158 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.155+0000 7f6c28c27640 1 --2- 172.21.15.5:0/2156501309 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c241089e0 0x7f6c241a1c40 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:28.158 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.155+0000 7f6c28c27640 1 --2- 172.21.15.5:0/2156501309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c24108090 0x7f6c2419c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:28.158 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.155+0000 7f6c28c27640 1 --2- 172.21.15.5:0/2156501309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6c24102760 0x7f6c2419c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:28.158 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.155+0000 7f6c28c27640 1 -- 172.21.15.5:0/2156501309 >> 172.21.15.5:0/2156501309 conn(0x7f6c240fe160 msgr2=0x7f6c24107770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:28.158 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.155+0000 7f6c28c27640 1 -- 172.21.15.5:0/2156501309 shutdown_connections 2024-08-31T05:38:28.158 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:28.155+0000 7f6c28c27640 1 -- 172.21.15.5:0/2156501309 wait complete. 2024-08-31T05:38:28.930 INFO:tasks.workunit.client.0.smithi005.stdout: 1 959405 11.31 MB/sec execute 316 sec latency 94.038 ms 2024-08-31T05:38:29.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:38:28 smithi050 ceph-mon[22146]: pgmap v604: 129 pgs: 129 active+clean; 511 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.2 MiB/s wr, 224 op/s 2024-08-31T05:38:29.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:38:28 smithi005 ceph-mon[18602]: pgmap v604: 129 pgs: 129 active+clean; 511 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.2 MiB/s wr, 224 op/s 2024-08-31T05:38:29.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:38:28 smithi070 ceph-mon[22316]: pgmap v604: 129 pgs: 129 active+clean; 511 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.2 MiB/s wr, 224 op/s 2024-08-31T05:38:29.930 INFO:tasks.workunit.client.0.smithi005.stdout: 1 960934 11.29 MB/sec execute 317 sec latency 27.101 ms 2024-08-31T05:38:30.930 INFO:tasks.workunit.client.0.smithi005.stdout: 1 963312 11.30 MB/sec execute 318 sec latency 15.597 ms 2024-08-31T05:38:31.156 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:38:30 smithi050 ceph-mon[22146]: pgmap v605: 129 pgs: 129 active+clean; 516 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.8 MiB/s wr, 252 op/s 2024-08-31T05:38:31.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:38:30 smithi005 ceph-mon[18602]: pgmap v605: 129 pgs: 129 active+clean; 516 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.8 MiB/s wr, 252 op/s 2024-08-31T05:38:31.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:38:30 smithi070 ceph-mon[22316]: pgmap v605: 129 pgs: 129 active+clean; 516 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.8 MiB/s wr, 252 op/s 2024-08-31T05:38:31.930 INFO:tasks.workunit.client.0.smithi005.stdout: 1 965320 11.29 MB/sec execute 319 sec latency 20.805 ms 2024-08-31T05:38:32.930 INFO:tasks.workunit.client.0.smithi005.stdout: 1 967351 11.29 MB/sec execute 320 sec latency 13.854 ms 2024-08-31T05:38:33.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:38:32 smithi050 ceph-mon[22146]: pgmap v606: 129 pgs: 129 active+clean; 521 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.0 MiB/s wr, 219 op/s 2024-08-31T05:38:33.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:38:32 smithi005 ceph-mon[18602]: pgmap v606: 129 pgs: 129 active+clean; 521 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.0 MiB/s wr, 219 op/s 2024-08-31T05:38:33.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:38:32 smithi070 ceph-mon[22316]: pgmap v606: 129 pgs: 129 active+clean; 521 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.0 MiB/s wr, 219 op/s 2024-08-31T05:38:33.913 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T05:38:33.930 INFO:tasks.workunit.client.0.smithi005.stdout: 1 969734 11.30 MB/sec execute 321 sec latency 29.038 ms 2024-08-31T05:38:34.265 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:38:34.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.788+0000 7f78ce0cc640 1 -- 172.21.15.5:0/2442544488 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78c8109310 msgr2=0x7f78c8109720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:34.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.788+0000 7f78ce0cc640 1 --2- 172.21.15.5:0/2442544488 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78c8109310 0x7f78c8109720 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f78bc009900 tx=0x7f78bc02a3f0 comp rx=0 tx=0).stop 2024-08-31T05:38:34.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.788+0000 7f78ce0cc640 1 -- 172.21.15.5:0/2442544488 shutdown_connections 2024-08-31T05:38:34.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.788+0000 7f78ce0cc640 1 --2- 172.21.15.5:0/2442544488 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78c8109c60 0x7f78c8110490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:34.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.788+0000 7f78ce0cc640 1 --2- 172.21.15.5:0/2442544488 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78c8109310 0x7f78c8109720 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:34.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.788+0000 7f78ce0cc640 1 --2- 172.21.15.5:0/2442544488 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78c81039d0 0x7f78c8103de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:34.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.788+0000 7f78ce0cc640 1 -- 172.21.15.5:0/2442544488 >> 172.21.15.5:0/2442544488 conn(0x7f78c807b670 msgr2=0x7f78c807ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:34.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.788+0000 7f78ce0cc640 1 -- 172.21.15.5:0/2442544488 shutdown_connections 2024-08-31T05:38:34.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.788+0000 7f78ce0cc640 1 -- 172.21.15.5:0/2442544488 wait complete. 2024-08-31T05:38:34.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.789+0000 7f78ce0cc640 1 Processor -- start 2024-08-31T05:38:34.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.789+0000 7f78ce0cc640 1 -- start start 2024-08-31T05:38:34.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.789+0000 7f78ce0cc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78c81039d0 0x7f78c819c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:34.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.789+0000 7f78ce0cc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78c8109310 0x7f78c819ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:34.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.789+0000 7f78ce0cc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78c8109c60 0x7f78c81a1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:34.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.789+0000 7f78ce0cc640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f78c8113880 con 0x7f78c8109310 2024-08-31T05:38:34.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.789+0000 7f78ce0cc640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f78c8113700 con 0x7f78c8109c60 2024-08-31T05:38:34.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.789+0000 7f78ce0cc640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f78c8113a00 con 0x7f78c81039d0 2024-08-31T05:38:34.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.790+0000 7f78c77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78c81039d0 0x7f78c819c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:34.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.790+0000 7f78c7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78c8109c60 0x7f78c81a1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:34.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.790+0000 7f78c77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78c81039d0 0x7f78c819c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:39876/0 (socket says 172.21.15.5:39876) 2024-08-31T05:38:34.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.790+0000 7f78c77fe640 1 -- 172.21.15.5:0/1897591005 learned_addr learned my addr 172.21.15.5:0/1897591005 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:34.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.790+0000 7f78c6ffd640 1 --2- 172.21.15.5:0/1897591005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78c8109310 0x7f78c819ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:34.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.790+0000 7f78c77fe640 1 -- 172.21.15.5:0/1897591005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78c8109c60 msgr2=0x7f78c81a1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:34.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.790+0000 7f78c77fe640 1 --2- 172.21.15.5:0/1897591005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78c8109c60 0x7f78c81a1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:34.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.790+0000 7f78c77fe640 1 -- 172.21.15.5:0/1897591005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78c8109310 msgr2=0x7f78c819ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:34.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.790+0000 7f78c77fe640 1 --2- 172.21.15.5:0/1897591005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78c8109310 0x7f78c819ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:34.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.790+0000 7f78c77fe640 1 -- 172.21.15.5:0/1897591005 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78c81a2440 con 0x7f78c81039d0 2024-08-31T05:38:34.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.790+0000 7f78c7fff640 1 --2- 172.21.15.5:0/1897591005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78c8109c60 0x7f78c81a1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:38:34.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.790+0000 7f78c77fe640 1 --2- 172.21.15.5:0/1897591005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78c81039d0 0x7f78c819c4d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f78b800ea60 tx=0x7f78b800ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:34.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.790+0000 7f78c4ff9640 1 -- 172.21.15.5:0/1897591005 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b800cde0 con 0x7f78c81039d0 2024-08-31T05:38:34.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.791+0000 7f78ce0cc640 1 -- 172.21.15.5:0/1897591005 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78c81a2730 con 0x7f78c81039d0 2024-08-31T05:38:34.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.791+0000 7f78c4ff9640 1 -- 172.21.15.5:0/1897591005 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78b80035f0 con 0x7f78c81039d0 2024-08-31T05:38:34.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.791+0000 7f78c4ff9640 1 -- 172.21.15.5:0/1897591005 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b8010690 con 0x7f78c81039d0 2024-08-31T05:38:34.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.791+0000 7f78ce0cc640 1 -- 172.21.15.5:0/1897591005 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78c81a8e90 con 0x7f78c81039d0 2024-08-31T05:38:34.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.794+0000 7f78c4ff9640 1 -- 172.21.15.5:0/1897591005 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f78b80037a0 con 0x7f78c81039d0 2024-08-31T05:38:34.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.794+0000 7f78d4641740 1 Processor -- start 2024-08-31T05:38:34.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.794+0000 7f78d4641740 1 -- start start 2024-08-31T05:38:34.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.794+0000 7f78d4641740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5645a64a0070 0x5645a68452c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:34.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.794+0000 7f78d4641740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5645a64771b0 0x5645a6845800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:34.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.794+0000 7f78d4641740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5645a647f390 0x5645a6845d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:34.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.794+0000 7f78d4641740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5645a67bc630 con 0x5645a64771b0 2024-08-31T05:38:34.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.795+0000 7f78d4641740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5645a67abbc0 con 0x5645a64a0070 2024-08-31T05:38:34.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.795+0000 7f78d4641740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5645a67afb70 con 0x5645a647f390 2024-08-31T05:38:34.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.795+0000 7f78c7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5645a64a0070 0x5645a68452c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:34.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.795+0000 7f78c6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5645a647f390 0x5645a6845d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:34.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.795+0000 7f78c7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5645a64a0070 0x5645a68452c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:51810/0 (socket says 172.21.15.5:51810) 2024-08-31T05:38:34.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.795+0000 7f78c77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5645a64771b0 0x5645a6845800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:34.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.795+0000 7f78c7fff640 1 -- 172.21.15.5:0/2796658048 learned_addr learned my addr 172.21.15.5:0/2796658048 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:34.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.795+0000 7f78c4ff9640 1 --2- 172.21.15.5:0/1897591005 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f78b00b4ca0 0x7f78b00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:34.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.795+0000 7f78c7fff640 1 --2- 172.21.15.5:0/1897591005 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f78b00b4ca0 0x7f78b00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:34.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.795+0000 7f78c6ffd640 1 -- 172.21.15.5:0/2796658048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5645a64a0070 msgr2=0x5645a68452c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:34.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.795+0000 7f78c6ffd640 1 --2- 172.21.15.5:0/2796658048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5645a64a0070 0x5645a68452c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:34.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.795+0000 7f78c6ffd640 1 -- 172.21.15.5:0/2796658048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5645a64771b0 msgr2=0x5645a6845800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:34.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.795+0000 7f78c6ffd640 1 --2- 172.21.15.5:0/2796658048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5645a64771b0 0x5645a6845800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:34.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.795+0000 7f78c4ff9640 1 -- 172.21.15.5:0/1897591005 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7f78b80e5c20 con 0x7f78c81039d0 2024-08-31T05:38:34.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.795+0000 7f78c6ffd640 1 -- 172.21.15.5:0/2796658048 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645a650b650 con 0x5645a647f390 2024-08-31T05:38:34.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.795+0000 7f78c7fff640 1 --2- 172.21.15.5:0/2796658048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5645a64a0070 0x5645a68452c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:38:34.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.796+0000 7f78c7fff640 1 --2- 172.21.15.5:0/1897591005 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f78b00b4ca0 0x7f78b00b71b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f78c0005c40 tx=0x7f78c0004ab0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:34.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.796+0000 7f78c6ffd640 1 --2- 172.21.15.5:0/2796658048 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5645a647f390 0x5645a6845d40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f78bc02a910 tx=0x7f78bc000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b58fa08e7ab01c1e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:34.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.796+0000 7f78adffb640 1 -- 172.21.15.5:0/2796658048 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78bc035040 con 0x5645a647f390 2024-08-31T05:38:34.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.796+0000 7f78adffb640 1 -- 172.21.15.5:0/2796658048 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78bc043be0 con 0x5645a647f390 2024-08-31T05:38:34.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.796+0000 7f78adffb640 1 -- 172.21.15.5:0/2796658048 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78bc005040 con 0x5645a647f390 2024-08-31T05:38:34.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.797+0000 7f78d4641740 1 -- 172.21.15.5:0/2796658048 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5645a647f390 msgr2=0x5645a6845d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:34.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.797+0000 7f78d4641740 1 --2- 172.21.15.5:0/2796658048 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5645a647f390 0x5645a6845d40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f78bc02a910 tx=0x7f78bc000bc0 comp rx=0 tx=0).stop 2024-08-31T05:38:34.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.797+0000 7f78d4641740 1 -- 172.21.15.5:0/2796658048 shutdown_connections 2024-08-31T05:38:34.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.797+0000 7f78d4641740 1 --2- 172.21.15.5:0/2796658048 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5645a647f390 0x5645a6845d40 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:34.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.797+0000 7f78d4641740 1 --2- 172.21.15.5:0/2796658048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5645a64771b0 0x5645a6845800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:34.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.797+0000 7f78d4641740 1 --2- 172.21.15.5:0/2796658048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5645a64a0070 0x5645a68452c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:34.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.797+0000 7f78d4641740 1 -- 172.21.15.5:0/2796658048 >> 172.21.15.5:0/2796658048 conn(0x5645a6494460 msgr2=0x5645a68431b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:34.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.797+0000 7f78d4641740 1 -- 172.21.15.5:0/2796658048 shutdown_connections 2024-08-31T05:38:34.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.797+0000 7f78d4641740 1 -- 172.21.15.5:0/2796658048 wait complete. 2024-08-31T05:38:34.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.798+0000 7f78d4641740 1 -- start start 2024-08-31T05:38:34.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.798+0000 7f78d4641740 1 Processor -- start 2024-08-31T05:38:34.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.798+0000 7f78d4641740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5645a64771b0 0x5645a6850a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:34.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.798+0000 7f78d4641740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5645a647f390 0x5645a6850f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:34.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.798+0000 7f78d4641740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5645a64a0070 0x5645a685cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:34.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.799+0000 7f78c77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5645a64771b0 0x5645a6850a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:34.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.799+0000 7f78c77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5645a64771b0 0x5645a6850a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:39898/0 (socket says 172.21.15.5:39898) 2024-08-31T05:38:34.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.799+0000 7f78c6ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5645a647f390 0x5645a6850f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:34.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.799+0000 7f78c77fe640 1 -- 172.21.15.5:0/202492396 learned_addr learned my addr 172.21.15.5:0/202492396 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:34.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.799+0000 7f78d4641740 1 -- 172.21.15.5:0/202492396 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5645a660e700 con 0x5645a64a0070 2024-08-31T05:38:34.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.799+0000 7f78c7fff640 1 --2- 172.21.15.5:0/202492396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5645a64a0070 0x5645a685cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:34.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.799+0000 7f78d4641740 1 -- 172.21.15.5:0/202492396 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5645a6732700 con 0x5645a647f390 2024-08-31T05:38:34.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.799+0000 7f78d4641740 1 -- 172.21.15.5:0/202492396 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5645a6853a40 con 0x5645a64771b0 2024-08-31T05:38:34.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.800+0000 7f78d4641740 10 client.0 _ll_register_callbacks cb 0x5645a6761dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:38:34.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.800+0000 7f78c77fe640 1 -- 172.21.15.5:0/202492396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5645a647f390 msgr2=0x5645a6850f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:34.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.800+0000 7f78c77fe640 1 --2- 172.21.15.5:0/202492396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5645a647f390 0x5645a6850f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:34.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.800+0000 7f78c77fe640 1 -- 172.21.15.5:0/202492396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5645a64a0070 msgr2=0x5645a685cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:34.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.800+0000 7f78c77fe640 1 --2- 172.21.15.5:0/202492396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5645a64a0070 0x5645a685cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:34.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.800+0000 7f78c77fe640 1 -- 172.21.15.5:0/202492396 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645a676b8b0 con 0x5645a64771b0 2024-08-31T05:38:34.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.800+0000 7f78c7fff640 1 --2- 172.21.15.5:0/202492396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5645a64a0070 0x5645a685cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:38:34.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.800+0000 7f78d4641740 1 -- 172.21.15.5:0/202492396 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78bc043be0 con 0x5645a64771b0 2024-08-31T05:38:34.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.800+0000 7f78c77fe640 1 --2- 172.21.15.5:0/202492396 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5645a64771b0 0x5645a6850a00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f78b80a91a0 tx=0x7f78b80ab940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8365c41b0ef8d4a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:34.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.800+0000 7f78a6ffd640 10 client.27409 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:38:34.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.800+0000 7f78a6ffd640 1 -- 172.21.15.5:0/202492396 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b80abf30 con 0x5645a64771b0 2024-08-31T05:38:34.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.801+0000 7f78a6ffd640 1 -- 172.21.15.5:0/202492396 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7f78b80971b0 con 0x5645a64771b0 2024-08-31T05:38:34.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.801+0000 7f78a6ffd640 1 -- 172.21.15.5:0/202492396 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f78b80b07a0 con 0x5645a64771b0 2024-08-31T05:38:34.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.801+0000 7f78d4641740 10 client.27409 fetch_fsmap learned FSMap version 34 2024-08-31T05:38:34.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.801+0000 7f78d4641740 1 -- 172.21.15.5:0/202492396 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({fsmap=34}) -- 0x5645a685f780 con 0x5645a64771b0 2024-08-31T05:38:34.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.801+0000 7f78a6ffd640 1 -- 172.21.15.5:0/202492396 <== mon.1 v2:172.21.15.70:3300/0 4 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f78b80c6ce0 con 0x5645a64771b0 2024-08-31T05:38:34.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.801+0000 7f78d4641740 10 client.27409 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:38:34.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.801+0000 7f78d4641740 10 client.27409 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:38:34.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.801+0000 7f78d4641740 20 client.27409 populate_metadata read hostname 'smithi005' 2024-08-31T05:38:34.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.801+0000 7f78d4641740 1 --2- 172.21.15.5:0/202492396 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5645a645e9f0 0x5645a6862b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:34.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.801+0000 7f78d4641740 4 client.27409 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:38:34.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.801+0000 7f78d4641740 1 -- 172.21.15.5:0/202492396 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5645a67be580 con 0x5645a645e9f0 2024-08-31T05:38:34.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.802+0000 7f78c6ffd640 1 --2- 172.21.15.5:0/202492396 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5645a645e9f0 0x5645a6862b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:34.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.802+0000 7f78a6ffd640 10 client.27409 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:38:34.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.802+0000 7f78c6ffd640 1 --2- 172.21.15.5:0/202492396 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5645a645e9f0 0x5645a6862b40 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9822579f8cc65a33 server_cookie=8ca1d22b75555edf in_seq=0 out_seq=0 2024-08-31T05:38:34.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.803+0000 7f78a6ffd640 1 -- 172.21.15.5:0/202492396 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5645a67be580 con 0x5645a645e9f0 2024-08-31T05:38:34.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.803+0000 7f78a6ffd640 10 client.27409 handle_command_reply: tid=0 2024-08-31T05:38:34.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.803+0000 7f78d4641740 1 client.27409 shutdown 2024-08-31T05:38:34.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.803+0000 7f78d4641740 1 -- 172.21.15.5:0/202492396 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5645a64771b0 msgr2=0x5645a6850a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:34.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.803+0000 7f78d4641740 1 --2- 172.21.15.5:0/202492396 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5645a64771b0 0x5645a6850a00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f78b80a91a0 tx=0x7f78b80ab940 comp rx=0 tx=0).stop 2024-08-31T05:38:34.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.803+0000 7f78d4641740 1 -- 172.21.15.5:0/202492396 shutdown_connections 2024-08-31T05:38:34.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.803+0000 7f78d4641740 1 --2- 172.21.15.5:0/202492396 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5645a645e9f0 0x5645a6862b40 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:34.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.803+0000 7f78d4641740 1 --2- 172.21.15.5:0/202492396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5645a64a0070 0x5645a685cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:34.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.803+0000 7f78d4641740 1 --2- 172.21.15.5:0/202492396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5645a647f390 0x5645a6850f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:34.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.803+0000 7f78d4641740 1 --2- 172.21.15.5:0/202492396 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5645a64771b0 0x5645a6850a00 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:34.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.803+0000 7f78a6ffd640 0 client.27409 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:38:34.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.803+0000 7f78d4641740 1 -- 172.21.15.5:0/202492396 >> 172.21.15.5:0/202492396 conn(0x5645a6494460 msgr2=0x5645a68484a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:34.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.803+0000 7f78d4641740 1 -- 172.21.15.5:0/202492396 shutdown_connections 2024-08-31T05:38:34.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.803+0000 7f78d4641740 1 -- 172.21.15.5:0/202492396 wait complete. 2024-08-31T05:38:34.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.803+0000 7f78d4641740 20 client.27409 trim_cache size 0 max 16384 2024-08-31T05:38:34.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.829+0000 7f78d4641740 1 Processor -- start 2024-08-31T05:38:34.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.829+0000 7f78d4641740 1 -- start start 2024-08-31T05:38:34.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.829+0000 7f78d4641740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5645a645e9f0 0x5645a6852630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:34.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.829+0000 7f78d4641740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5645a64771b0 0x5645a685cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:34.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.830+0000 7f78d4641740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5645a647f390 0x5645a684dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:34.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.830+0000 7f78d4641740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f78c81aeca0 con 0x5645a645e9f0 2024-08-31T05:38:34.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.830+0000 7f78d4641740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f78c81b07e0 con 0x5645a64771b0 2024-08-31T05:38:34.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.830+0000 7f78d4641740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f78c81af370 con 0x5645a647f390 2024-08-31T05:38:34.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.830+0000 7f78c77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5645a645e9f0 0x5645a6852630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:34.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.830+0000 7f78c7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5645a647f390 0x5645a684dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:34.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.830+0000 7f78c6ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5645a64771b0 0x5645a685cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:34.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.830+0000 7f78c77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5645a645e9f0 0x5645a6852630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36858/0 (socket says 172.21.15.5:36858) 2024-08-31T05:38:34.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.830+0000 7f78c77fe640 1 -- 172.21.15.5:0/737870336 learned_addr learned my addr 172.21.15.5:0/737870336 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:34.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.830+0000 7f78c77fe640 1 -- 172.21.15.5:0/737870336 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5645a647f390 msgr2=0x5645a684dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:34.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.830+0000 7f78c77fe640 1 --2- 172.21.15.5:0/737870336 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5645a647f390 0x5645a684dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:34.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.830+0000 7f78c77fe640 1 -- 172.21.15.5:0/737870336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5645a64771b0 msgr2=0x5645a685cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:34.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.830+0000 7f78c77fe640 1 --2- 172.21.15.5:0/737870336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5645a64771b0 0x5645a685cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:34.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.830+0000 7f78c77fe640 1 -- 172.21.15.5:0/737870336 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645a6843aa0 con 0x5645a645e9f0 2024-08-31T05:38:34.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.830+0000 7f78c7fff640 1 --2- 172.21.15.5:0/737870336 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5645a647f390 0x5645a684dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:38:34.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.831+0000 7f78c77fe640 1 --2- 172.21.15.5:0/737870336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5645a645e9f0 0x5645a6852630 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f78b80e3590 tx=0x7f78b8011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4089bd03238a74aa server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:34.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.831+0000 7f78ad7fa640 1 -- 172.21.15.5:0/737870336 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b80abf30 con 0x5645a645e9f0 2024-08-31T05:38:34.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.831+0000 7f78ad7fa640 1 -- 172.21.15.5:0/737870336 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78bc043be0 con 0x5645a645e9f0 2024-08-31T05:38:34.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.831+0000 7f78ad7fa640 1 -- 172.21.15.5:0/737870336 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b80b52a0 con 0x5645a645e9f0 2024-08-31T05:38:34.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.832+0000 7f78d4641740 1 -- 172.21.15.5:0/737870336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5645a645e9f0 msgr2=0x5645a6852630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:34.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.832+0000 7f78d4641740 1 --2- 172.21.15.5:0/737870336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5645a645e9f0 0x5645a6852630 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f78b80e3590 tx=0x7f78b8011000 comp rx=0 tx=0).stop 2024-08-31T05:38:34.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.833+0000 7f78d4641740 1 -- 172.21.15.5:0/737870336 shutdown_connections 2024-08-31T05:38:34.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.833+0000 7f78d4641740 1 --2- 172.21.15.5:0/737870336 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5645a647f390 0x5645a684dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:34.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.833+0000 7f78d4641740 1 --2- 172.21.15.5:0/737870336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5645a64771b0 0x5645a685cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:34.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.833+0000 7f78d4641740 1 --2- 172.21.15.5:0/737870336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5645a645e9f0 0x5645a6852630 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:34.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.833+0000 7f78d4641740 1 -- 172.21.15.5:0/737870336 >> 172.21.15.5:0/737870336 conn(0x5645a6494460 msgr2=0x5645a6851f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:34.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.833+0000 7f78d4641740 1 -- 172.21.15.5:0/737870336 shutdown_connections 2024-08-31T05:38:34.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.833+0000 7f78d4641740 1 -- 172.21.15.5:0/737870336 wait complete. 2024-08-31T05:38:34.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.833+0000 7f78d4641740 1 -- start start 2024-08-31T05:38:34.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.834+0000 7f78d4641740 1 Processor -- start 2024-08-31T05:38:34.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.834+0000 7f78d4641740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5645a645e9f0 0x5645a68592e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:34.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.834+0000 7f78d4641740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5645a64771b0 0x5645a68557f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:34.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.834+0000 7f78d4641740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5645a647f390 0x5645a6855d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:34.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.834+0000 7f78c6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5645a64771b0 0x5645a68557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:34.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.834+0000 7f78c77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5645a645e9f0 0x5645a68592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:34.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.834+0000 7f78c77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5645a645e9f0 0x5645a68592e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:51842/0 (socket says 172.21.15.5:51842) 2024-08-31T05:38:34.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.834+0000 7f78c6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5645a64771b0 0x5645a68557f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:39914/0 (socket says 172.21.15.5:39914) 2024-08-31T05:38:34.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.834+0000 7f78c77fe640 1 -- 172.21.15.5:0/367197219 learned_addr learned my addr 172.21.15.5:0/367197219 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:34.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.834+0000 7f78d4641740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f78c81b0110 con 0x5645a647f390 2024-08-31T05:38:34.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.834+0000 7f78d4641740 1 -- 172.21.15.5:0/367197219 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f78c81afa40 con 0x5645a645e9f0 2024-08-31T05:38:34.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.834+0000 7f78d4641740 1 -- 172.21.15.5:0/367197219 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f78c81accc0 con 0x5645a64771b0 2024-08-31T05:38:34.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.834+0000 7f78d4641740 10 client.0 _ll_register_callbacks cb 0x7f78b800e9b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:38:34.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.834+0000 7f78c7fff640 1 --2- 172.21.15.5:0/367197219 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5645a647f390 0x5645a6855d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:34.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.834+0000 7f78c77fe640 1 -- 172.21.15.5:0/367197219 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5645a64771b0 msgr2=0x5645a68557f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:34.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.834+0000 7f78c77fe640 1 --2- 172.21.15.5:0/367197219 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5645a64771b0 0x5645a68557f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:34.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.835+0000 7f78c77fe640 1 -- 172.21.15.5:0/367197219 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5645a647f390 msgr2=0x5645a6855d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:34.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.835+0000 7f78c77fe640 1 --2- 172.21.15.5:0/367197219 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5645a647f390 0x5645a6855d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:34.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.835+0000 7f78c77fe640 1 -- 172.21.15.5:0/367197219 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645a6856320 con 0x5645a645e9f0 2024-08-31T05:38:34.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.835+0000 7f78c77fe640 1 --2- 172.21.15.5:0/367197219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5645a645e9f0 0x5645a68592e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f78b80a7fb0 tx=0x7f78b80973e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bed183ffdf1ef8ec server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:34.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.835+0000 7f78a6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:38:34.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.835+0000 7f78a6ffd640 1 -- 172.21.15.5:0/367197219 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b80e8070 con 0x5645a645e9f0 2024-08-31T05:38:34.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.835+0000 7f78a6ffd640 1 -- 172.21.15.5:0/367197219 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7f78b8004210 con 0x5645a645e9f0 2024-08-31T05:38:34.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.835+0000 7f78d4641740 1 -- 172.21.15.5:0/367197219 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78bc043be0 con 0x5645a645e9f0 2024-08-31T05:38:34.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.835+0000 7f78a6ffd640 1 -- 172.21.15.5:0/367197219 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f78b808f050 con 0x5645a645e9f0 2024-08-31T05:38:34.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.835+0000 7f78d4641740 10 client.27410 fetch_fsmap learned FSMap version 34 2024-08-31T05:38:34.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.835+0000 7f78d4641740 1 -- 172.21.15.5:0/367197219 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5645a68ce230 con 0x5645a645e9f0 2024-08-31T05:38:34.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.835+0000 7f78a6ffd640 1 -- 172.21.15.5:0/367197219 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78bc043be0 con 0x5645a645e9f0 2024-08-31T05:38:34.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.836+0000 7f78a6ffd640 1 -- 172.21.15.5:0/367197219 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f78b80c6ce0 con 0x5645a645e9f0 2024-08-31T05:38:34.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.836+0000 7f78d4641740 10 client.27410 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:38:34.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.836+0000 7f78d4641740 10 client.27410 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:38:34.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.836+0000 7f78d4641740 20 client.27410 populate_metadata read hostname 'smithi005' 2024-08-31T05:38:34.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.836+0000 7f78d4641740 1 --2- 172.21.15.5:0/367197219 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5645a64a0070 0x5645a68d0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:34.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.836+0000 7f78d4641740 4 client.27410 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T05:38:34.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.836+0000 7f78d4641740 1 -- 172.21.15.5:0/367197219 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5645a67ba020 con 0x5645a64a0070 2024-08-31T05:38:34.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.836+0000 7f78c6ffd640 1 --2- 172.21.15.5:0/367197219 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5645a64a0070 0x5645a68d0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:34.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.837+0000 7f78a6ffd640 10 client.27410 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:38:34.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.837+0000 7f78c6ffd640 1 --2- 172.21.15.5:0/367197219 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5645a64a0070 0x5645a68d0770 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2dc6d197f8ba1031 server_cookie=383ee8bbf3483756 in_seq=0 out_seq=0 2024-08-31T05:38:34.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.837+0000 7f78a6ffd640 1 -- 172.21.15.5:0/367197219 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3214 (crc 0 0 0) 0x5645a67ba020 con 0x5645a64a0070 2024-08-31T05:38:34.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.837+0000 7f78a6ffd640 10 client.27410 handle_command_reply: tid=0 2024-08-31T05:38:34.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.837+0000 7f78d4641740 1 client.27410 shutdown 2024-08-31T05:38:34.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.837+0000 7f78d4641740 1 -- 172.21.15.5:0/367197219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5645a645e9f0 msgr2=0x5645a68592e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:34.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.837+0000 7f78d4641740 1 --2- 172.21.15.5:0/367197219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5645a645e9f0 0x5645a68592e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f78b80a7fb0 tx=0x7f78b80973e0 comp rx=0 tx=0).stop 2024-08-31T05:38:34.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.837+0000 7f78d4641740 1 -- 172.21.15.5:0/367197219 shutdown_connections 2024-08-31T05:38:34.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.837+0000 7f78d4641740 1 --2- 172.21.15.5:0/367197219 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5645a64a0070 0x5645a68d0770 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:34.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.837+0000 7f78d4641740 1 --2- 172.21.15.5:0/367197219 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5645a647f390 0x5645a6855d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:34.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.837+0000 7f78d4641740 1 --2- 172.21.15.5:0/367197219 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5645a64771b0 0x5645a68557f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:34.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.837+0000 7f78d4641740 1 --2- 172.21.15.5:0/367197219 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5645a645e9f0 0x5645a68592e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:34.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.837+0000 7f78d4641740 1 -- 172.21.15.5:0/367197219 >> 172.21.15.5:0/367197219 conn(0x5645a6494460 msgr2=0x5645a6851e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:34.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.837+0000 7f78a6ffd640 0 client.27410 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:38:34.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.838+0000 7f78d4641740 1 -- 172.21.15.5:0/367197219 shutdown_connections 2024-08-31T05:38:34.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.838+0000 7f78d4641740 1 -- 172.21.15.5:0/367197219 wait complete. 2024-08-31T05:38:34.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.838+0000 7f78d4641740 20 client.27410 trim_cache size 0 max 16384 2024-08-31T05:38:34.845 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:38:34.845 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "no active scrubs running", 2024-08-31T05:38:34.845 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": {}, 2024-08-31T05:38:34.845 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_stats": { 2024-08-31T05:38:34.845 INFO:teuthology.orchestra.run.smithi005.stdout: "94c23057-592d-4a8b-82d7-da2d84f8740b": { 2024-08-31T05:38:34.845 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:36:27.513638+0000", 2024-08-31T05:38:34.845 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:38:34.845 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:38:34.845 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:38:34.846 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:38:34.846 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:38:34.846 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:38:34.846 INFO:teuthology.orchestra.run.smithi005.stdout: "a4d4cf74-2477-4dd9-a3a2-3762b4dd87e4": { 2024-08-31T05:38:34.846 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:38:01.378833+0000", 2024-08-31T05:38:34.846 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:38:34.846 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:38:34.846 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:38:34.846 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:38:34.846 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:38:34.846 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:38:34.846 INFO:teuthology.orchestra.run.smithi005.stdout: "095ccc7a-f368-4bc6-9563-5930e21f9b4a": { 2024-08-31T05:38:34.846 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:35:40.190069+0000", 2024-08-31T05:38:34.846 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:38:34.847 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:38:34.847 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:38:34.847 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:38:34.847 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:38:34.847 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:38:34.847 INFO:teuthology.orchestra.run.smithi005.stdout: "297c26f3-7b4d-4245-abb0-f854248e5e1b": { 2024-08-31T05:38:34.847 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:37:14.019244+0000", 2024-08-31T05:38:34.847 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:38:34.847 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:38:34.847 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:38:34.847 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:38:34.848 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:38:34.848 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:38:34.848 INFO:teuthology.orchestra.run.smithi005.stdout: "de9731c7-ae4a-42fe-8146-e4752cdc40d4": { 2024-08-31T05:38:34.848 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:34:53.614499+0000", 2024-08-31T05:38:34.848 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:38:34.848 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:38:34.848 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:38:34.848 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:38:34.848 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:38:34.848 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:38:34.848 INFO:teuthology.orchestra.run.smithi005.stdout: "0bb67292-013a-40c7-b5fc-810bdd9715d8": { 2024-08-31T05:38:34.848 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:34:04.586008+0000", 2024-08-31T05:38:34.848 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:38:34.848 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:38:34.849 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:38:34.849 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:38:34.849 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:38:34.849 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:38:34.849 INFO:teuthology.orchestra.run.smithi005.stdout: "728a42ca-bbef-4151-830f-5fdd411d8fa0": { 2024-08-31T05:38:34.849 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:32:30.554906+0000", 2024-08-31T05:38:34.849 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:38:34.849 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:38:34.849 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:38:34.849 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:38:34.849 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:38:34.849 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:38:34.849 INFO:teuthology.orchestra.run.smithi005.stdout: "2445fc42-b797-434f-b380-e2da985b4d98": { 2024-08-31T05:38:34.849 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:33:17.681453+0000", 2024-08-31T05:38:34.850 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:38:34.850 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:38:34.850 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:38:34.850 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:38:34.850 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:38:34.850 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:38:34.850 INFO:teuthology.orchestra.run.smithi005.stdout: "cda92ac0-b35f-47a5-a3a5-471c888462a5": { 2024-08-31T05:38:34.850 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:53.103905+0000", 2024-08-31T05:38:34.850 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:38:34.850 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:38:34.850 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:38:34.850 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:38:34.850 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:38:34.850 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:38:34.851 INFO:teuthology.orchestra.run.smithi005.stdout: "ece37b07-9ab2-45f8-bc33-2755a07aac0b": { 2024-08-31T05:38:34.851 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:31:41.782407+0000", 2024-08-31T05:38:34.851 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:38:34.851 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:38:34.851 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:38:34.851 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:38:34.851 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:38:34.851 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:38:34.851 INFO:teuthology.orchestra.run.smithi005.stdout: "75d84398-5d9c-4872-b879-2fbce045fa71": { 2024-08-31T05:38:34.851 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:06.642335+0000", 2024-08-31T05:38:34.851 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:38:34.851 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:38:34.851 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:38:34.851 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:38:34.852 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:38:34.852 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:38:34.852 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:38:34.852 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:38:34.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.839+0000 7f78ce0cc640 1 -- 172.21.15.5:0/1897591005 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f78b00b4ca0 msgr2=0x7f78b00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:34.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.839+0000 7f78ce0cc640 1 --2- 172.21.15.5:0/1897591005 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f78b00b4ca0 0x7f78b00b71b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f78c0005c40 tx=0x7f78c0004ab0 comp rx=0 tx=0).stop 2024-08-31T05:38:34.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.839+0000 7f78ce0cc640 1 -- 172.21.15.5:0/1897591005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78c81039d0 msgr2=0x7f78c819c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:34.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.839+0000 7f78ce0cc640 1 --2- 172.21.15.5:0/1897591005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78c81039d0 0x7f78c819c4d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f78b800ea60 tx=0x7f78b800ef20 comp rx=0 tx=0).stop 2024-08-31T05:38:34.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.839+0000 7f78ce0cc640 1 -- 172.21.15.5:0/1897591005 shutdown_connections 2024-08-31T05:38:34.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.839+0000 7f78ce0cc640 1 --2- 172.21.15.5:0/1897591005 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f78b00b4ca0 0x7f78b00b71b0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:34.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.839+0000 7f78ce0cc640 1 --2- 172.21.15.5:0/1897591005 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f78c8109c60 0x7f78c81a1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:34.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.839+0000 7f78ce0cc640 1 --2- 172.21.15.5:0/1897591005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f78c8109310 0x7f78c819ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:34.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.839+0000 7f78ce0cc640 1 --2- 172.21.15.5:0/1897591005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78c81039d0 0x7f78c819c4d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:34.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.839+0000 7f78ce0cc640 1 -- 172.21.15.5:0/1897591005 >> 172.21.15.5:0/1897591005 conn(0x7f78c807b670 msgr2=0x7f78c8107120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:34.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.839+0000 7f78ce0cc640 1 -- 172.21.15.5:0/1897591005 shutdown_connections 2024-08-31T05:38:34.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:34.839+0000 7f78ce0cc640 1 -- 172.21.15.5:0/1897591005 wait complete. 2024-08-31T05:38:34.930 INFO:tasks.workunit.client.0.smithi005.stdout: 1 970983 11.29 MB/sec execute 322 sec latency 39.992 ms 2024-08-31T05:38:34.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:38:34 smithi005 ceph-mon[18602]: pgmap v607: 129 pgs: 129 active+clean; 520 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.6 MiB/s wr, 193 op/s 2024-08-31T05:38:35.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:38:34 smithi050 ceph-mon[22146]: pgmap v607: 129 pgs: 129 active+clean; 520 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.6 MiB/s wr, 193 op/s 2024-08-31T05:38:35.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:38:34 smithi070 ceph-mon[22316]: pgmap v607: 129 pgs: 129 active+clean; 520 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.6 MiB/s wr, 193 op/s 2024-08-31T05:38:35.678 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T05:38:35.679 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T05:38:35.930 INFO:tasks.workunit.client.0.smithi005.stdout: 1 973608 11.30 MB/sec execute 323 sec latency 16.959 ms 2024-08-31T05:38:35.997 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:38:36.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:36.768+0000 7f5049075640 1 -- 172.21.15.5:0/3538380202 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50441050a0 msgr2=0x7f504410d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:36.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:36.768+0000 7f5049075640 1 --2- 172.21.15.5:0/3538380202 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50441050a0 0x7f504410d5f0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f502c009900 tx=0x7f502c02a410 comp rx=0 tx=0).stop 2024-08-31T05:38:36.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:36.768+0000 7f5049075640 1 -- 172.21.15.5:0/3538380202 shutdown_connections 2024-08-31T05:38:36.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:36.768+0000 7f5049075640 1 --2- 172.21.15.5:0/3538380202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f504410dbb0 0x7f50441100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:36.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:36.768+0000 7f5049075640 1 --2- 172.21.15.5:0/3538380202 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f50441050a0 0x7f504410d5f0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:36.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:36.768+0000 7f5049075640 1 --2- 172.21.15.5:0/3538380202 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5044104750 0x7f5044104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:36.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:36.768+0000 7f5049075640 1 -- 172.21.15.5:0/3538380202 >> 172.21.15.5:0/3538380202 conn(0x7f50440794d0 msgr2=0x7f50440798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:36.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:36.768+0000 7f5049075640 1 -- 172.21.15.5:0/3538380202 shutdown_connections 2024-08-31T05:38:36.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:36.768+0000 7f5049075640 1 -- 172.21.15.5:0/3538380202 wait complete. 2024-08-31T05:38:36.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:36.769+0000 7f5049075640 1 Processor -- start 2024-08-31T05:38:36.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:36.769+0000 7f5049075640 1 -- start start 2024-08-31T05:38:36.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:36.770+0000 7f5049075640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5044104750 0x7f504419a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:36.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:36.770+0000 7f5049075640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50441050a0 0x7f504419a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:36.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:36.770+0000 7f5049075640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f504410dbb0 0x7f504419fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:36.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:36.770+0000 7f5049075640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f50441137f0 con 0x7f5044104750 2024-08-31T05:38:36.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:36.770+0000 7f5049075640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5044113670 con 0x7f50441050a0 2024-08-31T05:38:36.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:36.770+0000 7f5049075640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5044113970 con 0x7f504410dbb0 2024-08-31T05:38:36.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:36.770+0000 7f5042d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5044104750 0x7f504419a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:36.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:36.770+0000 7f5042d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5044104750 0x7f504419a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36882/0 (socket says 172.21.15.5:36882) 2024-08-31T05:38:36.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:36.770+0000 7f5042d9d640 1 -- 172.21.15.5:0/2248640483 learned_addr learned my addr 172.21.15.5:0/2248640483 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:36.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:36.770+0000 7f504259c640 1 --2- 172.21.15.5:0/2248640483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50441050a0 0x7f504419a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:36.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:36.770+0000 7f504359e640 1 --2- 172.21.15.5:0/2248640483 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f504410dbb0 0x7f504419fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:36.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:36.770+0000 7f5042d9d640 1 -- 172.21.15.5:0/2248640483 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f504410dbb0 msgr2=0x7f504419fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:36.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:36.770+0000 7f5042d9d640 1 --2- 172.21.15.5:0/2248640483 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f504410dbb0 0x7f504419fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:36.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:36.770+0000 7f5042d9d640 1 -- 172.21.15.5:0/2248640483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50441050a0 msgr2=0x7f504419a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:36.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:36.770+0000 7f5042d9d640 1 --2- 172.21.15.5:0/2248640483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50441050a0 0x7f504419a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:36.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:36.770+0000 7f5042d9d640 1 -- 172.21.15.5:0/2248640483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50441a0190 con 0x7f5044104750 2024-08-31T05:38:36.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:36.770+0000 7f5042d9d640 1 --2- 172.21.15.5:0/2248640483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5044104750 0x7f504419a220 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f503400eb70 tx=0x7f503400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:36.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:36.771+0000 7f503bfff640 1 -- 172.21.15.5:0/2248640483 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5034003b70 con 0x7f5044104750 2024-08-31T05:38:36.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:36.771+0000 7f503bfff640 1 -- 172.21.15.5:0/2248640483 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f503400ee70 con 0x7f5044104750 2024-08-31T05:38:36.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:36.771+0000 7f5049075640 1 -- 172.21.15.5:0/2248640483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50441a0480 con 0x7f5044104750 2024-08-31T05:38:36.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:36.771+0000 7f503bfff640 1 -- 172.21.15.5:0/2248640483 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5034010650 con 0x7f5044104750 2024-08-31T05:38:36.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:36.771+0000 7f5049075640 1 -- 172.21.15.5:0/2248640483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50441a6be0 con 0x7f5044104750 2024-08-31T05:38:36.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:36.772+0000 7f5049075640 1 -- 172.21.15.5:0/2248640483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f504406b300 con 0x7f5044104750 2024-08-31T05:38:36.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:36.774+0000 7f503bfff640 1 -- 172.21.15.5:0/2248640483 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f5034004a40 con 0x7f5044104750 2024-08-31T05:38:36.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:36.775+0000 7f503bfff640 1 --2- 172.21.15.5:0/2248640483 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f50300b4ca0 0x7f50300b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:36.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:36.775+0000 7f504259c640 1 --2- 172.21.15.5:0/2248640483 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f50300b4ca0 0x7f50300b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:36.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:36.775+0000 7f503bfff640 1 -- 172.21.15.5:0/2248640483 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7f50340e60a0 con 0x7f5044104750 2024-08-31T05:38:36.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:36.776+0000 7f504259c640 1 --2- 172.21.15.5:0/2248640483 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f50300b4ca0 0x7f50300b71b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f502c009230 tx=0x7f502c031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:36.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:36.778+0000 7f503bfff640 1 -- 172.21.15.5:0/2248640483 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f50340aca50 con 0x7f5044104750 2024-08-31T05:38:36.930 INFO:tasks.workunit.client.0.smithi005.stdout: 1 975154 11.28 MB/sec execute 324 sec latency 17.951 ms 2024-08-31T05:38:36.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:38:36 smithi005 ceph-mon[18602]: pgmap v608: 129 pgs: 129 active+clean; 525 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.5 MiB/s wr, 242 op/s 2024-08-31T05:38:37.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:37.011+0000 7f5049075640 1 -- 172.21.15.5:0/2248640483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5044104b60 con 0x7f5044104750 2024-08-31T05:38:37.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:37.012+0000 7f503bfff640 1 -- 172.21.15.5:0/2248640483 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11941 (secure 0 0 0) 0x7f5044104b60 con 0x7f5044104750 2024-08-31T05:38:37.015 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:38:37.015 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":34,"btime":"2024-08-31T05:33:43:289944+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14739,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2024812199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2024812199},{"type":"v1","addr":"172.21.15.5:6835","nonce":2024812199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3629023702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3629023702},{"type":"v1","addr":"172.21.15.5:6837","nonce":3629023702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T05:27:31.929153+0000","modified":"2024-08-31T05:33:42.378207+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24652,"mds_1":24638,"mds_2":24631,"mds_3":24625,"mds_4":24602},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6839/2412701258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":2412701258},{"type":"v1","addr":"172.21.15.5:6839","nonce":2412701258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14820":{"gid":14820,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6841/747057838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":747057838},{"type":"v1","addr":"172.21.15.5:6841","nonce":747057838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6833/1153378982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1153378982},{"type":"v1","addr":"172.21.15.50:6833","nonce":1153378982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6833/364083443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":364083443},{"type":"v1","addr":"172.21.15.70:6833","nonce":364083443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24587":{"gid":24587,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/2346896794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2346896794},{"type":"v1","addr":"172.21.15.50:6835","nonce":2346896794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24602":{"gid":24602,"name":"h","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.50:6837/428759669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":428759669},{"type":"v1","addr":"172.21.15.50:6837","nonce":428759669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.70:6835/2061504114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2061504114},{"type":"v1","addr":"172.21.15.70:6835","nonce":2061504114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.70:6837/2780036414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2780036414},{"type":"v1","addr":"172.21.15.70:6837","nonce":2780036414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.50:6839/98200944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":98200944},{"type":"v1","addr":"172.21.15.50:6839","nonce":98200944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24652":{"gid":24652,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.70:6839/2756569250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":2756569250},{"type":"v1","addr":"172.21.15.70:6839","nonce":2756569250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24652,"qdb_cluster":[24652,24631,24638,24625,24602]},"id":1}]} 2024-08-31T05:38:37.015 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 34 2024-08-31T05:38:37.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:37.015+0000 7f5049075640 1 -- 172.21.15.5:0/2248640483 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f50300b4ca0 msgr2=0x7f50300b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:37.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:37.015+0000 7f5049075640 1 --2- 172.21.15.5:0/2248640483 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f50300b4ca0 0x7f50300b71b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f502c009230 tx=0x7f502c031400 comp rx=0 tx=0).stop 2024-08-31T05:38:37.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:37.015+0000 7f5049075640 1 -- 172.21.15.5:0/2248640483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5044104750 msgr2=0x7f504419a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:37.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:37.015+0000 7f5049075640 1 --2- 172.21.15.5:0/2248640483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5044104750 0x7f504419a220 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f503400eb70 tx=0x7f503400c6a0 comp rx=0 tx=0).stop 2024-08-31T05:38:37.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:37.015+0000 7f5049075640 1 -- 172.21.15.5:0/2248640483 shutdown_connections 2024-08-31T05:38:37.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:37.015+0000 7f5049075640 1 --2- 172.21.15.5:0/2248640483 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f50300b4ca0 0x7f50300b71b0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:37.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:37.015+0000 7f5049075640 1 --2- 172.21.15.5:0/2248640483 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f504410dbb0 0x7f504419fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:37.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:37.015+0000 7f5049075640 1 --2- 172.21.15.5:0/2248640483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f50441050a0 0x7f504419a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:37.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:37.015+0000 7f5049075640 1 --2- 172.21.15.5:0/2248640483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5044104750 0x7f504419a220 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:37.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:37.015+0000 7f5049075640 1 -- 172.21.15.5:0/2248640483 >> 172.21.15.5:0/2248640483 conn(0x7f50440794d0 msgr2=0x7f50441005c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:37.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:37.015+0000 7f5049075640 1 -- 172.21.15.5:0/2248640483 shutdown_connections 2024-08-31T05:38:37.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:37.015+0000 7f5049075640 1 -- 172.21.15.5:0/2248640483 wait complete. 2024-08-31T05:38:37.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:38:36 smithi050 ceph-mon[22146]: pgmap v608: 129 pgs: 129 active+clean; 525 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.5 MiB/s wr, 242 op/s 2024-08-31T05:38:37.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:38:36 smithi070 ceph-mon[22316]: pgmap v608: 129 pgs: 129 active+clean; 525 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.5 MiB/s wr, 242 op/s 2024-08-31T05:38:37.726 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-31T05:38:37.930 INFO:tasks.workunit.client.0.smithi005.stdout: 1 977571 11.29 MB/sec execute 325 sec latency 15.298 ms 2024-08-31T05:38:37.991 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:38:38.112 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:38:37 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/2248640483' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:38:38.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:38:37 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/2248640483' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:38:38.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:38:37 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/2248640483' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:38:38.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.523+0000 7fcb65e5e640 1 -- 172.21.15.5:0/372611434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb60109270 msgr2=0x7fcb60109680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:38.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.523+0000 7fcb65e5e640 1 --2- 172.21.15.5:0/372611434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb60109270 0x7fcb60109680 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fcb48009900 tx=0x7fcb4802a410 comp rx=0 tx=0).stop 2024-08-31T05:38:38.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.523+0000 7fcb65e5e640 1 -- 172.21.15.5:0/372611434 shutdown_connections 2024-08-31T05:38:38.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.523+0000 7fcb65e5e640 1 --2- 172.21.15.5:0/372611434 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb60109bc0 0x7fcb601103f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:38.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.523+0000 7fcb65e5e640 1 --2- 172.21.15.5:0/372611434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb60109270 0x7fcb60109680 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:38.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.523+0000 7fcb65e5e640 1 --2- 172.21.15.5:0/372611434 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb60103930 0x7fcb60103d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:38.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.523+0000 7fcb65e5e640 1 -- 172.21.15.5:0/372611434 >> 172.21.15.5:0/372611434 conn(0x7fcb600ff3a0 msgr2=0x7fcb601017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:38.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.523+0000 7fcb65e5e640 1 -- 172.21.15.5:0/372611434 shutdown_connections 2024-08-31T05:38:38.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.523+0000 7fcb65e5e640 1 -- 172.21.15.5:0/372611434 wait complete. 2024-08-31T05:38:38.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.524+0000 7fcb65e5e640 1 Processor -- start 2024-08-31T05:38:38.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.524+0000 7fcb65e5e640 1 -- start start 2024-08-31T05:38:38.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.524+0000 7fcb65e5e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb60103930 0x7fcb6019c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:38.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.524+0000 7fcb65e5e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb60109270 0x7fcb6019ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:38.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.524+0000 7fcb65e5e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb60109bc0 0x7fcb601a1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:38.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.524+0000 7fcb65e5e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fcb60113880 con 0x7fcb60109bc0 2024-08-31T05:38:38.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.524+0000 7fcb65e5e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcb60113700 con 0x7fcb60109270 2024-08-31T05:38:38.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.524+0000 7fcb65e5e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcb60113a00 con 0x7fcb60103930 2024-08-31T05:38:38.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.524+0000 7fcb5ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb60109bc0 0x7fcb601a1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:38.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.524+0000 7fcb56ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb60109270 0x7fcb6019ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:38.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.524+0000 7fcb5ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb60109bc0 0x7fcb601a1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36890/0 (socket says 172.21.15.5:36890) 2024-08-31T05:38:38.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.524+0000 7fcb5ffff640 1 -- 172.21.15.5:0/1853486156 learned_addr learned my addr 172.21.15.5:0/1853486156 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:38.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.524+0000 7fcb5f7fe640 1 --2- 172.21.15.5:0/1853486156 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb60103930 0x7fcb6019c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:38.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.525+0000 7fcb5ffff640 1 -- 172.21.15.5:0/1853486156 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb60103930 msgr2=0x7fcb6019c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:38.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.525+0000 7fcb5ffff640 1 --2- 172.21.15.5:0/1853486156 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb60103930 0x7fcb6019c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:38.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.525+0000 7fcb5ffff640 1 -- 172.21.15.5:0/1853486156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb60109270 msgr2=0x7fcb6019ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:38.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.525+0000 7fcb5ffff640 1 --2- 172.21.15.5:0/1853486156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb60109270 0x7fcb6019ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:38.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.525+0000 7fcb5ffff640 1 -- 172.21.15.5:0/1853486156 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb601a2420 con 0x7fcb60109bc0 2024-08-31T05:38:38.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.525+0000 7fcb56ffd640 1 --2- 172.21.15.5:0/1853486156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb60109270 0x7fcb6019ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:38:38.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.525+0000 7fcb5ffff640 1 --2- 172.21.15.5:0/1853486156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb60109bc0 0x7fcb601a1cf0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fcb5800efd0 tx=0x7fcb5800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:38.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.525+0000 7fcb5d7fa640 1 -- 172.21.15.5:0/1853486156 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb58003b70 con 0x7fcb60109bc0 2024-08-31T05:38:38.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.525+0000 7fcb5d7fa640 1 -- 172.21.15.5:0/1853486156 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb58003d10 con 0x7fcb60109bc0 2024-08-31T05:38:38.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.525+0000 7fcb65e5e640 1 -- 172.21.15.5:0/1853486156 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb601a2710 con 0x7fcb60109bc0 2024-08-31T05:38:38.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.525+0000 7fcb5d7fa640 1 -- 172.21.15.5:0/1853486156 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb580108a0 con 0x7fcb60109bc0 2024-08-31T05:38:38.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.525+0000 7fcb65e5e640 1 -- 172.21.15.5:0/1853486156 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb601a8e70 con 0x7fcb60109bc0 2024-08-31T05:38:38.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.528+0000 7fcb6c3d3740 1 Processor -- start 2024-08-31T05:38:38.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.528+0000 7fcb5d7fa640 1 -- 172.21.15.5:0/1853486156 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fcb58004020 con 0x7fcb60109bc0 2024-08-31T05:38:38.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.528+0000 7fcb6c3d3740 1 -- start start 2024-08-31T05:38:38.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.529+0000 7fcb6c3d3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558fd8d7e070 0x558fd9123310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:38.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.529+0000 7fcb6c3d3740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558fd8d551b0 0x558fd9123850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:38.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.529+0000 7fcb6c3d3740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558fd8d5d390 0x558fd9123d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:38.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.529+0000 7fcb6c3d3740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x558fd909a680 con 0x558fd8d5d390 2024-08-31T05:38:38.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.529+0000 7fcb6c3d3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558fd9089c10 con 0x558fd8d7e070 2024-08-31T05:38:38.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.529+0000 7fcb6c3d3740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558fd908dbc0 con 0x558fd8d551b0 2024-08-31T05:38:38.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.529+0000 7fcb56ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558fd8d5d390 0x558fd9123d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:38.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.529+0000 7fcb5f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558fd8d551b0 0x558fd9123850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:38.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.529+0000 7fcb56ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558fd8d5d390 0x558fd9123d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36896/0 (socket says 172.21.15.5:36896) 2024-08-31T05:38:38.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.529+0000 7fcb5f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558fd8d551b0 0x558fd9123850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:39952/0 (socket says 172.21.15.5:39952) 2024-08-31T05:38:38.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.529+0000 7fcb56ffd640 1 -- 172.21.15.5:0/3048021630 learned_addr learned my addr 172.21.15.5:0/3048021630 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:38.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.529+0000 7fcb5f7fe640 1 -- 172.21.15.5:0/3048021630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558fd8d7e070 msgr2=0x558fd9123310 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T05:38:38.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.529+0000 7fcb5f7fe640 1 --2- 172.21.15.5:0/3048021630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558fd8d7e070 0x558fd9123310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:38.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.529+0000 7fcb5f7fe640 1 -- 172.21.15.5:0/3048021630 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558fd8d5d390 msgr2=0x558fd9123d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:38.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.530+0000 7fcb5f7fe640 1 --2- 172.21.15.5:0/3048021630 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558fd8d5d390 0x558fd9123d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:38.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.530+0000 7fcb5f7fe640 1 -- 172.21.15.5:0/3048021630 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fd8de9650 con 0x558fd8d551b0 2024-08-31T05:38:38.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.530+0000 7fcb56ffd640 1 --2- 172.21.15.5:0/3048021630 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558fd8d5d390 0x558fd9123d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:38:38.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.530+0000 7fcb5d7fa640 1 --2- 172.21.15.5:0/1853486156 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fcb4c0b4ca0 0x7fcb4c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:38.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.530+0000 7fcb56ffd640 1 --2- 172.21.15.5:0/1853486156 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fcb4c0b4ca0 0x7fcb4c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:38.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.530+0000 7fcb5d7fa640 1 -- 172.21.15.5:0/1853486156 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7fcb580e5d50 con 0x7fcb60109bc0 2024-08-31T05:38:38.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.530+0000 7fcb5f7fe640 1 --2- 172.21.15.5:0/3048021630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558fd8d551b0 0x558fd9123850 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fcb50009c00 tx=0x7fcb50011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd6e01740c8dd8ad server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:38.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.530+0000 7fcb55ffb640 1 -- 172.21.15.5:0/3048021630 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb50004230 con 0x558fd8d551b0 2024-08-31T05:38:38.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.530+0000 7fcb55ffb640 1 -- 172.21.15.5:0/3048021630 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb500043d0 con 0x558fd8d551b0 2024-08-31T05:38:38.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.530+0000 7fcb55ffb640 1 -- 172.21.15.5:0/3048021630 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb50004c30 con 0x558fd8d551b0 2024-08-31T05:38:38.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.531+0000 7fcb6c3d3740 1 -- 172.21.15.5:0/3048021630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558fd8d551b0 msgr2=0x558fd9123850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:38.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.531+0000 7fcb6c3d3740 1 --2- 172.21.15.5:0/3048021630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558fd8d551b0 0x558fd9123850 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fcb50009c00 tx=0x7fcb50011810 comp rx=0 tx=0).stop 2024-08-31T05:38:38.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.531+0000 7fcb56ffd640 1 --2- 172.21.15.5:0/1853486156 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fcb4c0b4ca0 0x7fcb4c0b71b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fcb480096c0 tx=0x7fcb48031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:38.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.531+0000 7fcb6c3d3740 1 -- 172.21.15.5:0/3048021630 shutdown_connections 2024-08-31T05:38:38.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.531+0000 7fcb6c3d3740 1 --2- 172.21.15.5:0/3048021630 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558fd8d5d390 0x558fd9123d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:38.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.531+0000 7fcb6c3d3740 1 --2- 172.21.15.5:0/3048021630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558fd8d551b0 0x558fd9123850 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:38.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.531+0000 7fcb6c3d3740 1 --2- 172.21.15.5:0/3048021630 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558fd8d7e070 0x558fd9123310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:38.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.531+0000 7fcb6c3d3740 1 -- 172.21.15.5:0/3048021630 >> 172.21.15.5:0/3048021630 conn(0x558fd8d72460 msgr2=0x558fd9121200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:38.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.531+0000 7fcb6c3d3740 1 -- 172.21.15.5:0/3048021630 shutdown_connections 2024-08-31T05:38:38.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.531+0000 7fcb6c3d3740 1 -- 172.21.15.5:0/3048021630 wait complete. 2024-08-31T05:38:38.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.532+0000 7fcb6c3d3740 1 -- start start 2024-08-31T05:38:38.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.532+0000 7fcb6c3d3740 1 Processor -- start 2024-08-31T05:38:38.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.532+0000 7fcb6c3d3740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558fd8d551b0 0x558fd912ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:38.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.532+0000 7fcb6c3d3740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558fd8d5d390 0x558fd912efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:38.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.532+0000 7fcb6c3d3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558fd8d7e070 0x558fd913ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:38.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.532+0000 7fcb6c3d3740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x558fd8eec700 con 0x558fd8d5d390 2024-08-31T05:38:38.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.532+0000 7fcb6c3d3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558fd9010750 con 0x558fd8d7e070 2024-08-31T05:38:38.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.532+0000 7fcb6c3d3740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558fd9131af0 con 0x558fd8d551b0 2024-08-31T05:38:38.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.533+0000 7fcb6c3d3740 10 client.0 _ll_register_callbacks cb 0x558fd903fe10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:38:38.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.533+0000 7fcb56ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558fd8d5d390 0x558fd912efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:38.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.533+0000 7fcb5ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558fd8d7e070 0x558fd913ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:38.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.533+0000 7fcb56ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558fd8d5d390 0x558fd912efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36898/0 (socket says 172.21.15.5:36898) 2024-08-31T05:38:38.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.533+0000 7fcb5f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558fd8d551b0 0x558fd912ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:38.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.533+0000 7fcb56ffd640 1 -- 172.21.15.5:0/461936293 learned_addr learned my addr 172.21.15.5:0/461936293 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:38.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.533+0000 7fcb5ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558fd8d7e070 0x558fd913ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:51900/0 (socket says 172.21.15.5:51900) 2024-08-31T05:38:38.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.533+0000 7fcb56ffd640 1 -- 172.21.15.5:0/461936293 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558fd8d551b0 msgr2=0x558fd912ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:38.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.533+0000 7fcb56ffd640 1 --2- 172.21.15.5:0/461936293 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558fd8d551b0 0x558fd912ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:38.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.533+0000 7fcb56ffd640 1 -- 172.21.15.5:0/461936293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558fd8d7e070 msgr2=0x558fd913ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:38.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.533+0000 7fcb56ffd640 1 --2- 172.21.15.5:0/461936293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558fd8d7e070 0x558fd913ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:38.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.533+0000 7fcb56ffd640 1 -- 172.21.15.5:0/461936293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558fd9049900 con 0x558fd8d5d390 2024-08-31T05:38:38.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.533+0000 7fcb5ffff640 1 --2- 172.21.15.5:0/461936293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558fd8d7e070 0x558fd913ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:38:38.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.533+0000 7fcb56ffd640 1 --2- 172.21.15.5:0/461936293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558fd8d5d390 0x558fd912efb0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fcb48032fa0 tx=0x7fcb4802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb67d224cc8e7b1e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:38.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.533+0000 7fcb3effd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:38:38.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.533+0000 7fcb3effd640 1 -- 172.21.15.5:0/461936293 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb48035040 con 0x558fd8d5d390 2024-08-31T05:38:38.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.533+0000 7fcb6c3d3740 1 -- 172.21.15.5:0/461936293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb500043d0 con 0x558fd8d5d390 2024-08-31T05:38:38.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.533+0000 7fcb3effd640 1 -- 172.21.15.5:0/461936293 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7fcb48005240 con 0x558fd8d5d390 2024-08-31T05:38:38.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.534+0000 7fcb3effd640 1 -- 172.21.15.5:0/461936293 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fcb48005440 con 0x558fd8d5d390 2024-08-31T05:38:38.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.534+0000 7fcb6c3d3740 10 client.17850 fetch_fsmap learned FSMap version 34 2024-08-31T05:38:38.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.534+0000 7fcb6c3d3740 1 -- 172.21.15.5:0/461936293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x558fd913d920 con 0x558fd8d5d390 2024-08-31T05:38:38.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.534+0000 7fcb3effd640 1 -- 172.21.15.5:0/461936293 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb500043d0 con 0x558fd8d5d390 2024-08-31T05:38:38.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.534+0000 7fcb3effd640 1 -- 172.21.15.5:0/461936293 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fcb48044030 con 0x558fd8d5d390 2024-08-31T05:38:38.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.534+0000 7fcb6c3d3740 10 client.17850 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:38:38.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.534+0000 7fcb6c3d3740 10 client.17850 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-31T05:38:38.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.534+0000 7fcb6c3d3740 20 client.17850 populate_metadata read hostname 'smithi005' 2024-08-31T05:38:38.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.534+0000 7fcb6c3d3740 1 --2- 172.21.15.5:0/461936293 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x558fd8d3c9f0 0x558fd9140de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:38.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.534+0000 7fcb6c3d3740 4 client.17850 mds_command: new command op to 24602 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:38:38.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.534+0000 7fcb6c3d3740 1 -- 172.21.15.5:0/461936293 --> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558fd909c5d0 con 0x558fd8d3c9f0 2024-08-31T05:38:38.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.534+0000 7fcb5f7fe640 1 --2- 172.21.15.5:0/461936293 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x558fd8d3c9f0 0x558fd9140de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:38.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.535+0000 7fcb5f7fe640 1 --2- 172.21.15.5:0/461936293 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x558fd8d3c9f0 0x558fd9140de0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b7ef865cbd00b48 server_cookie=b550da0648f3208e in_seq=0 out_seq=0 2024-08-31T05:38:38.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.535+0000 7fcb3effd640 10 client.17850 ms_handle_connect on v2:172.21.15.50:6836/428759669 2024-08-31T05:38:38.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.535+0000 7fcb3effd640 1 -- 172.21.15.5:0/461936293 <== mds.4 v2:172.21.15.50:6836/428759669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558fd909c5d0 con 0x558fd8d3c9f0 2024-08-31T05:38:38.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.535+0000 7fcb3effd640 10 client.17850 handle_command_reply: tid=0 2024-08-31T05:38:38.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.535+0000 7fcb6c3d3740 1 client.17850 shutdown 2024-08-31T05:38:38.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.536+0000 7fcb6c3d3740 1 -- 172.21.15.5:0/461936293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558fd8d5d390 msgr2=0x558fd912efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:38.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.536+0000 7fcb6c3d3740 1 --2- 172.21.15.5:0/461936293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558fd8d5d390 0x558fd912efb0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fcb48032fa0 tx=0x7fcb4802a410 comp rx=0 tx=0).stop 2024-08-31T05:38:38.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.536+0000 7fcb6c3d3740 1 -- 172.21.15.5:0/461936293 shutdown_connections 2024-08-31T05:38:38.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.536+0000 7fcb6c3d3740 1 --2- 172.21.15.5:0/461936293 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x558fd8d3c9f0 0x558fd9140de0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:38.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.536+0000 7fcb6c3d3740 1 --2- 172.21.15.5:0/461936293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558fd8d7e070 0x558fd913ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:38.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.536+0000 7fcb6c3d3740 1 --2- 172.21.15.5:0/461936293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558fd8d5d390 0x558fd912efb0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:38.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.536+0000 7fcb6c3d3740 1 --2- 172.21.15.5:0/461936293 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558fd8d551b0 0x558fd912ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:38.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.536+0000 7fcb3effd640 0 client.17850 ms_handle_reset on v2:172.21.15.50:6836/428759669 2024-08-31T05:38:38.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.536+0000 7fcb6c3d3740 1 -- 172.21.15.5:0/461936293 >> 172.21.15.5:0/461936293 conn(0x558fd8d72460 msgr2=0x558fd91264a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:38.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.536+0000 7fcb6c3d3740 1 -- 172.21.15.5:0/461936293 shutdown_connections 2024-08-31T05:38:38.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.536+0000 7fcb6c3d3740 1 -- 172.21.15.5:0/461936293 wait complete. 2024-08-31T05:38:38.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.536+0000 7fcb6c3d3740 20 client.17850 trim_cache size 0 max 16384 2024-08-31T05:38:38.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.551+0000 7fcb6c3d3740 1 Processor -- start 2024-08-31T05:38:38.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.551+0000 7fcb6c3d3740 1 -- start start 2024-08-31T05:38:38.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.551+0000 7fcb6c3d3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558fd8d551b0 0x558fd9124a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:38.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.551+0000 7fcb6c3d3740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558fd8d5d390 0x558fd913ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:38.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.551+0000 7fcb6c3d3740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558fd8d7e070 0x558fd912bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:38.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.551+0000 7fcb6c3d3740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fcb601b2e80 con 0x558fd8d7e070 2024-08-31T05:38:38.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.551+0000 7fcb6c3d3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcb601b49c0 con 0x558fd8d551b0 2024-08-31T05:38:38.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.551+0000 7fcb6c3d3740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcb601b3550 con 0x558fd8d5d390 2024-08-31T05:38:38.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.551+0000 7fcb5ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558fd8d7e070 0x558fd912bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:38.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.551+0000 7fcb5f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558fd8d551b0 0x558fd9124a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:38.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.551+0000 7fcb56ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558fd8d5d390 0x558fd913ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:38.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.551+0000 7fcb5f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558fd8d551b0 0x558fd9124a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:51914/0 (socket says 172.21.15.5:51914) 2024-08-31T05:38:38.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.551+0000 7fcb5f7fe640 1 -- 172.21.15.5:0/4187144410 learned_addr learned my addr 172.21.15.5:0/4187144410 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:38.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.551+0000 7fcb56ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558fd8d5d390 0x558fd913ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:39968/0 (socket says 172.21.15.5:39968) 2024-08-31T05:38:38.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.551+0000 7fcb5ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558fd8d7e070 0x558fd912bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36914/0 (socket says 172.21.15.5:36914) 2024-08-31T05:38:38.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.552+0000 7fcb5f7fe640 1 -- 172.21.15.5:0/4187144410 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558fd8d5d390 msgr2=0x558fd913ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:38.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.552+0000 7fcb5f7fe640 1 --2- 172.21.15.5:0/4187144410 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558fd8d5d390 0x558fd913ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:38.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.552+0000 7fcb5f7fe640 1 -- 172.21.15.5:0/4187144410 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558fd8d7e070 msgr2=0x558fd912bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:38.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.552+0000 7fcb5f7fe640 1 --2- 172.21.15.5:0/4187144410 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558fd8d7e070 0x558fd912bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:38.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.552+0000 7fcb5f7fe640 1 -- 172.21.15.5:0/4187144410 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fd9125600 con 0x558fd8d551b0 2024-08-31T05:38:38.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.552+0000 7fcb5f7fe640 1 --2- 172.21.15.5:0/4187144410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558fd8d551b0 0x558fd9124a50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fcb50011d10 tx=0x7fcb500046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17a14f9f605ffc7f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:38.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.552+0000 7fcb557fa640 1 -- 172.21.15.5:0/4187144410 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb50032070 con 0x558fd8d551b0 2024-08-31T05:38:38.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.552+0000 7fcb557fa640 1 -- 172.21.15.5:0/4187144410 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb5001f040 con 0x558fd8d551b0 2024-08-31T05:38:38.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.552+0000 7fcb557fa640 1 -- 172.21.15.5:0/4187144410 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb5001e040 con 0x558fd8d551b0 2024-08-31T05:38:38.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.553+0000 7fcb6c3d3740 1 -- 172.21.15.5:0/4187144410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558fd8d551b0 msgr2=0x558fd9124a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:38.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.553+0000 7fcb6c3d3740 1 --2- 172.21.15.5:0/4187144410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558fd8d551b0 0x558fd9124a50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fcb50011d10 tx=0x7fcb500046c0 comp rx=0 tx=0).stop 2024-08-31T05:38:38.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.553+0000 7fcb6c3d3740 1 -- 172.21.15.5:0/4187144410 shutdown_connections 2024-08-31T05:38:38.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.553+0000 7fcb6c3d3740 1 --2- 172.21.15.5:0/4187144410 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558fd8d7e070 0x558fd912bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:38.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.553+0000 7fcb6c3d3740 1 --2- 172.21.15.5:0/4187144410 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558fd8d5d390 0x558fd913ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:38.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.553+0000 7fcb6c3d3740 1 --2- 172.21.15.5:0/4187144410 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558fd8d551b0 0x558fd9124a50 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:38.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.553+0000 7fcb6c3d3740 1 -- 172.21.15.5:0/4187144410 >> 172.21.15.5:0/4187144410 conn(0x558fd8d72460 msgr2=0x558fd9124340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:38.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.553+0000 7fcb6c3d3740 1 -- 172.21.15.5:0/4187144410 shutdown_connections 2024-08-31T05:38:38.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.553+0000 7fcb6c3d3740 1 -- 172.21.15.5:0/4187144410 wait complete. 2024-08-31T05:38:38.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.553+0000 7fcb6c3d3740 1 -- start start 2024-08-31T05:38:38.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.554+0000 7fcb6c3d3740 1 Processor -- start 2024-08-31T05:38:38.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.554+0000 7fcb6c3d3740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558fd8d551b0 0x558fd91330f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:38.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.554+0000 7fcb6c3d3740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558fd8d5d390 0x558fd9133630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:38.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.554+0000 7fcb6c3d3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558fd8d7e070 0x558fd91aa7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:38.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.554+0000 7fcb6c3d3740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fcb601b42f0 con 0x558fd8d5d390 2024-08-31T05:38:38.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.554+0000 7fcb6c3d3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcb601b3c20 con 0x558fd8d7e070 2024-08-31T05:38:38.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.554+0000 7fcb6c3d3740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcb601b0e80 con 0x558fd8d551b0 2024-08-31T05:38:38.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.554+0000 7fcb6c3d3740 10 client.0 _ll_register_callbacks cb 0x7fcb48009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:38:38.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.554+0000 7fcb56ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558fd8d5d390 0x558fd9133630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:38.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.554+0000 7fcb5f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558fd8d551b0 0x558fd91330f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:38.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.554+0000 7fcb56ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558fd8d5d390 0x558fd9133630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36924/0 (socket says 172.21.15.5:36924) 2024-08-31T05:38:38.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.554+0000 7fcb56ffd640 1 -- 172.21.15.5:0/3567190415 learned_addr learned my addr 172.21.15.5:0/3567190415 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:38.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.554+0000 7fcb5ffff640 1 --2- 172.21.15.5:0/3567190415 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558fd8d7e070 0x558fd91aa7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:38.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.555+0000 7fcb5f7fe640 1 -- 172.21.15.5:0/3567190415 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558fd8d7e070 msgr2=0x558fd91aa7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:38.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.555+0000 7fcb5f7fe640 1 --2- 172.21.15.5:0/3567190415 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558fd8d7e070 0x558fd91aa7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:38.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.555+0000 7fcb5f7fe640 1 -- 172.21.15.5:0/3567190415 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558fd8d5d390 msgr2=0x558fd9133630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:38.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.555+0000 7fcb5f7fe640 1 --2- 172.21.15.5:0/3567190415 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558fd8d5d390 0x558fd9133630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:38.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.555+0000 7fcb5f7fe640 1 -- 172.21.15.5:0/3567190415 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558fd91aace0 con 0x558fd8d551b0 2024-08-31T05:38:38.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.555+0000 7fcb56ffd640 1 --2- 172.21.15.5:0/3567190415 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558fd8d5d390 0x558fd9133630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:38:38.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.555+0000 7fcb5f7fe640 1 --2- 172.21.15.5:0/3567190415 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558fd8d551b0 0x558fd91330f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fcb50011d10 tx=0x7fcb50009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6c1025918010160 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:38.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.555+0000 7fcb3effd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:38:38.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.555+0000 7fcb3effd640 1 -- 172.21.15.5:0/3567190415 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb5003a060 con 0x558fd8d551b0 2024-08-31T05:38:38.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.555+0000 7fcb6c3d3740 1 -- 172.21.15.5:0/3567190415 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb5001f040 con 0x558fd8d551b0 2024-08-31T05:38:38.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.555+0000 7fcb3effd640 1 -- 172.21.15.5:0/3567190415 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7fcb50004450 con 0x558fd8d551b0 2024-08-31T05:38:38.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.555+0000 7fcb3effd640 1 -- 172.21.15.5:0/3567190415 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fcb50032070 con 0x558fd8d551b0 2024-08-31T05:38:38.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.555+0000 7fcb6c3d3740 10 client.27439 fetch_fsmap learned FSMap version 34 2024-08-31T05:38:38.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.555+0000 7fcb6c3d3740 1 -- 172.21.15.5:0/3567190415 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x558fd91abdd0 con 0x558fd8d551b0 2024-08-31T05:38:38.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.556+0000 7fcb3effd640 1 -- 172.21.15.5:0/3567190415 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb5001f040 con 0x558fd8d551b0 2024-08-31T05:38:38.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.556+0000 7fcb3effd640 1 -- 172.21.15.5:0/3567190415 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fcb5002d040 con 0x558fd8d551b0 2024-08-31T05:38:38.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.556+0000 7fcb6c3d3740 10 client.27439 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:38:38.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.556+0000 7fcb6c3d3740 10 client.27439 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-31T05:38:38.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.556+0000 7fcb6c3d3740 20 client.27439 populate_metadata read hostname 'smithi005' 2024-08-31T05:38:38.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.556+0000 7fcb6c3d3740 1 --2- 172.21.15.5:0/3567190415 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x558fd8d11da0 0x558fd91ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:38.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.556+0000 7fcb6c3d3740 4 client.27439 mds_command: new command op to 24602 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:38:38.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.556+0000 7fcb6c3d3740 1 -- 172.21.15.5:0/3567190415 --> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558fd9098070 con 0x558fd8d11da0 2024-08-31T05:38:38.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.556+0000 7fcb56ffd640 1 --2- 172.21.15.5:0/3567190415 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x558fd8d11da0 0x558fd91ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:38.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.556+0000 7fcb3effd640 10 client.27439 ms_handle_connect on v2:172.21.15.50:6836/428759669 2024-08-31T05:38:38.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.557+0000 7fcb56ffd640 1 --2- 172.21.15.5:0/3567190415 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x558fd8d11da0 0x558fd91ae2c0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9dfa5535c3f9b133 server_cookie=1a8a32de63faecb1 in_seq=0 out_seq=0 2024-08-31T05:38:38.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.557+0000 7fcb3effd640 1 -- 172.21.15.5:0/3567190415 <== mds.4 v2:172.21.15.50:6836/428759669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558fd9098070 con 0x558fd8d11da0 2024-08-31T05:38:38.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.557+0000 7fcb3effd640 10 client.27439 handle_command_reply: tid=0 2024-08-31T05:38:38.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.557+0000 7fcb6c3d3740 1 client.27439 shutdown 2024-08-31T05:38:38.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.557+0000 7fcb6c3d3740 1 -- 172.21.15.5:0/3567190415 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558fd8d551b0 msgr2=0x558fd91330f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:38.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.557+0000 7fcb6c3d3740 1 --2- 172.21.15.5:0/3567190415 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558fd8d551b0 0x558fd91330f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fcb50011d10 tx=0x7fcb50009b90 comp rx=0 tx=0).stop 2024-08-31T05:38:38.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.557+0000 7fcb6c3d3740 1 -- 172.21.15.5:0/3567190415 shutdown_connections 2024-08-31T05:38:38.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.557+0000 7fcb6c3d3740 1 --2- 172.21.15.5:0/3567190415 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x558fd8d11da0 0x558fd91ae2c0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:38.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.557+0000 7fcb6c3d3740 1 --2- 172.21.15.5:0/3567190415 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558fd8d7e070 0x558fd91aa7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:38.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.557+0000 7fcb6c3d3740 1 --2- 172.21.15.5:0/3567190415 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558fd8d5d390 0x558fd9133630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:38.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.557+0000 7fcb3effd640 0 client.27439 ms_handle_reset on v2:172.21.15.50:6836/428759669 2024-08-31T05:38:38.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.557+0000 7fcb6c3d3740 1 --2- 172.21.15.5:0/3567190415 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558fd8d551b0 0x558fd91330f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:38.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.557+0000 7fcb6c3d3740 1 -- 172.21.15.5:0/3567190415 >> 172.21.15.5:0/3567190415 conn(0x558fd8d72460 msgr2=0x558fd9121170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:38.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.557+0000 7fcb6c3d3740 1 -- 172.21.15.5:0/3567190415 shutdown_connections 2024-08-31T05:38:38.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.557+0000 7fcb6c3d3740 1 -- 172.21.15.5:0/3567190415 wait complete. 2024-08-31T05:38:38.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.557+0000 7fcb6c3d3740 20 client.27439 trim_cache size 0 max 16384 2024-08-31T05:38:38.565 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:38:38.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.558+0000 7fcb65e5e640 1 -- 172.21.15.5:0/1853486156 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fcb4c0b4ca0 msgr2=0x7fcb4c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:38.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.558+0000 7fcb65e5e640 1 --2- 172.21.15.5:0/1853486156 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fcb4c0b4ca0 0x7fcb4c0b71b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fcb480096c0 tx=0x7fcb48031400 comp rx=0 tx=0).stop 2024-08-31T05:38:38.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.558+0000 7fcb65e5e640 1 -- 172.21.15.5:0/1853486156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb60109bc0 msgr2=0x7fcb601a1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:38.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.558+0000 7fcb65e5e640 1 --2- 172.21.15.5:0/1853486156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb60109bc0 0x7fcb601a1cf0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fcb5800efd0 tx=0x7fcb5800c6a0 comp rx=0 tx=0).stop 2024-08-31T05:38:38.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.558+0000 7fcb65e5e640 1 -- 172.21.15.5:0/1853486156 shutdown_connections 2024-08-31T05:38:38.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.558+0000 7fcb65e5e640 1 --2- 172.21.15.5:0/1853486156 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fcb4c0b4ca0 0x7fcb4c0b71b0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:38.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.558+0000 7fcb65e5e640 1 --2- 172.21.15.5:0/1853486156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb60109bc0 0x7fcb601a1cf0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:38.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.558+0000 7fcb65e5e640 1 --2- 172.21.15.5:0/1853486156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcb60109270 0x7fcb6019ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:38.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.558+0000 7fcb65e5e640 1 --2- 172.21.15.5:0/1853486156 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb60103930 0x7fcb6019c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:38.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.558+0000 7fcb65e5e640 1 -- 172.21.15.5:0/1853486156 >> 172.21.15.5:0/1853486156 conn(0x7fcb600ff3a0 msgr2=0x7fcb60106900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:38.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.558+0000 7fcb65e5e640 1 -- 172.21.15.5:0/1853486156 shutdown_connections 2024-08-31T05:38:38.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:38.558+0000 7fcb65e5e640 1 -- 172.21.15.5:0/1853486156 wait complete. 2024-08-31T05:38:38.930 INFO:tasks.workunit.client.0.smithi005.stdout: 1 979459 11.28 MB/sec execute 326 sec latency 37.665 ms 2024-08-31T05:38:39.156 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:38:38 smithi050 ceph-mon[22146]: pgmap v609: 129 pgs: 129 active+clean; 522 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.6 MiB/s wr, 209 op/s 2024-08-31T05:38:39.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:38:38 smithi005 ceph-mon[18602]: pgmap v609: 129 pgs: 129 active+clean; 522 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.6 MiB/s wr, 209 op/s 2024-08-31T05:38:39.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:38:38 smithi070 ceph-mon[22316]: pgmap v609: 129 pgs: 129 active+clean; 522 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.6 MiB/s wr, 209 op/s 2024-08-31T05:38:39.930 INFO:tasks.workunit.client.0.smithi005.stdout: 1 981129 11.28 MB/sec execute 327 sec latency 82.015 ms 2024-08-31T05:38:40.235 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-31T05:38:40.515 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:38:40.930 INFO:tasks.workunit.client.0.smithi005.stdout: 1 982537 11.26 MB/sec execute 328 sec latency 50.651 ms 2024-08-31T05:38:41.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.014+0000 7f64beb68640 1 -- 172.21.15.5:0/1167590585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64b8102820 msgr2=0x7f64b8102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:41.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.014+0000 7f64beb68640 1 --2- 172.21.15.5:0/1167590585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64b8102820 0x7f64b8102c30 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f64ac009900 tx=0x7f64ac02a3f0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.015+0000 7f64beb68640 1 -- 172.21.15.5:0/1167590585 shutdown_connections 2024-08-31T05:38:41.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.015+0000 7f64beb68640 1 --2- 172.21.15.5:0/1167590585 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64b8108ab0 0x7f64b810f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.015+0000 7f64beb68640 1 --2- 172.21.15.5:0/1167590585 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64b8108160 0x7f64b8108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.015+0000 7f64beb68640 1 --2- 172.21.15.5:0/1167590585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64b8102820 0x7f64b8102c30 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.015+0000 7f64beb68640 1 -- 172.21.15.5:0/1167590585 >> 172.21.15.5:0/1167590585 conn(0x7f64b80794e0 msgr2=0x7f64b80798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:41.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.015+0000 7f64beb68640 1 -- 172.21.15.5:0/1167590585 shutdown_connections 2024-08-31T05:38:41.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.015+0000 7f64beb68640 1 -- 172.21.15.5:0/1167590585 wait complete. 2024-08-31T05:38:41.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.015+0000 7f64beb68640 1 Processor -- start 2024-08-31T05:38:41.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.015+0000 7f64beb68640 1 -- start start 2024-08-31T05:38:41.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.016+0000 7f64beb68640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64b8102820 0x7f64b8197ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:41.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.016+0000 7f64beb68640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64b8108160 0x7f64b8198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:41.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.016+0000 7f64beb68640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64b8108ab0 0x7f64b819d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:41.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.016+0000 7f64beb68640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f64b8111620 con 0x7f64b8108160 2024-08-31T05:38:41.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.016+0000 7f64beb68640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f64b81114a0 con 0x7f64b8102820 2024-08-31T05:38:41.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.016+0000 7f64beb68640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f64b81117a0 con 0x7f64b8108ab0 2024-08-31T05:38:41.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.016+0000 7f64b7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64b8108160 0x7f64b8198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:41.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.016+0000 7f64b7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64b8108160 0x7f64b8198590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36944/0 (socket says 172.21.15.5:36944) 2024-08-31T05:38:41.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.016+0000 7f64b7fff640 1 -- 172.21.15.5:0/3563967495 learned_addr learned my addr 172.21.15.5:0/3563967495 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:41.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.016+0000 7f64bd105640 1 --2- 172.21.15.5:0/3563967495 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64b8108ab0 0x7f64b819d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:41.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.016+0000 7f64bc904640 1 --2- 172.21.15.5:0/3563967495 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64b8102820 0x7f64b8197ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:41.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.016+0000 7f64b7fff640 1 -- 172.21.15.5:0/3563967495 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64b8108ab0 msgr2=0x7f64b819d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:41.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.016+0000 7f64b7fff640 1 --2- 172.21.15.5:0/3563967495 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64b8108ab0 0x7f64b819d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.016+0000 7f64b7fff640 1 -- 172.21.15.5:0/3563967495 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64b8102820 msgr2=0x7f64b8197ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:41.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.016+0000 7f64b7fff640 1 --2- 172.21.15.5:0/3563967495 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64b8102820 0x7f64b8197ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.016+0000 7f64b7fff640 1 -- 172.21.15.5:0/3563967495 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64b819df60 con 0x7f64b8108160 2024-08-31T05:38:41.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.016+0000 7f64b7fff640 1 --2- 172.21.15.5:0/3563967495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64b8108160 0x7f64b8198590 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f64a4010aa0 tx=0x7f64a4010f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:41.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.016+0000 7f64b5ffb640 1 -- 172.21.15.5:0/3563967495 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a401a030 con 0x7f64b8108160 2024-08-31T05:38:41.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.017+0000 7f64b5ffb640 1 -- 172.21.15.5:0/3563967495 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64a4005020 con 0x7f64b8108160 2024-08-31T05:38:41.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.017+0000 7f64beb68640 1 -- 172.21.15.5:0/3563967495 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64b819e250 con 0x7f64b8108160 2024-08-31T05:38:41.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.017+0000 7f64b5ffb640 1 -- 172.21.15.5:0/3563967495 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a4004bc0 con 0x7f64b8108160 2024-08-31T05:38:41.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.017+0000 7f64beb68640 1 -- 172.21.15.5:0/3563967495 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64b81a49b0 con 0x7f64b8108160 2024-08-31T05:38:41.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.020+0000 7f64b5ffb640 1 -- 172.21.15.5:0/3563967495 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f64a401d070 con 0x7f64b8108160 2024-08-31T05:38:41.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.020+0000 7f64c50dd740 1 Processor -- start 2024-08-31T05:38:41.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.020+0000 7f64c50dd740 1 -- start start 2024-08-31T05:38:41.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.021+0000 7f64c50dd740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558840dc7070 0x55884116c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:41.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.021+0000 7f64c50dd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558840d9e1b0 0x55884116c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:41.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.021+0000 7f64c50dd740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558840da6390 0x55884116cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:41.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.021+0000 7f64c50dd740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5588410e3680 con 0x558840da6390 2024-08-31T05:38:41.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.021+0000 7f64c50dd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5588410d2c10 con 0x558840d9e1b0 2024-08-31T05:38:41.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.021+0000 7f64c50dd740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5588410d6bc0 con 0x558840dc7070 2024-08-31T05:38:41.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.021+0000 7f64bd105640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558840dc7070 0x55884116c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:41.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.021+0000 7f64bd105640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558840dc7070 0x55884116c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:40004/0 (socket says 172.21.15.5:40004) 2024-08-31T05:38:41.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.021+0000 7f64bd105640 1 -- 172.21.15.5:0/3758601611 learned_addr learned my addr 172.21.15.5:0/3758601611 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:41.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.021+0000 7f64bc904640 1 --2- 172.21.15.5:0/3758601611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558840d9e1b0 0x55884116c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:41.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.021+0000 7f64b5ffb640 1 --2- 172.21.15.5:0/3563967495 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f64a80b4d20 0x7f64a80b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:41.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.021+0000 7f64b7fff640 1 --2- 172.21.15.5:0/3758601611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558840da6390 0x55884116cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:41.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.021+0000 7f64bd105640 1 -- 172.21.15.5:0/3758601611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558840d9e1b0 msgr2=0x55884116c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:41.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.021+0000 7f64bd105640 1 --2- 172.21.15.5:0/3758601611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558840d9e1b0 0x55884116c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.021+0000 7f64bd105640 1 -- 172.21.15.5:0/3758601611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558840da6390 msgr2=0x55884116cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:41.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.021+0000 7f64bd105640 1 --2- 172.21.15.5:0/3758601611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558840da6390 0x55884116cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.021+0000 7f64bd105640 1 -- 172.21.15.5:0/3758601611 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558840e32650 con 0x558840dc7070 2024-08-31T05:38:41.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.021+0000 7f64bd105640 1 --2- 172.21.15.5:0/3563967495 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f64a80b4d20 0x7f64a80b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:41.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.021+0000 7f64b5ffb640 1 -- 172.21.15.5:0/3563967495 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7f64a40e7af0 con 0x7f64b8108160 2024-08-31T05:38:41.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.021+0000 7f64bd105640 1 --2- 172.21.15.5:0/3758601611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558840dc7070 0x55884116c310 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f64b0011590 tx=0x7f64b0011a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61e65720ab2c7d8f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:41.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.022+0000 7f64a2ffd640 1 -- 172.21.15.5:0/3758601611 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64b0017050 con 0x558840dc7070 2024-08-31T05:38:41.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.022+0000 7f64bd105640 1 --2- 172.21.15.5:0/3563967495 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f64a80b4d20 0x7f64a80b7230 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f64b0022000 tx=0x7f64b0023000 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:41.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.022+0000 7f64a2ffd640 1 -- 172.21.15.5:0/3758601611 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64b000fdb0 con 0x558840dc7070 2024-08-31T05:38:41.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.022+0000 7f64a2ffd640 1 -- 172.21.15.5:0/3758601611 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64b001ba60 con 0x558840dc7070 2024-08-31T05:38:41.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.023+0000 7f64c50dd740 1 -- 172.21.15.5:0/3758601611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558840dc7070 msgr2=0x55884116c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:41.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.023+0000 7f64c50dd740 1 --2- 172.21.15.5:0/3758601611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558840dc7070 0x55884116c310 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f64b0011590 tx=0x7f64b0011a50 comp rx=0 tx=0).stop 2024-08-31T05:38:41.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.023+0000 7f64c50dd740 1 -- 172.21.15.5:0/3758601611 shutdown_connections 2024-08-31T05:38:41.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.023+0000 7f64c50dd740 1 --2- 172.21.15.5:0/3758601611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558840da6390 0x55884116cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.023+0000 7f64c50dd740 1 --2- 172.21.15.5:0/3758601611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558840d9e1b0 0x55884116c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.023+0000 7f64c50dd740 1 --2- 172.21.15.5:0/3758601611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558840dc7070 0x55884116c310 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.023+0000 7f64c50dd740 1 -- 172.21.15.5:0/3758601611 >> 172.21.15.5:0/3758601611 conn(0x558840dbb460 msgr2=0x55884116a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:41.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.023+0000 7f64c50dd740 1 -- 172.21.15.5:0/3758601611 shutdown_connections 2024-08-31T05:38:41.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.023+0000 7f64c50dd740 1 -- 172.21.15.5:0/3758601611 wait complete. 2024-08-31T05:38:41.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.023+0000 7f64c50dd740 1 -- start start 2024-08-31T05:38:41.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.023+0000 7f64c50dd740 1 Processor -- start 2024-08-31T05:38:41.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.024+0000 7f64c50dd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558840d9e1b0 0x558841177ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:41.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.024+0000 7f64c50dd740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558840da6390 0x558841177ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:41.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.024+0000 7f64c50dd740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558840dc7070 0x558841183e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:41.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.024+0000 7f64c50dd740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x558840f35700 con 0x558840dc7070 2024-08-31T05:38:41.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.024+0000 7f64c50dd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558841059750 con 0x558840d9e1b0 2024-08-31T05:38:41.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.024+0000 7f64c50dd740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55884117aaf0 con 0x558840da6390 2024-08-31T05:38:41.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.024+0000 7f64c50dd740 10 client.0 _ll_register_callbacks cb 0x558841088e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:38:41.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.024+0000 7f64b7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558840da6390 0x558841177ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:41.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.024+0000 7f64bc904640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558840d9e1b0 0x558841177ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:41.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.024+0000 7f64b7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558840da6390 0x558841177ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:40018/0 (socket says 172.21.15.5:40018) 2024-08-31T05:38:41.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.024+0000 7f64b7fff640 1 -- 172.21.15.5:0/2084707126 learned_addr learned my addr 172.21.15.5:0/2084707126 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:41.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.024+0000 7f64bd105640 1 --2- 172.21.15.5:0/2084707126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558840dc7070 0x558841183e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:41.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.024+0000 7f64b7fff640 1 -- 172.21.15.5:0/2084707126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558840d9e1b0 msgr2=0x558841177ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:41.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.024+0000 7f64b7fff640 1 --2- 172.21.15.5:0/2084707126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558840d9e1b0 0x558841177ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.024+0000 7f64b7fff640 1 -- 172.21.15.5:0/2084707126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558840dc7070 msgr2=0x558841183e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:41.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.024+0000 7f64b7fff640 1 --2- 172.21.15.5:0/2084707126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558840dc7070 0x558841183e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.024+0000 7f64b7fff640 1 -- 172.21.15.5:0/2084707126 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558841092900 con 0x558840da6390 2024-08-31T05:38:41.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.024+0000 7f64b7fff640 1 --2- 172.21.15.5:0/2084707126 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558840da6390 0x558841177ff0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f64a40ade80 tx=0x7f64a40ad950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f8aa60f710f472b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:41.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.024+0000 7f6497fff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:38:41.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.025+0000 7f6497fff640 1 -- 172.21.15.5:0/2084707126 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a40b70c0 con 0x558840da6390 2024-08-31T05:38:41.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.025+0000 7f6497fff640 1 -- 172.21.15.5:0/2084707126 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7f64a40aa180 con 0x558840da6390 2024-08-31T05:38:41.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.025+0000 7f64c50dd740 1 -- 172.21.15.5:0/2084707126 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f64b000fdb0 con 0x558840da6390 2024-08-31T05:38:41.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.025+0000 7f6497fff640 1 -- 172.21.15.5:0/2084707126 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f64a40b2270 con 0x558840da6390 2024-08-31T05:38:41.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.025+0000 7f64c50dd740 10 client.27451 fetch_fsmap learned FSMap version 34 2024-08-31T05:38:41.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.025+0000 7f64c50dd740 1 -- 172.21.15.5:0/2084707126 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55884118ad90 con 0x558840da6390 2024-08-31T05:38:41.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.025+0000 7f6497fff640 1 -- 172.21.15.5:0/2084707126 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64b000fdb0 con 0x558840da6390 2024-08-31T05:38:41.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.025+0000 7f6497fff640 1 -- 172.21.15.5:0/2084707126 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f64a4027060 con 0x558840da6390 2024-08-31T05:38:41.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.025+0000 7f64c50dd740 10 client.27451 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:38:41.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.025+0000 7f64c50dd740 10 client.27451 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-31T05:38:41.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.025+0000 7f64c50dd740 20 client.27451 populate_metadata read hostname 'smithi005' 2024-08-31T05:38:41.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.025+0000 7f64c50dd740 1 --2- 172.21.15.5:0/2084707126 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x558840d859f0 0x55884118e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:41.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.025+0000 7f64c50dd740 4 client.27451 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:38:41.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.025+0000 7f64c50dd740 1 -- 172.21.15.5:0/2084707126 --> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5588410e55d0 con 0x558840d859f0 2024-08-31T05:38:41.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.026+0000 7f64bc904640 1 --2- 172.21.15.5:0/2084707126 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x558840d859f0 0x55884118e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:41.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.026+0000 7f6497fff640 10 client.27451 ms_handle_connect on v2:172.21.15.70:6834/2061504114 2024-08-31T05:38:41.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.026+0000 7f64bc904640 1 --2- 172.21.15.5:0/2084707126 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x558840d859f0 0x55884118e2b0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=917cfc79035546c1 server_cookie=77d9ab4d0795ae70 in_seq=0 out_seq=0 2024-08-31T05:38:41.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.027+0000 7f6497fff640 1 -- 172.21.15.5:0/2084707126 <== mds.3 v2:172.21.15.70:6834/2061504114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5588410e55d0 con 0x558840d859f0 2024-08-31T05:38:41.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.027+0000 7f6497fff640 10 client.27451 handle_command_reply: tid=0 2024-08-31T05:38:41.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.027+0000 7f64c50dd740 1 client.27451 shutdown 2024-08-31T05:38:41.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.027+0000 7f64c50dd740 1 -- 172.21.15.5:0/2084707126 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558840da6390 msgr2=0x558841177ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:41.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.027+0000 7f64c50dd740 1 --2- 172.21.15.5:0/2084707126 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558840da6390 0x558841177ff0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f64a40ade80 tx=0x7f64a40ad950 comp rx=0 tx=0).stop 2024-08-31T05:38:41.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.027+0000 7f64c50dd740 1 -- 172.21.15.5:0/2084707126 shutdown_connections 2024-08-31T05:38:41.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.027+0000 7f64c50dd740 1 --2- 172.21.15.5:0/2084707126 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x558840d859f0 0x55884118e2b0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.027+0000 7f64c50dd740 1 --2- 172.21.15.5:0/2084707126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558840dc7070 0x558841183e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.027+0000 7f64c50dd740 1 --2- 172.21.15.5:0/2084707126 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558840da6390 0x558841177ff0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.027+0000 7f64c50dd740 1 --2- 172.21.15.5:0/2084707126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558840d9e1b0 0x558841177ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.027+0000 7f64c50dd740 1 -- 172.21.15.5:0/2084707126 >> 172.21.15.5:0/2084707126 conn(0x558840dbb460 msgr2=0x55884116f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:41.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.027+0000 7f6497fff640 0 client.27451 ms_handle_reset on v2:172.21.15.70:6834/2061504114 2024-08-31T05:38:41.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.027+0000 7f64c50dd740 1 -- 172.21.15.5:0/2084707126 shutdown_connections 2024-08-31T05:38:41.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.027+0000 7f64c50dd740 1 -- 172.21.15.5:0/2084707126 wait complete. 2024-08-31T05:38:41.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.027+0000 7f64c50dd740 20 client.27451 trim_cache size 0 max 16384 2024-08-31T05:38:41.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.043+0000 7f64c50dd740 1 Processor -- start 2024-08-31T05:38:41.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.043+0000 7f64c50dd740 1 -- start start 2024-08-31T05:38:41.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.044+0000 7f64c50dd740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558840d9e1b0 0x558841183d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:41.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.044+0000 7f64c50dd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558840da6390 0x55884116a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:41.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.044+0000 7f64c50dd740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558840dc7070 0x558841174ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:41.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.044+0000 7f64c50dd740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f64b81aeb90 con 0x558840dc7070 2024-08-31T05:38:41.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.044+0000 7f64c50dd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f64b81b06d0 con 0x558840da6390 2024-08-31T05:38:41.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.044+0000 7f64c50dd740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f64b81af260 con 0x558840d9e1b0 2024-08-31T05:38:41.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.044+0000 7f64bc904640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558840d9e1b0 0x558841183d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:41.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.044+0000 7f64b7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558840da6390 0x55884116a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:41.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.044+0000 7f64bc904640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558840d9e1b0 0x558841183d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:40022/0 (socket says 172.21.15.5:40022) 2024-08-31T05:38:41.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.044+0000 7f64bc904640 1 -- 172.21.15.5:0/144866045 learned_addr learned my addr 172.21.15.5:0/144866045 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:41.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.044+0000 7f64b7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558840da6390 0x55884116a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:51982/0 (socket says 172.21.15.5:51982) 2024-08-31T05:38:41.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.044+0000 7f64bd105640 1 --2- 172.21.15.5:0/144866045 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558840dc7070 0x558841174ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:41.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.044+0000 7f64b7fff640 1 -- 172.21.15.5:0/144866045 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558840d9e1b0 msgr2=0x558841183d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:41.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.044+0000 7f64b7fff640 1 --2- 172.21.15.5:0/144866045 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558840d9e1b0 0x558841183d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.044+0000 7f64b7fff640 1 -- 172.21.15.5:0/144866045 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558840dc7070 msgr2=0x558841174ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:41.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.044+0000 7f64b7fff640 1 --2- 172.21.15.5:0/144866045 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558840dc7070 0x558841174ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.044+0000 7f64b7fff640 1 -- 172.21.15.5:0/144866045 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558841178b50 con 0x558840da6390 2024-08-31T05:38:41.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.045+0000 7f64b7fff640 1 --2- 172.21.15.5:0/144866045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558840da6390 0x55884116a230 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f64a40ab160 tx=0x7f64a40994b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95903b6f8a1da1b0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:41.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.045+0000 7f64a27fc640 1 -- 172.21.15.5:0/144866045 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a40b70c0 con 0x558840da6390 2024-08-31T05:38:41.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.045+0000 7f64a27fc640 1 -- 172.21.15.5:0/144866045 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64a4095390 con 0x558840da6390 2024-08-31T05:38:41.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.045+0000 7f64a27fc640 1 -- 172.21.15.5:0/144866045 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a40acdc0 con 0x558840da6390 2024-08-31T05:38:41.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.046+0000 7f64c50dd740 1 -- 172.21.15.5:0/144866045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558840da6390 msgr2=0x55884116a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:41.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.046+0000 7f64c50dd740 1 --2- 172.21.15.5:0/144866045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558840da6390 0x55884116a230 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f64a40ab160 tx=0x7f64a40994b0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.046+0000 7f64c50dd740 1 -- 172.21.15.5:0/144866045 shutdown_connections 2024-08-31T05:38:41.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.046+0000 7f64c50dd740 1 --2- 172.21.15.5:0/144866045 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558840dc7070 0x558841174ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.046+0000 7f64c50dd740 1 --2- 172.21.15.5:0/144866045 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558840da6390 0x55884116a230 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.046+0000 7f64c50dd740 1 --2- 172.21.15.5:0/144866045 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558840d9e1b0 0x558841183d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.046+0000 7f64c50dd740 1 -- 172.21.15.5:0/144866045 >> 172.21.15.5:0/144866045 conn(0x558840dbb460 msgr2=0x558841169b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:41.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.046+0000 7f64c50dd740 1 -- 172.21.15.5:0/144866045 shutdown_connections 2024-08-31T05:38:41.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.046+0000 7f64c50dd740 1 -- 172.21.15.5:0/144866045 wait complete. 2024-08-31T05:38:41.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.047+0000 7f64c50dd740 1 -- start start 2024-08-31T05:38:41.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.047+0000 7f64c50dd740 1 Processor -- start 2024-08-31T05:38:41.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.047+0000 7f64c50dd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558840d9e1b0 0x55884117be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:41.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.047+0000 7f64c50dd740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558840da6390 0x55884117c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:41.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.047+0000 7f64c50dd740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558840dc7070 0x55884117c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:41.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.047+0000 7f64c50dd740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f64b81b0000 con 0x558840da6390 2024-08-31T05:38:41.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.047+0000 7f64c50dd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f64b81af930 con 0x558840d9e1b0 2024-08-31T05:38:41.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.047+0000 7f64c50dd740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f64b81acb90 con 0x558840dc7070 2024-08-31T05:38:41.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.047+0000 7f64c50dd740 10 client.0 _ll_register_callbacks cb 0x7f64a40ad660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:38:41.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.048+0000 7f64bc904640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558840d9e1b0 0x55884117be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:41.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.048+0000 7f64bd105640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558840dc7070 0x55884117c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:41.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.048+0000 7f64bc904640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558840d9e1b0 0x55884117be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:51994/0 (socket says 172.21.15.5:51994) 2024-08-31T05:38:41.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.048+0000 7f64bc904640 1 -- 172.21.15.5:0/3976581075 learned_addr learned my addr 172.21.15.5:0/3976581075 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:41.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.048+0000 7f64b7fff640 1 --2- 172.21.15.5:0/3976581075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558840da6390 0x55884117c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:41.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.048+0000 7f64bc904640 1 -- 172.21.15.5:0/3976581075 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558840dc7070 msgr2=0x55884117c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:41.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.048+0000 7f64bc904640 1 --2- 172.21.15.5:0/3976581075 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558840dc7070 0x55884117c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.048+0000 7f64bc904640 1 -- 172.21.15.5:0/3976581075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558840da6390 msgr2=0x55884117c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:41.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.048+0000 7f64bc904640 1 --2- 172.21.15.5:0/3976581075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558840da6390 0x55884117c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.048+0000 7f64bc904640 1 -- 172.21.15.5:0/3976581075 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588411f7d20 con 0x558840d9e1b0 2024-08-31T05:38:41.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.048+0000 7f64bd105640 1 --2- 172.21.15.5:0/3976581075 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558840dc7070 0x55884117c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:38:41.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.048+0000 7f64bc904640 1 --2- 172.21.15.5:0/3976581075 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558840d9e1b0 0x55884117be10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f64ac009230 tx=0x7f64ac004400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6612d2b62345bb8e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:41.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.048+0000 7f6497fff640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:38:41.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.049+0000 7f6497fff640 1 -- 172.21.15.5:0/3976581075 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64ac035040 con 0x558840d9e1b0 2024-08-31T05:38:41.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.049+0000 7f64c50dd740 1 -- 172.21.15.5:0/3976581075 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f64a4095390 con 0x558840d9e1b0 2024-08-31T05:38:41.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.049+0000 7f6497fff640 1 -- 172.21.15.5:0/3976581075 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7f64ac005450 con 0x558840d9e1b0 2024-08-31T05:38:41.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.049+0000 7f6497fff640 1 -- 172.21.15.5:0/3976581075 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f64ac055050 con 0x558840d9e1b0 2024-08-31T05:38:41.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.049+0000 7f64c50dd740 10 client.27449 fetch_fsmap learned FSMap version 34 2024-08-31T05:38:41.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.049+0000 7f64c50dd740 1 -- 172.21.15.5:0/3976581075 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5588411f9000 con 0x558840d9e1b0 2024-08-31T05:38:41.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.049+0000 7f6497fff640 1 -- 172.21.15.5:0/3976581075 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64a4095390 con 0x558840d9e1b0 2024-08-31T05:38:41.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.049+0000 7f6497fff640 1 -- 172.21.15.5:0/3976581075 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f64ac0037b0 con 0x558840d9e1b0 2024-08-31T05:38:41.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.049+0000 7f64c50dd740 10 client.27449 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:38:41.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.049+0000 7f64c50dd740 10 client.27449 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-31T05:38:41.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.049+0000 7f64c50dd740 20 client.27449 populate_metadata read hostname 'smithi005' 2024-08-31T05:38:41.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.049+0000 7f64c50dd740 1 --2- 172.21.15.5:0/3976581075 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x558840d5ada0 0x5588411fb790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:41.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.049+0000 7f64c50dd740 4 client.27449 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:38:41.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.049+0000 7f64c50dd740 1 -- 172.21.15.5:0/3976581075 --> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5588410e1070 con 0x558840d5ada0 2024-08-31T05:38:41.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.050+0000 7f64b7fff640 1 --2- 172.21.15.5:0/3976581075 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x558840d5ada0 0x5588411fb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:41.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.050+0000 7f6497fff640 10 client.27449 ms_handle_connect on v2:172.21.15.70:6834/2061504114 2024-08-31T05:38:41.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.050+0000 7f64b7fff640 1 --2- 172.21.15.5:0/3976581075 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x558840d5ada0 0x5588411fb790 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4bfef3f16e8abbc server_cookie=b6ff5be511d98818 in_seq=0 out_seq=0 2024-08-31T05:38:41.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.050+0000 7f6497fff640 1 -- 172.21.15.5:0/3976581075 <== mds.3 v2:172.21.15.70:6834/2061504114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5588410e1070 con 0x558840d5ada0 2024-08-31T05:38:41.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.050+0000 7f6497fff640 10 client.27449 handle_command_reply: tid=0 2024-08-31T05:38:41.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.050+0000 7f64c50dd740 1 client.27449 shutdown 2024-08-31T05:38:41.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.050+0000 7f64c50dd740 1 -- 172.21.15.5:0/3976581075 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558840d9e1b0 msgr2=0x55884117be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:41.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.050+0000 7f64c50dd740 1 --2- 172.21.15.5:0/3976581075 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558840d9e1b0 0x55884117be10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f64ac009230 tx=0x7f64ac004400 comp rx=0 tx=0).stop 2024-08-31T05:38:41.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.050+0000 7f64c50dd740 1 -- 172.21.15.5:0/3976581075 shutdown_connections 2024-08-31T05:38:41.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.050+0000 7f64c50dd740 1 --2- 172.21.15.5:0/3976581075 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x558840d5ada0 0x5588411fb790 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.050+0000 7f64c50dd740 1 --2- 172.21.15.5:0/3976581075 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558840dc7070 0x55884117c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.051+0000 7f64c50dd740 1 --2- 172.21.15.5:0/3976581075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558840da6390 0x55884117c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.051+0000 7f6497fff640 0 client.27449 ms_handle_reset on v2:172.21.15.70:6834/2061504114 2024-08-31T05:38:41.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.051+0000 7f64c50dd740 1 --2- 172.21.15.5:0/3976581075 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x558840d9e1b0 0x55884117be10 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.051+0000 7f64c50dd740 1 -- 172.21.15.5:0/3976581075 >> 172.21.15.5:0/3976581075 conn(0x558840dbb460 msgr2=0x55884116d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:41.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.051+0000 7f64c50dd740 1 -- 172.21.15.5:0/3976581075 shutdown_connections 2024-08-31T05:38:41.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.051+0000 7f64c50dd740 1 -- 172.21.15.5:0/3976581075 wait complete. 2024-08-31T05:38:41.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.051+0000 7f64c50dd740 20 client.27449 trim_cache size 0 max 16384 2024-08-31T05:38:41.057 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:38:41.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.051+0000 7f64beb68640 1 -- 172.21.15.5:0/3563967495 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f64a80b4d20 msgr2=0x7f64a80b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:41.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.051+0000 7f64beb68640 1 --2- 172.21.15.5:0/3563967495 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f64a80b4d20 0x7f64a80b7230 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f64b0022000 tx=0x7f64b0023000 comp rx=0 tx=0).stop 2024-08-31T05:38:41.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.052+0000 7f64beb68640 1 -- 172.21.15.5:0/3563967495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64b8108160 msgr2=0x7f64b8198590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:41.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.052+0000 7f64beb68640 1 --2- 172.21.15.5:0/3563967495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64b8108160 0x7f64b8198590 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f64a4010aa0 tx=0x7f64a4010f60 comp rx=0 tx=0).stop 2024-08-31T05:38:41.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.052+0000 7f64beb68640 1 -- 172.21.15.5:0/3563967495 shutdown_connections 2024-08-31T05:38:41.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.052+0000 7f64beb68640 1 --2- 172.21.15.5:0/3563967495 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f64a80b4d20 0x7f64a80b7230 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.052+0000 7f64beb68640 1 --2- 172.21.15.5:0/3563967495 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64b8108ab0 0x7f64b819d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.052+0000 7f64beb68640 1 --2- 172.21.15.5:0/3563967495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f64b8108160 0x7f64b8198590 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.052+0000 7f64beb68640 1 --2- 172.21.15.5:0/3563967495 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f64b8102820 0x7f64b8197ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.052+0000 7f64beb68640 1 -- 172.21.15.5:0/3563967495 >> 172.21.15.5:0/3563967495 conn(0x7f64b80794e0 msgr2=0x7f64b81011f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:41.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.052+0000 7f64beb68640 1 -- 172.21.15.5:0/3563967495 shutdown_connections 2024-08-31T05:38:41.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:41.052+0000 7f64beb68640 1 -- 172.21.15.5:0/3563967495 wait complete. 2024-08-31T05:38:41.156 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:38:40 smithi050 ceph-mon[22146]: pgmap v610: 129 pgs: 129 active+clean; 500 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.3 MiB/s wr, 209 op/s 2024-08-31T05:38:41.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:38:40 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:38:41.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:38:40 smithi005 ceph-mon[18602]: pgmap v610: 129 pgs: 129 active+clean; 500 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.3 MiB/s wr, 209 op/s 2024-08-31T05:38:41.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:38:40 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:38:41.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.272+0000 7f0c77dc6640 1 -- 172.21.15.5:0/634231778 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c701038a0 msgr2=0x7f0c70103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:41.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.272+0000 7f0c77dc6640 1 --2- 172.21.15.5:0/634231778 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c701038a0 0x7f0c70103cb0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c009900 tx=0x7f0c6c02a410 comp rx=0 tx=0).stop 2024-08-31T05:38:41.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.272+0000 7f0c77dc6640 1 -- 172.21.15.5:0/634231778 shutdown_connections 2024-08-31T05:38:41.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.272+0000 7f0c77dc6640 1 --2- 172.21.15.5:0/634231778 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c70109c30 0x7f0c70110460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.272+0000 7f0c77dc6640 1 --2- 172.21.15.5:0/634231778 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c701092e0 0x7f0c701096f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.276 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.272+0000 7f0c77dc6640 1 --2- 172.21.15.5:0/634231778 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c701038a0 0x7f0c70103cb0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.276 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.272+0000 7f0c77dc6640 1 -- 172.21.15.5:0/634231778 >> 172.21.15.5:0/634231778 conn(0x7f0c700ff2c0 msgr2=0x7f0c70101710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:41.276 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.273+0000 7f0c77dc6640 1 -- 172.21.15.5:0/634231778 shutdown_connections 2024-08-31T05:38:41.276 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.273+0000 7f0c77dc6640 1 -- 172.21.15.5:0/634231778 wait complete. 2024-08-31T05:38:41.276 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.273+0000 7f0c77dc6640 1 Processor -- start 2024-08-31T05:38:41.276 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.273+0000 7f0c77dc6640 1 -- start start 2024-08-31T05:38:41.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.273+0000 7f0c77dc6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c701038a0 0x7f0c7019a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:41.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.274+0000 7f0c77dc6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c701092e0 0x7f0c7019a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:41.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.274+0000 7f0c77dc6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c70109c30 0x7f0c7019fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:41.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.274+0000 7f0c77dc6640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0c701138f0 con 0x7f0c70109c30 2024-08-31T05:38:41.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.274+0000 7f0c77dc6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0c70113770 con 0x7f0c701092e0 2024-08-31T05:38:41.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.274+0000 7f0c77dc6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0c70113a70 con 0x7f0c701038a0 2024-08-31T05:38:41.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.274+0000 7f0c76363640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c70109c30 0x7f0c7019fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:41.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.274+0000 7f0c75361640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c701092e0 0x7f0c7019a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:41.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.274+0000 7f0c76363640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c70109c30 0x7f0c7019fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37016/0 (socket says 172.21.15.5:37016) 2024-08-31T05:38:41.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.274+0000 7f0c76363640 1 -- 172.21.15.5:0/2971138713 learned_addr learned my addr 172.21.15.5:0/2971138713 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:41.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.274+0000 7f0c75b62640 1 --2- 172.21.15.5:0/2971138713 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c701038a0 0x7f0c7019a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:41.278 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.274+0000 7f0c76363640 1 -- 172.21.15.5:0/2971138713 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c701038a0 msgr2=0x7f0c7019a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:41.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.274+0000 7f0c76363640 1 --2- 172.21.15.5:0/2971138713 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c701038a0 0x7f0c7019a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.274+0000 7f0c76363640 1 -- 172.21.15.5:0/2971138713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c701092e0 msgr2=0x7f0c7019a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:41.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.274+0000 7f0c76363640 1 --2- 172.21.15.5:0/2971138713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c701092e0 0x7f0c7019a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.274+0000 7f0c76363640 1 -- 172.21.15.5:0/2971138713 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c701a0240 con 0x7f0c70109c30 2024-08-31T05:38:41.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.274+0000 7f0c75361640 1 --2- 172.21.15.5:0/2971138713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c701092e0 0x7f0c7019a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:38:41.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.274+0000 7f0c76363640 1 --2- 172.21.15.5:0/2971138713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c70109c30 0x7f0c7019fb40 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f0c6800eb10 tx=0x7f0c6800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:41.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.274+0000 7f0c66ffd640 1 -- 172.21.15.5:0/2971138713 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c68004b20 con 0x7f0c70109c30 2024-08-31T05:38:41.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.275+0000 7f0c77dc6640 1 -- 172.21.15.5:0/2971138713 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c701a0530 con 0x7f0c70109c30 2024-08-31T05:38:41.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.275+0000 7f0c66ffd640 1 -- 172.21.15.5:0/2971138713 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c68004cc0 con 0x7f0c70109c30 2024-08-31T05:38:41.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.275+0000 7f0c66ffd640 1 -- 172.21.15.5:0/2971138713 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c68010690 con 0x7f0c70109c30 2024-08-31T05:38:41.279 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.275+0000 7f0c77dc6640 1 -- 172.21.15.5:0/2971138713 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c701a6cc0 con 0x7f0c70109c30 2024-08-31T05:38:41.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.278+0000 7f0c7ee18740 1 Processor -- start 2024-08-31T05:38:41.282 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.278+0000 7f0c66ffd640 1 -- 172.21.15.5:0/2971138713 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f0c680108f0 con 0x7f0c70109c30 2024-08-31T05:38:41.282 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.278+0000 7f0c7ee18740 1 -- start start 2024-08-31T05:38:41.282 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.279+0000 7f0c7ee18740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648eda7d1b0 0x5648ede20ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:41.282 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.279+0000 7f0c7ee18740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648eda542f0 0x5648ede21000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:41.282 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.279+0000 7f0c7ee18740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5648eda5c4d0 0x5648ede21540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:41.282 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.279+0000 7f0c7ee18740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5648edd96000 con 0x5648eda5c4d0 2024-08-31T05:38:41.282 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.279+0000 7f0c7ee18740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5648edd85590 con 0x5648eda7d1b0 2024-08-31T05:38:41.282 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.279+0000 7f0c7ee18740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5648edd89540 con 0x5648eda542f0 2024-08-31T05:38:41.282 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.279+0000 7f0c75361640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648eda7d1b0 0x5648ede20ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:41.282 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.279+0000 7f0c75b62640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648eda542f0 0x5648ede21000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:41.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.279+0000 7f0c75361640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648eda7d1b0 0x5648ede20ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:52024/0 (socket says 172.21.15.5:52024) 2024-08-31T05:38:41.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.279+0000 7f0c75361640 1 -- 172.21.15.5:0/277640131 learned_addr learned my addr 172.21.15.5:0/277640131 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:41.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.279+0000 7f0c75361640 1 --2- 172.21.15.5:0/277640131 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5648eda5c4d0 0x5648ede21540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:41.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.279+0000 7f0c66ffd640 1 --2- 172.21.15.5:0/2971138713 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f0c5c0b4ca0 0x7f0c5c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:41.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.279+0000 7f0c75361640 1 -- 172.21.15.5:0/277640131 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648eda542f0 msgr2=0x5648ede21000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:41.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.279+0000 7f0c75361640 1 --2- 172.21.15.5:0/277640131 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648eda542f0 0x5648ede21000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.279+0000 7f0c75361640 1 -- 172.21.15.5:0/277640131 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5648eda5c4d0 msgr2=0x5648ede21540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:41.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.279+0000 7f0c75361640 1 --2- 172.21.15.5:0/277640131 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5648eda5c4d0 0x5648ede21540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.279+0000 7f0c75361640 1 -- 172.21.15.5:0/277640131 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648edae8790 con 0x5648eda7d1b0 2024-08-31T05:38:41.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.279+0000 7f0c76363640 1 --2- 172.21.15.5:0/2971138713 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f0c5c0b4ca0 0x7f0c5c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:41.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.279+0000 7f0c75361640 1 --2- 172.21.15.5:0/277640131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648eda7d1b0 0x5648ede20ac0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0c60011b60 tx=0x7f0c60005850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fcb407bfac0552d9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:41.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.280+0000 7f0c66ffd640 1 -- 172.21.15.5:0/2971138713 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7f0c680e5e70 con 0x7f0c70109c30 2024-08-31T05:38:41.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.280+0000 7f0c5bfff640 1 -- 172.21.15.5:0/277640131 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c6000fc50 con 0x5648eda7d1b0 2024-08-31T05:38:41.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.280+0000 7f0c5bfff640 1 -- 172.21.15.5:0/277640131 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c6000fdf0 con 0x5648eda7d1b0 2024-08-31T05:38:41.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.280+0000 7f0c5bfff640 1 -- 172.21.15.5:0/277640131 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c60003e20 con 0x5648eda7d1b0 2024-08-31T05:38:41.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.281+0000 7f0c7ee18740 1 -- 172.21.15.5:0/277640131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648eda7d1b0 msgr2=0x5648ede20ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:41.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.281+0000 7f0c76363640 1 --2- 172.21.15.5:0/2971138713 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f0c5c0b4ca0 0x7f0c5c0b71b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f0c680a93f0 tx=0x7f0c68000f40 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:41.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.281+0000 7f0c7ee18740 1 --2- 172.21.15.5:0/277640131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648eda7d1b0 0x5648ede20ac0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0c60011b60 tx=0x7f0c60005850 comp rx=0 tx=0).stop 2024-08-31T05:38:41.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.281+0000 7f0c7ee18740 1 -- 172.21.15.5:0/277640131 shutdown_connections 2024-08-31T05:38:41.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.281+0000 7f0c7ee18740 1 --2- 172.21.15.5:0/277640131 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5648eda5c4d0 0x5648ede21540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.281+0000 7f0c7ee18740 1 --2- 172.21.15.5:0/277640131 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648eda542f0 0x5648ede21000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.281+0000 7f0c7ee18740 1 --2- 172.21.15.5:0/277640131 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648eda7d1b0 0x5648ede20ac0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.281+0000 7f0c7ee18740 1 -- 172.21.15.5:0/277640131 >> 172.21.15.5:0/277640131 conn(0x5648eda71300 msgr2=0x5648ede1e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:41.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.281+0000 7f0c7ee18740 1 -- 172.21.15.5:0/277640131 shutdown_connections 2024-08-31T05:38:41.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.281+0000 7f0c7ee18740 1 -- 172.21.15.5:0/277640131 wait complete. 2024-08-31T05:38:41.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.281+0000 7f0c7ee18740 1 -- start start 2024-08-31T05:38:41.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.281+0000 7f0c7ee18740 1 Processor -- start 2024-08-31T05:38:41.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.282+0000 7f0c7ee18740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5648eda542f0 0x5648ede30a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:41.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.282+0000 7f0c7ee18740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648eda5c4d0 0x5648ede30fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:41.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.282+0000 7f0c7ee18740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648eda7d1b0 0x5648ede3c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:41.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.282+0000 7f0c7ee18740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5648edcbeab0 con 0x5648eda542f0 2024-08-31T05:38:41.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.282+0000 7f0c7ee18740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5648edd0c680 con 0x5648eda5c4d0 2024-08-31T05:38:41.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.282+0000 7f0c7ee18740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5648ede33620 con 0x5648eda7d1b0 2024-08-31T05:38:41.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.282+0000 7f0c7ee18740 10 client.0 _ll_register_callbacks cb 0x5648eda94a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:38:41.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.282+0000 7f0c75361640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5648eda542f0 0x5648ede30a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:41.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.282+0000 7f0c75361640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5648eda542f0 0x5648ede30a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37030/0 (socket says 172.21.15.5:37030) 2024-08-31T05:38:41.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.282+0000 7f0c75361640 1 -- 172.21.15.5:0/1799759525 learned_addr learned my addr 172.21.15.5:0/1799759525 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:41.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.282+0000 7f0c75361640 1 --2- 172.21.15.5:0/1799759525 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648eda7d1b0 0x5648ede3c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:41.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.282+0000 7f0c75b62640 1 --2- 172.21.15.5:0/1799759525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648eda5c4d0 0x5648ede30fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:41.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.282+0000 7f0c75361640 1 -- 172.21.15.5:0/1799759525 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648eda7d1b0 msgr2=0x5648ede3c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:41.289 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.282+0000 7f0c75361640 1 --2- 172.21.15.5:0/1799759525 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648eda7d1b0 0x5648ede3c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.290 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.282+0000 7f0c75361640 1 -- 172.21.15.5:0/1799759525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648eda5c4d0 msgr2=0x5648ede30fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:41.290 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.282+0000 7f0c75361640 1 --2- 172.21.15.5:0/1799759525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648eda5c4d0 0x5648ede30fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.290 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.282+0000 7f0c75361640 1 -- 172.21.15.5:0/1799759525 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648edb61620 con 0x5648eda542f0 2024-08-31T05:38:41.290 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.282+0000 7f0c75361640 1 --2- 172.21.15.5:0/1799759525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5648eda542f0 0x5648ede30a70 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f0c600058c0 tx=0x7f0c60003ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e46870f3784e70 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:41.290 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.282+0000 7f0c597fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:38:41.290 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.282+0000 7f0c597fa640 1 -- 172.21.15.5:0/1799759525 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c600037b0 con 0x5648eda542f0 2024-08-31T05:38:41.290 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.283+0000 7f0c597fa640 1 -- 172.21.15.5:0/1799759525 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7f0c60005460 con 0x5648eda542f0 2024-08-31T05:38:41.290 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.283+0000 7f0c7ee18740 1 -- 172.21.15.5:0/1799759525 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c6000fdf0 con 0x5648eda542f0 2024-08-31T05:38:41.290 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.283+0000 7f0c597fa640 1 -- 172.21.15.5:0/1799759525 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f0c60011020 con 0x5648eda542f0 2024-08-31T05:38:41.290 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.283+0000 7f0c7ee18740 10 client.17886 fetch_fsmap learned FSMap version 34 2024-08-31T05:38:41.290 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.283+0000 7f0c7ee18740 1 -- 172.21.15.5:0/1799759525 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5648ede3f630 con 0x5648eda542f0 2024-08-31T05:38:41.290 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.283+0000 7f0c597fa640 1 -- 172.21.15.5:0/1799759525 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c6000fdf0 con 0x5648eda542f0 2024-08-31T05:38:41.290 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.283+0000 7f0c597fa640 1 -- 172.21.15.5:0/1799759525 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f0c6002b020 con 0x5648eda542f0 2024-08-31T05:38:41.291 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.283+0000 7f0c7ee18740 10 client.17886 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:38:41.291 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.283+0000 7f0c7ee18740 10 client.17886 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:38:41.291 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.283+0000 7f0c7ee18740 20 client.17886 populate_metadata read hostname 'smithi005' 2024-08-31T05:38:41.291 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.283+0000 7f0c7ee18740 1 --2- 172.21.15.5:0/1799759525 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5648eda3bd80 0x5648ede42aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:41.291 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.283+0000 7f0c7ee18740 4 client.17886 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:38:41.291 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.283+0000 7f0c7ee18740 1 -- 172.21.15.5:0/1799759525 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5648edd97f50 con 0x5648eda3bd80 2024-08-31T05:38:41.291 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.283+0000 7f0c75b62640 1 --2- 172.21.15.5:0/1799759525 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5648eda3bd80 0x5648ede42aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:41.291 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.284+0000 7f0c597fa640 10 client.17886 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:38:41.291 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.284+0000 7f0c75b62640 1 --2- 172.21.15.5:0/1799759525 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5648eda3bd80 0x5648ede42aa0 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df0836332c1f7aa7 server_cookie=5b4d28a4e01b92f2 in_seq=0 out_seq=0 2024-08-31T05:38:41.291 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.284+0000 7f0c597fa640 1 -- 172.21.15.5:0/1799759525 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5648edd97f50 con 0x5648eda3bd80 2024-08-31T05:38:41.292 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.285+0000 7f0c597fa640 10 client.17886 handle_command_reply: tid=0 2024-08-31T05:38:41.292 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.285+0000 7f0c7ee18740 1 client.17886 shutdown 2024-08-31T05:38:41.292 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.285+0000 7f0c7ee18740 1 -- 172.21.15.5:0/1799759525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5648eda542f0 msgr2=0x5648ede30a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:41.292 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.285+0000 7f0c7ee18740 1 --2- 172.21.15.5:0/1799759525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5648eda542f0 0x5648ede30a70 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f0c600058c0 tx=0x7f0c60003ae0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.292 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.285+0000 7f0c7ee18740 1 -- 172.21.15.5:0/1799759525 shutdown_connections 2024-08-31T05:38:41.292 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.285+0000 7f0c7ee18740 1 --2- 172.21.15.5:0/1799759525 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5648eda3bd80 0x5648ede42aa0 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.292 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.285+0000 7f0c7ee18740 1 --2- 172.21.15.5:0/1799759525 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648eda7d1b0 0x5648ede3c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.292 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.285+0000 7f0c7ee18740 1 --2- 172.21.15.5:0/1799759525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648eda5c4d0 0x5648ede30fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.292 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.285+0000 7f0c597fa640 0 client.17886 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:38:41.292 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.285+0000 7f0c7ee18740 1 --2- 172.21.15.5:0/1799759525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5648eda542f0 0x5648ede30a70 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.292 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.285+0000 7f0c7ee18740 1 -- 172.21.15.5:0/1799759525 >> 172.21.15.5:0/1799759525 conn(0x5648eda71300 msgr2=0x5648ede23c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:41.292 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.285+0000 7f0c7ee18740 1 -- 172.21.15.5:0/1799759525 shutdown_connections 2024-08-31T05:38:41.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.285+0000 7f0c7ee18740 1 -- 172.21.15.5:0/1799759525 wait complete. 2024-08-31T05:38:41.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.285+0000 7f0c7ee18740 20 client.17886 trim_cache size 0 max 16384 2024-08-31T05:38:41.317 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.309+0000 7f0c7ee18740 1 Processor -- start 2024-08-31T05:38:41.317 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.309+0000 7f0c7ee18740 1 -- start start 2024-08-31T05:38:41.317 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.309+0000 7f0c7ee18740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648eda542f0 0x5648ede25db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:41.318 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.309+0000 7f0c7ee18740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648eda5c4d0 0x5648ede3c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:41.318 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.309+0000 7f0c7ee18740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5648eda7d1b0 0x5648ede3cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:41.318 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.309+0000 7f0c7ee18740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0c701aeb30 con 0x5648eda7d1b0 2024-08-31T05:38:41.318 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.309+0000 7f0c7ee18740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0c701b0670 con 0x5648eda542f0 2024-08-31T05:38:41.318 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.309+0000 7f0c7ee18740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0c701af200 con 0x5648eda5c4d0 2024-08-31T05:38:41.318 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.309+0000 7f0c75361640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5648eda7d1b0 0x5648ede3cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:41.318 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.309+0000 7f0c75361640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648eda542f0 0x5648ede25db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:41.318 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.309+0000 7f0c75361640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648eda542f0 0x5648ede25db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:52044/0 (socket says 172.21.15.5:52044) 2024-08-31T05:38:41.318 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.309+0000 7f0c75361640 1 -- 172.21.15.5:0/1745508076 learned_addr learned my addr 172.21.15.5:0/1745508076 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:41.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.310+0000 7f0c75b62640 1 --2- 172.21.15.5:0/1745508076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648eda5c4d0 0x5648ede3c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:41.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.310+0000 7f0c75361640 1 -- 172.21.15.5:0/1745508076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648eda5c4d0 msgr2=0x5648ede3c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:41.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.310+0000 7f0c75361640 1 --2- 172.21.15.5:0/1745508076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648eda5c4d0 0x5648ede3c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.310+0000 7f0c75361640 1 -- 172.21.15.5:0/1745508076 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5648eda7d1b0 msgr2=0x5648ede3cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:41.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.310+0000 7f0c75361640 1 --2- 172.21.15.5:0/1745508076 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5648eda7d1b0 0x5648ede3cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.310+0000 7f0c75361640 1 -- 172.21.15.5:0/1745508076 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648ede1f2b0 con 0x5648eda542f0 2024-08-31T05:38:41.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.310+0000 7f0c75361640 1 --2- 172.21.15.5:0/1745508076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648eda542f0 0x5648ede25db0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0c60003d10 tx=0x7f0c60000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdbb07412cc9bf4e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:41.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.310+0000 7f0c5b7fe640 1 -- 172.21.15.5:0/1745508076 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c6000fdf0 con 0x5648eda542f0 2024-08-31T05:38:41.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.310+0000 7f0c5b7fe640 1 -- 172.21.15.5:0/1745508076 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c60011780 con 0x5648eda542f0 2024-08-31T05:38:41.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.310+0000 7f0c5b7fe640 1 -- 172.21.15.5:0/1745508076 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c600055b0 con 0x5648eda542f0 2024-08-31T05:38:41.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.311+0000 7f0c7ee18740 1 -- 172.21.15.5:0/1745508076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648eda542f0 msgr2=0x5648ede25db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:41.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.311+0000 7f0c7ee18740 1 --2- 172.21.15.5:0/1745508076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648eda542f0 0x5648ede25db0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0c60003d10 tx=0x7f0c60000bc0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.311+0000 7f0c7ee18740 1 -- 172.21.15.5:0/1745508076 shutdown_connections 2024-08-31T05:38:41.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.311+0000 7f0c7ee18740 1 --2- 172.21.15.5:0/1745508076 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5648eda7d1b0 0x5648ede3cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.311+0000 7f0c7ee18740 1 --2- 172.21.15.5:0/1745508076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648eda5c4d0 0x5648ede3c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.311+0000 7f0c7ee18740 1 --2- 172.21.15.5:0/1745508076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648eda542f0 0x5648ede25db0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.311+0000 7f0c7ee18740 1 -- 172.21.15.5:0/1745508076 >> 172.21.15.5:0/1745508076 conn(0x5648eda71300 msgr2=0x5648ede2f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:41.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.311+0000 7f0c7ee18740 1 -- 172.21.15.5:0/1745508076 shutdown_connections 2024-08-31T05:38:41.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.311+0000 7f0c7ee18740 1 -- 172.21.15.5:0/1745508076 wait complete. 2024-08-31T05:38:41.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.312+0000 7f0c7ee18740 1 -- start start 2024-08-31T05:38:41.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.312+0000 7f0c7ee18740 1 Processor -- start 2024-08-31T05:38:41.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.312+0000 7f0c7ee18740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648eda542f0 0x5648ede391c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:41.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.312+0000 7f0c7ee18740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648eda5c4d0 0x5648ede346b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:41.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.312+0000 7f0c7ee18740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5648eda7d1b0 0x5648ede34ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:41.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.312+0000 7f0c7ee18740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0c701affa0 con 0x5648eda7d1b0 2024-08-31T05:38:41.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.312+0000 7f0c7ee18740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0c701af8d0 con 0x5648eda5c4d0 2024-08-31T05:38:41.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.312+0000 7f0c7ee18740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0c701acb30 con 0x5648eda542f0 2024-08-31T05:38:41.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.312+0000 7f0c7ee18740 10 client.0 _ll_register_callbacks cb 0x7f0c60011650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:38:41.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.312+0000 7f0c75361640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5648eda7d1b0 0x5648ede34ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:41.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.312+0000 7f0c75361640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5648eda7d1b0 0x5648ede34ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37046/0 (socket says 172.21.15.5:37046) 2024-08-31T05:38:41.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.312+0000 7f0c75b62640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648eda5c4d0 0x5648ede346b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:41.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.312+0000 7f0c75361640 1 -- 172.21.15.5:0/1248843425 learned_addr learned my addr 172.21.15.5:0/1248843425 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:41.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.312+0000 7f0c75361640 1 --2- 172.21.15.5:0/1248843425 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648eda542f0 0x5648ede391c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:41.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.313+0000 7f0c75361640 1 -- 172.21.15.5:0/1248843425 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648eda542f0 msgr2=0x5648ede391c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:41.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.313+0000 7f0c75361640 1 --2- 172.21.15.5:0/1248843425 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648eda542f0 0x5648ede391c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.313+0000 7f0c75361640 1 -- 172.21.15.5:0/1248843425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648eda5c4d0 msgr2=0x5648ede346b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:41.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.313+0000 7f0c75361640 1 --2- 172.21.15.5:0/1248843425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648eda5c4d0 0x5648ede346b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.313+0000 7f0c75361640 1 -- 172.21.15.5:0/1248843425 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648ede35470 con 0x5648eda7d1b0 2024-08-31T05:38:41.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.313+0000 7f0c75361640 1 --2- 172.21.15.5:0/1248843425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5648eda7d1b0 0x5648ede34ce0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f0c600059f0 tx=0x7f0c60009280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=257b473aeb1671cd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:41.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.313+0000 7f0c597fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:38:41.323 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.313+0000 7f0c597fa640 1 -- 172.21.15.5:0/1248843425 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c60040040 con 0x5648eda7d1b0 2024-08-31T05:38:41.323 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.314+0000 7f0c7ee18740 1 -- 172.21.15.5:0/1248843425 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c60011780 con 0x5648eda7d1b0 2024-08-31T05:38:41.323 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.313+0000 7f0c597fa640 1 -- 172.21.15.5:0/1248843425 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7f0c60039440 con 0x5648eda7d1b0 2024-08-31T05:38:41.323 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.314+0000 7f0c597fa640 1 -- 172.21.15.5:0/1248843425 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f0c6004e050 con 0x5648eda7d1b0 2024-08-31T05:38:41.323 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.314+0000 7f0c7ee18740 10 client.17892 fetch_fsmap learned FSMap version 34 2024-08-31T05:38:41.323 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.314+0000 7f0c7ee18740 1 -- 172.21.15.5:0/1248843425 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5648edead330 con 0x5648eda7d1b0 2024-08-31T05:38:41.323 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.314+0000 7f0c597fa640 1 -- 172.21.15.5:0/1248843425 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c60005c50 con 0x5648eda7d1b0 2024-08-31T05:38:41.323 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.314+0000 7f0c597fa640 1 -- 172.21.15.5:0/1248843425 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f0c60046070 con 0x5648eda7d1b0 2024-08-31T05:38:41.324 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.314+0000 7f0c7ee18740 10 client.17892 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:38:41.324 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.314+0000 7f0c7ee18740 10 client.17892 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:38:41.324 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.314+0000 7f0c7ee18740 20 client.17892 populate_metadata read hostname 'smithi005' 2024-08-31T05:38:41.324 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.314+0000 7f0c7ee18740 1 --2- 172.21.15.5:0/1248843425 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5648eda111c0 0x5648edeaf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:41.324 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.314+0000 7f0c7ee18740 4 client.17892 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:38:41.324 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.314+0000 7f0c7ee18740 1 -- 172.21.15.5:0/1248843425 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f0c60011780 con 0x5648eda111c0 2024-08-31T05:38:41.324 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.315+0000 7f0c75b62640 1 --2- 172.21.15.5:0/1248843425 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5648eda111c0 0x5648edeaf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:41.324 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.315+0000 7f0c597fa640 10 client.17892 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:38:41.324 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.315+0000 7f0c75b62640 1 --2- 172.21.15.5:0/1248843425 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5648eda111c0 0x5648edeaf980 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1bf541991576e134 server_cookie=f0158b9fecb104a7 in_seq=0 out_seq=0 2024-08-31T05:38:41.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.328+0000 7f0c597fa640 1 -- 172.21.15.5:0/1248843425 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f0c60011780 con 0x5648eda111c0 2024-08-31T05:38:41.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.329+0000 7f0c597fa640 10 client.17892 handle_command_reply: tid=0 2024-08-31T05:38:41.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.329+0000 7f0c7ee18740 1 client.17892 shutdown 2024-08-31T05:38:41.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.329+0000 7f0c7ee18740 1 -- 172.21.15.5:0/1248843425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5648eda7d1b0 msgr2=0x5648ede34ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:41.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.329+0000 7f0c7ee18740 1 --2- 172.21.15.5:0/1248843425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5648eda7d1b0 0x5648ede34ce0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f0c600059f0 tx=0x7f0c60009280 comp rx=0 tx=0).stop 2024-08-31T05:38:41.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.329+0000 7f0c7ee18740 1 -- 172.21.15.5:0/1248843425 shutdown_connections 2024-08-31T05:38:41.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.329+0000 7f0c7ee18740 1 --2- 172.21.15.5:0/1248843425 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5648eda111c0 0x5648edeaf980 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.329+0000 7f0c7ee18740 1 --2- 172.21.15.5:0/1248843425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5648eda7d1b0 0x5648ede34ce0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.329+0000 7f0c7ee18740 1 --2- 172.21.15.5:0/1248843425 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5648eda5c4d0 0x5648ede346b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.329+0000 7f0c7ee18740 1 --2- 172.21.15.5:0/1248843425 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648eda542f0 0x5648ede391c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.329+0000 7f0c7ee18740 1 -- 172.21.15.5:0/1248843425 >> 172.21.15.5:0/1248843425 conn(0x5648eda71300 msgr2=0x5648ede21ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:41.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.329+0000 7f0c597fa640 0 client.17892 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:38:41.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.329+0000 7f0c7ee18740 1 -- 172.21.15.5:0/1248843425 shutdown_connections 2024-08-31T05:38:41.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.329+0000 7f0c7ee18740 1 -- 172.21.15.5:0/1248843425 wait complete. 2024-08-31T05:38:41.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.329+0000 7f0c7ee18740 20 client.17892 trim_cache size 0 max 16384 2024-08-31T05:38:41.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:38:41.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:38:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:38:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:38:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.330+0000 7f0c77dc6640 1 -- 172.21.15.5:0/2971138713 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f0c5c0b4ca0 msgr2=0x7f0c5c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.330+0000 7f0c77dc6640 1 --2- 172.21.15.5:0/2971138713 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f0c5c0b4ca0 0x7f0c5c0b71b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f0c680a93f0 tx=0x7f0c68000f40 comp rx=0 tx=0).stop 2024-08-31T05:38:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.330+0000 7f0c77dc6640 1 -- 172.21.15.5:0/2971138713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c70109c30 msgr2=0x7f0c7019fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.330+0000 7f0c77dc6640 1 --2- 172.21.15.5:0/2971138713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c70109c30 0x7f0c7019fb40 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f0c6800eb10 tx=0x7f0c6800c2d0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.330+0000 7f0c77dc6640 1 -- 172.21.15.5:0/2971138713 shutdown_connections 2024-08-31T05:38:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.330+0000 7f0c77dc6640 1 --2- 172.21.15.5:0/2971138713 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f0c5c0b4ca0 0x7f0c5c0b71b0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.330+0000 7f0c77dc6640 1 --2- 172.21.15.5:0/2971138713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0c70109c30 0x7f0c7019fb40 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.330+0000 7f0c77dc6640 1 --2- 172.21.15.5:0/2971138713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0c701092e0 0x7f0c7019a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.330+0000 7f0c77dc6640 1 --2- 172.21.15.5:0/2971138713 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c701038a0 0x7f0c7019a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.330+0000 7f0c77dc6640 1 -- 172.21.15.5:0/2971138713 >> 172.21.15.5:0/2971138713 conn(0x7f0c700ff2c0 msgr2=0x7f0c701016e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.330+0000 7f0c77dc6640 1 -- 172.21.15.5:0/2971138713 shutdown_connections 2024-08-31T05:38:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:41.330+0000 7f0c77dc6640 1 -- 172.21.15.5:0/2971138713 wait complete. 2024-08-31T05:38:41.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:38:40 smithi070 ceph-mon[22316]: pgmap v610: 129 pgs: 129 active+clean; 500 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.3 MiB/s wr, 209 op/s 2024-08-31T05:38:41.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:38:40 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:38:41.931 INFO:tasks.workunit.client.0.smithi005.stdout: 1 984548 11.27 MB/sec execute 329 sec latency 48.673 ms 2024-08-31T05:38:41.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:38:41 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:38:41.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:38:41 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:38:41.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:38:41 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:38:42.090 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T05:38:42.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:38:41 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:38:42.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:38:41 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:38:42.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:38:41 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:38:42.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:38:41 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:38:42.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:38:41 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:38:42.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:38:41 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:38:42.416 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:38:42.931 INFO:tasks.workunit.client.0.smithi005.stdout: 1 986503 11.26 MB/sec execute 330 sec latency 31.156 ms 2024-08-31T05:38:43.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.908+0000 7ff1db9e5640 1 -- 172.21.15.5:0/2207819654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1d4102840 msgr2=0x7ff1d4102c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:43.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.908+0000 7ff1db9e5640 1 --2- 172.21.15.5:0/2207819654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1d4102840 0x7ff1d4102c50 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0009900 tx=0x7ff1d002a410 comp rx=0 tx=0).stop 2024-08-31T05:38:43.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.908+0000 7ff1db9e5640 1 -- 172.21.15.5:0/2207819654 shutdown_connections 2024-08-31T05:38:43.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.908+0000 7ff1db9e5640 1 --2- 172.21.15.5:0/2207819654 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1d4108ad0 0x7ff1d410f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:43.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.908+0000 7ff1db9e5640 1 --2- 172.21.15.5:0/2207819654 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1d4108180 0x7ff1d4108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:43.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.908+0000 7ff1db9e5640 1 --2- 172.21.15.5:0/2207819654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1d4102840 0x7ff1d4102c50 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:43.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.909+0000 7ff1db9e5640 1 -- 172.21.15.5:0/2207819654 >> 172.21.15.5:0/2207819654 conn(0x7ff1d4079580 msgr2=0x7ff1d4079990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:43.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.909+0000 7ff1db9e5640 1 -- 172.21.15.5:0/2207819654 shutdown_connections 2024-08-31T05:38:43.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.909+0000 7ff1db9e5640 1 -- 172.21.15.5:0/2207819654 wait complete. 2024-08-31T05:38:43.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.909+0000 7ff1db9e5640 1 Processor -- start 2024-08-31T05:38:43.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.909+0000 7ff1db9e5640 1 -- start start 2024-08-31T05:38:43.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.910+0000 7ff1db9e5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1d4102840 0x7ff1d419a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:43.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.910+0000 7ff1db9e5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1d4108180 0x7ff1d419a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:43.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.910+0000 7ff1db9e5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1d4108ad0 0x7ff1d419fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:43.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.910+0000 7ff1db9e5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d4112730 con 0x7ff1d4108180 2024-08-31T05:38:43.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.910+0000 7ff1db9e5640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d41125b0 con 0x7ff1d4108ad0 2024-08-31T05:38:43.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.910+0000 7ff1db9e5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d41128b0 con 0x7ff1d4102840 2024-08-31T05:38:43.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.910+0000 7ff1d8f80640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1d4108180 0x7ff1d419a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:43.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.910+0000 7ff1d8f80640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1d4108180 0x7ff1d419a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45622/0 (socket says 172.21.15.5:45622) 2024-08-31T05:38:43.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.910+0000 7ff1d8f80640 1 -- 172.21.15.5:0/941025037 learned_addr learned my addr 172.21.15.5:0/941025037 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:43.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.910+0000 7ff1d9781640 1 --2- 172.21.15.5:0/941025037 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1d4102840 0x7ff1d419a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:43.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.910+0000 7ff1d9f82640 1 --2- 172.21.15.5:0/941025037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1d4108ad0 0x7ff1d419fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:43.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.910+0000 7ff1d8f80640 1 -- 172.21.15.5:0/941025037 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1d4102840 msgr2=0x7ff1d419a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:43.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.910+0000 7ff1d8f80640 1 --2- 172.21.15.5:0/941025037 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1d4102840 0x7ff1d419a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:43.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.910+0000 7ff1d8f80640 1 -- 172.21.15.5:0/941025037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1d4108ad0 msgr2=0x7ff1d419fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:43.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.910+0000 7ff1d8f80640 1 --2- 172.21.15.5:0/941025037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1d4108ad0 0x7ff1d419fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:43.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.910+0000 7ff1d8f80640 1 -- 172.21.15.5:0/941025037 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1d41a01e0 con 0x7ff1d4108180 2024-08-31T05:38:43.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.910+0000 7ff1d8f80640 1 --2- 172.21.15.5:0/941025037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1d4108180 0x7ff1d419a8d0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7ff1c400e9c0 tx=0x7ff1c400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:43.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.911+0000 7ff1ca7fc640 1 -- 172.21.15.5:0/941025037 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c400cd80 con 0x7ff1d4108180 2024-08-31T05:38:43.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.911+0000 7ff1db9e5640 1 -- 172.21.15.5:0/941025037 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1d41a04d0 con 0x7ff1d4108180 2024-08-31T05:38:43.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.911+0000 7ff1ca7fc640 1 -- 172.21.15.5:0/941025037 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1c40054d0 con 0x7ff1d4108180 2024-08-31T05:38:43.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.911+0000 7ff1ca7fc640 1 -- 172.21.15.5:0/941025037 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c4010430 con 0x7ff1d4108180 2024-08-31T05:38:43.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.911+0000 7ff1db9e5640 1 -- 172.21.15.5:0/941025037 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1d41a6cf0 con 0x7ff1d4108180 2024-08-31T05:38:43.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.914+0000 7ff1e1f5a740 1 Processor -- start 2024-08-31T05:38:43.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.914+0000 7ff1e1f5a740 1 -- start start 2024-08-31T05:38:43.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.915+0000 7ff1e1f5a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561d0c30a070 0x561d0c6af310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:43.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.915+0000 7ff1e1f5a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d0c2e11b0 0x561d0c6af850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:43.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.915+0000 7ff1e1f5a740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d0c2e9390 0x561d0c6afd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:43.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.915+0000 7ff1e1f5a740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x561d0c626680 con 0x561d0c2e9390 2024-08-31T05:38:43.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.915+0000 7ff1e1f5a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x561d0c615c10 con 0x561d0c30a070 2024-08-31T05:38:43.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.915+0000 7ff1e1f5a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561d0c619bc0 con 0x561d0c2e11b0 2024-08-31T05:38:43.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.915+0000 7ff1d9f82640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561d0c30a070 0x561d0c6af310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:43.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.915+0000 7ff1d9f82640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561d0c30a070 0x561d0c6af310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:39190/0 (socket says 172.21.15.5:39190) 2024-08-31T05:38:43.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.915+0000 7ff1d9f82640 1 -- 172.21.15.5:0/487781243 learned_addr learned my addr 172.21.15.5:0/487781243 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:43.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.915+0000 7ff1ca7fc640 1 -- 172.21.15.5:0/941025037 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7ff1c4004f90 con 0x7ff1d4108180 2024-08-31T05:38:43.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.915+0000 7ff1d9781640 1 --2- 172.21.15.5:0/487781243 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d0c2e11b0 0x561d0c6af850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:43.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.915+0000 7ff1d9f82640 1 -- 172.21.15.5:0/487781243 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d0c2e11b0 msgr2=0x561d0c6af850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:43.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.915+0000 7ff1d9f82640 1 --2- 172.21.15.5:0/487781243 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d0c2e11b0 0x561d0c6af850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:43.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.915+0000 7ff1d9f82640 1 -- 172.21.15.5:0/487781243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d0c2e9390 msgr2=0x561d0c6afd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:43.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.915+0000 7ff1d8f80640 1 --2- 172.21.15.5:0/487781243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d0c2e9390 0x561d0c6afd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:43.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.916+0000 7ff1d9f82640 1 --2- 172.21.15.5:0/487781243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d0c2e9390 0x561d0c6afd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:43.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.916+0000 7ff1d9f82640 1 -- 172.21.15.5:0/487781243 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d0c375650 con 0x561d0c30a070 2024-08-31T05:38:43.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.916+0000 7ff1d8f80640 1 --2- 172.21.15.5:0/487781243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d0c2e9390 0x561d0c6afd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:38:43.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.916+0000 7ff1d9f82640 1 --2- 172.21.15.5:0/487781243 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561d0c30a070 0x561d0c6af310 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc007ec0 tx=0x7ff1cc00f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3bb6139f6ee2207 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:43.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.916+0000 7ff1bf7fe640 1 -- 172.21.15.5:0/487781243 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc010840 con 0x561d0c30a070 2024-08-31T05:38:43.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.916+0000 7ff1bf7fe640 1 -- 172.21.15.5:0/487781243 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1cc0183f0 con 0x561d0c30a070 2024-08-31T05:38:43.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.916+0000 7ff1bf7fe640 1 -- 172.21.15.5:0/487781243 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc017600 con 0x561d0c30a070 2024-08-31T05:38:43.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.916+0000 7ff1ca7fc640 1 --2- 172.21.15.5:0/941025037 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff1c00b4cd0 0x7ff1c00b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:43.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.917+0000 7ff1d9781640 1 --2- 172.21.15.5:0/941025037 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff1c00b4cd0 0x7ff1c00b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:43.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.917+0000 7ff1ca7fc640 1 -- 172.21.15.5:0/941025037 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7ff1c40e5d20 con 0x7ff1d4108180 2024-08-31T05:38:43.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.917+0000 7ff1e1f5a740 1 -- 172.21.15.5:0/487781243 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561d0c30a070 msgr2=0x561d0c6af310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:43.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.917+0000 7ff1d9781640 1 --2- 172.21.15.5:0/941025037 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff1c00b4cd0 0x7ff1c00b71e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0031440 tx=0x7ff1d0009640 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:43.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.917+0000 7ff1e1f5a740 1 --2- 172.21.15.5:0/487781243 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561d0c30a070 0x561d0c6af310 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc007ec0 tx=0x7ff1cc00f790 comp rx=0 tx=0).stop 2024-08-31T05:38:43.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.917+0000 7ff1e1f5a740 1 -- 172.21.15.5:0/487781243 shutdown_connections 2024-08-31T05:38:43.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.917+0000 7ff1e1f5a740 1 --2- 172.21.15.5:0/487781243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d0c2e9390 0x561d0c6afd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:43.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.917+0000 7ff1e1f5a740 1 --2- 172.21.15.5:0/487781243 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d0c2e11b0 0x561d0c6af850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:43.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.917+0000 7ff1e1f5a740 1 --2- 172.21.15.5:0/487781243 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561d0c30a070 0x561d0c6af310 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:43.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.917+0000 7ff1e1f5a740 1 -- 172.21.15.5:0/487781243 >> 172.21.15.5:0/487781243 conn(0x561d0c2fe460 msgr2=0x561d0c6ad200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:43.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.917+0000 7ff1e1f5a740 1 -- 172.21.15.5:0/487781243 shutdown_connections 2024-08-31T05:38:43.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.917+0000 7ff1e1f5a740 1 -- 172.21.15.5:0/487781243 wait complete. 2024-08-31T05:38:43.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.918+0000 7ff1e1f5a740 1 -- start start 2024-08-31T05:38:43.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.918+0000 7ff1e1f5a740 1 Processor -- start 2024-08-31T05:38:43.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.918+0000 7ff1e1f5a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561d0c2e11b0 0x561d0c6baad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:43.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.918+0000 7ff1e1f5a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d0c2e9390 0x561d0c6bb010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:43.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.918+0000 7ff1e1f5a740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d0c30a070 0x561d0c6c6de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:43.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.918+0000 7ff1e1f5a740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x561d0c478700 con 0x561d0c30a070 2024-08-31T05:38:43.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.918+0000 7ff1e1f5a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x561d0c59c750 con 0x561d0c2e11b0 2024-08-31T05:38:43.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.918+0000 7ff1e1f5a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561d0c6bdaf0 con 0x561d0c2e9390 2024-08-31T05:38:43.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.918+0000 7ff1e1f5a740 10 client.0 _ll_register_callbacks cb 0x561d0c5cbe10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:38:43.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.918+0000 7ff1d9f82640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d0c30a070 0x561d0c6c6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:43.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.918+0000 7ff1d9f82640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d0c30a070 0x561d0c6c6de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45648/0 (socket says 172.21.15.5:45648) 2024-08-31T05:38:43.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.918+0000 7ff1d9f82640 1 -- 172.21.15.5:0/1501594194 learned_addr learned my addr 172.21.15.5:0/1501594194 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:43.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.918+0000 7ff1d8f80640 1 --2- 172.21.15.5:0/1501594194 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d0c2e9390 0x561d0c6bb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:43.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.918+0000 7ff1d9781640 1 --2- 172.21.15.5:0/1501594194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561d0c2e11b0 0x561d0c6baad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:43.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.919+0000 7ff1d9f82640 1 -- 172.21.15.5:0/1501594194 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d0c2e9390 msgr2=0x561d0c6bb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:43.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.919+0000 7ff1d9f82640 1 --2- 172.21.15.5:0/1501594194 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d0c2e9390 0x561d0c6bb010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:43.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.919+0000 7ff1d9f82640 1 -- 172.21.15.5:0/1501594194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561d0c2e11b0 msgr2=0x561d0c6baad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:43.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.919+0000 7ff1d9f82640 1 --2- 172.21.15.5:0/1501594194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561d0c2e11b0 0x561d0c6baad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:43.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.919+0000 7ff1d9f82640 1 -- 172.21.15.5:0/1501594194 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d0c5d5900 con 0x561d0c30a070 2024-08-31T05:38:43.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.919+0000 7ff1d9781640 1 --2- 172.21.15.5:0/1501594194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561d0c2e11b0 0x561d0c6baad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:38:43.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.919+0000 7ff1d8f80640 1 --2- 172.21.15.5:0/1501594194 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d0c2e9390 0x561d0c6bb010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:38:43.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.919+0000 7ff1d9f82640 1 --2- 172.21.15.5:0/1501594194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d0c30a070 0x561d0c6c6de0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc000f80 tx=0x7ff1cc005ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=518917d138d22fa5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:43.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.919+0000 7ff1bcff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:38:43.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.919+0000 7ff1bcff9640 1 -- 172.21.15.5:0/1501594194 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc026020 con 0x561d0c30a070 2024-08-31T05:38:43.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.919+0000 7ff1bcff9640 1 -- 172.21.15.5:0/1501594194 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7ff1cc003c40 con 0x561d0c30a070 2024-08-31T05:38:43.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.919+0000 7ff1e1f5a740 1 -- 172.21.15.5:0/1501594194 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1cc0183f0 con 0x561d0c30a070 2024-08-31T05:38:43.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.920+0000 7ff1bcff9640 1 -- 172.21.15.5:0/1501594194 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ff1cc031050 con 0x561d0c30a070 2024-08-31T05:38:43.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.920+0000 7ff1e1f5a740 10 client.17901 fetch_fsmap learned FSMap version 34 2024-08-31T05:38:43.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.920+0000 7ff1e1f5a740 1 -- 172.21.15.5:0/1501594194 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x561d0c6c9890 con 0x561d0c30a070 2024-08-31T05:38:43.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.920+0000 7ff1bcff9640 1 -- 172.21.15.5:0/1501594194 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1cc0183f0 con 0x561d0c30a070 2024-08-31T05:38:43.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.920+0000 7ff1bcff9640 1 -- 172.21.15.5:0/1501594194 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7ff1cc004160 con 0x561d0c30a070 2024-08-31T05:38:43.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.920+0000 7ff1e1f5a740 10 client.17901 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:38:43.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.920+0000 7ff1e1f5a740 10 client.17901 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-31T05:38:43.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.920+0000 7ff1e1f5a740 20 client.17901 populate_metadata read hostname 'smithi005' 2024-08-31T05:38:43.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.920+0000 7ff1e1f5a740 1 --2- 172.21.15.5:0/1501594194 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x561d0c2c89f0 0x561d0c6ccd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:43.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.920+0000 7ff1e1f5a740 4 client.17901 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:38:43.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.920+0000 7ff1e1f5a740 1 -- 172.21.15.5:0/1501594194 --> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561d0c6285d0 con 0x561d0c2c89f0 2024-08-31T05:38:43.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.920+0000 7ff1d9781640 1 --2- 172.21.15.5:0/1501594194 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x561d0c2c89f0 0x561d0c6ccd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:43.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.921+0000 7ff1bcff9640 10 client.17901 ms_handle_connect on v2:172.21.15.70:6836/2780036414 2024-08-31T05:38:43.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.921+0000 7ff1d9781640 1 --2- 172.21.15.5:0/1501594194 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x561d0c2c89f0 0x561d0c6ccd60 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=39cdcca505375bf server_cookie=6802aedaf0424f3d in_seq=0 out_seq=0 2024-08-31T05:38:43.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.922+0000 7ff1bcff9640 1 -- 172.21.15.5:0/1501594194 <== mds.2 v2:172.21.15.70:6836/2780036414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561d0c6285d0 con 0x561d0c2c89f0 2024-08-31T05:38:43.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.922+0000 7ff1bcff9640 10 client.17901 handle_command_reply: tid=0 2024-08-31T05:38:43.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.922+0000 7ff1e1f5a740 1 client.17901 shutdown 2024-08-31T05:38:43.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.922+0000 7ff1e1f5a740 1 -- 172.21.15.5:0/1501594194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d0c30a070 msgr2=0x561d0c6c6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:43.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.922+0000 7ff1e1f5a740 1 --2- 172.21.15.5:0/1501594194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d0c30a070 0x561d0c6c6de0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc000f80 tx=0x7ff1cc005ac0 comp rx=0 tx=0).stop 2024-08-31T05:38:43.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.922+0000 7ff1e1f5a740 1 -- 172.21.15.5:0/1501594194 shutdown_connections 2024-08-31T05:38:43.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.922+0000 7ff1e1f5a740 1 --2- 172.21.15.5:0/1501594194 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x561d0c2c89f0 0x561d0c6ccd60 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:43.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.922+0000 7ff1e1f5a740 1 --2- 172.21.15.5:0/1501594194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d0c30a070 0x561d0c6c6de0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:43.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.922+0000 7ff1e1f5a740 1 --2- 172.21.15.5:0/1501594194 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d0c2e9390 0x561d0c6bb010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:43.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.922+0000 7ff1e1f5a740 1 --2- 172.21.15.5:0/1501594194 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561d0c2e11b0 0x561d0c6baad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:43.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.922+0000 7ff1e1f5a740 1 -- 172.21.15.5:0/1501594194 >> 172.21.15.5:0/1501594194 conn(0x561d0c2fe460 msgr2=0x561d0c6b24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:43.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.922+0000 7ff1bcff9640 0 client.17901 ms_handle_reset on v2:172.21.15.70:6836/2780036414 2024-08-31T05:38:43.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.922+0000 7ff1e1f5a740 1 -- 172.21.15.5:0/1501594194 shutdown_connections 2024-08-31T05:38:43.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.922+0000 7ff1e1f5a740 1 -- 172.21.15.5:0/1501594194 wait complete. 2024-08-31T05:38:43.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.922+0000 7ff1e1f5a740 20 client.17901 trim_cache size 0 max 16384 2024-08-31T05:38:43.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.937+0000 7ff1e1f5a740 1 Processor -- start 2024-08-31T05:38:43.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.937+0000 7ff1e1f5a740 1 -- start start 2024-08-31T05:38:43.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.937+0000 7ff1e1f5a740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d0c2e11b0 0x561d0c6b2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:43.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.937+0000 7ff1e1f5a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561d0c2e9390 0x561d0c6c6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:43.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.937+0000 7ff1e1f5a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d0c30a070 0x561d0c6c7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:43.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.937+0000 7ff1e1f5a740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d41b0e20 con 0x561d0c2e11b0 2024-08-31T05:38:43.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.937+0000 7ff1e1f5a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d41b2960 con 0x561d0c2e9390 2024-08-31T05:38:43.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.937+0000 7ff1e1f5a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d41b14f0 con 0x561d0c30a070 2024-08-31T05:38:43.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.937+0000 7ff1d9781640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d0c2e11b0 0x561d0c6b2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:43.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.937+0000 7ff1d9781640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d0c2e11b0 0x561d0c6b2b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45654/0 (socket says 172.21.15.5:45654) 2024-08-31T05:38:43.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.937+0000 7ff1d8f80640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561d0c2e9390 0x561d0c6c6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:43.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.937+0000 7ff1d9781640 1 -- 172.21.15.5:0/1115802460 learned_addr learned my addr 172.21.15.5:0/1115802460 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:43.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.937+0000 7ff1d9f82640 1 --2- 172.21.15.5:0/1115802460 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d0c30a070 0x561d0c6c7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:43.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.938+0000 7ff1d8f80640 1 -- 172.21.15.5:0/1115802460 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d0c30a070 msgr2=0x561d0c6c7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:43.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.938+0000 7ff1d8f80640 1 --2- 172.21.15.5:0/1115802460 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d0c30a070 0x561d0c6c7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:43.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.938+0000 7ff1d8f80640 1 -- 172.21.15.5:0/1115802460 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d0c2e11b0 msgr2=0x561d0c6b2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:43.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.938+0000 7ff1d8f80640 1 --2- 172.21.15.5:0/1115802460 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d0c2e11b0 0x561d0c6b2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:43.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.938+0000 7ff1d8f80640 1 -- 172.21.15.5:0/1115802460 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d0c6b3060 con 0x561d0c2e9390 2024-08-31T05:38:43.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.938+0000 7ff1d8f80640 1 --2- 172.21.15.5:0/1115802460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561d0c2e9390 0x561d0c6c6ce0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff1c40e3090 tx=0x7ff1c40049b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=221082284b60bdcd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:43.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.938+0000 7ff1beffd640 1 -- 172.21.15.5:0/1115802460 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c40d1070 con 0x561d0c2e9390 2024-08-31T05:38:43.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.938+0000 7ff1beffd640 1 -- 172.21.15.5:0/1115802460 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1c40abb40 con 0x561d0c2e9390 2024-08-31T05:38:43.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.938+0000 7ff1beffd640 1 -- 172.21.15.5:0/1115802460 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c40a82c0 con 0x561d0c2e9390 2024-08-31T05:38:43.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.939+0000 7ff1e1f5a740 1 -- 172.21.15.5:0/1115802460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561d0c2e9390 msgr2=0x561d0c6c6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:43.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.939+0000 7ff1e1f5a740 1 --2- 172.21.15.5:0/1115802460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561d0c2e9390 0x561d0c6c6ce0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff1c40e3090 tx=0x7ff1c40049b0 comp rx=0 tx=0).stop 2024-08-31T05:38:43.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.939+0000 7ff1e1f5a740 1 -- 172.21.15.5:0/1115802460 shutdown_connections 2024-08-31T05:38:43.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.939+0000 7ff1e1f5a740 1 --2- 172.21.15.5:0/1115802460 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d0c30a070 0x561d0c6c7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:43.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.939+0000 7ff1e1f5a740 1 --2- 172.21.15.5:0/1115802460 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561d0c2e9390 0x561d0c6c6ce0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:43.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.939+0000 7ff1e1f5a740 1 --2- 172.21.15.5:0/1115802460 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d0c2e11b0 0x561d0c6b2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:43.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.939+0000 7ff1e1f5a740 1 -- 172.21.15.5:0/1115802460 >> 172.21.15.5:0/1115802460 conn(0x561d0c2fe460 msgr2=0x561d0c6b2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:43.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.939+0000 7ff1e1f5a740 1 -- 172.21.15.5:0/1115802460 shutdown_connections 2024-08-31T05:38:43.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.939+0000 7ff1e1f5a740 1 -- 172.21.15.5:0/1115802460 wait complete. 2024-08-31T05:38:43.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.939+0000 7ff1e1f5a740 1 -- start start 2024-08-31T05:38:43.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.939+0000 7ff1e1f5a740 1 Processor -- start 2024-08-31T05:38:43.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.940+0000 7ff1e1f5a740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d0c2e11b0 0x561d0c6be510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:43.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.940+0000 7ff1e1f5a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d0c2e9390 0x561d0c6bea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:43.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.940+0000 7ff1e1f5a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561d0c30a070 0x561d0c735520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:43.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.940+0000 7ff1e1f5a740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d41b2290 con 0x561d0c2e11b0 2024-08-31T05:38:43.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.940+0000 7ff1e1f5a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d41b1bc0 con 0x561d0c30a070 2024-08-31T05:38:43.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.940+0000 7ff1e1f5a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d41aee20 con 0x561d0c2e9390 2024-08-31T05:38:43.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.940+0000 7ff1d9781640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d0c2e11b0 0x561d0c6be510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:43.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.940+0000 7ff1d9781640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d0c2e11b0 0x561d0c6be510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45662/0 (socket says 172.21.15.5:45662) 2024-08-31T05:38:43.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.940+0000 7ff1e1f5a740 10 client.0 _ll_register_callbacks cb 0x7ff1cc007d10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:38:43.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.940+0000 7ff1d9781640 1 -- 172.21.15.5:0/1681694523 learned_addr learned my addr 172.21.15.5:0/1681694523 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:43.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.940+0000 7ff1d8f80640 1 --2- 172.21.15.5:0/1681694523 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d0c2e9390 0x561d0c6bea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:43.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.940+0000 7ff1d9f82640 1 --2- 172.21.15.5:0/1681694523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561d0c30a070 0x561d0c735520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:43.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.940+0000 7ff1d9781640 1 -- 172.21.15.5:0/1681694523 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d0c2e9390 msgr2=0x561d0c6bea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:43.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.940+0000 7ff1d9781640 1 --2- 172.21.15.5:0/1681694523 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d0c2e9390 0x561d0c6bea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:43.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.940+0000 7ff1d9781640 1 -- 172.21.15.5:0/1681694523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561d0c30a070 msgr2=0x561d0c735520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:43.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.940+0000 7ff1d9781640 1 --2- 172.21.15.5:0/1681694523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561d0c30a070 0x561d0c735520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:43.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.940+0000 7ff1d9781640 1 -- 172.21.15.5:0/1681694523 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d0c735a60 con 0x561d0c2e11b0 2024-08-31T05:38:43.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.940+0000 7ff1d8f80640 1 --2- 172.21.15.5:0/1681694523 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d0c2e9390 0x561d0c6bea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:38:43.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.941+0000 7ff1d9781640 1 --2- 172.21.15.5:0/1681694523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d0c2e11b0 0x561d0c6be510 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0031760 tx=0x7ff1d003e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c42b7f34f6d32b7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:43.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.941+0000 7ff1bcff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:38:43.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.941+0000 7ff1bcff9640 1 -- 172.21.15.5:0/1681694523 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d0035040 con 0x561d0c2e11b0 2024-08-31T05:38:43.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.941+0000 7ff1bcff9640 1 -- 172.21.15.5:0/1681694523 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7ff1d0005040 con 0x561d0c2e11b0 2024-08-31T05:38:43.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.941+0000 7ff1e1f5a740 1 -- 172.21.15.5:0/1681694523 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1c40abb40 con 0x561d0c2e11b0 2024-08-31T05:38:43.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.941+0000 7ff1bcff9640 1 -- 172.21.15.5:0/1681694523 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ff1d0061050 con 0x561d0c2e11b0 2024-08-31T05:38:43.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.941+0000 7ff1e1f5a740 10 client.17907 fetch_fsmap learned FSMap version 34 2024-08-31T05:38:43.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.941+0000 7ff1e1f5a740 1 -- 172.21.15.5:0/1681694523 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x561d0c736d10 con 0x561d0c2e11b0 2024-08-31T05:38:43.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.941+0000 7ff1bcff9640 1 -- 172.21.15.5:0/1681694523 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1c40abb40 con 0x561d0c2e11b0 2024-08-31T05:38:43.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.942+0000 7ff1bcff9640 1 -- 172.21.15.5:0/1681694523 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7ff1d00035f0 con 0x561d0c2e11b0 2024-08-31T05:38:43.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.942+0000 7ff1e1f5a740 10 client.17907 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:38:43.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.942+0000 7ff1e1f5a740 10 client.17907 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-31T05:38:43.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.942+0000 7ff1e1f5a740 20 client.17907 populate_metadata read hostname 'smithi005' 2024-08-31T05:38:43.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.942+0000 7ff1e1f5a740 1 --2- 172.21.15.5:0/1681694523 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x561d0c29dda0 0x561d0c7394a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:43.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.942+0000 7ff1e1f5a740 4 client.17907 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:38:43.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.942+0000 7ff1e1f5a740 1 -- 172.21.15.5:0/1681694523 --> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561d0c624070 con 0x561d0c29dda0 2024-08-31T05:38:43.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.942+0000 7ff1d8f80640 1 --2- 172.21.15.5:0/1681694523 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x561d0c29dda0 0x561d0c7394a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:43.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.942+0000 7ff1bcff9640 10 client.17907 ms_handle_connect on v2:172.21.15.70:6836/2780036414 2024-08-31T05:38:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.942+0000 7ff1d8f80640 1 --2- 172.21.15.5:0/1681694523 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x561d0c29dda0 0x561d0c7394a0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ecc1a14c058648f5 server_cookie=56b0cf2f892291c0 in_seq=0 out_seq=0 2024-08-31T05:38:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.944+0000 7ff1bcff9640 1 -- 172.21.15.5:0/1681694523 <== mds.2 v2:172.21.15.70:6836/2780036414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561d0c624070 con 0x561d0c29dda0 2024-08-31T05:38:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.944+0000 7ff1bcff9640 10 client.17907 handle_command_reply: tid=0 2024-08-31T05:38:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.944+0000 7ff1e1f5a740 1 client.17907 shutdown 2024-08-31T05:38:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.944+0000 7ff1e1f5a740 1 -- 172.21.15.5:0/1681694523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d0c2e11b0 msgr2=0x561d0c6be510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.944+0000 7ff1e1f5a740 1 --2- 172.21.15.5:0/1681694523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d0c2e11b0 0x561d0c6be510 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0031760 tx=0x7ff1d003e070 comp rx=0 tx=0).stop 2024-08-31T05:38:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.944+0000 7ff1e1f5a740 1 -- 172.21.15.5:0/1681694523 shutdown_connections 2024-08-31T05:38:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.944+0000 7ff1e1f5a740 1 --2- 172.21.15.5:0/1681694523 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x561d0c29dda0 0x561d0c7394a0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.944+0000 7ff1e1f5a740 1 --2- 172.21.15.5:0/1681694523 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561d0c30a070 0x561d0c735520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.944+0000 7ff1e1f5a740 1 --2- 172.21.15.5:0/1681694523 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d0c2e9390 0x561d0c6bea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.944+0000 7ff1e1f5a740 1 --2- 172.21.15.5:0/1681694523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d0c2e11b0 0x561d0c6be510 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.944+0000 7ff1bcff9640 0 client.17907 ms_handle_reset on v2:172.21.15.70:6836/2780036414 2024-08-31T05:38:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.944+0000 7ff1e1f5a740 1 -- 172.21.15.5:0/1681694523 >> 172.21.15.5:0/1681694523 conn(0x561d0c2fe460 msgr2=0x561d0c6bbd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:43.052 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:38:43.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.944+0000 7ff1e1f5a740 1 -- 172.21.15.5:0/1681694523 shutdown_connections 2024-08-31T05:38:43.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.944+0000 7ff1e1f5a740 1 -- 172.21.15.5:0/1681694523 wait complete. 2024-08-31T05:38:43.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.945+0000 7ff1e1f5a740 20 client.17907 trim_cache size 0 max 16384 2024-08-31T05:38:43.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.945+0000 7ff1db9e5640 1 -- 172.21.15.5:0/941025037 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff1c00b4cd0 msgr2=0x7ff1c00b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:43.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.945+0000 7ff1db9e5640 1 --2- 172.21.15.5:0/941025037 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff1c00b4cd0 0x7ff1c00b71e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0031440 tx=0x7ff1d0009640 comp rx=0 tx=0).stop 2024-08-31T05:38:43.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.945+0000 7ff1db9e5640 1 -- 172.21.15.5:0/941025037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1d4108180 msgr2=0x7ff1d419a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:43.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.945+0000 7ff1db9e5640 1 --2- 172.21.15.5:0/941025037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1d4108180 0x7ff1d419a8d0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7ff1c400e9c0 tx=0x7ff1c400ee80 comp rx=0 tx=0).stop 2024-08-31T05:38:43.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.945+0000 7ff1db9e5640 1 -- 172.21.15.5:0/941025037 shutdown_connections 2024-08-31T05:38:43.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.945+0000 7ff1db9e5640 1 --2- 172.21.15.5:0/941025037 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff1c00b4cd0 0x7ff1c00b71e0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:43.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.945+0000 7ff1db9e5640 1 --2- 172.21.15.5:0/941025037 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff1d4108ad0 0x7ff1d419fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:43.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.945+0000 7ff1db9e5640 1 --2- 172.21.15.5:0/941025037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1d4108180 0x7ff1d419a8d0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:43.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.945+0000 7ff1db9e5640 1 --2- 172.21.15.5:0/941025037 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1d4102840 0x7ff1d419a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:43.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.945+0000 7ff1db9e5640 1 -- 172.21.15.5:0/941025037 >> 172.21.15.5:0/941025037 conn(0x7ff1d4079580 msgr2=0x7ff1d4106560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:43.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.945+0000 7ff1db9e5640 1 -- 172.21.15.5:0/941025037 shutdown_connections 2024-08-31T05:38:43.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:42.945+0000 7ff1db9e5640 1 -- 172.21.15.5:0/941025037 wait complete. 2024-08-31T05:38:43.156 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:38:42 smithi050 ceph-mon[22146]: pgmap v611: 129 pgs: 129 active+clean; 505 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.7 MiB/s wr, 176 op/s 2024-08-31T05:38:43.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:38:42 smithi005 ceph-mon[18602]: pgmap v611: 129 pgs: 129 active+clean; 505 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.7 MiB/s wr, 176 op/s 2024-08-31T05:38:43.237 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:38:42 smithi070 ceph-mon[22316]: pgmap v611: 129 pgs: 129 active+clean; 505 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.7 MiB/s wr, 176 op/s 2024-08-31T05:38:43.749 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T05:38:43.931 INFO:tasks.workunit.client.0.smithi005.stdout: 1 988436 11.26 MB/sec execute 331 sec latency 16.433 ms 2024-08-31T05:38:44.033 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:38:44.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.558+0000 7f4859aee640 1 -- 172.21.15.5:0/3873820777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4854108a90 msgr2=0x7f485410f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:44.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.558+0000 7f4859aee640 1 --2- 172.21.15.5:0/3873820777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4854108a90 0x7f485410f2c0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f484c009ca0 tx=0x7f484c02a8c0 comp rx=0 tx=0).stop 2024-08-31T05:38:44.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.559+0000 7f4859aee640 1 -- 172.21.15.5:0/3873820777 shutdown_connections 2024-08-31T05:38:44.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.559+0000 7f4859aee640 1 --2- 172.21.15.5:0/3873820777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4854108a90 0x7f485410f2c0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:44.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.559+0000 7f4859aee640 1 --2- 172.21.15.5:0/3873820777 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4854108140 0x7f4854108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:44.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.559+0000 7f4859aee640 1 --2- 172.21.15.5:0/3873820777 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4854102800 0x7f4854102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:44.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.559+0000 7f4859aee640 1 -- 172.21.15.5:0/3873820777 >> 172.21.15.5:0/3873820777 conn(0x7f48540794d0 msgr2=0x7f48540798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:44.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.559+0000 7f4859aee640 1 -- 172.21.15.5:0/3873820777 shutdown_connections 2024-08-31T05:38:44.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.559+0000 7f4859aee640 1 -- 172.21.15.5:0/3873820777 wait complete. 2024-08-31T05:38:44.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.559+0000 7f4859aee640 1 Processor -- start 2024-08-31T05:38:44.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.560+0000 7f4859aee640 1 -- start start 2024-08-31T05:38:44.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.560+0000 7f4859aee640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4854102800 0x7f485419a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:44.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.560+0000 7f4859aee640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4854108140 0x7f485419a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:44.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.560+0000 7f4859aee640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4854108a90 0x7f485419fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:44.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.560+0000 7f4859aee640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4854113820 con 0x7f4854102800 2024-08-31T05:38:44.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.560+0000 7f4859aee640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f48541136a0 con 0x7f4854108140 2024-08-31T05:38:44.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.560+0000 7f4859aee640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f48541139a0 con 0x7f4854108a90 2024-08-31T05:38:44.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.560+0000 7f48537fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4854102800 0x7f485419a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:44.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.560+0000 7f4852ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4854108140 0x7f485419a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:44.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.560+0000 7f48537fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4854102800 0x7f485419a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45686/0 (socket says 172.21.15.5:45686) 2024-08-31T05:38:44.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.560+0000 7f48537fe640 1 -- 172.21.15.5:0/3718825854 learned_addr learned my addr 172.21.15.5:0/3718825854 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:44.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.560+0000 7f4853fff640 1 --2- 172.21.15.5:0/3718825854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4854108a90 0x7f485419fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:44.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.560+0000 7f48537fe640 1 -- 172.21.15.5:0/3718825854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4854108a90 msgr2=0x7f485419fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:44.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.560+0000 7f48537fe640 1 --2- 172.21.15.5:0/3718825854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4854108a90 0x7f485419fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:44.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.560+0000 7f48537fe640 1 -- 172.21.15.5:0/3718825854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4854108140 msgr2=0x7f485419a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:44.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.560+0000 7f48537fe640 1 --2- 172.21.15.5:0/3718825854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4854108140 0x7f485419a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:44.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.561+0000 7f48537fe640 1 -- 172.21.15.5:0/3718825854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48541a0150 con 0x7f4854102800 2024-08-31T05:38:44.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.561+0000 7f48537fe640 1 --2- 172.21.15.5:0/3718825854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4854102800 0x7f485419a1e0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f484400e9f0 tx=0x7f484400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:44.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.561+0000 7f4850ff9640 1 -- 172.21.15.5:0/3718825854 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484400cd80 con 0x7f4854102800 2024-08-31T05:38:44.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.561+0000 7f4859aee640 1 -- 172.21.15.5:0/3718825854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48541a0440 con 0x7f4854102800 2024-08-31T05:38:44.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.561+0000 7f4850ff9640 1 -- 172.21.15.5:0/3718825854 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f48440108e0 con 0x7f4854102800 2024-08-31T05:38:44.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.561+0000 7f4850ff9640 1 -- 172.21.15.5:0/3718825854 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4844018980 con 0x7f4854102800 2024-08-31T05:38:44.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.561+0000 7f4859aee640 1 -- 172.21.15.5:0/3718825854 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48541a6ba0 con 0x7f4854102800 2024-08-31T05:38:44.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.564+0000 7f4860063740 1 Processor -- start 2024-08-31T05:38:44.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.564+0000 7f4860063740 1 -- start start 2024-08-31T05:38:44.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.564+0000 7f4850ff9640 1 -- 172.21.15.5:0/3718825854 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f4844010430 con 0x7f4854102800 2024-08-31T05:38:44.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.564+0000 7f4860063740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa68197070 0x55fa6853c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:44.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.564+0000 7f4860063740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa6816e1b0 0x55fa6853c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:44.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.564+0000 7f4860063740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fa68176390 0x55fa6853cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:44.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.564+0000 7f4860063740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55fa684b3680 con 0x55fa68197070 2024-08-31T05:38:44.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.564+0000 7f4860063740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55fa684a2c10 con 0x55fa68176390 2024-08-31T05:38:44.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.564+0000 7f4860063740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fa684a6bc0 con 0x55fa6816e1b0 2024-08-31T05:38:44.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.564+0000 7f4853fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa68197070 0x55fa6853c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:44.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.564+0000 7f4853fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa68197070 0x55fa6853c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45688/0 (socket says 172.21.15.5:45688) 2024-08-31T05:38:44.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.564+0000 7f4853fff640 1 -- 172.21.15.5:0/1118344264 learned_addr learned my addr 172.21.15.5:0/1118344264 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:44.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.564+0000 7f48537fe640 1 --2- 172.21.15.5:0/1118344264 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa6816e1b0 0x55fa6853c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:44.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.564+0000 7f4852ffd640 1 --2- 172.21.15.5:0/1118344264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fa68176390 0x55fa6853cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:44.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.565+0000 7f4853fff640 1 -- 172.21.15.5:0/1118344264 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa6816e1b0 msgr2=0x55fa6853c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:44.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.565+0000 7f4853fff640 1 --2- 172.21.15.5:0/1118344264 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa6816e1b0 0x55fa6853c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:44.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.565+0000 7f4853fff640 1 -- 172.21.15.5:0/1118344264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fa68176390 msgr2=0x55fa6853cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:44.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.565+0000 7f4853fff640 1 --2- 172.21.15.5:0/1118344264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fa68176390 0x55fa6853cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:44.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.565+0000 7f4853fff640 1 -- 172.21.15.5:0/1118344264 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa68202650 con 0x55fa68197070 2024-08-31T05:38:44.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.565+0000 7f4853fff640 1 --2- 172.21.15.5:0/1118344264 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa68197070 0x55fa6853c310 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f484c02f410 tx=0x7f484c02f440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4c713ad209ffda1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:44.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.565+0000 7f4839ffb640 1 -- 172.21.15.5:0/1118344264 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484c031cf0 con 0x55fa68197070 2024-08-31T05:38:44.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.565+0000 7f4839ffb640 1 -- 172.21.15.5:0/1118344264 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f484c036030 con 0x55fa68197070 2024-08-31T05:38:44.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.565+0000 7f4850ff9640 1 --2- 172.21.15.5:0/3718825854 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f483c0b4ca0 0x7f483c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:44.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.565+0000 7f4839ffb640 1 -- 172.21.15.5:0/1118344264 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484c0042a0 con 0x55fa68197070 2024-08-31T05:38:44.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.565+0000 7f48537fe640 1 --2- 172.21.15.5:0/3718825854 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f483c0b4ca0 0x7f483c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:44.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.565+0000 7f4850ff9640 1 -- 172.21.15.5:0/3718825854 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7f48440e5c30 con 0x7f4854102800 2024-08-31T05:38:44.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.566+0000 7f4860063740 1 -- 172.21.15.5:0/1118344264 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa68197070 msgr2=0x55fa6853c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:44.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.566+0000 7f48537fe640 1 --2- 172.21.15.5:0/3718825854 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f483c0b4ca0 0x7f483c0b71b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f48440e3050 tx=0x7f48440e9780 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:44.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.566+0000 7f4860063740 1 --2- 172.21.15.5:0/1118344264 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa68197070 0x55fa6853c310 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f484c02f410 tx=0x7f484c02f440 comp rx=0 tx=0).stop 2024-08-31T05:38:44.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.566+0000 7f4860063740 1 -- 172.21.15.5:0/1118344264 shutdown_connections 2024-08-31T05:38:44.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.566+0000 7f4860063740 1 --2- 172.21.15.5:0/1118344264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fa68176390 0x55fa6853cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:44.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.566+0000 7f4860063740 1 --2- 172.21.15.5:0/1118344264 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa6816e1b0 0x55fa6853c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:44.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.566+0000 7f4860063740 1 --2- 172.21.15.5:0/1118344264 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa68197070 0x55fa6853c310 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:44.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.566+0000 7f4860063740 1 -- 172.21.15.5:0/1118344264 >> 172.21.15.5:0/1118344264 conn(0x55fa6818b460 msgr2=0x55fa6853a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:44.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.566+0000 7f4860063740 1 -- 172.21.15.5:0/1118344264 shutdown_connections 2024-08-31T05:38:44.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.566+0000 7f4860063740 1 -- 172.21.15.5:0/1118344264 wait complete. 2024-08-31T05:38:44.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.567+0000 7f4860063740 1 -- start start 2024-08-31T05:38:44.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.567+0000 7f4860063740 1 Processor -- start 2024-08-31T05:38:44.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.567+0000 7f4860063740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa6816e1b0 0x55fa6854c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:44.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.567+0000 7f4860063740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fa68176390 0x55fa6854cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:44.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.567+0000 7f4860063740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa68197070 0x55fa68551ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:44.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.567+0000 7f4860063740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55fa68305700 con 0x55fa6816e1b0 2024-08-31T05:38:44.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.567+0000 7f4860063740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55fa68429750 con 0x55fa68176390 2024-08-31T05:38:44.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.567+0000 7f4860063740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fa6854a910 con 0x55fa68197070 2024-08-31T05:38:44.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.567+0000 7f4860063740 10 client.0 _ll_register_callbacks cb 0x55fa68458e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:38:44.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.567+0000 7f4853fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa6816e1b0 0x55fa6854c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:44.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.567+0000 7f4853fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa6816e1b0 0x55fa6854c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45696/0 (socket says 172.21.15.5:45696) 2024-08-31T05:38:44.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.567+0000 7f4853fff640 1 -- 172.21.15.5:0/3415803534 learned_addr learned my addr 172.21.15.5:0/3415803534 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:44.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.567+0000 7f4852ffd640 1 --2- 172.21.15.5:0/3415803534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fa68176390 0x55fa6854cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:44.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.567+0000 7f4853fff640 1 --2- 172.21.15.5:0/3415803534 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa68197070 0x55fa68551ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:44.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.568+0000 7f4852ffd640 1 -- 172.21.15.5:0/3415803534 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa68197070 msgr2=0x55fa68551ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:44.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.568+0000 7f4852ffd640 1 --2- 172.21.15.5:0/3415803534 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa68197070 0x55fa68551ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:44.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.568+0000 7f4852ffd640 1 -- 172.21.15.5:0/3415803534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa6816e1b0 msgr2=0x55fa6854c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:44.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.568+0000 7f4852ffd640 1 --2- 172.21.15.5:0/3415803534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa6816e1b0 0x55fa6854c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:44.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.568+0000 7f4852ffd640 1 -- 172.21.15.5:0/3415803534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa68462900 con 0x55fa68176390 2024-08-31T05:38:44.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.568+0000 7f4852ffd640 1 --2- 172.21.15.5:0/3415803534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fa68176390 0x55fa6854cb80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f485406a840 tx=0x7f4848012b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c59befd7eae42b1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:44.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.568+0000 7f4832ffd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:38:44.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.568+0000 7f4832ffd640 1 -- 172.21.15.5:0/3415803534 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484800f8c0 con 0x55fa68176390 2024-08-31T05:38:44.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.568+0000 7f4860063740 1 -- 172.21.15.5:0/3415803534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f484c036030 con 0x55fa68176390 2024-08-31T05:38:44.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.568+0000 7f4832ffd640 1 -- 172.21.15.5:0/3415803534 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7f484800fa60 con 0x55fa68176390 2024-08-31T05:38:44.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.568+0000 7f4832ffd640 1 -- 172.21.15.5:0/3415803534 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f484800fc60 con 0x55fa68176390 2024-08-31T05:38:44.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.568+0000 7f4860063740 10 client.27494 fetch_fsmap learned FSMap version 34 2024-08-31T05:38:44.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.568+0000 7f4860063740 1 -- 172.21.15.5:0/3415803534 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55fa6855aba0 con 0x55fa68176390 2024-08-31T05:38:44.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.569+0000 7f4832ffd640 1 -- 172.21.15.5:0/3415803534 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f484c036030 con 0x55fa68176390 2024-08-31T05:38:44.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.569+0000 7f4832ffd640 1 -- 172.21.15.5:0/3415803534 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f484801c420 con 0x55fa68176390 2024-08-31T05:38:44.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.569+0000 7f4860063740 10 client.27494 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:38:44.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.569+0000 7f4860063740 10 client.27494 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-31T05:38:44.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.569+0000 7f4860063740 20 client.27494 populate_metadata read hostname 'smithi005' 2024-08-31T05:38:44.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.569+0000 7f4860063740 1 --2- 172.21.15.5:0/3415803534 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55fa681559f0 0x55fa6855e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:44.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.569+0000 7f4860063740 4 client.27494 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:38:44.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.569+0000 7f4860063740 1 -- 172.21.15.5:0/3415803534 --> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fa684b55d0 con 0x55fa681559f0 2024-08-31T05:38:44.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.569+0000 7f4853fff640 1 --2- 172.21.15.5:0/3415803534 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55fa681559f0 0x55fa6855e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:44.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.569+0000 7f4853fff640 1 --2- 172.21.15.5:0/3415803534 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55fa681559f0 0x55fa6855e030 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fe87dc3618f9627a server_cookie=6dcb7b6edd00897 in_seq=0 out_seq=0 2024-08-31T05:38:44.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.569+0000 7f4832ffd640 10 client.27494 ms_handle_connect on v2:172.21.15.50:6838/98200944 2024-08-31T05:38:44.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.570+0000 7f4832ffd640 1 -- 172.21.15.5:0/3415803534 <== mds.1 v2:172.21.15.50:6838/98200944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fa684b55d0 con 0x55fa681559f0 2024-08-31T05:38:44.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.570+0000 7f4832ffd640 10 client.27494 handle_command_reply: tid=0 2024-08-31T05:38:44.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.570+0000 7f4860063740 1 client.27494 shutdown 2024-08-31T05:38:44.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.570+0000 7f4860063740 1 -- 172.21.15.5:0/3415803534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fa68176390 msgr2=0x55fa6854cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:44.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.570+0000 7f4860063740 1 --2- 172.21.15.5:0/3415803534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fa68176390 0x55fa6854cb80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f485406a840 tx=0x7f4848012b60 comp rx=0 tx=0).stop 2024-08-31T05:38:44.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.570+0000 7f4860063740 1 -- 172.21.15.5:0/3415803534 shutdown_connections 2024-08-31T05:38:44.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.570+0000 7f4860063740 1 --2- 172.21.15.5:0/3415803534 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55fa681559f0 0x55fa6855e030 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:44.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.570+0000 7f4860063740 1 --2- 172.21.15.5:0/3415803534 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa68197070 0x55fa68551ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:44.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.570+0000 7f4860063740 1 --2- 172.21.15.5:0/3415803534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fa68176390 0x55fa6854cb80 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:44.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.570+0000 7f4860063740 1 --2- 172.21.15.5:0/3415803534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa6816e1b0 0x55fa6854c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:44.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.570+0000 7f4832ffd640 0 client.27494 ms_handle_reset on v2:172.21.15.50:6838/98200944 2024-08-31T05:38:44.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.570+0000 7f4860063740 1 -- 172.21.15.5:0/3415803534 >> 172.21.15.5:0/3415803534 conn(0x55fa6818b460 msgr2=0x55fa6853f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:44.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.570+0000 7f4860063740 1 -- 172.21.15.5:0/3415803534 shutdown_connections 2024-08-31T05:38:44.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.571+0000 7f4860063740 1 -- 172.21.15.5:0/3415803534 wait complete. 2024-08-31T05:38:44.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.571+0000 7f4860063740 20 client.27494 trim_cache size 0 max 16384 2024-08-31T05:38:44.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.584+0000 7f4860063740 1 Processor -- start 2024-08-31T05:38:44.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.584+0000 7f4860063740 1 -- start start 2024-08-31T05:38:44.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.585+0000 7f4860063740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa681559f0 0x55fa6854b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:44.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.585+0000 7f4860063740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fa6816e1b0 0x55fa6853a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:44.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.585+0000 7f4860063740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa68176390 0x55fa6853f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:44.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.585+0000 7f4860063740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f48541aeaf0 con 0x55fa681559f0 2024-08-31T05:38:44.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.585+0000 7f4860063740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f48541b0630 con 0x55fa6816e1b0 2024-08-31T05:38:44.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.585+0000 7f4860063740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f48541af1c0 con 0x55fa68176390 2024-08-31T05:38:44.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.585+0000 7f4853fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa681559f0 0x55fa6854b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:44.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.585+0000 7f4853fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa681559f0 0x55fa6854b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45706/0 (socket says 172.21.15.5:45706) 2024-08-31T05:38:44.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.585+0000 7f4853fff640 1 -- 172.21.15.5:0/2058787834 learned_addr learned my addr 172.21.15.5:0/2058787834 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:44.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.585+0000 7f4852ffd640 1 --2- 172.21.15.5:0/2058787834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fa6816e1b0 0x55fa6853a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:44.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.585+0000 7f4853fff640 1 --2- 172.21.15.5:0/2058787834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa68176390 0x55fa6853f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:44.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.585+0000 7f4853fff640 1 -- 172.21.15.5:0/2058787834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa68176390 msgr2=0x55fa6853f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:44.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.585+0000 7f4853fff640 1 --2- 172.21.15.5:0/2058787834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa68176390 0x55fa6853f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:44.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.585+0000 7f4853fff640 1 -- 172.21.15.5:0/2058787834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fa6816e1b0 msgr2=0x55fa6853a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:44.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.585+0000 7f4853fff640 1 --2- 172.21.15.5:0/2058787834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fa6816e1b0 0x55fa6853a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:44.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.585+0000 7f4853fff640 1 -- 172.21.15.5:0/2058787834 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa6853f170 con 0x55fa681559f0 2024-08-31T05:38:44.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.585+0000 7f4853fff640 1 --2- 172.21.15.5:0/2058787834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa681559f0 0x55fa6854b2b0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f484c003c60 tx=0x7f484c02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=563354b62f313f46 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:44.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.586+0000 7f48397fa640 1 -- 172.21.15.5:0/2058787834 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484c062070 con 0x55fa681559f0 2024-08-31T05:38:44.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.586+0000 7f48397fa640 1 -- 172.21.15.5:0/2058787834 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f484c036040 con 0x55fa681559f0 2024-08-31T05:38:44.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.586+0000 7f48397fa640 1 -- 172.21.15.5:0/2058787834 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484c02fd90 con 0x55fa681559f0 2024-08-31T05:38:44.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.586+0000 7f4860063740 1 -- 172.21.15.5:0/2058787834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa681559f0 msgr2=0x55fa6854b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:44.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.586+0000 7f4860063740 1 --2- 172.21.15.5:0/2058787834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa681559f0 0x55fa6854b2b0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f484c003c60 tx=0x7f484c02a8c0 comp rx=0 tx=0).stop 2024-08-31T05:38:44.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.586+0000 7f4860063740 1 -- 172.21.15.5:0/2058787834 shutdown_connections 2024-08-31T05:38:44.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.586+0000 7f4860063740 1 --2- 172.21.15.5:0/2058787834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa68176390 0x55fa6853f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:44.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.586+0000 7f4860063740 1 --2- 172.21.15.5:0/2058787834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fa6816e1b0 0x55fa6853a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:44.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.586+0000 7f4860063740 1 --2- 172.21.15.5:0/2058787834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa681559f0 0x55fa6854b2b0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:44.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.586+0000 7f4860063740 1 -- 172.21.15.5:0/2058787834 >> 172.21.15.5:0/2058787834 conn(0x55fa6818b460 msgr2=0x55fa68539b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:44.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.587+0000 7f4860063740 1 -- 172.21.15.5:0/2058787834 shutdown_connections 2024-08-31T05:38:44.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.587+0000 7f4860063740 1 -- 172.21.15.5:0/2058787834 wait complete. 2024-08-31T05:38:44.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.587+0000 7f4860063740 1 -- start start 2024-08-31T05:38:44.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.587+0000 7f4860063740 1 Processor -- start 2024-08-31T05:38:44.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.587+0000 7f4860063740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa681559f0 0x55fa68557ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:44.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.588+0000 7f4860063740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa6816e1b0 0x55fa68558410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:44.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.588+0000 7f4860063740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fa68176390 0x55fa68556c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:44.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.588+0000 7f4860063740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f48541aff60 con 0x55fa6816e1b0 2024-08-31T05:38:44.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.588+0000 7f4860063740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f48541af890 con 0x55fa68176390 2024-08-31T05:38:44.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.588+0000 7f4860063740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f48541acaf0 con 0x55fa681559f0 2024-08-31T05:38:44.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.588+0000 7f4860063740 10 client.0 _ll_register_callbacks cb 0x7f4848009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:38:44.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.588+0000 7f4852ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa6816e1b0 0x55fa68558410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:44.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.588+0000 7f4853fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa681559f0 0x55fa68557ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:44.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.588+0000 7f4852ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa6816e1b0 0x55fa68558410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45714/0 (socket says 172.21.15.5:45714) 2024-08-31T05:38:44.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.588+0000 7f4853fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa681559f0 0x55fa68557ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:59402/0 (socket says 172.21.15.5:59402) 2024-08-31T05:38:44.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.588+0000 7f4852ffd640 1 -- 172.21.15.5:0/4172686362 learned_addr learned my addr 172.21.15.5:0/4172686362 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:44.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.588+0000 7f4853fff640 1 --2- 172.21.15.5:0/4172686362 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fa68176390 0x55fa68556c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:44.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.588+0000 7f4852ffd640 1 -- 172.21.15.5:0/4172686362 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa681559f0 msgr2=0x55fa68557ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:44.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.588+0000 7f4852ffd640 1 --2- 172.21.15.5:0/4172686362 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa681559f0 0x55fa68557ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:44.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.588+0000 7f4852ffd640 1 -- 172.21.15.5:0/4172686362 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fa68176390 msgr2=0x55fa68556c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:44.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.588+0000 7f4852ffd640 1 --2- 172.21.15.5:0/4172686362 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fa68176390 0x55fa68556c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:44.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.588+0000 7f4852ffd640 1 -- 172.21.15.5:0/4172686362 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa68557180 con 0x55fa6816e1b0 2024-08-31T05:38:44.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.588+0000 7f4852ffd640 1 --2- 172.21.15.5:0/4172686362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa6816e1b0 0x55fa68558410 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f4848001eb0 tx=0x7f4848005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af1c0435f446ae4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:44.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.588+0000 7f4832ffd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:38:44.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.588+0000 7f4832ffd640 1 -- 172.21.15.5:0/4172686362 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484802f060 con 0x55fa6816e1b0 2024-08-31T05:38:44.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.588+0000 7f4832ffd640 1 -- 172.21.15.5:0/4172686362 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7f484800f9a0 con 0x55fa6816e1b0 2024-08-31T05:38:44.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.588+0000 7f4860063740 1 -- 172.21.15.5:0/4172686362 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f484c036040 con 0x55fa6816e1b0 2024-08-31T05:38:44.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.589+0000 7f4832ffd640 1 -- 172.21.15.5:0/4172686362 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f4848036050 con 0x55fa6816e1b0 2024-08-31T05:38:44.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.589+0000 7f4860063740 10 client.17925 fetch_fsmap learned FSMap version 34 2024-08-31T05:38:44.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.589+0000 7f4860063740 1 -- 172.21.15.5:0/4172686362 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55fa685c9240 con 0x55fa6816e1b0 2024-08-31T05:38:44.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.589+0000 7f4832ffd640 1 -- 172.21.15.5:0/4172686362 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f484c036040 con 0x55fa6816e1b0 2024-08-31T05:38:44.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.589+0000 7f4832ffd640 1 -- 172.21.15.5:0/4172686362 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f48480035f0 con 0x55fa6816e1b0 2024-08-31T05:38:44.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.589+0000 7f4860063740 10 client.17925 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:38:44.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.589+0000 7f4860063740 10 client.17925 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-31T05:38:44.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.589+0000 7f4860063740 20 client.17925 populate_metadata read hostname 'smithi005' 2024-08-31T05:38:44.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.589+0000 7f4860063740 1 --2- 172.21.15.5:0/4172686362 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55fa68197070 0x55fa685cba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:44.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.589+0000 7f4860063740 4 client.17925 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:38:44.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.589+0000 7f4860063740 1 -- 172.21.15.5:0/4172686362 --> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fa684b1070 con 0x55fa68197070 2024-08-31T05:38:44.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.589+0000 7f4853fff640 1 --2- 172.21.15.5:0/4172686362 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55fa68197070 0x55fa685cba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:44.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.590+0000 7f4832ffd640 10 client.17925 ms_handle_connect on v2:172.21.15.50:6838/98200944 2024-08-31T05:38:44.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.590+0000 7f4853fff640 1 --2- 172.21.15.5:0/4172686362 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55fa68197070 0x55fa685cba80 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5caccdf9b75bdded server_cookie=5e2e727cfe04f9b in_seq=0 out_seq=0 2024-08-31T05:38:44.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.590+0000 7f4832ffd640 1 -- 172.21.15.5:0/4172686362 <== mds.1 v2:172.21.15.50:6838/98200944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fa684b1070 con 0x55fa68197070 2024-08-31T05:38:44.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.590+0000 7f4832ffd640 10 client.17925 handle_command_reply: tid=0 2024-08-31T05:38:44.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.590+0000 7f4860063740 1 client.17925 shutdown 2024-08-31T05:38:44.606 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.590+0000 7f4860063740 1 -- 172.21.15.5:0/4172686362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa6816e1b0 msgr2=0x55fa68558410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:44.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.590+0000 7f4860063740 1 --2- 172.21.15.5:0/4172686362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa6816e1b0 0x55fa68558410 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f4848001eb0 tx=0x7f4848005dc0 comp rx=0 tx=0).stop 2024-08-31T05:38:44.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.590+0000 7f4860063740 1 -- 172.21.15.5:0/4172686362 shutdown_connections 2024-08-31T05:38:44.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.590+0000 7f4860063740 1 --2- 172.21.15.5:0/4172686362 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55fa68197070 0x55fa685cba80 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:44.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.590+0000 7f4860063740 1 --2- 172.21.15.5:0/4172686362 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55fa68176390 0x55fa68556c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:44.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.590+0000 7f4860063740 1 --2- 172.21.15.5:0/4172686362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fa6816e1b0 0x55fa68558410 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:44.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.590+0000 7f4832ffd640 0 client.17925 ms_handle_reset on v2:172.21.15.50:6838/98200944 2024-08-31T05:38:44.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.590+0000 7f4860063740 1 --2- 172.21.15.5:0/4172686362 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa681559f0 0x55fa68557ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:44.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.590+0000 7f4860063740 1 -- 172.21.15.5:0/4172686362 >> 172.21.15.5:0/4172686362 conn(0x55fa6818b460 msgr2=0x55fa6853f410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:44.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.590+0000 7f4860063740 1 -- 172.21.15.5:0/4172686362 shutdown_connections 2024-08-31T05:38:44.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.590+0000 7f4860063740 1 -- 172.21.15.5:0/4172686362 wait complete. 2024-08-31T05:38:44.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.591+0000 7f4860063740 20 client.17925 trim_cache size 0 max 16384 2024-08-31T05:38:44.608 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:38:44.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.591+0000 7f4859aee640 1 -- 172.21.15.5:0/3718825854 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f483c0b4ca0 msgr2=0x7f483c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:44.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.591+0000 7f4859aee640 1 --2- 172.21.15.5:0/3718825854 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f483c0b4ca0 0x7f483c0b71b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f48440e3050 tx=0x7f48440e9780 comp rx=0 tx=0).stop 2024-08-31T05:38:44.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.591+0000 7f4859aee640 1 -- 172.21.15.5:0/3718825854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4854102800 msgr2=0x7f485419a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:44.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.591+0000 7f4859aee640 1 --2- 172.21.15.5:0/3718825854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4854102800 0x7f485419a1e0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f484400e9f0 tx=0x7f484400eeb0 comp rx=0 tx=0).stop 2024-08-31T05:38:44.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.591+0000 7f4859aee640 1 -- 172.21.15.5:0/3718825854 shutdown_connections 2024-08-31T05:38:44.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.591+0000 7f4859aee640 1 --2- 172.21.15.5:0/3718825854 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f483c0b4ca0 0x7f483c0b71b0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:44.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.591+0000 7f4859aee640 1 --2- 172.21.15.5:0/3718825854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4854108a90 0x7f485419fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:44.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.591+0000 7f4859aee640 1 --2- 172.21.15.5:0/3718825854 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4854108140 0x7f485419a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:44.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.591+0000 7f4859aee640 1 --2- 172.21.15.5:0/3718825854 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4854102800 0x7f485419a1e0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:44.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.591+0000 7f4859aee640 1 -- 172.21.15.5:0/3718825854 >> 172.21.15.5:0/3718825854 conn(0x7f48540794d0 msgr2=0x7f4854104150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:44.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.591+0000 7f4859aee640 1 -- 172.21.15.5:0/3718825854 shutdown_connections 2024-08-31T05:38:44.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:44.591+0000 7f4859aee640 1 -- 172.21.15.5:0/3718825854 wait complete. 2024-08-31T05:38:44.931 INFO:tasks.workunit.client.0.smithi005.stdout: 1 990186 11.25 MB/sec execute 332 sec latency 107.076 ms 2024-08-31T05:38:45.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:38:44 smithi050 ceph-mon[22146]: pgmap v612: 129 pgs: 129 active+clean; 508 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.7 MiB/s wr, 161 op/s 2024-08-31T05:38:45.179 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:38:44 smithi005 ceph-mon[18602]: pgmap v612: 129 pgs: 129 active+clean; 508 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.7 MiB/s wr, 161 op/s 2024-08-31T05:38:45.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:38:44 smithi070 ceph-mon[22316]: pgmap v612: 129 pgs: 129 active+clean; 508 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.7 MiB/s wr, 161 op/s 2024-08-31T05:38:45.587 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T05:38:45.852 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:38:45.931 INFO:tasks.workunit.client.0.smithi005.stdout: 1 991898 11.25 MB/sec execute 333 sec latency 60.131 ms 2024-08-31T05:38:46.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.383+0000 7fc16244d640 1 -- 172.21.15.5:0/102489522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc15c102800 msgr2=0x7fc15c102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:46.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.383+0000 7fc16244d640 1 --2- 172.21.15.5:0/102489522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc15c102800 0x7fc15c102c10 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fc14c009900 tx=0x7fc14c02a410 comp rx=0 tx=0).stop 2024-08-31T05:38:46.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.383+0000 7fc16244d640 1 -- 172.21.15.5:0/102489522 shutdown_connections 2024-08-31T05:38:46.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.383+0000 7fc16244d640 1 --2- 172.21.15.5:0/102489522 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc15c108a90 0x7fc15c10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:46.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.383+0000 7fc16244d640 1 --2- 172.21.15.5:0/102489522 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc15c108140 0x7fc15c108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:46.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.383+0000 7fc16244d640 1 --2- 172.21.15.5:0/102489522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc15c102800 0x7fc15c102c10 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:46.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.383+0000 7fc16244d640 1 -- 172.21.15.5:0/102489522 >> 172.21.15.5:0/102489522 conn(0x7fc15c0794d0 msgr2=0x7fc15c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:46.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.383+0000 7fc16244d640 1 -- 172.21.15.5:0/102489522 shutdown_connections 2024-08-31T05:38:46.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.383+0000 7fc16244d640 1 -- 172.21.15.5:0/102489522 wait complete. 2024-08-31T05:38:46.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.384+0000 7fc16244d640 1 Processor -- start 2024-08-31T05:38:46.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.384+0000 7fc16244d640 1 -- start start 2024-08-31T05:38:46.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.385+0000 7fc16244d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc15c102800 0x7fc15c19b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:46.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.385+0000 7fc16244d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc15c108140 0x7fc15c19b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:46.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.385+0000 7fc16244d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc15c108a90 0x7fc15c19bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:46.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.385+0000 7fc16244d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc15c1126f0 con 0x7fc15c108a90 2024-08-31T05:38:46.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.385+0000 7fc16244d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc15c112570 con 0x7fc15c108140 2024-08-31T05:38:46.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.385+0000 7fc16244d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc15c112870 con 0x7fc15c102800 2024-08-31T05:38:46.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.385+0000 7fc1609ea640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc15c108a90 0x7fc15c19bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:46.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.385+0000 7fc15bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc15c102800 0x7fc15c19b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:46.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.385+0000 7fc1609ea640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc15c108a90 0x7fc15c19bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45736/0 (socket says 172.21.15.5:45736) 2024-08-31T05:38:46.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.385+0000 7fc1609ea640 1 -- 172.21.15.5:0/3203996320 learned_addr learned my addr 172.21.15.5:0/3203996320 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:46.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.385+0000 7fc153fff640 1 --2- 172.21.15.5:0/3203996320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc15c108140 0x7fc15c19b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:46.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.385+0000 7fc15bfff640 1 -- 172.21.15.5:0/3203996320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc15c108140 msgr2=0x7fc15c19b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:46.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.385+0000 7fc15bfff640 1 --2- 172.21.15.5:0/3203996320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc15c108140 0x7fc15c19b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:46.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.385+0000 7fc15bfff640 1 -- 172.21.15.5:0/3203996320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc15c108a90 msgr2=0x7fc15c19bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:46.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.385+0000 7fc15bfff640 1 --2- 172.21.15.5:0/3203996320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc15c108a90 0x7fc15c19bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:46.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.385+0000 7fc15bfff640 1 -- 172.21.15.5:0/3203996320 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc15c1a6390 con 0x7fc15c102800 2024-08-31T05:38:46.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.385+0000 7fc15bfff640 1 --2- 172.21.15.5:0/3203996320 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc15c102800 0x7fc15c19b080 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc14c02a930 tx=0x7fc14c031a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:46.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.386+0000 7fc159ffb640 1 -- 172.21.15.5:0/3203996320 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc14c03f030 con 0x7fc15c102800 2024-08-31T05:38:46.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.386+0000 7fc159ffb640 1 -- 172.21.15.5:0/3203996320 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc14c004490 con 0x7fc15c102800 2024-08-31T05:38:46.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.386+0000 7fc16244d640 1 -- 172.21.15.5:0/3203996320 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc15c198e70 con 0x7fc15c102800 2024-08-31T05:38:46.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.386+0000 7fc159ffb640 1 -- 172.21.15.5:0/3203996320 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc14c035070 con 0x7fc15c102800 2024-08-31T05:38:46.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.386+0000 7fc16244d640 1 -- 172.21.15.5:0/3203996320 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc15c199350 con 0x7fc15c102800 2024-08-31T05:38:46.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.388+0000 7fc1689c2740 1 Processor -- start 2024-08-31T05:38:46.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.388+0000 7fc1689c2740 1 -- start start 2024-08-31T05:38:46.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.388+0000 7fc159ffb640 1 -- 172.21.15.5:0/3203996320 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fc14c042030 con 0x7fc15c102800 2024-08-31T05:38:46.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.388+0000 7fc1689c2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576bb4e2070 0x5576bb887350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:46.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.388+0000 7fc1689c2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5576bb4b91b0 0x5576bb887890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:46.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.388+0000 7fc1689c2740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5576bb4c1390 0x5576bb887dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:46.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.388+0000 7fc1689c2740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5576bb7fe680 con 0x5576bb4c1390 2024-08-31T05:38:46.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.388+0000 7fc1689c2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5576bb7edc10 con 0x5576bb4e2070 2024-08-31T05:38:46.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.388+0000 7fc1689c2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5576bb7f1bc0 con 0x5576bb4b91b0 2024-08-31T05:38:46.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.389+0000 7fc153fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5576bb4c1390 0x5576bb887dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:46.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.389+0000 7fc15bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5576bb4b91b0 0x5576bb887890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:46.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.389+0000 7fc153fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5576bb4c1390 0x5576bb887dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45748/0 (socket says 172.21.15.5:45748) 2024-08-31T05:38:46.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.389+0000 7fc153fff640 1 -- 172.21.15.5:0/3576936220 learned_addr learned my addr 172.21.15.5:0/3576936220 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:46.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.389+0000 7fc1609ea640 1 --2- 172.21.15.5:0/3576936220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576bb4e2070 0x5576bb887350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:46.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.389+0000 7fc153fff640 1 -- 172.21.15.5:0/3576936220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5576bb4b91b0 msgr2=0x5576bb887890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:46.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.389+0000 7fc153fff640 1 --2- 172.21.15.5:0/3576936220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5576bb4b91b0 0x5576bb887890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:46.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.389+0000 7fc153fff640 1 -- 172.21.15.5:0/3576936220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576bb4e2070 msgr2=0x5576bb887350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:46.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.389+0000 7fc153fff640 1 --2- 172.21.15.5:0/3576936220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576bb4e2070 0x5576bb887350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:46.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.389+0000 7fc153fff640 1 -- 172.21.15.5:0/3576936220 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576bb54d650 con 0x5576bb4c1390 2024-08-31T05:38:46.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.389+0000 7fc153fff640 1 --2- 172.21.15.5:0/3576936220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5576bb4c1390 0x5576bb887dd0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fc144009c60 tx=0x7fc144011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb0a2e3366991625 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:46.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.389+0000 7fc159ffb640 1 --2- 172.21.15.5:0/3203996320 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc1480b4ca0 0x7fc1480b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:46.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.389+0000 7fc1609ea640 1 --2- 172.21.15.5:0/3203996320 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc1480b4ca0 0x7fc1480b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:46.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.390+0000 7fc1527fc640 1 -- 172.21.15.5:0/3576936220 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc144004030 con 0x5576bb4c1390 2024-08-31T05:38:46.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.390+0000 7fc159ffb640 1 -- 172.21.15.5:0/3203996320 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7fc14c1058b0 con 0x7fc15c102800 2024-08-31T05:38:46.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.390+0000 7fc1527fc640 1 -- 172.21.15.5:0/3576936220 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1440035f0 con 0x5576bb4c1390 2024-08-31T05:38:46.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.390+0000 7fc1527fc640 1 -- 172.21.15.5:0/3576936220 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc144019620 con 0x5576bb4c1390 2024-08-31T05:38:46.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.390+0000 7fc1689c2740 1 -- 172.21.15.5:0/3576936220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5576bb4c1390 msgr2=0x5576bb887dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:46.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.390+0000 7fc1609ea640 1 --2- 172.21.15.5:0/3203996320 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc1480b4ca0 0x7fc1480b71b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc15c06bce0 tx=0x7fc154012040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:46.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.390+0000 7fc1689c2740 1 --2- 172.21.15.5:0/3576936220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5576bb4c1390 0x5576bb887dd0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fc144009c60 tx=0x7fc144011810 comp rx=0 tx=0).stop 2024-08-31T05:38:46.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.390+0000 7fc1689c2740 1 -- 172.21.15.5:0/3576936220 shutdown_connections 2024-08-31T05:38:46.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.390+0000 7fc1689c2740 1 --2- 172.21.15.5:0/3576936220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5576bb4c1390 0x5576bb887dd0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:46.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.390+0000 7fc1689c2740 1 --2- 172.21.15.5:0/3576936220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5576bb4b91b0 0x5576bb887890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:46.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.390+0000 7fc1689c2740 1 --2- 172.21.15.5:0/3576936220 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576bb4e2070 0x5576bb887350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:46.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.390+0000 7fc1689c2740 1 -- 172.21.15.5:0/3576936220 >> 172.21.15.5:0/3576936220 conn(0x5576bb4d6460 msgr2=0x5576bb885240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:46.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.390+0000 7fc1689c2740 1 -- 172.21.15.5:0/3576936220 shutdown_connections 2024-08-31T05:38:46.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.391+0000 7fc1689c2740 1 -- 172.21.15.5:0/3576936220 wait complete. 2024-08-31T05:38:46.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.391+0000 7fc1689c2740 1 -- start start 2024-08-31T05:38:46.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.391+0000 7fc1689c2740 1 Processor -- start 2024-08-31T05:38:46.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.391+0000 7fc1689c2740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5576bb4b91b0 0x5576bb892ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:46.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.391+0000 7fc1689c2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576bb4c1390 0x5576bb893010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:46.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.391+0000 7fc1689c2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5576bb4e2070 0x5576bb89ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:46.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.391+0000 7fc1689c2740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5576bb650700 con 0x5576bb4b91b0 2024-08-31T05:38:46.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.391+0000 7fc1689c2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5576bb774750 con 0x5576bb4c1390 2024-08-31T05:38:46.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.391+0000 7fc1689c2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5576bb895b30 con 0x5576bb4e2070 2024-08-31T05:38:46.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.392+0000 7fc1689c2740 10 client.0 _ll_register_callbacks cb 0x5576bb7a3e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:38:46.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.392+0000 7fc15bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5576bb4b91b0 0x5576bb892ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:46.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.392+0000 7fc153fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576bb4c1390 0x5576bb893010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:46.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.392+0000 7fc1609ea640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5576bb4e2070 0x5576bb89ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:46.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.392+0000 7fc153fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576bb4c1390 0x5576bb893010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:39302/0 (socket says 172.21.15.5:39302) 2024-08-31T05:38:46.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.392+0000 7fc153fff640 1 -- 172.21.15.5:0/2929774156 learned_addr learned my addr 172.21.15.5:0/2929774156 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:46.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.392+0000 7fc15bfff640 1 -- 172.21.15.5:0/2929774156 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5576bb4e2070 msgr2=0x5576bb89ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:46.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.392+0000 7fc15bfff640 1 --2- 172.21.15.5:0/2929774156 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5576bb4e2070 0x5576bb89ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:46.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.392+0000 7fc15bfff640 1 -- 172.21.15.5:0/2929774156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576bb4c1390 msgr2=0x5576bb893010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:46.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.392+0000 7fc15bfff640 1 --2- 172.21.15.5:0/2929774156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576bb4c1390 0x5576bb893010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:46.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.392+0000 7fc15bfff640 1 -- 172.21.15.5:0/2929774156 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576bb7ad900 con 0x5576bb4b91b0 2024-08-31T05:38:46.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.392+0000 7fc153fff640 1 --2- 172.21.15.5:0/2929774156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576bb4c1390 0x5576bb893010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:38:46.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.392+0000 7fc15bfff640 1 --2- 172.21.15.5:0/2929774156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5576bb4b91b0 0x5576bb892ad0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fc14c102bc0 tx=0x7fc14c003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aea05e1b8a8606c3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:46.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.392+0000 7fc13b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:38:46.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.392+0000 7fc13b7fe640 1 -- 172.21.15.5:0/2929774156 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc14c049070 con 0x5576bb4b91b0 2024-08-31T05:38:46.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.392+0000 7fc13b7fe640 1 -- 172.21.15.5:0/2929774156 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7fc14c105440 con 0x5576bb4b91b0 2024-08-31T05:38:46.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.392+0000 7fc1689c2740 1 -- 172.21.15.5:0/2929774156 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1440035f0 con 0x5576bb4b91b0 2024-08-31T05:38:46.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.392+0000 7fc13b7fe640 1 -- 172.21.15.5:0/2929774156 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc14c0cb560 con 0x5576bb4b91b0 2024-08-31T05:38:46.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.393+0000 7fc1689c2740 10 client.17937 fetch_fsmap learned FSMap version 34 2024-08-31T05:38:46.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.393+0000 7fc1689c2740 1 -- 172.21.15.5:0/2929774156 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5576bb8a1910 con 0x5576bb4b91b0 2024-08-31T05:38:46.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.393+0000 7fc13b7fe640 1 -- 172.21.15.5:0/2929774156 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1440035f0 con 0x5576bb4b91b0 2024-08-31T05:38:46.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.393+0000 7fc13b7fe640 1 -- 172.21.15.5:0/2929774156 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fc14c04c060 con 0x5576bb4b91b0 2024-08-31T05:38:46.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.393+0000 7fc1689c2740 10 client.17937 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:38:46.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.393+0000 7fc1689c2740 10 client.17937 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:38:46.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.393+0000 7fc1689c2740 20 client.17937 populate_metadata read hostname 'smithi005' 2024-08-31T05:38:46.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.393+0000 7fc1689c2740 1 --2- 172.21.15.5:0/2929774156 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5576bb4a09f0 0x5576bb8a4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:46.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.393+0000 7fc1689c2740 4 client.17937 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:38:46.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.393+0000 7fc1689c2740 1 -- 172.21.15.5:0/2929774156 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5576bb8005d0 con 0x5576bb4a09f0 2024-08-31T05:38:46.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.393+0000 7fc153fff640 1 --2- 172.21.15.5:0/2929774156 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5576bb4a09f0 0x5576bb8a4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:46.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.394+0000 7fc13b7fe640 10 client.17937 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:38:46.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.394+0000 7fc153fff640 1 --2- 172.21.15.5:0/2929774156 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5576bb4a09f0 0x5576bb8a4e70 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8426bcf8061c6cc server_cookie=94cdbd03cb341356 in_seq=0 out_seq=0 2024-08-31T05:38:46.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.395+0000 7fc13b7fe640 1 -- 172.21.15.5:0/2929774156 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5576bb8005d0 con 0x5576bb4a09f0 2024-08-31T05:38:46.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.395+0000 7fc13b7fe640 10 client.17937 handle_command_reply: tid=0 2024-08-31T05:38:46.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.395+0000 7fc1689c2740 1 client.17937 shutdown 2024-08-31T05:38:46.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.395+0000 7fc1689c2740 1 -- 172.21.15.5:0/2929774156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5576bb4b91b0 msgr2=0x5576bb892ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:46.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.395+0000 7fc1689c2740 1 --2- 172.21.15.5:0/2929774156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5576bb4b91b0 0x5576bb892ad0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fc14c102bc0 tx=0x7fc14c003f60 comp rx=0 tx=0).stop 2024-08-31T05:38:46.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.395+0000 7fc1689c2740 1 -- 172.21.15.5:0/2929774156 shutdown_connections 2024-08-31T05:38:46.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.395+0000 7fc1689c2740 1 --2- 172.21.15.5:0/2929774156 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5576bb4a09f0 0x5576bb8a4e70 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:46.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.395+0000 7fc13b7fe640 0 client.17937 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:38:46.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.395+0000 7fc1689c2740 1 --2- 172.21.15.5:0/2929774156 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5576bb4e2070 0x5576bb89ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:46.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.395+0000 7fc1689c2740 1 --2- 172.21.15.5:0/2929774156 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576bb4c1390 0x5576bb893010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:46.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.395+0000 7fc1689c2740 1 --2- 172.21.15.5:0/2929774156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5576bb4b91b0 0x5576bb892ad0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:46.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.395+0000 7fc1689c2740 1 -- 172.21.15.5:0/2929774156 >> 172.21.15.5:0/2929774156 conn(0x5576bb4d6460 msgr2=0x5576bb88a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:46.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.395+0000 7fc1689c2740 1 -- 172.21.15.5:0/2929774156 shutdown_connections 2024-08-31T05:38:46.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.395+0000 7fc1689c2740 1 -- 172.21.15.5:0/2929774156 wait complete. 2024-08-31T05:38:46.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.395+0000 7fc1689c2740 20 client.17937 trim_cache size 0 max 16384 2024-08-31T05:38:46.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.409+0000 7fc1689c2740 1 Processor -- start 2024-08-31T05:38:46.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.409+0000 7fc1689c2740 1 -- start start 2024-08-31T05:38:46.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.409+0000 7fc1689c2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576bb4a09f0 0x5576bb88a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:46.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.409+0000 7fc1689c2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5576bb4b91b0 0x5576bb88a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:46.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.409+0000 7fc1689c2740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5576bb4c1390 0x5576bb88fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:46.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.409+0000 7fc1689c2740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc15c1aeb50 con 0x5576bb4c1390 2024-08-31T05:38:46.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.409+0000 7fc1689c2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc15c1b0690 con 0x5576bb4a09f0 2024-08-31T05:38:46.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.409+0000 7fc1689c2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc15c1af220 con 0x5576bb4b91b0 2024-08-31T05:38:46.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.409+0000 7fc1609ea640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5576bb4c1390 0x5576bb88fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:46.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.409+0000 7fc1609ea640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5576bb4c1390 0x5576bb88fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45768/0 (socket says 172.21.15.5:45768) 2024-08-31T05:38:46.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.409+0000 7fc1609ea640 1 -- 172.21.15.5:0/3274025726 learned_addr learned my addr 172.21.15.5:0/3274025726 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:46.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.409+0000 7fc15bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576bb4a09f0 0x5576bb88a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:46.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.409+0000 7fc153fff640 1 --2- 172.21.15.5:0/3274025726 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5576bb4b91b0 0x5576bb88a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:46.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.410+0000 7fc15bfff640 1 -- 172.21.15.5:0/3274025726 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5576bb4b91b0 msgr2=0x5576bb88a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:46.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.410+0000 7fc15bfff640 1 --2- 172.21.15.5:0/3274025726 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5576bb4b91b0 0x5576bb88a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:46.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.410+0000 7fc15bfff640 1 -- 172.21.15.5:0/3274025726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5576bb4c1390 msgr2=0x5576bb88fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:46.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.410+0000 7fc15bfff640 1 --2- 172.21.15.5:0/3274025726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5576bb4c1390 0x5576bb88fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:46.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.410+0000 7fc15bfff640 1 -- 172.21.15.5:0/3274025726 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576bb885bb0 con 0x5576bb4a09f0 2024-08-31T05:38:46.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.410+0000 7fc1609ea640 1 --2- 172.21.15.5:0/3274025726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5576bb4c1390 0x5576bb88fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:38:46.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.410+0000 7fc15bfff640 1 --2- 172.21.15.5:0/3274025726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576bb4a09f0 0x5576bb88a450 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc14c0cbe70 tx=0x7fc14c009290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e426368200f403bd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:46.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.410+0000 7fc151ffb640 1 -- 172.21.15.5:0/3274025726 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc14c0f2070 con 0x5576bb4a09f0 2024-08-31T05:38:46.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.410+0000 7fc151ffb640 1 -- 172.21.15.5:0/3274025726 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc14c10b220 con 0x5576bb4a09f0 2024-08-31T05:38:46.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.410+0000 7fc151ffb640 1 -- 172.21.15.5:0/3274025726 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc14c049070 con 0x5576bb4a09f0 2024-08-31T05:38:46.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.411+0000 7fc1689c2740 1 -- 172.21.15.5:0/3274025726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576bb4a09f0 msgr2=0x5576bb88a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:46.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.411+0000 7fc1689c2740 1 --2- 172.21.15.5:0/3274025726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576bb4a09f0 0x5576bb88a450 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc14c0cbe70 tx=0x7fc14c009290 comp rx=0 tx=0).stop 2024-08-31T05:38:46.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.411+0000 7fc1689c2740 1 -- 172.21.15.5:0/3274025726 shutdown_connections 2024-08-31T05:38:46.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.411+0000 7fc1689c2740 1 --2- 172.21.15.5:0/3274025726 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5576bb4c1390 0x5576bb88fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:46.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.411+0000 7fc1689c2740 1 --2- 172.21.15.5:0/3274025726 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5576bb4b91b0 0x5576bb88a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:46.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.411+0000 7fc1689c2740 1 --2- 172.21.15.5:0/3274025726 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576bb4a09f0 0x5576bb88a450 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:46.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.411+0000 7fc1689c2740 1 -- 172.21.15.5:0/3274025726 >> 172.21.15.5:0/3274025726 conn(0x5576bb4d6460 msgr2=0x5576bb891350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:46.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.411+0000 7fc1689c2740 1 -- 172.21.15.5:0/3274025726 shutdown_connections 2024-08-31T05:38:46.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.411+0000 7fc1689c2740 1 -- 172.21.15.5:0/3274025726 wait complete. 2024-08-31T05:38:46.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.412+0000 7fc1689c2740 1 -- start start 2024-08-31T05:38:46.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.412+0000 7fc1689c2740 1 Processor -- start 2024-08-31T05:38:46.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.412+0000 7fc1689c2740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5576bb4a09f0 0x5576bb897110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:46.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.412+0000 7fc1689c2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576bb4b91b0 0x5576bb897650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:46.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.412+0000 7fc1689c2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5576bb4c1390 0x5576bb90e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:46.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.412+0000 7fc1689c2740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc15c1affc0 con 0x5576bb4a09f0 2024-08-31T05:38:46.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.412+0000 7fc1689c2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc15c1af8f0 con 0x5576bb4b91b0 2024-08-31T05:38:46.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.412+0000 7fc1689c2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc15c1acb50 con 0x5576bb4c1390 2024-08-31T05:38:46.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.412+0000 7fc1689c2740 10 client.0 _ll_register_callbacks cb 0x7fc14c005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:38:46.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.412+0000 7fc15bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5576bb4a09f0 0x5576bb897110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:46.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.412+0000 7fc153fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576bb4b91b0 0x5576bb897650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:46.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.412+0000 7fc15bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5576bb4a09f0 0x5576bb897110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45784/0 (socket says 172.21.15.5:45784) 2024-08-31T05:38:46.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.412+0000 7fc15bfff640 1 -- 172.21.15.5:0/1752656647 learned_addr learned my addr 172.21.15.5:0/1752656647 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:46.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.412+0000 7fc1609ea640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5576bb4c1390 0x5576bb90e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:46.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.413+0000 7fc153fff640 1 -- 172.21.15.5:0/1752656647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5576bb4c1390 msgr2=0x5576bb90e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:46.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.413+0000 7fc153fff640 1 --2- 172.21.15.5:0/1752656647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5576bb4c1390 0x5576bb90e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:46.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.413+0000 7fc153fff640 1 -- 172.21.15.5:0/1752656647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5576bb4a09f0 msgr2=0x5576bb897110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:46.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.413+0000 7fc153fff640 1 --2- 172.21.15.5:0/1752656647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5576bb4a09f0 0x5576bb897110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:46.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.413+0000 7fc153fff640 1 -- 172.21.15.5:0/1752656647 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576bb90ed40 con 0x5576bb4b91b0 2024-08-31T05:38:46.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.413+0000 7fc15bfff640 1 --2- 172.21.15.5:0/1752656647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5576bb4a09f0 0x5576bb897110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:38:46.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.413+0000 7fc153fff640 1 --2- 172.21.15.5:0/1752656647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576bb4b91b0 0x5576bb897650 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x5576bb8a55a0 tx=0x7fc144009f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bcb3a8107b0510b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:46.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.413+0000 7fc13b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:38:46.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.413+0000 7fc13b7fe640 1 -- 172.21.15.5:0/1752656647 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc14401f040 con 0x5576bb4b91b0 2024-08-31T05:38:46.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.413+0000 7fc1689c2740 1 -- 172.21.15.5:0/1752656647 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc14c10b220 con 0x5576bb4b91b0 2024-08-31T05:38:46.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.413+0000 7fc13b7fe640 1 -- 172.21.15.5:0/1752656647 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7fc144003b30 con 0x5576bb4b91b0 2024-08-31T05:38:46.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.413+0000 7fc13b7fe640 1 -- 172.21.15.5:0/1752656647 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc144039050 con 0x5576bb4b91b0 2024-08-31T05:38:46.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.413+0000 7fc1689c2740 10 client.27518 fetch_fsmap learned FSMap version 34 2024-08-31T05:38:46.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.413+0000 7fc1689c2740 1 -- 172.21.15.5:0/1752656647 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5576bb90fe80 con 0x5576bb4b91b0 2024-08-31T05:38:46.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.414+0000 7fc13b7fe640 1 -- 172.21.15.5:0/1752656647 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc14c10b220 con 0x5576bb4b91b0 2024-08-31T05:38:46.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.414+0000 7fc13b7fe640 1 -- 172.21.15.5:0/1752656647 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fc144018070 con 0x5576bb4b91b0 2024-08-31T05:38:46.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.414+0000 7fc1689c2740 10 client.27518 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:38:46.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.414+0000 7fc1689c2740 10 client.27518 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:38:46.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.414+0000 7fc1689c2740 20 client.27518 populate_metadata read hostname 'smithi005' 2024-08-31T05:38:46.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.414+0000 7fc1689c2740 1 --2- 172.21.15.5:0/1752656647 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5576bb4e2070 0x5576bb9123f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:46.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.414+0000 7fc1689c2740 4 client.27518 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:38:46.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.414+0000 7fc1689c2740 1 -- 172.21.15.5:0/1752656647 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5576bb7fc070 con 0x5576bb4e2070 2024-08-31T05:38:46.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.414+0000 7fc15bfff640 1 --2- 172.21.15.5:0/1752656647 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5576bb4e2070 0x5576bb9123f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:46.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.414+0000 7fc13b7fe640 10 client.27518 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:38:46.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.414+0000 7fc15bfff640 1 --2- 172.21.15.5:0/1752656647 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5576bb4e2070 0x5576bb9123f0 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=536b9087a80e79d5 server_cookie=3e329a355f8ab710 in_seq=0 out_seq=0 2024-08-31T05:38:46.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.415+0000 7fc13b7fe640 1 -- 172.21.15.5:0/1752656647 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5576bb7fc070 con 0x5576bb4e2070 2024-08-31T05:38:46.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.415+0000 7fc13b7fe640 10 client.27518 handle_command_reply: tid=0 2024-08-31T05:38:46.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.415+0000 7fc1689c2740 1 client.27518 shutdown 2024-08-31T05:38:46.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.415+0000 7fc1689c2740 1 -- 172.21.15.5:0/1752656647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576bb4b91b0 msgr2=0x5576bb897650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:46.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.415+0000 7fc1689c2740 1 --2- 172.21.15.5:0/1752656647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576bb4b91b0 0x5576bb897650 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x5576bb8a55a0 tx=0x7fc144009f80 comp rx=0 tx=0).stop 2024-08-31T05:38:46.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.415+0000 7fc1689c2740 1 -- 172.21.15.5:0/1752656647 shutdown_connections 2024-08-31T05:38:46.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.415+0000 7fc1689c2740 1 --2- 172.21.15.5:0/1752656647 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5576bb4e2070 0x5576bb9123f0 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:46.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.415+0000 7fc1689c2740 1 --2- 172.21.15.5:0/1752656647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5576bb4c1390 0x5576bb90e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:46.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.415+0000 7fc1689c2740 1 --2- 172.21.15.5:0/1752656647 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5576bb4b91b0 0x5576bb897650 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:46.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.415+0000 7fc1689c2740 1 --2- 172.21.15.5:0/1752656647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5576bb4a09f0 0x5576bb897110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:46.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.415+0000 7fc13b7fe640 0 client.27518 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:38:46.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.415+0000 7fc1689c2740 1 -- 172.21.15.5:0/1752656647 >> 172.21.15.5:0/1752656647 conn(0x5576bb4d6460 msgr2=0x5576bb88a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:46.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.415+0000 7fc1689c2740 1 -- 172.21.15.5:0/1752656647 shutdown_connections 2024-08-31T05:38:46.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.415+0000 7fc1689c2740 1 -- 172.21.15.5:0/1752656647 wait complete. 2024-08-31T05:38:46.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.415+0000 7fc1689c2740 20 client.27518 trim_cache size 0 max 16384 2024-08-31T05:38:46.423 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:38:46.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.416+0000 7fc16244d640 1 -- 172.21.15.5:0/3203996320 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc1480b4ca0 msgr2=0x7fc1480b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:46.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.416+0000 7fc16244d640 1 --2- 172.21.15.5:0/3203996320 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc1480b4ca0 0x7fc1480b71b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc15c06bce0 tx=0x7fc154012040 comp rx=0 tx=0).stop 2024-08-31T05:38:46.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.416+0000 7fc16244d640 1 -- 172.21.15.5:0/3203996320 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc15c102800 msgr2=0x7fc15c19b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:46.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.416+0000 7fc16244d640 1 --2- 172.21.15.5:0/3203996320 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc15c102800 0x7fc15c19b080 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc14c02a930 tx=0x7fc14c031a20 comp rx=0 tx=0).stop 2024-08-31T05:38:46.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.416+0000 7fc16244d640 1 -- 172.21.15.5:0/3203996320 shutdown_connections 2024-08-31T05:38:46.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.416+0000 7fc16244d640 1 --2- 172.21.15.5:0/3203996320 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc1480b4ca0 0x7fc1480b71b0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:46.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.416+0000 7fc16244d640 1 --2- 172.21.15.5:0/3203996320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc15c108a90 0x7fc15c19bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:46.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.416+0000 7fc16244d640 1 --2- 172.21.15.5:0/3203996320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc15c108140 0x7fc15c19b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:46.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.416+0000 7fc16244d640 1 --2- 172.21.15.5:0/3203996320 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc15c102800 0x7fc15c19b080 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:46.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.416+0000 7fc16244d640 1 -- 172.21.15.5:0/3203996320 >> 172.21.15.5:0/3203996320 conn(0x7fc15c0794d0 msgr2=0x7fc15c101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:46.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.416+0000 7fc16244d640 1 -- 172.21.15.5:0/3203996320 shutdown_connections 2024-08-31T05:38:46.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:46.416+0000 7fc16244d640 1 -- 172.21.15.5:0/3203996320 wait complete. 2024-08-31T05:38:46.931 INFO:tasks.workunit.client.0.smithi005.stdout: 1 993999 11.25 MB/sec execute 334 sec latency 34.908 ms 2024-08-31T05:38:47.156 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:38:46 smithi050 ceph-mon[22146]: pgmap v613: 129 pgs: 129 active+clean; 527 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.8 MiB/s wr, 241 op/s 2024-08-31T05:38:47.203 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:38:46 smithi005 ceph-mon[18602]: pgmap v613: 129 pgs: 129 active+clean; 527 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.8 MiB/s wr, 241 op/s 2024-08-31T05:38:47.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:38:46 smithi070 ceph-mon[22316]: pgmap v613: 129 pgs: 129 active+clean; 527 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.8 MiB/s wr, 241 op/s 2024-08-31T05:38:47.931 INFO:tasks.workunit.client.0.smithi005.stdout: 1 995995 11.25 MB/sec execute 335 sec latency 17.233 ms 2024-08-31T05:38:48.232 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T05:38:48.233 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T05:38:48.496 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:38:48.931 INFO:tasks.workunit.client.0.smithi005.stdout: 1 998301 11.26 MB/sec execute 336 sec latency 52.009 ms 2024-08-31T05:38:49.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:48.997+0000 7f8eb5560640 1 -- 172.21.15.5:0/569829623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8eb0108170 msgr2=0x7f8eb0108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:49.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:48.997+0000 7f8eb5560640 1 --2- 172.21.15.5:0/569829623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8eb0108170 0x7f8eb0108580 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0009900 tx=0x7f8ea002a410 comp rx=0 tx=0).stop 2024-08-31T05:38:49.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:48.997+0000 7f8eb5560640 1 -- 172.21.15.5:0/569829623 shutdown_connections 2024-08-31T05:38:49.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:48.997+0000 7f8eb5560640 1 --2- 172.21.15.5:0/569829623 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8eb0108ac0 0x7f8eb010f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:49.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:48.997+0000 7f8eb5560640 1 --2- 172.21.15.5:0/569829623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8eb0108170 0x7f8eb0108580 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:49.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:48.997+0000 7f8eb5560640 1 --2- 172.21.15.5:0/569829623 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8eb0102880 0x7f8eb0102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:49.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:48.997+0000 7f8eb5560640 1 -- 172.21.15.5:0/569829623 >> 172.21.15.5:0/569829623 conn(0x7f8eb0079530 msgr2=0x7f8eb0079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:49.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:48.997+0000 7f8eb5560640 1 -- 172.21.15.5:0/569829623 shutdown_connections 2024-08-31T05:38:49.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:48.997+0000 7f8eb5560640 1 -- 172.21.15.5:0/569829623 wait complete. 2024-08-31T05:38:49.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:48.998+0000 7f8eb5560640 1 Processor -- start 2024-08-31T05:38:49.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:48.998+0000 7f8eb5560640 1 -- start start 2024-08-31T05:38:49.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:48.998+0000 7f8eb5560640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8eb0102880 0x7f8eb019b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:49.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:48.998+0000 7f8eb5560640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8eb0108170 0x7f8eb019b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:49.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:48.998+0000 7f8eb5560640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8eb0108ac0 0x7f8eb019bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:49.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:48.998+0000 7f8eb5560640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb0112750 con 0x7f8eb0102880 2024-08-31T05:38:49.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:48.998+0000 7f8eb5560640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb01125d0 con 0x7f8eb0108170 2024-08-31T05:38:49.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:48.998+0000 7f8eb5560640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb01128d0 con 0x7f8eb0108ac0 2024-08-31T05:38:49.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:48.998+0000 7f8eaeffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8eb0102880 0x7f8eb019b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:49.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:48.998+0000 7f8eae7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8eb0108170 0x7f8eb019b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:49.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:48.999+0000 7f8eaeffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8eb0102880 0x7f8eb019b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45802/0 (socket says 172.21.15.5:45802) 2024-08-31T05:38:49.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:48.999+0000 7f8eae7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8eb0108170 0x7f8eb019b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:39332/0 (socket says 172.21.15.5:39332) 2024-08-31T05:38:49.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:48.999+0000 7f8eaf7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8eb0108ac0 0x7f8eb019bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:49.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:48.999+0000 7f8eaeffd640 1 -- 172.21.15.5:0/2946301772 learned_addr learned my addr 172.21.15.5:0/2946301772 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:49.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:48.999+0000 7f8eaeffd640 1 -- 172.21.15.5:0/2946301772 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8eb0108ac0 msgr2=0x7f8eb019bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:49.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:48.999+0000 7f8eaeffd640 1 --2- 172.21.15.5:0/2946301772 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8eb0108ac0 0x7f8eb019bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:49.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:48.999+0000 7f8eaeffd640 1 -- 172.21.15.5:0/2946301772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8eb0108170 msgr2=0x7f8eb019b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:49.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:48.999+0000 7f8eaeffd640 1 --2- 172.21.15.5:0/2946301772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8eb0108170 0x7f8eb019b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:49.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:48.999+0000 7f8eaeffd640 1 -- 172.21.15.5:0/2946301772 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eb01a6320 con 0x7f8eb0102880 2024-08-31T05:38:49.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:48.999+0000 7f8eaeffd640 1 --2- 172.21.15.5:0/2946301772 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8eb0102880 0x7f8eb019b060 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f8e9800e9f0 tx=0x7f8e9800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:49.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:48.999+0000 7f8ea7fff640 1 -- 172.21.15.5:0/2946301772 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e9800cd80 con 0x7f8eb0102880 2024-08-31T05:38:49.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:48.999+0000 7f8ea7fff640 1 -- 172.21.15.5:0/2946301772 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e980054d0 con 0x7f8eb0102880 2024-08-31T05:38:49.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:48.999+0000 7f8eb5560640 1 -- 172.21.15.5:0/2946301772 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8eb01a6610 con 0x7f8eb0102880 2024-08-31T05:38:49.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:48.999+0000 7f8ea7fff640 1 -- 172.21.15.5:0/2946301772 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e98010690 con 0x7f8eb0102880 2024-08-31T05:38:49.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:48.999+0000 7f8eb5560640 1 -- 172.21.15.5:0/2946301772 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8eb01a6b20 con 0x7f8eb0102880 2024-08-31T05:38:49.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.002+0000 7f8ebbad5740 1 Processor -- start 2024-08-31T05:38:49.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.002+0000 7f8ebbad5740 1 -- start start 2024-08-31T05:38:49.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.002+0000 7f8ea7fff640 1 -- 172.21.15.5:0/2946301772 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f8e98004e90 con 0x7f8eb0102880 2024-08-31T05:38:49.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.002+0000 7f8ebbad5740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556551cd9350 0x55655207f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:49.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.002+0000 7f8ebbad5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556551cb0490 0x55655207fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:49.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.002+0000 7f8ebbad5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556551cb8670 0x556552080200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:49.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.002+0000 7f8ebbad5740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x556551ff55f0 con 0x556551cd9350 2024-08-31T05:38:49.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.002+0000 7f8ebbad5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x556551fe4b80 con 0x556551cb0490 2024-08-31T05:38:49.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.002+0000 7f8ebbad5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556551fe8b30 con 0x556551cb8670 2024-08-31T05:38:49.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.003+0000 7f8eaf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556551cd9350 0x55655207f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:49.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.003+0000 7f8eae7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556551cb8670 0x556552080200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:49.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.003+0000 7f8eae7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556551cb8670 0x556552080200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:59480/0 (socket says 172.21.15.5:59480) 2024-08-31T05:38:49.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.003+0000 7f8eae7fc640 1 -- 172.21.15.5:0/835641525 learned_addr learned my addr 172.21.15.5:0/835641525 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:49.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.003+0000 7f8eaeffd640 1 --2- 172.21.15.5:0/835641525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556551cb0490 0x55655207fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:49.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.003+0000 7f8eae7fc640 1 -- 172.21.15.5:0/835641525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556551cb0490 msgr2=0x55655207fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:49.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.003+0000 7f8eae7fc640 1 --2- 172.21.15.5:0/835641525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556551cb0490 0x55655207fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:49.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.003+0000 7f8eae7fc640 1 -- 172.21.15.5:0/835641525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556551cd9350 msgr2=0x55655207f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:49.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.003+0000 7f8eae7fc640 1 --2- 172.21.15.5:0/835641525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556551cd9350 0x55655207f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:49.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.003+0000 7f8eae7fc640 1 -- 172.21.15.5:0/835641525 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556551d44930 con 0x556551cb8670 2024-08-31T05:38:49.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.003+0000 7f8eae7fc640 1 --2- 172.21.15.5:0/835641525 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556551cb8670 0x556552080200 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0009900 tx=0x7f8ea0000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e700e6ae3c6b5de server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:49.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.003+0000 7f8ea7fff640 1 --2- 172.21.15.5:0/2946301772 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f8e9c0b4d20 0x7f8e9c0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:49.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.004+0000 7f8ea57fa640 1 -- 172.21.15.5:0/835641525 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea0040070 con 0x556551cb8670 2024-08-31T05:38:49.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.004+0000 7f8eaf7fe640 1 --2- 172.21.15.5:0/2946301772 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f8e9c0b4d20 0x7f8e9c0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:49.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.004+0000 7f8ea57fa640 1 -- 172.21.15.5:0/835641525 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ea0004030 con 0x556551cb8670 2024-08-31T05:38:49.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.004+0000 7f8ea57fa640 1 -- 172.21.15.5:0/835641525 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea0035040 con 0x556551cb8670 2024-08-31T05:38:49.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.004+0000 7f8ea7fff640 1 -- 172.21.15.5:0/2946301772 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7f8e980e5ce0 con 0x7f8eb0102880 2024-08-31T05:38:49.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.005+0000 7f8ebbad5740 1 -- 172.21.15.5:0/835641525 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556551cb8670 msgr2=0x556552080200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:49.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.005+0000 7f8ebbad5740 1 --2- 172.21.15.5:0/835641525 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556551cb8670 0x556552080200 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0009900 tx=0x7f8ea0000bc0 comp rx=0 tx=0).stop 2024-08-31T05:38:49.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.005+0000 7f8eaf7fe640 1 --2- 172.21.15.5:0/2946301772 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f8e9c0b4d20 0x7f8e9c0b7230 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8005fd0 tx=0x7f8ea8009600 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:49.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.005+0000 7f8ebbad5740 1 -- 172.21.15.5:0/835641525 shutdown_connections 2024-08-31T05:38:49.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.005+0000 7f8ebbad5740 1 --2- 172.21.15.5:0/835641525 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556551cb8670 0x556552080200 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:49.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.005+0000 7f8ebbad5740 1 --2- 172.21.15.5:0/835641525 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556551cb0490 0x55655207fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:49.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.005+0000 7f8ebbad5740 1 --2- 172.21.15.5:0/835641525 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556551cd9350 0x55655207f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:49.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.005+0000 7f8ebbad5740 1 -- 172.21.15.5:0/835641525 >> 172.21.15.5:0/835641525 conn(0x556551ccd740 msgr2=0x55655207d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:49.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.005+0000 7f8ebbad5740 1 -- 172.21.15.5:0/835641525 shutdown_connections 2024-08-31T05:38:49.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.005+0000 7f8ebbad5740 1 -- 172.21.15.5:0/835641525 wait complete. 2024-08-31T05:38:49.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.005+0000 7f8ebbad5740 1 -- start start 2024-08-31T05:38:49.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.005+0000 7f8ebbad5740 1 Processor -- start 2024-08-31T05:38:49.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.006+0000 7f8ebbad5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556551cb0490 0x55655208af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:49.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.006+0000 7f8ebbad5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556551cb8670 0x55655208b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:49.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.006+0000 7f8ebbad5740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556551cd9350 0x5565520971f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:49.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.006+0000 7f8ebbad5740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x556551e47890 con 0x556551cd9350 2024-08-31T05:38:49.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.006+0000 7f8ebbad5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x556551f6b790 con 0x556551cb0490 2024-08-31T05:38:49.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.006+0000 7f8ebbad5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55655208df00 con 0x556551cb8670 2024-08-31T05:38:49.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.006+0000 7f8ebbad5740 10 client.0 _ll_register_callbacks cb 0x556551cf0ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:38:49.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.006+0000 7f8eaf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556551cd9350 0x5565520971f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:49.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.006+0000 7f8eae7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556551cb8670 0x55655208b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:49.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.006+0000 7f8eae7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556551cb8670 0x55655208b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:59494/0 (socket says 172.21.15.5:59494) 2024-08-31T05:38:49.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.006+0000 7f8eae7fc640 1 -- 172.21.15.5:0/485252427 learned_addr learned my addr 172.21.15.5:0/485252427 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:49.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.006+0000 7f8eaeffd640 1 --2- 172.21.15.5:0/485252427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556551cb0490 0x55655208af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:49.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.006+0000 7f8eae7fc640 1 -- 172.21.15.5:0/485252427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556551cb0490 msgr2=0x55655208af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:49.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.006+0000 7f8eae7fc640 1 --2- 172.21.15.5:0/485252427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556551cb0490 0x55655208af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:49.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.006+0000 7f8eae7fc640 1 -- 172.21.15.5:0/485252427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556551cd9350 msgr2=0x5565520971f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:49.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.006+0000 7f8eae7fc640 1 --2- 172.21.15.5:0/485252427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556551cd9350 0x5565520971f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:49.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.006+0000 7f8eae7fc640 1 -- 172.21.15.5:0/485252427 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556551fa2f30 con 0x556551cb8670 2024-08-31T05:38:49.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.006+0000 7f8eaeffd640 1 --2- 172.21.15.5:0/485252427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556551cb0490 0x55655208af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:38:49.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.006+0000 7f8eae7fc640 1 --2- 172.21.15.5:0/485252427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556551cb8670 0x55655208b470 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0032f90 tx=0x7f8ea002a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e014cd0a6af31ae0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:49.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.006+0000 7f8e967fc640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:38:49.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.007+0000 7f8e967fc640 1 -- 172.21.15.5:0/485252427 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea0035070 con 0x556551cb8670 2024-08-31T05:38:49.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.007+0000 7f8ebbad5740 1 -- 172.21.15.5:0/485252427 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ea0004030 con 0x556551cb8670 2024-08-31T05:38:49.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.007+0000 7f8e967fc640 1 -- 172.21.15.5:0/485252427 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7f8ea0005260 con 0x556551cb8670 2024-08-31T05:38:49.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.007+0000 7f8e967fc640 1 -- 172.21.15.5:0/485252427 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f8ea0058050 con 0x556551cb8670 2024-08-31T05:38:49.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.007+0000 7f8ebbad5740 10 client.27538 fetch_fsmap learned FSMap version 34 2024-08-31T05:38:49.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.007+0000 7f8ebbad5740 1 -- 172.21.15.5:0/485252427 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x556552099cb0 con 0x556551cb8670 2024-08-31T05:38:49.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.007+0000 7f8e967fc640 1 -- 172.21.15.5:0/485252427 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ea0004030 con 0x556551cb8670 2024-08-31T05:38:49.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.007+0000 7f8e967fc640 1 -- 172.21.15.5:0/485252427 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f8ea0004b30 con 0x556551cb8670 2024-08-31T05:38:49.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.007+0000 7f8ebbad5740 10 client.27538 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:38:49.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.007+0000 7f8ebbad5740 10 client.27538 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:38:49.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.007+0000 7f8ebbad5740 20 client.27538 populate_metadata read hostname 'smithi005' 2024-08-31T05:38:49.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.007+0000 7f8ebbad5740 1 --2- 172.21.15.5:0/485252427 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x556551c97cd0 0x55655209d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:49.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.007+0000 7f8ebbad5740 4 client.27538 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:38:49.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.007+0000 7f8ebbad5740 1 -- 172.21.15.5:0/485252427 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556551ff7540 con 0x556551c97cd0 2024-08-31T05:38:49.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.008+0000 7f8eaeffd640 1 --2- 172.21.15.5:0/485252427 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x556551c97cd0 0x55655209d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:49.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.008+0000 7f8e967fc640 10 client.27538 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:38:49.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.008+0000 7f8eaeffd640 1 --2- 172.21.15.5:0/485252427 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x556551c97cd0 0x55655209d010 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb900b700d80ffab server_cookie=94760a2cd1565bd6 in_seq=0 out_seq=0 2024-08-31T05:38:49.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.009+0000 7f8e967fc640 1 -- 172.21.15.5:0/485252427 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556551ff7540 con 0x556551c97cd0 2024-08-31T05:38:49.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.009+0000 7f8e967fc640 10 client.27538 handle_command_reply: tid=0 2024-08-31T05:38:49.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.009+0000 7f8ebbad5740 1 client.27538 shutdown 2024-08-31T05:38:49.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.009+0000 7f8ebbad5740 1 -- 172.21.15.5:0/485252427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556551cb8670 msgr2=0x55655208b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:49.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.009+0000 7f8ebbad5740 1 --2- 172.21.15.5:0/485252427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556551cb8670 0x55655208b470 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0032f90 tx=0x7f8ea002a410 comp rx=0 tx=0).stop 2024-08-31T05:38:49.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.009+0000 7f8ebbad5740 1 -- 172.21.15.5:0/485252427 shutdown_connections 2024-08-31T05:38:49.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.009+0000 7f8ebbad5740 1 --2- 172.21.15.5:0/485252427 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x556551c97cd0 0x55655209d010 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:49.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.009+0000 7f8ebbad5740 1 --2- 172.21.15.5:0/485252427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556551cd9350 0x5565520971f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:49.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.009+0000 7f8ebbad5740 1 --2- 172.21.15.5:0/485252427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556551cb8670 0x55655208b470 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:49.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.009+0000 7f8e967fc640 0 client.27538 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:38:49.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.009+0000 7f8ebbad5740 1 --2- 172.21.15.5:0/485252427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556551cb0490 0x55655208af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:49.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.009+0000 7f8ebbad5740 1 -- 172.21.15.5:0/485252427 >> 172.21.15.5:0/485252427 conn(0x556551ccd740 msgr2=0x556552082960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:49.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.009+0000 7f8ebbad5740 1 -- 172.21.15.5:0/485252427 shutdown_connections 2024-08-31T05:38:49.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.009+0000 7f8ebbad5740 1 -- 172.21.15.5:0/485252427 wait complete. 2024-08-31T05:38:49.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.009+0000 7f8ebbad5740 20 client.27538 trim_cache size 0 max 16384 2024-08-31T05:38:49.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.028+0000 7f8ebbad5740 1 Processor -- start 2024-08-31T05:38:49.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.028+0000 7f8ebbad5740 1 -- start start 2024-08-31T05:38:49.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.029+0000 7f8ebbad5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556551c97cd0 0x556552082f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:49.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.029+0000 7f8ebbad5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556551cb0490 0x556552097160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:49.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.029+0000 7f8ebbad5740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556551cb8670 0x556552088120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:49.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.029+0000 7f8ebbad5740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb01b0ca0 con 0x556551cb8670 2024-08-31T05:38:49.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.029+0000 7f8ebbad5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb01b27e0 con 0x556551cb0490 2024-08-31T05:38:49.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.029+0000 7f8ebbad5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb01b1370 con 0x556551c97cd0 2024-08-31T05:38:49.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.029+0000 7f8eaf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556551cb8670 0x556552088120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:49.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.029+0000 7f8eae7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556551cb0490 0x556552097160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:49.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.029+0000 7f8eaf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556551cb8670 0x556552088120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45834/0 (socket says 172.21.15.5:45834) 2024-08-31T05:38:49.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.029+0000 7f8eae7fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556551cb0490 0x556552097160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:39362/0 (socket says 172.21.15.5:39362) 2024-08-31T05:38:49.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.029+0000 7f8eaf7fe640 1 -- 172.21.15.5:0/2014438873 learned_addr learned my addr 172.21.15.5:0/2014438873 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:49.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.029+0000 7f8eaeffd640 1 --2- 172.21.15.5:0/2014438873 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556551c97cd0 0x556552082f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:49.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.029+0000 7f8eae7fc640 1 -- 172.21.15.5:0/2014438873 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556551c97cd0 msgr2=0x556552082f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:49.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.029+0000 7f8eae7fc640 1 --2- 172.21.15.5:0/2014438873 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556551c97cd0 0x556552082f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:49.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.029+0000 7f8eae7fc640 1 -- 172.21.15.5:0/2014438873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556551cb8670 msgr2=0x556552088120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:49.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.029+0000 7f8eae7fc640 1 --2- 172.21.15.5:0/2014438873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556551cb8670 0x556552088120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:49.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.029+0000 7f8eae7fc640 1 -- 172.21.15.5:0/2014438873 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55655207e270 con 0x556551cb0490 2024-08-31T05:38:49.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.029+0000 7f8eaf7fe640 1 --2- 172.21.15.5:0/2014438873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556551cb8670 0x556552088120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:38:49.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.029+0000 7f8eae7fc640 1 --2- 172.21.15.5:0/2014438873 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556551cb0490 0x556552097160 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0009900 tx=0x7f8ea0032b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd5715d24b5a9ac server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:49.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.030+0000 7f8ea4ff9640 1 -- 172.21.15.5:0/2014438873 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea0035040 con 0x556551cb0490 2024-08-31T05:38:49.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.030+0000 7f8ea4ff9640 1 -- 172.21.15.5:0/2014438873 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ea00314a0 con 0x556551cb0490 2024-08-31T05:38:49.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.030+0000 7f8ea4ff9640 1 -- 172.21.15.5:0/2014438873 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea0040040 con 0x556551cb0490 2024-08-31T05:38:49.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.031+0000 7f8ebbad5740 1 -- 172.21.15.5:0/2014438873 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556551cb0490 msgr2=0x556552097160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:49.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.031+0000 7f8ebbad5740 1 --2- 172.21.15.5:0/2014438873 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556551cb0490 0x556552097160 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0009900 tx=0x7f8ea0032b60 comp rx=0 tx=0).stop 2024-08-31T05:38:49.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.031+0000 7f8ebbad5740 1 -- 172.21.15.5:0/2014438873 shutdown_connections 2024-08-31T05:38:49.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.031+0000 7f8ebbad5740 1 --2- 172.21.15.5:0/2014438873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556551cb8670 0x556552088120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:49.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.031+0000 7f8ebbad5740 1 --2- 172.21.15.5:0/2014438873 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556551cb0490 0x556552097160 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:49.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.031+0000 7f8ebbad5740 1 --2- 172.21.15.5:0/2014438873 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556551c97cd0 0x556552082f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:49.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.031+0000 7f8ebbad5740 1 -- 172.21.15.5:0/2014438873 >> 172.21.15.5:0/2014438873 conn(0x556551ccd740 msgr2=0x556552082880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:49.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.031+0000 7f8ebbad5740 1 -- 172.21.15.5:0/2014438873 shutdown_connections 2024-08-31T05:38:49.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.031+0000 7f8ebbad5740 1 -- 172.21.15.5:0/2014438873 wait complete. 2024-08-31T05:38:49.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.031+0000 7f8ebbad5740 1 -- start start 2024-08-31T05:38:49.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.031+0000 7f8ebbad5740 1 Processor -- start 2024-08-31T05:38:49.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.032+0000 7f8ebbad5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556551c97cd0 0x5565520a05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:49.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.032+0000 7f8ebbad5740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556551cb0490 0x55655209ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:49.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.032+0000 7f8ebbad5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556551cb8670 0x55655209f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:49.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.032+0000 7f8ebbad5740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb01b2110 con 0x556551cb0490 2024-08-31T05:38:49.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.032+0000 7f8ebbad5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb01b1a40 con 0x556551c97cd0 2024-08-31T05:38:49.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.032+0000 7f8ebbad5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb01aeca0 con 0x556551cb8670 2024-08-31T05:38:49.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.032+0000 7f8ebbad5740 10 client.0 _ll_register_callbacks cb 0x7f8ea8009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:38:49.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.032+0000 7f8eae7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556551cb0490 0x55655209ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:49.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.032+0000 7f8eae7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556551cb0490 0x55655209ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45850/0 (socket says 172.21.15.5:45850) 2024-08-31T05:38:49.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.032+0000 7f8eae7fc640 1 -- 172.21.15.5:0/304368634 learned_addr learned my addr 172.21.15.5:0/304368634 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:49.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.032+0000 7f8eaf7fe640 1 --2- 172.21.15.5:0/304368634 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556551cb8670 0x55655209f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:49.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.032+0000 7f8eaeffd640 1 --2- 172.21.15.5:0/304368634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556551c97cd0 0x5565520a05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:49.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.032+0000 7f8eae7fc640 1 -- 172.21.15.5:0/304368634 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556551cb8670 msgr2=0x55655209f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:49.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.032+0000 7f8eae7fc640 1 --2- 172.21.15.5:0/304368634 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556551cb8670 0x55655209f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:49.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.032+0000 7f8eae7fc640 1 -- 172.21.15.5:0/304368634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556551c97cd0 msgr2=0x5565520a05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:49.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.032+0000 7f8eae7fc640 1 --2- 172.21.15.5:0/304368634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556551c97cd0 0x5565520a05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:49.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.032+0000 7f8eae7fc640 1 -- 172.21.15.5:0/304368634 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55655209f580 con 0x556551cb0490 2024-08-31T05:38:49.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.032+0000 7f8eae7fc640 1 --2- 172.21.15.5:0/304368634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556551cb0490 0x55655209ead0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f8ea002a930 tx=0x7f8ea0005910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a612830e7a6d053b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:49.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.032+0000 7f8e967fc640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:38:49.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.033+0000 7f8e967fc640 1 -- 172.21.15.5:0/304368634 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea0068070 con 0x556551cb0490 2024-08-31T05:38:49.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.033+0000 7f8e967fc640 1 -- 172.21.15.5:0/304368634 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7f8ea00053f0 con 0x556551cb0490 2024-08-31T05:38:49.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.033+0000 7f8ebbad5740 1 -- 172.21.15.5:0/304368634 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ea00314a0 con 0x556551cb0490 2024-08-31T05:38:49.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.033+0000 7f8e967fc640 1 -- 172.21.15.5:0/304368634 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f8ea0074050 con 0x556551cb0490 2024-08-31T05:38:49.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.033+0000 7f8ebbad5740 10 client.17961 fetch_fsmap learned FSMap version 34 2024-08-31T05:38:49.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.033+0000 7f8ebbad5740 1 -- 172.21.15.5:0/304368634 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5565521084f0 con 0x556551cb0490 2024-08-31T05:38:49.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.033+0000 7f8e967fc640 1 -- 172.21.15.5:0/304368634 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ea00314a0 con 0x556551cb0490 2024-08-31T05:38:49.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.033+0000 7f8e967fc640 1 -- 172.21.15.5:0/304368634 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f8ea003c810 con 0x556551cb0490 2024-08-31T05:38:49.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.033+0000 7f8ebbad5740 10 client.17961 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:38:49.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.033+0000 7f8ebbad5740 10 client.17961 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:38:49.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.033+0000 7f8ebbad5740 20 client.17961 populate_metadata read hostname 'smithi005' 2024-08-31T05:38:49.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.033+0000 7f8ebbad5740 1 --2- 172.21.15.5:0/304368634 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x556551cd9350 0x55655210a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:49.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.033+0000 7f8ebbad5740 4 client.17961 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T05:38:49.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.033+0000 7f8ebbad5740 1 -- 172.21.15.5:0/304368634 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x556552086ae0 con 0x556551cd9350 2024-08-31T05:38:49.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.034+0000 7f8eaeffd640 1 --2- 172.21.15.5:0/304368634 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x556551cd9350 0x55655210a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:49.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.034+0000 7f8eaeffd640 1 --2- 172.21.15.5:0/304368634 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x556551cd9350 0x55655210a9d0 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b12400eca0e40cc1 server_cookie=8fc049f9f372af43 in_seq=0 out_seq=0 2024-08-31T05:38:49.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.034+0000 7f8e967fc640 10 client.17961 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:38:49.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.036+0000 7f8e967fc640 1 -- 172.21.15.5:0/304368634 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x556552086ae0 con 0x556551cd9350 2024-08-31T05:38:49.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.036+0000 7f8e967fc640 10 client.17961 handle_command_reply: tid=0 2024-08-31T05:38:49.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.036+0000 7f8ebbad5740 1 client.17961 shutdown 2024-08-31T05:38:49.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.036+0000 7f8ebbad5740 1 -- 172.21.15.5:0/304368634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556551cb0490 msgr2=0x55655209ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:49.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.036+0000 7f8ebbad5740 1 --2- 172.21.15.5:0/304368634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556551cb0490 0x55655209ead0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f8ea002a930 tx=0x7f8ea0005910 comp rx=0 tx=0).stop 2024-08-31T05:38:49.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.036+0000 7f8ebbad5740 1 -- 172.21.15.5:0/304368634 shutdown_connections 2024-08-31T05:38:49.040 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.036+0000 7f8ebbad5740 1 --2- 172.21.15.5:0/304368634 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x556551cd9350 0x55655210a9d0 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:49.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.036+0000 7f8ebbad5740 1 --2- 172.21.15.5:0/304368634 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556551cb8670 0x55655209f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:49.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.036+0000 7f8ebbad5740 1 --2- 172.21.15.5:0/304368634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556551cb0490 0x55655209ead0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:49.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.036+0000 7f8e967fc640 0 client.17961 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:38:49.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.036+0000 7f8ebbad5740 1 --2- 172.21.15.5:0/304368634 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556551c97cd0 0x5565520a05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:49.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.036+0000 7f8ebbad5740 1 -- 172.21.15.5:0/304368634 >> 172.21.15.5:0/304368634 conn(0x556551ccd740 msgr2=0x55655208c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:49.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.036+0000 7f8ebbad5740 1 -- 172.21.15.5:0/304368634 shutdown_connections 2024-08-31T05:38:49.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.036+0000 7f8ebbad5740 1 -- 172.21.15.5:0/304368634 wait complete. 2024-08-31T05:38:49.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.036+0000 7f8ebbad5740 20 client.17961 trim_cache size 0 max 16384 2024-08-31T05:38:49.041 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:38:49.041 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-08-31T05:38:49.041 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "f4db3406-20ff-46a3-baf9-099e16392f76", 2024-08-31T05:38:49.042 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-08-31T05:38:49.042 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:38:49.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.037+0000 7f8eb5560640 1 -- 172.21.15.5:0/2946301772 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f8e9c0b4d20 msgr2=0x7f8e9c0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:49.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.037+0000 7f8eb5560640 1 --2- 172.21.15.5:0/2946301772 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f8e9c0b4d20 0x7f8e9c0b7230 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8005fd0 tx=0x7f8ea8009600 comp rx=0 tx=0).stop 2024-08-31T05:38:49.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.037+0000 7f8eb5560640 1 -- 172.21.15.5:0/2946301772 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8eb0102880 msgr2=0x7f8eb019b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:49.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.037+0000 7f8eb5560640 1 --2- 172.21.15.5:0/2946301772 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8eb0102880 0x7f8eb019b060 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f8e9800e9f0 tx=0x7f8e9800edf0 comp rx=0 tx=0).stop 2024-08-31T05:38:49.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.037+0000 7f8eb5560640 1 -- 172.21.15.5:0/2946301772 shutdown_connections 2024-08-31T05:38:49.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.037+0000 7f8eb5560640 1 --2- 172.21.15.5:0/2946301772 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f8e9c0b4d20 0x7f8e9c0b7230 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:49.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.037+0000 7f8eb5560640 1 --2- 172.21.15.5:0/2946301772 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8eb0108ac0 0x7f8eb019bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:49.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.037+0000 7f8eb5560640 1 --2- 172.21.15.5:0/2946301772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8eb0108170 0x7f8eb019b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:49.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.037+0000 7f8eb5560640 1 --2- 172.21.15.5:0/2946301772 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8eb0102880 0x7f8eb019b060 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:49.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.037+0000 7f8eb5560640 1 -- 172.21.15.5:0/2946301772 >> 172.21.15.5:0/2946301772 conn(0x7f8eb0079530 msgr2=0x7f8eb0106200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:49.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.037+0000 7f8eb5560640 1 -- 172.21.15.5:0/2946301772 shutdown_connections 2024-08-31T05:38:49.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:49.037+0000 7f8eb5560640 1 -- 172.21.15.5:0/2946301772 wait complete. 2024-08-31T05:38:49.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:38:48 smithi050 ceph-mon[22146]: pgmap v614: 129 pgs: 129 active+clean; 526 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.7 MiB/s wr, 190 op/s 2024-08-31T05:38:49.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:38:48 smithi005 ceph-mon[18602]: pgmap v614: 129 pgs: 129 active+clean; 526 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.7 MiB/s wr, 190 op/s 2024-08-31T05:38:49.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:38:48 smithi070 ceph-mon[22316]: pgmap v614: 129 pgs: 129 active+clean; 526 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.7 MiB/s wr, 190 op/s 2024-08-31T05:38:49.917 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T05:38:49.931 INFO:tasks.workunit.client.0.smithi005.stdout: 1 999392 11.24 MB/sec execute 337 sec latency 57.897 ms 2024-08-31T05:38:50.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:38:49 smithi050 ceph-mon[22146]: scrub queued for path: / 2024-08-31T05:38:50.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:38:49 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:38:50.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:38:49 smithi050 ceph-mon[22146]: scrub summary: active paths [/] 2024-08-31T05:38:50.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:38:49 smithi050 ceph-mon[22146]: scrub summary: active paths [/] 2024-08-31T05:38:50.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:38:49 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:38:50.209 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:38:50.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:38:49 smithi005 ceph-mon[18602]: scrub queued for path: / 2024-08-31T05:38:50.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:38:49 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:38:50.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:38:49 smithi005 ceph-mon[18602]: scrub summary: active paths [/] 2024-08-31T05:38:50.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:38:49 smithi005 ceph-mon[18602]: scrub summary: active paths [/] 2024-08-31T05:38:50.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:38:49 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:38:50.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:38:49 smithi070 ceph-mon[22316]: scrub queued for path: / 2024-08-31T05:38:50.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:38:49 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:38:50.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:38:49 smithi070 ceph-mon[22316]: scrub summary: active paths [/] 2024-08-31T05:38:50.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:38:49 smithi070 ceph-mon[22316]: scrub summary: active paths [/] 2024-08-31T05:38:50.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:38:49 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:38:50.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.722+0000 7f84a58a1640 1 -- 172.21.15.5:0/2808793760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84a01050a0 msgr2=0x7f84a010d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:50.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.722+0000 7f84a58a1640 1 --2- 172.21.15.5:0/2808793760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84a01050a0 0x7f84a010d5f0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f8488009900 tx=0x7f848802a410 comp rx=0 tx=0).stop 2024-08-31T05:38:50.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.722+0000 7f84a58a1640 1 -- 172.21.15.5:0/2808793760 shutdown_connections 2024-08-31T05:38:50.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.722+0000 7f84a58a1640 1 --2- 172.21.15.5:0/2808793760 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f84a010dbb0 0x7f84a01100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:50.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.722+0000 7f84a58a1640 1 --2- 172.21.15.5:0/2808793760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84a01050a0 0x7f84a010d5f0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:50.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.722+0000 7f84a58a1640 1 --2- 172.21.15.5:0/2808793760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84a0104750 0x7f84a0104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:50.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.722+0000 7f84a58a1640 1 -- 172.21.15.5:0/2808793760 >> 172.21.15.5:0/2808793760 conn(0x7f84a00794d0 msgr2=0x7f84a00798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:50.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.723+0000 7f84a58a1640 1 -- 172.21.15.5:0/2808793760 shutdown_connections 2024-08-31T05:38:50.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.723+0000 7f84a58a1640 1 -- 172.21.15.5:0/2808793760 wait complete. 2024-08-31T05:38:50.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.724+0000 7f84a58a1640 1 Processor -- start 2024-08-31T05:38:50.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.724+0000 7f84a58a1640 1 -- start start 2024-08-31T05:38:50.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.724+0000 7f84a58a1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84a0104750 0x7f84a01a14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:50.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.724+0000 7f84a58a1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f84a01050a0 0x7f84a01a1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:50.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.724+0000 7f84a58a1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84a010dbb0 0x7f84a01ac550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:50.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.724+0000 7f84a58a1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f84a01137f0 con 0x7f84a010dbb0 2024-08-31T05:38:50.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.724+0000 7f84a58a1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f84a0113670 con 0x7f84a0104750 2024-08-31T05:38:50.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.724+0000 7f84a58a1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f84a0113970 con 0x7f84a01050a0 2024-08-31T05:38:50.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.724+0000 7f849effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84a0104750 0x7f84a01a14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:50.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.724+0000 7f849e7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f84a01050a0 0x7f84a01a1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:50.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.724+0000 7f849effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84a0104750 0x7f84a01a14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:39384/0 (socket says 172.21.15.5:39384) 2024-08-31T05:38:50.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.724+0000 7f849effd640 1 -- 172.21.15.5:0/1583517651 learned_addr learned my addr 172.21.15.5:0/1583517651 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:50.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.725+0000 7f849f7fe640 1 --2- 172.21.15.5:0/1583517651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84a010dbb0 0x7f84a01ac550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:50.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.725+0000 7f849effd640 1 -- 172.21.15.5:0/1583517651 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f84a01050a0 msgr2=0x7f84a01a1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:50.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.725+0000 7f849effd640 1 --2- 172.21.15.5:0/1583517651 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f84a01050a0 0x7f84a01a1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:50.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.725+0000 7f849effd640 1 -- 172.21.15.5:0/1583517651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84a010dbb0 msgr2=0x7f84a01ac550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:50.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.725+0000 7f849effd640 1 --2- 172.21.15.5:0/1583517651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84a010dbb0 0x7f84a01ac550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:50.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.725+0000 7f849effd640 1 -- 172.21.15.5:0/1583517651 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84a01aca90 con 0x7f84a0104750 2024-08-31T05:38:50.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.725+0000 7f849f7fe640 1 --2- 172.21.15.5:0/1583517651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84a010dbb0 0x7f84a01ac550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:38:50.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.725+0000 7f849effd640 1 --2- 172.21.15.5:0/1583517651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84a0104750 0x7f84a01a14d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f849000ea80 tx=0x7f849000ef40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:50.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.725+0000 7f84a489f640 1 -- 172.21.15.5:0/1583517651 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f849000ce40 con 0x7f84a0104750 2024-08-31T05:38:50.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.725+0000 7f84a58a1640 1 -- 172.21.15.5:0/1583517651 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84a01acc60 con 0x7f84a0104750 2024-08-31T05:38:50.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.725+0000 7f84a489f640 1 -- 172.21.15.5:0/1583517651 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8490011920 con 0x7f84a0104750 2024-08-31T05:38:50.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.725+0000 7f84a489f640 1 -- 172.21.15.5:0/1583517651 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f849001aaa0 con 0x7f84a0104750 2024-08-31T05:38:50.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.725+0000 7f84a58a1640 1 -- 172.21.15.5:0/1583517651 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84a01ad160 con 0x7f84a0104750 2024-08-31T05:38:50.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.728+0000 7f84a489f640 1 -- 172.21.15.5:0/1583517651 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f849001ac40 con 0x7f84a0104750 2024-08-31T05:38:50.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.728+0000 7f84abe16740 1 Processor -- start 2024-08-31T05:38:50.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.728+0000 7f84abe16740 1 -- start start 2024-08-31T05:38:50.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.728+0000 7f84abe16740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f061f9f070 0x55f0623442c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:50.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.728+0000 7f84abe16740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f061f761b0 0x55f062344800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:50.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.728+0000 7f84abe16740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f061f7e390 0x55f062344d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:50.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.728+0000 7f84abe16740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f0622bb630 con 0x55f061f9f070 2024-08-31T05:38:50.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.728+0000 7f84abe16740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f0622aabc0 con 0x55f061f7e390 2024-08-31T05:38:50.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.728+0000 7f84abe16740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f0622aeb70 con 0x55f061f761b0 2024-08-31T05:38:50.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.728+0000 7f849f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f061f9f070 0x55f0623442c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:50.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.729+0000 7f849effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f061f761b0 0x55f062344800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:50.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.729+0000 7f849f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f061f9f070 0x55f0623442c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45868/0 (socket says 172.21.15.5:45868) 2024-08-31T05:38:50.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.729+0000 7f849f7fe640 1 -- 172.21.15.5:0/2856633070 learned_addr learned my addr 172.21.15.5:0/2856633070 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:50.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.729+0000 7f849e7fc640 1 --2- 172.21.15.5:0/2856633070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f061f7e390 0x55f062344d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:50.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.729+0000 7f84a489f640 1 --2- 172.21.15.5:0/1583517651 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f848c0b4ca0 0x7f848c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:50.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.729+0000 7f849effd640 1 -- 172.21.15.5:0/2856633070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f061f7e390 msgr2=0x55f062344d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:50.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.729+0000 7f849effd640 1 --2- 172.21.15.5:0/2856633070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f061f7e390 0x55f062344d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:50.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.729+0000 7f849effd640 1 -- 172.21.15.5:0/2856633070 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f061f9f070 msgr2=0x55f0623442c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:50.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.729+0000 7f849effd640 1 --2- 172.21.15.5:0/2856633070 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f061f9f070 0x55f0623442c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:50.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.729+0000 7f849effd640 1 -- 172.21.15.5:0/2856633070 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f06200a650 con 0x55f061f761b0 2024-08-31T05:38:50.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.729+0000 7f849f7fe640 1 --2- 172.21.15.5:0/2856633070 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f061f9f070 0x55f0623442c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:38:50.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.729+0000 7f849f7fe640 1 --2- 172.21.15.5:0/1583517651 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f848c0b4ca0 0x7f848c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:50.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.729+0000 7f84a489f640 1 -- 172.21.15.5:0/1583517651 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7f84900e5e70 con 0x7f84a0104750 2024-08-31T05:38:50.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.729+0000 7f849effd640 1 --2- 172.21.15.5:0/2856633070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f061f761b0 0x55f062344800 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f84900e31e0 tx=0x7f84900bdcf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f83060187f4dfaf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:50.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.729+0000 7f8495ffb640 1 -- 172.21.15.5:0/2856633070 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84900a7e70 con 0x55f061f761b0 2024-08-31T05:38:50.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.729+0000 7f8495ffb640 1 -- 172.21.15.5:0/2856633070 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84900abc90 con 0x55f061f761b0 2024-08-31T05:38:50.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.729+0000 7f8495ffb640 1 -- 172.21.15.5:0/2856633070 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84900ab8f0 con 0x55f061f761b0 2024-08-31T05:38:50.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.730+0000 7f84abe16740 1 -- 172.21.15.5:0/2856633070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f061f761b0 msgr2=0x55f062344800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:50.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.730+0000 7f84abe16740 1 --2- 172.21.15.5:0/2856633070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f061f761b0 0x55f062344800 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f84900e31e0 tx=0x7f84900bdcf0 comp rx=0 tx=0).stop 2024-08-31T05:38:50.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.730+0000 7f849f7fe640 1 --2- 172.21.15.5:0/1583517651 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f848c0b4ca0 0x7f848c0b71b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8498014470 tx=0x7f84980046c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:50.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.730+0000 7f84abe16740 1 -- 172.21.15.5:0/2856633070 shutdown_connections 2024-08-31T05:38:50.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.730+0000 7f84abe16740 1 --2- 172.21.15.5:0/2856633070 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f061f7e390 0x55f062344d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:50.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.730+0000 7f84abe16740 1 --2- 172.21.15.5:0/2856633070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f061f761b0 0x55f062344800 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:50.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.730+0000 7f84abe16740 1 --2- 172.21.15.5:0/2856633070 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f061f9f070 0x55f0623442c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:50.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.730+0000 7f84abe16740 1 -- 172.21.15.5:0/2856633070 >> 172.21.15.5:0/2856633070 conn(0x55f061f93460 msgr2=0x55f0623421b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:50.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.730+0000 7f84abe16740 1 -- 172.21.15.5:0/2856633070 shutdown_connections 2024-08-31T05:38:50.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.730+0000 7f84abe16740 1 -- 172.21.15.5:0/2856633070 wait complete. 2024-08-31T05:38:50.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.731+0000 7f84abe16740 1 -- start start 2024-08-31T05:38:50.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.731+0000 7f84abe16740 1 Processor -- start 2024-08-31T05:38:50.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.732+0000 7f84abe16740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f061f761b0 0x55f06234f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:50.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.732+0000 7f84abe16740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f061f7e390 0x55f06234ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:50.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.732+0000 7f84abe16740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f061f9f070 0x55f06235bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:50.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.732+0000 7f84abe16740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f06210d700 con 0x55f061f7e390 2024-08-31T05:38:50.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.732+0000 7f84abe16740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f062231700 con 0x55f061f9f070 2024-08-31T05:38:50.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.732+0000 7f84abe16740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f062352aa0 con 0x55f061f761b0 2024-08-31T05:38:50.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.732+0000 7f84abe16740 10 client.0 _ll_register_callbacks cb 0x55f062260dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:38:50.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.732+0000 7f849e7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f061f7e390 0x55f06234ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:50.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.732+0000 7f849effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f061f761b0 0x55f06234f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:50.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.732+0000 7f849e7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f061f7e390 0x55f06234ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45880/0 (socket says 172.21.15.5:45880) 2024-08-31T05:38:50.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.732+0000 7f849e7fc640 1 -- 172.21.15.5:0/3590297171 learned_addr learned my addr 172.21.15.5:0/3590297171 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:50.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.732+0000 7f849f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f061f9f070 0x55f06235bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:50.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.732+0000 7f849e7fc640 1 -- 172.21.15.5:0/3590297171 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f061f761b0 msgr2=0x55f06234f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:50.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.732+0000 7f849e7fc640 1 --2- 172.21.15.5:0/3590297171 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f061f761b0 0x55f06234f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:50.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.732+0000 7f849e7fc640 1 -- 172.21.15.5:0/3590297171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f061f9f070 msgr2=0x55f06235bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:50.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.732+0000 7f849e7fc640 1 --2- 172.21.15.5:0/3590297171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f061f9f070 0x55f06235bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:50.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.732+0000 7f849e7fc640 1 -- 172.21.15.5:0/3590297171 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f06226a8b0 con 0x55f061f7e390 2024-08-31T05:38:50.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.732+0000 7f849effd640 1 --2- 172.21.15.5:0/3590297171 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f061f761b0 0x55f06234f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:38:50.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.732+0000 7f849e7fc640 1 --2- 172.21.15.5:0/3590297171 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f061f7e390 0x55f06234ff20 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f8488009900 tx=0x7f8488032f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df6dfb4a5d6538b5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:50.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.732+0000 7f847effd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:38:50.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.732+0000 7f847effd640 1 -- 172.21.15.5:0/3590297171 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8488035040 con 0x55f061f7e390 2024-08-31T05:38:50.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.733+0000 7f84abe16740 1 -- 172.21.15.5:0/3590297171 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84900abc90 con 0x55f061f7e390 2024-08-31T05:38:50.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.733+0000 7f847effd640 1 -- 172.21.15.5:0/3590297171 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7f84880317a0 con 0x55f061f7e390 2024-08-31T05:38:50.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.733+0000 7f847effd640 1 -- 172.21.15.5:0/3590297171 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f848804f050 con 0x55f061f7e390 2024-08-31T05:38:50.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.733+0000 7f84abe16740 10 client.17973 fetch_fsmap learned FSMap version 34 2024-08-31T05:38:50.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.733+0000 7f84abe16740 1 -- 172.21.15.5:0/3590297171 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55f06235e830 con 0x55f061f7e390 2024-08-31T05:38:50.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.733+0000 7f847effd640 1 -- 172.21.15.5:0/3590297171 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84900abc90 con 0x55f061f7e390 2024-08-31T05:38:50.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.733+0000 7f847effd640 1 -- 172.21.15.5:0/3590297171 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f8488004750 con 0x55f061f7e390 2024-08-31T05:38:50.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.733+0000 7f84abe16740 10 client.17973 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:38:50.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.733+0000 7f84abe16740 10 client.17973 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:38:50.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.733+0000 7f84abe16740 20 client.17973 populate_metadata read hostname 'smithi005' 2024-08-31T05:38:50.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.733+0000 7f84abe16740 1 --2- 172.21.15.5:0/3590297171 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55f061f5d9f0 0x55f062361cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:50.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.733+0000 7f84abe16740 4 client.17973 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:38:50.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.733+0000 7f84abe16740 1 -- 172.21.15.5:0/3590297171 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f0622bd580 con 0x55f061f5d9f0 2024-08-31T05:38:50.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.733+0000 7f849effd640 1 --2- 172.21.15.5:0/3590297171 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55f061f5d9f0 0x55f062361cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:50.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.734+0000 7f847effd640 10 client.17973 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:38:50.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.734+0000 7f849effd640 1 --2- 172.21.15.5:0/3590297171 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55f061f5d9f0 0x55f062361cd0 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=311bf99d82d275b3 server_cookie=ec8a08610233d3ce in_seq=0 out_seq=0 2024-08-31T05:38:50.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.735+0000 7f847effd640 1 -- 172.21.15.5:0/3590297171 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f0622bd580 con 0x55f061f5d9f0 2024-08-31T05:38:50.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.735+0000 7f847effd640 10 client.17973 handle_command_reply: tid=0 2024-08-31T05:38:50.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.735+0000 7f84abe16740 1 client.17973 shutdown 2024-08-31T05:38:50.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.735+0000 7f84abe16740 1 -- 172.21.15.5:0/3590297171 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f061f7e390 msgr2=0x55f06234ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:50.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.735+0000 7f84abe16740 1 --2- 172.21.15.5:0/3590297171 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f061f7e390 0x55f06234ff20 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f8488009900 tx=0x7f8488032f60 comp rx=0 tx=0).stop 2024-08-31T05:38:50.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.735+0000 7f84abe16740 1 -- 172.21.15.5:0/3590297171 shutdown_connections 2024-08-31T05:38:50.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.735+0000 7f84abe16740 1 --2- 172.21.15.5:0/3590297171 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55f061f5d9f0 0x55f062361cd0 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:50.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.735+0000 7f84abe16740 1 --2- 172.21.15.5:0/3590297171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f061f9f070 0x55f06235bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:50.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.735+0000 7f84abe16740 1 --2- 172.21.15.5:0/3590297171 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f061f7e390 0x55f06234ff20 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:50.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.735+0000 7f847effd640 0 client.17973 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:38:50.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.735+0000 7f84abe16740 1 --2- 172.21.15.5:0/3590297171 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f061f761b0 0x55f06234f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:50.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.735+0000 7f84abe16740 1 -- 172.21.15.5:0/3590297171 >> 172.21.15.5:0/3590297171 conn(0x55f061f93460 msgr2=0x55f0623452f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:50.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.735+0000 7f84abe16740 1 -- 172.21.15.5:0/3590297171 shutdown_connections 2024-08-31T05:38:50.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.735+0000 7f84abe16740 1 -- 172.21.15.5:0/3590297171 wait complete. 2024-08-31T05:38:50.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.735+0000 7f84abe16740 20 client.17973 trim_cache size 0 max 16384 2024-08-31T05:38:50.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.754+0000 7f84abe16740 1 Processor -- start 2024-08-31T05:38:50.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.754+0000 7f84abe16740 1 -- start start 2024-08-31T05:38:50.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.754+0000 7f84abe16740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f061f5d9f0 0x55f062351610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:50.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.754+0000 7f84abe16740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f061f761b0 0x55f06235bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:50.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.754+0000 7f84abe16740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f061f7e390 0x55f06234cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:50.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.754+0000 7f84abe16740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f84a01b7350 con 0x55f061f5d9f0 2024-08-31T05:38:50.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.754+0000 7f84abe16740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f84a01b8e90 con 0x55f061f7e390 2024-08-31T05:38:50.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.754+0000 7f84abe16740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f84a01b7a20 con 0x55f061f761b0 2024-08-31T05:38:50.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.754+0000 7f849effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f061f5d9f0 0x55f062351610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:50.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.754+0000 7f849effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f061f5d9f0 0x55f062351610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45890/0 (socket says 172.21.15.5:45890) 2024-08-31T05:38:50.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.754+0000 7f849effd640 1 -- 172.21.15.5:0/3392350182 learned_addr learned my addr 172.21.15.5:0/3392350182 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:50.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.754+0000 7f849e7fc640 1 --2- 172.21.15.5:0/3392350182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f061f761b0 0x55f06235bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:50.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.754+0000 7f849f7fe640 1 --2- 172.21.15.5:0/3392350182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f061f7e390 0x55f06234cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:50.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.754+0000 7f849effd640 1 -- 172.21.15.5:0/3392350182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f061f761b0 msgr2=0x55f06235bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:50.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.754+0000 7f849effd640 1 --2- 172.21.15.5:0/3392350182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f061f761b0 0x55f06235bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:50.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.754+0000 7f849effd640 1 -- 172.21.15.5:0/3392350182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f061f7e390 msgr2=0x55f06234cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:50.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.754+0000 7f849effd640 1 --2- 172.21.15.5:0/3392350182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f061f7e390 0x55f06234cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:50.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.754+0000 7f849effd640 1 -- 172.21.15.5:0/3392350182 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0623465b0 con 0x55f061f5d9f0 2024-08-31T05:38:50.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.755+0000 7f849effd640 1 --2- 172.21.15.5:0/3392350182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f061f5d9f0 0x55f062351610 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f8490013010 tx=0x7f84900bd040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eae3bca76f6201fe server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:50.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.755+0000 7f84957fa640 1 -- 172.21.15.5:0/3392350182 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84900abad0 con 0x55f061f5d9f0 2024-08-31T05:38:50.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.755+0000 7f84957fa640 1 -- 172.21.15.5:0/3392350182 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84900e9790 con 0x55f061f5d9f0 2024-08-31T05:38:50.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.755+0000 7f84957fa640 1 -- 172.21.15.5:0/3392350182 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84900abf50 con 0x55f061f5d9f0 2024-08-31T05:38:50.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.755+0000 7f84abe16740 1 -- 172.21.15.5:0/3392350182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f061f5d9f0 msgr2=0x55f062351610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:50.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.755+0000 7f84abe16740 1 --2- 172.21.15.5:0/3392350182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f061f5d9f0 0x55f062351610 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f8490013010 tx=0x7f84900bd040 comp rx=0 tx=0).stop 2024-08-31T05:38:50.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.756+0000 7f84abe16740 1 -- 172.21.15.5:0/3392350182 shutdown_connections 2024-08-31T05:38:50.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.756+0000 7f84abe16740 1 --2- 172.21.15.5:0/3392350182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f061f7e390 0x55f06234cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:50.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.756+0000 7f84abe16740 1 --2- 172.21.15.5:0/3392350182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f061f761b0 0x55f06235bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:50.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.756+0000 7f84abe16740 1 --2- 172.21.15.5:0/3392350182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f061f5d9f0 0x55f062351610 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:50.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.756+0000 7f84abe16740 1 -- 172.21.15.5:0/3392350182 >> 172.21.15.5:0/3392350182 conn(0x55f061f93460 msgr2=0x55f062350f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:50.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.756+0000 7f84abe16740 1 -- 172.21.15.5:0/3392350182 shutdown_connections 2024-08-31T05:38:50.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.756+0000 7f84abe16740 1 -- 172.21.15.5:0/3392350182 wait complete. 2024-08-31T05:38:50.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.756+0000 7f84abe16740 1 -- start start 2024-08-31T05:38:50.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.756+0000 7f84abe16740 1 Processor -- start 2024-08-31T05:38:50.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.756+0000 7f84abe16740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f061f5d9f0 0x55f0623543b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:50.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.756+0000 7f84abe16740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f061f761b0 0x55f0623548f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:50.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.756+0000 7f84abe16740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f061f7e390 0x55f0623cb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:50.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.757+0000 7f84abe16740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f84a01b87c0 con 0x55f061f761b0 2024-08-31T05:38:50.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.757+0000 7f84abe16740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f84a01b80f0 con 0x55f061f5d9f0 2024-08-31T05:38:50.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.757+0000 7f84abe16740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f84a01b5350 con 0x55f061f7e390 2024-08-31T05:38:50.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.757+0000 7f84abe16740 10 client.0 _ll_register_callbacks cb 0x7f8488009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:38:50.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.757+0000 7f849e7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f061f761b0 0x55f0623548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:50.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.757+0000 7f849effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f061f5d9f0 0x55f0623543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:50.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.757+0000 7f849e7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f061f761b0 0x55f0623548f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45896/0 (socket says 172.21.15.5:45896) 2024-08-31T05:38:50.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.757+0000 7f849e7fc640 1 -- 172.21.15.5:0/3725578493 learned_addr learned my addr 172.21.15.5:0/3725578493 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:50.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.757+0000 7f849f7fe640 1 --2- 172.21.15.5:0/3725578493 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f061f7e390 0x55f0623cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:50.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.757+0000 7f849e7fc640 1 -- 172.21.15.5:0/3725578493 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f061f7e390 msgr2=0x55f0623cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:50.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.757+0000 7f849e7fc640 1 --2- 172.21.15.5:0/3725578493 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f061f7e390 0x55f0623cb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:50.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.757+0000 7f849e7fc640 1 -- 172.21.15.5:0/3725578493 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f061f5d9f0 msgr2=0x55f0623543b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:50.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.757+0000 7f849e7fc640 1 --2- 172.21.15.5:0/3725578493 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f061f5d9f0 0x55f0623543b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:50.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.757+0000 7f849e7fc640 1 -- 172.21.15.5:0/3725578493 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0623cbbd0 con 0x55f061f761b0 2024-08-31T05:38:50.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.757+0000 7f849effd640 1 --2- 172.21.15.5:0/3725578493 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f061f5d9f0 0x55f0623543b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:38:50.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.757+0000 7f849e7fc640 1 --2- 172.21.15.5:0/3725578493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f061f761b0 0x55f0623548f0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f8488009900 tx=0x7f84880048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c429406d4fe7c035 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:50.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.757+0000 7f847effd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:38:50.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.757+0000 7f847effd640 1 -- 172.21.15.5:0/3725578493 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8488058060 con 0x55f061f761b0 2024-08-31T05:38:50.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.757+0000 7f847effd640 1 -- 172.21.15.5:0/3725578493 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7f8488031d20 con 0x55f061f761b0 2024-08-31T05:38:50.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.757+0000 7f84abe16740 1 -- 172.21.15.5:0/3725578493 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84900e9790 con 0x55f061f761b0 2024-08-31T05:38:50.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.758+0000 7f847effd640 1 -- 172.21.15.5:0/3725578493 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f8488035070 con 0x55f061f761b0 2024-08-31T05:38:50.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.758+0000 7f84abe16740 10 client.17979 fetch_fsmap learned FSMap version 34 2024-08-31T05:38:50.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.758+0000 7f84abe16740 1 -- 172.21.15.5:0/3725578493 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55f0623cce10 con 0x55f061f761b0 2024-08-31T05:38:50.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.758+0000 7f847effd640 1 -- 172.21.15.5:0/3725578493 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84900e9790 con 0x55f061f761b0 2024-08-31T05:38:50.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.759+0000 7f847effd640 1 -- 172.21.15.5:0/3725578493 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f8488005330 con 0x55f061f761b0 2024-08-31T05:38:50.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.759+0000 7f84abe16740 10 client.17979 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:38:50.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.759+0000 7f84abe16740 10 client.17979 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:38:50.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.759+0000 7f84abe16740 20 client.17979 populate_metadata read hostname 'smithi005' 2024-08-31T05:38:50.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.759+0000 7f84abe16740 1 --2- 172.21.15.5:0/3725578493 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55f061f9f070 0x55f0623cf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:50.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.759+0000 7f84abe16740 4 client.17979 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T05:38:50.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.759+0000 7f84abe16740 1 -- 172.21.15.5:0/3725578493 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f0622b9020 con 0x55f061f9f070 2024-08-31T05:38:50.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.759+0000 7f849effd640 1 --2- 172.21.15.5:0/3725578493 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55f061f9f070 0x55f0623cf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:50.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.760+0000 7f849effd640 1 --2- 172.21.15.5:0/3725578493 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55f061f9f070 0x55f0623cf5d0 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc131e90262d9561 server_cookie=22a66ff22f65d8cb in_seq=0 out_seq=0 2024-08-31T05:38:50.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.760+0000 7f847effd640 10 client.17979 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:38:50.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.760+0000 7f847effd640 1 -- 172.21.15.5:0/3725578493 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3694 (crc 0 0 0) 0x55f0622b9020 con 0x55f061f9f070 2024-08-31T05:38:50.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.760+0000 7f847effd640 10 client.17979 handle_command_reply: tid=0 2024-08-31T05:38:50.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.760+0000 7f84abe16740 1 client.17979 shutdown 2024-08-31T05:38:50.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.760+0000 7f84abe16740 1 -- 172.21.15.5:0/3725578493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f061f761b0 msgr2=0x55f0623548f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:50.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.760+0000 7f84abe16740 1 --2- 172.21.15.5:0/3725578493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f061f761b0 0x55f0623548f0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f8488009900 tx=0x7f84880048f0 comp rx=0 tx=0).stop 2024-08-31T05:38:50.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.760+0000 7f84abe16740 1 -- 172.21.15.5:0/3725578493 shutdown_connections 2024-08-31T05:38:50.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.760+0000 7f84abe16740 1 --2- 172.21.15.5:0/3725578493 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55f061f9f070 0x55f0623cf5d0 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:50.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.760+0000 7f84abe16740 1 --2- 172.21.15.5:0/3725578493 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f061f7e390 0x55f0623cb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:50.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.760+0000 7f84abe16740 1 --2- 172.21.15.5:0/3725578493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f061f761b0 0x55f0623548f0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:50.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.760+0000 7f84abe16740 1 --2- 172.21.15.5:0/3725578493 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f061f5d9f0 0x55f0623543b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:50.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.760+0000 7f847effd640 0 client.17979 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:38:50.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.760+0000 7f84abe16740 1 -- 172.21.15.5:0/3725578493 >> 172.21.15.5:0/3725578493 conn(0x55f061f93460 msgr2=0x55f062351620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:50.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.760+0000 7f84abe16740 1 -- 172.21.15.5:0/3725578493 shutdown_connections 2024-08-31T05:38:50.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.760+0000 7f84abe16740 1 -- 172.21.15.5:0/3725578493 wait complete. 2024-08-31T05:38:50.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.760+0000 7f84abe16740 20 client.17979 trim_cache size 0 max 16384 2024-08-31T05:38:50.791 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:38:50.791 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T05:38:50.791 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2024-08-31T05:38:50.791 INFO:teuthology.orchestra.run.smithi005.stdout: "f4db3406-20ff-46a3-baf9-099e16392f76": { 2024-08-31T05:38:50.791 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:38:50.792 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "f4db3406-20ff-46a3-baf9-099e16392f76", 2024-08-31T05:38:50.792 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2024-08-31T05:38:50.792 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:38:50.792 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:38:50.792 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_stats": { 2024-08-31T05:38:50.792 INFO:teuthology.orchestra.run.smithi005.stdout: "94c23057-592d-4a8b-82d7-da2d84f8740b": { 2024-08-31T05:38:50.793 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:36:27.513638+0000", 2024-08-31T05:38:50.793 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:38:50.793 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:38:50.793 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:38:50.793 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:38:50.794 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:38:50.794 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:38:50.794 INFO:teuthology.orchestra.run.smithi005.stdout: "a4d4cf74-2477-4dd9-a3a2-3762b4dd87e4": { 2024-08-31T05:38:50.794 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:38:01.378833+0000", 2024-08-31T05:38:50.794 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:38:50.794 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:38:50.795 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:38:50.795 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:38:50.795 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:38:50.795 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:38:50.795 INFO:teuthology.orchestra.run.smithi005.stdout: "095ccc7a-f368-4bc6-9563-5930e21f9b4a": { 2024-08-31T05:38:50.795 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:35:40.190069+0000", 2024-08-31T05:38:50.796 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:38:50.796 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:38:50.796 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:38:50.796 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:38:50.796 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:38:50.797 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:38:50.797 INFO:teuthology.orchestra.run.smithi005.stdout: "f4db3406-20ff-46a3-baf9-099e16392f76": { 2024-08-31T05:38:50.797 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:38:49.034412+0000", 2024-08-31T05:38:50.797 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:38:50.797 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:38:50.797 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:38:50.798 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:38:50.798 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:38:50.798 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:38:50.798 INFO:teuthology.orchestra.run.smithi005.stdout: "297c26f3-7b4d-4245-abb0-f854248e5e1b": { 2024-08-31T05:38:50.798 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:37:14.019244+0000", 2024-08-31T05:38:50.798 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:38:50.799 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:38:50.799 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:38:50.799 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:38:50.799 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:38:50.799 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:38:50.799 INFO:teuthology.orchestra.run.smithi005.stdout: "de9731c7-ae4a-42fe-8146-e4752cdc40d4": { 2024-08-31T05:38:50.800 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:34:53.614499+0000", 2024-08-31T05:38:50.800 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:38:50.800 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:38:50.800 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:38:50.800 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:38:50.801 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:38:50.801 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:38:50.801 INFO:teuthology.orchestra.run.smithi005.stdout: "0bb67292-013a-40c7-b5fc-810bdd9715d8": { 2024-08-31T05:38:50.802 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:34:04.586008+0000", 2024-08-31T05:38:50.802 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:38:50.802 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:38:50.802 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:38:50.802 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:38:50.802 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:38:50.803 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:38:50.803 INFO:teuthology.orchestra.run.smithi005.stdout: "728a42ca-bbef-4151-830f-5fdd411d8fa0": { 2024-08-31T05:38:50.803 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:32:30.554906+0000", 2024-08-31T05:38:50.803 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:38:50.803 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:38:50.803 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:38:50.803 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:38:50.803 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:38:50.803 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:38:50.803 INFO:teuthology.orchestra.run.smithi005.stdout: "2445fc42-b797-434f-b380-e2da985b4d98": { 2024-08-31T05:38:50.803 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:33:17.681453+0000", 2024-08-31T05:38:50.803 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:38:50.803 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:38:50.803 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:38:50.804 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:38:50.804 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:38:50.804 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:38:50.804 INFO:teuthology.orchestra.run.smithi005.stdout: "cda92ac0-b35f-47a5-a3a5-471c888462a5": { 2024-08-31T05:38:50.804 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:53.103905+0000", 2024-08-31T05:38:50.804 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:38:50.804 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:38:50.804 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:38:50.804 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:38:50.804 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:38:50.804 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:38:50.804 INFO:teuthology.orchestra.run.smithi005.stdout: "ece37b07-9ab2-45f8-bc33-2755a07aac0b": { 2024-08-31T05:38:50.804 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:31:41.782407+0000", 2024-08-31T05:38:50.805 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:38:50.805 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:38:50.805 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:38:50.805 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:38:50.805 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:38:50.805 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:38:50.805 INFO:teuthology.orchestra.run.smithi005.stdout: "75d84398-5d9c-4872-b879-2fbce045fa71": { 2024-08-31T05:38:50.805 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:06.642335+0000", 2024-08-31T05:38:50.805 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:38:50.805 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:38:50.805 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:38:50.805 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:38:50.805 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:38:50.806 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:38:50.806 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:38:50.806 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:38:50.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.761+0000 7f84a58a1640 1 -- 172.21.15.5:0/1583517651 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f848c0b4ca0 msgr2=0x7f848c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:50.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.761+0000 7f84a58a1640 1 --2- 172.21.15.5:0/1583517651 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f848c0b4ca0 0x7f848c0b71b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8498014470 tx=0x7f84980046c0 comp rx=0 tx=0).stop 2024-08-31T05:38:50.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.761+0000 7f84a58a1640 1 -- 172.21.15.5:0/1583517651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84a0104750 msgr2=0x7f84a01a14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:50.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.761+0000 7f84a58a1640 1 --2- 172.21.15.5:0/1583517651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84a0104750 0x7f84a01a14d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f849000ea80 tx=0x7f849000ef40 comp rx=0 tx=0).stop 2024-08-31T05:38:50.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.761+0000 7f84a58a1640 1 -- 172.21.15.5:0/1583517651 shutdown_connections 2024-08-31T05:38:50.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.761+0000 7f84a58a1640 1 --2- 172.21.15.5:0/1583517651 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f848c0b4ca0 0x7f848c0b71b0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:50.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.761+0000 7f84a58a1640 1 --2- 172.21.15.5:0/1583517651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84a010dbb0 0x7f84a01ac550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:50.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.761+0000 7f84a58a1640 1 --2- 172.21.15.5:0/1583517651 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f84a01050a0 0x7f84a01a1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:50.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.761+0000 7f84a58a1640 1 --2- 172.21.15.5:0/1583517651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f84a0104750 0x7f84a01a14d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:50.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.761+0000 7f84a58a1640 1 -- 172.21.15.5:0/1583517651 >> 172.21.15.5:0/1583517651 conn(0x7f84a00794d0 msgr2=0x7f84a0100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:50.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.761+0000 7f84a58a1640 1 -- 172.21.15.5:0/1583517651 shutdown_connections 2024-08-31T05:38:50.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:38:50.761+0000 7f84a58a1640 1 -- 172.21.15.5:0/1583517651 wait complete. 2024-08-31T05:38:50.931 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1001320 11.24 MB/sec execute 338 sec latency 58.334 ms 2024-08-31T05:38:51.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:38:50 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:38:51.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:38:50 smithi050 ceph-mon[22146]: pgmap v615: 129 pgs: 129 active+clean; 532 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 5.9 MiB/s wr, 253 op/s 2024-08-31T05:38:51.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:38:50 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:38:51.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:38:50 smithi005 ceph-mon[18602]: pgmap v615: 129 pgs: 129 active+clean; 532 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 5.9 MiB/s wr, 253 op/s 2024-08-31T05:38:51.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:38:50 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:38:51.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:38:50 smithi070 ceph-mon[22316]: pgmap v615: 129 pgs: 129 active+clean; 532 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 5.9 MiB/s wr, 253 op/s 2024-08-31T05:38:51.577 INFO:tasks.cephfs.filesystem:scrub status for tag:f4db3406-20ff-46a3-baf9-099e16392f76 - {'path': '/', 'tag': 'f4db3406-20ff-46a3-baf9-099e16392f76', 'options': 'recursive,force'} 2024-08-31T05:38:51.931 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1003274 11.24 MB/sec execute 339 sec latency 28.682 ms 2024-08-31T05:38:52.931 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1005622 11.24 MB/sec execute 340 sec latency 28.315 ms 2024-08-31T05:38:53.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:38:52 smithi050 ceph-mon[22146]: pgmap v616: 129 pgs: 129 active+clean; 535 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.6 MiB/s wr, 218 op/s 2024-08-31T05:38:53.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:38:52 smithi005 ceph-mon[18602]: pgmap v616: 129 pgs: 129 active+clean; 535 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.6 MiB/s wr, 218 op/s 2024-08-31T05:38:53.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:38:52 smithi070 ceph-mon[22316]: pgmap v616: 129 pgs: 129 active+clean; 535 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.6 MiB/s wr, 218 op/s 2024-08-31T05:38:53.931 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1006944 11.23 MB/sec execute 341 sec latency 76.828 ms 2024-08-31T05:38:54.472 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.470+0000 7f49db2f2640 1 -- 172.21.15.5:0/3365347672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49d41080a0 msgr2=0x7f49d41084b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:54.472 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.470+0000 7f49db2f2640 1 --2- 172.21.15.5:0/3365347672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49d41080a0 0x7f49d41084b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f49d0009900 tx=0x7f49d002a420 comp rx=0 tx=0).stop 2024-08-31T05:38:54.476 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.473+0000 7f49db2f2640 1 -- 172.21.15.5:0/3365347672 shutdown_connections 2024-08-31T05:38:54.476 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.473+0000 7f49db2f2640 1 --2- 172.21.15.5:0/3365347672 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49d41089f0 0x7f49d410f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:54.476 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.473+0000 7f49db2f2640 1 --2- 172.21.15.5:0/3365347672 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49d41080a0 0x7f49d41084b0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:54.476 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.473+0000 7f49db2f2640 1 --2- 172.21.15.5:0/3365347672 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49d4102770 0x7f49d4102b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:54.476 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.474+0000 7f49db2f2640 1 -- 172.21.15.5:0/3365347672 >> 172.21.15.5:0/3365347672 conn(0x7f49d407a4b0 msgr2=0x7f49d407a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:54.478 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.476+0000 7f49db2f2640 1 -- 172.21.15.5:0/3365347672 shutdown_connections 2024-08-31T05:38:54.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.476+0000 7f49db2f2640 1 -- 172.21.15.5:0/3365347672 wait complete. 2024-08-31T05:38:54.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.477+0000 7f49db2f2640 1 Processor -- start 2024-08-31T05:38:54.479 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.477+0000 7f49db2f2640 1 -- start start 2024-08-31T05:38:54.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.477+0000 7f49db2f2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49d4102770 0x7f49d419ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:54.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.477+0000 7f49db2f2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49d41080a0 0x7f49d4197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:54.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.477+0000 7f49db2f2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49d41089f0 0x7f49d41984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:54.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.477+0000 7f49db2f2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f49d4111670 con 0x7f49d41080a0 2024-08-31T05:38:54.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.477+0000 7f49db2f2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f49d41114f0 con 0x7f49d41089f0 2024-08-31T05:38:54.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.477+0000 7f49db2f2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f49d41117f0 con 0x7f49d4102770 2024-08-31T05:38:54.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.477+0000 7f49d988f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49d41089f0 0x7f49d41984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:54.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.478+0000 7f49d908e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49d4102770 0x7f49d419ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:54.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.478+0000 7f49d908e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49d4102770 0x7f49d419ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:42512/0 (socket says 172.21.15.5:42512) 2024-08-31T05:38:54.480 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.478+0000 7f49d988f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49d41089f0 0x7f49d41984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:55012/0 (socket says 172.21.15.5:55012) 2024-08-31T05:38:54.481 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.478+0000 7f49d908e640 1 -- 172.21.15.5:0/4198378695 learned_addr learned my addr 172.21.15.5:0/4198378695 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:54.481 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.478+0000 7f49d888d640 1 --2- 172.21.15.5:0/4198378695 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49d41080a0 0x7f49d4197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:54.482 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.478+0000 7f49d988f640 1 -- 172.21.15.5:0/4198378695 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49d4102770 msgr2=0x7f49d419ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:54.482 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.478+0000 7f49d988f640 1 --2- 172.21.15.5:0/4198378695 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49d4102770 0x7f49d419ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:54.482 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.478+0000 7f49d988f640 1 -- 172.21.15.5:0/4198378695 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49d41080a0 msgr2=0x7f49d4197ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:54.482 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.478+0000 7f49d988f640 1 --2- 172.21.15.5:0/4198378695 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49d41080a0 0x7f49d4197ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:54.482 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.478+0000 7f49d988f640 1 -- 172.21.15.5:0/4198378695 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49d4198d00 con 0x7f49d41089f0 2024-08-31T05:38:54.482 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.478+0000 7f49d908e640 1 --2- 172.21.15.5:0/4198378695 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49d4102770 0x7f49d419ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:38:54.482 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.479+0000 7f49d988f640 1 --2- 172.21.15.5:0/4198378695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49d41089f0 0x7f49d41984e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f49cc00be20 tx=0x7f49cc00bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:54.482 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.479+0000 7f49ca7fc640 1 -- 172.21.15.5:0/4198378695 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49cc019070 con 0x7f49d41089f0 2024-08-31T05:38:54.482 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.479+0000 7f49db2f2640 1 -- 172.21.15.5:0/4198378695 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49d419d9b0 con 0x7f49d41089f0 2024-08-31T05:38:54.482 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.479+0000 7f49ca7fc640 1 -- 172.21.15.5:0/4198378695 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49cc0148f0 con 0x7f49d41089f0 2024-08-31T05:38:54.483 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.479+0000 7f49ca7fc640 1 -- 172.21.15.5:0/4198378695 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49cc012840 con 0x7f49d41089f0 2024-08-31T05:38:54.483 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.479+0000 7f49db2f2640 1 -- 172.21.15.5:0/4198378695 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49d419df00 con 0x7f49d41089f0 2024-08-31T05:38:54.485 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.482+0000 7f49e2262740 1 Processor -- start 2024-08-31T05:38:54.485 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.482+0000 7f49ca7fc640 1 -- 172.21.15.5:0/4198378695 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f49cc01c070 con 0x7f49d41089f0 2024-08-31T05:38:54.485 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.482+0000 7f49e2262740 1 -- start start 2024-08-31T05:38:54.485 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.482+0000 7f49e2262740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3102c11b0 0x55d310664ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:54.485 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.482+0000 7f49e2262740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d3102982f0 0x55d310665220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:54.485 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.482+0000 7f49e2262740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d3102a04d0 0x55d310665760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:54.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.482+0000 7f49e2262740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55d3105da000 con 0x55d3102a04d0 2024-08-31T05:38:54.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.482+0000 7f49e2262740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d3105c9590 con 0x55d3102982f0 2024-08-31T05:38:54.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.482+0000 7f49e2262740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d3105cd540 con 0x55d3102c11b0 2024-08-31T05:38:54.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.482+0000 7f49d888d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3102c11b0 0x55d310664ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:54.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.482+0000 7f49d888d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3102c11b0 0x55d310664ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:42518/0 (socket says 172.21.15.5:42518) 2024-08-31T05:38:54.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.482+0000 7f49d888d640 1 -- 172.21.15.5:0/3454289336 learned_addr learned my addr 172.21.15.5:0/3454289336 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:54.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.483+0000 7f49d888d640 1 --2- 172.21.15.5:0/3454289336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d3102a04d0 0x55d310665760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:54.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.483+0000 7f49d908e640 1 --2- 172.21.15.5:0/3454289336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d3102982f0 0x55d310665220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:54.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.483+0000 7f49ca7fc640 1 --2- 172.21.15.5:0/4198378695 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f49c00b4c80 0x7f49c00b7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:54.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.483+0000 7f49d888d640 1 -- 172.21.15.5:0/3454289336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d3102982f0 msgr2=0x55d310665220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:54.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.483+0000 7f49d888d640 1 --2- 172.21.15.5:0/3454289336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d3102982f0 0x55d310665220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:54.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.483+0000 7f49d888d640 1 -- 172.21.15.5:0/3454289336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d3102a04d0 msgr2=0x55d310665760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:54.486 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.483+0000 7f49d888d640 1 --2- 172.21.15.5:0/3454289336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d3102a04d0 0x55d310665760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:54.487 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.483+0000 7f49d888d640 1 -- 172.21.15.5:0/3454289336 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d31032c790 con 0x55d3102c11b0 2024-08-31T05:38:54.487 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.483+0000 7f49d988f640 1 --2- 172.21.15.5:0/4198378695 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f49c00b4c80 0x7f49c00b7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:54.487 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.483+0000 7f49d888d640 1 --2- 172.21.15.5:0/3454289336 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3102c11b0 0x55d310664ce0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f49d0009900 tx=0x7f49d0000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=569503b747feae7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:54.487 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.483+0000 7f49ca7fc640 1 -- 172.21.15.5:0/4198378695 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7f49cc0e50c0 con 0x7f49d41089f0 2024-08-31T05:38:54.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.484+0000 7f49bf7fe640 1 -- 172.21.15.5:0/3454289336 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d0041270 con 0x55d3102c11b0 2024-08-31T05:38:54.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.484+0000 7f49bf7fe640 1 -- 172.21.15.5:0/3454289336 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49d0041b50 con 0x55d3102c11b0 2024-08-31T05:38:54.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.484+0000 7f49bf7fe640 1 -- 172.21.15.5:0/3454289336 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d003fa80 con 0x55d3102c11b0 2024-08-31T05:38:54.491 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.484+0000 7f49e2262740 1 -- 172.21.15.5:0/3454289336 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3102c11b0 msgr2=0x55d310664ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:54.491 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.484+0000 7f49d988f640 1 --2- 172.21.15.5:0/4198378695 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f49c00b4c80 0x7f49c00b7190 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f49cc0ab180 tx=0x7f49cc0a6c90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:54.491 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.484+0000 7f49e2262740 1 --2- 172.21.15.5:0/3454289336 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3102c11b0 0x55d310664ce0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f49d0009900 tx=0x7f49d0000bc0 comp rx=0 tx=0).stop 2024-08-31T05:38:54.491 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.484+0000 7f49e2262740 1 -- 172.21.15.5:0/3454289336 shutdown_connections 2024-08-31T05:38:54.491 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.484+0000 7f49e2262740 1 --2- 172.21.15.5:0/3454289336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d3102a04d0 0x55d310665760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:54.491 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.484+0000 7f49e2262740 1 --2- 172.21.15.5:0/3454289336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d3102982f0 0x55d310665220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:54.491 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.485+0000 7f49e2262740 1 --2- 172.21.15.5:0/3454289336 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3102c11b0 0x55d310664ce0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:54.491 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.485+0000 7f49e2262740 1 -- 172.21.15.5:0/3454289336 >> 172.21.15.5:0/3454289336 conn(0x55d3102b5300 msgr2=0x55d310662bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:54.491 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.485+0000 7f49e2262740 1 -- 172.21.15.5:0/3454289336 shutdown_connections 2024-08-31T05:38:54.491 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.485+0000 7f49e2262740 1 -- 172.21.15.5:0/3454289336 wait complete. 2024-08-31T05:38:54.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.485+0000 7f49e2262740 1 -- start start 2024-08-31T05:38:54.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.485+0000 7f49e2262740 1 Processor -- start 2024-08-31T05:38:54.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.485+0000 7f49e2262740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3102982f0 0x55d3106708b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:54.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.485+0000 7f49e2262740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d3102a04d0 0x55d310670df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:54.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.485+0000 7f49e2262740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d3102c11b0 0x55d31067c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:54.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.486+0000 7f49e2262740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55d310502ab0 con 0x55d3102a04d0 2024-08-31T05:38:54.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.486+0000 7f49e2262740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d310550680 con 0x55d3102c11b0 2024-08-31T05:38:54.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.486+0000 7f49e2262740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d310673400 con 0x55d3102982f0 2024-08-31T05:38:54.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.486+0000 7f49e2262740 10 client.0 _ll_register_callbacks cb 0x55d3102d8a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:38:54.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.486+0000 7f49d908e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d3102a04d0 0x55d310670df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:54.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.486+0000 7f49d888d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3102982f0 0x55d3106708b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:54.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.486+0000 7f49d908e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d3102a04d0 0x55d310670df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43242/0 (socket says 172.21.15.5:43242) 2024-08-31T05:38:54.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.486+0000 7f49d908e640 1 -- 172.21.15.5:0/3566382157 learned_addr learned my addr 172.21.15.5:0/3566382157 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:54.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.486+0000 7f49d888d640 1 --2- 172.21.15.5:0/3566382157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d3102c11b0 0x55d31067c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:54.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.486+0000 7f49d908e640 1 -- 172.21.15.5:0/3566382157 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3102982f0 msgr2=0x55d3106708b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:54.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.486+0000 7f49d908e640 1 --2- 172.21.15.5:0/3566382157 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3102982f0 0x55d3106708b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:54.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.486+0000 7f49d908e640 1 -- 172.21.15.5:0/3566382157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d3102c11b0 msgr2=0x55d31067c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:54.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.486+0000 7f49d908e640 1 --2- 172.21.15.5:0/3566382157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d3102c11b0 0x55d31067c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:54.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.486+0000 7f49d908e640 1 -- 172.21.15.5:0/3566382157 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3103a5620 con 0x55d3102a04d0 2024-08-31T05:38:54.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.486+0000 7f49d908e640 1 --2- 172.21.15.5:0/3566382157 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d3102a04d0 0x55d310670df0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f49c40119e0 tx=0x7f49c4011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a910fb868fc5eec server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:54.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.486+0000 7f49bcff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:38:54.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.486+0000 7f49bcff9640 1 -- 172.21.15.5:0/3566382157 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c400fa40 con 0x55d3102a04d0 2024-08-31T05:38:54.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.486+0000 7f49bcff9640 1 -- 172.21.15.5:0/3566382157 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7f49c400fbe0 con 0x55d3102a04d0 2024-08-31T05:38:54.493 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.486+0000 7f49e2262740 1 -- 172.21.15.5:0/3566382157 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f49d0041b50 con 0x55d3102a04d0 2024-08-31T05:38:54.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.487+0000 7f49bcff9640 1 -- 172.21.15.5:0/3566382157 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f49c400fde0 con 0x55d3102a04d0 2024-08-31T05:38:54.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.487+0000 7f49e2262740 10 client.17988 fetch_fsmap learned FSMap version 34 2024-08-31T05:38:54.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.487+0000 7f49e2262740 1 -- 172.21.15.5:0/3566382157 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55d31067f500 con 0x55d3102a04d0 2024-08-31T05:38:54.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.487+0000 7f49bcff9640 1 -- 172.21.15.5:0/3566382157 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49d0041b50 con 0x55d3102a04d0 2024-08-31T05:38:54.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.487+0000 7f49bcff9640 1 -- 172.21.15.5:0/3566382157 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f49c401d520 con 0x55d3102a04d0 2024-08-31T05:38:54.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.487+0000 7f49e2262740 10 client.17988 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:38:54.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.487+0000 7f49e2262740 10 client.17988 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:38:54.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.487+0000 7f49e2262740 20 client.17988 populate_metadata read hostname 'smithi005' 2024-08-31T05:38:54.494 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.487+0000 7f49e2262740 1 --2- 172.21.15.5:0/3566382157 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d31027fd80 0x55d310682b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.487+0000 7f49e2262740 4 client.17988 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:38:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.487+0000 7f49e2262740 1 -- 172.21.15.5:0/3566382157 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d3105dbf50 con 0x55d31027fd80 2024-08-31T05:38:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.487+0000 7f49d888d640 1 --2- 172.21.15.5:0/3566382157 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d31027fd80 0x55d310682b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.488+0000 7f49d888d640 1 --2- 172.21.15.5:0/3566382157 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d31027fd80 0x55d310682b10 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14ec0d8957299d5c server_cookie=b32fb5aa35c387c7 in_seq=0 out_seq=0 2024-08-31T05:38:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.488+0000 7f49bcff9640 10 client.17988 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:38:54.497 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.489+0000 7f49bcff9640 1 -- 172.21.15.5:0/3566382157 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d3105dbf50 con 0x55d31027fd80 2024-08-31T05:38:54.497 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.489+0000 7f49bcff9640 10 client.17988 handle_command_reply: tid=0 2024-08-31T05:38:54.497 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.489+0000 7f49e2262740 1 client.17988 shutdown 2024-08-31T05:38:54.497 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.489+0000 7f49e2262740 1 -- 172.21.15.5:0/3566382157 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d3102a04d0 msgr2=0x55d310670df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:54.497 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.489+0000 7f49e2262740 1 --2- 172.21.15.5:0/3566382157 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d3102a04d0 0x55d310670df0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f49c40119e0 tx=0x7f49c4011ea0 comp rx=0 tx=0).stop 2024-08-31T05:38:54.497 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.489+0000 7f49e2262740 1 -- 172.21.15.5:0/3566382157 shutdown_connections 2024-08-31T05:38:54.497 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.489+0000 7f49e2262740 1 --2- 172.21.15.5:0/3566382157 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d31027fd80 0x55d310682b10 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:54.497 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.489+0000 7f49e2262740 1 --2- 172.21.15.5:0/3566382157 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d3102c11b0 0x55d31067c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:54.497 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.489+0000 7f49bcff9640 0 client.17988 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:38:54.498 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.489+0000 7f49e2262740 1 --2- 172.21.15.5:0/3566382157 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d3102a04d0 0x55d310670df0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:54.498 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.489+0000 7f49e2262740 1 --2- 172.21.15.5:0/3566382157 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3102982f0 0x55d3106708b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:54.498 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.489+0000 7f49e2262740 1 -- 172.21.15.5:0/3566382157 >> 172.21.15.5:0/3566382157 conn(0x55d3102b5300 msgr2=0x55d310665d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:54.498 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.489+0000 7f49e2262740 1 -- 172.21.15.5:0/3566382157 shutdown_connections 2024-08-31T05:38:54.498 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.489+0000 7f49e2262740 1 -- 172.21.15.5:0/3566382157 wait complete. 2024-08-31T05:38:54.498 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.489+0000 7f49e2262740 20 client.17988 trim_cache size 0 max 16384 2024-08-31T05:38:54.508 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.504+0000 7f49e2262740 1 Processor -- start 2024-08-31T05:38:54.509 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.504+0000 7f49e2262740 1 -- start start 2024-08-31T05:38:54.509 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.504+0000 7f49e2262740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d31027fd80 0x55d31067c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:54.509 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.505+0000 7f49e2262740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d3102982f0 0x55d310669da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:54.509 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.505+0000 7f49e2262740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3102a04d0 0x55d31066a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:54.509 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.505+0000 7f49e2262740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f49d41bfb80 con 0x55d31027fd80 2024-08-31T05:38:54.509 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.505+0000 7f49e2262740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f49d41c16c0 con 0x55d3102982f0 2024-08-31T05:38:54.509 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.505+0000 7f49e2262740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f49d41c0250 con 0x55d3102a04d0 2024-08-31T05:38:54.509 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.505+0000 7f49d888d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d31027fd80 0x55d31067c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:54.509 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.505+0000 7f49d888d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d31027fd80 0x55d31067c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43244/0 (socket says 172.21.15.5:43244) 2024-08-31T05:38:54.509 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.505+0000 7f49d888d640 1 -- 172.21.15.5:0/3170808458 learned_addr learned my addr 172.21.15.5:0/3170808458 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:54.510 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.505+0000 7f49d908e640 1 --2- 172.21.15.5:0/3170808458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d3102982f0 0x55d310669da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:54.510 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.505+0000 7f49d888d640 1 --2- 172.21.15.5:0/3170808458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3102a04d0 0x55d31066a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:54.510 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.505+0000 7f49d888d640 1 -- 172.21.15.5:0/3170808458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3102a04d0 msgr2=0x55d31066a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:54.510 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.505+0000 7f49d888d640 1 --2- 172.21.15.5:0/3170808458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3102a04d0 0x55d31066a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:54.510 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.505+0000 7f49d888d640 1 -- 172.21.15.5:0/3170808458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d3102982f0 msgr2=0x55d310669da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:54.510 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.505+0000 7f49d888d640 1 --2- 172.21.15.5:0/3170808458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d3102982f0 0x55d310669da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:54.510 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.505+0000 7f49d888d640 1 -- 172.21.15.5:0/3170808458 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d310667af0 con 0x55d31027fd80 2024-08-31T05:38:54.510 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.505+0000 7f49d908e640 1 --2- 172.21.15.5:0/3170808458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d3102982f0 0x55d310669da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:38:54.510 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.505+0000 7f49d888d640 1 --2- 172.21.15.5:0/3170808458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d31027fd80 0x55d31067c650 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f49d003f710 tx=0x7f49d003f6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54783a0f70781439 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:54.510 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.505+0000 7f49beffd640 1 -- 172.21.15.5:0/3170808458 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d00410b0 con 0x55d31027fd80 2024-08-31T05:38:54.510 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.505+0000 7f49beffd640 1 -- 172.21.15.5:0/3170808458 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49d0041b50 con 0x55d31027fd80 2024-08-31T05:38:54.510 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.505+0000 7f49beffd640 1 -- 172.21.15.5:0/3170808458 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d003fe00 con 0x55d31027fd80 2024-08-31T05:38:54.510 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.506+0000 7f49e2262740 1 -- 172.21.15.5:0/3170808458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d31027fd80 msgr2=0x55d31067c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:54.510 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.506+0000 7f49e2262740 1 --2- 172.21.15.5:0/3170808458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d31027fd80 0x55d31067c650 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f49d003f710 tx=0x7f49d003f6a0 comp rx=0 tx=0).stop 2024-08-31T05:38:54.511 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.506+0000 7f49e2262740 1 -- 172.21.15.5:0/3170808458 shutdown_connections 2024-08-31T05:38:54.511 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.506+0000 7f49e2262740 1 --2- 172.21.15.5:0/3170808458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3102a04d0 0x55d31066a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:54.511 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.506+0000 7f49e2262740 1 --2- 172.21.15.5:0/3170808458 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d3102982f0 0x55d310669da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:54.511 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.506+0000 7f49e2262740 1 --2- 172.21.15.5:0/3170808458 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d31027fd80 0x55d31067c650 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:54.511 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.506+0000 7f49e2262740 1 -- 172.21.15.5:0/3170808458 >> 172.21.15.5:0/3170808458 conn(0x55d3102b5300 msgr2=0x55d31066ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:54.511 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.506+0000 7f49e2262740 1 -- 172.21.15.5:0/3170808458 shutdown_connections 2024-08-31T05:38:54.511 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.506+0000 7f49e2262740 1 -- 172.21.15.5:0/3170808458 wait complete. 2024-08-31T05:38:54.511 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.506+0000 7f49e2262740 1 -- start start 2024-08-31T05:38:54.511 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.507+0000 7f49e2262740 1 Processor -- start 2024-08-31T05:38:54.514 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.507+0000 7f49e2262740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d31027fd80 0x55d310674690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:54.514 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.507+0000 7f49e2262740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d3102982f0 0x55d310674bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:54.515 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.507+0000 7f49e2262740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d3102a04d0 0x55d310675110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:54.515 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.507+0000 7f49e2262740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f49d41c0ff0 con 0x55d3102982f0 2024-08-31T05:38:54.515 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.507+0000 7f49e2262740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f49d41c0920 con 0x55d3102a04d0 2024-08-31T05:38:54.515 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.507+0000 7f49e2262740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f49d41bdb80 con 0x55d31027fd80 2024-08-31T05:38:54.515 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.507+0000 7f49e2262740 10 client.0 _ll_register_callbacks cb 0x7f49c4009a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:38:54.515 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.507+0000 7f49d908e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d3102982f0 0x55d310674bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:54.515 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.507+0000 7f49d908e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d3102982f0 0x55d310674bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43246/0 (socket says 172.21.15.5:43246) 2024-08-31T05:38:54.515 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.507+0000 7f49d908e640 1 -- 172.21.15.5:0/4181906530 learned_addr learned my addr 172.21.15.5:0/4181906530 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:38:54.515 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.507+0000 7f49d888d640 1 --2- 172.21.15.5:0/4181906530 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d31027fd80 0x55d310674690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:54.515 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.507+0000 7f49d888d640 1 --2- 172.21.15.5:0/4181906530 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d3102a04d0 0x55d310675110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:54.515 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.507+0000 7f49d908e640 1 -- 172.21.15.5:0/4181906530 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d31027fd80 msgr2=0x55d310674690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:54.515 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.507+0000 7f49d908e640 1 --2- 172.21.15.5:0/4181906530 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d31027fd80 0x55d310674690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:54.515 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.507+0000 7f49d908e640 1 -- 172.21.15.5:0/4181906530 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d3102a04d0 msgr2=0x55d310675110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:38:54.516 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.507+0000 7f49d908e640 1 --2- 172.21.15.5:0/4181906530 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d3102a04d0 0x55d310675110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:54.516 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.507+0000 7f49d908e640 1 -- 172.21.15.5:0/4181906530 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d31065c980 con 0x55d3102982f0 2024-08-31T05:38:54.516 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.508+0000 7f49d908e640 1 --2- 172.21.15.5:0/4181906530 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d3102982f0 0x55d310674bd0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f49c4004810 tx=0x7f49c401deb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=999542ad464677bc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:38:54.516 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.508+0000 7f49bcff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:38:54.516 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.508+0000 7f49bcff9640 1 -- 172.21.15.5:0/4181906530 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c4031060 con 0x55d3102982f0 2024-08-31T05:38:54.516 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.508+0000 7f49e2262740 1 -- 172.21.15.5:0/4181906530 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f49d0041b50 con 0x55d3102982f0 2024-08-31T05:38:54.516 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.508+0000 7f49bcff9640 1 -- 172.21.15.5:0/4181906530 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7f49c402c470 con 0x55d3102982f0 2024-08-31T05:38:54.516 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.508+0000 7f49bcff9640 1 -- 172.21.15.5:0/4181906530 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f49c4038050 con 0x55d3102982f0 2024-08-31T05:38:54.516 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.508+0000 7f49e2262740 10 client.17994 fetch_fsmap learned FSMap version 34 2024-08-31T05:38:54.516 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.508+0000 7f49e2262740 1 -- 172.21.15.5:0/4181906530 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55d3106ed580 con 0x55d3102982f0 2024-08-31T05:38:54.516 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.508+0000 7f49bcff9640 1 -- 172.21.15.5:0/4181906530 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49d0041b50 con 0x55d3102982f0 2024-08-31T05:38:54.517 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.508+0000 7f49bcff9640 1 -- 172.21.15.5:0/4181906530 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f49c40147e0 con 0x55d3102982f0 2024-08-31T05:38:54.517 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.509+0000 7f49e2262740 10 client.17994 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:38:54.517 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.509+0000 7f49e2262740 10 client.17994 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:38:54.517 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.509+0000 7f49e2262740 20 client.17994 populate_metadata read hostname 'smithi005' 2024-08-31T05:38:54.517 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.509+0000 7f49e2262740 1 --2- 172.21.15.5:0/4181906530 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d3102c11b0 0x55d3106efd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:38:54.517 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.509+0000 7f49e2262740 4 client.17994 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:38:54.517 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.509+0000 7f49e2262740 1 -- 172.21.15.5:0/4181906530 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d3105d79f0 con 0x55d3102c11b0 2024-08-31T05:38:54.517 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.509+0000 7f49d888d640 1 --2- 172.21.15.5:0/4181906530 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d3102c11b0 0x55d3106efd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:38:54.517 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.510+0000 7f49d888d640 1 --2- 172.21.15.5:0/4181906530 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d3102c11b0 0x55d3106efd10 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38481761a8cea55c server_cookie=88a4a757c13c7d7f in_seq=0 out_seq=0 2024-08-31T05:38:54.517 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.510+0000 7f49bcff9640 10 client.17994 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:38:54.524 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.521+0000 7f49bcff9640 1 -- 172.21.15.5:0/4181906530 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d3105d79f0 con 0x55d3102c11b0 2024-08-31T05:38:54.524 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.521+0000 7f49bcff9640 10 client.17994 handle_command_reply: tid=0 2024-08-31T05:38:54.524 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.521+0000 7f49e2262740 1 client.17994 shutdown 2024-08-31T05:38:54.524 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.521+0000 7f49e2262740 1 -- 172.21.15.5:0/4181906530 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d3102982f0 msgr2=0x55d310674bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:54.524 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.521+0000 7f49e2262740 1 --2- 172.21.15.5:0/4181906530 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d3102982f0 0x55d310674bd0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f49c4004810 tx=0x7f49c401deb0 comp rx=0 tx=0).stop 2024-08-31T05:38:54.524 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.521+0000 7f49e2262740 1 -- 172.21.15.5:0/4181906530 shutdown_connections 2024-08-31T05:38:54.525 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.521+0000 7f49e2262740 1 --2- 172.21.15.5:0/4181906530 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d3102c11b0 0x55d3106efd10 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:54.525 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.521+0000 7f49bcff9640 0 client.17994 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:38:54.525 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.521+0000 7f49e2262740 1 --2- 172.21.15.5:0/4181906530 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d3102a04d0 0x55d310675110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:54.525 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.521+0000 7f49e2262740 1 --2- 172.21.15.5:0/4181906530 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d3102982f0 0x55d310674bd0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:54.525 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.521+0000 7f49e2262740 1 --2- 172.21.15.5:0/4181906530 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d31027fd80 0x55d310674690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:54.525 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.521+0000 7f49e2262740 1 -- 172.21.15.5:0/4181906530 >> 172.21.15.5:0/4181906530 conn(0x55d3102b5300 msgr2=0x55d31066fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:54.525 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.522+0000 7f49e2262740 1 -- 172.21.15.5:0/4181906530 shutdown_connections 2024-08-31T05:38:54.525 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.522+0000 7f49e2262740 1 -- 172.21.15.5:0/4181906530 wait complete. 2024-08-31T05:38:54.525 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.522+0000 7f49e2262740 20 client.17994 trim_cache size 0 max 16384 2024-08-31T05:38:54.525 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:38:54.526 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:38:54.526 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:38:54.526 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:38:54.527 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.522+0000 7f49db2f2640 1 -- 172.21.15.5:0/4198378695 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f49c00b4c80 msgr2=0x7f49c00b7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:54.527 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.522+0000 7f49db2f2640 1 --2- 172.21.15.5:0/4198378695 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f49c00b4c80 0x7f49c00b7190 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f49cc0ab180 tx=0x7f49cc0a6c90 comp rx=0 tx=0).stop 2024-08-31T05:38:54.527 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.522+0000 7f49db2f2640 1 -- 172.21.15.5:0/4198378695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49d41089f0 msgr2=0x7f49d41984e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:38:54.528 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.522+0000 7f49db2f2640 1 --2- 172.21.15.5:0/4198378695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49d41089f0 0x7f49d41984e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f49cc00be20 tx=0x7f49cc00bf10 comp rx=0 tx=0).stop 2024-08-31T05:38:54.528 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.522+0000 7f49db2f2640 1 -- 172.21.15.5:0/4198378695 shutdown_connections 2024-08-31T05:38:54.528 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.522+0000 7f49db2f2640 1 --2- 172.21.15.5:0/4198378695 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f49c00b4c80 0x7f49c00b7190 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:54.528 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.523+0000 7f49db2f2640 1 --2- 172.21.15.5:0/4198378695 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f49d41089f0 0x7f49d41984e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:54.528 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.523+0000 7f49db2f2640 1 --2- 172.21.15.5:0/4198378695 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49d41080a0 0x7f49d4197ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:54.528 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.523+0000 7f49db2f2640 1 --2- 172.21.15.5:0/4198378695 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49d4102770 0x7f49d419ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:38:54.528 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.523+0000 7f49db2f2640 1 -- 172.21.15.5:0/4198378695 >> 172.21.15.5:0/4198378695 conn(0x7f49d407a4b0 msgr2=0x7f49d4104fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:38:54.528 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.523+0000 7f49db2f2640 1 -- 172.21.15.5:0/4198378695 shutdown_connections 2024-08-31T05:38:54.528 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:38:54.523+0000 7f49db2f2640 1 -- 172.21.15.5:0/4198378695 wait complete. 2024-08-31T05:38:54.931 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1009178 11.23 MB/sec execute 342 sec latency 55.075 ms 2024-08-31T05:38:55.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:38:54 smithi005 ceph-mon[18602]: pgmap v617: 129 pgs: 129 active+clean; 535 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.2 MiB/s wr, 206 op/s 2024-08-31T05:38:55.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:38:54 smithi070 ceph-mon[22316]: pgmap v617: 129 pgs: 129 active+clean; 535 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.2 MiB/s wr, 206 op/s 2024-08-31T05:38:55.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:38:54 smithi050 ceph-mon[22146]: pgmap v617: 129 pgs: 129 active+clean; 535 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.2 MiB/s wr, 206 op/s 2024-08-31T05:38:55.931 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1010652 11.22 MB/sec execute 343 sec latency 18.182 ms 2024-08-31T05:38:56.931 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1013062 11.23 MB/sec execute 344 sec latency 17.960 ms 2024-08-31T05:38:57.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:38:56 smithi005 ceph-mon[18602]: pgmap v618: 129 pgs: 129 active+clean; 538 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.9 MiB/s wr, 253 op/s 2024-08-31T05:38:57.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:38:56 smithi070 ceph-mon[22316]: pgmap v618: 129 pgs: 129 active+clean; 538 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.9 MiB/s wr, 253 op/s 2024-08-31T05:38:57.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:38:56 smithi050 ceph-mon[22146]: pgmap v618: 129 pgs: 129 active+clean; 538 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.9 MiB/s wr, 253 op/s 2024-08-31T05:38:57.931 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1014983 11.21 MB/sec execute 345 sec latency 22.078 ms 2024-08-31T05:38:58.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:38:57 smithi005 ceph-mon[18602]: scrub summary: idle 2024-08-31T05:38:58.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:38:57 smithi070 ceph-mon[22316]: scrub summary: idle 2024-08-31T05:38:58.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:38:57 smithi050 ceph-mon[22146]: scrub summary: idle 2024-08-31T05:38:58.931 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1016957 11.22 MB/sec execute 346 sec latency 17.415 ms 2024-08-31T05:38:59.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:38:58 smithi005 ceph-mon[18602]: scrub summary: idle 2024-08-31T05:38:59.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:38:58 smithi005 ceph-mon[18602]: pgmap v619: 129 pgs: 129 active+clean; 545 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.4 MiB/s wr, 208 op/s 2024-08-31T05:38:59.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:38:58 smithi070 ceph-mon[22316]: scrub summary: idle 2024-08-31T05:38:59.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:38:58 smithi070 ceph-mon[22316]: pgmap v619: 129 pgs: 129 active+clean; 545 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.4 MiB/s wr, 208 op/s 2024-08-31T05:38:59.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:38:58 smithi050 ceph-mon[22146]: scrub summary: idle 2024-08-31T05:38:59.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:38:58 smithi050 ceph-mon[22146]: pgmap v619: 129 pgs: 129 active+clean; 545 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.4 MiB/s wr, 208 op/s 2024-08-31T05:38:59.931 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1019045 11.22 MB/sec execute 347 sec latency 63.344 ms 2024-08-31T05:39:00.931 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1020605 11.21 MB/sec execute 348 sec latency 25.118 ms 2024-08-31T05:39:01.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:39:00 smithi005 ceph-mon[18602]: pgmap v620: 129 pgs: 129 active+clean; 550 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.5 MiB/s wr, 258 op/s 2024-08-31T05:39:01.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:39:00 smithi070 ceph-mon[22316]: pgmap v620: 129 pgs: 129 active+clean; 550 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.5 MiB/s wr, 258 op/s 2024-08-31T05:39:01.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:39:00 smithi050 ceph-mon[22146]: pgmap v620: 129 pgs: 129 active+clean; 550 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.5 MiB/s wr, 258 op/s 2024-08-31T05:39:01.932 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1021247 11.19 MB/sec execute 349 sec latency 86.823 ms 2024-08-31T05:39:02.932 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1023606 11.20 MB/sec execute 350 sec latency 15.028 ms 2024-08-31T05:39:03.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:39:02 smithi005 ceph-mon[18602]: pgmap v621: 129 pgs: 129 active+clean; 550 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.4 MiB/s wr, 194 op/s 2024-08-31T05:39:03.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:39:02 smithi070 ceph-mon[22316]: pgmap v621: 129 pgs: 129 active+clean; 550 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.4 MiB/s wr, 194 op/s 2024-08-31T05:39:03.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:39:02 smithi050 ceph-mon[22146]: pgmap v621: 129 pgs: 129 active+clean; 550 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.4 MiB/s wr, 194 op/s 2024-08-31T05:39:03.932 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1025617 11.19 MB/sec execute 351 sec latency 15.570 ms 2024-08-31T05:39:04.932 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1027387 11.19 MB/sec execute 352 sec latency 51.418 ms 2024-08-31T05:39:05.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:39:04 smithi005 ceph-mon[18602]: pgmap v622: 129 pgs: 129 active+clean; 553 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.5 MiB/s wr, 213 op/s 2024-08-31T05:39:05.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:39:04 smithi070 ceph-mon[22316]: pgmap v622: 129 pgs: 129 active+clean; 553 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.5 MiB/s wr, 213 op/s 2024-08-31T05:39:05.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:39:04 smithi050 ceph-mon[22146]: pgmap v622: 129 pgs: 129 active+clean; 553 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.5 MiB/s wr, 213 op/s 2024-08-31T05:39:05.932 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1029185 11.18 MB/sec execute 353 sec latency 29.434 ms 2024-08-31T05:39:06.932 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1031269 11.18 MB/sec execute 354 sec latency 15.405 ms 2024-08-31T05:39:07.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:39:06 smithi005 ceph-mon[18602]: pgmap v623: 129 pgs: 129 active+clean; 557 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.6 MiB/s wr, 275 op/s 2024-08-31T05:39:07.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:39:06 smithi070 ceph-mon[22316]: pgmap v623: 129 pgs: 129 active+clean; 557 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.6 MiB/s wr, 275 op/s 2024-08-31T05:39:07.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:39:06 smithi050 ceph-mon[22146]: pgmap v623: 129 pgs: 129 active+clean; 557 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.6 MiB/s wr, 275 op/s 2024-08-31T05:39:07.630 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.625+0000 7fc7666de640 1 -- 172.21.15.5:0/2394768264 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc760108090 msgr2=0x7fc7601084a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:07.631 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.625+0000 7fc7666de640 1 --2- 172.21.15.5:0/2394768264 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc760108090 0x7fc7601084a0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fc754009900 tx=0x7fc75402a410 comp rx=0 tx=0).stop 2024-08-31T05:39:07.631 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.625+0000 7fc7666de640 1 -- 172.21.15.5:0/2394768264 shutdown_connections 2024-08-31T05:39:07.631 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.625+0000 7fc7666de640 1 --2- 172.21.15.5:0/2394768264 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7601089e0 0x7fc76010f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:07.631 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.625+0000 7fc7666de640 1 --2- 172.21.15.5:0/2394768264 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc760108090 0x7fc7601084a0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:07.631 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.625+0000 7fc7666de640 1 --2- 172.21.15.5:0/2394768264 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc760102760 0x7fc760102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:07.631 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.625+0000 7fc7666de640 1 -- 172.21.15.5:0/2394768264 >> 172.21.15.5:0/2394768264 conn(0x7fc7600fe160 msgr2=0x7fc7601005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:07.631 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.625+0000 7fc7666de640 1 -- 172.21.15.5:0/2394768264 shutdown_connections 2024-08-31T05:39:07.631 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.625+0000 7fc7666de640 1 -- 172.21.15.5:0/2394768264 wait complete. 2024-08-31T05:39:07.631 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.626+0000 7fc7666de640 1 Processor -- start 2024-08-31T05:39:07.631 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.626+0000 7fc7666de640 1 -- start start 2024-08-31T05:39:07.632 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.626+0000 7fc7666de640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc760102760 0x7fc76019a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:07.632 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.626+0000 7fc7666de640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc760108090 0x7fc76019a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:07.632 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.626+0000 7fc7666de640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7601089e0 0x7fc76019fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:07.632 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.626+0000 7fc7666de640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc7601137c0 con 0x7fc760108090 2024-08-31T05:39:07.632 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.626+0000 7fc7666de640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc760113640 con 0x7fc7601089e0 2024-08-31T05:39:07.632 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.626+0000 7fc7666de640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc760113940 con 0x7fc760102760 2024-08-31T05:39:07.632 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.626+0000 7fc75f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc760108090 0x7fc76019a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:07.632 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.626+0000 7fc75f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc760108090 0x7fc76019a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37352/0 (socket says 172.21.15.5:37352) 2024-08-31T05:39:07.633 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.626+0000 7fc75ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc760102760 0x7fc76019a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:07.633 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.626+0000 7fc75f7fe640 1 -- 172.21.15.5:0/3082378686 learned_addr learned my addr 172.21.15.5:0/3082378686 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:07.633 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.627+0000 7fc764c7b640 1 --2- 172.21.15.5:0/3082378686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7601089e0 0x7fc76019fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:07.633 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.627+0000 7fc75f7fe640 1 -- 172.21.15.5:0/3082378686 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc760102760 msgr2=0x7fc76019a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:07.633 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.627+0000 7fc75f7fe640 1 --2- 172.21.15.5:0/3082378686 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc760102760 0x7fc76019a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:07.633 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.627+0000 7fc75f7fe640 1 -- 172.21.15.5:0/3082378686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7601089e0 msgr2=0x7fc76019fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:07.633 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.627+0000 7fc75f7fe640 1 --2- 172.21.15.5:0/3082378686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7601089e0 0x7fc76019fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:07.633 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.627+0000 7fc75f7fe640 1 -- 172.21.15.5:0/3082378686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7601a0150 con 0x7fc760108090 2024-08-31T05:39:07.633 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.627+0000 7fc75f7fe640 1 --2- 172.21.15.5:0/3082378686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc760108090 0x7fc76019a7c0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fc75402a930 tx=0x7fc754031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:07.633 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.627+0000 7fc75d7fa640 1 -- 172.21.15.5:0/3082378686 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc75403f030 con 0x7fc760108090 2024-08-31T05:39:07.634 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.627+0000 7fc75d7fa640 1 -- 172.21.15.5:0/3082378686 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc754004490 con 0x7fc760108090 2024-08-31T05:39:07.634 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.627+0000 7fc7666de640 1 -- 172.21.15.5:0/3082378686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7601a03e0 con 0x7fc760108090 2024-08-31T05:39:07.634 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.627+0000 7fc75d7fa640 1 -- 172.21.15.5:0/3082378686 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc754035070 con 0x7fc760108090 2024-08-31T05:39:07.634 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.627+0000 7fc7666de640 1 -- 172.21.15.5:0/3082378686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7601a6bd0 con 0x7fc760108090 2024-08-31T05:39:07.642 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.630+0000 7fc76d653740 1 Processor -- start 2024-08-31T05:39:07.643 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.630+0000 7fc76d653740 1 -- start start 2024-08-31T05:39:07.643 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.630+0000 7fc76d653740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561c4e44c1b0 0x561c4e7efce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:07.643 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.630+0000 7fc76d653740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c4e4232f0 0x561c4e7f0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:07.643 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.630+0000 7fc76d653740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c4e42b4d0 0x561c4e7f0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:07.643 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.630+0000 7fc76d653740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x561c4e765000 con 0x561c4e42b4d0 2024-08-31T05:39:07.643 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.630+0000 7fc76d653740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x561c4e754590 con 0x561c4e44c1b0 2024-08-31T05:39:07.643 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.630+0000 7fc76d653740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561c4e758540 con 0x561c4e4232f0 2024-08-31T05:39:07.643 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.630+0000 7fc764c7b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561c4e44c1b0 0x561c4e7efce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:07.643 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.630+0000 7fc764c7b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561c4e44c1b0 0x561c4e7efce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:33542/0 (socket says 172.21.15.5:33542) 2024-08-31T05:39:07.644 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.630+0000 7fc764c7b640 1 -- 172.21.15.5:0/1677841519 learned_addr learned my addr 172.21.15.5:0/1677841519 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:07.644 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.630+0000 7fc75ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c4e4232f0 0x561c4e7f0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:07.644 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.630+0000 7fc75d7fa640 1 -- 172.21.15.5:0/3082378686 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fc754042030 con 0x7fc760108090 2024-08-31T05:39:07.644 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.631+0000 7fc764c7b640 1 -- 172.21.15.5:0/1677841519 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c4e4232f0 msgr2=0x561c4e7f0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:07.644 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.631+0000 7fc764c7b640 1 --2- 172.21.15.5:0/1677841519 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c4e4232f0 0x561c4e7f0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:07.644 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.631+0000 7fc764c7b640 1 -- 172.21.15.5:0/1677841519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c4e42b4d0 msgr2=0x561c4e7f0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:07.644 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.631+0000 7fc764c7b640 1 --2- 172.21.15.5:0/1677841519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c4e42b4d0 0x561c4e7f0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:07.644 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.631+0000 7fc764c7b640 1 -- 172.21.15.5:0/1677841519 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c4e4b7790 con 0x561c4e44c1b0 2024-08-31T05:39:07.644 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.631+0000 7fc764c7b640 1 --2- 172.21.15.5:0/1677841519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561c4e44c1b0 0x561c4e7efce0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc758010400 tx=0x7fc7580108c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d00996550acffe5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:07.645 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.631+0000 7fc7467fc640 1 -- 172.21.15.5:0/1677841519 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc758003b70 con 0x561c4e44c1b0 2024-08-31T05:39:07.645 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.631+0000 7fc7467fc640 1 -- 172.21.15.5:0/1677841519 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc758003d10 con 0x561c4e44c1b0 2024-08-31T05:39:07.645 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.631+0000 7fc7467fc640 1 -- 172.21.15.5:0/1677841519 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7580119e0 con 0x561c4e44c1b0 2024-08-31T05:39:07.645 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.631+0000 7fc75d7fa640 1 --2- 172.21.15.5:0/3082378686 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc7480b4ca0 0x7fc7480b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:07.645 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.631+0000 7fc75ffff640 1 --2- 172.21.15.5:0/3082378686 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc7480b4ca0 0x7fc7480b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:07.645 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.631+0000 7fc75d7fa640 1 -- 172.21.15.5:0/3082378686 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7fc754105d10 con 0x7fc760108090 2024-08-31T05:39:07.645 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.632+0000 7fc75ffff640 1 --2- 172.21.15.5:0/3082378686 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc7480b4ca0 0x7fc7480b71b0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x561c4e7ee960 tx=0x7fc750005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:07.645 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.632+0000 7fc76d653740 1 -- 172.21.15.5:0/1677841519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561c4e44c1b0 msgr2=0x561c4e7efce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:07.645 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.632+0000 7fc76d653740 1 --2- 172.21.15.5:0/1677841519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561c4e44c1b0 0x561c4e7efce0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc758010400 tx=0x7fc7580108c0 comp rx=0 tx=0).stop 2024-08-31T05:39:07.645 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.632+0000 7fc76d653740 1 -- 172.21.15.5:0/1677841519 shutdown_connections 2024-08-31T05:39:07.646 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.632+0000 7fc76d653740 1 --2- 172.21.15.5:0/1677841519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c4e42b4d0 0x561c4e7f0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:07.646 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.632+0000 7fc76d653740 1 --2- 172.21.15.5:0/1677841519 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c4e4232f0 0x561c4e7f0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:07.646 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.632+0000 7fc76d653740 1 --2- 172.21.15.5:0/1677841519 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561c4e44c1b0 0x561c4e7efce0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:07.646 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.632+0000 7fc76d653740 1 -- 172.21.15.5:0/1677841519 >> 172.21.15.5:0/1677841519 conn(0x561c4e440300 msgr2=0x561c4e7edbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:07.646 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.632+0000 7fc76d653740 1 -- 172.21.15.5:0/1677841519 shutdown_connections 2024-08-31T05:39:07.646 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.632+0000 7fc76d653740 1 -- 172.21.15.5:0/1677841519 wait complete. 2024-08-31T05:39:07.646 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.632+0000 7fc76d653740 1 -- start start 2024-08-31T05:39:07.646 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.633+0000 7fc76d653740 1 Processor -- start 2024-08-31T05:39:07.646 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.633+0000 7fc76d653740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561c4e4232f0 0x561c4e7fb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:07.646 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.633+0000 7fc76d653740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c4e42b4d0 0x561c4e7fbf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:07.646 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.633+0000 7fc76d653740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c4e44c1b0 0x561c4e801780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:07.647 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.633+0000 7fc76d653740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x561c4e68dab0 con 0x561c4e44c1b0 2024-08-31T05:39:07.647 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.633+0000 7fc76d653740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x561c4e6db680 con 0x561c4e4232f0 2024-08-31T05:39:07.647 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.633+0000 7fc76d653740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561c4e7fe460 con 0x561c4e42b4d0 2024-08-31T05:39:07.647 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.633+0000 7fc76d653740 10 client.0 _ll_register_callbacks cb 0x561c4e463a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:39:07.647 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.633+0000 7fc764c7b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c4e44c1b0 0x561c4e801780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:07.647 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.633+0000 7fc764c7b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c4e44c1b0 0x561c4e801780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37356/0 (socket says 172.21.15.5:37356) 2024-08-31T05:39:07.647 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.633+0000 7fc764c7b640 1 -- 172.21.15.5:0/2672630214 learned_addr learned my addr 172.21.15.5:0/2672630214 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:07.647 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.633+0000 7fc75f7fe640 1 --2- 172.21.15.5:0/2672630214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c4e42b4d0 0x561c4e7fbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:07.647 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.633+0000 7fc75ffff640 1 --2- 172.21.15.5:0/2672630214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561c4e4232f0 0x561c4e7fb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:07.647 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.633+0000 7fc764c7b640 1 -- 172.21.15.5:0/2672630214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c4e42b4d0 msgr2=0x561c4e7fbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:07.648 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.633+0000 7fc764c7b640 1 --2- 172.21.15.5:0/2672630214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c4e42b4d0 0x561c4e7fbf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:07.648 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.634+0000 7fc764c7b640 1 -- 172.21.15.5:0/2672630214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561c4e4232f0 msgr2=0x561c4e7fb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:07.648 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.634+0000 7fc764c7b640 1 --2- 172.21.15.5:0/2672630214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561c4e4232f0 0x561c4e7fb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:07.648 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.634+0000 7fc764c7b640 1 -- 172.21.15.5:0/2672630214 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c4e530620 con 0x561c4e44c1b0 2024-08-31T05:39:07.648 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.634+0000 7fc764c7b640 1 --2- 172.21.15.5:0/2672630214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c4e44c1b0 0x561c4e801780 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fc758009dd0 tx=0x7fc758004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20044fd6761a39ff server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:07.648 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.634+0000 7fc73f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:39:07.648 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.634+0000 7fc73f7fe640 1 -- 172.21.15.5:0/2672630214 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc758004df0 con 0x561c4e44c1b0 2024-08-31T05:39:07.648 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.634+0000 7fc73f7fe640 1 -- 172.21.15.5:0/2672630214 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7fc7580116e0 con 0x561c4e44c1b0 2024-08-31T05:39:07.648 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.634+0000 7fc76d653740 1 -- 172.21.15.5:0/2672630214 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc758003d10 con 0x561c4e44c1b0 2024-08-31T05:39:07.648 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.634+0000 7fc73f7fe640 1 -- 172.21.15.5:0/2672630214 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc7580118e0 con 0x561c4e44c1b0 2024-08-31T05:39:07.649 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.634+0000 7fc76d653740 10 client.18003 fetch_fsmap learned FSMap version 34 2024-08-31T05:39:07.649 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.634+0000 7fc76d653740 1 -- 172.21.15.5:0/2672630214 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x561c4e80a620 con 0x561c4e44c1b0 2024-08-31T05:39:07.649 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.634+0000 7fc73f7fe640 1 -- 172.21.15.5:0/2672630214 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc758003d10 con 0x561c4e44c1b0 2024-08-31T05:39:07.649 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.635+0000 7fc73f7fe640 1 -- 172.21.15.5:0/2672630214 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fc758005040 con 0x561c4e44c1b0 2024-08-31T05:39:07.649 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.635+0000 7fc76d653740 10 client.18003 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:39:07.649 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.635+0000 7fc76d653740 10 client.18003 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:39:07.649 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.635+0000 7fc76d653740 20 client.18003 populate_metadata read hostname 'smithi005' 2024-08-31T05:39:07.649 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.635+0000 7fc76d653740 1 --2- 172.21.15.5:0/2672630214 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561c4e40ad80 0x561c4e80d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:07.649 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.635+0000 7fc76d653740 4 client.18003 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:39:07.650 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.635+0000 7fc76d653740 1 -- 172.21.15.5:0/2672630214 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561c4e766f50 con 0x561c4e40ad80 2024-08-31T05:39:07.650 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.635+0000 7fc75ffff640 1 --2- 172.21.15.5:0/2672630214 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561c4e40ad80 0x561c4e80d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:07.650 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.635+0000 7fc73f7fe640 10 client.18003 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:39:07.650 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.635+0000 7fc75ffff640 1 --2- 172.21.15.5:0/2672630214 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561c4e40ad80 0x561c4e80d9e0 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be7a9967cbf56de server_cookie=5d4f9191307eeedf in_seq=0 out_seq=0 2024-08-31T05:39:07.650 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.636+0000 7fc73f7fe640 1 -- 172.21.15.5:0/2672630214 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561c4e766f50 con 0x561c4e40ad80 2024-08-31T05:39:07.650 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.636+0000 7fc73f7fe640 10 client.18003 handle_command_reply: tid=0 2024-08-31T05:39:07.650 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.636+0000 7fc76d653740 1 client.18003 shutdown 2024-08-31T05:39:07.650 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.636+0000 7fc76d653740 1 -- 172.21.15.5:0/2672630214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c4e44c1b0 msgr2=0x561c4e801780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:07.650 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.636+0000 7fc76d653740 1 --2- 172.21.15.5:0/2672630214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c4e44c1b0 0x561c4e801780 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fc758009dd0 tx=0x7fc758004a40 comp rx=0 tx=0).stop 2024-08-31T05:39:07.651 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.636+0000 7fc76d653740 1 -- 172.21.15.5:0/2672630214 shutdown_connections 2024-08-31T05:39:07.651 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.636+0000 7fc76d653740 1 --2- 172.21.15.5:0/2672630214 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561c4e40ad80 0x561c4e80d9e0 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:07.651 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.636+0000 7fc76d653740 1 --2- 172.21.15.5:0/2672630214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c4e44c1b0 0x561c4e801780 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:07.651 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.636+0000 7fc76d653740 1 --2- 172.21.15.5:0/2672630214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c4e42b4d0 0x561c4e7fbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:07.651 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.636+0000 7fc73f7fe640 0 client.18003 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:39:07.651 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.636+0000 7fc76d653740 1 --2- 172.21.15.5:0/2672630214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561c4e4232f0 0x561c4e7fb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:07.651 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.636+0000 7fc76d653740 1 -- 172.21.15.5:0/2672630214 >> 172.21.15.5:0/2672630214 conn(0x561c4e440300 msgr2=0x561c4e7f0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:07.651 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.637+0000 7fc76d653740 1 -- 172.21.15.5:0/2672630214 shutdown_connections 2024-08-31T05:39:07.651 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.637+0000 7fc76d653740 1 -- 172.21.15.5:0/2672630214 wait complete. 2024-08-31T05:39:07.652 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.637+0000 7fc76d653740 20 client.18003 trim_cache size 0 max 16384 2024-08-31T05:39:07.660 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.652+0000 7fc76d653740 1 Processor -- start 2024-08-31T05:39:07.660 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.652+0000 7fc76d653740 1 -- start start 2024-08-31T05:39:07.660 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.652+0000 7fc76d653740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c4e4232f0 0x561c4e7f4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:07.660 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.652+0000 7fc76d653740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c4e42b4d0 0x561c4e808580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:07.661 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.652+0000 7fc76d653740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561c4e44c1b0 0x561c4e7f5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:07.661 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.652+0000 7fc76d653740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc7601b0d40 con 0x561c4e4232f0 2024-08-31T05:39:07.661 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.652+0000 7fc76d653740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc7601b2880 con 0x561c4e44c1b0 2024-08-31T05:39:07.661 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.652+0000 7fc76d653740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc7601b1410 con 0x561c4e42b4d0 2024-08-31T05:39:07.661 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.652+0000 7fc75ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c4e4232f0 0x561c4e7f4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:07.661 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.653+0000 7fc75ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c4e4232f0 0x561c4e7f4e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37362/0 (socket says 172.21.15.5:37362) 2024-08-31T05:39:07.661 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.653+0000 7fc75f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c4e42b4d0 0x561c4e808580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:07.661 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.653+0000 7fc764c7b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561c4e44c1b0 0x561c4e7f5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:07.661 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.653+0000 7fc75ffff640 1 -- 172.21.15.5:0/597716237 learned_addr learned my addr 172.21.15.5:0/597716237 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:07.662 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.653+0000 7fc75ffff640 1 -- 172.21.15.5:0/597716237 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c4e42b4d0 msgr2=0x561c4e808580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:07.662 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.653+0000 7fc75ffff640 1 --2- 172.21.15.5:0/597716237 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c4e42b4d0 0x561c4e808580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:07.662 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.653+0000 7fc75ffff640 1 -- 172.21.15.5:0/597716237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561c4e44c1b0 msgr2=0x561c4e7f5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:07.662 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.653+0000 7fc75ffff640 1 --2- 172.21.15.5:0/597716237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561c4e44c1b0 0x561c4e7f5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:07.662 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.653+0000 7fc75ffff640 1 -- 172.21.15.5:0/597716237 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c4e7fc2f0 con 0x561c4e4232f0 2024-08-31T05:39:07.662 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.653+0000 7fc764c7b640 1 --2- 172.21.15.5:0/597716237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561c4e44c1b0 0x561c4e7f5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:39:07.662 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.653+0000 7fc75ffff640 1 --2- 172.21.15.5:0/597716237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c4e4232f0 0x561c4e7f4e10 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fc750009b80 tx=0x7fc75001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaf88621987ca6bf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:07.662 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.653+0000 7fc745ffb640 1 -- 172.21.15.5:0/597716237 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7500039c0 con 0x561c4e4232f0 2024-08-31T05:39:07.662 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.653+0000 7fc745ffb640 1 -- 172.21.15.5:0/597716237 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7500054d0 con 0x561c4e4232f0 2024-08-31T05:39:07.662 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.653+0000 7fc745ffb640 1 -- 172.21.15.5:0/597716237 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc750004b70 con 0x561c4e4232f0 2024-08-31T05:39:07.662 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.654+0000 7fc76d653740 1 -- 172.21.15.5:0/597716237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c4e4232f0 msgr2=0x561c4e7f4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:07.662 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.654+0000 7fc76d653740 1 --2- 172.21.15.5:0/597716237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c4e4232f0 0x561c4e7f4e10 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fc750009b80 tx=0x7fc75001b000 comp rx=0 tx=0).stop 2024-08-31T05:39:07.663 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.654+0000 7fc76d653740 1 -- 172.21.15.5:0/597716237 shutdown_connections 2024-08-31T05:39:07.663 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.654+0000 7fc76d653740 1 --2- 172.21.15.5:0/597716237 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561c4e44c1b0 0x561c4e7f5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:07.663 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.654+0000 7fc76d653740 1 --2- 172.21.15.5:0/597716237 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c4e42b4d0 0x561c4e808580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:07.663 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.654+0000 7fc76d653740 1 --2- 172.21.15.5:0/597716237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c4e4232f0 0x561c4e7f4e10 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:07.663 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.654+0000 7fc76d653740 1 -- 172.21.15.5:0/597716237 >> 172.21.15.5:0/597716237 conn(0x561c4e440300 msgr2=0x561c4e7f6920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:07.663 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.654+0000 7fc76d653740 1 -- 172.21.15.5:0/597716237 shutdown_connections 2024-08-31T05:39:07.663 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.654+0000 7fc76d653740 1 -- 172.21.15.5:0/597716237 wait complete. 2024-08-31T05:39:07.663 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.654+0000 7fc76d653740 1 -- start start 2024-08-31T05:39:07.663 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.655+0000 7fc76d653740 1 Processor -- start 2024-08-31T05:39:07.663 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.655+0000 7fc76d653740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561c4e4232f0 0x561c4e803c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:07.663 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.655+0000 7fc76d653740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c4e42b4d0 0x561c4e8041b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:07.663 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.655+0000 7fc76d653740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c4e44c1b0 0x561c4e8046f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:07.663 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.655+0000 7fc76d653740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc7601b21b0 con 0x561c4e42b4d0 2024-08-31T05:39:07.664 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.655+0000 7fc76d653740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc7601b1ae0 con 0x561c4e4232f0 2024-08-31T05:39:07.664 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.655+0000 7fc76d653740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc7601aed40 con 0x561c4e44c1b0 2024-08-31T05:39:07.664 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.655+0000 7fc76d653740 10 client.0 _ll_register_callbacks cb 0x7fc750009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:39:07.664 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.655+0000 7fc75f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c4e42b4d0 0x561c4e8041b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:07.664 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.655+0000 7fc75f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c4e42b4d0 0x561c4e8041b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37374/0 (socket says 172.21.15.5:37374) 2024-08-31T05:39:07.664 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.655+0000 7fc75f7fe640 1 -- 172.21.15.5:0/2183386681 learned_addr learned my addr 172.21.15.5:0/2183386681 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:07.664 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.655+0000 7fc75ffff640 1 --2- 172.21.15.5:0/2183386681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561c4e4232f0 0x561c4e803c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:07.664 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.655+0000 7fc764c7b640 1 --2- 172.21.15.5:0/2183386681 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c4e44c1b0 0x561c4e8046f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:07.664 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.655+0000 7fc75f7fe640 1 -- 172.21.15.5:0/2183386681 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c4e44c1b0 msgr2=0x561c4e8046f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:07.664 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.655+0000 7fc75f7fe640 1 --2- 172.21.15.5:0/2183386681 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c4e44c1b0 0x561c4e8046f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:07.664 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.655+0000 7fc75f7fe640 1 -- 172.21.15.5:0/2183386681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561c4e4232f0 msgr2=0x561c4e803c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:07.664 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.655+0000 7fc75f7fe640 1 --2- 172.21.15.5:0/2183386681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561c4e4232f0 0x561c4e803c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:07.665 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.655+0000 7fc75f7fe640 1 -- 172.21.15.5:0/2183386681 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c4e877220 con 0x561c4e42b4d0 2024-08-31T05:39:07.665 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.656+0000 7fc75f7fe640 1 --2- 172.21.15.5:0/2183386681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c4e42b4d0 0x561c4e8041b0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fc7540c9290 tx=0x7fc7540cbeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e66069e7ee37356 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:07.665 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.656+0000 7fc73f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:39:07.665 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.656+0000 7fc73f7fe640 1 -- 172.21.15.5:0/2183386681 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc754049040 con 0x561c4e42b4d0 2024-08-31T05:39:07.665 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.656+0000 7fc73f7fe640 1 -- 172.21.15.5:0/2183386681 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9511+0+0 (secure 0 0 0) 0x7fc7540b71d0 con 0x561c4e42b4d0 2024-08-31T05:39:07.665 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.656+0000 7fc76d653740 1 -- 172.21.15.5:0/2183386681 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7500054d0 con 0x561c4e42b4d0 2024-08-31T05:39:07.665 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.656+0000 7fc73f7fe640 1 -- 172.21.15.5:0/2183386681 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc7540b73d0 con 0x561c4e42b4d0 2024-08-31T05:39:07.665 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.656+0000 7fc76d653740 10 client.18009 fetch_fsmap learned FSMap version 34 2024-08-31T05:39:07.665 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.656+0000 7fc76d653740 1 -- 172.21.15.5:0/2183386681 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x561c4e878510 con 0x561c4e42b4d0 2024-08-31T05:39:07.665 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.656+0000 7fc73f7fe640 1 -- 172.21.15.5:0/2183386681 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7500054d0 con 0x561c4e42b4d0 2024-08-31T05:39:07.665 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.656+0000 7fc73f7fe640 1 -- 172.21.15.5:0/2183386681 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fc7540cc280 con 0x561c4e42b4d0 2024-08-31T05:39:07.665 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.656+0000 7fc76d653740 10 client.18009 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:39:07.665 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.656+0000 7fc76d653740 10 client.18009 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:39:07.665 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.656+0000 7fc76d653740 20 client.18009 populate_metadata read hostname 'smithi005' 2024-08-31T05:39:07.666 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.656+0000 7fc76d653740 1 --2- 172.21.15.5:0/2183386681 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561c4e3e01c0 0x561c4e87acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:07.666 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.656+0000 7fc76d653740 4 client.18009 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:39:07.666 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.656+0000 7fc76d653740 1 -- 172.21.15.5:0/2183386681 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561c4e7629f0 con 0x561c4e3e01c0 2024-08-31T05:39:07.666 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.657+0000 7fc75ffff640 1 --2- 172.21.15.5:0/2183386681 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561c4e3e01c0 0x561c4e87acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:07.666 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.657+0000 7fc75ffff640 1 --2- 172.21.15.5:0/2183386681 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561c4e3e01c0 0x561c4e87acd0 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abe8d2ca552d4b90 server_cookie=753392f6451e5f38 in_seq=0 out_seq=0 2024-08-31T05:39:07.666 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.657+0000 7fc73f7fe640 10 client.18009 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:39:07.672 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.669+0000 7fc73f7fe640 1 -- 172.21.15.5:0/2183386681 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561c4e7629f0 con 0x561c4e3e01c0 2024-08-31T05:39:07.672 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.669+0000 7fc73f7fe640 10 client.18009 handle_command_reply: tid=0 2024-08-31T05:39:07.672 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.669+0000 7fc76d653740 1 client.18009 shutdown 2024-08-31T05:39:07.672 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.669+0000 7fc76d653740 1 -- 172.21.15.5:0/2183386681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c4e42b4d0 msgr2=0x561c4e8041b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:07.672 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.670+0000 7fc76d653740 1 --2- 172.21.15.5:0/2183386681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c4e42b4d0 0x561c4e8041b0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fc7540c9290 tx=0x7fc7540cbeb0 comp rx=0 tx=0).stop 2024-08-31T05:39:07.673 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.670+0000 7fc76d653740 1 -- 172.21.15.5:0/2183386681 shutdown_connections 2024-08-31T05:39:07.673 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.670+0000 7fc76d653740 1 --2- 172.21.15.5:0/2183386681 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561c4e3e01c0 0x561c4e87acd0 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:07.673 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.670+0000 7fc76d653740 1 --2- 172.21.15.5:0/2183386681 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c4e44c1b0 0x561c4e8046f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:07.673 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.670+0000 7fc76d653740 1 --2- 172.21.15.5:0/2183386681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561c4e42b4d0 0x561c4e8041b0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:07.673 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.670+0000 7fc73f7fe640 0 client.18009 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:39:07.673 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.670+0000 7fc76d653740 1 --2- 172.21.15.5:0/2183386681 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561c4e4232f0 0x561c4e803c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:07.673 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.670+0000 7fc76d653740 1 -- 172.21.15.5:0/2183386681 >> 172.21.15.5:0/2183386681 conn(0x561c4e440300 msgr2=0x561c4e7f6920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:07.673 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.670+0000 7fc76d653740 1 -- 172.21.15.5:0/2183386681 shutdown_connections 2024-08-31T05:39:07.673 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.670+0000 7fc76d653740 1 -- 172.21.15.5:0/2183386681 wait complete. 2024-08-31T05:39:07.673 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.670+0000 7fc76d653740 20 client.18009 trim_cache size 0 max 16384 2024-08-31T05:39:07.673 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:39:07.674 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:39:07.674 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:39:07.674 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:39:07.674 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.670+0000 7fc7666de640 1 -- 172.21.15.5:0/3082378686 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc7480b4ca0 msgr2=0x7fc7480b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:07.675 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.670+0000 7fc7666de640 1 --2- 172.21.15.5:0/3082378686 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc7480b4ca0 0x7fc7480b71b0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x561c4e7ee960 tx=0x7fc750005f90 comp rx=0 tx=0).stop 2024-08-31T05:39:07.675 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.670+0000 7fc7666de640 1 -- 172.21.15.5:0/3082378686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc760108090 msgr2=0x7fc76019a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:07.675 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.670+0000 7fc7666de640 1 --2- 172.21.15.5:0/3082378686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc760108090 0x7fc76019a7c0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fc75402a930 tx=0x7fc754031a20 comp rx=0 tx=0).stop 2024-08-31T05:39:07.675 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.671+0000 7fc7666de640 1 -- 172.21.15.5:0/3082378686 shutdown_connections 2024-08-31T05:39:07.675 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.671+0000 7fc7666de640 1 --2- 172.21.15.5:0/3082378686 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc7480b4ca0 0x7fc7480b71b0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:07.675 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.671+0000 7fc7666de640 1 --2- 172.21.15.5:0/3082378686 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc7601089e0 0x7fc76019fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:07.675 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.671+0000 7fc7666de640 1 --2- 172.21.15.5:0/3082378686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc760108090 0x7fc76019a7c0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:07.675 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.671+0000 7fc7666de640 1 --2- 172.21.15.5:0/3082378686 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc760102760 0x7fc76019a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:07.675 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.671+0000 7fc7666de640 1 -- 172.21.15.5:0/3082378686 >> 172.21.15.5:0/3082378686 conn(0x7fc7600fe160 msgr2=0x7fc760107770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:07.675 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.671+0000 7fc7666de640 1 -- 172.21.15.5:0/3082378686 shutdown_connections 2024-08-31T05:39:07.675 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:07.671+0000 7fc7666de640 1 -- 172.21.15.5:0/3082378686 wait complete. 2024-08-31T05:39:07.932 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1033798 11.20 MB/sec execute 355 sec latency 27.662 ms 2024-08-31T05:39:08.932 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1035297 11.18 MB/sec execute 356 sec latency 22.635 ms 2024-08-31T05:39:09.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:39:08 smithi005 ceph-mon[18602]: pgmap v624: 129 pgs: 129 active+clean; 559 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.7 MiB/s wr, 235 op/s 2024-08-31T05:39:09.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:39:08 smithi005 ceph-mon[18602]: osdmap e92: 12 total, 12 up, 12 in 2024-08-31T05:39:09.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:39:08 smithi070 ceph-mon[22316]: pgmap v624: 129 pgs: 129 active+clean; 559 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.7 MiB/s wr, 235 op/s 2024-08-31T05:39:09.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:39:08 smithi070 ceph-mon[22316]: osdmap e92: 12 total, 12 up, 12 in 2024-08-31T05:39:09.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:39:08 smithi050 ceph-mon[22146]: pgmap v624: 129 pgs: 129 active+clean; 559 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.7 MiB/s wr, 235 op/s 2024-08-31T05:39:09.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:39:08 smithi050 ceph-mon[22146]: osdmap e92: 12 total, 12 up, 12 in 2024-08-31T05:39:09.932 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1037411 11.19 MB/sec execute 357 sec latency 69.874 ms 2024-08-31T05:39:10.932 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1038840 11.17 MB/sec execute 358 sec latency 38.377 ms 2024-08-31T05:39:11.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:39:10 smithi005 ceph-mon[18602]: pgmap v626: 129 pgs: 129 active+clean; 569 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.4 MiB/s wr, 260 op/s 2024-08-31T05:39:11.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:39:10 smithi070 ceph-mon[22316]: pgmap v626: 129 pgs: 129 active+clean; 569 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.4 MiB/s wr, 260 op/s 2024-08-31T05:39:11.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:39:10 smithi050 ceph-mon[22146]: pgmap v626: 129 pgs: 129 active+clean; 569 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.4 MiB/s wr, 260 op/s 2024-08-31T05:39:11.932 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1041206 11.18 MB/sec execute 359 sec latency 43.499 ms 2024-08-31T05:39:12.932 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1042790 11.17 MB/sec execute 360 sec latency 36.386 ms 2024-08-31T05:39:13.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:39:12 smithi005 ceph-mon[18602]: pgmap v627: 129 pgs: 129 active+clean; 564 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.3 MiB/s wr, 260 op/s 2024-08-31T05:39:13.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:39:12 smithi070 ceph-mon[22316]: pgmap v627: 129 pgs: 129 active+clean; 564 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.3 MiB/s wr, 260 op/s 2024-08-31T05:39:13.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:39:12 smithi050 ceph-mon[22146]: pgmap v627: 129 pgs: 129 active+clean; 564 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.3 MiB/s wr, 260 op/s 2024-08-31T05:39:13.932 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1045034 11.17 MB/sec execute 361 sec latency 13.225 ms 2024-08-31T05:39:14.932 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1046858 11.16 MB/sec execute 362 sec latency 23.178 ms 2024-08-31T05:39:15.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:39:14 smithi005 ceph-mon[18602]: pgmap v628: 129 pgs: 129 active+clean; 559 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.3 MiB/s wr, 244 op/s 2024-08-31T05:39:15.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:39:14 smithi005 ceph-mon[18602]: osdmap e93: 12 total, 12 up, 12 in 2024-08-31T05:39:15.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:39:14 smithi070 ceph-mon[22316]: pgmap v628: 129 pgs: 129 active+clean; 559 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.3 MiB/s wr, 244 op/s 2024-08-31T05:39:15.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:39:14 smithi070 ceph-mon[22316]: osdmap e93: 12 total, 12 up, 12 in 2024-08-31T05:39:15.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:39:14 smithi050 ceph-mon[22146]: pgmap v628: 129 pgs: 129 active+clean; 559 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.3 MiB/s wr, 244 op/s 2024-08-31T05:39:15.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:39:14 smithi050 ceph-mon[22146]: osdmap e93: 12 total, 12 up, 12 in 2024-08-31T05:39:15.932 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1048528 11.16 MB/sec execute 363 sec latency 60.261 ms 2024-08-31T05:39:16.932 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1050463 11.15 MB/sec execute 364 sec latency 18.544 ms 2024-08-31T05:39:17.208 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:39:16 smithi050 ceph-mon[22146]: pgmap v630: 129 pgs: 129 active+clean; 533 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.4 MiB/s wr, 250 op/s 2024-08-31T05:39:17.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:39:16 smithi005 ceph-mon[18602]: pgmap v630: 129 pgs: 129 active+clean; 533 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.4 MiB/s wr, 250 op/s 2024-08-31T05:39:17.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:39:16 smithi070 ceph-mon[22316]: pgmap v630: 129 pgs: 129 active+clean; 533 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.4 MiB/s wr, 250 op/s 2024-08-31T05:39:17.932 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1052477 11.16 MB/sec execute 365 sec latency 13.107 ms 2024-08-31T05:39:18.932 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1054845 11.16 MB/sec execute 366 sec latency 34.008 ms 2024-08-31T05:39:19.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:39:18 smithi005 ceph-mon[18602]: pgmap v631: 129 pgs: 129 active+clean; 538 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.9 MiB/s wr, 238 op/s 2024-08-31T05:39:19.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:39:18 smithi070 ceph-mon[22316]: pgmap v631: 129 pgs: 129 active+clean; 538 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.9 MiB/s wr, 238 op/s 2024-08-31T05:39:19.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:39:18 smithi050 ceph-mon[22146]: pgmap v631: 129 pgs: 129 active+clean; 538 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.9 MiB/s wr, 238 op/s 2024-08-31T05:39:19.932 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1056480 11.16 MB/sec execute 367 sec latency 29.232 ms 2024-08-31T05:39:20.779 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.777+0000 7f9facf39640 1 -- 172.21.15.5:0/2683547014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fa8102790 msgr2=0x7f9fa8102ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:20.779 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.777+0000 7f9facf39640 1 --2- 172.21.15.5:0/2683547014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fa8102790 0x7f9fa8102ba0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f9f98009900 tx=0x7f9f9802a410 comp rx=0 tx=0).stop 2024-08-31T05:39:20.779 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.777+0000 7f9facf39640 1 -- 172.21.15.5:0/2683547014 shutdown_connections 2024-08-31T05:39:20.779 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.777+0000 7f9facf39640 1 --2- 172.21.15.5:0/2683547014 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fa8108a10 0x7f9fa810f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.777+0000 7f9facf39640 1 --2- 172.21.15.5:0/2683547014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9fa81080c0 0x7f9fa81084d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.777+0000 7f9facf39640 1 --2- 172.21.15.5:0/2683547014 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fa8102790 0x7f9fa8102ba0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.777+0000 7f9facf39640 1 -- 172.21.15.5:0/2683547014 >> 172.21.15.5:0/2683547014 conn(0x7f9fa80fe190 msgr2=0x7f9fa81005e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.777+0000 7f9facf39640 1 -- 172.21.15.5:0/2683547014 shutdown_connections 2024-08-31T05:39:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.777+0000 7f9facf39640 1 -- 172.21.15.5:0/2683547014 wait complete. 2024-08-31T05:39:20.782 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.778+0000 7f9facf39640 1 Processor -- start 2024-08-31T05:39:20.782 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.778+0000 7f9facf39640 1 -- start start 2024-08-31T05:39:20.782 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.778+0000 7f9facf39640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9fa8102790 0x7f9fa819a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:20.782 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.778+0000 7f9facf39640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fa81080c0 0x7f9fa819a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:20.782 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.778+0000 7f9facf39640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fa8108a10 0x7f9fa819fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:20.783 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.778+0000 7f9facf39640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa81126e0 con 0x7f9fa81080c0 2024-08-31T05:39:20.783 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.778+0000 7f9facf39640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa8112560 con 0x7f9fa8108a10 2024-08-31T05:39:20.783 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.778+0000 7f9facf39640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa8112860 con 0x7f9fa8102790 2024-08-31T05:39:20.783 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.778+0000 7f9fa5d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fa81080c0 0x7f9fa819a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:20.783 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.778+0000 7f9fa5d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fa81080c0 0x7f9fa819a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42416/0 (socket says 172.21.15.5:42416) 2024-08-31T05:39:20.783 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.778+0000 7f9fa5d9b640 1 -- 172.21.15.5:0/1776679362 learned_addr learned my addr 172.21.15.5:0/1776679362 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:20.783 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.778+0000 7f9fa659c640 1 --2- 172.21.15.5:0/1776679362 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9fa8102790 0x7f9fa819a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:20.783 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.778+0000 7f9fa6d9d640 1 --2- 172.21.15.5:0/1776679362 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fa8108a10 0x7f9fa819fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:20.783 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.778+0000 7f9fa5d9b640 1 -- 172.21.15.5:0/1776679362 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9fa8102790 msgr2=0x7f9fa819a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:20.783 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.778+0000 7f9fa5d9b640 1 --2- 172.21.15.5:0/1776679362 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9fa8102790 0x7f9fa819a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:20.783 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.778+0000 7f9fa5d9b640 1 -- 172.21.15.5:0/1776679362 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fa8108a10 msgr2=0x7f9fa819fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:20.783 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.778+0000 7f9fa5d9b640 1 --2- 172.21.15.5:0/1776679362 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fa8108a10 0x7f9fa819fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:20.783 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.779+0000 7f9fa5d9b640 1 -- 172.21.15.5:0/1776679362 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa81a0140 con 0x7f9fa81080c0 2024-08-31T05:39:20.783 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.779+0000 7f9fa6d9d640 1 --2- 172.21.15.5:0/1776679362 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fa8108a10 0x7f9fa819fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:39:20.784 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.779+0000 7f9fa5d9b640 1 --2- 172.21.15.5:0/1776679362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fa81080c0 0x7f9fa819a7b0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c00e9c0 tx=0x7f9f9c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:20.784 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.779+0000 7f9f977fe640 1 -- 172.21.15.5:0/1776679362 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c00ccc0 con 0x7f9fa81080c0 2024-08-31T05:39:20.784 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.779+0000 7f9f977fe640 1 -- 172.21.15.5:0/1776679362 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f9c0054d0 con 0x7f9fa81080c0 2024-08-31T05:39:20.784 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.779+0000 7f9facf39640 1 -- 172.21.15.5:0/1776679362 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fa81a0430 con 0x7f9fa81080c0 2024-08-31T05:39:20.784 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.779+0000 7f9f977fe640 1 -- 172.21.15.5:0/1776679362 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c010430 con 0x7f9fa81080c0 2024-08-31T05:39:20.784 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.779+0000 7f9facf39640 1 -- 172.21.15.5:0/1776679362 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fa81a6bc0 con 0x7f9fa81080c0 2024-08-31T05:39:20.789 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.782+0000 7f9fb3eac740 1 Processor -- start 2024-08-31T05:39:20.789 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.782+0000 7f9fb3eac740 1 -- start start 2024-08-31T05:39:20.789 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.782+0000 7f9f977fe640 1 -- 172.21.15.5:0/1776679362 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f9f9c0105d0 con 0x7f9fa81080c0 2024-08-31T05:39:20.790 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.782+0000 7f9fb3eac740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5614eb5391b0 0x5614eb8dcce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:20.790 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.782+0000 7f9fb3eac740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5614eb5102f0 0x5614eb8dd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:20.790 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.782+0000 7f9fb3eac740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5614eb5184d0 0x5614eb8dd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:20.790 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.782+0000 7f9fb3eac740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5614eb852000 con 0x5614eb5184d0 2024-08-31T05:39:20.790 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.782+0000 7f9fb3eac740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5614eb841590 con 0x5614eb5102f0 2024-08-31T05:39:20.790 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.782+0000 7f9fb3eac740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5614eb845540 con 0x5614eb5391b0 2024-08-31T05:39:20.790 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.782+0000 7f9fa6d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5614eb5391b0 0x5614eb8dcce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:20.790 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.783+0000 7f9fa6d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5614eb5391b0 0x5614eb8dcce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:35940/0 (socket says 172.21.15.5:35940) 2024-08-31T05:39:20.790 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.783+0000 7f9fa6d9d640 1 -- 172.21.15.5:0/913601548 learned_addr learned my addr 172.21.15.5:0/913601548 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:20.791 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.783+0000 7f9fa5d9b640 1 --2- 172.21.15.5:0/913601548 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5614eb5184d0 0x5614eb8dd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:20.791 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.783+0000 7f9fa659c640 1 --2- 172.21.15.5:0/913601548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5614eb5102f0 0x5614eb8dd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:20.791 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.783+0000 7f9fa6d9d640 1 -- 172.21.15.5:0/913601548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5614eb5102f0 msgr2=0x5614eb8dd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:20.791 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.783+0000 7f9fa6d9d640 1 --2- 172.21.15.5:0/913601548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5614eb5102f0 0x5614eb8dd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:20.791 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.783+0000 7f9fa6d9d640 1 -- 172.21.15.5:0/913601548 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5614eb5184d0 msgr2=0x5614eb8dd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:20.791 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.783+0000 7f9fa6d9d640 1 --2- 172.21.15.5:0/913601548 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5614eb5184d0 0x5614eb8dd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:20.791 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.783+0000 7f9fa6d9d640 1 -- 172.21.15.5:0/913601548 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614eb5a4790 con 0x5614eb5391b0 2024-08-31T05:39:20.791 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.783+0000 7f9f977fe640 1 --2- 172.21.15.5:0/1776679362 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9f900b4d20 0x7f9f900b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:20.791 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.783+0000 7f9fa6d9d640 1 --2- 172.21.15.5:0/913601548 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5614eb5391b0 0x5614eb8dcce0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9fa000f440 tx=0x7f9fa000f900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56f3a527cff2955a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:20.791 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.783+0000 7f9fa659c640 1 --2- 172.21.15.5:0/1776679362 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9f900b4d20 0x7f9f900b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:20.791 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.783+0000 7f9f977fe640 1 -- 172.21.15.5:0/1776679362 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7f9f9c0e5ca0 con 0x7f9fa81080c0 2024-08-31T05:39:20.791 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.783+0000 7f9f94ff9640 1 -- 172.21.15.5:0/913601548 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa0015070 con 0x5614eb5391b0 2024-08-31T05:39:20.791 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.783+0000 7f9f94ff9640 1 -- 172.21.15.5:0/913601548 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9fa0011bb0 con 0x5614eb5391b0 2024-08-31T05:39:20.792 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.783+0000 7f9f94ff9640 1 -- 172.21.15.5:0/913601548 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa0010c20 con 0x5614eb5391b0 2024-08-31T05:39:20.792 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.784+0000 7f9fb3eac740 1 -- 172.21.15.5:0/913601548 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5614eb5391b0 msgr2=0x5614eb8dcce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:20.792 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.784+0000 7f9fa659c640 1 --2- 172.21.15.5:0/1776679362 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9f900b4d20 0x7f9f900b7230 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f9f98031440 tx=0x7f9f98009560 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:20.792 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.784+0000 7f9fb3eac740 1 --2- 172.21.15.5:0/913601548 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5614eb5391b0 0x5614eb8dcce0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9fa000f440 tx=0x7f9fa000f900 comp rx=0 tx=0).stop 2024-08-31T05:39:20.792 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.784+0000 7f9fb3eac740 1 -- 172.21.15.5:0/913601548 shutdown_connections 2024-08-31T05:39:20.792 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.784+0000 7f9fb3eac740 1 --2- 172.21.15.5:0/913601548 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5614eb5184d0 0x5614eb8dd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:20.792 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.784+0000 7f9fb3eac740 1 --2- 172.21.15.5:0/913601548 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5614eb5102f0 0x5614eb8dd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:20.792 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.784+0000 7f9fb3eac740 1 --2- 172.21.15.5:0/913601548 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5614eb5391b0 0x5614eb8dcce0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:20.792 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.784+0000 7f9fb3eac740 1 -- 172.21.15.5:0/913601548 >> 172.21.15.5:0/913601548 conn(0x5614eb52d300 msgr2=0x5614eb8dabd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:20.792 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.784+0000 7f9fb3eac740 1 -- 172.21.15.5:0/913601548 shutdown_connections 2024-08-31T05:39:20.792 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.784+0000 7f9fb3eac740 1 -- 172.21.15.5:0/913601548 wait complete. 2024-08-31T05:39:20.792 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.785+0000 7f9fb3eac740 1 -- start start 2024-08-31T05:39:20.792 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.785+0000 7f9fb3eac740 1 Processor -- start 2024-08-31T05:39:20.793 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.785+0000 7f9fb3eac740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5614eb5102f0 0x5614eb8e8890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:20.793 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.785+0000 7f9fb3eac740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5614eb5184d0 0x5614eb8e8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:20.793 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.785+0000 7f9fb3eac740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5614eb5391b0 0x5614eb8f47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:20.793 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.785+0000 7f9fb3eac740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5614eb77aab0 con 0x5614eb5184d0 2024-08-31T05:39:20.793 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.785+0000 7f9fb3eac740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5614eb7c8680 con 0x5614eb5102f0 2024-08-31T05:39:20.793 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.785+0000 7f9fb3eac740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5614eb8eb460 con 0x5614eb5391b0 2024-08-31T05:39:20.793 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.785+0000 7f9fb3eac740 10 client.0 _ll_register_callbacks cb 0x5614eb550a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:39:20.793 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.785+0000 7f9fa5d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5614eb5184d0 0x5614eb8e8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:20.793 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.785+0000 7f9fa5d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5614eb5184d0 0x5614eb8e8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42432/0 (socket says 172.21.15.5:42432) 2024-08-31T05:39:20.793 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.785+0000 7f9fa5d9b640 1 -- 172.21.15.5:0/1075436583 learned_addr learned my addr 172.21.15.5:0/1075436583 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:20.793 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.785+0000 7f9fa6d9d640 1 --2- 172.21.15.5:0/1075436583 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5614eb5391b0 0x5614eb8f47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:20.793 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.786+0000 7f9fa659c640 1 --2- 172.21.15.5:0/1075436583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5614eb5102f0 0x5614eb8e8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:20.793 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.786+0000 7f9fa5d9b640 1 -- 172.21.15.5:0/1075436583 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5614eb5391b0 msgr2=0x5614eb8f47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:20.794 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.786+0000 7f9fa5d9b640 1 --2- 172.21.15.5:0/1075436583 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5614eb5391b0 0x5614eb8f47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:20.794 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.786+0000 7f9fa5d9b640 1 -- 172.21.15.5:0/1075436583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5614eb5102f0 msgr2=0x5614eb8e8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:20.794 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.786+0000 7f9fa5d9b640 1 --2- 172.21.15.5:0/1075436583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5614eb5102f0 0x5614eb8e8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:20.794 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.786+0000 7f9fa5d9b640 1 -- 172.21.15.5:0/1075436583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614eb61d620 con 0x5614eb5184d0 2024-08-31T05:39:20.794 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.786+0000 7f9fa6d9d640 1 --2- 172.21.15.5:0/1075436583 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5614eb5391b0 0x5614eb8f47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:39:20.794 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.786+0000 7f9fa5d9b640 1 --2- 172.21.15.5:0/1075436583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5614eb5184d0 0x5614eb8e8dd0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c0e3070 tx=0x7f9f9c0a7f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b65583947735810 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:20.794 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.786+0000 7f9f8dffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:39:20.794 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.786+0000 7f9f8dffb640 1 -- 172.21.15.5:0/1075436583 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c00ce60 con 0x5614eb5184d0 2024-08-31T05:39:20.794 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.786+0000 7f9f8dffb640 1 -- 172.21.15.5:0/1075436583 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7f9f9c0b0430 con 0x5614eb5184d0 2024-08-31T05:39:20.794 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.786+0000 7f9fb3eac740 1 -- 172.21.15.5:0/1075436583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9fa0011bb0 con 0x5614eb5184d0 2024-08-31T05:39:20.794 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.786+0000 7f9f8dffb640 1 -- 172.21.15.5:0/1075436583 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f9f9c0d2070 con 0x5614eb5184d0 2024-08-31T05:39:20.794 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.786+0000 7f9fb3eac740 10 client.18021 fetch_fsmap learned FSMap version 34 2024-08-31T05:39:20.794 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.786+0000 7f9fb3eac740 1 -- 172.21.15.5:0/1075436583 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5614eb8f7530 con 0x5614eb5184d0 2024-08-31T05:39:20.795 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.786+0000 7f9f8dffb640 1 -- 172.21.15.5:0/1075436583 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9fa0011bb0 con 0x5614eb5184d0 2024-08-31T05:39:20.795 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.787+0000 7f9f8dffb640 1 -- 172.21.15.5:0/1075436583 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f9f9c0b4e40 con 0x5614eb5184d0 2024-08-31T05:39:20.795 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.787+0000 7f9fb3eac740 10 client.18021 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:39:20.795 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.787+0000 7f9fb3eac740 10 client.18021 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:39:20.795 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.787+0000 7f9fb3eac740 20 client.18021 populate_metadata read hostname 'smithi005' 2024-08-31T05:39:20.795 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.787+0000 7f9fb3eac740 1 --2- 172.21.15.5:0/1075436583 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5614eb4f7d80 0x5614eb8faac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:20.795 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.787+0000 7f9fb3eac740 4 client.18021 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:39:20.795 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.787+0000 7f9fb3eac740 1 -- 172.21.15.5:0/1075436583 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5614eb853f50 con 0x5614eb4f7d80 2024-08-31T05:39:20.795 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.787+0000 7f9fa659c640 1 --2- 172.21.15.5:0/1075436583 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5614eb4f7d80 0x5614eb8faac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:20.795 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.787+0000 7f9f8dffb640 10 client.18021 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:39:20.795 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.787+0000 7f9fa659c640 1 --2- 172.21.15.5:0/1075436583 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5614eb4f7d80 0x5614eb8faac0 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77c363549a50b704 server_cookie=804bd4c3e3ce5d8 in_seq=0 out_seq=0 2024-08-31T05:39:20.796 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.788+0000 7f9f8dffb640 1 -- 172.21.15.5:0/1075436583 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5614eb853f50 con 0x5614eb4f7d80 2024-08-31T05:39:20.796 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.788+0000 7f9f8dffb640 10 client.18021 handle_command_reply: tid=0 2024-08-31T05:39:20.796 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.788+0000 7f9fb3eac740 1 client.18021 shutdown 2024-08-31T05:39:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.788+0000 7f9fb3eac740 1 -- 172.21.15.5:0/1075436583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5614eb5184d0 msgr2=0x5614eb8e8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.788+0000 7f9fb3eac740 1 --2- 172.21.15.5:0/1075436583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5614eb5184d0 0x5614eb8e8dd0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c0e3070 tx=0x7f9f9c0a7f30 comp rx=0 tx=0).stop 2024-08-31T05:39:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.788+0000 7f9fb3eac740 1 -- 172.21.15.5:0/1075436583 shutdown_connections 2024-08-31T05:39:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.788+0000 7f9fb3eac740 1 --2- 172.21.15.5:0/1075436583 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5614eb4f7d80 0x5614eb8faac0 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.788+0000 7f9fb3eac740 1 --2- 172.21.15.5:0/1075436583 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5614eb5391b0 0x5614eb8f47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.788+0000 7f9fb3eac740 1 --2- 172.21.15.5:0/1075436583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5614eb5184d0 0x5614eb8e8dd0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.788+0000 7f9f8dffb640 0 client.18021 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:39:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.788+0000 7f9fb3eac740 1 --2- 172.21.15.5:0/1075436583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5614eb5102f0 0x5614eb8e8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.788+0000 7f9fb3eac740 1 -- 172.21.15.5:0/1075436583 >> 172.21.15.5:0/1075436583 conn(0x5614eb52d300 msgr2=0x5614eb8ddd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.788+0000 7f9fb3eac740 1 -- 172.21.15.5:0/1075436583 shutdown_connections 2024-08-31T05:39:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.788+0000 7f9fb3eac740 1 -- 172.21.15.5:0/1075436583 wait complete. 2024-08-31T05:39:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.788+0000 7f9fb3eac740 20 client.18021 trim_cache size 0 max 16384 2024-08-31T05:39:20.807 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.806+0000 7f9fb3eac740 1 Processor -- start 2024-08-31T05:39:20.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.806+0000 7f9fb3eac740 1 -- start start 2024-08-31T05:39:20.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.806+0000 7f9fb3eac740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5614eb5102f0 0x5614eb8e2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:20.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.806+0000 7f9fb3eac740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5614eb5184d0 0x5614eb8e7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:20.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.806+0000 7f9fb3eac740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5614eb5391b0 0x5614eb8e8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:20.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.806+0000 7f9fb3eac740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa81b0cc0 con 0x5614eb5102f0 2024-08-31T05:39:20.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.806+0000 7f9fb3eac740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa81b2800 con 0x5614eb5391b0 2024-08-31T05:39:20.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.806+0000 7f9fb3eac740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa81b1390 con 0x5614eb5184d0 2024-08-31T05:39:20.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.806+0000 7f9fa659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5614eb5102f0 0x5614eb8e2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:20.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.806+0000 7f9fa5d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5614eb5184d0 0x5614eb8e7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:20.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.806+0000 7f9fa659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5614eb5102f0 0x5614eb8e2db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42436/0 (socket says 172.21.15.5:42436) 2024-08-31T05:39:20.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.806+0000 7f9fa659c640 1 -- 172.21.15.5:0/567813284 learned_addr learned my addr 172.21.15.5:0/567813284 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:20.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.806+0000 7f9fa6d9d640 1 --2- 172.21.15.5:0/567813284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5614eb5391b0 0x5614eb8e8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:20.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.807+0000 7f9fa5d9b640 1 -- 172.21.15.5:0/567813284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5614eb5391b0 msgr2=0x5614eb8e8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:20.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.807+0000 7f9fa5d9b640 1 --2- 172.21.15.5:0/567813284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5614eb5391b0 0x5614eb8e8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:20.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.807+0000 7f9fa5d9b640 1 -- 172.21.15.5:0/567813284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5614eb5102f0 msgr2=0x5614eb8e2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:20.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.807+0000 7f9fa5d9b640 1 --2- 172.21.15.5:0/567813284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5614eb5102f0 0x5614eb8e2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:20.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.807+0000 7f9fa5d9b640 1 -- 172.21.15.5:0/567813284 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614eb8defe0 con 0x5614eb5184d0 2024-08-31T05:39:20.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.807+0000 7f9fa659c640 1 --2- 172.21.15.5:0/567813284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5614eb5102f0 0x5614eb8e2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:39:20.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.807+0000 7f9fa5d9b640 1 --2- 172.21.15.5:0/567813284 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5614eb5184d0 0x5614eb8e7b50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c0abf40 tx=0x7f9f9c0e6030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13c55f5036d414b4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:20.811 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.807+0000 7f9f8ffff640 1 -- 172.21.15.5:0/567813284 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c00ce60 con 0x5614eb5184d0 2024-08-31T05:39:20.811 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.807+0000 7f9f8ffff640 1 -- 172.21.15.5:0/567813284 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f9c0abac0 con 0x5614eb5184d0 2024-08-31T05:39:20.811 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.807+0000 7f9f8ffff640 1 -- 172.21.15.5:0/567813284 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c005680 con 0x5614eb5184d0 2024-08-31T05:39:20.814 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.808+0000 7f9fb3eac740 1 -- 172.21.15.5:0/567813284 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5614eb5184d0 msgr2=0x5614eb8e7b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:20.814 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.808+0000 7f9fb3eac740 1 --2- 172.21.15.5:0/567813284 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5614eb5184d0 0x5614eb8e7b50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c0abf40 tx=0x7f9f9c0e6030 comp rx=0 tx=0).stop 2024-08-31T05:39:20.814 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.808+0000 7f9fb3eac740 1 -- 172.21.15.5:0/567813284 shutdown_connections 2024-08-31T05:39:20.814 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.808+0000 7f9fb3eac740 1 --2- 172.21.15.5:0/567813284 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5614eb5391b0 0x5614eb8e8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:20.814 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.808+0000 7f9fb3eac740 1 --2- 172.21.15.5:0/567813284 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5614eb5184d0 0x5614eb8e7b50 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:20.815 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.808+0000 7f9fb3eac740 1 --2- 172.21.15.5:0/567813284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5614eb5102f0 0x5614eb8e2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:20.815 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.808+0000 7f9fb3eac740 1 -- 172.21.15.5:0/567813284 >> 172.21.15.5:0/567813284 conn(0x5614eb52d300 msgr2=0x5614eb8e6ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:20.815 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.808+0000 7f9fb3eac740 1 -- 172.21.15.5:0/567813284 shutdown_connections 2024-08-31T05:39:20.815 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.808+0000 7f9fb3eac740 1 -- 172.21.15.5:0/567813284 wait complete. 2024-08-31T05:39:20.815 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.808+0000 7f9fb3eac740 1 -- start start 2024-08-31T05:39:20.815 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.809+0000 7f9fb3eac740 1 Processor -- start 2024-08-31T05:39:20.815 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.809+0000 7f9fb3eac740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5614eb5102f0 0x5614eb8f0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:20.815 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.809+0000 7f9fb3eac740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5614eb5184d0 0x5614eb8ec270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:20.815 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.809+0000 7f9fb3eac740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5614eb5391b0 0x5614eb8ec7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:20.815 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.809+0000 7f9fb3eac740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa81b2130 con 0x5614eb5391b0 2024-08-31T05:39:20.815 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.809+0000 7f9fb3eac740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa81b1a60 con 0x5614eb5184d0 2024-08-31T05:39:20.815 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.809+0000 7f9fb3eac740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa81aecc0 con 0x5614eb5102f0 2024-08-31T05:39:20.815 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.809+0000 7f9fb3eac740 10 client.0 _ll_register_callbacks cb 0x7f9f9c0e94e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:39:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.809+0000 7f9fa6d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5614eb5391b0 0x5614eb8ec7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.809+0000 7f9fa659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5614eb5102f0 0x5614eb8f0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.809+0000 7f9fa659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5614eb5102f0 0x5614eb8f0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:35982/0 (socket says 172.21.15.5:35982) 2024-08-31T05:39:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.809+0000 7f9fa659c640 1 -- 172.21.15.5:0/3967232703 learned_addr learned my addr 172.21.15.5:0/3967232703 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.809+0000 7f9fa5d9b640 1 --2- 172.21.15.5:0/3967232703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5614eb5184d0 0x5614eb8ec270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.809+0000 7f9fa659c640 1 -- 172.21.15.5:0/3967232703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5614eb5184d0 msgr2=0x5614eb8ec270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.809+0000 7f9fa659c640 1 --2- 172.21.15.5:0/3967232703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5614eb5184d0 0x5614eb8ec270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.809+0000 7f9fa659c640 1 -- 172.21.15.5:0/3967232703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5614eb5391b0 msgr2=0x5614eb8ec7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.809+0000 7f9fa659c640 1 --2- 172.21.15.5:0/3967232703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5614eb5391b0 0x5614eb8ec7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.810+0000 7f9fa659c640 1 -- 172.21.15.5:0/3967232703 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614eb8ece20 con 0x5614eb5102f0 2024-08-31T05:39:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.810+0000 7f9fa6d9d640 1 --2- 172.21.15.5:0/3967232703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5614eb5391b0 0x5614eb8ec7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:39:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.810+0000 7f9fa659c640 1 --2- 172.21.15.5:0/3967232703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5614eb5102f0 0x5614eb8f0dd0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9f98004270 tx=0x7f9f98009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e4fc8a676bf9126 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.810+0000 7f9f8dffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:39:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.810+0000 7f9f8dffb640 1 -- 172.21.15.5:0/3967232703 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f98035040 con 0x5614eb5102f0 2024-08-31T05:39:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.810+0000 7f9f8dffb640 1 -- 172.21.15.5:0/3967232703 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7f9f98005240 con 0x5614eb5102f0 2024-08-31T05:39:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.810+0000 7f9fb3eac740 1 -- 172.21.15.5:0/3967232703 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f9c0abac0 con 0x5614eb5102f0 2024-08-31T05:39:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.810+0000 7f9f8dffb640 1 -- 172.21.15.5:0/3967232703 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f9f98060050 con 0x5614eb5102f0 2024-08-31T05:39:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.810+0000 7f9fb3eac740 10 client.27613 fetch_fsmap learned FSMap version 34 2024-08-31T05:39:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.810+0000 7f9fb3eac740 1 -- 172.21.15.5:0/3967232703 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5614eb965260 con 0x5614eb5102f0 2024-08-31T05:39:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.810+0000 7f9f8dffb640 1 -- 172.21.15.5:0/3967232703 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f9c0abac0 con 0x5614eb5102f0 2024-08-31T05:39:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.810+0000 7f9f8dffb640 1 -- 172.21.15.5:0/3967232703 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f9f98003710 con 0x5614eb5102f0 2024-08-31T05:39:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.810+0000 7f9fb3eac740 10 client.27613 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:39:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.810+0000 7f9fb3eac740 10 client.27613 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:39:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.810+0000 7f9fb3eac740 20 client.27613 populate_metadata read hostname 'smithi005' 2024-08-31T05:39:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.810+0000 7f9fb3eac740 1 --2- 172.21.15.5:0/3967232703 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5614eb4cd1c0 0x5614eb967a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.810+0000 7f9fb3eac740 4 client.27613 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:39:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.810+0000 7f9fb3eac740 1 -- 172.21.15.5:0/3967232703 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5614eb84f9f0 con 0x5614eb4cd1c0 2024-08-31T05:39:20.818 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.811+0000 7f9fa5d9b640 1 --2- 172.21.15.5:0/3967232703 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5614eb4cd1c0 0x5614eb967a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:20.818 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.811+0000 7f9fa5d9b640 1 --2- 172.21.15.5:0/3967232703 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5614eb4cd1c0 0x5614eb967a00 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=702f9e034ba132d5 server_cookie=82f26b68670b95ec in_seq=0 out_seq=0 2024-08-31T05:39:20.818 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.811+0000 7f9f8dffb640 10 client.27613 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:39:20.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.824+0000 7f9f8dffb640 1 -- 172.21.15.5:0/3967232703 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5614eb84f9f0 con 0x5614eb4cd1c0 2024-08-31T05:39:20.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.824+0000 7f9f8dffb640 10 client.27613 handle_command_reply: tid=0 2024-08-31T05:39:20.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.824+0000 7f9fb3eac740 1 client.27613 shutdown 2024-08-31T05:39:20.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.824+0000 7f9fb3eac740 1 -- 172.21.15.5:0/3967232703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5614eb5102f0 msgr2=0x5614eb8f0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:20.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.824+0000 7f9fb3eac740 1 --2- 172.21.15.5:0/3967232703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5614eb5102f0 0x5614eb8f0dd0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9f98004270 tx=0x7f9f98009260 comp rx=0 tx=0).stop 2024-08-31T05:39:20.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.824+0000 7f9fb3eac740 1 -- 172.21.15.5:0/3967232703 shutdown_connections 2024-08-31T05:39:20.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.824+0000 7f9fb3eac740 1 --2- 172.21.15.5:0/3967232703 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5614eb4cd1c0 0x5614eb967a00 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:20.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.824+0000 7f9fb3eac740 1 --2- 172.21.15.5:0/3967232703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5614eb5391b0 0x5614eb8ec7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:20.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.824+0000 7f9fb3eac740 1 --2- 172.21.15.5:0/3967232703 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5614eb5184d0 0x5614eb8ec270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:20.828 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.824+0000 7f9f8dffb640 0 client.27613 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:39:20.828 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.824+0000 7f9fb3eac740 1 --2- 172.21.15.5:0/3967232703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5614eb5102f0 0x5614eb8f0dd0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:20.828 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.824+0000 7f9fb3eac740 1 -- 172.21.15.5:0/3967232703 >> 172.21.15.5:0/3967232703 conn(0x5614eb52d300 msgr2=0x5614eb8e7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:20.828 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.825+0000 7f9fb3eac740 1 -- 172.21.15.5:0/3967232703 shutdown_connections 2024-08-31T05:39:20.828 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.825+0000 7f9fb3eac740 1 -- 172.21.15.5:0/3967232703 wait complete. 2024-08-31T05:39:20.828 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.825+0000 7f9fb3eac740 20 client.27613 trim_cache size 0 max 16384 2024-08-31T05:39:20.828 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:39:20.828 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:39:20.828 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:39:20.829 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:39:20.829 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.825+0000 7f9facf39640 1 -- 172.21.15.5:0/1776679362 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9f900b4d20 msgr2=0x7f9f900b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:20.829 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.825+0000 7f9facf39640 1 --2- 172.21.15.5:0/1776679362 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9f900b4d20 0x7f9f900b7230 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f9f98031440 tx=0x7f9f98009560 comp rx=0 tx=0).stop 2024-08-31T05:39:20.829 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.825+0000 7f9facf39640 1 -- 172.21.15.5:0/1776679362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fa81080c0 msgr2=0x7f9fa819a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:20.829 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.825+0000 7f9facf39640 1 --2- 172.21.15.5:0/1776679362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fa81080c0 0x7f9fa819a7b0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c00e9c0 tx=0x7f9f9c00ee80 comp rx=0 tx=0).stop 2024-08-31T05:39:20.829 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.825+0000 7f9facf39640 1 -- 172.21.15.5:0/1776679362 shutdown_connections 2024-08-31T05:39:20.830 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.825+0000 7f9facf39640 1 --2- 172.21.15.5:0/1776679362 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9f900b4d20 0x7f9f900b7230 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:20.830 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.825+0000 7f9facf39640 1 --2- 172.21.15.5:0/1776679362 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9fa8108a10 0x7f9fa819fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:20.830 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.825+0000 7f9facf39640 1 --2- 172.21.15.5:0/1776679362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fa81080c0 0x7f9fa819a7b0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:20.830 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.825+0000 7f9facf39640 1 --2- 172.21.15.5:0/1776679362 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9fa8102790 0x7f9fa819a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:20.830 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.825+0000 7f9facf39640 1 -- 172.21.15.5:0/1776679362 >> 172.21.15.5:0/1776679362 conn(0x7f9fa80fe190 msgr2=0x7f9fa806ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:20.830 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.826+0000 7f9facf39640 1 -- 172.21.15.5:0/1776679362 shutdown_connections 2024-08-31T05:39:20.830 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:20.826+0000 7f9facf39640 1 -- 172.21.15.5:0/1776679362 wait complete. 2024-08-31T05:39:20.932 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1057971 11.15 MB/sec execute 368 sec latency 76.799 ms 2024-08-31T05:39:21.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:39:20 smithi005 ceph-mon[18602]: pgmap v632: 129 pgs: 129 active+clean; 547 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.4 MiB/s wr, 222 op/s 2024-08-31T05:39:21.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:39:20 smithi070 ceph-mon[22316]: pgmap v632: 129 pgs: 129 active+clean; 547 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.4 MiB/s wr, 222 op/s 2024-08-31T05:39:21.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:39:20 smithi050 ceph-mon[22146]: pgmap v632: 129 pgs: 129 active+clean; 547 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.4 MiB/s wr, 222 op/s 2024-08-31T05:39:21.577 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T05:39:21.861 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:39:21.932 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1059820 11.14 MB/sec execute 369 sec latency 13.611 ms 2024-08-31T05:39:22.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.535+0000 7fbb466a9640 1 -- 172.21.15.5:0/283132330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb4010dc00 msgr2=0x7fbb401100d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:22.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.535+0000 7fbb466a9640 1 --2- 172.21.15.5:0/283132330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb4010dc00 0x7fbb401100d0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fbb38009ca0 tx=0x7fbb3802a8c0 comp rx=0 tx=0).stop 2024-08-31T05:39:22.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.535+0000 7fbb466a9640 1 -- 172.21.15.5:0/283132330 shutdown_connections 2024-08-31T05:39:22.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.535+0000 7fbb466a9640 1 --2- 172.21.15.5:0/283132330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb4010dc00 0x7fbb401100d0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:22.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.536+0000 7fbb466a9640 1 --2- 172.21.15.5:0/283132330 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb40105120 0x7fbb4010d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:22.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.536+0000 7fbb466a9640 1 --2- 172.21.15.5:0/283132330 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb401047d0 0x7fbb40104be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:22.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.536+0000 7fbb466a9640 1 -- 172.21.15.5:0/283132330 >> 172.21.15.5:0/283132330 conn(0x7fbb40079530 msgr2=0x7fbb40079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:22.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.536+0000 7fbb466a9640 1 -- 172.21.15.5:0/283132330 shutdown_connections 2024-08-31T05:39:22.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.536+0000 7fbb466a9640 1 -- 172.21.15.5:0/283132330 wait complete. 2024-08-31T05:39:22.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.537+0000 7fbb466a9640 1 Processor -- start 2024-08-31T05:39:22.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.537+0000 7fbb466a9640 1 -- start start 2024-08-31T05:39:22.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.538+0000 7fbb466a9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb401047d0 0x7fbb4019c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:22.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.538+0000 7fbb466a9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb40105120 0x7fbb4019c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:22.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.538+0000 7fbb466a9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb4010dc00 0x7fbb401a1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:22.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.538+0000 7fbb466a9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbb401138b0 con 0x7fbb40105120 2024-08-31T05:39:22.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.538+0000 7fbb466a9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbb40113730 con 0x7fbb401047d0 2024-08-31T05:39:22.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.538+0000 7fbb466a9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbb40113a30 con 0x7fbb4010dc00 2024-08-31T05:39:22.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.538+0000 7fbb3f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb40105120 0x7fbb4019c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:22.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.538+0000 7fbb3ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb401047d0 0x7fbb4019c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:22.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.538+0000 7fbb3f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb40105120 0x7fbb4019c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40198/0 (socket says 172.21.15.5:40198) 2024-08-31T05:39:22.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.538+0000 7fbb3f7fe640 1 -- 172.21.15.5:0/170869308 learned_addr learned my addr 172.21.15.5:0/170869308 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:22.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.538+0000 7fbb44c46640 1 --2- 172.21.15.5:0/170869308 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb4010dc00 0x7fbb401a1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:22.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.539+0000 7fbb3f7fe640 1 -- 172.21.15.5:0/170869308 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb4010dc00 msgr2=0x7fbb401a1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:22.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.539+0000 7fbb3f7fe640 1 --2- 172.21.15.5:0/170869308 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb4010dc00 0x7fbb401a1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:22.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.539+0000 7fbb3f7fe640 1 -- 172.21.15.5:0/170869308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb401047d0 msgr2=0x7fbb4019c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:22.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.539+0000 7fbb3f7fe640 1 --2- 172.21.15.5:0/170869308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb401047d0 0x7fbb4019c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:22.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.539+0000 7fbb3f7fe640 1 -- 172.21.15.5:0/170869308 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb401a23b0 con 0x7fbb40105120 2024-08-31T05:39:22.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.539+0000 7fbb3ffff640 1 --2- 172.21.15.5:0/170869308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb401047d0 0x7fbb4019c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:39:22.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.539+0000 7fbb3f7fe640 1 --2- 172.21.15.5:0/170869308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb40105120 0x7fbb4019c9e0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fbb3400e970 tx=0x7fbb3400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:22.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.539+0000 7fbb3d7fa640 1 -- 172.21.15.5:0/170869308 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3400cd80 con 0x7fbb40105120 2024-08-31T05:39:22.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.539+0000 7fbb3d7fa640 1 -- 172.21.15.5:0/170869308 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb340035f0 con 0x7fbb40105120 2024-08-31T05:39:22.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.539+0000 7fbb466a9640 1 -- 172.21.15.5:0/170869308 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb401a26a0 con 0x7fbb40105120 2024-08-31T05:39:22.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.539+0000 7fbb3d7fa640 1 -- 172.21.15.5:0/170869308 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb34010690 con 0x7fbb40105120 2024-08-31T05:39:22.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.539+0000 7fbb466a9640 1 -- 172.21.15.5:0/170869308 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb401a8e00 con 0x7fbb40105120 2024-08-31T05:39:22.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.542+0000 7fbb4cc1e740 1 Processor -- start 2024-08-31T05:39:22.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.542+0000 7fbb4cc1e740 1 -- start start 2024-08-31T05:39:22.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.542+0000 7fbb3d7fa640 1 -- 172.21.15.5:0/170869308 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fbb34010830 con 0x7fbb40105120 2024-08-31T05:39:22.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.542+0000 7fbb4cc1e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d20e928070 0x55d20eccd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:22.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.542+0000 7fbb4cc1e740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d20e8ff1b0 0x55d20eccd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:22.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.542+0000 7fbb4cc1e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d20e907390 0x55d20eccdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:22.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.542+0000 7fbb4cc1e740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55d20ec44630 con 0x55d20e8ff1b0 2024-08-31T05:39:22.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.542+0000 7fbb4cc1e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d20ec33bc0 con 0x55d20e928070 2024-08-31T05:39:22.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.542+0000 7fbb4cc1e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d20ec37b70 con 0x55d20e907390 2024-08-31T05:39:22.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.542+0000 7fbb3ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d20e8ff1b0 0x55d20eccd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:22.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.542+0000 7fbb3f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d20e907390 0x55d20eccdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:22.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.543+0000 7fbb44c46640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d20e928070 0x55d20eccd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:22.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.542+0000 7fbb3ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d20e8ff1b0 0x55d20eccd800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40212/0 (socket says 172.21.15.5:40212) 2024-08-31T05:39:22.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.543+0000 7fbb44c46640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d20e928070 0x55d20eccd2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:52514/0 (socket says 172.21.15.5:52514) 2024-08-31T05:39:22.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.543+0000 7fbb3ffff640 1 -- 172.21.15.5:0/467132032 learned_addr learned my addr 172.21.15.5:0/467132032 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:22.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.543+0000 7fbb3f7fe640 1 -- 172.21.15.5:0/467132032 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d20e928070 msgr2=0x55d20eccd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:22.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.543+0000 7fbb3f7fe640 1 --2- 172.21.15.5:0/467132032 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d20e928070 0x55d20eccd2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:22.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.543+0000 7fbb3f7fe640 1 -- 172.21.15.5:0/467132032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d20e8ff1b0 msgr2=0x55d20eccd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:22.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.543+0000 7fbb3f7fe640 1 --2- 172.21.15.5:0/467132032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d20e8ff1b0 0x55d20eccd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:22.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.543+0000 7fbb3d7fa640 1 --2- 172.21.15.5:0/170869308 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fbb280b4ca0 0x7fbb280b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:22.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.543+0000 7fbb3f7fe640 1 -- 172.21.15.5:0/467132032 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d20e993650 con 0x55d20e907390 2024-08-31T05:39:22.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.543+0000 7fbb44c46640 1 --2- 172.21.15.5:0/467132032 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d20e928070 0x55d20eccd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-08-31T05:39:22.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.543+0000 7fbb44c46640 1 --2- 172.21.15.5:0/170869308 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fbb280b4ca0 0x7fbb280b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:22.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.543+0000 7fbb3f7fe640 1 --2- 172.21.15.5:0/467132032 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d20e907390 0x55d20eccdd40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fbb340e2eb0 tx=0x7fbb340a8560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fe83533ac596fd3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:22.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.543+0000 7fbb3d7fa640 1 -- 172.21.15.5:0/170869308 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7fbb340e5b40 con 0x7fbb40105120 2024-08-31T05:39:22.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.543+0000 7fbb267fc640 1 -- 172.21.15.5:0/467132032 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb340abc20 con 0x55d20e907390 2024-08-31T05:39:22.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.544+0000 7fbb267fc640 1 -- 172.21.15.5:0/467132032 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb340ab960 con 0x55d20e907390 2024-08-31T05:39:22.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.544+0000 7fbb267fc640 1 -- 172.21.15.5:0/467132032 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb340ab5c0 con 0x55d20e907390 2024-08-31T05:39:22.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.545+0000 7fbb4cc1e740 1 -- 172.21.15.5:0/467132032 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d20e907390 msgr2=0x55d20eccdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:22.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.545+0000 7fbb4cc1e740 1 --2- 172.21.15.5:0/467132032 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d20e907390 0x55d20eccdd40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fbb340e2eb0 tx=0x7fbb340a8560 comp rx=0 tx=0).stop 2024-08-31T05:39:22.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.545+0000 7fbb44c46640 1 --2- 172.21.15.5:0/170869308 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fbb280b4ca0 0x7fbb280b71b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fbb38009a60 tx=0x7fbb38032fa0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:22.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.545+0000 7fbb4cc1e740 1 -- 172.21.15.5:0/467132032 shutdown_connections 2024-08-31T05:39:22.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.545+0000 7fbb4cc1e740 1 --2- 172.21.15.5:0/467132032 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d20e907390 0x55d20eccdd40 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:22.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.545+0000 7fbb4cc1e740 1 --2- 172.21.15.5:0/467132032 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d20e8ff1b0 0x55d20eccd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:22.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.545+0000 7fbb4cc1e740 1 --2- 172.21.15.5:0/467132032 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d20e928070 0x55d20eccd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:22.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.545+0000 7fbb4cc1e740 1 -- 172.21.15.5:0/467132032 >> 172.21.15.5:0/467132032 conn(0x55d20e91c460 msgr2=0x55d20eccb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:22.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.545+0000 7fbb4cc1e740 1 -- 172.21.15.5:0/467132032 shutdown_connections 2024-08-31T05:39:22.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.545+0000 7fbb4cc1e740 1 -- 172.21.15.5:0/467132032 wait complete. 2024-08-31T05:39:22.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.545+0000 7fbb4cc1e740 1 -- start start 2024-08-31T05:39:22.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.546+0000 7fbb4cc1e740 1 Processor -- start 2024-08-31T05:39:22.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.546+0000 7fbb4cc1e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d20e8ff1b0 0x55d20ecd8a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:22.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.546+0000 7fbb4cc1e740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d20e907390 0x55d20ecd8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:22.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.546+0000 7fbb4cc1e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d20e928070 0x55d20ece4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:22.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.546+0000 7fbb4cc1e740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55d20ea96700 con 0x55d20e907390 2024-08-31T05:39:22.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.546+0000 7fbb4cc1e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d20ebba700 con 0x55d20e8ff1b0 2024-08-31T05:39:22.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.546+0000 7fbb4cc1e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d20ecdbaa0 con 0x55d20e928070 2024-08-31T05:39:22.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.546+0000 7fbb4cc1e740 10 client.0 _ll_register_callbacks cb 0x55d20ebe9dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:39:22.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.546+0000 7fbb3f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d20e907390 0x55d20ecd8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:22.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.546+0000 7fbb3ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d20e8ff1b0 0x55d20ecd8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:22.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.546+0000 7fbb3f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d20e907390 0x55d20ecd8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40224/0 (socket says 172.21.15.5:40224) 2024-08-31T05:39:22.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.546+0000 7fbb44c46640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d20e928070 0x55d20ece4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:22.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.546+0000 7fbb3f7fe640 1 -- 172.21.15.5:0/1555017367 learned_addr learned my addr 172.21.15.5:0/1555017367 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:22.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.547+0000 7fbb3ffff640 1 -- 172.21.15.5:0/1555017367 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d20e928070 msgr2=0x55d20ece4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:22.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.547+0000 7fbb3ffff640 1 --2- 172.21.15.5:0/1555017367 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d20e928070 0x55d20ece4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:22.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.547+0000 7fbb3ffff640 1 -- 172.21.15.5:0/1555017367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d20e907390 msgr2=0x55d20ecd8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:22.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.547+0000 7fbb3ffff640 1 --2- 172.21.15.5:0/1555017367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d20e907390 0x55d20ecd8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:22.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.547+0000 7fbb3ffff640 1 -- 172.21.15.5:0/1555017367 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d20ebf38b0 con 0x55d20e8ff1b0 2024-08-31T05:39:22.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.547+0000 7fbb3ffff640 1 --2- 172.21.15.5:0/1555017367 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d20e8ff1b0 0x55d20ecd8a60 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x55d20eccbf40 tx=0x7fbb3000f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdf6a698a09049de server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:22.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.547+0000 7fbb1f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:39:22.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.547+0000 7fbb1f7fe640 1 -- 172.21.15.5:0/1555017367 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb300120d0 con 0x55d20e8ff1b0 2024-08-31T05:39:22.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.547+0000 7fbb1f7fe640 1 -- 172.21.15.5:0/1555017367 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7fbb30005020 con 0x55d20e8ff1b0 2024-08-31T05:39:22.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.547+0000 7fbb4cc1e740 1 -- 172.21.15.5:0/1555017367 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb340ab960 con 0x55d20e8ff1b0 2024-08-31T05:39:22.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.548+0000 7fbb1f7fe640 1 -- 172.21.15.5:0/1555017367 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fbb30012270 con 0x55d20e8ff1b0 2024-08-31T05:39:22.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.548+0000 7fbb4cc1e740 10 client.27617 fetch_fsmap learned FSMap version 34 2024-08-31T05:39:22.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.548+0000 7fbb4cc1e740 1 -- 172.21.15.5:0/1555017367 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55d20ece7800 con 0x55d20e8ff1b0 2024-08-31T05:39:22.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.548+0000 7fbb1f7fe640 1 -- 172.21.15.5:0/1555017367 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb340ab960 con 0x55d20e8ff1b0 2024-08-31T05:39:22.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.548+0000 7fbb1f7fe640 1 -- 172.21.15.5:0/1555017367 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fbb3001c470 con 0x55d20e8ff1b0 2024-08-31T05:39:22.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.548+0000 7fbb4cc1e740 10 client.27617 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:39:22.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.548+0000 7fbb4cc1e740 10 client.27617 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:39:22.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.548+0000 7fbb4cc1e740 20 client.27617 populate_metadata read hostname 'smithi005' 2024-08-31T05:39:22.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.548+0000 7fbb4cc1e740 1 --2- 172.21.15.5:0/1555017367 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d20e8e69f0 0x55d20eceacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:22.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.548+0000 7fbb4cc1e740 4 client.27617 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:39:22.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.548+0000 7fbb4cc1e740 1 -- 172.21.15.5:0/1555017367 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d20ec46580 con 0x55d20e8e69f0 2024-08-31T05:39:22.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.548+0000 7fbb3f7fe640 1 --2- 172.21.15.5:0/1555017367 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d20e8e69f0 0x55d20eceacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:22.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.549+0000 7fbb1f7fe640 10 client.27617 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:39:22.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.549+0000 7fbb3f7fe640 1 --2- 172.21.15.5:0/1555017367 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d20e8e69f0 0x55d20eceacd0 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dbfdf82a8d6b2fa server_cookie=1c73801953f072b5 in_seq=0 out_seq=0 2024-08-31T05:39:22.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.550+0000 7fbb1f7fe640 1 -- 172.21.15.5:0/1555017367 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d20ec46580 con 0x55d20e8e69f0 2024-08-31T05:39:22.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.550+0000 7fbb1f7fe640 10 client.27617 handle_command_reply: tid=0 2024-08-31T05:39:22.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.550+0000 7fbb4cc1e740 1 client.27617 shutdown 2024-08-31T05:39:22.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.550+0000 7fbb4cc1e740 1 -- 172.21.15.5:0/1555017367 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d20e8ff1b0 msgr2=0x55d20ecd8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:22.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.550+0000 7fbb4cc1e740 1 --2- 172.21.15.5:0/1555017367 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d20e8ff1b0 0x55d20ecd8a60 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x55d20eccbf40 tx=0x7fbb3000f790 comp rx=0 tx=0).stop 2024-08-31T05:39:22.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.550+0000 7fbb4cc1e740 1 -- 172.21.15.5:0/1555017367 shutdown_connections 2024-08-31T05:39:22.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.550+0000 7fbb4cc1e740 1 --2- 172.21.15.5:0/1555017367 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d20e8e69f0 0x55d20eceacd0 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:22.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.550+0000 7fbb4cc1e740 1 --2- 172.21.15.5:0/1555017367 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d20e928070 0x55d20ece4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:22.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.550+0000 7fbb4cc1e740 1 --2- 172.21.15.5:0/1555017367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d20e907390 0x55d20ecd8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:22.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.550+0000 7fbb4cc1e740 1 --2- 172.21.15.5:0/1555017367 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d20e8ff1b0 0x55d20ecd8a60 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:22.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.550+0000 7fbb1f7fe640 0 client.27617 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:39:22.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.550+0000 7fbb4cc1e740 1 -- 172.21.15.5:0/1555017367 >> 172.21.15.5:0/1555017367 conn(0x55d20e91c460 msgr2=0x55d20ecd04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:22.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.550+0000 7fbb4cc1e740 1 -- 172.21.15.5:0/1555017367 shutdown_connections 2024-08-31T05:39:22.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.550+0000 7fbb4cc1e740 1 -- 172.21.15.5:0/1555017367 wait complete. 2024-08-31T05:39:22.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.550+0000 7fbb4cc1e740 20 client.27617 trim_cache size 0 max 16384 2024-08-31T05:39:22.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.575+0000 7fbb4cc1e740 1 Processor -- start 2024-08-31T05:39:22.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.575+0000 7fbb4cc1e740 1 -- start start 2024-08-31T05:39:22.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.575+0000 7fbb4cc1e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d20e8ff1b0 0x55d20ecd89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:22.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.575+0000 7fbb4cc1e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d20e907390 0x55d20ecd0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:22.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.575+0000 7fbb4cc1e740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d20e928070 0x55d20ecd5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:22.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.575+0000 7fbb3f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d20e907390 0x55d20ecd0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:22.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.575+0000 7fbb4cc1e740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbb401b2fc0 con 0x55d20e928070 2024-08-31T05:39:22.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.575+0000 7fbb4cc1e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbb401b4b00 con 0x55d20e8ff1b0 2024-08-31T05:39:22.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.575+0000 7fbb4cc1e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbb401b3690 con 0x55d20e907390 2024-08-31T05:39:22.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.575+0000 7fbb3f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d20e907390 0x55d20ecd0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:51952/0 (socket says 172.21.15.5:51952) 2024-08-31T05:39:22.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.575+0000 7fbb3f7fe640 1 -- 172.21.15.5:0/3839782456 learned_addr learned my addr 172.21.15.5:0/3839782456 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:22.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.575+0000 7fbb44c46640 1 --2- 172.21.15.5:0/3839782456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d20e928070 0x55d20ecd5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:22.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.576+0000 7fbb3ffff640 1 --2- 172.21.15.5:0/3839782456 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d20e8ff1b0 0x55d20ecd89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:22.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.576+0000 7fbb3f7fe640 1 -- 172.21.15.5:0/3839782456 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d20e8ff1b0 msgr2=0x55d20ecd89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:22.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.576+0000 7fbb3f7fe640 1 --2- 172.21.15.5:0/3839782456 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d20e8ff1b0 0x55d20ecd89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:22.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.576+0000 7fbb3f7fe640 1 -- 172.21.15.5:0/3839782456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d20e928070 msgr2=0x55d20ecd5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:22.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.576+0000 7fbb3f7fe640 1 --2- 172.21.15.5:0/3839782456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d20e928070 0x55d20ecd5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:22.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.576+0000 7fbb3f7fe640 1 -- 172.21.15.5:0/3839782456 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d20ecd79c0 con 0x55d20e907390 2024-08-31T05:39:22.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.576+0000 7fbb44c46640 1 --2- 172.21.15.5:0/3839782456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d20e928070 0x55d20ecd5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:39:22.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.576+0000 7fbb3ffff640 1 --2- 172.21.15.5:0/3839782456 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d20e8ff1b0 0x55d20ecd89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:39:22.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.576+0000 7fbb3f7fe640 1 --2- 172.21.15.5:0/3839782456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d20e907390 0x55d20ecd0ad0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fbb340098c0 tx=0x7fbb340a7c40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99b032159691e3e7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:22.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.576+0000 7fbb25ffb640 1 -- 172.21.15.5:0/3839782456 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb340ab7a0 con 0x55d20e907390 2024-08-31T05:39:22.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.576+0000 7fbb25ffb640 1 -- 172.21.15.5:0/3839782456 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb340ae020 con 0x55d20e907390 2024-08-31T05:39:22.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.576+0000 7fbb25ffb640 1 -- 172.21.15.5:0/3839782456 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb340abe50 con 0x55d20e907390 2024-08-31T05:39:22.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.577+0000 7fbb4cc1e740 1 -- 172.21.15.5:0/3839782456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d20e907390 msgr2=0x55d20ecd0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:22.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.577+0000 7fbb4cc1e740 1 --2- 172.21.15.5:0/3839782456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d20e907390 0x55d20ecd0ad0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fbb340098c0 tx=0x7fbb340a7c40 comp rx=0 tx=0).stop 2024-08-31T05:39:22.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.577+0000 7fbb4cc1e740 1 -- 172.21.15.5:0/3839782456 shutdown_connections 2024-08-31T05:39:22.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.577+0000 7fbb4cc1e740 1 --2- 172.21.15.5:0/3839782456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d20e928070 0x55d20ecd5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:22.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.577+0000 7fbb4cc1e740 1 --2- 172.21.15.5:0/3839782456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d20e907390 0x55d20ecd0ad0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:22.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.577+0000 7fbb4cc1e740 1 --2- 172.21.15.5:0/3839782456 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d20e8ff1b0 0x55d20ecd89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:22.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.577+0000 7fbb4cc1e740 1 -- 172.21.15.5:0/3839782456 >> 172.21.15.5:0/3839782456 conn(0x55d20e91c460 msgr2=0x55d20ecd03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:22.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.577+0000 7fbb4cc1e740 1 -- 172.21.15.5:0/3839782456 shutdown_connections 2024-08-31T05:39:22.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.577+0000 7fbb4cc1e740 1 -- 172.21.15.5:0/3839782456 wait complete. 2024-08-31T05:39:22.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.578+0000 7fbb4cc1e740 1 -- start start 2024-08-31T05:39:22.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.578+0000 7fbb4cc1e740 1 Processor -- start 2024-08-31T05:39:22.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.578+0000 7fbb4cc1e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d20e8ff1b0 0x55d20ecdd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:22.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.578+0000 7fbb4cc1e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d20e907390 0x55d20ecdd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:22.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.578+0000 7fbb4cc1e740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d20e928070 0x55d20ed54610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:22.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.578+0000 7fbb4cc1e740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbb401b4430 con 0x55d20e928070 2024-08-31T05:39:22.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.578+0000 7fbb4cc1e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbb401b3d60 con 0x55d20e8ff1b0 2024-08-31T05:39:22.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.578+0000 7fbb4cc1e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbb401b0fc0 con 0x55d20e907390 2024-08-31T05:39:22.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.578+0000 7fbb4cc1e740 10 client.0 _ll_register_callbacks cb 0x7fbb30009d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:39:22.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.579+0000 7fbb3ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d20e8ff1b0 0x55d20ecdd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:22.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.579+0000 7fbb3ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d20e8ff1b0 0x55d20ecdd090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:52542/0 (socket says 172.21.15.5:52542) 2024-08-31T05:39:22.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.579+0000 7fbb3ffff640 1 -- 172.21.15.5:0/3345564852 learned_addr learned my addr 172.21.15.5:0/3345564852 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:22.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.579+0000 7fbb3f7fe640 1 --2- 172.21.15.5:0/3345564852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d20e907390 0x55d20ecdd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:22.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.579+0000 7fbb44c46640 1 --2- 172.21.15.5:0/3345564852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d20e928070 0x55d20ed54610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:22.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.579+0000 7fbb3ffff640 1 -- 172.21.15.5:0/3345564852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d20e907390 msgr2=0x55d20ecdd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:22.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.579+0000 7fbb3ffff640 1 --2- 172.21.15.5:0/3345564852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d20e907390 0x55d20ecdd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:22.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.579+0000 7fbb3ffff640 1 -- 172.21.15.5:0/3345564852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d20e928070 msgr2=0x55d20ed54610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:22.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.579+0000 7fbb3ffff640 1 --2- 172.21.15.5:0/3345564852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d20e928070 0x55d20ed54610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:22.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.579+0000 7fbb3ffff640 1 -- 172.21.15.5:0/3345564852 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d20ed54b50 con 0x55d20e8ff1b0 2024-08-31T05:39:22.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.579+0000 7fbb3f7fe640 1 --2- 172.21.15.5:0/3345564852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d20e907390 0x55d20ecdd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:39:22.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.579+0000 7fbb3ffff640 1 --2- 172.21.15.5:0/3345564852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d20e8ff1b0 0x55d20ecdd090 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbb3001c910 tx=0x7fbb3001c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=941c6cf05bf8f27d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:22.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.579+0000 7fbb1f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:39:22.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.580+0000 7fbb1f7fe640 1 -- 172.21.15.5:0/3345564852 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3002e060 con 0x55d20e8ff1b0 2024-08-31T05:39:22.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.580+0000 7fbb4cc1e740 1 -- 172.21.15.5:0/3345564852 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb340ae020 con 0x55d20e8ff1b0 2024-08-31T05:39:22.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.580+0000 7fbb1f7fe640 1 -- 172.21.15.5:0/3345564852 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7fbb300050d0 con 0x55d20e8ff1b0 2024-08-31T05:39:22.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.580+0000 7fbb1f7fe640 1 -- 172.21.15.5:0/3345564852 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fbb300052d0 con 0x55d20e8ff1b0 2024-08-31T05:39:22.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.580+0000 7fbb4cc1e740 10 client.27623 fetch_fsmap learned FSMap version 34 2024-08-31T05:39:22.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.580+0000 7fbb4cc1e740 1 -- 172.21.15.5:0/3345564852 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55d20ed55c80 con 0x55d20e8ff1b0 2024-08-31T05:39:22.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.580+0000 7fbb1f7fe640 1 -- 172.21.15.5:0/3345564852 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb340ae020 con 0x55d20e8ff1b0 2024-08-31T05:39:22.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.580+0000 7fbb1f7fe640 1 -- 172.21.15.5:0/3345564852 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fbb30029440 con 0x55d20e8ff1b0 2024-08-31T05:39:22.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.580+0000 7fbb4cc1e740 10 client.27623 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:39:22.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.580+0000 7fbb4cc1e740 10 client.27623 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:39:22.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.580+0000 7fbb4cc1e740 20 client.27623 populate_metadata read hostname 'smithi005' 2024-08-31T05:39:22.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.580+0000 7fbb4cc1e740 1 --2- 172.21.15.5:0/3345564852 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d20e8bbda0 0x55d20ed58470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:22.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.580+0000 7fbb4cc1e740 4 client.27623 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T05:39:22.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.580+0000 7fbb4cc1e740 1 -- 172.21.15.5:0/3345564852 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d20ec42020 con 0x55d20e8bbda0 2024-08-31T05:39:22.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.581+0000 7fbb3f7fe640 1 --2- 172.21.15.5:0/3345564852 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d20e8bbda0 0x55d20ed58470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:22.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.581+0000 7fbb1f7fe640 10 client.27623 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:39:22.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.581+0000 7fbb3f7fe640 1 --2- 172.21.15.5:0/3345564852 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d20e8bbda0 0x55d20ed58470 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=268d336ee62355ee server_cookie=e00e81a3308b9a14 in_seq=0 out_seq=0 2024-08-31T05:39:22.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.582+0000 7fbb1f7fe640 1 -- 172.21.15.5:0/3345564852 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3498 (crc 0 0 0) 0x55d20ec42020 con 0x55d20e8bbda0 2024-08-31T05:39:22.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.582+0000 7fbb1f7fe640 10 client.27623 handle_command_reply: tid=0 2024-08-31T05:39:22.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.582+0000 7fbb4cc1e740 1 client.27623 shutdown 2024-08-31T05:39:22.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.582+0000 7fbb4cc1e740 1 -- 172.21.15.5:0/3345564852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d20e8ff1b0 msgr2=0x55d20ecdd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:22.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.582+0000 7fbb4cc1e740 1 --2- 172.21.15.5:0/3345564852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d20e8ff1b0 0x55d20ecdd090 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbb3001c910 tx=0x7fbb3001c470 comp rx=0 tx=0).stop 2024-08-31T05:39:22.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.582+0000 7fbb4cc1e740 1 -- 172.21.15.5:0/3345564852 shutdown_connections 2024-08-31T05:39:22.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.582+0000 7fbb4cc1e740 1 --2- 172.21.15.5:0/3345564852 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d20e8bbda0 0x55d20ed58470 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:22.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.582+0000 7fbb4cc1e740 1 --2- 172.21.15.5:0/3345564852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d20e928070 0x55d20ed54610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:22.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.582+0000 7fbb4cc1e740 1 --2- 172.21.15.5:0/3345564852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d20e907390 0x55d20ecdd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:22.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.582+0000 7fbb4cc1e740 1 --2- 172.21.15.5:0/3345564852 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d20e8ff1b0 0x55d20ecdd090 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:22.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.582+0000 7fbb4cc1e740 1 -- 172.21.15.5:0/3345564852 >> 172.21.15.5:0/3345564852 conn(0x55d20e91c460 msgr2=0x55d20ecce2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:22.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.582+0000 7fbb1f7fe640 0 client.27623 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:39:22.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.582+0000 7fbb4cc1e740 1 -- 172.21.15.5:0/3345564852 shutdown_connections 2024-08-31T05:39:22.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.582+0000 7fbb4cc1e740 1 -- 172.21.15.5:0/3345564852 wait complete. 2024-08-31T05:39:22.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.583+0000 7fbb4cc1e740 20 client.27623 trim_cache size 0 max 16384 2024-08-31T05:39:22.589 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:39:22.589 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "no active scrubs running", 2024-08-31T05:39:22.589 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": {}, 2024-08-31T05:39:22.589 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_stats": { 2024-08-31T05:39:22.589 INFO:teuthology.orchestra.run.smithi005.stdout: "94c23057-592d-4a8b-82d7-da2d84f8740b": { 2024-08-31T05:39:22.589 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:36:27.513638+0000", 2024-08-31T05:39:22.590 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:39:22.590 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:39:22.590 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:39:22.590 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:39:22.590 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:39:22.590 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:39:22.590 INFO:teuthology.orchestra.run.smithi005.stdout: "a4d4cf74-2477-4dd9-a3a2-3762b4dd87e4": { 2024-08-31T05:39:22.590 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:38:01.378833+0000", 2024-08-31T05:39:22.590 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:39:22.590 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:39:22.590 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:39:22.590 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:39:22.590 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:39:22.590 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:39:22.590 INFO:teuthology.orchestra.run.smithi005.stdout: "095ccc7a-f368-4bc6-9563-5930e21f9b4a": { 2024-08-31T05:39:22.591 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:35:40.190069+0000", 2024-08-31T05:39:22.591 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:39:22.591 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:39:22.591 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:39:22.591 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:39:22.591 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:39:22.591 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:39:22.591 INFO:teuthology.orchestra.run.smithi005.stdout: "f4db3406-20ff-46a3-baf9-099e16392f76": { 2024-08-31T05:39:22.591 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:38:49.034412+0000", 2024-08-31T05:39:22.591 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:39:22.591 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:39:22.591 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:39:22.591 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:39:22.591 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:39:22.592 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:39:22.592 INFO:teuthology.orchestra.run.smithi005.stdout: "297c26f3-7b4d-4245-abb0-f854248e5e1b": { 2024-08-31T05:39:22.592 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:37:14.019244+0000", 2024-08-31T05:39:22.592 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:39:22.592 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:39:22.592 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:39:22.592 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:39:22.592 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:39:22.592 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:39:22.592 INFO:teuthology.orchestra.run.smithi005.stdout: "de9731c7-ae4a-42fe-8146-e4752cdc40d4": { 2024-08-31T05:39:22.592 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:34:53.614499+0000", 2024-08-31T05:39:22.592 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:39:22.592 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:39:22.592 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:39:22.593 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:39:22.593 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:39:22.593 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:39:22.593 INFO:teuthology.orchestra.run.smithi005.stdout: "0bb67292-013a-40c7-b5fc-810bdd9715d8": { 2024-08-31T05:39:22.593 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:34:04.586008+0000", 2024-08-31T05:39:22.593 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:39:22.593 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:39:22.593 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:39:22.593 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:39:22.593 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:39:22.593 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:39:22.593 INFO:teuthology.orchestra.run.smithi005.stdout: "728a42ca-bbef-4151-830f-5fdd411d8fa0": { 2024-08-31T05:39:22.593 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:32:30.554906+0000", 2024-08-31T05:39:22.594 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:39:22.594 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:39:22.594 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:39:22.594 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:39:22.594 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:39:22.594 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:39:22.594 INFO:teuthology.orchestra.run.smithi005.stdout: "2445fc42-b797-434f-b380-e2da985b4d98": { 2024-08-31T05:39:22.594 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:33:17.681453+0000", 2024-08-31T05:39:22.594 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:39:22.594 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:39:22.594 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:39:22.594 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:39:22.594 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:39:22.595 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:39:22.595 INFO:teuthology.orchestra.run.smithi005.stdout: "cda92ac0-b35f-47a5-a3a5-471c888462a5": { 2024-08-31T05:39:22.595 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:53.103905+0000", 2024-08-31T05:39:22.595 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:39:22.595 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:39:22.595 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:39:22.595 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:39:22.595 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:39:22.595 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:39:22.595 INFO:teuthology.orchestra.run.smithi005.stdout: "ece37b07-9ab2-45f8-bc33-2755a07aac0b": { 2024-08-31T05:39:22.595 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:31:41.782407+0000", 2024-08-31T05:39:22.595 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:39:22.595 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:39:22.595 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:39:22.596 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:39:22.596 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:39:22.596 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:39:22.596 INFO:teuthology.orchestra.run.smithi005.stdout: "75d84398-5d9c-4872-b879-2fbce045fa71": { 2024-08-31T05:39:22.596 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:06.642335+0000", 2024-08-31T05:39:22.596 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:39:22.596 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:39:22.596 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:39:22.596 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:39:22.596 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:39:22.596 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:39:22.596 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:39:22.596 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:39:22.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.583+0000 7fbb466a9640 1 -- 172.21.15.5:0/170869308 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fbb280b4ca0 msgr2=0x7fbb280b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:22.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.583+0000 7fbb466a9640 1 --2- 172.21.15.5:0/170869308 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fbb280b4ca0 0x7fbb280b71b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fbb38009a60 tx=0x7fbb38032fa0 comp rx=0 tx=0).stop 2024-08-31T05:39:22.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.583+0000 7fbb466a9640 1 -- 172.21.15.5:0/170869308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb40105120 msgr2=0x7fbb4019c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:22.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.583+0000 7fbb466a9640 1 --2- 172.21.15.5:0/170869308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb40105120 0x7fbb4019c9e0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fbb3400e970 tx=0x7fbb3400ee30 comp rx=0 tx=0).stop 2024-08-31T05:39:22.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.583+0000 7fbb466a9640 1 -- 172.21.15.5:0/170869308 shutdown_connections 2024-08-31T05:39:22.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.583+0000 7fbb466a9640 1 --2- 172.21.15.5:0/170869308 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fbb280b4ca0 0x7fbb280b71b0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:22.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.583+0000 7fbb466a9640 1 --2- 172.21.15.5:0/170869308 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb4010dc00 0x7fbb401a1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:22.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.583+0000 7fbb466a9640 1 --2- 172.21.15.5:0/170869308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb40105120 0x7fbb4019c9e0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:22.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.583+0000 7fbb466a9640 1 --2- 172.21.15.5:0/170869308 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb401047d0 0x7fbb4019c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:22.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.583+0000 7fbb466a9640 1 -- 172.21.15.5:0/170869308 >> 172.21.15.5:0/170869308 conn(0x7fbb40079530 msgr2=0x7fbb401033f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:22.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.583+0000 7fbb466a9640 1 -- 172.21.15.5:0/170869308 shutdown_connections 2024-08-31T05:39:22.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:22.584+0000 7fbb466a9640 1 -- 172.21.15.5:0/170869308 wait complete. 2024-08-31T05:39:22.932 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1062107 11.16 MB/sec execute 370 sec latency 24.799 ms 2024-08-31T05:39:23.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:39:22 smithi005 ceph-mon[18602]: pgmap v633: 129 pgs: 129 active+clean; 547 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.5 MiB/s wr, 222 op/s 2024-08-31T05:39:23.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:39:22 smithi070 ceph-mon[22316]: pgmap v633: 129 pgs: 129 active+clean; 547 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.5 MiB/s wr, 222 op/s 2024-08-31T05:39:23.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:39:22 smithi050 ceph-mon[22146]: pgmap v633: 129 pgs: 129 active+clean; 547 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.5 MiB/s wr, 222 op/s 2024-08-31T05:39:23.408 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T05:39:23.408 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T05:39:23.704 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:39:23.932 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1063653 11.14 MB/sec execute 371 sec latency 15.378 ms 2024-08-31T05:39:24.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:24.198+0000 7fca5e19f640 1 -- 172.21.15.5:0/810355234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca581088a0 msgr2=0x7fca5810f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:24.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:24.198+0000 7fca5e19f640 1 --2- 172.21.15.5:0/810355234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca581088a0 0x7fca5810f0d0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fca50009ca0 tx=0x7fca5002a8c0 comp rx=0 tx=0).stop 2024-08-31T05:39:24.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:24.198+0000 7fca5e19f640 1 -- 172.21.15.5:0/810355234 shutdown_connections 2024-08-31T05:39:24.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:24.198+0000 7fca5e19f640 1 --2- 172.21.15.5:0/810355234 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca581088a0 0x7fca5810f0d0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:24.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:24.198+0000 7fca5e19f640 1 --2- 172.21.15.5:0/810355234 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca58107f50 0x7fca58108360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:24.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:24.198+0000 7fca5e19f640 1 --2- 172.21.15.5:0/810355234 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca58102610 0x7fca58102a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:24.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:24.198+0000 7fca5e19f640 1 -- 172.21.15.5:0/810355234 >> 172.21.15.5:0/810355234 conn(0x7fca580fe060 msgr2=0x7fca581004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:24.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:24.198+0000 7fca5e19f640 1 -- 172.21.15.5:0/810355234 shutdown_connections 2024-08-31T05:39:24.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:24.198+0000 7fca5e19f640 1 -- 172.21.15.5:0/810355234 wait complete. 2024-08-31T05:39:24.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:24.198+0000 7fca5e19f640 1 Processor -- start 2024-08-31T05:39:24.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:24.199+0000 7fca5e19f640 1 -- start start 2024-08-31T05:39:24.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:24.199+0000 7fca5e19f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca58102610 0x7fca5819a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:24.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:24.199+0000 7fca5e19f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca58107f50 0x7fca5819a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:24.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:24.199+0000 7fca5e19f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca581088a0 0x7fca5819f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:24.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:24.199+0000 7fca5e19f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fca58113670 con 0x7fca58102610 2024-08-31T05:39:24.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:24.199+0000 7fca5e19f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fca581134f0 con 0x7fca58107f50 2024-08-31T05:39:24.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:24.199+0000 7fca5e19f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fca581137f0 con 0x7fca581088a0 2024-08-31T05:39:24.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:24.199+0000 7fca5d19d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca58102610 0x7fca5819a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:24.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:24.199+0000 7fca5d19d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca58102610 0x7fca5819a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40258/0 (socket says 172.21.15.5:40258) 2024-08-31T05:39:24.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:24.199+0000 7fca5d19d640 1 -- 172.21.15.5:0/163710310 learned_addr learned my addr 172.21.15.5:0/163710310 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:24.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:24.199+0000 7fca5c99c640 1 --2- 172.21.15.5:0/163710310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca58107f50 0x7fca5819a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:24.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:24.199+0000 7fca5d99e640 1 --2- 172.21.15.5:0/163710310 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca581088a0 0x7fca5819f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:24.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:24.199+0000 7fca5d19d640 1 -- 172.21.15.5:0/163710310 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca581088a0 msgr2=0x7fca5819f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:24.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:24.199+0000 7fca5d19d640 1 --2- 172.21.15.5:0/163710310 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca581088a0 0x7fca5819f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:24.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:24.199+0000 7fca5d19d640 1 -- 172.21.15.5:0/163710310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca58107f50 msgr2=0x7fca5819a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:24.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:24.199+0000 7fca5d19d640 1 --2- 172.21.15.5:0/163710310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca58107f50 0x7fca5819a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:24.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:24.199+0000 7fca5d19d640 1 -- 172.21.15.5:0/163710310 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca5819ff90 con 0x7fca58102610 2024-08-31T05:39:24.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:24.199+0000 7fca5d19d640 1 --2- 172.21.15.5:0/163710310 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca58102610 0x7fca5819a020 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fca5400e9f0 tx=0x7fca5400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:24.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:24.200+0000 7fca4e7fc640 1 -- 172.21.15.5:0/163710310 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca5400cd80 con 0x7fca58102610 2024-08-31T05:39:24.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:24.200+0000 7fca5e19f640 1 -- 172.21.15.5:0/163710310 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca581a0280 con 0x7fca58102610 2024-08-31T05:39:24.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:24.200+0000 7fca4e7fc640 1 -- 172.21.15.5:0/163710310 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca540108e0 con 0x7fca58102610 2024-08-31T05:39:24.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:24.200+0000 7fca4e7fc640 1 -- 172.21.15.5:0/163710310 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca54018980 con 0x7fca58102610 2024-08-31T05:39:24.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:24.200+0000 7fca5e19f640 1 -- 172.21.15.5:0/163710310 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca581a69e0 con 0x7fca58102610 2024-08-31T05:39:24.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:24.201+0000 7fca5e19f640 1 -- 172.21.15.5:0/163710310 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca58102a20 con 0x7fca58102610 2024-08-31T05:39:24.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:24.202+0000 7fca4e7fc640 1 -- 172.21.15.5:0/163710310 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fca54010430 con 0x7fca58102610 2024-08-31T05:39:24.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:24.203+0000 7fca4e7fc640 1 --2- 172.21.15.5:0/163710310 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fca440b4ca0 0x7fca440b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:24.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:24.203+0000 7fca5c99c640 1 --2- 172.21.15.5:0/163710310 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fca440b4ca0 0x7fca440b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:24.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:24.203+0000 7fca4e7fc640 1 -- 172.21.15.5:0/163710310 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7fca540e60d0 con 0x7fca58102610 2024-08-31T05:39:24.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:24.204+0000 7fca5c99c640 1 --2- 172.21.15.5:0/163710310 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fca440b4ca0 0x7fca440b71b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fca58107a80 tx=0x7fca48005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:24.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:24.206+0000 7fca4e7fc640 1 -- 172.21.15.5:0/163710310 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fca540ac490 con 0x7fca58102610 2024-08-31T05:39:24.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:24.456+0000 7fca5e19f640 1 -- 172.21.15.5:0/163710310 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fca5802e430 con 0x7fca58102610 2024-08-31T05:39:24.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:24.456+0000 7fca4e7fc640 1 -- 172.21.15.5:0/163710310 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11941 (secure 0 0 0) 0x7fca540b0c50 con 0x7fca58102610 2024-08-31T05:39:24.459 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:39:24.459 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":34,"btime":"2024-08-31T05:33:43:289944+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14739,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2024812199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2024812199},{"type":"v1","addr":"172.21.15.5:6835","nonce":2024812199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3629023702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3629023702},{"type":"v1","addr":"172.21.15.5:6837","nonce":3629023702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T05:27:31.929153+0000","modified":"2024-08-31T05:33:42.378207+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24652,"mds_1":24638,"mds_2":24631,"mds_3":24625,"mds_4":24602},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6839/2412701258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":2412701258},{"type":"v1","addr":"172.21.15.5:6839","nonce":2412701258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14820":{"gid":14820,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6841/747057838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":747057838},{"type":"v1","addr":"172.21.15.5:6841","nonce":747057838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6833/1153378982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1153378982},{"type":"v1","addr":"172.21.15.50:6833","nonce":1153378982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6833/364083443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":364083443},{"type":"v1","addr":"172.21.15.70:6833","nonce":364083443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24587":{"gid":24587,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/2346896794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2346896794},{"type":"v1","addr":"172.21.15.50:6835","nonce":2346896794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24602":{"gid":24602,"name":"h","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.50:6837/428759669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":428759669},{"type":"v1","addr":"172.21.15.50:6837","nonce":428759669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.70:6835/2061504114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2061504114},{"type":"v1","addr":"172.21.15.70:6835","nonce":2061504114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.70:6837/2780036414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2780036414},{"type":"v1","addr":"172.21.15.70:6837","nonce":2780036414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.50:6839/98200944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":98200944},{"type":"v1","addr":"172.21.15.50:6839","nonce":98200944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24652":{"gid":24652,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.70:6839/2756569250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":2756569250},{"type":"v1","addr":"172.21.15.70:6839","nonce":2756569250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24652,"qdb_cluster":[24652,24631,24638,24625,24602]},"id":1}]} 2024-08-31T05:39:24.459 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 34 2024-08-31T05:39:24.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:24.459+0000 7fca5e19f640 1 -- 172.21.15.5:0/163710310 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fca440b4ca0 msgr2=0x7fca440b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:24.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:24.459+0000 7fca5e19f640 1 --2- 172.21.15.5:0/163710310 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fca440b4ca0 0x7fca440b71b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fca58107a80 tx=0x7fca48005f90 comp rx=0 tx=0).stop 2024-08-31T05:39:24.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:24.459+0000 7fca5e19f640 1 -- 172.21.15.5:0/163710310 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca58102610 msgr2=0x7fca5819a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:24.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:24.459+0000 7fca5e19f640 1 --2- 172.21.15.5:0/163710310 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca58102610 0x7fca5819a020 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fca5400e9f0 tx=0x7fca5400eeb0 comp rx=0 tx=0).stop 2024-08-31T05:39:24.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:24.459+0000 7fca5e19f640 1 -- 172.21.15.5:0/163710310 shutdown_connections 2024-08-31T05:39:24.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:24.459+0000 7fca5e19f640 1 --2- 172.21.15.5:0/163710310 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fca440b4ca0 0x7fca440b71b0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:24.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:24.459+0000 7fca5e19f640 1 --2- 172.21.15.5:0/163710310 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca581088a0 0x7fca5819f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:24.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:24.459+0000 7fca5e19f640 1 --2- 172.21.15.5:0/163710310 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fca58107f50 0x7fca5819a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:24.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:24.459+0000 7fca5e19f640 1 --2- 172.21.15.5:0/163710310 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fca58102610 0x7fca5819a020 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:24.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:24.459+0000 7fca5e19f640 1 -- 172.21.15.5:0/163710310 >> 172.21.15.5:0/163710310 conn(0x7fca580fe060 msgr2=0x7fca58100480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:24.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:24.459+0000 7fca5e19f640 1 -- 172.21.15.5:0/163710310 shutdown_connections 2024-08-31T05:39:24.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:24.459+0000 7fca5e19f640 1 -- 172.21.15.5:0/163710310 wait complete. 2024-08-31T05:39:24.932 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1066065 11.15 MB/sec execute 372 sec latency 27.097 ms 2024-08-31T05:39:25.098 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:39:24 smithi005 ceph-mon[18602]: pgmap v634: 129 pgs: 129 active+clean; 551 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.5 MiB/s wr, 225 op/s 2024-08-31T05:39:25.098 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:39:24 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/163710310' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:39:25.128 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-31T05:39:25.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:39:24 smithi070 ceph-mon[22316]: pgmap v634: 129 pgs: 129 active+clean; 551 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.5 MiB/s wr, 225 op/s 2024-08-31T05:39:25.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:39:24 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/163710310' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:39:25.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:39:24 smithi050 ceph-mon[22146]: pgmap v634: 129 pgs: 129 active+clean; 551 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.5 MiB/s wr, 225 op/s 2024-08-31T05:39:25.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:39:24 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/163710310' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:39:25.479 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:39:25.933 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1067297 11.14 MB/sec execute 373 sec latency 158.654 ms 2024-08-31T05:39:26.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.080+0000 7f3f37479640 1 -- 172.21.15.5:0/782885538 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f30108140 msgr2=0x7f3f30108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:26.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.080+0000 7f3f37479640 1 --2- 172.21.15.5:0/782885538 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f30108140 0x7f3f30108550 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f3f20009900 tx=0x7f3f2002a410 comp rx=0 tx=0).stop 2024-08-31T05:39:26.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.080+0000 7f3f37479640 1 -- 172.21.15.5:0/782885538 shutdown_connections 2024-08-31T05:39:26.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.080+0000 7f3f37479640 1 --2- 172.21.15.5:0/782885538 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f30108a90 0x7f3f3010f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:26.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.080+0000 7f3f37479640 1 --2- 172.21.15.5:0/782885538 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f30108140 0x7f3f30108550 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:26.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.080+0000 7f3f37479640 1 --2- 172.21.15.5:0/782885538 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f30102800 0x7f3f30102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:26.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.080+0000 7f3f37479640 1 -- 172.21.15.5:0/782885538 >> 172.21.15.5:0/782885538 conn(0x7f3f300794d0 msgr2=0x7f3f300798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:26.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.080+0000 7f3f37479640 1 -- 172.21.15.5:0/782885538 shutdown_connections 2024-08-31T05:39:26.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.080+0000 7f3f37479640 1 -- 172.21.15.5:0/782885538 wait complete. 2024-08-31T05:39:26.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.081+0000 7f3f37479640 1 Processor -- start 2024-08-31T05:39:26.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.081+0000 7f3f37479640 1 -- start start 2024-08-31T05:39:26.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.081+0000 7f3f37479640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f30102800 0x7f3f30104e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:26.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.081+0000 7f3f37479640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f30108140 0x7f3f301053c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:26.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.081+0000 7f3f37479640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f30108a90 0x7f3f30105900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:26.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.081+0000 7f3f37479640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3f301126e0 con 0x7f3f30102800 2024-08-31T05:39:26.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.081+0000 7f3f37479640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3f30112560 con 0x7f3f30108140 2024-08-31T05:39:26.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.081+0000 7f3f37479640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3f30112860 con 0x7f3f30108a90 2024-08-31T05:39:26.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.081+0000 7f3f35215640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f30102800 0x7f3f30104e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:26.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.081+0000 7f3f35215640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f30102800 0x7f3f30104e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40276/0 (socket says 172.21.15.5:40276) 2024-08-31T05:39:26.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.081+0000 7f3f35215640 1 -- 172.21.15.5:0/3540534815 learned_addr learned my addr 172.21.15.5:0/3540534815 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:26.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.081+0000 7f3f34a14640 1 --2- 172.21.15.5:0/3540534815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f30108140 0x7f3f301053c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:26.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.081+0000 7f3f35a16640 1 --2- 172.21.15.5:0/3540534815 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f30108a90 0x7f3f30105900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:26.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.082+0000 7f3f35215640 1 -- 172.21.15.5:0/3540534815 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f30108a90 msgr2=0x7f3f30105900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:26.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.082+0000 7f3f35215640 1 --2- 172.21.15.5:0/3540534815 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f30108a90 0x7f3f30105900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:26.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.082+0000 7f3f35215640 1 -- 172.21.15.5:0/3540534815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f30108140 msgr2=0x7f3f301053c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:26.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.082+0000 7f3f35215640 1 --2- 172.21.15.5:0/3540534815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f30108140 0x7f3f301053c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:26.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.082+0000 7f3f35215640 1 -- 172.21.15.5:0/3540534815 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f301a8530 con 0x7f3f30102800 2024-08-31T05:39:26.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.082+0000 7f3f35215640 1 --2- 172.21.15.5:0/3540534815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f30102800 0x7f3f30104e80 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c00e9f0 tx=0x7f3f2c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:26.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.082+0000 7f3f267fc640 1 -- 172.21.15.5:0/3540534815 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c00cd80 con 0x7f3f30102800 2024-08-31T05:39:26.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.082+0000 7f3f267fc640 1 -- 172.21.15.5:0/3540534815 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f2c0054d0 con 0x7f3f30102800 2024-08-31T05:39:26.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.082+0000 7f3f37479640 1 -- 172.21.15.5:0/3540534815 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f301a8820 con 0x7f3f30102800 2024-08-31T05:39:26.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.082+0000 7f3f267fc640 1 -- 172.21.15.5:0/3540534815 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c010690 con 0x7f3f30102800 2024-08-31T05:39:26.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.082+0000 7f3f37479640 1 -- 172.21.15.5:0/3540534815 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f301a8d30 con 0x7f3f30102800 2024-08-31T05:39:26.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.085+0000 7f3f3d9ee740 1 Processor -- start 2024-08-31T05:39:26.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.085+0000 7f3f3d9ee740 1 -- start start 2024-08-31T05:39:26.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.085+0000 7f3f267fc640 1 -- 172.21.15.5:0/3540534815 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f3f2c004e90 con 0x7f3f30102800 2024-08-31T05:39:26.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.086+0000 7f3f3d9ee740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5598f1e8e070 0x5598f2233310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:26.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.086+0000 7f3f3d9ee740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598f1e651b0 0x5598f2233850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:26.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.086+0000 7f3f3d9ee740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5598f1e6d390 0x5598f2233d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:26.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.086+0000 7f3f3d9ee740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5598f21aa680 con 0x5598f1e6d390 2024-08-31T05:39:26.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.086+0000 7f3f3d9ee740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5598f2199c10 con 0x5598f1e8e070 2024-08-31T05:39:26.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.086+0000 7f3f3d9ee740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5598f219dbc0 con 0x5598f1e651b0 2024-08-31T05:39:26.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.086+0000 7f3f35215640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598f1e651b0 0x5598f2233850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:26.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.086+0000 7f3f35a16640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5598f1e8e070 0x5598f2233310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:26.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.086+0000 7f3f35a16640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5598f1e8e070 0x5598f2233310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:52582/0 (socket says 172.21.15.5:52582) 2024-08-31T05:39:26.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.086+0000 7f3f34a14640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5598f1e6d390 0x5598f2233d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:26.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.086+0000 7f3f35a16640 1 -- 172.21.15.5:0/406494682 learned_addr learned my addr 172.21.15.5:0/406494682 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:26.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.086+0000 7f3f35215640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598f1e651b0 0x5598f2233850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:52018/0 (socket says 172.21.15.5:52018) 2024-08-31T05:39:26.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.086+0000 7f3f35a16640 1 -- 172.21.15.5:0/406494682 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598f1e651b0 msgr2=0x5598f2233850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:26.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.086+0000 7f3f35a16640 1 --2- 172.21.15.5:0/406494682 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598f1e651b0 0x5598f2233850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:26.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.086+0000 7f3f35a16640 1 -- 172.21.15.5:0/406494682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5598f1e6d390 msgr2=0x5598f2233d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:26.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.086+0000 7f3f35a16640 1 --2- 172.21.15.5:0/406494682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5598f1e6d390 0x5598f2233d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:26.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.086+0000 7f3f35a16640 1 -- 172.21.15.5:0/406494682 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598f1ef9650 con 0x5598f1e8e070 2024-08-31T05:39:26.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.086+0000 7f3f35a16640 1 --2- 172.21.15.5:0/406494682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5598f1e8e070 0x5598f2233310 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3f28009f50 tx=0x7f3f280118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e7581a56f4f8b3c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:26.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.086+0000 7f3f267fc640 1 --2- 172.21.15.5:0/3540534815 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f3f1c0b4d20 0x7f3f1c0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:26.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.087+0000 7f3f1b7fe640 1 -- 172.21.15.5:0/406494682 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f28004d20 con 0x5598f1e8e070 2024-08-31T05:39:26.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.087+0000 7f3f35215640 1 --2- 172.21.15.5:0/3540534815 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f3f1c0b4d20 0x7f3f1c0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:26.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.087+0000 7f3f1b7fe640 1 -- 172.21.15.5:0/406494682 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f28004050 con 0x5598f1e8e070 2024-08-31T05:39:26.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.087+0000 7f3f1b7fe640 1 -- 172.21.15.5:0/406494682 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f28005280 con 0x5598f1e8e070 2024-08-31T05:39:26.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.087+0000 7f3f267fc640 1 -- 172.21.15.5:0/3540534815 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7f3f2c0e5ce0 con 0x7f3f30102800 2024-08-31T05:39:26.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.088+0000 7f3f3d9ee740 1 -- 172.21.15.5:0/406494682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5598f1e8e070 msgr2=0x5598f2233310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:26.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.088+0000 7f3f35215640 1 --2- 172.21.15.5:0/3540534815 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f3f1c0b4d20 0x7f3f1c0b7230 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c0e3100 tx=0x7f3f2c0e9830 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:26.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.088+0000 7f3f3d9ee740 1 --2- 172.21.15.5:0/406494682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5598f1e8e070 0x5598f2233310 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3f28009f50 tx=0x7f3f280118d0 comp rx=0 tx=0).stop 2024-08-31T05:39:26.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.088+0000 7f3f3d9ee740 1 -- 172.21.15.5:0/406494682 shutdown_connections 2024-08-31T05:39:26.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.088+0000 7f3f3d9ee740 1 --2- 172.21.15.5:0/406494682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5598f1e6d390 0x5598f2233d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:26.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.088+0000 7f3f3d9ee740 1 --2- 172.21.15.5:0/406494682 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598f1e651b0 0x5598f2233850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:26.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.088+0000 7f3f3d9ee740 1 --2- 172.21.15.5:0/406494682 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5598f1e8e070 0x5598f2233310 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:26.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.088+0000 7f3f3d9ee740 1 -- 172.21.15.5:0/406494682 >> 172.21.15.5:0/406494682 conn(0x5598f1e82460 msgr2=0x5598f2231200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:26.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.088+0000 7f3f3d9ee740 1 -- 172.21.15.5:0/406494682 shutdown_connections 2024-08-31T05:39:26.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.088+0000 7f3f3d9ee740 1 -- 172.21.15.5:0/406494682 wait complete. 2024-08-31T05:39:26.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.088+0000 7f3f3d9ee740 1 -- start start 2024-08-31T05:39:26.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.088+0000 7f3f3d9ee740 1 Processor -- start 2024-08-31T05:39:26.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.089+0000 7f3f3d9ee740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5598f1e651b0 0x5598f223eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:26.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.089+0000 7f3f3d9ee740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598f1e6d390 0x5598f223f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:26.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.089+0000 7f3f3d9ee740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5598f1e8e070 0x5598f224ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:26.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.089+0000 7f3f3d9ee740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5598f1ffc700 con 0x5598f1e8e070 2024-08-31T05:39:26.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.089+0000 7f3f3d9ee740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5598f2120750 con 0x5598f1e651b0 2024-08-31T05:39:26.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.089+0000 7f3f3d9ee740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5598f2241af0 con 0x5598f1e6d390 2024-08-31T05:39:26.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.089+0000 7f3f3d9ee740 10 client.0 _ll_register_callbacks cb 0x5598f214fe10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:39:26.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.089+0000 7f3f35a16640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5598f1e651b0 0x5598f223eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:26.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.089+0000 7f3f34a14640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598f1e6d390 0x5598f223f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:26.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.089+0000 7f3f35a16640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5598f1e651b0 0x5598f223eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:52590/0 (socket says 172.21.15.5:52590) 2024-08-31T05:39:26.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.089+0000 7f3f34a14640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598f1e6d390 0x5598f223f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:52024/0 (socket says 172.21.15.5:52024) 2024-08-31T05:39:26.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.089+0000 7f3f35a16640 1 -- 172.21.15.5:0/1899488028 learned_addr learned my addr 172.21.15.5:0/1899488028 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:26.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.089+0000 7f3f35a16640 1 --2- 172.21.15.5:0/1899488028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5598f1e8e070 0x5598f224ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:26.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.091+0000 7f3f35a16640 1 -- 172.21.15.5:0/1899488028 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598f1e6d390 msgr2=0x5598f223f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:26.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.091+0000 7f3f35a16640 1 --2- 172.21.15.5:0/1899488028 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598f1e6d390 0x5598f223f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:26.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.091+0000 7f3f35a16640 1 -- 172.21.15.5:0/1899488028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5598f1e8e070 msgr2=0x5598f224ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:26.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.091+0000 7f3f35a16640 1 --2- 172.21.15.5:0/1899488028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5598f1e8e070 0x5598f224ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:26.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.091+0000 7f3f35a16640 1 -- 172.21.15.5:0/1899488028 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598f2159900 con 0x5598f1e651b0 2024-08-31T05:39:26.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.091+0000 7f3f34a14640 1 --2- 172.21.15.5:0/1899488028 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598f1e6d390 0x5598f223f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:39:26.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.091+0000 7f3f35a16640 1 --2- 172.21.15.5:0/1899488028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5598f1e651b0 0x5598f223eaf0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3f28003fd0 tx=0x7f3f28004950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4d139d95518d2a1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:26.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.091+0000 7f3f18ff9640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:39:26.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.091+0000 7f3f18ff9640 1 -- 172.21.15.5:0/1899488028 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f28004a00 con 0x5598f1e651b0 2024-08-31T05:39:26.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.091+0000 7f3f18ff9640 1 -- 172.21.15.5:0/1899488028 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7f3f28004ba0 con 0x5598f1e651b0 2024-08-31T05:39:26.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.091+0000 7f3f3d9ee740 1 -- 172.21.15.5:0/1899488028 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f28004050 con 0x5598f1e651b0 2024-08-31T05:39:26.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.091+0000 7f3f18ff9640 1 -- 172.21.15.5:0/1899488028 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f3f28036050 con 0x5598f1e651b0 2024-08-31T05:39:26.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.091+0000 7f3f3d9ee740 10 client.27641 fetch_fsmap learned FSMap version 34 2024-08-31T05:39:26.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.091+0000 7f3f3d9ee740 1 -- 172.21.15.5:0/1899488028 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5598f224d930 con 0x5598f1e651b0 2024-08-31T05:39:26.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.092+0000 7f3f18ff9640 1 -- 172.21.15.5:0/1899488028 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f2802d070 con 0x5598f1e651b0 2024-08-31T05:39:26.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.092+0000 7f3f18ff9640 1 -- 172.21.15.5:0/1899488028 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f3f2800f480 con 0x5598f1e651b0 2024-08-31T05:39:26.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.092+0000 7f3f3d9ee740 10 client.27641 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:39:26.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.092+0000 7f3f3d9ee740 10 client.27641 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-31T05:39:26.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.092+0000 7f3f3d9ee740 20 client.27641 populate_metadata read hostname 'smithi005' 2024-08-31T05:39:26.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.092+0000 7f3f3d9ee740 1 --2- 172.21.15.5:0/1899488028 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x5598f1e4c9f0 0x5598f2250da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:26.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.092+0000 7f3f3d9ee740 4 client.27641 mds_command: new command op to 24602 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:39:26.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.092+0000 7f3f3d9ee740 1 -- 172.21.15.5:0/1899488028 --> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f3f28004050 con 0x5598f1e4c9f0 2024-08-31T05:39:26.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.092+0000 7f3f34a14640 1 --2- 172.21.15.5:0/1899488028 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x5598f1e4c9f0 0x5598f2250da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:26.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.093+0000 7f3f18ff9640 10 client.27641 ms_handle_connect on v2:172.21.15.50:6836/428759669 2024-08-31T05:39:26.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.093+0000 7f3f34a14640 1 --2- 172.21.15.5:0/1899488028 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x5598f1e4c9f0 0x5598f2250da0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=4bb8598e391ee150 server_cookie=2ac9ae9892a530c5 in_seq=0 out_seq=0 2024-08-31T05:39:26.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.094+0000 7f3f18ff9640 1 -- 172.21.15.5:0/1899488028 <== mds.4 v2:172.21.15.50:6836/428759669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f3f28004050 con 0x5598f1e4c9f0 2024-08-31T05:39:26.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.094+0000 7f3f18ff9640 10 client.27641 handle_command_reply: tid=0 2024-08-31T05:39:26.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.094+0000 7f3f3d9ee740 1 client.27641 shutdown 2024-08-31T05:39:26.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.094+0000 7f3f3d9ee740 1 -- 172.21.15.5:0/1899488028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5598f1e651b0 msgr2=0x5598f223eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:26.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.094+0000 7f3f3d9ee740 1 --2- 172.21.15.5:0/1899488028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5598f1e651b0 0x5598f223eaf0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3f28003fd0 tx=0x7f3f28004950 comp rx=0 tx=0).stop 2024-08-31T05:39:26.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.094+0000 7f3f3d9ee740 1 -- 172.21.15.5:0/1899488028 shutdown_connections 2024-08-31T05:39:26.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.094+0000 7f3f3d9ee740 1 --2- 172.21.15.5:0/1899488028 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x5598f1e4c9f0 0x5598f2250da0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:26.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.094+0000 7f3f3d9ee740 1 --2- 172.21.15.5:0/1899488028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5598f1e8e070 0x5598f224ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:26.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.094+0000 7f3f3d9ee740 1 --2- 172.21.15.5:0/1899488028 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598f1e6d390 0x5598f223f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:26.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.094+0000 7f3f18ff9640 0 client.27641 ms_handle_reset on v2:172.21.15.50:6836/428759669 2024-08-31T05:39:26.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.094+0000 7f3f3d9ee740 1 --2- 172.21.15.5:0/1899488028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5598f1e651b0 0x5598f223eaf0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:26.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.094+0000 7f3f3d9ee740 1 -- 172.21.15.5:0/1899488028 >> 172.21.15.5:0/1899488028 conn(0x5598f1e82460 msgr2=0x5598f22364f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:26.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.094+0000 7f3f3d9ee740 1 -- 172.21.15.5:0/1899488028 shutdown_connections 2024-08-31T05:39:26.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.094+0000 7f3f3d9ee740 1 -- 172.21.15.5:0/1899488028 wait complete. 2024-08-31T05:39:26.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.094+0000 7f3f3d9ee740 20 client.27641 trim_cache size 0 max 16384 2024-08-31T05:39:26.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.109+0000 7f3f3d9ee740 1 Processor -- start 2024-08-31T05:39:26.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.109+0000 7f3f3d9ee740 1 -- start start 2024-08-31T05:39:26.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.109+0000 7f3f3d9ee740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5598f1e4c9f0 0x5598f223efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:26.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.109+0000 7f3f3d9ee740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5598f1e651b0 0x5598f2236410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:26.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.109+0000 7f3f3d9ee740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598f1e6d390 0x5598f2236950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:26.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.109+0000 7f3f3d9ee740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3f301b2ef0 con 0x5598f1e4c9f0 2024-08-31T05:39:26.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.109+0000 7f3f3d9ee740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3f301b4a30 con 0x5598f1e651b0 2024-08-31T05:39:26.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.109+0000 7f3f3d9ee740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3f301b35c0 con 0x5598f1e6d390 2024-08-31T05:39:26.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.109+0000 7f3f35a16640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5598f1e4c9f0 0x5598f223efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:26.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.109+0000 7f3f35a16640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5598f1e4c9f0 0x5598f223efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40318/0 (socket says 172.21.15.5:40318) 2024-08-31T05:39:26.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.109+0000 7f3f35a16640 1 -- 172.21.15.5:0/195184270 learned_addr learned my addr 172.21.15.5:0/195184270 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:26.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.109+0000 7f3f34a14640 1 --2- 172.21.15.5:0/195184270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5598f1e651b0 0x5598f2236410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:26.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.110+0000 7f3f35a16640 1 --2- 172.21.15.5:0/195184270 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598f1e6d390 0x5598f2236950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:26.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.110+0000 7f3f35a16640 1 -- 172.21.15.5:0/195184270 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598f1e6d390 msgr2=0x5598f2236950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:26.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.110+0000 7f3f35a16640 1 --2- 172.21.15.5:0/195184270 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598f1e6d390 0x5598f2236950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:26.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.110+0000 7f3f35a16640 1 -- 172.21.15.5:0/195184270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5598f1e651b0 msgr2=0x5598f2236410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:26.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.110+0000 7f3f35a16640 1 --2- 172.21.15.5:0/195184270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5598f1e651b0 0x5598f2236410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:26.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.110+0000 7f3f35a16640 1 -- 172.21.15.5:0/195184270 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598f222c5a0 con 0x5598f1e4c9f0 2024-08-31T05:39:26.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.110+0000 7f3f34a14640 1 --2- 172.21.15.5:0/195184270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5598f1e651b0 0x5598f2236410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:39:26.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.110+0000 7f3f35a16640 1 --2- 172.21.15.5:0/195184270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5598f1e4c9f0 0x5598f223efb0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f3f28005d70 tx=0x7f3f280096c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=174de6929981f767 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:26.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.110+0000 7f3f1affd640 1 -- 172.21.15.5:0/195184270 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f28004000 con 0x5598f1e4c9f0 2024-08-31T05:39:26.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.110+0000 7f3f1affd640 1 -- 172.21.15.5:0/195184270 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f2802d070 con 0x5598f1e4c9f0 2024-08-31T05:39:26.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.110+0000 7f3f1affd640 1 -- 172.21.15.5:0/195184270 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f2800f480 con 0x5598f1e4c9f0 2024-08-31T05:39:26.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.111+0000 7f3f3d9ee740 1 -- 172.21.15.5:0/195184270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5598f1e4c9f0 msgr2=0x5598f223efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:26.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.111+0000 7f3f3d9ee740 1 --2- 172.21.15.5:0/195184270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5598f1e4c9f0 0x5598f223efb0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f3f28005d70 tx=0x7f3f280096c0 comp rx=0 tx=0).stop 2024-08-31T05:39:26.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.111+0000 7f3f3d9ee740 1 -- 172.21.15.5:0/195184270 shutdown_connections 2024-08-31T05:39:26.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.111+0000 7f3f3d9ee740 1 --2- 172.21.15.5:0/195184270 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598f1e6d390 0x5598f2236950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:26.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.111+0000 7f3f3d9ee740 1 --2- 172.21.15.5:0/195184270 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5598f1e651b0 0x5598f2236410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:26.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.111+0000 7f3f3d9ee740 1 --2- 172.21.15.5:0/195184270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5598f1e4c9f0 0x5598f223efb0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:26.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.111+0000 7f3f3d9ee740 1 -- 172.21.15.5:0/195184270 >> 172.21.15.5:0/195184270 conn(0x5598f1e82460 msgr2=0x5598f223e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:26.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.111+0000 7f3f3d9ee740 1 -- 172.21.15.5:0/195184270 shutdown_connections 2024-08-31T05:39:26.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.111+0000 7f3f3d9ee740 1 -- 172.21.15.5:0/195184270 wait complete. 2024-08-31T05:39:26.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.112+0000 7f3f3d9ee740 1 -- start start 2024-08-31T05:39:26.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.112+0000 7f3f3d9ee740 1 Processor -- start 2024-08-31T05:39:26.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.112+0000 7f3f3d9ee740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5598f1e4c9f0 0x5598f2242d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:26.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.112+0000 7f3f3d9ee740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598f1e651b0 0x5598f22432c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:26.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.112+0000 7f3f3d9ee740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5598f1e6d390 0x5598f2243800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:26.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.112+0000 7f3f3d9ee740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3f301b4360 con 0x5598f1e4c9f0 2024-08-31T05:39:26.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.112+0000 7f3f3d9ee740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3f301b3c90 con 0x5598f1e6d390 2024-08-31T05:39:26.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.112+0000 7f3f3d9ee740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3f301b0ef0 con 0x5598f1e651b0 2024-08-31T05:39:26.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.112+0000 7f3f3d9ee740 10 client.0 _ll_register_callbacks cb 0x7f3f2c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:39:26.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.112+0000 7f3f35a16640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5598f1e4c9f0 0x5598f2242d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:26.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.112+0000 7f3f35a16640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5598f1e4c9f0 0x5598f2242d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40320/0 (socket says 172.21.15.5:40320) 2024-08-31T05:39:26.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.112+0000 7f3f35a16640 1 -- 172.21.15.5:0/3526764837 learned_addr learned my addr 172.21.15.5:0/3526764837 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:26.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.112+0000 7f3f34a14640 1 --2- 172.21.15.5:0/3526764837 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598f1e651b0 0x5598f22432c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:26.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.113+0000 7f3f35a16640 1 --2- 172.21.15.5:0/3526764837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5598f1e6d390 0x5598f2243800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:26.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.113+0000 7f3f35a16640 1 -- 172.21.15.5:0/3526764837 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598f1e651b0 msgr2=0x5598f22432c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:26.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.113+0000 7f3f35a16640 1 --2- 172.21.15.5:0/3526764837 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598f1e651b0 0x5598f22432c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:26.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.113+0000 7f3f35a16640 1 -- 172.21.15.5:0/3526764837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5598f1e6d390 msgr2=0x5598f2243800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:26.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.113+0000 7f3f35a16640 1 --2- 172.21.15.5:0/3526764837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5598f1e6d390 0x5598f2243800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:26.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.113+0000 7f3f35a16640 1 -- 172.21.15.5:0/3526764837 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598f22ba650 con 0x5598f1e4c9f0 2024-08-31T05:39:26.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.113+0000 7f3f35a16640 1 --2- 172.21.15.5:0/3526764837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5598f1e4c9f0 0x5598f2242d80 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f3f28009b00 tx=0x7f3f28009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fb6faf2ad4ff9f6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:26.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.113+0000 7f3f18ff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:39:26.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.113+0000 7f3f18ff9640 1 -- 172.21.15.5:0/3526764837 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f2800f680 con 0x5598f1e4c9f0 2024-08-31T05:39:26.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.113+0000 7f3f18ff9640 1 -- 172.21.15.5:0/3526764837 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7f3f2800fac0 con 0x5598f1e4c9f0 2024-08-31T05:39:26.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.113+0000 7f3f3d9ee740 1 -- 172.21.15.5:0/3526764837 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f2802d070 con 0x5598f1e4c9f0 2024-08-31T05:39:26.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.114+0000 7f3f18ff9640 1 -- 172.21.15.5:0/3526764837 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f3f2800fce0 con 0x5598f1e4c9f0 2024-08-31T05:39:26.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.114+0000 7f3f3d9ee740 10 client.18069 fetch_fsmap learned FSMap version 34 2024-08-31T05:39:26.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.114+0000 7f3f3d9ee740 1 -- 172.21.15.5:0/3526764837 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5598f22bb8b0 con 0x5598f1e4c9f0 2024-08-31T05:39:26.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.114+0000 7f3f18ff9640 1 -- 172.21.15.5:0/3526764837 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f2802d070 con 0x5598f1e4c9f0 2024-08-31T05:39:26.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.114+0000 7f3f18ff9640 1 -- 172.21.15.5:0/3526764837 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f3f28028890 con 0x5598f1e4c9f0 2024-08-31T05:39:26.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.114+0000 7f3f3d9ee740 10 client.18069 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:39:26.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.114+0000 7f3f3d9ee740 10 client.18069 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-31T05:39:26.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.114+0000 7f3f3d9ee740 20 client.18069 populate_metadata read hostname 'smithi005' 2024-08-31T05:39:26.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.114+0000 7f3f3d9ee740 1 --2- 172.21.15.5:0/3526764837 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x5598f1e8e070 0x5598f22bdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:26.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.114+0000 7f3f3d9ee740 4 client.18069 mds_command: new command op to 24602 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:39:26.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.114+0000 7f3f3d9ee740 1 -- 172.21.15.5:0/3526764837 --> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5598f21ac5d0 con 0x5598f1e8e070 2024-08-31T05:39:26.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.115+0000 7f3f34a14640 1 --2- 172.21.15.5:0/3526764837 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x5598f1e8e070 0x5598f22bdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:26.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.115+0000 7f3f18ff9640 10 client.18069 ms_handle_connect on v2:172.21.15.50:6836/428759669 2024-08-31T05:39:26.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.115+0000 7f3f34a14640 1 --2- 172.21.15.5:0/3526764837 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x5598f1e8e070 0x5598f22bdeb0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=758d3d5141383c2 server_cookie=6534b2f738d525f in_seq=0 out_seq=0 2024-08-31T05:39:26.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.115+0000 7f3f18ff9640 1 -- 172.21.15.5:0/3526764837 <== mds.4 v2:172.21.15.50:6836/428759669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5598f21ac5d0 con 0x5598f1e8e070 2024-08-31T05:39:26.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.115+0000 7f3f18ff9640 10 client.18069 handle_command_reply: tid=0 2024-08-31T05:39:26.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.115+0000 7f3f3d9ee740 1 client.18069 shutdown 2024-08-31T05:39:26.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.115+0000 7f3f3d9ee740 1 -- 172.21.15.5:0/3526764837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5598f1e4c9f0 msgr2=0x5598f2242d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:26.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.115+0000 7f3f3d9ee740 1 --2- 172.21.15.5:0/3526764837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5598f1e4c9f0 0x5598f2242d80 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f3f28009b00 tx=0x7f3f28009a50 comp rx=0 tx=0).stop 2024-08-31T05:39:26.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.116+0000 7f3f3d9ee740 1 -- 172.21.15.5:0/3526764837 shutdown_connections 2024-08-31T05:39:26.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.116+0000 7f3f3d9ee740 1 --2- 172.21.15.5:0/3526764837 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x5598f1e8e070 0x5598f22bdeb0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:26.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.116+0000 7f3f18ff9640 0 client.18069 ms_handle_reset on v2:172.21.15.50:6836/428759669 2024-08-31T05:39:26.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.116+0000 7f3f3d9ee740 1 --2- 172.21.15.5:0/3526764837 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5598f1e6d390 0x5598f2243800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:26.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.116+0000 7f3f3d9ee740 1 --2- 172.21.15.5:0/3526764837 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5598f1e651b0 0x5598f22432c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:26.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.116+0000 7f3f3d9ee740 1 --2- 172.21.15.5:0/3526764837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5598f1e4c9f0 0x5598f2242d80 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:26.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.116+0000 7f3f3d9ee740 1 -- 172.21.15.5:0/3526764837 >> 172.21.15.5:0/3526764837 conn(0x5598f1e82460 msgr2=0x5598f2236410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:26.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.116+0000 7f3f3d9ee740 1 -- 172.21.15.5:0/3526764837 shutdown_connections 2024-08-31T05:39:26.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.116+0000 7f3f3d9ee740 1 -- 172.21.15.5:0/3526764837 wait complete. 2024-08-31T05:39:26.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.116+0000 7f3f3d9ee740 20 client.18069 trim_cache size 0 max 16384 2024-08-31T05:39:26.122 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:39:26.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.117+0000 7f3f37479640 1 -- 172.21.15.5:0/3540534815 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f3f1c0b4d20 msgr2=0x7f3f1c0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:26.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.117+0000 7f3f37479640 1 --2- 172.21.15.5:0/3540534815 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f3f1c0b4d20 0x7f3f1c0b7230 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c0e3100 tx=0x7f3f2c0e9830 comp rx=0 tx=0).stop 2024-08-31T05:39:26.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.117+0000 7f3f37479640 1 -- 172.21.15.5:0/3540534815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f30102800 msgr2=0x7f3f30104e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:26.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.117+0000 7f3f37479640 1 --2- 172.21.15.5:0/3540534815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f30102800 0x7f3f30104e80 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c00e9f0 tx=0x7f3f2c00edf0 comp rx=0 tx=0).stop 2024-08-31T05:39:26.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.117+0000 7f3f37479640 1 -- 172.21.15.5:0/3540534815 shutdown_connections 2024-08-31T05:39:26.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.117+0000 7f3f37479640 1 --2- 172.21.15.5:0/3540534815 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f3f1c0b4d20 0x7f3f1c0b7230 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:26.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.117+0000 7f3f37479640 1 --2- 172.21.15.5:0/3540534815 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f30108a90 0x7f3f30105900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:26.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.117+0000 7f3f37479640 1 --2- 172.21.15.5:0/3540534815 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3f30108140 0x7f3f301053c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:26.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.117+0000 7f3f37479640 1 --2- 172.21.15.5:0/3540534815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f30102800 0x7f3f30104e80 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:26.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.117+0000 7f3f37479640 1 -- 172.21.15.5:0/3540534815 >> 172.21.15.5:0/3540534815 conn(0x7f3f300794d0 msgr2=0x7f3f300ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:26.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.117+0000 7f3f37479640 1 -- 172.21.15.5:0/3540534815 shutdown_connections 2024-08-31T05:39:26.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:26.117+0000 7f3f37479640 1 -- 172.21.15.5:0/3540534815 wait complete. 2024-08-31T05:39:26.820 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-31T05:39:26.932 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1069553 11.14 MB/sec execute 374 sec latency 20.930 ms 2024-08-31T05:39:27.101 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:39:27.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:39:26 smithi005 ceph-mon[18602]: pgmap v635: 129 pgs: 129 active+clean; 557 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.2 MiB/s wr, 214 op/s 2024-08-31T05:39:27.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:39:26 smithi070 ceph-mon[22316]: pgmap v635: 129 pgs: 129 active+clean; 557 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.2 MiB/s wr, 214 op/s 2024-08-31T05:39:27.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:39:26 smithi050 ceph-mon[22146]: pgmap v635: 129 pgs: 129 active+clean; 557 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.2 MiB/s wr, 214 op/s 2024-08-31T05:39:27.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.631+0000 7ff8a686c640 1 -- 172.21.15.5:0/2719106968 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8a0108140 msgr2=0x7ff8a0108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:27.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.631+0000 7ff8a686c640 1 --2- 172.21.15.5:0/2719106968 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8a0108140 0x7ff8a0108550 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7ff894009900 tx=0x7ff89402a410 comp rx=0 tx=0).stop 2024-08-31T05:39:27.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.631+0000 7ff8a686c640 1 -- 172.21.15.5:0/2719106968 shutdown_connections 2024-08-31T05:39:27.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.631+0000 7ff8a686c640 1 --2- 172.21.15.5:0/2719106968 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8a0108a90 0x7ff8a010f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:27.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.631+0000 7ff8a686c640 1 --2- 172.21.15.5:0/2719106968 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8a0108140 0x7ff8a0108550 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:27.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.631+0000 7ff8a686c640 1 --2- 172.21.15.5:0/2719106968 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8a0102800 0x7ff8a0102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:27.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.631+0000 7ff8a686c640 1 -- 172.21.15.5:0/2719106968 >> 172.21.15.5:0/2719106968 conn(0x7ff8a00794d0 msgr2=0x7ff8a00798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:27.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.631+0000 7ff8a686c640 1 -- 172.21.15.5:0/2719106968 shutdown_connections 2024-08-31T05:39:27.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.631+0000 7ff8a686c640 1 -- 172.21.15.5:0/2719106968 wait complete. 2024-08-31T05:39:27.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.632+0000 7ff8a686c640 1 Processor -- start 2024-08-31T05:39:27.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.632+0000 7ff8a686c640 1 -- start start 2024-08-31T05:39:27.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.632+0000 7ff8a686c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8a0102800 0x7ff8a019b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:27.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.632+0000 7ff8a686c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8a0108140 0x7ff8a019b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:27.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.632+0000 7ff8a686c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8a0108a90 0x7ff8a019bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:27.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.632+0000 7ff8a686c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a01126e0 con 0x7ff8a0102800 2024-08-31T05:39:27.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.632+0000 7ff8a686c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a0112560 con 0x7ff8a0108a90 2024-08-31T05:39:27.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.632+0000 7ff8a686c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a0112860 con 0x7ff8a0108140 2024-08-31T05:39:27.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.632+0000 7ff89ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8a0102800 0x7ff8a019b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:27.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.632+0000 7ff89ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8a0102800 0x7ff8a019b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40330/0 (socket says 172.21.15.5:40330) 2024-08-31T05:39:27.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.633+0000 7ff89ffff640 1 -- 172.21.15.5:0/2276172462 learned_addr learned my addr 172.21.15.5:0/2276172462 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:27.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.633+0000 7ff89f7fe640 1 --2- 172.21.15.5:0/2276172462 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8a0108140 0x7ff8a019b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:27.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.633+0000 7ff8a4e09640 1 --2- 172.21.15.5:0/2276172462 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8a0108a90 0x7ff8a019bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:27.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.633+0000 7ff89ffff640 1 -- 172.21.15.5:0/2276172462 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8a0108140 msgr2=0x7ff8a019b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:27.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.633+0000 7ff89ffff640 1 --2- 172.21.15.5:0/2276172462 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8a0108140 0x7ff8a019b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:27.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.633+0000 7ff89ffff640 1 -- 172.21.15.5:0/2276172462 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8a0108a90 msgr2=0x7ff8a019bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:27.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.633+0000 7ff89ffff640 1 --2- 172.21.15.5:0/2276172462 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8a0108a90 0x7ff8a019bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:27.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.633+0000 7ff89ffff640 1 -- 172.21.15.5:0/2276172462 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8a01a6380 con 0x7ff8a0102800 2024-08-31T05:39:27.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.633+0000 7ff89ffff640 1 --2- 172.21.15.5:0/2276172462 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8a0102800 0x7ff8a019b0f0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7ff89000e9f0 tx=0x7ff89000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:27.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.633+0000 7ff89d7fa640 1 -- 172.21.15.5:0/2276172462 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff89000ccc0 con 0x7ff8a0102800 2024-08-31T05:39:27.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.633+0000 7ff89d7fa640 1 -- 172.21.15.5:0/2276172462 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff89000ce60 con 0x7ff8a0102800 2024-08-31T05:39:27.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.633+0000 7ff8a686c640 1 -- 172.21.15.5:0/2276172462 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8a01a6670 con 0x7ff8a0102800 2024-08-31T05:39:27.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.633+0000 7ff89d7fa640 1 -- 172.21.15.5:0/2276172462 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff890010430 con 0x7ff8a0102800 2024-08-31T05:39:27.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.633+0000 7ff8a686c640 1 -- 172.21.15.5:0/2276172462 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8a01a6b80 con 0x7ff8a0102800 2024-08-31T05:39:27.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.637+0000 7ff8acde1740 1 Processor -- start 2024-08-31T05:39:27.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.637+0000 7ff8acde1740 1 -- start start 2024-08-31T05:39:27.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.637+0000 7ff8acde1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55afa3efc070 0x55afa42a1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:27.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.637+0000 7ff8acde1740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55afa3ed31b0 0x55afa42a1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:27.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.637+0000 7ff8acde1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afa3edb390 0x55afa42a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:27.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.637+0000 7ff8acde1740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55afa4218680 con 0x55afa3ed31b0 2024-08-31T05:39:27.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.637+0000 7ff8acde1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55afa4207c10 con 0x55afa3efc070 2024-08-31T05:39:27.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.637+0000 7ff8acde1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55afa420bbc0 con 0x55afa3edb390 2024-08-31T05:39:27.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.637+0000 7ff89d7fa640 1 -- 172.21.15.5:0/2276172462 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7ff8900105d0 con 0x7ff8a0102800 2024-08-31T05:39:27.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.637+0000 7ff89ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55afa3ed31b0 0x55afa42a1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:27.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.637+0000 7ff89f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afa3edb390 0x55afa42a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:27.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.637+0000 7ff89f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afa3edb390 0x55afa42a1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:52078/0 (socket says 172.21.15.5:52078) 2024-08-31T05:39:27.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.637+0000 7ff89ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55afa3ed31b0 0x55afa42a1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40332/0 (socket says 172.21.15.5:40332) 2024-08-31T05:39:27.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.637+0000 7ff89f7fe640 1 -- 172.21.15.5:0/453001028 learned_addr learned my addr 172.21.15.5:0/453001028 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:27.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.638+0000 7ff8a4e09640 1 --2- 172.21.15.5:0/453001028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55afa3efc070 0x55afa42a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:27.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.638+0000 7ff89ffff640 1 -- 172.21.15.5:0/453001028 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afa3edb390 msgr2=0x55afa42a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:27.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.638+0000 7ff89ffff640 1 --2- 172.21.15.5:0/453001028 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afa3edb390 0x55afa42a1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:27.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.638+0000 7ff89ffff640 1 -- 172.21.15.5:0/453001028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55afa3efc070 msgr2=0x55afa42a1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:27.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.638+0000 7ff89ffff640 1 --2- 172.21.15.5:0/453001028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55afa3efc070 0x55afa42a1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:27.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.638+0000 7ff89ffff640 1 -- 172.21.15.5:0/453001028 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afa3f67650 con 0x55afa3ed31b0 2024-08-31T05:39:27.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.638+0000 7ff89ffff640 1 --2- 172.21.15.5:0/453001028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55afa3ed31b0 0x55afa42a1850 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7ff8900e2fd0 tx=0x7ff8900e9d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f84dd20a18fda5b9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:27.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.638+0000 7ff89d7fa640 1 --2- 172.21.15.5:0/2276172462 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff8880b4d50 0x7ff8880b7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:27.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.638+0000 7ff8867fc640 1 -- 172.21.15.5:0/453001028 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8900a85c0 con 0x55afa3ed31b0 2024-08-31T05:39:27.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.638+0000 7ff8a4e09640 1 --2- 172.21.15.5:0/2276172462 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff8880b4d50 0x7ff8880b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:27.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.638+0000 7ff8867fc640 1 -- 172.21.15.5:0/453001028 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff8900f3070 con 0x55afa3ed31b0 2024-08-31T05:39:27.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.638+0000 7ff8867fc640 1 -- 172.21.15.5:0/453001028 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8900ab6e0 con 0x55afa3ed31b0 2024-08-31T05:39:27.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.638+0000 7ff89d7fa640 1 -- 172.21.15.5:0/2276172462 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7ff8900e5cc0 con 0x7ff8a0102800 2024-08-31T05:39:27.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.639+0000 7ff8acde1740 1 -- 172.21.15.5:0/453001028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55afa3ed31b0 msgr2=0x55afa42a1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:27.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.639+0000 7ff8a4e09640 1 --2- 172.21.15.5:0/2276172462 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff8880b4d50 0x7ff8880b7260 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff898005fd0 tx=0x7ff898009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:27.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.639+0000 7ff8acde1740 1 --2- 172.21.15.5:0/453001028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55afa3ed31b0 0x55afa42a1850 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7ff8900e2fd0 tx=0x7ff8900e9d60 comp rx=0 tx=0).stop 2024-08-31T05:39:27.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.639+0000 7ff8acde1740 1 -- 172.21.15.5:0/453001028 shutdown_connections 2024-08-31T05:39:27.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.639+0000 7ff8acde1740 1 --2- 172.21.15.5:0/453001028 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afa3edb390 0x55afa42a1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:27.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.639+0000 7ff8acde1740 1 --2- 172.21.15.5:0/453001028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55afa3ed31b0 0x55afa42a1850 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:27.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.639+0000 7ff8acde1740 1 --2- 172.21.15.5:0/453001028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55afa3efc070 0x55afa42a1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:27.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.639+0000 7ff8acde1740 1 -- 172.21.15.5:0/453001028 >> 172.21.15.5:0/453001028 conn(0x55afa3ef0460 msgr2=0x55afa429f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:27.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.639+0000 7ff8acde1740 1 -- 172.21.15.5:0/453001028 shutdown_connections 2024-08-31T05:39:27.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.639+0000 7ff8acde1740 1 -- 172.21.15.5:0/453001028 wait complete. 2024-08-31T05:39:27.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.640+0000 7ff8acde1740 1 -- start start 2024-08-31T05:39:27.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.640+0000 7ff8acde1740 1 Processor -- start 2024-08-31T05:39:27.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.641+0000 7ff8acde1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afa3ed31b0 0x55afa42b0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:27.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.641+0000 7ff8acde1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55afa3edb390 0x55afa42b1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:27.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.641+0000 7ff8acde1740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55afa3efc070 0x55afa42bd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:27.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.641+0000 7ff8acde1740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55afa406a700 con 0x55afa3efc070 2024-08-31T05:39:27.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.641+0000 7ff8acde1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55afa418e750 con 0x55afa3edb390 2024-08-31T05:39:27.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.641+0000 7ff8acde1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55afa42b3e50 con 0x55afa3ed31b0 2024-08-31T05:39:27.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.641+0000 7ff8acde1740 10 client.0 _ll_register_callbacks cb 0x55afa41bde10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:39:27.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.641+0000 7ff8a4e09640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55afa3efc070 0x55afa42bd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:27.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.641+0000 7ff89ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afa3ed31b0 0x55afa42b0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:27.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.641+0000 7ff8a4e09640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55afa3efc070 0x55afa42bd1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40338/0 (socket says 172.21.15.5:40338) 2024-08-31T05:39:27.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.641+0000 7ff8a4e09640 1 -- 172.21.15.5:0/4114950977 learned_addr learned my addr 172.21.15.5:0/4114950977 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:27.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.641+0000 7ff89f7fe640 1 --2- 172.21.15.5:0/4114950977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55afa3edb390 0x55afa42b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:27.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.641+0000 7ff8a4e09640 1 -- 172.21.15.5:0/4114950977 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afa3ed31b0 msgr2=0x55afa42b0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:27.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.641+0000 7ff8a4e09640 1 --2- 172.21.15.5:0/4114950977 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afa3ed31b0 0x55afa42b0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:27.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.641+0000 7ff8a4e09640 1 -- 172.21.15.5:0/4114950977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55afa3edb390 msgr2=0x55afa42b1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:27.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.641+0000 7ff8a4e09640 1 --2- 172.21.15.5:0/4114950977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55afa3edb390 0x55afa42b1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:27.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.641+0000 7ff8a4e09640 1 -- 172.21.15.5:0/4114950977 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55afa41c7900 con 0x55afa3efc070 2024-08-31T05:39:27.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.641+0000 7ff89f7fe640 1 --2- 172.21.15.5:0/4114950977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55afa3edb390 0x55afa42b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:39:27.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.641+0000 7ff8a4e09640 1 --2- 172.21.15.5:0/4114950977 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55afa3efc070 0x55afa42bd1b0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7ff898009ac0 tx=0x7ff898004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=256d5c0cc7b7aacd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:27.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.641+0000 7ff87f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:39:27.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.641+0000 7ff87f7fe640 1 -- 172.21.15.5:0/4114950977 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff89802e060 con 0x55afa3efc070 2024-08-31T05:39:27.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.642+0000 7ff8acde1740 1 -- 172.21.15.5:0/4114950977 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8900f3070 con 0x55afa3efc070 2024-08-31T05:39:27.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.642+0000 7ff87f7fe640 1 -- 172.21.15.5:0/4114950977 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7ff898018030 con 0x55afa3efc070 2024-08-31T05:39:27.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.642+0000 7ff87f7fe640 1 -- 172.21.15.5:0/4114950977 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ff898035050 con 0x55afa3efc070 2024-08-31T05:39:27.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.642+0000 7ff8acde1740 10 client.18081 fetch_fsmap learned FSMap version 34 2024-08-31T05:39:27.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.642+0000 7ff8acde1740 1 -- 172.21.15.5:0/4114950977 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55afa42bfbf0 con 0x55afa3efc070 2024-08-31T05:39:27.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.642+0000 7ff87f7fe640 1 -- 172.21.15.5:0/4114950977 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff8900f3070 con 0x55afa3efc070 2024-08-31T05:39:27.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.642+0000 7ff87f7fe640 1 -- 172.21.15.5:0/4114950977 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7ff898029720 con 0x55afa3efc070 2024-08-31T05:39:27.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.642+0000 7ff8acde1740 10 client.18081 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:39:27.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.642+0000 7ff8acde1740 10 client.18081 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-31T05:39:27.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.642+0000 7ff8acde1740 20 client.18081 populate_metadata read hostname 'smithi005' 2024-08-31T05:39:27.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.642+0000 7ff8acde1740 1 --2- 172.21.15.5:0/4114950977 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x55afa3eba9f0 0x55afa42c3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:27.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.642+0000 7ff8acde1740 4 client.18081 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:39:27.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.642+0000 7ff8acde1740 1 -- 172.21.15.5:0/4114950977 --> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55afa421a5d0 con 0x55afa3eba9f0 2024-08-31T05:39:27.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.642+0000 7ff89ffff640 1 --2- 172.21.15.5:0/4114950977 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x55afa3eba9f0 0x55afa42c3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:27.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.643+0000 7ff87f7fe640 10 client.18081 ms_handle_connect on v2:172.21.15.70:6834/2061504114 2024-08-31T05:39:27.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.643+0000 7ff89ffff640 1 --2- 172.21.15.5:0/4114950977 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x55afa3eba9f0 0x55afa42c3060 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5668a11b84b103ae server_cookie=8e0a919ef794d234 in_seq=0 out_seq=0 2024-08-31T05:39:27.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.644+0000 7ff87f7fe640 1 -- 172.21.15.5:0/4114950977 <== mds.3 v2:172.21.15.70:6834/2061504114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55afa421a5d0 con 0x55afa3eba9f0 2024-08-31T05:39:27.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.644+0000 7ff87f7fe640 10 client.18081 handle_command_reply: tid=0 2024-08-31T05:39:27.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.644+0000 7ff8acde1740 1 client.18081 shutdown 2024-08-31T05:39:27.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.644+0000 7ff8acde1740 1 -- 172.21.15.5:0/4114950977 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55afa3efc070 msgr2=0x55afa42bd1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:27.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.644+0000 7ff8acde1740 1 --2- 172.21.15.5:0/4114950977 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55afa3efc070 0x55afa42bd1b0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7ff898009ac0 tx=0x7ff898004ab0 comp rx=0 tx=0).stop 2024-08-31T05:39:27.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.644+0000 7ff8acde1740 1 -- 172.21.15.5:0/4114950977 shutdown_connections 2024-08-31T05:39:27.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.644+0000 7ff8acde1740 1 --2- 172.21.15.5:0/4114950977 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x55afa3eba9f0 0x55afa42c3060 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:27.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.644+0000 7ff8acde1740 1 --2- 172.21.15.5:0/4114950977 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55afa3efc070 0x55afa42bd1b0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:27.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.644+0000 7ff8acde1740 1 --2- 172.21.15.5:0/4114950977 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55afa3edb390 0x55afa42b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:27.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.644+0000 7ff8acde1740 1 --2- 172.21.15.5:0/4114950977 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afa3ed31b0 0x55afa42b0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:27.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.644+0000 7ff87f7fe640 0 client.18081 ms_handle_reset on v2:172.21.15.70:6834/2061504114 2024-08-31T05:39:27.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.644+0000 7ff8acde1740 1 -- 172.21.15.5:0/4114950977 >> 172.21.15.5:0/4114950977 conn(0x55afa3ef0460 msgr2=0x55afa42a2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:27.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.644+0000 7ff8acde1740 1 -- 172.21.15.5:0/4114950977 shutdown_connections 2024-08-31T05:39:27.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.644+0000 7ff8acde1740 1 -- 172.21.15.5:0/4114950977 wait complete. 2024-08-31T05:39:27.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.644+0000 7ff8acde1740 20 client.18081 trim_cache size 0 max 16384 2024-08-31T05:39:27.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.658+0000 7ff8acde1740 1 Processor -- start 2024-08-31T05:39:27.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.658+0000 7ff8acde1740 1 -- start start 2024-08-31T05:39:27.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.658+0000 7ff8acde1740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55afa3ed31b0 0x55afa42bd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:27.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.658+0000 7ff8acde1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afa3edb390 0x55afa429eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:27.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.658+0000 7ff8acde1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55afa3efc070 0x55afa429f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:27.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.658+0000 7ff8acde1740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a01aeb60 con 0x55afa3ed31b0 2024-08-31T05:39:27.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.658+0000 7ff8acde1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a01b06a0 con 0x55afa3efc070 2024-08-31T05:39:27.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.658+0000 7ff8acde1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a01af230 con 0x55afa3edb390 2024-08-31T05:39:27.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.659+0000 7ff89f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afa3edb390 0x55afa429eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:27.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.659+0000 7ff89f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afa3edb390 0x55afa429eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:52092/0 (socket says 172.21.15.5:52092) 2024-08-31T05:39:27.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.659+0000 7ff89f7fe640 1 -- 172.21.15.5:0/3277136920 learned_addr learned my addr 172.21.15.5:0/3277136920 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:27.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.659+0000 7ff89ffff640 1 --2- 172.21.15.5:0/3277136920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55afa3ed31b0 0x55afa42bd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:27.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.659+0000 7ff8a4e09640 1 --2- 172.21.15.5:0/3277136920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55afa3efc070 0x55afa429f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:27.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.659+0000 7ff89f7fe640 1 -- 172.21.15.5:0/3277136920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55afa3efc070 msgr2=0x55afa429f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:27.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.659+0000 7ff89f7fe640 1 --2- 172.21.15.5:0/3277136920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55afa3efc070 0x55afa429f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:27.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.659+0000 7ff89f7fe640 1 -- 172.21.15.5:0/3277136920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55afa3ed31b0 msgr2=0x55afa42bd0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:27.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.659+0000 7ff89f7fe640 1 --2- 172.21.15.5:0/3277136920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55afa3ed31b0 0x55afa42bd0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:27.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.659+0000 7ff89f7fe640 1 -- 172.21.15.5:0/3277136920 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afa42af2e0 con 0x55afa3edb390 2024-08-31T05:39:27.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.659+0000 7ff89f7fe640 1 --2- 172.21.15.5:0/3277136920 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afa3edb390 0x55afa429eb20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff894009900 tx=0x7ff894032df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35baed34af6b6abc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:27.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.659+0000 7ff885ffb640 1 -- 172.21.15.5:0/3277136920 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff894035040 con 0x55afa3edb390 2024-08-31T05:39:27.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.659+0000 7ff885ffb640 1 -- 172.21.15.5:0/3277136920 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff8940316a0 con 0x55afa3edb390 2024-08-31T05:39:27.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.659+0000 7ff885ffb640 1 -- 172.21.15.5:0/3277136920 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff894004750 con 0x55afa3edb390 2024-08-31T05:39:27.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.660+0000 7ff8acde1740 1 -- 172.21.15.5:0/3277136920 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afa3edb390 msgr2=0x55afa429eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:27.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.660+0000 7ff8acde1740 1 --2- 172.21.15.5:0/3277136920 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afa3edb390 0x55afa429eb20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff894009900 tx=0x7ff894032df0 comp rx=0 tx=0).stop 2024-08-31T05:39:27.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.660+0000 7ff8acde1740 1 -- 172.21.15.5:0/3277136920 shutdown_connections 2024-08-31T05:39:27.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.660+0000 7ff8acde1740 1 --2- 172.21.15.5:0/3277136920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55afa3efc070 0x55afa429f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:27.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.660+0000 7ff8acde1740 1 --2- 172.21.15.5:0/3277136920 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afa3edb390 0x55afa429eb20 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:27.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.660+0000 7ff8acde1740 1 --2- 172.21.15.5:0/3277136920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55afa3ed31b0 0x55afa42bd0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:27.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.660+0000 7ff8acde1740 1 -- 172.21.15.5:0/3277136920 >> 172.21.15.5:0/3277136920 conn(0x55afa3ef0460 msgr2=0x55afa42af660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:27.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.661+0000 7ff8acde1740 1 -- 172.21.15.5:0/3277136920 shutdown_connections 2024-08-31T05:39:27.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.661+0000 7ff8acde1740 1 -- 172.21.15.5:0/3277136920 wait complete. 2024-08-31T05:39:27.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.661+0000 7ff8acde1740 1 -- start start 2024-08-31T05:39:27.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.661+0000 7ff8acde1740 1 Processor -- start 2024-08-31T05:39:27.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.662+0000 7ff8acde1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55afa3ed31b0 0x55afa42b96f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:27.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.662+0000 7ff8acde1740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55afa3edb390 0x55afa42b5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:27.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.662+0000 7ff8acde1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afa3efc070 0x55afa42b60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:27.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.662+0000 7ff8acde1740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a01affd0 con 0x55afa3edb390 2024-08-31T05:39:27.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.662+0000 7ff8acde1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a01af900 con 0x55afa3ed31b0 2024-08-31T05:39:27.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.662+0000 7ff8acde1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a01acb60 con 0x55afa3efc070 2024-08-31T05:39:27.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.662+0000 7ff8acde1740 10 client.0 _ll_register_callbacks cb 0x7ff898009df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:39:27.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.662+0000 7ff89ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55afa3ed31b0 0x55afa42b96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:27.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.662+0000 7ff89f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55afa3edb390 0x55afa42b5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:27.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.662+0000 7ff89ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55afa3ed31b0 0x55afa42b96f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:52654/0 (socket says 172.21.15.5:52654) 2024-08-31T05:39:27.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.662+0000 7ff89ffff640 1 -- 172.21.15.5:0/2248464487 learned_addr learned my addr 172.21.15.5:0/2248464487 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:27.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.662+0000 7ff8a4e09640 1 --2- 172.21.15.5:0/2248464487 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afa3efc070 0x55afa42b60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:27.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.662+0000 7ff89f7fe640 1 -- 172.21.15.5:0/2248464487 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afa3efc070 msgr2=0x55afa42b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:27.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.662+0000 7ff89f7fe640 1 --2- 172.21.15.5:0/2248464487 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afa3efc070 0x55afa42b60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:27.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.662+0000 7ff89f7fe640 1 -- 172.21.15.5:0/2248464487 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55afa3ed31b0 msgr2=0x55afa42b96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:27.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.662+0000 7ff89f7fe640 1 --2- 172.21.15.5:0/2248464487 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55afa3ed31b0 0x55afa42b96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:27.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.662+0000 7ff89f7fe640 1 -- 172.21.15.5:0/2248464487 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55afa42b66b0 con 0x55afa3edb390 2024-08-31T05:39:27.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.662+0000 7ff8a4e09640 1 --2- 172.21.15.5:0/2248464487 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afa3efc070 0x55afa42b60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:39:27.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.663+0000 7ff89f7fe640 1 --2- 172.21.15.5:0/2248464487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55afa3edb390 0x55afa42b5bb0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7ff89402a930 tx=0x7ff894032f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b1112ac2f7e1931 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:27.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.663+0000 7ff87f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:39:27.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.663+0000 7ff87f7fe640 1 -- 172.21.15.5:0/2248464487 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff894050020 con 0x55afa3edb390 2024-08-31T05:39:27.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.663+0000 7ff87f7fe640 1 -- 172.21.15.5:0/2248464487 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7ff894004250 con 0x55afa3edb390 2024-08-31T05:39:27.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.663+0000 7ff8acde1740 1 -- 172.21.15.5:0/2248464487 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8940316a0 con 0x55afa3edb390 2024-08-31T05:39:27.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.663+0000 7ff87f7fe640 1 -- 172.21.15.5:0/2248464487 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ff89405b050 con 0x55afa3edb390 2024-08-31T05:39:27.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.663+0000 7ff8acde1740 10 client.18087 fetch_fsmap learned FSMap version 34 2024-08-31T05:39:27.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.663+0000 7ff8acde1740 1 -- 172.21.15.5:0/2248464487 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55afa432e780 con 0x55afa3edb390 2024-08-31T05:39:27.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.664+0000 7ff87f7fe640 1 -- 172.21.15.5:0/2248464487 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff894004450 con 0x55afa3edb390 2024-08-31T05:39:27.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.664+0000 7ff87f7fe640 1 -- 172.21.15.5:0/2248464487 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7ff894004ac0 con 0x55afa3edb390 2024-08-31T05:39:27.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.664+0000 7ff8acde1740 10 client.18087 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:39:27.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.664+0000 7ff8acde1740 10 client.18087 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-31T05:39:27.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.664+0000 7ff8acde1740 20 client.18087 populate_metadata read hostname 'smithi005' 2024-08-31T05:39:27.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.664+0000 7ff8acde1740 1 --2- 172.21.15.5:0/2248464487 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x55afa3e8fda0 0x55afa4330e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:27.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.664+0000 7ff8acde1740 4 client.18087 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:39:27.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.664+0000 7ff8acde1740 1 -- 172.21.15.5:0/2248464487 --> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7ff8940316a0 con 0x55afa3e8fda0 2024-08-31T05:39:27.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.664+0000 7ff89ffff640 1 --2- 172.21.15.5:0/2248464487 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x55afa3e8fda0 0x55afa4330e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:27.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.664+0000 7ff87f7fe640 10 client.18087 ms_handle_connect on v2:172.21.15.70:6834/2061504114 2024-08-31T05:39:27.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.665+0000 7ff89ffff640 1 --2- 172.21.15.5:0/2248464487 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x55afa3e8fda0 0x55afa4330e60 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e5a98bfb25a7a544 server_cookie=774be0e0d003e6a7 in_seq=0 out_seq=0 2024-08-31T05:39:27.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.665+0000 7ff87f7fe640 1 -- 172.21.15.5:0/2248464487 <== mds.3 v2:172.21.15.70:6834/2061504114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7ff8940316a0 con 0x55afa3e8fda0 2024-08-31T05:39:27.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.665+0000 7ff87f7fe640 10 client.18087 handle_command_reply: tid=0 2024-08-31T05:39:27.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.665+0000 7ff8acde1740 1 client.18087 shutdown 2024-08-31T05:39:27.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.665+0000 7ff8acde1740 1 -- 172.21.15.5:0/2248464487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55afa3edb390 msgr2=0x55afa42b5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:27.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.665+0000 7ff8acde1740 1 --2- 172.21.15.5:0/2248464487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55afa3edb390 0x55afa42b5bb0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7ff89402a930 tx=0x7ff894032f60 comp rx=0 tx=0).stop 2024-08-31T05:39:27.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.665+0000 7ff8acde1740 1 -- 172.21.15.5:0/2248464487 shutdown_connections 2024-08-31T05:39:27.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.665+0000 7ff8acde1740 1 --2- 172.21.15.5:0/2248464487 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x55afa3e8fda0 0x55afa4330e60 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:27.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.665+0000 7ff8acde1740 1 --2- 172.21.15.5:0/2248464487 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afa3efc070 0x55afa42b60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:27.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.665+0000 7ff8acde1740 1 --2- 172.21.15.5:0/2248464487 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55afa3edb390 0x55afa42b5bb0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:27.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.665+0000 7ff8acde1740 1 --2- 172.21.15.5:0/2248464487 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55afa3ed31b0 0x55afa42b96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:27.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.665+0000 7ff8acde1740 1 -- 172.21.15.5:0/2248464487 >> 172.21.15.5:0/2248464487 conn(0x55afa3ef0460 msgr2=0x55afa429eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:27.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.665+0000 7ff87f7fe640 0 client.18087 ms_handle_reset on v2:172.21.15.70:6834/2061504114 2024-08-31T05:39:27.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.665+0000 7ff8acde1740 1 -- 172.21.15.5:0/2248464487 shutdown_connections 2024-08-31T05:39:27.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.665+0000 7ff8acde1740 1 -- 172.21.15.5:0/2248464487 wait complete. 2024-08-31T05:39:27.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.665+0000 7ff8acde1740 20 client.18087 trim_cache size 0 max 16384 2024-08-31T05:39:27.671 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:39:27.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.666+0000 7ff8a686c640 1 -- 172.21.15.5:0/2276172462 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff8880b4d50 msgr2=0x7ff8880b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:27.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.666+0000 7ff8a686c640 1 --2- 172.21.15.5:0/2276172462 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff8880b4d50 0x7ff8880b7260 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff898005fd0 tx=0x7ff898009500 comp rx=0 tx=0).stop 2024-08-31T05:39:27.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.666+0000 7ff8a686c640 1 -- 172.21.15.5:0/2276172462 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8a0102800 msgr2=0x7ff8a019b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:27.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.666+0000 7ff8a686c640 1 --2- 172.21.15.5:0/2276172462 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8a0102800 0x7ff8a019b0f0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7ff89000e9f0 tx=0x7ff89000edf0 comp rx=0 tx=0).stop 2024-08-31T05:39:27.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.666+0000 7ff8a686c640 1 -- 172.21.15.5:0/2276172462 shutdown_connections 2024-08-31T05:39:27.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.666+0000 7ff8a686c640 1 --2- 172.21.15.5:0/2276172462 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff8880b4d50 0x7ff8880b7260 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:27.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.666+0000 7ff8a686c640 1 --2- 172.21.15.5:0/2276172462 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff8a0108a90 0x7ff8a019bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:27.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.666+0000 7ff8a686c640 1 --2- 172.21.15.5:0/2276172462 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8a0108140 0x7ff8a019b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:27.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.666+0000 7ff8a686c640 1 --2- 172.21.15.5:0/2276172462 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8a0102800 0x7ff8a019b0f0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:27.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.666+0000 7ff8a686c640 1 -- 172.21.15.5:0/2276172462 >> 172.21.15.5:0/2276172462 conn(0x7ff8a00794d0 msgr2=0x7ff8a0104260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:27.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.666+0000 7ff8a686c640 1 -- 172.21.15.5:0/2276172462 shutdown_connections 2024-08-31T05:39:27.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:27.666+0000 7ff8a686c640 1 -- 172.21.15.5:0/2276172462 wait complete. 2024-08-31T05:39:27.933 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1071014 11.13 MB/sec execute 375 sec latency 37.242 ms 2024-08-31T05:39:28.456 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T05:39:28.722 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:39:28.933 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1073244 11.13 MB/sec execute 376 sec latency 18.446 ms 2024-08-31T05:39:29.107 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:39:28 smithi005 ceph-mon[18602]: pgmap v636: 129 pgs: 129 active+clean; 557 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.7 MiB/s wr, 198 op/s 2024-08-31T05:39:29.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.220+0000 7f15b3821640 1 -- 172.21.15.5:0/1126424451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15ac102800 msgr2=0x7f15ac102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:29.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.220+0000 7f15b3821640 1 --2- 172.21.15.5:0/1126424451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15ac102800 0x7f15ac102c10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f159c009ca0 tx=0x7f159c02a8f0 comp rx=0 tx=0).stop 2024-08-31T05:39:29.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.220+0000 7f15b3821640 1 -- 172.21.15.5:0/1126424451 shutdown_connections 2024-08-31T05:39:29.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.220+0000 7f15b3821640 1 --2- 172.21.15.5:0/1126424451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15ac108a90 0x7f15ac10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:29.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.220+0000 7f15b3821640 1 --2- 172.21.15.5:0/1126424451 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f15ac108140 0x7f15ac108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:29.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.220+0000 7f15b3821640 1 --2- 172.21.15.5:0/1126424451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15ac102800 0x7f15ac102c10 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:29.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.220+0000 7f15b3821640 1 -- 172.21.15.5:0/1126424451 >> 172.21.15.5:0/1126424451 conn(0x7f15ac0794d0 msgr2=0x7f15ac0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:29.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.223+0000 7f15b3821640 1 -- 172.21.15.5:0/1126424451 shutdown_connections 2024-08-31T05:39:29.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.223+0000 7f15b3821640 1 -- 172.21.15.5:0/1126424451 wait complete. 2024-08-31T05:39:29.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.224+0000 7f15b3821640 1 Processor -- start 2024-08-31T05:39:29.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.224+0000 7f15b3821640 1 -- start start 2024-08-31T05:39:29.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.224+0000 7f15b3821640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15ac102800 0x7f15ac10cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:29.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.224+0000 7f15b3821640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15ac108140 0x7f15ac10d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:29.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.224+0000 7f15b3821640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f15ac108a90 0x7f15ac1ac3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:29.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.225+0000 7f15b3821640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f15ac1116a0 con 0x7f15ac102800 2024-08-31T05:39:29.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.225+0000 7f15b3821640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f15ac111520 con 0x7f15ac108140 2024-08-31T05:39:29.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.225+0000 7f15b3821640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f15ac111820 con 0x7f15ac108a90 2024-08-31T05:39:29.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.225+0000 7f15b1dbe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f15ac108a90 0x7f15ac1ac3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:29.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.225+0000 7f15b15bd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15ac102800 0x7f15ac10cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:29.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.225+0000 7f15b1dbe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f15ac108a90 0x7f15ac1ac3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:52114/0 (socket says 172.21.15.5:52114) 2024-08-31T05:39:29.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.225+0000 7f15b1dbe640 1 -- 172.21.15.5:0/1391019451 learned_addr learned my addr 172.21.15.5:0/1391019451 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:29.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.225+0000 7f15b0dbc640 1 --2- 172.21.15.5:0/1391019451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15ac108140 0x7f15ac10d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:29.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.225+0000 7f15b15bd640 1 -- 172.21.15.5:0/1391019451 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f15ac108a90 msgr2=0x7f15ac1ac3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:29.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.225+0000 7f15b15bd640 1 --2- 172.21.15.5:0/1391019451 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f15ac108a90 0x7f15ac1ac3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:29.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.225+0000 7f15b15bd640 1 -- 172.21.15.5:0/1391019451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15ac108140 msgr2=0x7f15ac10d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:29.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.225+0000 7f15b15bd640 1 --2- 172.21.15.5:0/1391019451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15ac108140 0x7f15ac10d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:29.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.225+0000 7f15b15bd640 1 -- 172.21.15.5:0/1391019451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15ac1ac930 con 0x7f15ac102800 2024-08-31T05:39:29.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.225+0000 7f15b1dbe640 1 --2- 172.21.15.5:0/1391019451 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f15ac108a90 0x7f15ac1ac3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:39:29.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.226+0000 7f15b15bd640 1 --2- 172.21.15.5:0/1391019451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15ac102800 0x7f15ac10cd20 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f159c02aee0 tx=0x7f159c031870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:29.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.226+0000 7f15aa7fc640 1 -- 172.21.15.5:0/1391019451 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f159c02f8c0 con 0x7f15ac102800 2024-08-31T05:39:29.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.226+0000 7f15aa7fc640 1 -- 172.21.15.5:0/1391019451 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f159c02d070 con 0x7f15ac102800 2024-08-31T05:39:29.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.226+0000 7f15aa7fc640 1 -- 172.21.15.5:0/1391019451 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f159c04c410 con 0x7f15ac102800 2024-08-31T05:39:29.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.226+0000 7f15b3821640 1 -- 172.21.15.5:0/1391019451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15ac06cb80 con 0x7f15ac102800 2024-08-31T05:39:29.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.226+0000 7f15b3821640 1 -- 172.21.15.5:0/1391019451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15ac06d190 con 0x7f15ac102800 2024-08-31T05:39:29.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.231+0000 7f15aa7fc640 1 -- 172.21.15.5:0/1391019451 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f159c02fa60 con 0x7f15ac102800 2024-08-31T05:39:29.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.232+0000 7f15b9d96740 1 Processor -- start 2024-08-31T05:39:29.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.232+0000 7f15b9d96740 1 -- start start 2024-08-31T05:39:29.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.232+0000 7f15aa7fc640 1 --2- 172.21.15.5:0/1391019451 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f15940b4d20 0x7f15940b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:29.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.233+0000 7f15aa7fc640 1 -- 172.21.15.5:0/1391019451 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7f159c116f90 con 0x7f15ac102800 2024-08-31T05:39:29.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.233+0000 7f15b1dbe640 1 --2- 172.21.15.5:0/1391019451 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f15940b4d20 0x7f15940b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:29.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.233+0000 7f15b9d96740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5608c0939070 0x5608c0cde310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:29.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.233+0000 7f15b9d96740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608c09101b0 0x5608c0cde850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:29.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.233+0000 7f15b15bd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5608c0939070 0x5608c0cde310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:29.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.233+0000 7f15b15bd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5608c0939070 0x5608c0cde310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40362/0 (socket says 172.21.15.5:40362) 2024-08-31T05:39:29.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.233+0000 7f15b9d96740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5608c0918390 0x5608c0cded90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:29.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.233+0000 7f15b0dbc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608c09101b0 0x5608c0cde850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:29.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.234+0000 7f15b0dbc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608c09101b0 0x5608c0cde850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:52676/0 (socket says 172.21.15.5:52676) 2024-08-31T05:39:29.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.234+0000 7f15b15bd640 1 -- 172.21.15.5:0/1783603786 learned_addr learned my addr 172.21.15.5:0/1783603786 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:29.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.234+0000 7f15b9d96740 1 -- 172.21.15.5:0/1783603786 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5608c0c55680 con 0x5608c0939070 2024-08-31T05:39:29.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.234+0000 7f15b9d96740 1 -- 172.21.15.5:0/1783603786 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5608c0c44c10 con 0x5608c09101b0 2024-08-31T05:39:29.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.234+0000 7f15b9d96740 1 -- 172.21.15.5:0/1783603786 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5608c0c48bc0 con 0x5608c0918390 2024-08-31T05:39:29.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.234+0000 7f15b15bd640 1 -- 172.21.15.5:0/1783603786 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5608c0918390 msgr2=0x5608c0cded90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:29.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.234+0000 7f15b15bd640 1 --2- 172.21.15.5:0/1783603786 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5608c0918390 0x5608c0cded90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:29.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.234+0000 7f15b15bd640 1 -- 172.21.15.5:0/1783603786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608c09101b0 msgr2=0x5608c0cde850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:29.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.234+0000 7f15b15bd640 1 --2- 172.21.15.5:0/1783603786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608c09101b0 0x5608c0cde850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:29.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.234+0000 7f15b15bd640 1 -- 172.21.15.5:0/1783603786 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608c09a4650 con 0x5608c0939070 2024-08-31T05:39:29.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.235+0000 7f15b1dbe640 1 --2- 172.21.15.5:0/1391019451 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f15940b4d20 0x7f15940b7230 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f15a40104e0 tx=0x7f15a40108e0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:29.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.235+0000 7f15b15bd640 1 --2- 172.21.15.5:0/1783603786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5608c0939070 0x5608c0cde310 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f159c009620 tx=0x7f159c0dcf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97e6a9977177f3a6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:29.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.235+0000 7f15937fe640 1 -- 172.21.15.5:0/1783603786 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f159c0e1ba0 con 0x5608c0939070 2024-08-31T05:39:29.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.235+0000 7f15937fe640 1 -- 172.21.15.5:0/1783603786 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f159c036070 con 0x5608c0939070 2024-08-31T05:39:29.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.235+0000 7f15937fe640 1 -- 172.21.15.5:0/1783603786 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f159c0d9730 con 0x5608c0939070 2024-08-31T05:39:29.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.236+0000 7f15b9d96740 1 -- 172.21.15.5:0/1783603786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5608c0939070 msgr2=0x5608c0cde310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:29.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.236+0000 7f15b9d96740 1 --2- 172.21.15.5:0/1783603786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5608c0939070 0x5608c0cde310 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f159c009620 tx=0x7f159c0dcf80 comp rx=0 tx=0).stop 2024-08-31T05:39:29.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.237+0000 7f15b9d96740 1 -- 172.21.15.5:0/1783603786 shutdown_connections 2024-08-31T05:39:29.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.237+0000 7f15b9d96740 1 --2- 172.21.15.5:0/1783603786 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5608c0918390 0x5608c0cded90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:29.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.237+0000 7f15b9d96740 1 --2- 172.21.15.5:0/1783603786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608c09101b0 0x5608c0cde850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:29.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.237+0000 7f15b9d96740 1 --2- 172.21.15.5:0/1783603786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5608c0939070 0x5608c0cde310 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:29.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.237+0000 7f15b9d96740 1 -- 172.21.15.5:0/1783603786 >> 172.21.15.5:0/1783603786 conn(0x5608c092d460 msgr2=0x5608c0cdc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:29.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.237+0000 7f15b9d96740 1 -- 172.21.15.5:0/1783603786 shutdown_connections 2024-08-31T05:39:29.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.237+0000 7f15b9d96740 1 -- 172.21.15.5:0/1783603786 wait complete. 2024-08-31T05:39:29.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.238+0000 7f15b9d96740 1 -- start start 2024-08-31T05:39:29.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.238+0000 7f15b9d96740 1 Processor -- start 2024-08-31T05:39:29.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.239+0000 7f15b9d96740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5608c09101b0 0x5608c0ce9b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:29.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.239+0000 7f15b9d96740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5608c0918390 0x5608c0cea040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:29.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.239+0000 7f15b9d96740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608c0939070 0x5608c0cf5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:29.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.239+0000 7f15b9d96740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5608c0aa7700 con 0x5608c09101b0 2024-08-31T05:39:29.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.239+0000 7f15b9d96740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5608c0bcb750 con 0x5608c0939070 2024-08-31T05:39:29.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.239+0000 7f15b9d96740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5608c0cec8b0 con 0x5608c0918390 2024-08-31T05:39:29.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.239+0000 7f15b9d96740 10 client.0 _ll_register_callbacks cb 0x5608c0bfae10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:39:29.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.239+0000 7f15b1dbe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608c0939070 0x5608c0cf5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:29.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.239+0000 7f15b1dbe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608c0939070 0x5608c0cf5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:52690/0 (socket says 172.21.15.5:52690) 2024-08-31T05:39:29.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.239+0000 7f15b1dbe640 1 -- 172.21.15.5:0/4041837880 learned_addr learned my addr 172.21.15.5:0/4041837880 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:29.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.239+0000 7f15b0dbc640 1 --2- 172.21.15.5:0/4041837880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5608c0918390 0x5608c0cea040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:29.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.239+0000 7f15b15bd640 1 --2- 172.21.15.5:0/4041837880 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5608c09101b0 0x5608c0ce9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:29.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.240+0000 7f15b1dbe640 1 -- 172.21.15.5:0/4041837880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5608c0918390 msgr2=0x5608c0cea040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:29.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.240+0000 7f15b1dbe640 1 --2- 172.21.15.5:0/4041837880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5608c0918390 0x5608c0cea040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:29.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.240+0000 7f15b1dbe640 1 -- 172.21.15.5:0/4041837880 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5608c09101b0 msgr2=0x5608c0ce9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:29.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.240+0000 7f15b1dbe640 1 --2- 172.21.15.5:0/4041837880 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5608c09101b0 0x5608c0ce9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:29.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.240+0000 7f15b1dbe640 1 -- 172.21.15.5:0/4041837880 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608c0c04900 con 0x5608c0939070 2024-08-31T05:39:29.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.240+0000 7f15b1dbe640 1 --2- 172.21.15.5:0/4041837880 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608c0939070 0x5608c0cf5b60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f15a4013750 tx=0x7f15a4004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8199adf01a7067db server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:29.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.240+0000 7f1590ff9640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:39:29.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.240+0000 7f1590ff9640 1 -- 172.21.15.5:0/4041837880 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a4024020 con 0x5608c0939070 2024-08-31T05:39:29.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.240+0000 7f15b9d96740 1 -- 172.21.15.5:0/4041837880 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f159c036070 con 0x5608c0939070 2024-08-31T05:39:29.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.240+0000 7f1590ff9640 1 -- 172.21.15.5:0/4041837880 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7f15a4011a90 con 0x5608c0939070 2024-08-31T05:39:29.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.241+0000 7f1590ff9640 1 -- 172.21.15.5:0/4041837880 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f15a402f050 con 0x5608c0939070 2024-08-31T05:39:29.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.241+0000 7f15b9d96740 10 client.27677 fetch_fsmap learned FSMap version 34 2024-08-31T05:39:29.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.241+0000 7f15b9d96740 1 -- 172.21.15.5:0/4041837880 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5608c0cf8700 con 0x5608c0939070 2024-08-31T05:39:29.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.241+0000 7f1590ff9640 1 -- 172.21.15.5:0/4041837880 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f159c036070 con 0x5608c0939070 2024-08-31T05:39:29.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.241+0000 7f1590ff9640 1 -- 172.21.15.5:0/4041837880 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f15a401f3b0 con 0x5608c0939070 2024-08-31T05:39:29.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.241+0000 7f15b9d96740 10 client.27677 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:39:29.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.241+0000 7f15b9d96740 10 client.27677 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-31T05:39:29.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.241+0000 7f15b9d96740 20 client.27677 populate_metadata read hostname 'smithi005' 2024-08-31T05:39:29.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.241+0000 7f15b9d96740 1 --2- 172.21.15.5:0/4041837880 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x5608c08f79f0 0x5608c0cfbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:29.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.242+0000 7f15b9d96740 4 client.27677 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:39:29.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.242+0000 7f15b9d96740 1 -- 172.21.15.5:0/4041837880 --> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5608c0c575d0 con 0x5608c08f79f0 2024-08-31T05:39:29.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.243+0000 7f15b15bd640 1 --2- 172.21.15.5:0/4041837880 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x5608c08f79f0 0x5608c0cfbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:29.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.243+0000 7f15b15bd640 1 --2- 172.21.15.5:0/4041837880 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x5608c08f79f0 0x5608c0cfbdc0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4d0de07b5fe36bd6 server_cookie=34f864326b1387bb in_seq=0 out_seq=0 2024-08-31T05:39:29.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.244+0000 7f1590ff9640 10 client.27677 ms_handle_connect on v2:172.21.15.70:6836/2780036414 2024-08-31T05:39:29.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.247+0000 7f1590ff9640 1 -- 172.21.15.5:0/4041837880 <== mds.2 v2:172.21.15.70:6836/2780036414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5608c0c575d0 con 0x5608c08f79f0 2024-08-31T05:39:29.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.247+0000 7f1590ff9640 10 client.27677 handle_command_reply: tid=0 2024-08-31T05:39:29.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.247+0000 7f15b9d96740 1 client.27677 shutdown 2024-08-31T05:39:29.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.248+0000 7f15b9d96740 1 -- 172.21.15.5:0/4041837880 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608c0939070 msgr2=0x5608c0cf5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:29.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.248+0000 7f15b9d96740 1 --2- 172.21.15.5:0/4041837880 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608c0939070 0x5608c0cf5b60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f15a4013750 tx=0x7f15a4004730 comp rx=0 tx=0).stop 2024-08-31T05:39:29.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.249+0000 7f15b9d96740 1 -- 172.21.15.5:0/4041837880 shutdown_connections 2024-08-31T05:39:29.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.249+0000 7f15b9d96740 1 --2- 172.21.15.5:0/4041837880 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x5608c08f79f0 0x5608c0cfbdc0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:29.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.249+0000 7f15b9d96740 1 --2- 172.21.15.5:0/4041837880 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608c0939070 0x5608c0cf5b60 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:29.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.249+0000 7f15b9d96740 1 --2- 172.21.15.5:0/4041837880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5608c0918390 0x5608c0cea040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:29.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.249+0000 7f15b9d96740 1 --2- 172.21.15.5:0/4041837880 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5608c09101b0 0x5608c0ce9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:29.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.249+0000 7f15b9d96740 1 -- 172.21.15.5:0/4041837880 >> 172.21.15.5:0/4041837880 conn(0x5608c092d460 msgr2=0x5608c0ce14a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:29.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.250+0000 7f1590ff9640 0 client.27677 ms_handle_reset on v2:172.21.15.70:6836/2780036414 2024-08-31T05:39:29.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.250+0000 7f15b9d96740 1 -- 172.21.15.5:0/4041837880 shutdown_connections 2024-08-31T05:39:29.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.250+0000 7f15b9d96740 1 -- 172.21.15.5:0/4041837880 wait complete. 2024-08-31T05:39:29.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.250+0000 7f15b9d96740 20 client.27677 trim_cache size 0 max 16384 2024-08-31T05:39:29.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.273+0000 7f15b9d96740 1 Processor -- start 2024-08-31T05:39:29.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.273+0000 7f15b9d96740 1 -- start start 2024-08-31T05:39:29.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.274+0000 7f15b9d96740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5608c09101b0 0x5608c0cdc250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:29.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.274+0000 7f15b9d96740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5608c0918390 0x5608c0cf5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:29.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.274+0000 7f15b9d96740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608c0939070 0x5608c0cf5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:29.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.274+0000 7f15b9d96740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1598010060 con 0x5608c0918390 2024-08-31T05:39:29.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.274+0000 7f15b9d96740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1598011ba0 con 0x5608c0939070 2024-08-31T05:39:29.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.274+0000 7f15b9d96740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1598010730 con 0x5608c09101b0 2024-08-31T05:39:29.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.274+0000 7f15b15bd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5608c09101b0 0x5608c0cdc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:29.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.274+0000 7f15b0dbc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5608c0918390 0x5608c0cf5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:29.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.274+0000 7f15b15bd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5608c09101b0 0x5608c0cdc250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:52140/0 (socket says 172.21.15.5:52140) 2024-08-31T05:39:29.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.274+0000 7f15b15bd640 1 -- 172.21.15.5:0/1095702386 learned_addr learned my addr 172.21.15.5:0/1095702386 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:29.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.274+0000 7f15b1dbe640 1 --2- 172.21.15.5:0/1095702386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608c0939070 0x5608c0cf5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:29.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.274+0000 7f15b0dbc640 1 -- 172.21.15.5:0/1095702386 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5608c09101b0 msgr2=0x5608c0cdc250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:29.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.274+0000 7f15b0dbc640 1 --2- 172.21.15.5:0/1095702386 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5608c09101b0 0x5608c0cdc250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:29.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.274+0000 7f15b0dbc640 1 -- 172.21.15.5:0/1095702386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608c0939070 msgr2=0x5608c0cf5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:29.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.274+0000 7f15b0dbc640 1 --2- 172.21.15.5:0/1095702386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608c0939070 0x5608c0cf5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:29.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.274+0000 7f15b0dbc640 1 -- 172.21.15.5:0/1095702386 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608c0ceadc0 con 0x5608c0918390 2024-08-31T05:39:29.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.275+0000 7f15b0dbc640 1 --2- 172.21.15.5:0/1095702386 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5608c0918390 0x5608c0cf5aa0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x5608c0cdcf90 tx=0x7f15a0014780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35f5e7f6eec92d0c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:29.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.275+0000 7f1592ffd640 1 -- 172.21.15.5:0/1095702386 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a0022070 con 0x5608c0918390 2024-08-31T05:39:29.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.275+0000 7f1592ffd640 1 -- 172.21.15.5:0/1095702386 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f15a0009e50 con 0x5608c0918390 2024-08-31T05:39:29.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.275+0000 7f1592ffd640 1 -- 172.21.15.5:0/1095702386 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a0015710 con 0x5608c0918390 2024-08-31T05:39:29.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.276+0000 7f15b9d96740 1 -- 172.21.15.5:0/1095702386 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5608c0918390 msgr2=0x5608c0cf5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:29.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.276+0000 7f15b9d96740 1 --2- 172.21.15.5:0/1095702386 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5608c0918390 0x5608c0cf5aa0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x5608c0cdcf90 tx=0x7f15a0014780 comp rx=0 tx=0).stop 2024-08-31T05:39:29.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.276+0000 7f15b9d96740 1 -- 172.21.15.5:0/1095702386 shutdown_connections 2024-08-31T05:39:29.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.276+0000 7f15b9d96740 1 --2- 172.21.15.5:0/1095702386 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608c0939070 0x5608c0cf5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:29.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.276+0000 7f15b9d96740 1 --2- 172.21.15.5:0/1095702386 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5608c0918390 0x5608c0cf5aa0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:29.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.276+0000 7f15b9d96740 1 --2- 172.21.15.5:0/1095702386 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5608c09101b0 0x5608c0cdc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:29.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.276+0000 7f15b9d96740 1 -- 172.21.15.5:0/1095702386 >> 172.21.15.5:0/1095702386 conn(0x5608c092d460 msgr2=0x5608c0cdbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:29.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.276+0000 7f15b9d96740 1 -- 172.21.15.5:0/1095702386 shutdown_connections 2024-08-31T05:39:29.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.276+0000 7f15b9d96740 1 -- 172.21.15.5:0/1095702386 wait complete. 2024-08-31T05:39:29.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.277+0000 7f15b9d96740 1 -- start start 2024-08-31T05:39:29.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.277+0000 7f15b9d96740 1 Processor -- start 2024-08-31T05:39:29.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.277+0000 7f15b9d96740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5608c09101b0 0x5608c0cedc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:29.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.277+0000 7f15b9d96740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5608c0918390 0x5608c0cee150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:29.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.277+0000 7f15b9d96740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608c0939070 0x5608c0cee690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:29.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.277+0000 7f15b9d96740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f15980114d0 con 0x5608c09101b0 2024-08-31T05:39:29.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.277+0000 7f15b9d96740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1598010e00 con 0x5608c0939070 2024-08-31T05:39:29.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.277+0000 7f15b9d96740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f159800e060 con 0x5608c0918390 2024-08-31T05:39:29.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.278+0000 7f15b9d96740 10 client.0 _ll_register_callbacks cb 0x7f15a4013330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:39:29.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.278+0000 7f15b15bd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5608c09101b0 0x5608c0cedc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:29.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.278+0000 7f15b1dbe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608c0939070 0x5608c0cee690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:29.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.278+0000 7f15b15bd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5608c09101b0 0x5608c0cedc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40384/0 (socket says 172.21.15.5:40384) 2024-08-31T05:39:29.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.278+0000 7f15b15bd640 1 -- 172.21.15.5:0/1819656200 learned_addr learned my addr 172.21.15.5:0/1819656200 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:29.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.278+0000 7f15b0dbc640 1 --2- 172.21.15.5:0/1819656200 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5608c0918390 0x5608c0cee150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:29.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.278+0000 7f15b1dbe640 1 -- 172.21.15.5:0/1819656200 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5608c0918390 msgr2=0x5608c0cee150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:29.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.278+0000 7f15b1dbe640 1 --2- 172.21.15.5:0/1819656200 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5608c0918390 0x5608c0cee150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:29.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.278+0000 7f15b1dbe640 1 -- 172.21.15.5:0/1819656200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5608c09101b0 msgr2=0x5608c0cedc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:29.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.278+0000 7f15b1dbe640 1 --2- 172.21.15.5:0/1819656200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5608c09101b0 0x5608c0cedc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:29.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.278+0000 7f15b1dbe640 1 -- 172.21.15.5:0/1819656200 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608c0d658b0 con 0x5608c0939070 2024-08-31T05:39:29.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.278+0000 7f15b1dbe640 1 --2- 172.21.15.5:0/1819656200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608c0939070 0x5608c0cee690 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f15a4013040 tx=0x7f15a401f660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f046cffab0e91682 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:29.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.278+0000 7f1590ff9640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:39:29.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.279+0000 7f1590ff9640 1 -- 172.21.15.5:0/1819656200 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a4024040 con 0x5608c0939070 2024-08-31T05:39:29.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.279+0000 7f15b9d96740 1 -- 172.21.15.5:0/1819656200 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15a0009e50 con 0x5608c0939070 2024-08-31T05:39:29.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.279+0000 7f1590ff9640 1 -- 172.21.15.5:0/1819656200 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7f15a401fe50 con 0x5608c0939070 2024-08-31T05:39:29.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.279+0000 7f1590ff9640 1 -- 172.21.15.5:0/1819656200 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f15a4011890 con 0x5608c0939070 2024-08-31T05:39:29.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.279+0000 7f15b9d96740 10 client.27683 fetch_fsmap learned FSMap version 34 2024-08-31T05:39:29.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.279+0000 7f15b9d96740 1 -- 172.21.15.5:0/1819656200 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5608c0d66b90 con 0x5608c0939070 2024-08-31T05:39:29.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.280+0000 7f1590ff9640 1 -- 172.21.15.5:0/1819656200 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f15a0009e50 con 0x5608c0939070 2024-08-31T05:39:29.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.280+0000 7f1590ff9640 1 -- 172.21.15.5:0/1819656200 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f15a4020b80 con 0x5608c0939070 2024-08-31T05:39:29.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.280+0000 7f15b9d96740 10 client.27683 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:39:29.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.280+0000 7f15b9d96740 10 client.27683 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-31T05:39:29.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.280+0000 7f15b9d96740 20 client.27683 populate_metadata read hostname 'smithi005' 2024-08-31T05:39:29.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.280+0000 7f15b9d96740 1 --2- 172.21.15.5:0/1819656200 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x5608c08ccda0 0x5608c0d692a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:29.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.280+0000 7f15b9d96740 4 client.27683 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:39:29.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.280+0000 7f15b9d96740 1 -- 172.21.15.5:0/1819656200 --> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5608c0c53070 con 0x5608c08ccda0 2024-08-31T05:39:29.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.280+0000 7f15b15bd640 1 --2- 172.21.15.5:0/1819656200 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x5608c08ccda0 0x5608c0d692a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:29.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.281+0000 7f1590ff9640 10 client.27683 ms_handle_connect on v2:172.21.15.70:6836/2780036414 2024-08-31T05:39:29.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.281+0000 7f15b15bd640 1 --2- 172.21.15.5:0/1819656200 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x5608c08ccda0 0x5608c0d692a0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6b5db8af7e9ae79b server_cookie=e2b6576e57764a7b in_seq=0 out_seq=0 2024-08-31T05:39:29.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.281+0000 7f1590ff9640 1 -- 172.21.15.5:0/1819656200 <== mds.2 v2:172.21.15.70:6836/2780036414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5608c0c53070 con 0x5608c08ccda0 2024-08-31T05:39:29.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.281+0000 7f1590ff9640 10 client.27683 handle_command_reply: tid=0 2024-08-31T05:39:29.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.281+0000 7f15b9d96740 1 client.27683 shutdown 2024-08-31T05:39:29.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.281+0000 7f15b9d96740 1 -- 172.21.15.5:0/1819656200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608c0939070 msgr2=0x5608c0cee690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:29.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.281+0000 7f15b9d96740 1 --2- 172.21.15.5:0/1819656200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608c0939070 0x5608c0cee690 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f15a4013040 tx=0x7f15a401f660 comp rx=0 tx=0).stop 2024-08-31T05:39:29.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.281+0000 7f15b9d96740 1 -- 172.21.15.5:0/1819656200 shutdown_connections 2024-08-31T05:39:29.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.281+0000 7f15b9d96740 1 --2- 172.21.15.5:0/1819656200 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x5608c08ccda0 0x5608c0d692a0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:29.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.282+0000 7f15b9d96740 1 --2- 172.21.15.5:0/1819656200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5608c0939070 0x5608c0cee690 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:29.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.282+0000 7f15b9d96740 1 --2- 172.21.15.5:0/1819656200 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5608c0918390 0x5608c0cee150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:29.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.282+0000 7f1590ff9640 0 client.27683 ms_handle_reset on v2:172.21.15.70:6836/2780036414 2024-08-31T05:39:29.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.282+0000 7f15b9d96740 1 --2- 172.21.15.5:0/1819656200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5608c09101b0 0x5608c0cedc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:29.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.282+0000 7f15b9d96740 1 -- 172.21.15.5:0/1819656200 >> 172.21.15.5:0/1819656200 conn(0x5608c092d460 msgr2=0x5608c0ce1410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:29.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.282+0000 7f15b9d96740 1 -- 172.21.15.5:0/1819656200 shutdown_connections 2024-08-31T05:39:29.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.282+0000 7f15b9d96740 1 -- 172.21.15.5:0/1819656200 wait complete. 2024-08-31T05:39:29.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.282+0000 7f15b9d96740 20 client.27683 trim_cache size 0 max 16384 2024-08-31T05:39:29.288 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:39:29.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.283+0000 7f15b3821640 1 -- 172.21.15.5:0/1391019451 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f15940b4d20 msgr2=0x7f15940b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:29.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.283+0000 7f15b3821640 1 --2- 172.21.15.5:0/1391019451 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f15940b4d20 0x7f15940b7230 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f15a40104e0 tx=0x7f15a40108e0 comp rx=0 tx=0).stop 2024-08-31T05:39:29.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.283+0000 7f15b3821640 1 -- 172.21.15.5:0/1391019451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15ac102800 msgr2=0x7f15ac10cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:29.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.283+0000 7f15b3821640 1 --2- 172.21.15.5:0/1391019451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15ac102800 0x7f15ac10cd20 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f159c02aee0 tx=0x7f159c031870 comp rx=0 tx=0).stop 2024-08-31T05:39:29.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.283+0000 7f15b3821640 1 -- 172.21.15.5:0/1391019451 shutdown_connections 2024-08-31T05:39:29.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.283+0000 7f15b3821640 1 --2- 172.21.15.5:0/1391019451 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f15940b4d20 0x7f15940b7230 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:29.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.283+0000 7f15b3821640 1 --2- 172.21.15.5:0/1391019451 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f15ac108a90 0x7f15ac1ac3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:29.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.283+0000 7f15b3821640 1 --2- 172.21.15.5:0/1391019451 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f15ac108140 0x7f15ac10d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:29.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.283+0000 7f15b3821640 1 --2- 172.21.15.5:0/1391019451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f15ac102800 0x7f15ac10cd20 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:29.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.283+0000 7f15b3821640 1 -- 172.21.15.5:0/1391019451 >> 172.21.15.5:0/1391019451 conn(0x7f15ac0794d0 msgr2=0x7f15ac1011a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:29.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.283+0000 7f15b3821640 1 -- 172.21.15.5:0/1391019451 shutdown_connections 2024-08-31T05:39:29.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:29.283+0000 7f15b3821640 1 -- 172.21.15.5:0/1391019451 wait complete. 2024-08-31T05:39:29.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:39:28 smithi070 ceph-mon[22316]: pgmap v636: 129 pgs: 129 active+clean; 557 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.7 MiB/s wr, 198 op/s 2024-08-31T05:39:29.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:39:28 smithi050 ceph-mon[22146]: pgmap v636: 129 pgs: 129 active+clean; 557 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.7 MiB/s wr, 198 op/s 2024-08-31T05:39:29.933 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1075199 11.12 MB/sec execute 377 sec latency 17.419 ms 2024-08-31T05:39:30.315 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T05:39:30.575 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:39:30.933 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1076994 11.13 MB/sec execute 378 sec latency 72.632 ms 2024-08-31T05:39:31.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:39:30 smithi005 ceph-mon[18602]: pgmap v637: 129 pgs: 129 active+clean; 568 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 5.0 MiB/s wr, 252 op/s 2024-08-31T05:39:31.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.235+0000 7fbb5c77c640 1 -- 172.21.15.5:0/2965773349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb54102840 msgr2=0x7fbb54102c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:31.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.235+0000 7fbb5c77c640 1 --2- 172.21.15.5:0/2965773349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb54102840 0x7fbb54102c50 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fbb50009900 tx=0x7fbb5002a410 comp rx=0 tx=0).stop 2024-08-31T05:39:31.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.235+0000 7fbb5c77c640 1 -- 172.21.15.5:0/2965773349 shutdown_connections 2024-08-31T05:39:31.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.235+0000 7fbb5c77c640 1 --2- 172.21.15.5:0/2965773349 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb54108ad0 0x7fbb5410f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:31.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.235+0000 7fbb5c77c640 1 --2- 172.21.15.5:0/2965773349 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb54108180 0x7fbb54108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:31.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.235+0000 7fbb5c77c640 1 --2- 172.21.15.5:0/2965773349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb54102840 0x7fbb54102c50 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:31.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.235+0000 7fbb5c77c640 1 -- 172.21.15.5:0/2965773349 >> 172.21.15.5:0/2965773349 conn(0x7fbb540794f0 msgr2=0x7fbb54079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:31.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.236+0000 7fbb5c77c640 1 -- 172.21.15.5:0/2965773349 shutdown_connections 2024-08-31T05:39:31.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.236+0000 7fbb5c77c640 1 -- 172.21.15.5:0/2965773349 wait complete. 2024-08-31T05:39:31.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.236+0000 7fbb5c77c640 1 Processor -- start 2024-08-31T05:39:31.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.237+0000 7fbb5c77c640 1 -- start start 2024-08-31T05:39:31.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.237+0000 7fbb5c77c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb54102840 0x7fbb5419c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:31.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.237+0000 7fbb5c77c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb54108180 0x7fbb5419c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:31.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.237+0000 7fbb5c77c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb54108ad0 0x7fbb541a1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:31.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.237+0000 7fbb5c77c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbb541127a0 con 0x7fbb54108180 2024-08-31T05:39:31.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.237+0000 7fbb5c77c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbb54112620 con 0x7fbb54102840 2024-08-31T05:39:31.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.237+0000 7fbb5c77c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbb54112920 con 0x7fbb54108ad0 2024-08-31T05:39:31.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.237+0000 7fbb59d17640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb54108180 0x7fbb5419c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:31.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.237+0000 7fbb59d17640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb54108180 0x7fbb5419c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40392/0 (socket says 172.21.15.5:40392) 2024-08-31T05:39:31.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.237+0000 7fbb59d17640 1 -- 172.21.15.5:0/848161110 learned_addr learned my addr 172.21.15.5:0/848161110 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:31.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.237+0000 7fbb5a518640 1 --2- 172.21.15.5:0/848161110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb54102840 0x7fbb5419c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:31.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.237+0000 7fbb5ad19640 1 --2- 172.21.15.5:0/848161110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb54108ad0 0x7fbb541a1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:31.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.238+0000 7fbb59d17640 1 -- 172.21.15.5:0/848161110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb54108ad0 msgr2=0x7fbb541a1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:31.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.238+0000 7fbb59d17640 1 --2- 172.21.15.5:0/848161110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb54108ad0 0x7fbb541a1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:31.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.238+0000 7fbb59d17640 1 -- 172.21.15.5:0/848161110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb54102840 msgr2=0x7fbb5419c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:31.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.238+0000 7fbb59d17640 1 --2- 172.21.15.5:0/848161110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb54102840 0x7fbb5419c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:31.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.238+0000 7fbb59d17640 1 -- 172.21.15.5:0/848161110 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb541a23c0 con 0x7fbb54108180 2024-08-31T05:39:31.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.238+0000 7fbb59d17640 1 --2- 172.21.15.5:0/848161110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb54108180 0x7fbb5419c9f0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fbb4400e9f0 tx=0x7fbb4400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:31.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.238+0000 7fbb4b7fe640 1 -- 172.21.15.5:0/848161110 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4400ccc0 con 0x7fbb54108180 2024-08-31T05:39:31.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.239+0000 7fbb4b7fe640 1 -- 172.21.15.5:0/848161110 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb440108e0 con 0x7fbb54108180 2024-08-31T05:39:31.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.239+0000 7fbb5c77c640 1 -- 172.21.15.5:0/848161110 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb541a26b0 con 0x7fbb54108180 2024-08-31T05:39:31.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.239+0000 7fbb5c77c640 1 -- 172.21.15.5:0/848161110 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb541a8e10 con 0x7fbb54108180 2024-08-31T05:39:31.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.239+0000 7fbb4b7fe640 1 -- 172.21.15.5:0/848161110 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb44018860 con 0x7fbb54108180 2024-08-31T05:39:31.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.242+0000 7fbb62cf1740 1 Processor -- start 2024-08-31T05:39:31.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.242+0000 7fbb62cf1740 1 -- start start 2024-08-31T05:39:31.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.243+0000 7fbb62cf1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d50e1b1070 0x55d50e556310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:31.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.243+0000 7fbb62cf1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d50e1881b0 0x55d50e556850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:31.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.243+0000 7fbb62cf1740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d50e190390 0x55d50e556d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:31.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.243+0000 7fbb62cf1740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55d50e4cd680 con 0x55d50e190390 2024-08-31T05:39:31.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.243+0000 7fbb62cf1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d50e4bcc10 con 0x55d50e1881b0 2024-08-31T05:39:31.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.243+0000 7fbb62cf1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d50e4c0bc0 con 0x55d50e1b1070 2024-08-31T05:39:31.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.243+0000 7fbb4b7fe640 1 -- 172.21.15.5:0/848161110 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fbb44010430 con 0x7fbb54108180 2024-08-31T05:39:31.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.243+0000 7fbb5a518640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d50e1881b0 0x55d50e556850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:31.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.243+0000 7fbb5ad19640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d50e1b1070 0x55d50e556310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:31.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.243+0000 7fbb5a518640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d50e1881b0 0x55d50e556850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:52724/0 (socket says 172.21.15.5:52724) 2024-08-31T05:39:31.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.243+0000 7fbb5a518640 1 -- 172.21.15.5:0/4223577296 learned_addr learned my addr 172.21.15.5:0/4223577296 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:31.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.243+0000 7fbb59d17640 1 --2- 172.21.15.5:0/4223577296 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d50e190390 0x55d50e556d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:31.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.243+0000 7fbb5ad19640 1 -- 172.21.15.5:0/4223577296 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d50e1881b0 msgr2=0x55d50e556850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:31.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.243+0000 7fbb5ad19640 1 --2- 172.21.15.5:0/4223577296 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d50e1881b0 0x55d50e556850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:31.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.243+0000 7fbb5ad19640 1 -- 172.21.15.5:0/4223577296 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d50e190390 msgr2=0x55d50e556d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:31.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.243+0000 7fbb5ad19640 1 --2- 172.21.15.5:0/4223577296 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d50e190390 0x55d50e556d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:31.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.243+0000 7fbb5ad19640 1 -- 172.21.15.5:0/4223577296 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d50e21c650 con 0x55d50e1b1070 2024-08-31T05:39:31.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.243+0000 7fbb5a518640 1 --2- 172.21.15.5:0/4223577296 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d50e1881b0 0x55d50e556850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:39:31.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.243+0000 7fbb59d17640 1 --2- 172.21.15.5:0/4223577296 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d50e190390 0x55d50e556d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:39:31.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.244+0000 7fbb5ad19640 1 --2- 172.21.15.5:0/4223577296 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d50e1b1070 0x55d50e556310 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c009f30 tx=0x7fbb4c010800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5b98713f7c30f60 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:31.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.244+0000 7fbb4b7fe640 1 --2- 172.21.15.5:0/848161110 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fbb400b4d20 0x7fbb400b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:31.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.244+0000 7fbb48ff9640 1 -- 172.21.15.5:0/4223577296 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c016070 con 0x55d50e1b1070 2024-08-31T05:39:31.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.244+0000 7fbb5a518640 1 --2- 172.21.15.5:0/848161110 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fbb400b4d20 0x7fbb400b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:31.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.244+0000 7fbb4b7fe640 1 -- 172.21.15.5:0/848161110 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7fbb440e5b30 con 0x7fbb54108180 2024-08-31T05:39:31.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.244+0000 7fbb48ff9640 1 -- 172.21.15.5:0/4223577296 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb4c004d20 con 0x55d50e1b1070 2024-08-31T05:39:31.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.244+0000 7fbb48ff9640 1 -- 172.21.15.5:0/4223577296 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c0127d0 con 0x55d50e1b1070 2024-08-31T05:39:31.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.245+0000 7fbb62cf1740 1 -- 172.21.15.5:0/4223577296 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d50e1b1070 msgr2=0x55d50e556310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:31.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.245+0000 7fbb62cf1740 1 --2- 172.21.15.5:0/4223577296 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d50e1b1070 0x55d50e556310 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c009f30 tx=0x7fbb4c010800 comp rx=0 tx=0).stop 2024-08-31T05:39:31.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.245+0000 7fbb5a518640 1 --2- 172.21.15.5:0/848161110 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fbb400b4d20 0x7fbb400b7230 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fbb50005f70 tx=0x7fbb50005890 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:31.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.245+0000 7fbb62cf1740 1 -- 172.21.15.5:0/4223577296 shutdown_connections 2024-08-31T05:39:31.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.245+0000 7fbb62cf1740 1 --2- 172.21.15.5:0/4223577296 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d50e190390 0x55d50e556d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:31.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.245+0000 7fbb62cf1740 1 --2- 172.21.15.5:0/4223577296 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d50e1881b0 0x55d50e556850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:31.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.245+0000 7fbb62cf1740 1 --2- 172.21.15.5:0/4223577296 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d50e1b1070 0x55d50e556310 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:31.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.245+0000 7fbb62cf1740 1 -- 172.21.15.5:0/4223577296 >> 172.21.15.5:0/4223577296 conn(0x55d50e1a5460 msgr2=0x55d50e554200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:31.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.246+0000 7fbb62cf1740 1 -- 172.21.15.5:0/4223577296 shutdown_connections 2024-08-31T05:39:31.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.246+0000 7fbb62cf1740 1 -- 172.21.15.5:0/4223577296 wait complete. 2024-08-31T05:39:31.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.246+0000 7fbb62cf1740 1 -- start start 2024-08-31T05:39:31.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.246+0000 7fbb62cf1740 1 Processor -- start 2024-08-31T05:39:31.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.247+0000 7fbb62cf1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d50e1881b0 0x55d50e561ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:31.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.247+0000 7fbb62cf1740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d50e190390 0x55d50e561ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:31.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.247+0000 7fbb62cf1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d50e1b1070 0x55d50e56de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:31.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.247+0000 7fbb62cf1740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55d50e31f700 con 0x55d50e190390 2024-08-31T05:39:31.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.247+0000 7fbb62cf1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d50e443750 con 0x55d50e1881b0 2024-08-31T05:39:31.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.247+0000 7fbb62cf1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d50e564af0 con 0x55d50e1b1070 2024-08-31T05:39:31.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.247+0000 7fbb62cf1740 10 client.0 _ll_register_callbacks cb 0x55d50e472e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:39:31.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.247+0000 7fbb5ad19640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d50e1b1070 0x55d50e56de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:31.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.247+0000 7fbb59d17640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d50e190390 0x55d50e561ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:31.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.247+0000 7fbb5ad19640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d50e1b1070 0x55d50e56de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:52192/0 (socket says 172.21.15.5:52192) 2024-08-31T05:39:31.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.247+0000 7fbb5ad19640 1 -- 172.21.15.5:0/2680164137 learned_addr learned my addr 172.21.15.5:0/2680164137 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:31.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.247+0000 7fbb5a518640 1 --2- 172.21.15.5:0/2680164137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d50e1881b0 0x55d50e561ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:31.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.247+0000 7fbb59d17640 1 -- 172.21.15.5:0/2680164137 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d50e1b1070 msgr2=0x55d50e56de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:31.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.248+0000 7fbb59d17640 1 --2- 172.21.15.5:0/2680164137 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d50e1b1070 0x55d50e56de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:31.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.248+0000 7fbb59d17640 1 -- 172.21.15.5:0/2680164137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d50e1881b0 msgr2=0x55d50e561ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:31.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.248+0000 7fbb59d17640 1 --2- 172.21.15.5:0/2680164137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d50e1881b0 0x55d50e561ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:31.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.248+0000 7fbb59d17640 1 -- 172.21.15.5:0/2680164137 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d50e47c900 con 0x55d50e190390 2024-08-31T05:39:31.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.248+0000 7fbb5a518640 1 --2- 172.21.15.5:0/2680164137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d50e1881b0 0x55d50e561ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:39:31.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.248+0000 7fbb5ad19640 1 --2- 172.21.15.5:0/2680164137 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d50e1b1070 0x55d50e56de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:39:31.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.248+0000 7fbb59d17640 1 --2- 172.21.15.5:0/2680164137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d50e190390 0x55d50e561ff0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fbb440e2ea0 tx=0x7fbb440096a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=550ccba621ea2dd2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:31.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.249+0000 7fbb3dffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:39:31.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.249+0000 7fbb3dffb640 1 -- 172.21.15.5:0/2680164137 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb440aba00 con 0x55d50e190390 2024-08-31T05:39:31.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.249+0000 7fbb3dffb640 1 -- 172.21.15.5:0/2680164137 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7fbb440930e0 con 0x55d50e190390 2024-08-31T05:39:31.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.249+0000 7fbb62cf1740 1 -- 172.21.15.5:0/2680164137 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb4c004d20 con 0x55d50e190390 2024-08-31T05:39:31.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.250+0000 7fbb3dffb640 1 -- 172.21.15.5:0/2680164137 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fbb440abef0 con 0x55d50e190390 2024-08-31T05:39:31.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.250+0000 7fbb62cf1740 10 client.18117 fetch_fsmap learned FSMap version 34 2024-08-31T05:39:31.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.250+0000 7fbb62cf1740 1 -- 172.21.15.5:0/2680164137 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55d50e570950 con 0x55d50e190390 2024-08-31T05:39:31.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.250+0000 7fbb3dffb640 1 -- 172.21.15.5:0/2680164137 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb4c004d20 con 0x55d50e190390 2024-08-31T05:39:31.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.250+0000 7fbb3dffb640 1 -- 172.21.15.5:0/2680164137 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fbb44091ce0 con 0x55d50e190390 2024-08-31T05:39:31.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.250+0000 7fbb62cf1740 10 client.18117 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:39:31.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.250+0000 7fbb62cf1740 10 client.18117 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-31T05:39:31.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.250+0000 7fbb62cf1740 20 client.18117 populate_metadata read hostname 'smithi005' 2024-08-31T05:39:31.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.251+0000 7fbb62cf1740 1 --2- 172.21.15.5:0/2680164137 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55d50e16f9f0 0x55d50e574310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:31.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.251+0000 7fbb62cf1740 4 client.18117 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:39:31.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.251+0000 7fbb62cf1740 1 -- 172.21.15.5:0/2680164137 --> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d50e4cf5d0 con 0x55d50e16f9f0 2024-08-31T05:39:31.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.251+0000 7fbb5a518640 1 --2- 172.21.15.5:0/2680164137 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55d50e16f9f0 0x55d50e574310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:31.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.252+0000 7fbb5a518640 1 --2- 172.21.15.5:0/2680164137 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55d50e16f9f0 0x55d50e574310 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7a8d62e046793c59 server_cookie=f2af7097ed581f02 in_seq=0 out_seq=0 2024-08-31T05:39:31.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.252+0000 7fbb3dffb640 10 client.18117 ms_handle_connect on v2:172.21.15.50:6838/98200944 2024-08-31T05:39:31.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.253+0000 7fbb3dffb640 1 -- 172.21.15.5:0/2680164137 <== mds.1 v2:172.21.15.50:6838/98200944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d50e4cf5d0 con 0x55d50e16f9f0 2024-08-31T05:39:31.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.253+0000 7fbb3dffb640 10 client.18117 handle_command_reply: tid=0 2024-08-31T05:39:31.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.253+0000 7fbb62cf1740 1 client.18117 shutdown 2024-08-31T05:39:31.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.253+0000 7fbb62cf1740 1 -- 172.21.15.5:0/2680164137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d50e190390 msgr2=0x55d50e561ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:31.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.253+0000 7fbb62cf1740 1 --2- 172.21.15.5:0/2680164137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d50e190390 0x55d50e561ff0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fbb440e2ea0 tx=0x7fbb440096a0 comp rx=0 tx=0).stop 2024-08-31T05:39:31.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.253+0000 7fbb62cf1740 1 -- 172.21.15.5:0/2680164137 shutdown_connections 2024-08-31T05:39:31.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.253+0000 7fbb62cf1740 1 --2- 172.21.15.5:0/2680164137 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55d50e16f9f0 0x55d50e574310 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:31.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.253+0000 7fbb62cf1740 1 --2- 172.21.15.5:0/2680164137 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d50e1b1070 0x55d50e56de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:31.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.253+0000 7fbb62cf1740 1 --2- 172.21.15.5:0/2680164137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d50e190390 0x55d50e561ff0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:31.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.253+0000 7fbb62cf1740 1 --2- 172.21.15.5:0/2680164137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d50e1881b0 0x55d50e561ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:31.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.253+0000 7fbb62cf1740 1 -- 172.21.15.5:0/2680164137 >> 172.21.15.5:0/2680164137 conn(0x55d50e1a5460 msgr2=0x55d50e5594a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:31.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.253+0000 7fbb3dffb640 0 client.18117 ms_handle_reset on v2:172.21.15.50:6838/98200944 2024-08-31T05:39:31.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.253+0000 7fbb62cf1740 1 -- 172.21.15.5:0/2680164137 shutdown_connections 2024-08-31T05:39:31.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.254+0000 7fbb62cf1740 1 -- 172.21.15.5:0/2680164137 wait complete. 2024-08-31T05:39:31.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.254+0000 7fbb62cf1740 20 client.18117 trim_cache size 0 max 16384 2024-08-31T05:39:31.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.281+0000 7fbb62cf1740 1 Processor -- start 2024-08-31T05:39:31.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.281+0000 7fbb62cf1740 1 -- start start 2024-08-31T05:39:31.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.281+0000 7fbb62cf1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d50e1881b0 0x55d50e559b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:31.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.281+0000 7fbb62cf1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d50e190390 0x55d50e56dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:31.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.281+0000 7fbb62cf1740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d50e1b1070 0x55d50e56e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:31.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.282+0000 7fbb62cf1740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbb541b3020 con 0x55d50e1b1070 2024-08-31T05:39:31.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.282+0000 7fbb62cf1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbb541b4b60 con 0x55d50e190390 2024-08-31T05:39:31.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.282+0000 7fbb62cf1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbb541b36f0 con 0x55d50e1881b0 2024-08-31T05:39:31.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.282+0000 7fbb5ad19640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d50e1b1070 0x55d50e56e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:31.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.282+0000 7fbb5ad19640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d50e1b1070 0x55d50e56e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40418/0 (socket says 172.21.15.5:40418) 2024-08-31T05:39:31.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.282+0000 7fbb5ad19640 1 -- 172.21.15.5:0/1540615407 learned_addr learned my addr 172.21.15.5:0/1540615407 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:31.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.282+0000 7fbb5a518640 1 --2- 172.21.15.5:0/1540615407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d50e1881b0 0x55d50e559b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:31.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.282+0000 7fbb59d17640 1 --2- 172.21.15.5:0/1540615407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d50e190390 0x55d50e56dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:31.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.282+0000 7fbb5ad19640 1 -- 172.21.15.5:0/1540615407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d50e1881b0 msgr2=0x55d50e559b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:31.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.282+0000 7fbb5ad19640 1 --2- 172.21.15.5:0/1540615407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d50e1881b0 0x55d50e559b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:31.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.282+0000 7fbb5ad19640 1 -- 172.21.15.5:0/1540615407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d50e190390 msgr2=0x55d50e56dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:31.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.282+0000 7fbb5ad19640 1 --2- 172.21.15.5:0/1540615407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d50e190390 0x55d50e56dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:31.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.282+0000 7fbb5ad19640 1 -- 172.21.15.5:0/1540615407 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d50e16fc20 con 0x55d50e1b1070 2024-08-31T05:39:31.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.284+0000 7fbb5ad19640 1 --2- 172.21.15.5:0/1540615407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d50e1b1070 0x55d50e56e280 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c005a80 tx=0x7fbb4c005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c81f90788010ca19 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:31.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.284+0000 7fbb3ffff640 1 -- 172.21.15.5:0/1540615407 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c016070 con 0x55d50e1b1070 2024-08-31T05:39:31.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.284+0000 7fbb3ffff640 1 -- 172.21.15.5:0/1540615407 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb4c003cf0 con 0x55d50e1b1070 2024-08-31T05:39:31.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.284+0000 7fbb3ffff640 1 -- 172.21.15.5:0/1540615407 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c012a00 con 0x55d50e1b1070 2024-08-31T05:39:31.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.286+0000 7fbb62cf1740 1 -- 172.21.15.5:0/1540615407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d50e1b1070 msgr2=0x55d50e56e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:31.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.286+0000 7fbb62cf1740 1 --2- 172.21.15.5:0/1540615407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d50e1b1070 0x55d50e56e280 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c005a80 tx=0x7fbb4c005c50 comp rx=0 tx=0).stop 2024-08-31T05:39:31.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.286+0000 7fbb62cf1740 1 -- 172.21.15.5:0/1540615407 shutdown_connections 2024-08-31T05:39:31.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.286+0000 7fbb62cf1740 1 --2- 172.21.15.5:0/1540615407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d50e1b1070 0x55d50e56e280 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:31.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.286+0000 7fbb62cf1740 1 --2- 172.21.15.5:0/1540615407 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d50e190390 0x55d50e56dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:31.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.286+0000 7fbb62cf1740 1 --2- 172.21.15.5:0/1540615407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d50e1881b0 0x55d50e559b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:31.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.286+0000 7fbb62cf1740 1 -- 172.21.15.5:0/1540615407 >> 172.21.15.5:0/1540615407 conn(0x55d50e1a5460 msgr2=0x55d50e559410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:31.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.286+0000 7fbb62cf1740 1 -- 172.21.15.5:0/1540615407 shutdown_connections 2024-08-31T05:39:31.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.287+0000 7fbb62cf1740 1 -- 172.21.15.5:0/1540615407 wait complete. 2024-08-31T05:39:31.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.287+0000 7fbb62cf1740 1 -- start start 2024-08-31T05:39:31.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.287+0000 7fbb62cf1740 1 Processor -- start 2024-08-31T05:39:31.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.288+0000 7fbb62cf1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d50e1881b0 0x55d50e56a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:31.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.288+0000 7fbb62cf1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d50e190390 0x55d50e56a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:31.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.288+0000 7fbb62cf1740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d50e1b1070 0x55d50e565940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:31.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.288+0000 7fbb5a518640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d50e1881b0 0x55d50e56a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:31.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.288+0000 7fbb5a518640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d50e1881b0 0x55d50e56a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:52212/0 (socket says 172.21.15.5:52212) 2024-08-31T05:39:31.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.288+0000 7fbb59d17640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d50e190390 0x55d50e56a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:31.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.288+0000 7fbb59d17640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d50e190390 0x55d50e56a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:52760/0 (socket says 172.21.15.5:52760) 2024-08-31T05:39:31.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.289+0000 7fbb5a518640 1 -- 172.21.15.5:0/1017169825 learned_addr learned my addr 172.21.15.5:0/1017169825 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:31.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.289+0000 7fbb62cf1740 1 -- 172.21.15.5:0/1017169825 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbb541b4490 con 0x55d50e1b1070 2024-08-31T05:39:31.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.289+0000 7fbb62cf1740 1 -- 172.21.15.5:0/1017169825 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbb541b3dc0 con 0x55d50e190390 2024-08-31T05:39:31.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.289+0000 7fbb5ad19640 1 --2- 172.21.15.5:0/1017169825 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d50e1b1070 0x55d50e565940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:31.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.289+0000 7fbb62cf1740 1 -- 172.21.15.5:0/1017169825 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbb541b1020 con 0x55d50e1881b0 2024-08-31T05:39:31.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.289+0000 7fbb62cf1740 10 client.0 _ll_register_callbacks cb 0x7fbb440e9390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:39:31.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.289+0000 7fbb59d17640 1 -- 172.21.15.5:0/1017169825 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d50e1881b0 msgr2=0x55d50e56a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:31.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.289+0000 7fbb59d17640 1 --2- 172.21.15.5:0/1017169825 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d50e1881b0 0x55d50e56a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:31.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.289+0000 7fbb59d17640 1 -- 172.21.15.5:0/1017169825 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d50e1b1070 msgr2=0x55d50e565940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:31.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.289+0000 7fbb59d17640 1 --2- 172.21.15.5:0/1017169825 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d50e1b1070 0x55d50e565940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:31.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.289+0000 7fbb59d17640 1 -- 172.21.15.5:0/1017169825 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d50e5660d0 con 0x55d50e190390 2024-08-31T05:39:31.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.290+0000 7fbb59d17640 1 --2- 172.21.15.5:0/1017169825 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d50e190390 0x55d50e56a7e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbb440b03c0 tx=0x7fbb4400cef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5fb537876603650 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:31.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.290+0000 7fbb3dffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:39:31.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.290+0000 7fbb3dffb640 1 -- 172.21.15.5:0/1017169825 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb440ae080 con 0x55d50e190390 2024-08-31T05:39:31.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.290+0000 7fbb3dffb640 1 -- 172.21.15.5:0/1017169825 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7fbb440ab360 con 0x55d50e190390 2024-08-31T05:39:31.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.290+0000 7fbb62cf1740 1 -- 172.21.15.5:0/1017169825 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb4c003cf0 con 0x55d50e190390 2024-08-31T05:39:31.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.290+0000 7fbb3dffb640 1 -- 172.21.15.5:0/1017169825 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fbb440abcc0 con 0x55d50e190390 2024-08-31T05:39:31.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.290+0000 7fbb62cf1740 10 client.27701 fetch_fsmap learned FSMap version 34 2024-08-31T05:39:31.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.290+0000 7fbb62cf1740 1 -- 172.21.15.5:0/1017169825 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55d50e5e70e0 con 0x55d50e190390 2024-08-31T05:39:31.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.290+0000 7fbb3dffb640 1 -- 172.21.15.5:0/1017169825 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb4c003cf0 con 0x55d50e190390 2024-08-31T05:39:31.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.291+0000 7fbb3dffb640 1 -- 172.21.15.5:0/1017169825 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fbb44091ce0 con 0x55d50e190390 2024-08-31T05:39:31.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.291+0000 7fbb62cf1740 10 client.27701 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:39:31.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.291+0000 7fbb62cf1740 10 client.27701 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-31T05:39:31.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.291+0000 7fbb62cf1740 20 client.27701 populate_metadata read hostname 'smithi005' 2024-08-31T05:39:31.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.291+0000 7fbb62cf1740 1 --2- 172.21.15.5:0/1017169825 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55d50e144da0 0x55d50e5e98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:31.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.291+0000 7fbb62cf1740 4 client.27701 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:39:31.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.291+0000 7fbb62cf1740 1 -- 172.21.15.5:0/1017169825 --> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d50e4cb070 con 0x55d50e144da0 2024-08-31T05:39:31.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.291+0000 7fbb5a518640 1 --2- 172.21.15.5:0/1017169825 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55d50e144da0 0x55d50e5e98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:31.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.292+0000 7fbb5a518640 1 --2- 172.21.15.5:0/1017169825 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55d50e144da0 0x55d50e5e98a0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4d283c3464719a6b server_cookie=5e569a801619d203 in_seq=0 out_seq=0 2024-08-31T05:39:31.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.292+0000 7fbb3dffb640 10 client.27701 ms_handle_connect on v2:172.21.15.50:6838/98200944 2024-08-31T05:39:31.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.292+0000 7fbb3dffb640 1 -- 172.21.15.5:0/1017169825 <== mds.1 v2:172.21.15.50:6838/98200944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d50e4cb070 con 0x55d50e144da0 2024-08-31T05:39:31.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.292+0000 7fbb3dffb640 10 client.27701 handle_command_reply: tid=0 2024-08-31T05:39:31.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.292+0000 7fbb62cf1740 1 client.27701 shutdown 2024-08-31T05:39:31.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.293+0000 7fbb62cf1740 1 -- 172.21.15.5:0/1017169825 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d50e190390 msgr2=0x55d50e56a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:31.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.293+0000 7fbb62cf1740 1 --2- 172.21.15.5:0/1017169825 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d50e190390 0x55d50e56a7e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbb440b03c0 tx=0x7fbb4400cef0 comp rx=0 tx=0).stop 2024-08-31T05:39:31.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.293+0000 7fbb62cf1740 1 -- 172.21.15.5:0/1017169825 shutdown_connections 2024-08-31T05:39:31.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.293+0000 7fbb62cf1740 1 --2- 172.21.15.5:0/1017169825 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55d50e144da0 0x55d50e5e98a0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:31.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.293+0000 7fbb62cf1740 1 --2- 172.21.15.5:0/1017169825 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d50e1b1070 0x55d50e565940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:31.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.293+0000 7fbb62cf1740 1 --2- 172.21.15.5:0/1017169825 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d50e190390 0x55d50e56a7e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:31.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.293+0000 7fbb62cf1740 1 --2- 172.21.15.5:0/1017169825 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d50e1881b0 0x55d50e56a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:31.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.293+0000 7fbb62cf1740 1 -- 172.21.15.5:0/1017169825 >> 172.21.15.5:0/1017169825 conn(0x55d50e1a5460 msgr2=0x55d50e5539e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:31.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.293+0000 7fbb3dffb640 0 client.27701 ms_handle_reset on v2:172.21.15.50:6838/98200944 2024-08-31T05:39:31.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.293+0000 7fbb62cf1740 1 -- 172.21.15.5:0/1017169825 shutdown_connections 2024-08-31T05:39:31.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.293+0000 7fbb62cf1740 1 -- 172.21.15.5:0/1017169825 wait complete. 2024-08-31T05:39:31.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.293+0000 7fbb62cf1740 20 client.27701 trim_cache size 0 max 16384 2024-08-31T05:39:31.299 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:39:31.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.294+0000 7fbb5c77c640 1 -- 172.21.15.5:0/848161110 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fbb400b4d20 msgr2=0x7fbb400b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:31.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.294+0000 7fbb5c77c640 1 --2- 172.21.15.5:0/848161110 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fbb400b4d20 0x7fbb400b7230 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fbb50005f70 tx=0x7fbb50005890 comp rx=0 tx=0).stop 2024-08-31T05:39:31.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.294+0000 7fbb5c77c640 1 -- 172.21.15.5:0/848161110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb54108180 msgr2=0x7fbb5419c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:31.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.294+0000 7fbb5c77c640 1 --2- 172.21.15.5:0/848161110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb54108180 0x7fbb5419c9f0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fbb4400e9f0 tx=0x7fbb4400eeb0 comp rx=0 tx=0).stop 2024-08-31T05:39:31.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.294+0000 7fbb5c77c640 1 -- 172.21.15.5:0/848161110 shutdown_connections 2024-08-31T05:39:31.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.294+0000 7fbb5c77c640 1 --2- 172.21.15.5:0/848161110 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fbb400b4d20 0x7fbb400b7230 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:31.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.294+0000 7fbb5c77c640 1 --2- 172.21.15.5:0/848161110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb54108ad0 0x7fbb541a1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:31.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.294+0000 7fbb5c77c640 1 --2- 172.21.15.5:0/848161110 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb54108180 0x7fbb5419c9f0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:31.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.294+0000 7fbb5c77c640 1 --2- 172.21.15.5:0/848161110 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbb54102840 0x7fbb5419c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:31.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.294+0000 7fbb5c77c640 1 -- 172.21.15.5:0/848161110 >> 172.21.15.5:0/848161110 conn(0x7fbb540794f0 msgr2=0x7fbb54106090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:31.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.294+0000 7fbb5c77c640 1 -- 172.21.15.5:0/848161110 shutdown_connections 2024-08-31T05:39:31.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:31.294+0000 7fbb5c77c640 1 -- 172.21.15.5:0/848161110 wait complete. 2024-08-31T05:39:31.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:39:30 smithi070 ceph-mon[22316]: pgmap v637: 129 pgs: 129 active+clean; 568 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 5.0 MiB/s wr, 252 op/s 2024-08-31T05:39:31.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:39:30 smithi050 ceph-mon[22146]: pgmap v637: 129 pgs: 129 active+clean; 568 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 5.0 MiB/s wr, 252 op/s 2024-08-31T05:39:31.933 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1078826 11.12 MB/sec execute 379 sec latency 40.123 ms 2024-08-31T05:39:32.013 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T05:39:32.291 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:39:32.933 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1080850 11.12 MB/sec execute 380 sec latency 26.433 ms 2024-08-31T05:39:33.022 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:39:32 smithi005 ceph-mon[18602]: pgmap v638: 129 pgs: 129 active+clean; 568 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.7 MiB/s wr, 181 op/s 2024-08-31T05:39:33.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.031+0000 7f586e668640 1 -- 172.21.15.5:0/2355838953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5868102880 msgr2=0x7f5868102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:33.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.031+0000 7f586e668640 1 --2- 172.21.15.5:0/2355838953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5868102880 0x7f5868102c90 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f5858009900 tx=0x7f585802a410 comp rx=0 tx=0).stop 2024-08-31T05:39:33.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.031+0000 7f586e668640 1 -- 172.21.15.5:0/2355838953 shutdown_connections 2024-08-31T05:39:33.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.031+0000 7f586e668640 1 --2- 172.21.15.5:0/2355838953 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5868108ac0 0x7f586810f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.031+0000 7f586e668640 1 --2- 172.21.15.5:0/2355838953 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5868108170 0x7f5868108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.031+0000 7f586e668640 1 --2- 172.21.15.5:0/2355838953 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5868102880 0x7f5868102c90 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.031+0000 7f586e668640 1 -- 172.21.15.5:0/2355838953 >> 172.21.15.5:0/2355838953 conn(0x7f5868079500 msgr2=0x7f5868079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:33.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.031+0000 7f586e668640 1 -- 172.21.15.5:0/2355838953 shutdown_connections 2024-08-31T05:39:33.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.031+0000 7f586e668640 1 -- 172.21.15.5:0/2355838953 wait complete. 2024-08-31T05:39:33.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.032+0000 7f586e668640 1 Processor -- start 2024-08-31T05:39:33.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.032+0000 7f586e668640 1 -- start start 2024-08-31T05:39:33.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.032+0000 7f586e668640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5868102880 0x7f5868104020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:33.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.032+0000 7f586e668640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5868108170 0x7f5868104560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:33.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.032+0000 7f586e668640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5868108ac0 0x7f5868104aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:33.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.032+0000 7f586e668640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5868112740 con 0x7f5868108ac0 2024-08-31T05:39:33.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.032+0000 7f586e668640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f58681125c0 con 0x7f5868102880 2024-08-31T05:39:33.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.032+0000 7f586e668640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f58681128c0 con 0x7f5868108170 2024-08-31T05:39:33.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.032+0000 7f586cc05640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5868108ac0 0x7f5868104aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:33.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.032+0000 7f586cc05640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5868108ac0 0x7f5868104aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34984/0 (socket says 172.21.15.5:34984) 2024-08-31T05:39:33.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.032+0000 7f586cc05640 1 -- 172.21.15.5:0/1524334278 learned_addr learned my addr 172.21.15.5:0/1524334278 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:33.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.032+0000 7f5867fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5868102880 0x7f5868104020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:33.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.032+0000 7f585ffff640 1 --2- 172.21.15.5:0/1524334278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5868108170 0x7f5868104560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:33.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.033+0000 7f586cc05640 1 -- 172.21.15.5:0/1524334278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5868108170 msgr2=0x7f5868104560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:33.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.033+0000 7f586cc05640 1 --2- 172.21.15.5:0/1524334278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5868108170 0x7f5868104560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.033+0000 7f586cc05640 1 -- 172.21.15.5:0/1524334278 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5868102880 msgr2=0x7f5868104020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:33.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.033+0000 7f586cc05640 1 --2- 172.21.15.5:0/1524334278 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5868102880 0x7f5868104020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.033+0000 7f586cc05640 1 -- 172.21.15.5:0/1524334278 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58681a84c0 con 0x7f5868108ac0 2024-08-31T05:39:33.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.033+0000 7f586cc05640 1 --2- 172.21.15.5:0/1524334278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5868108ac0 0x7f5868104aa0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f586000eb10 tx=0x7f586000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:33.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.033+0000 7f5865ffb640 1 -- 172.21.15.5:0/1524334278 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5860004b20 con 0x7f5868108ac0 2024-08-31T05:39:33.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.033+0000 7f5865ffb640 1 -- 172.21.15.5:0/1524334278 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5860004cc0 con 0x7f5868108ac0 2024-08-31T05:39:33.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.033+0000 7f586e668640 1 -- 172.21.15.5:0/1524334278 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58681a87b0 con 0x7f5868108ac0 2024-08-31T05:39:33.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.033+0000 7f5865ffb640 1 -- 172.21.15.5:0/1524334278 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5860010670 con 0x7f5868108ac0 2024-08-31T05:39:33.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.033+0000 7f586e668640 1 -- 172.21.15.5:0/1524334278 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58681a8d40 con 0x7f5868108ac0 2024-08-31T05:39:33.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.036+0000 7f5865ffb640 1 -- 172.21.15.5:0/1524334278 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f5860005020 con 0x7f5868108ac0 2024-08-31T05:39:33.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.036+0000 7f5874bdd740 1 Processor -- start 2024-08-31T05:39:33.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.037+0000 7f5874bdd740 1 -- start start 2024-08-31T05:39:33.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.037+0000 7f5874bdd740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d8b4a6070 0x560d8b84b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:33.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.037+0000 7f5874bdd740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d8b47d1b0 0x560d8b84b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:33.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.037+0000 7f5874bdd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8b485390 0x560d8b84bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:33.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.037+0000 7f5874bdd740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x560d8b7c2680 con 0x560d8b47d1b0 2024-08-31T05:39:33.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.037+0000 7f5874bdd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560d8b7b1c10 con 0x560d8b485390 2024-08-31T05:39:33.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.037+0000 7f5874bdd740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560d8b7b5bc0 con 0x560d8b4a6070 2024-08-31T05:39:33.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.037+0000 7f585ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d8b4a6070 0x560d8b84b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:33.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.037+0000 7f5867fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d8b47d1b0 0x560d8b84b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:33.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.037+0000 7f5867fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d8b47d1b0 0x560d8b84b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34986/0 (socket says 172.21.15.5:34986) 2024-08-31T05:39:33.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.037+0000 7f5867fff640 1 -- 172.21.15.5:0/1301531669 learned_addr learned my addr 172.21.15.5:0/1301531669 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:33.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.037+0000 7f585ffff640 1 --2- 172.21.15.5:0/1301531669 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8b485390 0x560d8b84bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:33.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.037+0000 7f585ffff640 1 -- 172.21.15.5:0/1301531669 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8b485390 msgr2=0x560d8b84bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:33.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.037+0000 7f585ffff640 1 --2- 172.21.15.5:0/1301531669 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8b485390 0x560d8b84bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.037+0000 7f585ffff640 1 -- 172.21.15.5:0/1301531669 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d8b47d1b0 msgr2=0x560d8b84b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:33.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.037+0000 7f585ffff640 1 --2- 172.21.15.5:0/1301531669 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d8b47d1b0 0x560d8b84b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.037+0000 7f585ffff640 1 -- 172.21.15.5:0/1301531669 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d8b511650 con 0x560d8b4a6070 2024-08-31T05:39:33.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.037+0000 7f5865ffb640 1 --2- 172.21.15.5:0/1524334278 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f58540b4d20 0x7f58540b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:33.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.038+0000 7f5867fff640 1 --2- 172.21.15.5:0/1524334278 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f58540b4d20 0x7f58540b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:33.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.038+0000 7f5865ffb640 1 -- 172.21.15.5:0/1524334278 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7f58600e5d70 con 0x7f5868108ac0 2024-08-31T05:39:33.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.038+0000 7f585ffff640 1 --2- 172.21.15.5:0/1301531669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d8b4a6070 0x560d8b84b310 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f585000b6c0 tx=0x7f585000b650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9abcea06e65fa54a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:33.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.038+0000 7f585e7fc640 1 -- 172.21.15.5:0/1301531669 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5850012d40 con 0x560d8b4a6070 2024-08-31T05:39:33.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.038+0000 7f585e7fc640 1 -- 172.21.15.5:0/1301531669 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5850005020 con 0x560d8b4a6070 2024-08-31T05:39:33.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.038+0000 7f585e7fc640 1 -- 172.21.15.5:0/1301531669 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58500049a0 con 0x560d8b4a6070 2024-08-31T05:39:33.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.039+0000 7f5874bdd740 1 -- 172.21.15.5:0/1301531669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d8b4a6070 msgr2=0x560d8b84b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:33.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.039+0000 7f5867fff640 1 --2- 172.21.15.5:0/1524334278 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f58540b4d20 0x7f58540b7230 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f5858005f70 tx=0x7f5858031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:33.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.039+0000 7f5874bdd740 1 --2- 172.21.15.5:0/1301531669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d8b4a6070 0x560d8b84b310 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f585000b6c0 tx=0x7f585000b650 comp rx=0 tx=0).stop 2024-08-31T05:39:33.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.039+0000 7f5874bdd740 1 -- 172.21.15.5:0/1301531669 shutdown_connections 2024-08-31T05:39:33.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.039+0000 7f5874bdd740 1 --2- 172.21.15.5:0/1301531669 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8b485390 0x560d8b84bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.039+0000 7f5874bdd740 1 --2- 172.21.15.5:0/1301531669 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d8b47d1b0 0x560d8b84b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.039+0000 7f5874bdd740 1 --2- 172.21.15.5:0/1301531669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d8b4a6070 0x560d8b84b310 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.039+0000 7f5874bdd740 1 -- 172.21.15.5:0/1301531669 >> 172.21.15.5:0/1301531669 conn(0x560d8b49a460 msgr2=0x560d8b849200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:33.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.039+0000 7f5874bdd740 1 -- 172.21.15.5:0/1301531669 shutdown_connections 2024-08-31T05:39:33.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.039+0000 7f5874bdd740 1 -- 172.21.15.5:0/1301531669 wait complete. 2024-08-31T05:39:33.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.040+0000 7f5874bdd740 1 -- start start 2024-08-31T05:39:33.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.040+0000 7f5874bdd740 1 Processor -- start 2024-08-31T05:39:33.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.040+0000 7f5874bdd740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d8b47d1b0 0x560d8b856a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:33.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.040+0000 7f5874bdd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8b485390 0x560d8b856fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:33.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.041+0000 7f5874bdd740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d8b4a6070 0x560d8b862de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:33.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.041+0000 7f5874bdd740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x560d8b614700 con 0x560d8b47d1b0 2024-08-31T05:39:33.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.041+0000 7f5874bdd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560d8b738750 con 0x560d8b485390 2024-08-31T05:39:33.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.041+0000 7f5874bdd740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560d8b859af0 con 0x560d8b4a6070 2024-08-31T05:39:33.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.041+0000 7f5874bdd740 10 client.0 _ll_register_callbacks cb 0x560d8b767e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:39:33.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.041+0000 7f585ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8b485390 0x560d8b856fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:33.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.041+0000 7f586cc05640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d8b4a6070 0x560d8b862de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:33.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.041+0000 7f585ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8b485390 0x560d8b856fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:37026/0 (socket says 172.21.15.5:37026) 2024-08-31T05:39:33.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.041+0000 7f585ffff640 1 -- 172.21.15.5:0/3367581659 learned_addr learned my addr 172.21.15.5:0/3367581659 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:33.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.041+0000 7f5867fff640 1 --2- 172.21.15.5:0/3367581659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d8b47d1b0 0x560d8b856a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:33.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.041+0000 7f585ffff640 1 -- 172.21.15.5:0/3367581659 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d8b4a6070 msgr2=0x560d8b862de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:33.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.041+0000 7f585ffff640 1 --2- 172.21.15.5:0/3367581659 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d8b4a6070 0x560d8b862de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.041+0000 7f585ffff640 1 -- 172.21.15.5:0/3367581659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d8b47d1b0 msgr2=0x560d8b856a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:33.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.041+0000 7f585ffff640 1 --2- 172.21.15.5:0/3367581659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d8b47d1b0 0x560d8b856a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.041+0000 7f585ffff640 1 -- 172.21.15.5:0/3367581659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d8b771900 con 0x560d8b485390 2024-08-31T05:39:33.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.041+0000 7f586cc05640 1 --2- 172.21.15.5:0/3367581659 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d8b4a6070 0x560d8b862de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:39:33.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.041+0000 7f585ffff640 1 --2- 172.21.15.5:0/3367581659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8b485390 0x560d8b856fc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5850015010 tx=0x7f585000b480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70465bcc75526d6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:33.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.041+0000 7f58477fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:39:33.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.041+0000 7f58477fe640 1 -- 172.21.15.5:0/3367581659 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58500053d0 con 0x560d8b485390 2024-08-31T05:39:33.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.042+0000 7f58477fe640 1 -- 172.21.15.5:0/3367581659 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7f5850005570 con 0x560d8b485390 2024-08-31T05:39:33.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.042+0000 7f5874bdd740 1 -- 172.21.15.5:0/3367581659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5850005020 con 0x560d8b485390 2024-08-31T05:39:33.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.042+0000 7f58477fe640 1 -- 172.21.15.5:0/3367581659 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f5850030050 con 0x560d8b485390 2024-08-31T05:39:33.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.042+0000 7f5874bdd740 10 client.27713 fetch_fsmap learned FSMap version 34 2024-08-31T05:39:33.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.042+0000 7f5874bdd740 1 -- 172.21.15.5:0/3367581659 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x560d8b8658c0 con 0x560d8b485390 2024-08-31T05:39:33.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.042+0000 7f58477fe640 1 -- 172.21.15.5:0/3367581659 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5850005020 con 0x560d8b485390 2024-08-31T05:39:33.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.042+0000 7f58477fe640 1 -- 172.21.15.5:0/3367581659 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f5850004960 con 0x560d8b485390 2024-08-31T05:39:33.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.042+0000 7f5874bdd740 10 client.27713 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:39:33.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.042+0000 7f5874bdd740 10 client.27713 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:39:33.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.042+0000 7f5874bdd740 20 client.27713 populate_metadata read hostname 'smithi005' 2024-08-31T05:39:33.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.042+0000 7f5874bdd740 1 --2- 172.21.15.5:0/3367581659 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x560d8b4649f0 0x560d8b868c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:33.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.042+0000 7f5874bdd740 4 client.27713 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:39:33.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.042+0000 7f5874bdd740 1 -- 172.21.15.5:0/3367581659 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d8b7c45d0 con 0x560d8b4649f0 2024-08-31T05:39:33.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.042+0000 7f5867fff640 1 --2- 172.21.15.5:0/3367581659 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x560d8b4649f0 0x560d8b868c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:33.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.043+0000 7f58477fe640 10 client.27713 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:39:33.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.043+0000 7f5867fff640 1 --2- 172.21.15.5:0/3367581659 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x560d8b4649f0 0x560d8b868c20 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21b701dfe4dc8efc server_cookie=f0ac86b1dacfce76 in_seq=0 out_seq=0 2024-08-31T05:39:33.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.044+0000 7f58477fe640 1 -- 172.21.15.5:0/3367581659 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560d8b7c45d0 con 0x560d8b4649f0 2024-08-31T05:39:33.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.044+0000 7f58477fe640 10 client.27713 handle_command_reply: tid=0 2024-08-31T05:39:33.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.044+0000 7f5874bdd740 1 client.27713 shutdown 2024-08-31T05:39:33.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.044+0000 7f5874bdd740 1 -- 172.21.15.5:0/3367581659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8b485390 msgr2=0x560d8b856fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:33.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.044+0000 7f5874bdd740 1 --2- 172.21.15.5:0/3367581659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8b485390 0x560d8b856fc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5850015010 tx=0x7f585000b480 comp rx=0 tx=0).stop 2024-08-31T05:39:33.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.044+0000 7f5874bdd740 1 -- 172.21.15.5:0/3367581659 shutdown_connections 2024-08-31T05:39:33.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.044+0000 7f5874bdd740 1 --2- 172.21.15.5:0/3367581659 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x560d8b4649f0 0x560d8b868c20 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.044+0000 7f5874bdd740 1 --2- 172.21.15.5:0/3367581659 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d8b4a6070 0x560d8b862de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.044+0000 7f5874bdd740 1 --2- 172.21.15.5:0/3367581659 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8b485390 0x560d8b856fc0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.044+0000 7f5874bdd740 1 --2- 172.21.15.5:0/3367581659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d8b47d1b0 0x560d8b856a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.044+0000 7f58477fe640 0 client.27713 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:39:33.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.044+0000 7f5874bdd740 1 -- 172.21.15.5:0/3367581659 >> 172.21.15.5:0/3367581659 conn(0x560d8b49a460 msgr2=0x560d8b84e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:33.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.044+0000 7f5874bdd740 1 -- 172.21.15.5:0/3367581659 shutdown_connections 2024-08-31T05:39:33.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.044+0000 7f5874bdd740 1 -- 172.21.15.5:0/3367581659 wait complete. 2024-08-31T05:39:33.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.044+0000 7f5874bdd740 20 client.27713 trim_cache size 0 max 16384 2024-08-31T05:39:33.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.059+0000 7f5874bdd740 1 Processor -- start 2024-08-31T05:39:33.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.059+0000 7f5874bdd740 1 -- start start 2024-08-31T05:39:33.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.059+0000 7f5874bdd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8b4649f0 0x560d8b856f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:33.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.059+0000 7f5874bdd740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d8b47d1b0 0x560d8b862ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:33.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.059+0000 7f5874bdd740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d8b485390 0x560d8b853c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:33.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.059+0000 7f5874bdd740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f58681b2eb0 con 0x560d8b47d1b0 2024-08-31T05:39:33.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.059+0000 7f5874bdd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f58681b49f0 con 0x560d8b4649f0 2024-08-31T05:39:33.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.059+0000 7f5874bdd740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f58681b3580 con 0x560d8b485390 2024-08-31T05:39:33.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.059+0000 7f585ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d8b47d1b0 0x560d8b862ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:33.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.059+0000 7f586cc05640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d8b485390 0x560d8b853c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:33.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.059+0000 7f5867fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8b4649f0 0x560d8b856f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:33.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.059+0000 7f585ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d8b47d1b0 0x560d8b862ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35002/0 (socket says 172.21.15.5:35002) 2024-08-31T05:39:33.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.059+0000 7f586cc05640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d8b485390 0x560d8b853c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:39226/0 (socket says 172.21.15.5:39226) 2024-08-31T05:39:33.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.059+0000 7f585ffff640 1 -- 172.21.15.5:0/1955769840 learned_addr learned my addr 172.21.15.5:0/1955769840 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:33.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.060+0000 7f586cc05640 1 -- 172.21.15.5:0/1955769840 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8b4649f0 msgr2=0x560d8b856f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:33.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.060+0000 7f586cc05640 1 --2- 172.21.15.5:0/1955769840 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8b4649f0 0x560d8b856f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.060+0000 7f586cc05640 1 -- 172.21.15.5:0/1955769840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d8b47d1b0 msgr2=0x560d8b862ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:33.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.060+0000 7f586cc05640 1 --2- 172.21.15.5:0/1955769840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d8b47d1b0 0x560d8b862ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.060+0000 7f586cc05640 1 -- 172.21.15.5:0/1955769840 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d8b844940 con 0x560d8b485390 2024-08-31T05:39:33.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.060+0000 7f586cc05640 1 --2- 172.21.15.5:0/1955769840 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d8b485390 0x560d8b853c70 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f58600e30e0 tx=0x7f5860009a70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95bf3d0725849e2b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:33.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.060+0000 7f585dffb640 1 -- 172.21.15.5:0/1955769840 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58600ac780 con 0x560d8b485390 2024-08-31T05:39:33.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.060+0000 7f585dffb640 1 -- 172.21.15.5:0/1955769840 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58600ac080 con 0x560d8b485390 2024-08-31T05:39:33.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.061+0000 7f585dffb640 1 -- 172.21.15.5:0/1955769840 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58600b5170 con 0x560d8b485390 2024-08-31T05:39:33.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.061+0000 7f5874bdd740 1 -- 172.21.15.5:0/1955769840 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d8b485390 msgr2=0x560d8b853c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:33.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.061+0000 7f5874bdd740 1 --2- 172.21.15.5:0/1955769840 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d8b485390 0x560d8b853c70 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f58600e30e0 tx=0x7f5860009a70 comp rx=0 tx=0).stop 2024-08-31T05:39:33.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.061+0000 7f5874bdd740 1 -- 172.21.15.5:0/1955769840 shutdown_connections 2024-08-31T05:39:33.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.061+0000 7f5874bdd740 1 --2- 172.21.15.5:0/1955769840 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d8b485390 0x560d8b853c70 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.061+0000 7f5874bdd740 1 --2- 172.21.15.5:0/1955769840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d8b47d1b0 0x560d8b862ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.061+0000 7f5874bdd740 1 --2- 172.21.15.5:0/1955769840 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8b4649f0 0x560d8b856f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.061+0000 7f5874bdd740 1 -- 172.21.15.5:0/1955769840 >> 172.21.15.5:0/1955769840 conn(0x560d8b49a460 msgr2=0x560d8b856830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:33.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.062+0000 7f5874bdd740 1 -- 172.21.15.5:0/1955769840 shutdown_connections 2024-08-31T05:39:33.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.062+0000 7f5874bdd740 1 -- 172.21.15.5:0/1955769840 wait complete. 2024-08-31T05:39:33.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.062+0000 7f5874bdd740 1 -- start start 2024-08-31T05:39:33.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.062+0000 7f5874bdd740 1 Processor -- start 2024-08-31T05:39:33.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.063+0000 7f5874bdd740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8b4649f0 0x560d8b85f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:33.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.063+0000 7f5874bdd740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d8b47d1b0 0x560d8b85a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:33.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.063+0000 7f5874bdd740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d8b485390 0x560d8b85add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:33.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.063+0000 7f5874bdd740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f58681b4320 con 0x560d8b485390 2024-08-31T05:39:33.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.063+0000 7f5874bdd740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f58681b3c50 con 0x560d8b4649f0 2024-08-31T05:39:33.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.063+0000 7f5874bdd740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f58681b0eb0 con 0x560d8b47d1b0 2024-08-31T05:39:33.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.063+0000 7f5874bdd740 10 client.0 _ll_register_callbacks cb 0x7f5858009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:39:33.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.063+0000 7f5867fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8b4649f0 0x560d8b85f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:33.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.063+0000 7f586cc05640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d8b485390 0x560d8b85add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:33.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.063+0000 7f585ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d8b47d1b0 0x560d8b85a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:33.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.063+0000 7f5867fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8b4649f0 0x560d8b85f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:37046/0 (socket says 172.21.15.5:37046) 2024-08-31T05:39:33.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.063+0000 7f5867fff640 1 -- 172.21.15.5:0/3776239948 learned_addr learned my addr 172.21.15.5:0/3776239948 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:33.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.063+0000 7f585ffff640 1 -- 172.21.15.5:0/3776239948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8b4649f0 msgr2=0x560d8b85f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:33.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.063+0000 7f585ffff640 1 --2- 172.21.15.5:0/3776239948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8b4649f0 0x560d8b85f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.063+0000 7f585ffff640 1 -- 172.21.15.5:0/3776239948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d8b485390 msgr2=0x560d8b85add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:33.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.063+0000 7f585ffff640 1 --2- 172.21.15.5:0/3776239948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d8b485390 0x560d8b85add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.063+0000 7f585ffff640 1 -- 172.21.15.5:0/3776239948 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d8b85b410 con 0x560d8b47d1b0 2024-08-31T05:39:33.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.063+0000 7f586cc05640 1 --2- 172.21.15.5:0/3776239948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d8b485390 0x560d8b85add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:39:33.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.063+0000 7f585ffff640 1 --2- 172.21.15.5:0/3776239948 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d8b47d1b0 0x560d8b85a890 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f585000b750 tx=0x7f5850012760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a30cabcd9d968657 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:33.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.063+0000 7f58477fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:39:33.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.064+0000 7f58477fe640 1 -- 172.21.15.5:0/3776239948 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5850004860 con 0x560d8b47d1b0 2024-08-31T05:39:33.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.064+0000 7f58477fe640 1 -- 172.21.15.5:0/3776239948 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7f5850004a00 con 0x560d8b47d1b0 2024-08-31T05:39:33.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.064+0000 7f5874bdd740 1 -- 172.21.15.5:0/3776239948 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58600ac080 con 0x560d8b47d1b0 2024-08-31T05:39:33.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.064+0000 7f58477fe640 1 -- 172.21.15.5:0/3776239948 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f585000bb00 con 0x560d8b47d1b0 2024-08-31T05:39:33.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.064+0000 7f5874bdd740 10 client.27721 fetch_fsmap learned FSMap version 34 2024-08-31T05:39:33.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.064+0000 7f5874bdd740 1 -- 172.21.15.5:0/3776239948 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x560d8b8d32a0 con 0x560d8b47d1b0 2024-08-31T05:39:33.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.064+0000 7f58477fe640 1 -- 172.21.15.5:0/3776239948 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58600ac080 con 0x560d8b47d1b0 2024-08-31T05:39:33.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.064+0000 7f58477fe640 1 -- 172.21.15.5:0/3776239948 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f5850003c90 con 0x560d8b47d1b0 2024-08-31T05:39:33.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.064+0000 7f5874bdd740 10 client.27721 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:39:33.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.064+0000 7f5874bdd740 10 client.27721 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:39:33.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.064+0000 7f5874bdd740 20 client.27721 populate_metadata read hostname 'smithi005' 2024-08-31T05:39:33.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.064+0000 7f5874bdd740 1 --2- 172.21.15.5:0/3776239948 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x560d8b4a6070 0x560d8b8d5960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:33.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.064+0000 7f5874bdd740 4 client.27721 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:39:33.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.064+0000 7f5874bdd740 1 -- 172.21.15.5:0/3776239948 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560d8b7c0070 con 0x560d8b4a6070 2024-08-31T05:39:33.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.065+0000 7f5867fff640 1 --2- 172.21.15.5:0/3776239948 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x560d8b4a6070 0x560d8b8d5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:33.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.065+0000 7f5867fff640 1 --2- 172.21.15.5:0/3776239948 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x560d8b4a6070 0x560d8b8d5960 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=763e386184d7f237 server_cookie=bfc8bc39285aa709 in_seq=0 out_seq=0 2024-08-31T05:39:33.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.065+0000 7f58477fe640 10 client.27721 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:39:33.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.065+0000 7f58477fe640 1 -- 172.21.15.5:0/3776239948 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560d8b7c0070 con 0x560d8b4a6070 2024-08-31T05:39:33.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.065+0000 7f58477fe640 10 client.27721 handle_command_reply: tid=0 2024-08-31T05:39:33.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.065+0000 7f5874bdd740 1 client.27721 shutdown 2024-08-31T05:39:33.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.065+0000 7f5874bdd740 1 -- 172.21.15.5:0/3776239948 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d8b47d1b0 msgr2=0x560d8b85a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:33.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.065+0000 7f5874bdd740 1 --2- 172.21.15.5:0/3776239948 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d8b47d1b0 0x560d8b85a890 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f585000b750 tx=0x7f5850012760 comp rx=0 tx=0).stop 2024-08-31T05:39:33.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.065+0000 7f5874bdd740 1 -- 172.21.15.5:0/3776239948 shutdown_connections 2024-08-31T05:39:33.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.065+0000 7f5874bdd740 1 --2- 172.21.15.5:0/3776239948 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x560d8b4a6070 0x560d8b8d5960 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.065+0000 7f5874bdd740 1 --2- 172.21.15.5:0/3776239948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560d8b485390 0x560d8b85add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.065+0000 7f58477fe640 0 client.27721 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:39:33.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.065+0000 7f5874bdd740 1 --2- 172.21.15.5:0/3776239948 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560d8b47d1b0 0x560d8b85a890 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.065+0000 7f5874bdd740 1 --2- 172.21.15.5:0/3776239948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560d8b4649f0 0x560d8b85f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.065+0000 7f5874bdd740 1 -- 172.21.15.5:0/3776239948 >> 172.21.15.5:0/3776239948 conn(0x560d8b49a460 msgr2=0x560d8b84c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:33.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.066+0000 7f5874bdd740 1 -- 172.21.15.5:0/3776239948 shutdown_connections 2024-08-31T05:39:33.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.066+0000 7f5874bdd740 1 -- 172.21.15.5:0/3776239948 wait complete. 2024-08-31T05:39:33.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.066+0000 7f5874bdd740 20 client.27721 trim_cache size 0 max 16384 2024-08-31T05:39:33.074 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:39:33.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.066+0000 7f586e668640 1 -- 172.21.15.5:0/1524334278 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f58540b4d20 msgr2=0x7f58540b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:33.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.066+0000 7f586e668640 1 --2- 172.21.15.5:0/1524334278 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f58540b4d20 0x7f58540b7230 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f5858005f70 tx=0x7f5858031400 comp rx=0 tx=0).stop 2024-08-31T05:39:33.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.066+0000 7f586e668640 1 -- 172.21.15.5:0/1524334278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5868108ac0 msgr2=0x7f5868104aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:33.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.066+0000 7f586e668640 1 --2- 172.21.15.5:0/1524334278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5868108ac0 0x7f5868104aa0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f586000eb10 tx=0x7f586000c2d0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.066+0000 7f586e668640 1 -- 172.21.15.5:0/1524334278 shutdown_connections 2024-08-31T05:39:33.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.066+0000 7f586e668640 1 --2- 172.21.15.5:0/1524334278 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f58540b4d20 0x7f58540b7230 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.066+0000 7f586e668640 1 --2- 172.21.15.5:0/1524334278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5868108ac0 0x7f5868104aa0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.066+0000 7f586e668640 1 --2- 172.21.15.5:0/1524334278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5868108170 0x7f5868104560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.066+0000 7f586e668640 1 --2- 172.21.15.5:0/1524334278 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5868102880 0x7f5868104020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.066+0000 7f586e668640 1 -- 172.21.15.5:0/1524334278 >> 172.21.15.5:0/1524334278 conn(0x7f5868079500 msgr2=0x7f5868106450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:33.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.067+0000 7f586e668640 1 -- 172.21.15.5:0/1524334278 shutdown_connections 2024-08-31T05:39:33.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:33.067+0000 7f586e668640 1 -- 172.21.15.5:0/1524334278 wait complete. 2024-08-31T05:39:33.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:39:32 smithi070 ceph-mon[22316]: pgmap v638: 129 pgs: 129 active+clean; 568 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.7 MiB/s wr, 181 op/s 2024-08-31T05:39:33.410 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:39:32 smithi050 ceph-mon[22146]: pgmap v638: 129 pgs: 129 active+clean; 568 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.7 MiB/s wr, 181 op/s 2024-08-31T05:39:33.933 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.930+0000 7fe930607640 1 -- 172.21.15.5:0/446653969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe928108090 msgr2=0x7fe9281084a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:33.933 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.930+0000 7fe930607640 1 --2- 172.21.15.5:0/446653969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe928108090 0x7fe9281084a0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fe918009900 tx=0x7fe91802a410 comp rx=0 tx=0).stop 2024-08-31T05:39:33.933 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.930+0000 7fe930607640 1 -- 172.21.15.5:0/446653969 shutdown_connections 2024-08-31T05:39:33.933 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.930+0000 7fe930607640 1 --2- 172.21.15.5:0/446653969 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe9281089e0 0x7fe92810f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.934 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.930+0000 7fe930607640 1 --2- 172.21.15.5:0/446653969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe928108090 0x7fe9281084a0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.934 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.930+0000 7fe930607640 1 --2- 172.21.15.5:0/446653969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe928102760 0x7fe928102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.934 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.930+0000 7fe930607640 1 -- 172.21.15.5:0/446653969 >> 172.21.15.5:0/446653969 conn(0x7fe9280fe160 msgr2=0x7fe9281005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:33.934 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.930+0000 7fe930607640 1 -- 172.21.15.5:0/446653969 shutdown_connections 2024-08-31T05:39:33.934 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.930+0000 7fe930607640 1 -- 172.21.15.5:0/446653969 wait complete. 2024-08-31T05:39:33.934 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1083226 11.13 MB/sec execute 381 sec latency 22.623 ms 2024-08-31T05:39:33.936 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.931+0000 7fe930607640 1 Processor -- start 2024-08-31T05:39:33.936 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.931+0000 7fe930607640 1 -- start start 2024-08-31T05:39:33.936 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.931+0000 7fe930607640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe928102760 0x7fe92819a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:33.936 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.931+0000 7fe930607640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe928108090 0x7fe92819a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:33.936 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.931+0000 7fe930607640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe9281089e0 0x7fe92819f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:33.936 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.931+0000 7fe930607640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe928112670 con 0x7fe928102760 2024-08-31T05:39:33.936 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.931+0000 7fe930607640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe9281124f0 con 0x7fe928108090 2024-08-31T05:39:33.937 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.931+0000 7fe930607640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe9281127f0 con 0x7fe9281089e0 2024-08-31T05:39:33.937 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.931+0000 7fe92e3a3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe928102760 0x7fe92819a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:33.937 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.931+0000 7fe92e3a3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe928102760 0x7fe92819a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35044/0 (socket says 172.21.15.5:35044) 2024-08-31T05:39:33.937 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.931+0000 7fe92e3a3640 1 -- 172.21.15.5:0/2862737856 learned_addr learned my addr 172.21.15.5:0/2862737856 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:33.937 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.931+0000 7fe92eba4640 1 --2- 172.21.15.5:0/2862737856 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe9281089e0 0x7fe92819f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:33.937 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.931+0000 7fe92dba2640 1 --2- 172.21.15.5:0/2862737856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe928108090 0x7fe92819a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:33.937 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.931+0000 7fe92e3a3640 1 -- 172.21.15.5:0/2862737856 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe9281089e0 msgr2=0x7fe92819f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:33.937 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.931+0000 7fe92e3a3640 1 --2- 172.21.15.5:0/2862737856 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe9281089e0 0x7fe92819f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.937 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.931+0000 7fe92e3a3640 1 -- 172.21.15.5:0/2862737856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe928108090 msgr2=0x7fe92819a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:33.937 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.931+0000 7fe92e3a3640 1 --2- 172.21.15.5:0/2862737856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe928108090 0x7fe92819a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.937 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.931+0000 7fe92e3a3640 1 -- 172.21.15.5:0/2862737856 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9281a00f0 con 0x7fe928102760 2024-08-31T05:39:33.937 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.931+0000 7fe92dba2640 1 --2- 172.21.15.5:0/2862737856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe928108090 0x7fe92819a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:39:33.937 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.931+0000 7fe92e3a3640 1 --2- 172.21.15.5:0/2862737856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe928102760 0x7fe92819a1c0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fe92400e9f0 tx=0x7fe92400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:33.938 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.932+0000 7fe91f7fe640 1 -- 172.21.15.5:0/2862737856 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe92400cd80 con 0x7fe928102760 2024-08-31T05:39:33.938 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.932+0000 7fe91f7fe640 1 -- 172.21.15.5:0/2862737856 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9240108e0 con 0x7fe928102760 2024-08-31T05:39:33.938 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.932+0000 7fe930607640 1 -- 172.21.15.5:0/2862737856 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9281a03e0 con 0x7fe928102760 2024-08-31T05:39:33.938 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.932+0000 7fe91f7fe640 1 -- 172.21.15.5:0/2862737856 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe924018980 con 0x7fe928102760 2024-08-31T05:39:33.938 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.932+0000 7fe930607640 1 -- 172.21.15.5:0/2862737856 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9281a6b70 con 0x7fe928102760 2024-08-31T05:39:33.943 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.934+0000 7fe937653740 1 Processor -- start 2024-08-31T05:39:33.943 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.935+0000 7fe937653740 1 -- start start 2024-08-31T05:39:33.943 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.935+0000 7fe91f7fe640 1 -- 172.21.15.5:0/2862737856 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fe924010430 con 0x7fe928102760 2024-08-31T05:39:33.944 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.935+0000 7fe937653740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0179421b0 0x55a017ce5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:33.944 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.935+0000 7fe937653740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0179192f0 0x55a017ce6220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:33.944 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.935+0000 7fe937653740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0179214d0 0x55a017ce6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:33.944 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.935+0000 7fe937653740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55a017c5b000 con 0x55a0179192f0 2024-08-31T05:39:33.944 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.935+0000 7fe937653740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a017c4a590 con 0x55a0179421b0 2024-08-31T05:39:33.944 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.935+0000 7fe937653740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a017c4e540 con 0x55a0179214d0 2024-08-31T05:39:33.944 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.935+0000 7fe92e3a3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0179192f0 0x55a017ce6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:33.944 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.935+0000 7fe92e3a3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0179192f0 0x55a017ce6220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35052/0 (socket says 172.21.15.5:35052) 2024-08-31T05:39:33.944 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.935+0000 7fe92e3a3640 1 -- 172.21.15.5:0/2656221685 learned_addr learned my addr 172.21.15.5:0/2656221685 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:33.944 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.935+0000 7fe92dba2640 1 --2- 172.21.15.5:0/2656221685 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0179214d0 0x55a017ce6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:33.944 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.935+0000 7fe92eba4640 1 --2- 172.21.15.5:0/2656221685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0179421b0 0x55a017ce5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:33.945 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.935+0000 7fe92dba2640 1 -- 172.21.15.5:0/2656221685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0179421b0 msgr2=0x55a017ce5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:33.945 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.935+0000 7fe92dba2640 1 --2- 172.21.15.5:0/2656221685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0179421b0 0x55a017ce5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.945 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.935+0000 7fe92dba2640 1 -- 172.21.15.5:0/2656221685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0179192f0 msgr2=0x55a017ce6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:33.945 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.935+0000 7fe92dba2640 1 --2- 172.21.15.5:0/2656221685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0179192f0 0x55a017ce6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.945 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.935+0000 7fe92dba2640 1 -- 172.21.15.5:0/2656221685 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0179ad790 con 0x55a0179214d0 2024-08-31T05:39:33.945 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.936+0000 7fe92e3a3640 1 --2- 172.21.15.5:0/2656221685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0179192f0 0x55a017ce6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:39:33.945 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.936+0000 7fe91f7fe640 1 --2- 172.21.15.5:0/2862737856 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe9140b4d20 0x7fe9140b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:33.945 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.936+0000 7fe92dba2640 1 --2- 172.21.15.5:0/2656221685 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0179214d0 0x55a017ce6760 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe92806c470 tx=0x7fe918032c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e51db9817088a116 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:33.945 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.936+0000 7fe92eba4640 1 --2- 172.21.15.5:0/2862737856 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe9140b4d20 0x7fe9140b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:33.945 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.936+0000 7fe91cbfe640 1 -- 172.21.15.5:0/2656221685 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe918035030 con 0x55a0179214d0 2024-08-31T05:39:33.945 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.936+0000 7fe91f7fe640 1 -- 172.21.15.5:0/2862737856 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7fe9240e5c60 con 0x7fe928102760 2024-08-31T05:39:33.946 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.936+0000 7fe91cbfe640 1 -- 172.21.15.5:0/2656221685 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9180316a0 con 0x55a0179214d0 2024-08-31T05:39:33.946 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.936+0000 7fe91cbfe640 1 -- 172.21.15.5:0/2656221685 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe918005640 con 0x55a0179214d0 2024-08-31T05:39:33.946 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.937+0000 7fe937653740 1 -- 172.21.15.5:0/2656221685 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0179214d0 msgr2=0x55a017ce6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:33.946 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.937+0000 7fe92eba4640 1 --2- 172.21.15.5:0/2862737856 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe9140b4d20 0x7fe9140b7230 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe920005fd0 tx=0x7fe920009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:33.946 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.937+0000 7fe937653740 1 --2- 172.21.15.5:0/2656221685 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0179214d0 0x55a017ce6760 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe92806c470 tx=0x7fe918032c50 comp rx=0 tx=0).stop 2024-08-31T05:39:33.946 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.937+0000 7fe937653740 1 -- 172.21.15.5:0/2656221685 shutdown_connections 2024-08-31T05:39:33.946 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.937+0000 7fe937653740 1 --2- 172.21.15.5:0/2656221685 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0179214d0 0x55a017ce6760 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.946 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.937+0000 7fe937653740 1 --2- 172.21.15.5:0/2656221685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0179192f0 0x55a017ce6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.946 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.937+0000 7fe937653740 1 --2- 172.21.15.5:0/2656221685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0179421b0 0x55a017ce5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.946 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.937+0000 7fe937653740 1 -- 172.21.15.5:0/2656221685 >> 172.21.15.5:0/2656221685 conn(0x55a017936300 msgr2=0x55a017ce3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:33.946 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.937+0000 7fe937653740 1 -- 172.21.15.5:0/2656221685 shutdown_connections 2024-08-31T05:39:33.946 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.937+0000 7fe937653740 1 -- 172.21.15.5:0/2656221685 wait complete. 2024-08-31T05:39:33.946 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.937+0000 7fe937653740 1 -- start start 2024-08-31T05:39:33.946 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.938+0000 7fe937653740 1 Processor -- start 2024-08-31T05:39:33.947 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.938+0000 7fe937653740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0179192f0 0x55a017cf18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:33.947 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.938+0000 7fe937653740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0179214d0 0x55a017cf1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:33.947 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.938+0000 7fe937653740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0179421b0 0x55a017cfd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:33.947 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.938+0000 7fe937653740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55a017b83ab0 con 0x55a0179421b0 2024-08-31T05:39:33.947 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.938+0000 7fe937653740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a017bd1680 con 0x55a0179214d0 2024-08-31T05:39:33.947 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.938+0000 7fe937653740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a017cf4400 con 0x55a0179192f0 2024-08-31T05:39:33.947 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.938+0000 7fe937653740 10 client.0 _ll_register_callbacks cb 0x55a017959a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:39:33.947 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.938+0000 7fe92eba4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0179421b0 0x55a017cfd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:33.947 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.938+0000 7fe92eba4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0179421b0 0x55a017cfd750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35056/0 (socket says 172.21.15.5:35056) 2024-08-31T05:39:33.947 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.938+0000 7fe92dba2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0179214d0 0x55a017cf1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:33.947 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.938+0000 7fe92eba4640 1 -- 172.21.15.5:0/3301508181 learned_addr learned my addr 172.21.15.5:0/3301508181 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:33.947 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.938+0000 7fe92e3a3640 1 --2- 172.21.15.5:0/3301508181 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0179192f0 0x55a017cf18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:33.947 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.938+0000 7fe92eba4640 1 -- 172.21.15.5:0/3301508181 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0179192f0 msgr2=0x55a017cf18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:33.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.938+0000 7fe92eba4640 1 --2- 172.21.15.5:0/3301508181 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0179192f0 0x55a017cf18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.938+0000 7fe92eba4640 1 -- 172.21.15.5:0/3301508181 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0179214d0 msgr2=0x55a017cf1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:33.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.938+0000 7fe92eba4640 1 --2- 172.21.15.5:0/3301508181 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0179214d0 0x55a017cf1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.938+0000 7fe92eba4640 1 -- 172.21.15.5:0/3301508181 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a017a26620 con 0x55a0179421b0 2024-08-31T05:39:33.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.938+0000 7fe92dba2640 1 --2- 172.21.15.5:0/3301508181 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0179214d0 0x55a017cf1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:39:33.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.939+0000 7fe92eba4640 1 --2- 172.21.15.5:0/3301508181 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0179421b0 0x55a017cfd750 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fe920003fd0 tx=0x7fe920004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8407c9fba69e682c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:33.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.939+0000 7fe911ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:39:33.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.939+0000 7fe911ffb640 1 -- 172.21.15.5:0/3301508181 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe92000f8b0 con 0x55a0179421b0 2024-08-31T05:39:33.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.939+0000 7fe911ffb640 1 -- 172.21.15.5:0/3301508181 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7fe92000fa50 con 0x55a0179421b0 2024-08-31T05:39:33.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.939+0000 7fe937653740 1 -- 172.21.15.5:0/3301508181 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9180316a0 con 0x55a0179421b0 2024-08-31T05:39:33.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.939+0000 7fe911ffb640 1 -- 172.21.15.5:0/3301508181 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe92000fc50 con 0x55a0179421b0 2024-08-31T05:39:33.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.939+0000 7fe937653740 10 client.18153 fetch_fsmap learned FSMap version 34 2024-08-31T05:39:33.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.939+0000 7fe937653740 1 -- 172.21.15.5:0/3301508181 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a017d00500 con 0x55a0179421b0 2024-08-31T05:39:33.948 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.939+0000 7fe911ffb640 1 -- 172.21.15.5:0/3301508181 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9180316a0 con 0x55a0179421b0 2024-08-31T05:39:33.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.940+0000 7fe911ffb640 1 -- 172.21.15.5:0/3301508181 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fe920026070 con 0x55a0179421b0 2024-08-31T05:39:33.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.940+0000 7fe937653740 10 client.18153 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:39:33.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.940+0000 7fe937653740 10 client.18153 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:39:33.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.940+0000 7fe937653740 20 client.18153 populate_metadata read hostname 'smithi005' 2024-08-31T05:39:33.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.940+0000 7fe937653740 1 --2- 172.21.15.5:0/3301508181 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a017900d80 0x55a017d03b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:33.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.940+0000 7fe937653740 4 client.18153 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:39:33.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.940+0000 7fe937653740 1 -- 172.21.15.5:0/3301508181 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a017c5cf50 con 0x55a017900d80 2024-08-31T05:39:33.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.940+0000 7fe92e3a3640 1 --2- 172.21.15.5:0/3301508181 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a017900d80 0x55a017d03b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:33.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.940+0000 7fe911ffb640 10 client.18153 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:39:33.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.940+0000 7fe92e3a3640 1 --2- 172.21.15.5:0/3301508181 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a017900d80 0x55a017d03b20 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a315e0d4d6626f66 server_cookie=60812345fa626dd2 in_seq=0 out_seq=0 2024-08-31T05:39:33.950 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.941+0000 7fe911ffb640 1 -- 172.21.15.5:0/3301508181 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a017c5cf50 con 0x55a017900d80 2024-08-31T05:39:33.950 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.941+0000 7fe911ffb640 10 client.18153 handle_command_reply: tid=0 2024-08-31T05:39:33.950 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.941+0000 7fe937653740 1 client.18153 shutdown 2024-08-31T05:39:33.951 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.941+0000 7fe937653740 1 -- 172.21.15.5:0/3301508181 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0179421b0 msgr2=0x55a017cfd750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:33.951 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.941+0000 7fe937653740 1 --2- 172.21.15.5:0/3301508181 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0179421b0 0x55a017cfd750 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fe920003fd0 tx=0x7fe920004ab0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.951 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.941+0000 7fe937653740 1 -- 172.21.15.5:0/3301508181 shutdown_connections 2024-08-31T05:39:33.951 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.941+0000 7fe937653740 1 --2- 172.21.15.5:0/3301508181 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a017900d80 0x55a017d03b20 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.951 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.941+0000 7fe937653740 1 --2- 172.21.15.5:0/3301508181 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0179421b0 0x55a017cfd750 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.951 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.941+0000 7fe937653740 1 --2- 172.21.15.5:0/3301508181 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0179214d0 0x55a017cf1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.951 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.941+0000 7fe911ffb640 0 client.18153 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:39:33.951 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.941+0000 7fe937653740 1 --2- 172.21.15.5:0/3301508181 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0179192f0 0x55a017cf18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.951 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.941+0000 7fe937653740 1 -- 172.21.15.5:0/3301508181 >> 172.21.15.5:0/3301508181 conn(0x55a017936300 msgr2=0x55a017ce6d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:33.951 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.941+0000 7fe937653740 1 -- 172.21.15.5:0/3301508181 shutdown_connections 2024-08-31T05:39:33.951 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.942+0000 7fe937653740 1 -- 172.21.15.5:0/3301508181 wait complete. 2024-08-31T05:39:33.951 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.942+0000 7fe937653740 20 client.18153 trim_cache size 0 max 16384 2024-08-31T05:39:33.960 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.956+0000 7fe937653740 1 Processor -- start 2024-08-31T05:39:33.960 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.956+0000 7fe937653740 1 -- start start 2024-08-31T05:39:33.960 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.957+0000 7fe937653740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0179192f0 0x55a017cf1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:33.960 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.957+0000 7fe937653740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0179214d0 0x55a017cfd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:33.961 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.957+0000 7fe937653740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0179421b0 0x55a017cfdb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:33.961 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.957+0000 7fe937653740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe9281b0d80 con 0x55a0179214d0 2024-08-31T05:39:33.961 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.957+0000 7fe937653740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe9281b28c0 con 0x55a0179192f0 2024-08-31T05:39:33.961 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.957+0000 7fe937653740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe9281b1450 con 0x55a0179421b0 2024-08-31T05:39:33.961 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.957+0000 7fe92dba2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0179214d0 0x55a017cfd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:33.961 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.957+0000 7fe92e3a3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0179192f0 0x55a017cf1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:33.961 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.957+0000 7fe92dba2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0179214d0 0x55a017cfd650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35058/0 (socket says 172.21.15.5:35058) 2024-08-31T05:39:33.961 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.957+0000 7fe92dba2640 1 -- 172.21.15.5:0/3842278820 learned_addr learned my addr 172.21.15.5:0/3842278820 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:33.961 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.957+0000 7fe92eba4640 1 --2- 172.21.15.5:0/3842278820 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0179421b0 0x55a017cfdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:33.961 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.957+0000 7fe92dba2640 1 -- 172.21.15.5:0/3842278820 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0179421b0 msgr2=0x55a017cfdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:33.961 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.957+0000 7fe92dba2640 1 --2- 172.21.15.5:0/3842278820 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0179421b0 0x55a017cfdb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.961 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.957+0000 7fe92dba2640 1 -- 172.21.15.5:0/3842278820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0179192f0 msgr2=0x55a017cf1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:33.962 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.957+0000 7fe92dba2640 1 --2- 172.21.15.5:0/3842278820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0179192f0 0x55a017cf1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.962 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.957+0000 7fe92dba2640 1 -- 172.21.15.5:0/3842278820 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a017cdd980 con 0x55a0179214d0 2024-08-31T05:39:33.962 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.957+0000 7fe92e3a3640 1 --2- 172.21.15.5:0/3842278820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0179192f0 0x55a017cf1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:39:33.962 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.957+0000 7fe92dba2640 1 --2- 172.21.15.5:0/3842278820 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0179214d0 0x55a017cfd650 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fe918005ab0 tx=0x7fe918000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c9f9b023275d7b5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:33.962 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.959+0000 7fe913fff640 1 -- 172.21.15.5:0/3842278820 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe918051070 con 0x55a0179214d0 2024-08-31T05:39:33.962 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.959+0000 7fe913fff640 1 -- 172.21.15.5:0/3842278820 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe918005dd0 con 0x55a0179214d0 2024-08-31T05:39:33.962 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.959+0000 7fe913fff640 1 -- 172.21.15.5:0/3842278820 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe918035040 con 0x55a0179214d0 2024-08-31T05:39:33.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.960+0000 7fe937653740 1 -- 172.21.15.5:0/3842278820 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0179214d0 msgr2=0x55a017cfd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:33.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.960+0000 7fe937653740 1 --2- 172.21.15.5:0/3842278820 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0179214d0 0x55a017cfd650 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fe918005ab0 tx=0x7fe918000bc0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.966 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.960+0000 7fe937653740 1 -- 172.21.15.5:0/3842278820 shutdown_connections 2024-08-31T05:39:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.960+0000 7fe937653740 1 --2- 172.21.15.5:0/3842278820 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0179421b0 0x55a017cfdb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.960+0000 7fe937653740 1 --2- 172.21.15.5:0/3842278820 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0179214d0 0x55a017cfd650 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.960+0000 7fe937653740 1 --2- 172.21.15.5:0/3842278820 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0179192f0 0x55a017cf1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.960+0000 7fe937653740 1 -- 172.21.15.5:0/3842278820 >> 172.21.15.5:0/3842278820 conn(0x55a017936300 msgr2=0x55a017cf0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.960+0000 7fe937653740 1 -- 172.21.15.5:0/3842278820 shutdown_connections 2024-08-31T05:39:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.960+0000 7fe937653740 1 -- 172.21.15.5:0/3842278820 wait complete. 2024-08-31T05:39:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.960+0000 7fe937653740 1 -- start start 2024-08-31T05:39:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.960+0000 7fe937653740 1 Processor -- start 2024-08-31T05:39:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.961+0000 7fe937653740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0179192f0 0x55a017cf50b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.961+0000 7fe937653740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0179214d0 0x55a017cf5690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.961+0000 7fe937653740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0179421b0 0x55a017d66510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.961+0000 7fe937653740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe9281b21f0 con 0x55a0179192f0 2024-08-31T05:39:33.967 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.961+0000 7fe937653740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe9281b1b20 con 0x55a0179421b0 2024-08-31T05:39:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.961+0000 7fe937653740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe9281aed80 con 0x55a0179214d0 2024-08-31T05:39:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.961+0000 7fe937653740 10 client.0 _ll_register_callbacks cb 0x7fe920009e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:39:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.961+0000 7fe92dba2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0179214d0 0x55a017cf5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.961+0000 7fe92e3a3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0179192f0 0x55a017cf50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.961+0000 7fe92dba2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0179214d0 0x55a017cf5690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:39288/0 (socket says 172.21.15.5:39288) 2024-08-31T05:39:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.961+0000 7fe92dba2640 1 -- 172.21.15.5:0/2563410266 learned_addr learned my addr 172.21.15.5:0/2563410266 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.961+0000 7fe92e3a3640 1 --2- 172.21.15.5:0/2563410266 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0179192f0 0x55a017cf50b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35072/0 (socket says 172.21.15.5:35072) 2024-08-31T05:39:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.961+0000 7fe92eba4640 1 --2- 172.21.15.5:0/2563410266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0179421b0 0x55a017d66510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.961+0000 7fe92dba2640 1 -- 172.21.15.5:0/2563410266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0179421b0 msgr2=0x55a017d66510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.961+0000 7fe92dba2640 1 --2- 172.21.15.5:0/2563410266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0179421b0 0x55a017d66510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.961+0000 7fe92dba2640 1 -- 172.21.15.5:0/2563410266 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0179192f0 msgr2=0x55a017cf50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.961+0000 7fe92dba2640 1 --2- 172.21.15.5:0/2563410266 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0179192f0 0x55a017cf50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.968 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.961+0000 7fe92dba2640 1 -- 172.21.15.5:0/2563410266 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a017d66bb0 con 0x55a0179214d0 2024-08-31T05:39:33.969 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.961+0000 7fe92dba2640 1 --2- 172.21.15.5:0/2563410266 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0179214d0 0x55a017cf5690 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe918005a80 tx=0x7fe918004530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=980d3eb9baefb747 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:33.969 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.961+0000 7fe911ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:39:33.969 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.962+0000 7fe911ffb640 1 -- 172.21.15.5:0/2563410266 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe918035070 con 0x55a0179214d0 2024-08-31T05:39:33.969 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.962+0000 7fe937653740 1 -- 172.21.15.5:0/2563410266 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe918005dd0 con 0x55a0179214d0 2024-08-31T05:39:33.969 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.962+0000 7fe911ffb640 1 -- 172.21.15.5:0/2563410266 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7fe9180046c0 con 0x55a0179214d0 2024-08-31T05:39:33.969 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.962+0000 7fe911ffb640 1 -- 172.21.15.5:0/2563410266 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe918051070 con 0x55a0179214d0 2024-08-31T05:39:33.969 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.962+0000 7fe937653740 10 client.27739 fetch_fsmap learned FSMap version 34 2024-08-31T05:39:33.969 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.962+0000 7fe937653740 1 -- 172.21.15.5:0/2563410266 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a017d6dfa0 con 0x55a0179214d0 2024-08-31T05:39:33.969 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.962+0000 7fe911ffb640 1 -- 172.21.15.5:0/2563410266 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe918005dd0 con 0x55a0179214d0 2024-08-31T05:39:33.969 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.962+0000 7fe911ffb640 1 -- 172.21.15.5:0/2563410266 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fe91804b070 con 0x55a0179214d0 2024-08-31T05:39:33.970 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.962+0000 7fe937653740 10 client.27739 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:39:33.970 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.962+0000 7fe937653740 10 client.27739 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:39:33.970 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.962+0000 7fe937653740 20 client.27739 populate_metadata read hostname 'smithi005' 2024-08-31T05:39:33.970 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.962+0000 7fe937653740 1 --2- 172.21.15.5:0/2563410266 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a0178d61c0 0x55a017d70230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:33.970 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.962+0000 7fe937653740 4 client.27739 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:39:33.970 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.962+0000 7fe937653740 1 -- 172.21.15.5:0/2563410266 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a017c589f0 con 0x55a0178d61c0 2024-08-31T05:39:33.970 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.962+0000 7fe92e3a3640 1 --2- 172.21.15.5:0/2563410266 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a0178d61c0 0x55a017d70230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:33.970 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.963+0000 7fe92e3a3640 1 --2- 172.21.15.5:0/2563410266 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a0178d61c0 0x55a017d70230 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a4ba2f7ae441b71 server_cookie=d28e9d6957c9e577 in_seq=0 out_seq=0 2024-08-31T05:39:33.970 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.963+0000 7fe911ffb640 10 client.27739 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:39:33.980 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.976+0000 7fe911ffb640 1 -- 172.21.15.5:0/2563410266 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a017c589f0 con 0x55a0178d61c0 2024-08-31T05:39:33.980 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.976+0000 7fe911ffb640 10 client.27739 handle_command_reply: tid=0 2024-08-31T05:39:33.980 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.976+0000 7fe937653740 1 client.27739 shutdown 2024-08-31T05:39:33.980 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.976+0000 7fe937653740 1 -- 172.21.15.5:0/2563410266 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0179214d0 msgr2=0x55a017cf5690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:33.980 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.976+0000 7fe937653740 1 --2- 172.21.15.5:0/2563410266 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0179214d0 0x55a017cf5690 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe918005a80 tx=0x7fe918004530 comp rx=0 tx=0).stop 2024-08-31T05:39:33.980 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.977+0000 7fe937653740 1 -- 172.21.15.5:0/2563410266 shutdown_connections 2024-08-31T05:39:33.980 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.977+0000 7fe937653740 1 --2- 172.21.15.5:0/2563410266 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a0178d61c0 0x55a017d70230 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.977+0000 7fe937653740 1 --2- 172.21.15.5:0/2563410266 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a0179421b0 0x55a017d66510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.977+0000 7fe911ffb640 0 client.27739 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:39:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.977+0000 7fe937653740 1 --2- 172.21.15.5:0/2563410266 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0179214d0 0x55a017cf5690 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.977+0000 7fe937653740 1 --2- 172.21.15.5:0/2563410266 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a0179192f0 0x55a017cf50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.977+0000 7fe937653740 1 -- 172.21.15.5:0/2563410266 >> 172.21.15.5:0/2563410266 conn(0x55a017936300 msgr2=0x55a017cf2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.977+0000 7fe937653740 1 -- 172.21.15.5:0/2563410266 shutdown_connections 2024-08-31T05:39:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.977+0000 7fe937653740 1 -- 172.21.15.5:0/2563410266 wait complete. 2024-08-31T05:39:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.977+0000 7fe937653740 20 client.27739 trim_cache size 0 max 16384 2024-08-31T05:39:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:39:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:39:33.982 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:39:33.982 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:39:33.982 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.977+0000 7fe930607640 1 -- 172.21.15.5:0/2862737856 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe9140b4d20 msgr2=0x7fe9140b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:33.982 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.977+0000 7fe930607640 1 --2- 172.21.15.5:0/2862737856 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe9140b4d20 0x7fe9140b7230 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe920005fd0 tx=0x7fe920009500 comp rx=0 tx=0).stop 2024-08-31T05:39:33.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.977+0000 7fe930607640 1 -- 172.21.15.5:0/2862737856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe928102760 msgr2=0x7fe92819a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:33.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.977+0000 7fe930607640 1 --2- 172.21.15.5:0/2862737856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe928102760 0x7fe92819a1c0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fe92400e9f0 tx=0x7fe92400eeb0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.977+0000 7fe930607640 1 -- 172.21.15.5:0/2862737856 shutdown_connections 2024-08-31T05:39:33.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.977+0000 7fe930607640 1 --2- 172.21.15.5:0/2862737856 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe9140b4d20 0x7fe9140b7230 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.977+0000 7fe930607640 1 --2- 172.21.15.5:0/2862737856 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe9281089e0 0x7fe92819f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.977+0000 7fe930607640 1 --2- 172.21.15.5:0/2862737856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe928108090 0x7fe92819a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.977+0000 7fe930607640 1 --2- 172.21.15.5:0/2862737856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe928102760 0x7fe92819a1c0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:33.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.977+0000 7fe930607640 1 -- 172.21.15.5:0/2862737856 >> 172.21.15.5:0/2862737856 conn(0x7fe9280fe160 msgr2=0x7fe92806add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:33.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.977+0000 7fe930607640 1 -- 172.21.15.5:0/2862737856 shutdown_connections 2024-08-31T05:39:33.983 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:33.978+0000 7fe930607640 1 -- 172.21.15.5:0/2862737856 wait complete. 2024-08-31T05:39:34.862 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T05:39:34.862 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T05:39:34.933 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1084876 11.12 MB/sec execute 382 sec latency 24.570 ms 2024-08-31T05:39:35.125 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:39:35.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:39:34 smithi005 ceph-mon[18602]: pgmap v639: 129 pgs: 129 active+clean; 568 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.7 MiB/s wr, 185 op/s 2024-08-31T05:39:35.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:39:34 smithi070 ceph-mon[22316]: pgmap v639: 129 pgs: 129 active+clean; 568 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.7 MiB/s wr, 185 op/s 2024-08-31T05:39:35.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:39:34 smithi050 ceph-mon[22146]: pgmap v639: 129 pgs: 129 active+clean; 568 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.7 MiB/s wr, 185 op/s 2024-08-31T05:39:35.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.672+0000 7fa176d32640 1 -- 172.21.15.5:0/93242320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa170108ab0 msgr2=0x7fa17010f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:35.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.672+0000 7fa176d32640 1 --2- 172.21.15.5:0/93242320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa170108ab0 0x7fa17010f2e0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fa168009ca0 tx=0x7fa16802a8c0 comp rx=0 tx=0).stop 2024-08-31T05:39:35.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.672+0000 7fa176d32640 1 -- 172.21.15.5:0/93242320 shutdown_connections 2024-08-31T05:39:35.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.672+0000 7fa176d32640 1 --2- 172.21.15.5:0/93242320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa170108ab0 0x7fa17010f2e0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:35.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.672+0000 7fa176d32640 1 --2- 172.21.15.5:0/93242320 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa170108160 0x7fa170108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:35.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.672+0000 7fa176d32640 1 --2- 172.21.15.5:0/93242320 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa170102820 0x7fa170102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:35.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.672+0000 7fa176d32640 1 -- 172.21.15.5:0/93242320 >> 172.21.15.5:0/93242320 conn(0x7fa1700794e0 msgr2=0x7fa1700798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:35.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.673+0000 7fa176d32640 1 -- 172.21.15.5:0/93242320 shutdown_connections 2024-08-31T05:39:35.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.673+0000 7fa176d32640 1 -- 172.21.15.5:0/93242320 wait complete. 2024-08-31T05:39:35.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.673+0000 7fa176d32640 1 Processor -- start 2024-08-31T05:39:35.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.673+0000 7fa176d32640 1 -- start start 2024-08-31T05:39:35.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.673+0000 7fa176d32640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa170102820 0x7fa17019b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:35.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.674+0000 7fa176d32640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa170108160 0x7fa17019b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:35.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.674+0000 7fa176d32640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa170108ab0 0x7fa17019baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:35.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.674+0000 7fa176d32640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa170112780 con 0x7fa170108160 2024-08-31T05:39:35.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.674+0000 7fa176d32640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa170112600 con 0x7fa170108ab0 2024-08-31T05:39:35.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.674+0000 7fa176d32640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa170112900 con 0x7fa170102820 2024-08-31T05:39:35.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.674+0000 7fa174ace640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa170102820 0x7fa17019b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:35.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.674+0000 7fa1752cf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa170108ab0 0x7fa17019baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:35.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.674+0000 7fa174ace640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa170102820 0x7fa17019b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:39308/0 (socket says 172.21.15.5:39308) 2024-08-31T05:39:35.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.674+0000 7fa174ace640 1 -- 172.21.15.5:0/1433097185 learned_addr learned my addr 172.21.15.5:0/1433097185 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:35.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.674+0000 7fa16ffff640 1 --2- 172.21.15.5:0/1433097185 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa170108160 0x7fa17019b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:35.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.674+0000 7fa174ace640 1 -- 172.21.15.5:0/1433097185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa170108ab0 msgr2=0x7fa17019baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:35.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.674+0000 7fa174ace640 1 --2- 172.21.15.5:0/1433097185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa170108ab0 0x7fa17019baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:35.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.674+0000 7fa174ace640 1 -- 172.21.15.5:0/1433097185 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa170108160 msgr2=0x7fa17019b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:35.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.674+0000 7fa174ace640 1 --2- 172.21.15.5:0/1433097185 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa170108160 0x7fa17019b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:35.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.674+0000 7fa174ace640 1 -- 172.21.15.5:0/1433097185 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1701a6300 con 0x7fa170102820 2024-08-31T05:39:35.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.674+0000 7fa16ffff640 1 --2- 172.21.15.5:0/1433097185 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa170108160 0x7fa17019b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:39:35.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.675+0000 7fa174ace640 1 --2- 172.21.15.5:0/1433097185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa170102820 0x7fa17019b070 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa16400e9f0 tx=0x7fa16400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:35.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.675+0000 7fa16dffb640 1 -- 172.21.15.5:0/1433097185 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa16400cd80 con 0x7fa170102820 2024-08-31T05:39:35.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.675+0000 7fa16dffb640 1 -- 172.21.15.5:0/1433097185 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1640108e0 con 0x7fa170102820 2024-08-31T05:39:35.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.675+0000 7fa176d32640 1 -- 172.21.15.5:0/1433097185 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa170198ec0 con 0x7fa170102820 2024-08-31T05:39:35.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.675+0000 7fa16dffb640 1 -- 172.21.15.5:0/1433097185 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa164018980 con 0x7fa170102820 2024-08-31T05:39:35.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.675+0000 7fa176d32640 1 -- 172.21.15.5:0/1433097185 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa170199400 con 0x7fa170102820 2024-08-31T05:39:35.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.678+0000 7fa17d2a7740 1 Processor -- start 2024-08-31T05:39:35.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.678+0000 7fa16dffb640 1 -- 172.21.15.5:0/1433097185 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fa164010430 con 0x7fa170102820 2024-08-31T05:39:35.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.678+0000 7fa17d2a7740 1 -- start start 2024-08-31T05:39:35.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.678+0000 7fa17d2a7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ad0f75350 0x564ad131b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:35.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.678+0000 7fa17d2a7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ad0f4c490 0x564ad131bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:35.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.678+0000 7fa17d2a7740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ad0f54670 0x564ad131c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:35.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.678+0000 7fa17d2a7740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x564ad12915f0 con 0x564ad0f54670 2024-08-31T05:39:35.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.678+0000 7fa17d2a7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564ad1280b80 con 0x564ad0f4c490 2024-08-31T05:39:35.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.678+0000 7fa17d2a7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564ad1284b30 con 0x564ad0f75350 2024-08-31T05:39:35.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.679+0000 7fa1752cf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ad0f75350 0x564ad131b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:35.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.679+0000 7fa1752cf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ad0f75350 0x564ad131b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:39316/0 (socket says 172.21.15.5:39316) 2024-08-31T05:39:35.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.679+0000 7fa1752cf640 1 -- 172.21.15.5:0/1991203893 learned_addr learned my addr 172.21.15.5:0/1991203893 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:35.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.679+0000 7fa16ffff640 1 --2- 172.21.15.5:0/1991203893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ad0f54670 0x564ad131c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:35.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.679+0000 7fa174ace640 1 --2- 172.21.15.5:0/1991203893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ad0f4c490 0x564ad131bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:35.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.679+0000 7fa1752cf640 1 -- 172.21.15.5:0/1991203893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ad0f4c490 msgr2=0x564ad131bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:35.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.679+0000 7fa1752cf640 1 --2- 172.21.15.5:0/1991203893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ad0f4c490 0x564ad131bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:35.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.679+0000 7fa1752cf640 1 -- 172.21.15.5:0/1991203893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ad0f54670 msgr2=0x564ad131c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:35.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.679+0000 7fa1752cf640 1 --2- 172.21.15.5:0/1991203893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ad0f54670 0x564ad131c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:35.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.679+0000 7fa1752cf640 1 -- 172.21.15.5:0/1991203893 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ad0fe0930 con 0x564ad0f75350 2024-08-31T05:39:35.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.679+0000 7fa1752cf640 1 --2- 172.21.15.5:0/1991203893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ad0f75350 0x564ad131b780 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa168009ca0 tx=0x7fa168009430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=573347c2728ca5c4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:35.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.679+0000 7fa15affd640 1 -- 172.21.15.5:0/1991203893 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa168031cf0 con 0x564ad0f75350 2024-08-31T05:39:35.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.679+0000 7fa16dffb640 1 --2- 172.21.15.5:0/1433097185 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa1600b4cd0 0x7fa1600b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:35.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.679+0000 7fa15affd640 1 -- 172.21.15.5:0/1991203893 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa168036030 con 0x564ad0f75350 2024-08-31T05:39:35.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.679+0000 7fa15affd640 1 -- 172.21.15.5:0/1991203893 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa168004280 con 0x564ad0f75350 2024-08-31T05:39:35.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.680+0000 7fa174ace640 1 --2- 172.21.15.5:0/1433097185 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa1600b4cd0 0x7fa1600b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:35.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.680+0000 7fa16dffb640 1 -- 172.21.15.5:0/1433097185 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7fa1640e5c70 con 0x7fa170102820 2024-08-31T05:39:35.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.680+0000 7fa17d2a7740 1 -- 172.21.15.5:0/1991203893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ad0f75350 msgr2=0x564ad131b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:35.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.680+0000 7fa174ace640 1 --2- 172.21.15.5:0/1433097185 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa1600b4cd0 0x7fa1600b71e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x564ad131a400 tx=0x7fa16400cf20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:35.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.680+0000 7fa17d2a7740 1 --2- 172.21.15.5:0/1991203893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ad0f75350 0x564ad131b780 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa168009ca0 tx=0x7fa168009430 comp rx=0 tx=0).stop 2024-08-31T05:39:35.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.681+0000 7fa17d2a7740 1 -- 172.21.15.5:0/1991203893 shutdown_connections 2024-08-31T05:39:35.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.681+0000 7fa17d2a7740 1 --2- 172.21.15.5:0/1991203893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ad0f54670 0x564ad131c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:35.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.681+0000 7fa17d2a7740 1 --2- 172.21.15.5:0/1991203893 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ad0f4c490 0x564ad131bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:35.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.681+0000 7fa17d2a7740 1 --2- 172.21.15.5:0/1991203893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ad0f75350 0x564ad131b780 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:35.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.681+0000 7fa17d2a7740 1 -- 172.21.15.5:0/1991203893 >> 172.21.15.5:0/1991203893 conn(0x564ad0f69740 msgr2=0x564ad1319670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:35.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.681+0000 7fa17d2a7740 1 -- 172.21.15.5:0/1991203893 shutdown_connections 2024-08-31T05:39:35.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.681+0000 7fa17d2a7740 1 -- 172.21.15.5:0/1991203893 wait complete. 2024-08-31T05:39:35.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.681+0000 7fa17d2a7740 1 -- start start 2024-08-31T05:39:35.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.681+0000 7fa17d2a7740 1 Processor -- start 2024-08-31T05:39:35.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.682+0000 7fa17d2a7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ad0f4c490 0x564ad1326e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:35.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.682+0000 7fa17d2a7740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ad0f54670 0x564ad13273d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:35.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.682+0000 7fa17d2a7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ad0f75350 0x564ad1333070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:35.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.682+0000 7fa17d2a7740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x564ad10e3890 con 0x564ad0f54670 2024-08-31T05:39:35.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.682+0000 7fa17d2a7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564ad1207790 con 0x564ad0f75350 2024-08-31T05:39:35.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.682+0000 7fa17d2a7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564ad1329d80 con 0x564ad0f4c490 2024-08-31T05:39:35.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.682+0000 7fa17d2a7740 10 client.0 _ll_register_callbacks cb 0x564ad0f8cba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:39:35.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.682+0000 7fa1752cf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ad0f4c490 0x564ad1326e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:35.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.682+0000 7fa1752cf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ad0f4c490 0x564ad1326e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:39328/0 (socket says 172.21.15.5:39328) 2024-08-31T05:39:35.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.682+0000 7fa16ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ad0f54670 0x564ad13273d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:35.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.682+0000 7fa1752cf640 1 -- 172.21.15.5:0/1701214287 learned_addr learned my addr 172.21.15.5:0/1701214287 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:35.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.682+0000 7fa1752cf640 1 --2- 172.21.15.5:0/1701214287 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ad0f75350 0x564ad1333070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:35.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.682+0000 7fa16ffff640 1 -- 172.21.15.5:0/1701214287 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ad0f4c490 msgr2=0x564ad1326e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:35.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.682+0000 7fa16ffff640 1 --2- 172.21.15.5:0/1701214287 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ad0f4c490 0x564ad1326e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:35.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.682+0000 7fa16ffff640 1 -- 172.21.15.5:0/1701214287 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ad0f75350 msgr2=0x564ad1333070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:35.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.682+0000 7fa16ffff640 1 --2- 172.21.15.5:0/1701214287 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ad0f75350 0x564ad1333070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:35.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.682+0000 7fa16ffff640 1 -- 172.21.15.5:0/1701214287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ad123ef30 con 0x564ad0f54670 2024-08-31T05:39:35.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.682+0000 7fa1752cf640 1 --2- 172.21.15.5:0/1701214287 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ad0f4c490 0x564ad1326e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:39:35.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.683+0000 7fa16ffff640 1 --2- 172.21.15.5:0/1701214287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ad0f54670 0x564ad13273d0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fa17006a840 tx=0x7fa15c00e780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8be4f9b29c314ad server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:35.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.683+0000 7fa14ffff640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:39:35.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.683+0000 7fa14ffff640 1 -- 172.21.15.5:0/1701214287 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa15c005020 con 0x564ad0f54670 2024-08-31T05:39:35.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.683+0000 7fa14ffff640 1 -- 172.21.15.5:0/1701214287 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7fa15c0051c0 con 0x564ad0f54670 2024-08-31T05:39:35.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.683+0000 7fa17d2a7740 1 -- 172.21.15.5:0/1701214287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa168036030 con 0x564ad0f54670 2024-08-31T05:39:35.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.683+0000 7fa14ffff640 1 -- 172.21.15.5:0/1701214287 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fa15c0053c0 con 0x564ad0f54670 2024-08-31T05:39:35.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.683+0000 7fa17d2a7740 10 client.18171 fetch_fsmap learned FSMap version 34 2024-08-31T05:39:35.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.683+0000 7fa17d2a7740 1 -- 172.21.15.5:0/1701214287 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x564ad1335b50 con 0x564ad0f54670 2024-08-31T05:39:35.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.683+0000 7fa14ffff640 1 -- 172.21.15.5:0/1701214287 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa168036030 con 0x564ad0f54670 2024-08-31T05:39:35.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.684+0000 7fa14ffff640 1 -- 172.21.15.5:0/1701214287 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fa15c01a0c0 con 0x564ad0f54670 2024-08-31T05:39:35.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.684+0000 7fa17d2a7740 10 client.18171 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:39:35.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.684+0000 7fa17d2a7740 10 client.18171 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:39:35.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.684+0000 7fa17d2a7740 20 client.18171 populate_metadata read hostname 'smithi005' 2024-08-31T05:39:35.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.684+0000 7fa17d2a7740 1 --2- 172.21.15.5:0/1701214287 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x564ad0f33cd0 0x564ad1339110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:35.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.684+0000 7fa17d2a7740 4 client.18171 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:39:35.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.684+0000 7fa17d2a7740 1 -- 172.21.15.5:0/1701214287 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ad1293540 con 0x564ad0f33cd0 2024-08-31T05:39:35.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.684+0000 7fa1752cf640 1 --2- 172.21.15.5:0/1701214287 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x564ad0f33cd0 0x564ad1339110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:35.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.685+0000 7fa14ffff640 10 client.18171 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:39:35.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.685+0000 7fa1752cf640 1 --2- 172.21.15.5:0/1701214287 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x564ad0f33cd0 0x564ad1339110 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a5a7bb1eb743423 server_cookie=a5c04af34ff2ba73 in_seq=0 out_seq=0 2024-08-31T05:39:35.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.685+0000 7fa14ffff640 1 -- 172.21.15.5:0/1701214287 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564ad1293540 con 0x564ad0f33cd0 2024-08-31T05:39:35.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.685+0000 7fa14ffff640 10 client.18171 handle_command_reply: tid=0 2024-08-31T05:39:35.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.685+0000 7fa17d2a7740 1 client.18171 shutdown 2024-08-31T05:39:35.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.686+0000 7fa17d2a7740 1 -- 172.21.15.5:0/1701214287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ad0f54670 msgr2=0x564ad13273d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:35.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.686+0000 7fa17d2a7740 1 --2- 172.21.15.5:0/1701214287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ad0f54670 0x564ad13273d0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fa17006a840 tx=0x7fa15c00e780 comp rx=0 tx=0).stop 2024-08-31T05:39:35.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.686+0000 7fa17d2a7740 1 -- 172.21.15.5:0/1701214287 shutdown_connections 2024-08-31T05:39:35.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.686+0000 7fa17d2a7740 1 --2- 172.21.15.5:0/1701214287 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x564ad0f33cd0 0x564ad1339110 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:35.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.686+0000 7fa17d2a7740 1 --2- 172.21.15.5:0/1701214287 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ad0f75350 0x564ad1333070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:35.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.686+0000 7fa17d2a7740 1 --2- 172.21.15.5:0/1701214287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ad0f54670 0x564ad13273d0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:35.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.686+0000 7fa17d2a7740 1 --2- 172.21.15.5:0/1701214287 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ad0f4c490 0x564ad1326e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:35.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.686+0000 7fa17d2a7740 1 -- 172.21.15.5:0/1701214287 >> 172.21.15.5:0/1701214287 conn(0x564ad0f69740 msgr2=0x564ad131e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:35.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.686+0000 7fa14ffff640 0 client.18171 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:39:35.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.686+0000 7fa17d2a7740 1 -- 172.21.15.5:0/1701214287 shutdown_connections 2024-08-31T05:39:35.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.686+0000 7fa17d2a7740 1 -- 172.21.15.5:0/1701214287 wait complete. 2024-08-31T05:39:35.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.686+0000 7fa17d2a7740 20 client.18171 trim_cache size 0 max 16384 2024-08-31T05:39:35.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.725+0000 7fa17d2a7740 1 Processor -- start 2024-08-31T05:39:35.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.725+0000 7fa17d2a7740 1 -- start start 2024-08-31T05:39:35.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.725+0000 7fa17d2a7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ad0f4c490 0x564ad1322670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:35.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.725+0000 7fa17d2a7740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ad0f54670 0x564ad131cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:35.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.725+0000 7fa17d2a7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ad0f75350 0x564ad1332f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:35.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.725+0000 7fa17d2a7740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa1701aeb40 con 0x564ad0f54670 2024-08-31T05:39:35.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.725+0000 7fa17d2a7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa1701b0680 con 0x564ad0f75350 2024-08-31T05:39:35.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.725+0000 7fa17d2a7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa1701af210 con 0x564ad0f4c490 2024-08-31T05:39:35.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.725+0000 7fa16ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ad0f54670 0x564ad131cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:35.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.725+0000 7fa1752cf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ad0f4c490 0x564ad1322670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:35.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.725+0000 7fa16ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ad0f54670 0x564ad131cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35138/0 (socket says 172.21.15.5:35138) 2024-08-31T05:39:35.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.725+0000 7fa16ffff640 1 -- 172.21.15.5:0/2019102966 learned_addr learned my addr 172.21.15.5:0/2019102966 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:35.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.725+0000 7fa1752cf640 1 --2- 172.21.15.5:0/2019102966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ad0f75350 0x564ad1332f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:35.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.725+0000 7fa1752cf640 1 -- 172.21.15.5:0/2019102966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ad0f75350 msgr2=0x564ad1332f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:35.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.726+0000 7fa1752cf640 1 --2- 172.21.15.5:0/2019102966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ad0f75350 0x564ad1332f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:35.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.726+0000 7fa1752cf640 1 -- 172.21.15.5:0/2019102966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ad0f54670 msgr2=0x564ad131cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:35.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.726+0000 7fa1752cf640 1 --2- 172.21.15.5:0/2019102966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ad0f54670 0x564ad131cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:35.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.726+0000 7fa1752cf640 1 -- 172.21.15.5:0/2019102966 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ad1326720 con 0x564ad0f4c490 2024-08-31T05:39:35.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.726+0000 7fa1752cf640 1 --2- 172.21.15.5:0/2019102966 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ad0f4c490 0x564ad1322670 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x564ad13296e0 tx=0x7fa168003d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b074a6dcb33110 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:35.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.726+0000 7fa15a7fc640 1 -- 172.21.15.5:0/2019102966 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa168070070 con 0x564ad0f4c490 2024-08-31T05:39:35.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.726+0000 7fa15a7fc640 1 -- 172.21.15.5:0/2019102966 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa168036040 con 0x564ad0f4c490 2024-08-31T05:39:35.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.726+0000 7fa15a7fc640 1 -- 172.21.15.5:0/2019102966 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa168004640 con 0x564ad0f4c490 2024-08-31T05:39:35.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.727+0000 7fa17d2a7740 1 -- 172.21.15.5:0/2019102966 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ad0f4c490 msgr2=0x564ad1322670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:35.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.727+0000 7fa17d2a7740 1 --2- 172.21.15.5:0/2019102966 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ad0f4c490 0x564ad1322670 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x564ad13296e0 tx=0x7fa168003d80 comp rx=0 tx=0).stop 2024-08-31T05:39:35.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.727+0000 7fa17d2a7740 1 -- 172.21.15.5:0/2019102966 shutdown_connections 2024-08-31T05:39:35.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.727+0000 7fa17d2a7740 1 --2- 172.21.15.5:0/2019102966 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ad0f75350 0x564ad1332f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:35.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.727+0000 7fa17d2a7740 1 --2- 172.21.15.5:0/2019102966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ad0f54670 0x564ad131cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:35.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.727+0000 7fa17d2a7740 1 --2- 172.21.15.5:0/2019102966 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ad0f4c490 0x564ad1322670 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:35.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.727+0000 7fa17d2a7740 1 -- 172.21.15.5:0/2019102966 >> 172.21.15.5:0/2019102966 conn(0x564ad0f69740 msgr2=0x564ad131c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:35.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.727+0000 7fa17d2a7740 1 -- 172.21.15.5:0/2019102966 shutdown_connections 2024-08-31T05:39:35.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.727+0000 7fa17d2a7740 1 -- 172.21.15.5:0/2019102966 wait complete. 2024-08-31T05:39:35.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.728+0000 7fa17d2a7740 1 -- start start 2024-08-31T05:39:35.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.728+0000 7fa17d2a7740 1 Processor -- start 2024-08-31T05:39:35.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.728+0000 7fa17d2a7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ad0f4c490 0x564ad132b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:35.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.728+0000 7fa17d2a7740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ad0f54670 0x564ad132b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:35.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.728+0000 7fa17d2a7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ad0f75350 0x564ad132bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:35.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.728+0000 7fa17d2a7740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa1701affb0 con 0x564ad0f54670 2024-08-31T05:39:35.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.728+0000 7fa17d2a7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa1701af8e0 con 0x564ad0f4c490 2024-08-31T05:39:35.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.728+0000 7fa17d2a7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa1701acb40 con 0x564ad0f75350 2024-08-31T05:39:35.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.728+0000 7fa17d2a7740 10 client.0 _ll_register_callbacks cb 0x7fa15c009cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:39:35.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.729+0000 7fa1752cf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ad0f4c490 0x564ad132b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:35.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.729+0000 7fa1752cf640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ad0f4c490 0x564ad132b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:37152/0 (socket says 172.21.15.5:37152) 2024-08-31T05:39:35.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.729+0000 7fa16ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ad0f54670 0x564ad132b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:35.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.729+0000 7fa1752cf640 1 -- 172.21.15.5:0/4120730489 learned_addr learned my addr 172.21.15.5:0/4120730489 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:35.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.729+0000 7fa1752cf640 1 --2- 172.21.15.5:0/4120730489 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ad0f75350 0x564ad132bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:35.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.729+0000 7fa1752cf640 1 -- 172.21.15.5:0/4120730489 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ad0f75350 msgr2=0x564ad132bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:35.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.729+0000 7fa1752cf640 1 --2- 172.21.15.5:0/4120730489 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ad0f75350 0x564ad132bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:35.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.729+0000 7fa1752cf640 1 -- 172.21.15.5:0/4120730489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ad0f54670 msgr2=0x564ad132b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:35.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.729+0000 7fa1752cf640 1 --2- 172.21.15.5:0/4120730489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ad0f54670 0x564ad132b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:35.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.729+0000 7fa1752cf640 1 -- 172.21.15.5:0/4120730489 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ad13a2cc0 con 0x564ad0f4c490 2024-08-31T05:39:35.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.729+0000 7fa1752cf640 1 --2- 172.21.15.5:0/4120730489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ad0f4c490 0x564ad132b140 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa168003c80 tx=0x7fa16802a8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b66f58a6368f9bf4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:35.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.729+0000 7fa14ffff640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:39:35.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.729+0000 7fa14ffff640 1 -- 172.21.15.5:0/4120730489 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa168070070 con 0x564ad0f4c490 2024-08-31T05:39:35.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.730+0000 7fa14ffff640 1 -- 172.21.15.5:0/4120730489 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7fa1680043c0 con 0x564ad0f4c490 2024-08-31T05:39:35.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.730+0000 7fa17d2a7740 1 -- 172.21.15.5:0/4120730489 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa168036040 con 0x564ad0f4c490 2024-08-31T05:39:35.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.730+0000 7fa14ffff640 1 -- 172.21.15.5:0/4120730489 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fa1680045c0 con 0x564ad0f4c490 2024-08-31T05:39:35.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.730+0000 7fa17d2a7740 10 client.27752 fetch_fsmap learned FSMap version 34 2024-08-31T05:39:35.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.730+0000 7fa17d2a7740 1 -- 172.21.15.5:0/4120730489 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x564ad13a3f60 con 0x564ad0f4c490 2024-08-31T05:39:35.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.730+0000 7fa14ffff640 1 -- 172.21.15.5:0/4120730489 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa16807d030 con 0x564ad0f4c490 2024-08-31T05:39:35.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.730+0000 7fa14ffff640 1 -- 172.21.15.5:0/4120730489 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fa168050040 con 0x564ad0f4c490 2024-08-31T05:39:35.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.731+0000 7fa17d2a7740 10 client.27752 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:39:35.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.731+0000 7fa17d2a7740 10 client.27752 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:39:35.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.731+0000 7fa17d2a7740 20 client.27752 populate_metadata read hostname 'smithi005' 2024-08-31T05:39:35.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.731+0000 7fa17d2a7740 1 --2- 172.21.15.5:0/4120730489 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x564ad0f09080 0x564ad13a62b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:35.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.731+0000 7fa17d2a7740 4 client.27752 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T05:39:35.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.731+0000 7fa17d2a7740 1 -- 172.21.15.5:0/4120730489 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x564ad128efe0 con 0x564ad0f09080 2024-08-31T05:39:35.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.731+0000 7fa16ffff640 1 --2- 172.21.15.5:0/4120730489 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x564ad0f09080 0x564ad13a62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:35.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.731+0000 7fa14ffff640 10 client.27752 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:39:35.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.731+0000 7fa16ffff640 1 --2- 172.21.15.5:0/4120730489 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x564ad0f09080 0x564ad13a62b0 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8e0db38012fd104 server_cookie=262c9056d6bea6f5 in_seq=0 out_seq=0 2024-08-31T05:39:35.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.733+0000 7fa14ffff640 1 -- 172.21.15.5:0/4120730489 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564ad128efe0 con 0x564ad0f09080 2024-08-31T05:39:35.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.733+0000 7fa14ffff640 10 client.27752 handle_command_reply: tid=0 2024-08-31T05:39:35.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.733+0000 7fa17d2a7740 1 client.27752 shutdown 2024-08-31T05:39:35.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.734+0000 7fa17d2a7740 1 -- 172.21.15.5:0/4120730489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ad0f4c490 msgr2=0x564ad132b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:35.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.734+0000 7fa17d2a7740 1 --2- 172.21.15.5:0/4120730489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ad0f4c490 0x564ad132b140 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa168003c80 tx=0x7fa16802a8c0 comp rx=0 tx=0).stop 2024-08-31T05:39:35.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.734+0000 7fa17d2a7740 1 -- 172.21.15.5:0/4120730489 shutdown_connections 2024-08-31T05:39:35.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.734+0000 7fa17d2a7740 1 --2- 172.21.15.5:0/4120730489 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x564ad0f09080 0x564ad13a62b0 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:35.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.734+0000 7fa17d2a7740 1 --2- 172.21.15.5:0/4120730489 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ad0f75350 0x564ad132bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:35.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.734+0000 7fa17d2a7740 1 --2- 172.21.15.5:0/4120730489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ad0f54670 0x564ad132b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:35.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.734+0000 7fa17d2a7740 1 --2- 172.21.15.5:0/4120730489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564ad0f4c490 0x564ad132b140 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:35.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.734+0000 7fa14ffff640 0 client.27752 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:39:35.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.734+0000 7fa17d2a7740 1 -- 172.21.15.5:0/4120730489 >> 172.21.15.5:0/4120730489 conn(0x564ad0f69740 msgr2=0x564ad131e880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:35.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.734+0000 7fa17d2a7740 1 -- 172.21.15.5:0/4120730489 shutdown_connections 2024-08-31T05:39:35.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.734+0000 7fa17d2a7740 1 -- 172.21.15.5:0/4120730489 wait complete. 2024-08-31T05:39:35.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.734+0000 7fa17d2a7740 20 client.27752 trim_cache size 0 max 16384 2024-08-31T05:39:35.739 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:39:35.739 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-08-31T05:39:35.739 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "239b7958-db06-4432-93ce-b7552effa357", 2024-08-31T05:39:35.739 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-08-31T05:39:35.739 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:39:35.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.735+0000 7fa176d32640 1 -- 172.21.15.5:0/1433097185 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa1600b4cd0 msgr2=0x7fa1600b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:35.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.735+0000 7fa176d32640 1 --2- 172.21.15.5:0/1433097185 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa1600b4cd0 0x7fa1600b71e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x564ad131a400 tx=0x7fa16400cf20 comp rx=0 tx=0).stop 2024-08-31T05:39:35.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.735+0000 7fa176d32640 1 -- 172.21.15.5:0/1433097185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa170102820 msgr2=0x7fa17019b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:35.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.735+0000 7fa176d32640 1 --2- 172.21.15.5:0/1433097185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa170102820 0x7fa17019b070 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa16400e9f0 tx=0x7fa16400eeb0 comp rx=0 tx=0).stop 2024-08-31T05:39:35.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.735+0000 7fa176d32640 1 -- 172.21.15.5:0/1433097185 shutdown_connections 2024-08-31T05:39:35.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.735+0000 7fa176d32640 1 --2- 172.21.15.5:0/1433097185 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa1600b4cd0 0x7fa1600b71e0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:35.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.735+0000 7fa176d32640 1 --2- 172.21.15.5:0/1433097185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa170108ab0 0x7fa17019baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:35.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.735+0000 7fa176d32640 1 --2- 172.21.15.5:0/1433097185 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa170108160 0x7fa17019b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:35.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.735+0000 7fa176d32640 1 --2- 172.21.15.5:0/1433097185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa170102820 0x7fa17019b070 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:35.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.735+0000 7fa176d32640 1 -- 172.21.15.5:0/1433097185 >> 172.21.15.5:0/1433097185 conn(0x7fa1700794e0 msgr2=0x7fa170105020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:35.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.735+0000 7fa176d32640 1 -- 172.21.15.5:0/1433097185 shutdown_connections 2024-08-31T05:39:35.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:35.735+0000 7fa176d32640 1 -- 172.21.15.5:0/1433097185 wait complete. 2024-08-31T05:39:35.933 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1086721 11.12 MB/sec execute 383 sec latency 68.941 ms 2024-08-31T05:39:36.570 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T05:39:37.164 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1088454 11.11 MB/sec execute 384 sec latency 14.505 ms 2024-08-31T05:39:37.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:39:36 smithi005 ceph-mon[18602]: pgmap v640: 129 pgs: 129 active+clean; 578 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.6 MiB/s wr, 231 op/s 2024-08-31T05:39:37.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:39:36 smithi005 ceph-mon[18602]: scrub queued for path: / 2024-08-31T05:39:37.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:39:36 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:39:37.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:39:36 smithi005 ceph-mon[18602]: scrub summary: active paths [/] 2024-08-31T05:39:37.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:39:36 smithi005 ceph-mon[18602]: scrub summary: active paths [/] 2024-08-31T05:39:37.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:39:36 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:39:37.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:39:36 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:39:37.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:39:36 smithi070 ceph-mon[22316]: pgmap v640: 129 pgs: 129 active+clean; 578 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.6 MiB/s wr, 231 op/s 2024-08-31T05:39:37.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:39:36 smithi070 ceph-mon[22316]: scrub queued for path: / 2024-08-31T05:39:37.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:39:36 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:39:37.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:39:36 smithi070 ceph-mon[22316]: scrub summary: active paths [/] 2024-08-31T05:39:37.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:39:36 smithi070 ceph-mon[22316]: scrub summary: active paths [/] 2024-08-31T05:39:37.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:39:36 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:39:37.337 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:39:36 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:39:37.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:39:36 smithi050 ceph-mon[22146]: pgmap v640: 129 pgs: 129 active+clean; 578 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.6 MiB/s wr, 231 op/s 2024-08-31T05:39:37.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:39:36 smithi050 ceph-mon[22146]: scrub queued for path: / 2024-08-31T05:39:37.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:39:36 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:39:37.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:39:36 smithi050 ceph-mon[22146]: scrub summary: active paths [/] 2024-08-31T05:39:37.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:39:36 smithi050 ceph-mon[22146]: scrub summary: active paths [/] 2024-08-31T05:39:37.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:39:36 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:39:37.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:39:36 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:39:37.432 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:39:37.933 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1090764 11.12 MB/sec execute 385 sec latency 37.494 ms 2024-08-31T05:39:38.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.929+0000 7fa428349640 1 -- 172.21.15.5:0/638412124 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa420102880 msgr2=0x7fa420102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:38.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.929+0000 7fa428349640 1 --2- 172.21.15.5:0/638412124 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa420102880 0x7fa420102c90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa41c009900 tx=0x7fa41c02a410 comp rx=0 tx=0).stop 2024-08-31T05:39:38.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.929+0000 7fa428349640 1 -- 172.21.15.5:0/638412124 shutdown_connections 2024-08-31T05:39:38.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.929+0000 7fa428349640 1 --2- 172.21.15.5:0/638412124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa420108ac0 0x7fa42010f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:38.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.929+0000 7fa428349640 1 --2- 172.21.15.5:0/638412124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa420108170 0x7fa420108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:38.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.929+0000 7fa428349640 1 --2- 172.21.15.5:0/638412124 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa420102880 0x7fa420102c90 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:38.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.929+0000 7fa428349640 1 -- 172.21.15.5:0/638412124 >> 172.21.15.5:0/638412124 conn(0x7fa420079530 msgr2=0x7fa420079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:38.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.929+0000 7fa428349640 1 -- 172.21.15.5:0/638412124 shutdown_connections 2024-08-31T05:39:38.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.929+0000 7fa428349640 1 -- 172.21.15.5:0/638412124 wait complete. 2024-08-31T05:39:38.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.930+0000 7fa428349640 1 Processor -- start 2024-08-31T05:39:38.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.930+0000 7fa428349640 1 -- start start 2024-08-31T05:39:38.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.931+0000 7fa428349640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa420102880 0x7fa42019b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:38.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.931+0000 7fa428349640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa420108170 0x7fa42019b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:38.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.931+0000 7fa428349640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa420108ac0 0x7fa42019bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:38.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.931+0000 7fa428349640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa420112770 con 0x7fa420102880 2024-08-31T05:39:38.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.931+0000 7fa428349640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa4201125f0 con 0x7fa420108170 2024-08-31T05:39:38.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.931+0000 7fa428349640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa4201128f0 con 0x7fa420108ac0 2024-08-31T05:39:38.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.931+0000 7fa4260e5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa420102880 0x7fa42019b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:38.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.931+0000 7fa4260e5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa420102880 0x7fa42019b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35174/0 (socket says 172.21.15.5:35174) 2024-08-31T05:39:38.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.931+0000 7fa4260e5640 1 -- 172.21.15.5:0/246109306 learned_addr learned my addr 172.21.15.5:0/246109306 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:38.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.931+0000 7fa4258e4640 1 --2- 172.21.15.5:0/246109306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa420108170 0x7fa42019b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:38.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.931+0000 7fa4268e6640 1 --2- 172.21.15.5:0/246109306 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa420108ac0 0x7fa42019bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:38.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.931+0000 7fa4260e5640 1 -- 172.21.15.5:0/246109306 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa420108ac0 msgr2=0x7fa42019bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:38.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.931+0000 7fa4260e5640 1 --2- 172.21.15.5:0/246109306 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa420108ac0 0x7fa42019bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:38.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.931+0000 7fa4260e5640 1 -- 172.21.15.5:0/246109306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa420108170 msgr2=0x7fa42019b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:38.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.931+0000 7fa4260e5640 1 --2- 172.21.15.5:0/246109306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa420108170 0x7fa42019b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:38.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.931+0000 7fa4260e5640 1 -- 172.21.15.5:0/246109306 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4201a62f0 con 0x7fa420102880 2024-08-31T05:39:38.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.931+0000 7fa4260e5640 1 --2- 172.21.15.5:0/246109306 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa420102880 0x7fa42019b060 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fa41c005940 tx=0x7fa41c0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:38.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.931+0000 7fa4177fe640 1 -- 172.21.15.5:0/246109306 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa41c03f030 con 0x7fa420102880 2024-08-31T05:39:38.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.931+0000 7fa428349640 1 -- 172.21.15.5:0/246109306 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4201a6580 con 0x7fa420102880 2024-08-31T05:39:38.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.932+0000 7fa4177fe640 1 -- 172.21.15.5:0/246109306 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa41c0044c0 con 0x7fa420102880 2024-08-31T05:39:38.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.932+0000 7fa4177fe640 1 -- 172.21.15.5:0/246109306 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa41c035070 con 0x7fa420102880 2024-08-31T05:39:38.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.932+0000 7fa428349640 1 -- 172.21.15.5:0/246109306 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4201a6ab0 con 0x7fa420102880 2024-08-31T05:39:38.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.935+0000 7fa42e8be740 1 Processor -- start 2024-08-31T05:39:38.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.935+0000 7fa42e8be740 1 -- start start 2024-08-31T05:39:38.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.935+0000 7fa42e8be740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d17843070 0x563d17be82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:38.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.935+0000 7fa42e8be740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d1781a1b0 0x563d17be8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:38.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.935+0000 7fa42e8be740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d17822390 0x563d17be8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:38.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.935+0000 7fa42e8be740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x563d17b5f630 con 0x563d17843070 2024-08-31T05:39:38.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.935+0000 7fa42e8be740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x563d17b4ebc0 con 0x563d1781a1b0 2024-08-31T05:39:38.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.935+0000 7fa42e8be740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563d17b52b70 con 0x563d17822390 2024-08-31T05:39:38.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.935+0000 7fa4177fe640 1 -- 172.21.15.5:0/246109306 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fa41c042030 con 0x7fa420102880 2024-08-31T05:39:38.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.935+0000 7fa4268e6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d17843070 0x563d17be82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:38.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.935+0000 7fa4258e4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d17822390 0x563d17be8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:38.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.935+0000 7fa4268e6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d17843070 0x563d17be82c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35190/0 (socket says 172.21.15.5:35190) 2024-08-31T05:39:38.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.935+0000 7fa4268e6640 1 -- 172.21.15.5:0/2163894061 learned_addr learned my addr 172.21.15.5:0/2163894061 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:38.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.936+0000 7fa4260e5640 1 --2- 172.21.15.5:0/2163894061 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d1781a1b0 0x563d17be8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:38.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.936+0000 7fa4258e4640 1 -- 172.21.15.5:0/2163894061 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d1781a1b0 msgr2=0x563d17be8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:38.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.936+0000 7fa4258e4640 1 --2- 172.21.15.5:0/2163894061 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d1781a1b0 0x563d17be8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:38.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.936+0000 7fa4258e4640 1 -- 172.21.15.5:0/2163894061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d17843070 msgr2=0x563d17be82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:38.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.936+0000 7fa4258e4640 1 --2- 172.21.15.5:0/2163894061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d17843070 0x563d17be82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:38.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.936+0000 7fa4258e4640 1 -- 172.21.15.5:0/2163894061 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d178ae650 con 0x563d17822390 2024-08-31T05:39:38.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.936+0000 7fa4268e6640 1 --2- 172.21.15.5:0/2163894061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d17843070 0x563d17be82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:39:38.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.936+0000 7fa4258e4640 1 --2- 172.21.15.5:0/2163894061 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d17822390 0x563d17be8d40 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa42006a630 tx=0x7fa410011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a14358fe9404a7ac server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:38.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.936+0000 7fa414d9a640 1 -- 172.21.15.5:0/2163894061 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa410009d70 con 0x563d17822390 2024-08-31T05:39:38.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.936+0000 7fa414d9a640 1 -- 172.21.15.5:0/2163894061 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4100198c0 con 0x563d17822390 2024-08-31T05:39:38.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.936+0000 7fa4177fe640 1 --2- 172.21.15.5:0/246109306 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa40c0b4cd0 0x7fa40c0b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:38.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.936+0000 7fa414d9a640 1 -- 172.21.15.5:0/2163894061 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa410018910 con 0x563d17822390 2024-08-31T05:39:38.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.936+0000 7fa4268e6640 1 --2- 172.21.15.5:0/246109306 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa40c0b4cd0 0x7fa40c0b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:38.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.936+0000 7fa4177fe640 1 -- 172.21.15.5:0/246109306 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7fa41c105c90 con 0x7fa420102880 2024-08-31T05:39:38.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.937+0000 7fa42e8be740 1 -- 172.21.15.5:0/2163894061 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d17822390 msgr2=0x563d17be8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:38.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.937+0000 7fa4268e6640 1 --2- 172.21.15.5:0/246109306 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa40c0b4cd0 0x7fa40c0b71e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa418011890 tx=0x7fa418009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:38.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.937+0000 7fa42e8be740 1 --2- 172.21.15.5:0/2163894061 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d17822390 0x563d17be8d40 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa42006a630 tx=0x7fa410011810 comp rx=0 tx=0).stop 2024-08-31T05:39:38.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.937+0000 7fa42e8be740 1 -- 172.21.15.5:0/2163894061 shutdown_connections 2024-08-31T05:39:38.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.937+0000 7fa42e8be740 1 --2- 172.21.15.5:0/2163894061 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d17822390 0x563d17be8d40 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:38.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.937+0000 7fa42e8be740 1 --2- 172.21.15.5:0/2163894061 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d1781a1b0 0x563d17be8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:38.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.937+0000 7fa42e8be740 1 --2- 172.21.15.5:0/2163894061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d17843070 0x563d17be82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:38.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.937+0000 7fa42e8be740 1 -- 172.21.15.5:0/2163894061 >> 172.21.15.5:0/2163894061 conn(0x563d17837460 msgr2=0x563d17be61b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:38.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.937+0000 7fa42e8be740 1 -- 172.21.15.5:0/2163894061 shutdown_connections 2024-08-31T05:39:38.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.937+0000 7fa42e8be740 1 -- 172.21.15.5:0/2163894061 wait complete. 2024-08-31T05:39:38.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.938+0000 7fa42e8be740 1 -- start start 2024-08-31T05:39:38.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.938+0000 7fa42e8be740 1 Processor -- start 2024-08-31T05:39:38.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.938+0000 7fa42e8be740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d1781a1b0 0x563d17bf3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:38.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.938+0000 7fa42e8be740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d17822390 0x563d17bf3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:38.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.938+0000 7fa42e8be740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d17843070 0x563d17bffdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:38.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.938+0000 7fa42e8be740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x563d179b1700 con 0x563d17822390 2024-08-31T05:39:38.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.938+0000 7fa42e8be740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x563d17ad5700 con 0x563d1781a1b0 2024-08-31T05:39:38.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.938+0000 7fa42e8be740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563d17bf6aa0 con 0x563d17843070 2024-08-31T05:39:38.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.938+0000 7fa4258e4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d17822390 0x563d17bf3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:38.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.938+0000 7fa42e8be740 10 client.0 _ll_register_callbacks cb 0x563d17b04dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:39:38.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.938+0000 7fa4258e4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d17822390 0x563d17bf3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35202/0 (socket says 172.21.15.5:35202) 2024-08-31T05:39:38.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.938+0000 7fa4258e4640 1 -- 172.21.15.5:0/3725812330 learned_addr learned my addr 172.21.15.5:0/3725812330 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:38.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.938+0000 7fa4260e5640 1 --2- 172.21.15.5:0/3725812330 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d1781a1b0 0x563d17bf3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:38.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.938+0000 7fa4268e6640 1 --2- 172.21.15.5:0/3725812330 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d17843070 0x563d17bffdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:38.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.939+0000 7fa4258e4640 1 -- 172.21.15.5:0/3725812330 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d17843070 msgr2=0x563d17bffdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:38.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.939+0000 7fa4258e4640 1 --2- 172.21.15.5:0/3725812330 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d17843070 0x563d17bffdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:38.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.939+0000 7fa4258e4640 1 -- 172.21.15.5:0/3725812330 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d1781a1b0 msgr2=0x563d17bf3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:38.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.939+0000 7fa4258e4640 1 --2- 172.21.15.5:0/3725812330 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d1781a1b0 0x563d17bf3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:38.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.939+0000 7fa4258e4640 1 -- 172.21.15.5:0/3725812330 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d17b0e8b0 con 0x563d17822390 2024-08-31T05:39:38.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.939+0000 7fa4260e5640 1 --2- 172.21.15.5:0/3725812330 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d1781a1b0 0x563d17bf3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:39:38.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.939+0000 7fa4258e4640 1 --2- 172.21.15.5:0/3725812330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d17822390 0x563d17bf3fd0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fa41001b040 tx=0x7fa410009fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=547b103464dee9ee server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:38.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.939+0000 7fa409ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:39:38.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.939+0000 7fa409ffb640 1 -- 172.21.15.5:0/3725812330 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa410028020 con 0x563d17822390 2024-08-31T05:39:38.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.939+0000 7fa409ffb640 1 -- 172.21.15.5:0/3725812330 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7fa410016040 con 0x563d17822390 2024-08-31T05:39:38.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.939+0000 7fa42e8be740 1 -- 172.21.15.5:0/3725812330 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4100198c0 con 0x563d17822390 2024-08-31T05:39:38.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.939+0000 7fa409ffb640 1 -- 172.21.15.5:0/3725812330 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fa410033050 con 0x563d17822390 2024-08-31T05:39:38.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.939+0000 7fa42e8be740 10 client.18189 fetch_fsmap learned FSMap version 34 2024-08-31T05:39:38.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.939+0000 7fa42e8be740 1 -- 172.21.15.5:0/3725812330 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x563d17c028a0 con 0x563d17822390 2024-08-31T05:39:38.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.940+0000 7fa409ffb640 1 -- 172.21.15.5:0/3725812330 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4100198c0 con 0x563d17822390 2024-08-31T05:39:38.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.940+0000 7fa409ffb640 1 -- 172.21.15.5:0/3725812330 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fa410018960 con 0x563d17822390 2024-08-31T05:39:38.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.940+0000 7fa42e8be740 10 client.18189 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:39:38.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.940+0000 7fa42e8be740 10 client.18189 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:39:38.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.940+0000 7fa42e8be740 20 client.18189 populate_metadata read hostname 'smithi005' 2024-08-31T05:39:38.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.940+0000 7fa42e8be740 1 --2- 172.21.15.5:0/3725812330 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x563d178019f0 0x563d17c05c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:38.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.940+0000 7fa42e8be740 4 client.18189 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:39:38.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.940+0000 7fa42e8be740 1 -- 172.21.15.5:0/3725812330 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563d17b61580 con 0x563d178019f0 2024-08-31T05:39:38.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.940+0000 7fa4260e5640 1 --2- 172.21.15.5:0/3725812330 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x563d178019f0 0x563d17c05c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:38.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.940+0000 7fa409ffb640 10 client.18189 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:39:38.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.940+0000 7fa4260e5640 1 --2- 172.21.15.5:0/3725812330 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x563d178019f0 0x563d17c05c60 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46871f5408185939 server_cookie=e825d7a8f84f921d in_seq=0 out_seq=0 2024-08-31T05:39:38.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.941+0000 7fa409ffb640 1 -- 172.21.15.5:0/3725812330 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563d17b61580 con 0x563d178019f0 2024-08-31T05:39:38.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.941+0000 7fa409ffb640 10 client.18189 handle_command_reply: tid=0 2024-08-31T05:39:38.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.941+0000 7fa42e8be740 1 client.18189 shutdown 2024-08-31T05:39:38.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.941+0000 7fa42e8be740 1 -- 172.21.15.5:0/3725812330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d17822390 msgr2=0x563d17bf3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:38.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.941+0000 7fa42e8be740 1 --2- 172.21.15.5:0/3725812330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d17822390 0x563d17bf3fd0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fa41001b040 tx=0x7fa410009fa0 comp rx=0 tx=0).stop 2024-08-31T05:39:38.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.941+0000 7fa42e8be740 1 -- 172.21.15.5:0/3725812330 shutdown_connections 2024-08-31T05:39:38.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.941+0000 7fa42e8be740 1 --2- 172.21.15.5:0/3725812330 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x563d178019f0 0x563d17c05c60 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:38.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.941+0000 7fa42e8be740 1 --2- 172.21.15.5:0/3725812330 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d17843070 0x563d17bffdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:38.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.941+0000 7fa409ffb640 0 client.18189 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:39:38.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.941+0000 7fa42e8be740 1 --2- 172.21.15.5:0/3725812330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d17822390 0x563d17bf3fd0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:38.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.941+0000 7fa42e8be740 1 --2- 172.21.15.5:0/3725812330 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d1781a1b0 0x563d17bf3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:38.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.941+0000 7fa42e8be740 1 -- 172.21.15.5:0/3725812330 >> 172.21.15.5:0/3725812330 conn(0x563d17837460 msgr2=0x563d17beb4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:38.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.941+0000 7fa42e8be740 1 -- 172.21.15.5:0/3725812330 shutdown_connections 2024-08-31T05:39:38.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.941+0000 7fa42e8be740 1 -- 172.21.15.5:0/3725812330 wait complete. 2024-08-31T05:39:38.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.942+0000 7fa42e8be740 20 client.18189 trim_cache size 0 max 16384 2024-08-31T05:39:38.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.959+0000 7fa42e8be740 1 Processor -- start 2024-08-31T05:39:38.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.959+0000 7fa42e8be740 1 -- start start 2024-08-31T05:39:38.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.960+0000 7fa42e8be740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d178019f0 0x563d17bebad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:38.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.960+0000 7fa42e8be740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d1781a1b0 0x563d17bffcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:38.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.960+0000 7fa42e8be740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d17822390 0x563d17bf0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:38.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.960+0000 7fa42e8be740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa4201b0d80 con 0x563d178019f0 2024-08-31T05:39:38.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.960+0000 7fa42e8be740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa4201b28c0 con 0x563d1781a1b0 2024-08-31T05:39:38.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.960+0000 7fa42e8be740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa4201b1450 con 0x563d17822390 2024-08-31T05:39:38.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.960+0000 7fa4260e5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d178019f0 0x563d17bebad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:38.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.960+0000 7fa4260e5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d178019f0 0x563d17bebad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35218/0 (socket says 172.21.15.5:35218) 2024-08-31T05:39:38.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.960+0000 7fa4260e5640 1 -- 172.21.15.5:0/1668789206 learned_addr learned my addr 172.21.15.5:0/1668789206 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:38.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.960+0000 7fa4258e4640 1 --2- 172.21.15.5:0/1668789206 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d1781a1b0 0x563d17bffcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:38.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.960+0000 7fa4268e6640 1 --2- 172.21.15.5:0/1668789206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d17822390 0x563d17bf0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:38.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.960+0000 7fa4260e5640 1 -- 172.21.15.5:0/1668789206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d17822390 msgr2=0x563d17bf0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:38.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.960+0000 7fa4260e5640 1 --2- 172.21.15.5:0/1668789206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d17822390 0x563d17bf0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:38.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.960+0000 7fa4260e5640 1 -- 172.21.15.5:0/1668789206 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d1781a1b0 msgr2=0x563d17bffcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:38.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.960+0000 7fa4260e5640 1 --2- 172.21.15.5:0/1668789206 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d1781a1b0 0x563d17bffcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:38.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.960+0000 7fa4260e5640 1 -- 172.21.15.5:0/1668789206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d17bf61d0 con 0x563d178019f0 2024-08-31T05:39:38.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.960+0000 7fa4260e5640 1 --2- 172.21.15.5:0/1668789206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d178019f0 0x563d17bebad0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fa41c006010 tx=0x7fa41c1081a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9db50ce7bbf2e060 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:38.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.961+0000 7fa40bfff640 1 -- 172.21.15.5:0/1668789206 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa41c049040 con 0x563d178019f0 2024-08-31T05:39:38.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.961+0000 7fa40bfff640 1 -- 172.21.15.5:0/1668789206 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa41c0cc050 con 0x563d178019f0 2024-08-31T05:39:38.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.961+0000 7fa40bfff640 1 -- 172.21.15.5:0/1668789206 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa41c103410 con 0x563d178019f0 2024-08-31T05:39:38.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.961+0000 7fa42e8be740 1 -- 172.21.15.5:0/1668789206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d178019f0 msgr2=0x563d17bebad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:38.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.961+0000 7fa42e8be740 1 --2- 172.21.15.5:0/1668789206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d178019f0 0x563d17bebad0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fa41c006010 tx=0x7fa41c1081a0 comp rx=0 tx=0).stop 2024-08-31T05:39:38.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.961+0000 7fa42e8be740 1 -- 172.21.15.5:0/1668789206 shutdown_connections 2024-08-31T05:39:38.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.961+0000 7fa42e8be740 1 --2- 172.21.15.5:0/1668789206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d17822390 0x563d17bf0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:38.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.961+0000 7fa42e8be740 1 --2- 172.21.15.5:0/1668789206 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d1781a1b0 0x563d17bffcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:38.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.961+0000 7fa42e8be740 1 --2- 172.21.15.5:0/1668789206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d178019f0 0x563d17bebad0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:38.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.961+0000 7fa42e8be740 1 -- 172.21.15.5:0/1668789206 >> 172.21.15.5:0/1668789206 conn(0x563d17837460 msgr2=0x563d17beb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:38.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.962+0000 7fa42e8be740 1 -- 172.21.15.5:0/1668789206 shutdown_connections 2024-08-31T05:39:38.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.962+0000 7fa42e8be740 1 -- 172.21.15.5:0/1668789206 wait complete. 2024-08-31T05:39:38.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.962+0000 7fa42e8be740 1 -- start start 2024-08-31T05:39:38.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.962+0000 7fa42e8be740 1 Processor -- start 2024-08-31T05:39:38.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.962+0000 7fa42e8be740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d178019f0 0x563d17bf7d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:38.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.962+0000 7fa42e8be740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d1781a1b0 0x563d17bf82b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:38.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.962+0000 7fa42e8be740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d17822390 0x563d17bf87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:38.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.962+0000 7fa42e8be740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa4201b21f0 con 0x563d1781a1b0 2024-08-31T05:39:38.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.962+0000 7fa42e8be740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa4201b1b20 con 0x563d178019f0 2024-08-31T05:39:38.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.962+0000 7fa42e8be740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa4201aed80 con 0x563d17822390 2024-08-31T05:39:38.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.962+0000 7fa4258e4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d1781a1b0 0x563d17bf82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:38.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.962+0000 7fa42e8be740 10 client.0 _ll_register_callbacks cb 0x7fa418009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:39:38.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.963+0000 7fa4258e4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d1781a1b0 0x563d17bf82b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35234/0 (socket says 172.21.15.5:35234) 2024-08-31T05:39:38.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.963+0000 7fa4260e5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d178019f0 0x563d17bf7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:38.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.963+0000 7fa4258e4640 1 -- 172.21.15.5:0/780750178 learned_addr learned my addr 172.21.15.5:0/780750178 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:38.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.963+0000 7fa4268e6640 1 --2- 172.21.15.5:0/780750178 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d17822390 0x563d17bf87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:38.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.963+0000 7fa4258e4640 1 -- 172.21.15.5:0/780750178 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d17822390 msgr2=0x563d17bf87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:38.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.963+0000 7fa4258e4640 1 --2- 172.21.15.5:0/780750178 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d17822390 0x563d17bf87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:38.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.963+0000 7fa4258e4640 1 -- 172.21.15.5:0/780750178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d178019f0 msgr2=0x563d17bf7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:38.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.963+0000 7fa4258e4640 1 --2- 172.21.15.5:0/780750178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d178019f0 0x563d17bf7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:38.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.963+0000 7fa4258e4640 1 -- 172.21.15.5:0/780750178 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d17c6f570 con 0x563d1781a1b0 2024-08-31T05:39:38.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.963+0000 7fa4260e5640 1 --2- 172.21.15.5:0/780750178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d178019f0 0x563d17bf7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:39:38.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.963+0000 7fa4258e4640 1 --2- 172.21.15.5:0/780750178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d1781a1b0 0x563d17bf82b0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fa410018ed0 tx=0x7fa410009540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e04def73b8130a1a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:38.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.963+0000 7fa409ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:39:38.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.964+0000 7fa409ffb640 1 -- 172.21.15.5:0/780750178 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa41003c060 con 0x563d1781a1b0 2024-08-31T05:39:38.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.964+0000 7fa409ffb640 1 -- 172.21.15.5:0/780750178 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7fa410003990 con 0x563d1781a1b0 2024-08-31T05:39:38.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.964+0000 7fa42e8be740 1 -- 172.21.15.5:0/780750178 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa41c0cc050 con 0x563d1781a1b0 2024-08-31T05:39:38.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.964+0000 7fa409ffb640 1 -- 172.21.15.5:0/780750178 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fa410043050 con 0x563d1781a1b0 2024-08-31T05:39:38.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.964+0000 7fa42e8be740 10 client.18195 fetch_fsmap learned FSMap version 34 2024-08-31T05:39:38.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.964+0000 7fa42e8be740 1 -- 172.21.15.5:0/780750178 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x563d17c70800 con 0x563d1781a1b0 2024-08-31T05:39:38.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.965+0000 7fa409ffb640 1 -- 172.21.15.5:0/780750178 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa41c0cc050 con 0x563d1781a1b0 2024-08-31T05:39:38.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.965+0000 7fa409ffb640 1 -- 172.21.15.5:0/780750178 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fa410003cb0 con 0x563d1781a1b0 2024-08-31T05:39:38.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.965+0000 7fa42e8be740 10 client.18195 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:39:38.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.965+0000 7fa42e8be740 10 client.18195 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:39:38.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.965+0000 7fa42e8be740 20 client.18195 populate_metadata read hostname 'smithi005' 2024-08-31T05:39:38.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.965+0000 7fa42e8be740 1 --2- 172.21.15.5:0/780750178 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x563d17843070 0x563d17c72f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:38.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.965+0000 7fa42e8be740 4 client.18195 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T05:39:38.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.965+0000 7fa42e8be740 1 -- 172.21.15.5:0/780750178 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563d17bf4400 con 0x563d17843070 2024-08-31T05:39:38.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.965+0000 7fa4260e5640 1 --2- 172.21.15.5:0/780750178 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x563d17843070 0x563d17c72f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:38.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.965+0000 7fa4260e5640 1 --2- 172.21.15.5:0/780750178 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x563d17843070 0x563d17c72f60 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=947fafd643e5fb5f server_cookie=c224123f13c6dad7 in_seq=0 out_seq=0 2024-08-31T05:39:38.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.965+0000 7fa409ffb640 10 client.18195 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:39:38.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.966+0000 7fa409ffb640 1 -- 172.21.15.5:0/780750178 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3978 (crc 0 0 0) 0x563d17bf4400 con 0x563d17843070 2024-08-31T05:39:38.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.966+0000 7fa409ffb640 10 client.18195 handle_command_reply: tid=0 2024-08-31T05:39:38.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.966+0000 7fa42e8be740 1 client.18195 shutdown 2024-08-31T05:39:38.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.966+0000 7fa42e8be740 1 -- 172.21.15.5:0/780750178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d1781a1b0 msgr2=0x563d17bf82b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:38.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.966+0000 7fa42e8be740 1 --2- 172.21.15.5:0/780750178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d1781a1b0 0x563d17bf82b0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fa410018ed0 tx=0x7fa410009540 comp rx=0 tx=0).stop 2024-08-31T05:39:38.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.966+0000 7fa42e8be740 1 -- 172.21.15.5:0/780750178 shutdown_connections 2024-08-31T05:39:38.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.966+0000 7fa42e8be740 1 --2- 172.21.15.5:0/780750178 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x563d17843070 0x563d17c72f60 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:38.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.966+0000 7fa42e8be740 1 --2- 172.21.15.5:0/780750178 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d17822390 0x563d17bf87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:38.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.966+0000 7fa42e8be740 1 --2- 172.21.15.5:0/780750178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d1781a1b0 0x563d17bf82b0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:38.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.966+0000 7fa42e8be740 1 --2- 172.21.15.5:0/780750178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d178019f0 0x563d17bf7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:38.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.966+0000 7fa409ffb640 0 client.18195 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:39:38.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.966+0000 7fa42e8be740 1 -- 172.21.15.5:0/780750178 >> 172.21.15.5:0/780750178 conn(0x563d17837460 msgr2=0x563d17be6120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:38.216 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:39:38.216 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T05:39:38.216 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2024-08-31T05:39:38.216 INFO:teuthology.orchestra.run.smithi005.stdout: "239b7958-db06-4432-93ce-b7552effa357": { 2024-08-31T05:39:38.216 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:39:38.216 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "239b7958-db06-4432-93ce-b7552effa357", 2024-08-31T05:39:38.216 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2024-08-31T05:39:38.216 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:39:38.216 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:39:38.216 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_stats": { 2024-08-31T05:39:38.217 INFO:teuthology.orchestra.run.smithi005.stdout: "239b7958-db06-4432-93ce-b7552effa357": { 2024-08-31T05:39:38.217 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:39:35.733028+0000", 2024-08-31T05:39:38.217 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:39:38.217 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:39:38.217 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:39:38.217 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:39:38.217 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:39:38.217 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:39:38.217 INFO:teuthology.orchestra.run.smithi005.stdout: "94c23057-592d-4a8b-82d7-da2d84f8740b": { 2024-08-31T05:39:38.217 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:36:27.513638+0000", 2024-08-31T05:39:38.217 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:39:38.217 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:39:38.217 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:39:38.218 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:39:38.218 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:39:38.218 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:39:38.218 INFO:teuthology.orchestra.run.smithi005.stdout: "a4d4cf74-2477-4dd9-a3a2-3762b4dd87e4": { 2024-08-31T05:39:38.218 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:38:01.378833+0000", 2024-08-31T05:39:38.218 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:39:38.218 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:39:38.218 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:39:38.218 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:39:38.218 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:39:38.219 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:39:38.219 INFO:teuthology.orchestra.run.smithi005.stdout: "095ccc7a-f368-4bc6-9563-5930e21f9b4a": { 2024-08-31T05:39:38.219 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:35:40.190069+0000", 2024-08-31T05:39:38.219 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:39:38.219 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:39:38.219 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:39:38.219 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:39:38.219 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:39:38.219 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:39:38.219 INFO:teuthology.orchestra.run.smithi005.stdout: "f4db3406-20ff-46a3-baf9-099e16392f76": { 2024-08-31T05:39:38.219 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:38:49.034412+0000", 2024-08-31T05:39:38.219 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:39:38.219 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:39:38.220 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:39:38.220 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:39:38.220 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:39:38.220 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:39:38.220 INFO:teuthology.orchestra.run.smithi005.stdout: "297c26f3-7b4d-4245-abb0-f854248e5e1b": { 2024-08-31T05:39:38.220 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:37:14.019244+0000", 2024-08-31T05:39:38.220 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:39:38.220 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:39:38.220 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:39:38.220 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:39:38.220 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:39:38.220 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:39:38.220 INFO:teuthology.orchestra.run.smithi005.stdout: "de9731c7-ae4a-42fe-8146-e4752cdc40d4": { 2024-08-31T05:39:38.221 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:34:53.614499+0000", 2024-08-31T05:39:38.221 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:39:38.221 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:39:38.221 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:39:38.221 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:39:38.221 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:39:38.221 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:39:38.221 INFO:teuthology.orchestra.run.smithi005.stdout: "0bb67292-013a-40c7-b5fc-810bdd9715d8": { 2024-08-31T05:39:38.221 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:34:04.586008+0000", 2024-08-31T05:39:38.221 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:39:38.221 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:39:38.222 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:39:38.222 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:39:38.222 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:39:38.222 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:39:38.222 INFO:teuthology.orchestra.run.smithi005.stdout: "728a42ca-bbef-4151-830f-5fdd411d8fa0": { 2024-08-31T05:39:38.222 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:32:30.554906+0000", 2024-08-31T05:39:38.222 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:39:38.222 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:39:38.222 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:39:38.222 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:39:38.222 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:39:38.222 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:39:38.222 INFO:teuthology.orchestra.run.smithi005.stdout: "2445fc42-b797-434f-b380-e2da985b4d98": { 2024-08-31T05:39:38.223 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:33:17.681453+0000", 2024-08-31T05:39:38.223 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:39:38.223 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:39:38.223 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:39:38.223 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:39:38.223 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:39:38.223 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:39:38.223 INFO:teuthology.orchestra.run.smithi005.stdout: "cda92ac0-b35f-47a5-a3a5-471c888462a5": { 2024-08-31T05:39:38.223 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:53.103905+0000", 2024-08-31T05:39:38.223 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:39:38.223 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:39:38.224 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:39:38.224 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:39:38.224 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:39:38.224 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:39:38.224 INFO:teuthology.orchestra.run.smithi005.stdout: "ece37b07-9ab2-45f8-bc33-2755a07aac0b": { 2024-08-31T05:39:38.224 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:31:41.782407+0000", 2024-08-31T05:39:38.224 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:39:38.224 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:39:38.224 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:39:38.224 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:39:38.224 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:39:38.225 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:39:38.225 INFO:teuthology.orchestra.run.smithi005.stdout: "75d84398-5d9c-4872-b879-2fbce045fa71": { 2024-08-31T05:39:38.225 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:06.642335+0000", 2024-08-31T05:39:38.225 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:39:38.225 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:39:38.225 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:39:38.225 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:39:38.225 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:39:38.225 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:39:38.225 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:39:38.225 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:39:38.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.966+0000 7fa42e8be740 1 -- 172.21.15.5:0/780750178 shutdown_connections 2024-08-31T05:39:38.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.966+0000 7fa42e8be740 1 -- 172.21.15.5:0/780750178 wait complete. 2024-08-31T05:39:38.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.966+0000 7fa42e8be740 20 client.18195 trim_cache size 0 max 16384 2024-08-31T05:39:38.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.967+0000 7fa428349640 1 -- 172.21.15.5:0/246109306 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa40c0b4cd0 msgr2=0x7fa40c0b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:38.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.967+0000 7fa428349640 1 --2- 172.21.15.5:0/246109306 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa40c0b4cd0 0x7fa40c0b71e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa418011890 tx=0x7fa418009500 comp rx=0 tx=0).stop 2024-08-31T05:39:38.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.967+0000 7fa428349640 1 -- 172.21.15.5:0/246109306 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa420102880 msgr2=0x7fa42019b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:38.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.967+0000 7fa428349640 1 --2- 172.21.15.5:0/246109306 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa420102880 0x7fa42019b060 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fa41c005940 tx=0x7fa41c0040c0 comp rx=0 tx=0).stop 2024-08-31T05:39:38.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.967+0000 7fa428349640 1 -- 172.21.15.5:0/246109306 shutdown_connections 2024-08-31T05:39:38.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.967+0000 7fa428349640 1 --2- 172.21.15.5:0/246109306 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa40c0b4cd0 0x7fa40c0b71e0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:38.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.967+0000 7fa428349640 1 --2- 172.21.15.5:0/246109306 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa420108ac0 0x7fa42019bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:38.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.967+0000 7fa428349640 1 --2- 172.21.15.5:0/246109306 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa420108170 0x7fa42019b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:38.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.967+0000 7fa428349640 1 --2- 172.21.15.5:0/246109306 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa420102880 0x7fa42019b060 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:38.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.967+0000 7fa428349640 1 -- 172.21.15.5:0/246109306 >> 172.21.15.5:0/246109306 conn(0x7fa420079530 msgr2=0x7fa4201062b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:38.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.967+0000 7fa428349640 1 -- 172.21.15.5:0/246109306 shutdown_connections 2024-08-31T05:39:38.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:39:37.967+0000 7fa428349640 1 -- 172.21.15.5:0/246109306 wait complete. 2024-08-31T05:39:38.933 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1092178 11.11 MB/sec execute 386 sec latency 28.158 ms 2024-08-31T05:39:39.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:39:38 smithi005 ceph-mon[18602]: pgmap v641: 129 pgs: 129 active+clean; 582 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.7 MiB/s wr, 203 op/s 2024-08-31T05:39:39.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:39:38 smithi070 ceph-mon[22316]: pgmap v641: 129 pgs: 129 active+clean; 582 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.7 MiB/s wr, 203 op/s 2024-08-31T05:39:39.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:39:38 smithi050 ceph-mon[22146]: pgmap v641: 129 pgs: 129 active+clean; 582 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.7 MiB/s wr, 203 op/s 2024-08-31T05:39:39.463 INFO:tasks.cephfs.filesystem:scrub status for tag:239b7958-db06-4432-93ce-b7552effa357 - {'path': '/', 'tag': '239b7958-db06-4432-93ce-b7552effa357', 'options': 'recursive,force'} 2024-08-31T05:39:39.933 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1094447 11.11 MB/sec execute 387 sec latency 15.096 ms 2024-08-31T05:39:40.933 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1095897 11.10 MB/sec execute 388 sec latency 124.267 ms 2024-08-31T05:39:41.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:39:40 smithi005 ceph-mon[18602]: pgmap v642: 129 pgs: 129 active+clean; 587 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.6 MiB/s wr, 255 op/s 2024-08-31T05:39:41.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:39:40 smithi070 ceph-mon[22316]: pgmap v642: 129 pgs: 129 active+clean; 587 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.6 MiB/s wr, 255 op/s 2024-08-31T05:39:41.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:39:40 smithi050 ceph-mon[22146]: pgmap v642: 129 pgs: 129 active+clean; 587 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.6 MiB/s wr, 255 op/s 2024-08-31T05:39:41.933 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1098083 11.11 MB/sec execute 389 sec latency 16.806 ms 2024-08-31T05:39:42.281 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:39:41 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:39:42.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:39:41 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:39:42.390 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:39:41 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:39:42.933 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1100030 11.10 MB/sec execute 390 sec latency 19.080 ms 2024-08-31T05:39:43.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:39:42 smithi005 ceph-mon[18602]: pgmap v643: 129 pgs: 129 active+clean; 587 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 180 op/s 2024-08-31T05:39:43.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:39:42 smithi005 ceph-mon[18602]: scrub summary: idle 2024-08-31T05:39:43.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:39:42 smithi070 ceph-mon[22316]: pgmap v643: 129 pgs: 129 active+clean; 587 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 180 op/s 2024-08-31T05:39:43.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:39:42 smithi070 ceph-mon[22316]: scrub summary: idle 2024-08-31T05:39:43.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:39:42 smithi050 ceph-mon[22146]: pgmap v643: 129 pgs: 129 active+clean; 587 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 180 op/s 2024-08-31T05:39:43.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:39:42 smithi050 ceph-mon[22146]: scrub summary: idle 2024-08-31T05:39:43.933 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1101810 11.10 MB/sec execute 391 sec latency 19.744 ms 2024-08-31T05:39:44.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:39:43 smithi070 ceph-mon[22316]: scrub summary: idle 2024-08-31T05:39:44.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:39:43 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:39:44.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:39:43 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:39:44.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:39:43 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:39:44.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:39:43 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:39:44.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:39:43 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:39:44.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:39:43 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:39:44.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:39:43 smithi050 ceph-mon[22146]: scrub summary: idle 2024-08-31T05:39:44.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:39:43 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:39:44.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:39:43 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:39:44.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:39:43 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:39:44.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:39:43 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:39:44.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:39:43 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:39:44.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:39:43 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:39:44.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:39:43 smithi005 ceph-mon[18602]: scrub summary: idle 2024-08-31T05:39:44.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:39:43 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:39:44.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:39:43 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:39:44.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:39:43 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:39:44.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:39:43 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:39:44.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:39:43 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:39:44.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:39:43 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:39:44.933 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1103739 11.09 MB/sec execute 392 sec latency 28.747 ms 2024-08-31T05:39:45.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:39:44 smithi070 ceph-mon[22316]: pgmap v644: 129 pgs: 129 active+clean; 586 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.6 MiB/s wr, 212 op/s 2024-08-31T05:39:45.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:39:44 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:39:45.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:39:44 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:39:45.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:39:44 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:39:45.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:39:44 smithi050 ceph-mon[22146]: pgmap v644: 129 pgs: 129 active+clean; 586 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.6 MiB/s wr, 212 op/s 2024-08-31T05:39:45.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:39:44 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:39:45.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:39:44 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:39:45.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:39:44 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:39:45.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:39:44 smithi005 ceph-mon[18602]: pgmap v644: 129 pgs: 129 active+clean; 586 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.6 MiB/s wr, 212 op/s 2024-08-31T05:39:45.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:39:44 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:39:45.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:39:44 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:39:45.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:39:44 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:39:45.934 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1105435 11.09 MB/sec execute 393 sec latency 53.720 ms 2024-08-31T05:39:46.934 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1107471 11.09 MB/sec execute 394 sec latency 31.956 ms 2024-08-31T05:39:47.088 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.086+0000 7f8b6c3c3640 1 -- 172.21.15.5:0/1687406611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b64101e00 msgr2=0x7f8b64102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:47.089 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.086+0000 7f8b6c3c3640 1 --2- 172.21.15.5:0/1687406611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b64101e00 0x7f8b64102210 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8b60009900 tx=0x7f8b6002a410 comp rx=0 tx=0).stop 2024-08-31T05:39:47.089 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.086+0000 7f8b6c3c3640 1 -- 172.21.15.5:0/1687406611 shutdown_connections 2024-08-31T05:39:47.089 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.086+0000 7f8b6c3c3640 1 --2- 172.21.15.5:0/1687406611 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b64109b20 0x7f8b64110350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:47.089 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.086+0000 7f8b6c3c3640 1 --2- 172.21.15.5:0/1687406611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b641091d0 0x7f8b641095e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:47.089 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.086+0000 7f8b6c3c3640 1 --2- 172.21.15.5:0/1687406611 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b64101e00 0x7f8b64102210 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:47.089 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.086+0000 7f8b6c3c3640 1 -- 172.21.15.5:0/1687406611 >> 172.21.15.5:0/1687406611 conn(0x7f8b64079c30 msgr2=0x7f8b6407a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:47.089 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.086+0000 7f8b6c3c3640 1 -- 172.21.15.5:0/1687406611 shutdown_connections 2024-08-31T05:39:47.089 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.086+0000 7f8b6c3c3640 1 -- 172.21.15.5:0/1687406611 wait complete. 2024-08-31T05:39:47.090 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.087+0000 7f8b6c3c3640 1 Processor -- start 2024-08-31T05:39:47.091 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.087+0000 7f8b6c3c3640 1 -- start start 2024-08-31T05:39:47.091 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.087+0000 7f8b6c3c3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b64101e00 0x7f8b64102d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:47.091 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.087+0000 7f8b6c3c3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b641091d0 0x7f8b641032d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:47.091 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.087+0000 7f8b6c3c3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b64109b20 0x7f8b64103810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:47.091 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.087+0000 7f8b6c3c3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8b64113830 con 0x7f8b641091d0 2024-08-31T05:39:47.091 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.087+0000 7f8b6c3c3640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8b641136b0 con 0x7f8b64101e00 2024-08-31T05:39:47.091 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.087+0000 7f8b6c3c3640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8b641139b0 con 0x7f8b64109b20 2024-08-31T05:39:47.091 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.087+0000 7f8b6995e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b641091d0 0x7f8b641032d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:47.091 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.087+0000 7f8b6995e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b641091d0 0x7f8b641032d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49318/0 (socket says 172.21.15.5:49318) 2024-08-31T05:39:47.091 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.087+0000 7f8b6a15f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b64101e00 0x7f8b64102d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:47.091 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.087+0000 7f8b6995e640 1 -- 172.21.15.5:0/2308028562 learned_addr learned my addr 172.21.15.5:0/2308028562 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:47.092 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.088+0000 7f8b6a960640 1 --2- 172.21.15.5:0/2308028562 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b64109b20 0x7f8b64103810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:47.092 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.088+0000 7f8b6995e640 1 -- 172.21.15.5:0/2308028562 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b64109b20 msgr2=0x7f8b64103810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:47.092 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.088+0000 7f8b6995e640 1 --2- 172.21.15.5:0/2308028562 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b64109b20 0x7f8b64103810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:47.092 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.088+0000 7f8b6995e640 1 -- 172.21.15.5:0/2308028562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b64101e00 msgr2=0x7f8b64102d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:47.092 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.088+0000 7f8b6995e640 1 --2- 172.21.15.5:0/2308028562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b64101e00 0x7f8b64102d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:47.092 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.088+0000 7f8b6995e640 1 -- 172.21.15.5:0/2308028562 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b641a84e0 con 0x7f8b641091d0 2024-08-31T05:39:47.092 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.088+0000 7f8b6995e640 1 --2- 172.21.15.5:0/2308028562 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b641091d0 0x7f8b641032d0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f8b5400e9c0 tx=0x7f8b5400edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:47.092 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.088+0000 7f8b5b7fe640 1 -- 172.21.15.5:0/2308028562 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b5400ccc0 con 0x7f8b641091d0 2024-08-31T05:39:47.093 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.089+0000 7f8b5b7fe640 1 -- 172.21.15.5:0/2308028562 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b540054d0 con 0x7f8b641091d0 2024-08-31T05:39:47.093 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.089+0000 7f8b5b7fe640 1 -- 172.21.15.5:0/2308028562 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b54010430 con 0x7f8b641091d0 2024-08-31T05:39:47.093 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.089+0000 7f8b6c3c3640 1 -- 172.21.15.5:0/2308028562 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b641a87d0 con 0x7f8b641091d0 2024-08-31T05:39:47.093 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.089+0000 7f8b6c3c3640 1 -- 172.21.15.5:0/2308028562 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b641a8c40 con 0x7f8b641091d0 2024-08-31T05:39:47.094 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.092+0000 7f8b7340a740 1 Processor -- start 2024-08-31T05:39:47.094 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.092+0000 7f8b7340a740 1 -- start start 2024-08-31T05:39:47.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.092+0000 7f8b5b7fe640 1 -- 172.21.15.5:0/2308028562 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f8b54004f20 con 0x7f8b641091d0 2024-08-31T05:39:47.095 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.093+0000 7f8b7340a740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cec47fb1b0 0x55cec4b9ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:47.096 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.093+0000 7f8b7340a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cec47d22f0 0x55cec4b9f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:47.096 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.093+0000 7f8b7340a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cec47da4d0 0x55cec4b9f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:47.097 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.093+0000 7f8b7340a740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55cec4b14000 con 0x55cec47fb1b0 2024-08-31T05:39:47.097 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.093+0000 7f8b7340a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55cec4b03590 con 0x55cec47da4d0 2024-08-31T05:39:47.097 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.093+0000 7f8b7340a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55cec4b07540 con 0x55cec47d22f0 2024-08-31T05:39:47.097 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.093+0000 7f8b6a960640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cec47fb1b0 0x55cec4b9ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:47.097 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.093+0000 7f8b6a15f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cec47d22f0 0x55cec4b9f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:47.097 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.093+0000 7f8b6a960640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cec47fb1b0 0x55cec4b9ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49332/0 (socket says 172.21.15.5:49332) 2024-08-31T05:39:47.097 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.093+0000 7f8b6a960640 1 -- 172.21.15.5:0/1184924239 learned_addr learned my addr 172.21.15.5:0/1184924239 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:47.097 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.093+0000 7f8b6a15f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cec47d22f0 0x55cec4b9f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:42600/0 (socket says 172.21.15.5:42600) 2024-08-31T05:39:47.097 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.093+0000 7f8b6995e640 1 --2- 172.21.15.5:0/1184924239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cec47da4d0 0x55cec4b9f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:47.097 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.093+0000 7f8b6a960640 1 -- 172.21.15.5:0/1184924239 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cec47d22f0 msgr2=0x55cec4b9f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:47.097 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.093+0000 7f8b6a960640 1 --2- 172.21.15.5:0/1184924239 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cec47d22f0 0x55cec4b9f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:47.097 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.093+0000 7f8b6a960640 1 -- 172.21.15.5:0/1184924239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cec47da4d0 msgr2=0x55cec4b9f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:47.098 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.093+0000 7f8b6a960640 1 --2- 172.21.15.5:0/1184924239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cec47da4d0 0x55cec4b9f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:47.098 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.093+0000 7f8b6a960640 1 -- 172.21.15.5:0/1184924239 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cec4866790 con 0x55cec47fb1b0 2024-08-31T05:39:47.098 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.093+0000 7f8b6a15f640 1 --2- 172.21.15.5:0/1184924239 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cec47d22f0 0x55cec4b9f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:39:47.098 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.094+0000 7f8b6a960640 1 --2- 172.21.15.5:0/1184924239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cec47fb1b0 0x55cec4b9ece0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c011440 tx=0x7f8b5c011900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1bcc2fcf85b9e3b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:47.098 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.094+0000 7f8b5b7fe640 1 --2- 172.21.15.5:0/2308028562 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f8b500b4e20 0x7f8b500b7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:47.098 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.094+0000 7f8b58bfe640 1 -- 172.21.15.5:0/1184924239 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c003c30 con 0x55cec47fb1b0 2024-08-31T05:39:47.098 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.094+0000 7f8b6a15f640 1 --2- 172.21.15.5:0/2308028562 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f8b500b4e20 0x7f8b500b7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:47.098 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.094+0000 7f8b58bfe640 1 -- 172.21.15.5:0/1184924239 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b5c003dd0 con 0x55cec47fb1b0 2024-08-31T05:39:47.098 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.094+0000 7f8b5b7fe640 1 -- 172.21.15.5:0/2308028562 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7f8b540e5c50 con 0x7f8b641091d0 2024-08-31T05:39:47.098 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.094+0000 7f8b58bfe640 1 -- 172.21.15.5:0/1184924239 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c00fa10 con 0x55cec47fb1b0 2024-08-31T05:39:47.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.095+0000 7f8b7340a740 1 -- 172.21.15.5:0/1184924239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cec47fb1b0 msgr2=0x55cec4b9ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:47.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.095+0000 7f8b6a15f640 1 --2- 172.21.15.5:0/2308028562 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f8b500b4e20 0x7f8b500b7330 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f8b60005ab0 tx=0x7f8b60005a20 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:47.102 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.095+0000 7f8b7340a740 1 --2- 172.21.15.5:0/1184924239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cec47fb1b0 0x55cec4b9ece0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c011440 tx=0x7f8b5c011900 comp rx=0 tx=0).stop 2024-08-31T05:39:47.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.095+0000 7f8b7340a740 1 -- 172.21.15.5:0/1184924239 shutdown_connections 2024-08-31T05:39:47.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.095+0000 7f8b7340a740 1 --2- 172.21.15.5:0/1184924239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cec47da4d0 0x55cec4b9f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:47.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.095+0000 7f8b7340a740 1 --2- 172.21.15.5:0/1184924239 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cec47d22f0 0x55cec4b9f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:47.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.095+0000 7f8b7340a740 1 --2- 172.21.15.5:0/1184924239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cec47fb1b0 0x55cec4b9ece0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:47.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.095+0000 7f8b7340a740 1 -- 172.21.15.5:0/1184924239 >> 172.21.15.5:0/1184924239 conn(0x55cec47ef300 msgr2=0x55cec4b9cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:47.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.095+0000 7f8b7340a740 1 -- 172.21.15.5:0/1184924239 shutdown_connections 2024-08-31T05:39:47.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.095+0000 7f8b7340a740 1 -- 172.21.15.5:0/1184924239 wait complete. 2024-08-31T05:39:47.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.096+0000 7f8b7340a740 1 -- start start 2024-08-31T05:39:47.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.096+0000 7f8b7340a740 1 Processor -- start 2024-08-31T05:39:47.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.096+0000 7f8b7340a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cec47d22f0 0x55cec4baa910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:47.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.096+0000 7f8b7340a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cec47da4d0 0x55cec4baaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:47.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.096+0000 7f8b7340a740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cec47fb1b0 0x55cec4bb6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:47.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.096+0000 7f8b7340a740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55cec4a3cab0 con 0x55cec47fb1b0 2024-08-31T05:39:47.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.097+0000 7f8b6995e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cec47da4d0 0x55cec4baaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:47.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.097+0000 7f8b6a15f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cec47d22f0 0x55cec4baa910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:47.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.097+0000 7f8b6a960640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cec47fb1b0 0x55cec4bb6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:47.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.097+0000 7f8b6995e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cec47da4d0 0x55cec4baaeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:48178/0 (socket says 172.21.15.5:48178) 2024-08-31T05:39:47.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.097+0000 7f8b6a15f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cec47d22f0 0x55cec4baa910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:42616/0 (socket says 172.21.15.5:42616) 2024-08-31T05:39:47.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.097+0000 7f8b6995e640 1 -- 172.21.15.5:0/2089303607 learned_addr learned my addr 172.21.15.5:0/2089303607 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:47.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.096+0000 7f8b7340a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55cec4a8a680 con 0x55cec47da4d0 2024-08-31T05:39:47.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.097+0000 7f8b7340a740 1 -- 172.21.15.5:0/2089303607 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55cec4bad460 con 0x55cec47d22f0 2024-08-31T05:39:47.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.097+0000 7f8b7340a740 10 client.0 _ll_register_callbacks cb 0x55cec4812a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:39:47.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.097+0000 7f8b6995e640 1 -- 172.21.15.5:0/2089303607 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cec47d22f0 msgr2=0x55cec4baa910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:47.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.097+0000 7f8b6995e640 1 --2- 172.21.15.5:0/2089303607 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cec47d22f0 0x55cec4baa910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:47.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.097+0000 7f8b6995e640 1 -- 172.21.15.5:0/2089303607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cec47fb1b0 msgr2=0x55cec4bb6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:47.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.097+0000 7f8b6995e640 1 --2- 172.21.15.5:0/2089303607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cec47fb1b0 0x55cec4bb6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:47.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.097+0000 7f8b6995e640 1 -- 172.21.15.5:0/2089303607 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cec48df620 con 0x55cec47da4d0 2024-08-31T05:39:47.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.097+0000 7f8b6995e640 1 --2- 172.21.15.5:0/2089303607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cec47da4d0 0x55cec4baaeb0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8b540e3020 tx=0x7f8b540a7ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c7c8567f44326ef server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:47.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.097+0000 7f8b4dffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:39:47.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.097+0000 7f8b4dffb640 1 -- 172.21.15.5:0/2089303607 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b540aba70 con 0x55cec47da4d0 2024-08-31T05:39:47.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.097+0000 7f8b4dffb640 1 -- 172.21.15.5:0/2089303607 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7f8b540b0430 con 0x55cec47da4d0 2024-08-31T05:39:47.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.097+0000 7f8b7340a740 1 -- 172.21.15.5:0/2089303607 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b5c003dd0 con 0x55cec47da4d0 2024-08-31T05:39:47.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.097+0000 7f8b4dffb640 1 -- 172.21.15.5:0/2089303607 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f8b54005680 con 0x55cec47da4d0 2024-08-31T05:39:47.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.097+0000 7f8b7340a740 10 client.27782 fetch_fsmap learned FSMap version 34 2024-08-31T05:39:47.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.097+0000 7f8b7340a740 1 -- 172.21.15.5:0/2089303607 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55cec4bb9540 con 0x55cec47da4d0 2024-08-31T05:39:47.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.098+0000 7f8b4dffb640 1 -- 172.21.15.5:0/2089303607 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b540ac660 con 0x55cec47da4d0 2024-08-31T05:39:47.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.098+0000 7f8b4dffb640 1 -- 172.21.15.5:0/2089303607 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f8b540b4df0 con 0x55cec47da4d0 2024-08-31T05:39:47.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.098+0000 7f8b7340a740 10 client.27782 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:39:47.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.098+0000 7f8b7340a740 10 client.27782 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:39:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.098+0000 7f8b7340a740 20 client.27782 populate_metadata read hostname 'smithi005' 2024-08-31T05:39:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.098+0000 7f8b7340a740 1 --2- 172.21.15.5:0/2089303607 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55cec47b9d80 0x55cec4bbca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.098+0000 7f8b7340a740 4 client.27782 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:39:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.098+0000 7f8b7340a740 1 -- 172.21.15.5:0/2089303607 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f8b5c003dd0 con 0x55cec47b9d80 2024-08-31T05:39:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.098+0000 7f8b6a15f640 1 --2- 172.21.15.5:0/2089303607 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55cec47b9d80 0x55cec4bbca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.098+0000 7f8b4dffb640 10 client.27782 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:39:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.098+0000 7f8b6a15f640 1 --2- 172.21.15.5:0/2089303607 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55cec47b9d80 0x55cec4bbca10 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a960f2a19238f1f server_cookie=6e26cf10b32f0580 in_seq=0 out_seq=0 2024-08-31T05:39:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.099+0000 7f8b4dffb640 1 -- 172.21.15.5:0/2089303607 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f8b5c003dd0 con 0x55cec47b9d80 2024-08-31T05:39:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.099+0000 7f8b4dffb640 10 client.27782 handle_command_reply: tid=0 2024-08-31T05:39:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.099+0000 7f8b7340a740 1 client.27782 shutdown 2024-08-31T05:39:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.099+0000 7f8b7340a740 1 -- 172.21.15.5:0/2089303607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cec47da4d0 msgr2=0x55cec4baaeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.099+0000 7f8b7340a740 1 --2- 172.21.15.5:0/2089303607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cec47da4d0 0x55cec4baaeb0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8b540e3020 tx=0x7f8b540a7ee0 comp rx=0 tx=0).stop 2024-08-31T05:39:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.099+0000 7f8b7340a740 1 -- 172.21.15.5:0/2089303607 shutdown_connections 2024-08-31T05:39:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.099+0000 7f8b7340a740 1 --2- 172.21.15.5:0/2089303607 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55cec47b9d80 0x55cec4bbca10 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:47.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.099+0000 7f8b7340a740 1 --2- 172.21.15.5:0/2089303607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cec47fb1b0 0x55cec4bb6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:47.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.099+0000 7f8b7340a740 1 --2- 172.21.15.5:0/2089303607 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cec47da4d0 0x55cec4baaeb0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:47.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.099+0000 7f8b7340a740 1 --2- 172.21.15.5:0/2089303607 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cec47d22f0 0x55cec4baa910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:47.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.100+0000 7f8b4dffb640 0 client.27782 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:39:47.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.100+0000 7f8b7340a740 1 -- 172.21.15.5:0/2089303607 >> 172.21.15.5:0/2089303607 conn(0x55cec47ef300 msgr2=0x55cec4b9fd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:47.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.100+0000 7f8b7340a740 1 -- 172.21.15.5:0/2089303607 shutdown_connections 2024-08-31T05:39:47.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.100+0000 7f8b7340a740 1 -- 172.21.15.5:0/2089303607 wait complete. 2024-08-31T05:39:47.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.100+0000 7f8b7340a740 20 client.27782 trim_cache size 0 max 16384 2024-08-31T05:39:47.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.116+0000 7f8b7340a740 1 Processor -- start 2024-08-31T05:39:47.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.116+0000 7f8b7340a740 1 -- start start 2024-08-31T05:39:47.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.116+0000 7f8b7340a740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cec47d22f0 0x55cec4bb6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:47.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.116+0000 7f8b7340a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cec47da4d0 0x55cec4ba3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:47.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.116+0000 7f8b7340a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cec47fb1b0 0x55cec4ba42e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:47.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.116+0000 7f8b7340a740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8b641b2e70 con 0x55cec47d22f0 2024-08-31T05:39:47.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.116+0000 7f8b7340a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8b641b49b0 con 0x55cec47fb1b0 2024-08-31T05:39:47.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.116+0000 7f8b7340a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8b641b3540 con 0x55cec47da4d0 2024-08-31T05:39:47.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.116+0000 7f8b6a15f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cec47d22f0 0x55cec4bb6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:47.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.116+0000 7f8b6a960640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cec47fb1b0 0x55cec4ba42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:47.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.116+0000 7f8b6995e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cec47da4d0 0x55cec4ba3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:47.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.116+0000 7f8b6a15f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cec47d22f0 0x55cec4bb6650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49344/0 (socket says 172.21.15.5:49344) 2024-08-31T05:39:47.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.116+0000 7f8b6a15f640 1 -- 172.21.15.5:0/3332906593 learned_addr learned my addr 172.21.15.5:0/3332906593 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:47.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.116+0000 7f8b6995e640 1 -- 172.21.15.5:0/3332906593 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cec47fb1b0 msgr2=0x55cec4ba42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:47.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.116+0000 7f8b6995e640 1 --2- 172.21.15.5:0/3332906593 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cec47fb1b0 0x55cec4ba42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:47.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.116+0000 7f8b6995e640 1 -- 172.21.15.5:0/3332906593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cec47d22f0 msgr2=0x55cec4bb6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:47.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.116+0000 7f8b6995e640 1 --2- 172.21.15.5:0/3332906593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cec47d22f0 0x55cec4bb6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:47.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.116+0000 7f8b6995e640 1 -- 172.21.15.5:0/3332906593 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cec4ba0fe0 con 0x55cec47da4d0 2024-08-31T05:39:47.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.117+0000 7f8b6995e640 1 --2- 172.21.15.5:0/3332906593 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cec47da4d0 0x55cec4ba3da0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8b540a91d0 tx=0x7f8b54004940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f92fa56d6984ac8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:47.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.117+0000 7f8b4ffff640 1 -- 172.21.15.5:0/3332906593 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b540e8070 con 0x55cec47da4d0 2024-08-31T05:39:47.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.117+0000 7f8b4ffff640 1 -- 172.21.15.5:0/3332906593 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b540aba70 con 0x55cec47da4d0 2024-08-31T05:39:47.120 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.117+0000 7f8b4ffff640 1 -- 172.21.15.5:0/3332906593 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b540ac660 con 0x55cec47da4d0 2024-08-31T05:39:47.124 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.118+0000 7f8b7340a740 1 -- 172.21.15.5:0/3332906593 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cec47da4d0 msgr2=0x55cec4ba3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:47.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.118+0000 7f8b7340a740 1 --2- 172.21.15.5:0/3332906593 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cec47da4d0 0x55cec4ba3da0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8b540a91d0 tx=0x7f8b54004940 comp rx=0 tx=0).stop 2024-08-31T05:39:47.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.118+0000 7f8b7340a740 1 -- 172.21.15.5:0/3332906593 shutdown_connections 2024-08-31T05:39:47.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.118+0000 7f8b7340a740 1 --2- 172.21.15.5:0/3332906593 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cec47fb1b0 0x55cec4ba42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:47.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.118+0000 7f8b7340a740 1 --2- 172.21.15.5:0/3332906593 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cec47da4d0 0x55cec4ba3da0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:47.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.118+0000 7f8b7340a740 1 --2- 172.21.15.5:0/3332906593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cec47d22f0 0x55cec4bb6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:47.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.118+0000 7f8b7340a740 1 -- 172.21.15.5:0/3332906593 >> 172.21.15.5:0/3332906593 conn(0x55cec47ef300 msgr2=0x55cec4ba8f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:47.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.118+0000 7f8b7340a740 1 -- 172.21.15.5:0/3332906593 shutdown_connections 2024-08-31T05:39:47.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.118+0000 7f8b7340a740 1 -- 172.21.15.5:0/3332906593 wait complete. 2024-08-31T05:39:47.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.118+0000 7f8b7340a740 1 -- start start 2024-08-31T05:39:47.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.118+0000 7f8b7340a740 1 Processor -- start 2024-08-31T05:39:47.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.119+0000 7f8b7340a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cec47d22f0 0x55cec4bae6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:47.126 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.119+0000 7f8b7340a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cec47da4d0 0x55cec4baebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:47.126 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.119+0000 7f8b7340a740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cec47fb1b0 0x55cec4baf120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:47.126 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.119+0000 7f8b7340a740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8b641b42e0 con 0x55cec47fb1b0 2024-08-31T05:39:47.126 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.119+0000 7f8b7340a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8b641b3c10 con 0x55cec47da4d0 2024-08-31T05:39:47.126 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.119+0000 7f8b6a15f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cec47d22f0 0x55cec4bae6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:47.126 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.119+0000 7f8b6a960640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cec47fb1b0 0x55cec4baf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:47.126 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.119+0000 7f8b6a15f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cec47d22f0 0x55cec4bae6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:42640/0 (socket says 172.21.15.5:42640) 2024-08-31T05:39:47.126 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.119+0000 7f8b6a15f640 1 -- 172.21.15.5:0/1536815845 learned_addr learned my addr 172.21.15.5:0/1536815845 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:39:47.127 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.119+0000 7f8b6a960640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cec47fb1b0 0x55cec4baf120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49356/0 (socket says 172.21.15.5:49356) 2024-08-31T05:39:47.127 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.119+0000 7f8b7340a740 1 -- 172.21.15.5:0/1536815845 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8b641b0e70 con 0x55cec47d22f0 2024-08-31T05:39:47.127 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.119+0000 7f8b7340a740 10 client.0 _ll_register_callbacks cb 0x7f8b5400eef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:39:47.127 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.119+0000 7f8b6995e640 1 --2- 172.21.15.5:0/1536815845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cec47da4d0 0x55cec4baebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:47.127 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.119+0000 7f8b6a15f640 1 -- 172.21.15.5:0/1536815845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cec47da4d0 msgr2=0x55cec4baebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:47.127 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.119+0000 7f8b6a15f640 1 --2- 172.21.15.5:0/1536815845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cec47da4d0 0x55cec4baebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:47.127 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.119+0000 7f8b6a15f640 1 -- 172.21.15.5:0/1536815845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cec47fb1b0 msgr2=0x55cec4baf120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:39:47.127 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.119+0000 7f8b6a15f640 1 --2- 172.21.15.5:0/1536815845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cec47fb1b0 0x55cec4baf120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:47.127 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.119+0000 7f8b6a15f640 1 -- 172.21.15.5:0/1536815845 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cec4c263b0 con 0x55cec47d22f0 2024-08-31T05:39:47.127 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.119+0000 7f8b6995e640 1 --2- 172.21.15.5:0/1536815845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cec47da4d0 0x55cec4baebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:39:47.127 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.120+0000 7f8b6a15f640 1 --2- 172.21.15.5:0/1536815845 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cec47d22f0 0x55cec4bae6a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8b60031440 tx=0x7f8b60009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b238d43e991f554 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:39:47.127 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.120+0000 7f8b4dffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:39:47.127 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.120+0000 7f8b4dffb640 1 -- 172.21.15.5:0/1536815845 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b60060060 con 0x55cec47d22f0 2024-08-31T05:39:47.128 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.120+0000 7f8b4dffb640 1 -- 172.21.15.5:0/1536815845 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7f8b60004b80 con 0x55cec47d22f0 2024-08-31T05:39:47.128 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.120+0000 7f8b7340a740 1 -- 172.21.15.5:0/1536815845 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b540aba70 con 0x55cec47d22f0 2024-08-31T05:39:47.128 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.120+0000 7f8b4dffb640 1 -- 172.21.15.5:0/1536815845 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f8b60067050 con 0x55cec47d22f0 2024-08-31T05:39:47.128 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.120+0000 7f8b7340a740 10 client.27793 fetch_fsmap learned FSMap version 34 2024-08-31T05:39:47.128 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.120+0000 7f8b7340a740 1 -- 172.21.15.5:0/1536815845 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55cec4c27630 con 0x55cec47d22f0 2024-08-31T05:39:47.128 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.120+0000 7f8b4dffb640 1 -- 172.21.15.5:0/1536815845 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b540aba70 con 0x55cec47d22f0 2024-08-31T05:39:47.128 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.121+0000 7f8b4dffb640 1 -- 172.21.15.5:0/1536815845 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f8b600324d0 con 0x55cec47d22f0 2024-08-31T05:39:47.128 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.121+0000 7f8b7340a740 10 client.27793 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:39:47.129 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.121+0000 7f8b7340a740 10 client.27793 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:39:47.129 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.121+0000 7f8b7340a740 20 client.27793 populate_metadata read hostname 'smithi005' 2024-08-31T05:39:47.129 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.121+0000 7f8b7340a740 1 --2- 172.21.15.5:0/1536815845 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55cec478f1c0 0x55cec4c29dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:39:47.129 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.121+0000 7f8b7340a740 4 client.27793 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:39:47.129 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.121+0000 7f8b7340a740 1 -- 172.21.15.5:0/1536815845 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cec4b15f50 con 0x55cec478f1c0 2024-08-31T05:39:47.129 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.121+0000 7f8b6995e640 1 --2- 172.21.15.5:0/1536815845 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55cec478f1c0 0x55cec4c29dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:39:47.129 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.121+0000 7f8b6995e640 1 --2- 172.21.15.5:0/1536815845 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55cec478f1c0 0x55cec4c29dc0 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1a0625ecab68463 server_cookie=6bd676a16ab4a60b in_seq=0 out_seq=0 2024-08-31T05:39:47.129 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.121+0000 7f8b4dffb640 10 client.27793 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:39:47.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.134+0000 7f8b4dffb640 1 -- 172.21.15.5:0/1536815845 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cec4b15f50 con 0x55cec478f1c0 2024-08-31T05:39:47.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.134+0000 7f8b4dffb640 10 client.27793 handle_command_reply: tid=0 2024-08-31T05:39:47.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.134+0000 7f8b7340a740 1 client.27793 shutdown 2024-08-31T05:39:47.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.134+0000 7f8b7340a740 1 -- 172.21.15.5:0/1536815845 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cec47d22f0 msgr2=0x55cec4bae6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:47.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.134+0000 7f8b7340a740 1 --2- 172.21.15.5:0/1536815845 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cec47d22f0 0x55cec4bae6a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8b60031440 tx=0x7f8b60009260 comp rx=0 tx=0).stop 2024-08-31T05:39:47.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.134+0000 7f8b7340a740 1 -- 172.21.15.5:0/1536815845 shutdown_connections 2024-08-31T05:39:47.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.134+0000 7f8b7340a740 1 --2- 172.21.15.5:0/1536815845 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55cec478f1c0 0x55cec4c29dc0 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:47.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.134+0000 7f8b7340a740 1 --2- 172.21.15.5:0/1536815845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55cec47fb1b0 0x55cec4baf120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:47.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.134+0000 7f8b7340a740 1 --2- 172.21.15.5:0/1536815845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55cec47da4d0 0x55cec4baebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:47.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.134+0000 7f8b4dffb640 0 client.27793 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:39:47.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.134+0000 7f8b7340a740 1 --2- 172.21.15.5:0/1536815845 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cec47d22f0 0x55cec4bae6a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:47.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.134+0000 7f8b7340a740 1 -- 172.21.15.5:0/1536815845 >> 172.21.15.5:0/1536815845 conn(0x55cec47ef300 msgr2=0x55cec4ba3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:47.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.135+0000 7f8b7340a740 1 -- 172.21.15.5:0/1536815845 shutdown_connections 2024-08-31T05:39:47.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.135+0000 7f8b7340a740 1 -- 172.21.15.5:0/1536815845 wait complete. 2024-08-31T05:39:47.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.135+0000 7f8b7340a740 20 client.27793 trim_cache size 0 max 16384 2024-08-31T05:39:47.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:39:47.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:39:47.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:39:47.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:39:47.139 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.135+0000 7f8b6c3c3640 1 -- 172.21.15.5:0/2308028562 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f8b500b4e20 msgr2=0x7f8b500b7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:47.139 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.135+0000 7f8b6c3c3640 1 --2- 172.21.15.5:0/2308028562 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f8b500b4e20 0x7f8b500b7330 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f8b60005ab0 tx=0x7f8b60005a20 comp rx=0 tx=0).stop 2024-08-31T05:39:47.139 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.135+0000 7f8b6c3c3640 1 -- 172.21.15.5:0/2308028562 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b641091d0 msgr2=0x7f8b641032d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:39:47.139 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.135+0000 7f8b6c3c3640 1 --2- 172.21.15.5:0/2308028562 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b641091d0 0x7f8b641032d0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f8b5400e9c0 tx=0x7f8b5400edc0 comp rx=0 tx=0).stop 2024-08-31T05:39:47.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.135+0000 7f8b6c3c3640 1 -- 172.21.15.5:0/2308028562 shutdown_connections 2024-08-31T05:39:47.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.135+0000 7f8b6c3c3640 1 --2- 172.21.15.5:0/2308028562 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f8b500b4e20 0x7f8b500b7330 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:47.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.135+0000 7f8b6c3c3640 1 --2- 172.21.15.5:0/2308028562 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b64109b20 0x7f8b64103810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:47.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.135+0000 7f8b6c3c3640 1 --2- 172.21.15.5:0/2308028562 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b641091d0 0x7f8b641032d0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:47.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.135+0000 7f8b6c3c3640 1 --2- 172.21.15.5:0/2308028562 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8b64101e00 0x7f8b64102d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:39:47.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.135+0000 7f8b6c3c3640 1 -- 172.21.15.5:0/2308028562 >> 172.21.15.5:0/2308028562 conn(0x7f8b64079c30 msgr2=0x7f8b64107260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:39:47.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.135+0000 7f8b6c3c3640 1 -- 172.21.15.5:0/2308028562 shutdown_connections 2024-08-31T05:39:47.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:39:47.135+0000 7f8b6c3c3640 1 -- 172.21.15.5:0/2308028562 wait complete. 2024-08-31T05:39:47.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:39:46 smithi070 ceph-mon[22316]: pgmap v645: 129 pgs: 129 active+clean; 570 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.7 MiB/s wr, 256 op/s 2024-08-31T05:39:47.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:39:46 smithi050 ceph-mon[22146]: pgmap v645: 129 pgs: 129 active+clean; 570 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.7 MiB/s wr, 256 op/s 2024-08-31T05:39:47.466 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:39:46 smithi005 ceph-mon[18602]: pgmap v645: 129 pgs: 129 active+clean; 570 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.7 MiB/s wr, 256 op/s 2024-08-31T05:39:47.934 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1109421 11.09 MB/sec execute 395 sec latency 13.992 ms 2024-08-31T05:39:48.934 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1111870 11.10 MB/sec execute 396 sec latency 28.611 ms 2024-08-31T05:39:49.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:39:48 smithi070 ceph-mon[22316]: pgmap v646: 129 pgs: 129 active+clean; 558 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.7 MiB/s wr, 202 op/s 2024-08-31T05:39:49.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:39:48 smithi050 ceph-mon[22146]: pgmap v646: 129 pgs: 129 active+clean; 558 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.7 MiB/s wr, 202 op/s 2024-08-31T05:39:49.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:39:48 smithi005 ceph-mon[18602]: pgmap v646: 129 pgs: 129 active+clean; 558 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.7 MiB/s wr, 202 op/s 2024-08-31T05:39:49.934 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1113363 11.09 MB/sec execute 397 sec latency 24.475 ms 2024-08-31T05:39:50.934 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1115554 11.09 MB/sec execute 398 sec latency 64.579 ms 2024-08-31T05:39:51.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:39:50 smithi070 ceph-mon[22316]: pgmap v647: 129 pgs: 129 active+clean; 565 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.7 MiB/s wr, 248 op/s 2024-08-31T05:39:51.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:39:50 smithi050 ceph-mon[22146]: pgmap v647: 129 pgs: 129 active+clean; 565 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.7 MiB/s wr, 248 op/s 2024-08-31T05:39:51.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:39:50 smithi005 ceph-mon[18602]: pgmap v647: 129 pgs: 129 active+clean; 565 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.7 MiB/s wr, 248 op/s 2024-08-31T05:39:51.934 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1116783 11.08 MB/sec execute 399 sec latency 35.793 ms 2024-08-31T05:39:52.934 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1118934 11.08 MB/sec execute 400 sec latency 15.574 ms 2024-08-31T05:39:53.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:39:52 smithi070 ceph-mon[22316]: pgmap v648: 129 pgs: 129 active+clean; 565 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.8 MiB/s wr, 191 op/s 2024-08-31T05:39:53.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:39:52 smithi050 ceph-mon[22146]: pgmap v648: 129 pgs: 129 active+clean; 565 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.8 MiB/s wr, 191 op/s 2024-08-31T05:39:53.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:39:52 smithi005 ceph-mon[18602]: pgmap v648: 129 pgs: 129 active+clean; 565 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.8 MiB/s wr, 191 op/s 2024-08-31T05:39:53.934 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1120483 11.07 MB/sec execute 401 sec latency 14.687 ms 2024-08-31T05:39:54.934 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1122828 11.08 MB/sec execute 402 sec latency 63.367 ms 2024-08-31T05:39:55.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:39:54 smithi070 ceph-mon[22316]: pgmap v649: 129 pgs: 129 active+clean; 565 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.8 MiB/s wr, 194 op/s 2024-08-31T05:39:55.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:39:54 smithi050 ceph-mon[22146]: pgmap v649: 129 pgs: 129 active+clean; 565 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.8 MiB/s wr, 194 op/s 2024-08-31T05:39:55.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:39:54 smithi005 ceph-mon[18602]: pgmap v649: 129 pgs: 129 active+clean; 565 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.8 MiB/s wr, 194 op/s 2024-08-31T05:39:55.934 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1124332 11.07 MB/sec execute 403 sec latency 72.371 ms 2024-08-31T05:39:56.934 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1126401 11.07 MB/sec execute 404 sec latency 81.352 ms 2024-08-31T05:39:57.337 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:39:56 smithi070 ceph-mon[22316]: pgmap v650: 129 pgs: 129 active+clean; 576 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.7 MiB/s wr, 241 op/s 2024-08-31T05:39:57.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:39:56 smithi050 ceph-mon[22146]: pgmap v650: 129 pgs: 129 active+clean; 576 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.7 MiB/s wr, 241 op/s 2024-08-31T05:39:57.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:39:56 smithi005 ceph-mon[18602]: pgmap v650: 129 pgs: 129 active+clean; 576 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.7 MiB/s wr, 241 op/s 2024-08-31T05:39:57.934 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1127949 11.06 MB/sec execute 405 sec latency 98.784 ms 2024-08-31T05:39:58.934 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1129926 11.06 MB/sec execute 406 sec latency 191.198 ms 2024-08-31T05:39:59.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:39:58 smithi070 ceph-mon[22316]: pgmap v651: 129 pgs: 129 active+clean; 576 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.7 MiB/s wr, 198 op/s 2024-08-31T05:39:59.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:39:58 smithi050 ceph-mon[22146]: pgmap v651: 129 pgs: 129 active+clean; 576 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.7 MiB/s wr, 198 op/s 2024-08-31T05:39:59.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:39:58 smithi005 ceph-mon[18602]: pgmap v651: 129 pgs: 129 active+clean; 576 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.7 MiB/s wr, 198 op/s 2024-08-31T05:39:59.934 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1131369 11.05 MB/sec execute 407 sec latency 120.919 ms 2024-08-31T05:40:00.237 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.234+0000 7f546ce07640 1 -- 172.21.15.5:0/590466013 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5468105f80 msgr2=0x7f5468106390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:00.237 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.234+0000 7f546ce07640 1 --2- 172.21.15.5:0/590466013 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5468105f80 0x7f5468106390 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f545c009900 tx=0x7f545c02a410 comp rx=0 tx=0).stop 2024-08-31T05:40:00.237 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.234+0000 7f546ce07640 1 -- 172.21.15.5:0/590466013 shutdown_connections 2024-08-31T05:40:00.237 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.234+0000 7f546ce07640 1 --2- 172.21.15.5:0/590466013 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f54681068d0 0x7f5468110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:00.237 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.235+0000 7f546ce07640 1 --2- 172.21.15.5:0/590466013 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5468105f80 0x7f5468106390 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:00.237 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.235+0000 7f546ce07640 1 --2- 172.21.15.5:0/590466013 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5468101e10 0x7f5468102220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:00.237 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.235+0000 7f546ce07640 1 -- 172.21.15.5:0/590466013 >> 172.21.15.5:0/590466013 conn(0x7f5468079c40 msgr2=0x7f546807a050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:00.237 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.235+0000 7f546ce07640 1 -- 172.21.15.5:0/590466013 shutdown_connections 2024-08-31T05:40:00.238 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.235+0000 7f546ce07640 1 -- 172.21.15.5:0/590466013 wait complete. 2024-08-31T05:40:00.239 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.235+0000 7f546ce07640 1 Processor -- start 2024-08-31T05:40:00.239 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.235+0000 7f546ce07640 1 -- start start 2024-08-31T05:40:00.239 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.236+0000 7f546ce07640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5468101e10 0x7f5468102da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.236+0000 7f546ce07640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5468105f80 0x7f54681032e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.236+0000 7f546ce07640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54681068d0 0x7f5468103820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.236+0000 7f546ce07640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5468113780 con 0x7f54681068d0 2024-08-31T05:40:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.236+0000 7f546ce07640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5468113600 con 0x7f5468101e10 2024-08-31T05:40:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.236+0000 7f546ce07640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5468113900 con 0x7f5468105f80 2024-08-31T05:40:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.236+0000 7f5466d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54681068d0 0x7f5468103820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.236+0000 7f5465d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5468105f80 0x7f54681032e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.236+0000 7f546659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5468101e10 0x7f5468102da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.236+0000 7f5466d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54681068d0 0x7f5468103820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53092/0 (socket says 172.21.15.5:53092) 2024-08-31T05:40:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.236+0000 7f5465d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5468105f80 0x7f54681032e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:33274/0 (socket says 172.21.15.5:33274) 2024-08-31T05:40:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.236+0000 7f5466d9d640 1 -- 172.21.15.5:0/2620048319 learned_addr learned my addr 172.21.15.5:0/2620048319 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.236+0000 7f5466d9d640 1 -- 172.21.15.5:0/2620048319 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5468105f80 msgr2=0x7f54681032e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:00.241 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.236+0000 7f5466d9d640 1 --2- 172.21.15.5:0/2620048319 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5468105f80 0x7f54681032e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:00.241 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.236+0000 7f5466d9d640 1 -- 172.21.15.5:0/2620048319 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5468101e10 msgr2=0x7f5468102da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:00.241 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.236+0000 7f5466d9d640 1 --2- 172.21.15.5:0/2620048319 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5468101e10 0x7f5468102da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:00.241 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.236+0000 7f5466d9d640 1 -- 172.21.15.5:0/2620048319 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54681a8510 con 0x7f54681068d0 2024-08-31T05:40:00.241 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.236+0000 7f5466d9d640 1 --2- 172.21.15.5:0/2620048319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54681068d0 0x7f5468103820 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f546000eb10 tx=0x7f546000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:00.241 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.236+0000 7f54577fe640 1 -- 172.21.15.5:0/2620048319 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5460004b20 con 0x7f54681068d0 2024-08-31T05:40:00.241 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.237+0000 7f54577fe640 1 -- 172.21.15.5:0/2620048319 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5460004cc0 con 0x7f54681068d0 2024-08-31T05:40:00.241 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.237+0000 7f546ce07640 1 -- 172.21.15.5:0/2620048319 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54681a8800 con 0x7f54681068d0 2024-08-31T05:40:00.241 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.237+0000 7f54577fe640 1 -- 172.21.15.5:0/2620048319 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5460010670 con 0x7f54681068d0 2024-08-31T05:40:00.241 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.237+0000 7f546ce07640 1 -- 172.21.15.5:0/2620048319 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54681a8cd0 con 0x7f54681068d0 2024-08-31T05:40:00.244 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.239+0000 7f5473e48740 1 Processor -- start 2024-08-31T05:40:00.244 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.239+0000 7f54577fe640 1 -- 172.21.15.5:0/2620048319 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f5460005000 con 0x7f54681068d0 2024-08-31T05:40:00.244 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.240+0000 7f5473e48740 1 -- start start 2024-08-31T05:40:00.244 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.240+0000 7f5473e48740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9b3ca41b0 0x55f9b4047ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:00.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.240+0000 7f5473e48740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9b3c7b2f0 0x55f9b4048220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:00.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.240+0000 7f5473e48740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9b3c834d0 0x55f9b4048760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:00.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.240+0000 7f5473e48740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f9b3fbd000 con 0x55f9b3c834d0 2024-08-31T05:40:00.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.240+0000 7f5473e48740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f9b3fac590 con 0x55f9b3ca41b0 2024-08-31T05:40:00.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.240+0000 7f5473e48740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f9b3fb0540 con 0x55f9b3c7b2f0 2024-08-31T05:40:00.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.240+0000 7f5465d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9b3ca41b0 0x55f9b4047ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:00.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.240+0000 7f546659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9b3c7b2f0 0x55f9b4048220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:00.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.240+0000 7f5465d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9b3ca41b0 0x55f9b4047ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:54210/0 (socket says 172.21.15.5:54210) 2024-08-31T05:40:00.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.240+0000 7f5465d9b640 1 -- 172.21.15.5:0/449902572 learned_addr learned my addr 172.21.15.5:0/449902572 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:00.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.240+0000 7f5465d9b640 1 --2- 172.21.15.5:0/449902572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9b3c834d0 0x55f9b4048760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:00.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.240+0000 7f54577fe640 1 --2- 172.21.15.5:0/2620048319 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f54500b4cd0 0x7f54500b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:00.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.240+0000 7f546659c640 1 -- 172.21.15.5:0/449902572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9b3ca41b0 msgr2=0x55f9b4047ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:00.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.240+0000 7f546659c640 1 --2- 172.21.15.5:0/449902572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9b3ca41b0 0x55f9b4047ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:00.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.240+0000 7f546659c640 1 -- 172.21.15.5:0/449902572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9b3c834d0 msgr2=0x55f9b4048760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:00.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.240+0000 7f546659c640 1 --2- 172.21.15.5:0/449902572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9b3c834d0 0x55f9b4048760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:00.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.240+0000 7f546659c640 1 -- 172.21.15.5:0/449902572 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9b3d0f790 con 0x55f9b3c7b2f0 2024-08-31T05:40:00.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.241+0000 7f5465d9b640 1 --2- 172.21.15.5:0/449902572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9b3ca41b0 0x55f9b4047ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:40:00.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.241+0000 7f5466d9d640 1 --2- 172.21.15.5:0/2620048319 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f54500b4cd0 0x7f54500b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:00.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.241+0000 7f546659c640 1 --2- 172.21.15.5:0/449902572 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9b3c7b2f0 0x55f9b4048220 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5458009c20 tx=0x7f5458011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff6ad9a58249030 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:00.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.241+0000 7f54577fe640 1 -- 172.21.15.5:0/2620048319 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7f54600e5e60 con 0x7f54681068d0 2024-08-31T05:40:00.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.241+0000 7f5454ff9640 1 -- 172.21.15.5:0/449902572 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5458004050 con 0x55f9b3c7b2f0 2024-08-31T05:40:00.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.241+0000 7f5454ff9640 1 -- 172.21.15.5:0/449902572 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54580054d0 con 0x55f9b3c7b2f0 2024-08-31T05:40:00.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.241+0000 7f5454ff9640 1 -- 172.21.15.5:0/449902572 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5458004cd0 con 0x55f9b3c7b2f0 2024-08-31T05:40:00.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.242+0000 7f5473e48740 1 -- 172.21.15.5:0/449902572 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9b3c7b2f0 msgr2=0x55f9b4048220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:00.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.242+0000 7f5466d9d640 1 --2- 172.21.15.5:0/2620048319 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f54500b4cd0 0x7f54500b71e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f54600a9380 tx=0x7f54600795b0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:00.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.242+0000 7f5473e48740 1 --2- 172.21.15.5:0/449902572 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9b3c7b2f0 0x55f9b4048220 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5458009c20 tx=0x7f5458011810 comp rx=0 tx=0).stop 2024-08-31T05:40:00.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.242+0000 7f5473e48740 1 -- 172.21.15.5:0/449902572 shutdown_connections 2024-08-31T05:40:00.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.242+0000 7f5473e48740 1 --2- 172.21.15.5:0/449902572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9b3c834d0 0x55f9b4048760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:00.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.242+0000 7f5473e48740 1 --2- 172.21.15.5:0/449902572 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9b3c7b2f0 0x55f9b4048220 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:00.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.242+0000 7f5473e48740 1 --2- 172.21.15.5:0/449902572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9b3ca41b0 0x55f9b4047ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:00.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.242+0000 7f5473e48740 1 -- 172.21.15.5:0/449902572 >> 172.21.15.5:0/449902572 conn(0x55f9b3c98300 msgr2=0x55f9b4045bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:00.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.242+0000 7f5473e48740 1 -- 172.21.15.5:0/449902572 shutdown_connections 2024-08-31T05:40:00.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.242+0000 7f5473e48740 1 -- 172.21.15.5:0/449902572 wait complete. 2024-08-31T05:40:00.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.242+0000 7f5473e48740 1 -- start start 2024-08-31T05:40:00.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.242+0000 7f5473e48740 1 Processor -- start 2024-08-31T05:40:00.250 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.243+0000 7f5473e48740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9b3c7b2f0 0x55f9b4053880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:00.250 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.243+0000 7f5473e48740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9b3c834d0 0x55f9b4053dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:00.250 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.243+0000 7f5473e48740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9b3ca41b0 0x55f9b405f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:00.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.243+0000 7f5473e48740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f9b3ee5ab0 con 0x55f9b3c834d0 2024-08-31T05:40:00.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.243+0000 7f5473e48740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f9b3f33680 con 0x55f9b3ca41b0 2024-08-31T05:40:00.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.243+0000 7f5473e48740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f9b4056460 con 0x55f9b3c7b2f0 2024-08-31T05:40:00.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.243+0000 7f5473e48740 10 client.0 _ll_register_callbacks cb 0x55f9b3cbba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:40:00.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.243+0000 7f546659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9b3c834d0 0x55f9b4053dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:00.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.243+0000 7f5465d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9b3c7b2f0 0x55f9b4053880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:00.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.243+0000 7f546659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9b3c834d0 0x55f9b4053dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53112/0 (socket says 172.21.15.5:53112) 2024-08-31T05:40:00.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.243+0000 7f5465d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9b3c7b2f0 0x55f9b4053880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:33296/0 (socket says 172.21.15.5:33296) 2024-08-31T05:40:00.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.243+0000 7f546659c640 1 -- 172.21.15.5:0/775721549 learned_addr learned my addr 172.21.15.5:0/775721549 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:00.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.243+0000 7f5465d9b640 1 --2- 172.21.15.5:0/775721549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9b3ca41b0 0x55f9b405f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:00.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.243+0000 7f546659c640 1 -- 172.21.15.5:0/775721549 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9b3c7b2f0 msgr2=0x55f9b4053880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:00.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.243+0000 7f546659c640 1 --2- 172.21.15.5:0/775721549 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9b3c7b2f0 0x55f9b4053880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:00.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.243+0000 7f546659c640 1 -- 172.21.15.5:0/775721549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9b3ca41b0 msgr2=0x55f9b405f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:00.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.243+0000 7f546659c640 1 --2- 172.21.15.5:0/775721549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9b3ca41b0 0x55f9b405f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:00.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.243+0000 7f546659c640 1 -- 172.21.15.5:0/775721549 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9b3d88620 con 0x55f9b3c834d0 2024-08-31T05:40:00.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.243+0000 7f546659c640 1 --2- 172.21.15.5:0/775721549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9b3c834d0 0x55f9b4053dc0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f5458000c00 tx=0x7f5458003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b57fffc8f6fead7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:00.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.243+0000 7f544dffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:40:00.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.244+0000 7f544dffb640 1 -- 172.21.15.5:0/775721549 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5458027070 con 0x55f9b3c834d0 2024-08-31T05:40:00.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.244+0000 7f5473e48740 1 -- 172.21.15.5:0/775721549 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54580054d0 con 0x55f9b3c834d0 2024-08-31T05:40:00.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.244+0000 7f544dffb640 1 -- 172.21.15.5:0/775721549 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7f5458003bd0 con 0x55f9b3c834d0 2024-08-31T05:40:00.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.244+0000 7f544dffb640 1 -- 172.21.15.5:0/775721549 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f5458033050 con 0x55f9b3c834d0 2024-08-31T05:40:00.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.244+0000 7f5473e48740 10 client.18225 fetch_fsmap learned FSMap version 34 2024-08-31T05:40:00.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.244+0000 7f5473e48740 1 -- 172.21.15.5:0/775721549 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55f9b40624b0 con 0x55f9b3c834d0 2024-08-31T05:40:00.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.244+0000 7f544dffb640 1 -- 172.21.15.5:0/775721549 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54580054d0 con 0x55f9b3c834d0 2024-08-31T05:40:00.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.244+0000 7f544dffb640 1 -- 172.21.15.5:0/775721549 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f5458004f90 con 0x55f9b3c834d0 2024-08-31T05:40:00.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.244+0000 7f5473e48740 10 client.18225 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:40:00.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.244+0000 7f5473e48740 10 client.18225 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:40:00.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.244+0000 7f5473e48740 20 client.18225 populate_metadata read hostname 'smithi005' 2024-08-31T05:40:00.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.244+0000 7f5473e48740 1 --2- 172.21.15.5:0/775721549 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55f9b3c62d80 0x55f9b40658d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:00.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.244+0000 7f5473e48740 4 client.18225 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:40:00.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.244+0000 7f5473e48740 1 -- 172.21.15.5:0/775721549 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f9b3fbef50 con 0x55f9b3c62d80 2024-08-31T05:40:00.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.244+0000 7f5465d9b640 1 --2- 172.21.15.5:0/775721549 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55f9b3c62d80 0x55f9b40658d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:00.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.245+0000 7f5465d9b640 1 --2- 172.21.15.5:0/775721549 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55f9b3c62d80 0x55f9b40658d0 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da0cc0ca0e5a888b server_cookie=613858396f705771 in_seq=0 out_seq=0 2024-08-31T05:40:00.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.245+0000 7f544dffb640 10 client.18225 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:40:00.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.246+0000 7f544dffb640 1 -- 172.21.15.5:0/775721549 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f9b3fbef50 con 0x55f9b3c62d80 2024-08-31T05:40:00.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.246+0000 7f544dffb640 10 client.18225 handle_command_reply: tid=0 2024-08-31T05:40:00.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.246+0000 7f5473e48740 1 client.18225 shutdown 2024-08-31T05:40:00.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.246+0000 7f5473e48740 1 -- 172.21.15.5:0/775721549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9b3c834d0 msgr2=0x55f9b4053dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:00.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.246+0000 7f5473e48740 1 --2- 172.21.15.5:0/775721549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9b3c834d0 0x55f9b4053dc0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f5458000c00 tx=0x7f5458003820 comp rx=0 tx=0).stop 2024-08-31T05:40:00.254 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.246+0000 7f5473e48740 1 -- 172.21.15.5:0/775721549 shutdown_connections 2024-08-31T05:40:00.254 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.246+0000 7f5473e48740 1 --2- 172.21.15.5:0/775721549 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55f9b3c62d80 0x55f9b40658d0 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:00.254 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.246+0000 7f5473e48740 1 --2- 172.21.15.5:0/775721549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9b3ca41b0 0x55f9b405f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:00.254 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.246+0000 7f5473e48740 1 --2- 172.21.15.5:0/775721549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9b3c834d0 0x55f9b4053dc0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:00.254 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.246+0000 7f544dffb640 0 client.18225 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:40:00.254 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.246+0000 7f5473e48740 1 --2- 172.21.15.5:0/775721549 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9b3c7b2f0 0x55f9b4053880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:00.254 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.246+0000 7f5473e48740 1 -- 172.21.15.5:0/775721549 >> 172.21.15.5:0/775721549 conn(0x55f9b3c98300 msgr2=0x55f9b4048d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:00.254 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.246+0000 7f5473e48740 1 -- 172.21.15.5:0/775721549 shutdown_connections 2024-08-31T05:40:00.254 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.246+0000 7f5473e48740 1 -- 172.21.15.5:0/775721549 wait complete. 2024-08-31T05:40:00.254 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.246+0000 7f5473e48740 20 client.18225 trim_cache size 0 max 16384 2024-08-31T05:40:00.264 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.261+0000 7f5473e48740 1 Processor -- start 2024-08-31T05:40:00.264 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.261+0000 7f5473e48740 1 -- start start 2024-08-31T05:40:00.264 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.261+0000 7f5473e48740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9b3c7b2f0 0x55f9b40496d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:00.264 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.261+0000 7f5473e48740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9b3c834d0 0x55f9b404de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:00.264 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.261+0000 7f5473e48740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9b3ca41b0 0x55f9b40552a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:00.264 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.261+0000 7f5473e48740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f54681b3010 con 0x55f9b3c834d0 2024-08-31T05:40:00.264 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.261+0000 7f5473e48740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f54681b4b50 con 0x55f9b3ca41b0 2024-08-31T05:40:00.264 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.261+0000 7f5473e48740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f54681b36e0 con 0x55f9b3c7b2f0 2024-08-31T05:40:00.264 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.261+0000 7f546659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9b3c834d0 0x55f9b404de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:00.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.261+0000 7f546659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9b3c834d0 0x55f9b404de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53118/0 (socket says 172.21.15.5:53118) 2024-08-31T05:40:00.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.261+0000 7f546659c640 1 -- 172.21.15.5:0/1404704950 learned_addr learned my addr 172.21.15.5:0/1404704950 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:00.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.261+0000 7f5465d9b640 1 --2- 172.21.15.5:0/1404704950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9b3c7b2f0 0x55f9b40496d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:00.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.261+0000 7f5465d9b640 1 --2- 172.21.15.5:0/1404704950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9b3ca41b0 0x55f9b40552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:00.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.261+0000 7f546659c640 1 -- 172.21.15.5:0/1404704950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9b3c7b2f0 msgr2=0x55f9b40496d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:00.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.261+0000 7f546659c640 1 --2- 172.21.15.5:0/1404704950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9b3c7b2f0 0x55f9b40496d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:00.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.261+0000 7f546659c640 1 -- 172.21.15.5:0/1404704950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9b3ca41b0 msgr2=0x55f9b40552a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:00.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.261+0000 7f546659c640 1 --2- 172.21.15.5:0/1404704950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9b3ca41b0 0x55f9b40552a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:00.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.261+0000 7f546659c640 1 -- 172.21.15.5:0/1404704950 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9b4065d30 con 0x55f9b3c834d0 2024-08-31T05:40:00.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.262+0000 7f546659c640 1 --2- 172.21.15.5:0/1404704950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9b3c834d0 0x55f9b404de20 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f54580234b0 tx=0x7f5458005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b4a29ceb6d71b9c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:00.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.262+0000 7f544ffff640 1 -- 172.21.15.5:0/1404704950 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f545803c070 con 0x55f9b3c834d0 2024-08-31T05:40:00.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.262+0000 7f544ffff640 1 -- 172.21.15.5:0/1404704950 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5458030070 con 0x55f9b3c834d0 2024-08-31T05:40:00.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.262+0000 7f544ffff640 1 -- 172.21.15.5:0/1404704950 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5458027040 con 0x55f9b3c834d0 2024-08-31T05:40:00.269 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.263+0000 7f5473e48740 1 -- 172.21.15.5:0/1404704950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9b3c834d0 msgr2=0x55f9b404de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:00.269 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.263+0000 7f5473e48740 1 --2- 172.21.15.5:0/1404704950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9b3c834d0 0x55f9b404de20 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f54580234b0 tx=0x7f5458005850 comp rx=0 tx=0).stop 2024-08-31T05:40:00.269 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.263+0000 7f5473e48740 1 -- 172.21.15.5:0/1404704950 shutdown_connections 2024-08-31T05:40:00.269 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.263+0000 7f5473e48740 1 --2- 172.21.15.5:0/1404704950 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9b3ca41b0 0x55f9b40552a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:00.269 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.263+0000 7f5473e48740 1 --2- 172.21.15.5:0/1404704950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9b3c834d0 0x55f9b404de20 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:00.269 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.263+0000 7f5473e48740 1 --2- 172.21.15.5:0/1404704950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9b3c7b2f0 0x55f9b40496d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:00.269 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.263+0000 7f5473e48740 1 -- 172.21.15.5:0/1404704950 >> 172.21.15.5:0/1404704950 conn(0x55f9b3c98300 msgr2=0x55f9b4054b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:00.269 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.263+0000 7f5473e48740 1 -- 172.21.15.5:0/1404704950 shutdown_connections 2024-08-31T05:40:00.270 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.263+0000 7f5473e48740 1 -- 172.21.15.5:0/1404704950 wait complete. 2024-08-31T05:40:00.270 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.263+0000 7f5473e48740 1 -- start start 2024-08-31T05:40:00.270 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.263+0000 7f5473e48740 1 Processor -- start 2024-08-31T05:40:00.270 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.263+0000 7f5473e48740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9b3c7b2f0 0x55f9b4056b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:00.270 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.263+0000 7f5473e48740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9b3c834d0 0x55f9b4057070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:00.270 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.264+0000 7f5473e48740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9b3ca41b0 0x55f9b40ce150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:00.270 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.264+0000 7f5473e48740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f54681b4480 con 0x55f9b3c7b2f0 2024-08-31T05:40:00.270 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.264+0000 7f5473e48740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f54681b3db0 con 0x55f9b3ca41b0 2024-08-31T05:40:00.270 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.264+0000 7f5473e48740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f54681b1010 con 0x55f9b3c834d0 2024-08-31T05:40:00.270 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.264+0000 7f5473e48740 10 client.0 _ll_register_callbacks cb 0x7f545c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:40:00.270 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.264+0000 7f5465d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9b3c7b2f0 0x55f9b4056b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:00.270 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.264+0000 7f5465d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9b3c7b2f0 0x55f9b4056b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53128/0 (socket says 172.21.15.5:53128) 2024-08-31T05:40:00.270 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.264+0000 7f5465d9b640 1 -- 172.21.15.5:0/3817484658 learned_addr learned my addr 172.21.15.5:0/3817484658 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:00.270 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.264+0000 7f546659c640 1 --2- 172.21.15.5:0/3817484658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9b3c834d0 0x55f9b4057070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:00.271 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.264+0000 7f5465d9b640 1 --2- 172.21.15.5:0/3817484658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9b3ca41b0 0x55f9b40ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:00.271 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.264+0000 7f5465d9b640 1 -- 172.21.15.5:0/3817484658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9b3c834d0 msgr2=0x55f9b4057070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:00.271 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.264+0000 7f5465d9b640 1 --2- 172.21.15.5:0/3817484658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9b3c834d0 0x55f9b4057070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:00.271 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.264+0000 7f5465d9b640 1 -- 172.21.15.5:0/3817484658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9b3ca41b0 msgr2=0x55f9b40ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:00.271 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.264+0000 7f5465d9b640 1 --2- 172.21.15.5:0/3817484658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9b3ca41b0 0x55f9b40ce150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:00.271 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.264+0000 7f5465d9b640 1 -- 172.21.15.5:0/3817484658 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9b40ce690 con 0x55f9b3c7b2f0 2024-08-31T05:40:00.271 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.264+0000 7f546659c640 1 --2- 172.21.15.5:0/3817484658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9b3c834d0 0x55f9b4057070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:40:00.271 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.264+0000 7f5465d9b640 1 --2- 172.21.15.5:0/3817484658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9b3c7b2f0 0x55f9b4056b10 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f545c006010 tx=0x7f54580043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56f2bf455a0d3a60 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:00.271 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.264+0000 7f544dffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:40:00.271 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.264+0000 7f544dffb640 1 -- 172.21.15.5:0/3817484658 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f545c035040 con 0x55f9b3c7b2f0 2024-08-31T05:40:00.271 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.264+0000 7f544dffb640 1 -- 172.21.15.5:0/3817484658 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9511+0+0 (secure 0 0 0) 0x7f545c005020 con 0x55f9b3c7b2f0 2024-08-31T05:40:00.271 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.264+0000 7f5473e48740 1 -- 172.21.15.5:0/3817484658 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5458030070 con 0x55f9b3c7b2f0 2024-08-31T05:40:00.271 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.265+0000 7f544dffb640 1 -- 172.21.15.5:0/3817484658 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f545c005220 con 0x55f9b3c7b2f0 2024-08-31T05:40:00.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.265+0000 7f5473e48740 10 client.18231 fetch_fsmap learned FSMap version 34 2024-08-31T05:40:00.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.265+0000 7f5473e48740 1 -- 172.21.15.5:0/3817484658 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55f9b40cf7d0 con 0x55f9b3c7b2f0 2024-08-31T05:40:00.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.265+0000 7f544dffb640 1 -- 172.21.15.5:0/3817484658 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5458030070 con 0x55f9b3c7b2f0 2024-08-31T05:40:00.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.265+0000 7f544dffb640 1 -- 172.21.15.5:0/3817484658 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f545c0036b0 con 0x55f9b3c7b2f0 2024-08-31T05:40:00.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.265+0000 7f5473e48740 10 client.18231 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:40:00.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.265+0000 7f5473e48740 10 client.18231 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:40:00.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.265+0000 7f5473e48740 20 client.18231 populate_metadata read hostname 'smithi005' 2024-08-31T05:40:00.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.265+0000 7f5473e48740 1 --2- 172.21.15.5:0/3817484658 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55f9b3c381c0 0x55f9b40d1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:00.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.265+0000 7f5473e48740 4 client.18231 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:40:00.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.265+0000 7f5473e48740 1 -- 172.21.15.5:0/3817484658 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f9b3fba9f0 con 0x55f9b3c381c0 2024-08-31T05:40:00.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.265+0000 7f546659c640 1 --2- 172.21.15.5:0/3817484658 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55f9b3c381c0 0x55f9b40d1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:00.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.266+0000 7f544dffb640 10 client.18231 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:40:00.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.266+0000 7f546659c640 1 --2- 172.21.15.5:0/3817484658 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55f9b3c381c0 0x55f9b40d1f90 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4af92ec1aef5dbef server_cookie=7009087001ef7b8a in_seq=0 out_seq=0 2024-08-31T05:40:00.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.282+0000 7f544dffb640 1 -- 172.21.15.5:0/3817484658 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f9b3fba9f0 con 0x55f9b3c381c0 2024-08-31T05:40:00.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.282+0000 7f544dffb640 10 client.18231 handle_command_reply: tid=0 2024-08-31T05:40:00.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.282+0000 7f5473e48740 1 client.18231 shutdown 2024-08-31T05:40:00.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.282+0000 7f5473e48740 1 -- 172.21.15.5:0/3817484658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9b3c7b2f0 msgr2=0x55f9b4056b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:00.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.282+0000 7f5473e48740 1 --2- 172.21.15.5:0/3817484658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9b3c7b2f0 0x55f9b4056b10 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f545c006010 tx=0x7f54580043d0 comp rx=0 tx=0).stop 2024-08-31T05:40:00.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.282+0000 7f5473e48740 1 -- 172.21.15.5:0/3817484658 shutdown_connections 2024-08-31T05:40:00.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.282+0000 7f5473e48740 1 --2- 172.21.15.5:0/3817484658 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55f9b3c381c0 0x55f9b40d1f90 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:00.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.282+0000 7f5473e48740 1 --2- 172.21.15.5:0/3817484658 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9b3ca41b0 0x55f9b40ce150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:00.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.282+0000 7f5473e48740 1 --2- 172.21.15.5:0/3817484658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9b3c834d0 0x55f9b4057070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:00.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.282+0000 7f544dffb640 0 client.18231 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:40:00.286 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.282+0000 7f5473e48740 1 --2- 172.21.15.5:0/3817484658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9b3c7b2f0 0x55f9b4056b10 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:00.286 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.282+0000 7f5473e48740 1 -- 172.21.15.5:0/3817484658 >> 172.21.15.5:0/3817484658 conn(0x55f9b3c98300 msgr2=0x55f9b40554e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:00.286 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.283+0000 7f5473e48740 1 -- 172.21.15.5:0/3817484658 shutdown_connections 2024-08-31T05:40:00.286 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.283+0000 7f5473e48740 1 -- 172.21.15.5:0/3817484658 wait complete. 2024-08-31T05:40:00.286 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.283+0000 7f5473e48740 20 client.18231 trim_cache size 0 max 16384 2024-08-31T05:40:00.286 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:40:00.286 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:40:00.286 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:40:00.286 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:40:00.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.284+0000 7f546ce07640 1 -- 172.21.15.5:0/2620048319 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f54500b4cd0 msgr2=0x7f54500b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:00.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.284+0000 7f546ce07640 1 --2- 172.21.15.5:0/2620048319 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f54500b4cd0 0x7f54500b71e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f54600a9380 tx=0x7f54600795b0 comp rx=0 tx=0).stop 2024-08-31T05:40:00.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.284+0000 7f546ce07640 1 -- 172.21.15.5:0/2620048319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54681068d0 msgr2=0x7f5468103820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:00.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.284+0000 7f546ce07640 1 --2- 172.21.15.5:0/2620048319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54681068d0 0x7f5468103820 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f546000eb10 tx=0x7f546000c2d0 comp rx=0 tx=0).stop 2024-08-31T05:40:00.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.284+0000 7f546ce07640 1 -- 172.21.15.5:0/2620048319 shutdown_connections 2024-08-31T05:40:00.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.284+0000 7f546ce07640 1 --2- 172.21.15.5:0/2620048319 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f54500b4cd0 0x7f54500b71e0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:00.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.284+0000 7f546ce07640 1 --2- 172.21.15.5:0/2620048319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54681068d0 0x7f5468103820 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:00.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.284+0000 7f546ce07640 1 --2- 172.21.15.5:0/2620048319 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5468105f80 0x7f54681032e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:00.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.284+0000 7f546ce07640 1 --2- 172.21.15.5:0/2620048319 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5468101e10 0x7f5468102da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:00.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.284+0000 7f546ce07640 1 -- 172.21.15.5:0/2620048319 >> 172.21.15.5:0/2620048319 conn(0x7f5468079c40 msgr2=0x7f54681072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:00.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.284+0000 7f546ce07640 1 -- 172.21.15.5:0/2620048319 shutdown_connections 2024-08-31T05:40:00.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:00.284+0000 7f546ce07640 1 -- 172.21.15.5:0/2620048319 wait complete. 2024-08-31T05:40:00.934 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1133387 11.06 MB/sec execute 408 sec latency 211.721 ms 2024-08-31T05:40:01.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:40:00 smithi070 ceph-mon[22316]: pgmap v652: 129 pgs: 129 active+clean; 585 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.7 MiB/s wr, 253 op/s 2024-08-31T05:40:01.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:40:00 smithi070 ceph-mon[22316]: overall HEALTH_OK 2024-08-31T05:40:01.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:40:00 smithi050 ceph-mon[22146]: pgmap v652: 129 pgs: 129 active+clean; 585 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.7 MiB/s wr, 253 op/s 2024-08-31T05:40:01.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:40:00 smithi050 ceph-mon[22146]: overall HEALTH_OK 2024-08-31T05:40:01.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:40:00 smithi005 ceph-mon[18602]: pgmap v652: 129 pgs: 129 active+clean; 585 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.7 MiB/s wr, 253 op/s 2024-08-31T05:40:01.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:40:00 smithi005 ceph-mon[18602]: overall HEALTH_OK 2024-08-31T05:40:01.934 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1133387 11.03 MB/sec execute 409 sec latency 1211.812 ms 2024-08-31T05:40:02.934 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1134126 11.01 MB/sec execute 410 sec latency 1239.018 ms 2024-08-31T05:40:03.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:40:03 smithi070 ceph-mon[22316]: pgmap v653: 129 pgs: 129 active+clean; 589 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.7 MiB/s wr, 201 op/s 2024-08-31T05:40:03.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:40:03 smithi050 ceph-mon[22146]: pgmap v653: 129 pgs: 129 active+clean; 589 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.7 MiB/s wr, 201 op/s 2024-08-31T05:40:03.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:40:03 smithi005 ceph-mon[18602]: pgmap v653: 129 pgs: 129 active+clean; 589 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.7 MiB/s wr, 201 op/s 2024-08-31T05:40:03.934 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1134805 10.99 MB/sec execute 411 sec latency 135.850 ms 2024-08-31T05:40:04.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:40:04 smithi070 ceph-mon[22316]: osdmap e94: 12 total, 12 up, 12 in 2024-08-31T05:40:04.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:40:04 smithi050 ceph-mon[22146]: osdmap e94: 12 total, 12 up, 12 in 2024-08-31T05:40:04.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:40:04 smithi005 ceph-mon[18602]: osdmap e94: 12 total, 12 up, 12 in 2024-08-31T05:40:04.935 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1137110 11.00 MB/sec execute 412 sec latency 13.796 ms 2024-08-31T05:40:05.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:40:05 smithi070 ceph-mon[22316]: pgmap v655: 129 pgs: 129 active+clean; 589 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.4 MiB/s wr, 255 op/s 2024-08-31T05:40:05.368 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:40:05 smithi005 ceph-mon[18602]: pgmap v655: 129 pgs: 129 active+clean; 589 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.4 MiB/s wr, 255 op/s 2024-08-31T05:40:05.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:40:05 smithi050 ceph-mon[22146]: pgmap v655: 129 pgs: 129 active+clean; 589 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.4 MiB/s wr, 255 op/s 2024-08-31T05:40:05.934 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1139013 10.99 MB/sec execute 413 sec latency 26.441 ms 2024-08-31T05:40:06.935 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1140670 10.99 MB/sec execute 414 sec latency 66.542 ms 2024-08-31T05:40:07.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:40:07 smithi070 ceph-mon[22316]: pgmap v656: 129 pgs: 129 active+clean; 571 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.6 MiB/s wr, 223 op/s 2024-08-31T05:40:07.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:40:07 smithi050 ceph-mon[22146]: pgmap v656: 129 pgs: 129 active+clean; 571 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.6 MiB/s wr, 223 op/s 2024-08-31T05:40:07.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:40:07 smithi005 ceph-mon[18602]: pgmap v656: 129 pgs: 129 active+clean; 571 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.6 MiB/s wr, 223 op/s 2024-08-31T05:40:07.935 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1142656 10.98 MB/sec execute 415 sec latency 18.127 ms 2024-08-31T05:40:08.935 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1144781 10.99 MB/sec execute 416 sec latency 22.756 ms 2024-08-31T05:40:09.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:40:09 smithi070 ceph-mon[22316]: pgmap v657: 129 pgs: 129 active+clean; 569 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.7 MiB/s wr, 225 op/s 2024-08-31T05:40:09.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:40:09 smithi050 ceph-mon[22146]: pgmap v657: 129 pgs: 129 active+clean; 569 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.7 MiB/s wr, 225 op/s 2024-08-31T05:40:09.464 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T05:40:09.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:40:09 smithi005 ceph-mon[18602]: pgmap v657: 129 pgs: 129 active+clean; 569 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.7 MiB/s wr, 225 op/s 2024-08-31T05:40:09.733 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:40:09.935 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1147271 11.00 MB/sec execute 417 sec latency 26.955 ms 2024-08-31T05:40:10.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.227+0000 7f400f86d640 1 -- 172.21.15.5:0/799715067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4008105b50 msgr2=0x7f4008105f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:10.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.227+0000 7f400f86d640 1 --2- 172.21.15.5:0/799715067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4008105b50 0x7f4008105f60 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f4004009900 tx=0x7f400402a410 comp rx=0 tx=0).stop 2024-08-31T05:40:10.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.227+0000 7f400f86d640 1 -- 172.21.15.5:0/799715067 shutdown_connections 2024-08-31T05:40:10.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.227+0000 7f400f86d640 1 --2- 172.21.15.5:0/799715067 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f400810bde0 0x7f4008112610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:10.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.227+0000 7f400f86d640 1 --2- 172.21.15.5:0/799715067 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f400810b490 0x7f400810b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:10.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.227+0000 7f400f86d640 1 --2- 172.21.15.5:0/799715067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4008105b50 0x7f4008105f60 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:10.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.228+0000 7f400f86d640 1 -- 172.21.15.5:0/799715067 >> 172.21.15.5:0/799715067 conn(0x7f4008101560 msgr2=0x7f40081039b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:10.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.228+0000 7f400f86d640 1 -- 172.21.15.5:0/799715067 shutdown_connections 2024-08-31T05:40:10.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.228+0000 7f400f86d640 1 -- 172.21.15.5:0/799715067 wait complete. 2024-08-31T05:40:10.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.228+0000 7f400f86d640 1 Processor -- start 2024-08-31T05:40:10.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.228+0000 7f400f86d640 1 -- start start 2024-08-31T05:40:10.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.229+0000 7f400f86d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4008105b50 0x7f400819c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:10.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.229+0000 7f400f86d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f400810b490 0x7f400819ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:10.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.229+0000 7f400f86d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f400810bde0 0x7f40081a1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:10.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.229+0000 7f400f86d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4008115af0 con 0x7f400810bde0 2024-08-31T05:40:10.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.229+0000 7f400f86d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4008115970 con 0x7f4008105b50 2024-08-31T05:40:10.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.229+0000 7f400f86d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4008115c70 con 0x7f400810b490 2024-08-31T05:40:10.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.229+0000 7f400de0a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f400810bde0 0x7f40081a1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:10.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.229+0000 7f400ce08640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f400810b490 0x7f400819ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:10.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.229+0000 7f400de0a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f400810bde0 0x7f40081a1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48618/0 (socket says 172.21.15.5:48618) 2024-08-31T05:40:10.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.229+0000 7f400de0a640 1 -- 172.21.15.5:0/2788811673 learned_addr learned my addr 172.21.15.5:0/2788811673 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:10.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.229+0000 7f400d609640 1 --2- 172.21.15.5:0/2788811673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4008105b50 0x7f400819c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:10.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.229+0000 7f400de0a640 1 -- 172.21.15.5:0/2788811673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f400810b490 msgr2=0x7f400819ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:10.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.229+0000 7f400de0a640 1 --2- 172.21.15.5:0/2788811673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f400810b490 0x7f400819ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:10.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.230+0000 7f400de0a640 1 -- 172.21.15.5:0/2788811673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4008105b50 msgr2=0x7f400819c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:10.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.230+0000 7f400de0a640 1 --2- 172.21.15.5:0/2788811673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4008105b50 0x7f400819c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:10.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.230+0000 7f400de0a640 1 -- 172.21.15.5:0/2788811673 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40081a2450 con 0x7f400810bde0 2024-08-31T05:40:10.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.230+0000 7f400d609640 1 --2- 172.21.15.5:0/2788811673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4008105b50 0x7f400819c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:40:10.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.230+0000 7f400ce08640 1 --2- 172.21.15.5:0/2788811673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f400810b490 0x7f400819ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:40:10.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.231+0000 7f400de0a640 1 --2- 172.21.15.5:0/2788811673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f400810bde0 0x7f40081a1d20 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f400000eaa0 tx=0x7f400000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:10.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.231+0000 7f3ffe7fc640 1 -- 172.21.15.5:0/2788811673 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400000cdb0 con 0x7f400810bde0 2024-08-31T05:40:10.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.231+0000 7f3ffe7fc640 1 -- 172.21.15.5:0/2788811673 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4000005020 con 0x7f400810bde0 2024-08-31T05:40:10.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.231+0000 7f400f86d640 1 -- 172.21.15.5:0/2788811673 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40081a2740 con 0x7f400810bde0 2024-08-31T05:40:10.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.231+0000 7f3ffe7fc640 1 -- 172.21.15.5:0/2788811673 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40000116d0 con 0x7f400810bde0 2024-08-31T05:40:10.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.231+0000 7f400f86d640 1 -- 172.21.15.5:0/2788811673 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40081a8ea0 con 0x7f400810bde0 2024-08-31T05:40:10.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.234+0000 7f4015de2740 1 Processor -- start 2024-08-31T05:40:10.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.234+0000 7f3ffe7fc640 1 -- 172.21.15.5:0/2788811673 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f40000051d0 con 0x7f400810bde0 2024-08-31T05:40:10.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.234+0000 7f4015de2740 1 -- start start 2024-08-31T05:40:10.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.235+0000 7f4015de2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e62bc4070 0x556e62f692c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:10.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.235+0000 7f4015de2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556e62b9b1b0 0x556e62f69800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:10.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.235+0000 7f4015de2740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556e62ba3390 0x556e62f69d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:10.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.235+0000 7f4015de2740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x556e62ee0630 con 0x556e62ba3390 2024-08-31T05:40:10.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.235+0000 7f4015de2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x556e62ecfbc0 con 0x556e62bc4070 2024-08-31T05:40:10.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.235+0000 7f4015de2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556e62ed3b70 con 0x556e62b9b1b0 2024-08-31T05:40:10.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.235+0000 7f400ce08640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556e62ba3390 0x556e62f69d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:10.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.235+0000 7f400d609640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556e62b9b1b0 0x556e62f69800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:10.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.235+0000 7f400ce08640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556e62ba3390 0x556e62f69d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48624/0 (socket says 172.21.15.5:48624) 2024-08-31T05:40:10.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.235+0000 7f400ce08640 1 -- 172.21.15.5:0/1607387622 learned_addr learned my addr 172.21.15.5:0/1607387622 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:10.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.235+0000 7f400ce08640 1 --2- 172.21.15.5:0/1607387622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e62bc4070 0x556e62f692c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:10.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.235+0000 7f400d609640 1 -- 172.21.15.5:0/1607387622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e62bc4070 msgr2=0x556e62f692c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:10.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.235+0000 7f400d609640 1 --2- 172.21.15.5:0/1607387622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e62bc4070 0x556e62f692c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:10.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.235+0000 7f400d609640 1 -- 172.21.15.5:0/1607387622 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556e62ba3390 msgr2=0x556e62f69d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:10.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.235+0000 7f400d609640 1 --2- 172.21.15.5:0/1607387622 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556e62ba3390 0x556e62f69d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:10.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.235+0000 7f3ffe7fc640 1 --2- 172.21.15.5:0/2788811673 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f3ff40b4ca0 0x7f3ff40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:10.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.235+0000 7f400d609640 1 -- 172.21.15.5:0/1607387622 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e62c2f650 con 0x556e62b9b1b0 2024-08-31T05:40:10.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.235+0000 7f400ce08640 1 --2- 172.21.15.5:0/1607387622 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556e62ba3390 0x556e62f69d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:40:10.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.235+0000 7f400de0a640 1 --2- 172.21.15.5:0/2788811673 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f3ff40b4ca0 0x7f3ff40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:10.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.236+0000 7f400d609640 1 --2- 172.21.15.5:0/1607387622 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556e62b9b1b0 0x556e62f69800 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f400402aa00 tx=0x7f4004004520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a91c7f8c77895e2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:10.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.236+0000 7f3ffe7fc640 1 -- 172.21.15.5:0/2788811673 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7f40000e59f0 con 0x7f400810bde0 2024-08-31T05:40:10.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.236+0000 7f3ff37fe640 1 -- 172.21.15.5:0/1607387622 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4004035040 con 0x556e62b9b1b0 2024-08-31T05:40:10.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.236+0000 7f3ff37fe640 1 -- 172.21.15.5:0/1607387622 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4004004c20 con 0x556e62b9b1b0 2024-08-31T05:40:10.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.236+0000 7f3ff37fe640 1 -- 172.21.15.5:0/1607387622 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4004003920 con 0x556e62b9b1b0 2024-08-31T05:40:10.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.237+0000 7f4015de2740 1 -- 172.21.15.5:0/1607387622 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556e62b9b1b0 msgr2=0x556e62f69800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:10.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.237+0000 7f4015de2740 1 --2- 172.21.15.5:0/1607387622 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556e62b9b1b0 0x556e62f69800 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f400402aa00 tx=0x7f4004004520 comp rx=0 tx=0).stop 2024-08-31T05:40:10.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.237+0000 7f400de0a640 1 --2- 172.21.15.5:0/2788811673 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f3ff40b4ca0 0x7f3ff40b71b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f40000abd40 tx=0x7f40000dbf00 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:10.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.237+0000 7f4015de2740 1 -- 172.21.15.5:0/1607387622 shutdown_connections 2024-08-31T05:40:10.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.237+0000 7f4015de2740 1 --2- 172.21.15.5:0/1607387622 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556e62ba3390 0x556e62f69d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:10.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.237+0000 7f4015de2740 1 --2- 172.21.15.5:0/1607387622 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556e62b9b1b0 0x556e62f69800 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:10.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.237+0000 7f4015de2740 1 --2- 172.21.15.5:0/1607387622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e62bc4070 0x556e62f692c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:10.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.237+0000 7f4015de2740 1 -- 172.21.15.5:0/1607387622 >> 172.21.15.5:0/1607387622 conn(0x556e62bb8460 msgr2=0x556e62f671b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:10.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.237+0000 7f4015de2740 1 -- 172.21.15.5:0/1607387622 shutdown_connections 2024-08-31T05:40:10.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.237+0000 7f4015de2740 1 -- 172.21.15.5:0/1607387622 wait complete. 2024-08-31T05:40:10.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.237+0000 7f4015de2740 1 -- start start 2024-08-31T05:40:10.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.237+0000 7f4015de2740 1 Processor -- start 2024-08-31T05:40:10.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.238+0000 7f4015de2740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556e62b9b1b0 0x556e62f74a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:10.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.238+0000 7f4015de2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556e62ba3390 0x556e62f74fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:10.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.238+0000 7f4015de2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e62bc4070 0x556e62f80d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:10.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.238+0000 7f4015de2740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x556e62d32700 con 0x556e62b9b1b0 2024-08-31T05:40:10.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.238+0000 7f4015de2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x556e62e56700 con 0x556e62bc4070 2024-08-31T05:40:10.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.238+0000 7f4015de2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556e62f77a40 con 0x556e62ba3390 2024-08-31T05:40:10.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.238+0000 7f4015de2740 10 client.0 _ll_register_callbacks cb 0x556e62e85dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:40:10.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.238+0000 7f400ce08640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556e62b9b1b0 0x556e62f74a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:10.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.238+0000 7f400ce08640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556e62b9b1b0 0x556e62f74a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48640/0 (socket says 172.21.15.5:48640) 2024-08-31T05:40:10.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.238+0000 7f400ce08640 1 -- 172.21.15.5:0/2605263566 learned_addr learned my addr 172.21.15.5:0/2605263566 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:10.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.238+0000 7f400d609640 1 --2- 172.21.15.5:0/2605263566 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556e62ba3390 0x556e62f74fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:10.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.239+0000 7f400ce08640 1 -- 172.21.15.5:0/2605263566 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556e62ba3390 msgr2=0x556e62f74fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:10.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.239+0000 7f400ce08640 1 --2- 172.21.15.5:0/2605263566 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556e62ba3390 0x556e62f74fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:10.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.239+0000 7f400ce08640 1 -- 172.21.15.5:0/2605263566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e62bc4070 msgr2=0x556e62f80d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:10.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.239+0000 7f400ce08640 1 --2- 172.21.15.5:0/2605263566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e62bc4070 0x556e62f80d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:10.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.239+0000 7f400ce08640 1 -- 172.21.15.5:0/2605263566 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e62e8f8b0 con 0x556e62b9b1b0 2024-08-31T05:40:10.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.239+0000 7f400ce08640 1 --2- 172.21.15.5:0/2605263566 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556e62b9b1b0 0x556e62f74a60 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8012fa0 tx=0x7f3ff800e840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc9b64ec4993a4a4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:10.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.239+0000 7f3ff0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:40:10.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.239+0000 7f3ff0ff9640 1 -- 172.21.15.5:0/2605263566 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff8004030 con 0x556e62b9b1b0 2024-08-31T05:40:10.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.239+0000 7f3ff0ff9640 1 -- 172.21.15.5:0/2605263566 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7f3ff80041d0 con 0x556e62b9b1b0 2024-08-31T05:40:10.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.239+0000 7f4015de2740 1 -- 172.21.15.5:0/2605263566 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4004004c20 con 0x556e62b9b1b0 2024-08-31T05:40:10.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.239+0000 7f3ff0ff9640 1 -- 172.21.15.5:0/2605263566 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f3ff80043d0 con 0x556e62b9b1b0 2024-08-31T05:40:10.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.239+0000 7f4015de2740 10 client.18243 fetch_fsmap learned FSMap version 34 2024-08-31T05:40:10.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.239+0000 7f4015de2740 1 -- 172.21.15.5:0/2605263566 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x556e62f838d0 con 0x556e62b9b1b0 2024-08-31T05:40:10.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.240+0000 7f3ff0ff9640 1 -- 172.21.15.5:0/2605263566 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4004004c20 con 0x556e62b9b1b0 2024-08-31T05:40:10.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.240+0000 7f3ff0ff9640 1 -- 172.21.15.5:0/2605263566 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f3ff801d070 con 0x556e62b9b1b0 2024-08-31T05:40:10.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.240+0000 7f4015de2740 10 client.18243 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:40:10.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.240+0000 7f4015de2740 10 client.18243 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:40:10.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.240+0000 7f4015de2740 20 client.18243 populate_metadata read hostname 'smithi005' 2024-08-31T05:40:10.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.240+0000 7f4015de2740 1 --2- 172.21.15.5:0/2605263566 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x556e62b829f0 0x556e62f86e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:10.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.240+0000 7f4015de2740 4 client.18243 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:40:10.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.240+0000 7f4015de2740 1 -- 172.21.15.5:0/2605263566 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556e62ee2580 con 0x556e62b829f0 2024-08-31T05:40:10.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.240+0000 7f400d609640 1 --2- 172.21.15.5:0/2605263566 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x556e62b829f0 0x556e62f86e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:10.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.241+0000 7f3ff0ff9640 10 client.18243 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:40:10.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.241+0000 7f400d609640 1 --2- 172.21.15.5:0/2605263566 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x556e62b829f0 0x556e62f86e10 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f5c1ac31252dd5e server_cookie=17d62198771719af in_seq=0 out_seq=0 2024-08-31T05:40:10.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.241+0000 7f3ff0ff9640 1 -- 172.21.15.5:0/2605263566 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556e62ee2580 con 0x556e62b829f0 2024-08-31T05:40:10.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.241+0000 7f3ff0ff9640 10 client.18243 handle_command_reply: tid=0 2024-08-31T05:40:10.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.241+0000 7f4015de2740 1 client.18243 shutdown 2024-08-31T05:40:10.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.242+0000 7f4015de2740 1 -- 172.21.15.5:0/2605263566 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556e62b9b1b0 msgr2=0x556e62f74a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:10.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.242+0000 7f4015de2740 1 --2- 172.21.15.5:0/2605263566 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556e62b9b1b0 0x556e62f74a60 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8012fa0 tx=0x7f3ff800e840 comp rx=0 tx=0).stop 2024-08-31T05:40:10.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.242+0000 7f4015de2740 1 -- 172.21.15.5:0/2605263566 shutdown_connections 2024-08-31T05:40:10.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.242+0000 7f4015de2740 1 --2- 172.21.15.5:0/2605263566 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x556e62b829f0 0x556e62f86e10 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:10.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.242+0000 7f4015de2740 1 --2- 172.21.15.5:0/2605263566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e62bc4070 0x556e62f80d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:10.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.242+0000 7f4015de2740 1 --2- 172.21.15.5:0/2605263566 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556e62ba3390 0x556e62f74fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:10.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.242+0000 7f3ff0ff9640 0 client.18243 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:40:10.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.242+0000 7f4015de2740 1 --2- 172.21.15.5:0/2605263566 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556e62b9b1b0 0x556e62f74a60 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:10.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.242+0000 7f4015de2740 1 -- 172.21.15.5:0/2605263566 >> 172.21.15.5:0/2605263566 conn(0x556e62bb8460 msgr2=0x556e62f6c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:10.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.242+0000 7f4015de2740 1 -- 172.21.15.5:0/2605263566 shutdown_connections 2024-08-31T05:40:10.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.242+0000 7f4015de2740 1 -- 172.21.15.5:0/2605263566 wait complete. 2024-08-31T05:40:10.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.242+0000 7f4015de2740 20 client.18243 trim_cache size 0 max 16384 2024-08-31T05:40:10.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.266+0000 7f4015de2740 1 Processor -- start 2024-08-31T05:40:10.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.266+0000 7f4015de2740 1 -- start start 2024-08-31T05:40:10.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.266+0000 7f4015de2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e62b9b1b0 0x556e62f6cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:10.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.266+0000 7f4015de2740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556e62ba3390 0x556e62f71c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:10.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.266+0000 7f4015de2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556e62bc4070 0x556e62f72190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:10.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.266+0000 7f4015de2740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f40081b2fb0 con 0x556e62ba3390 2024-08-31T05:40:10.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.266+0000 7f4015de2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f40081b4af0 con 0x556e62b9b1b0 2024-08-31T05:40:10.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.266+0000 7f4015de2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f40081b3680 con 0x556e62bc4070 2024-08-31T05:40:10.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.266+0000 7f400d609640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556e62ba3390 0x556e62f71c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:10.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.266+0000 7f400d609640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556e62ba3390 0x556e62f71c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48648/0 (socket says 172.21.15.5:48648) 2024-08-31T05:40:10.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.266+0000 7f400d609640 1 -- 172.21.15.5:0/1838957641 learned_addr learned my addr 172.21.15.5:0/1838957641 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:10.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.266+0000 7f400ce08640 1 --2- 172.21.15.5:0/1838957641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e62b9b1b0 0x556e62f6cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:10.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.266+0000 7f400ce08640 1 --2- 172.21.15.5:0/1838957641 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556e62bc4070 0x556e62f72190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:10.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.267+0000 7f400d609640 1 -- 172.21.15.5:0/1838957641 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556e62bc4070 msgr2=0x556e62f72190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:10.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.267+0000 7f400d609640 1 --2- 172.21.15.5:0/1838957641 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556e62bc4070 0x556e62f72190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:10.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.267+0000 7f400d609640 1 -- 172.21.15.5:0/1838957641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e62b9b1b0 msgr2=0x556e62f6cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:10.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.267+0000 7f400d609640 1 --2- 172.21.15.5:0/1838957641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e62b9b1b0 0x556e62f6cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:10.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.267+0000 7f400d609640 1 -- 172.21.15.5:0/1838957641 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e62f6f670 con 0x556e62ba3390 2024-08-31T05:40:10.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.267+0000 7f400ce08640 1 --2- 172.21.15.5:0/1838957641 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556e62bc4070 0x556e62f72190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:40:10.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.267+0000 7f400d609640 1 --2- 172.21.15.5:0/1838957641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556e62ba3390 0x556e62f71c50 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f4004005010 tx=0x7f4004005d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cbf11b8354cf862 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:10.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.267+0000 7f3ff2ffd640 1 -- 172.21.15.5:0/1838957641 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4004035040 con 0x556e62ba3390 2024-08-31T05:40:10.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.267+0000 7f3ff2ffd640 1 -- 172.21.15.5:0/1838957641 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4004005590 con 0x556e62ba3390 2024-08-31T05:40:10.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.267+0000 7f3ff2ffd640 1 -- 172.21.15.5:0/1838957641 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4004003ab0 con 0x556e62ba3390 2024-08-31T05:40:10.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.268+0000 7f4015de2740 1 -- 172.21.15.5:0/1838957641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556e62ba3390 msgr2=0x556e62f71c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:10.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.268+0000 7f4015de2740 1 --2- 172.21.15.5:0/1838957641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556e62ba3390 0x556e62f71c50 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f4004005010 tx=0x7f4004005d90 comp rx=0 tx=0).stop 2024-08-31T05:40:10.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.268+0000 7f4015de2740 1 -- 172.21.15.5:0/1838957641 shutdown_connections 2024-08-31T05:40:10.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.268+0000 7f4015de2740 1 --2- 172.21.15.5:0/1838957641 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556e62bc4070 0x556e62f72190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:10.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.268+0000 7f4015de2740 1 --2- 172.21.15.5:0/1838957641 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556e62ba3390 0x556e62f71c50 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:10.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.268+0000 7f4015de2740 1 --2- 172.21.15.5:0/1838957641 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e62b9b1b0 0x556e62f6cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:10.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.268+0000 7f4015de2740 1 -- 172.21.15.5:0/1838957641 >> 172.21.15.5:0/1838957641 conn(0x556e62bb8460 msgr2=0x556e62f6c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:10.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.268+0000 7f4015de2740 1 -- 172.21.15.5:0/1838957641 shutdown_connections 2024-08-31T05:40:10.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.268+0000 7f4015de2740 1 -- 172.21.15.5:0/1838957641 wait complete. 2024-08-31T05:40:10.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.269+0000 7f4015de2740 1 -- start start 2024-08-31T05:40:10.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.269+0000 7f4015de2740 1 Processor -- start 2024-08-31T05:40:10.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.269+0000 7f4015de2740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556e62b9b1b0 0x556e62f79550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:10.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.269+0000 7f4015de2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556e62ba3390 0x556e62f79b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:10.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.269+0000 7f4015de2740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e62bc4070 0x556e62fea7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:10.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.270+0000 7f4015de2740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f40081b4420 con 0x556e62b9b1b0 2024-08-31T05:40:10.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.270+0000 7f4015de2740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f40081b3d50 con 0x556e62bc4070 2024-08-31T05:40:10.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.270+0000 7f4015de2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f40081b0fb0 con 0x556e62ba3390 2024-08-31T05:40:10.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.270+0000 7f4015de2740 10 client.0 _ll_register_callbacks cb 0x7f3ff8012dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:40:10.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.270+0000 7f400ce08640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556e62b9b1b0 0x556e62f79550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:10.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.270+0000 7f400ce08640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556e62b9b1b0 0x556e62f79550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48654/0 (socket says 172.21.15.5:48654) 2024-08-31T05:40:10.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.270+0000 7f400ce08640 1 -- 172.21.15.5:0/2785697137 learned_addr learned my addr 172.21.15.5:0/2785697137 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:10.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.270+0000 7f400d609640 1 --2- 172.21.15.5:0/2785697137 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556e62ba3390 0x556e62f79b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:10.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.270+0000 7f400ce08640 1 --2- 172.21.15.5:0/2785697137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e62bc4070 0x556e62fea7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:10.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.270+0000 7f400ce08640 1 -- 172.21.15.5:0/2785697137 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556e62ba3390 msgr2=0x556e62f79b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:10.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.270+0000 7f400ce08640 1 --2- 172.21.15.5:0/2785697137 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556e62ba3390 0x556e62f79b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:10.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.270+0000 7f400ce08640 1 -- 172.21.15.5:0/2785697137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e62bc4070 msgr2=0x556e62fea7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:10.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.270+0000 7f400ce08640 1 --2- 172.21.15.5:0/2785697137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e62bc4070 0x556e62fea7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:10.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.270+0000 7f400ce08640 1 -- 172.21.15.5:0/2785697137 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e62feae50 con 0x556e62b9b1b0 2024-08-31T05:40:10.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.270+0000 7f400ce08640 1 --2- 172.21.15.5:0/2785697137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556e62b9b1b0 0x556e62f79550 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8009b70 tx=0x7f3ff8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3420c78857953fba server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:10.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.270+0000 7f3ff0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:40:10.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.270+0000 7f3ff0ff9640 1 -- 172.21.15.5:0/2785697137 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff8037020 con 0x556e62b9b1b0 2024-08-31T05:40:10.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.270+0000 7f4015de2740 1 -- 172.21.15.5:0/2785697137 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4004005590 con 0x556e62b9b1b0 2024-08-31T05:40:10.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.270+0000 7f3ff0ff9640 1 -- 172.21.15.5:0/2785697137 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7f3ff80118d0 con 0x556e62b9b1b0 2024-08-31T05:40:10.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.271+0000 7f3ff0ff9640 1 -- 172.21.15.5:0/2785697137 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f3ff803f050 con 0x556e62b9b1b0 2024-08-31T05:40:10.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.271+0000 7f4015de2740 10 client.18249 fetch_fsmap learned FSMap version 34 2024-08-31T05:40:10.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.271+0000 7f4015de2740 1 -- 172.21.15.5:0/2785697137 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x556e62ff2180 con 0x556e62b9b1b0 2024-08-31T05:40:10.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.271+0000 7f3ff0ff9640 1 -- 172.21.15.5:0/2785697137 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4004005590 con 0x556e62b9b1b0 2024-08-31T05:40:10.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.271+0000 7f3ff0ff9640 1 -- 172.21.15.5:0/2785697137 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f3ff801d070 con 0x556e62b9b1b0 2024-08-31T05:40:10.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.271+0000 7f4015de2740 10 client.18249 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:40:10.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.271+0000 7f4015de2740 10 client.18249 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:40:10.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.271+0000 7f4015de2740 20 client.18249 populate_metadata read hostname 'smithi005' 2024-08-31T05:40:10.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.271+0000 7f4015de2740 1 --2- 172.21.15.5:0/2785697137 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x556e62b57da0 0x556e62ff4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:10.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.271+0000 7f4015de2740 4 client.18249 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T05:40:10.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.271+0000 7f4015de2740 1 -- 172.21.15.5:0/2785697137 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556e62ede020 con 0x556e62b57da0 2024-08-31T05:40:10.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.271+0000 7f400d609640 1 --2- 172.21.15.5:0/2785697137 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x556e62b57da0 0x556e62ff4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:10.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.272+0000 7f3ff0ff9640 10 client.18249 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:40:10.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.272+0000 7f400d609640 1 --2- 172.21.15.5:0/2785697137 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x556e62b57da0 0x556e62ff4800 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da7f93d1f188a151 server_cookie=89771433abc489ef in_seq=0 out_seq=0 2024-08-31T05:40:10.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.272+0000 7f3ff0ff9640 1 -- 172.21.15.5:0/2785697137 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3782 (crc 0 0 0) 0x556e62ede020 con 0x556e62b57da0 2024-08-31T05:40:10.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.272+0000 7f3ff0ff9640 10 client.18249 handle_command_reply: tid=0 2024-08-31T05:40:10.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.272+0000 7f4015de2740 1 client.18249 shutdown 2024-08-31T05:40:10.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.272+0000 7f4015de2740 1 -- 172.21.15.5:0/2785697137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556e62b9b1b0 msgr2=0x556e62f79550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:10.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.272+0000 7f4015de2740 1 --2- 172.21.15.5:0/2785697137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556e62b9b1b0 0x556e62f79550 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8009b70 tx=0x7f3ff8004730 comp rx=0 tx=0).stop 2024-08-31T05:40:10.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.272+0000 7f4015de2740 1 -- 172.21.15.5:0/2785697137 shutdown_connections 2024-08-31T05:40:10.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.272+0000 7f4015de2740 1 --2- 172.21.15.5:0/2785697137 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x556e62b57da0 0x556e62ff4800 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:10.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.272+0000 7f4015de2740 1 --2- 172.21.15.5:0/2785697137 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x556e62bc4070 0x556e62fea7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:10.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.272+0000 7f4015de2740 1 --2- 172.21.15.5:0/2785697137 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556e62ba3390 0x556e62f79b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:10.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.272+0000 7f3ff0ff9640 0 client.18249 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:40:10.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.272+0000 7f4015de2740 1 --2- 172.21.15.5:0/2785697137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556e62b9b1b0 0x556e62f79550 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:10.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.272+0000 7f4015de2740 1 -- 172.21.15.5:0/2785697137 >> 172.21.15.5:0/2785697137 conn(0x556e62bb8460 msgr2=0x556e62f75f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:10.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.273+0000 7f4015de2740 1 -- 172.21.15.5:0/2785697137 shutdown_connections 2024-08-31T05:40:10.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.273+0000 7f4015de2740 1 -- 172.21.15.5:0/2785697137 wait complete. 2024-08-31T05:40:10.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.273+0000 7f4015de2740 20 client.18249 trim_cache size 0 max 16384 2024-08-31T05:40:10.279 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:40:10.279 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "no active scrubs running", 2024-08-31T05:40:10.279 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": {}, 2024-08-31T05:40:10.279 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_stats": { 2024-08-31T05:40:10.279 INFO:teuthology.orchestra.run.smithi005.stdout: "239b7958-db06-4432-93ce-b7552effa357": { 2024-08-31T05:40:10.279 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:39:35.733028+0000", 2024-08-31T05:40:10.280 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:40:10.280 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:40:10.280 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:40:10.280 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:40:10.280 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:40:10.280 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:40:10.280 INFO:teuthology.orchestra.run.smithi005.stdout: "94c23057-592d-4a8b-82d7-da2d84f8740b": { 2024-08-31T05:40:10.280 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:36:27.513638+0000", 2024-08-31T05:40:10.280 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:40:10.280 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:40:10.280 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:40:10.280 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:40:10.280 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:40:10.280 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:40:10.281 INFO:teuthology.orchestra.run.smithi005.stdout: "a4d4cf74-2477-4dd9-a3a2-3762b4dd87e4": { 2024-08-31T05:40:10.281 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:38:01.378833+0000", 2024-08-31T05:40:10.281 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:40:10.281 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:40:10.281 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:40:10.281 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:40:10.281 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:40:10.281 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:40:10.281 INFO:teuthology.orchestra.run.smithi005.stdout: "095ccc7a-f368-4bc6-9563-5930e21f9b4a": { 2024-08-31T05:40:10.281 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:35:40.190069+0000", 2024-08-31T05:40:10.281 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:40:10.281 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:40:10.281 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:40:10.281 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:40:10.281 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:40:10.281 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:40:10.282 INFO:teuthology.orchestra.run.smithi005.stdout: "f4db3406-20ff-46a3-baf9-099e16392f76": { 2024-08-31T05:40:10.282 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:38:49.034412+0000", 2024-08-31T05:40:10.282 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:40:10.282 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:40:10.282 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:40:10.282 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:40:10.282 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:40:10.282 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:40:10.282 INFO:teuthology.orchestra.run.smithi005.stdout: "297c26f3-7b4d-4245-abb0-f854248e5e1b": { 2024-08-31T05:40:10.282 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:37:14.019244+0000", 2024-08-31T05:40:10.282 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:40:10.282 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:40:10.282 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:40:10.282 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:40:10.282 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:40:10.283 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:40:10.283 INFO:teuthology.orchestra.run.smithi005.stdout: "de9731c7-ae4a-42fe-8146-e4752cdc40d4": { 2024-08-31T05:40:10.283 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:34:53.614499+0000", 2024-08-31T05:40:10.283 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:40:10.283 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:40:10.283 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:40:10.283 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:40:10.283 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:40:10.283 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:40:10.283 INFO:teuthology.orchestra.run.smithi005.stdout: "0bb67292-013a-40c7-b5fc-810bdd9715d8": { 2024-08-31T05:40:10.283 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:34:04.586008+0000", 2024-08-31T05:40:10.283 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:40:10.283 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:40:10.283 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:40:10.284 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:40:10.284 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:40:10.284 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:40:10.284 INFO:teuthology.orchestra.run.smithi005.stdout: "728a42ca-bbef-4151-830f-5fdd411d8fa0": { 2024-08-31T05:40:10.284 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:32:30.554906+0000", 2024-08-31T05:40:10.284 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:40:10.284 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:40:10.284 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:40:10.284 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:40:10.284 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:40:10.284 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:40:10.284 INFO:teuthology.orchestra.run.smithi005.stdout: "2445fc42-b797-434f-b380-e2da985b4d98": { 2024-08-31T05:40:10.284 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:33:17.681453+0000", 2024-08-31T05:40:10.284 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:40:10.284 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:40:10.285 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:40:10.285 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:40:10.285 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:40:10.285 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:40:10.285 INFO:teuthology.orchestra.run.smithi005.stdout: "cda92ac0-b35f-47a5-a3a5-471c888462a5": { 2024-08-31T05:40:10.285 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:53.103905+0000", 2024-08-31T05:40:10.285 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:40:10.285 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:40:10.285 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:40:10.285 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:40:10.285 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:40:10.285 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:40:10.285 INFO:teuthology.orchestra.run.smithi005.stdout: "ece37b07-9ab2-45f8-bc33-2755a07aac0b": { 2024-08-31T05:40:10.285 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:31:41.782407+0000", 2024-08-31T05:40:10.286 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:40:10.286 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:40:10.286 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:40:10.286 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:40:10.286 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:40:10.286 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:40:10.286 INFO:teuthology.orchestra.run.smithi005.stdout: "75d84398-5d9c-4872-b879-2fbce045fa71": { 2024-08-31T05:40:10.286 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:06.642335+0000", 2024-08-31T05:40:10.286 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:40:10.286 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:40:10.286 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:40:10.286 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:40:10.286 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:40:10.287 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:40:10.287 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:40:10.287 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:40:10.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.273+0000 7f400f86d640 1 -- 172.21.15.5:0/2788811673 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f3ff40b4ca0 msgr2=0x7f3ff40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:10.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.273+0000 7f400f86d640 1 --2- 172.21.15.5:0/2788811673 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f3ff40b4ca0 0x7f3ff40b71b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f40000abd40 tx=0x7f40000dbf00 comp rx=0 tx=0).stop 2024-08-31T05:40:10.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.273+0000 7f400f86d640 1 -- 172.21.15.5:0/2788811673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f400810bde0 msgr2=0x7f40081a1d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:10.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.273+0000 7f400f86d640 1 --2- 172.21.15.5:0/2788811673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f400810bde0 0x7f40081a1d20 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f400000eaa0 tx=0x7f400000ef60 comp rx=0 tx=0).stop 2024-08-31T05:40:10.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.273+0000 7f400f86d640 1 -- 172.21.15.5:0/2788811673 shutdown_connections 2024-08-31T05:40:10.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.273+0000 7f400f86d640 1 --2- 172.21.15.5:0/2788811673 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f3ff40b4ca0 0x7f3ff40b71b0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:10.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.273+0000 7f400f86d640 1 --2- 172.21.15.5:0/2788811673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f400810bde0 0x7f40081a1d20 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:10.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.273+0000 7f400f86d640 1 --2- 172.21.15.5:0/2788811673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f400810b490 0x7f400819ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:10.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.273+0000 7f400f86d640 1 --2- 172.21.15.5:0/2788811673 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4008105b50 0x7f400819c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:10.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.273+0000 7f400f86d640 1 -- 172.21.15.5:0/2788811673 >> 172.21.15.5:0/2788811673 conn(0x7f4008101560 msgr2=0x7f40081049d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:10.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.273+0000 7f400f86d640 1 -- 172.21.15.5:0/2788811673 shutdown_connections 2024-08-31T05:40:10.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:10.273+0000 7f400f86d640 1 -- 172.21.15.5:0/2788811673 wait complete. 2024-08-31T05:40:10.935 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1148780 10.99 MB/sec execute 418 sec latency 36.044 ms 2024-08-31T05:40:11.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:40:10 smithi050 ceph-mon[22146]: pgmap v658: 129 pgs: 129 active+clean; 578 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.2 MiB/s wr, 242 op/s 2024-08-31T05:40:11.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:40:10 smithi050 ceph-mon[22146]: osdmap e95: 12 total, 12 up, 12 in 2024-08-31T05:40:11.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:40:10 smithi005 ceph-mon[18602]: pgmap v658: 129 pgs: 129 active+clean; 578 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.2 MiB/s wr, 242 op/s 2024-08-31T05:40:11.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:40:10 smithi005 ceph-mon[18602]: osdmap e95: 12 total, 12 up, 12 in 2024-08-31T05:40:11.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:40:10 smithi070 ceph-mon[22316]: pgmap v658: 129 pgs: 129 active+clean; 578 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.2 MiB/s wr, 242 op/s 2024-08-31T05:40:11.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:40:10 smithi070 ceph-mon[22316]: osdmap e95: 12 total, 12 up, 12 in 2024-08-31T05:40:11.506 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T05:40:11.506 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T05:40:11.767 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:40:11.935 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1150811 10.99 MB/sec execute 419 sec latency 91.220 ms 2024-08-31T05:40:12.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.264+0000 7f2c6ce14640 1 -- 172.21.15.5:0/2958055813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c68109bb0 msgr2=0x7f2c681103e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:12.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.264+0000 7f2c6ce14640 1 --2- 172.21.15.5:0/2958055813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c68109bb0 0x7f2c681103e0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f2c60009ca0 tx=0x7f2c6002a8c0 comp rx=0 tx=0).stop 2024-08-31T05:40:12.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.264+0000 7f2c6ce14640 1 -- 172.21.15.5:0/2958055813 shutdown_connections 2024-08-31T05:40:12.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.264+0000 7f2c6ce14640 1 --2- 172.21.15.5:0/2958055813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c68109bb0 0x7f2c681103e0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:12.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.264+0000 7f2c6ce14640 1 --2- 172.21.15.5:0/2958055813 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c68109260 0x7f2c68109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:12.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.264+0000 7f2c6ce14640 1 --2- 172.21.15.5:0/2958055813 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c68103920 0x7f2c68103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:12.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.264+0000 7f2c6ce14640 1 -- 172.21.15.5:0/2958055813 >> 172.21.15.5:0/2958055813 conn(0x7f2c680ff3b0 msgr2=0x7f2c68101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:12.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.264+0000 7f2c6ce14640 1 -- 172.21.15.5:0/2958055813 shutdown_connections 2024-08-31T05:40:12.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.264+0000 7f2c6ce14640 1 -- 172.21.15.5:0/2958055813 wait complete. 2024-08-31T05:40:12.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.265+0000 7f2c6ce14640 1 Processor -- start 2024-08-31T05:40:12.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.265+0000 7f2c6ce14640 1 -- start start 2024-08-31T05:40:12.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.265+0000 7f2c6ce14640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c68103920 0x7f2c6819a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:12.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.265+0000 7f2c6ce14640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c68109260 0x7f2c6819a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:12.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.265+0000 7f2c6ce14640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c68109bb0 0x7f2c6819fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:12.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.265+0000 7f2c6ce14640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2c68113870 con 0x7f2c68109260 2024-08-31T05:40:12.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.265+0000 7f2c6ce14640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2c681136f0 con 0x7f2c68103920 2024-08-31T05:40:12.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.265+0000 7f2c6ce14640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2c681139f0 con 0x7f2c68109bb0 2024-08-31T05:40:12.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.265+0000 7f2c5ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c68109260 0x7f2c6819a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:12.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.265+0000 7f2c6659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c68103920 0x7f2c6819a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:12.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.265+0000 7f2c5ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c68109260 0x7f2c6819a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42924/0 (socket says 172.21.15.5:42924) 2024-08-31T05:40:12.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.265+0000 7f2c5ffff640 1 -- 172.21.15.5:0/2928134117 learned_addr learned my addr 172.21.15.5:0/2928134117 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:12.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.265+0000 7f2c66d9d640 1 --2- 172.21.15.5:0/2928134117 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c68109bb0 0x7f2c6819fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:12.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.265+0000 7f2c6659c640 1 -- 172.21.15.5:0/2928134117 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c68109bb0 msgr2=0x7f2c6819fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:12.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.265+0000 7f2c6659c640 1 --2- 172.21.15.5:0/2928134117 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c68109bb0 0x7f2c6819fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:12.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.265+0000 7f2c6659c640 1 -- 172.21.15.5:0/2928134117 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c68109260 msgr2=0x7f2c6819a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:12.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.265+0000 7f2c6659c640 1 --2- 172.21.15.5:0/2928134117 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c68109260 0x7f2c6819a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:12.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.266+0000 7f2c6659c640 1 -- 172.21.15.5:0/2928134117 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c681a0210 con 0x7f2c68103920 2024-08-31T05:40:12.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.266+0000 7f2c5ffff640 1 --2- 172.21.15.5:0/2928134117 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c68109260 0x7f2c6819a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:40:12.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.266+0000 7f2c6659c640 1 --2- 172.21.15.5:0/2928134117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c68103920 0x7f2c6819a2a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2c5800e9f0 tx=0x7f2c5800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:12.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.266+0000 7f2c5f7fe640 1 -- 172.21.15.5:0/2928134117 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c5800ccc0 con 0x7f2c68103920 2024-08-31T05:40:12.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.266+0000 7f2c6ce14640 1 -- 172.21.15.5:0/2928134117 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c681a0500 con 0x7f2c68103920 2024-08-31T05:40:12.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.266+0000 7f2c5f7fe640 1 -- 172.21.15.5:0/2928134117 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c58005020 con 0x7f2c68103920 2024-08-31T05:40:12.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.266+0000 7f2c5f7fe640 1 -- 172.21.15.5:0/2928134117 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c58004a00 con 0x7f2c68103920 2024-08-31T05:40:12.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.266+0000 7f2c6ce14640 1 -- 172.21.15.5:0/2928134117 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c681a6c60 con 0x7f2c68103920 2024-08-31T05:40:12.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.267+0000 7f2c6ce14640 1 -- 172.21.15.5:0/2928134117 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c68104ba0 con 0x7f2c68103920 2024-08-31T05:40:12.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.269+0000 7f2c5f7fe640 1 -- 172.21.15.5:0/2928134117 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f2c58004ba0 con 0x7f2c68103920 2024-08-31T05:40:12.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.269+0000 7f2c5f7fe640 1 --2- 172.21.15.5:0/2928134117 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2c540b4ca0 0x7f2c540b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:12.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.269+0000 7f2c5ffff640 1 --2- 172.21.15.5:0/2928134117 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2c540b4ca0 0x7f2c540b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:12.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.270+0000 7f2c5f7fe640 1 -- 172.21.15.5:0/2928134117 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7f2c580e5980 con 0x7f2c68103920 2024-08-31T05:40:12.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.270+0000 7f2c5ffff640 1 --2- 172.21.15.5:0/2928134117 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2c540b4ca0 0x7f2c540b71b0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2c68102ab0 tx=0x7f2c50005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:12.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.273+0000 7f2c5f7fe640 1 -- 172.21.15.5:0/2928134117 <== mon.2 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2c580ac3c0 con 0x7f2c68103920 2024-08-31T05:40:12.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.597+0000 7f2c6ce14640 1 -- 172.21.15.5:0/2928134117 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2c68103d30 con 0x7f2c68103920 2024-08-31T05:40:12.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.598+0000 7f2c5f7fe640 1 -- 172.21.15.5:0/2928134117 <== mon.2 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11941 (secure 0 0 0) 0x7f2c68103d30 con 0x7f2c68103920 2024-08-31T05:40:12.608 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:40:12.608 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":34,"btime":"2024-08-31T05:33:43:289944+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14739,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2024812199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2024812199},{"type":"v1","addr":"172.21.15.5:6835","nonce":2024812199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3629023702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3629023702},{"type":"v1","addr":"172.21.15.5:6837","nonce":3629023702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T05:27:31.929153+0000","modified":"2024-08-31T05:33:42.378207+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24652,"mds_1":24638,"mds_2":24631,"mds_3":24625,"mds_4":24602},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6839/2412701258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":2412701258},{"type":"v1","addr":"172.21.15.5:6839","nonce":2412701258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14820":{"gid":14820,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6841/747057838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":747057838},{"type":"v1","addr":"172.21.15.5:6841","nonce":747057838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6833/1153378982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1153378982},{"type":"v1","addr":"172.21.15.50:6833","nonce":1153378982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6833/364083443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":364083443},{"type":"v1","addr":"172.21.15.70:6833","nonce":364083443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24587":{"gid":24587,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/2346896794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2346896794},{"type":"v1","addr":"172.21.15.50:6835","nonce":2346896794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24602":{"gid":24602,"name":"h","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.50:6837/428759669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":428759669},{"type":"v1","addr":"172.21.15.50:6837","nonce":428759669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.70:6835/2061504114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2061504114},{"type":"v1","addr":"172.21.15.70:6835","nonce":2061504114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.70:6837/2780036414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2780036414},{"type":"v1","addr":"172.21.15.70:6837","nonce":2780036414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.50:6839/98200944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":98200944},{"type":"v1","addr":"172.21.15.50:6839","nonce":98200944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24652":{"gid":24652,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.70:6839/2756569250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":2756569250},{"type":"v1","addr":"172.21.15.70:6839","nonce":2756569250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24652,"qdb_cluster":[24652,24631,24638,24625,24602]},"id":1}]} 2024-08-31T05:40:12.609 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 34 2024-08-31T05:40:12.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.601+0000 7f2c6ce14640 1 -- 172.21.15.5:0/2928134117 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2c540b4ca0 msgr2=0x7f2c540b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:12.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.601+0000 7f2c6ce14640 1 --2- 172.21.15.5:0/2928134117 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2c540b4ca0 0x7f2c540b71b0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2c68102ab0 tx=0x7f2c50005f90 comp rx=0 tx=0).stop 2024-08-31T05:40:12.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.601+0000 7f2c6ce14640 1 -- 172.21.15.5:0/2928134117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c68103920 msgr2=0x7f2c6819a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:12.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.601+0000 7f2c6ce14640 1 --2- 172.21.15.5:0/2928134117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c68103920 0x7f2c6819a2a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2c5800e9f0 tx=0x7f2c5800eeb0 comp rx=0 tx=0).stop 2024-08-31T05:40:12.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.601+0000 7f2c6ce14640 1 -- 172.21.15.5:0/2928134117 shutdown_connections 2024-08-31T05:40:12.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.601+0000 7f2c6ce14640 1 --2- 172.21.15.5:0/2928134117 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2c540b4ca0 0x7f2c540b71b0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:12.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.601+0000 7f2c6ce14640 1 --2- 172.21.15.5:0/2928134117 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c68109bb0 0x7f2c6819fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:12.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.601+0000 7f2c6ce14640 1 --2- 172.21.15.5:0/2928134117 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c68109260 0x7f2c6819a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:12.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.601+0000 7f2c6ce14640 1 --2- 172.21.15.5:0/2928134117 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2c68103920 0x7f2c6819a2a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:12.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.601+0000 7f2c6ce14640 1 -- 172.21.15.5:0/2928134117 >> 172.21.15.5:0/2928134117 conn(0x7f2c680ff3b0 msgr2=0x7f2c68106830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:12.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.601+0000 7f2c6ce14640 1 -- 172.21.15.5:0/2928134117 shutdown_connections 2024-08-31T05:40:12.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:12.601+0000 7f2c6ce14640 1 -- 172.21.15.5:0/2928134117 wait complete. 2024-08-31T05:40:12.936 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1152015 10.97 MB/sec execute 420 sec latency 20.399 ms 2024-08-31T05:40:13.138 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:40:12 smithi070 ceph-mon[22316]: pgmap v660: 129 pgs: 129 active+clean; 578 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.3 MiB/s wr, 233 op/s 2024-08-31T05:40:13.138 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:40:12 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/2928134117' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:40:13.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:40:12 smithi050 ceph-mon[22146]: pgmap v660: 129 pgs: 129 active+clean; 578 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.3 MiB/s wr, 233 op/s 2024-08-31T05:40:13.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:40:12 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/2928134117' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:40:13.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:40:12 smithi005 ceph-mon[18602]: pgmap v660: 129 pgs: 129 active+clean; 578 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.3 MiB/s wr, 233 op/s 2024-08-31T05:40:13.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:40:12 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/2928134117' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:40:13.307 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-31T05:40:13.409 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.405+0000 7f997fb39640 1 -- 172.21.15.5:0/2618888664 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99781027b0 msgr2=0x7f9978102bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:13.409 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.405+0000 7f997fb39640 1 --2- 172.21.15.5:0/2618888664 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99781027b0 0x7f9978102bc0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9974009900 tx=0x7f997402a410 comp rx=0 tx=0).stop 2024-08-31T05:40:13.409 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.405+0000 7f997fb39640 1 -- 172.21.15.5:0/2618888664 shutdown_connections 2024-08-31T05:40:13.409 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.405+0000 7f997fb39640 1 --2- 172.21.15.5:0/2618888664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9978108a30 0x7f997810f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:13.410 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.405+0000 7f997fb39640 1 --2- 172.21.15.5:0/2618888664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99781080e0 0x7f99781084f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:13.410 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.405+0000 7f997fb39640 1 --2- 172.21.15.5:0/2618888664 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99781027b0 0x7f9978102bc0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:13.410 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.405+0000 7f997fb39640 1 -- 172.21.15.5:0/2618888664 >> 172.21.15.5:0/2618888664 conn(0x7f9978078450 msgr2=0x7f9978078860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:13.410 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.405+0000 7f997fb39640 1 -- 172.21.15.5:0/2618888664 shutdown_connections 2024-08-31T05:40:13.410 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.405+0000 7f997fb39640 1 -- 172.21.15.5:0/2618888664 wait complete. 2024-08-31T05:40:13.410 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.406+0000 7f997fb39640 1 Processor -- start 2024-08-31T05:40:13.410 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.406+0000 7f997fb39640 1 -- start start 2024-08-31T05:40:13.410 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.406+0000 7f997fb39640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99781027b0 0x7f997819a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:13.410 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.406+0000 7f997fb39640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99781080e0 0x7f997819a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:13.410 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.406+0000 7f997fb39640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9978108a30 0x7f997819fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:13.410 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.406+0000 7f997fb39640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f99781126e0 con 0x7f99781027b0 2024-08-31T05:40:13.410 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.406+0000 7f997fb39640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9978112560 con 0x7f9978108a30 2024-08-31T05:40:13.410 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.406+0000 7f997fb39640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9978112860 con 0x7f99781080e0 2024-08-31T05:40:13.410 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.406+0000 7f997d8d5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99781027b0 0x7f997819a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:13.411 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.406+0000 7f997d8d5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99781027b0 0x7f997819a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42952/0 (socket says 172.21.15.5:42952) 2024-08-31T05:40:13.411 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.406+0000 7f997d8d5640 1 -- 172.21.15.5:0/1769699638 learned_addr learned my addr 172.21.15.5:0/1769699638 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:13.411 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.406+0000 7f997d0d4640 1 --2- 172.21.15.5:0/1769699638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99781080e0 0x7f997819a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:13.411 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.406+0000 7f997e0d6640 1 --2- 172.21.15.5:0/1769699638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9978108a30 0x7f997819fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:13.411 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.407+0000 7f997d8d5640 1 -- 172.21.15.5:0/1769699638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99781080e0 msgr2=0x7f997819a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:13.411 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.407+0000 7f997d8d5640 1 --2- 172.21.15.5:0/1769699638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99781080e0 0x7f997819a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:13.411 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.407+0000 7f997d8d5640 1 -- 172.21.15.5:0/1769699638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9978108a30 msgr2=0x7f997819fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:13.411 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.407+0000 7f997d8d5640 1 --2- 172.21.15.5:0/1769699638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9978108a30 0x7f997819fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:13.411 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.407+0000 7f997d8d5640 1 -- 172.21.15.5:0/1769699638 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99781a01c0 con 0x7f99781027b0 2024-08-31T05:40:13.411 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.407+0000 7f997d8d5640 1 --2- 172.21.15.5:0/1769699638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99781027b0 0x7f997819a290 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f9974005940 tx=0x7f99740040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:13.411 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.407+0000 7f996effd640 1 -- 172.21.15.5:0/1769699638 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f997403f030 con 0x7f99781027b0 2024-08-31T05:40:13.411 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.407+0000 7f997fb39640 1 -- 172.21.15.5:0/1769699638 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99781a0450 con 0x7f99781027b0 2024-08-31T05:40:13.411 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.407+0000 7f996effd640 1 -- 172.21.15.5:0/1769699638 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99740044c0 con 0x7f99781027b0 2024-08-31T05:40:13.412 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.407+0000 7f997fb39640 1 -- 172.21.15.5:0/1769699638 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99781a6c40 con 0x7f99781027b0 2024-08-31T05:40:13.412 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.407+0000 7f996effd640 1 -- 172.21.15.5:0/1769699638 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9974049060 con 0x7f99781027b0 2024-08-31T05:40:13.412 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.410+0000 7f996effd640 1 -- 172.21.15.5:0/1769699638 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f9974042030 con 0x7f99781027b0 2024-08-31T05:40:13.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.411+0000 7f996effd640 1 --2- 172.21.15.5:0/1769699638 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f99640b4ca0 0x7f99640b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:13.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.411+0000 7f9986aac740 1 Processor -- start 2024-08-31T05:40:13.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.411+0000 7f997d0d4640 1 --2- 172.21.15.5:0/1769699638 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f99640b4ca0 0x7f99640b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:13.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.411+0000 7f996effd640 1 -- 172.21.15.5:0/1769699638 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7f9974106010 con 0x7f99781027b0 2024-08-31T05:40:13.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.411+0000 7f9986aac740 1 -- start start 2024-08-31T05:40:13.415 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.411+0000 7f9986aac740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ecdb3891b0 0x55ecdb72cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:13.415 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.411+0000 7f9986aac740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ecdb3602f0 0x55ecdb72d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:13.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.411+0000 7f9986aac740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ecdb3684d0 0x55ecdb72d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:13.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.411+0000 7f9986aac740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55ecdb6a2000 con 0x55ecdb3684d0 2024-08-31T05:40:13.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.411+0000 7f9986aac740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ecdb691590 con 0x55ecdb3891b0 2024-08-31T05:40:13.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.411+0000 7f9986aac740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ecdb695540 con 0x55ecdb3602f0 2024-08-31T05:40:13.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.411+0000 7f997d0d4640 1 --2- 172.21.15.5:0/1769699638 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f99640b4ca0 0x7f99640b71b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f99680095f0 tx=0x7f9968005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:13.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.412+0000 7f997d8d5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ecdb3891b0 0x55ecdb72cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:13.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.412+0000 7f997e0d6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ecdb3684d0 0x55ecdb72d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:13.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.412+0000 7f997d0d4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ecdb3602f0 0x55ecdb72d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:13.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.412+0000 7f997d8d5640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ecdb3891b0 0x55ecdb72cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:53100/0 (socket says 172.21.15.5:53100) 2024-08-31T05:40:13.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.412+0000 7f997d8d5640 1 -- 172.21.15.5:0/1319623440 learned_addr learned my addr 172.21.15.5:0/1319623440 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:13.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.412+0000 7f997d0d4640 1 -- 172.21.15.5:0/1319623440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ecdb3891b0 msgr2=0x55ecdb72cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:13.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.412+0000 7f997d0d4640 1 --2- 172.21.15.5:0/1319623440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ecdb3891b0 0x55ecdb72cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:13.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.412+0000 7f997d0d4640 1 -- 172.21.15.5:0/1319623440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ecdb3684d0 msgr2=0x55ecdb72d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:13.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.412+0000 7f997d0d4640 1 --2- 172.21.15.5:0/1319623440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ecdb3684d0 0x55ecdb72d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:13.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.412+0000 7f997d0d4640 1 -- 172.21.15.5:0/1319623440 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecdb3f4790 con 0x55ecdb3602f0 2024-08-31T05:40:13.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.412+0000 7f997d8d5640 1 --2- 172.21.15.5:0/1319623440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ecdb3891b0 0x55ecdb72cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:40:13.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.412+0000 7f997d0d4640 1 --2- 172.21.15.5:0/1319623440 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ecdb3602f0 0x55ecdb72d220 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9978078910 tx=0x7f9968014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=360b19094d05d3fb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:13.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.412+0000 7f9963fff640 1 -- 172.21.15.5:0/1319623440 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9968026430 con 0x55ecdb3602f0 2024-08-31T05:40:13.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.412+0000 7f9963fff640 1 -- 172.21.15.5:0/1319623440 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f996801d8c0 con 0x55ecdb3602f0 2024-08-31T05:40:13.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.412+0000 7f9963fff640 1 -- 172.21.15.5:0/1319623440 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99680258c0 con 0x55ecdb3602f0 2024-08-31T05:40:13.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.413+0000 7f9986aac740 1 -- 172.21.15.5:0/1319623440 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ecdb3602f0 msgr2=0x55ecdb72d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:13.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.413+0000 7f9986aac740 1 --2- 172.21.15.5:0/1319623440 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ecdb3602f0 0x55ecdb72d220 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9978078910 tx=0x7f9968014000 comp rx=0 tx=0).stop 2024-08-31T05:40:13.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.413+0000 7f9986aac740 1 -- 172.21.15.5:0/1319623440 shutdown_connections 2024-08-31T05:40:13.417 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.413+0000 7f9986aac740 1 --2- 172.21.15.5:0/1319623440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ecdb3684d0 0x55ecdb72d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:13.418 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.413+0000 7f9986aac740 1 --2- 172.21.15.5:0/1319623440 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ecdb3602f0 0x55ecdb72d220 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:13.418 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.413+0000 7f9986aac740 1 --2- 172.21.15.5:0/1319623440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ecdb3891b0 0x55ecdb72cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:13.418 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.413+0000 7f9986aac740 1 -- 172.21.15.5:0/1319623440 >> 172.21.15.5:0/1319623440 conn(0x55ecdb37d300 msgr2=0x55ecdb72abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:13.418 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.413+0000 7f9986aac740 1 -- 172.21.15.5:0/1319623440 shutdown_connections 2024-08-31T05:40:13.418 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.414+0000 7f9986aac740 1 -- 172.21.15.5:0/1319623440 wait complete. 2024-08-31T05:40:13.421 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.414+0000 7f9986aac740 1 -- start start 2024-08-31T05:40:13.421 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.414+0000 7f9986aac740 1 Processor -- start 2024-08-31T05:40:13.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.414+0000 7f9986aac740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ecdb3602f0 0x55ecdb73cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:13.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.414+0000 7f9986aac740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ecdb3684d0 0x55ecdb73d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:13.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.414+0000 7f9986aac740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ecdb3891b0 0x55ecdb748bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:13.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.414+0000 7f9986aac740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55ecdb5caab0 con 0x55ecdb3602f0 2024-08-31T05:40:13.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.414+0000 7f9986aac740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ecdb618680 con 0x55ecdb3684d0 2024-08-31T05:40:13.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.414+0000 7f9986aac740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ecdb73f840 con 0x55ecdb3891b0 2024-08-31T05:40:13.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.415+0000 7f9986aac740 10 client.0 _ll_register_callbacks cb 0x55ecdb3a0a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:40:13.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.415+0000 7f997d8d5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ecdb3602f0 0x55ecdb73cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:13.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.415+0000 7f997e0d6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ecdb3891b0 0x55ecdb748bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:13.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.415+0000 7f997d0d4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ecdb3684d0 0x55ecdb73d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:13.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.415+0000 7f997d8d5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ecdb3602f0 0x55ecdb73cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42970/0 (socket says 172.21.15.5:42970) 2024-08-31T05:40:13.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.415+0000 7f997e0d6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ecdb3891b0 0x55ecdb748bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:53194/0 (socket says 172.21.15.5:53194) 2024-08-31T05:40:13.422 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.415+0000 7f997d8d5640 1 -- 172.21.15.5:0/3820999375 learned_addr learned my addr 172.21.15.5:0/3820999375 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:13.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.415+0000 7f997d0d4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ecdb3684d0 0x55ecdb73d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:53116/0 (socket says 172.21.15.5:53116) 2024-08-31T05:40:13.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.415+0000 7f997d0d4640 1 -- 172.21.15.5:0/3820999375 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ecdb3891b0 msgr2=0x55ecdb748bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:13.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.415+0000 7f997d0d4640 1 --2- 172.21.15.5:0/3820999375 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ecdb3891b0 0x55ecdb748bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:13.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.415+0000 7f997d0d4640 1 -- 172.21.15.5:0/3820999375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ecdb3602f0 msgr2=0x55ecdb73cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:13.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.415+0000 7f997d0d4640 1 --2- 172.21.15.5:0/3820999375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ecdb3602f0 0x55ecdb73cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:13.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.415+0000 7f997d0d4640 1 -- 172.21.15.5:0/3820999375 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecdb46d620 con 0x55ecdb3684d0 2024-08-31T05:40:13.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.415+0000 7f997d0d4640 1 --2- 172.21.15.5:0/3820999375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ecdb3684d0 0x55ecdb73d1e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f99680099c0 tx=0x7f996800ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7412d38f2fb5554a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:13.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.415+0000 7f99617fa640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:40:13.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.415+0000 7f99617fa640 1 -- 172.21.15.5:0/3820999375 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9968034060 con 0x55ecdb3684d0 2024-08-31T05:40:13.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.416+0000 7f9986aac740 1 -- 172.21.15.5:0/3820999375 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f996801d8c0 con 0x55ecdb3684d0 2024-08-31T05:40:13.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.416+0000 7f99617fa640 1 -- 172.21.15.5:0/3820999375 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7f996801d620 con 0x55ecdb3684d0 2024-08-31T05:40:13.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.416+0000 7f99617fa640 1 -- 172.21.15.5:0/3820999375 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f996803b050 con 0x55ecdb3684d0 2024-08-31T05:40:13.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.416+0000 7f9986aac740 10 client.27839 fetch_fsmap learned FSMap version 34 2024-08-31T05:40:13.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.416+0000 7f9986aac740 1 -- 172.21.15.5:0/3820999375 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55ecdb74b8f0 con 0x55ecdb3684d0 2024-08-31T05:40:13.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.416+0000 7f99617fa640 1 -- 172.21.15.5:0/3820999375 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f996801d8c0 con 0x55ecdb3684d0 2024-08-31T05:40:13.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.416+0000 7f99617fa640 1 -- 172.21.15.5:0/3820999375 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f99680046c0 con 0x55ecdb3684d0 2024-08-31T05:40:13.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.416+0000 7f9986aac740 10 client.27839 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:40:13.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.416+0000 7f9986aac740 10 client.27839 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:40:13.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.416+0000 7f9986aac740 20 client.27839 populate_metadata read hostname 'smithi005' 2024-08-31T05:40:13.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.416+0000 7f9986aac740 1 --2- 172.21.15.5:0/3820999375 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55ecdb347d80 0x55ecdb74ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:13.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.416+0000 7f9986aac740 4 client.27839 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:40:13.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.416+0000 7f9986aac740 1 -- 172.21.15.5:0/3820999375 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ecdb6a3f50 con 0x55ecdb347d80 2024-08-31T05:40:13.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.416+0000 7f997d8d5640 1 --2- 172.21.15.5:0/3820999375 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55ecdb347d80 0x55ecdb74ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:13.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.417+0000 7f99617fa640 10 client.27839 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:40:13.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.417+0000 7f997d8d5640 1 --2- 172.21.15.5:0/3820999375 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55ecdb347d80 0x55ecdb74ed00 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11c55c96216dd93d server_cookie=2b4a7a8ba03f4a2 in_seq=0 out_seq=0 2024-08-31T05:40:13.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.417+0000 7f99617fa640 1 -- 172.21.15.5:0/3820999375 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ecdb6a3f50 con 0x55ecdb347d80 2024-08-31T05:40:13.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.417+0000 7f99617fa640 10 client.27839 handle_command_reply: tid=0 2024-08-31T05:40:13.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.418+0000 7f9986aac740 1 client.27839 shutdown 2024-08-31T05:40:13.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.418+0000 7f9986aac740 1 -- 172.21.15.5:0/3820999375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ecdb3684d0 msgr2=0x55ecdb73d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:13.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.418+0000 7f9986aac740 1 --2- 172.21.15.5:0/3820999375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ecdb3684d0 0x55ecdb73d1e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f99680099c0 tx=0x7f996800ee70 comp rx=0 tx=0).stop 2024-08-31T05:40:13.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.418+0000 7f9986aac740 1 -- 172.21.15.5:0/3820999375 shutdown_connections 2024-08-31T05:40:13.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.418+0000 7f9986aac740 1 --2- 172.21.15.5:0/3820999375 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55ecdb347d80 0x55ecdb74ed00 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:13.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.418+0000 7f9986aac740 1 --2- 172.21.15.5:0/3820999375 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ecdb3891b0 0x55ecdb748bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:13.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.418+0000 7f9986aac740 1 --2- 172.21.15.5:0/3820999375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ecdb3684d0 0x55ecdb73d1e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:13.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.418+0000 7f99617fa640 0 client.27839 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:40:13.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.418+0000 7f9986aac740 1 --2- 172.21.15.5:0/3820999375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ecdb3602f0 0x55ecdb73cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:13.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.418+0000 7f9986aac740 1 -- 172.21.15.5:0/3820999375 >> 172.21.15.5:0/3820999375 conn(0x55ecdb37d300 msgr2=0x55ecdb72e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:13.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.418+0000 7f9986aac740 1 -- 172.21.15.5:0/3820999375 shutdown_connections 2024-08-31T05:40:13.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.418+0000 7f9986aac740 1 -- 172.21.15.5:0/3820999375 wait complete. 2024-08-31T05:40:13.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.418+0000 7f9986aac740 20 client.27839 trim_cache size 0 max 16384 2024-08-31T05:40:13.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.433+0000 7f9986aac740 1 Processor -- start 2024-08-31T05:40:13.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.433+0000 7f9986aac740 1 -- start start 2024-08-31T05:40:13.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.433+0000 7f9986aac740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ecdb3602f0 0x55ecdb73b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:13.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.433+0000 7f9986aac740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ecdb3684d0 0x55ecdb73b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:13.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.433+0000 7f9986aac740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ecdb3891b0 0x55ecdb72a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:13.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.433+0000 7f9986aac740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f99781aebe0 con 0x55ecdb3602f0 2024-08-31T05:40:13.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.433+0000 7f9986aac740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f99781b0720 con 0x55ecdb3891b0 2024-08-31T05:40:13.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.433+0000 7f9986aac740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f99781af2b0 con 0x55ecdb3684d0 2024-08-31T05:40:13.436 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.433+0000 7f997d8d5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ecdb3602f0 0x55ecdb73b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:13.437 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.433+0000 7f997e0d6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ecdb3891b0 0x55ecdb72a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:13.437 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.433+0000 7f997d0d4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ecdb3684d0 0x55ecdb73b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:13.437 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.433+0000 7f997e0d6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ecdb3891b0 0x55ecdb72a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:53132/0 (socket says 172.21.15.5:53132) 2024-08-31T05:40:13.437 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.433+0000 7f997e0d6640 1 -- 172.21.15.5:0/3408227551 learned_addr learned my addr 172.21.15.5:0/3408227551 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:13.437 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.433+0000 7f997e0d6640 1 -- 172.21.15.5:0/3408227551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ecdb3684d0 msgr2=0x55ecdb73b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:13.437 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.433+0000 7f997e0d6640 1 --2- 172.21.15.5:0/3408227551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ecdb3684d0 0x55ecdb73b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:13.437 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.433+0000 7f997e0d6640 1 -- 172.21.15.5:0/3408227551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ecdb3602f0 msgr2=0x55ecdb73b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:13.437 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.433+0000 7f997e0d6640 1 --2- 172.21.15.5:0/3408227551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ecdb3602f0 0x55ecdb73b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:13.437 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.433+0000 7f997e0d6640 1 -- 172.21.15.5:0/3408227551 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecdb749520 con 0x55ecdb3891b0 2024-08-31T05:40:13.437 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.434+0000 7f997e0d6640 1 --2- 172.21.15.5:0/3408227551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ecdb3891b0 0x55ecdb72a180 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f99700127a0 tx=0x7f9970009500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23baa424d5f2c7ff server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:13.437 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.434+0000 7f99637fe640 1 -- 172.21.15.5:0/3408227551 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9970022070 con 0x55ecdb3891b0 2024-08-31T05:40:13.437 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.434+0000 7f99637fe640 1 -- 172.21.15.5:0/3408227551 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9970003e20 con 0x55ecdb3891b0 2024-08-31T05:40:13.437 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.434+0000 7f99637fe640 1 -- 172.21.15.5:0/3408227551 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9970004050 con 0x55ecdb3891b0 2024-08-31T05:40:13.441 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.435+0000 7f9986aac740 1 -- 172.21.15.5:0/3408227551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ecdb3891b0 msgr2=0x55ecdb72a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:13.441 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.435+0000 7f9986aac740 1 --2- 172.21.15.5:0/3408227551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ecdb3891b0 0x55ecdb72a180 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f99700127a0 tx=0x7f9970009500 comp rx=0 tx=0).stop 2024-08-31T05:40:13.441 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.435+0000 7f9986aac740 1 -- 172.21.15.5:0/3408227551 shutdown_connections 2024-08-31T05:40:13.441 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.435+0000 7f9986aac740 1 --2- 172.21.15.5:0/3408227551 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ecdb3891b0 0x55ecdb72a180 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:13.441 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.435+0000 7f9986aac740 1 --2- 172.21.15.5:0/3408227551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ecdb3684d0 0x55ecdb73b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:13.441 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.435+0000 7f9986aac740 1 --2- 172.21.15.5:0/3408227551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ecdb3602f0 0x55ecdb73b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:13.441 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.435+0000 7f9986aac740 1 -- 172.21.15.5:0/3408227551 >> 172.21.15.5:0/3408227551 conn(0x55ecdb37d300 msgr2=0x55ecdb737bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:13.441 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.435+0000 7f9986aac740 1 -- 172.21.15.5:0/3408227551 shutdown_connections 2024-08-31T05:40:13.442 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.435+0000 7f9986aac740 1 -- 172.21.15.5:0/3408227551 wait complete. 2024-08-31T05:40:13.442 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.435+0000 7f9986aac740 1 -- start start 2024-08-31T05:40:13.442 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.435+0000 7f9986aac740 1 Processor -- start 2024-08-31T05:40:13.442 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.436+0000 7f9986aac740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ecdb3602f0 0x55ecdb752490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:13.442 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.436+0000 7f9986aac740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ecdb3684d0 0x55ecdb74f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:13.442 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.436+0000 7f9986aac740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ecdb3891b0 0x55ecdb74fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:13.442 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.436+0000 7f9986aac740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f99781b0050 con 0x55ecdb3602f0 2024-08-31T05:40:13.442 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.436+0000 7f9986aac740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f99781af980 con 0x55ecdb3684d0 2024-08-31T05:40:13.442 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.436+0000 7f9986aac740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f99781acbe0 con 0x55ecdb3891b0 2024-08-31T05:40:13.442 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.436+0000 7f9986aac740 10 client.0 _ll_register_callbacks cb 0x7f9970009900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:40:13.443 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.436+0000 7f997d8d5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ecdb3602f0 0x55ecdb752490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:13.443 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.436+0000 7f997d8d5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ecdb3602f0 0x55ecdb752490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42996/0 (socket says 172.21.15.5:42996) 2024-08-31T05:40:13.443 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.436+0000 7f997d8d5640 1 -- 172.21.15.5:0/3120861123 learned_addr learned my addr 172.21.15.5:0/3120861123 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:13.443 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.436+0000 7f997e0d6640 1 --2- 172.21.15.5:0/3120861123 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ecdb3891b0 0x55ecdb74fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:13.443 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.436+0000 7f997d0d4640 1 --2- 172.21.15.5:0/3120861123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ecdb3684d0 0x55ecdb74f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:13.443 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.436+0000 7f997d8d5640 1 -- 172.21.15.5:0/3120861123 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ecdb3891b0 msgr2=0x55ecdb74fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:13.443 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.436+0000 7f997d8d5640 1 --2- 172.21.15.5:0/3120861123 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ecdb3891b0 0x55ecdb74fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:13.443 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.436+0000 7f997d8d5640 1 -- 172.21.15.5:0/3120861123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ecdb3684d0 msgr2=0x55ecdb74f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:13.443 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.436+0000 7f997d8d5640 1 --2- 172.21.15.5:0/3120861123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ecdb3684d0 0x55ecdb74f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:13.443 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.436+0000 7f997d8d5640 1 -- 172.21.15.5:0/3120861123 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecdb7505d0 con 0x55ecdb3602f0 2024-08-31T05:40:13.443 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.436+0000 7f997d8d5640 1 --2- 172.21.15.5:0/3120861123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ecdb3602f0 0x55ecdb752490 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f99740ef250 tx=0x7f99740057e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66805e89517f6ee server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:13.443 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.436+0000 7f99617fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:40:13.443 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.437+0000 7f99617fa640 1 -- 172.21.15.5:0/3120861123 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9974035040 con 0x55ecdb3602f0 2024-08-31T05:40:13.443 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.437+0000 7f99617fa640 1 -- 172.21.15.5:0/3120861123 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7f99740cc520 con 0x55ecdb3602f0 2024-08-31T05:40:13.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.437+0000 7f9986aac740 1 -- 172.21.15.5:0/3120861123 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9970003e20 con 0x55ecdb3602f0 2024-08-31T05:40:13.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.437+0000 7f99617fa640 1 -- 172.21.15.5:0/3120861123 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f99740cc2c0 con 0x55ecdb3602f0 2024-08-31T05:40:13.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.437+0000 7f9986aac740 10 client.18273 fetch_fsmap learned FSMap version 34 2024-08-31T05:40:13.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.437+0000 7f9986aac740 1 -- 172.21.15.5:0/3120861123 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55ecdb7b93a0 con 0x55ecdb3602f0 2024-08-31T05:40:13.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.437+0000 7f99617fa640 1 -- 172.21.15.5:0/3120861123 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9970003e20 con 0x55ecdb3602f0 2024-08-31T05:40:13.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.437+0000 7f99617fa640 1 -- 172.21.15.5:0/3120861123 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f99740d5150 con 0x55ecdb3602f0 2024-08-31T05:40:13.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.437+0000 7f9986aac740 10 client.18273 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:40:13.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.437+0000 7f9986aac740 10 client.18273 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:40:13.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.437+0000 7f9986aac740 20 client.18273 populate_metadata read hostname 'smithi005' 2024-08-31T05:40:13.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.437+0000 7f9986aac740 1 --2- 172.21.15.5:0/3120861123 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55ecdb31d1c0 0x55ecdb7bbb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:13.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.437+0000 7f9986aac740 4 client.18273 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:40:13.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.437+0000 7f9986aac740 1 -- 172.21.15.5:0/3120861123 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ecdb69f9f0 con 0x55ecdb31d1c0 2024-08-31T05:40:13.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.437+0000 7f997d0d4640 1 --2- 172.21.15.5:0/3120861123 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55ecdb31d1c0 0x55ecdb7bbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:13.445 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.438+0000 7f99617fa640 10 client.18273 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:40:13.445 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.438+0000 7f997d0d4640 1 --2- 172.21.15.5:0/3120861123 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55ecdb31d1c0 0x55ecdb7bbb40 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c43459ef812ae77a server_cookie=e7a209e7dfec1326 in_seq=0 out_seq=0 2024-08-31T05:40:13.453 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.451+0000 7f99617fa640 1 -- 172.21.15.5:0/3120861123 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ecdb69f9f0 con 0x55ecdb31d1c0 2024-08-31T05:40:13.453 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.451+0000 7f99617fa640 10 client.18273 handle_command_reply: tid=0 2024-08-31T05:40:13.453 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.451+0000 7f9986aac740 1 client.18273 shutdown 2024-08-31T05:40:13.454 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.451+0000 7f9986aac740 1 -- 172.21.15.5:0/3120861123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ecdb3602f0 msgr2=0x55ecdb752490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:13.454 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.451+0000 7f9986aac740 1 --2- 172.21.15.5:0/3120861123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ecdb3602f0 0x55ecdb752490 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f99740ef250 tx=0x7f99740057e0 comp rx=0 tx=0).stop 2024-08-31T05:40:13.454 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.451+0000 7f9986aac740 1 -- 172.21.15.5:0/3120861123 shutdown_connections 2024-08-31T05:40:13.454 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.451+0000 7f9986aac740 1 --2- 172.21.15.5:0/3120861123 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55ecdb31d1c0 0x55ecdb7bbb40 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:13.454 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.451+0000 7f9986aac740 1 --2- 172.21.15.5:0/3120861123 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ecdb3891b0 0x55ecdb74fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:13.454 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.451+0000 7f99617fa640 0 client.18273 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:40:13.454 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.451+0000 7f9986aac740 1 --2- 172.21.15.5:0/3120861123 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ecdb3684d0 0x55ecdb74f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:13.454 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.451+0000 7f9986aac740 1 --2- 172.21.15.5:0/3120861123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ecdb3602f0 0x55ecdb752490 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:13.454 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.451+0000 7f9986aac740 1 -- 172.21.15.5:0/3120861123 >> 172.21.15.5:0/3120861123 conn(0x55ecdb37d300 msgr2=0x55ecdb72db20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:13.454 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.451+0000 7f9986aac740 1 -- 172.21.15.5:0/3120861123 shutdown_connections 2024-08-31T05:40:13.454 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.451+0000 7f9986aac740 1 -- 172.21.15.5:0/3120861123 wait complete. 2024-08-31T05:40:13.455 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.451+0000 7f9986aac740 20 client.18273 trim_cache size 0 max 16384 2024-08-31T05:40:13.455 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:40:13.455 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:40:13.455 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:40:13.455 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:40:13.456 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.452+0000 7f997fb39640 1 -- 172.21.15.5:0/1769699638 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f99640b4ca0 msgr2=0x7f99640b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:13.456 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.452+0000 7f997fb39640 1 --2- 172.21.15.5:0/1769699638 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f99640b4ca0 0x7f99640b71b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f99680095f0 tx=0x7f9968005f90 comp rx=0 tx=0).stop 2024-08-31T05:40:13.456 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.452+0000 7f997fb39640 1 -- 172.21.15.5:0/1769699638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99781027b0 msgr2=0x7f997819a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:13.457 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.452+0000 7f997fb39640 1 --2- 172.21.15.5:0/1769699638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99781027b0 0x7f997819a290 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f9974005940 tx=0x7f99740040c0 comp rx=0 tx=0).stop 2024-08-31T05:40:13.457 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.452+0000 7f997fb39640 1 -- 172.21.15.5:0/1769699638 shutdown_connections 2024-08-31T05:40:13.457 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.452+0000 7f997fb39640 1 --2- 172.21.15.5:0/1769699638 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f99640b4ca0 0x7f99640b71b0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:13.457 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.452+0000 7f997fb39640 1 --2- 172.21.15.5:0/1769699638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9978108a30 0x7f997819fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:13.457 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.452+0000 7f997fb39640 1 --2- 172.21.15.5:0/1769699638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99781080e0 0x7f997819a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:13.457 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.452+0000 7f997fb39640 1 --2- 172.21.15.5:0/1769699638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99781027b0 0x7f997819a290 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:13.457 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.452+0000 7f997fb39640 1 -- 172.21.15.5:0/1769699638 >> 172.21.15.5:0/1769699638 conn(0x7f9978078450 msgr2=0x7f997806bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:13.457 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.452+0000 7f997fb39640 1 -- 172.21.15.5:0/1769699638 shutdown_connections 2024-08-31T05:40:13.457 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:13.452+0000 7f997fb39640 1 -- 172.21.15.5:0/1769699638 wait complete. 2024-08-31T05:40:13.586 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:40:13.935 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1154453 10.99 MB/sec execute 421 sec latency 27.284 ms 2024-08-31T05:40:14.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.325+0000 7f2d1a881640 1 -- 172.21.15.5:0/2855485028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d141023f0 msgr2=0x7f2d14102800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:14.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.325+0000 7f2d1a881640 1 --2- 172.21.15.5:0/2855485028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d141023f0 0x7f2d14102800 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f2d04009900 tx=0x7f2d0402a480 comp rx=0 tx=0).stop 2024-08-31T05:40:14.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.325+0000 7f2d1a881640 1 -- 172.21.15.5:0/2855485028 shutdown_connections 2024-08-31T05:40:14.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.325+0000 7f2d1a881640 1 --2- 172.21.15.5:0/2855485028 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d1410ffa0 0x7f2d141123c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:14.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.325+0000 7f2d1a881640 1 --2- 172.21.15.5:0/2855485028 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d14102d40 0x7f2d1410fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:14.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.325+0000 7f2d1a881640 1 --2- 172.21.15.5:0/2855485028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d141023f0 0x7f2d14102800 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:14.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.325+0000 7f2d1a881640 1 -- 172.21.15.5:0/2855485028 >> 172.21.15.5:0/2855485028 conn(0x7f2d140794d0 msgr2=0x7f2d140798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:14.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.325+0000 7f2d1a881640 1 -- 172.21.15.5:0/2855485028 shutdown_connections 2024-08-31T05:40:14.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.325+0000 7f2d1a881640 1 -- 172.21.15.5:0/2855485028 wait complete. 2024-08-31T05:40:14.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.326+0000 7f2d1a881640 1 Processor -- start 2024-08-31T05:40:14.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.326+0000 7f2d1a881640 1 -- start start 2024-08-31T05:40:14.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.326+0000 7f2d1a881640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d141023f0 0x7f2d1419c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:14.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.326+0000 7f2d1a881640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d14102d40 0x7f2d1419c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:14.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.326+0000 7f2d1a881640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d1410ffa0 0x7f2d141a1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:14.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.326+0000 7f2d1a881640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2d14115a10 con 0x7f2d141023f0 2024-08-31T05:40:14.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.326+0000 7f2d1a881640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2d14115890 con 0x7f2d1410ffa0 2024-08-31T05:40:14.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.326+0000 7f2d1a881640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2d14115b90 con 0x7f2d14102d40 2024-08-31T05:40:14.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.326+0000 7f2d13fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d141023f0 0x7f2d1419c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:14.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.326+0000 7f2d13fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d141023f0 0x7f2d1419c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43020/0 (socket says 172.21.15.5:43020) 2024-08-31T05:40:14.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.326+0000 7f2d13fff640 1 -- 172.21.15.5:0/105184309 learned_addr learned my addr 172.21.15.5:0/105184309 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:14.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.326+0000 7f2d0bfff640 1 --2- 172.21.15.5:0/105184309 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d14102d40 0x7f2d1419c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:14.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.327+0000 7f2d18e1e640 1 --2- 172.21.15.5:0/105184309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d1410ffa0 0x7f2d141a1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:14.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.327+0000 7f2d13fff640 1 -- 172.21.15.5:0/105184309 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d14102d40 msgr2=0x7f2d1419c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:14.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.327+0000 7f2d13fff640 1 --2- 172.21.15.5:0/105184309 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d14102d40 0x7f2d1419c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:14.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.327+0000 7f2d13fff640 1 -- 172.21.15.5:0/105184309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d1410ffa0 msgr2=0x7f2d141a1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:14.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.327+0000 7f2d13fff640 1 --2- 172.21.15.5:0/105184309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d1410ffa0 0x7f2d141a1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:14.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.327+0000 7f2d13fff640 1 -- 172.21.15.5:0/105184309 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d141a2350 con 0x7f2d141023f0 2024-08-31T05:40:14.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.327+0000 7f2d13fff640 1 --2- 172.21.15.5:0/105184309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d141023f0 0x7f2d1419c3e0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f2d04005940 tx=0x7f2d04004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:14.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.327+0000 7f2d11ffb640 1 -- 172.21.15.5:0/105184309 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0403f030 con 0x7f2d141023f0 2024-08-31T05:40:14.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.327+0000 7f2d11ffb640 1 -- 172.21.15.5:0/105184309 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d04003aa0 con 0x7f2d141023f0 2024-08-31T05:40:14.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.327+0000 7f2d1a881640 1 -- 172.21.15.5:0/105184309 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d141a25e0 con 0x7f2d141023f0 2024-08-31T05:40:14.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.327+0000 7f2d11ffb640 1 -- 172.21.15.5:0/105184309 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d04035070 con 0x7f2d141023f0 2024-08-31T05:40:14.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.327+0000 7f2d1a881640 1 -- 172.21.15.5:0/105184309 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d141a8da0 con 0x7f2d141023f0 2024-08-31T05:40:14.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.330+0000 7f2d20df6740 1 Processor -- start 2024-08-31T05:40:14.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.330+0000 7f2d20df6740 1 -- start start 2024-08-31T05:40:14.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.330+0000 7f2d11ffb640 1 -- 172.21.15.5:0/105184309 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f2d04042030 con 0x7f2d141023f0 2024-08-31T05:40:14.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.330+0000 7f2d20df6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f38826b070 0x55f388610310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:14.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.330+0000 7f2d20df6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f3882421b0 0x55f388610850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:14.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.330+0000 7f2d20df6740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f38824a390 0x55f388610d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:14.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.330+0000 7f2d20df6740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f388587680 con 0x55f38824a390 2024-08-31T05:40:14.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.330+0000 7f2d20df6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f388576c10 con 0x55f3882421b0 2024-08-31T05:40:14.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.330+0000 7f2d20df6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f38857abc0 con 0x55f38826b070 2024-08-31T05:40:14.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.331+0000 7f2d18e1e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f38826b070 0x55f388610310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:14.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.331+0000 7f2d0bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f38824a390 0x55f388610d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:14.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.331+0000 7f2d18e1e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f38826b070 0x55f388610310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:53228/0 (socket says 172.21.15.5:53228) 2024-08-31T05:40:14.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.331+0000 7f2d18e1e640 1 -- 172.21.15.5:0/3914283862 learned_addr learned my addr 172.21.15.5:0/3914283862 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:14.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.331+0000 7f2d13fff640 1 --2- 172.21.15.5:0/3914283862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f3882421b0 0x55f388610850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:14.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.331+0000 7f2d18e1e640 1 -- 172.21.15.5:0/3914283862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f3882421b0 msgr2=0x55f388610850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:14.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.331+0000 7f2d18e1e640 1 --2- 172.21.15.5:0/3914283862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f3882421b0 0x55f388610850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:14.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.331+0000 7f2d18e1e640 1 -- 172.21.15.5:0/3914283862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f38824a390 msgr2=0x55f388610d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:14.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.331+0000 7f2d18e1e640 1 --2- 172.21.15.5:0/3914283862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f38824a390 0x55f388610d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:14.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.331+0000 7f2d18e1e640 1 -- 172.21.15.5:0/3914283862 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3882d6650 con 0x55f38826b070 2024-08-31T05:40:14.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.331+0000 7f2d11ffb640 1 --2- 172.21.15.5:0/105184309 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2d000b4ca0 0x7f2d000b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:14.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.331+0000 7f2d18e1e640 1 --2- 172.21.15.5:0/3914283862 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f38826b070 0x55f388610310 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c009f50 tx=0x7f2d0c0118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aafaeb2052dc13d2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:14.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.331+0000 7f2d13fff640 1 --2- 172.21.15.5:0/105184309 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2d000b4ca0 0x7f2d000b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:14.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.331+0000 7f2d11ffb640 1 -- 172.21.15.5:0/105184309 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7f2d04105db0 con 0x7f2d141023f0 2024-08-31T05:40:14.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.331+0000 7f2d0a7fc640 1 -- 172.21.15.5:0/3914283862 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c004d20 con 0x55f38826b070 2024-08-31T05:40:14.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.332+0000 7f2d0a7fc640 1 -- 172.21.15.5:0/3914283862 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d0c004050 con 0x55f38826b070 2024-08-31T05:40:14.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.332+0000 7f2d0a7fc640 1 -- 172.21.15.5:0/3914283862 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c005280 con 0x55f38826b070 2024-08-31T05:40:14.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.332+0000 7f2d20df6740 1 -- 172.21.15.5:0/3914283862 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f38826b070 msgr2=0x55f388610310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:14.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.332+0000 7f2d20df6740 1 --2- 172.21.15.5:0/3914283862 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f38826b070 0x55f388610310 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c009f50 tx=0x7f2d0c0118d0 comp rx=0 tx=0).stop 2024-08-31T05:40:14.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.332+0000 7f2d13fff640 1 --2- 172.21.15.5:0/105184309 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2d000b4ca0 0x7f2d000b71b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2d041031d0 tx=0x7f2d04109b10 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:14.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.332+0000 7f2d20df6740 1 -- 172.21.15.5:0/3914283862 shutdown_connections 2024-08-31T05:40:14.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.332+0000 7f2d20df6740 1 --2- 172.21.15.5:0/3914283862 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f38824a390 0x55f388610d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:14.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.332+0000 7f2d20df6740 1 --2- 172.21.15.5:0/3914283862 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f3882421b0 0x55f388610850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:14.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.332+0000 7f2d20df6740 1 --2- 172.21.15.5:0/3914283862 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f38826b070 0x55f388610310 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:14.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.332+0000 7f2d20df6740 1 -- 172.21.15.5:0/3914283862 >> 172.21.15.5:0/3914283862 conn(0x55f38825f460 msgr2=0x55f38860e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:14.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.333+0000 7f2d20df6740 1 -- 172.21.15.5:0/3914283862 shutdown_connections 2024-08-31T05:40:14.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.333+0000 7f2d20df6740 1 -- 172.21.15.5:0/3914283862 wait complete. 2024-08-31T05:40:14.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.333+0000 7f2d20df6740 1 -- start start 2024-08-31T05:40:14.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.333+0000 7f2d20df6740 1 Processor -- start 2024-08-31T05:40:14.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.333+0000 7f2d20df6740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3882421b0 0x55f38861bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:14.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.333+0000 7f2d20df6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f38824a390 0x55f38861bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:14.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.333+0000 7f2d20df6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f38826b070 0x55f388627de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:14.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.334+0000 7f2d20df6740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f3883d9700 con 0x55f3882421b0 2024-08-31T05:40:14.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.334+0000 7f2d20df6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f3884fd750 con 0x55f38824a390 2024-08-31T05:40:14.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.334+0000 7f2d20df6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f38861eaf0 con 0x55f38826b070 2024-08-31T05:40:14.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.334+0000 7f2d18e1e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3882421b0 0x55f38861bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:14.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.334+0000 7f2d20df6740 10 client.0 _ll_register_callbacks cb 0x55f38852ce10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:40:14.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.334+0000 7f2d18e1e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3882421b0 0x55f38861bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43046/0 (socket says 172.21.15.5:43046) 2024-08-31T05:40:14.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.334+0000 7f2d18e1e640 1 -- 172.21.15.5:0/3001474411 learned_addr learned my addr 172.21.15.5:0/3001474411 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:14.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.334+0000 7f2d18e1e640 1 --2- 172.21.15.5:0/3001474411 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f38826b070 0x55f388627de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:14.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.334+0000 7f2d0bfff640 1 --2- 172.21.15.5:0/3001474411 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f38824a390 0x55f38861bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:14.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.334+0000 7f2d18e1e640 1 -- 172.21.15.5:0/3001474411 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f38826b070 msgr2=0x55f388627de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:14.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.334+0000 7f2d18e1e640 1 --2- 172.21.15.5:0/3001474411 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f38826b070 0x55f388627de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:14.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.334+0000 7f2d18e1e640 1 -- 172.21.15.5:0/3001474411 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f38824a390 msgr2=0x55f38861bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:14.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.334+0000 7f2d18e1e640 1 --2- 172.21.15.5:0/3001474411 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f38824a390 0x55f38861bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:14.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.334+0000 7f2d18e1e640 1 -- 172.21.15.5:0/3001474411 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f388536900 con 0x55f3882421b0 2024-08-31T05:40:14.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.334+0000 7f2d18e1e640 1 --2- 172.21.15.5:0/3001474411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3882421b0 0x55f38861bab0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c003fd0 tx=0x7f2d0c005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b433a56c84ac65c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:14.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.334+0000 7f2cf37fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:40:14.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.334+0000 7f2cf37fe640 1 -- 172.21.15.5:0/3001474411 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c02c020 con 0x55f3882421b0 2024-08-31T05:40:14.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.334+0000 7f2cf37fe640 1 -- 172.21.15.5:0/3001474411 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7f2d0c004c00 con 0x55f3882421b0 2024-08-31T05:40:14.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.334+0000 7f2d20df6740 1 -- 172.21.15.5:0/3001474411 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d0c004050 con 0x55f3882421b0 2024-08-31T05:40:14.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.335+0000 7f2cf37fe640 1 -- 172.21.15.5:0/3001474411 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f2d0c028450 con 0x55f3882421b0 2024-08-31T05:40:14.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.335+0000 7f2d20df6740 10 client.18285 fetch_fsmap learned FSMap version 34 2024-08-31T05:40:14.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.335+0000 7f2d20df6740 1 -- 172.21.15.5:0/3001474411 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55f38862a8f0 con 0x55f3882421b0 2024-08-31T05:40:14.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.335+0000 7f2cf37fe640 1 -- 172.21.15.5:0/3001474411 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d0c004050 con 0x55f3882421b0 2024-08-31T05:40:14.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.335+0000 7f2cf37fe640 1 -- 172.21.15.5:0/3001474411 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f2d0c027560 con 0x55f3882421b0 2024-08-31T05:40:14.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.335+0000 7f2d20df6740 10 client.18285 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:40:14.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.335+0000 7f2d20df6740 10 client.18285 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-31T05:40:14.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.335+0000 7f2d20df6740 20 client.18285 populate_metadata read hostname 'smithi005' 2024-08-31T05:40:14.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.335+0000 7f2d20df6740 1 --2- 172.21.15.5:0/3001474411 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55f3882299f0 0x55f38862dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:14.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.335+0000 7f2d20df6740 4 client.18285 mds_command: new command op to 24602 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:40:14.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.335+0000 7f2d20df6740 1 -- 172.21.15.5:0/3001474411 --> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f3885895d0 con 0x55f3882299f0 2024-08-31T05:40:14.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.335+0000 7f2d0bfff640 1 --2- 172.21.15.5:0/3001474411 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55f3882299f0 0x55f38862dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:14.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.336+0000 7f2cf37fe640 10 client.18285 ms_handle_connect on v2:172.21.15.50:6836/428759669 2024-08-31T05:40:14.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.336+0000 7f2d0bfff640 1 --2- 172.21.15.5:0/3001474411 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55f3882299f0 0x55f38862dc50 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=bcd85b19cd2b726a server_cookie=d73687ad9d346de5 in_seq=0 out_seq=0 2024-08-31T05:40:14.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.336+0000 7f2cf37fe640 1 -- 172.21.15.5:0/3001474411 <== mds.4 v2:172.21.15.50:6836/428759669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f3885895d0 con 0x55f3882299f0 2024-08-31T05:40:14.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.336+0000 7f2cf37fe640 10 client.18285 handle_command_reply: tid=0 2024-08-31T05:40:14.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.337+0000 7f2d20df6740 1 client.18285 shutdown 2024-08-31T05:40:14.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.337+0000 7f2d20df6740 1 -- 172.21.15.5:0/3001474411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3882421b0 msgr2=0x55f38861bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:14.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.337+0000 7f2d20df6740 1 --2- 172.21.15.5:0/3001474411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3882421b0 0x55f38861bab0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c003fd0 tx=0x7f2d0c005bd0 comp rx=0 tx=0).stop 2024-08-31T05:40:14.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.337+0000 7f2d20df6740 1 -- 172.21.15.5:0/3001474411 shutdown_connections 2024-08-31T05:40:14.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.337+0000 7f2d20df6740 1 --2- 172.21.15.5:0/3001474411 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55f3882299f0 0x55f38862dc50 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:14.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.337+0000 7f2d20df6740 1 --2- 172.21.15.5:0/3001474411 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f38826b070 0x55f388627de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:14.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.337+0000 7f2d20df6740 1 --2- 172.21.15.5:0/3001474411 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f38824a390 0x55f38861bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:14.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.337+0000 7f2d20df6740 1 --2- 172.21.15.5:0/3001474411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3882421b0 0x55f38861bab0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:14.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.337+0000 7f2d20df6740 1 -- 172.21.15.5:0/3001474411 >> 172.21.15.5:0/3001474411 conn(0x55f38825f460 msgr2=0x55f3886134a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:14.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.337+0000 7f2cf37fe640 0 client.18285 ms_handle_reset on v2:172.21.15.50:6836/428759669 2024-08-31T05:40:14.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.337+0000 7f2d20df6740 1 -- 172.21.15.5:0/3001474411 shutdown_connections 2024-08-31T05:40:14.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.337+0000 7f2d20df6740 1 -- 172.21.15.5:0/3001474411 wait complete. 2024-08-31T05:40:14.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.337+0000 7f2d20df6740 20 client.18285 trim_cache size 0 max 16384 2024-08-31T05:40:14.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.351+0000 7f2d20df6740 1 Processor -- start 2024-08-31T05:40:14.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.351+0000 7f2d20df6740 1 -- start start 2024-08-31T05:40:14.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.351+0000 7f2d20df6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3882421b0 0x55f388613410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:14.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.351+0000 7f2d20df6740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f38824a390 0x55f388613950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:14.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.351+0000 7f2d20df6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f38826b070 0x55f388618ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:14.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.351+0000 7f2d20df6740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2d141b2f40 con 0x55f38824a390 2024-08-31T05:40:14.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.351+0000 7f2d20df6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2d141b4a80 con 0x55f38826b070 2024-08-31T05:40:14.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.351+0000 7f2d20df6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2d141b3610 con 0x55f3882421b0 2024-08-31T05:40:14.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.351+0000 7f2d0bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f38824a390 0x55f388613950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:14.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.351+0000 7f2d0bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f38824a390 0x55f388613950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43062/0 (socket says 172.21.15.5:43062) 2024-08-31T05:40:14.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.351+0000 7f2d0bfff640 1 -- 172.21.15.5:0/154928153 learned_addr learned my addr 172.21.15.5:0/154928153 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:14.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.351+0000 7f2d18e1e640 1 --2- 172.21.15.5:0/154928153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3882421b0 0x55f388613410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:14.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.352+0000 7f2d18e1e640 1 --2- 172.21.15.5:0/154928153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f38826b070 0x55f388618ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:14.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.352+0000 7f2d0bfff640 1 -- 172.21.15.5:0/154928153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3882421b0 msgr2=0x55f388613410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:14.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.352+0000 7f2d0bfff640 1 --2- 172.21.15.5:0/154928153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3882421b0 0x55f388613410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:14.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.352+0000 7f2d0bfff640 1 -- 172.21.15.5:0/154928153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f38826b070 msgr2=0x55f388618ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:14.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.352+0000 7f2d0bfff640 1 --2- 172.21.15.5:0/154928153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f38826b070 0x55f388618ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:14.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.352+0000 7f2d0bfff640 1 -- 172.21.15.5:0/154928153 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f388613170 con 0x55f38824a390 2024-08-31T05:40:14.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.352+0000 7f2d18e1e640 1 --2- 172.21.15.5:0/154928153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3882421b0 0x55f388613410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:40:14.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.352+0000 7f2d0bfff640 1 --2- 172.21.15.5:0/154928153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f38824a390 0x55f388613950 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f2d14103db0 tx=0x7f2cfc00b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aac2c45d06f086f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:14.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.352+0000 7f2d09ffb640 1 -- 172.21.15.5:0/154928153 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc004220 con 0x55f38824a390 2024-08-31T05:40:14.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.352+0000 7f2d09ffb640 1 -- 172.21.15.5:0/154928153 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2cfc0043c0 con 0x55f38824a390 2024-08-31T05:40:14.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.352+0000 7f2d09ffb640 1 -- 172.21.15.5:0/154928153 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc0035f0 con 0x55f38824a390 2024-08-31T05:40:14.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.353+0000 7f2d20df6740 1 -- 172.21.15.5:0/154928153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f38824a390 msgr2=0x55f388613950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:14.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.353+0000 7f2d20df6740 1 --2- 172.21.15.5:0/154928153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f38824a390 0x55f388613950 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f2d14103db0 tx=0x7f2cfc00b410 comp rx=0 tx=0).stop 2024-08-31T05:40:14.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.353+0000 7f2d20df6740 1 -- 172.21.15.5:0/154928153 shutdown_connections 2024-08-31T05:40:14.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.353+0000 7f2d20df6740 1 --2- 172.21.15.5:0/154928153 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f38826b070 0x55f388618ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:14.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.353+0000 7f2d20df6740 1 --2- 172.21.15.5:0/154928153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f38824a390 0x55f388613950 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:14.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.353+0000 7f2d20df6740 1 --2- 172.21.15.5:0/154928153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3882421b0 0x55f388613410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:14.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.353+0000 7f2d20df6740 1 -- 172.21.15.5:0/154928153 >> 172.21.15.5:0/154928153 conn(0x55f38825f460 msgr2=0x55f38861a330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:14.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.353+0000 7f2d20df6740 1 -- 172.21.15.5:0/154928153 shutdown_connections 2024-08-31T05:40:14.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.353+0000 7f2d20df6740 1 -- 172.21.15.5:0/154928153 wait complete. 2024-08-31T05:40:14.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.354+0000 7f2d20df6740 1 -- start start 2024-08-31T05:40:14.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.354+0000 7f2d20df6740 1 Processor -- start 2024-08-31T05:40:14.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.354+0000 7f2d20df6740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3882421b0 0x55f38861fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:14.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.354+0000 7f2d20df6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f38824a390 0x55f3886202d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:14.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.354+0000 7f2d20df6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f38826b070 0x55f388620810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:14.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.354+0000 7f2d20df6740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2d141b43b0 con 0x55f3882421b0 2024-08-31T05:40:14.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.354+0000 7f2d20df6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2d141b3ce0 con 0x55f38824a390 2024-08-31T05:40:14.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.354+0000 7f2d20df6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2d141b0f40 con 0x55f38826b070 2024-08-31T05:40:14.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.354+0000 7f2d20df6740 10 client.0 _ll_register_callbacks cb 0x7f2cfc00b810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:40:14.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.355+0000 7f2d18e1e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3882421b0 0x55f38861fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:14.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.355+0000 7f2d18e1e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3882421b0 0x55f38861fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43070/0 (socket says 172.21.15.5:43070) 2024-08-31T05:40:14.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.355+0000 7f2d18e1e640 1 -- 172.21.15.5:0/877447178 learned_addr learned my addr 172.21.15.5:0/877447178 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:14.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.355+0000 7f2d0bfff640 1 --2- 172.21.15.5:0/877447178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f38824a390 0x55f3886202d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:14.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.355+0000 7f2d18e1e640 1 --2- 172.21.15.5:0/877447178 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f38826b070 0x55f388620810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:14.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.355+0000 7f2d0bfff640 1 -- 172.21.15.5:0/877447178 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f38826b070 msgr2=0x55f388620810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:14.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.355+0000 7f2d0bfff640 1 --2- 172.21.15.5:0/877447178 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f38826b070 0x55f388620810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:14.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.355+0000 7f2d0bfff640 1 -- 172.21.15.5:0/877447178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3882421b0 msgr2=0x55f38861fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:14.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.355+0000 7f2d0bfff640 1 --2- 172.21.15.5:0/877447178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3882421b0 0x55f38861fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:14.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.355+0000 7f2d0bfff640 1 -- 172.21.15.5:0/877447178 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f388612a40 con 0x55f38824a390 2024-08-31T05:40:14.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.355+0000 7f2d18e1e640 1 --2- 172.21.15.5:0/877447178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3882421b0 0x55f38861fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:40:14.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.355+0000 7f2d0bfff640 1 --2- 172.21.15.5:0/877447178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f38824a390 0x55f3886202d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc005940 tx=0x7f2cfc004e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9d0228617d84eb4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:14.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.355+0000 7f2cf37fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:40:14.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.355+0000 7f2cf37fe640 1 -- 172.21.15.5:0/877447178 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc028040 con 0x55f38824a390 2024-08-31T05:40:14.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.355+0000 7f2cf37fe640 1 -- 172.21.15.5:0/877447178 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7f2cfc0047b0 con 0x55f38824a390 2024-08-31T05:40:14.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.355+0000 7f2d20df6740 1 -- 172.21.15.5:0/877447178 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2cfc0043c0 con 0x55f38824a390 2024-08-31T05:40:14.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.356+0000 7f2cf37fe640 1 -- 172.21.15.5:0/877447178 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f2cfc039050 con 0x55f38824a390 2024-08-31T05:40:14.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.356+0000 7f2d20df6740 10 client.27863 fetch_fsmap learned FSMap version 34 2024-08-31T05:40:14.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.356+0000 7f2d20df6740 1 -- 172.21.15.5:0/877447178 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55f388698580 con 0x55f38824a390 2024-08-31T05:40:14.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.356+0000 7f2cf37fe640 1 -- 172.21.15.5:0/877447178 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2cfc0043c0 con 0x55f38824a390 2024-08-31T05:40:14.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.356+0000 7f2cf37fe640 1 -- 172.21.15.5:0/877447178 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f2cfc02b070 con 0x55f38824a390 2024-08-31T05:40:14.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.356+0000 7f2d20df6740 10 client.27863 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:40:14.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.356+0000 7f2d20df6740 10 client.27863 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-31T05:40:14.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.356+0000 7f2d20df6740 20 client.27863 populate_metadata read hostname 'smithi005' 2024-08-31T05:40:14.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.356+0000 7f2d20df6740 1 --2- 172.21.15.5:0/877447178 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55f3881feda0 0x55f38869abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:14.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.356+0000 7f2d20df6740 4 client.27863 mds_command: new command op to 24602 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:40:14.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.356+0000 7f2d20df6740 1 -- 172.21.15.5:0/877447178 --> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f388585070 con 0x55f3881feda0 2024-08-31T05:40:14.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.356+0000 7f2d18e1e640 1 --2- 172.21.15.5:0/877447178 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55f3881feda0 0x55f38869abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:14.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.357+0000 7f2cf37fe640 10 client.27863 ms_handle_connect on v2:172.21.15.50:6836/428759669 2024-08-31T05:40:14.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.357+0000 7f2d18e1e640 1 --2- 172.21.15.5:0/877447178 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55f3881feda0 0x55f38869abf0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=75cacf4b54b54f65 server_cookie=e39c2ca2b5ffca14 in_seq=0 out_seq=0 2024-08-31T05:40:14.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.357+0000 7f2cf37fe640 1 -- 172.21.15.5:0/877447178 <== mds.4 v2:172.21.15.50:6836/428759669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f388585070 con 0x55f3881feda0 2024-08-31T05:40:14.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.357+0000 7f2cf37fe640 10 client.27863 handle_command_reply: tid=0 2024-08-31T05:40:14.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.357+0000 7f2d20df6740 1 client.27863 shutdown 2024-08-31T05:40:14.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.357+0000 7f2d20df6740 1 -- 172.21.15.5:0/877447178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f38824a390 msgr2=0x55f3886202d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:14.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.357+0000 7f2d20df6740 1 --2- 172.21.15.5:0/877447178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f38824a390 0x55f3886202d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc005940 tx=0x7f2cfc004e80 comp rx=0 tx=0).stop 2024-08-31T05:40:14.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.357+0000 7f2d20df6740 1 -- 172.21.15.5:0/877447178 shutdown_connections 2024-08-31T05:40:14.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.357+0000 7f2d20df6740 1 --2- 172.21.15.5:0/877447178 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55f3881feda0 0x55f38869abf0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:14.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.357+0000 7f2d20df6740 1 --2- 172.21.15.5:0/877447178 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f38826b070 0x55f388620810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:14.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.357+0000 7f2d20df6740 1 --2- 172.21.15.5:0/877447178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f38824a390 0x55f3886202d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:14.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.357+0000 7f2cf37fe640 0 client.27863 ms_handle_reset on v2:172.21.15.50:6836/428759669 2024-08-31T05:40:14.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.357+0000 7f2d20df6740 1 --2- 172.21.15.5:0/877447178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f3882421b0 0x55f38861fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:14.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.357+0000 7f2d20df6740 1 -- 172.21.15.5:0/877447178 >> 172.21.15.5:0/877447178 conn(0x55f38825f460 msgr2=0x55f388613410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:14.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.357+0000 7f2d20df6740 1 -- 172.21.15.5:0/877447178 shutdown_connections 2024-08-31T05:40:14.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.357+0000 7f2d20df6740 1 -- 172.21.15.5:0/877447178 wait complete. 2024-08-31T05:40:14.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.357+0000 7f2d20df6740 20 client.27863 trim_cache size 0 max 16384 2024-08-31T05:40:14.373 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:40:14.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.358+0000 7f2d1a881640 1 -- 172.21.15.5:0/105184309 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2d000b4ca0 msgr2=0x7f2d000b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:14.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.358+0000 7f2d1a881640 1 --2- 172.21.15.5:0/105184309 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2d000b4ca0 0x7f2d000b71b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2d041031d0 tx=0x7f2d04109b10 comp rx=0 tx=0).stop 2024-08-31T05:40:14.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.358+0000 7f2d1a881640 1 -- 172.21.15.5:0/105184309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d141023f0 msgr2=0x7f2d1419c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:14.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.358+0000 7f2d1a881640 1 --2- 172.21.15.5:0/105184309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d141023f0 0x7f2d1419c3e0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f2d04005940 tx=0x7f2d04004270 comp rx=0 tx=0).stop 2024-08-31T05:40:14.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.358+0000 7f2d1a881640 1 -- 172.21.15.5:0/105184309 shutdown_connections 2024-08-31T05:40:14.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.358+0000 7f2d1a881640 1 --2- 172.21.15.5:0/105184309 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2d000b4ca0 0x7f2d000b71b0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:14.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.358+0000 7f2d1a881640 1 --2- 172.21.15.5:0/105184309 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d1410ffa0 0x7f2d141a1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:14.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.358+0000 7f2d1a881640 1 --2- 172.21.15.5:0/105184309 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d14102d40 0x7f2d1419c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:14.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.358+0000 7f2d1a881640 1 --2- 172.21.15.5:0/105184309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d141023f0 0x7f2d1419c3e0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:14.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.358+0000 7f2d1a881640 1 -- 172.21.15.5:0/105184309 >> 172.21.15.5:0/105184309 conn(0x7f2d140794d0 msgr2=0x7f2d14108a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:14.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.358+0000 7f2d1a881640 1 -- 172.21.15.5:0/105184309 shutdown_connections 2024-08-31T05:40:14.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:14.358+0000 7f2d1a881640 1 -- 172.21.15.5:0/105184309 wait complete. 2024-08-31T05:40:14.935 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1156024 10.98 MB/sec execute 422 sec latency 18.208 ms 2024-08-31T05:40:15.040 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:40:14 smithi005 ceph-mon[18602]: pgmap v661: 129 pgs: 129 active+clean; 578 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.8 MiB/s wr, 206 op/s 2024-08-31T05:40:15.066 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-31T05:40:15.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:40:14 smithi050 ceph-mon[22146]: pgmap v661: 129 pgs: 129 active+clean; 578 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.8 MiB/s wr, 206 op/s 2024-08-31T05:40:15.328 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:40:15.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:40:14 smithi070 ceph-mon[22316]: pgmap v661: 129 pgs: 129 active+clean; 578 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.8 MiB/s wr, 206 op/s 2024-08-31T05:40:15.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.833+0000 7fe58f4c7640 1 -- 172.21.15.5:0/1038030978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe58810ff40 msgr2=0x7fe588112360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:15.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.833+0000 7fe58f4c7640 1 --2- 172.21.15.5:0/1038030978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe58810ff40 0x7fe588112360 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fe580009ca0 tx=0x7fe58002a950 comp rx=0 tx=0).stop 2024-08-31T05:40:15.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.833+0000 7fe58f4c7640 1 -- 172.21.15.5:0/1038030978 shutdown_connections 2024-08-31T05:40:15.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.833+0000 7fe58f4c7640 1 --2- 172.21.15.5:0/1038030978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe58810ff40 0x7fe588112360 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:15.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.833+0000 7fe58f4c7640 1 --2- 172.21.15.5:0/1038030978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe588102ce0 0x7fe58810fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:15.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.833+0000 7fe58f4c7640 1 --2- 172.21.15.5:0/1038030978 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe588102390 0x7fe5881027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:15.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.833+0000 7fe58f4c7640 1 -- 172.21.15.5:0/1038030978 >> 172.21.15.5:0/1038030978 conn(0x7fe5880794e0 msgr2=0x7fe5880798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:15.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.833+0000 7fe58f4c7640 1 -- 172.21.15.5:0/1038030978 shutdown_connections 2024-08-31T05:40:15.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.833+0000 7fe58f4c7640 1 -- 172.21.15.5:0/1038030978 wait complete. 2024-08-31T05:40:15.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.833+0000 7fe58f4c7640 1 Processor -- start 2024-08-31T05:40:15.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.834+0000 7fe58f4c7640 1 -- start start 2024-08-31T05:40:15.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.834+0000 7fe58f4c7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe588102390 0x7fe58819c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:15.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.834+0000 7fe58f4c7640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe588102ce0 0x7fe58819c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:15.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.834+0000 7fe58f4c7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe58810ff40 0x7fe5881a1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:15.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.834+0000 7fe58f4c7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe588115a30 con 0x7fe588102390 2024-08-31T05:40:15.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.834+0000 7fe58f4c7640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe5881158b0 con 0x7fe588102ce0 2024-08-31T05:40:15.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.834+0000 7fe58f4c7640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe588115bb0 con 0x7fe58810ff40 2024-08-31T05:40:15.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.834+0000 7fe58d263640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe588102390 0x7fe58819c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:15.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.834+0000 7fe58d263640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe588102390 0x7fe58819c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43082/0 (socket says 172.21.15.5:43082) 2024-08-31T05:40:15.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.834+0000 7fe58d263640 1 -- 172.21.15.5:0/3523899 learned_addr learned my addr 172.21.15.5:0/3523899 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:15.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.834+0000 7fe58da64640 1 --2- 172.21.15.5:0/3523899 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe58810ff40 0x7fe5881a1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:15.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.834+0000 7fe58ca62640 1 --2- 172.21.15.5:0/3523899 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe588102ce0 0x7fe58819c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:15.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.834+0000 7fe58d263640 1 -- 172.21.15.5:0/3523899 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe58810ff40 msgr2=0x7fe5881a1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:15.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.834+0000 7fe58d263640 1 --2- 172.21.15.5:0/3523899 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe58810ff40 0x7fe5881a1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:15.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.834+0000 7fe58d263640 1 -- 172.21.15.5:0/3523899 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe588102ce0 msgr2=0x7fe58819c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:15.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.834+0000 7fe58d263640 1 --2- 172.21.15.5:0/3523899 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe588102ce0 0x7fe58819c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:15.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.834+0000 7fe58d263640 1 -- 172.21.15.5:0/3523899 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5881a2330 con 0x7fe588102390 2024-08-31T05:40:15.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.834+0000 7fe58ca62640 1 --2- 172.21.15.5:0/3523899 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe588102ce0 0x7fe58819c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:40:15.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.835+0000 7fe58d263640 1 --2- 172.21.15.5:0/3523899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe588102390 0x7fe58819c3c0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fe58400e9f0 tx=0x7fe58400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:15.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.835+0000 7fe57e7fc640 1 -- 172.21.15.5:0/3523899 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe58400cd80 con 0x7fe588102390 2024-08-31T05:40:15.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.835+0000 7fe57e7fc640 1 -- 172.21.15.5:0/3523899 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5840108e0 con 0x7fe588102390 2024-08-31T05:40:15.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.835+0000 7fe58f4c7640 1 -- 172.21.15.5:0/3523899 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5881a2620 con 0x7fe588102390 2024-08-31T05:40:15.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.835+0000 7fe57e7fc640 1 -- 172.21.15.5:0/3523899 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe584018980 con 0x7fe588102390 2024-08-31T05:40:15.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.835+0000 7fe58f4c7640 1 -- 172.21.15.5:0/3523899 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5881a8d80 con 0x7fe588102390 2024-08-31T05:40:15.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.838+0000 7fe595a3c740 1 Processor -- start 2024-08-31T05:40:15.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.838+0000 7fe595a3c740 1 -- start start 2024-08-31T05:40:15.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.838+0000 7fe595a3c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c64eb5b070 0x55c64ef00310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:15.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.838+0000 7fe595a3c740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c64eb321b0 0x55c64ef00850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:15.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.838+0000 7fe595a3c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c64eb3a390 0x55c64ef00d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:15.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.838+0000 7fe595a3c740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55c64ee77680 con 0x55c64eb321b0 2024-08-31T05:40:15.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.838+0000 7fe595a3c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55c64ee66c10 con 0x55c64eb3a390 2024-08-31T05:40:15.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.838+0000 7fe595a3c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c64ee6abc0 con 0x55c64eb5b070 2024-08-31T05:40:15.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.838+0000 7fe58da64640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c64eb5b070 0x55c64ef00310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:15.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.838+0000 7fe58ca62640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c64eb3a390 0x55c64ef00d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:15.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.838+0000 7fe58da64640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c64eb5b070 0x55c64ef00310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:53264/0 (socket says 172.21.15.5:53264) 2024-08-31T05:40:15.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.838+0000 7fe58da64640 1 -- 172.21.15.5:0/2938764276 learned_addr learned my addr 172.21.15.5:0/2938764276 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:15.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.839+0000 7fe57e7fc640 1 -- 172.21.15.5:0/3523899 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fe584010430 con 0x7fe588102390 2024-08-31T05:40:15.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.839+0000 7fe58da64640 1 -- 172.21.15.5:0/2938764276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c64eb3a390 msgr2=0x55c64ef00d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:15.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.839+0000 7fe58da64640 1 --2- 172.21.15.5:0/2938764276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c64eb3a390 0x55c64ef00d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:15.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.839+0000 7fe58da64640 1 -- 172.21.15.5:0/2938764276 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c64eb321b0 msgr2=0x55c64ef00850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:15.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.839+0000 7fe58da64640 1 --2- 172.21.15.5:0/2938764276 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c64eb321b0 0x55c64ef00850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:15.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.839+0000 7fe58da64640 1 -- 172.21.15.5:0/2938764276 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c64ebc6650 con 0x55c64eb5b070 2024-08-31T05:40:15.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.839+0000 7fe58ca62640 1 --2- 172.21.15.5:0/2938764276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c64eb3a390 0x55c64ef00d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:40:15.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.839+0000 7fe58da64640 1 --2- 172.21.15.5:0/2938764276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c64eb5b070 0x55c64ef00310 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe580035000 tx=0x7fe5800093a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac7b0b34d2501a6f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:15.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.839+0000 7fe5737fe640 1 -- 172.21.15.5:0/2938764276 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe580048070 con 0x55c64eb5b070 2024-08-31T05:40:15.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.839+0000 7fe5737fe640 1 -- 172.21.15.5:0/2938764276 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe580003e20 con 0x55c64eb5b070 2024-08-31T05:40:15.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.839+0000 7fe5737fe640 1 -- 172.21.15.5:0/2938764276 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe580034040 con 0x55c64eb5b070 2024-08-31T05:40:15.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.840+0000 7fe57e7fc640 1 --2- 172.21.15.5:0/3523899 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe5740b4d20 0x7fe5740b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:15.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.840+0000 7fe58d263640 1 --2- 172.21.15.5:0/3523899 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe5740b4d20 0x7fe5740b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:15.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.840+0000 7fe57e7fc640 1 -- 172.21.15.5:0/3523899 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7fe5840e5c80 con 0x7fe588102390 2024-08-31T05:40:15.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.840+0000 7fe595a3c740 1 -- 172.21.15.5:0/2938764276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c64eb5b070 msgr2=0x55c64ef00310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:15.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.840+0000 7fe58d263640 1 --2- 172.21.15.5:0/3523899 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe5740b4d20 0x7fe5740b7230 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x55c64eefef90 tx=0x7fe584000bc0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:15.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.840+0000 7fe595a3c740 1 --2- 172.21.15.5:0/2938764276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c64eb5b070 0x55c64ef00310 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe580035000 tx=0x7fe5800093a0 comp rx=0 tx=0).stop 2024-08-31T05:40:15.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.840+0000 7fe595a3c740 1 -- 172.21.15.5:0/2938764276 shutdown_connections 2024-08-31T05:40:15.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.840+0000 7fe595a3c740 1 --2- 172.21.15.5:0/2938764276 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c64eb3a390 0x55c64ef00d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:15.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.840+0000 7fe595a3c740 1 --2- 172.21.15.5:0/2938764276 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c64eb321b0 0x55c64ef00850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:15.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.840+0000 7fe595a3c740 1 --2- 172.21.15.5:0/2938764276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c64eb5b070 0x55c64ef00310 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:15.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.840+0000 7fe595a3c740 1 -- 172.21.15.5:0/2938764276 >> 172.21.15.5:0/2938764276 conn(0x55c64eb4f460 msgr2=0x55c64eefe200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:15.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.840+0000 7fe595a3c740 1 -- 172.21.15.5:0/2938764276 shutdown_connections 2024-08-31T05:40:15.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.841+0000 7fe595a3c740 1 -- 172.21.15.5:0/2938764276 wait complete. 2024-08-31T05:40:15.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.841+0000 7fe595a3c740 1 -- start start 2024-08-31T05:40:15.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.841+0000 7fe595a3c740 1 Processor -- start 2024-08-31T05:40:15.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.841+0000 7fe595a3c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c64eb321b0 0x55c64ef0bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:15.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.841+0000 7fe595a3c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c64eb3a390 0x55c64ef0bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:15.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.841+0000 7fe595a3c740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c64eb5b070 0x55c64ef17de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:15.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.841+0000 7fe595a3c740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55c64ecc9700 con 0x55c64eb5b070 2024-08-31T05:40:15.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.841+0000 7fe595a3c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55c64eded750 con 0x55c64eb321b0 2024-08-31T05:40:15.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.841+0000 7fe595a3c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c64ef0ea90 con 0x55c64eb3a390 2024-08-31T05:40:15.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.841+0000 7fe595a3c740 10 client.0 _ll_register_callbacks cb 0x55c64ee1ce10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:40:15.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.842+0000 7fe58ca62640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c64eb3a390 0x55c64ef0bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:15.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.842+0000 7fe58da64640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c64eb5b070 0x55c64ef17de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:15.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.842+0000 7fe58da64640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c64eb5b070 0x55c64ef17de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43108/0 (socket says 172.21.15.5:43108) 2024-08-31T05:40:15.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.842+0000 7fe58ca62640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c64eb3a390 0x55c64ef0bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:53276/0 (socket says 172.21.15.5:53276) 2024-08-31T05:40:15.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.842+0000 7fe58da64640 1 -- 172.21.15.5:0/2289604835 learned_addr learned my addr 172.21.15.5:0/2289604835 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:15.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.842+0000 7fe58da64640 1 --2- 172.21.15.5:0/2289604835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c64eb321b0 0x55c64ef0bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:15.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.842+0000 7fe58ca62640 1 -- 172.21.15.5:0/2289604835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c64eb321b0 msgr2=0x55c64ef0bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:15.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.842+0000 7fe58ca62640 1 --2- 172.21.15.5:0/2289604835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c64eb321b0 0x55c64ef0bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:15.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.842+0000 7fe58ca62640 1 -- 172.21.15.5:0/2289604835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c64eb5b070 msgr2=0x55c64ef17de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:15.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.842+0000 7fe58ca62640 1 --2- 172.21.15.5:0/2289604835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c64eb5b070 0x55c64ef17de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:15.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.842+0000 7fe58ca62640 1 -- 172.21.15.5:0/2289604835 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c64ee26900 con 0x55c64eb3a390 2024-08-31T05:40:15.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.842+0000 7fe58da64640 1 --2- 172.21.15.5:0/2289604835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c64eb5b070 0x55c64ef17de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:40:15.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.842+0000 7fe58ca62640 1 --2- 172.21.15.5:0/2289604835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c64eb3a390 0x55c64ef0bff0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe588103c80 tx=0x7fe578013b70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b5036ba9132f7bb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:15.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.842+0000 7fe570ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:40:15.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.842+0000 7fe570ff9640 1 -- 172.21.15.5:0/2289604835 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe578011dd0 con 0x55c64eb3a390 2024-08-31T05:40:15.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.842+0000 7fe570ff9640 1 -- 172.21.15.5:0/2289604835 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7fe578004030 con 0x55c64eb3a390 2024-08-31T05:40:15.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.842+0000 7fe595a3c740 1 -- 172.21.15.5:0/2289604835 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe580003e20 con 0x55c64eb3a390 2024-08-31T05:40:15.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.843+0000 7fe570ff9640 1 -- 172.21.15.5:0/2289604835 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe578025050 con 0x55c64eb3a390 2024-08-31T05:40:15.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.843+0000 7fe595a3c740 10 client.27883 fetch_fsmap learned FSMap version 34 2024-08-31T05:40:15.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.843+0000 7fe595a3c740 1 -- 172.21.15.5:0/2289604835 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55c64ef1a930 con 0x55c64eb3a390 2024-08-31T05:40:15.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.843+0000 7fe570ff9640 1 -- 172.21.15.5:0/2289604835 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe580003e20 con 0x55c64eb3a390 2024-08-31T05:40:15.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.843+0000 7fe570ff9640 1 -- 172.21.15.5:0/2289604835 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fe57800f040 con 0x55c64eb3a390 2024-08-31T05:40:15.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.843+0000 7fe595a3c740 10 client.27883 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:40:15.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.843+0000 7fe595a3c740 10 client.27883 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-31T05:40:15.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.843+0000 7fe595a3c740 20 client.27883 populate_metadata read hostname 'smithi005' 2024-08-31T05:40:15.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.843+0000 7fe595a3c740 1 --2- 172.21.15.5:0/2289604835 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x55c64eb199f0 0x55c64ef1de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:15.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.843+0000 7fe595a3c740 4 client.27883 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:40:15.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.843+0000 7fe595a3c740 1 -- 172.21.15.5:0/2289604835 --> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c64ee795d0 con 0x55c64eb199f0 2024-08-31T05:40:15.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.843+0000 7fe58da64640 1 --2- 172.21.15.5:0/2289604835 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x55c64eb199f0 0x55c64ef1de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:15.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.844+0000 7fe58da64640 1 --2- 172.21.15.5:0/2289604835 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x55c64eb199f0 0x55c64ef1de80 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=bd88c3b745b24926 server_cookie=72f13162a600f61 in_seq=0 out_seq=0 2024-08-31T05:40:15.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.844+0000 7fe570ff9640 10 client.27883 ms_handle_connect on v2:172.21.15.70:6834/2061504114 2024-08-31T05:40:15.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.844+0000 7fe570ff9640 1 -- 172.21.15.5:0/2289604835 <== mds.3 v2:172.21.15.70:6834/2061504114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c64ee795d0 con 0x55c64eb199f0 2024-08-31T05:40:15.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.844+0000 7fe570ff9640 10 client.27883 handle_command_reply: tid=0 2024-08-31T05:40:15.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.844+0000 7fe595a3c740 1 client.27883 shutdown 2024-08-31T05:40:15.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.844+0000 7fe595a3c740 1 -- 172.21.15.5:0/2289604835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c64eb3a390 msgr2=0x55c64ef0bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:15.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.844+0000 7fe595a3c740 1 --2- 172.21.15.5:0/2289604835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c64eb3a390 0x55c64ef0bff0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe588103c80 tx=0x7fe578013b70 comp rx=0 tx=0).stop 2024-08-31T05:40:15.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.845+0000 7fe595a3c740 1 -- 172.21.15.5:0/2289604835 shutdown_connections 2024-08-31T05:40:15.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.845+0000 7fe595a3c740 1 --2- 172.21.15.5:0/2289604835 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x55c64eb199f0 0x55c64ef1de80 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:15.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.845+0000 7fe595a3c740 1 --2- 172.21.15.5:0/2289604835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c64eb5b070 0x55c64ef17de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:15.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.845+0000 7fe595a3c740 1 --2- 172.21.15.5:0/2289604835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c64eb3a390 0x55c64ef0bff0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:15.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.845+0000 7fe570ff9640 0 client.27883 ms_handle_reset on v2:172.21.15.70:6834/2061504114 2024-08-31T05:40:15.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.845+0000 7fe595a3c740 1 --2- 172.21.15.5:0/2289604835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c64eb321b0 0x55c64ef0bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:15.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.845+0000 7fe595a3c740 1 -- 172.21.15.5:0/2289604835 >> 172.21.15.5:0/2289604835 conn(0x55c64eb4f460 msgr2=0x55c64ef034a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:15.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.845+0000 7fe595a3c740 1 -- 172.21.15.5:0/2289604835 shutdown_connections 2024-08-31T05:40:15.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.845+0000 7fe595a3c740 1 -- 172.21.15.5:0/2289604835 wait complete. 2024-08-31T05:40:15.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.845+0000 7fe595a3c740 20 client.27883 trim_cache size 0 max 16384 2024-08-31T05:40:15.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.858+0000 7fe595a3c740 1 Processor -- start 2024-08-31T05:40:15.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.858+0000 7fe595a3c740 1 -- start start 2024-08-31T05:40:15.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.858+0000 7fe595a3c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c64eb321b0 0x55c64ef03b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:15.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.858+0000 7fe595a3c740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c64eb3a390 0x55c64ef17ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:15.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.858+0000 7fe595a3c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c64eb5b070 0x55c64ef18220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:15.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.858+0000 7fe595a3c740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe5881b2e80 con 0x55c64eb3a390 2024-08-31T05:40:15.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.858+0000 7fe595a3c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe5881b49c0 con 0x55c64eb321b0 2024-08-31T05:40:15.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.858+0000 7fe595a3c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe5881b3550 con 0x55c64eb5b070 2024-08-31T05:40:15.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.859+0000 7fe58da64640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c64eb5b070 0x55c64ef18220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:15.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.859+0000 7fe58da64640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c64eb5b070 0x55c64ef18220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:53288/0 (socket says 172.21.15.5:53288) 2024-08-31T05:40:15.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.859+0000 7fe58ca62640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c64eb3a390 0x55c64ef17ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:15.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.859+0000 7fe58da64640 1 -- 172.21.15.5:0/3207111511 learned_addr learned my addr 172.21.15.5:0/3207111511 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:15.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.859+0000 7fe58da64640 1 --2- 172.21.15.5:0/3207111511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c64eb321b0 0x55c64ef03b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:15.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.859+0000 7fe58da64640 1 -- 172.21.15.5:0/3207111511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c64eb321b0 msgr2=0x55c64ef03b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:15.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.859+0000 7fe58da64640 1 --2- 172.21.15.5:0/3207111511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c64eb321b0 0x55c64ef03b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:15.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.859+0000 7fe58da64640 1 -- 172.21.15.5:0/3207111511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c64eb3a390 msgr2=0x55c64ef17ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:15.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.859+0000 7fe58da64640 1 --2- 172.21.15.5:0/3207111511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c64eb3a390 0x55c64ef17ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:15.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.859+0000 7fe58da64640 1 -- 172.21.15.5:0/3207111511 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c64ef03170 con 0x55c64eb5b070 2024-08-31T05:40:15.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.859+0000 7fe58ca62640 1 --2- 172.21.15.5:0/3207111511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c64eb3a390 0x55c64ef17ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:40:15.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.859+0000 7fe58da64640 1 --2- 172.21.15.5:0/3207111511 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c64eb5b070 0x55c64ef18220 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe580005cc0 tx=0x7fe580005c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff7521acc81b1b2e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:15.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.859+0000 7fe572ffd640 1 -- 172.21.15.5:0/3207111511 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe580048040 con 0x55c64eb5b070 2024-08-31T05:40:15.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.859+0000 7fe572ffd640 1 -- 172.21.15.5:0/3207111511 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe58003a8e0 con 0x55c64eb5b070 2024-08-31T05:40:15.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.859+0000 7fe572ffd640 1 -- 172.21.15.5:0/3207111511 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe580043790 con 0x55c64eb5b070 2024-08-31T05:40:15.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.860+0000 7fe595a3c740 1 -- 172.21.15.5:0/3207111511 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c64eb5b070 msgr2=0x55c64ef18220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:15.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.860+0000 7fe595a3c740 1 --2- 172.21.15.5:0/3207111511 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c64eb5b070 0x55c64ef18220 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe580005cc0 tx=0x7fe580005c50 comp rx=0 tx=0).stop 2024-08-31T05:40:15.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.860+0000 7fe595a3c740 1 -- 172.21.15.5:0/3207111511 shutdown_connections 2024-08-31T05:40:15.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.860+0000 7fe595a3c740 1 --2- 172.21.15.5:0/3207111511 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c64eb5b070 0x55c64ef18220 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:15.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.860+0000 7fe595a3c740 1 --2- 172.21.15.5:0/3207111511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c64eb3a390 0x55c64ef17ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:15.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.860+0000 7fe595a3c740 1 --2- 172.21.15.5:0/3207111511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c64eb321b0 0x55c64ef03b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:15.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.860+0000 7fe595a3c740 1 -- 172.21.15.5:0/3207111511 >> 172.21.15.5:0/3207111511 conn(0x55c64eb4f460 msgr2=0x55c64ef03410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:15.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.860+0000 7fe595a3c740 1 -- 172.21.15.5:0/3207111511 shutdown_connections 2024-08-31T05:40:15.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.860+0000 7fe595a3c740 1 -- 172.21.15.5:0/3207111511 wait complete. 2024-08-31T05:40:15.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.860+0000 7fe595a3c740 1 -- start start 2024-08-31T05:40:15.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.861+0000 7fe595a3c740 1 Processor -- start 2024-08-31T05:40:15.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.861+0000 7fe595a3c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c64eb321b0 0x55c64ef144a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:15.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.861+0000 7fe595a3c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c64eb3a390 0x55c64ef0f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:15.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.861+0000 7fe595a3c740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c64eb5b070 0x55c64ef0fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:15.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.861+0000 7fe595a3c740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe5881b42f0 con 0x55c64eb5b070 2024-08-31T05:40:15.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.861+0000 7fe595a3c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe5881b3c20 con 0x55c64eb3a390 2024-08-31T05:40:15.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.861+0000 7fe595a3c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe5881b0e80 con 0x55c64eb321b0 2024-08-31T05:40:15.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.861+0000 7fe595a3c740 10 client.0 _ll_register_callbacks cb 0x7fe578005850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:40:15.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.861+0000 7fe58da64640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c64eb5b070 0x55c64ef0fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:15.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.861+0000 7fe58da64640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c64eb5b070 0x55c64ef0fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43130/0 (socket says 172.21.15.5:43130) 2024-08-31T05:40:15.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.861+0000 7fe58da64640 1 -- 172.21.15.5:0/1062724587 learned_addr learned my addr 172.21.15.5:0/1062724587 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:15.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.861+0000 7fe58ca62640 1 --2- 172.21.15.5:0/1062724587 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c64eb3a390 0x55c64ef0f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:15.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.861+0000 7fe58da64640 1 --2- 172.21.15.5:0/1062724587 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c64eb321b0 0x55c64ef144a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:15.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.861+0000 7fe58da64640 1 -- 172.21.15.5:0/1062724587 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c64eb321b0 msgr2=0x55c64ef144a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:15.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.861+0000 7fe58da64640 1 --2- 172.21.15.5:0/1062724587 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c64eb321b0 0x55c64ef144a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:15.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.861+0000 7fe58da64640 1 -- 172.21.15.5:0/1062724587 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c64eb3a390 msgr2=0x55c64ef0f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:15.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.861+0000 7fe58da64640 1 --2- 172.21.15.5:0/1062724587 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c64eb3a390 0x55c64ef0f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:15.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.861+0000 7fe58da64640 1 -- 172.21.15.5:0/1062724587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c64ef105d0 con 0x55c64eb5b070 2024-08-31T05:40:15.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.862+0000 7fe58ca62640 1 --2- 172.21.15.5:0/1062724587 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c64eb3a390 0x55c64ef0f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:40:15.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.862+0000 7fe58da64640 1 --2- 172.21.15.5:0/1062724587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c64eb5b070 0x55c64ef0fe90 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fe58002f6b0 tx=0x7fe58002b0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb5ced88166d04df server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:15.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.862+0000 7fe570ff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:40:15.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.862+0000 7fe570ff9640 1 -- 172.21.15.5:0/1062724587 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe580048030 con 0x55c64eb5b070 2024-08-31T05:40:15.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.862+0000 7fe570ff9640 1 -- 172.21.15.5:0/1062724587 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7fe58003aa90 con 0x55c64eb5b070 2024-08-31T05:40:15.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.862+0000 7fe595a3c740 1 -- 172.21.15.5:0/1062724587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe58003a8e0 con 0x55c64eb5b070 2024-08-31T05:40:15.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.862+0000 7fe570ff9640 1 -- 172.21.15.5:0/1062724587 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe580034070 con 0x55c64eb5b070 2024-08-31T05:40:15.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.862+0000 7fe595a3c740 10 client.18306 fetch_fsmap learned FSMap version 34 2024-08-31T05:40:15.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.862+0000 7fe595a3c740 1 -- 172.21.15.5:0/1062724587 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55c64ef886d0 con 0x55c64eb5b070 2024-08-31T05:40:15.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.862+0000 7fe570ff9640 1 -- 172.21.15.5:0/1062724587 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe58003a8e0 con 0x55c64eb5b070 2024-08-31T05:40:15.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.862+0000 7fe570ff9640 1 -- 172.21.15.5:0/1062724587 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fe58004e040 con 0x55c64eb5b070 2024-08-31T05:40:15.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.863+0000 7fe595a3c740 10 client.18306 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:40:15.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.863+0000 7fe595a3c740 10 client.18306 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-31T05:40:15.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.863+0000 7fe595a3c740 20 client.18306 populate_metadata read hostname 'smithi005' 2024-08-31T05:40:15.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.863+0000 7fe595a3c740 1 --2- 172.21.15.5:0/1062724587 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x55c64eaeeda0 0x55c64ef8a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:15.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.863+0000 7fe595a3c740 4 client.18306 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:40:15.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.863+0000 7fe595a3c740 1 -- 172.21.15.5:0/1062724587 --> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c64ee75070 con 0x55c64eaeeda0 2024-08-31T05:40:15.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.863+0000 7fe58ca62640 1 --2- 172.21.15.5:0/1062724587 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x55c64eaeeda0 0x55c64ef8a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:15.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.863+0000 7fe570ff9640 10 client.18306 ms_handle_connect on v2:172.21.15.70:6834/2061504114 2024-08-31T05:40:15.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.863+0000 7fe58ca62640 1 --2- 172.21.15.5:0/1062724587 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x55c64eaeeda0 0x55c64ef8a8b0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=62865ee1bd667efd server_cookie=123d6963b2aeb59f in_seq=0 out_seq=0 2024-08-31T05:40:15.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.863+0000 7fe570ff9640 1 -- 172.21.15.5:0/1062724587 <== mds.3 v2:172.21.15.70:6834/2061504114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c64ee75070 con 0x55c64eaeeda0 2024-08-31T05:40:15.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.863+0000 7fe570ff9640 10 client.18306 handle_command_reply: tid=0 2024-08-31T05:40:15.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.863+0000 7fe595a3c740 1 client.18306 shutdown 2024-08-31T05:40:15.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.863+0000 7fe595a3c740 1 -- 172.21.15.5:0/1062724587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c64eb5b070 msgr2=0x55c64ef0fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:15.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.863+0000 7fe595a3c740 1 --2- 172.21.15.5:0/1062724587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c64eb5b070 0x55c64ef0fe90 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fe58002f6b0 tx=0x7fe58002b0d0 comp rx=0 tx=0).stop 2024-08-31T05:40:15.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.864+0000 7fe595a3c740 1 -- 172.21.15.5:0/1062724587 shutdown_connections 2024-08-31T05:40:15.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.864+0000 7fe595a3c740 1 --2- 172.21.15.5:0/1062724587 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x55c64eaeeda0 0x55c64ef8a8b0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:15.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.864+0000 7fe595a3c740 1 --2- 172.21.15.5:0/1062724587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c64eb5b070 0x55c64ef0fe90 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:15.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.864+0000 7fe595a3c740 1 --2- 172.21.15.5:0/1062724587 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c64eb3a390 0x55c64ef0f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:15.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.864+0000 7fe595a3c740 1 --2- 172.21.15.5:0/1062724587 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c64eb321b0 0x55c64ef144a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:15.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.864+0000 7fe570ff9640 0 client.18306 ms_handle_reset on v2:172.21.15.70:6834/2061504114 2024-08-31T05:40:15.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.864+0000 7fe595a3c740 1 -- 172.21.15.5:0/1062724587 >> 172.21.15.5:0/1062724587 conn(0x55c64eb4f460 msgr2=0x55c64ef0b860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:15.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.864+0000 7fe595a3c740 1 -- 172.21.15.5:0/1062724587 shutdown_connections 2024-08-31T05:40:15.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.864+0000 7fe595a3c740 1 -- 172.21.15.5:0/1062724587 wait complete. 2024-08-31T05:40:15.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.864+0000 7fe595a3c740 20 client.18306 trim_cache size 0 max 16384 2024-08-31T05:40:15.871 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:40:15.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.864+0000 7fe58f4c7640 1 -- 172.21.15.5:0/3523899 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe5740b4d20 msgr2=0x7fe5740b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:15.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.864+0000 7fe58f4c7640 1 --2- 172.21.15.5:0/3523899 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe5740b4d20 0x7fe5740b7230 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x55c64eefef90 tx=0x7fe584000bc0 comp rx=0 tx=0).stop 2024-08-31T05:40:15.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.864+0000 7fe58f4c7640 1 -- 172.21.15.5:0/3523899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe588102390 msgr2=0x7fe58819c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:15.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.864+0000 7fe58f4c7640 1 --2- 172.21.15.5:0/3523899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe588102390 0x7fe58819c3c0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fe58400e9f0 tx=0x7fe58400eeb0 comp rx=0 tx=0).stop 2024-08-31T05:40:15.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.864+0000 7fe58f4c7640 1 -- 172.21.15.5:0/3523899 shutdown_connections 2024-08-31T05:40:15.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.864+0000 7fe58f4c7640 1 --2- 172.21.15.5:0/3523899 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe5740b4d20 0x7fe5740b7230 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:15.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.864+0000 7fe58f4c7640 1 --2- 172.21.15.5:0/3523899 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe58810ff40 0x7fe5881a1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:15.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.865+0000 7fe58f4c7640 1 --2- 172.21.15.5:0/3523899 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe588102ce0 0x7fe58819c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:15.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.865+0000 7fe58f4c7640 1 --2- 172.21.15.5:0/3523899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe588102390 0x7fe58819c3c0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:15.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.865+0000 7fe58f4c7640 1 -- 172.21.15.5:0/3523899 >> 172.21.15.5:0/3523899 conn(0x7fe5880794e0 msgr2=0x7fe588109ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:15.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.865+0000 7fe58f4c7640 1 -- 172.21.15.5:0/3523899 shutdown_connections 2024-08-31T05:40:15.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:15.865+0000 7fe58f4c7640 1 -- 172.21.15.5:0/3523899 wait complete. 2024-08-31T05:40:15.935 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1158324 10.98 MB/sec execute 423 sec latency 35.260 ms 2024-08-31T05:40:16.935 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1159595 10.97 MB/sec execute 424 sec latency 86.526 ms 2024-08-31T05:40:17.156 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:40:16 smithi050 ceph-mon[22146]: pgmap v662: 129 pgs: 129 active+clean; 587 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.4 MiB/s wr, 224 op/s 2024-08-31T05:40:17.201 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:40:16 smithi005 ceph-mon[18602]: pgmap v662: 129 pgs: 129 active+clean; 587 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.4 MiB/s wr, 224 op/s 2024-08-31T05:40:17.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:40:16 smithi070 ceph-mon[22316]: pgmap v662: 129 pgs: 129 active+clean; 587 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.4 MiB/s wr, 224 op/s 2024-08-31T05:40:17.435 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T05:40:17.759 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:40:17.935 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1161695 10.97 MB/sec execute 425 sec latency 48.767 ms 2024-08-31T05:40:18.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.256+0000 7f2d25a78640 1 -- 172.21.15.5:0/3473581887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d20109240 msgr2=0x7f2d20109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:18.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.256+0000 7f2d25a78640 1 --2- 172.21.15.5:0/3473581887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d20109240 0x7f2d20109650 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f2d14009900 tx=0x7f2d1402a410 comp rx=0 tx=0).stop 2024-08-31T05:40:18.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.256+0000 7f2d25a78640 1 -- 172.21.15.5:0/3473581887 shutdown_connections 2024-08-31T05:40:18.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.256+0000 7f2d25a78640 1 --2- 172.21.15.5:0/3473581887 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d20109b90 0x7f2d201103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:18.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.256+0000 7f2d25a78640 1 --2- 172.21.15.5:0/3473581887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d20109240 0x7f2d20109650 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:18.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.256+0000 7f2d25a78640 1 --2- 172.21.15.5:0/3473581887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d20103900 0x7f2d20103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:18.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.256+0000 7f2d25a78640 1 -- 172.21.15.5:0/3473581887 >> 172.21.15.5:0/3473581887 conn(0x7f2d2007b5f0 msgr2=0x7f2d2007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:18.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.256+0000 7f2d25a78640 1 -- 172.21.15.5:0/3473581887 shutdown_connections 2024-08-31T05:40:18.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.256+0000 7f2d25a78640 1 -- 172.21.15.5:0/3473581887 wait complete. 2024-08-31T05:40:18.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.257+0000 7f2d25a78640 1 Processor -- start 2024-08-31T05:40:18.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.258+0000 7f2d25a78640 1 -- start start 2024-08-31T05:40:18.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.258+0000 7f2d25a78640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d20103900 0x7f2d2019a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:18.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.258+0000 7f2d25a78640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d20109240 0x7f2d2019a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:18.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.258+0000 7f2d25a78640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d20109b90 0x7f2d2019faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:18.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.258+0000 7f2d25a78640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2d20113850 con 0x7f2d20109b90 2024-08-31T05:40:18.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.258+0000 7f2d25a78640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2d201136d0 con 0x7f2d20109240 2024-08-31T05:40:18.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.258+0000 7f2d25a78640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2d201139d0 con 0x7f2d20103900 2024-08-31T05:40:18.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.258+0000 7f2d1ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d20109b90 0x7f2d2019faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:18.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.258+0000 7f2d1ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d20109b90 0x7f2d2019faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43158/0 (socket says 172.21.15.5:43158) 2024-08-31T05:40:18.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.258+0000 7f2d1ffff640 1 -- 172.21.15.5:0/2928812439 learned_addr learned my addr 172.21.15.5:0/2928812439 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:18.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.258+0000 7f2d1f7fe640 1 --2- 172.21.15.5:0/2928812439 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d20103900 0x7f2d2019a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:18.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.258+0000 7f2d1effd640 1 --2- 172.21.15.5:0/2928812439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d20109240 0x7f2d2019a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:18.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.258+0000 7f2d1ffff640 1 -- 172.21.15.5:0/2928812439 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d20103900 msgr2=0x7f2d2019a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:18.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.258+0000 7f2d1ffff640 1 --2- 172.21.15.5:0/2928812439 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d20103900 0x7f2d2019a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:18.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.258+0000 7f2d1ffff640 1 -- 172.21.15.5:0/2928812439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d20109240 msgr2=0x7f2d2019a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:18.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.258+0000 7f2d1ffff640 1 --2- 172.21.15.5:0/2928812439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d20109240 0x7f2d2019a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:18.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.258+0000 7f2d1ffff640 1 -- 172.21.15.5:0/2928812439 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d201a01d0 con 0x7f2d20109b90 2024-08-31T05:40:18.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.259+0000 7f2d1ffff640 1 --2- 172.21.15.5:0/2928812439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d20109b90 0x7f2d2019faa0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f2d1800eb10 tx=0x7f2d1800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:18.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.259+0000 7f2d1cff9640 1 -- 172.21.15.5:0/2928812439 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d18004b20 con 0x7f2d20109b90 2024-08-31T05:40:18.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.259+0000 7f2d1cff9640 1 -- 172.21.15.5:0/2928812439 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d18004cc0 con 0x7f2d20109b90 2024-08-31T05:40:18.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.259+0000 7f2d25a78640 1 -- 172.21.15.5:0/2928812439 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d201a04c0 con 0x7f2d20109b90 2024-08-31T05:40:18.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.259+0000 7f2d1cff9640 1 -- 172.21.15.5:0/2928812439 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d18010670 con 0x7f2d20109b90 2024-08-31T05:40:18.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.259+0000 7f2d25a78640 1 -- 172.21.15.5:0/2928812439 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d201a6c20 con 0x7f2d20109b90 2024-08-31T05:40:18.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.261+0000 7f2d1cff9640 1 -- 172.21.15.5:0/2928812439 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f2d18005020 con 0x7f2d20109b90 2024-08-31T05:40:18.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.262+0000 7f2d2bfed740 1 Processor -- start 2024-08-31T05:40:18.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.262+0000 7f2d2bfed740 1 -- start start 2024-08-31T05:40:18.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.262+0000 7f2d2bfed740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55936ed8b070 0x55936f130310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:18.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.262+0000 7f2d2bfed740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55936ed621b0 0x55936f130850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:18.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.262+0000 7f2d2bfed740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55936ed6a390 0x55936f130d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:18.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.262+0000 7f2d2bfed740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55936f0a7680 con 0x55936ed6a390 2024-08-31T05:40:18.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.262+0000 7f2d2bfed740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55936f096c10 con 0x55936ed621b0 2024-08-31T05:40:18.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.262+0000 7f2d2bfed740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55936f09abc0 con 0x55936ed8b070 2024-08-31T05:40:18.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.262+0000 7f2d1effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55936ed6a390 0x55936f130d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:18.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.262+0000 7f2d1f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55936ed621b0 0x55936f130850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:18.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.262+0000 7f2d1cff9640 1 --2- 172.21.15.5:0/2928812439 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2d080b4ca0 0x7f2d080b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:18.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.262+0000 7f2d1effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55936ed8b070 0x55936f130310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:18.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.262+0000 7f2d1effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55936ed8b070 0x55936f130310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:53340/0 (socket says 172.21.15.5:53340) 2024-08-31T05:40:18.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.262+0000 7f2d1f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55936ed621b0 0x55936f130850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:53234/0 (socket says 172.21.15.5:53234) 2024-08-31T05:40:18.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.262+0000 7f2d1effd640 1 -- 172.21.15.5:0/4190870648 learned_addr learned my addr 172.21.15.5:0/4190870648 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:18.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.263+0000 7f2d1cff9640 1 -- 172.21.15.5:0/2928812439 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7f2d180e5f10 con 0x7f2d20109b90 2024-08-31T05:40:18.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.263+0000 7f2d1effd640 1 -- 172.21.15.5:0/4190870648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55936ed621b0 msgr2=0x55936f130850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:18.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.263+0000 7f2d1effd640 1 --2- 172.21.15.5:0/4190870648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55936ed621b0 0x55936f130850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:18.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.263+0000 7f2d1effd640 1 -- 172.21.15.5:0/4190870648 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55936ed6a390 msgr2=0x55936f130d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:18.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.263+0000 7f2d1effd640 1 --2- 172.21.15.5:0/4190870648 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55936ed6a390 0x55936f130d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:18.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.263+0000 7f2d1effd640 1 -- 172.21.15.5:0/4190870648 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55936edf6650 con 0x55936ed8b070 2024-08-31T05:40:18.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.263+0000 7f2d1ffff640 1 --2- 172.21.15.5:0/2928812439 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2d080b4ca0 0x7f2d080b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:18.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.263+0000 7f2d1effd640 1 --2- 172.21.15.5:0/4190870648 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55936ed8b070 0x55936f130310 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2d2006c790 tx=0x7f2d14031400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9adbfc4155dc80 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:18.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.263+0000 7f2d05ffb640 1 -- 172.21.15.5:0/4190870648 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d14035070 con 0x55936ed8b070 2024-08-31T05:40:18.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.263+0000 7f2d05ffb640 1 -- 172.21.15.5:0/4190870648 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d14004030 con 0x55936ed8b070 2024-08-31T05:40:18.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.263+0000 7f2d05ffb640 1 -- 172.21.15.5:0/4190870648 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d14005310 con 0x55936ed8b070 2024-08-31T05:40:18.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.264+0000 7f2d2bfed740 1 -- 172.21.15.5:0/4190870648 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55936ed8b070 msgr2=0x55936f130310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:18.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.264+0000 7f2d1ffff640 1 --2- 172.21.15.5:0/2928812439 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2d080b4ca0 0x7f2d080b71b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f2d180e32e0 tx=0x7f2d18078420 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:18.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.264+0000 7f2d2bfed740 1 --2- 172.21.15.5:0/4190870648 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55936ed8b070 0x55936f130310 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2d2006c790 tx=0x7f2d14031400 comp rx=0 tx=0).stop 2024-08-31T05:40:18.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.264+0000 7f2d2bfed740 1 -- 172.21.15.5:0/4190870648 shutdown_connections 2024-08-31T05:40:18.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.264+0000 7f2d2bfed740 1 --2- 172.21.15.5:0/4190870648 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55936ed6a390 0x55936f130d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:18.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.264+0000 7f2d2bfed740 1 --2- 172.21.15.5:0/4190870648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55936ed621b0 0x55936f130850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:18.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.264+0000 7f2d2bfed740 1 --2- 172.21.15.5:0/4190870648 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55936ed8b070 0x55936f130310 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:18.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.264+0000 7f2d2bfed740 1 -- 172.21.15.5:0/4190870648 >> 172.21.15.5:0/4190870648 conn(0x55936ed7f460 msgr2=0x55936f12e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:18.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.264+0000 7f2d2bfed740 1 -- 172.21.15.5:0/4190870648 shutdown_connections 2024-08-31T05:40:18.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.264+0000 7f2d2bfed740 1 -- 172.21.15.5:0/4190870648 wait complete. 2024-08-31T05:40:18.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.265+0000 7f2d2bfed740 1 -- start start 2024-08-31T05:40:18.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.265+0000 7f2d2bfed740 1 Processor -- start 2024-08-31T05:40:18.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.265+0000 7f2d2bfed740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55936ed621b0 0x55936f13bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:18.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.265+0000 7f2d2bfed740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55936ed6a390 0x55936f13c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:18.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.265+0000 7f2d2bfed740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55936ed8b070 0x55936f1416e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:18.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.265+0000 7f2d2bfed740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55936eef9700 con 0x55936ed6a390 2024-08-31T05:40:18.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.265+0000 7f2d2bfed740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55936f01d750 con 0x55936ed8b070 2024-08-31T05:40:18.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.265+0000 7f2d2bfed740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55936f136820 con 0x55936ed621b0 2024-08-31T05:40:18.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.265+0000 7f2d2bfed740 10 client.0 _ll_register_callbacks cb 0x55936f04ce10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:40:18.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.265+0000 7f2d1f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55936ed6a390 0x55936f13c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:18.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.265+0000 7f2d1effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55936ed621b0 0x55936f13bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:18.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.265+0000 7f2d1f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55936ed6a390 0x55936f13c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43182/0 (socket says 172.21.15.5:43182) 2024-08-31T05:40:18.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.265+0000 7f2d1f7fe640 1 -- 172.21.15.5:0/461505202 learned_addr learned my addr 172.21.15.5:0/461505202 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:18.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.265+0000 7f2d1effd640 1 --2- 172.21.15.5:0/461505202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55936ed8b070 0x55936f1416e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:18.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.266+0000 7f2d1f7fe640 1 -- 172.21.15.5:0/461505202 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55936ed621b0 msgr2=0x55936f13bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:18.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.266+0000 7f2d1f7fe640 1 --2- 172.21.15.5:0/461505202 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55936ed621b0 0x55936f13bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:18.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.266+0000 7f2d1f7fe640 1 -- 172.21.15.5:0/461505202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55936ed8b070 msgr2=0x55936f1416e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:18.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.266+0000 7f2d1f7fe640 1 --2- 172.21.15.5:0/461505202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55936ed8b070 0x55936f1416e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:18.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.266+0000 7f2d1f7fe640 1 -- 172.21.15.5:0/461505202 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55936f056900 con 0x55936ed6a390 2024-08-31T05:40:18.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.266+0000 7f2d1f7fe640 1 --2- 172.21.15.5:0/461505202 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55936ed6a390 0x55936f13c510 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f2d1000bad0 tx=0x7f2d1000bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a1e823c697759e7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:18.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.266+0000 7f2cfeffd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:40:18.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.266+0000 7f2cfeffd640 1 -- 172.21.15.5:0/461505202 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d10005020 con 0x55936ed6a390 2024-08-31T05:40:18.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.266+0000 7f2cfeffd640 1 -- 172.21.15.5:0/461505202 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7f2d100051c0 con 0x55936ed6a390 2024-08-31T05:40:18.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.266+0000 7f2d2bfed740 1 -- 172.21.15.5:0/461505202 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d14004030 con 0x55936ed6a390 2024-08-31T05:40:18.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.266+0000 7f2cfeffd640 1 -- 172.21.15.5:0/461505202 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f2d100053c0 con 0x55936ed6a390 2024-08-31T05:40:18.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.266+0000 7f2d2bfed740 10 client.18318 fetch_fsmap learned FSMap version 34 2024-08-31T05:40:18.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.266+0000 7f2d2bfed740 1 -- 172.21.15.5:0/461505202 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55936f14a870 con 0x55936ed6a390 2024-08-31T05:40:18.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.267+0000 7f2cfeffd640 1 -- 172.21.15.5:0/461505202 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d14004030 con 0x55936ed6a390 2024-08-31T05:40:18.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.267+0000 7f2cfeffd640 1 -- 172.21.15.5:0/461505202 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f2d1001b670 con 0x55936ed6a390 2024-08-31T05:40:18.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.267+0000 7f2d2bfed740 10 client.18318 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:40:18.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.267+0000 7f2d2bfed740 10 client.18318 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-31T05:40:18.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.267+0000 7f2d2bfed740 20 client.18318 populate_metadata read hostname 'smithi005' 2024-08-31T05:40:18.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.267+0000 7f2d2bfed740 1 --2- 172.21.15.5:0/461505202 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55936ed499f0 0x55936f14dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:18.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.267+0000 7f2d2bfed740 4 client.18318 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:40:18.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.267+0000 7f2d2bfed740 1 -- 172.21.15.5:0/461505202 --> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55936f0a95d0 con 0x55936ed499f0 2024-08-31T05:40:18.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.267+0000 7f2d1effd640 1 --2- 172.21.15.5:0/461505202 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55936ed499f0 0x55936f14dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:18.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.268+0000 7f2cfeffd640 10 client.18318 ms_handle_connect on v2:172.21.15.70:6836/2780036414 2024-08-31T05:40:18.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.268+0000 7f2d1effd640 1 --2- 172.21.15.5:0/461505202 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55936ed499f0 0x55936f14dd30 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f0da260240860d6a server_cookie=ee304f4e928fdea6 in_seq=0 out_seq=0 2024-08-31T05:40:18.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.269+0000 7f2cfeffd640 1 -- 172.21.15.5:0/461505202 <== mds.2 v2:172.21.15.70:6836/2780036414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55936f0a95d0 con 0x55936ed499f0 2024-08-31T05:40:18.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.269+0000 7f2cfeffd640 10 client.18318 handle_command_reply: tid=0 2024-08-31T05:40:18.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.269+0000 7f2d2bfed740 1 client.18318 shutdown 2024-08-31T05:40:18.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.270+0000 7f2d2bfed740 1 -- 172.21.15.5:0/461505202 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55936ed6a390 msgr2=0x55936f13c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:18.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.270+0000 7f2d2bfed740 1 --2- 172.21.15.5:0/461505202 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55936ed6a390 0x55936f13c510 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f2d1000bad0 tx=0x7f2d1000bed0 comp rx=0 tx=0).stop 2024-08-31T05:40:18.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.270+0000 7f2d2bfed740 1 -- 172.21.15.5:0/461505202 shutdown_connections 2024-08-31T05:40:18.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.270+0000 7f2d2bfed740 1 --2- 172.21.15.5:0/461505202 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55936ed499f0 0x55936f14dd30 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:18.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.270+0000 7f2d2bfed740 1 --2- 172.21.15.5:0/461505202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55936ed8b070 0x55936f1416e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:18.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.270+0000 7f2d2bfed740 1 --2- 172.21.15.5:0/461505202 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55936ed6a390 0x55936f13c510 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:18.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.270+0000 7f2cfeffd640 0 client.18318 ms_handle_reset on v2:172.21.15.70:6836/2780036414 2024-08-31T05:40:18.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.270+0000 7f2d2bfed740 1 --2- 172.21.15.5:0/461505202 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55936ed621b0 0x55936f13bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:18.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.270+0000 7f2d2bfed740 1 -- 172.21.15.5:0/461505202 >> 172.21.15.5:0/461505202 conn(0x55936ed7f460 msgr2=0x55936f131d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:18.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.270+0000 7f2d2bfed740 1 -- 172.21.15.5:0/461505202 shutdown_connections 2024-08-31T05:40:18.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.270+0000 7f2d2bfed740 1 -- 172.21.15.5:0/461505202 wait complete. 2024-08-31T05:40:18.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.270+0000 7f2d2bfed740 20 client.18318 trim_cache size 0 max 16384 2024-08-31T05:40:18.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.285+0000 7f2d2bfed740 1 Processor -- start 2024-08-31T05:40:18.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.285+0000 7f2d2bfed740 1 -- start start 2024-08-31T05:40:18.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.285+0000 7f2d2bfed740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55936ed621b0 0x55936f13c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:18.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.285+0000 7f2d2bfed740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55936ed6a390 0x55936f139140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:18.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.285+0000 7f2d2bfed740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55936ed8b070 0x55936f139680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:18.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.285+0000 7f2d2bfed740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2d201aeb00 con 0x55936ed8b070 2024-08-31T05:40:18.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.285+0000 7f2d2bfed740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2d201b0640 con 0x55936ed621b0 2024-08-31T05:40:18.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.285+0000 7f2d2bfed740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2d201af1d0 con 0x55936ed6a390 2024-08-31T05:40:18.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.286+0000 7f2d1effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55936ed8b070 0x55936f139680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:18.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.286+0000 7f2d1f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55936ed6a390 0x55936f139140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:18.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.286+0000 7f2d1effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55936ed621b0 0x55936f13c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:18.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.286+0000 7f2d1f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55936ed6a390 0x55936f139140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:53358/0 (socket says 172.21.15.5:53358) 2024-08-31T05:40:18.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.286+0000 7f2d1effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55936ed621b0 0x55936f13c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:53258/0 (socket says 172.21.15.5:53258) 2024-08-31T05:40:18.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.286+0000 7f2d1f7fe640 1 -- 172.21.15.5:0/2879095355 learned_addr learned my addr 172.21.15.5:0/2879095355 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:18.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.286+0000 7f2d1effd640 1 -- 172.21.15.5:0/2879095355 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55936ed6a390 msgr2=0x55936f139140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:18.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.286+0000 7f2d1effd640 1 --2- 172.21.15.5:0/2879095355 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55936ed6a390 0x55936f139140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:18.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.286+0000 7f2d1effd640 1 -- 172.21.15.5:0/2879095355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55936ed8b070 msgr2=0x55936f139680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:18.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.286+0000 7f2d1effd640 1 --2- 172.21.15.5:0/2879095355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55936ed8b070 0x55936f139680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:18.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.286+0000 7f2d1effd640 1 -- 172.21.15.5:0/2879095355 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55936f13a450 con 0x55936ed621b0 2024-08-31T05:40:18.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.286+0000 7f2d1effd640 1 --2- 172.21.15.5:0/2879095355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55936ed621b0 0x55936f13c410 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2d14009550 tx=0x7f2d14000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71295bebe000128a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:18.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.286+0000 7f2d057fa640 1 -- 172.21.15.5:0/2879095355 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d14035040 con 0x55936ed621b0 2024-08-31T05:40:18.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.287+0000 7f2d057fa640 1 -- 172.21.15.5:0/2879095355 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d14031990 con 0x55936ed621b0 2024-08-31T05:40:18.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.287+0000 7f2d057fa640 1 -- 172.21.15.5:0/2879095355 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d14048a50 con 0x55936ed621b0 2024-08-31T05:40:18.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.287+0000 7f2d2bfed740 1 -- 172.21.15.5:0/2879095355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55936ed621b0 msgr2=0x55936f13c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:18.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.287+0000 7f2d2bfed740 1 --2- 172.21.15.5:0/2879095355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55936ed621b0 0x55936f13c410 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2d14009550 tx=0x7f2d14000bc0 comp rx=0 tx=0).stop 2024-08-31T05:40:18.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.287+0000 7f2d2bfed740 1 -- 172.21.15.5:0/2879095355 shutdown_connections 2024-08-31T05:40:18.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.287+0000 7f2d2bfed740 1 --2- 172.21.15.5:0/2879095355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55936ed8b070 0x55936f139680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:18.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.287+0000 7f2d2bfed740 1 --2- 172.21.15.5:0/2879095355 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55936ed6a390 0x55936f139140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:18.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.287+0000 7f2d2bfed740 1 --2- 172.21.15.5:0/2879095355 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55936ed621b0 0x55936f13c410 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:18.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.287+0000 7f2d2bfed740 1 -- 172.21.15.5:0/2879095355 >> 172.21.15.5:0/2879095355 conn(0x55936ed7f460 msgr2=0x55936f13bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:18.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.288+0000 7f2d2bfed740 1 -- 172.21.15.5:0/2879095355 shutdown_connections 2024-08-31T05:40:18.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.288+0000 7f2d2bfed740 1 -- 172.21.15.5:0/2879095355 wait complete. 2024-08-31T05:40:18.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.288+0000 7f2d2bfed740 1 -- start start 2024-08-31T05:40:18.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.288+0000 7f2d2bfed740 1 Processor -- start 2024-08-31T05:40:18.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.288+0000 7f2d2bfed740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55936ed621b0 0x55936f144100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:18.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.288+0000 7f2d2bfed740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55936ed6a390 0x55936f1446e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:18.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.289+0000 7f2d2bfed740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55936ed8b070 0x55936f1b7730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:18.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.289+0000 7f2d2bfed740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2d201aff70 con 0x55936ed8b070 2024-08-31T05:40:18.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.289+0000 7f2d2bfed740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2d201af8a0 con 0x55936ed6a390 2024-08-31T05:40:18.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.289+0000 7f2d2bfed740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2d201acb00 con 0x55936ed621b0 2024-08-31T05:40:18.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.289+0000 7f2d2bfed740 10 client.0 _ll_register_callbacks cb 0x7f2d100040a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:40:18.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.289+0000 7f2d1f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55936ed6a390 0x55936f1446e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:18.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.289+0000 7f2d1effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55936ed8b070 0x55936f1b7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:18.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.289+0000 7f2d1f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55936ed6a390 0x55936f1446e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:53274/0 (socket says 172.21.15.5:53274) 2024-08-31T05:40:18.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.289+0000 7f2d1f7fe640 1 -- 172.21.15.5:0/3595952325 learned_addr learned my addr 172.21.15.5:0/3595952325 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:18.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.289+0000 7f2d1effd640 1 --2- 172.21.15.5:0/3595952325 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55936ed621b0 0x55936f144100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:18.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.289+0000 7f2d1f7fe640 1 -- 172.21.15.5:0/3595952325 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55936ed621b0 msgr2=0x55936f144100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:18.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.289+0000 7f2d1f7fe640 1 --2- 172.21.15.5:0/3595952325 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55936ed621b0 0x55936f144100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:18.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.289+0000 7f2d1f7fe640 1 -- 172.21.15.5:0/3595952325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55936ed8b070 msgr2=0x55936f1b7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:18.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.289+0000 7f2d1f7fe640 1 --2- 172.21.15.5:0/3595952325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55936ed8b070 0x55936f1b7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:18.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.289+0000 7f2d1f7fe640 1 -- 172.21.15.5:0/3595952325 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55936f1b7c70 con 0x55936ed6a390 2024-08-31T05:40:18.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.289+0000 7f2d1effd640 1 --2- 172.21.15.5:0/3595952325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55936ed8b070 0x55936f1b7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:40:18.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.289+0000 7f2d1f7fe640 1 --2- 172.21.15.5:0/3595952325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55936ed6a390 0x55936f1446e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2d10005fe0 tx=0x7f2d10003a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=257a93128eb1a497 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:18.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.289+0000 7f2cfeffd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:40:18.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.289+0000 7f2cfeffd640 1 -- 172.21.15.5:0/3595952325 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d10011440 con 0x55936ed6a390 2024-08-31T05:40:18.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.290+0000 7f2d2bfed740 1 -- 172.21.15.5:0/3595952325 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d14031990 con 0x55936ed6a390 2024-08-31T05:40:18.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.290+0000 7f2cfeffd640 1 -- 172.21.15.5:0/3595952325 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7f2d100115e0 con 0x55936ed6a390 2024-08-31T05:40:18.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.290+0000 7f2cfeffd640 1 -- 172.21.15.5:0/3595952325 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f2d100117e0 con 0x55936ed6a390 2024-08-31T05:40:18.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.290+0000 7f2d2bfed740 10 client.27896 fetch_fsmap learned FSMap version 34 2024-08-31T05:40:18.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.290+0000 7f2d2bfed740 1 -- 172.21.15.5:0/3595952325 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55936f1b8e20 con 0x55936ed6a390 2024-08-31T05:40:18.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.290+0000 7f2cfeffd640 1 -- 172.21.15.5:0/3595952325 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d14031990 con 0x55936ed6a390 2024-08-31T05:40:18.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.290+0000 7f2cfeffd640 1 -- 172.21.15.5:0/3595952325 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f2d10031a10 con 0x55936ed6a390 2024-08-31T05:40:18.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.290+0000 7f2d2bfed740 10 client.27896 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:40:18.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.290+0000 7f2d2bfed740 10 client.27896 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-31T05:40:18.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.290+0000 7f2d2bfed740 20 client.27896 populate_metadata read hostname 'smithi005' 2024-08-31T05:40:18.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.290+0000 7f2d2bfed740 1 --2- 172.21.15.5:0/3595952325 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55936ed1eda0 0x55936f1bb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:18.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.290+0000 7f2d2bfed740 4 client.27896 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:40:18.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.290+0000 7f2d2bfed740 1 -- 172.21.15.5:0/3595952325 --> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55936f0a5070 con 0x55936ed1eda0 2024-08-31T05:40:18.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.290+0000 7f2d1effd640 1 --2- 172.21.15.5:0/3595952325 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55936ed1eda0 0x55936f1bb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:18.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.291+0000 7f2d1effd640 1 --2- 172.21.15.5:0/3595952325 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55936ed1eda0 0x55936f1bb520 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2cc62168545ed2ef server_cookie=8545b4663178abbb in_seq=0 out_seq=0 2024-08-31T05:40:18.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.291+0000 7f2cfeffd640 10 client.27896 ms_handle_connect on v2:172.21.15.70:6836/2780036414 2024-08-31T05:40:18.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.294+0000 7f2cfeffd640 1 -- 172.21.15.5:0/3595952325 <== mds.2 v2:172.21.15.70:6836/2780036414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55936f0a5070 con 0x55936ed1eda0 2024-08-31T05:40:18.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.294+0000 7f2cfeffd640 10 client.27896 handle_command_reply: tid=0 2024-08-31T05:40:18.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.294+0000 7f2d2bfed740 1 client.27896 shutdown 2024-08-31T05:40:18.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.294+0000 7f2d2bfed740 1 -- 172.21.15.5:0/3595952325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55936ed6a390 msgr2=0x55936f1446e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:18.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.295+0000 7f2d2bfed740 1 --2- 172.21.15.5:0/3595952325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55936ed6a390 0x55936f1446e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2d10005fe0 tx=0x7f2d10003a40 comp rx=0 tx=0).stop 2024-08-31T05:40:18.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.295+0000 7f2d2bfed740 1 -- 172.21.15.5:0/3595952325 shutdown_connections 2024-08-31T05:40:18.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.295+0000 7f2d2bfed740 1 --2- 172.21.15.5:0/3595952325 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x55936ed1eda0 0x55936f1bb520 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:18.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.295+0000 7f2d2bfed740 1 --2- 172.21.15.5:0/3595952325 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55936ed8b070 0x55936f1b7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:18.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.295+0000 7f2d2bfed740 1 --2- 172.21.15.5:0/3595952325 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55936ed6a390 0x55936f1446e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:18.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.295+0000 7f2d2bfed740 1 --2- 172.21.15.5:0/3595952325 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55936ed621b0 0x55936f144100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:18.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.295+0000 7f2cfeffd640 0 client.27896 ms_handle_reset on v2:172.21.15.70:6836/2780036414 2024-08-31T05:40:18.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.295+0000 7f2d2bfed740 1 -- 172.21.15.5:0/3595952325 >> 172.21.15.5:0/3595952325 conn(0x55936ed7f460 msgr2=0x55936f131340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:18.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.295+0000 7f2d2bfed740 1 -- 172.21.15.5:0/3595952325 shutdown_connections 2024-08-31T05:40:18.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.295+0000 7f2d2bfed740 1 -- 172.21.15.5:0/3595952325 wait complete. 2024-08-31T05:40:18.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.295+0000 7f2d2bfed740 20 client.27896 trim_cache size 0 max 16384 2024-08-31T05:40:18.298 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:40:18.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.295+0000 7f2d25a78640 1 -- 172.21.15.5:0/2928812439 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2d080b4ca0 msgr2=0x7f2d080b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:18.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.295+0000 7f2d25a78640 1 --2- 172.21.15.5:0/2928812439 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2d080b4ca0 0x7f2d080b71b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f2d180e32e0 tx=0x7f2d18078420 comp rx=0 tx=0).stop 2024-08-31T05:40:18.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.295+0000 7f2d25a78640 1 -- 172.21.15.5:0/2928812439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d20109b90 msgr2=0x7f2d2019faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:18.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.295+0000 7f2d25a78640 1 --2- 172.21.15.5:0/2928812439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d20109b90 0x7f2d2019faa0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f2d1800eb10 tx=0x7f2d1800c2d0 comp rx=0 tx=0).stop 2024-08-31T05:40:18.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.295+0000 7f2d25a78640 1 -- 172.21.15.5:0/2928812439 shutdown_connections 2024-08-31T05:40:18.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.295+0000 7f2d25a78640 1 --2- 172.21.15.5:0/2928812439 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2d080b4ca0 0x7f2d080b71b0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:18.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.295+0000 7f2d25a78640 1 --2- 172.21.15.5:0/2928812439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d20109b90 0x7f2d2019faa0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:18.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.295+0000 7f2d25a78640 1 --2- 172.21.15.5:0/2928812439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2d20109240 0x7f2d2019a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:18.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.295+0000 7f2d25a78640 1 --2- 172.21.15.5:0/2928812439 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d20103900 0x7f2d2019a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:18.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.295+0000 7f2d25a78640 1 -- 172.21.15.5:0/2928812439 >> 172.21.15.5:0/2928812439 conn(0x7f2d2007b5f0 msgr2=0x7f2d20107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:18.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.296+0000 7f2d25a78640 1 -- 172.21.15.5:0/2928812439 shutdown_connections 2024-08-31T05:40:18.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:18.296+0000 7f2d25a78640 1 -- 172.21.15.5:0/2928812439 wait complete. 2024-08-31T05:40:18.935 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1163142 10.96 MB/sec execute 426 sec latency 20.737 ms 2024-08-31T05:40:19.000 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T05:40:19.156 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:40:18 smithi050 ceph-mon[22146]: pgmap v663: 129 pgs: 129 active+clean; 591 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.7 MiB/s wr, 239 op/s 2024-08-31T05:40:19.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:40:18 smithi005 ceph-mon[18602]: pgmap v663: 129 pgs: 129 active+clean; 591 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.7 MiB/s wr, 239 op/s 2024-08-31T05:40:19.266 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:40:19.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:40:18 smithi070 ceph-mon[22316]: pgmap v663: 129 pgs: 129 active+clean; 591 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.7 MiB/s wr, 239 op/s 2024-08-31T05:40:19.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.787+0000 7f79e3ae4640 1 -- 172.21.15.5:0/2600217669 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79dc109250 msgr2=0x7f79dc109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:19.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.787+0000 7f79e3ae4640 1 --2- 172.21.15.5:0/2600217669 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79dc109250 0x7f79dc109660 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f79d0009900 tx=0x7f79d002a410 comp rx=0 tx=0).stop 2024-08-31T05:40:19.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.787+0000 7f79e3ae4640 1 -- 172.21.15.5:0/2600217669 shutdown_connections 2024-08-31T05:40:19.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.787+0000 7f79e3ae4640 1 --2- 172.21.15.5:0/2600217669 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79dc109ba0 0x7f79dc1103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:19.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.787+0000 7f79e3ae4640 1 --2- 172.21.15.5:0/2600217669 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79dc109250 0x7f79dc109660 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:19.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.787+0000 7f79e3ae4640 1 --2- 172.21.15.5:0/2600217669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79dc103960 0x7f79dc103d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:19.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.787+0000 7f79e3ae4640 1 -- 172.21.15.5:0/2600217669 >> 172.21.15.5:0/2600217669 conn(0x7f79dc07b6b0 msgr2=0x7f79dc07bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:19.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.787+0000 7f79e3ae4640 1 -- 172.21.15.5:0/2600217669 shutdown_connections 2024-08-31T05:40:19.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.787+0000 7f79e3ae4640 1 -- 172.21.15.5:0/2600217669 wait complete. 2024-08-31T05:40:19.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.788+0000 7f79e3ae4640 1 Processor -- start 2024-08-31T05:40:19.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.788+0000 7f79e3ae4640 1 -- start start 2024-08-31T05:40:19.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.788+0000 7f79e3ae4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79dc103960 0x7f79dc0754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:19.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.788+0000 7f79e3ae4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79dc109250 0x7f79dc0759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:19.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.788+0000 7f79e3ae4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79dc109ba0 0x7f79dc075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:19.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.788+0000 7f79e3ae4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f79dc1138b0 con 0x7f79dc109ba0 2024-08-31T05:40:19.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.788+0000 7f79e3ae4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f79dc113730 con 0x7f79dc109250 2024-08-31T05:40:19.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.788+0000 7f79e3ae4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f79dc113a30 con 0x7f79dc103960 2024-08-31T05:40:19.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.789+0000 7f79e1880640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79dc103960 0x7f79dc0754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:19.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.789+0000 7f79e2081640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79dc109ba0 0x7f79dc075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:19.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.789+0000 7f79e1880640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79dc103960 0x7f79dc0754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:53390/0 (socket says 172.21.15.5:53390) 2024-08-31T05:40:19.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.789+0000 7f79e1880640 1 -- 172.21.15.5:0/108990428 learned_addr learned my addr 172.21.15.5:0/108990428 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:19.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.789+0000 7f79e107f640 1 --2- 172.21.15.5:0/108990428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79dc109250 0x7f79dc0759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:19.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.789+0000 7f79e2081640 1 -- 172.21.15.5:0/108990428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79dc103960 msgr2=0x7f79dc0754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:19.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.789+0000 7f79e2081640 1 --2- 172.21.15.5:0/108990428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79dc103960 0x7f79dc0754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:19.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.789+0000 7f79e2081640 1 -- 172.21.15.5:0/108990428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79dc109250 msgr2=0x7f79dc0759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:19.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.789+0000 7f79e2081640 1 --2- 172.21.15.5:0/108990428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79dc109250 0x7f79dc0759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:19.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.789+0000 7f79e2081640 1 -- 172.21.15.5:0/108990428 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79dc1a8540 con 0x7f79dc109ba0 2024-08-31T05:40:19.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.789+0000 7f79e107f640 1 --2- 172.21.15.5:0/108990428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79dc109250 0x7f79dc0759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:40:19.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.789+0000 7f79e2081640 1 --2- 172.21.15.5:0/108990428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79dc109ba0 0x7f79dc075f30 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f79d400e970 tx=0x7f79d400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:19.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.789+0000 7f79daffd640 1 -- 172.21.15.5:0/108990428 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d400ccc0 con 0x7f79dc109ba0 2024-08-31T05:40:19.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.789+0000 7f79daffd640 1 -- 172.21.15.5:0/108990428 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f79d4005020 con 0x7f79dc109ba0 2024-08-31T05:40:19.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.789+0000 7f79e3ae4640 1 -- 172.21.15.5:0/108990428 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79dc1a8830 con 0x7f79dc109ba0 2024-08-31T05:40:19.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.789+0000 7f79daffd640 1 -- 172.21.15.5:0/108990428 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d4004a00 con 0x7f79dc109ba0 2024-08-31T05:40:19.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.789+0000 7f79e3ae4640 1 -- 172.21.15.5:0/108990428 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79dc1a8cf0 con 0x7f79dc109ba0 2024-08-31T05:40:19.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.792+0000 7f79daffd640 1 -- 172.21.15.5:0/108990428 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f79d4004ba0 con 0x7f79dc109ba0 2024-08-31T05:40:19.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.792+0000 7f79ea059740 1 Processor -- start 2024-08-31T05:40:19.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.792+0000 7f79ea059740 1 -- start start 2024-08-31T05:40:19.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.793+0000 7f79ea059740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588eea15070 0x5588eedba310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:19.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.793+0000 7f79ea059740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588ee9ec1b0 0x5588eedba850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:19.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.793+0000 7f79ea059740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588ee9f4390 0x5588eedbad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:19.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.793+0000 7f79ea059740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5588eed31680 con 0x5588ee9f4390 2024-08-31T05:40:19.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.793+0000 7f79ea059740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5588eed20c10 con 0x5588eea15070 2024-08-31T05:40:19.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.793+0000 7f79ea059740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5588eed24bc0 con 0x5588ee9ec1b0 2024-08-31T05:40:19.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.793+0000 7f79e107f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588eea15070 0x5588eedba310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:19.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.793+0000 7f79e1880640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588ee9ec1b0 0x5588eedba850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:19.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.793+0000 7f79e107f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588eea15070 0x5588eedba310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:53292/0 (socket says 172.21.15.5:53292) 2024-08-31T05:40:19.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.793+0000 7f79e107f640 1 -- 172.21.15.5:0/1879594777 learned_addr learned my addr 172.21.15.5:0/1879594777 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:19.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.793+0000 7f79e107f640 1 --2- 172.21.15.5:0/1879594777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588ee9f4390 0x5588eedbad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:19.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.793+0000 7f79daffd640 1 --2- 172.21.15.5:0/108990428 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f79c40b4ca0 0x7f79c40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:19.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.793+0000 7f79e1880640 1 -- 172.21.15.5:0/1879594777 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588eea15070 msgr2=0x5588eedba310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:19.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.793+0000 7f79e1880640 1 --2- 172.21.15.5:0/1879594777 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588eea15070 0x5588eedba310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:19.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.793+0000 7f79e1880640 1 -- 172.21.15.5:0/1879594777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588ee9f4390 msgr2=0x5588eedbad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:19.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.793+0000 7f79e1880640 1 --2- 172.21.15.5:0/1879594777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588ee9f4390 0x5588eedbad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:19.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.793+0000 7f79e1880640 1 -- 172.21.15.5:0/1879594777 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588eea80650 con 0x5588ee9ec1b0 2024-08-31T05:40:19.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.793+0000 7f79daffd640 1 -- 172.21.15.5:0/108990428 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7f79d40e5840 con 0x7f79dc109ba0 2024-08-31T05:40:19.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.793+0000 7f79e1880640 1 --2- 172.21.15.5:0/1879594777 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588ee9ec1b0 0x5588eedba850 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f79cc0114c0 tx=0x7f79cc009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ba81a57c4146c86 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:19.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.794+0000 7f79c3fff640 1 -- 172.21.15.5:0/1879594777 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79cc01e070 con 0x5588ee9ec1b0 2024-08-31T05:40:19.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.794+0000 7f79e2081640 1 --2- 172.21.15.5:0/108990428 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f79c40b4ca0 0x7f79c40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:19.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.794+0000 7f79c3fff640 1 -- 172.21.15.5:0/1879594777 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f79cc00fa50 con 0x5588ee9ec1b0 2024-08-31T05:40:19.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.794+0000 7f79c3fff640 1 -- 172.21.15.5:0/1879594777 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79cc019ae0 con 0x5588ee9ec1b0 2024-08-31T05:40:19.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.794+0000 7f79ea059740 1 -- 172.21.15.5:0/1879594777 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588ee9ec1b0 msgr2=0x5588eedba850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:19.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.794+0000 7f79e2081640 1 --2- 172.21.15.5:0/108990428 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f79c40b4ca0 0x7f79c40b71b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f79d40e2c10 tx=0x7f79d4005460 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:19.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.794+0000 7f79ea059740 1 --2- 172.21.15.5:0/1879594777 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588ee9ec1b0 0x5588eedba850 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f79cc0114c0 tx=0x7f79cc009f90 comp rx=0 tx=0).stop 2024-08-31T05:40:19.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.795+0000 7f79ea059740 1 -- 172.21.15.5:0/1879594777 shutdown_connections 2024-08-31T05:40:19.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.795+0000 7f79ea059740 1 --2- 172.21.15.5:0/1879594777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588ee9f4390 0x5588eedbad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:19.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.795+0000 7f79ea059740 1 --2- 172.21.15.5:0/1879594777 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588ee9ec1b0 0x5588eedba850 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:19.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.795+0000 7f79ea059740 1 --2- 172.21.15.5:0/1879594777 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588eea15070 0x5588eedba310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:19.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.795+0000 7f79ea059740 1 -- 172.21.15.5:0/1879594777 >> 172.21.15.5:0/1879594777 conn(0x5588eea09460 msgr2=0x5588eedb8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:19.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.795+0000 7f79ea059740 1 -- 172.21.15.5:0/1879594777 shutdown_connections 2024-08-31T05:40:19.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.795+0000 7f79ea059740 1 -- 172.21.15.5:0/1879594777 wait complete. 2024-08-31T05:40:19.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.795+0000 7f79ea059740 1 -- start start 2024-08-31T05:40:19.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.795+0000 7f79ea059740 1 Processor -- start 2024-08-31T05:40:19.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.796+0000 7f79ea059740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588ee9ec1b0 0x5588eedc5a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:19.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.796+0000 7f79ea059740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588ee9f4390 0x5588eedc5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:19.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.796+0000 7f79ea059740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588eea15070 0x5588eedd1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:19.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.796+0000 7f79ea059740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5588eeb83700 con 0x5588eea15070 2024-08-31T05:40:19.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.796+0000 7f79ea059740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5588eeca7750 con 0x5588ee9f4390 2024-08-31T05:40:19.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.796+0000 7f79ea059740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5588eedc8af0 con 0x5588ee9ec1b0 2024-08-31T05:40:19.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.796+0000 7f79ea059740 10 client.0 _ll_register_callbacks cb 0x5588eecd6e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:40:19.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.796+0000 7f79e107f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588eea15070 0x5588eedd1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:19.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.796+0000 7f79e1880640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588ee9f4390 0x5588eedc5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:19.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.796+0000 7f79e107f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588eea15070 0x5588eedd1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43256/0 (socket says 172.21.15.5:43256) 2024-08-31T05:40:19.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.796+0000 7f79e107f640 1 -- 172.21.15.5:0/1582924801 learned_addr learned my addr 172.21.15.5:0/1582924801 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:19.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.796+0000 7f79e107f640 1 --2- 172.21.15.5:0/1582924801 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588ee9ec1b0 0x5588eedc5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:19.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.796+0000 7f79e107f640 1 -- 172.21.15.5:0/1582924801 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588ee9ec1b0 msgr2=0x5588eedc5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:19.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.796+0000 7f79e107f640 1 --2- 172.21.15.5:0/1582924801 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588ee9ec1b0 0x5588eedc5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:19.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.796+0000 7f79e107f640 1 -- 172.21.15.5:0/1582924801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588ee9f4390 msgr2=0x5588eedc5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:19.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.796+0000 7f79e107f640 1 --2- 172.21.15.5:0/1582924801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588ee9f4390 0x5588eedc5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:19.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.796+0000 7f79e107f640 1 -- 172.21.15.5:0/1582924801 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588eece0900 con 0x5588eea15070 2024-08-31T05:40:19.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.796+0000 7f79e1880640 1 --2- 172.21.15.5:0/1582924801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588ee9f4390 0x5588eedc5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:40:19.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.796+0000 7f79e107f640 1 --2- 172.21.15.5:0/1582924801 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588eea15070 0x5588eedd1de0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f79d002a930 tx=0x7f79d0043040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36f966b583a74ca7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:19.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.796+0000 7f79c17fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:40:19.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.797+0000 7f79c17fa640 1 -- 172.21.15.5:0/1582924801 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d0035070 con 0x5588eea15070 2024-08-31T05:40:19.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.797+0000 7f79c17fa640 1 -- 172.21.15.5:0/1582924801 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7f79d00318b0 con 0x5588eea15070 2024-08-31T05:40:19.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.797+0000 7f79ea059740 1 -- 172.21.15.5:0/1582924801 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79cc00fa50 con 0x5588eea15070 2024-08-31T05:40:19.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.797+0000 7f79c17fa640 1 -- 172.21.15.5:0/1582924801 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f79d0055050 con 0x5588eea15070 2024-08-31T05:40:19.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.797+0000 7f79ea059740 10 client.18336 fetch_fsmap learned FSMap version 34 2024-08-31T05:40:19.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.797+0000 7f79ea059740 1 -- 172.21.15.5:0/1582924801 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5588eedd4830 con 0x5588eea15070 2024-08-31T05:40:19.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.797+0000 7f79c17fa640 1 -- 172.21.15.5:0/1582924801 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f79cc00fa50 con 0x5588eea15070 2024-08-31T05:40:19.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.797+0000 7f79c17fa640 1 -- 172.21.15.5:0/1582924801 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f79d003d910 con 0x5588eea15070 2024-08-31T05:40:19.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.797+0000 7f79ea059740 10 client.18336 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:40:19.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.797+0000 7f79ea059740 10 client.18336 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-31T05:40:19.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.797+0000 7f79ea059740 20 client.18336 populate_metadata read hostname 'smithi005' 2024-08-31T05:40:19.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.797+0000 7f79ea059740 1 --2- 172.21.15.5:0/1582924801 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x5588ee9d39f0 0x5588eedd7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:19.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.797+0000 7f79ea059740 4 client.18336 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:40:19.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.797+0000 7f79ea059740 1 -- 172.21.15.5:0/1582924801 --> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5588eed335d0 con 0x5588ee9d39f0 2024-08-31T05:40:19.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.798+0000 7f79e1880640 1 --2- 172.21.15.5:0/1582924801 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x5588ee9d39f0 0x5588eedd7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:19.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.798+0000 7f79c17fa640 10 client.18336 ms_handle_connect on v2:172.21.15.50:6838/98200944 2024-08-31T05:40:19.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.798+0000 7f79e1880640 1 --2- 172.21.15.5:0/1582924801 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x5588ee9d39f0 0x5588eedd7d40 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e0ea8c5909a29a9 server_cookie=11ca79b540cf62de in_seq=0 out_seq=0 2024-08-31T05:40:19.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.799+0000 7f79c17fa640 1 -- 172.21.15.5:0/1582924801 <== mds.1 v2:172.21.15.50:6838/98200944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5588eed335d0 con 0x5588ee9d39f0 2024-08-31T05:40:19.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.799+0000 7f79c17fa640 10 client.18336 handle_command_reply: tid=0 2024-08-31T05:40:19.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.799+0000 7f79ea059740 1 client.18336 shutdown 2024-08-31T05:40:19.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.799+0000 7f79ea059740 1 -- 172.21.15.5:0/1582924801 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588eea15070 msgr2=0x5588eedd1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:19.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.799+0000 7f79ea059740 1 --2- 172.21.15.5:0/1582924801 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588eea15070 0x5588eedd1de0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f79d002a930 tx=0x7f79d0043040 comp rx=0 tx=0).stop 2024-08-31T05:40:19.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.799+0000 7f79ea059740 1 -- 172.21.15.5:0/1582924801 shutdown_connections 2024-08-31T05:40:19.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.799+0000 7f79ea059740 1 --2- 172.21.15.5:0/1582924801 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x5588ee9d39f0 0x5588eedd7d40 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:19.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.799+0000 7f79ea059740 1 --2- 172.21.15.5:0/1582924801 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588eea15070 0x5588eedd1de0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:19.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.799+0000 7f79ea059740 1 --2- 172.21.15.5:0/1582924801 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588ee9f4390 0x5588eedc5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:19.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.799+0000 7f79ea059740 1 --2- 172.21.15.5:0/1582924801 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588ee9ec1b0 0x5588eedc5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:19.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.799+0000 7f79c17fa640 0 client.18336 ms_handle_reset on v2:172.21.15.50:6838/98200944 2024-08-31T05:40:19.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.799+0000 7f79ea059740 1 -- 172.21.15.5:0/1582924801 >> 172.21.15.5:0/1582924801 conn(0x5588eea09460 msgr2=0x5588eedbd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:19.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.799+0000 7f79ea059740 1 -- 172.21.15.5:0/1582924801 shutdown_connections 2024-08-31T05:40:19.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.799+0000 7f79ea059740 1 -- 172.21.15.5:0/1582924801 wait complete. 2024-08-31T05:40:19.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.799+0000 7f79ea059740 20 client.18336 trim_cache size 0 max 16384 2024-08-31T05:40:19.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.813+0000 7f79ea059740 1 Processor -- start 2024-08-31T05:40:19.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.813+0000 7f79ea059740 1 -- start start 2024-08-31T05:40:19.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.814+0000 7f79ea059740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588ee9ec1b0 0x5588eedc5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:19.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.814+0000 7f79ea059740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588ee9f4390 0x5588eedbba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:19.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.814+0000 7f79ea059740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588eea15070 0x5588eedb77d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:19.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.814+0000 7f79ea059740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f79dc1b2f10 con 0x5588ee9ec1b0 2024-08-31T05:40:19.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.814+0000 7f79ea059740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f79dc1b4a50 con 0x5588eea15070 2024-08-31T05:40:19.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.814+0000 7f79ea059740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f79dc1b35e0 con 0x5588ee9f4390 2024-08-31T05:40:19.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.814+0000 7f79e107f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588ee9ec1b0 0x5588eedc5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:19.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.814+0000 7f79e107f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588ee9ec1b0 0x5588eedc5fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43262/0 (socket says 172.21.15.5:43262) 2024-08-31T05:40:19.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.814+0000 7f79e107f640 1 -- 172.21.15.5:0/3680917185 learned_addr learned my addr 172.21.15.5:0/3680917185 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:19.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.814+0000 7f79e1880640 1 --2- 172.21.15.5:0/3680917185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588ee9f4390 0x5588eedbba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:19.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.814+0000 7f79e107f640 1 --2- 172.21.15.5:0/3680917185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588eea15070 0x5588eedb77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:19.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.814+0000 7f79e107f640 1 -- 172.21.15.5:0/3680917185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588ee9f4390 msgr2=0x5588eedbba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:19.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.814+0000 7f79e107f640 1 --2- 172.21.15.5:0/3680917185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588ee9f4390 0x5588eedbba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:19.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.814+0000 7f79e107f640 1 -- 172.21.15.5:0/3680917185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588eea15070 msgr2=0x5588eedb77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:19.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.814+0000 7f79e107f640 1 --2- 172.21.15.5:0/3680917185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588eea15070 0x5588eedb77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:19.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.814+0000 7f79e107f640 1 -- 172.21.15.5:0/3680917185 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588eedbc600 con 0x5588ee9ec1b0 2024-08-31T05:40:19.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.814+0000 7f79e1880640 1 --2- 172.21.15.5:0/3680917185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588ee9f4390 0x5588eedbba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:40:19.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.814+0000 7f79e107f640 1 --2- 172.21.15.5:0/3680917185 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588ee9ec1b0 0x5588eedc5fe0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f79d0009850 tx=0x7f79d0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25a2c3112adebfd1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:19.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.814+0000 7f79c37fe640 1 -- 172.21.15.5:0/3680917185 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d0035070 con 0x5588ee9ec1b0 2024-08-31T05:40:19.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.815+0000 7f79c37fe640 1 -- 172.21.15.5:0/3680917185 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f79d003db00 con 0x5588ee9ec1b0 2024-08-31T05:40:19.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.815+0000 7f79c37fe640 1 -- 172.21.15.5:0/3680917185 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d0031e00 con 0x5588ee9ec1b0 2024-08-31T05:40:19.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.815+0000 7f79ea059740 1 -- 172.21.15.5:0/3680917185 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588ee9ec1b0 msgr2=0x5588eedc5fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:19.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.815+0000 7f79ea059740 1 --2- 172.21.15.5:0/3680917185 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588ee9ec1b0 0x5588eedc5fe0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f79d0009850 tx=0x7f79d0003c10 comp rx=0 tx=0).stop 2024-08-31T05:40:19.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.815+0000 7f79ea059740 1 -- 172.21.15.5:0/3680917185 shutdown_connections 2024-08-31T05:40:19.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.815+0000 7f79ea059740 1 --2- 172.21.15.5:0/3680917185 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588eea15070 0x5588eedb77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:19.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.815+0000 7f79ea059740 1 --2- 172.21.15.5:0/3680917185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588ee9f4390 0x5588eedbba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:19.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.815+0000 7f79ea059740 1 --2- 172.21.15.5:0/3680917185 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588ee9ec1b0 0x5588eedc5fe0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:19.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.815+0000 7f79ea059740 1 -- 172.21.15.5:0/3680917185 >> 172.21.15.5:0/3680917185 conn(0x5588eea09460 msgr2=0x5588eedbb340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:19.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.816+0000 7f79ea059740 1 -- 172.21.15.5:0/3680917185 shutdown_connections 2024-08-31T05:40:19.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.816+0000 7f79ea059740 1 -- 172.21.15.5:0/3680917185 wait complete. 2024-08-31T05:40:19.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.816+0000 7f79ea059740 1 -- start start 2024-08-31T05:40:19.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.816+0000 7f79ea059740 1 Processor -- start 2024-08-31T05:40:19.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.817+0000 7f79ea059740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588ee9ec1b0 0x5588eedce6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:19.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.817+0000 7f79ea059740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588ee9f4390 0x5588eedc9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:19.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.817+0000 7f79ea059740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588eea15070 0x5588eedca250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:19.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.817+0000 7f79e1880640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588ee9f4390 0x5588eedc9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:19.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.817+0000 7f79e1880640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588ee9f4390 0x5588eedc9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:53330/0 (socket says 172.21.15.5:53330) 2024-08-31T05:40:19.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.817+0000 7f79ea059740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f79dc1b4380 con 0x5588ee9ec1b0 2024-08-31T05:40:19.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.817+0000 7f79e1880640 1 -- 172.21.15.5:0/2697072983 learned_addr learned my addr 172.21.15.5:0/2697072983 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:19.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.817+0000 7f79ea059740 1 -- 172.21.15.5:0/2697072983 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f79dc1b3cb0 con 0x5588ee9f4390 2024-08-31T05:40:19.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.817+0000 7f79e107f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588ee9ec1b0 0x5588eedce6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:19.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.817+0000 7f79ea059740 1 -- 172.21.15.5:0/2697072983 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f79dc1b0f10 con 0x5588eea15070 2024-08-31T05:40:19.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.817+0000 7f79ea059740 10 client.0 _ll_register_callbacks cb 0x7f79d0003b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:40:19.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.817+0000 7f79e107f640 1 --2- 172.21.15.5:0/2697072983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588eea15070 0x5588eedca250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:19.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.817+0000 7f79e107f640 1 -- 172.21.15.5:0/2697072983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588eea15070 msgr2=0x5588eedca250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:19.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.817+0000 7f79e107f640 1 --2- 172.21.15.5:0/2697072983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588eea15070 0x5588eedca250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:19.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.817+0000 7f79e107f640 1 -- 172.21.15.5:0/2697072983 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588ee9f4390 msgr2=0x5588eedc9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:19.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.817+0000 7f79e107f640 1 --2- 172.21.15.5:0/2697072983 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588ee9f4390 0x5588eedc9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:19.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.817+0000 7f79e107f640 1 -- 172.21.15.5:0/2697072983 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588eee41750 con 0x5588ee9ec1b0 2024-08-31T05:40:19.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.817+0000 7f79e107f640 1 --2- 172.21.15.5:0/2697072983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588ee9ec1b0 0x5588eedce6b0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f79d003dd60 tx=0x7f79d0005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4071763230490927 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:19.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.817+0000 7f79c17fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:40:19.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.818+0000 7f79c17fa640 1 -- 172.21.15.5:0/2697072983 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d0035040 con 0x5588ee9ec1b0 2024-08-31T05:40:19.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.818+0000 7f79c17fa640 1 -- 172.21.15.5:0/2697072983 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7f79d0031d90 con 0x5588ee9ec1b0 2024-08-31T05:40:19.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.818+0000 7f79ea059740 1 -- 172.21.15.5:0/2697072983 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79d003db00 con 0x5588ee9ec1b0 2024-08-31T05:40:19.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.818+0000 7f79c17fa640 1 -- 172.21.15.5:0/2697072983 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f79d003d450 con 0x5588ee9ec1b0 2024-08-31T05:40:19.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.818+0000 7f79ea059740 10 client.18342 fetch_fsmap learned FSMap version 34 2024-08-31T05:40:19.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.818+0000 7f79ea059740 1 -- 172.21.15.5:0/2697072983 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5588eee427c0 con 0x5588ee9ec1b0 2024-08-31T05:40:19.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.818+0000 7f79c17fa640 1 -- 172.21.15.5:0/2697072983 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f79d003db00 con 0x5588ee9ec1b0 2024-08-31T05:40:19.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.818+0000 7f79c17fa640 1 -- 172.21.15.5:0/2697072983 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f79d003cc30 con 0x5588ee9ec1b0 2024-08-31T05:40:19.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.818+0000 7f79ea059740 10 client.18342 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:40:19.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.818+0000 7f79ea059740 10 client.18342 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-31T05:40:19.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.818+0000 7f79ea059740 20 client.18342 populate_metadata read hostname 'smithi005' 2024-08-31T05:40:19.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.818+0000 7f79ea059740 1 --2- 172.21.15.5:0/2697072983 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x5588ee9a8da0 0x5588eee44db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:19.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.818+0000 7f79ea059740 4 client.18342 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:40:19.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.818+0000 7f79ea059740 1 -- 172.21.15.5:0/2697072983 --> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5588eed2f070 con 0x5588ee9a8da0 2024-08-31T05:40:19.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.819+0000 7f79e1880640 1 --2- 172.21.15.5:0/2697072983 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x5588ee9a8da0 0x5588eee44db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:19.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.819+0000 7f79c17fa640 10 client.18342 ms_handle_connect on v2:172.21.15.50:6838/98200944 2024-08-31T05:40:19.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.819+0000 7f79e1880640 1 --2- 172.21.15.5:0/2697072983 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x5588ee9a8da0 0x5588eee44db0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f951dd6b75fbd573 server_cookie=77bde9044b246bdf in_seq=0 out_seq=0 2024-08-31T05:40:19.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.819+0000 7f79c17fa640 1 -- 172.21.15.5:0/2697072983 <== mds.1 v2:172.21.15.50:6838/98200944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5588eed2f070 con 0x5588ee9a8da0 2024-08-31T05:40:19.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.819+0000 7f79c17fa640 10 client.18342 handle_command_reply: tid=0 2024-08-31T05:40:19.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.819+0000 7f79ea059740 1 client.18342 shutdown 2024-08-31T05:40:19.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.820+0000 7f79ea059740 1 -- 172.21.15.5:0/2697072983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588ee9ec1b0 msgr2=0x5588eedce6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:19.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.820+0000 7f79ea059740 1 --2- 172.21.15.5:0/2697072983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588ee9ec1b0 0x5588eedce6b0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f79d003dd60 tx=0x7f79d0005780 comp rx=0 tx=0).stop 2024-08-31T05:40:19.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.820+0000 7f79ea059740 1 -- 172.21.15.5:0/2697072983 shutdown_connections 2024-08-31T05:40:19.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.820+0000 7f79ea059740 1 --2- 172.21.15.5:0/2697072983 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x5588ee9a8da0 0x5588eee44db0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:19.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.820+0000 7f79ea059740 1 --2- 172.21.15.5:0/2697072983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588eea15070 0x5588eedca250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:19.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.820+0000 7f79ea059740 1 --2- 172.21.15.5:0/2697072983 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5588ee9f4390 0x5588eedc9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:19.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.820+0000 7f79c17fa640 0 client.18342 ms_handle_reset on v2:172.21.15.50:6838/98200944 2024-08-31T05:40:19.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.820+0000 7f79ea059740 1 --2- 172.21.15.5:0/2697072983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588ee9ec1b0 0x5588eedce6b0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:19.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.820+0000 7f79ea059740 1 -- 172.21.15.5:0/2697072983 >> 172.21.15.5:0/2697072983 conn(0x5588eea09460 msgr2=0x5588eedbbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:19.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.820+0000 7f79ea059740 1 -- 172.21.15.5:0/2697072983 shutdown_connections 2024-08-31T05:40:19.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.820+0000 7f79ea059740 1 -- 172.21.15.5:0/2697072983 wait complete. 2024-08-31T05:40:19.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.820+0000 7f79ea059740 20 client.18342 trim_cache size 0 max 16384 2024-08-31T05:40:19.838 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:40:19.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.820+0000 7f79e3ae4640 1 -- 172.21.15.5:0/108990428 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f79c40b4ca0 msgr2=0x7f79c40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:19.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.820+0000 7f79e3ae4640 1 --2- 172.21.15.5:0/108990428 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f79c40b4ca0 0x7f79c40b71b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f79d40e2c10 tx=0x7f79d4005460 comp rx=0 tx=0).stop 2024-08-31T05:40:19.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.820+0000 7f79e3ae4640 1 -- 172.21.15.5:0/108990428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79dc109ba0 msgr2=0x7f79dc075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:19.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.820+0000 7f79e3ae4640 1 --2- 172.21.15.5:0/108990428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79dc109ba0 0x7f79dc075f30 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f79d400e970 tx=0x7f79d400ee30 comp rx=0 tx=0).stop 2024-08-31T05:40:19.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.821+0000 7f79e3ae4640 1 -- 172.21.15.5:0/108990428 shutdown_connections 2024-08-31T05:40:19.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.821+0000 7f79e3ae4640 1 --2- 172.21.15.5:0/108990428 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f79c40b4ca0 0x7f79c40b71b0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:19.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.821+0000 7f79e3ae4640 1 --2- 172.21.15.5:0/108990428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79dc109ba0 0x7f79dc075f30 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:19.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.821+0000 7f79e3ae4640 1 --2- 172.21.15.5:0/108990428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f79dc109250 0x7f79dc0759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:19.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.821+0000 7f79e3ae4640 1 --2- 172.21.15.5:0/108990428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79dc103960 0x7f79dc0754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:19.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.821+0000 7f79e3ae4640 1 -- 172.21.15.5:0/108990428 >> 172.21.15.5:0/108990428 conn(0x7f79dc07b6b0 msgr2=0x7f79dc105320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:19.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.821+0000 7f79e3ae4640 1 -- 172.21.15.5:0/108990428 shutdown_connections 2024-08-31T05:40:19.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:19.821+0000 7f79e3ae4640 1 -- 172.21.15.5:0/108990428 wait complete. 2024-08-31T05:40:19.935 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1165285 10.97 MB/sec execute 427 sec latency 73.918 ms 2024-08-31T05:40:20.533 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T05:40:20.792 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:40:20.935 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1166685 10.96 MB/sec execute 428 sec latency 41.398 ms 2024-08-31T05:40:21.156 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:40:20 smithi050 ceph-mon[22146]: pgmap v664: 129 pgs: 129 active+clean; 588 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.1 MiB/s wr, 208 op/s 2024-08-31T05:40:21.213 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:40:20 smithi005 ceph-mon[18602]: pgmap v664: 129 pgs: 129 active+clean; 588 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.1 MiB/s wr, 208 op/s 2024-08-31T05:40:21.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.310+0000 7f6613771640 1 -- 172.21.15.5:0/2403092545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f660c109250 msgr2=0x7f660c109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:21.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.310+0000 7f6613771640 1 --2- 172.21.15.5:0/2403092545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f660c109250 0x7f660c109660 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f65fc009860 tx=0x7f65fc02a340 comp rx=0 tx=0).stop 2024-08-31T05:40:21.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.310+0000 7f6613771640 1 -- 172.21.15.5:0/2403092545 shutdown_connections 2024-08-31T05:40:21.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.310+0000 7f6613771640 1 --2- 172.21.15.5:0/2403092545 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f660c109ba0 0x7f660c1103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:21.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.310+0000 7f6613771640 1 --2- 172.21.15.5:0/2403092545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f660c109250 0x7f660c109660 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:21.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.310+0000 7f6613771640 1 --2- 172.21.15.5:0/2403092545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f660c101d10 0x7f660c102120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:21.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.310+0000 7f6613771640 1 -- 172.21.15.5:0/2403092545 >> 172.21.15.5:0/2403092545 conn(0x7f660c077a00 msgr2=0x7f660c077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:21.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.310+0000 7f6613771640 1 -- 172.21.15.5:0/2403092545 shutdown_connections 2024-08-31T05:40:21.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.310+0000 7f6613771640 1 -- 172.21.15.5:0/2403092545 wait complete. 2024-08-31T05:40:21.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.311+0000 7f6613771640 1 Processor -- start 2024-08-31T05:40:21.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.311+0000 7f6613771640 1 -- start start 2024-08-31T05:40:21.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.311+0000 7f6613771640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f660c101d10 0x7f660c19a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:21.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.311+0000 7f6613771640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f660c109250 0x7f660c19a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:21.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.311+0000 7f6613771640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f660c109ba0 0x7f660c19fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:21.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.311+0000 7f6613771640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f660c113860 con 0x7f660c109ba0 2024-08-31T05:40:21.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.311+0000 7f6613771640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f660c1136e0 con 0x7f660c109250 2024-08-31T05:40:21.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.311+0000 7f6613771640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f660c1139e0 con 0x7f660c101d10 2024-08-31T05:40:21.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.311+0000 7f661150d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f660c101d10 0x7f660c19a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:21.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.311+0000 7f661150d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f660c101d10 0x7f660c19a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:53432/0 (socket says 172.21.15.5:53432) 2024-08-31T05:40:21.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.311+0000 7f661150d640 1 -- 172.21.15.5:0/3140461661 learned_addr learned my addr 172.21.15.5:0/3140461661 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:21.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.311+0000 7f6611d0e640 1 --2- 172.21.15.5:0/3140461661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f660c109ba0 0x7f660c19fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:21.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.311+0000 7f6610d0c640 1 --2- 172.21.15.5:0/3140461661 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f660c109250 0x7f660c19a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:21.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.311+0000 7f661150d640 1 -- 172.21.15.5:0/3140461661 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f660c109250 msgr2=0x7f660c19a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:21.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.311+0000 7f661150d640 1 --2- 172.21.15.5:0/3140461661 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f660c109250 0x7f660c19a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:21.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.311+0000 7f661150d640 1 -- 172.21.15.5:0/3140461661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f660c109ba0 msgr2=0x7f660c19fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:21.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.311+0000 7f661150d640 1 --2- 172.21.15.5:0/3140461661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f660c109ba0 0x7f660c19fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:21.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.311+0000 7f661150d640 1 -- 172.21.15.5:0/3140461661 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f660c1a01c0 con 0x7f660c101d10 2024-08-31T05:40:21.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.311+0000 7f6610d0c640 1 --2- 172.21.15.5:0/3140461661 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f660c109250 0x7f660c19a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:40:21.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.312+0000 7f661150d640 1 --2- 172.21.15.5:0/3140461661 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f660c101d10 0x7f660c19a250 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f660800e9c0 tx=0x7f660800edc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:21.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.312+0000 7f66027fc640 1 -- 172.21.15.5:0/3140461661 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f660800cd80 con 0x7f660c101d10 2024-08-31T05:40:21.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.312+0000 7f6613771640 1 -- 172.21.15.5:0/3140461661 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f660c1a04b0 con 0x7f660c101d10 2024-08-31T05:40:21.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.312+0000 7f66027fc640 1 -- 172.21.15.5:0/3140461661 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66080035f0 con 0x7f660c101d10 2024-08-31T05:40:21.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.312+0000 7f66027fc640 1 -- 172.21.15.5:0/3140461661 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6608010690 con 0x7f660c101d10 2024-08-31T05:40:21.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.312+0000 7f6613771640 1 -- 172.21.15.5:0/3140461661 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f660c1a6c10 con 0x7f660c101d10 2024-08-31T05:40:21.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.315+0000 7f6619ce6740 1 Processor -- start 2024-08-31T05:40:21.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.315+0000 7f6619ce6740 1 -- start start 2024-08-31T05:40:21.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.315+0000 7f6619ce6740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e4ee5f2070 0x55e4ee997350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:21.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.315+0000 7f6619ce6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e4ee5c91b0 0x55e4ee997890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:21.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.315+0000 7f6619ce6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e4ee5d1390 0x55e4ee997dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:21.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.315+0000 7f6619ce6740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55e4ee90e680 con 0x55e4ee5f2070 2024-08-31T05:40:21.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.315+0000 7f6619ce6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e4ee8fdc10 con 0x55e4ee5c91b0 2024-08-31T05:40:21.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.315+0000 7f6619ce6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e4ee901bc0 con 0x55e4ee5d1390 2024-08-31T05:40:21.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.315+0000 7f6611d0e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e4ee5f2070 0x55e4ee997350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:21.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.315+0000 7f66027fc640 1 -- 172.21.15.5:0/3140461661 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f6608003fb0 con 0x7f660c101d10 2024-08-31T05:40:21.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.315+0000 7f6611d0e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e4ee5f2070 0x55e4ee997350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43298/0 (socket says 172.21.15.5:43298) 2024-08-31T05:40:21.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.315+0000 7f6611d0e640 1 -- 172.21.15.5:0/3395358012 learned_addr learned my addr 172.21.15.5:0/3395358012 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:21.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.315+0000 7f6610d0c640 1 --2- 172.21.15.5:0/3395358012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e4ee5d1390 0x55e4ee997dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:21.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.316+0000 7f661150d640 1 --2- 172.21.15.5:0/3395358012 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e4ee5c91b0 0x55e4ee997890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:21.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.316+0000 7f6611d0e640 1 -- 172.21.15.5:0/3395358012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e4ee5d1390 msgr2=0x55e4ee997dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:21.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.316+0000 7f6611d0e640 1 --2- 172.21.15.5:0/3395358012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e4ee5d1390 0x55e4ee997dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:21.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.316+0000 7f6611d0e640 1 -- 172.21.15.5:0/3395358012 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e4ee5c91b0 msgr2=0x55e4ee997890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:21.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.316+0000 7f6611d0e640 1 --2- 172.21.15.5:0/3395358012 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e4ee5c91b0 0x55e4ee997890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:21.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.316+0000 7f6611d0e640 1 -- 172.21.15.5:0/3395358012 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4ee65d650 con 0x55e4ee5f2070 2024-08-31T05:40:21.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.316+0000 7f661150d640 1 --2- 172.21.15.5:0/3395358012 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e4ee5c91b0 0x55e4ee997890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:40:21.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.316+0000 7f6611d0e640 1 --2- 172.21.15.5:0/3395358012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e4ee5f2070 0x55e4ee997350 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f6604011440 tx=0x7f6604011900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5699457af6dd65fb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:21.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.316+0000 7f65f77fe640 1 -- 172.21.15.5:0/3395358012 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6604003c30 con 0x55e4ee5f2070 2024-08-31T05:40:21.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.316+0000 7f65f77fe640 1 -- 172.21.15.5:0/3395358012 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f660401e070 con 0x55e4ee5f2070 2024-08-31T05:40:21.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.316+0000 7f66027fc640 1 --2- 172.21.15.5:0/3140461661 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f65f80b4ca0 0x7f65f80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:21.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.317+0000 7f65f77fe640 1 -- 172.21.15.5:0/3395358012 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66040045d0 con 0x55e4ee5f2070 2024-08-31T05:40:21.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.317+0000 7f661150d640 1 --2- 172.21.15.5:0/3140461661 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f65f80b4ca0 0x7f65f80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:21.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.317+0000 7f66027fc640 1 -- 172.21.15.5:0/3140461661 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7f66080e5c90 con 0x7f660c101d10 2024-08-31T05:40:21.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.317+0000 7f6619ce6740 1 -- 172.21.15.5:0/3395358012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e4ee5f2070 msgr2=0x55e4ee997350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:21.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.317+0000 7f6619ce6740 1 --2- 172.21.15.5:0/3395358012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e4ee5f2070 0x55e4ee997350 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f6604011440 tx=0x7f6604011900 comp rx=0 tx=0).stop 2024-08-31T05:40:21.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.317+0000 7f661150d640 1 --2- 172.21.15.5:0/3140461661 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f65f80b4ca0 0x7f65f80b71b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f66080e30b0 tx=0x7f6608093040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:21.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.317+0000 7f6619ce6740 1 -- 172.21.15.5:0/3395358012 shutdown_connections 2024-08-31T05:40:21.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.317+0000 7f6619ce6740 1 --2- 172.21.15.5:0/3395358012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e4ee5d1390 0x55e4ee997dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:21.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.317+0000 7f6619ce6740 1 --2- 172.21.15.5:0/3395358012 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e4ee5c91b0 0x55e4ee997890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:21.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.317+0000 7f6619ce6740 1 --2- 172.21.15.5:0/3395358012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e4ee5f2070 0x55e4ee997350 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:21.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.317+0000 7f6619ce6740 1 -- 172.21.15.5:0/3395358012 >> 172.21.15.5:0/3395358012 conn(0x55e4ee5e6460 msgr2=0x55e4ee995240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:21.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.317+0000 7f6619ce6740 1 -- 172.21.15.5:0/3395358012 shutdown_connections 2024-08-31T05:40:21.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.318+0000 7f6619ce6740 1 -- 172.21.15.5:0/3395358012 wait complete. 2024-08-31T05:40:21.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.318+0000 7f6619ce6740 1 -- start start 2024-08-31T05:40:21.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.318+0000 7f6619ce6740 1 Processor -- start 2024-08-31T05:40:21.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.318+0000 7f6619ce6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e4ee5c91b0 0x55e4ee9a2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:21.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.318+0000 7f6619ce6740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e4ee5d1390 0x55e4ee9a34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:21.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.318+0000 7f6619ce6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e4ee5f2070 0x55e4ee9a86d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:21.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.319+0000 7f6619ce6740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55e4ee760700 con 0x55e4ee5d1390 2024-08-31T05:40:21.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.319+0000 7f6619ce6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e4ee884750 con 0x55e4ee5f2070 2024-08-31T05:40:21.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.319+0000 7f6619ce6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e4ee99d910 con 0x55e4ee5c91b0 2024-08-31T05:40:21.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.319+0000 7f6619ce6740 10 client.0 _ll_register_callbacks cb 0x55e4ee8b3e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:40:21.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.319+0000 7f6611d0e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e4ee5c91b0 0x55e4ee9a2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:21.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.319+0000 7f6610d0c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e4ee5d1390 0x55e4ee9a34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:21.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.319+0000 7f6611d0e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e4ee5c91b0 0x55e4ee9a2f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:53448/0 (socket says 172.21.15.5:53448) 2024-08-31T05:40:21.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.319+0000 7f6611d0e640 1 -- 172.21.15.5:0/1149037638 learned_addr learned my addr 172.21.15.5:0/1149037638 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:21.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.319+0000 7f6611d0e640 1 --2- 172.21.15.5:0/1149037638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e4ee5f2070 0x55e4ee9a86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:21.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.319+0000 7f6610d0c640 1 -- 172.21.15.5:0/1149037638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e4ee5c91b0 msgr2=0x55e4ee9a2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:21.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.319+0000 7f6610d0c640 1 --2- 172.21.15.5:0/1149037638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e4ee5c91b0 0x55e4ee9a2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:21.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.319+0000 7f6610d0c640 1 -- 172.21.15.5:0/1149037638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e4ee5f2070 msgr2=0x55e4ee9a86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:21.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.319+0000 7f6610d0c640 1 --2- 172.21.15.5:0/1149037638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e4ee5f2070 0x55e4ee9a86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:21.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.319+0000 7f6610d0c640 1 -- 172.21.15.5:0/1149037638 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4ee8bd900 con 0x55e4ee5d1390 2024-08-31T05:40:21.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.319+0000 7f6611d0e640 1 --2- 172.21.15.5:0/1149037638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e4ee5c91b0 0x55e4ee9a2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:40:21.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.319+0000 7f6610d0c640 1 --2- 172.21.15.5:0/1149037638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e4ee5d1390 0x55e4ee9a34a0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f65fc02a860 tx=0x7f65fc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d011b46334703388 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:21.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.319+0000 7f65f4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:40:21.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.319+0000 7f65f4ff9640 1 -- 172.21.15.5:0/1149037638 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65fc037040 con 0x55e4ee5d1390 2024-08-31T05:40:21.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.319+0000 7f65f4ff9640 1 -- 172.21.15.5:0/1149037638 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7f65fc030450 con 0x55e4ee5d1390 2024-08-31T05:40:21.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.319+0000 7f6619ce6740 1 -- 172.21.15.5:0/1149037638 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f660401e070 con 0x55e4ee5d1390 2024-08-31T05:40:21.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.320+0000 7f65f4ff9640 1 -- 172.21.15.5:0/1149037638 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f65fc04b050 con 0x55e4ee5d1390 2024-08-31T05:40:21.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.320+0000 7f6619ce6740 10 client.18354 fetch_fsmap learned FSMap version 34 2024-08-31T05:40:21.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.320+0000 7f6619ce6740 1 -- 172.21.15.5:0/1149037638 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55e4ee9b1810 con 0x55e4ee5d1390 2024-08-31T05:40:21.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.320+0000 7f65f4ff9640 1 -- 172.21.15.5:0/1149037638 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f660401e070 con 0x55e4ee5d1390 2024-08-31T05:40:21.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.320+0000 7f65f4ff9640 1 -- 172.21.15.5:0/1149037638 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f65fc004850 con 0x55e4ee5d1390 2024-08-31T05:40:21.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.320+0000 7f6619ce6740 10 client.18354 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:40:21.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.320+0000 7f6619ce6740 10 client.18354 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:40:21.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.320+0000 7f6619ce6740 20 client.18354 populate_metadata read hostname 'smithi005' 2024-08-31T05:40:21.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.320+0000 7f6619ce6740 1 --2- 172.21.15.5:0/1149037638 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55e4ee5b09f0 0x55e4ee9b4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:21.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.320+0000 7f6619ce6740 4 client.18354 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:40:21.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.320+0000 7f6619ce6740 1 -- 172.21.15.5:0/1149037638 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e4ee9105d0 con 0x55e4ee5b09f0 2024-08-31T05:40:21.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.320+0000 7f6611d0e640 1 --2- 172.21.15.5:0/1149037638 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55e4ee5b09f0 0x55e4ee9b4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:21.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.321+0000 7f6611d0e640 1 --2- 172.21.15.5:0/1149037638 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55e4ee5b09f0 0x55e4ee9b4cd0 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3377061ac8b25b4 server_cookie=1e768fcbf9db55de in_seq=0 out_seq=0 2024-08-31T05:40:21.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.321+0000 7f65f4ff9640 10 client.18354 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:40:21.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.321+0000 7f65f4ff9640 1 -- 172.21.15.5:0/1149037638 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e4ee9105d0 con 0x55e4ee5b09f0 2024-08-31T05:40:21.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.321+0000 7f65f4ff9640 10 client.18354 handle_command_reply: tid=0 2024-08-31T05:40:21.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.322+0000 7f6619ce6740 1 client.18354 shutdown 2024-08-31T05:40:21.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.322+0000 7f6619ce6740 1 -- 172.21.15.5:0/1149037638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e4ee5d1390 msgr2=0x55e4ee9a34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:21.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.322+0000 7f6619ce6740 1 --2- 172.21.15.5:0/1149037638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e4ee5d1390 0x55e4ee9a34a0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f65fc02a860 tx=0x7f65fc004270 comp rx=0 tx=0).stop 2024-08-31T05:40:21.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.322+0000 7f6619ce6740 1 -- 172.21.15.5:0/1149037638 shutdown_connections 2024-08-31T05:40:21.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.322+0000 7f6619ce6740 1 --2- 172.21.15.5:0/1149037638 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55e4ee5b09f0 0x55e4ee9b4cd0 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:21.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.322+0000 7f6619ce6740 1 --2- 172.21.15.5:0/1149037638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e4ee5f2070 0x55e4ee9a86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:21.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.322+0000 7f6619ce6740 1 --2- 172.21.15.5:0/1149037638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e4ee5d1390 0x55e4ee9a34a0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:21.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.322+0000 7f6619ce6740 1 --2- 172.21.15.5:0/1149037638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e4ee5c91b0 0x55e4ee9a2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:21.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.322+0000 7f6619ce6740 1 -- 172.21.15.5:0/1149037638 >> 172.21.15.5:0/1149037638 conn(0x55e4ee5e6460 msgr2=0x55e4ee998d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:21.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.322+0000 7f65f4ff9640 0 client.18354 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:40:21.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.322+0000 7f6619ce6740 1 -- 172.21.15.5:0/1149037638 shutdown_connections 2024-08-31T05:40:21.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.322+0000 7f6619ce6740 1 -- 172.21.15.5:0/1149037638 wait complete. 2024-08-31T05:40:21.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.322+0000 7f6619ce6740 20 client.18354 trim_cache size 0 max 16384 2024-08-31T05:40:21.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:40:20 smithi070 ceph-mon[22316]: pgmap v664: 129 pgs: 129 active+clean; 588 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.1 MiB/s wr, 208 op/s 2024-08-31T05:40:21.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.336+0000 7f6619ce6740 1 Processor -- start 2024-08-31T05:40:21.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.336+0000 7f6619ce6740 1 -- start start 2024-08-31T05:40:21.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.336+0000 7f6619ce6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e4ee5c91b0 0x55e4ee99e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:21.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.336+0000 7f6619ce6740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e4ee5f2070 0x55e4ee99e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:21.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.336+0000 7f6619ce6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e4ee585da0 0x55e4ee994b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:21.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.336+0000 7f6619ce6740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f660c1aeaf0 con 0x55e4ee5f2070 2024-08-31T05:40:21.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.336+0000 7f6619ce6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f660c1b0630 con 0x55e4ee5c91b0 2024-08-31T05:40:21.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.336+0000 7f6619ce6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f660c1af1c0 con 0x55e4ee585da0 2024-08-31T05:40:21.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.337+0000 7f6610d0c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e4ee5f2070 0x55e4ee99e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:21.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.337+0000 7f6610d0c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e4ee5f2070 0x55e4ee99e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43304/0 (socket says 172.21.15.5:43304) 2024-08-31T05:40:21.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.337+0000 7f6610d0c640 1 -- 172.21.15.5:0/2355221437 learned_addr learned my addr 172.21.15.5:0/2355221437 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:21.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.337+0000 7f6611d0e640 1 --2- 172.21.15.5:0/2355221437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e4ee5c91b0 0x55e4ee99e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:21.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.337+0000 7f6611d0e640 1 --2- 172.21.15.5:0/2355221437 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e4ee585da0 0x55e4ee994b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:21.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.337+0000 7f6610d0c640 1 -- 172.21.15.5:0/2355221437 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e4ee585da0 msgr2=0x55e4ee994b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:21.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.337+0000 7f6610d0c640 1 --2- 172.21.15.5:0/2355221437 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e4ee585da0 0x55e4ee994b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:21.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.337+0000 7f6610d0c640 1 -- 172.21.15.5:0/2355221437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e4ee5c91b0 msgr2=0x55e4ee99e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:21.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.337+0000 7f6610d0c640 1 --2- 172.21.15.5:0/2355221437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e4ee5c91b0 0x55e4ee99e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:21.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.337+0000 7f6610d0c640 1 -- 172.21.15.5:0/2355221437 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4ee998140 con 0x55e4ee5f2070 2024-08-31T05:40:21.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.337+0000 7f6610d0c640 1 --2- 172.21.15.5:0/2355221437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e4ee5f2070 0x55e4ee99e5c0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f65fc004c40 tx=0x7f65fc005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e97485279bd57585 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:21.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.337+0000 7f65f6ffd640 1 -- 172.21.15.5:0/2355221437 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65fc037070 con 0x55e4ee5f2070 2024-08-31T05:40:21.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.337+0000 7f65f6ffd640 1 -- 172.21.15.5:0/2355221437 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f65fc030450 con 0x55e4ee5f2070 2024-08-31T05:40:21.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.337+0000 7f65f6ffd640 1 -- 172.21.15.5:0/2355221437 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65fc003ab0 con 0x55e4ee5f2070 2024-08-31T05:40:21.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.338+0000 7f6619ce6740 1 -- 172.21.15.5:0/2355221437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e4ee5f2070 msgr2=0x55e4ee99e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:21.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.338+0000 7f6619ce6740 1 --2- 172.21.15.5:0/2355221437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e4ee5f2070 0x55e4ee99e5c0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f65fc004c40 tx=0x7f65fc005f10 comp rx=0 tx=0).stop 2024-08-31T05:40:21.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.338+0000 7f6619ce6740 1 -- 172.21.15.5:0/2355221437 shutdown_connections 2024-08-31T05:40:21.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.338+0000 7f6619ce6740 1 --2- 172.21.15.5:0/2355221437 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e4ee585da0 0x55e4ee994b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:21.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.338+0000 7f6619ce6740 1 --2- 172.21.15.5:0/2355221437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e4ee5f2070 0x55e4ee99e5c0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:21.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.338+0000 7f6619ce6740 1 --2- 172.21.15.5:0/2355221437 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e4ee5c91b0 0x55e4ee99e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:21.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.338+0000 7f6619ce6740 1 -- 172.21.15.5:0/2355221437 >> 172.21.15.5:0/2355221437 conn(0x55e4ee5e6460 msgr2=0x55e4ee9a86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:21.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.338+0000 7f6619ce6740 1 -- 172.21.15.5:0/2355221437 shutdown_connections 2024-08-31T05:40:21.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.338+0000 7f6619ce6740 1 -- 172.21.15.5:0/2355221437 wait complete. 2024-08-31T05:40:21.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.339+0000 7f6619ce6740 1 -- start start 2024-08-31T05:40:21.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.339+0000 7f6619ce6740 1 Processor -- start 2024-08-31T05:40:21.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.339+0000 7f6619ce6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e4ee585da0 0x55e4ee9af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:21.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.339+0000 7f6619ce6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e4ee5c91b0 0x55e4ee9aa950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:21.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.339+0000 7f6619ce6740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e4ee5f2070 0x55e4ee9aae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:21.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.339+0000 7f6619ce6740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f660c1aff60 con 0x55e4ee5f2070 2024-08-31T05:40:21.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.339+0000 7f6619ce6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f660c1af890 con 0x55e4ee585da0 2024-08-31T05:40:21.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.339+0000 7f6619ce6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f660c1acaf0 con 0x55e4ee5c91b0 2024-08-31T05:40:21.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.339+0000 7f6619ce6740 10 client.0 _ll_register_callbacks cb 0x7f6608005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:40:21.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.339+0000 7f6611d0e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e4ee5f2070 0x55e4ee9aae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:21.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.339+0000 7f6610d0c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e4ee5c91b0 0x55e4ee9aa950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:21.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.339+0000 7f6611d0e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e4ee5f2070 0x55e4ee9aae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43316/0 (socket says 172.21.15.5:43316) 2024-08-31T05:40:21.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.339+0000 7f6611d0e640 1 -- 172.21.15.5:0/453982809 learned_addr learned my addr 172.21.15.5:0/453982809 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:21.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.340+0000 7f6611d0e640 1 --2- 172.21.15.5:0/453982809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e4ee585da0 0x55e4ee9af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:21.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.340+0000 7f6611d0e640 1 -- 172.21.15.5:0/453982809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e4ee5c91b0 msgr2=0x55e4ee9aa950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:21.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.340+0000 7f6611d0e640 1 --2- 172.21.15.5:0/453982809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e4ee5c91b0 0x55e4ee9aa950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:21.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.340+0000 7f6611d0e640 1 -- 172.21.15.5:0/453982809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e4ee585da0 msgr2=0x55e4ee9af4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:21.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.340+0000 7f6611d0e640 1 --2- 172.21.15.5:0/453982809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e4ee585da0 0x55e4ee9af4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:21.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.340+0000 7f6611d0e640 1 -- 172.21.15.5:0/453982809 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4ee9ab580 con 0x55e4ee5f2070 2024-08-31T05:40:21.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.340+0000 7f6611d0e640 1 --2- 172.21.15.5:0/453982809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e4ee5f2070 0x55e4ee9aae90 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f6604006010 tx=0x7f6604004190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b1c343ee4e50d53 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:21.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.340+0000 7f65f4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:40:21.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.340+0000 7f65f4ff9640 1 -- 172.21.15.5:0/453982809 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6604005050 con 0x55e4ee5f2070 2024-08-31T05:40:21.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.340+0000 7f65f4ff9640 1 -- 172.21.15.5:0/453982809 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7f66040051f0 con 0x55e4ee5f2070 2024-08-31T05:40:21.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.340+0000 7f6619ce6740 1 -- 172.21.15.5:0/453982809 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65fc030450 con 0x55e4ee5f2070 2024-08-31T05:40:21.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.340+0000 7f65f4ff9640 1 -- 172.21.15.5:0/453982809 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f66040053f0 con 0x55e4ee5f2070 2024-08-31T05:40:21.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.340+0000 7f6619ce6740 10 client.18360 fetch_fsmap learned FSMap version 34 2024-08-31T05:40:21.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.340+0000 7f6619ce6740 1 -- 172.21.15.5:0/453982809 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55e4eea1f570 con 0x55e4ee5f2070 2024-08-31T05:40:21.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.341+0000 7f65f4ff9640 1 -- 172.21.15.5:0/453982809 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f65fc030450 con 0x55e4ee5f2070 2024-08-31T05:40:21.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.341+0000 7f65f4ff9640 1 -- 172.21.15.5:0/453982809 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f66040309b0 con 0x55e4ee5f2070 2024-08-31T05:40:21.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.341+0000 7f6619ce6740 10 client.18360 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:40:21.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.341+0000 7f6619ce6740 10 client.18360 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:40:21.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.341+0000 7f6619ce6740 20 client.18360 populate_metadata read hostname 'smithi005' 2024-08-31T05:40:21.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.341+0000 7f6619ce6740 1 --2- 172.21.15.5:0/453982809 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55e4eea1fa50 0x55e4eea21e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:21.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.341+0000 7f6619ce6740 4 client.18360 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:40:21.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.341+0000 7f6619ce6740 1 -- 172.21.15.5:0/453982809 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e4ee90c070 con 0x55e4eea1fa50 2024-08-31T05:40:21.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.341+0000 7f6610d0c640 1 --2- 172.21.15.5:0/453982809 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55e4eea1fa50 0x55e4eea21e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:21.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.341+0000 7f65f4ff9640 10 client.18360 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:40:21.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.341+0000 7f6610d0c640 1 --2- 172.21.15.5:0/453982809 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55e4eea1fa50 0x55e4eea21e70 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a9c5ac6b3a66f79 server_cookie=d516cd6043b472c in_seq=0 out_seq=0 2024-08-31T05:40:21.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.342+0000 7f65f4ff9640 1 -- 172.21.15.5:0/453982809 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e4ee90c070 con 0x55e4eea1fa50 2024-08-31T05:40:21.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.342+0000 7f65f4ff9640 10 client.18360 handle_command_reply: tid=0 2024-08-31T05:40:21.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.342+0000 7f6619ce6740 1 client.18360 shutdown 2024-08-31T05:40:21.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.342+0000 7f6619ce6740 1 -- 172.21.15.5:0/453982809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e4ee5f2070 msgr2=0x55e4ee9aae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:21.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.342+0000 7f6619ce6740 1 --2- 172.21.15.5:0/453982809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e4ee5f2070 0x55e4ee9aae90 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f6604006010 tx=0x7f6604004190 comp rx=0 tx=0).stop 2024-08-31T05:40:21.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.342+0000 7f6619ce6740 1 -- 172.21.15.5:0/453982809 shutdown_connections 2024-08-31T05:40:21.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.342+0000 7f6619ce6740 1 --2- 172.21.15.5:0/453982809 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55e4eea1fa50 0x55e4eea21e70 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:21.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.342+0000 7f6619ce6740 1 --2- 172.21.15.5:0/453982809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e4ee5f2070 0x55e4ee9aae90 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:21.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.342+0000 7f6619ce6740 1 --2- 172.21.15.5:0/453982809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e4ee5c91b0 0x55e4ee9aa950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:21.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.342+0000 7f6619ce6740 1 --2- 172.21.15.5:0/453982809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e4ee585da0 0x55e4ee9af4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:21.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.342+0000 7f6619ce6740 1 -- 172.21.15.5:0/453982809 >> 172.21.15.5:0/453982809 conn(0x55e4ee5e6460 msgr2=0x55e4ee9a8540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:21.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.342+0000 7f65f4ff9640 0 client.18360 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:40:21.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.342+0000 7f6619ce6740 1 -- 172.21.15.5:0/453982809 shutdown_connections 2024-08-31T05:40:21.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.342+0000 7f6619ce6740 1 -- 172.21.15.5:0/453982809 wait complete. 2024-08-31T05:40:21.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.342+0000 7f6619ce6740 20 client.18360 trim_cache size 0 max 16384 2024-08-31T05:40:21.350 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:40:21.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.343+0000 7f6613771640 1 -- 172.21.15.5:0/3140461661 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f65f80b4ca0 msgr2=0x7f65f80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:21.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.343+0000 7f6613771640 1 --2- 172.21.15.5:0/3140461661 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f65f80b4ca0 0x7f65f80b71b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f66080e30b0 tx=0x7f6608093040 comp rx=0 tx=0).stop 2024-08-31T05:40:21.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.343+0000 7f6613771640 1 -- 172.21.15.5:0/3140461661 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f660c101d10 msgr2=0x7f660c19a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:21.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.343+0000 7f6613771640 1 --2- 172.21.15.5:0/3140461661 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f660c101d10 0x7f660c19a250 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f660800e9c0 tx=0x7f660800edc0 comp rx=0 tx=0).stop 2024-08-31T05:40:21.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.343+0000 7f6613771640 1 -- 172.21.15.5:0/3140461661 shutdown_connections 2024-08-31T05:40:21.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.343+0000 7f6613771640 1 --2- 172.21.15.5:0/3140461661 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f65f80b4ca0 0x7f65f80b71b0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:21.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.343+0000 7f6613771640 1 --2- 172.21.15.5:0/3140461661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f660c109ba0 0x7f660c19fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:21.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.343+0000 7f6613771640 1 --2- 172.21.15.5:0/3140461661 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f660c109250 0x7f660c19a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:21.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.343+0000 7f6613771640 1 --2- 172.21.15.5:0/3140461661 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f660c101d10 0x7f660c19a250 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:21.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.343+0000 7f6613771640 1 -- 172.21.15.5:0/3140461661 >> 172.21.15.5:0/3140461661 conn(0x7f660c077a00 msgr2=0x7f660c107340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:21.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.343+0000 7f6613771640 1 -- 172.21.15.5:0/3140461661 shutdown_connections 2024-08-31T05:40:21.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:21.343+0000 7f6613771640 1 -- 172.21.15.5:0/3140461661 wait complete. 2024-08-31T05:40:21.936 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1168850 10.96 MB/sec execute 429 sec latency 78.230 ms 2024-08-31T05:40:22.936 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1170177 10.95 MB/sec execute 430 sec latency 62.437 ms 2024-08-31T05:40:23.156 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T05:40:23.156 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T05:40:23.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:40:22 smithi050 ceph-mon[22146]: pgmap v665: 129 pgs: 129 active+clean; 587 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.9 MiB/s wr, 190 op/s 2024-08-31T05:40:23.178 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:40:22 smithi005 ceph-mon[18602]: pgmap v665: 129 pgs: 129 active+clean; 587 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.9 MiB/s wr, 190 op/s 2024-08-31T05:40:23.337 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:40:22 smithi070 ceph-mon[22316]: pgmap v665: 129 pgs: 129 active+clean; 587 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.9 MiB/s wr, 190 op/s 2024-08-31T05:40:23.440 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:40:23.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.898+0000 7fe159ae1640 1 -- 172.21.15.5:0/3389867952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe154104fc0 msgr2=0x7fe1541053d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:23.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.898+0000 7fe159ae1640 1 --2- 172.21.15.5:0/3389867952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe154104fc0 0x7fe1541053d0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fe148009900 tx=0x7fe14802a410 comp rx=0 tx=0).stop 2024-08-31T05:40:23.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.898+0000 7fe159ae1640 1 -- 172.21.15.5:0/3389867952 shutdown_connections 2024-08-31T05:40:23.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.898+0000 7fe159ae1640 1 --2- 172.21.15.5:0/3389867952 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe154105910 0x7fe15410f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:23.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.898+0000 7fe159ae1640 1 --2- 172.21.15.5:0/3389867952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe154104fc0 0x7fe1541053d0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:23.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.898+0000 7fe159ae1640 1 --2- 172.21.15.5:0/3389867952 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe154102ff0 0x7fe154103400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:23.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.898+0000 7fe159ae1640 1 -- 172.21.15.5:0/3389867952 >> 172.21.15.5:0/3389867952 conn(0x7fe154079c60 msgr2=0x7fe15407a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:23.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.898+0000 7fe159ae1640 1 -- 172.21.15.5:0/3389867952 shutdown_connections 2024-08-31T05:40:23.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.898+0000 7fe159ae1640 1 -- 172.21.15.5:0/3389867952 wait complete. 2024-08-31T05:40:23.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.899+0000 7fe159ae1640 1 Processor -- start 2024-08-31T05:40:23.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.899+0000 7fe159ae1640 1 -- start start 2024-08-31T05:40:23.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.899+0000 7fe159ae1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe154102ff0 0x7fe15419a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:23.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.899+0000 7fe159ae1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe154104fc0 0x7fe15419a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:23.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.899+0000 7fe159ae1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe154105910 0x7fe15419fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:23.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.899+0000 7fe159ae1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe154112820 con 0x7fe154104fc0 2024-08-31T05:40:23.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.899+0000 7fe159ae1640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe1541126a0 con 0x7fe154102ff0 2024-08-31T05:40:23.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.899+0000 7fe159ae1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe1541129a0 con 0x7fe154105910 2024-08-31T05:40:23.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.899+0000 7fe152ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe154104fc0 0x7fe15419a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:23.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.900+0000 7fe1537fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe154102ff0 0x7fe15419a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:23.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.900+0000 7fe152ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe154104fc0 0x7fe15419a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38862/0 (socket says 172.21.15.5:38862) 2024-08-31T05:40:23.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.900+0000 7fe1537fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe154102ff0 0x7fe15419a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:35380/0 (socket says 172.21.15.5:35380) 2024-08-31T05:40:23.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.900+0000 7fe152ffd640 1 -- 172.21.15.5:0/648830618 learned_addr learned my addr 172.21.15.5:0/648830618 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:23.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.900+0000 7fe153fff640 1 --2- 172.21.15.5:0/648830618 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe154105910 0x7fe15419fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:23.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.900+0000 7fe1537fe640 1 -- 172.21.15.5:0/648830618 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe154105910 msgr2=0x7fe15419fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:23.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.900+0000 7fe1537fe640 1 --2- 172.21.15.5:0/648830618 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe154105910 0x7fe15419fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:23.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.900+0000 7fe1537fe640 1 -- 172.21.15.5:0/648830618 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe154104fc0 msgr2=0x7fe15419a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:23.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.900+0000 7fe1537fe640 1 --2- 172.21.15.5:0/648830618 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe154104fc0 0x7fe15419a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:23.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.900+0000 7fe1537fe640 1 -- 172.21.15.5:0/648830618 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1541a0330 con 0x7fe154102ff0 2024-08-31T05:40:23.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.900+0000 7fe1537fe640 1 --2- 172.21.15.5:0/648830618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe154102ff0 0x7fe15419a3c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe14400e9f0 tx=0x7fe14400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:23.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.900+0000 7fe150ff9640 1 -- 172.21.15.5:0/648830618 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe14400ccc0 con 0x7fe154102ff0 2024-08-31T05:40:23.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.900+0000 7fe150ff9640 1 -- 172.21.15.5:0/648830618 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1440108e0 con 0x7fe154102ff0 2024-08-31T05:40:23.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.900+0000 7fe150ff9640 1 -- 172.21.15.5:0/648830618 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe144018880 con 0x7fe154102ff0 2024-08-31T05:40:23.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.900+0000 7fe159ae1640 1 -- 172.21.15.5:0/648830618 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1541a0620 con 0x7fe154102ff0 2024-08-31T05:40:23.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.901+0000 7fe159ae1640 1 -- 172.21.15.5:0/648830618 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1540feb70 con 0x7fe154102ff0 2024-08-31T05:40:23.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.903+0000 7fe150ff9640 1 -- 172.21.15.5:0/648830618 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fe144010430 con 0x7fe154102ff0 2024-08-31T05:40:23.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.903+0000 7fe160056740 1 Processor -- start 2024-08-31T05:40:23.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.903+0000 7fe160056740 1 -- start start 2024-08-31T05:40:23.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.903+0000 7fe160056740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d369195350 0x55d36953b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:23.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.903+0000 7fe160056740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d36916c490 0x55d36953bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:23.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.903+0000 7fe160056740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d369174670 0x55d36953c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:23.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.903+0000 7fe160056740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55d3694b15f0 con 0x55d369174670 2024-08-31T05:40:23.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.903+0000 7fe160056740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d3694a0b80 con 0x55d369195350 2024-08-31T05:40:23.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.903+0000 7fe160056740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d3694a4b30 con 0x55d36916c490 2024-08-31T05:40:23.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.904+0000 7fe152ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d369174670 0x55d36953c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:23.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.904+0000 7fe152ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d369174670 0x55d36953c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38866/0 (socket says 172.21.15.5:38866) 2024-08-31T05:40:23.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.904+0000 7fe152ffd640 1 -- 172.21.15.5:0/2077141200 learned_addr learned my addr 172.21.15.5:0/2077141200 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:23.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.904+0000 7fe1537fe640 1 --2- 172.21.15.5:0/2077141200 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d36916c490 0x55d36953bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:23.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.904+0000 7fe1537fe640 1 -- 172.21.15.5:0/2077141200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d369195350 msgr2=0x55d36953b780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T05:40:23.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.904+0000 7fe1537fe640 1 --2- 172.21.15.5:0/2077141200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d369195350 0x55d36953b780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:23.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.904+0000 7fe1537fe640 1 -- 172.21.15.5:0/2077141200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d369174670 msgr2=0x55d36953c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:23.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.904+0000 7fe1537fe640 1 --2- 172.21.15.5:0/2077141200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d369174670 0x55d36953c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:23.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.904+0000 7fe1537fe640 1 -- 172.21.15.5:0/2077141200 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d369200930 con 0x55d36916c490 2024-08-31T05:40:23.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.904+0000 7fe152ffd640 1 --2- 172.21.15.5:0/2077141200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d369174670 0x55d36953c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:40:23.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.904+0000 7fe150ff9640 1 --2- 172.21.15.5:0/648830618 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe13c0b4d20 0x7fe13c0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:23.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.904+0000 7fe153fff640 1 --2- 172.21.15.5:0/648830618 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe13c0b4d20 0x7fe13c0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:23.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.904+0000 7fe1537fe640 1 --2- 172.21.15.5:0/2077141200 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d36916c490 0x55d36953bcc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe1440e2f70 tx=0x7fe1440ee740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4d89ddcbf68d1a4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:23.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.904+0000 7fe150ff9640 1 -- 172.21.15.5:0/648830618 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7fe1440e5c00 con 0x7fe154102ff0 2024-08-31T05:40:23.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.905+0000 7fe139ffb640 1 -- 172.21.15.5:0/2077141200 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1440a7e80 con 0x55d36916c490 2024-08-31T05:40:23.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.905+0000 7fe139ffb640 1 -- 172.21.15.5:0/2077141200 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe144010720 con 0x55d36916c490 2024-08-31T05:40:23.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.905+0000 7fe139ffb640 1 -- 172.21.15.5:0/2077141200 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1440ab730 con 0x55d36916c490 2024-08-31T05:40:23.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.906+0000 7fe160056740 1 -- 172.21.15.5:0/2077141200 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d36916c490 msgr2=0x55d36953bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:23.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.906+0000 7fe160056740 1 --2- 172.21.15.5:0/2077141200 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d36916c490 0x55d36953bcc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe1440e2f70 tx=0x7fe1440ee740 comp rx=0 tx=0).stop 2024-08-31T05:40:23.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.906+0000 7fe153fff640 1 --2- 172.21.15.5:0/648830618 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe13c0b4d20 0x7fe13c0b7230 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe14c005fd0 tx=0x7fe14c009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:23.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.906+0000 7fe160056740 1 -- 172.21.15.5:0/2077141200 shutdown_connections 2024-08-31T05:40:23.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.906+0000 7fe160056740 1 --2- 172.21.15.5:0/2077141200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d369174670 0x55d36953c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:23.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.906+0000 7fe160056740 1 --2- 172.21.15.5:0/2077141200 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d36916c490 0x55d36953bcc0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:23.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.906+0000 7fe160056740 1 --2- 172.21.15.5:0/2077141200 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d369195350 0x55d36953b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:23.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.906+0000 7fe160056740 1 -- 172.21.15.5:0/2077141200 >> 172.21.15.5:0/2077141200 conn(0x55d369189740 msgr2=0x55d369539670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:23.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.906+0000 7fe160056740 1 -- 172.21.15.5:0/2077141200 shutdown_connections 2024-08-31T05:40:23.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.906+0000 7fe160056740 1 -- 172.21.15.5:0/2077141200 wait complete. 2024-08-31T05:40:23.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.906+0000 7fe160056740 1 -- start start 2024-08-31T05:40:23.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.907+0000 7fe160056740 1 Processor -- start 2024-08-31T05:40:23.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.907+0000 7fe160056740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d36916c490 0x55d369546fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:23.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.907+0000 7fe160056740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d369174670 0x55d3695475c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:23.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.907+0000 7fe160056740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d369195350 0x55d369553250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:23.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.907+0000 7fe160056740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55d369303890 con 0x55d369174670 2024-08-31T05:40:23.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.907+0000 7fe160056740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d369427790 con 0x55d36916c490 2024-08-31T05:40:23.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.907+0000 7fe160056740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d369549f60 con 0x55d369195350 2024-08-31T05:40:23.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.907+0000 7fe160056740 10 client.0 _ll_register_callbacks cb 0x55d3691acba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:40:23.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.907+0000 7fe152ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d369174670 0x55d3695475c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:23.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.907+0000 7fe1537fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d36916c490 0x55d369546fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:23.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.907+0000 7fe152ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d369174670 0x55d3695475c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38870/0 (socket says 172.21.15.5:38870) 2024-08-31T05:40:23.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.907+0000 7fe152ffd640 1 -- 172.21.15.5:0/3014555913 learned_addr learned my addr 172.21.15.5:0/3014555913 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:23.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.907+0000 7fe153fff640 1 --2- 172.21.15.5:0/3014555913 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d369195350 0x55d369553250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:23.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.907+0000 7fe1537fe640 1 -- 172.21.15.5:0/3014555913 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d369195350 msgr2=0x55d369553250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:23.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.907+0000 7fe1537fe640 1 --2- 172.21.15.5:0/3014555913 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d369195350 0x55d369553250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:23.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.907+0000 7fe1537fe640 1 -- 172.21.15.5:0/3014555913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d369174670 msgr2=0x55d3695475c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:23.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.907+0000 7fe1537fe640 1 --2- 172.21.15.5:0/3014555913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d369174670 0x55d3695475c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:23.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.907+0000 7fe1537fe640 1 -- 172.21.15.5:0/3014555913 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d36945ef30 con 0x55d36916c490 2024-08-31T05:40:23.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.907+0000 7fe153fff640 1 --2- 172.21.15.5:0/3014555913 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d369195350 0x55d369553250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:40:23.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.907+0000 7fe152ffd640 1 --2- 172.21.15.5:0/3014555913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d369174670 0x55d3695475c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:40:23.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.908+0000 7fe1537fe640 1 --2- 172.21.15.5:0/3014555913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d36916c490 0x55d369546fe0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe1440e2f70 tx=0x7fe1440ac110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48104c4f2bc3cc5a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:23.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.908+0000 7fe132ffd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:40:23.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.908+0000 7fe132ffd640 1 -- 172.21.15.5:0/3014555913 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1440ab910 con 0x55d36916c490 2024-08-31T05:40:23.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.908+0000 7fe132ffd640 1 -- 172.21.15.5:0/3014555913 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7fe1440a8250 con 0x55d36916c490 2024-08-31T05:40:23.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.908+0000 7fe160056740 1 -- 172.21.15.5:0/3014555913 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d3694b3540 con 0x55d36916c490 2024-08-31T05:40:23.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.908+0000 7fe132ffd640 1 -- 172.21.15.5:0/3014555913 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe1440abd90 con 0x55d36916c490 2024-08-31T05:40:23.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.908+0000 7fe160056740 10 client.27941 fetch_fsmap learned FSMap version 34 2024-08-31T05:40:23.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.908+0000 7fe160056740 1 -- 172.21.15.5:0/3014555913 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55d369555e20 con 0x55d36916c490 2024-08-31T05:40:23.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.908+0000 7fe132ffd640 1 -- 172.21.15.5:0/3014555913 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55d3694b3540 con 0x55d36916c490 2024-08-31T05:40:23.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.909+0000 7fe132ffd640 1 -- 172.21.15.5:0/3014555913 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fe1440ed040 con 0x55d36916c490 2024-08-31T05:40:23.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.909+0000 7fe160056740 10 client.27941 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:40:23.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.909+0000 7fe160056740 10 client.27941 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:40:23.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.909+0000 7fe160056740 20 client.27941 populate_metadata read hostname 'smithi005' 2024-08-31T05:40:23.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.909+0000 7fe160056740 1 --2- 172.21.15.5:0/3014555913 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d369153cd0 0x55d369559180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:23.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.909+0000 7fe160056740 4 client.27941 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:40:23.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.909+0000 7fe160056740 1 -- 172.21.15.5:0/3014555913 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d3694aefe0 con 0x55d369153cd0 2024-08-31T05:40:23.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.909+0000 7fe152ffd640 1 --2- 172.21.15.5:0/3014555913 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d369153cd0 0x55d369559180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:23.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.909+0000 7fe152ffd640 1 --2- 172.21.15.5:0/3014555913 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d369153cd0 0x55d369559180 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71fda5b63f20076d server_cookie=868b0dd48c48127a in_seq=0 out_seq=0 2024-08-31T05:40:23.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.910+0000 7fe132ffd640 10 client.27941 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:40:23.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.910+0000 7fe132ffd640 1 -- 172.21.15.5:0/3014555913 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d3694aefe0 con 0x55d369153cd0 2024-08-31T05:40:23.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.910+0000 7fe132ffd640 10 client.27941 handle_command_reply: tid=0 2024-08-31T05:40:23.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.910+0000 7fe160056740 1 client.27941 shutdown 2024-08-31T05:40:23.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.910+0000 7fe160056740 1 -- 172.21.15.5:0/3014555913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d36916c490 msgr2=0x55d369546fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:23.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.910+0000 7fe160056740 1 --2- 172.21.15.5:0/3014555913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d36916c490 0x55d369546fe0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe1440e2f70 tx=0x7fe1440ac110 comp rx=0 tx=0).stop 2024-08-31T05:40:23.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.910+0000 7fe160056740 1 -- 172.21.15.5:0/3014555913 shutdown_connections 2024-08-31T05:40:23.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.910+0000 7fe160056740 1 --2- 172.21.15.5:0/3014555913 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d369153cd0 0x55d369559180 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:23.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.910+0000 7fe160056740 1 --2- 172.21.15.5:0/3014555913 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d369195350 0x55d369553250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:23.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.910+0000 7fe160056740 1 --2- 172.21.15.5:0/3014555913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d369174670 0x55d3695475c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:23.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.910+0000 7fe160056740 1 --2- 172.21.15.5:0/3014555913 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d36916c490 0x55d369546fe0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:23.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.910+0000 7fe132ffd640 0 client.27941 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:40:23.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.911+0000 7fe160056740 1 -- 172.21.15.5:0/3014555913 >> 172.21.15.5:0/3014555913 conn(0x55d369189740 msgr2=0x55d36953e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:23.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.911+0000 7fe160056740 1 -- 172.21.15.5:0/3014555913 shutdown_connections 2024-08-31T05:40:23.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.911+0000 7fe160056740 1 -- 172.21.15.5:0/3014555913 wait complete. 2024-08-31T05:40:23.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.911+0000 7fe160056740 20 client.27941 trim_cache size 0 max 16384 2024-08-31T05:40:23.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.929+0000 7fe160056740 1 Processor -- start 2024-08-31T05:40:23.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.929+0000 7fe160056740 1 -- start start 2024-08-31T05:40:23.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.930+0000 7fe160056740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d36916c490 0x55d3695531c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:23.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.930+0000 7fe160056740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d369174670 0x55d369553700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:23.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.930+0000 7fe160056740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d369195350 0x55d369538f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:23.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.930+0000 7fe160056740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe1541b3000 con 0x55d36916c490 2024-08-31T05:40:23.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.930+0000 7fe160056740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe1541b4b40 con 0x55d369195350 2024-08-31T05:40:23.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.930+0000 7fe160056740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe1541b36d0 con 0x55d369174670 2024-08-31T05:40:23.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.930+0000 7fe1537fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d36916c490 0x55d3695531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:23.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.930+0000 7fe1537fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d36916c490 0x55d3695531c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38886/0 (socket says 172.21.15.5:38886) 2024-08-31T05:40:23.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.930+0000 7fe1537fe640 1 -- 172.21.15.5:0/823937136 learned_addr learned my addr 172.21.15.5:0/823937136 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:23.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.930+0000 7fe153fff640 1 --2- 172.21.15.5:0/823937136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d369195350 0x55d369538f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:23.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.930+0000 7fe152ffd640 1 --2- 172.21.15.5:0/823937136 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d369174670 0x55d369553700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:23.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.930+0000 7fe1537fe640 1 -- 172.21.15.5:0/823937136 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d369174670 msgr2=0x55d369553700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:23.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.930+0000 7fe1537fe640 1 --2- 172.21.15.5:0/823937136 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d369174670 0x55d369553700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:23.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.930+0000 7fe1537fe640 1 -- 172.21.15.5:0/823937136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d369195350 msgr2=0x55d369538f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:23.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.930+0000 7fe1537fe640 1 --2- 172.21.15.5:0/823937136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d369195350 0x55d369538f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:23.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.930+0000 7fe1537fe640 1 -- 172.21.15.5:0/823937136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d36953e5e0 con 0x55d36916c490 2024-08-31T05:40:23.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.930+0000 7fe153fff640 1 --2- 172.21.15.5:0/823937136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d369195350 0x55d369538f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:40:23.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.931+0000 7fe1537fe640 1 --2- 172.21.15.5:0/823937136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d36916c490 0x55d3695531c0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fe1440abf50 tx=0x7fe144010ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=236605e8f0845650 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:23.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.931+0000 7fe1397fa640 1 -- 172.21.15.5:0/823937136 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1440e92a0 con 0x55d36916c490 2024-08-31T05:40:23.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.931+0000 7fe1397fa640 1 -- 172.21.15.5:0/823937136 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1440e9050 con 0x55d36916c490 2024-08-31T05:40:23.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.931+0000 7fe1397fa640 1 -- 172.21.15.5:0/823937136 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1440ee0d0 con 0x55d36916c490 2024-08-31T05:40:23.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.932+0000 7fe160056740 1 -- 172.21.15.5:0/823937136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d36916c490 msgr2=0x55d3695531c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:23.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.932+0000 7fe160056740 1 --2- 172.21.15.5:0/823937136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d36916c490 0x55d3695531c0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fe1440abf50 tx=0x7fe144010ca0 comp rx=0 tx=0).stop 2024-08-31T05:40:23.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.932+0000 7fe160056740 1 -- 172.21.15.5:0/823937136 shutdown_connections 2024-08-31T05:40:23.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.932+0000 7fe160056740 1 --2- 172.21.15.5:0/823937136 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d369195350 0x55d369538f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:23.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.932+0000 7fe160056740 1 --2- 172.21.15.5:0/823937136 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d369174670 0x55d369553700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:23.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.932+0000 7fe160056740 1 --2- 172.21.15.5:0/823937136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d36916c490 0x55d3695531c0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:23.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.932+0000 7fe160056740 1 -- 172.21.15.5:0/823937136 >> 172.21.15.5:0/823937136 conn(0x55d369189740 msgr2=0x55d369545860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:23.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.932+0000 7fe160056740 1 -- 172.21.15.5:0/823937136 shutdown_connections 2024-08-31T05:40:23.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.932+0000 7fe160056740 1 -- 172.21.15.5:0/823937136 wait complete. 2024-08-31T05:40:23.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.933+0000 7fe160056740 1 -- start start 2024-08-31T05:40:23.937 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1172467 10.96 MB/sec execute 431 sec latency 42.009 ms 2024-08-31T05:40:23.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.933+0000 7fe160056740 1 Processor -- start 2024-08-31T05:40:23.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.933+0000 7fe160056740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d36916c490 0x55d36955c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:23.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.933+0000 7fe160056740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d369174670 0x55d369559b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:23.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.933+0000 7fe160056740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d369195350 0x55d36955a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:23.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.933+0000 7fe160056740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe1541b4470 con 0x55d36916c490 2024-08-31T05:40:23.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.933+0000 7fe160056740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe1541b3da0 con 0x55d369195350 2024-08-31T05:40:23.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.933+0000 7fe160056740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe1541b1000 con 0x55d369174670 2024-08-31T05:40:23.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.933+0000 7fe160056740 10 client.0 _ll_register_callbacks cb 0x7fe14c0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:40:23.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.933+0000 7fe1537fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d36916c490 0x55d36955c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:23.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.933+0000 7fe1537fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d36916c490 0x55d36955c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38890/0 (socket says 172.21.15.5:38890) 2024-08-31T05:40:23.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.933+0000 7fe1537fe640 1 -- 172.21.15.5:0/3301237279 learned_addr learned my addr 172.21.15.5:0/3301237279 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:23.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.933+0000 7fe153fff640 1 --2- 172.21.15.5:0/3301237279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d369195350 0x55d36955a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:23.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.934+0000 7fe152ffd640 1 --2- 172.21.15.5:0/3301237279 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d369174670 0x55d369559b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:23.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.934+0000 7fe153fff640 1 -- 172.21.15.5:0/3301237279 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d369174670 msgr2=0x55d369559b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:23.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.934+0000 7fe153fff640 1 --2- 172.21.15.5:0/3301237279 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d369174670 0x55d369559b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:23.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.934+0000 7fe153fff640 1 -- 172.21.15.5:0/3301237279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d36916c490 msgr2=0x55d36955c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:23.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.934+0000 7fe153fff640 1 --2- 172.21.15.5:0/3301237279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d36916c490 0x55d36955c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:23.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.934+0000 7fe153fff640 1 -- 172.21.15.5:0/3301237279 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d369533960 con 0x55d369195350 2024-08-31T05:40:23.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.934+0000 7fe153fff640 1 --2- 172.21.15.5:0/3301237279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d369195350 0x55d36955a0d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe14c004810 tx=0x7fe14c004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae00c2f83000035c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:23.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.934+0000 7fe132ffd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:40:23.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.934+0000 7fe132ffd640 1 -- 172.21.15.5:0/3301237279 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe14c02b060 con 0x55d369195350 2024-08-31T05:40:23.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.934+0000 7fe160056740 1 -- 172.21.15.5:0/3301237279 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1440e9050 con 0x55d369195350 2024-08-31T05:40:23.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.934+0000 7fe132ffd640 1 -- 172.21.15.5:0/3301237279 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7fe14c01a5f0 con 0x55d369195350 2024-08-31T05:40:23.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.934+0000 7fe132ffd640 1 -- 172.21.15.5:0/3301237279 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe14c032050 con 0x55d369195350 2024-08-31T05:40:23.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.934+0000 7fe160056740 10 client.27947 fetch_fsmap learned FSMap version 34 2024-08-31T05:40:23.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.934+0000 7fe160056740 1 -- 172.21.15.5:0/3301237279 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55d3695c34c0 con 0x55d369195350 2024-08-31T05:40:23.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.935+0000 7fe132ffd640 1 -- 172.21.15.5:0/3301237279 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1440e9050 con 0x55d369195350 2024-08-31T05:40:23.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.935+0000 7fe132ffd640 1 -- 172.21.15.5:0/3301237279 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fe14c018040 con 0x55d369195350 2024-08-31T05:40:23.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.935+0000 7fe160056740 10 client.27947 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:40:23.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.935+0000 7fe160056740 10 client.27947 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:40:23.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.935+0000 7fe160056740 20 client.27947 populate_metadata read hostname 'smithi005' 2024-08-31T05:40:23.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.935+0000 7fe160056740 1 --2- 172.21.15.5:0/3301237279 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d369129080 0x55d3695c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:23.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.935+0000 7fe160056740 4 client.27947 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T05:40:23.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.935+0000 7fe160056740 1 -- 172.21.15.5:0/3301237279 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d3694ac720 con 0x55d369129080 2024-08-31T05:40:23.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.935+0000 7fe1537fe640 1 --2- 172.21.15.5:0/3301237279 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d369129080 0x55d3695c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:23.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.936+0000 7fe132ffd640 10 client.27947 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:40:23.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.936+0000 7fe1537fe640 1 --2- 172.21.15.5:0/3301237279 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d369129080 0x55d3695c5c90 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4cbfa716c1e82553 server_cookie=443d36f50cd28e6a in_seq=0 out_seq=0 2024-08-31T05:40:23.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.937+0000 7fe132ffd640 1 -- 172.21.15.5:0/3301237279 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d3694ac720 con 0x55d369129080 2024-08-31T05:40:23.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.937+0000 7fe132ffd640 10 client.27947 handle_command_reply: tid=0 2024-08-31T05:40:23.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.937+0000 7fe160056740 1 client.27947 shutdown 2024-08-31T05:40:23.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.937+0000 7fe160056740 1 -- 172.21.15.5:0/3301237279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d369195350 msgr2=0x55d36955a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:23.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.937+0000 7fe160056740 1 --2- 172.21.15.5:0/3301237279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d369195350 0x55d36955a0d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe14c004810 tx=0x7fe14c004ab0 comp rx=0 tx=0).stop 2024-08-31T05:40:23.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.937+0000 7fe160056740 1 -- 172.21.15.5:0/3301237279 shutdown_connections 2024-08-31T05:40:23.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.937+0000 7fe160056740 1 --2- 172.21.15.5:0/3301237279 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d369129080 0x55d3695c5c90 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:23.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.937+0000 7fe160056740 1 --2- 172.21.15.5:0/3301237279 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d369195350 0x55d36955a0d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:23.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.937+0000 7fe160056740 1 --2- 172.21.15.5:0/3301237279 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d369174670 0x55d369559b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:23.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.937+0000 7fe160056740 1 --2- 172.21.15.5:0/3301237279 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d36916c490 0x55d36955c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:23.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.937+0000 7fe132ffd640 0 client.27947 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:40:23.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.937+0000 7fe160056740 1 -- 172.21.15.5:0/3301237279 >> 172.21.15.5:0/3301237279 conn(0x55d369189740 msgr2=0x55d36953e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:23.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.938+0000 7fe160056740 1 -- 172.21.15.5:0/3301237279 shutdown_connections 2024-08-31T05:40:23.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.938+0000 7fe160056740 1 -- 172.21.15.5:0/3301237279 wait complete. 2024-08-31T05:40:23.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.938+0000 7fe160056740 20 client.27947 trim_cache size 0 max 16384 2024-08-31T05:40:23.944 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:40:23.944 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-08-31T05:40:23.944 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "ab2853ca-505f-43fc-a132-af8bca186292", 2024-08-31T05:40:23.944 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-08-31T05:40:23.944 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:40:23.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.938+0000 7fe159ae1640 1 -- 172.21.15.5:0/648830618 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe13c0b4d20 msgr2=0x7fe13c0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:23.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.938+0000 7fe159ae1640 1 --2- 172.21.15.5:0/648830618 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe13c0b4d20 0x7fe13c0b7230 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe14c005fd0 tx=0x7fe14c009500 comp rx=0 tx=0).stop 2024-08-31T05:40:23.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.938+0000 7fe159ae1640 1 -- 172.21.15.5:0/648830618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe154102ff0 msgr2=0x7fe15419a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:23.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.938+0000 7fe159ae1640 1 --2- 172.21.15.5:0/648830618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe154102ff0 0x7fe15419a3c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe14400e9f0 tx=0x7fe14400eeb0 comp rx=0 tx=0).stop 2024-08-31T05:40:23.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.938+0000 7fe159ae1640 1 -- 172.21.15.5:0/648830618 shutdown_connections 2024-08-31T05:40:23.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.938+0000 7fe159ae1640 1 --2- 172.21.15.5:0/648830618 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe13c0b4d20 0x7fe13c0b7230 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:23.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.938+0000 7fe159ae1640 1 --2- 172.21.15.5:0/648830618 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe154105910 0x7fe15419fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:23.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.938+0000 7fe159ae1640 1 --2- 172.21.15.5:0/648830618 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe154104fc0 0x7fe15419a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:23.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.938+0000 7fe159ae1640 1 --2- 172.21.15.5:0/648830618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe154102ff0 0x7fe15419a3c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:23.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.939+0000 7fe159ae1640 1 -- 172.21.15.5:0/648830618 >> 172.21.15.5:0/648830618 conn(0x7fe154079c60 msgr2=0x7fe154101110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:23.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.939+0000 7fe159ae1640 1 -- 172.21.15.5:0/648830618 shutdown_connections 2024-08-31T05:40:23.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:23.939+0000 7fe159ae1640 1 -- 172.21.15.5:0/648830618 wait complete. 2024-08-31T05:40:24.702 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T05:40:24.935 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1173777 10.94 MB/sec execute 432 sec latency 87.167 ms 2024-08-31T05:40:25.000 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:40:25.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:40:24 smithi050 ceph-mon[22146]: pgmap v666: 129 pgs: 129 active+clean; 580 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.8 MiB/s wr, 189 op/s 2024-08-31T05:40:25.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:40:24 smithi050 ceph-mon[22146]: scrub queued for path: / 2024-08-31T05:40:25.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:40:24 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:40:25.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:40:24 smithi050 ceph-mon[22146]: scrub summary: active paths [/] 2024-08-31T05:40:25.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:40:24 smithi050 ceph-mon[22146]: scrub summary: active paths [/] 2024-08-31T05:40:25.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:40:24 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:40:25.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:40:24 smithi005 ceph-mon[18602]: pgmap v666: 129 pgs: 129 active+clean; 580 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.8 MiB/s wr, 189 op/s 2024-08-31T05:40:25.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:40:24 smithi005 ceph-mon[18602]: scrub queued for path: / 2024-08-31T05:40:25.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:40:24 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:40:25.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:40:24 smithi005 ceph-mon[18602]: scrub summary: active paths [/] 2024-08-31T05:40:25.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:40:24 smithi005 ceph-mon[18602]: scrub summary: active paths [/] 2024-08-31T05:40:25.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:40:24 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:40:25.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:40:24 smithi070 ceph-mon[22316]: pgmap v666: 129 pgs: 129 active+clean; 580 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.8 MiB/s wr, 189 op/s 2024-08-31T05:40:25.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:40:24 smithi070 ceph-mon[22316]: scrub queued for path: / 2024-08-31T05:40:25.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:40:24 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:40:25.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:40:24 smithi070 ceph-mon[22316]: scrub summary: active paths [/] 2024-08-31T05:40:25.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:40:24 smithi070 ceph-mon[22316]: scrub summary: active paths [/] 2024-08-31T05:40:25.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:40:24 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:40:25.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.489+0000 7f5d7cedc640 1 -- 172.21.15.5:0/2252664086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d78103960 msgr2=0x7f5d78103d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:25.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.489+0000 7f5d7cedc640 1 --2- 172.21.15.5:0/2252664086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d78103960 0x7f5d78103d70 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f5d68009900 tx=0x7f5d6802a410 comp rx=0 tx=0).stop 2024-08-31T05:40:25.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.489+0000 7f5d7cedc640 1 -- 172.21.15.5:0/2252664086 shutdown_connections 2024-08-31T05:40:25.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.489+0000 7f5d7cedc640 1 --2- 172.21.15.5:0/2252664086 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d78109ba0 0x7f5d781103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:25.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.489+0000 7f5d7cedc640 1 --2- 172.21.15.5:0/2252664086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d78109250 0x7f5d78109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:25.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.489+0000 7f5d7cedc640 1 --2- 172.21.15.5:0/2252664086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d78103960 0x7f5d78103d70 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:25.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.489+0000 7f5d7cedc640 1 -- 172.21.15.5:0/2252664086 >> 172.21.15.5:0/2252664086 conn(0x7f5d7807b6b0 msgr2=0x7f5d7807bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:25.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.489+0000 7f5d7cedc640 1 -- 172.21.15.5:0/2252664086 shutdown_connections 2024-08-31T05:40:25.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.489+0000 7f5d7cedc640 1 -- 172.21.15.5:0/2252664086 wait complete. 2024-08-31T05:40:25.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.490+0000 7f5d7cedc640 1 Processor -- start 2024-08-31T05:40:25.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.490+0000 7f5d7cedc640 1 -- start start 2024-08-31T05:40:25.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.490+0000 7f5d7cedc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d78103960 0x7f5d7819c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:25.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.490+0000 7f5d7cedc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d78109250 0x7f5d7819ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:25.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.490+0000 7f5d7cedc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d78109ba0 0x7f5d781a1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:25.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.490+0000 7f5d7cedc640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5d78113860 con 0x7f5d78109ba0 2024-08-31T05:40:25.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.490+0000 7f5d7cedc640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5d781136e0 con 0x7f5d78109250 2024-08-31T05:40:25.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.490+0000 7f5d7cedc640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5d781139e0 con 0x7f5d78103960 2024-08-31T05:40:25.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.490+0000 7f5d76d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d78109ba0 0x7f5d781a1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:25.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.490+0000 7f5d7659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d78103960 0x7f5d7819c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:25.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.490+0000 7f5d75d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d78109250 0x7f5d7819ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:25.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.490+0000 7f5d7659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d78103960 0x7f5d7819c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:57954/0 (socket says 172.21.15.5:57954) 2024-08-31T05:40:25.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.490+0000 7f5d75d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d78109250 0x7f5d7819ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:35436/0 (socket says 172.21.15.5:35436) 2024-08-31T05:40:25.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.490+0000 7f5d75d9b640 1 -- 172.21.15.5:0/2598396772 learned_addr learned my addr 172.21.15.5:0/2598396772 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:25.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.490+0000 7f5d76d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d78109ba0 0x7f5d781a1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38906/0 (socket says 172.21.15.5:38906) 2024-08-31T05:40:25.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.491+0000 7f5d75d9b640 1 -- 172.21.15.5:0/2598396772 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d78103960 msgr2=0x7f5d7819c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:25.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.491+0000 7f5d75d9b640 1 --2- 172.21.15.5:0/2598396772 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d78103960 0x7f5d7819c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:25.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.491+0000 7f5d75d9b640 1 -- 172.21.15.5:0/2598396772 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d78109ba0 msgr2=0x7f5d781a1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:25.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.491+0000 7f5d75d9b640 1 --2- 172.21.15.5:0/2598396772 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d78109ba0 0x7f5d781a1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:25.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.491+0000 7f5d75d9b640 1 -- 172.21.15.5:0/2598396772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d781a2440 con 0x7f5d78109250 2024-08-31T05:40:25.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.491+0000 7f5d7659c640 1 --2- 172.21.15.5:0/2598396772 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d78103960 0x7f5d7819c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:40:25.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.491+0000 7f5d76d9d640 1 --2- 172.21.15.5:0/2598396772 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d78109ba0 0x7f5d781a1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:40:25.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.491+0000 7f5d75d9b640 1 --2- 172.21.15.5:0/2598396772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d78109250 0x7f5d7819ca70 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c00ebc0 tx=0x7f5d6c00c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:25.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.491+0000 7f5d677fe640 1 -- 172.21.15.5:0/2598396772 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c010630 con 0x7f5d78109250 2024-08-31T05:40:25.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.491+0000 7f5d7cedc640 1 -- 172.21.15.5:0/2598396772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d781a2730 con 0x7f5d78109250 2024-08-31T05:40:25.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.491+0000 7f5d677fe640 1 -- 172.21.15.5:0/2598396772 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d6c010c80 con 0x7f5d78109250 2024-08-31T05:40:25.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.491+0000 7f5d677fe640 1 -- 172.21.15.5:0/2598396772 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c017ba0 con 0x7f5d78109250 2024-08-31T05:40:25.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.491+0000 7f5d7cedc640 1 -- 172.21.15.5:0/2598396772 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d781a8e90 con 0x7f5d78109250 2024-08-31T05:40:25.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.494+0000 7f5d83451740 1 Processor -- start 2024-08-31T05:40:25.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.494+0000 7f5d677fe640 1 -- 172.21.15.5:0/2598396772 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f5d6c0107d0 con 0x7f5d78109250 2024-08-31T05:40:25.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.494+0000 7f5d83451740 1 -- start start 2024-08-31T05:40:25.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.495+0000 7f5d83451740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acfeacd070 0x55acfee722c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:25.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.495+0000 7f5d83451740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55acfeaa41b0 0x55acfee72800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:25.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.495+0000 7f5d83451740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55acfeaac390 0x55acfee72d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:25.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.495+0000 7f5d83451740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55acfede9630 con 0x55acfeacd070 2024-08-31T05:40:25.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.495+0000 7f5d83451740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55acfedd8bc0 con 0x55acfeaac390 2024-08-31T05:40:25.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.495+0000 7f5d83451740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55acfeddcb70 con 0x55acfeaa41b0 2024-08-31T05:40:25.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.495+0000 7f5d76d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acfeacd070 0x55acfee722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:25.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.495+0000 7f5d7659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55acfeaa41b0 0x55acfee72800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:25.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.495+0000 7f5d76d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acfeacd070 0x55acfee722c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38916/0 (socket says 172.21.15.5:38916) 2024-08-31T05:40:25.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.495+0000 7f5d76d9d640 1 -- 172.21.15.5:0/1605272313 learned_addr learned my addr 172.21.15.5:0/1605272313 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:25.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.495+0000 7f5d75d9b640 1 --2- 172.21.15.5:0/1605272313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55acfeaac390 0x55acfee72d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:25.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.495+0000 7f5d7659c640 1 -- 172.21.15.5:0/1605272313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55acfeaac390 msgr2=0x55acfee72d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:25.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.495+0000 7f5d7659c640 1 --2- 172.21.15.5:0/1605272313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55acfeaac390 0x55acfee72d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:25.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.495+0000 7f5d7659c640 1 -- 172.21.15.5:0/1605272313 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acfeacd070 msgr2=0x55acfee722c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:25.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.495+0000 7f5d7659c640 1 --2- 172.21.15.5:0/1605272313 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acfeacd070 0x55acfee722c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:25.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.495+0000 7f5d7659c640 1 -- 172.21.15.5:0/1605272313 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acfeb38650 con 0x55acfeaa41b0 2024-08-31T05:40:25.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.495+0000 7f5d677fe640 1 --2- 172.21.15.5:0/2598396772 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5d600b4ca0 0x7f5d600b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:25.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.495+0000 7f5d76d9d640 1 --2- 172.21.15.5:0/2598396772 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5d600b4ca0 0x7f5d600b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:25.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.495+0000 7f5d7659c640 1 --2- 172.21.15.5:0/1605272313 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55acfeaa41b0 0x55acfee72800 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5d68009230 tx=0x7f5d68005e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dae20e1672910703 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:25.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.495+0000 7f5d677fe640 1 -- 172.21.15.5:0/2598396772 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7f5d6c0e6200 con 0x7f5d78109250 2024-08-31T05:40:25.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.496+0000 7f5d64ff9640 1 -- 172.21.15.5:0/1605272313 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d68040070 con 0x55acfeaa41b0 2024-08-31T05:40:25.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.496+0000 7f5d64ff9640 1 -- 172.21.15.5:0/1605272313 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d68031720 con 0x55acfeaa41b0 2024-08-31T05:40:25.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.496+0000 7f5d64ff9640 1 -- 172.21.15.5:0/1605272313 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d68035040 con 0x55acfeaa41b0 2024-08-31T05:40:25.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.497+0000 7f5d76d9d640 1 --2- 172.21.15.5:0/2598396772 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5d600b4ca0 0x7f5d600b71b0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f5d70005f60 tx=0x7f5d70005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:25.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.497+0000 7f5d83451740 1 -- 172.21.15.5:0/1605272313 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55acfeaa41b0 msgr2=0x55acfee72800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:25.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.497+0000 7f5d83451740 1 --2- 172.21.15.5:0/1605272313 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55acfeaa41b0 0x55acfee72800 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5d68009230 tx=0x7f5d68005e20 comp rx=0 tx=0).stop 2024-08-31T05:40:25.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.497+0000 7f5d83451740 1 -- 172.21.15.5:0/1605272313 shutdown_connections 2024-08-31T05:40:25.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.497+0000 7f5d83451740 1 --2- 172.21.15.5:0/1605272313 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55acfeaac390 0x55acfee72d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:25.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.497+0000 7f5d83451740 1 --2- 172.21.15.5:0/1605272313 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55acfeaa41b0 0x55acfee72800 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:25.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.497+0000 7f5d83451740 1 --2- 172.21.15.5:0/1605272313 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acfeacd070 0x55acfee722c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:25.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.497+0000 7f5d83451740 1 -- 172.21.15.5:0/1605272313 >> 172.21.15.5:0/1605272313 conn(0x55acfeac1460 msgr2=0x55acfee701b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:25.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.497+0000 7f5d83451740 1 -- 172.21.15.5:0/1605272313 shutdown_connections 2024-08-31T05:40:25.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.497+0000 7f5d83451740 1 -- 172.21.15.5:0/1605272313 wait complete. 2024-08-31T05:40:25.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.497+0000 7f5d83451740 1 -- start start 2024-08-31T05:40:25.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.497+0000 7f5d83451740 1 Processor -- start 2024-08-31T05:40:25.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.497+0000 7f5d83451740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acfeaa41b0 0x55acfee7d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:25.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.497+0000 7f5d83451740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55acfeaac390 0x55acfee7df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:25.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.497+0000 7f5d83451740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55acfeacd070 0x55acfee89d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:25.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.497+0000 7f5d83451740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55acfec3b700 con 0x55acfeaa41b0 2024-08-31T05:40:25.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.497+0000 7f5d83451740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55acfed5f700 con 0x55acfeaac390 2024-08-31T05:40:25.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.498+0000 7f5d83451740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55acfee80a40 con 0x55acfeacd070 2024-08-31T05:40:25.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.498+0000 7f5d83451740 10 client.0 _ll_register_callbacks cb 0x55acfed8edc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:40:25.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.498+0000 7f5d7659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acfeaa41b0 0x55acfee7d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:25.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.498+0000 7f5d7659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acfeaa41b0 0x55acfee7d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38930/0 (socket says 172.21.15.5:38930) 2024-08-31T05:40:25.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.498+0000 7f5d7659c640 1 -- 172.21.15.5:0/3215007685 learned_addr learned my addr 172.21.15.5:0/3215007685 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:25.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.498+0000 7f5d75d9b640 1 --2- 172.21.15.5:0/3215007685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55acfeaac390 0x55acfee7df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:25.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.498+0000 7f5d76d9d640 1 --2- 172.21.15.5:0/3215007685 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55acfeacd070 0x55acfee89d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:25.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.498+0000 7f5d7659c640 1 -- 172.21.15.5:0/3215007685 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55acfeacd070 msgr2=0x55acfee89d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:25.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.498+0000 7f5d7659c640 1 --2- 172.21.15.5:0/3215007685 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55acfeacd070 0x55acfee89d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:25.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.498+0000 7f5d7659c640 1 -- 172.21.15.5:0/3215007685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55acfeaac390 msgr2=0x55acfee7df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:25.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.498+0000 7f5d7659c640 1 --2- 172.21.15.5:0/3215007685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55acfeaac390 0x55acfee7df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:25.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.498+0000 7f5d7659c640 1 -- 172.21.15.5:0/3215007685 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acfed988b0 con 0x55acfeaa41b0 2024-08-31T05:40:25.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.498+0000 7f5d7659c640 1 --2- 172.21.15.5:0/3215007685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acfeaa41b0 0x55acfee7d9e0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f5d680319e0 tx=0x7f5d68031a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efa01c7c32deb2e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:25.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.498+0000 7f5d5dffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:40:25.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.499+0000 7f5d5dffb640 1 -- 172.21.15.5:0/3215007685 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d6804b020 con 0x55acfeaa41b0 2024-08-31T05:40:25.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.499+0000 7f5d5dffb640 1 -- 172.21.15.5:0/3215007685 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7f5d68004250 con 0x55acfeaa41b0 2024-08-31T05:40:25.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.499+0000 7f5d83451740 1 -- 172.21.15.5:0/3215007685 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d68031720 con 0x55acfeaa41b0 2024-08-31T05:40:25.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.499+0000 7f5d5dffb640 1 -- 172.21.15.5:0/3215007685 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f5d68056050 con 0x55acfeaa41b0 2024-08-31T05:40:25.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.499+0000 7f5d83451740 10 client.18390 fetch_fsmap learned FSMap version 34 2024-08-31T05:40:25.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.499+0000 7f5d83451740 1 -- 172.21.15.5:0/3215007685 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55acfee8c780 con 0x55acfeaa41b0 2024-08-31T05:40:25.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.499+0000 7f5d5dffb640 1 -- 172.21.15.5:0/3215007685 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d68031720 con 0x55acfeaa41b0 2024-08-31T05:40:25.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.499+0000 7f5d5dffb640 1 -- 172.21.15.5:0/3215007685 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f5d6803c440 con 0x55acfeaa41b0 2024-08-31T05:40:25.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.499+0000 7f5d83451740 10 client.18390 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:40:25.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.499+0000 7f5d83451740 10 client.18390 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:40:25.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.499+0000 7f5d83451740 20 client.18390 populate_metadata read hostname 'smithi005' 2024-08-31T05:40:25.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.499+0000 7f5d83451740 1 --2- 172.21.15.5:0/3215007685 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55acfea8b9f0 0x55acfee8fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:25.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.499+0000 7f5d83451740 4 client.18390 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:40:25.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.499+0000 7f5d83451740 1 -- 172.21.15.5:0/3215007685 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55acfedeb580 con 0x55acfea8b9f0 2024-08-31T05:40:25.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.500+0000 7f5d75d9b640 1 --2- 172.21.15.5:0/3215007685 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55acfea8b9f0 0x55acfee8fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:25.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.500+0000 7f5d5dffb640 10 client.18390 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:40:25.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.500+0000 7f5d75d9b640 1 --2- 172.21.15.5:0/3215007685 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55acfea8b9f0 0x55acfee8fae0 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4921e525fc100099 server_cookie=16f26042295233ea in_seq=0 out_seq=0 2024-08-31T05:40:25.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.501+0000 7f5d5dffb640 1 -- 172.21.15.5:0/3215007685 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55acfedeb580 con 0x55acfea8b9f0 2024-08-31T05:40:25.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.501+0000 7f5d5dffb640 10 client.18390 handle_command_reply: tid=0 2024-08-31T05:40:25.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.501+0000 7f5d83451740 1 client.18390 shutdown 2024-08-31T05:40:25.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.501+0000 7f5d83451740 1 -- 172.21.15.5:0/3215007685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acfeaa41b0 msgr2=0x55acfee7d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:25.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.501+0000 7f5d83451740 1 --2- 172.21.15.5:0/3215007685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acfeaa41b0 0x55acfee7d9e0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f5d680319e0 tx=0x7f5d68031a10 comp rx=0 tx=0).stop 2024-08-31T05:40:25.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.501+0000 7f5d83451740 1 -- 172.21.15.5:0/3215007685 shutdown_connections 2024-08-31T05:40:25.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.501+0000 7f5d83451740 1 --2- 172.21.15.5:0/3215007685 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55acfea8b9f0 0x55acfee8fae0 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:25.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.501+0000 7f5d83451740 1 --2- 172.21.15.5:0/3215007685 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55acfeacd070 0x55acfee89d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:25.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.501+0000 7f5d83451740 1 --2- 172.21.15.5:0/3215007685 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55acfeaac390 0x55acfee7df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:25.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.501+0000 7f5d83451740 1 --2- 172.21.15.5:0/3215007685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acfeaa41b0 0x55acfee7d9e0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:25.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.501+0000 7f5d5dffb640 0 client.18390 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:40:25.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.501+0000 7f5d83451740 1 -- 172.21.15.5:0/3215007685 >> 172.21.15.5:0/3215007685 conn(0x55acfeac1460 msgr2=0x55acfee754a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:25.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.501+0000 7f5d83451740 1 -- 172.21.15.5:0/3215007685 shutdown_connections 2024-08-31T05:40:25.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.501+0000 7f5d83451740 1 -- 172.21.15.5:0/3215007685 wait complete. 2024-08-31T05:40:25.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.502+0000 7f5d83451740 20 client.18390 trim_cache size 0 max 16384 2024-08-31T05:40:25.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.520+0000 7f5d83451740 1 Processor -- start 2024-08-31T05:40:25.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.520+0000 7f5d83451740 1 -- start start 2024-08-31T05:40:25.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.520+0000 7f5d83451740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55acfeaa41b0 0x55acfee70220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:25.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.520+0000 7f5d83451740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acfeaac390 0x55acfee89cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:25.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.521+0000 7f5d83451740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55acfeacd070 0x55acfee753c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:25.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.521+0000 7f5d83451740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5d781b2f90 con 0x55acfeaac390 2024-08-31T05:40:25.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.521+0000 7f5d83451740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5d781b4ad0 con 0x55acfeaa41b0 2024-08-31T05:40:25.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.521+0000 7f5d83451740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5d781b3660 con 0x55acfeacd070 2024-08-31T05:40:25.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.521+0000 7f5d7659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55acfeaa41b0 0x55acfee70220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:25.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.521+0000 7f5d75d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acfeaac390 0x55acfee89cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:25.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.521+0000 7f5d7659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55acfeaa41b0 0x55acfee70220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:35470/0 (socket says 172.21.15.5:35470) 2024-08-31T05:40:25.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.521+0000 7f5d7659c640 1 -- 172.21.15.5:0/4009293773 learned_addr learned my addr 172.21.15.5:0/4009293773 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:25.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.521+0000 7f5d75d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acfeaac390 0x55acfee89cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38942/0 (socket says 172.21.15.5:38942) 2024-08-31T05:40:25.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.521+0000 7f5d76d9d640 1 --2- 172.21.15.5:0/4009293773 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55acfeacd070 0x55acfee753c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:25.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.521+0000 7f5d75d9b640 1 -- 172.21.15.5:0/4009293773 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55acfeacd070 msgr2=0x55acfee753c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:25.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.521+0000 7f5d75d9b640 1 --2- 172.21.15.5:0/4009293773 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55acfeacd070 0x55acfee753c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:25.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.521+0000 7f5d75d9b640 1 -- 172.21.15.5:0/4009293773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55acfeaa41b0 msgr2=0x55acfee70220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:25.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.521+0000 7f5d75d9b640 1 --2- 172.21.15.5:0/4009293773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55acfeaa41b0 0x55acfee70220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:25.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.521+0000 7f5d75d9b640 1 -- 172.21.15.5:0/4009293773 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acfee7c940 con 0x55acfeaac390 2024-08-31T05:40:25.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.521+0000 7f5d75d9b640 1 --2- 172.21.15.5:0/4009293773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acfeaac390 0x55acfee89cd0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c0e3540 tx=0x7f5d6c0e86e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e926bf72392eaff server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:25.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.521+0000 7f5d5ffff640 1 -- 172.21.15.5:0/4009293773 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c0a83d0 con 0x55acfeaac390 2024-08-31T05:40:25.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.521+0000 7f5d5ffff640 1 -- 172.21.15.5:0/4009293773 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d6c010ac0 con 0x55acfeaac390 2024-08-31T05:40:25.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.521+0000 7f5d5ffff640 1 -- 172.21.15.5:0/4009293773 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c0abc80 con 0x55acfeaac390 2024-08-31T05:40:25.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.522+0000 7f5d83451740 1 -- 172.21.15.5:0/4009293773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acfeaac390 msgr2=0x55acfee89cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:25.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.522+0000 7f5d83451740 1 --2- 172.21.15.5:0/4009293773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acfeaac390 0x55acfee89cd0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c0e3540 tx=0x7f5d6c0e86e0 comp rx=0 tx=0).stop 2024-08-31T05:40:25.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.522+0000 7f5d83451740 1 -- 172.21.15.5:0/4009293773 shutdown_connections 2024-08-31T05:40:25.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.522+0000 7f5d83451740 1 --2- 172.21.15.5:0/4009293773 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55acfeacd070 0x55acfee753c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:25.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.522+0000 7f5d83451740 1 --2- 172.21.15.5:0/4009293773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acfeaac390 0x55acfee89cd0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:25.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.522+0000 7f5d83451740 1 --2- 172.21.15.5:0/4009293773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55acfeaa41b0 0x55acfee70220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:25.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.522+0000 7f5d83451740 1 -- 172.21.15.5:0/4009293773 >> 172.21.15.5:0/4009293773 conn(0x55acfeac1460 msgr2=0x55acfee6fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:25.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.522+0000 7f5d83451740 1 -- 172.21.15.5:0/4009293773 shutdown_connections 2024-08-31T05:40:25.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.523+0000 7f5d83451740 1 -- 172.21.15.5:0/4009293773 wait complete. 2024-08-31T05:40:25.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.523+0000 7f5d83451740 1 -- start start 2024-08-31T05:40:25.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.523+0000 7f5d83451740 1 Processor -- start 2024-08-31T05:40:25.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.523+0000 7f5d83451740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55acfeaa41b0 0x55acfee91270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:25.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.523+0000 7f5d83451740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55acfeaac390 0x55acfee917b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:25.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.523+0000 7f5d83451740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acfeacd070 0x55acfeef9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:25.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.523+0000 7f5d83451740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5d781b4400 con 0x55acfeacd070 2024-08-31T05:40:25.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.523+0000 7f5d83451740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5d781b3d30 con 0x55acfeaa41b0 2024-08-31T05:40:25.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.523+0000 7f5d83451740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5d781b0f90 con 0x55acfeaac390 2024-08-31T05:40:25.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.523+0000 7f5d83451740 10 client.0 _ll_register_callbacks cb 0x7f5d70009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:40:25.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.523+0000 7f5d75d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55acfeaac390 0x55acfee917b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:25.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.523+0000 7f5d76d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acfeacd070 0x55acfeef9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:25.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.523+0000 7f5d75d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55acfeaac390 0x55acfee917b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:57992/0 (socket says 172.21.15.5:57992) 2024-08-31T05:40:25.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.523+0000 7f5d75d9b640 1 -- 172.21.15.5:0/117986071 learned_addr learned my addr 172.21.15.5:0/117986071 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:25.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.524+0000 7f5d7659c640 1 --2- 172.21.15.5:0/117986071 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55acfeaa41b0 0x55acfee91270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:25.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.524+0000 7f5d76d9d640 1 -- 172.21.15.5:0/117986071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55acfeaac390 msgr2=0x55acfee917b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:25.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.524+0000 7f5d76d9d640 1 --2- 172.21.15.5:0/117986071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55acfeaac390 0x55acfee917b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:25.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.524+0000 7f5d76d9d640 1 -- 172.21.15.5:0/117986071 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55acfeaa41b0 msgr2=0x55acfee91270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:25.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.524+0000 7f5d76d9d640 1 --2- 172.21.15.5:0/117986071 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55acfeaa41b0 0x55acfee91270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:25.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.524+0000 7f5d76d9d640 1 -- 172.21.15.5:0/117986071 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acfeef97a0 con 0x55acfeacd070 2024-08-31T05:40:25.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.524+0000 7f5d75d9b640 1 --2- 172.21.15.5:0/117986071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55acfeaac390 0x55acfee917b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:40:25.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.524+0000 7f5d7659c640 1 --2- 172.21.15.5:0/117986071 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55acfeaa41b0 0x55acfee91270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:40:25.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.524+0000 7f5d76d9d640 1 --2- 172.21.15.5:0/117986071 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acfeacd070 0x55acfeef9260 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f5d70012f20 tx=0x7f5d700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5db13332c2ab5b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:25.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.524+0000 7f5d5dffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:40:25.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.524+0000 7f5d5dffb640 1 -- 172.21.15.5:0/117986071 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d70005020 con 0x55acfeacd070 2024-08-31T05:40:25.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.524+0000 7f5d83451740 1 -- 172.21.15.5:0/117986071 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55acfede7020 con 0x55acfeacd070 2024-08-31T05:40:25.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.524+0000 7f5d5dffb640 1 -- 172.21.15.5:0/117986071 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7f5d700051c0 con 0x55acfeacd070 2024-08-31T05:40:25.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.524+0000 7f5d5dffb640 1 -- 172.21.15.5:0/117986071 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f5d70035050 con 0x55acfeacd070 2024-08-31T05:40:25.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.525+0000 7f5d83451740 10 client.18396 fetch_fsmap learned FSMap version 34 2024-08-31T05:40:25.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.525+0000 7f5d83451740 1 -- 172.21.15.5:0/117986071 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55acfeefaa60 con 0x55acfeacd070 2024-08-31T05:40:25.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.525+0000 7f5d5dffb640 1 -- 172.21.15.5:0/117986071 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55acfede7020 con 0x55acfeacd070 2024-08-31T05:40:25.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.525+0000 7f5d5dffb640 1 -- 172.21.15.5:0/117986071 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f5d70011650 con 0x55acfeacd070 2024-08-31T05:40:25.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.525+0000 7f5d83451740 10 client.18396 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:40:25.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.525+0000 7f5d83451740 10 client.18396 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:40:25.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.525+0000 7f5d83451740 20 client.18396 populate_metadata read hostname 'smithi005' 2024-08-31T05:40:25.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.525+0000 7f5d83451740 1 --2- 172.21.15.5:0/117986071 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55acfea60da0 0x55acfeefd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:25.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.525+0000 7f5d83451740 4 client.18396 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T05:40:25.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.525+0000 7f5d83451740 1 -- 172.21.15.5:0/117986071 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55acfede4760 con 0x55acfea60da0 2024-08-31T05:40:25.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.525+0000 7f5d7659c640 1 --2- 172.21.15.5:0/117986071 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55acfea60da0 0x55acfeefd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:25.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.526+0000 7f5d7659c640 1 --2- 172.21.15.5:0/117986071 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55acfea60da0 0x55acfeefd2d0 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a6e283ee2713228 server_cookie=cd5c52791ae7251d in_seq=0 out_seq=0 2024-08-31T05:40:25.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.526+0000 7f5d5dffb640 10 client.18396 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:40:25.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.526+0000 7f5d5dffb640 1 -- 172.21.15.5:0/117986071 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4262 (crc 0 0 0) 0x55acfede4760 con 0x55acfea60da0 2024-08-31T05:40:25.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.526+0000 7f5d5dffb640 10 client.18396 handle_command_reply: tid=0 2024-08-31T05:40:25.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.526+0000 7f5d83451740 1 client.18396 shutdown 2024-08-31T05:40:25.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.526+0000 7f5d83451740 1 -- 172.21.15.5:0/117986071 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acfeacd070 msgr2=0x55acfeef9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:25.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.526+0000 7f5d83451740 1 --2- 172.21.15.5:0/117986071 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acfeacd070 0x55acfeef9260 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f5d70012f20 tx=0x7f5d700046c0 comp rx=0 tx=0).stop 2024-08-31T05:40:25.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.526+0000 7f5d83451740 1 -- 172.21.15.5:0/117986071 shutdown_connections 2024-08-31T05:40:25.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.526+0000 7f5d83451740 1 --2- 172.21.15.5:0/117986071 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55acfea60da0 0x55acfeefd2d0 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:25.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.526+0000 7f5d83451740 1 --2- 172.21.15.5:0/117986071 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55acfeacd070 0x55acfeef9260 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:25.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.526+0000 7f5d5dffb640 0 client.18396 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:40:25.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.526+0000 7f5d83451740 1 --2- 172.21.15.5:0/117986071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55acfeaac390 0x55acfee917b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:25.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.526+0000 7f5d83451740 1 --2- 172.21.15.5:0/117986071 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55acfeaa41b0 0x55acfee91270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:25.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.526+0000 7f5d83451740 1 -- 172.21.15.5:0/117986071 >> 172.21.15.5:0/117986071 conn(0x55acfeac1460 msgr2=0x55acfee753c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:25.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.526+0000 7f5d83451740 1 -- 172.21.15.5:0/117986071 shutdown_connections 2024-08-31T05:40:25.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.526+0000 7f5d83451740 1 -- 172.21.15.5:0/117986071 wait complete. 2024-08-31T05:40:25.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.526+0000 7f5d83451740 20 client.18396 trim_cache size 0 max 16384 2024-08-31T05:40:25.535 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:40:25.535 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T05:40:25.536 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2024-08-31T05:40:25.536 INFO:teuthology.orchestra.run.smithi005.stdout: "ab2853ca-505f-43fc-a132-af8bca186292": { 2024-08-31T05:40:25.536 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:40:25.536 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "ab2853ca-505f-43fc-a132-af8bca186292", 2024-08-31T05:40:25.536 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2024-08-31T05:40:25.536 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:40:25.536 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:40:25.536 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_stats": { 2024-08-31T05:40:25.536 INFO:teuthology.orchestra.run.smithi005.stdout: "ab2853ca-505f-43fc-a132-af8bca186292": { 2024-08-31T05:40:25.536 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:40:23.937602+0000", 2024-08-31T05:40:25.536 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:40:25.536 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:40:25.536 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:40:25.537 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:40:25.537 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:40:25.537 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:40:25.537 INFO:teuthology.orchestra.run.smithi005.stdout: "75d84398-5d9c-4872-b879-2fbce045fa71": { 2024-08-31T05:40:25.537 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:06.642335+0000", 2024-08-31T05:40:25.537 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:40:25.537 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:40:25.537 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:40:25.537 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:40:25.537 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:40:25.537 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:40:25.537 INFO:teuthology.orchestra.run.smithi005.stdout: "ece37b07-9ab2-45f8-bc33-2755a07aac0b": { 2024-08-31T05:40:25.537 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:31:41.782407+0000", 2024-08-31T05:40:25.538 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:40:25.538 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:40:25.538 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:40:25.538 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:40:25.538 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:40:25.538 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:40:25.538 INFO:teuthology.orchestra.run.smithi005.stdout: "728a42ca-bbef-4151-830f-5fdd411d8fa0": { 2024-08-31T05:40:25.538 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:32:30.554906+0000", 2024-08-31T05:40:25.538 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:40:25.538 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:40:25.538 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:40:25.538 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:40:25.538 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:40:25.539 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:40:25.539 INFO:teuthology.orchestra.run.smithi005.stdout: "cda92ac0-b35f-47a5-a3a5-471c888462a5": { 2024-08-31T05:40:25.539 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:53.103905+0000", 2024-08-31T05:40:25.539 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:40:25.539 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:40:25.539 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:40:25.539 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:40:25.539 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:40:25.539 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:40:25.540 INFO:teuthology.orchestra.run.smithi005.stdout: "0bb67292-013a-40c7-b5fc-810bdd9715d8": { 2024-08-31T05:40:25.540 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:34:04.586008+0000", 2024-08-31T05:40:25.540 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:40:25.540 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:40:25.540 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:40:25.540 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:40:25.540 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:40:25.540 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:40:25.540 INFO:teuthology.orchestra.run.smithi005.stdout: "de9731c7-ae4a-42fe-8146-e4752cdc40d4": { 2024-08-31T05:40:25.540 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:34:53.614499+0000", 2024-08-31T05:40:25.540 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:40:25.540 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:40:25.540 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:40:25.541 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:40:25.541 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:40:25.541 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:40:25.541 INFO:teuthology.orchestra.run.smithi005.stdout: "f4db3406-20ff-46a3-baf9-099e16392f76": { 2024-08-31T05:40:25.541 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:38:49.034412+0000", 2024-08-31T05:40:25.541 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:40:25.541 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:40:25.541 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:40:25.541 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:40:25.541 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:40:25.541 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:40:25.541 INFO:teuthology.orchestra.run.smithi005.stdout: "095ccc7a-f368-4bc6-9563-5930e21f9b4a": { 2024-08-31T05:40:25.541 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:35:40.190069+0000", 2024-08-31T05:40:25.542 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:40:25.542 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:40:25.542 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:40:25.542 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:40:25.542 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:40:25.542 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:40:25.542 INFO:teuthology.orchestra.run.smithi005.stdout: "297c26f3-7b4d-4245-abb0-f854248e5e1b": { 2024-08-31T05:40:25.542 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:37:14.019244+0000", 2024-08-31T05:40:25.542 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:40:25.542 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:40:25.542 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:40:25.542 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:40:25.542 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:40:25.542 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:40:25.543 INFO:teuthology.orchestra.run.smithi005.stdout: "a4d4cf74-2477-4dd9-a3a2-3762b4dd87e4": { 2024-08-31T05:40:25.543 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:38:01.378833+0000", 2024-08-31T05:40:25.543 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:40:25.543 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:40:25.543 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:40:25.543 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:40:25.543 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:40:25.543 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:40:25.543 INFO:teuthology.orchestra.run.smithi005.stdout: "94c23057-592d-4a8b-82d7-da2d84f8740b": { 2024-08-31T05:40:25.543 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:36:27.513638+0000", 2024-08-31T05:40:25.543 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:40:25.543 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:40:25.543 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:40:25.543 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:40:25.544 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:40:25.544 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:40:25.544 INFO:teuthology.orchestra.run.smithi005.stdout: "2445fc42-b797-434f-b380-e2da985b4d98": { 2024-08-31T05:40:25.544 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:33:17.681453+0000", 2024-08-31T05:40:25.544 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:40:25.544 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:40:25.544 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:40:25.544 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:40:25.544 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:40:25.544 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:40:25.544 INFO:teuthology.orchestra.run.smithi005.stdout: "239b7958-db06-4432-93ce-b7552effa357": { 2024-08-31T05:40:25.544 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:39:35.733028+0000", 2024-08-31T05:40:25.544 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:40:25.545 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:40:25.545 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:40:25.545 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:40:25.545 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:40:25.545 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:40:25.545 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:40:25.545 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:40:25.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.527+0000 7f5d7cedc640 1 -- 172.21.15.5:0/2598396772 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5d600b4ca0 msgr2=0x7f5d600b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:25.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.527+0000 7f5d7cedc640 1 --2- 172.21.15.5:0/2598396772 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5d600b4ca0 0x7f5d600b71b0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f5d70005f60 tx=0x7f5d70005f90 comp rx=0 tx=0).stop 2024-08-31T05:40:25.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.527+0000 7f5d7cedc640 1 -- 172.21.15.5:0/2598396772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d78109250 msgr2=0x7f5d7819ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:25.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.527+0000 7f5d7cedc640 1 --2- 172.21.15.5:0/2598396772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d78109250 0x7f5d7819ca70 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c00ebc0 tx=0x7f5d6c00c6a0 comp rx=0 tx=0).stop 2024-08-31T05:40:25.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.527+0000 7f5d7cedc640 1 -- 172.21.15.5:0/2598396772 shutdown_connections 2024-08-31T05:40:25.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.527+0000 7f5d7cedc640 1 --2- 172.21.15.5:0/2598396772 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5d600b4ca0 0x7f5d600b71b0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:25.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.527+0000 7f5d7cedc640 1 --2- 172.21.15.5:0/2598396772 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d78109ba0 0x7f5d781a1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:25.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.527+0000 7f5d7cedc640 1 --2- 172.21.15.5:0/2598396772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5d78109250 0x7f5d7819ca70 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:25.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.527+0000 7f5d7cedc640 1 --2- 172.21.15.5:0/2598396772 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d78103960 0x7f5d7819c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:25.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.527+0000 7f5d7cedc640 1 -- 172.21.15.5:0/2598396772 >> 172.21.15.5:0/2598396772 conn(0x7f5d7807b6b0 msgr2=0x7f5d78107160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:25.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.527+0000 7f5d7cedc640 1 -- 172.21.15.5:0/2598396772 shutdown_connections 2024-08-31T05:40:25.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:25.527+0000 7f5d7cedc640 1 -- 172.21.15.5:0/2598396772 wait complete. 2024-08-31T05:40:25.936 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1176050 10.95 MB/sec execute 433 sec latency 22.494 ms 2024-08-31T05:40:26.156 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:40:25 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:40:26.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:40:25 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:40:26.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:40:25 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:40:26.555 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.552+0000 7ff3e2362640 1 -- 172.21.15.5:0/871621379 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3dc1089e0 msgr2=0x7ff3dc10f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:26.555 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.552+0000 7ff3e2362640 1 --2- 172.21.15.5:0/871621379 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3dc1089e0 0x7ff3dc10f210 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4009ca0 tx=0x7ff3d402a8c0 comp rx=0 tx=0).stop 2024-08-31T05:40:26.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.552+0000 7ff3e2362640 1 -- 172.21.15.5:0/871621379 shutdown_connections 2024-08-31T05:40:26.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.552+0000 7ff3e2362640 1 --2- 172.21.15.5:0/871621379 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3dc1089e0 0x7ff3dc10f210 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:26.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.552+0000 7ff3e2362640 1 --2- 172.21.15.5:0/871621379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3dc108090 0x7ff3dc1084a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:26.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.552+0000 7ff3e2362640 1 --2- 172.21.15.5:0/871621379 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff3dc102760 0x7ff3dc102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:26.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.552+0000 7ff3e2362640 1 -- 172.21.15.5:0/871621379 >> 172.21.15.5:0/871621379 conn(0x7ff3dc0fe160 msgr2=0x7ff3dc1005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:26.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.552+0000 7ff3e2362640 1 -- 172.21.15.5:0/871621379 shutdown_connections 2024-08-31T05:40:26.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.552+0000 7ff3e2362640 1 -- 172.21.15.5:0/871621379 wait complete. 2024-08-31T05:40:26.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.554+0000 7ff3e2362640 1 Processor -- start 2024-08-31T05:40:26.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.554+0000 7ff3e2362640 1 -- start start 2024-08-31T05:40:26.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.554+0000 7ff3e2362640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff3dc102760 0x7ff3dc0fe690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:26.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.554+0000 7ff3e2362640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3dc108090 0x7ff3dc0febd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:26.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.554+0000 7ff3e2362640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3dc1089e0 0x7ff3dc0ff110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:26.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.554+0000 7ff3e2362640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff3dc1126b0 con 0x7ff3dc108090 2024-08-31T05:40:26.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.554+0000 7ff3e2362640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff3dc112530 con 0x7ff3dc1089e0 2024-08-31T05:40:26.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.554+0000 7ff3e2362640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff3dc112830 con 0x7ff3dc102760 2024-08-31T05:40:26.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.554+0000 7ff3db7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3dc108090 0x7ff3dc0febd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:26.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.554+0000 7ff3dbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff3dc102760 0x7ff3dc0fe690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:26.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.554+0000 7ff3db7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3dc108090 0x7ff3dc0febd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38972/0 (socket says 172.21.15.5:38972) 2024-08-31T05:40:26.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.554+0000 7ff3e08ff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3dc1089e0 0x7ff3dc0ff110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:26.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.554+0000 7ff3dbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff3dc102760 0x7ff3dc0fe690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:58010/0 (socket says 172.21.15.5:58010) 2024-08-31T05:40:26.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.554+0000 7ff3db7fe640 1 -- 172.21.15.5:0/3387213807 learned_addr learned my addr 172.21.15.5:0/3387213807 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:26.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.554+0000 7ff3db7fe640 1 -- 172.21.15.5:0/3387213807 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff3dc102760 msgr2=0x7ff3dc0fe690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:26.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.554+0000 7ff3db7fe640 1 --2- 172.21.15.5:0/3387213807 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff3dc102760 0x7ff3dc0fe690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:26.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.554+0000 7ff3db7fe640 1 -- 172.21.15.5:0/3387213807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3dc1089e0 msgr2=0x7ff3dc0ff110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:26.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.554+0000 7ff3db7fe640 1 --2- 172.21.15.5:0/3387213807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3dc1089e0 0x7ff3dc0ff110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:26.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.554+0000 7ff3db7fe640 1 -- 172.21.15.5:0/3387213807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3dc1a8470 con 0x7ff3dc108090 2024-08-31T05:40:26.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.554+0000 7ff3dbfff640 1 --2- 172.21.15.5:0/3387213807 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff3dc102760 0x7ff3dc0fe690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:40:26.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.554+0000 7ff3db7fe640 1 --2- 172.21.15.5:0/3387213807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3dc108090 0x7ff3dc0febd0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7ff3d000e970 tx=0x7ff3d000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:26.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.554+0000 7ff3d97fa640 1 -- 172.21.15.5:0/3387213807 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d000cd80 con 0x7ff3dc108090 2024-08-31T05:40:26.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.554+0000 7ff3d97fa640 1 -- 172.21.15.5:0/3387213807 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3d00035f0 con 0x7ff3dc108090 2024-08-31T05:40:26.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.554+0000 7ff3e2362640 1 -- 172.21.15.5:0/3387213807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3dc1a8760 con 0x7ff3dc108090 2024-08-31T05:40:26.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.554+0000 7ff3d97fa640 1 -- 172.21.15.5:0/3387213807 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d0010690 con 0x7ff3dc108090 2024-08-31T05:40:26.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.554+0000 7ff3e2362640 1 -- 172.21.15.5:0/3387213807 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3dc1a8cb0 con 0x7ff3dc108090 2024-08-31T05:40:26.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.559+0000 7ff3e92cb740 1 Processor -- start 2024-08-31T05:40:26.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.559+0000 7ff3d97fa640 1 -- 172.21.15.5:0/3387213807 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7ff3d0003aa0 con 0x7ff3dc108090 2024-08-31T05:40:26.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.562+0000 7ff3d97fa640 1 --2- 172.21.15.5:0/3387213807 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff3c40b4cd0 0x7ff3c40b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:26.566 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.563+0000 7ff3d97fa640 1 -- 172.21.15.5:0/3387213807 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7ff3d00e5c30 con 0x7ff3dc108090 2024-08-31T05:40:26.566 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.564+0000 7ff3e92cb740 1 -- start start 2024-08-31T05:40:26.566 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.564+0000 7ff3e92cb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f90f34e1b0 0x55f90f6f1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:26.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.564+0000 7ff3e92cb740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f90f3252f0 0x55f90f6f2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:26.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.564+0000 7ff3e92cb740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f90f32d4d0 0x55f90f6f2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:26.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.564+0000 7ff3e92cb740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f90f667000 con 0x55f90f32d4d0 2024-08-31T05:40:26.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.564+0000 7ff3e92cb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f90f656590 con 0x55f90f34e1b0 2024-08-31T05:40:26.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.564+0000 7ff3e92cb740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f90f65a540 con 0x55f90f3252f0 2024-08-31T05:40:26.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.565+0000 7ff3e08ff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f90f32d4d0 0x55f90f6f2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:26.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.565+0000 7ff3e08ff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f90f32d4d0 0x55f90f6f2540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38982/0 (socket says 172.21.15.5:38982) 2024-08-31T05:40:26.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.565+0000 7ff3e08ff640 1 -- 172.21.15.5:0/4076282517 learned_addr learned my addr 172.21.15.5:0/4076282517 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:26.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.568+0000 7ff3e08ff640 1 --2- 172.21.15.5:0/3387213807 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff3c40b4cd0 0x7ff3c40b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:26.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.568+0000 7ff3db7fe640 1 --2- 172.21.15.5:0/4076282517 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f90f3252f0 0x55f90f6f2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:26.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.568+0000 7ff3dbfff640 1 --2- 172.21.15.5:0/4076282517 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f90f34e1b0 0x55f90f6f1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:26.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.572+0000 7ff3e08ff640 1 -- 172.21.15.5:0/4076282517 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f90f3252f0 msgr2=0x55f90f6f2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:26.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.572+0000 7ff3e08ff640 1 --2- 172.21.15.5:0/4076282517 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f90f3252f0 0x55f90f6f2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:26.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.572+0000 7ff3e08ff640 1 -- 172.21.15.5:0/4076282517 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f90f34e1b0 msgr2=0x55f90f6f1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:26.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.572+0000 7ff3e08ff640 1 --2- 172.21.15.5:0/4076282517 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f90f34e1b0 0x55f90f6f1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:26.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.572+0000 7ff3e08ff640 1 -- 172.21.15.5:0/4076282517 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f90f3b9790 con 0x55f90f32d4d0 2024-08-31T05:40:26.577 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.572+0000 7ff3e08ff640 1 --2- 172.21.15.5:0/3387213807 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff3c40b4cd0 0x7ff3c40b71e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4033010 tx=0x7ff3d403b000 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:26.577 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.573+0000 7ff3e08ff640 1 --2- 172.21.15.5:0/4076282517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f90f32d4d0 0x55f90f6f2540 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4032f70 tx=0x7ff3d4032fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31b153f29b3811de server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:26.580 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.578+0000 7ff3c27fc640 1 -- 172.21.15.5:0/4076282517 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d404f070 con 0x55f90f32d4d0 2024-08-31T05:40:26.580 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.578+0000 7ff3c27fc640 1 -- 172.21.15.5:0/4076282517 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3d4036040 con 0x55f90f32d4d0 2024-08-31T05:40:26.580 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.578+0000 7ff3c27fc640 1 -- 172.21.15.5:0/4076282517 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d4004780 con 0x55f90f32d4d0 2024-08-31T05:40:26.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.579+0000 7ff3e92cb740 1 -- 172.21.15.5:0/4076282517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f90f32d4d0 msgr2=0x55f90f6f2540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:26.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.579+0000 7ff3e92cb740 1 --2- 172.21.15.5:0/4076282517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f90f32d4d0 0x55f90f6f2540 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4032f70 tx=0x7ff3d4032fa0 comp rx=0 tx=0).stop 2024-08-31T05:40:26.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.584+0000 7ff3e92cb740 1 -- 172.21.15.5:0/4076282517 shutdown_connections 2024-08-31T05:40:26.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.584+0000 7ff3e92cb740 1 --2- 172.21.15.5:0/4076282517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f90f32d4d0 0x55f90f6f2540 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:26.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.584+0000 7ff3e92cb740 1 --2- 172.21.15.5:0/4076282517 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f90f3252f0 0x55f90f6f2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:26.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.584+0000 7ff3e92cb740 1 --2- 172.21.15.5:0/4076282517 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f90f34e1b0 0x55f90f6f1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:26.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.584+0000 7ff3e92cb740 1 -- 172.21.15.5:0/4076282517 >> 172.21.15.5:0/4076282517 conn(0x55f90f342300 msgr2=0x55f90f6ef9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:26.596 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.594+0000 7ff3e92cb740 1 -- 172.21.15.5:0/4076282517 shutdown_connections 2024-08-31T05:40:26.599 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.596+0000 7ff3e92cb740 1 -- 172.21.15.5:0/4076282517 wait complete. 2024-08-31T05:40:26.599 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.597+0000 7ff3e92cb740 1 -- start start 2024-08-31T05:40:26.599 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.597+0000 7ff3e92cb740 1 Processor -- start 2024-08-31T05:40:26.603 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.601+0000 7ff3e92cb740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f90f3252f0 0x55f90f6fd830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:26.603 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.601+0000 7ff3e92cb740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f90f32d4d0 0x55f90f6fde10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:26.603 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.601+0000 7ff3e92cb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f90f34e1b0 0x55f90f70bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:26.603 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.601+0000 7ff3e92cb740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f90f58fab0 con 0x55f90f3252f0 2024-08-31T05:40:26.604 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.601+0000 7ff3e92cb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f90f5dd680 con 0x55f90f34e1b0 2024-08-31T05:40:26.604 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.601+0000 7ff3e92cb740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f90f708870 con 0x55f90f32d4d0 2024-08-31T05:40:26.604 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.601+0000 7ff3e92cb740 10 client.0 _ll_register_callbacks cb 0x55f90f365a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:40:26.605 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.602+0000 7ff3e08ff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f90f34e1b0 0x55f90f70bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:26.605 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.602+0000 7ff3e08ff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f90f34e1b0 0x55f90f70bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:35518/0 (socket says 172.21.15.5:35518) 2024-08-31T05:40:26.605 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.602+0000 7ff3e08ff640 1 -- 172.21.15.5:0/701215171 learned_addr learned my addr 172.21.15.5:0/701215171 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:26.605 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.603+0000 7ff3dbfff640 1 --2- 172.21.15.5:0/701215171 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f90f3252f0 0x55f90f6fd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:26.605 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.603+0000 7ff3db7fe640 1 --2- 172.21.15.5:0/701215171 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f90f32d4d0 0x55f90f6fde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:26.609 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.607+0000 7ff3dbfff640 1 -- 172.21.15.5:0/701215171 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f90f32d4d0 msgr2=0x55f90f6fde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:26.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.607+0000 7ff3dbfff640 1 --2- 172.21.15.5:0/701215171 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f90f32d4d0 0x55f90f6fde10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:26.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.607+0000 7ff3dbfff640 1 -- 172.21.15.5:0/701215171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f90f34e1b0 msgr2=0x55f90f70bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:26.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.607+0000 7ff3dbfff640 1 --2- 172.21.15.5:0/701215171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f90f34e1b0 0x55f90f70bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:26.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.607+0000 7ff3dbfff640 1 -- 172.21.15.5:0/701215171 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f90f432620 con 0x55f90f3252f0 2024-08-31T05:40:26.612 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.610+0000 7ff3e08ff640 1 --2- 172.21.15.5:0/701215171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f90f34e1b0 0x55f90f70bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:40:26.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.617+0000 7ff3dbfff640 1 --2- 172.21.15.5:0/701215171 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f90f3252f0 0x55f90f6fd830 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc012cf0 tx=0x7ff3cc00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6297f84143f8b32a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:26.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.618+0000 7ff3bb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:40:26.626 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.621+0000 7ff3bb7fe640 1 -- 172.21.15.5:0/701215171 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc012110 con 0x55f90f3252f0 2024-08-31T05:40:26.626 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.621+0000 7ff3e92cb740 1 -- 172.21.15.5:0/701215171 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3d4036040 con 0x55f90f3252f0 2024-08-31T05:40:26.626 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.621+0000 7ff3bb7fe640 1 -- 172.21.15.5:0/701215171 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7ff3cc004030 con 0x55f90f3252f0 2024-08-31T05:40:26.626 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.621+0000 7ff3bb7fe640 1 -- 172.21.15.5:0/701215171 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ff3cc0122b0 con 0x55f90f3252f0 2024-08-31T05:40:26.626 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.624+0000 7ff3e92cb740 10 client.18408 fetch_fsmap learned FSMap version 34 2024-08-31T05:40:26.626 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.624+0000 7ff3e92cb740 1 -- 172.21.15.5:0/701215171 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55f90f714a10 con 0x55f90f3252f0 2024-08-31T05:40:26.627 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.625+0000 7ff3bb7fe640 1 -- 172.21.15.5:0/701215171 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3d4036040 con 0x55f90f3252f0 2024-08-31T05:40:26.627 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.625+0000 7ff3bb7fe640 1 -- 172.21.15.5:0/701215171 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7ff3cc010430 con 0x55f90f3252f0 2024-08-31T05:40:26.627 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.625+0000 7ff3e92cb740 10 client.18408 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:40:26.627 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.625+0000 7ff3e92cb740 10 client.18408 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:40:26.627 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.625+0000 7ff3e92cb740 20 client.18408 populate_metadata read hostname 'smithi005' 2024-08-31T05:40:26.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.625+0000 7ff3e92cb740 1 --2- 172.21.15.5:0/701215171 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55f90f30cd80 0x55f90f718390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:26.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.625+0000 7ff3e92cb740 4 client.18408 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:40:26.628 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.625+0000 7ff3e92cb740 1 -- 172.21.15.5:0/701215171 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f90f668f50 con 0x55f90f30cd80 2024-08-31T05:40:26.629 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.628+0000 7ff3db7fe640 1 --2- 172.21.15.5:0/701215171 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55f90f30cd80 0x55f90f718390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:26.634 INFO:tasks.cephfs.filesystem:scrub status for tag:ab2853ca-505f-43fc-a132-af8bca186292 - {'path': '/', 'tag': 'ab2853ca-505f-43fc-a132-af8bca186292', 'options': 'recursive,force'} 2024-08-31T05:40:26.637 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.635+0000 7ff3db7fe640 1 --2- 172.21.15.5:0/701215171 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55f90f30cd80 0x55f90f718390 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de0785f187bac08b server_cookie=edec81f44ce1745d in_seq=0 out_seq=0 2024-08-31T05:40:26.639 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.636+0000 7ff3bb7fe640 10 client.18408 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:40:26.643 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.638+0000 7ff3bb7fe640 1 -- 172.21.15.5:0/701215171 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f90f668f50 con 0x55f90f30cd80 2024-08-31T05:40:26.643 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.638+0000 7ff3bb7fe640 10 client.18408 handle_command_reply: tid=0 2024-08-31T05:40:26.643 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.638+0000 7ff3e92cb740 1 client.18408 shutdown 2024-08-31T05:40:26.643 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.640+0000 7ff3e92cb740 1 -- 172.21.15.5:0/701215171 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f90f3252f0 msgr2=0x55f90f6fd830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:26.643 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.640+0000 7ff3e92cb740 1 --2- 172.21.15.5:0/701215171 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f90f3252f0 0x55f90f6fd830 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc012cf0 tx=0x7ff3cc00f790 comp rx=0 tx=0).stop 2024-08-31T05:40:26.643 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.641+0000 7ff3e92cb740 1 -- 172.21.15.5:0/701215171 shutdown_connections 2024-08-31T05:40:26.643 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.641+0000 7ff3e92cb740 1 --2- 172.21.15.5:0/701215171 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55f90f30cd80 0x55f90f718390 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:26.643 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.641+0000 7ff3e92cb740 1 --2- 172.21.15.5:0/701215171 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f90f34e1b0 0x55f90f70bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:26.643 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.641+0000 7ff3e92cb740 1 --2- 172.21.15.5:0/701215171 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f90f32d4d0 0x55f90f6fde10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:26.643 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.641+0000 7ff3e92cb740 1 --2- 172.21.15.5:0/701215171 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f90f3252f0 0x55f90f6fd830 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:26.643 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.641+0000 7ff3e92cb740 1 -- 172.21.15.5:0/701215171 >> 172.21.15.5:0/701215171 conn(0x55f90f342300 msgr2=0x55f90f6f2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:26.644 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.641+0000 7ff3bb7fe640 0 client.18408 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:40:26.648 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.645+0000 7ff3e92cb740 1 -- 172.21.15.5:0/701215171 shutdown_connections 2024-08-31T05:40:26.648 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.646+0000 7ff3e92cb740 1 -- 172.21.15.5:0/701215171 wait complete. 2024-08-31T05:40:26.649 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.647+0000 7ff3e92cb740 20 client.18408 trim_cache size 0 max 16384 2024-08-31T05:40:26.673 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.671+0000 7ff3e92cb740 1 Processor -- start 2024-08-31T05:40:26.673 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.671+0000 7ff3e92cb740 1 -- start start 2024-08-31T05:40:26.674 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.671+0000 7ff3e92cb740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f90f3252f0 0x55f90f70baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:26.674 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.671+0000 7ff3e92cb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f90f32d4d0 0x55f90f6fbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:26.674 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.671+0000 7ff3e92cb740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f90f34e1b0 0x55f90f6fc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:26.674 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.671+0000 7ff3e92cb740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff3dc1aec80 con 0x55f90f3252f0 2024-08-31T05:40:26.674 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.671+0000 7ff3e92cb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff3dc1b07c0 con 0x55f90f32d4d0 2024-08-31T05:40:26.674 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.671+0000 7ff3e92cb740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff3dc1af350 con 0x55f90f34e1b0 2024-08-31T05:40:26.674 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.671+0000 7ff3dbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f90f3252f0 0x55f90f70baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:26.674 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.671+0000 7ff3dbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f90f3252f0 0x55f90f70baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38998/0 (socket says 172.21.15.5:38998) 2024-08-31T05:40:26.674 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.671+0000 7ff3dbfff640 1 -- 172.21.15.5:0/3506896236 learned_addr learned my addr 172.21.15.5:0/3506896236 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:26.674 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.671+0000 7ff3db7fe640 1 --2- 172.21.15.5:0/3506896236 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f90f32d4d0 0x55f90f6fbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:26.674 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.671+0000 7ff3e08ff640 1 --2- 172.21.15.5:0/3506896236 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f90f34e1b0 0x55f90f6fc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:26.675 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.671+0000 7ff3dbfff640 1 -- 172.21.15.5:0/3506896236 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f90f34e1b0 msgr2=0x55f90f6fc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:26.675 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.671+0000 7ff3dbfff640 1 --2- 172.21.15.5:0/3506896236 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f90f34e1b0 0x55f90f6fc3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:26.675 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.671+0000 7ff3dbfff640 1 -- 172.21.15.5:0/3506896236 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f90f32d4d0 msgr2=0x55f90f6fbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:26.675 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.671+0000 7ff3dbfff640 1 --2- 172.21.15.5:0/3506896236 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f90f32d4d0 0x55f90f6fbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:26.675 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.671+0000 7ff3dbfff640 1 -- 172.21.15.5:0/3506896236 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f90f6fe540 con 0x55f90f3252f0 2024-08-31T05:40:26.675 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.672+0000 7ff3dbfff640 1 --2- 172.21.15.5:0/3506896236 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f90f3252f0 0x55f90f70baa0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc00fc90 tx=0x7ff3cc005d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b94ef5a9f88bcc69 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:26.675 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.672+0000 7ff3c1ffb640 1 -- 172.21.15.5:0/3506896236 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc011ed0 con 0x55f90f3252f0 2024-08-31T05:40:26.675 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.672+0000 7ff3c1ffb640 1 -- 172.21.15.5:0/3506896236 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3cc010430 con 0x55f90f3252f0 2024-08-31T05:40:26.676 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.672+0000 7ff3c1ffb640 1 -- 172.21.15.5:0/3506896236 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc0035f0 con 0x55f90f3252f0 2024-08-31T05:40:26.679 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.673+0000 7ff3e92cb740 1 -- 172.21.15.5:0/3506896236 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f90f3252f0 msgr2=0x55f90f70baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:26.679 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.673+0000 7ff3e92cb740 1 --2- 172.21.15.5:0/3506896236 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f90f3252f0 0x55f90f70baa0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc00fc90 tx=0x7ff3cc005d30 comp rx=0 tx=0).stop 2024-08-31T05:40:26.679 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.673+0000 7ff3e92cb740 1 -- 172.21.15.5:0/3506896236 shutdown_connections 2024-08-31T05:40:26.679 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.673+0000 7ff3e92cb740 1 --2- 172.21.15.5:0/3506896236 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f90f34e1b0 0x55f90f6fc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:26.679 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.673+0000 7ff3e92cb740 1 --2- 172.21.15.5:0/3506896236 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f90f32d4d0 0x55f90f6fbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:26.679 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.673+0000 7ff3e92cb740 1 --2- 172.21.15.5:0/3506896236 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f90f3252f0 0x55f90f70baa0 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:26.679 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.673+0000 7ff3e92cb740 1 -- 172.21.15.5:0/3506896236 >> 172.21.15.5:0/3506896236 conn(0x55f90f342300 msgr2=0x55f90f6f8720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:26.679 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.673+0000 7ff3e92cb740 1 -- 172.21.15.5:0/3506896236 shutdown_connections 2024-08-31T05:40:26.679 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.673+0000 7ff3e92cb740 1 -- 172.21.15.5:0/3506896236 wait complete. 2024-08-31T05:40:26.680 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.673+0000 7ff3e92cb740 1 -- start start 2024-08-31T05:40:26.680 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.673+0000 7ff3e92cb740 1 Processor -- start 2024-08-31T05:40:26.680 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.674+0000 7ff3e92cb740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f90f3252f0 0x55f90f70f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:26.680 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.674+0000 7ff3e92cb740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f90f32d4d0 0x55f90f70f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:26.680 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.674+0000 7ff3e92cb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f90f34e1b0 0x55f90f780d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:26.680 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.674+0000 7ff3e92cb740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff3dc1b00f0 con 0x55f90f3252f0 2024-08-31T05:40:26.680 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.674+0000 7ff3e92cb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff3dc1afa20 con 0x55f90f34e1b0 2024-08-31T05:40:26.680 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.674+0000 7ff3e92cb740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff3dc1acc80 con 0x55f90f32d4d0 2024-08-31T05:40:26.680 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.674+0000 7ff3dbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f90f3252f0 0x55f90f70f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:26.680 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.674+0000 7ff3db7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f90f32d4d0 0x55f90f70f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:26.680 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.674+0000 7ff3dbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f90f3252f0 0x55f90f70f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39008/0 (socket says 172.21.15.5:39008) 2024-08-31T05:40:26.680 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.674+0000 7ff3dbfff640 1 -- 172.21.15.5:0/2614870863 learned_addr learned my addr 172.21.15.5:0/2614870863 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:26.680 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.674+0000 7ff3e08ff640 1 --2- 172.21.15.5:0/2614870863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f90f34e1b0 0x55f90f780d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:26.681 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.674+0000 7ff3e92cb740 10 client.0 _ll_register_callbacks cb 0x7ff3cc009cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:40:26.681 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.674+0000 7ff3dbfff640 1 -- 172.21.15.5:0/2614870863 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f90f32d4d0 msgr2=0x55f90f70f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:26.681 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.674+0000 7ff3dbfff640 1 --2- 172.21.15.5:0/2614870863 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f90f32d4d0 0x55f90f70f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:26.681 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.674+0000 7ff3dbfff640 1 -- 172.21.15.5:0/2614870863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f90f34e1b0 msgr2=0x55f90f780d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:26.681 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.674+0000 7ff3dbfff640 1 --2- 172.21.15.5:0/2614870863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f90f34e1b0 0x55f90f780d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:26.681 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.674+0000 7ff3dbfff640 1 -- 172.21.15.5:0/2614870863 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f90f70ffc0 con 0x55f90f3252f0 2024-08-31T05:40:26.681 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.674+0000 7ff3db7fe640 1 --2- 172.21.15.5:0/2614870863 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f90f32d4d0 0x55f90f70f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:40:26.681 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.674+0000 7ff3dbfff640 1 --2- 172.21.15.5:0/2614870863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f90f3252f0 0x55f90f70f200 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc00a010 tx=0x7ff3cc0105e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f58d4e1649d1e404 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:26.681 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.674+0000 7ff3bb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:40:26.681 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.675+0000 7ff3bb7fe640 1 -- 172.21.15.5:0/2614870863 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc036020 con 0x55f90f3252f0 2024-08-31T05:40:26.681 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.675+0000 7ff3bb7fe640 1 -- 172.21.15.5:0/2614870863 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7ff3cc005640 con 0x55f90f3252f0 2024-08-31T05:40:26.681 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.675+0000 7ff3e92cb740 1 -- 172.21.15.5:0/2614870863 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3cc010430 con 0x55f90f3252f0 2024-08-31T05:40:26.681 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.675+0000 7ff3bb7fe640 1 -- 172.21.15.5:0/2614870863 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ff3cc03e050 con 0x55f90f3252f0 2024-08-31T05:40:26.681 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.675+0000 7ff3e92cb740 10 client.18414 fetch_fsmap learned FSMap version 34 2024-08-31T05:40:26.682 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.675+0000 7ff3e92cb740 1 -- 172.21.15.5:0/2614870863 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55f90f7822d0 con 0x55f90f3252f0 2024-08-31T05:40:26.682 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.675+0000 7ff3bb7fe640 1 -- 172.21.15.5:0/2614870863 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3cc010430 con 0x55f90f3252f0 2024-08-31T05:40:26.682 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.675+0000 7ff3bb7fe640 1 -- 172.21.15.5:0/2614870863 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7ff3cc032480 con 0x55f90f3252f0 2024-08-31T05:40:26.682 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.675+0000 7ff3e92cb740 10 client.18414 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:40:26.682 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.675+0000 7ff3e92cb740 10 client.18414 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:40:26.682 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.675+0000 7ff3e92cb740 20 client.18414 populate_metadata read hostname 'smithi005' 2024-08-31T05:40:26.682 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.675+0000 7ff3e92cb740 1 --2- 172.21.15.5:0/2614870863 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55f90f2e21c0 0x55f90f784960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:26.682 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.675+0000 7ff3e92cb740 4 client.18414 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:40:26.682 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.675+0000 7ff3e92cb740 1 -- 172.21.15.5:0/2614870863 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f90f6649f0 con 0x55f90f2e21c0 2024-08-31T05:40:26.682 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.675+0000 7ff3db7fe640 1 --2- 172.21.15.5:0/2614870863 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55f90f2e21c0 0x55f90f784960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:26.683 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.676+0000 7ff3db7fe640 1 --2- 172.21.15.5:0/2614870863 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55f90f2e21c0 0x55f90f784960 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a794c45d917f549d server_cookie=6a9fc5a21452bc71 in_seq=0 out_seq=0 2024-08-31T05:40:26.683 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.676+0000 7ff3bb7fe640 10 client.18414 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:40:26.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.689+0000 7ff3bb7fe640 1 -- 172.21.15.5:0/2614870863 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f90f6649f0 con 0x55f90f2e21c0 2024-08-31T05:40:26.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.689+0000 7ff3bb7fe640 10 client.18414 handle_command_reply: tid=0 2024-08-31T05:40:26.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.689+0000 7ff3e92cb740 1 client.18414 shutdown 2024-08-31T05:40:26.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.689+0000 7ff3e92cb740 1 -- 172.21.15.5:0/2614870863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f90f3252f0 msgr2=0x55f90f70f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:26.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.689+0000 7ff3e92cb740 1 --2- 172.21.15.5:0/2614870863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f90f3252f0 0x55f90f70f200 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc00a010 tx=0x7ff3cc0105e0 comp rx=0 tx=0).stop 2024-08-31T05:40:26.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.690+0000 7ff3e92cb740 1 -- 172.21.15.5:0/2614870863 shutdown_connections 2024-08-31T05:40:26.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.690+0000 7ff3e92cb740 1 --2- 172.21.15.5:0/2614870863 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55f90f2e21c0 0x55f90f784960 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:26.692 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.690+0000 7ff3e92cb740 1 --2- 172.21.15.5:0/2614870863 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f90f34e1b0 0x55f90f780d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:26.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.690+0000 7ff3bb7fe640 0 client.18414 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:40:26.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.690+0000 7ff3e92cb740 1 --2- 172.21.15.5:0/2614870863 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f90f32d4d0 0x55f90f70f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:26.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.690+0000 7ff3e92cb740 1 --2- 172.21.15.5:0/2614870863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f90f3252f0 0x55f90f70f200 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:26.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.690+0000 7ff3e92cb740 1 -- 172.21.15.5:0/2614870863 >> 172.21.15.5:0/2614870863 conn(0x55f90f342300 msgr2=0x55f90f6f8720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:26.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.690+0000 7ff3e92cb740 1 -- 172.21.15.5:0/2614870863 shutdown_connections 2024-08-31T05:40:26.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.690+0000 7ff3e92cb740 1 -- 172.21.15.5:0/2614870863 wait complete. 2024-08-31T05:40:26.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.690+0000 7ff3e92cb740 20 client.18414 trim_cache size 0 max 16384 2024-08-31T05:40:26.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:40:26.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:40:26.693 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:40:26.694 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:40:26.694 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.690+0000 7ff3e2362640 1 -- 172.21.15.5:0/3387213807 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff3c40b4cd0 msgr2=0x7ff3c40b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:26.694 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.690+0000 7ff3e2362640 1 --2- 172.21.15.5:0/3387213807 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff3c40b4cd0 0x7ff3c40b71e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4033010 tx=0x7ff3d403b000 comp rx=0 tx=0).stop 2024-08-31T05:40:26.694 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.690+0000 7ff3e2362640 1 -- 172.21.15.5:0/3387213807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3dc108090 msgr2=0x7ff3dc0febd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:26.694 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.690+0000 7ff3e2362640 1 --2- 172.21.15.5:0/3387213807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3dc108090 0x7ff3dc0febd0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7ff3d000e970 tx=0x7ff3d000ee30 comp rx=0 tx=0).stop 2024-08-31T05:40:26.695 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.690+0000 7ff3e2362640 1 -- 172.21.15.5:0/3387213807 shutdown_connections 2024-08-31T05:40:26.695 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.690+0000 7ff3e2362640 1 --2- 172.21.15.5:0/3387213807 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff3c40b4cd0 0x7ff3c40b71e0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:26.695 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.690+0000 7ff3e2362640 1 --2- 172.21.15.5:0/3387213807 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff3dc1089e0 0x7ff3dc0ff110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:26.695 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.690+0000 7ff3e2362640 1 --2- 172.21.15.5:0/3387213807 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3dc108090 0x7ff3dc0febd0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:26.695 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.690+0000 7ff3e2362640 1 --2- 172.21.15.5:0/3387213807 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff3dc102760 0x7ff3dc0fe690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:26.695 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.690+0000 7ff3e2362640 1 -- 172.21.15.5:0/3387213807 >> 172.21.15.5:0/3387213807 conn(0x7ff3dc0fe160 msgr2=0x7ff3dc105620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:26.695 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.690+0000 7ff3e2362640 1 -- 172.21.15.5:0/3387213807 shutdown_connections 2024-08-31T05:40:26.695 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:26.690+0000 7ff3e2362640 1 -- 172.21.15.5:0/3387213807 wait complete. 2024-08-31T05:40:26.936 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1177349 10.94 MB/sec execute 434 sec latency 148.721 ms 2024-08-31T05:40:27.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:40:26 smithi050 ceph-mon[22146]: pgmap v667: 129 pgs: 129 active+clean; 558 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 5.2 MiB/s wr, 242 op/s 2024-08-31T05:40:27.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:40:26 smithi005 ceph-mon[18602]: pgmap v667: 129 pgs: 129 active+clean; 558 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 5.2 MiB/s wr, 242 op/s 2024-08-31T05:40:27.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:40:26 smithi070 ceph-mon[22316]: pgmap v667: 129 pgs: 129 active+clean; 558 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 5.2 MiB/s wr, 242 op/s 2024-08-31T05:40:27.936 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1179563 10.94 MB/sec execute 435 sec latency 13.698 ms 2024-08-31T05:40:28.936 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1181011 10.93 MB/sec execute 436 sec latency 26.328 ms 2024-08-31T05:40:29.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:40:28 smithi005 ceph-mon[18602]: pgmap v668: 129 pgs: 129 active+clean; 562 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.2 MiB/s wr, 197 op/s 2024-08-31T05:40:29.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:40:28 smithi070 ceph-mon[22316]: pgmap v668: 129 pgs: 129 active+clean; 562 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.2 MiB/s wr, 197 op/s 2024-08-31T05:40:29.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:40:28 smithi050 ceph-mon[22146]: pgmap v668: 129 pgs: 129 active+clean; 562 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.2 MiB/s wr, 197 op/s 2024-08-31T05:40:29.936 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1183340 10.94 MB/sec execute 437 sec latency 15.384 ms 2024-08-31T05:40:30.936 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1185331 10.93 MB/sec execute 438 sec latency 29.114 ms 2024-08-31T05:40:31.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:40:30 smithi005 ceph-mon[18602]: pgmap v669: 129 pgs: 129 active+clean; 568 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.9 MiB/s wr, 236 op/s 2024-08-31T05:40:31.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:40:30 smithi070 ceph-mon[22316]: pgmap v669: 129 pgs: 129 active+clean; 568 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.9 MiB/s wr, 236 op/s 2024-08-31T05:40:31.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:40:30 smithi050 ceph-mon[22146]: pgmap v669: 129 pgs: 129 active+clean; 568 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.9 MiB/s wr, 236 op/s 2024-08-31T05:40:31.936 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1187080 10.93 MB/sec execute 439 sec latency 95.042 ms 2024-08-31T05:40:32.936 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1189168 10.93 MB/sec execute 440 sec latency 34.755 ms 2024-08-31T05:40:33.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:40:32 smithi005 ceph-mon[18602]: pgmap v670: 129 pgs: 129 active+clean; 576 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.2 MiB/s wr, 206 op/s 2024-08-31T05:40:33.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:40:32 smithi005 ceph-mon[18602]: scrub summary: idle 2024-08-31T05:40:33.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:40:32 smithi070 ceph-mon[22316]: pgmap v670: 129 pgs: 129 active+clean; 576 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.2 MiB/s wr, 206 op/s 2024-08-31T05:40:33.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:40:32 smithi070 ceph-mon[22316]: scrub summary: idle 2024-08-31T05:40:33.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:40:32 smithi050 ceph-mon[22146]: pgmap v670: 129 pgs: 129 active+clean; 576 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.2 MiB/s wr, 206 op/s 2024-08-31T05:40:33.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:40:32 smithi050 ceph-mon[22146]: scrub summary: idle 2024-08-31T05:40:33.936 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1191224 10.94 MB/sec execute 441 sec latency 12.791 ms 2024-08-31T05:40:34.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:40:33 smithi005 ceph-mon[18602]: scrub summary: idle 2024-08-31T05:40:34.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:40:33 smithi070 ceph-mon[22316]: scrub summary: idle 2024-08-31T05:40:34.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:40:33 smithi050 ceph-mon[22146]: scrub summary: idle 2024-08-31T05:40:34.936 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1193637 10.94 MB/sec execute 442 sec latency 15.332 ms 2024-08-31T05:40:35.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:40:34 smithi005 ceph-mon[18602]: pgmap v671: 129 pgs: 129 active+clean; 577 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.1 MiB/s wr, 207 op/s 2024-08-31T05:40:35.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:40:34 smithi070 ceph-mon[22316]: pgmap v671: 129 pgs: 129 active+clean; 577 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.1 MiB/s wr, 207 op/s 2024-08-31T05:40:35.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:40:34 smithi050 ceph-mon[22146]: pgmap v671: 129 pgs: 129 active+clean; 577 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.1 MiB/s wr, 207 op/s 2024-08-31T05:40:35.936 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1195040 10.93 MB/sec execute 443 sec latency 30.397 ms 2024-08-31T05:40:36.936 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1197329 10.94 MB/sec execute 444 sec latency 83.546 ms 2024-08-31T05:40:37.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:40:36 smithi005 ceph-mon[18602]: pgmap v672: 129 pgs: 129 active+clean; 586 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.2 MiB/s wr, 262 op/s 2024-08-31T05:40:37.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:40:36 smithi070 ceph-mon[22316]: pgmap v672: 129 pgs: 129 active+clean; 586 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.2 MiB/s wr, 262 op/s 2024-08-31T05:40:37.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:40:36 smithi050 ceph-mon[22146]: pgmap v672: 129 pgs: 129 active+clean; 586 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.2 MiB/s wr, 262 op/s 2024-08-31T05:40:37.936 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1198914 10.92 MB/sec execute 445 sec latency 39.649 ms 2024-08-31T05:40:38.937 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1201139 10.93 MB/sec execute 446 sec latency 16.764 ms 2024-08-31T05:40:39.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:40:38 smithi005 ceph-mon[18602]: pgmap v673: 129 pgs: 129 active+clean; 586 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.8 MiB/s wr, 210 op/s 2024-08-31T05:40:39.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:40:38 smithi070 ceph-mon[22316]: pgmap v673: 129 pgs: 129 active+clean; 586 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.8 MiB/s wr, 210 op/s 2024-08-31T05:40:39.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:40:38 smithi050 ceph-mon[22146]: pgmap v673: 129 pgs: 129 active+clean; 586 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.8 MiB/s wr, 210 op/s 2024-08-31T05:40:39.796 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.792+0000 7f4e78684640 1 -- 172.21.15.5:0/2181547736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e70102790 msgr2=0x7f4e70102ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:39.796 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.792+0000 7f4e78684640 1 --2- 172.21.15.5:0/2181547736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e70102790 0x7f4e70102ba0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f4e60009ca0 tx=0x7f4e6002a8c0 comp rx=0 tx=0).stop 2024-08-31T05:40:39.796 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.792+0000 7f4e78684640 1 -- 172.21.15.5:0/2181547736 shutdown_connections 2024-08-31T05:40:39.796 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.792+0000 7f4e78684640 1 --2- 172.21.15.5:0/2181547736 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e70108a10 0x7f4e7010f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:39.796 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.792+0000 7f4e78684640 1 --2- 172.21.15.5:0/2181547736 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e701080c0 0x7f4e701084d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:39.796 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.792+0000 7f4e78684640 1 --2- 172.21.15.5:0/2181547736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e70102790 0x7f4e70102ba0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:39.796 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.792+0000 7f4e78684640 1 -- 172.21.15.5:0/2181547736 >> 172.21.15.5:0/2181547736 conn(0x7f4e700fe190 msgr2=0x7f4e701005e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:39.796 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.792+0000 7f4e78684640 1 -- 172.21.15.5:0/2181547736 shutdown_connections 2024-08-31T05:40:39.796 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.792+0000 7f4e78684640 1 -- 172.21.15.5:0/2181547736 wait complete. 2024-08-31T05:40:39.797 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.792+0000 7f4e78684640 1 Processor -- start 2024-08-31T05:40:39.797 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.792+0000 7f4e78684640 1 -- start start 2024-08-31T05:40:39.797 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.793+0000 7f4e78684640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e70102790 0x7f4e7019aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:39.797 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.793+0000 7f4e78684640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e701080c0 0x7f4e7019b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:39.797 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.793+0000 7f4e78684640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e70108a10 0x7f4e7019ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:39.797 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.793+0000 7f4e78684640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4e701126e0 con 0x7f4e70102790 2024-08-31T05:40:39.797 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.793+0000 7f4e78684640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4e70112560 con 0x7f4e70108a10 2024-08-31T05:40:39.797 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.793+0000 7f4e78684640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4e70112860 con 0x7f4e701080c0 2024-08-31T05:40:39.797 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.793+0000 7f4e76420640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e70102790 0x7f4e7019aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:39.797 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.793+0000 7f4e75c1f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e701080c0 0x7f4e7019b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:39.797 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.793+0000 7f4e76420640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e70102790 0x7f4e7019aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49942/0 (socket says 172.21.15.5:49942) 2024-08-31T05:40:39.797 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.793+0000 7f4e76420640 1 -- 172.21.15.5:0/929677126 learned_addr learned my addr 172.21.15.5:0/929677126 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:39.798 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.793+0000 7f4e76c21640 1 --2- 172.21.15.5:0/929677126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e70108a10 0x7f4e7019ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:39.798 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.793+0000 7f4e75c1f640 1 -- 172.21.15.5:0/929677126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e70108a10 msgr2=0x7f4e7019ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:39.798 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.793+0000 7f4e75c1f640 1 --2- 172.21.15.5:0/929677126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e70108a10 0x7f4e7019ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:39.798 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.793+0000 7f4e75c1f640 1 -- 172.21.15.5:0/929677126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e70102790 msgr2=0x7f4e7019aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:39.798 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.793+0000 7f4e75c1f640 1 --2- 172.21.15.5:0/929677126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e70102790 0x7f4e7019aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:39.798 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.793+0000 7f4e75c1f640 1 -- 172.21.15.5:0/929677126 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e701a62b0 con 0x7f4e701080c0 2024-08-31T05:40:39.798 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.793+0000 7f4e76420640 1 --2- 172.21.15.5:0/929677126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e70102790 0x7f4e7019aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:40:39.798 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.793+0000 7f4e75c1f640 1 --2- 172.21.15.5:0/929677126 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e701080c0 0x7f4e7019b530 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4e7006b2e0 tx=0x7f4e6400ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:39.798 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.794+0000 7f4e6f7fe640 1 -- 172.21.15.5:0/929677126 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6400cc40 con 0x7f4e701080c0 2024-08-31T05:40:39.798 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.794+0000 7f4e6f7fe640 1 -- 172.21.15.5:0/929677126 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e6400cde0 con 0x7f4e701080c0 2024-08-31T05:40:39.798 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.794+0000 7f4e78684640 1 -- 172.21.15.5:0/929677126 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e70198e40 con 0x7f4e701080c0 2024-08-31T05:40:39.798 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.794+0000 7f4e6f7fe640 1 -- 172.21.15.5:0/929677126 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e64018780 con 0x7f4e701080c0 2024-08-31T05:40:39.798 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.794+0000 7f4e78684640 1 -- 172.21.15.5:0/929677126 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e70199390 con 0x7f4e701080c0 2024-08-31T05:40:39.799 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.797+0000 7f4e7f5ee740 1 Processor -- start 2024-08-31T05:40:39.799 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.797+0000 7f4e7f5ee740 1 -- start start 2024-08-31T05:40:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.797+0000 7f4e7f5ee740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1f814c1b0 0x55f1f84efac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.798+0000 7f4e7f5ee740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1f81232f0 0x55f1f84f0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.798+0000 7f4e7f5ee740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1f812b4d0 0x55f1f84f0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.798+0000 7f4e7f5ee740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f1f8465000 con 0x55f1f81232f0 2024-08-31T05:40:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.798+0000 7f4e7f5ee740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f1f8454590 con 0x55f1f812b4d0 2024-08-31T05:40:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.798+0000 7f4e7f5ee740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f1f8458540 con 0x55f1f814c1b0 2024-08-31T05:40:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.798+0000 7f4e6f7fe640 1 -- 172.21.15.5:0/929677126 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f4e64010a90 con 0x7f4e701080c0 2024-08-31T05:40:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.798+0000 7f4e76c21640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1f814c1b0 0x55f1f84efac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.798+0000 7f4e76c21640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1f814c1b0 0x55f1f84efac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:59548/0 (socket says 172.21.15.5:59548) 2024-08-31T05:40:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.798+0000 7f4e76c21640 1 -- 172.21.15.5:0/1834488242 learned_addr learned my addr 172.21.15.5:0/1834488242 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.798+0000 7f4e76420640 1 --2- 172.21.15.5:0/1834488242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1f81232f0 0x55f1f84f0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.798+0000 7f4e75c1f640 1 --2- 172.21.15.5:0/1834488242 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1f812b4d0 0x55f1f84f0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.798+0000 7f4e76c21640 1 -- 172.21.15.5:0/1834488242 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1f812b4d0 msgr2=0x55f1f84f0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.798+0000 7f4e76c21640 1 --2- 172.21.15.5:0/1834488242 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1f812b4d0 0x55f1f84f0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.798+0000 7f4e76c21640 1 -- 172.21.15.5:0/1834488242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1f81232f0 msgr2=0x55f1f84f0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.798+0000 7f4e76c21640 1 --2- 172.21.15.5:0/1834488242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1f81232f0 0x55f1f84f0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.798+0000 7f4e76c21640 1 -- 172.21.15.5:0/1834488242 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1f81b7790 con 0x55f1f814c1b0 2024-08-31T05:40:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.798+0000 7f4e76c21640 1 --2- 172.21.15.5:0/1834488242 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1f814c1b0 0x55f1f84efac0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4e68009cd0 tx=0x7f4e68011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a07688bf8a4037a4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.799+0000 7f4e6cbfe640 1 -- 172.21.15.5:0/1834488242 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6801e070 con 0x55f1f814c1b0 2024-08-31T05:40:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.799+0000 7f4e6f7fe640 1 --2- 172.21.15.5:0/929677126 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4e580b4ca0 0x7f4e580b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:39.803 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.799+0000 7f4e6cbfe640 1 -- 172.21.15.5:0/1834488242 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e68019ae0 con 0x55f1f814c1b0 2024-08-31T05:40:39.803 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.799+0000 7f4e6cbfe640 1 -- 172.21.15.5:0/1834488242 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6800e9e0 con 0x55f1f814c1b0 2024-08-31T05:40:39.803 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.799+0000 7f4e76420640 1 --2- 172.21.15.5:0/929677126 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4e580b4ca0 0x7f4e580b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:39.803 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.799+0000 7f4e6f7fe640 1 -- 172.21.15.5:0/929677126 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7f4e640e5bd0 con 0x7f4e701080c0 2024-08-31T05:40:39.807 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.800+0000 7f4e7f5ee740 1 -- 172.21.15.5:0/1834488242 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1f814c1b0 msgr2=0x55f1f84efac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:39.807 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.800+0000 7f4e76420640 1 --2- 172.21.15.5:0/929677126 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4e580b4ca0 0x7f4e580b71b0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x55f1f84ee740 tx=0x7f4e60009480 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:39.807 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.800+0000 7f4e7f5ee740 1 --2- 172.21.15.5:0/1834488242 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1f814c1b0 0x55f1f84efac0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4e68009cd0 tx=0x7f4e68011810 comp rx=0 tx=0).stop 2024-08-31T05:40:39.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.800+0000 7f4e7f5ee740 1 -- 172.21.15.5:0/1834488242 shutdown_connections 2024-08-31T05:40:39.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.800+0000 7f4e7f5ee740 1 --2- 172.21.15.5:0/1834488242 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1f812b4d0 0x55f1f84f0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:39.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.800+0000 7f4e7f5ee740 1 --2- 172.21.15.5:0/1834488242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1f81232f0 0x55f1f84f0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:39.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.800+0000 7f4e7f5ee740 1 --2- 172.21.15.5:0/1834488242 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1f814c1b0 0x55f1f84efac0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:39.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.800+0000 7f4e7f5ee740 1 -- 172.21.15.5:0/1834488242 >> 172.21.15.5:0/1834488242 conn(0x55f1f8140300 msgr2=0x55f1f84ed9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:39.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.800+0000 7f4e7f5ee740 1 -- 172.21.15.5:0/1834488242 shutdown_connections 2024-08-31T05:40:39.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.800+0000 7f4e7f5ee740 1 -- 172.21.15.5:0/1834488242 wait complete. 2024-08-31T05:40:39.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.800+0000 7f4e7f5ee740 1 -- start start 2024-08-31T05:40:39.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.800+0000 7f4e7f5ee740 1 Processor -- start 2024-08-31T05:40:39.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.801+0000 7f4e7f5ee740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1f81232f0 0x55f1f84fb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:39.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.801+0000 7f4e7f5ee740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1f812b4d0 0x55f1f84fbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:39.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.801+0000 7f4e7f5ee740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1f814c1b0 0x55f1f8507590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:39.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.801+0000 7f4e7f5ee740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f1f838dab0 con 0x55f1f814c1b0 2024-08-31T05:40:39.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.801+0000 7f4e7f5ee740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f1f83db680 con 0x55f1f81232f0 2024-08-31T05:40:39.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.801+0000 7f4e7f5ee740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f1f84fe240 con 0x55f1f812b4d0 2024-08-31T05:40:39.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.801+0000 7f4e7f5ee740 10 client.0 _ll_register_callbacks cb 0x55f1f8163a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:40:39.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.801+0000 7f4e76c21640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1f814c1b0 0x55f1f8507590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:39.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.801+0000 7f4e76420640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1f81232f0 0x55f1f84fb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:39.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.801+0000 7f4e76420640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1f81232f0 0x55f1f84fb6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:55242/0 (socket says 172.21.15.5:55242) 2024-08-31T05:40:39.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.801+0000 7f4e76c21640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1f814c1b0 0x55f1f8507590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49952/0 (socket says 172.21.15.5:49952) 2024-08-31T05:40:39.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.801+0000 7f4e76420640 1 -- 172.21.15.5:0/1772383233 learned_addr learned my addr 172.21.15.5:0/1772383233 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:39.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.801+0000 7f4e75c1f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1f812b4d0 0x55f1f84fbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:39.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.801+0000 7f4e76420640 1 -- 172.21.15.5:0/1772383233 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1f812b4d0 msgr2=0x55f1f84fbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:39.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.801+0000 7f4e76420640 1 --2- 172.21.15.5:0/1772383233 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1f812b4d0 0x55f1f84fbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:39.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.801+0000 7f4e76420640 1 -- 172.21.15.5:0/1772383233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1f814c1b0 msgr2=0x55f1f8507590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:39.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.801+0000 7f4e76420640 1 --2- 172.21.15.5:0/1772383233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1f814c1b0 0x55f1f8507590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:39.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.801+0000 7f4e76420640 1 -- 172.21.15.5:0/1772383233 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1f8230620 con 0x55f1f81232f0 2024-08-31T05:40:39.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.801+0000 7f4e76c21640 1 --2- 172.21.15.5:0/1772383233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1f814c1b0 0x55f1f8507590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:40:39.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.801+0000 7f4e76420640 1 --2- 172.21.15.5:0/1772383233 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1f81232f0 0x55f1f84fb6c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4e60031a00 tx=0x7f4e6002a8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fb6cad3d4a1d186 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:39.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.801+0000 7f4e55ffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:40:39.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.801+0000 7f4e55ffb640 1 -- 172.21.15.5:0/1772383233 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e60004250 con 0x55f1f81232f0 2024-08-31T05:40:39.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.801+0000 7f4e7f5ee740 1 -- 172.21.15.5:0/1772383233 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e68019ae0 con 0x55f1f81232f0 2024-08-31T05:40:39.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.801+0000 7f4e55ffb640 1 -- 172.21.15.5:0/1772383233 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7f4e600043f0 con 0x55f1f81232f0 2024-08-31T05:40:39.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.802+0000 7f4e55ffb640 1 -- 172.21.15.5:0/1772383233 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f4e600045f0 con 0x55f1f81232f0 2024-08-31T05:40:39.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.802+0000 7f4e7f5ee740 10 client.27995 fetch_fsmap learned FSMap version 34 2024-08-31T05:40:39.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.802+0000 7f4e7f5ee740 1 -- 172.21.15.5:0/1772383233 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55f1f850a310 con 0x55f1f81232f0 2024-08-31T05:40:39.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.802+0000 7f4e55ffb640 1 -- 172.21.15.5:0/1772383233 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e68019ae0 con 0x55f1f81232f0 2024-08-31T05:40:39.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.802+0000 7f4e55ffb640 1 -- 172.21.15.5:0/1772383233 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f4e60052070 con 0x55f1f81232f0 2024-08-31T05:40:39.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.802+0000 7f4e7f5ee740 10 client.27995 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:40:39.811 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.802+0000 7f4e7f5ee740 10 client.27995 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:40:39.811 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.802+0000 7f4e7f5ee740 20 client.27995 populate_metadata read hostname 'smithi005' 2024-08-31T05:40:39.811 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.802+0000 7f4e7f5ee740 1 --2- 172.21.15.5:0/1772383233 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55f1f810ad80 0x55f1f850d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:39.811 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.802+0000 7f4e7f5ee740 4 client.27995 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:40:39.811 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.802+0000 7f4e7f5ee740 1 -- 172.21.15.5:0/1772383233 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f1f8466f50 con 0x55f1f810ad80 2024-08-31T05:40:39.811 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.802+0000 7f4e75c1f640 1 --2- 172.21.15.5:0/1772383233 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55f1f810ad80 0x55f1f850d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:39.811 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.803+0000 7f4e75c1f640 1 --2- 172.21.15.5:0/1772383233 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55f1f810ad80 0x55f1f850d7a0 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96db223d3ddfc490 server_cookie=836163104fda24ee in_seq=0 out_seq=0 2024-08-31T05:40:39.811 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.803+0000 7f4e55ffb640 10 client.27995 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:40:39.811 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.803+0000 7f4e55ffb640 1 -- 172.21.15.5:0/1772383233 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f1f8466f50 con 0x55f1f810ad80 2024-08-31T05:40:39.811 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.803+0000 7f4e55ffb640 10 client.27995 handle_command_reply: tid=0 2024-08-31T05:40:39.811 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.803+0000 7f4e7f5ee740 1 client.27995 shutdown 2024-08-31T05:40:39.811 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.804+0000 7f4e7f5ee740 1 -- 172.21.15.5:0/1772383233 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1f81232f0 msgr2=0x55f1f84fb6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:39.811 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.804+0000 7f4e7f5ee740 1 --2- 172.21.15.5:0/1772383233 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1f81232f0 0x55f1f84fb6c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4e60031a00 tx=0x7f4e6002a8c0 comp rx=0 tx=0).stop 2024-08-31T05:40:39.811 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.804+0000 7f4e7f5ee740 1 -- 172.21.15.5:0/1772383233 shutdown_connections 2024-08-31T05:40:39.812 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.804+0000 7f4e7f5ee740 1 --2- 172.21.15.5:0/1772383233 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55f1f810ad80 0x55f1f850d7a0 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:39.812 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.804+0000 7f4e7f5ee740 1 --2- 172.21.15.5:0/1772383233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1f814c1b0 0x55f1f8507590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:39.812 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.804+0000 7f4e7f5ee740 1 --2- 172.21.15.5:0/1772383233 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1f812b4d0 0x55f1f84fbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:39.812 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.804+0000 7f4e7f5ee740 1 --2- 172.21.15.5:0/1772383233 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1f81232f0 0x55f1f84fb6c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:39.812 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.804+0000 7f4e55ffb640 0 client.27995 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:40:39.812 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.804+0000 7f4e7f5ee740 1 -- 172.21.15.5:0/1772383233 >> 172.21.15.5:0/1772383233 conn(0x55f1f8140300 msgr2=0x55f1f84f0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:39.812 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.804+0000 7f4e7f5ee740 1 -- 172.21.15.5:0/1772383233 shutdown_connections 2024-08-31T05:40:39.812 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.804+0000 7f4e7f5ee740 1 -- 172.21.15.5:0/1772383233 wait complete. 2024-08-31T05:40:39.812 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.804+0000 7f4e7f5ee740 20 client.27995 trim_cache size 0 max 16384 2024-08-31T05:40:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.819+0000 7f4e7f5ee740 1 Processor -- start 2024-08-31T05:40:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.819+0000 7f4e7f5ee740 1 -- start start 2024-08-31T05:40:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.819+0000 7f4e7f5ee740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1f81232f0 0x55f1f84f4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.819+0000 7f4e7f5ee740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1f812b4d0 0x55f1f84f50c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.819+0000 7f4e7f5ee740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1f814c1b0 0x55f1f84f8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.819+0000 7f4e7f5ee740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4e701b2ed0 con 0x55f1f812b4d0 2024-08-31T05:40:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.819+0000 7f4e7f5ee740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4e701b4a10 con 0x55f1f81232f0 2024-08-31T05:40:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.819+0000 7f4e7f5ee740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4e701b35a0 con 0x55f1f814c1b0 2024-08-31T05:40:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.819+0000 7f4e75c1f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1f812b4d0 0x55f1f84f50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.819+0000 7f4e75c1f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1f812b4d0 0x55f1f84f50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49962/0 (socket says 172.21.15.5:49962) 2024-08-31T05:40:39.822 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.819+0000 7f4e75c1f640 1 -- 172.21.15.5:0/1100330052 learned_addr learned my addr 172.21.15.5:0/1100330052 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.819+0000 7f4e76420640 1 --2- 172.21.15.5:0/1100330052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1f81232f0 0x55f1f84f4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.819+0000 7f4e76c21640 1 --2- 172.21.15.5:0/1100330052 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1f814c1b0 0x55f1f84f8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.819+0000 7f4e75c1f640 1 -- 172.21.15.5:0/1100330052 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1f814c1b0 msgr2=0x55f1f84f8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.819+0000 7f4e75c1f640 1 --2- 172.21.15.5:0/1100330052 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1f814c1b0 0x55f1f84f8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.819+0000 7f4e75c1f640 1 -- 172.21.15.5:0/1100330052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1f81232f0 msgr2=0x55f1f84f4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.819+0000 7f4e75c1f640 1 --2- 172.21.15.5:0/1100330052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1f81232f0 0x55f1f84f4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.819+0000 7f4e75c1f640 1 -- 172.21.15.5:0/1100330052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1f84fc0a0 con 0x55f1f812b4d0 2024-08-31T05:40:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.820+0000 7f4e75c1f640 1 --2- 172.21.15.5:0/1100330052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1f812b4d0 0x55f1f84f50c0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f4e640abc90 tx=0x7f4e6400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80ec206098d50d2e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.820+0000 7f4e57fff640 1 -- 172.21.15.5:0/1100330052 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e640b5200 con 0x55f1f812b4d0 2024-08-31T05:40:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.820+0000 7f4e57fff640 1 -- 172.21.15.5:0/1100330052 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e640e31c0 con 0x55f1f812b4d0 2024-08-31T05:40:39.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.820+0000 7f4e57fff640 1 -- 172.21.15.5:0/1100330052 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e640a7900 con 0x55f1f812b4d0 2024-08-31T05:40:39.826 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.820+0000 7f4e7f5ee740 1 -- 172.21.15.5:0/1100330052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1f812b4d0 msgr2=0x55f1f84f50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:39.826 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.820+0000 7f4e7f5ee740 1 --2- 172.21.15.5:0/1100330052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1f812b4d0 0x55f1f84f50c0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f4e640abc90 tx=0x7f4e6400cf90 comp rx=0 tx=0).stop 2024-08-31T05:40:39.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.820+0000 7f4e7f5ee740 1 -- 172.21.15.5:0/1100330052 shutdown_connections 2024-08-31T05:40:39.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.820+0000 7f4e7f5ee740 1 --2- 172.21.15.5:0/1100330052 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1f814c1b0 0x55f1f84f8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:39.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.820+0000 7f4e7f5ee740 1 --2- 172.21.15.5:0/1100330052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1f812b4d0 0x55f1f84f50c0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:39.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.820+0000 7f4e7f5ee740 1 --2- 172.21.15.5:0/1100330052 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1f81232f0 0x55f1f84f4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:39.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.820+0000 7f4e7f5ee740 1 -- 172.21.15.5:0/1100330052 >> 172.21.15.5:0/1100330052 conn(0x55f1f8140300 msgr2=0x55f1f84f9d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:39.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.821+0000 7f4e7f5ee740 1 -- 172.21.15.5:0/1100330052 shutdown_connections 2024-08-31T05:40:39.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.821+0000 7f4e7f5ee740 1 -- 172.21.15.5:0/1100330052 wait complete. 2024-08-31T05:40:39.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.821+0000 7f4e7f5ee740 1 -- start start 2024-08-31T05:40:39.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.821+0000 7f4e7f5ee740 1 Processor -- start 2024-08-31T05:40:39.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.821+0000 7f4e7f5ee740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1f81232f0 0x55f1f8503a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:39.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.821+0000 7f4e7f5ee740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1f812b4d0 0x55f1f8500f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:39.827 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.821+0000 7f4e7f5ee740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1f814c1b0 0x55f1f8501480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:39.828 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.821+0000 7f4e7f5ee740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4e701b4340 con 0x55f1f81232f0 2024-08-31T05:40:39.828 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.821+0000 7f4e7f5ee740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4e701b3c70 con 0x55f1f814c1b0 2024-08-31T05:40:39.828 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.821+0000 7f4e7f5ee740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4e701b0ed0 con 0x55f1f812b4d0 2024-08-31T05:40:39.828 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.821+0000 7f4e7f5ee740 10 client.0 _ll_register_callbacks cb 0x7f4e60009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:40:39.828 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.821+0000 7f4e76420640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1f81232f0 0x55f1f8503a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:39.828 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.821+0000 7f4e76420640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1f81232f0 0x55f1f8503a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49974/0 (socket says 172.21.15.5:49974) 2024-08-31T05:40:39.828 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.821+0000 7f4e76420640 1 -- 172.21.15.5:0/397690124 learned_addr learned my addr 172.21.15.5:0/397690124 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:39.828 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.821+0000 7f4e75c1f640 1 --2- 172.21.15.5:0/397690124 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1f812b4d0 0x55f1f8500f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:39.828 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.821+0000 7f4e76c21640 1 --2- 172.21.15.5:0/397690124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1f814c1b0 0x55f1f8501480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:39.828 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.822+0000 7f4e76420640 1 -- 172.21.15.5:0/397690124 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1f812b4d0 msgr2=0x55f1f8500f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:39.828 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.822+0000 7f4e76420640 1 --2- 172.21.15.5:0/397690124 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1f812b4d0 0x55f1f8500f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:39.828 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.822+0000 7f4e76420640 1 -- 172.21.15.5:0/397690124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1f814c1b0 msgr2=0x55f1f8501480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:39.828 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.822+0000 7f4e76420640 1 --2- 172.21.15.5:0/397690124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1f814c1b0 0x55f1f8501480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:39.829 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.822+0000 7f4e76420640 1 -- 172.21.15.5:0/397690124 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1f85019c0 con 0x55f1f81232f0 2024-08-31T05:40:39.829 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.822+0000 7f4e76420640 1 --2- 172.21.15.5:0/397690124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1f81232f0 0x55f1f8503a80 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f4e600306b0 tx=0x7f4e600318c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62914c67581a781f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:39.829 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.822+0000 7f4e55ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:40:39.829 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.822+0000 7f4e55ffb640 1 -- 172.21.15.5:0/397690124 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6002f860 con 0x55f1f81232f0 2024-08-31T05:40:39.829 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.822+0000 7f4e55ffb640 1 -- 172.21.15.5:0/397690124 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7f4e6002fa00 con 0x55f1f81232f0 2024-08-31T05:40:39.829 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.822+0000 7f4e7f5ee740 1 -- 172.21.15.5:0/397690124 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e640e31c0 con 0x55f1f81232f0 2024-08-31T05:40:39.829 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.822+0000 7f4e55ffb640 1 -- 172.21.15.5:0/397690124 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f4e6002fc00 con 0x55f1f81232f0 2024-08-31T05:40:39.829 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.822+0000 7f4e7f5ee740 10 client.18432 fetch_fsmap learned FSMap version 34 2024-08-31T05:40:39.829 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.822+0000 7f4e7f5ee740 1 -- 172.21.15.5:0/397690124 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55f1f8577eb0 con 0x55f1f81232f0 2024-08-31T05:40:39.829 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.822+0000 7f4e55ffb640 1 -- 172.21.15.5:0/397690124 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e640e31c0 con 0x55f1f81232f0 2024-08-31T05:40:39.829 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.823+0000 7f4e55ffb640 1 -- 172.21.15.5:0/397690124 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f4e60052070 con 0x55f1f81232f0 2024-08-31T05:40:39.829 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.823+0000 7f4e7f5ee740 10 client.18432 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:40:39.829 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.823+0000 7f4e7f5ee740 10 client.18432 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:40:39.829 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.823+0000 7f4e7f5ee740 20 client.18432 populate_metadata read hostname 'smithi005' 2024-08-31T05:40:39.830 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.823+0000 7f4e7f5ee740 1 --2- 172.21.15.5:0/397690124 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55f1f80e01c0 0x55f1f857a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:39.830 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.823+0000 7f4e7f5ee740 4 client.18432 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:40:39.830 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.823+0000 7f4e7f5ee740 1 -- 172.21.15.5:0/397690124 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f1f84629f0 con 0x55f1f80e01c0 2024-08-31T05:40:39.830 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.823+0000 7f4e75c1f640 1 --2- 172.21.15.5:0/397690124 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55f1f80e01c0 0x55f1f857a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:39.830 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.823+0000 7f4e55ffb640 10 client.18432 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:40:39.830 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.823+0000 7f4e75c1f640 1 --2- 172.21.15.5:0/397690124 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55f1f80e01c0 0x55f1f857a6a0 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1aa104a217eadb71 server_cookie=925426775c04a6af in_seq=0 out_seq=0 2024-08-31T05:40:39.839 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.836+0000 7f4e55ffb640 1 -- 172.21.15.5:0/397690124 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f1f84629f0 con 0x55f1f80e01c0 2024-08-31T05:40:39.839 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.836+0000 7f4e55ffb640 10 client.18432 handle_command_reply: tid=0 2024-08-31T05:40:39.839 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.836+0000 7f4e7f5ee740 1 client.18432 shutdown 2024-08-31T05:40:39.839 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.837+0000 7f4e7f5ee740 1 -- 172.21.15.5:0/397690124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1f81232f0 msgr2=0x55f1f8503a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:39.839 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.837+0000 7f4e7f5ee740 1 --2- 172.21.15.5:0/397690124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1f81232f0 0x55f1f8503a80 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f4e600306b0 tx=0x7f4e600318c0 comp rx=0 tx=0).stop 2024-08-31T05:40:39.839 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.837+0000 7f4e7f5ee740 1 -- 172.21.15.5:0/397690124 shutdown_connections 2024-08-31T05:40:39.839 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.837+0000 7f4e7f5ee740 1 --2- 172.21.15.5:0/397690124 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55f1f80e01c0 0x55f1f857a6a0 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:39.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.837+0000 7f4e7f5ee740 1 --2- 172.21.15.5:0/397690124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f1f814c1b0 0x55f1f8501480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:39.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.837+0000 7f4e7f5ee740 1 --2- 172.21.15.5:0/397690124 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1f812b4d0 0x55f1f8500f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:39.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.837+0000 7f4e55ffb640 0 client.18432 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:40:39.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.837+0000 7f4e7f5ee740 1 --2- 172.21.15.5:0/397690124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f1f81232f0 0x55f1f8503a80 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:39.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.837+0000 7f4e7f5ee740 1 -- 172.21.15.5:0/397690124 >> 172.21.15.5:0/397690124 conn(0x55f1f8140300 msgr2=0x55f1f84f9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:39.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.837+0000 7f4e7f5ee740 1 -- 172.21.15.5:0/397690124 shutdown_connections 2024-08-31T05:40:39.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.837+0000 7f4e7f5ee740 1 -- 172.21.15.5:0/397690124 wait complete. 2024-08-31T05:40:39.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.837+0000 7f4e7f5ee740 20 client.18432 trim_cache size 0 max 16384 2024-08-31T05:40:39.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:40:39.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:40:39.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:40:39.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:40:39.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.837+0000 7f4e78684640 1 -- 172.21.15.5:0/929677126 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4e580b4ca0 msgr2=0x7f4e580b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:39.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.837+0000 7f4e78684640 1 --2- 172.21.15.5:0/929677126 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4e580b4ca0 0x7f4e580b71b0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x55f1f84ee740 tx=0x7f4e60009480 comp rx=0 tx=0).stop 2024-08-31T05:40:39.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.837+0000 7f4e78684640 1 -- 172.21.15.5:0/929677126 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e701080c0 msgr2=0x7f4e7019b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:39.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.837+0000 7f4e78684640 1 --2- 172.21.15.5:0/929677126 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e701080c0 0x7f4e7019b530 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4e7006b2e0 tx=0x7f4e6400ee50 comp rx=0 tx=0).stop 2024-08-31T05:40:39.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.837+0000 7f4e78684640 1 -- 172.21.15.5:0/929677126 shutdown_connections 2024-08-31T05:40:39.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.837+0000 7f4e78684640 1 --2- 172.21.15.5:0/929677126 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f4e580b4ca0 0x7f4e580b71b0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:39.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.837+0000 7f4e78684640 1 --2- 172.21.15.5:0/929677126 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4e70108a10 0x7f4e7019ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:39.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.837+0000 7f4e78684640 1 --2- 172.21.15.5:0/929677126 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e701080c0 0x7f4e7019b530 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:39.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.837+0000 7f4e78684640 1 --2- 172.21.15.5:0/929677126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e70102790 0x7f4e7019aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:39.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.837+0000 7f4e78684640 1 -- 172.21.15.5:0/929677126 >> 172.21.15.5:0/929677126 conn(0x7f4e700fe190 msgr2=0x7f4e701005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:39.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.838+0000 7f4e78684640 1 -- 172.21.15.5:0/929677126 shutdown_connections 2024-08-31T05:40:39.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:39.838+0000 7f4e78684640 1 -- 172.21.15.5:0/929677126 wait complete. 2024-08-31T05:40:39.936 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1203443 10.93 MB/sec execute 447 sec latency 26.014 ms 2024-08-31T05:40:40.936 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1205405 10.94 MB/sec execute 448 sec latency 19.975 ms 2024-08-31T05:40:41.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:40:40 smithi005 ceph-mon[18602]: pgmap v674: 129 pgs: 129 active+clean; 599 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.9 MiB/s wr, 260 op/s 2024-08-31T05:40:41.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:40:40 smithi070 ceph-mon[22316]: pgmap v674: 129 pgs: 129 active+clean; 599 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.9 MiB/s wr, 260 op/s 2024-08-31T05:40:41.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:40:40 smithi050 ceph-mon[22146]: pgmap v674: 129 pgs: 129 active+clean; 599 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.9 MiB/s wr, 260 op/s 2024-08-31T05:40:41.936 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1207703 10.94 MB/sec execute 449 sec latency 23.351 ms 2024-08-31T05:40:42.937 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1208973 10.93 MB/sec execute 450 sec latency 46.796 ms 2024-08-31T05:40:43.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:40:42 smithi005 ceph-mon[18602]: pgmap v675: 129 pgs: 129 active+clean; 599 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.8 MiB/s wr, 201 op/s 2024-08-31T05:40:43.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:40:42 smithi070 ceph-mon[22316]: pgmap v675: 129 pgs: 129 active+clean; 599 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.8 MiB/s wr, 201 op/s 2024-08-31T05:40:43.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:40:42 smithi050 ceph-mon[22146]: pgmap v675: 129 pgs: 129 active+clean; 599 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.8 MiB/s wr, 201 op/s 2024-08-31T05:40:43.936 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1211331 10.94 MB/sec execute 451 sec latency 28.889 ms 2024-08-31T05:40:44.937 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1212642 10.92 MB/sec execute 452 sec latency 24.870 ms 2024-08-31T05:40:45.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:40:44 smithi005 ceph-mon[18602]: pgmap v676: 129 pgs: 129 active+clean; 606 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.7 MiB/s wr, 194 op/s 2024-08-31T05:40:45.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:40:44 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:40:45.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:40:44 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:40:45.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:40:44 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:40:45.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:40:44 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:40:45.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:40:44 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:40:45.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:40:44 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:40:45.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:40:44 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:40:45.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:40:44 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:40:45.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:40:44 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:40:45.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:40:44 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:40:45.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:40:44 smithi070 ceph-mon[22316]: pgmap v676: 129 pgs: 129 active+clean; 606 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.7 MiB/s wr, 194 op/s 2024-08-31T05:40:45.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:40:44 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:40:45.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:40:44 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:40:45.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:40:44 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:40:45.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:40:44 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:40:45.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:40:44 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:40:45.337 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:40:44 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:40:45.337 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:40:44 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:40:45.337 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:40:44 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:40:45.337 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:40:44 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:40:45.337 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:40:44 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:40:45.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:40:44 smithi050 ceph-mon[22146]: pgmap v676: 129 pgs: 129 active+clean; 606 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.7 MiB/s wr, 194 op/s 2024-08-31T05:40:45.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:40:44 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:40:45.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:40:44 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:40:45.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:40:44 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:40:45.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:40:44 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:40:45.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:40:44 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:40:45.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:40:44 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:40:45.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:40:44 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:40:45.408 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:40:44 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:40:45.408 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:40:44 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:40:45.408 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:40:44 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:40:45.937 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1214950 10.93 MB/sec execute 453 sec latency 15.509 ms 2024-08-31T05:40:46.937 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1216440 10.92 MB/sec execute 454 sec latency 27.077 ms 2024-08-31T05:40:47.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:40:46 smithi005 ceph-mon[18602]: pgmap v677: 129 pgs: 129 active+clean; 570 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.5 MiB/s wr, 232 op/s 2024-08-31T05:40:47.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:40:46 smithi070 ceph-mon[22316]: pgmap v677: 129 pgs: 129 active+clean; 570 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.5 MiB/s wr, 232 op/s 2024-08-31T05:40:47.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:40:46 smithi050 ceph-mon[22146]: pgmap v677: 129 pgs: 129 active+clean; 570 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.5 MiB/s wr, 232 op/s 2024-08-31T05:40:47.937 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1218535 10.92 MB/sec execute 455 sec latency 87.086 ms 2024-08-31T05:40:48.937 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1220410 10.91 MB/sec execute 456 sec latency 16.813 ms 2024-08-31T05:40:49.209 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:40:48 smithi050 ceph-mon[22146]: pgmap v678: 129 pgs: 129 active+clean; 564 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.8 MiB/s wr, 188 op/s 2024-08-31T05:40:49.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:40:48 smithi005 ceph-mon[18602]: pgmap v678: 129 pgs: 129 active+clean; 564 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.8 MiB/s wr, 188 op/s 2024-08-31T05:40:49.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:40:48 smithi070 ceph-mon[22316]: pgmap v678: 129 pgs: 129 active+clean; 564 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.8 MiB/s wr, 188 op/s 2024-08-31T05:40:49.937 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1222437 10.92 MB/sec execute 457 sec latency 47.793 ms 2024-08-31T05:40:50.937 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1224629 10.92 MB/sec execute 458 sec latency 40.826 ms 2024-08-31T05:40:51.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:40:50 smithi005 ceph-mon[18602]: pgmap v679: 129 pgs: 129 active+clean; 562 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.9 MiB/s wr, 239 op/s 2024-08-31T05:40:51.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:40:50 smithi070 ceph-mon[22316]: pgmap v679: 129 pgs: 129 active+clean; 562 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.9 MiB/s wr, 239 op/s 2024-08-31T05:40:51.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:40:50 smithi050 ceph-mon[22146]: pgmap v679: 129 pgs: 129 active+clean; 562 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.9 MiB/s wr, 239 op/s 2024-08-31T05:40:51.937 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1226452 10.92 MB/sec execute 459 sec latency 33.557 ms 2024-08-31T05:40:52.937 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1228230 10.92 MB/sec execute 460 sec latency 110.812 ms 2024-08-31T05:40:52.939 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.937+0000 7fce31afa640 1 -- 172.21.15.5:0/738874664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce2c102760 msgr2=0x7fce2c102b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:52.939 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.937+0000 7fce31afa640 1 --2- 172.21.15.5:0/738874664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce2c102760 0x7fce2c102b70 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fce1c009900 tx=0x7fce1c02a410 comp rx=0 tx=0).stop 2024-08-31T05:40:52.939 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.937+0000 7fce31afa640 1 -- 172.21.15.5:0/738874664 shutdown_connections 2024-08-31T05:40:52.939 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.937+0000 7fce31afa640 1 --2- 172.21.15.5:0/738874664 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce2c1089e0 0x7fce2c10f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:52.939 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.937+0000 7fce31afa640 1 --2- 172.21.15.5:0/738874664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce2c108090 0x7fce2c1084a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:52.940 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.937+0000 7fce31afa640 1 --2- 172.21.15.5:0/738874664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce2c102760 0x7fce2c102b70 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:52.940 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.937+0000 7fce31afa640 1 -- 172.21.15.5:0/738874664 >> 172.21.15.5:0/738874664 conn(0x7fce2c0fe160 msgr2=0x7fce2c1005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:52.940 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.937+0000 7fce31afa640 1 -- 172.21.15.5:0/738874664 shutdown_connections 2024-08-31T05:40:52.940 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.937+0000 7fce31afa640 1 -- 172.21.15.5:0/738874664 wait complete. 2024-08-31T05:40:52.942 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.938+0000 7fce31afa640 1 Processor -- start 2024-08-31T05:40:52.942 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.938+0000 7fce31afa640 1 -- start start 2024-08-31T05:40:52.942 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.938+0000 7fce31afa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce2c102760 0x7fce2c199130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:52.942 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.938+0000 7fce31afa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce2c108090 0x7fce2c1996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:52.942 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.938+0000 7fce31afa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce2c1089e0 0x7fce2c19e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:52.942 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.938+0000 7fce31afa640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fce2c1126b0 con 0x7fce2c102760 2024-08-31T05:40:52.942 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.938+0000 7fce31afa640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fce2c112530 con 0x7fce2c108090 2024-08-31T05:40:52.942 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.938+0000 7fce31afa640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fce2c112830 con 0x7fce2c1089e0 2024-08-31T05:40:52.943 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.938+0000 7fce2b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce2c102760 0x7fce2c199130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:52.943 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.938+0000 7fce2b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce2c102760 0x7fce2c199130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53560/0 (socket says 172.21.15.5:53560) 2024-08-31T05:40:52.943 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.938+0000 7fce2bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce2c1089e0 0x7fce2c19e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:52.943 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.938+0000 7fce2b7fe640 1 -- 172.21.15.5:0/1617096042 learned_addr learned my addr 172.21.15.5:0/1617096042 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:52.943 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.938+0000 7fce22ffd640 1 --2- 172.21.15.5:0/1617096042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce2c108090 0x7fce2c1996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:52.943 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.939+0000 7fce2b7fe640 1 -- 172.21.15.5:0/1617096042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce2c1089e0 msgr2=0x7fce2c19e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:52.943 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.939+0000 7fce2b7fe640 1 --2- 172.21.15.5:0/1617096042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce2c1089e0 0x7fce2c19e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:52.943 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.939+0000 7fce2b7fe640 1 -- 172.21.15.5:0/1617096042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce2c108090 msgr2=0x7fce2c1996d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:52.943 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.939+0000 7fce2b7fe640 1 --2- 172.21.15.5:0/1617096042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce2c108090 0x7fce2c1996d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:52.943 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.939+0000 7fce2b7fe640 1 -- 172.21.15.5:0/1617096042 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce2c19f060 con 0x7fce2c102760 2024-08-31T05:40:52.943 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.939+0000 7fce2bfff640 1 --2- 172.21.15.5:0/1617096042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce2c1089e0 0x7fce2c19e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:40:52.943 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.939+0000 7fce2b7fe640 1 --2- 172.21.15.5:0/1617096042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce2c102760 0x7fce2c199130 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fce1c005940 tx=0x7fce1c0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:52.944 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.942+0000 7fce297fa640 1 -- 172.21.15.5:0/1617096042 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce1c03f030 con 0x7fce2c102760 2024-08-31T05:40:52.944 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.942+0000 7fce297fa640 1 -- 172.21.15.5:0/1617096042 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce1c0044c0 con 0x7fce2c102760 2024-08-31T05:40:52.944 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.942+0000 7fce297fa640 1 -- 172.21.15.5:0/1617096042 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce1c035070 con 0x7fce2c102760 2024-08-31T05:40:52.944 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.942+0000 7fce31afa640 1 -- 172.21.15.5:0/1617096042 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce2c19f2f0 con 0x7fce2c102760 2024-08-31T05:40:52.945 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.942+0000 7fce31afa640 1 -- 172.21.15.5:0/1617096042 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce2c1a5ae0 con 0x7fce2c102760 2024-08-31T05:40:52.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.945+0000 7fce38a64740 1 Processor -- start 2024-08-31T05:40:52.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.945+0000 7fce297fa640 1 -- 172.21.15.5:0/1617096042 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fce1c042030 con 0x7fce2c102760 2024-08-31T05:40:52.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.945+0000 7fce38a64740 1 -- start start 2024-08-31T05:40:52.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.945+0000 7fce38a64740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562d500431b0 0x562d503e6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:52.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.945+0000 7fce38a64740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d5001a2f0 0x562d503e7000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:52.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.945+0000 7fce38a64740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d500224d0 0x562d503e7540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:52.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.945+0000 7fce38a64740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x562d5035c000 con 0x562d500431b0 2024-08-31T05:40:52.949 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.945+0000 7fce38a64740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562d5034b590 con 0x562d500224d0 2024-08-31T05:40:52.950 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.945+0000 7fce38a64740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562d5034f540 con 0x562d5001a2f0 2024-08-31T05:40:52.950 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.945+0000 7fce2bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562d500431b0 0x562d503e6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:52.950 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.945+0000 7fce2bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562d500431b0 0x562d503e6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53574/0 (socket says 172.21.15.5:53574) 2024-08-31T05:40:52.950 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.945+0000 7fce2bfff640 1 -- 172.21.15.5:0/2453304374 learned_addr learned my addr 172.21.15.5:0/2453304374 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:52.950 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.946+0000 7fce2b7fe640 1 --2- 172.21.15.5:0/2453304374 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d5001a2f0 0x562d503e7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:52.950 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.946+0000 7fce22ffd640 1 --2- 172.21.15.5:0/2453304374 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d500224d0 0x562d503e7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:52.950 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.946+0000 7fce297fa640 1 --2- 172.21.15.5:0/1617096042 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fce180b4d20 0x7fce180b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:52.950 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.946+0000 7fce2bfff640 1 -- 172.21.15.5:0/2453304374 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d5001a2f0 msgr2=0x562d503e7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:52.950 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.946+0000 7fce2bfff640 1 --2- 172.21.15.5:0/2453304374 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d5001a2f0 0x562d503e7000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:52.950 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.946+0000 7fce2bfff640 1 -- 172.21.15.5:0/2453304374 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d500224d0 msgr2=0x562d503e7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:52.950 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.946+0000 7fce2bfff640 1 --2- 172.21.15.5:0/2453304374 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d500224d0 0x562d503e7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:52.950 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.946+0000 7fce2bfff640 1 -- 172.21.15.5:0/2453304374 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d500ae790 con 0x562d500431b0 2024-08-31T05:40:52.950 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.946+0000 7fce297fa640 1 -- 172.21.15.5:0/1617096042 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7fce1c105be0 con 0x7fce2c102760 2024-08-31T05:40:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.946+0000 7fce2bfff640 1 --2- 172.21.15.5:0/2453304374 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562d500431b0 0x562d503e6ac0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fce240117e0 tx=0x7fce24011ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=672c64b40a5eea1b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.946+0000 7fce2bfff640 1 --2- 172.21.15.5:0/1617096042 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fce180b4d20 0x7fce180b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.946+0000 7fce21ffb640 1 -- 172.21.15.5:0/2453304374 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce24011290 con 0x562d500431b0 2024-08-31T05:40:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.946+0000 7fce21ffb640 1 -- 172.21.15.5:0/2453304374 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce24003bd0 con 0x562d500431b0 2024-08-31T05:40:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.946+0000 7fce21ffb640 1 -- 172.21.15.5:0/2453304374 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2401a3f0 con 0x562d500431b0 2024-08-31T05:40:52.955 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.947+0000 7fce38a64740 1 -- 172.21.15.5:0/2453304374 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562d500431b0 msgr2=0x562d503e6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.947+0000 7fce38a64740 1 --2- 172.21.15.5:0/2453304374 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562d500431b0 0x562d503e6ac0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fce240117e0 tx=0x7fce24011ca0 comp rx=0 tx=0).stop 2024-08-31T05:40:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.947+0000 7fce2bfff640 1 --2- 172.21.15.5:0/1617096042 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fce180b4d20 0x7fce180b7230 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fce2401b000 tx=0x7fce2401a700 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.947+0000 7fce38a64740 1 -- 172.21.15.5:0/2453304374 shutdown_connections 2024-08-31T05:40:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.947+0000 7fce38a64740 1 --2- 172.21.15.5:0/2453304374 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d500224d0 0x562d503e7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.947+0000 7fce38a64740 1 --2- 172.21.15.5:0/2453304374 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d5001a2f0 0x562d503e7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.947+0000 7fce38a64740 1 --2- 172.21.15.5:0/2453304374 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562d500431b0 0x562d503e6ac0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.947+0000 7fce38a64740 1 -- 172.21.15.5:0/2453304374 >> 172.21.15.5:0/2453304374 conn(0x562d50037300 msgr2=0x562d503e49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.947+0000 7fce38a64740 1 -- 172.21.15.5:0/2453304374 shutdown_connections 2024-08-31T05:40:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.947+0000 7fce38a64740 1 -- 172.21.15.5:0/2453304374 wait complete. 2024-08-31T05:40:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.948+0000 7fce38a64740 1 -- start start 2024-08-31T05:40:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.948+0000 7fce38a64740 1 Processor -- start 2024-08-31T05:40:52.956 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.948+0000 7fce38a64740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d5001a2f0 0x562d503f4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.948+0000 7fce38a64740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562d500224d0 0x562d503f4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.948+0000 7fce38a64740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d500431b0 0x562d50400780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.948+0000 7fce38a64740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x562d50284ab0 con 0x562d500224d0 2024-08-31T05:40:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.948+0000 7fce38a64740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562d502d2680 con 0x562d500431b0 2024-08-31T05:40:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.948+0000 7fce38a64740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562d503f7420 con 0x562d5001a2f0 2024-08-31T05:40:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.948+0000 7fce38a64740 10 client.0 _ll_register_callbacks cb 0x562d5005aa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:40:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.948+0000 7fce22ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562d500224d0 0x562d503f4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.948+0000 7fce22ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562d500224d0 0x562d503f4d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53584/0 (socket says 172.21.15.5:53584) 2024-08-31T05:40:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.949+0000 7fce22ffd640 1 -- 172.21.15.5:0/1880471178 learned_addr learned my addr 172.21.15.5:0/1880471178 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.949+0000 7fce2b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d5001a2f0 0x562d503f4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.949+0000 7fce2bfff640 1 --2- 172.21.15.5:0/1880471178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d500431b0 0x562d50400780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:52.957 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.949+0000 7fce22ffd640 1 -- 172.21.15.5:0/1880471178 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d5001a2f0 msgr2=0x562d503f4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.949+0000 7fce22ffd640 1 --2- 172.21.15.5:0/1880471178 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d5001a2f0 0x562d503f4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.949+0000 7fce22ffd640 1 -- 172.21.15.5:0/1880471178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d500431b0 msgr2=0x562d50400780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.949+0000 7fce22ffd640 1 --2- 172.21.15.5:0/1880471178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d500431b0 0x562d50400780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.949+0000 7fce22ffd640 1 -- 172.21.15.5:0/1880471178 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d50127620 con 0x562d500224d0 2024-08-31T05:40:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.949+0000 7fce2b7fe640 1 --2- 172.21.15.5:0/1880471178 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d5001a2f0 0x562d503f4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:40:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.949+0000 7fce22ffd640 1 --2- 172.21.15.5:0/1880471178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562d500224d0 0x562d503f4d80 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fce140126e0 tx=0x7fce14012ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a4c497123a3b288 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.949+0000 7fce0affd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:40:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.949+0000 7fce0affd640 1 -- 172.21.15.5:0/1880471178 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce14012190 con 0x562d500224d0 2024-08-31T05:40:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.949+0000 7fce38a64740 1 -- 172.21.15.5:0/1880471178 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce24003bd0 con 0x562d500224d0 2024-08-31T05:40:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.949+0000 7fce0affd640 1 -- 172.21.15.5:0/1880471178 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7fce1400f920 con 0x562d500224d0 2024-08-31T05:40:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.949+0000 7fce0affd640 1 -- 172.21.15.5:0/1880471178 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fce1400fb20 con 0x562d500224d0 2024-08-31T05:40:52.958 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.949+0000 7fce38a64740 10 client.18444 fetch_fsmap learned FSMap version 34 2024-08-31T05:40:52.959 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.949+0000 7fce38a64740 1 -- 172.21.15.5:0/1880471178 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x562d504034b0 con 0x562d500224d0 2024-08-31T05:40:52.959 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.950+0000 7fce0affd640 1 -- 172.21.15.5:0/1880471178 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce24003bd0 con 0x562d500224d0 2024-08-31T05:40:52.959 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.950+0000 7fce0affd640 1 -- 172.21.15.5:0/1880471178 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fce14010c90 con 0x562d500224d0 2024-08-31T05:40:52.959 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.950+0000 7fce38a64740 10 client.18444 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:40:52.959 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.950+0000 7fce38a64740 10 client.18444 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:40:52.959 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.950+0000 7fce38a64740 20 client.18444 populate_metadata read hostname 'smithi005' 2024-08-31T05:40:52.959 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.950+0000 7fce38a64740 1 --2- 172.21.15.5:0/1880471178 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x562d50001d80 0x562d50406a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:52.959 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.950+0000 7fce38a64740 4 client.18444 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:40:52.959 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.950+0000 7fce38a64740 1 -- 172.21.15.5:0/1880471178 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562d5035df50 con 0x562d50001d80 2024-08-31T05:40:52.959 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.950+0000 7fce2b7fe640 1 --2- 172.21.15.5:0/1880471178 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x562d50001d80 0x562d50406a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:52.959 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.950+0000 7fce0affd640 10 client.18444 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:40:52.959 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.950+0000 7fce2b7fe640 1 --2- 172.21.15.5:0/1880471178 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x562d50001d80 0x562d50406a50 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d840429f64c0840 server_cookie=23ad590704aaf8eb in_seq=0 out_seq=0 2024-08-31T05:40:52.960 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.951+0000 7fce0affd640 1 -- 172.21.15.5:0/1880471178 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562d5035df50 con 0x562d50001d80 2024-08-31T05:40:52.960 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.951+0000 7fce0affd640 10 client.18444 handle_command_reply: tid=0 2024-08-31T05:40:52.960 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.951+0000 7fce38a64740 1 client.18444 shutdown 2024-08-31T05:40:52.960 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.951+0000 7fce38a64740 1 -- 172.21.15.5:0/1880471178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562d500224d0 msgr2=0x562d503f4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:52.960 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.951+0000 7fce38a64740 1 --2- 172.21.15.5:0/1880471178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562d500224d0 0x562d503f4d80 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fce140126e0 tx=0x7fce14012ba0 comp rx=0 tx=0).stop 2024-08-31T05:40:52.960 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.951+0000 7fce38a64740 1 -- 172.21.15.5:0/1880471178 shutdown_connections 2024-08-31T05:40:52.960 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.951+0000 7fce38a64740 1 --2- 172.21.15.5:0/1880471178 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x562d50001d80 0x562d50406a50 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:52.960 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.951+0000 7fce0affd640 0 client.18444 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:40:52.960 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.951+0000 7fce38a64740 1 --2- 172.21.15.5:0/1880471178 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d500431b0 0x562d50400780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:52.960 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.951+0000 7fce38a64740 1 --2- 172.21.15.5:0/1880471178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562d500224d0 0x562d503f4d80 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:52.960 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.951+0000 7fce38a64740 1 --2- 172.21.15.5:0/1880471178 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d5001a2f0 0x562d503f4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:52.960 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.951+0000 7fce38a64740 1 -- 172.21.15.5:0/1880471178 >> 172.21.15.5:0/1880471178 conn(0x562d50037300 msgr2=0x562d503e2c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:52.961 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.951+0000 7fce38a64740 1 -- 172.21.15.5:0/1880471178 shutdown_connections 2024-08-31T05:40:52.961 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.952+0000 7fce38a64740 1 -- 172.21.15.5:0/1880471178 wait complete. 2024-08-31T05:40:52.961 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.952+0000 7fce38a64740 20 client.18444 trim_cache size 0 max 16384 2024-08-31T05:40:52.971 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.967+0000 7fce38a64740 1 Processor -- start 2024-08-31T05:40:52.971 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.967+0000 7fce38a64740 1 -- start start 2024-08-31T05:40:52.971 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.967+0000 7fce38a64740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562d50001d80 0x562d503ebbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:52.971 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.967+0000 7fce38a64740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d5001a2f0 0x562d503ec110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:52.971 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.967+0000 7fce38a64740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d500224d0 0x562d503f2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:52.971 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.967+0000 7fce38a64740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fce2c1aeb10 con 0x562d50001d80 2024-08-31T05:40:52.971 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.967+0000 7fce38a64740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fce2c1b0650 con 0x562d5001a2f0 2024-08-31T05:40:52.971 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.967+0000 7fce38a64740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fce2c1af1e0 con 0x562d500224d0 2024-08-31T05:40:52.971 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.968+0000 7fce2b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562d50001d80 0x562d503ebbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:52.971 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.968+0000 7fce2b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562d50001d80 0x562d503ebbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53592/0 (socket says 172.21.15.5:53592) 2024-08-31T05:40:52.971 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.968+0000 7fce22ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d5001a2f0 0x562d503ec110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:52.972 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.968+0000 7fce2b7fe640 1 -- 172.21.15.5:0/4161749907 learned_addr learned my addr 172.21.15.5:0/4161749907 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:52.972 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.968+0000 7fce2bfff640 1 --2- 172.21.15.5:0/4161749907 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d500224d0 0x562d503f2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:52.972 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.968+0000 7fce2b7fe640 1 -- 172.21.15.5:0/4161749907 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d500224d0 msgr2=0x562d503f2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:52.972 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.968+0000 7fce2b7fe640 1 --2- 172.21.15.5:0/4161749907 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d500224d0 0x562d503f2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:52.972 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.968+0000 7fce2b7fe640 1 -- 172.21.15.5:0/4161749907 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d5001a2f0 msgr2=0x562d503ec110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:52.972 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.968+0000 7fce2b7fe640 1 --2- 172.21.15.5:0/4161749907 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d5001a2f0 0x562d503ec110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:52.972 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.968+0000 7fce2b7fe640 1 -- 172.21.15.5:0/4161749907 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d503f2b10 con 0x562d50001d80 2024-08-31T05:40:52.972 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.968+0000 7fce22ffd640 1 --2- 172.21.15.5:0/4161749907 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d5001a2f0 0x562d503ec110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:40:52.972 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.968+0000 7fce2b7fe640 1 --2- 172.21.15.5:0/4161749907 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562d50001d80 0x562d503ebbd0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fce1c0c8020 tx=0x7fce1c109730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4b1c1f231a3ee23 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:52.972 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.968+0000 7fce217fa640 1 -- 172.21.15.5:0/4161749907 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce1c049040 con 0x562d50001d80 2024-08-31T05:40:52.972 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.968+0000 7fce217fa640 1 -- 172.21.15.5:0/4161749907 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce1c0cbab0 con 0x562d50001d80 2024-08-31T05:40:52.972 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.968+0000 7fce217fa640 1 -- 172.21.15.5:0/4161749907 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce1c0c8230 con 0x562d50001d80 2024-08-31T05:40:52.976 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.969+0000 7fce38a64740 1 -- 172.21.15.5:0/4161749907 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562d50001d80 msgr2=0x562d503ebbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:52.976 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.969+0000 7fce38a64740 1 --2- 172.21.15.5:0/4161749907 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562d50001d80 0x562d503ebbd0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fce1c0c8020 tx=0x7fce1c109730 comp rx=0 tx=0).stop 2024-08-31T05:40:52.976 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.969+0000 7fce38a64740 1 -- 172.21.15.5:0/4161749907 shutdown_connections 2024-08-31T05:40:52.976 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.969+0000 7fce38a64740 1 --2- 172.21.15.5:0/4161749907 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d500224d0 0x562d503f2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:52.976 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.969+0000 7fce38a64740 1 --2- 172.21.15.5:0/4161749907 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d5001a2f0 0x562d503ec110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:52.976 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.969+0000 7fce38a64740 1 --2- 172.21.15.5:0/4161749907 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562d50001d80 0x562d503ebbd0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:52.977 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.969+0000 7fce38a64740 1 -- 172.21.15.5:0/4161749907 >> 172.21.15.5:0/4161749907 conn(0x562d50037300 msgr2=0x562d503ef760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:52.977 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.969+0000 7fce38a64740 1 -- 172.21.15.5:0/4161749907 shutdown_connections 2024-08-31T05:40:52.977 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.969+0000 7fce38a64740 1 -- 172.21.15.5:0/4161749907 wait complete. 2024-08-31T05:40:52.977 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.970+0000 7fce38a64740 1 -- start start 2024-08-31T05:40:52.977 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.970+0000 7fce38a64740 1 Processor -- start 2024-08-31T05:40:52.977 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.970+0000 7fce38a64740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562d50001d80 0x562d503fca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:52.977 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.970+0000 7fce38a64740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d5001a2f0 0x562d503fd070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:52.977 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.970+0000 7fce38a64740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d500224d0 0x562d503ed9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:52.977 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.970+0000 7fce38a64740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fce2c1aff80 con 0x562d50001d80 2024-08-31T05:40:52.977 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.970+0000 7fce38a64740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fce2c1af8b0 con 0x562d5001a2f0 2024-08-31T05:40:52.977 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.970+0000 7fce38a64740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fce2c1acb10 con 0x562d500224d0 2024-08-31T05:40:52.977 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.970+0000 7fce38a64740 10 client.0 _ll_register_callbacks cb 0x7fce14009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:40:52.977 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.970+0000 7fce2b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562d50001d80 0x562d503fca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:52.978 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.970+0000 7fce2b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562d50001d80 0x562d503fca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53608/0 (socket says 172.21.15.5:53608) 2024-08-31T05:40:52.978 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.970+0000 7fce22ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d5001a2f0 0x562d503fd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:52.978 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.970+0000 7fce2b7fe640 1 -- 172.21.15.5:0/3855613747 learned_addr learned my addr 172.21.15.5:0/3855613747 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:52.978 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.970+0000 7fce2bfff640 1 --2- 172.21.15.5:0/3855613747 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d500224d0 0x562d503ed9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:52.978 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.971+0000 7fce2b7fe640 1 -- 172.21.15.5:0/3855613747 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d500224d0 msgr2=0x562d503ed9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:52.978 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.971+0000 7fce2b7fe640 1 --2- 172.21.15.5:0/3855613747 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d500224d0 0x562d503ed9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:52.978 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.971+0000 7fce2b7fe640 1 -- 172.21.15.5:0/3855613747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d5001a2f0 msgr2=0x562d503fd070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:52.978 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.971+0000 7fce2b7fe640 1 --2- 172.21.15.5:0/3855613747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d5001a2f0 0x562d503fd070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:52.978 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.971+0000 7fce2b7fe640 1 -- 172.21.15.5:0/3855613747 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d503ee160 con 0x562d50001d80 2024-08-31T05:40:52.978 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.971+0000 7fce22ffd640 1 --2- 172.21.15.5:0/3855613747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d5001a2f0 0x562d503fd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:40:52.978 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.971+0000 7fce2b7fe640 1 --2- 172.21.15.5:0/3855613747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562d50001d80 0x562d503fca90 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fce1c03d040 tx=0x7fce1c103400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7363012d043a1c9c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:52.978 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.971+0000 7fce0affd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:40:52.978 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.971+0000 7fce0affd640 1 -- 172.21.15.5:0/3855613747 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce1c0f2020 con 0x562d50001d80 2024-08-31T05:40:52.979 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.971+0000 7fce0affd640 1 -- 172.21.15.5:0/3855613747 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7fce1c0b71b0 con 0x562d50001d80 2024-08-31T05:40:52.979 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.971+0000 7fce38a64740 1 -- 172.21.15.5:0/3855613747 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce1c0cbab0 con 0x562d50001d80 2024-08-31T05:40:52.979 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.971+0000 7fce0affd640 1 -- 172.21.15.5:0/3855613747 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fce1c049040 con 0x562d50001d80 2024-08-31T05:40:52.979 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.971+0000 7fce38a64740 10 client.18450 fetch_fsmap learned FSMap version 34 2024-08-31T05:40:52.979 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.971+0000 7fce38a64740 1 -- 172.21.15.5:0/3855613747 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x562d503fc210 con 0x562d50001d80 2024-08-31T05:40:52.979 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.971+0000 7fce0affd640 1 -- 172.21.15.5:0/3855613747 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce1c0cbab0 con 0x562d50001d80 2024-08-31T05:40:52.979 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.972+0000 7fce0affd640 1 -- 172.21.15.5:0/3855613747 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fce1c0cc200 con 0x562d50001d80 2024-08-31T05:40:52.979 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.972+0000 7fce38a64740 10 client.18450 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:40:52.979 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.972+0000 7fce38a64740 10 client.18450 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:40:52.979 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.972+0000 7fce38a64740 20 client.18450 populate_metadata read hostname 'smithi005' 2024-08-31T05:40:52.979 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.972+0000 7fce38a64740 1 --2- 172.21.15.5:0/3855613747 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x562d500431b0 0x562d504715c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:52.979 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.972+0000 7fce38a64740 4 client.18450 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:40:52.979 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.972+0000 7fce38a64740 1 -- 172.21.15.5:0/3855613747 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562d503599f0 con 0x562d500431b0 2024-08-31T05:40:52.980 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.972+0000 7fce22ffd640 1 --2- 172.21.15.5:0/3855613747 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x562d500431b0 0x562d504715c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:52.980 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.972+0000 7fce0affd640 10 client.18450 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:40:52.980 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.972+0000 7fce22ffd640 1 --2- 172.21.15.5:0/3855613747 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x562d500431b0 0x562d504715c0 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6f6556d70ef899c server_cookie=756f0c8d4587ca1b in_seq=0 out_seq=0 2024-08-31T05:40:52.987 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.985+0000 7fce0affd640 1 -- 172.21.15.5:0/3855613747 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562d503599f0 con 0x562d500431b0 2024-08-31T05:40:52.987 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.985+0000 7fce0affd640 10 client.18450 handle_command_reply: tid=0 2024-08-31T05:40:52.988 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.985+0000 7fce38a64740 1 client.18450 shutdown 2024-08-31T05:40:52.988 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.985+0000 7fce38a64740 1 -- 172.21.15.5:0/3855613747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562d50001d80 msgr2=0x562d503fca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:52.988 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.985+0000 7fce38a64740 1 --2- 172.21.15.5:0/3855613747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562d50001d80 0x562d503fca90 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fce1c03d040 tx=0x7fce1c103400 comp rx=0 tx=0).stop 2024-08-31T05:40:52.988 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.985+0000 7fce38a64740 1 -- 172.21.15.5:0/3855613747 shutdown_connections 2024-08-31T05:40:52.988 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.985+0000 7fce38a64740 1 --2- 172.21.15.5:0/3855613747 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x562d500431b0 0x562d504715c0 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:52.988 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.985+0000 7fce38a64740 1 --2- 172.21.15.5:0/3855613747 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d500224d0 0x562d503ed9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:52.988 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.985+0000 7fce38a64740 1 --2- 172.21.15.5:0/3855613747 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562d5001a2f0 0x562d503fd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:52.988 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.985+0000 7fce38a64740 1 --2- 172.21.15.5:0/3855613747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562d50001d80 0x562d503fca90 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:52.988 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.985+0000 7fce0affd640 0 client.18450 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:40:52.988 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.985+0000 7fce38a64740 1 -- 172.21.15.5:0/3855613747 >> 172.21.15.5:0/3855613747 conn(0x562d50037300 msgr2=0x562d503ef760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:52.988 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.985+0000 7fce38a64740 1 -- 172.21.15.5:0/3855613747 shutdown_connections 2024-08-31T05:40:52.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.985+0000 7fce38a64740 1 -- 172.21.15.5:0/3855613747 wait complete. 2024-08-31T05:40:52.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.985+0000 7fce38a64740 20 client.18450 trim_cache size 0 max 16384 2024-08-31T05:40:52.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:40:52.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:40:52.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:40:52.989 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:40:52.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.986+0000 7fce31afa640 1 -- 172.21.15.5:0/1617096042 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fce180b4d20 msgr2=0x7fce180b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:52.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.986+0000 7fce31afa640 1 --2- 172.21.15.5:0/1617096042 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fce180b4d20 0x7fce180b7230 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fce2401b000 tx=0x7fce2401a700 comp rx=0 tx=0).stop 2024-08-31T05:40:52.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.986+0000 7fce31afa640 1 -- 172.21.15.5:0/1617096042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce2c102760 msgr2=0x7fce2c199130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:52.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.986+0000 7fce31afa640 1 --2- 172.21.15.5:0/1617096042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce2c102760 0x7fce2c199130 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fce1c005940 tx=0x7fce1c0040c0 comp rx=0 tx=0).stop 2024-08-31T05:40:52.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.986+0000 7fce31afa640 1 -- 172.21.15.5:0/1617096042 shutdown_connections 2024-08-31T05:40:52.990 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.986+0000 7fce31afa640 1 --2- 172.21.15.5:0/1617096042 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fce180b4d20 0x7fce180b7230 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:52.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.986+0000 7fce31afa640 1 --2- 172.21.15.5:0/1617096042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fce2c1089e0 0x7fce2c19e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:52.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.986+0000 7fce31afa640 1 --2- 172.21.15.5:0/1617096042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fce2c108090 0x7fce2c1996d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:52.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.986+0000 7fce31afa640 1 --2- 172.21.15.5:0/1617096042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce2c102760 0x7fce2c199130 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:52.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.986+0000 7fce31afa640 1 -- 172.21.15.5:0/1617096042 >> 172.21.15.5:0/1617096042 conn(0x7fce2c0fe160 msgr2=0x7fce2c107780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:52.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.986+0000 7fce31afa640 1 -- 172.21.15.5:0/1617096042 shutdown_connections 2024-08-31T05:40:52.991 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:40:52.986+0000 7fce31afa640 1 -- 172.21.15.5:0/1617096042 wait complete. 2024-08-31T05:40:53.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:40:52 smithi005 ceph-mon[18602]: pgmap v680: 129 pgs: 129 active+clean; 566 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.7 MiB/s wr, 182 op/s 2024-08-31T05:40:53.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:40:52 smithi070 ceph-mon[22316]: pgmap v680: 129 pgs: 129 active+clean; 566 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.7 MiB/s wr, 182 op/s 2024-08-31T05:40:53.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:40:52 smithi050 ceph-mon[22146]: pgmap v680: 129 pgs: 129 active+clean; 566 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.7 MiB/s wr, 182 op/s 2024-08-31T05:40:53.937 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1230124 10.91 MB/sec execute 461 sec latency 13.003 ms 2024-08-31T05:40:54.937 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1232661 10.92 MB/sec execute 462 sec latency 15.120 ms 2024-08-31T05:40:55.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:40:54 smithi005 ceph-mon[18602]: pgmap v681: 129 pgs: 129 active+clean; 569 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.8 MiB/s wr, 192 op/s 2024-08-31T05:40:55.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:40:54 smithi070 ceph-mon[22316]: pgmap v681: 129 pgs: 129 active+clean; 569 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.8 MiB/s wr, 192 op/s 2024-08-31T05:40:55.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:40:54 smithi050 ceph-mon[22146]: pgmap v681: 129 pgs: 129 active+clean; 569 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.8 MiB/s wr, 192 op/s 2024-08-31T05:40:55.937 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1234087 10.91 MB/sec execute 463 sec latency 18.971 ms 2024-08-31T05:40:56.636 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T05:40:56.906 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:40:56.937 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1236392 10.92 MB/sec execute 464 sec latency 15.427 ms 2024-08-31T05:40:57.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:40:56 smithi005 ceph-mon[18602]: pgmap v682: 129 pgs: 129 active+clean; 580 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.9 MiB/s wr, 240 op/s 2024-08-31T05:40:57.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:40:56 smithi070 ceph-mon[22316]: pgmap v682: 129 pgs: 129 active+clean; 580 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.9 MiB/s wr, 240 op/s 2024-08-31T05:40:57.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:40:56 smithi050 ceph-mon[22146]: pgmap v682: 129 pgs: 129 active+clean; 580 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.9 MiB/s wr, 240 op/s 2024-08-31T05:40:57.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.443+0000 7fe4db969640 1 -- 172.21.15.5:0/52978438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4d4108140 msgr2=0x7fe4d4108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:57.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.443+0000 7fe4db969640 1 --2- 172.21.15.5:0/52978438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4d4108140 0x7fe4d4108550 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fe4c4009900 tx=0x7fe4c402a410 comp rx=0 tx=0).stop 2024-08-31T05:40:57.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.443+0000 7fe4db969640 1 -- 172.21.15.5:0/52978438 shutdown_connections 2024-08-31T05:40:57.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.443+0000 7fe4db969640 1 --2- 172.21.15.5:0/52978438 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4d4108a90 0x7fe4d410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:57.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.443+0000 7fe4db969640 1 --2- 172.21.15.5:0/52978438 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4d4108140 0x7fe4d4108550 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:57.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.443+0000 7fe4db969640 1 --2- 172.21.15.5:0/52978438 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4d4102800 0x7fe4d4102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:57.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.443+0000 7fe4db969640 1 -- 172.21.15.5:0/52978438 >> 172.21.15.5:0/52978438 conn(0x7fe4d40794d0 msgr2=0x7fe4d40798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:57.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.443+0000 7fe4db969640 1 -- 172.21.15.5:0/52978438 shutdown_connections 2024-08-31T05:40:57.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.443+0000 7fe4db969640 1 -- 172.21.15.5:0/52978438 wait complete. 2024-08-31T05:40:57.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.444+0000 7fe4db969640 1 Processor -- start 2024-08-31T05:40:57.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.444+0000 7fe4db969640 1 -- start start 2024-08-31T05:40:57.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.444+0000 7fe4db969640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4d4102800 0x7fe4d419a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:57.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.444+0000 7fe4db969640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4d4108140 0x7fe4d419a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:57.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.444+0000 7fe4db969640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4d4108a90 0x7fe4d419fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:57.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.444+0000 7fe4db969640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d41126c0 con 0x7fe4d4108a90 2024-08-31T05:40:57.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.444+0000 7fe4db969640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d4112540 con 0x7fe4d4102800 2024-08-31T05:40:57.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.444+0000 7fe4db969640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d4112840 con 0x7fe4d4108140 2024-08-31T05:40:57.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.444+0000 7fe4d8f04640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4d4108140 0x7fe4d419a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:57.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.444+0000 7fe4d8f04640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4d4108140 0x7fe4d419a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:49418/0 (socket says 172.21.15.5:49418) 2024-08-31T05:40:57.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.444+0000 7fe4d9f06640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4d4108a90 0x7fe4d419fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:57.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.444+0000 7fe4d8f04640 1 -- 172.21.15.5:0/1563367061 learned_addr learned my addr 172.21.15.5:0/1563367061 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:57.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.445+0000 7fe4d9705640 1 --2- 172.21.15.5:0/1563367061 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4d4102800 0x7fe4d419a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:57.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.445+0000 7fe4d8f04640 1 -- 172.21.15.5:0/1563367061 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4d4102800 msgr2=0x7fe4d419a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:57.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.445+0000 7fe4d8f04640 1 --2- 172.21.15.5:0/1563367061 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4d4102800 0x7fe4d419a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:57.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.445+0000 7fe4d8f04640 1 -- 172.21.15.5:0/1563367061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4d4108a90 msgr2=0x7fe4d419fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:57.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.445+0000 7fe4d8f04640 1 --2- 172.21.15.5:0/1563367061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4d4108a90 0x7fe4d419fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:57.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.445+0000 7fe4d8f04640 1 -- 172.21.15.5:0/1563367061 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4d41a0170 con 0x7fe4d4108140 2024-08-31T05:40:57.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.445+0000 7fe4d9f06640 1 --2- 172.21.15.5:0/1563367061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4d4108a90 0x7fe4d419fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:40:57.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.445+0000 7fe4d8f04640 1 --2- 172.21.15.5:0/1563367061 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4d4108140 0x7fe4d419a7a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe4c4032fd0 tx=0x7fe4c4031a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:57.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.445+0000 7fe4ca7fc640 1 -- 172.21.15.5:0/1563367061 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c403f030 con 0x7fe4d4108140 2024-08-31T05:40:57.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.445+0000 7fe4db969640 1 -- 172.21.15.5:0/1563367061 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4d41a0400 con 0x7fe4d4108140 2024-08-31T05:40:57.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.445+0000 7fe4ca7fc640 1 -- 172.21.15.5:0/1563367061 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe4c4004490 con 0x7fe4d4108140 2024-08-31T05:40:57.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.445+0000 7fe4ca7fc640 1 -- 172.21.15.5:0/1563367061 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c4035070 con 0x7fe4d4108140 2024-08-31T05:40:57.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.445+0000 7fe4db969640 1 -- 172.21.15.5:0/1563367061 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4d41a6bc0 con 0x7fe4d4108140 2024-08-31T05:40:57.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.449+0000 7fe4e1ede740 1 Processor -- start 2024-08-31T05:40:57.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.449+0000 7fe4e1ede740 1 -- start start 2024-08-31T05:40:57.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.449+0000 7fe4e1ede740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559339af2070 0x559339e972c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:57.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.449+0000 7fe4e1ede740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559339ac91b0 0x559339e97800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:57.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.449+0000 7fe4e1ede740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559339ad1390 0x559339e97d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:57.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.449+0000 7fe4e1ede740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x559339e0e630 con 0x559339ac91b0 2024-08-31T05:40:57.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.449+0000 7fe4e1ede740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559339dfdbc0 con 0x559339af2070 2024-08-31T05:40:57.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.449+0000 7fe4e1ede740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559339e01b70 con 0x559339ad1390 2024-08-31T05:40:57.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.449+0000 7fe4ca7fc640 1 -- 172.21.15.5:0/1563367061 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fe4c4042030 con 0x7fe4d4108140 2024-08-31T05:40:57.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.449+0000 7fe4d9705640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559339ac91b0 0x559339e97800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:57.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.449+0000 7fe4d9705640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559339ac91b0 0x559339e97800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53626/0 (socket says 172.21.15.5:53626) 2024-08-31T05:40:57.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.449+0000 7fe4d9705640 1 -- 172.21.15.5:0/312798780 learned_addr learned my addr 172.21.15.5:0/312798780 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:57.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.449+0000 7fe4d8f04640 1 --2- 172.21.15.5:0/312798780 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559339ad1390 0x559339e97d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:57.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.450+0000 7fe4d9f06640 1 --2- 172.21.15.5:0/312798780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559339af2070 0x559339e972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:57.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.450+0000 7fe4d9705640 1 -- 172.21.15.5:0/312798780 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559339ad1390 msgr2=0x559339e97d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:57.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.450+0000 7fe4d9705640 1 --2- 172.21.15.5:0/312798780 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559339ad1390 0x559339e97d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:57.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.450+0000 7fe4d9705640 1 -- 172.21.15.5:0/312798780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559339af2070 msgr2=0x559339e972c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:57.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.450+0000 7fe4d9705640 1 --2- 172.21.15.5:0/312798780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559339af2070 0x559339e972c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:57.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.450+0000 7fe4d9705640 1 -- 172.21.15.5:0/312798780 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559339b5d650 con 0x559339ac91b0 2024-08-31T05:40:57.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.450+0000 7fe4d9f06640 1 --2- 172.21.15.5:0/312798780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559339af2070 0x559339e972c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:40:57.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.450+0000 7fe4d9705640 1 --2- 172.21.15.5:0/312798780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559339ac91b0 0x559339e97800 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0009cf0 tx=0x7fe4d0011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b4cbba52862f9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:57.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.450+0000 7fe4bf7fe640 1 -- 172.21.15.5:0/312798780 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d0004230 con 0x559339ac91b0 2024-08-31T05:40:57.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.450+0000 7fe4ca7fc640 1 --2- 172.21.15.5:0/1563367061 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe4c00b4d20 0x7fe4c00b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:57.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.450+0000 7fe4bf7fe640 1 -- 172.21.15.5:0/312798780 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe4d00043d0 con 0x559339ac91b0 2024-08-31T05:40:57.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.450+0000 7fe4bf7fe640 1 -- 172.21.15.5:0/312798780 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d0019880 con 0x559339ac91b0 2024-08-31T05:40:57.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.451+0000 7fe4ca7fc640 1 -- 172.21.15.5:0/1563367061 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7fe4c4105b90 con 0x7fe4d4108140 2024-08-31T05:40:57.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.451+0000 7fe4d9f06640 1 --2- 172.21.15.5:0/1563367061 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe4c00b4d20 0x7fe4c00b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:57.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.452+0000 7fe4e1ede740 1 -- 172.21.15.5:0/312798780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559339ac91b0 msgr2=0x559339e97800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:57.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.452+0000 7fe4e1ede740 1 --2- 172.21.15.5:0/312798780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559339ac91b0 0x559339e97800 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0009cf0 tx=0x7fe4d0011810 comp rx=0 tx=0).stop 2024-08-31T05:40:57.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.452+0000 7fe4d9f06640 1 --2- 172.21.15.5:0/1563367061 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe4c00b4d20 0x7fe4c00b7230 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc005fd0 tx=0x7fe4cc009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:57.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.452+0000 7fe4e1ede740 1 -- 172.21.15.5:0/312798780 shutdown_connections 2024-08-31T05:40:57.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.452+0000 7fe4e1ede740 1 --2- 172.21.15.5:0/312798780 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559339ad1390 0x559339e97d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:57.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.452+0000 7fe4e1ede740 1 --2- 172.21.15.5:0/312798780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559339ac91b0 0x559339e97800 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:57.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.452+0000 7fe4e1ede740 1 --2- 172.21.15.5:0/312798780 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559339af2070 0x559339e972c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:57.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.452+0000 7fe4e1ede740 1 -- 172.21.15.5:0/312798780 >> 172.21.15.5:0/312798780 conn(0x559339ae6460 msgr2=0x559339e951b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:57.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.453+0000 7fe4e1ede740 1 -- 172.21.15.5:0/312798780 shutdown_connections 2024-08-31T05:40:57.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.453+0000 7fe4e1ede740 1 -- 172.21.15.5:0/312798780 wait complete. 2024-08-31T05:40:57.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.454+0000 7fe4e1ede740 1 -- start start 2024-08-31T05:40:57.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.454+0000 7fe4e1ede740 1 Processor -- start 2024-08-31T05:40:57.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.454+0000 7fe4e1ede740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559339ac91b0 0x559339ea5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:57.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.454+0000 7fe4e1ede740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559339ad1390 0x559339ea29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:57.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.454+0000 7fe4e1ede740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559339af2070 0x559339ea3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:57.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.455+0000 7fe4e1ede740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x559339c60700 con 0x559339ad1390 2024-08-31T05:40:57.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.455+0000 7fe4e1ede740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559339d84700 con 0x559339ac91b0 2024-08-31T05:40:57.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.455+0000 7fe4e1ede740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559339ea5aa0 con 0x559339af2070 2024-08-31T05:40:57.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.455+0000 7fe4e1ede740 10 client.0 _ll_register_callbacks cb 0x559339db3dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:40:57.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.455+0000 7fe4d9705640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559339ac91b0 0x559339ea5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:57.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.455+0000 7fe4d9705640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559339ac91b0 0x559339ea5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:41196/0 (socket says 172.21.15.5:41196) 2024-08-31T05:40:57.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.455+0000 7fe4d9705640 1 -- 172.21.15.5:0/833352720 learned_addr learned my addr 172.21.15.5:0/833352720 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:57.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.455+0000 7fe4d9705640 1 -- 172.21.15.5:0/833352720 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559339af2070 msgr2=0x559339ea3100 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T05:40:57.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.455+0000 7fe4d9705640 1 --2- 172.21.15.5:0/833352720 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559339af2070 0x559339ea3100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:57.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.455+0000 7fe4d9705640 1 -- 172.21.15.5:0/833352720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559339ad1390 msgr2=0x559339ea29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:57.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.455+0000 7fe4d9705640 1 --2- 172.21.15.5:0/833352720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559339ad1390 0x559339ea29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:57.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.455+0000 7fe4d9705640 1 -- 172.21.15.5:0/833352720 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559339dbd8b0 con 0x559339ac91b0 2024-08-31T05:40:57.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.456+0000 7fe4d9705640 1 --2- 172.21.15.5:0/833352720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559339ac91b0 0x559339ea5110 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0009560 tx=0x7fe4d00038a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5360bf349c07a14 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:57.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.456+0000 7fe4bcff9640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:40:57.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.456+0000 7fe4bcff9640 1 -- 172.21.15.5:0/833352720 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d0027070 con 0x559339ac91b0 2024-08-31T05:40:57.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.456+0000 7fe4bcff9640 1 -- 172.21.15.5:0/833352720 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7fe4d0005240 con 0x559339ac91b0 2024-08-31T05:40:57.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.456+0000 7fe4e1ede740 1 -- 172.21.15.5:0/833352720 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4d00043d0 con 0x559339ac91b0 2024-08-31T05:40:57.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.457+0000 7fe4bcff9640 1 -- 172.21.15.5:0/833352720 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe4d0031050 con 0x559339ac91b0 2024-08-31T05:40:57.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.457+0000 7fe4e1ede740 10 client.28028 fetch_fsmap learned FSMap version 34 2024-08-31T05:40:57.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.457+0000 7fe4e1ede740 1 -- 172.21.15.5:0/833352720 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x559339eba000 con 0x559339ac91b0 2024-08-31T05:40:57.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.458+0000 7fe4bcff9640 1 -- 172.21.15.5:0/833352720 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe4d00043d0 con 0x559339ac91b0 2024-08-31T05:40:57.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.458+0000 7fe4bcff9640 1 -- 172.21.15.5:0/833352720 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fe4d0004b70 con 0x559339ac91b0 2024-08-31T05:40:57.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.458+0000 7fe4e1ede740 10 client.28028 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:40:57.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.458+0000 7fe4e1ede740 10 client.28028 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:40:57.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.458+0000 7fe4e1ede740 20 client.28028 populate_metadata read hostname 'smithi005' 2024-08-31T05:40:57.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.458+0000 7fe4e1ede740 1 --2- 172.21.15.5:0/833352720 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x559339ab09f0 0x559339ebd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:57.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.458+0000 7fe4e1ede740 4 client.28028 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:40:57.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.458+0000 7fe4e1ede740 1 -- 172.21.15.5:0/833352720 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559339e10580 con 0x559339ab09f0 2024-08-31T05:40:57.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.461+0000 7fe4d8f04640 1 --2- 172.21.15.5:0/833352720 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x559339ab09f0 0x559339ebd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:57.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.463+0000 7fe4d8f04640 1 --2- 172.21.15.5:0/833352720 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x559339ab09f0 0x559339ebd3b0 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a0375feea634db3 server_cookie=3b3e32d373fdabb4 in_seq=0 out_seq=0 2024-08-31T05:40:57.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.463+0000 7fe4bcff9640 10 client.28028 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:40:57.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.467+0000 7fe4bcff9640 1 -- 172.21.15.5:0/833352720 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559339e10580 con 0x559339ab09f0 2024-08-31T05:40:57.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.467+0000 7fe4bcff9640 10 client.28028 handle_command_reply: tid=0 2024-08-31T05:40:57.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.467+0000 7fe4e1ede740 1 client.28028 shutdown 2024-08-31T05:40:57.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.467+0000 7fe4e1ede740 1 -- 172.21.15.5:0/833352720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559339ac91b0 msgr2=0x559339ea5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:57.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.467+0000 7fe4e1ede740 1 --2- 172.21.15.5:0/833352720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559339ac91b0 0x559339ea5110 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0009560 tx=0x7fe4d00038a0 comp rx=0 tx=0).stop 2024-08-31T05:40:57.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.469+0000 7fe4e1ede740 1 -- 172.21.15.5:0/833352720 shutdown_connections 2024-08-31T05:40:57.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.469+0000 7fe4e1ede740 1 --2- 172.21.15.5:0/833352720 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x559339ab09f0 0x559339ebd3b0 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:57.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.469+0000 7fe4e1ede740 1 --2- 172.21.15.5:0/833352720 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559339af2070 0x559339ea3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:57.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.469+0000 7fe4e1ede740 1 --2- 172.21.15.5:0/833352720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559339ad1390 0x559339ea29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:57.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.469+0000 7fe4e1ede740 1 --2- 172.21.15.5:0/833352720 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559339ac91b0 0x559339ea5110 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:57.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.469+0000 7fe4e1ede740 1 -- 172.21.15.5:0/833352720 >> 172.21.15.5:0/833352720 conn(0x559339ae6460 msgr2=0x559339e9a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:57.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.469+0000 7fe4bcff9640 0 client.28028 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:40:57.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.470+0000 7fe4e1ede740 1 -- 172.21.15.5:0/833352720 shutdown_connections 2024-08-31T05:40:57.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.470+0000 7fe4e1ede740 1 -- 172.21.15.5:0/833352720 wait complete. 2024-08-31T05:40:57.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.470+0000 7fe4e1ede740 20 client.28028 trim_cache size 0 max 16384 2024-08-31T05:40:57.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.510+0000 7fe4e1ede740 1 Processor -- start 2024-08-31T05:40:57.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.510+0000 7fe4e1ede740 1 -- start start 2024-08-31T05:40:57.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.511+0000 7fe4e1ede740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559339ac91b0 0x559339e98a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:57.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.511+0000 7fe4e1ede740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559339ad1390 0x559339e9fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:57.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.511+0000 7fe4e1ede740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559339af2070 0x559339ea00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:57.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.511+0000 7fe4d9705640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559339ac91b0 0x559339e98a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:57.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.511+0000 7fe4e1ede740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d41aea90 con 0x559339ac91b0 2024-08-31T05:40:57.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.511+0000 7fe4e1ede740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d41b05d0 con 0x559339ad1390 2024-08-31T05:40:57.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.511+0000 7fe4e1ede740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d41af160 con 0x559339af2070 2024-08-31T05:40:57.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.511+0000 7fe4d9705640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559339ac91b0 0x559339e98a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53640/0 (socket says 172.21.15.5:53640) 2024-08-31T05:40:57.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.511+0000 7fe4d9705640 1 -- 172.21.15.5:0/351387334 learned_addr learned my addr 172.21.15.5:0/351387334 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:57.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.511+0000 7fe4d9f06640 1 --2- 172.21.15.5:0/351387334 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559339af2070 0x559339ea00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:57.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.512+0000 7fe4d9f06640 1 -- 172.21.15.5:0/351387334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559339ad1390 msgr2=0x559339e9fba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T05:40:57.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.512+0000 7fe4d9f06640 1 --2- 172.21.15.5:0/351387334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559339ad1390 0x559339e9fba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:57.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.512+0000 7fe4d9f06640 1 -- 172.21.15.5:0/351387334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559339ac91b0 msgr2=0x559339e98a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:57.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.512+0000 7fe4d9f06640 1 --2- 172.21.15.5:0/351387334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559339ac91b0 0x559339e98a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:57.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.512+0000 7fe4d9f06640 1 -- 172.21.15.5:0/351387334 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559339e90910 con 0x559339af2070 2024-08-31T05:40:57.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.512+0000 7fe4d9f06640 1 --2- 172.21.15.5:0/351387334 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559339af2070 0x559339ea00e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc013830 tx=0x7fe4cc016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1173fd5ce62e2770 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:57.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.512+0000 7fe4beffd640 1 -- 172.21.15.5:0/351387334 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc004240 con 0x559339af2070 2024-08-31T05:40:57.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.513+0000 7fe4beffd640 1 -- 172.21.15.5:0/351387334 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe4cc020420 con 0x559339af2070 2024-08-31T05:40:57.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.513+0000 7fe4beffd640 1 -- 172.21.15.5:0/351387334 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc01f610 con 0x559339af2070 2024-08-31T05:40:57.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.514+0000 7fe4e1ede740 1 -- 172.21.15.5:0/351387334 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559339af2070 msgr2=0x559339ea00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:57.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.514+0000 7fe4e1ede740 1 --2- 172.21.15.5:0/351387334 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559339af2070 0x559339ea00e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc013830 tx=0x7fe4cc016000 comp rx=0 tx=0).stop 2024-08-31T05:40:57.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.514+0000 7fe4e1ede740 1 -- 172.21.15.5:0/351387334 shutdown_connections 2024-08-31T05:40:57.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.514+0000 7fe4e1ede740 1 --2- 172.21.15.5:0/351387334 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559339af2070 0x559339ea00e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:57.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.514+0000 7fe4e1ede740 1 --2- 172.21.15.5:0/351387334 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559339ad1390 0x559339e9fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:57.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.514+0000 7fe4e1ede740 1 --2- 172.21.15.5:0/351387334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559339ac91b0 0x559339e98a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:57.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.514+0000 7fe4e1ede740 1 -- 172.21.15.5:0/351387334 >> 172.21.15.5:0/351387334 conn(0x559339ae6460 msgr2=0x559339e982f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:57.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.515+0000 7fe4e1ede740 1 -- 172.21.15.5:0/351387334 shutdown_connections 2024-08-31T05:40:57.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.515+0000 7fe4e1ede740 1 -- 172.21.15.5:0/351387334 wait complete. 2024-08-31T05:40:57.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.515+0000 7fe4e1ede740 1 -- start start 2024-08-31T05:40:57.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.515+0000 7fe4e1ede740 1 Processor -- start 2024-08-31T05:40:57.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.517+0000 7fe4e1ede740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559339ac91b0 0x559339f22d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:57.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.517+0000 7fe4e1ede740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559339ad1390 0x559339f23260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:57.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.517+0000 7fe4e1ede740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559339af2070 0x559339f237a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:57.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.517+0000 7fe4d9705640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559339ac91b0 0x559339f22d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:57.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.517+0000 7fe4d9705640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559339ac91b0 0x559339f22d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:49462/0 (socket says 172.21.15.5:49462) 2024-08-31T05:40:57.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.517+0000 7fe4d8f04640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559339ad1390 0x559339f23260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:57.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.517+0000 7fe4d8f04640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559339ad1390 0x559339f23260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:41212/0 (socket says 172.21.15.5:41212) 2024-08-31T05:40:57.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.517+0000 7fe4d9705640 1 -- 172.21.15.5:0/379185959 learned_addr learned my addr 172.21.15.5:0/379185959 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:57.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.517+0000 7fe4e1ede740 1 -- 172.21.15.5:0/379185959 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d41aff00 con 0x559339af2070 2024-08-31T05:40:57.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.517+0000 7fe4e1ede740 1 -- 172.21.15.5:0/379185959 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d41af830 con 0x559339ad1390 2024-08-31T05:40:57.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.517+0000 7fe4e1ede740 1 -- 172.21.15.5:0/379185959 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d41aca90 con 0x559339ac91b0 2024-08-31T05:40:57.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.517+0000 7fe4e1ede740 10 client.0 _ll_register_callbacks cb 0x7fe4c41095b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:40:57.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.518+0000 7fe4d9f06640 1 --2- 172.21.15.5:0/379185959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559339af2070 0x559339f237a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:57.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.518+0000 7fe4d9705640 1 -- 172.21.15.5:0/379185959 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559339ad1390 msgr2=0x559339f23260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:57.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.518+0000 7fe4d9705640 1 --2- 172.21.15.5:0/379185959 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559339ad1390 0x559339f23260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:57.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.518+0000 7fe4d9705640 1 -- 172.21.15.5:0/379185959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559339af2070 msgr2=0x559339f237a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:40:57.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.518+0000 7fe4d9705640 1 --2- 172.21.15.5:0/379185959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559339af2070 0x559339f237a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:57.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.518+0000 7fe4d9705640 1 -- 172.21.15.5:0/379185959 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559339eb5aa0 con 0x559339ac91b0 2024-08-31T05:40:57.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.519+0000 7fe4d9705640 1 --2- 172.21.15.5:0/379185959 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559339ac91b0 0x559339f22d20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0011d10 tx=0x7fe4d0005dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e20ea4e2d69f4afc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:57.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.520+0000 7fe4bcff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:40:57.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.520+0000 7fe4bcff9640 1 -- 172.21.15.5:0/379185959 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d0027040 con 0x559339ac91b0 2024-08-31T05:40:57.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.520+0000 7fe4bcff9640 1 -- 172.21.15.5:0/379185959 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7fe4d0005190 con 0x559339ac91b0 2024-08-31T05:40:57.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.521+0000 7fe4e1ede740 1 -- 172.21.15.5:0/379185959 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4cc020420 con 0x559339ac91b0 2024-08-31T05:40:57.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.521+0000 7fe4bcff9640 1 -- 172.21.15.5:0/379185959 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe4d0044050 con 0x559339ac91b0 2024-08-31T05:40:57.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.521+0000 7fe4e1ede740 10 client.28048 fetch_fsmap learned FSMap version 34 2024-08-31T05:40:57.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.521+0000 7fe4e1ede740 1 -- 172.21.15.5:0/379185959 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x559339f38fa0 con 0x559339ac91b0 2024-08-31T05:40:57.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.522+0000 7fe4bcff9640 1 -- 172.21.15.5:0/379185959 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe4cc020420 con 0x559339ac91b0 2024-08-31T05:40:57.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.522+0000 7fe4bcff9640 1 -- 172.21.15.5:0/379185959 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fe4d0005440 con 0x559339ac91b0 2024-08-31T05:40:57.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.522+0000 7fe4e1ede740 10 client.28048 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:40:57.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.522+0000 7fe4e1ede740 10 client.28048 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:40:57.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.522+0000 7fe4e1ede740 20 client.28048 populate_metadata read hostname 'smithi005' 2024-08-31T05:40:57.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.522+0000 7fe4e1ede740 1 --2- 172.21.15.5:0/379185959 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x559339a85da0 0x559339f3b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:57.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.522+0000 7fe4e1ede740 4 client.28048 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T05:40:57.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.522+0000 7fe4e1ede740 1 -- 172.21.15.5:0/379185959 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559339e0c020 con 0x559339a85da0 2024-08-31T05:40:57.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.522+0000 7fe4d8f04640 1 --2- 172.21.15.5:0/379185959 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x559339a85da0 0x559339f3b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:57.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.523+0000 7fe4bcff9640 10 client.28048 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:40:57.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.523+0000 7fe4d8f04640 1 --2- 172.21.15.5:0/379185959 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x559339a85da0 0x559339f3b730 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a70e7594b05b716 server_cookie=f48b052553d57a51 in_seq=0 out_seq=0 2024-08-31T05:40:57.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.524+0000 7fe4bcff9640 1 -- 172.21.15.5:0/379185959 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4066 (crc 0 0 0) 0x559339e0c020 con 0x559339a85da0 2024-08-31T05:40:57.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.524+0000 7fe4bcff9640 10 client.28048 handle_command_reply: tid=0 2024-08-31T05:40:57.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.524+0000 7fe4e1ede740 1 client.28048 shutdown 2024-08-31T05:40:57.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.524+0000 7fe4e1ede740 1 -- 172.21.15.5:0/379185959 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559339ac91b0 msgr2=0x559339f22d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:57.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.524+0000 7fe4e1ede740 1 --2- 172.21.15.5:0/379185959 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559339ac91b0 0x559339f22d20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0011d10 tx=0x7fe4d0005dc0 comp rx=0 tx=0).stop 2024-08-31T05:40:57.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.525+0000 7fe4e1ede740 1 -- 172.21.15.5:0/379185959 shutdown_connections 2024-08-31T05:40:57.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.525+0000 7fe4e1ede740 1 --2- 172.21.15.5:0/379185959 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x559339a85da0 0x559339f3b730 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:57.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.525+0000 7fe4e1ede740 1 --2- 172.21.15.5:0/379185959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559339af2070 0x559339f237a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:57.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.525+0000 7fe4e1ede740 1 --2- 172.21.15.5:0/379185959 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559339ad1390 0x559339f23260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:57.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.525+0000 7fe4e1ede740 1 --2- 172.21.15.5:0/379185959 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559339ac91b0 0x559339f22d20 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:57.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.525+0000 7fe4e1ede740 1 -- 172.21.15.5:0/379185959 >> 172.21.15.5:0/379185959 conn(0x559339ae6460 msgr2=0x559339ea3c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:57.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.525+0000 7fe4bcff9640 0 client.28048 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:40:57.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.525+0000 7fe4e1ede740 1 -- 172.21.15.5:0/379185959 shutdown_connections 2024-08-31T05:40:57.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.525+0000 7fe4e1ede740 1 -- 172.21.15.5:0/379185959 wait complete. 2024-08-31T05:40:57.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.525+0000 7fe4e1ede740 20 client.28048 trim_cache size 0 max 16384 2024-08-31T05:40:57.529 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:40:57.529 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "no active scrubs running", 2024-08-31T05:40:57.529 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": {}, 2024-08-31T05:40:57.529 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_stats": { 2024-08-31T05:40:57.529 INFO:teuthology.orchestra.run.smithi005.stdout: "ab2853ca-505f-43fc-a132-af8bca186292": { 2024-08-31T05:40:57.529 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:40:23.937602+0000", 2024-08-31T05:40:57.529 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:40:57.529 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:40:57.530 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:40:57.530 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:40:57.530 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:40:57.530 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:40:57.530 INFO:teuthology.orchestra.run.smithi005.stdout: "75d84398-5d9c-4872-b879-2fbce045fa71": { 2024-08-31T05:40:57.530 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:06.642335+0000", 2024-08-31T05:40:57.530 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:40:57.530 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:40:57.530 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:40:57.530 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:40:57.530 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:40:57.530 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:40:57.531 INFO:teuthology.orchestra.run.smithi005.stdout: "ece37b07-9ab2-45f8-bc33-2755a07aac0b": { 2024-08-31T05:40:57.531 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:31:41.782407+0000", 2024-08-31T05:40:57.531 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:40:57.531 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:40:57.531 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:40:57.531 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:40:57.531 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:40:57.531 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:40:57.531 INFO:teuthology.orchestra.run.smithi005.stdout: "728a42ca-bbef-4151-830f-5fdd411d8fa0": { 2024-08-31T05:40:57.531 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:32:30.554906+0000", 2024-08-31T05:40:57.532 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:40:57.532 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:40:57.532 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:40:57.532 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:40:57.532 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:40:57.532 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:40:57.532 INFO:teuthology.orchestra.run.smithi005.stdout: "cda92ac0-b35f-47a5-a3a5-471c888462a5": { 2024-08-31T05:40:57.532 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:53.103905+0000", 2024-08-31T05:40:57.532 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:40:57.532 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:40:57.532 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:40:57.532 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:40:57.532 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:40:57.532 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:40:57.533 INFO:teuthology.orchestra.run.smithi005.stdout: "0bb67292-013a-40c7-b5fc-810bdd9715d8": { 2024-08-31T05:40:57.533 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:34:04.586008+0000", 2024-08-31T05:40:57.533 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:40:57.533 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:40:57.533 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:40:57.533 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:40:57.533 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:40:57.533 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:40:57.533 INFO:teuthology.orchestra.run.smithi005.stdout: "de9731c7-ae4a-42fe-8146-e4752cdc40d4": { 2024-08-31T05:40:57.533 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:34:53.614499+0000", 2024-08-31T05:40:57.533 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:40:57.533 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:40:57.533 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:40:57.534 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:40:57.534 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:40:57.534 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:40:57.534 INFO:teuthology.orchestra.run.smithi005.stdout: "f4db3406-20ff-46a3-baf9-099e16392f76": { 2024-08-31T05:40:57.534 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:38:49.034412+0000", 2024-08-31T05:40:57.534 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:40:57.534 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:40:57.534 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:40:57.534 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:40:57.534 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:40:57.534 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:40:57.534 INFO:teuthology.orchestra.run.smithi005.stdout: "095ccc7a-f368-4bc6-9563-5930e21f9b4a": { 2024-08-31T05:40:57.534 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:35:40.190069+0000", 2024-08-31T05:40:57.534 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:40:57.535 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:40:57.535 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:40:57.535 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:40:57.535 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:40:57.535 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:40:57.535 INFO:teuthology.orchestra.run.smithi005.stdout: "297c26f3-7b4d-4245-abb0-f854248e5e1b": { 2024-08-31T05:40:57.535 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:37:14.019244+0000", 2024-08-31T05:40:57.535 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:40:57.535 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:40:57.535 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:40:57.535 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:40:57.535 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:40:57.535 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:40:57.535 INFO:teuthology.orchestra.run.smithi005.stdout: "a4d4cf74-2477-4dd9-a3a2-3762b4dd87e4": { 2024-08-31T05:40:57.536 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:38:01.378833+0000", 2024-08-31T05:40:57.536 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:40:57.536 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:40:57.536 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:40:57.536 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:40:57.536 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:40:57.536 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:40:57.536 INFO:teuthology.orchestra.run.smithi005.stdout: "94c23057-592d-4a8b-82d7-da2d84f8740b": { 2024-08-31T05:40:57.536 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:36:27.513638+0000", 2024-08-31T05:40:57.536 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:40:57.536 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:40:57.536 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:40:57.536 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:40:57.536 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:40:57.537 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:40:57.537 INFO:teuthology.orchestra.run.smithi005.stdout: "2445fc42-b797-434f-b380-e2da985b4d98": { 2024-08-31T05:40:57.537 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:33:17.681453+0000", 2024-08-31T05:40:57.537 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:40:57.537 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:40:57.537 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:40:57.537 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:40:57.537 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:40:57.537 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:40:57.537 INFO:teuthology.orchestra.run.smithi005.stdout: "239b7958-db06-4432-93ce-b7552effa357": { 2024-08-31T05:40:57.537 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:39:35.733028+0000", 2024-08-31T05:40:57.537 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:40:57.537 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:40:57.538 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:40:57.538 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:40:57.538 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:40:57.538 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:40:57.538 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:40:57.538 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:40:57.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.526+0000 7fe4db969640 1 -- 172.21.15.5:0/1563367061 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe4c00b4d20 msgr2=0x7fe4c00b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:57.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.526+0000 7fe4db969640 1 --2- 172.21.15.5:0/1563367061 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe4c00b4d20 0x7fe4c00b7230 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc005fd0 tx=0x7fe4cc009500 comp rx=0 tx=0).stop 2024-08-31T05:40:57.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.526+0000 7fe4db969640 1 -- 172.21.15.5:0/1563367061 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4d4108140 msgr2=0x7fe4d419a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:57.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.526+0000 7fe4db969640 1 --2- 172.21.15.5:0/1563367061 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4d4108140 0x7fe4d419a7a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe4c4032fd0 tx=0x7fe4c4031a20 comp rx=0 tx=0).stop 2024-08-31T05:40:57.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.527+0000 7fe4db969640 1 -- 172.21.15.5:0/1563367061 shutdown_connections 2024-08-31T05:40:57.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.527+0000 7fe4db969640 1 --2- 172.21.15.5:0/1563367061 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe4c00b4d20 0x7fe4c00b7230 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:57.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.527+0000 7fe4db969640 1 --2- 172.21.15.5:0/1563367061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4d4108a90 0x7fe4d419fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:57.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.527+0000 7fe4db969640 1 --2- 172.21.15.5:0/1563367061 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4d4108140 0x7fe4d419a7a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:57.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.527+0000 7fe4db969640 1 --2- 172.21.15.5:0/1563367061 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe4d4102800 0x7fe4d419a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:57.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.527+0000 7fe4db969640 1 -- 172.21.15.5:0/1563367061 >> 172.21.15.5:0/1563367061 conn(0x7fe4d40794d0 msgr2=0x7fe4d4100a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:57.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.529+0000 7fe4db969640 1 -- 172.21.15.5:0/1563367061 shutdown_connections 2024-08-31T05:40:57.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:57.529+0000 7fe4db969640 1 -- 172.21.15.5:0/1563367061 wait complete. 2024-08-31T05:40:57.937 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1237593 10.91 MB/sec execute 465 sec latency 68.120 ms 2024-08-31T05:40:58.506 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T05:40:58.506 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T05:40:58.785 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:40:58.937 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1239921 10.91 MB/sec execute 466 sec latency 16.141 ms 2024-08-31T05:40:58.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:40:58 smithi005 ceph-mon[18602]: pgmap v683: 129 pgs: 129 active+clean; 580 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.0 MiB/s wr, 198 op/s 2024-08-31T05:40:59.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:40:58 smithi070 ceph-mon[22316]: pgmap v683: 129 pgs: 129 active+clean; 580 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.0 MiB/s wr, 198 op/s 2024-08-31T05:40:59.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:40:58 smithi050 ceph-mon[22146]: pgmap v683: 129 pgs: 129 active+clean; 580 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.0 MiB/s wr, 198 op/s 2024-08-31T05:40:59.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.428+0000 7f257202b640 1 -- 172.21.15.5:0/1977482808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f256c109bf0 msgr2=0x7f256c110420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:59.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.428+0000 7f257202b640 1 --2- 172.21.15.5:0/1977482808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f256c109bf0 0x7f256c110420 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f2564009ca0 tx=0x7f256402a8c0 comp rx=0 tx=0).stop 2024-08-31T05:40:59.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.428+0000 7f257202b640 1 -- 172.21.15.5:0/1977482808 shutdown_connections 2024-08-31T05:40:59.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.428+0000 7f257202b640 1 --2- 172.21.15.5:0/1977482808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f256c109bf0 0x7f256c110420 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:59.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.428+0000 7f257202b640 1 --2- 172.21.15.5:0/1977482808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f256c1092a0 0x7f256c1096b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:59.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.428+0000 7f257202b640 1 --2- 172.21.15.5:0/1977482808 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f256c101d60 0x7f256c102170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:59.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.428+0000 7f257202b640 1 -- 172.21.15.5:0/1977482808 >> 172.21.15.5:0/1977482808 conn(0x7f256c079d30 msgr2=0x7f256c07a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:59.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.428+0000 7f257202b640 1 -- 172.21.15.5:0/1977482808 shutdown_connections 2024-08-31T05:40:59.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.428+0000 7f257202b640 1 -- 172.21.15.5:0/1977482808 wait complete. 2024-08-31T05:40:59.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.429+0000 7f257202b640 1 Processor -- start 2024-08-31T05:40:59.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.429+0000 7f257202b640 1 -- start start 2024-08-31T05:40:59.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.429+0000 7f257202b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f256c101d60 0x7f256c19a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:59.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.429+0000 7f257202b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f256c1092a0 0x7f256c19a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:59.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.429+0000 7f257202b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f256c109bf0 0x7f256c19fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:59.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.429+0000 7f257202b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f256c1138b0 con 0x7f256c1092a0 2024-08-31T05:40:59.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.429+0000 7f257202b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f256c113730 con 0x7f256c101d60 2024-08-31T05:40:59.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.429+0000 7f257202b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f256c113a30 con 0x7f256c109bf0 2024-08-31T05:40:59.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.429+0000 7f256affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f256c1092a0 0x7f256c19a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:59.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.429+0000 7f256b7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f256c101d60 0x7f256c19a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:59.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.429+0000 7f256affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f256c1092a0 0x7f256c19a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53662/0 (socket says 172.21.15.5:53662) 2024-08-31T05:40:59.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.429+0000 7f256affd640 1 -- 172.21.15.5:0/3100519808 learned_addr learned my addr 172.21.15.5:0/3100519808 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:40:59.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.429+0000 7f256bfff640 1 --2- 172.21.15.5:0/3100519808 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f256c109bf0 0x7f256c19fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:59.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.430+0000 7f256affd640 1 -- 172.21.15.5:0/3100519808 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f256c109bf0 msgr2=0x7f256c19fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:59.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.430+0000 7f256affd640 1 --2- 172.21.15.5:0/3100519808 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f256c109bf0 0x7f256c19fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:59.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.430+0000 7f256affd640 1 -- 172.21.15.5:0/3100519808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f256c101d60 msgr2=0x7f256c19a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:59.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.430+0000 7f256affd640 1 --2- 172.21.15.5:0/3100519808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f256c101d60 0x7f256c19a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:59.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.430+0000 7f256affd640 1 -- 172.21.15.5:0/3100519808 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f256c1a01b0 con 0x7f256c1092a0 2024-08-31T05:40:59.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.430+0000 7f256b7fe640 1 --2- 172.21.15.5:0/3100519808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f256c101d60 0x7f256c19a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:40:59.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.430+0000 7f256affd640 1 --2- 172.21.15.5:0/3100519808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f256c1092a0 0x7f256c19a7e0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f256000e9f0 tx=0x7f256000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:59.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.430+0000 7f2568ff9640 1 -- 172.21.15.5:0/3100519808 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f256000ccc0 con 0x7f256c1092a0 2024-08-31T05:40:59.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.430+0000 7f2568ff9640 1 -- 172.21.15.5:0/3100519808 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25600108e0 con 0x7f256c1092a0 2024-08-31T05:40:59.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.430+0000 7f2568ff9640 1 -- 172.21.15.5:0/3100519808 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2560018860 con 0x7f256c1092a0 2024-08-31T05:40:59.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.430+0000 7f257202b640 1 -- 172.21.15.5:0/3100519808 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f256c1a04a0 con 0x7f256c1092a0 2024-08-31T05:40:59.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.430+0000 7f257202b640 1 -- 172.21.15.5:0/3100519808 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f256c1a6c00 con 0x7f256c1092a0 2024-08-31T05:40:59.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.431+0000 7f257202b640 1 -- 172.21.15.5:0/3100519808 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f256c102170 con 0x7f256c1092a0 2024-08-31T05:40:59.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.433+0000 7f2568ff9640 1 -- 172.21.15.5:0/3100519808 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f2560010430 con 0x7f256c1092a0 2024-08-31T05:40:59.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.433+0000 7f2568ff9640 1 --2- 172.21.15.5:0/3100519808 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f25540b4ca0 0x7f25540b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:40:59.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.434+0000 7f256b7fe640 1 --2- 172.21.15.5:0/3100519808 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f25540b4ca0 0x7f25540b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:40:59.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.434+0000 7f2568ff9640 1 -- 172.21.15.5:0/3100519808 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7f25600e6060 con 0x7f256c1092a0 2024-08-31T05:40:59.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.434+0000 7f256b7fe640 1 --2- 172.21.15.5:0/3100519808 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f25540b4ca0 0x7f25540b71b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f255c009fc0 tx=0x7f255c005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:40:59.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.438+0000 7f2568ff9640 1 -- 172.21.15.5:0/3100519808 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f25600ac420 con 0x7f256c1092a0 2024-08-31T05:40:59.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.699+0000 7f257202b640 1 -- 172.21.15.5:0/3100519808 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f256c19b370 con 0x7f256c1092a0 2024-08-31T05:40:59.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.700+0000 7f2568ff9640 1 -- 172.21.15.5:0/3100519808 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11941 (secure 0 0 0) 0x7f256c19b370 con 0x7f256c1092a0 2024-08-31T05:40:59.702 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:40:59.702 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":34,"btime":"2024-08-31T05:33:43:289944+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14739,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2024812199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2024812199},{"type":"v1","addr":"172.21.15.5:6835","nonce":2024812199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3629023702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3629023702},{"type":"v1","addr":"172.21.15.5:6837","nonce":3629023702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T05:27:31.929153+0000","modified":"2024-08-31T05:33:42.378207+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24652,"mds_1":24638,"mds_2":24631,"mds_3":24625,"mds_4":24602},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6839/2412701258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":2412701258},{"type":"v1","addr":"172.21.15.5:6839","nonce":2412701258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14820":{"gid":14820,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6841/747057838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":747057838},{"type":"v1","addr":"172.21.15.5:6841","nonce":747057838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6833/1153378982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1153378982},{"type":"v1","addr":"172.21.15.50:6833","nonce":1153378982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6833/364083443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":364083443},{"type":"v1","addr":"172.21.15.70:6833","nonce":364083443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24587":{"gid":24587,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/2346896794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2346896794},{"type":"v1","addr":"172.21.15.50:6835","nonce":2346896794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24602":{"gid":24602,"name":"h","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.50:6837/428759669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":428759669},{"type":"v1","addr":"172.21.15.50:6837","nonce":428759669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.70:6835/2061504114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2061504114},{"type":"v1","addr":"172.21.15.70:6835","nonce":2061504114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.70:6837/2780036414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2780036414},{"type":"v1","addr":"172.21.15.70:6837","nonce":2780036414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.50:6839/98200944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":98200944},{"type":"v1","addr":"172.21.15.50:6839","nonce":98200944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24652":{"gid":24652,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.70:6839/2756569250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":2756569250},{"type":"v1","addr":"172.21.15.70:6839","nonce":2756569250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24652,"qdb_cluster":[24652,24631,24638,24625,24602]},"id":1}]} 2024-08-31T05:40:59.703 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 34 2024-08-31T05:40:59.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.702+0000 7f257202b640 1 -- 172.21.15.5:0/3100519808 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f25540b4ca0 msgr2=0x7f25540b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:59.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.703+0000 7f257202b640 1 --2- 172.21.15.5:0/3100519808 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f25540b4ca0 0x7f25540b71b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f255c009fc0 tx=0x7f255c005f90 comp rx=0 tx=0).stop 2024-08-31T05:40:59.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.703+0000 7f257202b640 1 -- 172.21.15.5:0/3100519808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f256c1092a0 msgr2=0x7f256c19a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:40:59.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.703+0000 7f257202b640 1 --2- 172.21.15.5:0/3100519808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f256c1092a0 0x7f256c19a7e0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f256000e9f0 tx=0x7f256000eeb0 comp rx=0 tx=0).stop 2024-08-31T05:40:59.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.703+0000 7f257202b640 1 -- 172.21.15.5:0/3100519808 shutdown_connections 2024-08-31T05:40:59.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.703+0000 7f257202b640 1 --2- 172.21.15.5:0/3100519808 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f25540b4ca0 0x7f25540b71b0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:59.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.703+0000 7f257202b640 1 --2- 172.21.15.5:0/3100519808 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f256c109bf0 0x7f256c19fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:59.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.703+0000 7f257202b640 1 --2- 172.21.15.5:0/3100519808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f256c1092a0 0x7f256c19a7e0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:59.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.703+0000 7f257202b640 1 --2- 172.21.15.5:0/3100519808 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f256c101d60 0x7f256c19a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:40:59.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.703+0000 7f257202b640 1 -- 172.21.15.5:0/3100519808 >> 172.21.15.5:0/3100519808 conn(0x7f256c079d30 msgr2=0x7f256c105230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:40:59.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.703+0000 7f257202b640 1 -- 172.21.15.5:0/3100519808 shutdown_connections 2024-08-31T05:40:59.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:40:59.703+0000 7f257202b640 1 -- 172.21.15.5:0/3100519808 wait complete. 2024-08-31T05:40:59.937 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1241624 10.90 MB/sec execute 467 sec latency 39.611 ms 2024-08-31T05:41:00.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:40:59 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/3100519808' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:41:00.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:40:59 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/3100519808' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:41:00.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:40:59 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/3100519808' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:41:00.421 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-31T05:41:00.679 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:41:00.937 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1243690 10.91 MB/sec execute 468 sec latency 19.957 ms 2024-08-31T05:41:01.204 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:41:00 smithi005 ceph-mon[18602]: pgmap v684: 129 pgs: 129 active+clean; 589 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.9 MiB/s wr, 247 op/s 2024-08-31T05:41:01.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.296+0000 7f9d58b85640 1 -- 172.21.15.5:0/2307969831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d54103900 msgr2=0x7f9d54103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:01.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.296+0000 7f9d58b85640 1 --2- 172.21.15.5:0/2307969831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d54103900 0x7f9d54103d10 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f9d44009900 tx=0x7f9d4402a410 comp rx=0 tx=0).stop 2024-08-31T05:41:01.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.297+0000 7f9d58b85640 1 -- 172.21.15.5:0/2307969831 shutdown_connections 2024-08-31T05:41:01.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.297+0000 7f9d58b85640 1 --2- 172.21.15.5:0/2307969831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d54109b90 0x7f9d541103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:01.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.297+0000 7f9d58b85640 1 --2- 172.21.15.5:0/2307969831 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d54109240 0x7f9d54109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:01.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.297+0000 7f9d58b85640 1 --2- 172.21.15.5:0/2307969831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d54103900 0x7f9d54103d10 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:01.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.297+0000 7f9d58b85640 1 -- 172.21.15.5:0/2307969831 >> 172.21.15.5:0/2307969831 conn(0x7f9d5407b5f0 msgr2=0x7f9d5407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:01.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.297+0000 7f9d58b85640 1 -- 172.21.15.5:0/2307969831 shutdown_connections 2024-08-31T05:41:01.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.297+0000 7f9d58b85640 1 -- 172.21.15.5:0/2307969831 wait complete. 2024-08-31T05:41:01.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.297+0000 7f9d58b85640 1 Processor -- start 2024-08-31T05:41:01.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.297+0000 7f9d58b85640 1 -- start start 2024-08-31T05:41:01.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.298+0000 7f9d58b85640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d54103900 0x7f9d54198070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:01.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.298+0000 7f9d58b85640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d54109240 0x7f9d54198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:01.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.298+0000 7f9d58b85640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d54109b90 0x7f9d5419d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:01.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.298+0000 7f9d58b85640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9d54111660 con 0x7f9d54103900 2024-08-31T05:41:01.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.298+0000 7f9d58b85640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9d541114e0 con 0x7f9d54109240 2024-08-31T05:41:01.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.298+0000 7f9d58b85640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9d541117e0 con 0x7f9d54109b90 2024-08-31T05:41:01.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.298+0000 7f9d5259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d54103900 0x7f9d54198070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:01.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.298+0000 7f9d4bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d54109240 0x7f9d54198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:01.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.298+0000 7f9d5259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d54103900 0x7f9d54198070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53668/0 (socket says 172.21.15.5:53668) 2024-08-31T05:41:01.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.298+0000 7f9d5259c640 1 -- 172.21.15.5:0/3226283707 learned_addr learned my addr 172.21.15.5:0/3226283707 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:01.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.298+0000 7f9d52d9d640 1 --2- 172.21.15.5:0/3226283707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d54109b90 0x7f9d5419d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:01.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.298+0000 7f9d4bfff640 1 -- 172.21.15.5:0/3226283707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d54109b90 msgr2=0x7f9d5419d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:01.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.298+0000 7f9d4bfff640 1 --2- 172.21.15.5:0/3226283707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d54109b90 0x7f9d5419d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:01.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.298+0000 7f9d4bfff640 1 -- 172.21.15.5:0/3226283707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d54103900 msgr2=0x7f9d54198070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:01.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.298+0000 7f9d4bfff640 1 --2- 172.21.15.5:0/3226283707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d54103900 0x7f9d54198070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:01.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.298+0000 7f9d4bfff640 1 -- 172.21.15.5:0/3226283707 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d5419dfe0 con 0x7f9d54109240 2024-08-31T05:41:01.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.299+0000 7f9d4bfff640 1 --2- 172.21.15.5:0/3226283707 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d54109240 0x7f9d54198610 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9d5406c790 tx=0x7f9d3c00ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:01.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.299+0000 7f9d4b7fe640 1 -- 172.21.15.5:0/3226283707 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d3c00cc40 con 0x7f9d54109240 2024-08-31T05:41:01.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.299+0000 7f9d4b7fe640 1 -- 172.21.15.5:0/3226283707 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d3c00cde0 con 0x7f9d54109240 2024-08-31T05:41:01.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.299+0000 7f9d58b85640 1 -- 172.21.15.5:0/3226283707 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d5419e2d0 con 0x7f9d54109240 2024-08-31T05:41:01.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.299+0000 7f9d4b7fe640 1 -- 172.21.15.5:0/3226283707 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d3c018780 con 0x7f9d54109240 2024-08-31T05:41:01.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.299+0000 7f9d58b85640 1 -- 172.21.15.5:0/3226283707 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d541a4a30 con 0x7f9d54109240 2024-08-31T05:41:01.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.301+0000 7f9d5f0fa740 1 Processor -- start 2024-08-31T05:41:01.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.302+0000 7f9d5f0fa740 1 -- start start 2024-08-31T05:41:01.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.302+0000 7f9d4b7fe640 1 -- 172.21.15.5:0/3226283707 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f9d3c010a90 con 0x7f9d54109240 2024-08-31T05:41:01.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.302+0000 7f9d5f0fa740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9a545f070 0x55f9a5804310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:01.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.302+0000 7f9d5f0fa740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9a54361b0 0x55f9a5804850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:01.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.302+0000 7f9d5f0fa740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9a543e390 0x55f9a5804d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:01.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.302+0000 7f9d5f0fa740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f9a577b680 con 0x55f9a545f070 2024-08-31T05:41:01.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.302+0000 7f9d5f0fa740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f9a576ac10 con 0x55f9a54361b0 2024-08-31T05:41:01.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.302+0000 7f9d5f0fa740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f9a576ebc0 con 0x55f9a543e390 2024-08-31T05:41:01.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.302+0000 7f9d52d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9a545f070 0x55f9a5804310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:01.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.302+0000 7f9d5259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9a54361b0 0x55f9a5804850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:01.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.302+0000 7f9d52d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9a545f070 0x55f9a5804310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53682/0 (socket says 172.21.15.5:53682) 2024-08-31T05:41:01.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.302+0000 7f9d52d9d640 1 -- 172.21.15.5:0/3707928477 learned_addr learned my addr 172.21.15.5:0/3707928477 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:01.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.302+0000 7f9d4bfff640 1 --2- 172.21.15.5:0/3707928477 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9a543e390 0x55f9a5804d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:01.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.302+0000 7f9d52d9d640 1 -- 172.21.15.5:0/3707928477 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9a543e390 msgr2=0x55f9a5804d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:01.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.302+0000 7f9d52d9d640 1 --2- 172.21.15.5:0/3707928477 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9a543e390 0x55f9a5804d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:01.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.302+0000 7f9d52d9d640 1 -- 172.21.15.5:0/3707928477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9a54361b0 msgr2=0x55f9a5804850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:01.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.302+0000 7f9d52d9d640 1 --2- 172.21.15.5:0/3707928477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9a54361b0 0x55f9a5804850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:01.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.302+0000 7f9d52d9d640 1 -- 172.21.15.5:0/3707928477 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9a54ca650 con 0x55f9a545f070 2024-08-31T05:41:01.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.302+0000 7f9d5259c640 1 --2- 172.21.15.5:0/3707928477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9a54361b0 0x55f9a5804850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:41:01.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.302+0000 7f9d52d9d640 1 --2- 172.21.15.5:0/3707928477 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9a545f070 0x55f9a5804310 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c015620 tx=0x7f9d4c00d910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36f31341451ed119 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:01.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.303+0000 7f9d4b7fe640 1 --2- 172.21.15.5:0/3226283707 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9d400b4d20 0x7f9d400b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:01.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.303+0000 7f9d48ff9640 1 -- 172.21.15.5:0/3707928477 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c003970 con 0x55f9a545f070 2024-08-31T05:41:01.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.303+0000 7f9d48ff9640 1 -- 172.21.15.5:0/3707928477 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d4c01e070 con 0x55f9a545f070 2024-08-31T05:41:01.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.303+0000 7f9d48ff9640 1 -- 172.21.15.5:0/3707928477 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c00b830 con 0x55f9a545f070 2024-08-31T05:41:01.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.303+0000 7f9d5259c640 1 --2- 172.21.15.5:0/3226283707 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9d400b4d20 0x7f9d400b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:01.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.303+0000 7f9d4b7fe640 1 -- 172.21.15.5:0/3226283707 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7f9d3c0e5b50 con 0x7f9d54109240 2024-08-31T05:41:01.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.304+0000 7f9d5f0fa740 1 -- 172.21.15.5:0/3707928477 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9a545f070 msgr2=0x55f9a5804310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:01.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.304+0000 7f9d5259c640 1 --2- 172.21.15.5:0/3226283707 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9d400b4d20 0x7f9d400b7230 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x55f9a5802f90 tx=0x7f9d44005d70 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:01.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.304+0000 7f9d5f0fa740 1 --2- 172.21.15.5:0/3707928477 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9a545f070 0x55f9a5804310 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c015620 tx=0x7f9d4c00d910 comp rx=0 tx=0).stop 2024-08-31T05:41:01.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.304+0000 7f9d5f0fa740 1 -- 172.21.15.5:0/3707928477 shutdown_connections 2024-08-31T05:41:01.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.304+0000 7f9d5f0fa740 1 --2- 172.21.15.5:0/3707928477 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9a543e390 0x55f9a5804d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:01.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.304+0000 7f9d5f0fa740 1 --2- 172.21.15.5:0/3707928477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9a54361b0 0x55f9a5804850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:01.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.304+0000 7f9d5f0fa740 1 --2- 172.21.15.5:0/3707928477 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9a545f070 0x55f9a5804310 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:01.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.304+0000 7f9d5f0fa740 1 -- 172.21.15.5:0/3707928477 >> 172.21.15.5:0/3707928477 conn(0x55f9a5453460 msgr2=0x55f9a5802200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:01.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.304+0000 7f9d5f0fa740 1 -- 172.21.15.5:0/3707928477 shutdown_connections 2024-08-31T05:41:01.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.304+0000 7f9d5f0fa740 1 -- 172.21.15.5:0/3707928477 wait complete. 2024-08-31T05:41:01.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.304+0000 7f9d5f0fa740 1 -- start start 2024-08-31T05:41:01.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.304+0000 7f9d5f0fa740 1 Processor -- start 2024-08-31T05:41:01.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.305+0000 7f9d5f0fa740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9a54361b0 0x55f9a580fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:01.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.305+0000 7f9d5f0fa740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9a543e390 0x55f9a580ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:01.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.305+0000 7f9d5f0fa740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9a545f070 0x55f9a581bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:01.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.305+0000 7f9d5f0fa740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f9a55cd700 con 0x55f9a54361b0 2024-08-31T05:41:01.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.305+0000 7f9d5f0fa740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55f9a56f1750 con 0x55f9a545f070 2024-08-31T05:41:01.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.305+0000 7f9d5f0fa740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f9a5812a90 con 0x55f9a543e390 2024-08-31T05:41:01.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.305+0000 7f9d5259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9a54361b0 0x55f9a580fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:01.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.305+0000 7f9d5259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9a54361b0 0x55f9a580fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53684/0 (socket says 172.21.15.5:53684) 2024-08-31T05:41:01.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.305+0000 7f9d5259c640 1 -- 172.21.15.5:0/3113934394 learned_addr learned my addr 172.21.15.5:0/3113934394 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:01.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.305+0000 7f9d5f0fa740 10 client.0 _ll_register_callbacks cb 0x55f9a5720e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:41:01.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.305+0000 7f9d4bfff640 1 --2- 172.21.15.5:0/3113934394 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9a543e390 0x55f9a580ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:01.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.305+0000 7f9d52d9d640 1 --2- 172.21.15.5:0/3113934394 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9a545f070 0x55f9a581bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:01.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.305+0000 7f9d5259c640 1 -- 172.21.15.5:0/3113934394 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9a543e390 msgr2=0x55f9a580ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:01.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.305+0000 7f9d5259c640 1 --2- 172.21.15.5:0/3113934394 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9a543e390 0x55f9a580ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:01.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.305+0000 7f9d5259c640 1 -- 172.21.15.5:0/3113934394 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9a545f070 msgr2=0x55f9a581bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:01.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.305+0000 7f9d5259c640 1 --2- 172.21.15.5:0/3113934394 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9a545f070 0x55f9a581bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:01.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.305+0000 7f9d5259c640 1 -- 172.21.15.5:0/3113934394 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9a572a900 con 0x55f9a54361b0 2024-08-31T05:41:01.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.305+0000 7f9d52d9d640 1 --2- 172.21.15.5:0/3113934394 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9a545f070 0x55f9a581bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:41:01.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.306+0000 7f9d5259c640 1 --2- 172.21.15.5:0/3113934394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9a54361b0 0x55f9a580fa70 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f9d44006010 tx=0x7f9d44009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ee625f8b3f6cceb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:01.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.306+0000 7f9d39ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:41:01.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.306+0000 7f9d39ffb640 1 -- 172.21.15.5:0/3113934394 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4404e070 con 0x55f9a54361b0 2024-08-31T05:41:01.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.306+0000 7f9d39ffb640 1 -- 172.21.15.5:0/3113934394 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7f9d440035f0 con 0x55f9a54361b0 2024-08-31T05:41:01.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.306+0000 7f9d5f0fa740 1 -- 172.21.15.5:0/3113934394 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d4c01e070 con 0x55f9a54361b0 2024-08-31T05:41:01.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.306+0000 7f9d39ffb640 1 -- 172.21.15.5:0/3113934394 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f9d4405a050 con 0x55f9a54361b0 2024-08-31T05:41:01.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.306+0000 7f9d5f0fa740 10 client.18483 fetch_fsmap learned FSMap version 34 2024-08-31T05:41:01.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.306+0000 7f9d5f0fa740 1 -- 172.21.15.5:0/3113934394 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55f9a581e800 con 0x55f9a54361b0 2024-08-31T05:41:01.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.306+0000 7f9d39ffb640 1 -- 172.21.15.5:0/3113934394 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d4c01e070 con 0x55f9a54361b0 2024-08-31T05:41:01.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.306+0000 7f9d39ffb640 1 -- 172.21.15.5:0/3113934394 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f9d4404a7c0 con 0x55f9a54361b0 2024-08-31T05:41:01.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.306+0000 7f9d5f0fa740 10 client.18483 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:41:01.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.306+0000 7f9d5f0fa740 10 client.18483 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-31T05:41:01.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.306+0000 7f9d5f0fa740 20 client.18483 populate_metadata read hostname 'smithi005' 2024-08-31T05:41:01.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.306+0000 7f9d5f0fa740 1 --2- 172.21.15.5:0/3113934394 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55f9a541d9f0 0x55f9a5821d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:01.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.306+0000 7f9d5f0fa740 4 client.18483 mds_command: new command op to 24602 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:41:01.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.306+0000 7f9d5f0fa740 1 -- 172.21.15.5:0/3113934394 --> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f9a577d5d0 con 0x55f9a541d9f0 2024-08-31T05:41:01.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.307+0000 7f9d4bfff640 1 --2- 172.21.15.5:0/3113934394 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55f9a541d9f0 0x55f9a5821d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:01.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.307+0000 7f9d39ffb640 10 client.18483 ms_handle_connect on v2:172.21.15.50:6836/428759669 2024-08-31T05:41:01.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.307+0000 7f9d4bfff640 1 --2- 172.21.15.5:0/3113934394 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55f9a541d9f0 0x55f9a5821d20 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7696e2c3fda99a8b server_cookie=b576788593edee6a in_seq=0 out_seq=0 2024-08-31T05:41:01.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.308+0000 7f9d39ffb640 1 -- 172.21.15.5:0/3113934394 <== mds.4 v2:172.21.15.50:6836/428759669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f9a577d5d0 con 0x55f9a541d9f0 2024-08-31T05:41:01.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.308+0000 7f9d39ffb640 10 client.18483 handle_command_reply: tid=0 2024-08-31T05:41:01.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.308+0000 7f9d5f0fa740 1 client.18483 shutdown 2024-08-31T05:41:01.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.308+0000 7f9d5f0fa740 1 -- 172.21.15.5:0/3113934394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9a54361b0 msgr2=0x55f9a580fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:01.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.308+0000 7f9d5f0fa740 1 --2- 172.21.15.5:0/3113934394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9a54361b0 0x55f9a580fa70 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f9d44006010 tx=0x7f9d44009260 comp rx=0 tx=0).stop 2024-08-31T05:41:01.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.308+0000 7f9d5f0fa740 1 -- 172.21.15.5:0/3113934394 shutdown_connections 2024-08-31T05:41:01.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.308+0000 7f9d5f0fa740 1 --2- 172.21.15.5:0/3113934394 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55f9a541d9f0 0x55f9a5821d20 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:01.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.308+0000 7f9d5f0fa740 1 --2- 172.21.15.5:0/3113934394 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9a545f070 0x55f9a581bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:01.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.308+0000 7f9d39ffb640 0 client.18483 ms_handle_reset on v2:172.21.15.50:6836/428759669 2024-08-31T05:41:01.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.308+0000 7f9d5f0fa740 1 --2- 172.21.15.5:0/3113934394 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9a543e390 0x55f9a580ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:01.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.308+0000 7f9d5f0fa740 1 --2- 172.21.15.5:0/3113934394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9a54361b0 0x55f9a580fa70 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:01.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.308+0000 7f9d5f0fa740 1 -- 172.21.15.5:0/3113934394 >> 172.21.15.5:0/3113934394 conn(0x55f9a5453460 msgr2=0x55f9a58074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:01.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.308+0000 7f9d5f0fa740 1 -- 172.21.15.5:0/3113934394 shutdown_connections 2024-08-31T05:41:01.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.308+0000 7f9d5f0fa740 1 -- 172.21.15.5:0/3113934394 wait complete. 2024-08-31T05:41:01.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.309+0000 7f9d5f0fa740 20 client.18483 trim_cache size 0 max 16384 2024-08-31T05:41:01.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.322+0000 7f9d5f0fa740 1 Processor -- start 2024-08-31T05:41:01.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.322+0000 7f9d5f0fa740 1 -- start start 2024-08-31T05:41:01.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.322+0000 7f9d5f0fa740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9a54361b0 0x55f9a5805a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:01.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.322+0000 7f9d5f0fa740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9a543e390 0x55f9a581bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:01.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.322+0000 7f9d5f0fa740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9a545f070 0x55f9a580cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:01.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.322+0000 7f9d5f0fa740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9d541aeb20 con 0x55f9a543e390 2024-08-31T05:41:01.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.322+0000 7f9d5f0fa740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9d541b0660 con 0x55f9a545f070 2024-08-31T05:41:01.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.322+0000 7f9d5f0fa740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9d541af1f0 con 0x55f9a54361b0 2024-08-31T05:41:01.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.322+0000 7f9d4bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9a543e390 0x55f9a581bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:01.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.322+0000 7f9d4bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9a543e390 0x55f9a581bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53686/0 (socket says 172.21.15.5:53686) 2024-08-31T05:41:01.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.322+0000 7f9d4bfff640 1 -- 172.21.15.5:0/1682184700 learned_addr learned my addr 172.21.15.5:0/1682184700 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:01.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.322+0000 7f9d52d9d640 1 --2- 172.21.15.5:0/1682184700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9a545f070 0x55f9a580cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:01.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.322+0000 7f9d5259c640 1 --2- 172.21.15.5:0/1682184700 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9a54361b0 0x55f9a5805a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:01.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.323+0000 7f9d4bfff640 1 -- 172.21.15.5:0/1682184700 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9a54361b0 msgr2=0x55f9a5805a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:01.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.323+0000 7f9d4bfff640 1 --2- 172.21.15.5:0/1682184700 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9a54361b0 0x55f9a5805a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:01.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.323+0000 7f9d4bfff640 1 -- 172.21.15.5:0/1682184700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9a545f070 msgr2=0x55f9a580cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:01.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.323+0000 7f9d4bfff640 1 --2- 172.21.15.5:0/1682184700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9a545f070 0x55f9a580cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:01.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.323+0000 7f9d4bfff640 1 -- 172.21.15.5:0/1682184700 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9a5810d30 con 0x55f9a543e390 2024-08-31T05:41:01.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.323+0000 7f9d4bfff640 1 --2- 172.21.15.5:0/1682184700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9a543e390 0x55f9a581bc80 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c0abc10 tx=0x7f9d3c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92c00f003333b812 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:01.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.323+0000 7f9d3bfff640 1 -- 172.21.15.5:0/1682184700 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d3c0b5180 con 0x55f9a543e390 2024-08-31T05:41:01.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.323+0000 7f9d3bfff640 1 -- 172.21.15.5:0/1682184700 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d3c0e3140 con 0x55f9a543e390 2024-08-31T05:41:01.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.323+0000 7f9d3bfff640 1 -- 172.21.15.5:0/1682184700 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d3c0a7ae0 con 0x55f9a543e390 2024-08-31T05:41:01.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.324+0000 7f9d5f0fa740 1 -- 172.21.15.5:0/1682184700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9a543e390 msgr2=0x55f9a581bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:01.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.324+0000 7f9d5f0fa740 1 --2- 172.21.15.5:0/1682184700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9a543e390 0x55f9a581bc80 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c0abc10 tx=0x7f9d3c00cf90 comp rx=0 tx=0).stop 2024-08-31T05:41:01.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.324+0000 7f9d5f0fa740 1 -- 172.21.15.5:0/1682184700 shutdown_connections 2024-08-31T05:41:01.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.324+0000 7f9d5f0fa740 1 --2- 172.21.15.5:0/1682184700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9a545f070 0x55f9a580cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:01.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.324+0000 7f9d5f0fa740 1 --2- 172.21.15.5:0/1682184700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9a543e390 0x55f9a581bc80 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:01.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.324+0000 7f9d5f0fa740 1 --2- 172.21.15.5:0/1682184700 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9a54361b0 0x55f9a5805a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:01.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.324+0000 7f9d5f0fa740 1 -- 172.21.15.5:0/1682184700 >> 172.21.15.5:0/1682184700 conn(0x55f9a5453460 msgr2=0x55f9a5805340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:01.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.324+0000 7f9d5f0fa740 1 -- 172.21.15.5:0/1682184700 shutdown_connections 2024-08-31T05:41:01.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.324+0000 7f9d5f0fa740 1 -- 172.21.15.5:0/1682184700 wait complete. 2024-08-31T05:41:01.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.324+0000 7f9d5f0fa740 1 -- start start 2024-08-31T05:41:01.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.324+0000 7f9d5f0fa740 1 Processor -- start 2024-08-31T05:41:01.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.325+0000 7f9d5f0fa740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9a54361b0 0x55f9a58140f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:01.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.325+0000 7f9d5f0fa740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9a543e390 0x55f9a5814690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:01.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.325+0000 7f9d5f0fa740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9a545f070 0x55f9a588b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:01.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.325+0000 7f9d5f0fa740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9d541aff90 con 0x55f9a545f070 2024-08-31T05:41:01.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.325+0000 7f9d5f0fa740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9d541af8c0 con 0x55f9a54361b0 2024-08-31T05:41:01.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.325+0000 7f9d5f0fa740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9d541acb20 con 0x55f9a543e390 2024-08-31T05:41:01.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.325+0000 7f9d5f0fa740 10 client.0 _ll_register_callbacks cb 0x7f9d44009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:41:01.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.325+0000 7f9d52d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9a545f070 0x55f9a588b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:01.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.325+0000 7f9d5259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9a54361b0 0x55f9a58140f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:01.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.325+0000 7f9d52d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9a545f070 0x55f9a588b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53696/0 (socket says 172.21.15.5:53696) 2024-08-31T05:41:01.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.325+0000 7f9d4bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9a543e390 0x55f9a5814690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:01.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.325+0000 7f9d52d9d640 1 -- 172.21.15.5:0/1409996545 learned_addr learned my addr 172.21.15.5:0/1409996545 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:01.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.325+0000 7f9d5259c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9a54361b0 0x55f9a58140f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:41288/0 (socket says 172.21.15.5:41288) 2024-08-31T05:41:01.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.325+0000 7f9d5259c640 1 -- 172.21.15.5:0/1409996545 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9a543e390 msgr2=0x55f9a5814690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:01.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.325+0000 7f9d5259c640 1 --2- 172.21.15.5:0/1409996545 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9a543e390 0x55f9a5814690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:01.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.325+0000 7f9d5259c640 1 -- 172.21.15.5:0/1409996545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9a545f070 msgr2=0x55f9a588b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:01.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.325+0000 7f9d5259c640 1 --2- 172.21.15.5:0/1409996545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9a545f070 0x55f9a588b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:01.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.325+0000 7f9d5259c640 1 -- 172.21.15.5:0/1409996545 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9a588bc20 con 0x55f9a54361b0 2024-08-31T05:41:01.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.325+0000 7f9d52d9d640 1 --2- 172.21.15.5:0/1409996545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9a545f070 0x55f9a588b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:41:01.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.325+0000 7f9d4bfff640 1 --2- 172.21.15.5:0/1409996545 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9a543e390 0x55f9a5814690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:41:01.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.325+0000 7f9d5259c640 1 --2- 172.21.15.5:0/1409996545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9a54361b0 0x55f9a58140f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9d44005de0 tx=0x7f9d44000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf403888a58143f8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:01.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.325+0000 7f9d39ffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:41:01.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.326+0000 7f9d39ffb640 1 -- 172.21.15.5:0/1409996545 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4404e040 con 0x55f9a54361b0 2024-08-31T05:41:01.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.326+0000 7f9d5f0fa740 1 -- 172.21.15.5:0/1409996545 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d3c0e3140 con 0x55f9a54361b0 2024-08-31T05:41:01.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.326+0000 7f9d39ffb640 1 -- 172.21.15.5:0/1409996545 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9511+0+0 (secure 0 0 0) 0x7f9d4404a650 con 0x55f9a54361b0 2024-08-31T05:41:01.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.326+0000 7f9d39ffb640 1 -- 172.21.15.5:0/1409996545 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f9d44035040 con 0x55f9a54361b0 2024-08-31T05:41:01.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.326+0000 7f9d5f0fa740 10 client.28055 fetch_fsmap learned FSMap version 34 2024-08-31T05:41:01.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.326+0000 7f9d5f0fa740 1 -- 172.21.15.5:0/1409996545 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55f9a588cda0 con 0x55f9a54361b0 2024-08-31T05:41:01.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.326+0000 7f9d39ffb640 1 -- 172.21.15.5:0/1409996545 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d3c0e3140 con 0x55f9a54361b0 2024-08-31T05:41:01.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.326+0000 7f9d39ffb640 1 -- 172.21.15.5:0/1409996545 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f9d44003bc0 con 0x55f9a54361b0 2024-08-31T05:41:01.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.326+0000 7f9d5f0fa740 10 client.28055 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:41:01.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.326+0000 7f9d5f0fa740 10 client.28055 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-31T05:41:01.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.326+0000 7f9d5f0fa740 20 client.28055 populate_metadata read hostname 'smithi005' 2024-08-31T05:41:01.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.326+0000 7f9d5f0fa740 1 --2- 172.21.15.5:0/1409996545 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55f9a53f2da0 0x55f9a588f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:01.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.326+0000 7f9d5f0fa740 4 client.28055 mds_command: new command op to 24602 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:41:01.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.326+0000 7f9d5f0fa740 1 -- 172.21.15.5:0/1409996545 --> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f9a5779070 con 0x55f9a53f2da0 2024-08-31T05:41:01.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.327+0000 7f9d4bfff640 1 --2- 172.21.15.5:0/1409996545 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55f9a53f2da0 0x55f9a588f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:01.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.327+0000 7f9d4bfff640 1 --2- 172.21.15.5:0/1409996545 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55f9a53f2da0 0x55f9a588f590 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=cf0b94d34684a481 server_cookie=add04d5b55ceee6e in_seq=0 out_seq=0 2024-08-31T05:41:01.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.327+0000 7f9d39ffb640 10 client.28055 ms_handle_connect on v2:172.21.15.50:6836/428759669 2024-08-31T05:41:01.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.327+0000 7f9d39ffb640 1 -- 172.21.15.5:0/1409996545 <== mds.4 v2:172.21.15.50:6836/428759669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f9a5779070 con 0x55f9a53f2da0 2024-08-31T05:41:01.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.327+0000 7f9d39ffb640 10 client.28055 handle_command_reply: tid=0 2024-08-31T05:41:01.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.327+0000 7f9d5f0fa740 1 client.28055 shutdown 2024-08-31T05:41:01.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.327+0000 7f9d5f0fa740 1 -- 172.21.15.5:0/1409996545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9a54361b0 msgr2=0x55f9a58140f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:01.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.327+0000 7f9d5f0fa740 1 --2- 172.21.15.5:0/1409996545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9a54361b0 0x55f9a58140f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9d44005de0 tx=0x7f9d44000bc0 comp rx=0 tx=0).stop 2024-08-31T05:41:01.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.327+0000 7f9d5f0fa740 1 -- 172.21.15.5:0/1409996545 shutdown_connections 2024-08-31T05:41:01.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.327+0000 7f9d5f0fa740 1 --2- 172.21.15.5:0/1409996545 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55f9a53f2da0 0x55f9a588f590 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:01.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.327+0000 7f9d5f0fa740 1 --2- 172.21.15.5:0/1409996545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f9a545f070 0x55f9a588b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:01.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.327+0000 7f9d39ffb640 0 client.28055 ms_handle_reset on v2:172.21.15.50:6836/428759669 2024-08-31T05:41:01.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.327+0000 7f9d5f0fa740 1 --2- 172.21.15.5:0/1409996545 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f9a543e390 0x55f9a5814690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:01.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.327+0000 7f9d5f0fa740 1 --2- 172.21.15.5:0/1409996545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55f9a54361b0 0x55f9a58140f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:01.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.327+0000 7f9d5f0fa740 1 -- 172.21.15.5:0/1409996545 >> 172.21.15.5:0/1409996545 conn(0x55f9a5453460 msgr2=0x55f9a58118c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:01.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.327+0000 7f9d5f0fa740 1 -- 172.21.15.5:0/1409996545 shutdown_connections 2024-08-31T05:41:01.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.328+0000 7f9d5f0fa740 1 -- 172.21.15.5:0/1409996545 wait complete. 2024-08-31T05:41:01.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.328+0000 7f9d5f0fa740 20 client.28055 trim_cache size 0 max 16384 2024-08-31T05:41:01.335 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:41:01.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.328+0000 7f9d58b85640 1 -- 172.21.15.5:0/3226283707 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9d400b4d20 msgr2=0x7f9d400b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:01.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.328+0000 7f9d58b85640 1 --2- 172.21.15.5:0/3226283707 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9d400b4d20 0x7f9d400b7230 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x55f9a5802f90 tx=0x7f9d44005d70 comp rx=0 tx=0).stop 2024-08-31T05:41:01.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.328+0000 7f9d58b85640 1 -- 172.21.15.5:0/3226283707 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d54109240 msgr2=0x7f9d54198610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:01.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.328+0000 7f9d58b85640 1 --2- 172.21.15.5:0/3226283707 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d54109240 0x7f9d54198610 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9d5406c790 tx=0x7f9d3c00ee50 comp rx=0 tx=0).stop 2024-08-31T05:41:01.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.328+0000 7f9d58b85640 1 -- 172.21.15.5:0/3226283707 shutdown_connections 2024-08-31T05:41:01.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.328+0000 7f9d58b85640 1 --2- 172.21.15.5:0/3226283707 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9d400b4d20 0x7f9d400b7230 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:01.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.328+0000 7f9d58b85640 1 --2- 172.21.15.5:0/3226283707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d54109b90 0x7f9d5419d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:01.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.328+0000 7f9d58b85640 1 --2- 172.21.15.5:0/3226283707 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9d54109240 0x7f9d54198610 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:01.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.328+0000 7f9d58b85640 1 --2- 172.21.15.5:0/3226283707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9d54103900 0x7f9d54198070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:01.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.328+0000 7f9d58b85640 1 -- 172.21.15.5:0/3226283707 >> 172.21.15.5:0/3226283707 conn(0x7f9d5407b5f0 msgr2=0x7f9d54107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:01.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.328+0000 7f9d58b85640 1 -- 172.21.15.5:0/3226283707 shutdown_connections 2024-08-31T05:41:01.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:01.328+0000 7f9d58b85640 1 -- 172.21.15.5:0/3226283707 wait complete. 2024-08-31T05:41:01.337 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:41:00 smithi070 ceph-mon[22316]: pgmap v684: 129 pgs: 129 active+clean; 589 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.9 MiB/s wr, 247 op/s 2024-08-31T05:41:01.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:41:00 smithi050 ceph-mon[22146]: pgmap v684: 129 pgs: 129 active+clean; 589 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.9 MiB/s wr, 247 op/s 2024-08-31T05:41:01.937 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1244058 10.89 MB/sec execute 469 sec latency 94.627 ms 2024-08-31T05:41:02.246 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-31T05:41:02.561 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:41:02.938 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1245467 10.88 MB/sec execute 470 sec latency 127.803 ms 2024-08-31T05:41:03.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.102+0000 7f5fda351640 1 -- 172.21.15.5:0/1607120128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fd4108ad0 msgr2=0x7f5fd410f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:03.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.102+0000 7f5fda351640 1 --2- 172.21.15.5:0/1607120128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fd4108ad0 0x7f5fd410f300 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc009ca0 tx=0x7f5fcc02a8c0 comp rx=0 tx=0).stop 2024-08-31T05:41:03.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.102+0000 7f5fda351640 1 -- 172.21.15.5:0/1607120128 shutdown_connections 2024-08-31T05:41:03.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.102+0000 7f5fda351640 1 --2- 172.21.15.5:0/1607120128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fd4108ad0 0x7f5fd410f300 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:03.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.102+0000 7f5fda351640 1 --2- 172.21.15.5:0/1607120128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5fd4108180 0x7f5fd4108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:03.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.102+0000 7f5fda351640 1 --2- 172.21.15.5:0/1607120128 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fd4102840 0x7f5fd4102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:03.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.102+0000 7f5fda351640 1 -- 172.21.15.5:0/1607120128 >> 172.21.15.5:0/1607120128 conn(0x7f5fd4079580 msgr2=0x7f5fd4079990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:03.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.102+0000 7f5fda351640 1 -- 172.21.15.5:0/1607120128 shutdown_connections 2024-08-31T05:41:03.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.102+0000 7f5fda351640 1 -- 172.21.15.5:0/1607120128 wait complete. 2024-08-31T05:41:03.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.103+0000 7f5fda351640 1 Processor -- start 2024-08-31T05:41:03.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.103+0000 7f5fda351640 1 -- start start 2024-08-31T05:41:03.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.103+0000 7f5fda351640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fd4102840 0x7f5fd41990e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:03.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.103+0000 7f5fda351640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5fd4108180 0x7f5fd4199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:03.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.103+0000 7f5fda351640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fd4108ad0 0x7f5fd419e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:03.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.104+0000 7f5fda351640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd4112750 con 0x7f5fd4108ad0 2024-08-31T05:41:03.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.104+0000 7f5fda351640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd41125d0 con 0x7f5fd4102840 2024-08-31T05:41:03.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.104+0000 7f5fda351640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd41128d0 con 0x7f5fd4108180 2024-08-31T05:41:03.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.104+0000 7f5fd88ee640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fd4108ad0 0x7f5fd419e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:03.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.104+0000 7f5fd88ee640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fd4108ad0 0x7f5fd419e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44658/0 (socket says 172.21.15.5:44658) 2024-08-31T05:41:03.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.104+0000 7f5fd3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fd4102840 0x7f5fd41990e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:03.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.104+0000 7f5fd88ee640 1 -- 172.21.15.5:0/398895261 learned_addr learned my addr 172.21.15.5:0/398895261 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:03.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.104+0000 7f5fd37fe640 1 --2- 172.21.15.5:0/398895261 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5fd4108180 0x7f5fd4199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:03.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.104+0000 7f5fd88ee640 1 -- 172.21.15.5:0/398895261 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5fd4108180 msgr2=0x7f5fd4199680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:03.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.104+0000 7f5fd88ee640 1 --2- 172.21.15.5:0/398895261 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5fd4108180 0x7f5fd4199680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:03.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.104+0000 7f5fd88ee640 1 -- 172.21.15.5:0/398895261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fd4102840 msgr2=0x7f5fd41990e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:03.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.104+0000 7f5fd88ee640 1 --2- 172.21.15.5:0/398895261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fd4102840 0x7f5fd41990e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:03.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.104+0000 7f5fd88ee640 1 -- 172.21.15.5:0/398895261 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fd419f050 con 0x7f5fd4108ad0 2024-08-31T05:41:03.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.104+0000 7f5fd3fff640 1 --2- 172.21.15.5:0/398895261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fd4102840 0x7f5fd41990e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:41:03.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.104+0000 7f5fd88ee640 1 --2- 172.21.15.5:0/398895261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fd4108ad0 0x7f5fd419e920 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc0098d0 tx=0x7f5fcc031730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:03.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.105+0000 7f5fd17fa640 1 -- 172.21.15.5:0/398895261 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc04c070 con 0x7f5fd4108ad0 2024-08-31T05:41:03.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.105+0000 7f5fda351640 1 -- 172.21.15.5:0/398895261 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fd419f2e0 con 0x7f5fd4108ad0 2024-08-31T05:41:03.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.105+0000 7f5fda351640 1 -- 172.21.15.5:0/398895261 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fd406b5c0 con 0x7f5fd4108ad0 2024-08-31T05:41:03.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.105+0000 7f5fd17fa640 1 -- 172.21.15.5:0/398895261 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5fcc03cbd0 con 0x7f5fd4108ad0 2024-08-31T05:41:03.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.105+0000 7f5fd17fa640 1 -- 172.21.15.5:0/398895261 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc0042a0 con 0x7f5fd4108ad0 2024-08-31T05:41:03.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.108+0000 7f5fe08c6740 1 Processor -- start 2024-08-31T05:41:03.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.108+0000 7f5fd17fa640 1 -- 172.21.15.5:0/398895261 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f5fcc04f070 con 0x7f5fd4108ad0 2024-08-31T05:41:03.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.108+0000 7f5fe08c6740 1 -- start start 2024-08-31T05:41:03.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.108+0000 7f5fe08c6740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba108e3070 0x55ba10c88310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:03.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.108+0000 7f5fe08c6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba108ba1b0 0x55ba10c88850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:03.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.108+0000 7f5fe08c6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba108c2390 0x55ba10c88d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:03.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.108+0000 7f5fe08c6740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55ba10bff680 con 0x55ba108e3070 2024-08-31T05:41:03.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.108+0000 7f5fe08c6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ba10beec10 con 0x55ba108c2390 2024-08-31T05:41:03.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.108+0000 7f5fe08c6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ba10bf2bc0 con 0x55ba108ba1b0 2024-08-31T05:41:03.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.108+0000 7f5fd3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba108ba1b0 0x55ba10c88850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:03.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.108+0000 7f5fd37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba108e3070 0x55ba10c88310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:03.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.108+0000 7f5fd3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba108ba1b0 0x55ba10c88850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:43602/0 (socket says 172.21.15.5:43602) 2024-08-31T05:41:03.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.108+0000 7f5fd3fff640 1 -- 172.21.15.5:0/736467155 learned_addr learned my addr 172.21.15.5:0/736467155 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:03.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.108+0000 7f5fd37fe640 1 --2- 172.21.15.5:0/736467155 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba108c2390 0x55ba10c88d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:03.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.109+0000 7f5fd37fe640 1 -- 172.21.15.5:0/736467155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba108ba1b0 msgr2=0x55ba10c88850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:03.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.109+0000 7f5fd37fe640 1 --2- 172.21.15.5:0/736467155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba108ba1b0 0x55ba10c88850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:03.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.109+0000 7f5fd37fe640 1 -- 172.21.15.5:0/736467155 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba108c2390 msgr2=0x55ba10c88d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:03.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.109+0000 7f5fd37fe640 1 --2- 172.21.15.5:0/736467155 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba108c2390 0x55ba10c88d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:03.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.109+0000 7f5fd37fe640 1 -- 172.21.15.5:0/736467155 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba1094e650 con 0x55ba108e3070 2024-08-31T05:41:03.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.109+0000 7f5fd3fff640 1 --2- 172.21.15.5:0/736467155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba108ba1b0 0x55ba10c88850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:41:03.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.109+0000 7f5fd37fe640 1 --2- 172.21.15.5:0/736467155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba108e3070 0x55ba10c88310 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4107840 tx=0x7f5fc8005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43614c53c4301659 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:03.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.109+0000 7f5fba7fc640 1 -- 172.21.15.5:0/736467155 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc8013130 con 0x55ba108e3070 2024-08-31T05:41:03.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.109+0000 7f5fd17fa640 1 --2- 172.21.15.5:0/398895261 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5fbc0b4ca0 0x7f5fbc0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:03.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.109+0000 7f5fba7fc640 1 -- 172.21.15.5:0/736467155 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5fc8005020 con 0x55ba108e3070 2024-08-31T05:41:03.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.109+0000 7f5fba7fc640 1 -- 172.21.15.5:0/736467155 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc80044e0 con 0x55ba108e3070 2024-08-31T05:41:03.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.110+0000 7f5fd17fa640 1 -- 172.21.15.5:0/398895261 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9599+0+0 (secure 0 0 0) 0x7f5fcc10a0c0 con 0x7f5fd4108ad0 2024-08-31T05:41:03.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.110+0000 7f5fd3fff640 1 --2- 172.21.15.5:0/398895261 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5fbc0b4ca0 0x7f5fbc0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:03.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.110+0000 7f5fd3fff640 1 --2- 172.21.15.5:0/398895261 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5fbc0b4ca0 0x7f5fbc0b71b0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x55ba10c86f90 tx=0x7f5fc400b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:03.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.111+0000 7f5fe08c6740 1 -- 172.21.15.5:0/736467155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba108e3070 msgr2=0x55ba10c88310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:03.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.111+0000 7f5fe08c6740 1 --2- 172.21.15.5:0/736467155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba108e3070 0x55ba10c88310 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4107840 tx=0x7f5fc8005850 comp rx=0 tx=0).stop 2024-08-31T05:41:03.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.111+0000 7f5fe08c6740 1 -- 172.21.15.5:0/736467155 shutdown_connections 2024-08-31T05:41:03.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.111+0000 7f5fe08c6740 1 --2- 172.21.15.5:0/736467155 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba108c2390 0x55ba10c88d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:03.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.111+0000 7f5fe08c6740 1 --2- 172.21.15.5:0/736467155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba108ba1b0 0x55ba10c88850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:03.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.111+0000 7f5fe08c6740 1 --2- 172.21.15.5:0/736467155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba108e3070 0x55ba10c88310 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:03.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.111+0000 7f5fe08c6740 1 -- 172.21.15.5:0/736467155 >> 172.21.15.5:0/736467155 conn(0x55ba108d7460 msgr2=0x55ba10c86200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:03.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.111+0000 7f5fe08c6740 1 -- 172.21.15.5:0/736467155 shutdown_connections 2024-08-31T05:41:03.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.111+0000 7f5fe08c6740 1 -- 172.21.15.5:0/736467155 wait complete. 2024-08-31T05:41:03.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.111+0000 7f5fe08c6740 1 -- start start 2024-08-31T05:41:03.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.111+0000 7f5fe08c6740 1 Processor -- start 2024-08-31T05:41:03.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.112+0000 7f5fe08c6740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba108ba1b0 0x55ba10c93a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:03.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.112+0000 7f5fe08c6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba108c2390 0x55ba10c93f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:03.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.112+0000 7f5fe08c6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba108e3070 0x55ba10c9fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:03.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.112+0000 7f5fe08c6740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55ba10a51700 con 0x55ba108ba1b0 2024-08-31T05:41:03.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.112+0000 7f5fe08c6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ba10b75750 con 0x55ba108e3070 2024-08-31T05:41:03.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.112+0000 7f5fe08c6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ba10c96a90 con 0x55ba108c2390 2024-08-31T05:41:03.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.112+0000 7f5fd3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba108ba1b0 0x55ba10c93a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:03.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.112+0000 7f5fd3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba108ba1b0 0x55ba10c93a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44688/0 (socket says 172.21.15.5:44688) 2024-08-31T05:41:03.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.112+0000 7f5fd37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba108c2390 0x55ba10c93f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:03.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.112+0000 7f5fd3fff640 1 -- 172.21.15.5:0/824163969 learned_addr learned my addr 172.21.15.5:0/824163969 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:03.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.112+0000 7f5fd88ee640 1 --2- 172.21.15.5:0/824163969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba108e3070 0x55ba10c9fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:03.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.112+0000 7f5fe08c6740 10 client.0 _ll_register_callbacks cb 0x55ba10ba4e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:41:03.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.112+0000 7f5fd3fff640 1 -- 172.21.15.5:0/824163969 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba108c2390 msgr2=0x55ba10c93f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:03.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.112+0000 7f5fd3fff640 1 --2- 172.21.15.5:0/824163969 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba108c2390 0x55ba10c93f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:03.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.112+0000 7f5fd3fff640 1 -- 172.21.15.5:0/824163969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba108e3070 msgr2=0x55ba10c9fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:03.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.112+0000 7f5fd3fff640 1 --2- 172.21.15.5:0/824163969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba108e3070 0x55ba10c9fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:03.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.112+0000 7f5fd3fff640 1 -- 172.21.15.5:0/824163969 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba10bae900 con 0x55ba108ba1b0 2024-08-31T05:41:03.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.112+0000 7f5fd37fe640 1 --2- 172.21.15.5:0/824163969 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba108c2390 0x55ba10c93f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:41:03.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.112+0000 7f5fd88ee640 1 --2- 172.21.15.5:0/824163969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba108e3070 0x55ba10c9fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:41:03.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.113+0000 7f5fd3fff640 1 --2- 172.21.15.5:0/824163969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba108ba1b0 0x55ba10c93a30 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f5fc4011f80 tx=0x7f5fc4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21f242e948453878 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:03.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.113+0000 7f5fb37fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:41:03.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.113+0000 7f5fb37fe640 1 -- 172.21.15.5:0/824163969 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc402c060 con 0x55ba108ba1b0 2024-08-31T05:41:03.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.113+0000 7f5fe08c6740 1 -- 172.21.15.5:0/824163969 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5fc8005020 con 0x55ba108ba1b0 2024-08-31T05:41:03.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.113+0000 7f5fb37fe640 1 -- 172.21.15.5:0/824163969 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9599+0+0 (secure 0 0 0) 0x7f5fc4017030 con 0x55ba108ba1b0 2024-08-31T05:41:03.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.113+0000 7f5fb37fe640 1 -- 172.21.15.5:0/824163969 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f5fc401fb40 con 0x55ba108ba1b0 2024-08-31T05:41:03.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.113+0000 7f5fe08c6740 10 client.18501 fetch_fsmap learned FSMap version 34 2024-08-31T05:41:03.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.113+0000 7f5fe08c6740 1 -- 172.21.15.5:0/824163969 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55ba10ca28d0 con 0x55ba108ba1b0 2024-08-31T05:41:03.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.114+0000 7f5fb37fe640 1 -- 172.21.15.5:0/824163969 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5fc8005020 con 0x55ba108ba1b0 2024-08-31T05:41:03.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.114+0000 7f5fb37fe640 1 -- 172.21.15.5:0/824163969 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f5fc401b390 con 0x55ba108ba1b0 2024-08-31T05:41:03.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.114+0000 7f5fe08c6740 10 client.18501 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:41:03.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.114+0000 7f5fe08c6740 10 client.18501 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-31T05:41:03.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.114+0000 7f5fe08c6740 20 client.18501 populate_metadata read hostname 'smithi005' 2024-08-31T05:41:03.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.114+0000 7f5fe08c6740 1 --2- 172.21.15.5:0/824163969 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x55ba108a19f0 0x55ba10ca5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:03.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.114+0000 7f5fe08c6740 4 client.18501 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:41:03.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.114+0000 7f5fe08c6740 1 -- 172.21.15.5:0/824163969 --> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ba10c015d0 con 0x55ba108a19f0 2024-08-31T05:41:03.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.114+0000 7f5fd37fe640 1 --2- 172.21.15.5:0/824163969 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x55ba108a19f0 0x55ba10ca5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:03.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.115+0000 7f5fb37fe640 10 client.18501 ms_handle_connect on v2:172.21.15.70:6834/2061504114 2024-08-31T05:41:03.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.115+0000 7f5fd37fe640 1 --2- 172.21.15.5:0/824163969 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x55ba108a19f0 0x55ba10ca5ea0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=75722ef0610863bc server_cookie=dd21c13631a43092 in_seq=0 out_seq=0 2024-08-31T05:41:03.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.115+0000 7f5fb37fe640 1 -- 172.21.15.5:0/824163969 <== mds.3 v2:172.21.15.70:6834/2061504114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ba10c015d0 con 0x55ba108a19f0 2024-08-31T05:41:03.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.115+0000 7f5fb37fe640 10 client.18501 handle_command_reply: tid=0 2024-08-31T05:41:03.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.115+0000 7f5fe08c6740 1 client.18501 shutdown 2024-08-31T05:41:03.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.116+0000 7f5fe08c6740 1 -- 172.21.15.5:0/824163969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba108ba1b0 msgr2=0x55ba10c93a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:03.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.116+0000 7f5fe08c6740 1 --2- 172.21.15.5:0/824163969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba108ba1b0 0x55ba10c93a30 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f5fc4011f80 tx=0x7f5fc4004730 comp rx=0 tx=0).stop 2024-08-31T05:41:03.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.116+0000 7f5fe08c6740 1 -- 172.21.15.5:0/824163969 shutdown_connections 2024-08-31T05:41:03.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.116+0000 7f5fe08c6740 1 --2- 172.21.15.5:0/824163969 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x55ba108a19f0 0x55ba10ca5ea0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:03.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.116+0000 7f5fb37fe640 0 client.18501 ms_handle_reset on v2:172.21.15.70:6834/2061504114 2024-08-31T05:41:03.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.116+0000 7f5fe08c6740 1 --2- 172.21.15.5:0/824163969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba108e3070 0x55ba10c9fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:03.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.116+0000 7f5fe08c6740 1 --2- 172.21.15.5:0/824163969 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba108c2390 0x55ba10c93f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:03.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.116+0000 7f5fe08c6740 1 --2- 172.21.15.5:0/824163969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba108ba1b0 0x55ba10c93a30 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:03.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.116+0000 7f5fe08c6740 1 -- 172.21.15.5:0/824163969 >> 172.21.15.5:0/824163969 conn(0x55ba108d7460 msgr2=0x55ba10c8b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:03.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.116+0000 7f5fe08c6740 1 -- 172.21.15.5:0/824163969 shutdown_connections 2024-08-31T05:41:03.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.116+0000 7f5fe08c6740 1 -- 172.21.15.5:0/824163969 wait complete. 2024-08-31T05:41:03.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.116+0000 7f5fe08c6740 20 client.18501 trim_cache size 0 max 16384 2024-08-31T05:41:03.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.130+0000 7f5fe08c6740 1 Processor -- start 2024-08-31T05:41:03.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.130+0000 7f5fe08c6740 1 -- start start 2024-08-31T05:41:03.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.130+0000 7f5fe08c6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba108a19f0 0x55ba10c9fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:03.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.130+0000 7f5fe08c6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba108ba1b0 0x55ba10c857d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:03.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.131+0000 7f5fe08c6740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba108c2390 0x55ba10c85d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:03.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.131+0000 7f5fe08c6740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc0010180 con 0x55ba108c2390 2024-08-31T05:41:03.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.131+0000 7f5fe08c6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc0011cc0 con 0x55ba108ba1b0 2024-08-31T05:41:03.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.131+0000 7f5fe08c6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc0010850 con 0x55ba108a19f0 2024-08-31T05:41:03.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.131+0000 7f5fd37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba108ba1b0 0x55ba10c857d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:03.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.131+0000 7f5fd37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba108ba1b0 0x55ba10c857d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:59154/0 (socket says 172.21.15.5:59154) 2024-08-31T05:41:03.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.131+0000 7f5fd37fe640 1 -- 172.21.15.5:0/1775049283 learned_addr learned my addr 172.21.15.5:0/1775049283 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:03.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.131+0000 7f5fd3fff640 1 --2- 172.21.15.5:0/1775049283 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba108a19f0 0x55ba10c9fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:03.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.131+0000 7f5fd88ee640 1 --2- 172.21.15.5:0/1775049283 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba108c2390 0x55ba10c85d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:03.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.131+0000 7f5fd37fe640 1 -- 172.21.15.5:0/1775049283 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba108a19f0 msgr2=0x55ba10c9fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:03.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.131+0000 7f5fd37fe640 1 --2- 172.21.15.5:0/1775049283 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba108a19f0 0x55ba10c9fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:03.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.131+0000 7f5fd37fe640 1 -- 172.21.15.5:0/1775049283 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba108c2390 msgr2=0x55ba10c85d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:03.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.131+0000 7f5fd37fe640 1 --2- 172.21.15.5:0/1775049283 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba108c2390 0x55ba10c85d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:03.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.131+0000 7f5fd37fe640 1 -- 172.21.15.5:0/1775049283 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba10c8a600 con 0x55ba108ba1b0 2024-08-31T05:41:03.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.132+0000 7f5fd37fe640 1 --2- 172.21.15.5:0/1775049283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba108ba1b0 0x55ba10c857d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8009270 tx=0x7f5fc801c040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=498e0350eec34b0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:03.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.132+0000 7f5fb9ffb640 1 -- 172.21.15.5:0/1775049283 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc8013250 con 0x55ba108ba1b0 2024-08-31T05:41:03.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.132+0000 7f5fb9ffb640 1 -- 172.21.15.5:0/1775049283 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5fc802d020 con 0x55ba108ba1b0 2024-08-31T05:41:03.135 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:41:02 smithi005 ceph-mon[18602]: pgmap v685: 129 pgs: 129 active+clean; 593 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.2 MiB/s wr, 210 op/s 2024-08-31T05:41:03.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.132+0000 7f5fb9ffb640 1 -- 172.21.15.5:0/1775049283 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc802a6a0 con 0x55ba108ba1b0 2024-08-31T05:41:03.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.133+0000 7f5fe08c6740 1 -- 172.21.15.5:0/1775049283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba108ba1b0 msgr2=0x55ba10c857d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:03.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.133+0000 7f5fe08c6740 1 --2- 172.21.15.5:0/1775049283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba108ba1b0 0x55ba10c857d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8009270 tx=0x7f5fc801c040 comp rx=0 tx=0).stop 2024-08-31T05:41:03.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.133+0000 7f5fe08c6740 1 -- 172.21.15.5:0/1775049283 shutdown_connections 2024-08-31T05:41:03.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.133+0000 7f5fe08c6740 1 --2- 172.21.15.5:0/1775049283 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba108c2390 0x55ba10c85d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:03.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.133+0000 7f5fe08c6740 1 --2- 172.21.15.5:0/1775049283 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba108ba1b0 0x55ba10c857d0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:03.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.133+0000 7f5fe08c6740 1 --2- 172.21.15.5:0/1775049283 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba108a19f0 0x55ba10c9fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:03.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.133+0000 7f5fe08c6740 1 -- 172.21.15.5:0/1775049283 >> 172.21.15.5:0/1775049283 conn(0x55ba108d7460 msgr2=0x55ba10c922b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:03.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.134+0000 7f5fe08c6740 1 -- 172.21.15.5:0/1775049283 shutdown_connections 2024-08-31T05:41:03.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.134+0000 7f5fe08c6740 1 -- 172.21.15.5:0/1775049283 wait complete. 2024-08-31T05:41:03.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.134+0000 7f5fe08c6740 1 -- start start 2024-08-31T05:41:03.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.134+0000 7f5fe08c6740 1 Processor -- start 2024-08-31T05:41:03.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.135+0000 7f5fe08c6740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba108a19f0 0x55ba10c9c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:03.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.135+0000 7f5fe08c6740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba108ba1b0 0x55ba10c97a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:03.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.135+0000 7f5fe08c6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba108c2390 0x55ba10c97f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:03.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.135+0000 7f5fe08c6740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc00115f0 con 0x55ba108a19f0 2024-08-31T05:41:03.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.135+0000 7f5fe08c6740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc0010f20 con 0x55ba108ba1b0 2024-08-31T05:41:03.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.135+0000 7f5fe08c6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc000e180 con 0x55ba108c2390 2024-08-31T05:41:03.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.135+0000 7f5fe08c6740 10 client.0 _ll_register_callbacks cb 0x7f5fc4005c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:41:03.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.135+0000 7f5fd88ee640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba108c2390 0x55ba10c97f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:03.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.135+0000 7f5fd3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba108a19f0 0x55ba10c9c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:03.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.135+0000 7f5fd88ee640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba108c2390 0x55ba10c97f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:43636/0 (socket says 172.21.15.5:43636) 2024-08-31T05:41:03.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.135+0000 7f5fd88ee640 1 -- 172.21.15.5:0/3468725336 learned_addr learned my addr 172.21.15.5:0/3468725336 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:03.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.135+0000 7f5fd37fe640 1 --2- 172.21.15.5:0/3468725336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba108ba1b0 0x55ba10c97a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:03.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.136+0000 7f5fd88ee640 1 -- 172.21.15.5:0/3468725336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba108ba1b0 msgr2=0x55ba10c97a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:03.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.136+0000 7f5fd88ee640 1 --2- 172.21.15.5:0/3468725336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba108ba1b0 0x55ba10c97a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:03.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.136+0000 7f5fd88ee640 1 -- 172.21.15.5:0/3468725336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba108a19f0 msgr2=0x55ba10c9c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:03.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.136+0000 7f5fd88ee640 1 --2- 172.21.15.5:0/3468725336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba108a19f0 0x55ba10c9c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:03.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.136+0000 7f5fd88ee640 1 -- 172.21.15.5:0/3468725336 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba10c98720 con 0x55ba108c2390 2024-08-31T05:41:03.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.136+0000 7f5fd88ee640 1 --2- 172.21.15.5:0/3468725336 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba108c2390 0x55ba10c97f90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc0d03c0 tx=0x7f5fcc0d0200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e85699d7f9c5c0e5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:03.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.136+0000 7f5fb37fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:41:03.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.136+0000 7f5fb37fe640 1 -- 172.21.15.5:0/3468725336 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc003b80 con 0x55ba108c2390 2024-08-31T05:41:03.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.136+0000 7f5fb37fe640 1 -- 172.21.15.5:0/3468725336 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9599+0+0 (secure 0 0 0) 0x7f5fcc0cad60 con 0x55ba108c2390 2024-08-31T05:41:03.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.136+0000 7f5fe08c6740 1 -- 172.21.15.5:0/3468725336 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5fc802d020 con 0x55ba108c2390 2024-08-31T05:41:03.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.136+0000 7f5fb37fe640 1 -- 172.21.15.5:0/3468725336 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f5fcc0cff40 con 0x55ba108c2390 2024-08-31T05:41:03.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.136+0000 7f5fe08c6740 10 client.28090 fetch_fsmap learned FSMap version 34 2024-08-31T05:41:03.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.136+0000 7f5fe08c6740 1 -- 172.21.15.5:0/3468725336 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55ba10d107d0 con 0x55ba108c2390 2024-08-31T05:41:03.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.137+0000 7f5fb37fe640 1 -- 172.21.15.5:0/3468725336 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5fc802d020 con 0x55ba108c2390 2024-08-31T05:41:03.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.137+0000 7f5fb37fe640 1 -- 172.21.15.5:0/3468725336 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f5fcc004b40 con 0x55ba108c2390 2024-08-31T05:41:03.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.137+0000 7f5fe08c6740 10 client.28090 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:41:03.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.137+0000 7f5fe08c6740 10 client.28090 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-31T05:41:03.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.137+0000 7f5fe08c6740 20 client.28090 populate_metadata read hostname 'smithi005' 2024-08-31T05:41:03.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.137+0000 7f5fe08c6740 1 --2- 172.21.15.5:0/3468725336 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x55ba108e3070 0x55ba10d12f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:03.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.137+0000 7f5fe08c6740 4 client.28090 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:41:03.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.137+0000 7f5fe08c6740 1 -- 172.21.15.5:0/3468725336 --> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ba10bfd070 con 0x55ba108e3070 2024-08-31T05:41:03.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.137+0000 7f5fd3fff640 1 --2- 172.21.15.5:0/3468725336 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x55ba108e3070 0x55ba10d12f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:03.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.137+0000 7f5fb37fe640 10 client.28090 ms_handle_connect on v2:172.21.15.70:6834/2061504114 2024-08-31T05:41:03.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.138+0000 7f5fd3fff640 1 --2- 172.21.15.5:0/3468725336 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x55ba108e3070 0x55ba10d12f10 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=16b366a85d643f25 server_cookie=f80fe73457ec8343 in_seq=0 out_seq=0 2024-08-31T05:41:03.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.138+0000 7f5fb37fe640 1 -- 172.21.15.5:0/3468725336 <== mds.3 v2:172.21.15.70:6834/2061504114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ba10bfd070 con 0x55ba108e3070 2024-08-31T05:41:03.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.138+0000 7f5fb37fe640 10 client.28090 handle_command_reply: tid=0 2024-08-31T05:41:03.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.138+0000 7f5fe08c6740 1 client.28090 shutdown 2024-08-31T05:41:03.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.138+0000 7f5fe08c6740 1 -- 172.21.15.5:0/3468725336 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba108c2390 msgr2=0x55ba10c97f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:03.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.138+0000 7f5fe08c6740 1 --2- 172.21.15.5:0/3468725336 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba108c2390 0x55ba10c97f90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc0d03c0 tx=0x7f5fcc0d0200 comp rx=0 tx=0).stop 2024-08-31T05:41:03.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.138+0000 7f5fe08c6740 1 -- 172.21.15.5:0/3468725336 shutdown_connections 2024-08-31T05:41:03.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.138+0000 7f5fe08c6740 1 --2- 172.21.15.5:0/3468725336 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x55ba108e3070 0x55ba10d12f10 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:03.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.138+0000 7f5fe08c6740 1 --2- 172.21.15.5:0/3468725336 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba108c2390 0x55ba10c97f90 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:03.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.138+0000 7f5fe08c6740 1 --2- 172.21.15.5:0/3468725336 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba108ba1b0 0x55ba10c97a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:03.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.138+0000 7f5fe08c6740 1 --2- 172.21.15.5:0/3468725336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba108a19f0 0x55ba10c9c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:03.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.138+0000 7f5fe08c6740 1 -- 172.21.15.5:0/3468725336 >> 172.21.15.5:0/3468725336 conn(0x55ba108d7460 msgr2=0x55ba10c89340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:03.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.138+0000 7f5fb37fe640 0 client.28090 ms_handle_reset on v2:172.21.15.70:6834/2061504114 2024-08-31T05:41:03.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.138+0000 7f5fe08c6740 1 -- 172.21.15.5:0/3468725336 shutdown_connections 2024-08-31T05:41:03.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.139+0000 7f5fe08c6740 1 -- 172.21.15.5:0/3468725336 wait complete. 2024-08-31T05:41:03.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.139+0000 7f5fe08c6740 20 client.28090 trim_cache size 0 max 16384 2024-08-31T05:41:03.145 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:41:03.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.139+0000 7f5fda351640 1 -- 172.21.15.5:0/398895261 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5fbc0b4ca0 msgr2=0x7f5fbc0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:03.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.139+0000 7f5fda351640 1 --2- 172.21.15.5:0/398895261 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5fbc0b4ca0 0x7f5fbc0b71b0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x55ba10c86f90 tx=0x7f5fc400b390 comp rx=0 tx=0).stop 2024-08-31T05:41:03.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.139+0000 7f5fda351640 1 -- 172.21.15.5:0/398895261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fd4108ad0 msgr2=0x7f5fd419e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:03.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.139+0000 7f5fda351640 1 --2- 172.21.15.5:0/398895261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fd4108ad0 0x7f5fd419e920 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc0098d0 tx=0x7f5fcc031730 comp rx=0 tx=0).stop 2024-08-31T05:41:03.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.139+0000 7f5fda351640 1 -- 172.21.15.5:0/398895261 shutdown_connections 2024-08-31T05:41:03.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.140+0000 7f5fda351640 1 --2- 172.21.15.5:0/398895261 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f5fbc0b4ca0 0x7f5fbc0b71b0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:03.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.140+0000 7f5fda351640 1 --2- 172.21.15.5:0/398895261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fd4108ad0 0x7f5fd419e920 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:03.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.140+0000 7f5fda351640 1 --2- 172.21.15.5:0/398895261 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5fd4108180 0x7f5fd4199680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:03.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.140+0000 7f5fda351640 1 --2- 172.21.15.5:0/398895261 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f5fd4102840 0x7f5fd41990e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:03.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.140+0000 7f5fda351640 1 -- 172.21.15.5:0/398895261 >> 172.21.15.5:0/398895261 conn(0x7f5fd4079580 msgr2=0x7f5fd4104fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:03.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.140+0000 7f5fda351640 1 -- 172.21.15.5:0/398895261 shutdown_connections 2024-08-31T05:41:03.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:03.140+0000 7f5fda351640 1 -- 172.21.15.5:0/398895261 wait complete. 2024-08-31T05:41:03.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:41:02 smithi070 ceph-mon[22316]: pgmap v685: 129 pgs: 129 active+clean; 593 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.2 MiB/s wr, 210 op/s 2024-08-31T05:41:03.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:41:02 smithi050 ceph-mon[22146]: pgmap v685: 129 pgs: 129 active+clean; 593 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.2 MiB/s wr, 210 op/s 2024-08-31T05:41:03.938 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1247166 10.88 MB/sec execute 471 sec latency 50.547 ms 2024-08-31T05:41:04.053 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T05:41:04.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:41:03 smithi070 ceph-mon[22316]: osdmap e96: 12 total, 12 up, 12 in 2024-08-31T05:41:04.341 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:41:04.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:41:03 smithi050 ceph-mon[22146]: osdmap e96: 12 total, 12 up, 12 in 2024-08-31T05:41:04.463 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:41:03 smithi005 ceph-mon[18602]: osdmap e96: 12 total, 12 up, 12 in 2024-08-31T05:41:04.938 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1248951 10.87 MB/sec execute 472 sec latency 73.604 ms 2024-08-31T05:41:05.084 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:41:04 smithi005 ceph-mon[18602]: pgmap v687: 129 pgs: 129 active+clean; 594 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.6 MiB/s wr, 238 op/s 2024-08-31T05:41:05.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.186+0000 7f2a55bdc640 1 -- 172.21.15.5:0/277475921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a5010db90 msgr2=0x7f2a501100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:05.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.186+0000 7f2a55bdc640 1 --2- 172.21.15.5:0/277475921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a5010db90 0x7f2a501100a0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f2a48009ca0 tx=0x7f2a4802a8c0 comp rx=0 tx=0).stop 2024-08-31T05:41:05.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.186+0000 7f2a55bdc640 1 -- 172.21.15.5:0/277475921 shutdown_connections 2024-08-31T05:41:05.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.186+0000 7f2a55bdc640 1 --2- 172.21.15.5:0/277475921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a5010db90 0x7f2a501100a0 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:05.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.186+0000 7f2a55bdc640 1 --2- 172.21.15.5:0/277475921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a50105010 0x7f2a5010d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:05.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.186+0000 7f2a55bdc640 1 --2- 172.21.15.5:0/277475921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a501045e0 0x7f2a501049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:05.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.186+0000 7f2a55bdc640 1 -- 172.21.15.5:0/277475921 >> 172.21.15.5:0/277475921 conn(0x7f2a500794d0 msgr2=0x7f2a500798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:05.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.186+0000 7f2a55bdc640 1 -- 172.21.15.5:0/277475921 shutdown_connections 2024-08-31T05:41:05.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.186+0000 7f2a55bdc640 1 -- 172.21.15.5:0/277475921 wait complete. 2024-08-31T05:41:05.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.187+0000 7f2a55bdc640 1 Processor -- start 2024-08-31T05:41:05.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.187+0000 7f2a55bdc640 1 -- start start 2024-08-31T05:41:05.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.187+0000 7f2a55bdc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a501045e0 0x7f2a501024f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:05.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.187+0000 7f2a55bdc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a50105010 0x7f2a50102a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:05.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.187+0000 7f2a55bdc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a5010db90 0x7f2a50102f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:05.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.187+0000 7f2a55bdc640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2a50113830 con 0x7f2a50105010 2024-08-31T05:41:05.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.187+0000 7f2a55bdc640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2a501136b0 con 0x7f2a501045e0 2024-08-31T05:41:05.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.187+0000 7f2a55bdc640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2a501139b0 con 0x7f2a5010db90 2024-08-31T05:41:05.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.188+0000 7f2a46ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a50105010 0x7f2a50102a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:05.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.188+0000 7f2a4ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a5010db90 0x7f2a50102f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:05.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.188+0000 7f2a46ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a50105010 0x7f2a50102a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44726/0 (socket says 172.21.15.5:44726) 2024-08-31T05:41:05.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.188+0000 7f2a46ffd640 1 -- 172.21.15.5:0/4102857660 learned_addr learned my addr 172.21.15.5:0/4102857660 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:05.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.188+0000 7f2a4ffff640 1 -- 172.21.15.5:0/4102857660 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a501045e0 msgr2=0x7f2a501024f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-31T05:41:05.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.188+0000 7f2a4ffff640 1 --2- 172.21.15.5:0/4102857660 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a501045e0 0x7f2a501024f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:05.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.188+0000 7f2a4ffff640 1 -- 172.21.15.5:0/4102857660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a50105010 msgr2=0x7f2a50102a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:05.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.188+0000 7f2a4ffff640 1 --2- 172.21.15.5:0/4102857660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a50105010 0x7f2a50102a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:05.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.188+0000 7f2a4ffff640 1 -- 172.21.15.5:0/4102857660 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a501a8560 con 0x7f2a5010db90 2024-08-31T05:41:05.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.188+0000 7f2a46ffd640 1 --2- 172.21.15.5:0/4102857660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a50105010 0x7f2a50102a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:41:05.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.188+0000 7f2a4ffff640 1 --2- 172.21.15.5:0/4102857660 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a5010db90 0x7f2a50102f70 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2a4802ade0 tx=0x7f2a48031660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:05.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.189+0000 7f2a4d7fa640 1 -- 172.21.15.5:0/4102857660 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a48003b70 con 0x7f2a5010db90 2024-08-31T05:41:05.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.189+0000 7f2a4d7fa640 1 -- 172.21.15.5:0/4102857660 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2a48031910 con 0x7f2a5010db90 2024-08-31T05:41:05.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.189+0000 7f2a55bdc640 1 -- 172.21.15.5:0/4102857660 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a501a87f0 con 0x7f2a5010db90 2024-08-31T05:41:05.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.189+0000 7f2a4d7fa640 1 -- 172.21.15.5:0/4102857660 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a4802f950 con 0x7f2a5010db90 2024-08-31T05:41:05.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.189+0000 7f2a55bdc640 1 -- 172.21.15.5:0/4102857660 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a501a8d30 con 0x7f2a5010db90 2024-08-31T05:41:05.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.191+0000 7f2a4d7fa640 1 -- 172.21.15.5:0/4102857660 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f2a4802faf0 con 0x7f2a5010db90 2024-08-31T05:41:05.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.192+0000 7f2a5c151740 1 Processor -- start 2024-08-31T05:41:05.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.192+0000 7f2a5c151740 1 -- start start 2024-08-31T05:41:05.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.192+0000 7f2a5c151740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5601585c5070 0x56015896a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:05.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.192+0000 7f2a5c151740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56015859c1b0 0x56015896a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:05.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.192+0000 7f2a5c151740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5601585a4390 0x56015896add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:05.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.192+0000 7f2a5c151740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5601588e1680 con 0x5601585c5070 2024-08-31T05:41:05.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.192+0000 7f2a5c151740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5601588d0c10 con 0x56015859c1b0 2024-08-31T05:41:05.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.192+0000 7f2a5c151740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5601588d4bc0 con 0x5601585a4390 2024-08-31T05:41:05.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.192+0000 7f2a46ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5601585c5070 0x56015896a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:05.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.192+0000 7f2a4f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56015859c1b0 0x56015896a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:05.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.192+0000 7f2a46ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5601585c5070 0x56015896a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44736/0 (socket says 172.21.15.5:44736) 2024-08-31T05:41:05.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.192+0000 7f2a46ffd640 1 -- 172.21.15.5:0/2130012354 learned_addr learned my addr 172.21.15.5:0/2130012354 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:05.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.192+0000 7f2a46ffd640 1 --2- 172.21.15.5:0/2130012354 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5601585a4390 0x56015896add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:05.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.193+0000 7f2a4d7fa640 1 --2- 172.21.15.5:0/4102857660 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2a3c0b4ca0 0x7f2a3c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:05.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.193+0000 7f2a4f7fe640 1 -- 172.21.15.5:0/2130012354 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5601585a4390 msgr2=0x56015896add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:05.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.193+0000 7f2a4f7fe640 1 --2- 172.21.15.5:0/2130012354 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5601585a4390 0x56015896add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:05.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.193+0000 7f2a4f7fe640 1 -- 172.21.15.5:0/2130012354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5601585c5070 msgr2=0x56015896a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:05.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.193+0000 7f2a4f7fe640 1 --2- 172.21.15.5:0/2130012354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5601585c5070 0x56015896a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:05.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.193+0000 7f2a4f7fe640 1 -- 172.21.15.5:0/2130012354 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560158630650 con 0x56015859c1b0 2024-08-31T05:41:05.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.193+0000 7f2a4ffff640 1 --2- 172.21.15.5:0/4102857660 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2a3c0b4ca0 0x7f2a3c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:05.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.193+0000 7f2a4d7fa640 1 -- 172.21.15.5:0/4102857660 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9599+0+0 (secure 0 0 0) 0x7f2a48106b50 con 0x7f2a5010db90 2024-08-31T05:41:05.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.193+0000 7f2a4f7fe640 1 --2- 172.21.15.5:0/2130012354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56015859c1b0 0x56015896a890 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2a5006b9a0 tx=0x7f2a40009f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd6690633b8c7d53 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:05.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.193+0000 7f2a45ffb640 1 -- 172.21.15.5:0/2130012354 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a4000ed10 con 0x56015859c1b0 2024-08-31T05:41:05.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.193+0000 7f2a45ffb640 1 -- 172.21.15.5:0/2130012354 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2a400054d0 con 0x56015859c1b0 2024-08-31T05:41:05.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.193+0000 7f2a45ffb640 1 -- 172.21.15.5:0/2130012354 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a40018470 con 0x56015859c1b0 2024-08-31T05:41:05.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.194+0000 7f2a5c151740 1 -- 172.21.15.5:0/2130012354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56015859c1b0 msgr2=0x56015896a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:05.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.194+0000 7f2a4ffff640 1 --2- 172.21.15.5:0/4102857660 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2a3c0b4ca0 0x7f2a3c0b71b0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2a48033ff0 tx=0x7f2a48003f10 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:05.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.194+0000 7f2a5c151740 1 --2- 172.21.15.5:0/2130012354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56015859c1b0 0x56015896a890 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2a5006b9a0 tx=0x7f2a40009f50 comp rx=0 tx=0).stop 2024-08-31T05:41:05.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.194+0000 7f2a5c151740 1 -- 172.21.15.5:0/2130012354 shutdown_connections 2024-08-31T05:41:05.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.194+0000 7f2a5c151740 1 --2- 172.21.15.5:0/2130012354 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5601585a4390 0x56015896add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:05.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.194+0000 7f2a5c151740 1 --2- 172.21.15.5:0/2130012354 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56015859c1b0 0x56015896a890 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:05.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.194+0000 7f2a5c151740 1 --2- 172.21.15.5:0/2130012354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5601585c5070 0x56015896a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:05.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.194+0000 7f2a5c151740 1 -- 172.21.15.5:0/2130012354 >> 172.21.15.5:0/2130012354 conn(0x5601585b9460 msgr2=0x560158968240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:05.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.194+0000 7f2a5c151740 1 -- 172.21.15.5:0/2130012354 shutdown_connections 2024-08-31T05:41:05.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.194+0000 7f2a5c151740 1 -- 172.21.15.5:0/2130012354 wait complete. 2024-08-31T05:41:05.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.195+0000 7f2a5c151740 1 -- start start 2024-08-31T05:41:05.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.195+0000 7f2a5c151740 1 Processor -- start 2024-08-31T05:41:05.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.195+0000 7f2a5c151740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56015859c1b0 0x560158975b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:05.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.195+0000 7f2a5c151740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5601585a4390 0x5601589760c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:05.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.195+0000 7f2a5c151740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5601585c5070 0x560158981e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:05.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.195+0000 7f2a5c151740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x560158733700 con 0x5601585c5070 2024-08-31T05:41:05.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.195+0000 7f2a5c151740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560158857750 con 0x56015859c1b0 2024-08-31T05:41:05.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.195+0000 7f2a5c151740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560158978b30 con 0x5601585a4390 2024-08-31T05:41:05.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.195+0000 7f2a5c151740 10 client.0 _ll_register_callbacks cb 0x560158886e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:41:05.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.196+0000 7f2a46ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56015859c1b0 0x560158975b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:05.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.196+0000 7f2a4f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5601585a4390 0x5601589760c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:05.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.196+0000 7f2a46ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56015859c1b0 0x560158975b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:59186/0 (socket says 172.21.15.5:59186) 2024-08-31T05:41:05.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.196+0000 7f2a4f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5601585a4390 0x5601589760c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:43682/0 (socket says 172.21.15.5:43682) 2024-08-31T05:41:05.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.196+0000 7f2a46ffd640 1 -- 172.21.15.5:0/1100285860 learned_addr learned my addr 172.21.15.5:0/1100285860 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:05.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.196+0000 7f2a46ffd640 1 --2- 172.21.15.5:0/1100285860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5601585c5070 0x560158981e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:05.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.196+0000 7f2a46ffd640 1 -- 172.21.15.5:0/1100285860 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5601585a4390 msgr2=0x5601589760c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:05.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.196+0000 7f2a46ffd640 1 --2- 172.21.15.5:0/1100285860 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5601585a4390 0x5601589760c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:05.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.196+0000 7f2a46ffd640 1 -- 172.21.15.5:0/1100285860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5601585c5070 msgr2=0x560158981e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:05.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.196+0000 7f2a46ffd640 1 --2- 172.21.15.5:0/1100285860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5601585c5070 0x560158981e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:05.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.196+0000 7f2a46ffd640 1 -- 172.21.15.5:0/1100285860 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560158890900 con 0x56015859c1b0 2024-08-31T05:41:05.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.196+0000 7f2a4f7fe640 1 --2- 172.21.15.5:0/1100285860 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5601585a4390 0x5601589760c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:41:05.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.196+0000 7f2a46ffd640 1 --2- 172.21.15.5:0/1100285860 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56015859c1b0 0x560158975b80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2a38013cd0 tx=0x7f2a38005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b42203c379c4e6f9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:05.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.196+0000 7f2a2effd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:41:05.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.196+0000 7f2a2effd640 1 -- 172.21.15.5:0/1100285860 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a3800fe60 con 0x56015859c1b0 2024-08-31T05:41:05.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.196+0000 7f2a2effd640 1 -- 172.21.15.5:0/1100285860 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9599+0+0 (secure 0 0 0) 0x7f2a38004030 con 0x56015859c1b0 2024-08-31T05:41:05.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.197+0000 7f2a5c151740 1 -- 172.21.15.5:0/1100285860 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a400054d0 con 0x56015859c1b0 2024-08-31T05:41:05.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.197+0000 7f2a2effd640 1 -- 172.21.15.5:0/1100285860 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f2a38004230 con 0x56015859c1b0 2024-08-31T05:41:05.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.197+0000 7f2a5c151740 10 client.28082 fetch_fsmap learned FSMap version 34 2024-08-31T05:41:05.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.197+0000 7f2a5c151740 1 -- 172.21.15.5:0/1100285860 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5601589849b0 con 0x56015859c1b0 2024-08-31T05:41:05.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.197+0000 7f2a2effd640 1 -- 172.21.15.5:0/1100285860 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2a400054d0 con 0x56015859c1b0 2024-08-31T05:41:05.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.197+0000 7f2a2effd640 1 -- 172.21.15.5:0/1100285860 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f2a38023450 con 0x56015859c1b0 2024-08-31T05:41:05.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.197+0000 7f2a5c151740 10 client.28082 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:41:05.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.197+0000 7f2a5c151740 10 client.28082 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-31T05:41:05.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.197+0000 7f2a5c151740 20 client.28082 populate_metadata read hostname 'smithi005' 2024-08-31T05:41:05.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.197+0000 7f2a5c151740 1 --2- 172.21.15.5:0/1100285860 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x5601585839f0 0x560158987e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:05.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.197+0000 7f2a5c151740 4 client.28082 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:41:05.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.197+0000 7f2a5c151740 1 -- 172.21.15.5:0/1100285860 --> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5601588e35d0 con 0x5601585839f0 2024-08-31T05:41:05.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.198+0000 7f2a4f7fe640 1 --2- 172.21.15.5:0/1100285860 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x5601585839f0 0x560158987e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:05.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.198+0000 7f2a2effd640 10 client.28082 ms_handle_connect on v2:172.21.15.70:6836/2780036414 2024-08-31T05:41:05.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.198+0000 7f2a4f7fe640 1 --2- 172.21.15.5:0/1100285860 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x5601585839f0 0x560158987e80 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d13921beb6cba3aa server_cookie=568f53a8dd3f093d in_seq=0 out_seq=0 2024-08-31T05:41:05.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.199+0000 7f2a2effd640 1 -- 172.21.15.5:0/1100285860 <== mds.2 v2:172.21.15.70:6836/2780036414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5601588e35d0 con 0x5601585839f0 2024-08-31T05:41:05.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.199+0000 7f2a2effd640 10 client.28082 handle_command_reply: tid=0 2024-08-31T05:41:05.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.199+0000 7f2a5c151740 1 client.28082 shutdown 2024-08-31T05:41:05.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.199+0000 7f2a5c151740 1 -- 172.21.15.5:0/1100285860 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56015859c1b0 msgr2=0x560158975b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:05.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.199+0000 7f2a5c151740 1 --2- 172.21.15.5:0/1100285860 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56015859c1b0 0x560158975b80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2a38013cd0 tx=0x7f2a38005f90 comp rx=0 tx=0).stop 2024-08-31T05:41:05.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.199+0000 7f2a5c151740 1 -- 172.21.15.5:0/1100285860 shutdown_connections 2024-08-31T05:41:05.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.199+0000 7f2a5c151740 1 --2- 172.21.15.5:0/1100285860 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x5601585839f0 0x560158987e80 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:05.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.199+0000 7f2a5c151740 1 --2- 172.21.15.5:0/1100285860 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5601585c5070 0x560158981e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:05.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.199+0000 7f2a5c151740 1 --2- 172.21.15.5:0/1100285860 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5601585a4390 0x5601589760c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:05.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.199+0000 7f2a5c151740 1 --2- 172.21.15.5:0/1100285860 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56015859c1b0 0x560158975b80 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:05.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.199+0000 7f2a5c151740 1 -- 172.21.15.5:0/1100285860 >> 172.21.15.5:0/1100285860 conn(0x5601585b9460 msgr2=0x56015896d530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:05.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.199+0000 7f2a2effd640 0 client.28082 ms_handle_reset on v2:172.21.15.70:6836/2780036414 2024-08-31T05:41:05.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.200+0000 7f2a5c151740 1 -- 172.21.15.5:0/1100285860 shutdown_connections 2024-08-31T05:41:05.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.200+0000 7f2a5c151740 1 -- 172.21.15.5:0/1100285860 wait complete. 2024-08-31T05:41:05.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.200+0000 7f2a5c151740 20 client.28082 trim_cache size 0 max 16384 2024-08-31T05:41:05.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.215+0000 7f2a5c151740 1 Processor -- start 2024-08-31T05:41:05.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.215+0000 7f2a5c151740 1 -- start start 2024-08-31T05:41:05.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.215+0000 7f2a5c151740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56015859c1b0 0x560158976040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:05.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.215+0000 7f2a5c151740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5601585a4390 0x560158981d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:05.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.215+0000 7f2a5c151740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5601585c5070 0x560158982260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:05.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.215+0000 7f2a5c151740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2a501b3020 con 0x5601585c5070 2024-08-31T05:41:05.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.215+0000 7f2a5c151740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2a501b4b60 con 0x56015859c1b0 2024-08-31T05:41:05.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.215+0000 7f2a5c151740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2a501b36f0 con 0x5601585a4390 2024-08-31T05:41:05.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.215+0000 7f2a4f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5601585a4390 0x560158981d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:05.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.215+0000 7f2a4f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5601585a4390 0x560158981d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:43698/0 (socket says 172.21.15.5:43698) 2024-08-31T05:41:05.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.215+0000 7f2a4f7fe640 1 -- 172.21.15.5:0/2719792605 learned_addr learned my addr 172.21.15.5:0/2719792605 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:05.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.215+0000 7f2a46ffd640 1 --2- 172.21.15.5:0/2719792605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5601585c5070 0x560158982260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:05.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.216+0000 7f2a46ffd640 1 --2- 172.21.15.5:0/2719792605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56015859c1b0 0x560158976040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:05.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.216+0000 7f2a4f7fe640 1 -- 172.21.15.5:0/2719792605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56015859c1b0 msgr2=0x560158976040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:05.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.216+0000 7f2a4f7fe640 1 --2- 172.21.15.5:0/2719792605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56015859c1b0 0x560158976040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:05.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.216+0000 7f2a4f7fe640 1 -- 172.21.15.5:0/2719792605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5601585c5070 msgr2=0x560158982260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:05.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.216+0000 7f2a4f7fe640 1 --2- 172.21.15.5:0/2719792605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5601585c5070 0x560158982260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:05.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.216+0000 7f2a4f7fe640 1 -- 172.21.15.5:0/2719792605 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560158976e40 con 0x5601585a4390 2024-08-31T05:41:05.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.216+0000 7f2a46ffd640 1 --2- 172.21.15.5:0/2719792605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5601585c5070 0x560158982260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:41:05.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.216+0000 7f2a4f7fe640 1 --2- 172.21.15.5:0/2719792605 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5601585a4390 0x560158981d20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2a40009770 tx=0x7f2a40004bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c9a2b46e8baf51 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:05.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.216+0000 7f2a457fa640 1 -- 172.21.15.5:0/2719792605 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a40030020 con 0x5601585a4390 2024-08-31T05:41:05.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.216+0000 7f2a457fa640 1 -- 172.21.15.5:0/2719792605 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2a40004d20 con 0x5601585a4390 2024-08-31T05:41:05.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.216+0000 7f2a457fa640 1 -- 172.21.15.5:0/2719792605 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a400054f0 con 0x5601585a4390 2024-08-31T05:41:05.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.217+0000 7f2a5c151740 1 -- 172.21.15.5:0/2719792605 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5601585a4390 msgr2=0x560158981d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:05.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.217+0000 7f2a5c151740 1 --2- 172.21.15.5:0/2719792605 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5601585a4390 0x560158981d20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2a40009770 tx=0x7f2a40004bf0 comp rx=0 tx=0).stop 2024-08-31T05:41:05.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.217+0000 7f2a5c151740 1 -- 172.21.15.5:0/2719792605 shutdown_connections 2024-08-31T05:41:05.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.217+0000 7f2a5c151740 1 --2- 172.21.15.5:0/2719792605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5601585c5070 0x560158982260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:05.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.217+0000 7f2a5c151740 1 --2- 172.21.15.5:0/2719792605 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5601585a4390 0x560158981d20 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:05.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.217+0000 7f2a5c151740 1 --2- 172.21.15.5:0/2719792605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56015859c1b0 0x560158976040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:05.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.217+0000 7f2a5c151740 1 -- 172.21.15.5:0/2719792605 >> 172.21.15.5:0/2719792605 conn(0x5601585b9460 msgr2=0x560158975930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:05.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.217+0000 7f2a5c151740 1 -- 172.21.15.5:0/2719792605 shutdown_connections 2024-08-31T05:41:05.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.217+0000 7f2a5c151740 1 -- 172.21.15.5:0/2719792605 wait complete. 2024-08-31T05:41:05.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.218+0000 7f2a5c151740 1 -- start start 2024-08-31T05:41:05.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.218+0000 7f2a5c151740 1 Processor -- start 2024-08-31T05:41:05.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.218+0000 7f2a5c151740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56015859c1b0 0x56015897e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:05.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.218+0000 7f2a5c151740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5601585a4390 0x560158979790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:05.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.218+0000 7f2a5c151740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5601585c5070 0x560158979cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:05.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.218+0000 7f2a5c151740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2a501b4490 con 0x5601585c5070 2024-08-31T05:41:05.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.218+0000 7f2a5c151740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2a501b3dc0 con 0x56015859c1b0 2024-08-31T05:41:05.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.218+0000 7f2a5c151740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2a501b1020 con 0x5601585a4390 2024-08-31T05:41:05.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.219+0000 7f2a5c151740 10 client.0 _ll_register_callbacks cb 0x7f2a38013050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:41:05.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.219+0000 7f2a4f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5601585a4390 0x560158979790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:05.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.219+0000 7f2a4f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5601585a4390 0x560158979790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:43700/0 (socket says 172.21.15.5:43700) 2024-08-31T05:41:05.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.219+0000 7f2a4f7fe640 1 -- 172.21.15.5:0/152604079 learned_addr learned my addr 172.21.15.5:0/152604079 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:05.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.219+0000 7f2a46ffd640 1 --2- 172.21.15.5:0/152604079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5601585c5070 0x560158979cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:05.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.219+0000 7f2a46ffd640 1 --2- 172.21.15.5:0/152604079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56015859c1b0 0x56015897e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:05.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.219+0000 7f2a4f7fe640 1 -- 172.21.15.5:0/152604079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56015859c1b0 msgr2=0x56015897e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:05.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.219+0000 7f2a4f7fe640 1 --2- 172.21.15.5:0/152604079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56015859c1b0 0x56015897e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:05.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.219+0000 7f2a4f7fe640 1 -- 172.21.15.5:0/152604079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5601585c5070 msgr2=0x560158979cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:05.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.219+0000 7f2a4f7fe640 1 --2- 172.21.15.5:0/152604079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5601585c5070 0x560158979cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:05.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.219+0000 7f2a4f7fe640 1 -- 172.21.15.5:0/152604079 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56015897a210 con 0x5601585a4390 2024-08-31T05:41:05.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.219+0000 7f2a46ffd640 1 --2- 172.21.15.5:0/152604079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56015859c1b0 0x56015897e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:41:05.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.219+0000 7f2a4f7fe640 1 --2- 172.21.15.5:0/152604079 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5601585a4390 0x560158979790 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2a4000e990 tx=0x7f2a40004f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6807c5bf8c71dacf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:05.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.219+0000 7f2a2effd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:41:05.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.219+0000 7f2a2effd640 1 -- 172.21.15.5:0/152604079 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a4003c070 con 0x5601585a4390 2024-08-31T05:41:05.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.219+0000 7f2a2effd640 1 -- 172.21.15.5:0/152604079 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9599+0+0 (secure 0 0 0) 0x7f2a4000ed10 con 0x5601585a4390 2024-08-31T05:41:05.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.220+0000 7f2a5c151740 1 -- 172.21.15.5:0/152604079 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a40004d20 con 0x5601585a4390 2024-08-31T05:41:05.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.220+0000 7f2a2effd640 1 -- 172.21.15.5:0/152604079 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f2a40030020 con 0x5601585a4390 2024-08-31T05:41:05.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.220+0000 7f2a5c151740 10 client.28108 fetch_fsmap learned FSMap version 34 2024-08-31T05:41:05.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.220+0000 7f2a5c151740 1 -- 172.21.15.5:0/152604079 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5601589f24d0 con 0x5601585a4390 2024-08-31T05:41:05.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.220+0000 7f2a2effd640 1 -- 172.21.15.5:0/152604079 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2a40004d20 con 0x5601585a4390 2024-08-31T05:41:05.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.220+0000 7f2a2effd640 1 -- 172.21.15.5:0/152604079 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f2a400188b0 con 0x5601585a4390 2024-08-31T05:41:05.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.220+0000 7f2a5c151740 10 client.28108 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:41:05.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.220+0000 7f2a5c151740 10 client.28108 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-31T05:41:05.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.220+0000 7f2a5c151740 20 client.28108 populate_metadata read hostname 'smithi005' 2024-08-31T05:41:05.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.220+0000 7f2a5c151740 1 --2- 172.21.15.5:0/152604079 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x560158558da0 0x5601589f4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:05.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.220+0000 7f2a5c151740 4 client.28108 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:41:05.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.220+0000 7f2a5c151740 1 -- 172.21.15.5:0/152604079 --> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5601588df070 con 0x560158558da0 2024-08-31T05:41:05.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.220+0000 7f2a46ffd640 1 --2- 172.21.15.5:0/152604079 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x560158558da0 0x5601589f4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:05.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.221+0000 7f2a2effd640 10 client.28108 ms_handle_connect on v2:172.21.15.70:6836/2780036414 2024-08-31T05:41:05.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.221+0000 7f2a46ffd640 1 --2- 172.21.15.5:0/152604079 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x560158558da0 0x5601589f4950 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e9606305488beff7 server_cookie=9c59847c00ae2bc3 in_seq=0 out_seq=0 2024-08-31T05:41:05.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.221+0000 7f2a2effd640 1 -- 172.21.15.5:0/152604079 <== mds.2 v2:172.21.15.70:6836/2780036414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5601588df070 con 0x560158558da0 2024-08-31T05:41:05.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.221+0000 7f2a2effd640 10 client.28108 handle_command_reply: tid=0 2024-08-31T05:41:05.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.221+0000 7f2a5c151740 1 client.28108 shutdown 2024-08-31T05:41:05.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.221+0000 7f2a5c151740 1 -- 172.21.15.5:0/152604079 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5601585a4390 msgr2=0x560158979790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:05.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.221+0000 7f2a5c151740 1 --2- 172.21.15.5:0/152604079 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5601585a4390 0x560158979790 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2a4000e990 tx=0x7f2a40004f60 comp rx=0 tx=0).stop 2024-08-31T05:41:05.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.221+0000 7f2a5c151740 1 -- 172.21.15.5:0/152604079 shutdown_connections 2024-08-31T05:41:05.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.221+0000 7f2a5c151740 1 --2- 172.21.15.5:0/152604079 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x560158558da0 0x5601589f4950 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:05.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.221+0000 7f2a5c151740 1 --2- 172.21.15.5:0/152604079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5601585c5070 0x560158979cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:05.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.221+0000 7f2a5c151740 1 --2- 172.21.15.5:0/152604079 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5601585a4390 0x560158979790 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:05.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.221+0000 7f2a2effd640 0 client.28108 ms_handle_reset on v2:172.21.15.70:6836/2780036414 2024-08-31T05:41:05.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.221+0000 7f2a5c151740 1 --2- 172.21.15.5:0/152604079 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56015859c1b0 0x56015897e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:05.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.221+0000 7f2a5c151740 1 -- 172.21.15.5:0/152604079 >> 172.21.15.5:0/152604079 conn(0x5601585b9460 msgr2=0x56015896d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:05.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.222+0000 7f2a5c151740 1 -- 172.21.15.5:0/152604079 shutdown_connections 2024-08-31T05:41:05.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.222+0000 7f2a5c151740 1 -- 172.21.15.5:0/152604079 wait complete. 2024-08-31T05:41:05.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.222+0000 7f2a5c151740 20 client.28108 trim_cache size 0 max 16384 2024-08-31T05:41:05.230 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:41:05.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.223+0000 7f2a55bdc640 1 -- 172.21.15.5:0/4102857660 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2a3c0b4ca0 msgr2=0x7f2a3c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:05.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.223+0000 7f2a55bdc640 1 --2- 172.21.15.5:0/4102857660 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2a3c0b4ca0 0x7f2a3c0b71b0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2a48033ff0 tx=0x7f2a48003f10 comp rx=0 tx=0).stop 2024-08-31T05:41:05.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.223+0000 7f2a55bdc640 1 -- 172.21.15.5:0/4102857660 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a5010db90 msgr2=0x7f2a50102f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:05.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.223+0000 7f2a55bdc640 1 --2- 172.21.15.5:0/4102857660 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a5010db90 0x7f2a50102f70 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2a4802ade0 tx=0x7f2a48031660 comp rx=0 tx=0).stop 2024-08-31T05:41:05.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.223+0000 7f2a55bdc640 1 -- 172.21.15.5:0/4102857660 shutdown_connections 2024-08-31T05:41:05.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.223+0000 7f2a55bdc640 1 --2- 172.21.15.5:0/4102857660 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2a3c0b4ca0 0x7f2a3c0b71b0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:05.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.223+0000 7f2a55bdc640 1 --2- 172.21.15.5:0/4102857660 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a5010db90 0x7f2a50102f70 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:05.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.223+0000 7f2a55bdc640 1 --2- 172.21.15.5:0/4102857660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a50105010 0x7f2a50102a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:05.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.223+0000 7f2a55bdc640 1 --2- 172.21.15.5:0/4102857660 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2a501045e0 0x7f2a501024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:05.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.223+0000 7f2a55bdc640 1 -- 172.21.15.5:0/4102857660 >> 172.21.15.5:0/4102857660 conn(0x7f2a500794d0 msgr2=0x7f2a501066f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:05.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.223+0000 7f2a55bdc640 1 -- 172.21.15.5:0/4102857660 shutdown_connections 2024-08-31T05:41:05.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:05.223+0000 7f2a55bdc640 1 -- 172.21.15.5:0/4102857660 wait complete. 2024-08-31T05:41:05.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:41:04 smithi070 ceph-mon[22316]: pgmap v687: 129 pgs: 129 active+clean; 594 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.6 MiB/s wr, 238 op/s 2024-08-31T05:41:05.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:41:04 smithi050 ceph-mon[22146]: pgmap v687: 129 pgs: 129 active+clean; 594 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.6 MiB/s wr, 238 op/s 2024-08-31T05:41:05.938 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1250897 10.87 MB/sec execute 473 sec latency 20.161 ms 2024-08-31T05:41:05.959 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T05:41:06.089 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.086+0000 7fb046551640 1 -- 172.21.15.5:0/3151468539 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0401092e0 msgr2=0x7fb0401096f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:06.089 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.086+0000 7fb046551640 1 --2- 172.21.15.5:0/3151468539 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0401092e0 0x7fb0401096f0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fb034009900 tx=0x7fb03402a410 comp rx=0 tx=0).stop 2024-08-31T05:41:06.089 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.087+0000 7fb046551640 1 -- 172.21.15.5:0/3151468539 shutdown_connections 2024-08-31T05:41:06.089 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.087+0000 7fb046551640 1 --2- 172.21.15.5:0/3151468539 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb040109c30 0x7fb040110460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.090 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.087+0000 7fb046551640 1 --2- 172.21.15.5:0/3151468539 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0401092e0 0x7fb0401096f0 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.090 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.087+0000 7fb046551640 1 --2- 172.21.15.5:0/3151468539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0401038a0 0x7fb040103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.090 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.087+0000 7fb046551640 1 -- 172.21.15.5:0/3151468539 >> 172.21.15.5:0/3151468539 conn(0x7fb0400ff2c0 msgr2=0x7fb040101710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:06.090 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.087+0000 7fb046551640 1 -- 172.21.15.5:0/3151468539 shutdown_connections 2024-08-31T05:41:06.090 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.087+0000 7fb046551640 1 -- 172.21.15.5:0/3151468539 wait complete. 2024-08-31T05:41:06.090 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.087+0000 7fb046551640 1 Processor -- start 2024-08-31T05:41:06.090 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.087+0000 7fb046551640 1 -- start start 2024-08-31T05:41:06.092 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.088+0000 7fb046551640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb0401038a0 0x7fb0400754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:06.092 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.088+0000 7fb046551640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0401092e0 0x7fb0400759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:06.092 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.088+0000 7fb046551640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb040109c30 0x7fb040075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:06.092 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.088+0000 7fb046551640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb0401138f0 con 0x7fb040109c30 2024-08-31T05:41:06.092 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.088+0000 7fb046551640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb040113770 con 0x7fb0401092e0 2024-08-31T05:41:06.092 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.088+0000 7fb046551640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb040113a70 con 0x7fb0401038a0 2024-08-31T05:41:06.092 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.088+0000 7fb044aee640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb040109c30 0x7fb040075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:06.092 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.088+0000 7fb03ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb0401038a0 0x7fb0400754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:06.092 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.088+0000 7fb03f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0401092e0 0x7fb0400759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:06.093 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.088+0000 7fb03ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb0401038a0 0x7fb0400754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:43714/0 (socket says 172.21.15.5:43714) 2024-08-31T05:41:06.093 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.088+0000 7fb044aee640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb040109c30 0x7fb040075f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44778/0 (socket says 172.21.15.5:44778) 2024-08-31T05:41:06.093 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.088+0000 7fb03ffff640 1 -- 172.21.15.5:0/2668360997 learned_addr learned my addr 172.21.15.5:0/2668360997 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:06.093 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.088+0000 7fb044aee640 1 -- 172.21.15.5:0/2668360997 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb0401038a0 msgr2=0x7fb0400754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:06.093 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.088+0000 7fb044aee640 1 --2- 172.21.15.5:0/2668360997 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb0401038a0 0x7fb0400754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.093 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.088+0000 7fb044aee640 1 -- 172.21.15.5:0/2668360997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0401092e0 msgr2=0x7fb0400759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:06.093 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.088+0000 7fb044aee640 1 --2- 172.21.15.5:0/2668360997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0401092e0 0x7fb0400759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.093 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.088+0000 7fb044aee640 1 -- 172.21.15.5:0/2668360997 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0401a85a0 con 0x7fb040109c30 2024-08-31T05:41:06.093 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.088+0000 7fb03ffff640 1 --2- 172.21.15.5:0/2668360997 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb0401038a0 0x7fb0400754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:41:06.093 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.088+0000 7fb044aee640 1 --2- 172.21.15.5:0/2668360997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb040109c30 0x7fb040075f30 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fb03800ec50 tx=0x7fb03800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:06.093 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.089+0000 7fb03d7fa640 1 -- 172.21.15.5:0/2668360997 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb038003b70 con 0x7fb040109c30 2024-08-31T05:41:06.093 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.089+0000 7fb03d7fa640 1 -- 172.21.15.5:0/2668360997 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb038003d10 con 0x7fb040109c30 2024-08-31T05:41:06.093 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.089+0000 7fb046551640 1 -- 172.21.15.5:0/2668360997 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0401a8890 con 0x7fb040109c30 2024-08-31T05:41:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.089+0000 7fb03d7fa640 1 -- 172.21.15.5:0/2668360997 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb038010830 con 0x7fb040109c30 2024-08-31T05:41:06.094 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.089+0000 7fb046551640 1 -- 172.21.15.5:0/2668360997 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0401a8d60 con 0x7fb040109c30 2024-08-31T05:41:06.097 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.091+0000 7fb04d4b8740 1 Processor -- start 2024-08-31T05:41:06.097 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.092+0000 7fb03d7fa640 1 -- 172.21.15.5:0/2668360997 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fb038003fa0 con 0x7fb040109c30 2024-08-31T05:41:06.097 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.092+0000 7fb04d4b8740 1 -- start start 2024-08-31T05:41:06.097 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.092+0000 7fb04d4b8740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55921a4231b0 0x55921a7c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:06.097 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.092+0000 7fb04d4b8740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55921a3fa2f0 0x55921a7c7000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:06.097 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.092+0000 7fb04d4b8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55921a4024d0 0x55921a7c7540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:06.097 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.092+0000 7fb04d4b8740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55921a73c000 con 0x55921a3fa2f0 2024-08-31T05:41:06.097 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.092+0000 7fb04d4b8740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55921a72b590 con 0x55921a4231b0 2024-08-31T05:41:06.098 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.092+0000 7fb04d4b8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55921a72f540 con 0x55921a4024d0 2024-08-31T05:41:06.098 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.093+0000 7fb03f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55921a4231b0 0x55921a7c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:06.098 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.093+0000 7fb03f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55921a4231b0 0x55921a7c6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:59236/0 (socket says 172.21.15.5:59236) 2024-08-31T05:41:06.098 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.093+0000 7fb03ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55921a3fa2f0 0x55921a7c7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:06.098 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.093+0000 7fb03f7fe640 1 -- 172.21.15.5:0/1069672662 learned_addr learned my addr 172.21.15.5:0/1069672662 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:06.098 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.093+0000 7fb03f7fe640 1 --2- 172.21.15.5:0/1069672662 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55921a4024d0 0x55921a7c7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:06.098 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.093+0000 7fb03ffff640 1 -- 172.21.15.5:0/1069672662 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55921a4024d0 msgr2=0x55921a7c7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:06.098 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.093+0000 7fb03ffff640 1 --2- 172.21.15.5:0/1069672662 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55921a4024d0 0x55921a7c7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.098 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.093+0000 7fb03ffff640 1 -- 172.21.15.5:0/1069672662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55921a4231b0 msgr2=0x55921a7c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:06.098 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.093+0000 7fb03ffff640 1 --2- 172.21.15.5:0/1069672662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55921a4231b0 0x55921a7c6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.098 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.093+0000 7fb03ffff640 1 -- 172.21.15.5:0/1069672662 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55921a48e790 con 0x55921a3fa2f0 2024-08-31T05:41:06.099 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.093+0000 7fb03d7fa640 1 --2- 172.21.15.5:0/2668360997 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb0280b4cd0 0x7fb0280b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:06.099 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.093+0000 7fb03ffff640 1 --2- 172.21.15.5:0/1069672662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55921a3fa2f0 0x55921a7c7000 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fb030009fd0 tx=0x7fb0300119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=938448cf55819d57 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:06.099 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.093+0000 7fb03f7fe640 1 --2- 172.21.15.5:0/2668360997 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb0280b4cd0 0x7fb0280b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:06.099 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.093+0000 7fb03d7fa640 1 -- 172.21.15.5:0/2668360997 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9599+0+0 (secure 0 0 0) 0x7fb0380e5e80 con 0x7fb040109c30 2024-08-31T05:41:06.099 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.093+0000 7fb0267fc640 1 -- 172.21.15.5:0/1069672662 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb030004020 con 0x55921a3fa2f0 2024-08-31T05:41:06.099 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.093+0000 7fb0267fc640 1 -- 172.21.15.5:0/1069672662 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb0300054d0 con 0x55921a3fa2f0 2024-08-31T05:41:06.099 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.093+0000 7fb0267fc640 1 -- 172.21.15.5:0/1069672662 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb030004ca0 con 0x55921a3fa2f0 2024-08-31T05:41:06.099 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.094+0000 7fb04d4b8740 1 -- 172.21.15.5:0/1069672662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55921a3fa2f0 msgr2=0x55921a7c7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:06.099 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.094+0000 7fb04d4b8740 1 --2- 172.21.15.5:0/1069672662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55921a3fa2f0 0x55921a7c7000 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fb030009fd0 tx=0x7fb0300119a0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.099 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.094+0000 7fb03f7fe640 1 --2- 172.21.15.5:0/2668360997 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb0280b4cd0 0x7fb0280b71e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fb0340096c0 tx=0x7fb034000bc0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:06.099 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.094+0000 7fb04d4b8740 1 -- 172.21.15.5:0/1069672662 shutdown_connections 2024-08-31T05:41:06.099 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.094+0000 7fb04d4b8740 1 --2- 172.21.15.5:0/1069672662 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55921a4024d0 0x55921a7c7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.099 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.094+0000 7fb04d4b8740 1 --2- 172.21.15.5:0/1069672662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55921a3fa2f0 0x55921a7c7000 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.094+0000 7fb04d4b8740 1 --2- 172.21.15.5:0/1069672662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55921a4231b0 0x55921a7c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.094+0000 7fb04d4b8740 1 -- 172.21.15.5:0/1069672662 >> 172.21.15.5:0/1069672662 conn(0x55921a417300 msgr2=0x55921a7c49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.094+0000 7fb04d4b8740 1 -- 172.21.15.5:0/1069672662 shutdown_connections 2024-08-31T05:41:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.094+0000 7fb04d4b8740 1 -- 172.21.15.5:0/1069672662 wait complete. 2024-08-31T05:41:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.095+0000 7fb04d4b8740 1 -- start start 2024-08-31T05:41:06.100 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.095+0000 7fb04d4b8740 1 Processor -- start 2024-08-31T05:41:06.103 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.095+0000 7fb04d4b8740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55921a3fa2f0 0x55921a7d2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:06.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.095+0000 7fb04d4b8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55921a4024d0 0x55921a7d2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:06.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.095+0000 7fb04d4b8740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55921a4231b0 0x55921a7de590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:06.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.095+0000 7fb04d4b8740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55921a664ab0 con 0x55921a3fa2f0 2024-08-31T05:41:06.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.095+0000 7fb04d4b8740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55921a6b2680 con 0x55921a4231b0 2024-08-31T05:41:06.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.095+0000 7fb04d4b8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55921a7d5240 con 0x55921a4024d0 2024-08-31T05:41:06.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.095+0000 7fb04d4b8740 10 client.0 _ll_register_callbacks cb 0x55921a43aa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:41:06.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.096+0000 7fb03ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55921a3fa2f0 0x55921a7d2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:06.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.096+0000 7fb03ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55921a3fa2f0 0x55921a7d2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44796/0 (socket says 172.21.15.5:44796) 2024-08-31T05:41:06.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.096+0000 7fb03ffff640 1 -- 172.21.15.5:0/267343727 learned_addr learned my addr 172.21.15.5:0/267343727 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:06.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.096+0000 7fb03f7fe640 1 --2- 172.21.15.5:0/267343727 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55921a4024d0 0x55921a7d2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:06.104 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.096+0000 7fb044aee640 1 --2- 172.21.15.5:0/267343727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55921a4231b0 0x55921a7de590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:06.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.096+0000 7fb03ffff640 1 -- 172.21.15.5:0/267343727 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55921a4024d0 msgr2=0x55921a7d2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:06.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.096+0000 7fb03ffff640 1 --2- 172.21.15.5:0/267343727 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55921a4024d0 0x55921a7d2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.096+0000 7fb03ffff640 1 -- 172.21.15.5:0/267343727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55921a4231b0 msgr2=0x55921a7de590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:06.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.096+0000 7fb03ffff640 1 --2- 172.21.15.5:0/267343727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55921a4231b0 0x55921a7de590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.096+0000 7fb03ffff640 1 -- 172.21.15.5:0/267343727 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55921a507620 con 0x55921a3fa2f0 2024-08-31T05:41:06.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.096+0000 7fb044aee640 1 --2- 172.21.15.5:0/267343727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55921a4231b0 0x55921a7de590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:41:06.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.096+0000 7fb03ffff640 1 --2- 172.21.15.5:0/267343727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55921a3fa2f0 0x55921a7d2620 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fb030000c00 tx=0x7fb03000fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35fb359d270d910d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:06.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.096+0000 7fb01f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:41:06.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.096+0000 7fb01f7fe640 1 -- 172.21.15.5:0/267343727 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb030028020 con 0x55921a3fa2f0 2024-08-31T05:41:06.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.096+0000 7fb01f7fe640 1 -- 172.21.15.5:0/267343727 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9599+0+0 (secure 0 0 0) 0x7fb0300049e0 con 0x55921a3fa2f0 2024-08-31T05:41:06.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.096+0000 7fb04d4b8740 1 -- 172.21.15.5:0/267343727 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0300054d0 con 0x55921a3fa2f0 2024-08-31T05:41:06.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.097+0000 7fb01f7fe640 1 -- 172.21.15.5:0/267343727 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fb030033050 con 0x55921a3fa2f0 2024-08-31T05:41:06.105 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.097+0000 7fb04d4b8740 10 client.18537 fetch_fsmap learned FSMap version 34 2024-08-31T05:41:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.097+0000 7fb04d4b8740 1 -- 172.21.15.5:0/267343727 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55921a7e1260 con 0x55921a3fa2f0 2024-08-31T05:41:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.097+0000 7fb01f7fe640 1 -- 172.21.15.5:0/267343727 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb0300054d0 con 0x55921a3fa2f0 2024-08-31T05:41:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.097+0000 7fb01f7fe640 1 -- 172.21.15.5:0/267343727 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fb030023470 con 0x55921a3fa2f0 2024-08-31T05:41:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.097+0000 7fb04d4b8740 10 client.18537 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:41:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.097+0000 7fb04d4b8740 10 client.18537 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:41:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.097+0000 7fb04d4b8740 20 client.18537 populate_metadata read hostname 'smithi005' 2024-08-31T05:41:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.097+0000 7fb04d4b8740 1 --2- 172.21.15.5:0/267343727 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55921a3e1d80 0x55921a7e46d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.097+0000 7fb04d4b8740 4 client.18537 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:41:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.097+0000 7fb04d4b8740 1 -- 172.21.15.5:0/267343727 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55921a73df50 con 0x55921a3e1d80 2024-08-31T05:41:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.097+0000 7fb03f7fe640 1 --2- 172.21.15.5:0/267343727 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55921a3e1d80 0x55921a7e46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.098+0000 7fb01f7fe640 10 client.18537 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:41:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.098+0000 7fb03f7fe640 1 --2- 172.21.15.5:0/267343727 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55921a3e1d80 0x55921a7e46d0 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19d4e4b6e8941e0c server_cookie=7bd4724c01e7b53b in_seq=0 out_seq=0 2024-08-31T05:41:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.099+0000 7fb01f7fe640 1 -- 172.21.15.5:0/267343727 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55921a73df50 con 0x55921a3e1d80 2024-08-31T05:41:06.106 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.099+0000 7fb01f7fe640 10 client.18537 handle_command_reply: tid=0 2024-08-31T05:41:06.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.099+0000 7fb04d4b8740 1 client.18537 shutdown 2024-08-31T05:41:06.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.099+0000 7fb04d4b8740 1 -- 172.21.15.5:0/267343727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55921a3fa2f0 msgr2=0x55921a7d2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:06.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.099+0000 7fb04d4b8740 1 --2- 172.21.15.5:0/267343727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55921a3fa2f0 0x55921a7d2620 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fb030000c00 tx=0x7fb03000fc80 comp rx=0 tx=0).stop 2024-08-31T05:41:06.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.099+0000 7fb04d4b8740 1 -- 172.21.15.5:0/267343727 shutdown_connections 2024-08-31T05:41:06.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.099+0000 7fb04d4b8740 1 --2- 172.21.15.5:0/267343727 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55921a3e1d80 0x55921a7e46d0 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.099+0000 7fb04d4b8740 1 --2- 172.21.15.5:0/267343727 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55921a4231b0 0x55921a7de590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.099+0000 7fb01f7fe640 0 client.18537 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:41:06.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.099+0000 7fb04d4b8740 1 --2- 172.21.15.5:0/267343727 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55921a4024d0 0x55921a7d2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.099+0000 7fb04d4b8740 1 --2- 172.21.15.5:0/267343727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55921a3fa2f0 0x55921a7d2620 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.099+0000 7fb04d4b8740 1 -- 172.21.15.5:0/267343727 >> 172.21.15.5:0/267343727 conn(0x55921a417300 msgr2=0x55921a7c7af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:06.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.099+0000 7fb04d4b8740 1 -- 172.21.15.5:0/267343727 shutdown_connections 2024-08-31T05:41:06.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.099+0000 7fb04d4b8740 1 -- 172.21.15.5:0/267343727 wait complete. 2024-08-31T05:41:06.107 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.099+0000 7fb04d4b8740 20 client.18537 trim_cache size 0 max 16384 2024-08-31T05:41:06.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.114+0000 7fb04d4b8740 1 Processor -- start 2024-08-31T05:41:06.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.114+0000 7fb04d4b8740 1 -- start start 2024-08-31T05:41:06.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.115+0000 7fb04d4b8740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55921a3fa2f0 0x55921a7cc290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:06.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.115+0000 7fb04d4b8740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55921a4024d0 0x55921a7cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:06.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.115+0000 7fb04d4b8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55921a4231b0 0x55921a7cfb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:06.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.115+0000 7fb04d4b8740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb0401b3020 con 0x55921a4024d0 2024-08-31T05:41:06.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.115+0000 7fb04d4b8740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb0401b4b60 con 0x55921a3fa2f0 2024-08-31T05:41:06.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.115+0000 7fb04d4b8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb0401b36f0 con 0x55921a4231b0 2024-08-31T05:41:06.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.115+0000 7fb03f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55921a4024d0 0x55921a7cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:06.118 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.115+0000 7fb03f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55921a4024d0 0x55921a7cf5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44802/0 (socket says 172.21.15.5:44802) 2024-08-31T05:41:06.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.115+0000 7fb03f7fe640 1 -- 172.21.15.5:0/378404023 learned_addr learned my addr 172.21.15.5:0/378404023 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:06.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.115+0000 7fb03ffff640 1 --2- 172.21.15.5:0/378404023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55921a3fa2f0 0x55921a7cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:06.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.115+0000 7fb044aee640 1 --2- 172.21.15.5:0/378404023 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55921a4231b0 0x55921a7cfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:06.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.115+0000 7fb03f7fe640 1 -- 172.21.15.5:0/378404023 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55921a4231b0 msgr2=0x55921a7cfb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:06.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.115+0000 7fb03f7fe640 1 --2- 172.21.15.5:0/378404023 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55921a4231b0 0x55921a7cfb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.115+0000 7fb03f7fe640 1 -- 172.21.15.5:0/378404023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55921a3fa2f0 msgr2=0x55921a7cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:06.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.115+0000 7fb03f7fe640 1 --2- 172.21.15.5:0/378404023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55921a3fa2f0 0x55921a7cc290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.115+0000 7fb03f7fe640 1 -- 172.21.15.5:0/378404023 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55921a7c8ff0 con 0x55921a4024d0 2024-08-31T05:41:06.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.115+0000 7fb03ffff640 1 --2- 172.21.15.5:0/378404023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55921a3fa2f0 0x55921a7cc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:41:06.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.115+0000 7fb03f7fe640 1 --2- 172.21.15.5:0/378404023 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55921a4024d0 0x55921a7cf5e0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fb04006a560 tx=0x7fb034009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebf4241aa30fc353 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:06.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.116+0000 7fb025ffb640 1 -- 172.21.15.5:0/378404023 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb034035040 con 0x55921a4024d0 2024-08-31T05:41:06.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.116+0000 7fb025ffb640 1 -- 172.21.15.5:0/378404023 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb034004430 con 0x55921a4024d0 2024-08-31T05:41:06.119 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.116+0000 7fb025ffb640 1 -- 172.21.15.5:0/378404023 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb034004d70 con 0x55921a4024d0 2024-08-31T05:41:06.122 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.116+0000 7fb04d4b8740 1 -- 172.21.15.5:0/378404023 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55921a4024d0 msgr2=0x55921a7cf5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:06.122 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.116+0000 7fb04d4b8740 1 --2- 172.21.15.5:0/378404023 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55921a4024d0 0x55921a7cf5e0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fb04006a560 tx=0x7fb034009260 comp rx=0 tx=0).stop 2024-08-31T05:41:06.123 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.117+0000 7fb04d4b8740 1 -- 172.21.15.5:0/378404023 shutdown_connections 2024-08-31T05:41:06.123 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.117+0000 7fb04d4b8740 1 --2- 172.21.15.5:0/378404023 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55921a4231b0 0x55921a7cfb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.123 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.117+0000 7fb04d4b8740 1 --2- 172.21.15.5:0/378404023 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55921a4024d0 0x55921a7cf5e0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.123 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.117+0000 7fb04d4b8740 1 --2- 172.21.15.5:0/378404023 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55921a3fa2f0 0x55921a7cc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.123 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.117+0000 7fb04d4b8740 1 -- 172.21.15.5:0/378404023 >> 172.21.15.5:0/378404023 conn(0x55921a417300 msgr2=0x55921a7cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:06.123 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.117+0000 7fb04d4b8740 1 -- 172.21.15.5:0/378404023 shutdown_connections 2024-08-31T05:41:06.123 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.117+0000 7fb04d4b8740 1 -- 172.21.15.5:0/378404023 wait complete. 2024-08-31T05:41:06.123 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.117+0000 7fb04d4b8740 1 -- start start 2024-08-31T05:41:06.123 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.117+0000 7fb04d4b8740 1 Processor -- start 2024-08-31T05:41:06.123 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.117+0000 7fb04d4b8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55921a3fa2f0 0x55921a7dada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:06.123 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.117+0000 7fb04d4b8740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55921a4024d0 0x55921a7d8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:06.123 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.117+0000 7fb04d4b8740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55921a4231b0 0x55921a7d8860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:06.123 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.117+0000 7fb04d4b8740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb0401b4490 con 0x55921a4231b0 2024-08-31T05:41:06.124 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.117+0000 7fb04d4b8740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb0401b3dc0 con 0x55921a4024d0 2024-08-31T05:41:06.124 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.117+0000 7fb04d4b8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb0401b1020 con 0x55921a3fa2f0 2024-08-31T05:41:06.124 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.118+0000 7fb04d4b8740 10 client.0 _ll_register_callbacks cb 0x7fb0380093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:41:06.124 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.118+0000 7fb044aee640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55921a4231b0 0x55921a7d8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:06.124 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.118+0000 7fb03ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55921a3fa2f0 0x55921a7dada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:06.124 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.118+0000 7fb044aee640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55921a4231b0 0x55921a7d8860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44812/0 (socket says 172.21.15.5:44812) 2024-08-31T05:41:06.124 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.118+0000 7fb044aee640 1 -- 172.21.15.5:0/4215953737 learned_addr learned my addr 172.21.15.5:0/4215953737 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:06.124 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.118+0000 7fb03f7fe640 1 --2- 172.21.15.5:0/4215953737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55921a4024d0 0x55921a7d8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:06.124 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.118+0000 7fb044aee640 1 -- 172.21.15.5:0/4215953737 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55921a3fa2f0 msgr2=0x55921a7dada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:06.124 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.118+0000 7fb044aee640 1 --2- 172.21.15.5:0/4215953737 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55921a3fa2f0 0x55921a7dada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.124 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.118+0000 7fb044aee640 1 -- 172.21.15.5:0/4215953737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55921a4024d0 msgr2=0x55921a7d8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:06.124 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.118+0000 7fb044aee640 1 --2- 172.21.15.5:0/4215953737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55921a4024d0 0x55921a7d8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.118+0000 7fb044aee640 1 -- 172.21.15.5:0/4215953737 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55921a7d8ff0 con 0x55921a4231b0 2024-08-31T05:41:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.118+0000 7fb03ffff640 1 --2- 172.21.15.5:0/4215953737 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55921a3fa2f0 0x55921a7dada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:41:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.118+0000 7fb044aee640 1 --2- 172.21.15.5:0/4215953737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55921a4231b0 0x55921a7d8860 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fb0380cf0d0 tx=0x7fb038004590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cacd6c2bbdc3c6f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.118+0000 7fb01f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:41:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.120+0000 7fb01f7fe640 1 -- 172.21.15.5:0/4215953737 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb038009820 con 0x55921a4231b0 2024-08-31T05:41:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.120+0000 7fb01f7fe640 1 -- 172.21.15.5:0/4215953737 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9599+0+0 (secure 0 0 0) 0x7fb0380a7cc0 con 0x55921a4231b0 2024-08-31T05:41:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.120+0000 7fb04d4b8740 1 -- 172.21.15.5:0/4215953737 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb034004430 con 0x55921a4231b0 2024-08-31T05:41:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.120+0000 7fb01f7fe640 1 -- 172.21.15.5:0/4215953737 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fb038004660 con 0x55921a4231b0 2024-08-31T05:41:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.120+0000 7fb04d4b8740 10 client.18543 fetch_fsmap learned FSMap version 34 2024-08-31T05:41:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.120+0000 7fb04d4b8740 1 -- 172.21.15.5:0/4215953737 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55921a84efc0 con 0x55921a4231b0 2024-08-31T05:41:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.120+0000 7fb01f7fe640 1 -- 172.21.15.5:0/4215953737 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb034004430 con 0x55921a4231b0 2024-08-31T05:41:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.120+0000 7fb01f7fe640 1 -- 172.21.15.5:0/4215953737 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fb0380aae10 con 0x55921a4231b0 2024-08-31T05:41:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.120+0000 7fb04d4b8740 10 client.18543 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:41:06.125 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.120+0000 7fb04d4b8740 10 client.18543 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:41:06.126 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.120+0000 7fb04d4b8740 20 client.18543 populate_metadata read hostname 'smithi005' 2024-08-31T05:41:06.126 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.120+0000 7fb04d4b8740 1 --2- 172.21.15.5:0/4215953737 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55921a3b71c0 0x55921a851750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:06.126 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.120+0000 7fb04d4b8740 4 client.18543 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:41:06.126 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.120+0000 7fb04d4b8740 1 -- 172.21.15.5:0/4215953737 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55921a7399f0 con 0x55921a3b71c0 2024-08-31T05:41:06.126 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.120+0000 7fb03ffff640 1 --2- 172.21.15.5:0/4215953737 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55921a3b71c0 0x55921a851750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:06.126 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.121+0000 7fb01f7fe640 10 client.18543 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:41:06.126 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.121+0000 7fb03ffff640 1 --2- 172.21.15.5:0/4215953737 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55921a3b71c0 0x55921a851750 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e34557d72e022468 server_cookie=7c979eee9a2a0622 in_seq=0 out_seq=0 2024-08-31T05:41:06.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.135+0000 7fb01f7fe640 1 -- 172.21.15.5:0/4215953737 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55921a7399f0 con 0x55921a3b71c0 2024-08-31T05:41:06.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.135+0000 7fb01f7fe640 10 client.18543 handle_command_reply: tid=0 2024-08-31T05:41:06.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.135+0000 7fb04d4b8740 1 client.18543 shutdown 2024-08-31T05:41:06.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.135+0000 7fb04d4b8740 1 -- 172.21.15.5:0/4215953737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55921a4231b0 msgr2=0x55921a7d8860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:06.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.135+0000 7fb04d4b8740 1 --2- 172.21.15.5:0/4215953737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55921a4231b0 0x55921a7d8860 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fb0380cf0d0 tx=0x7fb038004590 comp rx=0 tx=0).stop 2024-08-31T05:41:06.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.135+0000 7fb04d4b8740 1 -- 172.21.15.5:0/4215953737 shutdown_connections 2024-08-31T05:41:06.140 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.135+0000 7fb04d4b8740 1 --2- 172.21.15.5:0/4215953737 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55921a3b71c0 0x55921a851750 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.141 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.135+0000 7fb04d4b8740 1 --2- 172.21.15.5:0/4215953737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55921a4231b0 0x55921a7d8860 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.141 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.135+0000 7fb04d4b8740 1 --2- 172.21.15.5:0/4215953737 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55921a4024d0 0x55921a7d8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.141 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.135+0000 7fb04d4b8740 1 --2- 172.21.15.5:0/4215953737 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55921a3fa2f0 0x55921a7dada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.141 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.135+0000 7fb04d4b8740 1 -- 172.21.15.5:0/4215953737 >> 172.21.15.5:0/4215953737 conn(0x55921a417300 msgr2=0x55921a7d36d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:06.141 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.135+0000 7fb01f7fe640 0 client.18543 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:41:06.141 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.135+0000 7fb04d4b8740 1 -- 172.21.15.5:0/4215953737 shutdown_connections 2024-08-31T05:41:06.141 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.135+0000 7fb04d4b8740 1 -- 172.21.15.5:0/4215953737 wait complete. 2024-08-31T05:41:06.141 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.135+0000 7fb04d4b8740 20 client.18543 trim_cache size 0 max 16384 2024-08-31T05:41:06.141 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:41:06.141 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:41:06.142 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:41:06.142 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:41:06.142 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.136+0000 7fb046551640 1 -- 172.21.15.5:0/2668360997 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb0280b4cd0 msgr2=0x7fb0280b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:06.142 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.136+0000 7fb046551640 1 --2- 172.21.15.5:0/2668360997 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb0280b4cd0 0x7fb0280b71e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fb0340096c0 tx=0x7fb034000bc0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.143 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.136+0000 7fb046551640 1 -- 172.21.15.5:0/2668360997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb040109c30 msgr2=0x7fb040075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:06.143 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.136+0000 7fb046551640 1 --2- 172.21.15.5:0/2668360997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb040109c30 0x7fb040075f30 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fb03800ec50 tx=0x7fb03800c6a0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.143 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.136+0000 7fb046551640 1 -- 172.21.15.5:0/2668360997 shutdown_connections 2024-08-31T05:41:06.143 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.136+0000 7fb046551640 1 --2- 172.21.15.5:0/2668360997 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb0280b4cd0 0x7fb0280b71e0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.143 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.136+0000 7fb046551640 1 --2- 172.21.15.5:0/2668360997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb040109c30 0x7fb040075f30 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.143 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.136+0000 7fb046551640 1 --2- 172.21.15.5:0/2668360997 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb0401092e0 0x7fb0400759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.143 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.136+0000 7fb046551640 1 --2- 172.21.15.5:0/2668360997 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb0401038a0 0x7fb0400754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.143 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.136+0000 7fb046551640 1 -- 172.21.15.5:0/2668360997 >> 172.21.15.5:0/2668360997 conn(0x7fb0400ff2c0 msgr2=0x7fb0401016e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:06.143 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.136+0000 7fb046551640 1 -- 172.21.15.5:0/2668360997 shutdown_connections 2024-08-31T05:41:06.143 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:06.136+0000 7fb046551640 1 -- 172.21.15.5:0/2668360997 wait complete. 2024-08-31T05:41:06.240 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:41:06.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.723+0000 7fa003507640 1 -- 172.21.15.5:0/1823621712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ffc109bb0 msgr2=0x7f9ffc1103e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:06.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.723+0000 7fa003507640 1 --2- 172.21.15.5:0/1823621712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ffc109bb0 0x7f9ffc1103e0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4009ca0 tx=0x7f9ff402a8c0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.723+0000 7fa003507640 1 -- 172.21.15.5:0/1823621712 shutdown_connections 2024-08-31T05:41:06.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.723+0000 7fa003507640 1 --2- 172.21.15.5:0/1823621712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ffc109bb0 0x7f9ffc1103e0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.723+0000 7fa003507640 1 --2- 172.21.15.5:0/1823621712 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ffc109260 0x7f9ffc109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.723+0000 7fa003507640 1 --2- 172.21.15.5:0/1823621712 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ffc103920 0x7f9ffc103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.723+0000 7fa003507640 1 -- 172.21.15.5:0/1823621712 >> 172.21.15.5:0/1823621712 conn(0x7f9ffc0ff3b0 msgr2=0x7f9ffc101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:06.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.723+0000 7fa003507640 1 -- 172.21.15.5:0/1823621712 shutdown_connections 2024-08-31T05:41:06.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.723+0000 7fa003507640 1 -- 172.21.15.5:0/1823621712 wait complete. 2024-08-31T05:41:06.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.724+0000 7fa003507640 1 Processor -- start 2024-08-31T05:41:06.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.724+0000 7fa003507640 1 -- start start 2024-08-31T05:41:06.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.724+0000 7fa003507640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ffc103920 0x7f9ffc19a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:06.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.724+0000 7fa003507640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ffc109260 0x7f9ffc19a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:06.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.724+0000 7fa003507640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ffc109bb0 0x7f9ffc19fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:06.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.724+0000 7fa003507640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9ffc113870 con 0x7f9ffc109260 2024-08-31T05:41:06.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.724+0000 7fa003507640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9ffc1136f0 con 0x7f9ffc103920 2024-08-31T05:41:06.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.724+0000 7fa003507640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9ffc1139f0 con 0x7f9ffc109bb0 2024-08-31T05:41:06.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.724+0000 7fa000aa2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ffc109260 0x7f9ffc19a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:06.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.724+0000 7fa000aa2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ffc109260 0x7f9ffc19a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44820/0 (socket says 172.21.15.5:44820) 2024-08-31T05:41:06.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.724+0000 7fa000aa2640 1 -- 172.21.15.5:0/3654082735 learned_addr learned my addr 172.21.15.5:0/3654082735 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:06.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.725+0000 7fa001aa4640 1 --2- 172.21.15.5:0/3654082735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ffc109bb0 0x7f9ffc19fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:06.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.725+0000 7fa0012a3640 1 --2- 172.21.15.5:0/3654082735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ffc103920 0x7f9ffc19a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:06.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.725+0000 7fa000aa2640 1 -- 172.21.15.5:0/3654082735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ffc109bb0 msgr2=0x7f9ffc19fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:06.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.725+0000 7fa000aa2640 1 --2- 172.21.15.5:0/3654082735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ffc109bb0 0x7f9ffc19fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.725+0000 7fa000aa2640 1 -- 172.21.15.5:0/3654082735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ffc103920 msgr2=0x7f9ffc19a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:06.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.725+0000 7fa000aa2640 1 --2- 172.21.15.5:0/3654082735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ffc103920 0x7f9ffc19a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.725+0000 7fa000aa2640 1 -- 172.21.15.5:0/3654082735 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ffc1a0130 con 0x7f9ffc109260 2024-08-31T05:41:06.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.725+0000 7fa0012a3640 1 --2- 172.21.15.5:0/3654082735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ffc103920 0x7f9ffc19a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:41:06.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.725+0000 7fa000aa2640 1 --2- 172.21.15.5:0/3654082735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ffc109260 0x7f9ffc19a760 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f9fec00e9f0 tx=0x7f9fec00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:06.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.725+0000 7f9ff27fc640 1 -- 172.21.15.5:0/3654082735 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fec00ccc0 con 0x7f9ffc109260 2024-08-31T05:41:06.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.726+0000 7f9ff27fc640 1 -- 172.21.15.5:0/3654082735 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9fec0108e0 con 0x7f9ffc109260 2024-08-31T05:41:06.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.726+0000 7f9ff27fc640 1 -- 172.21.15.5:0/3654082735 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fec018860 con 0x7f9ffc109260 2024-08-31T05:41:06.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.726+0000 7fa003507640 1 -- 172.21.15.5:0/3654082735 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ffc1a0420 con 0x7f9ffc109260 2024-08-31T05:41:06.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.726+0000 7fa003507640 1 -- 172.21.15.5:0/3654082735 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ffc075390 con 0x7f9ffc109260 2024-08-31T05:41:06.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.729+0000 7fa009a7c740 1 Processor -- start 2024-08-31T05:41:06.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.729+0000 7fa009a7c740 1 -- start start 2024-08-31T05:41:06.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.729+0000 7fa009a7c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e97a48c070 0x55e97a831350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:06.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.729+0000 7fa009a7c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e97a4631b0 0x55e97a831890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:06.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.729+0000 7fa009a7c740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e97a46b390 0x55e97a831dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:06.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.729+0000 7fa009a7c740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55e97a7a8680 con 0x55e97a46b390 2024-08-31T05:41:06.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.729+0000 7fa009a7c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e97a797c10 con 0x55e97a4631b0 2024-08-31T05:41:06.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.729+0000 7fa009a7c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e97a79bbc0 con 0x55e97a48c070 2024-08-31T05:41:06.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.730+0000 7fa0012a3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e97a4631b0 0x55e97a831890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:06.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.730+0000 7fa0012a3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e97a4631b0 0x55e97a831890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:59306/0 (socket says 172.21.15.5:59306) 2024-08-31T05:41:06.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.730+0000 7fa0012a3640 1 -- 172.21.15.5:0/2795652303 learned_addr learned my addr 172.21.15.5:0/2795652303 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:06.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.730+0000 7f9ff27fc640 1 -- 172.21.15.5:0/3654082735 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f9fec010430 con 0x7f9ffc109260 2024-08-31T05:41:06.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.730+0000 7fa001aa4640 1 --2- 172.21.15.5:0/2795652303 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e97a48c070 0x55e97a831350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:06.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.730+0000 7fa000aa2640 1 --2- 172.21.15.5:0/2795652303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e97a46b390 0x55e97a831dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:06.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.730+0000 7fa0012a3640 1 -- 172.21.15.5:0/2795652303 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e97a48c070 msgr2=0x55e97a831350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:06.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.730+0000 7fa0012a3640 1 --2- 172.21.15.5:0/2795652303 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e97a48c070 0x55e97a831350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.730+0000 7fa0012a3640 1 -- 172.21.15.5:0/2795652303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e97a46b390 msgr2=0x55e97a831dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:06.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.730+0000 7fa0012a3640 1 --2- 172.21.15.5:0/2795652303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e97a46b390 0x55e97a831dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.730+0000 7fa0012a3640 1 -- 172.21.15.5:0/2795652303 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e97a4f7650 con 0x55e97a4631b0 2024-08-31T05:41:06.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.730+0000 7fa000aa2640 1 --2- 172.21.15.5:0/2795652303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e97a46b390 0x55e97a831dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:41:06.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.731+0000 7f9ff27fc640 1 --2- 172.21.15.5:0/3654082735 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9fe80b91b0 0x7f9fe80bb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:06.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.731+0000 7fa0012a3640 1 --2- 172.21.15.5:0/2795652303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e97a4631b0 0x55e97a831890 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9ff80115f0 tx=0x7f9ff8011ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=320413340b01dfa2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:06.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.731+0000 7fa001aa4640 1 --2- 172.21.15.5:0/3654082735 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9fe80b91b0 0x7f9fe80bb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:06.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.731+0000 7f9ff27fc640 1 -- 172.21.15.5:0/3654082735 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9599+0+0 (secure 0 0 0) 0x7f9fec0e5c30 con 0x7f9ffc109260 2024-08-31T05:41:06.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.731+0000 7f9fe77fe640 1 -- 172.21.15.5:0/2795652303 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff801e070 con 0x55e97a4631b0 2024-08-31T05:41:06.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.731+0000 7f9fe77fe640 1 -- 172.21.15.5:0/2795652303 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ff800faf0 con 0x55e97a4631b0 2024-08-31T05:41:06.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.732+0000 7f9fe77fe640 1 -- 172.21.15.5:0/2795652303 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff8019bc0 con 0x55e97a4631b0 2024-08-31T05:41:06.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.732+0000 7fa009a7c740 1 -- 172.21.15.5:0/2795652303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e97a4631b0 msgr2=0x55e97a831890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:06.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.732+0000 7fa001aa4640 1 --2- 172.21.15.5:0/3654082735 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9fe80b91b0 0x7f9fe80bb6c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f9ff402f500 tx=0x7f9ff402f310 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:06.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.732+0000 7fa009a7c740 1 --2- 172.21.15.5:0/2795652303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e97a4631b0 0x55e97a831890 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9ff80115f0 tx=0x7f9ff8011ab0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.732+0000 7fa009a7c740 1 -- 172.21.15.5:0/2795652303 shutdown_connections 2024-08-31T05:41:06.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.732+0000 7fa009a7c740 1 --2- 172.21.15.5:0/2795652303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e97a46b390 0x55e97a831dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.732+0000 7fa009a7c740 1 --2- 172.21.15.5:0/2795652303 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e97a4631b0 0x55e97a831890 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.732+0000 7fa009a7c740 1 --2- 172.21.15.5:0/2795652303 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e97a48c070 0x55e97a831350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.732+0000 7fa009a7c740 1 -- 172.21.15.5:0/2795652303 >> 172.21.15.5:0/2795652303 conn(0x55e97a480460 msgr2=0x55e97a82f240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:06.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.732+0000 7fa009a7c740 1 -- 172.21.15.5:0/2795652303 shutdown_connections 2024-08-31T05:41:06.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.732+0000 7fa009a7c740 1 -- 172.21.15.5:0/2795652303 wait complete. 2024-08-31T05:41:06.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.733+0000 7fa009a7c740 1 -- start start 2024-08-31T05:41:06.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.733+0000 7fa009a7c740 1 Processor -- start 2024-08-31T05:41:06.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.733+0000 7fa009a7c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e97a4631b0 0x55e97a83ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:06.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.733+0000 7fa009a7c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e97a46b390 0x55e97a83cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:06.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.733+0000 7fa009a7c740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e97a48c070 0x55e97a848ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:06.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.733+0000 7fa009a7c740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55e97a5fa700 con 0x55e97a48c070 2024-08-31T05:41:06.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.733+0000 7fa009a7c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e97a71e750 con 0x55e97a4631b0 2024-08-31T05:41:06.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.733+0000 7fa009a7c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e97a83fbd0 con 0x55e97a46b390 2024-08-31T05:41:06.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.733+0000 7fa009a7c740 10 client.0 _ll_register_callbacks cb 0x55e97a74de10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:41:06.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.734+0000 7fa001aa4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e97a48c070 0x55e97a848ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:06.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.734+0000 7fa000aa2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e97a46b390 0x55e97a83cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:06.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.734+0000 7fa0012a3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e97a4631b0 0x55e97a83ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:06.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.734+0000 7fa0012a3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e97a4631b0 0x55e97a83ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:59320/0 (socket says 172.21.15.5:59320) 2024-08-31T05:41:06.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.734+0000 7fa000aa2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e97a46b390 0x55e97a83cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:43784/0 (socket says 172.21.15.5:43784) 2024-08-31T05:41:06.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.734+0000 7fa0012a3640 1 -- 172.21.15.5:0/281707696 learned_addr learned my addr 172.21.15.5:0/281707696 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:06.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.734+0000 7fa0012a3640 1 -- 172.21.15.5:0/281707696 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e97a46b390 msgr2=0x55e97a83cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:06.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.734+0000 7fa0012a3640 1 --2- 172.21.15.5:0/281707696 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e97a46b390 0x55e97a83cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.734+0000 7fa0012a3640 1 -- 172.21.15.5:0/281707696 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e97a48c070 msgr2=0x55e97a848ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:06.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.734+0000 7fa0012a3640 1 --2- 172.21.15.5:0/281707696 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e97a48c070 0x55e97a848ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.734+0000 7fa0012a3640 1 -- 172.21.15.5:0/281707696 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e97a757900 con 0x55e97a4631b0 2024-08-31T05:41:06.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.734+0000 7fa000aa2640 1 --2- 172.21.15.5:0/281707696 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e97a46b390 0x55e97a83cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:41:06.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.734+0000 7fa0012a3640 1 --2- 172.21.15.5:0/281707696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e97a4631b0 0x55e97a83ca70 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9ff80198a0 tx=0x7f9ff8005da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5bbb542d6071a18 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:06.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.734+0000 7f9fe4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:41:06.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.734+0000 7f9fe4ff9640 1 -- 172.21.15.5:0/281707696 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff801e040 con 0x55e97a4631b0 2024-08-31T05:41:06.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.734+0000 7fa009a7c740 1 -- 172.21.15.5:0/281707696 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ff800faf0 con 0x55e97a4631b0 2024-08-31T05:41:06.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.734+0000 7f9fe4ff9640 1 -- 172.21.15.5:0/281707696 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9599+0+0 (secure 0 0 0) 0x7f9ff800f640 con 0x55e97a4631b0 2024-08-31T05:41:06.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.735+0000 7f9fe4ff9640 1 -- 172.21.15.5:0/281707696 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f9ff802f050 con 0x55e97a4631b0 2024-08-31T05:41:06.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.735+0000 7fa009a7c740 10 client.28115 fetch_fsmap learned FSMap version 34 2024-08-31T05:41:06.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.735+0000 7fa009a7c740 1 -- 172.21.15.5:0/281707696 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55e97a84b970 con 0x55e97a4631b0 2024-08-31T05:41:06.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.735+0000 7f9fe4ff9640 1 -- 172.21.15.5:0/281707696 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ff800faf0 con 0x55e97a4631b0 2024-08-31T05:41:06.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.735+0000 7f9fe4ff9640 1 -- 172.21.15.5:0/281707696 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f9ff802a030 con 0x55e97a4631b0 2024-08-31T05:41:06.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.735+0000 7fa009a7c740 10 client.28115 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:41:06.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.735+0000 7fa009a7c740 10 client.28115 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-31T05:41:06.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.735+0000 7fa009a7c740 20 client.28115 populate_metadata read hostname 'smithi005' 2024-08-31T05:41:06.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.735+0000 7fa009a7c740 1 --2- 172.21.15.5:0/281707696 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55e97a44a9f0 0x55e97a84ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:06.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.735+0000 7fa009a7c740 4 client.28115 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:41:06.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.735+0000 7fa009a7c740 1 -- 172.21.15.5:0/281707696 --> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e97a7aa5d0 con 0x55e97a44a9f0 2024-08-31T05:41:06.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.735+0000 7fa000aa2640 1 --2- 172.21.15.5:0/281707696 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55e97a44a9f0 0x55e97a84ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:06.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.736+0000 7f9fe4ff9640 10 client.28115 ms_handle_connect on v2:172.21.15.50:6838/98200944 2024-08-31T05:41:06.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.736+0000 7fa000aa2640 1 --2- 172.21.15.5:0/281707696 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55e97a44a9f0 0x55e97a84ed30 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=abf4ea22889e130c server_cookie=27067ce919cc01ae in_seq=0 out_seq=0 2024-08-31T05:41:06.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.736+0000 7f9fe4ff9640 1 -- 172.21.15.5:0/281707696 <== mds.1 v2:172.21.15.50:6838/98200944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e97a7aa5d0 con 0x55e97a44a9f0 2024-08-31T05:41:06.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.736+0000 7f9fe4ff9640 10 client.28115 handle_command_reply: tid=0 2024-08-31T05:41:06.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.736+0000 7fa009a7c740 1 client.28115 shutdown 2024-08-31T05:41:06.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.737+0000 7fa009a7c740 1 -- 172.21.15.5:0/281707696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e97a4631b0 msgr2=0x55e97a83ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:06.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.737+0000 7fa009a7c740 1 --2- 172.21.15.5:0/281707696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e97a4631b0 0x55e97a83ca70 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9ff80198a0 tx=0x7f9ff8005da0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.737+0000 7fa009a7c740 1 -- 172.21.15.5:0/281707696 shutdown_connections 2024-08-31T05:41:06.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.737+0000 7fa009a7c740 1 --2- 172.21.15.5:0/281707696 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55e97a44a9f0 0x55e97a84ed30 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.737+0000 7fa009a7c740 1 --2- 172.21.15.5:0/281707696 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e97a48c070 0x55e97a848ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.737+0000 7fa009a7c740 1 --2- 172.21.15.5:0/281707696 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e97a46b390 0x55e97a83cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.737+0000 7f9fe4ff9640 0 client.28115 ms_handle_reset on v2:172.21.15.50:6838/98200944 2024-08-31T05:41:06.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.737+0000 7fa009a7c740 1 --2- 172.21.15.5:0/281707696 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e97a4631b0 0x55e97a83ca70 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.737+0000 7fa009a7c740 1 -- 172.21.15.5:0/281707696 >> 172.21.15.5:0/281707696 conn(0x55e97a480460 msgr2=0x55e97a832d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:06.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.737+0000 7fa009a7c740 1 -- 172.21.15.5:0/281707696 shutdown_connections 2024-08-31T05:41:06.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.737+0000 7fa009a7c740 1 -- 172.21.15.5:0/281707696 wait complete. 2024-08-31T05:41:06.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.737+0000 7fa009a7c740 20 client.28115 trim_cache size 0 max 16384 2024-08-31T05:41:06.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.751+0000 7fa009a7c740 1 Processor -- start 2024-08-31T05:41:06.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.751+0000 7fa009a7c740 1 -- start start 2024-08-31T05:41:06.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.751+0000 7fa009a7c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e97a4631b0 0x55e97a82a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:06.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.751+0000 7fa009a7c740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e97a46b390 0x55e97a83b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:06.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.751+0000 7fa009a7c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e97a48c070 0x55e97a83b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:06.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.751+0000 7fa009a7c740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9ffc1aecb0 con 0x55e97a46b390 2024-08-31T05:41:06.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.751+0000 7fa009a7c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9ffc1b07f0 con 0x55e97a48c070 2024-08-31T05:41:06.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.751+0000 7fa009a7c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9ffc1af380 con 0x55e97a4631b0 2024-08-31T05:41:06.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.751+0000 7fa0012a3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e97a4631b0 0x55e97a82a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:06.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.751+0000 7fa0012a3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e97a4631b0 0x55e97a82a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:43794/0 (socket says 172.21.15.5:43794) 2024-08-31T05:41:06.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.751+0000 7fa0012a3640 1 -- 172.21.15.5:0/3533244439 learned_addr learned my addr 172.21.15.5:0/3533244439 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:06.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.751+0000 7fa000aa2640 1 --2- 172.21.15.5:0/3533244439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e97a46b390 0x55e97a83b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:06.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.751+0000 7fa001aa4640 1 --2- 172.21.15.5:0/3533244439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e97a48c070 0x55e97a83b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:06.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.751+0000 7fa0012a3640 1 -- 172.21.15.5:0/3533244439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e97a48c070 msgr2=0x55e97a83b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:06.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.751+0000 7fa0012a3640 1 --2- 172.21.15.5:0/3533244439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e97a48c070 0x55e97a83b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.751+0000 7fa0012a3640 1 -- 172.21.15.5:0/3533244439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e97a46b390 msgr2=0x55e97a83b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:06.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.751+0000 7fa0012a3640 1 --2- 172.21.15.5:0/3533244439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e97a46b390 0x55e97a83b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.751+0000 7fa0012a3640 1 -- 172.21.15.5:0/3533244439 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e97a84f190 con 0x55e97a4631b0 2024-08-31T05:41:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.752+0000 7fa0012a3640 1 --2- 172.21.15.5:0/3533244439 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e97a4631b0 0x55e97a82a270 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8005d70 tx=0x7f9ff8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b44cf75580e9d9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.752+0000 7f9fe6ffd640 1 -- 172.21.15.5:0/3533244439 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff801e070 con 0x55e97a4631b0 2024-08-31T05:41:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.752+0000 7f9fe6ffd640 1 -- 172.21.15.5:0/3533244439 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ff800faf0 con 0x55e97a4631b0 2024-08-31T05:41:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.752+0000 7f9fe6ffd640 1 -- 172.21.15.5:0/3533244439 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff8003d10 con 0x55e97a4631b0 2024-08-31T05:41:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.753+0000 7fa009a7c740 1 -- 172.21.15.5:0/3533244439 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e97a4631b0 msgr2=0x55e97a82a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.753+0000 7fa009a7c740 1 --2- 172.21.15.5:0/3533244439 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e97a4631b0 0x55e97a82a270 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8005d70 tx=0x7f9ff8009b50 comp rx=0 tx=0).stop 2024-08-31T05:41:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.753+0000 7fa009a7c740 1 -- 172.21.15.5:0/3533244439 shutdown_connections 2024-08-31T05:41:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.753+0000 7fa009a7c740 1 --2- 172.21.15.5:0/3533244439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e97a48c070 0x55e97a83b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.753+0000 7fa009a7c740 1 --2- 172.21.15.5:0/3533244439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e97a46b390 0x55e97a83b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.753+0000 7fa009a7c740 1 --2- 172.21.15.5:0/3533244439 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e97a4631b0 0x55e97a82a270 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.753+0000 7fa009a7c740 1 -- 172.21.15.5:0/3533244439 >> 172.21.15.5:0/3533244439 conn(0x55e97a480460 msgr2=0x55e97a837bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:06.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.753+0000 7fa009a7c740 1 -- 172.21.15.5:0/3533244439 shutdown_connections 2024-08-31T05:41:06.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.753+0000 7fa009a7c740 1 -- 172.21.15.5:0/3533244439 wait complete. 2024-08-31T05:41:06.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.753+0000 7fa009a7c740 1 -- start start 2024-08-31T05:41:06.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.753+0000 7fa009a7c740 1 Processor -- start 2024-08-31T05:41:06.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.754+0000 7fa009a7c740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e97a4631b0 0x55e97a845840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:06.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.754+0000 7fa009a7c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e97a46b390 0x55e97a840d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:06.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.754+0000 7fa009a7c740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e97a48c070 0x55e97a841440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:06.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.754+0000 7fa009a7c740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9ffc1b0120 con 0x55e97a4631b0 2024-08-31T05:41:06.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.754+0000 7fa009a7c740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9ffc1afa50 con 0x55e97a48c070 2024-08-31T05:41:06.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.754+0000 7fa009a7c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9ffc1accb0 con 0x55e97a46b390 2024-08-31T05:41:06.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.754+0000 7fa009a7c740 10 client.0 _ll_register_callbacks cb 0x7f9ff801c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:41:06.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.754+0000 7fa0012a3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e97a4631b0 0x55e97a845840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:06.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.754+0000 7fa000aa2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e97a46b390 0x55e97a840d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:06.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.754+0000 7fa0012a3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e97a4631b0 0x55e97a845840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44848/0 (socket says 172.21.15.5:44848) 2024-08-31T05:41:06.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.754+0000 7fa000aa2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e97a46b390 0x55e97a840d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:43802/0 (socket says 172.21.15.5:43802) 2024-08-31T05:41:06.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.754+0000 7fa0012a3640 1 -- 172.21.15.5:0/3448433003 learned_addr learned my addr 172.21.15.5:0/3448433003 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:06.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.754+0000 7fa001aa4640 1 --2- 172.21.15.5:0/3448433003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e97a48c070 0x55e97a841440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:06.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.754+0000 7fa001aa4640 1 -- 172.21.15.5:0/3448433003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e97a46b390 msgr2=0x55e97a840d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:06.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.754+0000 7fa001aa4640 1 --2- 172.21.15.5:0/3448433003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e97a46b390 0x55e97a840d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.754+0000 7fa001aa4640 1 -- 172.21.15.5:0/3448433003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e97a4631b0 msgr2=0x55e97a845840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:06.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.754+0000 7fa001aa4640 1 --2- 172.21.15.5:0/3448433003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e97a4631b0 0x55e97a845840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.754+0000 7fa001aa4640 1 -- 172.21.15.5:0/3448433003 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e97a8b8610 con 0x55e97a48c070 2024-08-31T05:41:06.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.755+0000 7fa000aa2640 1 --2- 172.21.15.5:0/3448433003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e97a46b390 0x55e97a840d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:41:06.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.755+0000 7fa001aa4640 1 --2- 172.21.15.5:0/3448433003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e97a48c070 0x55e97a841440 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4006010 tx=0x7f9ff40095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=617f313344f2fdfe server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:06.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.755+0000 7f9fe4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:41:06.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.755+0000 7f9fe4ff9640 1 -- 172.21.15.5:0/3448433003 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff4058060 con 0x55e97a48c070 2024-08-31T05:41:06.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.755+0000 7f9fe4ff9640 1 -- 172.21.15.5:0/3448433003 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9599+0+0 (secure 0 0 0) 0x7f9ff4004040 con 0x55e97a48c070 2024-08-31T05:41:06.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.755+0000 7fa009a7c740 1 -- 172.21.15.5:0/3448433003 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ff800faf0 con 0x55e97a48c070 2024-08-31T05:41:06.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.755+0000 7f9fe4ff9640 1 -- 172.21.15.5:0/3448433003 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f9ff405f050 con 0x55e97a48c070 2024-08-31T05:41:06.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.755+0000 7fa009a7c740 10 client.28121 fetch_fsmap learned FSMap version 34 2024-08-31T05:41:06.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.755+0000 7fa009a7c740 1 -- 172.21.15.5:0/3448433003 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55e97a8b9760 con 0x55e97a48c070 2024-08-31T05:41:06.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.755+0000 7f9fe4ff9640 1 -- 172.21.15.5:0/3448433003 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ff800faf0 con 0x55e97a48c070 2024-08-31T05:41:06.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.755+0000 7f9fe4ff9640 1 -- 172.21.15.5:0/3448433003 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f9ff402fb20 con 0x55e97a48c070 2024-08-31T05:41:06.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.755+0000 7fa009a7c740 10 client.28121 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:41:06.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.756+0000 7fa009a7c740 10 client.28121 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-31T05:41:06.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.756+0000 7fa009a7c740 20 client.28121 populate_metadata read hostname 'smithi005' 2024-08-31T05:41:06.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.756+0000 7fa009a7c740 1 --2- 172.21.15.5:0/3448433003 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55e97a41fda0 0x55e97a8bbf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:06.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.756+0000 7fa009a7c740 4 client.28121 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:41:06.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.756+0000 7fa009a7c740 1 -- 172.21.15.5:0/3448433003 --> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e97a7a6070 con 0x55e97a41fda0 2024-08-31T05:41:06.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.756+0000 7fa0012a3640 1 --2- 172.21.15.5:0/3448433003 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55e97a41fda0 0x55e97a8bbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:06.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.756+0000 7fa0012a3640 1 --2- 172.21.15.5:0/3448433003 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55e97a41fda0 0x55e97a8bbf50 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c482559c7f7f2ecc server_cookie=192ff80253c753b6 in_seq=0 out_seq=0 2024-08-31T05:41:06.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.756+0000 7f9fe4ff9640 10 client.28121 ms_handle_connect on v2:172.21.15.50:6838/98200944 2024-08-31T05:41:06.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.756+0000 7f9fe4ff9640 1 -- 172.21.15.5:0/3448433003 <== mds.1 v2:172.21.15.50:6838/98200944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e97a7a6070 con 0x55e97a41fda0 2024-08-31T05:41:06.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.756+0000 7f9fe4ff9640 10 client.28121 handle_command_reply: tid=0 2024-08-31T05:41:06.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.756+0000 7fa009a7c740 1 client.28121 shutdown 2024-08-31T05:41:06.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.757+0000 7fa009a7c740 1 -- 172.21.15.5:0/3448433003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e97a48c070 msgr2=0x55e97a841440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:06.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.757+0000 7fa009a7c740 1 --2- 172.21.15.5:0/3448433003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e97a48c070 0x55e97a841440 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4006010 tx=0x7f9ff40095c0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.757+0000 7fa009a7c740 1 -- 172.21.15.5:0/3448433003 shutdown_connections 2024-08-31T05:41:06.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.757+0000 7fa009a7c740 1 --2- 172.21.15.5:0/3448433003 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55e97a41fda0 0x55e97a8bbf50 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.757+0000 7fa009a7c740 1 --2- 172.21.15.5:0/3448433003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e97a48c070 0x55e97a841440 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.757+0000 7f9fe4ff9640 0 client.28121 ms_handle_reset on v2:172.21.15.50:6838/98200944 2024-08-31T05:41:06.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.757+0000 7fa009a7c740 1 --2- 172.21.15.5:0/3448433003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e97a46b390 0x55e97a840d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.757+0000 7fa009a7c740 1 --2- 172.21.15.5:0/3448433003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e97a4631b0 0x55e97a845840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.757+0000 7fa009a7c740 1 -- 172.21.15.5:0/3448433003 >> 172.21.15.5:0/3448433003 conn(0x55e97a480460 msgr2=0x55e97a83af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:06.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.757+0000 7fa009a7c740 1 -- 172.21.15.5:0/3448433003 shutdown_connections 2024-08-31T05:41:06.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.757+0000 7fa009a7c740 1 -- 172.21.15.5:0/3448433003 wait complete. 2024-08-31T05:41:06.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.757+0000 7fa009a7c740 20 client.28121 trim_cache size 0 max 16384 2024-08-31T05:41:06.766 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:41:06.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.758+0000 7fa003507640 1 -- 172.21.15.5:0/3654082735 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9fe80b91b0 msgr2=0x7f9fe80bb6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:06.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.758+0000 7fa003507640 1 --2- 172.21.15.5:0/3654082735 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9fe80b91b0 0x7f9fe80bb6c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f9ff402f500 tx=0x7f9ff402f310 comp rx=0 tx=0).stop 2024-08-31T05:41:06.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.758+0000 7fa003507640 1 -- 172.21.15.5:0/3654082735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ffc109260 msgr2=0x7f9ffc19a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:06.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.758+0000 7fa003507640 1 --2- 172.21.15.5:0/3654082735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ffc109260 0x7f9ffc19a760 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f9fec00e9f0 tx=0x7f9fec00eeb0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.758+0000 7fa003507640 1 -- 172.21.15.5:0/3654082735 shutdown_connections 2024-08-31T05:41:06.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.758+0000 7fa003507640 1 --2- 172.21.15.5:0/3654082735 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f9fe80b91b0 0x7f9fe80bb6c0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.758+0000 7fa003507640 1 --2- 172.21.15.5:0/3654082735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ffc109bb0 0x7f9ffc19fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.758+0000 7fa003507640 1 --2- 172.21.15.5:0/3654082735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ffc109260 0x7f9ffc19a760 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.758+0000 7fa003507640 1 --2- 172.21.15.5:0/3654082735 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9ffc103920 0x7f9ffc19a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:06.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.758+0000 7fa003507640 1 -- 172.21.15.5:0/3654082735 >> 172.21.15.5:0/3654082735 conn(0x7f9ffc0ff3b0 msgr2=0x7f9ffc106820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:06.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.758+0000 7fa003507640 1 -- 172.21.15.5:0/3654082735 shutdown_connections 2024-08-31T05:41:06.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:06.758+0000 7fa003507640 1 -- 172.21.15.5:0/3654082735 wait complete. 2024-08-31T05:41:06.938 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1253015 10.87 MB/sec execute 474 sec latency 40.406 ms 2024-08-31T05:41:07.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:41:06 smithi070 ceph-mon[22316]: pgmap v688: 129 pgs: 129 active+clean; 597 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.9 MiB/s wr, 235 op/s 2024-08-31T05:41:07.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:41:06 smithi050 ceph-mon[22146]: pgmap v688: 129 pgs: 129 active+clean; 597 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.9 MiB/s wr, 235 op/s 2024-08-31T05:41:07.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:41:06 smithi005 ceph-mon[18602]: pgmap v688: 129 pgs: 129 active+clean; 597 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.9 MiB/s wr, 235 op/s 2024-08-31T05:41:07.464 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T05:41:07.799 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:41:07.938 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1254424 10.87 MB/sec execute 475 sec latency 95.262 ms 2024-08-31T05:41:08.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.374+0000 7f42af946640 1 -- 172.21.15.5:0/1509812572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42a8104640 msgr2=0x7f42a8104a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:08.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.374+0000 7f42af946640 1 --2- 172.21.15.5:0/1509812572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42a8104640 0x7f42a8104a50 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f42a4009900 tx=0x7f42a402a410 comp rx=0 tx=0).stop 2024-08-31T05:41:08.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.374+0000 7f42af946640 1 -- 172.21.15.5:0/1509812572 shutdown_connections 2024-08-31T05:41:08.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.374+0000 7f42af946640 1 --2- 172.21.15.5:0/1509812572 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42a810dbf0 0x7f42a81100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:08.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.374+0000 7f42af946640 1 --2- 172.21.15.5:0/1509812572 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42a8105070 0x7f42a810d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:08.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.374+0000 7f42af946640 1 --2- 172.21.15.5:0/1509812572 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42a8104640 0x7f42a8104a50 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:08.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.374+0000 7f42af946640 1 -- 172.21.15.5:0/1509812572 >> 172.21.15.5:0/1509812572 conn(0x7f42a80794e0 msgr2=0x7f42a80798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:08.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.374+0000 7f42af946640 1 -- 172.21.15.5:0/1509812572 shutdown_connections 2024-08-31T05:41:08.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.374+0000 7f42af946640 1 -- 172.21.15.5:0/1509812572 wait complete. 2024-08-31T05:41:08.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.375+0000 7f42af946640 1 Processor -- start 2024-08-31T05:41:08.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.375+0000 7f42af946640 1 -- start start 2024-08-31T05:41:08.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.375+0000 7f42af946640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42a8104640 0x7f42a819a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:08.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.375+0000 7f42af946640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42a8105070 0x7f42a819a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:08.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.375+0000 7f42af946640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42a810dbf0 0x7f42a819fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:08.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.375+0000 7f42af946640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f42a8113830 con 0x7f42a810dbf0 2024-08-31T05:41:08.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.375+0000 7f42af946640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f42a81136b0 con 0x7f42a8105070 2024-08-31T05:41:08.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.375+0000 7f42af946640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f42a81139b0 con 0x7f42a8104640 2024-08-31T05:41:08.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.375+0000 7f42adee3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42a810dbf0 0x7f42a819fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:08.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.375+0000 7f42acee1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42a8105070 0x7f42a819a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:08.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.375+0000 7f42adee3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42a810dbf0 0x7f42a819fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44862/0 (socket says 172.21.15.5:44862) 2024-08-31T05:41:08.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.375+0000 7f42acee1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42a8105070 0x7f42a819a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:59362/0 (socket says 172.21.15.5:59362) 2024-08-31T05:41:08.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.375+0000 7f42adee3640 1 -- 172.21.15.5:0/1354921631 learned_addr learned my addr 172.21.15.5:0/1354921631 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:08.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.375+0000 7f42ad6e2640 1 --2- 172.21.15.5:0/1354921631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42a8104640 0x7f42a819a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:08.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.376+0000 7f42adee3640 1 -- 172.21.15.5:0/1354921631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42a8104640 msgr2=0x7f42a819a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:08.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.376+0000 7f42adee3640 1 --2- 172.21.15.5:0/1354921631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42a8104640 0x7f42a819a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:08.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.376+0000 7f42adee3640 1 -- 172.21.15.5:0/1354921631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42a8105070 msgr2=0x7f42a819a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:08.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.376+0000 7f42adee3640 1 --2- 172.21.15.5:0/1354921631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42a8105070 0x7f42a819a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:08.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.376+0000 7f42adee3640 1 -- 172.21.15.5:0/1354921631 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42a81a0190 con 0x7f42a810dbf0 2024-08-31T05:41:08.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.376+0000 7f42adee3640 1 --2- 172.21.15.5:0/1354921631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42a810dbf0 0x7f42a819fa60 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f42a000eb10 tx=0x7f42a000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:08.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.376+0000 7f429e7fc640 1 -- 172.21.15.5:0/1354921631 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a0004b20 con 0x7f42a810dbf0 2024-08-31T05:41:08.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.376+0000 7f42af946640 1 -- 172.21.15.5:0/1354921631 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42a81a0480 con 0x7f42a810dbf0 2024-08-31T05:41:08.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.376+0000 7f429e7fc640 1 -- 172.21.15.5:0/1354921631 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42a0004cc0 con 0x7f42a810dbf0 2024-08-31T05:41:08.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.376+0000 7f429e7fc640 1 -- 172.21.15.5:0/1354921631 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a0010690 con 0x7f42a810dbf0 2024-08-31T05:41:08.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.376+0000 7f42af946640 1 -- 172.21.15.5:0/1354921631 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42a81a6be0 con 0x7f42a810dbf0 2024-08-31T05:41:08.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.379+0000 7f429e7fc640 1 -- 172.21.15.5:0/1354921631 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f42a0005020 con 0x7f42a810dbf0 2024-08-31T05:41:08.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.379+0000 7f42b5ebb740 1 Processor -- start 2024-08-31T05:41:08.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.380+0000 7f42b5ebb740 1 -- start start 2024-08-31T05:41:08.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.380+0000 7f42b5ebb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5612a3f1f070 0x5612a42c4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:08.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.380+0000 7f42b5ebb740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5612a3ef61b0 0x5612a42c4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:08.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.380+0000 7f42b5ebb740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612a3efe390 0x5612a42c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:08.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.380+0000 7f42b5ebb740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5612a423b680 con 0x5612a3ef61b0 2024-08-31T05:41:08.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.380+0000 7f42b5ebb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5612a422ac10 con 0x5612a3f1f070 2024-08-31T05:41:08.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.380+0000 7f42b5ebb740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5612a422ebc0 con 0x5612a3efe390 2024-08-31T05:41:08.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.380+0000 7f42ad6e2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5612a3ef61b0 0x5612a42c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:08.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.380+0000 7f42acee1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5612a3f1f070 0x5612a42c4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:08.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.380+0000 7f429e7fc640 1 --2- 172.21.15.5:0/1354921631 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f42940b4ca0 0x7f42940b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:08.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.380+0000 7f42ad6e2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5612a3ef61b0 0x5612a42c4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44864/0 (socket says 172.21.15.5:44864) 2024-08-31T05:41:08.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.380+0000 7f42ad6e2640 1 -- 172.21.15.5:0/3545540003 learned_addr learned my addr 172.21.15.5:0/3545540003 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:08.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.380+0000 7f42adee3640 1 --2- 172.21.15.5:0/1354921631 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f42940b4ca0 0x7f42940b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:08.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.380+0000 7f42acee1640 1 --2- 172.21.15.5:0/3545540003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612a3efe390 0x5612a42c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:08.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.380+0000 7f429e7fc640 1 -- 172.21.15.5:0/1354921631 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9599+0+0 (secure 0 0 0) 0x7f42a00e5ef0 con 0x7f42a810dbf0 2024-08-31T05:41:08.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.380+0000 7f42acee1640 1 -- 172.21.15.5:0/3545540003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612a3efe390 msgr2=0x5612a42c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:08.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.381+0000 7f42acee1640 1 --2- 172.21.15.5:0/3545540003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612a3efe390 0x5612a42c4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:08.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.381+0000 7f42acee1640 1 -- 172.21.15.5:0/3545540003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5612a3ef61b0 msgr2=0x5612a42c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:08.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.381+0000 7f42acee1640 1 --2- 172.21.15.5:0/3545540003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5612a3ef61b0 0x5612a42c4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:08.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.381+0000 7f42acee1640 1 -- 172.21.15.5:0/3545540003 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612a3f8a650 con 0x5612a3f1f070 2024-08-31T05:41:08.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.381+0000 7f42ad6e2640 1 --2- 172.21.15.5:0/3545540003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5612a3ef61b0 0x5612a42c4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:41:08.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.381+0000 7f42acee1640 1 --2- 172.21.15.5:0/3545540003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5612a3f1f070 0x5612a42c4310 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f42a8102130 tx=0x7f42980096c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b2167106f67a6f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:08.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.381+0000 7f42adee3640 1 --2- 172.21.15.5:0/1354921631 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f42940b4ca0 0x7f42940b71b0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f42a00e3810 tx=0x7f42a0079650 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:08.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.381+0000 7f42937fe640 1 -- 172.21.15.5:0/3545540003 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4298005020 con 0x5612a3f1f070 2024-08-31T05:41:08.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.381+0000 7f42937fe640 1 -- 172.21.15.5:0/3545540003 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42980047a0 con 0x5612a3f1f070 2024-08-31T05:41:08.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.381+0000 7f42937fe640 1 -- 172.21.15.5:0/3545540003 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4298010910 con 0x5612a3f1f070 2024-08-31T05:41:08.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.382+0000 7f42b5ebb740 1 -- 172.21.15.5:0/3545540003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5612a3f1f070 msgr2=0x5612a42c4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:08.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.382+0000 7f42b5ebb740 1 --2- 172.21.15.5:0/3545540003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5612a3f1f070 0x5612a42c4310 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f42a8102130 tx=0x7f42980096c0 comp rx=0 tx=0).stop 2024-08-31T05:41:08.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.382+0000 7f42b5ebb740 1 -- 172.21.15.5:0/3545540003 shutdown_connections 2024-08-31T05:41:08.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.382+0000 7f42b5ebb740 1 --2- 172.21.15.5:0/3545540003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612a3efe390 0x5612a42c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:08.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.382+0000 7f42b5ebb740 1 --2- 172.21.15.5:0/3545540003 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5612a3ef61b0 0x5612a42c4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:08.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.382+0000 7f42b5ebb740 1 --2- 172.21.15.5:0/3545540003 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5612a3f1f070 0x5612a42c4310 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:08.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.382+0000 7f42b5ebb740 1 -- 172.21.15.5:0/3545540003 >> 172.21.15.5:0/3545540003 conn(0x5612a3f13460 msgr2=0x5612a42c2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:08.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.382+0000 7f42b5ebb740 1 -- 172.21.15.5:0/3545540003 shutdown_connections 2024-08-31T05:41:08.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.382+0000 7f42b5ebb740 1 -- 172.21.15.5:0/3545540003 wait complete. 2024-08-31T05:41:08.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.382+0000 7f42b5ebb740 1 -- start start 2024-08-31T05:41:08.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.383+0000 7f42b5ebb740 1 Processor -- start 2024-08-31T05:41:08.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.383+0000 7f42b5ebb740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612a3ef61b0 0x5612a42d3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:08.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.383+0000 7f42b5ebb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5612a3efe390 0x5612a42d4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:08.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.383+0000 7f42b5ebb740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5612a3f1f070 0x5612a42e01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:08.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.383+0000 7f42b5ebb740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5612a408d700 con 0x5612a3f1f070 2024-08-31T05:41:08.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.383+0000 7f42b5ebb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5612a41b1750 con 0x5612a3efe390 2024-08-31T05:41:08.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.383+0000 7f42b5ebb740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5612a42d6e20 con 0x5612a3ef61b0 2024-08-31T05:41:08.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.383+0000 7f42b5ebb740 10 client.0 _ll_register_callbacks cb 0x5612a41e0e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:41:08.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.383+0000 7f42acee1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5612a3f1f070 0x5612a42e01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:08.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.383+0000 7f42acee1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5612a3f1f070 0x5612a42e01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44870/0 (socket says 172.21.15.5:44870) 2024-08-31T05:41:08.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.383+0000 7f42acee1640 1 -- 172.21.15.5:0/4269442835 learned_addr learned my addr 172.21.15.5:0/4269442835 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:08.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.383+0000 7f42ad6e2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5612a3efe390 0x5612a42d4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:08.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.383+0000 7f42acee1640 1 --2- 172.21.15.5:0/4269442835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612a3ef61b0 0x5612a42d3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:08.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.384+0000 7f42acee1640 1 -- 172.21.15.5:0/4269442835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612a3ef61b0 msgr2=0x5612a42d3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:08.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.384+0000 7f42acee1640 1 --2- 172.21.15.5:0/4269442835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612a3ef61b0 0x5612a42d3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:08.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.384+0000 7f42acee1640 1 -- 172.21.15.5:0/4269442835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5612a3efe390 msgr2=0x5612a42d4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:08.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.384+0000 7f42acee1640 1 --2- 172.21.15.5:0/4269442835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5612a3efe390 0x5612a42d4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:08.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.384+0000 7f42acee1640 1 -- 172.21.15.5:0/4269442835 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612a41ea900 con 0x5612a3f1f070 2024-08-31T05:41:08.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.384+0000 7f42ad6e2640 1 --2- 172.21.15.5:0/4269442835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5612a3efe390 0x5612a42d4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:41:08.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.384+0000 7f42acee1640 1 --2- 172.21.15.5:0/4269442835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5612a3f1f070 0x5612a42e01b0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x5612a42d6720 tx=0x7f42980104f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f507d227d4d1050a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:08.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.384+0000 7f4290ff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:41:08.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.384+0000 7f4290ff9640 1 -- 172.21.15.5:0/4269442835 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4298028040 con 0x5612a3f1f070 2024-08-31T05:41:08.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.384+0000 7f4290ff9640 1 -- 172.21.15.5:0/4269442835 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9599+0+0 (secure 0 0 0) 0x7f4298005450 con 0x5612a3f1f070 2024-08-31T05:41:08.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.384+0000 7f42b5ebb740 1 -- 172.21.15.5:0/4269442835 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42980047a0 con 0x5612a3f1f070 2024-08-31T05:41:08.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.384+0000 7f4290ff9640 1 -- 172.21.15.5:0/4269442835 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f4298004020 con 0x5612a3f1f070 2024-08-31T05:41:08.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.384+0000 7f42b5ebb740 10 client.18573 fetch_fsmap learned FSMap version 34 2024-08-31T05:41:08.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.384+0000 7f42b5ebb740 1 -- 172.21.15.5:0/4269442835 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5612a42e2cc0 con 0x5612a3f1f070 2024-08-31T05:41:08.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.385+0000 7f4290ff9640 1 -- 172.21.15.5:0/4269442835 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42980047a0 con 0x5612a3f1f070 2024-08-31T05:41:08.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.385+0000 7f4290ff9640 1 -- 172.21.15.5:0/4269442835 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f429801d020 con 0x5612a3f1f070 2024-08-31T05:41:08.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.385+0000 7f42b5ebb740 10 client.18573 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:41:08.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.385+0000 7f42b5ebb740 10 client.18573 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:41:08.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.385+0000 7f42b5ebb740 20 client.18573 populate_metadata read hostname 'smithi005' 2024-08-31T05:41:08.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.385+0000 7f42b5ebb740 1 --2- 172.21.15.5:0/4269442835 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5612a3edd9f0 0x5612a42e63e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:08.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.385+0000 7f42b5ebb740 4 client.18573 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:41:08.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.385+0000 7f42b5ebb740 1 -- 172.21.15.5:0/4269442835 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5612a423d5d0 con 0x5612a3edd9f0 2024-08-31T05:41:08.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.385+0000 7f42ad6e2640 1 --2- 172.21.15.5:0/4269442835 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5612a3edd9f0 0x5612a42e63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:08.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.385+0000 7f42ad6e2640 1 --2- 172.21.15.5:0/4269442835 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5612a3edd9f0 0x5612a42e63e0 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3766e8bfad05dbe server_cookie=c816fce91a13b415 in_seq=0 out_seq=0 2024-08-31T05:41:08.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.385+0000 7f4290ff9640 10 client.18573 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:41:08.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.386+0000 7f4290ff9640 1 -- 172.21.15.5:0/4269442835 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5612a423d5d0 con 0x5612a3edd9f0 2024-08-31T05:41:08.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.386+0000 7f4290ff9640 10 client.18573 handle_command_reply: tid=0 2024-08-31T05:41:08.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.386+0000 7f42b5ebb740 1 client.18573 shutdown 2024-08-31T05:41:08.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.386+0000 7f42b5ebb740 1 -- 172.21.15.5:0/4269442835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5612a3f1f070 msgr2=0x5612a42e01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:08.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.386+0000 7f42b5ebb740 1 --2- 172.21.15.5:0/4269442835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5612a3f1f070 0x5612a42e01b0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x5612a42d6720 tx=0x7f42980104f0 comp rx=0 tx=0).stop 2024-08-31T05:41:08.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.386+0000 7f42b5ebb740 1 -- 172.21.15.5:0/4269442835 shutdown_connections 2024-08-31T05:41:08.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.386+0000 7f42b5ebb740 1 --2- 172.21.15.5:0/4269442835 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5612a3edd9f0 0x5612a42e63e0 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:08.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.386+0000 7f42b5ebb740 1 --2- 172.21.15.5:0/4269442835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5612a3f1f070 0x5612a42e01b0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:08.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.386+0000 7f42b5ebb740 1 --2- 172.21.15.5:0/4269442835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5612a3efe390 0x5612a42d4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:08.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.386+0000 7f4290ff9640 0 client.18573 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:41:08.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.386+0000 7f42b5ebb740 1 --2- 172.21.15.5:0/4269442835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612a3ef61b0 0x5612a42d3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:08.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.386+0000 7f42b5ebb740 1 -- 172.21.15.5:0/4269442835 >> 172.21.15.5:0/4269442835 conn(0x5612a3f13460 msgr2=0x5612a42c73b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:08.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.387+0000 7f42b5ebb740 1 -- 172.21.15.5:0/4269442835 shutdown_connections 2024-08-31T05:41:08.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.387+0000 7f42b5ebb740 1 -- 172.21.15.5:0/4269442835 wait complete. 2024-08-31T05:41:08.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.387+0000 7f42b5ebb740 20 client.18573 trim_cache size 0 max 16384 2024-08-31T05:41:08.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.402+0000 7f42b5ebb740 1 Processor -- start 2024-08-31T05:41:08.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.402+0000 7f42b5ebb740 1 -- start start 2024-08-31T05:41:08.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.402+0000 7f42b5ebb740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5612a3ef61b0 0x5612a42d44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:08.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.402+0000 7f42b5ebb740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612a3efe390 0x5612a42c73b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:08.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.402+0000 7f42b5ebb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5612a3f1f070 0x5612a42c78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:08.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.402+0000 7f42b5ebb740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f42a81aed20 con 0x5612a3ef61b0 2024-08-31T05:41:08.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.402+0000 7f42b5ebb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f42a81b0860 con 0x5612a3f1f070 2024-08-31T05:41:08.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.402+0000 7f42b5ebb740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f42a81af3f0 con 0x5612a3efe390 2024-08-31T05:41:08.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.402+0000 7f42acee1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5612a3ef61b0 0x5612a42d44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:08.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.403+0000 7f42acee1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5612a3ef61b0 0x5612a42d44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44880/0 (socket says 172.21.15.5:44880) 2024-08-31T05:41:08.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.403+0000 7f42acee1640 1 -- 172.21.15.5:0/212435477 learned_addr learned my addr 172.21.15.5:0/212435477 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:08.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.403+0000 7f42ad6e2640 1 --2- 172.21.15.5:0/212435477 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612a3efe390 0x5612a42c73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:08.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.403+0000 7f42acee1640 1 --2- 172.21.15.5:0/212435477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5612a3f1f070 0x5612a42c78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:08.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.403+0000 7f42acee1640 1 -- 172.21.15.5:0/212435477 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612a3efe390 msgr2=0x5612a42c73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:08.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.403+0000 7f42acee1640 1 --2- 172.21.15.5:0/212435477 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612a3efe390 0x5612a42c73b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:08.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.403+0000 7f42acee1640 1 -- 172.21.15.5:0/212435477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5612a3f1f070 msgr2=0x5612a42c78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:08.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.403+0000 7f42acee1640 1 --2- 172.21.15.5:0/212435477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5612a3f1f070 0x5612a42c78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:08.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.403+0000 7f42acee1640 1 -- 172.21.15.5:0/212435477 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612a42e0950 con 0x5612a3ef61b0 2024-08-31T05:41:08.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.403+0000 7f42acee1640 1 --2- 172.21.15.5:0/212435477 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5612a3ef61b0 0x5612a42d44b0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f42980059f0 tx=0x7f4298009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73cec7b0c9f70b33 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:08.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.403+0000 7f4292ffd640 1 -- 172.21.15.5:0/212435477 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4298004da0 con 0x5612a3ef61b0 2024-08-31T05:41:08.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.403+0000 7f4292ffd640 1 -- 172.21.15.5:0/212435477 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4298013190 con 0x5612a3ef61b0 2024-08-31T05:41:08.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.403+0000 7f4292ffd640 1 -- 172.21.15.5:0/212435477 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42980041c0 con 0x5612a3ef61b0 2024-08-31T05:41:08.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.404+0000 7f42b5ebb740 1 -- 172.21.15.5:0/212435477 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5612a3ef61b0 msgr2=0x5612a42d44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:08.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.404+0000 7f42b5ebb740 1 --2- 172.21.15.5:0/212435477 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5612a3ef61b0 0x5612a42d44b0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f42980059f0 tx=0x7f4298009ed0 comp rx=0 tx=0).stop 2024-08-31T05:41:08.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.404+0000 7f42b5ebb740 1 -- 172.21.15.5:0/212435477 shutdown_connections 2024-08-31T05:41:08.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.404+0000 7f42b5ebb740 1 --2- 172.21.15.5:0/212435477 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5612a3f1f070 0x5612a42c78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:08.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.404+0000 7f42b5ebb740 1 --2- 172.21.15.5:0/212435477 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612a3efe390 0x5612a42c73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:08.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.404+0000 7f42b5ebb740 1 --2- 172.21.15.5:0/212435477 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5612a3ef61b0 0x5612a42d44b0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:08.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.404+0000 7f42b5ebb740 1 -- 172.21.15.5:0/212435477 >> 172.21.15.5:0/212435477 conn(0x5612a3f13460 msgr2=0x5612a42d2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:08.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.404+0000 7f42b5ebb740 1 -- 172.21.15.5:0/212435477 shutdown_connections 2024-08-31T05:41:08.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.404+0000 7f42b5ebb740 1 -- 172.21.15.5:0/212435477 wait complete. 2024-08-31T05:41:08.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.405+0000 7f42b5ebb740 1 -- start start 2024-08-31T05:41:08.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.405+0000 7f42b5ebb740 1 Processor -- start 2024-08-31T05:41:08.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.406+0000 7f42b5ebb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5612a3ef61b0 0x5612a42d79a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:08.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.406+0000 7f42b5ebb740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612a3efe390 0x5612a42d7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:08.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.406+0000 7f42b5ebb740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5612a3f1f070 0x5612a434ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:08.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.406+0000 7f42b5ebb740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f42a81b0190 con 0x5612a3f1f070 2024-08-31T05:41:08.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.406+0000 7f42b5ebb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f42a81afac0 con 0x5612a3ef61b0 2024-08-31T05:41:08.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.406+0000 7f42b5ebb740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f42a81acd20 con 0x5612a3efe390 2024-08-31T05:41:08.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.406+0000 7f42b5ebb740 10 client.0 _ll_register_callbacks cb 0x7f42a00093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:41:08.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.406+0000 7f42acee1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5612a3f1f070 0x5612a434ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:08.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.406+0000 7f42acee1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5612a3ef61b0 0x5612a42d79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:08.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.406+0000 7f42ad6e2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612a3efe390 0x5612a42d7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:08.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.406+0000 7f42acee1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5612a3ef61b0 0x5612a42d79a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:59404/0 (socket says 172.21.15.5:59404) 2024-08-31T05:41:08.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.406+0000 7f42ad6e2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612a3efe390 0x5612a42d7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:43850/0 (socket says 172.21.15.5:43850) 2024-08-31T05:41:08.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.406+0000 7f42acee1640 1 -- 172.21.15.5:0/2622875077 learned_addr learned my addr 172.21.15.5:0/2622875077 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:08.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.406+0000 7f42ad6e2640 1 -- 172.21.15.5:0/2622875077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5612a3ef61b0 msgr2=0x5612a42d79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:08.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.406+0000 7f42ad6e2640 1 --2- 172.21.15.5:0/2622875077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5612a3ef61b0 0x5612a42d79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:08.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.406+0000 7f42ad6e2640 1 -- 172.21.15.5:0/2622875077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5612a3f1f070 msgr2=0x5612a434ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:08.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.406+0000 7f42ad6e2640 1 --2- 172.21.15.5:0/2622875077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5612a3f1f070 0x5612a434ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:08.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.406+0000 7f42ad6e2640 1 -- 172.21.15.5:0/2622875077 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612a434f3d0 con 0x5612a3efe390 2024-08-31T05:41:08.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.406+0000 7f42acee1640 1 --2- 172.21.15.5:0/2622875077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5612a3f1f070 0x5612a434ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:41:08.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.406+0000 7f42ad6e2640 1 --2- 172.21.15.5:0/2622875077 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612a3efe390 0x5612a42d7f80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f42a4006010 tx=0x7f42a4032e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d5884f8a7a2ef44 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:08.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.406+0000 7f4290ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:41:08.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.407+0000 7f4290ff9640 1 -- 172.21.15.5:0/2622875077 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a4035040 con 0x5612a3efe390 2024-08-31T05:41:08.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.407+0000 7f4290ff9640 1 -- 172.21.15.5:0/2622875077 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9599+0+0 (secure 0 0 0) 0x7f42a4005040 con 0x5612a3efe390 2024-08-31T05:41:08.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.407+0000 7f42b5ebb740 1 -- 172.21.15.5:0/2622875077 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4298013190 con 0x5612a3efe390 2024-08-31T05:41:08.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.407+0000 7f4290ff9640 1 -- 172.21.15.5:0/2622875077 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f42a4054050 con 0x5612a3efe390 2024-08-31T05:41:08.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.407+0000 7f42b5ebb740 10 client.28162 fetch_fsmap learned FSMap version 34 2024-08-31T05:41:08.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.407+0000 7f42b5ebb740 1 -- 172.21.15.5:0/2622875077 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5612a43506b0 con 0x5612a3efe390 2024-08-31T05:41:08.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.407+0000 7f4290ff9640 1 -- 172.21.15.5:0/2622875077 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4298013190 con 0x5612a3efe390 2024-08-31T05:41:08.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.407+0000 7f4290ff9640 1 -- 172.21.15.5:0/2622875077 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f42a40035f0 con 0x5612a3efe390 2024-08-31T05:41:08.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.407+0000 7f42b5ebb740 10 client.28162 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:41:08.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.407+0000 7f42b5ebb740 10 client.28162 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:41:08.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.407+0000 7f42b5ebb740 20 client.28162 populate_metadata read hostname 'smithi005' 2024-08-31T05:41:08.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.407+0000 7f42b5ebb740 1 --2- 172.21.15.5:0/2622875077 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5612a3eb2da0 0x5612a4352ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:08.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.407+0000 7f42b5ebb740 4 client.28162 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:41:08.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.407+0000 7f42b5ebb740 1 -- 172.21.15.5:0/2622875077 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5612a4239070 con 0x5612a3eb2da0 2024-08-31T05:41:08.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.408+0000 7f42acee1640 1 --2- 172.21.15.5:0/2622875077 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5612a3eb2da0 0x5612a4352ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:08.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.408+0000 7f42acee1640 1 --2- 172.21.15.5:0/2622875077 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5612a3eb2da0 0x5612a4352ec0 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0d5abf1f4c45320 server_cookie=16a280e332ee0522 in_seq=0 out_seq=0 2024-08-31T05:41:08.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.408+0000 7f4290ff9640 10 client.28162 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:41:08.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.408+0000 7f4290ff9640 1 -- 172.21.15.5:0/2622875077 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5612a4239070 con 0x5612a3eb2da0 2024-08-31T05:41:08.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.408+0000 7f4290ff9640 10 client.28162 handle_command_reply: tid=0 2024-08-31T05:41:08.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.408+0000 7f42b5ebb740 1 client.28162 shutdown 2024-08-31T05:41:08.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.408+0000 7f42b5ebb740 1 -- 172.21.15.5:0/2622875077 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612a3efe390 msgr2=0x5612a42d7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:08.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.408+0000 7f42b5ebb740 1 --2- 172.21.15.5:0/2622875077 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612a3efe390 0x5612a42d7f80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f42a4006010 tx=0x7f42a4032e00 comp rx=0 tx=0).stop 2024-08-31T05:41:08.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.408+0000 7f42b5ebb740 1 -- 172.21.15.5:0/2622875077 shutdown_connections 2024-08-31T05:41:08.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.408+0000 7f42b5ebb740 1 --2- 172.21.15.5:0/2622875077 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5612a3eb2da0 0x5612a4352ec0 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:08.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.408+0000 7f42b5ebb740 1 --2- 172.21.15.5:0/2622875077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5612a3f1f070 0x5612a434ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:08.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.408+0000 7f42b5ebb740 1 --2- 172.21.15.5:0/2622875077 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612a3efe390 0x5612a42d7f80 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:08.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.408+0000 7f42b5ebb740 1 --2- 172.21.15.5:0/2622875077 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5612a3ef61b0 0x5612a42d79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:08.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.409+0000 7f42b5ebb740 1 -- 172.21.15.5:0/2622875077 >> 172.21.15.5:0/2622875077 conn(0x5612a3f13460 msgr2=0x5612a42c73b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:08.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.409+0000 7f4290ff9640 0 client.28162 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:41:08.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.409+0000 7f42b5ebb740 1 -- 172.21.15.5:0/2622875077 shutdown_connections 2024-08-31T05:41:08.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.409+0000 7f42b5ebb740 1 -- 172.21.15.5:0/2622875077 wait complete. 2024-08-31T05:41:08.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.409+0000 7f42b5ebb740 20 client.28162 trim_cache size 0 max 16384 2024-08-31T05:41:08.417 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:41:08.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.409+0000 7f42af946640 1 -- 172.21.15.5:0/1354921631 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f42940b4ca0 msgr2=0x7f42940b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:08.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.409+0000 7f42af946640 1 --2- 172.21.15.5:0/1354921631 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f42940b4ca0 0x7f42940b71b0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f42a00e3810 tx=0x7f42a0079650 comp rx=0 tx=0).stop 2024-08-31T05:41:08.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.409+0000 7f42af946640 1 -- 172.21.15.5:0/1354921631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42a810dbf0 msgr2=0x7f42a819fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:08.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.409+0000 7f42af946640 1 --2- 172.21.15.5:0/1354921631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42a810dbf0 0x7f42a819fa60 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f42a000eb10 tx=0x7f42a000c2d0 comp rx=0 tx=0).stop 2024-08-31T05:41:08.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.410+0000 7f42af946640 1 -- 172.21.15.5:0/1354921631 shutdown_connections 2024-08-31T05:41:08.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.410+0000 7f42af946640 1 --2- 172.21.15.5:0/1354921631 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f42940b4ca0 0x7f42940b71b0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:08.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.410+0000 7f42af946640 1 --2- 172.21.15.5:0/1354921631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42a810dbf0 0x7f42a819fa60 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:08.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.410+0000 7f42af946640 1 --2- 172.21.15.5:0/1354921631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f42a8105070 0x7f42a819a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:08.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.410+0000 7f42af946640 1 --2- 172.21.15.5:0/1354921631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42a8104640 0x7f42a819a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:08.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.410+0000 7f42af946640 1 -- 172.21.15.5:0/1354921631 >> 172.21.15.5:0/1354921631 conn(0x7f42a80794e0 msgr2=0x7f42a8100680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:08.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.410+0000 7f42af946640 1 -- 172.21.15.5:0/1354921631 shutdown_connections 2024-08-31T05:41:08.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:08.410+0000 7f42af946640 1 -- 172.21.15.5:0/1354921631 wait complete. 2024-08-31T05:41:08.938 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1256415 10.87 MB/sec execute 476 sec latency 36.836 ms 2024-08-31T05:41:09.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:41:08 smithi070 ceph-mon[22316]: pgmap v689: 129 pgs: 129 active+clean; 596 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.7 MiB/s wr, 231 op/s 2024-08-31T05:41:09.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:41:08 smithi050 ceph-mon[22146]: pgmap v689: 129 pgs: 129 active+clean; 596 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.7 MiB/s wr, 231 op/s 2024-08-31T05:41:09.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:41:08 smithi005 ceph-mon[18602]: pgmap v689: 129 pgs: 129 active+clean; 596 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.7 MiB/s wr, 231 op/s 2024-08-31T05:41:09.938 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1258314 10.87 MB/sec execute 477 sec latency 13.659 ms 2024-08-31T05:41:10.566 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T05:41:10.566 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T05:41:10.830 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:41:10.938 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1260885 10.88 MB/sec execute 478 sec latency 14.972 ms 2024-08-31T05:41:11.156 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:41:10 smithi050 ceph-mon[22146]: pgmap v690: 129 pgs: 129 active+clean; 567 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.2 MiB/s wr, 246 op/s 2024-08-31T05:41:11.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:41:10 smithi050 ceph-mon[22146]: osdmap e97: 12 total, 12 up, 12 in 2024-08-31T05:41:11.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:41:10 smithi005 ceph-mon[18602]: pgmap v690: 129 pgs: 129 active+clean; 567 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.2 MiB/s wr, 246 op/s 2024-08-31T05:41:11.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:41:10 smithi005 ceph-mon[18602]: osdmap e97: 12 total, 12 up, 12 in 2024-08-31T05:41:11.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:41:10 smithi070 ceph-mon[22316]: pgmap v690: 129 pgs: 129 active+clean; 567 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.2 MiB/s wr, 246 op/s 2024-08-31T05:41:11.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:41:10 smithi070 ceph-mon[22316]: osdmap e97: 12 total, 12 up, 12 in 2024-08-31T05:41:11.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.342+0000 7febcf278640 1 -- 172.21.15.5:0/3364182324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febc8109bd0 msgr2=0x7febc8110400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:11.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.342+0000 7febcf278640 1 --2- 172.21.15.5:0/3364182324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febc8109bd0 0x7febc8110400 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7febc0009ca0 tx=0x7febc002a8c0 comp rx=0 tx=0).stop 2024-08-31T05:41:11.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.342+0000 7febcf278640 1 -- 172.21.15.5:0/3364182324 shutdown_connections 2024-08-31T05:41:11.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.342+0000 7febcf278640 1 --2- 172.21.15.5:0/3364182324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febc8109bd0 0x7febc8110400 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:11.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.342+0000 7febcf278640 1 --2- 172.21.15.5:0/3364182324 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febc8109280 0x7febc8109690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:11.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.342+0000 7febcf278640 1 --2- 172.21.15.5:0/3364182324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7febc8103940 0x7febc8103d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:11.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.342+0000 7febcf278640 1 -- 172.21.15.5:0/3364182324 >> 172.21.15.5:0/3364182324 conn(0x7febc80ff3d0 msgr2=0x7febc8101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:11.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.342+0000 7febcf278640 1 -- 172.21.15.5:0/3364182324 shutdown_connections 2024-08-31T05:41:11.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.342+0000 7febcf278640 1 -- 172.21.15.5:0/3364182324 wait complete. 2024-08-31T05:41:11.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.343+0000 7febcf278640 1 Processor -- start 2024-08-31T05:41:11.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.343+0000 7febcf278640 1 -- start start 2024-08-31T05:41:11.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.343+0000 7febcf278640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febc8103940 0x7febc819a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:11.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.343+0000 7febcf278640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7febc8109280 0x7febc819a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:11.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.343+0000 7febcf278640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febc8109bd0 0x7febc819fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:11.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.343+0000 7febcf278640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7febc8113890 con 0x7febc8109bd0 2024-08-31T05:41:11.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.343+0000 7febcf278640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7febc8113710 con 0x7febc8103940 2024-08-31T05:41:11.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.343+0000 7febcf278640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7febc8113a10 con 0x7febc8109280 2024-08-31T05:41:11.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.343+0000 7febcd815640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febc8109bd0 0x7febc819fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:11.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.343+0000 7febcd014640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febc8103940 0x7febc819a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:11.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.343+0000 7febcd014640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febc8103940 0x7febc819a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:59418/0 (socket says 172.21.15.5:59418) 2024-08-31T05:41:11.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.343+0000 7febcd014640 1 -- 172.21.15.5:0/725087170 learned_addr learned my addr 172.21.15.5:0/725087170 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:11.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.343+0000 7febcd815640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febc8109bd0 0x7febc819fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44920/0 (socket says 172.21.15.5:44920) 2024-08-31T05:41:11.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.343+0000 7febcc813640 1 --2- 172.21.15.5:0/725087170 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7febc8109280 0x7febc819a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:11.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.344+0000 7febcd014640 1 -- 172.21.15.5:0/725087170 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7febc8109280 msgr2=0x7febc819a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:11.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.344+0000 7febcd014640 1 --2- 172.21.15.5:0/725087170 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7febc8109280 0x7febc819a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:11.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.344+0000 7febcd014640 1 -- 172.21.15.5:0/725087170 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febc8109bd0 msgr2=0x7febc819fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:11.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.344+0000 7febcd014640 1 --2- 172.21.15.5:0/725087170 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febc8109bd0 0x7febc819fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:11.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.344+0000 7febcd014640 1 -- 172.21.15.5:0/725087170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febc81a01f0 con 0x7febc8103940 2024-08-31T05:41:11.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.344+0000 7febcd014640 1 --2- 172.21.15.5:0/725087170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febc8103940 0x7febc819a280 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7febc400e9f0 tx=0x7febc400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:11.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.344+0000 7febbe7fc640 1 -- 172.21.15.5:0/725087170 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc400cd80 con 0x7febc8103940 2024-08-31T05:41:11.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.344+0000 7febcf278640 1 -- 172.21.15.5:0/725087170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febc81a04e0 con 0x7febc8103940 2024-08-31T05:41:11.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.344+0000 7febbe7fc640 1 -- 172.21.15.5:0/725087170 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febc40054d0 con 0x7febc8103940 2024-08-31T05:41:11.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.344+0000 7febbe7fc640 1 -- 172.21.15.5:0/725087170 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc4010690 con 0x7febc8103940 2024-08-31T05:41:11.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.344+0000 7febcf278640 1 -- 172.21.15.5:0/725087170 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febc81a6c40 con 0x7febc8103940 2024-08-31T05:41:11.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.347+0000 7febd57ed740 1 Processor -- start 2024-08-31T05:41:11.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.347+0000 7febd57ed740 1 -- start start 2024-08-31T05:41:11.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.347+0000 7febbe7fc640 1 -- 172.21.15.5:0/725087170 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7febc4010830 con 0x7febc8103940 2024-08-31T05:41:11.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.347+0000 7febd57ed740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557bd355d350 0x557bd3903780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:11.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.347+0000 7febd57ed740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557bd3534490 0x557bd3903cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:11.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.347+0000 7febd57ed740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557bd353c670 0x557bd3904200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:11.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.347+0000 7febd57ed740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x557bd38795f0 con 0x557bd355d350 2024-08-31T05:41:11.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.347+0000 7febd57ed740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x557bd3868b80 con 0x557bd353c670 2024-08-31T05:41:11.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.347+0000 7febd57ed740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557bd386cb30 con 0x557bd3534490 2024-08-31T05:41:11.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.348+0000 7febcd815640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557bd355d350 0x557bd3903780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:11.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.348+0000 7febcd815640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557bd355d350 0x557bd3903780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44924/0 (socket says 172.21.15.5:44924) 2024-08-31T05:41:11.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.348+0000 7febcd014640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557bd3534490 0x557bd3903cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:11.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.348+0000 7febcd815640 1 -- 172.21.15.5:0/2074981379 learned_addr learned my addr 172.21.15.5:0/2074981379 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:11.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.348+0000 7febcc813640 1 --2- 172.21.15.5:0/2074981379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557bd353c670 0x557bd3904200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:11.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.348+0000 7febcd815640 1 -- 172.21.15.5:0/2074981379 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557bd3534490 msgr2=0x557bd3903cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:11.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.348+0000 7febcd815640 1 --2- 172.21.15.5:0/2074981379 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557bd3534490 0x557bd3903cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:11.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.348+0000 7febcd815640 1 -- 172.21.15.5:0/2074981379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557bd353c670 msgr2=0x557bd3904200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:11.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.348+0000 7febcd815640 1 --2- 172.21.15.5:0/2074981379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557bd353c670 0x557bd3904200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:11.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.348+0000 7febcd815640 1 -- 172.21.15.5:0/2074981379 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557bd35c8930 con 0x557bd355d350 2024-08-31T05:41:11.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.348+0000 7febcd014640 1 --2- 172.21.15.5:0/2074981379 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557bd3534490 0x557bd3903cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:41:11.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.348+0000 7febcd815640 1 --2- 172.21.15.5:0/2074981379 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557bd355d350 0x557bd3903780 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7febc002f410 tx=0x7febc002f440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ef07c32a1137823 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:11.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.348+0000 7febbe7fc640 1 --2- 172.21.15.5:0/725087170 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7febb40b4ca0 0x7febb40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:11.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.349+0000 7febb37fe640 1 -- 172.21.15.5:0/2074981379 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc0031cf0 con 0x557bd355d350 2024-08-31T05:41:11.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.349+0000 7febcd014640 1 --2- 172.21.15.5:0/725087170 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7febb40b4ca0 0x7febb40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:11.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.349+0000 7febb37fe640 1 -- 172.21.15.5:0/2074981379 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febc0036030 con 0x557bd355d350 2024-08-31T05:41:11.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.349+0000 7febb37fe640 1 -- 172.21.15.5:0/2074981379 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc00042a0 con 0x557bd355d350 2024-08-31T05:41:11.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.349+0000 7febbe7fc640 1 -- 172.21.15.5:0/725087170 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9511+0+0 (secure 0 0 0) 0x7febc40e5d30 con 0x7febc8103940 2024-08-31T05:41:11.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.350+0000 7febd57ed740 1 -- 172.21.15.5:0/2074981379 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557bd355d350 msgr2=0x557bd3903780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:11.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.350+0000 7febcd014640 1 --2- 172.21.15.5:0/725087170 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7febb40b4ca0 0x7febb40b71b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7febc40e3150 tx=0x7febc40ee040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:11.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.350+0000 7febd57ed740 1 --2- 172.21.15.5:0/2074981379 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557bd355d350 0x557bd3903780 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7febc002f410 tx=0x7febc002f440 comp rx=0 tx=0).stop 2024-08-31T05:41:11.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.350+0000 7febd57ed740 1 -- 172.21.15.5:0/2074981379 shutdown_connections 2024-08-31T05:41:11.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.350+0000 7febd57ed740 1 --2- 172.21.15.5:0/2074981379 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557bd353c670 0x557bd3904200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:11.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.350+0000 7febd57ed740 1 --2- 172.21.15.5:0/2074981379 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557bd3534490 0x557bd3903cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:11.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.350+0000 7febd57ed740 1 --2- 172.21.15.5:0/2074981379 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557bd355d350 0x557bd3903780 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:11.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.350+0000 7febd57ed740 1 -- 172.21.15.5:0/2074981379 >> 172.21.15.5:0/2074981379 conn(0x557bd3551740 msgr2=0x557bd3901670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:11.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.350+0000 7febd57ed740 1 -- 172.21.15.5:0/2074981379 shutdown_connections 2024-08-31T05:41:11.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.350+0000 7febd57ed740 1 -- 172.21.15.5:0/2074981379 wait complete. 2024-08-31T05:41:11.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.350+0000 7febd57ed740 1 -- start start 2024-08-31T05:41:11.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.350+0000 7febd57ed740 1 Processor -- start 2024-08-31T05:41:11.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.351+0000 7febd57ed740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557bd3534490 0x557bd3913390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:11.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.351+0000 7febd57ed740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557bd353c670 0x557bd39138d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:11.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.351+0000 7febd57ed740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557bd355d350 0x557bd391f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:11.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.351+0000 7febd57ed740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x557bd36cb890 con 0x557bd3534490 2024-08-31T05:41:11.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.351+0000 7febd57ed740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x557bd37ef790 con 0x557bd355d350 2024-08-31T05:41:11.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.351+0000 7febd57ed740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557bd39160e0 con 0x557bd353c670 2024-08-31T05:41:11.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.351+0000 7febd57ed740 10 client.0 _ll_register_callbacks cb 0x557bd3574ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:41:11.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.351+0000 7febcd815640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557bd3534490 0x557bd3913390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:11.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.351+0000 7febcc813640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557bd353c670 0x557bd39138d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:11.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.351+0000 7febcd815640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557bd3534490 0x557bd3913390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44926/0 (socket says 172.21.15.5:44926) 2024-08-31T05:41:11.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.351+0000 7febcc813640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557bd353c670 0x557bd39138d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:43876/0 (socket says 172.21.15.5:43876) 2024-08-31T05:41:11.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.351+0000 7febcd815640 1 -- 172.21.15.5:0/1920617940 learned_addr learned my addr 172.21.15.5:0/1920617940 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:11.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.351+0000 7febcd815640 1 --2- 172.21.15.5:0/1920617940 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557bd355d350 0x557bd391f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:11.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.351+0000 7febcc813640 1 -- 172.21.15.5:0/1920617940 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557bd355d350 msgr2=0x557bd391f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:11.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.351+0000 7febcc813640 1 --2- 172.21.15.5:0/1920617940 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557bd355d350 0x557bd391f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:11.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.351+0000 7febcc813640 1 -- 172.21.15.5:0/1920617940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557bd3534490 msgr2=0x557bd3913390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:11.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.351+0000 7febcc813640 1 --2- 172.21.15.5:0/1920617940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557bd3534490 0x557bd3913390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:11.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.351+0000 7febcc813640 1 -- 172.21.15.5:0/1920617940 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557bd3826f30 con 0x557bd353c670 2024-08-31T05:41:11.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.351+0000 7febcd815640 1 --2- 172.21.15.5:0/1920617940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557bd3534490 0x557bd3913390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:41:11.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.352+0000 7febcc813640 1 --2- 172.21.15.5:0/1920617940 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557bd353c670 0x557bd39138d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7febc806a530 tx=0x7febb8012b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55b94973182672c5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:11.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.352+0000 7febb0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:41:11.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.352+0000 7febb0ff9640 1 -- 172.21.15.5:0/1920617940 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb800f8f0 con 0x557bd353c670 2024-08-31T05:41:11.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.352+0000 7febb0ff9640 1 -- 172.21.15.5:0/1920617940 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9511+0+0 (secure 0 0 0) 0x7febb800fa90 con 0x557bd353c670 2024-08-31T05:41:11.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.352+0000 7febd57ed740 1 -- 172.21.15.5:0/1920617940 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7febc0036030 con 0x557bd353c670 2024-08-31T05:41:11.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.352+0000 7febb0ff9640 1 -- 172.21.15.5:0/1920617940 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7febb8025050 con 0x557bd353c670 2024-08-31T05:41:11.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.352+0000 7febd57ed740 10 client.28174 fetch_fsmap learned FSMap version 34 2024-08-31T05:41:11.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.352+0000 7febd57ed740 1 -- 172.21.15.5:0/1920617940 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x557bd3922000 con 0x557bd353c670 2024-08-31T05:41:11.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.352+0000 7febb0ff9640 1 -- 172.21.15.5:0/1920617940 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febc0036030 con 0x557bd353c670 2024-08-31T05:41:11.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.353+0000 7febb0ff9640 1 -- 172.21.15.5:0/1920617940 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7febb8010430 con 0x557bd353c670 2024-08-31T05:41:11.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.353+0000 7febd57ed740 10 client.28174 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:41:11.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.353+0000 7febd57ed740 10 client.28174 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:41:11.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.353+0000 7febd57ed740 20 client.28174 populate_metadata read hostname 'smithi005' 2024-08-31T05:41:11.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.353+0000 7febd57ed740 1 --2- 172.21.15.5:0/1920617940 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x557bd351bcd0 0x557bd3925560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:11.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.353+0000 7febd57ed740 4 client.28174 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:41:11.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.353+0000 7febd57ed740 1 -- 172.21.15.5:0/1920617940 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557bd387b540 con 0x557bd351bcd0 2024-08-31T05:41:11.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.353+0000 7febcd815640 1 --2- 172.21.15.5:0/1920617940 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x557bd351bcd0 0x557bd3925560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:11.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.353+0000 7febb0ff9640 10 client.28174 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:41:11.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.354+0000 7febcd815640 1 --2- 172.21.15.5:0/1920617940 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x557bd351bcd0 0x557bd3925560 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b078a5cabfd3b9 server_cookie=926ecccf86d7c43a in_seq=0 out_seq=0 2024-08-31T05:41:11.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.354+0000 7febb0ff9640 1 -- 172.21.15.5:0/1920617940 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557bd387b540 con 0x557bd351bcd0 2024-08-31T05:41:11.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.354+0000 7febb0ff9640 10 client.28174 handle_command_reply: tid=0 2024-08-31T05:41:11.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.354+0000 7febd57ed740 1 client.28174 shutdown 2024-08-31T05:41:11.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.354+0000 7febd57ed740 1 -- 172.21.15.5:0/1920617940 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557bd353c670 msgr2=0x557bd39138d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:11.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.354+0000 7febd57ed740 1 --2- 172.21.15.5:0/1920617940 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557bd353c670 0x557bd39138d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7febc806a530 tx=0x7febb8012b60 comp rx=0 tx=0).stop 2024-08-31T05:41:11.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.354+0000 7febd57ed740 1 -- 172.21.15.5:0/1920617940 shutdown_connections 2024-08-31T05:41:11.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.354+0000 7febd57ed740 1 --2- 172.21.15.5:0/1920617940 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x557bd351bcd0 0x557bd3925560 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:11.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.354+0000 7febd57ed740 1 --2- 172.21.15.5:0/1920617940 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557bd355d350 0x557bd391f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:11.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.354+0000 7febd57ed740 1 --2- 172.21.15.5:0/1920617940 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557bd353c670 0x557bd39138d0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:11.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.354+0000 7febb0ff9640 0 client.28174 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:41:11.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.354+0000 7febd57ed740 1 --2- 172.21.15.5:0/1920617940 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557bd3534490 0x557bd3913390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:11.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.354+0000 7febd57ed740 1 -- 172.21.15.5:0/1920617940 >> 172.21.15.5:0/1920617940 conn(0x557bd3551740 msgr2=0x557bd38ffc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:11.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.355+0000 7febd57ed740 1 -- 172.21.15.5:0/1920617940 shutdown_connections 2024-08-31T05:41:11.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.355+0000 7febd57ed740 1 -- 172.21.15.5:0/1920617940 wait complete. 2024-08-31T05:41:11.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.355+0000 7febd57ed740 20 client.28174 trim_cache size 0 max 16384 2024-08-31T05:41:11.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.372+0000 7febd57ed740 1 Processor -- start 2024-08-31T05:41:11.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.372+0000 7febd57ed740 1 -- start start 2024-08-31T05:41:11.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.373+0000 7febd57ed740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557bd3534490 0x557bd3913970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:11.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.373+0000 7febd57ed740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557bd353c670 0x557bd3909030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:11.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.373+0000 7febd57ed740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557bd355d350 0x557bd391f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:11.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.373+0000 7febd57ed740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7febc81aea50 con 0x557bd3534490 2024-08-31T05:41:11.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.373+0000 7febd57ed740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7febc81b0590 con 0x557bd353c670 2024-08-31T05:41:11.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.373+0000 7febd57ed740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7febc81af120 con 0x557bd355d350 2024-08-31T05:41:11.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.373+0000 7febcc813640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557bd353c670 0x557bd3909030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:11.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.373+0000 7febcd815640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557bd3534490 0x557bd3913970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:11.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.373+0000 7febcc813640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557bd353c670 0x557bd3909030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:59436/0 (socket says 172.21.15.5:59436) 2024-08-31T05:41:11.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.373+0000 7febcc813640 1 -- 172.21.15.5:0/167554718 learned_addr learned my addr 172.21.15.5:0/167554718 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:11.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.373+0000 7febcd815640 1 --2- 172.21.15.5:0/167554718 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557bd355d350 0x557bd391f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:11.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.373+0000 7febcc813640 1 -- 172.21.15.5:0/167554718 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557bd355d350 msgr2=0x557bd391f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:11.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.373+0000 7febcc813640 1 --2- 172.21.15.5:0/167554718 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557bd355d350 0x557bd391f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:11.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.373+0000 7febcc813640 1 -- 172.21.15.5:0/167554718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557bd3534490 msgr2=0x557bd3913970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:11.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.373+0000 7febcc813640 1 --2- 172.21.15.5:0/167554718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557bd3534490 0x557bd3913970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:11.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.373+0000 7febcc813640 1 -- 172.21.15.5:0/167554718 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557bd38fcd90 con 0x557bd353c670 2024-08-31T05:41:11.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.373+0000 7febcd815640 1 --2- 172.21.15.5:0/167554718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557bd3534490 0x557bd3913970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:41:11.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.374+0000 7febcc813640 1 --2- 172.21.15.5:0/167554718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557bd353c670 0x557bd3909030 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7febb8009d20 tx=0x7febb8005db0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18d224adb583ff69 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:11.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.374+0000 7febb2ffd640 1 -- 172.21.15.5:0/167554718 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb8011ea0 con 0x557bd353c670 2024-08-31T05:41:11.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.374+0000 7febb2ffd640 1 -- 172.21.15.5:0/167554718 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febb800fda0 con 0x557bd353c670 2024-08-31T05:41:11.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.374+0000 7febb2ffd640 1 -- 172.21.15.5:0/167554718 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb80050f0 con 0x557bd353c670 2024-08-31T05:41:11.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.375+0000 7febd57ed740 1 -- 172.21.15.5:0/167554718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557bd353c670 msgr2=0x557bd3909030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:11.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.375+0000 7febd57ed740 1 --2- 172.21.15.5:0/167554718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557bd353c670 0x557bd3909030 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7febb8009d20 tx=0x7febb8005db0 comp rx=0 tx=0).stop 2024-08-31T05:41:11.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.375+0000 7febd57ed740 1 -- 172.21.15.5:0/167554718 shutdown_connections 2024-08-31T05:41:11.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.375+0000 7febd57ed740 1 --2- 172.21.15.5:0/167554718 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557bd355d350 0x557bd391f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:11.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.375+0000 7febd57ed740 1 --2- 172.21.15.5:0/167554718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557bd353c670 0x557bd3909030 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:11.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.375+0000 7febd57ed740 1 --2- 172.21.15.5:0/167554718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557bd3534490 0x557bd3913970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:11.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.375+0000 7febd57ed740 1 -- 172.21.15.5:0/167554718 >> 172.21.15.5:0/167554718 conn(0x557bd3551740 msgr2=0x557bd3908920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:11.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.375+0000 7febd57ed740 1 -- 172.21.15.5:0/167554718 shutdown_connections 2024-08-31T05:41:11.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.375+0000 7febd57ed740 1 -- 172.21.15.5:0/167554718 wait complete. 2024-08-31T05:41:11.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.375+0000 7febd57ed740 1 -- start start 2024-08-31T05:41:11.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.375+0000 7febd57ed740 1 Processor -- start 2024-08-31T05:41:11.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.376+0000 7febd57ed740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557bd3534490 0x557bd3917c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:11.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.376+0000 7febd57ed740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557bd353c670 0x557bd3918240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:11.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.376+0000 7febd57ed740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557bd355d350 0x557bd3988f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:11.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.376+0000 7febd57ed740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7febc81afec0 con 0x557bd355d350 2024-08-31T05:41:11.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.376+0000 7febd57ed740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7febc81af7f0 con 0x557bd353c670 2024-08-31T05:41:11.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.376+0000 7febd57ed740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7febc81aca50 con 0x557bd3534490 2024-08-31T05:41:11.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.376+0000 7febd57ed740 10 client.0 _ll_register_callbacks cb 0x7febb8009850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:41:11.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.376+0000 7febcc813640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557bd353c670 0x557bd3918240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:11.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.376+0000 7febcd815640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557bd355d350 0x557bd3988f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:11.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.376+0000 7febcc813640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557bd353c670 0x557bd3918240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:59444/0 (socket says 172.21.15.5:59444) 2024-08-31T05:41:11.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.376+0000 7febcc813640 1 -- 172.21.15.5:0/3847552920 learned_addr learned my addr 172.21.15.5:0/3847552920 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:11.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.376+0000 7febcd815640 1 --2- 172.21.15.5:0/3847552920 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557bd3534490 0x557bd3917c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:11.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.376+0000 7febcc813640 1 -- 172.21.15.5:0/3847552920 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557bd3534490 msgr2=0x557bd3917c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:11.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.376+0000 7febcc813640 1 --2- 172.21.15.5:0/3847552920 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557bd3534490 0x557bd3917c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:11.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.376+0000 7febcc813640 1 -- 172.21.15.5:0/3847552920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557bd355d350 msgr2=0x557bd3988f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:11.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.376+0000 7febcc813640 1 --2- 172.21.15.5:0/3847552920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557bd355d350 0x557bd3988f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:11.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.376+0000 7febcc813640 1 -- 172.21.15.5:0/3847552920 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557bd3916020 con 0x557bd353c670 2024-08-31T05:41:11.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.377+0000 7febcc813640 1 --2- 172.21.15.5:0/3847552920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557bd353c670 0x557bd3918240 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7febb8001e90 tx=0x7febb8009eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43bca22b9b846f27 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:11.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.377+0000 7febb0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:41:11.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.377+0000 7febb0ff9640 1 -- 172.21.15.5:0/3847552920 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb800f8f0 con 0x557bd353c670 2024-08-31T05:41:11.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.377+0000 7febb0ff9640 1 -- 172.21.15.5:0/3847552920 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9511+0+0 (secure 0 0 0) 0x7febb8022040 con 0x557bd353c670 2024-08-31T05:41:11.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.377+0000 7febd57ed740 1 -- 172.21.15.5:0/3847552920 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7febb800fda0 con 0x557bd353c670 2024-08-31T05:41:11.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.377+0000 7febb0ff9640 1 -- 172.21.15.5:0/3847552920 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7febb800fa90 con 0x557bd353c670 2024-08-31T05:41:11.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.377+0000 7febd57ed740 10 client.28157 fetch_fsmap learned FSMap version 34 2024-08-31T05:41:11.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.377+0000 7febd57ed740 1 -- 172.21.15.5:0/3847552920 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x557bd3990750 con 0x557bd353c670 2024-08-31T05:41:11.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.377+0000 7febb0ff9640 1 -- 172.21.15.5:0/3847552920 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febb800fda0 con 0x557bd353c670 2024-08-31T05:41:11.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.378+0000 7febb0ff9640 1 -- 172.21.15.5:0/3847552920 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7febb8003850 con 0x557bd353c670 2024-08-31T05:41:11.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.378+0000 7febd57ed740 10 client.28157 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:41:11.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.378+0000 7febd57ed740 10 client.28157 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:41:11.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.378+0000 7febd57ed740 20 client.28157 populate_metadata read hostname 'smithi005' 2024-08-31T05:41:11.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.378+0000 7febd57ed740 1 --2- 172.21.15.5:0/3847552920 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x557bd34f1080 0x557bd3992e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:11.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.378+0000 7febd57ed740 4 client.28157 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T05:41:11.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.378+0000 7febd57ed740 1 -- 172.21.15.5:0/3847552920 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x557bd3876fe0 con 0x557bd34f1080 2024-08-31T05:41:11.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.378+0000 7febcd815640 1 --2- 172.21.15.5:0/3847552920 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x557bd34f1080 0x557bd3992e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:11.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.378+0000 7febb0ff9640 10 client.28157 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:41:11.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.378+0000 7febcd815640 1 --2- 172.21.15.5:0/3847552920 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x557bd34f1080 0x557bd3992e50 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9cef2ecbc249d5b server_cookie=cb039c998831319a in_seq=0 out_seq=0 2024-08-31T05:41:11.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.380+0000 7febb0ff9640 1 -- 172.21.15.5:0/3847552920 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x557bd3876fe0 con 0x557bd34f1080 2024-08-31T05:41:11.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.380+0000 7febb0ff9640 10 client.28157 handle_command_reply: tid=0 2024-08-31T05:41:11.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.380+0000 7febd57ed740 1 client.28157 shutdown 2024-08-31T05:41:11.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.380+0000 7febd57ed740 1 -- 172.21.15.5:0/3847552920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557bd353c670 msgr2=0x557bd3918240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:11.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.380+0000 7febd57ed740 1 --2- 172.21.15.5:0/3847552920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557bd353c670 0x557bd3918240 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7febb8001e90 tx=0x7febb8009eb0 comp rx=0 tx=0).stop 2024-08-31T05:41:11.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.380+0000 7febd57ed740 1 -- 172.21.15.5:0/3847552920 shutdown_connections 2024-08-31T05:41:11.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.380+0000 7febd57ed740 1 --2- 172.21.15.5:0/3847552920 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x557bd34f1080 0x557bd3992e50 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:11.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.380+0000 7febd57ed740 1 --2- 172.21.15.5:0/3847552920 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557bd355d350 0x557bd3988f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:11.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.380+0000 7febd57ed740 1 --2- 172.21.15.5:0/3847552920 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557bd353c670 0x557bd3918240 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:11.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.380+0000 7febd57ed740 1 --2- 172.21.15.5:0/3847552920 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557bd3534490 0x557bd3917c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:11.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.380+0000 7febd57ed740 1 -- 172.21.15.5:0/3847552920 >> 172.21.15.5:0/3847552920 conn(0x557bd3551740 msgr2=0x557bd3908920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:11.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.380+0000 7febb0ff9640 0 client.28157 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:41:11.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.381+0000 7febd57ed740 1 -- 172.21.15.5:0/3847552920 shutdown_connections 2024-08-31T05:41:11.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.381+0000 7febd57ed740 1 -- 172.21.15.5:0/3847552920 wait complete. 2024-08-31T05:41:11.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.381+0000 7febd57ed740 20 client.28157 trim_cache size 0 max 16384 2024-08-31T05:41:11.387 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:41:11.387 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-08-31T05:41:11.387 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "c9a687a5-4adf-4788-8f18-4c06352efa9b", 2024-08-31T05:41:11.387 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-08-31T05:41:11.387 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:41:11.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.381+0000 7febcf278640 1 -- 172.21.15.5:0/725087170 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7febb40b4ca0 msgr2=0x7febb40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:11.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.381+0000 7febcf278640 1 --2- 172.21.15.5:0/725087170 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7febb40b4ca0 0x7febb40b71b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7febc40e3150 tx=0x7febc40ee040 comp rx=0 tx=0).stop 2024-08-31T05:41:11.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.381+0000 7febcf278640 1 -- 172.21.15.5:0/725087170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febc8103940 msgr2=0x7febc819a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:11.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.381+0000 7febcf278640 1 --2- 172.21.15.5:0/725087170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febc8103940 0x7febc819a280 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7febc400e9f0 tx=0x7febc400edf0 comp rx=0 tx=0).stop 2024-08-31T05:41:11.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.381+0000 7febcf278640 1 -- 172.21.15.5:0/725087170 shutdown_connections 2024-08-31T05:41:11.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.381+0000 7febcf278640 1 --2- 172.21.15.5:0/725087170 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7febb40b4ca0 0x7febb40b71b0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:11.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.381+0000 7febcf278640 1 --2- 172.21.15.5:0/725087170 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7febc8109bd0 0x7febc819fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:11.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.381+0000 7febcf278640 1 --2- 172.21.15.5:0/725087170 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7febc8109280 0x7febc819a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:11.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.381+0000 7febcf278640 1 --2- 172.21.15.5:0/725087170 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7febc8103940 0x7febc819a280 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:11.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.381+0000 7febcf278640 1 -- 172.21.15.5:0/725087170 >> 172.21.15.5:0/725087170 conn(0x7febc80ff3d0 msgr2=0x7febc8106810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:11.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.381+0000 7febcf278640 1 -- 172.21.15.5:0/725087170 shutdown_connections 2024-08-31T05:41:11.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:11.381+0000 7febcf278640 1 -- 172.21.15.5:0/725087170 wait complete. 2024-08-31T05:41:11.938 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1262285 10.87 MB/sec execute 479 sec latency 46.469 ms 2024-08-31T05:41:12.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:41:11 smithi050 ceph-mon[22146]: scrub queued for path: / 2024-08-31T05:41:12.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:41:11 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:41:12.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:41:11 smithi050 ceph-mon[22146]: scrub summary: active paths [/] 2024-08-31T05:41:12.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:41:11 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:41:12.157 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:41:11 smithi005 ceph-mon[18602]: scrub queued for path: / 2024-08-31T05:41:12.158 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:41:11 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:41:12.158 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:41:11 smithi005 ceph-mon[18602]: scrub summary: active paths [/] 2024-08-31T05:41:12.158 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:41:11 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:41:12.184 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T05:41:12.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:41:11 smithi070 ceph-mon[22316]: scrub queued for path: / 2024-08-31T05:41:12.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:41:11 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:41:12.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:41:11 smithi070 ceph-mon[22316]: scrub summary: active paths [/] 2024-08-31T05:41:12.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:41:11 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:41:12.447 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:41:12.938 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1264141 10.86 MB/sec execute 480 sec latency 72.525 ms 2024-08-31T05:41:12.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.950+0000 7f76a01f0640 1 -- 172.21.15.5:0/2909811687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f769810dbb0 msgr2=0x7f76981100c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:12.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.950+0000 7f76a01f0640 1 --2- 172.21.15.5:0/2909811687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f769810dbb0 0x7f76981100c0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f7690009ca0 tx=0x7f769002a8c0 comp rx=0 tx=0).stop 2024-08-31T05:41:12.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.950+0000 7f76a01f0640 1 -- 172.21.15.5:0/2909811687 shutdown_connections 2024-08-31T05:41:12.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.950+0000 7f76a01f0640 1 --2- 172.21.15.5:0/2909811687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f769810dbb0 0x7f76981100c0 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:12.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.950+0000 7f76a01f0640 1 --2- 172.21.15.5:0/2909811687 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7698105030 0x7f769810d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:12.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.950+0000 7f76a01f0640 1 --2- 172.21.15.5:0/2909811687 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7698104600 0x7f7698104a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:12.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.950+0000 7f76a01f0640 1 -- 172.21.15.5:0/2909811687 >> 172.21.15.5:0/2909811687 conn(0x7f76980794e0 msgr2=0x7f76980798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:12.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.950+0000 7f76a01f0640 1 -- 172.21.15.5:0/2909811687 shutdown_connections 2024-08-31T05:41:12.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.950+0000 7f76a01f0640 1 -- 172.21.15.5:0/2909811687 wait complete. 2024-08-31T05:41:12.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.951+0000 7f76a01f0640 1 Processor -- start 2024-08-31T05:41:12.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.951+0000 7f76a01f0640 1 -- start start 2024-08-31T05:41:12.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.951+0000 7f76a01f0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7698104600 0x7f769819a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:12.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.951+0000 7f76a01f0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7698105030 0x7f769819a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:12.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.951+0000 7f76a01f0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f769810dbb0 0x7f769819faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:12.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.951+0000 7f76a01f0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7698113830 con 0x7f7698104600 2024-08-31T05:41:12.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.951+0000 7f76a01f0640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f76981136b0 con 0x7f769810dbb0 2024-08-31T05:41:12.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.951+0000 7f76a01f0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f76981139b0 con 0x7f7698105030 2024-08-31T05:41:12.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.951+0000 7f769df8c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7698104600 0x7f769819a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:12.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.951+0000 7f769df8c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7698104600 0x7f769819a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35238/0 (socket says 172.21.15.5:35238) 2024-08-31T05:41:12.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.951+0000 7f769df8c640 1 -- 172.21.15.5:0/1560050149 learned_addr learned my addr 172.21.15.5:0/1560050149 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:12.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.951+0000 7f769d78b640 1 --2- 172.21.15.5:0/1560050149 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7698105030 0x7f769819a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:12.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.951+0000 7f769e78d640 1 --2- 172.21.15.5:0/1560050149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f769810dbb0 0x7f769819faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:12.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.951+0000 7f769df8c640 1 -- 172.21.15.5:0/1560050149 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7698105030 msgr2=0x7f769819a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:12.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.951+0000 7f769df8c640 1 --2- 172.21.15.5:0/1560050149 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7698105030 0x7f769819a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:12.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.951+0000 7f769df8c640 1 -- 172.21.15.5:0/1560050149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f769810dbb0 msgr2=0x7f769819faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:12.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.951+0000 7f769df8c640 1 --2- 172.21.15.5:0/1560050149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f769810dbb0 0x7f769819faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:12.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.951+0000 7f769df8c640 1 -- 172.21.15.5:0/1560050149 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76981a01d0 con 0x7f7698104600 2024-08-31T05:41:12.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.952+0000 7f769d78b640 1 --2- 172.21.15.5:0/1560050149 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7698105030 0x7f769819a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:41:12.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.951+0000 7f769e78d640 1 --2- 172.21.15.5:0/1560050149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f769810dbb0 0x7f769819faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:41:12.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.952+0000 7f769df8c640 1 --2- 172.21.15.5:0/1560050149 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7698104600 0x7f769819a260 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f769400e9c0 tx=0x7f769400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:12.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.952+0000 7f768effd640 1 -- 172.21.15.5:0/1560050149 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f769400cd80 con 0x7f7698104600 2024-08-31T05:41:12.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.952+0000 7f76a01f0640 1 -- 172.21.15.5:0/1560050149 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76981a04c0 con 0x7f7698104600 2024-08-31T05:41:12.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.952+0000 7f768effd640 1 -- 172.21.15.5:0/1560050149 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76940035f0 con 0x7f7698104600 2024-08-31T05:41:12.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.952+0000 7f768effd640 1 -- 172.21.15.5:0/1560050149 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7694010690 con 0x7f7698104600 2024-08-31T05:41:12.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.952+0000 7f76a01f0640 1 -- 172.21.15.5:0/1560050149 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76981a6c20 con 0x7f7698104600 2024-08-31T05:41:12.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.954+0000 7f768effd640 1 -- 172.21.15.5:0/1560050149 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f76940037a0 con 0x7f7698104600 2024-08-31T05:41:12.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.955+0000 7f76a6765740 1 Processor -- start 2024-08-31T05:41:12.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.955+0000 7f76a6765740 1 -- start start 2024-08-31T05:41:12.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.955+0000 7f76a6765740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a7c1f5070 0x555a7c59a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:12.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.955+0000 7f76a6765740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555a7c1cc1b0 0x555a7c59a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:12.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.955+0000 7f76a6765740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555a7c1d4390 0x555a7c59ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:12.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.955+0000 7f76a6765740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x555a7c511630 con 0x555a7c1d4390 2024-08-31T05:41:12.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.955+0000 7f76a6765740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x555a7c500bc0 con 0x555a7c1cc1b0 2024-08-31T05:41:12.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.955+0000 7f76a6765740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555a7c504b70 con 0x555a7c1f5070 2024-08-31T05:41:12.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.955+0000 7f769d78b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555a7c1d4390 0x555a7c59ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:12.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.955+0000 7f769e78d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a7c1f5070 0x555a7c59a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:12.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.955+0000 7f769df8c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555a7c1cc1b0 0x555a7c59a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:12.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.955+0000 7f769d78b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555a7c1d4390 0x555a7c59ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35250/0 (socket says 172.21.15.5:35250) 2024-08-31T05:41:12.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.955+0000 7f769d78b640 1 -- 172.21.15.5:0/4036737931 learned_addr learned my addr 172.21.15.5:0/4036737931 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:12.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.956+0000 7f769e78d640 1 -- 172.21.15.5:0/4036737931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555a7c1cc1b0 msgr2=0x555a7c59a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:12.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.956+0000 7f769e78d640 1 --2- 172.21.15.5:0/4036737931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555a7c1cc1b0 0x555a7c59a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:12.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.956+0000 7f769e78d640 1 -- 172.21.15.5:0/4036737931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555a7c1d4390 msgr2=0x555a7c59ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:12.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.956+0000 7f769e78d640 1 --2- 172.21.15.5:0/4036737931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555a7c1d4390 0x555a7c59ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:12.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.956+0000 7f769e78d640 1 -- 172.21.15.5:0/4036737931 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a7c260650 con 0x555a7c1f5070 2024-08-31T05:41:12.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.956+0000 7f769d78b640 1 --2- 172.21.15.5:0/4036737931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555a7c1d4390 0x555a7c59ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:41:12.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.956+0000 7f768effd640 1 --2- 172.21.15.5:0/1560050149 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f76840b4ca0 0x7f76840b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:12.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.956+0000 7f769e78d640 1 --2- 172.21.15.5:0/4036737931 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a7c1f5070 0x555a7c59a300 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f769002ade0 tx=0x7f7690009440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3414bf882c02ae08 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:12.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.956+0000 7f769df8c640 1 --2- 172.21.15.5:0/1560050149 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f76840b4ca0 0x7f76840b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:12.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.956+0000 7f7683fff640 1 -- 172.21.15.5:0/4036737931 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7690031cf0 con 0x555a7c1f5070 2024-08-31T05:41:12.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.956+0000 7f768effd640 1 -- 172.21.15.5:0/1560050149 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9511+0+0 (secure 0 0 0) 0x7f76940e5d70 con 0x7f7698104600 2024-08-31T05:41:12.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.956+0000 7f7683fff640 1 -- 172.21.15.5:0/4036737931 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7690036040 con 0x555a7c1f5070 2024-08-31T05:41:12.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.956+0000 7f7683fff640 1 -- 172.21.15.5:0/4036737931 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76900042a0 con 0x555a7c1f5070 2024-08-31T05:41:12.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.957+0000 7f76a6765740 1 -- 172.21.15.5:0/4036737931 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a7c1f5070 msgr2=0x555a7c59a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:12.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.957+0000 7f769df8c640 1 --2- 172.21.15.5:0/1560050149 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f76840b4ca0 0x7f76840b71b0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f76940e3190 tx=0x7f76940a6040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:12.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.957+0000 7f76a6765740 1 --2- 172.21.15.5:0/4036737931 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a7c1f5070 0x555a7c59a300 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f769002ade0 tx=0x7f7690009440 comp rx=0 tx=0).stop 2024-08-31T05:41:12.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.957+0000 7f76a6765740 1 -- 172.21.15.5:0/4036737931 shutdown_connections 2024-08-31T05:41:12.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.957+0000 7f76a6765740 1 --2- 172.21.15.5:0/4036737931 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555a7c1d4390 0x555a7c59ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:12.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.957+0000 7f76a6765740 1 --2- 172.21.15.5:0/4036737931 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555a7c1cc1b0 0x555a7c59a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:12.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.957+0000 7f76a6765740 1 --2- 172.21.15.5:0/4036737931 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a7c1f5070 0x555a7c59a300 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:12.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.957+0000 7f76a6765740 1 -- 172.21.15.5:0/4036737931 >> 172.21.15.5:0/4036737931 conn(0x555a7c1e9460 msgr2=0x555a7c5981f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:12.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.957+0000 7f76a6765740 1 -- 172.21.15.5:0/4036737931 shutdown_connections 2024-08-31T05:41:12.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.957+0000 7f76a6765740 1 -- 172.21.15.5:0/4036737931 wait complete. 2024-08-31T05:41:12.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.958+0000 7f76a6765740 1 -- start start 2024-08-31T05:41:12.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.958+0000 7f76a6765740 1 Processor -- start 2024-08-31T05:41:12.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.958+0000 7f76a6765740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555a7c1cc1b0 0x555a7c5a9e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:12.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.958+0000 7f76a6765740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555a7c1d4390 0x555a7c5aa380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:12.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.958+0000 7f76a6765740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a7c1f5070 0x555a7c5b6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:12.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.958+0000 7f76a6765740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x555a7c363700 con 0x555a7c1d4390 2024-08-31T05:41:12.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.958+0000 7f76a6765740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x555a7c487700 con 0x555a7c1cc1b0 2024-08-31T05:41:12.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.958+0000 7f76a6765740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555a7c5acde0 con 0x555a7c1f5070 2024-08-31T05:41:12.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.958+0000 7f76a6765740 10 client.0 _ll_register_callbacks cb 0x555a7c4b6dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:41:12.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.958+0000 7f769d78b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555a7c1d4390 0x555a7c5aa380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:12.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.958+0000 7f769d78b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555a7c1d4390 0x555a7c5aa380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35256/0 (socket says 172.21.15.5:35256) 2024-08-31T05:41:12.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.958+0000 7f769e78d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555a7c1cc1b0 0x555a7c5a9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:12.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.958+0000 7f769d78b640 1 -- 172.21.15.5:0/4038303610 learned_addr learned my addr 172.21.15.5:0/4038303610 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:12.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.959+0000 7f769e78d640 1 --2- 172.21.15.5:0/4038303610 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a7c1f5070 0x555a7c5b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:12.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.959+0000 7f769d78b640 1 -- 172.21.15.5:0/4038303610 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a7c1f5070 msgr2=0x555a7c5b6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:12.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.959+0000 7f769d78b640 1 --2- 172.21.15.5:0/4038303610 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a7c1f5070 0x555a7c5b6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:12.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.959+0000 7f769d78b640 1 -- 172.21.15.5:0/4038303610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555a7c1cc1b0 msgr2=0x555a7c5a9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:12.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.959+0000 7f769d78b640 1 --2- 172.21.15.5:0/4038303610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555a7c1cc1b0 0x555a7c5a9e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:12.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.959+0000 7f769d78b640 1 -- 172.21.15.5:0/4038303610 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a7c4c08b0 con 0x555a7c1d4390 2024-08-31T05:41:12.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.959+0000 7f769e78d640 1 --2- 172.21.15.5:0/4038303610 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a7c1f5070 0x555a7c5b6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:41:12.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.959+0000 7f769d78b640 1 --2- 172.21.15.5:0/4038303610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555a7c1d4390 0x555a7c5aa380 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f7688012d20 tx=0x7f768800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f160423207d796e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:12.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.959+0000 7f76817fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:41:12.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.959+0000 7f76817fa640 1 -- 172.21.15.5:0/4038303610 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f768800fe20 con 0x555a7c1d4390 2024-08-31T05:41:12.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.959+0000 7f76817fa640 1 -- 172.21.15.5:0/4038303610 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9511+0+0 (secure 0 0 0) 0x7f7688010430 con 0x555a7c1d4390 2024-08-31T05:41:12.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.959+0000 7f76a6765740 1 -- 172.21.15.5:0/4038303610 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7690036040 con 0x555a7c1d4390 2024-08-31T05:41:12.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.960+0000 7f76817fa640 1 -- 172.21.15.5:0/4038303610 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f7688010630 con 0x555a7c1d4390 2024-08-31T05:41:12.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.960+0000 7f76a6765740 10 client.18609 fetch_fsmap learned FSMap version 34 2024-08-31T05:41:12.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.960+0000 7f76a6765740 1 -- 172.21.15.5:0/4038303610 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x555a7c5b8c00 con 0x555a7c1d4390 2024-08-31T05:41:12.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.960+0000 7f76817fa640 1 -- 172.21.15.5:0/4038303610 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7690036040 con 0x555a7c1d4390 2024-08-31T05:41:12.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.960+0000 7f76817fa640 1 -- 172.21.15.5:0/4038303610 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f768801c800 con 0x555a7c1d4390 2024-08-31T05:41:12.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.960+0000 7f76a6765740 10 client.18609 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:41:12.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.960+0000 7f76a6765740 10 client.18609 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:41:12.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.960+0000 7f76a6765740 20 client.18609 populate_metadata read hostname 'smithi005' 2024-08-31T05:41:12.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.960+0000 7f76a6765740 1 --2- 172.21.15.5:0/4038303610 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x555a7c1b39f0 0x555a7c5bc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:12.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.960+0000 7f76a6765740 4 client.18609 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:41:12.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.960+0000 7f76a6765740 1 -- 172.21.15.5:0/4038303610 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555a7c513580 con 0x555a7c1b39f0 2024-08-31T05:41:12.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.960+0000 7f769e78d640 1 --2- 172.21.15.5:0/4038303610 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x555a7c1b39f0 0x555a7c5bc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:12.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.961+0000 7f76817fa640 10 client.18609 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:41:12.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.961+0000 7f769e78d640 1 --2- 172.21.15.5:0/4038303610 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x555a7c1b39f0 0x555a7c5bc1b0 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c88fb2bf82050812 server_cookie=81fdc71d7041b643 in_seq=0 out_seq=0 2024-08-31T05:41:12.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.961+0000 7f76817fa640 1 -- 172.21.15.5:0/4038303610 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555a7c513580 con 0x555a7c1b39f0 2024-08-31T05:41:12.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.961+0000 7f76817fa640 10 client.18609 handle_command_reply: tid=0 2024-08-31T05:41:12.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.962+0000 7f76a6765740 1 client.18609 shutdown 2024-08-31T05:41:12.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.962+0000 7f76a6765740 1 -- 172.21.15.5:0/4038303610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555a7c1d4390 msgr2=0x555a7c5aa380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:12.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.962+0000 7f76a6765740 1 --2- 172.21.15.5:0/4038303610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555a7c1d4390 0x555a7c5aa380 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f7688012d20 tx=0x7f768800f790 comp rx=0 tx=0).stop 2024-08-31T05:41:12.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.962+0000 7f76a6765740 1 -- 172.21.15.5:0/4038303610 shutdown_connections 2024-08-31T05:41:12.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.962+0000 7f76a6765740 1 --2- 172.21.15.5:0/4038303610 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x555a7c1b39f0 0x555a7c5bc1b0 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:12.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.962+0000 7f76a6765740 1 --2- 172.21.15.5:0/4038303610 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a7c1f5070 0x555a7c5b6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:12.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.962+0000 7f76a6765740 1 --2- 172.21.15.5:0/4038303610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555a7c1d4390 0x555a7c5aa380 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:12.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.962+0000 7f76817fa640 0 client.18609 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:41:12.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.962+0000 7f76a6765740 1 --2- 172.21.15.5:0/4038303610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555a7c1cc1b0 0x555a7c5a9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:12.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.962+0000 7f76a6765740 1 -- 172.21.15.5:0/4038303610 >> 172.21.15.5:0/4038303610 conn(0x555a7c1e9460 msgr2=0x555a7c5967b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:12.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.962+0000 7f76a6765740 1 -- 172.21.15.5:0/4038303610 shutdown_connections 2024-08-31T05:41:12.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.962+0000 7f76a6765740 1 -- 172.21.15.5:0/4038303610 wait complete. 2024-08-31T05:41:12.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.962+0000 7f76a6765740 20 client.18609 trim_cache size 0 max 16384 2024-08-31T05:41:12.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.981+0000 7f76a6765740 1 Processor -- start 2024-08-31T05:41:12.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.981+0000 7f76a6765740 1 -- start start 2024-08-31T05:41:12.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.981+0000 7f76a6765740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555a7c1b39f0 0x555a7c5b6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:12.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.981+0000 7f76a6765740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555a7c1cc1b0 0x555a7c5b6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:12.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.981+0000 7f76a6765740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a7c1d4390 0x555a7c5a7030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:12.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.981+0000 7f76a6765740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f76981aebb0 con 0x555a7c1cc1b0 2024-08-31T05:41:12.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.981+0000 7f76a6765740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f76981b06f0 con 0x555a7c1b39f0 2024-08-31T05:41:12.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.981+0000 7f76a6765740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f76981af280 con 0x555a7c1d4390 2024-08-31T05:41:12.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.982+0000 7f769d78b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555a7c1cc1b0 0x555a7c5b6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:12.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.982+0000 7f769e78d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555a7c1b39f0 0x555a7c5b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:12.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.982+0000 7f769d78b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555a7c1cc1b0 0x555a7c5b6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35260/0 (socket says 172.21.15.5:35260) 2024-08-31T05:41:12.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.982+0000 7f769d78b640 1 -- 172.21.15.5:0/3732505202 learned_addr learned my addr 172.21.15.5:0/3732505202 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:12.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.982+0000 7f769e78d640 1 --2- 172.21.15.5:0/3732505202 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a7c1d4390 0x555a7c5a7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:12.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.982+0000 7f769e78d640 1 -- 172.21.15.5:0/3732505202 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a7c1d4390 msgr2=0x555a7c5a7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:12.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.982+0000 7f769e78d640 1 --2- 172.21.15.5:0/3732505202 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a7c1d4390 0x555a7c5a7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:12.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.982+0000 7f769e78d640 1 -- 172.21.15.5:0/3732505202 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555a7c1cc1b0 msgr2=0x555a7c5b6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:12.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.982+0000 7f769e78d640 1 --2- 172.21.15.5:0/3732505202 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555a7c1cc1b0 0x555a7c5b6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:12.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.982+0000 7f769e78d640 1 -- 172.21.15.5:0/3732505202 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a7c59d130 con 0x555a7c1b39f0 2024-08-31T05:41:12.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.982+0000 7f769d78b640 1 --2- 172.21.15.5:0/3732505202 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555a7c1cc1b0 0x555a7c5b6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:41:12.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.982+0000 7f769e78d640 1 --2- 172.21.15.5:0/3732505202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555a7c1b39f0 0x555a7c5b6040 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7690009a60 tx=0x7f7690005c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b30f3e4e8f50cbd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:12.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.982+0000 7f76837fe640 1 -- 172.21.15.5:0/3732505202 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7690031af0 con 0x555a7c1b39f0 2024-08-31T05:41:12.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.982+0000 7f76837fe640 1 -- 172.21.15.5:0/3732505202 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7690036030 con 0x555a7c1b39f0 2024-08-31T05:41:12.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.983+0000 7f76837fe640 1 -- 172.21.15.5:0/3732505202 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7690004280 con 0x555a7c1b39f0 2024-08-31T05:41:12.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.983+0000 7f76a6765740 1 -- 172.21.15.5:0/3732505202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555a7c1b39f0 msgr2=0x555a7c5b6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:12.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.983+0000 7f76a6765740 1 --2- 172.21.15.5:0/3732505202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555a7c1b39f0 0x555a7c5b6040 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7690009a60 tx=0x7f7690005c30 comp rx=0 tx=0).stop 2024-08-31T05:41:12.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.983+0000 7f76a6765740 1 -- 172.21.15.5:0/3732505202 shutdown_connections 2024-08-31T05:41:12.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.983+0000 7f76a6765740 1 --2- 172.21.15.5:0/3732505202 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a7c1d4390 0x555a7c5a7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:12.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.983+0000 7f76a6765740 1 --2- 172.21.15.5:0/3732505202 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555a7c1cc1b0 0x555a7c5b6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:12.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.983+0000 7f76a6765740 1 --2- 172.21.15.5:0/3732505202 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555a7c1b39f0 0x555a7c5b6040 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:12.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.983+0000 7f76a6765740 1 -- 172.21.15.5:0/3732505202 >> 172.21.15.5:0/3732505202 conn(0x555a7c1e9460 msgr2=0x555a7c5a86c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:12.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.984+0000 7f76a6765740 1 -- 172.21.15.5:0/3732505202 shutdown_connections 2024-08-31T05:41:12.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.984+0000 7f76a6765740 1 -- 172.21.15.5:0/3732505202 wait complete. 2024-08-31T05:41:12.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.984+0000 7f76a6765740 1 -- start start 2024-08-31T05:41:12.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.984+0000 7f76a6765740 1 Processor -- start 2024-08-31T05:41:12.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.985+0000 7f76a6765740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555a7c1b39f0 0x555a7c5ae9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:12.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.985+0000 7f76a6765740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a7c1cc1b0 0x555a7c5aef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:12.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.985+0000 7f76a6765740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555a7c1d4390 0x555a7c61fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:12.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.985+0000 7f76a6765740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f76981b0020 con 0x555a7c1b39f0 2024-08-31T05:41:12.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.985+0000 7f76a6765740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f76981af950 con 0x555a7c1d4390 2024-08-31T05:41:12.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.985+0000 7f76a6765740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f76981acbb0 con 0x555a7c1cc1b0 2024-08-31T05:41:12.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.985+0000 7f76a6765740 10 client.0 _ll_register_callbacks cb 0x7f7688009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:41:12.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.985+0000 7f769e78d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555a7c1b39f0 0x555a7c5ae9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:12.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.985+0000 7f769e78d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555a7c1b39f0 0x555a7c5ae9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35274/0 (socket says 172.21.15.5:35274) 2024-08-31T05:41:12.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.985+0000 7f769e78d640 1 -- 172.21.15.5:0/3617615982 learned_addr learned my addr 172.21.15.5:0/3617615982 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:12.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.985+0000 7f769d78b640 1 --2- 172.21.15.5:0/3617615982 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a7c1cc1b0 0x555a7c5aef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:12.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.985+0000 7f769e78d640 1 --2- 172.21.15.5:0/3617615982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555a7c1d4390 0x555a7c61fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:12.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.985+0000 7f769e78d640 1 -- 172.21.15.5:0/3617615982 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a7c1cc1b0 msgr2=0x555a7c5aef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:12.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.985+0000 7f769e78d640 1 --2- 172.21.15.5:0/3617615982 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a7c1cc1b0 0x555a7c5aef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:12.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.985+0000 7f769e78d640 1 -- 172.21.15.5:0/3617615982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555a7c1d4390 msgr2=0x555a7c61fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:12.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.985+0000 7f769e78d640 1 --2- 172.21.15.5:0/3617615982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555a7c1d4390 0x555a7c61fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:12.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.985+0000 7f769e78d640 1 -- 172.21.15.5:0/3617615982 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a7c620260 con 0x555a7c1b39f0 2024-08-31T05:41:12.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.985+0000 7f769e78d640 1 --2- 172.21.15.5:0/3617615982 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555a7c1b39f0 0x555a7c5ae9b0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f7690009620 tx=0x7f7690003ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=545246b679f8efc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:12.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.985+0000 7f76817fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:41:12.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.985+0000 7f76817fa640 1 -- 172.21.15.5:0/3617615982 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7690031c70 con 0x555a7c1b39f0 2024-08-31T05:41:12.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.985+0000 7f76a6765740 1 -- 172.21.15.5:0/3617615982 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7690036030 con 0x555a7c1b39f0 2024-08-31T05:41:12.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.986+0000 7f76817fa640 1 -- 172.21.15.5:0/3617615982 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9511+0+0 (secure 0 0 0) 0x7f7690031450 con 0x555a7c1b39f0 2024-08-31T05:41:12.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.986+0000 7f76817fa640 1 -- 172.21.15.5:0/3617615982 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f7690031650 con 0x555a7c1b39f0 2024-08-31T05:41:12.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.986+0000 7f76a6765740 10 client.18615 fetch_fsmap learned FSMap version 34 2024-08-31T05:41:12.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.986+0000 7f76a6765740 1 -- 172.21.15.5:0/3617615982 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x555a7c627570 con 0x555a7c1b39f0 2024-08-31T05:41:12.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.986+0000 7f76817fa640 1 -- 172.21.15.5:0/3617615982 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7690036030 con 0x555a7c1b39f0 2024-08-31T05:41:12.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.986+0000 7f76817fa640 1 -- 172.21.15.5:0/3617615982 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f7690062030 con 0x555a7c1b39f0 2024-08-31T05:41:12.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.986+0000 7f76a6765740 10 client.18615 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:41:12.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.986+0000 7f76a6765740 10 client.18615 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:41:12.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.986+0000 7f76a6765740 20 client.18615 populate_metadata read hostname 'smithi005' 2024-08-31T05:41:12.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.986+0000 7f76a6765740 1 --2- 172.21.15.5:0/3617615982 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x555a7c1f5070 0x555a7c6297a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:12.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.986+0000 7f76a6765740 4 client.18615 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T05:41:12.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.986+0000 7f76a6765740 1 -- 172.21.15.5:0/3617615982 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555a7c50f020 con 0x555a7c1f5070 2024-08-31T05:41:12.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.987+0000 7f769d78b640 1 --2- 172.21.15.5:0/3617615982 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x555a7c1f5070 0x555a7c6297a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:12.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.987+0000 7f76817fa640 10 client.18615 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:41:12.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.987+0000 7f769d78b640 1 --2- 172.21.15.5:0/3617615982 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x555a7c1f5070 0x555a7c6297a0 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de73cfd610d84c2d server_cookie=dc5bfe3ac5b32094 in_seq=0 out_seq=0 2024-08-31T05:41:12.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.988+0000 7f76817fa640 1 -- 172.21.15.5:0/3617615982 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4546 (crc 0 0 0) 0x555a7c50f020 con 0x555a7c1f5070 2024-08-31T05:41:12.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.988+0000 7f76817fa640 10 client.18615 handle_command_reply: tid=0 2024-08-31T05:41:12.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.988+0000 7f76a6765740 1 client.18615 shutdown 2024-08-31T05:41:12.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.988+0000 7f76a6765740 1 -- 172.21.15.5:0/3617615982 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555a7c1b39f0 msgr2=0x555a7c5ae9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:12.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.988+0000 7f76a6765740 1 --2- 172.21.15.5:0/3617615982 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555a7c1b39f0 0x555a7c5ae9b0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f7690009620 tx=0x7f7690003ed0 comp rx=0 tx=0).stop 2024-08-31T05:41:12.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.988+0000 7f76a6765740 1 -- 172.21.15.5:0/3617615982 shutdown_connections 2024-08-31T05:41:12.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.988+0000 7f76a6765740 1 --2- 172.21.15.5:0/3617615982 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x555a7c1f5070 0x555a7c6297a0 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:12.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.988+0000 7f76a6765740 1 --2- 172.21.15.5:0/3617615982 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x555a7c1d4390 0x555a7c61fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:12.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.988+0000 7f76a6765740 1 --2- 172.21.15.5:0/3617615982 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a7c1cc1b0 0x555a7c5aef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:12.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.988+0000 7f76a6765740 1 --2- 172.21.15.5:0/3617615982 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x555a7c1b39f0 0x555a7c5ae9b0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:12.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.988+0000 7f76817fa640 0 client.18615 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:41:12.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.988+0000 7f76a6765740 1 -- 172.21.15.5:0/3617615982 >> 172.21.15.5:0/3617615982 conn(0x555a7c1e9460 msgr2=0x555a7c59b330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:12.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.988+0000 7f76a6765740 1 -- 172.21.15.5:0/3617615982 shutdown_connections 2024-08-31T05:41:12.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.988+0000 7f76a6765740 1 -- 172.21.15.5:0/3617615982 wait complete. 2024-08-31T05:41:12.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.988+0000 7f76a6765740 20 client.18615 trim_cache size 0 max 16384 2024-08-31T05:41:12.996 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:41:12.996 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T05:41:12.996 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2024-08-31T05:41:12.996 INFO:teuthology.orchestra.run.smithi005.stdout: "c9a687a5-4adf-4788-8f18-4c06352efa9b": { 2024-08-31T05:41:12.996 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:41:12.996 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "c9a687a5-4adf-4788-8f18-4c06352efa9b", 2024-08-31T05:41:12.996 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2024-08-31T05:41:12.996 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:41:12.996 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:41:12.996 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_stats": { 2024-08-31T05:41:12.997 INFO:teuthology.orchestra.run.smithi005.stdout: "ab2853ca-505f-43fc-a132-af8bca186292": { 2024-08-31T05:41:12.997 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:40:23.937602+0000", 2024-08-31T05:41:12.997 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:41:12.997 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:41:12.997 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:41:12.997 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:41:12.997 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:41:12.997 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:41:12.997 INFO:teuthology.orchestra.run.smithi005.stdout: "75d84398-5d9c-4872-b879-2fbce045fa71": { 2024-08-31T05:41:12.997 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:06.642335+0000", 2024-08-31T05:41:12.997 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:41:12.997 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:41:12.997 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:41:12.997 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:41:12.998 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:41:12.998 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:41:12.998 INFO:teuthology.orchestra.run.smithi005.stdout: "ece37b07-9ab2-45f8-bc33-2755a07aac0b": { 2024-08-31T05:41:12.998 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:31:41.782407+0000", 2024-08-31T05:41:12.998 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:41:12.998 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:41:12.998 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:41:12.998 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:41:12.998 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:41:12.998 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:41:12.998 INFO:teuthology.orchestra.run.smithi005.stdout: "728a42ca-bbef-4151-830f-5fdd411d8fa0": { 2024-08-31T05:41:12.998 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:32:30.554906+0000", 2024-08-31T05:41:12.998 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:41:12.998 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:41:12.999 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:41:12.999 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:41:12.999 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:41:12.999 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:41:12.999 INFO:teuthology.orchestra.run.smithi005.stdout: "cda92ac0-b35f-47a5-a3a5-471c888462a5": { 2024-08-31T05:41:12.999 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:53.103905+0000", 2024-08-31T05:41:12.999 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:41:12.999 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:41:12.999 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:41:12.999 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:41:12.999 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:41:12.999 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:41:12.999 INFO:teuthology.orchestra.run.smithi005.stdout: "0bb67292-013a-40c7-b5fc-810bdd9715d8": { 2024-08-31T05:41:12.999 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:34:04.586008+0000", 2024-08-31T05:41:13.000 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:41:13.000 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:41:13.000 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:41:13.000 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:41:13.000 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:41:13.000 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:41:13.000 INFO:teuthology.orchestra.run.smithi005.stdout: "c9a687a5-4adf-4788-8f18-4c06352efa9b": { 2024-08-31T05:41:13.000 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:41:11.380197+0000", 2024-08-31T05:41:13.000 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:41:13.000 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:41:13.000 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:41:13.000 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:41:13.000 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:41:13.001 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:41:13.001 INFO:teuthology.orchestra.run.smithi005.stdout: "de9731c7-ae4a-42fe-8146-e4752cdc40d4": { 2024-08-31T05:41:13.001 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:34:53.614499+0000", 2024-08-31T05:41:13.001 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:41:13.001 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:41:13.001 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:41:13.001 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:41:13.001 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:41:13.001 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:41:13.001 INFO:teuthology.orchestra.run.smithi005.stdout: "f4db3406-20ff-46a3-baf9-099e16392f76": { 2024-08-31T05:41:13.001 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:38:49.034412+0000", 2024-08-31T05:41:13.001 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:41:13.001 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:41:13.001 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:41:13.002 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:41:13.002 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:41:13.002 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:41:13.002 INFO:teuthology.orchestra.run.smithi005.stdout: "095ccc7a-f368-4bc6-9563-5930e21f9b4a": { 2024-08-31T05:41:13.002 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:35:40.190069+0000", 2024-08-31T05:41:13.002 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:41:13.002 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:41:13.002 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:41:13.002 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:41:13.002 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:41:13.002 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:41:13.002 INFO:teuthology.orchestra.run.smithi005.stdout: "297c26f3-7b4d-4245-abb0-f854248e5e1b": { 2024-08-31T05:41:13.002 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:37:14.019244+0000", 2024-08-31T05:41:13.002 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:41:13.003 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:41:13.003 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:41:13.003 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:41:13.003 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:41:13.003 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:41:13.003 INFO:teuthology.orchestra.run.smithi005.stdout: "a4d4cf74-2477-4dd9-a3a2-3762b4dd87e4": { 2024-08-31T05:41:13.003 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:38:01.378833+0000", 2024-08-31T05:41:13.003 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:41:13.003 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:41:13.003 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:41:13.003 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:41:13.003 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:41:13.003 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:41:13.004 INFO:teuthology.orchestra.run.smithi005.stdout: "94c23057-592d-4a8b-82d7-da2d84f8740b": { 2024-08-31T05:41:13.004 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:36:27.513638+0000", 2024-08-31T05:41:13.004 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:41:13.004 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:41:13.004 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:41:13.004 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:41:13.004 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:41:13.004 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:41:13.004 INFO:teuthology.orchestra.run.smithi005.stdout: "2445fc42-b797-434f-b380-e2da985b4d98": { 2024-08-31T05:41:13.004 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:33:17.681453+0000", 2024-08-31T05:41:13.004 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:41:13.004 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:41:13.004 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:41:13.004 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:41:13.005 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:41:13.005 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:41:13.005 INFO:teuthology.orchestra.run.smithi005.stdout: "239b7958-db06-4432-93ce-b7552effa357": { 2024-08-31T05:41:13.005 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:39:35.733028+0000", 2024-08-31T05:41:13.005 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:41:13.005 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:41:13.005 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:41:13.005 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:41:13.005 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:41:13.005 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:41:13.005 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:41:13.005 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:41:13.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.989+0000 7f76a01f0640 1 -- 172.21.15.5:0/1560050149 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f76840b4ca0 msgr2=0x7f76840b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:13.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.989+0000 7f76a01f0640 1 --2- 172.21.15.5:0/1560050149 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f76840b4ca0 0x7f76840b71b0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f76940e3190 tx=0x7f76940a6040 comp rx=0 tx=0).stop 2024-08-31T05:41:13.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.989+0000 7f76a01f0640 1 -- 172.21.15.5:0/1560050149 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7698104600 msgr2=0x7f769819a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:13.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.989+0000 7f76a01f0640 1 --2- 172.21.15.5:0/1560050149 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7698104600 0x7f769819a260 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f769400e9c0 tx=0x7f769400ee80 comp rx=0 tx=0).stop 2024-08-31T05:41:13.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.989+0000 7f76a01f0640 1 -- 172.21.15.5:0/1560050149 shutdown_connections 2024-08-31T05:41:13.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.989+0000 7f76a01f0640 1 --2- 172.21.15.5:0/1560050149 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f76840b4ca0 0x7f76840b71b0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:13.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.989+0000 7f76a01f0640 1 --2- 172.21.15.5:0/1560050149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f769810dbb0 0x7f769819faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:13.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.989+0000 7f76a01f0640 1 --2- 172.21.15.5:0/1560050149 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7698105030 0x7f769819a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:13.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.989+0000 7f76a01f0640 1 --2- 172.21.15.5:0/1560050149 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7698104600 0x7f769819a260 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:13.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.989+0000 7f76a01f0640 1 -- 172.21.15.5:0/1560050149 >> 172.21.15.5:0/1560050149 conn(0x7f76980794e0 msgr2=0x7f76980ff310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:13.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.989+0000 7f76a01f0640 1 -- 172.21.15.5:0/1560050149 shutdown_connections 2024-08-31T05:41:13.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:12.989+0000 7f76a01f0640 1 -- 172.21.15.5:0/1560050149 wait complete. 2024-08-31T05:41:13.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:41:12 smithi050 ceph-mon[22146]: scrub summary: active paths [/] 2024-08-31T05:41:13.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:41:12 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:41:13.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:41:12 smithi050 ceph-mon[22146]: pgmap v692: 129 pgs: 129 active+clean; 563 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.6 MiB/s wr, 247 op/s 2024-08-31T05:41:13.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:41:12 smithi005 ceph-mon[18602]: scrub summary: active paths [/] 2024-08-31T05:41:13.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:41:12 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:41:13.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:41:12 smithi005 ceph-mon[18602]: pgmap v692: 129 pgs: 129 active+clean; 563 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.6 MiB/s wr, 247 op/s 2024-08-31T05:41:13.236 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:41:12 smithi070 ceph-mon[22316]: scrub summary: active paths [/] 2024-08-31T05:41:13.237 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:41:12 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:41:13.237 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:41:12 smithi070 ceph-mon[22316]: pgmap v692: 129 pgs: 129 active+clean; 563 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.6 MiB/s wr, 247 op/s 2024-08-31T05:41:13.917 INFO:tasks.cephfs.filesystem:scrub status for tag:c9a687a5-4adf-4788-8f18-4c06352efa9b - {'path': '/', 'tag': 'c9a687a5-4adf-4788-8f18-4c06352efa9b', 'options': 'recursive,force'} 2024-08-31T05:41:13.938 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1265708 10.86 MB/sec execute 481 sec latency 25.056 ms 2024-08-31T05:41:14.938 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1268083 10.87 MB/sec execute 482 sec latency 16.380 ms 2024-08-31T05:41:15.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:41:14 smithi050 ceph-mon[22146]: pgmap v693: 129 pgs: 129 active+clean; 555 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.0 MiB/s wr, 218 op/s 2024-08-31T05:41:15.175 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:41:14 smithi005 ceph-mon[18602]: pgmap v693: 129 pgs: 129 active+clean; 555 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.0 MiB/s wr, 218 op/s 2024-08-31T05:41:15.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:41:14 smithi070 ceph-mon[22316]: pgmap v693: 129 pgs: 129 active+clean; 555 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.0 MiB/s wr, 218 op/s 2024-08-31T05:41:15.938 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1269484 10.86 MB/sec execute 483 sec latency 59.082 ms 2024-08-31T05:41:16.938 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1271637 10.86 MB/sec execute 484 sec latency 17.054 ms 2024-08-31T05:41:17.173 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:41:16 smithi070 ceph-mon[22316]: pgmap v694: 129 pgs: 129 active+clean; 569 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 5.1 MiB/s wr, 219 op/s 2024-08-31T05:41:17.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:41:16 smithi005 ceph-mon[18602]: pgmap v694: 129 pgs: 129 active+clean; 569 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 5.1 MiB/s wr, 219 op/s 2024-08-31T05:41:17.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:41:16 smithi050 ceph-mon[22146]: pgmap v694: 129 pgs: 129 active+clean; 569 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 5.1 MiB/s wr, 219 op/s 2024-08-31T05:41:17.938 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1272841 10.85 MB/sec execute 485 sec latency 134.668 ms 2024-08-31T05:41:18.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:41:17 smithi005 ceph-mon[18602]: scrub summary: idle 2024-08-31T05:41:18.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:41:17 smithi070 ceph-mon[22316]: scrub summary: idle 2024-08-31T05:41:18.408 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:41:17 smithi050 ceph-mon[22146]: scrub summary: idle 2024-08-31T05:41:18.938 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1275051 10.85 MB/sec execute 486 sec latency 22.106 ms 2024-08-31T05:41:19.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:41:18 smithi005 ceph-mon[18602]: scrub summary: idle 2024-08-31T05:41:19.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:41:18 smithi005 ceph-mon[18602]: pgmap v695: 129 pgs: 129 active+clean; 573 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.6 MiB/s wr, 244 op/s 2024-08-31T05:41:19.238 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.235+0000 7f7476ea9640 1 -- 172.21.15.5:0/3601862732 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7470108090 msgr2=0x7f74701084a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:19.238 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.235+0000 7f7476ea9640 1 --2- 172.21.15.5:0/3601862732 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7470108090 0x7f74701084a0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f745c009900 tx=0x7f745c02a410 comp rx=0 tx=0).stop 2024-08-31T05:41:19.238 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.235+0000 7f7476ea9640 1 -- 172.21.15.5:0/3601862732 shutdown_connections 2024-08-31T05:41:19.238 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.235+0000 7f7476ea9640 1 --2- 172.21.15.5:0/3601862732 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74701089e0 0x7f747010f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:19.238 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.235+0000 7f7476ea9640 1 --2- 172.21.15.5:0/3601862732 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7470108090 0x7f74701084a0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:19.238 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.235+0000 7f7476ea9640 1 --2- 172.21.15.5:0/3601862732 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7470102760 0x7f7470102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:19.238 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.235+0000 7f7476ea9640 1 -- 172.21.15.5:0/3601862732 >> 172.21.15.5:0/3601862732 conn(0x7f74700fe160 msgr2=0x7f74701005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:19.238 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.235+0000 7f7476ea9640 1 -- 172.21.15.5:0/3601862732 shutdown_connections 2024-08-31T05:41:19.238 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.235+0000 7f7476ea9640 1 -- 172.21.15.5:0/3601862732 wait complete. 2024-08-31T05:41:19.238 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.236+0000 7f7476ea9640 1 Processor -- start 2024-08-31T05:41:19.238 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.236+0000 7f7476ea9640 1 -- start start 2024-08-31T05:41:19.240 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.236+0000 7f7476ea9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7470102760 0x7f747019afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:19.240 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.236+0000 7f7476ea9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7470108090 0x7f747019b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:19.240 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.236+0000 7f7476ea9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74701089e0 0x7f747019ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:19.240 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.236+0000 7f7476ea9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7470112670 con 0x7f7470102760 2024-08-31T05:41:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.236+0000 7f7476ea9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f74701124f0 con 0x7f74701089e0 2024-08-31T05:41:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.236+0000 7f7476ea9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f74701127f0 con 0x7f7470108090 2024-08-31T05:41:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.236+0000 7f7474c45640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7470102760 0x7f747019afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.236+0000 7f7474c45640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7470102760 0x7f747019afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35288/0 (socket says 172.21.15.5:35288) 2024-08-31T05:41:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.236+0000 7f7474c45640 1 -- 172.21.15.5:0/1821767614 learned_addr learned my addr 172.21.15.5:0/1821767614 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.236+0000 7f746ffff640 1 --2- 172.21.15.5:0/1821767614 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7470108090 0x7f747019b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.236+0000 7f7475446640 1 --2- 172.21.15.5:0/1821767614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74701089e0 0x7f747019ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.237+0000 7f7474c45640 1 -- 172.21.15.5:0/1821767614 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7470108090 msgr2=0x7f747019b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.237+0000 7f7474c45640 1 --2- 172.21.15.5:0/1821767614 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7470108090 0x7f747019b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.237+0000 7f7474c45640 1 -- 172.21.15.5:0/1821767614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74701089e0 msgr2=0x7f747019ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.237+0000 7f7474c45640 1 --2- 172.21.15.5:0/1821767614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74701089e0 0x7f747019ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.237+0000 7f7474c45640 1 -- 172.21.15.5:0/1821767614 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74701a6270 con 0x7f7470102760 2024-08-31T05:41:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.237+0000 7f7474c45640 1 --2- 172.21.15.5:0/1821767614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7470102760 0x7f747019afe0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f746400e9f0 tx=0x7f746400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:19.242 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.237+0000 7f746dffb640 1 -- 172.21.15.5:0/1821767614 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f746400cd80 con 0x7f7470102760 2024-08-31T05:41:19.242 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.237+0000 7f7476ea9640 1 -- 172.21.15.5:0/1821767614 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74701a6560 con 0x7f7470102760 2024-08-31T05:41:19.242 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.237+0000 7f746dffb640 1 -- 172.21.15.5:0/1821767614 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74640108e0 con 0x7f7470102760 2024-08-31T05:41:19.242 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.237+0000 7f746dffb640 1 -- 172.21.15.5:0/1821767614 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7464018980 con 0x7f7470102760 2024-08-31T05:41:19.242 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.237+0000 7f7476ea9640 1 -- 172.21.15.5:0/1821767614 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74701a6a80 con 0x7f7470102760 2024-08-31T05:41:19.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.240+0000 7f747de19740 1 Processor -- start 2024-08-31T05:41:19.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.240+0000 7f747de19740 1 -- start start 2024-08-31T05:41:19.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.241+0000 7f747de19740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5595d5e3b1b0 0x5595d61dece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:19.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.241+0000 7f747de19740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595d5e122f0 0x5595d61df220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:19.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.241+0000 7f747de19740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5595d5e1a4d0 0x5595d61df760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:19.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.241+0000 7f747de19740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5595d6154000 con 0x5595d5e1a4d0 2024-08-31T05:41:19.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.241+0000 7f747de19740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5595d6143590 con 0x5595d5e3b1b0 2024-08-31T05:41:19.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.241+0000 7f747de19740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5595d6147540 con 0x5595d5e122f0 2024-08-31T05:41:19.245 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.241+0000 7f746dffb640 1 -- 172.21.15.5:0/1821767614 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f7464010430 con 0x7f7470102760 2024-08-31T05:41:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.241+0000 7f746ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5595d5e1a4d0 0x5595d61df760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.241+0000 7f7475446640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5595d5e3b1b0 0x5595d61dece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.241+0000 7f746ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5595d5e1a4d0 0x5595d61df760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35290/0 (socket says 172.21.15.5:35290) 2024-08-31T05:41:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.241+0000 7f746ffff640 1 -- 172.21.15.5:0/896325734 learned_addr learned my addr 172.21.15.5:0/896325734 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.241+0000 7f7474c45640 1 --2- 172.21.15.5:0/896325734 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595d5e122f0 0x5595d61df220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.241+0000 7f7475446640 1 -- 172.21.15.5:0/896325734 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595d5e122f0 msgr2=0x5595d61df220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.241+0000 7f7475446640 1 --2- 172.21.15.5:0/896325734 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595d5e122f0 0x5595d61df220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.241+0000 7f7475446640 1 -- 172.21.15.5:0/896325734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5595d5e1a4d0 msgr2=0x5595d61df760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.241+0000 7f7475446640 1 --2- 172.21.15.5:0/896325734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5595d5e1a4d0 0x5595d61df760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.241+0000 7f7475446640 1 -- 172.21.15.5:0/896325734 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595d5ea6790 con 0x5595d5e3b1b0 2024-08-31T05:41:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.241+0000 7f7475446640 1 --2- 172.21.15.5:0/896325734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5595d5e3b1b0 0x5595d61dece0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7468009f30 tx=0x7f74680118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f6acd9dfc19149d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.242+0000 7f745affd640 1 -- 172.21.15.5:0/896325734 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7468004d20 con 0x5595d5e3b1b0 2024-08-31T05:41:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.242+0000 7f746dffb640 1 --2- 172.21.15.5:0/1821767614 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f74600b4ca0 0x7f74600b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.242+0000 7f745affd640 1 -- 172.21.15.5:0/896325734 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7468004050 con 0x5595d5e3b1b0 2024-08-31T05:41:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.242+0000 7f745affd640 1 -- 172.21.15.5:0/896325734 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7468005280 con 0x5595d5e3b1b0 2024-08-31T05:41:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.242+0000 7f7474c45640 1 --2- 172.21.15.5:0/1821767614 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f74600b4ca0 0x7f74600b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.242+0000 7f746dffb640 1 -- 172.21.15.5:0/1821767614 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9511+0+0 (secure 0 0 0) 0x7f74640e5c30 con 0x7f7470102760 2024-08-31T05:41:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.242+0000 7f747de19740 1 -- 172.21.15.5:0/896325734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5595d5e3b1b0 msgr2=0x5595d61dece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.242+0000 7f7474c45640 1 --2- 172.21.15.5:0/1821767614 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f74600b4ca0 0x7f74600b71b0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f74640e3050 tx=0x7f7464000bc0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.242+0000 7f747de19740 1 --2- 172.21.15.5:0/896325734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5595d5e3b1b0 0x5595d61dece0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7468009f30 tx=0x7f74680118d0 comp rx=0 tx=0).stop 2024-08-31T05:41:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.243+0000 7f747de19740 1 -- 172.21.15.5:0/896325734 shutdown_connections 2024-08-31T05:41:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.243+0000 7f747de19740 1 --2- 172.21.15.5:0/896325734 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5595d5e1a4d0 0x5595d61df760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.243+0000 7f747de19740 1 --2- 172.21.15.5:0/896325734 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595d5e122f0 0x5595d61df220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.243+0000 7f747de19740 1 --2- 172.21.15.5:0/896325734 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5595d5e3b1b0 0x5595d61dece0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.243+0000 7f747de19740 1 -- 172.21.15.5:0/896325734 >> 172.21.15.5:0/896325734 conn(0x5595d5e2f300 msgr2=0x5595d61dcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:19.247 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.243+0000 7f747de19740 1 -- 172.21.15.5:0/896325734 shutdown_connections 2024-08-31T05:41:19.248 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.243+0000 7f747de19740 1 -- 172.21.15.5:0/896325734 wait complete. 2024-08-31T05:41:19.248 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.243+0000 7f747de19740 1 -- start start 2024-08-31T05:41:19.248 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.243+0000 7f747de19740 1 Processor -- start 2024-08-31T05:41:19.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.244+0000 7f747de19740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5595d5e122f0 0x5595d61ea820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:19.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.244+0000 7f747de19740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5595d5e1a4d0 0x5595d61ead60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:19.251 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.244+0000 7f747de19740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595d5e3b1b0 0x5595d61f67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:19.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.244+0000 7f747de19740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5595d607cab0 con 0x5595d5e122f0 2024-08-31T05:41:19.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.244+0000 7f747de19740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5595d60ca680 con 0x5595d5e1a4d0 2024-08-31T05:41:19.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.244+0000 7f747de19740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5595d61ed460 con 0x5595d5e3b1b0 2024-08-31T05:41:19.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.244+0000 7f747de19740 10 client.0 _ll_register_callbacks cb 0x5595d5e52a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:41:19.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.244+0000 7f7475446640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5595d5e122f0 0x5595d61ea820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:19.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.244+0000 7f746ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5595d5e1a4d0 0x5595d61ead60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:19.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.244+0000 7f7475446640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5595d5e122f0 0x5595d61ea820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35304/0 (socket says 172.21.15.5:35304) 2024-08-31T05:41:19.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.244+0000 7f7475446640 1 -- 172.21.15.5:0/1019445770 learned_addr learned my addr 172.21.15.5:0/1019445770 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:19.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.244+0000 7f7475446640 1 --2- 172.21.15.5:0/1019445770 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595d5e3b1b0 0x5595d61f67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:19.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.244+0000 7f746ffff640 1 -- 172.21.15.5:0/1019445770 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595d5e3b1b0 msgr2=0x5595d61f67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:19.252 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.244+0000 7f746ffff640 1 --2- 172.21.15.5:0/1019445770 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595d5e3b1b0 0x5595d61f67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:19.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.244+0000 7f746ffff640 1 -- 172.21.15.5:0/1019445770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5595d5e122f0 msgr2=0x5595d61ea820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:19.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.244+0000 7f746ffff640 1 --2- 172.21.15.5:0/1019445770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5595d5e122f0 0x5595d61ea820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:19.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.244+0000 7f746ffff640 1 -- 172.21.15.5:0/1019445770 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595d5f1f620 con 0x5595d5e1a4d0 2024-08-31T05:41:19.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.244+0000 7f746ffff640 1 --2- 172.21.15.5:0/1019445770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5595d5e1a4d0 0x5595d61ead60 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f745c009230 tx=0x7f745c005f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=babc69ee64ae772d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:19.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.244+0000 7f744ffff640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:41:19.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.244+0000 7f744ffff640 1 -- 172.21.15.5:0/1019445770 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f745c035040 con 0x5595d5e1a4d0 2024-08-31T05:41:19.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.244+0000 7f744ffff640 1 -- 172.21.15.5:0/1019445770 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9511+0+0 (secure 0 0 0) 0x7f745c0316a0 con 0x5595d5e1a4d0 2024-08-31T05:41:19.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.244+0000 7f747de19740 1 -- 172.21.15.5:0/1019445770 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7468004050 con 0x5595d5e1a4d0 2024-08-31T05:41:19.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.245+0000 7f744ffff640 1 -- 172.21.15.5:0/1019445770 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f745c0318a0 con 0x5595d5e1a4d0 2024-08-31T05:41:19.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.245+0000 7f747de19740 10 client.28187 fetch_fsmap learned FSMap version 34 2024-08-31T05:41:19.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.245+0000 7f747de19740 1 -- 172.21.15.5:0/1019445770 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5595d61f9460 con 0x5595d5e1a4d0 2024-08-31T05:41:19.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.245+0000 7f744ffff640 1 -- 172.21.15.5:0/1019445770 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7468004050 con 0x5595d5e1a4d0 2024-08-31T05:41:19.253 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.245+0000 7f744ffff640 1 -- 172.21.15.5:0/1019445770 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f745c004750 con 0x5595d5e1a4d0 2024-08-31T05:41:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.245+0000 7f747de19740 10 client.28187 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:41:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.245+0000 7f747de19740 10 client.28187 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:41:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.245+0000 7f747de19740 20 client.28187 populate_metadata read hostname 'smithi005' 2024-08-31T05:41:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.245+0000 7f747de19740 1 --2- 172.21.15.5:0/1019445770 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5595d5df9d80 0x5595d61fc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.245+0000 7f747de19740 4 client.28187 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:41:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.245+0000 7f747de19740 1 -- 172.21.15.5:0/1019445770 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5595d6155f50 con 0x5595d5df9d80 2024-08-31T05:41:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.245+0000 7f7475446640 1 --2- 172.21.15.5:0/1019445770 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5595d5df9d80 0x5595d61fc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.246+0000 7f744ffff640 10 client.28187 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:41:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.246+0000 7f7475446640 1 --2- 172.21.15.5:0/1019445770 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5595d5df9d80 0x5595d61fc9b0 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a59b9e7301135d4e server_cookie=ff0eb800426d4968 in_seq=0 out_seq=0 2024-08-31T05:41:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.246+0000 7f744ffff640 1 -- 172.21.15.5:0/1019445770 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5595d6155f50 con 0x5595d5df9d80 2024-08-31T05:41:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.246+0000 7f744ffff640 10 client.28187 handle_command_reply: tid=0 2024-08-31T05:41:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.246+0000 7f747de19740 1 client.28187 shutdown 2024-08-31T05:41:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.246+0000 7f747de19740 1 -- 172.21.15.5:0/1019445770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5595d5e1a4d0 msgr2=0x5595d61ead60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:19.255 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.246+0000 7f747de19740 1 --2- 172.21.15.5:0/1019445770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5595d5e1a4d0 0x5595d61ead60 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f745c009230 tx=0x7f745c005f30 comp rx=0 tx=0).stop 2024-08-31T05:41:19.255 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.247+0000 7f747de19740 1 -- 172.21.15.5:0/1019445770 shutdown_connections 2024-08-31T05:41:19.255 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.247+0000 7f747de19740 1 --2- 172.21.15.5:0/1019445770 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5595d5df9d80 0x5595d61fc9b0 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:19.255 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.247+0000 7f747de19740 1 --2- 172.21.15.5:0/1019445770 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595d5e3b1b0 0x5595d61f67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:19.255 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.247+0000 7f744ffff640 0 client.28187 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:41:19.255 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.247+0000 7f747de19740 1 --2- 172.21.15.5:0/1019445770 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5595d5e1a4d0 0x5595d61ead60 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:19.255 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.247+0000 7f747de19740 1 --2- 172.21.15.5:0/1019445770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5595d5e122f0 0x5595d61ea820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:19.255 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.247+0000 7f747de19740 1 -- 172.21.15.5:0/1019445770 >> 172.21.15.5:0/1019445770 conn(0x5595d5e2f300 msgr2=0x5595d61dfd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:19.255 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.247+0000 7f747de19740 1 -- 172.21.15.5:0/1019445770 shutdown_connections 2024-08-31T05:41:19.255 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.247+0000 7f747de19740 1 -- 172.21.15.5:0/1019445770 wait complete. 2024-08-31T05:41:19.255 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.247+0000 7f747de19740 20 client.28187 trim_cache size 0 max 16384 2024-08-31T05:41:19.265 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.261+0000 7f747de19740 1 Processor -- start 2024-08-31T05:41:19.266 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.261+0000 7f747de19740 1 -- start start 2024-08-31T05:41:19.266 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.262+0000 7f747de19740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595d5df9d80 0x5595d61ec240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:19.266 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.262+0000 7f747de19740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5595d5e122f0 0x5595d61e9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:19.266 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.262+0000 7f747de19740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5595d5e1a4d0 0x5595d61dc180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:19.266 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.262+0000 7f747de19740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f74701b0cf0 con 0x5595d5e122f0 2024-08-31T05:41:19.266 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.262+0000 7f747de19740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f74701b2830 con 0x5595d5e1a4d0 2024-08-31T05:41:19.266 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.262+0000 7f747de19740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f74701b13c0 con 0x5595d5df9d80 2024-08-31T05:41:19.266 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.262+0000 7f746ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5595d5e122f0 0x5595d61e9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:19.266 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.262+0000 7f746ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5595d5e122f0 0x5595d61e9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35320/0 (socket says 172.21.15.5:35320) 2024-08-31T05:41:19.266 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.262+0000 7f746ffff640 1 -- 172.21.15.5:0/455216044 learned_addr learned my addr 172.21.15.5:0/455216044 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:19.266 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.262+0000 7f7475446640 1 --2- 172.21.15.5:0/455216044 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595d5df9d80 0x5595d61ec240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:19.266 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.262+0000 7f7475446640 1 --2- 172.21.15.5:0/455216044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5595d5e1a4d0 0x5595d61dc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:19.266 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.262+0000 7f746ffff640 1 -- 172.21.15.5:0/455216044 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595d5df9d80 msgr2=0x5595d61ec240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:19.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.262+0000 7f746ffff640 1 --2- 172.21.15.5:0/455216044 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595d5df9d80 0x5595d61ec240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:19.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.262+0000 7f746ffff640 1 -- 172.21.15.5:0/455216044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5595d5e1a4d0 msgr2=0x5595d61dc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:19.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.262+0000 7f746ffff640 1 --2- 172.21.15.5:0/455216044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5595d5e1a4d0 0x5595d61dc180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:19.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.262+0000 7f746ffff640 1 -- 172.21.15.5:0/455216044 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595d61eb0f0 con 0x5595d5e122f0 2024-08-31T05:41:19.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.262+0000 7f7475446640 1 --2- 172.21.15.5:0/455216044 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595d5df9d80 0x5595d61ec240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:41:19.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.262+0000 7f746ffff640 1 --2- 172.21.15.5:0/455216044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5595d5e122f0 0x5595d61e9e80 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f745c02a450 tx=0x7f745c005e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ffd7d9f3690ba23 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:19.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.262+0000 7f745a7fc640 1 -- 172.21.15.5:0/455216044 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f745c058070 con 0x5595d5e122f0 2024-08-31T05:41:19.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.262+0000 7f745a7fc640 1 -- 172.21.15.5:0/455216044 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f745c0048c0 con 0x5595d5e122f0 2024-08-31T05:41:19.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.262+0000 7f745a7fc640 1 -- 172.21.15.5:0/455216044 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f745c035030 con 0x5595d5e122f0 2024-08-31T05:41:19.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.263+0000 7f747de19740 1 -- 172.21.15.5:0/455216044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5595d5e122f0 msgr2=0x5595d61e9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:19.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.263+0000 7f747de19740 1 --2- 172.21.15.5:0/455216044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5595d5e122f0 0x5595d61e9e80 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f745c02a450 tx=0x7f745c005e40 comp rx=0 tx=0).stop 2024-08-31T05:41:19.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.263+0000 7f747de19740 1 -- 172.21.15.5:0/455216044 shutdown_connections 2024-08-31T05:41:19.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.263+0000 7f747de19740 1 --2- 172.21.15.5:0/455216044 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5595d5e1a4d0 0x5595d61dc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:19.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.263+0000 7f747de19740 1 --2- 172.21.15.5:0/455216044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5595d5e122f0 0x5595d61e9e80 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:19.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.263+0000 7f747de19740 1 --2- 172.21.15.5:0/455216044 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595d5df9d80 0x5595d61ec240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:19.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.263+0000 7f747de19740 1 -- 172.21.15.5:0/455216044 >> 172.21.15.5:0/455216044 conn(0x5595d5e2f300 msgr2=0x5595d61ebb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:19.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.263+0000 7f747de19740 1 -- 172.21.15.5:0/455216044 shutdown_connections 2024-08-31T05:41:19.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.263+0000 7f747de19740 1 -- 172.21.15.5:0/455216044 wait complete. 2024-08-31T05:41:19.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.264+0000 7f747de19740 1 -- start start 2024-08-31T05:41:19.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.264+0000 7f747de19740 1 Processor -- start 2024-08-31T05:41:19.271 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.264+0000 7f747de19740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5595d5df9d80 0x5595d61f3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:19.271 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.264+0000 7f747de19740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595d5e122f0 0x5595d61ee4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:19.271 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.264+0000 7f747de19740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5595d5e1a4d0 0x5595d61eeb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:19.271 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.264+0000 7f747de19740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f74701b2160 con 0x5595d5df9d80 2024-08-31T05:41:19.271 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.264+0000 7f747de19740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f74701b1a90 con 0x5595d5e1a4d0 2024-08-31T05:41:19.271 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.264+0000 7f747de19740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f74701aecf0 con 0x5595d5e122f0 2024-08-31T05:41:19.271 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.264+0000 7f747de19740 10 client.0 _ll_register_callbacks cb 0x7f745c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:41:19.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.264+0000 7f7475446640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5595d5df9d80 0x5595d61f3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:19.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.264+0000 7f7475446640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5595d5df9d80 0x5595d61f3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35326/0 (socket says 172.21.15.5:35326) 2024-08-31T05:41:19.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.264+0000 7f7475446640 1 -- 172.21.15.5:0/1658070489 learned_addr learned my addr 172.21.15.5:0/1658070489 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:19.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.264+0000 7f746ffff640 1 --2- 172.21.15.5:0/1658070489 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595d5e122f0 0x5595d61ee4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:19.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.264+0000 7f7475446640 1 --2- 172.21.15.5:0/1658070489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5595d5e1a4d0 0x5595d61eeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:19.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.264+0000 7f7475446640 1 -- 172.21.15.5:0/1658070489 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595d5e122f0 msgr2=0x5595d61ee4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:19.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.264+0000 7f7475446640 1 --2- 172.21.15.5:0/1658070489 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595d5e122f0 0x5595d61ee4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:19.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.264+0000 7f7475446640 1 -- 172.21.15.5:0/1658070489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5595d5e1a4d0 msgr2=0x5595d61eeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:19.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.264+0000 7f7475446640 1 --2- 172.21.15.5:0/1658070489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5595d5e1a4d0 0x5595d61eeb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:19.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.264+0000 7f7475446640 1 -- 172.21.15.5:0/1658070489 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595d61ef2f0 con 0x5595d5df9d80 2024-08-31T05:41:19.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.265+0000 7f7475446640 1 --2- 172.21.15.5:0/1658070489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5595d5df9d80 0x5595d61f3040 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f7468006010 tx=0x7f7468005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85920bf9585a3587 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:19.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.265+0000 7f744ffff640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:41:19.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.265+0000 7f744ffff640 1 -- 172.21.15.5:0/1658070489 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74680095c0 con 0x5595d5df9d80 2024-08-31T05:41:19.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.265+0000 7f744ffff640 1 -- 172.21.15.5:0/1658070489 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9511+0+0 (secure 0 0 0) 0x7f74680044a0 con 0x5595d5df9d80 2024-08-31T05:41:19.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.265+0000 7f747de19740 1 -- 172.21.15.5:0/1658070489 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f745c0048c0 con 0x5595d5df9d80 2024-08-31T05:41:19.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.265+0000 7f744ffff640 1 -- 172.21.15.5:0/1658070489 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f74680046a0 con 0x5595d5df9d80 2024-08-31T05:41:19.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.265+0000 7f747de19740 10 client.18633 fetch_fsmap learned FSMap version 34 2024-08-31T05:41:19.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.265+0000 7f747de19740 1 -- 172.21.15.5:0/1658070489 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5595d6267450 con 0x5595d5df9d80 2024-08-31T05:41:19.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.265+0000 7f744ffff640 1 -- 172.21.15.5:0/1658070489 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f745c0048c0 con 0x5595d5df9d80 2024-08-31T05:41:19.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.265+0000 7f744ffff640 1 -- 172.21.15.5:0/1658070489 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f7468025040 con 0x5595d5df9d80 2024-08-31T05:41:19.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.265+0000 7f747de19740 10 client.18633 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:41:19.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.265+0000 7f747de19740 10 client.18633 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:41:19.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.265+0000 7f747de19740 20 client.18633 populate_metadata read hostname 'smithi005' 2024-08-31T05:41:19.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.265+0000 7f747de19740 1 --2- 172.21.15.5:0/1658070489 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5595d5e3b1b0 0x5595d6269aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:19.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.265+0000 7f747de19740 4 client.18633 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:41:19.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.265+0000 7f747de19740 1 -- 172.21.15.5:0/1658070489 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5595d61519f0 con 0x5595d5e3b1b0 2024-08-31T05:41:19.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.266+0000 7f746ffff640 1 --2- 172.21.15.5:0/1658070489 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5595d5e3b1b0 0x5595d6269aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:19.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.266+0000 7f744ffff640 10 client.18633 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:41:19.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.266+0000 7f746ffff640 1 --2- 172.21.15.5:0/1658070489 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5595d5e3b1b0 0x5595d6269aa0 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20d868b03c20f7dd server_cookie=24210e925c03948f in_seq=0 out_seq=0 2024-08-31T05:41:19.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.280+0000 7f744ffff640 1 -- 172.21.15.5:0/1658070489 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5595d61519f0 con 0x5595d5e3b1b0 2024-08-31T05:41:19.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.280+0000 7f744ffff640 10 client.18633 handle_command_reply: tid=0 2024-08-31T05:41:19.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.280+0000 7f747de19740 1 client.18633 shutdown 2024-08-31T05:41:19.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.280+0000 7f747de19740 1 -- 172.21.15.5:0/1658070489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5595d5df9d80 msgr2=0x5595d61f3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:19.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.280+0000 7f747de19740 1 --2- 172.21.15.5:0/1658070489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5595d5df9d80 0x5595d61f3040 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f7468006010 tx=0x7f7468005a50 comp rx=0 tx=0).stop 2024-08-31T05:41:19.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.280+0000 7f747de19740 1 -- 172.21.15.5:0/1658070489 shutdown_connections 2024-08-31T05:41:19.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.280+0000 7f747de19740 1 --2- 172.21.15.5:0/1658070489 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5595d5e3b1b0 0x5595d6269aa0 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:19.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.280+0000 7f747de19740 1 --2- 172.21.15.5:0/1658070489 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5595d5e1a4d0 0x5595d61eeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:19.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.280+0000 7f744ffff640 0 client.18633 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:41:19.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.280+0000 7f747de19740 1 --2- 172.21.15.5:0/1658070489 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595d5e122f0 0x5595d61ee4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:19.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.280+0000 7f747de19740 1 --2- 172.21.15.5:0/1658070489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5595d5df9d80 0x5595d61f3040 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:19.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.280+0000 7f747de19740 1 -- 172.21.15.5:0/1658070489 >> 172.21.15.5:0/1658070489 conn(0x5595d5e2f300 msgr2=0x5595d61ec290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:19.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.280+0000 7f747de19740 1 -- 172.21.15.5:0/1658070489 shutdown_connections 2024-08-31T05:41:19.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.280+0000 7f747de19740 1 -- 172.21.15.5:0/1658070489 wait complete. 2024-08-31T05:41:19.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.280+0000 7f747de19740 20 client.18633 trim_cache size 0 max 16384 2024-08-31T05:41:19.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:41:19.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:41:19.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:41:19.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:41:19.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.281+0000 7f7476ea9640 1 -- 172.21.15.5:0/1821767614 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f74600b4ca0 msgr2=0x7f74600b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:19.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.281+0000 7f7476ea9640 1 --2- 172.21.15.5:0/1821767614 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f74600b4ca0 0x7f74600b71b0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f74640e3050 tx=0x7f7464000bc0 comp rx=0 tx=0).stop 2024-08-31T05:41:19.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.281+0000 7f7476ea9640 1 -- 172.21.15.5:0/1821767614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7470102760 msgr2=0x7f747019afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:19.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.281+0000 7f7476ea9640 1 --2- 172.21.15.5:0/1821767614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7470102760 0x7f747019afe0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f746400e9f0 tx=0x7f746400eeb0 comp rx=0 tx=0).stop 2024-08-31T05:41:19.286 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.281+0000 7f7476ea9640 1 -- 172.21.15.5:0/1821767614 shutdown_connections 2024-08-31T05:41:19.286 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.281+0000 7f7476ea9640 1 --2- 172.21.15.5:0/1821767614 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f74600b4ca0 0x7f74600b71b0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:19.286 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.281+0000 7f7476ea9640 1 --2- 172.21.15.5:0/1821767614 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f74701089e0 0x7f747019ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:19.286 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.281+0000 7f7476ea9640 1 --2- 172.21.15.5:0/1821767614 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7470108090 0x7f747019b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:19.286 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.281+0000 7f7476ea9640 1 --2- 172.21.15.5:0/1821767614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7470102760 0x7f747019afe0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:19.286 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.281+0000 7f7476ea9640 1 -- 172.21.15.5:0/1821767614 >> 172.21.15.5:0/1821767614 conn(0x7f74700fe160 msgr2=0x7f7470107720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:19.286 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.281+0000 7f7476ea9640 1 -- 172.21.15.5:0/1821767614 shutdown_connections 2024-08-31T05:41:19.286 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:19.281+0000 7f7476ea9640 1 -- 172.21.15.5:0/1821767614 wait complete. 2024-08-31T05:41:19.308 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:41:18 smithi050 ceph-mon[22146]: scrub summary: idle 2024-08-31T05:41:19.308 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:41:18 smithi050 ceph-mon[22146]: pgmap v695: 129 pgs: 129 active+clean; 573 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.6 MiB/s wr, 244 op/s 2024-08-31T05:41:19.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:41:18 smithi070 ceph-mon[22316]: scrub summary: idle 2024-08-31T05:41:19.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:41:18 smithi070 ceph-mon[22316]: pgmap v695: 129 pgs: 129 active+clean; 573 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.6 MiB/s wr, 244 op/s 2024-08-31T05:41:19.938 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1276443 10.84 MB/sec execute 487 sec latency 75.003 ms 2024-08-31T05:41:20.938 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1278801 10.85 MB/sec execute 488 sec latency 15.017 ms 2024-08-31T05:41:21.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:41:20 smithi005 ceph-mon[18602]: pgmap v696: 129 pgs: 129 active+clean; 579 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.9 MiB/s wr, 214 op/s 2024-08-31T05:41:21.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:41:20 smithi070 ceph-mon[22316]: pgmap v696: 129 pgs: 129 active+clean; 579 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.9 MiB/s wr, 214 op/s 2024-08-31T05:41:21.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:41:20 smithi050 ceph-mon[22146]: pgmap v696: 129 pgs: 129 active+clean; 579 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.9 MiB/s wr, 214 op/s 2024-08-31T05:41:21.938 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1280340 10.84 MB/sec execute 489 sec latency 17.490 ms 2024-08-31T05:41:22.938 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1282607 10.85 MB/sec execute 490 sec latency 19.498 ms 2024-08-31T05:41:23.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:41:22 smithi005 ceph-mon[18602]: pgmap v697: 129 pgs: 129 active+clean; 583 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.6 MiB/s wr, 198 op/s 2024-08-31T05:41:23.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:41:22 smithi070 ceph-mon[22316]: pgmap v697: 129 pgs: 129 active+clean; 583 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.6 MiB/s wr, 198 op/s 2024-08-31T05:41:23.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:41:22 smithi050 ceph-mon[22146]: pgmap v697: 129 pgs: 129 active+clean; 583 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.6 MiB/s wr, 198 op/s 2024-08-31T05:41:23.938 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1284010 10.84 MB/sec execute 491 sec latency 38.772 ms 2024-08-31T05:41:24.938 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1286238 10.84 MB/sec execute 492 sec latency 13.568 ms 2024-08-31T05:41:25.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:41:24 smithi005 ceph-mon[18602]: pgmap v698: 129 pgs: 129 active+clean; 582 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.3 MiB/s wr, 189 op/s 2024-08-31T05:41:25.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:41:24 smithi070 ceph-mon[22316]: pgmap v698: 129 pgs: 129 active+clean; 582 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.3 MiB/s wr, 189 op/s 2024-08-31T05:41:25.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:41:24 smithi050 ceph-mon[22146]: pgmap v698: 129 pgs: 129 active+clean; 582 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.3 MiB/s wr, 189 op/s 2024-08-31T05:41:25.938 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1288349 10.84 MB/sec execute 493 sec latency 27.299 ms 2024-08-31T05:41:26.939 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1290098 10.84 MB/sec execute 494 sec latency 35.201 ms 2024-08-31T05:41:27.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:41:26 smithi005 ceph-mon[18602]: pgmap v699: 129 pgs: 129 active+clean; 595 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 5.8 MiB/s wr, 261 op/s 2024-08-31T05:41:27.259 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:41:26 smithi070 ceph-mon[22316]: pgmap v699: 129 pgs: 129 active+clean; 595 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 5.8 MiB/s wr, 261 op/s 2024-08-31T05:41:27.410 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:41:26 smithi050 ceph-mon[22146]: pgmap v699: 129 pgs: 129 active+clean; 595 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 5.8 MiB/s wr, 261 op/s 2024-08-31T05:41:27.939 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1292489 10.84 MB/sec execute 495 sec latency 21.155 ms 2024-08-31T05:41:28.939 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1293722 10.83 MB/sec execute 496 sec latency 75.040 ms 2024-08-31T05:41:29.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:41:28 smithi005 ceph-mon[18602]: pgmap v700: 129 pgs: 129 active+clean; 595 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.0 MiB/s wr, 197 op/s 2024-08-31T05:41:29.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:41:28 smithi070 ceph-mon[22316]: pgmap v700: 129 pgs: 129 active+clean; 595 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.0 MiB/s wr, 197 op/s 2024-08-31T05:41:29.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:41:28 smithi050 ceph-mon[22146]: pgmap v700: 129 pgs: 129 active+clean; 595 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.0 MiB/s wr, 197 op/s 2024-08-31T05:41:29.939 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1296229 10.84 MB/sec execute 497 sec latency 14.709 ms 2024-08-31T05:41:30.939 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1297757 10.84 MB/sec execute 498 sec latency 19.917 ms 2024-08-31T05:41:31.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:41:30 smithi005 ceph-mon[18602]: pgmap v701: 129 pgs: 129 active+clean; 605 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 5.0 MiB/s wr, 240 op/s 2024-08-31T05:41:31.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:41:30 smithi070 ceph-mon[22316]: pgmap v701: 129 pgs: 129 active+clean; 605 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 5.0 MiB/s wr, 240 op/s 2024-08-31T05:41:31.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:41:30 smithi050 ceph-mon[22146]: pgmap v701: 129 pgs: 129 active+clean; 605 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 5.0 MiB/s wr, 240 op/s 2024-08-31T05:41:31.939 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1300133 10.84 MB/sec execute 499 sec latency 26.184 ms 2024-08-31T05:41:32.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.387+0000 7f8a01139640 1 -- 172.21.15.5:0/2121618365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89fc105020 msgr2=0x7f89fc10d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:32.389 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.387+0000 7f8a01139640 1 --2- 172.21.15.5:0/2121618365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89fc105020 0x7f89fc10d560 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f89f0009900 tx=0x7f89f002a410 comp rx=0 tx=0).stop 2024-08-31T05:41:32.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.387+0000 7f8a01139640 1 -- 172.21.15.5:0/2121618365 shutdown_connections 2024-08-31T05:41:32.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.387+0000 7f8a01139640 1 --2- 172.21.15.5:0/2121618365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89fc10db30 0x7f89fc110020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:32.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.387+0000 7f8a01139640 1 --2- 172.21.15.5:0/2121618365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89fc105020 0x7f89fc10d560 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:32.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.387+0000 7f8a01139640 1 --2- 172.21.15.5:0/2121618365 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89fc1046d0 0x7f89fc104ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:32.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.387+0000 7f8a01139640 1 -- 172.21.15.5:0/2121618365 >> 172.21.15.5:0/2121618365 conn(0x7f89fc0fe180 msgr2=0x7f89fc1005d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:32.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.387+0000 7f8a01139640 1 -- 172.21.15.5:0/2121618365 shutdown_connections 2024-08-31T05:41:32.390 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.387+0000 7f8a01139640 1 -- 172.21.15.5:0/2121618365 wait complete. 2024-08-31T05:41:32.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.388+0000 7f8a01139640 1 Processor -- start 2024-08-31T05:41:32.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.388+0000 7f8a01139640 1 -- start start 2024-08-31T05:41:32.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.388+0000 7f8a01139640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89fc1046d0 0x7f89fc102400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:32.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.388+0000 7f8a01139640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89fc105020 0x7f89fc102940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:32.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.388+0000 7f8a01139640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89fc10db30 0x7f89fc102e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:32.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.388+0000 7f8a01139640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f89fc113760 con 0x7f89fc105020 2024-08-31T05:41:32.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.388+0000 7f8a01139640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f89fc1135e0 con 0x7f89fc10db30 2024-08-31T05:41:32.392 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.388+0000 7f8a01139640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f89fc1138e0 con 0x7f89fc1046d0 2024-08-31T05:41:32.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.389+0000 7f89fa59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89fc105020 0x7f89fc102940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:32.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.389+0000 7f89fad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89fc1046d0 0x7f89fc102400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:32.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.389+0000 7f89fa59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89fc105020 0x7f89fc102940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46150/0 (socket says 172.21.15.5:46150) 2024-08-31T05:41:32.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.389+0000 7f89fa59c640 1 -- 172.21.15.5:0/4185587511 learned_addr learned my addr 172.21.15.5:0/4185587511 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:32.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.389+0000 7f89fb59e640 1 --2- 172.21.15.5:0/4185587511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89fc10db30 0x7f89fc102e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:32.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.389+0000 7f89fad9d640 1 -- 172.21.15.5:0/4185587511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89fc10db30 msgr2=0x7f89fc102e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:32.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.389+0000 7f89fad9d640 1 --2- 172.21.15.5:0/4185587511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89fc10db30 0x7f89fc102e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:32.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.389+0000 7f89fad9d640 1 -- 172.21.15.5:0/4185587511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89fc105020 msgr2=0x7f89fc102940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:32.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.389+0000 7f89fad9d640 1 --2- 172.21.15.5:0/4185587511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89fc105020 0x7f89fc102940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:32.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.389+0000 7f89fad9d640 1 -- 172.21.15.5:0/4185587511 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89fc1a8470 con 0x7f89fc1046d0 2024-08-31T05:41:32.393 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.389+0000 7f89fa59c640 1 --2- 172.21.15.5:0/4185587511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89fc105020 0x7f89fc102940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:41:32.394 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.389+0000 7f89fad9d640 1 --2- 172.21.15.5:0/4185587511 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89fc1046d0 0x7f89fc102400 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f89ec00e9f0 tx=0x7f89ec00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:32.394 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.389+0000 7f89e3fff640 1 -- 172.21.15.5:0/4185587511 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ec00ccc0 con 0x7f89fc1046d0 2024-08-31T05:41:32.394 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.389+0000 7f8a01139640 1 -- 172.21.15.5:0/4185587511 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89fc1a8760 con 0x7f89fc1046d0 2024-08-31T05:41:32.394 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.389+0000 7f89e3fff640 1 -- 172.21.15.5:0/4185587511 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89ec0108e0 con 0x7f89fc1046d0 2024-08-31T05:41:32.394 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.389+0000 7f89e3fff640 1 -- 172.21.15.5:0/4185587511 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ec018880 con 0x7f89fc1046d0 2024-08-31T05:41:32.394 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.389+0000 7f8a01139640 1 -- 172.21.15.5:0/4185587511 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89fc1a8cb0 con 0x7f89fc1046d0 2024-08-31T05:41:32.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.392+0000 7f89e3fff640 1 -- 172.21.15.5:0/4185587511 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f89ec010430 con 0x7f89fc1046d0 2024-08-31T05:41:32.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.392+0000 7f8a080a7740 1 Processor -- start 2024-08-31T05:41:32.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.392+0000 7f8a080a7740 1 -- start start 2024-08-31T05:41:32.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.393+0000 7f8a080a7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55724065a1b0 0x557240a062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:32.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.393+0000 7f8a080a7740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5572406312f0 0x557240a06810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:32.399 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.393+0000 7f8a080a7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572406394d0 0x557240a06d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:32.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.393+0000 7f8a080a7740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x557240973000 con 0x5572406312f0 2024-08-31T05:41:32.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.393+0000 7f8a080a7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x557240962590 con 0x5572406394d0 2024-08-31T05:41:32.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.393+0000 7f8a080a7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557240966540 con 0x55724065a1b0 2024-08-31T05:41:32.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.393+0000 7f89fad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5572406312f0 0x557240a06810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:32.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.393+0000 7f89fb59e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55724065a1b0 0x557240a062d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:32.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.393+0000 7f89fa59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572406394d0 0x557240a06d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:32.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.393+0000 7f89fb59e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55724065a1b0 0x557240a062d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:44552/0 (socket says 172.21.15.5:44552) 2024-08-31T05:41:32.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.393+0000 7f89fb59e640 1 -- 172.21.15.5:0/1482717714 learned_addr learned my addr 172.21.15.5:0/1482717714 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:32.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.393+0000 7f89e3fff640 1 --2- 172.21.15.5:0/4185587511 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f89e40b4cd0 0x7f89e40b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:32.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.393+0000 7f89fa59c640 1 -- 172.21.15.5:0/1482717714 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55724065a1b0 msgr2=0x557240a062d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:32.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.393+0000 7f89fa59c640 1 --2- 172.21.15.5:0/1482717714 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55724065a1b0 0x557240a062d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:32.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.393+0000 7f89fa59c640 1 -- 172.21.15.5:0/1482717714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5572406312f0 msgr2=0x557240a06810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:32.400 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.393+0000 7f89fa59c640 1 --2- 172.21.15.5:0/1482717714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5572406312f0 0x557240a06810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:32.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.393+0000 7f89fa59c640 1 -- 172.21.15.5:0/1482717714 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572406c5790 con 0x5572406394d0 2024-08-31T05:41:32.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.393+0000 7f89fad9d640 1 --2- 172.21.15.5:0/1482717714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5572406312f0 0x557240a06810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:41:32.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.393+0000 7f89fb59e640 1 --2- 172.21.15.5:0/4185587511 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f89e40b4cd0 0x7f89e40b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:32.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.393+0000 7f89e3fff640 1 -- 172.21.15.5:0/4185587511 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9511+0+0 (secure 0 0 0) 0x7f89ec0e5c20 con 0x7f89fc1046d0 2024-08-31T05:41:32.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.393+0000 7f89fa59c640 1 --2- 172.21.15.5:0/1482717714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572406394d0 0x557240a06d50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f89f0000c00 tx=0x7f89f0005e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96b2b0f200356213 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:32.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.394+0000 7f89e17fa640 1 -- 172.21.15.5:0/1482717714 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f0035040 con 0x5572406394d0 2024-08-31T05:41:32.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.394+0000 7f89fb59e640 1 --2- 172.21.15.5:0/4185587511 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f89e40b4cd0 0x7f89e40b71e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f89f4009fd0 tx=0x7f89f4004a40 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:32.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.394+0000 7f89e17fa640 1 -- 172.21.15.5:0/1482717714 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89f0031720 con 0x5572406394d0 2024-08-31T05:41:32.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.394+0000 7f89e17fa640 1 -- 172.21.15.5:0/1482717714 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f00047a0 con 0x5572406394d0 2024-08-31T05:41:32.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.394+0000 7f8a080a7740 1 -- 172.21.15.5:0/1482717714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572406394d0 msgr2=0x557240a06d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:32.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.394+0000 7f8a080a7740 1 --2- 172.21.15.5:0/1482717714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572406394d0 0x557240a06d50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f89f0000c00 tx=0x7f89f0005e20 comp rx=0 tx=0).stop 2024-08-31T05:41:32.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.395+0000 7f8a080a7740 1 -- 172.21.15.5:0/1482717714 shutdown_connections 2024-08-31T05:41:32.401 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.395+0000 7f8a080a7740 1 --2- 172.21.15.5:0/1482717714 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572406394d0 0x557240a06d50 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:32.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.395+0000 7f8a080a7740 1 --2- 172.21.15.5:0/1482717714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5572406312f0 0x557240a06810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:32.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.395+0000 7f8a080a7740 1 --2- 172.21.15.5:0/1482717714 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55724065a1b0 0x557240a062d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:32.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.395+0000 7f8a080a7740 1 -- 172.21.15.5:0/1482717714 >> 172.21.15.5:0/1482717714 conn(0x55724064e300 msgr2=0x557240a041c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:32.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.395+0000 7f8a080a7740 1 -- 172.21.15.5:0/1482717714 shutdown_connections 2024-08-31T05:41:32.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.395+0000 7f8a080a7740 1 -- 172.21.15.5:0/1482717714 wait complete. 2024-08-31T05:41:32.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.395+0000 7f8a080a7740 1 -- start start 2024-08-31T05:41:32.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.395+0000 7f8a080a7740 1 Processor -- start 2024-08-31T05:41:32.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.395+0000 7f8a080a7740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5572406312f0 0x557240a11ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:32.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.395+0000 7f8a080a7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5572406394d0 0x557240a12400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:32.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.395+0000 7f8a080a7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55724065a1b0 0x557240a1dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:32.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.395+0000 7f8a080a7740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55724089bab0 con 0x5572406312f0 2024-08-31T05:41:32.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.395+0000 7f8a080a7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5572408e9680 con 0x55724065a1b0 2024-08-31T05:41:32.402 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.395+0000 7f8a080a7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557240a149f0 con 0x5572406394d0 2024-08-31T05:41:32.403 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.395+0000 7f8a080a7740 10 client.0 _ll_register_callbacks cb 0x557240671a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:41:32.403 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.395+0000 7f89fad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5572406312f0 0x557240a11ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:32.403 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.396+0000 7f89fa59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5572406394d0 0x557240a12400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:32.403 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.396+0000 7f89fad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5572406312f0 0x557240a11ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46166/0 (socket says 172.21.15.5:46166) 2024-08-31T05:41:32.403 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.396+0000 7f89fad9d640 1 -- 172.21.15.5:0/3125018006 learned_addr learned my addr 172.21.15.5:0/3125018006 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:32.403 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.396+0000 7f89fb59e640 1 --2- 172.21.15.5:0/3125018006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55724065a1b0 0x557240a1dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:32.403 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.396+0000 7f89fad9d640 1 -- 172.21.15.5:0/3125018006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5572406394d0 msgr2=0x557240a12400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:32.403 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.396+0000 7f89fad9d640 1 --2- 172.21.15.5:0/3125018006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5572406394d0 0x557240a12400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:32.403 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.396+0000 7f89fad9d640 1 -- 172.21.15.5:0/3125018006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55724065a1b0 msgr2=0x557240a1dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:32.403 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.396+0000 7f89fad9d640 1 --2- 172.21.15.5:0/3125018006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55724065a1b0 0x557240a1dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:32.403 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.396+0000 7f89fad9d640 1 -- 172.21.15.5:0/3125018006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55724073e620 con 0x5572406312f0 2024-08-31T05:41:32.403 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.396+0000 7f89fad9d640 1 --2- 172.21.15.5:0/3125018006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5572406312f0 0x557240a11ec0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f89ec000c00 tx=0x7f89ec00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df697fd490ec683a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:32.403 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.396+0000 7f89deff5640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:41:32.404 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.396+0000 7f89deff5640 1 -- 172.21.15.5:0/3125018006 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ec0ab750 con 0x5572406312f0 2024-08-31T05:41:32.404 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.396+0000 7f89deff5640 1 -- 172.21.15.5:0/3125018006 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9511+0+0 (secure 0 0 0) 0x7f89ec0ab440 con 0x5572406312f0 2024-08-31T05:41:32.404 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.396+0000 7f8a080a7740 1 -- 172.21.15.5:0/3125018006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89f0031720 con 0x5572406312f0 2024-08-31T05:41:32.404 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.396+0000 7f89deff5640 1 -- 172.21.15.5:0/3125018006 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f89ec010720 con 0x5572406312f0 2024-08-31T05:41:32.404 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.396+0000 7f8a080a7740 10 client.18645 fetch_fsmap learned FSMap version 34 2024-08-31T05:41:32.404 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.396+0000 7f8a080a7740 1 -- 172.21.15.5:0/3125018006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x557240a20a00 con 0x5572406312f0 2024-08-31T05:41:32.404 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.397+0000 7f89deff5640 1 -- 172.21.15.5:0/3125018006 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89f0031720 con 0x5572406312f0 2024-08-31T05:41:32.404 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.397+0000 7f89deff5640 1 -- 172.21.15.5:0/3125018006 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f89ec0eb060 con 0x5572406312f0 2024-08-31T05:41:32.404 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.397+0000 7f8a080a7740 10 client.18645 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:41:32.404 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.397+0000 7f8a080a7740 10 client.18645 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:41:32.405 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.397+0000 7f8a080a7740 20 client.18645 populate_metadata read hostname 'smithi005' 2024-08-31T05:41:32.405 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.397+0000 7f8a080a7740 1 --2- 172.21.15.5:0/3125018006 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x557240618d80 0x557240a23ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:32.405 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.397+0000 7f8a080a7740 4 client.18645 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:41:32.405 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.397+0000 7f8a080a7740 1 -- 172.21.15.5:0/3125018006 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557240974f50 con 0x557240618d80 2024-08-31T05:41:32.405 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.397+0000 7f89fa59c640 1 --2- 172.21.15.5:0/3125018006 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x557240618d80 0x557240a23ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:32.406 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.398+0000 7f89deff5640 10 client.18645 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:41:32.406 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.398+0000 7f89fa59c640 1 --2- 172.21.15.5:0/3125018006 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x557240618d80 0x557240a23ed0 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=386d6b6d4d9ad355 server_cookie=bc31c1905c71b380 in_seq=0 out_seq=0 2024-08-31T05:41:32.406 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.398+0000 7f89deff5640 1 -- 172.21.15.5:0/3125018006 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557240974f50 con 0x557240618d80 2024-08-31T05:41:32.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.398+0000 7f89deff5640 10 client.18645 handle_command_reply: tid=0 2024-08-31T05:41:32.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.398+0000 7f8a080a7740 1 client.18645 shutdown 2024-08-31T05:41:32.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.399+0000 7f8a080a7740 1 -- 172.21.15.5:0/3125018006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5572406312f0 msgr2=0x557240a11ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:32.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.399+0000 7f8a080a7740 1 --2- 172.21.15.5:0/3125018006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5572406312f0 0x557240a11ec0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f89ec000c00 tx=0x7f89ec00ce60 comp rx=0 tx=0).stop 2024-08-31T05:41:32.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.399+0000 7f8a080a7740 1 -- 172.21.15.5:0/3125018006 shutdown_connections 2024-08-31T05:41:32.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.399+0000 7f8a080a7740 1 --2- 172.21.15.5:0/3125018006 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x557240618d80 0x557240a23ed0 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:32.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.399+0000 7f8a080a7740 1 --2- 172.21.15.5:0/3125018006 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55724065a1b0 0x557240a1dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:32.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.399+0000 7f89deff5640 0 client.18645 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:41:32.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.399+0000 7f8a080a7740 1 --2- 172.21.15.5:0/3125018006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5572406394d0 0x557240a12400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:32.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.399+0000 7f8a080a7740 1 --2- 172.21.15.5:0/3125018006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5572406312f0 0x557240a11ec0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:32.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.399+0000 7f8a080a7740 1 -- 172.21.15.5:0/3125018006 >> 172.21.15.5:0/3125018006 conn(0x55724064e300 msgr2=0x557240a07300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:32.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.399+0000 7f8a080a7740 1 -- 172.21.15.5:0/3125018006 shutdown_connections 2024-08-31T05:41:32.407 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.399+0000 7f8a080a7740 1 -- 172.21.15.5:0/3125018006 wait complete. 2024-08-31T05:41:32.408 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.399+0000 7f8a080a7740 20 client.18645 trim_cache size 0 max 16384 2024-08-31T05:41:32.419 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.416+0000 7f8a080a7740 1 Processor -- start 2024-08-31T05:41:32.419 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.416+0000 7f8a080a7740 1 -- start start 2024-08-31T05:41:32.419 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.416+0000 7f8a080a7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557240618d80 0x557240a12190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:32.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.417+0000 7f8a080a7740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5572406312f0 0x557240a03a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:32.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.417+0000 7f8a080a7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572406394d0 0x557240a03f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:32.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.417+0000 7f8a080a7740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f89fc1aeaa0 con 0x5572406312f0 2024-08-31T05:41:32.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.417+0000 7f8a080a7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f89fc1b05e0 con 0x5572406394d0 2024-08-31T05:41:32.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.417+0000 7f8a080a7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f89fc1af170 con 0x557240618d80 2024-08-31T05:41:32.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.417+0000 7f89fa59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5572406312f0 0x557240a03a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:32.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.417+0000 7f89fad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557240618d80 0x557240a12190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:32.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.417+0000 7f89fb59e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572406394d0 0x557240a03f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:32.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.417+0000 7f89fad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557240618d80 0x557240a12190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:44574/0 (socket says 172.21.15.5:44574) 2024-08-31T05:41:32.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.417+0000 7f89fad9d640 1 -- 172.21.15.5:0/2194930835 learned_addr learned my addr 172.21.15.5:0/2194930835 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:32.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.417+0000 7f89fa59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5572406312f0 0x557240a03a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46176/0 (socket says 172.21.15.5:46176) 2024-08-31T05:41:32.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.417+0000 7f89fb59e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572406394d0 0x557240a03f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:54300/0 (socket says 172.21.15.5:54300) 2024-08-31T05:41:32.420 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.417+0000 7f89fa59c640 1 -- 172.21.15.5:0/2194930835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557240618d80 msgr2=0x557240a12190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:32.421 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.417+0000 7f89fa59c640 1 --2- 172.21.15.5:0/2194930835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557240618d80 0x557240a12190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:32.421 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.417+0000 7f89fa59c640 1 -- 172.21.15.5:0/2194930835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572406394d0 msgr2=0x557240a03f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:32.421 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.417+0000 7f89fa59c640 1 --2- 172.21.15.5:0/2194930835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572406394d0 0x557240a03f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:32.421 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.417+0000 7f89fa59c640 1 -- 172.21.15.5:0/2194930835 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557240a04ac0 con 0x5572406312f0 2024-08-31T05:41:32.421 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.417+0000 7f89fb59e640 1 --2- 172.21.15.5:0/2194930835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572406394d0 0x557240a03f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:41:32.421 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.417+0000 7f89fa59c640 1 --2- 172.21.15.5:0/2194930835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5572406312f0 0x557240a03a10 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x557240a245b0 tx=0x7f89f002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9e9fc6059cc1778 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:32.421 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.418+0000 7f89e0ff9640 1 -- 172.21.15.5:0/2194930835 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f0035040 con 0x5572406312f0 2024-08-31T05:41:32.421 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.418+0000 7f89e0ff9640 1 -- 172.21.15.5:0/2194930835 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89f0005520 con 0x5572406312f0 2024-08-31T05:41:32.421 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.418+0000 7f89e0ff9640 1 -- 172.21.15.5:0/2194930835 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f0003850 con 0x5572406312f0 2024-08-31T05:41:32.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.418+0000 7f8a080a7740 1 -- 172.21.15.5:0/2194930835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5572406312f0 msgr2=0x557240a03a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:32.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.418+0000 7f8a080a7740 1 --2- 172.21.15.5:0/2194930835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5572406312f0 0x557240a03a10 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x557240a245b0 tx=0x7f89f002a410 comp rx=0 tx=0).stop 2024-08-31T05:41:32.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.418+0000 7f8a080a7740 1 -- 172.21.15.5:0/2194930835 shutdown_connections 2024-08-31T05:41:32.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.418+0000 7f8a080a7740 1 --2- 172.21.15.5:0/2194930835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5572406394d0 0x557240a03f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:32.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.418+0000 7f8a080a7740 1 --2- 172.21.15.5:0/2194930835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5572406312f0 0x557240a03a10 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:32.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.418+0000 7f8a080a7740 1 --2- 172.21.15.5:0/2194930835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557240618d80 0x557240a12190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:32.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.418+0000 7f8a080a7740 1 -- 172.21.15.5:0/2194930835 >> 172.21.15.5:0/2194930835 conn(0x55724064e300 msgr2=0x557240a10510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:32.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.419+0000 7f8a080a7740 1 -- 172.21.15.5:0/2194930835 shutdown_connections 2024-08-31T05:41:32.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.419+0000 7f8a080a7740 1 -- 172.21.15.5:0/2194930835 wait complete. 2024-08-31T05:41:32.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.419+0000 7f8a080a7740 1 -- start start 2024-08-31T05:41:32.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.419+0000 7f8a080a7740 1 Processor -- start 2024-08-31T05:41:32.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.419+0000 7f8a080a7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557240618d80 0x557240a162e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:32.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.419+0000 7f8a080a7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5572406312f0 0x557240a16820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:32.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.419+0000 7f8a080a7740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5572406394d0 0x557240a8d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:32.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.419+0000 7f8a080a7740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f89fc1aff10 con 0x5572406394d0 2024-08-31T05:41:32.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.419+0000 7f8a080a7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f89fc1af840 con 0x557240618d80 2024-08-31T05:41:32.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.419+0000 7f8a080a7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f89fc1acb40 con 0x5572406312f0 2024-08-31T05:41:32.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.419+0000 7f8a080a7740 10 client.0 _ll_register_callbacks cb 0x7f89ec00e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:41:32.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.419+0000 7f89fb59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5572406394d0 0x557240a8d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:32.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.419+0000 7f89fad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557240618d80 0x557240a162e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:32.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.419+0000 7f89fb59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5572406394d0 0x557240a8d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46182/0 (socket says 172.21.15.5:46182) 2024-08-31T05:41:32.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.419+0000 7f89fa59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5572406312f0 0x557240a16820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:32.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.419+0000 7f89fb59e640 1 -- 172.21.15.5:0/424157669 learned_addr learned my addr 172.21.15.5:0/424157669 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:32.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.420+0000 7f89fad9d640 1 -- 172.21.15.5:0/424157669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5572406312f0 msgr2=0x557240a16820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:32.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.420+0000 7f89fad9d640 1 --2- 172.21.15.5:0/424157669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5572406312f0 0x557240a16820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:32.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.420+0000 7f89fad9d640 1 -- 172.21.15.5:0/424157669 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5572406394d0 msgr2=0x557240a8d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:32.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.420+0000 7f89fad9d640 1 --2- 172.21.15.5:0/424157669 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5572406394d0 0x557240a8d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:32.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.420+0000 7f89fad9d640 1 -- 172.21.15.5:0/424157669 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557240a8ddb0 con 0x557240618d80 2024-08-31T05:41:32.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.420+0000 7f89fad9d640 1 --2- 172.21.15.5:0/424157669 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557240618d80 0x557240a162e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f89ec0a7f20 tx=0x7f89ec00c840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6f72cd41f66de45 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:32.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.420+0000 7f89deff5640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:41:32.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.420+0000 7f89deff5640 1 -- 172.21.15.5:0/424157669 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ec0e8040 con 0x557240618d80 2024-08-31T05:41:32.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.420+0000 7f8a080a7740 1 -- 172.21.15.5:0/424157669 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89f0005520 con 0x557240618d80 2024-08-31T05:41:32.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.420+0000 7f89deff5640 1 -- 172.21.15.5:0/424157669 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9511+0+0 (secure 0 0 0) 0x7f89ec0b3b20 con 0x557240618d80 2024-08-31T05:41:32.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.420+0000 7f89deff5640 1 -- 172.21.15.5:0/424157669 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f89ec0ab750 con 0x557240618d80 2024-08-31T05:41:32.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.420+0000 7f8a080a7740 10 client.28211 fetch_fsmap learned FSMap version 34 2024-08-31T05:41:32.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.420+0000 7f8a080a7740 1 -- 172.21.15.5:0/424157669 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x557240a8efc0 con 0x557240618d80 2024-08-31T05:41:32.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.420+0000 7f89deff5640 1 -- 172.21.15.5:0/424157669 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89f0005520 con 0x557240618d80 2024-08-31T05:41:32.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.421+0000 7f89deff5640 1 -- 172.21.15.5:0/424157669 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f89ec0eb040 con 0x557240618d80 2024-08-31T05:41:32.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.421+0000 7f8a080a7740 10 client.28211 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:41:32.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.421+0000 7f8a080a7740 10 client.28211 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:41:32.428 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.421+0000 7f8a080a7740 20 client.28211 populate_metadata read hostname 'smithi005' 2024-08-31T05:41:32.428 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.421+0000 7f8a080a7740 1 --2- 172.21.15.5:0/424157669 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55724065a1b0 0x557240a917d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:32.428 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.421+0000 7f8a080a7740 4 client.28211 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:41:32.428 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.421+0000 7f8a080a7740 1 -- 172.21.15.5:0/424157669 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5572409709f0 con 0x55724065a1b0 2024-08-31T05:41:32.428 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.421+0000 7f89fa59c640 1 --2- 172.21.15.5:0/424157669 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55724065a1b0 0x557240a917d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:32.428 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.421+0000 7f89fa59c640 1 --2- 172.21.15.5:0/424157669 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55724065a1b0 0x557240a917d0 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a11c7a8624faf12 server_cookie=9397bb50ceb8fb5a in_seq=0 out_seq=0 2024-08-31T05:41:32.428 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.421+0000 7f89deff5640 10 client.28211 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:41:32.437 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.434+0000 7f89deff5640 1 -- 172.21.15.5:0/424157669 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5572409709f0 con 0x55724065a1b0 2024-08-31T05:41:32.437 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.434+0000 7f89deff5640 10 client.28211 handle_command_reply: tid=0 2024-08-31T05:41:32.438 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.434+0000 7f8a080a7740 1 client.28211 shutdown 2024-08-31T05:41:32.438 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.434+0000 7f8a080a7740 1 -- 172.21.15.5:0/424157669 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557240618d80 msgr2=0x557240a162e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:32.438 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.434+0000 7f8a080a7740 1 --2- 172.21.15.5:0/424157669 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557240618d80 0x557240a162e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f89ec0a7f20 tx=0x7f89ec00c840 comp rx=0 tx=0).stop 2024-08-31T05:41:32.438 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.435+0000 7f8a080a7740 1 -- 172.21.15.5:0/424157669 shutdown_connections 2024-08-31T05:41:32.438 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.435+0000 7f8a080a7740 1 --2- 172.21.15.5:0/424157669 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55724065a1b0 0x557240a917d0 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:32.438 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.435+0000 7f8a080a7740 1 --2- 172.21.15.5:0/424157669 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5572406394d0 0x557240a8d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:32.438 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.435+0000 7f89deff5640 0 client.28211 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:41:32.438 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.435+0000 7f8a080a7740 1 --2- 172.21.15.5:0/424157669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5572406312f0 0x557240a16820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:32.438 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.435+0000 7f8a080a7740 1 --2- 172.21.15.5:0/424157669 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x557240618d80 0x557240a162e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:32.438 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.435+0000 7f8a080a7740 1 -- 172.21.15.5:0/424157669 >> 172.21.15.5:0/424157669 conn(0x55724064e300 msgr2=0x557240a03a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:32.438 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.435+0000 7f8a080a7740 1 -- 172.21.15.5:0/424157669 shutdown_connections 2024-08-31T05:41:32.438 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.435+0000 7f8a080a7740 1 -- 172.21.15.5:0/424157669 wait complete. 2024-08-31T05:41:32.438 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.435+0000 7f8a080a7740 20 client.28211 trim_cache size 0 max 16384 2024-08-31T05:41:32.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:41:32.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:41:32.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:41:32.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:41:32.440 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.435+0000 7f8a01139640 1 -- 172.21.15.5:0/4185587511 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f89e40b4cd0 msgr2=0x7f89e40b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:32.440 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.435+0000 7f8a01139640 1 --2- 172.21.15.5:0/4185587511 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f89e40b4cd0 0x7f89e40b71e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f89f4009fd0 tx=0x7f89f4004a40 comp rx=0 tx=0).stop 2024-08-31T05:41:32.440 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.435+0000 7f8a01139640 1 -- 172.21.15.5:0/4185587511 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89fc1046d0 msgr2=0x7f89fc102400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:32.440 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.435+0000 7f8a01139640 1 --2- 172.21.15.5:0/4185587511 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89fc1046d0 0x7f89fc102400 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f89ec00e9f0 tx=0x7f89ec00eeb0 comp rx=0 tx=0).stop 2024-08-31T05:41:32.440 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.435+0000 7f8a01139640 1 -- 172.21.15.5:0/4185587511 shutdown_connections 2024-08-31T05:41:32.440 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.435+0000 7f8a01139640 1 --2- 172.21.15.5:0/4185587511 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f89e40b4cd0 0x7f89e40b71e0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:32.440 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.435+0000 7f8a01139640 1 --2- 172.21.15.5:0/4185587511 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f89fc10db30 0x7f89fc102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:32.440 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.435+0000 7f8a01139640 1 --2- 172.21.15.5:0/4185587511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f89fc105020 0x7f89fc102940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:32.441 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.435+0000 7f8a01139640 1 --2- 172.21.15.5:0/4185587511 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89fc1046d0 0x7f89fc102400 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:32.441 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.435+0000 7f8a01139640 1 -- 172.21.15.5:0/4185587511 >> 172.21.15.5:0/4185587511 conn(0x7f89fc0fe180 msgr2=0x7f89fc107620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:32.441 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.436+0000 7f8a01139640 1 -- 172.21.15.5:0/4185587511 shutdown_connections 2024-08-31T05:41:32.441 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:32.436+0000 7f8a01139640 1 -- 172.21.15.5:0/4185587511 wait complete. 2024-08-31T05:41:32.939 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1302016 10.83 MB/sec execute 500 sec latency 15.542 ms 2024-08-31T05:41:33.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:41:32 smithi005 ceph-mon[18602]: pgmap v702: 129 pgs: 129 active+clean; 609 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.3 MiB/s wr, 203 op/s 2024-08-31T05:41:33.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:41:32 smithi070 ceph-mon[22316]: pgmap v702: 129 pgs: 129 active+clean; 609 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.3 MiB/s wr, 203 op/s 2024-08-31T05:41:33.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:41:32 smithi050 ceph-mon[22146]: pgmap v702: 129 pgs: 129 active+clean; 609 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.3 MiB/s wr, 203 op/s 2024-08-31T05:41:33.939 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1303757 10.84 MB/sec execute 501 sec latency 55.627 ms 2024-08-31T05:41:34.939 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1305321 10.83 MB/sec execute 502 sec latency 25.731 ms 2024-08-31T05:41:35.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:41:34 smithi005 ceph-mon[18602]: pgmap v703: 129 pgs: 129 active+clean; 609 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.1 MiB/s wr, 196 op/s 2024-08-31T05:41:35.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:41:34 smithi070 ceph-mon[22316]: pgmap v703: 129 pgs: 129 active+clean; 609 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.1 MiB/s wr, 196 op/s 2024-08-31T05:41:35.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:41:34 smithi050 ceph-mon[22146]: pgmap v703: 129 pgs: 129 active+clean; 609 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.1 MiB/s wr, 196 op/s 2024-08-31T05:41:35.939 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1307527 10.83 MB/sec execute 503 sec latency 14.825 ms 2024-08-31T05:41:36.939 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1309515 10.83 MB/sec execute 504 sec latency 28.515 ms 2024-08-31T05:41:37.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:41:36 smithi005 ceph-mon[18602]: pgmap v704: 129 pgs: 129 active+clean; 619 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 5.2 MiB/s wr, 252 op/s 2024-08-31T05:41:37.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:41:36 smithi070 ceph-mon[22316]: pgmap v704: 129 pgs: 129 active+clean; 619 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 5.2 MiB/s wr, 252 op/s 2024-08-31T05:41:37.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:41:36 smithi050 ceph-mon[22146]: pgmap v704: 129 pgs: 129 active+clean; 619 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 5.2 MiB/s wr, 252 op/s 2024-08-31T05:41:37.939 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1311493 10.83 MB/sec execute 505 sec latency 17.232 ms 2024-08-31T05:41:38.939 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1313064 10.82 MB/sec execute 506 sec latency 81.918 ms 2024-08-31T05:41:39.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:41:38 smithi005 ceph-mon[18602]: pgmap v705: 129 pgs: 129 active+clean; 612 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.6 MiB/s wr, 182 op/s 2024-08-31T05:41:39.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:41:38 smithi070 ceph-mon[22316]: pgmap v705: 129 pgs: 129 active+clean; 612 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.6 MiB/s wr, 182 op/s 2024-08-31T05:41:39.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:41:38 smithi050 ceph-mon[22146]: pgmap v705: 129 pgs: 129 active+clean; 612 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.6 MiB/s wr, 182 op/s 2024-08-31T05:41:39.939 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1314987 10.82 MB/sec execute 507 sec latency 42.834 ms 2024-08-31T05:41:40.939 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1316977 10.83 MB/sec execute 508 sec latency 151.683 ms 2024-08-31T05:41:41.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:41:40 smithi005 ceph-mon[18602]: pgmap v706: 129 pgs: 129 active+clean; 566 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.7 MiB/s wr, 230 op/s 2024-08-31T05:41:41.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:41:40 smithi070 ceph-mon[22316]: pgmap v706: 129 pgs: 129 active+clean; 566 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.7 MiB/s wr, 230 op/s 2024-08-31T05:41:41.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:41:40 smithi050 ceph-mon[22146]: pgmap v706: 129 pgs: 129 active+clean; 566 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.7 MiB/s wr, 230 op/s 2024-08-31T05:41:41.939 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1318949 10.83 MB/sec execute 509 sec latency 14.041 ms 2024-08-31T05:41:42.939 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1321248 10.83 MB/sec execute 510 sec latency 16.063 ms 2024-08-31T05:41:43.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:41:42 smithi005 ceph-mon[18602]: pgmap v707: 129 pgs: 129 active+clean; 561 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.5 MiB/s wr, 175 op/s 2024-08-31T05:41:43.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:41:42 smithi070 ceph-mon[22316]: pgmap v707: 129 pgs: 129 active+clean; 561 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.5 MiB/s wr, 175 op/s 2024-08-31T05:41:43.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:41:42 smithi050 ceph-mon[22146]: pgmap v707: 129 pgs: 129 active+clean; 561 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.5 MiB/s wr, 175 op/s 2024-08-31T05:41:43.918 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T05:41:43.939 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1322230 10.82 MB/sec execute 511 sec latency 82.133 ms 2024-08-31T05:41:44.179 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:41:44.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.732+0000 7f780107e640 1 -- 172.21.15.5:0/3293289864 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77fc101d90 msgr2=0x7f77fc1021a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:44.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.732+0000 7f780107e640 1 --2- 172.21.15.5:0/3293289864 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77fc101d90 0x7f77fc1021a0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f77ec009900 tx=0x7f77ec02a410 comp rx=0 tx=0).stop 2024-08-31T05:41:44.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.732+0000 7f780107e640 1 -- 172.21.15.5:0/3293289864 shutdown_connections 2024-08-31T05:41:44.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.732+0000 7f780107e640 1 --2- 172.21.15.5:0/3293289864 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77fc1069c0 0x7f77fc110410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:44.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.732+0000 7f780107e640 1 --2- 172.21.15.5:0/3293289864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77fc106070 0x7f77fc106480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:44.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.732+0000 7f780107e640 1 --2- 172.21.15.5:0/3293289864 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77fc101d90 0x7f77fc1021a0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:44.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.732+0000 7f780107e640 1 -- 172.21.15.5:0/3293289864 >> 172.21.15.5:0/3293289864 conn(0x7f77fc077a60 msgr2=0x7f77fc077ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:44.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.732+0000 7f780107e640 1 -- 172.21.15.5:0/3293289864 shutdown_connections 2024-08-31T05:41:44.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.732+0000 7f780107e640 1 -- 172.21.15.5:0/3293289864 wait complete. 2024-08-31T05:41:44.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.733+0000 7f780107e640 1 Processor -- start 2024-08-31T05:41:44.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.733+0000 7f780107e640 1 -- start start 2024-08-31T05:41:44.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.734+0000 7f780107e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77fc101d90 0x7f77fc19a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:44.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.734+0000 7f780107e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77fc106070 0x7f77fc19a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:44.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.734+0000 7f780107e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77fc1069c0 0x7f77fc19fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:44.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.734+0000 7f780107e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f77fc113880 con 0x7f77fc1069c0 2024-08-31T05:41:44.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.734+0000 7f780107e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f77fc113700 con 0x7f77fc106070 2024-08-31T05:41:44.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.734+0000 7f780107e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f77fc113a00 con 0x7f77fc101d90 2024-08-31T05:41:44.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.734+0000 7f77fb59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77fc1069c0 0x7f77fc19fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:44.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.734+0000 7f77fa59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77fc106070 0x7f77fc19a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:44.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.734+0000 7f77fad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77fc101d90 0x7f77fc19a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:44.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.734+0000 7f77fa59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77fc106070 0x7f77fc19a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:52522/0 (socket says 172.21.15.5:52522) 2024-08-31T05:41:44.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.734+0000 7f77fa59c640 1 -- 172.21.15.5:0/3226682645 learned_addr learned my addr 172.21.15.5:0/3226682645 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:44.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.734+0000 7f77fad9d640 1 --2- 172.21.15.5:0/3226682645 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77fc101d90 0x7f77fc19a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:55630/0 (socket says 172.21.15.5:55630) 2024-08-31T05:41:44.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.734+0000 7f77fa59c640 1 -- 172.21.15.5:0/3226682645 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77fc101d90 msgr2=0x7f77fc19a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:44.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.734+0000 7f77fa59c640 1 --2- 172.21.15.5:0/3226682645 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77fc101d90 0x7f77fc19a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:44.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.734+0000 7f77fa59c640 1 -- 172.21.15.5:0/3226682645 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77fc1069c0 msgr2=0x7f77fc19fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:44.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.734+0000 7f77fa59c640 1 --2- 172.21.15.5:0/3226682645 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77fc1069c0 0x7f77fc19fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:44.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.734+0000 7f77fa59c640 1 -- 172.21.15.5:0/3226682645 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77fc1a01e0 con 0x7f77fc106070 2024-08-31T05:41:44.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.734+0000 7f77fa59c640 1 --2- 172.21.15.5:0/3226682645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77fc106070 0x7f77fc19a810 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f77f000e9f0 tx=0x7f77f000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:44.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.734+0000 7f77e3fff640 1 -- 172.21.15.5:0/3226682645 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f000ccc0 con 0x7f77fc106070 2024-08-31T05:41:44.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.735+0000 7f780107e640 1 -- 172.21.15.5:0/3226682645 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77fc1a04d0 con 0x7f77fc106070 2024-08-31T05:41:44.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.735+0000 7f77e3fff640 1 -- 172.21.15.5:0/3226682645 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77f00108e0 con 0x7f77fc106070 2024-08-31T05:41:44.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.735+0000 7f77e3fff640 1 -- 172.21.15.5:0/3226682645 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f0018860 con 0x7f77fc106070 2024-08-31T05:41:44.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.735+0000 7f780107e640 1 -- 172.21.15.5:0/3226682645 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77fc1a6c30 con 0x7f77fc106070 2024-08-31T05:41:44.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.738+0000 7f78075f3740 1 Processor -- start 2024-08-31T05:41:44.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.738+0000 7f78075f3740 1 -- start start 2024-08-31T05:41:44.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.738+0000 7f78075f3740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653cade3070 0x5653cb1882c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:44.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.738+0000 7f78075f3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653cadba1b0 0x5653cb188800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:44.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.738+0000 7f78075f3740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653cadc2390 0x5653cb188d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:44.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.738+0000 7f77e3fff640 1 -- 172.21.15.5:0/3226682645 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f77f0018a00 con 0x7f77fc106070 2024-08-31T05:41:44.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.738+0000 7f78075f3740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5653cb0ff630 con 0x5653cadc2390 2024-08-31T05:41:44.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.738+0000 7f78075f3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5653cb0eebc0 con 0x5653cadba1b0 2024-08-31T05:41:44.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.738+0000 7f78075f3740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5653cb0f2b70 con 0x5653cade3070 2024-08-31T05:41:44.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.738+0000 7f77fa59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653cadc2390 0x5653cb188d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:44.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.738+0000 7f77fb59e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653cade3070 0x5653cb1882c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:44.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.738+0000 7f77fad9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653cadba1b0 0x5653cb188800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:44.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.738+0000 7f77fb59e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653cade3070 0x5653cb1882c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:55644/0 (socket says 172.21.15.5:55644) 2024-08-31T05:41:44.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.738+0000 7f77fb59e640 1 -- 172.21.15.5:0/142556952 learned_addr learned my addr 172.21.15.5:0/142556952 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:44.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.739+0000 7f77fa59c640 1 -- 172.21.15.5:0/142556952 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653cade3070 msgr2=0x5653cb1882c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:44.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.739+0000 7f77fa59c640 1 --2- 172.21.15.5:0/142556952 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653cade3070 0x5653cb1882c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:44.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.739+0000 7f77fa59c640 1 -- 172.21.15.5:0/142556952 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653cadba1b0 msgr2=0x5653cb188800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:44.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.739+0000 7f77fa59c640 1 --2- 172.21.15.5:0/142556952 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653cadba1b0 0x5653cb188800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:44.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.739+0000 7f77fa59c640 1 -- 172.21.15.5:0/142556952 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653cae4e650 con 0x5653cadc2390 2024-08-31T05:41:44.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.739+0000 7f77fa59c640 1 --2- 172.21.15.5:0/142556952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653cadc2390 0x5653cb188d40 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f77f00e2fa0 tx=0x7f77f00e9f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee25db31361f3594 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:44.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.739+0000 7f77e17fa640 1 -- 172.21.15.5:0/142556952 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f00f8470 con 0x5653cadc2390 2024-08-31T05:41:44.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.739+0000 7f77e17fa640 1 -- 172.21.15.5:0/142556952 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77f00f3070 con 0x5653cadc2390 2024-08-31T05:41:44.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.739+0000 7f77e17fa640 1 -- 172.21.15.5:0/142556952 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f00ec800 con 0x5653cadc2390 2024-08-31T05:41:44.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.739+0000 7f77e3fff640 1 --2- 172.21.15.5:0/3226682645 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f77e40b4ca0 0x7f77e40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:44.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.739+0000 7f77fb59e640 1 --2- 172.21.15.5:0/3226682645 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f77e40b4ca0 0x7f77e40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:44.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.739+0000 7f77e3fff640 1 -- 172.21.15.5:0/3226682645 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9511+0+0 (secure 0 0 0) 0x7f77f00e5c30 con 0x7f77fc106070 2024-08-31T05:41:44.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.740+0000 7f78075f3740 1 -- 172.21.15.5:0/142556952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653cadc2390 msgr2=0x5653cb188d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:44.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.740+0000 7f77fb59e640 1 --2- 172.21.15.5:0/3226682645 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f77e40b4ca0 0x7f77e40b71b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f77f40116b0 tx=0x7f77f4009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:44.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.740+0000 7f78075f3740 1 --2- 172.21.15.5:0/142556952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653cadc2390 0x5653cb188d40 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f77f00e2fa0 tx=0x7f77f00e9f00 comp rx=0 tx=0).stop 2024-08-31T05:41:44.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.740+0000 7f78075f3740 1 -- 172.21.15.5:0/142556952 shutdown_connections 2024-08-31T05:41:44.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.740+0000 7f78075f3740 1 --2- 172.21.15.5:0/142556952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653cadc2390 0x5653cb188d40 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:44.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.740+0000 7f78075f3740 1 --2- 172.21.15.5:0/142556952 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653cadba1b0 0x5653cb188800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:44.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.740+0000 7f78075f3740 1 --2- 172.21.15.5:0/142556952 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653cade3070 0x5653cb1882c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:44.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.740+0000 7f78075f3740 1 -- 172.21.15.5:0/142556952 >> 172.21.15.5:0/142556952 conn(0x5653cadd7460 msgr2=0x5653cb1861b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:44.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.740+0000 7f78075f3740 1 -- 172.21.15.5:0/142556952 shutdown_connections 2024-08-31T05:41:44.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.740+0000 7f78075f3740 1 -- 172.21.15.5:0/142556952 wait complete. 2024-08-31T05:41:44.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.741+0000 7f78075f3740 1 -- start start 2024-08-31T05:41:44.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.741+0000 7f78075f3740 1 Processor -- start 2024-08-31T05:41:44.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.741+0000 7f78075f3740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653cadba1b0 0x5653cb193aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:44.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.741+0000 7f78075f3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653cadc2390 0x5653cb194000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:44.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.741+0000 7f78075f3740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653cade3070 0x5653cb19fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:44.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.741+0000 7f78075f3740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5653caf51700 con 0x5653cadba1b0 2024-08-31T05:41:44.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.741+0000 7f78075f3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5653cb075700 con 0x5653cadc2390 2024-08-31T05:41:44.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.741+0000 7f78075f3740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5653cb196aa0 con 0x5653cade3070 2024-08-31T05:41:44.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.741+0000 7f78075f3740 10 client.0 _ll_register_callbacks cb 0x5653cb0a4dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:41:44.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.741+0000 7f77fad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653cadba1b0 0x5653cb193aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:44.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.741+0000 7f77fad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653cadba1b0 0x5653cb193aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44160/0 (socket says 172.21.15.5:44160) 2024-08-31T05:41:44.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.741+0000 7f77fad9d640 1 -- 172.21.15.5:0/1914474294 learned_addr learned my addr 172.21.15.5:0/1914474294 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:44.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.741+0000 7f77fb59e640 1 --2- 172.21.15.5:0/1914474294 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653cade3070 0x5653cb19fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:44.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.741+0000 7f77fa59c640 1 --2- 172.21.15.5:0/1914474294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653cadc2390 0x5653cb194000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:44.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.742+0000 7f77fad9d640 1 -- 172.21.15.5:0/1914474294 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653cade3070 msgr2=0x5653cb19fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:44.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.742+0000 7f77fad9d640 1 --2- 172.21.15.5:0/1914474294 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653cade3070 0x5653cb19fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:44.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.742+0000 7f77fad9d640 1 -- 172.21.15.5:0/1914474294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653cadc2390 msgr2=0x5653cb194000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:44.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.742+0000 7f77fad9d640 1 --2- 172.21.15.5:0/1914474294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653cadc2390 0x5653cb194000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:44.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.742+0000 7f77fad9d640 1 -- 172.21.15.5:0/1914474294 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653cb0ae8b0 con 0x5653cadba1b0 2024-08-31T05:41:44.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.742+0000 7f77fa59c640 1 --2- 172.21.15.5:0/1914474294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653cadc2390 0x5653cb194000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:41:44.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.742+0000 7f77fb59e640 1 --2- 172.21.15.5:0/1914474294 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653cade3070 0x5653cb19fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:41:44.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.742+0000 7f77fad9d640 1 --2- 172.21.15.5:0/1914474294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653cadba1b0 0x5653cb193aa0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f77ec009900 tx=0x7f77ec005f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=309e9f35b9531b22 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:44.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.742+0000 7f77deff5640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:41:44.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.742+0000 7f77deff5640 1 -- 172.21.15.5:0/1914474294 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ec035040 con 0x5653cadba1b0 2024-08-31T05:41:44.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.742+0000 7f77deff5640 1 -- 172.21.15.5:0/1914474294 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9511+0+0 (secure 0 0 0) 0x7f77ec0317a0 con 0x5653cadba1b0 2024-08-31T05:41:44.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.742+0000 7f78075f3740 1 -- 172.21.15.5:0/1914474294 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77f00f3070 con 0x5653cadba1b0 2024-08-31T05:41:44.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.742+0000 7f77deff5640 1 -- 172.21.15.5:0/1914474294 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f77ec04f050 con 0x5653cadba1b0 2024-08-31T05:41:44.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.742+0000 7f78075f3740 10 client.18663 fetch_fsmap learned FSMap version 34 2024-08-31T05:41:44.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.742+0000 7f78075f3740 1 -- 172.21.15.5:0/1914474294 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5653cb1a28e0 con 0x5653cadba1b0 2024-08-31T05:41:44.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.742+0000 7f77deff5640 1 -- 172.21.15.5:0/1914474294 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77f00f3070 con 0x5653cadba1b0 2024-08-31T05:41:44.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.743+0000 7f77deff5640 1 -- 172.21.15.5:0/1914474294 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f77ec004750 con 0x5653cadba1b0 2024-08-31T05:41:44.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.743+0000 7f78075f3740 10 client.18663 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:41:44.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.743+0000 7f78075f3740 10 client.18663 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:41:44.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.743+0000 7f78075f3740 20 client.18663 populate_metadata read hostname 'smithi005' 2024-08-31T05:41:44.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.743+0000 7f78075f3740 1 --2- 172.21.15.5:0/1914474294 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5653cada19f0 0x5653cb1a5e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:44.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.743+0000 7f78075f3740 4 client.18663 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:41:44.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.743+0000 7f78075f3740 1 -- 172.21.15.5:0/1914474294 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5653cb101580 con 0x5653cada19f0 2024-08-31T05:41:44.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.743+0000 7f77fa59c640 1 --2- 172.21.15.5:0/1914474294 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5653cada19f0 0x5653cb1a5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:44.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.743+0000 7f77deff5640 10 client.18663 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:41:44.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.743+0000 7f77fa59c640 1 --2- 172.21.15.5:0/1914474294 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5653cada19f0 0x5653cb1a5e70 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25470f51a361cb98 server_cookie=1667a75c049acd3a in_seq=0 out_seq=0 2024-08-31T05:41:44.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.744+0000 7f77deff5640 1 -- 172.21.15.5:0/1914474294 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5653cb101580 con 0x5653cada19f0 2024-08-31T05:41:44.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.744+0000 7f77deff5640 10 client.18663 handle_command_reply: tid=0 2024-08-31T05:41:44.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.744+0000 7f78075f3740 1 client.18663 shutdown 2024-08-31T05:41:44.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.744+0000 7f78075f3740 1 -- 172.21.15.5:0/1914474294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653cadba1b0 msgr2=0x5653cb193aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:44.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.744+0000 7f78075f3740 1 --2- 172.21.15.5:0/1914474294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653cadba1b0 0x5653cb193aa0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f77ec009900 tx=0x7f77ec005f00 comp rx=0 tx=0).stop 2024-08-31T05:41:44.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.744+0000 7f78075f3740 1 -- 172.21.15.5:0/1914474294 shutdown_connections 2024-08-31T05:41:44.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.744+0000 7f78075f3740 1 --2- 172.21.15.5:0/1914474294 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5653cada19f0 0x5653cb1a5e70 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:44.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.744+0000 7f78075f3740 1 --2- 172.21.15.5:0/1914474294 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653cade3070 0x5653cb19fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:44.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.744+0000 7f78075f3740 1 --2- 172.21.15.5:0/1914474294 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653cadc2390 0x5653cb194000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:44.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.744+0000 7f78075f3740 1 --2- 172.21.15.5:0/1914474294 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653cadba1b0 0x5653cb193aa0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:44.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.744+0000 7f77deff5640 0 client.18663 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:41:44.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.744+0000 7f78075f3740 1 -- 172.21.15.5:0/1914474294 >> 172.21.15.5:0/1914474294 conn(0x5653cadd7460 msgr2=0x5653cb18b450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:44.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.744+0000 7f78075f3740 1 -- 172.21.15.5:0/1914474294 shutdown_connections 2024-08-31T05:41:44.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.744+0000 7f78075f3740 1 -- 172.21.15.5:0/1914474294 wait complete. 2024-08-31T05:41:44.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.744+0000 7f78075f3740 20 client.18663 trim_cache size 0 max 16384 2024-08-31T05:41:44.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.762+0000 7f78075f3740 1 Processor -- start 2024-08-31T05:41:44.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.762+0000 7f78075f3740 1 -- start start 2024-08-31T05:41:44.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.763+0000 7f78075f3740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653cadba1b0 0x5653cb186200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:44.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.763+0000 7f78075f3740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653cadc2390 0x5653cb19fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:44.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.763+0000 7f78075f3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653cade3070 0x5653cb1a01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:44.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.763+0000 7f78075f3740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f77fc1b0d50 con 0x5653cadc2390 2024-08-31T05:41:44.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.763+0000 7f78075f3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f77fc1b2890 con 0x5653cade3070 2024-08-31T05:41:44.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.763+0000 7f78075f3740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f77fc1b1420 con 0x5653cadba1b0 2024-08-31T05:41:44.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.763+0000 7f77fa59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653cadc2390 0x5653cb19fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:44.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.763+0000 7f77fad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653cadba1b0 0x5653cb186200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:44.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.763+0000 7f77fa59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653cadc2390 0x5653cb19fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44162/0 (socket says 172.21.15.5:44162) 2024-08-31T05:41:44.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.763+0000 7f77fa59c640 1 -- 172.21.15.5:0/4287179335 learned_addr learned my addr 172.21.15.5:0/4287179335 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:44.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.763+0000 7f77fad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653cadba1b0 0x5653cb186200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:55656/0 (socket says 172.21.15.5:55656) 2024-08-31T05:41:44.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.763+0000 7f77fb59e640 1 --2- 172.21.15.5:0/4287179335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653cade3070 0x5653cb1a01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:44.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.763+0000 7f77fa59c640 1 -- 172.21.15.5:0/4287179335 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653cadba1b0 msgr2=0x5653cb186200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:44.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.763+0000 7f77fa59c640 1 --2- 172.21.15.5:0/4287179335 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653cadba1b0 0x5653cb186200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:44.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.763+0000 7f77fa59c640 1 -- 172.21.15.5:0/4287179335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653cade3070 msgr2=0x5653cb1a01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:44.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.763+0000 7f77fa59c640 1 --2- 172.21.15.5:0/4287179335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653cade3070 0x5653cb1a01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:44.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.763+0000 7f77fa59c640 1 -- 172.21.15.5:0/4287179335 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653cb192a00 con 0x5653cadc2390 2024-08-31T05:41:44.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.763+0000 7f77fad9d640 1 --2- 172.21.15.5:0/4287179335 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653cadba1b0 0x5653cb186200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:41:44.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.763+0000 7f77fa59c640 1 --2- 172.21.15.5:0/4287179335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653cadc2390 0x5653cb19fc90 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f77f00e35a0 tx=0x7f77f00e9fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cca8c3d38501380e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:44.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.764+0000 7f77e0ff9640 1 -- 172.21.15.5:0/4287179335 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f00ab940 con 0x5653cadc2390 2024-08-31T05:41:44.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.764+0000 7f77e0ff9640 1 -- 172.21.15.5:0/4287179335 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77f00f3040 con 0x5653cadc2390 2024-08-31T05:41:44.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.764+0000 7f77e0ff9640 1 -- 172.21.15.5:0/4287179335 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f00ab760 con 0x5653cadc2390 2024-08-31T05:41:44.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.765+0000 7f78075f3740 1 -- 172.21.15.5:0/4287179335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653cadc2390 msgr2=0x5653cb19fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:44.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.765+0000 7f78075f3740 1 --2- 172.21.15.5:0/4287179335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653cadc2390 0x5653cb19fc90 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f77f00e35a0 tx=0x7f77f00e9fd0 comp rx=0 tx=0).stop 2024-08-31T05:41:44.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.765+0000 7f78075f3740 1 -- 172.21.15.5:0/4287179335 shutdown_connections 2024-08-31T05:41:44.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.765+0000 7f78075f3740 1 --2- 172.21.15.5:0/4287179335 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653cade3070 0x5653cb1a01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:44.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.765+0000 7f78075f3740 1 --2- 172.21.15.5:0/4287179335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653cadc2390 0x5653cb19fc90 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:44.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.765+0000 7f78075f3740 1 --2- 172.21.15.5:0/4287179335 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653cadba1b0 0x5653cb186200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:44.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.765+0000 7f78075f3740 1 -- 172.21.15.5:0/4287179335 >> 172.21.15.5:0/4287179335 conn(0x5653cadd7460 msgr2=0x5653cb185af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:44.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.765+0000 7f78075f3740 1 -- 172.21.15.5:0/4287179335 shutdown_connections 2024-08-31T05:41:44.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.765+0000 7f78075f3740 1 -- 172.21.15.5:0/4287179335 wait complete. 2024-08-31T05:41:44.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.765+0000 7f78075f3740 1 -- start start 2024-08-31T05:41:44.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.765+0000 7f78075f3740 1 Processor -- start 2024-08-31T05:41:44.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.765+0000 7f78075f3740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653cadba1b0 0x5653cb197f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:44.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.765+0000 7f78075f3740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653cadc2390 0x5653cb198470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:44.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.765+0000 7f78075f3740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653cade3070 0x5653cb20f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:44.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.765+0000 7f78075f3740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f77fc1b21c0 con 0x5653cadba1b0 2024-08-31T05:41:44.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.765+0000 7f78075f3740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f77fc1b1af0 con 0x5653cadc2390 2024-08-31T05:41:44.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.765+0000 7f78075f3740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f77fc1aed50 con 0x5653cade3070 2024-08-31T05:41:44.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.766+0000 7f78075f3740 10 client.0 _ll_register_callbacks cb 0x7f77ec009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:41:44.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.766+0000 7f77fad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653cadba1b0 0x5653cb197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:44.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.766+0000 7f77fad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653cadba1b0 0x5653cb197f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44164/0 (socket says 172.21.15.5:44164) 2024-08-31T05:41:44.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.766+0000 7f77fad9d640 1 -- 172.21.15.5:0/4013904849 learned_addr learned my addr 172.21.15.5:0/4013904849 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:44.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.766+0000 7f77fa59c640 1 --2- 172.21.15.5:0/4013904849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653cadc2390 0x5653cb198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:44.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.766+0000 7f77fb59e640 1 --2- 172.21.15.5:0/4013904849 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653cade3070 0x5653cb20f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:44.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.766+0000 7f77fad9d640 1 -- 172.21.15.5:0/4013904849 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653cade3070 msgr2=0x5653cb20f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:44.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.766+0000 7f77fad9d640 1 --2- 172.21.15.5:0/4013904849 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653cade3070 0x5653cb20f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:44.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.766+0000 7f77fad9d640 1 -- 172.21.15.5:0/4013904849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653cadc2390 msgr2=0x5653cb198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:44.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.766+0000 7f77fad9d640 1 --2- 172.21.15.5:0/4013904849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653cadc2390 0x5653cb198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:44.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.766+0000 7f77fad9d640 1 -- 172.21.15.5:0/4013904849 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653cb198c60 con 0x5653cadba1b0 2024-08-31T05:41:44.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.766+0000 7f77fad9d640 1 --2- 172.21.15.5:0/4013904849 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653cadba1b0 0x5653cb197f30 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f77ec009900 tx=0x7f77ec031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc8b3282bb187175 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:44.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.766+0000 7f77deff5640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:41:44.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.766+0000 7f77deff5640 1 -- 172.21.15.5:0/4013904849 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ec058060 con 0x5653cadba1b0 2024-08-31T05:41:44.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.766+0000 7f78075f3740 1 -- 172.21.15.5:0/4013904849 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77f00f3040 con 0x5653cadba1b0 2024-08-31T05:41:44.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.766+0000 7f77deff5640 1 -- 172.21.15.5:0/4013904849 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9511+0+0 (secure 0 0 0) 0x7f77ec031da0 con 0x5653cadba1b0 2024-08-31T05:41:44.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.766+0000 7f77deff5640 1 -- 172.21.15.5:0/4013904849 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f77ec05f050 con 0x5653cadba1b0 2024-08-31T05:41:44.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.767+0000 7f78075f3740 10 client.18669 fetch_fsmap learned FSMap version 34 2024-08-31T05:41:44.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.767+0000 7f78075f3740 1 -- 172.21.15.5:0/4013904849 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5653cb210da0 con 0x5653cadba1b0 2024-08-31T05:41:44.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.767+0000 7f77deff5640 1 -- 172.21.15.5:0/4013904849 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77f00f3040 con 0x5653cadba1b0 2024-08-31T05:41:44.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.767+0000 7f77deff5640 1 -- 172.21.15.5:0/4013904849 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f77ec005470 con 0x5653cadba1b0 2024-08-31T05:41:44.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.767+0000 7f78075f3740 10 client.18669 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:41:44.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.767+0000 7f78075f3740 10 client.18669 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:41:44.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.767+0000 7f78075f3740 20 client.18669 populate_metadata read hostname 'smithi005' 2024-08-31T05:41:44.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.767+0000 7f78075f3740 1 --2- 172.21.15.5:0/4013904849 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5653cad76da0 0x5653cb213530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:44.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.767+0000 7f78075f3740 4 client.18669 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T05:41:44.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.767+0000 7f78075f3740 1 -- 172.21.15.5:0/4013904849 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5653cb0fd020 con 0x5653cad76da0 2024-08-31T05:41:44.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.767+0000 7f77fa59c640 1 --2- 172.21.15.5:0/4013904849 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5653cad76da0 0x5653cb213530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:44.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.768+0000 7f77deff5640 10 client.18669 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:41:44.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.768+0000 7f77fa59c640 1 --2- 172.21.15.5:0/4013904849 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5653cad76da0 0x5653cb213530 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a1b6dd31521146c server_cookie=65c67601f9c49ed in_seq=0 out_seq=0 2024-08-31T05:41:44.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.768+0000 7f77deff5640 1 -- 172.21.15.5:0/4013904849 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4350 (crc 0 0 0) 0x5653cb0fd020 con 0x5653cad76da0 2024-08-31T05:41:44.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.768+0000 7f77deff5640 10 client.18669 handle_command_reply: tid=0 2024-08-31T05:41:44.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.768+0000 7f78075f3740 1 client.18669 shutdown 2024-08-31T05:41:44.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.768+0000 7f78075f3740 1 -- 172.21.15.5:0/4013904849 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653cadba1b0 msgr2=0x5653cb197f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:44.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.768+0000 7f78075f3740 1 --2- 172.21.15.5:0/4013904849 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653cadba1b0 0x5653cb197f30 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f77ec009900 tx=0x7f77ec031400 comp rx=0 tx=0).stop 2024-08-31T05:41:44.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.768+0000 7f78075f3740 1 -- 172.21.15.5:0/4013904849 shutdown_connections 2024-08-31T05:41:44.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.768+0000 7f78075f3740 1 --2- 172.21.15.5:0/4013904849 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5653cad76da0 0x5653cb213530 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:44.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.768+0000 7f78075f3740 1 --2- 172.21.15.5:0/4013904849 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5653cade3070 0x5653cb20f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:44.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.768+0000 7f78075f3740 1 --2- 172.21.15.5:0/4013904849 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5653cadc2390 0x5653cb198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:44.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.768+0000 7f78075f3740 1 --2- 172.21.15.5:0/4013904849 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653cadba1b0 0x5653cb197f30 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:44.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.768+0000 7f77deff5640 0 client.18669 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:41:44.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.768+0000 7f78075f3740 1 -- 172.21.15.5:0/4013904849 >> 172.21.15.5:0/4013904849 conn(0x5653cadd7460 msgr2=0x5653cb18b310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:44.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.768+0000 7f78075f3740 1 -- 172.21.15.5:0/4013904849 shutdown_connections 2024-08-31T05:41:44.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.768+0000 7f78075f3740 1 -- 172.21.15.5:0/4013904849 wait complete. 2024-08-31T05:41:44.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.768+0000 7f78075f3740 20 client.18669 trim_cache size 0 max 16384 2024-08-31T05:41:44.775 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:41:44.775 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "no active scrubs running", 2024-08-31T05:41:44.776 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": {}, 2024-08-31T05:41:44.776 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_stats": { 2024-08-31T05:41:44.776 INFO:teuthology.orchestra.run.smithi005.stdout: "ab2853ca-505f-43fc-a132-af8bca186292": { 2024-08-31T05:41:44.776 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:40:23.937602+0000", 2024-08-31T05:41:44.776 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:41:44.776 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:41:44.776 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:41:44.776 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:41:44.776 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:41:44.776 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:41:44.776 INFO:teuthology.orchestra.run.smithi005.stdout: "75d84398-5d9c-4872-b879-2fbce045fa71": { 2024-08-31T05:41:44.776 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:06.642335+0000", 2024-08-31T05:41:44.776 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:41:44.776 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:41:44.777 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:41:44.777 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:41:44.777 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:41:44.777 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:41:44.777 INFO:teuthology.orchestra.run.smithi005.stdout: "ece37b07-9ab2-45f8-bc33-2755a07aac0b": { 2024-08-31T05:41:44.777 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:31:41.782407+0000", 2024-08-31T05:41:44.777 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:41:44.777 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:41:44.777 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:41:44.777 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:41:44.777 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:41:44.777 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:41:44.777 INFO:teuthology.orchestra.run.smithi005.stdout: "728a42ca-bbef-4151-830f-5fdd411d8fa0": { 2024-08-31T05:41:44.777 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:32:30.554906+0000", 2024-08-31T05:41:44.778 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:41:44.778 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:41:44.778 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:41:44.778 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:41:44.778 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:41:44.778 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:41:44.778 INFO:teuthology.orchestra.run.smithi005.stdout: "cda92ac0-b35f-47a5-a3a5-471c888462a5": { 2024-08-31T05:41:44.778 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:53.103905+0000", 2024-08-31T05:41:44.778 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:41:44.778 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:41:44.778 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:41:44.778 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:41:44.778 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:41:44.778 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:41:44.779 INFO:teuthology.orchestra.run.smithi005.stdout: "0bb67292-013a-40c7-b5fc-810bdd9715d8": { 2024-08-31T05:41:44.779 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:34:04.586008+0000", 2024-08-31T05:41:44.779 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:41:44.779 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:41:44.779 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:41:44.779 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:41:44.779 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:41:44.779 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:41:44.779 INFO:teuthology.orchestra.run.smithi005.stdout: "c9a687a5-4adf-4788-8f18-4c06352efa9b": { 2024-08-31T05:41:44.779 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:41:11.380197+0000", 2024-08-31T05:41:44.779 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:41:44.779 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:41:44.779 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:41:44.779 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:41:44.779 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:41:44.780 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:41:44.780 INFO:teuthology.orchestra.run.smithi005.stdout: "de9731c7-ae4a-42fe-8146-e4752cdc40d4": { 2024-08-31T05:41:44.780 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:34:53.614499+0000", 2024-08-31T05:41:44.780 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:41:44.780 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:41:44.780 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:41:44.780 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:41:44.780 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:41:44.780 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:41:44.780 INFO:teuthology.orchestra.run.smithi005.stdout: "f4db3406-20ff-46a3-baf9-099e16392f76": { 2024-08-31T05:41:44.780 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:38:49.034412+0000", 2024-08-31T05:41:44.780 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:41:44.780 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:41:44.781 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:41:44.781 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:41:44.781 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:41:44.781 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:41:44.781 INFO:teuthology.orchestra.run.smithi005.stdout: "095ccc7a-f368-4bc6-9563-5930e21f9b4a": { 2024-08-31T05:41:44.781 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:35:40.190069+0000", 2024-08-31T05:41:44.781 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:41:44.781 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:41:44.781 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:41:44.781 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:41:44.782 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:41:44.782 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:41:44.782 INFO:teuthology.orchestra.run.smithi005.stdout: "297c26f3-7b4d-4245-abb0-f854248e5e1b": { 2024-08-31T05:41:44.782 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:37:14.019244+0000", 2024-08-31T05:41:44.782 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:41:44.782 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:41:44.782 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:41:44.782 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:41:44.782 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:41:44.783 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:41:44.783 INFO:teuthology.orchestra.run.smithi005.stdout: "a4d4cf74-2477-4dd9-a3a2-3762b4dd87e4": { 2024-08-31T05:41:44.783 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:38:01.378833+0000", 2024-08-31T05:41:44.783 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:41:44.783 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:41:44.783 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:41:44.783 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:41:44.783 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:41:44.783 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:41:44.783 INFO:teuthology.orchestra.run.smithi005.stdout: "94c23057-592d-4a8b-82d7-da2d84f8740b": { 2024-08-31T05:41:44.783 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:36:27.513638+0000", 2024-08-31T05:41:44.783 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:41:44.783 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:41:44.783 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:41:44.784 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:41:44.784 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:41:44.784 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:41:44.784 INFO:teuthology.orchestra.run.smithi005.stdout: "2445fc42-b797-434f-b380-e2da985b4d98": { 2024-08-31T05:41:44.784 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:33:17.681453+0000", 2024-08-31T05:41:44.784 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:41:44.784 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:41:44.784 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:41:44.784 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:41:44.784 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:41:44.784 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:41:44.784 INFO:teuthology.orchestra.run.smithi005.stdout: "239b7958-db06-4432-93ce-b7552effa357": { 2024-08-31T05:41:44.785 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:39:35.733028+0000", 2024-08-31T05:41:44.785 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:41:44.785 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:41:44.785 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:41:44.785 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:41:44.785 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:41:44.785 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:41:44.785 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:41:44.785 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:41:44.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.769+0000 7f780107e640 1 -- 172.21.15.5:0/3226682645 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f77e40b4ca0 msgr2=0x7f77e40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:44.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.769+0000 7f780107e640 1 --2- 172.21.15.5:0/3226682645 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f77e40b4ca0 0x7f77e40b71b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f77f40116b0 tx=0x7f77f4009500 comp rx=0 tx=0).stop 2024-08-31T05:41:44.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.769+0000 7f780107e640 1 -- 172.21.15.5:0/3226682645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77fc106070 msgr2=0x7f77fc19a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:44.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.769+0000 7f780107e640 1 --2- 172.21.15.5:0/3226682645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77fc106070 0x7f77fc19a810 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f77f000e9f0 tx=0x7f77f000eeb0 comp rx=0 tx=0).stop 2024-08-31T05:41:44.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.769+0000 7f780107e640 1 -- 172.21.15.5:0/3226682645 shutdown_connections 2024-08-31T05:41:44.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.769+0000 7f780107e640 1 --2- 172.21.15.5:0/3226682645 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f77e40b4ca0 0x7f77e40b71b0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:44.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.769+0000 7f780107e640 1 --2- 172.21.15.5:0/3226682645 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f77fc1069c0 0x7f77fc19fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:44.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.769+0000 7f780107e640 1 --2- 172.21.15.5:0/3226682645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f77fc106070 0x7f77fc19a810 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:44.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.769+0000 7f780107e640 1 --2- 172.21.15.5:0/3226682645 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77fc101d90 0x7f77fc19a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:44.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.769+0000 7f780107e640 1 -- 172.21.15.5:0/3226682645 >> 172.21.15.5:0/3226682645 conn(0x7f77fc077a60 msgr2=0x7f77fc107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:44.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.769+0000 7f780107e640 1 -- 172.21.15.5:0/3226682645 shutdown_connections 2024-08-31T05:41:44.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:44.769+0000 7f780107e640 1 -- 172.21.15.5:0/3226682645 wait complete. 2024-08-31T05:41:44.939 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1324641 10.83 MB/sec execute 512 sec latency 35.116 ms 2024-08-31T05:41:45.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:41:44 smithi005 ceph-mon[18602]: pgmap v708: 129 pgs: 129 active+clean; 574 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.3 MiB/s wr, 209 op/s 2024-08-31T05:41:45.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:41:44 smithi070 ceph-mon[22316]: pgmap v708: 129 pgs: 129 active+clean; 574 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.3 MiB/s wr, 209 op/s 2024-08-31T05:41:45.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:41:44 smithi050 ceph-mon[22146]: pgmap v708: 129 pgs: 129 active+clean; 574 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.3 MiB/s wr, 209 op/s 2024-08-31T05:41:45.541 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.539+0000 7fde6cc8d640 1 -- 172.21.15.5:0/2212831590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde681046b0 msgr2=0x7fde68104ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:45.542 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.539+0000 7fde6cc8d640 1 --2- 172.21.15.5:0/2212831590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde681046b0 0x7fde68104ac0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fde60009900 tx=0x7fde6002a410 comp rx=0 tx=0).stop 2024-08-31T05:41:45.542 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.539+0000 7fde6cc8d640 1 -- 172.21.15.5:0/2212831590 shutdown_connections 2024-08-31T05:41:45.542 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.539+0000 7fde6cc8d640 1 --2- 172.21.15.5:0/2212831590 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde6810db10 0x7fde68110000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:45.542 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.539+0000 7fde6cc8d640 1 --2- 172.21.15.5:0/2212831590 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde68105000 0x7fde6810d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:45.542 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.539+0000 7fde6cc8d640 1 --2- 172.21.15.5:0/2212831590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde681046b0 0x7fde68104ac0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:45.542 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.539+0000 7fde6cc8d640 1 -- 172.21.15.5:0/2212831590 >> 172.21.15.5:0/2212831590 conn(0x7fde680fe160 msgr2=0x7fde681005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:45.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.539+0000 7fde6cc8d640 1 -- 172.21.15.5:0/2212831590 shutdown_connections 2024-08-31T05:41:45.543 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.539+0000 7fde6cc8d640 1 -- 172.21.15.5:0/2212831590 wait complete. 2024-08-31T05:41:45.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.540+0000 7fde6cc8d640 1 Processor -- start 2024-08-31T05:41:45.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.540+0000 7fde6cc8d640 1 -- start start 2024-08-31T05:41:45.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.540+0000 7fde6cc8d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde681046b0 0x7fde6819a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:45.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.540+0000 7fde6cc8d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde68105000 0x7fde6819a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:45.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.540+0000 7fde6cc8d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde6810db10 0x7fde6819fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:45.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.540+0000 7fde6cc8d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fde68113780 con 0x7fde68105000 2024-08-31T05:41:45.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.540+0000 7fde6cc8d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fde68113600 con 0x7fde681046b0 2024-08-31T05:41:45.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.540+0000 7fde6cc8d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fde68113900 con 0x7fde6810db10 2024-08-31T05:41:45.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.540+0000 7fde65d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde68105000 0x7fde6819a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:45.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.540+0000 7fde6659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde681046b0 0x7fde6819a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:45.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.540+0000 7fde65d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde68105000 0x7fde6819a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44178/0 (socket says 172.21.15.5:44178) 2024-08-31T05:41:45.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.540+0000 7fde65d9b640 1 -- 172.21.15.5:0/506935883 learned_addr learned my addr 172.21.15.5:0/506935883 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:45.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.540+0000 7fde66d9d640 1 --2- 172.21.15.5:0/506935883 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde6810db10 0x7fde6819fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:45.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.541+0000 7fde65d9b640 1 -- 172.21.15.5:0/506935883 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde6810db10 msgr2=0x7fde6819fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:45.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.541+0000 7fde65d9b640 1 --2- 172.21.15.5:0/506935883 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde6810db10 0x7fde6819fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:45.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.541+0000 7fde65d9b640 1 -- 172.21.15.5:0/506935883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde681046b0 msgr2=0x7fde6819a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:45.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.541+0000 7fde65d9b640 1 --2- 172.21.15.5:0/506935883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde681046b0 0x7fde6819a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:45.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.541+0000 7fde65d9b640 1 -- 172.21.15.5:0/506935883 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde681a0130 con 0x7fde68105000 2024-08-31T05:41:45.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.541+0000 7fde65d9b640 1 --2- 172.21.15.5:0/506935883 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde68105000 0x7fde6819a7a0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fde5000e9f0 tx=0x7fde5000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:45.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.541+0000 7fde5f7fe640 1 -- 172.21.15.5:0/506935883 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde5000ccc0 con 0x7fde68105000 2024-08-31T05:41:45.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.541+0000 7fde6cc8d640 1 -- 172.21.15.5:0/506935883 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde681a0420 con 0x7fde68105000 2024-08-31T05:41:45.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.541+0000 7fde5f7fe640 1 -- 172.21.15.5:0/506935883 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde500108e0 con 0x7fde68105000 2024-08-31T05:41:45.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.541+0000 7fde5f7fe640 1 -- 172.21.15.5:0/506935883 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde50018860 con 0x7fde68105000 2024-08-31T05:41:45.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.541+0000 7fde6cc8d640 1 -- 172.21.15.5:0/506935883 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde681a6bb0 con 0x7fde68105000 2024-08-31T05:41:45.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.544+0000 7fde73bfa740 1 Processor -- start 2024-08-31T05:41:45.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.544+0000 7fde73bfa740 1 -- start start 2024-08-31T05:41:45.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.544+0000 7fde5f7fe640 1 -- 172.21.15.5:0/506935883 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fde50010430 con 0x7fde68105000 2024-08-31T05:41:45.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.544+0000 7fde73bfa740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a2081e1b0 0x564a20bc1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:45.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.544+0000 7fde73bfa740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564a207f52f0 0x564a20bc2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:45.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.544+0000 7fde73bfa740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564a207fd4d0 0x564a20bc2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:45.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.544+0000 7fde73bfa740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x564a20b37000 con 0x564a207fd4d0 2024-08-31T05:41:45.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.544+0000 7fde73bfa740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564a20b26590 con 0x564a2081e1b0 2024-08-31T05:41:45.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.544+0000 7fde73bfa740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564a20b2a540 con 0x564a207f52f0 2024-08-31T05:41:45.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.544+0000 7fde66d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a2081e1b0 0x564a20bc1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:45.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.544+0000 7fde65d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564a207fd4d0 0x564a20bc2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:45.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.544+0000 7fde66d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a2081e1b0 0x564a20bc1ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:52576/0 (socket says 172.21.15.5:52576) 2024-08-31T05:41:45.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.544+0000 7fde6659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564a207f52f0 0x564a20bc2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:45.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.544+0000 7fde66d9d640 1 -- 172.21.15.5:0/770596956 learned_addr learned my addr 172.21.15.5:0/770596956 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:45.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.545+0000 7fde6659c640 1 -- 172.21.15.5:0/770596956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a2081e1b0 msgr2=0x564a20bc1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:45.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.545+0000 7fde6659c640 1 --2- 172.21.15.5:0/770596956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a2081e1b0 0x564a20bc1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:45.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.545+0000 7fde6659c640 1 -- 172.21.15.5:0/770596956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564a207fd4d0 msgr2=0x564a20bc2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:45.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.545+0000 7fde6659c640 1 --2- 172.21.15.5:0/770596956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564a207fd4d0 0x564a20bc2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:45.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.545+0000 7fde6659c640 1 -- 172.21.15.5:0/770596956 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a20889790 con 0x564a207f52f0 2024-08-31T05:41:45.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.545+0000 7fde65d9b640 1 --2- 172.21.15.5:0/770596956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564a207fd4d0 0x564a20bc2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:41:45.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.545+0000 7fde5f7fe640 1 --2- 172.21.15.5:0/506935883 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fde540b4ca0 0x7fde540b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:45.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.545+0000 7fde6659c640 1 --2- 172.21.15.5:0/770596956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564a207f52f0 0x564a20bc2220 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fde60006010 tx=0x7fde60032b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2aafdb7654238131 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:45.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.545+0000 7fde66d9d640 1 --2- 172.21.15.5:0/506935883 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fde540b4ca0 0x7fde540b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:45.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.545+0000 7fde5f7fe640 1 -- 172.21.15.5:0/506935883 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9511+0+0 (secure 0 0 0) 0x7fde500e5bd0 con 0x7fde68105000 2024-08-31T05:41:45.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.545+0000 7fde5cff9640 1 -- 172.21.15.5:0/770596956 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde60035040 con 0x564a207f52f0 2024-08-31T05:41:45.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.545+0000 7fde5cff9640 1 -- 172.21.15.5:0/770596956 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde60004030 con 0x564a207f52f0 2024-08-31T05:41:45.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.545+0000 7fde5cff9640 1 -- 172.21.15.5:0/770596956 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde60005470 con 0x564a207f52f0 2024-08-31T05:41:45.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.546+0000 7fde73bfa740 1 -- 172.21.15.5:0/770596956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564a207f52f0 msgr2=0x564a20bc2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:45.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.546+0000 7fde73bfa740 1 --2- 172.21.15.5:0/770596956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564a207f52f0 0x564a20bc2220 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fde60006010 tx=0x7fde60032b90 comp rx=0 tx=0).stop 2024-08-31T05:41:45.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.546+0000 7fde66d9d640 1 --2- 172.21.15.5:0/506935883 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fde540b4ca0 0x7fde540b71b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fde58011690 tx=0x7fde58009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:45.566 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.546+0000 7fde73bfa740 1 -- 172.21.15.5:0/770596956 shutdown_connections 2024-08-31T05:41:45.566 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.546+0000 7fde73bfa740 1 --2- 172.21.15.5:0/770596956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564a207fd4d0 0x564a20bc2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:45.566 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.546+0000 7fde73bfa740 1 --2- 172.21.15.5:0/770596956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564a207f52f0 0x564a20bc2220 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:45.566 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.546+0000 7fde73bfa740 1 --2- 172.21.15.5:0/770596956 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a2081e1b0 0x564a20bc1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:45.566 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.546+0000 7fde73bfa740 1 -- 172.21.15.5:0/770596956 >> 172.21.15.5:0/770596956 conn(0x564a20812300 msgr2=0x564a20bbfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:45.566 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.546+0000 7fde73bfa740 1 -- 172.21.15.5:0/770596956 shutdown_connections 2024-08-31T05:41:45.566 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.546+0000 7fde73bfa740 1 -- 172.21.15.5:0/770596956 wait complete. 2024-08-31T05:41:45.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.547+0000 7fde73bfa740 1 -- start start 2024-08-31T05:41:45.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.547+0000 7fde73bfa740 1 Processor -- start 2024-08-31T05:41:45.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.547+0000 7fde73bfa740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564a207f52f0 0x564a20bcd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:45.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.547+0000 7fde73bfa740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564a207fd4d0 0x564a20bcddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:45.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.547+0000 7fde73bfa740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a2081e1b0 0x564a20bd9720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:45.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.547+0000 7fde73bfa740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x564a20a5fab0 con 0x564a207f52f0 2024-08-31T05:41:45.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.547+0000 7fde73bfa740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564a20aad680 con 0x564a2081e1b0 2024-08-31T05:41:45.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.547+0000 7fde73bfa740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564a20bd0400 con 0x564a207fd4d0 2024-08-31T05:41:45.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.547+0000 7fde73bfa740 10 client.0 _ll_register_callbacks cb 0x564a20835a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:41:45.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.547+0000 7fde6659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564a207f52f0 0x564a20bcd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:45.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.547+0000 7fde6659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564a207f52f0 0x564a20bcd8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44198/0 (socket says 172.21.15.5:44198) 2024-08-31T05:41:45.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.547+0000 7fde6659c640 1 -- 172.21.15.5:0/2578786772 learned_addr learned my addr 172.21.15.5:0/2578786772 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:45.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.547+0000 7fde65d9b640 1 --2- 172.21.15.5:0/2578786772 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564a207fd4d0 0x564a20bcddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:45.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.547+0000 7fde66d9d640 1 --2- 172.21.15.5:0/2578786772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a2081e1b0 0x564a20bd9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:45.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.547+0000 7fde6659c640 1 -- 172.21.15.5:0/2578786772 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564a207fd4d0 msgr2=0x564a20bcddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:45.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.547+0000 7fde6659c640 1 --2- 172.21.15.5:0/2578786772 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564a207fd4d0 0x564a20bcddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:45.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.547+0000 7fde6659c640 1 -- 172.21.15.5:0/2578786772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a2081e1b0 msgr2=0x564a20bd9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:45.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.547+0000 7fde6659c640 1 --2- 172.21.15.5:0/2578786772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a2081e1b0 0x564a20bd9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:45.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.547+0000 7fde6659c640 1 -- 172.21.15.5:0/2578786772 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a20902620 con 0x564a207f52f0 2024-08-31T05:41:45.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.548+0000 7fde6659c640 1 --2- 172.21.15.5:0/2578786772 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564a207f52f0 0x564a20bcd8b0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fde60032f30 tx=0x7fde60005050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c698c2c193e5db2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:45.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.548+0000 7fde4dffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:41:45.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.548+0000 7fde4dffb640 1 -- 172.21.15.5:0/2578786772 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde60035070 con 0x564a207f52f0 2024-08-31T05:41:45.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.548+0000 7fde4dffb640 1 -- 172.21.15.5:0/2578786772 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9511+0+0 (secure 0 0 0) 0x7fde60004470 con 0x564a207f52f0 2024-08-31T05:41:45.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.548+0000 7fde73bfa740 1 -- 172.21.15.5:0/2578786772 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde60004030 con 0x564a207f52f0 2024-08-31T05:41:45.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.548+0000 7fde4dffb640 1 -- 172.21.15.5:0/2578786772 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fde60005270 con 0x564a207f52f0 2024-08-31T05:41:45.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.548+0000 7fde73bfa740 10 client.18681 fetch_fsmap learned FSMap version 34 2024-08-31T05:41:45.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.548+0000 7fde73bfa740 1 -- 172.21.15.5:0/2578786772 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x564a20bdc470 con 0x564a207f52f0 2024-08-31T05:41:45.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.548+0000 7fde4dffb640 1 -- 172.21.15.5:0/2578786772 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde60004030 con 0x564a207f52f0 2024-08-31T05:41:45.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.548+0000 7fde4dffb640 1 -- 172.21.15.5:0/2578786772 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fde60004b00 con 0x564a207f52f0 2024-08-31T05:41:45.571 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.548+0000 7fde73bfa740 10 client.18681 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:41:45.571 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.548+0000 7fde73bfa740 10 client.18681 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:41:45.571 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.548+0000 7fde73bfa740 20 client.18681 populate_metadata read hostname 'smithi005' 2024-08-31T05:41:45.571 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.549+0000 7fde73bfa740 1 --2- 172.21.15.5:0/2578786772 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x564a207dcd80 0x564a20bdf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:45.571 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.549+0000 7fde73bfa740 4 client.18681 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:41:45.571 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.549+0000 7fde73bfa740 1 -- 172.21.15.5:0/2578786772 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564a20b38f50 con 0x564a207dcd80 2024-08-31T05:41:45.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.549+0000 7fde65d9b640 1 --2- 172.21.15.5:0/2578786772 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x564a207dcd80 0x564a20bdf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:45.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.549+0000 7fde65d9b640 1 --2- 172.21.15.5:0/2578786772 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x564a207dcd80 0x564a20bdf7d0 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fdef9ad603821a78 server_cookie=94926502dc041fcf in_seq=0 out_seq=0 2024-08-31T05:41:45.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.549+0000 7fde4dffb640 10 client.18681 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:41:45.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.550+0000 7fde4dffb640 1 -- 172.21.15.5:0/2578786772 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564a20b38f50 con 0x564a207dcd80 2024-08-31T05:41:45.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.550+0000 7fde4dffb640 10 client.18681 handle_command_reply: tid=0 2024-08-31T05:41:45.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.550+0000 7fde73bfa740 1 client.18681 shutdown 2024-08-31T05:41:45.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.550+0000 7fde73bfa740 1 -- 172.21.15.5:0/2578786772 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564a207f52f0 msgr2=0x564a20bcd8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:45.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.550+0000 7fde73bfa740 1 --2- 172.21.15.5:0/2578786772 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564a207f52f0 0x564a20bcd8b0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fde60032f30 tx=0x7fde60005050 comp rx=0 tx=0).stop 2024-08-31T05:41:45.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.550+0000 7fde73bfa740 1 -- 172.21.15.5:0/2578786772 shutdown_connections 2024-08-31T05:41:45.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.550+0000 7fde73bfa740 1 --2- 172.21.15.5:0/2578786772 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x564a207dcd80 0x564a20bdf7d0 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:45.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.550+0000 7fde73bfa740 1 --2- 172.21.15.5:0/2578786772 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a2081e1b0 0x564a20bd9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:45.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.550+0000 7fde4dffb640 0 client.18681 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:41:45.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.550+0000 7fde73bfa740 1 --2- 172.21.15.5:0/2578786772 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564a207fd4d0 0x564a20bcddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:45.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.550+0000 7fde73bfa740 1 --2- 172.21.15.5:0/2578786772 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564a207f52f0 0x564a20bcd8b0 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:45.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.550+0000 7fde73bfa740 1 -- 172.21.15.5:0/2578786772 >> 172.21.15.5:0/2578786772 conn(0x564a20812300 msgr2=0x564a20bc2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:45.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.550+0000 7fde73bfa740 1 -- 172.21.15.5:0/2578786772 shutdown_connections 2024-08-31T05:41:45.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.550+0000 7fde73bfa740 1 -- 172.21.15.5:0/2578786772 wait complete. 2024-08-31T05:41:45.574 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.550+0000 7fde73bfa740 20 client.18681 trim_cache size 0 max 16384 2024-08-31T05:41:45.576 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.572+0000 7fde73bfa740 1 Processor -- start 2024-08-31T05:41:45.577 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.572+0000 7fde73bfa740 1 -- start start 2024-08-31T05:41:45.577 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.573+0000 7fde73bfa740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564a207f52f0 0x564a20bd9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:45.577 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.573+0000 7fde73bfa740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a207fd4d0 0x564a20bcf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:45.577 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.573+0000 7fde73bfa740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564a2081e1b0 0x564a20bca870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:45.577 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.573+0000 7fde73bfa740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fde681b0c20 con 0x564a207f52f0 2024-08-31T05:41:45.577 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.573+0000 7fde6659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564a207f52f0 0x564a20bd9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:45.577 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.573+0000 7fde73bfa740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fde681b2760 con 0x564a207fd4d0 2024-08-31T05:41:45.578 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.573+0000 7fde73bfa740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fde681b12f0 con 0x564a2081e1b0 2024-08-31T05:41:45.578 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.573+0000 7fde6659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564a207f52f0 0x564a20bd9d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44202/0 (socket says 172.21.15.5:44202) 2024-08-31T05:41:45.578 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.573+0000 7fde6659c640 1 -- 172.21.15.5:0/372151337 learned_addr learned my addr 172.21.15.5:0/372151337 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:45.578 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.573+0000 7fde65d9b640 1 --2- 172.21.15.5:0/372151337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a207fd4d0 0x564a20bcf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:45.578 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.573+0000 7fde66d9d640 1 --2- 172.21.15.5:0/372151337 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564a2081e1b0 0x564a20bca870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:45.578 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.574+0000 7fde6659c640 1 -- 172.21.15.5:0/372151337 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564a2081e1b0 msgr2=0x564a20bca870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:45.578 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.574+0000 7fde6659c640 1 --2- 172.21.15.5:0/372151337 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564a2081e1b0 0x564a20bca870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:45.578 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.574+0000 7fde6659c640 1 -- 172.21.15.5:0/372151337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a207fd4d0 msgr2=0x564a20bcf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:45.579 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.574+0000 7fde6659c640 1 --2- 172.21.15.5:0/372151337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a207fd4d0 0x564a20bcf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:45.579 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.574+0000 7fde6659c640 1 -- 172.21.15.5:0/372151337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a20bc3fe0 con 0x564a207f52f0 2024-08-31T05:41:45.579 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.574+0000 7fde6659c640 1 --2- 172.21.15.5:0/372151337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564a207f52f0 0x564a20bd9d30 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fde60009900 tx=0x7fde6002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53ac589c612b0f2a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:45.579 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.575+0000 7fde4ffff640 1 -- 172.21.15.5:0/372151337 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde60035070 con 0x564a207f52f0 2024-08-31T05:41:45.579 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.575+0000 7fde4ffff640 1 -- 172.21.15.5:0/372151337 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde60004b70 con 0x564a207f52f0 2024-08-31T05:41:45.579 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.575+0000 7fde4ffff640 1 -- 172.21.15.5:0/372151337 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde60003c40 con 0x564a207f52f0 2024-08-31T05:41:45.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.576+0000 7fde73bfa740 1 -- 172.21.15.5:0/372151337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564a207f52f0 msgr2=0x564a20bd9d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:45.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.576+0000 7fde73bfa740 1 --2- 172.21.15.5:0/372151337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564a207f52f0 0x564a20bd9d30 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fde60009900 tx=0x7fde6002a410 comp rx=0 tx=0).stop 2024-08-31T05:41:45.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.577+0000 7fde73bfa740 1 -- 172.21.15.5:0/372151337 shutdown_connections 2024-08-31T05:41:45.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.577+0000 7fde73bfa740 1 --2- 172.21.15.5:0/372151337 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564a2081e1b0 0x564a20bca870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:45.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.578+0000 7fde73bfa740 1 --2- 172.21.15.5:0/372151337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a207fd4d0 0x564a20bcf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:45.581 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.578+0000 7fde73bfa740 1 --2- 172.21.15.5:0/372151337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564a207f52f0 0x564a20bd9d30 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:45.582 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.578+0000 7fde73bfa740 1 -- 172.21.15.5:0/372151337 >> 172.21.15.5:0/372151337 conn(0x564a20812300 msgr2=0x564a20bd8610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:45.584 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.579+0000 7fde73bfa740 1 -- 172.21.15.5:0/372151337 shutdown_connections 2024-08-31T05:41:45.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.580+0000 7fde73bfa740 1 -- 172.21.15.5:0/372151337 wait complete. 2024-08-31T05:41:45.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.581+0000 7fde73bfa740 1 -- start start 2024-08-31T05:41:45.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.581+0000 7fde73bfa740 1 Processor -- start 2024-08-31T05:41:45.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.581+0000 7fde73bfa740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564a207f52f0 0x564a20bd3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:45.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.581+0000 7fde73bfa740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a207fd4d0 0x564a20bd3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:45.585 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.582+0000 7fde73bfa740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564a2081e1b0 0x564a20c49770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:45.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.582+0000 7fde73bfa740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fde681b2090 con 0x564a207f52f0 2024-08-31T05:41:45.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.582+0000 7fde73bfa740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fde681b19c0 con 0x564a207fd4d0 2024-08-31T05:41:45.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.582+0000 7fde73bfa740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fde681aec20 con 0x564a2081e1b0 2024-08-31T05:41:45.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.582+0000 7fde73bfa740 10 client.0 _ll_register_callbacks cb 0x7fde500e95f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:41:45.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.582+0000 7fde66d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564a2081e1b0 0x564a20c49770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:45.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.582+0000 7fde66d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564a2081e1b0 0x564a20c49770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:55708/0 (socket says 172.21.15.5:55708) 2024-08-31T05:41:45.586 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.582+0000 7fde66d9d640 1 -- 172.21.15.5:0/2407695921 learned_addr learned my addr 172.21.15.5:0/2407695921 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:45.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.582+0000 7fde65d9b640 1 --2- 172.21.15.5:0/2407695921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a207fd4d0 0x564a20bd3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:45.590 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.583+0000 7fde65d9b640 1 -- 172.21.15.5:0/2407695921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564a2081e1b0 msgr2=0x564a20c49770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:45.590 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.583+0000 7fde65d9b640 1 --2- 172.21.15.5:0/2407695921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564a2081e1b0 0x564a20c49770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:45.590 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.583+0000 7fde65d9b640 1 -- 172.21.15.5:0/2407695921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564a207f52f0 msgr2=0x564a20bd3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:45.590 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.583+0000 7fde65d9b640 1 --2- 172.21.15.5:0/2407695921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564a207f52f0 0x564a20bd3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:45.590 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.583+0000 7fde65d9b640 1 -- 172.21.15.5:0/2407695921 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a20c49e10 con 0x564a207fd4d0 2024-08-31T05:41:45.590 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.583+0000 7fde65d9b640 1 --2- 172.21.15.5:0/2407695921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a207fd4d0 0x564a20bd3730 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fde500e2f40 tx=0x7fde500e80e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3df5d383b44c7303 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:45.591 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.585+0000 7fde4dffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:41:45.591 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.585+0000 7fde4dffb640 1 -- 172.21.15.5:0/2407695921 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde50010720 con 0x564a207fd4d0 2024-08-31T05:41:45.591 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.585+0000 7fde4dffb640 1 -- 172.21.15.5:0/2407695921 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9511+0+0 (secure 0 0 0) 0x7fde500a8220 con 0x564a207fd4d0 2024-08-31T05:41:45.591 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.585+0000 7fde73bfa740 1 -- 172.21.15.5:0/2407695921 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde60004b70 con 0x564a207fd4d0 2024-08-31T05:41:45.591 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.585+0000 7fde4dffb640 1 -- 172.21.15.5:0/2407695921 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fde500abaa0 con 0x564a207fd4d0 2024-08-31T05:41:45.591 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.585+0000 7fde73bfa740 10 client.28247 fetch_fsmap learned FSMap version 34 2024-08-31T05:41:45.591 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.585+0000 7fde73bfa740 1 -- 172.21.15.5:0/2407695921 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x564a20c52390 con 0x564a207fd4d0 2024-08-31T05:41:45.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.586+0000 7fde4dffb640 1 -- 172.21.15.5:0/2407695921 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde60004b70 con 0x564a207fd4d0 2024-08-31T05:41:45.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.586+0000 7fde4dffb640 1 -- 172.21.15.5:0/2407695921 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fde500b0020 con 0x564a207fd4d0 2024-08-31T05:41:45.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.586+0000 7fde73bfa740 10 client.28247 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:41:45.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.586+0000 7fde73bfa740 10 client.28247 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:41:45.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.586+0000 7fde73bfa740 20 client.28247 populate_metadata read hostname 'smithi005' 2024-08-31T05:41:45.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.586+0000 7fde73bfa740 1 --2- 172.21.15.5:0/2407695921 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x564a207b21c0 0x564a20c54ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:45.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.586+0000 7fde73bfa740 4 client.28247 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:41:45.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.586+0000 7fde73bfa740 1 -- 172.21.15.5:0/2407695921 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564a20b349f0 con 0x564a207b21c0 2024-08-31T05:41:45.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.587+0000 7fde6659c640 1 --2- 172.21.15.5:0/2407695921 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x564a207b21c0 0x564a20c54ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:45.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.588+0000 7fde4dffb640 10 client.28247 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:41:45.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.588+0000 7fde6659c640 1 --2- 172.21.15.5:0/2407695921 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x564a207b21c0 0x564a20c54ba0 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41287033871c12d2 server_cookie=f7f4ed7c82572bf7 in_seq=0 out_seq=0 2024-08-31T05:41:45.612 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T05:41:45.612 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T05:41:45.615 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.612+0000 7fde4dffb640 1 -- 172.21.15.5:0/2407695921 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564a20b349f0 con 0x564a207b21c0 2024-08-31T05:41:45.615 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.612+0000 7fde4dffb640 10 client.28247 handle_command_reply: tid=0 2024-08-31T05:41:45.615 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.612+0000 7fde73bfa740 1 client.28247 shutdown 2024-08-31T05:41:45.615 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.613+0000 7fde73bfa740 1 -- 172.21.15.5:0/2407695921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a207fd4d0 msgr2=0x564a20bd3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:45.616 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.613+0000 7fde73bfa740 1 --2- 172.21.15.5:0/2407695921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a207fd4d0 0x564a20bd3730 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fde500e2f40 tx=0x7fde500e80e0 comp rx=0 tx=0).stop 2024-08-31T05:41:45.617 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.614+0000 7fde73bfa740 1 -- 172.21.15.5:0/2407695921 shutdown_connections 2024-08-31T05:41:45.617 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.614+0000 7fde73bfa740 1 --2- 172.21.15.5:0/2407695921 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x564a207b21c0 0x564a20c54ba0 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:45.618 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.614+0000 7fde73bfa740 1 --2- 172.21.15.5:0/2407695921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564a2081e1b0 0x564a20c49770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:45.618 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.614+0000 7fde73bfa740 1 --2- 172.21.15.5:0/2407695921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564a207fd4d0 0x564a20bd3730 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:45.618 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.614+0000 7fde73bfa740 1 --2- 172.21.15.5:0/2407695921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564a207f52f0 0x564a20bd3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:45.618 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.614+0000 7fde4dffb640 0 client.28247 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:41:45.618 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.614+0000 7fde73bfa740 1 -- 172.21.15.5:0/2407695921 >> 172.21.15.5:0/2407695921 conn(0x564a20812300 msgr2=0x564a20bd8610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:45.618 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.615+0000 7fde73bfa740 1 -- 172.21.15.5:0/2407695921 shutdown_connections 2024-08-31T05:41:45.619 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.616+0000 7fde73bfa740 1 -- 172.21.15.5:0/2407695921 wait complete. 2024-08-31T05:41:45.619 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.616+0000 7fde73bfa740 20 client.28247 trim_cache size 0 max 16384 2024-08-31T05:41:45.619 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:41:45.619 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:41:45.619 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:41:45.620 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:41:45.620 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.617+0000 7fde6cc8d640 1 -- 172.21.15.5:0/506935883 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fde540b4ca0 msgr2=0x7fde540b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:45.620 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.617+0000 7fde6cc8d640 1 --2- 172.21.15.5:0/506935883 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fde540b4ca0 0x7fde540b71b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fde58011690 tx=0x7fde58009500 comp rx=0 tx=0).stop 2024-08-31T05:41:45.620 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.617+0000 7fde6cc8d640 1 -- 172.21.15.5:0/506935883 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde68105000 msgr2=0x7fde6819a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:45.620 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.617+0000 7fde6cc8d640 1 --2- 172.21.15.5:0/506935883 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde68105000 0x7fde6819a7a0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fde5000e9f0 tx=0x7fde5000eeb0 comp rx=0 tx=0).stop 2024-08-31T05:41:45.620 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.617+0000 7fde6cc8d640 1 -- 172.21.15.5:0/506935883 shutdown_connections 2024-08-31T05:41:45.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.617+0000 7fde6cc8d640 1 --2- 172.21.15.5:0/506935883 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fde540b4ca0 0x7fde540b71b0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:45.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.617+0000 7fde6cc8d640 1 --2- 172.21.15.5:0/506935883 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde6810db10 0x7fde6819fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:45.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.617+0000 7fde6cc8d640 1 --2- 172.21.15.5:0/506935883 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde68105000 0x7fde6819a7a0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:45.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.617+0000 7fde6cc8d640 1 --2- 172.21.15.5:0/506935883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fde681046b0 0x7fde6819a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:45.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.617+0000 7fde6cc8d640 1 -- 172.21.15.5:0/506935883 >> 172.21.15.5:0/506935883 conn(0x7fde680fe160 msgr2=0x7fde68106510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:45.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.618+0000 7fde6cc8d640 1 -- 172.21.15.5:0/506935883 shutdown_connections 2024-08-31T05:41:45.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:45.618+0000 7fde6cc8d640 1 -- 172.21.15.5:0/506935883 wait complete. 2024-08-31T05:41:45.915 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:41:45.939 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1326062 10.82 MB/sec execute 513 sec latency 32.879 ms 2024-08-31T05:41:46.216 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:41:45 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:41:46.216 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:41:45 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:41:46.216 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:41:45 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:41:46.216 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:41:45 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:41:46.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:41:45 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:41:46.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:41:45 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:41:46.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:41:45 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:41:46.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:41:45 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:41:46.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:41:45 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:41:46.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:41:45 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:41:46.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:41:45 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:41:46.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:41:45 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:41:46.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.434+0000 7f277f96e640 1 -- 172.21.15.5:0/165423718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2778075550 msgr2=0x7f2778075960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:46.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.434+0000 7f277f96e640 1 --2- 172.21.15.5:0/165423718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2778075550 0x7f2778075960 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f2774009900 tx=0x7f277402a410 comp rx=0 tx=0).stop 2024-08-31T05:41:46.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.434+0000 7f277f96e640 1 -- 172.21.15.5:0/165423718 shutdown_connections 2024-08-31T05:41:46.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.434+0000 7f277f96e640 1 --2- 172.21.15.5:0/165423718 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f277810fe80 0x7f27781122c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:46.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.434+0000 7f277f96e640 1 --2- 172.21.15.5:0/165423718 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2778075ea0 0x7f277810f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:46.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.434+0000 7f277f96e640 1 --2- 172.21.15.5:0/165423718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2778075550 0x7f2778075960 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:46.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.434+0000 7f277f96e640 1 -- 172.21.15.5:0/165423718 >> 172.21.15.5:0/165423718 conn(0x7f27780ff3b0 msgr2=0x7f2778101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:46.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.434+0000 7f277f96e640 1 -- 172.21.15.5:0/165423718 shutdown_connections 2024-08-31T05:41:46.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.434+0000 7f277f96e640 1 -- 172.21.15.5:0/165423718 wait complete. 2024-08-31T05:41:46.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.435+0000 7f277f96e640 1 Processor -- start 2024-08-31T05:41:46.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.435+0000 7f277f96e640 1 -- start start 2024-08-31T05:41:46.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.435+0000 7f277f96e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2778075550 0x7f277819c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:46.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.435+0000 7f277f96e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2778075ea0 0x7f277819c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:46.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.435+0000 7f277f96e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f277810fe80 0x7f27781a1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:46.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.435+0000 7f277f96e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2778115a30 con 0x7f277810fe80 2024-08-31T05:41:46.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.435+0000 7f277f96e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f27781158b0 con 0x7f2778075ea0 2024-08-31T05:41:46.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.435+0000 7f277f96e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2778115bb0 con 0x7f2778075550 2024-08-31T05:41:46.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.435+0000 7f277cf09640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2778075ea0 0x7f277819c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:46.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.436+0000 7f277df0b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f277810fe80 0x7f27781a1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:46.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.435+0000 7f277d70a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2778075550 0x7f277819c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:46.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.436+0000 7f277cf09640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2778075ea0 0x7f277819c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:52628/0 (socket says 172.21.15.5:52628) 2024-08-31T05:41:46.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.436+0000 7f277cf09640 1 -- 172.21.15.5:0/2538405347 learned_addr learned my addr 172.21.15.5:0/2538405347 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:46.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.436+0000 7f277df0b640 1 -- 172.21.15.5:0/2538405347 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2778075550 msgr2=0x7f277819c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:46.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.436+0000 7f277df0b640 1 --2- 172.21.15.5:0/2538405347 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2778075550 0x7f277819c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:46.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.436+0000 7f277df0b640 1 -- 172.21.15.5:0/2538405347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2778075ea0 msgr2=0x7f277819c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:46.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.436+0000 7f277df0b640 1 --2- 172.21.15.5:0/2538405347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2778075ea0 0x7f277819c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:46.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.436+0000 7f277df0b640 1 -- 172.21.15.5:0/2538405347 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27781a2310 con 0x7f277810fe80 2024-08-31T05:41:46.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.436+0000 7f277d70a640 1 --2- 172.21.15.5:0/2538405347 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2778075550 0x7f277819c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:41:46.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.436+0000 7f277cf09640 1 --2- 172.21.15.5:0/2538405347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2778075ea0 0x7f277819c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:41:46.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.436+0000 7f277df0b640 1 --2- 172.21.15.5:0/2538405347 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f277810fe80 0x7f27781a1be0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f2770009fd0 tx=0x7f277000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:46.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.436+0000 7f276e7fc640 1 -- 172.21.15.5:0/2538405347 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277000ce20 con 0x7f277810fe80 2024-08-31T05:41:46.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.436+0000 7f276e7fc640 1 -- 172.21.15.5:0/2538405347 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2770005020 con 0x7f277810fe80 2024-08-31T05:41:46.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.437+0000 7f277f96e640 1 -- 172.21.15.5:0/2538405347 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27781a2600 con 0x7f277810fe80 2024-08-31T05:41:46.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.437+0000 7f276e7fc640 1 -- 172.21.15.5:0/2538405347 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2770010690 con 0x7f277810fe80 2024-08-31T05:41:46.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.437+0000 7f277f96e640 1 -- 172.21.15.5:0/2538405347 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27781a8d60 con 0x7f277810fe80 2024-08-31T05:41:46.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.438+0000 7f277f96e640 1 -- 172.21.15.5:0/2538405347 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2778076a60 con 0x7f277810fe80 2024-08-31T05:41:46.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.439+0000 7f276e7fc640 1 -- 172.21.15.5:0/2538405347 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f27700054d0 con 0x7f277810fe80 2024-08-31T05:41:46.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.440+0000 7f276e7fc640 1 --2- 172.21.15.5:0/2538405347 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f27640b4d20 0x7f27640b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:46.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.440+0000 7f277d70a640 1 --2- 172.21.15.5:0/2538405347 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f27640b4d20 0x7f27640b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:46.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.440+0000 7f276e7fc640 1 -- 172.21.15.5:0/2538405347 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9511+0+0 (secure 0 0 0) 0x7f27700e6030 con 0x7f277810fe80 2024-08-31T05:41:46.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.441+0000 7f277d70a640 1 --2- 172.21.15.5:0/2538405347 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f27640b4d20 0x7f27640b7230 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f2774031440 tx=0x7f2774032ed0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:46.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.445+0000 7f276e7fc640 1 -- 172.21.15.5:0/2538405347 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f27700ac9e0 con 0x7f277810fe80 2024-08-31T05:41:46.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.683+0000 7f277f96e640 1 -- 172.21.15.5:0/2538405347 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2778075960 con 0x7f277810fe80 2024-08-31T05:41:46.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.684+0000 7f276e7fc640 1 -- 172.21.15.5:0/2538405347 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11941 (secure 0 0 0) 0x7f27700ac2e0 con 0x7f277810fe80 2024-08-31T05:41:46.686 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:41:46.686 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":34,"btime":"2024-08-31T05:33:43:289944+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14739,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2024812199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2024812199},{"type":"v1","addr":"172.21.15.5:6835","nonce":2024812199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3629023702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3629023702},{"type":"v1","addr":"172.21.15.5:6837","nonce":3629023702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T05:27:31.929153+0000","modified":"2024-08-31T05:33:42.378207+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24652,"mds_1":24638,"mds_2":24631,"mds_3":24625,"mds_4":24602},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6839/2412701258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":2412701258},{"type":"v1","addr":"172.21.15.5:6839","nonce":2412701258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14820":{"gid":14820,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6841/747057838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":747057838},{"type":"v1","addr":"172.21.15.5:6841","nonce":747057838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6833/1153378982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1153378982},{"type":"v1","addr":"172.21.15.50:6833","nonce":1153378982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6833/364083443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":364083443},{"type":"v1","addr":"172.21.15.70:6833","nonce":364083443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24587":{"gid":24587,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/2346896794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2346896794},{"type":"v1","addr":"172.21.15.50:6835","nonce":2346896794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24602":{"gid":24602,"name":"h","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.50:6837/428759669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":428759669},{"type":"v1","addr":"172.21.15.50:6837","nonce":428759669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.70:6835/2061504114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2061504114},{"type":"v1","addr":"172.21.15.70:6835","nonce":2061504114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.70:6837/2780036414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2780036414},{"type":"v1","addr":"172.21.15.70:6837","nonce":2780036414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.50:6839/98200944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":98200944},{"type":"v1","addr":"172.21.15.50:6839","nonce":98200944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24652":{"gid":24652,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.70:6839/2756569250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":2756569250},{"type":"v1","addr":"172.21.15.70:6839","nonce":2756569250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24652,"qdb_cluster":[24652,24631,24638,24625,24602]},"id":1}]} 2024-08-31T05:41:46.687 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 34 2024-08-31T05:41:46.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.687+0000 7f277f96e640 1 -- 172.21.15.5:0/2538405347 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f27640b4d20 msgr2=0x7f27640b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:46.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.687+0000 7f277f96e640 1 --2- 172.21.15.5:0/2538405347 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f27640b4d20 0x7f27640b7230 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f2774031440 tx=0x7f2774032ed0 comp rx=0 tx=0).stop 2024-08-31T05:41:46.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.687+0000 7f277f96e640 1 -- 172.21.15.5:0/2538405347 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f277810fe80 msgr2=0x7f27781a1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:46.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.687+0000 7f277f96e640 1 --2- 172.21.15.5:0/2538405347 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f277810fe80 0x7f27781a1be0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f2770009fd0 tx=0x7f277000ef10 comp rx=0 tx=0).stop 2024-08-31T05:41:46.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.687+0000 7f277f96e640 1 -- 172.21.15.5:0/2538405347 shutdown_connections 2024-08-31T05:41:46.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.687+0000 7f277f96e640 1 --2- 172.21.15.5:0/2538405347 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f27640b4d20 0x7f27640b7230 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:46.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.687+0000 7f277f96e640 1 --2- 172.21.15.5:0/2538405347 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f277810fe80 0x7f27781a1be0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:46.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.687+0000 7f277f96e640 1 --2- 172.21.15.5:0/2538405347 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2778075ea0 0x7f277819c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:46.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.687+0000 7f277f96e640 1 --2- 172.21.15.5:0/2538405347 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2778075550 0x7f277819c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:46.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.687+0000 7f277f96e640 1 -- 172.21.15.5:0/2538405347 >> 172.21.15.5:0/2538405347 conn(0x7f27780ff3b0 msgr2=0x7f27781099b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:46.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.687+0000 7f277f96e640 1 -- 172.21.15.5:0/2538405347 shutdown_connections 2024-08-31T05:41:46.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:46.687+0000 7f277f96e640 1 -- 172.21.15.5:0/2538405347 wait complete. 2024-08-31T05:41:46.939 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1328287 10.82 MB/sec execute 514 sec latency 77.894 ms 2024-08-31T05:41:47.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:41:46 smithi005 ceph-mon[18602]: pgmap v709: 129 pgs: 129 active+clean; 578 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.3 MiB/s wr, 249 op/s 2024-08-31T05:41:47.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:41:46 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/2538405347' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:41:47.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:41:46 smithi070 ceph-mon[22316]: pgmap v709: 129 pgs: 129 active+clean; 578 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.3 MiB/s wr, 249 op/s 2024-08-31T05:41:47.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:41:46 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/2538405347' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:41:47.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:41:46 smithi050 ceph-mon[22146]: pgmap v709: 129 pgs: 129 active+clean; 578 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.3 MiB/s wr, 249 op/s 2024-08-31T05:41:47.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:41:46 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/2538405347' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:41:47.939 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1329788 10.81 MB/sec execute 515 sec latency 18.096 ms 2024-08-31T05:41:47.993 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-31T05:41:48.292 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:41:48.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.807+0000 7f1404755640 1 -- 172.21.15.5:0/3021971088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13fc103900 msgr2=0x7f13fc103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:48.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.807+0000 7f1404755640 1 --2- 172.21.15.5:0/3021971088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13fc103900 0x7f13fc103d10 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f13f8009900 tx=0x7f13f802a410 comp rx=0 tx=0).stop 2024-08-31T05:41:48.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.807+0000 7f1404755640 1 -- 172.21.15.5:0/3021971088 shutdown_connections 2024-08-31T05:41:48.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.807+0000 7f1404755640 1 --2- 172.21.15.5:0/3021971088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13fc109b90 0x7f13fc1103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:48.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.807+0000 7f1404755640 1 --2- 172.21.15.5:0/3021971088 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13fc109240 0x7f13fc109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:48.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.807+0000 7f1404755640 1 --2- 172.21.15.5:0/3021971088 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13fc103900 0x7f13fc103d10 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:48.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.807+0000 7f1404755640 1 -- 172.21.15.5:0/3021971088 >> 172.21.15.5:0/3021971088 conn(0x7f13fc07b5f0 msgr2=0x7f13fc07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:48.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.807+0000 7f1404755640 1 -- 172.21.15.5:0/3021971088 shutdown_connections 2024-08-31T05:41:48.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.807+0000 7f1404755640 1 -- 172.21.15.5:0/3021971088 wait complete. 2024-08-31T05:41:48.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.807+0000 7f1404755640 1 Processor -- start 2024-08-31T05:41:48.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.807+0000 7f1404755640 1 -- start start 2024-08-31T05:41:48.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.808+0000 7f1404755640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13fc103900 0x7f13fc19a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:48.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.808+0000 7f1404755640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13fc109240 0x7f13fc19a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:48.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.808+0000 7f1404755640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13fc109b90 0x7f13fc19fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:48.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.808+0000 7f1404755640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f13fc113850 con 0x7f13fc109b90 2024-08-31T05:41:48.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.808+0000 7f1404755640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f13fc1136d0 con 0x7f13fc109240 2024-08-31T05:41:48.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.808+0000 7f1404755640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f13fc1139d0 con 0x7f13fc103900 2024-08-31T05:41:48.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.808+0000 7f1402cf2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13fc109b90 0x7f13fc19fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:48.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.808+0000 7f1402cf2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13fc109b90 0x7f13fc19fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44256/0 (socket says 172.21.15.5:44256) 2024-08-31T05:41:48.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.808+0000 7f1402cf2640 1 -- 172.21.15.5:0/120821498 learned_addr learned my addr 172.21.15.5:0/120821498 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:48.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.808+0000 7f14024f1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13fc103900 0x7f13fc19a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:48.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.808+0000 7f1401cf0640 1 --2- 172.21.15.5:0/120821498 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13fc109240 0x7f13fc19a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:48.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.808+0000 7f1402cf2640 1 -- 172.21.15.5:0/120821498 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13fc103900 msgr2=0x7f13fc19a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:48.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.808+0000 7f1402cf2640 1 --2- 172.21.15.5:0/120821498 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13fc103900 0x7f13fc19a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:48.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.808+0000 7f1402cf2640 1 -- 172.21.15.5:0/120821498 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13fc109240 msgr2=0x7f13fc19a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:48.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.808+0000 7f1402cf2640 1 --2- 172.21.15.5:0/120821498 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13fc109240 0x7f13fc19a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:48.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.808+0000 7f1402cf2640 1 -- 172.21.15.5:0/120821498 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13fc1a0190 con 0x7f13fc109b90 2024-08-31T05:41:48.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.808+0000 7f1402cf2640 1 --2- 172.21.15.5:0/120821498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13fc109b90 0x7f13fc19fa60 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f13f400eb10 tx=0x7f13f400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:48.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.809+0000 7f13f37fe640 1 -- 172.21.15.5:0/120821498 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f4004b20 con 0x7f13fc109b90 2024-08-31T05:41:48.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.809+0000 7f1404755640 1 -- 172.21.15.5:0/120821498 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13fc1a0480 con 0x7f13fc109b90 2024-08-31T05:41:48.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.809+0000 7f13f37fe640 1 -- 172.21.15.5:0/120821498 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13f4004cc0 con 0x7f13fc109b90 2024-08-31T05:41:48.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.809+0000 7f13f37fe640 1 -- 172.21.15.5:0/120821498 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f4010670 con 0x7f13fc109b90 2024-08-31T05:41:48.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.809+0000 7f1404755640 1 -- 172.21.15.5:0/120821498 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13fc1a6be0 con 0x7f13fc109b90 2024-08-31T05:41:48.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.812+0000 7f140acca740 1 Processor -- start 2024-08-31T05:41:48.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.812+0000 7f13f37fe640 1 -- 172.21.15.5:0/120821498 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f13f4005020 con 0x7f13fc109b90 2024-08-31T05:41:48.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.812+0000 7f140acca740 1 -- start start 2024-08-31T05:41:48.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.813+0000 7f140acca740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e5e219070 0x563e5e5be350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:48.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.813+0000 7f140acca740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e5e1f01b0 0x563e5e5be890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:48.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.813+0000 7f140acca740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e5e1f8390 0x563e5e5bedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:48.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.813+0000 7f140acca740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x563e5e535680 con 0x563e5e219070 2024-08-31T05:41:48.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.813+0000 7f140acca740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x563e5e524c10 con 0x563e5e1f01b0 2024-08-31T05:41:48.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.813+0000 7f140acca740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563e5e528bc0 con 0x563e5e1f8390 2024-08-31T05:41:48.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.813+0000 7f1401cf0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e5e219070 0x563e5e5be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:48.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.813+0000 7f14024f1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e5e1f01b0 0x563e5e5be890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:48.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.813+0000 7f14024f1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e5e1f01b0 0x563e5e5be890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:52652/0 (socket says 172.21.15.5:52652) 2024-08-31T05:41:48.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.813+0000 7f14024f1640 1 -- 172.21.15.5:0/1882130828 learned_addr learned my addr 172.21.15.5:0/1882130828 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:48.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.813+0000 7f1401cf0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e5e219070 0x563e5e5be350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44262/0 (socket says 172.21.15.5:44262) 2024-08-31T05:41:48.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.813+0000 7f1401cf0640 1 --2- 172.21.15.5:0/1882130828 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e5e1f8390 0x563e5e5bedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:48.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.813+0000 7f14024f1640 1 -- 172.21.15.5:0/1882130828 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e5e1f8390 msgr2=0x563e5e5bedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:48.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.813+0000 7f14024f1640 1 --2- 172.21.15.5:0/1882130828 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e5e1f8390 0x563e5e5bedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:48.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.813+0000 7f14024f1640 1 -- 172.21.15.5:0/1882130828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e5e219070 msgr2=0x563e5e5be350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:48.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.813+0000 7f14024f1640 1 --2- 172.21.15.5:0/1882130828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e5e219070 0x563e5e5be350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:48.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.813+0000 7f14024f1640 1 -- 172.21.15.5:0/1882130828 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e5e284650 con 0x563e5e1f01b0 2024-08-31T05:41:48.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.813+0000 7f13f37fe640 1 --2- 172.21.15.5:0/120821498 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f13e80b4ca0 0x7f13e80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:48.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.813+0000 7f14024f1640 1 --2- 172.21.15.5:0/1882130828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e5e1f01b0 0x563e5e5be890 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f13f8009900 tx=0x7f13f8032b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=716e2b5c2a0b1e3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:48.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.813+0000 7f1401cf0640 1 --2- 172.21.15.5:0/120821498 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f13e80b4ca0 0x7f13e80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:48.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.813+0000 7f13f37fe640 1 -- 172.21.15.5:0/120821498 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9511+0+0 (secure 0 0 0) 0x7f13f40e5fc0 con 0x7f13fc109b90 2024-08-31T05:41:48.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.814+0000 7f13f0ff9640 1 -- 172.21.15.5:0/1882130828 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f8040070 con 0x563e5e1f01b0 2024-08-31T05:41:48.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.814+0000 7f13f0ff9640 1 -- 172.21.15.5:0/1882130828 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13f8004030 con 0x563e5e1f01b0 2024-08-31T05:41:48.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.814+0000 7f13f0ff9640 1 -- 172.21.15.5:0/1882130828 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f8035040 con 0x563e5e1f01b0 2024-08-31T05:41:48.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.814+0000 7f140acca740 1 -- 172.21.15.5:0/1882130828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e5e1f01b0 msgr2=0x563e5e5be890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:48.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.815+0000 7f140acca740 1 --2- 172.21.15.5:0/1882130828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e5e1f01b0 0x563e5e5be890 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f13f8009900 tx=0x7f13f8032b90 comp rx=0 tx=0).stop 2024-08-31T05:41:48.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.815+0000 7f1401cf0640 1 --2- 172.21.15.5:0/120821498 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f13e80b4ca0 0x7f13e80b71b0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f13fc1061f0 tx=0x7f13ec015040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:48.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.815+0000 7f140acca740 1 -- 172.21.15.5:0/1882130828 shutdown_connections 2024-08-31T05:41:48.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.815+0000 7f140acca740 1 --2- 172.21.15.5:0/1882130828 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e5e1f8390 0x563e5e5bedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:48.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.815+0000 7f140acca740 1 --2- 172.21.15.5:0/1882130828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e5e1f01b0 0x563e5e5be890 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:48.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.815+0000 7f140acca740 1 --2- 172.21.15.5:0/1882130828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e5e219070 0x563e5e5be350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:48.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.815+0000 7f140acca740 1 -- 172.21.15.5:0/1882130828 >> 172.21.15.5:0/1882130828 conn(0x563e5e20d460 msgr2=0x563e5e5bc240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:48.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.815+0000 7f140acca740 1 -- 172.21.15.5:0/1882130828 shutdown_connections 2024-08-31T05:41:48.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.815+0000 7f140acca740 1 -- 172.21.15.5:0/1882130828 wait complete. 2024-08-31T05:41:48.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.815+0000 7f140acca740 1 -- start start 2024-08-31T05:41:48.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.815+0000 7f140acca740 1 Processor -- start 2024-08-31T05:41:48.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.816+0000 7f140acca740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e5e1f01b0 0x563e5e5c9a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:48.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.816+0000 7f140acca740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e5e1f8390 0x563e5e5c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:48.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.816+0000 7f140acca740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e5e219070 0x563e5e5d5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:48.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.816+0000 7f140acca740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x563e5e387700 con 0x563e5e219070 2024-08-31T05:41:48.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.816+0000 7f140acca740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x563e5e4ab750 con 0x563e5e1f01b0 2024-08-31T05:41:48.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.816+0000 7f140acca740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563e5e5ccad0 con 0x563e5e1f8390 2024-08-31T05:41:48.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.816+0000 7f140acca740 10 client.0 _ll_register_callbacks cb 0x563e5e4dae10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:41:48.859 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:41:48.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.816+0000 7f1401cf0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e5e1f8390 0x563e5e5c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:48.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.816+0000 7f1402cf2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e5e219070 0x563e5e5d5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:48.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.816+0000 7f14024f1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e5e1f01b0 0x563e5e5c9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:48.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.816+0000 7f1401cf0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e5e1f8390 0x563e5e5c9fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:55772/0 (socket says 172.21.15.5:55772) 2024-08-31T05:41:48.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.816+0000 7f1401cf0640 1 -- 172.21.15.5:0/891006887 learned_addr learned my addr 172.21.15.5:0/891006887 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:48.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.816+0000 7f1401cf0640 1 -- 172.21.15.5:0/891006887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e5e1f01b0 msgr2=0x563e5e5c9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:48.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.816+0000 7f1401cf0640 1 --2- 172.21.15.5:0/891006887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e5e1f01b0 0x563e5e5c9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:48.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.816+0000 7f1401cf0640 1 -- 172.21.15.5:0/891006887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e5e219070 msgr2=0x563e5e5d5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:48.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.816+0000 7f1401cf0640 1 --2- 172.21.15.5:0/891006887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e5e219070 0x563e5e5d5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:48.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.816+0000 7f1401cf0640 1 -- 172.21.15.5:0/891006887 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e5e4e4900 con 0x563e5e1f8390 2024-08-31T05:41:48.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.817+0000 7f1401cf0640 1 --2- 172.21.15.5:0/891006887 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e5e1f8390 0x563e5e5c9fd0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f13ec0038a0 tx=0x7f13ec005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6027613f72270415 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:48.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.817+0000 7f13e5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:41:48.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.817+0000 7f13e5ffb640 1 -- 172.21.15.5:0/891006887 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13ec011bc0 con 0x563e5e1f8390 2024-08-31T05:41:48.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.817+0000 7f13e5ffb640 1 -- 172.21.15.5:0/891006887 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9511+0+0 (secure 0 0 0) 0x7f13ec011d60 con 0x563e5e1f8390 2024-08-31T05:41:48.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.817+0000 7f140acca740 1 -- 172.21.15.5:0/891006887 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13f8004030 con 0x563e5e1f8390 2024-08-31T05:41:48.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.817+0000 7f13e5ffb640 1 -- 172.21.15.5:0/891006887 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f13ec003eb0 con 0x563e5e1f8390 2024-08-31T05:41:48.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.817+0000 7f140acca740 10 client.28285 fetch_fsmap learned FSMap version 34 2024-08-31T05:41:48.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.817+0000 7f140acca740 1 -- 172.21.15.5:0/891006887 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x563e5e5d8870 con 0x563e5e1f8390 2024-08-31T05:41:48.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.817+0000 7f13e5ffb640 1 -- 172.21.15.5:0/891006887 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13f8004030 con 0x563e5e1f8390 2024-08-31T05:41:48.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.817+0000 7f13e5ffb640 1 -- 172.21.15.5:0/891006887 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f13ec01d040 con 0x563e5e1f8390 2024-08-31T05:41:48.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.817+0000 7f140acca740 10 client.28285 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:41:48.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.817+0000 7f140acca740 10 client.28285 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-31T05:41:48.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.817+0000 7f140acca740 20 client.28285 populate_metadata read hostname 'smithi005' 2024-08-31T05:41:48.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.817+0000 7f140acca740 1 --2- 172.21.15.5:0/891006887 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x563e5e1d79f0 0x563e5e5dbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:48.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.817+0000 7f140acca740 4 client.28285 mds_command: new command op to 24602 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:41:48.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.817+0000 7f140acca740 1 -- 172.21.15.5:0/891006887 --> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563e5e5375d0 con 0x563e5e1d79f0 2024-08-31T05:41:48.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.818+0000 7f14024f1640 1 --2- 172.21.15.5:0/891006887 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x563e5e1d79f0 0x563e5e5dbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:48.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.818+0000 7f14024f1640 1 --2- 172.21.15.5:0/891006887 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x563e5e1d79f0 0x563e5e5dbd90 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8c4b66612331967d server_cookie=6c27e47e2d763d9b in_seq=0 out_seq=0 2024-08-31T05:41:48.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.818+0000 7f13e5ffb640 10 client.28285 ms_handle_connect on v2:172.21.15.50:6836/428759669 2024-08-31T05:41:48.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.819+0000 7f13e5ffb640 1 -- 172.21.15.5:0/891006887 <== mds.4 v2:172.21.15.50:6836/428759669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563e5e5375d0 con 0x563e5e1d79f0 2024-08-31T05:41:48.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.819+0000 7f13e5ffb640 10 client.28285 handle_command_reply: tid=0 2024-08-31T05:41:48.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.819+0000 7f140acca740 1 client.28285 shutdown 2024-08-31T05:41:48.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.819+0000 7f140acca740 1 -- 172.21.15.5:0/891006887 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e5e1f8390 msgr2=0x563e5e5c9fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:48.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.819+0000 7f140acca740 1 --2- 172.21.15.5:0/891006887 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e5e1f8390 0x563e5e5c9fd0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f13ec0038a0 tx=0x7f13ec005f90 comp rx=0 tx=0).stop 2024-08-31T05:41:48.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.819+0000 7f140acca740 1 -- 172.21.15.5:0/891006887 shutdown_connections 2024-08-31T05:41:48.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.819+0000 7f140acca740 1 --2- 172.21.15.5:0/891006887 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x563e5e1d79f0 0x563e5e5dbd90 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:48.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.819+0000 7f140acca740 1 --2- 172.21.15.5:0/891006887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e5e219070 0x563e5e5d5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:48.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.819+0000 7f13e5ffb640 0 client.28285 ms_handle_reset on v2:172.21.15.50:6836/428759669 2024-08-31T05:41:48.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.819+0000 7f140acca740 1 --2- 172.21.15.5:0/891006887 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e5e1f8390 0x563e5e5c9fd0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:48.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.819+0000 7f140acca740 1 --2- 172.21.15.5:0/891006887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e5e1f01b0 0x563e5e5c9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:48.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.819+0000 7f140acca740 1 -- 172.21.15.5:0/891006887 >> 172.21.15.5:0/891006887 conn(0x563e5e20d460 msgr2=0x563e5e5c1530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:48.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.819+0000 7f140acca740 1 -- 172.21.15.5:0/891006887 shutdown_connections 2024-08-31T05:41:48.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.819+0000 7f140acca740 1 -- 172.21.15.5:0/891006887 wait complete. 2024-08-31T05:41:48.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.819+0000 7f140acca740 20 client.28285 trim_cache size 0 max 16384 2024-08-31T05:41:48.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.833+0000 7f140acca740 1 Processor -- start 2024-08-31T05:41:48.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.833+0000 7f140acca740 1 -- start start 2024-08-31T05:41:48.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.833+0000 7f140acca740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e5e1f01b0 0x563e5e5c1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:48.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.833+0000 7f140acca740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e5e1f8390 0x563e5e5d5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:48.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.833+0000 7f140acca740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e5e219070 0x563e5e5d6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:48.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.833+0000 7f140acca740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f13fc1b0d90 con 0x563e5e219070 2024-08-31T05:41:48.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.833+0000 7f140acca740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f13fc1b28d0 con 0x563e5e1f01b0 2024-08-31T05:41:48.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.833+0000 7f140acca740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f13fc1b1460 con 0x563e5e1f8390 2024-08-31T05:41:48.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.833+0000 7f1402cf2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e5e219070 0x563e5e5d6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:48.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.833+0000 7f1402cf2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e5e219070 0x563e5e5d6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44276/0 (socket says 172.21.15.5:44276) 2024-08-31T05:41:48.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.833+0000 7f1402cf2640 1 -- 172.21.15.5:0/2424897010 learned_addr learned my addr 172.21.15.5:0/2424897010 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:48.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.833+0000 7f14024f1640 1 --2- 172.21.15.5:0/2424897010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e5e1f01b0 0x563e5e5c1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:48.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.833+0000 7f1401cf0640 1 --2- 172.21.15.5:0/2424897010 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e5e1f8390 0x563e5e5d5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:48.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.833+0000 7f1402cf2640 1 -- 172.21.15.5:0/2424897010 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e5e1f8390 msgr2=0x563e5e5d5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:48.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.834+0000 7f1402cf2640 1 --2- 172.21.15.5:0/2424897010 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e5e1f8390 0x563e5e5d5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:48.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.834+0000 7f1402cf2640 1 -- 172.21.15.5:0/2424897010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e5e1f01b0 msgr2=0x563e5e5c1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:48.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.834+0000 7f1402cf2640 1 --2- 172.21.15.5:0/2424897010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e5e1f01b0 0x563e5e5c1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:48.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.834+0000 7f1402cf2640 1 -- 172.21.15.5:0/2424897010 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e5e5c11b0 con 0x563e5e219070 2024-08-31T05:41:48.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.834+0000 7f1402cf2640 1 --2- 172.21.15.5:0/2424897010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e5e219070 0x563e5e5d6200 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f13f40a94e0 tx=0x7f13f400cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8f6ef0a53b64374 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:48.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.834+0000 7f13e7fff640 1 -- 172.21.15.5:0/2424897010 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f40b3e60 con 0x563e5e219070 2024-08-31T05:41:48.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.834+0000 7f13e7fff640 1 -- 172.21.15.5:0/2424897010 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13f40abd80 con 0x563e5e219070 2024-08-31T05:41:48.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.834+0000 7f13e7fff640 1 -- 172.21.15.5:0/2424897010 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f40b5590 con 0x563e5e219070 2024-08-31T05:41:48.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.835+0000 7f140acca740 1 -- 172.21.15.5:0/2424897010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e5e219070 msgr2=0x563e5e5d6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:48.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.835+0000 7f140acca740 1 --2- 172.21.15.5:0/2424897010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e5e219070 0x563e5e5d6200 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f13f40a94e0 tx=0x7f13f400cf70 comp rx=0 tx=0).stop 2024-08-31T05:41:48.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.835+0000 7f140acca740 1 -- 172.21.15.5:0/2424897010 shutdown_connections 2024-08-31T05:41:48.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.835+0000 7f140acca740 1 --2- 172.21.15.5:0/2424897010 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e5e219070 0x563e5e5d6200 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:48.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.835+0000 7f140acca740 1 --2- 172.21.15.5:0/2424897010 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e5e1f8390 0x563e5e5d5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:48.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.835+0000 7f140acca740 1 --2- 172.21.15.5:0/2424897010 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e5e1f01b0 0x563e5e5c1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:48.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.835+0000 7f140acca740 1 -- 172.21.15.5:0/2424897010 >> 172.21.15.5:0/2424897010 conn(0x563e5e20d460 msgr2=0x563e5e5c1450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:48.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.835+0000 7f140acca740 1 -- 172.21.15.5:0/2424897010 shutdown_connections 2024-08-31T05:41:48.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.835+0000 7f140acca740 1 -- 172.21.15.5:0/2424897010 wait complete. 2024-08-31T05:41:48.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.835+0000 7f140acca740 1 -- start start 2024-08-31T05:41:48.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.835+0000 7f140acca740 1 Processor -- start 2024-08-31T05:41:48.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.835+0000 7f140acca740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e5e1f01b0 0x563e5e5ce730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:48.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.835+0000 7f140acca740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e5e1f8390 0x563e5e5cecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:48.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.836+0000 7f140acca740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e5e219070 0x563e5e63f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:48.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.836+0000 7f140acca740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f13fc1b2200 con 0x563e5e1f01b0 2024-08-31T05:41:48.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.836+0000 7f140acca740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f13fc1b1b30 con 0x563e5e1f8390 2024-08-31T05:41:48.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.836+0000 7f140acca740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f13fc1aed90 con 0x563e5e219070 2024-08-31T05:41:48.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.836+0000 7f140acca740 10 client.0 _ll_register_callbacks cb 0x7f13ec009da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:41:48.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.836+0000 7f14024f1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e5e1f01b0 0x563e5e5ce730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:48.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.836+0000 7f1401cf0640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e5e1f8390 0x563e5e5cecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:48.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.836+0000 7f14024f1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e5e1f01b0 0x563e5e5ce730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44284/0 (socket says 172.21.15.5:44284) 2024-08-31T05:41:48.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.836+0000 7f14024f1640 1 -- 172.21.15.5:0/2189600250 learned_addr learned my addr 172.21.15.5:0/2189600250 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:48.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.836+0000 7f1402cf2640 1 --2- 172.21.15.5:0/2189600250 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e5e219070 0x563e5e63f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:48.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.836+0000 7f14024f1640 1 -- 172.21.15.5:0/2189600250 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e5e219070 msgr2=0x563e5e63f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:48.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.836+0000 7f14024f1640 1 --2- 172.21.15.5:0/2189600250 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e5e219070 0x563e5e63f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:48.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.836+0000 7f14024f1640 1 -- 172.21.15.5:0/2189600250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e5e1f8390 msgr2=0x563e5e5cecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:48.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.836+0000 7f14024f1640 1 --2- 172.21.15.5:0/2189600250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e5e1f8390 0x563e5e5cecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:48.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.836+0000 7f14024f1640 1 -- 172.21.15.5:0/2189600250 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e5e5cca10 con 0x563e5e1f01b0 2024-08-31T05:41:48.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.836+0000 7f1401cf0640 1 --2- 172.21.15.5:0/2189600250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e5e1f8390 0x563e5e5cecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:41:48.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.836+0000 7f14024f1640 1 --2- 172.21.15.5:0/2189600250 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e5e1f01b0 0x563e5e5ce730 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x563e5e5bcfd0 tx=0x7f13f802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8603de1eb8049e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:48.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.836+0000 7f13e5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:41:48.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.836+0000 7f13e5ffb640 1 -- 172.21.15.5:0/2189600250 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f8040070 con 0x563e5e1f01b0 2024-08-31T05:41:48.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.836+0000 7f13e5ffb640 1 -- 172.21.15.5:0/2189600250 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9511+0+0 (secure 0 0 0) 0x7f13f8031b10 con 0x563e5e1f01b0 2024-08-31T05:41:48.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.836+0000 7f140acca740 1 -- 172.21.15.5:0/2189600250 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13f40abd80 con 0x563e5e1f01b0 2024-08-31T05:41:48.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.837+0000 7f13e5ffb640 1 -- 172.21.15.5:0/2189600250 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f13f805f050 con 0x563e5e1f01b0 2024-08-31T05:41:48.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.837+0000 7f140acca740 10 client.18708 fetch_fsmap learned FSMap version 34 2024-08-31T05:41:48.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.837+0000 7f140acca740 1 -- 172.21.15.5:0/2189600250 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x563e5e647090 con 0x563e5e1f01b0 2024-08-31T05:41:48.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.837+0000 7f13e5ffb640 1 -- 172.21.15.5:0/2189600250 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13f40abd80 con 0x563e5e1f01b0 2024-08-31T05:41:48.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.837+0000 7f13e5ffb640 1 -- 172.21.15.5:0/2189600250 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f13f80046c0 con 0x563e5e1f01b0 2024-08-31T05:41:48.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.837+0000 7f140acca740 10 client.18708 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:41:48.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.837+0000 7f140acca740 10 client.18708 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-31T05:41:48.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.837+0000 7f140acca740 20 client.18708 populate_metadata read hostname 'smithi005' 2024-08-31T05:41:48.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.837+0000 7f140acca740 1 --2- 172.21.15.5:0/2189600250 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x563e5e1acda0 0x563e5e6494a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:48.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.837+0000 7f140acca740 4 client.18708 mds_command: new command op to 24602 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:41:48.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.837+0000 7f140acca740 1 -- 172.21.15.5:0/2189600250 --> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563e5e533070 con 0x563e5e1acda0 2024-08-31T05:41:48.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.837+0000 7f1401cf0640 1 --2- 172.21.15.5:0/2189600250 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x563e5e1acda0 0x563e5e6494a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:48.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.838+0000 7f13e5ffb640 10 client.18708 ms_handle_connect on v2:172.21.15.50:6836/428759669 2024-08-31T05:41:48.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.838+0000 7f1401cf0640 1 --2- 172.21.15.5:0/2189600250 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x563e5e1acda0 0x563e5e6494a0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=38a71e3ee4c9b89f server_cookie=7bd62e4fe59e1a65 in_seq=0 out_seq=0 2024-08-31T05:41:48.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.838+0000 7f13e5ffb640 1 -- 172.21.15.5:0/2189600250 <== mds.4 v2:172.21.15.50:6836/428759669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563e5e533070 con 0x563e5e1acda0 2024-08-31T05:41:48.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.838+0000 7f13e5ffb640 10 client.18708 handle_command_reply: tid=0 2024-08-31T05:41:48.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.838+0000 7f140acca740 1 client.18708 shutdown 2024-08-31T05:41:48.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.838+0000 7f140acca740 1 -- 172.21.15.5:0/2189600250 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e5e1f01b0 msgr2=0x563e5e5ce730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:48.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.838+0000 7f140acca740 1 --2- 172.21.15.5:0/2189600250 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e5e1f01b0 0x563e5e5ce730 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x563e5e5bcfd0 tx=0x7f13f802a410 comp rx=0 tx=0).stop 2024-08-31T05:41:48.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.838+0000 7f140acca740 1 -- 172.21.15.5:0/2189600250 shutdown_connections 2024-08-31T05:41:48.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.838+0000 7f140acca740 1 --2- 172.21.15.5:0/2189600250 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x563e5e1acda0 0x563e5e6494a0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:48.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.838+0000 7f140acca740 1 --2- 172.21.15.5:0/2189600250 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e5e219070 0x563e5e63f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:48.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.838+0000 7f140acca740 1 --2- 172.21.15.5:0/2189600250 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563e5e1f8390 0x563e5e5cecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:48.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.838+0000 7f140acca740 1 --2- 172.21.15.5:0/2189600250 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563e5e1f01b0 0x563e5e5ce730 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:48.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.838+0000 7f13e5ffb640 0 client.18708 ms_handle_reset on v2:172.21.15.50:6836/428759669 2024-08-31T05:41:48.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.838+0000 7f140acca740 1 -- 172.21.15.5:0/2189600250 >> 172.21.15.5:0/2189600250 conn(0x563e5e20d460 msgr2=0x563e5e5bba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:48.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.838+0000 7f140acca740 1 -- 172.21.15.5:0/2189600250 shutdown_connections 2024-08-31T05:41:48.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.838+0000 7f140acca740 1 -- 172.21.15.5:0/2189600250 wait complete. 2024-08-31T05:41:48.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.838+0000 7f140acca740 20 client.18708 trim_cache size 0 max 16384 2024-08-31T05:41:48.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.839+0000 7f1404755640 1 -- 172.21.15.5:0/120821498 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f13e80b4ca0 msgr2=0x7f13e80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:48.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.839+0000 7f1404755640 1 --2- 172.21.15.5:0/120821498 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f13e80b4ca0 0x7f13e80b71b0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f13fc1061f0 tx=0x7f13ec015040 comp rx=0 tx=0).stop 2024-08-31T05:41:48.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.839+0000 7f1404755640 1 -- 172.21.15.5:0/120821498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13fc109b90 msgr2=0x7f13fc19fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:48.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.839+0000 7f1404755640 1 --2- 172.21.15.5:0/120821498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13fc109b90 0x7f13fc19fa60 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f13f400eb10 tx=0x7f13f400c2d0 comp rx=0 tx=0).stop 2024-08-31T05:41:48.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.839+0000 7f1404755640 1 -- 172.21.15.5:0/120821498 shutdown_connections 2024-08-31T05:41:48.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.839+0000 7f1404755640 1 --2- 172.21.15.5:0/120821498 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f13e80b4ca0 0x7f13e80b71b0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:48.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.839+0000 7f1404755640 1 --2- 172.21.15.5:0/120821498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13fc109b90 0x7f13fc19fa60 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:48.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.839+0000 7f1404755640 1 --2- 172.21.15.5:0/120821498 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f13fc109240 0x7f13fc19a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:48.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.839+0000 7f1404755640 1 --2- 172.21.15.5:0/120821498 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13fc103900 0x7f13fc19a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:48.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.839+0000 7f1404755640 1 -- 172.21.15.5:0/120821498 >> 172.21.15.5:0/120821498 conn(0x7f13fc07b5f0 msgr2=0x7f13fc107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:48.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.839+0000 7f1404755640 1 -- 172.21.15.5:0/120821498 shutdown_connections 2024-08-31T05:41:48.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:48.839+0000 7f1404755640 1 -- 172.21.15.5:0/120821498 wait complete. 2024-08-31T05:41:48.939 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1331966 10.82 MB/sec execute 516 sec latency 82.493 ms 2024-08-31T05:41:48.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:41:48 smithi005 ceph-mon[18602]: pgmap v710: 129 pgs: 129 active+clean; 579 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.2 MiB/s wr, 195 op/s 2024-08-31T05:41:49.209 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:41:48 smithi050 ceph-mon[22146]: pgmap v710: 129 pgs: 129 active+clean; 579 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.2 MiB/s wr, 195 op/s 2024-08-31T05:41:49.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:41:48 smithi070 ceph-mon[22316]: pgmap v710: 129 pgs: 129 active+clean; 579 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.2 MiB/s wr, 195 op/s 2024-08-31T05:41:49.940 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-31T05:41:49.941 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1333387 10.81 MB/sec execute 517 sec latency 24.877 ms 2024-08-31T05:41:50.201 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:41:50.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.708+0000 7f8f7e0c4640 1 -- 172.21.15.5:0/4220184622 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f78108ab0 msgr2=0x7f8f7810f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:50.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.708+0000 7f8f7e0c4640 1 --2- 172.21.15.5:0/4220184622 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f78108ab0 0x7f8f7810f2e0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f8f70009ca0 tx=0x7f8f7002a8c0 comp rx=0 tx=0).stop 2024-08-31T05:41:50.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.708+0000 7f8f7e0c4640 1 -- 172.21.15.5:0/4220184622 shutdown_connections 2024-08-31T05:41:50.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.708+0000 7f8f7e0c4640 1 --2- 172.21.15.5:0/4220184622 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f78108ab0 0x7f8f7810f2e0 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:50.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.708+0000 7f8f7e0c4640 1 --2- 172.21.15.5:0/4220184622 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f78108160 0x7f8f78108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:50.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.708+0000 7f8f7e0c4640 1 --2- 172.21.15.5:0/4220184622 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f78102870 0x7f8f78102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:50.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.708+0000 7f8f7e0c4640 1 -- 172.21.15.5:0/4220184622 >> 172.21.15.5:0/4220184622 conn(0x7f8f78079470 msgr2=0x7f8f78079880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:50.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.708+0000 7f8f7e0c4640 1 -- 172.21.15.5:0/4220184622 shutdown_connections 2024-08-31T05:41:50.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.708+0000 7f8f7e0c4640 1 -- 172.21.15.5:0/4220184622 wait complete. 2024-08-31T05:41:50.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.709+0000 7f8f7e0c4640 1 Processor -- start 2024-08-31T05:41:50.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.709+0000 7f8f7e0c4640 1 -- start start 2024-08-31T05:41:50.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.709+0000 7f8f7e0c4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f78102870 0x7f8f780ff440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:50.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.709+0000 7f8f7e0c4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f78108160 0x7f8f780ff980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:50.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.709+0000 7f8f7e0c4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f78108ab0 0x7f8f780ffec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:50.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.709+0000 7f8f7e0c4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8f78112780 con 0x7f8f78108160 2024-08-31T05:41:50.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.709+0000 7f8f7e0c4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8f78112600 con 0x7f8f78108ab0 2024-08-31T05:41:50.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.709+0000 7f8f7e0c4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8f78112900 con 0x7f8f78102870 2024-08-31T05:41:50.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.709+0000 7f8f6effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f78108160 0x7f8f780ff980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:50.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.709+0000 7f8f777fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f78102870 0x7f8f780ff440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:50.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.709+0000 7f8f777fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f78102870 0x7f8f780ff440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:55818/0 (socket says 172.21.15.5:55818) 2024-08-31T05:41:50.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.709+0000 7f8f77fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f78108ab0 0x7f8f780ffec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:50.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.709+0000 7f8f777fe640 1 -- 172.21.15.5:0/3735756661 learned_addr learned my addr 172.21.15.5:0/3735756661 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:50.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.709+0000 7f8f6effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f78108160 0x7f8f780ff980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44306/0 (socket says 172.21.15.5:44306) 2024-08-31T05:41:50.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.710+0000 7f8f6effd640 1 -- 172.21.15.5:0/3735756661 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f78102870 msgr2=0x7f8f780ff440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:50.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.710+0000 7f8f6effd640 1 --2- 172.21.15.5:0/3735756661 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f78102870 0x7f8f780ff440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:50.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.710+0000 7f8f6effd640 1 -- 172.21.15.5:0/3735756661 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f78108ab0 msgr2=0x7f8f780ffec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:50.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.710+0000 7f8f6effd640 1 --2- 172.21.15.5:0/3735756661 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f78108ab0 0x7f8f780ffec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:50.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.710+0000 7f8f6effd640 1 -- 172.21.15.5:0/3735756661 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f781a8580 con 0x7f8f78108160 2024-08-31T05:41:50.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.710+0000 7f8f777fe640 1 --2- 172.21.15.5:0/3735756661 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f78102870 0x7f8f780ff440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:41:50.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.710+0000 7f8f77fff640 1 --2- 172.21.15.5:0/3735756661 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f78108ab0 0x7f8f780ffec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:41:50.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.710+0000 7f8f6effd640 1 --2- 172.21.15.5:0/3735756661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f78108160 0x7f8f780ff980 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f8f7806b6f0 tx=0x7f8f6000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:50.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.710+0000 7f8f757fa640 1 -- 172.21.15.5:0/3735756661 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f6000cc40 con 0x7f8f78108160 2024-08-31T05:41:50.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.710+0000 7f8f757fa640 1 -- 172.21.15.5:0/3735756661 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f6000cde0 con 0x7f8f78108160 2024-08-31T05:41:50.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.710+0000 7f8f7e0c4640 1 -- 172.21.15.5:0/3735756661 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f781a8870 con 0x7f8f78108160 2024-08-31T05:41:50.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.710+0000 7f8f757fa640 1 -- 172.21.15.5:0/3735756661 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f60018780 con 0x7f8f78108160 2024-08-31T05:41:50.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.710+0000 7f8f7e0c4640 1 -- 172.21.15.5:0/3735756661 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f781a8db0 con 0x7f8f78108160 2024-08-31T05:41:50.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.713+0000 7f8f84639740 1 Processor -- start 2024-08-31T05:41:50.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.713+0000 7f8f757fa640 1 -- 172.21.15.5:0/3735756661 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f8f60010a90 con 0x7f8f78108160 2024-08-31T05:41:50.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.713+0000 7f8f84639740 1 -- start start 2024-08-31T05:41:50.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.713+0000 7f8f84639740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5631663ac070 0x563166751310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:50.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.713+0000 7f8f84639740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5631663831b0 0x563166751850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:50.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.713+0000 7f8f84639740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56316638b390 0x563166751d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:50.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.713+0000 7f8f84639740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5631666c8680 con 0x56316638b390 2024-08-31T05:41:50.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.713+0000 7f8f84639740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5631666b7c10 con 0x5631663831b0 2024-08-31T05:41:50.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.713+0000 7f8f84639740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5631666bbbc0 con 0x5631663ac070 2024-08-31T05:41:50.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.713+0000 7f8f77fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5631663ac070 0x563166751310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:50.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.713+0000 7f8f6effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56316638b390 0x563166751d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:50.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.714+0000 7f8f777fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5631663831b0 0x563166751850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:50.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.714+0000 7f8f77fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5631663ac070 0x563166751310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:55830/0 (socket says 172.21.15.5:55830) 2024-08-31T05:41:50.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.714+0000 7f8f77fff640 1 -- 172.21.15.5:0/50347567 learned_addr learned my addr 172.21.15.5:0/50347567 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:50.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.714+0000 7f8f77fff640 1 -- 172.21.15.5:0/50347567 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5631663831b0 msgr2=0x563166751850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:50.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.714+0000 7f8f77fff640 1 --2- 172.21.15.5:0/50347567 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5631663831b0 0x563166751850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:50.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.714+0000 7f8f77fff640 1 -- 172.21.15.5:0/50347567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56316638b390 msgr2=0x563166751d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:50.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.714+0000 7f8f77fff640 1 --2- 172.21.15.5:0/50347567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56316638b390 0x563166751d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:50.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.714+0000 7f8f77fff640 1 -- 172.21.15.5:0/50347567 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563166417650 con 0x5631663ac070 2024-08-31T05:41:50.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.714+0000 7f8f777fe640 1 --2- 172.21.15.5:0/50347567 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5631663831b0 0x563166751850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:41:50.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.714+0000 7f8f757fa640 1 --2- 172.21.15.5:0/3735756661 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f8f640b4ca0 0x7f8f640b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:50.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.714+0000 7f8f777fe640 1 --2- 172.21.15.5:0/3735756661 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f8f640b4ca0 0x7f8f640b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:50.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.714+0000 7f8f77fff640 1 --2- 172.21.15.5:0/50347567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5631663ac070 0x563166751310 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8f70033040 tx=0x7f8f7002f310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3c1c77b7f1a915d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:50.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.714+0000 7f8f757fa640 1 -- 172.21.15.5:0/3735756661 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9511+0+0 (secure 0 0 0) 0x7f8f600e5b80 con 0x7f8f78108160 2024-08-31T05:41:50.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.714+0000 7f8f6dffb640 1 -- 172.21.15.5:0/50347567 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f70031650 con 0x5631663ac070 2024-08-31T05:41:50.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.714+0000 7f8f6dffb640 1 -- 172.21.15.5:0/50347567 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f70036040 con 0x5631663ac070 2024-08-31T05:41:50.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.714+0000 7f8f6dffb640 1 -- 172.21.15.5:0/50347567 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f700044c0 con 0x5631663ac070 2024-08-31T05:41:50.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.715+0000 7f8f84639740 1 -- 172.21.15.5:0/50347567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5631663ac070 msgr2=0x563166751310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:50.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.715+0000 7f8f84639740 1 --2- 172.21.15.5:0/50347567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5631663ac070 0x563166751310 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8f70033040 tx=0x7f8f7002f310 comp rx=0 tx=0).stop 2024-08-31T05:41:50.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.715+0000 7f8f777fe640 1 --2- 172.21.15.5:0/3735756661 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f8f640b4ca0 0x7f8f640b71b0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x56316674ff90 tx=0x7f8f68005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:50.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.715+0000 7f8f84639740 1 -- 172.21.15.5:0/50347567 shutdown_connections 2024-08-31T05:41:50.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.715+0000 7f8f84639740 1 --2- 172.21.15.5:0/50347567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56316638b390 0x563166751d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:50.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.715+0000 7f8f84639740 1 --2- 172.21.15.5:0/50347567 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5631663831b0 0x563166751850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:50.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.715+0000 7f8f84639740 1 --2- 172.21.15.5:0/50347567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5631663ac070 0x563166751310 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:50.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.715+0000 7f8f84639740 1 -- 172.21.15.5:0/50347567 >> 172.21.15.5:0/50347567 conn(0x5631663a0460 msgr2=0x56316674f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:50.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.715+0000 7f8f84639740 1 -- 172.21.15.5:0/50347567 shutdown_connections 2024-08-31T05:41:50.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.715+0000 7f8f84639740 1 -- 172.21.15.5:0/50347567 wait complete. 2024-08-31T05:41:50.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.716+0000 7f8f84639740 1 -- start start 2024-08-31T05:41:50.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.716+0000 7f8f84639740 1 Processor -- start 2024-08-31T05:41:50.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.716+0000 7f8f84639740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5631663831b0 0x56316675cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:50.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.716+0000 7f8f84639740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56316638b390 0x56316675d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:50.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.716+0000 7f8f84639740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5631663ac070 0x563166768c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:50.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.716+0000 7f8f84639740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56316651a700 con 0x5631663ac070 2024-08-31T05:41:50.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.716+0000 7f8f84639740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56316663e750 con 0x56316638b390 2024-08-31T05:41:50.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.716+0000 7f8f84639740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56316675f910 con 0x5631663831b0 2024-08-31T05:41:50.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.716+0000 7f8f84639740 10 client.0 _ll_register_callbacks cb 0x56316666de10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:41:50.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.716+0000 7f8f77fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5631663ac070 0x563166768c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:50.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.716+0000 7f8f6effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56316638b390 0x56316675d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:50.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.717+0000 7f8f77fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5631663ac070 0x563166768c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44314/0 (socket says 172.21.15.5:44314) 2024-08-31T05:41:50.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.717+0000 7f8f777fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5631663831b0 0x56316675cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:50.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.717+0000 7f8f77fff640 1 -- 172.21.15.5:0/2161005317 learned_addr learned my addr 172.21.15.5:0/2161005317 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:50.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.717+0000 7f8f77fff640 1 -- 172.21.15.5:0/2161005317 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5631663831b0 msgr2=0x56316675cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:50.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.717+0000 7f8f77fff640 1 --2- 172.21.15.5:0/2161005317 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5631663831b0 0x56316675cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:50.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.717+0000 7f8f77fff640 1 -- 172.21.15.5:0/2161005317 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56316638b390 msgr2=0x56316675d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:50.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.717+0000 7f8f77fff640 1 --2- 172.21.15.5:0/2161005317 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56316638b390 0x56316675d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:50.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.717+0000 7f8f77fff640 1 -- 172.21.15.5:0/2161005317 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563166677900 con 0x5631663ac070 2024-08-31T05:41:50.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.717+0000 7f8f6effd640 1 --2- 172.21.15.5:0/2161005317 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56316638b390 0x56316675d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:41:50.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.717+0000 7f8f77fff640 1 --2- 172.21.15.5:0/2161005317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5631663ac070 0x563166768c00 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f8f700094e0 tx=0x7f8f70003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=761e9737cc3b1f98 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:50.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.717+0000 7f8f56ffd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:41:50.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.717+0000 7f8f56ffd640 1 -- 172.21.15.5:0/2161005317 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f70054060 con 0x5631663ac070 2024-08-31T05:41:50.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.717+0000 7f8f56ffd640 1 -- 172.21.15.5:0/2161005317 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9511+0+0 (secure 0 0 0) 0x7f8f700041c0 con 0x5631663ac070 2024-08-31T05:41:50.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.717+0000 7f8f84639740 1 -- 172.21.15.5:0/2161005317 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f70036040 con 0x5631663ac070 2024-08-31T05:41:50.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.717+0000 7f8f56ffd640 1 -- 172.21.15.5:0/2161005317 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f8f7005b050 con 0x5631663ac070 2024-08-31T05:41:50.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.717+0000 7f8f84639740 10 client.18720 fetch_fsmap learned FSMap version 34 2024-08-31T05:41:50.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.717+0000 7f8f84639740 1 -- 172.21.15.5:0/2161005317 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56316676b770 con 0x5631663ac070 2024-08-31T05:41:50.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.718+0000 7f8f56ffd640 1 -- 172.21.15.5:0/2161005317 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f70036040 con 0x5631663ac070 2024-08-31T05:41:50.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.718+0000 7f8f56ffd640 1 -- 172.21.15.5:0/2161005317 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f8f70044070 con 0x5631663ac070 2024-08-31T05:41:50.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.718+0000 7f8f84639740 10 client.18720 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:41:50.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.718+0000 7f8f84639740 10 client.18720 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-31T05:41:50.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.718+0000 7f8f84639740 20 client.18720 populate_metadata read hostname 'smithi005' 2024-08-31T05:41:50.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.718+0000 7f8f84639740 1 --2- 172.21.15.5:0/2161005317 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x56316636a9f0 0x56316676ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:50.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.718+0000 7f8f84639740 4 client.18720 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:41:50.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.718+0000 7f8f84639740 1 -- 172.21.15.5:0/2161005317 --> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5631666ca5d0 con 0x56316636a9f0 2024-08-31T05:41:50.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.718+0000 7f8f777fe640 1 --2- 172.21.15.5:0/2161005317 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x56316636a9f0 0x56316676ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:50.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.718+0000 7f8f56ffd640 10 client.18720 ms_handle_connect on v2:172.21.15.70:6834/2061504114 2024-08-31T05:41:50.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.718+0000 7f8f777fe640 1 --2- 172.21.15.5:0/2161005317 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x56316636a9f0 0x56316676ead0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=859ecbdd623b597c server_cookie=fabbdb459b860790 in_seq=0 out_seq=0 2024-08-31T05:41:50.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.719+0000 7f8f56ffd640 1 -- 172.21.15.5:0/2161005317 <== mds.3 v2:172.21.15.70:6834/2061504114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5631666ca5d0 con 0x56316636a9f0 2024-08-31T05:41:50.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.719+0000 7f8f56ffd640 10 client.18720 handle_command_reply: tid=0 2024-08-31T05:41:50.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.719+0000 7f8f84639740 1 client.18720 shutdown 2024-08-31T05:41:50.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.719+0000 7f8f84639740 1 -- 172.21.15.5:0/2161005317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5631663ac070 msgr2=0x563166768c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:50.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.719+0000 7f8f84639740 1 --2- 172.21.15.5:0/2161005317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5631663ac070 0x563166768c00 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f8f700094e0 tx=0x7f8f70003c20 comp rx=0 tx=0).stop 2024-08-31T05:41:50.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.719+0000 7f8f84639740 1 -- 172.21.15.5:0/2161005317 shutdown_connections 2024-08-31T05:41:50.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.719+0000 7f8f84639740 1 --2- 172.21.15.5:0/2161005317 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x56316636a9f0 0x56316676ead0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:50.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.719+0000 7f8f84639740 1 --2- 172.21.15.5:0/2161005317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5631663ac070 0x563166768c00 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:50.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.719+0000 7f8f84639740 1 --2- 172.21.15.5:0/2161005317 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56316638b390 0x56316675d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:50.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.719+0000 7f8f84639740 1 --2- 172.21.15.5:0/2161005317 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5631663831b0 0x56316675cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:50.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.719+0000 7f8f84639740 1 -- 172.21.15.5:0/2161005317 >> 172.21.15.5:0/2161005317 conn(0x5631663a0460 msgr2=0x5631667544a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:50.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.719+0000 7f8f56ffd640 0 client.18720 ms_handle_reset on v2:172.21.15.70:6834/2061504114 2024-08-31T05:41:50.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.720+0000 7f8f84639740 1 -- 172.21.15.5:0/2161005317 shutdown_connections 2024-08-31T05:41:50.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.720+0000 7f8f84639740 1 -- 172.21.15.5:0/2161005317 wait complete. 2024-08-31T05:41:50.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.720+0000 7f8f84639740 20 client.18720 trim_cache size 0 max 16384 2024-08-31T05:41:50.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.733+0000 7f8f84639740 1 Processor -- start 2024-08-31T05:41:50.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.733+0000 7f8f84639740 1 -- start start 2024-08-31T05:41:50.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.733+0000 7f8f84639740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5631663831b0 0x563166752a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:50.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.734+0000 7f8f84639740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56316638b390 0x563166768b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:50.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.734+0000 7f8f84639740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5631663ac070 0x563166769040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:50.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.734+0000 7f8f84639740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8f781b2f30 con 0x56316638b390 2024-08-31T05:41:50.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.734+0000 7f8f84639740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8f781b4a70 con 0x5631663ac070 2024-08-31T05:41:50.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.734+0000 7f8f84639740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8f781b3600 con 0x5631663831b0 2024-08-31T05:41:50.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.734+0000 7f8f6effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56316638b390 0x563166768b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:50.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.734+0000 7f8f6effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56316638b390 0x563166768b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44320/0 (socket says 172.21.15.5:44320) 2024-08-31T05:41:50.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.734+0000 7f8f77fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5631663ac070 0x563166769040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:50.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.734+0000 7f8f6effd640 1 -- 172.21.15.5:0/2659637904 learned_addr learned my addr 172.21.15.5:0/2659637904 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:50.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.734+0000 7f8f777fe640 1 --2- 172.21.15.5:0/2659637904 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5631663831b0 0x563166752a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:50.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.734+0000 7f8f6effd640 1 -- 172.21.15.5:0/2659637904 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5631663831b0 msgr2=0x563166752a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:50.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.734+0000 7f8f6effd640 1 --2- 172.21.15.5:0/2659637904 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5631663831b0 0x563166752a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:50.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.734+0000 7f8f6effd640 1 -- 172.21.15.5:0/2659637904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5631663ac070 msgr2=0x563166769040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:50.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.734+0000 7f8f6effd640 1 --2- 172.21.15.5:0/2659637904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5631663ac070 0x563166769040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:50.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.734+0000 7f8f6effd640 1 -- 172.21.15.5:0/2659637904 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56316674a960 con 0x56316638b390 2024-08-31T05:41:50.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.734+0000 7f8f6effd640 1 --2- 172.21.15.5:0/2659637904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56316638b390 0x563166768b00 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f8f600a7fc0 tx=0x7f8f6000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=663e237d5a20ea40 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:50.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.734+0000 7f8f6d7fa640 1 -- 172.21.15.5:0/2659637904 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f600aba50 con 0x56316638b390 2024-08-31T05:41:50.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.734+0000 7f8f6d7fa640 1 -- 172.21.15.5:0/2659637904 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f600abf40 con 0x56316638b390 2024-08-31T05:41:50.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.734+0000 7f8f6d7fa640 1 -- 172.21.15.5:0/2659637904 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f600a78b0 con 0x56316638b390 2024-08-31T05:41:50.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.735+0000 7f8f84639740 1 -- 172.21.15.5:0/2659637904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56316638b390 msgr2=0x563166768b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:50.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.735+0000 7f8f84639740 1 --2- 172.21.15.5:0/2659637904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56316638b390 0x563166768b00 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f8f600a7fc0 tx=0x7f8f6000cf90 comp rx=0 tx=0).stop 2024-08-31T05:41:50.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.735+0000 7f8f84639740 1 -- 172.21.15.5:0/2659637904 shutdown_connections 2024-08-31T05:41:50.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.735+0000 7f8f84639740 1 --2- 172.21.15.5:0/2659637904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5631663ac070 0x563166769040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:50.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.735+0000 7f8f84639740 1 --2- 172.21.15.5:0/2659637904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56316638b390 0x563166768b00 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:50.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.735+0000 7f8f84639740 1 --2- 172.21.15.5:0/2659637904 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5631663831b0 0x563166752a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:50.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.735+0000 7f8f84639740 1 -- 172.21.15.5:0/2659637904 >> 172.21.15.5:0/2659637904 conn(0x5631663a0460 msgr2=0x563166752340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:50.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.735+0000 7f8f84639740 1 -- 172.21.15.5:0/2659637904 shutdown_connections 2024-08-31T05:41:50.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.735+0000 7f8f84639740 1 -- 172.21.15.5:0/2659637904 wait complete. 2024-08-31T05:41:50.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.736+0000 7f8f84639740 1 -- start start 2024-08-31T05:41:50.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.736+0000 7f8f84639740 1 Processor -- start 2024-08-31T05:41:50.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.736+0000 7f8f84639740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5631663831b0 0x563166760c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:50.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.736+0000 7f8f84639740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56316638b390 0x563166761140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:50.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.736+0000 7f8f84639740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5631663ac070 0x563166761680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:50.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.736+0000 7f8f84639740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8f781b43a0 con 0x56316638b390 2024-08-31T05:41:50.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.736+0000 7f8f84639740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8f781b3cd0 con 0x5631663ac070 2024-08-31T05:41:50.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.736+0000 7f8f84639740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8f781b0f30 con 0x5631663831b0 2024-08-31T05:41:50.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.737+0000 7f8f777fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5631663831b0 0x563166760c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:50.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.737+0000 7f8f6effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56316638b390 0x563166761140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:50.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.737+0000 7f8f84639740 10 client.0 _ll_register_callbacks cb 0x7f8f600e95a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:41:50.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.737+0000 7f8f777fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5631663831b0 0x563166760c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:55836/0 (socket says 172.21.15.5:55836) 2024-08-31T05:41:50.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.737+0000 7f8f777fe640 1 -- 172.21.15.5:0/1708470012 learned_addr learned my addr 172.21.15.5:0/1708470012 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:50.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.737+0000 7f8f77fff640 1 --2- 172.21.15.5:0/1708470012 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5631663ac070 0x563166761680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:50.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.737+0000 7f8f6effd640 1 -- 172.21.15.5:0/1708470012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5631663831b0 msgr2=0x563166760c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:50.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.737+0000 7f8f6effd640 1 --2- 172.21.15.5:0/1708470012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5631663831b0 0x563166760c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:50.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.737+0000 7f8f6effd640 1 -- 172.21.15.5:0/1708470012 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5631663ac070 msgr2=0x563166761680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:50.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.737+0000 7f8f6effd640 1 --2- 172.21.15.5:0/1708470012 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5631663ac070 0x563166761680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:50.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.737+0000 7f8f6effd640 1 -- 172.21.15.5:0/1708470012 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563166753b20 con 0x56316638b390 2024-08-31T05:41:50.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.737+0000 7f8f777fe640 1 --2- 172.21.15.5:0/1708470012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5631663831b0 0x563166760c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:41:50.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.737+0000 7f8f6effd640 1 --2- 172.21.15.5:0/1708470012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56316638b390 0x563166761140 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f8f600a7fc0 tx=0x7f8f600ab1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc5ce6fa7d10c8e8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:50.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.737+0000 7f8f56ffd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:41:50.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.737+0000 7f8f56ffd640 1 -- 172.21.15.5:0/1708470012 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f600aba50 con 0x56316638b390 2024-08-31T05:41:50.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.737+0000 7f8f56ffd640 1 -- 172.21.15.5:0/1708470012 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9511+0+0 (secure 0 0 0) 0x7f8f600ab310 con 0x56316638b390 2024-08-31T05:41:50.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.737+0000 7f8f84639740 1 -- 172.21.15.5:0/1708470012 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f600abf40 con 0x56316638b390 2024-08-31T05:41:50.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.738+0000 7f8f56ffd640 1 -- 172.21.15.5:0/1708470012 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f8f600b0700 con 0x56316638b390 2024-08-31T05:41:50.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.738+0000 7f8f84639740 10 client.18726 fetch_fsmap learned FSMap version 34 2024-08-31T05:41:50.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.738+0000 7f8f84639740 1 -- 172.21.15.5:0/1708470012 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5631667d93f0 con 0x56316638b390 2024-08-31T05:41:50.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.738+0000 7f8f56ffd640 1 -- 172.21.15.5:0/1708470012 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f600abf40 con 0x56316638b390 2024-08-31T05:41:50.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.738+0000 7f8f56ffd640 1 -- 172.21.15.5:0/1708470012 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f8f600ec030 con 0x56316638b390 2024-08-31T05:41:50.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.738+0000 7f8f84639740 10 client.18726 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:41:50.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.738+0000 7f8f84639740 10 client.18726 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-31T05:41:50.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.738+0000 7f8f84639740 20 client.18726 populate_metadata read hostname 'smithi005' 2024-08-31T05:41:50.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.738+0000 7f8f84639740 1 --2- 172.21.15.5:0/1708470012 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x56316633fda0 0x5631667dba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:50.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.738+0000 7f8f84639740 4 client.18726 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:41:50.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.738+0000 7f8f84639740 1 -- 172.21.15.5:0/1708470012 --> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5631666c6070 con 0x56316633fda0 2024-08-31T05:41:50.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.738+0000 7f8f777fe640 1 --2- 172.21.15.5:0/1708470012 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x56316633fda0 0x5631667dba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:50.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.739+0000 7f8f56ffd640 10 client.18726 ms_handle_connect on v2:172.21.15.70:6834/2061504114 2024-08-31T05:41:50.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.739+0000 7f8f777fe640 1 --2- 172.21.15.5:0/1708470012 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x56316633fda0 0x5631667dba90 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6bdba10710e4d7e7 server_cookie=1100cca1d2f25fec in_seq=0 out_seq=0 2024-08-31T05:41:50.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.739+0000 7f8f56ffd640 1 -- 172.21.15.5:0/1708470012 <== mds.3 v2:172.21.15.70:6834/2061504114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5631666c6070 con 0x56316633fda0 2024-08-31T05:41:50.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.739+0000 7f8f56ffd640 10 client.18726 handle_command_reply: tid=0 2024-08-31T05:41:50.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.739+0000 7f8f84639740 1 client.18726 shutdown 2024-08-31T05:41:50.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.739+0000 7f8f84639740 1 -- 172.21.15.5:0/1708470012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56316638b390 msgr2=0x563166761140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:50.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.739+0000 7f8f84639740 1 --2- 172.21.15.5:0/1708470012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56316638b390 0x563166761140 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f8f600a7fc0 tx=0x7f8f600ab1a0 comp rx=0 tx=0).stop 2024-08-31T05:41:50.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.739+0000 7f8f84639740 1 -- 172.21.15.5:0/1708470012 shutdown_connections 2024-08-31T05:41:50.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.739+0000 7f8f84639740 1 --2- 172.21.15.5:0/1708470012 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x56316633fda0 0x5631667dba90 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:50.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.739+0000 7f8f84639740 1 --2- 172.21.15.5:0/1708470012 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5631663ac070 0x563166761680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:50.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.739+0000 7f8f84639740 1 --2- 172.21.15.5:0/1708470012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56316638b390 0x563166761140 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:50.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.739+0000 7f8f84639740 1 --2- 172.21.15.5:0/1708470012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5631663831b0 0x563166760c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:50.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.739+0000 7f8f84639740 1 -- 172.21.15.5:0/1708470012 >> 172.21.15.5:0/1708470012 conn(0x5631663a0460 msgr2=0x563166754b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:50.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.739+0000 7f8f56ffd640 0 client.18726 ms_handle_reset on v2:172.21.15.70:6834/2061504114 2024-08-31T05:41:50.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.739+0000 7f8f84639740 1 -- 172.21.15.5:0/1708470012 shutdown_connections 2024-08-31T05:41:50.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.739+0000 7f8f84639740 1 -- 172.21.15.5:0/1708470012 wait complete. 2024-08-31T05:41:50.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.739+0000 7f8f84639740 20 client.18726 trim_cache size 0 max 16384 2024-08-31T05:41:50.746 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:41:50.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.740+0000 7f8f7e0c4640 1 -- 172.21.15.5:0/3735756661 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f8f640b4ca0 msgr2=0x7f8f640b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:50.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.740+0000 7f8f7e0c4640 1 --2- 172.21.15.5:0/3735756661 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f8f640b4ca0 0x7f8f640b71b0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x56316674ff90 tx=0x7f8f68005f90 comp rx=0 tx=0).stop 2024-08-31T05:41:50.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.740+0000 7f8f7e0c4640 1 -- 172.21.15.5:0/3735756661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f78108160 msgr2=0x7f8f780ff980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:50.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.740+0000 7f8f7e0c4640 1 --2- 172.21.15.5:0/3735756661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f78108160 0x7f8f780ff980 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f8f7806b6f0 tx=0x7f8f6000ee50 comp rx=0 tx=0).stop 2024-08-31T05:41:50.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.740+0000 7f8f7e0c4640 1 -- 172.21.15.5:0/3735756661 shutdown_connections 2024-08-31T05:41:50.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.740+0000 7f8f7e0c4640 1 --2- 172.21.15.5:0/3735756661 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f8f640b4ca0 0x7f8f640b71b0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:50.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.740+0000 7f8f7e0c4640 1 --2- 172.21.15.5:0/3735756661 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8f78108ab0 0x7f8f780ffec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:50.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.740+0000 7f8f7e0c4640 1 --2- 172.21.15.5:0/3735756661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f78108160 0x7f8f780ff980 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:50.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.740+0000 7f8f7e0c4640 1 --2- 172.21.15.5:0/3735756661 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f78102870 0x7f8f780ff440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:50.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.740+0000 7f8f7e0c4640 1 -- 172.21.15.5:0/3735756661 >> 172.21.15.5:0/3735756661 conn(0x7f8f78079470 msgr2=0x7f8f781018d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:50.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.740+0000 7f8f7e0c4640 1 -- 172.21.15.5:0/3735756661 shutdown_connections 2024-08-31T05:41:50.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:50.740+0000 7f8f7e0c4640 1 -- 172.21.15.5:0/3735756661 wait complete. 2024-08-31T05:41:50.939 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1335612 10.81 MB/sec execute 518 sec latency 63.566 ms 2024-08-31T05:41:51.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:41:50 smithi005 ceph-mon[18602]: pgmap v711: 129 pgs: 129 active+clean; 591 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.2 MiB/s wr, 239 op/s 2024-08-31T05:41:51.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:41:50 smithi070 ceph-mon[22316]: pgmap v711: 129 pgs: 129 active+clean; 591 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.2 MiB/s wr, 239 op/s 2024-08-31T05:41:51.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:41:50 smithi050 ceph-mon[22146]: pgmap v711: 129 pgs: 129 active+clean; 591 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.2 MiB/s wr, 239 op/s 2024-08-31T05:41:51.457 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T05:41:51.762 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:41:51.940 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1337050 10.80 MB/sec execute 519 sec latency 31.454 ms 2024-08-31T05:41:52.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.538+0000 7f12a7a26640 1 -- 172.21.15.5:0/985226163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12a0108140 msgr2=0x7f12a0108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:52.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.538+0000 7f12a7a26640 1 --2- 172.21.15.5:0/985226163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12a0108140 0x7f12a0108550 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f1290009900 tx=0x7f129002a410 comp rx=0 tx=0).stop 2024-08-31T05:41:52.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.538+0000 7f12a7a26640 1 -- 172.21.15.5:0/985226163 shutdown_connections 2024-08-31T05:41:52.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.538+0000 7f12a7a26640 1 --2- 172.21.15.5:0/985226163 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f12a0108a90 0x7f12a010f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:52.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.538+0000 7f12a7a26640 1 --2- 172.21.15.5:0/985226163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12a0108140 0x7f12a0108550 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:52.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.538+0000 7f12a7a26640 1 --2- 172.21.15.5:0/985226163 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12a0102800 0x7f12a0102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:52.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.538+0000 7f12a7a26640 1 -- 172.21.15.5:0/985226163 >> 172.21.15.5:0/985226163 conn(0x7f12a00794d0 msgr2=0x7f12a00798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:52.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.538+0000 7f12a7a26640 1 -- 172.21.15.5:0/985226163 shutdown_connections 2024-08-31T05:41:52.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.538+0000 7f12a7a26640 1 -- 172.21.15.5:0/985226163 wait complete. 2024-08-31T05:41:52.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.539+0000 7f12a7a26640 1 Processor -- start 2024-08-31T05:41:52.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.539+0000 7f12a7a26640 1 -- start start 2024-08-31T05:41:52.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.539+0000 7f12a7a26640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f12a0102800 0x7f12a019a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:52.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.539+0000 7f12a7a26640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12a0108140 0x7f12a019a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:52.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.539+0000 7f12a7a26640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12a0108a90 0x7f12a019fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:52.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.539+0000 7f12a7a26640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f12a01126e0 con 0x7f12a0108a90 2024-08-31T05:41:52.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.539+0000 7f12a7a26640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f12a0112560 con 0x7f12a0108140 2024-08-31T05:41:52.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.539+0000 7f12a7a26640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f12a0112860 con 0x7f12a0102800 2024-08-31T05:41:52.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.539+0000 7f12a4fc1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12a0108140 0x7f12a019a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:52.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.539+0000 7f12a57c2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f12a0102800 0x7f12a019a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:52.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.539+0000 7f12a5fc3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12a0108a90 0x7f12a019fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:52.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.539+0000 7f12a4fc1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12a0108140 0x7f12a019a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:47118/0 (socket says 172.21.15.5:47118) 2024-08-31T05:41:52.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.539+0000 7f12a57c2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f12a0102800 0x7f12a019a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:35222/0 (socket says 172.21.15.5:35222) 2024-08-31T05:41:52.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.539+0000 7f12a4fc1640 1 -- 172.21.15.5:0/3806496603 learned_addr learned my addr 172.21.15.5:0/3806496603 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:52.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.539+0000 7f12a5fc3640 1 --2- 172.21.15.5:0/3806496603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12a0108a90 0x7f12a019fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40448/0 (socket says 172.21.15.5:40448) 2024-08-31T05:41:52.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.540+0000 7f12a5fc3640 1 -- 172.21.15.5:0/3806496603 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f12a0102800 msgr2=0x7f12a019a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:52.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.540+0000 7f12a5fc3640 1 --2- 172.21.15.5:0/3806496603 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f12a0102800 0x7f12a019a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:52.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.540+0000 7f12a5fc3640 1 -- 172.21.15.5:0/3806496603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12a0108140 msgr2=0x7f12a019a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:52.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.540+0000 7f12a5fc3640 1 --2- 172.21.15.5:0/3806496603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12a0108140 0x7f12a019a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:52.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.540+0000 7f12a5fc3640 1 -- 172.21.15.5:0/3806496603 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12a01a01f0 con 0x7f12a0108a90 2024-08-31T05:41:52.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.540+0000 7f12a5fc3640 1 --2- 172.21.15.5:0/3806496603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12a0108a90 0x7f12a019fac0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f1298009fd0 tx=0x7f129800ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:52.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.540+0000 7f12967fc640 1 -- 172.21.15.5:0/3806496603 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129800ce20 con 0x7f12a0108a90 2024-08-31T05:41:52.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.540+0000 7f12a7a26640 1 -- 172.21.15.5:0/3806496603 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12a01a04e0 con 0x7f12a0108a90 2024-08-31T05:41:52.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.540+0000 7f12967fc640 1 -- 172.21.15.5:0/3806496603 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1298005020 con 0x7f12a0108a90 2024-08-31T05:41:52.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.540+0000 7f12967fc640 1 -- 172.21.15.5:0/3806496603 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1298010690 con 0x7f12a0108a90 2024-08-31T05:41:52.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.540+0000 7f12a7a26640 1 -- 172.21.15.5:0/3806496603 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12a0104d60 con 0x7f12a0108a90 2024-08-31T05:41:52.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.543+0000 7f12adf9b740 1 Processor -- start 2024-08-31T05:41:52.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.544+0000 7f12967fc640 1 -- 172.21.15.5:0/3806496603 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f12980054d0 con 0x7f12a0108a90 2024-08-31T05:41:52.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.544+0000 7f12adf9b740 1 -- start start 2024-08-31T05:41:52.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.544+0000 7f12adf9b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560f9725b070 0x560f97600310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:52.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.544+0000 7f12adf9b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f972321b0 0x560f97600850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:52.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.544+0000 7f12adf9b740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560f9723a390 0x560f97600d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:52.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.544+0000 7f12adf9b740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x560f97577680 con 0x560f9723a390 2024-08-31T05:41:52.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.544+0000 7f12adf9b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560f97566c10 con 0x560f972321b0 2024-08-31T05:41:52.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.544+0000 7f12adf9b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560f9756abc0 con 0x560f9725b070 2024-08-31T05:41:52.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.544+0000 7f12a4fc1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560f9723a390 0x560f97600d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:52.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.544+0000 7f12a4fc1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560f9723a390 0x560f97600d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40452/0 (socket says 172.21.15.5:40452) 2024-08-31T05:41:52.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.544+0000 7f12a4fc1640 1 -- 172.21.15.5:0/3880088965 learned_addr learned my addr 172.21.15.5:0/3880088965 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:52.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.544+0000 7f12a57c2640 1 --2- 172.21.15.5:0/3880088965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f972321b0 0x560f97600850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:52.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.544+0000 7f12a4fc1640 1 --2- 172.21.15.5:0/3880088965 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560f9725b070 0x560f97600310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:52.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.545+0000 7f12a57c2640 1 -- 172.21.15.5:0/3880088965 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560f9725b070 msgr2=0x560f97600310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:52.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.545+0000 7f12a57c2640 1 --2- 172.21.15.5:0/3880088965 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560f9725b070 0x560f97600310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:52.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.545+0000 7f12a57c2640 1 -- 172.21.15.5:0/3880088965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560f9723a390 msgr2=0x560f97600d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:52.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.545+0000 7f12967fc640 1 --2- 172.21.15.5:0/3806496603 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f128c0b4ca0 0x7f128c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:52.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.545+0000 7f12a57c2640 1 --2- 172.21.15.5:0/3880088965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560f9723a390 0x560f97600d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:52.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.545+0000 7f12a57c2640 1 -- 172.21.15.5:0/3880088965 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f972c6650 con 0x560f972321b0 2024-08-31T05:41:52.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.545+0000 7f12a5fc3640 1 --2- 172.21.15.5:0/3806496603 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f128c0b4ca0 0x7f128c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:52.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.545+0000 7f12a57c2640 1 --2- 172.21.15.5:0/3880088965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f972321b0 0x560f97600850 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f129c009c20 tx=0x7f129c011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac3282b91f81324c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:52.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.545+0000 7f12967fc640 1 -- 172.21.15.5:0/3806496603 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9511+0+0 (secure 0 0 0) 0x7f12980e5f40 con 0x7f12a0108a90 2024-08-31T05:41:52.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.545+0000 7f128b7fe640 1 -- 172.21.15.5:0/3880088965 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129c004050 con 0x560f972321b0 2024-08-31T05:41:52.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.545+0000 7f128b7fe640 1 -- 172.21.15.5:0/3880088965 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f129c0054d0 con 0x560f972321b0 2024-08-31T05:41:52.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.545+0000 7f128b7fe640 1 -- 172.21.15.5:0/3880088965 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129c004d90 con 0x560f972321b0 2024-08-31T05:41:52.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.546+0000 7f12adf9b740 1 -- 172.21.15.5:0/3880088965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f972321b0 msgr2=0x560f97600850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:52.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.546+0000 7f12a5fc3640 1 --2- 172.21.15.5:0/3806496603 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f128c0b4ca0 0x7f128c0b71b0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f12980e38b0 tx=0x7f1298093040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:52.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.546+0000 7f12adf9b740 1 --2- 172.21.15.5:0/3880088965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f972321b0 0x560f97600850 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f129c009c20 tx=0x7f129c011810 comp rx=0 tx=0).stop 2024-08-31T05:41:52.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.546+0000 7f12adf9b740 1 -- 172.21.15.5:0/3880088965 shutdown_connections 2024-08-31T05:41:52.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.546+0000 7f12adf9b740 1 --2- 172.21.15.5:0/3880088965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560f9723a390 0x560f97600d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:52.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.546+0000 7f12adf9b740 1 --2- 172.21.15.5:0/3880088965 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f972321b0 0x560f97600850 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:52.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.546+0000 7f12adf9b740 1 --2- 172.21.15.5:0/3880088965 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560f9725b070 0x560f97600310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:52.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.546+0000 7f12adf9b740 1 -- 172.21.15.5:0/3880088965 >> 172.21.15.5:0/3880088965 conn(0x560f9724f460 msgr2=0x560f975fe200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:52.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.546+0000 7f12adf9b740 1 -- 172.21.15.5:0/3880088965 shutdown_connections 2024-08-31T05:41:52.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.546+0000 7f12adf9b740 1 -- 172.21.15.5:0/3880088965 wait complete. 2024-08-31T05:41:52.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.547+0000 7f12adf9b740 1 -- start start 2024-08-31T05:41:52.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.547+0000 7f12adf9b740 1 Processor -- start 2024-08-31T05:41:52.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.547+0000 7f12adf9b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f972321b0 0x560f9760b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:52.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.547+0000 7f12adf9b740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560f9723a390 0x560f9760bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:52.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.547+0000 7f12adf9b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560f9725b070 0x560f97617de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:52.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.547+0000 7f12adf9b740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x560f973c9700 con 0x560f9723a390 2024-08-31T05:41:52.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.547+0000 7f12adf9b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560f974ed750 con 0x560f972321b0 2024-08-31T05:41:52.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.547+0000 7f12adf9b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560f9760eaf0 con 0x560f9725b070 2024-08-31T05:41:52.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.547+0000 7f12adf9b740 10 client.0 _ll_register_callbacks cb 0x560f9751ce10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:41:52.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.547+0000 7f12a57c2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560f9723a390 0x560f9760bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:52.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.547+0000 7f12a57c2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560f9723a390 0x560f9760bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40464/0 (socket says 172.21.15.5:40464) 2024-08-31T05:41:52.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.547+0000 7f12a57c2640 1 -- 172.21.15.5:0/499417635 learned_addr learned my addr 172.21.15.5:0/499417635 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:52.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.547+0000 7f12a4fc1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f972321b0 0x560f9760b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:52.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.547+0000 7f12a4fc1640 1 --2- 172.21.15.5:0/499417635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560f9725b070 0x560f97617de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:52.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.548+0000 7f12a4fc1640 1 -- 172.21.15.5:0/499417635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560f9725b070 msgr2=0x560f97617de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:52.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.548+0000 7f12a4fc1640 1 --2- 172.21.15.5:0/499417635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560f9725b070 0x560f97617de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:52.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.548+0000 7f12a4fc1640 1 -- 172.21.15.5:0/499417635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560f9723a390 msgr2=0x560f9760bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:52.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.548+0000 7f12a4fc1640 1 --2- 172.21.15.5:0/499417635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560f9723a390 0x560f9760bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:52.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.548+0000 7f12a4fc1640 1 -- 172.21.15.5:0/499417635 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f97526900 con 0x560f972321b0 2024-08-31T05:41:52.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.548+0000 7f12a4fc1640 1 --2- 172.21.15.5:0/499417635 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f972321b0 0x560f9760b9d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f12900096c0 tx=0x7f129002a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3b4852292528d1e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:52.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.548+0000 7f1288ff9640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:41:52.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.548+0000 7f1288ff9640 1 -- 172.21.15.5:0/499417635 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1290052060 con 0x560f972321b0 2024-08-31T05:41:52.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.548+0000 7f1288ff9640 1 -- 172.21.15.5:0/499417635 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9511+0+0 (secure 0 0 0) 0x7f1290004250 con 0x560f972321b0 2024-08-31T05:41:52.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.548+0000 7f12adf9b740 1 -- 172.21.15.5:0/499417635 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f129c0054d0 con 0x560f972321b0 2024-08-31T05:41:52.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.548+0000 7f1288ff9640 1 -- 172.21.15.5:0/499417635 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f1290035040 con 0x560f972321b0 2024-08-31T05:41:52.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.548+0000 7f12adf9b740 10 client.28301 fetch_fsmap learned FSMap version 34 2024-08-31T05:41:52.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.548+0000 7f12adf9b740 1 -- 172.21.15.5:0/499417635 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x560f9761a800 con 0x560f972321b0 2024-08-31T05:41:52.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.548+0000 7f1288ff9640 1 -- 172.21.15.5:0/499417635 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f129c0054d0 con 0x560f972321b0 2024-08-31T05:41:52.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.549+0000 7f1288ff9640 1 -- 172.21.15.5:0/499417635 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f12900049b0 con 0x560f972321b0 2024-08-31T05:41:52.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.549+0000 7f12adf9b740 10 client.28301 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:41:52.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.549+0000 7f12adf9b740 10 client.28301 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-31T05:41:52.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.549+0000 7f12adf9b740 20 client.28301 populate_metadata read hostname 'smithi005' 2024-08-31T05:41:52.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.549+0000 7f12adf9b740 1 --2- 172.21.15.5:0/499417635 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x560f972199f0 0x560f9761dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:52.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.549+0000 7f12adf9b740 4 client.28301 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:41:52.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.549+0000 7f12adf9b740 1 -- 172.21.15.5:0/499417635 --> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560f975795d0 con 0x560f972199f0 2024-08-31T05:41:52.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.549+0000 7f12a57c2640 1 --2- 172.21.15.5:0/499417635 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x560f972199f0 0x560f9761dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:52.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.549+0000 7f1288ff9640 10 client.28301 ms_handle_connect on v2:172.21.15.70:6836/2780036414 2024-08-31T05:41:52.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.549+0000 7f12a57c2640 1 --2- 172.21.15.5:0/499417635 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x560f972199f0 0x560f9761dcd0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=46ad6c2aac7c52e1 server_cookie=2a2ef88fbac5f68c in_seq=0 out_seq=0 2024-08-31T05:41:52.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.550+0000 7f1288ff9640 1 -- 172.21.15.5:0/499417635 <== mds.2 v2:172.21.15.70:6836/2780036414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560f975795d0 con 0x560f972199f0 2024-08-31T05:41:52.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.550+0000 7f1288ff9640 10 client.28301 handle_command_reply: tid=0 2024-08-31T05:41:52.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.550+0000 7f12adf9b740 1 client.28301 shutdown 2024-08-31T05:41:52.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.550+0000 7f12adf9b740 1 -- 172.21.15.5:0/499417635 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f972321b0 msgr2=0x560f9760b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:52.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.550+0000 7f12adf9b740 1 --2- 172.21.15.5:0/499417635 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f972321b0 0x560f9760b9d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f12900096c0 tx=0x7f129002a410 comp rx=0 tx=0).stop 2024-08-31T05:41:52.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.550+0000 7f12adf9b740 1 -- 172.21.15.5:0/499417635 shutdown_connections 2024-08-31T05:41:52.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.550+0000 7f12adf9b740 1 --2- 172.21.15.5:0/499417635 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x560f972199f0 0x560f9761dcd0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:52.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.550+0000 7f12adf9b740 1 --2- 172.21.15.5:0/499417635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560f9725b070 0x560f97617de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:52.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.550+0000 7f1288ff9640 0 client.28301 ms_handle_reset on v2:172.21.15.70:6836/2780036414 2024-08-31T05:41:52.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.550+0000 7f12adf9b740 1 --2- 172.21.15.5:0/499417635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560f9723a390 0x560f9760bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:52.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.550+0000 7f12adf9b740 1 --2- 172.21.15.5:0/499417635 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f972321b0 0x560f9760b9d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:52.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.550+0000 7f12adf9b740 1 -- 172.21.15.5:0/499417635 >> 172.21.15.5:0/499417635 conn(0x560f9724f460 msgr2=0x560f976034a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:52.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.551+0000 7f12adf9b740 1 -- 172.21.15.5:0/499417635 shutdown_connections 2024-08-31T05:41:52.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.551+0000 7f12adf9b740 1 -- 172.21.15.5:0/499417635 wait complete. 2024-08-31T05:41:52.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.551+0000 7f12adf9b740 20 client.28301 trim_cache size 0 max 16384 2024-08-31T05:41:52.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.565+0000 7f12adf9b740 1 Processor -- start 2024-08-31T05:41:52.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.565+0000 7f12adf9b740 1 -- start start 2024-08-31T05:41:52.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.565+0000 7f12adf9b740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560f972321b0 0x560f97603410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:52.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.565+0000 7f12adf9b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f9723a390 0x560f97603950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:52.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.565+0000 7f12adf9b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560f9725b070 0x560f97608bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:52.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.565+0000 7f12adf9b740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f12a01aec20 con 0x560f972321b0 2024-08-31T05:41:52.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.565+0000 7f12adf9b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f12a01b0760 con 0x560f9723a390 2024-08-31T05:41:52.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.565+0000 7f12adf9b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f12a01af2f0 con 0x560f9725b070 2024-08-31T05:41:52.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.565+0000 7f12a4fc1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560f972321b0 0x560f97603410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:52.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.565+0000 7f12a4fc1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560f972321b0 0x560f97603410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40472/0 (socket says 172.21.15.5:40472) 2024-08-31T05:41:52.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.565+0000 7f12a57c2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f9723a390 0x560f97603950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:52.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.565+0000 7f12a4fc1640 1 -- 172.21.15.5:0/2681028502 learned_addr learned my addr 172.21.15.5:0/2681028502 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:52.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.565+0000 7f12a4fc1640 1 --2- 172.21.15.5:0/2681028502 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560f9725b070 0x560f97608bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:52.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.566+0000 7f12a4fc1640 1 -- 172.21.15.5:0/2681028502 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560f9725b070 msgr2=0x560f97608bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:52.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.566+0000 7f12a4fc1640 1 --2- 172.21.15.5:0/2681028502 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560f9725b070 0x560f97608bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:52.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.566+0000 7f12a4fc1640 1 -- 172.21.15.5:0/2681028502 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f9723a390 msgr2=0x560f97603950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:52.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.566+0000 7f12a4fc1640 1 --2- 172.21.15.5:0/2681028502 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f9723a390 0x560f97603950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:52.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.566+0000 7f12a4fc1640 1 -- 172.21.15.5:0/2681028502 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f97602600 con 0x560f972321b0 2024-08-31T05:41:52.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.566+0000 7f12a57c2640 1 --2- 172.21.15.5:0/2681028502 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f9723a390 0x560f97603950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:41:52.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.566+0000 7f12a4fc1640 1 --2- 172.21.15.5:0/2681028502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560f972321b0 0x560f97603410 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f1290031440 tx=0x7f1290009830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f453fdcf1b2c1797 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:52.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.566+0000 7f128affd640 1 -- 172.21.15.5:0/2681028502 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1290052070 con 0x560f972321b0 2024-08-31T05:41:52.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.566+0000 7f128affd640 1 -- 172.21.15.5:0/2681028502 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1290031d80 con 0x560f972321b0 2024-08-31T05:41:52.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.566+0000 7f128affd640 1 -- 172.21.15.5:0/2681028502 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1290004fa0 con 0x560f972321b0 2024-08-31T05:41:52.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.567+0000 7f12adf9b740 1 -- 172.21.15.5:0/2681028502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560f972321b0 msgr2=0x560f97603410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:52.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.567+0000 7f12adf9b740 1 --2- 172.21.15.5:0/2681028502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560f972321b0 0x560f97603410 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f1290031440 tx=0x7f1290009830 comp rx=0 tx=0).stop 2024-08-31T05:41:52.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.567+0000 7f12adf9b740 1 -- 172.21.15.5:0/2681028502 shutdown_connections 2024-08-31T05:41:52.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.567+0000 7f12adf9b740 1 --2- 172.21.15.5:0/2681028502 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560f9725b070 0x560f97608bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:52.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.567+0000 7f12adf9b740 1 --2- 172.21.15.5:0/2681028502 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f9723a390 0x560f97603950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:52.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.567+0000 7f12adf9b740 1 --2- 172.21.15.5:0/2681028502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560f972321b0 0x560f97603410 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:52.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.567+0000 7f12adf9b740 1 -- 172.21.15.5:0/2681028502 >> 172.21.15.5:0/2681028502 conn(0x560f9724f460 msgr2=0x560f9760a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:52.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.567+0000 7f12adf9b740 1 -- 172.21.15.5:0/2681028502 shutdown_connections 2024-08-31T05:41:52.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.567+0000 7f12adf9b740 1 -- 172.21.15.5:0/2681028502 wait complete. 2024-08-31T05:41:52.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.568+0000 7f12adf9b740 1 -- start start 2024-08-31T05:41:52.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.568+0000 7f12adf9b740 1 Processor -- start 2024-08-31T05:41:52.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.568+0000 7f12adf9b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560f972321b0 0x560f976101b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:52.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.568+0000 7f12adf9b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f9723a390 0x560f97610770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:52.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.568+0000 7f12adf9b740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560f9725b070 0x560f97687670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:52.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.568+0000 7f12adf9b740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f12a01b0090 con 0x560f9725b070 2024-08-31T05:41:52.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.568+0000 7f12adf9b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f12a01af9c0 con 0x560f9723a390 2024-08-31T05:41:52.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.568+0000 7f12adf9b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f12a01acc20 con 0x560f972321b0 2024-08-31T05:41:52.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.568+0000 7f12adf9b740 10 client.0 _ll_register_callbacks cb 0x7f1290031700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:41:52.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.568+0000 7f12a4fc1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560f9725b070 0x560f97687670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:52.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.568+0000 7f12a4fc1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560f9725b070 0x560f97687670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40476/0 (socket says 172.21.15.5:40476) 2024-08-31T05:41:52.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.568+0000 7f12a57c2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f9723a390 0x560f97610770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:52.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.568+0000 7f12a4fc1640 1 -- 172.21.15.5:0/3819385632 learned_addr learned my addr 172.21.15.5:0/3819385632 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:52.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.568+0000 7f12a4fc1640 1 --2- 172.21.15.5:0/3819385632 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560f972321b0 0x560f976101b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:52.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.569+0000 7f12a57c2640 1 -- 172.21.15.5:0/3819385632 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560f972321b0 msgr2=0x560f976101b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:52.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.569+0000 7f12a57c2640 1 --2- 172.21.15.5:0/3819385632 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560f972321b0 0x560f976101b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:52.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.569+0000 7f12a57c2640 1 -- 172.21.15.5:0/3819385632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560f9725b070 msgr2=0x560f97687670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:52.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.569+0000 7f12a57c2640 1 --2- 172.21.15.5:0/3819385632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560f9725b070 0x560f97687670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:52.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.569+0000 7f12a57c2640 1 -- 172.21.15.5:0/3819385632 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f97687bb0 con 0x560f9723a390 2024-08-31T05:41:52.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.569+0000 7f12a4fc1640 1 --2- 172.21.15.5:0/3819385632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560f9725b070 0x560f97687670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:41:52.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.569+0000 7f12a57c2640 1 --2- 172.21.15.5:0/3819385632 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f9723a390 0x560f97610770 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f129c009bf0 tx=0x7f129c004850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a77fc722cdd8f079 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:52.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.569+0000 7f1288ff9640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:41:52.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.569+0000 7f1288ff9640 1 -- 172.21.15.5:0/3819385632 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129c01e040 con 0x560f9723a390 2024-08-31T05:41:52.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.569+0000 7f1288ff9640 1 -- 172.21.15.5:0/3819385632 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9511+0+0 (secure 0 0 0) 0x7f129c004250 con 0x560f9723a390 2024-08-31T05:41:52.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.569+0000 7f12adf9b740 1 -- 172.21.15.5:0/3819385632 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1290031d80 con 0x560f9723a390 2024-08-31T05:41:52.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.569+0000 7f1288ff9640 1 -- 172.21.15.5:0/3819385632 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f129c038050 con 0x560f9723a390 2024-08-31T05:41:52.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.569+0000 7f12adf9b740 10 client.28307 fetch_fsmap learned FSMap version 34 2024-08-31T05:41:52.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.569+0000 7f12adf9b740 1 -- 172.21.15.5:0/3819385632 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x560f97688d40 con 0x560f9723a390 2024-08-31T05:41:52.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.570+0000 7f1288ff9640 1 -- 172.21.15.5:0/3819385632 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1290031d80 con 0x560f9723a390 2024-08-31T05:41:52.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.570+0000 7f1288ff9640 1 -- 172.21.15.5:0/3819385632 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f129c018070 con 0x560f9723a390 2024-08-31T05:41:52.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.570+0000 7f12adf9b740 10 client.28307 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:41:52.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.570+0000 7f12adf9b740 10 client.28307 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-31T05:41:52.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.570+0000 7f12adf9b740 20 client.28307 populate_metadata read hostname 'smithi005' 2024-08-31T05:41:52.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.570+0000 7f12adf9b740 1 --2- 172.21.15.5:0/3819385632 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x560f971eeda0 0x560f9768b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:52.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.570+0000 7f12adf9b740 4 client.28307 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:41:52.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.570+0000 7f12adf9b740 1 -- 172.21.15.5:0/3819385632 --> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560f97575070 con 0x560f971eeda0 2024-08-31T05:41:52.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.570+0000 7f12a4fc1640 1 --2- 172.21.15.5:0/3819385632 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x560f971eeda0 0x560f9768b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:52.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.570+0000 7f1288ff9640 10 client.28307 ms_handle_connect on v2:172.21.15.70:6836/2780036414 2024-08-31T05:41:52.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.571+0000 7f12a4fc1640 1 --2- 172.21.15.5:0/3819385632 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x560f971eeda0 0x560f9768b310 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4b0b2b0ae84265c1 server_cookie=cffd0b009bc9d57a in_seq=0 out_seq=0 2024-08-31T05:41:52.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.571+0000 7f1288ff9640 1 -- 172.21.15.5:0/3819385632 <== mds.2 v2:172.21.15.70:6836/2780036414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560f97575070 con 0x560f971eeda0 2024-08-31T05:41:52.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.571+0000 7f1288ff9640 10 client.28307 handle_command_reply: tid=0 2024-08-31T05:41:52.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.571+0000 7f12adf9b740 1 client.28307 shutdown 2024-08-31T05:41:52.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.571+0000 7f12adf9b740 1 -- 172.21.15.5:0/3819385632 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f9723a390 msgr2=0x560f97610770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:52.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.571+0000 7f12adf9b740 1 --2- 172.21.15.5:0/3819385632 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f9723a390 0x560f97610770 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f129c009bf0 tx=0x7f129c004850 comp rx=0 tx=0).stop 2024-08-31T05:41:52.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.571+0000 7f12adf9b740 1 -- 172.21.15.5:0/3819385632 shutdown_connections 2024-08-31T05:41:52.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.571+0000 7f12adf9b740 1 --2- 172.21.15.5:0/3819385632 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x560f971eeda0 0x560f9768b310 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:52.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.571+0000 7f12adf9b740 1 --2- 172.21.15.5:0/3819385632 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560f9725b070 0x560f97687670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:52.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.571+0000 7f12adf9b740 1 --2- 172.21.15.5:0/3819385632 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560f9723a390 0x560f97610770 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:52.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.571+0000 7f12adf9b740 1 --2- 172.21.15.5:0/3819385632 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560f972321b0 0x560f976101b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:52.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.571+0000 7f12adf9b740 1 -- 172.21.15.5:0/3819385632 >> 172.21.15.5:0/3819385632 conn(0x560f9724f460 msgr2=0x560f97601340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:52.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.571+0000 7f1288ff9640 0 client.28307 ms_handle_reset on v2:172.21.15.70:6836/2780036414 2024-08-31T05:41:52.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.571+0000 7f12adf9b740 1 -- 172.21.15.5:0/3819385632 shutdown_connections 2024-08-31T05:41:52.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.571+0000 7f12adf9b740 1 -- 172.21.15.5:0/3819385632 wait complete. 2024-08-31T05:41:52.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.571+0000 7f12adf9b740 20 client.28307 trim_cache size 0 max 16384 2024-08-31T05:41:52.579 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:41:52.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.572+0000 7f12a7a26640 1 -- 172.21.15.5:0/3806496603 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f128c0b4ca0 msgr2=0x7f128c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:52.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.572+0000 7f12a7a26640 1 --2- 172.21.15.5:0/3806496603 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f128c0b4ca0 0x7f128c0b71b0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f12980e38b0 tx=0x7f1298093040 comp rx=0 tx=0).stop 2024-08-31T05:41:52.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.572+0000 7f12a7a26640 1 -- 172.21.15.5:0/3806496603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12a0108a90 msgr2=0x7f12a019fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:52.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.572+0000 7f12a7a26640 1 --2- 172.21.15.5:0/3806496603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12a0108a90 0x7f12a019fac0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f1298009fd0 tx=0x7f129800ef10 comp rx=0 tx=0).stop 2024-08-31T05:41:52.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.572+0000 7f12a7a26640 1 -- 172.21.15.5:0/3806496603 shutdown_connections 2024-08-31T05:41:52.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.572+0000 7f12a7a26640 1 --2- 172.21.15.5:0/3806496603 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f128c0b4ca0 0x7f128c0b71b0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:52.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.572+0000 7f12a7a26640 1 --2- 172.21.15.5:0/3806496603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12a0108a90 0x7f12a019fac0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:52.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.572+0000 7f12a7a26640 1 --2- 172.21.15.5:0/3806496603 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f12a0108140 0x7f12a019a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:52.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.572+0000 7f12a7a26640 1 --2- 172.21.15.5:0/3806496603 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f12a0102800 0x7f12a019a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:52.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.572+0000 7f12a7a26640 1 -- 172.21.15.5:0/3806496603 >> 172.21.15.5:0/3806496603 conn(0x7f12a00794d0 msgr2=0x7f12a006af90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:52.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.572+0000 7f12a7a26640 1 -- 172.21.15.5:0/3806496603 shutdown_connections 2024-08-31T05:41:52.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:52.572+0000 7f12a7a26640 1 -- 172.21.15.5:0/3806496603 wait complete. 2024-08-31T05:41:52.940 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1339374 10.81 MB/sec execute 520 sec latency 15.437 ms 2024-08-31T05:41:53.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:41:52 smithi005 ceph-mon[18602]: pgmap v712: 129 pgs: 129 active+clean; 600 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.7 MiB/s wr, 216 op/s 2024-08-31T05:41:53.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:41:52 smithi070 ceph-mon[22316]: pgmap v712: 129 pgs: 129 active+clean; 600 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.7 MiB/s wr, 216 op/s 2024-08-31T05:41:53.415 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:41:52 smithi050 ceph-mon[22146]: pgmap v712: 129 pgs: 129 active+clean; 600 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.7 MiB/s wr, 216 op/s 2024-08-31T05:41:53.485 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T05:41:53.822 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:41:53.940 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1340667 10.80 MB/sec execute 521 sec latency 59.485 ms 2024-08-31T05:41:54.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.314+0000 7fb6ed6fc640 1 -- 172.21.15.5:0/4156060372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6e810db90 msgr2=0x7fb6e81100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:54.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.314+0000 7fb6ed6fc640 1 --2- 172.21.15.5:0/4156060372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6e810db90 0x7fb6e81100a0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fb6e0009900 tx=0x7fb6e002a410 comp rx=0 tx=0).stop 2024-08-31T05:41:54.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.314+0000 7fb6ed6fc640 1 -- 172.21.15.5:0/4156060372 shutdown_connections 2024-08-31T05:41:54.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.314+0000 7fb6ed6fc640 1 --2- 172.21.15.5:0/4156060372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6e810db90 0x7fb6e81100a0 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:54.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.314+0000 7fb6ed6fc640 1 --2- 172.21.15.5:0/4156060372 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6e8105010 0x7fb6e810d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:54.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.314+0000 7fb6ed6fc640 1 --2- 172.21.15.5:0/4156060372 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6e81045e0 0x7fb6e81049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:54.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.314+0000 7fb6ed6fc640 1 -- 172.21.15.5:0/4156060372 >> 172.21.15.5:0/4156060372 conn(0x7fb6e80794d0 msgr2=0x7fb6e80798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:54.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.314+0000 7fb6ed6fc640 1 -- 172.21.15.5:0/4156060372 shutdown_connections 2024-08-31T05:41:54.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.314+0000 7fb6ed6fc640 1 -- 172.21.15.5:0/4156060372 wait complete. 2024-08-31T05:41:54.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.315+0000 7fb6ed6fc640 1 Processor -- start 2024-08-31T05:41:54.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.315+0000 7fb6ed6fc640 1 -- start start 2024-08-31T05:41:54.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.316+0000 7fb6ed6fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6e81045e0 0x7fb6e81024f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:54.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.316+0000 7fb6ed6fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6e8105010 0x7fb6e8102a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:54.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.316+0000 7fb6ed6fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6e810db90 0x7fb6e8102f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:54.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.316+0000 7fb6ed6fc640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e8113830 con 0x7fb6e810db90 2024-08-31T05:41:54.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.316+0000 7fb6ed6fc640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e81136b0 con 0x7fb6e81045e0 2024-08-31T05:41:54.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.316+0000 7fb6ed6fc640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e81139b0 con 0x7fb6e8105010 2024-08-31T05:41:54.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.316+0000 7fb6e67fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6e8105010 0x7fb6e8102a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:54.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.316+0000 7fb6e6ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6e81045e0 0x7fb6e81024f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:54.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.316+0000 7fb6e77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6e810db90 0x7fb6e8102f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:54.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.316+0000 7fb6e67fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6e8105010 0x7fb6e8102a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:35284/0 (socket says 172.21.15.5:35284) 2024-08-31T05:41:54.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.316+0000 7fb6e67fc640 1 -- 172.21.15.5:0/2438276792 learned_addr learned my addr 172.21.15.5:0/2438276792 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:54.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.316+0000 7fb6e6ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6e81045e0 0x7fb6e81024f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:47170/0 (socket says 172.21.15.5:47170) 2024-08-31T05:41:54.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.316+0000 7fb6e67fc640 1 -- 172.21.15.5:0/2438276792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6e81045e0 msgr2=0x7fb6e81024f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:54.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.316+0000 7fb6e67fc640 1 --2- 172.21.15.5:0/2438276792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6e81045e0 0x7fb6e81024f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:54.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.316+0000 7fb6e67fc640 1 -- 172.21.15.5:0/2438276792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6e810db90 msgr2=0x7fb6e8102f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:54.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.316+0000 7fb6e67fc640 1 --2- 172.21.15.5:0/2438276792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6e810db90 0x7fb6e8102f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:54.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.316+0000 7fb6e67fc640 1 -- 172.21.15.5:0/2438276792 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6e81a84c0 con 0x7fb6e8105010 2024-08-31T05:41:54.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.316+0000 7fb6e6ffd640 1 --2- 172.21.15.5:0/2438276792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6e81045e0 0x7fb6e81024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:41:54.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.317+0000 7fb6e67fc640 1 --2- 172.21.15.5:0/2438276792 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6e8105010 0x7fb6e8102a30 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb6d000e970 tx=0x7fb6d000ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:54.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.317+0000 7fb6dffff640 1 -- 172.21.15.5:0/2438276792 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d000cd80 con 0x7fb6e8105010 2024-08-31T05:41:54.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.317+0000 7fb6ed6fc640 1 -- 172.21.15.5:0/2438276792 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6e81a87b0 con 0x7fb6e8105010 2024-08-31T05:41:54.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.317+0000 7fb6dffff640 1 -- 172.21.15.5:0/2438276792 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb6d00035f0 con 0x7fb6e8105010 2024-08-31T05:41:54.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.317+0000 7fb6dffff640 1 -- 172.21.15.5:0/2438276792 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d0010690 con 0x7fb6e8105010 2024-08-31T05:41:54.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.317+0000 7fb6ed6fc640 1 -- 172.21.15.5:0/2438276792 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6e81a8cf0 con 0x7fb6e8105010 2024-08-31T05:41:54.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.320+0000 7fb6f3c71740 1 Processor -- start 2024-08-31T05:41:54.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.320+0000 7fb6f3c71740 1 -- start start 2024-08-31T05:41:54.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.320+0000 7fb6dffff640 1 -- 172.21.15.5:0/2438276792 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fb6d0010830 con 0x7fb6e8105010 2024-08-31T05:41:54.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.320+0000 7fb6f3c71740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595e9b66070 0x5595e9f0b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:54.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.320+0000 7fb6f3c71740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5595e9b3d1b0 0x5595e9f0b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:54.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.320+0000 7fb6f3c71740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5595e9b45390 0x5595e9f0bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:54.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.320+0000 7fb6f3c71740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5595e9e82680 con 0x5595e9b3d1b0 2024-08-31T05:41:54.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.320+0000 7fb6f3c71740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5595e9e71c10 con 0x5595e9b45390 2024-08-31T05:41:54.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.320+0000 7fb6f3c71740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5595e9e75bc0 con 0x5595e9b66070 2024-08-31T05:41:54.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.320+0000 7fb6e6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5595e9b3d1b0 0x5595e9f0b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:54.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.320+0000 7fb6e77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595e9b66070 0x5595e9f0b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:54.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.320+0000 7fb6e6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5595e9b3d1b0 0x5595e9f0b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40506/0 (socket says 172.21.15.5:40506) 2024-08-31T05:41:54.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.320+0000 7fb6e6ffd640 1 -- 172.21.15.5:0/2655298806 learned_addr learned my addr 172.21.15.5:0/2655298806 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:54.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.320+0000 7fb6e77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595e9b66070 0x5595e9f0b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:35288/0 (socket says 172.21.15.5:35288) 2024-08-31T05:41:54.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.321+0000 7fb6e67fc640 1 --2- 172.21.15.5:0/2655298806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5595e9b45390 0x5595e9f0bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:54.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.321+0000 7fb6e6ffd640 1 -- 172.21.15.5:0/2655298806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595e9b66070 msgr2=0x5595e9f0b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:54.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.321+0000 7fb6e6ffd640 1 --2- 172.21.15.5:0/2655298806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595e9b66070 0x5595e9f0b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:54.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.321+0000 7fb6e6ffd640 1 -- 172.21.15.5:0/2655298806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5595e9b45390 msgr2=0x5595e9f0bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:54.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.321+0000 7fb6e6ffd640 1 --2- 172.21.15.5:0/2655298806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5595e9b45390 0x5595e9f0bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:54.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.321+0000 7fb6e6ffd640 1 -- 172.21.15.5:0/2655298806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595e9bd1650 con 0x5595e9b3d1b0 2024-08-31T05:41:54.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.321+0000 7fb6e77fe640 1 --2- 172.21.15.5:0/2655298806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595e9b66070 0x5595e9f0b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:41:54.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.321+0000 7fb6e6ffd640 1 --2- 172.21.15.5:0/2655298806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5595e9b3d1b0 0x5595e9f0b850 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fb6d8011810 tx=0x7fb6d8011cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e86b107c78663a07 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:54.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.321+0000 7fb6dd7fa640 1 -- 172.21.15.5:0/2655298806 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d8004d20 con 0x5595e9b3d1b0 2024-08-31T05:41:54.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.322+0000 7fb6dd7fa640 1 -- 172.21.15.5:0/2655298806 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb6d800f9a0 con 0x5595e9b3d1b0 2024-08-31T05:41:54.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.322+0000 7fb6dffff640 1 --2- 172.21.15.5:0/2438276792 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb6d40b4ca0 0x7fb6d40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:54.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.322+0000 7fb6dd7fa640 1 -- 172.21.15.5:0/2655298806 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d80043b0 con 0x5595e9b3d1b0 2024-08-31T05:41:54.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.322+0000 7fb6e77fe640 1 --2- 172.21.15.5:0/2438276792 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb6d40b4ca0 0x7fb6d40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:54.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.322+0000 7fb6dffff640 1 -- 172.21.15.5:0/2438276792 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9511+0+0 (secure 0 0 0) 0x7fb6d00e5bb0 con 0x7fb6e8105010 2024-08-31T05:41:54.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.323+0000 7fb6f3c71740 1 -- 172.21.15.5:0/2655298806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5595e9b3d1b0 msgr2=0x5595e9f0b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:54.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.323+0000 7fb6e77fe640 1 --2- 172.21.15.5:0/2438276792 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb6d40b4ca0 0x7fb6d40b71b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb6e0006010 tx=0x7fb6e00058d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:54.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.323+0000 7fb6f3c71740 1 --2- 172.21.15.5:0/2655298806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5595e9b3d1b0 0x5595e9f0b850 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fb6d8011810 tx=0x7fb6d8011cd0 comp rx=0 tx=0).stop 2024-08-31T05:41:54.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.323+0000 7fb6f3c71740 1 -- 172.21.15.5:0/2655298806 shutdown_connections 2024-08-31T05:41:54.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.323+0000 7fb6f3c71740 1 --2- 172.21.15.5:0/2655298806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5595e9b45390 0x5595e9f0bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:54.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.323+0000 7fb6f3c71740 1 --2- 172.21.15.5:0/2655298806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5595e9b3d1b0 0x5595e9f0b850 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:54.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.323+0000 7fb6f3c71740 1 --2- 172.21.15.5:0/2655298806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595e9b66070 0x5595e9f0b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:54.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.323+0000 7fb6f3c71740 1 -- 172.21.15.5:0/2655298806 >> 172.21.15.5:0/2655298806 conn(0x5595e9b5a460 msgr2=0x5595e9f09200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:54.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.323+0000 7fb6f3c71740 1 -- 172.21.15.5:0/2655298806 shutdown_connections 2024-08-31T05:41:54.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.324+0000 7fb6f3c71740 1 -- 172.21.15.5:0/2655298806 wait complete. 2024-08-31T05:41:54.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.324+0000 7fb6f3c71740 1 -- start start 2024-08-31T05:41:54.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.324+0000 7fb6f3c71740 1 Processor -- start 2024-08-31T05:41:54.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.325+0000 7fb6f3c71740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5595e9b3d1b0 0x5595e9f16a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:54.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.325+0000 7fb6f3c71740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5595e9b45390 0x5595e9f16fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:54.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.325+0000 7fb6f3c71740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595e9b66070 0x5595e9f2b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:54.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.325+0000 7fb6f3c71740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5595e9cd4700 con 0x5595e9b3d1b0 2024-08-31T05:41:54.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.325+0000 7fb6f3c71740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5595e9df8750 con 0x5595e9b45390 2024-08-31T05:41:54.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.325+0000 7fb6f3c71740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5595e9f19af0 con 0x5595e9b66070 2024-08-31T05:41:54.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.325+0000 7fb6f3c71740 10 client.0 _ll_register_callbacks cb 0x5595e9e27e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:41:54.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.325+0000 7fb6e67fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5595e9b45390 0x5595e9f16fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:54.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.325+0000 7fb6e67fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5595e9b45390 0x5595e9f16fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:47182/0 (socket says 172.21.15.5:47182) 2024-08-31T05:41:54.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.325+0000 7fb6e67fc640 1 -- 172.21.15.5:0/1068667738 learned_addr learned my addr 172.21.15.5:0/1068667738 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:54.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.325+0000 7fb6e6ffd640 1 --2- 172.21.15.5:0/1068667738 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5595e9b3d1b0 0x5595e9f16a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:54.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.325+0000 7fb6e77fe640 1 --2- 172.21.15.5:0/1068667738 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595e9b66070 0x5595e9f2b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:54.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.325+0000 7fb6e67fc640 1 -- 172.21.15.5:0/1068667738 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595e9b66070 msgr2=0x5595e9f2b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:54.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.325+0000 7fb6e67fc640 1 --2- 172.21.15.5:0/1068667738 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595e9b66070 0x5595e9f2b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:54.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.325+0000 7fb6e67fc640 1 -- 172.21.15.5:0/1068667738 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5595e9b3d1b0 msgr2=0x5595e9f16a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:54.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.325+0000 7fb6e67fc640 1 --2- 172.21.15.5:0/1068667738 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5595e9b3d1b0 0x5595e9f16a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:54.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.325+0000 7fb6e67fc640 1 -- 172.21.15.5:0/1068667738 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595e9e31900 con 0x5595e9b45390 2024-08-31T05:41:54.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.325+0000 7fb6e6ffd640 1 --2- 172.21.15.5:0/1068667738 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5595e9b3d1b0 0x5595e9f16a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:41:54.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.326+0000 7fb6e67fc640 1 --2- 172.21.15.5:0/1068667738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5595e9b45390 0x5595e9f16fc0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb6d00058c0 tx=0x7fb6d00ab630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d9419c0d5ffa1f8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:54.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.326+0000 7fb6ce7fc640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:41:54.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.326+0000 7fb6ce7fc640 1 -- 172.21.15.5:0/1068667738 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d00abec0 con 0x5595e9b45390 2024-08-31T05:41:54.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.326+0000 7fb6f3c71740 1 -- 172.21.15.5:0/1068667738 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6d800f9a0 con 0x5595e9b45390 2024-08-31T05:41:54.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.326+0000 7fb6ce7fc640 1 -- 172.21.15.5:0/1068667738 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9511+0+0 (secure 0 0 0) 0x7fb6d00b0340 con 0x5595e9b45390 2024-08-31T05:41:54.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.326+0000 7fb6ce7fc640 1 -- 172.21.15.5:0/1068667738 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fb6d00b0730 con 0x5595e9b45390 2024-08-31T05:41:54.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.326+0000 7fb6f3c71740 10 client.28319 fetch_fsmap learned FSMap version 34 2024-08-31T05:41:54.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.326+0000 7fb6f3c71740 1 -- 172.21.15.5:0/1068667738 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5595e9f2e180 con 0x5595e9b45390 2024-08-31T05:41:54.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.327+0000 7fb6ce7fc640 1 -- 172.21.15.5:0/1068667738 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb6d800f9a0 con 0x5595e9b45390 2024-08-31T05:41:54.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.327+0000 7fb6ce7fc640 1 -- 172.21.15.5:0/1068667738 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fb6d00b4d50 con 0x5595e9b45390 2024-08-31T05:41:54.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.327+0000 7fb6f3c71740 10 client.28319 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:41:54.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.327+0000 7fb6f3c71740 10 client.28319 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-31T05:41:54.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.327+0000 7fb6f3c71740 20 client.28319 populate_metadata read hostname 'smithi005' 2024-08-31T05:41:54.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.327+0000 7fb6f3c71740 1 --2- 172.21.15.5:0/1068667738 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x5595e9b249f0 0x5595e9f31600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:54.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.327+0000 7fb6f3c71740 4 client.28319 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:41:54.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.327+0000 7fb6f3c71740 1 -- 172.21.15.5:0/1068667738 --> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5595e9e845d0 con 0x5595e9b249f0 2024-08-31T05:41:54.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.327+0000 7fb6e6ffd640 1 --2- 172.21.15.5:0/1068667738 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x5595e9b249f0 0x5595e9f31600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:54.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.328+0000 7fb6ce7fc640 10 client.28319 ms_handle_connect on v2:172.21.15.50:6838/98200944 2024-08-31T05:41:54.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.328+0000 7fb6e6ffd640 1 --2- 172.21.15.5:0/1068667738 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x5595e9b249f0 0x5595e9f31600 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ebe0c3bdb326515d server_cookie=91785d20a474eda7 in_seq=0 out_seq=0 2024-08-31T05:41:54.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.328+0000 7fb6ce7fc640 1 -- 172.21.15.5:0/1068667738 <== mds.1 v2:172.21.15.50:6838/98200944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5595e9e845d0 con 0x5595e9b249f0 2024-08-31T05:41:54.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.328+0000 7fb6ce7fc640 10 client.28319 handle_command_reply: tid=0 2024-08-31T05:41:54.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.328+0000 7fb6f3c71740 1 client.28319 shutdown 2024-08-31T05:41:54.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.329+0000 7fb6f3c71740 1 -- 172.21.15.5:0/1068667738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5595e9b45390 msgr2=0x5595e9f16fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:54.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.329+0000 7fb6f3c71740 1 --2- 172.21.15.5:0/1068667738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5595e9b45390 0x5595e9f16fc0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb6d00058c0 tx=0x7fb6d00ab630 comp rx=0 tx=0).stop 2024-08-31T05:41:54.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.329+0000 7fb6f3c71740 1 -- 172.21.15.5:0/1068667738 shutdown_connections 2024-08-31T05:41:54.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.329+0000 7fb6f3c71740 1 --2- 172.21.15.5:0/1068667738 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x5595e9b249f0 0x5595e9f31600 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:54.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.329+0000 7fb6f3c71740 1 --2- 172.21.15.5:0/1068667738 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595e9b66070 0x5595e9f2b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:54.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.329+0000 7fb6f3c71740 1 --2- 172.21.15.5:0/1068667738 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5595e9b45390 0x5595e9f16fc0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:54.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.329+0000 7fb6f3c71740 1 --2- 172.21.15.5:0/1068667738 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5595e9b3d1b0 0x5595e9f16a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:54.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.329+0000 7fb6f3c71740 1 -- 172.21.15.5:0/1068667738 >> 172.21.15.5:0/1068667738 conn(0x5595e9b5a460 msgr2=0x5595e9f0e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:54.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.329+0000 7fb6ce7fc640 0 client.28319 ms_handle_reset on v2:172.21.15.50:6838/98200944 2024-08-31T05:41:54.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.329+0000 7fb6f3c71740 1 -- 172.21.15.5:0/1068667738 shutdown_connections 2024-08-31T05:41:54.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.329+0000 7fb6f3c71740 1 -- 172.21.15.5:0/1068667738 wait complete. 2024-08-31T05:41:54.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.329+0000 7fb6f3c71740 20 client.28319 trim_cache size 0 max 16384 2024-08-31T05:41:54.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.348+0000 7fb6f3c71740 1 Processor -- start 2024-08-31T05:41:54.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.355+0000 7fb6f3c71740 1 -- start start 2024-08-31T05:41:54.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.355+0000 7fb6f3c71740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5595e9b3d1b0 0x5595e9f16f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:54.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.356+0000 7fb6f3c71740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595e9b45390 0x5595e9f2b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:54.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.356+0000 7fb6f3c71740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5595e9b66070 0x5595e9f13c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:54.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.356+0000 7fb6f3c71740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e81aeaf0 con 0x5595e9b66070 2024-08-31T05:41:54.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.356+0000 7fb6f3c71740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e81b0630 con 0x5595e9b3d1b0 2024-08-31T05:41:54.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.356+0000 7fb6f3c71740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e81af1c0 con 0x5595e9b45390 2024-08-31T05:41:54.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.356+0000 7fb6e6ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5595e9b3d1b0 0x5595e9f16f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:54.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.356+0000 7fb6e6ffd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5595e9b3d1b0 0x5595e9f16f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:47198/0 (socket says 172.21.15.5:47198) 2024-08-31T05:41:54.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.356+0000 7fb6e6ffd640 1 -- 172.21.15.5:0/3726575691 learned_addr learned my addr 172.21.15.5:0/3726575691 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:54.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.356+0000 7fb6e77fe640 1 --2- 172.21.15.5:0/3726575691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5595e9b66070 0x5595e9f13c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:54.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.357+0000 7fb6e77fe640 1 -- 172.21.15.5:0/3726575691 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595e9b45390 msgr2=0x5595e9f2b570 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T05:41:54.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.357+0000 7fb6e77fe640 1 --2- 172.21.15.5:0/3726575691 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595e9b45390 0x5595e9f2b570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:54.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.357+0000 7fb6e77fe640 1 -- 172.21.15.5:0/3726575691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5595e9b3d1b0 msgr2=0x5595e9f16f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:54.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.357+0000 7fb6e77fe640 1 --2- 172.21.15.5:0/3726575691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5595e9b3d1b0 0x5595e9f16f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:54.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.357+0000 7fb6e77fe640 1 -- 172.21.15.5:0/3726575691 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595e9f0d600 con 0x5595e9b66070 2024-08-31T05:41:54.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.357+0000 7fb6e77fe640 1 --2- 172.21.15.5:0/3726575691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5595e9b66070 0x5595e9f13c70 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fb6e0005940 tx=0x7fb6e003f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5c5a5f98f146472 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:54.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.358+0000 7fb6dcff9640 1 -- 172.21.15.5:0/3726575691 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6e0035040 con 0x5595e9b66070 2024-08-31T05:41:54.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.358+0000 7fb6dcff9640 1 -- 172.21.15.5:0/3726575691 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb6e005f070 con 0x5595e9b66070 2024-08-31T05:41:54.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.358+0000 7fb6dcff9640 1 -- 172.21.15.5:0/3726575691 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6e0004b90 con 0x5595e9b66070 2024-08-31T05:41:54.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.359+0000 7fb6f3c71740 1 -- 172.21.15.5:0/3726575691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5595e9b66070 msgr2=0x5595e9f13c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:54.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.359+0000 7fb6f3c71740 1 --2- 172.21.15.5:0/3726575691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5595e9b66070 0x5595e9f13c70 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fb6e0005940 tx=0x7fb6e003f000 comp rx=0 tx=0).stop 2024-08-31T05:41:54.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.360+0000 7fb6f3c71740 1 -- 172.21.15.5:0/3726575691 shutdown_connections 2024-08-31T05:41:54.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.360+0000 7fb6f3c71740 1 --2- 172.21.15.5:0/3726575691 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5595e9b66070 0x5595e9f13c70 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:54.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.360+0000 7fb6f3c71740 1 --2- 172.21.15.5:0/3726575691 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595e9b45390 0x5595e9f2b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:54.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.360+0000 7fb6f3c71740 1 --2- 172.21.15.5:0/3726575691 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5595e9b3d1b0 0x5595e9f16f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:54.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.360+0000 7fb6f3c71740 1 -- 172.21.15.5:0/3726575691 >> 172.21.15.5:0/3726575691 conn(0x5595e9b5a460 msgr2=0x5595e9f16830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:54.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.361+0000 7fb6f3c71740 1 -- 172.21.15.5:0/3726575691 shutdown_connections 2024-08-31T05:41:54.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.367+0000 7fb6f3c71740 1 -- 172.21.15.5:0/3726575691 wait complete. 2024-08-31T05:41:54.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.367+0000 7fb6f3c71740 1 -- start start 2024-08-31T05:41:54.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.367+0000 7fb6f3c71740 1 Processor -- start 2024-08-31T05:41:54.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.368+0000 7fb6f3c71740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5595e9b3d1b0 0x5595e9f1ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:54.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.368+0000 7fb6f3c71740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5595e9b66070 0x5595e9f1b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:54.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.368+0000 7fb6f3c71740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595e9af9da0 0x5595e9f20310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:54.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.368+0000 7fb6f3c71740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e81aff60 con 0x5595e9b3d1b0 2024-08-31T05:41:54.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.368+0000 7fb6f3c71740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e81af890 con 0x5595e9b66070 2024-08-31T05:41:54.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.368+0000 7fb6f3c71740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e81acb50 con 0x5595e9af9da0 2024-08-31T05:41:54.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.368+0000 7fb6f3c71740 10 client.0 _ll_register_callbacks cb 0x7fb6d00e9210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:41:54.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.368+0000 7fb6e77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595e9af9da0 0x5595e9f20310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:54.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.368+0000 7fb6e77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595e9af9da0 0x5595e9f20310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:35324/0 (socket says 172.21.15.5:35324) 2024-08-31T05:41:54.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.368+0000 7fb6e77fe640 1 -- 172.21.15.5:0/319119627 learned_addr learned my addr 172.21.15.5:0/319119627 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:54.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.368+0000 7fb6e6ffd640 1 --2- 172.21.15.5:0/319119627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5595e9b3d1b0 0x5595e9f1ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:54.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.369+0000 7fb6e6ffd640 1 -- 172.21.15.5:0/319119627 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595e9af9da0 msgr2=0x5595e9f20310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:54.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.369+0000 7fb6e6ffd640 1 --2- 172.21.15.5:0/319119627 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595e9af9da0 0x5595e9f20310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:54.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.369+0000 7fb6e6ffd640 1 -- 172.21.15.5:0/319119627 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5595e9b66070 msgr2=0x5595e9f1b320 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T05:41:54.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.369+0000 7fb6e6ffd640 1 --2- 172.21.15.5:0/319119627 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5595e9b66070 0x5595e9f1b320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:54.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.369+0000 7fb6e6ffd640 1 -- 172.21.15.5:0/319119627 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595e9f20980 con 0x5595e9b3d1b0 2024-08-31T05:41:54.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.372+0000 7fb6e6ffd640 1 --2- 172.21.15.5:0/319119627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5595e9b3d1b0 0x5595e9f1ad60 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fb6d8014040 tx=0x7fb6d8004050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af742c852a5fae9b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:54.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.372+0000 7fb6ce7fc640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:41:54.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.372+0000 7fb6ce7fc640 1 -- 172.21.15.5:0/319119627 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d8033060 con 0x5595e9b3d1b0 2024-08-31T05:41:54.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.373+0000 7fb6ce7fc640 1 -- 172.21.15.5:0/319119627 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9511+0+0 (secure 0 0 0) 0x7fb6d8011050 con 0x5595e9b3d1b0 2024-08-31T05:41:54.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.373+0000 7fb6f3c71740 1 -- 172.21.15.5:0/319119627 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6e005f070 con 0x5595e9b3d1b0 2024-08-31T05:41:54.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.373+0000 7fb6ce7fc640 1 -- 172.21.15.5:0/319119627 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fb6d803a050 con 0x5595e9b3d1b0 2024-08-31T05:41:54.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.373+0000 7fb6f3c71740 10 client.18762 fetch_fsmap learned FSMap version 34 2024-08-31T05:41:54.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.373+0000 7fb6f3c71740 1 -- 172.21.15.5:0/319119627 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5595e9f27d70 con 0x5595e9b3d1b0 2024-08-31T05:41:54.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.374+0000 7fb6ce7fc640 1 -- 172.21.15.5:0/319119627 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb6e005f070 con 0x5595e9b3d1b0 2024-08-31T05:41:54.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.374+0000 7fb6ce7fc640 1 -- 172.21.15.5:0/319119627 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fb6d8024040 con 0x5595e9b3d1b0 2024-08-31T05:41:54.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.374+0000 7fb6f3c71740 10 client.18762 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:41:54.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.374+0000 7fb6f3c71740 10 client.18762 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-31T05:41:54.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.374+0000 7fb6f3c71740 20 client.18762 populate_metadata read hostname 'smithi005' 2024-08-31T05:41:54.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.374+0000 7fb6f3c71740 1 --2- 172.21.15.5:0/319119627 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x5595e9f93f80 0x5595e9f963a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:54.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.374+0000 7fb6f3c71740 4 client.18762 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:41:54.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.374+0000 7fb6f3c71740 1 -- 172.21.15.5:0/319119627 --> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5595e9e80070 con 0x5595e9f93f80 2024-08-31T05:41:54.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.378+0000 7fb6e67fc640 1 --2- 172.21.15.5:0/319119627 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x5595e9f93f80 0x5595e9f963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:54.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.384+0000 7fb6e67fc640 1 --2- 172.21.15.5:0/319119627 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x5595e9f93f80 0x5595e9f963a0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=66628f6887e19ef9 server_cookie=f04227ddcd89e8c1 in_seq=0 out_seq=0 2024-08-31T05:41:54.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.385+0000 7fb6ce7fc640 10 client.18762 ms_handle_connect on v2:172.21.15.50:6838/98200944 2024-08-31T05:41:54.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.385+0000 7fb6ce7fc640 1 -- 172.21.15.5:0/319119627 <== mds.1 v2:172.21.15.50:6838/98200944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5595e9e80070 con 0x5595e9f93f80 2024-08-31T05:41:54.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.385+0000 7fb6ce7fc640 10 client.18762 handle_command_reply: tid=0 2024-08-31T05:41:54.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.385+0000 7fb6f3c71740 1 client.18762 shutdown 2024-08-31T05:41:54.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.386+0000 7fb6f3c71740 1 -- 172.21.15.5:0/319119627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5595e9b3d1b0 msgr2=0x5595e9f1ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:54.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.386+0000 7fb6f3c71740 1 --2- 172.21.15.5:0/319119627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5595e9b3d1b0 0x5595e9f1ad60 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fb6d8014040 tx=0x7fb6d8004050 comp rx=0 tx=0).stop 2024-08-31T05:41:54.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.387+0000 7fb6f3c71740 1 -- 172.21.15.5:0/319119627 shutdown_connections 2024-08-31T05:41:54.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.387+0000 7fb6f3c71740 1 --2- 172.21.15.5:0/319119627 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x5595e9f93f80 0x5595e9f963a0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:54.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.387+0000 7fb6f3c71740 1 --2- 172.21.15.5:0/319119627 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5595e9af9da0 0x5595e9f20310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:54.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.387+0000 7fb6f3c71740 1 --2- 172.21.15.5:0/319119627 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5595e9b66070 0x5595e9f1b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:54.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.387+0000 7fb6ce7fc640 0 client.18762 ms_handle_reset on v2:172.21.15.50:6838/98200944 2024-08-31T05:41:54.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.387+0000 7fb6f3c71740 1 --2- 172.21.15.5:0/319119627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5595e9b3d1b0 0x5595e9f1ad60 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:54.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.387+0000 7fb6f3c71740 1 -- 172.21.15.5:0/319119627 >> 172.21.15.5:0/319119627 conn(0x5595e9b5a460 msgr2=0x5595e9f0c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:54.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.387+0000 7fb6f3c71740 1 -- 172.21.15.5:0/319119627 shutdown_connections 2024-08-31T05:41:54.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.387+0000 7fb6f3c71740 1 -- 172.21.15.5:0/319119627 wait complete. 2024-08-31T05:41:54.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.387+0000 7fb6f3c71740 20 client.18762 trim_cache size 0 max 16384 2024-08-31T05:41:54.392 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:41:54.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.389+0000 7fb6ed6fc640 1 -- 172.21.15.5:0/2438276792 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb6d40b4ca0 msgr2=0x7fb6d40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:54.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.389+0000 7fb6ed6fc640 1 --2- 172.21.15.5:0/2438276792 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb6d40b4ca0 0x7fb6d40b71b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb6e0006010 tx=0x7fb6e00058d0 comp rx=0 tx=0).stop 2024-08-31T05:41:54.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.389+0000 7fb6ed6fc640 1 -- 172.21.15.5:0/2438276792 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6e8105010 msgr2=0x7fb6e8102a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:54.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.389+0000 7fb6ed6fc640 1 --2- 172.21.15.5:0/2438276792 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6e8105010 0x7fb6e8102a30 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb6d000e970 tx=0x7fb6d000ee30 comp rx=0 tx=0).stop 2024-08-31T05:41:54.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.389+0000 7fb6ed6fc640 1 -- 172.21.15.5:0/2438276792 shutdown_connections 2024-08-31T05:41:54.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.389+0000 7fb6ed6fc640 1 --2- 172.21.15.5:0/2438276792 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb6d40b4ca0 0x7fb6d40b71b0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:54.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.389+0000 7fb6ed6fc640 1 --2- 172.21.15.5:0/2438276792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6e810db90 0x7fb6e8102f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:54.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.389+0000 7fb6ed6fc640 1 --2- 172.21.15.5:0/2438276792 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6e8105010 0x7fb6e8102a30 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:54.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.389+0000 7fb6ed6fc640 1 --2- 172.21.15.5:0/2438276792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb6e81045e0 0x7fb6e81024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:54.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.389+0000 7fb6ed6fc640 1 -- 172.21.15.5:0/2438276792 >> 172.21.15.5:0/2438276792 conn(0x7fb6e80794d0 msgr2=0x7fb6e80ff2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:54.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.389+0000 7fb6ed6fc640 1 -- 172.21.15.5:0/2438276792 shutdown_connections 2024-08-31T05:41:54.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:54.389+0000 7fb6ed6fc640 1 -- 172.21.15.5:0/2438276792 wait complete. 2024-08-31T05:41:54.940 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1342724 10.80 MB/sec execute 522 sec latency 32.238 ms 2024-08-31T05:41:55.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:41:54 smithi005 ceph-mon[18602]: pgmap v713: 129 pgs: 129 active+clean; 599 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.5 MiB/s wr, 207 op/s 2024-08-31T05:41:55.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:41:54 smithi070 ceph-mon[22316]: pgmap v713: 129 pgs: 129 active+clean; 599 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.5 MiB/s wr, 207 op/s 2024-08-31T05:41:55.391 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T05:41:55.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:41:54 smithi050 ceph-mon[22146]: pgmap v713: 129 pgs: 129 active+clean; 599 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.5 MiB/s wr, 207 op/s 2024-08-31T05:41:55.725 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:41:55.940 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1344222 10.79 MB/sec execute 523 sec latency 30.217 ms 2024-08-31T05:41:56.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.254+0000 7fb23e591640 1 -- 172.21.15.5:0/89664978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2381050a0 msgr2=0x7fb23810d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:56.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.254+0000 7fb23e591640 1 --2- 172.21.15.5:0/89664978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2381050a0 0x7fb23810d5f0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fb22c009900 tx=0x7fb22c02a410 comp rx=0 tx=0).stop 2024-08-31T05:41:56.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.254+0000 7fb23e591640 1 -- 172.21.15.5:0/89664978 shutdown_connections 2024-08-31T05:41:56.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.254+0000 7fb23e591640 1 --2- 172.21.15.5:0/89664978 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb23810dbb0 0x7fb2381100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:56.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.255+0000 7fb23e591640 1 --2- 172.21.15.5:0/89664978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2381050a0 0x7fb23810d5f0 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:56.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.255+0000 7fb23e591640 1 --2- 172.21.15.5:0/89664978 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb238104750 0x7fb238104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:56.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.255+0000 7fb23e591640 1 -- 172.21.15.5:0/89664978 >> 172.21.15.5:0/89664978 conn(0x7fb2380794d0 msgr2=0x7fb2380798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:56.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.255+0000 7fb23e591640 1 -- 172.21.15.5:0/89664978 shutdown_connections 2024-08-31T05:41:56.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.255+0000 7fb23e591640 1 -- 172.21.15.5:0/89664978 wait complete. 2024-08-31T05:41:56.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.255+0000 7fb23e591640 1 Processor -- start 2024-08-31T05:41:56.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.256+0000 7fb23e591640 1 -- start start 2024-08-31T05:41:56.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.256+0000 7fb23e591640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb238104750 0x7fb23819a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:56.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.256+0000 7fb23e591640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2381050a0 0x7fb23819a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:56.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.256+0000 7fb23e591640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb23810dbb0 0x7fb23819faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:56.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.256+0000 7fb23e591640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb2381137f0 con 0x7fb2381050a0 2024-08-31T05:41:56.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.256+0000 7fb23e591640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb238113670 con 0x7fb23810dbb0 2024-08-31T05:41:56.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.256+0000 7fb23e591640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb238113970 con 0x7fb238104750 2024-08-31T05:41:56.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.256+0000 7fb2377fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2381050a0 0x7fb23819a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:56.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.256+0000 7fb237fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb238104750 0x7fb23819a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:56.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.256+0000 7fb2377fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2381050a0 0x7fb23819a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40548/0 (socket says 172.21.15.5:40548) 2024-08-31T05:41:56.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.256+0000 7fb237fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb238104750 0x7fb23819a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:35338/0 (socket says 172.21.15.5:35338) 2024-08-31T05:41:56.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.256+0000 7fb2377fe640 1 -- 172.21.15.5:0/1650193819 learned_addr learned my addr 172.21.15.5:0/1650193819 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:56.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.256+0000 7fb23cb2e640 1 --2- 172.21.15.5:0/1650193819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb23810dbb0 0x7fb23819faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:56.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.257+0000 7fb237fff640 1 -- 172.21.15.5:0/1650193819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb23810dbb0 msgr2=0x7fb23819faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:56.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.257+0000 7fb237fff640 1 --2- 172.21.15.5:0/1650193819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb23810dbb0 0x7fb23819faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:56.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.257+0000 7fb237fff640 1 -- 172.21.15.5:0/1650193819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2381050a0 msgr2=0x7fb23819a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:56.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.257+0000 7fb237fff640 1 --2- 172.21.15.5:0/1650193819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2381050a0 0x7fb23819a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:56.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.257+0000 7fb237fff640 1 -- 172.21.15.5:0/1650193819 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2381a01d0 con 0x7fb238104750 2024-08-31T05:41:56.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.257+0000 7fb23cb2e640 1 --2- 172.21.15.5:0/1650193819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb23810dbb0 0x7fb23819faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:41:56.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.257+0000 7fb237fff640 1 --2- 172.21.15.5:0/1650193819 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb238104750 0x7fb23819a260 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb22800e9c0 tx=0x7fb22800ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:56.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.257+0000 7fb2357fa640 1 -- 172.21.15.5:0/1650193819 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb22800ccc0 con 0x7fb238104750 2024-08-31T05:41:56.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.257+0000 7fb23e591640 1 -- 172.21.15.5:0/1650193819 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2381a04c0 con 0x7fb238104750 2024-08-31T05:41:56.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.257+0000 7fb23e591640 1 -- 172.21.15.5:0/1650193819 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2381a6c20 con 0x7fb238104750 2024-08-31T05:41:56.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.257+0000 7fb2357fa640 1 -- 172.21.15.5:0/1650193819 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2280035f0 con 0x7fb238104750 2024-08-31T05:41:56.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.257+0000 7fb2357fa640 1 -- 172.21.15.5:0/1650193819 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb22800ce60 con 0x7fb238104750 2024-08-31T05:41:56.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.260+0000 7fb244b06740 1 Processor -- start 2024-08-31T05:41:56.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.260+0000 7fb244b06740 1 -- start start 2024-08-31T05:41:56.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.261+0000 7fb244b06740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a7c78d7070 0x55a7c7c7c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:56.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.261+0000 7fb244b06740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7c78ae1b0 0x55a7c7c7c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:56.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.261+0000 7fb244b06740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7c78b6390 0x55a7c7c7cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:56.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.261+0000 7fb244b06740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55a7c7bf3680 con 0x55a7c78b6390 2024-08-31T05:41:56.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.261+0000 7fb244b06740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a7c7be2c10 con 0x55a7c78ae1b0 2024-08-31T05:41:56.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.261+0000 7fb244b06740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a7c7be6bc0 con 0x55a7c78d7070 2024-08-31T05:41:56.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.261+0000 7fb2377fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7c78b6390 0x55a7c7c7cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:56.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.261+0000 7fb2357fa640 1 -- 172.21.15.5:0/1650193819 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fb228010690 con 0x7fb238104750 2024-08-31T05:41:56.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.261+0000 7fb2377fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7c78b6390 0x55a7c7c7cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40564/0 (socket says 172.21.15.5:40564) 2024-08-31T05:41:56.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.261+0000 7fb2377fe640 1 -- 172.21.15.5:0/857339068 learned_addr learned my addr 172.21.15.5:0/857339068 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:56.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.261+0000 7fb23cb2e640 1 --2- 172.21.15.5:0/857339068 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a7c78d7070 0x55a7c7c7c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:56.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.261+0000 7fb237fff640 1 --2- 172.21.15.5:0/857339068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7c78ae1b0 0x55a7c7c7c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:56.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.261+0000 7fb2377fe640 1 -- 172.21.15.5:0/857339068 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a7c78d7070 msgr2=0x55a7c7c7c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:56.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.261+0000 7fb2377fe640 1 --2- 172.21.15.5:0/857339068 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a7c78d7070 0x55a7c7c7c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:56.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.261+0000 7fb2377fe640 1 -- 172.21.15.5:0/857339068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7c78ae1b0 msgr2=0x55a7c7c7c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:56.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.261+0000 7fb2377fe640 1 --2- 172.21.15.5:0/857339068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7c78ae1b0 0x55a7c7c7c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:56.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.261+0000 7fb2377fe640 1 -- 172.21.15.5:0/857339068 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7c7942650 con 0x55a7c78b6390 2024-08-31T05:41:56.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.262+0000 7fb2377fe640 1 --2- 172.21.15.5:0/857339068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7c78b6390 0x55a7c7c7cd90 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fb22c009230 tx=0x7fb22c031b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5e2b78217735956 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:56.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.262+0000 7fb21e7fc640 1 -- 172.21.15.5:0/857339068 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb22c040070 con 0x55a7c78b6390 2024-08-31T05:41:56.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.262+0000 7fb21e7fc640 1 -- 172.21.15.5:0/857339068 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb22c004030 con 0x55a7c78b6390 2024-08-31T05:41:56.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.262+0000 7fb21e7fc640 1 -- 172.21.15.5:0/857339068 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb22c035040 con 0x55a7c78b6390 2024-08-31T05:41:56.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.262+0000 7fb2357fa640 1 --2- 172.21.15.5:0/1650193819 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb2200b4d20 0x7fb2200b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:56.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.262+0000 7fb23cb2e640 1 --2- 172.21.15.5:0/1650193819 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb2200b4d20 0x7fb2200b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:56.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.262+0000 7fb2357fa640 1 -- 172.21.15.5:0/1650193819 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9511+0+0 (secure 0 0 0) 0x7fb2280e5b80 con 0x7fb238104750 2024-08-31T05:41:56.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.263+0000 7fb244b06740 1 -- 172.21.15.5:0/857339068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7c78b6390 msgr2=0x55a7c7c7cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:56.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.263+0000 7fb23cb2e640 1 --2- 172.21.15.5:0/1650193819 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb2200b4d20 0x7fb2200b7230 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb230009fd0 tx=0x7fb230009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:56.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.263+0000 7fb244b06740 1 --2- 172.21.15.5:0/857339068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7c78b6390 0x55a7c7c7cd90 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fb22c009230 tx=0x7fb22c031b10 comp rx=0 tx=0).stop 2024-08-31T05:41:56.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.263+0000 7fb244b06740 1 -- 172.21.15.5:0/857339068 shutdown_connections 2024-08-31T05:41:56.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.263+0000 7fb244b06740 1 --2- 172.21.15.5:0/857339068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7c78b6390 0x55a7c7c7cd90 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:56.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.263+0000 7fb244b06740 1 --2- 172.21.15.5:0/857339068 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7c78ae1b0 0x55a7c7c7c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:56.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.263+0000 7fb244b06740 1 --2- 172.21.15.5:0/857339068 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a7c78d7070 0x55a7c7c7c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:56.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.263+0000 7fb244b06740 1 -- 172.21.15.5:0/857339068 >> 172.21.15.5:0/857339068 conn(0x55a7c78cb460 msgr2=0x55a7c7c7a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:56.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.263+0000 7fb244b06740 1 -- 172.21.15.5:0/857339068 shutdown_connections 2024-08-31T05:41:56.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.263+0000 7fb244b06740 1 -- 172.21.15.5:0/857339068 wait complete. 2024-08-31T05:41:56.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.263+0000 7fb244b06740 1 -- start start 2024-08-31T05:41:56.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.264+0000 7fb244b06740 1 Processor -- start 2024-08-31T05:41:56.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.264+0000 7fb244b06740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7c78ae1b0 0x55a7c7c879b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:56.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.264+0000 7fb244b06740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a7c78b6390 0x55a7c7c87ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:56.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.264+0000 7fb244b06740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7c78d7070 0x55a7c7c88470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:56.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.264+0000 7fb244b06740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55a7c7a45700 con 0x55a7c78ae1b0 2024-08-31T05:41:56.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.264+0000 7fb244b06740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a7c7b69750 con 0x55a7c78d7070 2024-08-31T05:41:56.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.264+0000 7fb244b06740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a7c7c8aa90 con 0x55a7c78b6390 2024-08-31T05:41:56.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.264+0000 7fb244b06740 10 client.0 _ll_register_callbacks cb 0x55a7c7b98e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:41:56.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.264+0000 7fb237fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7c78ae1b0 0x55a7c7c879b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:56.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.264+0000 7fb2377fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a7c78b6390 0x55a7c7c87ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:56.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.264+0000 7fb237fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7c78ae1b0 0x55a7c7c879b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40574/0 (socket says 172.21.15.5:40574) 2024-08-31T05:41:56.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.264+0000 7fb237fff640 1 -- 172.21.15.5:0/4141428423 learned_addr learned my addr 172.21.15.5:0/4141428423 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:56.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.264+0000 7fb23cb2e640 1 --2- 172.21.15.5:0/4141428423 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7c78d7070 0x55a7c7c88470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:56.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.264+0000 7fb237fff640 1 -- 172.21.15.5:0/4141428423 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a7c78b6390 msgr2=0x55a7c7c87ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:56.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.264+0000 7fb237fff640 1 --2- 172.21.15.5:0/4141428423 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a7c78b6390 0x55a7c7c87ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:56.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.264+0000 7fb237fff640 1 -- 172.21.15.5:0/4141428423 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7c78d7070 msgr2=0x55a7c7c88470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:56.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.264+0000 7fb237fff640 1 --2- 172.21.15.5:0/4141428423 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7c78d7070 0x55a7c7c88470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:56.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.264+0000 7fb237fff640 1 -- 172.21.15.5:0/4141428423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7c7ba2900 con 0x55a7c78ae1b0 2024-08-31T05:41:56.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.265+0000 7fb237fff640 1 --2- 172.21.15.5:0/4141428423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7c78ae1b0 0x55a7c7c879b0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fb22800c6a0 tx=0x7fb2280ab660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1868a9569ce89131 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:56.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.265+0000 7fb2177fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:41:56.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.265+0000 7fb2177fe640 1 -- 172.21.15.5:0/4141428423 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb228003cb0 con 0x55a7c78ae1b0 2024-08-31T05:41:56.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.265+0000 7fb2177fe640 1 -- 172.21.15.5:0/4141428423 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9511+0+0 (secure 0 0 0) 0x7fb2280a8420 con 0x55a7c78ae1b0 2024-08-31T05:41:56.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.265+0000 7fb244b06740 1 -- 172.21.15.5:0/4141428423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb22c004030 con 0x55a7c78ae1b0 2024-08-31T05:41:56.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.265+0000 7fb2177fe640 1 -- 172.21.15.5:0/4141428423 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fb2280b06a0 con 0x55a7c78ae1b0 2024-08-31T05:41:56.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.265+0000 7fb244b06740 10 client.18774 fetch_fsmap learned FSMap version 34 2024-08-31T05:41:56.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.265+0000 7fb244b06740 1 -- 172.21.15.5:0/4141428423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a7c7c967c0 con 0x55a7c78ae1b0 2024-08-31T05:41:56.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.265+0000 7fb2177fe640 1 -- 172.21.15.5:0/4141428423 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb22c004030 con 0x55a7c78ae1b0 2024-08-31T05:41:56.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.265+0000 7fb2177fe640 1 -- 172.21.15.5:0/4141428423 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fb2280e3110 con 0x55a7c78ae1b0 2024-08-31T05:41:56.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.265+0000 7fb244b06740 10 client.18774 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:41:56.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.265+0000 7fb244b06740 10 client.18774 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:41:56.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.265+0000 7fb244b06740 20 client.18774 populate_metadata read hostname 'smithi005' 2024-08-31T05:41:56.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.265+0000 7fb244b06740 1 --2- 172.21.15.5:0/4141428423 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a7c78959f0 0x55a7c7c99c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:56.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.265+0000 7fb244b06740 4 client.18774 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:41:56.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.265+0000 7fb244b06740 1 -- 172.21.15.5:0/4141428423 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a7c7bf55d0 con 0x55a7c78959f0 2024-08-31T05:41:56.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.266+0000 7fb2377fe640 1 --2- 172.21.15.5:0/4141428423 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a7c78959f0 0x55a7c7c99c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:56.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.266+0000 7fb2177fe640 10 client.18774 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:41:56.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.266+0000 7fb2377fe640 1 --2- 172.21.15.5:0/4141428423 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a7c78959f0 0x55a7c7c99c90 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5e9227f020e5135 server_cookie=d9ac1191f8bebd5 in_seq=0 out_seq=0 2024-08-31T05:41:56.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.267+0000 7fb2177fe640 1 -- 172.21.15.5:0/4141428423 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a7c7bf55d0 con 0x55a7c78959f0 2024-08-31T05:41:56.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.267+0000 7fb2177fe640 10 client.18774 handle_command_reply: tid=0 2024-08-31T05:41:56.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.267+0000 7fb244b06740 1 client.18774 shutdown 2024-08-31T05:41:56.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.267+0000 7fb244b06740 1 -- 172.21.15.5:0/4141428423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7c78ae1b0 msgr2=0x55a7c7c879b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:56.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.267+0000 7fb244b06740 1 --2- 172.21.15.5:0/4141428423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7c78ae1b0 0x55a7c7c879b0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fb22800c6a0 tx=0x7fb2280ab660 comp rx=0 tx=0).stop 2024-08-31T05:41:56.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.267+0000 7fb244b06740 1 -- 172.21.15.5:0/4141428423 shutdown_connections 2024-08-31T05:41:56.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.267+0000 7fb244b06740 1 --2- 172.21.15.5:0/4141428423 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a7c78959f0 0x55a7c7c99c90 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:56.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.267+0000 7fb244b06740 1 --2- 172.21.15.5:0/4141428423 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7c78d7070 0x55a7c7c88470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:56.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.267+0000 7fb244b06740 1 --2- 172.21.15.5:0/4141428423 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a7c78b6390 0x55a7c7c87ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:56.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.267+0000 7fb244b06740 1 --2- 172.21.15.5:0/4141428423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7c78ae1b0 0x55a7c7c879b0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:56.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.267+0000 7fb244b06740 1 -- 172.21.15.5:0/4141428423 >> 172.21.15.5:0/4141428423 conn(0x55a7c78cb460 msgr2=0x55a7c7c7f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:56.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.267+0000 7fb2177fe640 0 client.18774 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:41:56.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.267+0000 7fb244b06740 1 -- 172.21.15.5:0/4141428423 shutdown_connections 2024-08-31T05:41:56.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.267+0000 7fb244b06740 1 -- 172.21.15.5:0/4141428423 wait complete. 2024-08-31T05:41:56.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.268+0000 7fb244b06740 20 client.18774 trim_cache size 0 max 16384 2024-08-31T05:41:56.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.283+0000 7fb244b06740 1 Processor -- start 2024-08-31T05:41:56.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.283+0000 7fb244b06740 1 -- start start 2024-08-31T05:41:56.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.283+0000 7fb244b06740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7c78ae1b0 0x55a7c7c797d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:56.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.283+0000 7fb244b06740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a7c78b6390 0x55a7c7c79d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:56.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.283+0000 7fb244b06740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7c78d7070 0x55a7c7c84ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:56.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.283+0000 7fb244b06740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb224010010 con 0x55a7c78ae1b0 2024-08-31T05:41:56.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.283+0000 7fb244b06740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb224011b50 con 0x55a7c78d7070 2024-08-31T05:41:56.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.283+0000 7fb244b06740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb2240106e0 con 0x55a7c78b6390 2024-08-31T05:41:56.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.283+0000 7fb237fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7c78ae1b0 0x55a7c7c797d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:56.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.283+0000 7fb2377fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a7c78b6390 0x55a7c7c79d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:56.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.283+0000 7fb237fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7c78ae1b0 0x55a7c7c797d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40590/0 (socket says 172.21.15.5:40590) 2024-08-31T05:41:56.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.283+0000 7fb237fff640 1 -- 172.21.15.5:0/1378184981 learned_addr learned my addr 172.21.15.5:0/1378184981 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:56.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.283+0000 7fb23cb2e640 1 --2- 172.21.15.5:0/1378184981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7c78d7070 0x55a7c7c84ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:56.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.284+0000 7fb2377fe640 1 -- 172.21.15.5:0/1378184981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7c78d7070 msgr2=0x55a7c7c84ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:56.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.284+0000 7fb2377fe640 1 --2- 172.21.15.5:0/1378184981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7c78d7070 0x55a7c7c84ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:56.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.284+0000 7fb2377fe640 1 -- 172.21.15.5:0/1378184981 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7c78ae1b0 msgr2=0x55a7c7c797d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:56.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.284+0000 7fb2377fe640 1 --2- 172.21.15.5:0/1378184981 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7c78ae1b0 0x55a7c7c797d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:56.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.284+0000 7fb2377fe640 1 -- 172.21.15.5:0/1378184981 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7c7c88a50 con 0x55a7c78b6390 2024-08-31T05:41:56.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.284+0000 7fb237fff640 1 --2- 172.21.15.5:0/1378184981 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7c78ae1b0 0x55a7c7c797d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:41:56.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.284+0000 7fb2377fe640 1 --2- 172.21.15.5:0/1378184981 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a7c78b6390 0x55a7c7c79d10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb22c0052a0 tx=0x7fb22c0051a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8df5a8b03e573008 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:56.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.284+0000 7fb21dffb640 1 -- 172.21.15.5:0/1378184981 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb22c040040 con 0x55a7c78b6390 2024-08-31T05:41:56.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.284+0000 7fb21dffb640 1 -- 172.21.15.5:0/1378184981 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb22c031950 con 0x55a7c78b6390 2024-08-31T05:41:56.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.284+0000 7fb21dffb640 1 -- 172.21.15.5:0/1378184981 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb22c035040 con 0x55a7c78b6390 2024-08-31T05:41:56.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.285+0000 7fb244b06740 1 -- 172.21.15.5:0/1378184981 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a7c78b6390 msgr2=0x55a7c7c79d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:56.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.285+0000 7fb244b06740 1 --2- 172.21.15.5:0/1378184981 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a7c78b6390 0x55a7c7c79d10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb22c0052a0 tx=0x7fb22c0051a0 comp rx=0 tx=0).stop 2024-08-31T05:41:56.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.285+0000 7fb244b06740 1 -- 172.21.15.5:0/1378184981 shutdown_connections 2024-08-31T05:41:56.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.285+0000 7fb244b06740 1 --2- 172.21.15.5:0/1378184981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7c78d7070 0x55a7c7c84ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:56.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.285+0000 7fb244b06740 1 --2- 172.21.15.5:0/1378184981 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a7c78b6390 0x55a7c7c79d10 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:56.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.285+0000 7fb244b06740 1 --2- 172.21.15.5:0/1378184981 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7c78ae1b0 0x55a7c7c797d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:56.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.285+0000 7fb244b06740 1 -- 172.21.15.5:0/1378184981 >> 172.21.15.5:0/1378184981 conn(0x55a7c78cb460 msgr2=0x55a7c7c86230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:56.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.285+0000 7fb244b06740 1 -- 172.21.15.5:0/1378184981 shutdown_connections 2024-08-31T05:41:56.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.285+0000 7fb244b06740 1 -- 172.21.15.5:0/1378184981 wait complete. 2024-08-31T05:41:56.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.286+0000 7fb244b06740 1 -- start start 2024-08-31T05:41:56.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.286+0000 7fb244b06740 1 Processor -- start 2024-08-31T05:41:56.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.286+0000 7fb244b06740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7c78ae1b0 0x55a7c7c8bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:56.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.286+0000 7fb244b06740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a7c78b6390 0x55a7c7c8c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:56.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.286+0000 7fb244b06740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7c78d7070 0x55a7c7c8c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:56.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.287+0000 7fb244b06740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb224011480 con 0x55a7c78d7070 2024-08-31T05:41:56.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.287+0000 7fb244b06740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb224010db0 con 0x55a7c78ae1b0 2024-08-31T05:41:56.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.287+0000 7fb244b06740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb22400e010 con 0x55a7c78b6390 2024-08-31T05:41:56.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.287+0000 7fb244b06740 10 client.0 _ll_register_callbacks cb 0x7fb2280046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:41:56.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.287+0000 7fb237fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7c78ae1b0 0x55a7c7c8bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:56.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.287+0000 7fb237fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7c78ae1b0 0x55a7c7c8bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:47220/0 (socket says 172.21.15.5:47220) 2024-08-31T05:41:56.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.287+0000 7fb237fff640 1 -- 172.21.15.5:0/170142583 learned_addr learned my addr 172.21.15.5:0/170142583 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:56.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.287+0000 7fb2377fe640 1 --2- 172.21.15.5:0/170142583 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a7c78b6390 0x55a7c7c8c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:56.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.287+0000 7fb23cb2e640 1 --2- 172.21.15.5:0/170142583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7c78d7070 0x55a7c7c8c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:56.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.287+0000 7fb237fff640 1 -- 172.21.15.5:0/170142583 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a7c78b6390 msgr2=0x55a7c7c8c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:56.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.287+0000 7fb237fff640 1 --2- 172.21.15.5:0/170142583 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a7c78b6390 0x55a7c7c8c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:56.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.287+0000 7fb237fff640 1 -- 172.21.15.5:0/170142583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7c78d7070 msgr2=0x55a7c7c8c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:56.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.287+0000 7fb237fff640 1 --2- 172.21.15.5:0/170142583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7c78d7070 0x55a7c7c8c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:56.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.287+0000 7fb237fff640 1 -- 172.21.15.5:0/170142583 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7c7d03890 con 0x55a7c78ae1b0 2024-08-31T05:41:56.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.287+0000 7fb237fff640 1 --2- 172.21.15.5:0/170142583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7c78ae1b0 0x55a7c7c8bf10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb22800c6a0 tx=0x7fb2280e33c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2a4fc3970c5ce17 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:56.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.287+0000 7fb2177fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:41:56.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.287+0000 7fb2177fe640 1 -- 172.21.15.5:0/170142583 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb228003cb0 con 0x55a7c78ae1b0 2024-08-31T05:41:56.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.287+0000 7fb2177fe640 1 -- 172.21.15.5:0/170142583 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9511+0+0 (secure 0 0 0) 0x7fb2280eb040 con 0x55a7c78ae1b0 2024-08-31T05:41:56.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.287+0000 7fb244b06740 1 -- 172.21.15.5:0/170142583 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a7c7bf1070 con 0x55a7c78ae1b0 2024-08-31T05:41:56.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.288+0000 7fb2177fe640 1 -- 172.21.15.5:0/170142583 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fb228003fd0 con 0x55a7c78ae1b0 2024-08-31T05:41:56.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.288+0000 7fb244b06740 10 client.28340 fetch_fsmap learned FSMap version 34 2024-08-31T05:41:56.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.288+0000 7fb244b06740 1 -- 172.21.15.5:0/170142583 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a7c7d04ad0 con 0x55a7c78ae1b0 2024-08-31T05:41:56.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.288+0000 7fb2177fe640 1 -- 172.21.15.5:0/170142583 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55a7c7bf1070 con 0x55a7c78ae1b0 2024-08-31T05:41:56.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.288+0000 7fb2177fe640 1 -- 172.21.15.5:0/170142583 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fb2280c6be0 con 0x55a7c78ae1b0 2024-08-31T05:41:56.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.288+0000 7fb244b06740 10 client.28340 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:41:56.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.288+0000 7fb244b06740 10 client.28340 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:41:56.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.288+0000 7fb244b06740 20 client.28340 populate_metadata read hostname 'smithi005' 2024-08-31T05:41:56.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.288+0000 7fb244b06740 1 --2- 172.21.15.5:0/170142583 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a7c786ada0 0x55a7c7d07270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:56.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.288+0000 7fb244b06740 4 client.28340 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:41:56.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.288+0000 7fb244b06740 1 -- 172.21.15.5:0/170142583 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a7c7bee7b0 con 0x55a7c786ada0 2024-08-31T05:41:56.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.288+0000 7fb2377fe640 1 --2- 172.21.15.5:0/170142583 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a7c786ada0 0x55a7c7d07270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:56.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.289+0000 7fb2377fe640 1 --2- 172.21.15.5:0/170142583 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a7c786ada0 0x55a7c7d07270 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=529c438457b9ad23 server_cookie=a56ce70a8bb7df69 in_seq=0 out_seq=0 2024-08-31T05:41:56.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.289+0000 7fb2177fe640 10 client.28340 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:41:56.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.289+0000 7fb2177fe640 1 -- 172.21.15.5:0/170142583 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a7c7bee7b0 con 0x55a7c786ada0 2024-08-31T05:41:56.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.289+0000 7fb2177fe640 10 client.28340 handle_command_reply: tid=0 2024-08-31T05:41:56.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.289+0000 7fb244b06740 1 client.28340 shutdown 2024-08-31T05:41:56.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.289+0000 7fb244b06740 1 -- 172.21.15.5:0/170142583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7c78ae1b0 msgr2=0x55a7c7c8bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:56.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.289+0000 7fb244b06740 1 --2- 172.21.15.5:0/170142583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7c78ae1b0 0x55a7c7c8bf10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb22800c6a0 tx=0x7fb2280e33c0 comp rx=0 tx=0).stop 2024-08-31T05:41:56.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.289+0000 7fb244b06740 1 -- 172.21.15.5:0/170142583 shutdown_connections 2024-08-31T05:41:56.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.289+0000 7fb244b06740 1 --2- 172.21.15.5:0/170142583 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a7c786ada0 0x55a7c7d07270 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:56.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.289+0000 7fb244b06740 1 --2- 172.21.15.5:0/170142583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a7c78d7070 0x55a7c7c8c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:56.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.289+0000 7fb244b06740 1 --2- 172.21.15.5:0/170142583 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a7c78b6390 0x55a7c7c8c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:56.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.289+0000 7fb2177fe640 0 client.28340 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:41:56.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.289+0000 7fb244b06740 1 --2- 172.21.15.5:0/170142583 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a7c78ae1b0 0x55a7c7c8bf10 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:56.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.289+0000 7fb244b06740 1 -- 172.21.15.5:0/170142583 >> 172.21.15.5:0/170142583 conn(0x55a7c78cb460 msgr2=0x55a7c7c85df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:56.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.289+0000 7fb244b06740 1 -- 172.21.15.5:0/170142583 shutdown_connections 2024-08-31T05:41:56.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.289+0000 7fb244b06740 1 -- 172.21.15.5:0/170142583 wait complete. 2024-08-31T05:41:56.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.289+0000 7fb244b06740 20 client.28340 trim_cache size 0 max 16384 2024-08-31T05:41:56.296 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:41:56.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.290+0000 7fb23e591640 1 -- 172.21.15.5:0/1650193819 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb2200b4d20 msgr2=0x7fb2200b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:56.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.290+0000 7fb23e591640 1 --2- 172.21.15.5:0/1650193819 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb2200b4d20 0x7fb2200b7230 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb230009fd0 tx=0x7fb230009500 comp rx=0 tx=0).stop 2024-08-31T05:41:56.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.290+0000 7fb23e591640 1 -- 172.21.15.5:0/1650193819 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb238104750 msgr2=0x7fb23819a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:56.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.290+0000 7fb23e591640 1 --2- 172.21.15.5:0/1650193819 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb238104750 0x7fb23819a260 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb22800e9c0 tx=0x7fb22800ee80 comp rx=0 tx=0).stop 2024-08-31T05:41:56.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.290+0000 7fb23e591640 1 -- 172.21.15.5:0/1650193819 shutdown_connections 2024-08-31T05:41:56.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.290+0000 7fb23e591640 1 --2- 172.21.15.5:0/1650193819 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb2200b4d20 0x7fb2200b7230 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:56.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.290+0000 7fb23e591640 1 --2- 172.21.15.5:0/1650193819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb23810dbb0 0x7fb23819faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:56.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.290+0000 7fb23e591640 1 --2- 172.21.15.5:0/1650193819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2381050a0 0x7fb23819a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:56.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.290+0000 7fb23e591640 1 --2- 172.21.15.5:0/1650193819 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb238104750 0x7fb23819a260 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:56.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.290+0000 7fb23e591640 1 -- 172.21.15.5:0/1650193819 >> 172.21.15.5:0/1650193819 conn(0x7fb2380794d0 msgr2=0x7fb238100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:56.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.290+0000 7fb23e591640 1 -- 172.21.15.5:0/1650193819 shutdown_connections 2024-08-31T05:41:56.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:56.290+0000 7fb23e591640 1 -- 172.21.15.5:0/1650193819 wait complete. 2024-08-31T05:41:56.940 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1346504 10.80 MB/sec execute 524 sec latency 26.177 ms 2024-08-31T05:41:57.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:41:56 smithi005 ceph-mon[18602]: pgmap v714: 129 pgs: 129 active+clean; 609 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.8 MiB/s wr, 225 op/s 2024-08-31T05:41:57.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:41:56 smithi070 ceph-mon[22316]: pgmap v714: 129 pgs: 129 active+clean; 609 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.8 MiB/s wr, 225 op/s 2024-08-31T05:41:57.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:41:56 smithi050 ceph-mon[22146]: pgmap v714: 129 pgs: 129 active+clean; 609 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.8 MiB/s wr, 225 op/s 2024-08-31T05:41:57.940 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1348787 10.80 MB/sec execute 525 sec latency 16.517 ms 2024-08-31T05:41:57.975 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T05:41:57.976 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T05:41:58.237 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:41:58.797 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.794+0000 7f9686fcc640 1 -- 172.21.15.5:0/2430183468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9680110980 msgr2=0x7f9680117240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:58.798 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.794+0000 7f9686fcc640 1 --2- 172.21.15.5:0/2430183468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9680110980 0x7f9680117240 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f9678009ca0 tx=0x7f967802a8e0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.797+0000 7f9686fcc640 1 -- 172.21.15.5:0/2430183468 shutdown_connections 2024-08-31T05:41:58.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.797+0000 7f9686fcc640 1 --2- 172.21.15.5:0/2430183468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9680110980 0x7f9680117240 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.797+0000 7f9686fcc640 1 --2- 172.21.15.5:0/2430183468 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9680110030 0x7f9680110440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.797+0000 7f9686fcc640 1 --2- 172.21.15.5:0/2430183468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f968010ac90 0x7f968010b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.797+0000 7f9686fcc640 1 -- 172.21.15.5:0/2430183468 >> 172.21.15.5:0/2430183468 conn(0x7f9680070b30 msgr2=0x7f9680070f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:58.804 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.801+0000 7f9686fcc640 1 -- 172.21.15.5:0/2430183468 shutdown_connections 2024-08-31T05:41:58.804 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.801+0000 7f9686fcc640 1 -- 172.21.15.5:0/2430183468 wait complete. 2024-08-31T05:41:58.805 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.802+0000 7f9686fcc640 1 Processor -- start 2024-08-31T05:41:58.805 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.802+0000 7f9686fcc640 1 -- start start 2024-08-31T05:41:58.806 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.802+0000 7f9686fcc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f968010ac90 0x7f96801a72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:58.806 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.802+0000 7f9686fcc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9680110030 0x7f96801a0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:58.806 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.802+0000 7f9686fcc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9680110980 0x7f96801a0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:58.806 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.802+0000 7f9686fcc640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9680119d90 con 0x7f9680110030 2024-08-31T05:41:58.806 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.802+0000 7f9686fcc640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9680119c10 con 0x7f9680110980 2024-08-31T05:41:58.806 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.802+0000 7f9686fcc640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9680119f10 con 0x7f968010ac90 2024-08-31T05:41:58.807 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.803+0000 7f967ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9680110030 0x7f96801a0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:58.807 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.803+0000 7f967ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9680110030 0x7f96801a0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40604/0 (socket says 172.21.15.5:40604) 2024-08-31T05:41:58.807 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.803+0000 7f967ffff640 1 -- 172.21.15.5:0/2189412576 learned_addr learned my addr 172.21.15.5:0/2189412576 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:58.807 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.804+0000 7f9685569640 1 --2- 172.21.15.5:0/2189412576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9680110980 0x7f96801a0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:58.807 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.804+0000 7f9684d68640 1 --2- 172.21.15.5:0/2189412576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f968010ac90 0x7f96801a72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:58.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.807+0000 7f9685569640 1 -- 172.21.15.5:0/2189412576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f968010ac90 msgr2=0x7f96801a72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:58.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.807+0000 7f9685569640 1 --2- 172.21.15.5:0/2189412576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f968010ac90 0x7f96801a72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.807+0000 7f9685569640 1 -- 172.21.15.5:0/2189412576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9680110030 msgr2=0x7f96801a0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:58.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.807+0000 7f9685569640 1 --2- 172.21.15.5:0/2189412576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9680110030 0x7f96801a0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.807+0000 7f9685569640 1 -- 172.21.15.5:0/2189412576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96801a1330 con 0x7f9680110980 2024-08-31T05:41:58.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.807+0000 7f9685569640 1 --2- 172.21.15.5:0/2189412576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9680110980 0x7f96801a0b10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9678009ca0 tx=0x7f9678003ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:58.811 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.808+0000 7f967dffb640 1 -- 172.21.15.5:0/2189412576 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9678031d30 con 0x7f9680110980 2024-08-31T05:41:58.811 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.808+0000 7f9686fcc640 1 -- 172.21.15.5:0/2189412576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96801a5f90 con 0x7f9680110980 2024-08-31T05:41:58.811 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.808+0000 7f9686fcc640 1 -- 172.21.15.5:0/2189412576 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96801a64e0 con 0x7f9680110980 2024-08-31T05:41:58.819 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.816+0000 7f968e013740 1 Processor -- start 2024-08-31T05:41:58.819 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.816+0000 7f968e013740 1 -- start start 2024-08-31T05:41:58.820 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.816+0000 7f967dffb640 1 -- 172.21.15.5:0/2189412576 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f967803f070 con 0x7f9680110980 2024-08-31T05:41:58.821 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.816+0000 7f967dffb640 1 -- 172.21.15.5:0/2189412576 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96780046f0 con 0x7f9680110980 2024-08-31T05:41:58.821 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.816+0000 7f967dffb640 1 -- 172.21.15.5:0/2189412576 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f967803a420 con 0x7f9680110980 2024-08-31T05:41:58.821 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.816+0000 7f968e013740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621aaf8a1b0 0x5621ab32dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:58.821 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.816+0000 7f968e013740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5621aaf612f0 0x5621ab32e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:58.821 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.816+0000 7f968e013740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5621aaf694d0 0x5621ab32e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:58.821 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.816+0000 7f968e013740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5621ab2a3000 con 0x5621aaf612f0 2024-08-31T05:41:58.821 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.816+0000 7f968e013740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5621ab292590 con 0x5621aaf694d0 2024-08-31T05:41:58.821 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.816+0000 7f968e013740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5621ab296540 con 0x5621aaf8a1b0 2024-08-31T05:41:58.821 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.817+0000 7f967ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5621aaf694d0 0x5621ab32e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:58.821 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.817+0000 7f967ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5621aaf694d0 0x5621ab32e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:47254/0 (socket says 172.21.15.5:47254) 2024-08-31T05:41:58.821 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.817+0000 7f967ffff640 1 -- 172.21.15.5:0/1318377828 learned_addr learned my addr 172.21.15.5:0/1318377828 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:58.821 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.817+0000 7f967ffff640 1 -- 172.21.15.5:0/1318377828 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621aaf8a1b0 msgr2=0x5621ab32dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:58.821 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.817+0000 7f967ffff640 1 --2- 172.21.15.5:0/1318377828 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621aaf8a1b0 0x5621ab32dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.821 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.817+0000 7f967ffff640 1 -- 172.21.15.5:0/1318377828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5621aaf612f0 msgr2=0x5621ab32e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:58.822 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.817+0000 7f967ffff640 1 --2- 172.21.15.5:0/1318377828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5621aaf612f0 0x5621ab32e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.822 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.817+0000 7f967ffff640 1 -- 172.21.15.5:0/1318377828 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621aaff5790 con 0x5621aaf694d0 2024-08-31T05:41:58.822 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.817+0000 7f967ffff640 1 --2- 172.21.15.5:0/1318377828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5621aaf694d0 0x5621ab32e760 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f966c009d10 tx=0x7f966c012820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f013707f58338bc0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:58.822 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.818+0000 7f966affd640 1 -- 172.21.15.5:0/1318377828 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f966c01b640 con 0x5621aaf694d0 2024-08-31T05:41:58.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.818+0000 7f966affd640 1 -- 172.21.15.5:0/1318377828 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f966c01bc90 con 0x5621aaf694d0 2024-08-31T05:41:58.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.818+0000 7f967dffb640 1 --2- 172.21.15.5:0/2189412576 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f96700b4ed0 0x7f96700b73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:58.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.819+0000 7f967dffb640 1 -- 172.21.15.5:0/2189412576 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9511+0+0 (secure 0 0 0) 0x7f96781077b0 con 0x7f9680110980 2024-08-31T05:41:58.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.819+0000 7f966affd640 1 -- 172.21.15.5:0/1318377828 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f966c00fc50 con 0x5621aaf694d0 2024-08-31T05:41:58.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.819+0000 7f968e013740 1 -- 172.21.15.5:0/1318377828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5621aaf694d0 msgr2=0x5621ab32e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:58.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.819+0000 7f968e013740 1 --2- 172.21.15.5:0/1318377828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5621aaf694d0 0x5621ab32e760 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f966c009d10 tx=0x7f966c012820 comp rx=0 tx=0).stop 2024-08-31T05:41:58.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.819+0000 7f968e013740 1 -- 172.21.15.5:0/1318377828 shutdown_connections 2024-08-31T05:41:58.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.819+0000 7f968e013740 1 --2- 172.21.15.5:0/1318377828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5621aaf694d0 0x5621ab32e760 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.819+0000 7f968e013740 1 --2- 172.21.15.5:0/1318377828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5621aaf612f0 0x5621ab32e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.819+0000 7f968e013740 1 --2- 172.21.15.5:0/1318377828 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621aaf8a1b0 0x5621ab32dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.823 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.820+0000 7f968e013740 1 -- 172.21.15.5:0/1318377828 >> 172.21.15.5:0/1318377828 conn(0x5621aaf7e300 msgr2=0x5621ab32bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:58.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.820+0000 7f9684d68640 1 --2- 172.21.15.5:0/2189412576 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f96700b4ed0 0x7f96700b73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:58.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.820+0000 7f968e013740 1 -- 172.21.15.5:0/1318377828 shutdown_connections 2024-08-31T05:41:58.824 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.820+0000 7f968e013740 1 -- 172.21.15.5:0/1318377828 wait complete. 2024-08-31T05:41:58.826 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.823+0000 7f968e013740 1 -- start start 2024-08-31T05:41:58.826 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.823+0000 7f968e013740 1 Processor -- start 2024-08-31T05:41:58.826 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.823+0000 7f9684d68640 1 --2- 172.21.15.5:0/2189412576 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f96700b4ed0 0x7f96700b73e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x5621ab32c960 tx=0x7f96740046c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:58.830 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.827+0000 7f968e013740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5621aaf612f0 0x5621ab3395b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:58.830 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.827+0000 7f968e013740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621aaf694d0 0x5621ab339b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:58.830 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.827+0000 7f968e013740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5621aaf8a1b0 0x5621ab345900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:58.831 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.827+0000 7f967ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621aaf694d0 0x5621ab339b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:58.831 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.827+0000 7f967ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621aaf694d0 0x5621ab339b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:35442/0 (socket says 172.21.15.5:35442) 2024-08-31T05:41:58.831 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.827+0000 7f967ffff640 1 -- 172.21.15.5:0/357874427 learned_addr learned my addr 172.21.15.5:0/357874427 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:58.831 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.827+0000 7f968e013740 1 -- 172.21.15.5:0/357874427 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5621ab1cbab0 con 0x5621aaf8a1b0 2024-08-31T05:41:58.831 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.827+0000 7f968e013740 1 -- 172.21.15.5:0/357874427 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5621ab219680 con 0x5621aaf612f0 2024-08-31T05:41:58.831 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.827+0000 7f968e013740 1 -- 172.21.15.5:0/357874427 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5621ab33c500 con 0x5621aaf694d0 2024-08-31T05:41:58.831 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.827+0000 7f968e013740 10 client.0 _ll_register_callbacks cb 0x5621aafa1a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:41:58.831 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.828+0000 7f9685569640 1 --2- 172.21.15.5:0/357874427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5621aaf8a1b0 0x5621ab345900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:58.832 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.829+0000 7f9684d68640 1 --2- 172.21.15.5:0/357874427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5621aaf612f0 0x5621ab3395b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:58.832 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.829+0000 7f9685569640 1 -- 172.21.15.5:0/357874427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621aaf694d0 msgr2=0x5621ab339b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:58.832 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.829+0000 7f9685569640 1 --2- 172.21.15.5:0/357874427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621aaf694d0 0x5621ab339b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.832 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.829+0000 7f9685569640 1 -- 172.21.15.5:0/357874427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5621aaf612f0 msgr2=0x5621ab3395b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:58.832 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.829+0000 7f9685569640 1 --2- 172.21.15.5:0/357874427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5621aaf612f0 0x5621ab3395b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.832 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.829+0000 7f9685569640 1 -- 172.21.15.5:0/357874427 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621ab06e620 con 0x5621aaf8a1b0 2024-08-31T05:41:58.833 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.830+0000 7f9685569640 1 --2- 172.21.15.5:0/357874427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5621aaf8a1b0 0x5621ab345900 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f9678104b40 tx=0x7f96780cd4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4f46c05a1f17504 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:58.833 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.830+0000 7f9663fff640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:41:58.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.832+0000 7f9663fff640 1 -- 172.21.15.5:0/357874427 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96780ce1e0 con 0x5621aaf8a1b0 2024-08-31T05:41:58.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.832+0000 7f968e013740 1 -- 172.21.15.5:0/357874427 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f966c01bc90 con 0x5621aaf8a1b0 2024-08-31T05:41:58.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.832+0000 7f9663fff640 1 -- 172.21.15.5:0/357874427 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9511+0+0 (secure 0 0 0) 0x7f96780d6b80 con 0x5621aaf8a1b0 2024-08-31T05:41:58.836 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.833+0000 7f9663fff640 1 -- 172.21.15.5:0/357874427 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f96780cdae0 con 0x5621aaf8a1b0 2024-08-31T05:41:58.836 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.834+0000 7f968e013740 10 client.18792 fetch_fsmap learned FSMap version 34 2024-08-31T05:41:58.837 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.834+0000 7f968e013740 1 -- 172.21.15.5:0/357874427 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5621ab3484b0 con 0x5621aaf8a1b0 2024-08-31T05:41:58.837 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.834+0000 7f9663fff640 1 -- 172.21.15.5:0/357874427 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f966c01bc90 con 0x5621aaf8a1b0 2024-08-31T05:41:58.837 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.834+0000 7f9663fff640 1 -- 172.21.15.5:0/357874427 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f967804b020 con 0x5621aaf8a1b0 2024-08-31T05:41:58.837 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.835+0000 7f968e013740 10 client.18792 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:41:58.838 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.835+0000 7f968e013740 10 client.18792 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:41:58.838 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.835+0000 7f968e013740 20 client.18792 populate_metadata read hostname 'smithi005' 2024-08-31T05:41:58.838 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.835+0000 7f968e013740 1 --2- 172.21.15.5:0/357874427 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5621aaf48d80 0x5621ab34bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:58.838 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.835+0000 7f968e013740 4 client.18792 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:41:58.838 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.835+0000 7f968e013740 1 -- 172.21.15.5:0/357874427 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5621ab2a4f50 con 0x5621aaf48d80 2024-08-31T05:41:58.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.834+0000 7fecba3b3640 1 -- 172.21.15.5:0/1371969405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecb410a780 msgr2=0x7fecb410ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:58.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.834+0000 7fecba3b3640 1 --2- 172.21.15.5:0/1371969405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecb410a780 0x7fecb410ab90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7feca4009860 tx=0x7feca402a340 comp rx=0 tx=0).stop 2024-08-31T05:41:58.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.835+0000 7fecba3b3640 1 -- 172.21.15.5:0/1371969405 shutdown_connections 2024-08-31T05:41:58.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.835+0000 7fecba3b3640 1 --2- 172.21.15.5:0/1371969405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fecb411c9d0 0x7fecb411eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.835+0000 7fecba3b3640 1 --2- 172.21.15.5:0/1371969405 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecb410a780 0x7fecb410ab90 secure :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7feca4009860 tx=0x7feca402a340 comp rx=0 tx=0).stop 2024-08-31T05:41:58.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.835+0000 7fecba3b3640 1 --2- 172.21.15.5:0/1371969405 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fecb4111ce0 0x7fecb410a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.835+0000 7fecba3b3640 1 -- 172.21.15.5:0/1371969405 >> 172.21.15.5:0/1371969405 conn(0x7fecb4070c60 msgr2=0x7fecb4071070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:58.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.839+0000 7f9684d68640 1 --2- 172.21.15.5:0/357874427 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5621aaf48d80 0x5621ab34bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:58.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.838+0000 7fecba3b3640 1 -- 172.21.15.5:0/1371969405 shutdown_connections 2024-08-31T05:41:58.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.839+0000 7fecba3b3640 1 -- 172.21.15.5:0/1371969405 wait complete. 2024-08-31T05:41:58.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.841+0000 7fecba3b3640 1 Processor -- start 2024-08-31T05:41:58.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.841+0000 7fecba3b3640 1 -- start start 2024-08-31T05:41:58.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.841+0000 7fecba3b3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fecb4111ce0 0x7fecb41a9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:58.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.841+0000 7fecba3b3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecb411c9d0 0x7fecb41a97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:58.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.841+0000 7fecba3b3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fecb41ae9d0 0x7fecb41aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:58.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.841+0000 7fecba3b3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fecb4122660 con 0x7fecb41ae9d0 2024-08-31T05:41:58.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.841+0000 7fecba3b3640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fecb41224e0 con 0x7fecb411c9d0 2024-08-31T05:41:58.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.841+0000 7fecba3b3640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fecb41227e0 con 0x7fecb4111ce0 2024-08-31T05:41:58.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.842+0000 7f9684d68640 1 --2- 172.21.15.5:0/357874427 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5621aaf48d80 0x5621ab34bb80 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ade84e6225458de7 server_cookie=3cea27a9edfc36ec in_seq=0 out_seq=0 2024-08-31T05:41:58.845 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.843+0000 7f9663fff640 10 client.18792 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:41:58.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.842+0000 7fecab7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecb411c9d0 0x7fecb41a97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:58.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.842+0000 7fecb8950640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fecb41ae9d0 0x7fecb41aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:58.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.842+0000 7fecb8950640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fecb41ae9d0 0x7fecb41aede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40634/0 (socket says 172.21.15.5:40634) 2024-08-31T05:41:58.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.842+0000 7fecb8950640 1 -- 172.21.15.5:0/2233247853 learned_addr learned my addr 172.21.15.5:0/2233247853 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:58.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.842+0000 7fecb8950640 1 -- 172.21.15.5:0/2233247853 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fecb4111ce0 msgr2=0x7fecb41a9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:58.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.842+0000 7fecb8950640 1 --2- 172.21.15.5:0/2233247853 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fecb4111ce0 0x7fecb41a9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.842+0000 7fecb8950640 1 -- 172.21.15.5:0/2233247853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecb411c9d0 msgr2=0x7fecb41a97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:58.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.842+0000 7fecb8950640 1 --2- 172.21.15.5:0/2233247853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecb411c9d0 0x7fecb41a97f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.842+0000 7fecb8950640 1 -- 172.21.15.5:0/2233247853 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecb41af5b0 con 0x7fecb41ae9d0 2024-08-31T05:41:58.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.843+0000 7fecb8950640 1 --2- 172.21.15.5:0/2233247853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fecb41ae9d0 0x7fecb41aede0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fecac00efc0 tx=0x7fecac00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:58.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.843+0000 7fecb1ffb640 1 -- 172.21.15.5:0/2233247853 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecac003970 con 0x7fecb41ae9d0 2024-08-31T05:41:58.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.843+0000 7fecb1ffb640 1 -- 172.21.15.5:0/2233247853 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fecac004020 con 0x7fecb41ae9d0 2024-08-31T05:41:58.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.843+0000 7fecba3b3640 1 -- 172.21.15.5:0/2233247853 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecb41b5b50 con 0x7fecb41ae9d0 2024-08-31T05:41:58.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.844+0000 7fecb1ffb640 1 -- 172.21.15.5:0/2233247853 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecac00b900 con 0x7fecb41ae9d0 2024-08-31T05:41:58.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.844+0000 7fecba3b3640 1 -- 172.21.15.5:0/2233247853 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecb41b5f50 con 0x7fecb41ae9d0 2024-08-31T05:41:58.849 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.845+0000 7f9663fff640 1 -- 172.21.15.5:0/357874427 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5621ab2a4f50 con 0x5621aaf48d80 2024-08-31T05:41:58.849 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.845+0000 7f9663fff640 10 client.18792 handle_command_reply: tid=0 2024-08-31T05:41:58.849 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.845+0000 7f968e013740 1 client.18792 shutdown 2024-08-31T05:41:58.851 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.849+0000 7f968e013740 1 -- 172.21.15.5:0/357874427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5621aaf8a1b0 msgr2=0x5621ab345900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:58.852 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.849+0000 7f968e013740 1 --2- 172.21.15.5:0/357874427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5621aaf8a1b0 0x5621ab345900 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f9678104b40 tx=0x7f96780cd4f0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.852 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.849+0000 7f968e013740 1 -- 172.21.15.5:0/357874427 shutdown_connections 2024-08-31T05:41:58.852 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.849+0000 7f968e013740 1 --2- 172.21.15.5:0/357874427 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5621aaf48d80 0x5621ab34bb80 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.852 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.849+0000 7f968e013740 1 --2- 172.21.15.5:0/357874427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5621aaf8a1b0 0x5621ab345900 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.852 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.849+0000 7f968e013740 1 --2- 172.21.15.5:0/357874427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621aaf694d0 0x5621ab339b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.852 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.849+0000 7f968e013740 1 --2- 172.21.15.5:0/357874427 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5621aaf612f0 0x5621ab3395b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.853 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.849+0000 7f968e013740 1 -- 172.21.15.5:0/357874427 >> 172.21.15.5:0/357874427 conn(0x5621aaf7e300 msgr2=0x5621ab32ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:58.853 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.849+0000 7f9663fff640 0 client.18792 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:41:58.853 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.850+0000 7f968e013740 1 -- 172.21.15.5:0/357874427 shutdown_connections 2024-08-31T05:41:58.853 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.850+0000 7f968e013740 1 -- 172.21.15.5:0/357874427 wait complete. 2024-08-31T05:41:58.853 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.850+0000 7f968e013740 20 client.18792 trim_cache size 0 max 16384 2024-08-31T05:41:58.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.849+0000 7fecc0928740 1 Processor -- start 2024-08-31T05:41:58.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.851+0000 7fecc0928740 1 -- start start 2024-08-31T05:41:58.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.851+0000 7fecb1ffb640 1 -- 172.21.15.5:0/2233247853 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fecac01d020 con 0x7fecb41ae9d0 2024-08-31T05:41:58.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.852+0000 7fecc0928740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56304e367350 0x56304e70d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:58.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.852+0000 7fecc0928740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56304e33e490 0x56304e70dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:58.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.852+0000 7fecc0928740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56304e346670 0x56304e70e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:58.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.852+0000 7fecc0928740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56304e6835f0 con 0x56304e346670 2024-08-31T05:41:58.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.852+0000 7fecc0928740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56304e672b80 con 0x56304e367350 2024-08-31T05:41:58.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.852+0000 7fecc0928740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56304e676b30 con 0x56304e33e490 2024-08-31T05:41:58.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.852+0000 7fecb3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56304e33e490 0x56304e70dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:58.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.853+0000 7fecab7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56304e367350 0x56304e70d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:58.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.853+0000 7fecab7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56304e367350 0x56304e70d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:47288/0 (socket says 172.21.15.5:47288) 2024-08-31T05:41:58.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.853+0000 7fecab7fe640 1 -- 172.21.15.5:0/1451315830 learned_addr learned my addr 172.21.15.5:0/1451315830 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:58.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.853+0000 7fecab7fe640 1 --2- 172.21.15.5:0/1451315830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56304e346670 0x56304e70e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:58.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.853+0000 7fecab7fe640 1 -- 172.21.15.5:0/1451315830 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56304e33e490 msgr2=0x56304e70dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:58.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.853+0000 7fecab7fe640 1 --2- 172.21.15.5:0/1451315830 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56304e33e490 0x56304e70dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.853+0000 7fecab7fe640 1 -- 172.21.15.5:0/1451315830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56304e346670 msgr2=0x56304e70e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:58.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.853+0000 7fecab7fe640 1 --2- 172.21.15.5:0/1451315830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56304e346670 0x56304e70e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.853+0000 7fecab7fe640 1 -- 172.21.15.5:0/1451315830 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56304e3d2930 con 0x56304e367350 2024-08-31T05:41:58.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.854+0000 7fecb1ffb640 1 --2- 172.21.15.5:0/2233247853 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7feca00b4dd0 0x7feca00b72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:58.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.854+0000 7fecab7fe640 1 --2- 172.21.15.5:0/1451315830 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56304e367350 0x56304e70d780 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7feca4035040 tx=0x7feca4030340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=384028d697724e80 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:58.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.854+0000 7fecb1ffb640 1 -- 172.21.15.5:0/2233247853 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9511+0+0 (secure 0 0 0) 0x7fecac0e5950 con 0x7fecb41ae9d0 2024-08-31T05:41:58.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.855+0000 7fecb3fff640 1 --2- 172.21.15.5:0/2233247853 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7feca00b4dd0 0x7feca00b72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:58.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.856+0000 7fecb3fff640 1 --2- 172.21.15.5:0/2233247853 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7feca00b4dd0 0x7feca00b72e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x56304e70c400 tx=0x7fec9c009530 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:58.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.856+0000 7fecaa7fc640 1 -- 172.21.15.5:0/1451315830 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca4037040 con 0x56304e367350 2024-08-31T05:41:58.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.856+0000 7fecaa7fc640 1 -- 172.21.15.5:0/1451315830 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feca4003aa0 con 0x56304e367350 2024-08-31T05:41:58.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.857+0000 7fecaa7fc640 1 -- 172.21.15.5:0/1451315830 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca4032920 con 0x56304e367350 2024-08-31T05:41:58.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.857+0000 7fecc0928740 1 -- 172.21.15.5:0/1451315830 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56304e367350 msgr2=0x56304e70d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:58.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.857+0000 7fecc0928740 1 --2- 172.21.15.5:0/1451315830 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56304e367350 0x56304e70d780 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7feca4035040 tx=0x7feca4030340 comp rx=0 tx=0).stop 2024-08-31T05:41:58.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.858+0000 7fecc0928740 1 -- 172.21.15.5:0/1451315830 shutdown_connections 2024-08-31T05:41:58.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.858+0000 7fecc0928740 1 --2- 172.21.15.5:0/1451315830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56304e346670 0x56304e70e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.858+0000 7fecc0928740 1 --2- 172.21.15.5:0/1451315830 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56304e33e490 0x56304e70dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.858+0000 7fecc0928740 1 --2- 172.21.15.5:0/1451315830 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56304e367350 0x56304e70d780 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.858+0000 7fecc0928740 1 -- 172.21.15.5:0/1451315830 >> 172.21.15.5:0/1451315830 conn(0x56304e35b740 msgr2=0x56304e70b670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:58.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.859+0000 7fecc0928740 1 -- 172.21.15.5:0/1451315830 shutdown_connections 2024-08-31T05:41:58.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.859+0000 7fecc0928740 1 -- 172.21.15.5:0/1451315830 wait complete. 2024-08-31T05:41:58.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.860+0000 7fecc0928740 1 -- start start 2024-08-31T05:41:58.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.860+0000 7fecc0928740 1 Processor -- start 2024-08-31T05:41:58.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.861+0000 7fecc0928740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56304e33e490 0x56304e718ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:58.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.861+0000 7fecc0928740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56304e346670 0x56304e719420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:58.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.861+0000 7fecb3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56304e33e490 0x56304e718ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:58.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.861+0000 7fecb3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56304e33e490 0x56304e718ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:35458/0 (socket says 172.21.15.5:35458) 2024-08-31T05:41:58.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.862+0000 7fecab7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56304e346670 0x56304e719420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:58.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.862+0000 7fecab7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56304e346670 0x56304e719420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:47292/0 (socket says 172.21.15.5:47292) 2024-08-31T05:41:58.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.862+0000 7fecb3fff640 1 -- 172.21.15.5:0/1718567042 learned_addr learned my addr 172.21.15.5:0/1718567042 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:58.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.862+0000 7fecc0928740 1 --2- 172.21.15.5:0/1718567042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56304e367350 0x56304e725230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:58.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.862+0000 7fecc0928740 1 -- 172.21.15.5:0/1718567042 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56304e4d5890 con 0x56304e367350 2024-08-31T05:41:58.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.862+0000 7fecc0928740 1 -- 172.21.15.5:0/1718567042 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56304e5f9790 con 0x56304e346670 2024-08-31T05:41:58.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.862+0000 7fecc0928740 1 -- 172.21.15.5:0/1718567042 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56304e71bef0 con 0x56304e33e490 2024-08-31T05:41:58.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.862+0000 7fecc0928740 10 client.0 _ll_register_callbacks cb 0x56304e37eba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:41:58.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.863+0000 7fecab7fe640 1 -- 172.21.15.5:0/1718567042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56304e33e490 msgr2=0x56304e718ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:58.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.863+0000 7fecab7fe640 1 --2- 172.21.15.5:0/1718567042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56304e33e490 0x56304e718ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.863+0000 7fecab7fe640 1 -- 172.21.15.5:0/1718567042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56304e367350 msgr2=0x56304e725230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:58.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.863+0000 7fecab7fe640 1 --2- 172.21.15.5:0/1718567042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56304e367350 0x56304e725230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.863+0000 7fecab7fe640 1 -- 172.21.15.5:0/1718567042 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56304e630f30 con 0x56304e346670 2024-08-31T05:41:58.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.863+0000 7fecb3fff640 1 --2- 172.21.15.5:0/1718567042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56304e33e490 0x56304e718ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:41:58.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.863+0000 7fecab7fe640 1 --2- 172.21.15.5:0/1718567042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56304e346670 0x56304e719420 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7feca4035040 tx=0x7feca402a9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a845776d3034064d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:58.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.863+0000 7fec937fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:41:58.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.864+0000 7fec937fe640 1 -- 172.21.15.5:0/1718567042 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca404d060 con 0x56304e346670 2024-08-31T05:41:58.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.864+0000 7fecc0928740 1 -- 172.21.15.5:0/1718567042 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feca4003aa0 con 0x56304e346670 2024-08-31T05:41:58.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.864+0000 7fec937fe640 1 -- 172.21.15.5:0/1718567042 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9511+0+0 (secure 0 0 0) 0x7feca40035f0 con 0x56304e346670 2024-08-31T05:41:58.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.864+0000 7fec937fe640 1 -- 172.21.15.5:0/1718567042 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7feca4054050 con 0x56304e346670 2024-08-31T05:41:58.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.864+0000 7fecc0928740 10 client.28364 fetch_fsmap learned FSMap version 34 2024-08-31T05:41:58.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.864+0000 7fecc0928740 1 -- 172.21.15.5:0/1718567042 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56304e727cf0 con 0x56304e346670 2024-08-31T05:41:58.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.865+0000 7fec937fe640 1 -- 172.21.15.5:0/1718567042 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feca4003aa0 con 0x56304e346670 2024-08-31T05:41:58.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.865+0000 7fec937fe640 1 -- 172.21.15.5:0/1718567042 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7feca4030450 con 0x56304e346670 2024-08-31T05:41:58.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.865+0000 7fecc0928740 10 client.28364 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:41:58.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.865+0000 7fecc0928740 10 client.28364 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:41:58.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.865+0000 7fecc0928740 20 client.28364 populate_metadata read hostname 'smithi005' 2024-08-31T05:41:58.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.865+0000 7fecc0928740 1 --2- 172.21.15.5:0/1718567042 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56304e325cd0 0x56304e72b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:58.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.865+0000 7fecc0928740 4 client.28364 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:41:58.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.865+0000 7fecc0928740 1 -- 172.21.15.5:0/1718567042 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56304e685540 con 0x56304e325cd0 2024-08-31T05:41:58.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.865+0000 7fecb3fff640 1 --2- 172.21.15.5:0/1718567042 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56304e325cd0 0x56304e72b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:58.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.868+0000 7fec937fe640 10 client.28364 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:41:58.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.868+0000 7fecb3fff640 1 --2- 172.21.15.5:0/1718567042 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56304e325cd0 0x56304e72b2b0 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3ae60a40bdf9716 server_cookie=1e668ab942a166f5 in_seq=0 out_seq=0 2024-08-31T05:41:58.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.870+0000 7fec937fe640 1 -- 172.21.15.5:0/1718567042 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56304e685540 con 0x56304e325cd0 2024-08-31T05:41:58.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.870+0000 7fec937fe640 10 client.28364 handle_command_reply: tid=0 2024-08-31T05:41:58.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.870+0000 7fecc0928740 1 client.28364 shutdown 2024-08-31T05:41:58.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.870+0000 7fecc0928740 1 -- 172.21.15.5:0/1718567042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56304e346670 msgr2=0x56304e719420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:58.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.870+0000 7fecc0928740 1 --2- 172.21.15.5:0/1718567042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56304e346670 0x56304e719420 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7feca4035040 tx=0x7feca402a9e0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.870+0000 7fecc0928740 1 -- 172.21.15.5:0/1718567042 shutdown_connections 2024-08-31T05:41:58.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.870+0000 7fecc0928740 1 --2- 172.21.15.5:0/1718567042 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56304e325cd0 0x56304e72b2b0 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.870+0000 7fecc0928740 1 --2- 172.21.15.5:0/1718567042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56304e367350 0x56304e725230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.871+0000 7fec937fe640 0 client.28364 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:41:58.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.871+0000 7fecc0928740 1 --2- 172.21.15.5:0/1718567042 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56304e346670 0x56304e719420 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.871+0000 7fecc0928740 1 --2- 172.21.15.5:0/1718567042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56304e33e490 0x56304e718ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.871+0000 7fecc0928740 1 -- 172.21.15.5:0/1718567042 >> 172.21.15.5:0/1718567042 conn(0x56304e35b740 msgr2=0x56304e710910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:58.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.871+0000 7fecc0928740 1 -- 172.21.15.5:0/1718567042 shutdown_connections 2024-08-31T05:41:58.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.871+0000 7fecc0928740 1 -- 172.21.15.5:0/1718567042 wait complete. 2024-08-31T05:41:58.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.871+0000 7fecc0928740 20 client.28364 trim_cache size 0 max 16384 2024-08-31T05:41:58.884 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.881+0000 7f968e013740 1 Processor -- start 2024-08-31T05:41:58.884 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.881+0000 7f968e013740 1 -- start start 2024-08-31T05:41:58.884 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.881+0000 7f968e013740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5621aaf612f0 0x5621ab333db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:58.884 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.881+0000 7f968e013740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621aaf694d0 0x5621ab32f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:58.884 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.881+0000 7f968e013740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5621aaf8a1b0 0x5621ab345880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:58.885 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.881+0000 7f968e013740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f966400ffc0 con 0x5621aaf612f0 2024-08-31T05:41:58.885 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.881+0000 7f968e013740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9664011b00 con 0x5621aaf8a1b0 2024-08-31T05:41:58.885 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.881+0000 7f968e013740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9664010690 con 0x5621aaf694d0 2024-08-31T05:41:58.885 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.881+0000 7f9684d68640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5621aaf612f0 0x5621ab333db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:58.885 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.881+0000 7f9684d68640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5621aaf612f0 0x5621ab333db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40656/0 (socket says 172.21.15.5:40656) 2024-08-31T05:41:58.885 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.881+0000 7f9684d68640 1 -- 172.21.15.5:0/2593059139 learned_addr learned my addr 172.21.15.5:0/2593059139 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:58.885 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.881+0000 7f9685569640 1 --2- 172.21.15.5:0/2593059139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5621aaf8a1b0 0x5621ab345880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:58.885 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.881+0000 7f967ffff640 1 --2- 172.21.15.5:0/2593059139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621aaf694d0 0x5621ab32f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:58.886 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.882+0000 7f9685569640 1 -- 172.21.15.5:0/2593059139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621aaf694d0 msgr2=0x5621ab32f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:58.886 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.882+0000 7f9685569640 1 --2- 172.21.15.5:0/2593059139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621aaf694d0 0x5621ab32f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.886 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.882+0000 7f9685569640 1 -- 172.21.15.5:0/2593059139 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5621aaf612f0 msgr2=0x5621ab333db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:58.886 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.882+0000 7f9685569640 1 --2- 172.21.15.5:0/2593059139 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5621aaf612f0 0x5621ab333db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.886 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.882+0000 7f9685569640 1 -- 172.21.15.5:0/2593059139 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621aaf48fb0 con 0x5621aaf8a1b0 2024-08-31T05:41:58.886 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.882+0000 7f9685569640 1 --2- 172.21.15.5:0/2593059139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5621aaf8a1b0 0x5621ab345880 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9678005e30 tx=0x7f96780cd560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1fd53847cf6f7f1e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:58.886 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.882+0000 7f966a7fc640 1 -- 172.21.15.5:0/2593059139 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96780c9270 con 0x5621aaf8a1b0 2024-08-31T05:41:58.886 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.882+0000 7f966a7fc640 1 -- 172.21.15.5:0/2593059139 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9678036030 con 0x5621aaf8a1b0 2024-08-31T05:41:58.886 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.882+0000 7f966a7fc640 1 -- 172.21.15.5:0/2593059139 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96780d2350 con 0x5621aaf8a1b0 2024-08-31T05:41:58.887 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.883+0000 7f968e013740 1 -- 172.21.15.5:0/2593059139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5621aaf8a1b0 msgr2=0x5621ab345880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:58.888 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.883+0000 7f968e013740 1 --2- 172.21.15.5:0/2593059139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5621aaf8a1b0 0x5621ab345880 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9678005e30 tx=0x7f96780cd560 comp rx=0 tx=0).stop 2024-08-31T05:41:58.888 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.884+0000 7f968e013740 1 -- 172.21.15.5:0/2593059139 shutdown_connections 2024-08-31T05:41:58.888 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.884+0000 7f968e013740 1 --2- 172.21.15.5:0/2593059139 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5621aaf8a1b0 0x5621ab345880 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.888 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.884+0000 7f968e013740 1 --2- 172.21.15.5:0/2593059139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621aaf694d0 0x5621ab32f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.888 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.884+0000 7f968e013740 1 --2- 172.21.15.5:0/2593059139 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5621aaf612f0 0x5621ab333db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.888 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.884+0000 7f968e013740 1 -- 172.21.15.5:0/2593059139 >> 172.21.15.5:0/2593059139 conn(0x5621aaf7e300 msgr2=0x5621ab337e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:58.888 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.884+0000 7f968e013740 1 -- 172.21.15.5:0/2593059139 shutdown_connections 2024-08-31T05:41:58.888 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.884+0000 7f968e013740 1 -- 172.21.15.5:0/2593059139 wait complete. 2024-08-31T05:41:58.888 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.884+0000 7f968e013740 1 -- start start 2024-08-31T05:41:58.888 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.885+0000 7f968e013740 1 Processor -- start 2024-08-31T05:41:58.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.885+0000 7f968e013740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5621aaf612f0 0x5621ab33dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:58.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.885+0000 7f968e013740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621aaf694d0 0x5621ab33e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:58.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.885+0000 7f968e013740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5621aaf8a1b0 0x5621ab33e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:58.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.885+0000 7f968e013740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9664011430 con 0x5621aaf8a1b0 2024-08-31T05:41:58.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.885+0000 7f968e013740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9664010d60 con 0x5621aaf612f0 2024-08-31T05:41:58.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.885+0000 7f968e013740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f966400dfc0 con 0x5621aaf694d0 2024-08-31T05:41:58.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.885+0000 7f968e013740 10 client.0 _ll_register_callbacks cb 0x7f9678009460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:41:58.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.886+0000 7f9684d68640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5621aaf612f0 0x5621ab33dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:58.891 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.886+0000 7f9685569640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5621aaf8a1b0 0x5621ab33e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:58.892 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.886+0000 7f967ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621aaf694d0 0x5621ab33e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:58.892 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.886+0000 7f9685569640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5621aaf8a1b0 0x5621ab33e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40672/0 (socket says 172.21.15.5:40672) 2024-08-31T05:41:58.892 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.886+0000 7f9685569640 1 -- 172.21.15.5:0/4092316127 learned_addr learned my addr 172.21.15.5:0/4092316127 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:58.892 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.886+0000 7f9684d68640 1 -- 172.21.15.5:0/4092316127 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621aaf694d0 msgr2=0x5621ab33e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:58.892 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.886+0000 7f9684d68640 1 --2- 172.21.15.5:0/4092316127 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621aaf694d0 0x5621ab33e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.892 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.886+0000 7f9684d68640 1 -- 172.21.15.5:0/4092316127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5621aaf8a1b0 msgr2=0x5621ab33e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:58.892 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.886+0000 7f9684d68640 1 --2- 172.21.15.5:0/4092316127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5621aaf8a1b0 0x5621ab33e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.892 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.886+0000 7f9684d68640 1 -- 172.21.15.5:0/4092316127 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621ab3b57b0 con 0x5621aaf612f0 2024-08-31T05:41:58.892 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.886+0000 7f9685569640 1 --2- 172.21.15.5:0/4092316127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5621aaf8a1b0 0x5621ab33e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:41:58.892 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.886+0000 7f9684d68640 1 --2- 172.21.15.5:0/4092316127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5621aaf612f0 0x5621ab33dad0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9674012010 tx=0x7f9674005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f25ba982f650fb8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:58.893 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.886+0000 7f9663fff640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:41:58.893 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.886+0000 7f9663fff640 1 -- 172.21.15.5:0/4092316127 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9674020a40 con 0x5621aaf612f0 2024-08-31T05:41:58.893 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.886+0000 7f9663fff640 1 -- 172.21.15.5:0/4092316127 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9511+0+0 (secure 0 0 0) 0x7f9674020be0 con 0x5621aaf612f0 2024-08-31T05:41:58.893 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.887+0000 7f968e013740 1 -- 172.21.15.5:0/4092316127 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9678036030 con 0x5621aaf612f0 2024-08-31T05:41:58.893 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.887+0000 7f9663fff640 1 -- 172.21.15.5:0/4092316127 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f967403b050 con 0x5621aaf612f0 2024-08-31T05:41:58.893 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.887+0000 7f968e013740 10 client.28370 fetch_fsmap learned FSMap version 34 2024-08-31T05:41:58.893 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.887+0000 7f968e013740 1 -- 172.21.15.5:0/4092316127 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5621ab3b6ad0 con 0x5621aaf612f0 2024-08-31T05:41:58.893 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.887+0000 7f9663fff640 1 -- 172.21.15.5:0/4092316127 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9678036030 con 0x5621aaf612f0 2024-08-31T05:41:58.893 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.887+0000 7f9663fff640 1 -- 172.21.15.5:0/4092316127 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f967402f070 con 0x5621aaf612f0 2024-08-31T05:41:58.893 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.887+0000 7f968e013740 10 client.28370 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:41:58.893 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.887+0000 7f968e013740 10 client.28370 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:41:58.893 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.887+0000 7f968e013740 20 client.28370 populate_metadata read hostname 'smithi005' 2024-08-31T05:41:58.893 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.887+0000 7f968e013740 1 --2- 172.21.15.5:0/4092316127 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5621aaf1e1c0 0x5621ab3b9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:58.894 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.887+0000 7f968e013740 4 client.28370 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:41:58.894 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.887+0000 7f968e013740 1 -- 172.21.15.5:0/4092316127 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5621ab2a09f0 con 0x5621aaf1e1c0 2024-08-31T05:41:58.894 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.888+0000 7f967ffff640 1 --2- 172.21.15.5:0/4092316127 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5621aaf1e1c0 0x5621ab3b9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:58.894 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.888+0000 7f967ffff640 1 --2- 172.21.15.5:0/4092316127 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5621aaf1e1c0 0x5621ab3b9340 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4bf2922994ead0ff server_cookie=4309b0fb565ee4ea in_seq=0 out_seq=0 2024-08-31T05:41:58.894 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.888+0000 7f9663fff640 10 client.28370 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:41:58.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.897+0000 7fecc0928740 1 Processor -- start 2024-08-31T05:41:58.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.897+0000 7fecc0928740 1 -- start start 2024-08-31T05:41:58.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.898+0000 7fecc0928740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56304e325cd0 0x56304e7193a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:58.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.898+0000 7fecc0928740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56304e33e490 0x56304e725130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:58.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.898+0000 7fecc0928740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56304e346670 0x56304e7160d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:58.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.898+0000 7fecc0928740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fecb41c00e0 con 0x56304e33e490 2024-08-31T05:41:58.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.898+0000 7fecc0928740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fecb41c1c20 con 0x56304e346670 2024-08-31T05:41:58.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.898+0000 7fecc0928740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fecb41c07b0 con 0x56304e325cd0 2024-08-31T05:41:58.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.898+0000 7fecab7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56304e33e490 0x56304e725130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:58.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.898+0000 7fecb3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56304e325cd0 0x56304e7193a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:58.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.898+0000 7fecab7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56304e33e490 0x56304e725130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40684/0 (socket says 172.21.15.5:40684) 2024-08-31T05:41:58.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.898+0000 7fecab7fe640 1 -- 172.21.15.5:0/1993126786 learned_addr learned my addr 172.21.15.5:0/1993126786 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:58.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.898+0000 7fecb8950640 1 --2- 172.21.15.5:0/1993126786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56304e346670 0x56304e7160d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:58.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.898+0000 7fecab7fe640 1 -- 172.21.15.5:0/1993126786 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56304e325cd0 msgr2=0x56304e7193a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:58.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.898+0000 7fecab7fe640 1 --2- 172.21.15.5:0/1993126786 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56304e325cd0 0x56304e7193a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.898+0000 7fecab7fe640 1 -- 172.21.15.5:0/1993126786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56304e346670 msgr2=0x56304e7160d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:58.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.898+0000 7fecab7fe640 1 --2- 172.21.15.5:0/1993126786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56304e346670 0x56304e7160d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.898+0000 7fecab7fe640 1 -- 172.21.15.5:0/1993126786 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56304e71bbb0 con 0x56304e33e490 2024-08-31T05:41:58.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.898+0000 7fecab7fe640 1 --2- 172.21.15.5:0/1993126786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56304e33e490 0x56304e725130 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7feca4000c00 tx=0x7feca4030340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b79bf445e130dca server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:58.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.899+0000 7feca9ffb640 1 -- 172.21.15.5:0/1993126786 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca404d030 con 0x56304e33e490 2024-08-31T05:41:58.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.899+0000 7feca9ffb640 1 -- 172.21.15.5:0/1993126786 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feca4030a40 con 0x56304e33e490 2024-08-31T05:41:58.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.899+0000 7feca9ffb640 1 -- 172.21.15.5:0/1993126786 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca4037040 con 0x56304e33e490 2024-08-31T05:41:58.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.900+0000 7fecc0928740 1 -- 172.21.15.5:0/1993126786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56304e33e490 msgr2=0x56304e725130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:58.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.900+0000 7fecc0928740 1 --2- 172.21.15.5:0/1993126786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56304e33e490 0x56304e725130 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7feca4000c00 tx=0x7feca4030340 comp rx=0 tx=0).stop 2024-08-31T05:41:58.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.900+0000 7fecc0928740 1 -- 172.21.15.5:0/1993126786 shutdown_connections 2024-08-31T05:41:58.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.900+0000 7fecc0928740 1 --2- 172.21.15.5:0/1993126786 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56304e346670 0x56304e7160d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.900+0000 7fecc0928740 1 --2- 172.21.15.5:0/1993126786 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56304e33e490 0x56304e725130 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.900+0000 7fecc0928740 1 --2- 172.21.15.5:0/1993126786 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56304e325cd0 0x56304e7193a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.900+0000 7fecc0928740 1 -- 172.21.15.5:0/1993126786 >> 172.21.15.5:0/1993126786 conn(0x56304e35b740 msgr2=0x56304e718c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:58.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.900+0000 7fecc0928740 1 -- 172.21.15.5:0/1993126786 shutdown_connections 2024-08-31T05:41:58.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.900+0000 7fecc0928740 1 -- 172.21.15.5:0/1993126786 wait complete. 2024-08-31T05:41:58.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.900+0000 7fecc0928740 1 -- start start 2024-08-31T05:41:58.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.901+0000 7fecc0928740 1 Processor -- start 2024-08-31T05:41:58.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.901+0000 7fecc0928740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56304e325cd0 0x56304e71d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:58.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.901+0000 7fecc0928740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56304e33e490 0x56304e71d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:58.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.901+0000 7fecc0928740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56304e346670 0x56304e71dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:58.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.901+0000 7fecc0928740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fecb41c1550 con 0x56304e325cd0 2024-08-31T05:41:58.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.901+0000 7fecc0928740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fecb41c0e80 con 0x56304e33e490 2024-08-31T05:41:58.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.901+0000 7fecc0928740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fecb41be0e0 con 0x56304e346670 2024-08-31T05:41:58.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.901+0000 7fecb3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56304e325cd0 0x56304e71d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:58.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.901+0000 7fecb3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56304e325cd0 0x56304e71d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40688/0 (socket says 172.21.15.5:40688) 2024-08-31T05:41:58.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.901+0000 7fecb3fff640 1 -- 172.21.15.5:0/2098094120 learned_addr learned my addr 172.21.15.5:0/2098094120 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:41:58.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.901+0000 7fecc0928740 10 client.0 _ll_register_callbacks cb 0x7fecac009460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:41:58.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.901+0000 7fecab7fe640 1 --2- 172.21.15.5:0/2098094120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56304e33e490 0x56304e71d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:58.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.901+0000 7fecb8950640 1 --2- 172.21.15.5:0/2098094120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56304e346670 0x56304e71dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:58.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.901+0000 7fecb3fff640 1 -- 172.21.15.5:0/2098094120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56304e346670 msgr2=0x56304e71dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:58.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.901+0000 7fecb3fff640 1 --2- 172.21.15.5:0/2098094120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56304e346670 0x56304e71dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.901+0000 7fecb3fff640 1 -- 172.21.15.5:0/2098094120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56304e33e490 msgr2=0x56304e71d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:41:58.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.901+0000 7fecb3fff640 1 --2- 172.21.15.5:0/2098094120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56304e33e490 0x56304e71d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.901+0000 7fecb3fff640 1 -- 172.21.15.5:0/2098094120 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56304e794d80 con 0x56304e325cd0 2024-08-31T05:41:58.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.902+0000 7fecb3fff640 1 --2- 172.21.15.5:0/2098094120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56304e325cd0 0x56304e71d250 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fec9c012010 tx=0x7fec9c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26f0a4eae5f4982c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:41:58.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.902+0000 7fec937fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:41:58.909 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.902+0000 7f9663fff640 1 -- 172.21.15.5:0/4092316127 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5621ab2a09f0 con 0x5621aaf1e1c0 2024-08-31T05:41:58.909 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.902+0000 7f9663fff640 10 client.28370 handle_command_reply: tid=0 2024-08-31T05:41:58.909 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.902+0000 7f968e013740 1 client.28370 shutdown 2024-08-31T05:41:58.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.902+0000 7fec937fe640 1 -- 172.21.15.5:0/2098094120 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec9c004250 con 0x56304e325cd0 2024-08-31T05:41:58.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.902+0000 7fec937fe640 1 -- 172.21.15.5:0/2098094120 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9511+0+0 (secure 0 0 0) 0x7fec9c0043f0 con 0x56304e325cd0 2024-08-31T05:41:58.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.902+0000 7fecc0928740 1 -- 172.21.15.5:0/2098094120 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feca4030a40 con 0x56304e325cd0 2024-08-31T05:41:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.902+0000 7f968e013740 1 -- 172.21.15.5:0/4092316127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5621aaf612f0 msgr2=0x5621ab33dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.902+0000 7f968e013740 1 --2- 172.21.15.5:0/4092316127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5621aaf612f0 0x5621ab33dad0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9674012010 tx=0x7f9674005f90 comp rx=0 tx=0).stop 2024-08-31T05:41:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.902+0000 7f968e013740 1 -- 172.21.15.5:0/4092316127 shutdown_connections 2024-08-31T05:41:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.902+0000 7f968e013740 1 --2- 172.21.15.5:0/4092316127 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5621aaf1e1c0 0x5621ab3b9340 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.902+0000 7f968e013740 1 --2- 172.21.15.5:0/4092316127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5621aaf8a1b0 0x5621ab33e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.902+0000 7f9663fff640 0 client.28370 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:41:58.911 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.902+0000 7f968e013740 1 --2- 172.21.15.5:0/4092316127 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621aaf694d0 0x5621ab33e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.902+0000 7fec937fe640 1 -- 172.21.15.5:0/2098094120 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fec9c021910 con 0x56304e325cd0 2024-08-31T05:41:58.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.902+0000 7fecc0928740 10 client.18810 fetch_fsmap learned FSMap version 34 2024-08-31T05:41:58.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.902+0000 7fecc0928740 1 -- 172.21.15.5:0/2098094120 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56304e7960b0 con 0x56304e325cd0 2024-08-31T05:41:58.911 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.902+0000 7f968e013740 1 --2- 172.21.15.5:0/4092316127 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5621aaf612f0 0x5621ab33dad0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.912 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.902+0000 7f968e013740 1 -- 172.21.15.5:0/4092316127 >> 172.21.15.5:0/4092316127 conn(0x5621aaf7e300 msgr2=0x5621ab338a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:58.912 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.903+0000 7f968e013740 1 -- 172.21.15.5:0/4092316127 shutdown_connections 2024-08-31T05:41:58.912 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.903+0000 7f968e013740 1 -- 172.21.15.5:0/4092316127 wait complete. 2024-08-31T05:41:58.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.903+0000 7fec937fe640 1 -- 172.21.15.5:0/2098094120 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec9c038070 con 0x56304e325cd0 2024-08-31T05:41:58.912 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.903+0000 7f968e013740 20 client.28370 trim_cache size 0 max 16384 2024-08-31T05:41:58.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.903+0000 7fec937fe640 1 -- 172.21.15.5:0/2098094120 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fec9c003aa0 con 0x56304e325cd0 2024-08-31T05:41:58.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.903+0000 7fecc0928740 10 client.18810 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:41:58.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.903+0000 7fecc0928740 10 client.18810 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:41:58.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.903+0000 7fecc0928740 20 client.18810 populate_metadata read hostname 'smithi005' 2024-08-31T05:41:58.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.903+0000 7fecc0928740 1 --2- 172.21.15.5:0/2098094120 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56304e367350 0x56304e7988a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:41:58.913 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:41:58.913 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:41:58.913 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:41:58.913 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:41:58.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.903+0000 7fecc0928740 4 client.18810 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T05:41:58.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.903+0000 7fecc0928740 1 -- 172.21.15.5:0/2098094120 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56304e680fe0 con 0x56304e367350 2024-08-31T05:41:58.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.903+0000 7fecab7fe640 1 --2- 172.21.15.5:0/2098094120 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56304e367350 0x56304e7988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:41:58.915 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.903+0000 7f9686fcc640 1 -- 172.21.15.5:0/2189412576 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f96700b4ed0 msgr2=0x7f96700b73e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:58.915 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.903+0000 7f9686fcc640 1 --2- 172.21.15.5:0/2189412576 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f96700b4ed0 0x7f96700b73e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x5621ab32c960 tx=0x7f96740046c0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.915 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.903+0000 7f9686fcc640 1 -- 172.21.15.5:0/2189412576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9680110980 msgr2=0x7f96801a0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:58.915 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.903+0000 7f9686fcc640 1 --2- 172.21.15.5:0/2189412576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9680110980 0x7f96801a0b10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9678009ca0 tx=0x7f9678003ef0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.915 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.903+0000 7f9686fcc640 1 -- 172.21.15.5:0/2189412576 shutdown_connections 2024-08-31T05:41:58.915 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.903+0000 7f9686fcc640 1 --2- 172.21.15.5:0/2189412576 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f96700b4ed0 0x7f96700b73e0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.915 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.903+0000 7f9686fcc640 1 --2- 172.21.15.5:0/2189412576 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9680110980 0x7f96801a0b10 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.915 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.903+0000 7f9686fcc640 1 --2- 172.21.15.5:0/2189412576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9680110030 0x7f96801a0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.916 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.903+0000 7f9686fcc640 1 --2- 172.21.15.5:0/2189412576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f968010ac90 0x7f96801a72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.916 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.903+0000 7f9686fcc640 1 -- 172.21.15.5:0/2189412576 >> 172.21.15.5:0/2189412576 conn(0x7f9680070b30 msgr2=0x7f968010e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:58.916 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.904+0000 7f9686fcc640 1 -- 172.21.15.5:0/2189412576 shutdown_connections 2024-08-31T05:41:58.916 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:41:58.904+0000 7f9686fcc640 1 -- 172.21.15.5:0/2189412576 wait complete. 2024-08-31T05:41:58.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.904+0000 7fec937fe640 10 client.18810 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:41:58.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.904+0000 7fecab7fe640 1 --2- 172.21.15.5:0/2098094120 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56304e367350 0x56304e7988a0 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b3248b457bf284a server_cookie=ada3798f58785148 in_seq=0 out_seq=0 2024-08-31T05:41:58.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.905+0000 7fec937fe640 1 -- 172.21.15.5:0/2098094120 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56304e680fe0 con 0x56304e367350 2024-08-31T05:41:58.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.905+0000 7fec937fe640 10 client.18810 handle_command_reply: tid=0 2024-08-31T05:41:58.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.905+0000 7fecc0928740 1 client.18810 shutdown 2024-08-31T05:41:58.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.905+0000 7fecc0928740 1 -- 172.21.15.5:0/2098094120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56304e325cd0 msgr2=0x56304e71d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:58.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.905+0000 7fecc0928740 1 --2- 172.21.15.5:0/2098094120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56304e325cd0 0x56304e71d250 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fec9c012010 tx=0x7fec9c014000 comp rx=0 tx=0).stop 2024-08-31T05:41:58.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.906+0000 7fecc0928740 1 -- 172.21.15.5:0/2098094120 shutdown_connections 2024-08-31T05:41:58.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.906+0000 7fecc0928740 1 --2- 172.21.15.5:0/2098094120 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56304e367350 0x56304e7988a0 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.906+0000 7fec937fe640 0 client.18810 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:41:58.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.906+0000 7fecc0928740 1 --2- 172.21.15.5:0/2098094120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56304e346670 0x56304e71dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.906+0000 7fecc0928740 1 --2- 172.21.15.5:0/2098094120 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56304e33e490 0x56304e71d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.906+0000 7fecc0928740 1 --2- 172.21.15.5:0/2098094120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56304e325cd0 0x56304e71d250 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.906+0000 7fecc0928740 1 -- 172.21.15.5:0/2098094120 >> 172.21.15.5:0/2098094120 conn(0x56304e35b740 msgr2=0x56304e71a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:58.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.906+0000 7fecc0928740 1 -- 172.21.15.5:0/2098094120 shutdown_connections 2024-08-31T05:41:58.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.906+0000 7fecc0928740 1 -- 172.21.15.5:0/2098094120 wait complete. 2024-08-31T05:41:58.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.906+0000 7fecc0928740 20 client.18810 trim_cache size 0 max 16384 2024-08-31T05:41:58.918 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:41:58.919 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-08-31T05:41:58.919 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "4788e020-0dc9-4938-9db8-dfd5992cb286", 2024-08-31T05:41:58.919 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-08-31T05:41:58.919 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:41:58.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.907+0000 7fecba3b3640 1 -- 172.21.15.5:0/2233247853 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7feca00b4dd0 msgr2=0x7feca00b72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:58.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.907+0000 7fecba3b3640 1 --2- 172.21.15.5:0/2233247853 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7feca00b4dd0 0x7feca00b72e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x56304e70c400 tx=0x7fec9c009530 comp rx=0 tx=0).stop 2024-08-31T05:41:58.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.907+0000 7fecba3b3640 1 -- 172.21.15.5:0/2233247853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fecb41ae9d0 msgr2=0x7fecb41aede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:41:58.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.907+0000 7fecba3b3640 1 --2- 172.21.15.5:0/2233247853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fecb41ae9d0 0x7fecb41aede0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fecac00efc0 tx=0x7fecac00c800 comp rx=0 tx=0).stop 2024-08-31T05:41:58.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.907+0000 7fecba3b3640 1 -- 172.21.15.5:0/2233247853 shutdown_connections 2024-08-31T05:41:58.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.907+0000 7fecba3b3640 1 --2- 172.21.15.5:0/2233247853 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7feca00b4dd0 0x7feca00b72e0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.907+0000 7fecba3b3640 1 --2- 172.21.15.5:0/2233247853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fecb41ae9d0 0x7fecb41aede0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.907+0000 7fecba3b3640 1 --2- 172.21.15.5:0/2233247853 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fecb411c9d0 0x7fecb41a97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.907+0000 7fecba3b3640 1 --2- 172.21.15.5:0/2233247853 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fecb4111ce0 0x7fecb41a9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:41:58.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.907+0000 7fecba3b3640 1 -- 172.21.15.5:0/2233247853 >> 172.21.15.5:0/2233247853 conn(0x7fecb4070c60 msgr2=0x7fecb4071bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:41:58.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.907+0000 7fecba3b3640 1 -- 172.21.15.5:0/2233247853 shutdown_connections 2024-08-31T05:41:58.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:41:58.907+0000 7fecba3b3640 1 -- 172.21.15.5:0/2233247853 wait complete. 2024-08-31T05:41:58.940 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1350186 10.80 MB/sec execute 526 sec latency 53.303 ms 2024-08-31T05:41:59.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:41:58 smithi005 ceph-mon[18602]: pgmap v715: 129 pgs: 129 active+clean; 614 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.1 MiB/s wr, 202 op/s 2024-08-31T05:41:59.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:41:58 smithi070 ceph-mon[22316]: pgmap v715: 129 pgs: 129 active+clean; 614 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.1 MiB/s wr, 202 op/s 2024-08-31T05:41:59.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:41:58 smithi050 ceph-mon[22146]: pgmap v715: 129 pgs: 129 active+clean; 614 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.1 MiB/s wr, 202 op/s 2024-08-31T05:41:59.746 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T05:41:59.940 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1351951 10.79 MB/sec execute 527 sec latency 43.315 ms 2024-08-31T05:42:00.065 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:42:00.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:41:59 smithi005 ceph-mon[18602]: scrub queued for path: / 2024-08-31T05:42:00.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:41:59 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:42:00.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:41:59 smithi005 ceph-mon[18602]: scrub summary: active paths [/] 2024-08-31T05:42:00.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:41:59 smithi005 ceph-mon[18602]: scrub summary: active paths [/] 2024-08-31T05:42:00.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:41:59 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:42:00.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:41:59 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:42:00.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:41:59 smithi070 ceph-mon[22316]: scrub queued for path: / 2024-08-31T05:42:00.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:41:59 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:42:00.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:41:59 smithi070 ceph-mon[22316]: scrub summary: active paths [/] 2024-08-31T05:42:00.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:41:59 smithi070 ceph-mon[22316]: scrub summary: active paths [/] 2024-08-31T05:42:00.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:41:59 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:42:00.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:41:59 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:42:00.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:41:59 smithi050 ceph-mon[22146]: scrub queued for path: / 2024-08-31T05:42:00.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:41:59 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:42:00.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:41:59 smithi050 ceph-mon[22146]: scrub summary: active paths [/] 2024-08-31T05:42:00.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:41:59 smithi050 ceph-mon[22146]: scrub summary: active paths [/] 2024-08-31T05:42:00.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:41:59 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:42:00.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:41:59 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:42:00.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.687+0000 7fe58ac42640 1 -- 172.21.15.5:0/506140592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe584108b10 msgr2=0x7fe58410f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:00.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.687+0000 7fe58ac42640 1 --2- 172.21.15.5:0/506140592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe584108b10 0x7fe58410f340 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe57c009ca0 tx=0x7fe57c02a8c0 comp rx=0 tx=0).stop 2024-08-31T05:42:00.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.687+0000 7fe58ac42640 1 -- 172.21.15.5:0/506140592 shutdown_connections 2024-08-31T05:42:00.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.687+0000 7fe58ac42640 1 --2- 172.21.15.5:0/506140592 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe584108b10 0x7fe58410f340 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:00.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.687+0000 7fe58ac42640 1 --2- 172.21.15.5:0/506140592 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe5841081c0 0x7fe5841085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:00.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.687+0000 7fe58ac42640 1 --2- 172.21.15.5:0/506140592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe584102880 0x7fe584102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:00.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.687+0000 7fe58ac42640 1 -- 172.21.15.5:0/506140592 >> 172.21.15.5:0/506140592 conn(0x7fe584079510 msgr2=0x7fe584079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:00.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.688+0000 7fe58ac42640 1 -- 172.21.15.5:0/506140592 shutdown_connections 2024-08-31T05:42:00.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.688+0000 7fe58ac42640 1 -- 172.21.15.5:0/506140592 wait complete. 2024-08-31T05:42:00.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.688+0000 7fe58ac42640 1 Processor -- start 2024-08-31T05:42:00.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.688+0000 7fe58ac42640 1 -- start start 2024-08-31T05:42:00.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.689+0000 7fe58ac42640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe584102880 0x7fe58419b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:00.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.689+0000 7fe58ac42640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5841081c0 0x7fe58419b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:00.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.689+0000 7fe58ac42640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe584108b10 0x7fe58419bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:00.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.689+0000 7fe58ac42640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe5841127c0 con 0x7fe5841081c0 2024-08-31T05:42:00.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.689+0000 7fe58ac42640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe584112640 con 0x7fe584102880 2024-08-31T05:42:00.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.689+0000 7fe58ac42640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe584112940 con 0x7fe584108b10 2024-08-31T05:42:00.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.689+0000 7fe5889de640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe584102880 0x7fe58419b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:00.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.689+0000 7fe5889de640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe584102880 0x7fe58419b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:47338/0 (socket says 172.21.15.5:47338) 2024-08-31T05:42:00.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.689+0000 7fe5889de640 1 -- 172.21.15.5:0/3303026638 learned_addr learned my addr 172.21.15.5:0/3303026638 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:00.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.689+0000 7fe5891df640 1 --2- 172.21.15.5:0/3303026638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe584108b10 0x7fe58419bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:00.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.689+0000 7fe583fff640 1 --2- 172.21.15.5:0/3303026638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5841081c0 0x7fe58419b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:00.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.689+0000 7fe5889de640 1 -- 172.21.15.5:0/3303026638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe584108b10 msgr2=0x7fe58419bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:00.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.689+0000 7fe5889de640 1 --2- 172.21.15.5:0/3303026638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe584108b10 0x7fe58419bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:00.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.689+0000 7fe5889de640 1 -- 172.21.15.5:0/3303026638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5841081c0 msgr2=0x7fe58419b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:00.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.689+0000 7fe5889de640 1 --2- 172.21.15.5:0/3303026638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5841081c0 0x7fe58419b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:00.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.689+0000 7fe5889de640 1 -- 172.21.15.5:0/3303026638 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5841a62e0 con 0x7fe584102880 2024-08-31T05:42:00.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.689+0000 7fe5889de640 1 --2- 172.21.15.5:0/3303026638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe584102880 0x7fe58419b050 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe57800ea60 tx=0x7fe57800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:00.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.690+0000 7fe581ffb640 1 -- 172.21.15.5:0/3303026638 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe57800cde0 con 0x7fe584102880 2024-08-31T05:42:00.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.690+0000 7fe581ffb640 1 -- 172.21.15.5:0/3303026638 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5780035f0 con 0x7fe584102880 2024-08-31T05:42:00.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.690+0000 7fe58ac42640 1 -- 172.21.15.5:0/3303026638 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5841a65d0 con 0x7fe584102880 2024-08-31T05:42:00.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.690+0000 7fe581ffb640 1 -- 172.21.15.5:0/3303026638 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe578010690 con 0x7fe584102880 2024-08-31T05:42:00.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.690+0000 7fe58ac42640 1 -- 172.21.15.5:0/3303026638 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5841a6b10 con 0x7fe584102880 2024-08-31T05:42:00.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.692+0000 7fe5911b7740 1 Processor -- start 2024-08-31T05:42:00.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.692+0000 7fe5911b7740 1 -- start start 2024-08-31T05:42:00.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.692+0000 7fe581ffb640 1 -- 172.21.15.5:0/3303026638 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fe5780037a0 con 0x7fe584102880 2024-08-31T05:42:00.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.693+0000 7fe5911b7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a8b26ba070 0x55a8b2a5f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:00.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.693+0000 7fe5911b7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8b26911b0 0x55a8b2a5f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:00.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.693+0000 7fe5911b7740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8b2699390 0x55a8b2a5fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:00.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.693+0000 7fe5911b7740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55a8b29d6630 con 0x55a8b2699390 2024-08-31T05:42:00.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.693+0000 7fe5911b7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a8b29c5bc0 con 0x55a8b26911b0 2024-08-31T05:42:00.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.693+0000 7fe5911b7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a8b29c9b70 con 0x55a8b26ba070 2024-08-31T05:42:00.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.693+0000 7fe5889de640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8b26911b0 0x55a8b2a5f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:00.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.693+0000 7fe5891df640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a8b26ba070 0x55a8b2a5f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:00.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.693+0000 7fe5891df640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a8b26ba070 0x55a8b2a5f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:35514/0 (socket says 172.21.15.5:35514) 2024-08-31T05:42:00.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.693+0000 7fe5891df640 1 -- 172.21.15.5:0/956472609 learned_addr learned my addr 172.21.15.5:0/956472609 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:00.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.693+0000 7fe583fff640 1 --2- 172.21.15.5:0/956472609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8b2699390 0x55a8b2a5fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:00.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.693+0000 7fe5891df640 1 -- 172.21.15.5:0/956472609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8b26911b0 msgr2=0x55a8b2a5f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:00.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.693+0000 7fe5891df640 1 --2- 172.21.15.5:0/956472609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8b26911b0 0x55a8b2a5f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:00.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.693+0000 7fe5891df640 1 -- 172.21.15.5:0/956472609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8b2699390 msgr2=0x55a8b2a5fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:00.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.693+0000 7fe5891df640 1 --2- 172.21.15.5:0/956472609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8b2699390 0x55a8b2a5fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:00.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.693+0000 7fe5891df640 1 -- 172.21.15.5:0/956472609 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8b2725650 con 0x55a8b26ba070 2024-08-31T05:42:00.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.693+0000 7fe5891df640 1 --2- 172.21.15.5:0/956472609 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a8b26ba070 0x55a8b2a5f2c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe57c02f410 tx=0x7fe57c02f440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c1d6400aaabc9c8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:00.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.694+0000 7fe581ffb640 1 --2- 172.21.15.5:0/3303026638 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe5740b4cd0 0x7fe5740b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:00.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.694+0000 7fe56effd640 1 -- 172.21.15.5:0/956472609 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe57c031cf0 con 0x55a8b26ba070 2024-08-31T05:42:00.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.694+0000 7fe5889de640 1 --2- 172.21.15.5:0/3303026638 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe5740b4cd0 0x7fe5740b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:00.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.694+0000 7fe56effd640 1 -- 172.21.15.5:0/956472609 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe57c036030 con 0x55a8b26ba070 2024-08-31T05:42:00.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.694+0000 7fe56effd640 1 -- 172.21.15.5:0/956472609 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe57c0042a0 con 0x55a8b26ba070 2024-08-31T05:42:00.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.694+0000 7fe581ffb640 1 -- 172.21.15.5:0/3303026638 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9511+0+0 (secure 0 0 0) 0x7fe5780e5c10 con 0x7fe584102880 2024-08-31T05:42:00.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.695+0000 7fe5911b7740 1 -- 172.21.15.5:0/956472609 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a8b26ba070 msgr2=0x55a8b2a5f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:00.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.695+0000 7fe5889de640 1 --2- 172.21.15.5:0/3303026638 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe5740b4cd0 0x7fe5740b71e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe5780e3030 tx=0x7fe5780e9760 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:00.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.695+0000 7fe5911b7740 1 --2- 172.21.15.5:0/956472609 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a8b26ba070 0x55a8b2a5f2c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe57c02f410 tx=0x7fe57c02f440 comp rx=0 tx=0).stop 2024-08-31T05:42:00.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.695+0000 7fe5911b7740 1 -- 172.21.15.5:0/956472609 shutdown_connections 2024-08-31T05:42:00.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.695+0000 7fe5911b7740 1 --2- 172.21.15.5:0/956472609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8b2699390 0x55a8b2a5fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:00.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.695+0000 7fe5911b7740 1 --2- 172.21.15.5:0/956472609 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8b26911b0 0x55a8b2a5f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:00.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.695+0000 7fe5911b7740 1 --2- 172.21.15.5:0/956472609 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a8b26ba070 0x55a8b2a5f2c0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:00.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.695+0000 7fe5911b7740 1 -- 172.21.15.5:0/956472609 >> 172.21.15.5:0/956472609 conn(0x55a8b26ae460 msgr2=0x55a8b2a5d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:00.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.695+0000 7fe5911b7740 1 -- 172.21.15.5:0/956472609 shutdown_connections 2024-08-31T05:42:00.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.695+0000 7fe5911b7740 1 -- 172.21.15.5:0/956472609 wait complete. 2024-08-31T05:42:00.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.695+0000 7fe5911b7740 1 -- start start 2024-08-31T05:42:00.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.695+0000 7fe5911b7740 1 Processor -- start 2024-08-31T05:42:00.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.696+0000 7fe5911b7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a8b26911b0 0x55a8b2a6aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:00.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.696+0000 7fe5911b7740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8b2699390 0x55a8b2a6af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:00.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.696+0000 7fe5911b7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8b26ba070 0x55a8b2a76bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:00.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.696+0000 7fe5911b7740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55a8b2828700 con 0x55a8b2699390 2024-08-31T05:42:00.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.696+0000 7fe5911b7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a8b294c700 con 0x55a8b26ba070 2024-08-31T05:42:00.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.696+0000 7fe5911b7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a8b2a6d8c0 con 0x55a8b26911b0 2024-08-31T05:42:00.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.696+0000 7fe5911b7740 10 client.0 _ll_register_callbacks cb 0x55a8b297bdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:42:00.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.696+0000 7fe583fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8b2699390 0x55a8b2a6af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:00.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.696+0000 7fe583fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8b2699390 0x55a8b2a6af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40718/0 (socket says 172.21.15.5:40718) 2024-08-31T05:42:00.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.696+0000 7fe583fff640 1 -- 172.21.15.5:0/4207002481 learned_addr learned my addr 172.21.15.5:0/4207002481 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:00.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.696+0000 7fe5891df640 1 --2- 172.21.15.5:0/4207002481 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a8b26911b0 0x55a8b2a6aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:00.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.696+0000 7fe5891df640 1 --2- 172.21.15.5:0/4207002481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8b26ba070 0x55a8b2a76bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:00.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.696+0000 7fe583fff640 1 -- 172.21.15.5:0/4207002481 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a8b26911b0 msgr2=0x55a8b2a6aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:00.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.696+0000 7fe583fff640 1 --2- 172.21.15.5:0/4207002481 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a8b26911b0 0x55a8b2a6aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:00.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.696+0000 7fe583fff640 1 -- 172.21.15.5:0/4207002481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8b26ba070 msgr2=0x55a8b2a76bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:00.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.696+0000 7fe583fff640 1 --2- 172.21.15.5:0/4207002481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8b26ba070 0x55a8b2a76bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:00.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.696+0000 7fe583fff640 1 -- 172.21.15.5:0/4207002481 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8b29858b0 con 0x55a8b2699390 2024-08-31T05:42:00.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.697+0000 7fe583fff640 1 --2- 172.21.15.5:0/4207002481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8b2699390 0x55a8b2a6af60 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fe5700126e0 tx=0x7fe570012ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=225383c828941652 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:00.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.697+0000 7fe563fff640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:42:00.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.697+0000 7fe563fff640 1 -- 172.21.15.5:0/4207002481 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe570012190 con 0x55a8b2699390 2024-08-31T05:42:00.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.697+0000 7fe563fff640 1 -- 172.21.15.5:0/4207002481 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9511+0+0 (secure 0 0 0) 0x7fe57000f920 con 0x55a8b2699390 2024-08-31T05:42:00.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.697+0000 7fe5911b7740 1 -- 172.21.15.5:0/4207002481 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe57c036030 con 0x55a8b2699390 2024-08-31T05:42:00.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.697+0000 7fe563fff640 1 -- 172.21.15.5:0/4207002481 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe57000fb20 con 0x55a8b2699390 2024-08-31T05:42:00.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.697+0000 7fe5911b7740 10 client.18822 fetch_fsmap learned FSMap version 34 2024-08-31T05:42:00.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.697+0000 7fe5911b7740 1 -- 172.21.15.5:0/4207002481 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a8b2a796d0 con 0x55a8b2699390 2024-08-31T05:42:00.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.697+0000 7fe563fff640 1 -- 172.21.15.5:0/4207002481 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe57c036030 con 0x55a8b2699390 2024-08-31T05:42:00.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.697+0000 7fe563fff640 1 -- 172.21.15.5:0/4207002481 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fe570010c90 con 0x55a8b2699390 2024-08-31T05:42:00.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.697+0000 7fe5911b7740 10 client.18822 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:42:00.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.697+0000 7fe5911b7740 10 client.18822 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:42:00.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.697+0000 7fe5911b7740 20 client.18822 populate_metadata read hostname 'smithi005' 2024-08-31T05:42:00.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.697+0000 7fe5911b7740 1 --2- 172.21.15.5:0/4207002481 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a8b26789f0 0x55a8b2a7cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:00.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.697+0000 7fe5911b7740 4 client.18822 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:42:00.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.697+0000 7fe5911b7740 1 -- 172.21.15.5:0/4207002481 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a8b29d8580 con 0x55a8b26789f0 2024-08-31T05:42:00.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.698+0000 7fe5891df640 1 --2- 172.21.15.5:0/4207002481 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a8b26789f0 0x55a8b2a7cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:00.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.698+0000 7fe563fff640 10 client.18822 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:42:00.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.698+0000 7fe5891df640 1 --2- 172.21.15.5:0/4207002481 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a8b26789f0 0x55a8b2a7cc40 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=113d7bbd7218109d server_cookie=c0e56d62a94e5c53 in_seq=0 out_seq=0 2024-08-31T05:42:00.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.699+0000 7fe563fff640 1 -- 172.21.15.5:0/4207002481 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a8b29d8580 con 0x55a8b26789f0 2024-08-31T05:42:00.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.699+0000 7fe563fff640 10 client.18822 handle_command_reply: tid=0 2024-08-31T05:42:00.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.699+0000 7fe5911b7740 1 client.18822 shutdown 2024-08-31T05:42:00.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.699+0000 7fe5911b7740 1 -- 172.21.15.5:0/4207002481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8b2699390 msgr2=0x55a8b2a6af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:00.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.699+0000 7fe5911b7740 1 --2- 172.21.15.5:0/4207002481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8b2699390 0x55a8b2a6af60 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fe5700126e0 tx=0x7fe570012ba0 comp rx=0 tx=0).stop 2024-08-31T05:42:00.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.699+0000 7fe5911b7740 1 -- 172.21.15.5:0/4207002481 shutdown_connections 2024-08-31T05:42:00.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.699+0000 7fe5911b7740 1 --2- 172.21.15.5:0/4207002481 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a8b26789f0 0x55a8b2a7cc40 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:00.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.699+0000 7fe5911b7740 1 --2- 172.21.15.5:0/4207002481 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8b26ba070 0x55a8b2a76bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:00.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.699+0000 7fe5911b7740 1 --2- 172.21.15.5:0/4207002481 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8b2699390 0x55a8b2a6af60 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:00.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.699+0000 7fe5911b7740 1 --2- 172.21.15.5:0/4207002481 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a8b26911b0 0x55a8b2a6aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:00.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.699+0000 7fe5911b7740 1 -- 172.21.15.5:0/4207002481 >> 172.21.15.5:0/4207002481 conn(0x55a8b26ae460 msgr2=0x55a8b2a624a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:00.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.699+0000 7fe563fff640 0 client.18822 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:42:00.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.700+0000 7fe5911b7740 1 -- 172.21.15.5:0/4207002481 shutdown_connections 2024-08-31T05:42:00.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.700+0000 7fe5911b7740 1 -- 172.21.15.5:0/4207002481 wait complete. 2024-08-31T05:42:00.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.700+0000 7fe5911b7740 20 client.18822 trim_cache size 0 max 16384 2024-08-31T05:42:00.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.717+0000 7fe5911b7740 1 Processor -- start 2024-08-31T05:42:00.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.717+0000 7fe5911b7740 1 -- start start 2024-08-31T05:42:00.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.718+0000 7fe5911b7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a8b26911b0 0x55a8b2a5d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:00.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.718+0000 7fe5911b7740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8b2699390 0x55a8b2a76ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:00.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.718+0000 7fe5911b7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8b26ba070 0x55a8b2a67c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:00.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.718+0000 7fe5911b7740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe5841b0cd0 con 0x55a8b2699390 2024-08-31T05:42:00.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.718+0000 7fe5911b7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe5841b2810 con 0x55a8b26ba070 2024-08-31T05:42:00.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.718+0000 7fe5911b7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe5841b13a0 con 0x55a8b26911b0 2024-08-31T05:42:00.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.718+0000 7fe583fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8b2699390 0x55a8b2a76ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:00.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.718+0000 7fe583fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8b2699390 0x55a8b2a76ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40722/0 (socket says 172.21.15.5:40722) 2024-08-31T05:42:00.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.718+0000 7fe583fff640 1 -- 172.21.15.5:0/1856484994 learned_addr learned my addr 172.21.15.5:0/1856484994 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:00.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.718+0000 7fe5891df640 1 --2- 172.21.15.5:0/1856484994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8b26ba070 0x55a8b2a67c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:00.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.718+0000 7fe5891df640 1 --2- 172.21.15.5:0/1856484994 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a8b26911b0 0x55a8b2a5d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:00.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.718+0000 7fe583fff640 1 -- 172.21.15.5:0/1856484994 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a8b26911b0 msgr2=0x55a8b2a5d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:00.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.718+0000 7fe583fff640 1 --2- 172.21.15.5:0/1856484994 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a8b26911b0 0x55a8b2a5d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:00.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.718+0000 7fe583fff640 1 -- 172.21.15.5:0/1856484994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8b26ba070 msgr2=0x55a8b2a67c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:00.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.718+0000 7fe583fff640 1 --2- 172.21.15.5:0/1856484994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8b26ba070 0x55a8b2a67c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:00.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.718+0000 7fe583fff640 1 -- 172.21.15.5:0/1856484994 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8b2a615b0 con 0x55a8b2699390 2024-08-31T05:42:00.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.718+0000 7fe583fff640 1 --2- 172.21.15.5:0/1856484994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8b2699390 0x55a8b2a76ab0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fe57000f810 tx=0x7fe570005e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e995b0d11ee0482 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:00.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.719+0000 7fe56e7fc640 1 -- 172.21.15.5:0/1856484994 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe570012190 con 0x55a8b2699390 2024-08-31T05:42:00.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.719+0000 7fe56e7fc640 1 -- 172.21.15.5:0/1856484994 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe570005590 con 0x55a8b2699390 2024-08-31T05:42:00.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.719+0000 7fe56e7fc640 1 -- 172.21.15.5:0/1856484994 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe57001cd00 con 0x55a8b2699390 2024-08-31T05:42:00.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.719+0000 7fe5911b7740 1 -- 172.21.15.5:0/1856484994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8b2699390 msgr2=0x55a8b2a76ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:00.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.719+0000 7fe5911b7740 1 --2- 172.21.15.5:0/1856484994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8b2699390 0x55a8b2a76ab0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fe57000f810 tx=0x7fe570005e70 comp rx=0 tx=0).stop 2024-08-31T05:42:00.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.719+0000 7fe5911b7740 1 -- 172.21.15.5:0/1856484994 shutdown_connections 2024-08-31T05:42:00.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.719+0000 7fe5911b7740 1 --2- 172.21.15.5:0/1856484994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8b26ba070 0x55a8b2a67c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:00.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.719+0000 7fe5911b7740 1 --2- 172.21.15.5:0/1856484994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8b2699390 0x55a8b2a76ab0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:00.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.719+0000 7fe5911b7740 1 --2- 172.21.15.5:0/1856484994 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a8b26911b0 0x55a8b2a5d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:00.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.719+0000 7fe5911b7740 1 -- 172.21.15.5:0/1856484994 >> 172.21.15.5:0/1856484994 conn(0x55a8b26ae460 msgr2=0x55a8b2a5cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:00.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.719+0000 7fe5911b7740 1 -- 172.21.15.5:0/1856484994 shutdown_connections 2024-08-31T05:42:00.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.719+0000 7fe5911b7740 1 -- 172.21.15.5:0/1856484994 wait complete. 2024-08-31T05:42:00.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.720+0000 7fe5911b7740 1 -- start start 2024-08-31T05:42:00.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.720+0000 7fe5911b7740 1 Processor -- start 2024-08-31T05:42:00.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.720+0000 7fe5911b7740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8b26911b0 0x55a8b2a6eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:00.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.720+0000 7fe5911b7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a8b2699390 0x55a8b2a6eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:00.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.720+0000 7fe5911b7740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8b26ba070 0x55a8b2a6f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:00.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.720+0000 7fe5911b7740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe5841b2140 con 0x55a8b26911b0 2024-08-31T05:42:00.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.720+0000 7fe5911b7740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fe5841b1a70 con 0x55a8b26ba070 2024-08-31T05:42:00.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.720+0000 7fe5911b7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe5841aecd0 con 0x55a8b2699390 2024-08-31T05:42:00.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.720+0000 7fe5911b7740 10 client.0 _ll_register_callbacks cb 0x7fe570009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:42:00.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.720+0000 7fe5891df640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8b26911b0 0x55a8b2a6eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:00.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.720+0000 7fe5891df640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8b26911b0 0x55a8b2a6eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40726/0 (socket says 172.21.15.5:40726) 2024-08-31T05:42:00.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.720+0000 7fe5891df640 1 -- 172.21.15.5:0/3142068845 learned_addr learned my addr 172.21.15.5:0/3142068845 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:00.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.721+0000 7fe583fff640 1 --2- 172.21.15.5:0/3142068845 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a8b2699390 0x55a8b2a6eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:00.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.721+0000 7fe5891df640 1 --2- 172.21.15.5:0/3142068845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8b26ba070 0x55a8b2a6f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:00.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.721+0000 7fe5891df640 1 -- 172.21.15.5:0/3142068845 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a8b2699390 msgr2=0x55a8b2a6eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:00.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.721+0000 7fe5891df640 1 --2- 172.21.15.5:0/3142068845 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a8b2699390 0x55a8b2a6eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:00.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.721+0000 7fe5891df640 1 -- 172.21.15.5:0/3142068845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8b26ba070 msgr2=0x55a8b2a6f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:00.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.721+0000 7fe5891df640 1 --2- 172.21.15.5:0/3142068845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8b26ba070 0x55a8b2a6f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:00.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.721+0000 7fe5891df640 1 -- 172.21.15.5:0/3142068845 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8b2ae65f0 con 0x55a8b26911b0 2024-08-31T05:42:00.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.721+0000 7fe583fff640 1 --2- 172.21.15.5:0/3142068845 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a8b2699390 0x55a8b2a6eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:42:00.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.721+0000 7fe5891df640 1 --2- 172.21.15.5:0/3142068845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8b26911b0 0x55a8b2a6eab0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fe57c006010 tx=0x7fe570009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42d5875c95fec164 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:00.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.721+0000 7fe563fff640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:42:00.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.721+0000 7fe563fff640 1 -- 172.21.15.5:0/3142068845 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe57c068060 con 0x55a8b26911b0 2024-08-31T05:42:00.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.721+0000 7fe563fff640 1 -- 172.21.15.5:0/3142068845 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9511+0+0 (secure 0 0 0) 0x7fe57c04a040 con 0x55a8b26911b0 2024-08-31T05:42:00.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.721+0000 7fe5911b7740 1 -- 172.21.15.5:0/3142068845 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a8b2a62fe0 con 0x55a8b26911b0 2024-08-31T05:42:00.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.721+0000 7fe563fff640 1 -- 172.21.15.5:0/3142068845 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe57c031510 con 0x55a8b26911b0 2024-08-31T05:42:00.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.721+0000 7fe5911b7740 10 client.18828 fetch_fsmap learned FSMap version 34 2024-08-31T05:42:00.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.721+0000 7fe5911b7740 1 -- 172.21.15.5:0/3142068845 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a8b2ae7850 con 0x55a8b26911b0 2024-08-31T05:42:00.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.722+0000 7fe563fff640 1 -- 172.21.15.5:0/3142068845 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55a8b2a62fe0 con 0x55a8b26911b0 2024-08-31T05:42:00.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.722+0000 7fe563fff640 1 -- 172.21.15.5:0/3142068845 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fe57c043070 con 0x55a8b26911b0 2024-08-31T05:42:00.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.722+0000 7fe5911b7740 10 client.18828 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:42:00.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.722+0000 7fe5911b7740 10 client.18828 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:42:00.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.722+0000 7fe5911b7740 20 client.18828 populate_metadata read hostname 'smithi005' 2024-08-31T05:42:00.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.722+0000 7fe5911b7740 1 --2- 172.21.15.5:0/3142068845 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a8b264dda0 0x55a8b2ae9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:00.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.722+0000 7fe5911b7740 4 client.18828 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T05:42:00.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.722+0000 7fe5911b7740 1 -- 172.21.15.5:0/3142068845 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a8b2a7d1e0 con 0x55a8b264dda0 2024-08-31T05:42:00.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.722+0000 7fe583fff640 1 --2- 172.21.15.5:0/3142068845 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a8b264dda0 0x55a8b2ae9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:00.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.723+0000 7fe583fff640 1 --2- 172.21.15.5:0/3142068845 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a8b264dda0 0x55a8b2ae9d00 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd7317f9288c6a24 server_cookie=7eb8a5441df39d88 in_seq=0 out_seq=0 2024-08-31T05:42:00.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.723+0000 7fe563fff640 10 client.18828 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:42:00.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.723+0000 7fe563fff640 1 -- 172.21.15.5:0/3142068845 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4830 (crc 0 0 0) 0x55a8b2a7d1e0 con 0x55a8b264dda0 2024-08-31T05:42:00.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.723+0000 7fe563fff640 10 client.18828 handle_command_reply: tid=0 2024-08-31T05:42:00.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.723+0000 7fe5911b7740 1 client.18828 shutdown 2024-08-31T05:42:00.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.723+0000 7fe5911b7740 1 -- 172.21.15.5:0/3142068845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8b26911b0 msgr2=0x55a8b2a6eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:00.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.723+0000 7fe5911b7740 1 --2- 172.21.15.5:0/3142068845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8b26911b0 0x55a8b2a6eab0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fe57c006010 tx=0x7fe570009e30 comp rx=0 tx=0).stop 2024-08-31T05:42:00.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.723+0000 7fe5911b7740 1 -- 172.21.15.5:0/3142068845 shutdown_connections 2024-08-31T05:42:00.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.723+0000 7fe5911b7740 1 --2- 172.21.15.5:0/3142068845 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a8b264dda0 0x55a8b2ae9d00 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:00.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.723+0000 7fe5911b7740 1 --2- 172.21.15.5:0/3142068845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a8b26ba070 0x55a8b2a6f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:00.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.723+0000 7fe5911b7740 1 --2- 172.21.15.5:0/3142068845 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a8b2699390 0x55a8b2a6eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:00.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.723+0000 7fe563fff640 0 client.18828 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:42:00.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.723+0000 7fe5911b7740 1 --2- 172.21.15.5:0/3142068845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a8b26911b0 0x55a8b2a6eab0 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:00.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.723+0000 7fe5911b7740 1 -- 172.21.15.5:0/3142068845 >> 172.21.15.5:0/3142068845 conn(0x55a8b26ae460 msgr2=0x55a8b2a602f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:00.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.723+0000 7fe5911b7740 1 -- 172.21.15.5:0/3142068845 shutdown_connections 2024-08-31T05:42:00.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.723+0000 7fe5911b7740 1 -- 172.21.15.5:0/3142068845 wait complete. 2024-08-31T05:42:00.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.723+0000 7fe5911b7740 20 client.18828 trim_cache size 0 max 16384 2024-08-31T05:42:00.736 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:42:00.736 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T05:42:00.737 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2024-08-31T05:42:00.737 INFO:teuthology.orchestra.run.smithi005.stdout: "4788e020-0dc9-4938-9db8-dfd5992cb286": { 2024-08-31T05:42:00.737 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:42:00.737 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "4788e020-0dc9-4938-9db8-dfd5992cb286", 2024-08-31T05:42:00.737 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2024-08-31T05:42:00.737 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:42:00.737 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:42:00.737 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_stats": { 2024-08-31T05:42:00.737 INFO:teuthology.orchestra.run.smithi005.stdout: "ab2853ca-505f-43fc-a132-af8bca186292": { 2024-08-31T05:42:00.737 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:40:23.937602+0000", 2024-08-31T05:42:00.737 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:42:00.737 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:42:00.737 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:42:00.737 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:42:00.738 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:42:00.738 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:42:00.738 INFO:teuthology.orchestra.run.smithi005.stdout: "75d84398-5d9c-4872-b879-2fbce045fa71": { 2024-08-31T05:42:00.738 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:06.642335+0000", 2024-08-31T05:42:00.738 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:42:00.738 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:42:00.738 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:42:00.738 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:42:00.738 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:42:00.738 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:42:00.738 INFO:teuthology.orchestra.run.smithi005.stdout: "ece37b07-9ab2-45f8-bc33-2755a07aac0b": { 2024-08-31T05:42:00.738 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:31:41.782407+0000", 2024-08-31T05:42:00.738 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:42:00.739 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:42:00.739 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:42:00.739 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:42:00.739 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:42:00.739 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:42:00.739 INFO:teuthology.orchestra.run.smithi005.stdout: "728a42ca-bbef-4151-830f-5fdd411d8fa0": { 2024-08-31T05:42:00.739 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:32:30.554906+0000", 2024-08-31T05:42:00.739 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:42:00.739 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:42:00.739 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:42:00.739 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:42:00.739 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:42:00.739 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:42:00.739 INFO:teuthology.orchestra.run.smithi005.stdout: "cda92ac0-b35f-47a5-a3a5-471c888462a5": { 2024-08-31T05:42:00.740 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:53.103905+0000", 2024-08-31T05:42:00.740 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:42:00.740 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:42:00.740 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:42:00.740 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:42:00.740 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:42:00.740 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:42:00.740 INFO:teuthology.orchestra.run.smithi005.stdout: "0bb67292-013a-40c7-b5fc-810bdd9715d8": { 2024-08-31T05:42:00.740 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:34:04.586008+0000", 2024-08-31T05:42:00.740 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:42:00.740 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:42:00.740 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:42:00.740 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:42:00.740 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:42:00.741 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:42:00.741 INFO:teuthology.orchestra.run.smithi005.stdout: "c9a687a5-4adf-4788-8f18-4c06352efa9b": { 2024-08-31T05:42:00.741 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:41:11.380197+0000", 2024-08-31T05:42:00.741 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:42:00.741 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:42:00.741 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:42:00.741 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:42:00.741 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:42:00.741 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:42:00.741 INFO:teuthology.orchestra.run.smithi005.stdout: "de9731c7-ae4a-42fe-8146-e4752cdc40d4": { 2024-08-31T05:42:00.741 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:34:53.614499+0000", 2024-08-31T05:42:00.741 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:42:00.742 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:42:00.742 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:42:00.742 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:42:00.742 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:42:00.742 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:42:00.742 INFO:teuthology.orchestra.run.smithi005.stdout: "f4db3406-20ff-46a3-baf9-099e16392f76": { 2024-08-31T05:42:00.742 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:38:49.034412+0000", 2024-08-31T05:42:00.742 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:42:00.742 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:42:00.742 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:42:00.743 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:42:00.743 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:42:00.743 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:42:00.743 INFO:teuthology.orchestra.run.smithi005.stdout: "095ccc7a-f368-4bc6-9563-5930e21f9b4a": { 2024-08-31T05:42:00.743 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:35:40.190069+0000", 2024-08-31T05:42:00.743 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:42:00.743 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:42:00.743 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:42:00.743 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:42:00.744 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:42:00.744 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:42:00.744 INFO:teuthology.orchestra.run.smithi005.stdout: "4788e020-0dc9-4938-9db8-dfd5992cb286": { 2024-08-31T05:42:00.744 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:41:58.905797+0000", 2024-08-31T05:42:00.744 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:42:00.744 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:42:00.744 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:42:00.744 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:42:00.745 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:42:00.745 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:42:00.745 INFO:teuthology.orchestra.run.smithi005.stdout: "297c26f3-7b4d-4245-abb0-f854248e5e1b": { 2024-08-31T05:42:00.745 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:37:14.019244+0000", 2024-08-31T05:42:00.745 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:42:00.745 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:42:00.745 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:42:00.745 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:42:00.745 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:42:00.746 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:42:00.746 INFO:teuthology.orchestra.run.smithi005.stdout: "a4d4cf74-2477-4dd9-a3a2-3762b4dd87e4": { 2024-08-31T05:42:00.746 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:38:01.378833+0000", 2024-08-31T05:42:00.746 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:42:00.746 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:42:00.746 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:42:00.746 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:42:00.746 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:42:00.747 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:42:00.747 INFO:teuthology.orchestra.run.smithi005.stdout: "94c23057-592d-4a8b-82d7-da2d84f8740b": { 2024-08-31T05:42:00.747 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:36:27.513638+0000", 2024-08-31T05:42:00.747 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:42:00.747 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:42:00.747 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:42:00.747 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:42:00.747 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:42:00.747 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:42:00.748 INFO:teuthology.orchestra.run.smithi005.stdout: "2445fc42-b797-434f-b380-e2da985b4d98": { 2024-08-31T05:42:00.748 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:33:17.681453+0000", 2024-08-31T05:42:00.748 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:42:00.748 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:42:00.748 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:42:00.748 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:42:00.748 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:42:00.748 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:42:00.749 INFO:teuthology.orchestra.run.smithi005.stdout: "239b7958-db06-4432-93ce-b7552effa357": { 2024-08-31T05:42:00.749 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:39:35.733028+0000", 2024-08-31T05:42:00.749 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:42:00.749 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:42:00.749 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:42:00.749 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:42:00.749 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:42:00.749 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:42:00.749 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:42:00.750 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:42:00.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.724+0000 7fe58ac42640 1 -- 172.21.15.5:0/3303026638 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe5740b4cd0 msgr2=0x7fe5740b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:00.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.724+0000 7fe58ac42640 1 --2- 172.21.15.5:0/3303026638 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe5740b4cd0 0x7fe5740b71e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe5780e3030 tx=0x7fe5780e9760 comp rx=0 tx=0).stop 2024-08-31T05:42:00.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.724+0000 7fe58ac42640 1 -- 172.21.15.5:0/3303026638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe584102880 msgr2=0x7fe58419b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:00.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.724+0000 7fe58ac42640 1 --2- 172.21.15.5:0/3303026638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe584102880 0x7fe58419b050 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe57800ea60 tx=0x7fe57800ef20 comp rx=0 tx=0).stop 2024-08-31T05:42:00.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.724+0000 7fe58ac42640 1 -- 172.21.15.5:0/3303026638 shutdown_connections 2024-08-31T05:42:00.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.724+0000 7fe58ac42640 1 --2- 172.21.15.5:0/3303026638 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fe5740b4cd0 0x7fe5740b71e0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:00.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.724+0000 7fe58ac42640 1 --2- 172.21.15.5:0/3303026638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe584108b10 0x7fe58419bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:00.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.724+0000 7fe58ac42640 1 --2- 172.21.15.5:0/3303026638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5841081c0 0x7fe58419b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:00.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.724+0000 7fe58ac42640 1 --2- 172.21.15.5:0/3303026638 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fe584102880 0x7fe58419b050 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:00.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.724+0000 7fe58ac42640 1 -- 172.21.15.5:0/3303026638 >> 172.21.15.5:0/3303026638 conn(0x7fe584079510 msgr2=0x7fe584106210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:00.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.724+0000 7fe58ac42640 1 -- 172.21.15.5:0/3303026638 shutdown_connections 2024-08-31T05:42:00.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:00.724+0000 7fe58ac42640 1 -- 172.21.15.5:0/3303026638 wait complete. 2024-08-31T05:42:00.940 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1353915 10.79 MB/sec execute 528 sec latency 17.813 ms 2024-08-31T05:42:01.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:42:00 smithi005 ceph-mon[18602]: pgmap v716: 129 pgs: 129 active+clean; 618 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 5.0 MiB/s wr, 252 op/s 2024-08-31T05:42:01.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:42:00 smithi070 ceph-mon[22316]: pgmap v716: 129 pgs: 129 active+clean; 618 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 5.0 MiB/s wr, 252 op/s 2024-08-31T05:42:01.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:42:00 smithi050 ceph-mon[22146]: pgmap v716: 129 pgs: 129 active+clean; 618 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 5.0 MiB/s wr, 252 op/s 2024-08-31T05:42:01.575 INFO:tasks.cephfs.filesystem:scrub status for tag:4788e020-0dc9-4938-9db8-dfd5992cb286 - {'path': '/', 'tag': '4788e020-0dc9-4938-9db8-dfd5992cb286', 'options': 'recursive,force'} 2024-08-31T05:42:01.940 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1354208 10.77 MB/sec execute 529 sec latency 96.963 ms 2024-08-31T05:42:02.940 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1356557 10.78 MB/sec execute 530 sec latency 16.169 ms 2024-08-31T05:42:03.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:42:02 smithi070 ceph-mon[22316]: pgmap v717: 129 pgs: 129 active+clean; 628 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.7 MiB/s wr, 238 op/s 2024-08-31T05:42:03.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:42:02 smithi050 ceph-mon[22146]: pgmap v717: 129 pgs: 129 active+clean; 628 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.7 MiB/s wr, 238 op/s 2024-08-31T05:42:03.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:42:02 smithi005 ceph-mon[18602]: pgmap v717: 129 pgs: 129 active+clean; 628 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.7 MiB/s wr, 238 op/s 2024-08-31T05:42:03.940 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1357996 10.77 MB/sec execute 531 sec latency 106.763 ms 2024-08-31T05:42:04.940 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1359915 10.77 MB/sec execute 532 sec latency 165.573 ms 2024-08-31T05:42:05.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:42:04 smithi070 ceph-mon[22316]: pgmap v718: 129 pgs: 129 active+clean; 628 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.1 MiB/s wr, 227 op/s 2024-08-31T05:42:05.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:42:04 smithi050 ceph-mon[22146]: pgmap v718: 129 pgs: 129 active+clean; 628 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.1 MiB/s wr, 227 op/s 2024-08-31T05:42:05.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:42:04 smithi005 ceph-mon[18602]: pgmap v718: 129 pgs: 129 active+clean; 628 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.1 MiB/s wr, 227 op/s 2024-08-31T05:42:05.940 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1361611 10.77 MB/sec execute 533 sec latency 15.598 ms 2024-08-31T05:42:06.940 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1363949 10.78 MB/sec execute 534 sec latency 15.224 ms 2024-08-31T05:42:07.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:42:06 smithi070 ceph-mon[22316]: pgmap v719: 129 pgs: 129 active+clean; 632 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 5.2 MiB/s wr, 288 op/s 2024-08-31T05:42:07.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:42:06 smithi050 ceph-mon[22146]: pgmap v719: 129 pgs: 129 active+clean; 632 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 5.2 MiB/s wr, 288 op/s 2024-08-31T05:42:07.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:42:06 smithi005 ceph-mon[18602]: pgmap v719: 129 pgs: 129 active+clean; 632 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 5.2 MiB/s wr, 288 op/s 2024-08-31T05:42:07.940 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1365153 10.77 MB/sec execute 535 sec latency 43.266 ms 2024-08-31T05:42:08.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:42:07 smithi070 ceph-mon[22316]: scrub summary: idle 2024-08-31T05:42:08.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:42:07 smithi050 ceph-mon[22146]: scrub summary: idle 2024-08-31T05:42:08.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:42:07 smithi005 ceph-mon[18602]: scrub summary: idle 2024-08-31T05:42:08.940 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1366563 10.76 MB/sec execute 536 sec latency 33.495 ms 2024-08-31T05:42:09.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:42:08 smithi070 ceph-mon[22316]: scrub summary: idle 2024-08-31T05:42:09.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:42:08 smithi070 ceph-mon[22316]: pgmap v720: 129 pgs: 129 active+clean; 636 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.2 MiB/s wr, 241 op/s 2024-08-31T05:42:09.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:42:08 smithi070 ceph-mon[22316]: osdmap e98: 12 total, 12 up, 12 in 2024-08-31T05:42:09.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:42:08 smithi050 ceph-mon[22146]: scrub summary: idle 2024-08-31T05:42:09.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:42:08 smithi050 ceph-mon[22146]: pgmap v720: 129 pgs: 129 active+clean; 636 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.2 MiB/s wr, 241 op/s 2024-08-31T05:42:09.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:42:08 smithi050 ceph-mon[22146]: osdmap e98: 12 total, 12 up, 12 in 2024-08-31T05:42:09.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:42:08 smithi005 ceph-mon[18602]: scrub summary: idle 2024-08-31T05:42:09.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:42:08 smithi005 ceph-mon[18602]: pgmap v720: 129 pgs: 129 active+clean; 636 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.2 MiB/s wr, 241 op/s 2024-08-31T05:42:09.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:42:08 smithi005 ceph-mon[18602]: osdmap e98: 12 total, 12 up, 12 in 2024-08-31T05:42:09.940 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1367946 10.75 MB/sec execute 537 sec latency 131.425 ms 2024-08-31T05:42:10.940 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1370158 10.75 MB/sec execute 538 sec latency 16.500 ms 2024-08-31T05:42:11.335 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:42:10 smithi070 ceph-mon[22316]: pgmap v722: 129 pgs: 129 active+clean; 595 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.4 MiB/s wr, 250 op/s 2024-08-31T05:42:11.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:42:10 smithi050 ceph-mon[22146]: pgmap v722: 129 pgs: 129 active+clean; 595 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.4 MiB/s wr, 250 op/s 2024-08-31T05:42:11.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:42:10 smithi005 ceph-mon[18602]: pgmap v722: 129 pgs: 129 active+clean; 595 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.4 MiB/s wr, 250 op/s 2024-08-31T05:42:11.940 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1371718 10.75 MB/sec execute 539 sec latency 37.351 ms 2024-08-31T05:42:12.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.007+0000 7f7c0c9fe640 1 -- 172.21.15.5:0/2447456084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c08107f00 msgr2=0x7f7c08108310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:12.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.007+0000 7f7c0c9fe640 1 --2- 172.21.15.5:0/2447456084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c08107f00 0x7f7c08108310 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc009900 tx=0x7f7bfc02a410 comp rx=0 tx=0).stop 2024-08-31T05:42:12.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.007+0000 7f7c0c9fe640 1 -- 172.21.15.5:0/2447456084 shutdown_connections 2024-08-31T05:42:12.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.007+0000 7f7c0c9fe640 1 --2- 172.21.15.5:0/2447456084 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c08108850 0x7f7c0810f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:12.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.007+0000 7f7c0c9fe640 1 --2- 172.21.15.5:0/2447456084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c08107f00 0x7f7c08108310 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:12.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.007+0000 7f7c0c9fe640 1 --2- 172.21.15.5:0/2447456084 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c081025d0 0x7f7c081029e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:12.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.007+0000 7f7c0c9fe640 1 -- 172.21.15.5:0/2447456084 >> 172.21.15.5:0/2447456084 conn(0x7f7c080fdfd0 msgr2=0x7f7c08100420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:12.010 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.007+0000 7f7c0c9fe640 1 -- 172.21.15.5:0/2447456084 shutdown_connections 2024-08-31T05:42:12.010 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.007+0000 7f7c0c9fe640 1 -- 172.21.15.5:0/2447456084 wait complete. 2024-08-31T05:42:12.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.008+0000 7f7c0c9fe640 1 Processor -- start 2024-08-31T05:42:12.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.008+0000 7f7c0c9fe640 1 -- start start 2024-08-31T05:42:12.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.008+0000 7f7c0c9fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c081025d0 0x7f7c0819a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:12.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.008+0000 7f7c0c9fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c08107f00 0x7f7c0819a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:12.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.008+0000 7f7c0c9fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c08108850 0x7f7c0819f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:12.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.008+0000 7f7c0c9fe640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7c081124e0 con 0x7f7c081025d0 2024-08-31T05:42:12.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.008+0000 7f7c0c9fe640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7c08112360 con 0x7f7c08108850 2024-08-31T05:42:12.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.008+0000 7f7c0c9fe640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7c08112660 con 0x7f7c08107f00 2024-08-31T05:42:12.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.008+0000 7f7c06d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c081025d0 0x7f7c0819a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:12.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.008+0000 7f7c06d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c081025d0 0x7f7c0819a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41630/0 (socket says 172.21.15.5:41630) 2024-08-31T05:42:12.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.008+0000 7f7c06d9d640 1 -- 172.21.15.5:0/1282811741 learned_addr learned my addr 172.21.15.5:0/1282811741 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:12.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.008+0000 7f7c0659c640 1 --2- 172.21.15.5:0/1282811741 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c08107f00 0x7f7c0819a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:12.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.008+0000 7f7c0759e640 1 --2- 172.21.15.5:0/1282811741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c08108850 0x7f7c0819f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:12.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.009+0000 7f7c06d9d640 1 -- 172.21.15.5:0/1282811741 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c08107f00 msgr2=0x7f7c0819a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:12.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.009+0000 7f7c06d9d640 1 --2- 172.21.15.5:0/1282811741 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c08107f00 0x7f7c0819a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:12.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.009+0000 7f7c06d9d640 1 -- 172.21.15.5:0/1282811741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c08108850 msgr2=0x7f7c0819f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:12.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.009+0000 7f7c06d9d640 1 --2- 172.21.15.5:0/1282811741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c08108850 0x7f7c0819f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:12.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.009+0000 7f7c06d9d640 1 -- 172.21.15.5:0/1282811741 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c0819ffc0 con 0x7f7c081025d0 2024-08-31T05:42:12.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.009+0000 7f7c0659c640 1 --2- 172.21.15.5:0/1282811741 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c08107f00 0x7f7c0819a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:42:12.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.009+0000 7f7c06d9d640 1 --2- 172.21.15.5:0/1282811741 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c081025d0 0x7f7c0819a090 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f7bf800e9f0 tx=0x7f7bf800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:12.014 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.009+0000 7f7beffff640 1 -- 172.21.15.5:0/1282811741 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf800cd80 con 0x7f7c081025d0 2024-08-31T05:42:12.014 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.009+0000 7f7beffff640 1 -- 172.21.15.5:0/1282811741 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7bf80108e0 con 0x7f7c081025d0 2024-08-31T05:42:12.014 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.009+0000 7f7c0c9fe640 1 -- 172.21.15.5:0/1282811741 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c081a02b0 con 0x7f7c081025d0 2024-08-31T05:42:12.014 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.009+0000 7f7beffff640 1 -- 172.21.15.5:0/1282811741 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf8018980 con 0x7f7c081025d0 2024-08-31T05:42:12.014 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.009+0000 7f7c0c9fe640 1 -- 172.21.15.5:0/1282811741 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c081a6a40 con 0x7f7c081025d0 2024-08-31T05:42:12.022 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.012+0000 7f7c14245740 1 Processor -- start 2024-08-31T05:42:12.022 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.012+0000 7f7c14245740 1 -- start start 2024-08-31T05:42:12.022 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.012+0000 7f7beffff640 1 -- 172.21.15.5:0/1282811741 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f7bf8010430 con 0x7f7c081025d0 2024-08-31T05:42:12.022 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.012+0000 7f7c14245740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d8d2fa1b0 0x564d8d69dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:12.022 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.012+0000 7f7c14245740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d8d2d12f0 0x564d8d69e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:12.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.012+0000 7f7c14245740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d8d2d94d0 0x564d8d69e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:12.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.012+0000 7f7c14245740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x564d8d613000 con 0x564d8d2d94d0 2024-08-31T05:42:12.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.012+0000 7f7c14245740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564d8d602590 con 0x564d8d2fa1b0 2024-08-31T05:42:12.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.012+0000 7f7c14245740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564d8d606540 con 0x564d8d2d12f0 2024-08-31T05:42:12.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.012+0000 7f7c0659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d8d2d94d0 0x564d8d69e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:12.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.012+0000 7f7c0659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d8d2d94d0 0x564d8d69e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41632/0 (socket says 172.21.15.5:41632) 2024-08-31T05:42:12.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.012+0000 7f7c0659c640 1 -- 172.21.15.5:0/636996796 learned_addr learned my addr 172.21.15.5:0/636996796 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:12.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.012+0000 7f7c06d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d8d2d12f0 0x564d8d69e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:12.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.012+0000 7f7c0759e640 1 --2- 172.21.15.5:0/636996796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d8d2fa1b0 0x564d8d69dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:12.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.013+0000 7f7c0759e640 1 -- 172.21.15.5:0/636996796 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d8d2d12f0 msgr2=0x564d8d69e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:12.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.013+0000 7f7c0759e640 1 --2- 172.21.15.5:0/636996796 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d8d2d12f0 0x564d8d69e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:12.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.013+0000 7f7c0759e640 1 -- 172.21.15.5:0/636996796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d8d2d94d0 msgr2=0x564d8d69e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:12.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.013+0000 7f7c0759e640 1 --2- 172.21.15.5:0/636996796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d8d2d94d0 0x564d8d69e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:12.024 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.013+0000 7f7c0759e640 1 -- 172.21.15.5:0/636996796 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d8d365790 con 0x564d8d2fa1b0 2024-08-31T05:42:12.024 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.013+0000 7f7c0659c640 1 --2- 172.21.15.5:0/636996796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d8d2d94d0 0x564d8d69e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:42:12.024 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.013+0000 7f7beffff640 1 --2- 172.21.15.5:0/1282811741 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f7bf00b4c90 0x7f7bf00b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:12.024 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.013+0000 7f7c0759e640 1 --2- 172.21.15.5:0/636996796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d8d2fa1b0 0x564d8d69dee0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7c00009f30 tx=0x7f7c000118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a9e2587deefc7e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:12.024 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.013+0000 7f7c06d9d640 1 --2- 172.21.15.5:0/1282811741 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f7bf00b4c90 0x7f7bf00b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:12.024 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.013+0000 7f7bed7fa640 1 -- 172.21.15.5:0/636996796 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c00004d20 con 0x564d8d2fa1b0 2024-08-31T05:42:12.024 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.013+0000 7f7bed7fa640 1 -- 172.21.15.5:0/636996796 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c00004050 con 0x564d8d2fa1b0 2024-08-31T05:42:12.024 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.013+0000 7f7bed7fa640 1 -- 172.21.15.5:0/636996796 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c00005280 con 0x564d8d2fa1b0 2024-08-31T05:42:12.024 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.013+0000 7f7beffff640 1 -- 172.21.15.5:0/1282811741 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9599+0+0 (secure 0 0 0) 0x7f7bf80e5c80 con 0x7f7c081025d0 2024-08-31T05:42:12.024 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.014+0000 7f7c14245740 1 -- 172.21.15.5:0/636996796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d8d2fa1b0 msgr2=0x564d8d69dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:12.024 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.014+0000 7f7c06d9d640 1 --2- 172.21.15.5:0/1282811741 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f7bf00b4c90 0x7f7bf00b71a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f7bf80e3050 tx=0x7f7bf80e97d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:12.024 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.014+0000 7f7c14245740 1 --2- 172.21.15.5:0/636996796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d8d2fa1b0 0x564d8d69dee0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7c00009f30 tx=0x7f7c000118d0 comp rx=0 tx=0).stop 2024-08-31T05:42:12.024 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.014+0000 7f7c14245740 1 -- 172.21.15.5:0/636996796 shutdown_connections 2024-08-31T05:42:12.024 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.014+0000 7f7c14245740 1 --2- 172.21.15.5:0/636996796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d8d2d94d0 0x564d8d69e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:12.025 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.014+0000 7f7c14245740 1 --2- 172.21.15.5:0/636996796 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d8d2d12f0 0x564d8d69e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:12.025 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.014+0000 7f7c14245740 1 --2- 172.21.15.5:0/636996796 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d8d2fa1b0 0x564d8d69dee0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:12.025 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.014+0000 7f7c14245740 1 -- 172.21.15.5:0/636996796 >> 172.21.15.5:0/636996796 conn(0x564d8d2ee300 msgr2=0x564d8d69bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:12.025 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.014+0000 7f7c14245740 1 -- 172.21.15.5:0/636996796 shutdown_connections 2024-08-31T05:42:12.025 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.014+0000 7f7c14245740 1 -- 172.21.15.5:0/636996796 wait complete. 2024-08-31T05:42:12.025 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.014+0000 7f7c14245740 1 -- start start 2024-08-31T05:42:12.025 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.015+0000 7f7c14245740 1 Processor -- start 2024-08-31T05:42:12.025 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.015+0000 7f7c14245740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d8d2d12f0 0x564d8d6a9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:12.025 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.015+0000 7f7c14245740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d8d2d94d0 0x564d8d6aa060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:12.025 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.015+0000 7f7c14245740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d8d2fa1b0 0x564d8d6b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:12.025 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.015+0000 7f7c14245740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x564d8d53bab0 con 0x564d8d2d12f0 2024-08-31T05:42:12.025 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.015+0000 7f7c14245740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564d8d589680 con 0x564d8d2d94d0 2024-08-31T05:42:12.025 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.015+0000 7f7c14245740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564d8d6ac660 con 0x564d8d2fa1b0 2024-08-31T05:42:12.025 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.015+0000 7f7c0759e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d8d2d12f0 0x564d8d6a9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:12.025 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.015+0000 7f7c14245740 10 client.0 _ll_register_callbacks cb 0x564d8d311a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:42:12.026 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.015+0000 7f7c0759e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d8d2d12f0 0x564d8d6a9ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41640/0 (socket says 172.21.15.5:41640) 2024-08-31T05:42:12.026 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.015+0000 7f7c0759e640 1 -- 172.21.15.5:0/1075367994 learned_addr learned my addr 172.21.15.5:0/1075367994 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:12.026 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.015+0000 7f7c0659c640 1 --2- 172.21.15.5:0/1075367994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d8d2d94d0 0x564d8d6aa060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:12.026 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.015+0000 7f7c0759e640 1 --2- 172.21.15.5:0/1075367994 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d8d2fa1b0 0x564d8d6b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:12.026 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.015+0000 7f7c0759e640 1 -- 172.21.15.5:0/1075367994 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d8d2fa1b0 msgr2=0x564d8d6b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:12.026 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.015+0000 7f7c0759e640 1 --2- 172.21.15.5:0/1075367994 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d8d2fa1b0 0x564d8d6b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:12.026 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.015+0000 7f7c0759e640 1 -- 172.21.15.5:0/1075367994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d8d2d94d0 msgr2=0x564d8d6aa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:12.026 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.015+0000 7f7c0759e640 1 --2- 172.21.15.5:0/1075367994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d8d2d94d0 0x564d8d6aa060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:12.026 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.015+0000 7f7c0759e640 1 -- 172.21.15.5:0/1075367994 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d8d3de620 con 0x564d8d2d12f0 2024-08-31T05:42:12.026 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.015+0000 7f7c0759e640 1 --2- 172.21.15.5:0/1075367994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d8d2d12f0 0x564d8d6a9ae0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f7c00005c10 tx=0x7f7c00005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d9d67965b83be19 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:12.026 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.015+0000 7f7beaff5640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:42:12.026 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.016+0000 7f7beaff5640 1 -- 172.21.15.5:0/1075367994 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c0002c060 con 0x564d8d2d12f0 2024-08-31T05:42:12.026 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.016+0000 7f7beaff5640 1 -- 172.21.15.5:0/1075367994 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9599+0+0 (secure 0 0 0) 0x7f7c00027460 con 0x564d8d2d12f0 2024-08-31T05:42:12.027 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.016+0000 7f7c14245740 1 -- 172.21.15.5:0/1075367994 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c00004050 con 0x564d8d2d12f0 2024-08-31T05:42:12.027 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.016+0000 7f7beaff5640 1 -- 172.21.15.5:0/1075367994 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f7c00033050 con 0x564d8d2d12f0 2024-08-31T05:42:12.027 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.016+0000 7f7c14245740 10 client.18840 fetch_fsmap learned FSMap version 34 2024-08-31T05:42:12.027 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.016+0000 7f7c14245740 1 -- 172.21.15.5:0/1075367994 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x564d8d6b86d0 con 0x564d8d2d12f0 2024-08-31T05:42:12.027 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.016+0000 7f7beaff5640 1 -- 172.21.15.5:0/1075367994 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c00004050 con 0x564d8d2d12f0 2024-08-31T05:42:12.027 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.016+0000 7f7beaff5640 1 -- 172.21.15.5:0/1075367994 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f7c00025040 con 0x564d8d2d12f0 2024-08-31T05:42:12.027 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.016+0000 7f7c14245740 10 client.18840 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:42:12.027 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.016+0000 7f7c14245740 10 client.18840 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:42:12.027 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.016+0000 7f7c14245740 20 client.18840 populate_metadata read hostname 'smithi005' 2024-08-31T05:42:12.027 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.016+0000 7f7c14245740 1 --2- 172.21.15.5:0/1075367994 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x564d8d2b8d80 0x564d8d6bbb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:12.027 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.016+0000 7f7c14245740 4 client.18840 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:42:12.027 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.016+0000 7f7c14245740 1 -- 172.21.15.5:0/1075367994 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564d8d614f50 con 0x564d8d2b8d80 2024-08-31T05:42:12.027 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.017+0000 7f7c0659c640 1 --2- 172.21.15.5:0/1075367994 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x564d8d2b8d80 0x564d8d6bbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:12.027 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.017+0000 7f7beaff5640 10 client.18840 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:42:12.028 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.017+0000 7f7c0659c640 1 --2- 172.21.15.5:0/1075367994 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x564d8d2b8d80 0x564d8d6bbb40 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f1d8c6d3d6818ba server_cookie=1f11203f3e743260 in_seq=0 out_seq=0 2024-08-31T05:42:12.028 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.018+0000 7f7beaff5640 1 -- 172.21.15.5:0/1075367994 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564d8d614f50 con 0x564d8d2b8d80 2024-08-31T05:42:12.028 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.018+0000 7f7beaff5640 10 client.18840 handle_command_reply: tid=0 2024-08-31T05:42:12.028 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.018+0000 7f7c14245740 1 client.18840 shutdown 2024-08-31T05:42:12.028 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.018+0000 7f7c14245740 1 -- 172.21.15.5:0/1075367994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d8d2d12f0 msgr2=0x564d8d6a9ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:12.028 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.018+0000 7f7c14245740 1 --2- 172.21.15.5:0/1075367994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d8d2d12f0 0x564d8d6a9ae0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f7c00005c10 tx=0x7f7c00005a50 comp rx=0 tx=0).stop 2024-08-31T05:42:12.028 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.018+0000 7f7c14245740 1 -- 172.21.15.5:0/1075367994 shutdown_connections 2024-08-31T05:42:12.028 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.018+0000 7f7c14245740 1 --2- 172.21.15.5:0/1075367994 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x564d8d2b8d80 0x564d8d6bbb40 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:12.028 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.018+0000 7f7c14245740 1 --2- 172.21.15.5:0/1075367994 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d8d2fa1b0 0x564d8d6b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:12.028 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.018+0000 7f7c14245740 1 --2- 172.21.15.5:0/1075367994 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d8d2d94d0 0x564d8d6aa060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:12.028 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.018+0000 7f7beaff5640 0 client.18840 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:42:12.028 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.018+0000 7f7c14245740 1 --2- 172.21.15.5:0/1075367994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d8d2d12f0 0x564d8d6a9ae0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:12.028 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.018+0000 7f7c14245740 1 -- 172.21.15.5:0/1075367994 >> 172.21.15.5:0/1075367994 conn(0x564d8d2ee300 msgr2=0x564d8d69ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:12.028 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.018+0000 7f7c14245740 1 -- 172.21.15.5:0/1075367994 shutdown_connections 2024-08-31T05:42:12.028 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.018+0000 7f7c14245740 1 -- 172.21.15.5:0/1075367994 wait complete. 2024-08-31T05:42:12.029 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.018+0000 7f7c14245740 20 client.18840 trim_cache size 0 max 16384 2024-08-31T05:42:12.036 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.033+0000 7f7c14245740 1 Processor -- start 2024-08-31T05:42:12.036 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.033+0000 7f7c14245740 1 -- start start 2024-08-31T05:42:12.036 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.033+0000 7f7c14245740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d8d2d12f0 0x564d8d6a4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:12.036 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.033+0000 7f7c14245740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d8d2d94d0 0x564d8d69f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:12.036 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.033+0000 7f7c14245740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d8d2fa1b0 0x564d8d6b5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:12.036 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.033+0000 7f7c14245740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7c081b0dc0 con 0x564d8d2fa1b0 2024-08-31T05:42:12.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.033+0000 7f7c14245740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7c081b2900 con 0x564d8d2d94d0 2024-08-31T05:42:12.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.033+0000 7f7c14245740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7c081b1490 con 0x564d8d2d12f0 2024-08-31T05:42:12.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.033+0000 7f7c0759e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d8d2fa1b0 0x564d8d6b5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:12.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.033+0000 7f7c0759e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d8d2fa1b0 0x564d8d6b5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41654/0 (socket says 172.21.15.5:41654) 2024-08-31T05:42:12.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.033+0000 7f7c0759e640 1 -- 172.21.15.5:0/109445701 learned_addr learned my addr 172.21.15.5:0/109445701 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:12.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.033+0000 7f7c0659c640 1 --2- 172.21.15.5:0/109445701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d8d2d94d0 0x564d8d69f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:12.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.033+0000 7f7c0759e640 1 --2- 172.21.15.5:0/109445701 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d8d2d12f0 0x564d8d6a4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:12.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.034+0000 7f7c0759e640 1 -- 172.21.15.5:0/109445701 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d8d2d12f0 msgr2=0x564d8d6a4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:12.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.034+0000 7f7c0759e640 1 --2- 172.21.15.5:0/109445701 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d8d2d12f0 0x564d8d6a4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:12.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.034+0000 7f7c0759e640 1 -- 172.21.15.5:0/109445701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d8d2d94d0 msgr2=0x564d8d69f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:12.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.034+0000 7f7c0759e640 1 --2- 172.21.15.5:0/109445701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d8d2d94d0 0x564d8d69f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:12.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.034+0000 7f7c0759e640 1 -- 172.21.15.5:0/109445701 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d8d69c770 con 0x564d8d2fa1b0 2024-08-31T05:42:12.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.034+0000 7f7c0759e640 1 --2- 172.21.15.5:0/109445701 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d8d2fa1b0 0x564d8d6b5850 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f7c00002230 tx=0x7f7c000118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57c69cd801ad3f12 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:12.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.034+0000 7f7becff9640 1 -- 172.21.15.5:0/109445701 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c0002c070 con 0x564d8d2fa1b0 2024-08-31T05:42:12.038 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.034+0000 7f7becff9640 1 -- 172.21.15.5:0/109445701 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c0000fdf0 con 0x564d8d2fa1b0 2024-08-31T05:42:12.038 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.034+0000 7f7becff9640 1 -- 172.21.15.5:0/109445701 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c00004c60 con 0x564d8d2fa1b0 2024-08-31T05:42:12.041 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.035+0000 7f7c14245740 1 -- 172.21.15.5:0/109445701 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d8d2fa1b0 msgr2=0x564d8d6b5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:12.041 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.035+0000 7f7c14245740 1 --2- 172.21.15.5:0/109445701 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d8d2fa1b0 0x564d8d6b5850 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f7c00002230 tx=0x7f7c000118d0 comp rx=0 tx=0).stop 2024-08-31T05:42:12.041 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.035+0000 7f7c14245740 1 -- 172.21.15.5:0/109445701 shutdown_connections 2024-08-31T05:42:12.041 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.035+0000 7f7c14245740 1 --2- 172.21.15.5:0/109445701 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d8d2fa1b0 0x564d8d6b5850 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:12.041 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.035+0000 7f7c14245740 1 --2- 172.21.15.5:0/109445701 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d8d2d94d0 0x564d8d69f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:12.041 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.035+0000 7f7c14245740 1 --2- 172.21.15.5:0/109445701 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d8d2d12f0 0x564d8d6a4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:12.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.035+0000 7f7c14245740 1 -- 172.21.15.5:0/109445701 >> 172.21.15.5:0/109445701 conn(0x564d8d2ee300 msgr2=0x564d8d69edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:12.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.035+0000 7f7c14245740 1 -- 172.21.15.5:0/109445701 shutdown_connections 2024-08-31T05:42:12.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.035+0000 7f7c14245740 1 -- 172.21.15.5:0/109445701 wait complete. 2024-08-31T05:42:12.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.035+0000 7f7c14245740 1 -- start start 2024-08-31T05:42:12.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.035+0000 7f7c14245740 1 Processor -- start 2024-08-31T05:42:12.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.036+0000 7f7c14245740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d8d2d12f0 0x564d8d6ad170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:12.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.036+0000 7f7c14245740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d8d2d94d0 0x564d8d6ad730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:12.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.036+0000 7f7c14245740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d8d2fa1b0 0x564d8d7242d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:12.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.036+0000 7f7c14245740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7c081b2230 con 0x564d8d2d12f0 2024-08-31T05:42:12.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.036+0000 7f7c14245740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f7c081b1b60 con 0x564d8d2d94d0 2024-08-31T05:42:12.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.036+0000 7f7c14245740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7c081aedc0 con 0x564d8d2fa1b0 2024-08-31T05:42:12.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.036+0000 7f7c14245740 10 client.0 _ll_register_callbacks cb 0x7f7c000093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:42:12.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.036+0000 7f7c0759e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d8d2d12f0 0x564d8d6ad170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:12.042 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.036+0000 7f7c0759e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d8d2d12f0 0x564d8d6ad170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41658/0 (socket says 172.21.15.5:41658) 2024-08-31T05:42:12.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.036+0000 7f7c0759e640 1 -- 172.21.15.5:0/3555708141 learned_addr learned my addr 172.21.15.5:0/3555708141 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:12.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.036+0000 7f7c0659c640 1 --2- 172.21.15.5:0/3555708141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d8d2d94d0 0x564d8d6ad730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:12.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.036+0000 7f7c0759e640 1 --2- 172.21.15.5:0/3555708141 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d8d2fa1b0 0x564d8d7242d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:12.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.036+0000 7f7c0759e640 1 -- 172.21.15.5:0/3555708141 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d8d2fa1b0 msgr2=0x564d8d7242d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:12.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.036+0000 7f7c0759e640 1 --2- 172.21.15.5:0/3555708141 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d8d2fa1b0 0x564d8d7242d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:12.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.036+0000 7f7c0759e640 1 -- 172.21.15.5:0/3555708141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d8d2d94d0 msgr2=0x564d8d6ad730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:12.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.036+0000 7f7c0759e640 1 --2- 172.21.15.5:0/3555708141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d8d2d94d0 0x564d8d6ad730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:12.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.036+0000 7f7c0759e640 1 -- 172.21.15.5:0/3555708141 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d8d696cf0 con 0x564d8d2d12f0 2024-08-31T05:42:12.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.036+0000 7f7c0759e640 1 --2- 172.21.15.5:0/3555708141 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d8d2d12f0 0x564d8d6ad170 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f7c0000fd40 tx=0x7f7c0000fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a5547e520724a0a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:12.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.036+0000 7f7beaff5640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:42:12.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.036+0000 7f7beaff5640 1 -- 172.21.15.5:0/3555708141 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c0002c070 con 0x564d8d2d12f0 2024-08-31T05:42:12.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.036+0000 7f7beaff5640 1 -- 172.21.15.5:0/3555708141 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9599+0+0 (secure 0 0 0) 0x7f7c00003e80 con 0x564d8d2d12f0 2024-08-31T05:42:12.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.036+0000 7f7c14245740 1 -- 172.21.15.5:0/3555708141 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c0000fdf0 con 0x564d8d2d12f0 2024-08-31T05:42:12.043 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.037+0000 7f7beaff5640 1 -- 172.21.15.5:0/3555708141 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f7c0004b050 con 0x564d8d2d12f0 2024-08-31T05:42:12.044 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.037+0000 7f7c14245740 10 client.18846 fetch_fsmap learned FSMap version 34 2024-08-31T05:42:12.044 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.037+0000 7f7c14245740 1 -- 172.21.15.5:0/3555708141 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x564d8d725a00 con 0x564d8d2d12f0 2024-08-31T05:42:12.044 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.037+0000 7f7beaff5640 1 -- 172.21.15.5:0/3555708141 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c0000fdf0 con 0x564d8d2d12f0 2024-08-31T05:42:12.044 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.037+0000 7f7beaff5640 1 -- 172.21.15.5:0/3555708141 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f7c00005200 con 0x564d8d2d12f0 2024-08-31T05:42:12.044 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.037+0000 7f7c14245740 10 client.18846 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:42:12.044 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.037+0000 7f7c14245740 10 client.18846 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:42:12.044 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.037+0000 7f7c14245740 20 client.18846 populate_metadata read hostname 'smithi005' 2024-08-31T05:42:12.044 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.037+0000 7f7c14245740 1 --2- 172.21.15.5:0/3555708141 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x564d8d28e1c0 0x564d8d728030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:12.044 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.037+0000 7f7c14245740 4 client.18846 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:42:12.044 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.037+0000 7f7c14245740 1 -- 172.21.15.5:0/3555708141 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564d8d6109f0 con 0x564d8d28e1c0 2024-08-31T05:42:12.044 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.037+0000 7f7c0659c640 1 --2- 172.21.15.5:0/3555708141 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x564d8d28e1c0 0x564d8d728030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:12.044 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.038+0000 7f7beaff5640 10 client.18846 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:42:12.044 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.038+0000 7f7c0659c640 1 --2- 172.21.15.5:0/3555708141 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x564d8d28e1c0 0x564d8d728030 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=589f837f3e67a2dc server_cookie=bc68c2da1200f11d in_seq=0 out_seq=0 2024-08-31T05:42:12.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.052+0000 7f7beaff5640 1 -- 172.21.15.5:0/3555708141 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564d8d6109f0 con 0x564d8d28e1c0 2024-08-31T05:42:12.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.052+0000 7f7beaff5640 10 client.18846 handle_command_reply: tid=0 2024-08-31T05:42:12.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.052+0000 7f7c14245740 1 client.18846 shutdown 2024-08-31T05:42:12.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.053+0000 7f7c14245740 1 -- 172.21.15.5:0/3555708141 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d8d2d12f0 msgr2=0x564d8d6ad170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:12.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.053+0000 7f7c14245740 1 --2- 172.21.15.5:0/3555708141 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d8d2d12f0 0x564d8d6ad170 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f7c0000fd40 tx=0x7f7c0000fcb0 comp rx=0 tx=0).stop 2024-08-31T05:42:12.055 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.053+0000 7f7c14245740 1 -- 172.21.15.5:0/3555708141 shutdown_connections 2024-08-31T05:42:12.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.053+0000 7f7c14245740 1 --2- 172.21.15.5:0/3555708141 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x564d8d28e1c0 0x564d8d728030 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:12.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.053+0000 7f7c14245740 1 --2- 172.21.15.5:0/3555708141 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d8d2fa1b0 0x564d8d7242d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:12.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.053+0000 7f7c14245740 1 --2- 172.21.15.5:0/3555708141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564d8d2d94d0 0x564d8d6ad730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:12.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.053+0000 7f7beaff5640 0 client.18846 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:42:12.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.053+0000 7f7c14245740 1 --2- 172.21.15.5:0/3555708141 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564d8d2d12f0 0x564d8d6ad170 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:12.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.053+0000 7f7c14245740 1 -- 172.21.15.5:0/3555708141 >> 172.21.15.5:0/3555708141 conn(0x564d8d2ee300 msgr2=0x564d8d69edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:12.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.053+0000 7f7c14245740 1 -- 172.21.15.5:0/3555708141 shutdown_connections 2024-08-31T05:42:12.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.053+0000 7f7c14245740 1 -- 172.21.15.5:0/3555708141 wait complete. 2024-08-31T05:42:12.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.053+0000 7f7c14245740 20 client.18846 trim_cache size 0 max 16384 2024-08-31T05:42:12.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:42:12.057 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:42:12.057 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:42:12.057 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:42:12.057 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.053+0000 7f7c0c9fe640 1 -- 172.21.15.5:0/1282811741 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f7bf00b4c90 msgr2=0x7f7bf00b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:12.058 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.053+0000 7f7c0c9fe640 1 --2- 172.21.15.5:0/1282811741 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f7bf00b4c90 0x7f7bf00b71a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f7bf80e3050 tx=0x7f7bf80e97d0 comp rx=0 tx=0).stop 2024-08-31T05:42:12.058 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.053+0000 7f7c0c9fe640 1 -- 172.21.15.5:0/1282811741 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c081025d0 msgr2=0x7f7c0819a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:12.058 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.053+0000 7f7c0c9fe640 1 --2- 172.21.15.5:0/1282811741 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c081025d0 0x7f7c0819a090 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f7bf800e9f0 tx=0x7f7bf800eeb0 comp rx=0 tx=0).stop 2024-08-31T05:42:12.058 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.053+0000 7f7c0c9fe640 1 -- 172.21.15.5:0/1282811741 shutdown_connections 2024-08-31T05:42:12.058 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.053+0000 7f7c0c9fe640 1 --2- 172.21.15.5:0/1282811741 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f7bf00b4c90 0x7f7bf00b71a0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:12.058 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.053+0000 7f7c0c9fe640 1 --2- 172.21.15.5:0/1282811741 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f7c08108850 0x7f7c0819f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:12.058 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.053+0000 7f7c0c9fe640 1 --2- 172.21.15.5:0/1282811741 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c08107f00 0x7f7c0819a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:12.058 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.053+0000 7f7c0c9fe640 1 --2- 172.21.15.5:0/1282811741 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c081025d0 0x7f7c0819a090 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:12.058 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.053+0000 7f7c0c9fe640 1 -- 172.21.15.5:0/1282811741 >> 172.21.15.5:0/1282811741 conn(0x7f7c080fdfd0 msgr2=0x7f7c0806b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:12.058 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.054+0000 7f7c0c9fe640 1 -- 172.21.15.5:0/1282811741 shutdown_connections 2024-08-31T05:42:12.058 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:12.054+0000 7f7c0c9fe640 1 -- 172.21.15.5:0/1282811741 wait complete. 2024-08-31T05:42:12.940 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1374235 10.76 MB/sec execute 540 sec latency 22.233 ms 2024-08-31T05:42:13.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:42:12 smithi070 ceph-mon[22316]: pgmap v723: 129 pgs: 129 active+clean; 574 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.1 MiB/s wr, 235 op/s 2024-08-31T05:42:13.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:42:12 smithi050 ceph-mon[22146]: pgmap v723: 129 pgs: 129 active+clean; 574 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.1 MiB/s wr, 235 op/s 2024-08-31T05:42:13.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:42:12 smithi005 ceph-mon[18602]: pgmap v723: 129 pgs: 129 active+clean; 574 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.1 MiB/s wr, 235 op/s 2024-08-31T05:42:13.941 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1375405 10.77 MB/sec execute 541 sec latency 84.626 ms 2024-08-31T05:42:14.941 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1376521 10.77 MB/sec execute 542 sec latency 133.900 ms 2024-08-31T05:42:15.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:42:14 smithi070 ceph-mon[22316]: pgmap v724: 129 pgs: 129 active+clean; 577 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.5 MiB/s wr, 232 op/s 2024-08-31T05:42:15.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:42:14 smithi070 ceph-mon[22316]: osdmap e99: 12 total, 12 up, 12 in 2024-08-31T05:42:15.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:42:14 smithi050 ceph-mon[22146]: pgmap v724: 129 pgs: 129 active+clean; 577 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.5 MiB/s wr, 232 op/s 2024-08-31T05:42:15.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:42:14 smithi050 ceph-mon[22146]: osdmap e99: 12 total, 12 up, 12 in 2024-08-31T05:42:15.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:42:14 smithi005 ceph-mon[18602]: pgmap v724: 129 pgs: 129 active+clean; 577 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.5 MiB/s wr, 232 op/s 2024-08-31T05:42:15.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:42:14 smithi005 ceph-mon[18602]: osdmap e99: 12 total, 12 up, 12 in 2024-08-31T05:42:15.941 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1378884 10.78 MB/sec execute 543 sec latency 15.367 ms 2024-08-31T05:42:16.941 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1380452 10.77 MB/sec execute 544 sec latency 34.327 ms 2024-08-31T05:42:17.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:42:16 smithi070 ceph-mon[22316]: pgmap v726: 129 pgs: 129 active+clean; 582 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.7 MiB/s wr, 227 op/s 2024-08-31T05:42:17.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:42:16 smithi050 ceph-mon[22146]: pgmap v726: 129 pgs: 129 active+clean; 582 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.7 MiB/s wr, 227 op/s 2024-08-31T05:42:17.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:42:16 smithi005 ceph-mon[18602]: pgmap v726: 129 pgs: 129 active+clean; 582 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.7 MiB/s wr, 227 op/s 2024-08-31T05:42:17.941 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1382598 10.77 MB/sec execute 545 sec latency 15.428 ms 2024-08-31T05:42:18.941 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1384543 10.77 MB/sec execute 546 sec latency 32.914 ms 2024-08-31T05:42:19.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:42:18 smithi070 ceph-mon[22316]: pgmap v727: 129 pgs: 129 active+clean; 582 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.1 MiB/s wr, 201 op/s 2024-08-31T05:42:19.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:42:18 smithi050 ceph-mon[22146]: pgmap v727: 129 pgs: 129 active+clean; 582 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.1 MiB/s wr, 201 op/s 2024-08-31T05:42:19.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:42:18 smithi005 ceph-mon[18602]: pgmap v727: 129 pgs: 129 active+clean; 582 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.1 MiB/s wr, 201 op/s 2024-08-31T05:42:19.941 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1386215 10.77 MB/sec execute 547 sec latency 61.639 ms 2024-08-31T05:42:20.941 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1388255 10.76 MB/sec execute 548 sec latency 15.052 ms 2024-08-31T05:42:21.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:42:20 smithi070 ceph-mon[22316]: pgmap v728: 129 pgs: 129 active+clean; 592 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.5 MiB/s wr, 214 op/s 2024-08-31T05:42:21.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:42:20 smithi050 ceph-mon[22146]: pgmap v728: 129 pgs: 129 active+clean; 592 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.5 MiB/s wr, 214 op/s 2024-08-31T05:42:21.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:42:20 smithi005 ceph-mon[18602]: pgmap v728: 129 pgs: 129 active+clean; 592 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.5 MiB/s wr, 214 op/s 2024-08-31T05:42:21.941 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1390130 10.77 MB/sec execute 549 sec latency 63.134 ms 2024-08-31T05:42:22.941 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1392247 10.77 MB/sec execute 550 sec latency 17.915 ms 2024-08-31T05:42:23.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:42:22 smithi070 ceph-mon[22316]: pgmap v729: 129 pgs: 129 active+clean; 596 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.3 MiB/s wr, 203 op/s 2024-08-31T05:42:23.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:42:22 smithi050 ceph-mon[22146]: pgmap v729: 129 pgs: 129 active+clean; 596 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.3 MiB/s wr, 203 op/s 2024-08-31T05:42:23.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:42:22 smithi005 ceph-mon[18602]: pgmap v729: 129 pgs: 129 active+clean; 596 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.3 MiB/s wr, 203 op/s 2024-08-31T05:42:23.941 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1394161 10.77 MB/sec execute 551 sec latency 13.614 ms 2024-08-31T05:42:24.941 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1395824 10.76 MB/sec execute 552 sec latency 145.462 ms 2024-08-31T05:42:25.157 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.155+0000 7f80a0c25640 1 -- 172.21.15.5:0/3667027955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f809c102ee0 msgr2=0x7f809c1032f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:25.157 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.155+0000 7f80a0c25640 1 --2- 172.21.15.5:0/3667027955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f809c102ee0 0x7f809c1032f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f808c009860 tx=0x7f808c02a340 comp rx=0 tx=0).stop 2024-08-31T05:42:25.157 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.155+0000 7f80a0c25640 1 -- 172.21.15.5:0/3667027955 shutdown_connections 2024-08-31T05:42:25.157 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.155+0000 7f80a0c25640 1 --2- 172.21.15.5:0/3667027955 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f809c1057f0 0x7f809c10f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:25.157 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.155+0000 7f80a0c25640 1 --2- 172.21.15.5:0/3667027955 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f809c104ea0 0x7f809c1052b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:25.158 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.155+0000 7f80a0c25640 1 --2- 172.21.15.5:0/3667027955 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f809c102ee0 0x7f809c1032f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:25.158 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.155+0000 7f80a0c25640 1 -- 172.21.15.5:0/3667027955 >> 172.21.15.5:0/3667027955 conn(0x7f809c079a80 msgr2=0x7f809c079ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:25.158 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.155+0000 7f80a0c25640 1 -- 172.21.15.5:0/3667027955 shutdown_connections 2024-08-31T05:42:25.158 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.155+0000 7f80a0c25640 1 -- 172.21.15.5:0/3667027955 wait complete. 2024-08-31T05:42:25.160 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.156+0000 7f80a0c25640 1 Processor -- start 2024-08-31T05:42:25.160 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.156+0000 7f80a0c25640 1 -- start start 2024-08-31T05:42:25.160 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.156+0000 7f80a0c25640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f809c102ee0 0x7f809c19b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:25.161 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.156+0000 7f80a0c25640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f809c104ea0 0x7f809c19b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:25.161 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.156+0000 7f80a0c25640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f809c1057f0 0x7f809c19bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:25.161 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.156+0000 7f80a0c25640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f809c1126e0 con 0x7f809c104ea0 2024-08-31T05:42:25.161 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.156+0000 7f80a0c25640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f809c112560 con 0x7f809c102ee0 2024-08-31T05:42:25.161 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.156+0000 7f80a0c25640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f809c112860 con 0x7f809c1057f0 2024-08-31T05:42:25.161 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.156+0000 7f8099d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f809c104ea0 0x7f809c19b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:25.161 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.156+0000 7f809a59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f809c102ee0 0x7f809c19b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:25.161 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.156+0000 7f8099d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f809c104ea0 0x7f809c19b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32914/0 (socket says 172.21.15.5:32914) 2024-08-31T05:42:25.161 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.156+0000 7f8099d9b640 1 -- 172.21.15.5:0/791787839 learned_addr learned my addr 172.21.15.5:0/791787839 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:25.162 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.156+0000 7f809ad9d640 1 --2- 172.21.15.5:0/791787839 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f809c1057f0 0x7f809c19bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:25.162 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.157+0000 7f8099d9b640 1 -- 172.21.15.5:0/791787839 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f809c1057f0 msgr2=0x7f809c19bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:25.162 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.157+0000 7f8099d9b640 1 --2- 172.21.15.5:0/791787839 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f809c1057f0 0x7f809c19bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:25.162 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.157+0000 7f8099d9b640 1 -- 172.21.15.5:0/791787839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f809c102ee0 msgr2=0x7f809c19b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:25.162 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.157+0000 7f8099d9b640 1 --2- 172.21.15.5:0/791787839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f809c102ee0 0x7f809c19b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:25.162 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.157+0000 7f8099d9b640 1 -- 172.21.15.5:0/791787839 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f809c1a6310 con 0x7f809c104ea0 2024-08-31T05:42:25.162 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.157+0000 7f8099d9b640 1 --2- 172.21.15.5:0/791787839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f809c104ea0 0x7f809c19b590 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f809000e970 tx=0x7f809000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:25.162 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.157+0000 7f808b7fe640 1 -- 172.21.15.5:0/791787839 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f809000cd80 con 0x7f809c104ea0 2024-08-31T05:42:25.162 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.157+0000 7f80a0c25640 1 -- 172.21.15.5:0/791787839 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f809c1a6600 con 0x7f809c104ea0 2024-08-31T05:42:25.162 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.157+0000 7f808b7fe640 1 -- 172.21.15.5:0/791787839 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80900035f0 con 0x7f809c104ea0 2024-08-31T05:42:25.162 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.157+0000 7f808b7fe640 1 -- 172.21.15.5:0/791787839 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8090010690 con 0x7f809c104ea0 2024-08-31T05:42:25.163 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.157+0000 7f80a0c25640 1 -- 172.21.15.5:0/791787839 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f809c1a6ba0 con 0x7f809c104ea0 2024-08-31T05:42:25.169 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.160+0000 7f80a7c73740 1 Processor -- start 2024-08-31T05:42:25.169 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.160+0000 7f80a7c73740 1 -- start start 2024-08-31T05:42:25.169 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.160+0000 7f808b7fe640 1 -- 172.21.15.5:0/791787839 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f80900108f0 con 0x7f809c104ea0 2024-08-31T05:42:25.170 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.160+0000 7f80a7c73740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e54e4191b0 0x55e54e7bcce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:25.170 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.160+0000 7f80a7c73740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e54e3f02f0 0x55e54e7bd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:25.170 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.160+0000 7f80a7c73740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e54e3f84d0 0x55e54e7bd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:25.170 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.160+0000 7f80a7c73740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55e54e732000 con 0x55e54e3f02f0 2024-08-31T05:42:25.170 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.160+0000 7f80a7c73740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e54e721590 con 0x55e54e4191b0 2024-08-31T05:42:25.170 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.160+0000 7f80a7c73740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e54e725540 con 0x55e54e3f84d0 2024-08-31T05:42:25.170 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.161+0000 7f809a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e54e3f02f0 0x55e54e7bd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:25.170 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.161+0000 7f8099d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e54e3f84d0 0x55e54e7bd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:25.170 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.161+0000 7f809a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e54e3f02f0 0x55e54e7bd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32922/0 (socket says 172.21.15.5:32922) 2024-08-31T05:42:25.170 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.161+0000 7f809a59c640 1 -- 172.21.15.5:0/2092356858 learned_addr learned my addr 172.21.15.5:0/2092356858 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:25.171 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.161+0000 7f809ad9d640 1 --2- 172.21.15.5:0/2092356858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e54e4191b0 0x55e54e7bcce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:25.171 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.161+0000 7f809a59c640 1 -- 172.21.15.5:0/2092356858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e54e3f84d0 msgr2=0x55e54e7bd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:25.171 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.161+0000 7f809a59c640 1 --2- 172.21.15.5:0/2092356858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e54e3f84d0 0x55e54e7bd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:25.171 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.161+0000 7f809a59c640 1 -- 172.21.15.5:0/2092356858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e54e4191b0 msgr2=0x55e54e7bcce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:25.171 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.161+0000 7f809a59c640 1 --2- 172.21.15.5:0/2092356858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e54e4191b0 0x55e54e7bcce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:25.171 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.161+0000 7f809a59c640 1 -- 172.21.15.5:0/2092356858 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e54e484790 con 0x55e54e3f02f0 2024-08-31T05:42:25.171 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.161+0000 7f809ad9d640 1 --2- 172.21.15.5:0/2092356858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e54e4191b0 0x55e54e7bcce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:42:25.171 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.161+0000 7f809a59c640 1 --2- 172.21.15.5:0/2092356858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e54e3f02f0 0x55e54e7bd220 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f808c02a860 tx=0x7f808c005d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43d5637b4d97febb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:25.171 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.161+0000 7f808b7fe640 1 --2- 172.21.15.5:0/791787839 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f80840b4ca0 0x7f80840b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:25.171 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.161+0000 7f8088ff9640 1 -- 172.21.15.5:0/2092356858 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f808c037040 con 0x55e54e3f02f0 2024-08-31T05:42:25.171 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.161+0000 7f809ad9d640 1 --2- 172.21.15.5:0/791787839 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f80840b4ca0 0x7f80840b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:25.171 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.162+0000 7f8088ff9640 1 -- 172.21.15.5:0/2092356858 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f808c030450 con 0x55e54e3f02f0 2024-08-31T05:42:25.172 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.162+0000 7f8088ff9640 1 -- 172.21.15.5:0/2092356858 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f808c003950 con 0x55e54e3f02f0 2024-08-31T05:42:25.172 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.162+0000 7f808b7fe640 1 -- 172.21.15.5:0/791787839 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9511+0+0 (secure 0 0 0) 0x7f80900e5bd0 con 0x7f809c104ea0 2024-08-31T05:42:25.172 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.162+0000 7f80a7c73740 1 -- 172.21.15.5:0/2092356858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e54e3f02f0 msgr2=0x55e54e7bd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:25.172 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.162+0000 7f809ad9d640 1 --2- 172.21.15.5:0/791787839 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f80840b4ca0 0x7f80840b71b0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f8094009fd0 tx=0x7f8094010040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:25.172 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.162+0000 7f80a7c73740 1 --2- 172.21.15.5:0/2092356858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e54e3f02f0 0x55e54e7bd220 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f808c02a860 tx=0x7f808c005d30 comp rx=0 tx=0).stop 2024-08-31T05:42:25.172 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.162+0000 7f80a7c73740 1 -- 172.21.15.5:0/2092356858 shutdown_connections 2024-08-31T05:42:25.172 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.162+0000 7f80a7c73740 1 --2- 172.21.15.5:0/2092356858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e54e3f84d0 0x55e54e7bd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:25.172 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.162+0000 7f80a7c73740 1 --2- 172.21.15.5:0/2092356858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e54e3f02f0 0x55e54e7bd220 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:25.172 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.162+0000 7f80a7c73740 1 --2- 172.21.15.5:0/2092356858 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e54e4191b0 0x55e54e7bcce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:25.172 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.162+0000 7f80a7c73740 1 -- 172.21.15.5:0/2092356858 >> 172.21.15.5:0/2092356858 conn(0x55e54e40d300 msgr2=0x55e54e7babd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:25.172 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.163+0000 7f80a7c73740 1 -- 172.21.15.5:0/2092356858 shutdown_connections 2024-08-31T05:42:25.172 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.163+0000 7f80a7c73740 1 -- 172.21.15.5:0/2092356858 wait complete. 2024-08-31T05:42:25.172 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.163+0000 7f80a7c73740 1 -- start start 2024-08-31T05:42:25.173 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.163+0000 7f80a7c73740 1 Processor -- start 2024-08-31T05:42:25.173 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.163+0000 7f80a7c73740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e54e3f02f0 0x55e54e7c8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:25.173 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.163+0000 7f80a7c73740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e54e3f84d0 0x55e54e7c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:25.173 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.163+0000 7f80a7c73740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e54e4191b0 0x55e54e7d4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:25.173 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.163+0000 7f80a7c73740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55e54e65aab0 con 0x55e54e4191b0 2024-08-31T05:42:25.173 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.163+0000 7f80a7c73740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55e54e6a8680 con 0x55e54e3f84d0 2024-08-31T05:42:25.173 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.163+0000 7f80a7c73740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e54e7cb400 con 0x55e54e3f02f0 2024-08-31T05:42:25.173 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.163+0000 7f80a7c73740 10 client.0 _ll_register_callbacks cb 0x55e54e430a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:42:25.173 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.164+0000 7f809a59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e54e3f02f0 0x55e54e7c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:25.173 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.164+0000 7f809ad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e54e4191b0 0x55e54e7d4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:25.173 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.164+0000 7f8099d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e54e3f84d0 0x55e54e7c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:25.173 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.164+0000 7f809a59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e54e3f02f0 0x55e54e7c8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:32950/0 (socket says 172.21.15.5:32950) 2024-08-31T05:42:25.174 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.164+0000 7f809a59c640 1 -- 172.21.15.5:0/2700681613 learned_addr learned my addr 172.21.15.5:0/2700681613 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:25.174 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.164+0000 7f809a59c640 1 -- 172.21.15.5:0/2700681613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e54e3f84d0 msgr2=0x55e54e7c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:25.174 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.164+0000 7f809a59c640 1 --2- 172.21.15.5:0/2700681613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e54e3f84d0 0x55e54e7c8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:25.174 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.164+0000 7f809a59c640 1 -- 172.21.15.5:0/2700681613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e54e4191b0 msgr2=0x55e54e7d4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:25.174 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.164+0000 7f809a59c640 1 --2- 172.21.15.5:0/2700681613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e54e4191b0 0x55e54e7d4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:25.174 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.164+0000 7f809a59c640 1 -- 172.21.15.5:0/2700681613 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e54e4fd620 con 0x55e54e3f02f0 2024-08-31T05:42:25.174 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.164+0000 7f8099d9b640 1 --2- 172.21.15.5:0/2700681613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e54e3f84d0 0x55e54e7c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:42:25.174 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.164+0000 7f809ad9d640 1 --2- 172.21.15.5:0/2700681613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e54e4191b0 0x55e54e7d4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:42:25.174 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.164+0000 7f809a59c640 1 --2- 172.21.15.5:0/2700681613 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e54e3f02f0 0x55e54e7c8850 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f808c02a930 tx=0x7f808c005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13382ec5ce2d2c9a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:25.174 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.164+0000 7f8081ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:42:25.174 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.164+0000 7f8081ffb640 1 -- 172.21.15.5:0/2700681613 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f808c04d070 con 0x55e54e3f02f0 2024-08-31T05:42:25.174 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.164+0000 7f8081ffb640 1 -- 172.21.15.5:0/2700681613 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9511+0+0 (secure 0 0 0) 0x7f808c03d480 con 0x55e54e3f02f0 2024-08-31T05:42:25.174 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.164+0000 7f80a7c73740 1 -- 172.21.15.5:0/2700681613 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f808c030450 con 0x55e54e3f02f0 2024-08-31T05:42:25.175 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.164+0000 7f8081ffb640 1 -- 172.21.15.5:0/2700681613 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f808c059050 con 0x55e54e3f02f0 2024-08-31T05:42:25.175 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.164+0000 7f80a7c73740 10 client.28438 fetch_fsmap learned FSMap version 34 2024-08-31T05:42:25.175 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.164+0000 7f80a7c73740 1 -- 172.21.15.5:0/2700681613 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55e54e7d7450 con 0x55e54e3f02f0 2024-08-31T05:42:25.175 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.165+0000 7f8081ffb640 1 -- 172.21.15.5:0/2700681613 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f808c030450 con 0x55e54e3f02f0 2024-08-31T05:42:25.175 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.165+0000 7f8081ffb640 1 -- 172.21.15.5:0/2700681613 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f808c0468e0 con 0x55e54e3f02f0 2024-08-31T05:42:25.175 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.165+0000 7f80a7c73740 10 client.28438 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:42:25.175 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.165+0000 7f80a7c73740 10 client.28438 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:42:25.175 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.165+0000 7f80a7c73740 20 client.28438 populate_metadata read hostname 'smithi005' 2024-08-31T05:42:25.175 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.165+0000 7f80a7c73740 1 --2- 172.21.15.5:0/2700681613 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55e54e3d7d80 0x55e54e7da7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:25.175 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.165+0000 7f80a7c73740 4 client.28438 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:42:25.175 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.165+0000 7f80a7c73740 1 -- 172.21.15.5:0/2700681613 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e54e733f50 con 0x55e54e3d7d80 2024-08-31T05:42:25.175 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.165+0000 7f8099d9b640 1 --2- 172.21.15.5:0/2700681613 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55e54e3d7d80 0x55e54e7da7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:25.175 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.166+0000 7f8081ffb640 10 client.28438 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:42:25.175 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.166+0000 7f8099d9b640 1 --2- 172.21.15.5:0/2700681613 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55e54e3d7d80 0x55e54e7da7b0 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb2155b0c67f775e server_cookie=23251af425854de1 in_seq=0 out_seq=0 2024-08-31T05:42:25.176 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.166+0000 7f8081ffb640 1 -- 172.21.15.5:0/2700681613 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e54e733f50 con 0x55e54e3d7d80 2024-08-31T05:42:25.176 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.166+0000 7f8081ffb640 10 client.28438 handle_command_reply: tid=0 2024-08-31T05:42:25.176 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.166+0000 7f80a7c73740 1 client.28438 shutdown 2024-08-31T05:42:25.176 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.166+0000 7f80a7c73740 1 -- 172.21.15.5:0/2700681613 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e54e3f02f0 msgr2=0x55e54e7c8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:25.176 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.166+0000 7f80a7c73740 1 --2- 172.21.15.5:0/2700681613 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e54e3f02f0 0x55e54e7c8850 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f808c02a930 tx=0x7f808c005f90 comp rx=0 tx=0).stop 2024-08-31T05:42:25.176 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.166+0000 7f80a7c73740 1 -- 172.21.15.5:0/2700681613 shutdown_connections 2024-08-31T05:42:25.176 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.166+0000 7f80a7c73740 1 --2- 172.21.15.5:0/2700681613 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55e54e3d7d80 0x55e54e7da7b0 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:25.176 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.166+0000 7f80a7c73740 1 --2- 172.21.15.5:0/2700681613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e54e4191b0 0x55e54e7d4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:25.176 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.166+0000 7f80a7c73740 1 --2- 172.21.15.5:0/2700681613 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e54e3f84d0 0x55e54e7c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:25.176 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.166+0000 7f8081ffb640 0 client.28438 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:42:25.176 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.166+0000 7f80a7c73740 1 --2- 172.21.15.5:0/2700681613 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e54e3f02f0 0x55e54e7c8850 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:25.176 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.166+0000 7f80a7c73740 1 -- 172.21.15.5:0/2700681613 >> 172.21.15.5:0/2700681613 conn(0x55e54e40d300 msgr2=0x55e54e7bdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:25.176 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.167+0000 7f80a7c73740 1 -- 172.21.15.5:0/2700681613 shutdown_connections 2024-08-31T05:42:25.177 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.167+0000 7f80a7c73740 1 -- 172.21.15.5:0/2700681613 wait complete. 2024-08-31T05:42:25.177 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.167+0000 7f80a7c73740 20 client.28438 trim_cache size 0 max 16384 2024-08-31T05:42:25.185 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.181+0000 7f80a7c73740 1 Processor -- start 2024-08-31T05:42:25.185 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.181+0000 7f80a7c73740 1 -- start start 2024-08-31T05:42:25.185 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.181+0000 7f80a7c73740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e54e3d7d80 0x55e54e7bad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:25.185 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.182+0000 7f80a7c73740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e54e3f02f0 0x55e54e7be420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:25.185 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.182+0000 7f80a7c73740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e54e3f84d0 0x55e54e7c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:25.185 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.182+0000 7f80a7c73740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f809c1b0d70 con 0x55e54e3d7d80 2024-08-31T05:42:25.185 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.182+0000 7f80a7c73740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f809c1b28b0 con 0x55e54e3f02f0 2024-08-31T05:42:25.185 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.182+0000 7f80a7c73740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f809c1b1440 con 0x55e54e3f84d0 2024-08-31T05:42:25.185 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.182+0000 7f809a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e54e3d7d80 0x55e54e7bad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:25.185 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.182+0000 7f809a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e54e3d7d80 0x55e54e7bad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32934/0 (socket says 172.21.15.5:32934) 2024-08-31T05:42:25.185 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.182+0000 7f809ad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e54e3f84d0 0x55e54e7c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:25.185 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.182+0000 7f809a59c640 1 -- 172.21.15.5:0/3198782998 learned_addr learned my addr 172.21.15.5:0/3198782998 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:25.186 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.182+0000 7f8099d9b640 1 --2- 172.21.15.5:0/3198782998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e54e3f02f0 0x55e54e7be420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:25.186 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.182+0000 7f809a59c640 1 -- 172.21.15.5:0/3198782998 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e54e3f84d0 msgr2=0x55e54e7c8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:25.186 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.182+0000 7f809a59c640 1 --2- 172.21.15.5:0/3198782998 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e54e3f84d0 0x55e54e7c8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:25.186 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.182+0000 7f809a59c640 1 -- 172.21.15.5:0/3198782998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e54e3f02f0 msgr2=0x55e54e7be420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:25.186 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.182+0000 7f809a59c640 1 --2- 172.21.15.5:0/3198782998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e54e3f02f0 0x55e54e7be420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:25.186 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.182+0000 7f809a59c640 1 -- 172.21.15.5:0/3198782998 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e54e7bf210 con 0x55e54e3d7d80 2024-08-31T05:42:25.186 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.182+0000 7f8099d9b640 1 --2- 172.21.15.5:0/3198782998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e54e3f02f0 0x55e54e7be420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:42:25.186 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.182+0000 7f809a59c640 1 --2- 172.21.15.5:0/3198782998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e54e3d7d80 0x55e54e7bad80 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f808c02aac0 tx=0x7f808c032440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae95e5c62beb7d81 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:25.186 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.182+0000 7f8083fff640 1 -- 172.21.15.5:0/3198782998 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f808c037030 con 0x55e54e3d7d80 2024-08-31T05:42:25.186 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.182+0000 7f8083fff640 1 -- 172.21.15.5:0/3198782998 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f808c04a070 con 0x55e54e3d7d80 2024-08-31T05:42:25.186 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.182+0000 7f8083fff640 1 -- 172.21.15.5:0/3198782998 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f808c04d040 con 0x55e54e3d7d80 2024-08-31T05:42:25.189 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.183+0000 7f80a7c73740 1 -- 172.21.15.5:0/3198782998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e54e3d7d80 msgr2=0x55e54e7bad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:25.189 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.183+0000 7f80a7c73740 1 --2- 172.21.15.5:0/3198782998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e54e3d7d80 0x55e54e7bad80 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f808c02aac0 tx=0x7f808c032440 comp rx=0 tx=0).stop 2024-08-31T05:42:25.189 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.183+0000 7f80a7c73740 1 -- 172.21.15.5:0/3198782998 shutdown_connections 2024-08-31T05:42:25.190 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.183+0000 7f80a7c73740 1 --2- 172.21.15.5:0/3198782998 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e54e3f84d0 0x55e54e7c8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:25.190 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.183+0000 7f80a7c73740 1 --2- 172.21.15.5:0/3198782998 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e54e3f02f0 0x55e54e7be420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:25.190 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.183+0000 7f80a7c73740 1 --2- 172.21.15.5:0/3198782998 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e54e3d7d80 0x55e54e7bad80 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:25.190 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.183+0000 7f80a7c73740 1 -- 172.21.15.5:0/3198782998 >> 172.21.15.5:0/3198782998 conn(0x55e54e40d300 msgr2=0x55e54e7bdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:25.190 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.183+0000 7f80a7c73740 1 -- 172.21.15.5:0/3198782998 shutdown_connections 2024-08-31T05:42:25.190 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.183+0000 7f80a7c73740 1 -- 172.21.15.5:0/3198782998 wait complete. 2024-08-31T05:42:25.190 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.184+0000 7f80a7c73740 1 -- start start 2024-08-31T05:42:25.190 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.184+0000 7f80a7c73740 1 Processor -- start 2024-08-31T05:42:25.190 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.184+0000 7f80a7c73740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e54e3d7d80 0x55e54e7dae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:25.190 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.184+0000 7f80a7c73740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e54e3f02f0 0x55e54e7db3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:25.190 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.184+0000 7f80a7c73740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e54e3f84d0 0x55e54e842f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:25.190 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.184+0000 7f80a7c73740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f809c1b21e0 con 0x55e54e3f02f0 2024-08-31T05:42:25.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.184+0000 7f80a7c73740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f809c1b1b10 con 0x55e54e3f84d0 2024-08-31T05:42:25.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.184+0000 7f80a7c73740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f809c1aed70 con 0x55e54e3d7d80 2024-08-31T05:42:25.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.184+0000 7f80a7c73740 10 client.0 _ll_register_callbacks cb 0x7f8094009900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:42:25.191 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.184+0000 7f8099d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e54e3f02f0 0x55e54e7db3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:25.192 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.184+0000 7f809a59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e54e3d7d80 0x55e54e7dae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:25.192 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.184+0000 7f8099d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e54e3f02f0 0x55e54e7db3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32946/0 (socket says 172.21.15.5:32946) 2024-08-31T05:42:25.192 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.184+0000 7f8099d9b640 1 -- 172.21.15.5:0/1125551561 learned_addr learned my addr 172.21.15.5:0/1125551561 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:25.192 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.184+0000 7f809ad9d640 1 --2- 172.21.15.5:0/1125551561 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e54e3f84d0 0x55e54e842f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:25.192 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.185+0000 7f809a59c640 1 -- 172.21.15.5:0/1125551561 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e54e3f84d0 msgr2=0x55e54e842f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:25.192 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.185+0000 7f809a59c640 1 --2- 172.21.15.5:0/1125551561 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e54e3f84d0 0x55e54e842f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:25.192 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.185+0000 7f809a59c640 1 -- 172.21.15.5:0/1125551561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e54e3f02f0 msgr2=0x55e54e7db3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:25.192 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.185+0000 7f809a59c640 1 --2- 172.21.15.5:0/1125551561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e54e3f02f0 0x55e54e7db3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:25.192 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.185+0000 7f809a59c640 1 -- 172.21.15.5:0/1125551561 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e54e843460 con 0x55e54e3d7d80 2024-08-31T05:42:25.192 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.185+0000 7f8099d9b640 1 --2- 172.21.15.5:0/1125551561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e54e3f02f0 0x55e54e7db3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:42:25.192 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.185+0000 7f809a59c640 1 --2- 172.21.15.5:0/1125551561 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e54e3d7d80 0x55e54e7dae70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f808c046d80 tx=0x7f808c02aaf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6bbfad803b325dc4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:25.192 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.185+0000 7f8081ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:42:25.193 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.185+0000 7f8081ffb640 1 -- 172.21.15.5:0/1125551561 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f808c062020 con 0x55e54e3d7d80 2024-08-31T05:42:25.193 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.185+0000 7f8081ffb640 1 -- 172.21.15.5:0/1125551561 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9511+0+0 (secure 0 0 0) 0x7f808c046870 con 0x55e54e3d7d80 2024-08-31T05:42:25.193 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.185+0000 7f80a7c73740 1 -- 172.21.15.5:0/1125551561 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f808c04a070 con 0x55e54e3d7d80 2024-08-31T05:42:25.193 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.185+0000 7f8081ffb640 1 -- 172.21.15.5:0/1125551561 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f808c06d050 con 0x55e54e3d7d80 2024-08-31T05:42:25.193 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.185+0000 7f80a7c73740 10 client.28444 fetch_fsmap learned FSMap version 34 2024-08-31T05:42:25.193 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.185+0000 7f80a7c73740 1 -- 172.21.15.5:0/1125551561 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55e54e844650 con 0x55e54e3d7d80 2024-08-31T05:42:25.193 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.185+0000 7f8081ffb640 1 -- 172.21.15.5:0/1125551561 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f808c04a070 con 0x55e54e3d7d80 2024-08-31T05:42:25.193 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.186+0000 7f8081ffb640 1 -- 172.21.15.5:0/1125551561 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f808c03d5a0 con 0x55e54e3d7d80 2024-08-31T05:42:25.193 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.186+0000 7f80a7c73740 10 client.28444 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:42:25.193 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.186+0000 7f80a7c73740 10 client.28444 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:42:25.193 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.186+0000 7f80a7c73740 20 client.28444 populate_metadata read hostname 'smithi005' 2024-08-31T05:42:25.193 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.186+0000 7f80a7c73740 1 --2- 172.21.15.5:0/1125551561 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55e54e4191b0 0x55e54e846d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:25.193 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.186+0000 7f80a7c73740 4 client.28444 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:42:25.194 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.186+0000 7f80a7c73740 1 -- 172.21.15.5:0/1125551561 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e54e72f9f0 con 0x55e54e4191b0 2024-08-31T05:42:25.194 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.186+0000 7f8099d9b640 1 --2- 172.21.15.5:0/1125551561 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55e54e4191b0 0x55e54e846d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:25.194 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.186+0000 7f8099d9b640 1 --2- 172.21.15.5:0/1125551561 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55e54e4191b0 0x55e54e846d70 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6ba92dbab177e29 server_cookie=b841b861645bfae0 in_seq=0 out_seq=0 2024-08-31T05:42:25.194 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.186+0000 7f8081ffb640 10 client.28444 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:42:25.202 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.200+0000 7f8081ffb640 1 -- 172.21.15.5:0/1125551561 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e54e72f9f0 con 0x55e54e4191b0 2024-08-31T05:42:25.202 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.200+0000 7f8081ffb640 10 client.28444 handle_command_reply: tid=0 2024-08-31T05:42:25.202 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.200+0000 7f80a7c73740 1 client.28444 shutdown 2024-08-31T05:42:25.202 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.200+0000 7f80a7c73740 1 -- 172.21.15.5:0/1125551561 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e54e3d7d80 msgr2=0x55e54e7dae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:25.203 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.200+0000 7f80a7c73740 1 --2- 172.21.15.5:0/1125551561 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e54e3d7d80 0x55e54e7dae70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f808c046d80 tx=0x7f808c02aaf0 comp rx=0 tx=0).stop 2024-08-31T05:42:25.203 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.200+0000 7f80a7c73740 1 -- 172.21.15.5:0/1125551561 shutdown_connections 2024-08-31T05:42:25.203 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.200+0000 7f80a7c73740 1 --2- 172.21.15.5:0/1125551561 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55e54e4191b0 0x55e54e846d70 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:25.203 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.200+0000 7f80a7c73740 1 --2- 172.21.15.5:0/1125551561 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55e54e3f84d0 0x55e54e842f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:25.203 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.200+0000 7f8081ffb640 0 client.28444 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:42:25.203 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.200+0000 7f80a7c73740 1 --2- 172.21.15.5:0/1125551561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55e54e3f02f0 0x55e54e7db3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:25.203 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.200+0000 7f80a7c73740 1 --2- 172.21.15.5:0/1125551561 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e54e3d7d80 0x55e54e7dae70 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:25.203 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.200+0000 7f80a7c73740 1 -- 172.21.15.5:0/1125551561 >> 172.21.15.5:0/1125551561 conn(0x55e54e40d300 msgr2=0x55e54e7bab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:25.203 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.200+0000 7f80a7c73740 1 -- 172.21.15.5:0/1125551561 shutdown_connections 2024-08-31T05:42:25.203 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.200+0000 7f80a7c73740 1 -- 172.21.15.5:0/1125551561 wait complete. 2024-08-31T05:42:25.203 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.200+0000 7f80a7c73740 20 client.28444 trim_cache size 0 max 16384 2024-08-31T05:42:25.204 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:42:25.204 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:42:25.204 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:42:25.204 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:42:25.205 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.201+0000 7f80a0c25640 1 -- 172.21.15.5:0/791787839 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f80840b4ca0 msgr2=0x7f80840b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:25.205 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.201+0000 7f80a0c25640 1 --2- 172.21.15.5:0/791787839 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f80840b4ca0 0x7f80840b71b0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f8094009fd0 tx=0x7f8094010040 comp rx=0 tx=0).stop 2024-08-31T05:42:25.205 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.201+0000 7f80a0c25640 1 -- 172.21.15.5:0/791787839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f809c104ea0 msgr2=0x7f809c19b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:25.205 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.201+0000 7f80a0c25640 1 --2- 172.21.15.5:0/791787839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f809c104ea0 0x7f809c19b590 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f809000e970 tx=0x7f809000ee30 comp rx=0 tx=0).stop 2024-08-31T05:42:25.205 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.201+0000 7f80a0c25640 1 -- 172.21.15.5:0/791787839 shutdown_connections 2024-08-31T05:42:25.205 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.201+0000 7f80a0c25640 1 --2- 172.21.15.5:0/791787839 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f80840b4ca0 0x7f80840b71b0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:25.205 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.201+0000 7f80a0c25640 1 --2- 172.21.15.5:0/791787839 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f809c1057f0 0x7f809c19bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:25.205 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.201+0000 7f80a0c25640 1 --2- 172.21.15.5:0/791787839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f809c104ea0 0x7f809c19b590 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:25.205 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.201+0000 7f80a0c25640 1 --2- 172.21.15.5:0/791787839 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f809c102ee0 0x7f809c19b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:25.205 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.201+0000 7f80a0c25640 1 -- 172.21.15.5:0/791787839 >> 172.21.15.5:0/791787839 conn(0x7f809c079a80 msgr2=0x7f809c106e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:25.206 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.201+0000 7f80a0c25640 1 -- 172.21.15.5:0/791787839 shutdown_connections 2024-08-31T05:42:25.206 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:25.201+0000 7f80a0c25640 1 -- 172.21.15.5:0/791787839 wait complete. 2024-08-31T05:42:25.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:42:24 smithi070 ceph-mon[22316]: pgmap v730: 129 pgs: 129 active+clean; 596 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.0 MiB/s wr, 188 op/s 2024-08-31T05:42:25.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:42:24 smithi050 ceph-mon[22146]: pgmap v730: 129 pgs: 129 active+clean; 596 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.0 MiB/s wr, 188 op/s 2024-08-31T05:42:25.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:42:24 smithi005 ceph-mon[18602]: pgmap v730: 129 pgs: 129 active+clean; 596 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.0 MiB/s wr, 188 op/s 2024-08-31T05:42:25.941 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1397614 10.76 MB/sec execute 553 sec latency 14.925 ms 2024-08-31T05:42:26.941 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1400115 10.77 MB/sec execute 554 sec latency 18.780 ms 2024-08-31T05:42:27.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:42:26 smithi070 ceph-mon[22316]: pgmap v731: 129 pgs: 129 active+clean; 603 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.0 MiB/s wr, 185 op/s 2024-08-31T05:42:27.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:42:26 smithi050 ceph-mon[22146]: pgmap v731: 129 pgs: 129 active+clean; 603 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.0 MiB/s wr, 185 op/s 2024-08-31T05:42:27.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:42:26 smithi005 ceph-mon[18602]: pgmap v731: 129 pgs: 129 active+clean; 603 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.0 MiB/s wr, 185 op/s 2024-08-31T05:42:27.941 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1401566 10.76 MB/sec execute 555 sec latency 27.008 ms 2024-08-31T05:42:28.941 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1403925 10.77 MB/sec execute 556 sec latency 17.831 ms 2024-08-31T05:42:29.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:42:29 smithi070 ceph-mon[22316]: pgmap v732: 129 pgs: 129 active+clean; 607 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.0 MiB/s wr, 188 op/s 2024-08-31T05:42:29.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:42:29 smithi050 ceph-mon[22146]: pgmap v732: 129 pgs: 129 active+clean; 607 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.0 MiB/s wr, 188 op/s 2024-08-31T05:42:29.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:42:29 smithi005 ceph-mon[18602]: pgmap v732: 129 pgs: 129 active+clean; 607 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.0 MiB/s wr, 188 op/s 2024-08-31T05:42:29.941 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1405225 10.76 MB/sec execute 557 sec latency 104.833 ms 2024-08-31T05:42:30.941 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1407565 10.76 MB/sec execute 558 sec latency 21.019 ms 2024-08-31T05:42:31.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:42:31 smithi070 ceph-mon[22316]: pgmap v733: 129 pgs: 129 active+clean; 610 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.8 MiB/s wr, 220 op/s 2024-08-31T05:42:31.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:42:31 smithi050 ceph-mon[22146]: pgmap v733: 129 pgs: 129 active+clean; 610 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.8 MiB/s wr, 220 op/s 2024-08-31T05:42:31.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:42:31 smithi005 ceph-mon[18602]: pgmap v733: 129 pgs: 129 active+clean; 610 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.8 MiB/s wr, 220 op/s 2024-08-31T05:42:31.576 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T05:42:31.842 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:42:31.942 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1409604 10.76 MB/sec execute 559 sec latency 17.277 ms 2024-08-31T05:42:32.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.474+0000 7fec17fa9640 1 -- 172.21.15.5:0/4185148064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec10106020 msgr2=0x7fec10106430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:32.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.474+0000 7fec17fa9640 1 --2- 172.21.15.5:0/4185148064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec10106020 0x7fec10106430 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fec00009900 tx=0x7fec0002a410 comp rx=0 tx=0).stop 2024-08-31T05:42:32.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.474+0000 7fec17fa9640 1 -- 172.21.15.5:0/4185148064 shutdown_connections 2024-08-31T05:42:32.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.474+0000 7fec17fa9640 1 --2- 172.21.15.5:0/4185148064 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec10106970 0x7fec10110400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:32.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.474+0000 7fec17fa9640 1 --2- 172.21.15.5:0/4185148064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec10106020 0x7fec10106430 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:32.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.474+0000 7fec17fa9640 1 --2- 172.21.15.5:0/4185148064 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec10101dd0 0x7fec101021e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:32.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.474+0000 7fec17fa9640 1 -- 172.21.15.5:0/4185148064 >> 172.21.15.5:0/4185148064 conn(0x7fec10077a00 msgr2=0x7fec10077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:32.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.474+0000 7fec17fa9640 1 -- 172.21.15.5:0/4185148064 shutdown_connections 2024-08-31T05:42:32.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.474+0000 7fec17fa9640 1 -- 172.21.15.5:0/4185148064 wait complete. 2024-08-31T05:42:32.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.475+0000 7fec17fa9640 1 Processor -- start 2024-08-31T05:42:32.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.475+0000 7fec17fa9640 1 -- start start 2024-08-31T05:42:32.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.475+0000 7fec17fa9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec10101dd0 0x7fec1019a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:32.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.476+0000 7fec17fa9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec10106020 0x7fec1019a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:32.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.476+0000 7fec17fa9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec10106970 0x7fec1019fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:32.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.476+0000 7fec17fa9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fec10113840 con 0x7fec10106970 2024-08-31T05:42:32.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.476+0000 7fec17fa9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fec101136c0 con 0x7fec10101dd0 2024-08-31T05:42:32.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.476+0000 7fec17fa9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fec101139c0 con 0x7fec10106020 2024-08-31T05:42:32.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.476+0000 7fec15d45640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec10101dd0 0x7fec1019a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:32.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.476+0000 7fec15d45640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec10101dd0 0x7fec1019a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:53764/0 (socket says 172.21.15.5:53764) 2024-08-31T05:42:32.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.476+0000 7fec16546640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec10106970 0x7fec1019fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:32.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.476+0000 7fec15d45640 1 -- 172.21.15.5:0/3919075060 learned_addr learned my addr 172.21.15.5:0/3919075060 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:32.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.476+0000 7fec15544640 1 --2- 172.21.15.5:0/3919075060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec10106020 0x7fec1019a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:32.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.476+0000 7fec16546640 1 -- 172.21.15.5:0/3919075060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec10106020 msgr2=0x7fec1019a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:32.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.476+0000 7fec16546640 1 --2- 172.21.15.5:0/3919075060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec10106020 0x7fec1019a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:32.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.476+0000 7fec16546640 1 -- 172.21.15.5:0/3919075060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec10101dd0 msgr2=0x7fec1019a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:32.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.476+0000 7fec16546640 1 --2- 172.21.15.5:0/3919075060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec10101dd0 0x7fec1019a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:32.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.476+0000 7fec16546640 1 -- 172.21.15.5:0/3919075060 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec101a01c0 con 0x7fec10106970 2024-08-31T05:42:32.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.476+0000 7fec15d45640 1 --2- 172.21.15.5:0/3919075060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec10101dd0 0x7fec1019a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:42:32.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.476+0000 7fec16546640 1 --2- 172.21.15.5:0/3919075060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec10106970 0x7fec1019fa90 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fec08009fd0 tx=0x7fec0800ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:32.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.477+0000 7fec06ffd640 1 -- 172.21.15.5:0/3919075060 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec0800ce20 con 0x7fec10106970 2024-08-31T05:42:32.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.477+0000 7fec17fa9640 1 -- 172.21.15.5:0/3919075060 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec101a04b0 con 0x7fec10106970 2024-08-31T05:42:32.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.477+0000 7fec17fa9640 1 -- 172.21.15.5:0/3919075060 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec101a6c10 con 0x7fec10106970 2024-08-31T05:42:32.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.477+0000 7fec06ffd640 1 -- 172.21.15.5:0/3919075060 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec08010430 con 0x7fec10106970 2024-08-31T05:42:32.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.477+0000 7fec06ffd640 1 -- 172.21.15.5:0/3919075060 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec0800f620 con 0x7fec10106970 2024-08-31T05:42:32.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.479+0000 7fec1e51e740 1 Processor -- start 2024-08-31T05:42:32.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.480+0000 7fec06ffd640 1 -- 172.21.15.5:0/3919075060 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fec0800f7c0 con 0x7fec10106970 2024-08-31T05:42:32.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.480+0000 7fec1e51e740 1 -- start start 2024-08-31T05:42:32.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.480+0000 7fec1e51e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5561c03a1070 0x5561c07462c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:32.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.480+0000 7fec1e51e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5561c03781b0 0x5561c0746800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:32.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.480+0000 7fec1e51e740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5561c0380390 0x5561c0746d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:32.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.480+0000 7fec1e51e740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5561c06bd630 con 0x5561c0380390 2024-08-31T05:42:32.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.480+0000 7fec1e51e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5561c06acbc0 con 0x5561c03781b0 2024-08-31T05:42:32.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.480+0000 7fec1e51e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5561c06b0b70 con 0x5561c03a1070 2024-08-31T05:42:32.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.481+0000 7fec15544640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5561c03a1070 0x5561c07462c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:32.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.481+0000 7fec15544640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5561c03a1070 0x5561c07462c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:41612/0 (socket says 172.21.15.5:41612) 2024-08-31T05:42:32.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.481+0000 7fec15544640 1 -- 172.21.15.5:0/2164982717 learned_addr learned my addr 172.21.15.5:0/2164982717 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:32.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.481+0000 7fec15544640 1 --2- 172.21.15.5:0/2164982717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5561c0380390 0x5561c0746d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:32.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.481+0000 7fec15d45640 1 --2- 172.21.15.5:0/2164982717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5561c03781b0 0x5561c0746800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:32.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.481+0000 7fec15544640 1 -- 172.21.15.5:0/2164982717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5561c03781b0 msgr2=0x5561c0746800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:32.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.481+0000 7fec15544640 1 --2- 172.21.15.5:0/2164982717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5561c03781b0 0x5561c0746800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:32.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.481+0000 7fec15544640 1 -- 172.21.15.5:0/2164982717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5561c0380390 msgr2=0x5561c0746d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:32.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.481+0000 7fec15544640 1 --2- 172.21.15.5:0/2164982717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5561c0380390 0x5561c0746d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:32.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.481+0000 7fec15544640 1 -- 172.21.15.5:0/2164982717 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561c040c650 con 0x5561c03a1070 2024-08-31T05:42:32.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.481+0000 7fec06ffd640 1 --2- 172.21.15.5:0/3919075060 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7febfc0b4ca0 0x7febfc0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:32.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.481+0000 7fec15544640 1 --2- 172.21.15.5:0/2164982717 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5561c03a1070 0x5561c07462c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fec10075850 tx=0x7fec00000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6f97003886ffafb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:32.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.481+0000 7fec15d45640 1 --2- 172.21.15.5:0/3919075060 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7febfc0b4ca0 0x7febfc0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:32.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.481+0000 7fec06ffd640 1 -- 172.21.15.5:0/3919075060 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9511+0+0 (secure 0 0 0) 0x7fec080e5aa0 con 0x7fec10106970 2024-08-31T05:42:32.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.481+0000 7febfbfff640 1 -- 172.21.15.5:0/2164982717 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec00035070 con 0x5561c03a1070 2024-08-31T05:42:32.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.482+0000 7febfbfff640 1 -- 172.21.15.5:0/2164982717 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec00031770 con 0x5561c03a1070 2024-08-31T05:42:32.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.482+0000 7febfbfff640 1 -- 172.21.15.5:0/2164982717 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec00003d00 con 0x5561c03a1070 2024-08-31T05:42:32.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.482+0000 7fec1e51e740 1 -- 172.21.15.5:0/2164982717 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5561c03a1070 msgr2=0x5561c07462c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:32.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.482+0000 7fec15d45640 1 --2- 172.21.15.5:0/3919075060 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7febfc0b4ca0 0x7febfc0b71b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x5561c0744f40 tx=0x7fec0c015040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:32.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.482+0000 7fec1e51e740 1 --2- 172.21.15.5:0/2164982717 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5561c03a1070 0x5561c07462c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fec10075850 tx=0x7fec00000bc0 comp rx=0 tx=0).stop 2024-08-31T05:42:32.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.483+0000 7fec1e51e740 1 -- 172.21.15.5:0/2164982717 shutdown_connections 2024-08-31T05:42:32.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.483+0000 7fec1e51e740 1 --2- 172.21.15.5:0/2164982717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5561c0380390 0x5561c0746d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:32.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.483+0000 7fec1e51e740 1 --2- 172.21.15.5:0/2164982717 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5561c03781b0 0x5561c0746800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:32.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.483+0000 7fec1e51e740 1 --2- 172.21.15.5:0/2164982717 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5561c03a1070 0x5561c07462c0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:32.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.483+0000 7fec1e51e740 1 -- 172.21.15.5:0/2164982717 >> 172.21.15.5:0/2164982717 conn(0x5561c0395460 msgr2=0x5561c07441b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:32.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.483+0000 7fec1e51e740 1 -- 172.21.15.5:0/2164982717 shutdown_connections 2024-08-31T05:42:32.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.483+0000 7fec1e51e740 1 -- 172.21.15.5:0/2164982717 wait complete. 2024-08-31T05:42:32.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.483+0000 7fec1e51e740 1 -- start start 2024-08-31T05:42:32.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.483+0000 7fec1e51e740 1 Processor -- start 2024-08-31T05:42:32.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.484+0000 7fec1e51e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5561c03781b0 0x5561c0751a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:32.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.484+0000 7fec1e51e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5561c0380390 0x5561c0751fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:32.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.484+0000 7fec1e51e740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5561c03a1070 0x5561c075ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:32.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.484+0000 7fec1e51e740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5561c050f700 con 0x5561c03a1070 2024-08-31T05:42:32.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.484+0000 7fec1e51e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5561c0633700 con 0x5561c0380390 2024-08-31T05:42:32.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.484+0000 7fec1e51e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5561c0754a40 con 0x5561c03781b0 2024-08-31T05:42:32.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.484+0000 7fec1e51e740 10 client.0 _ll_register_callbacks cb 0x5561c0662dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:42:32.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.484+0000 7fec16546640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5561c03a1070 0x5561c075ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:32.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.484+0000 7fec15d45640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5561c03781b0 0x5561c0751a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:32.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.484+0000 7fec15544640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5561c0380390 0x5561c0751fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:32.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.484+0000 7fec16546640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5561c03a1070 0x5561c075ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57994/0 (socket says 172.21.15.5:57994) 2024-08-31T05:42:32.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.484+0000 7fec16546640 1 -- 172.21.15.5:0/196244812 learned_addr learned my addr 172.21.15.5:0/196244812 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:32.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.484+0000 7fec15d45640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5561c03781b0 0x5561c0751a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:41624/0 (socket says 172.21.15.5:41624) 2024-08-31T05:42:32.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.484+0000 7fec16546640 1 -- 172.21.15.5:0/196244812 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5561c03781b0 msgr2=0x5561c0751a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:32.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.484+0000 7fec16546640 1 --2- 172.21.15.5:0/196244812 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5561c03781b0 0x5561c0751a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:32.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.484+0000 7fec16546640 1 -- 172.21.15.5:0/196244812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5561c0380390 msgr2=0x5561c0751fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:32.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.484+0000 7fec16546640 1 --2- 172.21.15.5:0/196244812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5561c0380390 0x5561c0751fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:32.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.484+0000 7fec16546640 1 -- 172.21.15.5:0/196244812 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561c066c8b0 con 0x5561c03a1070 2024-08-31T05:42:32.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.484+0000 7fec15544640 1 --2- 172.21.15.5:0/196244812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5561c0380390 0x5561c0751fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:42:32.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.484+0000 7fec16546640 1 --2- 172.21.15.5:0/196244812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5561c03a1070 0x5561c075ddc0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fec080abab0 tx=0x7fec080abe70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e2463beb590a751 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:32.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.484+0000 7febf97fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:42:32.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.485+0000 7febf97fa640 1 -- 172.21.15.5:0/196244812 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec080b0190 con 0x5561c03a1070 2024-08-31T05:42:32.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.485+0000 7febf97fa640 1 -- 172.21.15.5:0/196244812 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9511+0+0 (secure 0 0 0) 0x7fec080b0330 con 0x5561c03a1070 2024-08-31T05:42:32.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.485+0000 7fec1e51e740 1 -- 172.21.15.5:0/196244812 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec00031770 con 0x5561c03a1070 2024-08-31T05:42:32.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.485+0000 7febf97fa640 1 -- 172.21.15.5:0/196244812 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fec080970d0 con 0x5561c03a1070 2024-08-31T05:42:32.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.485+0000 7fec1e51e740 10 client.18876 fetch_fsmap learned FSMap version 34 2024-08-31T05:42:32.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.485+0000 7fec1e51e740 1 -- 172.21.15.5:0/196244812 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5561c0760880 con 0x5561c03a1070 2024-08-31T05:42:32.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.485+0000 7febf97fa640 1 -- 172.21.15.5:0/196244812 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec00031770 con 0x5561c03a1070 2024-08-31T05:42:32.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.485+0000 7febf97fa640 1 -- 172.21.15.5:0/196244812 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fec0801f020 con 0x5561c03a1070 2024-08-31T05:42:32.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.485+0000 7fec1e51e740 10 client.18876 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:42:32.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.485+0000 7fec1e51e740 10 client.18876 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:42:32.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.485+0000 7fec1e51e740 20 client.18876 populate_metadata read hostname 'smithi005' 2024-08-31T05:42:32.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.485+0000 7fec1e51e740 1 --2- 172.21.15.5:0/196244812 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5561c035f9f0 0x5561c0763d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:32.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.485+0000 7fec1e51e740 4 client.18876 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:42:32.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.485+0000 7fec1e51e740 1 -- 172.21.15.5:0/196244812 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5561c06bf580 con 0x5561c035f9f0 2024-08-31T05:42:32.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.485+0000 7fec15d45640 1 --2- 172.21.15.5:0/196244812 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5561c035f9f0 0x5561c0763d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:32.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.486+0000 7febf97fa640 10 client.18876 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:42:32.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.486+0000 7fec15d45640 1 --2- 172.21.15.5:0/196244812 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5561c035f9f0 0x5561c0763d90 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94f6adbf4a399c33 server_cookie=c361b11677df0ce8 in_seq=0 out_seq=0 2024-08-31T05:42:32.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.487+0000 7febf97fa640 1 -- 172.21.15.5:0/196244812 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5561c06bf580 con 0x5561c035f9f0 2024-08-31T05:42:32.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.487+0000 7febf97fa640 10 client.18876 handle_command_reply: tid=0 2024-08-31T05:42:32.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.487+0000 7fec1e51e740 1 client.18876 shutdown 2024-08-31T05:42:32.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.487+0000 7fec1e51e740 1 -- 172.21.15.5:0/196244812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5561c03a1070 msgr2=0x5561c075ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:32.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.487+0000 7fec1e51e740 1 --2- 172.21.15.5:0/196244812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5561c03a1070 0x5561c075ddc0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fec080abab0 tx=0x7fec080abe70 comp rx=0 tx=0).stop 2024-08-31T05:42:32.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.487+0000 7fec1e51e740 1 -- 172.21.15.5:0/196244812 shutdown_connections 2024-08-31T05:42:32.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.487+0000 7fec1e51e740 1 --2- 172.21.15.5:0/196244812 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5561c035f9f0 0x5561c0763d90 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:32.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.487+0000 7fec1e51e740 1 --2- 172.21.15.5:0/196244812 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5561c03a1070 0x5561c075ddc0 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:32.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.487+0000 7fec1e51e740 1 --2- 172.21.15.5:0/196244812 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5561c0380390 0x5561c0751fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:32.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.487+0000 7fec1e51e740 1 --2- 172.21.15.5:0/196244812 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5561c03781b0 0x5561c0751a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:32.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.487+0000 7febf97fa640 0 client.18876 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:42:32.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.487+0000 7fec1e51e740 1 -- 172.21.15.5:0/196244812 >> 172.21.15.5:0/196244812 conn(0x5561c0395460 msgr2=0x5561c0749450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:32.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.487+0000 7fec1e51e740 1 -- 172.21.15.5:0/196244812 shutdown_connections 2024-08-31T05:42:32.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.487+0000 7fec1e51e740 1 -- 172.21.15.5:0/196244812 wait complete. 2024-08-31T05:42:32.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.487+0000 7fec1e51e740 20 client.18876 trim_cache size 0 max 16384 2024-08-31T05:42:32.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.506+0000 7fec1e51e740 1 Processor -- start 2024-08-31T05:42:32.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.506+0000 7fec1e51e740 1 -- start start 2024-08-31T05:42:32.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.506+0000 7fec1e51e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5561c03781b0 0x5561c0749ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:32.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.506+0000 7fec1e51e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5561c0380390 0x5561c075dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:32.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.506+0000 7fec1e51e740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5561c03a1070 0x5561c0743ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:32.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.506+0000 7fec1e51e740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7febf400ffe0 con 0x5561c03a1070 2024-08-31T05:42:32.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.506+0000 7fec1e51e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7febf4011b20 con 0x5561c0380390 2024-08-31T05:42:32.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.506+0000 7fec1e51e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7febf40106b0 con 0x5561c03781b0 2024-08-31T05:42:32.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.507+0000 7fec16546640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5561c03a1070 0x5561c0743ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:32.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.507+0000 7fec15544640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5561c0380390 0x5561c075dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:32.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.507+0000 7fec15544640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5561c0380390 0x5561c075dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:53796/0 (socket says 172.21.15.5:53796) 2024-08-31T05:42:32.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.507+0000 7fec16546640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5561c03a1070 0x5561c0743ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58008/0 (socket says 172.21.15.5:58008) 2024-08-31T05:42:32.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.507+0000 7fec15544640 1 -- 172.21.15.5:0/1813143004 learned_addr learned my addr 172.21.15.5:0/1813143004 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:32.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.507+0000 7fec15d45640 1 --2- 172.21.15.5:0/1813143004 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5561c03781b0 0x5561c0749ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:32.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.507+0000 7fec15544640 1 -- 172.21.15.5:0/1813143004 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5561c03781b0 msgr2=0x5561c0749ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:32.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.507+0000 7fec15544640 1 --2- 172.21.15.5:0/1813143004 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5561c03781b0 0x5561c0749ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:32.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.507+0000 7fec15544640 1 -- 172.21.15.5:0/1813143004 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5561c03a1070 msgr2=0x5561c0743ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:32.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.507+0000 7fec15544640 1 --2- 172.21.15.5:0/1813143004 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5561c03a1070 0x5561c0743ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:32.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.507+0000 7fec15544640 1 -- 172.21.15.5:0/1813143004 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561c07509d0 con 0x5561c0380390 2024-08-31T05:42:32.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.507+0000 7fec15544640 1 --2- 172.21.15.5:0/1813143004 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5561c0380390 0x5561c075dcc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fec00009900 tx=0x7fec000038e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=371cf3873efd7780 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:32.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.507+0000 7febfb7fe640 1 -- 172.21.15.5:0/1813143004 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec00051070 con 0x5561c0380390 2024-08-31T05:42:32.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.507+0000 7febfb7fe640 1 -- 172.21.15.5:0/1813143004 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec00041040 con 0x5561c0380390 2024-08-31T05:42:32.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.507+0000 7febfb7fe640 1 -- 172.21.15.5:0/1813143004 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec00035040 con 0x5561c0380390 2024-08-31T05:42:32.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.508+0000 7fec1e51e740 1 -- 172.21.15.5:0/1813143004 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5561c0380390 msgr2=0x5561c075dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:32.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.508+0000 7fec1e51e740 1 --2- 172.21.15.5:0/1813143004 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5561c0380390 0x5561c075dcc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fec00009900 tx=0x7fec000038e0 comp rx=0 tx=0).stop 2024-08-31T05:42:32.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.508+0000 7fec1e51e740 1 -- 172.21.15.5:0/1813143004 shutdown_connections 2024-08-31T05:42:32.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.508+0000 7fec1e51e740 1 --2- 172.21.15.5:0/1813143004 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5561c03a1070 0x5561c0743ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:32.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.508+0000 7fec1e51e740 1 --2- 172.21.15.5:0/1813143004 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5561c0380390 0x5561c075dcc0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:32.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.508+0000 7fec1e51e740 1 --2- 172.21.15.5:0/1813143004 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5561c03781b0 0x5561c0749ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:32.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.508+0000 7fec1e51e740 1 -- 172.21.15.5:0/1813143004 >> 172.21.15.5:0/1813143004 conn(0x5561c0395460 msgr2=0x5561c07493c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:32.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.508+0000 7fec1e51e740 1 -- 172.21.15.5:0/1813143004 shutdown_connections 2024-08-31T05:42:32.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.508+0000 7fec1e51e740 1 -- 172.21.15.5:0/1813143004 wait complete. 2024-08-31T05:42:32.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.509+0000 7fec1e51e740 1 -- start start 2024-08-31T05:42:32.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.509+0000 7fec1e51e740 1 Processor -- start 2024-08-31T05:42:32.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.509+0000 7fec1e51e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5561c03781b0 0x5561c07566e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:32.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.509+0000 7fec1e51e740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5561c0380390 0x5561c0756cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:32.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.509+0000 7fec1e51e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5561c03a1070 0x5561c07c7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:32.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.509+0000 7fec1e51e740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7febf4011450 con 0x5561c0380390 2024-08-31T05:42:32.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.509+0000 7fec1e51e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7febf4010d80 con 0x5561c03a1070 2024-08-31T05:42:32.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.509+0000 7fec1e51e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7febf400dfe0 con 0x5561c03781b0 2024-08-31T05:42:32.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.510+0000 7fec15d45640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5561c03781b0 0x5561c07566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:32.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.510+0000 7fec15544640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5561c0380390 0x5561c0756cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:32.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.510+0000 7fec1e51e740 10 client.0 _ll_register_callbacks cb 0x7fec080abb80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:42:32.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.510+0000 7fec15d45640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5561c03781b0 0x5561c07566e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:41642/0 (socket says 172.21.15.5:41642) 2024-08-31T05:42:32.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.510+0000 7fec15d45640 1 -- 172.21.15.5:0/2506193304 learned_addr learned my addr 172.21.15.5:0/2506193304 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:32.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.510+0000 7fec16546640 1 --2- 172.21.15.5:0/2506193304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5561c03a1070 0x5561c07c7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:32.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.510+0000 7fec15544640 1 -- 172.21.15.5:0/2506193304 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5561c03781b0 msgr2=0x5561c07566e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:32.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.510+0000 7fec15544640 1 --2- 172.21.15.5:0/2506193304 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5561c03781b0 0x5561c07566e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:32.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.510+0000 7fec15544640 1 -- 172.21.15.5:0/2506193304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5561c03a1070 msgr2=0x5561c07c7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:32.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.510+0000 7fec15544640 1 --2- 172.21.15.5:0/2506193304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5561c03a1070 0x5561c07c7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:32.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.510+0000 7fec15544640 1 -- 172.21.15.5:0/2506193304 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561c07c7e70 con 0x5561c0380390 2024-08-31T05:42:32.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.510+0000 7fec15d45640 1 --2- 172.21.15.5:0/2506193304 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5561c03781b0 0x5561c07566e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:42:32.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.510+0000 7fec15544640 1 --2- 172.21.15.5:0/2506193304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5561c0380390 0x5561c0756cc0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fec0002a930 tx=0x7fec00031960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e544c8717877c29e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:32.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.510+0000 7febf97fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:42:32.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.510+0000 7febf97fa640 1 -- 172.21.15.5:0/2506193304 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec0005d070 con 0x5561c0380390 2024-08-31T05:42:32.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.510+0000 7febf97fa640 1 -- 172.21.15.5:0/2506193304 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9511+0+0 (secure 0 0 0) 0x7fec00032480 con 0x5561c0380390 2024-08-31T05:42:32.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.510+0000 7fec1e51e740 1 -- 172.21.15.5:0/2506193304 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec00041040 con 0x5561c0380390 2024-08-31T05:42:32.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.511+0000 7febf97fa640 1 -- 172.21.15.5:0/2506193304 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fec00069050 con 0x5561c0380390 2024-08-31T05:42:32.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.511+0000 7fec1e51e740 10 client.18882 fetch_fsmap learned FSMap version 34 2024-08-31T05:42:32.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.511+0000 7fec1e51e740 1 -- 172.21.15.5:0/2506193304 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5561c07cf1a0 con 0x5561c0380390 2024-08-31T05:42:32.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.511+0000 7febf97fa640 1 -- 172.21.15.5:0/2506193304 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec00041040 con 0x5561c0380390 2024-08-31T05:42:32.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.511+0000 7febf97fa640 1 -- 172.21.15.5:0/2506193304 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fec00032680 con 0x5561c0380390 2024-08-31T05:42:32.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.511+0000 7fec1e51e740 10 client.18882 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:42:32.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.511+0000 7fec1e51e740 10 client.18882 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:42:32.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.511+0000 7fec1e51e740 20 client.18882 populate_metadata read hostname 'smithi005' 2024-08-31T05:42:32.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.511+0000 7fec1e51e740 1 --2- 172.21.15.5:0/2506193304 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5561c0334da0 0x5561c07d1380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:32.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.511+0000 7fec1e51e740 4 client.18882 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T05:42:32.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.511+0000 7fec1e51e740 1 -- 172.21.15.5:0/2506193304 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5561c06bb020 con 0x5561c0334da0 2024-08-31T05:42:32.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.511+0000 7fec15d45640 1 --2- 172.21.15.5:0/2506193304 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5561c0334da0 0x5561c07d1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:32.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.512+0000 7fec15d45640 1 --2- 172.21.15.5:0/2506193304 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5561c0334da0 0x5561c07d1380 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5dc007145d22f030 server_cookie=ff17bc9f6265fc67 in_seq=0 out_seq=0 2024-08-31T05:42:32.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.512+0000 7febf97fa640 10 client.18882 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:42:32.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.512+0000 7febf97fa640 1 -- 172.21.15.5:0/2506193304 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4634 (crc 0 0 0) 0x5561c06bb020 con 0x5561c0334da0 2024-08-31T05:42:32.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.512+0000 7febf97fa640 10 client.18882 handle_command_reply: tid=0 2024-08-31T05:42:32.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.512+0000 7fec1e51e740 1 client.18882 shutdown 2024-08-31T05:42:32.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.512+0000 7fec1e51e740 1 -- 172.21.15.5:0/2506193304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5561c0380390 msgr2=0x5561c0756cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:32.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.512+0000 7fec1e51e740 1 --2- 172.21.15.5:0/2506193304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5561c0380390 0x5561c0756cc0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fec0002a930 tx=0x7fec00031960 comp rx=0 tx=0).stop 2024-08-31T05:42:32.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.512+0000 7fec1e51e740 1 -- 172.21.15.5:0/2506193304 shutdown_connections 2024-08-31T05:42:32.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.512+0000 7fec1e51e740 1 --2- 172.21.15.5:0/2506193304 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5561c0334da0 0x5561c07d1380 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:32.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.512+0000 7fec1e51e740 1 --2- 172.21.15.5:0/2506193304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5561c03a1070 0x5561c07c7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:32.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.512+0000 7fec1e51e740 1 --2- 172.21.15.5:0/2506193304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5561c0380390 0x5561c0756cc0 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:32.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.512+0000 7fec1e51e740 1 --2- 172.21.15.5:0/2506193304 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5561c03781b0 0x5561c07566e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:32.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.512+0000 7febf97fa640 0 client.18882 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:42:32.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.512+0000 7fec1e51e740 1 -- 172.21.15.5:0/2506193304 >> 172.21.15.5:0/2506193304 conn(0x5561c0395460 msgr2=0x5561c07439e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:32.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.512+0000 7fec1e51e740 1 -- 172.21.15.5:0/2506193304 shutdown_connections 2024-08-31T05:42:32.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.512+0000 7fec1e51e740 1 -- 172.21.15.5:0/2506193304 wait complete. 2024-08-31T05:42:32.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.512+0000 7fec1e51e740 20 client.18882 trim_cache size 0 max 16384 2024-08-31T05:42:32.520 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:42:32.520 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "no active scrubs running", 2024-08-31T05:42:32.520 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": {}, 2024-08-31T05:42:32.520 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_stats": { 2024-08-31T05:42:32.520 INFO:teuthology.orchestra.run.smithi005.stdout: "ab2853ca-505f-43fc-a132-af8bca186292": { 2024-08-31T05:42:32.521 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:40:23.937602+0000", 2024-08-31T05:42:32.521 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:42:32.521 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:42:32.521 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:42:32.521 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:42:32.521 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:42:32.521 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:42:32.521 INFO:teuthology.orchestra.run.smithi005.stdout: "75d84398-5d9c-4872-b879-2fbce045fa71": { 2024-08-31T05:42:32.521 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:06.642335+0000", 2024-08-31T05:42:32.521 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:42:32.521 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:42:32.521 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:42:32.521 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:42:32.522 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:42:32.522 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:42:32.522 INFO:teuthology.orchestra.run.smithi005.stdout: "ece37b07-9ab2-45f8-bc33-2755a07aac0b": { 2024-08-31T05:42:32.522 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:31:41.782407+0000", 2024-08-31T05:42:32.522 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:42:32.522 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:42:32.522 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:42:32.522 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:42:32.522 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:42:32.522 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:42:32.522 INFO:teuthology.orchestra.run.smithi005.stdout: "728a42ca-bbef-4151-830f-5fdd411d8fa0": { 2024-08-31T05:42:32.522 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:32:30.554906+0000", 2024-08-31T05:42:32.522 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:42:32.523 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:42:32.523 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:42:32.523 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:42:32.523 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:42:32.523 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:42:32.523 INFO:teuthology.orchestra.run.smithi005.stdout: "cda92ac0-b35f-47a5-a3a5-471c888462a5": { 2024-08-31T05:42:32.523 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:53.103905+0000", 2024-08-31T05:42:32.523 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:42:32.523 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:42:32.523 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:42:32.523 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:42:32.523 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:42:32.523 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:42:32.523 INFO:teuthology.orchestra.run.smithi005.stdout: "0bb67292-013a-40c7-b5fc-810bdd9715d8": { 2024-08-31T05:42:32.524 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:34:04.586008+0000", 2024-08-31T05:42:32.524 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:42:32.524 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:42:32.524 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:42:32.524 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:42:32.524 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:42:32.524 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:42:32.524 INFO:teuthology.orchestra.run.smithi005.stdout: "c9a687a5-4adf-4788-8f18-4c06352efa9b": { 2024-08-31T05:42:32.524 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:41:11.380197+0000", 2024-08-31T05:42:32.524 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:42:32.524 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:42:32.524 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:42:32.524 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:42:32.525 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:42:32.525 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:42:32.525 INFO:teuthology.orchestra.run.smithi005.stdout: "de9731c7-ae4a-42fe-8146-e4752cdc40d4": { 2024-08-31T05:42:32.525 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:34:53.614499+0000", 2024-08-31T05:42:32.525 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:42:32.525 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:42:32.525 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:42:32.525 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:42:32.525 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:42:32.525 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:42:32.525 INFO:teuthology.orchestra.run.smithi005.stdout: "f4db3406-20ff-46a3-baf9-099e16392f76": { 2024-08-31T05:42:32.525 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:38:49.034412+0000", 2024-08-31T05:42:32.525 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:42:32.525 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:42:32.526 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:42:32.526 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:42:32.526 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:42:32.526 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:42:32.526 INFO:teuthology.orchestra.run.smithi005.stdout: "095ccc7a-f368-4bc6-9563-5930e21f9b4a": { 2024-08-31T05:42:32.526 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:35:40.190069+0000", 2024-08-31T05:42:32.526 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:42:32.526 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:42:32.526 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:42:32.526 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:42:32.526 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:42:32.526 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:42:32.526 INFO:teuthology.orchestra.run.smithi005.stdout: "4788e020-0dc9-4938-9db8-dfd5992cb286": { 2024-08-31T05:42:32.527 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:41:58.905797+0000", 2024-08-31T05:42:32.527 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:42:32.527 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:42:32.527 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:42:32.527 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:42:32.527 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:42:32.527 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:42:32.527 INFO:teuthology.orchestra.run.smithi005.stdout: "297c26f3-7b4d-4245-abb0-f854248e5e1b": { 2024-08-31T05:42:32.527 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:37:14.019244+0000", 2024-08-31T05:42:32.527 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:42:32.527 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:42:32.527 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:42:32.527 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:42:32.528 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:42:32.528 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:42:32.528 INFO:teuthology.orchestra.run.smithi005.stdout: "a4d4cf74-2477-4dd9-a3a2-3762b4dd87e4": { 2024-08-31T05:42:32.528 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:38:01.378833+0000", 2024-08-31T05:42:32.528 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:42:32.528 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:42:32.528 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:42:32.528 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:42:32.528 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:42:32.528 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:42:32.528 INFO:teuthology.orchestra.run.smithi005.stdout: "94c23057-592d-4a8b-82d7-da2d84f8740b": { 2024-08-31T05:42:32.528 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:36:27.513638+0000", 2024-08-31T05:42:32.528 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:42:32.529 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:42:32.529 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:42:32.529 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:42:32.529 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:42:32.529 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:42:32.529 INFO:teuthology.orchestra.run.smithi005.stdout: "2445fc42-b797-434f-b380-e2da985b4d98": { 2024-08-31T05:42:32.529 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:33:17.681453+0000", 2024-08-31T05:42:32.529 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:42:32.529 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:42:32.529 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:42:32.529 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:42:32.529 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:42:32.529 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:42:32.529 INFO:teuthology.orchestra.run.smithi005.stdout: "239b7958-db06-4432-93ce-b7552effa357": { 2024-08-31T05:42:32.530 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:39:35.733028+0000", 2024-08-31T05:42:32.530 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:42:32.530 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:42:32.530 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:42:32.530 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:42:32.530 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:42:32.530 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:42:32.530 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:42:32.530 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:42:32.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.513+0000 7fec17fa9640 1 -- 172.21.15.5:0/3919075060 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7febfc0b4ca0 msgr2=0x7febfc0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:32.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.513+0000 7fec17fa9640 1 --2- 172.21.15.5:0/3919075060 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7febfc0b4ca0 0x7febfc0b71b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x5561c0744f40 tx=0x7fec0c015040 comp rx=0 tx=0).stop 2024-08-31T05:42:32.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.513+0000 7fec17fa9640 1 -- 172.21.15.5:0/3919075060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec10106970 msgr2=0x7fec1019fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:32.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.513+0000 7fec17fa9640 1 --2- 172.21.15.5:0/3919075060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec10106970 0x7fec1019fa90 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fec08009fd0 tx=0x7fec0800ef10 comp rx=0 tx=0).stop 2024-08-31T05:42:32.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.513+0000 7fec17fa9640 1 -- 172.21.15.5:0/3919075060 shutdown_connections 2024-08-31T05:42:32.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.513+0000 7fec17fa9640 1 --2- 172.21.15.5:0/3919075060 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7febfc0b4ca0 0x7febfc0b71b0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:32.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.513+0000 7fec17fa9640 1 --2- 172.21.15.5:0/3919075060 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec10106970 0x7fec1019fa90 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:32.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.513+0000 7fec17fa9640 1 --2- 172.21.15.5:0/3919075060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec10106020 0x7fec1019a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:32.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.513+0000 7fec17fa9640 1 --2- 172.21.15.5:0/3919075060 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fec10101dd0 0x7fec1019a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:32.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.513+0000 7fec17fa9640 1 -- 172.21.15.5:0/3919075060 >> 172.21.15.5:0/3919075060 conn(0x7fec10077a00 msgr2=0x7fec101072f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:32.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.513+0000 7fec17fa9640 1 -- 172.21.15.5:0/3919075060 shutdown_connections 2024-08-31T05:42:32.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:32.513+0000 7fec17fa9640 1 -- 172.21.15.5:0/3919075060 wait complete. 2024-08-31T05:42:32.942 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1411600 10.76 MB/sec execute 560 sec latency 24.086 ms 2024-08-31T05:42:33.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:42:33 smithi070 ceph-mon[22316]: pgmap v734: 129 pgs: 129 active+clean; 618 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.9 MiB/s wr, 186 op/s 2024-08-31T05:42:33.400 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:42:33 smithi005 ceph-mon[18602]: pgmap v734: 129 pgs: 129 active+clean; 618 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.9 MiB/s wr, 186 op/s 2024-08-31T05:42:33.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:42:33 smithi050 ceph-mon[22146]: pgmap v734: 129 pgs: 129 active+clean; 618 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.9 MiB/s wr, 186 op/s 2024-08-31T05:42:33.427 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T05:42:33.427 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T05:42:33.688 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:42:33.942 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1414162 10.77 MB/sec execute 561 sec latency 19.176 ms 2024-08-31T05:42:34.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.347+0000 7f2ed09d6640 1 -- 172.21.15.5:0/2863630947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ecc105030 msgr2=0x7f2ecc10d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:34.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.347+0000 7f2ed09d6640 1 --2- 172.21.15.5:0/2863630947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ecc105030 0x7f2ecc10d670 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f2eb4009900 tx=0x7f2eb402a410 comp rx=0 tx=0).stop 2024-08-31T05:42:34.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.347+0000 7f2ed09d6640 1 -- 172.21.15.5:0/2863630947 shutdown_connections 2024-08-31T05:42:34.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.347+0000 7f2ed09d6640 1 --2- 172.21.15.5:0/2863630947 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ecc10dbb0 0x7f2ecc1100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:34.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.347+0000 7f2ed09d6640 1 --2- 172.21.15.5:0/2863630947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ecc105030 0x7f2ecc10d670 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:34.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.347+0000 7f2ed09d6640 1 --2- 172.21.15.5:0/2863630947 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ecc104600 0x7f2ecc104a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:34.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.347+0000 7f2ed09d6640 1 -- 172.21.15.5:0/2863630947 >> 172.21.15.5:0/2863630947 conn(0x7f2ecc0794e0 msgr2=0x7f2ecc0798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:34.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.347+0000 7f2ed09d6640 1 -- 172.21.15.5:0/2863630947 shutdown_connections 2024-08-31T05:42:34.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.347+0000 7f2ed09d6640 1 -- 172.21.15.5:0/2863630947 wait complete. 2024-08-31T05:42:34.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.348+0000 7f2ed09d6640 1 Processor -- start 2024-08-31T05:42:34.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.348+0000 7f2ed09d6640 1 -- start start 2024-08-31T05:42:34.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.348+0000 7f2ed09d6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ecc104600 0x7f2ecc19a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:34.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.348+0000 7f2ed09d6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ecc105030 0x7f2ecc19a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:34.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.348+0000 7f2ed09d6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ecc10dbb0 0x7f2ecc19fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:34.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.348+0000 7f2ed09d6640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2ecc113810 con 0x7f2ecc104600 2024-08-31T05:42:34.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.348+0000 7f2ed09d6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2ecc113690 con 0x7f2ecc105030 2024-08-31T05:42:34.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.348+0000 7f2ed09d6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2ecc113990 con 0x7f2ecc10dbb0 2024-08-31T05:42:34.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.349+0000 7f2ec9d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ecc105030 0x7f2ecc19a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:34.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.349+0000 7f2eca59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ecc104600 0x7f2ecc19a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:34.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.349+0000 7f2ec9d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ecc105030 0x7f2ecc19a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:53820/0 (socket says 172.21.15.5:53820) 2024-08-31T05:42:34.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.349+0000 7f2ec9d9b640 1 -- 172.21.15.5:0/2862986182 learned_addr learned my addr 172.21.15.5:0/2862986182 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:34.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.349+0000 7f2ecad9d640 1 --2- 172.21.15.5:0/2862986182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ecc10dbb0 0x7f2ecc19fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:34.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.349+0000 7f2eca59c640 1 -- 172.21.15.5:0/2862986182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ecc10dbb0 msgr2=0x7f2ecc19fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:34.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.349+0000 7f2eca59c640 1 --2- 172.21.15.5:0/2862986182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ecc10dbb0 0x7f2ecc19fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:34.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.349+0000 7f2eca59c640 1 -- 172.21.15.5:0/2862986182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ecc105030 msgr2=0x7f2ecc19a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:34.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.349+0000 7f2eca59c640 1 --2- 172.21.15.5:0/2862986182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ecc105030 0x7f2ecc19a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:34.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.349+0000 7f2eca59c640 1 -- 172.21.15.5:0/2862986182 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ecc1a01b0 con 0x7f2ecc104600 2024-08-31T05:42:34.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.349+0000 7f2ec9d9b640 1 --2- 172.21.15.5:0/2862986182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ecc105030 0x7f2ecc19a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:42:34.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.349+0000 7f2eca59c640 1 --2- 172.21.15.5:0/2862986182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ecc104600 0x7f2ecc19a240 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc00e9c0 tx=0x7f2ebc00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:34.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.349+0000 7f2ec37fe640 1 -- 172.21.15.5:0/2862986182 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc00ccc0 con 0x7f2ecc104600 2024-08-31T05:42:34.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.349+0000 7f2ec37fe640 1 -- 172.21.15.5:0/2862986182 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ebc0035f0 con 0x7f2ecc104600 2024-08-31T05:42:34.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.349+0000 7f2ed09d6640 1 -- 172.21.15.5:0/2862986182 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ecc1a04a0 con 0x7f2ecc104600 2024-08-31T05:42:34.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.349+0000 7f2ec37fe640 1 -- 172.21.15.5:0/2862986182 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc00ce60 con 0x7f2ecc104600 2024-08-31T05:42:34.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.349+0000 7f2ed09d6640 1 -- 172.21.15.5:0/2862986182 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ecc1a6c00 con 0x7f2ecc104600 2024-08-31T05:42:34.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.351+0000 7f2ed09d6640 1 -- 172.21.15.5:0/2862986182 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ecc06bf80 con 0x7f2ecc104600 2024-08-31T05:42:34.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.352+0000 7f2ec37fe640 1 -- 172.21.15.5:0/2862986182 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f2ebc004000 con 0x7f2ecc104600 2024-08-31T05:42:34.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.353+0000 7f2ec37fe640 1 --2- 172.21.15.5:0/2862986182 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2eb80b4ca0 0x7f2eb80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:34.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.353+0000 7f2ec9d9b640 1 --2- 172.21.15.5:0/2862986182 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2eb80b4ca0 0x7f2eb80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:34.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.353+0000 7f2ec37fe640 1 -- 172.21.15.5:0/2862986182 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9511+0+0 (secure 0 0 0) 0x7f2ebc0e5d00 con 0x7f2ecc104600 2024-08-31T05:42:34.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.353+0000 7f2ec9d9b640 1 --2- 172.21.15.5:0/2862986182 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2eb80b4ca0 0x7f2eb80b71b0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc102200 tx=0x7f2eb4032ed0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:34.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.357+0000 7f2ec37fe640 1 -- 172.21.15.5:0/2862986182 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2ebc0ac6b0 con 0x7f2ecc104600 2024-08-31T05:42:34.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.633+0000 7f2ed09d6640 1 -- 172.21.15.5:0/2862986182 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2ecc104a10 con 0x7f2ecc104600 2024-08-31T05:42:34.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.635+0000 7f2ec37fe640 1 -- 172.21.15.5:0/2862986182 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11941 (secure 0 0 0) 0x7f2ebc0abfb0 con 0x7f2ecc104600 2024-08-31T05:42:34.637 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:42:34.638 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":34,"btime":"2024-08-31T05:33:43:289944+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14739,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2024812199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2024812199},{"type":"v1","addr":"172.21.15.5:6835","nonce":2024812199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3629023702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3629023702},{"type":"v1","addr":"172.21.15.5:6837","nonce":3629023702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T05:27:31.929153+0000","modified":"2024-08-31T05:33:42.378207+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24652,"mds_1":24638,"mds_2":24631,"mds_3":24625,"mds_4":24602},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6839/2412701258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":2412701258},{"type":"v1","addr":"172.21.15.5:6839","nonce":2412701258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14820":{"gid":14820,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6841/747057838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":747057838},{"type":"v1","addr":"172.21.15.5:6841","nonce":747057838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6833/1153378982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1153378982},{"type":"v1","addr":"172.21.15.50:6833","nonce":1153378982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6833/364083443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":364083443},{"type":"v1","addr":"172.21.15.70:6833","nonce":364083443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24587":{"gid":24587,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/2346896794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2346896794},{"type":"v1","addr":"172.21.15.50:6835","nonce":2346896794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24602":{"gid":24602,"name":"h","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.50:6837/428759669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":428759669},{"type":"v1","addr":"172.21.15.50:6837","nonce":428759669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.70:6835/2061504114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2061504114},{"type":"v1","addr":"172.21.15.70:6835","nonce":2061504114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.70:6837/2780036414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2780036414},{"type":"v1","addr":"172.21.15.70:6837","nonce":2780036414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.50:6839/98200944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":98200944},{"type":"v1","addr":"172.21.15.50:6839","nonce":98200944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24652":{"gid":24652,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.70:6839/2756569250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":2756569250},{"type":"v1","addr":"172.21.15.70:6839","nonce":2756569250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24652,"qdb_cluster":[24652,24631,24638,24625,24602]},"id":1}]} 2024-08-31T05:42:34.638 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 34 2024-08-31T05:42:34.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.641+0000 7f2ed09d6640 1 -- 172.21.15.5:0/2862986182 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2eb80b4ca0 msgr2=0x7f2eb80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:34.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.641+0000 7f2ed09d6640 1 --2- 172.21.15.5:0/2862986182 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2eb80b4ca0 0x7f2eb80b71b0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc102200 tx=0x7f2eb4032ed0 comp rx=0 tx=0).stop 2024-08-31T05:42:34.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.641+0000 7f2ed09d6640 1 -- 172.21.15.5:0/2862986182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ecc104600 msgr2=0x7f2ecc19a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:34.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.641+0000 7f2ed09d6640 1 --2- 172.21.15.5:0/2862986182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ecc104600 0x7f2ecc19a240 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc00e9c0 tx=0x7f2ebc00ee80 comp rx=0 tx=0).stop 2024-08-31T05:42:34.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.641+0000 7f2ed09d6640 1 -- 172.21.15.5:0/2862986182 shutdown_connections 2024-08-31T05:42:34.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.641+0000 7f2ed09d6640 1 --2- 172.21.15.5:0/2862986182 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f2eb80b4ca0 0x7f2eb80b71b0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:34.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.641+0000 7f2ed09d6640 1 --2- 172.21.15.5:0/2862986182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ecc10dbb0 0x7f2ecc19fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:34.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.641+0000 7f2ed09d6640 1 --2- 172.21.15.5:0/2862986182 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2ecc105030 0x7f2ecc19a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:34.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.641+0000 7f2ed09d6640 1 --2- 172.21.15.5:0/2862986182 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ecc104600 0x7f2ecc19a240 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:34.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.641+0000 7f2ed09d6640 1 -- 172.21.15.5:0/2862986182 >> 172.21.15.5:0/2862986182 conn(0x7f2ecc0794e0 msgr2=0x7f2ecc1005e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:34.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.644+0000 7f2ed09d6640 1 -- 172.21.15.5:0/2862986182 shutdown_connections 2024-08-31T05:42:34.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:34.645+0000 7f2ed09d6640 1 -- 172.21.15.5:0/2862986182 wait complete. 2024-08-31T05:42:34.944 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1415271 10.76 MB/sec execute 562 sec latency 66.576 ms 2024-08-31T05:42:35.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:42:35 smithi070 ceph-mon[22316]: pgmap v735: 129 pgs: 129 active+clean; 606 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.7 MiB/s wr, 174 op/s 2024-08-31T05:42:35.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:42:35 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/2862986182' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:42:35.370 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:42:35 smithi005 ceph-mon[18602]: pgmap v735: 129 pgs: 129 active+clean; 606 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.7 MiB/s wr, 174 op/s 2024-08-31T05:42:35.370 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:42:35 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/2862986182' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:42:35.397 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-31T05:42:35.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:42:35 smithi050 ceph-mon[22146]: pgmap v735: 129 pgs: 129 active+clean; 606 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.7 MiB/s wr, 174 op/s 2024-08-31T05:42:35.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:42:35 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/2862986182' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:42:35.670 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:42:35.942 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1417424 10.76 MB/sec execute 563 sec latency 24.133 ms 2024-08-31T05:42:36.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.181+0000 7fbe87be2640 1 -- 172.21.15.5:0/751250074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe80108140 msgr2=0x7fbe80108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:36.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.181+0000 7fbe87be2640 1 --2- 172.21.15.5:0/751250074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe80108140 0x7fbe80108550 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fbe74009900 tx=0x7fbe7402a410 comp rx=0 tx=0).stop 2024-08-31T05:42:36.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.181+0000 7fbe87be2640 1 -- 172.21.15.5:0/751250074 shutdown_connections 2024-08-31T05:42:36.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.181+0000 7fbe87be2640 1 --2- 172.21.15.5:0/751250074 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe80108a90 0x7fbe8010f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:36.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.181+0000 7fbe87be2640 1 --2- 172.21.15.5:0/751250074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe80108140 0x7fbe80108550 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:36.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.181+0000 7fbe87be2640 1 --2- 172.21.15.5:0/751250074 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe80102800 0x7fbe80102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:36.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.181+0000 7fbe87be2640 1 -- 172.21.15.5:0/751250074 >> 172.21.15.5:0/751250074 conn(0x7fbe800794d0 msgr2=0x7fbe800798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:36.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.181+0000 7fbe87be2640 1 -- 172.21.15.5:0/751250074 shutdown_connections 2024-08-31T05:42:36.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.181+0000 7fbe87be2640 1 -- 172.21.15.5:0/751250074 wait complete. 2024-08-31T05:42:36.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.182+0000 7fbe87be2640 1 Processor -- start 2024-08-31T05:42:36.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.182+0000 7fbe87be2640 1 -- start start 2024-08-31T05:42:36.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.182+0000 7fbe87be2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe80102800 0x7fbe8019c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:36.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.182+0000 7fbe87be2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe80108140 0x7fbe8019ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:36.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.182+0000 7fbe87be2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe80108a90 0x7fbe801a1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:36.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.182+0000 7fbe87be2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbe801126c0 con 0x7fbe80102800 2024-08-31T05:42:36.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.182+0000 7fbe87be2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbe80112540 con 0x7fbe80108140 2024-08-31T05:42:36.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.182+0000 7fbe87be2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbe80112840 con 0x7fbe80108a90 2024-08-31T05:42:36.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.182+0000 7fbe8597e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe80102800 0x7fbe8019c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:36.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.182+0000 7fbe8597e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe80102800 0x7fbe8019c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58050/0 (socket says 172.21.15.5:58050) 2024-08-31T05:42:36.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.182+0000 7fbe8597e640 1 -- 172.21.15.5:0/3656309766 learned_addr learned my addr 172.21.15.5:0/3656309766 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:36.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.182+0000 7fbe8517d640 1 --2- 172.21.15.5:0/3656309766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe80108140 0x7fbe8019ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:36.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.182+0000 7fbe8617f640 1 --2- 172.21.15.5:0/3656309766 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe80108a90 0x7fbe801a1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:36.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.182+0000 7fbe8597e640 1 -- 172.21.15.5:0/3656309766 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe80108a90 msgr2=0x7fbe801a1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:36.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.182+0000 7fbe8597e640 1 --2- 172.21.15.5:0/3656309766 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe80108a90 0x7fbe801a1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:36.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.182+0000 7fbe8597e640 1 -- 172.21.15.5:0/3656309766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe80108140 msgr2=0x7fbe8019ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:36.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.182+0000 7fbe8597e640 1 --2- 172.21.15.5:0/3656309766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe80108140 0x7fbe8019ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:36.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.182+0000 7fbe8597e640 1 -- 172.21.15.5:0/3656309766 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe801a23e0 con 0x7fbe80102800 2024-08-31T05:42:36.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.182+0000 7fbe8517d640 1 --2- 172.21.15.5:0/3656309766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe80108140 0x7fbe8019ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:42:36.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.182+0000 7fbe8617f640 1 --2- 172.21.15.5:0/3656309766 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe80108a90 0x7fbe801a1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:42:36.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.183+0000 7fbe8597e640 1 --2- 172.21.15.5:0/3656309766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe80102800 0x7fbe8019c470 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fbe7000ebc0 tx=0x7fbe7000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:36.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.183+0000 7fbe7effd640 1 -- 172.21.15.5:0/3656309766 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe70010430 con 0x7fbe80102800 2024-08-31T05:42:36.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.183+0000 7fbe87be2640 1 -- 172.21.15.5:0/3656309766 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe801a26d0 con 0x7fbe80102800 2024-08-31T05:42:36.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.183+0000 7fbe7effd640 1 -- 172.21.15.5:0/3656309766 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe70010a80 con 0x7fbe80102800 2024-08-31T05:42:36.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.183+0000 7fbe7effd640 1 -- 172.21.15.5:0/3656309766 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe70018a50 con 0x7fbe80102800 2024-08-31T05:42:36.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.183+0000 7fbe87be2640 1 -- 172.21.15.5:0/3656309766 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe801a8e30 con 0x7fbe80102800 2024-08-31T05:42:36.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.186+0000 7fbe8e157740 1 Processor -- start 2024-08-31T05:42:36.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.186+0000 7fbe8e157740 1 -- start start 2024-08-31T05:42:36.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.186+0000 7fbe7effd640 1 -- 172.21.15.5:0/3656309766 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fbe70010c30 con 0x7fbe80102800 2024-08-31T05:42:36.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.186+0000 7fbe8e157740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eb52cae070 0x55eb53053310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:36.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.186+0000 7fbe8e157740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eb52c851b0 0x55eb53053850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:36.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.186+0000 7fbe8e157740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb52c8d390 0x55eb53053d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:36.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.186+0000 7fbe8e157740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55eb52fca680 con 0x55eb52c851b0 2024-08-31T05:42:36.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.186+0000 7fbe8e157740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55eb52fb9c10 con 0x55eb52c8d390 2024-08-31T05:42:36.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.186+0000 7fbe8e157740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55eb52fbdbc0 con 0x55eb52cae070 2024-08-31T05:42:36.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.186+0000 7fbe8597e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eb52c851b0 0x55eb53053850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:36.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.186+0000 7fbe8617f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eb52cae070 0x55eb53053310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:36.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.186+0000 7fbe8617f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eb52cae070 0x55eb53053310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:41682/0 (socket says 172.21.15.5:41682) 2024-08-31T05:42:36.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.186+0000 7fbe8617f640 1 -- 172.21.15.5:0/2178194834 learned_addr learned my addr 172.21.15.5:0/2178194834 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:36.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.186+0000 7fbe8517d640 1 --2- 172.21.15.5:0/2178194834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb52c8d390 0x55eb53053d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:36.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.187+0000 7fbe8617f640 1 -- 172.21.15.5:0/2178194834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb52c8d390 msgr2=0x55eb53053d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:36.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.187+0000 7fbe8617f640 1 --2- 172.21.15.5:0/2178194834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb52c8d390 0x55eb53053d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:36.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.187+0000 7fbe8617f640 1 -- 172.21.15.5:0/2178194834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eb52c851b0 msgr2=0x55eb53053850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:36.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.187+0000 7fbe8617f640 1 --2- 172.21.15.5:0/2178194834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eb52c851b0 0x55eb53053850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:36.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.187+0000 7fbe8617f640 1 -- 172.21.15.5:0/2178194834 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb52d19650 con 0x55eb52cae070 2024-08-31T05:42:36.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.187+0000 7fbe7effd640 1 --2- 172.21.15.5:0/3656309766 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fbe680b4ca0 0x7fbe680b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:36.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.187+0000 7fbe8617f640 1 --2- 172.21.15.5:0/2178194834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eb52cae070 0x55eb53053310 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fbe78011470 tx=0x7fbe78011930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed3eee474822fb03 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:36.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.187+0000 7fbe8597e640 1 --2- 172.21.15.5:0/3656309766 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fbe680b4ca0 0x7fbe680b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:36.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.187+0000 7fbe67fff640 1 -- 172.21.15.5:0/2178194834 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe7801e070 con 0x55eb52cae070 2024-08-31T05:42:36.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.187+0000 7fbe7effd640 1 -- 172.21.15.5:0/3656309766 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9511+0+0 (secure 0 0 0) 0x7fbe700e5ff0 con 0x7fbe80102800 2024-08-31T05:42:36.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.187+0000 7fbe67fff640 1 -- 172.21.15.5:0/2178194834 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe7800f9f0 con 0x55eb52cae070 2024-08-31T05:42:36.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.187+0000 7fbe67fff640 1 -- 172.21.15.5:0/2178194834 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe78019a50 con 0x55eb52cae070 2024-08-31T05:42:36.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.188+0000 7fbe8e157740 1 -- 172.21.15.5:0/2178194834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eb52cae070 msgr2=0x55eb53053310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:36.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.188+0000 7fbe8597e640 1 --2- 172.21.15.5:0/3656309766 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fbe680b4ca0 0x7fbe680b71b0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fbe700e3410 tx=0x7fbe700e9b40 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:36.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.188+0000 7fbe8e157740 1 --2- 172.21.15.5:0/2178194834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eb52cae070 0x55eb53053310 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fbe78011470 tx=0x7fbe78011930 comp rx=0 tx=0).stop 2024-08-31T05:42:36.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.188+0000 7fbe8e157740 1 -- 172.21.15.5:0/2178194834 shutdown_connections 2024-08-31T05:42:36.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.188+0000 7fbe8e157740 1 --2- 172.21.15.5:0/2178194834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb52c8d390 0x55eb53053d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:36.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.188+0000 7fbe8e157740 1 --2- 172.21.15.5:0/2178194834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eb52c851b0 0x55eb53053850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:36.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.188+0000 7fbe8e157740 1 --2- 172.21.15.5:0/2178194834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eb52cae070 0x55eb53053310 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:36.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.188+0000 7fbe8e157740 1 -- 172.21.15.5:0/2178194834 >> 172.21.15.5:0/2178194834 conn(0x55eb52ca2460 msgr2=0x55eb53051200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:36.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.189+0000 7fbe8e157740 1 -- 172.21.15.5:0/2178194834 shutdown_connections 2024-08-31T05:42:36.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.189+0000 7fbe8e157740 1 -- 172.21.15.5:0/2178194834 wait complete. 2024-08-31T05:42:36.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.189+0000 7fbe8e157740 1 -- start start 2024-08-31T05:42:36.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.189+0000 7fbe8e157740 1 Processor -- start 2024-08-31T05:42:36.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.190+0000 7fbe8e157740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eb52c851b0 0x55eb5305ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:36.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.190+0000 7fbe8e157740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eb52c8d390 0x55eb5305efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:36.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.190+0000 7fbe8e157740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb52cae070 0x55eb5306ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:36.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.190+0000 7fbe8e157740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55eb52e1c700 con 0x55eb52c8d390 2024-08-31T05:42:36.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.190+0000 7fbe8e157740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55eb52f40750 con 0x55eb52cae070 2024-08-31T05:42:36.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.190+0000 7fbe8e157740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55eb53061af0 con 0x55eb52c851b0 2024-08-31T05:42:36.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.190+0000 7fbe8617f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eb52c851b0 0x55eb5305ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:36.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.190+0000 7fbe8e157740 10 client.0 _ll_register_callbacks cb 0x55eb52f6fe10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:42:36.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.190+0000 7fbe8617f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eb52c851b0 0x55eb5305ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:41696/0 (socket says 172.21.15.5:41696) 2024-08-31T05:42:36.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.190+0000 7fbe8517d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eb52c8d390 0x55eb5305efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:36.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.190+0000 7fbe8617f640 1 -- 172.21.15.5:0/3800299605 learned_addr learned my addr 172.21.15.5:0/3800299605 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:36.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.190+0000 7fbe8617f640 1 --2- 172.21.15.5:0/3800299605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb52cae070 0x55eb5306ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:36.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.190+0000 7fbe8617f640 1 -- 172.21.15.5:0/3800299605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb52cae070 msgr2=0x55eb5306ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:36.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.190+0000 7fbe8617f640 1 --2- 172.21.15.5:0/3800299605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb52cae070 0x55eb5306ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:36.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.190+0000 7fbe8617f640 1 -- 172.21.15.5:0/3800299605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eb52c8d390 msgr2=0x55eb5305efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:36.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.190+0000 7fbe8617f640 1 --2- 172.21.15.5:0/3800299605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eb52c8d390 0x55eb5305efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:36.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.190+0000 7fbe8617f640 1 -- 172.21.15.5:0/3800299605 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb52f79900 con 0x55eb52c851b0 2024-08-31T05:42:36.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.191+0000 7fbe8617f640 1 --2- 172.21.15.5:0/3800299605 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eb52c851b0 0x55eb5305ea90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fbe78019530 tx=0x7fbe78019630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=594e6d9c72c426f1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:36.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.191+0000 7fbe657fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:42:36.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.191+0000 7fbe657fa640 1 -- 172.21.15.5:0/3800299605 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe7801e070 con 0x55eb52c851b0 2024-08-31T05:42:36.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.191+0000 7fbe8e157740 1 -- 172.21.15.5:0/3800299605 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe7800f9f0 con 0x55eb52c851b0 2024-08-31T05:42:36.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.191+0000 7fbe657fa640 1 -- 172.21.15.5:0/3800299605 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9511+0+0 (secure 0 0 0) 0x7fbe78005260 con 0x55eb52c851b0 2024-08-31T05:42:36.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.191+0000 7fbe657fa640 1 -- 172.21.15.5:0/3800299605 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fbe78032050 con 0x55eb52c851b0 2024-08-31T05:42:36.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.191+0000 7fbe8e157740 10 client.28480 fetch_fsmap learned FSMap version 34 2024-08-31T05:42:36.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.191+0000 7fbe8e157740 1 -- 172.21.15.5:0/3800299605 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55eb5306d8d0 con 0x55eb52c851b0 2024-08-31T05:42:36.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.191+0000 7fbe657fa640 1 -- 172.21.15.5:0/3800299605 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe7800f9f0 con 0x55eb52c851b0 2024-08-31T05:42:36.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.192+0000 7fbe657fa640 1 -- 172.21.15.5:0/3800299605 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fbe78004880 con 0x55eb52c851b0 2024-08-31T05:42:36.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.192+0000 7fbe8e157740 10 client.28480 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:42:36.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.192+0000 7fbe8e157740 10 client.28480 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-31T05:42:36.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.192+0000 7fbe8e157740 20 client.28480 populate_metadata read hostname 'smithi005' 2024-08-31T05:42:36.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.192+0000 7fbe8e157740 1 --2- 172.21.15.5:0/3800299605 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55eb52c6c9f0 0x55eb53071090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:36.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.192+0000 7fbe8e157740 4 client.28480 mds_command: new command op to 24602 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:42:36.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.192+0000 7fbe8e157740 1 -- 172.21.15.5:0/3800299605 --> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eb52fcc5d0 con 0x55eb52c6c9f0 2024-08-31T05:42:36.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.192+0000 7fbe8517d640 1 --2- 172.21.15.5:0/3800299605 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55eb52c6c9f0 0x55eb53071090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:36.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.193+0000 7fbe657fa640 10 client.28480 ms_handle_connect on v2:172.21.15.50:6836/428759669 2024-08-31T05:42:36.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.193+0000 7fbe8517d640 1 --2- 172.21.15.5:0/3800299605 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55eb52c6c9f0 0x55eb53071090 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=125d68249b4b1c8a server_cookie=a38881c61fe39e0 in_seq=0 out_seq=0 2024-08-31T05:42:36.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.193+0000 7fbe657fa640 1 -- 172.21.15.5:0/3800299605 <== mds.4 v2:172.21.15.50:6836/428759669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55eb52fcc5d0 con 0x55eb52c6c9f0 2024-08-31T05:42:36.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.193+0000 7fbe657fa640 10 client.28480 handle_command_reply: tid=0 2024-08-31T05:42:36.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.193+0000 7fbe8e157740 1 client.28480 shutdown 2024-08-31T05:42:36.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.193+0000 7fbe8e157740 1 -- 172.21.15.5:0/3800299605 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eb52c851b0 msgr2=0x55eb5305ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:36.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.193+0000 7fbe8e157740 1 --2- 172.21.15.5:0/3800299605 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eb52c851b0 0x55eb5305ea90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fbe78019530 tx=0x7fbe78019630 comp rx=0 tx=0).stop 2024-08-31T05:42:36.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.194+0000 7fbe8e157740 1 -- 172.21.15.5:0/3800299605 shutdown_connections 2024-08-31T05:42:36.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.194+0000 7fbe8e157740 1 --2- 172.21.15.5:0/3800299605 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55eb52c6c9f0 0x55eb53071090 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:36.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.194+0000 7fbe8e157740 1 --2- 172.21.15.5:0/3800299605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb52cae070 0x55eb5306ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:36.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.194+0000 7fbe8e157740 1 --2- 172.21.15.5:0/3800299605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eb52c8d390 0x55eb5305efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:36.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.194+0000 7fbe657fa640 0 client.28480 ms_handle_reset on v2:172.21.15.50:6836/428759669 2024-08-31T05:42:36.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.194+0000 7fbe8e157740 1 --2- 172.21.15.5:0/3800299605 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eb52c851b0 0x55eb5305ea90 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:36.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.194+0000 7fbe8e157740 1 -- 172.21.15.5:0/3800299605 >> 172.21.15.5:0/3800299605 conn(0x55eb52ca2460 msgr2=0x55eb530564a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:36.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.194+0000 7fbe8e157740 1 -- 172.21.15.5:0/3800299605 shutdown_connections 2024-08-31T05:42:36.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.194+0000 7fbe8e157740 1 -- 172.21.15.5:0/3800299605 wait complete. 2024-08-31T05:42:36.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.194+0000 7fbe8e157740 20 client.28480 trim_cache size 0 max 16384 2024-08-31T05:42:36.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.207+0000 7fbe8e157740 1 Processor -- start 2024-08-31T05:42:36.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.207+0000 7fbe8e157740 1 -- start start 2024-08-31T05:42:36.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.208+0000 7fbe8e157740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eb52c851b0 0x55eb53051300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:36.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.208+0000 7fbe8e157740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb52c8d390 0x55eb5306ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:36.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.208+0000 7fbe8e157740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eb52cae070 0x55eb5306b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:36.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.208+0000 7fbe8e157740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbe801b2fb0 con 0x55eb52c851b0 2024-08-31T05:42:36.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.208+0000 7fbe8e157740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbe801b4af0 con 0x55eb52c8d390 2024-08-31T05:42:36.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.208+0000 7fbe8e157740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbe801b3680 con 0x55eb52cae070 2024-08-31T05:42:36.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.208+0000 7fbe8617f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eb52c851b0 0x55eb53051300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:36.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.208+0000 7fbe8617f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eb52c851b0 0x55eb53051300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58072/0 (socket says 172.21.15.5:58072) 2024-08-31T05:42:36.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.208+0000 7fbe8617f640 1 -- 172.21.15.5:0/969076096 learned_addr learned my addr 172.21.15.5:0/969076096 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:36.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.208+0000 7fbe8517d640 1 --2- 172.21.15.5:0/969076096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb52c8d390 0x55eb5306ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:36.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.208+0000 7fbe8617f640 1 --2- 172.21.15.5:0/969076096 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eb52cae070 0x55eb5306b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:36.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.208+0000 7fbe8617f640 1 -- 172.21.15.5:0/969076096 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eb52cae070 msgr2=0x55eb5306b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:36.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.208+0000 7fbe8617f640 1 --2- 172.21.15.5:0/969076096 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eb52cae070 0x55eb5306b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:36.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.208+0000 7fbe8617f640 1 -- 172.21.15.5:0/969076096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb52c8d390 msgr2=0x55eb5306ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:36.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.208+0000 7fbe8617f640 1 --2- 172.21.15.5:0/969076096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb52c8d390 0x55eb5306ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:36.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.208+0000 7fbe8617f640 1 -- 172.21.15.5:0/969076096 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb53055830 con 0x55eb52c851b0 2024-08-31T05:42:36.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.208+0000 7fbe8517d640 1 --2- 172.21.15.5:0/969076096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb52c8d390 0x55eb5306ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:42:36.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.209+0000 7fbe8617f640 1 --2- 172.21.15.5:0/969076096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eb52c851b0 0x55eb53051300 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fbe780095f0 tx=0x7fbe78011930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9e38d1accfeb8bc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:36.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.209+0000 7fbe677fe640 1 -- 172.21.15.5:0/969076096 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe7803b070 con 0x55eb52c851b0 2024-08-31T05:42:36.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.209+0000 7fbe677fe640 1 -- 172.21.15.5:0/969076096 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe7800f9c0 con 0x55eb52c851b0 2024-08-31T05:42:36.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.209+0000 7fbe677fe640 1 -- 172.21.15.5:0/969076096 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe7801e050 con 0x55eb52c851b0 2024-08-31T05:42:36.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.210+0000 7fbe8e157740 1 -- 172.21.15.5:0/969076096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eb52c851b0 msgr2=0x55eb53051300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:36.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.210+0000 7fbe8e157740 1 --2- 172.21.15.5:0/969076096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eb52c851b0 0x55eb53051300 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fbe780095f0 tx=0x7fbe78011930 comp rx=0 tx=0).stop 2024-08-31T05:42:36.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.210+0000 7fbe8e157740 1 -- 172.21.15.5:0/969076096 shutdown_connections 2024-08-31T05:42:36.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.210+0000 7fbe8e157740 1 --2- 172.21.15.5:0/969076096 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eb52cae070 0x55eb5306b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:36.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.210+0000 7fbe8e157740 1 --2- 172.21.15.5:0/969076096 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb52c8d390 0x55eb5306ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:36.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.210+0000 7fbe8e157740 1 --2- 172.21.15.5:0/969076096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eb52c851b0 0x55eb53051300 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:36.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.210+0000 7fbe8e157740 1 -- 172.21.15.5:0/969076096 >> 172.21.15.5:0/969076096 conn(0x55eb52ca2460 msgr2=0x55eb53050bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:36.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.210+0000 7fbe8e157740 1 -- 172.21.15.5:0/969076096 shutdown_connections 2024-08-31T05:42:36.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.210+0000 7fbe8e157740 1 -- 172.21.15.5:0/969076096 wait complete. 2024-08-31T05:42:36.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.211+0000 7fbe8e157740 1 -- start start 2024-08-31T05:42:36.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.211+0000 7fbe8e157740 1 Processor -- start 2024-08-31T05:42:36.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.211+0000 7fbe8e157740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eb52c851b0 0x55eb53067360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:36.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.211+0000 7fbe8e157740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eb52c8d390 0x55eb53062810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:36.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.211+0000 7fbe8e157740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb52cae070 0x55eb53062d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:36.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.211+0000 7fbe8e157740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbe801b4420 con 0x55eb52c851b0 2024-08-31T05:42:36.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.211+0000 7fbe8e157740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbe801b3d50 con 0x55eb52cae070 2024-08-31T05:42:36.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.211+0000 7fbe8e157740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbe801b0fb0 con 0x55eb52c8d390 2024-08-31T05:42:36.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.211+0000 7fbe8e157740 10 client.0 _ll_register_callbacks cb 0x7fbe7801c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:42:36.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.212+0000 7fbe8617f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eb52c851b0 0x55eb53067360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:36.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.212+0000 7fbe8517d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eb52c8d390 0x55eb53062810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:36.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.212+0000 7fbe8617f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eb52c851b0 0x55eb53067360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58080/0 (socket says 172.21.15.5:58080) 2024-08-31T05:42:36.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.212+0000 7fbe8617f640 1 -- 172.21.15.5:0/940439806 learned_addr learned my addr 172.21.15.5:0/940439806 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:36.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.212+0000 7fbe8517d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eb52c8d390 0x55eb53062810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:41716/0 (socket says 172.21.15.5:41716) 2024-08-31T05:42:36.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.212+0000 7fbe8617f640 1 --2- 172.21.15.5:0/940439806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb52cae070 0x55eb53062d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:36.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.212+0000 7fbe8617f640 1 -- 172.21.15.5:0/940439806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eb52c8d390 msgr2=0x55eb53062810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:36.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.212+0000 7fbe8617f640 1 --2- 172.21.15.5:0/940439806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eb52c8d390 0x55eb53062810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:36.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.212+0000 7fbe8617f640 1 -- 172.21.15.5:0/940439806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb52cae070 msgr2=0x55eb53062d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:36.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.212+0000 7fbe8617f640 1 --2- 172.21.15.5:0/940439806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb52cae070 0x55eb53062d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:36.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.212+0000 7fbe8617f640 1 -- 172.21.15.5:0/940439806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb53063310 con 0x55eb52c851b0 2024-08-31T05:42:36.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.212+0000 7fbe8517d640 1 --2- 172.21.15.5:0/940439806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eb52c8d390 0x55eb53062810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:42:36.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.212+0000 7fbe8617f640 1 --2- 172.21.15.5:0/940439806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eb52c851b0 0x55eb53067360 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fbe78000c00 tx=0x7fbe7800ffa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70883e813f60119c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:36.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.212+0000 7fbe657fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:42:36.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.212+0000 7fbe657fa640 1 -- 172.21.15.5:0/940439806 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe7801e030 con 0x55eb52c851b0 2024-08-31T05:42:36.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.212+0000 7fbe657fa640 1 -- 172.21.15.5:0/940439806 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9511+0+0 (secure 0 0 0) 0x7fbe78019760 con 0x55eb52c851b0 2024-08-31T05:42:36.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.212+0000 7fbe8e157740 1 -- 172.21.15.5:0/940439806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe7800f9c0 con 0x55eb52c851b0 2024-08-31T05:42:36.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.213+0000 7fbe657fa640 1 -- 172.21.15.5:0/940439806 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fbe7804a050 con 0x55eb52c851b0 2024-08-31T05:42:36.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.213+0000 7fbe8e157740 10 client.18906 fetch_fsmap learned FSMap version 34 2024-08-31T05:42:36.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.213+0000 7fbe8e157740 1 -- 172.21.15.5:0/940439806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55eb530db770 con 0x55eb52c851b0 2024-08-31T05:42:36.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.213+0000 7fbe657fa640 1 -- 172.21.15.5:0/940439806 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe7800f9c0 con 0x55eb52c851b0 2024-08-31T05:42:36.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.213+0000 7fbe657fa640 1 -- 172.21.15.5:0/940439806 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fbe78041070 con 0x55eb52c851b0 2024-08-31T05:42:36.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.213+0000 7fbe8e157740 10 client.18906 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:42:36.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.213+0000 7fbe8e157740 10 client.18906 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-31T05:42:36.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.213+0000 7fbe8e157740 20 client.18906 populate_metadata read hostname 'smithi005' 2024-08-31T05:42:36.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.213+0000 7fbe8e157740 1 --2- 172.21.15.5:0/940439806 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55eb52c41da0 0x55eb530ddd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:36.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.213+0000 7fbe8e157740 4 client.18906 mds_command: new command op to 24602 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:42:36.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.213+0000 7fbe8e157740 1 -- 172.21.15.5:0/940439806 --> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55eb52fc8070 con 0x55eb52c41da0 2024-08-31T05:42:36.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.213+0000 7fbe8517d640 1 --2- 172.21.15.5:0/940439806 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55eb52c41da0 0x55eb530ddd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:36.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.214+0000 7fbe657fa640 10 client.18906 ms_handle_connect on v2:172.21.15.50:6836/428759669 2024-08-31T05:42:36.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.214+0000 7fbe8517d640 1 --2- 172.21.15.5:0/940439806 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55eb52c41da0 0x55eb530ddd70 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8a29b2bf4687c179 server_cookie=19d2ed49e665d188 in_seq=0 out_seq=0 2024-08-31T05:42:36.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.214+0000 7fbe657fa640 1 -- 172.21.15.5:0/940439806 <== mds.4 v2:172.21.15.50:6836/428759669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55eb52fc8070 con 0x55eb52c41da0 2024-08-31T05:42:36.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.214+0000 7fbe657fa640 10 client.18906 handle_command_reply: tid=0 2024-08-31T05:42:36.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.214+0000 7fbe8e157740 1 client.18906 shutdown 2024-08-31T05:42:36.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.214+0000 7fbe8e157740 1 -- 172.21.15.5:0/940439806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eb52c851b0 msgr2=0x55eb53067360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:36.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.214+0000 7fbe8e157740 1 --2- 172.21.15.5:0/940439806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eb52c851b0 0x55eb53067360 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fbe78000c00 tx=0x7fbe7800ffa0 comp rx=0 tx=0).stop 2024-08-31T05:42:36.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.214+0000 7fbe8e157740 1 -- 172.21.15.5:0/940439806 shutdown_connections 2024-08-31T05:42:36.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.214+0000 7fbe8e157740 1 --2- 172.21.15.5:0/940439806 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x55eb52c41da0 0x55eb530ddd70 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:36.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.214+0000 7fbe8e157740 1 --2- 172.21.15.5:0/940439806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55eb52cae070 0x55eb53062d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:36.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.214+0000 7fbe8e157740 1 --2- 172.21.15.5:0/940439806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eb52c8d390 0x55eb53062810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:36.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.214+0000 7fbe657fa640 0 client.18906 ms_handle_reset on v2:172.21.15.50:6836/428759669 2024-08-31T05:42:36.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.214+0000 7fbe8e157740 1 --2- 172.21.15.5:0/940439806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55eb52c851b0 0x55eb53067360 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:36.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.214+0000 7fbe8e157740 1 -- 172.21.15.5:0/940439806 >> 172.21.15.5:0/940439806 conn(0x55eb52ca2460 msgr2=0x55eb530509e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:36.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.214+0000 7fbe8e157740 1 -- 172.21.15.5:0/940439806 shutdown_connections 2024-08-31T05:42:36.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.214+0000 7fbe8e157740 1 -- 172.21.15.5:0/940439806 wait complete. 2024-08-31T05:42:36.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.214+0000 7fbe8e157740 20 client.18906 trim_cache size 0 max 16384 2024-08-31T05:42:36.221 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:42:36.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.215+0000 7fbe87be2640 1 -- 172.21.15.5:0/3656309766 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fbe680b4ca0 msgr2=0x7fbe680b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:36.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.215+0000 7fbe87be2640 1 --2- 172.21.15.5:0/3656309766 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fbe680b4ca0 0x7fbe680b71b0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fbe700e3410 tx=0x7fbe700e9b40 comp rx=0 tx=0).stop 2024-08-31T05:42:36.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.215+0000 7fbe87be2640 1 -- 172.21.15.5:0/3656309766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe80102800 msgr2=0x7fbe8019c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:36.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.215+0000 7fbe87be2640 1 --2- 172.21.15.5:0/3656309766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe80102800 0x7fbe8019c470 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fbe7000ebc0 tx=0x7fbe7000c2d0 comp rx=0 tx=0).stop 2024-08-31T05:42:36.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.215+0000 7fbe87be2640 1 -- 172.21.15.5:0/3656309766 shutdown_connections 2024-08-31T05:42:36.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.215+0000 7fbe87be2640 1 --2- 172.21.15.5:0/3656309766 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fbe680b4ca0 0x7fbe680b71b0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:36.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.215+0000 7fbe87be2640 1 --2- 172.21.15.5:0/3656309766 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe80108a90 0x7fbe801a1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:36.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.215+0000 7fbe87be2640 1 --2- 172.21.15.5:0/3656309766 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe80108140 0x7fbe8019ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:36.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.215+0000 7fbe87be2640 1 --2- 172.21.15.5:0/3656309766 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe80102800 0x7fbe8019c470 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:36.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.215+0000 7fbe87be2640 1 -- 172.21.15.5:0/3656309766 >> 172.21.15.5:0/3656309766 conn(0x7fbe800794d0 msgr2=0x7fbe8006ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:36.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.215+0000 7fbe87be2640 1 -- 172.21.15.5:0/3656309766 shutdown_connections 2024-08-31T05:42:36.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:36.215+0000 7fbe87be2640 1 -- 172.21.15.5:0/3656309766 wait complete. 2024-08-31T05:42:36.942 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1418913 10.75 MB/sec execute 564 sec latency 34.000 ms 2024-08-31T05:42:36.943 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-31T05:42:37.203 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:42:37.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:42:37 smithi005 ceph-mon[18602]: pgmap v736: 129 pgs: 129 active+clean; 570 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.9 MiB/s wr, 222 op/s 2024-08-31T05:42:37.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:42:37 smithi070 ceph-mon[22316]: pgmap v736: 129 pgs: 129 active+clean; 570 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.9 MiB/s wr, 222 op/s 2024-08-31T05:42:37.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:42:37 smithi050 ceph-mon[22146]: pgmap v736: 129 pgs: 129 active+clean; 570 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 4.9 MiB/s wr, 222 op/s 2024-08-31T05:42:37.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.707+0000 7efd94adb640 1 -- 172.21.15.5:0/3916301848 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd901050a0 msgr2=0x7efd9010d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:37.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.707+0000 7efd94adb640 1 --2- 172.21.15.5:0/3916301848 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd901050a0 0x7efd9010d5f0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7efd84009900 tx=0x7efd8402a410 comp rx=0 tx=0).stop 2024-08-31T05:42:37.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.707+0000 7efd94adb640 1 -- 172.21.15.5:0/3916301848 shutdown_connections 2024-08-31T05:42:37.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.707+0000 7efd94adb640 1 --2- 172.21.15.5:0/3916301848 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd9010dbb0 0x7efd901100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:37.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.707+0000 7efd94adb640 1 --2- 172.21.15.5:0/3916301848 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd901050a0 0x7efd9010d5f0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:37.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.707+0000 7efd94adb640 1 --2- 172.21.15.5:0/3916301848 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd90104750 0x7efd90104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:37.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.707+0000 7efd94adb640 1 -- 172.21.15.5:0/3916301848 >> 172.21.15.5:0/3916301848 conn(0x7efd900794d0 msgr2=0x7efd900798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:37.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.707+0000 7efd94adb640 1 -- 172.21.15.5:0/3916301848 shutdown_connections 2024-08-31T05:42:37.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.707+0000 7efd94adb640 1 -- 172.21.15.5:0/3916301848 wait complete. 2024-08-31T05:42:37.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.708+0000 7efd94adb640 1 Processor -- start 2024-08-31T05:42:37.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.708+0000 7efd94adb640 1 -- start start 2024-08-31T05:42:37.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.709+0000 7efd94adb640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd90104750 0x7efd9019a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:37.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.709+0000 7efd94adb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd901050a0 0x7efd9019a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:37.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.709+0000 7efd94adb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd9010dbb0 0x7efd9019fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:37.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.709+0000 7efd94adb640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7efd901137f0 con 0x7efd901050a0 2024-08-31T05:42:37.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.709+0000 7efd94adb640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7efd90113670 con 0x7efd90104750 2024-08-31T05:42:37.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.709+0000 7efd94adb640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efd90113970 con 0x7efd9010dbb0 2024-08-31T05:42:37.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.709+0000 7efd8e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd90104750 0x7efd9019a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:37.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.709+0000 7efd8dd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd901050a0 0x7efd9019a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:37.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.709+0000 7efd8e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd90104750 0x7efd9019a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:53904/0 (socket says 172.21.15.5:53904) 2024-08-31T05:42:37.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.709+0000 7efd8e59c640 1 -- 172.21.15.5:0/343239617 learned_addr learned my addr 172.21.15.5:0/343239617 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:37.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.709+0000 7efd8ed9d640 1 --2- 172.21.15.5:0/343239617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd9010dbb0 0x7efd9019fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:37.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.709+0000 7efd8e59c640 1 -- 172.21.15.5:0/343239617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd9010dbb0 msgr2=0x7efd9019fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:37.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.709+0000 7efd8e59c640 1 --2- 172.21.15.5:0/343239617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd9010dbb0 0x7efd9019fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:37.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.709+0000 7efd8e59c640 1 -- 172.21.15.5:0/343239617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd901050a0 msgr2=0x7efd9019a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:37.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.709+0000 7efd8e59c640 1 --2- 172.21.15.5:0/343239617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd901050a0 0x7efd9019a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:37.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.709+0000 7efd8e59c640 1 -- 172.21.15.5:0/343239617 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd901a01b0 con 0x7efd90104750 2024-08-31T05:42:37.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.709+0000 7efd8e59c640 1 --2- 172.21.15.5:0/343239617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd90104750 0x7efd9019a240 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7efd8000e9c0 tx=0x7efd8000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:37.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.710+0000 7efd7f7fe640 1 -- 172.21.15.5:0/343239617 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd8000cd80 con 0x7efd90104750 2024-08-31T05:42:37.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.710+0000 7efd94adb640 1 -- 172.21.15.5:0/343239617 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd901a04a0 con 0x7efd90104750 2024-08-31T05:42:37.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.710+0000 7efd7f7fe640 1 -- 172.21.15.5:0/343239617 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd800035f0 con 0x7efd90104750 2024-08-31T05:42:37.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.710+0000 7efd7f7fe640 1 -- 172.21.15.5:0/343239617 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd80010690 con 0x7efd90104750 2024-08-31T05:42:37.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.710+0000 7efd94adb640 1 -- 172.21.15.5:0/343239617 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd901a6c00 con 0x7efd90104750 2024-08-31T05:42:37.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.712+0000 7efd9b050740 1 Processor -- start 2024-08-31T05:42:37.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.712+0000 7efd9b050740 1 -- start start 2024-08-31T05:42:37.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.713+0000 7efd7f7fe640 1 -- 172.21.15.5:0/343239617 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7efd80010830 con 0x7efd90104750 2024-08-31T05:42:37.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.713+0000 7efd9b050740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55863d132070 0x55863d4d7310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:37.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.713+0000 7efd9b050740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55863d1091b0 0x55863d4d7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:37.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.713+0000 7efd9b050740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55863d111390 0x55863d4d7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:37.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.713+0000 7efd9b050740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55863d44e680 con 0x55863d132070 2024-08-31T05:42:37.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.713+0000 7efd9b050740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55863d43dc10 con 0x55863d111390 2024-08-31T05:42:37.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.713+0000 7efd9b050740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55863d441bc0 con 0x55863d1091b0 2024-08-31T05:42:37.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.713+0000 7efd8e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55863d1091b0 0x55863d4d7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:37.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.713+0000 7efd8ed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55863d132070 0x55863d4d7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:37.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.713+0000 7efd8e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55863d1091b0 0x55863d4d7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:41744/0 (socket says 172.21.15.5:41744) 2024-08-31T05:42:37.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.713+0000 7efd8e59c640 1 -- 172.21.15.5:0/907111053 learned_addr learned my addr 172.21.15.5:0/907111053 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:37.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.713+0000 7efd8dd9b640 1 --2- 172.21.15.5:0/907111053 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55863d111390 0x55863d4d7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:37.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.713+0000 7efd8dd9b640 1 -- 172.21.15.5:0/907111053 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55863d1091b0 msgr2=0x55863d4d7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:37.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.713+0000 7efd8dd9b640 1 --2- 172.21.15.5:0/907111053 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55863d1091b0 0x55863d4d7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:37.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.714+0000 7efd8dd9b640 1 -- 172.21.15.5:0/907111053 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55863d132070 msgr2=0x55863d4d7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:37.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.714+0000 7efd8dd9b640 1 --2- 172.21.15.5:0/907111053 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55863d132070 0x55863d4d7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:37.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.714+0000 7efd8dd9b640 1 -- 172.21.15.5:0/907111053 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55863d19d650 con 0x55863d111390 2024-08-31T05:42:37.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.714+0000 7efd8dd9b640 1 --2- 172.21.15.5:0/907111053 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55863d111390 0x55863d4d7d90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7efd8402a930 tx=0x7efd84000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3667541919e7d554 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:37.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.714+0000 7efd7f7fe640 1 --2- 172.21.15.5:0/343239617 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7efd780b4ca0 0x7efd780b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:37.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.714+0000 7efd7cff9640 1 -- 172.21.15.5:0/907111053 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd84040070 con 0x55863d111390 2024-08-31T05:42:37.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.714+0000 7efd8ed9d640 1 --2- 172.21.15.5:0/343239617 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7efd780b4ca0 0x7efd780b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:37.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.714+0000 7efd7cff9640 1 -- 172.21.15.5:0/907111053 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd84004030 con 0x55863d111390 2024-08-31T05:42:37.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.714+0000 7efd7cff9640 1 -- 172.21.15.5:0/907111053 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd84035040 con 0x55863d111390 2024-08-31T05:42:37.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.714+0000 7efd7f7fe640 1 -- 172.21.15.5:0/343239617 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9511+0+0 (secure 0 0 0) 0x7efd800e5e70 con 0x7efd90104750 2024-08-31T05:42:37.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.715+0000 7efd9b050740 1 -- 172.21.15.5:0/907111053 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55863d111390 msgr2=0x55863d4d7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:37.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.715+0000 7efd8ed9d640 1 --2- 172.21.15.5:0/343239617 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7efd780b4ca0 0x7efd780b71b0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7efd88005fd0 tx=0x7efd88009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:37.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.715+0000 7efd9b050740 1 --2- 172.21.15.5:0/907111053 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55863d111390 0x55863d4d7d90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7efd8402a930 tx=0x7efd84000bc0 comp rx=0 tx=0).stop 2024-08-31T05:42:37.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.715+0000 7efd9b050740 1 -- 172.21.15.5:0/907111053 shutdown_connections 2024-08-31T05:42:37.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.715+0000 7efd9b050740 1 --2- 172.21.15.5:0/907111053 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55863d111390 0x55863d4d7d90 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:37.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.715+0000 7efd9b050740 1 --2- 172.21.15.5:0/907111053 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55863d1091b0 0x55863d4d7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:37.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.715+0000 7efd9b050740 1 --2- 172.21.15.5:0/907111053 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55863d132070 0x55863d4d7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:37.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.715+0000 7efd9b050740 1 -- 172.21.15.5:0/907111053 >> 172.21.15.5:0/907111053 conn(0x55863d126460 msgr2=0x55863d4d5200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:37.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.716+0000 7efd9b050740 1 -- 172.21.15.5:0/907111053 shutdown_connections 2024-08-31T05:42:37.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.716+0000 7efd9b050740 1 -- 172.21.15.5:0/907111053 wait complete. 2024-08-31T05:42:37.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.716+0000 7efd9b050740 1 -- start start 2024-08-31T05:42:37.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.717+0000 7efd9b050740 1 Processor -- start 2024-08-31T05:42:37.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.717+0000 7efd9b050740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55863d1091b0 0x55863d4e6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:37.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.717+0000 7efd9b050740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55863d111390 0x55863d4e7410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:37.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.717+0000 7efd9b050740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55863d132070 0x55863d4f30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:37.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.717+0000 7efd9b050740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55863d2a0700 con 0x55863d1091b0 2024-08-31T05:42:37.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.717+0000 7efd9b050740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55863d3c4750 con 0x55863d132070 2024-08-31T05:42:37.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.717+0000 7efd9b050740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55863d4e9d90 con 0x55863d111390 2024-08-31T05:42:37.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.717+0000 7efd9b050740 10 client.0 _ll_register_callbacks cb 0x55863d3f3e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:42:37.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.717+0000 7efd8dd9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55863d111390 0x55863d4e7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:37.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.717+0000 7efd8e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55863d1091b0 0x55863d4e6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:37.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.717+0000 7efd8dd9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55863d111390 0x55863d4e7410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:41750/0 (socket says 172.21.15.5:41750) 2024-08-31T05:42:37.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.717+0000 7efd8dd9b640 1 -- 172.21.15.5:0/433630412 learned_addr learned my addr 172.21.15.5:0/433630412 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:37.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.717+0000 7efd8ed9d640 1 --2- 172.21.15.5:0/433630412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55863d132070 0x55863d4f30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:37.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.718+0000 7efd8dd9b640 1 -- 172.21.15.5:0/433630412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55863d132070 msgr2=0x55863d4f30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:37.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.718+0000 7efd8dd9b640 1 --2- 172.21.15.5:0/433630412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55863d132070 0x55863d4f30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:37.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.718+0000 7efd8dd9b640 1 -- 172.21.15.5:0/433630412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55863d1091b0 msgr2=0x55863d4e6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:37.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.718+0000 7efd8dd9b640 1 --2- 172.21.15.5:0/433630412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55863d1091b0 0x55863d4e6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:37.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.718+0000 7efd8dd9b640 1 -- 172.21.15.5:0/433630412 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55863d3fd900 con 0x55863d111390 2024-08-31T05:42:37.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.718+0000 7efd8e59c640 1 --2- 172.21.15.5:0/433630412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55863d1091b0 0x55863d4e6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:42:37.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.718+0000 7efd8dd9b640 1 --2- 172.21.15.5:0/433630412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55863d111390 0x55863d4e7410 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7efd84032ee0 tx=0x7efd84032f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9add5c860a57bb21 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:37.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.718+0000 7efd75ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:42:37.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.718+0000 7efd75ffb640 1 -- 172.21.15.5:0/433630412 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd84035070 con 0x55863d111390 2024-08-31T05:42:37.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.718+0000 7efd75ffb640 1 -- 172.21.15.5:0/433630412 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9511+0+0 (secure 0 0 0) 0x7efd840314a0 con 0x55863d111390 2024-08-31T05:42:37.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.718+0000 7efd9b050740 1 -- 172.21.15.5:0/433630412 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd84004030 con 0x55863d111390 2024-08-31T05:42:37.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.718+0000 7efd75ffb640 1 -- 172.21.15.5:0/433630412 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7efd84058050 con 0x55863d111390 2024-08-31T05:42:37.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.718+0000 7efd9b050740 10 client.28498 fetch_fsmap learned FSMap version 34 2024-08-31T05:42:37.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.718+0000 7efd9b050740 1 -- 172.21.15.5:0/433630412 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55863d4f5bb0 con 0x55863d111390 2024-08-31T05:42:37.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.719+0000 7efd75ffb640 1 -- 172.21.15.5:0/433630412 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd84004030 con 0x55863d111390 2024-08-31T05:42:37.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.719+0000 7efd75ffb640 1 -- 172.21.15.5:0/433630412 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7efd84004b30 con 0x55863d111390 2024-08-31T05:42:37.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.719+0000 7efd9b050740 10 client.28498 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:42:37.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.719+0000 7efd9b050740 10 client.28498 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-31T05:42:37.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.719+0000 7efd9b050740 20 client.28498 populate_metadata read hostname 'smithi005' 2024-08-31T05:42:37.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.719+0000 7efd9b050740 1 --2- 172.21.15.5:0/433630412 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x55863d0f09f0 0x55863d4f8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:37.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.719+0000 7efd9b050740 4 client.28498 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:42:37.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.719+0000 7efd9b050740 1 -- 172.21.15.5:0/433630412 --> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55863d4505d0 con 0x55863d0f09f0 2024-08-31T05:42:37.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.719+0000 7efd8e59c640 1 --2- 172.21.15.5:0/433630412 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x55863d0f09f0 0x55863d4f8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:37.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.720+0000 7efd75ffb640 10 client.28498 ms_handle_connect on v2:172.21.15.70:6834/2061504114 2024-08-31T05:42:37.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.720+0000 7efd8e59c640 1 --2- 172.21.15.5:0/433630412 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x55863d0f09f0 0x55863d4f8f10 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e905ecc763e44954 server_cookie=f82d234b561fa707 in_seq=0 out_seq=0 2024-08-31T05:42:37.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.720+0000 7efd75ffb640 1 -- 172.21.15.5:0/433630412 <== mds.3 v2:172.21.15.70:6834/2061504114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55863d4505d0 con 0x55863d0f09f0 2024-08-31T05:42:37.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.720+0000 7efd75ffb640 10 client.28498 handle_command_reply: tid=0 2024-08-31T05:42:37.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.721+0000 7efd9b050740 1 client.28498 shutdown 2024-08-31T05:42:37.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.721+0000 7efd9b050740 1 -- 172.21.15.5:0/433630412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55863d111390 msgr2=0x55863d4e7410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:37.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.721+0000 7efd9b050740 1 --2- 172.21.15.5:0/433630412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55863d111390 0x55863d4e7410 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7efd84032ee0 tx=0x7efd84032f10 comp rx=0 tx=0).stop 2024-08-31T05:42:37.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.721+0000 7efd9b050740 1 -- 172.21.15.5:0/433630412 shutdown_connections 2024-08-31T05:42:37.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.721+0000 7efd9b050740 1 --2- 172.21.15.5:0/433630412 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x55863d0f09f0 0x55863d4f8f10 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:37.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.721+0000 7efd9b050740 1 --2- 172.21.15.5:0/433630412 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55863d132070 0x55863d4f30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:37.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.721+0000 7efd9b050740 1 --2- 172.21.15.5:0/433630412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55863d111390 0x55863d4e7410 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:37.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.721+0000 7efd9b050740 1 --2- 172.21.15.5:0/433630412 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55863d1091b0 0x55863d4e6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:37.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.721+0000 7efd75ffb640 0 client.28498 ms_handle_reset on v2:172.21.15.70:6834/2061504114 2024-08-31T05:42:37.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.721+0000 7efd9b050740 1 -- 172.21.15.5:0/433630412 >> 172.21.15.5:0/433630412 conn(0x55863d126460 msgr2=0x55863d4d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:37.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.721+0000 7efd9b050740 1 -- 172.21.15.5:0/433630412 shutdown_connections 2024-08-31T05:42:37.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.721+0000 7efd9b050740 1 -- 172.21.15.5:0/433630412 wait complete. 2024-08-31T05:42:37.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.721+0000 7efd9b050740 20 client.28498 trim_cache size 0 max 16384 2024-08-31T05:42:37.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.734+0000 7efd9b050740 1 Processor -- start 2024-08-31T05:42:37.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.734+0000 7efd9b050740 1 -- start start 2024-08-31T05:42:37.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.734+0000 7efd9b050740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55863d1091b0 0x55863d4e8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:37.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.734+0000 7efd9b050740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55863d111390 0x55863d4e40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:37.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.734+0000 7efd9b050740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55863d132070 0x55863d4e4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:37.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.734+0000 7efd9b050740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7efd901aea20 con 0x55863d1091b0 2024-08-31T05:42:37.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.734+0000 7efd9b050740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7efd901b0560 con 0x55863d111390 2024-08-31T05:42:37.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.734+0000 7efd9b050740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efd901af0f0 con 0x55863d132070 2024-08-31T05:42:37.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.735+0000 7efd8e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55863d1091b0 0x55863d4e8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:37.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.735+0000 7efd8e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55863d1091b0 0x55863d4e8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58124/0 (socket says 172.21.15.5:58124) 2024-08-31T05:42:37.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.735+0000 7efd8e59c640 1 -- 172.21.15.5:0/3043456099 learned_addr learned my addr 172.21.15.5:0/3043456099 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:37.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.735+0000 7efd8ed9d640 1 --2- 172.21.15.5:0/3043456099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55863d132070 0x55863d4e4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:37.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.735+0000 7efd8dd9b640 1 --2- 172.21.15.5:0/3043456099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55863d111390 0x55863d4e40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:37.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.735+0000 7efd8e59c640 1 -- 172.21.15.5:0/3043456099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55863d132070 msgr2=0x55863d4e4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:37.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.735+0000 7efd8e59c640 1 --2- 172.21.15.5:0/3043456099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55863d132070 0x55863d4e4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:37.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.735+0000 7efd8e59c640 1 -- 172.21.15.5:0/3043456099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55863d111390 msgr2=0x55863d4e40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:37.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.735+0000 7efd8e59c640 1 --2- 172.21.15.5:0/3043456099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55863d111390 0x55863d4e40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:37.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.735+0000 7efd8e59c640 1 -- 172.21.15.5:0/3043456099 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55863d4d8100 con 0x55863d1091b0 2024-08-31T05:42:37.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.735+0000 7efd8e59c640 1 --2- 172.21.15.5:0/3043456099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55863d1091b0 0x55863d4e8b00 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7efd800058c0 tx=0x7efd800e8380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=441b58842e346e9d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:37.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.735+0000 7efd77fff640 1 -- 172.21.15.5:0/3043456099 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd800abf50 con 0x55863d1091b0 2024-08-31T05:42:37.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.735+0000 7efd77fff640 1 -- 172.21.15.5:0/3043456099 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd800abc90 con 0x55863d1091b0 2024-08-31T05:42:37.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.735+0000 7efd77fff640 1 -- 172.21.15.5:0/3043456099 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd800ab8f0 con 0x55863d1091b0 2024-08-31T05:42:37.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.736+0000 7efd9b050740 1 -- 172.21.15.5:0/3043456099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55863d1091b0 msgr2=0x55863d4e8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:37.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.736+0000 7efd9b050740 1 --2- 172.21.15.5:0/3043456099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55863d1091b0 0x55863d4e8b00 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7efd800058c0 tx=0x7efd800e8380 comp rx=0 tx=0).stop 2024-08-31T05:42:37.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.736+0000 7efd9b050740 1 -- 172.21.15.5:0/3043456099 shutdown_connections 2024-08-31T05:42:37.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.736+0000 7efd9b050740 1 --2- 172.21.15.5:0/3043456099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55863d132070 0x55863d4e4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:37.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.736+0000 7efd9b050740 1 --2- 172.21.15.5:0/3043456099 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55863d111390 0x55863d4e40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:37.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.736+0000 7efd9b050740 1 --2- 172.21.15.5:0/3043456099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55863d1091b0 0x55863d4e8b00 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:37.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.736+0000 7efd9b050740 1 -- 172.21.15.5:0/3043456099 >> 172.21.15.5:0/3043456099 conn(0x55863d126460 msgr2=0x55863d4e83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:37.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.736+0000 7efd9b050740 1 -- 172.21.15.5:0/3043456099 shutdown_connections 2024-08-31T05:42:37.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.736+0000 7efd9b050740 1 -- 172.21.15.5:0/3043456099 wait complete. 2024-08-31T05:42:37.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.737+0000 7efd9b050740 1 -- start start 2024-08-31T05:42:37.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.737+0000 7efd9b050740 1 Processor -- start 2024-08-31T05:42:37.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.737+0000 7efd9b050740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55863d1091b0 0x55863d4fa300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:37.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.737+0000 7efd9b050740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55863d111390 0x55863d4fa840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:37.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.737+0000 7efd9b050740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55863d132070 0x55863d562690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:37.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.737+0000 7efd9b050740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7efd901afe90 con 0x55863d111390 2024-08-31T05:42:37.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.737+0000 7efd9b050740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7efd901af7c0 con 0x55863d1091b0 2024-08-31T05:42:37.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.737+0000 7efd9b050740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efd901aca20 con 0x55863d132070 2024-08-31T05:42:37.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.737+0000 7efd9b050740 10 client.0 _ll_register_callbacks cb 0x7efd88009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:42:37.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.737+0000 7efd8e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55863d1091b0 0x55863d4fa300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:37.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.737+0000 7efd8ed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55863d132070 0x55863d562690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:37.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.737+0000 7efd8e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55863d1091b0 0x55863d4fa300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:53950/0 (socket says 172.21.15.5:53950) 2024-08-31T05:42:37.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.737+0000 7efd8e59c640 1 -- 172.21.15.5:0/4208370880 learned_addr learned my addr 172.21.15.5:0/4208370880 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:37.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.737+0000 7efd8dd9b640 1 --2- 172.21.15.5:0/4208370880 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55863d111390 0x55863d4fa840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:37.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.738+0000 7efd8e59c640 1 -- 172.21.15.5:0/4208370880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55863d132070 msgr2=0x55863d562690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:37.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.738+0000 7efd8e59c640 1 --2- 172.21.15.5:0/4208370880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55863d132070 0x55863d562690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:37.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.738+0000 7efd8e59c640 1 -- 172.21.15.5:0/4208370880 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55863d111390 msgr2=0x55863d4fa840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:37.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.738+0000 7efd8e59c640 1 --2- 172.21.15.5:0/4208370880 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55863d111390 0x55863d4fa840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:37.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.738+0000 7efd8e59c640 1 -- 172.21.15.5:0/4208370880 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55863d562bd0 con 0x55863d1091b0 2024-08-31T05:42:37.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.738+0000 7efd8ed9d640 1 --2- 172.21.15.5:0/4208370880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55863d132070 0x55863d562690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:42:37.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.738+0000 7efd8e59c640 1 --2- 172.21.15.5:0/4208370880 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55863d1091b0 0x55863d4fa300 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7efd80009fd0 tx=0x7efd80003cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b58c8aa7659f08c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:37.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.738+0000 7efd75ffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:42:37.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.738+0000 7efd75ffb640 1 -- 172.21.15.5:0/4208370880 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd800abad0 con 0x55863d1091b0 2024-08-31T05:42:37.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.738+0000 7efd75ffb640 1 -- 172.21.15.5:0/4208370880 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9511+0+0 (secure 0 0 0) 0x7efd800a8410 con 0x55863d1091b0 2024-08-31T05:42:37.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.738+0000 7efd9b050740 1 -- 172.21.15.5:0/4208370880 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd800abc90 con 0x55863d1091b0 2024-08-31T05:42:37.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.738+0000 7efd75ffb640 1 -- 172.21.15.5:0/4208370880 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7efd800ac180 con 0x55863d1091b0 2024-08-31T05:42:37.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.738+0000 7efd9b050740 10 client.28490 fetch_fsmap learned FSMap version 34 2024-08-31T05:42:37.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.738+0000 7efd9b050740 1 -- 172.21.15.5:0/4208370880 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55863d563cf0 con 0x55863d1091b0 2024-08-31T05:42:37.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.739+0000 7efd75ffb640 1 -- 172.21.15.5:0/4208370880 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd800abc90 con 0x55863d1091b0 2024-08-31T05:42:37.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.739+0000 7efd75ffb640 1 -- 172.21.15.5:0/4208370880 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7efd80010b20 con 0x55863d1091b0 2024-08-31T05:42:37.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.739+0000 7efd9b050740 10 client.28490 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:42:37.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.739+0000 7efd9b050740 10 client.28490 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-31T05:42:37.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.739+0000 7efd9b050740 20 client.28490 populate_metadata read hostname 'smithi005' 2024-08-31T05:42:37.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.739+0000 7efd9b050740 1 --2- 172.21.15.5:0/4208370880 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x55863d0c5da0 0x55863d566320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:37.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.739+0000 7efd9b050740 4 client.28490 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:42:37.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.739+0000 7efd9b050740 1 -- 172.21.15.5:0/4208370880 --> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55863d44c070 con 0x55863d0c5da0 2024-08-31T05:42:37.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.739+0000 7efd8dd9b640 1 --2- 172.21.15.5:0/4208370880 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x55863d0c5da0 0x55863d566320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:37.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.739+0000 7efd75ffb640 10 client.28490 ms_handle_connect on v2:172.21.15.70:6834/2061504114 2024-08-31T05:42:37.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.739+0000 7efd8dd9b640 1 --2- 172.21.15.5:0/4208370880 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x55863d0c5da0 0x55863d566320 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6315a9b8ba1e26b6 server_cookie=4c6a55ce80a6ce2c in_seq=0 out_seq=0 2024-08-31T05:42:37.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.740+0000 7efd75ffb640 1 -- 172.21.15.5:0/4208370880 <== mds.3 v2:172.21.15.70:6834/2061504114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55863d44c070 con 0x55863d0c5da0 2024-08-31T05:42:37.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.740+0000 7efd75ffb640 10 client.28490 handle_command_reply: tid=0 2024-08-31T05:42:37.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.740+0000 7efd9b050740 1 client.28490 shutdown 2024-08-31T05:42:37.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.740+0000 7efd9b050740 1 -- 172.21.15.5:0/4208370880 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55863d1091b0 msgr2=0x55863d4fa300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:37.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.740+0000 7efd9b050740 1 --2- 172.21.15.5:0/4208370880 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55863d1091b0 0x55863d4fa300 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7efd80009fd0 tx=0x7efd80003cd0 comp rx=0 tx=0).stop 2024-08-31T05:42:37.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.740+0000 7efd9b050740 1 -- 172.21.15.5:0/4208370880 shutdown_connections 2024-08-31T05:42:37.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.740+0000 7efd9b050740 1 --2- 172.21.15.5:0/4208370880 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x55863d0c5da0 0x55863d566320 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:37.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.740+0000 7efd9b050740 1 --2- 172.21.15.5:0/4208370880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55863d132070 0x55863d562690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:37.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.740+0000 7efd9b050740 1 --2- 172.21.15.5:0/4208370880 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55863d111390 0x55863d4fa840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:37.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.740+0000 7efd75ffb640 0 client.28490 ms_handle_reset on v2:172.21.15.70:6834/2061504114 2024-08-31T05:42:37.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.740+0000 7efd9b050740 1 --2- 172.21.15.5:0/4208370880 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55863d1091b0 0x55863d4fa300 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:37.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.740+0000 7efd9b050740 1 -- 172.21.15.5:0/4208370880 >> 172.21.15.5:0/4208370880 conn(0x55863d126460 msgr2=0x55863d4dc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:37.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.740+0000 7efd9b050740 1 -- 172.21.15.5:0/4208370880 shutdown_connections 2024-08-31T05:42:37.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.740+0000 7efd9b050740 1 -- 172.21.15.5:0/4208370880 wait complete. 2024-08-31T05:42:37.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.740+0000 7efd9b050740 20 client.28490 trim_cache size 0 max 16384 2024-08-31T05:42:37.748 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:42:37.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.741+0000 7efd94adb640 1 -- 172.21.15.5:0/343239617 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7efd780b4ca0 msgr2=0x7efd780b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:37.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.741+0000 7efd94adb640 1 --2- 172.21.15.5:0/343239617 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7efd780b4ca0 0x7efd780b71b0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7efd88005fd0 tx=0x7efd88009500 comp rx=0 tx=0).stop 2024-08-31T05:42:37.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.741+0000 7efd94adb640 1 -- 172.21.15.5:0/343239617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd90104750 msgr2=0x7efd9019a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:37.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.741+0000 7efd94adb640 1 --2- 172.21.15.5:0/343239617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd90104750 0x7efd9019a240 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7efd8000e9c0 tx=0x7efd8000ee80 comp rx=0 tx=0).stop 2024-08-31T05:42:37.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.741+0000 7efd94adb640 1 -- 172.21.15.5:0/343239617 shutdown_connections 2024-08-31T05:42:37.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.741+0000 7efd94adb640 1 --2- 172.21.15.5:0/343239617 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7efd780b4ca0 0x7efd780b71b0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:37.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.741+0000 7efd94adb640 1 --2- 172.21.15.5:0/343239617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd9010dbb0 0x7efd9019fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:37.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.741+0000 7efd94adb640 1 --2- 172.21.15.5:0/343239617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efd901050a0 0x7efd9019a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:37.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.741+0000 7efd94adb640 1 --2- 172.21.15.5:0/343239617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efd90104750 0x7efd9019a240 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:37.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.741+0000 7efd94adb640 1 -- 172.21.15.5:0/343239617 >> 172.21.15.5:0/343239617 conn(0x7efd900794d0 msgr2=0x7efd900ff4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:37.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.741+0000 7efd94adb640 1 -- 172.21.15.5:0/343239617 shutdown_connections 2024-08-31T05:42:37.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:37.741+0000 7efd94adb640 1 -- 172.21.15.5:0/343239617 wait complete. 2024-08-31T05:42:37.942 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1421340 10.76 MB/sec execute 565 sec latency 43.436 ms 2024-08-31T05:42:38.304 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.302+0000 7fa3cc82f640 1 -- 172.21.15.5:0/2729747618 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3c8102770 msgr2=0x7fa3c8102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:38.305 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.302+0000 7fa3cc82f640 1 --2- 172.21.15.5:0/2729747618 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3c8102770 0x7fa3c8102b80 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fa3b8009900 tx=0x7fa3b802a410 comp rx=0 tx=0).stop 2024-08-31T05:42:38.305 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.302+0000 7fa3cc82f640 1 -- 172.21.15.5:0/2729747618 shutdown_connections 2024-08-31T05:42:38.305 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.302+0000 7fa3cc82f640 1 --2- 172.21.15.5:0/2729747618 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3c81089f0 0x7fa3c810f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:38.305 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.302+0000 7fa3cc82f640 1 --2- 172.21.15.5:0/2729747618 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3c81080a0 0x7fa3c81084b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:38.305 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.302+0000 7fa3cc82f640 1 --2- 172.21.15.5:0/2729747618 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3c8102770 0x7fa3c8102b80 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:38.305 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.302+0000 7fa3cc82f640 1 -- 172.21.15.5:0/2729747618 >> 172.21.15.5:0/2729747618 conn(0x7fa3c807a4b0 msgr2=0x7fa3c807a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:38.305 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.302+0000 7fa3cc82f640 1 -- 172.21.15.5:0/2729747618 shutdown_connections 2024-08-31T05:42:38.305 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.302+0000 7fa3cc82f640 1 -- 172.21.15.5:0/2729747618 wait complete. 2024-08-31T05:42:38.307 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.303+0000 7fa3cc82f640 1 Processor -- start 2024-08-31T05:42:38.307 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.303+0000 7fa3cc82f640 1 -- start start 2024-08-31T05:42:38.307 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.303+0000 7fa3cc82f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3c8102770 0x7fa3c819af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:38.307 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.303+0000 7fa3cc82f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3c81080a0 0x7fa3c819b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:38.307 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.303+0000 7fa3cc82f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3c81089f0 0x7fa3c819ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:38.307 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.303+0000 7fa3cc82f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c8112680 con 0x7fa3c81080a0 2024-08-31T05:42:38.307 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.303+0000 7fa3cc82f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c8112500 con 0x7fa3c81089f0 2024-08-31T05:42:38.308 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.303+0000 7fa3cc82f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c8112800 con 0x7fa3c8102770 2024-08-31T05:42:38.308 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.304+0000 7fa3c5d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3c81080a0 0x7fa3c819b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:38.308 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.304+0000 7fa3c659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3c8102770 0x7fa3c819af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:38.308 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.304+0000 7fa3c5d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3c81080a0 0x7fa3c819b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58146/0 (socket says 172.21.15.5:58146) 2024-08-31T05:42:38.308 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.304+0000 7fa3c5d9b640 1 -- 172.21.15.5:0/3697763617 learned_addr learned my addr 172.21.15.5:0/3697763617 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:38.308 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.304+0000 7fa3c6d9d640 1 --2- 172.21.15.5:0/3697763617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3c81089f0 0x7fa3c819ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:38.308 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.304+0000 7fa3c5d9b640 1 -- 172.21.15.5:0/3697763617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3c8102770 msgr2=0x7fa3c819af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:38.308 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.304+0000 7fa3c5d9b640 1 --2- 172.21.15.5:0/3697763617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3c8102770 0x7fa3c819af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:38.308 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.304+0000 7fa3c5d9b640 1 -- 172.21.15.5:0/3697763617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3c81089f0 msgr2=0x7fa3c819ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:38.308 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.304+0000 7fa3c5d9b640 1 --2- 172.21.15.5:0/3697763617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3c81089f0 0x7fa3c819ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:38.308 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.304+0000 7fa3c5d9b640 1 -- 172.21.15.5:0/3697763617 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3c81a62a0 con 0x7fa3c81080a0 2024-08-31T05:42:38.308 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.304+0000 7fa3c6d9d640 1 --2- 172.21.15.5:0/3697763617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3c81089f0 0x7fa3c819ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:42:38.309 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.304+0000 7fa3c5d9b640 1 --2- 172.21.15.5:0/3697763617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3c81080a0 0x7fa3c819b4d0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc00e9f0 tx=0x7fa3bc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:38.309 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.304+0000 7fa3b77fe640 1 -- 172.21.15.5:0/3697763617 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3bc00ccc0 con 0x7fa3c81080a0 2024-08-31T05:42:38.309 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.304+0000 7fa3b77fe640 1 -- 172.21.15.5:0/3697763617 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3bc0054d0 con 0x7fa3c81080a0 2024-08-31T05:42:38.309 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.304+0000 7fa3cc82f640 1 -- 172.21.15.5:0/3697763617 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3c81a6590 con 0x7fa3c81080a0 2024-08-31T05:42:38.309 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.304+0000 7fa3b77fe640 1 -- 172.21.15.5:0/3697763617 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3bc010430 con 0x7fa3c81080a0 2024-08-31T05:42:38.309 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.304+0000 7fa3cc82f640 1 -- 172.21.15.5:0/3697763617 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3c81a6a90 con 0x7fa3c81080a0 2024-08-31T05:42:38.311 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.307+0000 7fa3d387b740 1 Processor -- start 2024-08-31T05:42:38.312 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.307+0000 7fa3d387b740 1 -- start start 2024-08-31T05:42:38.312 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.307+0000 7fa3b77fe640 1 -- 172.21.15.5:0/3697763617 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fa3bc0105d0 con 0x7fa3c81080a0 2024-08-31T05:42:38.312 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.307+0000 7fa3d387b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d3e1171b0 0x561d3e4baac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:38.312 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.307+0000 7fa3d387b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561d3e0ee2f0 0x561d3e4bb000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:38.312 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.307+0000 7fa3d387b740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d3e0f64d0 0x561d3e4bb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:38.312 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.307+0000 7fa3d387b740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x561d3e430000 con 0x561d3e0f64d0 2024-08-31T05:42:38.312 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.307+0000 7fa3d387b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x561d3e41f590 con 0x561d3e0ee2f0 2024-08-31T05:42:38.312 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.307+0000 7fa3d387b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561d3e423540 con 0x561d3e1171b0 2024-08-31T05:42:38.312 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.308+0000 7fa3c5d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d3e0f64d0 0x561d3e4bb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:38.312 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.308+0000 7fa3c6d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d3e1171b0 0x561d3e4baac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:38.312 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.308+0000 7fa3c5d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d3e0f64d0 0x561d3e4bb540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58158/0 (socket says 172.21.15.5:58158) 2024-08-31T05:42:38.312 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.308+0000 7fa3c659c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561d3e0ee2f0 0x561d3e4bb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:38.313 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.308+0000 7fa3c6d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d3e1171b0 0x561d3e4baac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:41806/0 (socket says 172.21.15.5:41806) 2024-08-31T05:42:38.313 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.308+0000 7fa3c5d9b640 1 -- 172.21.15.5:0/3221001864 learned_addr learned my addr 172.21.15.5:0/3221001864 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:38.313 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.308+0000 7fa3c6d9d640 1 -- 172.21.15.5:0/3221001864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561d3e0ee2f0 msgr2=0x561d3e4bb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:38.313 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.308+0000 7fa3c6d9d640 1 --2- 172.21.15.5:0/3221001864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561d3e0ee2f0 0x561d3e4bb000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:38.313 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.308+0000 7fa3c6d9d640 1 -- 172.21.15.5:0/3221001864 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d3e0f64d0 msgr2=0x561d3e4bb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:38.313 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.308+0000 7fa3c6d9d640 1 --2- 172.21.15.5:0/3221001864 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d3e0f64d0 0x561d3e4bb540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:38.313 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.308+0000 7fa3c6d9d640 1 -- 172.21.15.5:0/3221001864 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d3e182790 con 0x561d3e1171b0 2024-08-31T05:42:38.313 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.308+0000 7fa3c659c640 1 --2- 172.21.15.5:0/3221001864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561d3e0ee2f0 0x561d3e4bb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:42:38.313 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.308+0000 7fa3c6d9d640 1 --2- 172.21.15.5:0/3221001864 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d3e1171b0 0x561d3e4baac0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0009fa0 tx=0x7fa3c0010860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe06afded9f395c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:38.313 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.308+0000 7fa3b77fe640 1 --2- 172.21.15.5:0/3697763617 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa3b00b4ca0 0x7fa3b00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:38.313 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.308+0000 7fa3b4ff9640 1 -- 172.21.15.5:0/3221001864 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c0011700 con 0x561d3e1171b0 2024-08-31T05:42:38.313 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.308+0000 7fa3c659c640 1 --2- 172.21.15.5:0/3697763617 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa3b00b4ca0 0x7fa3b00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:38.313 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.308+0000 7fa3b4ff9640 1 -- 172.21.15.5:0/3221001864 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3c0015070 con 0x561d3e1171b0 2024-08-31T05:42:38.314 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.308+0000 7fa3b4ff9640 1 -- 172.21.15.5:0/3221001864 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c001bc00 con 0x561d3e1171b0 2024-08-31T05:42:38.314 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.309+0000 7fa3b77fe640 1 -- 172.21.15.5:0/3697763617 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9511+0+0 (secure 0 0 0) 0x7fa3bc0e5d70 con 0x7fa3c81080a0 2024-08-31T05:42:38.314 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.309+0000 7fa3d387b740 1 -- 172.21.15.5:0/3221001864 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d3e1171b0 msgr2=0x561d3e4baac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:38.314 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.309+0000 7fa3c659c640 1 --2- 172.21.15.5:0/3697763617 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa3b00b4ca0 0x7fa3b00b71b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fa3b8000c00 tx=0x7fa3b8031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:38.314 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.309+0000 7fa3d387b740 1 --2- 172.21.15.5:0/3221001864 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d3e1171b0 0x561d3e4baac0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0009fa0 tx=0x7fa3c0010860 comp rx=0 tx=0).stop 2024-08-31T05:42:38.314 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.309+0000 7fa3d387b740 1 -- 172.21.15.5:0/3221001864 shutdown_connections 2024-08-31T05:42:38.314 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.309+0000 7fa3d387b740 1 --2- 172.21.15.5:0/3221001864 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d3e0f64d0 0x561d3e4bb540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:38.314 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.309+0000 7fa3d387b740 1 --2- 172.21.15.5:0/3221001864 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561d3e0ee2f0 0x561d3e4bb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:38.314 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.309+0000 7fa3d387b740 1 --2- 172.21.15.5:0/3221001864 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d3e1171b0 0x561d3e4baac0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:38.314 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.309+0000 7fa3d387b740 1 -- 172.21.15.5:0/3221001864 >> 172.21.15.5:0/3221001864 conn(0x561d3e10b300 msgr2=0x561d3e4b89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:38.314 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.309+0000 7fa3d387b740 1 -- 172.21.15.5:0/3221001864 shutdown_connections 2024-08-31T05:42:38.314 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.309+0000 7fa3d387b740 1 -- 172.21.15.5:0/3221001864 wait complete. 2024-08-31T05:42:38.314 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.310+0000 7fa3d387b740 1 -- start start 2024-08-31T05:42:38.314 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.310+0000 7fa3d387b740 1 Processor -- start 2024-08-31T05:42:38.318 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.310+0000 7fa3d387b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d3e0ee2f0 0x561d3e4c6690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:38.318 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.310+0000 7fa3d387b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561d3e0f64d0 0x561d3e4c6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:38.318 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.310+0000 7fa3d387b740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d3e1171b0 0x561d3e4d2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:38.318 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.310+0000 7fa3d387b740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x561d3e358ab0 con 0x561d3e1171b0 2024-08-31T05:42:38.318 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.310+0000 7fa3d387b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x561d3e3a6680 con 0x561d3e0f64d0 2024-08-31T05:42:38.318 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.310+0000 7fa3d387b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561d3e4c9240 con 0x561d3e0ee2f0 2024-08-31T05:42:38.318 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.310+0000 7fa3d387b740 10 client.0 _ll_register_callbacks cb 0x561d3e12ea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:42:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.310+0000 7fa3c6d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d3e1171b0 0x561d3e4d2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.310+0000 7fa3c659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d3e0ee2f0 0x561d3e4c6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.310+0000 7fa3c6d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d3e1171b0 0x561d3e4d2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58172/0 (socket says 172.21.15.5:58172) 2024-08-31T05:42:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.310+0000 7fa3c6d9d640 1 -- 172.21.15.5:0/1465591831 learned_addr learned my addr 172.21.15.5:0/1465591831 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.311+0000 7fa3c5d9b640 1 --2- 172.21.15.5:0/1465591831 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561d3e0f64d0 0x561d3e4c6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.311+0000 7fa3c6d9d640 1 -- 172.21.15.5:0/1465591831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d3e0ee2f0 msgr2=0x561d3e4c6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.311+0000 7fa3c6d9d640 1 --2- 172.21.15.5:0/1465591831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d3e0ee2f0 0x561d3e4c6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.311+0000 7fa3c6d9d640 1 -- 172.21.15.5:0/1465591831 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561d3e0f64d0 msgr2=0x561d3e4c6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.311+0000 7fa3c6d9d640 1 --2- 172.21.15.5:0/1465591831 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561d3e0f64d0 0x561d3e4c6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.311+0000 7fa3c6d9d640 1 -- 172.21.15.5:0/1465591831 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d3e1fb620 con 0x561d3e1171b0 2024-08-31T05:42:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.311+0000 7fa3c6d9d640 1 --2- 172.21.15.5:0/1465591831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d3e1171b0 0x561d3e4d2560 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0000f80 tx=0x7fa3c0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9de140dee7514af3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.311+0000 7fa3adffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:42:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.311+0000 7fa3adffb640 1 -- 172.21.15.5:0/1465591831 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c002a060 con 0x561d3e1171b0 2024-08-31T05:42:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.311+0000 7fa3adffb640 1 -- 172.21.15.5:0/1465591831 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9511+0+0 (secure 0 0 0) 0x7fa3c001b980 con 0x561d3e1171b0 2024-08-31T05:42:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.311+0000 7fa3d387b740 1 -- 172.21.15.5:0/1465591831 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3c0015070 con 0x561d3e1171b0 2024-08-31T05:42:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.311+0000 7fa3adffb640 1 -- 172.21.15.5:0/1465591831 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fa3c0031050 con 0x561d3e1171b0 2024-08-31T05:42:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.311+0000 7fa3d387b740 10 client.18936 fetch_fsmap learned FSMap version 34 2024-08-31T05:42:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.311+0000 7fa3d387b740 1 -- 172.21.15.5:0/1465591831 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x561d3e4d52b0 con 0x561d3e1171b0 2024-08-31T05:42:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.311+0000 7fa3adffb640 1 -- 172.21.15.5:0/1465591831 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3c0015070 con 0x561d3e1171b0 2024-08-31T05:42:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.312+0000 7fa3adffb640 1 -- 172.21.15.5:0/1465591831 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fa3c0011bb0 con 0x561d3e1171b0 2024-08-31T05:42:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.312+0000 7fa3d387b740 10 client.18936 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:42:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.312+0000 7fa3d387b740 10 client.18936 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:42:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.312+0000 7fa3d387b740 20 client.18936 populate_metadata read hostname 'smithi005' 2024-08-31T05:42:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.312+0000 7fa3d387b740 1 --2- 172.21.15.5:0/1465591831 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561d3e0d5d80 0x561d3e4d8720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.312+0000 7fa3d387b740 4 client.18936 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:42:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.312+0000 7fa3d387b740 1 -- 172.21.15.5:0/1465591831 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561d3e431f50 con 0x561d3e0d5d80 2024-08-31T05:42:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.312+0000 7fa3c659c640 1 --2- 172.21.15.5:0/1465591831 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561d3e0d5d80 0x561d3e4d8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.312+0000 7fa3c659c640 1 --2- 172.21.15.5:0/1465591831 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561d3e0d5d80 0x561d3e4d8720 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8fa5152fff920ec3 server_cookie=e8909dbb3a8809be in_seq=0 out_seq=0 2024-08-31T05:42:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.312+0000 7fa3adffb640 10 client.18936 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:42:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.313+0000 7fa3adffb640 1 -- 172.21.15.5:0/1465591831 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561d3e431f50 con 0x561d3e0d5d80 2024-08-31T05:42:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.313+0000 7fa3adffb640 10 client.18936 handle_command_reply: tid=0 2024-08-31T05:42:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.313+0000 7fa3d387b740 1 client.18936 shutdown 2024-08-31T05:42:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.313+0000 7fa3d387b740 1 -- 172.21.15.5:0/1465591831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d3e1171b0 msgr2=0x561d3e4d2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.313+0000 7fa3d387b740 1 --2- 172.21.15.5:0/1465591831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d3e1171b0 0x561d3e4d2560 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0000f80 tx=0x7fa3c0004a40 comp rx=0 tx=0).stop 2024-08-31T05:42:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.313+0000 7fa3d387b740 1 -- 172.21.15.5:0/1465591831 shutdown_connections 2024-08-31T05:42:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.313+0000 7fa3d387b740 1 --2- 172.21.15.5:0/1465591831 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561d3e0d5d80 0x561d3e4d8720 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.313+0000 7fa3d387b740 1 --2- 172.21.15.5:0/1465591831 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d3e1171b0 0x561d3e4d2560 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.313+0000 7fa3adffb640 0 client.18936 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:42:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.313+0000 7fa3d387b740 1 --2- 172.21.15.5:0/1465591831 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561d3e0f64d0 0x561d3e4c6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:38.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.313+0000 7fa3d387b740 1 --2- 172.21.15.5:0/1465591831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d3e0ee2f0 0x561d3e4c6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:38.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.313+0000 7fa3d387b740 1 -- 172.21.15.5:0/1465591831 >> 172.21.15.5:0/1465591831 conn(0x561d3e10b300 msgr2=0x561d3e4bbaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:38.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.313+0000 7fa3d387b740 1 -- 172.21.15.5:0/1465591831 shutdown_connections 2024-08-31T05:42:38.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.313+0000 7fa3d387b740 1 -- 172.21.15.5:0/1465591831 wait complete. 2024-08-31T05:42:38.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.313+0000 7fa3d387b740 20 client.18936 trim_cache size 0 max 16384 2024-08-31T05:42:38.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.329+0000 7fa3d387b740 1 Processor -- start 2024-08-31T05:42:38.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.329+0000 7fa3d387b740 1 -- start start 2024-08-31T05:42:38.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.329+0000 7fa3d387b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561d3e0d5d80 0x561d3e4bfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:38.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.329+0000 7fa3d387b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d3e0ee2f0 0x561d3e4c0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:38.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.329+0000 7fa3d387b740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d3e0f64d0 0x561d3e4c5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:38.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.329+0000 7fa3d387b740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c81b0d10 con 0x561d3e0f64d0 2024-08-31T05:42:38.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.329+0000 7fa3d387b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c81b2850 con 0x561d3e0d5d80 2024-08-31T05:42:38.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.329+0000 7fa3d387b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c81b13e0 con 0x561d3e0ee2f0 2024-08-31T05:42:38.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.329+0000 7fa3c6d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d3e0f64d0 0x561d3e4c5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:38.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.329+0000 7fa3c6d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d3e0f64d0 0x561d3e4c5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58174/0 (socket says 172.21.15.5:58174) 2024-08-31T05:42:38.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.329+0000 7fa3c6d9d640 1 -- 172.21.15.5:0/2390386536 learned_addr learned my addr 172.21.15.5:0/2390386536 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:38.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.329+0000 7fa3c5d9b640 1 --2- 172.21.15.5:0/2390386536 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d3e0ee2f0 0x561d3e4c0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:38.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.329+0000 7fa3c659c640 1 --2- 172.21.15.5:0/2390386536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561d3e0d5d80 0x561d3e4bfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:38.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.329+0000 7fa3c6d9d640 1 -- 172.21.15.5:0/2390386536 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d3e0ee2f0 msgr2=0x561d3e4c0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:38.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.329+0000 7fa3c6d9d640 1 --2- 172.21.15.5:0/2390386536 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d3e0ee2f0 0x561d3e4c0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:38.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.329+0000 7fa3c6d9d640 1 -- 172.21.15.5:0/2390386536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561d3e0d5d80 msgr2=0x561d3e4bfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:38.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.329+0000 7fa3c6d9d640 1 --2- 172.21.15.5:0/2390386536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561d3e0d5d80 0x561d3e4bfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:38.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.329+0000 7fa3c6d9d640 1 -- 172.21.15.5:0/2390386536 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d3e4c0670 con 0x561d3e0f64d0 2024-08-31T05:42:38.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.330+0000 7fa3c6d9d640 1 --2- 172.21.15.5:0/2390386536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d3e0f64d0 0x561d3e4c5950 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0009540 tx=0x7fa3c0009be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=971c4c8a295b6615 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:38.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.330+0000 7fa3affff640 1 -- 172.21.15.5:0/2390386536 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c002a050 con 0x561d3e0f64d0 2024-08-31T05:42:38.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.330+0000 7fa3affff640 1 -- 172.21.15.5:0/2390386536 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3c0015070 con 0x561d3e0f64d0 2024-08-31T05:42:38.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.330+0000 7fa3affff640 1 -- 172.21.15.5:0/2390386536 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c001ba60 con 0x561d3e0f64d0 2024-08-31T05:42:38.337 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.331+0000 7fa3d387b740 1 -- 172.21.15.5:0/2390386536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d3e0f64d0 msgr2=0x561d3e4c5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:38.337 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.331+0000 7fa3d387b740 1 --2- 172.21.15.5:0/2390386536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d3e0f64d0 0x561d3e4c5950 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0009540 tx=0x7fa3c0009be0 comp rx=0 tx=0).stop 2024-08-31T05:42:38.337 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.331+0000 7fa3d387b740 1 -- 172.21.15.5:0/2390386536 shutdown_connections 2024-08-31T05:42:38.337 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.331+0000 7fa3d387b740 1 --2- 172.21.15.5:0/2390386536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d3e0f64d0 0x561d3e4c5950 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:38.337 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.331+0000 7fa3d387b740 1 --2- 172.21.15.5:0/2390386536 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d3e0ee2f0 0x561d3e4c0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:38.337 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.331+0000 7fa3d387b740 1 --2- 172.21.15.5:0/2390386536 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561d3e0d5d80 0x561d3e4bfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:38.337 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.331+0000 7fa3d387b740 1 -- 172.21.15.5:0/2390386536 >> 172.21.15.5:0/2390386536 conn(0x561d3e10b300 msgr2=0x561d3e4c4ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:38.337 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.331+0000 7fa3d387b740 1 -- 172.21.15.5:0/2390386536 shutdown_connections 2024-08-31T05:42:38.337 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.331+0000 7fa3d387b740 1 -- 172.21.15.5:0/2390386536 wait complete. 2024-08-31T05:42:38.338 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.331+0000 7fa3d387b740 1 -- start start 2024-08-31T05:42:38.338 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.331+0000 7fa3d387b740 1 Processor -- start 2024-08-31T05:42:38.338 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.332+0000 7fa3d387b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d3e0d5d80 0x561d3e4d99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:38.338 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.332+0000 7fa3d387b740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d3e0ee2f0 0x561d3e4d9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:38.338 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.332+0000 7fa3d387b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561d3e0f64d0 0x561d3e552eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:38.338 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.332+0000 7fa3d387b740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c81b2180 con 0x561d3e0ee2f0 2024-08-31T05:42:38.338 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.332+0000 7fa3d387b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c81b1ab0 con 0x561d3e0f64d0 2024-08-31T05:42:38.338 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.332+0000 7fa3d387b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c81aed10 con 0x561d3e0d5d80 2024-08-31T05:42:38.338 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.332+0000 7fa3d387b740 10 client.0 _ll_register_callbacks cb 0x7fa3bc0e9780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:42:38.338 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.332+0000 7fa3c659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d3e0d5d80 0x561d3e4d99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:38.338 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.332+0000 7fa3c5d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d3e0ee2f0 0x561d3e4d9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:38.338 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.332+0000 7fa3c6d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561d3e0f64d0 0x561d3e552eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:38.338 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.332+0000 7fa3c659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d3e0d5d80 0x561d3e4d99c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:41842/0 (socket says 172.21.15.5:41842) 2024-08-31T05:42:38.339 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.332+0000 7fa3c6d9d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561d3e0f64d0 0x561d3e552eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:54030/0 (socket says 172.21.15.5:54030) 2024-08-31T05:42:38.339 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.332+0000 7fa3c5d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d3e0ee2f0 0x561d3e4d9f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58190/0 (socket says 172.21.15.5:58190) 2024-08-31T05:42:38.339 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.332+0000 7fa3c659c640 1 -- 172.21.15.5:0/1321269891 learned_addr learned my addr 172.21.15.5:0/1321269891 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:38.339 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.332+0000 7fa3c659c640 1 -- 172.21.15.5:0/1321269891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561d3e0f64d0 msgr2=0x561d3e552eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:38.339 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.332+0000 7fa3c659c640 1 --2- 172.21.15.5:0/1321269891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561d3e0f64d0 0x561d3e552eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:38.339 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.332+0000 7fa3c659c640 1 -- 172.21.15.5:0/1321269891 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d3e0ee2f0 msgr2=0x561d3e4d9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:38.339 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.332+0000 7fa3c659c640 1 --2- 172.21.15.5:0/1321269891 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d3e0ee2f0 0x561d3e4d9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:38.339 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.332+0000 7fa3c659c640 1 -- 172.21.15.5:0/1321269891 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d3e4da710 con 0x561d3e0d5d80 2024-08-31T05:42:38.339 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.332+0000 7fa3c6d9d640 1 --2- 172.21.15.5:0/1321269891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561d3e0f64d0 0x561d3e552eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:42:38.339 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.332+0000 7fa3c5d9b640 1 --2- 172.21.15.5:0/1321269891 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d3e0ee2f0 0x561d3e4d9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:42:38.339 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.333+0000 7fa3c659c640 1 --2- 172.21.15.5:0/1321269891 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d3e0d5d80 0x561d3e4d99c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa3b8032fd0 tx=0x7fa3b802a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f91f4b5f86a179c7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:38.339 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.333+0000 7fa3adffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:42:38.339 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.333+0000 7fa3adffb640 1 -- 172.21.15.5:0/1321269891 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b8035040 con 0x561d3e0d5d80 2024-08-31T05:42:38.340 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.333+0000 7fa3d387b740 1 -- 172.21.15.5:0/1321269891 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3c0015070 con 0x561d3e0d5d80 2024-08-31T05:42:38.340 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.333+0000 7fa3adffb640 1 -- 172.21.15.5:0/1321269891 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9511+0+0 (secure 0 0 0) 0x7fa3b8004450 con 0x561d3e0d5d80 2024-08-31T05:42:38.340 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.333+0000 7fa3adffb640 1 -- 172.21.15.5:0/1321269891 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fa3b8005040 con 0x561d3e0d5d80 2024-08-31T05:42:38.340 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.333+0000 7fa3d387b740 10 client.28522 fetch_fsmap learned FSMap version 34 2024-08-31T05:42:38.340 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.333+0000 7fa3d387b740 1 -- 172.21.15.5:0/1321269891 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x561d3e554450 con 0x561d3e0d5d80 2024-08-31T05:42:38.340 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.333+0000 7fa3adffb640 1 -- 172.21.15.5:0/1321269891 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3c0015070 con 0x561d3e0d5d80 2024-08-31T05:42:38.340 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.334+0000 7fa3adffb640 1 -- 172.21.15.5:0/1321269891 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fa3b8059070 con 0x561d3e0d5d80 2024-08-31T05:42:38.340 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.334+0000 7fa3d387b740 10 client.28522 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:42:38.340 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.334+0000 7fa3d387b740 10 client.28522 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:42:38.340 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.334+0000 7fa3d387b740 20 client.28522 populate_metadata read hostname 'smithi005' 2024-08-31T05:42:38.340 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.334+0000 7fa3d387b740 1 --2- 172.21.15.5:0/1321269891 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561d3e1171b0 0x561d3e556bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:38.340 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.334+0000 7fa3d387b740 4 client.28522 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:42:38.340 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.334+0000 7fa3d387b740 1 -- 172.21.15.5:0/1321269891 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561d3e42d9f0 con 0x561d3e1171b0 2024-08-31T05:42:38.341 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.334+0000 7fa3c5d9b640 1 --2- 172.21.15.5:0/1321269891 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561d3e1171b0 0x561d3e556bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:38.341 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.334+0000 7fa3adffb640 10 client.28522 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:42:38.341 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.334+0000 7fa3c5d9b640 1 --2- 172.21.15.5:0/1321269891 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561d3e1171b0 0x561d3e556bf0 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a03a94744af960a server_cookie=143941ffa55328c0 in_seq=0 out_seq=0 2024-08-31T05:42:38.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.349+0000 7fa3adffb640 1 -- 172.21.15.5:0/1321269891 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561d3e42d9f0 con 0x561d3e1171b0 2024-08-31T05:42:38.352 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.349+0000 7fa3adffb640 10 client.28522 handle_command_reply: tid=0 2024-08-31T05:42:38.352 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.349+0000 7fa3d387b740 1 client.28522 shutdown 2024-08-31T05:42:38.352 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.349+0000 7fa3d387b740 1 -- 172.21.15.5:0/1321269891 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d3e0d5d80 msgr2=0x561d3e4d99c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:38.352 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.349+0000 7fa3d387b740 1 --2- 172.21.15.5:0/1321269891 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d3e0d5d80 0x561d3e4d99c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa3b8032fd0 tx=0x7fa3b802a410 comp rx=0 tx=0).stop 2024-08-31T05:42:38.352 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.349+0000 7fa3d387b740 1 -- 172.21.15.5:0/1321269891 shutdown_connections 2024-08-31T05:42:38.352 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.349+0000 7fa3d387b740 1 --2- 172.21.15.5:0/1321269891 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x561d3e1171b0 0x561d3e556bf0 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:38.352 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.349+0000 7fa3d387b740 1 --2- 172.21.15.5:0/1321269891 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561d3e0f64d0 0x561d3e552eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:38.352 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.349+0000 7fa3d387b740 1 --2- 172.21.15.5:0/1321269891 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561d3e0ee2f0 0x561d3e4d9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:38.352 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.349+0000 7fa3adffb640 0 client.28522 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:42:38.352 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.349+0000 7fa3d387b740 1 --2- 172.21.15.5:0/1321269891 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d3e0d5d80 0x561d3e4d99c0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:38.352 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.349+0000 7fa3d387b740 1 -- 172.21.15.5:0/1321269891 >> 172.21.15.5:0/1321269891 conn(0x561d3e10b300 msgr2=0x561d3e4c4c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:38.352 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.349+0000 7fa3d387b740 1 -- 172.21.15.5:0/1321269891 shutdown_connections 2024-08-31T05:42:38.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.349+0000 7fa3d387b740 1 -- 172.21.15.5:0/1321269891 wait complete. 2024-08-31T05:42:38.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.349+0000 7fa3d387b740 20 client.28522 trim_cache size 0 max 16384 2024-08-31T05:42:38.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:42:38.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:42:38.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:42:38.353 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:42:38.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.350+0000 7fa3cc82f640 1 -- 172.21.15.5:0/3697763617 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa3b00b4ca0 msgr2=0x7fa3b00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:38.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.350+0000 7fa3cc82f640 1 --2- 172.21.15.5:0/3697763617 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa3b00b4ca0 0x7fa3b00b71b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fa3b8000c00 tx=0x7fa3b8031400 comp rx=0 tx=0).stop 2024-08-31T05:42:38.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.350+0000 7fa3cc82f640 1 -- 172.21.15.5:0/3697763617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3c81080a0 msgr2=0x7fa3c819b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:38.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.350+0000 7fa3cc82f640 1 --2- 172.21.15.5:0/3697763617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3c81080a0 0x7fa3c819b4d0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc00e9f0 tx=0x7fa3bc00eeb0 comp rx=0 tx=0).stop 2024-08-31T05:42:38.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.350+0000 7fa3cc82f640 1 -- 172.21.15.5:0/3697763617 shutdown_connections 2024-08-31T05:42:38.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.350+0000 7fa3cc82f640 1 --2- 172.21.15.5:0/3697763617 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa3b00b4ca0 0x7fa3b00b71b0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:38.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.350+0000 7fa3cc82f640 1 --2- 172.21.15.5:0/3697763617 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa3c81089f0 0x7fa3c819ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:38.354 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.350+0000 7fa3cc82f640 1 --2- 172.21.15.5:0/3697763617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3c81080a0 0x7fa3c819b4d0 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:38.355 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.350+0000 7fa3cc82f640 1 --2- 172.21.15.5:0/3697763617 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3c8102770 0x7fa3c819af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:38.355 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.350+0000 7fa3cc82f640 1 -- 172.21.15.5:0/3697763617 >> 172.21.15.5:0/3697763617 conn(0x7fa3c807a4b0 msgr2=0x7fa3c8101090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:38.355 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.350+0000 7fa3cc82f640 1 -- 172.21.15.5:0/3697763617 shutdown_connections 2024-08-31T05:42:38.355 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:38.350+0000 7fa3cc82f640 1 -- 172.21.15.5:0/3697763617 wait complete. 2024-08-31T05:42:38.473 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T05:42:38.737 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:42:38.942 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1422958 10.75 MB/sec execute 566 sec latency 18.852 ms 2024-08-31T05:42:39.147 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:42:39 smithi005 ceph-mon[18602]: pgmap v737: 129 pgs: 129 active+clean; 566 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.7 MiB/s wr, 212 op/s 2024-08-31T05:42:39.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.244+0000 7fbe0c6fc640 1 -- 172.21.15.5:0/2613418367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe04108a90 msgr2=0x7fbe0410f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:39.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.244+0000 7fbe0c6fc640 1 --2- 172.21.15.5:0/2613418367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe04108a90 0x7fbe0410f2c0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc009900 tx=0x7fbdfc02a410 comp rx=0 tx=0).stop 2024-08-31T05:42:39.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.245+0000 7fbe0c6fc640 1 -- 172.21.15.5:0/2613418367 shutdown_connections 2024-08-31T05:42:39.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.245+0000 7fbe0c6fc640 1 --2- 172.21.15.5:0/2613418367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe04108a90 0x7fbe0410f2c0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:39.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.245+0000 7fbe0c6fc640 1 --2- 172.21.15.5:0/2613418367 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe04108140 0x7fbe04108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:39.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.245+0000 7fbe0c6fc640 1 --2- 172.21.15.5:0/2613418367 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe04102800 0x7fbe04102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:39.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.245+0000 7fbe0c6fc640 1 -- 172.21.15.5:0/2613418367 >> 172.21.15.5:0/2613418367 conn(0x7fbe040794d0 msgr2=0x7fbe040798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:39.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.245+0000 7fbe0c6fc640 1 -- 172.21.15.5:0/2613418367 shutdown_connections 2024-08-31T05:42:39.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.245+0000 7fbe0c6fc640 1 -- 172.21.15.5:0/2613418367 wait complete. 2024-08-31T05:42:39.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.245+0000 7fbe0c6fc640 1 Processor -- start 2024-08-31T05:42:39.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.245+0000 7fbe0c6fc640 1 -- start start 2024-08-31T05:42:39.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.246+0000 7fbe0c6fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe04102800 0x7fbe0419a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:39.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.246+0000 7fbe0c6fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe04108140 0x7fbe0419a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:39.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.246+0000 7fbe0c6fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe04108a90 0x7fbe0419f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:39.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.246+0000 7fbe0c6fc640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbe04112710 con 0x7fbe04108140 2024-08-31T05:42:39.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.246+0000 7fbe0c6fc640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbe04112590 con 0x7fbe04102800 2024-08-31T05:42:39.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.246+0000 7fbe0c6fc640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbe04112890 con 0x7fbe04108a90 2024-08-31T05:42:39.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.246+0000 7fbe09c97640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe04108140 0x7fbe0419a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:39.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.246+0000 7fbe09c97640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe04108140 0x7fbe0419a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58212/0 (socket says 172.21.15.5:58212) 2024-08-31T05:42:39.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.246+0000 7fbe09c97640 1 -- 172.21.15.5:0/3589302825 learned_addr learned my addr 172.21.15.5:0/3589302825 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:39.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.246+0000 7fbe0a498640 1 --2- 172.21.15.5:0/3589302825 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe04102800 0x7fbe0419a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:39.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.246+0000 7fbe0ac99640 1 --2- 172.21.15.5:0/3589302825 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe04108a90 0x7fbe0419f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:39.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.246+0000 7fbe09c97640 1 -- 172.21.15.5:0/3589302825 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe04108a90 msgr2=0x7fbe0419f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:39.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.246+0000 7fbe09c97640 1 --2- 172.21.15.5:0/3589302825 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe04108a90 0x7fbe0419f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:39.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.246+0000 7fbe09c97640 1 -- 172.21.15.5:0/3589302825 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe04102800 msgr2=0x7fbe0419a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:39.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.246+0000 7fbe09c97640 1 --2- 172.21.15.5:0/3589302825 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe04102800 0x7fbe0419a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:39.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.246+0000 7fbe09c97640 1 -- 172.21.15.5:0/3589302825 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe041a0100 con 0x7fbe04108140 2024-08-31T05:42:39.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.246+0000 7fbe0a498640 1 --2- 172.21.15.5:0/3589302825 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe04102800 0x7fbe0419a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:42:39.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.246+0000 7fbe09c97640 1 --2- 172.21.15.5:0/3589302825 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe04108140 0x7fbe0419a730 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fbdf800e9c0 tx=0x7fbdf800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:39.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.247+0000 7fbe037fe640 1 -- 172.21.15.5:0/3589302825 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf800cd80 con 0x7fbe04108140 2024-08-31T05:42:39.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.247+0000 7fbe037fe640 1 -- 172.21.15.5:0/3589302825 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbdf80054d0 con 0x7fbe04108140 2024-08-31T05:42:39.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.247+0000 7fbe0c6fc640 1 -- 172.21.15.5:0/3589302825 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe041a03f0 con 0x7fbe04108140 2024-08-31T05:42:39.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.247+0000 7fbe037fe640 1 -- 172.21.15.5:0/3589302825 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf8010430 con 0x7fbe04108140 2024-08-31T05:42:39.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.247+0000 7fbe0c6fc640 1 -- 172.21.15.5:0/3589302825 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe041a6b50 con 0x7fbe04108140 2024-08-31T05:42:39.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.249+0000 7fbe12c71740 1 Processor -- start 2024-08-31T05:42:39.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.250+0000 7fbe12c71740 1 -- start start 2024-08-31T05:42:39.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.250+0000 7fbe12c71740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56441455a070 0x5644148ff350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:39.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.250+0000 7fbe12c71740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5644145311b0 0x5644148ff890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:39.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.250+0000 7fbe12c71740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564414539390 0x5644148ffdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:39.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.250+0000 7fbe037fe640 1 -- 172.21.15.5:0/3589302825 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fbdf80105d0 con 0x7fbe04108140 2024-08-31T05:42:39.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.250+0000 7fbe12c71740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x564414876680 con 0x5644145311b0 2024-08-31T05:42:39.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.250+0000 7fbe12c71740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x564414865c10 con 0x564414539390 2024-08-31T05:42:39.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.250+0000 7fbe12c71740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564414869bc0 con 0x56441455a070 2024-08-31T05:42:39.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.250+0000 7fbe0ac99640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56441455a070 0x5644148ff350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:39.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.250+0000 7fbe0a498640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5644145311b0 0x5644148ff890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:39.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.250+0000 7fbe0ac99640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56441455a070 0x5644148ff350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:41876/0 (socket says 172.21.15.5:41876) 2024-08-31T05:42:39.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.250+0000 7fbe09c97640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564414539390 0x5644148ffdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:39.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.250+0000 7fbe0ac99640 1 -- 172.21.15.5:0/1485423834 learned_addr learned my addr 172.21.15.5:0/1485423834 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:39.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.251+0000 7fbe0ac99640 1 -- 172.21.15.5:0/1485423834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564414539390 msgr2=0x5644148ffdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:39.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.251+0000 7fbe0ac99640 1 --2- 172.21.15.5:0/1485423834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564414539390 0x5644148ffdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:39.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.251+0000 7fbe0ac99640 1 -- 172.21.15.5:0/1485423834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5644145311b0 msgr2=0x5644148ff890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:39.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.251+0000 7fbe0ac99640 1 --2- 172.21.15.5:0/1485423834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5644145311b0 0x5644148ff890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:39.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.251+0000 7fbe0ac99640 1 -- 172.21.15.5:0/1485423834 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644145c5650 con 0x56441455a070 2024-08-31T05:42:39.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.251+0000 7fbe0ac99640 1 --2- 172.21.15.5:0/1485423834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56441455a070 0x5644148ff350 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc009900 tx=0x7fbdfc032b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbdb4fc7273b461e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:39.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.251+0000 7fbe037fe640 1 --2- 172.21.15.5:0/3589302825 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fbdec0b4d20 0x7fbdec0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:39.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.251+0000 7fbe00ff9640 1 -- 172.21.15.5:0/1485423834 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc040070 con 0x56441455a070 2024-08-31T05:42:39.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.251+0000 7fbe00ff9640 1 -- 172.21.15.5:0/1485423834 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbdfc004030 con 0x56441455a070 2024-08-31T05:42:39.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.251+0000 7fbe00ff9640 1 -- 172.21.15.5:0/1485423834 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc035040 con 0x56441455a070 2024-08-31T05:42:39.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.251+0000 7fbe0a498640 1 --2- 172.21.15.5:0/3589302825 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fbdec0b4d20 0x7fbdec0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:39.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.251+0000 7fbe037fe640 1 -- 172.21.15.5:0/3589302825 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9511+0+0 (secure 0 0 0) 0x7fbdf80e5d00 con 0x7fbe04108140 2024-08-31T05:42:39.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.252+0000 7fbe12c71740 1 -- 172.21.15.5:0/1485423834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56441455a070 msgr2=0x5644148ff350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:39.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.252+0000 7fbe0a498640 1 --2- 172.21.15.5:0/3589302825 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fbdec0b4d20 0x7fbdec0b7230 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x5644148fdfd0 tx=0x7fbdf4009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:39.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.252+0000 7fbe12c71740 1 --2- 172.21.15.5:0/1485423834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56441455a070 0x5644148ff350 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc009900 tx=0x7fbdfc032b20 comp rx=0 tx=0).stop 2024-08-31T05:42:39.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.252+0000 7fbe12c71740 1 -- 172.21.15.5:0/1485423834 shutdown_connections 2024-08-31T05:42:39.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.252+0000 7fbe12c71740 1 --2- 172.21.15.5:0/1485423834 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564414539390 0x5644148ffdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:39.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.252+0000 7fbe12c71740 1 --2- 172.21.15.5:0/1485423834 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5644145311b0 0x5644148ff890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:39.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.252+0000 7fbe12c71740 1 --2- 172.21.15.5:0/1485423834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56441455a070 0x5644148ff350 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:39.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.252+0000 7fbe12c71740 1 -- 172.21.15.5:0/1485423834 >> 172.21.15.5:0/1485423834 conn(0x56441454e460 msgr2=0x5644148fd240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:39.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.252+0000 7fbe12c71740 1 -- 172.21.15.5:0/1485423834 shutdown_connections 2024-08-31T05:42:39.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.252+0000 7fbe12c71740 1 -- 172.21.15.5:0/1485423834 wait complete. 2024-08-31T05:42:39.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.253+0000 7fbe12c71740 1 -- start start 2024-08-31T05:42:39.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.253+0000 7fbe12c71740 1 Processor -- start 2024-08-31T05:42:39.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.253+0000 7fbe12c71740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5644145311b0 0x56441490ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:39.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.253+0000 7fbe12c71740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564414539390 0x56441490b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:39.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.253+0000 7fbe12c71740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56441455a070 0x564414916df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:39.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.253+0000 7fbe12c71740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5644146c8700 con 0x5644145311b0 2024-08-31T05:42:39.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.253+0000 7fbe12c71740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5644147ec750 con 0x56441455a070 2024-08-31T05:42:39.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.253+0000 7fbe12c71740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56441490dad0 con 0x564414539390 2024-08-31T05:42:39.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.253+0000 7fbe0a498640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5644145311b0 0x56441490ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:39.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.253+0000 7fbe0a498640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5644145311b0 0x56441490ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58230/0 (socket says 172.21.15.5:58230) 2024-08-31T05:42:39.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.253+0000 7fbe0a498640 1 -- 172.21.15.5:0/1949324470 learned_addr learned my addr 172.21.15.5:0/1949324470 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:39.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.253+0000 7fbe12c71740 10 client.0 _ll_register_callbacks cb 0x56441481be10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:42:39.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.253+0000 7fbe09c97640 1 --2- 172.21.15.5:0/1949324470 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564414539390 0x56441490b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:39.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.254+0000 7fbe0ac99640 1 --2- 172.21.15.5:0/1949324470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56441455a070 0x564414916df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:39.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.254+0000 7fbe0a498640 1 -- 172.21.15.5:0/1949324470 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564414539390 msgr2=0x56441490b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:39.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.254+0000 7fbe0a498640 1 --2- 172.21.15.5:0/1949324470 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564414539390 0x56441490b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:39.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.254+0000 7fbe0a498640 1 -- 172.21.15.5:0/1949324470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56441455a070 msgr2=0x564414916df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:39.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.254+0000 7fbe0a498640 1 --2- 172.21.15.5:0/1949324470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56441455a070 0x564414916df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:39.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.254+0000 7fbe0a498640 1 -- 172.21.15.5:0/1949324470 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564414825900 con 0x5644145311b0 2024-08-31T05:42:39.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.254+0000 7fbe09c97640 1 --2- 172.21.15.5:0/1949324470 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564414539390 0x56441490b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:42:39.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.254+0000 7fbe0ac99640 1 --2- 172.21.15.5:0/1949324470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56441455a070 0x564414916df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:42:39.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.254+0000 7fbe0a498640 1 --2- 172.21.15.5:0/1949324470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5644145311b0 0x56441490ab30 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fbdf400fdc0 tx=0x7fbdf4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d48846712b9a94c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:39.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.254+0000 7fbde9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:42:39.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.254+0000 7fbde9ffb640 1 -- 172.21.15.5:0/1949324470 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf40044d0 con 0x5644145311b0 2024-08-31T05:42:39.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.254+0000 7fbe12c71740 1 -- 172.21.15.5:0/1949324470 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbdfc004030 con 0x5644145311b0 2024-08-31T05:42:39.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.254+0000 7fbde9ffb640 1 -- 172.21.15.5:0/1949324470 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9511+0+0 (secure 0 0 0) 0x7fbdf4018030 con 0x5644145311b0 2024-08-31T05:42:39.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.255+0000 7fbde9ffb640 1 -- 172.21.15.5:0/1949324470 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fbdf4004670 con 0x5644145311b0 2024-08-31T05:42:39.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.255+0000 7fbe12c71740 10 client.18954 fetch_fsmap learned FSMap version 34 2024-08-31T05:42:39.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.255+0000 7fbe12c71740 1 -- 172.21.15.5:0/1949324470 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x564414919990 con 0x5644145311b0 2024-08-31T05:42:39.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.255+0000 7fbde9ffb640 1 -- 172.21.15.5:0/1949324470 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbdfc004030 con 0x5644145311b0 2024-08-31T05:42:39.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.255+0000 7fbde9ffb640 1 -- 172.21.15.5:0/1949324470 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fbdf4028420 con 0x5644145311b0 2024-08-31T05:42:39.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.255+0000 7fbe12c71740 10 client.18954 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:42:39.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.255+0000 7fbe12c71740 10 client.18954 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-31T05:42:39.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.255+0000 7fbe12c71740 20 client.18954 populate_metadata read hostname 'smithi005' 2024-08-31T05:42:39.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.255+0000 7fbe12c71740 1 --2- 172.21.15.5:0/1949324470 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x5644145189f0 0x56441491cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:39.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.255+0000 7fbe12c71740 4 client.18954 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:42:39.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.255+0000 7fbe12c71740 1 -- 172.21.15.5:0/1949324470 --> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5644148785d0 con 0x5644145189f0 2024-08-31T05:42:39.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.255+0000 7fbe09c97640 1 --2- 172.21.15.5:0/1949324470 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x5644145189f0 0x56441491cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:39.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.256+0000 7fbde9ffb640 10 client.18954 ms_handle_connect on v2:172.21.15.70:6836/2780036414 2024-08-31T05:42:39.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.256+0000 7fbe09c97640 1 --2- 172.21.15.5:0/1949324470 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x5644145189f0 0x56441491cf20 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c2d182e7868fa5be server_cookie=1efcc6904eadb8b5 in_seq=0 out_seq=0 2024-08-31T05:42:39.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.257+0000 7fbde9ffb640 1 -- 172.21.15.5:0/1949324470 <== mds.2 v2:172.21.15.70:6836/2780036414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5644148785d0 con 0x5644145189f0 2024-08-31T05:42:39.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.257+0000 7fbde9ffb640 10 client.18954 handle_command_reply: tid=0 2024-08-31T05:42:39.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.257+0000 7fbe12c71740 1 client.18954 shutdown 2024-08-31T05:42:39.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.257+0000 7fbe12c71740 1 -- 172.21.15.5:0/1949324470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5644145311b0 msgr2=0x56441490ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:39.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.257+0000 7fbe12c71740 1 --2- 172.21.15.5:0/1949324470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5644145311b0 0x56441490ab30 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fbdf400fdc0 tx=0x7fbdf4004ab0 comp rx=0 tx=0).stop 2024-08-31T05:42:39.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.257+0000 7fbe12c71740 1 -- 172.21.15.5:0/1949324470 shutdown_connections 2024-08-31T05:42:39.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.257+0000 7fbe12c71740 1 --2- 172.21.15.5:0/1949324470 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x5644145189f0 0x56441491cf20 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:39.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.257+0000 7fbe12c71740 1 --2- 172.21.15.5:0/1949324470 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56441455a070 0x564414916df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:39.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.257+0000 7fbe12c71740 1 --2- 172.21.15.5:0/1949324470 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564414539390 0x56441490b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:39.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.257+0000 7fbde9ffb640 0 client.18954 ms_handle_reset on v2:172.21.15.70:6836/2780036414 2024-08-31T05:42:39.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.257+0000 7fbe12c71740 1 --2- 172.21.15.5:0/1949324470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5644145311b0 0x56441490ab30 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:39.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.257+0000 7fbe12c71740 1 -- 172.21.15.5:0/1949324470 >> 172.21.15.5:0/1949324470 conn(0x56441454e460 msgr2=0x5644149024e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:39.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.257+0000 7fbe12c71740 1 -- 172.21.15.5:0/1949324470 shutdown_connections 2024-08-31T05:42:39.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.257+0000 7fbe12c71740 1 -- 172.21.15.5:0/1949324470 wait complete. 2024-08-31T05:42:39.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.257+0000 7fbe12c71740 20 client.18954 trim_cache size 0 max 16384 2024-08-31T05:42:39.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.271+0000 7fbe12c71740 1 Processor -- start 2024-08-31T05:42:39.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.271+0000 7fbe12c71740 1 -- start start 2024-08-31T05:42:39.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.271+0000 7fbe12c71740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5644145189f0 0x564414900a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:39.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.271+0000 7fbe12c71740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644145311b0 0x564414907d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:39.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.271+0000 7fbe12c71740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564414539390 0x564414908260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:39.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.271+0000 7fbe12c71740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbe041b0d20 con 0x5644145189f0 2024-08-31T05:42:39.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.271+0000 7fbe12c71740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbe041b2860 con 0x564414539390 2024-08-31T05:42:39.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.271+0000 7fbe12c71740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbe041b13f0 con 0x5644145311b0 2024-08-31T05:42:39.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.271+0000 7fbe0a498640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5644145189f0 0x564414900a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:39.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.271+0000 7fbe0a498640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5644145189f0 0x564414900a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58242/0 (socket says 172.21.15.5:58242) 2024-08-31T05:42:39.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.271+0000 7fbe0a498640 1 -- 172.21.15.5:0/2369832442 learned_addr learned my addr 172.21.15.5:0/2369832442 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:39.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.271+0000 7fbe09c97640 1 --2- 172.21.15.5:0/2369832442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644145311b0 0x564414907d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:39.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.271+0000 7fbe0ac99640 1 --2- 172.21.15.5:0/2369832442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564414539390 0x564414908260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:39.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.272+0000 7fbe0a498640 1 -- 172.21.15.5:0/2369832442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644145311b0 msgr2=0x564414907d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:39.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.272+0000 7fbe0a498640 1 --2- 172.21.15.5:0/2369832442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644145311b0 0x564414907d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:39.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.272+0000 7fbe0a498640 1 -- 172.21.15.5:0/2369832442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564414539390 msgr2=0x564414908260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:39.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.272+0000 7fbe0a498640 1 --2- 172.21.15.5:0/2369832442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564414539390 0x564414908260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:39.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.272+0000 7fbe0a498640 1 -- 172.21.15.5:0/2369832442 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564414909030 con 0x5644145189f0 2024-08-31T05:42:39.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.272+0000 7fbe0a498640 1 --2- 172.21.15.5:0/2369832442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5644145189f0 0x564414900a90 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4028a80 tx=0x7fbdf4009570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b184e23650476dc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:39.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.272+0000 7fbdebfff640 1 -- 172.21.15.5:0/2369832442 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf4004810 con 0x5644145189f0 2024-08-31T05:42:39.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.272+0000 7fbdebfff640 1 -- 172.21.15.5:0/2369832442 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbdf400f7e0 con 0x5644145189f0 2024-08-31T05:42:39.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.272+0000 7fbdebfff640 1 -- 172.21.15.5:0/2369832442 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf4028550 con 0x5644145189f0 2024-08-31T05:42:39.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.273+0000 7fbe12c71740 1 -- 172.21.15.5:0/2369832442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5644145189f0 msgr2=0x564414900a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:39.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.273+0000 7fbe12c71740 1 --2- 172.21.15.5:0/2369832442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5644145189f0 0x564414900a90 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4028a80 tx=0x7fbdf4009570 comp rx=0 tx=0).stop 2024-08-31T05:42:39.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.273+0000 7fbe12c71740 1 -- 172.21.15.5:0/2369832442 shutdown_connections 2024-08-31T05:42:39.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.273+0000 7fbe12c71740 1 --2- 172.21.15.5:0/2369832442 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x564414539390 0x564414908260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:39.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.273+0000 7fbe12c71740 1 --2- 172.21.15.5:0/2369832442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644145311b0 0x564414907d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:39.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.273+0000 7fbe12c71740 1 --2- 172.21.15.5:0/2369832442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5644145189f0 0x564414900a90 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:39.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.273+0000 7fbe12c71740 1 -- 172.21.15.5:0/2369832442 >> 172.21.15.5:0/2369832442 conn(0x56441454e460 msgr2=0x564414900380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:39.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.273+0000 7fbe12c71740 1 -- 172.21.15.5:0/2369832442 shutdown_connections 2024-08-31T05:42:39.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.273+0000 7fbe12c71740 1 -- 172.21.15.5:0/2369832442 wait complete. 2024-08-31T05:42:39.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.274+0000 7fbe12c71740 1 -- start start 2024-08-31T05:42:39.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.274+0000 7fbe12c71740 1 Processor -- start 2024-08-31T05:42:39.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.274+0000 7fbe12c71740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644145189f0 0x564414913240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:39.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.274+0000 7fbe12c71740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5644145311b0 0x564414910710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:39.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.274+0000 7fbe12c71740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564414539390 0x564414910c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:39.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.274+0000 7fbe12c71740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbe041b2190 con 0x564414539390 2024-08-31T05:42:39.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.274+0000 7fbe12c71740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fbe041b1ac0 con 0x5644145311b0 2024-08-31T05:42:39.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.274+0000 7fbe12c71740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbe041aed20 con 0x5644145189f0 2024-08-31T05:42:39.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.274+0000 7fbe12c71740 10 client.0 _ll_register_callbacks cb 0x7fbdf4012f90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:42:39.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.274+0000 7fbe09c97640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5644145311b0 0x564414910710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:39.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.274+0000 7fbe0a498640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644145189f0 0x564414913240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:39.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.274+0000 7fbe09c97640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5644145311b0 0x564414910710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:54068/0 (socket says 172.21.15.5:54068) 2024-08-31T05:42:39.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.274+0000 7fbe0a498640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644145189f0 0x564414913240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:41900/0 (socket says 172.21.15.5:41900) 2024-08-31T05:42:39.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.274+0000 7fbe09c97640 1 -- 172.21.15.5:0/804107542 learned_addr learned my addr 172.21.15.5:0/804107542 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:39.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.274+0000 7fbe0ac99640 1 --2- 172.21.15.5:0/804107542 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564414539390 0x564414910c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:39.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.275+0000 7fbe0ac99640 1 -- 172.21.15.5:0/804107542 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644145189f0 msgr2=0x564414913240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:39.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.275+0000 7fbe0ac99640 1 --2- 172.21.15.5:0/804107542 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644145189f0 0x564414913240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:39.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.275+0000 7fbe0ac99640 1 -- 172.21.15.5:0/804107542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5644145311b0 msgr2=0x564414910710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:39.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.275+0000 7fbe0ac99640 1 --2- 172.21.15.5:0/804107542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5644145311b0 0x564414910710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:39.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.275+0000 7fbe0ac99640 1 -- 172.21.15.5:0/804107542 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564414911190 con 0x564414539390 2024-08-31T05:42:39.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.275+0000 7fbe09c97640 1 --2- 172.21.15.5:0/804107542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5644145311b0 0x564414910710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:42:39.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.275+0000 7fbe0ac99640 1 --2- 172.21.15.5:0/804107542 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564414539390 0x564414910c50 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc006010 tx=0x7fbdfc032f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef2afd99a236a255 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:39.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.275+0000 7fbde9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:42:39.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.275+0000 7fbde9ffb640 1 -- 172.21.15.5:0/804107542 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc040040 con 0x564414539390 2024-08-31T05:42:39.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.275+0000 7fbe12c71740 1 -- 172.21.15.5:0/804107542 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbdf400f7e0 con 0x564414539390 2024-08-31T05:42:39.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.275+0000 7fbde9ffb640 1 -- 172.21.15.5:0/804107542 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9511+0+0 (secure 0 0 0) 0x7fbdfc031730 con 0x564414539390 2024-08-31T05:42:39.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.276+0000 7fbde9ffb640 1 -- 172.21.15.5:0/804107542 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fbdfc057050 con 0x564414539390 2024-08-31T05:42:39.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.276+0000 7fbe12c71740 10 client.18960 fetch_fsmap learned FSMap version 34 2024-08-31T05:42:39.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.276+0000 7fbe12c71740 1 -- 172.21.15.5:0/804107542 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x564414987570 con 0x564414539390 2024-08-31T05:42:39.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.276+0000 7fbde9ffb640 1 -- 172.21.15.5:0/804107542 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbdf400f7e0 con 0x564414539390 2024-08-31T05:42:39.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.276+0000 7fbde9ffb640 1 -- 172.21.15.5:0/804107542 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fbdfc0046c0 con 0x564414539390 2024-08-31T05:42:39.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.276+0000 7fbe12c71740 10 client.18960 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:42:39.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.276+0000 7fbe12c71740 10 client.18960 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-31T05:42:39.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.276+0000 7fbe12c71740 20 client.18960 populate_metadata read hostname 'smithi005' 2024-08-31T05:42:39.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.276+0000 7fbe12c71740 1 --2- 172.21.15.5:0/804107542 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x56441455a070 0x5644149898c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:39.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.276+0000 7fbe12c71740 4 client.18960 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:42:39.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.276+0000 7fbe12c71740 1 -- 172.21.15.5:0/804107542 --> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564414874070 con 0x56441455a070 2024-08-31T05:42:39.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.276+0000 7fbe0a498640 1 --2- 172.21.15.5:0/804107542 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x56441455a070 0x5644149898c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:39.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.277+0000 7fbe0a498640 1 --2- 172.21.15.5:0/804107542 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x56441455a070 0x5644149898c0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=31e076f747c3c081 server_cookie=2bec911ec0a5806 in_seq=0 out_seq=0 2024-08-31T05:42:39.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.277+0000 7fbde9ffb640 10 client.18960 ms_handle_connect on v2:172.21.15.70:6836/2780036414 2024-08-31T05:42:39.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.277+0000 7fbde9ffb640 1 -- 172.21.15.5:0/804107542 <== mds.2 v2:172.21.15.70:6836/2780036414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564414874070 con 0x56441455a070 2024-08-31T05:42:39.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.277+0000 7fbde9ffb640 10 client.18960 handle_command_reply: tid=0 2024-08-31T05:42:39.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.277+0000 7fbe12c71740 1 client.18960 shutdown 2024-08-31T05:42:39.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.277+0000 7fbe12c71740 1 -- 172.21.15.5:0/804107542 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564414539390 msgr2=0x564414910c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:39.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.277+0000 7fbe12c71740 1 --2- 172.21.15.5:0/804107542 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564414539390 0x564414910c50 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc006010 tx=0x7fbdfc032f40 comp rx=0 tx=0).stop 2024-08-31T05:42:39.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.277+0000 7fbe12c71740 1 -- 172.21.15.5:0/804107542 shutdown_connections 2024-08-31T05:42:39.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.277+0000 7fbe12c71740 1 --2- 172.21.15.5:0/804107542 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x56441455a070 0x5644149898c0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:39.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.277+0000 7fbde9ffb640 0 client.18960 ms_handle_reset on v2:172.21.15.70:6836/2780036414 2024-08-31T05:42:39.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.277+0000 7fbe12c71740 1 --2- 172.21.15.5:0/804107542 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564414539390 0x564414910c50 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:39.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.277+0000 7fbe12c71740 1 --2- 172.21.15.5:0/804107542 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5644145311b0 0x564414910710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:39.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.277+0000 7fbe12c71740 1 --2- 172.21.15.5:0/804107542 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644145189f0 0x564414913240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:39.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.277+0000 7fbe12c71740 1 -- 172.21.15.5:0/804107542 >> 172.21.15.5:0/804107542 conn(0x56441454e460 msgr2=0x56441490bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:39.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.277+0000 7fbe12c71740 1 -- 172.21.15.5:0/804107542 shutdown_connections 2024-08-31T05:42:39.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.277+0000 7fbe12c71740 1 -- 172.21.15.5:0/804107542 wait complete. 2024-08-31T05:42:39.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.277+0000 7fbe12c71740 20 client.18960 trim_cache size 0 max 16384 2024-08-31T05:42:39.284 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:42:39.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.278+0000 7fbe0c6fc640 1 -- 172.21.15.5:0/3589302825 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fbdec0b4d20 msgr2=0x7fbdec0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:39.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.278+0000 7fbe0c6fc640 1 --2- 172.21.15.5:0/3589302825 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fbdec0b4d20 0x7fbdec0b7230 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x5644148fdfd0 tx=0x7fbdf4009500 comp rx=0 tx=0).stop 2024-08-31T05:42:39.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.278+0000 7fbe0c6fc640 1 -- 172.21.15.5:0/3589302825 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe04108140 msgr2=0x7fbe0419a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:39.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.278+0000 7fbe0c6fc640 1 --2- 172.21.15.5:0/3589302825 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe04108140 0x7fbe0419a730 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fbdf800e9c0 tx=0x7fbdf800ee80 comp rx=0 tx=0).stop 2024-08-31T05:42:39.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.278+0000 7fbe0c6fc640 1 -- 172.21.15.5:0/3589302825 shutdown_connections 2024-08-31T05:42:39.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.278+0000 7fbe0c6fc640 1 --2- 172.21.15.5:0/3589302825 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fbdec0b4d20 0x7fbdec0b7230 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:39.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.278+0000 7fbe0c6fc640 1 --2- 172.21.15.5:0/3589302825 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe04108a90 0x7fbe0419f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:39.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.278+0000 7fbe0c6fc640 1 --2- 172.21.15.5:0/3589302825 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe04108140 0x7fbe0419a730 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:39.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.278+0000 7fbe0c6fc640 1 --2- 172.21.15.5:0/3589302825 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fbe04102800 0x7fbe0419a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:39.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.278+0000 7fbe0c6fc640 1 -- 172.21.15.5:0/3589302825 >> 172.21.15.5:0/3589302825 conn(0x7fbe040794d0 msgr2=0x7fbe04103fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:39.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.278+0000 7fbe0c6fc640 1 -- 172.21.15.5:0/3589302825 shutdown_connections 2024-08-31T05:42:39.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:39.278+0000 7fbe0c6fc640 1 -- 172.21.15.5:0/3589302825 wait complete. 2024-08-31T05:42:39.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:42:39 smithi070 ceph-mon[22316]: pgmap v737: 129 pgs: 129 active+clean; 566 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.7 MiB/s wr, 212 op/s 2024-08-31T05:42:39.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:42:39 smithi050 ceph-mon[22146]: pgmap v737: 129 pgs: 129 active+clean; 566 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.7 MiB/s wr, 212 op/s 2024-08-31T05:42:39.942 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1425031 10.76 MB/sec execute 567 sec latency 123.939 ms 2024-08-31T05:42:40.631 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T05:42:40.942 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1426381 10.75 MB/sec execute 568 sec latency 58.126 ms 2024-08-31T05:42:40.962 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:42:41.275 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:42:41 smithi005 ceph-mon[18602]: pgmap v738: 129 pgs: 129 active+clean; 574 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.4 MiB/s wr, 245 op/s 2024-08-31T05:42:41.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:42:41 smithi070 ceph-mon[22316]: pgmap v738: 129 pgs: 129 active+clean; 574 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.4 MiB/s wr, 245 op/s 2024-08-31T05:42:41.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:42:41 smithi050 ceph-mon[22146]: pgmap v738: 129 pgs: 129 active+clean; 574 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.4 MiB/s wr, 245 op/s 2024-08-31T05:42:41.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.516+0000 7f40ca0a8640 1 -- 172.21.15.5:0/3117625550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40c4104750 msgr2=0x7f40c4104b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:41.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.516+0000 7f40ca0a8640 1 --2- 172.21.15.5:0/3117625550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40c4104750 0x7f40c4104b60 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f40b4009900 tx=0x7f40b402a410 comp rx=0 tx=0).stop 2024-08-31T05:42:41.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.516+0000 7f40ca0a8640 1 -- 172.21.15.5:0/3117625550 shutdown_connections 2024-08-31T05:42:41.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.516+0000 7f40ca0a8640 1 --2- 172.21.15.5:0/3117625550 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40c410dbb0 0x7f40c41100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:41.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.516+0000 7f40ca0a8640 1 --2- 172.21.15.5:0/3117625550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40c41050a0 0x7f40c410d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:41.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.516+0000 7f40ca0a8640 1 --2- 172.21.15.5:0/3117625550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40c4104750 0x7f40c4104b60 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:41.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.516+0000 7f40ca0a8640 1 -- 172.21.15.5:0/3117625550 >> 172.21.15.5:0/3117625550 conn(0x7f40c40794d0 msgr2=0x7f40c40798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:41.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.516+0000 7f40ca0a8640 1 -- 172.21.15.5:0/3117625550 shutdown_connections 2024-08-31T05:42:41.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.516+0000 7f40ca0a8640 1 -- 172.21.15.5:0/3117625550 wait complete. 2024-08-31T05:42:41.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.517+0000 7f40ca0a8640 1 Processor -- start 2024-08-31T05:42:41.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.517+0000 7f40ca0a8640 1 -- start start 2024-08-31T05:42:41.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.517+0000 7f40ca0a8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40c4104750 0x7f40c419a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:41.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.517+0000 7f40ca0a8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40c41050a0 0x7f40c419a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:41.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.517+0000 7f40ca0a8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40c410dbb0 0x7f40c419fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:41.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.517+0000 7f40ca0a8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f40c4113830 con 0x7f40c410dbb0 2024-08-31T05:42:41.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.517+0000 7f40ca0a8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f40c41136b0 con 0x7f40c4104750 2024-08-31T05:42:41.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.517+0000 7f40ca0a8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f40c41139b0 con 0x7f40c41050a0 2024-08-31T05:42:41.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.517+0000 7f40c3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40c410dbb0 0x7f40c419fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:41.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.517+0000 7f40c2ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40c41050a0 0x7f40c419a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:41.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.517+0000 7f40c3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40c410dbb0 0x7f40c419fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58258/0 (socket says 172.21.15.5:58258) 2024-08-31T05:42:41.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.517+0000 7f40c3fff640 1 -- 172.21.15.5:0/3607787626 learned_addr learned my addr 172.21.15.5:0/3607787626 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:41.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.517+0000 7f40c37fe640 1 --2- 172.21.15.5:0/3607787626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40c4104750 0x7f40c419a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:41.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.518+0000 7f40c2ffd640 1 -- 172.21.15.5:0/3607787626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40c4104750 msgr2=0x7f40c419a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:41.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.518+0000 7f40c2ffd640 1 --2- 172.21.15.5:0/3607787626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40c4104750 0x7f40c419a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:41.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.518+0000 7f40c2ffd640 1 -- 172.21.15.5:0/3607787626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40c410dbb0 msgr2=0x7f40c419fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:41.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.518+0000 7f40c2ffd640 1 --2- 172.21.15.5:0/3607787626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40c410dbb0 0x7f40c419fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:41.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.518+0000 7f40c2ffd640 1 -- 172.21.15.5:0/3607787626 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40c41a0210 con 0x7f40c41050a0 2024-08-31T05:42:41.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.518+0000 7f40c3fff640 1 --2- 172.21.15.5:0/3607787626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40c410dbb0 0x7f40c419fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:42:41.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.518+0000 7f40c2ffd640 1 --2- 172.21.15.5:0/3607787626 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40c41050a0 0x7f40c419a840 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f40c406aad0 tx=0x7f40b800ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:41.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.518+0000 7f40c0ff9640 1 -- 172.21.15.5:0/3607787626 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b800cc40 con 0x7f40c41050a0 2024-08-31T05:42:41.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.518+0000 7f40c0ff9640 1 -- 172.21.15.5:0/3607787626 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40b800cde0 con 0x7f40c41050a0 2024-08-31T05:42:41.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.518+0000 7f40ca0a8640 1 -- 172.21.15.5:0/3607787626 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40c41a0500 con 0x7f40c41050a0 2024-08-31T05:42:41.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.518+0000 7f40c0ff9640 1 -- 172.21.15.5:0/3607787626 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b8018780 con 0x7f40c41050a0 2024-08-31T05:42:41.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.518+0000 7f40ca0a8640 1 -- 172.21.15.5:0/3607787626 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40c41a6c60 con 0x7f40c41050a0 2024-08-31T05:42:41.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.521+0000 7f40c0ff9640 1 -- 172.21.15.5:0/3607787626 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f40b8010a90 con 0x7f40c41050a0 2024-08-31T05:42:41.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.522+0000 7f40d061d740 1 Processor -- start 2024-08-31T05:42:41.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.522+0000 7f40d061d740 1 -- start start 2024-08-31T05:42:41.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.523+0000 7f40d061d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba92ff0070 0x55ba93395350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:41.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.523+0000 7f40d061d740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba92fc71b0 0x55ba93395890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:41.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.523+0000 7f40d061d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba92fcf390 0x55ba93395dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:41.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.523+0000 7f40d061d740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55ba9330c680 con 0x55ba92fc71b0 2024-08-31T05:42:41.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.523+0000 7f40d061d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ba932fbc10 con 0x55ba92fcf390 2024-08-31T05:42:41.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.523+0000 7f40d061d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ba932ffbc0 con 0x55ba92ff0070 2024-08-31T05:42:41.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.523+0000 7f40c3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba92ff0070 0x55ba93395350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:41.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.523+0000 7f40c37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba92fc71b0 0x55ba93395890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:41.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.523+0000 7f40c37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba92fc71b0 0x55ba93395890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58268/0 (socket says 172.21.15.5:58268) 2024-08-31T05:42:41.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.523+0000 7f40c3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba92ff0070 0x55ba93395350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:41924/0 (socket says 172.21.15.5:41924) 2024-08-31T05:42:41.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.523+0000 7f40c37fe640 1 -- 172.21.15.5:0/1178818162 learned_addr learned my addr 172.21.15.5:0/1178818162 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:41.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.523+0000 7f40c2ffd640 1 --2- 172.21.15.5:0/1178818162 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba92fcf390 0x55ba93395dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:41.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.523+0000 7f40c0ff9640 1 --2- 172.21.15.5:0/3607787626 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f40ac0b4d20 0x7f40ac0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:41.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.523+0000 7f40c3fff640 1 -- 172.21.15.5:0/1178818162 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba92fcf390 msgr2=0x55ba93395dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:41.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.523+0000 7f40c3fff640 1 --2- 172.21.15.5:0/1178818162 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba92fcf390 0x55ba93395dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:41.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.523+0000 7f40c3fff640 1 -- 172.21.15.5:0/1178818162 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba92fc71b0 msgr2=0x55ba93395890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:41.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.523+0000 7f40c3fff640 1 --2- 172.21.15.5:0/1178818162 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba92fc71b0 0x55ba93395890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:41.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.523+0000 7f40c3fff640 1 -- 172.21.15.5:0/1178818162 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba9305b650 con 0x55ba92ff0070 2024-08-31T05:42:41.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.523+0000 7f40c37fe640 1 --2- 172.21.15.5:0/1178818162 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba92fc71b0 0x55ba93395890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:42:41.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.523+0000 7f40c3fff640 1 --2- 172.21.15.5:0/3607787626 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f40ac0b4d20 0x7f40ac0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:41.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.524+0000 7f40c0ff9640 1 -- 172.21.15.5:0/3607787626 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9511+0+0 (secure 0 0 0) 0x7f40b80e5b70 con 0x7f40c41050a0 2024-08-31T05:42:41.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.524+0000 7f40c3fff640 1 --2- 172.21.15.5:0/1178818162 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba92ff0070 0x55ba93395350 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f40bc011920 tx=0x7f40bc011de0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6415910ef7784a3e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:41.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.524+0000 7f40a9ffb640 1 -- 172.21.15.5:0/1178818162 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40bc017050 con 0x55ba92ff0070 2024-08-31T05:42:41.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.524+0000 7f40a9ffb640 1 -- 172.21.15.5:0/1178818162 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40bc01cc30 con 0x55ba92ff0070 2024-08-31T05:42:41.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.524+0000 7f40c3fff640 1 --2- 172.21.15.5:0/3607787626 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f40ac0b4d20 0x7f40ac0b7230 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f40bc023000 tx=0x7f40bc024000 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:41.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.524+0000 7f40a9ffb640 1 -- 172.21.15.5:0/1178818162 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40bc010aa0 con 0x55ba92ff0070 2024-08-31T05:42:41.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.525+0000 7f40d061d740 1 -- 172.21.15.5:0/1178818162 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba92ff0070 msgr2=0x55ba93395350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:41.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.525+0000 7f40d061d740 1 --2- 172.21.15.5:0/1178818162 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba92ff0070 0x55ba93395350 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f40bc011920 tx=0x7f40bc011de0 comp rx=0 tx=0).stop 2024-08-31T05:42:41.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.525+0000 7f40d061d740 1 -- 172.21.15.5:0/1178818162 shutdown_connections 2024-08-31T05:42:41.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.525+0000 7f40d061d740 1 --2- 172.21.15.5:0/1178818162 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba92fcf390 0x55ba93395dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:41.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.525+0000 7f40d061d740 1 --2- 172.21.15.5:0/1178818162 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba92fc71b0 0x55ba93395890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:41.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.525+0000 7f40d061d740 1 --2- 172.21.15.5:0/1178818162 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba92ff0070 0x55ba93395350 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:41.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.525+0000 7f40d061d740 1 -- 172.21.15.5:0/1178818162 >> 172.21.15.5:0/1178818162 conn(0x55ba92fe4460 msgr2=0x55ba93393240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:41.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.525+0000 7f40d061d740 1 -- 172.21.15.5:0/1178818162 shutdown_connections 2024-08-31T05:42:41.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.525+0000 7f40d061d740 1 -- 172.21.15.5:0/1178818162 wait complete. 2024-08-31T05:42:41.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.525+0000 7f40d061d740 1 -- start start 2024-08-31T05:42:41.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.526+0000 7f40d061d740 1 Processor -- start 2024-08-31T05:42:41.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.526+0000 7f40d061d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba92fc71b0 0x55ba933a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:41.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.526+0000 7f40d061d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba92fcf390 0x55ba933a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:41.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.526+0000 7f40d061d740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba92ff0070 0x55ba933ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:41.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.526+0000 7f40d061d740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55ba9315e700 con 0x55ba92ff0070 2024-08-31T05:42:41.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.526+0000 7f40d061d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ba93282750 con 0x55ba92fc71b0 2024-08-31T05:42:41.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.526+0000 7f40d061d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ba933a3b30 con 0x55ba92fcf390 2024-08-31T05:42:41.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.526+0000 7f40d061d740 10 client.0 _ll_register_callbacks cb 0x55ba932b1e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:42:41.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.526+0000 7f40c2ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba92fcf390 0x55ba933a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:41.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.526+0000 7f40c2ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba92fcf390 0x55ba933a0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:41938/0 (socket says 172.21.15.5:41938) 2024-08-31T05:42:41.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.526+0000 7f40c2ffd640 1 -- 172.21.15.5:0/4114996949 learned_addr learned my addr 172.21.15.5:0/4114996949 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:41.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.526+0000 7f40c37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba92fc71b0 0x55ba933a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:41.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.526+0000 7f40c3fff640 1 --2- 172.21.15.5:0/4114996949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba92ff0070 0x55ba933ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:41.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.527+0000 7f40c2ffd640 1 -- 172.21.15.5:0/4114996949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba92fc71b0 msgr2=0x55ba933a0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:41.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.527+0000 7f40c2ffd640 1 --2- 172.21.15.5:0/4114996949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba92fc71b0 0x55ba933a0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:41.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.527+0000 7f40c2ffd640 1 -- 172.21.15.5:0/4114996949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba92ff0070 msgr2=0x55ba933ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:41.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.527+0000 7f40c2ffd640 1 --2- 172.21.15.5:0/4114996949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba92ff0070 0x55ba933ace20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:41.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.527+0000 7f40c2ffd640 1 -- 172.21.15.5:0/4114996949 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba932bb900 con 0x55ba92fcf390 2024-08-31T05:42:41.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.527+0000 7f40c2ffd640 1 --2- 172.21.15.5:0/4114996949 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba92fcf390 0x55ba933a0ff0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f40b80b2e50 tx=0x7f40b8009700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbb076138d71f071 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:41.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.527+0000 7f40a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:42:41.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.527+0000 7f40a2ffd640 1 -- 172.21.15.5:0/4114996949 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b80aba40 con 0x55ba92fcf390 2024-08-31T05:42:41.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.527+0000 7f40a2ffd640 1 -- 172.21.15.5:0/4114996949 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9511+0+0 (secure 0 0 0) 0x7f40b80a8520 con 0x55ba92fcf390 2024-08-31T05:42:41.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.527+0000 7f40d061d740 1 -- 172.21.15.5:0/4114996949 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40bc01cc30 con 0x55ba92fcf390 2024-08-31T05:42:41.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.527+0000 7f40a2ffd640 1 -- 172.21.15.5:0/4114996949 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f40b80abf30 con 0x55ba92fcf390 2024-08-31T05:42:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.527+0000 7f40d061d740 10 client.28552 fetch_fsmap learned FSMap version 34 2024-08-31T05:42:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.527+0000 7f40d061d740 1 -- 172.21.15.5:0/4114996949 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55ba933af930 con 0x55ba92fcf390 2024-08-31T05:42:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.527+0000 7f40a2ffd640 1 -- 172.21.15.5:0/4114996949 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40bc01cc30 con 0x55ba92fcf390 2024-08-31T05:42:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.528+0000 7f40a2ffd640 1 -- 172.21.15.5:0/4114996949 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f40b80b0300 con 0x55ba92fcf390 2024-08-31T05:42:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.528+0000 7f40d061d740 10 client.28552 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:42:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.528+0000 7f40d061d740 10 client.28552 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-31T05:42:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.528+0000 7f40d061d740 20 client.28552 populate_metadata read hostname 'smithi005' 2024-08-31T05:42:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.528+0000 7f40d061d740 1 --2- 172.21.15.5:0/4114996949 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55ba92fae9f0 0x55ba933b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.528+0000 7f40d061d740 4 client.28552 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:42:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.528+0000 7f40d061d740 1 -- 172.21.15.5:0/4114996949 --> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ba9330e5d0 con 0x55ba92fae9f0 2024-08-31T05:42:41.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.528+0000 7f40c37fe640 1 --2- 172.21.15.5:0/4114996949 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55ba92fae9f0 0x55ba933b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.529+0000 7f40c37fe640 1 --2- 172.21.15.5:0/4114996949 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55ba92fae9f0 0x55ba933b2d50 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bba151f1499311f6 server_cookie=a40b8ac3d35adc78 in_seq=0 out_seq=0 2024-08-31T05:42:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.529+0000 7f40a2ffd640 10 client.28552 ms_handle_connect on v2:172.21.15.50:6838/98200944 2024-08-31T05:42:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.529+0000 7f40a2ffd640 1 -- 172.21.15.5:0/4114996949 <== mds.1 v2:172.21.15.50:6838/98200944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ba9330e5d0 con 0x55ba92fae9f0 2024-08-31T05:42:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.529+0000 7f40a2ffd640 10 client.28552 handle_command_reply: tid=0 2024-08-31T05:42:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.529+0000 7f40d061d740 1 client.28552 shutdown 2024-08-31T05:42:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.530+0000 7f40d061d740 1 -- 172.21.15.5:0/4114996949 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba92fcf390 msgr2=0x55ba933a0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.530+0000 7f40d061d740 1 --2- 172.21.15.5:0/4114996949 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba92fcf390 0x55ba933a0ff0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f40b80b2e50 tx=0x7f40b8009700 comp rx=0 tx=0).stop 2024-08-31T05:42:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.530+0000 7f40d061d740 1 -- 172.21.15.5:0/4114996949 shutdown_connections 2024-08-31T05:42:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.530+0000 7f40d061d740 1 --2- 172.21.15.5:0/4114996949 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55ba92fae9f0 0x55ba933b2d50 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.530+0000 7f40d061d740 1 --2- 172.21.15.5:0/4114996949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba92ff0070 0x55ba933ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.530+0000 7f40d061d740 1 --2- 172.21.15.5:0/4114996949 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba92fcf390 0x55ba933a0ff0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:41.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.530+0000 7f40a2ffd640 0 client.28552 ms_handle_reset on v2:172.21.15.50:6838/98200944 2024-08-31T05:42:41.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.530+0000 7f40d061d740 1 --2- 172.21.15.5:0/4114996949 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba92fc71b0 0x55ba933a0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:41.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.530+0000 7f40d061d740 1 -- 172.21.15.5:0/4114996949 >> 172.21.15.5:0/4114996949 conn(0x55ba92fe4460 msgr2=0x55ba933984e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:41.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.530+0000 7f40d061d740 1 -- 172.21.15.5:0/4114996949 shutdown_connections 2024-08-31T05:42:41.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.530+0000 7f40d061d740 1 -- 172.21.15.5:0/4114996949 wait complete. 2024-08-31T05:42:41.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.530+0000 7f40d061d740 20 client.28552 trim_cache size 0 max 16384 2024-08-31T05:42:41.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.544+0000 7f40d061d740 1 Processor -- start 2024-08-31T05:42:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.544+0000 7f40d061d740 1 -- start start 2024-08-31T05:42:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.544+0000 7f40d061d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba92fae9f0 0x55ba93393270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.544+0000 7f40d061d740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba92fc71b0 0x55ba933acd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.544+0000 7f40d061d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba92fcf390 0x55ba9339dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.544+0000 7f40d061d740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f40c41b0db0 con 0x55ba92fc71b0 2024-08-31T05:42:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.544+0000 7f40d061d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f40c41b28f0 con 0x55ba92fae9f0 2024-08-31T05:42:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.544+0000 7f40d061d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f40c41b1480 con 0x55ba92fcf390 2024-08-31T05:42:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.544+0000 7f40c37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba92fae9f0 0x55ba93393270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.544+0000 7f40c2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba92fc71b0 0x55ba933acd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:41.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.544+0000 7f40c37fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba92fae9f0 0x55ba93393270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:54108/0 (socket says 172.21.15.5:54108) 2024-08-31T05:42:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.544+0000 7f40c3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba92fcf390 0x55ba9339dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.544+0000 7f40c37fe640 1 -- 172.21.15.5:0/4196095436 learned_addr learned my addr 172.21.15.5:0/4196095436 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.545+0000 7f40c2ffd640 1 -- 172.21.15.5:0/4196095436 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba92fcf390 msgr2=0x55ba9339dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.545+0000 7f40c2ffd640 1 --2- 172.21.15.5:0/4196095436 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba92fcf390 0x55ba9339dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.545+0000 7f40c2ffd640 1 -- 172.21.15.5:0/4196095436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba92fae9f0 msgr2=0x55ba93393270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.545+0000 7f40c2ffd640 1 --2- 172.21.15.5:0/4196095436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba92fae9f0 0x55ba93393270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.545+0000 7f40c2ffd640 1 -- 172.21.15.5:0/4196095436 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba933981b0 con 0x55ba92fc71b0 2024-08-31T05:42:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.545+0000 7f40c2ffd640 1 --2- 172.21.15.5:0/4196095436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba92fc71b0 0x55ba933acd20 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f40b80abec0 tx=0x7f40b80a83d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e275fa7a554a8fb1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.545+0000 7f40a97fa640 1 -- 172.21.15.5:0/4196095436 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b80b51a0 con 0x55ba92fc71b0 2024-08-31T05:42:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.545+0000 7f40a97fa640 1 -- 172.21.15.5:0/4196095436 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40b80b06f0 con 0x55ba92fc71b0 2024-08-31T05:42:41.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.545+0000 7f40a97fa640 1 -- 172.21.15.5:0/4196095436 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b80aae60 con 0x55ba92fc71b0 2024-08-31T05:42:41.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.547+0000 7f40d061d740 1 -- 172.21.15.5:0/4196095436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba92fc71b0 msgr2=0x55ba933acd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:41.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.547+0000 7f40d061d740 1 --2- 172.21.15.5:0/4196095436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba92fc71b0 0x55ba933acd20 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f40b80abec0 tx=0x7f40b80a83d0 comp rx=0 tx=0).stop 2024-08-31T05:42:41.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.547+0000 7f40d061d740 1 -- 172.21.15.5:0/4196095436 shutdown_connections 2024-08-31T05:42:41.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.547+0000 7f40d061d740 1 --2- 172.21.15.5:0/4196095436 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba92fcf390 0x55ba9339dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:41.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.547+0000 7f40d061d740 1 --2- 172.21.15.5:0/4196095436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba92fc71b0 0x55ba933acd20 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:41.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.547+0000 7f40d061d740 1 --2- 172.21.15.5:0/4196095436 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba92fae9f0 0x55ba93393270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:41.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.547+0000 7f40d061d740 1 -- 172.21.15.5:0/4196095436 >> 172.21.15.5:0/4196095436 conn(0x55ba92fe4460 msgr2=0x55ba93392b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:41.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.547+0000 7f40d061d740 1 -- 172.21.15.5:0/4196095436 shutdown_connections 2024-08-31T05:42:41.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.547+0000 7f40d061d740 1 -- 172.21.15.5:0/4196095436 wait complete. 2024-08-31T05:42:41.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.548+0000 7f40d061d740 1 -- start start 2024-08-31T05:42:41.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.548+0000 7f40d061d740 1 Processor -- start 2024-08-31T05:42:41.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.548+0000 7f40d061d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba92fae9f0 0x55ba933a90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:41.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.548+0000 7f40d061d740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba92fc71b0 0x55ba933a9690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:41.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.548+0000 7f40d061d740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba92fcf390 0x55ba93416f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:41.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.548+0000 7f40d061d740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f40c41b2220 con 0x55ba92fcf390 2024-08-31T05:42:41.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.548+0000 7f40d061d740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f40c41b1b50 con 0x55ba92fc71b0 2024-08-31T05:42:41.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.548+0000 7f40d061d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f40c41aedb0 con 0x55ba92fae9f0 2024-08-31T05:42:41.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.548+0000 7f40d061d740 10 client.0 _ll_register_callbacks cb 0x7f40b80ab970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:42:41.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.549+0000 7f40c37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba92fae9f0 0x55ba933a90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:41.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.549+0000 7f40c37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba92fae9f0 0x55ba933a90f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:41954/0 (socket says 172.21.15.5:41954) 2024-08-31T05:42:41.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.549+0000 7f40c37fe640 1 -- 172.21.15.5:0/20658584 learned_addr learned my addr 172.21.15.5:0/20658584 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:41.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.549+0000 7f40c2ffd640 1 --2- 172.21.15.5:0/20658584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba92fc71b0 0x55ba933a9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:41.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.549+0000 7f40c3fff640 1 --2- 172.21.15.5:0/20658584 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba92fcf390 0x55ba93416f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:41.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.549+0000 7f40c37fe640 1 -- 172.21.15.5:0/20658584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba92fc71b0 msgr2=0x55ba933a9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:41.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.549+0000 7f40c37fe640 1 --2- 172.21.15.5:0/20658584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba92fc71b0 0x55ba933a9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:41.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.549+0000 7f40c37fe640 1 -- 172.21.15.5:0/20658584 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba92fcf390 msgr2=0x55ba93416f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:41.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.549+0000 7f40c37fe640 1 --2- 172.21.15.5:0/20658584 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba92fcf390 0x55ba93416f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:41.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.549+0000 7f40c37fe640 1 -- 172.21.15.5:0/20658584 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba934176f0 con 0x55ba92fae9f0 2024-08-31T05:42:41.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.549+0000 7f40c37fe640 1 --2- 172.21.15.5:0/20658584 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba92fae9f0 0x55ba933a90f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f40b4009230 tx=0x7f40b4004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdc1e25590e03eb2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:41.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.549+0000 7f40a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:42:41.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.550+0000 7f40a2ffd640 1 -- 172.21.15.5:0/20658584 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b4035040 con 0x55ba92fae9f0 2024-08-31T05:42:41.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.550+0000 7f40a2ffd640 1 -- 172.21.15.5:0/20658584 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9511+0+0 (secure 0 0 0) 0x7f40b4005040 con 0x55ba92fae9f0 2024-08-31T05:42:41.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.550+0000 7f40d061d740 1 -- 172.21.15.5:0/20658584 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40b80b06f0 con 0x55ba92fae9f0 2024-08-31T05:42:41.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.550+0000 7f40a2ffd640 1 -- 172.21.15.5:0/20658584 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f40b4056050 con 0x55ba92fae9f0 2024-08-31T05:42:41.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.550+0000 7f40d061d740 10 client.28558 fetch_fsmap learned FSMap version 34 2024-08-31T05:42:41.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.550+0000 7f40d061d740 1 -- 172.21.15.5:0/20658584 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55ba934225a0 con 0x55ba92fae9f0 2024-08-31T05:42:41.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.550+0000 7f40a2ffd640 1 -- 172.21.15.5:0/20658584 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40b4004750 con 0x55ba92fae9f0 2024-08-31T05:42:41.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.551+0000 7f40a2ffd640 1 -- 172.21.15.5:0/20658584 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f40b40035f0 con 0x55ba92fae9f0 2024-08-31T05:42:41.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.551+0000 7f40d061d740 10 client.28558 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:42:41.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.551+0000 7f40d061d740 10 client.28558 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-31T05:42:41.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.551+0000 7f40d061d740 20 client.28558 populate_metadata read hostname 'smithi005' 2024-08-31T05:42:41.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.551+0000 7f40d061d740 1 --2- 172.21.15.5:0/20658584 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55ba92ff0070 0x55ba93424de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:41.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.551+0000 7f40d061d740 4 client.28558 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:42:41.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.551+0000 7f40d061d740 1 -- 172.21.15.5:0/20658584 --> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f40b80b06f0 con 0x55ba92ff0070 2024-08-31T05:42:41.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.551+0000 7f40c2ffd640 1 --2- 172.21.15.5:0/20658584 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55ba92ff0070 0x55ba93424de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:41.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.552+0000 7f40c2ffd640 1 --2- 172.21.15.5:0/20658584 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55ba92ff0070 0x55ba93424de0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a60f35fdc9090b4d server_cookie=8f973b336504d638 in_seq=0 out_seq=0 2024-08-31T05:42:41.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.552+0000 7f40a2ffd640 10 client.28558 ms_handle_connect on v2:172.21.15.50:6838/98200944 2024-08-31T05:42:41.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.552+0000 7f40a2ffd640 1 -- 172.21.15.5:0/20658584 <== mds.1 v2:172.21.15.50:6838/98200944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f40b80b06f0 con 0x55ba92ff0070 2024-08-31T05:42:41.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.552+0000 7f40a2ffd640 10 client.28558 handle_command_reply: tid=0 2024-08-31T05:42:41.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.552+0000 7f40d061d740 1 client.28558 shutdown 2024-08-31T05:42:41.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.552+0000 7f40d061d740 1 -- 172.21.15.5:0/20658584 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba92fae9f0 msgr2=0x55ba933a90f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:41.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.552+0000 7f40d061d740 1 --2- 172.21.15.5:0/20658584 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba92fae9f0 0x55ba933a90f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f40b4009230 tx=0x7f40b4004040 comp rx=0 tx=0).stop 2024-08-31T05:42:41.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.553+0000 7f40d061d740 1 -- 172.21.15.5:0/20658584 shutdown_connections 2024-08-31T05:42:41.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.553+0000 7f40d061d740 1 --2- 172.21.15.5:0/20658584 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55ba92ff0070 0x55ba93424de0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:41.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.553+0000 7f40d061d740 1 --2- 172.21.15.5:0/20658584 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ba92fcf390 0x55ba93416f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:41.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.553+0000 7f40a2ffd640 0 client.28558 ms_handle_reset on v2:172.21.15.50:6838/98200944 2024-08-31T05:42:41.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.553+0000 7f40d061d740 1 --2- 172.21.15.5:0/20658584 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ba92fc71b0 0x55ba933a9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:41.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.553+0000 7f40d061d740 1 --2- 172.21.15.5:0/20658584 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba92fae9f0 0x55ba933a90f0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:41.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.553+0000 7f40d061d740 1 -- 172.21.15.5:0/20658584 >> 172.21.15.5:0/20658584 conn(0x55ba92fe4460 msgr2=0x55ba933962a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:41.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.553+0000 7f40d061d740 1 -- 172.21.15.5:0/20658584 shutdown_connections 2024-08-31T05:42:41.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.553+0000 7f40d061d740 1 -- 172.21.15.5:0/20658584 wait complete. 2024-08-31T05:42:41.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.553+0000 7f40d061d740 20 client.28558 trim_cache size 0 max 16384 2024-08-31T05:42:41.560 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:42:41.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.554+0000 7f40ca0a8640 1 -- 172.21.15.5:0/3607787626 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f40ac0b4d20 msgr2=0x7f40ac0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:41.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.554+0000 7f40ca0a8640 1 --2- 172.21.15.5:0/3607787626 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f40ac0b4d20 0x7f40ac0b7230 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f40bc023000 tx=0x7f40bc024000 comp rx=0 tx=0).stop 2024-08-31T05:42:41.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.554+0000 7f40ca0a8640 1 -- 172.21.15.5:0/3607787626 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40c41050a0 msgr2=0x7f40c419a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:41.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.554+0000 7f40ca0a8640 1 --2- 172.21.15.5:0/3607787626 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40c41050a0 0x7f40c419a840 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f40c406aad0 tx=0x7f40b800ee50 comp rx=0 tx=0).stop 2024-08-31T05:42:41.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.554+0000 7f40ca0a8640 1 -- 172.21.15.5:0/3607787626 shutdown_connections 2024-08-31T05:42:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.554+0000 7f40ca0a8640 1 --2- 172.21.15.5:0/3607787626 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f40ac0b4d20 0x7f40ac0b7230 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.554+0000 7f40ca0a8640 1 --2- 172.21.15.5:0/3607787626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40c410dbb0 0x7f40c419fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.554+0000 7f40ca0a8640 1 --2- 172.21.15.5:0/3607787626 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40c41050a0 0x7f40c419a840 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.554+0000 7f40ca0a8640 1 --2- 172.21.15.5:0/3607787626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f40c4104750 0x7f40c419a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.554+0000 7f40ca0a8640 1 -- 172.21.15.5:0/3607787626 >> 172.21.15.5:0/3607787626 conn(0x7f40c40794d0 msgr2=0x7f40c40ff4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.554+0000 7f40ca0a8640 1 -- 172.21.15.5:0/3607787626 shutdown_connections 2024-08-31T05:42:41.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:41.554+0000 7f40ca0a8640 1 -- 172.21.15.5:0/3607787626 wait complete. 2024-08-31T05:42:41.942 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1428685 10.76 MB/sec execute 569 sec latency 16.334 ms 2024-08-31T05:42:42.468 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T05:42:42.731 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:42:42.942 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1430664 10.75 MB/sec execute 570 sec latency 19.090 ms 2024-08-31T05:42:43.211 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:42:43 smithi005 ceph-mon[18602]: pgmap v739: 129 pgs: 129 active+clean; 578 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.9 MiB/s wr, 212 op/s 2024-08-31T05:42:43.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.313+0000 7fc08b3e9640 1 -- 172.21.15.5:0/276465985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc084104790 msgr2=0x7fc084104ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:43.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.313+0000 7fc08b3e9640 1 --2- 172.21.15.5:0/276465985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc084104790 0x7fc084104ba0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc080009860 tx=0x7fc08002a340 comp rx=0 tx=0).stop 2024-08-31T05:42:43.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.313+0000 7fc08b3e9640 1 -- 172.21.15.5:0/276465985 shutdown_connections 2024-08-31T05:42:43.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.313+0000 7fc08b3e9640 1 --2- 172.21.15.5:0/276465985 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc08410dbf0 0x7fc0841100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:43.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.313+0000 7fc08b3e9640 1 --2- 172.21.15.5:0/276465985 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0841050e0 0x7fc08410d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:43.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.313+0000 7fc08b3e9640 1 --2- 172.21.15.5:0/276465985 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc084104790 0x7fc084104ba0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:43.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.313+0000 7fc08b3e9640 1 -- 172.21.15.5:0/276465985 >> 172.21.15.5:0/276465985 conn(0x7fc084079580 msgr2=0x7fc084079990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:43.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.313+0000 7fc08b3e9640 1 -- 172.21.15.5:0/276465985 shutdown_connections 2024-08-31T05:42:43.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.313+0000 7fc08b3e9640 1 -- 172.21.15.5:0/276465985 wait complete. 2024-08-31T05:42:43.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.314+0000 7fc08b3e9640 1 Processor -- start 2024-08-31T05:42:43.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.314+0000 7fc08b3e9640 1 -- start start 2024-08-31T05:42:43.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.314+0000 7fc08b3e9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc084104790 0x7fc08419a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:43.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.314+0000 7fc08b3e9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0841050e0 0x7fc08419a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:43.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.314+0000 7fc08b3e9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc08410dbf0 0x7fc08419fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:43.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.314+0000 7fc08b3e9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc084113850 con 0x7fc0841050e0 2024-08-31T05:42:43.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.314+0000 7fc08b3e9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc0841136d0 con 0x7fc084104790 2024-08-31T05:42:43.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.314+0000 7fc08b3e9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc0841139d0 con 0x7fc08410dbf0 2024-08-31T05:42:43.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.314+0000 7fc088984640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0841050e0 0x7fc08419a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:43.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.314+0000 7fc089986640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc08410dbf0 0x7fc08419fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:43.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.314+0000 7fc089986640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc08410dbf0 0x7fc08419fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:58446/0 (socket says 172.21.15.5:58446) 2024-08-31T05:42:43.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.314+0000 7fc089986640 1 -- 172.21.15.5:0/1823263098 learned_addr learned my addr 172.21.15.5:0/1823263098 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:43.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.314+0000 7fc089185640 1 --2- 172.21.15.5:0/1823263098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc084104790 0x7fc08419a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:43.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.314+0000 7fc089986640 1 -- 172.21.15.5:0/1823263098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc084104790 msgr2=0x7fc08419a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:43.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.314+0000 7fc089986640 1 --2- 172.21.15.5:0/1823263098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc084104790 0x7fc08419a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:43.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.314+0000 7fc089986640 1 -- 172.21.15.5:0/1823263098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0841050e0 msgr2=0x7fc08419a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:43.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.314+0000 7fc089986640 1 --2- 172.21.15.5:0/1823263098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0841050e0 0x7fc08419a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:43.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.314+0000 7fc089986640 1 -- 172.21.15.5:0/1823263098 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0841a0250 con 0x7fc08410dbf0 2024-08-31T05:42:43.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.315+0000 7fc089986640 1 --2- 172.21.15.5:0/1823263098 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc08410dbf0 0x7fc08419fb20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc07c00eb10 tx=0x7fc07c00c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:43.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.315+0000 7fc07a7fc640 1 -- 172.21.15.5:0/1823263098 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc07c004b20 con 0x7fc08410dbf0 2024-08-31T05:42:43.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.315+0000 7fc07a7fc640 1 -- 172.21.15.5:0/1823263098 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc07c004cc0 con 0x7fc08410dbf0 2024-08-31T05:42:43.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.315+0000 7fc07a7fc640 1 -- 172.21.15.5:0/1823263098 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc07c010670 con 0x7fc08410dbf0 2024-08-31T05:42:43.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.315+0000 7fc08b3e9640 1 -- 172.21.15.5:0/1823263098 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0841a0540 con 0x7fc08410dbf0 2024-08-31T05:42:43.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.315+0000 7fc08b3e9640 1 -- 172.21.15.5:0/1823263098 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0841a6ca0 con 0x7fc08410dbf0 2024-08-31T05:42:43.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.318+0000 7fc07a7fc640 1 -- 172.21.15.5:0/1823263098 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fc07c005020 con 0x7fc08410dbf0 2024-08-31T05:42:43.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.318+0000 7fc09195e740 1 Processor -- start 2024-08-31T05:42:43.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.318+0000 7fc09195e740 1 -- start start 2024-08-31T05:42:43.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.319+0000 7fc09195e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559cce58e070 0x559cce933310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:43.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.319+0000 7fc09195e740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559cce5651b0 0x559cce933850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:43.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.319+0000 7fc09195e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559cce56d390 0x559cce933d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:43.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.319+0000 7fc09195e740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x559cce8aa680 con 0x559cce5651b0 2024-08-31T05:42:43.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.319+0000 7fc09195e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559cce899c10 con 0x559cce58e070 2024-08-31T05:42:43.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.319+0000 7fc09195e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559cce89dbc0 con 0x559cce56d390 2024-08-31T05:42:43.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.319+0000 7fc088984640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559cce58e070 0x559cce933310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:43.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.319+0000 7fc089185640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559cce5651b0 0x559cce933850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:43.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.319+0000 7fc088984640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559cce58e070 0x559cce933310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:41516/0 (socket says 172.21.15.5:41516) 2024-08-31T05:42:43.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.319+0000 7fc088984640 1 -- 172.21.15.5:0/2663600582 learned_addr learned my addr 172.21.15.5:0/2663600582 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:43.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.319+0000 7fc088984640 1 --2- 172.21.15.5:0/2663600582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559cce56d390 0x559cce933d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:43.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.319+0000 7fc07a7fc640 1 --2- 172.21.15.5:0/1823263098 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc0700b4d20 0x7fc0700b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:43.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.319+0000 7fc089986640 1 --2- 172.21.15.5:0/1823263098 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc0700b4d20 0x7fc0700b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:43.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.319+0000 7fc088984640 1 -- 172.21.15.5:0/2663600582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559cce56d390 msgr2=0x559cce933d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:43.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.319+0000 7fc088984640 1 --2- 172.21.15.5:0/2663600582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559cce56d390 0x559cce933d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:43.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.319+0000 7fc088984640 1 -- 172.21.15.5:0/2663600582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559cce5651b0 msgr2=0x559cce933850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:43.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.319+0000 7fc088984640 1 --2- 172.21.15.5:0/2663600582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559cce5651b0 0x559cce933850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:43.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.319+0000 7fc07a7fc640 1 -- 172.21.15.5:0/1823263098 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9511+0+0 (secure 0 0 0) 0x7fc07c0e5e30 con 0x7fc08410dbf0 2024-08-31T05:42:43.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.319+0000 7fc088984640 1 -- 172.21.15.5:0/2663600582 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cce5f9650 con 0x559cce58e070 2024-08-31T05:42:43.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.320+0000 7fc088984640 1 --2- 172.21.15.5:0/2663600582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559cce58e070 0x559cce933310 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc074009820 tx=0x7fc0740097b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76e6cf917af136c4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:43.323 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.320+0000 7fc06f7fe640 1 -- 172.21.15.5:0/2663600582 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc074004020 con 0x559cce58e070 2024-08-31T05:42:43.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.320+0000 7fc06f7fe640 1 -- 172.21.15.5:0/2663600582 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc0740054d0 con 0x559cce58e070 2024-08-31T05:42:43.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.320+0000 7fc06f7fe640 1 -- 172.21.15.5:0/2663600582 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc074004b60 con 0x559cce58e070 2024-08-31T05:42:43.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.320+0000 7fc089986640 1 --2- 172.21.15.5:0/1823263098 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc0700b4d20 0x7fc0700b7230 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fc07c0049d0 tx=0x7fc07c01d000 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:43.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.321+0000 7fc09195e740 1 -- 172.21.15.5:0/2663600582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559cce58e070 msgr2=0x559cce933310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:43.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.321+0000 7fc09195e740 1 --2- 172.21.15.5:0/2663600582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559cce58e070 0x559cce933310 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc074009820 tx=0x7fc0740097b0 comp rx=0 tx=0).stop 2024-08-31T05:42:43.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.321+0000 7fc09195e740 1 -- 172.21.15.5:0/2663600582 shutdown_connections 2024-08-31T05:42:43.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.321+0000 7fc09195e740 1 --2- 172.21.15.5:0/2663600582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559cce56d390 0x559cce933d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:43.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.321+0000 7fc09195e740 1 --2- 172.21.15.5:0/2663600582 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559cce5651b0 0x559cce933850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:43.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.321+0000 7fc09195e740 1 --2- 172.21.15.5:0/2663600582 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559cce58e070 0x559cce933310 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:43.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.321+0000 7fc09195e740 1 -- 172.21.15.5:0/2663600582 >> 172.21.15.5:0/2663600582 conn(0x559cce582460 msgr2=0x559cce931200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:43.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.321+0000 7fc09195e740 1 -- 172.21.15.5:0/2663600582 shutdown_connections 2024-08-31T05:42:43.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.321+0000 7fc09195e740 1 -- 172.21.15.5:0/2663600582 wait complete. 2024-08-31T05:42:43.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.321+0000 7fc09195e740 1 -- start start 2024-08-31T05:42:43.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.321+0000 7fc09195e740 1 Processor -- start 2024-08-31T05:42:43.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.322+0000 7fc09195e740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559cce5651b0 0x559cce93ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:43.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.322+0000 7fc09195e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559cce56d390 0x559cce93efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:43.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.322+0000 7fc09195e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559cce58e070 0x559cce94ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:43.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.322+0000 7fc09195e740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x559cce6fc700 con 0x559cce5651b0 2024-08-31T05:42:43.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.322+0000 7fc09195e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x559cce820750 con 0x559cce56d390 2024-08-31T05:42:43.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.322+0000 7fc09195e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559cce941af0 con 0x559cce58e070 2024-08-31T05:42:43.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.322+0000 7fc09195e740 10 client.0 _ll_register_callbacks cb 0x559cce84fe10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:42:43.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.322+0000 7fc088984640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559cce5651b0 0x559cce93ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:43.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.322+0000 7fc089185640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559cce56d390 0x559cce93efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:43.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.322+0000 7fc088984640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559cce5651b0 0x559cce93ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42188/0 (socket says 172.21.15.5:42188) 2024-08-31T05:42:43.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.322+0000 7fc089185640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559cce56d390 0x559cce93efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:41522/0 (socket says 172.21.15.5:41522) 2024-08-31T05:42:43.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.322+0000 7fc088984640 1 -- 172.21.15.5:0/4066741671 learned_addr learned my addr 172.21.15.5:0/4066741671 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:43.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.322+0000 7fc088984640 1 --2- 172.21.15.5:0/4066741671 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559cce58e070 0x559cce94ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:43.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.323+0000 7fc089185640 1 -- 172.21.15.5:0/4066741671 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559cce58e070 msgr2=0x559cce94ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:43.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.323+0000 7fc089185640 1 --2- 172.21.15.5:0/4066741671 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559cce58e070 0x559cce94ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:43.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.323+0000 7fc089185640 1 -- 172.21.15.5:0/4066741671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559cce5651b0 msgr2=0x559cce93ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:43.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.323+0000 7fc089185640 1 --2- 172.21.15.5:0/4066741671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559cce5651b0 0x559cce93ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:43.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.323+0000 7fc089185640 1 -- 172.21.15.5:0/4066741671 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559cce859900 con 0x559cce56d390 2024-08-31T05:42:43.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.323+0000 7fc088984640 1 --2- 172.21.15.5:0/4066741671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559cce5651b0 0x559cce93ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:42:43.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.323+0000 7fc089185640 1 --2- 172.21.15.5:0/4066741671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559cce56d390 0x559cce93efb0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc080035040 tx=0x7fc080005e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4be0f15a0a882672 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:43.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.323+0000 7fc06cff9640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:42:43.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.323+0000 7fc06cff9640 1 -- 172.21.15.5:0/4066741671 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc080042070 con 0x559cce56d390 2024-08-31T05:42:43.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.323+0000 7fc06cff9640 1 -- 172.21.15.5:0/4066741671 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9511+0+0 (secure 0 0 0) 0x7fc080004240 con 0x559cce56d390 2024-08-31T05:42:43.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.323+0000 7fc09195e740 1 -- 172.21.15.5:0/4066741671 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc0740054d0 con 0x559cce56d390 2024-08-31T05:42:43.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.323+0000 7fc06cff9640 1 -- 172.21.15.5:0/4066741671 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc08004e050 con 0x559cce56d390 2024-08-31T05:42:43.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.323+0000 7fc09195e740 10 client.28556 fetch_fsmap learned FSMap version 34 2024-08-31T05:42:43.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.323+0000 7fc09195e740 1 -- 172.21.15.5:0/4066741671 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x559cce94d8a0 con 0x559cce56d390 2024-08-31T05:42:43.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.324+0000 7fc06cff9640 1 -- 172.21.15.5:0/4066741671 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc0740054d0 con 0x559cce56d390 2024-08-31T05:42:43.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.324+0000 7fc06cff9640 1 -- 172.21.15.5:0/4066741671 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fc080003920 con 0x559cce56d390 2024-08-31T05:42:43.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.324+0000 7fc09195e740 10 client.28556 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:42:43.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.324+0000 7fc09195e740 10 client.28556 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:42:43.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.324+0000 7fc09195e740 20 client.28556 populate_metadata read hostname 'smithi005' 2024-08-31T05:42:43.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.324+0000 7fc09195e740 1 --2- 172.21.15.5:0/4066741671 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x559cce54c9f0 0x559cce950d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:43.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.324+0000 7fc09195e740 4 client.28556 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:42:43.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.324+0000 7fc09195e740 1 -- 172.21.15.5:0/4066741671 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559cce8ac5d0 con 0x559cce54c9f0 2024-08-31T05:42:43.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.324+0000 7fc088984640 1 --2- 172.21.15.5:0/4066741671 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x559cce54c9f0 0x559cce950d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:43.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.325+0000 7fc06cff9640 10 client.28556 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:42:43.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.325+0000 7fc088984640 1 --2- 172.21.15.5:0/4066741671 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x559cce54c9f0 0x559cce950d50 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50c5794666257b54 server_cookie=da28e8a4fee31ef6 in_seq=0 out_seq=0 2024-08-31T05:42:43.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.325+0000 7fc06cff9640 1 -- 172.21.15.5:0/4066741671 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559cce8ac5d0 con 0x559cce54c9f0 2024-08-31T05:42:43.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.325+0000 7fc06cff9640 10 client.28556 handle_command_reply: tid=0 2024-08-31T05:42:43.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.325+0000 7fc09195e740 1 client.28556 shutdown 2024-08-31T05:42:43.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.326+0000 7fc09195e740 1 -- 172.21.15.5:0/4066741671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559cce56d390 msgr2=0x559cce93efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:43.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.326+0000 7fc09195e740 1 --2- 172.21.15.5:0/4066741671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559cce56d390 0x559cce93efb0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc080035040 tx=0x7fc080005e70 comp rx=0 tx=0).stop 2024-08-31T05:42:43.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.326+0000 7fc09195e740 1 -- 172.21.15.5:0/4066741671 shutdown_connections 2024-08-31T05:42:43.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.326+0000 7fc09195e740 1 --2- 172.21.15.5:0/4066741671 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x559cce54c9f0 0x559cce950d50 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:43.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.326+0000 7fc09195e740 1 --2- 172.21.15.5:0/4066741671 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559cce58e070 0x559cce94ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:43.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.326+0000 7fc09195e740 1 --2- 172.21.15.5:0/4066741671 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559cce56d390 0x559cce93efb0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:43.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.326+0000 7fc09195e740 1 --2- 172.21.15.5:0/4066741671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559cce5651b0 0x559cce93ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:43.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.326+0000 7fc09195e740 1 -- 172.21.15.5:0/4066741671 >> 172.21.15.5:0/4066741671 conn(0x559cce582460 msgr2=0x559cce9364f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:43.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.326+0000 7fc06cff9640 0 client.28556 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:42:43.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.326+0000 7fc09195e740 1 -- 172.21.15.5:0/4066741671 shutdown_connections 2024-08-31T05:42:43.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.326+0000 7fc09195e740 1 -- 172.21.15.5:0/4066741671 wait complete. 2024-08-31T05:42:43.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.326+0000 7fc09195e740 20 client.28556 trim_cache size 0 max 16384 2024-08-31T05:42:43.338 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:42:43 smithi070 ceph-mon[22316]: pgmap v739: 129 pgs: 129 active+clean; 578 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.9 MiB/s wr, 212 op/s 2024-08-31T05:42:43.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.341+0000 7fc09195e740 1 Processor -- start 2024-08-31T05:42:43.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.341+0000 7fc09195e740 1 -- start start 2024-08-31T05:42:43.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.341+0000 7fc09195e740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559cce5651b0 0x559cce931250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:43.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.341+0000 7fc09195e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559cce56d390 0x559cce94ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:43.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.341+0000 7fc09195e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559cce58e070 0x559cce93bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:43.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.341+0000 7fc09195e740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc0841b0ce0 con 0x559cce5651b0 2024-08-31T05:42:43.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.341+0000 7fc09195e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc0841b2820 con 0x559cce56d390 2024-08-31T05:42:43.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.341+0000 7fc09195e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc0841b13b0 con 0x559cce58e070 2024-08-31T05:42:43.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.341+0000 7fc088984640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559cce5651b0 0x559cce931250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:43.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.341+0000 7fc088984640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559cce5651b0 0x559cce931250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42202/0 (socket says 172.21.15.5:42202) 2024-08-31T05:42:43.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.341+0000 7fc088984640 1 -- 172.21.15.5:0/1095727036 learned_addr learned my addr 172.21.15.5:0/1095727036 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:43.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.341+0000 7fc089185640 1 --2- 172.21.15.5:0/1095727036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559cce56d390 0x559cce94ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:43.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.341+0000 7fc088984640 1 --2- 172.21.15.5:0/1095727036 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559cce58e070 0x559cce93bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:43.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.341+0000 7fc089185640 1 -- 172.21.15.5:0/1095727036 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559cce58e070 msgr2=0x559cce93bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:43.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.341+0000 7fc089185640 1 --2- 172.21.15.5:0/1095727036 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559cce58e070 0x559cce93bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:43.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.341+0000 7fc089185640 1 -- 172.21.15.5:0/1095727036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559cce5651b0 msgr2=0x559cce931250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:43.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.341+0000 7fc089185640 1 --2- 172.21.15.5:0/1095727036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559cce5651b0 0x559cce931250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:43.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.341+0000 7fc089185640 1 -- 172.21.15.5:0/1095727036 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cce936170 con 0x559cce56d390 2024-08-31T05:42:43.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.342+0000 7fc089185640 1 --2- 172.21.15.5:0/1095727036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559cce56d390 0x559cce94ace0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc08002a930 tx=0x7fc080005f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e0a2ce463ec5534 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:43.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.342+0000 7fc06effd640 1 -- 172.21.15.5:0/1095727036 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc080042040 con 0x559cce56d390 2024-08-31T05:42:43.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.342+0000 7fc06effd640 1 -- 172.21.15.5:0/1095727036 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc080030900 con 0x559cce56d390 2024-08-31T05:42:43.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.342+0000 7fc06effd640 1 -- 172.21.15.5:0/1095727036 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc080037040 con 0x559cce56d390 2024-08-31T05:42:43.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.343+0000 7fc09195e740 1 -- 172.21.15.5:0/1095727036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559cce56d390 msgr2=0x559cce94ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:43.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.343+0000 7fc09195e740 1 --2- 172.21.15.5:0/1095727036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559cce56d390 0x559cce94ace0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc08002a930 tx=0x7fc080005f10 comp rx=0 tx=0).stop 2024-08-31T05:42:43.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.343+0000 7fc09195e740 1 -- 172.21.15.5:0/1095727036 shutdown_connections 2024-08-31T05:42:43.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.343+0000 7fc09195e740 1 --2- 172.21.15.5:0/1095727036 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559cce58e070 0x559cce93bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:43.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.343+0000 7fc09195e740 1 --2- 172.21.15.5:0/1095727036 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559cce56d390 0x559cce94ace0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:43.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.343+0000 7fc09195e740 1 --2- 172.21.15.5:0/1095727036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559cce5651b0 0x559cce931250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:43.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.343+0000 7fc09195e740 1 -- 172.21.15.5:0/1095727036 >> 172.21.15.5:0/1095727036 conn(0x559cce582460 msgr2=0x559cce930b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:43.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.343+0000 7fc09195e740 1 -- 172.21.15.5:0/1095727036 shutdown_connections 2024-08-31T05:42:43.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.343+0000 7fc09195e740 1 -- 172.21.15.5:0/1095727036 wait complete. 2024-08-31T05:42:43.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.343+0000 7fc09195e740 1 -- start start 2024-08-31T05:42:43.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.343+0000 7fc09195e740 1 Processor -- start 2024-08-31T05:42:43.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.344+0000 7fc09195e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559cce5651b0 0x559cce942df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:43.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.344+0000 7fc09195e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559cce56d390 0x559cce943330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:43.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.344+0000 7fc09195e740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559cce58e070 0x559cce943870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:43.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.344+0000 7fc09195e740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc0841b2150 con 0x559cce58e070 2024-08-31T05:42:43.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.344+0000 7fc09195e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc0841b1a80 con 0x559cce5651b0 2024-08-31T05:42:43.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.344+0000 7fc09195e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc0841aece0 con 0x559cce56d390 2024-08-31T05:42:43.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.344+0000 7fc09195e740 10 client.0 _ll_register_callbacks cb 0x7fc07c0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:42:43.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.344+0000 7fc088984640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559cce58e070 0x559cce943870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:43.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.344+0000 7fc089185640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559cce56d390 0x559cce943330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:43.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.344+0000 7fc089185640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559cce56d390 0x559cce943330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:58482/0 (socket says 172.21.15.5:58482) 2024-08-31T05:42:43.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.344+0000 7fc088984640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559cce58e070 0x559cce943870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42206/0 (socket says 172.21.15.5:42206) 2024-08-31T05:42:43.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.344+0000 7fc089185640 1 -- 172.21.15.5:0/1686529553 learned_addr learned my addr 172.21.15.5:0/1686529553 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:43.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.344+0000 7fc088984640 1 --2- 172.21.15.5:0/1686529553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559cce5651b0 0x559cce942df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:43.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.344+0000 7fc089185640 1 -- 172.21.15.5:0/1686529553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559cce5651b0 msgr2=0x559cce942df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:43.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.344+0000 7fc089185640 1 --2- 172.21.15.5:0/1686529553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559cce5651b0 0x559cce942df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:43.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.345+0000 7fc089185640 1 -- 172.21.15.5:0/1686529553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559cce58e070 msgr2=0x559cce943870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:43.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.345+0000 7fc089185640 1 --2- 172.21.15.5:0/1686529553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559cce58e070 0x559cce943870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:43.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.345+0000 7fc089185640 1 -- 172.21.15.5:0/1686529553 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559cce9ba7e0 con 0x559cce56d390 2024-08-31T05:42:43.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.345+0000 7fc088984640 1 --2- 172.21.15.5:0/1686529553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559cce58e070 0x559cce943870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:42:43.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.345+0000 7fc089185640 1 --2- 172.21.15.5:0/1686529553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559cce56d390 0x559cce943330 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc080003e40 tx=0x7fc080009720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=707e56e42afd858a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:43.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.345+0000 7fc06cff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:42:43.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.345+0000 7fc06cff9640 1 -- 172.21.15.5:0/1686529553 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc080037070 con 0x559cce56d390 2024-08-31T05:42:43.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.345+0000 7fc06cff9640 1 -- 172.21.15.5:0/1686529553 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9511+0+0 (secure 0 0 0) 0x7fc080005550 con 0x559cce56d390 2024-08-31T05:42:43.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.345+0000 7fc09195e740 1 -- 172.21.15.5:0/1686529553 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc080030900 con 0x559cce56d390 2024-08-31T05:42:43.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.345+0000 7fc06cff9640 1 -- 172.21.15.5:0/1686529553 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc080060050 con 0x559cce56d390 2024-08-31T05:42:43.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.345+0000 7fc09195e740 10 client.28576 fetch_fsmap learned FSMap version 34 2024-08-31T05:42:43.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.345+0000 7fc09195e740 1 -- 172.21.15.5:0/1686529553 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x559cce9bba60 con 0x559cce56d390 2024-08-31T05:42:43.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.345+0000 7fc06cff9640 1 -- 172.21.15.5:0/1686529553 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc080030900 con 0x559cce56d390 2024-08-31T05:42:43.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.346+0000 7fc06cff9640 1 -- 172.21.15.5:0/1686529553 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fc080003fe0 con 0x559cce56d390 2024-08-31T05:42:43.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.346+0000 7fc09195e740 10 client.28576 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:42:43.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.346+0000 7fc09195e740 10 client.28576 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:42:43.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.346+0000 7fc09195e740 20 client.28576 populate_metadata read hostname 'smithi005' 2024-08-31T05:42:43.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.346+0000 7fc09195e740 1 --2- 172.21.15.5:0/1686529553 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x559cce521da0 0x559cce9be180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:43.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.346+0000 7fc09195e740 4 client.28576 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:42:43.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.346+0000 7fc09195e740 1 -- 172.21.15.5:0/1686529553 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559cce8a8070 con 0x559cce521da0 2024-08-31T05:42:43.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.346+0000 7fc088984640 1 --2- 172.21.15.5:0/1686529553 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x559cce521da0 0x559cce9be180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:43.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.346+0000 7fc06cff9640 10 client.28576 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:42:43.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.346+0000 7fc088984640 1 --2- 172.21.15.5:0/1686529553 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x559cce521da0 0x559cce9be180 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c76f4a57995c3f7 server_cookie=9f5d2bab3e49d116 in_seq=0 out_seq=0 2024-08-31T05:42:43.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.346+0000 7fc06cff9640 1 -- 172.21.15.5:0/1686529553 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559cce8a8070 con 0x559cce521da0 2024-08-31T05:42:43.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.346+0000 7fc06cff9640 10 client.28576 handle_command_reply: tid=0 2024-08-31T05:42:43.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.347+0000 7fc09195e740 1 client.28576 shutdown 2024-08-31T05:42:43.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.347+0000 7fc09195e740 1 -- 172.21.15.5:0/1686529553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559cce56d390 msgr2=0x559cce943330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:43.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.347+0000 7fc09195e740 1 --2- 172.21.15.5:0/1686529553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559cce56d390 0x559cce943330 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc080003e40 tx=0x7fc080009720 comp rx=0 tx=0).stop 2024-08-31T05:42:43.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.347+0000 7fc09195e740 1 -- 172.21.15.5:0/1686529553 shutdown_connections 2024-08-31T05:42:43.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.347+0000 7fc09195e740 1 --2- 172.21.15.5:0/1686529553 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x559cce521da0 0x559cce9be180 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:43.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.347+0000 7fc09195e740 1 --2- 172.21.15.5:0/1686529553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x559cce58e070 0x559cce943870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:43.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.347+0000 7fc09195e740 1 --2- 172.21.15.5:0/1686529553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559cce56d390 0x559cce943330 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:43.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.347+0000 7fc09195e740 1 --2- 172.21.15.5:0/1686529553 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x559cce5651b0 0x559cce942df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:43.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.347+0000 7fc09195e740 1 -- 172.21.15.5:0/1686529553 >> 172.21.15.5:0/1686529553 conn(0x559cce582460 msgr2=0x559cce93feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:43.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.347+0000 7fc06cff9640 0 client.28576 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:42:43.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.347+0000 7fc09195e740 1 -- 172.21.15.5:0/1686529553 shutdown_connections 2024-08-31T05:42:43.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.347+0000 7fc09195e740 1 -- 172.21.15.5:0/1686529553 wait complete. 2024-08-31T05:42:43.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.347+0000 7fc09195e740 20 client.28576 trim_cache size 0 max 16384 2024-08-31T05:42:43.354 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:42:43.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.347+0000 7fc08b3e9640 1 -- 172.21.15.5:0/1823263098 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc0700b4d20 msgr2=0x7fc0700b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:43.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.347+0000 7fc08b3e9640 1 --2- 172.21.15.5:0/1823263098 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc0700b4d20 0x7fc0700b7230 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fc07c0049d0 tx=0x7fc07c01d000 comp rx=0 tx=0).stop 2024-08-31T05:42:43.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.347+0000 7fc08b3e9640 1 -- 172.21.15.5:0/1823263098 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc08410dbf0 msgr2=0x7fc08419fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:43.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.347+0000 7fc08b3e9640 1 --2- 172.21.15.5:0/1823263098 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc08410dbf0 0x7fc08419fb20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc07c00eb10 tx=0x7fc07c00c2d0 comp rx=0 tx=0).stop 2024-08-31T05:42:43.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.347+0000 7fc08b3e9640 1 -- 172.21.15.5:0/1823263098 shutdown_connections 2024-08-31T05:42:43.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.348+0000 7fc08b3e9640 1 --2- 172.21.15.5:0/1823263098 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc0700b4d20 0x7fc0700b7230 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:43.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.348+0000 7fc08b3e9640 1 --2- 172.21.15.5:0/1823263098 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc08410dbf0 0x7fc08419fb20 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:43.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.348+0000 7fc08b3e9640 1 --2- 172.21.15.5:0/1823263098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0841050e0 0x7fc08419a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:43.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.348+0000 7fc08b3e9640 1 --2- 172.21.15.5:0/1823263098 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc084104790 0x7fc08419a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:43.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.348+0000 7fc08b3e9640 1 -- 172.21.15.5:0/1823263098 >> 172.21.15.5:0/1823263098 conn(0x7fc084079580 msgr2=0x7fc084100660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:43.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.348+0000 7fc08b3e9640 1 -- 172.21.15.5:0/1823263098 shutdown_connections 2024-08-31T05:42:43.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:43.348+0000 7fc08b3e9640 1 -- 172.21.15.5:0/1823263098 wait complete. 2024-08-31T05:42:43.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:42:43 smithi050 ceph-mon[22146]: pgmap v739: 129 pgs: 129 active+clean; 578 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.9 MiB/s wr, 212 op/s 2024-08-31T05:42:43.942 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1432602 10.75 MB/sec execute 571 sec latency 33.335 ms 2024-08-31T05:42:44.942 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1434401 10.75 MB/sec execute 572 sec latency 85.094 ms 2024-08-31T05:42:45.164 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T05:42:45.165 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T05:42:45.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:42:45 smithi070 ceph-mon[22316]: pgmap v740: 129 pgs: 129 active+clean; 578 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.3 MiB/s wr, 184 op/s 2024-08-31T05:42:45.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:42:45 smithi050 ceph-mon[22146]: pgmap v740: 129 pgs: 129 active+clean; 578 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.3 MiB/s wr, 184 op/s 2024-08-31T05:42:45.427 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:42:45.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:42:45 smithi005 ceph-mon[18602]: pgmap v740: 129 pgs: 129 active+clean; 578 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.3 MiB/s wr, 184 op/s 2024-08-31T05:42:45.942 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1436093 10.75 MB/sec execute 573 sec latency 55.738 ms 2024-08-31T05:42:46.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.042+0000 7fea45bd9640 1 -- 172.21.15.5:0/2574723439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea40101900 msgr2=0x7fea40101d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:46.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.042+0000 7fea45bd9640 1 --2- 172.21.15.5:0/2574723439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea40101900 0x7fea40101d10 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fea30009ca0 tx=0x7fea3002a8b0 comp rx=0 tx=0).stop 2024-08-31T05:42:46.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.042+0000 7fea45bd9640 1 -- 172.21.15.5:0/2574723439 shutdown_connections 2024-08-31T05:42:46.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.042+0000 7fea45bd9640 1 --2- 172.21.15.5:0/2574723439 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea40107680 0x7fea40112770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:46.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.042+0000 7fea45bd9640 1 --2- 172.21.15.5:0/2574723439 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea40102250 0x7fea40107030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:46.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.042+0000 7fea45bd9640 1 --2- 172.21.15.5:0/2574723439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea40101900 0x7fea40101d10 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:46.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.042+0000 7fea45bd9640 1 -- 172.21.15.5:0/2574723439 >> 172.21.15.5:0/2574723439 conn(0x7fea400775a0 msgr2=0x7fea400779e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:46.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.043+0000 7fea45bd9640 1 -- 172.21.15.5:0/2574723439 shutdown_connections 2024-08-31T05:42:46.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.043+0000 7fea45bd9640 1 -- 172.21.15.5:0/2574723439 wait complete. 2024-08-31T05:42:46.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.044+0000 7fea45bd9640 1 Processor -- start 2024-08-31T05:42:46.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.044+0000 7fea45bd9640 1 -- start start 2024-08-31T05:42:46.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.044+0000 7fea45bd9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea40101900 0x7fea401121f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:46.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.044+0000 7fea45bd9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea40102250 0x7fea4010f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:46.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.044+0000 7fea45bd9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea40107680 0x7fea4010fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:46.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.044+0000 7fea45bd9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fea40115a70 con 0x7fea40107680 2024-08-31T05:42:46.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.044+0000 7fea45bd9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fea401158f0 con 0x7fea40102250 2024-08-31T05:42:46.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.044+0000 7fea45bd9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fea40115bf0 con 0x7fea40101900 2024-08-31T05:42:46.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.044+0000 7fea3f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea40101900 0x7fea401121f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:46.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.045+0000 7fea3f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea40101900 0x7fea401121f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:58508/0 (socket says 172.21.15.5:58508) 2024-08-31T05:42:46.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.045+0000 7fea3f7fe640 1 -- 172.21.15.5:0/2384188901 learned_addr learned my addr 172.21.15.5:0/2384188901 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:46.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.045+0000 7fea36ffd640 1 --2- 172.21.15.5:0/2384188901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea40102250 0x7fea4010f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:46.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.045+0000 7fea3f7fe640 1 -- 172.21.15.5:0/2384188901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea40102250 msgr2=0x7fea4010f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:46.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.045+0000 7fea3f7fe640 1 --2- 172.21.15.5:0/2384188901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea40102250 0x7fea4010f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:46.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.045+0000 7fea3f7fe640 1 -- 172.21.15.5:0/2384188901 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea40107680 msgr2=0x7fea4010fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:46.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.045+0000 7fea3f7fe640 1 --2- 172.21.15.5:0/2384188901 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea40107680 0x7fea4010fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:46.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.045+0000 7fea3f7fe640 1 -- 172.21.15.5:0/2384188901 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea401a1f70 con 0x7fea40101900 2024-08-31T05:42:46.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.045+0000 7fea3f7fe640 1 --2- 172.21.15.5:0/2384188901 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea40101900 0x7fea401121f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fea3002aea0 tx=0x7fea30003ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:46.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.046+0000 7fea3d7fa640 1 -- 172.21.15.5:0/2384188901 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea30004240 con 0x7fea40101900 2024-08-31T05:42:46.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.046+0000 7fea3d7fa640 1 -- 172.21.15.5:0/2384188901 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea30062070 con 0x7fea40101900 2024-08-31T05:42:46.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.047+0000 7fea45bd9640 1 -- 172.21.15.5:0/2384188901 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea401a21a0 con 0x7fea40101900 2024-08-31T05:42:46.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.046+0000 7fea3d7fa640 1 -- 172.21.15.5:0/2384188901 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea30067e00 con 0x7fea40101900 2024-08-31T05:42:46.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.047+0000 7fea45bd9640 1 -- 172.21.15.5:0/2384188901 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea401a2700 con 0x7fea40101900 2024-08-31T05:42:46.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.050+0000 7fea4c14e740 1 Processor -- start 2024-08-31T05:42:46.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.051+0000 7fea4c14e740 1 -- start start 2024-08-31T05:42:46.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.051+0000 7fea4c14e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56547e018350 0x56547e3be780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:46.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.051+0000 7fea4c14e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56547dfef490 0x56547e3becc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:46.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.051+0000 7fea4c14e740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56547dff7670 0x56547e3bf200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:46.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.051+0000 7fea4c14e740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56547e3345f0 con 0x56547dff7670 2024-08-31T05:42:46.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.051+0000 7fea4c14e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56547e323b80 con 0x56547e018350 2024-08-31T05:42:46.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.051+0000 7fea4c14e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56547e327b30 con 0x56547dfef490 2024-08-31T05:42:46.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.052+0000 7fea36ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56547dff7670 0x56547e3bf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:46.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.052+0000 7fea36ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56547dff7670 0x56547e3bf200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42222/0 (socket says 172.21.15.5:42222) 2024-08-31T05:42:46.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.052+0000 7fea36ffd640 1 -- 172.21.15.5:0/1977380075 learned_addr learned my addr 172.21.15.5:0/1977380075 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:46.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.052+0000 7fea3d7fa640 1 -- 172.21.15.5:0/2384188901 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fea30067500 con 0x7fea40101900 2024-08-31T05:42:46.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.052+0000 7fea3ffff640 1 --2- 172.21.15.5:0/1977380075 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56547e018350 0x56547e3be780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:46.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.052+0000 7fea36ffd640 1 -- 172.21.15.5:0/1977380075 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56547dfef490 msgr2=0x56547e3becc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:46.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.052+0000 7fea3f7fe640 1 --2- 172.21.15.5:0/1977380075 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56547dfef490 0x56547e3becc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:46.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.053+0000 7fea36ffd640 1 --2- 172.21.15.5:0/1977380075 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56547dfef490 0x56547e3becc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:46.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.053+0000 7fea36ffd640 1 -- 172.21.15.5:0/1977380075 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56547e018350 msgr2=0x56547e3be780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:46.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.053+0000 7fea36ffd640 1 --2- 172.21.15.5:0/1977380075 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56547e018350 0x56547e3be780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:46.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.053+0000 7fea36ffd640 1 -- 172.21.15.5:0/1977380075 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56547e083930 con 0x56547dff7670 2024-08-31T05:42:46.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.053+0000 7fea3f7fe640 1 --2- 172.21.15.5:0/1977380075 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56547dfef490 0x56547e3becc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:42:46.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.053+0000 7fea36ffd640 1 --2- 172.21.15.5:0/1977380075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56547dff7670 0x56547e3bf200 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fea28009c20 tx=0x7fea28011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5afbe6cbb3ec7ee5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:46.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.053+0000 7fea3d7fa640 1 --2- 172.21.15.5:0/2384188901 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fea2c0b4d50 0x7fea2c0b7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:46.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.054+0000 7fea35ffb640 1 -- 172.21.15.5:0/1977380075 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea28004230 con 0x56547dff7670 2024-08-31T05:42:46.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.054+0000 7fea3d7fa640 1 -- 172.21.15.5:0/2384188901 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9511+0+0 (secure 0 0 0) 0x7fea30128bf0 con 0x7fea40101900 2024-08-31T05:42:46.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.054+0000 7fea35ffb640 1 -- 172.21.15.5:0/1977380075 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea280043d0 con 0x56547dff7670 2024-08-31T05:42:46.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.054+0000 7fea35ffb640 1 -- 172.21.15.5:0/1977380075 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea28004d50 con 0x56547dff7670 2024-08-31T05:42:46.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.054+0000 7fea3ffff640 1 --2- 172.21.15.5:0/2384188901 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fea2c0b4d50 0x7fea2c0b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:46.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.055+0000 7fea3ffff640 1 --2- 172.21.15.5:0/2384188901 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fea2c0b4d50 0x7fea2c0b7260 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fea38005fd0 tx=0x7fea38005cc0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:46.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.055+0000 7fea4c14e740 1 -- 172.21.15.5:0/1977380075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56547dff7670 msgr2=0x56547e3bf200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:46.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.055+0000 7fea4c14e740 1 --2- 172.21.15.5:0/1977380075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56547dff7670 0x56547e3bf200 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fea28009c20 tx=0x7fea28011810 comp rx=0 tx=0).stop 2024-08-31T05:42:46.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.055+0000 7fea4c14e740 1 -- 172.21.15.5:0/1977380075 shutdown_connections 2024-08-31T05:42:46.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.055+0000 7fea4c14e740 1 --2- 172.21.15.5:0/1977380075 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56547dff7670 0x56547e3bf200 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:46.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.055+0000 7fea4c14e740 1 --2- 172.21.15.5:0/1977380075 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56547dfef490 0x56547e3becc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:46.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.055+0000 7fea4c14e740 1 --2- 172.21.15.5:0/1977380075 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56547e018350 0x56547e3be780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:46.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.055+0000 7fea4c14e740 1 -- 172.21.15.5:0/1977380075 >> 172.21.15.5:0/1977380075 conn(0x56547e00c740 msgr2=0x56547e3bc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:46.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.055+0000 7fea4c14e740 1 -- 172.21.15.5:0/1977380075 shutdown_connections 2024-08-31T05:42:46.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.055+0000 7fea4c14e740 1 -- 172.21.15.5:0/1977380075 wait complete. 2024-08-31T05:42:46.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.055+0000 7fea4c14e740 1 -- start start 2024-08-31T05:42:46.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.056+0000 7fea4c14e740 1 Processor -- start 2024-08-31T05:42:46.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.056+0000 7fea4c14e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56547dfef490 0x56547e3c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:46.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.056+0000 7fea4c14e740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56547dff7670 0x56547e3ca430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:46.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.056+0000 7fea4c14e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56547e018350 0x56547e3d6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:46.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.056+0000 7fea4c14e740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56547e186890 con 0x56547dff7670 2024-08-31T05:42:46.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.056+0000 7fea4c14e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56547e2aa790 con 0x56547dfef490 2024-08-31T05:42:46.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.056+0000 7fea4c14e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56547e3ccf60 con 0x56547e018350 2024-08-31T05:42:46.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.056+0000 7fea4c14e740 10 client.0 _ll_register_callbacks cb 0x56547e02fba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:42:46.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.057+0000 7fea3f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56547dfef490 0x56547e3c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:46.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.057+0000 7fea36ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56547dff7670 0x56547e3ca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:46.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.057+0000 7fea36ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56547dff7670 0x56547e3ca430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42234/0 (socket says 172.21.15.5:42234) 2024-08-31T05:42:46.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.057+0000 7fea36ffd640 1 -- 172.21.15.5:0/774716375 learned_addr learned my addr 172.21.15.5:0/774716375 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:46.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.057+0000 7fea36ffd640 1 -- 172.21.15.5:0/774716375 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56547e018350 msgr2=0x56547e3d6280 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T05:42:46.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.057+0000 7fea36ffd640 1 --2- 172.21.15.5:0/774716375 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56547e018350 0x56547e3d6280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:46.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.057+0000 7fea36ffd640 1 -- 172.21.15.5:0/774716375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56547dfef490 msgr2=0x56547e3c9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:46.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.057+0000 7fea36ffd640 1 --2- 172.21.15.5:0/774716375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56547dfef490 0x56547e3c9ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:46.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.057+0000 7fea36ffd640 1 -- 172.21.15.5:0/774716375 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56547e2e1f30 con 0x56547dff7670 2024-08-31T05:42:46.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.058+0000 7fea36ffd640 1 --2- 172.21.15.5:0/774716375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56547dff7670 0x56547e3ca430 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fea28019bb0 tx=0x7fea28019be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c17b6ba415ead11 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:46.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.058+0000 7fea1effd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:42:46.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.058+0000 7fea1effd640 1 -- 172.21.15.5:0/774716375 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea28028020 con 0x56547dff7670 2024-08-31T05:42:46.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.058+0000 7fea1effd640 1 -- 172.21.15.5:0/774716375 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9511+0+0 (secure 0 0 0) 0x7fea28024620 con 0x56547dff7670 2024-08-31T05:42:46.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.059+0000 7fea4c14e740 1 -- 172.21.15.5:0/774716375 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea280043d0 con 0x56547dff7670 2024-08-31T05:42:46.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.059+0000 7fea1effd640 1 -- 172.21.15.5:0/774716375 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fea28009e90 con 0x56547dff7670 2024-08-31T05:42:46.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.060+0000 7fea4c14e740 10 client.19005 fetch_fsmap learned FSMap version 34 2024-08-31T05:42:46.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.060+0000 7fea4c14e740 1 -- 172.21.15.5:0/774716375 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56547e3d8cd0 con 0x56547dff7670 2024-08-31T05:42:46.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.060+0000 7fea1effd640 1 -- 172.21.15.5:0/774716375 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea280043d0 con 0x56547dff7670 2024-08-31T05:42:46.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.060+0000 7fea1effd640 1 -- 172.21.15.5:0/774716375 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fea28018070 con 0x56547dff7670 2024-08-31T05:42:46.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.060+0000 7fea4c14e740 10 client.19005 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:42:46.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.060+0000 7fea4c14e740 10 client.19005 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:42:46.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.060+0000 7fea4c14e740 20 client.19005 populate_metadata read hostname 'smithi005' 2024-08-31T05:42:46.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.060+0000 7fea4c14e740 1 --2- 172.21.15.5:0/774716375 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56547dfd6cd0 0x56547e3dc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:46.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.060+0000 7fea4c14e740 4 client.19005 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:42:46.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.060+0000 7fea4c14e740 1 -- 172.21.15.5:0/774716375 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56547e336540 con 0x56547dfd6cd0 2024-08-31T05:42:46.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.061+0000 7fea3f7fe640 1 --2- 172.21.15.5:0/774716375 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56547dfd6cd0 0x56547e3dc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:46.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.061+0000 7fea1effd640 10 client.19005 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:42:46.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.061+0000 7fea3f7fe640 1 --2- 172.21.15.5:0/774716375 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56547dfd6cd0 0x56547e3dc090 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4259798df71217b4 server_cookie=c1d72a7ca2f354cf in_seq=0 out_seq=0 2024-08-31T05:42:46.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.062+0000 7fea1effd640 1 -- 172.21.15.5:0/774716375 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56547e336540 con 0x56547dfd6cd0 2024-08-31T05:42:46.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.062+0000 7fea1effd640 10 client.19005 handle_command_reply: tid=0 2024-08-31T05:42:46.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.062+0000 7fea4c14e740 1 client.19005 shutdown 2024-08-31T05:42:46.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.062+0000 7fea4c14e740 1 -- 172.21.15.5:0/774716375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56547dff7670 msgr2=0x56547e3ca430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:46.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.062+0000 7fea4c14e740 1 --2- 172.21.15.5:0/774716375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56547dff7670 0x56547e3ca430 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fea28019bb0 tx=0x7fea28019be0 comp rx=0 tx=0).stop 2024-08-31T05:42:46.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.063+0000 7fea4c14e740 1 -- 172.21.15.5:0/774716375 shutdown_connections 2024-08-31T05:42:46.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.063+0000 7fea4c14e740 1 --2- 172.21.15.5:0/774716375 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56547dfd6cd0 0x56547e3dc090 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:46.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.063+0000 7fea4c14e740 1 --2- 172.21.15.5:0/774716375 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56547e018350 0x56547e3d6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:46.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.063+0000 7fea4c14e740 1 --2- 172.21.15.5:0/774716375 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56547dff7670 0x56547e3ca430 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:46.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.063+0000 7fea4c14e740 1 --2- 172.21.15.5:0/774716375 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56547dfef490 0x56547e3c9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:46.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.063+0000 7fea4c14e740 1 -- 172.21.15.5:0/774716375 >> 172.21.15.5:0/774716375 conn(0x56547e00c740 msgr2=0x56547e3c1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:46.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.063+0000 7fea1effd640 0 client.19005 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:42:46.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.063+0000 7fea4c14e740 1 -- 172.21.15.5:0/774716375 shutdown_connections 2024-08-31T05:42:46.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.064+0000 7fea4c14e740 1 -- 172.21.15.5:0/774716375 wait complete. 2024-08-31T05:42:46.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.064+0000 7fea4c14e740 20 client.19005 trim_cache size 0 max 16384 2024-08-31T05:42:46.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.098+0000 7fea4c14e740 1 Processor -- start 2024-08-31T05:42:46.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.098+0000 7fea4c14e740 1 -- start start 2024-08-31T05:42:46.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.099+0000 7fea4c14e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56547dfef490 0x56547e3cbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:46.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.099+0000 7fea4c14e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56547dff7670 0x56547e3d6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:46.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.099+0000 7fea4c14e740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56547e018350 0x56547e3c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:46.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.099+0000 7fea4c14e740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fea4006e8b0 con 0x56547e018350 2024-08-31T05:42:46.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.099+0000 7fea4c14e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fea400703f0 con 0x56547dfef490 2024-08-31T05:42:46.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.099+0000 7fea4c14e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fea4006ef80 con 0x56547dff7670 2024-08-31T05:42:46.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.099+0000 7fea3ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56547e018350 0x56547e3c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:46.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.099+0000 7fea3ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56547e018350 0x56547e3c8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42236/0 (socket says 172.21.15.5:42236) 2024-08-31T05:42:46.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.099+0000 7fea3ffff640 1 -- 172.21.15.5:0/2766857468 learned_addr learned my addr 172.21.15.5:0/2766857468 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:46.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.100+0000 7fea36ffd640 1 --2- 172.21.15.5:0/2766857468 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56547dff7670 0x56547e3d6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:46.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.100+0000 7fea3f7fe640 1 --2- 172.21.15.5:0/2766857468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56547dfef490 0x56547e3cbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:46.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.100+0000 7fea3ffff640 1 -- 172.21.15.5:0/2766857468 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56547dff7670 msgr2=0x56547e3d6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:46.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.100+0000 7fea3ffff640 1 --2- 172.21.15.5:0/2766857468 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56547dff7670 0x56547e3d6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:46.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.100+0000 7fea3ffff640 1 -- 172.21.15.5:0/2766857468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56547dfef490 msgr2=0x56547e3cbdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:46.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.100+0000 7fea3ffff640 1 --2- 172.21.15.5:0/2766857468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56547dfef490 0x56547e3cbdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:46.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.100+0000 7fea3ffff640 1 -- 172.21.15.5:0/2766857468 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56547dfd6f00 con 0x56547e018350 2024-08-31T05:42:46.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.100+0000 7fea3ffff640 1 --2- 172.21.15.5:0/2766857468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56547e018350 0x56547e3c8e80 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fea3800b550 tx=0x7fea38012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=831c225e4bba5b33 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:46.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.103+0000 7fea357fa640 1 -- 172.21.15.5:0/2766857468 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea38022070 con 0x56547e018350 2024-08-31T05:42:46.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.104+0000 7fea357fa640 1 -- 172.21.15.5:0/2766857468 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea3801e900 con 0x56547e018350 2024-08-31T05:42:46.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.104+0000 7fea357fa640 1 -- 172.21.15.5:0/2766857468 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea380108b0 con 0x56547e018350 2024-08-31T05:42:46.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.107+0000 7fea4c14e740 1 -- 172.21.15.5:0/2766857468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56547e018350 msgr2=0x56547e3c8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:46.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.107+0000 7fea4c14e740 1 --2- 172.21.15.5:0/2766857468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56547e018350 0x56547e3c8e80 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fea3800b550 tx=0x7fea38012000 comp rx=0 tx=0).stop 2024-08-31T05:42:46.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.107+0000 7fea4c14e740 1 -- 172.21.15.5:0/2766857468 shutdown_connections 2024-08-31T05:42:46.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.107+0000 7fea4c14e740 1 --2- 172.21.15.5:0/2766857468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56547e018350 0x56547e3c8e80 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:46.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.107+0000 7fea4c14e740 1 --2- 172.21.15.5:0/2766857468 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56547dff7670 0x56547e3d6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:46.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.107+0000 7fea4c14e740 1 --2- 172.21.15.5:0/2766857468 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56547dfef490 0x56547e3cbdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:46.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.107+0000 7fea4c14e740 1 -- 172.21.15.5:0/2766857468 >> 172.21.15.5:0/2766857468 conn(0x56547e00c740 msgr2=0x56547e3c8770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:46.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.108+0000 7fea4c14e740 1 -- 172.21.15.5:0/2766857468 shutdown_connections 2024-08-31T05:42:46.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.108+0000 7fea4c14e740 1 -- 172.21.15.5:0/2766857468 wait complete. 2024-08-31T05:42:46.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.109+0000 7fea4c14e740 1 -- start start 2024-08-31T05:42:46.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.109+0000 7fea4c14e740 1 Processor -- start 2024-08-31T05:42:46.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.110+0000 7fea4c14e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56547dfef490 0x56547e3ce2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:46.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.110+0000 7fea4c14e740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56547dff7670 0x56547e3ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:46.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.110+0000 7fea4c14e740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56547e018350 0x56547e3ced20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:46.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.110+0000 7fea4c14e740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fea4006fd20 con 0x56547e018350 2024-08-31T05:42:46.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.110+0000 7fea4c14e740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fea4006f650 con 0x56547dff7670 2024-08-31T05:42:46.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.110+0000 7fea4c14e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fea401107e0 con 0x56547dfef490 2024-08-31T05:42:46.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.110+0000 7fea4c14e740 10 client.0 _ll_register_callbacks cb 0x7fea28009a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:42:46.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.111+0000 7fea3f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56547dfef490 0x56547e3ce2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:46.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.111+0000 7fea3ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56547e018350 0x56547e3ced20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:46.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.111+0000 7fea3ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56547e018350 0x56547e3ced20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42244/0 (socket says 172.21.15.5:42244) 2024-08-31T05:42:46.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.111+0000 7fea3ffff640 1 -- 172.21.15.5:0/3287864608 learned_addr learned my addr 172.21.15.5:0/3287864608 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:46.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.111+0000 7fea3ffff640 1 -- 172.21.15.5:0/3287864608 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56547dfef490 msgr2=0x56547e3ce2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:46.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.111+0000 7fea3ffff640 1 --2- 172.21.15.5:0/3287864608 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56547dfef490 0x56547e3ce2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:46.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.111+0000 7fea3ffff640 1 -- 172.21.15.5:0/3287864608 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56547dff7670 msgr2=0x56547e3ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:46.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.111+0000 7fea3ffff640 1 --2- 172.21.15.5:0/3287864608 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56547dff7670 0x56547e3ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:46.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.111+0000 7fea3ffff640 1 -- 172.21.15.5:0/3287864608 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56547e4459f0 con 0x56547e018350 2024-08-31T05:42:46.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.112+0000 7fea3ffff640 1 --2- 172.21.15.5:0/3287864608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56547e018350 0x56547e3ced20 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fea3800b520 tx=0x7fea380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeba0722b36f77e3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:46.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.112+0000 7fea1effd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:42:46.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.112+0000 7fea1effd640 1 -- 172.21.15.5:0/3287864608 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea38022050 con 0x56547e018350 2024-08-31T05:42:46.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.112+0000 7fea1effd640 1 -- 172.21.15.5:0/3287864608 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9511+0+0 (secure 0 0 0) 0x7fea3800fdf0 con 0x56547e018350 2024-08-31T05:42:46.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.112+0000 7fea4c14e740 1 -- 172.21.15.5:0/3287864608 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea3801e900 con 0x56547e018350 2024-08-31T05:42:46.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.113+0000 7fea1effd640 1 -- 172.21.15.5:0/3287864608 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fea3801e730 con 0x56547e018350 2024-08-31T05:42:46.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.113+0000 7fea4c14e740 10 client.19011 fetch_fsmap learned FSMap version 34 2024-08-31T05:42:46.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.113+0000 7fea4c14e740 1 -- 172.21.15.5:0/3287864608 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56547e446c90 con 0x56547e018350 2024-08-31T05:42:46.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.115+0000 7fea1effd640 1 -- 172.21.15.5:0/3287864608 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea38004230 con 0x56547e018350 2024-08-31T05:42:46.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.116+0000 7fea1effd640 1 -- 172.21.15.5:0/3287864608 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fea38010510 con 0x56547e018350 2024-08-31T05:42:46.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.116+0000 7fea4c14e740 10 client.19011 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:42:46.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.116+0000 7fea4c14e740 10 client.19011 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:42:46.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.116+0000 7fea4c14e740 20 client.19011 populate_metadata read hostname 'smithi005' 2024-08-31T05:42:46.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.116+0000 7fea4c14e740 1 --2- 172.21.15.5:0/3287864608 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56547dfac080 0x56547e449320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:46.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.116+0000 7fea4c14e740 4 client.19011 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T05:42:46.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.116+0000 7fea4c14e740 1 -- 172.21.15.5:0/3287864608 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7fea3801e900 con 0x56547dfac080 2024-08-31T05:42:46.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.118+0000 7fea3f7fe640 1 --2- 172.21.15.5:0/3287864608 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56547dfac080 0x56547e449320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:46.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.122+0000 7fea1effd640 10 client.19011 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:42:46.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.122+0000 7fea3f7fe640 1 --2- 172.21.15.5:0/3287864608 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56547dfac080 0x56547e449320 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3971bbb3ce1bc1b server_cookie=aeb5411840b6d955 in_seq=0 out_seq=0 2024-08-31T05:42:46.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.124+0000 7fea1effd640 1 -- 172.21.15.5:0/3287864608 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7fea3801e900 con 0x56547dfac080 2024-08-31T05:42:46.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.124+0000 7fea1effd640 10 client.19011 handle_command_reply: tid=0 2024-08-31T05:42:46.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.124+0000 7fea4c14e740 1 client.19011 shutdown 2024-08-31T05:42:46.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.124+0000 7fea4c14e740 1 -- 172.21.15.5:0/3287864608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56547e018350 msgr2=0x56547e3ced20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:46.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.124+0000 7fea4c14e740 1 --2- 172.21.15.5:0/3287864608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56547e018350 0x56547e3ced20 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fea3800b520 tx=0x7fea380046c0 comp rx=0 tx=0).stop 2024-08-31T05:42:46.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.126+0000 7fea4c14e740 1 -- 172.21.15.5:0/3287864608 shutdown_connections 2024-08-31T05:42:46.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.126+0000 7fea4c14e740 1 --2- 172.21.15.5:0/3287864608 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x56547dfac080 0x56547e449320 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:46.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.126+0000 7fea4c14e740 1 --2- 172.21.15.5:0/3287864608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56547e018350 0x56547e3ced20 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:46.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.126+0000 7fea4c14e740 1 --2- 172.21.15.5:0/3287864608 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56547dff7670 0x56547e3ce7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:46.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.127+0000 7fea4c14e740 1 --2- 172.21.15.5:0/3287864608 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56547dfef490 0x56547e3ce2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:46.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.126+0000 7fea1effd640 0 client.19011 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:42:46.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.127+0000 7fea4c14e740 1 -- 172.21.15.5:0/3287864608 >> 172.21.15.5:0/3287864608 conn(0x56547e00c740 msgr2=0x56547e3cbb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:46.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.128+0000 7fea4c14e740 1 -- 172.21.15.5:0/3287864608 shutdown_connections 2024-08-31T05:42:46.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.129+0000 7fea4c14e740 1 -- 172.21.15.5:0/3287864608 wait complete. 2024-08-31T05:42:46.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.130+0000 7fea4c14e740 20 client.19011 trim_cache size 0 max 16384 2024-08-31T05:42:46.132 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:42:46.132 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-08-31T05:42:46.132 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "9a98c3be-1a83-4ac4-9efb-e98104b2c85a", 2024-08-31T05:42:46.132 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-08-31T05:42:46.133 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:42:46.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.131+0000 7fea45bd9640 1 -- 172.21.15.5:0/2384188901 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fea2c0b4d50 msgr2=0x7fea2c0b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:46.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.131+0000 7fea45bd9640 1 --2- 172.21.15.5:0/2384188901 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fea2c0b4d50 0x7fea2c0b7260 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fea38005fd0 tx=0x7fea38005cc0 comp rx=0 tx=0).stop 2024-08-31T05:42:46.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.131+0000 7fea45bd9640 1 -- 172.21.15.5:0/2384188901 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea40101900 msgr2=0x7fea401121f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:46.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.131+0000 7fea45bd9640 1 --2- 172.21.15.5:0/2384188901 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea40101900 0x7fea401121f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fea3002aea0 tx=0x7fea30003ba0 comp rx=0 tx=0).stop 2024-08-31T05:42:46.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.131+0000 7fea45bd9640 1 -- 172.21.15.5:0/2384188901 shutdown_connections 2024-08-31T05:42:46.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.131+0000 7fea45bd9640 1 --2- 172.21.15.5:0/2384188901 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fea2c0b4d50 0x7fea2c0b7260 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:46.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.131+0000 7fea45bd9640 1 --2- 172.21.15.5:0/2384188901 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea40107680 0x7fea4010fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:46.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.131+0000 7fea45bd9640 1 --2- 172.21.15.5:0/2384188901 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fea40102250 0x7fea4010f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:46.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.131+0000 7fea45bd9640 1 --2- 172.21.15.5:0/2384188901 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea40101900 0x7fea401121f0 secure :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fea3002aea0 tx=0x7fea30003ba0 comp rx=0 tx=0).stop 2024-08-31T05:42:46.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.131+0000 7fea45bd9640 1 -- 172.21.15.5:0/2384188901 >> 172.21.15.5:0/2384188901 conn(0x7fea400775a0 msgr2=0x7fea400ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:46.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.131+0000 7fea45bd9640 1 -- 172.21.15.5:0/2384188901 shutdown_connections 2024-08-31T05:42:46.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:46.131+0000 7fea45bd9640 1 -- 172.21.15.5:0/2384188901 wait complete. 2024-08-31T05:42:46.147 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:42:46 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:42:46.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:42:46 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:42:46.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:42:46 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:42:46.931 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T05:42:46.942 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1437402 10.74 MB/sec execute 574 sec latency 51.159 ms 2024-08-31T05:42:47.195 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:42:47.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:42:47 smithi005 ceph-mon[18602]: pgmap v741: 129 pgs: 129 active+clean; 582 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.1 MiB/s wr, 219 op/s 2024-08-31T05:42:47.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:42:47 smithi005 ceph-mon[18602]: scrub queued for path: / 2024-08-31T05:42:47.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:42:47 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:42:47.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:42:47 smithi005 ceph-mon[18602]: scrub summary: active paths [/] 2024-08-31T05:42:47.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:42:47 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:42:47.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:42:47 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:42:47.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:42:47 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:42:47.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:42:47 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:42:47.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:42:47 smithi070 ceph-mon[22316]: pgmap v741: 129 pgs: 129 active+clean; 582 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.1 MiB/s wr, 219 op/s 2024-08-31T05:42:47.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:42:47 smithi070 ceph-mon[22316]: scrub queued for path: / 2024-08-31T05:42:47.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:42:47 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:42:47.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:42:47 smithi070 ceph-mon[22316]: scrub summary: active paths [/] 2024-08-31T05:42:47.337 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:42:47 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:42:47.337 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:42:47 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:42:47.337 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:42:47 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:42:47.337 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:42:47 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:42:47.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:42:47 smithi050 ceph-mon[22146]: pgmap v741: 129 pgs: 129 active+clean; 582 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.1 MiB/s wr, 219 op/s 2024-08-31T05:42:47.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:42:47 smithi050 ceph-mon[22146]: scrub queued for path: / 2024-08-31T05:42:47.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:42:47 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:42:47.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:42:47 smithi050 ceph-mon[22146]: scrub summary: active paths [/] 2024-08-31T05:42:47.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:42:47 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:42:47.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:42:47 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:42:47.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:42:47 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:42:47.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:42:47 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:42:47.942 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1439495 10.74 MB/sec execute 575 sec latency 20.941 ms 2024-08-31T05:42:48.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.058+0000 7fcd69b1d640 1 -- 172.21.15.5:0/271307478 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd64102880 msgr2=0x7fcd64102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:48.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.058+0000 7fcd69b1d640 1 --2- 172.21.15.5:0/271307478 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd64102880 0x7fcd64102c90 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fcd54009900 tx=0x7fcd5402a410 comp rx=0 tx=0).stop 2024-08-31T05:42:48.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.058+0000 7fcd69b1d640 1 -- 172.21.15.5:0/271307478 shutdown_connections 2024-08-31T05:42:48.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.058+0000 7fcd69b1d640 1 --2- 172.21.15.5:0/271307478 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd64108ac0 0x7fcd6410f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:48.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.058+0000 7fcd69b1d640 1 --2- 172.21.15.5:0/271307478 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd64108170 0x7fcd64108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:48.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.058+0000 7fcd69b1d640 1 --2- 172.21.15.5:0/271307478 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd64102880 0x7fcd64102c90 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:48.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.058+0000 7fcd69b1d640 1 -- 172.21.15.5:0/271307478 >> 172.21.15.5:0/271307478 conn(0x7fcd64079500 msgr2=0x7fcd64079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:48.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.058+0000 7fcd69b1d640 1 -- 172.21.15.5:0/271307478 shutdown_connections 2024-08-31T05:42:48.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.058+0000 7fcd69b1d640 1 -- 172.21.15.5:0/271307478 wait complete. 2024-08-31T05:42:48.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.059+0000 7fcd69b1d640 1 Processor -- start 2024-08-31T05:42:48.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.059+0000 7fcd69b1d640 1 -- start start 2024-08-31T05:42:48.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.059+0000 7fcd69b1d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd64102880 0x7fcd64104020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:48.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.059+0000 7fcd69b1d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd64108170 0x7fcd64104560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:48.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.059+0000 7fcd69b1d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd64108ac0 0x7fcd64104aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:48.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.059+0000 7fcd69b1d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fcd64112740 con 0x7fcd64108ac0 2024-08-31T05:42:48.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.059+0000 7fcd69b1d640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcd641125c0 con 0x7fcd64108170 2024-08-31T05:42:48.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.059+0000 7fcd69b1d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcd641128c0 con 0x7fcd64102880 2024-08-31T05:42:48.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.059+0000 7fcd637fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd64102880 0x7fcd64104020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:48.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.059+0000 7fcd63fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd64108ac0 0x7fcd64104aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:48.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.059+0000 7fcd637fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd64102880 0x7fcd64104020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:58546/0 (socket says 172.21.15.5:58546) 2024-08-31T05:42:48.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.059+0000 7fcd637fe640 1 -- 172.21.15.5:0/3376932148 learned_addr learned my addr 172.21.15.5:0/3376932148 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:48.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.059+0000 7fcd5bfff640 1 --2- 172.21.15.5:0/3376932148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd64108170 0x7fcd64104560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:48.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.059+0000 7fcd63fff640 1 -- 172.21.15.5:0/3376932148 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd64102880 msgr2=0x7fcd64104020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:48.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.059+0000 7fcd63fff640 1 --2- 172.21.15.5:0/3376932148 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd64102880 0x7fcd64104020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:48.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.059+0000 7fcd63fff640 1 -- 172.21.15.5:0/3376932148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd64108170 msgr2=0x7fcd64104560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:48.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.059+0000 7fcd63fff640 1 --2- 172.21.15.5:0/3376932148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd64108170 0x7fcd64104560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:48.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.059+0000 7fcd63fff640 1 -- 172.21.15.5:0/3376932148 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd641a84c0 con 0x7fcd64108ac0 2024-08-31T05:42:48.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.060+0000 7fcd63fff640 1 --2- 172.21.15.5:0/3376932148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd64108ac0 0x7fcd64104aa0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c009fd0 tx=0x7fcd5c00ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:48.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.060+0000 7fcd617fa640 1 -- 172.21.15.5:0/3376932148 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c00ce20 con 0x7fcd64108ac0 2024-08-31T05:42:48.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.060+0000 7fcd69b1d640 1 -- 172.21.15.5:0/3376932148 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd641a87b0 con 0x7fcd64108ac0 2024-08-31T05:42:48.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.060+0000 7fcd617fa640 1 -- 172.21.15.5:0/3376932148 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd5c005020 con 0x7fcd64108ac0 2024-08-31T05:42:48.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.060+0000 7fcd617fa640 1 -- 172.21.15.5:0/3376932148 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c010690 con 0x7fcd64108ac0 2024-08-31T05:42:48.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.060+0000 7fcd69b1d640 1 -- 172.21.15.5:0/3376932148 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd641a8cf0 con 0x7fcd64108ac0 2024-08-31T05:42:48.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.063+0000 7fcd617fa640 1 -- 172.21.15.5:0/3376932148 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fcd5c010830 con 0x7fcd64108ac0 2024-08-31T05:42:48.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.063+0000 7fcd70092740 1 Processor -- start 2024-08-31T05:42:48.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.063+0000 7fcd70092740 1 -- start start 2024-08-31T05:42:48.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.063+0000 7fcd70092740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aa2e135070 0x55aa2e4da2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:48.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.063+0000 7fcd70092740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa2e10c1b0 0x55aa2e4da800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:48.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.063+0000 7fcd70092740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa2e114390 0x55aa2e4dad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:48.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.063+0000 7fcd70092740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55aa2e451630 con 0x55aa2e135070 2024-08-31T05:42:48.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.063+0000 7fcd70092740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55aa2e440bc0 con 0x55aa2e114390 2024-08-31T05:42:48.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.063+0000 7fcd70092740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55aa2e444b70 con 0x55aa2e10c1b0 2024-08-31T05:42:48.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.063+0000 7fcd637fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa2e10c1b0 0x55aa2e4da800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:48.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.063+0000 7fcd5bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aa2e135070 0x55aa2e4da2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:48.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.063+0000 7fcd637fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa2e10c1b0 0x55aa2e4da800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:58548/0 (socket says 172.21.15.5:58548) 2024-08-31T05:42:48.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.063+0000 7fcd637fe640 1 -- 172.21.15.5:0/2663175664 learned_addr learned my addr 172.21.15.5:0/2663175664 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:48.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.063+0000 7fcd5bfff640 1 --2- 172.21.15.5:0/2663175664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa2e114390 0x55aa2e4dad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:48.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.063+0000 7fcd617fa640 1 --2- 172.21.15.5:0/3376932148 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fcd500b4ca0 0x7fcd500b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:48.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.063+0000 7fcd637fe640 1 -- 172.21.15.5:0/2663175664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa2e114390 msgr2=0x55aa2e4dad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:48.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.063+0000 7fcd637fe640 1 --2- 172.21.15.5:0/2663175664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa2e114390 0x55aa2e4dad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:48.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.063+0000 7fcd637fe640 1 -- 172.21.15.5:0/2663175664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aa2e135070 msgr2=0x55aa2e4da2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:48.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.063+0000 7fcd637fe640 1 --2- 172.21.15.5:0/2663175664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aa2e135070 0x55aa2e4da2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:48.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.063+0000 7fcd637fe640 1 -- 172.21.15.5:0/2663175664 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa2e1a0650 con 0x55aa2e10c1b0 2024-08-31T05:42:48.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.064+0000 7fcd617fa640 1 -- 172.21.15.5:0/3376932148 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9511+0+0 (secure 0 0 0) 0x7fcd5c0e6000 con 0x7fcd64108ac0 2024-08-31T05:42:48.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.064+0000 7fcd63fff640 1 --2- 172.21.15.5:0/3376932148 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fcd500b4ca0 0x7fcd500b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:48.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.064+0000 7fcd637fe640 1 --2- 172.21.15.5:0/2663175664 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa2e10c1b0 0x55aa2e4da800 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fcd54000c00 tx=0x7fcd54031b10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c30dee7e831e81a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:48.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.064+0000 7fcd59ffb640 1 -- 172.21.15.5:0/2663175664 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd54040070 con 0x55aa2e10c1b0 2024-08-31T05:42:48.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.064+0000 7fcd59ffb640 1 -- 172.21.15.5:0/2663175664 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd54004030 con 0x55aa2e10c1b0 2024-08-31T05:42:48.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.064+0000 7fcd59ffb640 1 -- 172.21.15.5:0/2663175664 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd54035040 con 0x55aa2e10c1b0 2024-08-31T05:42:48.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.065+0000 7fcd70092740 1 -- 172.21.15.5:0/2663175664 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa2e10c1b0 msgr2=0x55aa2e4da800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:48.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.065+0000 7fcd63fff640 1 --2- 172.21.15.5:0/3376932148 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fcd500b4ca0 0x7fcd500b71b0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c0e33d0 tx=0x7fcd5c005f70 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:48.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.065+0000 7fcd70092740 1 --2- 172.21.15.5:0/2663175664 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa2e10c1b0 0x55aa2e4da800 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fcd54000c00 tx=0x7fcd54031b10 comp rx=0 tx=0).stop 2024-08-31T05:42:48.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.065+0000 7fcd70092740 1 -- 172.21.15.5:0/2663175664 shutdown_connections 2024-08-31T05:42:48.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.065+0000 7fcd70092740 1 --2- 172.21.15.5:0/2663175664 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa2e114390 0x55aa2e4dad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:48.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.065+0000 7fcd70092740 1 --2- 172.21.15.5:0/2663175664 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa2e10c1b0 0x55aa2e4da800 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:48.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.065+0000 7fcd70092740 1 --2- 172.21.15.5:0/2663175664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aa2e135070 0x55aa2e4da2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:48.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.065+0000 7fcd70092740 1 -- 172.21.15.5:0/2663175664 >> 172.21.15.5:0/2663175664 conn(0x55aa2e129460 msgr2=0x55aa2e4d81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:48.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.065+0000 7fcd70092740 1 -- 172.21.15.5:0/2663175664 shutdown_connections 2024-08-31T05:42:48.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.065+0000 7fcd70092740 1 -- 172.21.15.5:0/2663175664 wait complete. 2024-08-31T05:42:48.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.065+0000 7fcd70092740 1 -- start start 2024-08-31T05:42:48.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.066+0000 7fcd70092740 1 Processor -- start 2024-08-31T05:42:48.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.066+0000 7fcd70092740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa2e10c1b0 0x55aa2e4e5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:48.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.066+0000 7fcd70092740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa2e114390 0x55aa2e4e5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:48.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.066+0000 7fcd70092740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aa2e135070 0x55aa2e4f1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:48.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.066+0000 7fcd70092740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55aa2e2a3700 con 0x55aa2e135070 2024-08-31T05:42:48.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.066+0000 7fcd70092740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55aa2e3c7700 con 0x55aa2e10c1b0 2024-08-31T05:42:48.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.066+0000 7fcd70092740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55aa2e4e8a40 con 0x55aa2e114390 2024-08-31T05:42:48.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.066+0000 7fcd70092740 10 client.0 _ll_register_callbacks cb 0x55aa2e3f6dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:42:48.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.066+0000 7fcd637fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa2e114390 0x55aa2e4e5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:48.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.066+0000 7fcd5bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aa2e135070 0x55aa2e4f1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:48.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.066+0000 7fcd637fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa2e114390 0x55aa2e4e5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:58552/0 (socket says 172.21.15.5:58552) 2024-08-31T05:42:48.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.066+0000 7fcd637fe640 1 -- 172.21.15.5:0/2708171973 learned_addr learned my addr 172.21.15.5:0/2708171973 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:48.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.066+0000 7fcd5bfff640 1 --2- 172.21.15.5:0/2708171973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa2e10c1b0 0x55aa2e4e5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:48.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.066+0000 7fcd5bfff640 1 -- 172.21.15.5:0/2708171973 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa2e114390 msgr2=0x55aa2e4e5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:48.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.066+0000 7fcd5bfff640 1 --2- 172.21.15.5:0/2708171973 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa2e114390 0x55aa2e4e5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:48.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.066+0000 7fcd5bfff640 1 -- 172.21.15.5:0/2708171973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa2e10c1b0 msgr2=0x55aa2e4e5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:48.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.066+0000 7fcd5bfff640 1 --2- 172.21.15.5:0/2708171973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa2e10c1b0 0x55aa2e4e5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:48.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.066+0000 7fcd5bfff640 1 -- 172.21.15.5:0/2708171973 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa2e4008b0 con 0x55aa2e135070 2024-08-31T05:42:48.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.066+0000 7fcd637fe640 1 --2- 172.21.15.5:0/2708171973 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa2e114390 0x55aa2e4e5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:42:48.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.067+0000 7fcd5bfff640 1 --2- 172.21.15.5:0/2708171973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aa2e135070 0x55aa2e4f1d30 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c0058c0 tx=0x7fcd4c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f4d85cd77e2a0ba server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:48.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.067+0000 7fcd42ffd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:42:48.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.067+0000 7fcd42ffd640 1 -- 172.21.15.5:0/2708171973 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c00fe30 con 0x55aa2e135070 2024-08-31T05:42:48.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.067+0000 7fcd42ffd640 1 -- 172.21.15.5:0/2708171973 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9511+0+0 (secure 0 0 0) 0x7fcd4c004030 con 0x55aa2e135070 2024-08-31T05:42:48.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.067+0000 7fcd70092740 1 -- 172.21.15.5:0/2708171973 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd54004030 con 0x55aa2e135070 2024-08-31T05:42:48.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.067+0000 7fcd42ffd640 1 -- 172.21.15.5:0/2708171973 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fcd4c02a050 con 0x55aa2e135070 2024-08-31T05:42:48.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.067+0000 7fcd70092740 10 client.19023 fetch_fsmap learned FSMap version 34 2024-08-31T05:42:48.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.067+0000 7fcd70092740 1 -- 172.21.15.5:0/2708171973 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55aa2e4f47b0 con 0x55aa2e135070 2024-08-31T05:42:48.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.067+0000 7fcd42ffd640 1 -- 172.21.15.5:0/2708171973 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd54004030 con 0x55aa2e135070 2024-08-31T05:42:48.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.068+0000 7fcd42ffd640 1 -- 172.21.15.5:0/2708171973 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fcd4c003bc0 con 0x55aa2e135070 2024-08-31T05:42:48.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.068+0000 7fcd70092740 10 client.19023 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:42:48.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.068+0000 7fcd70092740 10 client.19023 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:42:48.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.068+0000 7fcd70092740 20 client.19023 populate_metadata read hostname 'smithi005' 2024-08-31T05:42:48.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.068+0000 7fcd70092740 1 --2- 172.21.15.5:0/2708171973 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55aa2e0f39f0 0x55aa2e4f7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:48.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.068+0000 7fcd70092740 4 client.19023 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:42:48.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.068+0000 7fcd70092740 1 -- 172.21.15.5:0/2708171973 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aa2e453580 con 0x55aa2e0f39f0 2024-08-31T05:42:48.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.068+0000 7fcd637fe640 1 --2- 172.21.15.5:0/2708171973 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55aa2e0f39f0 0x55aa2e4f7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:48.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.068+0000 7fcd42ffd640 10 client.19023 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:42:48.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.068+0000 7fcd637fe640 1 --2- 172.21.15.5:0/2708171973 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55aa2e0f39f0 0x55aa2e4f7c60 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6a479efd5f48c72 server_cookie=6e69a49d79c7e787 in_seq=0 out_seq=0 2024-08-31T05:42:48.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.069+0000 7fcd42ffd640 1 -- 172.21.15.5:0/2708171973 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55aa2e453580 con 0x55aa2e0f39f0 2024-08-31T05:42:48.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.069+0000 7fcd42ffd640 10 client.19023 handle_command_reply: tid=0 2024-08-31T05:42:48.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.069+0000 7fcd70092740 1 client.19023 shutdown 2024-08-31T05:42:48.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.069+0000 7fcd70092740 1 -- 172.21.15.5:0/2708171973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aa2e135070 msgr2=0x55aa2e4f1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:48.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.069+0000 7fcd70092740 1 --2- 172.21.15.5:0/2708171973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aa2e135070 0x55aa2e4f1d30 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c0058c0 tx=0x7fcd4c005f90 comp rx=0 tx=0).stop 2024-08-31T05:42:48.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.069+0000 7fcd70092740 1 -- 172.21.15.5:0/2708171973 shutdown_connections 2024-08-31T05:42:48.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.069+0000 7fcd70092740 1 --2- 172.21.15.5:0/2708171973 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55aa2e0f39f0 0x55aa2e4f7c60 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:48.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.069+0000 7fcd70092740 1 --2- 172.21.15.5:0/2708171973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aa2e135070 0x55aa2e4f1d30 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:48.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.069+0000 7fcd42ffd640 0 client.19023 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:42:48.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.070+0000 7fcd70092740 1 --2- 172.21.15.5:0/2708171973 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa2e114390 0x55aa2e4e5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:48.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.070+0000 7fcd70092740 1 --2- 172.21.15.5:0/2708171973 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa2e10c1b0 0x55aa2e4e5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:48.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.070+0000 7fcd70092740 1 -- 172.21.15.5:0/2708171973 >> 172.21.15.5:0/2708171973 conn(0x55aa2e129460 msgr2=0x55aa2e4dd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:48.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.070+0000 7fcd70092740 1 -- 172.21.15.5:0/2708171973 shutdown_connections 2024-08-31T05:42:48.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.070+0000 7fcd70092740 1 -- 172.21.15.5:0/2708171973 wait complete. 2024-08-31T05:42:48.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.070+0000 7fcd70092740 20 client.19023 trim_cache size 0 max 16384 2024-08-31T05:42:48.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.088+0000 7fcd70092740 1 Processor -- start 2024-08-31T05:42:48.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.088+0000 7fcd70092740 1 -- start start 2024-08-31T05:42:48.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.088+0000 7fcd70092740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aa2e129460 0x55aa2e4ddad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:48.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.088+0000 7fcd70092740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa2e0f39f0 0x55aa2e4f1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:48.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.088+0000 7fcd70092740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa2e10c1b0 0x55aa2e4d7b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:48.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.088+0000 7fcd70092740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fcd641b2f50 con 0x55aa2e129460 2024-08-31T05:42:48.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.088+0000 7fcd70092740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcd641b4a90 con 0x55aa2e10c1b0 2024-08-31T05:42:48.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.088+0000 7fcd70092740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcd641b3620 con 0x55aa2e0f39f0 2024-08-31T05:42:48.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.088+0000 7fcd5bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aa2e129460 0x55aa2e4ddad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:48.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.088+0000 7fcd5bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aa2e129460 0x55aa2e4ddad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42300/0 (socket says 172.21.15.5:42300) 2024-08-31T05:42:48.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.088+0000 7fcd637fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa2e0f39f0 0x55aa2e4f1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:48.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.088+0000 7fcd5bfff640 1 -- 172.21.15.5:0/1994983483 learned_addr learned my addr 172.21.15.5:0/1994983483 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:48.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.088+0000 7fcd5bfff640 1 --2- 172.21.15.5:0/1994983483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa2e10c1b0 0x55aa2e4d7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:48.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.089+0000 7fcd5bfff640 1 -- 172.21.15.5:0/1994983483 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa2e0f39f0 msgr2=0x55aa2e4f1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:48.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.089+0000 7fcd5bfff640 1 --2- 172.21.15.5:0/1994983483 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa2e0f39f0 0x55aa2e4f1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:48.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.089+0000 7fcd5bfff640 1 -- 172.21.15.5:0/1994983483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa2e10c1b0 msgr2=0x55aa2e4d7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:48.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.089+0000 7fcd5bfff640 1 --2- 172.21.15.5:0/1994983483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa2e10c1b0 0x55aa2e4d7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:48.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.089+0000 7fcd5bfff640 1 -- 172.21.15.5:0/1994983483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa2e4e48e0 con 0x55aa2e129460 2024-08-31T05:42:48.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.089+0000 7fcd5bfff640 1 --2- 172.21.15.5:0/1994983483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aa2e129460 0x55aa2e4ddad0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c022670 tx=0x7fcd4c011b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f74370f77c511dcf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:48.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.089+0000 7fcd597fa640 1 -- 172.21.15.5:0/1994983483 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c009b60 con 0x55aa2e129460 2024-08-31T05:42:48.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.089+0000 7fcd597fa640 1 -- 172.21.15.5:0/1994983483 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd4c011bf0 con 0x55aa2e129460 2024-08-31T05:42:48.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.089+0000 7fcd597fa640 1 -- 172.21.15.5:0/1994983483 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c004380 con 0x55aa2e129460 2024-08-31T05:42:48.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.090+0000 7fcd70092740 1 -- 172.21.15.5:0/1994983483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aa2e129460 msgr2=0x55aa2e4ddad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:48.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.090+0000 7fcd70092740 1 --2- 172.21.15.5:0/1994983483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aa2e129460 0x55aa2e4ddad0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c022670 tx=0x7fcd4c011b10 comp rx=0 tx=0).stop 2024-08-31T05:42:48.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.090+0000 7fcd70092740 1 -- 172.21.15.5:0/1994983483 shutdown_connections 2024-08-31T05:42:48.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.090+0000 7fcd70092740 1 --2- 172.21.15.5:0/1994983483 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa2e10c1b0 0x55aa2e4d7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:48.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.090+0000 7fcd70092740 1 --2- 172.21.15.5:0/1994983483 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa2e0f39f0 0x55aa2e4f1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:48.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.090+0000 7fcd70092740 1 --2- 172.21.15.5:0/1994983483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aa2e129460 0x55aa2e4ddad0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:48.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.090+0000 7fcd70092740 1 -- 172.21.15.5:0/1994983483 >> 172.21.15.5:0/1994983483 conn(0x55aa2e4f7f90 msgr2=0x55aa2e4dd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:48.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.090+0000 7fcd70092740 1 -- 172.21.15.5:0/1994983483 shutdown_connections 2024-08-31T05:42:48.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.090+0000 7fcd70092740 1 -- 172.21.15.5:0/1994983483 wait complete. 2024-08-31T05:42:48.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.090+0000 7fcd70092740 1 -- start start 2024-08-31T05:42:48.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.091+0000 7fcd70092740 1 Processor -- start 2024-08-31T05:42:48.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.091+0000 7fcd70092740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa2e0f39f0 0x55aa2e4ea0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:48.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.091+0000 7fcd70092740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aa2e10c1b0 0x55aa2e4ea610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:48.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.091+0000 7fcd70092740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa2e129460 0x55aa2e561660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:48.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.091+0000 7fcd70092740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fcd641b43c0 con 0x55aa2e10c1b0 2024-08-31T05:42:48.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.091+0000 7fcd70092740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcd641b3cf0 con 0x55aa2e0f39f0 2024-08-31T05:42:48.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.091+0000 7fcd70092740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcd641b0f50 con 0x55aa2e129460 2024-08-31T05:42:48.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.091+0000 7fcd70092740 10 client.0 _ll_register_callbacks cb 0x7fcd4c009df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:42:48.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.091+0000 7fcd637fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aa2e10c1b0 0x55aa2e4ea610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:48.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.091+0000 7fcd5bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa2e0f39f0 0x55aa2e4ea0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:48.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.091+0000 7fcd637fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aa2e10c1b0 0x55aa2e4ea610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42302/0 (socket says 172.21.15.5:42302) 2024-08-31T05:42:48.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.091+0000 7fcd5bfff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa2e0f39f0 0x55aa2e4ea0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:41656/0 (socket says 172.21.15.5:41656) 2024-08-31T05:42:48.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.091+0000 7fcd637fe640 1 -- 172.21.15.5:0/2387797300 learned_addr learned my addr 172.21.15.5:0/2387797300 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:48.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.091+0000 7fcd5bfff640 1 --2- 172.21.15.5:0/2387797300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa2e129460 0x55aa2e561660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:48.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.091+0000 7fcd637fe640 1 -- 172.21.15.5:0/2387797300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa2e129460 msgr2=0x55aa2e561660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:48.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.091+0000 7fcd637fe640 1 --2- 172.21.15.5:0/2387797300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa2e129460 0x55aa2e561660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:48.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.091+0000 7fcd637fe640 1 -- 172.21.15.5:0/2387797300 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa2e0f39f0 msgr2=0x55aa2e4ea0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:48.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.092+0000 7fcd637fe640 1 --2- 172.21.15.5:0/2387797300 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa2e0f39f0 0x55aa2e4ea0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:48.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.092+0000 7fcd637fe640 1 -- 172.21.15.5:0/2387797300 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa2e561ba0 con 0x55aa2e10c1b0 2024-08-31T05:42:48.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.092+0000 7fcd637fe640 1 --2- 172.21.15.5:0/2387797300 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aa2e10c1b0 0x55aa2e4ea610 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fcd54005130 tx=0x7fcd540058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdab9973a3238747 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:48.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.092+0000 7fcd42ffd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:42:48.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.092+0000 7fcd42ffd640 1 -- 172.21.15.5:0/2387797300 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd54040070 con 0x55aa2e10c1b0 2024-08-31T05:42:48.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.092+0000 7fcd42ffd640 1 -- 172.21.15.5:0/2387797300 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9511+0+0 (secure 0 0 0) 0x7fcd540053d0 con 0x55aa2e10c1b0 2024-08-31T05:42:48.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.092+0000 7fcd70092740 1 -- 172.21.15.5:0/2387797300 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd4c011bf0 con 0x55aa2e10c1b0 2024-08-31T05:42:48.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.092+0000 7fcd42ffd640 1 -- 172.21.15.5:0/2387797300 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fcd54035040 con 0x55aa2e10c1b0 2024-08-31T05:42:48.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.092+0000 7fcd70092740 10 client.19029 fetch_fsmap learned FSMap version 34 2024-08-31T05:42:48.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.092+0000 7fcd70092740 1 -- 172.21.15.5:0/2387797300 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55aa2e562d30 con 0x55aa2e10c1b0 2024-08-31T05:42:48.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.092+0000 7fcd42ffd640 1 -- 172.21.15.5:0/2387797300 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd4c011bf0 con 0x55aa2e10c1b0 2024-08-31T05:42:48.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.093+0000 7fcd42ffd640 1 -- 172.21.15.5:0/2387797300 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fcd54004b50 con 0x55aa2e10c1b0 2024-08-31T05:42:48.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.093+0000 7fcd70092740 10 client.19029 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:42:48.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.093+0000 7fcd70092740 10 client.19029 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:42:48.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.093+0000 7fcd70092740 20 client.19029 populate_metadata read hostname 'smithi005' 2024-08-31T05:42:48.159 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:42:48.159 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T05:42:48.159 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2024-08-31T05:42:48.159 INFO:teuthology.orchestra.run.smithi005.stdout: "9a98c3be-1a83-4ac4-9efb-e98104b2c85a": { 2024-08-31T05:42:48.159 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:42:48.159 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "9a98c3be-1a83-4ac4-9efb-e98104b2c85a", 2024-08-31T05:42:48.159 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2024-08-31T05:42:48.159 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:42:48.159 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:42:48.159 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_stats": { 2024-08-31T05:42:48.160 INFO:teuthology.orchestra.run.smithi005.stdout: "9a98c3be-1a83-4ac4-9efb-e98104b2c85a": { 2024-08-31T05:42:48.160 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:42:46.122404+0000", 2024-08-31T05:42:48.160 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:42:48.160 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:42:48.160 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:42:48.160 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:42:48.160 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:42:48.160 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:42:48.160 INFO:teuthology.orchestra.run.smithi005.stdout: "ab2853ca-505f-43fc-a132-af8bca186292": { 2024-08-31T05:42:48.160 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:40:23.937602+0000", 2024-08-31T05:42:48.160 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:42:48.160 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:42:48.160 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:42:48.161 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:42:48.161 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:42:48.161 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:42:48.161 INFO:teuthology.orchestra.run.smithi005.stdout: "75d84398-5d9c-4872-b879-2fbce045fa71": { 2024-08-31T05:42:48.161 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:06.642335+0000", 2024-08-31T05:42:48.161 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:42:48.161 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:42:48.161 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:42:48.161 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:42:48.161 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:42:48.161 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:42:48.161 INFO:teuthology.orchestra.run.smithi005.stdout: "ece37b07-9ab2-45f8-bc33-2755a07aac0b": { 2024-08-31T05:42:48.161 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:31:41.782407+0000", 2024-08-31T05:42:48.161 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:42:48.162 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:42:48.162 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:42:48.162 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:42:48.162 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:42:48.162 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:42:48.162 INFO:teuthology.orchestra.run.smithi005.stdout: "728a42ca-bbef-4151-830f-5fdd411d8fa0": { 2024-08-31T05:42:48.162 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:32:30.554906+0000", 2024-08-31T05:42:48.162 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:42:48.162 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:42:48.162 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:42:48.162 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:42:48.162 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:42:48.162 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:42:48.162 INFO:teuthology.orchestra.run.smithi005.stdout: "cda92ac0-b35f-47a5-a3a5-471c888462a5": { 2024-08-31T05:42:48.163 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:53.103905+0000", 2024-08-31T05:42:48.163 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:42:48.163 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:42:48.163 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:42:48.163 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:42:48.163 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:42:48.163 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:42:48.163 INFO:teuthology.orchestra.run.smithi005.stdout: "0bb67292-013a-40c7-b5fc-810bdd9715d8": { 2024-08-31T05:42:48.163 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:34:04.586008+0000", 2024-08-31T05:42:48.163 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:42:48.163 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:42:48.163 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:42:48.163 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:42:48.163 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:42:48.164 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:42:48.164 INFO:teuthology.orchestra.run.smithi005.stdout: "c9a687a5-4adf-4788-8f18-4c06352efa9b": { 2024-08-31T05:42:48.164 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:41:11.380197+0000", 2024-08-31T05:42:48.164 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:42:48.164 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:42:48.164 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:42:48.164 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:42:48.164 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:42:48.164 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:42:48.164 INFO:teuthology.orchestra.run.smithi005.stdout: "de9731c7-ae4a-42fe-8146-e4752cdc40d4": { 2024-08-31T05:42:48.164 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:34:53.614499+0000", 2024-08-31T05:42:48.164 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:42:48.164 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:42:48.165 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:42:48.165 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:42:48.165 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:42:48.165 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:42:48.165 INFO:teuthology.orchestra.run.smithi005.stdout: "f4db3406-20ff-46a3-baf9-099e16392f76": { 2024-08-31T05:42:48.165 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:38:49.034412+0000", 2024-08-31T05:42:48.165 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:42:48.165 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:42:48.165 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:42:48.165 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:42:48.165 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:42:48.165 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:42:48.165 INFO:teuthology.orchestra.run.smithi005.stdout: "095ccc7a-f368-4bc6-9563-5930e21f9b4a": { 2024-08-31T05:42:48.165 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:35:40.190069+0000", 2024-08-31T05:42:48.166 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:42:48.166 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:42:48.166 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:42:48.166 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:42:48.166 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:42:48.166 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:42:48.166 INFO:teuthology.orchestra.run.smithi005.stdout: "4788e020-0dc9-4938-9db8-dfd5992cb286": { 2024-08-31T05:42:48.166 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:41:58.905797+0000", 2024-08-31T05:42:48.166 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:42:48.166 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:42:48.166 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:42:48.166 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:42:48.166 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:42:48.166 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:42:48.167 INFO:teuthology.orchestra.run.smithi005.stdout: "297c26f3-7b4d-4245-abb0-f854248e5e1b": { 2024-08-31T05:42:48.167 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:37:14.019244+0000", 2024-08-31T05:42:48.167 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:42:48.167 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:42:48.167 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:42:48.167 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:42:48.167 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:42:48.167 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:42:48.167 INFO:teuthology.orchestra.run.smithi005.stdout: "a4d4cf74-2477-4dd9-a3a2-3762b4dd87e4": { 2024-08-31T05:42:48.167 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:38:01.378833+0000", 2024-08-31T05:42:48.167 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:42:48.167 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:42:48.167 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:42:48.167 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:42:48.168 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:42:48.168 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:42:48.168 INFO:teuthology.orchestra.run.smithi005.stdout: "94c23057-592d-4a8b-82d7-da2d84f8740b": { 2024-08-31T05:42:48.168 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:36:27.513638+0000", 2024-08-31T05:42:48.168 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:42:48.168 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:42:48.168 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:42:48.168 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:42:48.168 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:42:48.168 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:42:48.168 INFO:teuthology.orchestra.run.smithi005.stdout: "2445fc42-b797-434f-b380-e2da985b4d98": { 2024-08-31T05:42:48.168 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:33:17.681453+0000", 2024-08-31T05:42:48.168 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:42:48.168 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:42:48.169 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:42:48.169 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:42:48.169 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:42:48.169 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:42:48.169 INFO:teuthology.orchestra.run.smithi005.stdout: "239b7958-db06-4432-93ce-b7552effa357": { 2024-08-31T05:42:48.169 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:39:35.733028+0000", 2024-08-31T05:42:48.169 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:42:48.169 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:42:48.169 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:42:48.169 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:42:48.169 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:42:48.169 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:42:48.169 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:42:48.169 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:42:48.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.093+0000 7fcd70092740 1 --2- 172.21.15.5:0/2387797300 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55aa2e114390 0x55aa2e565080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:48.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.093+0000 7fcd70092740 4 client.19029 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T05:42:48.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.093+0000 7fcd70092740 1 -- 172.21.15.5:0/2387797300 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55aa2e44f020 con 0x55aa2e114390 2024-08-31T05:42:48.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.093+0000 7fcd5bfff640 1 --2- 172.21.15.5:0/2387797300 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55aa2e114390 0x55aa2e565080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:48.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.093+0000 7fcd5bfff640 1 --2- 172.21.15.5:0/2387797300 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55aa2e114390 0x55aa2e565080 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe831a6f287089ef server_cookie=53f5b73881ca3c8d in_seq=0 out_seq=0 2024-08-31T05:42:48.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.093+0000 7fcd42ffd640 10 client.19029 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:42:48.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.094+0000 7fcd42ffd640 1 -- 172.21.15.5:0/2387797300 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5114 (crc 0 0 0) 0x55aa2e44f020 con 0x55aa2e114390 2024-08-31T05:42:48.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.094+0000 7fcd42ffd640 10 client.19029 handle_command_reply: tid=0 2024-08-31T05:42:48.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.094+0000 7fcd70092740 1 client.19029 shutdown 2024-08-31T05:42:48.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.094+0000 7fcd70092740 1 -- 172.21.15.5:0/2387797300 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aa2e10c1b0 msgr2=0x55aa2e4ea610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:48.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.094+0000 7fcd70092740 1 --2- 172.21.15.5:0/2387797300 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aa2e10c1b0 0x55aa2e4ea610 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fcd54005130 tx=0x7fcd540058a0 comp rx=0 tx=0).stop 2024-08-31T05:42:48.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.094+0000 7fcd70092740 1 -- 172.21.15.5:0/2387797300 shutdown_connections 2024-08-31T05:42:48.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.094+0000 7fcd70092740 1 --2- 172.21.15.5:0/2387797300 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55aa2e114390 0x55aa2e565080 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:48.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.094+0000 7fcd70092740 1 --2- 172.21.15.5:0/2387797300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa2e129460 0x55aa2e561660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:48.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.094+0000 7fcd70092740 1 --2- 172.21.15.5:0/2387797300 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55aa2e10c1b0 0x55aa2e4ea610 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:48.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.094+0000 7fcd70092740 1 --2- 172.21.15.5:0/2387797300 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55aa2e0f39f0 0x55aa2e4ea0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:48.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.094+0000 7fcd42ffd640 0 client.19029 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:42:48.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.094+0000 7fcd70092740 1 -- 172.21.15.5:0/2387797300 >> 172.21.15.5:0/2387797300 conn(0x55aa2e4f7f90 msgr2=0x55aa2e4d7a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:48.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.094+0000 7fcd70092740 1 -- 172.21.15.5:0/2387797300 shutdown_connections 2024-08-31T05:42:48.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.094+0000 7fcd70092740 1 -- 172.21.15.5:0/2387797300 wait complete. 2024-08-31T05:42:48.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.094+0000 7fcd70092740 20 client.19029 trim_cache size 0 max 16384 2024-08-31T05:42:48.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.095+0000 7fcd69b1d640 1 -- 172.21.15.5:0/3376932148 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fcd500b4ca0 msgr2=0x7fcd500b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:48.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.095+0000 7fcd69b1d640 1 --2- 172.21.15.5:0/3376932148 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fcd500b4ca0 0x7fcd500b71b0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c0e33d0 tx=0x7fcd5c005f70 comp rx=0 tx=0).stop 2024-08-31T05:42:48.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.095+0000 7fcd69b1d640 1 -- 172.21.15.5:0/3376932148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd64108ac0 msgr2=0x7fcd64104aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:48.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.095+0000 7fcd69b1d640 1 --2- 172.21.15.5:0/3376932148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd64108ac0 0x7fcd64104aa0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c009fd0 tx=0x7fcd5c00ef10 comp rx=0 tx=0).stop 2024-08-31T05:42:48.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.095+0000 7fcd69b1d640 1 -- 172.21.15.5:0/3376932148 shutdown_connections 2024-08-31T05:42:48.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.095+0000 7fcd69b1d640 1 --2- 172.21.15.5:0/3376932148 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fcd500b4ca0 0x7fcd500b71b0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:48.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.095+0000 7fcd69b1d640 1 --2- 172.21.15.5:0/3376932148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd64108ac0 0x7fcd64104aa0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:48.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.095+0000 7fcd69b1d640 1 --2- 172.21.15.5:0/3376932148 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcd64108170 0x7fcd64104560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:48.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.095+0000 7fcd69b1d640 1 --2- 172.21.15.5:0/3376932148 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd64102880 0x7fcd64104020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:48.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.095+0000 7fcd69b1d640 1 -- 172.21.15.5:0/3376932148 >> 172.21.15.5:0/3376932148 conn(0x7fcd64079500 msgr2=0x7fcd64106460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:48.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.095+0000 7fcd69b1d640 1 -- 172.21.15.5:0/3376932148 shutdown_connections 2024-08-31T05:42:48.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:42:48.095+0000 7fcd69b1d640 1 -- 172.21.15.5:0/3376932148 wait complete. 2024-08-31T05:42:48.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:42:48 smithi070 ceph-mon[22316]: scrub summary: active paths [/] 2024-08-31T05:42:48.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:42:48 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:42:48.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:42:48 smithi050 ceph-mon[22146]: scrub summary: active paths [/] 2024-08-31T05:42:48.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:42:48 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:42:48.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:42:48 smithi005 ceph-mon[18602]: scrub summary: active paths [/] 2024-08-31T05:42:48.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:42:48 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:42:48.942 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1441332 10.74 MB/sec execute 576 sec latency 25.473 ms 2024-08-31T05:42:49.045 INFO:tasks.cephfs.filesystem:scrub status for tag:9a98c3be-1a83-4ac4-9efb-e98104b2c85a - {'path': '/', 'tag': '9a98c3be-1a83-4ac4-9efb-e98104b2c85a', 'options': 'recursive,force'} 2024-08-31T05:42:49.308 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:42:49 smithi050 ceph-mon[22146]: pgmap v742: 129 pgs: 129 active+clean; 594 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.9 MiB/s wr, 201 op/s 2024-08-31T05:42:49.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:42:49 smithi070 ceph-mon[22316]: pgmap v742: 129 pgs: 129 active+clean; 594 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.9 MiB/s wr, 201 op/s 2024-08-31T05:42:49.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:42:49 smithi005 ceph-mon[18602]: pgmap v742: 129 pgs: 129 active+clean; 594 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.9 MiB/s wr, 201 op/s 2024-08-31T05:42:49.942 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1443336 10.74 MB/sec execute 577 sec latency 20.535 ms 2024-08-31T05:42:50.942 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1444949 10.73 MB/sec execute 578 sec latency 68.458 ms 2024-08-31T05:42:51.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:42:51 smithi070 ceph-mon[22316]: pgmap v743: 129 pgs: 129 active+clean; 618 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 6.4 MiB/s wr, 225 op/s 2024-08-31T05:42:51.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:42:51 smithi050 ceph-mon[22146]: pgmap v743: 129 pgs: 129 active+clean; 618 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 6.4 MiB/s wr, 225 op/s 2024-08-31T05:42:51.456 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.453+0000 7f85d90d3640 1 -- 172.21.15.5:0/889972328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85d4104f80 msgr2=0x7f85d410d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:51.456 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.453+0000 7f85d90d3640 1 --2- 172.21.15.5:0/889972328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85d4104f80 0x7f85d410d5c0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f85c8009860 tx=0x7f85c802a340 comp rx=0 tx=0).stop 2024-08-31T05:42:51.457 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.453+0000 7f85d90d3640 1 -- 172.21.15.5:0/889972328 shutdown_connections 2024-08-31T05:42:51.457 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.453+0000 7f85d90d3640 1 --2- 172.21.15.5:0/889972328 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85d410db00 0x7f85d4110010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:51.457 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.453+0000 7f85d90d3640 1 --2- 172.21.15.5:0/889972328 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85d4104f80 0x7f85d410d5c0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:51.457 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.453+0000 7f85d90d3640 1 --2- 172.21.15.5:0/889972328 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85d4104550 0x7f85d4104960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:51.457 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.453+0000 7f85d90d3640 1 -- 172.21.15.5:0/889972328 >> 172.21.15.5:0/889972328 conn(0x7f85d40fe160 msgr2=0x7f85d41005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:51.457 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.453+0000 7f85d90d3640 1 -- 172.21.15.5:0/889972328 shutdown_connections 2024-08-31T05:42:51.457 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.453+0000 7f85d90d3640 1 -- 172.21.15.5:0/889972328 wait complete. 2024-08-31T05:42:51.457 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.454+0000 7f85d90d3640 1 Processor -- start 2024-08-31T05:42:51.459 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.454+0000 7f85d90d3640 1 -- start start 2024-08-31T05:42:51.459 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.454+0000 7f85d90d3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85d4104550 0x7f85d419a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:51.459 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.454+0000 7f85d90d3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85d4104f80 0x7f85d419a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:51.460 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.454+0000 7f85d90d3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85d410db00 0x7f85d419fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:51.460 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.454+0000 7f85d90d3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f85d4113750 con 0x7f85d4104f80 2024-08-31T05:42:51.460 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.454+0000 7f85d90d3640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f85d41135d0 con 0x7f85d410db00 2024-08-31T05:42:51.460 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.454+0000 7f85d90d3640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f85d41138d0 con 0x7f85d4104550 2024-08-31T05:42:51.460 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.454+0000 7f85d259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85d4104f80 0x7f85d419a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:51.460 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.454+0000 7f85d259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85d4104f80 0x7f85d419a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42328/0 (socket says 172.21.15.5:42328) 2024-08-31T05:42:51.460 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.454+0000 7f85d259c640 1 -- 172.21.15.5:0/4005222760 learned_addr learned my addr 172.21.15.5:0/4005222760 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:51.460 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.454+0000 7f85d2d9d640 1 --2- 172.21.15.5:0/4005222760 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85d4104550 0x7f85d419a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:51.460 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.454+0000 7f85d359e640 1 --2- 172.21.15.5:0/4005222760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85d410db00 0x7f85d419fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:51.460 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.455+0000 7f85d259c640 1 -- 172.21.15.5:0/4005222760 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85d4104550 msgr2=0x7f85d419a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:51.460 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.455+0000 7f85d259c640 1 --2- 172.21.15.5:0/4005222760 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85d4104550 0x7f85d419a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:51.460 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.455+0000 7f85d259c640 1 -- 172.21.15.5:0/4005222760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85d410db00 msgr2=0x7f85d419fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:51.460 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.455+0000 7f85d259c640 1 --2- 172.21.15.5:0/4005222760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85d410db00 0x7f85d419fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:51.461 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.455+0000 7f85d259c640 1 -- 172.21.15.5:0/4005222760 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85d41a0120 con 0x7f85d4104f80 2024-08-31T05:42:51.461 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.455+0000 7f85d2d9d640 1 --2- 172.21.15.5:0/4005222760 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85d4104550 0x7f85d419a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:42:51.461 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.455+0000 7f85d259c640 1 --2- 172.21.15.5:0/4005222760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85d4104f80 0x7f85d419a790 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f85c8035040 tx=0x7f85c8032d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:51.461 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.455+0000 7f85bbfff640 1 -- 172.21.15.5:0/4005222760 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c8040020 con 0x7f85d4104f80 2024-08-31T05:42:51.461 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.455+0000 7f85d90d3640 1 -- 172.21.15.5:0/4005222760 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85d41a03b0 con 0x7f85d4104f80 2024-08-31T05:42:51.461 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.455+0000 7f85bbfff640 1 -- 172.21.15.5:0/4005222760 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f85c8030e10 con 0x7f85d4104f80 2024-08-31T05:42:51.461 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.455+0000 7f85bbfff640 1 -- 172.21.15.5:0/4005222760 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c8037040 con 0x7f85d4104f80 2024-08-31T05:42:51.461 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.455+0000 7f85d90d3640 1 -- 172.21.15.5:0/4005222760 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85d41a6ba0 con 0x7f85d4104f80 2024-08-31T05:42:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.458+0000 7f85e0043740 1 Processor -- start 2024-08-31T05:42:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.458+0000 7f85e0043740 1 -- start start 2024-08-31T05:42:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.458+0000 7f85bbfff640 1 -- 172.21.15.5:0/4005222760 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f85c8043020 con 0x7f85d4104f80 2024-08-31T05:42:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.458+0000 7f85e0043740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589686fc1b0 0x558968a9fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.458+0000 7f85e0043740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589686d32f0 0x558968aa0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.458+0000 7f85e0043740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589686db4d0 0x558968aa0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.458+0000 7f85e0043740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x558968a15000 con 0x5589686d32f0 2024-08-31T05:42:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.458+0000 7f85e0043740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x558968a04590 con 0x5589686db4d0 2024-08-31T05:42:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.458+0000 7f85e0043740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558968a08540 con 0x5589686fc1b0 2024-08-31T05:42:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.458+0000 7f85d2d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589686d32f0 0x558968aa0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.458+0000 7f85d359e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589686fc1b0 0x558968a9fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.458+0000 7f85d2d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589686d32f0 0x558968aa0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42332/0 (socket says 172.21.15.5:42332) 2024-08-31T05:42:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.458+0000 7f85d2d9d640 1 -- 172.21.15.5:0/4021517534 learned_addr learned my addr 172.21.15.5:0/4021517534 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.458+0000 7f85d259c640 1 --2- 172.21.15.5:0/4021517534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589686db4d0 0x558968aa0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.459+0000 7f85d2d9d640 1 -- 172.21.15.5:0/4021517534 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589686fc1b0 msgr2=0x558968a9fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.459+0000 7f85d2d9d640 1 --2- 172.21.15.5:0/4021517534 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589686fc1b0 0x558968a9fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.459+0000 7f85d2d9d640 1 -- 172.21.15.5:0/4021517534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589686db4d0 msgr2=0x558968aa0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.459+0000 7f85d2d9d640 1 --2- 172.21.15.5:0/4021517534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589686db4d0 0x558968aa0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.459+0000 7f85d2d9d640 1 -- 172.21.15.5:0/4021517534 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558968767790 con 0x5589686d32f0 2024-08-31T05:42:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.459+0000 7f85d359e640 1 --2- 172.21.15.5:0/4021517534 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589686fc1b0 0x558968a9fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:42:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.459+0000 7f85bbfff640 1 --2- 172.21.15.5:0/4005222760 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f85bc0b4ca0 0x7f85bc0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.459+0000 7f85d2d9d640 1 --2- 172.21.15.5:0/4021517534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589686d32f0 0x558968aa0000 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f85c40115f0 tx=0x7f85c4011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=261bec6a4e0d3f07 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:51.469 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.459+0000 7f85d359e640 1 --2- 172.21.15.5:0/4005222760 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f85bc0b4ca0 0x7f85bc0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:51.469 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.459+0000 7f85b97fa640 1 -- 172.21.15.5:0/4021517534 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c401e070 con 0x5589686d32f0 2024-08-31T05:42:51.469 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.459+0000 7f85bbfff640 1 -- 172.21.15.5:0/4005222760 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9511+0+0 (secure 0 0 0) 0x7f85c81054a0 con 0x7f85d4104f80 2024-08-31T05:42:51.469 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.459+0000 7f85b97fa640 1 -- 172.21.15.5:0/4021517534 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f85c400faf0 con 0x5589686d32f0 2024-08-31T05:42:51.469 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.459+0000 7f85b97fa640 1 -- 172.21.15.5:0/4021517534 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c4019ac0 con 0x5589686d32f0 2024-08-31T05:42:51.469 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.460+0000 7f85d359e640 1 --2- 172.21.15.5:0/4005222760 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f85bc0b4ca0 0x7f85bc0b71b0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f85cc005fd0 tx=0x7f85cc011040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:51.469 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.460+0000 7f85e0043740 1 -- 172.21.15.5:0/4021517534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589686d32f0 msgr2=0x558968aa0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:51.469 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.460+0000 7f85e0043740 1 --2- 172.21.15.5:0/4021517534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589686d32f0 0x558968aa0000 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f85c40115f0 tx=0x7f85c4011ab0 comp rx=0 tx=0).stop 2024-08-31T05:42:51.469 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.460+0000 7f85e0043740 1 -- 172.21.15.5:0/4021517534 shutdown_connections 2024-08-31T05:42:51.469 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.460+0000 7f85e0043740 1 --2- 172.21.15.5:0/4021517534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589686db4d0 0x558968aa0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:51.469 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.460+0000 7f85e0043740 1 --2- 172.21.15.5:0/4021517534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589686d32f0 0x558968aa0000 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:51.469 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.460+0000 7f85e0043740 1 --2- 172.21.15.5:0/4021517534 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589686fc1b0 0x558968a9fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:51.470 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.460+0000 7f85e0043740 1 -- 172.21.15.5:0/4021517534 >> 172.21.15.5:0/4021517534 conn(0x5589686f0300 msgr2=0x558968a9d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:51.470 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.460+0000 7f85e0043740 1 -- 172.21.15.5:0/4021517534 shutdown_connections 2024-08-31T05:42:51.470 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.460+0000 7f85e0043740 1 -- 172.21.15.5:0/4021517534 wait complete. 2024-08-31T05:42:51.470 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.461+0000 7f85e0043740 1 -- start start 2024-08-31T05:42:51.470 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.461+0000 7f85e0043740 1 Processor -- start 2024-08-31T05:42:51.470 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.461+0000 7f85e0043740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589686d32f0 0x558968aaf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:51.470 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.461+0000 7f85e0043740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589686db4d0 0x558968aaff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:51.470 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.461+0000 7f85e0043740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589686fc1b0 0x558968abb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:51.470 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.461+0000 7f85e0043740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55896893dab0 con 0x5589686d32f0 2024-08-31T05:42:51.470 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.461+0000 7f85e0043740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55896898b680 con 0x5589686fc1b0 2024-08-31T05:42:51.470 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.461+0000 7f85e0043740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558968ab2620 con 0x5589686db4d0 2024-08-31T05:42:51.471 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.461+0000 7f85e0043740 10 client.0 _ll_register_callbacks cb 0x558968713a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:42:51.471 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.461+0000 7f85d2d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589686d32f0 0x558968aaf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:51.471 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.461+0000 7f85d2d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589686d32f0 0x558968aaf9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42342/0 (socket says 172.21.15.5:42342) 2024-08-31T05:42:51.471 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.461+0000 7f85d2d9d640 1 -- 172.21.15.5:0/4227588288 learned_addr learned my addr 172.21.15.5:0/4227588288 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:51.471 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.461+0000 7f85d259c640 1 --2- 172.21.15.5:0/4227588288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589686db4d0 0x558968aaff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:51.471 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.461+0000 7f85d359e640 1 --2- 172.21.15.5:0/4227588288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589686fc1b0 0x558968abb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:51.471 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.461+0000 7f85d2d9d640 1 -- 172.21.15.5:0/4227588288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589686db4d0 msgr2=0x558968aaff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:51.471 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.461+0000 7f85d2d9d640 1 --2- 172.21.15.5:0/4227588288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589686db4d0 0x558968aaff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:51.471 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.461+0000 7f85d2d9d640 1 -- 172.21.15.5:0/4227588288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589686fc1b0 msgr2=0x558968abb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:51.471 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.461+0000 7f85d2d9d640 1 --2- 172.21.15.5:0/4227588288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589686fc1b0 0x558968abb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:51.471 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.461+0000 7f85d2d9d640 1 -- 172.21.15.5:0/4227588288 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589687e0620 con 0x5589686d32f0 2024-08-31T05:42:51.471 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.461+0000 7f85d259c640 1 --2- 172.21.15.5:0/4227588288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589686db4d0 0x558968aaff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:42:51.471 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.462+0000 7f85d2d9d640 1 --2- 172.21.15.5:0/4227588288 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589686d32f0 0x558968aaf9d0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f85c401c040 tx=0x7f85c400f8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53fdf7bebd31b6f7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:51.472 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.462+0000 7f85b6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:42:51.472 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.462+0000 7f85b6ff5640 1 -- 172.21.15.5:0/4227588288 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c401e040 con 0x5589686d32f0 2024-08-31T05:42:51.472 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.462+0000 7f85b6ff5640 1 -- 172.21.15.5:0/4227588288 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9511+0+0 (secure 0 0 0) 0x7f85c4004040 con 0x5589686d32f0 2024-08-31T05:42:51.472 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.462+0000 7f85e0043740 1 -- 172.21.15.5:0/4227588288 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f85c400faf0 con 0x5589686d32f0 2024-08-31T05:42:51.472 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.462+0000 7f85b6ff5640 1 -- 172.21.15.5:0/4227588288 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f85c4030050 con 0x5589686d32f0 2024-08-31T05:42:51.472 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.462+0000 7f85e0043740 10 client.19041 fetch_fsmap learned FSMap version 34 2024-08-31T05:42:51.472 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.462+0000 7f85e0043740 1 -- 172.21.15.5:0/4227588288 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x558968abe650 con 0x5589686d32f0 2024-08-31T05:42:51.472 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.462+0000 7f85b6ff5640 1 -- 172.21.15.5:0/4227588288 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f85c400faf0 con 0x5589686d32f0 2024-08-31T05:42:51.472 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.462+0000 7f85b6ff5640 1 -- 172.21.15.5:0/4227588288 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f85c4021070 con 0x5589686d32f0 2024-08-31T05:42:51.472 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.462+0000 7f85e0043740 10 client.19041 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:42:51.472 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.462+0000 7f85e0043740 10 client.19041 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:42:51.472 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.462+0000 7f85e0043740 20 client.19041 populate_metadata read hostname 'smithi005' 2024-08-31T05:42:51.472 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.462+0000 7f85e0043740 1 --2- 172.21.15.5:0/4227588288 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5589686bad80 0x558968ac1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:51.472 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.462+0000 7f85e0043740 4 client.19041 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:42:51.473 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.462+0000 7f85e0043740 1 -- 172.21.15.5:0/4227588288 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558968a16f50 con 0x5589686bad80 2024-08-31T05:42:51.473 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.463+0000 7f85d259c640 1 --2- 172.21.15.5:0/4227588288 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5589686bad80 0x558968ac1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:51.473 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.463+0000 7f85d259c640 1 --2- 172.21.15.5:0/4227588288 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5589686bad80 0x558968ac1a00 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7326a80d112cf91e server_cookie=6ca5e2ac4af34168 in_seq=0 out_seq=0 2024-08-31T05:42:51.473 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.463+0000 7f85b6ff5640 10 client.19041 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:42:51.473 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.464+0000 7f85b6ff5640 1 -- 172.21.15.5:0/4227588288 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558968a16f50 con 0x5589686bad80 2024-08-31T05:42:51.473 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.464+0000 7f85b6ff5640 10 client.19041 handle_command_reply: tid=0 2024-08-31T05:42:51.473 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.464+0000 7f85e0043740 1 client.19041 shutdown 2024-08-31T05:42:51.473 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:42:51 smithi005 ceph-mon[18602]: pgmap v743: 129 pgs: 129 active+clean; 618 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 6.4 MiB/s wr, 225 op/s 2024-08-31T05:42:51.474 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.464+0000 7f85e0043740 1 -- 172.21.15.5:0/4227588288 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589686d32f0 msgr2=0x558968aaf9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:51.474 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.464+0000 7f85e0043740 1 --2- 172.21.15.5:0/4227588288 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589686d32f0 0x558968aaf9d0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f85c401c040 tx=0x7f85c400f8f0 comp rx=0 tx=0).stop 2024-08-31T05:42:51.474 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.464+0000 7f85e0043740 1 -- 172.21.15.5:0/4227588288 shutdown_connections 2024-08-31T05:42:51.475 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.464+0000 7f85e0043740 1 --2- 172.21.15.5:0/4227588288 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5589686bad80 0x558968ac1a00 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:51.475 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.464+0000 7f85e0043740 1 --2- 172.21.15.5:0/4227588288 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589686fc1b0 0x558968abb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:51.475 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.464+0000 7f85e0043740 1 --2- 172.21.15.5:0/4227588288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589686db4d0 0x558968aaff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:51.475 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.464+0000 7f85b6ff5640 0 client.19041 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:42:51.475 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.464+0000 7f85e0043740 1 --2- 172.21.15.5:0/4227588288 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589686d32f0 0x558968aaf9d0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:51.475 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.464+0000 7f85e0043740 1 -- 172.21.15.5:0/4227588288 >> 172.21.15.5:0/4227588288 conn(0x5589686f0300 msgr2=0x558968a9bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:51.475 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.464+0000 7f85e0043740 1 -- 172.21.15.5:0/4227588288 shutdown_connections 2024-08-31T05:42:51.475 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.464+0000 7f85e0043740 1 -- 172.21.15.5:0/4227588288 wait complete. 2024-08-31T05:42:51.475 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.464+0000 7f85e0043740 20 client.19041 trim_cache size 0 max 16384 2024-08-31T05:42:51.483 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.479+0000 7f85e0043740 1 Processor -- start 2024-08-31T05:42:51.483 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.479+0000 7f85e0043740 1 -- start start 2024-08-31T05:42:51.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.479+0000 7f85e0043740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589686d32f0 0x558968aa14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:51.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.479+0000 7f85e0043740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589686db4d0 0x558968ab1380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:51.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.479+0000 7f85e0043740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589686fc1b0 0x558968aac990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:51.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.479+0000 7f85e0043740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f85d41aeae0 con 0x5589686db4d0 2024-08-31T05:42:51.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.479+0000 7f85e0043740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f85d41b0620 con 0x5589686d32f0 2024-08-31T05:42:51.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.479+0000 7f85e0043740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f85d41af1b0 con 0x5589686fc1b0 2024-08-31T05:42:51.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.479+0000 7f85d259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589686db4d0 0x558968ab1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:51.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.479+0000 7f85d259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589686db4d0 0x558968ab1380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42352/0 (socket says 172.21.15.5:42352) 2024-08-31T05:42:51.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.479+0000 7f85d259c640 1 -- 172.21.15.5:0/371410883 learned_addr learned my addr 172.21.15.5:0/371410883 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:51.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.479+0000 7f85d2d9d640 1 --2- 172.21.15.5:0/371410883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589686d32f0 0x558968aa14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:51.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.479+0000 7f85d359e640 1 --2- 172.21.15.5:0/371410883 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589686fc1b0 0x558968aac990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:51.484 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.480+0000 7f85d259c640 1 -- 172.21.15.5:0/371410883 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589686fc1b0 msgr2=0x558968aac990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:51.485 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.480+0000 7f85d259c640 1 --2- 172.21.15.5:0/371410883 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589686fc1b0 0x558968aac990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:51.485 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.480+0000 7f85d259c640 1 -- 172.21.15.5:0/371410883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589686d32f0 msgr2=0x558968aa14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:51.485 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.480+0000 7f85d259c640 1 --2- 172.21.15.5:0/371410883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589686d32f0 0x558968aa14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:51.485 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.480+0000 7f85d259c640 1 -- 172.21.15.5:0/371410883 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558968aa08b0 con 0x5589686db4d0 2024-08-31T05:42:51.485 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.480+0000 7f85d259c640 1 --2- 172.21.15.5:0/371410883 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589686db4d0 0x558968ab1380 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f85c8005940 tx=0x7f85c80c7040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ce41e7c158cf1f7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:51.485 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.480+0000 7f85b8ff9640 1 -- 172.21.15.5:0/371410883 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c80c7710 con 0x5589686db4d0 2024-08-31T05:42:51.485 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.480+0000 7f85b8ff9640 1 -- 172.21.15.5:0/371410883 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f85c80cb360 con 0x5589686db4d0 2024-08-31T05:42:51.485 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.480+0000 7f85b8ff9640 1 -- 172.21.15.5:0/371410883 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c80cafc0 con 0x5589686db4d0 2024-08-31T05:42:51.489 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.481+0000 7f85e0043740 1 -- 172.21.15.5:0/371410883 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589686db4d0 msgr2=0x558968ab1380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:51.489 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.481+0000 7f85e0043740 1 --2- 172.21.15.5:0/371410883 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589686db4d0 0x558968ab1380 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f85c8005940 tx=0x7f85c80c7040 comp rx=0 tx=0).stop 2024-08-31T05:42:51.489 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.481+0000 7f85e0043740 1 -- 172.21.15.5:0/371410883 shutdown_connections 2024-08-31T05:42:51.489 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.481+0000 7f85e0043740 1 --2- 172.21.15.5:0/371410883 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589686fc1b0 0x558968aac990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:51.489 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.481+0000 7f85e0043740 1 --2- 172.21.15.5:0/371410883 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589686db4d0 0x558968ab1380 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:51.489 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.481+0000 7f85e0043740 1 --2- 172.21.15.5:0/371410883 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589686d32f0 0x558968aa14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:51.489 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.481+0000 7f85e0043740 1 -- 172.21.15.5:0/371410883 >> 172.21.15.5:0/371410883 conn(0x5589686f0300 msgr2=0x558968ab0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:51.489 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.481+0000 7f85e0043740 1 -- 172.21.15.5:0/371410883 shutdown_connections 2024-08-31T05:42:51.489 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.481+0000 7f85e0043740 1 -- 172.21.15.5:0/371410883 wait complete. 2024-08-31T05:42:51.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.481+0000 7f85e0043740 1 -- start start 2024-08-31T05:42:51.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.481+0000 7f85e0043740 1 Processor -- start 2024-08-31T05:42:51.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.482+0000 7f85e0043740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589686d32f0 0x558968ab50f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:51.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.482+0000 7f85e0043740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589686db4d0 0x558968ab5630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:51.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.482+0000 7f85e0043740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589686fc1b0 0x558968b2a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:51.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.482+0000 7f85e0043740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f85d41aff50 con 0x5589686d32f0 2024-08-31T05:42:51.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.482+0000 7f85e0043740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f85d41af880 con 0x5589686db4d0 2024-08-31T05:42:51.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.482+0000 7f85e0043740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f85d41acae0 con 0x5589686fc1b0 2024-08-31T05:42:51.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.482+0000 7f85e0043740 10 client.0 _ll_register_callbacks cb 0x7f85c401c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:42:51.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.482+0000 7f85d2d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589686d32f0 0x558968ab50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:51.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.482+0000 7f85d2d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589686d32f0 0x558968ab50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42354/0 (socket says 172.21.15.5:42354) 2024-08-31T05:42:51.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.482+0000 7f85d2d9d640 1 -- 172.21.15.5:0/2443686459 learned_addr learned my addr 172.21.15.5:0/2443686459 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:42:51.490 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.482+0000 7f85d259c640 1 --2- 172.21.15.5:0/2443686459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589686db4d0 0x558968ab5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:51.491 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.482+0000 7f85d359e640 1 --2- 172.21.15.5:0/2443686459 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589686fc1b0 0x558968b2a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:51.491 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.482+0000 7f85d2d9d640 1 -- 172.21.15.5:0/2443686459 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589686fc1b0 msgr2=0x558968b2a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:51.491 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.482+0000 7f85d2d9d640 1 --2- 172.21.15.5:0/2443686459 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589686fc1b0 0x558968b2a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:51.491 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.482+0000 7f85d2d9d640 1 -- 172.21.15.5:0/2443686459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589686db4d0 msgr2=0x558968ab5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:42:51.491 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.482+0000 7f85d2d9d640 1 --2- 172.21.15.5:0/2443686459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589686db4d0 0x558968ab5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:51.491 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.482+0000 7f85d2d9d640 1 -- 172.21.15.5:0/2443686459 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558968b2a900 con 0x5589686d32f0 2024-08-31T05:42:51.491 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.482+0000 7f85d259c640 1 --2- 172.21.15.5:0/2443686459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589686db4d0 0x558968ab5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:42:51.491 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.482+0000 7f85d2d9d640 1 --2- 172.21.15.5:0/2443686459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589686d32f0 0x558968ab50f0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f85c401c040 tx=0x7f85c4009fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7357c1a13fa9ac1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:42:51.491 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.482+0000 7f85b6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:42:51.491 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.482+0000 7f85b6ff5640 1 -- 172.21.15.5:0/2443686459 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c401e040 con 0x5589686d32f0 2024-08-31T05:42:51.491 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.482+0000 7f85b6ff5640 1 -- 172.21.15.5:0/2443686459 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9511+0+0 (secure 0 0 0) 0x7f85c4003880 con 0x5589686d32f0 2024-08-31T05:42:51.491 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.482+0000 7f85e0043740 1 -- 172.21.15.5:0/2443686459 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f85c80cb360 con 0x5589686d32f0 2024-08-31T05:42:51.491 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.483+0000 7f85b6ff5640 1 -- 172.21.15.5:0/2443686459 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f85c4042050 con 0x5589686d32f0 2024-08-31T05:42:51.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.483+0000 7f85e0043740 10 client.19047 fetch_fsmap learned FSMap version 34 2024-08-31T05:42:51.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.483+0000 7f85e0043740 1 -- 172.21.15.5:0/2443686459 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x558968b2bb90 con 0x5589686d32f0 2024-08-31T05:42:51.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.483+0000 7f85b6ff5640 1 -- 172.21.15.5:0/2443686459 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f85c80cb360 con 0x5589686d32f0 2024-08-31T05:42:51.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.483+0000 7f85b6ff5640 1 -- 172.21.15.5:0/2443686459 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f85c4021040 con 0x5589686d32f0 2024-08-31T05:42:51.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.483+0000 7f85e0043740 10 client.19047 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:42:51.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.483+0000 7f85e0043740 10 client.19047 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:42:51.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.483+0000 7f85e0043740 20 client.19047 populate_metadata read hostname 'smithi005' 2024-08-31T05:42:51.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.483+0000 7f85e0043740 1 --2- 172.21.15.5:0/2443686459 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5589686901c0 0x558968b2e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:42:51.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.483+0000 7f85e0043740 4 client.19047 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:42:51.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.483+0000 7f85e0043740 1 -- 172.21.15.5:0/2443686459 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558968a129f0 con 0x5589686901c0 2024-08-31T05:42:51.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.483+0000 7f85d259c640 1 --2- 172.21.15.5:0/2443686459 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5589686901c0 0x558968b2e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:42:51.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.484+0000 7f85b6ff5640 10 client.19047 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:42:51.492 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.484+0000 7f85d259c640 1 --2- 172.21.15.5:0/2443686459 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5589686901c0 0x558968b2e310 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=226ac3db9516968d server_cookie=59c035cc4d189546 in_seq=0 out_seq=0 2024-08-31T05:42:51.502 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.499+0000 7f85b6ff5640 1 -- 172.21.15.5:0/2443686459 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558968a129f0 con 0x5589686901c0 2024-08-31T05:42:51.502 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.499+0000 7f85b6ff5640 10 client.19047 handle_command_reply: tid=0 2024-08-31T05:42:51.502 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.499+0000 7f85e0043740 1 client.19047 shutdown 2024-08-31T05:42:51.502 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.499+0000 7f85e0043740 1 -- 172.21.15.5:0/2443686459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589686d32f0 msgr2=0x558968ab50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:51.503 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.499+0000 7f85e0043740 1 --2- 172.21.15.5:0/2443686459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589686d32f0 0x558968ab50f0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f85c401c040 tx=0x7f85c4009fd0 comp rx=0 tx=0).stop 2024-08-31T05:42:51.503 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.499+0000 7f85e0043740 1 -- 172.21.15.5:0/2443686459 shutdown_connections 2024-08-31T05:42:51.503 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.499+0000 7f85e0043740 1 --2- 172.21.15.5:0/2443686459 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5589686901c0 0x558968b2e310 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:51.503 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.499+0000 7f85e0043740 1 --2- 172.21.15.5:0/2443686459 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589686fc1b0 0x558968b2a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:51.503 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.499+0000 7f85b6ff5640 0 client.19047 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:42:51.503 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.499+0000 7f85e0043740 1 --2- 172.21.15.5:0/2443686459 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5589686db4d0 0x558968ab5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:51.503 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.499+0000 7f85e0043740 1 --2- 172.21.15.5:0/2443686459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5589686d32f0 0x558968ab50f0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:51.503 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.499+0000 7f85e0043740 1 -- 172.21.15.5:0/2443686459 >> 172.21.15.5:0/2443686459 conn(0x5589686f0300 msgr2=0x558968aa1280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:51.503 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.499+0000 7f85e0043740 1 -- 172.21.15.5:0/2443686459 shutdown_connections 2024-08-31T05:42:51.503 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.499+0000 7f85e0043740 1 -- 172.21.15.5:0/2443686459 wait complete. 2024-08-31T05:42:51.503 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.499+0000 7f85e0043740 20 client.19047 trim_cache size 0 max 16384 2024-08-31T05:42:51.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:42:51.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:42:51.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:42:51.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:42:51.505 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.500+0000 7f85d90d3640 1 -- 172.21.15.5:0/4005222760 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f85bc0b4ca0 msgr2=0x7f85bc0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:51.505 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.500+0000 7f85d90d3640 1 --2- 172.21.15.5:0/4005222760 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f85bc0b4ca0 0x7f85bc0b71b0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f85cc005fd0 tx=0x7f85cc011040 comp rx=0 tx=0).stop 2024-08-31T05:42:51.505 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.500+0000 7f85d90d3640 1 -- 172.21.15.5:0/4005222760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85d4104f80 msgr2=0x7f85d419a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:42:51.505 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.500+0000 7f85d90d3640 1 --2- 172.21.15.5:0/4005222760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85d4104f80 0x7f85d419a790 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f85c8035040 tx=0x7f85c8032d50 comp rx=0 tx=0).stop 2024-08-31T05:42:51.505 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.500+0000 7f85d90d3640 1 -- 172.21.15.5:0/4005222760 shutdown_connections 2024-08-31T05:42:51.505 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.500+0000 7f85d90d3640 1 --2- 172.21.15.5:0/4005222760 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f85bc0b4ca0 0x7f85bc0b71b0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:51.505 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.500+0000 7f85d90d3640 1 --2- 172.21.15.5:0/4005222760 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f85d410db00 0x7f85d419fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:51.505 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.500+0000 7f85d90d3640 1 --2- 172.21.15.5:0/4005222760 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85d4104f80 0x7f85d419a790 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:51.505 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.500+0000 7f85d90d3640 1 --2- 172.21.15.5:0/4005222760 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85d4104550 0x7f85d419a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:42:51.505 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.500+0000 7f85d90d3640 1 -- 172.21.15.5:0/4005222760 >> 172.21.15.5:0/4005222760 conn(0x7f85d40fe160 msgr2=0x7f85d4107700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:42:51.505 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.500+0000 7f85d90d3640 1 -- 172.21.15.5:0/4005222760 shutdown_connections 2024-08-31T05:42:51.506 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:42:51.500+0000 7f85d90d3640 1 -- 172.21.15.5:0/4005222760 wait complete. 2024-08-31T05:42:51.942 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1446800 10.74 MB/sec execute 579 sec latency 27.942 ms 2024-08-31T05:42:52.943 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1449364 10.74 MB/sec execute 580 sec latency 15.830 ms 2024-08-31T05:42:53.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:42:53 smithi070 ceph-mon[22316]: pgmap v744: 129 pgs: 129 active+clean; 623 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.6 MiB/s wr, 187 op/s 2024-08-31T05:42:53.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:42:53 smithi070 ceph-mon[22316]: scrub summary: idle 2024-08-31T05:42:53.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:42:53 smithi050 ceph-mon[22146]: pgmap v744: 129 pgs: 129 active+clean; 623 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.6 MiB/s wr, 187 op/s 2024-08-31T05:42:53.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:42:53 smithi050 ceph-mon[22146]: scrub summary: idle 2024-08-31T05:42:53.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:42:53 smithi005 ceph-mon[18602]: pgmap v744: 129 pgs: 129 active+clean; 623 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.6 MiB/s wr, 187 op/s 2024-08-31T05:42:53.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:42:53 smithi005 ceph-mon[18602]: scrub summary: idle 2024-08-31T05:42:53.943 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1450960 10.74 MB/sec execute 581 sec latency 30.999 ms 2024-08-31T05:42:54.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:42:54 smithi070 ceph-mon[22316]: scrub summary: idle 2024-08-31T05:42:54.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:42:54 smithi050 ceph-mon[22146]: scrub summary: idle 2024-08-31T05:42:54.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:42:54 smithi005 ceph-mon[18602]: scrub summary: idle 2024-08-31T05:42:54.942 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1453191 10.74 MB/sec execute 582 sec latency 70.328 ms 2024-08-31T05:42:55.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:42:55 smithi070 ceph-mon[22316]: pgmap v745: 129 pgs: 129 active+clean; 625 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.7 MiB/s wr, 192 op/s 2024-08-31T05:42:55.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:42:55 smithi050 ceph-mon[22146]: pgmap v745: 129 pgs: 129 active+clean; 625 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.7 MiB/s wr, 192 op/s 2024-08-31T05:42:55.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:42:55 smithi005 ceph-mon[18602]: pgmap v745: 129 pgs: 129 active+clean; 625 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.7 MiB/s wr, 192 op/s 2024-08-31T05:42:55.942 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1454156 10.73 MB/sec execute 583 sec latency 71.002 ms 2024-08-31T05:42:56.943 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1456444 10.73 MB/sec execute 584 sec latency 16.294 ms 2024-08-31T05:42:57.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:42:57 smithi070 ceph-mon[22316]: pgmap v746: 129 pgs: 129 active+clean; 629 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 6.5 MiB/s wr, 235 op/s 2024-08-31T05:42:57.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:42:57 smithi050 ceph-mon[22146]: pgmap v746: 129 pgs: 129 active+clean; 629 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 6.5 MiB/s wr, 235 op/s 2024-08-31T05:42:57.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:42:57 smithi005 ceph-mon[18602]: pgmap v746: 129 pgs: 129 active+clean; 629 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 6.5 MiB/s wr, 235 op/s 2024-08-31T05:42:57.943 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1458160 10.73 MB/sec execute 585 sec latency 14.774 ms 2024-08-31T05:42:58.943 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1460580 10.74 MB/sec execute 586 sec latency 14.408 ms 2024-08-31T05:42:59.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:42:59 smithi070 ceph-mon[22316]: pgmap v747: 129 pgs: 129 active+clean; 635 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 6.3 MiB/s wr, 220 op/s 2024-08-31T05:42:59.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:42:59 smithi050 ceph-mon[22146]: pgmap v747: 129 pgs: 129 active+clean; 635 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 6.3 MiB/s wr, 220 op/s 2024-08-31T05:42:59.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:42:59 smithi005 ceph-mon[18602]: pgmap v747: 129 pgs: 129 active+clean; 635 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 6.3 MiB/s wr, 220 op/s 2024-08-31T05:42:59.943 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1462034 10.73 MB/sec execute 587 sec latency 28.430 ms 2024-08-31T05:43:00.943 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1464006 10.73 MB/sec execute 588 sec latency 43.563 ms 2024-08-31T05:43:01.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:01 smithi070 ceph-mon[22316]: pgmap v748: 129 pgs: 129 active+clean; 647 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 6.8 MiB/s wr, 262 op/s 2024-08-31T05:43:01.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:01 smithi050 ceph-mon[22146]: pgmap v748: 129 pgs: 129 active+clean; 647 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 6.8 MiB/s wr, 262 op/s 2024-08-31T05:43:01.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:01 smithi005 ceph-mon[18602]: pgmap v748: 129 pgs: 129 active+clean; 647 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 6.8 MiB/s wr, 262 op/s 2024-08-31T05:43:01.943 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1464775 10.72 MB/sec execute 589 sec latency 98.618 ms 2024-08-31T05:43:02.943 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1465740 10.71 MB/sec execute 590 sec latency 56.688 ms 2024-08-31T05:43:03.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:03 smithi070 ceph-mon[22316]: pgmap v749: 129 pgs: 129 active+clean; 647 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.3 MiB/s wr, 195 op/s 2024-08-31T05:43:03.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:03 smithi050 ceph-mon[22146]: pgmap v749: 129 pgs: 129 active+clean; 647 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.3 MiB/s wr, 195 op/s 2024-08-31T05:43:03.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:03 smithi005 ceph-mon[18602]: pgmap v749: 129 pgs: 129 active+clean; 647 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.3 MiB/s wr, 195 op/s 2024-08-31T05:43:03.943 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1467804 10.71 MB/sec execute 591 sec latency 24.360 ms 2024-08-31T05:43:04.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:04 smithi070 ceph-mon[22316]: osdmap e100: 12 total, 12 up, 12 in 2024-08-31T05:43:04.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:04 smithi050 ceph-mon[22146]: osdmap e100: 12 total, 12 up, 12 in 2024-08-31T05:43:04.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:04 smithi005 ceph-mon[18602]: osdmap e100: 12 total, 12 up, 12 in 2024-08-31T05:43:04.609 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.605+0000 7f83bebc6640 1 -- 172.21.15.5:0/4008021566 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83b81027a0 msgr2=0x7f83b8102bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:04.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.605+0000 7f83bebc6640 1 --2- 172.21.15.5:0/4008021566 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83b81027a0 0x7f83b8102bb0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f83a0009900 tx=0x7f83a002a410 comp rx=0 tx=0).stop 2024-08-31T05:43:04.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.605+0000 7f83bebc6640 1 -- 172.21.15.5:0/4008021566 shutdown_connections 2024-08-31T05:43:04.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.605+0000 7f83bebc6640 1 --2- 172.21.15.5:0/4008021566 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83b8108a20 0x7f83b810f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:04.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.605+0000 7f83bebc6640 1 --2- 172.21.15.5:0/4008021566 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83b81080d0 0x7f83b81084e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:04.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.605+0000 7f83bebc6640 1 --2- 172.21.15.5:0/4008021566 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83b81027a0 0x7f83b8102bb0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:04.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.605+0000 7f83bebc6640 1 -- 172.21.15.5:0/4008021566 >> 172.21.15.5:0/4008021566 conn(0x7f83b80fe1a0 msgr2=0x7f83b81005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:04.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.605+0000 7f83bebc6640 1 -- 172.21.15.5:0/4008021566 shutdown_connections 2024-08-31T05:43:04.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.605+0000 7f83bebc6640 1 -- 172.21.15.5:0/4008021566 wait complete. 2024-08-31T05:43:04.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.606+0000 7f83bebc6640 1 Processor -- start 2024-08-31T05:43:04.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.606+0000 7f83bebc6640 1 -- start start 2024-08-31T05:43:04.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.606+0000 7f83bebc6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83b81027a0 0x7f83b810fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:04.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.606+0000 7f83bebc6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83b81080d0 0x7f83b8110270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:04.610 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.606+0000 7f83bebc6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83b8108a20 0x7f83b81107b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:04.611 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.606+0000 7f83bebc6640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f83b8113800 con 0x7f83b8108a20 2024-08-31T05:43:04.611 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.606+0000 7f83bebc6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f83b8113680 con 0x7f83b81027a0 2024-08-31T05:43:04.611 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.606+0000 7f83bebc6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f83b8113980 con 0x7f83b81080d0 2024-08-31T05:43:04.611 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.607+0000 7f83bc962640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83b81027a0 0x7f83b810fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:04.611 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.607+0000 7f83bd163640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83b8108a20 0x7f83b81107b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:04.611 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.607+0000 7f83b7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83b81080d0 0x7f83b8110270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:04.611 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.607+0000 7f83bc962640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83b81027a0 0x7f83b810fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:35676/0 (socket says 172.21.15.5:35676) 2024-08-31T05:43:04.611 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.607+0000 7f83bc962640 1 -- 172.21.15.5:0/1020603773 learned_addr learned my addr 172.21.15.5:0/1020603773 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:04.611 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.607+0000 7f83bc962640 1 -- 172.21.15.5:0/1020603773 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83b81080d0 msgr2=0x7f83b8110270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:04.611 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.607+0000 7f83bc962640 1 --2- 172.21.15.5:0/1020603773 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83b81080d0 0x7f83b8110270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:04.611 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.607+0000 7f83bc962640 1 -- 172.21.15.5:0/1020603773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83b8108a20 msgr2=0x7f83b81107b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:04.611 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.607+0000 7f83bc962640 1 --2- 172.21.15.5:0/1020603773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83b8108a20 0x7f83b81107b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:04.611 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.607+0000 7f83bc962640 1 -- 172.21.15.5:0/1020603773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83b81a8550 con 0x7f83b81027a0 2024-08-31T05:43:04.611 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.607+0000 7f83b7fff640 1 --2- 172.21.15.5:0/1020603773 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83b81080d0 0x7f83b8110270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:43:04.612 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.607+0000 7f83bd163640 1 --2- 172.21.15.5:0/1020603773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83b8108a20 0x7f83b81107b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:43:04.612 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.607+0000 7f83bc962640 1 --2- 172.21.15.5:0/1020603773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83b81027a0 0x7f83b810fd30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f83a0005940 tx=0x7f83a00040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:04.612 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.607+0000 7f83b5ffb640 1 -- 172.21.15.5:0/1020603773 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a003f030 con 0x7f83b81027a0 2024-08-31T05:43:04.612 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.607+0000 7f83bebc6640 1 -- 172.21.15.5:0/1020603773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83b81a87e0 con 0x7f83b81027a0 2024-08-31T05:43:04.612 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.607+0000 7f83b5ffb640 1 -- 172.21.15.5:0/1020603773 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83a00044c0 con 0x7f83b81027a0 2024-08-31T05:43:04.612 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.607+0000 7f83b5ffb640 1 -- 172.21.15.5:0/1020603773 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a0035070 con 0x7f83b81027a0 2024-08-31T05:43:04.612 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.608+0000 7f83bebc6640 1 -- 172.21.15.5:0/1020603773 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83b81a8cd0 con 0x7f83b81027a0 2024-08-31T05:43:04.613 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.610+0000 7f83b5ffb640 1 -- 172.21.15.5:0/1020603773 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f83a0042030 con 0x7f83b81027a0 2024-08-31T05:43:04.613 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.611+0000 7f83c5c1a740 1 Processor -- start 2024-08-31T05:43:04.613 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.611+0000 7f83c5c1a740 1 -- start start 2024-08-31T05:43:04.613 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.611+0000 7f83c5c1a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e45f221b0 0x560e462c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:04.613 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.611+0000 7f83c5c1a740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e45ef92f0 0x560e462c6220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:04.614 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.611+0000 7f83c5c1a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e45f014d0 0x560e462c6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:04.614 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.611+0000 7f83c5c1a740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x560e4623b000 con 0x560e45ef92f0 2024-08-31T05:43:04.614 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.611+0000 7f83c5c1a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560e4622a590 con 0x560e45f221b0 2024-08-31T05:43:04.614 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.611+0000 7f83c5c1a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560e4622e540 con 0x560e45f014d0 2024-08-31T05:43:04.614 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.611+0000 7f83bd163640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e45f221b0 0x560e462c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:04.614 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.611+0000 7f83bd163640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e45f221b0 0x560e462c5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:35678/0 (socket says 172.21.15.5:35678) 2024-08-31T05:43:04.614 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.611+0000 7f83bd163640 1 -- 172.21.15.5:0/97548078 learned_addr learned my addr 172.21.15.5:0/97548078 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:04.614 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.611+0000 7f83bc962640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e45ef92f0 0x560e462c6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:04.614 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.611+0000 7f83b5ffb640 1 --2- 172.21.15.5:0/1020603773 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f83a40b4cd0 0x7f83a40b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:04.614 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.611+0000 7f83b7fff640 1 --2- 172.21.15.5:0/97548078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e45f014d0 0x560e462c6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:04.618 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.612+0000 7f83bd163640 1 -- 172.21.15.5:0/97548078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e45f014d0 msgr2=0x560e462c6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:04.618 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.612+0000 7f83bd163640 1 --2- 172.21.15.5:0/97548078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e45f014d0 0x560e462c6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:04.618 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.612+0000 7f83bd163640 1 -- 172.21.15.5:0/97548078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e45ef92f0 msgr2=0x560e462c6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:04.618 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.612+0000 7f83bd163640 1 --2- 172.21.15.5:0/97548078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e45ef92f0 0x560e462c6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:04.618 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.612+0000 7f83bd163640 1 -- 172.21.15.5:0/97548078 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e45f8d790 con 0x560e45f221b0 2024-08-31T05:43:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.612+0000 7f83b7fff640 1 --2- 172.21.15.5:0/97548078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e45f014d0 0x560e462c6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:43:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.612+0000 7f83b5ffb640 1 -- 172.21.15.5:0/1020603773 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9599+0+0 (secure 0 0 0) 0x7f83a0105d10 con 0x7f83b81027a0 2024-08-31T05:43:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.612+0000 7f83bd163640 1 --2- 172.21.15.5:0/1020603773 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f83a40b4cd0 0x7f83a40b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.612+0000 7f83bd163640 1 --2- 172.21.15.5:0/97548078 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e45f221b0 0x560e462c5ce0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f83b0011900 tx=0x7f83b0011dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f290f649cbf2da57 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.612+0000 7f83aeffd640 1 -- 172.21.15.5:0/97548078 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b0017050 con 0x560e45f221b0 2024-08-31T05:43:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.612+0000 7f83aeffd640 1 -- 172.21.15.5:0/97548078 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83b0026440 con 0x560e45f221b0 2024-08-31T05:43:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.612+0000 7f83aeffd640 1 -- 172.21.15.5:0/97548078 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b000e5b0 con 0x560e45f221b0 2024-08-31T05:43:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.613+0000 7f83c5c1a740 1 -- 172.21.15.5:0/97548078 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e45f221b0 msgr2=0x560e462c5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.613+0000 7f83bd163640 1 --2- 172.21.15.5:0/1020603773 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f83a40b4cd0 0x7f83a40b71e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f83b0023000 tx=0x7f83b0024000 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.613+0000 7f83c5c1a740 1 --2- 172.21.15.5:0/97548078 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e45f221b0 0x560e462c5ce0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f83b0011900 tx=0x7f83b0011dc0 comp rx=0 tx=0).stop 2024-08-31T05:43:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.613+0000 7f83c5c1a740 1 -- 172.21.15.5:0/97548078 shutdown_connections 2024-08-31T05:43:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.613+0000 7f83c5c1a740 1 --2- 172.21.15.5:0/97548078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e45f014d0 0x560e462c6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.613+0000 7f83c5c1a740 1 --2- 172.21.15.5:0/97548078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e45ef92f0 0x560e462c6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:04.620 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.613+0000 7f83c5c1a740 1 --2- 172.21.15.5:0/97548078 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e45f221b0 0x560e462c5ce0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:04.620 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.613+0000 7f83c5c1a740 1 -- 172.21.15.5:0/97548078 >> 172.21.15.5:0/97548078 conn(0x560e45f16300 msgr2=0x560e462c3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:04.620 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.613+0000 7f83c5c1a740 1 -- 172.21.15.5:0/97548078 shutdown_connections 2024-08-31T05:43:04.620 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.613+0000 7f83c5c1a740 1 -- 172.21.15.5:0/97548078 wait complete. 2024-08-31T05:43:04.620 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.614+0000 7f83c5c1a740 1 -- start start 2024-08-31T05:43:04.620 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.614+0000 7f83c5c1a740 1 Processor -- start 2024-08-31T05:43:04.620 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.614+0000 7f83c5c1a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e45ef92f0 0x560e462d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:04.620 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.614+0000 7f83c5c1a740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e45f014d0 0x560e462d1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:04.620 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.614+0000 7f83c5c1a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e45f221b0 0x560e462dd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:04.620 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.614+0000 7f83c5c1a740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x560e46163ab0 con 0x560e45f014d0 2024-08-31T05:43:04.620 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.614+0000 7f83c5c1a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x560e461b1680 con 0x560e45ef92f0 2024-08-31T05:43:04.620 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.614+0000 7f83c5c1a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560e462d4460 con 0x560e45f221b0 2024-08-31T05:43:04.620 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.614+0000 7f83c5c1a740 10 client.0 _ll_register_callbacks cb 0x560e45f39a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:43:04.620 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.614+0000 7f83b7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e45f014d0 0x560e462d1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:04.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.614+0000 7f83bc962640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e45ef92f0 0x560e462d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:04.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.614+0000 7f83bc962640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e45ef92f0 0x560e462d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:35680/0 (socket says 172.21.15.5:35680) 2024-08-31T05:43:04.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.614+0000 7f83bc962640 1 -- 172.21.15.5:0/2996782495 learned_addr learned my addr 172.21.15.5:0/2996782495 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:04.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.614+0000 7f83bd163640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e45f221b0 0x560e462dd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:04.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.615+0000 7f83bc962640 1 -- 172.21.15.5:0/2996782495 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e45f221b0 msgr2=0x560e462dd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:04.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.615+0000 7f83bc962640 1 --2- 172.21.15.5:0/2996782495 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e45f221b0 0x560e462dd750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:04.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.615+0000 7f83bc962640 1 -- 172.21.15.5:0/2996782495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e45f014d0 msgr2=0x560e462d1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:04.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.615+0000 7f83bc962640 1 --2- 172.21.15.5:0/2996782495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e45f014d0 0x560e462d1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:04.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.615+0000 7f83bc962640 1 -- 172.21.15.5:0/2996782495 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e46006620 con 0x560e45ef92f0 2024-08-31T05:43:04.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.615+0000 7f83b7fff640 1 --2- 172.21.15.5:0/2996782495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e45f014d0 0x560e462d1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:43:04.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.615+0000 7f83bc962640 1 --2- 172.21.15.5:0/2996782495 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e45ef92f0 0x560e462d1920 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f83a0103030 tx=0x7f83a0103590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b38375642914e03b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:04.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.615+0000 7f8397fff640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:43:04.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.615+0000 7f8397fff640 1 -- 172.21.15.5:0/2996782495 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a0049040 con 0x560e45ef92f0 2024-08-31T05:43:04.621 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.615+0000 7f8397fff640 1 -- 172.21.15.5:0/2996782495 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9599+0+0 (secure 0 0 0) 0x7f83a00d4e00 con 0x560e45ef92f0 2024-08-31T05:43:04.622 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.615+0000 7f83c5c1a740 1 -- 172.21.15.5:0/2996782495 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83b0026440 con 0x560e45ef92f0 2024-08-31T05:43:04.622 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.615+0000 7f8397fff640 1 -- 172.21.15.5:0/2996782495 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f83a00cbb30 con 0x560e45ef92f0 2024-08-31T05:43:04.622 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.615+0000 7f83c5c1a740 10 client.28622 fetch_fsmap learned FSMap version 34 2024-08-31T05:43:04.622 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.615+0000 7f83c5c1a740 1 -- 172.21.15.5:0/2996782495 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x560e462e04f0 con 0x560e45ef92f0 2024-08-31T05:43:04.622 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.615+0000 7f8397fff640 1 -- 172.21.15.5:0/2996782495 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83b0026440 con 0x560e45ef92f0 2024-08-31T05:43:04.622 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.616+0000 7f8397fff640 1 -- 172.21.15.5:0/2996782495 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f83a010a040 con 0x560e45ef92f0 2024-08-31T05:43:04.622 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.616+0000 7f83c5c1a740 10 client.28622 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:43:04.622 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.616+0000 7f83c5c1a740 10 client.28622 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:43:04.622 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.616+0000 7f83c5c1a740 20 client.28622 populate_metadata read hostname 'smithi005' 2024-08-31T05:43:04.622 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.616+0000 7f83c5c1a740 1 --2- 172.21.15.5:0/2996782495 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x560e45ee0d80 0x560e462e3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:04.622 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.616+0000 7f83c5c1a740 4 client.28622 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:43:04.622 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.616+0000 7f83c5c1a740 1 -- 172.21.15.5:0/2996782495 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560e4623cf50 con 0x560e45ee0d80 2024-08-31T05:43:04.622 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.616+0000 7f83b7fff640 1 --2- 172.21.15.5:0/2996782495 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x560e45ee0d80 0x560e462e3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:04.622 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.616+0000 7f8397fff640 10 client.28622 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:43:04.623 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.616+0000 7f83b7fff640 1 --2- 172.21.15.5:0/2996782495 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x560e45ee0d80 0x560e462e3aa0 crc :-1 s=READY pgs=287 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91fcc0bf89b41725 server_cookie=362a26baba019dea in_seq=0 out_seq=0 2024-08-31T05:43:04.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.617+0000 7f8397fff640 1 -- 172.21.15.5:0/2996782495 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560e4623cf50 con 0x560e45ee0d80 2024-08-31T05:43:04.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.617+0000 7f8397fff640 10 client.28622 handle_command_reply: tid=0 2024-08-31T05:43:04.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.617+0000 7f83c5c1a740 1 client.28622 shutdown 2024-08-31T05:43:04.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.617+0000 7f83c5c1a740 1 -- 172.21.15.5:0/2996782495 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e45ef92f0 msgr2=0x560e462d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:04.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.617+0000 7f83c5c1a740 1 --2- 172.21.15.5:0/2996782495 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e45ef92f0 0x560e462d1920 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f83a0103030 tx=0x7f83a0103590 comp rx=0 tx=0).stop 2024-08-31T05:43:04.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.617+0000 7f83c5c1a740 1 -- 172.21.15.5:0/2996782495 shutdown_connections 2024-08-31T05:43:04.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.617+0000 7f83c5c1a740 1 --2- 172.21.15.5:0/2996782495 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x560e45ee0d80 0x560e462e3aa0 crc :-1 s=READY pgs=287 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:04.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.617+0000 7f83c5c1a740 1 --2- 172.21.15.5:0/2996782495 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e45f221b0 0x560e462dd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:04.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.617+0000 7f83c5c1a740 1 --2- 172.21.15.5:0/2996782495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e45f014d0 0x560e462d1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:04.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.617+0000 7f8397fff640 0 client.28622 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:43:04.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.617+0000 7f83c5c1a740 1 --2- 172.21.15.5:0/2996782495 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e45ef92f0 0x560e462d1920 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:04.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.617+0000 7f83c5c1a740 1 -- 172.21.15.5:0/2996782495 >> 172.21.15.5:0/2996782495 conn(0x560e45f16300 msgr2=0x560e462c6d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:04.624 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.617+0000 7f83c5c1a740 1 -- 172.21.15.5:0/2996782495 shutdown_connections 2024-08-31T05:43:04.625 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.618+0000 7f83c5c1a740 1 -- 172.21.15.5:0/2996782495 wait complete. 2024-08-31T05:43:04.625 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.618+0000 7f83c5c1a740 20 client.28622 trim_cache size 0 max 16384 2024-08-31T05:43:04.636 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.633+0000 7f83c5c1a740 1 Processor -- start 2024-08-31T05:43:04.636 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.633+0000 7f83c5c1a740 1 -- start start 2024-08-31T05:43:04.636 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.633+0000 7f83c5c1a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e45ef92f0 0x560e462cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:04.636 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.633+0000 7f83c5c1a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e45f014d0 0x560e462dd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:04.637 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.633+0000 7f83c5c1a740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e45f221b0 0x560e462c3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:04.637 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.633+0000 7f83c5c1a740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f83b81b3060 con 0x560e45f221b0 2024-08-31T05:43:04.637 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.633+0000 7f83c5c1a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f83b81b4ba0 con 0x560e45ef92f0 2024-08-31T05:43:04.637 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.633+0000 7f83c5c1a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f83b81b3730 con 0x560e45f014d0 2024-08-31T05:43:04.637 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.633+0000 7f83bd163640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e45f221b0 0x560e462c3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:04.637 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.633+0000 7f83bc962640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e45ef92f0 0x560e462cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:04.637 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.633+0000 7f83bc962640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e45ef92f0 0x560e462cb4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:35694/0 (socket says 172.21.15.5:35694) 2024-08-31T05:43:04.637 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.633+0000 7f83b7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e45f014d0 0x560e462dd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:04.637 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.633+0000 7f83bd163640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e45f221b0 0x560e462c3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57528/0 (socket says 172.21.15.5:57528) 2024-08-31T05:43:04.637 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.633+0000 7f83bc962640 1 -- 172.21.15.5:0/3543124563 learned_addr learned my addr 172.21.15.5:0/3543124563 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:04.637 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.634+0000 7f83bc962640 1 -- 172.21.15.5:0/3543124563 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e45f014d0 msgr2=0x560e462dd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:04.637 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.634+0000 7f83bc962640 1 --2- 172.21.15.5:0/3543124563 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e45f014d0 0x560e462dd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:04.637 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.634+0000 7f83bc962640 1 -- 172.21.15.5:0/3543124563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e45f221b0 msgr2=0x560e462c3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:04.638 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.634+0000 7f83bc962640 1 --2- 172.21.15.5:0/3543124563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e45f221b0 0x560e462c3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:04.638 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.634+0000 7f83bc962640 1 -- 172.21.15.5:0/3543124563 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e462d05e0 con 0x560e45ef92f0 2024-08-31T05:43:04.638 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.634+0000 7f83bd163640 1 --2- 172.21.15.5:0/3543124563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e45f221b0 0x560e462c3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:43:04.638 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.634+0000 7f83bc962640 1 --2- 172.21.15.5:0/3543124563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e45ef92f0 0x560e462cb4b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f83a003d040 tx=0x7f83a0005a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b86ca7e76956c9c8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:04.638 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.634+0000 7f83ae7fc640 1 -- 172.21.15.5:0/3543124563 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a0049070 con 0x560e45ef92f0 2024-08-31T05:43:04.638 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.634+0000 7f83ae7fc640 1 -- 172.21.15.5:0/3543124563 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83a00cc020 con 0x560e45ef92f0 2024-08-31T05:43:04.638 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.634+0000 7f83ae7fc640 1 -- 172.21.15.5:0/3543124563 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a00d5040 con 0x560e45ef92f0 2024-08-31T05:43:04.642 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.635+0000 7f83c5c1a740 1 -- 172.21.15.5:0/3543124563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e45ef92f0 msgr2=0x560e462cb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:04.643 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.635+0000 7f83c5c1a740 1 --2- 172.21.15.5:0/3543124563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e45ef92f0 0x560e462cb4b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f83a003d040 tx=0x7f83a0005a20 comp rx=0 tx=0).stop 2024-08-31T05:43:04.643 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.635+0000 7f83c5c1a740 1 -- 172.21.15.5:0/3543124563 shutdown_connections 2024-08-31T05:43:04.643 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.635+0000 7f83c5c1a740 1 --2- 172.21.15.5:0/3543124563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e45f221b0 0x560e462c3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:04.643 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.635+0000 7f83c5c1a740 1 --2- 172.21.15.5:0/3543124563 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e45f014d0 0x560e462dd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:04.643 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.635+0000 7f83c5c1a740 1 --2- 172.21.15.5:0/3543124563 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e45ef92f0 0x560e462cb4b0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:04.643 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.635+0000 7f83c5c1a740 1 -- 172.21.15.5:0/3543124563 >> 172.21.15.5:0/3543124563 conn(0x560e45f16300 msgr2=0x560e462cada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:04.643 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.635+0000 7f83c5c1a740 1 -- 172.21.15.5:0/3543124563 shutdown_connections 2024-08-31T05:43:04.643 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.635+0000 7f83c5c1a740 1 -- 172.21.15.5:0/3543124563 wait complete. 2024-08-31T05:43:04.643 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.635+0000 7f83c5c1a740 1 -- start start 2024-08-31T05:43:04.643 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.635+0000 7f83c5c1a740 1 Processor -- start 2024-08-31T05:43:04.643 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.636+0000 7f83c5c1a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e45ef92f0 0x560e462d5690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:04.644 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.636+0000 7f83c5c1a740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e45f014d0 0x560e462d5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:04.644 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.636+0000 7f83c5c1a740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e45f221b0 0x560e462d6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:04.644 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.636+0000 7f83c5c1a740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f83b81b44d0 con 0x560e45f014d0 2024-08-31T05:43:04.644 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.636+0000 7f83c5c1a740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f83b81b3e00 con 0x560e45f221b0 2024-08-31T05:43:04.644 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.636+0000 7f83c5c1a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f83b81b1060 con 0x560e45ef92f0 2024-08-31T05:43:04.644 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.636+0000 7f83c5c1a740 10 client.0 _ll_register_callbacks cb 0x7f83a0005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:43:04.644 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.636+0000 7f83b7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e45f014d0 0x560e462d5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:04.644 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.636+0000 7f83bd163640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e45f221b0 0x560e462d6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:04.644 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.636+0000 7f83bc962640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e45ef92f0 0x560e462d5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:04.644 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.636+0000 7f83b7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e45f014d0 0x560e462d5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57532/0 (socket says 172.21.15.5:57532) 2024-08-31T05:43:04.644 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.636+0000 7f83b7fff640 1 -- 172.21.15.5:0/269122700 learned_addr learned my addr 172.21.15.5:0/269122700 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:04.644 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.636+0000 7f83b7fff640 1 -- 172.21.15.5:0/269122700 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e45ef92f0 msgr2=0x560e462d5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:04.644 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.636+0000 7f83b7fff640 1 --2- 172.21.15.5:0/269122700 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e45ef92f0 0x560e462d5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:04.645 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.636+0000 7f83b7fff640 1 -- 172.21.15.5:0/269122700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e45f221b0 msgr2=0x560e462d6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:04.645 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.636+0000 7f83b7fff640 1 --2- 172.21.15.5:0/269122700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e45f221b0 0x560e462d6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:04.645 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.636+0000 7f83b7fff640 1 -- 172.21.15.5:0/269122700 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e4634d490 con 0x560e45f014d0 2024-08-31T05:43:04.645 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.636+0000 7f83bc962640 1 --2- 172.21.15.5:0/269122700 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e45ef92f0 0x560e462d5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:43:04.645 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.637+0000 7f83b7fff640 1 --2- 172.21.15.5:0/269122700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e45f014d0 0x560e462d5bd0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f83a8009fd0 tx=0x7f83a8012e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ace6d4621987018 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:04.645 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.637+0000 7f8397fff640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:43:04.645 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.637+0000 7f8397fff640 1 -- 172.21.15.5:0/269122700 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a8010c70 con 0x560e45f014d0 2024-08-31T05:43:04.645 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.637+0000 7f8397fff640 1 -- 172.21.15.5:0/269122700 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9599+0+0 (secure 0 0 0) 0x7f83a8005020 con 0x560e45f014d0 2024-08-31T05:43:04.645 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.637+0000 7f83c5c1a740 1 -- 172.21.15.5:0/269122700 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83a00cc020 con 0x560e45f014d0 2024-08-31T05:43:04.645 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.637+0000 7f8397fff640 1 -- 172.21.15.5:0/269122700 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f83a8031050 con 0x560e45f014d0 2024-08-31T05:43:04.645 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.637+0000 7f83c5c1a740 10 client.19065 fetch_fsmap learned FSMap version 34 2024-08-31T05:43:04.645 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.637+0000 7f83c5c1a740 1 -- 172.21.15.5:0/269122700 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x560e4634e790 con 0x560e45f014d0 2024-08-31T05:43:04.645 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.637+0000 7f8397fff640 1 -- 172.21.15.5:0/269122700 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83a00cc020 con 0x560e45f014d0 2024-08-31T05:43:04.646 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.637+0000 7f8397fff640 1 -- 172.21.15.5:0/269122700 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7f83a8023070 con 0x560e45f014d0 2024-08-31T05:43:04.646 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.637+0000 7f83c5c1a740 10 client.19065 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:43:04.646 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.637+0000 7f83c5c1a740 10 client.19065 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:43:04.646 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.637+0000 7f83c5c1a740 20 client.19065 populate_metadata read hostname 'smithi005' 2024-08-31T05:43:04.646 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.637+0000 7f83c5c1a740 1 --2- 172.21.15.5:0/269122700 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x560e45eb61c0 0x560e46350fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:04.646 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.637+0000 7f83c5c1a740 4 client.19065 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:43:04.646 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.637+0000 7f83c5c1a740 1 -- 172.21.15.5:0/269122700 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560e462389f0 con 0x560e45eb61c0 2024-08-31T05:43:04.646 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.638+0000 7f83bc962640 1 --2- 172.21.15.5:0/269122700 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x560e45eb61c0 0x560e46350fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:04.646 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.638+0000 7f8397fff640 10 client.19065 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:43:04.647 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.638+0000 7f83bc962640 1 --2- 172.21.15.5:0/269122700 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x560e45eb61c0 0x560e46350fd0 crc :-1 s=READY pgs=288 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5c860019510532e server_cookie=d5127bca8cb3d315 in_seq=0 out_seq=0 2024-08-31T05:43:04.655 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.652+0000 7f8397fff640 1 -- 172.21.15.5:0/269122700 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560e462389f0 con 0x560e45eb61c0 2024-08-31T05:43:04.655 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.652+0000 7f8397fff640 10 client.19065 handle_command_reply: tid=0 2024-08-31T05:43:04.655 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.652+0000 7f83c5c1a740 1 client.19065 shutdown 2024-08-31T05:43:04.655 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.652+0000 7f83c5c1a740 1 -- 172.21.15.5:0/269122700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e45f014d0 msgr2=0x560e462d5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:04.655 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.652+0000 7f83c5c1a740 1 --2- 172.21.15.5:0/269122700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e45f014d0 0x560e462d5bd0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f83a8009fd0 tx=0x7f83a8012e40 comp rx=0 tx=0).stop 2024-08-31T05:43:04.655 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.652+0000 7f83c5c1a740 1 -- 172.21.15.5:0/269122700 shutdown_connections 2024-08-31T05:43:04.655 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.652+0000 7f83c5c1a740 1 --2- 172.21.15.5:0/269122700 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x560e45eb61c0 0x560e46350fd0 crc :-1 s=READY pgs=288 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:04.655 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.652+0000 7f83c5c1a740 1 --2- 172.21.15.5:0/269122700 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x560e45f221b0 0x560e462d6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:04.655 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.652+0000 7f83c5c1a740 1 --2- 172.21.15.5:0/269122700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560e45f014d0 0x560e462d5bd0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:04.655 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.652+0000 7f83c5c1a740 1 --2- 172.21.15.5:0/269122700 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e45ef92f0 0x560e462d5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:04.656 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.652+0000 7f8397fff640 0 client.19065 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:43:04.656 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.652+0000 7f83c5c1a740 1 -- 172.21.15.5:0/269122700 >> 172.21.15.5:0/269122700 conn(0x560e45f16300 msgr2=0x560e462c6c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:04.656 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.652+0000 7f83c5c1a740 1 -- 172.21.15.5:0/269122700 shutdown_connections 2024-08-31T05:43:04.656 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.652+0000 7f83c5c1a740 1 -- 172.21.15.5:0/269122700 wait complete. 2024-08-31T05:43:04.656 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.652+0000 7f83c5c1a740 20 client.19065 trim_cache size 0 max 16384 2024-08-31T05:43:04.656 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:43:04.656 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:43:04.656 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:43:04.656 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:43:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.653+0000 7f83bebc6640 1 -- 172.21.15.5:0/1020603773 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f83a40b4cd0 msgr2=0x7f83a40b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.653+0000 7f83bebc6640 1 --2- 172.21.15.5:0/1020603773 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f83a40b4cd0 0x7f83a40b71e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f83b0023000 tx=0x7f83b0024000 comp rx=0 tx=0).stop 2024-08-31T05:43:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.653+0000 7f83bebc6640 1 -- 172.21.15.5:0/1020603773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83b81027a0 msgr2=0x7f83b810fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.653+0000 7f83bebc6640 1 --2- 172.21.15.5:0/1020603773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83b81027a0 0x7f83b810fd30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f83a0005940 tx=0x7f83a00040c0 comp rx=0 tx=0).stop 2024-08-31T05:43:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.653+0000 7f83bebc6640 1 -- 172.21.15.5:0/1020603773 shutdown_connections 2024-08-31T05:43:04.658 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.653+0000 7f83bebc6640 1 --2- 172.21.15.5:0/1020603773 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f83a40b4cd0 0x7f83a40b71e0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:04.658 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.653+0000 7f83bebc6640 1 --2- 172.21.15.5:0/1020603773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83b8108a20 0x7f83b81107b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:04.658 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.653+0000 7f83bebc6640 1 --2- 172.21.15.5:0/1020603773 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83b81080d0 0x7f83b8110270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:04.658 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.653+0000 7f83bebc6640 1 --2- 172.21.15.5:0/1020603773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f83b81027a0 0x7f83b810fd30 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:04.658 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.653+0000 7f83bebc6640 1 -- 172.21.15.5:0/1020603773 >> 172.21.15.5:0/1020603773 conn(0x7f83b80fe1a0 msgr2=0x7f83b8107730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:04.658 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.653+0000 7f83bebc6640 1 -- 172.21.15.5:0/1020603773 shutdown_connections 2024-08-31T05:43:04.658 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:04.653+0000 7f83bebc6640 1 -- 172.21.15.5:0/1020603773 wait complete. 2024-08-31T05:43:04.943 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1469740 10.71 MB/sec execute 592 sec latency 18.568 ms 2024-08-31T05:43:05.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:05 smithi070 ceph-mon[22316]: pgmap v751: 129 pgs: 129 active+clean; 647 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.2 MiB/s wr, 220 op/s 2024-08-31T05:43:05.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:05 smithi050 ceph-mon[22146]: pgmap v751: 129 pgs: 129 active+clean; 647 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.2 MiB/s wr, 220 op/s 2024-08-31T05:43:05.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:05 smithi005 ceph-mon[18602]: pgmap v751: 129 pgs: 129 active+clean; 647 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.2 MiB/s wr, 220 op/s 2024-08-31T05:43:05.943 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1471392 10.71 MB/sec execute 593 sec latency 92.080 ms 2024-08-31T05:43:06.943 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1472988 10.70 MB/sec execute 594 sec latency 28.136 ms 2024-08-31T05:43:07.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:07 smithi050 ceph-mon[22146]: pgmap v752: 129 pgs: 129 active+clean; 658 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 5.0 MiB/s wr, 265 op/s 2024-08-31T05:43:07.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:07 smithi005 ceph-mon[18602]: pgmap v752: 129 pgs: 129 active+clean; 658 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 5.0 MiB/s wr, 265 op/s 2024-08-31T05:43:07.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:07 smithi070 ceph-mon[22316]: pgmap v752: 129 pgs: 129 active+clean; 658 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 5.0 MiB/s wr, 265 op/s 2024-08-31T05:43:07.943 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1475058 10.70 MB/sec execute 595 sec latency 14.047 ms 2024-08-31T05:43:08.943 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1476974 10.70 MB/sec execute 596 sec latency 18.263 ms 2024-08-31T05:43:09.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:09 smithi050 ceph-mon[22146]: pgmap v753: 129 pgs: 129 active+clean; 650 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.4 MiB/s wr, 244 op/s 2024-08-31T05:43:09.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:09 smithi005 ceph-mon[18602]: pgmap v753: 129 pgs: 129 active+clean; 650 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.4 MiB/s wr, 244 op/s 2024-08-31T05:43:09.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:09 smithi070 ceph-mon[22316]: pgmap v753: 129 pgs: 129 active+clean; 650 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.4 MiB/s wr, 244 op/s 2024-08-31T05:43:09.943 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1478749 10.70 MB/sec execute 597 sec latency 14.559 ms 2024-08-31T05:43:10.944 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1480513 10.69 MB/sec execute 598 sec latency 89.524 ms 2024-08-31T05:43:11.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:10 smithi005 ceph-mon[18602]: pgmap v754: 129 pgs: 129 active+clean; 589 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.0 MiB/s wr, 224 op/s 2024-08-31T05:43:11.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:10 smithi005 ceph-mon[18602]: osdmap e101: 12 total, 12 up, 12 in 2024-08-31T05:43:11.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:10 smithi070 ceph-mon[22316]: pgmap v754: 129 pgs: 129 active+clean; 589 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.0 MiB/s wr, 224 op/s 2024-08-31T05:43:11.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:10 smithi070 ceph-mon[22316]: osdmap e101: 12 total, 12 up, 12 in 2024-08-31T05:43:11.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:10 smithi050 ceph-mon[22146]: pgmap v754: 129 pgs: 129 active+clean; 589 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.0 MiB/s wr, 224 op/s 2024-08-31T05:43:11.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:10 smithi050 ceph-mon[22146]: osdmap e101: 12 total, 12 up, 12 in 2024-08-31T05:43:11.943 INFO:tasks.workunit.client.0.smithi005.stdout: 1 1482366 10.70 MB/sec execute 599 sec latency 14.297 ms 2024-08-31T05:43:12.943 INFO:tasks.workunit.client.0.smithi005.stdout: 1 cleanup 600 sec 2024-08-31T05:43:13.165 INFO:tasks.workunit.client.0.smithi005.stdout: 0 cleanup 600 sec 2024-08-31T05:43:13.165 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-08-31T05:43:13.165 INFO:tasks.workunit.client.0.smithi005.stdout: Operation Count AvgLat MaxLat 2024-08-31T05:43:13.165 INFO:tasks.workunit.client.0.smithi005.stdout: ---------------------------------------- 2024-08-31T05:43:13.165 INFO:tasks.workunit.client.0.smithi005.stdout: NTCreateX 204103 1.029 1239.009 2024-08-31T05:43:13.165 INFO:tasks.workunit.client.0.smithi005.stdout: Close 149967 0.002 0.118 2024-08-31T05:43:13.165 INFO:tasks.workunit.client.0.smithi005.stdout: Rename 8645 4.706 246.465 2024-08-31T05:43:13.165 INFO:tasks.workunit.client.0.smithi005.stdout: Unlink 41202 1.632 86.485 2024-08-31T05:43:13.165 INFO:tasks.workunit.client.0.smithi005.stdout: Deltree 6 81.780 105.462 2024-08-31T05:43:13.165 INFO:tasks.workunit.client.0.smithi005.stdout: Mkdir 3 0.020 0.041 2024-08-31T05:43:13.165 INFO:tasks.workunit.client.0.smithi005.stdout: Qpathinfo 185030 0.948 321.021 2024-08-31T05:43:13.166 INFO:tasks.workunit.client.0.smithi005.stdout: Qfileinfo 32463 0.001 0.051 2024-08-31T05:43:13.166 INFO:tasks.workunit.client.0.smithi005.stdout: Qfsinfo 33916 0.199 38.364 2024-08-31T05:43:13.166 INFO:tasks.workunit.client.0.smithi005.stdout: Sfileinfo 16628 0.018 6.347 2024-08-31T05:43:13.166 INFO:tasks.workunit.client.0.smithi005.stdout: Find 71531 0.261 9687.953 2024-08-31T05:43:13.166 INFO:tasks.workunit.client.0.smithi005.stdout: WriteX 101949 0.091 135.840 2024-08-31T05:43:13.166 INFO:tasks.workunit.client.0.smithi005.stdout: ReadX 320005 0.018 86.517 2024-08-31T05:43:13.166 INFO:tasks.workunit.client.0.smithi005.stdout: LockX 666 0.842 7.547 2024-08-31T05:43:13.166 INFO:tasks.workunit.client.0.smithi005.stdout: UnlockX 666 0.723 9.793 2024-08-31T05:43:13.166 INFO:tasks.workunit.client.0.smithi005.stdout: Flush 14304 4.304 147.507 2024-08-31T05:43:13.166 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-08-31T05:43:13.166 INFO:tasks.workunit.client.0.smithi005.stdout:Throughput 10.6969 MB/sec 1 clients 1 procs max_latency=9687.962 ms 2024-08-31T05:43:13.167 INFO:tasks.workunit.client.0.smithi005.stderr:+ dbench 10 2024-08-31T05:43:13.167 INFO:tasks.workunit.client.0.smithi005.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-08-31T05:43:13.167 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-08-31T05:43:13.167 INFO:tasks.workunit.client.0.smithi005.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-08-31T05:43:13.167 INFO:tasks.workunit.client.0.smithi005.stdout:9 of 10 processes prepared for launch 0 sec 2024-08-31T05:43:13.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:12 smithi005 ceph-mon[18602]: pgmap v756: 129 pgs: 129 active+clean; 581 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 5.0 MiB/s wr, 245 op/s 2024-08-31T05:43:13.266 INFO:tasks.workunit.client.0.smithi005.stdout:10 of 10 processes prepared for launch 0 sec 2024-08-31T05:43:13.266 INFO:tasks.workunit.client.0.smithi005.stdout:releasing clients 2024-08-31T05:43:13.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:12 smithi070 ceph-mon[22316]: pgmap v756: 129 pgs: 129 active+clean; 581 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 5.0 MiB/s wr, 245 op/s 2024-08-31T05:43:13.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:12 smithi050 ceph-mon[22146]: pgmap v756: 129 pgs: 129 active+clean; 581 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 5.0 MiB/s wr, 245 op/s 2024-08-31T05:43:14.266 INFO:tasks.workunit.client.0.smithi005.stdout: 10 313 114.84 MB/sec warmup 1 sec latency 74.579 ms 2024-08-31T05:43:15.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:14 smithi005 ceph-mon[18602]: pgmap v757: 129 pgs: 129 active+clean; 586 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.8 MiB/s wr, 233 op/s 2024-08-31T05:43:15.266 INFO:tasks.workunit.client.0.smithi005.stdout: 10 677 102.43 MB/sec warmup 2 sec latency 176.703 ms 2024-08-31T05:43:15.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:14 smithi070 ceph-mon[22316]: pgmap v757: 129 pgs: 129 active+clean; 586 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.8 MiB/s wr, 233 op/s 2024-08-31T05:43:15.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:14 smithi050 ceph-mon[22146]: pgmap v757: 129 pgs: 129 active+clean; 586 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.8 MiB/s wr, 233 op/s 2024-08-31T05:43:16.266 INFO:tasks.workunit.client.0.smithi005.stdout: 10 763 69.14 MB/sec warmup 3 sec latency 693.219 ms 2024-08-31T05:43:17.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:16 smithi005 ceph-mon[18602]: pgmap v758: 129 pgs: 129 active+clean; 598 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 5.1 MiB/s wr, 209 op/s 2024-08-31T05:43:17.266 INFO:tasks.workunit.client.0.smithi005.stdout: 10 869 52.87 MB/sec warmup 4 sec latency 1361.934 ms 2024-08-31T05:43:17.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:16 smithi070 ceph-mon[22316]: pgmap v758: 129 pgs: 129 active+clean; 598 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 5.1 MiB/s wr, 209 op/s 2024-08-31T05:43:17.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:16 smithi050 ceph-mon[22146]: pgmap v758: 129 pgs: 129 active+clean; 598 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 5.1 MiB/s wr, 209 op/s 2024-08-31T05:43:17.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.783+0000 7fc275225640 1 -- 172.21.15.5:0/3328579024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc270102ed0 msgr2=0x7fc2701032e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:17.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.784+0000 7fc275225640 1 --2- 172.21.15.5:0/3328579024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc270102ed0 0x7fc2701032e0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fc264009860 tx=0x7fc26402a340 comp rx=0 tx=0).stop 2024-08-31T05:43:17.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.784+0000 7fc275225640 1 -- 172.21.15.5:0/3328579024 shutdown_connections 2024-08-31T05:43:17.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.784+0000 7fc275225640 1 --2- 172.21.15.5:0/3328579024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc270108b20 0x7fc27010f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:17.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.784+0000 7fc275225640 1 --2- 172.21.15.5:0/3328579024 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2701081d0 0x7fc2701085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:17.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.784+0000 7fc275225640 1 --2- 172.21.15.5:0/3328579024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc270102ed0 0x7fc2701032e0 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:17.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.784+0000 7fc275225640 1 -- 172.21.15.5:0/3328579024 >> 172.21.15.5:0/3328579024 conn(0x7fc270079bf0 msgr2=0x7fc27007a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:17.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.784+0000 7fc275225640 1 -- 172.21.15.5:0/3328579024 shutdown_connections 2024-08-31T05:43:17.786 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.784+0000 7fc275225640 1 -- 172.21.15.5:0/3328579024 wait complete. 2024-08-31T05:43:17.788 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.785+0000 7fc275225640 1 Processor -- start 2024-08-31T05:43:17.788 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.785+0000 7fc275225640 1 -- start start 2024-08-31T05:43:17.788 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.785+0000 7fc275225640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc270102ed0 0x7fc27010f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:17.788 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.785+0000 7fc275225640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2701081d0 0x7fc27010c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:17.788 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.786+0000 7fc275225640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc270108b20 0x7fc27010cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:17.788 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.786+0000 7fc275225640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc2701116e0 con 0x7fc270108b20 2024-08-31T05:43:17.788 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.786+0000 7fc275225640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc270111560 con 0x7fc2701081d0 2024-08-31T05:43:17.788 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.786+0000 7fc275225640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc270111860 con 0x7fc270102ed0 2024-08-31T05:43:17.788 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.786+0000 7fc26e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2701081d0 0x7fc27010c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:17.788 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.786+0000 7fc26e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2701081d0 0x7fc27010c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:32952/0 (socket says 172.21.15.5:32952) 2024-08-31T05:43:17.788 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.786+0000 7fc26e59c640 1 -- 172.21.15.5:0/1174822612 learned_addr learned my addr 172.21.15.5:0/1174822612 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:17.789 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.786+0000 7fc26ed9d640 1 --2- 172.21.15.5:0/1174822612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc270102ed0 0x7fc27010f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:17.789 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.786+0000 7fc26f59e640 1 --2- 172.21.15.5:0/1174822612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc270108b20 0x7fc27010cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:17.789 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.786+0000 7fc26f59e640 1 -- 172.21.15.5:0/1174822612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc270102ed0 msgr2=0x7fc27010f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:17.789 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.786+0000 7fc26f59e640 1 --2- 172.21.15.5:0/1174822612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc270102ed0 0x7fc27010f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:17.789 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.786+0000 7fc26f59e640 1 -- 172.21.15.5:0/1174822612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2701081d0 msgr2=0x7fc27010c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:17.789 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.786+0000 7fc26f59e640 1 --2- 172.21.15.5:0/1174822612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2701081d0 0x7fc27010c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:17.789 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.786+0000 7fc26f59e640 1 -- 172.21.15.5:0/1174822612 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2701acb40 con 0x7fc270108b20 2024-08-31T05:43:17.790 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.786+0000 7fc26f59e640 1 --2- 172.21.15.5:0/1174822612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc270108b20 0x7fc27010cb40 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fc268009fd0 tx=0x7fc26800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:17.790 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.787+0000 7fc257fff640 1 -- 172.21.15.5:0/1174822612 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc26800cd60 con 0x7fc270108b20 2024-08-31T05:43:17.790 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.787+0000 7fc275225640 1 -- 172.21.15.5:0/1174822612 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2701acd10 con 0x7fc270108b20 2024-08-31T05:43:17.790 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.787+0000 7fc275225640 1 -- 172.21.15.5:0/1174822612 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2701ad1f0 con 0x7fc270108b20 2024-08-31T05:43:17.790 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.787+0000 7fc257fff640 1 -- 172.21.15.5:0/1174822612 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc268005020 con 0x7fc270108b20 2024-08-31T05:43:17.790 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.787+0000 7fc257fff640 1 -- 172.21.15.5:0/1174822612 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc268010690 con 0x7fc270108b20 2024-08-31T05:43:17.792 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.790+0000 7fc27c271740 1 Processor -- start 2024-08-31T05:43:17.792 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.790+0000 7fc27c271740 1 -- start start 2024-08-31T05:43:17.793 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.790+0000 7fc27c271740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c1a3a3a1b0 0x55c1a3dddce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:17.793 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.790+0000 7fc27c271740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c1a3a112f0 0x55c1a3dde220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:17.793 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.790+0000 7fc27c271740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1a3a194d0 0x55c1a3dde760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:17.793 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.790+0000 7fc27c271740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55c1a3d53000 con 0x55c1a3a112f0 2024-08-31T05:43:17.793 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.790+0000 7fc27c271740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55c1a3d42590 con 0x55c1a3a3a1b0 2024-08-31T05:43:17.793 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.790+0000 7fc27c271740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c1a3d46540 con 0x55c1a3a194d0 2024-08-31T05:43:17.793 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.790+0000 7fc26e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c1a3a3a1b0 0x55c1a3dddce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:17.793 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.791+0000 7fc26e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c1a3a3a1b0 0x55c1a3dddce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:32962/0 (socket says 172.21.15.5:32962) 2024-08-31T05:43:17.793 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.791+0000 7fc26e59c640 1 -- 172.21.15.5:0/4292845791 learned_addr learned my addr 172.21.15.5:0/4292845791 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:17.793 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.791+0000 7fc26e59c640 1 --2- 172.21.15.5:0/4292845791 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1a3a194d0 0x55c1a3dde760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:17.793 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.791+0000 7fc26ed9d640 1 --2- 172.21.15.5:0/4292845791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c1a3a112f0 0x55c1a3dde220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:17.794 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.791+0000 7fc26e59c640 1 -- 172.21.15.5:0/4292845791 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1a3a194d0 msgr2=0x55c1a3dde760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:17.794 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.791+0000 7fc26e59c640 1 --2- 172.21.15.5:0/4292845791 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1a3a194d0 0x55c1a3dde760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:17.794 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.791+0000 7fc26e59c640 1 -- 172.21.15.5:0/4292845791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c1a3a112f0 msgr2=0x55c1a3dde220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:17.794 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.791+0000 7fc26e59c640 1 --2- 172.21.15.5:0/4292845791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c1a3a112f0 0x55c1a3dde220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:17.794 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.791+0000 7fc26e59c640 1 -- 172.21.15.5:0/4292845791 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1a3aa5790 con 0x55c1a3a3a1b0 2024-08-31T05:43:17.795 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.791+0000 7fc26e59c640 1 --2- 172.21.15.5:0/4292845791 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c1a3a3a1b0 0x55c1a3dddce0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc2600118a0 tx=0x7fc260009460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35dc4fbdce7e0178 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:17.795 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.792+0000 7fc2557fa640 1 -- 172.21.15.5:0/4292845791 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc26000f7c0 con 0x55c1a3a3a1b0 2024-08-31T05:43:17.795 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.792+0000 7fc2557fa640 1 -- 172.21.15.5:0/4292845791 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc26000fe10 con 0x55c1a3a3a1b0 2024-08-31T05:43:17.795 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.792+0000 7fc2557fa640 1 -- 172.21.15.5:0/4292845791 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc26001fc90 con 0x55c1a3a3a1b0 2024-08-31T05:43:17.795 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.792+0000 7fc257fff640 1 -- 172.21.15.5:0/1174822612 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fc2680054d0 con 0x7fc270108b20 2024-08-31T05:43:17.795 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.793+0000 7fc27c271740 1 -- 172.21.15.5:0/4292845791 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c1a3a3a1b0 msgr2=0x55c1a3dddce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:17.795 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.793+0000 7fc27c271740 1 --2- 172.21.15.5:0/4292845791 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c1a3a3a1b0 0x55c1a3dddce0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc2600118a0 tx=0x7fc260009460 comp rx=0 tx=0).stop 2024-08-31T05:43:17.796 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.793+0000 7fc257fff640 1 --2- 172.21.15.5:0/1174822612 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc2580b4d20 0x7fc2580b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:17.796 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.794+0000 7fc257fff640 1 -- 172.21.15.5:0/1174822612 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9511+0+0 (secure 0 0 0) 0x7fc2680e5ec0 con 0x7fc270108b20 2024-08-31T05:43:17.797 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.794+0000 7fc27c271740 1 -- 172.21.15.5:0/4292845791 shutdown_connections 2024-08-31T05:43:17.797 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.794+0000 7fc27c271740 1 --2- 172.21.15.5:0/4292845791 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1a3a194d0 0x55c1a3dde760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:17.797 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.795+0000 7fc27c271740 1 --2- 172.21.15.5:0/4292845791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c1a3a112f0 0x55c1a3dde220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:17.797 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.795+0000 7fc27c271740 1 --2- 172.21.15.5:0/4292845791 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c1a3a3a1b0 0x55c1a3dddce0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:17.797 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.795+0000 7fc27c271740 1 -- 172.21.15.5:0/4292845791 >> 172.21.15.5:0/4292845791 conn(0x55c1a3a2e300 msgr2=0x55c1a3ddbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:17.797 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.795+0000 7fc27c271740 1 -- 172.21.15.5:0/4292845791 shutdown_connections 2024-08-31T05:43:17.797 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.795+0000 7fc26e59c640 1 --2- 172.21.15.5:0/1174822612 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc2580b4d20 0x7fc2580b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:17.797 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.795+0000 7fc27c271740 1 -- 172.21.15.5:0/4292845791 wait complete. 2024-08-31T05:43:17.798 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.795+0000 7fc27c271740 1 -- start start 2024-08-31T05:43:17.798 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.796+0000 7fc26e59c640 1 --2- 172.21.15.5:0/1174822612 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc2580b4d20 0x7fc2580b7230 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fc260005c80 tx=0x7fc260005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:17.798 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.796+0000 7fc27c271740 1 Processor -- start 2024-08-31T05:43:17.799 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.796+0000 7fc27c271740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c1a3a112f0 0x55c1a3de9870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:17.799 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.796+0000 7fc27c271740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c1a3a194d0 0x55c1a3de9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:17.799 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.796+0000 7fc27c271740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1a3a3a1b0 0x55c1a3df57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:17.799 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.796+0000 7fc27c271740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55c1a3c7bab0 con 0x55c1a3a112f0 2024-08-31T05:43:17.799 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.796+0000 7fc27c271740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55c1a3cc9680 con 0x55c1a3a194d0 2024-08-31T05:43:17.799 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.796+0000 7fc27c271740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c1a3dec4b0 con 0x55c1a3a3a1b0 2024-08-31T05:43:17.799 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.796+0000 7fc27c271740 10 client.0 _ll_register_callbacks cb 0x55c1a3a51a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:43:17.799 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.796+0000 7fc26ed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c1a3a112f0 0x55c1a3de9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:17.799 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.796+0000 7fc26ed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c1a3a112f0 0x55c1a3de9870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37874/0 (socket says 172.21.15.5:37874) 2024-08-31T05:43:17.799 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.796+0000 7fc26ed9d640 1 -- 172.21.15.5:0/1568712605 learned_addr learned my addr 172.21.15.5:0/1568712605 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:17.799 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.797+0000 7fc26e59c640 1 --2- 172.21.15.5:0/1568712605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c1a3a194d0 0x55c1a3de9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:17.799 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.797+0000 7fc26f59e640 1 --2- 172.21.15.5:0/1568712605 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1a3a3a1b0 0x55c1a3df57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:17.800 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.797+0000 7fc26ed9d640 1 -- 172.21.15.5:0/1568712605 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1a3a3a1b0 msgr2=0x55c1a3df57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:17.800 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.797+0000 7fc26ed9d640 1 --2- 172.21.15.5:0/1568712605 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1a3a3a1b0 0x55c1a3df57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:17.800 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.797+0000 7fc26ed9d640 1 -- 172.21.15.5:0/1568712605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c1a3a194d0 msgr2=0x55c1a3de9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:17.800 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.797+0000 7fc26ed9d640 1 --2- 172.21.15.5:0/1568712605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c1a3a194d0 0x55c1a3de9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:17.800 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.797+0000 7fc26ed9d640 1 -- 172.21.15.5:0/1568712605 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1a3b1e620 con 0x55c1a3a112f0 2024-08-31T05:43:17.800 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.797+0000 7fc26e59c640 1 --2- 172.21.15.5:0/1568712605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c1a3a194d0 0x55c1a3de9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:43:17.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.799+0000 7fc26ed9d640 1 --2- 172.21.15.5:0/1568712605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c1a3a112f0 0x55c1a3de9870 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fc2640057c0 tx=0x7fc264030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=603a840d427e7db5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:17.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.799+0000 7fc252ff5640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:43:17.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.800+0000 7fc252ff5640 1 -- 172.21.15.5:0/1568712605 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc264042070 con 0x55c1a3a112f0 2024-08-31T05:43:17.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.800+0000 7fc27c271740 1 -- 172.21.15.5:0/1568712605 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc26000fe10 con 0x55c1a3a112f0 2024-08-31T05:43:17.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.800+0000 7fc252ff5640 1 -- 172.21.15.5:0/1568712605 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9511+0+0 (secure 0 0 0) 0x7fc264004240 con 0x55c1a3a112f0 2024-08-31T05:43:17.802 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.800+0000 7fc252ff5640 1 -- 172.21.15.5:0/1568712605 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc26404e050 con 0x55c1a3a112f0 2024-08-31T05:43:17.803 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.800+0000 7fc27c271740 10 client.19077 fetch_fsmap learned FSMap version 34 2024-08-31T05:43:17.803 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.800+0000 7fc27c271740 1 -- 172.21.15.5:0/1568712605 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55c1a3df8540 con 0x55c1a3a112f0 2024-08-31T05:43:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.803+0000 7fc252ff5640 1 -- 172.21.15.5:0/1568712605 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc264030900 con 0x55c1a3a112f0 2024-08-31T05:43:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.803+0000 7fc252ff5640 1 -- 172.21.15.5:0/1568712605 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fc264003cc0 con 0x55c1a3a112f0 2024-08-31T05:43:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.803+0000 7fc27c271740 10 client.19077 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:43:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.803+0000 7fc27c271740 10 client.19077 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:43:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.803+0000 7fc27c271740 20 client.19077 populate_metadata read hostname 'smithi005' 2024-08-31T05:43:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.803+0000 7fc27c271740 1 --2- 172.21.15.5:0/1568712605 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55c1a39f8d80 0x55c1a3dfba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.803+0000 7fc27c271740 4 client.19077 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:43:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.803+0000 7fc27c271740 1 -- 172.21.15.5:0/1568712605 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fc26000fe10 con 0x55c1a39f8d80 2024-08-31T05:43:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.804+0000 7fc26e59c640 1 --2- 172.21.15.5:0/1568712605 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55c1a39f8d80 0x55c1a3dfba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.804+0000 7fc252ff5640 10 client.19077 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:43:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.804+0000 7fc26e59c640 1 --2- 172.21.15.5:0/1568712605 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55c1a39f8d80 0x55c1a3dfba70 crc :-1 s=READY pgs=289 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f322fde2b00c1681 server_cookie=ba2e79e199d0ad7f in_seq=0 out_seq=0 2024-08-31T05:43:17.807 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.805+0000 7fc252ff5640 1 -- 172.21.15.5:0/1568712605 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fc26000fe10 con 0x55c1a39f8d80 2024-08-31T05:43:17.807 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.805+0000 7fc252ff5640 10 client.19077 handle_command_reply: tid=0 2024-08-31T05:43:17.807 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.805+0000 7fc27c271740 1 client.19077 shutdown 2024-08-31T05:43:17.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.806+0000 7fc27c271740 1 -- 172.21.15.5:0/1568712605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c1a3a112f0 msgr2=0x55c1a3de9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:17.808 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.806+0000 7fc27c271740 1 --2- 172.21.15.5:0/1568712605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c1a3a112f0 0x55c1a3de9870 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fc2640057c0 tx=0x7fc264030d80 comp rx=0 tx=0).stop 2024-08-31T05:43:17.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.807+0000 7fc27c271740 1 -- 172.21.15.5:0/1568712605 shutdown_connections 2024-08-31T05:43:17.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.807+0000 7fc27c271740 1 --2- 172.21.15.5:0/1568712605 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55c1a39f8d80 0x55c1a3dfba70 crc :-1 s=READY pgs=289 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:17.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.807+0000 7fc27c271740 1 --2- 172.21.15.5:0/1568712605 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1a3a3a1b0 0x55c1a3df57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:17.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.807+0000 7fc27c271740 1 --2- 172.21.15.5:0/1568712605 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c1a3a194d0 0x55c1a3de9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:17.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.807+0000 7fc27c271740 1 --2- 172.21.15.5:0/1568712605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c1a3a112f0 0x55c1a3de9870 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:17.809 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.807+0000 7fc27c271740 1 -- 172.21.15.5:0/1568712605 >> 172.21.15.5:0/1568712605 conn(0x55c1a3a2e300 msgr2=0x55c1a3dded10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:17.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.807+0000 7fc252ff5640 0 client.19077 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:43:17.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.807+0000 7fc27c271740 1 -- 172.21.15.5:0/1568712605 shutdown_connections 2024-08-31T05:43:17.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.807+0000 7fc27c271740 1 -- 172.21.15.5:0/1568712605 wait complete. 2024-08-31T05:43:17.810 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.807+0000 7fc27c271740 20 client.19077 trim_cache size 0 max 16384 2024-08-31T05:43:17.832 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.830+0000 7fc27c271740 1 Processor -- start 2024-08-31T05:43:17.832 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.830+0000 7fc27c271740 1 -- start start 2024-08-31T05:43:17.834 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.831+0000 7fc27c271740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c1a3a112f0 0x55c1a3ddf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:17.834 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.831+0000 7fc27c271740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1a3a194d0 0x55c1a3de9b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:17.834 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.831+0000 7fc27c271740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c1a3a3a1b0 0x55c1a3df56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:17.834 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.831+0000 7fc27c271740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc2701b7330 con 0x55c1a3a112f0 2024-08-31T05:43:17.834 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.831+0000 7fc27c271740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc2701b8e70 con 0x55c1a3a3a1b0 2024-08-31T05:43:17.834 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.831+0000 7fc27c271740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc2701b7a00 con 0x55c1a3a194d0 2024-08-31T05:43:17.834 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.831+0000 7fc26ed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c1a3a112f0 0x55c1a3ddf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:17.834 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.831+0000 7fc26e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1a3a194d0 0x55c1a3de9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:17.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.831+0000 7fc26e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1a3a194d0 0x55c1a3de9b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:32922/0 (socket says 172.21.15.5:32922) 2024-08-31T05:43:17.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.831+0000 7fc26e59c640 1 -- 172.21.15.5:0/2192100528 learned_addr learned my addr 172.21.15.5:0/2192100528 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:17.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.831+0000 7fc26f59e640 1 --2- 172.21.15.5:0/2192100528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c1a3a3a1b0 0x55c1a3df56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:17.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.832+0000 7fc26ed9d640 1 -- 172.21.15.5:0/2192100528 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1a3a194d0 msgr2=0x55c1a3de9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:17.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.832+0000 7fc26ed9d640 1 --2- 172.21.15.5:0/2192100528 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1a3a194d0 0x55c1a3de9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:17.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.832+0000 7fc26ed9d640 1 -- 172.21.15.5:0/2192100528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c1a3a3a1b0 msgr2=0x55c1a3df56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:17.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.832+0000 7fc26ed9d640 1 --2- 172.21.15.5:0/2192100528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c1a3a3a1b0 0x55c1a3df56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:17.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.832+0000 7fc26ed9d640 1 -- 172.21.15.5:0/2192100528 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1a3de7b40 con 0x55c1a3a112f0 2024-08-31T05:43:17.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.832+0000 7fc26f59e640 1 --2- 172.21.15.5:0/2192100528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c1a3a3a1b0 0x55c1a3df56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:43:17.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.832+0000 7fc26ed9d640 1 --2- 172.21.15.5:0/2192100528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c1a3a112f0 0x55c1a3ddf420 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fc26403e650 tx=0x7fc26402a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=219b5336b27b9706 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:17.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.832+0000 7fc254ff9640 1 -- 172.21.15.5:0/2192100528 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc26404b070 con 0x55c1a3a112f0 2024-08-31T05:43:17.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.832+0000 7fc254ff9640 1 -- 172.21.15.5:0/2192100528 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc264005cf0 con 0x55c1a3a112f0 2024-08-31T05:43:17.835 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.832+0000 7fc254ff9640 1 -- 172.21.15.5:0/2192100528 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc264042070 con 0x55c1a3a112f0 2024-08-31T05:43:17.838 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.833+0000 7fc27c271740 1 -- 172.21.15.5:0/2192100528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c1a3a112f0 msgr2=0x55c1a3ddf420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:17.839 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.833+0000 7fc27c271740 1 --2- 172.21.15.5:0/2192100528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c1a3a112f0 0x55c1a3ddf420 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fc26403e650 tx=0x7fc26402a340 comp rx=0 tx=0).stop 2024-08-31T05:43:17.839 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.833+0000 7fc27c271740 1 -- 172.21.15.5:0/2192100528 shutdown_connections 2024-08-31T05:43:17.839 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.833+0000 7fc27c271740 1 --2- 172.21.15.5:0/2192100528 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c1a3a3a1b0 0x55c1a3df56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:17.839 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.833+0000 7fc27c271740 1 --2- 172.21.15.5:0/2192100528 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1a3a194d0 0x55c1a3de9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:17.839 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.833+0000 7fc27c271740 1 --2- 172.21.15.5:0/2192100528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c1a3a112f0 0x55c1a3ddf420 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:17.839 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.833+0000 7fc27c271740 1 -- 172.21.15.5:0/2192100528 >> 172.21.15.5:0/2192100528 conn(0x55c1a3a2e300 msgr2=0x55c1a3dded10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:17.839 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.833+0000 7fc27c271740 1 -- 172.21.15.5:0/2192100528 shutdown_connections 2024-08-31T05:43:17.839 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.833+0000 7fc27c271740 1 -- 172.21.15.5:0/2192100528 wait complete. 2024-08-31T05:43:17.839 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.834+0000 7fc27c271740 1 -- start start 2024-08-31T05:43:17.839 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.834+0000 7fc27c271740 1 Processor -- start 2024-08-31T05:43:17.839 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.834+0000 7fc27c271740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c1a3a112f0 0x55c1a3ded7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:17.839 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.834+0000 7fc27c271740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c1a3a194d0 0x55c1a3dedd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:17.839 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.834+0000 7fc27c271740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1a3a3a1b0 0x55c1a3dee270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:17.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.834+0000 7fc27c271740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc2701b87a0 con 0x55c1a3a112f0 2024-08-31T05:43:17.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.834+0000 7fc27c271740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc2701b80d0 con 0x55c1a3a194d0 2024-08-31T05:43:17.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.834+0000 7fc27c271740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc2701b5330 con 0x55c1a3a3a1b0 2024-08-31T05:43:17.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.834+0000 7fc26ed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c1a3a112f0 0x55c1a3ded7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:17.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.834+0000 7fc27c271740 10 client.0 _ll_register_callbacks cb 0x7fc2680093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:43:17.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.834+0000 7fc26ed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c1a3a112f0 0x55c1a3ded7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37902/0 (socket says 172.21.15.5:37902) 2024-08-31T05:43:17.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.834+0000 7fc26ed9d640 1 -- 172.21.15.5:0/354051231 learned_addr learned my addr 172.21.15.5:0/354051231 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:17.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.834+0000 7fc26f59e640 1 --2- 172.21.15.5:0/354051231 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1a3a3a1b0 0x55c1a3dee270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:17.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.834+0000 7fc26e59c640 1 --2- 172.21.15.5:0/354051231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c1a3a194d0 0x55c1a3dedd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:17.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.835+0000 7fc26ed9d640 1 -- 172.21.15.5:0/354051231 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1a3a3a1b0 msgr2=0x55c1a3dee270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:17.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.835+0000 7fc26ed9d640 1 --2- 172.21.15.5:0/354051231 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1a3a3a1b0 0x55c1a3dee270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:17.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.835+0000 7fc26ed9d640 1 -- 172.21.15.5:0/354051231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c1a3a194d0 msgr2=0x55c1a3dedd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:17.840 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.835+0000 7fc26ed9d640 1 --2- 172.21.15.5:0/354051231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c1a3a194d0 0x55c1a3dedd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:17.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.835+0000 7fc26ed9d640 1 -- 172.21.15.5:0/354051231 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1a3e65500 con 0x55c1a3a112f0 2024-08-31T05:43:17.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.835+0000 7fc26ed9d640 1 --2- 172.21.15.5:0/354051231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c1a3a112f0 0x55c1a3ded7f0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fc26403e460 tx=0x7fc264030340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52df0d469846457b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:17.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.835+0000 7fc252ff5640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:43:17.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.835+0000 7fc252ff5640 1 -- 172.21.15.5:0/354051231 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc264042070 con 0x55c1a3a112f0 2024-08-31T05:43:17.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.835+0000 7fc252ff5640 1 -- 172.21.15.5:0/354051231 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9511+0+0 (secure 0 0 0) 0x7fc26403ed50 con 0x55c1a3a112f0 2024-08-31T05:43:17.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.835+0000 7fc27c271740 1 -- 172.21.15.5:0/354051231 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc264005cf0 con 0x55c1a3a112f0 2024-08-31T05:43:17.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.835+0000 7fc252ff5640 1 -- 172.21.15.5:0/354051231 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc264063050 con 0x55c1a3a112f0 2024-08-31T05:43:17.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.835+0000 7fc27c271740 10 client.19083 fetch_fsmap learned FSMap version 34 2024-08-31T05:43:17.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.835+0000 7fc27c271740 1 -- 172.21.15.5:0/354051231 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55c1a3e66790 con 0x55c1a3a112f0 2024-08-31T05:43:17.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.836+0000 7fc252ff5640 1 -- 172.21.15.5:0/354051231 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc264005cf0 con 0x55c1a3a112f0 2024-08-31T05:43:17.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.836+0000 7fc252ff5640 1 -- 172.21.15.5:0/354051231 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 34) ==== 8370+0+0 (secure 0 0 0) 0x7fc264004990 con 0x55c1a3a112f0 2024-08-31T05:43:17.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.836+0000 7fc27c271740 10 client.19083 fetch_fsmap finished waiting for FSMap version 34 2024-08-31T05:43:17.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.836+0000 7fc27c271740 10 client.19083 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:43:17.841 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.836+0000 7fc27c271740 20 client.19083 populate_metadata read hostname 'smithi005' 2024-08-31T05:43:17.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.836+0000 7fc27c271740 1 --2- 172.21.15.5:0/354051231 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55c1a39ce1c0 0x55c1a3e68e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:17.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.836+0000 7fc27c271740 4 client.19083 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:43:17.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.836+0000 7fc27c271740 1 -- 172.21.15.5:0/354051231 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c1a3d54f50 con 0x55c1a39ce1c0 2024-08-31T05:43:17.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.837+0000 7fc26e59c640 1 --2- 172.21.15.5:0/354051231 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55c1a39ce1c0 0x55c1a3e68e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:17.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.837+0000 7fc252ff5640 10 client.19083 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:43:17.842 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.837+0000 7fc26e59c640 1 --2- 172.21.15.5:0/354051231 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55c1a39ce1c0 0x55c1a3e68e60 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b69345e62359aef3 server_cookie=fb63e1384722d7d5 in_seq=0 out_seq=0 2024-08-31T05:43:17.860 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.858+0000 7fc252ff5640 1 -- 172.21.15.5:0/354051231 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c1a3d54f50 con 0x55c1a39ce1c0 2024-08-31T05:43:17.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.858+0000 7fc252ff5640 10 client.19083 handle_command_reply: tid=0 2024-08-31T05:43:17.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.858+0000 7fc27c271740 1 client.19083 shutdown 2024-08-31T05:43:17.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.858+0000 7fc27c271740 1 -- 172.21.15.5:0/354051231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c1a3a112f0 msgr2=0x55c1a3ded7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:17.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.858+0000 7fc27c271740 1 --2- 172.21.15.5:0/354051231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c1a3a112f0 0x55c1a3ded7f0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fc26403e460 tx=0x7fc264030340 comp rx=0 tx=0).stop 2024-08-31T05:43:17.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.858+0000 7fc27c271740 1 -- 172.21.15.5:0/354051231 shutdown_connections 2024-08-31T05:43:17.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.858+0000 7fc27c271740 1 --2- 172.21.15.5:0/354051231 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55c1a39ce1c0 0x55c1a3e68e60 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:17.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.858+0000 7fc27c271740 1 --2- 172.21.15.5:0/354051231 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c1a3a3a1b0 0x55c1a3dee270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:17.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.858+0000 7fc252ff5640 0 client.19083 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:43:17.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.858+0000 7fc27c271740 1 --2- 172.21.15.5:0/354051231 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55c1a3a194d0 0x55c1a3dedd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:17.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.858+0000 7fc27c271740 1 --2- 172.21.15.5:0/354051231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c1a3a112f0 0x55c1a3ded7f0 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:17.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.858+0000 7fc27c271740 1 -- 172.21.15.5:0/354051231 >> 172.21.15.5:0/354051231 conn(0x55c1a3a2e300 msgr2=0x55c1a3dded10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:17.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.858+0000 7fc27c271740 1 -- 172.21.15.5:0/354051231 shutdown_connections 2024-08-31T05:43:17.861 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.858+0000 7fc27c271740 1 -- 172.21.15.5:0/354051231 wait complete. 2024-08-31T05:43:17.862 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.858+0000 7fc27c271740 20 client.19083 trim_cache size 0 max 16384 2024-08-31T05:43:17.862 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:43:17.862 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:43:17.862 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:43:17.862 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:43:17.863 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.859+0000 7fc275225640 1 -- 172.21.15.5:0/1174822612 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc2580b4d20 msgr2=0x7fc2580b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:17.863 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.859+0000 7fc275225640 1 --2- 172.21.15.5:0/1174822612 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc2580b4d20 0x7fc2580b7230 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fc260005c80 tx=0x7fc260005850 comp rx=0 tx=0).stop 2024-08-31T05:43:17.863 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.859+0000 7fc275225640 1 -- 172.21.15.5:0/1174822612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc270108b20 msgr2=0x7fc27010cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:17.863 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.859+0000 7fc275225640 1 --2- 172.21.15.5:0/1174822612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc270108b20 0x7fc27010cb40 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fc268009fd0 tx=0x7fc26800ee50 comp rx=0 tx=0).stop 2024-08-31T05:43:17.863 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.859+0000 7fc275225640 1 -- 172.21.15.5:0/1174822612 shutdown_connections 2024-08-31T05:43:17.863 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.859+0000 7fc275225640 1 --2- 172.21.15.5:0/1174822612 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc2580b4d20 0x7fc2580b7230 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:17.863 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.859+0000 7fc275225640 1 --2- 172.21.15.5:0/1174822612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc270108b20 0x7fc27010cb40 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:17.863 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.859+0000 7fc275225640 1 --2- 172.21.15.5:0/1174822612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc2701081d0 0x7fc27010c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:17.863 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.859+0000 7fc275225640 1 --2- 172.21.15.5:0/1174822612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc270102ed0 0x7fc27010f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:17.863 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.859+0000 7fc275225640 1 -- 172.21.15.5:0/1174822612 >> 172.21.15.5:0/1174822612 conn(0x7fc270079bf0 msgr2=0x7fc270106260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:17.864 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.859+0000 7fc275225640 1 -- 172.21.15.5:0/1174822612 shutdown_connections 2024-08-31T05:43:17.864 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:17.859+0000 7fc275225640 1 -- 172.21.15.5:0/1174822612 wait complete. 2024-08-31T05:43:18.266 INFO:tasks.workunit.client.0.smithi005.stdout: 10 1141 45.29 MB/sec warmup 5 sec latency 265.200 ms 2024-08-31T05:43:19.046 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T05:43:19.209 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:18 smithi050 ceph-mon[22146]: pgmap v759: 129 pgs: 129 active+clean; 627 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 8.0 MiB/s wr, 229 op/s 2024-08-31T05:43:19.209 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:18 smithi050 ceph-mon[22146]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T05:43:19.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:18 smithi005 ceph-mon[18602]: pgmap v759: 129 pgs: 129 active+clean; 627 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 8.0 MiB/s wr, 229 op/s 2024-08-31T05:43:19.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:18 smithi005 ceph-mon[18602]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T05:43:19.267 INFO:tasks.workunit.client.0.smithi005.stdout: 10 1806 44.27 MB/sec warmup 6 sec latency 267.010 ms 2024-08-31T05:43:19.330 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:43:19.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:18 smithi070 ceph-mon[22316]: pgmap v759: 129 pgs: 129 active+clean; 627 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 8.0 MiB/s wr, 229 op/s 2024-08-31T05:43:19.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:18 smithi070 ceph-mon[22316]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T05:43:19.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.956+0000 7f473e87a640 1 -- 172.21.15.5:0/2142507612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4738102870 msgr2=0x7f4738102c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:19.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.956+0000 7f473e87a640 1 --2- 172.21.15.5:0/2142507612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4738102870 0x7f4738102c80 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f4728009980 tx=0x7f472802c620 comp rx=0 tx=0).stop 2024-08-31T05:43:19.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.956+0000 7f473e87a640 1 -- 172.21.15.5:0/2142507612 shutdown_connections 2024-08-31T05:43:19.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.956+0000 7f473e87a640 1 --2- 172.21.15.5:0/2142507612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4738108ab0 0x7f473810f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:19.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.956+0000 7f473e87a640 1 --2- 172.21.15.5:0/2142507612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4738108160 0x7f4738108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:19.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.956+0000 7f473e87a640 1 --2- 172.21.15.5:0/2142507612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4738102870 0x7f4738102c80 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:19.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.956+0000 7f473e87a640 1 -- 172.21.15.5:0/2142507612 >> 172.21.15.5:0/2142507612 conn(0x7f4738079470 msgr2=0x7f4738079880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:19.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.956+0000 7f473e87a640 1 -- 172.21.15.5:0/2142507612 shutdown_connections 2024-08-31T05:43:19.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.956+0000 7f473e87a640 1 -- 172.21.15.5:0/2142507612 wait complete. 2024-08-31T05:43:19.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.957+0000 7f473e87a640 1 Processor -- start 2024-08-31T05:43:19.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.957+0000 7f473e87a640 1 -- start start 2024-08-31T05:43:19.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.957+0000 7f473e87a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4738102870 0x7f47381980e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:19.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.957+0000 7f473e87a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4738108160 0x7f4738198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:19.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.957+0000 7f473e87a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4738108ab0 0x7f473819d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:19.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.957+0000 7f473e87a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f47381116b0 con 0x7f4738108160 2024-08-31T05:43:19.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.957+0000 7f473e87a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f4738111530 con 0x7f4738108ab0 2024-08-31T05:43:19.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.957+0000 7f473e87a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4738111830 con 0x7f4738102870 2024-08-31T05:43:19.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.957+0000 7f47377fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4738108160 0x7f4738198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:19.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.957+0000 7f4737fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4738102870 0x7f47381980e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:19.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.957+0000 7f47377fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4738108160 0x7f4738198680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37928/0 (socket says 172.21.15.5:37928) 2024-08-31T05:43:19.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.957+0000 7f4737fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4738102870 0x7f47381980e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:32958/0 (socket says 172.21.15.5:32958) 2024-08-31T05:43:19.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.957+0000 7f47377fe640 1 -- 172.21.15.5:0/389411767 learned_addr learned my addr 172.21.15.5:0/389411767 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:19.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.957+0000 7f473ce17640 1 --2- 172.21.15.5:0/389411767 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4738108ab0 0x7f473819d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:19.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.958+0000 7f47377fe640 1 -- 172.21.15.5:0/389411767 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4738102870 msgr2=0x7f47381980e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:19.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.958+0000 7f47377fe640 1 --2- 172.21.15.5:0/389411767 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4738102870 0x7f47381980e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:19.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.958+0000 7f47377fe640 1 -- 172.21.15.5:0/389411767 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4738108ab0 msgr2=0x7f473819d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:19.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.958+0000 7f47377fe640 1 --2- 172.21.15.5:0/389411767 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4738108ab0 0x7f473819d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:19.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.958+0000 7f47377fe640 1 -- 172.21.15.5:0/389411767 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f473819e050 con 0x7f4738108160 2024-08-31T05:43:19.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.958+0000 7f47377fe640 1 --2- 172.21.15.5:0/389411767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4738108160 0x7f4738198680 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f472c00e9f0 tx=0x7f472c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:19.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.958+0000 7f47357fa640 1 -- 172.21.15.5:0/389411767 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f472c00ccc0 con 0x7f4738108160 2024-08-31T05:43:19.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.958+0000 7f473e87a640 1 -- 172.21.15.5:0/389411767 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f473819e340 con 0x7f4738108160 2024-08-31T05:43:19.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.958+0000 7f47357fa640 1 -- 172.21.15.5:0/389411767 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f472c0108e0 con 0x7f4738108160 2024-08-31T05:43:19.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.958+0000 7f47357fa640 1 -- 172.21.15.5:0/389411767 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f472c018860 con 0x7f4738108160 2024-08-31T05:43:19.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.958+0000 7f473e87a640 1 -- 172.21.15.5:0/389411767 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47381a4aa0 con 0x7f4738108160 2024-08-31T05:43:19.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.961+0000 7f4744def740 1 Processor -- start 2024-08-31T05:43:19.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.961+0000 7f4744def740 1 -- start start 2024-08-31T05:43:19.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.961+0000 7f4744def740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562cdf737070 0x562cdfadc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:19.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.961+0000 7f4744def740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562cdf70e1b0 0x562cdfadc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:19.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.961+0000 7f4744def740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562cdf716390 0x562cdfadcd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:19.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.961+0000 7f4744def740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x562cdfa53630 con 0x562cdf716390 2024-08-31T05:43:19.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.961+0000 7f4744def740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562cdfa42bc0 con 0x562cdf70e1b0 2024-08-31T05:43:19.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.961+0000 7f4744def740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562cdfa46b70 con 0x562cdf737070 2024-08-31T05:43:19.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.961+0000 7f4737fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562cdf70e1b0 0x562cdfadc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:19.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.961+0000 7f473ce17640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562cdf737070 0x562cdfadc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:19.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.961+0000 7f4737fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562cdf70e1b0 0x562cdfadc800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:33016/0 (socket says 172.21.15.5:33016) 2024-08-31T05:43:19.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.961+0000 7f4737fff640 1 -- 172.21.15.5:0/1493877275 learned_addr learned my addr 172.21.15.5:0/1493877275 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:19.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.962+0000 7f4737fff640 1 -- 172.21.15.5:0/1493877275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562cdf737070 msgr2=0x562cdfadc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:19.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.962+0000 7f4737fff640 1 --2- 172.21.15.5:0/1493877275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562cdf737070 0x562cdfadc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:19.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.962+0000 7f4737fff640 1 -- 172.21.15.5:0/1493877275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562cdf716390 msgr2=0x562cdfadcd40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T05:43:19.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.962+0000 7f4737fff640 1 --2- 172.21.15.5:0/1493877275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562cdf716390 0x562cdfadcd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:19.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.962+0000 7f4737fff640 1 -- 172.21.15.5:0/1493877275 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cdf7a2650 con 0x562cdf70e1b0 2024-08-31T05:43:19.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.962+0000 7f47357fa640 1 -- 172.21.15.5:0/389411767 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f472c018a00 con 0x7f4738108160 2024-08-31T05:43:19.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.962+0000 7f4737fff640 1 --2- 172.21.15.5:0/1493877275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562cdf70e1b0 0x562cdfadc800 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4728009230 tx=0x7f4728004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2050d34233787b86 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:19.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.962+0000 7f471e7fc640 1 -- 172.21.15.5:0/1493877275 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4728037040 con 0x562cdf70e1b0 2024-08-31T05:43:19.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.962+0000 7f471e7fc640 1 -- 172.21.15.5:0/1493877275 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47280054f0 con 0x562cdf70e1b0 2024-08-31T05:43:19.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.962+0000 7f471e7fc640 1 -- 172.21.15.5:0/1493877275 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47280035f0 con 0x562cdf70e1b0 2024-08-31T05:43:19.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.963+0000 7f47357fa640 1 --2- 172.21.15.5:0/389411767 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f47200b4ca0 0x7f47200b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:19.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.963+0000 7f473ce17640 1 --2- 172.21.15.5:0/389411767 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f47200b4ca0 0x7f47200b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:19.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.963+0000 7f47357fa640 1 -- 172.21.15.5:0/389411767 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9511+0+0 (secure 0 0 0) 0x7f472c0e5c30 con 0x7f4738108160 2024-08-31T05:43:19.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.963+0000 7f4744def740 1 -- 172.21.15.5:0/1493877275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562cdf70e1b0 msgr2=0x562cdfadc800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:19.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.963+0000 7f4744def740 1 --2- 172.21.15.5:0/1493877275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562cdf70e1b0 0x562cdfadc800 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4728009230 tx=0x7f4728004040 comp rx=0 tx=0).stop 2024-08-31T05:43:19.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.963+0000 7f473ce17640 1 --2- 172.21.15.5:0/389411767 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f47200b4ca0 0x7f47200b71b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f4730005fd0 tx=0x7f4730009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:19.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.963+0000 7f4744def740 1 -- 172.21.15.5:0/1493877275 shutdown_connections 2024-08-31T05:43:19.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.963+0000 7f4744def740 1 --2- 172.21.15.5:0/1493877275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562cdf716390 0x562cdfadcd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:19.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.963+0000 7f4744def740 1 --2- 172.21.15.5:0/1493877275 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562cdf70e1b0 0x562cdfadc800 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:19.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.963+0000 7f4744def740 1 --2- 172.21.15.5:0/1493877275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562cdf737070 0x562cdfadc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:19.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.963+0000 7f4744def740 1 -- 172.21.15.5:0/1493877275 >> 172.21.15.5:0/1493877275 conn(0x562cdf72b460 msgr2=0x562cdfada1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:19.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.963+0000 7f4744def740 1 -- 172.21.15.5:0/1493877275 shutdown_connections 2024-08-31T05:43:19.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.963+0000 7f4744def740 1 -- 172.21.15.5:0/1493877275 wait complete. 2024-08-31T05:43:19.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.964+0000 7f4744def740 1 -- start start 2024-08-31T05:43:19.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.964+0000 7f4744def740 1 Processor -- start 2024-08-31T05:43:19.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.964+0000 7f4744def740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562cdf70e1b0 0x562cdfae7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:19.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.964+0000 7f4744def740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562cdf716390 0x562cdfae8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:19.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.964+0000 7f4744def740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562cdf737070 0x562cdfaf3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:19.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.964+0000 7f4744def740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x562cdf8a5700 con 0x562cdf70e1b0 2024-08-31T05:43:19.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.965+0000 7f4744def740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562cdf9c9700 con 0x562cdf716390 2024-08-31T05:43:19.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.965+0000 7f4744def740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562cdfaeaa40 con 0x562cdf737070 2024-08-31T05:43:19.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.965+0000 7f4744def740 10 client.0 _ll_register_callbacks cb 0x562cdf9f8dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:43:19.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.965+0000 7f4737fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562cdf70e1b0 0x562cdfae7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:19.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.965+0000 7f47377fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562cdf716390 0x562cdfae8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:19.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.965+0000 7f4737fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562cdf70e1b0 0x562cdfae7aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37936/0 (socket says 172.21.15.5:37936) 2024-08-31T05:43:19.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.965+0000 7f4737fff640 1 -- 172.21.15.5:0/225912594 learned_addr learned my addr 172.21.15.5:0/225912594 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:19.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.965+0000 7f473ce17640 1 --2- 172.21.15.5:0/225912594 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562cdf737070 0x562cdfaf3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:19.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.965+0000 7f47377fe640 1 -- 172.21.15.5:0/225912594 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562cdf737070 msgr2=0x562cdfaf3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:19.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.965+0000 7f47377fe640 1 --2- 172.21.15.5:0/225912594 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562cdf737070 0x562cdfaf3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:19.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.965+0000 7f47377fe640 1 -- 172.21.15.5:0/225912594 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562cdf70e1b0 msgr2=0x562cdfae7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:19.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.965+0000 7f47377fe640 1 --2- 172.21.15.5:0/225912594 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562cdf70e1b0 0x562cdfae7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:19.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.965+0000 7f47377fe640 1 -- 172.21.15.5:0/225912594 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cdfa028b0 con 0x562cdf716390 2024-08-31T05:43:19.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.965+0000 7f47377fe640 1 --2- 172.21.15.5:0/225912594 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562cdf716390 0x562cdfae8000 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f472c0e2fa0 tx=0x7f472c0abef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44d5d1654ff68366 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:19.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.965+0000 7f47177fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:43:19.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.965+0000 7f47177fe640 1 -- 172.21.15.5:0/225912594 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f472c0b5260 con 0x562cdf716390 2024-08-31T05:43:19.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.965+0000 7f47177fe640 1 -- 172.21.15.5:0/225912594 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9511+0+0 (secure 0 0 0) 0x7f472c0b0400 con 0x562cdf716390 2024-08-31T05:43:19.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.965+0000 7f4744def740 1 -- 172.21.15.5:0/225912594 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47280054f0 con 0x562cdf716390 2024-08-31T05:43:19.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.966+0000 7f47177fe640 1 -- 172.21.15.5:0/225912594 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f472c010430 con 0x562cdf716390 2024-08-31T05:43:19.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.966+0000 7f4744def740 10 client.28658 fetch_fsmap learned FSMap version 35 2024-08-31T05:43:19.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.966+0000 7f4744def740 1 -- 172.21.15.5:0/225912594 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x562cdfaf68b0 con 0x562cdf716390 2024-08-31T05:43:19.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.966+0000 7f47177fe640 1 -- 172.21.15.5:0/225912594 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47280054f0 con 0x562cdf716390 2024-08-31T05:43:19.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.966+0000 7f47177fe640 1 -- 172.21.15.5:0/225912594 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 35) ==== 8382+0+0 (secure 0 0 0) 0x7f472c0ab250 con 0x562cdf716390 2024-08-31T05:43:19.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.966+0000 7f4744def740 10 client.28658 fetch_fsmap finished waiting for FSMap version 35 2024-08-31T05:43:19.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.966+0000 7f4744def740 10 client.28658 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:43:19.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.966+0000 7f4744def740 20 client.28658 populate_metadata read hostname 'smithi005' 2024-08-31T05:43:19.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.966+0000 7f4744def740 1 --2- 172.21.15.5:0/225912594 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x562cdf6f59f0 0x562cdfaf9d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:19.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.966+0000 7f4744def740 4 client.28658 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:43:19.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.966+0000 7f4744def740 1 -- 172.21.15.5:0/225912594 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562cdfa55580 con 0x562cdf6f59f0 2024-08-31T05:43:19.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.966+0000 7f4737fff640 1 --2- 172.21.15.5:0/225912594 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x562cdf6f59f0 0x562cdfaf9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:19.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.967+0000 7f47177fe640 10 client.28658 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:43:19.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.967+0000 7f4737fff640 1 --2- 172.21.15.5:0/225912594 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x562cdf6f59f0 0x562cdfaf9d50 crc :-1 s=READY pgs=291 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a7e18876f02338f server_cookie=74453abf091477b8 in_seq=0 out_seq=0 2024-08-31T05:43:19.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.970+0000 7f47177fe640 1 -- 172.21.15.5:0/225912594 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562cdfa55580 con 0x562cdf6f59f0 2024-08-31T05:43:19.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.970+0000 7f47177fe640 10 client.28658 handle_command_reply: tid=0 2024-08-31T05:43:19.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.970+0000 7f4744def740 1 client.28658 shutdown 2024-08-31T05:43:19.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.970+0000 7f4744def740 1 -- 172.21.15.5:0/225912594 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562cdf716390 msgr2=0x562cdfae8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:19.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.970+0000 7f4744def740 1 --2- 172.21.15.5:0/225912594 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562cdf716390 0x562cdfae8000 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f472c0e2fa0 tx=0x7f472c0abef0 comp rx=0 tx=0).stop 2024-08-31T05:43:19.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.970+0000 7f4744def740 1 -- 172.21.15.5:0/225912594 shutdown_connections 2024-08-31T05:43:19.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.970+0000 7f4744def740 1 --2- 172.21.15.5:0/225912594 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x562cdf6f59f0 0x562cdfaf9d50 crc :-1 s=READY pgs=291 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:19.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.970+0000 7f4744def740 1 --2- 172.21.15.5:0/225912594 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562cdf737070 0x562cdfaf3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:19.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.970+0000 7f47177fe640 0 client.28658 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:43:19.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.970+0000 7f4744def740 1 --2- 172.21.15.5:0/225912594 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562cdf716390 0x562cdfae8000 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:19.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.970+0000 7f4744def740 1 --2- 172.21.15.5:0/225912594 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562cdf70e1b0 0x562cdfae7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:19.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.970+0000 7f4744def740 1 -- 172.21.15.5:0/225912594 >> 172.21.15.5:0/225912594 conn(0x562cdf72b460 msgr2=0x562cdfadf450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:19.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.970+0000 7f4744def740 1 -- 172.21.15.5:0/225912594 shutdown_connections 2024-08-31T05:43:19.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.970+0000 7f4744def740 1 -- 172.21.15.5:0/225912594 wait complete. 2024-08-31T05:43:19.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.971+0000 7f4744def740 20 client.28658 trim_cache size 0 max 16384 2024-08-31T05:43:19.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.991+0000 7f4744def740 1 Processor -- start 2024-08-31T05:43:19.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.991+0000 7f4744def740 1 -- start start 2024-08-31T05:43:19.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.991+0000 7f4744def740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562cdf70e1b0 0x562cdfadfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:19.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.991+0000 7f4744def740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562cdf716390 0x562cdfaf3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:19.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.991+0000 7f4744def740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562cdf737070 0x562cdfaf41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:19.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.991+0000 7f4744def740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f47381aec60 con 0x562cdf70e1b0 2024-08-31T05:43:19.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.991+0000 7f4744def740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f47381b0830 con 0x562cdf737070 2024-08-31T05:43:19.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.991+0000 7f4744def740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f47381af330 con 0x562cdf716390 2024-08-31T05:43:19.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.992+0000 7f47377fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562cdf716390 0x562cdfaf3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:19.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.992+0000 7f4737fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562cdf70e1b0 0x562cdfadfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:19.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.992+0000 7f47377fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562cdf716390 0x562cdfaf3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:32972/0 (socket says 172.21.15.5:32972) 2024-08-31T05:43:19.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.992+0000 7f4737fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562cdf70e1b0 0x562cdfadfad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37946/0 (socket says 172.21.15.5:37946) 2024-08-31T05:43:19.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.992+0000 7f47377fe640 1 -- 172.21.15.5:0/1238749819 learned_addr learned my addr 172.21.15.5:0/1238749819 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:19.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.992+0000 7f473ce17640 1 --2- 172.21.15.5:0/1238749819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562cdf737070 0x562cdfaf41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:19.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.992+0000 7f47377fe640 1 -- 172.21.15.5:0/1238749819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562cdf737070 msgr2=0x562cdfaf41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:19.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.992+0000 7f47377fe640 1 --2- 172.21.15.5:0/1238749819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562cdf737070 0x562cdfaf41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:19.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.992+0000 7f47377fe640 1 -- 172.21.15.5:0/1238749819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562cdf70e1b0 msgr2=0x562cdfadfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:19.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.992+0000 7f47377fe640 1 --2- 172.21.15.5:0/1238749819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562cdf70e1b0 0x562cdfadfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:19.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.992+0000 7f47377fe640 1 -- 172.21.15.5:0/1238749819 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cdfade5b0 con 0x562cdf716390 2024-08-31T05:43:19.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.992+0000 7f4737fff640 1 --2- 172.21.15.5:0/1238749819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562cdf70e1b0 0x562cdfadfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:43:19.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.992+0000 7f47377fe640 1 --2- 172.21.15.5:0/1238749819 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562cdf716390 0x562cdfaf3c60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f472c00c6a0 tx=0x7f472c014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96d9c3ef8a389802 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:19.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.993+0000 7f471dffb640 1 -- 172.21.15.5:0/1238749819 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f472c0b5260 con 0x562cdf716390 2024-08-31T05:43:19.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.993+0000 7f471dffb640 1 -- 172.21.15.5:0/1238749819 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f472c0a7b90 con 0x562cdf716390 2024-08-31T05:43:19.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.993+0000 7f471dffb640 1 -- 172.21.15.5:0/1238749819 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f472c0b0410 con 0x562cdf716390 2024-08-31T05:43:19.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.994+0000 7f4744def740 1 -- 172.21.15.5:0/1238749819 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562cdf716390 msgr2=0x562cdfaf3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:20.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.994+0000 7f4744def740 1 --2- 172.21.15.5:0/1238749819 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562cdf716390 0x562cdfaf3c60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f472c00c6a0 tx=0x7f472c014000 comp rx=0 tx=0).stop 2024-08-31T05:43:20.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.994+0000 7f4744def740 1 -- 172.21.15.5:0/1238749819 shutdown_connections 2024-08-31T05:43:20.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.994+0000 7f4744def740 1 --2- 172.21.15.5:0/1238749819 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562cdf737070 0x562cdfaf41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:20.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.994+0000 7f4744def740 1 --2- 172.21.15.5:0/1238749819 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562cdf716390 0x562cdfaf3c60 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:20.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.994+0000 7f4744def740 1 --2- 172.21.15.5:0/1238749819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562cdf70e1b0 0x562cdfadfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:20.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.994+0000 7f4744def740 1 -- 172.21.15.5:0/1238749819 >> 172.21.15.5:0/1238749819 conn(0x562cdf72b460 msgr2=0x562cdfadf3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:20.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.994+0000 7f4744def740 1 -- 172.21.15.5:0/1238749819 shutdown_connections 2024-08-31T05:43:20.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.994+0000 7f4744def740 1 -- 172.21.15.5:0/1238749819 wait complete. 2024-08-31T05:43:20.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.994+0000 7f4744def740 1 -- start start 2024-08-31T05:43:20.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.995+0000 7f4744def740 1 Processor -- start 2024-08-31T05:43:20.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.995+0000 7f4744def740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562cdf70e1b0 0x562cdfaec340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:20.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.995+0000 7f4744def740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562cdf716390 0x562cdfaec880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:20.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.995+0000 7f4744def740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562cdf737070 0x562cdfb636b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:20.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.995+0000 7f4744def740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f47381b0160 con 0x562cdf737070 2024-08-31T05:43:20.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.995+0000 7f4744def740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f47381afa90 con 0x562cdf70e1b0 2024-08-31T05:43:20.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.995+0000 7f4744def740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f47381acc60 con 0x562cdf716390 2024-08-31T05:43:20.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.995+0000 7f4744def740 10 client.0 _ll_register_callbacks cb 0x7f472c0a7eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:43:20.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.995+0000 7f4737fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562cdf70e1b0 0x562cdfaec340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:20.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.996+0000 7f4737fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562cdf70e1b0 0x562cdfaec340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:33038/0 (socket says 172.21.15.5:33038) 2024-08-31T05:43:20.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.996+0000 7f4737fff640 1 -- 172.21.15.5:0/1702687281 learned_addr learned my addr 172.21.15.5:0/1702687281 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:20.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.996+0000 7f473ce17640 1 --2- 172.21.15.5:0/1702687281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562cdf737070 0x562cdfb636b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:20.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.996+0000 7f47377fe640 1 --2- 172.21.15.5:0/1702687281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562cdf716390 0x562cdfaec880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:20.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.996+0000 7f4737fff640 1 -- 172.21.15.5:0/1702687281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562cdf716390 msgr2=0x562cdfaec880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:20.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.996+0000 7f4737fff640 1 --2- 172.21.15.5:0/1702687281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562cdf716390 0x562cdfaec880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:20.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.996+0000 7f4737fff640 1 -- 172.21.15.5:0/1702687281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562cdf737070 msgr2=0x562cdfb636b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:20.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.996+0000 7f4737fff640 1 --2- 172.21.15.5:0/1702687281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562cdf737070 0x562cdfb636b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:20.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.996+0000 7f4737fff640 1 -- 172.21.15.5:0/1702687281 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cdfb63bf0 con 0x562cdf70e1b0 2024-08-31T05:43:20.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.996+0000 7f473ce17640 1 --2- 172.21.15.5:0/1702687281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562cdf737070 0x562cdfb636b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:43:20.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.996+0000 7f4737fff640 1 --2- 172.21.15.5:0/1702687281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562cdf70e1b0 0x562cdfaec340 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4728009230 tx=0x7f4728009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e466704271330a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:20.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.996+0000 7f47177fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:43:20.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.996+0000 7f47177fe640 1 -- 172.21.15.5:0/1702687281 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4728037040 con 0x562cdf70e1b0 2024-08-31T05:43:20.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.996+0000 7f4744def740 1 -- 172.21.15.5:0/1702687281 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f472c0a7b90 con 0x562cdf70e1b0 2024-08-31T05:43:20.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.996+0000 7f47177fe640 1 -- 172.21.15.5:0/1702687281 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9511+0+0 (secure 0 0 0) 0x7f4728004770 con 0x562cdf70e1b0 2024-08-31T05:43:20.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.997+0000 7f47177fe640 1 -- 172.21.15.5:0/1702687281 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f4728004970 con 0x562cdf70e1b0 2024-08-31T05:43:20.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.997+0000 7f4744def740 10 client.28664 fetch_fsmap learned FSMap version 35 2024-08-31T05:43:20.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.997+0000 7f4744def740 1 -- 172.21.15.5:0/1702687281 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x562cdfb64de0 con 0x562cdf70e1b0 2024-08-31T05:43:20.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.997+0000 7f47177fe640 1 -- 172.21.15.5:0/1702687281 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f472c0a7b90 con 0x562cdf70e1b0 2024-08-31T05:43:20.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.997+0000 7f47177fe640 1 -- 172.21.15.5:0/1702687281 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 35) ==== 8382+0+0 (secure 0 0 0) 0x7f47280038c0 con 0x562cdf70e1b0 2024-08-31T05:43:20.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.997+0000 7f4744def740 10 client.28664 fetch_fsmap finished waiting for FSMap version 35 2024-08-31T05:43:20.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.997+0000 7f4744def740 10 client.28664 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:43:20.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.997+0000 7f4744def740 20 client.28664 populate_metadata read hostname 'smithi005' 2024-08-31T05:43:20.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.997+0000 7f4744def740 1 --2- 172.21.15.5:0/1702687281 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x562cdf6cada0 0x562cdfb671f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:20.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.997+0000 7f4744def740 4 client.28664 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T05:43:20.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.997+0000 7f4744def740 1 -- 172.21.15.5:0/1702687281 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562cdfa51020 con 0x562cdf6cada0 2024-08-31T05:43:20.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.997+0000 7f47377fe640 1 --2- 172.21.15.5:0/1702687281 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x562cdf6cada0 0x562cdfb671f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:20.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.998+0000 7f47177fe640 10 client.28664 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:43:20.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:19.998+0000 7f47377fe640 1 --2- 172.21.15.5:0/1702687281 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x562cdf6cada0 0x562cdfb671f0 crc :-1 s=READY pgs=292 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97b7babc5facd728 server_cookie=fa56140be927c263 in_seq=0 out_seq=0 2024-08-31T05:43:20.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:20.000+0000 7f47177fe640 1 -- 172.21.15.5:0/1702687281 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4918 (crc 0 0 0) 0x562cdfa51020 con 0x562cdf6cada0 2024-08-31T05:43:20.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:20.000+0000 7f47177fe640 10 client.28664 handle_command_reply: tid=0 2024-08-31T05:43:20.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:20.000+0000 7f4744def740 1 client.28664 shutdown 2024-08-31T05:43:20.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:20.000+0000 7f4744def740 1 -- 172.21.15.5:0/1702687281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562cdf70e1b0 msgr2=0x562cdfaec340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:20.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:20.000+0000 7f4744def740 1 --2- 172.21.15.5:0/1702687281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562cdf70e1b0 0x562cdfaec340 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4728009230 tx=0x7f4728009260 comp rx=0 tx=0).stop 2024-08-31T05:43:20.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:20.000+0000 7f4744def740 1 -- 172.21.15.5:0/1702687281 shutdown_connections 2024-08-31T05:43:20.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:20.000+0000 7f4744def740 1 --2- 172.21.15.5:0/1702687281 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x562cdf6cada0 0x562cdfb671f0 crc :-1 s=READY pgs=292 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:20.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:20.000+0000 7f4744def740 1 --2- 172.21.15.5:0/1702687281 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562cdf737070 0x562cdfb636b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:20.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:20.000+0000 7f4744def740 1 --2- 172.21.15.5:0/1702687281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562cdf716390 0x562cdfaec880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:20.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:20.000+0000 7f4744def740 1 --2- 172.21.15.5:0/1702687281 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562cdf70e1b0 0x562cdfaec340 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:20.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:20.000+0000 7f47177fe640 0 client.28664 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:43:20.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:20.000+0000 7f4744def740 1 -- 172.21.15.5:0/1702687281 >> 172.21.15.5:0/1702687281 conn(0x562cdf72b460 msgr2=0x562cdfad9ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:20.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:20.000+0000 7f4744def740 1 -- 172.21.15.5:0/1702687281 shutdown_connections 2024-08-31T05:43:20.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:20.000+0000 7f4744def740 1 -- 172.21.15.5:0/1702687281 wait complete. 2024-08-31T05:43:20.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:20.000+0000 7f4744def740 20 client.28664 trim_cache size 0 max 16384 2024-08-31T05:43:20.006 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:43:20.006 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "no active scrubs running", 2024-08-31T05:43:20.006 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": {}, 2024-08-31T05:43:20.006 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_stats": { 2024-08-31T05:43:20.006 INFO:teuthology.orchestra.run.smithi005.stdout: "9a98c3be-1a83-4ac4-9efb-e98104b2c85a": { 2024-08-31T05:43:20.006 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:42:46.122404+0000", 2024-08-31T05:43:20.006 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:43:20.006 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:43:20.006 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:43:20.006 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:43:20.006 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:43:20.007 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:43:20.007 INFO:teuthology.orchestra.run.smithi005.stdout: "ab2853ca-505f-43fc-a132-af8bca186292": { 2024-08-31T05:43:20.007 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:40:23.937602+0000", 2024-08-31T05:43:20.007 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:43:20.007 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:43:20.007 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:43:20.007 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:43:20.007 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:43:20.007 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:43:20.007 INFO:teuthology.orchestra.run.smithi005.stdout: "75d84398-5d9c-4872-b879-2fbce045fa71": { 2024-08-31T05:43:20.007 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:06.642335+0000", 2024-08-31T05:43:20.007 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:43:20.007 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:43:20.008 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:43:20.008 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:43:20.008 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:43:20.008 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:43:20.008 INFO:teuthology.orchestra.run.smithi005.stdout: "ece37b07-9ab2-45f8-bc33-2755a07aac0b": { 2024-08-31T05:43:20.008 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:31:41.782407+0000", 2024-08-31T05:43:20.008 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:43:20.008 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:43:20.008 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:43:20.008 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:43:20.008 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:43:20.008 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:43:20.008 INFO:teuthology.orchestra.run.smithi005.stdout: "728a42ca-bbef-4151-830f-5fdd411d8fa0": { 2024-08-31T05:43:20.008 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:32:30.554906+0000", 2024-08-31T05:43:20.009 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:43:20.009 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:43:20.009 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:43:20.009 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:43:20.009 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:43:20.009 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:43:20.009 INFO:teuthology.orchestra.run.smithi005.stdout: "cda92ac0-b35f-47a5-a3a5-471c888462a5": { 2024-08-31T05:43:20.009 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:53.103905+0000", 2024-08-31T05:43:20.009 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:43:20.009 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:43:20.009 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:43:20.009 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:43:20.009 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:43:20.010 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:43:20.010 INFO:teuthology.orchestra.run.smithi005.stdout: "0bb67292-013a-40c7-b5fc-810bdd9715d8": { 2024-08-31T05:43:20.010 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:34:04.586008+0000", 2024-08-31T05:43:20.010 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:43:20.010 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:43:20.010 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:43:20.010 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:43:20.010 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:43:20.010 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:43:20.010 INFO:teuthology.orchestra.run.smithi005.stdout: "c9a687a5-4adf-4788-8f18-4c06352efa9b": { 2024-08-31T05:43:20.010 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:41:11.380197+0000", 2024-08-31T05:43:20.010 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:43:20.010 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:43:20.010 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:43:20.011 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:43:20.011 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:43:20.011 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:43:20.011 INFO:teuthology.orchestra.run.smithi005.stdout: "de9731c7-ae4a-42fe-8146-e4752cdc40d4": { 2024-08-31T05:43:20.011 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:34:53.614499+0000", 2024-08-31T05:43:20.011 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:43:20.011 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:43:20.011 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:43:20.011 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:43:20.011 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:43:20.011 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:43:20.011 INFO:teuthology.orchestra.run.smithi005.stdout: "f4db3406-20ff-46a3-baf9-099e16392f76": { 2024-08-31T05:43:20.011 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:38:49.034412+0000", 2024-08-31T05:43:20.012 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:43:20.012 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:43:20.012 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:43:20.012 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:43:20.012 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:43:20.012 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:43:20.012 INFO:teuthology.orchestra.run.smithi005.stdout: "095ccc7a-f368-4bc6-9563-5930e21f9b4a": { 2024-08-31T05:43:20.012 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:35:40.190069+0000", 2024-08-31T05:43:20.012 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:43:20.012 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:43:20.012 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:43:20.012 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:43:20.012 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:43:20.012 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:43:20.013 INFO:teuthology.orchestra.run.smithi005.stdout: "4788e020-0dc9-4938-9db8-dfd5992cb286": { 2024-08-31T05:43:20.013 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:41:58.905797+0000", 2024-08-31T05:43:20.013 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:43:20.013 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:43:20.013 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:43:20.013 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:43:20.013 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:43:20.013 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:43:20.013 INFO:teuthology.orchestra.run.smithi005.stdout: "297c26f3-7b4d-4245-abb0-f854248e5e1b": { 2024-08-31T05:43:20.013 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:37:14.019244+0000", 2024-08-31T05:43:20.013 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:43:20.013 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:43:20.013 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:43:20.014 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:43:20.014 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:43:20.014 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:43:20.014 INFO:teuthology.orchestra.run.smithi005.stdout: "a4d4cf74-2477-4dd9-a3a2-3762b4dd87e4": { 2024-08-31T05:43:20.014 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:38:01.378833+0000", 2024-08-31T05:43:20.014 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:43:20.014 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:43:20.014 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:43:20.014 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:43:20.014 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:43:20.014 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:43:20.014 INFO:teuthology.orchestra.run.smithi005.stdout: "94c23057-592d-4a8b-82d7-da2d84f8740b": { 2024-08-31T05:43:20.014 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:36:27.513638+0000", 2024-08-31T05:43:20.014 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:43:20.015 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:43:20.015 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:43:20.015 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:43:20.015 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:43:20.015 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:43:20.015 INFO:teuthology.orchestra.run.smithi005.stdout: "2445fc42-b797-434f-b380-e2da985b4d98": { 2024-08-31T05:43:20.015 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:33:17.681453+0000", 2024-08-31T05:43:20.015 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:43:20.015 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:43:20.015 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:43:20.015 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:43:20.015 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:43:20.015 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:43:20.015 INFO:teuthology.orchestra.run.smithi005.stdout: "239b7958-db06-4432-93ce-b7552effa357": { 2024-08-31T05:43:20.016 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:39:35.733028+0000", 2024-08-31T05:43:20.016 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:43:20.016 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:43:20.016 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:43:20.016 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:43:20.016 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:43:20.016 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:43:20.016 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:43:20.016 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:43:20.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:20.001+0000 7f473e87a640 1 -- 172.21.15.5:0/389411767 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f47200b4ca0 msgr2=0x7f47200b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:20.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:20.001+0000 7f473e87a640 1 --2- 172.21.15.5:0/389411767 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f47200b4ca0 0x7f47200b71b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f4730005fd0 tx=0x7f4730009500 comp rx=0 tx=0).stop 2024-08-31T05:43:20.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:20.001+0000 7f473e87a640 1 -- 172.21.15.5:0/389411767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4738108160 msgr2=0x7f4738198680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:20.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:20.001+0000 7f473e87a640 1 --2- 172.21.15.5:0/389411767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4738108160 0x7f4738198680 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f472c00e9f0 tx=0x7f472c00eeb0 comp rx=0 tx=0).stop 2024-08-31T05:43:20.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:20.001+0000 7f473e87a640 1 -- 172.21.15.5:0/389411767 shutdown_connections 2024-08-31T05:43:20.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:20.001+0000 7f473e87a640 1 --2- 172.21.15.5:0/389411767 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f47200b4ca0 0x7f47200b71b0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:20.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:20.001+0000 7f473e87a640 1 --2- 172.21.15.5:0/389411767 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f4738108ab0 0x7f473819d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:20.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:20.001+0000 7f473e87a640 1 --2- 172.21.15.5:0/389411767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4738108160 0x7f4738198680 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:20.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:20.001+0000 7f473e87a640 1 --2- 172.21.15.5:0/389411767 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4738102870 0x7f47381980e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:20.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:20.001+0000 7f473e87a640 1 -- 172.21.15.5:0/389411767 >> 172.21.15.5:0/389411767 conn(0x7f4738079470 msgr2=0x7f4738106250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:20.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:20.001+0000 7f473e87a640 1 -- 172.21.15.5:0/389411767 shutdown_connections 2024-08-31T05:43:20.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:20.001+0000 7f473e87a640 1 -- 172.21.15.5:0/389411767 wait complete. 2024-08-31T05:43:20.267 INFO:tasks.workunit.client.0.smithi005.stdout: 10 2555 42.58 MB/sec warmup 7 sec latency 40.081 ms 2024-08-31T05:43:20.916 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T05:43:20.917 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T05:43:21.209 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:43:21.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:20 smithi005 ceph-mon[18602]: pgmap v760: 129 pgs: 129 active+clean; 737 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 22 MiB/s wr, 403 op/s 2024-08-31T05:43:21.267 INFO:tasks.workunit.client.0.smithi005.stdout: 10 3121 42.82 MB/sec warmup 8 sec latency 907.455 ms 2024-08-31T05:43:21.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:20 smithi070 ceph-mon[22316]: pgmap v760: 129 pgs: 129 active+clean; 737 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 22 MiB/s wr, 403 op/s 2024-08-31T05:43:21.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:20 smithi050 ceph-mon[22146]: pgmap v760: 129 pgs: 129 active+clean; 737 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 22 MiB/s wr, 403 op/s 2024-08-31T05:43:21.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:21.700+0000 7f6ae37c8640 1 -- 172.21.15.5:0/3505914496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6adc102880 msgr2=0x7f6adc102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:21.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:21.700+0000 7f6ae37c8640 1 --2- 172.21.15.5:0/3505914496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6adc102880 0x7f6adc102c90 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0009900 tx=0x7f6ad002a410 comp rx=0 tx=0).stop 2024-08-31T05:43:21.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:21.700+0000 7f6ae37c8640 1 -- 172.21.15.5:0/3505914496 shutdown_connections 2024-08-31T05:43:21.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:21.700+0000 7f6ae37c8640 1 --2- 172.21.15.5:0/3505914496 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6adc108ac0 0x7f6adc10f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:21.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:21.701+0000 7f6ae37c8640 1 --2- 172.21.15.5:0/3505914496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6adc108170 0x7f6adc108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:21.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:21.701+0000 7f6ae37c8640 1 --2- 172.21.15.5:0/3505914496 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6adc102880 0x7f6adc102c90 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:21.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:21.701+0000 7f6ae37c8640 1 -- 172.21.15.5:0/3505914496 >> 172.21.15.5:0/3505914496 conn(0x7f6adc079500 msgr2=0x7f6adc079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:21.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:21.701+0000 7f6ae37c8640 1 -- 172.21.15.5:0/3505914496 shutdown_connections 2024-08-31T05:43:21.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:21.701+0000 7f6ae37c8640 1 -- 172.21.15.5:0/3505914496 wait complete. 2024-08-31T05:43:21.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:21.702+0000 7f6ae37c8640 1 Processor -- start 2024-08-31T05:43:21.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:21.702+0000 7f6ae37c8640 1 -- start start 2024-08-31T05:43:21.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:21.702+0000 7f6ae37c8640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6adc102880 0x7f6adc19b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:21.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:21.702+0000 7f6ae37c8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6adc108170 0x7f6adc19b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:21.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:21.702+0000 7f6ae37c8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6adc108ac0 0x7f6adc19bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:21.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:21.702+0000 7f6ae37c8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6adc112740 con 0x7f6adc108ac0 2024-08-31T05:43:21.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:21.702+0000 7f6ae37c8640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6adc1125c0 con 0x7f6adc102880 2024-08-31T05:43:21.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:21.702+0000 7f6ae37c8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6adc1128c0 con 0x7f6adc108170 2024-08-31T05:43:21.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:21.702+0000 7f6ae1d65640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6adc108ac0 0x7f6adc19bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:21.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:21.702+0000 7f6ae1d65640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6adc108ac0 0x7f6adc19bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37966/0 (socket says 172.21.15.5:37966) 2024-08-31T05:43:21.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:21.702+0000 7f6ae1d65640 1 -- 172.21.15.5:0/1776198515 learned_addr learned my addr 172.21.15.5:0/1776198515 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:21.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:21.702+0000 7f6ae0d63640 1 --2- 172.21.15.5:0/1776198515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6adc108170 0x7f6adc19b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:21.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:21.702+0000 7f6ae1564640 1 --2- 172.21.15.5:0/1776198515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6adc102880 0x7f6adc19b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:21.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:21.702+0000 7f6ae1d65640 1 -- 172.21.15.5:0/1776198515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6adc108170 msgr2=0x7f6adc19b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:21.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:21.702+0000 7f6ae1d65640 1 --2- 172.21.15.5:0/1776198515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6adc108170 0x7f6adc19b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:21.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:21.702+0000 7f6ae1d65640 1 -- 172.21.15.5:0/1776198515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6adc102880 msgr2=0x7f6adc19b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:21.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:21.702+0000 7f6ae1d65640 1 --2- 172.21.15.5:0/1776198515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6adc102880 0x7f6adc19b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:21.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:21.703+0000 7f6ae1d65640 1 -- 172.21.15.5:0/1776198515 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6adc1a6340 con 0x7f6adc108ac0 2024-08-31T05:43:21.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:21.703+0000 7f6ae0d63640 1 --2- 172.21.15.5:0/1776198515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6adc108170 0x7f6adc19b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:43:21.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:21.703+0000 7f6ae1564640 1 --2- 172.21.15.5:0/1776198515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6adc102880 0x7f6adc19b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:43:21.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:21.703+0000 7f6ae1d65640 1 --2- 172.21.15.5:0/1776198515 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6adc108ac0 0x7f6adc19bb30 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f6ad400eb10 tx=0x7f6ad400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:21.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:21.703+0000 7f6ace7fc640 1 -- 172.21.15.5:0/1776198515 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad4004b20 con 0x7f6adc108ac0 2024-08-31T05:43:21.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:21.703+0000 7f6ae37c8640 1 -- 172.21.15.5:0/1776198515 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6adc1a6630 con 0x7f6adc108ac0 2024-08-31T05:43:21.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:21.703+0000 7f6ace7fc640 1 -- 172.21.15.5:0/1776198515 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ad4004cc0 con 0x7f6adc108ac0 2024-08-31T05:43:21.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:21.703+0000 7f6ace7fc640 1 -- 172.21.15.5:0/1776198515 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad4010670 con 0x7f6adc108ac0 2024-08-31T05:43:21.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:21.703+0000 7f6ae37c8640 1 -- 172.21.15.5:0/1776198515 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6adc1a6b70 con 0x7f6adc108ac0 2024-08-31T05:43:21.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:21.704+0000 7f6ae37c8640 1 -- 172.21.15.5:0/1776198515 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6adc103ab0 con 0x7f6adc108ac0 2024-08-31T05:43:21.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:21.707+0000 7f6ace7fc640 1 -- 172.21.15.5:0/1776198515 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f6ad4010810 con 0x7f6adc108ac0 2024-08-31T05:43:21.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:21.707+0000 7f6ace7fc640 1 --2- 172.21.15.5:0/1776198515 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f6ac80b4cd0 0x7f6ac80b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:21.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:21.707+0000 7f6ae1564640 1 --2- 172.21.15.5:0/1776198515 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f6ac80b4cd0 0x7f6ac80b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:21.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:21.707+0000 7f6ace7fc640 1 -- 172.21.15.5:0/1776198515 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9511+0+0 (secure 0 0 0) 0x7f6ad40e6000 con 0x7f6adc108ac0 2024-08-31T05:43:21.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:21.708+0000 7f6ae1564640 1 --2- 172.21.15.5:0/1776198515 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f6ac80b4cd0 0x7f6ac80b71e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0000c00 tx=0x7f6ad0031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:21.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:21.712+0000 7f6ace7fc640 1 -- 172.21.15.5:0/1776198515 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6ad4056130 con 0x7f6adc108ac0 2024-08-31T05:43:22.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:22.022+0000 7f6ae37c8640 1 -- 172.21.15.5:0/1776198515 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6adc102c90 con 0x7f6adc108ac0 2024-08-31T05:43:22.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:22.023+0000 7f6ace7fc640 1 -- 172.21.15.5:0/1776198515 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11946 (secure 0 0 0) 0x7f6adc102c90 con 0x7f6adc108ac0 2024-08-31T05:43:22.026 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:43:22.026 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":35,"btime":"2024-08-31T05:43:17:936206+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14739,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2024812199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2024812199},{"type":"v1","addr":"172.21.15.5:6835","nonce":2024812199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3629023702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3629023702},{"type":"v1","addr":"172.21.15.5:6837","nonce":3629023702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T05:27:31.929153+0000","modified":"2024-08-31T05:43:17.082440+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24652,"mds_1":24638,"mds_2":24631,"mds_3":24625,"mds_4":24602},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6839/2412701258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":2412701258},{"type":"v1","addr":"172.21.15.5:6839","nonce":2412701258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14820":{"gid":14820,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6841/747057838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":747057838},{"type":"v1","addr":"172.21.15.5:6841","nonce":747057838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6833/1153378982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1153378982},{"type":"v1","addr":"172.21.15.50:6833","nonce":1153378982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6833/364083443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":364083443},{"type":"v1","addr":"172.21.15.70:6833","nonce":364083443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24587":{"gid":24587,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/2346896794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2346896794},{"type":"v1","addr":"172.21.15.50:6835","nonce":2346896794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24602":{"gid":24602,"name":"h","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.50:6837/428759669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":428759669},{"type":"v1","addr":"172.21.15.50:6837","nonce":428759669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.70:6835/2061504114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2061504114},{"type":"v1","addr":"172.21.15.70:6835","nonce":2061504114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.70:6837/2780036414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2780036414},{"type":"v1","addr":"172.21.15.70:6837","nonce":2780036414}]},"join_fscid":-1,"export_targets":[0,1,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.50:6839/98200944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":98200944},{"type":"v1","addr":"172.21.15.50:6839","nonce":98200944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24652":{"gid":24652,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.70:6839/2756569250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":2756569250},{"type":"v1","addr":"172.21.15.70:6839","nonce":2756569250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24652,"qdb_cluster":[24602,24625,24638,24631,24652]},"id":1}]} 2024-08-31T05:43:22.026 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 35 2024-08-31T05:43:22.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:22.025+0000 7f6ae37c8640 1 -- 172.21.15.5:0/1776198515 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f6ac80b4cd0 msgr2=0x7f6ac80b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:22.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:22.025+0000 7f6ae37c8640 1 --2- 172.21.15.5:0/1776198515 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f6ac80b4cd0 0x7f6ac80b71e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0000c00 tx=0x7f6ad0031400 comp rx=0 tx=0).stop 2024-08-31T05:43:22.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:22.025+0000 7f6ae37c8640 1 -- 172.21.15.5:0/1776198515 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6adc108ac0 msgr2=0x7f6adc19bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:22.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:22.025+0000 7f6ae37c8640 1 --2- 172.21.15.5:0/1776198515 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6adc108ac0 0x7f6adc19bb30 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f6ad400eb10 tx=0x7f6ad400c2d0 comp rx=0 tx=0).stop 2024-08-31T05:43:22.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:22.025+0000 7f6ae37c8640 1 -- 172.21.15.5:0/1776198515 shutdown_connections 2024-08-31T05:43:22.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:22.025+0000 7f6ae37c8640 1 --2- 172.21.15.5:0/1776198515 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f6ac80b4cd0 0x7f6ac80b71e0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:22.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:22.025+0000 7f6ae37c8640 1 --2- 172.21.15.5:0/1776198515 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6adc108ac0 0x7f6adc19bb30 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:22.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:22.025+0000 7f6ae37c8640 1 --2- 172.21.15.5:0/1776198515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6adc108170 0x7f6adc19b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:22.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:22.025+0000 7f6ae37c8640 1 --2- 172.21.15.5:0/1776198515 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6adc102880 0x7f6adc19b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:22.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:22.025+0000 7f6ae37c8640 1 -- 172.21.15.5:0/1776198515 >> 172.21.15.5:0/1776198515 conn(0x7f6adc079500 msgr2=0x7f6adc101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:22.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:22.025+0000 7f6ae37c8640 1 -- 172.21.15.5:0/1776198515 shutdown_connections 2024-08-31T05:43:22.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:22.025+0000 7f6ae37c8640 1 -- 172.21.15.5:0/1776198515 wait complete. 2024-08-31T05:43:22.267 INFO:tasks.workunit.client.0.smithi005.stdout: 10 3641 42.29 MB/sec warmup 9 sec latency 1440.609 ms 2024-08-31T05:43:22.849 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-31T05:43:23.177 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:43:23.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:22 smithi005 ceph-mon[18602]: pgmap v761: 129 pgs: 129 active+clean; 744 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 19 MiB/s wr, 355 op/s 2024-08-31T05:43:23.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:22 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/1776198515' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:43:23.267 INFO:tasks.workunit.client.0.smithi005.stdout: 10 3952 40.15 MB/sec warmup 10 sec latency 161.606 ms 2024-08-31T05:43:23.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:22 smithi070 ceph-mon[22316]: pgmap v761: 129 pgs: 129 active+clean; 744 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 19 MiB/s wr, 355 op/s 2024-08-31T05:43:23.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:22 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/1776198515' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:43:23.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:22 smithi050 ceph-mon[22146]: pgmap v761: 129 pgs: 129 active+clean; 744 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 19 MiB/s wr, 355 op/s 2024-08-31T05:43:23.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:22 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/1776198515' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:43:23.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.900+0000 7f274e494640 1 -- 172.21.15.5:0/3975062657 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2748075550 msgr2=0x7f2748075960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:23.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.900+0000 7f274e494640 1 --2- 172.21.15.5:0/3975062657 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2748075550 0x7f2748075960 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f2738009900 tx=0x7f273802a410 comp rx=0 tx=0).stop 2024-08-31T05:43:23.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.900+0000 7f274e494640 1 -- 172.21.15.5:0/3975062657 shutdown_connections 2024-08-31T05:43:23.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.900+0000 7f274e494640 1 --2- 172.21.15.5:0/3975062657 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f274810fe90 0x7f27481122d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:23.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.900+0000 7f274e494640 1 --2- 172.21.15.5:0/3975062657 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2748075ea0 0x7f274810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:23.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.900+0000 7f274e494640 1 --2- 172.21.15.5:0/3975062657 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2748075550 0x7f2748075960 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:23.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.900+0000 7f274e494640 1 -- 172.21.15.5:0/3975062657 >> 172.21.15.5:0/3975062657 conn(0x7f27480ff380 msgr2=0x7f27481017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:23.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.900+0000 7f274e494640 1 -- 172.21.15.5:0/3975062657 shutdown_connections 2024-08-31T05:43:23.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.900+0000 7f274e494640 1 -- 172.21.15.5:0/3975062657 wait complete. 2024-08-31T05:43:23.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.901+0000 7f274e494640 1 Processor -- start 2024-08-31T05:43:23.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.902+0000 7f274e494640 1 -- start start 2024-08-31T05:43:23.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.902+0000 7f274e494640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2748075550 0x7f274810e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:23.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.902+0000 7f274e494640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2748075ea0 0x7f274810eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:23.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.902+0000 7f274e494640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f274810fe90 0x7f27481ac120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:23.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.902+0000 7f274e494640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f27481043e0 con 0x7f2748075ea0 2024-08-31T05:43:23.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.903+0000 7f274e494640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2748104260 con 0x7f2748075550 2024-08-31T05:43:23.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.903+0000 7f2747fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2748075550 0x7f274810e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:23.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.903+0000 7f27477fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2748075ea0 0x7f274810eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:23.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.903+0000 7f2747fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2748075550 0x7f274810e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:51582/0 (socket says 172.21.15.5:51582) 2024-08-31T05:43:23.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.903+0000 7f27477fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2748075ea0 0x7f274810eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35850/0 (socket says 172.21.15.5:35850) 2024-08-31T05:43:23.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.903+0000 7f2747fff640 1 -- 172.21.15.5:0/759887143 learned_addr learned my addr 172.21.15.5:0/759887143 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:23.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.903+0000 7f274e494640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2748104560 con 0x7f274810fe90 2024-08-31T05:43:23.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.903+0000 7f274ca31640 1 --2- 172.21.15.5:0/759887143 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f274810fe90 0x7f27481ac120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:23.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.903+0000 7f27477fe640 1 -- 172.21.15.5:0/759887143 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f274810fe90 msgr2=0x7f27481ac120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:23.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.903+0000 7f27477fe640 1 --2- 172.21.15.5:0/759887143 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f274810fe90 0x7f27481ac120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:23.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.904+0000 7f27477fe640 1 -- 172.21.15.5:0/759887143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2748075550 msgr2=0x7f274810e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:23.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.904+0000 7f27477fe640 1 --2- 172.21.15.5:0/759887143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2748075550 0x7f274810e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:23.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.904+0000 7f27477fe640 1 -- 172.21.15.5:0/759887143 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27481ac820 con 0x7f2748075ea0 2024-08-31T05:43:23.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.904+0000 7f27477fe640 1 --2- 172.21.15.5:0/759887143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2748075ea0 0x7f274810eb00 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f273c00e9c0 tx=0x7f273c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:23.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.904+0000 7f27457fa640 1 -- 172.21.15.5:0/759887143 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f273c00ccc0 con 0x7f2748075ea0 2024-08-31T05:43:23.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.904+0000 7f274e494640 1 -- 172.21.15.5:0/759887143 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27481acb10 con 0x7f2748075ea0 2024-08-31T05:43:23.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.905+0000 7f274e494640 1 -- 172.21.15.5:0/759887143 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27481ad0a0 con 0x7f2748075ea0 2024-08-31T05:43:23.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.905+0000 7f27457fa640 1 -- 172.21.15.5:0/759887143 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f273c0035f0 con 0x7f2748075ea0 2024-08-31T05:43:23.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.906+0000 7f27457fa640 1 -- 172.21.15.5:0/759887143 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f273c00ce60 con 0x7f2748075ea0 2024-08-31T05:43:23.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.908+0000 7f2754a09740 1 Processor -- start 2024-08-31T05:43:23.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.910+0000 7f27457fa640 1 -- 172.21.15.5:0/759887143 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f273c010690 con 0x7f2748075ea0 2024-08-31T05:43:23.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.910+0000 7f2754a09740 1 -- start start 2024-08-31T05:43:23.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.911+0000 7f2754a09740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561536bf2070 0x561536f97350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:23.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.911+0000 7f2754a09740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561536bc91b0 0x561536f97890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:23.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.911+0000 7f2754a09740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561536bd1390 0x561536f97dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:23.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.911+0000 7f2754a09740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x561536f0e680 con 0x561536bd1390 2024-08-31T05:43:23.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.911+0000 7f2754a09740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x561536efdc10 con 0x561536bf2070 2024-08-31T05:43:23.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.911+0000 7f2754a09740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561536f01bc0 con 0x561536bc91b0 2024-08-31T05:43:23.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.913+0000 7f274ca31640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561536bf2070 0x561536f97350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:23.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.913+0000 7f274ca31640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561536bf2070 0x561536f97350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:51590/0 (socket says 172.21.15.5:51590) 2024-08-31T05:43:23.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.913+0000 7f274ca31640 1 -- 172.21.15.5:0/1192732357 learned_addr learned my addr 172.21.15.5:0/1192732357 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:23.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.913+0000 7f2747fff640 1 --2- 172.21.15.5:0/1192732357 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561536bc91b0 0x561536f97890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:23.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.914+0000 7f27477fe640 1 --2- 172.21.15.5:0/1192732357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561536bd1390 0x561536f97dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:23.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.915+0000 7f2747fff640 1 -- 172.21.15.5:0/1192732357 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561536bf2070 msgr2=0x561536f97350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:23.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.915+0000 7f2747fff640 1 --2- 172.21.15.5:0/1192732357 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561536bf2070 0x561536f97350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:23.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.915+0000 7f2747fff640 1 -- 172.21.15.5:0/1192732357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561536bd1390 msgr2=0x561536f97dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:23.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.915+0000 7f2747fff640 1 --2- 172.21.15.5:0/1192732357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561536bd1390 0x561536f97dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:23.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.915+0000 7f2747fff640 1 -- 172.21.15.5:0/1192732357 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561536c5d650 con 0x561536bc91b0 2024-08-31T05:43:23.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.916+0000 7f27457fa640 1 --2- 172.21.15.5:0/759887143 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f27300b4d90 0x7f27300b72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:23.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.916+0000 7f27457fa640 1 -- 172.21.15.5:0/759887143 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9511+0+0 (secure 0 0 0) 0x7f273c0e5ba0 con 0x7f2748075ea0 2024-08-31T05:43:23.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.916+0000 7f2747fff640 1 --2- 172.21.15.5:0/1192732357 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561536bc91b0 0x561536f97890 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2738000c00 tx=0x7f27380040d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e646b5193f1fe291 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:23.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.917+0000 7f272e7fc640 1 -- 172.21.15.5:0/1192732357 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2738040070 con 0x561536bc91b0 2024-08-31T05:43:23.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.917+0000 7f272e7fc640 1 -- 172.21.15.5:0/1192732357 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27380054d0 con 0x561536bc91b0 2024-08-31T05:43:23.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.917+0000 7f272e7fc640 1 -- 172.21.15.5:0/1192732357 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2738035040 con 0x561536bc91b0 2024-08-31T05:43:23.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.918+0000 7f2754a09740 1 -- 172.21.15.5:0/1192732357 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561536bc91b0 msgr2=0x561536f97890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:23.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.918+0000 7f2754a09740 1 --2- 172.21.15.5:0/1192732357 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561536bc91b0 0x561536f97890 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2738000c00 tx=0x7f27380040d0 comp rx=0 tx=0).stop 2024-08-31T05:43:23.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.919+0000 7f274ca31640 1 --2- 172.21.15.5:0/759887143 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f27300b4d90 0x7f27300b72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:23.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.919+0000 7f2754a09740 1 -- 172.21.15.5:0/1192732357 shutdown_connections 2024-08-31T05:43:23.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.919+0000 7f2754a09740 1 --2- 172.21.15.5:0/1192732357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561536bd1390 0x561536f97dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:23.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.919+0000 7f2754a09740 1 --2- 172.21.15.5:0/1192732357 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561536bc91b0 0x561536f97890 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:23.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.919+0000 7f2754a09740 1 --2- 172.21.15.5:0/1192732357 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561536bf2070 0x561536f97350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:23.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.919+0000 7f2754a09740 1 -- 172.21.15.5:0/1192732357 >> 172.21.15.5:0/1192732357 conn(0x561536be6460 msgr2=0x561536f95240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:23.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.920+0000 7f274ca31640 1 --2- 172.21.15.5:0/759887143 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f27300b4d90 0x7f27300b72a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f27400116b0 tx=0x7f2740009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:23.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.920+0000 7f2754a09740 1 -- 172.21.15.5:0/1192732357 shutdown_connections 2024-08-31T05:43:23.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.921+0000 7f2754a09740 1 -- 172.21.15.5:0/1192732357 wait complete. 2024-08-31T05:43:23.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.921+0000 7f2754a09740 1 -- start start 2024-08-31T05:43:23.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.921+0000 7f2754a09740 1 Processor -- start 2024-08-31T05:43:23.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.923+0000 7f2754a09740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561536bc91b0 0x561536fa2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:23.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.923+0000 7f2754a09740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561536bd1390 0x561536fa2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:23.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.923+0000 7f2754a09740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561536bf2070 0x561536fbfe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:23.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.923+0000 7f2754a09740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x561536d60700 con 0x561536bf2070 2024-08-31T05:43:23.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.923+0000 7f2754a09740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x561536e84750 con 0x561536bc91b0 2024-08-31T05:43:23.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.923+0000 7f2754a09740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561536fb6ae0 con 0x561536bd1390 2024-08-31T05:43:23.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.923+0000 7f2754a09740 10 client.0 _ll_register_callbacks cb 0x561536eb3e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:43:23.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.923+0000 7f274ca31640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561536bf2070 0x561536fbfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:23.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.923+0000 7f274ca31640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561536bf2070 0x561536fbfe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35862/0 (socket says 172.21.15.5:35862) 2024-08-31T05:43:23.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.923+0000 7f274ca31640 1 -- 172.21.15.5:0/2320478945 learned_addr learned my addr 172.21.15.5:0/2320478945 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:23.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.924+0000 7f274ca31640 1 -- 172.21.15.5:0/2320478945 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561536bd1390 msgr2=0x561536fa2fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T05:43:23.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.924+0000 7f274ca31640 1 --2- 172.21.15.5:0/2320478945 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561536bd1390 0x561536fa2fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:23.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.924+0000 7f274ca31640 1 -- 172.21.15.5:0/2320478945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561536bc91b0 msgr2=0x561536fa2a80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T05:43:23.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.924+0000 7f274ca31640 1 --2- 172.21.15.5:0/2320478945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561536bc91b0 0x561536fa2a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:23.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.924+0000 7f274ca31640 1 -- 172.21.15.5:0/2320478945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561536ebd900 con 0x561536bf2070 2024-08-31T05:43:23.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.924+0000 7f274ca31640 1 --2- 172.21.15.5:0/2320478945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561536bf2070 0x561536fbfe60 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f274000f730 tx=0x7f2740004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7d472c99a29b89f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:23.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.924+0000 7f27277fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:43:23.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.924+0000 7f27277fe640 1 -- 172.21.15.5:0/2320478945 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2740003c40 con 0x561536bf2070 2024-08-31T05:43:23.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.925+0000 7f27277fe640 1 -- 172.21.15.5:0/2320478945 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9511+0+0 (secure 0 0 0) 0x7f2740003de0 con 0x561536bf2070 2024-08-31T05:43:23.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.925+0000 7f2754a09740 1 -- 172.21.15.5:0/2320478945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27380054d0 con 0x561536bf2070 2024-08-31T05:43:23.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.926+0000 7f27277fe640 1 -- 172.21.15.5:0/2320478945 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f274001f6a0 con 0x561536bf2070 2024-08-31T05:43:23.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.926+0000 7f2754a09740 10 client.19113 fetch_fsmap learned FSMap version 36 2024-08-31T05:43:23.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.926+0000 7f2754a09740 1 -- 172.21.15.5:0/2320478945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x561536fa5790 con 0x561536bf2070 2024-08-31T05:43:23.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.927+0000 7f27277fe640 1 -- 172.21.15.5:0/2320478945 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27380054d0 con 0x561536bf2070 2024-08-31T05:43:23.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.927+0000 7f27277fe640 1 -- 172.21.15.5:0/2320478945 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 36) ==== 8386+0+0 (secure 0 0 0) 0x7f2740026020 con 0x561536bf2070 2024-08-31T05:43:23.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.927+0000 7f2754a09740 10 client.19113 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T05:43:23.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.927+0000 7f2754a09740 10 client.19113 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-31T05:43:23.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.927+0000 7f2754a09740 20 client.19113 populate_metadata read hostname 'smithi005' 2024-08-31T05:43:23.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.927+0000 7f2754a09740 1 --2- 172.21.15.5:0/2320478945 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x561536bb09f0 0x561536fa8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:23.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.927+0000 7f2754a09740 4 client.19113 mds_command: new command op to 24602 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:43:23.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.927+0000 7f2754a09740 1 -- 172.21.15.5:0/2320478945 --> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561536f105d0 con 0x561536bb09f0 2024-08-31T05:43:23.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.929+0000 7f2747fff640 1 --2- 172.21.15.5:0/2320478945 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x561536bb09f0 0x561536fa8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:23.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.929+0000 7f2747fff640 1 --2- 172.21.15.5:0/2320478945 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x561536bb09f0 0x561536fa8dd0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8f8d8cf2ee0d7609 server_cookie=3e9df8c96ff9ca46 in_seq=0 out_seq=0 2024-08-31T05:43:23.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.929+0000 7f27277fe640 10 client.19113 ms_handle_connect on v2:172.21.15.50:6836/428759669 2024-08-31T05:43:23.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.930+0000 7f27277fe640 1 -- 172.21.15.5:0/2320478945 <== mds.4 v2:172.21.15.50:6836/428759669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561536f105d0 con 0x561536bb09f0 2024-08-31T05:43:23.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.930+0000 7f27277fe640 10 client.19113 handle_command_reply: tid=0 2024-08-31T05:43:23.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.930+0000 7f2754a09740 1 client.19113 shutdown 2024-08-31T05:43:23.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.931+0000 7f2754a09740 1 -- 172.21.15.5:0/2320478945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561536bf2070 msgr2=0x561536fbfe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:23.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.931+0000 7f2754a09740 1 --2- 172.21.15.5:0/2320478945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561536bf2070 0x561536fbfe60 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f274000f730 tx=0x7f2740004ab0 comp rx=0 tx=0).stop 2024-08-31T05:43:23.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.931+0000 7f2754a09740 1 -- 172.21.15.5:0/2320478945 shutdown_connections 2024-08-31T05:43:23.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.931+0000 7f2754a09740 1 --2- 172.21.15.5:0/2320478945 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x561536bb09f0 0x561536fa8dd0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:23.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.931+0000 7f2754a09740 1 --2- 172.21.15.5:0/2320478945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561536bf2070 0x561536fbfe60 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:23.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.931+0000 7f2754a09740 1 --2- 172.21.15.5:0/2320478945 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561536bd1390 0x561536fa2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:23.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.931+0000 7f2754a09740 1 --2- 172.21.15.5:0/2320478945 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561536bc91b0 0x561536fa2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:23.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.931+0000 7f2754a09740 1 -- 172.21.15.5:0/2320478945 >> 172.21.15.5:0/2320478945 conn(0x561536be6460 msgr2=0x561536f9a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:23.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.931+0000 7f27277fe640 0 client.19113 ms_handle_reset on v2:172.21.15.50:6836/428759669 2024-08-31T05:43:23.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.932+0000 7f2754a09740 1 -- 172.21.15.5:0/2320478945 shutdown_connections 2024-08-31T05:43:23.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.932+0000 7f2754a09740 1 -- 172.21.15.5:0/2320478945 wait complete. 2024-08-31T05:43:23.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.933+0000 7f2754a09740 20 client.19113 trim_cache size 0 max 16384 2024-08-31T05:43:23.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.956+0000 7f2754a09740 1 Processor -- start 2024-08-31T05:43:23.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.956+0000 7f2754a09740 1 -- start start 2024-08-31T05:43:23.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.957+0000 7f2754a09740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561536bc91b0 0x561536f9e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:23.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.957+0000 7f2754a09740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561536bd1390 0x561536fa4960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:23.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.957+0000 7f2754a09740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561536bf2070 0x561536f98a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:23.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.957+0000 7f2754a09740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2734032130 con 0x561536bf2070 2024-08-31T05:43:23.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.957+0000 7f2754a09740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2734033d30 con 0x561536bd1390 2024-08-31T05:43:23.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.957+0000 7f2754a09740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2734032800 con 0x561536bc91b0 2024-08-31T05:43:23.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.957+0000 7f2747fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561536bc91b0 0x561536f9e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:23.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.957+0000 7f2747fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561536bc91b0 0x561536f9e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:57256/0 (socket says 172.21.15.5:57256) 2024-08-31T05:43:23.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.957+0000 7f2747fff640 1 -- 172.21.15.5:0/2167340151 learned_addr learned my addr 172.21.15.5:0/2167340151 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:23.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.957+0000 7f27477fe640 1 --2- 172.21.15.5:0/2167340151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561536bd1390 0x561536fa4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:23.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.957+0000 7f274ca31640 1 --2- 172.21.15.5:0/2167340151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561536bf2070 0x561536f98a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:23.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.957+0000 7f27477fe640 1 -- 172.21.15.5:0/2167340151 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561536bc91b0 msgr2=0x561536f9e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:23.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.957+0000 7f27477fe640 1 --2- 172.21.15.5:0/2167340151 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561536bc91b0 0x561536f9e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:23.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.957+0000 7f27477fe640 1 -- 172.21.15.5:0/2167340151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561536bf2070 msgr2=0x561536f98a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:23.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.957+0000 7f27477fe640 1 --2- 172.21.15.5:0/2167340151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561536bf2070 0x561536f98a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:23.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.957+0000 7f27477fe640 1 -- 172.21.15.5:0/2167340151 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561536f99640 con 0x561536bd1390 2024-08-31T05:43:23.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.957+0000 7f274ca31640 1 --2- 172.21.15.5:0/2167340151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561536bf2070 0x561536f98a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:43:23.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.958+0000 7f2747fff640 1 --2- 172.21.15.5:0/2167340151 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561536bc91b0 0x561536f9e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:43:23.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.958+0000 7f27477fe640 1 --2- 172.21.15.5:0/2167340151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561536bd1390 0x561536fa4960 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f273c0e2eb0 tx=0x7f273c0ab5c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87936ecc2252c194 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:23.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.958+0000 7f272dffb640 1 -- 172.21.15.5:0/2167340151 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f273c0abe50 con 0x561536bd1390 2024-08-31T05:43:23.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.958+0000 7f272dffb640 1 -- 172.21.15.5:0/2167340151 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f273c0ae020 con 0x561536bd1390 2024-08-31T05:43:23.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.958+0000 7f272dffb640 1 -- 172.21.15.5:0/2167340151 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f273c0930b0 con 0x561536bd1390 2024-08-31T05:43:23.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.959+0000 7f2754a09740 1 -- 172.21.15.5:0/2167340151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561536bd1390 msgr2=0x561536fa4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:23.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.959+0000 7f2754a09740 1 --2- 172.21.15.5:0/2167340151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561536bd1390 0x561536fa4960 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f273c0e2eb0 tx=0x7f273c0ab5c0 comp rx=0 tx=0).stop 2024-08-31T05:43:23.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.959+0000 7f2754a09740 1 -- 172.21.15.5:0/2167340151 shutdown_connections 2024-08-31T05:43:23.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.959+0000 7f2754a09740 1 --2- 172.21.15.5:0/2167340151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561536bf2070 0x561536f98a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:23.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.959+0000 7f2754a09740 1 --2- 172.21.15.5:0/2167340151 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561536bd1390 0x561536fa4960 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:23.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.959+0000 7f2754a09740 1 --2- 172.21.15.5:0/2167340151 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561536bc91b0 0x561536f9e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:23.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.959+0000 7f2754a09740 1 -- 172.21.15.5:0/2167340151 >> 172.21.15.5:0/2167340151 conn(0x561536be6460 msgr2=0x561536f98380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:23.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.959+0000 7f2754a09740 1 -- 172.21.15.5:0/2167340151 shutdown_connections 2024-08-31T05:43:23.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.959+0000 7f2754a09740 1 -- 172.21.15.5:0/2167340151 wait complete. 2024-08-31T05:43:23.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.960+0000 7f2754a09740 1 -- start start 2024-08-31T05:43:23.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.960+0000 7f2754a09740 1 Processor -- start 2024-08-31T05:43:23.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.960+0000 7f2754a09740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561536bc91b0 0x561536fbc440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:23.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.960+0000 7f2754a09740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561536bd1390 0x561536fb6d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:23.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.961+0000 7f2754a09740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561536bf2070 0x561536fb72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:23.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.961+0000 7f2754a09740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2734033660 con 0x561536bf2070 2024-08-31T05:43:23.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.961+0000 7f2754a09740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f2734032f90 con 0x561536bd1390 2024-08-31T05:43:23.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.961+0000 7f2754a09740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2734030130 con 0x561536bc91b0 2024-08-31T05:43:23.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.961+0000 7f2747fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561536bc91b0 0x561536fbc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:23.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.961+0000 7f2747fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561536bc91b0 0x561536fbc440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:57262/0 (socket says 172.21.15.5:57262) 2024-08-31T05:43:23.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.961+0000 7f2747fff640 1 -- 172.21.15.5:0/3894138857 learned_addr learned my addr 172.21.15.5:0/3894138857 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:23.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.961+0000 7f2754a09740 10 client.0 _ll_register_callbacks cb 0x7f2740009c40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:43:23.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.961+0000 7f27477fe640 1 --2- 172.21.15.5:0/3894138857 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561536bd1390 0x561536fb6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:23.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.961+0000 7f274ca31640 1 --2- 172.21.15.5:0/3894138857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561536bf2070 0x561536fb72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:23.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.961+0000 7f2747fff640 1 -- 172.21.15.5:0/3894138857 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561536bd1390 msgr2=0x561536fb6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:23.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.961+0000 7f2747fff640 1 --2- 172.21.15.5:0/3894138857 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561536bd1390 0x561536fb6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:23.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.961+0000 7f2747fff640 1 -- 172.21.15.5:0/3894138857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561536bf2070 msgr2=0x561536fb72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:23.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.961+0000 7f2747fff640 1 --2- 172.21.15.5:0/3894138857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561536bf2070 0x561536fb72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:23.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.961+0000 7f2747fff640 1 -- 172.21.15.5:0/3894138857 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561536fb7900 con 0x561536bc91b0 2024-08-31T05:43:23.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.962+0000 7f2747fff640 1 --2- 172.21.15.5:0/3894138857 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561536bc91b0 0x561536fbc440 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2738005ab0 tx=0x7f2738005df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd6c7c6de50ba500 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:23.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.962+0000 7f27277fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:43:23.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.968+0000 7f27277fe640 1 -- 172.21.15.5:0/3894138857 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2738035040 con 0x561536bc91b0 2024-08-31T05:43:23.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.968+0000 7f27277fe640 1 -- 172.21.15.5:0/3894138857 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9511+0+0 (secure 0 0 0) 0x7f27380047a0 con 0x561536bc91b0 2024-08-31T05:43:23.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.968+0000 7f2754a09740 1 -- 172.21.15.5:0/3894138857 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f273c0ae020 con 0x561536bc91b0 2024-08-31T05:43:23.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.977+0000 7f27277fe640 1 -- 172.21.15.5:0/3894138857 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f2738040040 con 0x561536bc91b0 2024-08-31T05:43:23.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.977+0000 7f2754a09740 10 client.28696 fetch_fsmap learned FSMap version 36 2024-08-31T05:43:23.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.977+0000 7f2754a09740 1 -- 172.21.15.5:0/3894138857 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x56153701f810 con 0x561536bc91b0 2024-08-31T05:43:23.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.977+0000 7f27277fe640 1 -- 172.21.15.5:0/3894138857 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27380049a0 con 0x561536bc91b0 2024-08-31T05:43:23.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.978+0000 7f27277fe640 1 -- 172.21.15.5:0/3894138857 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 36) ==== 8386+0+0 (secure 0 0 0) 0x7f273805d030 con 0x561536bc91b0 2024-08-31T05:43:23.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.978+0000 7f2754a09740 10 client.28696 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T05:43:23.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.978+0000 7f2754a09740 10 client.28696 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-31T05:43:23.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.978+0000 7f2754a09740 20 client.28696 populate_metadata read hostname 'smithi005' 2024-08-31T05:43:23.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.978+0000 7f2754a09740 1 --2- 172.21.15.5:0/3894138857 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x561536b85da0 0x561537021bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:23.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.978+0000 7f2754a09740 4 client.28696 mds_command: new command op to 24602 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:43:23.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.978+0000 7f2754a09740 1 -- 172.21.15.5:0/3894138857 --> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f273c0ae020 con 0x561536b85da0 2024-08-31T05:43:23.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.978+0000 7f27477fe640 1 --2- 172.21.15.5:0/3894138857 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x561536b85da0 0x561537021bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:23.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.979+0000 7f27477fe640 1 --2- 172.21.15.5:0/3894138857 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x561536b85da0 0x561537021bb0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=453a5ce1606749a5 server_cookie=ef21c69f686ad008 in_seq=0 out_seq=0 2024-08-31T05:43:23.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.979+0000 7f27277fe640 10 client.28696 ms_handle_connect on v2:172.21.15.50:6836/428759669 2024-08-31T05:43:23.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.979+0000 7f27277fe640 1 -- 172.21.15.5:0/3894138857 <== mds.4 v2:172.21.15.50:6836/428759669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f273c0ae020 con 0x561536b85da0 2024-08-31T05:43:23.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.979+0000 7f27277fe640 10 client.28696 handle_command_reply: tid=0 2024-08-31T05:43:23.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.979+0000 7f2754a09740 1 client.28696 shutdown 2024-08-31T05:43:23.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.980+0000 7f2754a09740 1 -- 172.21.15.5:0/3894138857 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561536bc91b0 msgr2=0x561536fbc440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:23.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.980+0000 7f2754a09740 1 --2- 172.21.15.5:0/3894138857 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561536bc91b0 0x561536fbc440 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2738005ab0 tx=0x7f2738005df0 comp rx=0 tx=0).stop 2024-08-31T05:43:23.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.980+0000 7f2754a09740 1 -- 172.21.15.5:0/3894138857 shutdown_connections 2024-08-31T05:43:23.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.980+0000 7f2754a09740 1 --2- 172.21.15.5:0/3894138857 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x561536b85da0 0x561537021bb0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:23.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.980+0000 7f27277fe640 0 client.28696 ms_handle_reset on v2:172.21.15.50:6836/428759669 2024-08-31T05:43:23.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.980+0000 7f2754a09740 1 --2- 172.21.15.5:0/3894138857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561536bf2070 0x561536fb72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:23.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.980+0000 7f2754a09740 1 --2- 172.21.15.5:0/3894138857 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561536bd1390 0x561536fb6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:23.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.980+0000 7f2754a09740 1 --2- 172.21.15.5:0/3894138857 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561536bc91b0 0x561536fbc440 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:23.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.980+0000 7f2754a09740 1 -- 172.21.15.5:0/3894138857 >> 172.21.15.5:0/3894138857 conn(0x561536be6460 msgr2=0x561536f98d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:23.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.981+0000 7f2754a09740 1 -- 172.21.15.5:0/3894138857 shutdown_connections 2024-08-31T05:43:23.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.981+0000 7f2754a09740 1 -- 172.21.15.5:0/3894138857 wait complete. 2024-08-31T05:43:23.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.981+0000 7f2754a09740 20 client.28696 trim_cache size 0 max 16384 2024-08-31T05:43:23.985 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:43:23.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.982+0000 7f274e494640 1 -- 172.21.15.5:0/759887143 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f27300b4d90 msgr2=0x7f27300b72a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:23.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.982+0000 7f274e494640 1 --2- 172.21.15.5:0/759887143 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f27300b4d90 0x7f27300b72a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f27400116b0 tx=0x7f2740009500 comp rx=0 tx=0).stop 2024-08-31T05:43:23.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.982+0000 7f274e494640 1 -- 172.21.15.5:0/759887143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2748075ea0 msgr2=0x7f274810eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:23.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.982+0000 7f274e494640 1 --2- 172.21.15.5:0/759887143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2748075ea0 0x7f274810eb00 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f273c00e9c0 tx=0x7f273c00ee80 comp rx=0 tx=0).stop 2024-08-31T05:43:23.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.982+0000 7f274e494640 1 -- 172.21.15.5:0/759887143 shutdown_connections 2024-08-31T05:43:23.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.982+0000 7f274e494640 1 --2- 172.21.15.5:0/759887143 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f27300b4d90 0x7f27300b72a0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:23.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.982+0000 7f274e494640 1 --2- 172.21.15.5:0/759887143 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f274810fe90 0x7f27481ac120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:23.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.982+0000 7f274e494640 1 --2- 172.21.15.5:0/759887143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2748075ea0 0x7f274810eb00 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:23.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.982+0000 7f274e494640 1 --2- 172.21.15.5:0/759887143 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2748075550 0x7f274810e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:23.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.982+0000 7f274e494640 1 -- 172.21.15.5:0/759887143 >> 172.21.15.5:0/759887143 conn(0x7f27480ff380 msgr2=0x7f2748106c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:23.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.982+0000 7f274e494640 1 -- 172.21.15.5:0/759887143 shutdown_connections 2024-08-31T05:43:23.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:23.983+0000 7f274e494640 1 -- 172.21.15.5:0/759887143 wait complete. 2024-08-31T05:43:24.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:23 smithi005 ceph-mon[18602]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T05:43:24.267 INFO:tasks.workunit.client.0.smithi005.stdout: 10 4176 36.98 MB/sec warmup 11 sec latency 175.274 ms 2024-08-31T05:43:24.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:23 smithi070 ceph-mon[22316]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T05:43:24.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:23 smithi050 ceph-mon[22146]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-31T05:43:24.747 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-31T05:43:25.037 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:43:25.267 INFO:tasks.workunit.client.0.smithi005.stdout: 10 4433 34.48 MB/sec warmup 12 sec latency 292.175 ms 2024-08-31T05:43:25.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:24 smithi070 ceph-mon[22316]: pgmap v762: 129 pgs: 129 active+clean; 740 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 19 MiB/s wr, 345 op/s 2024-08-31T05:43:25.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:24 smithi050 ceph-mon[22146]: pgmap v762: 129 pgs: 129 active+clean; 740 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 19 MiB/s wr, 345 op/s 2024-08-31T05:43:25.423 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:24 smithi005 ceph-mon[18602]: pgmap v762: 129 pgs: 129 active+clean; 740 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 19 MiB/s wr, 345 op/s 2024-08-31T05:43:25.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.653+0000 7f6eba2c4640 1 -- 172.21.15.5:0/1373251149 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6eb410dbd0 msgr2=0x7f6eb41100c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:25.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.653+0000 7f6eba2c4640 1 --2- 172.21.15.5:0/1373251149 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6eb410dbd0 0x7f6eb41100c0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f6eac009ca0 tx=0x7f6eac02a8c0 comp rx=0 tx=0).stop 2024-08-31T05:43:25.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.653+0000 7f6eba2c4640 1 -- 172.21.15.5:0/1373251149 shutdown_connections 2024-08-31T05:43:25.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.653+0000 7f6eba2c4640 1 --2- 172.21.15.5:0/1373251149 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6eb410dbd0 0x7f6eb41100c0 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:25.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.653+0000 7f6eba2c4640 1 --2- 172.21.15.5:0/1373251149 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6eb41050c0 0x7f6eb410d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:25.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.653+0000 7f6eba2c4640 1 --2- 172.21.15.5:0/1373251149 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6eb4104770 0x7f6eb4104b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:25.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.653+0000 7f6eba2c4640 1 -- 172.21.15.5:0/1373251149 >> 172.21.15.5:0/1373251149 conn(0x7f6eb40794e0 msgr2=0x7f6eb40798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:25.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.653+0000 7f6eba2c4640 1 -- 172.21.15.5:0/1373251149 shutdown_connections 2024-08-31T05:43:25.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.653+0000 7f6eba2c4640 1 -- 172.21.15.5:0/1373251149 wait complete. 2024-08-31T05:43:25.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.654+0000 7f6eba2c4640 1 Processor -- start 2024-08-31T05:43:25.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.654+0000 7f6eba2c4640 1 -- start start 2024-08-31T05:43:25.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.655+0000 7f6eba2c4640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6eb4104770 0x7f6eb419a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:25.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.655+0000 7f6eba2c4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6eb41050c0 0x7f6eb419a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:25.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.655+0000 7f6eba2c4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6eb410dbd0 0x7f6eb419fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:25.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.655+0000 7f6eba2c4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb41138d0 con 0x7f6eb410dbd0 2024-08-31T05:43:25.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.655+0000 7f6eba2c4640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb4113750 con 0x7f6eb4104770 2024-08-31T05:43:25.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.655+0000 7f6eba2c4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb4113a50 con 0x7f6eb41050c0 2024-08-31T05:43:25.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.655+0000 7f6eb3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6eb4104770 0x7f6eb419a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:25.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.655+0000 7f6eb3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6eb4104770 0x7f6eb419a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:51610/0 (socket says 172.21.15.5:51610) 2024-08-31T05:43:25.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.655+0000 7f6eb3fff640 1 -- 172.21.15.5:0/2287880888 learned_addr learned my addr 172.21.15.5:0/2287880888 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:25.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.655+0000 7f6eb37fe640 1 --2- 172.21.15.5:0/2287880888 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6eb41050c0 0x7f6eb419a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:25.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.655+0000 7f6eb8861640 1 --2- 172.21.15.5:0/2287880888 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6eb410dbd0 0x7f6eb419fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:25.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.655+0000 7f6eb3fff640 1 -- 172.21.15.5:0/2287880888 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6eb41050c0 msgr2=0x7f6eb419a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:25.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.655+0000 7f6eb3fff640 1 --2- 172.21.15.5:0/2287880888 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6eb41050c0 0x7f6eb419a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:25.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.655+0000 7f6eb3fff640 1 -- 172.21.15.5:0/2287880888 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6eb410dbd0 msgr2=0x7f6eb419fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:25.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.655+0000 7f6eb3fff640 1 --2- 172.21.15.5:0/2287880888 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6eb410dbd0 0x7f6eb419fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:25.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.655+0000 7f6eb3fff640 1 -- 172.21.15.5:0/2287880888 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6eb41a0290 con 0x7f6eb4104770 2024-08-31T05:43:25.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.655+0000 7f6eb3fff640 1 --2- 172.21.15.5:0/2287880888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6eb4104770 0x7f6eb419a320 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6ea400b450 tx=0x7f6ea400b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:25.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.656+0000 7f6eb17fa640 1 -- 172.21.15.5:0/2287880888 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea4015020 con 0x7f6eb4104770 2024-08-31T05:43:25.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.656+0000 7f6eb17fa640 1 -- 172.21.15.5:0/2287880888 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ea4011d40 con 0x7f6eb4104770 2024-08-31T05:43:25.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.656+0000 7f6eba2c4640 1 -- 172.21.15.5:0/2287880888 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6eb41a0580 con 0x7f6eb4104770 2024-08-31T05:43:25.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.656+0000 7f6eb17fa640 1 -- 172.21.15.5:0/2287880888 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea400f340 con 0x7f6eb4104770 2024-08-31T05:43:25.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.656+0000 7f6eba2c4640 1 -- 172.21.15.5:0/2287880888 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6eb41a6ce0 con 0x7f6eb4104770 2024-08-31T05:43:25.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.658+0000 7f6eb17fa640 1 -- 172.21.15.5:0/2287880888 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f6ea4018020 con 0x7f6eb4104770 2024-08-31T05:43:25.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.658+0000 7f6ec0839740 1 Processor -- start 2024-08-31T05:43:25.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.658+0000 7f6ec0839740 1 -- start start 2024-08-31T05:43:25.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.659+0000 7f6ec0839740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562e0bdac070 0x562e0c151310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:25.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.659+0000 7f6ec0839740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562e0bd831b0 0x562e0c151850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:25.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.659+0000 7f6ec0839740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e0bd8b390 0x562e0c151d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:25.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.659+0000 7f6ec0839740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x562e0c0c8680 con 0x562e0bd831b0 2024-08-31T05:43:25.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.659+0000 7f6ec0839740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562e0c0b7c10 con 0x562e0bdac070 2024-08-31T05:43:25.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.659+0000 7f6ec0839740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562e0c0bbbc0 con 0x562e0bd8b390 2024-08-31T05:43:25.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.659+0000 7f6eb3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562e0bd831b0 0x562e0c151850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:25.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.659+0000 7f6eb8861640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562e0bdac070 0x562e0c151310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:25.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.659+0000 7f6eb8861640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562e0bdac070 0x562e0c151310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:51614/0 (socket says 172.21.15.5:51614) 2024-08-31T05:43:25.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.659+0000 7f6eb8861640 1 -- 172.21.15.5:0/3650394239 learned_addr learned my addr 172.21.15.5:0/3650394239 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:25.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.659+0000 7f6eb37fe640 1 --2- 172.21.15.5:0/3650394239 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e0bd8b390 0x562e0c151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:25.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.659+0000 7f6eb8861640 1 -- 172.21.15.5:0/3650394239 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e0bd8b390 msgr2=0x562e0c151d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:25.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.659+0000 7f6eb8861640 1 --2- 172.21.15.5:0/3650394239 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e0bd8b390 0x562e0c151d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:25.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.659+0000 7f6eb8861640 1 -- 172.21.15.5:0/3650394239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562e0bd831b0 msgr2=0x562e0c151850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:25.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.659+0000 7f6eb8861640 1 --2- 172.21.15.5:0/3650394239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562e0bd831b0 0x562e0c151850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:25.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.659+0000 7f6eb8861640 1 -- 172.21.15.5:0/3650394239 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e0be17650 con 0x562e0bdac070 2024-08-31T05:43:25.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.660+0000 7f6eb17fa640 1 --2- 172.21.15.5:0/2287880888 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f6e9c0b4ca0 0x7f6e9c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:25.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.660+0000 7f6eb8861640 1 --2- 172.21.15.5:0/3650394239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562e0bdac070 0x562e0c151310 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6eac0098b0 tx=0x7f6eac0098e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d5023db5b8505da server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:25.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.660+0000 7f6eb3fff640 1 --2- 172.21.15.5:0/2287880888 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f6e9c0b4ca0 0x7f6e9c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:25.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.660+0000 7f6e9a7fc640 1 -- 172.21.15.5:0/3650394239 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eac031e30 con 0x562e0bdac070 2024-08-31T05:43:25.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.660+0000 7f6e9a7fc640 1 -- 172.21.15.5:0/3650394239 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6eac036030 con 0x562e0bdac070 2024-08-31T05:43:25.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.660+0000 7f6e9a7fc640 1 -- 172.21.15.5:0/3650394239 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eac004370 con 0x562e0bdac070 2024-08-31T05:43:25.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.660+0000 7f6eb17fa640 1 -- 172.21.15.5:0/2287880888 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9511+0+0 (secure 0 0 0) 0x7f6ea40e52e0 con 0x7f6eb4104770 2024-08-31T05:43:25.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.661+0000 7f6ec0839740 1 -- 172.21.15.5:0/3650394239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562e0bdac070 msgr2=0x562e0c151310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:25.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.661+0000 7f6ec0839740 1 --2- 172.21.15.5:0/3650394239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562e0bdac070 0x562e0c151310 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6eac0098b0 tx=0x7f6eac0098e0 comp rx=0 tx=0).stop 2024-08-31T05:43:25.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.661+0000 7f6eb3fff640 1 --2- 172.21.15.5:0/2287880888 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f6e9c0b4ca0 0x7f6e9c0b71b0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x562e0c14ff90 tx=0x7f6ea40e8d90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:25.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.661+0000 7f6ec0839740 1 -- 172.21.15.5:0/3650394239 shutdown_connections 2024-08-31T05:43:25.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.661+0000 7f6ec0839740 1 --2- 172.21.15.5:0/3650394239 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e0bd8b390 0x562e0c151d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:25.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.661+0000 7f6ec0839740 1 --2- 172.21.15.5:0/3650394239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562e0bd831b0 0x562e0c151850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:25.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.661+0000 7f6ec0839740 1 --2- 172.21.15.5:0/3650394239 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562e0bdac070 0x562e0c151310 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:25.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.661+0000 7f6ec0839740 1 -- 172.21.15.5:0/3650394239 >> 172.21.15.5:0/3650394239 conn(0x562e0bda0460 msgr2=0x562e0c14f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:25.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.661+0000 7f6ec0839740 1 -- 172.21.15.5:0/3650394239 shutdown_connections 2024-08-31T05:43:25.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.661+0000 7f6ec0839740 1 -- 172.21.15.5:0/3650394239 wait complete. 2024-08-31T05:43:25.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.662+0000 7f6ec0839740 1 -- start start 2024-08-31T05:43:25.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.662+0000 7f6ec0839740 1 Processor -- start 2024-08-31T05:43:25.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.662+0000 7f6ec0839740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562e0bd831b0 0x562e0c15ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:25.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.662+0000 7f6ec0839740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562e0bd8b390 0x562e0c15cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:25.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.662+0000 7f6ec0839740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e0bdac070 0x562e0c16d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:25.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.662+0000 7f6ec0839740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x562e0bf1a700 con 0x562e0bd831b0 2024-08-31T05:43:25.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.662+0000 7f6ec0839740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562e0c03e750 con 0x562e0bd8b390 2024-08-31T05:43:25.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.662+0000 7f6ec0839740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562e0c163d20 con 0x562e0bdac070 2024-08-31T05:43:25.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.662+0000 7f6ec0839740 10 client.0 _ll_register_callbacks cb 0x562e0c06de10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:43:25.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.662+0000 7f6eb8861640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562e0bd831b0 0x562e0c15ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:25.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.662+0000 7f6eb8861640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562e0bd831b0 0x562e0c15ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35910/0 (socket says 172.21.15.5:35910) 2024-08-31T05:43:25.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.662+0000 7f6eb8861640 1 -- 172.21.15.5:0/3885336663 learned_addr learned my addr 172.21.15.5:0/3885336663 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:25.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.662+0000 7f6eb37fe640 1 --2- 172.21.15.5:0/3885336663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562e0bd8b390 0x562e0c15cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:25.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.663+0000 7f6eb8861640 1 --2- 172.21.15.5:0/3885336663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e0bdac070 0x562e0c16d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:25.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.663+0000 7f6eb8861640 1 -- 172.21.15.5:0/3885336663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e0bdac070 msgr2=0x562e0c16d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:25.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.663+0000 7f6eb8861640 1 --2- 172.21.15.5:0/3885336663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e0bdac070 0x562e0c16d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:25.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.663+0000 7f6eb8861640 1 -- 172.21.15.5:0/3885336663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562e0bd8b390 msgr2=0x562e0c15cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:25.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.663+0000 7f6eb8861640 1 --2- 172.21.15.5:0/3885336663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562e0bd8b390 0x562e0c15cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:25.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.663+0000 7f6eb8861640 1 -- 172.21.15.5:0/3885336663 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e0c077900 con 0x562e0bd831b0 2024-08-31T05:43:25.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.663+0000 7f6eb8861640 1 --2- 172.21.15.5:0/3885336663 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562e0bd831b0 0x562e0c15ca80 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f6eac02ade0 tx=0x7f6eac0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7454fc511de3ad6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:25.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.663+0000 7f6e937fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:43:25.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.663+0000 7f6e937fe640 1 -- 172.21.15.5:0/3885336663 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eac058060 con 0x562e0bd831b0 2024-08-31T05:43:25.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.663+0000 7f6ec0839740 1 -- 172.21.15.5:0/3885336663 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6eac036030 con 0x562e0bd831b0 2024-08-31T05:43:25.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.663+0000 7f6e937fe640 1 -- 172.21.15.5:0/3885336663 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9511+0+0 (secure 0 0 0) 0x7f6eac031860 con 0x562e0bd831b0 2024-08-31T05:43:25.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.663+0000 7f6e937fe640 1 -- 172.21.15.5:0/3885336663 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f6eac05f050 con 0x562e0bd831b0 2024-08-31T05:43:25.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.663+0000 7f6ec0839740 10 client.19131 fetch_fsmap learned FSMap version 36 2024-08-31T05:43:25.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.663+0000 7f6ec0839740 1 -- 172.21.15.5:0/3885336663 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x562e0c16fa90 con 0x562e0bd831b0 2024-08-31T05:43:25.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.664+0000 7f6e937fe640 1 -- 172.21.15.5:0/3885336663 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6eac036030 con 0x562e0bd831b0 2024-08-31T05:43:25.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.664+0000 7f6e937fe640 1 -- 172.21.15.5:0/3885336663 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 36) ==== 8386+0+0 (secure 0 0 0) 0x7f6eac043070 con 0x562e0bd831b0 2024-08-31T05:43:25.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.664+0000 7f6ec0839740 10 client.19131 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T05:43:25.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.664+0000 7f6ec0839740 10 client.19131 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-31T05:43:25.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.664+0000 7f6ec0839740 20 client.19131 populate_metadata read hostname 'smithi005' 2024-08-31T05:43:25.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.664+0000 7f6ec0839740 1 --2- 172.21.15.5:0/3885336663 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x562e0bd6a9f0 0x562e0c172df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:25.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.664+0000 7f6ec0839740 4 client.19131 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:43:25.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.664+0000 7f6ec0839740 1 -- 172.21.15.5:0/3885336663 --> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562e0c0ca5d0 con 0x562e0bd6a9f0 2024-08-31T05:43:25.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.664+0000 7f6eb37fe640 1 --2- 172.21.15.5:0/3885336663 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x562e0bd6a9f0 0x562e0c172df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:25.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.665+0000 7f6eb37fe640 1 --2- 172.21.15.5:0/3885336663 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x562e0bd6a9f0 0x562e0c172df0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4d1f7711e507f6e9 server_cookie=4766b86f34136cec in_seq=0 out_seq=0 2024-08-31T05:43:25.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.665+0000 7f6e937fe640 10 client.19131 ms_handle_connect on v2:172.21.15.70:6834/2061504114 2024-08-31T05:43:25.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.666+0000 7f6e937fe640 1 -- 172.21.15.5:0/3885336663 <== mds.3 v2:172.21.15.70:6834/2061504114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562e0c0ca5d0 con 0x562e0bd6a9f0 2024-08-31T05:43:25.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.666+0000 7f6e937fe640 10 client.19131 handle_command_reply: tid=0 2024-08-31T05:43:25.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.666+0000 7f6ec0839740 1 client.19131 shutdown 2024-08-31T05:43:25.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.666+0000 7f6ec0839740 1 -- 172.21.15.5:0/3885336663 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562e0bd831b0 msgr2=0x562e0c15ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:25.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.666+0000 7f6ec0839740 1 --2- 172.21.15.5:0/3885336663 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562e0bd831b0 0x562e0c15ca80 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f6eac02ade0 tx=0x7f6eac0095c0 comp rx=0 tx=0).stop 2024-08-31T05:43:25.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.666+0000 7f6ec0839740 1 -- 172.21.15.5:0/3885336663 shutdown_connections 2024-08-31T05:43:25.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.666+0000 7f6ec0839740 1 --2- 172.21.15.5:0/3885336663 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x562e0bd6a9f0 0x562e0c172df0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:25.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.666+0000 7f6ec0839740 1 --2- 172.21.15.5:0/3885336663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e0bdac070 0x562e0c16d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:25.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.666+0000 7f6ec0839740 1 --2- 172.21.15.5:0/3885336663 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562e0bd8b390 0x562e0c15cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:25.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.666+0000 7f6ec0839740 1 --2- 172.21.15.5:0/3885336663 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562e0bd831b0 0x562e0c15ca80 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:25.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.667+0000 7f6ec0839740 1 -- 172.21.15.5:0/3885336663 >> 172.21.15.5:0/3885336663 conn(0x562e0bda0460 msgr2=0x562e0c1544f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:25.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.666+0000 7f6e937fe640 0 client.19131 ms_handle_reset on v2:172.21.15.70:6834/2061504114 2024-08-31T05:43:25.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.667+0000 7f6ec0839740 1 -- 172.21.15.5:0/3885336663 shutdown_connections 2024-08-31T05:43:25.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.667+0000 7f6ec0839740 1 -- 172.21.15.5:0/3885336663 wait complete. 2024-08-31T05:43:25.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.667+0000 7f6ec0839740 20 client.19131 trim_cache size 0 max 16384 2024-08-31T05:43:25.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.683+0000 7f6ec0839740 1 Processor -- start 2024-08-31T05:43:25.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.683+0000 7f6ec0839740 1 -- start start 2024-08-31T05:43:25.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.683+0000 7f6ec0839740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562e0bd831b0 0x562e0c154b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:25.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.683+0000 7f6ec0839740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562e0bd8b390 0x562e0c159c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:25.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.683+0000 7f6ec0839740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e0bdac070 0x562e0c15a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:25.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.683+0000 7f6ec0839740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb41aeaf0 con 0x562e0bd8b390 2024-08-31T05:43:25.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.683+0000 7f6ec0839740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb41b06f0 con 0x562e0bd831b0 2024-08-31T05:43:25.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.683+0000 7f6ec0839740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb41af1c0 con 0x562e0bdac070 2024-08-31T05:43:25.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.683+0000 7f6eb37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562e0bd8b390 0x562e0c159c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:25.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.684+0000 7f6eb37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562e0bd8b390 0x562e0c159c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35922/0 (socket says 172.21.15.5:35922) 2024-08-31T05:43:25.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.684+0000 7f6eb37fe640 1 -- 172.21.15.5:0/1751217669 learned_addr learned my addr 172.21.15.5:0/1751217669 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:25.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.684+0000 7f6eb8861640 1 --2- 172.21.15.5:0/1751217669 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562e0bd831b0 0x562e0c154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:25.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.684+0000 7f6eb37fe640 1 -- 172.21.15.5:0/1751217669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e0bdac070 msgr2=0x562e0c15a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:25.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.684+0000 7f6eb37fe640 1 --2- 172.21.15.5:0/1751217669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e0bdac070 0x562e0c15a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:25.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.684+0000 7f6eb37fe640 1 -- 172.21.15.5:0/1751217669 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562e0bd831b0 msgr2=0x562e0c154b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:25.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.684+0000 7f6eb37fe640 1 --2- 172.21.15.5:0/1751217669 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562e0bd831b0 0x562e0c154b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:25.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.684+0000 7f6eb37fe640 1 -- 172.21.15.5:0/1751217669 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e0c155060 con 0x562e0bd8b390 2024-08-31T05:43:25.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.685+0000 7f6eb37fe640 1 --2- 172.21.15.5:0/1751217669 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562e0bd8b390 0x562e0c159c70 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f6ea8009dd0 tx=0x7f6ea8005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d75712f14de07baf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:25.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.685+0000 7f6e99ffb640 1 -- 172.21.15.5:0/1751217669 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea8005220 con 0x562e0bd8b390 2024-08-31T05:43:25.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.685+0000 7f6e99ffb640 1 -- 172.21.15.5:0/1751217669 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ea8004c50 con 0x562e0bd8b390 2024-08-31T05:43:25.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.685+0000 7f6e99ffb640 1 -- 172.21.15.5:0/1751217669 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea80248e0 con 0x562e0bd8b390 2024-08-31T05:43:25.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.686+0000 7f6ec0839740 1 -- 172.21.15.5:0/1751217669 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562e0bd8b390 msgr2=0x562e0c159c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:25.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.686+0000 7f6ec0839740 1 --2- 172.21.15.5:0/1751217669 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562e0bd8b390 0x562e0c159c70 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f6ea8009dd0 tx=0x7f6ea8005f90 comp rx=0 tx=0).stop 2024-08-31T05:43:25.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.686+0000 7f6ec0839740 1 -- 172.21.15.5:0/1751217669 shutdown_connections 2024-08-31T05:43:25.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.686+0000 7f6ec0839740 1 --2- 172.21.15.5:0/1751217669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e0bdac070 0x562e0c15a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:25.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.686+0000 7f6ec0839740 1 --2- 172.21.15.5:0/1751217669 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562e0bd8b390 0x562e0c159c70 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:25.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.686+0000 7f6ec0839740 1 --2- 172.21.15.5:0/1751217669 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562e0bd831b0 0x562e0c154b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:25.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.686+0000 7f6ec0839740 1 -- 172.21.15.5:0/1751217669 >> 172.21.15.5:0/1751217669 conn(0x562e0bda0460 msgr2=0x562e0c154410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:25.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.687+0000 7f6ec0839740 1 -- 172.21.15.5:0/1751217669 shutdown_connections 2024-08-31T05:43:25.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.687+0000 7f6ec0839740 1 -- 172.21.15.5:0/1751217669 wait complete. 2024-08-31T05:43:25.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.687+0000 7f6ec0839740 1 -- start start 2024-08-31T05:43:25.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.688+0000 7f6ec0839740 1 Processor -- start 2024-08-31T05:43:25.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.688+0000 7f6ec0839740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e0bd831b0 0x562e0c1655f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:25.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.688+0000 7f6ec0839740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562e0bd8b390 0x562e0c165b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:25.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.688+0000 7f6ec0839740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562e0bdac070 0x562e0c1dc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:25.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.688+0000 7f6ec0839740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb41b0020 con 0x562e0bd8b390 2024-08-31T05:43:25.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.688+0000 7f6ec0839740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb41af950 con 0x562e0bdac070 2024-08-31T05:43:25.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.688+0000 7f6ec0839740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb41acaf0 con 0x562e0bd831b0 2024-08-31T05:43:25.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.688+0000 7f6ec0839740 10 client.0 _ll_register_callbacks cb 0x7f6ea40e8c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:43:25.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.688+0000 7f6eb8861640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562e0bdac070 0x562e0c1dc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:25.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.688+0000 7f6eb8861640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562e0bdac070 0x562e0c1dc5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:51648/0 (socket says 172.21.15.5:51648) 2024-08-31T05:43:25.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.688+0000 7f6eb8861640 1 -- 172.21.15.5:0/3617007183 learned_addr learned my addr 172.21.15.5:0/3617007183 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:25.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.688+0000 7f6eb37fe640 1 --2- 172.21.15.5:0/3617007183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562e0bd8b390 0x562e0c165b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:25.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.688+0000 7f6eb8861640 1 --2- 172.21.15.5:0/3617007183 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e0bd831b0 0x562e0c1655f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:25.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.689+0000 7f6eb8861640 1 -- 172.21.15.5:0/3617007183 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e0bd831b0 msgr2=0x562e0c1655f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:25.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.689+0000 7f6eb8861640 1 --2- 172.21.15.5:0/3617007183 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e0bd831b0 0x562e0c1655f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:25.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.689+0000 7f6eb8861640 1 -- 172.21.15.5:0/3617007183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562e0bd8b390 msgr2=0x562e0c165b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:25.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.689+0000 7f6eb8861640 1 --2- 172.21.15.5:0/3617007183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562e0bd8b390 0x562e0c165b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:25.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.689+0000 7f6eb8861640 1 -- 172.21.15.5:0/3617007183 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e0c1dcb00 con 0x562e0bdac070 2024-08-31T05:43:25.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.689+0000 7f6eb8861640 1 --2- 172.21.15.5:0/3617007183 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562e0bdac070 0x562e0c1dc5c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6eac02f990 tx=0x7f6eac000f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14ad49da26e23de0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:25.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.689+0000 7f6e937fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:43:25.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.689+0000 7f6e937fe640 1 -- 172.21.15.5:0/3617007183 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eac058070 con 0x562e0bdac070 2024-08-31T05:43:25.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.689+0000 7f6e937fe640 1 -- 172.21.15.5:0/3617007183 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9511+0+0 (secure 0 0 0) 0x7f6eac009800 con 0x562e0bdac070 2024-08-31T05:43:25.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.689+0000 7f6ec0839740 1 -- 172.21.15.5:0/3617007183 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ea8004c50 con 0x562e0bdac070 2024-08-31T05:43:25.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.689+0000 7f6e937fe640 1 -- 172.21.15.5:0/3617007183 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f6eac003b80 con 0x562e0bdac070 2024-08-31T05:43:25.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.689+0000 7f6ec0839740 10 client.28703 fetch_fsmap learned FSMap version 36 2024-08-31T05:43:25.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.689+0000 7f6ec0839740 1 -- 172.21.15.5:0/3617007183 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x562e0c1ddce0 con 0x562e0bdac070 2024-08-31T05:43:25.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.690+0000 7f6e937fe640 1 -- 172.21.15.5:0/3617007183 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ea8004c50 con 0x562e0bdac070 2024-08-31T05:43:25.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.690+0000 7f6e937fe640 1 -- 172.21.15.5:0/3617007183 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 36) ==== 8386+0+0 (secure 0 0 0) 0x7f6eac043040 con 0x562e0bdac070 2024-08-31T05:43:25.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.690+0000 7f6ec0839740 10 client.28703 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T05:43:25.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.690+0000 7f6ec0839740 10 client.28703 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-31T05:43:25.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.690+0000 7f6ec0839740 20 client.28703 populate_metadata read hostname 'smithi005' 2024-08-31T05:43:25.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.690+0000 7f6ec0839740 1 --2- 172.21.15.5:0/3617007183 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x562e0bd3fda0 0x562e0c1e0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:25.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.690+0000 7f6ec0839740 4 client.28703 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:43:25.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.690+0000 7f6ec0839740 1 -- 172.21.15.5:0/3617007183 --> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562e0c0c6070 con 0x562e0bd3fda0 2024-08-31T05:43:25.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.690+0000 7f6eb37fe640 1 --2- 172.21.15.5:0/3617007183 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x562e0bd3fda0 0x562e0c1e0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:25.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.691+0000 7f6eb37fe640 1 --2- 172.21.15.5:0/3617007183 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x562e0bd3fda0 0x562e0c1e0390 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f91a4dd877741bbc server_cookie=38b8c363716522be in_seq=0 out_seq=0 2024-08-31T05:43:25.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.691+0000 7f6e937fe640 10 client.28703 ms_handle_connect on v2:172.21.15.70:6834/2061504114 2024-08-31T05:43:25.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.696+0000 7f6e937fe640 1 -- 172.21.15.5:0/3617007183 <== mds.3 v2:172.21.15.70:6834/2061504114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562e0c0c6070 con 0x562e0bd3fda0 2024-08-31T05:43:25.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.696+0000 7f6e937fe640 10 client.28703 handle_command_reply: tid=0 2024-08-31T05:43:25.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.696+0000 7f6ec0839740 1 client.28703 shutdown 2024-08-31T05:43:25.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.696+0000 7f6ec0839740 1 -- 172.21.15.5:0/3617007183 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562e0bdac070 msgr2=0x562e0c1dc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:25.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.696+0000 7f6ec0839740 1 --2- 172.21.15.5:0/3617007183 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562e0bdac070 0x562e0c1dc5c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6eac02f990 tx=0x7f6eac000f40 comp rx=0 tx=0).stop 2024-08-31T05:43:25.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.697+0000 7f6ec0839740 1 -- 172.21.15.5:0/3617007183 shutdown_connections 2024-08-31T05:43:25.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.697+0000 7f6ec0839740 1 --2- 172.21.15.5:0/3617007183 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x562e0bd3fda0 0x562e0c1e0390 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:25.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.697+0000 7f6ec0839740 1 --2- 172.21.15.5:0/3617007183 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562e0bdac070 0x562e0c1dc5c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:25.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.697+0000 7f6ec0839740 1 --2- 172.21.15.5:0/3617007183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562e0bd8b390 0x562e0c165b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:25.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.697+0000 7f6ec0839740 1 --2- 172.21.15.5:0/3617007183 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e0bd831b0 0x562e0c1655f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:25.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.697+0000 7f6ec0839740 1 -- 172.21.15.5:0/3617007183 >> 172.21.15.5:0/3617007183 conn(0x562e0bda0460 msgr2=0x562e0c15df30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:25.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.697+0000 7f6e937fe640 0 client.28703 ms_handle_reset on v2:172.21.15.70:6834/2061504114 2024-08-31T05:43:25.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.697+0000 7f6ec0839740 1 -- 172.21.15.5:0/3617007183 shutdown_connections 2024-08-31T05:43:25.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.697+0000 7f6ec0839740 1 -- 172.21.15.5:0/3617007183 wait complete. 2024-08-31T05:43:25.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.697+0000 7f6ec0839740 20 client.28703 trim_cache size 0 max 16384 2024-08-31T05:43:25.700 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:43:25.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.698+0000 7f6eba2c4640 1 -- 172.21.15.5:0/2287880888 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f6e9c0b4ca0 msgr2=0x7f6e9c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:25.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.698+0000 7f6eba2c4640 1 --2- 172.21.15.5:0/2287880888 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f6e9c0b4ca0 0x7f6e9c0b71b0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x562e0c14ff90 tx=0x7f6ea40e8d90 comp rx=0 tx=0).stop 2024-08-31T05:43:25.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.698+0000 7f6eba2c4640 1 -- 172.21.15.5:0/2287880888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6eb4104770 msgr2=0x7f6eb419a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:25.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.698+0000 7f6eba2c4640 1 --2- 172.21.15.5:0/2287880888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6eb4104770 0x7f6eb419a320 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6ea400b450 tx=0x7f6ea400b910 comp rx=0 tx=0).stop 2024-08-31T05:43:25.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.698+0000 7f6eba2c4640 1 -- 172.21.15.5:0/2287880888 shutdown_connections 2024-08-31T05:43:25.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.698+0000 7f6eba2c4640 1 --2- 172.21.15.5:0/2287880888 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f6e9c0b4ca0 0x7f6e9c0b71b0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:25.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.698+0000 7f6eba2c4640 1 --2- 172.21.15.5:0/2287880888 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6eb410dbd0 0x7f6eb419fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:25.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.698+0000 7f6eba2c4640 1 --2- 172.21.15.5:0/2287880888 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6eb41050c0 0x7f6eb419a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:25.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.698+0000 7f6eba2c4640 1 --2- 172.21.15.5:0/2287880888 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f6eb4104770 0x7f6eb419a320 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:25.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.698+0000 7f6eba2c4640 1 -- 172.21.15.5:0/2287880888 >> 172.21.15.5:0/2287880888 conn(0x7f6eb40794e0 msgr2=0x7f6eb40ff310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:25.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.698+0000 7f6eba2c4640 1 -- 172.21.15.5:0/2287880888 shutdown_connections 2024-08-31T05:43:25.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:25.698+0000 7f6eba2c4640 1 -- 172.21.15.5:0/2287880888 wait complete. 2024-08-31T05:43:26.267 INFO:tasks.workunit.client.0.smithi005.stdout: 10 4896 33.10 MB/sec warmup 13 sec latency 217.666 ms 2024-08-31T05:43:26.431 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T05:43:26.725 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:43:27.144 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:26 smithi005 ceph-mon[18602]: pgmap v763: 129 pgs: 129 active+clean; 755 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 20 MiB/s wr, 422 op/s 2024-08-31T05:43:27.267 INFO:tasks.workunit.client.0.smithi005.stdout: 10 5393 32.96 MB/sec warmup 14 sec latency 451.690 ms 2024-08-31T05:43:27.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.243+0000 7f0925c60640 1 -- 172.21.15.5:0/3938524779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0920109bc0 msgr2=0x7f09201103f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:27.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.243+0000 7f0925c60640 1 --2- 172.21.15.5:0/3938524779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0920109bc0 0x7f09201103f0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f0918009ca0 tx=0x7f091802a8c0 comp rx=0 tx=0).stop 2024-08-31T05:43:27.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.243+0000 7f0925c60640 1 -- 172.21.15.5:0/3938524779 shutdown_connections 2024-08-31T05:43:27.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.243+0000 7f0925c60640 1 --2- 172.21.15.5:0/3938524779 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0920109bc0 0x7f09201103f0 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:27.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.243+0000 7f0925c60640 1 --2- 172.21.15.5:0/3938524779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0920109270 0x7f0920109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:27.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.243+0000 7f0925c60640 1 --2- 172.21.15.5:0/3938524779 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0920103930 0x7f0920103d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:27.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.243+0000 7f0925c60640 1 -- 172.21.15.5:0/3938524779 >> 172.21.15.5:0/3938524779 conn(0x7f09200ff3a0 msgr2=0x7f09201017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:27.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.243+0000 7f0925c60640 1 -- 172.21.15.5:0/3938524779 shutdown_connections 2024-08-31T05:43:27.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.243+0000 7f0925c60640 1 -- 172.21.15.5:0/3938524779 wait complete. 2024-08-31T05:43:27.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.244+0000 7f0925c60640 1 Processor -- start 2024-08-31T05:43:27.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.244+0000 7f0925c60640 1 -- start start 2024-08-31T05:43:27.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.244+0000 7f0925c60640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0920103930 0x7f09200754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:27.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.244+0000 7f0925c60640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0920109270 0x7f09200759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:27.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.244+0000 7f0925c60640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0920109bc0 0x7f0920075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:27.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.244+0000 7f0925c60640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0920113880 con 0x7f0920103930 2024-08-31T05:43:27.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.244+0000 7f0925c60640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f0920113700 con 0x7f0920109270 2024-08-31T05:43:27.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.244+0000 7f0925c60640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0920113a00 con 0x7f0920109bc0 2024-08-31T05:43:27.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.244+0000 7f091f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0920103930 0x7f09200754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:27.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.244+0000 7f091f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0920103930 0x7f09200754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35944/0 (socket says 172.21.15.5:35944) 2024-08-31T05:43:27.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.244+0000 7f091effd640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0920109270 0x7f09200759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:27.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.244+0000 7f091f7fe640 1 -- 172.21.15.5:0/3423083499 learned_addr learned my addr 172.21.15.5:0/3423083499 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:27.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.244+0000 7f091ffff640 1 --2- 172.21.15.5:0/3423083499 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0920109bc0 0x7f0920075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:27.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.245+0000 7f091effd640 1 -- 172.21.15.5:0/3423083499 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0920109bc0 msgr2=0x7f0920075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:27.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.245+0000 7f091effd640 1 --2- 172.21.15.5:0/3423083499 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0920109bc0 0x7f0920075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:27.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.245+0000 7f091effd640 1 -- 172.21.15.5:0/3423083499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0920103930 msgr2=0x7f09200754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:27.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.245+0000 7f091effd640 1 --2- 172.21.15.5:0/3423083499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0920103930 0x7f09200754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:27.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.245+0000 7f091effd640 1 -- 172.21.15.5:0/3423083499 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09201a84d0 con 0x7f0920109270 2024-08-31T05:43:27.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.245+0000 7f091f7fe640 1 --2- 172.21.15.5:0/3423083499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0920103930 0x7f09200754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:43:27.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.245+0000 7f091effd640 1 --2- 172.21.15.5:0/3423083499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0920109270 0x7f09200759f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f092006b8d0 tx=0x7f091400ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:27.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.245+0000 7f091cff9640 1 -- 172.21.15.5:0/3423083499 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f091400cc40 con 0x7f0920109270 2024-08-31T05:43:27.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.245+0000 7f091cff9640 1 -- 172.21.15.5:0/3423083499 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f091400cde0 con 0x7f0920109270 2024-08-31T05:43:27.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.245+0000 7f0925c60640 1 -- 172.21.15.5:0/3423083499 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09201a87c0 con 0x7f0920109270 2024-08-31T05:43:27.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.245+0000 7f091cff9640 1 -- 172.21.15.5:0/3423083499 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0914018780 con 0x7f0920109270 2024-08-31T05:43:27.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.245+0000 7f0925c60640 1 -- 172.21.15.5:0/3423083499 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09201a8d00 con 0x7f0920109270 2024-08-31T05:43:27.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.248+0000 7f092c1d5740 1 Processor -- start 2024-08-31T05:43:27.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.248+0000 7f092c1d5740 1 -- start start 2024-08-31T05:43:27.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.248+0000 7f092c1d5740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d989f9070 0x563d98d9e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:27.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.248+0000 7f092c1d5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d989d01b0 0x563d98d9e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:27.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.248+0000 7f092c1d5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d989d8390 0x563d98d9ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:27.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.248+0000 7f092c1d5740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x563d98d15680 con 0x563d989f9070 2024-08-31T05:43:27.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.248+0000 7f092c1d5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x563d98d04c10 con 0x563d989d8390 2024-08-31T05:43:27.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.248+0000 7f092c1d5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563d98d08bc0 con 0x563d989d01b0 2024-08-31T05:43:27.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.248+0000 7f091cff9640 1 -- 172.21.15.5:0/3423083499 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f0914018920 con 0x7f0920109270 2024-08-31T05:43:27.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.248+0000 7f091ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d989f9070 0x563d98d9e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:27.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.248+0000 7f091ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d989f9070 0x563d98d9e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35952/0 (socket says 172.21.15.5:35952) 2024-08-31T05:43:27.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.248+0000 7f091ffff640 1 -- 172.21.15.5:0/3885948150 learned_addr learned my addr 172.21.15.5:0/3885948150 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:27.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.248+0000 7f091f7fe640 1 --2- 172.21.15.5:0/3885948150 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d989d01b0 0x563d98d9e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:27.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.248+0000 7f091effd640 1 --2- 172.21.15.5:0/3885948150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d989d8390 0x563d98d9ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:27.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.248+0000 7f091ffff640 1 -- 172.21.15.5:0/3885948150 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d989d01b0 msgr2=0x563d98d9e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:27.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.248+0000 7f091ffff640 1 --2- 172.21.15.5:0/3885948150 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d989d01b0 0x563d98d9e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:27.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.248+0000 7f091ffff640 1 -- 172.21.15.5:0/3885948150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d989d8390 msgr2=0x563d98d9ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:27.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.248+0000 7f091ffff640 1 --2- 172.21.15.5:0/3885948150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d989d8390 0x563d98d9ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:27.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.248+0000 7f091ffff640 1 -- 172.21.15.5:0/3885948150 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d98a64650 con 0x563d989f9070 2024-08-31T05:43:27.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.249+0000 7f091ffff640 1 --2- 172.21.15.5:0/3885948150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d989f9070 0x563d98d9e310 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f091802f410 tx=0x7f091802f440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c2d5f13bcc5cadf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:27.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.249+0000 7f0905ffb640 1 -- 172.21.15.5:0/3885948150 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0918031cf0 con 0x563d989f9070 2024-08-31T05:43:27.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.249+0000 7f0905ffb640 1 -- 172.21.15.5:0/3885948150 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0918036030 con 0x563d989f9070 2024-08-31T05:43:27.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.249+0000 7f0905ffb640 1 -- 172.21.15.5:0/3885948150 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09180042a0 con 0x563d989f9070 2024-08-31T05:43:27.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.249+0000 7f091cff9640 1 --2- 172.21.15.5:0/3423083499 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f09080b4ca0 0x7f09080b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:27.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.249+0000 7f091f7fe640 1 --2- 172.21.15.5:0/3423083499 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f09080b4ca0 0x7f09080b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:27.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.249+0000 7f091cff9640 1 -- 172.21.15.5:0/3423083499 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9511+0+0 (secure 0 0 0) 0x7f09140e5c40 con 0x7f0920109270 2024-08-31T05:43:27.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.250+0000 7f092c1d5740 1 -- 172.21.15.5:0/3885948150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d989f9070 msgr2=0x563d98d9e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:27.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.250+0000 7f091f7fe640 1 --2- 172.21.15.5:0/3423083499 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f09080b4ca0 0x7f09080b71b0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x563d98d9cf90 tx=0x7f0910005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:27.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.250+0000 7f092c1d5740 1 --2- 172.21.15.5:0/3885948150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d989f9070 0x563d98d9e310 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f091802f410 tx=0x7f091802f440 comp rx=0 tx=0).stop 2024-08-31T05:43:27.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.250+0000 7f092c1d5740 1 -- 172.21.15.5:0/3885948150 shutdown_connections 2024-08-31T05:43:27.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.250+0000 7f092c1d5740 1 --2- 172.21.15.5:0/3885948150 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d989d8390 0x563d98d9ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:27.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.250+0000 7f092c1d5740 1 --2- 172.21.15.5:0/3885948150 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d989d01b0 0x563d98d9e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:27.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.250+0000 7f092c1d5740 1 --2- 172.21.15.5:0/3885948150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d989f9070 0x563d98d9e310 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:27.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.250+0000 7f092c1d5740 1 -- 172.21.15.5:0/3885948150 >> 172.21.15.5:0/3885948150 conn(0x563d989ed460 msgr2=0x563d98d9c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:27.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.250+0000 7f092c1d5740 1 -- 172.21.15.5:0/3885948150 shutdown_connections 2024-08-31T05:43:27.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.250+0000 7f092c1d5740 1 -- 172.21.15.5:0/3885948150 wait complete. 2024-08-31T05:43:27.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.250+0000 7f092c1d5740 1 -- start start 2024-08-31T05:43:27.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.251+0000 7f092c1d5740 1 Processor -- start 2024-08-31T05:43:27.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.251+0000 7f092c1d5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d989d01b0 0x563d98da9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:27.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.251+0000 7f092c1d5740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d989d8390 0x563d98daa020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:27.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.251+0000 7f092c1d5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d989f9070 0x563d98db5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:27.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.251+0000 7f092c1d5740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x563d98b67700 con 0x563d989d8390 2024-08-31T05:43:27.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.251+0000 7f092c1d5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x563d98c8b750 con 0x563d989d01b0 2024-08-31T05:43:27.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.251+0000 7f092c1d5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563d98dac910 con 0x563d989f9070 2024-08-31T05:43:27.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.251+0000 7f092c1d5740 10 client.0 _ll_register_callbacks cb 0x563d98cbae10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:43:27.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.251+0000 7f091effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d989d8390 0x563d98daa020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:27.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.251+0000 7f091f7fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d989d01b0 0x563d98da9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:27.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.251+0000 7f091effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d989d8390 0x563d98daa020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35954/0 (socket says 172.21.15.5:35954) 2024-08-31T05:43:27.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.251+0000 7f091effd640 1 -- 172.21.15.5:0/3440880337 learned_addr learned my addr 172.21.15.5:0/3440880337 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:27.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.251+0000 7f091ffff640 1 --2- 172.21.15.5:0/3440880337 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d989f9070 0x563d98db5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:27.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.252+0000 7f091effd640 1 -- 172.21.15.5:0/3440880337 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d989f9070 msgr2=0x563d98db5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:27.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.252+0000 7f091effd640 1 --2- 172.21.15.5:0/3440880337 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d989f9070 0x563d98db5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:27.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.252+0000 7f091effd640 1 -- 172.21.15.5:0/3440880337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d989d01b0 msgr2=0x563d98da9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:27.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.252+0000 7f091effd640 1 --2- 172.21.15.5:0/3440880337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d989d01b0 0x563d98da9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:27.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.252+0000 7f091effd640 1 -- 172.21.15.5:0/3440880337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d98cc4900 con 0x563d989d8390 2024-08-31T05:43:27.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.252+0000 7f091effd640 1 --2- 172.21.15.5:0/3440880337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d989d8390 0x563d98daa020 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f09140abf70 tx=0x7f0914009700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b82ecd17307d1969 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:27.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.252+0000 7f08feffd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:43:27.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.252+0000 7f08feffd640 1 -- 172.21.15.5:0/3440880337 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0914010a90 con 0x563d989d8390 2024-08-31T05:43:27.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.252+0000 7f08feffd640 1 -- 172.21.15.5:0/3440880337 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9511+0+0 (secure 0 0 0) 0x7f09140b3d30 con 0x563d989d8390 2024-08-31T05:43:27.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.252+0000 7f092c1d5740 1 -- 172.21.15.5:0/3440880337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0918036030 con 0x563d989d8390 2024-08-31T05:43:27.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.252+0000 7f08feffd640 1 -- 172.21.15.5:0/3440880337 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f09140abaf0 con 0x563d989d8390 2024-08-31T05:43:27.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.252+0000 7f092c1d5740 10 client.19149 fetch_fsmap learned FSMap version 36 2024-08-31T05:43:27.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.252+0000 7f092c1d5740 1 -- 172.21.15.5:0/3440880337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x563d98db8740 con 0x563d989d8390 2024-08-31T05:43:27.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.252+0000 7f08feffd640 1 -- 172.21.15.5:0/3440880337 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0918036030 con 0x563d989d8390 2024-08-31T05:43:27.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.253+0000 7f08feffd640 1 -- 172.21.15.5:0/3440880337 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 36) ==== 8386+0+0 (secure 0 0 0) 0x7f09140ed040 con 0x563d989d8390 2024-08-31T05:43:27.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.253+0000 7f092c1d5740 10 client.19149 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T05:43:27.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.253+0000 7f092c1d5740 10 client.19149 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-31T05:43:27.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.253+0000 7f092c1d5740 20 client.19149 populate_metadata read hostname 'smithi005' 2024-08-31T05:43:27.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.253+0000 7f092c1d5740 1 --2- 172.21.15.5:0/3440880337 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x563d989b79f0 0x563d98dbbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:27.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.253+0000 7f092c1d5740 4 client.19149 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:43:27.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.253+0000 7f092c1d5740 1 -- 172.21.15.5:0/3440880337 --> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563d98d175d0 con 0x563d989b79f0 2024-08-31T05:43:27.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.253+0000 7f091f7fe640 1 --2- 172.21.15.5:0/3440880337 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x563d989b79f0 0x563d98dbbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:27.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.253+0000 7f091f7fe640 1 --2- 172.21.15.5:0/3440880337 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x563d989b79f0 0x563d98dbbcd0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7251357819d79a31 server_cookie=c18f87c4661618 in_seq=0 out_seq=0 2024-08-31T05:43:27.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.253+0000 7f08feffd640 10 client.19149 ms_handle_connect on v2:172.21.15.70:6836/2780036414 2024-08-31T05:43:27.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.255+0000 7f08feffd640 1 -- 172.21.15.5:0/3440880337 <== mds.2 v2:172.21.15.70:6836/2780036414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563d98d175d0 con 0x563d989b79f0 2024-08-31T05:43:27.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.255+0000 7f08feffd640 10 client.19149 handle_command_reply: tid=0 2024-08-31T05:43:27.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.255+0000 7f092c1d5740 1 client.19149 shutdown 2024-08-31T05:43:27.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.255+0000 7f092c1d5740 1 -- 172.21.15.5:0/3440880337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d989d8390 msgr2=0x563d98daa020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:27.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.255+0000 7f092c1d5740 1 --2- 172.21.15.5:0/3440880337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d989d8390 0x563d98daa020 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f09140abf70 tx=0x7f0914009700 comp rx=0 tx=0).stop 2024-08-31T05:43:27.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.255+0000 7f092c1d5740 1 -- 172.21.15.5:0/3440880337 shutdown_connections 2024-08-31T05:43:27.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.255+0000 7f092c1d5740 1 --2- 172.21.15.5:0/3440880337 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x563d989b79f0 0x563d98dbbcd0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:27.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.255+0000 7f092c1d5740 1 --2- 172.21.15.5:0/3440880337 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d989f9070 0x563d98db5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:27.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.255+0000 7f092c1d5740 1 --2- 172.21.15.5:0/3440880337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d989d8390 0x563d98daa020 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:27.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.255+0000 7f092c1d5740 1 --2- 172.21.15.5:0/3440880337 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d989d01b0 0x563d98da9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:27.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.255+0000 7f08feffd640 0 client.19149 ms_handle_reset on v2:172.21.15.70:6836/2780036414 2024-08-31T05:43:27.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.255+0000 7f092c1d5740 1 -- 172.21.15.5:0/3440880337 >> 172.21.15.5:0/3440880337 conn(0x563d989ed460 msgr2=0x563d98da14f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:27.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.255+0000 7f092c1d5740 1 -- 172.21.15.5:0/3440880337 shutdown_connections 2024-08-31T05:43:27.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.255+0000 7f092c1d5740 1 -- 172.21.15.5:0/3440880337 wait complete. 2024-08-31T05:43:27.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.255+0000 7f092c1d5740 20 client.19149 trim_cache size 0 max 16384 2024-08-31T05:43:27.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.271+0000 7f092c1d5740 1 Processor -- start 2024-08-31T05:43:27.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.271+0000 7f092c1d5740 1 -- start start 2024-08-31T05:43:27.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.271+0000 7f092c1d5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d989d01b0 0x563d98da1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:27.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.271+0000 7f092c1d5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d989d8390 0x563d98db5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:27.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.271+0000 7f092c1d5740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d989f9070 0x563d98db6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:27.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.271+0000 7f092c1d5740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f09201b2f50 con 0x563d989f9070 2024-08-31T05:43:27.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.271+0000 7f092c1d5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f09201b4b50 con 0x563d989d8390 2024-08-31T05:43:27.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.271+0000 7f092c1d5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f09201b3620 con 0x563d989d01b0 2024-08-31T05:43:27.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.272+0000 7f091ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d989f9070 0x563d98db6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:27.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.272+0000 7f091ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d989f9070 0x563d98db6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35964/0 (socket says 172.21.15.5:35964) 2024-08-31T05:43:27.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.272+0000 7f091ffff640 1 -- 172.21.15.5:0/3259407208 learned_addr learned my addr 172.21.15.5:0/3259407208 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:27.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.272+0000 7f091effd640 1 --2- 172.21.15.5:0/3259407208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d989d8390 0x563d98db5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:27.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.272+0000 7f091f7fe640 1 --2- 172.21.15.5:0/3259407208 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d989d01b0 0x563d98da1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:27.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.272+0000 7f091ffff640 1 -- 172.21.15.5:0/3259407208 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d989d01b0 msgr2=0x563d98da1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:27.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.272+0000 7f091ffff640 1 --2- 172.21.15.5:0/3259407208 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d989d01b0 0x563d98da1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:27.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.272+0000 7f091ffff640 1 -- 172.21.15.5:0/3259407208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d989d8390 msgr2=0x563d98db5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:27.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.272+0000 7f091ffff640 1 --2- 172.21.15.5:0/3259407208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d989d8390 0x563d98db5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:27.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.272+0000 7f091ffff640 1 -- 172.21.15.5:0/3259407208 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d98daada0 con 0x563d989f9070 2024-08-31T05:43:27.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.272+0000 7f091effd640 1 --2- 172.21.15.5:0/3259407208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d989d8390 0x563d98db5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:43:27.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.272+0000 7f091ffff640 1 --2- 172.21.15.5:0/3259407208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d989f9070 0x563d98db6040 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f0918003d40 tx=0x7f0918003d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f27c8b3ed3454814 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:27.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.272+0000 7f09057fa640 1 -- 172.21.15.5:0/3259407208 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0918055020 con 0x563d989f9070 2024-08-31T05:43:27.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.272+0000 7f09057fa640 1 -- 172.21.15.5:0/3259407208 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0918036040 con 0x563d989f9070 2024-08-31T05:43:27.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.272+0000 7f09057fa640 1 -- 172.21.15.5:0/3259407208 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f091804a040 con 0x563d989f9070 2024-08-31T05:43:27.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.273+0000 7f092c1d5740 1 -- 172.21.15.5:0/3259407208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d989f9070 msgr2=0x563d98db6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:27.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.273+0000 7f092c1d5740 1 --2- 172.21.15.5:0/3259407208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d989f9070 0x563d98db6040 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f0918003d40 tx=0x7f0918003d70 comp rx=0 tx=0).stop 2024-08-31T05:43:27.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.273+0000 7f092c1d5740 1 -- 172.21.15.5:0/3259407208 shutdown_connections 2024-08-31T05:43:27.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.273+0000 7f092c1d5740 1 --2- 172.21.15.5:0/3259407208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d989f9070 0x563d98db6040 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:27.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.273+0000 7f092c1d5740 1 --2- 172.21.15.5:0/3259407208 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d989d8390 0x563d98db5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:27.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.273+0000 7f092c1d5740 1 --2- 172.21.15.5:0/3259407208 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d989d01b0 0x563d98da1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:27.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.273+0000 7f092c1d5740 1 -- 172.21.15.5:0/3259407208 >> 172.21.15.5:0/3259407208 conn(0x563d989ed460 msgr2=0x563d98da1410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:27.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.274+0000 7f092c1d5740 1 -- 172.21.15.5:0/3259407208 shutdown_connections 2024-08-31T05:43:27.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.274+0000 7f092c1d5740 1 -- 172.21.15.5:0/3259407208 wait complete. 2024-08-31T05:43:27.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.274+0000 7f092c1d5740 1 -- start start 2024-08-31T05:43:27.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.274+0000 7f092c1d5740 1 Processor -- start 2024-08-31T05:43:27.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.275+0000 7f092c1d5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d989d01b0 0x563d98db2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:27.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.275+0000 7f092c1d5740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d989d8390 0x563d98dae640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:27.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.275+0000 7f092c1d5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d989f9070 0x563d98daeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:27.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.275+0000 7f092c1d5740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f09201b4480 con 0x563d989d8390 2024-08-31T05:43:27.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.275+0000 7f092c1d5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f09201b3db0 con 0x563d989f9070 2024-08-31T05:43:27.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.275+0000 7f092c1d5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f09201b0f50 con 0x563d989d01b0 2024-08-31T05:43:27.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.275+0000 7f092c1d5740 10 client.0 _ll_register_callbacks cb 0x7f09140e9260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:43:27.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.275+0000 7f091effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d989d8390 0x563d98dae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:27.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.275+0000 7f091f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d989d01b0 0x563d98db2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:27.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.275+0000 7f091effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d989d8390 0x563d98dae640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35980/0 (socket says 172.21.15.5:35980) 2024-08-31T05:43:27.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.275+0000 7f091effd640 1 -- 172.21.15.5:0/641749115 learned_addr learned my addr 172.21.15.5:0/641749115 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:27.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.275+0000 7f091ffff640 1 --2- 172.21.15.5:0/641749115 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d989f9070 0x563d98daeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:27.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.275+0000 7f091effd640 1 -- 172.21.15.5:0/641749115 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d989d01b0 msgr2=0x563d98db2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:27.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.275+0000 7f091effd640 1 --2- 172.21.15.5:0/641749115 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d989d01b0 0x563d98db2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:27.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.275+0000 7f091effd640 1 -- 172.21.15.5:0/641749115 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d989f9070 msgr2=0x563d98daeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:27.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.275+0000 7f091effd640 1 --2- 172.21.15.5:0/641749115 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d989f9070 0x563d98daeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:27.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.275+0000 7f091effd640 1 -- 172.21.15.5:0/641749115 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d98daf140 con 0x563d989d8390 2024-08-31T05:43:27.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.275+0000 7f091ffff640 1 --2- 172.21.15.5:0/641749115 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d989f9070 0x563d98daeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:43:27.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.276+0000 7f091effd640 1 --2- 172.21.15.5:0/641749115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d989d8390 0x563d98dae640 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f09140a8060 tx=0x7f09140ab610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=771f99599a9ce2ce server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:27.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.276+0000 7f08feffd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:43:27.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.276+0000 7f08feffd640 1 -- 172.21.15.5:0/641749115 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0914097070 con 0x563d989d8390 2024-08-31T05:43:27.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.276+0000 7f08feffd640 1 -- 172.21.15.5:0/641749115 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9511+0+0 (secure 0 0 0) 0x7f09140ab000 con 0x563d989d8390 2024-08-31T05:43:27.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.276+0000 7f092c1d5740 1 -- 172.21.15.5:0/641749115 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0918036040 con 0x563d989d8390 2024-08-31T05:43:27.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.276+0000 7f08feffd640 1 -- 172.21.15.5:0/641749115 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f09140a7ea0 con 0x563d989d8390 2024-08-31T05:43:27.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.276+0000 7f092c1d5740 10 client.19155 fetch_fsmap learned FSMap version 36 2024-08-31T05:43:27.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.276+0000 7f092c1d5740 1 -- 172.21.15.5:0/641749115 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x563d98e27410 con 0x563d989d8390 2024-08-31T05:43:27.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.276+0000 7f08feffd640 1 -- 172.21.15.5:0/641749115 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0918036040 con 0x563d989d8390 2024-08-31T05:43:27.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.277+0000 7f08feffd640 1 -- 172.21.15.5:0/641749115 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 36) ==== 8386+0+0 (secure 0 0 0) 0x7f09140c6ce0 con 0x563d989d8390 2024-08-31T05:43:27.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.277+0000 7f092c1d5740 10 client.19155 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T05:43:27.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.277+0000 7f092c1d5740 10 client.19155 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-31T05:43:27.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.277+0000 7f092c1d5740 20 client.19155 populate_metadata read hostname 'smithi005' 2024-08-31T05:43:27.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.277+0000 7f092c1d5740 1 --2- 172.21.15.5:0/641749115 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x563d9898cda0 0x563d98e299e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:27.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.277+0000 7f092c1d5740 4 client.19155 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:43:27.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.277+0000 7f092c1d5740 1 -- 172.21.15.5:0/641749115 --> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563d98d13070 con 0x563d9898cda0 2024-08-31T05:43:27.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.277+0000 7f091f7fe640 1 --2- 172.21.15.5:0/641749115 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x563d9898cda0 0x563d98e299e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:27.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.277+0000 7f08feffd640 10 client.19155 ms_handle_connect on v2:172.21.15.70:6836/2780036414 2024-08-31T05:43:27.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.277+0000 7f091f7fe640 1 --2- 172.21.15.5:0/641749115 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x563d9898cda0 0x563d98e299e0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4c01bcdcdc270372 server_cookie=b4c4bae4ec83789 in_seq=0 out_seq=0 2024-08-31T05:43:27.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.281+0000 7f08feffd640 1 -- 172.21.15.5:0/641749115 <== mds.2 v2:172.21.15.70:6836/2780036414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563d98d13070 con 0x563d9898cda0 2024-08-31T05:43:27.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.281+0000 7f08feffd640 10 client.19155 handle_command_reply: tid=0 2024-08-31T05:43:27.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.281+0000 7f092c1d5740 1 client.19155 shutdown 2024-08-31T05:43:27.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.281+0000 7f092c1d5740 1 -- 172.21.15.5:0/641749115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d989d8390 msgr2=0x563d98dae640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:27.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.281+0000 7f092c1d5740 1 --2- 172.21.15.5:0/641749115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d989d8390 0x563d98dae640 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f09140a8060 tx=0x7f09140ab610 comp rx=0 tx=0).stop 2024-08-31T05:43:27.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.281+0000 7f092c1d5740 1 -- 172.21.15.5:0/641749115 shutdown_connections 2024-08-31T05:43:27.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.281+0000 7f092c1d5740 1 --2- 172.21.15.5:0/641749115 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x563d9898cda0 0x563d98e299e0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:27.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.281+0000 7f092c1d5740 1 --2- 172.21.15.5:0/641749115 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x563d989f9070 0x563d98daeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:27.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.281+0000 7f092c1d5740 1 --2- 172.21.15.5:0/641749115 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563d989d8390 0x563d98dae640 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:27.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.281+0000 7f08feffd640 0 client.19155 ms_handle_reset on v2:172.21.15.70:6836/2780036414 2024-08-31T05:43:27.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.281+0000 7f092c1d5740 1 --2- 172.21.15.5:0/641749115 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d989d01b0 0x563d98db2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:27.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.281+0000 7f092c1d5740 1 -- 172.21.15.5:0/641749115 >> 172.21.15.5:0/641749115 conn(0x563d989ed460 msgr2=0x563d98daaf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:27.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.281+0000 7f092c1d5740 1 -- 172.21.15.5:0/641749115 shutdown_connections 2024-08-31T05:43:27.307 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:43:27.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.281+0000 7f092c1d5740 1 -- 172.21.15.5:0/641749115 wait complete. 2024-08-31T05:43:27.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.281+0000 7f092c1d5740 20 client.19155 trim_cache size 0 max 16384 2024-08-31T05:43:27.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.282+0000 7f0925c60640 1 -- 172.21.15.5:0/3423083499 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f09080b4ca0 msgr2=0x7f09080b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:27.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.282+0000 7f0925c60640 1 --2- 172.21.15.5:0/3423083499 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f09080b4ca0 0x7f09080b71b0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x563d98d9cf90 tx=0x7f0910005f90 comp rx=0 tx=0).stop 2024-08-31T05:43:27.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.282+0000 7f0925c60640 1 -- 172.21.15.5:0/3423083499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0920109270 msgr2=0x7f09200759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:27.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.282+0000 7f0925c60640 1 --2- 172.21.15.5:0/3423083499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0920109270 0x7f09200759f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f092006b8d0 tx=0x7f091400ee50 comp rx=0 tx=0).stop 2024-08-31T05:43:27.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.282+0000 7f0925c60640 1 -- 172.21.15.5:0/3423083499 shutdown_connections 2024-08-31T05:43:27.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.282+0000 7f0925c60640 1 --2- 172.21.15.5:0/3423083499 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f09080b4ca0 0x7f09080b71b0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:27.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.282+0000 7f0925c60640 1 --2- 172.21.15.5:0/3423083499 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0920109bc0 0x7f0920075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:27.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.282+0000 7f0925c60640 1 --2- 172.21.15.5:0/3423083499 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f0920109270 0x7f09200759f0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:27.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.282+0000 7f0925c60640 1 --2- 172.21.15.5:0/3423083499 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0920103930 0x7f09200754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:27.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.282+0000 7f0925c60640 1 -- 172.21.15.5:0/3423083499 >> 172.21.15.5:0/3423083499 conn(0x7f09200ff3a0 msgr2=0x7f0920108900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:27.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.282+0000 7f0925c60640 1 -- 172.21.15.5:0/3423083499 shutdown_connections 2024-08-31T05:43:27.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:27.282+0000 7f0925c60640 1 -- 172.21.15.5:0/3423083499 wait complete. 2024-08-31T05:43:27.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:26 smithi070 ceph-mon[22316]: pgmap v763: 129 pgs: 129 active+clean; 755 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 20 MiB/s wr, 422 op/s 2024-08-31T05:43:27.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:26 smithi050 ceph-mon[22146]: pgmap v763: 129 pgs: 129 active+clean; 755 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 20 MiB/s wr, 422 op/s 2024-08-31T05:43:28.267 INFO:tasks.workunit.client.0.smithi005.stdout: 10 5938 32.50 MB/sec warmup 15 sec latency 1451.718 ms 2024-08-31T05:43:28.448 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T05:43:28.715 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:43:29.123 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:28 smithi005 ceph-mon[18602]: pgmap v764: 129 pgs: 129 active+clean; 760 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 18 MiB/s wr, 379 op/s 2024-08-31T05:43:29.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.222+0000 7f1828890640 1 -- 172.21.15.5:0/4167828610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1824108ac0 msgr2=0x7f182410f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:29.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.222+0000 7f1828890640 1 --2- 172.21.15.5:0/4167828610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1824108ac0 0x7f182410f2f0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f181c009ca0 tx=0x7f181c02a8c0 comp rx=0 tx=0).stop 2024-08-31T05:43:29.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.222+0000 7f1828890640 1 -- 172.21.15.5:0/4167828610 shutdown_connections 2024-08-31T05:43:29.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.222+0000 7f1828890640 1 --2- 172.21.15.5:0/4167828610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1824108ac0 0x7f182410f2f0 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:29.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.222+0000 7f1828890640 1 --2- 172.21.15.5:0/4167828610 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1824108170 0x7f1824108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:29.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.222+0000 7f1828890640 1 --2- 172.21.15.5:0/4167828610 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1824102880 0x7f1824102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:29.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.222+0000 7f1828890640 1 -- 172.21.15.5:0/4167828610 >> 172.21.15.5:0/4167828610 conn(0x7f1824079500 msgr2=0x7f1824079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:29.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.222+0000 7f1828890640 1 -- 172.21.15.5:0/4167828610 shutdown_connections 2024-08-31T05:43:29.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.222+0000 7f1828890640 1 -- 172.21.15.5:0/4167828610 wait complete. 2024-08-31T05:43:29.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.223+0000 7f1828890640 1 Processor -- start 2024-08-31T05:43:29.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.223+0000 7f1828890640 1 -- start start 2024-08-31T05:43:29.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.223+0000 7f1828890640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1824102880 0x7f182419a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:29.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.223+0000 7f1828890640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1824108170 0x7f182419a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:29.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.223+0000 7f1828890640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1824108ac0 0x7f182419fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:29.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.223+0000 7f1828890640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1824112740 con 0x7f1824108ac0 2024-08-31T05:43:29.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.223+0000 7f1828890640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f18241125c0 con 0x7f1824108170 2024-08-31T05:43:29.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.223+0000 7f1828890640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f18241128c0 con 0x7f1824102880 2024-08-31T05:43:29.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.223+0000 7f182259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1824102880 0x7f182419a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:29.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.223+0000 7f1822d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1824108ac0 0x7f182419fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:29.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.223+0000 7f182259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1824102880 0x7f182419a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:57398/0 (socket says 172.21.15.5:57398) 2024-08-31T05:43:29.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.223+0000 7f182259c640 1 -- 172.21.15.5:0/3643553108 learned_addr learned my addr 172.21.15.5:0/3643553108 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:29.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.223+0000 7f1819d9b640 1 --2- 172.21.15.5:0/3643553108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1824108170 0x7f182419a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:29.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.224+0000 7f182259c640 1 -- 172.21.15.5:0/3643553108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1824108170 msgr2=0x7f182419a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:29.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.224+0000 7f182259c640 1 --2- 172.21.15.5:0/3643553108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1824108170 0x7f182419a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:29.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.224+0000 7f182259c640 1 -- 172.21.15.5:0/3643553108 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1824108ac0 msgr2=0x7f182419fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:29.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.224+0000 7f182259c640 1 --2- 172.21.15.5:0/3643553108 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1824108ac0 0x7f182419fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:29.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.224+0000 7f182259c640 1 -- 172.21.15.5:0/3643553108 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18241a0130 con 0x7f1824102880 2024-08-31T05:43:29.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.224+0000 7f1819d9b640 1 --2- 172.21.15.5:0/3643553108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1824108170 0x7f182419a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:43:29.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.224+0000 7f182259c640 1 --2- 172.21.15.5:0/3643553108 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1824102880 0x7f182419a1c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f181400e9f0 tx=0x7f181400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:29.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.224+0000 7f181bfff640 1 -- 172.21.15.5:0/3643553108 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f181400cd80 con 0x7f1824102880 2024-08-31T05:43:29.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.224+0000 7f181bfff640 1 -- 172.21.15.5:0/3643553108 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18140054d0 con 0x7f1824102880 2024-08-31T05:43:29.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.224+0000 7f1828890640 1 -- 172.21.15.5:0/3643553108 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18241a0420 con 0x7f1824102880 2024-08-31T05:43:29.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.224+0000 7f181bfff640 1 -- 172.21.15.5:0/3643553108 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1814010690 con 0x7f1824102880 2024-08-31T05:43:29.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.224+0000 7f1828890640 1 -- 172.21.15.5:0/3643553108 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18240ff2f0 con 0x7f1824102880 2024-08-31T05:43:29.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.227+0000 7f182ee05740 1 Processor -- start 2024-08-31T05:43:29.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.227+0000 7f182ee05740 1 -- start start 2024-08-31T05:43:29.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.227+0000 7f182ee05740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55749f0b0070 0x55749f455310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:29.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.227+0000 7f182ee05740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55749f0871b0 0x55749f455850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:29.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.227+0000 7f182ee05740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55749f08f390 0x55749f455d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:29.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.227+0000 7f182ee05740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55749f3cc680 con 0x55749f0871b0 2024-08-31T05:43:29.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.227+0000 7f182ee05740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55749f3bbc10 con 0x55749f08f390 2024-08-31T05:43:29.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.227+0000 7f182ee05740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55749f3bfbc0 con 0x55749f0b0070 2024-08-31T05:43:29.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.228+0000 7f1822d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55749f0b0070 0x55749f455310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:29.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.228+0000 7f1819d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55749f08f390 0x55749f455d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:29.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.228+0000 7f1819d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55749f08f390 0x55749f455d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:51758/0 (socket says 172.21.15.5:51758) 2024-08-31T05:43:29.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.228+0000 7f1822d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55749f0b0070 0x55749f455310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:57414/0 (socket says 172.21.15.5:57414) 2024-08-31T05:43:29.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.228+0000 7f1819d9b640 1 -- 172.21.15.5:0/671658835 learned_addr learned my addr 172.21.15.5:0/671658835 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:29.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.228+0000 7f181bfff640 1 -- 172.21.15.5:0/3643553108 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f1814004e90 con 0x7f1824102880 2024-08-31T05:43:29.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.228+0000 7f1819d9b640 1 -- 172.21.15.5:0/671658835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55749f0b0070 msgr2=0x55749f455310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:29.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.228+0000 7f1819d9b640 1 --2- 172.21.15.5:0/671658835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55749f0b0070 0x55749f455310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:29.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.228+0000 7f1819d9b640 1 -- 172.21.15.5:0/671658835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55749f0871b0 msgr2=0x55749f455850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:29.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.228+0000 7f1819d9b640 1 --2- 172.21.15.5:0/671658835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55749f0871b0 0x55749f455850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:29.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.228+0000 7f1819d9b640 1 -- 172.21.15.5:0/671658835 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55749f11b650 con 0x55749f08f390 2024-08-31T05:43:29.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.228+0000 7f1822d9d640 1 --2- 172.21.15.5:0/671658835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55749f0b0070 0x55749f455310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:43:29.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.228+0000 7f1819d9b640 1 --2- 172.21.15.5:0/671658835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55749f08f390 0x55749f455d90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f180c009cb0 tx=0x7f180c0117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa4bb59ff7d61c1f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:29.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.228+0000 7f1818d99640 1 -- 172.21.15.5:0/671658835 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f180c004020 con 0x55749f08f390 2024-08-31T05:43:29.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.228+0000 7f1818d99640 1 -- 172.21.15.5:0/671658835 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f180c0041c0 con 0x55749f08f390 2024-08-31T05:43:29.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.229+0000 7f1818d99640 1 -- 172.21.15.5:0/671658835 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f180c012720 con 0x55749f08f390 2024-08-31T05:43:29.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.229+0000 7f181bfff640 1 --2- 172.21.15.5:0/3643553108 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f18100b4ca0 0x7f18100b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:29.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.229+0000 7f1822d9d640 1 --2- 172.21.15.5:0/3643553108 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f18100b4ca0 0x7f18100b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:29.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.229+0000 7f181bfff640 1 -- 172.21.15.5:0/3643553108 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9511+0+0 (secure 0 0 0) 0x7f18140e5e20 con 0x7f1824102880 2024-08-31T05:43:29.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.229+0000 7f182ee05740 1 -- 172.21.15.5:0/671658835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55749f08f390 msgr2=0x55749f455d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:29.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.229+0000 7f182ee05740 1 --2- 172.21.15.5:0/671658835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55749f08f390 0x55749f455d90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f180c009cb0 tx=0x7f180c0117b0 comp rx=0 tx=0).stop 2024-08-31T05:43:29.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.229+0000 7f182ee05740 1 -- 172.21.15.5:0/671658835 shutdown_connections 2024-08-31T05:43:29.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.229+0000 7f182ee05740 1 --2- 172.21.15.5:0/671658835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55749f08f390 0x55749f455d90 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:29.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.229+0000 7f182ee05740 1 --2- 172.21.15.5:0/671658835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55749f0871b0 0x55749f455850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:29.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.229+0000 7f182ee05740 1 --2- 172.21.15.5:0/671658835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55749f0b0070 0x55749f455310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:29.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.229+0000 7f182ee05740 1 -- 172.21.15.5:0/671658835 >> 172.21.15.5:0/671658835 conn(0x55749f0a4460 msgr2=0x55749f453200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:29.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.230+0000 7f1822d9d640 1 --2- 172.21.15.5:0/3643553108 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f18100b4ca0 0x7f18100b71b0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f181c02f500 tx=0x7f181c02f490 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:29.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.230+0000 7f182ee05740 1 -- 172.21.15.5:0/671658835 shutdown_connections 2024-08-31T05:43:29.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.230+0000 7f182ee05740 1 -- 172.21.15.5:0/671658835 wait complete. 2024-08-31T05:43:29.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.230+0000 7f182ee05740 1 -- start start 2024-08-31T05:43:29.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.230+0000 7f182ee05740 1 Processor -- start 2024-08-31T05:43:29.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.230+0000 7f182ee05740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55749f0871b0 0x55749f460a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:29.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.230+0000 7f182ee05740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55749f08f390 0x55749f460f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:29.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.231+0000 7f182ee05740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55749f0b0070 0x55749f46cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:29.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.231+0000 7f182ee05740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55749f21e700 con 0x55749f0b0070 2024-08-31T05:43:29.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.231+0000 7f182ee05740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55749f342750 con 0x55749f08f390 2024-08-31T05:43:29.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.231+0000 7f182ee05740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55749f463af0 con 0x55749f0871b0 2024-08-31T05:43:29.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.231+0000 7f182ee05740 10 client.0 _ll_register_callbacks cb 0x55749f371e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:43:29.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.231+0000 7f1819d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55749f08f390 0x55749f460f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:29.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.231+0000 7f1822d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55749f0b0070 0x55749f46cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:29.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.231+0000 7f182259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55749f0871b0 0x55749f460a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:29.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.231+0000 7f1819d9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55749f08f390 0x55749f460f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:51764/0 (socket says 172.21.15.5:51764) 2024-08-31T05:43:29.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.231+0000 7f1819d9b640 1 -- 172.21.15.5:0/1390042662 learned_addr learned my addr 172.21.15.5:0/1390042662 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:29.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.231+0000 7f1819d9b640 1 -- 172.21.15.5:0/1390042662 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55749f0871b0 msgr2=0x55749f460a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:29.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.231+0000 7f1819d9b640 1 --2- 172.21.15.5:0/1390042662 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55749f0871b0 0x55749f460a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:29.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.231+0000 7f1819d9b640 1 -- 172.21.15.5:0/1390042662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55749f0b0070 msgr2=0x55749f46cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:29.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.231+0000 7f1819d9b640 1 --2- 172.21.15.5:0/1390042662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55749f0b0070 0x55749f46cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:29.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.231+0000 7f1819d9b640 1 -- 172.21.15.5:0/1390042662 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55749f37b900 con 0x55749f08f390 2024-08-31T05:43:29.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.231+0000 7f1819d9b640 1 --2- 172.21.15.5:0/1390042662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55749f08f390 0x55749f460f70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f180c003e90 tx=0x7f180c003b70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1af53e7ac9dd5ddc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:29.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.231+0000 7f1809ffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:43:29.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.231+0000 7f1809ffb640 1 -- 172.21.15.5:0/1390042662 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f180c009da0 con 0x55749f08f390 2024-08-31T05:43:29.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.231+0000 7f1809ffb640 1 -- 172.21.15.5:0/1390042662 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9511+0+0 (secure 0 0 0) 0x7f180c0097a0 con 0x55749f08f390 2024-08-31T05:43:29.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.231+0000 7f182ee05740 1 -- 172.21.15.5:0/1390042662 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f180c0041c0 con 0x55749f08f390 2024-08-31T05:43:29.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.232+0000 7f1809ffb640 1 -- 172.21.15.5:0/1390042662 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f180c031050 con 0x55749f08f390 2024-08-31T05:43:29.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.232+0000 7f182ee05740 10 client.28733 fetch_fsmap learned FSMap version 36 2024-08-31T05:43:29.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.232+0000 7f182ee05740 1 -- 172.21.15.5:0/1390042662 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55749f46f860 con 0x55749f08f390 2024-08-31T05:43:29.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.232+0000 7f1809ffb640 1 -- 172.21.15.5:0/1390042662 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f180c0041c0 con 0x55749f08f390 2024-08-31T05:43:29.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.232+0000 7f1809ffb640 1 -- 172.21.15.5:0/1390042662 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 36) ==== 8386+0+0 (secure 0 0 0) 0x7f180c004ae0 con 0x55749f08f390 2024-08-31T05:43:29.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.232+0000 7f182ee05740 10 client.28733 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T05:43:29.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.232+0000 7f182ee05740 10 client.28733 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-31T05:43:29.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.232+0000 7f182ee05740 20 client.28733 populate_metadata read hostname 'smithi005' 2024-08-31T05:43:29.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.232+0000 7f182ee05740 1 --2- 172.21.15.5:0/1390042662 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55749f06e9f0 0x55749f472bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:29.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.232+0000 7f182ee05740 4 client.28733 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:43:29.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.232+0000 7f182ee05740 1 -- 172.21.15.5:0/1390042662 --> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55749f3ce5d0 con 0x55749f06e9f0 2024-08-31T05:43:29.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.232+0000 7f182259c640 1 --2- 172.21.15.5:0/1390042662 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55749f06e9f0 0x55749f472bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:29.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.233+0000 7f182259c640 1 --2- 172.21.15.5:0/1390042662 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55749f06e9f0 0x55749f472bc0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1be6a04194ac775a server_cookie=e5f4961fa189419e in_seq=0 out_seq=0 2024-08-31T05:43:29.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.233+0000 7f1809ffb640 10 client.28733 ms_handle_connect on v2:172.21.15.50:6838/98200944 2024-08-31T05:43:29.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.233+0000 7f1809ffb640 1 -- 172.21.15.5:0/1390042662 <== mds.1 v2:172.21.15.50:6838/98200944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55749f3ce5d0 con 0x55749f06e9f0 2024-08-31T05:43:29.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.233+0000 7f1809ffb640 10 client.28733 handle_command_reply: tid=0 2024-08-31T05:43:29.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.233+0000 7f182ee05740 1 client.28733 shutdown 2024-08-31T05:43:29.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.234+0000 7f182ee05740 1 -- 172.21.15.5:0/1390042662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55749f08f390 msgr2=0x55749f460f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:29.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.234+0000 7f182ee05740 1 --2- 172.21.15.5:0/1390042662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55749f08f390 0x55749f460f70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f180c003e90 tx=0x7f180c003b70 comp rx=0 tx=0).stop 2024-08-31T05:43:29.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.234+0000 7f182ee05740 1 -- 172.21.15.5:0/1390042662 shutdown_connections 2024-08-31T05:43:29.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.234+0000 7f182ee05740 1 --2- 172.21.15.5:0/1390042662 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55749f06e9f0 0x55749f472bc0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:29.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.234+0000 7f182ee05740 1 --2- 172.21.15.5:0/1390042662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55749f0b0070 0x55749f46cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:29.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.234+0000 7f182ee05740 1 --2- 172.21.15.5:0/1390042662 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55749f08f390 0x55749f460f70 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:29.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.234+0000 7f1809ffb640 0 client.28733 ms_handle_reset on v2:172.21.15.50:6838/98200944 2024-08-31T05:43:29.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.234+0000 7f182ee05740 1 --2- 172.21.15.5:0/1390042662 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55749f0871b0 0x55749f460a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:29.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.234+0000 7f182ee05740 1 -- 172.21.15.5:0/1390042662 >> 172.21.15.5:0/1390042662 conn(0x55749f0a4460 msgr2=0x55749f4584a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:29.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.234+0000 7f182ee05740 1 -- 172.21.15.5:0/1390042662 shutdown_connections 2024-08-31T05:43:29.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.234+0000 7f182ee05740 1 -- 172.21.15.5:0/1390042662 wait complete. 2024-08-31T05:43:29.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.234+0000 7f182ee05740 20 client.28733 trim_cache size 0 max 16384 2024-08-31T05:43:29.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.248+0000 7f182ee05740 1 Processor -- start 2024-08-31T05:43:29.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.248+0000 7f182ee05740 1 -- start start 2024-08-31T05:43:29.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.248+0000 7f182ee05740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55749f0871b0 0x55749f453270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:29.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.248+0000 7f182ee05740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55749f08f390 0x55749f46cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:29.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.248+0000 7f182ee05740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55749f0b0070 0x55749f45dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:29.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.248+0000 7f182ee05740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f18241b2eb0 con 0x55749f0871b0 2024-08-31T05:43:29.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.248+0000 7f182ee05740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f18241b4ab0 con 0x55749f08f390 2024-08-31T05:43:29.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.248+0000 7f182ee05740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f18241b3580 con 0x55749f0b0070 2024-08-31T05:43:29.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.248+0000 7f182259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55749f0871b0 0x55749f453270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:29.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.248+0000 7f182259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55749f0871b0 0x55749f453270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36020/0 (socket says 172.21.15.5:36020) 2024-08-31T05:43:29.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.248+0000 7f182259c640 1 -- 172.21.15.5:0/4094987533 learned_addr learned my addr 172.21.15.5:0/4094987533 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:29.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.248+0000 7f1822d9d640 1 --2- 172.21.15.5:0/4094987533 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55749f0b0070 0x55749f45dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:29.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.248+0000 7f1819d9b640 1 --2- 172.21.15.5:0/4094987533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55749f08f390 0x55749f46cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:29.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.248+0000 7f182259c640 1 -- 172.21.15.5:0/4094987533 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55749f0b0070 msgr2=0x55749f45dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:29.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.248+0000 7f182259c640 1 --2- 172.21.15.5:0/4094987533 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55749f0b0070 0x55749f45dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:29.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.248+0000 7f182259c640 1 -- 172.21.15.5:0/4094987533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55749f08f390 msgr2=0x55749f46cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:29.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.248+0000 7f182259c640 1 --2- 172.21.15.5:0/4094987533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55749f08f390 0x55749f46cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:29.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.248+0000 7f182259c640 1 -- 172.21.15.5:0/4094987533 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55749f457600 con 0x55749f0871b0 2024-08-31T05:43:29.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.249+0000 7f182259c640 1 --2- 172.21.15.5:0/4094987533 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55749f0871b0 0x55749f453270 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f18140abbf0 tx=0x7f18140a7ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe50c67ad8ee278e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:29.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.249+0000 7f180bfff640 1 -- 172.21.15.5:0/4094987533 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18140ac830 con 0x55749f0871b0 2024-08-31T05:43:29.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.249+0000 7f180bfff640 1 -- 172.21.15.5:0/4094987533 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18140ac130 con 0x55749f0871b0 2024-08-31T05:43:29.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.249+0000 7f180bfff640 1 -- 172.21.15.5:0/4094987533 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18140a83c0 con 0x55749f0871b0 2024-08-31T05:43:29.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.250+0000 7f182ee05740 1 -- 172.21.15.5:0/4094987533 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55749f0871b0 msgr2=0x55749f453270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:29.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.250+0000 7f182ee05740 1 --2- 172.21.15.5:0/4094987533 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55749f0871b0 0x55749f453270 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f18140abbf0 tx=0x7f18140a7ff0 comp rx=0 tx=0).stop 2024-08-31T05:43:29.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.250+0000 7f182ee05740 1 -- 172.21.15.5:0/4094987533 shutdown_connections 2024-08-31T05:43:29.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.250+0000 7f182ee05740 1 --2- 172.21.15.5:0/4094987533 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55749f0b0070 0x55749f45dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:29.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.250+0000 7f182ee05740 1 --2- 172.21.15.5:0/4094987533 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55749f08f390 0x55749f46cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:29.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.250+0000 7f182ee05740 1 --2- 172.21.15.5:0/4094987533 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55749f0871b0 0x55749f453270 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:29.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.250+0000 7f182ee05740 1 -- 172.21.15.5:0/4094987533 >> 172.21.15.5:0/4094987533 conn(0x55749f0a4460 msgr2=0x55749f452b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:29.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.250+0000 7f182ee05740 1 -- 172.21.15.5:0/4094987533 shutdown_connections 2024-08-31T05:43:29.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.250+0000 7f182ee05740 1 -- 172.21.15.5:0/4094987533 wait complete. 2024-08-31T05:43:29.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.250+0000 7f182ee05740 1 -- start start 2024-08-31T05:43:29.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.250+0000 7f182ee05740 1 Processor -- start 2024-08-31T05:43:29.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.251+0000 7f182ee05740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55749f0871b0 0x55749f473c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:29.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.251+0000 7f182ee05740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55749f08f390 0x55749f474190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:29.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.251+0000 7f182ee05740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55749f0b0070 0x55749f4746d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:29.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.251+0000 7f182ee05740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f18241b43e0 con 0x55749f0b0070 2024-08-31T05:43:29.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.251+0000 7f182ee05740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f18241b3d10 con 0x55749f08f390 2024-08-31T05:43:29.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.251+0000 7f182ee05740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f18241b0eb0 con 0x55749f0871b0 2024-08-31T05:43:29.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.251+0000 7f182ee05740 10 client.0 _ll_register_callbacks cb 0x7f1814005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:43:29.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.251+0000 7f182259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55749f0871b0 0x55749f473c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:29.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.251+0000 7f1822d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55749f0b0070 0x55749f4746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:29.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.251+0000 7f182259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55749f0871b0 0x55749f473c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:57436/0 (socket says 172.21.15.5:57436) 2024-08-31T05:43:29.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.251+0000 7f182259c640 1 -- 172.21.15.5:0/2507024177 learned_addr learned my addr 172.21.15.5:0/2507024177 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:29.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.251+0000 7f1819d9b640 1 --2- 172.21.15.5:0/2507024177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55749f08f390 0x55749f474190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:29.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.251+0000 7f1822d9d640 1 -- 172.21.15.5:0/2507024177 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55749f0871b0 msgr2=0x55749f473c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:29.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.251+0000 7f1822d9d640 1 --2- 172.21.15.5:0/2507024177 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55749f0871b0 0x55749f473c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:29.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.251+0000 7f1822d9d640 1 -- 172.21.15.5:0/2507024177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55749f08f390 msgr2=0x55749f474190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:29.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.251+0000 7f1822d9d640 1 --2- 172.21.15.5:0/2507024177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55749f08f390 0x55749f474190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:29.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.251+0000 7f1822d9d640 1 -- 172.21.15.5:0/2507024177 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55749f4dc3c0 con 0x55749f0b0070 2024-08-31T05:43:29.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.251+0000 7f1819d9b640 1 --2- 172.21.15.5:0/2507024177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55749f08f390 0x55749f474190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:43:29.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.251+0000 7f1822d9d640 1 --2- 172.21.15.5:0/2507024177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55749f0b0070 0x55749f4746d0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f181c006010 tx=0x7f181c0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c12b7a11162d2c3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:29.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.251+0000 7f1809ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:43:29.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.252+0000 7f1809ffb640 1 -- 172.21.15.5:0/2507024177 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f181c058060 con 0x55749f0b0070 2024-08-31T05:43:29.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.252+0000 7f1809ffb640 1 -- 172.21.15.5:0/2507024177 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9511+0+0 (secure 0 0 0) 0x7f181c004040 con 0x55749f0b0070 2024-08-31T05:43:29.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.252+0000 7f182ee05740 1 -- 172.21.15.5:0/2507024177 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18140ac130 con 0x55749f0b0070 2024-08-31T05:43:29.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.252+0000 7f1809ffb640 1 -- 172.21.15.5:0/2507024177 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f181c05f050 con 0x55749f0b0070 2024-08-31T05:43:29.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.252+0000 7f182ee05740 10 client.19170 fetch_fsmap learned FSMap version 36 2024-08-31T05:43:29.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.252+0000 7f182ee05740 1 -- 172.21.15.5:0/2507024177 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55749f4dd650 con 0x55749f0b0070 2024-08-31T05:43:29.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.252+0000 7f1809ffb640 1 -- 172.21.15.5:0/2507024177 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18140ac130 con 0x55749f0b0070 2024-08-31T05:43:29.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.252+0000 7f1809ffb640 1 -- 172.21.15.5:0/2507024177 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 36) ==== 8386+0+0 (secure 0 0 0) 0x7f181c02fb50 con 0x55749f0b0070 2024-08-31T05:43:29.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.252+0000 7f182ee05740 10 client.19170 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T05:43:29.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.252+0000 7f182ee05740 10 client.19170 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-31T05:43:29.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.252+0000 7f182ee05740 20 client.19170 populate_metadata read hostname 'smithi005' 2024-08-31T05:43:29.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.252+0000 7f182ee05740 1 --2- 172.21.15.5:0/2507024177 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55749f043da0 0x55749f4dfe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:29.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.252+0000 7f182ee05740 4 client.19170 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:43:29.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.252+0000 7f182ee05740 1 -- 172.21.15.5:0/2507024177 --> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55749f3ca070 con 0x55749f043da0 2024-08-31T05:43:29.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.253+0000 7f182259c640 1 --2- 172.21.15.5:0/2507024177 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55749f043da0 0x55749f4dfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:29.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.253+0000 7f182259c640 1 --2- 172.21.15.5:0/2507024177 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55749f043da0 0x55749f4dfe40 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=24d6cb47901d0241 server_cookie=63688c2c3bf4b6ee in_seq=0 out_seq=0 2024-08-31T05:43:29.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.253+0000 7f1809ffb640 10 client.19170 ms_handle_connect on v2:172.21.15.50:6838/98200944 2024-08-31T05:43:29.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.253+0000 7f1809ffb640 1 -- 172.21.15.5:0/2507024177 <== mds.1 v2:172.21.15.50:6838/98200944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55749f3ca070 con 0x55749f043da0 2024-08-31T05:43:29.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.253+0000 7f1809ffb640 10 client.19170 handle_command_reply: tid=0 2024-08-31T05:43:29.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.253+0000 7f182ee05740 1 client.19170 shutdown 2024-08-31T05:43:29.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.253+0000 7f182ee05740 1 -- 172.21.15.5:0/2507024177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55749f0b0070 msgr2=0x55749f4746d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:29.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.253+0000 7f182ee05740 1 --2- 172.21.15.5:0/2507024177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55749f0b0070 0x55749f4746d0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f181c006010 tx=0x7f181c0095c0 comp rx=0 tx=0).stop 2024-08-31T05:43:29.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.254+0000 7f182ee05740 1 -- 172.21.15.5:0/2507024177 shutdown_connections 2024-08-31T05:43:29.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.254+0000 7f182ee05740 1 --2- 172.21.15.5:0/2507024177 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x55749f043da0 0x55749f4dfe40 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:29.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.254+0000 7f182ee05740 1 --2- 172.21.15.5:0/2507024177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55749f0b0070 0x55749f4746d0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:29.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.254+0000 7f182ee05740 1 --2- 172.21.15.5:0/2507024177 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55749f08f390 0x55749f474190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:29.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.254+0000 7f182ee05740 1 --2- 172.21.15.5:0/2507024177 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55749f0871b0 0x55749f473c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:29.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.254+0000 7f182ee05740 1 -- 172.21.15.5:0/2507024177 >> 172.21.15.5:0/2507024177 conn(0x55749f0a4460 msgr2=0x55749f461e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:29.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.254+0000 7f1809ffb640 0 client.19170 ms_handle_reset on v2:172.21.15.50:6838/98200944 2024-08-31T05:43:29.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.254+0000 7f182ee05740 1 -- 172.21.15.5:0/2507024177 shutdown_connections 2024-08-31T05:43:29.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.254+0000 7f182ee05740 1 -- 172.21.15.5:0/2507024177 wait complete. 2024-08-31T05:43:29.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.254+0000 7f182ee05740 20 client.19170 trim_cache size 0 max 16384 2024-08-31T05:43:29.261 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:43:29.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.255+0000 7f1828890640 1 -- 172.21.15.5:0/3643553108 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f18100b4ca0 msgr2=0x7f18100b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:29.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.255+0000 7f1828890640 1 --2- 172.21.15.5:0/3643553108 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f18100b4ca0 0x7f18100b71b0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f181c02f500 tx=0x7f181c02f490 comp rx=0 tx=0).stop 2024-08-31T05:43:29.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.255+0000 7f1828890640 1 -- 172.21.15.5:0/3643553108 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1824102880 msgr2=0x7f182419a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:29.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.255+0000 7f1828890640 1 --2- 172.21.15.5:0/3643553108 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1824102880 0x7f182419a1c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f181400e9f0 tx=0x7f181400edf0 comp rx=0 tx=0).stop 2024-08-31T05:43:29.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.255+0000 7f1828890640 1 -- 172.21.15.5:0/3643553108 shutdown_connections 2024-08-31T05:43:29.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.255+0000 7f1828890640 1 --2- 172.21.15.5:0/3643553108 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f18100b4ca0 0x7f18100b71b0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:29.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.255+0000 7f1828890640 1 --2- 172.21.15.5:0/3643553108 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1824108ac0 0x7f182419fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:29.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.255+0000 7f1828890640 1 --2- 172.21.15.5:0/3643553108 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1824108170 0x7f182419a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:29.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.255+0000 7f1828890640 1 --2- 172.21.15.5:0/3643553108 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1824102880 0x7f182419a1c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:29.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.255+0000 7f1828890640 1 -- 172.21.15.5:0/3643553108 >> 172.21.15.5:0/3643553108 conn(0x7f1824079500 msgr2=0x7f1824101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:29.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.255+0000 7f1828890640 1 -- 172.21.15.5:0/3643553108 shutdown_connections 2024-08-31T05:43:29.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:29.256+0000 7f1828890640 1 -- 172.21.15.5:0/3643553108 wait complete. 2024-08-31T05:43:29.267 INFO:tasks.workunit.client.0.smithi005.stdout: 10 6558 32.10 MB/sec warmup 16 sec latency 2451.760 ms 2024-08-31T05:43:29.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:28 smithi070 ceph-mon[22316]: pgmap v764: 129 pgs: 129 active+clean; 760 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 18 MiB/s wr, 379 op/s 2024-08-31T05:43:29.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:28 smithi050 ceph-mon[22146]: pgmap v764: 129 pgs: 129 active+clean; 760 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 18 MiB/s wr, 379 op/s 2024-08-31T05:43:30.249 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T05:43:30.267 INFO:tasks.workunit.client.0.smithi005.stdout: 10 7154 32.92 MB/sec warmup 17 sec latency 3451.788 ms 2024-08-31T05:43:30.547 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:43:31.007 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.005+0000 7fb9392de640 1 -- 172.21.15.5:0/1700116895 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb934102df0 msgr2=0x7fb934107310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:31.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.005+0000 7fb9392de640 1 --2- 172.21.15.5:0/1700116895 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb934102df0 0x7fb934107310 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7fb924009860 tx=0x7fb92402a360 comp rx=0 tx=0).stop 2024-08-31T05:43:31.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.006+0000 7fb9392de640 1 -- 172.21.15.5:0/1700116895 shutdown_connections 2024-08-31T05:43:31.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.006+0000 7fb9392de640 1 --2- 172.21.15.5:0/1700116895 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb934107960 0x7fb934107dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.006+0000 7fb9392de640 1 --2- 172.21.15.5:0/1700116895 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb934102df0 0x7fb934107310 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.006+0000 7fb9392de640 1 --2- 172.21.15.5:0/1700116895 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb9341024a0 0x7fb9341028b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.006+0000 7fb9392de640 1 -- 172.21.15.5:0/1700116895 >> 172.21.15.5:0/1700116895 conn(0x7fb9340fe160 msgr2=0x7fb9341005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:31.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.007+0000 7fb9392de640 1 -- 172.21.15.5:0/1700116895 shutdown_connections 2024-08-31T05:43:31.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.007+0000 7fb9392de640 1 -- 172.21.15.5:0/1700116895 wait complete. 2024-08-31T05:43:31.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.008+0000 7fb9392de640 1 Processor -- start 2024-08-31T05:43:31.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.008+0000 7fb9392de640 1 -- start start 2024-08-31T05:43:31.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.008+0000 7fb9392de640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9341024a0 0x7fb934108be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:31.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.008+0000 7fb9392de640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb934102df0 0x7fb934109160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:31.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.008+0000 7fb9392de640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb934107960 0x7fb93410e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:31.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.008+0000 7fb9392de640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb934119e30 con 0x7fb9341024a0 2024-08-31T05:43:31.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.008+0000 7fb9392de640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb934119cb0 con 0x7fb934102df0 2024-08-31T05:43:31.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.008+0000 7fb9392de640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb934119fb0 con 0x7fb934107960 2024-08-31T05:43:31.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.009+0000 7fb9337fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb934107960 0x7fb93410e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:31.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.009+0000 7fb9337fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb934107960 0x7fb93410e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:57440/0 (socket says 172.21.15.5:57440) 2024-08-31T05:43:31.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.009+0000 7fb9337fe640 1 -- 172.21.15.5:0/3612201809 learned_addr learned my addr 172.21.15.5:0/3612201809 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:31.012 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.009+0000 7fb932ffd640 1 --2- 172.21.15.5:0/3612201809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9341024a0 0x7fb934108be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:31.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.009+0000 7fb9337fe640 1 -- 172.21.15.5:0/3612201809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb934102df0 msgr2=0x7fb934109160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:31.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.009+0000 7fb9337fe640 1 --2- 172.21.15.5:0/3612201809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb934102df0 0x7fb934109160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.009+0000 7fb9337fe640 1 -- 172.21.15.5:0/3612201809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9341024a0 msgr2=0x7fb934108be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:31.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.009+0000 7fb9337fe640 1 --2- 172.21.15.5:0/3612201809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9341024a0 0x7fb934108be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.010+0000 7fb9337fe640 1 -- 172.21.15.5:0/3612201809 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb93410eaf0 con 0x7fb934107960 2024-08-31T05:43:31.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.010+0000 7fb932ffd640 1 --2- 172.21.15.5:0/3612201809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9341024a0 0x7fb934108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:43:31.013 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.010+0000 7fb9337fe640 1 --2- 172.21.15.5:0/3612201809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb934107960 0x7fb93410e410 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb92800b3f0 tx=0x7fb92800b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:31.016 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.012+0000 7fb91bfff640 1 -- 172.21.15.5:0/3612201809 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb928015020 con 0x7fb934107960 2024-08-31T05:43:31.016 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.012+0000 7fb91bfff640 1 -- 172.21.15.5:0/3612201809 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb928011ce0 con 0x7fb934107960 2024-08-31T05:43:31.016 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.012+0000 7fb91bfff640 1 -- 172.21.15.5:0/3612201809 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb928010d80 con 0x7fb934107960 2024-08-31T05:43:31.017 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.015+0000 7fb9392de640 1 -- 172.21.15.5:0/3612201809 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb93410ede0 con 0x7fb934107960 2024-08-31T05:43:31.017 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.015+0000 7fb9392de640 1 -- 172.21.15.5:0/3612201809 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb93410f580 con 0x7fb934107960 2024-08-31T05:43:31.020 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.019+0000 7fb940252740 1 Processor -- start 2024-08-31T05:43:31.021 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.019+0000 7fb91bfff640 1 -- 172.21.15.5:0/3612201809 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fb928018020 con 0x7fb934107960 2024-08-31T05:43:31.021 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.020+0000 7fb940252740 1 -- start start 2024-08-31T05:43:31.024 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.021+0000 7fb940252740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55969a2d31b0 0x55969a676ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:31.024 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.021+0000 7fb940252740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55969a2aa2f0 0x55969a677220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:31.024 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.021+0000 7fb9327fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55969a2d31b0 0x55969a676ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:31.024 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.021+0000 7fb9327fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55969a2d31b0 0x55969a676ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:51812/0 (socket says 172.21.15.5:51812) 2024-08-31T05:43:31.024 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.021+0000 7fb940252740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55969a2b24d0 0x55969a677760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:31.024 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.021+0000 7fb91bfff640 1 --2- 172.21.15.5:0/3612201809 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb91c0b4e30 0x7fb91c0b7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:31.024 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.021+0000 7fb9327fc640 1 -- 172.21.15.5:0/1441374440 learned_addr learned my addr 172.21.15.5:0/1441374440 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:31.024 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.021+0000 7fb940252740 1 -- 172.21.15.5:0/1441374440 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55969a5ec000 con 0x55969a2b24d0 2024-08-31T05:43:31.024 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.022+0000 7fb940252740 1 -- 172.21.15.5:0/1441374440 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55969a5db590 con 0x55969a2d31b0 2024-08-31T05:43:31.024 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.022+0000 7fb940252740 1 -- 172.21.15.5:0/1441374440 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55969a5df540 con 0x55969a2aa2f0 2024-08-31T05:43:31.025 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.022+0000 7fb91bfff640 1 -- 172.21.15.5:0/3612201809 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9511+0+0 (secure 0 0 0) 0x7fb9280e4f80 con 0x7fb934107960 2024-08-31T05:43:31.025 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.022+0000 7fb9337fe640 1 --2- 172.21.15.5:0/3612201809 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb91c0b4e30 0x7fb91c0b7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:31.025 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.022+0000 7fb9327fc640 1 -- 172.21.15.5:0/1441374440 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55969a2aa2f0 msgr2=0x55969a677220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T05:43:31.025 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.022+0000 7fb9327fc640 1 --2- 172.21.15.5:0/1441374440 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55969a2aa2f0 0x55969a677220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.025 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.022+0000 7fb9327fc640 1 -- 172.21.15.5:0/1441374440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55969a2b24d0 msgr2=0x55969a677760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:31.025 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.022+0000 7fb9327fc640 1 --2- 172.21.15.5:0/1441374440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55969a2b24d0 0x55969a677760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.026 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.022+0000 7fb9327fc640 1 -- 172.21.15.5:0/1441374440 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55969a33e790 con 0x55969a2d31b0 2024-08-31T05:43:31.026 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.022+0000 7fb9327fc640 1 --2- 172.21.15.5:0/1441374440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55969a2d31b0 0x55969a676ce0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb9240303f0 tx=0x7fb9240094e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=149687f9fb189309 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:31.026 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.023+0000 7fb9197fa640 1 -- 172.21.15.5:0/1441374440 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb924042070 con 0x55969a2d31b0 2024-08-31T05:43:31.026 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.023+0000 7fb9197fa640 1 -- 172.21.15.5:0/1441374440 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb924004040 con 0x55969a2d31b0 2024-08-31T05:43:31.026 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.023+0000 7fb9197fa640 1 -- 172.21.15.5:0/1441374440 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb924037030 con 0x55969a2d31b0 2024-08-31T05:43:31.027 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.024+0000 7fb9337fe640 1 --2- 172.21.15.5:0/3612201809 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb91c0b4e30 0x7fb91c0b7340 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb9280a7260 tx=0x7fb9280047d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:31.027 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.024+0000 7fb940252740 1 -- 172.21.15.5:0/1441374440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55969a2d31b0 msgr2=0x55969a676ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:31.027 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.024+0000 7fb940252740 1 --2- 172.21.15.5:0/1441374440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55969a2d31b0 0x55969a676ce0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb9240303f0 tx=0x7fb9240094e0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.027 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.024+0000 7fb940252740 1 -- 172.21.15.5:0/1441374440 shutdown_connections 2024-08-31T05:43:31.027 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.024+0000 7fb940252740 1 --2- 172.21.15.5:0/1441374440 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55969a2b24d0 0x55969a677760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.027 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.024+0000 7fb940252740 1 --2- 172.21.15.5:0/1441374440 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55969a2aa2f0 0x55969a677220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.028 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.024+0000 7fb940252740 1 --2- 172.21.15.5:0/1441374440 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55969a2d31b0 0x55969a676ce0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.028 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.024+0000 7fb940252740 1 -- 172.21.15.5:0/1441374440 >> 172.21.15.5:0/1441374440 conn(0x55969a2c7300 msgr2=0x55969a674bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:31.028 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.025+0000 7fb940252740 1 -- 172.21.15.5:0/1441374440 shutdown_connections 2024-08-31T05:43:31.028 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.025+0000 7fb940252740 1 -- 172.21.15.5:0/1441374440 wait complete. 2024-08-31T05:43:31.029 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.026+0000 7fb940252740 1 -- start start 2024-08-31T05:43:31.029 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.026+0000 7fb940252740 1 Processor -- start 2024-08-31T05:43:31.029 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.026+0000 7fb940252740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55969a2aa2f0 0x55969a682950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:31.029 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.026+0000 7fb940252740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55969a2b24d0 0x55969a682f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:31.029 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.026+0000 7fb940252740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55969a2d31b0 0x55969a6886f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:31.029 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.026+0000 7fb940252740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55969a514ab0 con 0x55969a2d31b0 2024-08-31T05:43:31.029 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.026+0000 7fb940252740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55969a562680 con 0x55969a2aa2f0 2024-08-31T05:43:31.029 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.026+0000 7fb940252740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55969a685400 con 0x55969a2b24d0 2024-08-31T05:43:31.029 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.026+0000 7fb940252740 10 client.0 _ll_register_callbacks cb 0x55969a2eaa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:43:31.030 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.027+0000 7fb9327fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55969a2aa2f0 0x55969a682950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:31.030 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.027+0000 7fb932ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55969a2b24d0 0x55969a682f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:31.030 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.027+0000 7fb9327fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55969a2aa2f0 0x55969a682950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:51818/0 (socket says 172.21.15.5:51818) 2024-08-31T05:43:31.030 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.027+0000 7fb9327fc640 1 -- 172.21.15.5:0/1350069165 learned_addr learned my addr 172.21.15.5:0/1350069165 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:31.030 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.027+0000 7fb9327fc640 1 --2- 172.21.15.5:0/1350069165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55969a2d31b0 0x55969a6886f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:31.030 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.027+0000 7fb9327fc640 1 -- 172.21.15.5:0/1350069165 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55969a2b24d0 msgr2=0x55969a682f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:31.030 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.027+0000 7fb9327fc640 1 --2- 172.21.15.5:0/1350069165 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55969a2b24d0 0x55969a682f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.030 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.027+0000 7fb9327fc640 1 -- 172.21.15.5:0/1350069165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55969a2d31b0 msgr2=0x55969a6886f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:31.030 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.027+0000 7fb9327fc640 1 --2- 172.21.15.5:0/1350069165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55969a2d31b0 0x55969a6886f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.030 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.027+0000 7fb9327fc640 1 -- 172.21.15.5:0/1350069165 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55969a3b7620 con 0x55969a2aa2f0 2024-08-31T05:43:31.031 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.027+0000 7fb932ffd640 1 --2- 172.21.15.5:0/1350069165 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55969a2b24d0 0x55969a682f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:43:31.032 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.029+0000 7fb9327fc640 1 --2- 172.21.15.5:0/1350069165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55969a2aa2f0 0x55969a682950 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb924030f90 tx=0x7fb924005850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e2054c9a0bcf57b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:31.032 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.029+0000 7fb916ff5640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:43:31.032 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.030+0000 7fb916ff5640 1 -- 172.21.15.5:0/1350069165 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb924037070 con 0x55969a2aa2f0 2024-08-31T05:43:31.032 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.030+0000 7fb916ff5640 1 -- 172.21.15.5:0/1350069165 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9511+0+0 (secure 0 0 0) 0x7fb924003a00 con 0x55969a2aa2f0 2024-08-31T05:43:31.032 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.030+0000 7fb940252740 1 -- 172.21.15.5:0/1350069165 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb924004040 con 0x55969a2aa2f0 2024-08-31T05:43:31.034 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.030+0000 7fb916ff5640 1 -- 172.21.15.5:0/1350069165 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fb924055050 con 0x55969a2aa2f0 2024-08-31T05:43:31.034 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.030+0000 7fb940252740 10 client.28748 fetch_fsmap learned FSMap version 36 2024-08-31T05:43:31.034 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.030+0000 7fb940252740 1 -- 172.21.15.5:0/1350069165 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55969a691570 con 0x55969a2aa2f0 2024-08-31T05:43:31.034 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.031+0000 7fb916ff5640 1 -- 172.21.15.5:0/1350069165 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb924043040 con 0x55969a2aa2f0 2024-08-31T05:43:31.034 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.031+0000 7fb916ff5640 1 -- 172.21.15.5:0/1350069165 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 36) ==== 8386+0+0 (secure 0 0 0) 0x7fb92403dc50 con 0x55969a2aa2f0 2024-08-31T05:43:31.034 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.031+0000 7fb940252740 10 client.28748 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T05:43:31.034 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.031+0000 7fb940252740 10 client.28748 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:43:31.034 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.031+0000 7fb940252740 20 client.28748 populate_metadata read hostname 'smithi005' 2024-08-31T05:43:31.034 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.031+0000 7fb940252740 1 --2- 172.21.15.5:0/1350069165 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55969a291d80 0x55969a6948d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:31.034 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.031+0000 7fb940252740 4 client.28748 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:43:31.035 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.031+0000 7fb940252740 1 -- 172.21.15.5:0/1350069165 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fb924004040 con 0x55969a291d80 2024-08-31T05:43:31.035 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.033+0000 7fb932ffd640 1 --2- 172.21.15.5:0/1350069165 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55969a291d80 0x55969a6948d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:31.035 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.033+0000 7fb932ffd640 1 --2- 172.21.15.5:0/1350069165 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55969a291d80 0x55969a6948d0 crc :-1 s=READY pgs=293 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92c8cb872e334c21 server_cookie=ee1d0cf9b20d3300 in_seq=0 out_seq=0 2024-08-31T05:43:31.035 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.033+0000 7fb916ff5640 10 client.28748 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:43:31.036 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.034+0000 7fb916ff5640 1 -- 172.21.15.5:0/1350069165 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fb924004040 con 0x55969a291d80 2024-08-31T05:43:31.036 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.034+0000 7fb916ff5640 10 client.28748 handle_command_reply: tid=0 2024-08-31T05:43:31.036 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.034+0000 7fb940252740 1 client.28748 shutdown 2024-08-31T05:43:31.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.034+0000 7fb940252740 1 -- 172.21.15.5:0/1350069165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55969a2aa2f0 msgr2=0x55969a682950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:31.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.034+0000 7fb940252740 1 --2- 172.21.15.5:0/1350069165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55969a2aa2f0 0x55969a682950 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb924030f90 tx=0x7fb924005850 comp rx=0 tx=0).stop 2024-08-31T05:43:31.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.034+0000 7fb940252740 1 -- 172.21.15.5:0/1350069165 shutdown_connections 2024-08-31T05:43:31.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.034+0000 7fb940252740 1 --2- 172.21.15.5:0/1350069165 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55969a291d80 0x55969a6948d0 crc :-1 s=READY pgs=293 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.034+0000 7fb940252740 1 --2- 172.21.15.5:0/1350069165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55969a2d31b0 0x55969a6886f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.034+0000 7fb940252740 1 --2- 172.21.15.5:0/1350069165 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55969a2b24d0 0x55969a682f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.034+0000 7fb940252740 1 --2- 172.21.15.5:0/1350069165 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55969a2aa2f0 0x55969a682950 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.034+0000 7fb940252740 1 -- 172.21.15.5:0/1350069165 >> 172.21.15.5:0/1350069165 conn(0x55969a2c7300 msgr2=0x55969a677d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:31.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.034+0000 7fb916ff5640 0 client.28748 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:43:31.038 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.035+0000 7fb940252740 1 -- 172.21.15.5:0/1350069165 shutdown_connections 2024-08-31T05:43:31.038 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.035+0000 7fb940252740 1 -- 172.21.15.5:0/1350069165 wait complete. 2024-08-31T05:43:31.038 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.035+0000 7fb940252740 20 client.28748 trim_cache size 0 max 16384 2024-08-31T05:43:31.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.049+0000 7fb940252740 1 Processor -- start 2024-08-31T05:43:31.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.049+0000 7fb940252740 1 -- start start 2024-08-31T05:43:31.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.050+0000 7fb940252740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55969a2aa2f0 0x55969a67c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:31.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.050+0000 7fb940252740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55969a2b24d0 0x55969a688660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:31.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.050+0000 7fb940252740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55969a2d31b0 0x55969a6743c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:31.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.050+0000 7fb940252740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb9341bfc20 con 0x55969a2b24d0 2024-08-31T05:43:31.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.050+0000 7fb940252740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb9341c1820 con 0x55969a2aa2f0 2024-08-31T05:43:31.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.050+0000 7fb940252740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb9341c02f0 con 0x55969a2d31b0 2024-08-31T05:43:31.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.050+0000 7fb932ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55969a2b24d0 0x55969a688660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:31.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.050+0000 7fb932ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55969a2b24d0 0x55969a688660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36092/0 (socket says 172.21.15.5:36092) 2024-08-31T05:43:31.052 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.050+0000 7fb932ffd640 1 -- 172.21.15.5:0/297616568 learned_addr learned my addr 172.21.15.5:0/297616568 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:31.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.050+0000 7fb9327fc640 1 --2- 172.21.15.5:0/297616568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55969a2aa2f0 0x55969a67c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:31.053 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.050+0000 7fb932ffd640 1 -- 172.21.15.5:0/297616568 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55969a2d31b0 msgr2=0x55969a6743c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:31.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.050+0000 7fb9327fc640 1 --2- 172.21.15.5:0/297616568 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55969a2d31b0 0x55969a6743c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:31.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.050+0000 7fb932ffd640 1 --2- 172.21.15.5:0/297616568 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55969a2d31b0 0x55969a6743c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.050+0000 7fb932ffd640 1 -- 172.21.15.5:0/297616568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55969a2aa2f0 msgr2=0x55969a67c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:31.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.050+0000 7fb932ffd640 1 --2- 172.21.15.5:0/297616568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55969a2aa2f0 0x55969a67c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.050+0000 7fb932ffd640 1 -- 172.21.15.5:0/297616568 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55969a672f60 con 0x55969a2b24d0 2024-08-31T05:43:31.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.050+0000 7fb9327fc640 1 --2- 172.21.15.5:0/297616568 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55969a2d31b0 0x55969a6743c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:43:31.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.051+0000 7fb932ffd640 1 --2- 172.21.15.5:0/297616568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55969a2b24d0 0x55969a688660 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fb93410f4a0 tx=0x7fb92c009660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b595be021d86ba07 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:31.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.051+0000 7fb918ff9640 1 -- 172.21.15.5:0/297616568 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb92c004ab0 con 0x55969a2b24d0 2024-08-31T05:43:31.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.051+0000 7fb918ff9640 1 -- 172.21.15.5:0/297616568 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb92c004c50 con 0x55969a2b24d0 2024-08-31T05:43:31.054 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.051+0000 7fb918ff9640 1 -- 172.21.15.5:0/297616568 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb92c005020 con 0x55969a2b24d0 2024-08-31T05:43:31.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.052+0000 7fb940252740 1 -- 172.21.15.5:0/297616568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55969a2b24d0 msgr2=0x55969a688660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:31.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.052+0000 7fb940252740 1 --2- 172.21.15.5:0/297616568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55969a2b24d0 0x55969a688660 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fb93410f4a0 tx=0x7fb92c009660 comp rx=0 tx=0).stop 2024-08-31T05:43:31.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.052+0000 7fb940252740 1 -- 172.21.15.5:0/297616568 shutdown_connections 2024-08-31T05:43:31.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.052+0000 7fb940252740 1 --2- 172.21.15.5:0/297616568 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55969a2d31b0 0x55969a6743c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.056 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.052+0000 7fb940252740 1 --2- 172.21.15.5:0/297616568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55969a2b24d0 0x55969a688660 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.057 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.052+0000 7fb940252740 1 --2- 172.21.15.5:0/297616568 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55969a2aa2f0 0x55969a67c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.057 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.052+0000 7fb940252740 1 -- 172.21.15.5:0/297616568 >> 172.21.15.5:0/297616568 conn(0x55969a2c7300 msgr2=0x55969a67bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:31.057 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.052+0000 7fb940252740 1 -- 172.21.15.5:0/297616568 shutdown_connections 2024-08-31T05:43:31.057 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.052+0000 7fb940252740 1 -- 172.21.15.5:0/297616568 wait complete. 2024-08-31T05:43:31.057 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.053+0000 7fb940252740 1 -- start start 2024-08-31T05:43:31.057 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.053+0000 7fb940252740 1 Processor -- start 2024-08-31T05:43:31.057 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.053+0000 7fb940252740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55969a2aa2f0 0x55969a6f7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:31.057 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.053+0000 7fb940252740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55969a2b24d0 0x55969a6f78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:31.057 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.053+0000 7fb940252740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55969a2d31b0 0x55969a68c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:31.057 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.053+0000 7fb940252740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb9341c1150 con 0x55969a2b24d0 2024-08-31T05:43:31.057 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.053+0000 7fb940252740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fb9341c0a80 con 0x55969a2aa2f0 2024-08-31T05:43:31.057 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.053+0000 7fb940252740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb9341bdc20 con 0x55969a2d31b0 2024-08-31T05:43:31.057 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.053+0000 7fb940252740 10 client.0 _ll_register_callbacks cb 0x7fb924040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:43:31.058 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.054+0000 7fb932ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55969a2b24d0 0x55969a6f78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:31.058 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.054+0000 7fb9327fc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55969a2aa2f0 0x55969a6f7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:31.058 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.054+0000 7fb932ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55969a2b24d0 0x55969a6f78e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36096/0 (socket says 172.21.15.5:36096) 2024-08-31T05:43:31.058 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.054+0000 7fb932ffd640 1 -- 172.21.15.5:0/425559959 learned_addr learned my addr 172.21.15.5:0/425559959 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:31.058 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.054+0000 7fb9327fc640 1 --2- 172.21.15.5:0/425559959 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55969a2d31b0 0x55969a68c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:31.058 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.054+0000 7fb932ffd640 1 -- 172.21.15.5:0/425559959 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55969a2d31b0 msgr2=0x55969a68c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:31.058 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.054+0000 7fb932ffd640 1 --2- 172.21.15.5:0/425559959 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55969a2d31b0 0x55969a68c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.058 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.054+0000 7fb932ffd640 1 -- 172.21.15.5:0/425559959 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55969a2aa2f0 msgr2=0x55969a6f7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:31.058 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.054+0000 7fb932ffd640 1 --2- 172.21.15.5:0/425559959 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55969a2aa2f0 0x55969a6f7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.058 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.054+0000 7fb932ffd640 1 -- 172.21.15.5:0/425559959 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55969a68c960 con 0x55969a2b24d0 2024-08-31T05:43:31.058 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.054+0000 7fb932ffd640 1 --2- 172.21.15.5:0/425559959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55969a2b24d0 0x55969a6f78e0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fb92c004550 tx=0x7fb92c004820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64b40ba23e00f25e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:31.058 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.054+0000 7fb916ff5640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:43:31.060 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.055+0000 7fb916ff5640 1 -- 172.21.15.5:0/425559959 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb92c01d040 con 0x55969a2b24d0 2024-08-31T05:43:31.060 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.055+0000 7fb916ff5640 1 -- 172.21.15.5:0/425559959 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9511+0+0 (secure 0 0 0) 0x7fb92c003c40 con 0x55969a2b24d0 2024-08-31T05:43:31.060 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.055+0000 7fb940252740 1 -- 172.21.15.5:0/425559959 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb92c004c50 con 0x55969a2b24d0 2024-08-31T05:43:31.060 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.055+0000 7fb916ff5640 1 -- 172.21.15.5:0/425559959 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fb92c037050 con 0x55969a2b24d0 2024-08-31T05:43:31.060 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.055+0000 7fb940252740 10 client.19182 fetch_fsmap learned FSMap version 36 2024-08-31T05:43:31.060 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.055+0000 7fb940252740 1 -- 172.21.15.5:0/425559959 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55969a6fe9d0 con 0x55969a2b24d0 2024-08-31T05:43:31.060 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.055+0000 7fb916ff5640 1 -- 172.21.15.5:0/425559959 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb92c004c50 con 0x55969a2b24d0 2024-08-31T05:43:31.060 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.055+0000 7fb916ff5640 1 -- 172.21.15.5:0/425559959 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 36) ==== 8386+0+0 (secure 0 0 0) 0x7fb92c00b040 con 0x55969a2b24d0 2024-08-31T05:43:31.060 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.055+0000 7fb940252740 10 client.19182 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T05:43:31.060 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.055+0000 7fb940252740 10 client.19182 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:43:31.061 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.055+0000 7fb940252740 20 client.19182 populate_metadata read hostname 'smithi005' 2024-08-31T05:43:31.061 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.055+0000 7fb940252740 1 --2- 172.21.15.5:0/425559959 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55969a2671c0 0x55969a7010e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:31.061 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.055+0000 7fb940252740 4 client.19182 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:43:31.061 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.055+0000 7fb940252740 1 -- 172.21.15.5:0/425559959 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55969a5edf50 con 0x55969a2671c0 2024-08-31T05:43:31.061 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.056+0000 7fb9327fc640 1 --2- 172.21.15.5:0/425559959 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55969a2671c0 0x55969a7010e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:31.061 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.056+0000 7fb916ff5640 10 client.19182 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:43:31.061 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.056+0000 7fb9327fc640 1 --2- 172.21.15.5:0/425559959 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55969a2671c0 0x55969a7010e0 crc :-1 s=READY pgs=294 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66e9906244679422 server_cookie=f98fd0f33b82d303 in_seq=0 out_seq=0 2024-08-31T05:43:31.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.142+0000 7fdf95d26640 1 -- 172.21.15.5:0/4274645640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf901081c0 msgr2=0x7fdf901085d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:31.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.142+0000 7fdf95d26640 1 --2- 172.21.15.5:0/4274645640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf901081c0 0x7fdf901085d0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fdf78009900 tx=0x7fdf7802a410 comp rx=0 tx=0).stop 2024-08-31T05:43:31.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.142+0000 7fdf95d26640 1 -- 172.21.15.5:0/4274645640 shutdown_connections 2024-08-31T05:43:31.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.142+0000 7fdf95d26640 1 --2- 172.21.15.5:0/4274645640 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf90108b10 0x7fdf9010f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.142+0000 7fdf95d26640 1 --2- 172.21.15.5:0/4274645640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf901081c0 0x7fdf901085d0 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.142+0000 7fdf95d26640 1 --2- 172.21.15.5:0/4274645640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf90102880 0x7fdf90102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.142+0000 7fdf95d26640 1 -- 172.21.15.5:0/4274645640 >> 172.21.15.5:0/4274645640 conn(0x7fdf90079510 msgr2=0x7fdf90079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:31.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.142+0000 7fdf95d26640 1 -- 172.21.15.5:0/4274645640 shutdown_connections 2024-08-31T05:43:31.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.142+0000 7fdf95d26640 1 -- 172.21.15.5:0/4274645640 wait complete. 2024-08-31T05:43:31.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.143+0000 7fdf95d26640 1 Processor -- start 2024-08-31T05:43:31.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.143+0000 7fdf95d26640 1 -- start start 2024-08-31T05:43:31.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.143+0000 7fdf95d26640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf90102880 0x7fdf9019a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:31.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.143+0000 7fdf95d26640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf901081c0 0x7fdf9019a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:31.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.143+0000 7fdf95d26640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf90108b10 0x7fdf9019fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:31.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.143+0000 7fdf95d26640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdf901127a0 con 0x7fdf90102880 2024-08-31T05:43:31.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.143+0000 7fdf95d26640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdf90112620 con 0x7fdf901081c0 2024-08-31T05:43:31.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.143+0000 7fdf95d26640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdf90112920 con 0x7fdf90108b10 2024-08-31T05:43:31.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.143+0000 7fdf8f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf90102880 0x7fdf9019a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:31.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.143+0000 7fdf8f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf90102880 0x7fdf9019a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36108/0 (socket says 172.21.15.5:36108) 2024-08-31T05:43:31.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.143+0000 7fdf8f7fe640 1 -- 172.21.15.5:0/1605703980 learned_addr learned my addr 172.21.15.5:0/1605703980 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:31.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.143+0000 7fdf8ffff640 1 --2- 172.21.15.5:0/1605703980 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf90108b10 0x7fdf9019fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:31.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.143+0000 7fdf87fff640 1 --2- 172.21.15.5:0/1605703980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf901081c0 0x7fdf9019a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:31.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.143+0000 7fdf8f7fe640 1 -- 172.21.15.5:0/1605703980 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf90108b10 msgr2=0x7fdf9019fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:31.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.143+0000 7fdf8f7fe640 1 --2- 172.21.15.5:0/1605703980 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf90108b10 0x7fdf9019fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.143+0000 7fdf8f7fe640 1 -- 172.21.15.5:0/1605703980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf901081c0 msgr2=0x7fdf9019a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:31.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.143+0000 7fdf8f7fe640 1 --2- 172.21.15.5:0/1605703980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf901081c0 0x7fdf9019a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.143+0000 7fdf8f7fe640 1 -- 172.21.15.5:0/1605703980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf901a0190 con 0x7fdf90102880 2024-08-31T05:43:31.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.143+0000 7fdf87fff640 1 --2- 172.21.15.5:0/1605703980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf901081c0 0x7fdf9019a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:43:31.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.144+0000 7fdf8f7fe640 1 --2- 172.21.15.5:0/1605703980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf90102880 0x7fdf9019a2e0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fdf8000c920 tx=0x7fdf8000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:31.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.144+0000 7fdf8d7fa640 1 -- 172.21.15.5:0/1605703980 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf80007c70 con 0x7fdf90102880 2024-08-31T05:43:31.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.144+0000 7fdf8d7fa640 1 -- 172.21.15.5:0/1605703980 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf80007e10 con 0x7fdf90102880 2024-08-31T05:43:31.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.144+0000 7fdf95d26640 1 -- 172.21.15.5:0/1605703980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf901a0480 con 0x7fdf90102880 2024-08-31T05:43:31.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.144+0000 7fdf8d7fa640 1 -- 172.21.15.5:0/1605703980 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf80018820 con 0x7fdf90102880 2024-08-31T05:43:31.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.144+0000 7fdf95d26640 1 -- 172.21.15.5:0/1605703980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf901a6ca0 con 0x7fdf90102880 2024-08-31T05:43:31.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.146+0000 7fdf9c29b740 1 Processor -- start 2024-08-31T05:43:31.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.146+0000 7fdf9c29b740 1 -- start start 2024-08-31T05:43:31.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.147+0000 7fdf8d7fa640 1 -- 172.21.15.5:0/1605703980 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fdf8000f450 con 0x7fdf90102880 2024-08-31T05:43:31.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.147+0000 7fdf9c29b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad433fe070 0x55ad437a3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:31.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.147+0000 7fdf9c29b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad433d51b0 0x55ad437a3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:31.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.147+0000 7fdf9c29b740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad433dd390 0x55ad437a3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:31.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.147+0000 7fdf9c29b740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55ad4371a680 con 0x55ad433dd390 2024-08-31T05:43:31.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.147+0000 7fdf9c29b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ad43709c10 con 0x55ad433d51b0 2024-08-31T05:43:31.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.147+0000 7fdf9c29b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ad4370dbc0 con 0x55ad433fe070 2024-08-31T05:43:31.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.147+0000 7fdf87fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad433dd390 0x55ad437a3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:31.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.147+0000 7fdf87fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad433dd390 0x55ad437a3d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36116/0 (socket says 172.21.15.5:36116) 2024-08-31T05:43:31.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.147+0000 7fdf87fff640 1 -- 172.21.15.5:0/1783338324 learned_addr learned my addr 172.21.15.5:0/1783338324 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:31.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.147+0000 7fdf8ffff640 1 --2- 172.21.15.5:0/1783338324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad433fe070 0x55ad437a3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:31.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.147+0000 7fdf8f7fe640 1 --2- 172.21.15.5:0/1783338324 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad433d51b0 0x55ad437a3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:31.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.147+0000 7fdf8ffff640 1 -- 172.21.15.5:0/1783338324 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad433d51b0 msgr2=0x55ad437a3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:31.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.147+0000 7fdf8ffff640 1 --2- 172.21.15.5:0/1783338324 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad433d51b0 0x55ad437a3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.147+0000 7fdf8ffff640 1 -- 172.21.15.5:0/1783338324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad433dd390 msgr2=0x55ad437a3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:31.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.147+0000 7fdf8ffff640 1 --2- 172.21.15.5:0/1783338324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad433dd390 0x55ad437a3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.147+0000 7fdf8ffff640 1 -- 172.21.15.5:0/1783338324 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad43469650 con 0x55ad433fe070 2024-08-31T05:43:31.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.147+0000 7fdf87fff640 1 --2- 172.21.15.5:0/1783338324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad433dd390 0x55ad437a3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:43:31.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.147+0000 7fdf8d7fa640 1 --2- 172.21.15.5:0/1605703980 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fdf7c0b4cd0 0x7fdf7c0b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:31.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.148+0000 7fdf8f7fe640 1 --2- 172.21.15.5:0/1605703980 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fdf7c0b4cd0 0x7fdf7c0b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:31.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.148+0000 7fdf8ffff640 1 --2- 172.21.15.5:0/1783338324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad433fe070 0x55ad437a3310 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fdf88009f00 tx=0x7fdf88011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcfc7ed4d5e6779d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:31.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.148+0000 7fdf8d7fa640 1 -- 172.21.15.5:0/1605703980 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9511+0+0 (secure 0 0 0) 0x7fdf800e5a40 con 0x7fdf90102880 2024-08-31T05:43:31.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.148+0000 7fdf85ffb640 1 -- 172.21.15.5:0/1783338324 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf88004d20 con 0x55ad433fe070 2024-08-31T05:43:31.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.148+0000 7fdf85ffb640 1 -- 172.21.15.5:0/1783338324 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf88004050 con 0x55ad433fe070 2024-08-31T05:43:31.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.148+0000 7fdf85ffb640 1 -- 172.21.15.5:0/1783338324 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf88005280 con 0x55ad433fe070 2024-08-31T05:43:31.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.149+0000 7fdf9c29b740 1 -- 172.21.15.5:0/1783338324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad433fe070 msgr2=0x55ad437a3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:31.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.149+0000 7fdf8f7fe640 1 --2- 172.21.15.5:0/1605703980 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fdf7c0b4cd0 0x7fdf7c0b71e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fdf800e2e60 tx=0x7fdf80093040 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:31.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.149+0000 7fdf9c29b740 1 --2- 172.21.15.5:0/1783338324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad433fe070 0x55ad437a3310 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fdf88009f00 tx=0x7fdf88011810 comp rx=0 tx=0).stop 2024-08-31T05:43:31.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.149+0000 7fdf9c29b740 1 -- 172.21.15.5:0/1783338324 shutdown_connections 2024-08-31T05:43:31.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.149+0000 7fdf9c29b740 1 --2- 172.21.15.5:0/1783338324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad433dd390 0x55ad437a3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.149+0000 7fdf9c29b740 1 --2- 172.21.15.5:0/1783338324 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad433d51b0 0x55ad437a3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.149+0000 7fdf9c29b740 1 --2- 172.21.15.5:0/1783338324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad433fe070 0x55ad437a3310 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.149+0000 7fdf9c29b740 1 -- 172.21.15.5:0/1783338324 >> 172.21.15.5:0/1783338324 conn(0x55ad433f2460 msgr2=0x55ad437a1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:31.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.149+0000 7fdf9c29b740 1 -- 172.21.15.5:0/1783338324 shutdown_connections 2024-08-31T05:43:31.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.149+0000 7fdf9c29b740 1 -- 172.21.15.5:0/1783338324 wait complete. 2024-08-31T05:43:31.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.149+0000 7fdf9c29b740 1 -- start start 2024-08-31T05:43:31.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.150+0000 7fdf9c29b740 1 Processor -- start 2024-08-31T05:43:31.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.150+0000 7fdf9c29b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad433d51b0 0x55ad437b2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:31.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.150+0000 7fdf9c29b740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad433dd390 0x55ad437b33e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:31.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.150+0000 7fdf9c29b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad433fe070 0x55ad437bf180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:31.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.150+0000 7fdf9c29b740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55ad4356c700 con 0x55ad433dd390 2024-08-31T05:43:31.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.150+0000 7fdf9c29b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ad43690750 con 0x55ad433fe070 2024-08-31T05:43:31.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.150+0000 7fdf9c29b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ad437b5e50 con 0x55ad433d51b0 2024-08-31T05:43:31.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.150+0000 7fdf9c29b740 10 client.0 _ll_register_callbacks cb 0x55ad436bfe10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:43:31.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.150+0000 7fdf87fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad433dd390 0x55ad437b33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:31.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.150+0000 7fdf87fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad433dd390 0x55ad437b33e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36126/0 (socket says 172.21.15.5:36126) 2024-08-31T05:43:31.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.150+0000 7fdf87fff640 1 -- 172.21.15.5:0/810803739 learned_addr learned my addr 172.21.15.5:0/810803739 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:31.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.150+0000 7fdf8ffff640 1 --2- 172.21.15.5:0/810803739 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad433d51b0 0x55ad437b2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:31.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.150+0000 7fdf8ffff640 1 --2- 172.21.15.5:0/810803739 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad433fe070 0x55ad437bf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:31.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.150+0000 7fdf87fff640 1 -- 172.21.15.5:0/810803739 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad433d51b0 msgr2=0x55ad437b2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:31.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.150+0000 7fdf87fff640 1 --2- 172.21.15.5:0/810803739 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad433d51b0 0x55ad437b2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.150+0000 7fdf87fff640 1 -- 172.21.15.5:0/810803739 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad433fe070 msgr2=0x55ad437bf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:31.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.150+0000 7fdf87fff640 1 --2- 172.21.15.5:0/810803739 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad433fe070 0x55ad437bf180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.150+0000 7fdf87fff640 1 -- 172.21.15.5:0/810803739 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad436c9900 con 0x55ad433dd390 2024-08-31T05:43:31.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.150+0000 7fdf8ffff640 1 --2- 172.21.15.5:0/810803739 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad433fe070 0x55ad437bf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:43:31.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.151+0000 7fdf87fff640 1 --2- 172.21.15.5:0/810803739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad433dd390 0x55ad437b33e0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fdf78009900 tx=0x7fdf780314a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acb42e529fcc59b0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:31.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.151+0000 7fdf6effd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:43:31.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.151+0000 7fdf6effd640 1 -- 172.21.15.5:0/810803739 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf78040070 con 0x55ad433dd390 2024-08-31T05:43:31.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.151+0000 7fdf9c29b740 1 -- 172.21.15.5:0/810803739 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf88004050 con 0x55ad433dd390 2024-08-31T05:43:31.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.151+0000 7fdf6effd640 1 -- 172.21.15.5:0/810803739 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9511+0+0 (secure 0 0 0) 0x7fdf78004240 con 0x55ad433dd390 2024-08-31T05:43:31.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.151+0000 7fdf6effd640 1 -- 172.21.15.5:0/810803739 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fdf7804d050 con 0x55ad433dd390 2024-08-31T05:43:31.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.151+0000 7fdf9c29b740 10 client.19194 fetch_fsmap learned FSMap version 36 2024-08-31T05:43:31.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.151+0000 7fdf9c29b740 1 -- 172.21.15.5:0/810803739 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55ad437c1c00 con 0x55ad433dd390 2024-08-31T05:43:31.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.151+0000 7fdf6effd640 1 -- 172.21.15.5:0/810803739 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf88004050 con 0x55ad433dd390 2024-08-31T05:43:31.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.151+0000 7fdf6effd640 1 -- 172.21.15.5:0/810803739 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 36) ==== 8386+0+0 (secure 0 0 0) 0x7fdf78004960 con 0x55ad433dd390 2024-08-31T05:43:31.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.151+0000 7fdf9c29b740 10 client.19194 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T05:43:31.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.151+0000 7fdf9c29b740 10 client.19194 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:43:31.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.151+0000 7fdf9c29b740 20 client.19194 populate_metadata read hostname 'smithi005' 2024-08-31T05:43:31.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.151+0000 7fdf9c29b740 1 --2- 172.21.15.5:0/810803739 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55ad433bc9f0 0x55ad437c50f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:31.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.151+0000 7fdf9c29b740 4 client.19194 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:43:31.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.152+0000 7fdf9c29b740 1 -- 172.21.15.5:0/810803739 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ad4371c5d0 con 0x55ad433bc9f0 2024-08-31T05:43:31.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.152+0000 7fdf8ffff640 1 --2- 172.21.15.5:0/810803739 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55ad433bc9f0 0x55ad437c50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:31.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.152+0000 7fdf6effd640 10 client.19194 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:43:31.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.152+0000 7fdf8ffff640 1 --2- 172.21.15.5:0/810803739 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55ad433bc9f0 0x55ad437c50f0 crc :-1 s=READY pgs=295 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7bf3e229a13e712 server_cookie=3b6a5bba19afb3a8 in_seq=0 out_seq=0 2024-08-31T05:43:31.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.153+0000 7fdf6effd640 1 -- 172.21.15.5:0/810803739 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ad4371c5d0 con 0x55ad433bc9f0 2024-08-31T05:43:31.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.153+0000 7fdf6effd640 10 client.19194 handle_command_reply: tid=0 2024-08-31T05:43:31.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.153+0000 7fdf9c29b740 1 client.19194 shutdown 2024-08-31T05:43:31.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.153+0000 7fdf9c29b740 1 -- 172.21.15.5:0/810803739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad433dd390 msgr2=0x55ad437b33e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:31.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.153+0000 7fdf9c29b740 1 --2- 172.21.15.5:0/810803739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad433dd390 0x55ad437b33e0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fdf78009900 tx=0x7fdf780314a0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.153+0000 7fdf9c29b740 1 -- 172.21.15.5:0/810803739 shutdown_connections 2024-08-31T05:43:31.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.153+0000 7fdf9c29b740 1 --2- 172.21.15.5:0/810803739 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55ad433bc9f0 0x55ad437c50f0 crc :-1 s=READY pgs=295 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.153+0000 7fdf9c29b740 1 --2- 172.21.15.5:0/810803739 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad433fe070 0x55ad437bf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.153+0000 7fdf9c29b740 1 --2- 172.21.15.5:0/810803739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad433dd390 0x55ad437b33e0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.153+0000 7fdf6effd640 0 client.19194 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:43:31.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.153+0000 7fdf9c29b740 1 --2- 172.21.15.5:0/810803739 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad433d51b0 0x55ad437b2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.153+0000 7fdf9c29b740 1 -- 172.21.15.5:0/810803739 >> 172.21.15.5:0/810803739 conn(0x55ad433f2460 msgr2=0x55ad437a4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:31.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.153+0000 7fdf9c29b740 1 -- 172.21.15.5:0/810803739 shutdown_connections 2024-08-31T05:43:31.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.153+0000 7fdf9c29b740 1 -- 172.21.15.5:0/810803739 wait complete. 2024-08-31T05:43:31.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.153+0000 7fdf9c29b740 20 client.19194 trim_cache size 0 max 16384 2024-08-31T05:43:31.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.167+0000 7fdf9c29b740 1 Processor -- start 2024-08-31T05:43:31.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.167+0000 7fdf9c29b740 1 -- start start 2024-08-31T05:43:31.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.167+0000 7fdf9c29b740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad433d51b0 0x55ad4379c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:31.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.167+0000 7fdf9c29b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad433dd390 0x55ad437b3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:31.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.167+0000 7fdf9c29b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad433fe070 0x55ad437bf080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:31.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.167+0000 7fdf9c29b740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdf901aeae0 con 0x55ad433d51b0 2024-08-31T05:43:31.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.167+0000 7fdf9c29b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdf901b06e0 con 0x55ad433fe070 2024-08-31T05:43:31.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.167+0000 7fdf9c29b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdf901af1b0 con 0x55ad433dd390 2024-08-31T05:43:31.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.167+0000 7fdf8ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad433d51b0 0x55ad4379c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:31.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.167+0000 7fdf8ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad433d51b0 0x55ad4379c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36128/0 (socket says 172.21.15.5:36128) 2024-08-31T05:43:31.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.167+0000 7fdf8ffff640 1 -- 172.21.15.5:0/2003219969 learned_addr learned my addr 172.21.15.5:0/2003219969 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:31.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.167+0000 7fdf8ffff640 1 --2- 172.21.15.5:0/2003219969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad433fe070 0x55ad437bf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:31.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.167+0000 7fdf87fff640 1 --2- 172.21.15.5:0/2003219969 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad433dd390 0x55ad437b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:31.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.167+0000 7fdf8ffff640 1 -- 172.21.15.5:0/2003219969 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad433dd390 msgr2=0x55ad437b3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:31.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.167+0000 7fdf8ffff640 1 --2- 172.21.15.5:0/2003219969 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad433dd390 0x55ad437b3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.167+0000 7fdf8ffff640 1 -- 172.21.15.5:0/2003219969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad433fe070 msgr2=0x55ad437bf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:31.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.167+0000 7fdf8ffff640 1 --2- 172.21.15.5:0/2003219969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad433fe070 0x55ad437bf080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.167+0000 7fdf8ffff640 1 -- 172.21.15.5:0/2003219969 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad437b1e00 con 0x55ad433d51b0 2024-08-31T05:43:31.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.168+0000 7fdf8ffff640 1 --2- 172.21.15.5:0/2003219969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad433d51b0 0x55ad4379c230 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fdf8801b040 tx=0x7fdf88004990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72d699210265e494 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:31.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.168+0000 7fdf857fa640 1 -- 172.21.15.5:0/2003219969 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf88034070 con 0x55ad433d51b0 2024-08-31T05:43:31.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.168+0000 7fdf857fa640 1 -- 172.21.15.5:0/2003219969 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf88028450 con 0x55ad433d51b0 2024-08-31T05:43:31.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.168+0000 7fdf857fa640 1 -- 172.21.15.5:0/2003219969 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf8802c070 con 0x55ad433d51b0 2024-08-31T05:43:31.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.168+0000 7fdf9c29b740 1 -- 172.21.15.5:0/2003219969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad433d51b0 msgr2=0x55ad4379c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:31.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.168+0000 7fdf9c29b740 1 --2- 172.21.15.5:0/2003219969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad433d51b0 0x55ad4379c230 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fdf8801b040 tx=0x7fdf88004990 comp rx=0 tx=0).stop 2024-08-31T05:43:31.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.169+0000 7fdf9c29b740 1 -- 172.21.15.5:0/2003219969 shutdown_connections 2024-08-31T05:43:31.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.169+0000 7fdf9c29b740 1 --2- 172.21.15.5:0/2003219969 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad433fe070 0x55ad437bf080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.169+0000 7fdf9c29b740 1 --2- 172.21.15.5:0/2003219969 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad433dd390 0x55ad437b3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.169+0000 7fdf9c29b740 1 --2- 172.21.15.5:0/2003219969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad433d51b0 0x55ad4379c230 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.169+0000 7fdf9c29b740 1 -- 172.21.15.5:0/2003219969 >> 172.21.15.5:0/2003219969 conn(0x55ad433f2460 msgr2=0x55ad437b2c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:31.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.169+0000 7fdf9c29b740 1 -- 172.21.15.5:0/2003219969 shutdown_connections 2024-08-31T05:43:31.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.169+0000 7fdf9c29b740 1 -- 172.21.15.5:0/2003219969 wait complete. 2024-08-31T05:43:31.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.169+0000 7fdf9c29b740 1 -- start start 2024-08-31T05:43:31.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.169+0000 7fdf9c29b740 1 Processor -- start 2024-08-31T05:43:31.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.169+0000 7fdf9c29b740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad433d51b0 0x55ad437b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:31.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.170+0000 7fdf9c29b740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad433dd390 0x55ad437b7d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:31.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.170+0000 7fdf9c29b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad433fe070 0x55ad4382ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:31.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.170+0000 7fdf9c29b740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdf901b0010 con 0x55ad433d51b0 2024-08-31T05:43:31.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.170+0000 7fdf9c29b740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdf901af940 con 0x55ad433dd390 2024-08-31T05:43:31.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.170+0000 7fdf9c29b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdf901acae0 con 0x55ad433fe070 2024-08-31T05:43:31.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.170+0000 7fdf8ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad433d51b0 0x55ad437b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:31.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.170+0000 7fdf9c29b740 10 client.0 _ll_register_callbacks cb 0x7fdf78009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:43:31.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.170+0000 7fdf8ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad433d51b0 0x55ad437b77f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36134/0 (socket says 172.21.15.5:36134) 2024-08-31T05:43:31.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.170+0000 7fdf8ffff640 1 -- 172.21.15.5:0/1128062356 learned_addr learned my addr 172.21.15.5:0/1128062356 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:31.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.170+0000 7fdf87fff640 1 --2- 172.21.15.5:0/1128062356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad433dd390 0x55ad437b7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:31.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.170+0000 7fdf8ffff640 1 --2- 172.21.15.5:0/1128062356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad433fe070 0x55ad4382ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:31.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.170+0000 7fdf87fff640 1 -- 172.21.15.5:0/1128062356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad433fe070 msgr2=0x55ad4382ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:31.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.170+0000 7fdf87fff640 1 --2- 172.21.15.5:0/1128062356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad433fe070 0x55ad4382ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.170+0000 7fdf87fff640 1 -- 172.21.15.5:0/1128062356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad433d51b0 msgr2=0x55ad437b77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:31.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.170+0000 7fdf87fff640 1 --2- 172.21.15.5:0/1128062356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad433d51b0 0x55ad437b77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.170+0000 7fdf87fff640 1 -- 172.21.15.5:0/1128062356 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad4382efd0 con 0x55ad433dd390 2024-08-31T05:43:31.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.170+0000 7fdf8ffff640 1 --2- 172.21.15.5:0/1128062356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad433d51b0 0x55ad437b77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:43:31.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.170+0000 7fdf87fff640 1 --2- 172.21.15.5:0/1128062356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad433dd390 0x55ad437b7d30 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fdf78004e80 tx=0x7fdf78031a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8059b46f016f110 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:31.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.170+0000 7fdf6effd640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:43:31.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.171+0000 7fdf6effd640 1 -- 172.21.15.5:0/1128062356 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf78040070 con 0x55ad433dd390 2024-08-31T05:43:31.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.171+0000 7fdf6effd640 1 -- 172.21.15.5:0/1128062356 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9511+0+0 (secure 0 0 0) 0x7fdf780046c0 con 0x55ad433dd390 2024-08-31T05:43:31.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.171+0000 7fdf9c29b740 1 -- 172.21.15.5:0/1128062356 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf88028450 con 0x55ad433dd390 2024-08-31T05:43:31.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.171+0000 7fdf6effd640 1 -- 172.21.15.5:0/1128062356 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fdf7805e050 con 0x55ad433dd390 2024-08-31T05:43:31.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.171+0000 7fdf9c29b740 10 client.28766 fetch_fsmap learned FSMap version 36 2024-08-31T05:43:31.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.171+0000 7fdf9c29b740 1 -- 172.21.15.5:0/1128062356 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55ad43830250 con 0x55ad433dd390 2024-08-31T05:43:31.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.171+0000 7fdf6effd640 1 -- 172.21.15.5:0/1128062356 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf88028450 con 0x55ad433dd390 2024-08-31T05:43:31.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.172+0000 7fdf6effd640 1 -- 172.21.15.5:0/1128062356 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 36) ==== 8386+0+0 (secure 0 0 0) 0x7fdf7803c440 con 0x55ad433dd390 2024-08-31T05:43:31.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.172+0000 7fdf9c29b740 10 client.28766 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T05:43:31.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.172+0000 7fdf9c29b740 10 client.28766 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:43:31.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.172+0000 7fdf9c29b740 20 client.28766 populate_metadata read hostname 'smithi005' 2024-08-31T05:43:31.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.172+0000 7fdf9c29b740 1 --2- 172.21.15.5:0/1128062356 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55ad43391da0 0x55ad43832940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:31.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.172+0000 7fdf9c29b740 4 client.28766 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:43:31.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.172+0000 7fdf9c29b740 1 -- 172.21.15.5:0/1128062356 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ad43718070 con 0x55ad43391da0 2024-08-31T05:43:31.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.179+0000 7fdf8ffff640 1 --2- 172.21.15.5:0/1128062356 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55ad43391da0 0x55ad43832940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:31.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.182+0000 7fdf8ffff640 1 --2- 172.21.15.5:0/1128062356 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55ad43391da0 0x55ad43832940 crc :-1 s=READY pgs=296 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=faef6d760e3cd9a4 server_cookie=f020b25124b6c6dc in_seq=0 out_seq=0 2024-08-31T05:43:31.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.182+0000 7fdf6effd640 10 client.28766 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:43:31.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.203+0000 7fdf6effd640 1 -- 172.21.15.5:0/1128062356 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ad43718070 con 0x55ad43391da0 2024-08-31T05:43:31.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.203+0000 7fdf6effd640 10 client.28766 handle_command_reply: tid=0 2024-08-31T05:43:31.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.203+0000 7fdf9c29b740 1 client.28766 shutdown 2024-08-31T05:43:31.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.203+0000 7fdf9c29b740 1 -- 172.21.15.5:0/1128062356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad433dd390 msgr2=0x55ad437b7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:31.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.204+0000 7fdf9c29b740 1 --2- 172.21.15.5:0/1128062356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad433dd390 0x55ad437b7d30 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fdf78004e80 tx=0x7fdf78031a50 comp rx=0 tx=0).stop 2024-08-31T05:43:31.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.205+0000 7fdf9c29b740 1 -- 172.21.15.5:0/1128062356 shutdown_connections 2024-08-31T05:43:31.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.205+0000 7fdf9c29b740 1 --2- 172.21.15.5:0/1128062356 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55ad43391da0 0x55ad43832940 crc :-1 s=READY pgs=296 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.205+0000 7fdf9c29b740 1 --2- 172.21.15.5:0/1128062356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad433fe070 0x55ad4382ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.205+0000 7fdf9c29b740 1 --2- 172.21.15.5:0/1128062356 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ad433dd390 0x55ad437b7d30 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.205+0000 7fdf9c29b740 1 --2- 172.21.15.5:0/1128062356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ad433d51b0 0x55ad437b77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.205+0000 7fdf9c29b740 1 -- 172.21.15.5:0/1128062356 >> 172.21.15.5:0/1128062356 conn(0x55ad433f2460 msgr2=0x55ad437a09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:31.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.205+0000 7fdf6effd640 0 client.28766 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:43:31.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.206+0000 7fdf9c29b740 1 -- 172.21.15.5:0/1128062356 shutdown_connections 2024-08-31T05:43:31.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.207+0000 7fdf9c29b740 1 -- 172.21.15.5:0/1128062356 wait complete. 2024-08-31T05:43:31.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.207+0000 7fdf9c29b740 20 client.28766 trim_cache size 0 max 16384 2024-08-31T05:43:31.210 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:43:31.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.208+0000 7fdf95d26640 1 -- 172.21.15.5:0/1605703980 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fdf7c0b4cd0 msgr2=0x7fdf7c0b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:31.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.208+0000 7fdf95d26640 1 --2- 172.21.15.5:0/1605703980 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fdf7c0b4cd0 0x7fdf7c0b71e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fdf800e2e60 tx=0x7fdf80093040 comp rx=0 tx=0).stop 2024-08-31T05:43:31.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.208+0000 7fdf95d26640 1 -- 172.21.15.5:0/1605703980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf90102880 msgr2=0x7fdf9019a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:31.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.208+0000 7fdf95d26640 1 --2- 172.21.15.5:0/1605703980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf90102880 0x7fdf9019a2e0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fdf8000c920 tx=0x7fdf8000cde0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.208+0000 7fdf95d26640 1 -- 172.21.15.5:0/1605703980 shutdown_connections 2024-08-31T05:43:31.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.208+0000 7fdf95d26640 1 --2- 172.21.15.5:0/1605703980 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fdf7c0b4cd0 0x7fdf7c0b71e0 secure :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fdf800e2e60 tx=0x7fdf80093040 comp rx=0 tx=0).stop 2024-08-31T05:43:31.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.208+0000 7fdf95d26640 1 --2- 172.21.15.5:0/1605703980 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf90108b10 0x7fdf9019fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.208+0000 7fdf95d26640 1 --2- 172.21.15.5:0/1605703980 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdf901081c0 0x7fdf9019a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.208+0000 7fdf95d26640 1 --2- 172.21.15.5:0/1605703980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf90102880 0x7fdf9019a2e0 secure :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fdf8000c920 tx=0x7fdf8000cde0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.208+0000 7fdf95d26640 1 -- 172.21.15.5:0/1605703980 >> 172.21.15.5:0/1605703980 conn(0x7fdf90079510 msgr2=0x7fdf90101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:31.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.209+0000 7fdf95d26640 1 -- 172.21.15.5:0/1605703980 shutdown_connections 2024-08-31T05:43:31.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:31.210+0000 7fdf95d26640 1 -- 172.21.15.5:0/1605703980 wait complete. 2024-08-31T05:43:31.234 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:30 smithi005 ceph-mon[18602]: pgmap v765: 129 pgs: 129 active+clean; 771 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 17 MiB/s wr, 460 op/s 2024-08-31T05:43:31.267 INFO:tasks.workunit.client.0.smithi005.stdout: 10 7546 32.72 MB/sec warmup 18 sec latency 4451.819 ms 2024-08-31T05:43:31.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:30 smithi070 ceph-mon[22316]: pgmap v765: 129 pgs: 129 active+clean; 771 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 17 MiB/s wr, 460 op/s 2024-08-31T05:43:31.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:30 smithi050 ceph-mon[22146]: pgmap v765: 129 pgs: 129 active+clean; 771 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 17 MiB/s wr, 460 op/s 2024-08-31T05:43:31.443 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.440+0000 7fb916ff5640 1 -- 172.21.15.5:0/425559959 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55969a5edf50 con 0x55969a2671c0 2024-08-31T05:43:31.443 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.440+0000 7fb916ff5640 10 client.19182 handle_command_reply: tid=0 2024-08-31T05:43:31.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.440+0000 7fb940252740 1 client.19182 shutdown 2024-08-31T05:43:31.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.440+0000 7fb940252740 1 -- 172.21.15.5:0/425559959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55969a2b24d0 msgr2=0x55969a6f78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:31.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.440+0000 7fb940252740 1 --2- 172.21.15.5:0/425559959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55969a2b24d0 0x55969a6f78e0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fb92c004550 tx=0x7fb92c004820 comp rx=0 tx=0).stop 2024-08-31T05:43:31.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.441+0000 7fb940252740 1 -- 172.21.15.5:0/425559959 shutdown_connections 2024-08-31T05:43:31.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.441+0000 7fb940252740 1 --2- 172.21.15.5:0/425559959 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55969a2671c0 0x55969a7010e0 crc :-1 s=READY pgs=294 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.441+0000 7fb916ff5640 0 client.19182 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:43:31.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.441+0000 7fb940252740 1 --2- 172.21.15.5:0/425559959 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55969a2d31b0 0x55969a68c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.441+0000 7fb940252740 1 --2- 172.21.15.5:0/425559959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55969a2b24d0 0x55969a6f78e0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.441+0000 7fb940252740 1 --2- 172.21.15.5:0/425559959 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55969a2aa2f0 0x55969a6f7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.441+0000 7fb940252740 1 -- 172.21.15.5:0/425559959 >> 172.21.15.5:0/425559959 conn(0x55969a2c7300 msgr2=0x55969a6743c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:31.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.441+0000 7fb940252740 1 -- 172.21.15.5:0/425559959 shutdown_connections 2024-08-31T05:43:31.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.441+0000 7fb940252740 1 -- 172.21.15.5:0/425559959 wait complete. 2024-08-31T05:43:31.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.441+0000 7fb940252740 20 client.19182 trim_cache size 0 max 16384 2024-08-31T05:43:31.445 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:43:31.445 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:43:31.445 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:43:31.445 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:43:31.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.442+0000 7fb9392de640 1 -- 172.21.15.5:0/3612201809 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb91c0b4e30 msgr2=0x7fb91c0b7340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:31.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.442+0000 7fb9392de640 1 --2- 172.21.15.5:0/3612201809 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb91c0b4e30 0x7fb91c0b7340 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb9280a7260 tx=0x7fb9280047d0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.442+0000 7fb9392de640 1 -- 172.21.15.5:0/3612201809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb934107960 msgr2=0x7fb93410e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:31.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.442+0000 7fb9392de640 1 --2- 172.21.15.5:0/3612201809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb934107960 0x7fb93410e410 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb92800b3f0 tx=0x7fb92800b8b0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.442+0000 7fb9392de640 1 -- 172.21.15.5:0/3612201809 shutdown_connections 2024-08-31T05:43:31.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.442+0000 7fb9392de640 1 --2- 172.21.15.5:0/3612201809 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fb91c0b4e30 0x7fb91c0b7340 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.442+0000 7fb9392de640 1 --2- 172.21.15.5:0/3612201809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb934107960 0x7fb93410e410 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.442+0000 7fb9392de640 1 --2- 172.21.15.5:0/3612201809 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fb934102df0 0x7fb934109160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.442+0000 7fb9392de640 1 --2- 172.21.15.5:0/3612201809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb9341024a0 0x7fb934108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:31.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.442+0000 7fb9392de640 1 -- 172.21.15.5:0/3612201809 >> 172.21.15.5:0/3612201809 conn(0x7fb9340fe160 msgr2=0x7fb9341052e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:31.447 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.442+0000 7fb9392de640 1 -- 172.21.15.5:0/3612201809 shutdown_connections 2024-08-31T05:43:31.447 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:31.442+0000 7fb9392de640 1 -- 172.21.15.5:0/3612201809 wait complete. 2024-08-31T05:43:32.267 INFO:tasks.workunit.client.0.smithi005.stdout: 10 7873 31.97 MB/sec warmup 19 sec latency 4738.103 ms 2024-08-31T05:43:33.093 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T05:43:33.093 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T05:43:33.268 INFO:tasks.workunit.client.0.smithi005.stdout: 10 8238 31.18 MB/sec warmup 20 sec latency 1493.762 ms 2024-08-31T05:43:33.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:32 smithi070 ceph-mon[22316]: pgmap v766: 129 pgs: 129 active+clean; 773 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 3.9 MiB/s wr, 269 op/s 2024-08-31T05:43:33.375 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:43:33.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:32 smithi050 ceph-mon[22146]: pgmap v766: 129 pgs: 129 active+clean; 773 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 3.9 MiB/s wr, 269 op/s 2024-08-31T05:43:33.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:32 smithi005 ceph-mon[18602]: pgmap v766: 129 pgs: 129 active+clean; 773 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 3.9 MiB/s wr, 269 op/s 2024-08-31T05:43:34.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.201+0000 7f9677780640 1 -- 172.21.15.5:0/3101692076 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9670102800 msgr2=0x7f9670102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:34.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.201+0000 7f9677780640 1 --2- 172.21.15.5:0/3101692076 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9670102800 0x7f9670102c10 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f966c009ca0 tx=0x7f966c02a8c0 comp rx=0 tx=0).stop 2024-08-31T05:43:34.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.201+0000 7f9677780640 1 -- 172.21.15.5:0/3101692076 shutdown_connections 2024-08-31T05:43:34.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.201+0000 7f9677780640 1 --2- 172.21.15.5:0/3101692076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9670108a90 0x7f967010f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:34.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.201+0000 7f9677780640 1 --2- 172.21.15.5:0/3101692076 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9670108140 0x7f9670108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:34.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.201+0000 7f9677780640 1 --2- 172.21.15.5:0/3101692076 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9670102800 0x7f9670102c10 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:34.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.201+0000 7f9677780640 1 -- 172.21.15.5:0/3101692076 >> 172.21.15.5:0/3101692076 conn(0x7f96700794d0 msgr2=0x7f96700798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:34.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.201+0000 7f9677780640 1 -- 172.21.15.5:0/3101692076 shutdown_connections 2024-08-31T05:43:34.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.201+0000 7f9677780640 1 -- 172.21.15.5:0/3101692076 wait complete. 2024-08-31T05:43:34.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.202+0000 7f9677780640 1 Processor -- start 2024-08-31T05:43:34.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.202+0000 7f9677780640 1 -- start start 2024-08-31T05:43:34.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.202+0000 7f9677780640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9670102800 0x7f9670103ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:34.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.202+0000 7f9677780640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9670108140 0x7f9670104530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:34.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.202+0000 7f9677780640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9670108a90 0x7f9670104a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:34.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.202+0000 7f9677780640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f96701126f0 con 0x7f9670108a90 2024-08-31T05:43:34.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.202+0000 7f9677780640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f9670112570 con 0x7f9670108140 2024-08-31T05:43:34.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.202+0000 7f9677780640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9670112870 con 0x7f9670102800 2024-08-31T05:43:34.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.203+0000 7f9675d1d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9670108a90 0x7f9670104a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:34.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.203+0000 7f967551c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9670102800 0x7f9670103ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:34.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.203+0000 7f967551c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9670102800 0x7f9670103ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:34506/0 (socket says 172.21.15.5:34506) 2024-08-31T05:43:34.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.203+0000 7f967551c640 1 -- 172.21.15.5:0/1841009773 learned_addr learned my addr 172.21.15.5:0/1841009773 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:34.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.203+0000 7f9675d1d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9670108a90 0x7f9670104a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53000/0 (socket says 172.21.15.5:53000) 2024-08-31T05:43:34.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.203+0000 7f9674d1b640 1 --2- 172.21.15.5:0/1841009773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9670108140 0x7f9670104530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:34.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.203+0000 7f9675d1d640 1 -- 172.21.15.5:0/1841009773 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9670102800 msgr2=0x7f9670103ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:34.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.203+0000 7f9675d1d640 1 --2- 172.21.15.5:0/1841009773 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9670102800 0x7f9670103ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:34.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.203+0000 7f9675d1d640 1 -- 172.21.15.5:0/1841009773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9670108140 msgr2=0x7f9670104530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:34.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.203+0000 7f9675d1d640 1 --2- 172.21.15.5:0/1841009773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9670108140 0x7f9670104530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:34.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.203+0000 7f9675d1d640 1 -- 172.21.15.5:0/1841009773 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96701a84b0 con 0x7f9670108a90 2024-08-31T05:43:34.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.203+0000 7f9674d1b640 1 --2- 172.21.15.5:0/1841009773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9670108140 0x7f9670104530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:43:34.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.203+0000 7f9675d1d640 1 --2- 172.21.15.5:0/1841009773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9670108a90 0x7f9670104a70 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f966800e970 tx=0x7f966800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:34.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.203+0000 7f96667fc640 1 -- 172.21.15.5:0/1841009773 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f966800ccc0 con 0x7f9670108a90 2024-08-31T05:43:34.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.203+0000 7f96667fc640 1 -- 172.21.15.5:0/1841009773 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9668005020 con 0x7f9670108a90 2024-08-31T05:43:34.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.203+0000 7f9677780640 1 -- 172.21.15.5:0/1841009773 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96701a87a0 con 0x7f9670108a90 2024-08-31T05:43:34.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.203+0000 7f96667fc640 1 -- 172.21.15.5:0/1841009773 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9668004a00 con 0x7f9670108a90 2024-08-31T05:43:34.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.203+0000 7f9677780640 1 -- 172.21.15.5:0/1841009773 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96701a8ce0 con 0x7f9670108a90 2024-08-31T05:43:34.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.206+0000 7f967dcf5740 1 Processor -- start 2024-08-31T05:43:34.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.207+0000 7f96667fc640 1 -- 172.21.15.5:0/1841009773 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f9668004ba0 con 0x7f9670108a90 2024-08-31T05:43:34.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.207+0000 7f967dcf5740 1 -- start start 2024-08-31T05:43:34.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.207+0000 7f967dcf5740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5632f2f09350 0x5632f32af780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:34.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.207+0000 7f967dcf5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5632f2ee0490 0x5632f32afcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:34.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.207+0000 7f967dcf5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5632f2ee8670 0x5632f32b0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:34.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.207+0000 7f967dcf5740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5632f32255f0 con 0x5632f2f09350 2024-08-31T05:43:34.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.207+0000 7f967dcf5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5632f3214b80 con 0x5632f2ee0490 2024-08-31T05:43:34.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.207+0000 7f967dcf5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5632f3218b30 con 0x5632f2ee8670 2024-08-31T05:43:34.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.207+0000 7f9674d1b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5632f2f09350 0x5632f32af780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:34.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.207+0000 7f967551c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5632f2ee0490 0x5632f32afcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:34.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.207+0000 7f967551c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5632f2ee0490 0x5632f32afcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:39558/0 (socket says 172.21.15.5:39558) 2024-08-31T05:43:34.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.207+0000 7f967551c640 1 -- 172.21.15.5:0/444053095 learned_addr learned my addr 172.21.15.5:0/444053095 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:34.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.207+0000 7f9674d1b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5632f2f09350 0x5632f32af780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53016/0 (socket says 172.21.15.5:53016) 2024-08-31T05:43:34.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.207+0000 7f9674d1b640 1 --2- 172.21.15.5:0/444053095 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5632f2ee8670 0x5632f32b0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:34.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.208+0000 7f96667fc640 1 --2- 172.21.15.5:0/1841009773 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f965c0b4d20 0x7f965c0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:34.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.208+0000 7f967551c640 1 -- 172.21.15.5:0/444053095 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5632f2ee8670 msgr2=0x5632f32b0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:34.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.208+0000 7f967551c640 1 --2- 172.21.15.5:0/444053095 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5632f2ee8670 0x5632f32b0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:34.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.208+0000 7f967551c640 1 -- 172.21.15.5:0/444053095 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5632f2f09350 msgr2=0x5632f32af780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:34.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.208+0000 7f967551c640 1 --2- 172.21.15.5:0/444053095 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5632f2f09350 0x5632f32af780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:34.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.208+0000 7f967551c640 1 -- 172.21.15.5:0/444053095 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632f2f74930 con 0x5632f2ee0490 2024-08-31T05:43:34.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.208+0000 7f9674d1b640 1 --2- 172.21.15.5:0/444053095 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5632f2ee8670 0x5632f32b0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:43:34.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.208+0000 7f9675d1d640 1 --2- 172.21.15.5:0/1841009773 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f965c0b4d20 0x7f965c0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:34.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.208+0000 7f967551c640 1 --2- 172.21.15.5:0/444053095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5632f2ee0490 0x5632f32afcc0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f966c009470 tx=0x7f966c0094a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a98dd11c9512eac server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:34.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.208+0000 7f96667fc640 1 -- 172.21.15.5:0/1841009773 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9511+0+0 (secure 0 0 0) 0x7f96680e5880 con 0x7f9670108a90 2024-08-31T05:43:34.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.208+0000 7f965b7fe640 1 -- 172.21.15.5:0/444053095 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f966c031cf0 con 0x5632f2ee0490 2024-08-31T05:43:34.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.208+0000 7f965b7fe640 1 -- 172.21.15.5:0/444053095 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f966c036030 con 0x5632f2ee0490 2024-08-31T05:43:34.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.208+0000 7f965b7fe640 1 -- 172.21.15.5:0/444053095 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f966c0042a0 con 0x5632f2ee0490 2024-08-31T05:43:34.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.209+0000 7f967dcf5740 1 -- 172.21.15.5:0/444053095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5632f2ee0490 msgr2=0x5632f32afcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:34.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.209+0000 7f9675d1d640 1 --2- 172.21.15.5:0/1841009773 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f965c0b4d20 0x7f965c0b7230 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f96680abb20 tx=0x7f96680ab960 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:34.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.209+0000 7f967dcf5740 1 --2- 172.21.15.5:0/444053095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5632f2ee0490 0x5632f32afcc0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f966c009470 tx=0x7f966c0094a0 comp rx=0 tx=0).stop 2024-08-31T05:43:34.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.209+0000 7f967dcf5740 1 -- 172.21.15.5:0/444053095 shutdown_connections 2024-08-31T05:43:34.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.209+0000 7f967dcf5740 1 --2- 172.21.15.5:0/444053095 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5632f2ee8670 0x5632f32b0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:34.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.209+0000 7f967dcf5740 1 --2- 172.21.15.5:0/444053095 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5632f2ee0490 0x5632f32afcc0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:34.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.209+0000 7f967dcf5740 1 --2- 172.21.15.5:0/444053095 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5632f2f09350 0x5632f32af780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:34.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.209+0000 7f967dcf5740 1 -- 172.21.15.5:0/444053095 >> 172.21.15.5:0/444053095 conn(0x5632f2efd740 msgr2=0x5632f32ad670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:34.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.209+0000 7f967dcf5740 1 -- 172.21.15.5:0/444053095 shutdown_connections 2024-08-31T05:43:34.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.209+0000 7f967dcf5740 1 -- 172.21.15.5:0/444053095 wait complete. 2024-08-31T05:43:34.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.210+0000 7f967dcf5740 1 -- start start 2024-08-31T05:43:34.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.210+0000 7f967dcf5740 1 Processor -- start 2024-08-31T05:43:34.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.210+0000 7f967dcf5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5632f2ee0490 0x5632f32bb010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:34.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.210+0000 7f967dcf5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5632f2ee8670 0x5632f32bb550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:34.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.210+0000 7f967dcf5740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5632f2f09350 0x5632f32c7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:34.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.210+0000 7f967dcf5740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5632f3077890 con 0x5632f2f09350 2024-08-31T05:43:34.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.210+0000 7f967dcf5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5632f319b790 con 0x5632f2ee0490 2024-08-31T05:43:34.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.210+0000 7f967dcf5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5632f32bdd80 con 0x5632f2ee8670 2024-08-31T05:43:34.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.210+0000 7f967dcf5740 10 client.0 _ll_register_callbacks cb 0x5632f2f20ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:43:34.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.210+0000 7f9674d1b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5632f2f09350 0x5632f32c7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:34.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.210+0000 7f9674d1b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5632f2f09350 0x5632f32c7070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53022/0 (socket says 172.21.15.5:53022) 2024-08-31T05:43:34.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.210+0000 7f9674d1b640 1 -- 172.21.15.5:0/50760823 learned_addr learned my addr 172.21.15.5:0/50760823 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:34.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.210+0000 7f967551c640 1 --2- 172.21.15.5:0/50760823 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5632f2ee8670 0x5632f32bb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:34.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.210+0000 7f9674d1b640 1 --2- 172.21.15.5:0/50760823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5632f2ee0490 0x5632f32bb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:34.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.211+0000 7f9674d1b640 1 -- 172.21.15.5:0/50760823 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5632f2ee8670 msgr2=0x5632f32bb550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:34.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.211+0000 7f9674d1b640 1 --2- 172.21.15.5:0/50760823 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5632f2ee8670 0x5632f32bb550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:34.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.211+0000 7f9674d1b640 1 -- 172.21.15.5:0/50760823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5632f2f09350 msgr2=0x5632f32c7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:34.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.211+0000 7f9674d1b640 1 --2- 172.21.15.5:0/50760823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5632f2f09350 0x5632f32c7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:34.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.211+0000 7f9674d1b640 1 -- 172.21.15.5:0/50760823 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632f31d2f30 con 0x5632f2ee0490 2024-08-31T05:43:34.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.211+0000 7f9674d1b640 1 --2- 172.21.15.5:0/50760823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5632f2ee0490 0x5632f32bb010 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9660013e20 tx=0x7f9660009770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2713bbe064d8dbc7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:34.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.211+0000 7f9658ff9640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:43:34.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.211+0000 7f9658ff9640 1 -- 172.21.15.5:0/50760823 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9660005020 con 0x5632f2ee0490 2024-08-31T05:43:34.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.211+0000 7f967dcf5740 1 -- 172.21.15.5:0/50760823 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f966c036030 con 0x5632f2ee0490 2024-08-31T05:43:34.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.211+0000 7f9658ff9640 1 -- 172.21.15.5:0/50760823 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9511+0+0 (secure 0 0 0) 0x7f96600051c0 con 0x5632f2ee0490 2024-08-31T05:43:34.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.212+0000 7f9658ff9640 1 -- 172.21.15.5:0/50760823 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f96600053c0 con 0x5632f2ee0490 2024-08-31T05:43:34.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.212+0000 7f967dcf5740 10 client.28778 fetch_fsmap learned FSMap version 36 2024-08-31T05:43:34.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.212+0000 7f967dcf5740 1 -- 172.21.15.5:0/50760823 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5632f32c9c10 con 0x5632f2ee0490 2024-08-31T05:43:34.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.212+0000 7f9658ff9640 1 -- 172.21.15.5:0/50760823 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f966c036030 con 0x5632f2ee0490 2024-08-31T05:43:34.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.212+0000 7f9658ff9640 1 -- 172.21.15.5:0/50760823 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 36) ==== 8386+0+0 (secure 0 0 0) 0x7f96600224c0 con 0x5632f2ee0490 2024-08-31T05:43:34.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.212+0000 7f967dcf5740 10 client.28778 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T05:43:34.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.212+0000 7f967dcf5740 10 client.28778 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:43:34.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.212+0000 7f967dcf5740 20 client.28778 populate_metadata read hostname 'smithi005' 2024-08-31T05:43:34.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.212+0000 7f967dcf5740 1 --2- 172.21.15.5:0/50760823 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5632f2ec7cd0 0x5632f32cd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:34.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.212+0000 7f967dcf5740 4 client.28778 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:43:34.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.212+0000 7f967dcf5740 1 -- 172.21.15.5:0/50760823 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5632f3227540 con 0x5632f2ec7cd0 2024-08-31T05:43:34.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.212+0000 7f967551c640 1 --2- 172.21.15.5:0/50760823 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5632f2ec7cd0 0x5632f32cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:34.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.213+0000 7f967551c640 1 --2- 172.21.15.5:0/50760823 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5632f2ec7cd0 0x5632f32cd140 crc :-1 s=READY pgs=297 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5479c140b9177d0a server_cookie=e9e06862f04c97a7 in_seq=0 out_seq=0 2024-08-31T05:43:34.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.213+0000 7f9658ff9640 10 client.28778 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:43:34.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.213+0000 7f9658ff9640 1 -- 172.21.15.5:0/50760823 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5632f3227540 con 0x5632f2ec7cd0 2024-08-31T05:43:34.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.213+0000 7f9658ff9640 10 client.28778 handle_command_reply: tid=0 2024-08-31T05:43:34.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.213+0000 7f967dcf5740 1 client.28778 shutdown 2024-08-31T05:43:34.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.214+0000 7f967dcf5740 1 -- 172.21.15.5:0/50760823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5632f2ee0490 msgr2=0x5632f32bb010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:34.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.214+0000 7f967dcf5740 1 --2- 172.21.15.5:0/50760823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5632f2ee0490 0x5632f32bb010 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9660013e20 tx=0x7f9660009770 comp rx=0 tx=0).stop 2024-08-31T05:43:34.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.214+0000 7f967dcf5740 1 -- 172.21.15.5:0/50760823 shutdown_connections 2024-08-31T05:43:34.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.214+0000 7f967dcf5740 1 --2- 172.21.15.5:0/50760823 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5632f2ec7cd0 0x5632f32cd140 crc :-1 s=READY pgs=297 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:34.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.214+0000 7f967dcf5740 1 --2- 172.21.15.5:0/50760823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5632f2f09350 0x5632f32c7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:34.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.214+0000 7f967dcf5740 1 --2- 172.21.15.5:0/50760823 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5632f2ee8670 0x5632f32bb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:34.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.214+0000 7f967dcf5740 1 --2- 172.21.15.5:0/50760823 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5632f2ee0490 0x5632f32bb010 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:34.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.214+0000 7f967dcf5740 1 -- 172.21.15.5:0/50760823 >> 172.21.15.5:0/50760823 conn(0x5632f2efd740 msgr2=0x5632f32b2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:34.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.214+0000 7f9658ff9640 0 client.28778 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:43:34.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.214+0000 7f967dcf5740 1 -- 172.21.15.5:0/50760823 shutdown_connections 2024-08-31T05:43:34.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.214+0000 7f967dcf5740 1 -- 172.21.15.5:0/50760823 wait complete. 2024-08-31T05:43:34.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.214+0000 7f967dcf5740 20 client.28778 trim_cache size 0 max 16384 2024-08-31T05:43:34.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.233+0000 7f967dcf5740 1 Processor -- start 2024-08-31T05:43:34.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.233+0000 7f967dcf5740 1 -- start start 2024-08-31T05:43:34.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.233+0000 7f967dcf5740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5632f2ee0490 0x5632f32ad6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:34.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.233+0000 7f967dcf5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5632f2ee8670 0x5632f32c6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:34.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.233+0000 7f967dcf5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5632f2f09350 0x5632f32c74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:34.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.234+0000 7f967dcf5740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f96701b2e30 con 0x5632f2ee0490 2024-08-31T05:43:34.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.234+0000 7f967dcf5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f96701b4a30 con 0x5632f2ee8670 2024-08-31T05:43:34.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.234+0000 7f967dcf5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f96701b3500 con 0x5632f2f09350 2024-08-31T05:43:34.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.234+0000 7f9674d1b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5632f2ee0490 0x5632f32ad6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:34.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.234+0000 7f967551c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5632f2ee8670 0x5632f32c6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:34.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.234+0000 7f9674d1b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5632f2ee0490 0x5632f32ad6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53038/0 (socket says 172.21.15.5:53038) 2024-08-31T05:43:34.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.234+0000 7f9674d1b640 1 -- 172.21.15.5:0/2614243845 learned_addr learned my addr 172.21.15.5:0/2614243845 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:34.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.234+0000 7f9674d1b640 1 -- 172.21.15.5:0/2614243845 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5632f2f09350 msgr2=0x5632f32c74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:34.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.234+0000 7f9674d1b640 1 --2- 172.21.15.5:0/2614243845 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5632f2f09350 0x5632f32c74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:34.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.234+0000 7f9674d1b640 1 -- 172.21.15.5:0/2614243845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5632f2ee8670 msgr2=0x5632f32c6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:34.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.234+0000 7f9674d1b640 1 --2- 172.21.15.5:0/2614243845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5632f2ee8670 0x5632f32c6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:34.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.234+0000 7f9674d1b640 1 -- 172.21.15.5:0/2614243845 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632f32b1eb0 con 0x5632f2ee0490 2024-08-31T05:43:34.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.234+0000 7f9674d1b640 1 --2- 172.21.15.5:0/2614243845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5632f2ee0490 0x5632f32ad6e0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f9660022930 tx=0x7f9660009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af4037f7853694ff server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:34.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.234+0000 7f965affd640 1 -- 172.21.15.5:0/2614243845 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9660013540 con 0x5632f2ee0490 2024-08-31T05:43:34.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.235+0000 7f965affd640 1 -- 172.21.15.5:0/2614243845 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9660013ba0 con 0x5632f2ee0490 2024-08-31T05:43:34.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.235+0000 7f965affd640 1 -- 172.21.15.5:0/2614243845 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96600035f0 con 0x5632f2ee0490 2024-08-31T05:43:34.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.235+0000 7f967dcf5740 1 -- 172.21.15.5:0/2614243845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5632f2ee0490 msgr2=0x5632f32ad6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:34.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.235+0000 7f967dcf5740 1 --2- 172.21.15.5:0/2614243845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5632f2ee0490 0x5632f32ad6e0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f9660022930 tx=0x7f9660009310 comp rx=0 tx=0).stop 2024-08-31T05:43:34.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.236+0000 7f967dcf5740 1 -- 172.21.15.5:0/2614243845 shutdown_connections 2024-08-31T05:43:34.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.236+0000 7f967dcf5740 1 --2- 172.21.15.5:0/2614243845 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5632f2f09350 0x5632f32c74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:34.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.236+0000 7f967dcf5740 1 --2- 172.21.15.5:0/2614243845 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5632f2ee8670 0x5632f32c6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:34.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.236+0000 7f967dcf5740 1 --2- 172.21.15.5:0/2614243845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5632f2ee0490 0x5632f32ad6e0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:34.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.236+0000 7f967dcf5740 1 -- 172.21.15.5:0/2614243845 >> 172.21.15.5:0/2614243845 conn(0x5632f2efd740 msgr2=0x5632f32acfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:34.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.236+0000 7f967dcf5740 1 -- 172.21.15.5:0/2614243845 shutdown_connections 2024-08-31T05:43:34.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.236+0000 7f967dcf5740 1 -- 172.21.15.5:0/2614243845 wait complete. 2024-08-31T05:43:34.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.236+0000 7f967dcf5740 1 -- start start 2024-08-31T05:43:34.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.236+0000 7f967dcf5740 1 Processor -- start 2024-08-31T05:43:34.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.237+0000 7f967dcf5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5632f2ee0490 0x5632f32befa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:34.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.237+0000 7f967dcf5740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5632f2ee8670 0x5632f32bf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:34.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.237+0000 7f967dcf5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5632f2f09350 0x5632f32bfa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:34.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.237+0000 7f967dcf5740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f96701b4360 con 0x5632f2ee8670 2024-08-31T05:43:34.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.237+0000 7f967dcf5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f96701b3c90 con 0x5632f2f09350 2024-08-31T05:43:34.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.237+0000 7f967dcf5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f96701b0e30 con 0x5632f2ee0490 2024-08-31T05:43:34.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.237+0000 7f967dcf5740 10 client.0 _ll_register_callbacks cb 0x7f96600132d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:43:34.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.237+0000 7f967551c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5632f2ee8670 0x5632f32bf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:34.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.237+0000 7f9674d1b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5632f2ee0490 0x5632f32befa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:34.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.237+0000 7f967551c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5632f2ee8670 0x5632f32bf4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53050/0 (socket says 172.21.15.5:53050) 2024-08-31T05:43:34.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.237+0000 7f9674d1b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5632f2ee0490 0x5632f32befa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:34532/0 (socket says 172.21.15.5:34532) 2024-08-31T05:43:34.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.237+0000 7f967551c640 1 -- 172.21.15.5:0/3287349800 learned_addr learned my addr 172.21.15.5:0/3287349800 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:34.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.237+0000 7f9674d1b640 1 --2- 172.21.15.5:0/3287349800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5632f2f09350 0x5632f32bfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:34.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.237+0000 7f967551c640 1 -- 172.21.15.5:0/3287349800 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5632f2ee0490 msgr2=0x5632f32befa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:34.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.237+0000 7f967551c640 1 --2- 172.21.15.5:0/3287349800 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5632f2ee0490 0x5632f32befa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:34.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.237+0000 7f967551c640 1 -- 172.21.15.5:0/3287349800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5632f2f09350 msgr2=0x5632f32bfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:34.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.237+0000 7f967551c640 1 --2- 172.21.15.5:0/3287349800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5632f2f09350 0x5632f32bfa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:34.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.237+0000 7f967551c640 1 -- 172.21.15.5:0/3287349800 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632f3336ab0 con 0x5632f2ee8670 2024-08-31T05:43:34.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.237+0000 7f9674d1b640 1 --2- 172.21.15.5:0/3287349800 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5632f2ee0490 0x5632f32befa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:43:34.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.238+0000 7f967551c640 1 --2- 172.21.15.5:0/3287349800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5632f2ee8670 0x5632f32bf4e0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f966c02f470 tx=0x7f966c009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42320d63bf5313c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:34.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.238+0000 7f9658ff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:43:34.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.238+0000 7f9658ff9640 1 -- 172.21.15.5:0/3287349800 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f966c04a040 con 0x5632f2ee8670 2024-08-31T05:43:34.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.238+0000 7f9658ff9640 1 -- 172.21.15.5:0/3287349800 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9511+0+0 (secure 0 0 0) 0x7f966c031d70 con 0x5632f2ee8670 2024-08-31T05:43:34.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.238+0000 7f967dcf5740 1 -- 172.21.15.5:0/3287349800 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9660013ba0 con 0x5632f2ee8670 2024-08-31T05:43:34.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.238+0000 7f9658ff9640 1 -- 172.21.15.5:0/3287349800 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f966c031450 con 0x5632f2ee8670 2024-08-31T05:43:34.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.238+0000 7f967dcf5740 10 client.19218 fetch_fsmap learned FSMap version 36 2024-08-31T05:43:34.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.238+0000 7f967dcf5740 1 -- 172.21.15.5:0/3287349800 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5632f3337d10 con 0x5632f2ee8670 2024-08-31T05:43:34.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.239+0000 7f9658ff9640 1 -- 172.21.15.5:0/3287349800 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f966c036040 con 0x5632f2ee8670 2024-08-31T05:43:34.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.239+0000 7f9658ff9640 1 -- 172.21.15.5:0/3287349800 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 36) ==== 8386+0+0 (secure 0 0 0) 0x7f966c043070 con 0x5632f2ee8670 2024-08-31T05:43:34.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.239+0000 7f967dcf5740 10 client.19218 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T05:43:34.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.239+0000 7f967dcf5740 10 client.19218 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:43:34.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.239+0000 7f967dcf5740 20 client.19218 populate_metadata read hostname 'smithi005' 2024-08-31T05:43:34.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.239+0000 7f967dcf5740 1 --2- 172.21.15.5:0/3287349800 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5632f2e9d080 0x5632f333a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:34.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.239+0000 7f967dcf5740 4 client.19218 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T05:43:34.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.239+0000 7f967dcf5740 1 -- 172.21.15.5:0/3287349800 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f9660013ba0 con 0x5632f2e9d080 2024-08-31T05:43:34.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.239+0000 7f9674d1b640 1 --2- 172.21.15.5:0/3287349800 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5632f2e9d080 0x5632f333a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:34.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.240+0000 7f9658ff9640 10 client.19218 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:43:34.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.240+0000 7f9674d1b640 1 --2- 172.21.15.5:0/3287349800 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5632f2e9d080 0x5632f333a4d0 crc :-1 s=READY pgs=298 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ffdc6d8841c85b8b server_cookie=c8ca1f84f89189e5 in_seq=0 out_seq=0 2024-08-31T05:43:34.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.242+0000 7f9658ff9640 1 -- 172.21.15.5:0/3287349800 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f9660013ba0 con 0x5632f2e9d080 2024-08-31T05:43:34.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.242+0000 7f9658ff9640 10 client.19218 handle_command_reply: tid=0 2024-08-31T05:43:34.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.242+0000 7f967dcf5740 1 client.19218 shutdown 2024-08-31T05:43:34.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.243+0000 7f967dcf5740 1 -- 172.21.15.5:0/3287349800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5632f2ee8670 msgr2=0x5632f32bf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:34.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.243+0000 7f967dcf5740 1 --2- 172.21.15.5:0/3287349800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5632f2ee8670 0x5632f32bf4e0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f966c02f470 tx=0x7f966c009360 comp rx=0 tx=0).stop 2024-08-31T05:43:34.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.243+0000 7f967dcf5740 1 -- 172.21.15.5:0/3287349800 shutdown_connections 2024-08-31T05:43:34.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.243+0000 7f967dcf5740 1 --2- 172.21.15.5:0/3287349800 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x5632f2e9d080 0x5632f333a4d0 crc :-1 s=READY pgs=298 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:34.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.243+0000 7f967dcf5740 1 --2- 172.21.15.5:0/3287349800 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5632f2f09350 0x5632f32bfa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:34.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.243+0000 7f967dcf5740 1 --2- 172.21.15.5:0/3287349800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5632f2ee8670 0x5632f32bf4e0 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:34.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.243+0000 7f967dcf5740 1 --2- 172.21.15.5:0/3287349800 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5632f2ee0490 0x5632f32befa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:34.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.243+0000 7f967dcf5740 1 -- 172.21.15.5:0/3287349800 >> 172.21.15.5:0/3287349800 conn(0x5632f2efd740 msgr2=0x5632f32b2880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:34.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.243+0000 7f9658ff9640 0 client.19218 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:43:34.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.243+0000 7f967dcf5740 1 -- 172.21.15.5:0/3287349800 shutdown_connections 2024-08-31T05:43:34.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.243+0000 7f967dcf5740 1 -- 172.21.15.5:0/3287349800 wait complete. 2024-08-31T05:43:34.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.243+0000 7f967dcf5740 20 client.19218 trim_cache size 0 max 16384 2024-08-31T05:43:34.247 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:43:34.247 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-08-31T05:43:34.247 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "99e21ed4-9179-434d-86c5-36842066eafc", 2024-08-31T05:43:34.248 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-08-31T05:43:34.248 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:43:34.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.244+0000 7f9677780640 1 -- 172.21.15.5:0/1841009773 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f965c0b4d20 msgr2=0x7f965c0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:34.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.244+0000 7f9677780640 1 --2- 172.21.15.5:0/1841009773 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f965c0b4d20 0x7f965c0b7230 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f96680abb20 tx=0x7f96680ab960 comp rx=0 tx=0).stop 2024-08-31T05:43:34.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.244+0000 7f9677780640 1 -- 172.21.15.5:0/1841009773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9670108a90 msgr2=0x7f9670104a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:34.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.244+0000 7f9677780640 1 --2- 172.21.15.5:0/1841009773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9670108a90 0x7f9670104a70 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f966800e970 tx=0x7f966800ee30 comp rx=0 tx=0).stop 2024-08-31T05:43:34.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.244+0000 7f9677780640 1 -- 172.21.15.5:0/1841009773 shutdown_connections 2024-08-31T05:43:34.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.244+0000 7f9677780640 1 --2- 172.21.15.5:0/1841009773 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f965c0b4d20 0x7f965c0b7230 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:34.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.244+0000 7f9677780640 1 --2- 172.21.15.5:0/1841009773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9670108a90 0x7f9670104a70 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:34.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.244+0000 7f9677780640 1 --2- 172.21.15.5:0/1841009773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f9670108140 0x7f9670104530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:34.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.244+0000 7f9677780640 1 --2- 172.21.15.5:0/1841009773 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9670102800 0x7f9670103ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:34.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.244+0000 7f9677780640 1 -- 172.21.15.5:0/1841009773 >> 172.21.15.5:0/1841009773 conn(0x7f96700794d0 msgr2=0x7f9670101750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:34.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.244+0000 7f9677780640 1 -- 172.21.15.5:0/1841009773 shutdown_connections 2024-08-31T05:43:34.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:34.244+0000 7f9677780640 1 -- 172.21.15.5:0/1841009773 wait complete. 2024-08-31T05:43:34.267 INFO:tasks.workunit.client.0.smithi005.stdout: 10 8526 30.35 MB/sec warmup 21 sec latency 2493.791 ms 2024-08-31T05:43:35.078 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T05:43:35.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:35 smithi005 ceph-mon[18602]: pgmap v767: 129 pgs: 129 active+clean; 780 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 3.8 MiB/s wr, 300 op/s 2024-08-31T05:43:35.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:35 smithi005 ceph-mon[18602]: scrub queued for path: / 2024-08-31T05:43:35.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:35 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:43:35.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:35 smithi005 ceph-mon[18602]: scrub summary: active paths [/] 2024-08-31T05:43:35.110 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:35 smithi005 ceph-mon[18602]: scrub summary: active paths [/] 2024-08-31T05:43:35.112 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:35 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:43:35.112 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:35 smithi005 ceph-mon[18602]: scrub summary: active paths [/] 2024-08-31T05:43:35.112 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:35 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:43:35.112 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:35 smithi005 ceph-mon[18602]: scrub summary: active paths [/] 2024-08-31T05:43:35.112 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:35 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:43:35.112 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:35 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:43:35.112 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:35 smithi005 ceph-mon[18602]: scrub summary: active paths [/] 2024-08-31T05:43:35.113 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:35 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:43:35.267 INFO:tasks.workunit.client.0.smithi005.stdout: 10 8554 29.07 MB/sec warmup 22 sec latency 2798.152 ms 2024-08-31T05:43:35.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:35 smithi070 ceph-mon[22316]: pgmap v767: 129 pgs: 129 active+clean; 780 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 3.8 MiB/s wr, 300 op/s 2024-08-31T05:43:35.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:35 smithi070 ceph-mon[22316]: scrub queued for path: / 2024-08-31T05:43:35.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:35 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:43:35.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:35 smithi070 ceph-mon[22316]: scrub summary: active paths [/] 2024-08-31T05:43:35.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:35 smithi070 ceph-mon[22316]: scrub summary: active paths [/] 2024-08-31T05:43:35.337 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:35 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:43:35.337 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:35 smithi070 ceph-mon[22316]: scrub summary: active paths [/] 2024-08-31T05:43:35.337 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:35 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:43:35.337 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:35 smithi070 ceph-mon[22316]: scrub summary: active paths [/] 2024-08-31T05:43:35.337 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:35 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:43:35.337 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:35 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:43:35.337 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:35 smithi070 ceph-mon[22316]: scrub summary: active paths [/] 2024-08-31T05:43:35.337 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:35 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:43:35.406 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:43:35.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:35 smithi050 ceph-mon[22146]: pgmap v767: 129 pgs: 129 active+clean; 780 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 3.8 MiB/s wr, 300 op/s 2024-08-31T05:43:35.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:35 smithi050 ceph-mon[22146]: scrub queued for path: / 2024-08-31T05:43:35.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:35 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:43:35.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:35 smithi050 ceph-mon[22146]: scrub summary: active paths [/] 2024-08-31T05:43:35.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:35 smithi050 ceph-mon[22146]: scrub summary: active paths [/] 2024-08-31T05:43:35.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:35 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:43:35.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:35 smithi050 ceph-mon[22146]: scrub summary: active paths [/] 2024-08-31T05:43:35.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:35 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:43:35.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:35 smithi050 ceph-mon[22146]: scrub summary: active paths [/] 2024-08-31T05:43:35.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:35 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:43:35.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:35 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:43:35.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:35 smithi050 ceph-mon[22146]: scrub summary: active paths [/] 2024-08-31T05:43:35.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:35 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:43:36.267 INFO:tasks.workunit.client.0.smithi005.stdout: 10 8668 28.03 MB/sec warmup 23 sec latency 1235.539 ms 2024-08-31T05:43:36.278 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:36 smithi005 ceph-mon[18602]: scrub summary: active paths [/] 2024-08-31T05:43:36.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:36 smithi070 ceph-mon[22316]: scrub summary: active paths [/] 2024-08-31T05:43:36.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:36 smithi050 ceph-mon[22146]: scrub summary: active paths [/] 2024-08-31T05:43:36.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.539+0000 7f3914b13640 1 -- 172.21.15.5:0/4209892129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3910102870 msgr2=0x7f3910102c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:36.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.539+0000 7f3914b13640 1 --2- 172.21.15.5:0/4209892129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3910102870 0x7f3910102c80 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f3900009900 tx=0x7f390002a410 comp rx=0 tx=0).stop 2024-08-31T05:43:36.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.539+0000 7f3914b13640 1 -- 172.21.15.5:0/4209892129 shutdown_connections 2024-08-31T05:43:36.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.539+0000 7f3914b13640 1 --2- 172.21.15.5:0/4209892129 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3910108ab0 0x7f391010f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:36.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.539+0000 7f3914b13640 1 --2- 172.21.15.5:0/4209892129 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3910108160 0x7f3910108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:36.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.539+0000 7f3914b13640 1 --2- 172.21.15.5:0/4209892129 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3910102870 0x7f3910102c80 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:36.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.539+0000 7f3914b13640 1 -- 172.21.15.5:0/4209892129 >> 172.21.15.5:0/4209892129 conn(0x7f3910079470 msgr2=0x7f3910079880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:36.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.539+0000 7f3914b13640 1 -- 172.21.15.5:0/4209892129 shutdown_connections 2024-08-31T05:43:36.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.539+0000 7f3914b13640 1 -- 172.21.15.5:0/4209892129 wait complete. 2024-08-31T05:43:36.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.540+0000 7f3914b13640 1 Processor -- start 2024-08-31T05:43:36.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.540+0000 7f3914b13640 1 -- start start 2024-08-31T05:43:36.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.540+0000 7f3914b13640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3910102870 0x7f391019c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:36.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.540+0000 7f3914b13640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3910108160 0x7f391019c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:36.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.540+0000 7f3914b13640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3910108ab0 0x7f39101a1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:36.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.540+0000 7f3914b13640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3910112760 con 0x7f3910108ab0 2024-08-31T05:43:36.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.540+0000 7f3914b13640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f39101125e0 con 0x7f3910108160 2024-08-31T05:43:36.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.540+0000 7f3914b13640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f39101128e0 con 0x7f3910102870 2024-08-31T05:43:36.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.540+0000 7f390e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3910102870 0x7f391019c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:36.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.540+0000 7f390ed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3910108ab0 0x7f39101a1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:36.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.540+0000 7f390dd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3910108160 0x7f391019c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:36.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.540+0000 7f390e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3910102870 0x7f391019c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:34542/0 (socket says 172.21.15.5:34542) 2024-08-31T05:43:36.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.540+0000 7f390dd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3910108160 0x7f391019c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:39612/0 (socket says 172.21.15.5:39612) 2024-08-31T05:43:36.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.540+0000 7f390e59c640 1 -- 172.21.15.5:0/537176141 learned_addr learned my addr 172.21.15.5:0/537176141 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:36.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.540+0000 7f390ed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3910108ab0 0x7f39101a1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53056/0 (socket says 172.21.15.5:53056) 2024-08-31T05:43:36.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.540+0000 7f390ed9d640 1 -- 172.21.15.5:0/537176141 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3910102870 msgr2=0x7f391019c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:36.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.540+0000 7f390ed9d640 1 --2- 172.21.15.5:0/537176141 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3910102870 0x7f391019c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:36.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.540+0000 7f390ed9d640 1 -- 172.21.15.5:0/537176141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3910108160 msgr2=0x7f391019c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:36.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.540+0000 7f390ed9d640 1 --2- 172.21.15.5:0/537176141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3910108160 0x7f391019c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:36.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.541+0000 7f390ed9d640 1 -- 172.21.15.5:0/537176141 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39101a23b0 con 0x7f3910108ab0 2024-08-31T05:43:36.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.541+0000 7f390dd9b640 1 --2- 172.21.15.5:0/537176141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3910108160 0x7f391019c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:43:36.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.541+0000 7f390ed9d640 1 --2- 172.21.15.5:0/537176141 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3910108ab0 0x7f39101a1c80 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f3908009fd0 tx=0x7f390800ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:36.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.541+0000 7f38ff7fe640 1 -- 172.21.15.5:0/537176141 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f390800ce20 con 0x7f3910108ab0 2024-08-31T05:43:36.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.541+0000 7f38ff7fe640 1 -- 172.21.15.5:0/537176141 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3908005020 con 0x7f3910108ab0 2024-08-31T05:43:36.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.541+0000 7f3914b13640 1 -- 172.21.15.5:0/537176141 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39101a26a0 con 0x7f3910108ab0 2024-08-31T05:43:36.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.541+0000 7f38ff7fe640 1 -- 172.21.15.5:0/537176141 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3908010690 con 0x7f3910108ab0 2024-08-31T05:43:36.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.541+0000 7f3914b13640 1 -- 172.21.15.5:0/537176141 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39101a8e00 con 0x7f3910108ab0 2024-08-31T05:43:36.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.544+0000 7f391b088740 1 Processor -- start 2024-08-31T05:43:36.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.544+0000 7f38ff7fe640 1 -- 172.21.15.5:0/537176141 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f3908010830 con 0x7f3910108ab0 2024-08-31T05:43:36.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.544+0000 7f391b088740 1 -- start start 2024-08-31T05:43:36.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.545+0000 7f391b088740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ffdc7bf070 0x55ffdcb642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:36.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.545+0000 7f391b088740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ffdc7961b0 0x55ffdcb64800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:36.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.545+0000 7f391b088740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffdc79e390 0x55ffdcb64d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:36.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.545+0000 7f391b088740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55ffdcadb630 con 0x55ffdc7961b0 2024-08-31T05:43:36.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.545+0000 7f391b088740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ffdcacabc0 con 0x55ffdc7bf070 2024-08-31T05:43:36.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.545+0000 7f391b088740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ffdcaceb70 con 0x55ffdc79e390 2024-08-31T05:43:36.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.545+0000 7f390dd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ffdc7bf070 0x55ffdcb642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:36.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.545+0000 7f390e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ffdc7961b0 0x55ffdcb64800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:36.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.545+0000 7f390dd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ffdc7bf070 0x55ffdcb642c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:39614/0 (socket says 172.21.15.5:39614) 2024-08-31T05:43:36.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.545+0000 7f390dd9b640 1 -- 172.21.15.5:0/630766051 learned_addr learned my addr 172.21.15.5:0/630766051 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:36.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.545+0000 7f390dd9b640 1 --2- 172.21.15.5:0/630766051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffdc79e390 0x55ffdcb64d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:36.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.545+0000 7f38ff7fe640 1 --2- 172.21.15.5:0/537176141 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f38f80b4ca0 0x7f38f80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:36.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.545+0000 7f390dd9b640 1 -- 172.21.15.5:0/630766051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffdc79e390 msgr2=0x55ffdcb64d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:36.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.545+0000 7f390dd9b640 1 --2- 172.21.15.5:0/630766051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffdc79e390 0x55ffdcb64d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:36.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.546+0000 7f390dd9b640 1 -- 172.21.15.5:0/630766051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ffdc7961b0 msgr2=0x55ffdcb64800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:36.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.546+0000 7f390dd9b640 1 --2- 172.21.15.5:0/630766051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ffdc7961b0 0x55ffdcb64800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:36.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.546+0000 7f390dd9b640 1 -- 172.21.15.5:0/630766051 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffdc82a650 con 0x55ffdc7bf070 2024-08-31T05:43:36.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.546+0000 7f390dd9b640 1 --2- 172.21.15.5:0/630766051 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ffdc7bf070 0x55ffdcb642c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3904011b60 tx=0x7f3904005850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f070d36f3cf5527 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:36.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.546+0000 7f38ff7fe640 1 -- 172.21.15.5:0/537176141 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9511+0+0 (secure 0 0 0) 0x7f39080e5ff0 con 0x7f3910108ab0 2024-08-31T05:43:36.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.546+0000 7f390ed9d640 1 --2- 172.21.15.5:0/537176141 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f38f80b4ca0 0x7f38f80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:36.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.546+0000 7f38fcff9640 1 -- 172.21.15.5:0/630766051 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f390400fc50 con 0x55ffdc7bf070 2024-08-31T05:43:36.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.546+0000 7f38fcff9640 1 -- 172.21.15.5:0/630766051 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f390400fdf0 con 0x55ffdc7bf070 2024-08-31T05:43:36.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.546+0000 7f38fcff9640 1 -- 172.21.15.5:0/630766051 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39040038e0 con 0x55ffdc7bf070 2024-08-31T05:43:36.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.547+0000 7f390ed9d640 1 --2- 172.21.15.5:0/537176141 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f38f80b4ca0 0x7f38f80b71b0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f39080ac290 tx=0x7f390800c890 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:36.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.547+0000 7f391b088740 1 -- 172.21.15.5:0/630766051 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ffdc7bf070 msgr2=0x55ffdcb642c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:36.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.547+0000 7f391b088740 1 --2- 172.21.15.5:0/630766051 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ffdc7bf070 0x55ffdcb642c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3904011b60 tx=0x7f3904005850 comp rx=0 tx=0).stop 2024-08-31T05:43:36.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.547+0000 7f391b088740 1 -- 172.21.15.5:0/630766051 shutdown_connections 2024-08-31T05:43:36.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.547+0000 7f391b088740 1 --2- 172.21.15.5:0/630766051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffdc79e390 0x55ffdcb64d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:36.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.547+0000 7f391b088740 1 --2- 172.21.15.5:0/630766051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ffdc7961b0 0x55ffdcb64800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:36.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.547+0000 7f391b088740 1 --2- 172.21.15.5:0/630766051 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ffdc7bf070 0x55ffdcb642c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:36.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.548+0000 7f391b088740 1 -- 172.21.15.5:0/630766051 >> 172.21.15.5:0/630766051 conn(0x55ffdc7b3460 msgr2=0x55ffdcb621b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:36.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.548+0000 7f391b088740 1 -- 172.21.15.5:0/630766051 shutdown_connections 2024-08-31T05:43:36.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.548+0000 7f391b088740 1 -- 172.21.15.5:0/630766051 wait complete. 2024-08-31T05:43:36.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.549+0000 7f391b088740 1 -- start start 2024-08-31T05:43:36.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.549+0000 7f391b088740 1 Processor -- start 2024-08-31T05:43:36.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.549+0000 7f391b088740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffdc7961b0 0x55ffdcb6fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:36.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.549+0000 7f391b088740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ffdc79e390 0x55ffdcb6ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:36.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.549+0000 7f391b088740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ffdc7bf070 0x55ffdcb7bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:36.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.549+0000 7f391b088740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55ffdc92d700 con 0x55ffdc7bf070 2024-08-31T05:43:36.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.549+0000 7f391b088740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ffdca51700 con 0x55ffdc79e390 2024-08-31T05:43:36.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.549+0000 7f391b088740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ffdcb72aa0 con 0x55ffdc7961b0 2024-08-31T05:43:36.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.549+0000 7f390dd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ffdc7bf070 0x55ffdcb7bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:36.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.549+0000 7f390dd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ffdc7bf070 0x55ffdcb7bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53078/0 (socket says 172.21.15.5:53078) 2024-08-31T05:43:36.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.549+0000 7f390dd9b640 1 -- 172.21.15.5:0/2995945549 learned_addr learned my addr 172.21.15.5:0/2995945549 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:36.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.550+0000 7f390dd9b640 1 --2- 172.21.15.5:0/2995945549 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffdc7961b0 0x55ffdcb6fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:36.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.549+0000 7f391b088740 10 client.0 _ll_register_callbacks cb 0x55ffdca80dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:43:36.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.550+0000 7f390e59c640 1 --2- 172.21.15.5:0/2995945549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ffdc79e390 0x55ffdcb6ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:36.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.550+0000 7f390dd9b640 1 -- 172.21.15.5:0/2995945549 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffdc7961b0 msgr2=0x55ffdcb6fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:36.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.550+0000 7f390dd9b640 1 --2- 172.21.15.5:0/2995945549 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffdc7961b0 0x55ffdcb6fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:36.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.550+0000 7f390dd9b640 1 -- 172.21.15.5:0/2995945549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ffdc79e390 msgr2=0x55ffdcb6ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:36.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.550+0000 7f390dd9b640 1 --2- 172.21.15.5:0/2995945549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ffdc79e390 0x55ffdcb6ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:36.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.550+0000 7f390dd9b640 1 -- 172.21.15.5:0/2995945549 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffdca8a8b0 con 0x55ffdc7bf070 2024-08-31T05:43:36.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.550+0000 7f390dd9b640 1 --2- 172.21.15.5:0/2995945549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ffdc7bf070 0x55ffdcb7bdc0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f3904020900 tx=0x7f3904004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10f62ce56022bde4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:36.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.550+0000 7f38f5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:43:36.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.550+0000 7f38f5ffb640 1 -- 172.21.15.5:0/2995945549 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3904011050 con 0x55ffdc7bf070 2024-08-31T05:43:36.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.551+0000 7f38f5ffb640 1 -- 172.21.15.5:0/2995945549 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9511+0+0 (secure 0 0 0) 0x7f39040111f0 con 0x55ffdc7bf070 2024-08-31T05:43:36.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.551+0000 7f391b088740 1 -- 172.21.15.5:0/2995945549 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f390400fdf0 con 0x55ffdc7bf070 2024-08-31T05:43:36.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.551+0000 7f38f5ffb640 1 -- 172.21.15.5:0/2995945549 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f3904036050 con 0x55ffdc7bf070 2024-08-31T05:43:36.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.551+0000 7f391b088740 10 client.19230 fetch_fsmap learned FSMap version 36 2024-08-31T05:43:36.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.551+0000 7f391b088740 1 -- 172.21.15.5:0/2995945549 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55ffdcb7e840 con 0x55ffdc7bf070 2024-08-31T05:43:36.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.551+0000 7f38f5ffb640 1 -- 172.21.15.5:0/2995945549 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f390400fdf0 con 0x55ffdc7bf070 2024-08-31T05:43:36.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.551+0000 7f38f5ffb640 1 -- 172.21.15.5:0/2995945549 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 36) ==== 8386+0+0 (secure 0 0 0) 0x7f3904010980 con 0x55ffdc7bf070 2024-08-31T05:43:36.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.551+0000 7f391b088740 10 client.19230 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T05:43:36.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.551+0000 7f391b088740 10 client.19230 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:43:36.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.551+0000 7f391b088740 20 client.19230 populate_metadata read hostname 'smithi005' 2024-08-31T05:43:36.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.551+0000 7f391b088740 1 --2- 172.21.15.5:0/2995945549 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55ffdc77d9f0 0x55ffdcb81ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:36.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.551+0000 7f391b088740 4 client.19230 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:43:36.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.551+0000 7f391b088740 1 -- 172.21.15.5:0/2995945549 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ffdcadd580 con 0x55ffdc77d9f0 2024-08-31T05:43:36.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.551+0000 7f390e59c640 1 --2- 172.21.15.5:0/2995945549 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55ffdc77d9f0 0x55ffdcb81ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:36.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.552+0000 7f38f5ffb640 10 client.19230 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:43:36.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.552+0000 7f390e59c640 1 --2- 172.21.15.5:0/2995945549 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55ffdc77d9f0 0x55ffdcb81ba0 crc :-1 s=READY pgs=299 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=596bb23e7558e3e3 server_cookie=e3e32bb89f0dc8b9 in_seq=0 out_seq=0 2024-08-31T05:43:36.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.553+0000 7f38f5ffb640 1 -- 172.21.15.5:0/2995945549 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ffdcadd580 con 0x55ffdc77d9f0 2024-08-31T05:43:36.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.553+0000 7f38f5ffb640 10 client.19230 handle_command_reply: tid=0 2024-08-31T05:43:36.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.553+0000 7f391b088740 1 client.19230 shutdown 2024-08-31T05:43:36.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.553+0000 7f391b088740 1 -- 172.21.15.5:0/2995945549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ffdc7bf070 msgr2=0x55ffdcb7bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:36.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.553+0000 7f391b088740 1 --2- 172.21.15.5:0/2995945549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ffdc7bf070 0x55ffdcb7bdc0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f3904020900 tx=0x7f3904004610 comp rx=0 tx=0).stop 2024-08-31T05:43:36.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.554+0000 7f391b088740 1 -- 172.21.15.5:0/2995945549 shutdown_connections 2024-08-31T05:43:36.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.554+0000 7f391b088740 1 --2- 172.21.15.5:0/2995945549 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55ffdc77d9f0 0x55ffdcb81ba0 crc :-1 s=READY pgs=299 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:36.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.554+0000 7f391b088740 1 --2- 172.21.15.5:0/2995945549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ffdc7bf070 0x55ffdcb7bdc0 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:36.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.554+0000 7f38f5ffb640 0 client.19230 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:43:36.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.554+0000 7f391b088740 1 --2- 172.21.15.5:0/2995945549 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ffdc79e390 0x55ffdcb6ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:36.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.554+0000 7f391b088740 1 --2- 172.21.15.5:0/2995945549 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffdc7961b0 0x55ffdcb6fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:36.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.554+0000 7f391b088740 1 -- 172.21.15.5:0/2995945549 >> 172.21.15.5:0/2995945549 conn(0x55ffdc7b3460 msgr2=0x55ffdcb67450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:36.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.554+0000 7f391b088740 1 -- 172.21.15.5:0/2995945549 shutdown_connections 2024-08-31T05:43:36.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.554+0000 7f391b088740 1 -- 172.21.15.5:0/2995945549 wait complete. 2024-08-31T05:43:36.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.554+0000 7f391b088740 20 client.19230 trim_cache size 0 max 16384 2024-08-31T05:43:36.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.575+0000 7f391b088740 1 Processor -- start 2024-08-31T05:43:36.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.575+0000 7f391b088740 1 -- start start 2024-08-31T05:43:36.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.575+0000 7f391b088740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ffdc77d9f0 0x55ffdcb7bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:36.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.575+0000 7f391b088740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ffdc7961b0 0x55ffdcb673c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:36.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.575+0000 7f391b088740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffdc79e390 0x55ffdcb67900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:36.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.575+0000 7f391b088740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f39101b2e90 con 0x55ffdc7961b0 2024-08-31T05:43:36.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.575+0000 7f391b088740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f39101b4a90 con 0x55ffdc77d9f0 2024-08-31T05:43:36.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.575+0000 7f391b088740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f39101b3560 con 0x55ffdc79e390 2024-08-31T05:43:36.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.576+0000 7f390e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ffdc7961b0 0x55ffdcb673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:36.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.576+0000 7f390dd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ffdc77d9f0 0x55ffdcb7bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:36.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.576+0000 7f390dd9b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ffdc77d9f0 0x55ffdcb7bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:39632/0 (socket says 172.21.15.5:39632) 2024-08-31T05:43:36.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.576+0000 7f390dd9b640 1 -- 172.21.15.5:0/2834055784 learned_addr learned my addr 172.21.15.5:0/2834055784 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:36.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.576+0000 7f390e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ffdc7961b0 0x55ffdcb673c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53080/0 (socket says 172.21.15.5:53080) 2024-08-31T05:43:36.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.576+0000 7f390dd9b640 1 --2- 172.21.15.5:0/2834055784 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffdc79e390 0x55ffdcb67900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:36.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.576+0000 7f390dd9b640 1 -- 172.21.15.5:0/2834055784 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffdc79e390 msgr2=0x55ffdcb67900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:36.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.576+0000 7f390dd9b640 1 --2- 172.21.15.5:0/2834055784 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffdc79e390 0x55ffdcb67900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:36.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.576+0000 7f390dd9b640 1 -- 172.21.15.5:0/2834055784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ffdc7961b0 msgr2=0x55ffdcb673c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:36.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.576+0000 7f390dd9b640 1 --2- 172.21.15.5:0/2834055784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ffdc7961b0 0x55ffdcb673c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:36.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.576+0000 7f390dd9b640 1 -- 172.21.15.5:0/2834055784 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffdcb665b0 con 0x55ffdc77d9f0 2024-08-31T05:43:36.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.576+0000 7f390dd9b640 1 --2- 172.21.15.5:0/2834055784 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ffdc77d9f0 0x55ffdcb7bcc0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3904009730 tx=0x7f3904005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e51874413c929aeb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:36.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.577+0000 7f38f7fff640 1 -- 172.21.15.5:0/2834055784 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39040304b0 con 0x55ffdc77d9f0 2024-08-31T05:43:36.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.577+0000 7f38f7fff640 1 -- 172.21.15.5:0/2834055784 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f390400fcd0 con 0x55ffdc77d9f0 2024-08-31T05:43:36.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.577+0000 7f38f7fff640 1 -- 172.21.15.5:0/2834055784 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3904005280 con 0x55ffdc77d9f0 2024-08-31T05:43:36.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.578+0000 7f391b088740 1 -- 172.21.15.5:0/2834055784 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ffdc77d9f0 msgr2=0x55ffdcb7bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:36.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.578+0000 7f391b088740 1 --2- 172.21.15.5:0/2834055784 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ffdc77d9f0 0x55ffdcb7bcc0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3904009730 tx=0x7f3904005f90 comp rx=0 tx=0).stop 2024-08-31T05:43:36.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.578+0000 7f391b088740 1 -- 172.21.15.5:0/2834055784 shutdown_connections 2024-08-31T05:43:36.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.578+0000 7f391b088740 1 --2- 172.21.15.5:0/2834055784 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffdc79e390 0x55ffdcb67900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:36.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.578+0000 7f391b088740 1 --2- 172.21.15.5:0/2834055784 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ffdc7961b0 0x55ffdcb673c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:36.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.578+0000 7f391b088740 1 --2- 172.21.15.5:0/2834055784 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ffdc77d9f0 0x55ffdcb7bcc0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:36.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.578+0000 7f391b088740 1 -- 172.21.15.5:0/2834055784 >> 172.21.15.5:0/2834055784 conn(0x55ffdc7b3460 msgr2=0x55ffdcb6e2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:36.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.578+0000 7f391b088740 1 -- 172.21.15.5:0/2834055784 shutdown_connections 2024-08-31T05:43:36.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.578+0000 7f391b088740 1 -- 172.21.15.5:0/2834055784 wait complete. 2024-08-31T05:43:36.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.578+0000 7f391b088740 1 -- start start 2024-08-31T05:43:36.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.579+0000 7f391b088740 1 Processor -- start 2024-08-31T05:43:36.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.579+0000 7f391b088740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffdc77d9f0 0x55ffdcb74510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:36.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.579+0000 7f391b088740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ffdc7961b0 0x55ffdcb74a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:36.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.579+0000 7f391b088740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ffdc79e390 0x55ffdcbeb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:36.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.579+0000 7f391b088740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f39101b43c0 con 0x55ffdc79e390 2024-08-31T05:43:36.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.579+0000 7f391b088740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f39101b3cf0 con 0x55ffdc7961b0 2024-08-31T05:43:36.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.579+0000 7f391b088740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f39101b0e90 con 0x55ffdc77d9f0 2024-08-31T05:43:36.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.579+0000 7f391b088740 10 client.0 _ll_register_callbacks cb 0x7f3904005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:43:36.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.579+0000 7f390dd9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffdc77d9f0 0x55ffdcb74510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:36.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.579+0000 7f390e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ffdc7961b0 0x55ffdcb74a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:36.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.579+0000 7f390e59c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ffdc7961b0 0x55ffdcb74a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:39646/0 (socket says 172.21.15.5:39646) 2024-08-31T05:43:36.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.579+0000 7f390dd9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffdc77d9f0 0x55ffdcb74510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:34592/0 (socket says 172.21.15.5:34592) 2024-08-31T05:43:36.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.579+0000 7f390e59c640 1 -- 172.21.15.5:0/546288836 learned_addr learned my addr 172.21.15.5:0/546288836 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:36.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.579+0000 7f390dd9b640 1 --2- 172.21.15.5:0/546288836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ffdc79e390 0x55ffdcbeb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:36.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.580+0000 7f390dd9b640 1 -- 172.21.15.5:0/546288836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ffdc7961b0 msgr2=0x55ffdcb74a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:36.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.580+0000 7f390dd9b640 1 --2- 172.21.15.5:0/546288836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ffdc7961b0 0x55ffdcb74a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:36.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.580+0000 7f390dd9b640 1 -- 172.21.15.5:0/546288836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ffdc79e390 msgr2=0x55ffdcbeb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:36.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.580+0000 7f390dd9b640 1 --2- 172.21.15.5:0/546288836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ffdc79e390 0x55ffdcbeb400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:36.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.580+0000 7f390dd9b640 1 -- 172.21.15.5:0/546288836 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffdcbeba10 con 0x55ffdc77d9f0 2024-08-31T05:43:36.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.580+0000 7f390e59c640 1 --2- 172.21.15.5:0/546288836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ffdc7961b0 0x55ffdcb74a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:43:36.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.580+0000 7f390dd9b640 1 --2- 172.21.15.5:0/546288836 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffdc77d9f0 0x55ffdcb74510 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3904011900 tx=0x7f39040096c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ff9b3ab8521635c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:36.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.580+0000 7f38f5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:43:36.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.580+0000 7f38f5ffb640 1 -- 172.21.15.5:0/546288836 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3904020d10 con 0x55ffdc77d9f0 2024-08-31T05:43:36.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.581+0000 7f38f5ffb640 1 -- 172.21.15.5:0/546288836 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9511+0+0 (secure 0 0 0) 0x7f39040050b0 con 0x55ffdc77d9f0 2024-08-31T05:43:36.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.581+0000 7f391b088740 1 -- 172.21.15.5:0/546288836 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f390400fcd0 con 0x55ffdc77d9f0 2024-08-31T05:43:36.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.581+0000 7f38f5ffb640 1 -- 172.21.15.5:0/546288836 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f3904005c50 con 0x55ffdc77d9f0 2024-08-31T05:43:36.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.581+0000 7f391b088740 10 client.28804 fetch_fsmap learned FSMap version 36 2024-08-31T05:43:36.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.581+0000 7f391b088740 1 -- 172.21.15.5:0/546288836 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55ffdcbecca0 con 0x55ffdc77d9f0 2024-08-31T05:43:36.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.581+0000 7f38f5ffb640 1 -- 172.21.15.5:0/546288836 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f390403f070 con 0x55ffdc77d9f0 2024-08-31T05:43:36.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.582+0000 7f38f5ffb640 1 -- 172.21.15.5:0/546288836 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 36) ==== 8386+0+0 (secure 0 0 0) 0x7f39040307f0 con 0x55ffdc77d9f0 2024-08-31T05:43:36.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.582+0000 7f391b088740 10 client.28804 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T05:43:36.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.582+0000 7f391b088740 10 client.28804 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:43:36.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.582+0000 7f391b088740 20 client.28804 populate_metadata read hostname 'smithi005' 2024-08-31T05:43:36.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.582+0000 7f391b088740 1 --2- 172.21.15.5:0/546288836 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55ffdc752da0 0x55ffdcbef2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:36.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.582+0000 7f391b088740 4 client.28804 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T05:43:36.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.582+0000 7f391b088740 1 -- 172.21.15.5:0/546288836 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f390400fcd0 con 0x55ffdc752da0 2024-08-31T05:43:36.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.582+0000 7f390e59c640 1 --2- 172.21.15.5:0/546288836 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55ffdc752da0 0x55ffdcbef2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:36.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.583+0000 7f38f5ffb640 10 client.28804 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:43:36.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.583+0000 7f390e59c640 1 --2- 172.21.15.5:0/546288836 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55ffdc752da0 0x55ffdcbef2f0 crc :-1 s=READY pgs=300 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87e13d9989a3b1cb server_cookie=7df71f5e5e7e3645 in_seq=0 out_seq=0 2024-08-31T05:43:36.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.583+0000 7f38f5ffb640 1 -- 172.21.15.5:0/546288836 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5398 (crc 0 0 0) 0x7f390400fcd0 con 0x55ffdc752da0 2024-08-31T05:43:36.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.583+0000 7f38f5ffb640 10 client.28804 handle_command_reply: tid=0 2024-08-31T05:43:36.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.583+0000 7f391b088740 1 client.28804 shutdown 2024-08-31T05:43:36.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.584+0000 7f391b088740 1 -- 172.21.15.5:0/546288836 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffdc77d9f0 msgr2=0x55ffdcb74510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:36.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.584+0000 7f391b088740 1 --2- 172.21.15.5:0/546288836 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffdc77d9f0 0x55ffdcb74510 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3904011900 tx=0x7f39040096c0 comp rx=0 tx=0).stop 2024-08-31T05:43:36.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.584+0000 7f391b088740 1 -- 172.21.15.5:0/546288836 shutdown_connections 2024-08-31T05:43:36.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.584+0000 7f391b088740 1 --2- 172.21.15.5:0/546288836 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55ffdc752da0 0x55ffdcbef2f0 crc :-1 s=READY pgs=300 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:36.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.584+0000 7f391b088740 1 --2- 172.21.15.5:0/546288836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ffdc79e390 0x55ffdcbeb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:36.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.584+0000 7f38f5ffb640 0 client.28804 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:43:36.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.584+0000 7f391b088740 1 --2- 172.21.15.5:0/546288836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ffdc7961b0 0x55ffdcb74a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:36.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.584+0000 7f391b088740 1 --2- 172.21.15.5:0/546288836 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffdc77d9f0 0x55ffdcb74510 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:36.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.584+0000 7f391b088740 1 -- 172.21.15.5:0/546288836 >> 172.21.15.5:0/546288836 conn(0x55ffdc7b3460 msgr2=0x55ffdcb67390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:36.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.584+0000 7f391b088740 1 -- 172.21.15.5:0/546288836 shutdown_connections 2024-08-31T05:43:36.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.584+0000 7f391b088740 1 -- 172.21.15.5:0/546288836 wait complete. 2024-08-31T05:43:36.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.584+0000 7f391b088740 20 client.28804 trim_cache size 0 max 16384 2024-08-31T05:43:36.591 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:43:36.591 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T05:43:36.591 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2024-08-31T05:43:36.591 INFO:teuthology.orchestra.run.smithi005.stdout: "99e21ed4-9179-434d-86c5-36842066eafc": { 2024-08-31T05:43:36.591 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:43:36.591 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "99e21ed4-9179-434d-86c5-36842066eafc", 2024-08-31T05:43:36.591 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2024-08-31T05:43:36.591 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:43:36.591 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:43:36.591 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_stats": { 2024-08-31T05:43:36.591 INFO:teuthology.orchestra.run.smithi005.stdout: "99e21ed4-9179-434d-86c5-36842066eafc": { 2024-08-31T05:43:36.591 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:43:34.239983+0000", 2024-08-31T05:43:36.592 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:43:36.592 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:43:36.592 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:43:36.592 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:43:36.592 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:43:36.592 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:43:36.592 INFO:teuthology.orchestra.run.smithi005.stdout: "9a98c3be-1a83-4ac4-9efb-e98104b2c85a": { 2024-08-31T05:43:36.592 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:42:46.122404+0000", 2024-08-31T05:43:36.592 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:43:36.592 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:43:36.592 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:43:36.592 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:43:36.592 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:43:36.592 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:43:36.593 INFO:teuthology.orchestra.run.smithi005.stdout: "ab2853ca-505f-43fc-a132-af8bca186292": { 2024-08-31T05:43:36.593 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:40:23.937602+0000", 2024-08-31T05:43:36.593 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:43:36.593 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:43:36.593 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:43:36.593 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:43:36.593 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:43:36.593 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:43:36.593 INFO:teuthology.orchestra.run.smithi005.stdout: "75d84398-5d9c-4872-b879-2fbce045fa71": { 2024-08-31T05:43:36.594 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:06.642335+0000", 2024-08-31T05:43:36.594 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:43:36.594 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:43:36.594 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:43:36.594 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:43:36.594 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:43:36.594 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:43:36.594 INFO:teuthology.orchestra.run.smithi005.stdout: "ece37b07-9ab2-45f8-bc33-2755a07aac0b": { 2024-08-31T05:43:36.594 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:31:41.782407+0000", 2024-08-31T05:43:36.594 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:43:36.594 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:43:36.594 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:43:36.594 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:43:36.595 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:43:36.595 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:43:36.595 INFO:teuthology.orchestra.run.smithi005.stdout: "728a42ca-bbef-4151-830f-5fdd411d8fa0": { 2024-08-31T05:43:36.595 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:32:30.554906+0000", 2024-08-31T05:43:36.595 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:43:36.595 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:43:36.595 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:43:36.595 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:43:36.595 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:43:36.595 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:43:36.595 INFO:teuthology.orchestra.run.smithi005.stdout: "cda92ac0-b35f-47a5-a3a5-471c888462a5": { 2024-08-31T05:43:36.595 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:53.103905+0000", 2024-08-31T05:43:36.595 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:43:36.596 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:43:36.596 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:43:36.596 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:43:36.596 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:43:36.596 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:43:36.596 INFO:teuthology.orchestra.run.smithi005.stdout: "0bb67292-013a-40c7-b5fc-810bdd9715d8": { 2024-08-31T05:43:36.596 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:34:04.586008+0000", 2024-08-31T05:43:36.596 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:43:36.596 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:43:36.596 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:43:36.596 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:43:36.596 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:43:36.597 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:43:36.597 INFO:teuthology.orchestra.run.smithi005.stdout: "c9a687a5-4adf-4788-8f18-4c06352efa9b": { 2024-08-31T05:43:36.597 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:41:11.380197+0000", 2024-08-31T05:43:36.597 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:43:36.597 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:43:36.597 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:43:36.597 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:43:36.597 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:43:36.597 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:43:36.597 INFO:teuthology.orchestra.run.smithi005.stdout: "de9731c7-ae4a-42fe-8146-e4752cdc40d4": { 2024-08-31T05:43:36.597 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:34:53.614499+0000", 2024-08-31T05:43:36.597 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:43:36.597 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:43:36.598 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:43:36.598 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:43:36.598 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:43:36.598 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:43:36.598 INFO:teuthology.orchestra.run.smithi005.stdout: "f4db3406-20ff-46a3-baf9-099e16392f76": { 2024-08-31T05:43:36.598 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:38:49.034412+0000", 2024-08-31T05:43:36.598 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:43:36.598 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:43:36.598 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:43:36.598 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:43:36.598 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:43:36.598 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:43:36.598 INFO:teuthology.orchestra.run.smithi005.stdout: "095ccc7a-f368-4bc6-9563-5930e21f9b4a": { 2024-08-31T05:43:36.598 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:35:40.190069+0000", 2024-08-31T05:43:36.599 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:43:36.599 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:43:36.599 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:43:36.599 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:43:36.599 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:43:36.599 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:43:36.599 INFO:teuthology.orchestra.run.smithi005.stdout: "4788e020-0dc9-4938-9db8-dfd5992cb286": { 2024-08-31T05:43:36.599 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:41:58.905797+0000", 2024-08-31T05:43:36.599 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:43:36.599 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:43:36.599 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:43:36.599 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:43:36.599 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:43:36.600 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:43:36.600 INFO:teuthology.orchestra.run.smithi005.stdout: "297c26f3-7b4d-4245-abb0-f854248e5e1b": { 2024-08-31T05:43:36.600 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:37:14.019244+0000", 2024-08-31T05:43:36.600 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:43:36.600 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:43:36.600 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:43:36.600 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:43:36.600 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:43:36.600 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:43:36.600 INFO:teuthology.orchestra.run.smithi005.stdout: "a4d4cf74-2477-4dd9-a3a2-3762b4dd87e4": { 2024-08-31T05:43:36.600 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:38:01.378833+0000", 2024-08-31T05:43:36.600 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:43:36.600 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:43:36.600 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:43:36.601 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:43:36.601 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:43:36.601 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:43:36.601 INFO:teuthology.orchestra.run.smithi005.stdout: "94c23057-592d-4a8b-82d7-da2d84f8740b": { 2024-08-31T05:43:36.601 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:36:27.513638+0000", 2024-08-31T05:43:36.601 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:43:36.601 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:43:36.601 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:43:36.601 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:43:36.601 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:43:36.601 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:43:36.601 INFO:teuthology.orchestra.run.smithi005.stdout: "2445fc42-b797-434f-b380-e2da985b4d98": { 2024-08-31T05:43:36.602 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:33:17.681453+0000", 2024-08-31T05:43:36.602 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:43:36.602 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:43:36.602 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:43:36.602 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:43:36.602 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:43:36.602 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:43:36.602 INFO:teuthology.orchestra.run.smithi005.stdout: "239b7958-db06-4432-93ce-b7552effa357": { 2024-08-31T05:43:36.602 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:39:35.733028+0000", 2024-08-31T05:43:36.602 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:43:36.603 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:43:36.603 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:43:36.603 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:43:36.603 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:43:36.603 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:43:36.603 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:43:36.603 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:43:36.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.585+0000 7f3914b13640 1 -- 172.21.15.5:0/537176141 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f38f80b4ca0 msgr2=0x7f38f80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:36.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.585+0000 7f3914b13640 1 --2- 172.21.15.5:0/537176141 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f38f80b4ca0 0x7f38f80b71b0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f39080ac290 tx=0x7f390800c890 comp rx=0 tx=0).stop 2024-08-31T05:43:36.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.585+0000 7f3914b13640 1 -- 172.21.15.5:0/537176141 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3910108ab0 msgr2=0x7f39101a1c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:36.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.585+0000 7f3914b13640 1 --2- 172.21.15.5:0/537176141 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3910108ab0 0x7f39101a1c80 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f3908009fd0 tx=0x7f390800ef10 comp rx=0 tx=0).stop 2024-08-31T05:43:36.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.585+0000 7f3914b13640 1 -- 172.21.15.5:0/537176141 shutdown_connections 2024-08-31T05:43:36.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.585+0000 7f3914b13640 1 --2- 172.21.15.5:0/537176141 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f38f80b4ca0 0x7f38f80b71b0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:36.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.585+0000 7f3914b13640 1 --2- 172.21.15.5:0/537176141 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3910108ab0 0x7f39101a1c80 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:36.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.585+0000 7f3914b13640 1 --2- 172.21.15.5:0/537176141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3910108160 0x7f391019c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:36.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.585+0000 7f3914b13640 1 --2- 172.21.15.5:0/537176141 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3910102870 0x7f391019c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:36.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.585+0000 7f3914b13640 1 -- 172.21.15.5:0/537176141 >> 172.21.15.5:0/537176141 conn(0x7f3910079470 msgr2=0x7f39101061a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:36.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.585+0000 7f3914b13640 1 -- 172.21.15.5:0/537176141 shutdown_connections 2024-08-31T05:43:36.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:43:36.585+0000 7f3914b13640 1 -- 172.21.15.5:0/537176141 wait complete. 2024-08-31T05:43:37.267 INFO:tasks.workunit.client.0.smithi005.stdout: 10 9125 27.65 MB/sec warmup 24 sec latency 317.960 ms 2024-08-31T05:43:37.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:37 smithi070 ceph-mon[22316]: scrub summary: idle+waiting paths [/] 2024-08-31T05:43:37.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:37 smithi070 ceph-mon[22316]: pgmap v768: 129 pgs: 129 active+clean; 787 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 4.6 MiB/s wr, 407 op/s 2024-08-31T05:43:37.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:37 smithi050 ceph-mon[22146]: scrub summary: idle+waiting paths [/] 2024-08-31T05:43:37.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:37 smithi050 ceph-mon[22146]: pgmap v768: 129 pgs: 129 active+clean; 787 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 4.6 MiB/s wr, 407 op/s 2024-08-31T05:43:37.451 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:37 smithi005 ceph-mon[18602]: scrub summary: idle+waiting paths [/] 2024-08-31T05:43:37.451 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:37 smithi005 ceph-mon[18602]: pgmap v768: 129 pgs: 129 active+clean; 787 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 4.6 MiB/s wr, 407 op/s 2024-08-31T05:43:37.484 INFO:tasks.cephfs.filesystem:scrub status for tag:99e21ed4-9179-434d-86c5-36842066eafc - {'path': '/', 'tag': '99e21ed4-9179-434d-86c5-36842066eafc', 'options': 'recursive,force'} 2024-08-31T05:43:38.267 INFO:tasks.workunit.client.0.smithi005.stdout: 10 9657 27.37 MB/sec warmup 25 sec latency 244.673 ms 2024-08-31T05:43:39.267 INFO:tasks.workunit.client.0.smithi005.stdout: 10 10146 27.44 MB/sec warmup 26 sec latency 255.602 ms 2024-08-31T05:43:39.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:39 smithi070 ceph-mon[22316]: pgmap v769: 129 pgs: 129 active+clean; 796 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 4.1 MiB/s wr, 356 op/s 2024-08-31T05:43:39.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:39 smithi050 ceph-mon[22146]: pgmap v769: 129 pgs: 129 active+clean; 796 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 4.1 MiB/s wr, 356 op/s 2024-08-31T05:43:39.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:39 smithi005 ceph-mon[18602]: pgmap v769: 129 pgs: 129 active+clean; 796 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 4.1 MiB/s wr, 356 op/s 2024-08-31T05:43:40.268 INFO:tasks.workunit.client.0.smithi005.stdout: 10 10703 27.37 MB/sec warmup 27 sec latency 206.419 ms 2024-08-31T05:43:41.267 INFO:tasks.workunit.client.0.smithi005.stdout: 10 11377 28.05 MB/sec warmup 28 sec latency 120.514 ms 2024-08-31T05:43:41.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:41 smithi070 ceph-mon[22316]: pgmap v770: 129 pgs: 129 active+clean; 828 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 6.7 MiB/s wr, 441 op/s 2024-08-31T05:43:41.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:41 smithi050 ceph-mon[22146]: pgmap v770: 129 pgs: 129 active+clean; 828 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 6.7 MiB/s wr, 441 op/s 2024-08-31T05:43:41.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:41 smithi005 ceph-mon[18602]: pgmap v770: 129 pgs: 129 active+clean; 828 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 6.7 MiB/s wr, 441 op/s 2024-08-31T05:43:42.269 INFO:tasks.workunit.client.0.smithi005.stdout: 10 11883 28.40 MB/sec warmup 29 sec latency 194.404 ms 2024-08-31T05:43:43.267 INFO:tasks.workunit.client.0.smithi005.stdout: 10 12272 28.23 MB/sec warmup 30 sec latency 125.001 ms 2024-08-31T05:43:43.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:43 smithi070 ceph-mon[22316]: pgmap v771: 129 pgs: 129 active+clean; 834 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 6.1 MiB/s wr, 392 op/s 2024-08-31T05:43:43.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:43 smithi050 ceph-mon[22146]: pgmap v771: 129 pgs: 129 active+clean; 834 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 6.1 MiB/s wr, 392 op/s 2024-08-31T05:43:43.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:43 smithi005 ceph-mon[18602]: pgmap v771: 129 pgs: 129 active+clean; 834 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 6.1 MiB/s wr, 392 op/s 2024-08-31T05:43:44.267 INFO:tasks.workunit.client.0.smithi005.stdout: 10 12550 27.71 MB/sec warmup 31 sec latency 126.960 ms 2024-08-31T05:43:44.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.554+0000 7efe3510e640 1 -- 172.21.15.5:0/1638162830 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe301036d0 msgr2=0x7efe30103ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:44.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.554+0000 7efe3510e640 1 --2- 172.21.15.5:0/1638162830 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe301036d0 0x7efe30103ae0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7efe20009900 tx=0x7efe2002a410 comp rx=0 tx=0).stop 2024-08-31T05:43:44.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.554+0000 7efe3510e640 1 -- 172.21.15.5:0/1638162830 shutdown_connections 2024-08-31T05:43:44.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.554+0000 7efe3510e640 1 --2- 172.21.15.5:0/1638162830 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe30109950 0x7efe30110180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:44.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.554+0000 7efe3510e640 1 --2- 172.21.15.5:0/1638162830 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe30109000 0x7efe30109410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:44.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.554+0000 7efe3510e640 1 --2- 172.21.15.5:0/1638162830 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe301036d0 0x7efe30103ae0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:44.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.554+0000 7efe3510e640 1 -- 172.21.15.5:0/1638162830 >> 172.21.15.5:0/1638162830 conn(0x7efe300ff130 msgr2=0x7efe30101580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:44.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.554+0000 7efe3510e640 1 -- 172.21.15.5:0/1638162830 shutdown_connections 2024-08-31T05:43:44.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.554+0000 7efe3510e640 1 -- 172.21.15.5:0/1638162830 wait complete. 2024-08-31T05:43:44.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.554+0000 7efe3510e640 1 Processor -- start 2024-08-31T05:43:44.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.554+0000 7efe3510e640 1 -- start start 2024-08-31T05:43:44.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.555+0000 7efe3510e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe301036d0 0x7efe3019a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:44.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.555+0000 7efe3510e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe30109000 0x7efe3019a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:44.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.555+0000 7efe3510e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe30109950 0x7efe3019f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:44.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.555+0000 7efe3510e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7efe30113620 con 0x7efe30109000 2024-08-31T05:43:44.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.555+0000 7efe3510e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7efe301134a0 con 0x7efe30109950 2024-08-31T05:43:44.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.555+0000 7efe3510e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efe301137a0 con 0x7efe301036d0 2024-08-31T05:43:44.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.555+0000 7efe2f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe30109000 0x7efe3019a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:44.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.555+0000 7efe3490d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe30109950 0x7efe3019f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:44.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.555+0000 7efe2ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe301036d0 0x7efe3019a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:44.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.555+0000 7efe2f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe30109000 0x7efe3019a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45234/0 (socket says 172.21.15.5:45234) 2024-08-31T05:43:44.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.555+0000 7efe2f7fe640 1 -- 172.21.15.5:0/3084743251 learned_addr learned my addr 172.21.15.5:0/3084743251 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:44.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.555+0000 7efe2f7fe640 1 -- 172.21.15.5:0/3084743251 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe301036d0 msgr2=0x7efe3019a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:44.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.555+0000 7efe2f7fe640 1 --2- 172.21.15.5:0/3084743251 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe301036d0 0x7efe3019a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:44.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.555+0000 7efe2f7fe640 1 -- 172.21.15.5:0/3084743251 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe30109950 msgr2=0x7efe3019f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:44.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.555+0000 7efe2f7fe640 1 --2- 172.21.15.5:0/3084743251 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe30109950 0x7efe3019f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:44.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.555+0000 7efe2f7fe640 1 -- 172.21.15.5:0/3084743251 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe3019ff90 con 0x7efe30109000 2024-08-31T05:43:44.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.555+0000 7efe2ffff640 1 --2- 172.21.15.5:0/3084743251 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe301036d0 0x7efe3019a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:43:44.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.555+0000 7efe3490d640 1 --2- 172.21.15.5:0/3084743251 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe30109950 0x7efe3019f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:43:44.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.556+0000 7efe2f7fe640 1 --2- 172.21.15.5:0/3084743251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe30109000 0x7efe3019a600 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7efe2400e9f0 tx=0x7efe2400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:44.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.556+0000 7efe2d7fa640 1 -- 172.21.15.5:0/3084743251 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe2400ccc0 con 0x7efe30109000 2024-08-31T05:43:44.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.556+0000 7efe3510e640 1 -- 172.21.15.5:0/3084743251 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe301a0280 con 0x7efe30109000 2024-08-31T05:43:44.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.556+0000 7efe2d7fa640 1 -- 172.21.15.5:0/3084743251 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe240108e0 con 0x7efe30109000 2024-08-31T05:43:44.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.556+0000 7efe2d7fa640 1 -- 172.21.15.5:0/3084743251 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe24018860 con 0x7efe30109000 2024-08-31T05:43:44.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.556+0000 7efe3510e640 1 -- 172.21.15.5:0/3084743251 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe301a6a10 con 0x7efe30109000 2024-08-31T05:43:44.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.559+0000 7efe3d2da740 1 Processor -- start 2024-08-31T05:43:44.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.559+0000 7efe3d2da740 1 -- start start 2024-08-31T05:43:44.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.559+0000 7efe2d7fa640 1 -- 172.21.15.5:0/3084743251 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7efe24018a00 con 0x7efe30109000 2024-08-31T05:43:44.565 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.559+0000 7efe3d2da740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d7df9ac1b0 0x55d7dfd4fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:44.566 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.559+0000 7efe3d2da740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d7df9832f0 0x55d7dfd50200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:44.566 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.559+0000 7efe3d2da740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d7df98b4d0 0x55d7dfd50740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:44.566 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.559+0000 7efe3d2da740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55d7dfcc5000 con 0x55d7df9832f0 2024-08-31T05:43:44.566 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.559+0000 7efe3d2da740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d7dfcb4590 con 0x55d7df9ac1b0 2024-08-31T05:43:44.566 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.559+0000 7efe3d2da740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d7dfcb8540 con 0x55d7df98b4d0 2024-08-31T05:43:44.566 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.559+0000 7efe2ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d7df9832f0 0x55d7dfd50200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:44.566 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.559+0000 7efe3490d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d7df9ac1b0 0x55d7dfd4fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:44.566 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.559+0000 7efe2ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d7df9832f0 0x55d7dfd50200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45248/0 (socket says 172.21.15.5:45248) 2024-08-31T05:43:44.566 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.559+0000 7efe3490d640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d7df9ac1b0 0x55d7dfd4fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:43330/0 (socket says 172.21.15.5:43330) 2024-08-31T05:43:44.566 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.559+0000 7efe2ffff640 1 -- 172.21.15.5:0/204934981 learned_addr learned my addr 172.21.15.5:0/204934981 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:44.566 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.559+0000 7efe2f7fe640 1 --2- 172.21.15.5:0/204934981 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d7df98b4d0 0x55d7dfd50740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:44.566 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.559+0000 7efe2ffff640 1 -- 172.21.15.5:0/204934981 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d7df98b4d0 msgr2=0x55d7dfd50740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:44.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.559+0000 7efe2ffff640 1 --2- 172.21.15.5:0/204934981 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d7df98b4d0 0x55d7dfd50740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:44.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.560+0000 7efe2ffff640 1 -- 172.21.15.5:0/204934981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d7df9ac1b0 msgr2=0x55d7dfd4fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:44.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.560+0000 7efe2ffff640 1 --2- 172.21.15.5:0/204934981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d7df9ac1b0 0x55d7dfd4fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:44.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.560+0000 7efe2ffff640 1 -- 172.21.15.5:0/204934981 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7dfa17790 con 0x55d7df9832f0 2024-08-31T05:43:44.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.560+0000 7efe2ffff640 1 --2- 172.21.15.5:0/204934981 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d7df9832f0 0x55d7dfd50200 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7efe20009900 tx=0x7efe20005e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5083cb78b763a6d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:44.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.560+0000 7efe2d7fa640 1 --2- 172.21.15.5:0/3084743251 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7efe180b4c90 0x7efe180b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:44.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.560+0000 7efe167fc640 1 -- 172.21.15.5:0/204934981 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe20040070 con 0x55d7df9832f0 2024-08-31T05:43:44.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.560+0000 7efe3490d640 1 --2- 172.21.15.5:0/3084743251 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7efe180b4c90 0x7efe180b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:44.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.560+0000 7efe167fc640 1 -- 172.21.15.5:0/204934981 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe20031720 con 0x55d7df9832f0 2024-08-31T05:43:44.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.560+0000 7efe167fc640 1 -- 172.21.15.5:0/204934981 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe20035040 con 0x55d7df9832f0 2024-08-31T05:43:44.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.560+0000 7efe2d7fa640 1 -- 172.21.15.5:0/3084743251 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9511+0+0 (secure 0 0 0) 0x7efe240e5c40 con 0x7efe30109000 2024-08-31T05:43:44.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.561+0000 7efe3d2da740 1 -- 172.21.15.5:0/204934981 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d7df9832f0 msgr2=0x55d7dfd50200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:44.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.561+0000 7efe3d2da740 1 --2- 172.21.15.5:0/204934981 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d7df9832f0 0x55d7dfd50200 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7efe20009900 tx=0x7efe20005e20 comp rx=0 tx=0).stop 2024-08-31T05:43:44.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.561+0000 7efe3490d640 1 --2- 172.21.15.5:0/3084743251 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7efe180b4c90 0x7efe180b71a0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7efe28009fd0 tx=0x7efe28009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:44.567 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.561+0000 7efe3d2da740 1 -- 172.21.15.5:0/204934981 shutdown_connections 2024-08-31T05:43:44.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.561+0000 7efe3d2da740 1 --2- 172.21.15.5:0/204934981 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d7df98b4d0 0x55d7dfd50740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:44.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.561+0000 7efe3d2da740 1 --2- 172.21.15.5:0/204934981 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d7df9832f0 0x55d7dfd50200 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:44.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.561+0000 7efe3d2da740 1 --2- 172.21.15.5:0/204934981 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d7df9ac1b0 0x55d7dfd4fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:44.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.561+0000 7efe3d2da740 1 -- 172.21.15.5:0/204934981 >> 172.21.15.5:0/204934981 conn(0x55d7df9a0300 msgr2=0x55d7dfd4dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:44.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.561+0000 7efe3d2da740 1 -- 172.21.15.5:0/204934981 shutdown_connections 2024-08-31T05:43:44.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.561+0000 7efe3d2da740 1 -- 172.21.15.5:0/204934981 wait complete. 2024-08-31T05:43:44.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.561+0000 7efe3d2da740 1 -- start start 2024-08-31T05:43:44.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.562+0000 7efe3d2da740 1 Processor -- start 2024-08-31T05:43:44.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.562+0000 7efe3d2da740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d7df9832f0 0x55d7dfd5fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:44.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.562+0000 7efe3d2da740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d7df98b4d0 0x55d7dfd601b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:44.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.562+0000 7efe3d2da740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d7df9ac1b0 0x55d7dfd6bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:44.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.562+0000 7efe3d2da740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55d7dfbedab0 con 0x55d7df98b4d0 2024-08-31T05:43:44.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.562+0000 7efe3d2da740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55d7dfc3b680 con 0x55d7df9832f0 2024-08-31T05:43:44.568 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.562+0000 7efe3d2da740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d7dfd627c0 con 0x55d7df9ac1b0 2024-08-31T05:43:44.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.562+0000 7efe3d2da740 10 client.0 _ll_register_callbacks cb 0x55d7df9c3a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:43:44.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.562+0000 7efe2f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d7df98b4d0 0x55d7dfd601b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:44.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.562+0000 7efe3490d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d7df9ac1b0 0x55d7dfd6bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:44.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.562+0000 7efe2ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d7df9832f0 0x55d7dfd5fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:44.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.562+0000 7efe3490d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d7df9ac1b0 0x55d7dfd6bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:58284/0 (socket says 172.21.15.5:58284) 2024-08-31T05:43:44.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.562+0000 7efe2ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d7df9832f0 0x55d7dfd5fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:43336/0 (socket says 172.21.15.5:43336) 2024-08-31T05:43:44.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.562+0000 7efe3490d640 1 -- 172.21.15.5:0/1651551304 learned_addr learned my addr 172.21.15.5:0/1651551304 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:44.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.563+0000 7efe2ffff640 1 -- 172.21.15.5:0/1651551304 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d7df9ac1b0 msgr2=0x55d7dfd6bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:44.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.563+0000 7efe2ffff640 1 --2- 172.21.15.5:0/1651551304 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d7df9ac1b0 0x55d7dfd6bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:44.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.563+0000 7efe2ffff640 1 -- 172.21.15.5:0/1651551304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d7df98b4d0 msgr2=0x55d7dfd601b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:44.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.563+0000 7efe2ffff640 1 --2- 172.21.15.5:0/1651551304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d7df98b4d0 0x55d7dfd601b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:44.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.563+0000 7efe2ffff640 1 -- 172.21.15.5:0/1651551304 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7dfa90620 con 0x55d7df9832f0 2024-08-31T05:43:44.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.563+0000 7efe2ffff640 1 --2- 172.21.15.5:0/1651551304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d7df9832f0 0x55d7dfd5fc70 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7efe2002a930 tx=0x7efe200053f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=882f9c90bae38a81 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:44.569 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.563+0000 7efe0f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:43:44.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.563+0000 7efe0f7fe640 1 -- 172.21.15.5:0/1651551304 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe20051060 con 0x55d7df9832f0 2024-08-31T05:43:44.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.563+0000 7efe3d2da740 1 -- 172.21.15.5:0/1651551304 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe20031720 con 0x55d7df9832f0 2024-08-31T05:43:44.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.563+0000 7efe0f7fe640 1 -- 172.21.15.5:0/1651551304 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9511+0+0 (secure 0 0 0) 0x7efe200035f0 con 0x55d7df9832f0 2024-08-31T05:43:44.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.563+0000 7efe0f7fe640 1 -- 172.21.15.5:0/1651551304 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7efe20035040 con 0x55d7df9832f0 2024-08-31T05:43:44.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.563+0000 7efe3d2da740 10 client.28814 fetch_fsmap learned FSMap version 36 2024-08-31T05:43:44.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.563+0000 7efe3d2da740 1 -- 172.21.15.5:0/1651551304 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55d7dfd6e820 con 0x55d7df9832f0 2024-08-31T05:43:44.570 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.564+0000 7efe0f7fe640 1 -- 172.21.15.5:0/1651551304 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe20031720 con 0x55d7df9832f0 2024-08-31T05:43:44.571 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.564+0000 7efe0f7fe640 1 -- 172.21.15.5:0/1651551304 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 36) ==== 8386+0+0 (secure 0 0 0) 0x7efe2003c440 con 0x55d7df9832f0 2024-08-31T05:43:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.564+0000 7efe3d2da740 10 client.28814 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T05:43:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.564+0000 7efe3d2da740 10 client.28814 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:43:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.564+0000 7efe3d2da740 20 client.28814 populate_metadata read hostname 'smithi005' 2024-08-31T05:43:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.564+0000 7efe3d2da740 1 --2- 172.21.15.5:0/1651551304 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d7df96ad80 0x55d7dfd71b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.564+0000 7efe3d2da740 4 client.28814 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:43:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.564+0000 7efe3d2da740 1 -- 172.21.15.5:0/1651551304 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d7dfcc6f50 con 0x55d7df96ad80 2024-08-31T05:43:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.564+0000 7efe2f7fe640 1 --2- 172.21.15.5:0/1651551304 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d7df96ad80 0x55d7dfd71b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.565+0000 7efe0f7fe640 10 client.28814 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:43:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.565+0000 7efe2f7fe640 1 --2- 172.21.15.5:0/1651551304 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d7df96ad80 0x55d7dfd71b80 crc :-1 s=READY pgs=301 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ecb0ff7afdf9b76 server_cookie=fd13de23526e367e in_seq=0 out_seq=0 2024-08-31T05:43:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.566+0000 7efe0f7fe640 1 -- 172.21.15.5:0/1651551304 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d7dfcc6f50 con 0x55d7df96ad80 2024-08-31T05:43:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.566+0000 7efe0f7fe640 10 client.28814 handle_command_reply: tid=0 2024-08-31T05:43:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.566+0000 7efe3d2da740 1 client.28814 shutdown 2024-08-31T05:43:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.567+0000 7efe3d2da740 1 -- 172.21.15.5:0/1651551304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d7df9832f0 msgr2=0x55d7dfd5fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:44.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.567+0000 7efe3d2da740 1 --2- 172.21.15.5:0/1651551304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d7df9832f0 0x55d7dfd5fc70 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7efe2002a930 tx=0x7efe200053f0 comp rx=0 tx=0).stop 2024-08-31T05:43:44.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.567+0000 7efe3d2da740 1 -- 172.21.15.5:0/1651551304 shutdown_connections 2024-08-31T05:43:44.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.567+0000 7efe3d2da740 1 --2- 172.21.15.5:0/1651551304 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d7df96ad80 0x55d7dfd71b80 crc :-1 s=READY pgs=301 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:44.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.567+0000 7efe0f7fe640 0 client.28814 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:43:44.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.567+0000 7efe3d2da740 1 --2- 172.21.15.5:0/1651551304 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d7df9ac1b0 0x55d7dfd6bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:44.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.567+0000 7efe3d2da740 1 --2- 172.21.15.5:0/1651551304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d7df98b4d0 0x55d7dfd601b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:44.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.567+0000 7efe3d2da740 1 --2- 172.21.15.5:0/1651551304 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d7df9832f0 0x55d7dfd5fc70 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:44.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.567+0000 7efe3d2da740 1 -- 172.21.15.5:0/1651551304 >> 172.21.15.5:0/1651551304 conn(0x55d7df9a0300 msgr2=0x55d7dfd4c150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:44.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.567+0000 7efe3d2da740 1 -- 172.21.15.5:0/1651551304 shutdown_connections 2024-08-31T05:43:44.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.567+0000 7efe3d2da740 1 -- 172.21.15.5:0/1651551304 wait complete. 2024-08-31T05:43:44.573 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.567+0000 7efe3d2da740 20 client.28814 trim_cache size 0 max 16384 2024-08-31T05:43:44.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.584+0000 7efe3d2da740 1 Processor -- start 2024-08-31T05:43:44.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.584+0000 7efe3d2da740 1 -- start start 2024-08-31T05:43:44.587 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.584+0000 7efe3d2da740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d7df96ad80 0x55d7dfd4c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:44.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.584+0000 7efe3d2da740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d7df9832f0 0x55d7dfd5ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:44.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.584+0000 7efe3d2da740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d7df98b4d0 0x55d7dfd5cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:44.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.584+0000 7efe3d2da740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7efe301ae990 con 0x55d7df9832f0 2024-08-31T05:43:44.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.584+0000 7efe3d2da740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7efe301b0590 con 0x55d7df98b4d0 2024-08-31T05:43:44.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.584+0000 7efe3d2da740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efe301af060 con 0x55d7df96ad80 2024-08-31T05:43:44.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.585+0000 7efe2f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d7df9832f0 0x55d7dfd5ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:44.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.585+0000 7efe2ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d7df96ad80 0x55d7dfd4c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:44.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.585+0000 7efe2f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d7df9832f0 0x55d7dfd5ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45264/0 (socket says 172.21.15.5:45264) 2024-08-31T05:43:44.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.585+0000 7efe2f7fe640 1 -- 172.21.15.5:0/3488574415 learned_addr learned my addr 172.21.15.5:0/3488574415 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:44.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.585+0000 7efe3490d640 1 --2- 172.21.15.5:0/3488574415 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d7df98b4d0 0x55d7dfd5cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:44.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.585+0000 7efe2f7fe640 1 -- 172.21.15.5:0/3488574415 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d7df96ad80 msgr2=0x55d7dfd4c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:44.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.585+0000 7efe2f7fe640 1 --2- 172.21.15.5:0/3488574415 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d7df96ad80 0x55d7dfd4c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:44.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.585+0000 7efe2f7fe640 1 -- 172.21.15.5:0/3488574415 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d7df98b4d0 msgr2=0x55d7dfd5cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:44.588 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.585+0000 7efe2f7fe640 1 --2- 172.21.15.5:0/3488574415 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d7df98b4d0 0x55d7dfd5cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:44.589 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.585+0000 7efe2f7fe640 1 -- 172.21.15.5:0/3488574415 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7dfd6bed0 con 0x55d7df9832f0 2024-08-31T05:43:44.589 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.585+0000 7efe2f7fe640 1 --2- 172.21.15.5:0/3488574415 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d7df9832f0 0x55d7dfd5ff40 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7efe240e35b0 tx=0x7efe240096a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5589594c02a49df server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:44.589 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.585+0000 7efe15ffb640 1 -- 172.21.15.5:0/3488574415 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe240b5270 con 0x55d7df9832f0 2024-08-31T05:43:44.589 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.585+0000 7efe15ffb640 1 -- 172.21.15.5:0/3488574415 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe24010a90 con 0x55d7df9832f0 2024-08-31T05:43:44.589 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.585+0000 7efe15ffb640 1 -- 172.21.15.5:0/3488574415 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe240b3e30 con 0x55d7df9832f0 2024-08-31T05:43:44.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.586+0000 7efe3d2da740 1 -- 172.21.15.5:0/3488574415 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d7df9832f0 msgr2=0x55d7dfd5ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:44.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.586+0000 7efe3d2da740 1 --2- 172.21.15.5:0/3488574415 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d7df9832f0 0x55d7dfd5ff40 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7efe240e35b0 tx=0x7efe240096a0 comp rx=0 tx=0).stop 2024-08-31T05:43:44.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.586+0000 7efe3d2da740 1 -- 172.21.15.5:0/3488574415 shutdown_connections 2024-08-31T05:43:44.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.586+0000 7efe3d2da740 1 --2- 172.21.15.5:0/3488574415 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d7df98b4d0 0x55d7dfd5cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:44.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.586+0000 7efe3d2da740 1 --2- 172.21.15.5:0/3488574415 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d7df9832f0 0x55d7dfd5ff40 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:44.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.586+0000 7efe3d2da740 1 --2- 172.21.15.5:0/3488574415 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d7df96ad80 0x55d7dfd4c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:44.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.586+0000 7efe3d2da740 1 -- 172.21.15.5:0/3488574415 >> 172.21.15.5:0/3488574415 conn(0x55d7df9a0300 msgr2=0x55d7dfd4c150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:44.592 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.586+0000 7efe3d2da740 1 -- 172.21.15.5:0/3488574415 shutdown_connections 2024-08-31T05:43:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.586+0000 7efe3d2da740 1 -- 172.21.15.5:0/3488574415 wait complete. 2024-08-31T05:43:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.587+0000 7efe3d2da740 1 -- start start 2024-08-31T05:43:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.587+0000 7efe3d2da740 1 Processor -- start 2024-08-31T05:43:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.587+0000 7efe3d2da740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d7df96ad80 0x55d7dfd72f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.587+0000 7efe3d2da740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d7df9832f0 0x55d7dfd734c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.587+0000 7efe3d2da740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d7df98b4d0 0x55d7dfddb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.587+0000 7efe3d2da740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7efe301afec0 con 0x55d7df98b4d0 2024-08-31T05:43:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.587+0000 7efe3d2da740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7efe301af7f0 con 0x55d7df96ad80 2024-08-31T05:43:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.587+0000 7efe3d2da740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efe301ac990 con 0x55d7df9832f0 2024-08-31T05:43:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.587+0000 7efe3d2da740 10 client.0 _ll_register_callbacks cb 0x7efe28009ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:43:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.588+0000 7efe3490d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d7df98b4d0 0x55d7dfddb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.588+0000 7efe3490d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d7df98b4d0 0x55d7dfddb300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45270/0 (socket says 172.21.15.5:45270) 2024-08-31T05:43:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.588+0000 7efe3490d640 1 -- 172.21.15.5:0/1102399404 learned_addr learned my addr 172.21.15.5:0/1102399404 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:44.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.588+0000 7efe2ffff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d7df96ad80 0x55d7dfd72f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:44.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.588+0000 7efe2f7fe640 1 --2- 172.21.15.5:0/1102399404 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d7df9832f0 0x55d7dfd734c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:44.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.588+0000 7efe3490d640 1 -- 172.21.15.5:0/1102399404 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d7df9832f0 msgr2=0x55d7dfd734c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:44.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.588+0000 7efe3490d640 1 --2- 172.21.15.5:0/1102399404 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d7df9832f0 0x55d7dfd734c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:44.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.588+0000 7efe3490d640 1 -- 172.21.15.5:0/1102399404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d7df96ad80 msgr2=0x55d7dfd72f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:44.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.588+0000 7efe3490d640 1 --2- 172.21.15.5:0/1102399404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d7df96ad80 0x55d7dfd72f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:44.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.588+0000 7efe3490d640 1 -- 172.21.15.5:0/1102399404 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7dfddb840 con 0x55d7df98b4d0 2024-08-31T05:43:44.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.588+0000 7efe2f7fe640 1 --2- 172.21.15.5:0/1102399404 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d7df9832f0 0x55d7dfd734c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:43:44.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.588+0000 7efe3490d640 1 --2- 172.21.15.5:0/1102399404 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d7df98b4d0 0x55d7dfddb300 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7efe2800fb90 tx=0x7efe28004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38f0f51343108fd8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:44.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.588+0000 7efe0f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:43:44.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.588+0000 7efe0f7fe640 1 -- 172.21.15.5:0/1102399404 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe28004820 con 0x55d7df98b4d0 2024-08-31T05:43:44.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.588+0000 7efe0f7fe640 1 -- 172.21.15.5:0/1102399404 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9511+0+0 (secure 0 0 0) 0x7efe28018030 con 0x55d7df98b4d0 2024-08-31T05:43:44.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.588+0000 7efe3d2da740 1 -- 172.21.15.5:0/1102399404 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe24010a90 con 0x55d7df98b4d0 2024-08-31T05:43:44.594 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.589+0000 7efe0f7fe640 1 -- 172.21.15.5:0/1102399404 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7efe28037050 con 0x55d7df98b4d0 2024-08-31T05:43:44.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.589+0000 7efe3d2da740 10 client.19254 fetch_fsmap learned FSMap version 36 2024-08-31T05:43:44.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.589+0000 7efe3d2da740 1 -- 172.21.15.5:0/1102399404 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55d7dfddc920 con 0x55d7df98b4d0 2024-08-31T05:43:44.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.589+0000 7efe0f7fe640 1 -- 172.21.15.5:0/1102399404 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe24010a90 con 0x55d7df98b4d0 2024-08-31T05:43:44.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.589+0000 7efe0f7fe640 1 -- 172.21.15.5:0/1102399404 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 36) ==== 8386+0+0 (secure 0 0 0) 0x7efe280055f0 con 0x55d7df98b4d0 2024-08-31T05:43:44.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.589+0000 7efe3d2da740 10 client.19254 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T05:43:44.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.589+0000 7efe3d2da740 10 client.19254 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:43:44.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.589+0000 7efe3d2da740 20 client.19254 populate_metadata read hostname 'smithi005' 2024-08-31T05:43:44.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.589+0000 7efe3d2da740 1 --2- 172.21.15.5:0/1102399404 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d7df9ac1b0 0x55d7dfddf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:44.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.589+0000 7efe3d2da740 4 client.19254 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:43:44.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.589+0000 7efe3d2da740 1 -- 172.21.15.5:0/1102399404 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d7dfcc29f0 con 0x55d7df9ac1b0 2024-08-31T05:43:44.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.589+0000 7efe2ffff640 1 --2- 172.21.15.5:0/1102399404 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d7df9ac1b0 0x55d7dfddf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:44.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.590+0000 7efe0f7fe640 10 client.19254 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:43:44.595 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.590+0000 7efe2ffff640 1 --2- 172.21.15.5:0/1102399404 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d7df9ac1b0 0x55d7dfddf190 crc :-1 s=READY pgs=302 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e2f1c5755205f00 server_cookie=cda3eb81d2e8fd01 in_seq=0 out_seq=0 2024-08-31T05:43:44.788 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.786+0000 7efe0f7fe640 1 -- 172.21.15.5:0/1102399404 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d7dfcc29f0 con 0x55d7df9ac1b0 2024-08-31T05:43:44.788 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.786+0000 7efe0f7fe640 10 client.19254 handle_command_reply: tid=0 2024-08-31T05:43:44.789 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.786+0000 7efe3d2da740 1 client.19254 shutdown 2024-08-31T05:43:44.789 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.786+0000 7efe3d2da740 1 -- 172.21.15.5:0/1102399404 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d7df98b4d0 msgr2=0x55d7dfddb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:44.789 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.786+0000 7efe3d2da740 1 --2- 172.21.15.5:0/1102399404 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d7df98b4d0 0x55d7dfddb300 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7efe2800fb90 tx=0x7efe28004a40 comp rx=0 tx=0).stop 2024-08-31T05:43:44.789 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.786+0000 7efe3d2da740 1 -- 172.21.15.5:0/1102399404 shutdown_connections 2024-08-31T05:43:44.789 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.786+0000 7efe3d2da740 1 --2- 172.21.15.5:0/1102399404 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55d7df9ac1b0 0x55d7dfddf190 crc :-1 s=READY pgs=302 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:44.789 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.786+0000 7efe3d2da740 1 --2- 172.21.15.5:0/1102399404 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d7df98b4d0 0x55d7dfddb300 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:44.789 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.786+0000 7efe3d2da740 1 --2- 172.21.15.5:0/1102399404 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d7df9832f0 0x55d7dfd734c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:44.789 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.786+0000 7efe0f7fe640 0 client.19254 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:43:44.789 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.786+0000 7efe3d2da740 1 --2- 172.21.15.5:0/1102399404 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55d7df96ad80 0x55d7dfd72f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:44.789 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.786+0000 7efe3d2da740 1 -- 172.21.15.5:0/1102399404 >> 172.21.15.5:0/1102399404 conn(0x55d7df9a0300 msgr2=0x55d7dfd50cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:44.789 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.786+0000 7efe3d2da740 1 -- 172.21.15.5:0/1102399404 shutdown_connections 2024-08-31T05:43:44.789 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.786+0000 7efe3d2da740 1 -- 172.21.15.5:0/1102399404 wait complete. 2024-08-31T05:43:44.789 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.786+0000 7efe3d2da740 20 client.19254 trim_cache size 0 max 16384 2024-08-31T05:43:44.790 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:43:44.790 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:43:44.790 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:43:44.790 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:43:44.791 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.787+0000 7efe3510e640 1 -- 172.21.15.5:0/3084743251 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7efe180b4c90 msgr2=0x7efe180b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:44.791 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.787+0000 7efe3510e640 1 --2- 172.21.15.5:0/3084743251 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7efe180b4c90 0x7efe180b71a0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7efe28009fd0 tx=0x7efe28009500 comp rx=0 tx=0).stop 2024-08-31T05:43:44.791 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.787+0000 7efe3510e640 1 -- 172.21.15.5:0/3084743251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe30109000 msgr2=0x7efe3019a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:44.791 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.787+0000 7efe3510e640 1 --2- 172.21.15.5:0/3084743251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe30109000 0x7efe3019a600 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7efe2400e9f0 tx=0x7efe2400eeb0 comp rx=0 tx=0).stop 2024-08-31T05:43:44.791 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.787+0000 7efe3510e640 1 -- 172.21.15.5:0/3084743251 shutdown_connections 2024-08-31T05:43:44.791 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.787+0000 7efe3510e640 1 --2- 172.21.15.5:0/3084743251 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7efe180b4c90 0x7efe180b71a0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:44.791 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.787+0000 7efe3510e640 1 --2- 172.21.15.5:0/3084743251 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7efe30109950 0x7efe3019f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:44.791 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.787+0000 7efe3510e640 1 --2- 172.21.15.5:0/3084743251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe30109000 0x7efe3019a600 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:44.791 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.787+0000 7efe3510e640 1 --2- 172.21.15.5:0/3084743251 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe301036d0 0x7efe3019a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:44.792 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.787+0000 7efe3510e640 1 -- 172.21.15.5:0/3084743251 >> 172.21.15.5:0/3084743251 conn(0x7efe300ff130 msgr2=0x7efe30101550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:44.792 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.787+0000 7efe3510e640 1 -- 172.21.15.5:0/3084743251 shutdown_connections 2024-08-31T05:43:44.792 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:44.787+0000 7efe3510e640 1 -- 172.21.15.5:0/3084743251 wait complete. 2024-08-31T05:43:45.267 INFO:tasks.workunit.client.0.smithi005.stdout: 10 12945 27.31 MB/sec warmup 32 sec latency 172.558 ms 2024-08-31T05:43:45.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:45 smithi070 ceph-mon[22316]: pgmap v772: 129 pgs: 129 active+clean; 835 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 6.1 MiB/s wr, 406 op/s 2024-08-31T05:43:45.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:45 smithi050 ceph-mon[22146]: pgmap v772: 129 pgs: 129 active+clean; 835 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 6.1 MiB/s wr, 406 op/s 2024-08-31T05:43:45.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:45 smithi005 ceph-mon[18602]: pgmap v772: 129 pgs: 129 active+clean; 835 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 6.1 MiB/s wr, 406 op/s 2024-08-31T05:43:46.268 INFO:tasks.workunit.client.0.smithi005.stdout: 10 13339 27.24 MB/sec warmup 33 sec latency 115.450 ms 2024-08-31T05:43:47.268 INFO:tasks.workunit.client.0.smithi005.stdout: 10 13618 26.78 MB/sec warmup 34 sec latency 94.513 ms 2024-08-31T05:43:47.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:47 smithi070 ceph-mon[22316]: pgmap v773: 129 pgs: 129 active+clean; 838 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 6.2 MiB/s wr, 420 op/s 2024-08-31T05:43:47.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:47 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:43:47.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:47 smithi050 ceph-mon[22146]: pgmap v773: 129 pgs: 129 active+clean; 838 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 6.2 MiB/s wr, 420 op/s 2024-08-31T05:43:47.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:47 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:43:47.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:47 smithi005 ceph-mon[18602]: pgmap v773: 129 pgs: 129 active+clean; 838 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 6.2 MiB/s wr, 420 op/s 2024-08-31T05:43:47.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:47 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:43:48.268 INFO:tasks.workunit.client.0.smithi005.stdout: 10 14032 26.31 MB/sec warmup 35 sec latency 195.323 ms 2024-08-31T05:43:48.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:48 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:43:48.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:48 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:43:48.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:48 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:43:48.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:48 smithi070 ceph-mon[22316]: scrub summary: idle 2024-08-31T05:43:48.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:48 smithi070 ceph-mon[22316]: scrub summary: idle 2024-08-31T05:43:48.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:48 smithi070 ceph-mon[22316]: scrub summary: idle 2024-08-31T05:43:48.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:48 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:43:48.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:48 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:43:48.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:48 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:43:48.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:48 smithi050 ceph-mon[22146]: scrub summary: idle 2024-08-31T05:43:48.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:48 smithi050 ceph-mon[22146]: scrub summary: idle 2024-08-31T05:43:48.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:48 smithi050 ceph-mon[22146]: scrub summary: idle 2024-08-31T05:43:48.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:48 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:43:48.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:48 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:43:48.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:48 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:43:48.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:48 smithi005 ceph-mon[18602]: scrub summary: idle 2024-08-31T05:43:48.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:48 smithi005 ceph-mon[18602]: scrub summary: idle 2024-08-31T05:43:48.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:48 smithi005 ceph-mon[18602]: scrub summary: idle 2024-08-31T05:43:49.268 INFO:tasks.workunit.client.0.smithi005.stdout: 10 14673 26.47 MB/sec warmup 36 sec latency 46.929 ms 2024-08-31T05:43:49.308 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:49 smithi050 ceph-mon[22146]: scrub summary: idle 2024-08-31T05:43:49.308 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:49 smithi050 ceph-mon[22146]: pgmap v774: 129 pgs: 129 active+clean; 832 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 6.3 MiB/s wr, 390 op/s 2024-08-31T05:43:49.335 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:49 smithi070 ceph-mon[22316]: scrub summary: idle 2024-08-31T05:43:49.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:49 smithi070 ceph-mon[22316]: pgmap v774: 129 pgs: 129 active+clean; 832 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 6.3 MiB/s wr, 390 op/s 2024-08-31T05:43:49.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:49 smithi005 ceph-mon[18602]: scrub summary: idle 2024-08-31T05:43:49.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:49 smithi005 ceph-mon[18602]: pgmap v774: 129 pgs: 129 active+clean; 832 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 6.3 MiB/s wr, 390 op/s 2024-08-31T05:43:50.268 INFO:tasks.workunit.client.0.smithi005.stdout: 10 15466 27.08 MB/sec warmup 37 sec latency 163.115 ms 2024-08-31T05:43:51.268 INFO:tasks.workunit.client.0.smithi005.stdout: 10 15967 27.24 MB/sec warmup 38 sec latency 202.289 ms 2024-08-31T05:43:51.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:51 smithi070 ceph-mon[22316]: pgmap v775: 129 pgs: 129 active+clean; 799 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 9.0 MiB/s wr, 450 op/s 2024-08-31T05:43:51.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:51 smithi050 ceph-mon[22146]: pgmap v775: 129 pgs: 129 active+clean; 799 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 9.0 MiB/s wr, 450 op/s 2024-08-31T05:43:51.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:51 smithi005 ceph-mon[18602]: pgmap v775: 129 pgs: 129 active+clean; 799 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 9.0 MiB/s wr, 450 op/s 2024-08-31T05:43:52.268 INFO:tasks.workunit.client.0.smithi005.stdout: 10 16133 26.76 MB/sec warmup 39 sec latency 497.679 ms 2024-08-31T05:43:53.268 INFO:tasks.workunit.client.0.smithi005.stdout: 10 16543 26.78 MB/sec warmup 40 sec latency 229.853 ms 2024-08-31T05:43:53.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:53 smithi070 ceph-mon[22316]: pgmap v776: 129 pgs: 129 active+clean; 799 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 6.0 MiB/s wr, 345 op/s 2024-08-31T05:43:53.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:53 smithi050 ceph-mon[22146]: pgmap v776: 129 pgs: 129 active+clean; 799 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 6.0 MiB/s wr, 345 op/s 2024-08-31T05:43:53.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:53 smithi005 ceph-mon[18602]: pgmap v776: 129 pgs: 129 active+clean; 799 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 6.0 MiB/s wr, 345 op/s 2024-08-31T05:43:54.268 INFO:tasks.workunit.client.0.smithi005.stdout: 10 16986 26.72 MB/sec warmup 41 sec latency 206.471 ms 2024-08-31T05:43:55.268 INFO:tasks.workunit.client.0.smithi005.stdout: 10 17346 26.52 MB/sec warmup 42 sec latency 198.923 ms 2024-08-31T05:43:55.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:55 smithi070 ceph-mon[22316]: pgmap v777: 129 pgs: 129 active+clean; 808 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 6.3 MiB/s wr, 359 op/s 2024-08-31T05:43:55.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:55 smithi050 ceph-mon[22146]: pgmap v777: 129 pgs: 129 active+clean; 808 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 6.3 MiB/s wr, 359 op/s 2024-08-31T05:43:55.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:55 smithi005 ceph-mon[18602]: pgmap v777: 129 pgs: 129 active+clean; 808 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 6.3 MiB/s wr, 359 op/s 2024-08-31T05:43:56.268 INFO:tasks.workunit.client.0.smithi005.stdout: 10 17716 26.17 MB/sec warmup 43 sec latency 172.442 ms 2024-08-31T05:43:57.268 INFO:tasks.workunit.client.0.smithi005.stdout: 10 18043 25.99 MB/sec warmup 44 sec latency 248.477 ms 2024-08-31T05:43:57.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:57 smithi070 ceph-mon[22316]: pgmap v778: 129 pgs: 129 active+clean; 819 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 8.9 MiB/s wr, 455 op/s 2024-08-31T05:43:57.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:57 smithi050 ceph-mon[22146]: pgmap v778: 129 pgs: 129 active+clean; 819 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 8.9 MiB/s wr, 455 op/s 2024-08-31T05:43:57.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:57 smithi005 ceph-mon[18602]: pgmap v778: 129 pgs: 129 active+clean; 819 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 8.9 MiB/s wr, 455 op/s 2024-08-31T05:43:57.900 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.897+0000 7f35fac7f640 1 -- 172.21.15.5:0/4124035493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35f41089e0 msgr2=0x7f35f410f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:57.900 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.897+0000 7f35fac7f640 1 --2- 172.21.15.5:0/4124035493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35f41089e0 0x7f35f410f210 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f35ec009be0 tx=0x7f35ec02a6c0 comp rx=0 tx=0).stop 2024-08-31T05:43:57.900 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.897+0000 7f35fac7f640 1 -- 172.21.15.5:0/4124035493 shutdown_connections 2024-08-31T05:43:57.900 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.897+0000 7f35fac7f640 1 --2- 172.21.15.5:0/4124035493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35f41089e0 0x7f35f410f210 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:57.900 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.897+0000 7f35fac7f640 1 --2- 172.21.15.5:0/4124035493 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35f4108090 0x7f35f41084a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:57.900 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.897+0000 7f35fac7f640 1 --2- 172.21.15.5:0/4124035493 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35f4102760 0x7f35f4102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:57.900 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.897+0000 7f35fac7f640 1 -- 172.21.15.5:0/4124035493 >> 172.21.15.5:0/4124035493 conn(0x7f35f40fe160 msgr2=0x7f35f41005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:57.901 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.898+0000 7f35fac7f640 1 -- 172.21.15.5:0/4124035493 shutdown_connections 2024-08-31T05:43:57.901 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.898+0000 7f35fac7f640 1 -- 172.21.15.5:0/4124035493 wait complete. 2024-08-31T05:43:57.903 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.898+0000 7f35fac7f640 1 Processor -- start 2024-08-31T05:43:57.903 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.898+0000 7f35fac7f640 1 -- start start 2024-08-31T05:43:57.903 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.899+0000 7f35fac7f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35f4102760 0x7f35f419afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:57.903 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.899+0000 7f35fac7f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35f4108090 0x7f35f419b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:57.903 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.899+0000 7f35fac7f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35f41089e0 0x7f35f419ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:57.903 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.899+0000 7f35fac7f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f35f41126b0 con 0x7f35f4102760 2024-08-31T05:43:57.903 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.899+0000 7f35fac7f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f35f4112530 con 0x7f35f4108090 2024-08-31T05:43:57.904 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.899+0000 7f35fac7f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f35f4112830 con 0x7f35f41089e0 2024-08-31T05:43:57.904 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.899+0000 7f35f8a1b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35f4102760 0x7f35f419afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:57.904 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.899+0000 7f35f8a1b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35f4102760 0x7f35f419afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40864/0 (socket says 172.21.15.5:40864) 2024-08-31T05:43:57.904 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.899+0000 7f35f3fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35f4108090 0x7f35f419b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:57.904 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.899+0000 7f35f8a1b640 1 -- 172.21.15.5:0/1489906497 learned_addr learned my addr 172.21.15.5:0/1489906497 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:57.904 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.899+0000 7f35f921c640 1 --2- 172.21.15.5:0/1489906497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35f41089e0 0x7f35f419ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:57.904 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.899+0000 7f35f8a1b640 1 -- 172.21.15.5:0/1489906497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35f41089e0 msgr2=0x7f35f419ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:57.904 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.899+0000 7f35f8a1b640 1 --2- 172.21.15.5:0/1489906497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35f41089e0 0x7f35f419ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:57.904 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.899+0000 7f35f8a1b640 1 -- 172.21.15.5:0/1489906497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35f4108090 msgr2=0x7f35f419b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:57.904 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.899+0000 7f35f8a1b640 1 --2- 172.21.15.5:0/1489906497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35f4108090 0x7f35f419b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:57.904 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.899+0000 7f35f8a1b640 1 -- 172.21.15.5:0/1489906497 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35f41a6280 con 0x7f35f4102760 2024-08-31T05:43:57.904 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.899+0000 7f35f3fff640 1 --2- 172.21.15.5:0/1489906497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35f4108090 0x7f35f419b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:43:57.904 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.900+0000 7f35f8a1b640 1 --2- 172.21.15.5:0/1489906497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35f4102760 0x7f35f419afc0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f35e800e9f0 tx=0x7f35e800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:57.905 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.900+0000 7f35f1ffb640 1 -- 172.21.15.5:0/1489906497 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e800ccc0 con 0x7f35f4102760 2024-08-31T05:43:57.905 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.900+0000 7f35f1ffb640 1 -- 172.21.15.5:0/1489906497 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35e800ce60 con 0x7f35f4102760 2024-08-31T05:43:57.905 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.900+0000 7f35f1ffb640 1 -- 172.21.15.5:0/1489906497 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e8010430 con 0x7f35f4102760 2024-08-31T05:43:57.905 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.900+0000 7f35fac7f640 1 -- 172.21.15.5:0/1489906497 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35f41a6570 con 0x7f35f4102760 2024-08-31T05:43:57.905 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.900+0000 7f35fac7f640 1 -- 172.21.15.5:0/1489906497 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35f41a6ac0 con 0x7f35f4102760 2024-08-31T05:43:57.905 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.904+0000 7f35f1ffb640 1 -- 172.21.15.5:0/1489906497 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f35e80046c0 con 0x7f35f4102760 2024-08-31T05:43:57.907 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.905+0000 7f3601be1740 1 Processor -- start 2024-08-31T05:43:57.907 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.905+0000 7f3601be1740 1 -- start start 2024-08-31T05:43:57.907 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.905+0000 7f35f1ffb640 1 --2- 172.21.15.5:0/1489906497 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f35e40b4d20 0x7f35e40b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:57.907 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.905+0000 7f35f921c640 1 --2- 172.21.15.5:0/1489906497 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f35e40b4d20 0x7f35e40b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:57.907 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.905+0000 7f3601be1740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ffec9331b0 0x55ffeccd6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:57.908 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.905+0000 7f3601be1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffec90a2f0 0x55ffeccd7000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:57.908 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.905+0000 7f3601be1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ffec9124d0 0x55ffeccd7540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:57.908 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.905+0000 7f3601be1740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55ffecc4c000 con 0x55ffec9331b0 2024-08-31T05:43:57.908 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.905+0000 7f3601be1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ffecc3b590 con 0x55ffec9124d0 2024-08-31T05:43:57.908 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.905+0000 7f3601be1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ffecc3f540 con 0x55ffec90a2f0 2024-08-31T05:43:57.908 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.905+0000 7f35f1ffb640 1 -- 172.21.15.5:0/1489906497 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9511+0+0 (secure 0 0 0) 0x7f35e80e5c80 con 0x7f35f4102760 2024-08-31T05:43:57.908 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.905+0000 7f35f8a1b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ffec9331b0 0x55ffeccd6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:57.908 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.905+0000 7f35f8a1b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ffec9331b0 0x55ffeccd6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40874/0 (socket says 172.21.15.5:40874) 2024-08-31T05:43:57.908 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.905+0000 7f35f8a1b640 1 -- 172.21.15.5:0/2410742930 learned_addr learned my addr 172.21.15.5:0/2410742930 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:57.908 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.905+0000 7f35f921c640 1 --2- 172.21.15.5:0/2410742930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ffec9124d0 0x55ffeccd7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:57.909 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.906+0000 7f35f8a1b640 1 -- 172.21.15.5:0/2410742930 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffec90a2f0 msgr2=0x55ffeccd7000 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T05:43:57.909 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.906+0000 7f35f8a1b640 1 --2- 172.21.15.5:0/2410742930 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffec90a2f0 0x55ffeccd7000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:57.909 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.906+0000 7f35f8a1b640 1 -- 172.21.15.5:0/2410742930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ffec9124d0 msgr2=0x55ffeccd7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:57.909 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.906+0000 7f35f8a1b640 1 --2- 172.21.15.5:0/2410742930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ffec9124d0 0x55ffeccd7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:57.909 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.906+0000 7f35f8a1b640 1 -- 172.21.15.5:0/2410742930 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffec99e790 con 0x55ffec9331b0 2024-08-31T05:43:57.909 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.906+0000 7f35f8a1b640 1 --2- 172.21.15.5:0/2410742930 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ffec9331b0 0x55ffeccd6ac0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f35e80abf20 tx=0x7f35e80abbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fee20c80d9c177df server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:57.909 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.906+0000 7f35f921c640 1 --2- 172.21.15.5:0/1489906497 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f35e40b4d20 0x7f35e40b7230 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f35ec009370 tx=0x7f35ec030760 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:57.909 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.906+0000 7f35deffd640 1 -- 172.21.15.5:0/2410742930 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e80b52b0 con 0x55ffec9331b0 2024-08-31T05:43:57.909 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.906+0000 7f35deffd640 1 -- 172.21.15.5:0/2410742930 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35e80a8220 con 0x55ffec9331b0 2024-08-31T05:43:57.909 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.906+0000 7f35deffd640 1 -- 172.21.15.5:0/2410742930 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e80b3da0 con 0x55ffec9331b0 2024-08-31T05:43:57.913 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.907+0000 7f3601be1740 1 -- 172.21.15.5:0/2410742930 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ffec9331b0 msgr2=0x55ffeccd6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:57.913 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.907+0000 7f3601be1740 1 --2- 172.21.15.5:0/2410742930 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ffec9331b0 0x55ffeccd6ac0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f35e80abf20 tx=0x7f35e80abbe0 comp rx=0 tx=0).stop 2024-08-31T05:43:57.913 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.907+0000 7f3601be1740 1 -- 172.21.15.5:0/2410742930 shutdown_connections 2024-08-31T05:43:57.913 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.908+0000 7f3601be1740 1 --2- 172.21.15.5:0/2410742930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ffec9124d0 0x55ffeccd7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:57.913 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.908+0000 7f3601be1740 1 --2- 172.21.15.5:0/2410742930 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffec90a2f0 0x55ffeccd7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:57.913 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.908+0000 7f3601be1740 1 --2- 172.21.15.5:0/2410742930 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ffec9331b0 0x55ffeccd6ac0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:57.913 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.908+0000 7f3601be1740 1 -- 172.21.15.5:0/2410742930 >> 172.21.15.5:0/2410742930 conn(0x55ffec927300 msgr2=0x55ffeccd49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:57.913 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.908+0000 7f3601be1740 1 -- 172.21.15.5:0/2410742930 shutdown_connections 2024-08-31T05:43:57.913 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.908+0000 7f3601be1740 1 -- 172.21.15.5:0/2410742930 wait complete. 2024-08-31T05:43:57.914 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.908+0000 7f3601be1740 1 -- start start 2024-08-31T05:43:57.914 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.908+0000 7f3601be1740 1 Processor -- start 2024-08-31T05:43:57.914 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.909+0000 7f3601be1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffec90a2f0 0x55ffecce26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:57.914 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.909+0000 7f3601be1740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ffec9124d0 0x55ffecce2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:57.914 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.909+0000 7f3601be1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ffec9331b0 0x55ffeccf2940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:57.914 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.909+0000 7f3601be1740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55ffecb74ab0 con 0x55ffec9124d0 2024-08-31T05:43:57.914 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.909+0000 7f3601be1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55ffecbc2680 con 0x55ffec9331b0 2024-08-31T05:43:57.914 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.909+0000 7f3601be1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ffecce9650 con 0x55ffec90a2f0 2024-08-31T05:43:57.914 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.909+0000 7f3601be1740 10 client.0 _ll_register_callbacks cb 0x55ffec94aa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:43:57.914 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.909+0000 7f35f8a1b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffec90a2f0 0x55ffecce26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:57.914 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.909+0000 7f35f8a1b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffec90a2f0 0x55ffecce26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:34452/0 (socket says 172.21.15.5:34452) 2024-08-31T05:43:57.914 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.909+0000 7f35f8a1b640 1 -- 172.21.15.5:0/1661237363 learned_addr learned my addr 172.21.15.5:0/1661237363 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:57.914 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.909+0000 7f35f921c640 1 --2- 172.21.15.5:0/1661237363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ffec9331b0 0x55ffeccf2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:57.915 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.909+0000 7f35f3fff640 1 --2- 172.21.15.5:0/1661237363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ffec9124d0 0x55ffecce2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:57.915 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.909+0000 7f35f8a1b640 1 -- 172.21.15.5:0/1661237363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ffec9331b0 msgr2=0x55ffeccf2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:57.915 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.909+0000 7f35f8a1b640 1 --2- 172.21.15.5:0/1661237363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ffec9331b0 0x55ffeccf2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:57.915 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.909+0000 7f35f8a1b640 1 -- 172.21.15.5:0/1661237363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ffec9124d0 msgr2=0x55ffecce2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:57.915 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.909+0000 7f35f8a1b640 1 --2- 172.21.15.5:0/1661237363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ffec9124d0 0x55ffecce2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:57.915 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.909+0000 7f35f8a1b640 1 -- 172.21.15.5:0/1661237363 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffeca17620 con 0x55ffec90a2f0 2024-08-31T05:43:57.915 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.909+0000 7f35f8a1b640 1 --2- 172.21.15.5:0/1661237363 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffec90a2f0 0x55ffecce26b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f35e80abc90 tx=0x7f35e80b3e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d83a6b0ae5ad0077 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:57.915 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.910+0000 7f35d3fff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:43:57.915 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.910+0000 7f35d3fff640 1 -- 172.21.15.5:0/1661237363 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e8097020 con 0x55ffec90a2f0 2024-08-31T05:43:57.915 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.910+0000 7f35d3fff640 1 -- 172.21.15.5:0/1661237363 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9511+0+0 (secure 0 0 0) 0x7f35e80ab400 con 0x55ffec90a2f0 2024-08-31T05:43:57.915 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.910+0000 7f3601be1740 1 -- 172.21.15.5:0/1661237363 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35e80a8220 con 0x55ffec90a2f0 2024-08-31T05:43:57.915 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.910+0000 7f35d3fff640 1 -- 172.21.15.5:0/1661237363 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f35e80b52b0 con 0x55ffec90a2f0 2024-08-31T05:43:57.915 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.910+0000 7f3601be1740 10 client.28831 fetch_fsmap learned FSMap version 36 2024-08-31T05:43:57.915 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.910+0000 7f3601be1740 1 -- 172.21.15.5:0/1661237363 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55ffeccf5690 con 0x55ffec90a2f0 2024-08-31T05:43:57.916 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.910+0000 7f35d3fff640 1 -- 172.21.15.5:0/1661237363 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35e80971c0 con 0x55ffec90a2f0 2024-08-31T05:43:57.916 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.910+0000 7f35d3fff640 1 -- 172.21.15.5:0/1661237363 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 36) ==== 8386+0+0 (secure 0 0 0) 0x7f35e8093070 con 0x55ffec90a2f0 2024-08-31T05:43:57.916 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.910+0000 7f3601be1740 10 client.28831 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T05:43:57.916 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.910+0000 7f3601be1740 10 client.28831 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:43:57.916 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.910+0000 7f3601be1740 20 client.28831 populate_metadata read hostname 'smithi005' 2024-08-31T05:43:57.916 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.910+0000 7f3601be1740 1 --2- 172.21.15.5:0/1661237363 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55ffec8f1d80 0x55ffeccf89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:57.916 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.910+0000 7f3601be1740 4 client.28831 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:43:57.916 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.910+0000 7f3601be1740 1 -- 172.21.15.5:0/1661237363 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f35e80a8220 con 0x55ffec8f1d80 2024-08-31T05:43:57.916 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.911+0000 7f35f3fff640 1 --2- 172.21.15.5:0/1661237363 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55ffec8f1d80 0x55ffeccf89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:57.916 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.911+0000 7f35f3fff640 1 --2- 172.21.15.5:0/1661237363 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55ffec8f1d80 0x55ffeccf89f0 crc :-1 s=READY pgs=303 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4da0b435ace994e server_cookie=cb14601aa114b7f5 in_seq=0 out_seq=0 2024-08-31T05:43:57.916 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.911+0000 7f35d3fff640 10 client.28831 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:43:57.917 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.912+0000 7f35d3fff640 1 -- 172.21.15.5:0/1661237363 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f35e80a8220 con 0x55ffec8f1d80 2024-08-31T05:43:57.918 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.912+0000 7f35d3fff640 10 client.28831 handle_command_reply: tid=0 2024-08-31T05:43:57.918 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.912+0000 7f3601be1740 1 client.28831 shutdown 2024-08-31T05:43:57.918 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.912+0000 7f3601be1740 1 -- 172.21.15.5:0/1661237363 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffec90a2f0 msgr2=0x55ffecce26b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:57.918 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.912+0000 7f3601be1740 1 --2- 172.21.15.5:0/1661237363 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffec90a2f0 0x55ffecce26b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f35e80abc90 tx=0x7f35e80b3e30 comp rx=0 tx=0).stop 2024-08-31T05:43:57.918 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.912+0000 7f3601be1740 1 -- 172.21.15.5:0/1661237363 shutdown_connections 2024-08-31T05:43:57.918 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.912+0000 7f3601be1740 1 --2- 172.21.15.5:0/1661237363 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55ffec8f1d80 0x55ffeccf89f0 crc :-1 s=READY pgs=303 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:57.918 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.912+0000 7f35d3fff640 0 client.28831 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:43:57.918 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.912+0000 7f3601be1740 1 --2- 172.21.15.5:0/1661237363 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ffec9331b0 0x55ffeccf2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:57.918 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.912+0000 7f3601be1740 1 --2- 172.21.15.5:0/1661237363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ffec9124d0 0x55ffecce2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:57.918 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.912+0000 7f3601be1740 1 --2- 172.21.15.5:0/1661237363 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffec90a2f0 0x55ffecce26b0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:57.918 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.912+0000 7f3601be1740 1 -- 172.21.15.5:0/1661237363 >> 172.21.15.5:0/1661237363 conn(0x55ffec927300 msgr2=0x55ffeccd7af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:57.918 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.912+0000 7f3601be1740 1 -- 172.21.15.5:0/1661237363 shutdown_connections 2024-08-31T05:43:57.918 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.912+0000 7f3601be1740 1 -- 172.21.15.5:0/1661237363 wait complete. 2024-08-31T05:43:57.918 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.912+0000 7f3601be1740 20 client.28831 trim_cache size 0 max 16384 2024-08-31T05:43:57.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.931+0000 7f3601be1740 1 Processor -- start 2024-08-31T05:43:57.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.931+0000 7f3601be1740 1 -- start start 2024-08-31T05:43:57.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.932+0000 7f3601be1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffec8f1d80 0x55ffeccf28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:57.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.932+0000 7f3601be1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ffec90a2f0 0x55ffeccf2df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:57.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.932+0000 7f3601be1740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ffec9124d0 0x55ffeccd4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:57.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.932+0000 7f3601be1740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f35f41aeb40 con 0x55ffec9124d0 2024-08-31T05:43:57.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.932+0000 7f3601be1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f35f41b0740 con 0x55ffec90a2f0 2024-08-31T05:43:57.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.932+0000 7f3601be1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f35f41af210 con 0x55ffec8f1d80 2024-08-31T05:43:57.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.932+0000 7f35f921c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ffec9124d0 0x55ffeccd4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:57.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.932+0000 7f35f921c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ffec9124d0 0x55ffeccd4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40890/0 (socket says 172.21.15.5:40890) 2024-08-31T05:43:57.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.932+0000 7f35f921c640 1 -- 172.21.15.5:0/2863815173 learned_addr learned my addr 172.21.15.5:0/2863815173 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:57.935 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.932+0000 7f35f3fff640 1 --2- 172.21.15.5:0/2863815173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ffec90a2f0 0x55ffeccf2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:57.936 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.932+0000 7f35f8a1b640 1 --2- 172.21.15.5:0/2863815173 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffec8f1d80 0x55ffeccf28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:57.936 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.932+0000 7f35f921c640 1 -- 172.21.15.5:0/2863815173 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffec8f1d80 msgr2=0x55ffeccf28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:57.936 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.932+0000 7f35f921c640 1 --2- 172.21.15.5:0/2863815173 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffec8f1d80 0x55ffeccf28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:57.936 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.932+0000 7f35f921c640 1 -- 172.21.15.5:0/2863815173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ffec90a2f0 msgr2=0x55ffeccf2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:57.936 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.932+0000 7f35f921c640 1 --2- 172.21.15.5:0/2863815173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ffec90a2f0 0x55ffeccf2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:57.936 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.932+0000 7f35f921c640 1 -- 172.21.15.5:0/2863815173 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffecce0980 con 0x55ffec9124d0 2024-08-31T05:43:57.936 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.932+0000 7f35f3fff640 1 --2- 172.21.15.5:0/2863815173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ffec90a2f0 0x55ffeccf2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:43:57.936 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.932+0000 7f35f921c640 1 --2- 172.21.15.5:0/2863815173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ffec9124d0 0x55ffeccd4310 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f35ec02acb0 tx=0x7f35ec044000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=457f12751d2e82b4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:57.936 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.933+0000 7f35de7fc640 1 -- 172.21.15.5:0/2863815173 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35ec036040 con 0x55ffec9124d0 2024-08-31T05:43:57.936 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.933+0000 7f35de7fc640 1 -- 172.21.15.5:0/2863815173 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35ec031af0 con 0x55ffec9124d0 2024-08-31T05:43:57.936 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.933+0000 7f35de7fc640 1 -- 172.21.15.5:0/2863815173 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35ec04cb10 con 0x55ffec9124d0 2024-08-31T05:43:57.940 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.934+0000 7f3601be1740 1 -- 172.21.15.5:0/2863815173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ffec9124d0 msgr2=0x55ffeccd4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:57.940 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.934+0000 7f3601be1740 1 --2- 172.21.15.5:0/2863815173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ffec9124d0 0x55ffeccd4310 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f35ec02acb0 tx=0x7f35ec044000 comp rx=0 tx=0).stop 2024-08-31T05:43:57.940 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.934+0000 7f3601be1740 1 -- 172.21.15.5:0/2863815173 shutdown_connections 2024-08-31T05:43:57.940 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.934+0000 7f3601be1740 1 --2- 172.21.15.5:0/2863815173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ffec9124d0 0x55ffeccd4310 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:57.940 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.934+0000 7f3601be1740 1 --2- 172.21.15.5:0/2863815173 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ffec90a2f0 0x55ffeccf2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:57.940 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.934+0000 7f3601be1740 1 --2- 172.21.15.5:0/2863815173 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffec8f1d80 0x55ffeccf28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:57.940 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.934+0000 7f3601be1740 1 -- 172.21.15.5:0/2863815173 >> 172.21.15.5:0/2863815173 conn(0x55ffec927300 msgr2=0x55ffecce0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:57.940 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.934+0000 7f3601be1740 1 -- 172.21.15.5:0/2863815173 shutdown_connections 2024-08-31T05:43:57.941 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.934+0000 7f3601be1740 1 -- 172.21.15.5:0/2863815173 wait complete. 2024-08-31T05:43:57.941 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.934+0000 7f3601be1740 1 -- start start 2024-08-31T05:43:57.941 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.934+0000 7f3601be1740 1 Processor -- start 2024-08-31T05:43:57.941 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.935+0000 7f3601be1740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ffec8f1d80 0x55ffeccfa3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:57.941 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.935+0000 7f3601be1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffec90a2f0 0x55ffeccfa950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:57.941 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.935+0000 7f3601be1740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ffec9124d0 0x55ffecd5c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:57.941 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.935+0000 7f3601be1740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f35f41b0070 con 0x55ffec8f1d80 2024-08-31T05:43:57.941 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.935+0000 7f3601be1740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f35f41af9a0 con 0x55ffec9124d0 2024-08-31T05:43:57.941 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.935+0000 7f3601be1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f35f41acb40 con 0x55ffec90a2f0 2024-08-31T05:43:57.941 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.935+0000 7f3601be1740 10 client.0 _ll_register_callbacks cb 0x7f35e80ab760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:43:57.941 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.935+0000 7f35f8a1b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ffec8f1d80 0x55ffeccfa3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:57.941 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.935+0000 7f35f8a1b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ffec8f1d80 0x55ffeccfa3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40894/0 (socket says 172.21.15.5:40894) 2024-08-31T05:43:57.941 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.935+0000 7f35f8a1b640 1 -- 172.21.15.5:0/504387773 learned_addr learned my addr 172.21.15.5:0/504387773 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:43:57.942 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.935+0000 7f35f921c640 1 --2- 172.21.15.5:0/504387773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ffec9124d0 0x55ffecd5c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:57.942 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.935+0000 7f35f3fff640 1 --2- 172.21.15.5:0/504387773 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffec90a2f0 0x55ffeccfa950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:57.942 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.935+0000 7f35f8a1b640 1 -- 172.21.15.5:0/504387773 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffec90a2f0 msgr2=0x55ffeccfa950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:57.942 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.935+0000 7f35f8a1b640 1 --2- 172.21.15.5:0/504387773 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffec90a2f0 0x55ffeccfa950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:57.942 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.935+0000 7f35f8a1b640 1 -- 172.21.15.5:0/504387773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ffec9124d0 msgr2=0x55ffecd5c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:43:57.942 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.935+0000 7f35f8a1b640 1 --2- 172.21.15.5:0/504387773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ffec9124d0 0x55ffecd5c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:57.942 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.935+0000 7f35f8a1b640 1 -- 172.21.15.5:0/504387773 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffecd5c820 con 0x55ffec8f1d80 2024-08-31T05:43:57.942 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.935+0000 7f35f921c640 1 --2- 172.21.15.5:0/504387773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ffec9124d0 0x55ffecd5c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:43:57.942 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.935+0000 7f35f8a1b640 1 --2- 172.21.15.5:0/504387773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ffec8f1d80 0x55ffeccfa3b0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f35e80e35f0 tx=0x7f35e80b1a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=640403da77239b7f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:43:57.942 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.935+0000 7f35d3fff640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:43:57.942 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.936+0000 7f35d3fff640 1 -- 172.21.15.5:0/504387773 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e8097040 con 0x55ffec8f1d80 2024-08-31T05:43:57.942 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.936+0000 7f35d3fff640 1 -- 172.21.15.5:0/504387773 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9511+0+0 (secure 0 0 0) 0x7f35e80930f0 con 0x55ffec8f1d80 2024-08-31T05:43:57.942 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.936+0000 7f3601be1740 1 -- 172.21.15.5:0/504387773 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35ec031af0 con 0x55ffec8f1d80 2024-08-31T05:43:57.942 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.936+0000 7f35d3fff640 1 -- 172.21.15.5:0/504387773 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f35e80a7e50 con 0x55ffec8f1d80 2024-08-31T05:43:57.943 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.936+0000 7f3601be1740 10 client.19272 fetch_fsmap learned FSMap version 36 2024-08-31T05:43:57.943 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.936+0000 7f3601be1740 1 -- 172.21.15.5:0/504387773 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55ffecd63b90 con 0x55ffec8f1d80 2024-08-31T05:43:57.943 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.936+0000 7f35d3fff640 1 -- 172.21.15.5:0/504387773 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35ec031af0 con 0x55ffec8f1d80 2024-08-31T05:43:57.943 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.936+0000 7f35d3fff640 1 -- 172.21.15.5:0/504387773 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 36) ==== 8386+0+0 (secure 0 0 0) 0x7f35e80aac60 con 0x55ffec8f1d80 2024-08-31T05:43:57.943 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.936+0000 7f3601be1740 10 client.19272 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T05:43:57.943 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.936+0000 7f3601be1740 10 client.19272 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:43:57.943 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.936+0000 7f3601be1740 20 client.19272 populate_metadata read hostname 'smithi005' 2024-08-31T05:43:57.943 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.936+0000 7f3601be1740 1 --2- 172.21.15.5:0/504387773 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55ffec9331b0 0x55ffecd66190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:43:57.943 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.936+0000 7f3601be1740 4 client.19272 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:43:57.943 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.936+0000 7f3601be1740 1 -- 172.21.15.5:0/504387773 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ffecc4df50 con 0x55ffec9331b0 2024-08-31T05:43:57.943 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.936+0000 7f35f3fff640 1 --2- 172.21.15.5:0/504387773 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55ffec9331b0 0x55ffecd66190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:43:57.943 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.937+0000 7f35d3fff640 10 client.19272 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:43:57.943 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:57.937+0000 7f35f3fff640 1 --2- 172.21.15.5:0/504387773 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55ffec9331b0 0x55ffecd66190 crc :-1 s=READY pgs=304 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfc20b0539bdd1fa server_cookie=8dadd97dea8eb54b in_seq=0 out_seq=0 2024-08-31T05:43:58.134 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:58.131+0000 7f35d3fff640 1 -- 172.21.15.5:0/504387773 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ffecc4df50 con 0x55ffec9331b0 2024-08-31T05:43:58.134 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:58.131+0000 7f35d3fff640 10 client.19272 handle_command_reply: tid=0 2024-08-31T05:43:58.134 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:58.131+0000 7f3601be1740 1 client.19272 shutdown 2024-08-31T05:43:58.134 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:58.131+0000 7f3601be1740 1 -- 172.21.15.5:0/504387773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ffec8f1d80 msgr2=0x55ffeccfa3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:58.134 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:58.131+0000 7f3601be1740 1 --2- 172.21.15.5:0/504387773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ffec8f1d80 0x55ffeccfa3b0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f35e80e35f0 tx=0x7f35e80b1a50 comp rx=0 tx=0).stop 2024-08-31T05:43:58.134 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:58.131+0000 7f3601be1740 1 -- 172.21.15.5:0/504387773 shutdown_connections 2024-08-31T05:43:58.134 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:58.131+0000 7f3601be1740 1 --2- 172.21.15.5:0/504387773 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55ffec9331b0 0x55ffecd66190 crc :-1 s=READY pgs=304 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:58.134 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:58.131+0000 7f3601be1740 1 --2- 172.21.15.5:0/504387773 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55ffec9124d0 0x55ffecd5c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:58.135 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:58.131+0000 7f3601be1740 1 --2- 172.21.15.5:0/504387773 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffec90a2f0 0x55ffeccfa950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:58.135 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:58.131+0000 7f35d3fff640 0 client.19272 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:43:58.135 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:58.131+0000 7f3601be1740 1 --2- 172.21.15.5:0/504387773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ffec8f1d80 0x55ffeccfa3b0 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:58.135 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:58.131+0000 7f3601be1740 1 -- 172.21.15.5:0/504387773 >> 172.21.15.5:0/504387773 conn(0x55ffec927300 msgr2=0x55ffeccd42a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:58.135 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:58.132+0000 7f3601be1740 1 -- 172.21.15.5:0/504387773 shutdown_connections 2024-08-31T05:43:58.135 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:58.132+0000 7f3601be1740 1 -- 172.21.15.5:0/504387773 wait complete. 2024-08-31T05:43:58.135 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:58.132+0000 7f3601be1740 20 client.19272 trim_cache size 0 max 16384 2024-08-31T05:43:58.135 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:43:58.135 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:43:58.135 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:43:58.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:43:58.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:58.132+0000 7f35fac7f640 1 -- 172.21.15.5:0/1489906497 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f35e40b4d20 msgr2=0x7f35e40b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:58.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:58.133+0000 7f35fac7f640 1 --2- 172.21.15.5:0/1489906497 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f35e40b4d20 0x7f35e40b7230 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f35ec009370 tx=0x7f35ec030760 comp rx=0 tx=0).stop 2024-08-31T05:43:58.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:58.133+0000 7f35fac7f640 1 -- 172.21.15.5:0/1489906497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35f4102760 msgr2=0x7f35f419afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:43:58.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:58.133+0000 7f35fac7f640 1 --2- 172.21.15.5:0/1489906497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35f4102760 0x7f35f419afc0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f35e800e9f0 tx=0x7f35e800edf0 comp rx=0 tx=0).stop 2024-08-31T05:43:58.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:58.133+0000 7f35fac7f640 1 -- 172.21.15.5:0/1489906497 shutdown_connections 2024-08-31T05:43:58.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:58.133+0000 7f35fac7f640 1 --2- 172.21.15.5:0/1489906497 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f35e40b4d20 0x7f35e40b7230 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:58.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:58.133+0000 7f35fac7f640 1 --2- 172.21.15.5:0/1489906497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35f41089e0 0x7f35f419ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:58.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:58.133+0000 7f35fac7f640 1 --2- 172.21.15.5:0/1489906497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f35f4108090 0x7f35f419b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:58.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:58.133+0000 7f35fac7f640 1 --2- 172.21.15.5:0/1489906497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35f4102760 0x7f35f419afc0 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:43:58.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:58.133+0000 7f35fac7f640 1 -- 172.21.15.5:0/1489906497 >> 172.21.15.5:0/1489906497 conn(0x7f35f40fe160 msgr2=0x7f35f4105620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:43:58.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:58.133+0000 7f35fac7f640 1 -- 172.21.15.5:0/1489906497 shutdown_connections 2024-08-31T05:43:58.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:43:58.133+0000 7f35fac7f640 1 -- 172.21.15.5:0/1489906497 wait complete. 2024-08-31T05:43:58.268 INFO:tasks.workunit.client.0.smithi005.stdout: 10 18521 25.92 MB/sec warmup 45 sec latency 126.726 ms 2024-08-31T05:43:59.268 INFO:tasks.workunit.client.0.smithi005.stdout: 10 19067 26.09 MB/sec warmup 46 sec latency 107.685 ms 2024-08-31T05:43:59.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:43:59 smithi070 ceph-mon[22316]: pgmap v779: 129 pgs: 129 active+clean; 817 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 8.5 MiB/s wr, 429 op/s 2024-08-31T05:43:59.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:43:59 smithi050 ceph-mon[22146]: pgmap v779: 129 pgs: 129 active+clean; 817 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 8.5 MiB/s wr, 429 op/s 2024-08-31T05:43:59.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:43:59 smithi005 ceph-mon[18602]: pgmap v779: 129 pgs: 129 active+clean; 817 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 8.5 MiB/s wr, 429 op/s 2024-08-31T05:44:00.268 INFO:tasks.workunit.client.0.smithi005.stdout: 10 19578 26.02 MB/sec warmup 47 sec latency 250.556 ms 2024-08-31T05:44:01.268 INFO:tasks.workunit.client.0.smithi005.stdout: 10 19578 25.47 MB/sec warmup 48 sec latency 1250.626 ms 2024-08-31T05:44:01.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:44:01 smithi070 ceph-mon[22316]: pgmap v780: 129 pgs: 129 active+clean; 830 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 9.7 MiB/s wr, 514 op/s 2024-08-31T05:44:01.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:44:01 smithi050 ceph-mon[22146]: pgmap v780: 129 pgs: 129 active+clean; 830 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 9.7 MiB/s wr, 514 op/s 2024-08-31T05:44:01.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:44:01 smithi005 ceph-mon[18602]: pgmap v780: 129 pgs: 129 active+clean; 830 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 9.7 MiB/s wr, 514 op/s 2024-08-31T05:44:02.268 INFO:tasks.workunit.client.0.smithi005.stdout: 10 19613 24.96 MB/sec warmup 49 sec latency 2236.875 ms 2024-08-31T05:44:03.268 INFO:tasks.workunit.client.0.smithi005.stdout: 10 19930 24.81 MB/sec warmup 50 sec latency 464.731 ms 2024-08-31T05:44:03.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:44:03 smithi070 ceph-mon[22316]: pgmap v781: 129 pgs: 129 active+clean; 832 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 6.4 MiB/s wr, 434 op/s 2024-08-31T05:44:03.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:44:03 smithi050 ceph-mon[22146]: pgmap v781: 129 pgs: 129 active+clean; 832 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 6.4 MiB/s wr, 434 op/s 2024-08-31T05:44:03.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:44:03 smithi005 ceph-mon[18602]: pgmap v781: 129 pgs: 129 active+clean; 832 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 6.4 MiB/s wr, 434 op/s 2024-08-31T05:44:04.268 INFO:tasks.workunit.client.0.smithi005.stdout: 10 20080 24.44 MB/sec warmup 51 sec latency 342.366 ms 2024-08-31T05:44:05.268 INFO:tasks.workunit.client.0.smithi005.stdout: 10 20150 24.13 MB/sec warmup 52 sec latency 237.062 ms 2024-08-31T05:44:05.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:44:05 smithi070 ceph-mon[22316]: pgmap v782: 129 pgs: 129 active+clean; 831 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 6.7 MiB/s wr, 474 op/s 2024-08-31T05:44:05.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:44:05 smithi050 ceph-mon[22146]: pgmap v782: 129 pgs: 129 active+clean; 831 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 6.7 MiB/s wr, 474 op/s 2024-08-31T05:44:05.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:44:05 smithi005 ceph-mon[18602]: pgmap v782: 129 pgs: 129 active+clean; 831 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 6.7 MiB/s wr, 474 op/s 2024-08-31T05:44:06.269 INFO:tasks.workunit.client.0.smithi005.stdout: 10 20439 24.08 MB/sec warmup 53 sec latency 474.908 ms 2024-08-31T05:44:07.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:44:07 smithi005 ceph-mon[18602]: pgmap v783: 129 pgs: 129 active+clean; 830 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 7.8 MiB/s wr, 571 op/s 2024-08-31T05:44:07.268 INFO:tasks.workunit.client.0.smithi005.stdout: 10 20757 24.02 MB/sec warmup 54 sec latency 130.933 ms 2024-08-31T05:44:07.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:44:07 smithi070 ceph-mon[22316]: pgmap v783: 129 pgs: 129 active+clean; 830 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 7.8 MiB/s wr, 571 op/s 2024-08-31T05:44:07.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:44:07 smithi050 ceph-mon[22146]: pgmap v783: 129 pgs: 129 active+clean; 830 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 7.8 MiB/s wr, 571 op/s 2024-08-31T05:44:07.485 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T05:44:07.764 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:44:08.268 INFO:tasks.workunit.client.0.smithi005.stdout: 10 21079 23.96 MB/sec warmup 55 sec latency 198.666 ms 2024-08-31T05:44:08.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.957+0000 7f18571b3640 1 -- 172.21.15.5:0/912306428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1850108a90 msgr2=0x7f185010f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:08.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.957+0000 7f18571b3640 1 --2- 172.21.15.5:0/912306428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1850108a90 0x7f185010f2c0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f1848009ca0 tx=0x7f184802a8c0 comp rx=0 tx=0).stop 2024-08-31T05:44:08.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.957+0000 7f18571b3640 1 -- 172.21.15.5:0/912306428 shutdown_connections 2024-08-31T05:44:08.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.957+0000 7f18571b3640 1 --2- 172.21.15.5:0/912306428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1850108a90 0x7f185010f2c0 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:08.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.957+0000 7f18571b3640 1 --2- 172.21.15.5:0/912306428 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1850108140 0x7f1850108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:08.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.957+0000 7f18571b3640 1 --2- 172.21.15.5:0/912306428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1850102800 0x7f1850102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:08.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.957+0000 7f18571b3640 1 -- 172.21.15.5:0/912306428 >> 172.21.15.5:0/912306428 conn(0x7f18500794d0 msgr2=0x7f18500798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:08.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.958+0000 7f18571b3640 1 -- 172.21.15.5:0/912306428 shutdown_connections 2024-08-31T05:44:08.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.958+0000 7f18571b3640 1 -- 172.21.15.5:0/912306428 wait complete. 2024-08-31T05:44:08.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.958+0000 7f18571b3640 1 Processor -- start 2024-08-31T05:44:08.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.959+0000 7f18571b3640 1 -- start start 2024-08-31T05:44:08.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.959+0000 7f18571b3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1850102800 0x7f1850199180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:08.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.959+0000 7f18571b3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1850108140 0x7f1850199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:08.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.959+0000 7f18571b3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1850108a90 0x7f185019e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:08.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.959+0000 7f18571b3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f18501126f0 con 0x7f1850102800 2024-08-31T05:44:08.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.959+0000 7f18571b3640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1850112570 con 0x7f1850108a90 2024-08-31T05:44:08.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.959+0000 7f18571b3640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1850112870 con 0x7f1850108140 2024-08-31T05:44:08.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.959+0000 7f1854f4f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1850102800 0x7f1850199180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:08.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.959+0000 7f1854f4f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1850102800 0x7f1850199180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56514/0 (socket says 172.21.15.5:56514) 2024-08-31T05:44:08.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.959+0000 7f1854f4f640 1 -- 172.21.15.5:0/3632497105 learned_addr learned my addr 172.21.15.5:0/3632497105 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:44:08.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.959+0000 7f184ffff640 1 --2- 172.21.15.5:0/3632497105 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1850108140 0x7f1850199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:08.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.959+0000 7f1855750640 1 --2- 172.21.15.5:0/3632497105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1850108a90 0x7f185019e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:08.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.960+0000 7f1854f4f640 1 -- 172.21.15.5:0/3632497105 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1850108140 msgr2=0x7f1850199720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:08.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.960+0000 7f1854f4f640 1 --2- 172.21.15.5:0/3632497105 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1850108140 0x7f1850199720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:08.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.960+0000 7f1854f4f640 1 -- 172.21.15.5:0/3632497105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1850108a90 msgr2=0x7f185019e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:08.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.960+0000 7f1854f4f640 1 --2- 172.21.15.5:0/3632497105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1850108a90 0x7f185019e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:08.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.960+0000 7f1854f4f640 1 -- 172.21.15.5:0/3632497105 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f185019f0f0 con 0x7f1850102800 2024-08-31T05:44:08.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.960+0000 7f184ffff640 1 --2- 172.21.15.5:0/3632497105 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1850108140 0x7f1850199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:44:08.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.960+0000 7f1855750640 1 --2- 172.21.15.5:0/3632497105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1850108a90 0x7f185019e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:44:08.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.960+0000 7f1854f4f640 1 --2- 172.21.15.5:0/3632497105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1850102800 0x7f1850199180 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f184400e9f0 tx=0x7f184400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:08.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.960+0000 7f184dffb640 1 -- 172.21.15.5:0/3632497105 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f184400cd80 con 0x7f1850102800 2024-08-31T05:44:08.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.960+0000 7f18571b3640 1 -- 172.21.15.5:0/3632497105 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f185019f3e0 con 0x7f1850102800 2024-08-31T05:44:08.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.960+0000 7f184dffb640 1 -- 172.21.15.5:0/3632497105 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18440108e0 con 0x7f1850102800 2024-08-31T05:44:08.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.960+0000 7f184dffb640 1 -- 172.21.15.5:0/3632497105 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1844018980 con 0x7f1850102800 2024-08-31T05:44:08.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.960+0000 7f18571b3640 1 -- 172.21.15.5:0/3632497105 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f185006ac00 con 0x7f1850102800 2024-08-31T05:44:08.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.963+0000 7f185d728740 1 Processor -- start 2024-08-31T05:44:08.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.963+0000 7f185d728740 1 -- start start 2024-08-31T05:44:08.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.963+0000 7f184dffb640 1 -- 172.21.15.5:0/3632497105 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f1844010430 con 0x7f1850102800 2024-08-31T05:44:08.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.963+0000 7f185d728740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a224f9f070 0x55a2253442c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:08.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.963+0000 7f185d728740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a224f761b0 0x55a225344800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:08.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.963+0000 7f185d728740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a224f7e390 0x55a225344d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:08.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.963+0000 7f185d728740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55a2252bb630 con 0x55a224f761b0 2024-08-31T05:44:08.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.963+0000 7f185d728740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a2252aabc0 con 0x55a224f7e390 2024-08-31T05:44:08.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.963+0000 7f185d728740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a2252aeb70 con 0x55a224f9f070 2024-08-31T05:44:08.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.964+0000 7f1854f4f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a224f761b0 0x55a225344800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:08.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.964+0000 7f1855750640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a224f9f070 0x55a2253442c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:08.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.964+0000 7f1855750640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a224f9f070 0x55a2253442c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:55460/0 (socket says 172.21.15.5:55460) 2024-08-31T05:44:08.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.964+0000 7f1855750640 1 -- 172.21.15.5:0/3142488640 learned_addr learned my addr 172.21.15.5:0/3142488640 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:44:08.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.964+0000 7f184ffff640 1 --2- 172.21.15.5:0/3142488640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a224f7e390 0x55a225344d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:08.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.964+0000 7f1855750640 1 -- 172.21.15.5:0/3142488640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a224f7e390 msgr2=0x55a225344d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:44:08.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.964+0000 7f1855750640 1 --2- 172.21.15.5:0/3142488640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a224f7e390 0x55a225344d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:08.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.964+0000 7f1855750640 1 -- 172.21.15.5:0/3142488640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a224f761b0 msgr2=0x55a225344800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:44:08.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.964+0000 7f1855750640 1 --2- 172.21.15.5:0/3142488640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a224f761b0 0x55a225344800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:08.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.964+0000 7f1855750640 1 -- 172.21.15.5:0/3142488640 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a22500a650 con 0x55a224f9f070 2024-08-31T05:44:08.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.964+0000 7f184dffb640 1 --2- 172.21.15.5:0/3632497105 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f18400b4ca0 0x7f18400b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:08.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.964+0000 7f1855750640 1 --2- 172.21.15.5:0/3142488640 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a224f9f070 0x55a2253442c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1848033040 tx=0x7f184802f310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4503cc9ce4ce8820 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:08.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.964+0000 7f1854f4f640 1 --2- 172.21.15.5:0/3632497105 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f18400b4ca0 0x7f18400b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:08.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.964+0000 7f183affd640 1 -- 172.21.15.5:0/3142488640 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1848031650 con 0x55a224f9f070 2024-08-31T05:44:08.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.964+0000 7f184dffb640 1 -- 172.21.15.5:0/3632497105 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9599+0+0 (secure 0 0 0) 0x7f18440e5c80 con 0x7f1850102800 2024-08-31T05:44:08.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.965+0000 7f183affd640 1 -- 172.21.15.5:0/3142488640 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1848036040 con 0x55a224f9f070 2024-08-31T05:44:08.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.965+0000 7f183affd640 1 -- 172.21.15.5:0/3142488640 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18480044c0 con 0x55a224f9f070 2024-08-31T05:44:08.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.965+0000 7f185d728740 1 -- 172.21.15.5:0/3142488640 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a224f9f070 msgr2=0x55a2253442c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:08.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.965+0000 7f185d728740 1 --2- 172.21.15.5:0/3142488640 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a224f9f070 0x55a2253442c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1848033040 tx=0x7f184802f310 comp rx=0 tx=0).stop 2024-08-31T05:44:08.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.965+0000 7f1854f4f640 1 --2- 172.21.15.5:0/3632497105 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f18400b4ca0 0x7f18400b71b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f18440e3050 tx=0x7f18440e97d0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:08.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.965+0000 7f185d728740 1 -- 172.21.15.5:0/3142488640 shutdown_connections 2024-08-31T05:44:08.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.965+0000 7f185d728740 1 --2- 172.21.15.5:0/3142488640 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a224f7e390 0x55a225344d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:08.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.965+0000 7f185d728740 1 --2- 172.21.15.5:0/3142488640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a224f761b0 0x55a225344800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:08.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.965+0000 7f185d728740 1 --2- 172.21.15.5:0/3142488640 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a224f9f070 0x55a2253442c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:08.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.965+0000 7f185d728740 1 -- 172.21.15.5:0/3142488640 >> 172.21.15.5:0/3142488640 conn(0x55a224f93460 msgr2=0x55a2253421b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:08.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.965+0000 7f185d728740 1 -- 172.21.15.5:0/3142488640 shutdown_connections 2024-08-31T05:44:08.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.965+0000 7f185d728740 1 -- 172.21.15.5:0/3142488640 wait complete. 2024-08-31T05:44:08.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.966+0000 7f185d728740 1 -- start start 2024-08-31T05:44:08.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.966+0000 7f185d728740 1 Processor -- start 2024-08-31T05:44:08.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.966+0000 7f185d728740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a224f761b0 0x55a22534fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:08.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.966+0000 7f185d728740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a224f7e390 0x55a22534ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:08.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.966+0000 7f185d728740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a224f9f070 0x55a22535bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:08.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.966+0000 7f185d728740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55a22510d700 con 0x55a224f7e390 2024-08-31T05:44:08.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.966+0000 7f185d728740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55a225231700 con 0x55a224f9f070 2024-08-31T05:44:08.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.966+0000 7f185d728740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a2253528c0 con 0x55a224f761b0 2024-08-31T05:44:08.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.966+0000 7f185d728740 10 client.0 _ll_register_callbacks cb 0x55a225260dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:44:08.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.966+0000 7f184ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a224f7e390 0x55a22534ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:08.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.966+0000 7f1855750640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a224f761b0 0x55a22534fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:08.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.967+0000 7f184ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a224f7e390 0x55a22534ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56522/0 (socket says 172.21.15.5:56522) 2024-08-31T05:44:08.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.967+0000 7f1855750640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a224f761b0 0x55a22534fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:55476/0 (socket says 172.21.15.5:55476) 2024-08-31T05:44:08.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.967+0000 7f184ffff640 1 -- 172.21.15.5:0/20987871 learned_addr learned my addr 172.21.15.5:0/20987871 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:44:08.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.967+0000 7f1855750640 1 --2- 172.21.15.5:0/20987871 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a224f9f070 0x55a22535bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:08.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.967+0000 7f184ffff640 1 -- 172.21.15.5:0/20987871 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a224f761b0 msgr2=0x55a22534fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:44:08.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.967+0000 7f184ffff640 1 --2- 172.21.15.5:0/20987871 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a224f761b0 0x55a22534fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:08.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.967+0000 7f184ffff640 1 -- 172.21.15.5:0/20987871 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a224f9f070 msgr2=0x55a22535bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:44:08.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.967+0000 7f184ffff640 1 --2- 172.21.15.5:0/20987871 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a224f9f070 0x55a22535bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:08.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.967+0000 7f184ffff640 1 -- 172.21.15.5:0/20987871 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a22526a8b0 con 0x55a224f7e390 2024-08-31T05:44:08.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.967+0000 7f184ffff640 1 --2- 172.21.15.5:0/20987871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a224f7e390 0x55a22534ffc0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f183c012d00 tx=0x7f183c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ba0cfcf86d50789 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:08.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.967+0000 7f182ffff640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:44:08.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.967+0000 7f182ffff640 1 -- 172.21.15.5:0/20987871 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f183c009d90 con 0x55a224f7e390 2024-08-31T05:44:08.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.967+0000 7f182ffff640 1 -- 172.21.15.5:0/20987871 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9599+0+0 (secure 0 0 0) 0x7f183c012110 con 0x55a224f7e390 2024-08-31T05:44:08.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.967+0000 7f185d728740 1 -- 172.21.15.5:0/20987871 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1848036040 con 0x55a224f7e390 2024-08-31T05:44:08.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.967+0000 7f182ffff640 1 -- 172.21.15.5:0/20987871 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f183c004050 con 0x55a224f7e390 2024-08-31T05:44:08.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.967+0000 7f185d728740 10 client.19284 fetch_fsmap learned FSMap version 36 2024-08-31T05:44:08.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.967+0000 7f185d728740 1 -- 172.21.15.5:0/20987871 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55a22535e750 con 0x55a224f7e390 2024-08-31T05:44:08.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.968+0000 7f182ffff640 1 -- 172.21.15.5:0/20987871 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1848036040 con 0x55a224f7e390 2024-08-31T05:44:08.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.968+0000 7f182ffff640 1 -- 172.21.15.5:0/20987871 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 36) ==== 8386+0+0 (secure 0 0 0) 0x7f183c010430 con 0x55a224f7e390 2024-08-31T05:44:08.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.968+0000 7f185d728740 10 client.19284 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T05:44:08.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.968+0000 7f185d728740 10 client.19284 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:44:08.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.968+0000 7f185d728740 20 client.19284 populate_metadata read hostname 'smithi005' 2024-08-31T05:44:08.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.968+0000 7f185d728740 1 --2- 172.21.15.5:0/20987871 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a224f5d9f0 0x55a225361c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:08.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.968+0000 7f185d728740 4 client.19284 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:44:08.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.968+0000 7f185d728740 1 -- 172.21.15.5:0/20987871 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a2252bd580 con 0x55a224f5d9f0 2024-08-31T05:44:08.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.968+0000 7f1855750640 1 --2- 172.21.15.5:0/20987871 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a224f5d9f0 0x55a225361c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:08.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.969+0000 7f182ffff640 10 client.19284 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:44:08.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.969+0000 7f1855750640 1 --2- 172.21.15.5:0/20987871 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a224f5d9f0 0x55a225361c70 crc :-1 s=READY pgs=305 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d80a5bb3bfef0c20 server_cookie=1d2091c51602931f in_seq=0 out_seq=0 2024-08-31T05:44:08.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.970+0000 7f182ffff640 1 -- 172.21.15.5:0/20987871 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a2252bd580 con 0x55a224f5d9f0 2024-08-31T05:44:08.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.970+0000 7f182ffff640 10 client.19284 handle_command_reply: tid=0 2024-08-31T05:44:08.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.970+0000 7f185d728740 1 client.19284 shutdown 2024-08-31T05:44:08.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.970+0000 7f185d728740 1 -- 172.21.15.5:0/20987871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a224f7e390 msgr2=0x55a22534ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:08.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.970+0000 7f185d728740 1 --2- 172.21.15.5:0/20987871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a224f7e390 0x55a22534ffc0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f183c012d00 tx=0x7f183c00f790 comp rx=0 tx=0).stop 2024-08-31T05:44:08.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.970+0000 7f185d728740 1 -- 172.21.15.5:0/20987871 shutdown_connections 2024-08-31T05:44:08.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.970+0000 7f185d728740 1 --2- 172.21.15.5:0/20987871 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a224f5d9f0 0x55a225361c70 crc :-1 s=READY pgs=305 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:08.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.970+0000 7f185d728740 1 --2- 172.21.15.5:0/20987871 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a224f9f070 0x55a22535bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:08.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.970+0000 7f185d728740 1 --2- 172.21.15.5:0/20987871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a224f7e390 0x55a22534ffc0 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:08.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.970+0000 7f185d728740 1 --2- 172.21.15.5:0/20987871 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a224f761b0 0x55a22534fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:08.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.970+0000 7f185d728740 1 -- 172.21.15.5:0/20987871 >> 172.21.15.5:0/20987871 conn(0x55a224f93460 msgr2=0x55a225347450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:08.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.970+0000 7f182ffff640 0 client.19284 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:44:08.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.970+0000 7f185d728740 1 -- 172.21.15.5:0/20987871 shutdown_connections 2024-08-31T05:44:08.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.970+0000 7f185d728740 1 -- 172.21.15.5:0/20987871 wait complete. 2024-08-31T05:44:08.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.970+0000 7f185d728740 20 client.19284 trim_cache size 0 max 16384 2024-08-31T05:44:08.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.994+0000 7f185d728740 1 Processor -- start 2024-08-31T05:44:08.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.994+0000 7f185d728740 1 -- start start 2024-08-31T05:44:08.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.994+0000 7f185d728740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a224f761b0 0x55a225347ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:08.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.994+0000 7f185d728740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a224f7e390 0x55a22535bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:08.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.994+0000 7f185d728740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a224f9f070 0x55a22535bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:08.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.994+0000 7f185d728740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f18501b0f10 con 0x55a224f7e390 2024-08-31T05:44:08.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.994+0000 7f185d728740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f18501b2b10 con 0x55a224f761b0 2024-08-31T05:44:08.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.994+0000 7f185d728740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f18501b15e0 con 0x55a224f9f070 2024-08-31T05:44:08.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.994+0000 7f184ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a224f7e390 0x55a22535bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:08.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.995+0000 7f184ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a224f7e390 0x55a22535bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56530/0 (socket says 172.21.15.5:56530) 2024-08-31T05:44:08.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.995+0000 7f184ffff640 1 -- 172.21.15.5:0/539267904 learned_addr learned my addr 172.21.15.5:0/539267904 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:44:08.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.995+0000 7f1855750640 1 --2- 172.21.15.5:0/539267904 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a224f9f070 0x55a22535bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:08.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.995+0000 7f1855750640 1 --2- 172.21.15.5:0/539267904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a224f761b0 0x55a225347ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:09.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.995+0000 7f184ffff640 1 -- 172.21.15.5:0/539267904 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a224f9f070 msgr2=0x55a22535bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:44:09.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.995+0000 7f184ffff640 1 --2- 172.21.15.5:0/539267904 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a224f9f070 0x55a22535bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:09.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.995+0000 7f184ffff640 1 -- 172.21.15.5:0/539267904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a224f761b0 msgr2=0x55a225347ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:44:09.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.995+0000 7f184ffff640 1 --2- 172.21.15.5:0/539267904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a224f761b0 0x55a225347ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:09.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.995+0000 7f184ffff640 1 -- 172.21.15.5:0/539267904 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2253465b0 con 0x55a224f7e390 2024-08-31T05:44:09.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.995+0000 7f184ffff640 1 --2- 172.21.15.5:0/539267904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a224f7e390 0x55a22535bab0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f183c0093e0 tx=0x7f183c00fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17a3d7572c8e5fb2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:09.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.996+0000 7f183a7fc640 1 -- 172.21.15.5:0/539267904 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f183c02f070 con 0x55a224f7e390 2024-08-31T05:44:09.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.996+0000 7f183a7fc640 1 -- 172.21.15.5:0/539267904 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f183c012110 con 0x55a224f7e390 2024-08-31T05:44:09.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.996+0000 7f183a7fc640 1 -- 172.21.15.5:0/539267904 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f183c02b750 con 0x55a224f7e390 2024-08-31T05:44:09.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.997+0000 7f185d728740 1 -- 172.21.15.5:0/539267904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a224f7e390 msgr2=0x55a22535bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:09.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.997+0000 7f185d728740 1 --2- 172.21.15.5:0/539267904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a224f7e390 0x55a22535bab0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f183c0093e0 tx=0x7f183c00fc90 comp rx=0 tx=0).stop 2024-08-31T05:44:09.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.997+0000 7f185d728740 1 -- 172.21.15.5:0/539267904 shutdown_connections 2024-08-31T05:44:09.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.997+0000 7f185d728740 1 --2- 172.21.15.5:0/539267904 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a224f9f070 0x55a22535bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:09.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.997+0000 7f185d728740 1 --2- 172.21.15.5:0/539267904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a224f7e390 0x55a22535bab0 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:09.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.997+0000 7f185d728740 1 --2- 172.21.15.5:0/539267904 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a224f761b0 0x55a225347ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:09.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.997+0000 7f185d728740 1 -- 172.21.15.5:0/539267904 >> 172.21.15.5:0/539267904 conn(0x55a224f93460 msgr2=0x55a2253473c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:09.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.997+0000 7f185d728740 1 -- 172.21.15.5:0/539267904 shutdown_connections 2024-08-31T05:44:09.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.997+0000 7f185d728740 1 -- 172.21.15.5:0/539267904 wait complete. 2024-08-31T05:44:09.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.998+0000 7f185d728740 1 -- start start 2024-08-31T05:44:09.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.998+0000 7f185d728740 1 Processor -- start 2024-08-31T05:44:09.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.999+0000 7f185d728740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a224f761b0 0x55a225353bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:09.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.999+0000 7f185d728740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a224f7e390 0x55a225354100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:09.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.999+0000 7f185d728740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a224f9f070 0x55a225354640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:09.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.999+0000 7f184ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a224f7e390 0x55a225354100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:09.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.999+0000 7f184ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a224f7e390 0x55a225354100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56542/0 (socket says 172.21.15.5:56542) 2024-08-31T05:44:09.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.999+0000 7f184ffff640 1 -- 172.21.15.5:0/133408124 learned_addr learned my addr 172.21.15.5:0/133408124 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:44:09.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.999+0000 7f185d728740 1 -- 172.21.15.5:0/133408124 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f18501b2440 con 0x55a224f7e390 2024-08-31T05:44:09.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.999+0000 7f185d728740 1 -- 172.21.15.5:0/133408124 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f18501b1d70 con 0x55a224f761b0 2024-08-31T05:44:09.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.999+0000 7f185d728740 1 -- 172.21.15.5:0/133408124 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f18501aef10 con 0x55a224f9f070 2024-08-31T05:44:09.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.999+0000 7f1855750640 1 --2- 172.21.15.5:0/133408124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a224f761b0 0x55a225353bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:09.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:08.999+0000 7f1855750640 1 --2- 172.21.15.5:0/133408124 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a224f9f070 0x55a225354640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:09.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:09.000+0000 7f1855750640 1 -- 172.21.15.5:0/133408124 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a224f9f070 msgr2=0x55a225354640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:44:09.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:09.000+0000 7f1855750640 1 --2- 172.21.15.5:0/133408124 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a224f9f070 0x55a225354640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:09.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:09.000+0000 7f1855750640 1 -- 172.21.15.5:0/133408124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a224f7e390 msgr2=0x55a225354100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:44:09.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:09.000+0000 7f1855750640 1 --2- 172.21.15.5:0/133408124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a224f7e390 0x55a225354100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:09.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:09.000+0000 7f1855750640 1 -- 172.21.15.5:0/133408124 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2253cb700 con 0x55a224f761b0 2024-08-31T05:44:09.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:09.000+0000 7f184ffff640 1 --2- 172.21.15.5:0/133408124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a224f7e390 0x55a225354100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:44:09.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:09.000+0000 7f185d728740 10 client.0 _ll_register_callbacks cb 0x7f183c009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:44:09.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:09.000+0000 7f185d728740 1 -- 172.21.15.5:0/133408124 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f183c012110 con 0x55a224f761b0 2024-08-31T05:44:09.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:09.001+0000 7f1855750640 1 --2- 172.21.15.5:0/133408124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a224f761b0 0x55a225353bc0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f184802ade0 tx=0x7f183c0128a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3494b39dcae67ee8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:09.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:09.001+0000 7f182ffff640 10 client.28856 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:44:09.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:09.001+0000 7f182ffff640 1 -- 172.21.15.5:0/133408124 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1848031740 con 0x55a224f761b0 2024-08-31T05:44:09.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:09.001+0000 7f182ffff640 1 -- 172.21.15.5:0/133408124 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9599+0+0 (secure 0 0 0) 0x7f1848003970 con 0x55a224f761b0 2024-08-31T05:44:09.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:09.001+0000 7f182ffff640 1 -- 172.21.15.5:0/133408124 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f1848003b70 con 0x55a224f761b0 2024-08-31T05:44:09.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:09.001+0000 7f185d728740 10 client.28856 fetch_fsmap learned FSMap version 36 2024-08-31T05:44:09.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:09.001+0000 7f185d728740 1 -- 172.21.15.5:0/133408124 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({fsmap=36}) -- 0x55a2253cc700 con 0x55a224f761b0 2024-08-31T05:44:09.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:09.002+0000 7f182ffff640 1 -- 172.21.15.5:0/133408124 <== mon.2 v2:172.21.15.50:3300/0 4 ==== fsmap(e 36) ==== 8386+0+0 (secure 0 0 0) 0x7f1848051040 con 0x55a224f761b0 2024-08-31T05:44:09.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:09.002+0000 7f185d728740 10 client.28856 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T05:44:09.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:09.002+0000 7f185d728740 10 client.28856 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:44:09.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:09.002+0000 7f185d728740 20 client.28856 populate_metadata read hostname 'smithi005' 2024-08-31T05:44:09.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:09.002+0000 7f185d728740 1 --2- 172.21.15.5:0/133408124 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a224f32da0 0x55a2253cead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:09.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:09.002+0000 7f185d728740 4 client.28856 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T05:44:09.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:09.002+0000 7f185d728740 1 -- 172.21.15.5:0/133408124 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a2252b9020 con 0x55a224f32da0 2024-08-31T05:44:09.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:09.002+0000 7f184ffff640 1 --2- 172.21.15.5:0/133408124 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a224f32da0 0x55a2253cead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:09.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:09.003+0000 7f184ffff640 1 --2- 172.21.15.5:0/133408124 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a224f32da0 0x55a2253cead0 crc :-1 s=READY pgs=306 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e9e47eff8914e7e server_cookie=1d18d20f1cab067b in_seq=0 out_seq=0 2024-08-31T05:44:09.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:09.003+0000 7f182ffff640 10 client.28856 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:44:09.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:09.004+0000 7f182ffff640 1 -- 172.21.15.5:0/133408124 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5202 (crc 0 0 0) 0x7f183c03b460 con 0x55a224f32da0 2024-08-31T05:44:09.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:09.004+0000 7f182ffff640 10 client.28856 handle_command_reply: tid=0 2024-08-31T05:44:09.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:09.005+0000 7f185d728740 1 client.28856 shutdown 2024-08-31T05:44:09.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:09.005+0000 7f185d728740 1 -- 172.21.15.5:0/133408124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a224f761b0 msgr2=0x55a225353bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:09.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:09.005+0000 7f185d728740 1 --2- 172.21.15.5:0/133408124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a224f761b0 0x55a225353bc0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f184802ade0 tx=0x7f183c0128a0 comp rx=0 tx=0).stop 2024-08-31T05:44:09.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:09.005+0000 7f185d728740 1 -- 172.21.15.5:0/133408124 shutdown_connections 2024-08-31T05:44:09.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:09.005+0000 7f185d728740 1 --2- 172.21.15.5:0/133408124 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55a224f32da0 0x55a2253cead0 crc :-1 s=READY pgs=306 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:09.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:09.005+0000 7f182ffff640 0 client.28856 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:44:09.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:09.005+0000 7f185d728740 1 --2- 172.21.15.5:0/133408124 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a224f9f070 0x55a225354640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:09.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:09.005+0000 7f185d728740 1 --2- 172.21.15.5:0/133408124 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55a224f7e390 0x55a225354100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:09.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:09.005+0000 7f185d728740 1 --2- 172.21.15.5:0/133408124 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55a224f761b0 0x55a225353bc0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:09.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:09.005+0000 7f185d728740 1 -- 172.21.15.5:0/133408124 >> 172.21.15.5:0/133408124 conn(0x55a224f93460 msgr2=0x55a225341a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:09.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:09.005+0000 7f185d728740 1 -- 172.21.15.5:0/133408124 shutdown_connections 2024-08-31T05:44:09.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:09.005+0000 7f185d728740 1 -- 172.21.15.5:0/133408124 wait complete. 2024-08-31T05:44:09.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:09.006+0000 7f185d728740 20 client.28856 trim_cache size 0 max 16384 2024-08-31T05:44:09.012 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:44:09.012 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "no active scrubs running", 2024-08-31T05:44:09.012 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": {}, 2024-08-31T05:44:09.012 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_stats": { 2024-08-31T05:44:09.012 INFO:teuthology.orchestra.run.smithi005.stdout: "99e21ed4-9179-434d-86c5-36842066eafc": { 2024-08-31T05:44:09.012 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:43:34.239983+0000", 2024-08-31T05:44:09.012 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:44:09.012 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:44:09.012 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:44:09.012 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:44:09.012 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:44:09.013 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:09.013 INFO:teuthology.orchestra.run.smithi005.stdout: "9a98c3be-1a83-4ac4-9efb-e98104b2c85a": { 2024-08-31T05:44:09.013 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:42:46.122404+0000", 2024-08-31T05:44:09.013 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:44:09.013 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:44:09.013 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:44:09.013 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:44:09.013 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:44:09.013 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:09.013 INFO:teuthology.orchestra.run.smithi005.stdout: "ab2853ca-505f-43fc-a132-af8bca186292": { 2024-08-31T05:44:09.013 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:40:23.937602+0000", 2024-08-31T05:44:09.013 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:44:09.013 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:44:09.014 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:44:09.014 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:44:09.014 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:44:09.014 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:09.014 INFO:teuthology.orchestra.run.smithi005.stdout: "75d84398-5d9c-4872-b879-2fbce045fa71": { 2024-08-31T05:44:09.014 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:06.642335+0000", 2024-08-31T05:44:09.014 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:44:09.014 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:44:09.014 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:44:09.014 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:44:09.014 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:44:09.014 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:09.014 INFO:teuthology.orchestra.run.smithi005.stdout: "ece37b07-9ab2-45f8-bc33-2755a07aac0b": { 2024-08-31T05:44:09.015 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:31:41.782407+0000", 2024-08-31T05:44:09.015 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:44:09.015 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:44:09.015 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:44:09.015 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:44:09.015 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:44:09.015 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:09.015 INFO:teuthology.orchestra.run.smithi005.stdout: "728a42ca-bbef-4151-830f-5fdd411d8fa0": { 2024-08-31T05:44:09.015 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:32:30.554906+0000", 2024-08-31T05:44:09.016 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:44:09.016 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:44:09.016 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:44:09.016 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:44:09.016 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:44:09.016 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:09.016 INFO:teuthology.orchestra.run.smithi005.stdout: "cda92ac0-b35f-47a5-a3a5-471c888462a5": { 2024-08-31T05:44:09.016 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:30:53.103905+0000", 2024-08-31T05:44:09.016 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:44:09.016 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:44:09.016 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:44:09.017 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:44:09.017 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:44:09.017 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:09.017 INFO:teuthology.orchestra.run.smithi005.stdout: "0bb67292-013a-40c7-b5fc-810bdd9715d8": { 2024-08-31T05:44:09.017 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:34:04.586008+0000", 2024-08-31T05:44:09.017 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:44:09.017 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:44:09.017 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:44:09.017 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:44:09.017 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:44:09.017 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:09.017 INFO:teuthology.orchestra.run.smithi005.stdout: "c9a687a5-4adf-4788-8f18-4c06352efa9b": { 2024-08-31T05:44:09.017 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:41:11.380197+0000", 2024-08-31T05:44:09.018 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:44:09.018 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:44:09.018 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:44:09.018 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:44:09.018 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:44:09.018 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:09.018 INFO:teuthology.orchestra.run.smithi005.stdout: "de9731c7-ae4a-42fe-8146-e4752cdc40d4": { 2024-08-31T05:44:09.018 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:34:53.614499+0000", 2024-08-31T05:44:09.018 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:44:09.018 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:44:09.018 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:44:09.018 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:44:09.018 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:44:09.018 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:09.019 INFO:teuthology.orchestra.run.smithi005.stdout: "f4db3406-20ff-46a3-baf9-099e16392f76": { 2024-08-31T05:44:09.019 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:38:49.034412+0000", 2024-08-31T05:44:09.019 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:44:09.019 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:44:09.019 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:44:09.019 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:44:09.019 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:44:09.019 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:09.019 INFO:teuthology.orchestra.run.smithi005.stdout: "095ccc7a-f368-4bc6-9563-5930e21f9b4a": { 2024-08-31T05:44:09.019 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:35:40.190069+0000", 2024-08-31T05:44:09.019 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:44:09.019 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:44:09.019 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:44:09.019 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:44:09.020 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:44:09.020 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:09.020 INFO:teuthology.orchestra.run.smithi005.stdout: "4788e020-0dc9-4938-9db8-dfd5992cb286": { 2024-08-31T05:44:09.020 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:41:58.905797+0000", 2024-08-31T05:44:09.020 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:44:09.020 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:44:09.020 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:44:09.020 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:44:09.020 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:44:09.020 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:09.020 INFO:teuthology.orchestra.run.smithi005.stdout: "297c26f3-7b4d-4245-abb0-f854248e5e1b": { 2024-08-31T05:44:09.020 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:37:14.019244+0000", 2024-08-31T05:44:09.021 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:44:09.021 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:44:09.021 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:44:09.021 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:44:09.021 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:44:09.021 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:09.021 INFO:teuthology.orchestra.run.smithi005.stdout: "a4d4cf74-2477-4dd9-a3a2-3762b4dd87e4": { 2024-08-31T05:44:09.021 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:38:01.378833+0000", 2024-08-31T05:44:09.021 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:44:09.021 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:44:09.021 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:44:09.022 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:44:09.022 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:44:09.022 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:09.022 INFO:teuthology.orchestra.run.smithi005.stdout: "94c23057-592d-4a8b-82d7-da2d84f8740b": { 2024-08-31T05:44:09.022 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:36:27.513638+0000", 2024-08-31T05:44:09.022 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:44:09.022 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:44:09.022 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:44:09.022 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:44:09.022 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:44:09.022 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:09.022 INFO:teuthology.orchestra.run.smithi005.stdout: "2445fc42-b797-434f-b380-e2da985b4d98": { 2024-08-31T05:44:09.022 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:33:17.681453+0000", 2024-08-31T05:44:09.022 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:44:09.023 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:44:09.023 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:44:09.023 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:44:09.023 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:44:09.023 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:09.023 INFO:teuthology.orchestra.run.smithi005.stdout: "239b7958-db06-4432-93ce-b7552effa357": { 2024-08-31T05:44:09.023 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-08-31T05:39:35.733028+0000", 2024-08-31T05:44:09.023 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-08-31T05:44:09.023 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:44:09.023 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-08-31T05:44:09.023 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-08-31T05:44:09.023 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-08-31T05:44:09.023 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:09.023 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:09.023 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:44:09.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:09.008+0000 7f18571b3640 1 -- 172.21.15.5:0/3632497105 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f18400b4ca0 msgr2=0x7f18400b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:09.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:09.008+0000 7f18571b3640 1 --2- 172.21.15.5:0/3632497105 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f18400b4ca0 0x7f18400b71b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f18440e3050 tx=0x7f18440e97d0 comp rx=0 tx=0).stop 2024-08-31T05:44:09.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:09.008+0000 7f18571b3640 1 -- 172.21.15.5:0/3632497105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1850102800 msgr2=0x7f1850199180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:09.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:09.008+0000 7f18571b3640 1 --2- 172.21.15.5:0/3632497105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1850102800 0x7f1850199180 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f184400e9f0 tx=0x7f184400eeb0 comp rx=0 tx=0).stop 2024-08-31T05:44:09.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:09.008+0000 7f18571b3640 1 -- 172.21.15.5:0/3632497105 shutdown_connections 2024-08-31T05:44:09.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:09.008+0000 7f18571b3640 1 --2- 172.21.15.5:0/3632497105 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f18400b4ca0 0x7f18400b71b0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:09.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:09.008+0000 7f18571b3640 1 --2- 172.21.15.5:0/3632497105 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1850108a90 0x7f185019e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:09.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:09.008+0000 7f18571b3640 1 --2- 172.21.15.5:0/3632497105 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1850108140 0x7f1850199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:09.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:09.008+0000 7f18571b3640 1 --2- 172.21.15.5:0/3632497105 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1850102800 0x7f1850199180 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:09.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:09.008+0000 7f18571b3640 1 -- 172.21.15.5:0/3632497105 >> 172.21.15.5:0/3632497105 conn(0x7f18500794d0 msgr2=0x7f1850104200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:09.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:09.009+0000 7f18571b3640 1 -- 172.21.15.5:0/3632497105 shutdown_connections 2024-08-31T05:44:09.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:09.009+0000 7f18571b3640 1 -- 172.21.15.5:0/3632497105 wait complete. 2024-08-31T05:44:09.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:44:09 smithi005 ceph-mon[18602]: pgmap v784: 129 pgs: 129 active+clean; 834 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 5.7 MiB/s wr, 486 op/s 2024-08-31T05:44:09.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:44:09 smithi005 ceph-mon[18602]: osdmap e102: 12 total, 12 up, 12 in 2024-08-31T05:44:09.269 INFO:tasks.workunit.client.0.smithi005.stdout: 10 21387 23.82 MB/sec warmup 56 sec latency 252.311 ms 2024-08-31T05:44:09.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:44:09 smithi070 ceph-mon[22316]: pgmap v784: 129 pgs: 129 active+clean; 834 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 5.7 MiB/s wr, 486 op/s 2024-08-31T05:44:09.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:44:09 smithi070 ceph-mon[22316]: osdmap e102: 12 total, 12 up, 12 in 2024-08-31T05:44:09.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:44:09 smithi050 ceph-mon[22146]: pgmap v784: 129 pgs: 129 active+clean; 834 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 5.7 MiB/s wr, 486 op/s 2024-08-31T05:44:09.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:44:09 smithi050 ceph-mon[22146]: osdmap e102: 12 total, 12 up, 12 in 2024-08-31T05:44:09.838 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T05:44:09.838 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T05:44:10.162 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:44:10.269 INFO:tasks.workunit.client.0.smithi005.stdout: 10 21785 23.72 MB/sec warmup 57 sec latency 103.219 ms 2024-08-31T05:44:10.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:10.809+0000 7faa74213640 1 -- 172.21.15.5:0/2908023215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa6c102800 msgr2=0x7faa6c102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:10.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:10.809+0000 7faa74213640 1 --2- 172.21.15.5:0/2908023215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa6c102800 0x7faa6c102c10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7faa68009900 tx=0x7faa6802a410 comp rx=0 tx=0).stop 2024-08-31T05:44:10.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:10.810+0000 7faa74213640 1 -- 172.21.15.5:0/2908023215 shutdown_connections 2024-08-31T05:44:10.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:10.810+0000 7faa74213640 1 --2- 172.21.15.5:0/2908023215 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa6c108a90 0x7faa6c10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:10.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:10.810+0000 7faa74213640 1 --2- 172.21.15.5:0/2908023215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa6c108140 0x7faa6c108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:10.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:10.810+0000 7faa74213640 1 --2- 172.21.15.5:0/2908023215 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa6c102800 0x7faa6c102c10 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:10.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:10.810+0000 7faa74213640 1 -- 172.21.15.5:0/2908023215 >> 172.21.15.5:0/2908023215 conn(0x7faa6c0794d0 msgr2=0x7faa6c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:10.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:10.810+0000 7faa74213640 1 -- 172.21.15.5:0/2908023215 shutdown_connections 2024-08-31T05:44:10.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:10.810+0000 7faa74213640 1 -- 172.21.15.5:0/2908023215 wait complete. 2024-08-31T05:44:10.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:10.811+0000 7faa74213640 1 Processor -- start 2024-08-31T05:44:10.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:10.811+0000 7faa74213640 1 -- start start 2024-08-31T05:44:10.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:10.812+0000 7faa74213640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa6c102800 0x7faa6c1991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:10.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:10.812+0000 7faa74213640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa6c108140 0x7faa6c199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:10.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:10.812+0000 7faa74213640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa6c108a90 0x7faa6c19ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:10.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:10.812+0000 7faa74213640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7faa6c112710 con 0x7faa6c108a90 2024-08-31T05:44:10.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:10.812+0000 7faa74213640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7faa6c112590 con 0x7faa6c108140 2024-08-31T05:44:10.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:10.812+0000 7faa74213640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7faa6c112890 con 0x7faa6c102800 2024-08-31T05:44:10.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:10.812+0000 7faa727b0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa6c108a90 0x7faa6c19ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:10.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:10.812+0000 7faa727b0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa6c108a90 0x7faa6c19ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56554/0 (socket says 172.21.15.5:56554) 2024-08-31T05:44:10.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:10.812+0000 7faa727b0640 1 -- 172.21.15.5:0/1738389612 learned_addr learned my addr 172.21.15.5:0/1738389612 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:44:10.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:10.813+0000 7faa727b0640 1 -- 172.21.15.5:0/1738389612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa6c102800 msgr2=0x7faa6c1991e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-31T05:44:10.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:10.813+0000 7faa727b0640 1 --2- 172.21.15.5:0/1738389612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa6c102800 0x7faa6c1991e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:10.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:10.813+0000 7faa727b0640 1 -- 172.21.15.5:0/1738389612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa6c108140 msgr2=0x7faa6c199780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-31T05:44:10.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:10.813+0000 7faa727b0640 1 --2- 172.21.15.5:0/1738389612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa6c108140 0x7faa6c199780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:10.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:10.813+0000 7faa727b0640 1 -- 172.21.15.5:0/1738389612 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa6c19f120 con 0x7faa6c108a90 2024-08-31T05:44:10.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:10.813+0000 7faa727b0640 1 --2- 172.21.15.5:0/1738389612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa6c108a90 0x7faa6c19ea20 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7faa6400eca0 tx=0x7faa6400b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:10.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:10.813+0000 7faa62ffd640 1 -- 172.21.15.5:0/1738389612 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa64004b20 con 0x7faa6c108a90 2024-08-31T05:44:10.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:10.814+0000 7faa62ffd640 1 -- 172.21.15.5:0/1738389612 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa64004cc0 con 0x7faa6c108a90 2024-08-31T05:44:10.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:10.814+0000 7faa74213640 1 -- 172.21.15.5:0/1738389612 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa6c19f410 con 0x7faa6c108a90 2024-08-31T05:44:10.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:10.814+0000 7faa62ffd640 1 -- 172.21.15.5:0/1738389612 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa64005310 con 0x7faa6c108a90 2024-08-31T05:44:10.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:10.814+0000 7faa74213640 1 -- 172.21.15.5:0/1738389612 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa6c06ac00 con 0x7faa6c108a90 2024-08-31T05:44:10.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:10.815+0000 7faa74213640 1 -- 172.21.15.5:0/1738389612 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa6c103a80 con 0x7faa6c108a90 2024-08-31T05:44:10.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:10.818+0000 7faa62ffd640 1 -- 172.21.15.5:0/1738389612 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7faa640054b0 con 0x7faa6c108a90 2024-08-31T05:44:11.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:10.819+0000 7faa62ffd640 1 --2- 172.21.15.5:0/1738389612 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7faa580b4d20 0x7faa580b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:11.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:10.819+0000 7faa62ffd640 1 -- 172.21.15.5:0/1738389612 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9599+0+0 (secure 0 0 0) 0x7faa640e9fd0 con 0x7faa6c108a90 2024-08-31T05:44:11.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:10.820+0000 7faa71faf640 1 --2- 172.21.15.5:0/1738389612 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7faa580b4d20 0x7faa580b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:11.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:10.821+0000 7faa71faf640 1 --2- 172.21.15.5:0/1738389612 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7faa580b4d20 0x7faa580b7230 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7faa6802a930 tx=0x7faa68000bc0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:11.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:10.824+0000 7faa62ffd640 1 -- 172.21.15.5:0/1738389612 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7faa64019030 con 0x7faa6c108a90 2024-08-31T05:44:11.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:11.177+0000 7faa74213640 1 -- 172.21.15.5:0/1738389612 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faa6c102c10 con 0x7faa6c108a90 2024-08-31T05:44:11.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:11.178+0000 7faa62ffd640 1 -- 172.21.15.5:0/1738389612 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+11948 (secure 0 0 0) 0x7faa6c102c10 con 0x7faa6c108a90 2024-08-31T05:44:11.180 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:44:11.181 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":36,"btime":"2024-08-31T05:43:22:948959+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14739,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2024812199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2024812199},{"type":"v1","addr":"172.21.15.5:6835","nonce":2024812199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3629023702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3629023702},{"type":"v1","addr":"172.21.15.5:6837","nonce":3629023702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":36,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T05:27:31.929153+0000","modified":"2024-08-31T05:43:22.085750+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24652,"mds_1":24638,"mds_2":24631,"mds_3":24625,"mds_4":24602},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6839/2412701258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":2412701258},{"type":"v1","addr":"172.21.15.5:6839","nonce":2412701258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14820":{"gid":14820,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6841/747057838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":747057838},{"type":"v1","addr":"172.21.15.5:6841","nonce":747057838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6833/1153378982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1153378982},{"type":"v1","addr":"172.21.15.50:6833","nonce":1153378982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6833/364083443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":364083443},{"type":"v1","addr":"172.21.15.70:6833","nonce":364083443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24587":{"gid":24587,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/2346896794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2346896794},{"type":"v1","addr":"172.21.15.50:6835","nonce":2346896794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24602":{"gid":24602,"name":"h","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.50:6837/428759669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":428759669},{"type":"v1","addr":"172.21.15.50:6837","nonce":428759669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.70:6835/2061504114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2061504114},{"type":"v1","addr":"172.21.15.70:6835","nonce":2061504114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.70:6837/2780036414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2780036414},{"type":"v1","addr":"172.21.15.70:6837","nonce":2780036414}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.50:6839/98200944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":98200944},{"type":"v1","addr":"172.21.15.50:6839","nonce":98200944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24652":{"gid":24652,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.70:6839/2756569250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":2756569250},{"type":"v1","addr":"172.21.15.70:6839","nonce":2756569250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24652,"qdb_cluster":[24652,24631,24638,24625,24602]},"id":1}]} 2024-08-31T05:44:11.181 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 36 2024-08-31T05:44:11.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:11.181+0000 7faa74213640 1 -- 172.21.15.5:0/1738389612 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7faa580b4d20 msgr2=0x7faa580b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:11.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:11.181+0000 7faa74213640 1 --2- 172.21.15.5:0/1738389612 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7faa580b4d20 0x7faa580b7230 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7faa6802a930 tx=0x7faa68000bc0 comp rx=0 tx=0).stop 2024-08-31T05:44:11.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:11.181+0000 7faa74213640 1 -- 172.21.15.5:0/1738389612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa6c108a90 msgr2=0x7faa6c19ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:11.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:11.181+0000 7faa74213640 1 --2- 172.21.15.5:0/1738389612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa6c108a90 0x7faa6c19ea20 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7faa6400eca0 tx=0x7faa6400b690 comp rx=0 tx=0).stop 2024-08-31T05:44:11.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:11.181+0000 7faa74213640 1 -- 172.21.15.5:0/1738389612 shutdown_connections 2024-08-31T05:44:11.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:11.181+0000 7faa74213640 1 --2- 172.21.15.5:0/1738389612 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7faa580b4d20 0x7faa580b7230 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:11.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:11.181+0000 7faa74213640 1 --2- 172.21.15.5:0/1738389612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa6c108a90 0x7faa6c19ea20 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:11.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:11.181+0000 7faa74213640 1 --2- 172.21.15.5:0/1738389612 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7faa6c108140 0x7faa6c199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:11.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:11.181+0000 7faa74213640 1 --2- 172.21.15.5:0/1738389612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa6c102800 0x7faa6c1991e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:11.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:11.181+0000 7faa74213640 1 -- 172.21.15.5:0/1738389612 >> 172.21.15.5:0/1738389612 conn(0x7faa6c0794d0 msgr2=0x7faa6c101180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:11.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:11.181+0000 7faa74213640 1 -- 172.21.15.5:0/1738389612 shutdown_connections 2024-08-31T05:44:11.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:11.181+0000 7faa74213640 1 -- 172.21.15.5:0/1738389612 wait complete. 2024-08-31T05:44:11.260 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.258+0000 7ff01b015640 1 -- 172.21.15.5:0/3505982939 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0141038a0 msgr2=0x7ff014103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:11.260 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.258+0000 7ff01b015640 1 --2- 172.21.15.5:0/3505982939 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0141038a0 0x7ff014103cb0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff008009900 tx=0x7ff00802a410 comp rx=0 tx=0).stop 2024-08-31T05:44:11.260 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.258+0000 7ff01b015640 1 -- 172.21.15.5:0/3505982939 shutdown_connections 2024-08-31T05:44:11.261 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.258+0000 7ff01b015640 1 --2- 172.21.15.5:0/3505982939 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff014109c30 0x7ff014110460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:11.261 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.258+0000 7ff01b015640 1 --2- 172.21.15.5:0/3505982939 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0141092e0 0x7ff0141096f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:11.261 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.258+0000 7ff01b015640 1 --2- 172.21.15.5:0/3505982939 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0141038a0 0x7ff014103cb0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:11.261 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.258+0000 7ff01b015640 1 -- 172.21.15.5:0/3505982939 >> 172.21.15.5:0/3505982939 conn(0x7ff0140ff2c0 msgr2=0x7ff014101710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:11.261 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.258+0000 7ff01b015640 1 -- 172.21.15.5:0/3505982939 shutdown_connections 2024-08-31T05:44:11.261 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.258+0000 7ff01b015640 1 -- 172.21.15.5:0/3505982939 wait complete. 2024-08-31T05:44:11.261 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.259+0000 7ff01b015640 1 Processor -- start 2024-08-31T05:44:11.261 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.259+0000 7ff01b015640 1 -- start start 2024-08-31T05:44:11.263 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.259+0000 7ff01b015640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0141038a0 0x7ff01419a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:11.263 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.259+0000 7ff01b015640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0141092e0 0x7ff01419a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:11.263 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.259+0000 7ff01b015640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff014109c30 0x7ff01419fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:11.263 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.259+0000 7ff01b015640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff0141138f0 con 0x7ff0141092e0 2024-08-31T05:44:11.263 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.259+0000 7ff01b015640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff014113770 con 0x7ff0141038a0 2024-08-31T05:44:11.263 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.259+0000 7ff01b015640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff014113a70 con 0x7ff014109c30 2024-08-31T05:44:11.263 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.259+0000 7ff013fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0141092e0 0x7ff01419a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:11.263 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.259+0000 7ff0195b2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff014109c30 0x7ff01419fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:11.263 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.259+0000 7ff013fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0141092e0 0x7ff01419a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56564/0 (socket says 172.21.15.5:56564) 2024-08-31T05:44:11.263 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.259+0000 7ff013fff640 1 -- 172.21.15.5:0/2075690184 learned_addr learned my addr 172.21.15.5:0/2075690184 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:44:11.264 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.259+0000 7ff018db1640 1 --2- 172.21.15.5:0/2075690184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0141038a0 0x7ff01419a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:11.264 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.259+0000 7ff013fff640 1 -- 172.21.15.5:0/2075690184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff014109c30 msgr2=0x7ff01419fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:11.264 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.259+0000 7ff013fff640 1 --2- 172.21.15.5:0/2075690184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff014109c30 0x7ff01419fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:11.264 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.259+0000 7ff013fff640 1 -- 172.21.15.5:0/2075690184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0141038a0 msgr2=0x7ff01419a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:11.264 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.259+0000 7ff013fff640 1 --2- 172.21.15.5:0/2075690184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0141038a0 0x7ff01419a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:11.264 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.259+0000 7ff013fff640 1 -- 172.21.15.5:0/2075690184 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0141a0220 con 0x7ff0141092e0 2024-08-31T05:44:11.264 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.260+0000 7ff013fff640 1 --2- 172.21.15.5:0/2075690184 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0141092e0 0x7ff01419a890 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7ff00000e9f0 tx=0x7ff00000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:11.264 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.260+0000 7ff011ffb640 1 -- 172.21.15.5:0/2075690184 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff00000ccc0 con 0x7ff0141092e0 2024-08-31T05:44:11.264 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.260+0000 7ff01b015640 1 -- 172.21.15.5:0/2075690184 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0141a0510 con 0x7ff0141092e0 2024-08-31T05:44:11.264 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.260+0000 7ff011ffb640 1 -- 172.21.15.5:0/2075690184 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff0000108e0 con 0x7ff0141092e0 2024-08-31T05:44:11.264 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.260+0000 7ff011ffb640 1 -- 172.21.15.5:0/2075690184 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff000018860 con 0x7ff0141092e0 2024-08-31T05:44:11.264 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.260+0000 7ff01b015640 1 -- 172.21.15.5:0/2075690184 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff014075390 con 0x7ff0141092e0 2024-08-31T05:44:11.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.262+0000 7ff02205f740 1 Processor -- start 2024-08-31T05:44:11.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.263+0000 7ff02205f740 1 -- start start 2024-08-31T05:44:11.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.263+0000 7ff011ffb640 1 -- 172.21.15.5:0/2075690184 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7ff000010430 con 0x7ff0141092e0 2024-08-31T05:44:11.267 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.263+0000 7ff02205f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562abd26f1b0 0x562abd612ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:11.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.263+0000 7ff02205f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562abd2462f0 0x562abd613000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:11.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.263+0000 7ff02205f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562abd24e4d0 0x562abd613540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:11.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.263+0000 7ff02205f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x562abd588000 con 0x562abd2462f0 2024-08-31T05:44:11.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.263+0000 7ff02205f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562abd577590 con 0x562abd26f1b0 2024-08-31T05:44:11.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.263+0000 7ff02205f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562abd57b540 con 0x562abd24e4d0 2024-08-31T05:44:11.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.263+0000 7ff018db1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562abd2462f0 0x562abd613000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:11.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.263+0000 7ff018db1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562abd2462f0 0x562abd613000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56578/0 (socket says 172.21.15.5:56578) 2024-08-31T05:44:11.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.263+0000 7ff018db1640 1 -- 172.21.15.5:0/52533806 learned_addr learned my addr 172.21.15.5:0/52533806 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:44:11.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.263+0000 7ff0195b2640 1 --2- 172.21.15.5:0/52533806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562abd26f1b0 0x562abd612ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:11.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.263+0000 7ff013fff640 1 --2- 172.21.15.5:0/52533806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562abd24e4d0 0x562abd613540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:11.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.263+0000 7ff0195b2640 1 -- 172.21.15.5:0/52533806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562abd24e4d0 msgr2=0x562abd613540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:44:11.268 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.263+0000 7ff0195b2640 1 --2- 172.21.15.5:0/52533806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562abd24e4d0 0x562abd613540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:11.269 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.263+0000 7ff0195b2640 1 -- 172.21.15.5:0/52533806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562abd2462f0 msgr2=0x562abd613000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:44:11.269 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.263+0000 7ff0195b2640 1 --2- 172.21.15.5:0/52533806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562abd2462f0 0x562abd613000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:11.269 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.263+0000 7ff0195b2640 1 -- 172.21.15.5:0/52533806 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562abd2da790 con 0x562abd26f1b0 2024-08-31T05:44:11.269 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.263+0000 7ff013fff640 1 --2- 172.21.15.5:0/52533806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562abd24e4d0 0x562abd613540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:44:11.269 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.263+0000 7ff018db1640 1 --2- 172.21.15.5:0/52533806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562abd2462f0 0x562abd613000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:44:11.269 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.264+0000 7ff0195b2640 1 --2- 172.21.15.5:0/52533806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562abd26f1b0 0x562abd612ac0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff00c009f60 tx=0x7ff00c009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9da2927fc22bd1a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:11.269 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.264+0000 7ff011ffb640 1 --2- 172.21.15.5:0/2075690184 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff0040b4ca0 0x7ff0040b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:11.269 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.264+0000 7feffeffd640 1 -- 172.21.15.5:0/52533806 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff00c016070 con 0x562abd26f1b0 2024-08-31T05:44:11.269 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.264+0000 7ff018db1640 1 --2- 172.21.15.5:0/2075690184 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff0040b4ca0 0x7ff0040b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:11.269 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.264+0000 7feffeffd640 1 -- 172.21.15.5:0/52533806 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff00c004d20 con 0x562abd26f1b0 2024-08-31T05:44:11.269 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.264+0000 7feffeffd640 1 -- 172.21.15.5:0/52533806 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff00c012760 con 0x562abd26f1b0 2024-08-31T05:44:11.269 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.264+0000 7ff011ffb640 1 -- 172.21.15.5:0/2075690184 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9599+0+0 (secure 0 0 0) 0x7ff0000e5c20 con 0x7ff0141092e0 2024-08-31T05:44:11.269 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.265+0000 7ff02205f740 1 -- 172.21.15.5:0/52533806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562abd26f1b0 msgr2=0x562abd612ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:11.270 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.265+0000 7ff018db1640 1 --2- 172.21.15.5:0/2075690184 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff0040b4ca0 0x7ff0040b71b0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ff0080095d0 tx=0x7ff008009560 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:11.270 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.265+0000 7ff02205f740 1 --2- 172.21.15.5:0/52533806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562abd26f1b0 0x562abd612ac0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff00c009f60 tx=0x7ff00c009f90 comp rx=0 tx=0).stop 2024-08-31T05:44:11.270 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.265+0000 7ff02205f740 1 -- 172.21.15.5:0/52533806 shutdown_connections 2024-08-31T05:44:11.270 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.265+0000 7ff02205f740 1 --2- 172.21.15.5:0/52533806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562abd24e4d0 0x562abd613540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:11.270 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.265+0000 7ff02205f740 1 --2- 172.21.15.5:0/52533806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562abd2462f0 0x562abd613000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:11.270 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.265+0000 7ff02205f740 1 --2- 172.21.15.5:0/52533806 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562abd26f1b0 0x562abd612ac0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:11.270 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.265+0000 7ff02205f740 1 -- 172.21.15.5:0/52533806 >> 172.21.15.5:0/52533806 conn(0x562abd263300 msgr2=0x562abd6109b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:11.270 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.265+0000 7ff02205f740 1 -- 172.21.15.5:0/52533806 shutdown_connections 2024-08-31T05:44:11.270 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.265+0000 7ff02205f740 1 -- 172.21.15.5:0/52533806 wait complete. 2024-08-31T05:44:11.270 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.265+0000 7ff02205f740 1 -- start start 2024-08-31T05:44:11.270 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.265+0000 7ff02205f740 1 Processor -- start 2024-08-31T05:44:11.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.266+0000 7ff02205f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562abd2462f0 0x562abd61e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:11.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.266+0000 7ff02205f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562abd24e4d0 0x562abd61ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:11.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.266+0000 7ff02205f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562abd26f1b0 0x562abd62a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:11.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.266+0000 7ff02205f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x562abd4b0ab0 con 0x562abd24e4d0 2024-08-31T05:44:11.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.266+0000 7ff02205f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x562abd4fe680 con 0x562abd2462f0 2024-08-31T05:44:11.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.266+0000 7ff02205f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562abd621240 con 0x562abd26f1b0 2024-08-31T05:44:11.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.266+0000 7ff02205f740 10 client.0 _ll_register_callbacks cb 0x562abd286a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:44:11.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.266+0000 7ff013fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562abd24e4d0 0x562abd61ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:11.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.266+0000 7ff018db1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562abd2462f0 0x562abd61e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:11.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.266+0000 7ff013fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562abd24e4d0 0x562abd61ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56592/0 (socket says 172.21.15.5:56592) 2024-08-31T05:44:11.274 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.266+0000 7ff013fff640 1 -- 172.21.15.5:0/4074959160 learned_addr learned my addr 172.21.15.5:0/4074959160 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:44:11.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.266+0000 7ff0195b2640 1 --2- 172.21.15.5:0/4074959160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562abd26f1b0 0x562abd62a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:11.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.266+0000 7ff018db1640 1 -- 172.21.15.5:0/4074959160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562abd26f1b0 msgr2=0x562abd62a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:44:11.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.266+0000 7ff018db1640 1 --2- 172.21.15.5:0/4074959160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562abd26f1b0 0x562abd62a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:11.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.266+0000 7ff018db1640 1 -- 172.21.15.5:0/4074959160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562abd24e4d0 msgr2=0x562abd61ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:44:11.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.266+0000 7ff018db1640 1 --2- 172.21.15.5:0/4074959160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562abd24e4d0 0x562abd61ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:11.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.266+0000 7ff018db1640 1 -- 172.21.15.5:0/4074959160 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562abd353620 con 0x562abd2462f0 2024-08-31T05:44:11.275 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.267+0000 7ff013fff640 1 --2- 172.21.15.5:0/4074959160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562abd24e4d0 0x562abd61ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:44:11.276 INFO:tasks.workunit.client.0.smithi005.stdout: 10 22109 23.58 MB/sec warmup 58 sec latency 214.514 ms 2024-08-31T05:44:11.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.267+0000 7ff018db1640 1 --2- 172.21.15.5:0/4074959160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562abd2462f0 0x562abd61e710 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff0080096c0 tx=0x7ff008009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9a7adcf386cdc3b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:11.280 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.267+0000 7feff3fff640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:44:11.281 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.267+0000 7feff3fff640 1 -- 172.21.15.5:0/4074959160 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff00804d070 con 0x562abd2462f0 2024-08-31T05:44:11.281 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.267+0000 7feff3fff640 1 -- 172.21.15.5:0/4074959160 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9599+0+0 (secure 0 0 0) 0x7ff008005050 con 0x562abd2462f0 2024-08-31T05:44:11.281 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.267+0000 7ff02205f740 1 -- 172.21.15.5:0/4074959160 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff00c004d20 con 0x562abd2462f0 2024-08-31T05:44:11.281 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.267+0000 7feff3fff640 1 -- 172.21.15.5:0/4074959160 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7ff008059050 con 0x562abd2462f0 2024-08-31T05:44:11.281 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.267+0000 7ff02205f740 10 client.28871 fetch_fsmap learned FSMap version 36 2024-08-31T05:44:11.281 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.267+0000 7ff02205f740 1 -- 172.21.15.5:0/4074959160 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x562abd62d330 con 0x562abd2462f0 2024-08-31T05:44:11.282 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.267+0000 7feff3fff640 1 -- 172.21.15.5:0/4074959160 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff00c004d20 con 0x562abd2462f0 2024-08-31T05:44:11.282 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.267+0000 7feff3fff640 1 -- 172.21.15.5:0/4074959160 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 36) ==== 8386+0+0 (secure 0 0 0) 0x7ff0080035f0 con 0x562abd2462f0 2024-08-31T05:44:11.282 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.268+0000 7ff02205f740 10 client.28871 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T05:44:11.282 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.268+0000 7ff02205f740 10 client.28871 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:44:11.282 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.268+0000 7ff02205f740 20 client.28871 populate_metadata read hostname 'smithi005' 2024-08-31T05:44:11.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.268+0000 7ff02205f740 1 --2- 172.21.15.5:0/4074959160 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x562abd22dd80 0x562abd630820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:11.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.268+0000 7ff02205f740 4 client.28871 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:44:11.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.268+0000 7ff02205f740 1 -- 172.21.15.5:0/4074959160 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562abd589f50 con 0x562abd22dd80 2024-08-31T05:44:11.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.268+0000 7ff013fff640 1 --2- 172.21.15.5:0/4074959160 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x562abd22dd80 0x562abd630820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:11.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.268+0000 7feff3fff640 10 client.28871 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:44:11.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.268+0000 7ff013fff640 1 --2- 172.21.15.5:0/4074959160 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x562abd22dd80 0x562abd630820 crc :-1 s=READY pgs=307 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=569f5c1e16355a1f server_cookie=96992dde6ac283d6 in_seq=0 out_seq=0 2024-08-31T05:44:11.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.269+0000 7feff3fff640 1 -- 172.21.15.5:0/4074959160 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562abd589f50 con 0x562abd22dd80 2024-08-31T05:44:11.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.269+0000 7feff3fff640 10 client.28871 handle_command_reply: tid=0 2024-08-31T05:44:11.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.269+0000 7ff02205f740 1 client.28871 shutdown 2024-08-31T05:44:11.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.269+0000 7ff02205f740 1 -- 172.21.15.5:0/4074959160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562abd2462f0 msgr2=0x562abd61e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:11.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.269+0000 7ff02205f740 1 --2- 172.21.15.5:0/4074959160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562abd2462f0 0x562abd61e710 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff0080096c0 tx=0x7ff008009260 comp rx=0 tx=0).stop 2024-08-31T05:44:11.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.269+0000 7ff02205f740 1 -- 172.21.15.5:0/4074959160 shutdown_connections 2024-08-31T05:44:11.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.269+0000 7ff02205f740 1 --2- 172.21.15.5:0/4074959160 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x562abd22dd80 0x562abd630820 crc :-1 s=READY pgs=307 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:11.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.269+0000 7ff02205f740 1 --2- 172.21.15.5:0/4074959160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562abd26f1b0 0x562abd62a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:11.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.269+0000 7feff3fff640 0 client.28871 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:44:11.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.269+0000 7ff02205f740 1 --2- 172.21.15.5:0/4074959160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562abd24e4d0 0x562abd61ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:11.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.269+0000 7ff02205f740 1 --2- 172.21.15.5:0/4074959160 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562abd2462f0 0x562abd61e710 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:11.286 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.269+0000 7ff02205f740 1 -- 172.21.15.5:0/4074959160 >> 172.21.15.5:0/4074959160 conn(0x562abd263300 msgr2=0x562abd613af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:11.286 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.269+0000 7ff02205f740 1 -- 172.21.15.5:0/4074959160 shutdown_connections 2024-08-31T05:44:11.286 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.269+0000 7ff02205f740 1 -- 172.21.15.5:0/4074959160 wait complete. 2024-08-31T05:44:11.286 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.269+0000 7ff02205f740 20 client.28871 trim_cache size 0 max 16384 2024-08-31T05:44:11.292 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.285+0000 7ff02205f740 1 Processor -- start 2024-08-31T05:44:11.292 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.285+0000 7ff02205f740 1 -- start start 2024-08-31T05:44:11.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.285+0000 7ff02205f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562abd2462f0 0x562abd617bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:11.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.285+0000 7ff02205f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562abd24e4d0 0x562abd618130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:11.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.285+0000 7ff02205f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562abd26f1b0 0x562abd61b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:11.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.285+0000 7ff02205f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff0141b2fe0 con 0x562abd2462f0 2024-08-31T05:44:11.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.285+0000 7ff02205f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff0141b4be0 con 0x562abd24e4d0 2024-08-31T05:44:11.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.285+0000 7ff02205f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff0141b36b0 con 0x562abd26f1b0 2024-08-31T05:44:11.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.285+0000 7ff018db1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562abd2462f0 0x562abd617bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:11.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.285+0000 7ff018db1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562abd2462f0 0x562abd617bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56602/0 (socket says 172.21.15.5:56602) 2024-08-31T05:44:11.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.285+0000 7ff018db1640 1 -- 172.21.15.5:0/4248923921 learned_addr learned my addr 172.21.15.5:0/4248923921 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:44:11.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.285+0000 7ff013fff640 1 --2- 172.21.15.5:0/4248923921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562abd24e4d0 0x562abd618130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:11.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.285+0000 7ff0195b2640 1 --2- 172.21.15.5:0/4248923921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562abd26f1b0 0x562abd61b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:11.293 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.285+0000 7ff018db1640 1 -- 172.21.15.5:0/4248923921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562abd26f1b0 msgr2=0x562abd61b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:44:11.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.285+0000 7ff018db1640 1 --2- 172.21.15.5:0/4248923921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562abd26f1b0 0x562abd61b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:11.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.285+0000 7ff018db1640 1 -- 172.21.15.5:0/4248923921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562abd24e4d0 msgr2=0x562abd618130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:44:11.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.285+0000 7ff018db1640 1 --2- 172.21.15.5:0/4248923921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562abd24e4d0 0x562abd618130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:11.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.285+0000 7ff018db1640 1 -- 172.21.15.5:0/4248923921 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562abd6112b0 con 0x562abd2462f0 2024-08-31T05:44:11.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.286+0000 7ff018db1640 1 --2- 172.21.15.5:0/4248923921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562abd2462f0 0x562abd617bf0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7ff008000c00 tx=0x7ff008005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55aa18e9cdec501c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:11.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.286+0000 7feffe7fc640 1 -- 172.21.15.5:0/4248923921 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff00804d070 con 0x562abd2462f0 2024-08-31T05:44:11.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.286+0000 7feffe7fc640 1 -- 172.21.15.5:0/4248923921 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff008062070 con 0x562abd2462f0 2024-08-31T05:44:11.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.286+0000 7feffe7fc640 1 -- 172.21.15.5:0/4248923921 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff008035040 con 0x562abd2462f0 2024-08-31T05:44:11.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.287+0000 7ff02205f740 1 -- 172.21.15.5:0/4248923921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562abd2462f0 msgr2=0x562abd617bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:11.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.287+0000 7ff02205f740 1 --2- 172.21.15.5:0/4248923921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562abd2462f0 0x562abd617bf0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7ff008000c00 tx=0x7ff008005fd0 comp rx=0 tx=0).stop 2024-08-31T05:44:11.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.287+0000 7ff02205f740 1 -- 172.21.15.5:0/4248923921 shutdown_connections 2024-08-31T05:44:11.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.287+0000 7ff02205f740 1 --2- 172.21.15.5:0/4248923921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562abd26f1b0 0x562abd61b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:11.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.287+0000 7ff02205f740 1 --2- 172.21.15.5:0/4248923921 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562abd24e4d0 0x562abd618130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:11.294 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.287+0000 7ff02205f740 1 --2- 172.21.15.5:0/4248923921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562abd2462f0 0x562abd617bf0 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:11.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.287+0000 7ff02205f740 1 -- 172.21.15.5:0/4248923921 >> 172.21.15.5:0/4248923921 conn(0x562abd263300 msgr2=0x562abd61cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:11.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.287+0000 7ff02205f740 1 -- 172.21.15.5:0/4248923921 shutdown_connections 2024-08-31T05:44:11.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.287+0000 7ff02205f740 1 -- 172.21.15.5:0/4248923921 wait complete. 2024-08-31T05:44:11.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.287+0000 7ff02205f740 1 -- start start 2024-08-31T05:44:11.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.287+0000 7ff02205f740 1 Processor -- start 2024-08-31T05:44:11.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.288+0000 7ff02205f740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562abd2462f0 0x562abd6245c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:11.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.288+0000 7ff02205f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562abd24e4d0 0x562abd624b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:11.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.288+0000 7ff02205f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562abd26f1b0 0x562abd625040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:11.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.288+0000 7ff02205f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff0141b4510 con 0x562abd26f1b0 2024-08-31T05:44:11.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.288+0000 7ff02205f740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff0141b3e40 con 0x562abd2462f0 2024-08-31T05:44:11.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.288+0000 7ff02205f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff0141b0fe0 con 0x562abd24e4d0 2024-08-31T05:44:11.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.288+0000 7ff02205f740 10 client.0 _ll_register_callbacks cb 0x7ff008005e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:44:11.295 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.288+0000 7ff018db1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562abd2462f0 0x562abd6245c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:11.296 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.288+0000 7ff018db1640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562abd2462f0 0x562abd6245c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:50294/0 (socket says 172.21.15.5:50294) 2024-08-31T05:44:11.296 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.288+0000 7ff018db1640 1 -- 172.21.15.5:0/2667443213 learned_addr learned my addr 172.21.15.5:0/2667443213 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:44:11.296 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.288+0000 7ff0195b2640 1 --2- 172.21.15.5:0/2667443213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562abd26f1b0 0x562abd625040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:11.296 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.288+0000 7ff013fff640 1 --2- 172.21.15.5:0/2667443213 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562abd24e4d0 0x562abd624b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:11.296 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.288+0000 7ff018db1640 1 -- 172.21.15.5:0/2667443213 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562abd24e4d0 msgr2=0x562abd624b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:44:11.296 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.288+0000 7ff018db1640 1 --2- 172.21.15.5:0/2667443213 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562abd24e4d0 0x562abd624b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:11.296 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.288+0000 7ff018db1640 1 -- 172.21.15.5:0/2667443213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562abd26f1b0 msgr2=0x562abd625040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:44:11.296 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.288+0000 7ff018db1640 1 --2- 172.21.15.5:0/2667443213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562abd26f1b0 0x562abd625040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:11.296 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.288+0000 7ff018db1640 1 -- 172.21.15.5:0/2667443213 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562abd69a360 con 0x562abd2462f0 2024-08-31T05:44:11.296 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.288+0000 7ff0195b2640 1 --2- 172.21.15.5:0/2667443213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562abd26f1b0 0x562abd625040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:44:11.296 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.289+0000 7ff018db1640 1 --2- 172.21.15.5:0/2667443213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562abd2462f0 0x562abd6245c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff008031440 tx=0x7ff008004590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6e897e104f7668f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:11.296 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.289+0000 7feff3fff640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:44:11.297 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.289+0000 7feff3fff640 1 -- 172.21.15.5:0/2667443213 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff00806a030 con 0x562abd2462f0 2024-08-31T05:44:11.297 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.289+0000 7feff3fff640 1 -- 172.21.15.5:0/2667443213 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9599+0+0 (secure 0 0 0) 0x7ff008003dc0 con 0x562abd2462f0 2024-08-31T05:44:11.297 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.289+0000 7ff02205f740 1 -- 172.21.15.5:0/2667443213 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff008062070 con 0x562abd2462f0 2024-08-31T05:44:11.297 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.289+0000 7feff3fff640 1 -- 172.21.15.5:0/2667443213 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7ff008077050 con 0x562abd2462f0 2024-08-31T05:44:11.297 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.289+0000 7ff02205f740 10 client.28877 fetch_fsmap learned FSMap version 36 2024-08-31T05:44:11.297 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.289+0000 7ff02205f740 1 -- 172.21.15.5:0/2667443213 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x562abd69b5d0 con 0x562abd2462f0 2024-08-31T05:44:11.297 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.289+0000 7feff3fff640 1 -- 172.21.15.5:0/2667443213 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff008062070 con 0x562abd2462f0 2024-08-31T05:44:11.297 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.289+0000 7feff3fff640 1 -- 172.21.15.5:0/2667443213 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 36) ==== 8386+0+0 (secure 0 0 0) 0x7ff0080714f0 con 0x562abd2462f0 2024-08-31T05:44:11.297 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.289+0000 7ff02205f740 10 client.28877 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T05:44:11.297 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.289+0000 7ff02205f740 10 client.28877 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-08-31T05:44:11.297 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.289+0000 7ff02205f740 20 client.28877 populate_metadata read hostname 'smithi005' 2024-08-31T05:44:11.297 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.289+0000 7ff02205f740 1 --2- 172.21.15.5:0/2667443213 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x562abd2031c0 0x562abd69dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:11.298 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.289+0000 7ff02205f740 4 client.28877 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T05:44:11.298 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.289+0000 7ff02205f740 1 -- 172.21.15.5:0/2667443213 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562abd5859f0 con 0x562abd2031c0 2024-08-31T05:44:11.298 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.290+0000 7ff013fff640 1 --2- 172.21.15.5:0/2667443213 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x562abd2031c0 0x562abd69dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:11.298 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.290+0000 7feff3fff640 10 client.28877 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:44:11.298 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.290+0000 7ff013fff640 1 --2- 172.21.15.5:0/2667443213 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x562abd2031c0 0x562abd69dc50 crc :-1 s=READY pgs=308 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d33b961a8d0c5c52 server_cookie=1104b95856363031 in_seq=0 out_seq=0 2024-08-31T05:44:11.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:44:11 smithi050 ceph-mon[22146]: pgmap v786: 129 pgs: 129 active+clean; 823 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.8 MiB/s wr, 563 op/s 2024-08-31T05:44:11.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:44:11 smithi005 ceph-mon[18602]: pgmap v786: 129 pgs: 129 active+clean; 823 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.8 MiB/s wr, 563 op/s 2024-08-31T05:44:11.531 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.528+0000 7feff3fff640 1 -- 172.21.15.5:0/2667443213 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562abd5859f0 con 0x562abd2031c0 2024-08-31T05:44:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.528+0000 7feff3fff640 10 client.28877 handle_command_reply: tid=0 2024-08-31T05:44:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.529+0000 7ff02205f740 1 client.28877 shutdown 2024-08-31T05:44:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.529+0000 7ff02205f740 1 -- 172.21.15.5:0/2667443213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562abd2462f0 msgr2=0x562abd6245c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.529+0000 7ff02205f740 1 --2- 172.21.15.5:0/2667443213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562abd2462f0 0x562abd6245c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff008031440 tx=0x7ff008004590 comp rx=0 tx=0).stop 2024-08-31T05:44:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.529+0000 7ff02205f740 1 -- 172.21.15.5:0/2667443213 shutdown_connections 2024-08-31T05:44:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.529+0000 7ff02205f740 1 --2- 172.21.15.5:0/2667443213 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x562abd2031c0 0x562abd69dc50 crc :-1 s=READY pgs=308 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.529+0000 7ff02205f740 1 --2- 172.21.15.5:0/2667443213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562abd26f1b0 0x562abd625040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.529+0000 7feff3fff640 0 client.28877 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:44:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.529+0000 7ff02205f740 1 --2- 172.21.15.5:0/2667443213 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562abd24e4d0 0x562abd624b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.529+0000 7ff02205f740 1 --2- 172.21.15.5:0/2667443213 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x562abd2462f0 0x562abd6245c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.529+0000 7ff02205f740 1 -- 172.21.15.5:0/2667443213 >> 172.21.15.5:0/2667443213 conn(0x562abd263300 msgr2=0x562abd61ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.529+0000 7ff02205f740 1 -- 172.21.15.5:0/2667443213 shutdown_connections 2024-08-31T05:44:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.529+0000 7ff02205f740 1 -- 172.21.15.5:0/2667443213 wait complete. 2024-08-31T05:44:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.529+0000 7ff02205f740 20 client.28877 trim_cache size 0 max 16384 2024-08-31T05:44:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-08-31T05:44:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-08-31T05:44:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-08-31T05:44:11.533 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-08-31T05:44:11.534 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.530+0000 7ff01b015640 1 -- 172.21.15.5:0/2075690184 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff0040b4ca0 msgr2=0x7ff0040b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:11.534 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.530+0000 7ff01b015640 1 --2- 172.21.15.5:0/2075690184 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff0040b4ca0 0x7ff0040b71b0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ff0080095d0 tx=0x7ff008009560 comp rx=0 tx=0).stop 2024-08-31T05:44:11.534 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.530+0000 7ff01b015640 1 -- 172.21.15.5:0/2075690184 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0141092e0 msgr2=0x7ff01419a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:11.534 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.530+0000 7ff01b015640 1 --2- 172.21.15.5:0/2075690184 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0141092e0 0x7ff01419a890 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7ff00000e9f0 tx=0x7ff00000eeb0 comp rx=0 tx=0).stop 2024-08-31T05:44:11.534 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.530+0000 7ff01b015640 1 -- 172.21.15.5:0/2075690184 shutdown_connections 2024-08-31T05:44:11.534 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.530+0000 7ff01b015640 1 --2- 172.21.15.5:0/2075690184 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff0040b4ca0 0x7ff0040b71b0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:11.535 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.530+0000 7ff01b015640 1 --2- 172.21.15.5:0/2075690184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff014109c30 0x7ff01419fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:11.535 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.530+0000 7ff01b015640 1 --2- 172.21.15.5:0/2075690184 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0141092e0 0x7ff01419a890 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:11.535 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.530+0000 7ff01b015640 1 --2- 172.21.15.5:0/2075690184 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff0141038a0 0x7ff01419a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:11.535 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.530+0000 7ff01b015640 1 -- 172.21.15.5:0/2075690184 >> 172.21.15.5:0/2075690184 conn(0x7ff0140ff2c0 msgr2=0x7ff0141016e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:11.535 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.530+0000 7ff01b015640 1 -- 172.21.15.5:0/2075690184 shutdown_connections 2024-08-31T05:44:11.535 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-08-31T05:44:11.530+0000 7ff01b015640 1 -- 172.21.15.5:0/2075690184 wait complete. 2024-08-31T05:44:11.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:44:11 smithi070 ceph-mon[22316]: pgmap v786: 129 pgs: 129 active+clean; 823 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.8 MiB/s wr, 563 op/s 2024-08-31T05:44:12.269 INFO:tasks.workunit.client.0.smithi005.stdout: 10 22285 23.36 MB/sec warmup 59 sec latency 418.960 ms 2024-08-31T05:44:12.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:44:12 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/1738389612' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:44:12.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:44:12 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/1738389612' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:44:12.562 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-31T05:44:12.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:44:12 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/1738389612' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:44:12.879 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:44:13.269 INFO:tasks.workunit.client.0.smithi005.stdout: 10 22656 23.20 MB/sec warmup 60 sec latency 552.828 ms 2024-08-31T05:44:13.372 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:44:13 smithi005 ceph-mon[18602]: pgmap v787: 129 pgs: 129 active+clean; 824 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 5.6 MiB/s wr, 545 op/s 2024-08-31T05:44:13.406 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:44:13 smithi050 ceph-mon[22146]: pgmap v787: 129 pgs: 129 active+clean; 824 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 5.6 MiB/s wr, 545 op/s 2024-08-31T05:44:13.487 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:44:13 smithi070 ceph-mon[22316]: pgmap v787: 129 pgs: 129 active+clean; 824 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 5.6 MiB/s wr, 545 op/s 2024-08-31T05:44:13.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.514+0000 7f23f23d2640 1 -- 172.21.15.5:0/3636982918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23ec1101e0 msgr2=0x7f23ec116a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:13.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.514+0000 7f23f23d2640 1 --2- 172.21.15.5:0/3636982918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23ec1101e0 0x7f23ec116a10 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f23d4009900 tx=0x7f23d402a410 comp rx=0 tx=0).stop 2024-08-31T05:44:13.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.514+0000 7f23f23d2640 1 -- 172.21.15.5:0/3636982918 shutdown_connections 2024-08-31T05:44:13.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.514+0000 7f23f23d2640 1 --2- 172.21.15.5:0/3636982918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23ec1101e0 0x7f23ec116a10 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:13.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.514+0000 7f23f23d2640 1 --2- 172.21.15.5:0/3636982918 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23ec10f890 0x7f23ec10fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:13.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.514+0000 7f23f23d2640 1 --2- 172.21.15.5:0/3636982918 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23ec109f50 0x7f23ec10a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:13.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.514+0000 7f23f23d2640 1 -- 172.21.15.5:0/3636982918 >> 172.21.15.5:0/3636982918 conn(0x7f23ec077e80 msgr2=0x7f23ec107f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:13.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.515+0000 7f23f23d2640 1 -- 172.21.15.5:0/3636982918 shutdown_connections 2024-08-31T05:44:13.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.515+0000 7f23f23d2640 1 -- 172.21.15.5:0/3636982918 wait complete. 2024-08-31T05:44:13.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.515+0000 7f23f23d2640 1 Processor -- start 2024-08-31T05:44:13.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.515+0000 7f23f23d2640 1 -- start start 2024-08-31T05:44:13.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.516+0000 7f23f23d2640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23ec109f50 0x7f23ec1a08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:13.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.516+0000 7f23f23d2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23ec10f890 0x7f23ec1a0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:13.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.516+0000 7f23f23d2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23ec1101e0 0x7f23ec1a6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:13.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.516+0000 7f23f23d2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f23ec119f00 con 0x7f23ec10f890 2024-08-31T05:44:13.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.516+0000 7f23f23d2640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f23ec119d80 con 0x7f23ec109f50 2024-08-31T05:44:13.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.516+0000 7f23f23d2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f23ec11a080 con 0x7f23ec1101e0 2024-08-31T05:44:13.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.516+0000 7f23f096f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23ec1101e0 0x7f23ec1a6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:13.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.516+0000 7f23eb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23ec10f890 0x7f23ec1a0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:13.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.516+0000 7f23f096f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23ec1101e0 0x7f23ec1a6110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:37184/0 (socket says 172.21.15.5:37184) 2024-08-31T05:44:13.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.516+0000 7f23f096f640 1 -- 172.21.15.5:0/3169625914 learned_addr learned my addr 172.21.15.5:0/3169625914 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:44:13.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.517+0000 7f23ebfff640 1 --2- 172.21.15.5:0/3169625914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23ec109f50 0x7f23ec1a08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:13.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.517+0000 7f23f096f640 1 -- 172.21.15.5:0/3169625914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23ec109f50 msgr2=0x7f23ec1a08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:13.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.517+0000 7f23f096f640 1 --2- 172.21.15.5:0/3169625914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23ec109f50 0x7f23ec1a08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:13.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.517+0000 7f23f096f640 1 -- 172.21.15.5:0/3169625914 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23ec10f890 msgr2=0x7f23ec1a0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:13.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.517+0000 7f23f096f640 1 --2- 172.21.15.5:0/3169625914 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23ec10f890 0x7f23ec1a0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:13.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.517+0000 7f23f096f640 1 -- 172.21.15.5:0/3169625914 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23ec1a6840 con 0x7f23ec1101e0 2024-08-31T05:44:13.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.517+0000 7f23f096f640 1 --2- 172.21.15.5:0/3169625914 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23ec1101e0 0x7f23ec1a6110 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f23d4004770 tx=0x7f23d4004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:13.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.518+0000 7f23e97fa640 1 -- 172.21.15.5:0/3169625914 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d403f030 con 0x7f23ec1101e0 2024-08-31T05:44:13.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.518+0000 7f23f23d2640 1 -- 172.21.15.5:0/3169625914 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23ec1a6ad0 con 0x7f23ec1101e0 2024-08-31T05:44:13.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.518+0000 7f23f23d2640 1 -- 172.21.15.5:0/3169625914 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23ec1ad290 con 0x7f23ec1101e0 2024-08-31T05:44:13.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.518+0000 7f23e97fa640 1 -- 172.21.15.5:0/3169625914 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f23d4003aa0 con 0x7f23ec1101e0 2024-08-31T05:44:13.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.518+0000 7f23e97fa640 1 -- 172.21.15.5:0/3169625914 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d4035070 con 0x7f23ec1101e0 2024-08-31T05:44:13.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.521+0000 7f23f8947740 1 Processor -- start 2024-08-31T05:44:13.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.523+0000 7f23e97fa640 1 -- 172.21.15.5:0/3169625914 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f23d4042030 con 0x7f23ec1101e0 2024-08-31T05:44:13.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.523+0000 7f23f8947740 1 -- start start 2024-08-31T05:44:13.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.524+0000 7f23f8947740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593e875d070 0x5593e8b02310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:13.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.524+0000 7f23f8947740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5593e87341b0 0x5593e8b02850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:13.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.524+0000 7f23f8947740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5593e873c390 0x5593e8b02d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:13.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.524+0000 7f23f8947740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5593e8a79680 con 0x5593e87341b0 2024-08-31T05:44:13.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.524+0000 7f23f8947740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5593e8a68c10 con 0x5593e875d070 2024-08-31T05:44:13.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.524+0000 7f23f8947740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5593e8a6cbc0 con 0x5593e873c390 2024-08-31T05:44:13.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.524+0000 7f23ebfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5593e87341b0 0x5593e8b02850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:13.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.524+0000 7f23ebfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5593e87341b0 0x5593e8b02850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55570/0 (socket says 172.21.15.5:55570) 2024-08-31T05:44:13.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.524+0000 7f23ebfff640 1 -- 172.21.15.5:0/937266668 learned_addr learned my addr 172.21.15.5:0/937266668 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:44:13.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.525+0000 7f23e97fa640 1 --2- 172.21.15.5:0/3169625914 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f23d80b4da0 0x7f23d80b72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:13.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.525+0000 7f23ebfff640 1 -- 172.21.15.5:0/937266668 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5593e873c390 msgr2=0x5593e8b02d90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T05:44:13.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.525+0000 7f23ebfff640 1 --2- 172.21.15.5:0/937266668 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5593e873c390 0x5593e8b02d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:13.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.525+0000 7f23ebfff640 1 -- 172.21.15.5:0/937266668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593e875d070 msgr2=0x5593e8b02310 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T05:44:13.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.525+0000 7f23ebfff640 1 --2- 172.21.15.5:0/937266668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593e875d070 0x5593e8b02310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:13.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.525+0000 7f23ebfff640 1 -- 172.21.15.5:0/937266668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593e87c8650 con 0x5593e87341b0 2024-08-31T05:44:13.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.526+0000 7f23e97fa640 1 -- 172.21.15.5:0/3169625914 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9599+0+0 (secure 0 0 0) 0x7f23d4105f00 con 0x7f23ec1101e0 2024-08-31T05:44:13.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.526+0000 7f23ebfff640 1 --2- 172.21.15.5:0/937266668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5593e87341b0 0x5593e8b02850 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f23e4009fa0 tx=0x7f23e400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a548ea2296e60c34 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:13.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.527+0000 7f23e27fc640 1 -- 172.21.15.5:0/937266668 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e401a070 con 0x5593e87341b0 2024-08-31T05:44:13.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.527+0000 7f23f096f640 1 --2- 172.21.15.5:0/3169625914 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f23d80b4da0 0x7f23d80b72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:13.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.527+0000 7f23e27fc640 1 -- 172.21.15.5:0/937266668 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f23e40158c0 con 0x5593e87341b0 2024-08-31T05:44:13.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.527+0000 7f23e27fc640 1 -- 172.21.15.5:0/937266668 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e400a8c0 con 0x5593e87341b0 2024-08-31T05:44:13.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.528+0000 7f23f8947740 1 -- 172.21.15.5:0/937266668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5593e87341b0 msgr2=0x5593e8b02850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:13.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.528+0000 7f23f096f640 1 --2- 172.21.15.5:0/3169625914 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f23d80b4da0 0x7f23d80b72b0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f23d4005f70 tx=0x7f23d4003f50 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:13.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.528+0000 7f23f8947740 1 --2- 172.21.15.5:0/937266668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5593e87341b0 0x5593e8b02850 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f23e4009fa0 tx=0x7f23e400c8b0 comp rx=0 tx=0).stop 2024-08-31T05:44:13.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.528+0000 7f23f8947740 1 -- 172.21.15.5:0/937266668 shutdown_connections 2024-08-31T05:44:13.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.528+0000 7f23f8947740 1 --2- 172.21.15.5:0/937266668 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5593e873c390 0x5593e8b02d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:13.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.528+0000 7f23f8947740 1 --2- 172.21.15.5:0/937266668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5593e87341b0 0x5593e8b02850 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:13.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.528+0000 7f23f8947740 1 --2- 172.21.15.5:0/937266668 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593e875d070 0x5593e8b02310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:13.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.528+0000 7f23f8947740 1 -- 172.21.15.5:0/937266668 >> 172.21.15.5:0/937266668 conn(0x5593e8751460 msgr2=0x5593e8b00200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:13.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.531+0000 7f23f8947740 1 -- 172.21.15.5:0/937266668 shutdown_connections 2024-08-31T05:44:13.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.531+0000 7f23f8947740 1 -- 172.21.15.5:0/937266668 wait complete. 2024-08-31T05:44:13.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.532+0000 7f23f8947740 1 -- start start 2024-08-31T05:44:13.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.532+0000 7f23f8947740 1 Processor -- start 2024-08-31T05:44:13.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.533+0000 7f23f8947740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593e87341b0 0x5593e8b0da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:13.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.533+0000 7f23f8947740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5593e873c390 0x5593e8b0dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:13.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.533+0000 7f23f8947740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5593e875d070 0x5593e8b19de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:13.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.533+0000 7f23f8947740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5593e88cb700 con 0x5593e873c390 2024-08-31T05:44:13.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.533+0000 7f23f8947740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5593e89ef750 con 0x5593e87341b0 2024-08-31T05:44:13.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.533+0000 7f23f8947740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5593e8b10af0 con 0x5593e875d070 2024-08-31T05:44:13.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.533+0000 7f23f8947740 10 client.0 _ll_register_callbacks cb 0x5593e8a1ee10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:44:13.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.533+0000 7f23ebfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5593e873c390 0x5593e8b0dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:13.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.534+0000 7f23ebfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5593e873c390 0x5593e8b0dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55578/0 (socket says 172.21.15.5:55578) 2024-08-31T05:44:13.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.534+0000 7f23ebfff640 1 -- 172.21.15.5:0/2888680545 learned_addr learned my addr 172.21.15.5:0/2888680545 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:44:13.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.534+0000 7f23ebfff640 1 -- 172.21.15.5:0/2888680545 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5593e875d070 msgr2=0x5593e8b19de0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T05:44:13.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.534+0000 7f23ebfff640 1 --2- 172.21.15.5:0/2888680545 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5593e875d070 0x5593e8b19de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:13.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.534+0000 7f23ebfff640 1 -- 172.21.15.5:0/2888680545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593e87341b0 msgr2=0x5593e8b0da80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T05:44:13.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.534+0000 7f23ebfff640 1 --2- 172.21.15.5:0/2888680545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593e87341b0 0x5593e8b0da80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:13.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.534+0000 7f23ebfff640 1 -- 172.21.15.5:0/2888680545 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593e8a28900 con 0x5593e873c390 2024-08-31T05:44:13.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.534+0000 7f23ebfff640 1 --2- 172.21.15.5:0/2888680545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5593e873c390 0x5593e8b0dfc0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f23e400cfd0 tx=0x7f23e4015ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf738433940df6ab server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:13.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.534+0000 7f23cb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:44:13.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.535+0000 7f23cb7fe640 1 -- 172.21.15.5:0/2888680545 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e401a040 con 0x5593e873c390 2024-08-31T05:44:13.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.535+0000 7f23cb7fe640 1 -- 172.21.15.5:0/2888680545 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9599+0+0 (secure 0 0 0) 0x7f23e400a640 con 0x5593e873c390 2024-08-31T05:44:13.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.535+0000 7f23f8947740 1 -- 172.21.15.5:0/2888680545 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23e40158c0 con 0x5593e873c390 2024-08-31T05:44:13.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.535+0000 7f23cb7fe640 1 -- 172.21.15.5:0/2888680545 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f23e400a840 con 0x5593e873c390 2024-08-31T05:44:13.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.535+0000 7f23f8947740 10 client.19326 fetch_fsmap learned FSMap version 36 2024-08-31T05:44:13.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.535+0000 7f23f8947740 1 -- 172.21.15.5:0/2888680545 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5593e8b1c880 con 0x5593e873c390 2024-08-31T05:44:13.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.536+0000 7f23cb7fe640 1 -- 172.21.15.5:0/2888680545 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f23e40158c0 con 0x5593e873c390 2024-08-31T05:44:13.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.536+0000 7f23cb7fe640 1 -- 172.21.15.5:0/2888680545 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 36) ==== 8386+0+0 (secure 0 0 0) 0x7f23e4028030 con 0x5593e873c390 2024-08-31T05:44:13.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.536+0000 7f23f8947740 10 client.19326 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T05:44:13.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.536+0000 7f23f8947740 10 client.19326 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-31T05:44:13.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.536+0000 7f23f8947740 20 client.19326 populate_metadata read hostname 'smithi005' 2024-08-31T05:44:13.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.536+0000 7f23f8947740 1 --2- 172.21.15.5:0/2888680545 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x5593e871b9f0 0x5593e8b1fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:13.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.536+0000 7f23f8947740 4 client.19326 mds_command: new command op to 24602 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:44:13.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.536+0000 7f23f8947740 1 -- 172.21.15.5:0/2888680545 --> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5593e8a7b5d0 con 0x5593e871b9f0 2024-08-31T05:44:13.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.537+0000 7f23eb7fe640 1 --2- 172.21.15.5:0/2888680545 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x5593e871b9f0 0x5593e8b1fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:13.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.539+0000 7f23eb7fe640 1 --2- 172.21.15.5:0/2888680545 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x5593e871b9f0 0x5593e8b1fc90 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=792a64b3b7cafc90 server_cookie=39bbb80d3f72daec in_seq=0 out_seq=0 2024-08-31T05:44:13.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.539+0000 7f23cb7fe640 10 client.19326 ms_handle_connect on v2:172.21.15.50:6836/428759669 2024-08-31T05:44:13.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.539+0000 7f23cb7fe640 1 -- 172.21.15.5:0/2888680545 <== mds.4 v2:172.21.15.50:6836/428759669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5593e8a7b5d0 con 0x5593e871b9f0 2024-08-31T05:44:13.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.539+0000 7f23cb7fe640 10 client.19326 handle_command_reply: tid=0 2024-08-31T05:44:13.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.539+0000 7f23f8947740 1 client.19326 shutdown 2024-08-31T05:44:13.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.540+0000 7f23f8947740 1 -- 172.21.15.5:0/2888680545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5593e873c390 msgr2=0x5593e8b0dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:13.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.540+0000 7f23f8947740 1 --2- 172.21.15.5:0/2888680545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5593e873c390 0x5593e8b0dfc0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f23e400cfd0 tx=0x7f23e4015ca0 comp rx=0 tx=0).stop 2024-08-31T05:44:13.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.540+0000 7f23f8947740 1 -- 172.21.15.5:0/2888680545 shutdown_connections 2024-08-31T05:44:13.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.540+0000 7f23f8947740 1 --2- 172.21.15.5:0/2888680545 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x5593e871b9f0 0x5593e8b1fc90 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:13.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.540+0000 7f23f8947740 1 --2- 172.21.15.5:0/2888680545 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5593e875d070 0x5593e8b19de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:13.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.540+0000 7f23f8947740 1 --2- 172.21.15.5:0/2888680545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5593e873c390 0x5593e8b0dfc0 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:13.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.540+0000 7f23f8947740 1 --2- 172.21.15.5:0/2888680545 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593e87341b0 0x5593e8b0da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:13.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.540+0000 7f23f8947740 1 -- 172.21.15.5:0/2888680545 >> 172.21.15.5:0/2888680545 conn(0x5593e8751460 msgr2=0x5593e8b054c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:13.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.540+0000 7f23cb7fe640 0 client.19326 ms_handle_reset on v2:172.21.15.50:6836/428759669 2024-08-31T05:44:13.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.540+0000 7f23f8947740 1 -- 172.21.15.5:0/2888680545 shutdown_connections 2024-08-31T05:44:13.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.540+0000 7f23f8947740 1 -- 172.21.15.5:0/2888680545 wait complete. 2024-08-31T05:44:13.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.540+0000 7f23f8947740 20 client.19326 trim_cache size 0 max 16384 2024-08-31T05:44:13.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.566+0000 7f23f8947740 1 Processor -- start 2024-08-31T05:44:13.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.567+0000 7f23f8947740 1 -- start start 2024-08-31T05:44:13.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.567+0000 7f23f8947740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5593e87341b0 0x5593e8b00250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:13.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.567+0000 7f23f8947740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5593e873c390 0x5593e8b19ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:13.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.567+0000 7f23f8947740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593e875d070 0x5593e8b05410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:13.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.567+0000 7f23f8947740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f23ec1b7650 con 0x5593e87341b0 2024-08-31T05:44:13.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.567+0000 7f23eb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5593e87341b0 0x5593e8b00250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:13.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.567+0000 7f23f8947740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f23ec1b9250 con 0x5593e875d070 2024-08-31T05:44:13.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.567+0000 7f23f8947740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f23ec1b7d20 con 0x5593e873c390 2024-08-31T05:44:13.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.567+0000 7f23eb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5593e87341b0 0x5593e8b00250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55588/0 (socket says 172.21.15.5:55588) 2024-08-31T05:44:13.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.567+0000 7f23eb7fe640 1 -- 172.21.15.5:0/1265231539 learned_addr learned my addr 172.21.15.5:0/1265231539 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:44:13.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.568+0000 7f23eb7fe640 1 --2- 172.21.15.5:0/1265231539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593e875d070 0x5593e8b05410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:13.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.568+0000 7f23ebfff640 1 --2- 172.21.15.5:0/1265231539 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5593e873c390 0x5593e8b19ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:13.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.568+0000 7f23eb7fe640 1 -- 172.21.15.5:0/1265231539 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5593e873c390 msgr2=0x5593e8b19ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:44:13.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.568+0000 7f23eb7fe640 1 --2- 172.21.15.5:0/1265231539 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5593e873c390 0x5593e8b19ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:13.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.568+0000 7f23eb7fe640 1 -- 172.21.15.5:0/1265231539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593e875d070 msgr2=0x5593e8b05410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:44:13.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.568+0000 7f23eb7fe640 1 --2- 172.21.15.5:0/1265231539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593e875d070 0x5593e8b05410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:13.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.568+0000 7f23eb7fe640 1 -- 172.21.15.5:0/1265231539 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593e8b101c0 con 0x5593e87341b0 2024-08-31T05:44:13.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.572+0000 7f23eb7fe640 1 --2- 172.21.15.5:0/1265231539 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5593e87341b0 0x5593e8b00250 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f23dc00b7f0 tx=0x7f23dc013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9200c1f697b7148 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:13.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.573+0000 7f23e1ffb640 1 -- 172.21.15.5:0/1265231539 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23dc01f040 con 0x5593e87341b0 2024-08-31T05:44:13.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.573+0000 7f23e1ffb640 1 -- 172.21.15.5:0/1265231539 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f23dc0047a0 con 0x5593e87341b0 2024-08-31T05:44:13.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.573+0000 7f23e1ffb640 1 -- 172.21.15.5:0/1265231539 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23dc010a00 con 0x5593e87341b0 2024-08-31T05:44:13.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.575+0000 7f23f8947740 1 -- 172.21.15.5:0/1265231539 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5593e87341b0 msgr2=0x5593e8b00250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:13.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.575+0000 7f23f8947740 1 --2- 172.21.15.5:0/1265231539 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5593e87341b0 0x5593e8b00250 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f23dc00b7f0 tx=0x7f23dc013040 comp rx=0 tx=0).stop 2024-08-31T05:44:13.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.578+0000 7f23f8947740 1 -- 172.21.15.5:0/1265231539 shutdown_connections 2024-08-31T05:44:13.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.578+0000 7f23f8947740 1 --2- 172.21.15.5:0/1265231539 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593e875d070 0x5593e8b05410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:13.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.578+0000 7f23f8947740 1 --2- 172.21.15.5:0/1265231539 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5593e873c390 0x5593e8b19ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:13.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.578+0000 7f23f8947740 1 --2- 172.21.15.5:0/1265231539 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5593e87341b0 0x5593e8b00250 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:13.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.578+0000 7f23f8947740 1 -- 172.21.15.5:0/1265231539 >> 172.21.15.5:0/1265231539 conn(0x5593e8751460 msgr2=0x5593e8affb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:13.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.579+0000 7f23f8947740 1 -- 172.21.15.5:0/1265231539 shutdown_connections 2024-08-31T05:44:13.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.583+0000 7f23f8947740 1 -- 172.21.15.5:0/1265231539 wait complete. 2024-08-31T05:44:13.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.583+0000 7f23f8947740 1 -- start start 2024-08-31T05:44:13.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.583+0000 7f23f8947740 1 Processor -- start 2024-08-31T05:44:13.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.584+0000 7f23f8947740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593e87341b0 0x5593e8b11e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:13.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.584+0000 7f23f8947740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5593e873c390 0x5593e8b123c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:13.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.584+0000 7f23f8947740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5593e875d070 0x5593e8b12900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:13.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.584+0000 7f23f8947740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f23ec1b8b80 con 0x5593e873c390 2024-08-31T05:44:13.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.584+0000 7f23f8947740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f23ec1b84b0 con 0x5593e87341b0 2024-08-31T05:44:13.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.584+0000 7f23f8947740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f23ec1b5650 con 0x5593e875d070 2024-08-31T05:44:13.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.585+0000 7f23f8947740 10 client.0 _ll_register_callbacks cb 0x7f23e4018070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:44:13.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.585+0000 7f23ebfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5593e873c390 0x5593e8b123c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:13.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.585+0000 7f23ebfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5593e873c390 0x5593e8b123c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55592/0 (socket says 172.21.15.5:55592) 2024-08-31T05:44:13.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.585+0000 7f23ebfff640 1 -- 172.21.15.5:0/881749887 learned_addr learned my addr 172.21.15.5:0/881749887 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:44:13.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.585+0000 7f23eb7fe640 1 --2- 172.21.15.5:0/881749887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593e87341b0 0x5593e8b11e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:13.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.585+0000 7f23eb7fe640 1 --2- 172.21.15.5:0/881749887 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5593e875d070 0x5593e8b12900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:13.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.586+0000 7f23ebfff640 1 -- 172.21.15.5:0/881749887 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5593e875d070 msgr2=0x5593e8b12900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:44:13.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.586+0000 7f23ebfff640 1 --2- 172.21.15.5:0/881749887 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5593e875d070 0x5593e8b12900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:13.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.586+0000 7f23ebfff640 1 -- 172.21.15.5:0/881749887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593e87341b0 msgr2=0x5593e8b11e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:44:13.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.586+0000 7f23ebfff640 1 --2- 172.21.15.5:0/881749887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593e87341b0 0x5593e8b11e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:13.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.586+0000 7f23ebfff640 1 -- 172.21.15.5:0/881749887 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593e8b895f0 con 0x5593e873c390 2024-08-31T05:44:13.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.586+0000 7f23eb7fe640 1 --2- 172.21.15.5:0/881749887 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5593e875d070 0x5593e8b12900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:44:13.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.586+0000 7f23ebfff640 1 --2- 172.21.15.5:0/881749887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5593e873c390 0x5593e8b123c0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f23e400a4e0 tx=0x7f23e4009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e596ca0886fc7d98 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:13.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.586+0000 7f23cb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:44:13.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.587+0000 7f23cb7fe640 1 -- 172.21.15.5:0/881749887 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e401a040 con 0x5593e873c390 2024-08-31T05:44:13.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.587+0000 7f23cb7fe640 1 -- 172.21.15.5:0/881749887 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9599+0+0 (secure 0 0 0) 0x7f23e400a560 con 0x5593e873c390 2024-08-31T05:44:13.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.587+0000 7f23f8947740 1 -- 172.21.15.5:0/881749887 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23dc0047a0 con 0x5593e873c390 2024-08-31T05:44:13.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.587+0000 7f23cb7fe640 1 -- 172.21.15.5:0/881749887 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f23e401ec00 con 0x5593e873c390 2024-08-31T05:44:13.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.588+0000 7f23f8947740 10 client.19332 fetch_fsmap learned FSMap version 36 2024-08-31T05:44:13.605 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.588+0000 7f23f8947740 1 -- 172.21.15.5:0/881749887 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5593e8b8a870 con 0x5593e873c390 2024-08-31T05:44:13.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.589+0000 7f23cb7fe640 1 -- 172.21.15.5:0/881749887 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f23e401eda0 con 0x5593e873c390 2024-08-31T05:44:13.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.589+0000 7f23cb7fe640 1 -- 172.21.15.5:0/881749887 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 36) ==== 8386+0+0 (secure 0 0 0) 0x7f23e4028070 con 0x5593e873c390 2024-08-31T05:44:13.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.589+0000 7f23f8947740 10 client.19332 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T05:44:13.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.589+0000 7f23f8947740 10 client.19332 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-08-31T05:44:13.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.589+0000 7f23f8947740 20 client.19332 populate_metadata read hostname 'smithi005' 2024-08-31T05:44:13.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.589+0000 7f23f8947740 1 --2- 172.21.15.5:0/881749887 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x5593e86f0da0 0x5593e8b8cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:13.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.589+0000 7f23f8947740 4 client.19332 mds_command: new command op to 24602 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:44:13.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.589+0000 7f23f8947740 1 -- 172.21.15.5:0/881749887 --> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f23dc0047a0 con 0x5593e86f0da0 2024-08-31T05:44:13.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.590+0000 7f23eb7fe640 1 --2- 172.21.15.5:0/881749887 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x5593e86f0da0 0x5593e8b8cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:13.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.592+0000 7f23cb7fe640 10 client.19332 ms_handle_connect on v2:172.21.15.50:6836/428759669 2024-08-31T05:44:13.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.592+0000 7f23eb7fe640 1 --2- 172.21.15.5:0/881749887 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x5593e86f0da0 0x5593e8b8cf30 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=76cb58dd6542caa0 server_cookie=fdc5e4a51f389ec9 in_seq=0 out_seq=0 2024-08-31T05:44:13.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.593+0000 7f23cb7fe640 1 -- 172.21.15.5:0/881749887 <== mds.4 v2:172.21.15.50:6836/428759669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f23dc0047a0 con 0x5593e86f0da0 2024-08-31T05:44:13.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.593+0000 7f23cb7fe640 10 client.19332 handle_command_reply: tid=0 2024-08-31T05:44:13.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.593+0000 7f23f8947740 1 client.19332 shutdown 2024-08-31T05:44:13.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.595+0000 7f23f8947740 1 -- 172.21.15.5:0/881749887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5593e873c390 msgr2=0x5593e8b123c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:13.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.595+0000 7f23f8947740 1 --2- 172.21.15.5:0/881749887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5593e873c390 0x5593e8b123c0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f23e400a4e0 tx=0x7f23e4009560 comp rx=0 tx=0).stop 2024-08-31T05:44:13.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.595+0000 7f23f8947740 1 -- 172.21.15.5:0/881749887 shutdown_connections 2024-08-31T05:44:13.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.595+0000 7f23f8947740 1 --2- 172.21.15.5:0/881749887 >> [v2:172.21.15.50:6836/428759669,v1:172.21.15.50:6837/428759669] conn(0x5593e86f0da0 0x5593e8b8cf30 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:13.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.595+0000 7f23cb7fe640 0 client.19332 ms_handle_reset on v2:172.21.15.50:6836/428759669 2024-08-31T05:44:13.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.595+0000 7f23f8947740 1 --2- 172.21.15.5:0/881749887 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5593e875d070 0x5593e8b12900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:13.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.595+0000 7f23f8947740 1 --2- 172.21.15.5:0/881749887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5593e873c390 0x5593e8b123c0 secure :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f23e400a4e0 tx=0x7f23e4009560 comp rx=0 tx=0).stop 2024-08-31T05:44:13.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.595+0000 7f23f8947740 1 --2- 172.21.15.5:0/881749887 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5593e87341b0 0x5593e8b11e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:13.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.595+0000 7f23f8947740 1 -- 172.21.15.5:0/881749887 >> 172.21.15.5:0/881749887 conn(0x5593e8751460 msgr2=0x5593e8b05410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:13.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.596+0000 7f23f8947740 1 -- 172.21.15.5:0/881749887 shutdown_connections 2024-08-31T05:44:13.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.597+0000 7f23f8947740 1 -- 172.21.15.5:0/881749887 wait complete. 2024-08-31T05:44:13.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.597+0000 7f23f8947740 20 client.19332 trim_cache size 0 max 16384 2024-08-31T05:44:13.609 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:44:13.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.598+0000 7f23f23d2640 1 -- 172.21.15.5:0/3169625914 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f23d80b4da0 msgr2=0x7f23d80b72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:13.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.598+0000 7f23f23d2640 1 --2- 172.21.15.5:0/3169625914 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f23d80b4da0 0x7f23d80b72b0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f23d4005f70 tx=0x7f23d4003f50 comp rx=0 tx=0).stop 2024-08-31T05:44:13.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.598+0000 7f23f23d2640 1 -- 172.21.15.5:0/3169625914 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23ec1101e0 msgr2=0x7f23ec1a6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:13.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.598+0000 7f23f23d2640 1 --2- 172.21.15.5:0/3169625914 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23ec1101e0 0x7f23ec1a6110 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f23d4004770 tx=0x7f23d4004270 comp rx=0 tx=0).stop 2024-08-31T05:44:13.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.598+0000 7f23f23d2640 1 -- 172.21.15.5:0/3169625914 shutdown_connections 2024-08-31T05:44:13.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.598+0000 7f23f23d2640 1 --2- 172.21.15.5:0/3169625914 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f23d80b4da0 0x7f23d80b72b0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:13.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.598+0000 7f23f23d2640 1 --2- 172.21.15.5:0/3169625914 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23ec1101e0 0x7f23ec1a6110 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:13.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.598+0000 7f23f23d2640 1 --2- 172.21.15.5:0/3169625914 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23ec10f890 0x7f23ec1a0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:13.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.598+0000 7f23f23d2640 1 --2- 172.21.15.5:0/3169625914 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f23ec109f50 0x7f23ec1a08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:13.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.598+0000 7f23f23d2640 1 -- 172.21.15.5:0/3169625914 >> 172.21.15.5:0/3169625914 conn(0x7f23ec077e80 msgr2=0x7f23ec078540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:13.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.599+0000 7f23f23d2640 1 -- 172.21.15.5:0/3169625914 shutdown_connections 2024-08-31T05:44:13.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:13.599+0000 7f23f23d2640 1 -- 172.21.15.5:0/3169625914 wait complete. 2024-08-31T05:44:14.269 INFO:tasks.workunit.client.0.smithi005.stdout: 10 23170 23.22 MB/sec warmup 61 sec latency 236.567 ms 2024-08-31T05:44:14.430 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-31T05:44:14.513 INFO:tasks.workunit.client.0.smithi005.stdout:[19269] write failed on handle 13973 (Resource temporarily unavailable) 2024-08-31T05:44:14.513 INFO:tasks.workunit.client.0.smithi005.stdout:Child failed with status 1 2024-08-31T05:44:14.513 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T05:44:14.533 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.0... 2024-08-31T05:44:14.533 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-08-31T05:44:14.709 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:44:14.845 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/workunit.py", line 293, in _spawn_on_all_clients with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test suites/dbench.sh) on smithi005 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d19e6118f7015f0047264006cb0c873528eb3ae6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh' 2024-08-31T05:44:15.108 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=dcdfb20cc38047a19171386137633f0f Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/workunit.py", line 293, in _spawn_on_all_clients with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test suites/dbench.sh) on smithi005 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d19e6118f7015f0047264006cb0c873528eb3ae6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh' 2024-08-31T05:44:15.111 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-08-31T05:44:15.122 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi005.front.sepia.ceph.com 2024-08-31T05:44:15.137 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-08-31T05:44:15.147 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-08-31T05:44:15.147 INFO:teuthology.task.exec:Executing custom commands... 2024-08-31T05:44:15.147 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi005.front.sepia.ceph.com 2024-08-31T05:44:15.147 DEBUG:teuthology.orchestra.run.smithi005:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-08-31T05:44:15.205 DEBUG:teuthology.orchestra.run.smithi005:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-08-31T05:44:15.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.228+0000 7f2604993640 1 -- 172.21.15.5:0/3669918195 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2600109240 msgr2=0x7f2600109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:15.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.228+0000 7f2604993640 1 --2- 172.21.15.5:0/3669918195 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2600109240 0x7f2600109650 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f25f4009900 tx=0x7f25f402a410 comp rx=0 tx=0).stop 2024-08-31T05:44:15.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.228+0000 7f2604993640 1 -- 172.21.15.5:0/3669918195 shutdown_connections 2024-08-31T05:44:15.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.228+0000 7f2604993640 1 --2- 172.21.15.5:0/3669918195 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2600109b90 0x7f26001103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:15.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.228+0000 7f2604993640 1 --2- 172.21.15.5:0/3669918195 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2600109240 0x7f2600109650 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:15.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.228+0000 7f2604993640 1 --2- 172.21.15.5:0/3669918195 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2600103900 0x7f2600103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:15.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.228+0000 7f2604993640 1 -- 172.21.15.5:0/3669918195 >> 172.21.15.5:0/3669918195 conn(0x7f260007b5f0 msgr2=0x7f260007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:15.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.229+0000 7f2604993640 1 -- 172.21.15.5:0/3669918195 shutdown_connections 2024-08-31T05:44:15.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.229+0000 7f2604993640 1 -- 172.21.15.5:0/3669918195 wait complete. 2024-08-31T05:44:15.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.229+0000 7f2604993640 1 Processor -- start 2024-08-31T05:44:15.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.229+0000 7f2604993640 1 -- start start 2024-08-31T05:44:15.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.230+0000 7f2604993640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2600103900 0x7f260019a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:15.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.230+0000 7f2604993640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2600109240 0x7f260019a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:15.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.230+0000 7f2604993640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2600109b90 0x7f260019fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:15.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.230+0000 7f2604993640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2600113850 con 0x7f2600103900 2024-08-31T05:44:15.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.230+0000 7f2604993640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f26001136d0 con 0x7f2600109b90 2024-08-31T05:44:15.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.230+0000 7f2604993640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f26001139d0 con 0x7f2600109240 2024-08-31T05:44:15.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.230+0000 7f25fe59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2600103900 0x7f260019a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:15.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.230+0000 7f25fe59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2600103900 0x7f260019a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55616/0 (socket says 172.21.15.5:55616) 2024-08-31T05:44:15.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.230+0000 7f25fe59c640 1 -- 172.21.15.5:0/2303615648 learned_addr learned my addr 172.21.15.5:0/2303615648 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:44:15.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.230+0000 7f25fdd9b640 1 --2- 172.21.15.5:0/2303615648 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2600109240 0x7f260019a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:15.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.230+0000 7f25fed9d640 1 --2- 172.21.15.5:0/2303615648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2600109b90 0x7f260019fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:15.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.230+0000 7f25fe59c640 1 -- 172.21.15.5:0/2303615648 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2600109240 msgr2=0x7f260019a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:15.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.230+0000 7f25fe59c640 1 --2- 172.21.15.5:0/2303615648 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2600109240 0x7f260019a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:15.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.230+0000 7f25fe59c640 1 -- 172.21.15.5:0/2303615648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2600109b90 msgr2=0x7f260019fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:15.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.230+0000 7f25fe59c640 1 --2- 172.21.15.5:0/2303615648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2600109b90 0x7f260019fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:15.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.230+0000 7f25fe59c640 1 -- 172.21.15.5:0/2303615648 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26001a01f0 con 0x7f2600103900 2024-08-31T05:44:15.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.230+0000 7f25fe59c640 1 --2- 172.21.15.5:0/2303615648 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2600103900 0x7f260019a340 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f25f000c920 tx=0x7f25f000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:15.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.231+0000 7f25ef7fe640 1 -- 172.21.15.5:0/2303615648 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f0007c70 con 0x7f2600103900 2024-08-31T05:44:15.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.231+0000 7f25ef7fe640 1 -- 172.21.15.5:0/2303615648 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25f0007e10 con 0x7f2600103900 2024-08-31T05:44:15.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.231+0000 7f2604993640 1 -- 172.21.15.5:0/2303615648 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26001a04e0 con 0x7f2600103900 2024-08-31T05:44:15.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.231+0000 7f25ef7fe640 1 -- 172.21.15.5:0/2303615648 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f0018820 con 0x7f2600103900 2024-08-31T05:44:15.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.231+0000 7f2604993640 1 -- 172.21.15.5:0/2303615648 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26001a6d00 con 0x7f2600103900 2024-08-31T05:44:15.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.233+0000 7f260af08740 1 Processor -- start 2024-08-31T05:44:15.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.234+0000 7f260af08740 1 -- start start 2024-08-31T05:44:15.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.234+0000 7f25ef7fe640 1 -- 172.21.15.5:0/2303615648 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f25f000f450 con 0x7f2600103900 2024-08-31T05:44:15.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.234+0000 7f260af08740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55579913c070 0x5557994e1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:15.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.234+0000 7f260af08740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5557991131b0 0x5557994e1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:15.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.234+0000 7f260af08740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55579911b390 0x5557994e1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:15.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.234+0000 7f260af08740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x555799458680 con 0x55579911b390 2024-08-31T05:44:15.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.234+0000 7f260af08740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x555799447c10 con 0x55579913c070 2024-08-31T05:44:15.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.234+0000 7f260af08740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55579944bbc0 con 0x5557991131b0 2024-08-31T05:44:15.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.234+0000 7f25fdd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55579911b390 0x5557994e1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:15.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.234+0000 7f25fdd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55579911b390 0x5557994e1dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55620/0 (socket says 172.21.15.5:55620) 2024-08-31T05:44:15.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.234+0000 7f25fdd9b640 1 -- 172.21.15.5:0/1028067799 learned_addr learned my addr 172.21.15.5:0/1028067799 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:44:15.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.234+0000 7f25fed9d640 1 --2- 172.21.15.5:0/1028067799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55579913c070 0x5557994e1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:15.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.234+0000 7f25fe59c640 1 --2- 172.21.15.5:0/1028067799 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5557991131b0 0x5557994e1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:15.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.235+0000 7f25fdd9b640 1 -- 172.21.15.5:0/1028067799 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5557991131b0 msgr2=0x5557994e1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:44:15.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.235+0000 7f25fdd9b640 1 --2- 172.21.15.5:0/1028067799 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5557991131b0 0x5557994e1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:15.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.235+0000 7f25fdd9b640 1 -- 172.21.15.5:0/1028067799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55579913c070 msgr2=0x5557994e1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:44:15.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.235+0000 7f25fdd9b640 1 --2- 172.21.15.5:0/1028067799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55579913c070 0x5557994e1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:15.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.235+0000 7f25fdd9b640 1 -- 172.21.15.5:0/1028067799 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557991a7650 con 0x55579911b390 2024-08-31T05:44:15.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.235+0000 7f25fed9d640 1 --2- 172.21.15.5:0/1028067799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55579913c070 0x5557994e1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:44:15.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.235+0000 7f25ef7fe640 1 --2- 172.21.15.5:0/2303615648 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f25e80b4cd0 0x7f25e80b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:15.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.235+0000 7f25fdd9b640 1 --2- 172.21.15.5:0/1028067799 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55579911b390 0x5557994e1dd0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f25f4009900 tx=0x7f25f4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2626aac2d08f8e27 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:15.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.235+0000 7f25fed9d640 1 --2- 172.21.15.5:0/2303615648 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f25e80b4cd0 0x7f25e80b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:15.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.235+0000 7f25ecff9640 1 -- 172.21.15.5:0/1028067799 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f4040070 con 0x55579911b390 2024-08-31T05:44:15.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.235+0000 7f25ef7fe640 1 -- 172.21.15.5:0/2303615648 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9511+0+0 (secure 0 0 0) 0x7f25f00e5990 con 0x7f2600103900 2024-08-31T05:44:15.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.235+0000 7f25ecff9640 1 -- 172.21.15.5:0/1028067799 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25f4005db0 con 0x55579911b390 2024-08-31T05:44:15.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.235+0000 7f25ecff9640 1 -- 172.21.15.5:0/1028067799 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f4035040 con 0x55579911b390 2024-08-31T05:44:15.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.236+0000 7f260af08740 1 -- 172.21.15.5:0/1028067799 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55579911b390 msgr2=0x5557994e1dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:15.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.236+0000 7f260af08740 1 --2- 172.21.15.5:0/1028067799 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55579911b390 0x5557994e1dd0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f25f4009900 tx=0x7f25f4000bc0 comp rx=0 tx=0).stop 2024-08-31T05:44:15.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.236+0000 7f25fed9d640 1 --2- 172.21.15.5:0/2303615648 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f25e80b4cd0 0x7f25e80b71e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f25f8005fd0 tx=0x7f25f80096a0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:15.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.236+0000 7f260af08740 1 -- 172.21.15.5:0/1028067799 shutdown_connections 2024-08-31T05:44:15.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.236+0000 7f260af08740 1 --2- 172.21.15.5:0/1028067799 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55579911b390 0x5557994e1dd0 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:15.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.236+0000 7f260af08740 1 --2- 172.21.15.5:0/1028067799 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5557991131b0 0x5557994e1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:15.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.236+0000 7f260af08740 1 --2- 172.21.15.5:0/1028067799 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55579913c070 0x5557994e1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:15.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.237+0000 7f260af08740 1 -- 172.21.15.5:0/1028067799 >> 172.21.15.5:0/1028067799 conn(0x555799130460 msgr2=0x5557994df240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:15.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.237+0000 7f260af08740 1 -- 172.21.15.5:0/1028067799 shutdown_connections 2024-08-31T05:44:15.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.237+0000 7f260af08740 1 -- 172.21.15.5:0/1028067799 wait complete. 2024-08-31T05:44:15.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.237+0000 7f260af08740 1 -- start start 2024-08-31T05:44:15.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.237+0000 7f260af08740 1 Processor -- start 2024-08-31T05:44:15.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.237+0000 7f260af08740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5557991131b0 0x5557994ecae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:15.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.237+0000 7f260af08740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55579911b390 0x5557994ed020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:15.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.238+0000 7f260af08740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55579913c070 0x5557994f8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:15.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.238+0000 7f260af08740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5557992aa700 con 0x55579913c070 2024-08-31T05:44:15.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.238+0000 7f260af08740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x5557993ce750 con 0x55579911b390 2024-08-31T05:44:15.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.238+0000 7f260af08740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5557994efad0 con 0x5557991131b0 2024-08-31T05:44:15.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.238+0000 7f260af08740 10 client.0 _ll_register_callbacks cb 0x5557993fde10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:44:15.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.238+0000 7f25fed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55579913c070 0x5557994f8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:15.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.238+0000 7f25fed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55579913c070 0x5557994f8dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55634/0 (socket says 172.21.15.5:55634) 2024-08-31T05:44:15.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.238+0000 7f25fed9d640 1 -- 172.21.15.5:0/504481911 learned_addr learned my addr 172.21.15.5:0/504481911 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:44:15.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.238+0000 7f25fe59c640 1 --2- 172.21.15.5:0/504481911 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5557991131b0 0x5557994ecae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:15.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.238+0000 7f25fdd9b640 1 --2- 172.21.15.5:0/504481911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55579911b390 0x5557994ed020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:15.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.238+0000 7f25fed9d640 1 -- 172.21.15.5:0/504481911 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5557991131b0 msgr2=0x5557994ecae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:44:15.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.238+0000 7f25fed9d640 1 --2- 172.21.15.5:0/504481911 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5557991131b0 0x5557994ecae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:15.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.238+0000 7f25fed9d640 1 -- 172.21.15.5:0/504481911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55579911b390 msgr2=0x5557994ed020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:44:15.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.238+0000 7f25fed9d640 1 --2- 172.21.15.5:0/504481911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55579911b390 0x5557994ed020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:15.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.238+0000 7f25fed9d640 1 -- 172.21.15.5:0/504481911 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555799407900 con 0x55579913c070 2024-08-31T05:44:15.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.238+0000 7f25fe59c640 1 --2- 172.21.15.5:0/504481911 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5557991131b0 0x5557994ecae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:44:15.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.238+0000 7f25fdd9b640 1 --2- 172.21.15.5:0/504481911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55579911b390 0x5557994ed020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:44:15.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.238+0000 7f25fed9d640 1 --2- 172.21.15.5:0/504481911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55579913c070 0x5557994f8dc0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f25f8009fd0 tx=0x7f25f8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87360757bb7537 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:15.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.238+0000 7f25e5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:44:15.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.239+0000 7f25e5ffb640 1 -- 172.21.15.5:0/504481911 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f802c060 con 0x55579913c070 2024-08-31T05:44:15.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.239+0000 7f25e5ffb640 1 -- 172.21.15.5:0/504481911 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9511+0+0 (secure 0 0 0) 0x7f25f8017030 con 0x55579913c070 2024-08-31T05:44:15.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.239+0000 7f260af08740 1 -- 172.21.15.5:0/504481911 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25f4005db0 con 0x55579913c070 2024-08-31T05:44:15.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.239+0000 7f25e5ffb640 1 -- 172.21.15.5:0/504481911 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f25f8033050 con 0x55579913c070 2024-08-31T05:44:15.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.239+0000 7f260af08740 10 client.19344 fetch_fsmap learned FSMap version 36 2024-08-31T05:44:15.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.239+0000 7f260af08740 1 -- 172.21.15.5:0/504481911 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5557994fb910 con 0x55579913c070 2024-08-31T05:44:15.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.239+0000 7f25e5ffb640 1 -- 172.21.15.5:0/504481911 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25f4005db0 con 0x55579913c070 2024-08-31T05:44:15.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.239+0000 7f25e5ffb640 1 -- 172.21.15.5:0/504481911 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 36) ==== 8386+0+0 (secure 0 0 0) 0x7f25f8027a70 con 0x55579913c070 2024-08-31T05:44:15.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.239+0000 7f260af08740 10 client.19344 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T05:44:15.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.239+0000 7f260af08740 10 client.19344 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-31T05:44:15.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.239+0000 7f260af08740 20 client.19344 populate_metadata read hostname 'smithi005' 2024-08-31T05:44:15.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.239+0000 7f260af08740 1 --2- 172.21.15.5:0/504481911 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5557990fa9f0 0x5557994fee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:15.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.239+0000 7f260af08740 4 client.19344 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:44:15.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.239+0000 7f260af08740 1 -- 172.21.15.5:0/504481911 --> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55579945a5d0 con 0x5557990fa9f0 2024-08-31T05:44:15.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.240+0000 7f25fe59c640 1 --2- 172.21.15.5:0/504481911 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5557990fa9f0 0x5557994fee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:15.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.240+0000 7f25e5ffb640 10 client.19344 ms_handle_connect on v2:172.21.15.70:6834/2061504114 2024-08-31T05:44:15.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.240+0000 7f25fe59c640 1 --2- 172.21.15.5:0/504481911 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5557990fa9f0 0x5557994fee80 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d8ef310d1b4143c4 server_cookie=ff989d747ab3f97d in_seq=0 out_seq=0 2024-08-31T05:44:15.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.241+0000 7f25e5ffb640 1 -- 172.21.15.5:0/504481911 <== mds.3 v2:172.21.15.70:6834/2061504114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55579945a5d0 con 0x5557990fa9f0 2024-08-31T05:44:15.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.241+0000 7f25e5ffb640 10 client.19344 handle_command_reply: tid=0 2024-08-31T05:44:15.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.241+0000 7f260af08740 1 client.19344 shutdown 2024-08-31T05:44:15.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.241+0000 7f260af08740 1 -- 172.21.15.5:0/504481911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55579913c070 msgr2=0x5557994f8dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:15.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.241+0000 7f260af08740 1 --2- 172.21.15.5:0/504481911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55579913c070 0x5557994f8dc0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f25f8009fd0 tx=0x7f25f8004ab0 comp rx=0 tx=0).stop 2024-08-31T05:44:15.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.241+0000 7f260af08740 1 -- 172.21.15.5:0/504481911 shutdown_connections 2024-08-31T05:44:15.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.241+0000 7f260af08740 1 --2- 172.21.15.5:0/504481911 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5557990fa9f0 0x5557994fee80 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:15.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.241+0000 7f260af08740 1 --2- 172.21.15.5:0/504481911 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55579913c070 0x5557994f8dc0 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:15.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.241+0000 7f260af08740 1 --2- 172.21.15.5:0/504481911 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55579911b390 0x5557994ed020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:15.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.241+0000 7f260af08740 1 --2- 172.21.15.5:0/504481911 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5557991131b0 0x5557994ecae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:15.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.241+0000 7f260af08740 1 -- 172.21.15.5:0/504481911 >> 172.21.15.5:0/504481911 conn(0x555799130460 msgr2=0x5557994e4530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:15.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.241+0000 7f25e5ffb640 0 client.19344 ms_handle_reset on v2:172.21.15.70:6834/2061504114 2024-08-31T05:44:15.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.241+0000 7f260af08740 1 -- 172.21.15.5:0/504481911 shutdown_connections 2024-08-31T05:44:15.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.241+0000 7f260af08740 1 -- 172.21.15.5:0/504481911 wait complete. 2024-08-31T05:44:15.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.241+0000 7f260af08740 20 client.19344 trim_cache size 0 max 16384 2024-08-31T05:44:15.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.255+0000 7f260af08740 1 Processor -- start 2024-08-31T05:44:15.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.255+0000 7f260af08740 1 -- start start 2024-08-31T05:44:15.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.255+0000 7f260af08740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557991131b0 0x5557994ed160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:15.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.255+0000 7f260af08740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55579911b390 0x5557994f8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:15.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.255+0000 7f260af08740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55579913c070 0x5557994f9200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:15.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.255+0000 7f260af08740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f26001b0d10 con 0x55579913c070 2024-08-31T05:44:15.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.255+0000 7f260af08740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f26001b2910 con 0x5557991131b0 2024-08-31T05:44:15.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.255+0000 7f260af08740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f26001b13e0 con 0x55579911b390 2024-08-31T05:44:15.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.255+0000 7f25fed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55579913c070 0x5557994f9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:15.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.255+0000 7f25fed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55579913c070 0x5557994f9200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55650/0 (socket says 172.21.15.5:55650) 2024-08-31T05:44:15.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.255+0000 7f25fed9d640 1 -- 172.21.15.5:0/2367113626 learned_addr learned my addr 172.21.15.5:0/2367113626 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:44:15.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.255+0000 7f25fe59c640 1 --2- 172.21.15.5:0/2367113626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557991131b0 0x5557994ed160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:15.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.255+0000 7f25fdd9b640 1 --2- 172.21.15.5:0/2367113626 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55579911b390 0x5557994f8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:15.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.256+0000 7f25fe59c640 1 -- 172.21.15.5:0/2367113626 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55579911b390 msgr2=0x5557994f8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:44:15.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.256+0000 7f25fe59c640 1 --2- 172.21.15.5:0/2367113626 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55579911b390 0x5557994f8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:15.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.256+0000 7f25fe59c640 1 -- 172.21.15.5:0/2367113626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55579913c070 msgr2=0x5557994f9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:44:15.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.256+0000 7f25fe59c640 1 --2- 172.21.15.5:0/2367113626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55579913c070 0x5557994f9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:15.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.256+0000 7f25fe59c640 1 -- 172.21.15.5:0/2367113626 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557990fac10 con 0x5557991131b0 2024-08-31T05:44:15.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.256+0000 7f25fed9d640 1 --2- 172.21.15.5:0/2367113626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55579913c070 0x5557994f9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:44:15.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.256+0000 7f25fe59c640 1 --2- 172.21.15.5:0/2367113626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557991131b0 0x5557994ed160 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f25f00e2d00 tx=0x7f25f000fe60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38939acb62e19ea8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:15.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.256+0000 7f25e7fff640 1 -- 172.21.15.5:0/2367113626 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f00ab7b0 con 0x5557991131b0 2024-08-31T05:44:15.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.256+0000 7f25e7fff640 1 -- 172.21.15.5:0/2367113626 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25f00ac3a0 con 0x5557991131b0 2024-08-31T05:44:15.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.256+0000 7f25e7fff640 1 -- 172.21.15.5:0/2367113626 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f000f740 con 0x5557991131b0 2024-08-31T05:44:15.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.257+0000 7f260af08740 1 -- 172.21.15.5:0/2367113626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557991131b0 msgr2=0x5557994ed160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:15.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.257+0000 7f260af08740 1 --2- 172.21.15.5:0/2367113626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557991131b0 0x5557994ed160 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f25f00e2d00 tx=0x7f25f000fe60 comp rx=0 tx=0).stop 2024-08-31T05:44:15.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.257+0000 7f260af08740 1 -- 172.21.15.5:0/2367113626 shutdown_connections 2024-08-31T05:44:15.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.257+0000 7f260af08740 1 --2- 172.21.15.5:0/2367113626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55579913c070 0x5557994f9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:15.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.257+0000 7f260af08740 1 --2- 172.21.15.5:0/2367113626 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55579911b390 0x5557994f8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:15.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.257+0000 7f260af08740 1 --2- 172.21.15.5:0/2367113626 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x5557991131b0 0x5557994ed160 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:15.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.257+0000 7f260af08740 1 -- 172.21.15.5:0/2367113626 >> 172.21.15.5:0/2367113626 conn(0x555799130460 msgr2=0x5557994eca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:15.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.257+0000 7f260af08740 1 -- 172.21.15.5:0/2367113626 shutdown_connections 2024-08-31T05:44:15.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.257+0000 7f260af08740 1 -- 172.21.15.5:0/2367113626 wait complete. 2024-08-31T05:44:15.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.258+0000 7f260af08740 1 -- start start 2024-08-31T05:44:15.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.258+0000 7f260af08740 1 Processor -- start 2024-08-31T05:44:15.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.258+0000 7f260af08740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557991131b0 0x5557994f07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:15.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.258+0000 7f260af08740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55579911b390 0x5557994f0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:15.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.258+0000 7f260af08740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55579913c070 0x555799561940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:15.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.258+0000 7f260af08740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f26001b2240 con 0x5557991131b0 2024-08-31T05:44:15.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.258+0000 7f260af08740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f26001b1b70 con 0x55579913c070 2024-08-31T05:44:15.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.258+0000 7f260af08740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f26001aed10 con 0x55579911b390 2024-08-31T05:44:15.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.258+0000 7f260af08740 10 client.0 _ll_register_callbacks cb 0x7f25f8009e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:44:15.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.258+0000 7f25fe59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557991131b0 0x5557994f07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:15.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.258+0000 7f25fe59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557991131b0 0x5557994f07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55662/0 (socket says 172.21.15.5:55662) 2024-08-31T05:44:15.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.258+0000 7f25fe59c640 1 -- 172.21.15.5:0/1673249292 learned_addr learned my addr 172.21.15.5:0/1673249292 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:44:15.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.258+0000 7f25fed9d640 1 --2- 172.21.15.5:0/1673249292 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55579913c070 0x555799561940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:15.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.258+0000 7f25fdd9b640 1 --2- 172.21.15.5:0/1673249292 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55579911b390 0x5557994f0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:15.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.259+0000 7f25fed9d640 1 -- 172.21.15.5:0/1673249292 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55579911b390 msgr2=0x5557994f0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:44:15.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.259+0000 7f25fed9d640 1 --2- 172.21.15.5:0/1673249292 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55579911b390 0x5557994f0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:15.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.259+0000 7f25fed9d640 1 -- 172.21.15.5:0/1673249292 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557991131b0 msgr2=0x5557994f07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:44:15.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.259+0000 7f25fed9d640 1 --2- 172.21.15.5:0/1673249292 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557991131b0 0x5557994f07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:15.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.259+0000 7f25fed9d640 1 -- 172.21.15.5:0/1673249292 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555799561fb0 con 0x55579913c070 2024-08-31T05:44:15.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.259+0000 7f25fe59c640 1 --2- 172.21.15.5:0/1673249292 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557991131b0 0x5557994f07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:44:15.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.259+0000 7f25fed9d640 1 --2- 172.21.15.5:0/1673249292 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55579913c070 0x555799561940 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f25f801c440 tx=0x7f25f801c6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84c8dda1ab7c08ee server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:15.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.259+0000 7f25e5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:44:15.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.259+0000 7f25e5ffb640 1 -- 172.21.15.5:0/1673249292 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f801fcc0 con 0x55579913c070 2024-08-31T05:44:15.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.259+0000 7f25e5ffb640 1 -- 172.21.15.5:0/1673249292 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9511+0+0 (secure 0 0 0) 0x7f25f801c760 con 0x55579913c070 2024-08-31T05:44:15.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.259+0000 7f260af08740 1 -- 172.21.15.5:0/1673249292 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25f00ac3a0 con 0x55579913c070 2024-08-31T05:44:15.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.259+0000 7f25e5ffb640 1 -- 172.21.15.5:0/1673249292 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f25f801fe60 con 0x55579913c070 2024-08-31T05:44:15.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.259+0000 7f260af08740 10 client.28904 fetch_fsmap learned FSMap version 36 2024-08-31T05:44:15.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.260+0000 7f260af08740 1 -- 172.21.15.5:0/1673249292 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5557995693a0 con 0x55579913c070 2024-08-31T05:44:15.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.260+0000 7f25e5ffb640 1 -- 172.21.15.5:0/1673249292 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25f00ac3a0 con 0x55579913c070 2024-08-31T05:44:15.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.260+0000 7f25e5ffb640 1 -- 172.21.15.5:0/1673249292 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 36) ==== 8386+0+0 (secure 0 0 0) 0x7f25f8027870 con 0x55579913c070 2024-08-31T05:44:15.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.260+0000 7f260af08740 10 client.28904 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T05:44:15.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.260+0000 7f260af08740 10 client.28904 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-08-31T05:44:15.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.260+0000 7f260af08740 20 client.28904 populate_metadata read hostname 'smithi005' 2024-08-31T05:44:15.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.260+0000 7f260af08740 1 --2- 172.21.15.5:0/1673249292 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5557990cfda0 0x55579956bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:15.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.260+0000 7f260af08740 4 client.28904 mds_command: new command op to 24625 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:44:15.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.260+0000 7f260af08740 1 -- 172.21.15.5:0/1673249292 --> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555799456070 con 0x5557990cfda0 2024-08-31T05:44:15.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.260+0000 7f25fe59c640 1 --2- 172.21.15.5:0/1673249292 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5557990cfda0 0x55579956bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:15.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.261+0000 7f25e5ffb640 10 client.28904 ms_handle_connect on v2:172.21.15.70:6834/2061504114 2024-08-31T05:44:15.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.261+0000 7f25fe59c640 1 --2- 172.21.15.5:0/1673249292 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5557990cfda0 0x55579956bbb0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=7051663c9eda3e71 server_cookie=4582afdbf7c5b77e in_seq=0 out_seq=0 2024-08-31T05:44:15.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.261+0000 7f25e5ffb640 1 -- 172.21.15.5:0/1673249292 <== mds.3 v2:172.21.15.70:6834/2061504114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555799456070 con 0x5557990cfda0 2024-08-31T05:44:15.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.261+0000 7f25e5ffb640 10 client.28904 handle_command_reply: tid=0 2024-08-31T05:44:15.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.261+0000 7f260af08740 1 client.28904 shutdown 2024-08-31T05:44:15.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.261+0000 7f260af08740 1 -- 172.21.15.5:0/1673249292 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55579913c070 msgr2=0x555799561940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:15.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.261+0000 7f260af08740 1 --2- 172.21.15.5:0/1673249292 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55579913c070 0x555799561940 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f25f801c440 tx=0x7f25f801c6f0 comp rx=0 tx=0).stop 2024-08-31T05:44:15.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.261+0000 7f260af08740 1 -- 172.21.15.5:0/1673249292 shutdown_connections 2024-08-31T05:44:15.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.261+0000 7f260af08740 1 --2- 172.21.15.5:0/1673249292 >> [v2:172.21.15.70:6834/2061504114,v1:172.21.15.70:6835/2061504114] conn(0x5557990cfda0 0x55579956bbb0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:15.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.261+0000 7f260af08740 1 --2- 172.21.15.5:0/1673249292 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55579913c070 0x555799561940 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:15.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.261+0000 7f260af08740 1 --2- 172.21.15.5:0/1673249292 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55579911b390 0x5557994f0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:15.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.261+0000 7f260af08740 1 --2- 172.21.15.5:0/1673249292 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5557991131b0 0x5557994f07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:15.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.261+0000 7f260af08740 1 -- 172.21.15.5:0/1673249292 >> 172.21.15.5:0/1673249292 conn(0x555799130460 msgr2=0x5557994dea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:15.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.261+0000 7f25e5ffb640 0 client.28904 ms_handle_reset on v2:172.21.15.70:6834/2061504114 2024-08-31T05:44:15.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.261+0000 7f260af08740 1 -- 172.21.15.5:0/1673249292 shutdown_connections 2024-08-31T05:44:15.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.261+0000 7f260af08740 1 -- 172.21.15.5:0/1673249292 wait complete. 2024-08-31T05:44:15.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.262+0000 7f260af08740 20 client.28904 trim_cache size 0 max 16384 2024-08-31T05:44:15.279 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:44:15.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.262+0000 7f2604993640 1 -- 172.21.15.5:0/2303615648 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f25e80b4cd0 msgr2=0x7f25e80b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:15.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.262+0000 7f2604993640 1 --2- 172.21.15.5:0/2303615648 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f25e80b4cd0 0x7f25e80b71e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f25f8005fd0 tx=0x7f25f80096a0 comp rx=0 tx=0).stop 2024-08-31T05:44:15.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.262+0000 7f2604993640 1 -- 172.21.15.5:0/2303615648 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2600103900 msgr2=0x7f260019a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:15.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.262+0000 7f2604993640 1 --2- 172.21.15.5:0/2303615648 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2600103900 0x7f260019a340 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f25f000c920 tx=0x7f25f000cde0 comp rx=0 tx=0).stop 2024-08-31T05:44:15.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.262+0000 7f2604993640 1 -- 172.21.15.5:0/2303615648 shutdown_connections 2024-08-31T05:44:15.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.262+0000 7f2604993640 1 --2- 172.21.15.5:0/2303615648 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f25e80b4cd0 0x7f25e80b71e0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:15.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.262+0000 7f2604993640 1 --2- 172.21.15.5:0/2303615648 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2600109b90 0x7f260019fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:15.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.262+0000 7f2604993640 1 --2- 172.21.15.5:0/2303615648 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2600109240 0x7f260019a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:15.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.262+0000 7f2604993640 1 --2- 172.21.15.5:0/2303615648 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2600103900 0x7f260019a340 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:15.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.262+0000 7f2604993640 1 -- 172.21.15.5:0/2303615648 >> 172.21.15.5:0/2303615648 conn(0x7f260007b5f0 msgr2=0x7f2600105360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:15.282 DEBUG:teuthology.orchestra.run.smithi005:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-08-31T05:44:15.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.263+0000 7f2604993640 1 -- 172.21.15.5:0/2303615648 shutdown_connections 2024-08-31T05:44:15.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.263+0000 7f2604993640 1 -- 172.21.15.5:0/2303615648 wait complete. 2024-08-31T05:44:15.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:44:15 smithi050 ceph-mon[22146]: pgmap v788: 129 pgs: 129 active+clean; 827 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 6.3 MiB/s wr, 542 op/s 2024-08-31T05:44:15.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:44:15 smithi050 ceph-mon[22146]: osdmap e103: 12 total, 12 up, 12 in 2024-08-31T05:44:15.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.433+0000 7f2833a0f640 1 -- 172.21.15.5:0/1836759361 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f282c10feb0 msgr2=0x7f282c1122d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:15.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.433+0000 7f2833a0f640 1 --2- 172.21.15.5:0/1836759361 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f282c10feb0 0x7f282c1122d0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f2824009900 tx=0x7f282402a480 comp rx=0 tx=0).stop 2024-08-31T05:44:15.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.433+0000 7f2833a0f640 1 -- 172.21.15.5:0/1836759361 shutdown_connections 2024-08-31T05:44:15.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.433+0000 7f2833a0f640 1 --2- 172.21.15.5:0/1836759361 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f282c10feb0 0x7f282c1122d0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:15.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.433+0000 7f2833a0f640 1 --2- 172.21.15.5:0/1836759361 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f282c102c50 0x7f282c10f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:15.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.433+0000 7f2833a0f640 1 --2- 172.21.15.5:0/1836759361 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f282c102300 0x7f282c102710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:15.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.433+0000 7f2833a0f640 1 -- 172.21.15.5:0/1836759361 >> 172.21.15.5:0/1836759361 conn(0x7f282c0fe1a0 msgr2=0x7f282c1005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:15.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.433+0000 7f2833a0f640 1 -- 172.21.15.5:0/1836759361 shutdown_connections 2024-08-31T05:44:15.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.433+0000 7f2833a0f640 1 -- 172.21.15.5:0/1836759361 wait complete. 2024-08-31T05:44:15.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.434+0000 7f2833a0f640 1 Processor -- start 2024-08-31T05:44:15.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.434+0000 7f2833a0f640 1 -- start start 2024-08-31T05:44:15.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.434+0000 7f2833a0f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f282c102300 0x7f282c19c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:15.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.434+0000 7f2833a0f640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f282c102c50 0x7f282c19c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:15.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.434+0000 7f2833a0f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f282c10feb0 0x7f282c1a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:15.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.434+0000 7f2833a0f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f282c1159a0 con 0x7f282c102300 2024-08-31T05:44:15.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.434+0000 7f2833a0f640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f282c115820 con 0x7f282c102c50 2024-08-31T05:44:15.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.434+0000 7f2833a0f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f282c115b20 con 0x7f282c10feb0 2024-08-31T05:44:15.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.434+0000 7f28317ab640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f282c102300 0x7f282c19c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:15.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.434+0000 7f28317ab640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f282c102300 0x7f282c19c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55686/0 (socket says 172.21.15.5:55686) 2024-08-31T05:44:15.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.434+0000 7f28317ab640 1 -- 172.21.15.5:0/3068901272 learned_addr learned my addr 172.21.15.5:0/3068901272 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:44:15.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.434+0000 7f2830faa640 1 --2- 172.21.15.5:0/3068901272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f282c102c50 0x7f282c19c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:15.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.435+0000 7f2831fac640 1 --2- 172.21.15.5:0/3068901272 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f282c10feb0 0x7f282c1a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:15.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.435+0000 7f28317ab640 1 -- 172.21.15.5:0/3068901272 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f282c10feb0 msgr2=0x7f282c1a1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:15.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.435+0000 7f28317ab640 1 --2- 172.21.15.5:0/3068901272 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f282c10feb0 0x7f282c1a1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:15.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.435+0000 7f28317ab640 1 -- 172.21.15.5:0/3068901272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f282c102c50 msgr2=0x7f282c19c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:15.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.435+0000 7f28317ab640 1 --2- 172.21.15.5:0/3068901272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f282c102c50 0x7f282c19c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:15.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.435+0000 7f28317ab640 1 -- 172.21.15.5:0/3068901272 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f282c1a2270 con 0x7f282c102300 2024-08-31T05:44:15.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.435+0000 7f28317ab640 1 --2- 172.21.15.5:0/3068901272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f282c102300 0x7f282c19c340 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f281c00eb90 tx=0x7f281c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:15.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.435+0000 7f282a7fc640 1 -- 172.21.15.5:0/3068901272 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f281c004d20 con 0x7f282c102300 2024-08-31T05:44:15.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.435+0000 7f2833a0f640 1 -- 172.21.15.5:0/3068901272 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f282c1a2560 con 0x7f282c102300 2024-08-31T05:44:15.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.435+0000 7f282a7fc640 1 -- 172.21.15.5:0/3068901272 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f281c00ee90 con 0x7f282c102300 2024-08-31T05:44:15.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.435+0000 7f282a7fc640 1 -- 172.21.15.5:0/3068901272 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f281c010670 con 0x7f282c102300 2024-08-31T05:44:15.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.435+0000 7f2833a0f640 1 -- 172.21.15.5:0/3068901272 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f282c1a8cf0 con 0x7f282c102300 2024-08-31T05:44:15.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.436+0000 7f2833a0f640 1 -- 172.21.15.5:0/3068901272 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f282c102710 con 0x7f282c102300 2024-08-31T05:44:15.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.438+0000 7f282a7fc640 1 -- 172.21.15.5:0/3068901272 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f281c005020 con 0x7f282c102300 2024-08-31T05:44:15.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.438+0000 7f282a7fc640 1 --2- 172.21.15.5:0/3068901272 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f28140b4ca0 0x7f28140b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:15.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.438+0000 7f282a7fc640 1 -- 172.21.15.5:0/3068901272 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9511+0+0 (secure 0 0 0) 0x7f281c0e6040 con 0x7f282c102300 2024-08-31T05:44:15.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.438+0000 7f2830faa640 1 --2- 172.21.15.5:0/3068901272 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f28140b4ca0 0x7f28140b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:15.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.439+0000 7f2830faa640 1 --2- 172.21.15.5:0/3068901272 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f28140b4ca0 0x7f28140b71b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f282c103bd0 tx=0x7f282000b410 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:15.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.443+0000 7f282a7fc640 1 -- 172.21.15.5:0/3068901272 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f281c0aca50 con 0x7f282c102300 2024-08-31T05:44:15.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:44:15 smithi005 ceph-mon[18602]: pgmap v788: 129 pgs: 129 active+clean; 827 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 6.3 MiB/s wr, 542 op/s 2024-08-31T05:44:15.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:44:15 smithi005 ceph-mon[18602]: osdmap e103: 12 total, 12 up, 12 in 2024-08-31T05:44:15.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:44:15 smithi070 ceph-mon[22316]: pgmap v788: 129 pgs: 129 active+clean; 827 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 6.3 MiB/s wr, 542 op/s 2024-08-31T05:44:15.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:44:15 smithi070 ceph-mon[22316]: osdmap e103: 12 total, 12 up, 12 in 2024-08-31T05:44:15.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.652+0000 7f2833a0f640 1 -- 172.21.15.5:0/3068901272 --> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f282c101350 con 0x7f28140b4ca0 2024-08-31T05:44:15.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.664+0000 7f282a7fc640 1 -- 172.21.15.5:0/3068901272 <== mgr.14220 v2:172.21.15.5:6800/2696053609 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7f282c101350 con 0x7f28140b4ca0 2024-08-31T05:44:15.666 INFO:teuthology.orchestra.run.smithi005.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-08-31T00:00:00", "created": "2024-08-31T05:30:06", "first": "2024-08-31T05:31:00", "last": "2024-08-31T05:44:00", "last_pruned": "2024-08-31T05:44:02", "created_count": 14, "pruned_count": 8, "active": true} 2024-08-31T05:44:15.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.666+0000 7f2833a0f640 1 -- 172.21.15.5:0/3068901272 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f28140b4ca0 msgr2=0x7f28140b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:15.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.666+0000 7f2833a0f640 1 --2- 172.21.15.5:0/3068901272 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f28140b4ca0 0x7f28140b71b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f282c103bd0 tx=0x7f282000b410 comp rx=0 tx=0).stop 2024-08-31T05:44:15.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.666+0000 7f2833a0f640 1 -- 172.21.15.5:0/3068901272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f282c102300 msgr2=0x7f282c19c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:15.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.666+0000 7f2833a0f640 1 --2- 172.21.15.5:0/3068901272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f282c102300 0x7f282c19c340 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f281c00eb90 tx=0x7f281c00c6a0 comp rx=0 tx=0).stop 2024-08-31T05:44:15.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.666+0000 7f2833a0f640 1 -- 172.21.15.5:0/3068901272 shutdown_connections 2024-08-31T05:44:15.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.666+0000 7f2833a0f640 1 --2- 172.21.15.5:0/3068901272 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f28140b4ca0 0x7f28140b71b0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:15.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.666+0000 7f2833a0f640 1 --2- 172.21.15.5:0/3068901272 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f282c10feb0 0x7f282c1a1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:15.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.666+0000 7f2833a0f640 1 --2- 172.21.15.5:0/3068901272 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f282c102c50 0x7f282c19c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:15.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.666+0000 7f2833a0f640 1 --2- 172.21.15.5:0/3068901272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f282c102300 0x7f282c19c340 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:15.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.666+0000 7f2833a0f640 1 -- 172.21.15.5:0/3068901272 >> 172.21.15.5:0/3068901272 conn(0x7f282c0fe1a0 msgr2=0x7f282c100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:15.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.666+0000 7f2833a0f640 1 -- 172.21.15.5:0/3068901272 shutdown_connections 2024-08-31T05:44:15.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.666+0000 7f2833a0f640 1 -- 172.21.15.5:0/3068901272 wait complete. 2024-08-31T05:44:15.680 DEBUG:teuthology.orchestra.run.smithi005:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-08-31T05:44:15.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.790+0000 7f198217b640 1 -- 172.21.15.5:0/4009849534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f197c1068d0 msgr2=0x7f197c110340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:15.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.790+0000 7f198217b640 1 --2- 172.21.15.5:0/4009849534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f197c1068d0 0x7f197c110340 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f1974009ca0 tx=0x7f197402a8c0 comp rx=0 tx=0).stop 2024-08-31T05:44:15.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.790+0000 7f198217b640 1 -- 172.21.15.5:0/4009849534 shutdown_connections 2024-08-31T05:44:15.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.791+0000 7f198217b640 1 --2- 172.21.15.5:0/4009849534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f197c1068d0 0x7f197c110340 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:15.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.791+0000 7f198217b640 1 --2- 172.21.15.5:0/4009849534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f197c105f80 0x7f197c106390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:15.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.791+0000 7f198217b640 1 --2- 172.21.15.5:0/4009849534 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f197c101e10 0x7f197c102220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:15.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.791+0000 7f198217b640 1 -- 172.21.15.5:0/4009849534 >> 172.21.15.5:0/4009849534 conn(0x7f197c079c40 msgr2=0x7f197c07a050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:15.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.791+0000 7f198217b640 1 -- 172.21.15.5:0/4009849534 shutdown_connections 2024-08-31T05:44:15.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.791+0000 7f198217b640 1 -- 172.21.15.5:0/4009849534 wait complete. 2024-08-31T05:44:15.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.791+0000 7f198217b640 1 Processor -- start 2024-08-31T05:44:15.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.791+0000 7f198217b640 1 -- start start 2024-08-31T05:44:15.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.792+0000 7f198217b640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f197c101e10 0x7f197c102da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:15.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.792+0000 7f198217b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f197c105f80 0x7f197c1032e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:15.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.792+0000 7f198217b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f197c1068d0 0x7f197c103820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:15.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.792+0000 7f198217b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f197c1137e0 con 0x7f197c1068d0 2024-08-31T05:44:15.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.792+0000 7f198217b640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f197c113660 con 0x7f197c101e10 2024-08-31T05:44:15.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.792+0000 7f198217b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f197c113960 con 0x7f197c105f80 2024-08-31T05:44:15.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.792+0000 7f197bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f197c1068d0 0x7f197c103820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:15.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.792+0000 7f197bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f197c1068d0 0x7f197c103820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55700/0 (socket says 172.21.15.5:55700) 2024-08-31T05:44:15.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.792+0000 7f197bfff640 1 -- 172.21.15.5:0/2248053031 learned_addr learned my addr 172.21.15.5:0/2248053031 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:44:15.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.792+0000 7f197b7fe640 1 --2- 172.21.15.5:0/2248053031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f197c101e10 0x7f197c102da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:15.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.792+0000 7f197affd640 1 --2- 172.21.15.5:0/2248053031 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f197c105f80 0x7f197c1032e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:15.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.792+0000 7f197bfff640 1 -- 172.21.15.5:0/2248053031 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f197c105f80 msgr2=0x7f197c1032e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:15.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.792+0000 7f197bfff640 1 --2- 172.21.15.5:0/2248053031 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f197c105f80 0x7f197c1032e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:15.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.792+0000 7f197bfff640 1 -- 172.21.15.5:0/2248053031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f197c101e10 msgr2=0x7f197c102da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:15.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.792+0000 7f197bfff640 1 --2- 172.21.15.5:0/2248053031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f197c101e10 0x7f197c102da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:15.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.792+0000 7f197bfff640 1 -- 172.21.15.5:0/2248053031 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f197c1a8430 con 0x7f197c1068d0 2024-08-31T05:44:15.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.792+0000 7f197bfff640 1 --2- 172.21.15.5:0/2248053031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f197c1068d0 0x7f197c103820 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f1974005cc0 tx=0x7f197402f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:15.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.793+0000 7f1978ff9640 1 -- 172.21.15.5:0/2248053031 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1974003cf0 con 0x7f197c1068d0 2024-08-31T05:44:15.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.793+0000 7f198217b640 1 -- 172.21.15.5:0/2248053031 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f197c1a86c0 con 0x7f197c1068d0 2024-08-31T05:44:15.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.793+0000 7f1978ff9640 1 -- 172.21.15.5:0/2248053031 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19740044f0 con 0x7f197c1068d0 2024-08-31T05:44:15.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.793+0000 7f1978ff9640 1 -- 172.21.15.5:0/2248053031 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f197402fd10 con 0x7f197c1068d0 2024-08-31T05:44:15.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.793+0000 7f198217b640 1 -- 172.21.15.5:0/2248053031 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f197c1a8c60 con 0x7f197c1068d0 2024-08-31T05:44:15.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.794+0000 7f198217b640 1 -- 172.21.15.5:0/2248053031 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f197c102220 con 0x7f197c1068d0 2024-08-31T05:44:15.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.796+0000 7f1978ff9640 1 -- 172.21.15.5:0/2248053031 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f1974004040 con 0x7f197c1068d0 2024-08-31T05:44:15.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.796+0000 7f1978ff9640 1 --2- 172.21.15.5:0/2248053031 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f19640b4cd0 0x7f19640b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:15.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.797+0000 7f197b7fe640 1 --2- 172.21.15.5:0/2248053031 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f19640b4cd0 0x7f19640b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:15.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.797+0000 7f1978ff9640 1 -- 172.21.15.5:0/2248053031 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9511+0+0 (secure 0 0 0) 0x7f1974106f00 con 0x7f197c1068d0 2024-08-31T05:44:15.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.797+0000 7f197b7fe640 1 --2- 172.21.15.5:0/2248053031 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f19640b4cd0 0x7f19640b71e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f196c0058c0 tx=0x7f196c00a250 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:15.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:15.800+0000 7f1978ff9640 1 -- 172.21.15.5:0/2248053031 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f19740cd910 con 0x7f197c1068d0 2024-08-31T05:44:15.963 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T05:44:16.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.010+0000 7f198217b640 1 -- 172.21.15.5:0/2248053031 --> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f197c0635a0 con 0x7f19640b4cd0 2024-08-31T05:44:16.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.022+0000 7f1978ff9640 1 -- 172.21.15.5:0/2248053031 <== mgr.14220 v2:172.21.15.5:6800/2696053609 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f197c0635a0 con 0x7f19640b4cd0 2024-08-31T05:44:16.024 INFO:teuthology.orchestra.run.smithi005.stdout:/ 1m 6m3h 2024-08-31T05:44:16.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.024+0000 7f198217b640 1 -- 172.21.15.5:0/2248053031 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f19640b4cd0 msgr2=0x7f19640b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:16.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.024+0000 7f198217b640 1 --2- 172.21.15.5:0/2248053031 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f19640b4cd0 0x7f19640b71e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f196c0058c0 tx=0x7f196c00a250 comp rx=0 tx=0).stop 2024-08-31T05:44:16.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.024+0000 7f198217b640 1 -- 172.21.15.5:0/2248053031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f197c1068d0 msgr2=0x7f197c103820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:16.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.024+0000 7f198217b640 1 --2- 172.21.15.5:0/2248053031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f197c1068d0 0x7f197c103820 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f1974005cc0 tx=0x7f197402f470 comp rx=0 tx=0).stop 2024-08-31T05:44:16.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.024+0000 7f198217b640 1 -- 172.21.15.5:0/2248053031 shutdown_connections 2024-08-31T05:44:16.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.024+0000 7f198217b640 1 --2- 172.21.15.5:0/2248053031 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f19640b4cd0 0x7f19640b71e0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:16.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.024+0000 7f198217b640 1 --2- 172.21.15.5:0/2248053031 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f197c1068d0 0x7f197c103820 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:16.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.024+0000 7f198217b640 1 --2- 172.21.15.5:0/2248053031 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f197c105f80 0x7f197c1032e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:16.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.024+0000 7f198217b640 1 --2- 172.21.15.5:0/2248053031 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f197c101e10 0x7f197c102da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:16.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.024+0000 7f198217b640 1 -- 172.21.15.5:0/2248053031 >> 172.21.15.5:0/2248053031 conn(0x7f197c079c40 msgr2=0x7f197c107170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:16.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.024+0000 7f198217b640 1 -- 172.21.15.5:0/2248053031 shutdown_connections 2024-08-31T05:44:16.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.024+0000 7f198217b640 1 -- 172.21.15.5:0/2248053031 wait complete. 2024-08-31T05:44:16.038 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-08-31T05:44:16.084 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-08-31T05:44:16.220 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:44:16.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.738+0000 7f8ad2b40640 1 -- 172.21.15.5:0/3830667348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8acc109240 msgr2=0x7f8acc109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:16.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.738+0000 7f8ad2b40640 1 --2- 172.21.15.5:0/3830667348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8acc109240 0x7f8acc109650 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8009900 tx=0x7f8ab802a410 comp rx=0 tx=0).stop 2024-08-31T05:44:16.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.738+0000 7f8ad2b40640 1 -- 172.21.15.5:0/3830667348 shutdown_connections 2024-08-31T05:44:16.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.738+0000 7f8ad2b40640 1 --2- 172.21.15.5:0/3830667348 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8acc109b90 0x7f8acc1103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:16.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.738+0000 7f8ad2b40640 1 --2- 172.21.15.5:0/3830667348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8acc109240 0x7f8acc109650 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:16.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.738+0000 7f8ad2b40640 1 --2- 172.21.15.5:0/3830667348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8acc103900 0x7f8acc103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:16.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.738+0000 7f8ad2b40640 1 -- 172.21.15.5:0/3830667348 >> 172.21.15.5:0/3830667348 conn(0x7f8acc07b5f0 msgr2=0x7f8acc07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:16.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.738+0000 7f8ad2b40640 1 -- 172.21.15.5:0/3830667348 shutdown_connections 2024-08-31T05:44:16.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.738+0000 7f8ad2b40640 1 -- 172.21.15.5:0/3830667348 wait complete. 2024-08-31T05:44:16.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.739+0000 7f8ad2b40640 1 Processor -- start 2024-08-31T05:44:16.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.739+0000 7f8ad2b40640 1 -- start start 2024-08-31T05:44:16.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.739+0000 7f8ad2b40640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8acc103900 0x7f8acc19a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:16.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.739+0000 7f8ad2b40640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8acc109240 0x7f8acc19a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:16.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.739+0000 7f8ad2b40640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8acc109b90 0x7f8acc19fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:16.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.739+0000 7f8ad2b40640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8acc113870 con 0x7f8acc103900 2024-08-31T05:44:16.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.739+0000 7f8ad2b40640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8acc1136f0 con 0x7f8acc109240 2024-08-31T05:44:16.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.739+0000 7f8ad2b40640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8acc1139f0 con 0x7f8acc109b90 2024-08-31T05:44:16.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.740+0000 7f8ad08dc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8acc103900 0x7f8acc19a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:16.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.740+0000 7f8ad08dc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8acc103900 0x7f8acc19a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55718/0 (socket says 172.21.15.5:55718) 2024-08-31T05:44:16.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.740+0000 7f8ad08dc640 1 -- 172.21.15.5:0/801985595 learned_addr learned my addr 172.21.15.5:0/801985595 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:44:16.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.740+0000 7f8acbfff640 1 --2- 172.21.15.5:0/801985595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8acc109240 0x7f8acc19a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:16.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.740+0000 7f8ad10dd640 1 --2- 172.21.15.5:0/801985595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8acc109b90 0x7f8acc19fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:16.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.740+0000 7f8ad08dc640 1 -- 172.21.15.5:0/801985595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8acc109b90 msgr2=0x7f8acc19fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:16.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.740+0000 7f8ad08dc640 1 --2- 172.21.15.5:0/801985595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8acc109b90 0x7f8acc19fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:16.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.740+0000 7f8ad08dc640 1 -- 172.21.15.5:0/801985595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8acc109240 msgr2=0x7f8acc19a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:16.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.740+0000 7f8ad08dc640 1 --2- 172.21.15.5:0/801985595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8acc109240 0x7f8acc19a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:16.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.740+0000 7f8ad08dc640 1 -- 172.21.15.5:0/801985595 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8acc1a0270 con 0x7f8acc103900 2024-08-31T05:44:16.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.740+0000 7f8ad08dc640 1 --2- 172.21.15.5:0/801985595 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8acc103900 0x7f8acc19a300 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f8ac000d950 tx=0x7f8ac000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:16.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.740+0000 7f8ac9ffb640 1 -- 172.21.15.5:0/801985595 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac0017070 con 0x7f8acc103900 2024-08-31T05:44:16.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.740+0000 7f8ac9ffb640 1 -- 172.21.15.5:0/801985595 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ac0009c30 con 0x7f8acc103900 2024-08-31T05:44:16.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.740+0000 7f8ad2b40640 1 -- 172.21.15.5:0/801985595 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8acc1a0560 con 0x7f8acc103900 2024-08-31T05:44:16.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.740+0000 7f8ac9ffb640 1 -- 172.21.15.5:0/801985595 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac000f620 con 0x7f8acc103900 2024-08-31T05:44:16.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.741+0000 7f8ad2b40640 1 -- 172.21.15.5:0/801985595 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8acc1a6cc0 con 0x7f8acc103900 2024-08-31T05:44:16.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.744+0000 7f8ad90b5740 1 Processor -- start 2024-08-31T05:44:16.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.744+0000 7f8ad90b5740 1 -- start start 2024-08-31T05:44:16.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.744+0000 7f8ac9ffb640 1 -- 172.21.15.5:0/801985595 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f8ac0010460 con 0x7f8acc103900 2024-08-31T05:44:16.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.744+0000 7f8ad90b5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56151ac7a070 0x56151b01f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:16.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.744+0000 7f8ad90b5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56151ac511b0 0x56151b01f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:16.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.744+0000 7f8ad90b5740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56151ac59390 0x56151b01fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:16.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.744+0000 7f8ad90b5740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56151af96680 con 0x56151ac59390 2024-08-31T05:44:16.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.744+0000 7f8ad90b5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56151af85c10 con 0x56151ac7a070 2024-08-31T05:44:16.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.744+0000 7f8ad90b5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56151af89bc0 con 0x56151ac511b0 2024-08-31T05:44:16.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.744+0000 7f8acbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56151ac59390 0x56151b01fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:16.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.744+0000 7f8acbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56151ac59390 0x56151b01fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55730/0 (socket says 172.21.15.5:55730) 2024-08-31T05:44:16.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.744+0000 7f8acbfff640 1 -- 172.21.15.5:0/4078025396 learned_addr learned my addr 172.21.15.5:0/4078025396 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:44:16.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.744+0000 7f8ad10dd640 1 --2- 172.21.15.5:0/4078025396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56151ac7a070 0x56151b01f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:16.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.745+0000 7f8ad08dc640 1 --2- 172.21.15.5:0/4078025396 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56151ac511b0 0x56151b01f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:16.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.745+0000 7f8acbfff640 1 -- 172.21.15.5:0/4078025396 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56151ac511b0 msgr2=0x56151b01f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:44:16.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.745+0000 7f8acbfff640 1 --2- 172.21.15.5:0/4078025396 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56151ac511b0 0x56151b01f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:16.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.745+0000 7f8acbfff640 1 -- 172.21.15.5:0/4078025396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56151ac7a070 msgr2=0x56151b01f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:44:16.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.745+0000 7f8acbfff640 1 --2- 172.21.15.5:0/4078025396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56151ac7a070 0x56151b01f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:16.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.745+0000 7f8acbfff640 1 -- 172.21.15.5:0/4078025396 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56151ace5650 con 0x56151ac59390 2024-08-31T05:44:16.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.745+0000 7f8ad08dc640 1 --2- 172.21.15.5:0/4078025396 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56151ac511b0 0x56151b01f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:44:16.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.745+0000 7f8ac9ffb640 1 --2- 172.21.15.5:0/801985595 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f8abc0b4ca0 0x7f8abc0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:16.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.745+0000 7f8acbfff640 1 --2- 172.21.15.5:0/4078025396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56151ac59390 0x56151b01fd90 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8009900 tx=0x7f8ab8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a44752fdfc33589 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:16.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.745+0000 7f8ad10dd640 1 --2- 172.21.15.5:0/801985595 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f8abc0b4ca0 0x7f8abc0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:16.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.745+0000 7f8ac9ffb640 1 -- 172.21.15.5:0/801985595 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9511+0+0 (secure 0 0 0) 0x7f8ac00e54e0 con 0x7f8acc103900 2024-08-31T05:44:16.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.745+0000 7f8ab6ffd640 1 -- 172.21.15.5:0/4078025396 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab8040070 con 0x56151ac59390 2024-08-31T05:44:16.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.745+0000 7f8ab6ffd640 1 -- 172.21.15.5:0/4078025396 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ab8005db0 con 0x56151ac59390 2024-08-31T05:44:16.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.745+0000 7f8ab6ffd640 1 -- 172.21.15.5:0/4078025396 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab8035040 con 0x56151ac59390 2024-08-31T05:44:16.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.746+0000 7f8ad90b5740 1 -- 172.21.15.5:0/4078025396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56151ac59390 msgr2=0x56151b01fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:16.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.746+0000 7f8ad10dd640 1 --2- 172.21.15.5:0/801985595 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f8abc0b4ca0 0x7f8abc0b71b0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4007d80 tx=0x7f8ac4007430 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:16.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.746+0000 7f8ad90b5740 1 --2- 172.21.15.5:0/4078025396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56151ac59390 0x56151b01fd90 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8009900 tx=0x7f8ab8000bc0 comp rx=0 tx=0).stop 2024-08-31T05:44:16.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.746+0000 7f8ad90b5740 1 -- 172.21.15.5:0/4078025396 shutdown_connections 2024-08-31T05:44:16.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.746+0000 7f8ad90b5740 1 --2- 172.21.15.5:0/4078025396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56151ac59390 0x56151b01fd90 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:16.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.746+0000 7f8ad90b5740 1 --2- 172.21.15.5:0/4078025396 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56151ac511b0 0x56151b01f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:16.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.746+0000 7f8ad90b5740 1 --2- 172.21.15.5:0/4078025396 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56151ac7a070 0x56151b01f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:16.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.746+0000 7f8ad90b5740 1 -- 172.21.15.5:0/4078025396 >> 172.21.15.5:0/4078025396 conn(0x56151ac6e460 msgr2=0x56151b01d200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:16.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.746+0000 7f8ad90b5740 1 -- 172.21.15.5:0/4078025396 shutdown_connections 2024-08-31T05:44:16.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.746+0000 7f8ad90b5740 1 -- 172.21.15.5:0/4078025396 wait complete. 2024-08-31T05:44:16.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.747+0000 7f8ad90b5740 1 -- start start 2024-08-31T05:44:16.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.747+0000 7f8ad90b5740 1 Processor -- start 2024-08-31T05:44:16.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.747+0000 7f8ad90b5740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56151ac511b0 0x56151b02aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:16.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.747+0000 7f8ad90b5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56151ac59390 0x56151b02af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:16.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.747+0000 7f8ad90b5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56151ac7a070 0x56151b036d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:16.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.747+0000 7f8ad90b5740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56151ade8700 con 0x56151ac511b0 2024-08-31T05:44:16.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.747+0000 7f8ad90b5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x56151af0c750 con 0x56151ac59390 2024-08-31T05:44:16.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.747+0000 7f8ad90b5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56151b02da90 con 0x56151ac7a070 2024-08-31T05:44:16.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.747+0000 7f8ad90b5740 10 client.0 _ll_register_callbacks cb 0x56151af3be10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:44:16.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.747+0000 7f8ad08dc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56151ac511b0 0x56151b02aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:16.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.747+0000 7f8ad08dc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56151ac511b0 0x56151b02aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55732/0 (socket says 172.21.15.5:55732) 2024-08-31T05:44:16.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.748+0000 7f8ad08dc640 1 -- 172.21.15.5:0/2570203141 learned_addr learned my addr 172.21.15.5:0/2570203141 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:44:16.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.748+0000 7f8acbfff640 1 --2- 172.21.15.5:0/2570203141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56151ac59390 0x56151b02af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:16.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.748+0000 7f8ad10dd640 1 --2- 172.21.15.5:0/2570203141 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56151ac7a070 0x56151b036d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:16.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.748+0000 7f8ad08dc640 1 -- 172.21.15.5:0/2570203141 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56151ac7a070 msgr2=0x56151b036d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:44:16.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.748+0000 7f8ad08dc640 1 --2- 172.21.15.5:0/2570203141 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56151ac7a070 0x56151b036d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:16.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.748+0000 7f8ad08dc640 1 -- 172.21.15.5:0/2570203141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56151ac59390 msgr2=0x56151b02af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:44:16.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.748+0000 7f8ad08dc640 1 --2- 172.21.15.5:0/2570203141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56151ac59390 0x56151b02af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:16.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.748+0000 7f8ad08dc640 1 -- 172.21.15.5:0/2570203141 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56151af45900 con 0x56151ac511b0 2024-08-31T05:44:16.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.748+0000 7f8ad08dc640 1 --2- 172.21.15.5:0/2570203141 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56151ac511b0 0x56151b02aa00 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f8ac00ab820 tx=0x7f8ac00a7070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f740da81a899e89 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:16.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.748+0000 7f8aabfff640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:44:16.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.748+0000 7f8aabfff640 1 -- 172.21.15.5:0/2570203141 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac0020070 con 0x56151ac511b0 2024-08-31T05:44:16.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.748+0000 7f8aabfff640 1 -- 172.21.15.5:0/2570203141 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9511+0+0 (secure 0 0 0) 0x7f8ac00aad00 con 0x56151ac511b0 2024-08-31T05:44:16.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.748+0000 7f8ad90b5740 1 -- 172.21.15.5:0/2570203141 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ab8005db0 con 0x56151ac511b0 2024-08-31T05:44:16.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.748+0000 7f8aabfff640 1 -- 172.21.15.5:0/2570203141 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f8ac00ab000 con 0x56151ac511b0 2024-08-31T05:44:16.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.748+0000 7f8ad90b5740 10 client.19374 fetch_fsmap learned FSMap version 36 2024-08-31T05:44:16.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.748+0000 7f8ad90b5740 1 -- 172.21.15.5:0/2570203141 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x56151b039820 con 0x56151ac511b0 2024-08-31T05:44:16.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.749+0000 7f8aabfff640 1 -- 172.21.15.5:0/2570203141 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ab8005db0 con 0x56151ac511b0 2024-08-31T05:44:16.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.749+0000 7f8aabfff640 1 -- 172.21.15.5:0/2570203141 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 36) ==== 8386+0+0 (secure 0 0 0) 0x7f8ac00e5120 con 0x56151ac511b0 2024-08-31T05:44:16.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.749+0000 7f8ad90b5740 10 client.19374 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T05:44:16.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.749+0000 7f8ad90b5740 10 client.19374 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-31T05:44:16.759 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.749+0000 7f8ad90b5740 20 client.19374 populate_metadata read hostname 'smithi005' 2024-08-31T05:44:16.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.749+0000 7f8ad90b5740 1 --2- 172.21.15.5:0/2570203141 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x56151ac389f0 0x56151b03cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:16.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.749+0000 7f8ad90b5740 4 client.19374 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:44:16.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.749+0000 7f8ad90b5740 1 -- 172.21.15.5:0/2570203141 --> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56151af985d0 con 0x56151ac389f0 2024-08-31T05:44:16.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.749+0000 7f8acbfff640 1 --2- 172.21.15.5:0/2570203141 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x56151ac389f0 0x56151b03cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:16.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.750+0000 7f8acbfff640 1 --2- 172.21.15.5:0/2570203141 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x56151ac389f0 0x56151b03cd70 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b13d1642fe0f7b5c server_cookie=68cc54005a0dfbbd in_seq=0 out_seq=0 2024-08-31T05:44:16.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.750+0000 7f8aabfff640 10 client.19374 ms_handle_connect on v2:172.21.15.70:6836/2780036414 2024-08-31T05:44:16.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.750+0000 7f8aabfff640 1 -- 172.21.15.5:0/2570203141 <== mds.2 v2:172.21.15.70:6836/2780036414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56151af985d0 con 0x56151ac389f0 2024-08-31T05:44:16.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.750+0000 7f8aabfff640 10 client.19374 handle_command_reply: tid=0 2024-08-31T05:44:16.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.750+0000 7f8ad90b5740 1 client.19374 shutdown 2024-08-31T05:44:16.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.751+0000 7f8ad90b5740 1 -- 172.21.15.5:0/2570203141 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56151ac511b0 msgr2=0x56151b02aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:16.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.751+0000 7f8ad90b5740 1 --2- 172.21.15.5:0/2570203141 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56151ac511b0 0x56151b02aa00 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f8ac00ab820 tx=0x7f8ac00a7070 comp rx=0 tx=0).stop 2024-08-31T05:44:16.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.751+0000 7f8ad90b5740 1 -- 172.21.15.5:0/2570203141 shutdown_connections 2024-08-31T05:44:16.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.751+0000 7f8ad90b5740 1 --2- 172.21.15.5:0/2570203141 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x56151ac389f0 0x56151b03cd70 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:16.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.751+0000 7f8ad90b5740 1 --2- 172.21.15.5:0/2570203141 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56151ac7a070 0x56151b036d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:16.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.751+0000 7f8ad90b5740 1 --2- 172.21.15.5:0/2570203141 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56151ac59390 0x56151b02af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:16.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.751+0000 7f8ad90b5740 1 --2- 172.21.15.5:0/2570203141 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56151ac511b0 0x56151b02aa00 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:16.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.751+0000 7f8ad90b5740 1 -- 172.21.15.5:0/2570203141 >> 172.21.15.5:0/2570203141 conn(0x56151ac6e460 msgr2=0x56151b0224f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:16.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.751+0000 7f8aabfff640 0 client.19374 ms_handle_reset on v2:172.21.15.70:6836/2780036414 2024-08-31T05:44:16.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.751+0000 7f8ad90b5740 1 -- 172.21.15.5:0/2570203141 shutdown_connections 2024-08-31T05:44:16.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.751+0000 7f8ad90b5740 1 -- 172.21.15.5:0/2570203141 wait complete. 2024-08-31T05:44:16.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.751+0000 7f8ad90b5740 20 client.19374 trim_cache size 0 max 16384 2024-08-31T05:44:16.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.764+0000 7f8ad90b5740 1 Processor -- start 2024-08-31T05:44:16.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.764+0000 7f8ad90b5740 1 -- start start 2024-08-31T05:44:16.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.764+0000 7f8ad90b5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56151ac511b0 0x56151b036c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:16.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.764+0000 7f8ad90b5740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56151ac59390 0x56151b027bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:16.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.764+0000 7f8ad90b5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56151ac7a070 0x56151b028130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:16.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.764+0000 7f8ad90b5740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8acc1b0d90 con 0x56151ac59390 2024-08-31T05:44:16.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.764+0000 7f8ad90b5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8acc1b2990 con 0x56151ac7a070 2024-08-31T05:44:16.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.764+0000 7f8ad90b5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8acc1b1460 con 0x56151ac511b0 2024-08-31T05:44:16.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.764+0000 7f8acbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56151ac59390 0x56151b027bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:16.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.764+0000 7f8acbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56151ac59390 0x56151b027bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55746/0 (socket says 172.21.15.5:55746) 2024-08-31T05:44:16.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.764+0000 7f8acbfff640 1 -- 172.21.15.5:0/1945487461 learned_addr learned my addr 172.21.15.5:0/1945487461 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:44:16.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.765+0000 7f8ad10dd640 1 --2- 172.21.15.5:0/1945487461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56151ac7a070 0x56151b028130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:16.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.765+0000 7f8ad08dc640 1 --2- 172.21.15.5:0/1945487461 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56151ac511b0 0x56151b036c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:16.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.765+0000 7f8acbfff640 1 -- 172.21.15.5:0/1945487461 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56151ac511b0 msgr2=0x56151b036c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:44:16.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.765+0000 7f8acbfff640 1 --2- 172.21.15.5:0/1945487461 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56151ac511b0 0x56151b036c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:16.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.765+0000 7f8acbfff640 1 -- 172.21.15.5:0/1945487461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56151ac7a070 msgr2=0x56151b028130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:44:16.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.765+0000 7f8acbfff640 1 --2- 172.21.15.5:0/1945487461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56151ac7a070 0x56151b028130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:16.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.765+0000 7f8acbfff640 1 -- 172.21.15.5:0/1945487461 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56151b0187e0 con 0x56151ac59390 2024-08-31T05:44:16.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.765+0000 7f8ad08dc640 1 --2- 172.21.15.5:0/1945487461 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56151ac511b0 0x56151b036c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:44:16.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.765+0000 7f8ad10dd640 1 --2- 172.21.15.5:0/1945487461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56151ac7a070 0x56151b028130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:44:16.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.765+0000 7f8acbfff640 1 --2- 172.21.15.5:0/1945487461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56151ac59390 0x56151b027bf0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f8ab80051e0 tx=0x7f8ab8005210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed2ab81e6a9499ba server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:16.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.765+0000 7f8ab67fc640 1 -- 172.21.15.5:0/1945487461 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab8035040 con 0x56151ac59390 2024-08-31T05:44:16.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.765+0000 7f8ab67fc640 1 -- 172.21.15.5:0/1945487461 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ab8005db0 con 0x56151ac59390 2024-08-31T05:44:16.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.765+0000 7f8ab67fc640 1 -- 172.21.15.5:0/1945487461 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab8040040 con 0x56151ac59390 2024-08-31T05:44:16.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.766+0000 7f8ad90b5740 1 -- 172.21.15.5:0/1945487461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56151ac59390 msgr2=0x56151b027bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:16.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.766+0000 7f8ad90b5740 1 --2- 172.21.15.5:0/1945487461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56151ac59390 0x56151b027bf0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f8ab80051e0 tx=0x7f8ab8005210 comp rx=0 tx=0).stop 2024-08-31T05:44:16.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.766+0000 7f8ad90b5740 1 -- 172.21.15.5:0/1945487461 shutdown_connections 2024-08-31T05:44:16.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.766+0000 7f8ad90b5740 1 --2- 172.21.15.5:0/1945487461 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56151ac7a070 0x56151b028130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:16.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.766+0000 7f8ad90b5740 1 --2- 172.21.15.5:0/1945487461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56151ac59390 0x56151b027bf0 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:16.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.766+0000 7f8ad90b5740 1 --2- 172.21.15.5:0/1945487461 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56151ac511b0 0x56151b036c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:16.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.766+0000 7f8ad90b5740 1 -- 172.21.15.5:0/1945487461 >> 172.21.15.5:0/1945487461 conn(0x56151ac6e460 msgr2=0x56151b029280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:16.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.766+0000 7f8ad90b5740 1 -- 172.21.15.5:0/1945487461 shutdown_connections 2024-08-31T05:44:16.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.766+0000 7f8ad90b5740 1 -- 172.21.15.5:0/1945487461 wait complete. 2024-08-31T05:44:16.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.767+0000 7f8ad90b5740 1 -- start start 2024-08-31T05:44:16.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.767+0000 7f8ad90b5740 1 Processor -- start 2024-08-31T05:44:16.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.767+0000 7f8ad90b5740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56151ac511b0 0x56151b0a0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:16.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.767+0000 7f8ad90b5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56151ac59390 0x56151b0a1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:16.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.767+0000 7f8ad90b5740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56151ac7a070 0x56151b032ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:16.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.767+0000 7f8ad90b5740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8acc1b22c0 con 0x56151ac7a070 2024-08-31T05:44:16.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.767+0000 7f8ad90b5740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f8acc1b1bf0 con 0x56151ac511b0 2024-08-31T05:44:16.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.767+0000 7f8ad90b5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8acc1aed90 con 0x56151ac59390 2024-08-31T05:44:16.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.767+0000 7f8ad90b5740 10 client.0 _ll_register_callbacks cb 0x7f8ac00e2da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:44:16.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.767+0000 7f8ad10dd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56151ac7a070 0x56151b032ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:16.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.767+0000 7f8ad10dd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56151ac7a070 0x56151b032ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55754/0 (socket says 172.21.15.5:55754) 2024-08-31T05:44:16.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.767+0000 7f8ad10dd640 1 -- 172.21.15.5:0/561932500 learned_addr learned my addr 172.21.15.5:0/561932500 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:44:16.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.768+0000 7f8ad08dc640 1 --2- 172.21.15.5:0/561932500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56151ac511b0 0x56151b0a0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:16.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.768+0000 7f8acbfff640 1 --2- 172.21.15.5:0/561932500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56151ac59390 0x56151b0a1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:16.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.768+0000 7f8ad10dd640 1 -- 172.21.15.5:0/561932500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56151ac59390 msgr2=0x56151b0a1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:44:16.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.768+0000 7f8ad10dd640 1 --2- 172.21.15.5:0/561932500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56151ac59390 0x56151b0a1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:16.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.768+0000 7f8ad10dd640 1 -- 172.21.15.5:0/561932500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56151ac511b0 msgr2=0x56151b0a0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:44:16.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.768+0000 7f8ad10dd640 1 --2- 172.21.15.5:0/561932500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56151ac511b0 0x56151b0a0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:16.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.768+0000 7f8ad10dd640 1 -- 172.21.15.5:0/561932500 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56151b033250 con 0x56151ac7a070 2024-08-31T05:44:16.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.768+0000 7f8ad08dc640 1 --2- 172.21.15.5:0/561932500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56151ac511b0 0x56151b0a0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:44:16.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.768+0000 7f8acbfff640 1 --2- 172.21.15.5:0/561932500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56151ac59390 0x56151b0a1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:44:16.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.768+0000 7f8ad10dd640 1 --2- 172.21.15.5:0/561932500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56151ac7a070 0x56151b032ce0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4007320 tx=0x7f8ac4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b168b296dba9a7d1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:16.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.768+0000 7f8aabfff640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:44:16.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.768+0000 7f8aabfff640 1 -- 172.21.15.5:0/561932500 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac4025070 con 0x56151ac7a070 2024-08-31T05:44:16.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.768+0000 7f8aabfff640 1 -- 172.21.15.5:0/561932500 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9511+0+0 (secure 0 0 0) 0x7f8ac4012b70 con 0x56151ac7a070 2024-08-31T05:44:16.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.768+0000 7f8ad90b5740 1 -- 172.21.15.5:0/561932500 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ab8005db0 con 0x56151ac7a070 2024-08-31T05:44:16.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.768+0000 7f8aabfff640 1 -- 172.21.15.5:0/561932500 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f8ac401a040 con 0x56151ac7a070 2024-08-31T05:44:16.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.768+0000 7f8ad90b5740 10 client.19380 fetch_fsmap learned FSMap version 36 2024-08-31T05:44:16.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.768+0000 7f8ad90b5740 1 -- 172.21.15.5:0/561932500 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x56151b0ac460 con 0x56151ac7a070 2024-08-31T05:44:16.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.769+0000 7f8aabfff640 1 -- 172.21.15.5:0/561932500 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ab8005db0 con 0x56151ac7a070 2024-08-31T05:44:16.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.769+0000 7f8aabfff640 1 -- 172.21.15.5:0/561932500 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 36) ==== 8386+0+0 (secure 0 0 0) 0x7f8ac4020040 con 0x56151ac7a070 2024-08-31T05:44:16.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.769+0000 7f8ad90b5740 10 client.19380 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T05:44:16.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.769+0000 7f8ad90b5740 10 client.19380 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-31T05:44:16.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.769+0000 7f8ad90b5740 20 client.19380 populate_metadata read hostname 'smithi005' 2024-08-31T05:44:16.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.769+0000 7f8ad90b5740 1 --2- 172.21.15.5:0/561932500 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x56151ac0dda0 0x56151b0aed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:16.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.769+0000 7f8ad90b5740 4 client.19380 mds_command: new command op to 24631 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:44:16.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.769+0000 7f8ad90b5740 1 -- 172.21.15.5:0/561932500 --> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56151af94070 con 0x56151ac0dda0 2024-08-31T05:44:16.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.769+0000 7f8ad08dc640 1 --2- 172.21.15.5:0/561932500 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x56151ac0dda0 0x56151b0aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:16.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.769+0000 7f8ad08dc640 1 --2- 172.21.15.5:0/561932500 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x56151ac0dda0 0x56151b0aed90 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2953d48857fdb500 server_cookie=aa9e04c02e1e5bb3 in_seq=0 out_seq=0 2024-08-31T05:44:16.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.769+0000 7f8aabfff640 10 client.19380 ms_handle_connect on v2:172.21.15.70:6836/2780036414 2024-08-31T05:44:16.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.770+0000 7f8aabfff640 1 -- 172.21.15.5:0/561932500 <== mds.2 v2:172.21.15.70:6836/2780036414 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56151af94070 con 0x56151ac0dda0 2024-08-31T05:44:16.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.770+0000 7f8aabfff640 10 client.19380 handle_command_reply: tid=0 2024-08-31T05:44:16.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.770+0000 7f8ad90b5740 1 client.19380 shutdown 2024-08-31T05:44:16.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.770+0000 7f8ad90b5740 1 -- 172.21.15.5:0/561932500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56151ac7a070 msgr2=0x56151b032ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:16.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.770+0000 7f8ad90b5740 1 --2- 172.21.15.5:0/561932500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56151ac7a070 0x56151b032ce0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4007320 tx=0x7f8ac4004a40 comp rx=0 tx=0).stop 2024-08-31T05:44:16.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.770+0000 7f8ad90b5740 1 -- 172.21.15.5:0/561932500 shutdown_connections 2024-08-31T05:44:16.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.770+0000 7f8ad90b5740 1 --2- 172.21.15.5:0/561932500 >> [v2:172.21.15.70:6836/2780036414,v1:172.21.15.70:6837/2780036414] conn(0x56151ac0dda0 0x56151b0aed90 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:16.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.770+0000 7f8ad90b5740 1 --2- 172.21.15.5:0/561932500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56151ac7a070 0x56151b032ce0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:16.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.770+0000 7f8ad90b5740 1 --2- 172.21.15.5:0/561932500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56151ac59390 0x56151b0a1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:16.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.770+0000 7f8ad90b5740 1 --2- 172.21.15.5:0/561932500 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x56151ac511b0 0x56151b0a0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:16.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.770+0000 7f8ad90b5740 1 -- 172.21.15.5:0/561932500 >> 172.21.15.5:0/561932500 conn(0x56151ac6e460 msgr2=0x56151b02be80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:16.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.770+0000 7f8aabfff640 0 client.19380 ms_handle_reset on v2:172.21.15.70:6836/2780036414 2024-08-31T05:44:16.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.770+0000 7f8ad90b5740 1 -- 172.21.15.5:0/561932500 shutdown_connections 2024-08-31T05:44:16.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.770+0000 7f8ad90b5740 1 -- 172.21.15.5:0/561932500 wait complete. 2024-08-31T05:44:16.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.770+0000 7f8ad90b5740 20 client.19380 trim_cache size 0 max 16384 2024-08-31T05:44:16.783 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:44:16.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.771+0000 7f8ad2b40640 1 -- 172.21.15.5:0/801985595 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f8abc0b4ca0 msgr2=0x7f8abc0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:16.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.771+0000 7f8ad2b40640 1 --2- 172.21.15.5:0/801985595 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f8abc0b4ca0 0x7f8abc0b71b0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4007d80 tx=0x7f8ac4007430 comp rx=0 tx=0).stop 2024-08-31T05:44:16.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.771+0000 7f8ad2b40640 1 -- 172.21.15.5:0/801985595 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8acc103900 msgr2=0x7f8acc19a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:16.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.771+0000 7f8ad2b40640 1 --2- 172.21.15.5:0/801985595 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8acc103900 0x7f8acc19a300 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f8ac000d950 tx=0x7f8ac000de10 comp rx=0 tx=0).stop 2024-08-31T05:44:16.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.771+0000 7f8ad2b40640 1 -- 172.21.15.5:0/801985595 shutdown_connections 2024-08-31T05:44:16.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.771+0000 7f8ad2b40640 1 --2- 172.21.15.5:0/801985595 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f8abc0b4ca0 0x7f8abc0b71b0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:16.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.771+0000 7f8ad2b40640 1 --2- 172.21.15.5:0/801985595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8acc109b90 0x7f8acc19fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:16.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.771+0000 7f8ad2b40640 1 --2- 172.21.15.5:0/801985595 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f8acc109240 0x7f8acc19a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:16.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.771+0000 7f8ad2b40640 1 --2- 172.21.15.5:0/801985595 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8acc103900 0x7f8acc19a300 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:16.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.771+0000 7f8ad2b40640 1 -- 172.21.15.5:0/801985595 >> 172.21.15.5:0/801985595 conn(0x7f8acc07b5f0 msgr2=0x7f8acc107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:16.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.771+0000 7f8ad2b40640 1 -- 172.21.15.5:0/801985595 shutdown_connections 2024-08-31T05:44:16.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:16.771+0000 7f8ad2b40640 1 -- 172.21.15.5:0/801985595 wait complete. 2024-08-31T05:44:17.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:44:17 smithi050 ceph-mon[22146]: from='client.19356 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:44:17.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:44:17 smithi050 ceph-mon[22146]: pgmap v790: 129 pgs: 129 active+clean; 829 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 7.5 MiB/s wr, 618 op/s 2024-08-31T05:44:17.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:44:17 smithi050 ceph-mon[22146]: from='client.19362 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:44:17.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:44:17 smithi005 ceph-mon[18602]: from='client.19356 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:44:17.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:44:17 smithi005 ceph-mon[18602]: pgmap v790: 129 pgs: 129 active+clean; 829 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 7.5 MiB/s wr, 618 op/s 2024-08-31T05:44:17.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:44:17 smithi005 ceph-mon[18602]: from='client.19362 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:44:17.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:44:17 smithi070 ceph-mon[22316]: from='client.19356 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:44:17.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:44:17 smithi070 ceph-mon[22316]: pgmap v790: 129 pgs: 129 active+clean; 829 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 7.5 MiB/s wr, 618 op/s 2024-08-31T05:44:17.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:44:17 smithi070 ceph-mon[22316]: from='client.19362 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T05:44:19.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:44:19 smithi005 ceph-mon[18602]: pgmap v791: 129 pgs: 129 active+clean; 836 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 7.4 MiB/s wr, 562 op/s 2024-08-31T05:44:19.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:44:19 smithi050 ceph-mon[22146]: pgmap v791: 129 pgs: 129 active+clean; 836 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 7.4 MiB/s wr, 562 op/s 2024-08-31T05:44:19.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:44:19 smithi070 ceph-mon[22316]: pgmap v791: 129 pgs: 129 active+clean; 836 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 7.4 MiB/s wr, 562 op/s 2024-08-31T05:44:19.921 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T05:44:20.235 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:44:20.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.766+0000 7f45640cc640 1 -- 172.21.15.5:0/1761940324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f455c103900 msgr2=0x7f455c103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:20.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.766+0000 7f45640cc640 1 --2- 172.21.15.5:0/1761940324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f455c103900 0x7f455c103d10 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f4558009900 tx=0x7f455802a410 comp rx=0 tx=0).stop 2024-08-31T05:44:20.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.766+0000 7f45640cc640 1 -- 172.21.15.5:0/1761940324 shutdown_connections 2024-08-31T05:44:20.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.766+0000 7f45640cc640 1 --2- 172.21.15.5:0/1761940324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f455c109b90 0x7f455c1103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:20.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.766+0000 7f45640cc640 1 --2- 172.21.15.5:0/1761940324 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f455c109240 0x7f455c109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:20.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.766+0000 7f45640cc640 1 --2- 172.21.15.5:0/1761940324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f455c103900 0x7f455c103d10 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:20.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.766+0000 7f45640cc640 1 -- 172.21.15.5:0/1761940324 >> 172.21.15.5:0/1761940324 conn(0x7f455c07b5f0 msgr2=0x7f455c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:20.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.766+0000 7f45640cc640 1 -- 172.21.15.5:0/1761940324 shutdown_connections 2024-08-31T05:44:20.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.766+0000 7f45640cc640 1 -- 172.21.15.5:0/1761940324 wait complete. 2024-08-31T05:44:20.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.767+0000 7f45640cc640 1 Processor -- start 2024-08-31T05:44:20.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.767+0000 7f45640cc640 1 -- start start 2024-08-31T05:44:20.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.767+0000 7f45640cc640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f455c103900 0x7f455c0754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:20.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.767+0000 7f45640cc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f455c109240 0x7f455c0759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:20.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.767+0000 7f45640cc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f455c109b90 0x7f455c075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:20.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.767+0000 7f45640cc640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f455c113850 con 0x7f455c109240 2024-08-31T05:44:20.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.767+0000 7f45640cc640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f455c1136d0 con 0x7f455c103900 2024-08-31T05:44:20.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.767+0000 7f45640cc640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f455c1139d0 con 0x7f455c109b90 2024-08-31T05:44:20.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.767+0000 7f4561667640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f455c109240 0x7f455c0759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:20.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.768+0000 7f4561667640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f455c109240 0x7f455c0759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55762/0 (socket says 172.21.15.5:55762) 2024-08-31T05:44:20.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.768+0000 7f4561667640 1 -- 172.21.15.5:0/4112869244 learned_addr learned my addr 172.21.15.5:0/4112869244 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:44:20.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.768+0000 7f4561e68640 1 --2- 172.21.15.5:0/4112869244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f455c103900 0x7f455c0754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:20.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.768+0000 7f4562669640 1 --2- 172.21.15.5:0/4112869244 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f455c109b90 0x7f455c075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:20.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.768+0000 7f4561667640 1 -- 172.21.15.5:0/4112869244 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f455c109b90 msgr2=0x7f455c075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:20.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.768+0000 7f4561667640 1 --2- 172.21.15.5:0/4112869244 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f455c109b90 0x7f455c075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:20.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.768+0000 7f4561667640 1 -- 172.21.15.5:0/4112869244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f455c103900 msgr2=0x7f455c0754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:20.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.768+0000 7f4561667640 1 --2- 172.21.15.5:0/4112869244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f455c103900 0x7f455c0754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:20.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.768+0000 7f4561667640 1 -- 172.21.15.5:0/4112869244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f455c1a8560 con 0x7f455c109240 2024-08-31T05:44:20.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.768+0000 7f4561667640 1 --2- 172.21.15.5:0/4112869244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f455c109240 0x7f455c0759f0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f454c00c970 tx=0x7f454c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:20.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.768+0000 7f4552ffd640 1 -- 172.21.15.5:0/4112869244 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f454c007bb0 con 0x7f455c109240 2024-08-31T05:44:20.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.768+0000 7f4552ffd640 1 -- 172.21.15.5:0/4112869244 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f454c007d50 con 0x7f455c109240 2024-08-31T05:44:20.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.768+0000 7f45640cc640 1 -- 172.21.15.5:0/4112869244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f455c1a8850 con 0x7f455c109240 2024-08-31T05:44:20.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.768+0000 7f4552ffd640 1 -- 172.21.15.5:0/4112869244 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f454c00f450 con 0x7f455c109240 2024-08-31T05:44:20.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.768+0000 7f45640cc640 1 -- 172.21.15.5:0/4112869244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f455c1a8d90 con 0x7f455c109240 2024-08-31T05:44:20.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.771+0000 7f456a641740 1 Processor -- start 2024-08-31T05:44:20.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.771+0000 7f4552ffd640 1 -- 172.21.15.5:0/4112869244 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f454c004eb0 con 0x7f455c109240 2024-08-31T05:44:20.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.771+0000 7f456a641740 1 -- start start 2024-08-31T05:44:20.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.771+0000 7f456a641740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561b1ef9e070 0x561b1f343310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:20.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.771+0000 7f456a641740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561b1ef751b0 0x561b1f343850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:20.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.771+0000 7f456a641740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561b1ef7d390 0x561b1f343d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:20.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.771+0000 7f456a641740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x561b1f2ba680 con 0x561b1ef751b0 2024-08-31T05:44:20.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.771+0000 7f456a641740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x561b1f2a9c10 con 0x561b1ef9e070 2024-08-31T05:44:20.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.771+0000 7f456a641740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561b1f2adbc0 con 0x561b1ef7d390 2024-08-31T05:44:20.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.771+0000 7f4561e68640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561b1ef751b0 0x561b1f343850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:20.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.771+0000 7f4561e68640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561b1ef751b0 0x561b1f343850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55774/0 (socket says 172.21.15.5:55774) 2024-08-31T05:44:20.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.771+0000 7f4561e68640 1 -- 172.21.15.5:0/320151651 learned_addr learned my addr 172.21.15.5:0/320151651 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:44:20.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.772+0000 7f4561667640 1 --2- 172.21.15.5:0/320151651 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561b1ef7d390 0x561b1f343d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:20.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.772+0000 7f4562669640 1 --2- 172.21.15.5:0/320151651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561b1ef9e070 0x561b1f343310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:20.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.772+0000 7f4561e68640 1 -- 172.21.15.5:0/320151651 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561b1ef7d390 msgr2=0x561b1f343d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:44:20.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.772+0000 7f4561e68640 1 --2- 172.21.15.5:0/320151651 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561b1ef7d390 0x561b1f343d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:20.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.772+0000 7f4561e68640 1 -- 172.21.15.5:0/320151651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561b1ef9e070 msgr2=0x561b1f343310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:44:20.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.772+0000 7f4561e68640 1 --2- 172.21.15.5:0/320151651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561b1ef9e070 0x561b1f343310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:20.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.772+0000 7f4561e68640 1 -- 172.21.15.5:0/320151651 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b1f009650 con 0x561b1ef751b0 2024-08-31T05:44:20.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.772+0000 7f4552ffd640 1 --2- 172.21.15.5:0/4112869244 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f45480b4ca0 0x7f45480b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:20.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.772+0000 7f4561e68640 1 --2- 172.21.15.5:0/320151651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561b1ef751b0 0x561b1f343850 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f455802a930 tx=0x7f4558032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d02dc9619b4c80b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:20.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.772+0000 7f4562669640 1 --2- 172.21.15.5:0/4112869244 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f45480b4ca0 0x7f45480b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:20.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.772+0000 7f4547fff640 1 -- 172.21.15.5:0/320151651 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4558040070 con 0x561b1ef751b0 2024-08-31T05:44:20.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.772+0000 7f4552ffd640 1 -- 172.21.15.5:0/4112869244 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9511+0+0 (secure 0 0 0) 0x7f454c0e5660 con 0x7f455c109240 2024-08-31T05:44:20.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.772+0000 7f4547fff640 1 -- 172.21.15.5:0/320151651 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4558032e50 con 0x561b1ef751b0 2024-08-31T05:44:20.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.772+0000 7f4547fff640 1 -- 172.21.15.5:0/320151651 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4558035040 con 0x561b1ef751b0 2024-08-31T05:44:20.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.773+0000 7f456a641740 1 -- 172.21.15.5:0/320151651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561b1ef751b0 msgr2=0x561b1f343850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:20.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.773+0000 7f456a641740 1 --2- 172.21.15.5:0/320151651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561b1ef751b0 0x561b1f343850 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f455802a930 tx=0x7f4558032c60 comp rx=0 tx=0).stop 2024-08-31T05:44:20.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.773+0000 7f4562669640 1 --2- 172.21.15.5:0/4112869244 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f45480b4ca0 0x7f45480b71b0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f4554005fd0 tx=0x7f4554009500 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:20.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.773+0000 7f456a641740 1 -- 172.21.15.5:0/320151651 shutdown_connections 2024-08-31T05:44:20.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.773+0000 7f456a641740 1 --2- 172.21.15.5:0/320151651 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561b1ef7d390 0x561b1f343d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:20.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.773+0000 7f456a641740 1 --2- 172.21.15.5:0/320151651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561b1ef751b0 0x561b1f343850 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:20.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.773+0000 7f456a641740 1 --2- 172.21.15.5:0/320151651 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561b1ef9e070 0x561b1f343310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:20.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.773+0000 7f456a641740 1 -- 172.21.15.5:0/320151651 >> 172.21.15.5:0/320151651 conn(0x561b1ef92460 msgr2=0x561b1f341200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:20.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.773+0000 7f456a641740 1 -- 172.21.15.5:0/320151651 shutdown_connections 2024-08-31T05:44:20.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.773+0000 7f456a641740 1 -- 172.21.15.5:0/320151651 wait complete. 2024-08-31T05:44:20.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.774+0000 7f456a641740 1 -- start start 2024-08-31T05:44:20.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.774+0000 7f456a641740 1 Processor -- start 2024-08-31T05:44:20.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.774+0000 7f456a641740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561b1ef751b0 0x561b1f34ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:20.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.774+0000 7f456a641740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561b1ef7d390 0x561b1f34ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:20.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.774+0000 7f456a641740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561b1ef9e070 0x561b1f35ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:20.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.774+0000 7f456a641740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x561b1f10c700 con 0x561b1ef751b0 2024-08-31T05:44:20.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.774+0000 7f456a641740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x561b1f230750 con 0x561b1ef7d390 2024-08-31T05:44:20.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.774+0000 7f456a641740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561b1f351a90 con 0x561b1ef9e070 2024-08-31T05:44:20.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.774+0000 7f456a641740 10 client.0 _ll_register_callbacks cb 0x561b1f25fe10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:44:20.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.775+0000 7f4561e68640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561b1ef751b0 0x561b1f34ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:20.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.775+0000 7f4561e68640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561b1ef751b0 0x561b1f34ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55776/0 (socket says 172.21.15.5:55776) 2024-08-31T05:44:20.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.775+0000 7f4561e68640 1 -- 172.21.15.5:0/2300055930 learned_addr learned my addr 172.21.15.5:0/2300055930 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:44:20.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.775+0000 7f4561667640 1 --2- 172.21.15.5:0/2300055930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561b1ef7d390 0x561b1f34ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:20.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.775+0000 7f4562669640 1 --2- 172.21.15.5:0/2300055930 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561b1ef9e070 0x561b1f35ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:20.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.775+0000 7f4561e68640 1 -- 172.21.15.5:0/2300055930 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561b1ef9e070 msgr2=0x561b1f35ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:44:20.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.775+0000 7f4561e68640 1 --2- 172.21.15.5:0/2300055930 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561b1ef9e070 0x561b1f35ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:20.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.775+0000 7f4561e68640 1 -- 172.21.15.5:0/2300055930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561b1ef7d390 msgr2=0x561b1f34ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:44:20.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.775+0000 7f4561e68640 1 --2- 172.21.15.5:0/2300055930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561b1ef7d390 0x561b1f34ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:20.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.775+0000 7f4561e68640 1 -- 172.21.15.5:0/2300055930 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b1f269900 con 0x561b1ef751b0 2024-08-31T05:44:20.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.775+0000 7f4562669640 1 --2- 172.21.15.5:0/2300055930 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561b1ef9e070 0x561b1f35ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:44:20.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.775+0000 7f4561e68640 1 --2- 172.21.15.5:0/2300055930 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561b1ef751b0 0x561b1f34ea50 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f455802a450 tx=0x7f4558005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce8633a8df3dce2f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:20.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.775+0000 7f45457fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:44:20.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.775+0000 7f45457fa640 1 -- 172.21.15.5:0/2300055930 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f455804c060 con 0x561b1ef751b0 2024-08-31T05:44:20.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.775+0000 7f456a641740 1 -- 172.21.15.5:0/2300055930 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4558032e50 con 0x561b1ef751b0 2024-08-31T05:44:20.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.775+0000 7f45457fa640 1 -- 172.21.15.5:0/2300055930 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9511+0+0 (secure 0 0 0) 0x7f4558004030 con 0x561b1ef751b0 2024-08-31T05:44:20.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.776+0000 7f45457fa640 1 -- 172.21.15.5:0/2300055930 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f4558053050 con 0x561b1ef751b0 2024-08-31T05:44:20.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.776+0000 7f456a641740 10 client.19392 fetch_fsmap learned FSMap version 36 2024-08-31T05:44:20.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.776+0000 7f456a641740 1 -- 172.21.15.5:0/2300055930 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x561b1f35d7d0 con 0x561b1ef751b0 2024-08-31T05:44:20.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.776+0000 7f45457fa640 1 -- 172.21.15.5:0/2300055930 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4558032e50 con 0x561b1ef751b0 2024-08-31T05:44:20.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.776+0000 7f45457fa640 1 -- 172.21.15.5:0/2300055930 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 36) ==== 8386+0+0 (secure 0 0 0) 0x7f4558004750 con 0x561b1ef751b0 2024-08-31T05:44:20.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.776+0000 7f456a641740 10 client.19392 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T05:44:20.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.776+0000 7f456a641740 10 client.19392 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-31T05:44:20.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.776+0000 7f456a641740 20 client.19392 populate_metadata read hostname 'smithi005' 2024-08-31T05:44:20.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.776+0000 7f456a641740 1 --2- 172.21.15.5:0/2300055930 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x561b1ef5c9f0 0x561b1f360b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:20.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.776+0000 7f456a641740 4 client.19392 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:44:20.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.776+0000 7f456a641740 1 -- 172.21.15.5:0/2300055930 --> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561b1f2bc5d0 con 0x561b1ef5c9f0 2024-08-31T05:44:20.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.776+0000 7f4561667640 1 --2- 172.21.15.5:0/2300055930 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x561b1ef5c9f0 0x561b1f360b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:20.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.777+0000 7f4561667640 1 --2- 172.21.15.5:0/2300055930 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x561b1ef5c9f0 0x561b1f360b30 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=17643125081c7d57 server_cookie=51ceae58e8f74b3d in_seq=0 out_seq=0 2024-08-31T05:44:20.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.777+0000 7f45457fa640 10 client.19392 ms_handle_connect on v2:172.21.15.50:6838/98200944 2024-08-31T05:44:20.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.777+0000 7f45457fa640 1 -- 172.21.15.5:0/2300055930 <== mds.1 v2:172.21.15.50:6838/98200944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561b1f2bc5d0 con 0x561b1ef5c9f0 2024-08-31T05:44:20.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.777+0000 7f45457fa640 10 client.19392 handle_command_reply: tid=0 2024-08-31T05:44:20.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.778+0000 7f456a641740 1 client.19392 shutdown 2024-08-31T05:44:20.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.778+0000 7f456a641740 1 -- 172.21.15.5:0/2300055930 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561b1ef751b0 msgr2=0x561b1f34ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:20.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.778+0000 7f456a641740 1 --2- 172.21.15.5:0/2300055930 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561b1ef751b0 0x561b1f34ea50 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f455802a450 tx=0x7f4558005770 comp rx=0 tx=0).stop 2024-08-31T05:44:20.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.778+0000 7f456a641740 1 -- 172.21.15.5:0/2300055930 shutdown_connections 2024-08-31T05:44:20.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.778+0000 7f456a641740 1 --2- 172.21.15.5:0/2300055930 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x561b1ef5c9f0 0x561b1f360b30 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:20.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.778+0000 7f456a641740 1 --2- 172.21.15.5:0/2300055930 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561b1ef9e070 0x561b1f35ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:20.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.778+0000 7f456a641740 1 --2- 172.21.15.5:0/2300055930 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561b1ef7d390 0x561b1f34ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:20.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.778+0000 7f456a641740 1 --2- 172.21.15.5:0/2300055930 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561b1ef751b0 0x561b1f34ea50 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:20.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.778+0000 7f45457fa640 0 client.19392 ms_handle_reset on v2:172.21.15.50:6838/98200944 2024-08-31T05:44:20.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.778+0000 7f456a641740 1 -- 172.21.15.5:0/2300055930 >> 172.21.15.5:0/2300055930 conn(0x561b1ef92460 msgr2=0x561b1f3464f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:20.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.778+0000 7f456a641740 1 -- 172.21.15.5:0/2300055930 shutdown_connections 2024-08-31T05:44:20.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.778+0000 7f456a641740 1 -- 172.21.15.5:0/2300055930 wait complete. 2024-08-31T05:44:20.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.778+0000 7f456a641740 20 client.19392 trim_cache size 0 max 16384 2024-08-31T05:44:20.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.791+0000 7f456a641740 1 Processor -- start 2024-08-31T05:44:20.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.791+0000 7f456a641740 1 -- start start 2024-08-31T05:44:20.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.791+0000 7f456a641740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561b1ef751b0 0x561b1f346b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:20.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.791+0000 7f456a641740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561b1ef7d390 0x561b1f34bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:20.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.791+0000 7f456a641740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561b1ef9e070 0x561b1f34c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:20.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.791+0000 7f456a641740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f455c1b2fb0 con 0x561b1ef7d390 2024-08-31T05:44:20.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.791+0000 7f456a641740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f455c1b4bb0 con 0x561b1ef9e070 2024-08-31T05:44:20.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.791+0000 7f456a641740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f455c1b3680 con 0x561b1ef751b0 2024-08-31T05:44:20.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.791+0000 7f4561667640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561b1ef7d390 0x561b1f34bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:20.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.791+0000 7f4561667640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561b1ef7d390 0x561b1f34bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55792/0 (socket says 172.21.15.5:55792) 2024-08-31T05:44:20.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.791+0000 7f4561667640 1 -- 172.21.15.5:0/1546546776 learned_addr learned my addr 172.21.15.5:0/1546546776 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:44:20.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.792+0000 7f4561e68640 1 --2- 172.21.15.5:0/1546546776 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561b1ef751b0 0x561b1f346b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:20.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.792+0000 7f4562669640 1 --2- 172.21.15.5:0/1546546776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561b1ef9e070 0x561b1f34c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:20.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.792+0000 7f4561667640 1 -- 172.21.15.5:0/1546546776 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561b1ef751b0 msgr2=0x561b1f346b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:44:20.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.792+0000 7f4561667640 1 --2- 172.21.15.5:0/1546546776 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561b1ef751b0 0x561b1f346b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:20.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.792+0000 7f4561667640 1 -- 172.21.15.5:0/1546546776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561b1ef9e070 msgr2=0x561b1f34c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:44:20.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.792+0000 7f4561667640 1 --2- 172.21.15.5:0/1546546776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561b1ef9e070 0x561b1f34c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:20.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.792+0000 7f4561667640 1 -- 172.21.15.5:0/1546546776 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b1f346170 con 0x561b1ef7d390 2024-08-31T05:44:20.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.792+0000 7f4562669640 1 --2- 172.21.15.5:0/1546546776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561b1ef9e070 0x561b1f34c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:44:20.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.792+0000 7f4561667640 1 --2- 172.21.15.5:0/1546546776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561b1ef7d390 0x561b1f34bc40 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f454c0a8be0 tx=0x7f454c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de207fb2d6c0f714 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:20.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.792+0000 7f45477fe640 1 -- 172.21.15.5:0/1546546776 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f454c01d040 con 0x561b1ef7d390 2024-08-31T05:44:20.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.792+0000 7f45477fe640 1 -- 172.21.15.5:0/1546546776 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f454c0ac070 con 0x561b1ef7d390 2024-08-31T05:44:20.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.792+0000 7f45477fe640 1 -- 172.21.15.5:0/1546546776 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f454c0046c0 con 0x561b1ef7d390 2024-08-31T05:44:20.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.793+0000 7f456a641740 1 -- 172.21.15.5:0/1546546776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561b1ef7d390 msgr2=0x561b1f34bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:20.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.793+0000 7f456a641740 1 --2- 172.21.15.5:0/1546546776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561b1ef7d390 0x561b1f34bc40 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f454c0a8be0 tx=0x7f454c000bc0 comp rx=0 tx=0).stop 2024-08-31T05:44:20.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.793+0000 7f456a641740 1 -- 172.21.15.5:0/1546546776 shutdown_connections 2024-08-31T05:44:20.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.793+0000 7f456a641740 1 --2- 172.21.15.5:0/1546546776 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561b1ef9e070 0x561b1f34c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:20.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.793+0000 7f456a641740 1 --2- 172.21.15.5:0/1546546776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561b1ef7d390 0x561b1f34bc40 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:20.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.793+0000 7f456a641740 1 --2- 172.21.15.5:0/1546546776 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561b1ef751b0 0x561b1f346b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:20.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.793+0000 7f456a641740 1 -- 172.21.15.5:0/1546546776 >> 172.21.15.5:0/1546546776 conn(0x561b1ef92460 msgr2=0x561b1f346410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:20.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.793+0000 7f456a641740 1 -- 172.21.15.5:0/1546546776 shutdown_connections 2024-08-31T05:44:20.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.793+0000 7f456a641740 1 -- 172.21.15.5:0/1546546776 wait complete. 2024-08-31T05:44:20.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.794+0000 7f456a641740 1 -- start start 2024-08-31T05:44:20.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.794+0000 7f456a641740 1 Processor -- start 2024-08-31T05:44:20.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.794+0000 7f456a641740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561b1ef751b0 0x561b1f364320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:20.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.794+0000 7f456a641740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561b1ef7d390 0x561b1f362850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:20.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.794+0000 7f456a641740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561b1ef9e070 0x561b1f362d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:20.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.794+0000 7f456a641740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f455c1b44e0 con 0x561b1ef751b0 2024-08-31T05:44:20.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.794+0000 7f456a641740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f455c1b3e10 con 0x561b1ef7d390 2024-08-31T05:44:20.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.794+0000 7f456a641740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f455c1b0fb0 con 0x561b1ef9e070 2024-08-31T05:44:20.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.794+0000 7f456a641740 10 client.0 _ll_register_callbacks cb 0x7f4558032bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:44:20.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.794+0000 7f4561e68640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561b1ef751b0 0x561b1f364320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:20.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.794+0000 7f4561e68640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561b1ef751b0 0x561b1f364320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55794/0 (socket says 172.21.15.5:55794) 2024-08-31T05:44:20.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.794+0000 7f4561e68640 1 -- 172.21.15.5:0/3259401900 learned_addr learned my addr 172.21.15.5:0/3259401900 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:44:20.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.794+0000 7f4562669640 1 --2- 172.21.15.5:0/3259401900 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561b1ef9e070 0x561b1f362d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:20.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.795+0000 7f4561667640 1 --2- 172.21.15.5:0/3259401900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561b1ef7d390 0x561b1f362850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:20.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.795+0000 7f4561e68640 1 -- 172.21.15.5:0/3259401900 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561b1ef9e070 msgr2=0x561b1f362d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:44:20.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.795+0000 7f4561e68640 1 --2- 172.21.15.5:0/3259401900 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561b1ef9e070 0x561b1f362d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:20.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.795+0000 7f4561e68640 1 -- 172.21.15.5:0/3259401900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561b1ef7d390 msgr2=0x561b1f362850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:44:20.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.795+0000 7f4561e68640 1 --2- 172.21.15.5:0/3259401900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561b1ef7d390 0x561b1f362850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:20.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.795+0000 7f4561e68640 1 -- 172.21.15.5:0/3259401900 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b1f363500 con 0x561b1ef751b0 2024-08-31T05:44:20.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.795+0000 7f4562669640 1 --2- 172.21.15.5:0/3259401900 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561b1ef9e070 0x561b1f362d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:44:20.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.795+0000 7f4561667640 1 --2- 172.21.15.5:0/3259401900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561b1ef7d390 0x561b1f362850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:44:20.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.795+0000 7f4561e68640 1 --2- 172.21.15.5:0/3259401900 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561b1ef751b0 0x561b1f364320 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f455802a450 tx=0x7f4558031520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf110245ef174b69 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:20.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.795+0000 7f45457fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-08-31T05:44:20.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.795+0000 7f45457fa640 1 -- 172.21.15.5:0/3259401900 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f455805b030 con 0x561b1ef751b0 2024-08-31T05:44:20.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.795+0000 7f45457fa640 1 -- 172.21.15.5:0/3259401900 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9511+0+0 (secure 0 0 0) 0x7f4558032cd0 con 0x561b1ef751b0 2024-08-31T05:44:20.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.795+0000 7f456a641740 1 -- 172.21.15.5:0/3259401900 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f454c0ac070 con 0x561b1ef751b0 2024-08-31T05:44:20.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.795+0000 7f45457fa640 1 -- 172.21.15.5:0/3259401900 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f4558065050 con 0x561b1ef751b0 2024-08-31T05:44:20.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.795+0000 7f456a641740 10 client.19398 fetch_fsmap learned FSMap version 36 2024-08-31T05:44:20.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.795+0000 7f456a641740 1 -- 172.21.15.5:0/3259401900 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x561b1f3cc180 con 0x561b1ef751b0 2024-08-31T05:44:20.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.795+0000 7f45457fa640 1 -- 172.21.15.5:0/3259401900 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f454c0ac070 con 0x561b1ef751b0 2024-08-31T05:44:20.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.796+0000 7f45457fa640 1 -- 172.21.15.5:0/3259401900 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 36) ==== 8386+0+0 (secure 0 0 0) 0x7f4558004d40 con 0x561b1ef751b0 2024-08-31T05:44:20.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.796+0000 7f456a641740 10 client.19398 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T05:44:20.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.796+0000 7f456a641740 10 client.19398 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-08-31T05:44:20.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.796+0000 7f456a641740 20 client.19398 populate_metadata read hostname 'smithi005' 2024-08-31T05:44:20.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.796+0000 7f456a641740 1 --2- 172.21.15.5:0/3259401900 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x561b1ef31da0 0x561b1f3ce960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:20.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.796+0000 7f456a641740 4 client.19398 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:44:20.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.796+0000 7f456a641740 1 -- 172.21.15.5:0/3259401900 --> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561b1f2b8070 con 0x561b1ef31da0 2024-08-31T05:44:20.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.796+0000 7f4561667640 1 --2- 172.21.15.5:0/3259401900 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x561b1ef31da0 0x561b1f3ce960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:20.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.797+0000 7f4561667640 1 --2- 172.21.15.5:0/3259401900 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x561b1ef31da0 0x561b1f3ce960 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=93bb012965a8f593 server_cookie=763455d9f3112082 in_seq=0 out_seq=0 2024-08-31T05:44:20.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.797+0000 7f45457fa640 10 client.19398 ms_handle_connect on v2:172.21.15.50:6838/98200944 2024-08-31T05:44:20.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.797+0000 7f45457fa640 1 -- 172.21.15.5:0/3259401900 <== mds.1 v2:172.21.15.50:6838/98200944 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561b1f2b8070 con 0x561b1ef31da0 2024-08-31T05:44:20.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.797+0000 7f45457fa640 10 client.19398 handle_command_reply: tid=0 2024-08-31T05:44:20.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.797+0000 7f456a641740 1 client.19398 shutdown 2024-08-31T05:44:20.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.797+0000 7f456a641740 1 -- 172.21.15.5:0/3259401900 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561b1ef751b0 msgr2=0x561b1f364320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:20.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.797+0000 7f456a641740 1 --2- 172.21.15.5:0/3259401900 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561b1ef751b0 0x561b1f364320 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f455802a450 tx=0x7f4558031520 comp rx=0 tx=0).stop 2024-08-31T05:44:20.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.797+0000 7f456a641740 1 -- 172.21.15.5:0/3259401900 shutdown_connections 2024-08-31T05:44:20.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.797+0000 7f456a641740 1 --2- 172.21.15.5:0/3259401900 >> [v2:172.21.15.50:6838/98200944,v1:172.21.15.50:6839/98200944] conn(0x561b1ef31da0 0x561b1f3ce960 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:20.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.797+0000 7f456a641740 1 --2- 172.21.15.5:0/3259401900 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561b1ef9e070 0x561b1f362d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:20.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.797+0000 7f456a641740 1 --2- 172.21.15.5:0/3259401900 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x561b1ef7d390 0x561b1f362850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:20.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.797+0000 7f45457fa640 0 client.19398 ms_handle_reset on v2:172.21.15.50:6838/98200944 2024-08-31T05:44:20.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.797+0000 7f456a641740 1 --2- 172.21.15.5:0/3259401900 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x561b1ef751b0 0x561b1f364320 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:20.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.797+0000 7f456a641740 1 -- 172.21.15.5:0/3259401900 >> 172.21.15.5:0/3259401900 conn(0x561b1ef92460 msgr2=0x561b1f344340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:20.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.797+0000 7f456a641740 1 -- 172.21.15.5:0/3259401900 shutdown_connections 2024-08-31T05:44:20.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.797+0000 7f456a641740 1 -- 172.21.15.5:0/3259401900 wait complete. 2024-08-31T05:44:20.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.797+0000 7f456a641740 20 client.19398 trim_cache size 0 max 16384 2024-08-31T05:44:20.816 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:44:20.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.798+0000 7f45640cc640 1 -- 172.21.15.5:0/4112869244 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f45480b4ca0 msgr2=0x7f45480b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:20.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.798+0000 7f45640cc640 1 --2- 172.21.15.5:0/4112869244 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f45480b4ca0 0x7f45480b71b0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f4554005fd0 tx=0x7f4554009500 comp rx=0 tx=0).stop 2024-08-31T05:44:20.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.798+0000 7f45640cc640 1 -- 172.21.15.5:0/4112869244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f455c109240 msgr2=0x7f455c0759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:20.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.798+0000 7f45640cc640 1 --2- 172.21.15.5:0/4112869244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f455c109240 0x7f455c0759f0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f454c00c970 tx=0x7f454c00ce30 comp rx=0 tx=0).stop 2024-08-31T05:44:20.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.798+0000 7f45640cc640 1 -- 172.21.15.5:0/4112869244 shutdown_connections 2024-08-31T05:44:20.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.798+0000 7f45640cc640 1 --2- 172.21.15.5:0/4112869244 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f45480b4ca0 0x7f45480b71b0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:20.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.798+0000 7f45640cc640 1 --2- 172.21.15.5:0/4112869244 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f455c109b90 0x7f455c075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:20.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.798+0000 7f45640cc640 1 --2- 172.21.15.5:0/4112869244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f455c109240 0x7f455c0759f0 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:20.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.798+0000 7f45640cc640 1 --2- 172.21.15.5:0/4112869244 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f455c103900 0x7f455c0754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:20.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.798+0000 7f45640cc640 1 -- 172.21.15.5:0/4112869244 >> 172.21.15.5:0/4112869244 conn(0x7f455c07b5f0 msgr2=0x7f455c107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:20.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.798+0000 7f45640cc640 1 -- 172.21.15.5:0/4112869244 shutdown_connections 2024-08-31T05:44:20.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:20.798+0000 7f45640cc640 1 -- 172.21.15.5:0/4112869244 wait complete. 2024-08-31T05:44:21.367 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:44:21 smithi005 ceph-mon[18602]: pgmap v792: 129 pgs: 129 active+clean; 844 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 7.0 MiB/s wr, 374 op/s 2024-08-31T05:44:21.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:44:21 smithi050 ceph-mon[22146]: pgmap v792: 129 pgs: 129 active+clean; 844 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 7.0 MiB/s wr, 374 op/s 2024-08-31T05:44:21.586 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T05:44:21.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:44:21 smithi070 ceph-mon[22316]: pgmap v792: 129 pgs: 129 active+clean; 844 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 7.0 MiB/s wr, 374 op/s 2024-08-31T05:44:21.842 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:44:22.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.417+0000 7fa0be866640 1 -- 172.21.15.5:0/1944815974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0b810b890 msgr2=0x7fa0b810bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:22.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.417+0000 7fa0be866640 1 --2- 172.21.15.5:0/1944815974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0b810b890 0x7fa0b810bca0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8005c50 tx=0x7fa0a802b570 comp rx=0 tx=0).stop 2024-08-31T05:44:22.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.417+0000 7fa0be866640 1 -- 172.21.15.5:0/1944815974 shutdown_connections 2024-08-31T05:44:22.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.417+0000 7fa0be866640 1 --2- 172.21.15.5:0/1944815974 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0b8110230 0x7fa0b807b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:22.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.417+0000 7fa0be866640 1 --2- 172.21.15.5:0/1944815974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0b810f8e0 0x7fa0b810fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:22.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.417+0000 7fa0be866640 1 --2- 172.21.15.5:0/1944815974 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0b810b890 0x7fa0b810bca0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:22.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.417+0000 7fa0be866640 1 -- 172.21.15.5:0/1944815974 >> 172.21.15.5:0/1944815974 conn(0x7fa0b8070c60 msgr2=0x7fa0b8071070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:22.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.417+0000 7fa0be866640 1 -- 172.21.15.5:0/1944815974 shutdown_connections 2024-08-31T05:44:22.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.421+0000 7fa0be866640 1 -- 172.21.15.5:0/1944815974 wait complete. 2024-08-31T05:44:22.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.422+0000 7fa0be866640 1 Processor -- start 2024-08-31T05:44:22.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.422+0000 7fa0be866640 1 -- start start 2024-08-31T05:44:22.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.423+0000 7fa0be866640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0b810b890 0x7fa0b8080410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:22.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.423+0000 7fa0be866640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0b810f8e0 0x7fa0b8080950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:22.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.423+0000 7fa0be866640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0b8110230 0x7fa0b8080eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:22.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.423+0000 7fa0be866640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b807e660 con 0x7fa0b810b890 2024-08-31T05:44:22.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.423+0000 7fa0be866640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b807e4e0 con 0x7fa0b810f8e0 2024-08-31T05:44:22.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.423+0000 7fa0be866640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b807e7e0 con 0x7fa0b8110230 2024-08-31T05:44:22.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.423+0000 7fa0b77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0b810f8e0 0x7fa0b8080950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:22.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.423+0000 7fa0b77fe640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0b810f8e0 0x7fa0b8080950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:42226/0 (socket says 172.21.15.5:42226) 2024-08-31T05:44:22.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.423+0000 7fa0b77fe640 1 -- 172.21.15.5:0/2385178803 learned_addr learned my addr 172.21.15.5:0/2385178803 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:44:22.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.423+0000 7fa0b7fff640 1 --2- 172.21.15.5:0/2385178803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0b810b890 0x7fa0b8080410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:22.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.424+0000 7fa0b77fe640 1 -- 172.21.15.5:0/2385178803 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0b8110230 msgr2=0x7fa0b8080eb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-31T05:44:22.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.424+0000 7fa0b77fe640 1 --2- 172.21.15.5:0/2385178803 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0b8110230 0x7fa0b8080eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:22.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.424+0000 7fa0b77fe640 1 -- 172.21.15.5:0/2385178803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0b810b890 msgr2=0x7fa0b8080410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:22.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.424+0000 7fa0b77fe640 1 --2- 172.21.15.5:0/2385178803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0b810b890 0x7fa0b8080410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:22.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.424+0000 7fa0b77fe640 1 -- 172.21.15.5:0/2385178803 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0b81c6200 con 0x7fa0b810f8e0 2024-08-31T05:44:22.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.424+0000 7fa0b7fff640 1 --2- 172.21.15.5:0/2385178803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0b810b890 0x7fa0b8080410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:44:22.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.425+0000 7fa0b77fe640 1 --2- 172.21.15.5:0/2385178803 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0b810f8e0 0x7fa0b8080950 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa0b000ebc0 tx=0x7fa0b000c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:22.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.425+0000 7fa0b57fa640 1 -- 172.21.15.5:0/2385178803 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b0010630 con 0x7fa0b810f8e0 2024-08-31T05:44:22.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.426+0000 7fa0be866640 1 -- 172.21.15.5:0/2385178803 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0b81c64f0 con 0x7fa0b810f8e0 2024-08-31T05:44:22.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.426+0000 7fa0be866640 1 -- 172.21.15.5:0/2385178803 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0b81c6a80 con 0x7fa0b810f8e0 2024-08-31T05:44:22.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.428+0000 7fa0b57fa640 1 -- 172.21.15.5:0/2385178803 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0b0010c80 con 0x7fa0b810f8e0 2024-08-31T05:44:22.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.428+0000 7fa0b57fa640 1 -- 172.21.15.5:0/2385178803 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b0010630 con 0x7fa0b810f8e0 2024-08-31T05:44:22.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.430+0000 7fa0c4ddb740 1 Processor -- start 2024-08-31T05:44:22.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.432+0000 7fa0b57fa640 1 -- 172.21.15.5:0/2385178803 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fa0b00107d0 con 0x7fa0b810f8e0 2024-08-31T05:44:22.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.434+0000 7fa0c4ddb740 1 -- start start 2024-08-31T05:44:22.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.434+0000 7fa0c4ddb740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55af20d82070 0x55af21127310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:22.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.434+0000 7fa0c4ddb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af20d591b0 0x55af21127850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:22.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.434+0000 7fa0c4ddb740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55af20d61390 0x55af21127d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:22.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.434+0000 7fa0c4ddb740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55af2109e680 con 0x55af20d82070 2024-08-31T05:44:22.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.434+0000 7fa0c4ddb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55af2108dc10 con 0x55af20d591b0 2024-08-31T05:44:22.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.434+0000 7fa0c4ddb740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55af21091bc0 con 0x55af20d61390 2024-08-31T05:44:22.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.435+0000 7fa0b57fa640 1 --2- 172.21.15.5:0/2385178803 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa0a00b50a0 0x7fa0a00b75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:22.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.436+0000 7fa0b57fa640 1 -- 172.21.15.5:0/2385178803 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9511+0+0 (secure 0 0 0) 0x7fa0b0010430 con 0x7fa0b810f8e0 2024-08-31T05:44:22.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.436+0000 7fa0b77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55af20d61390 0x55af21127d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:22.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.437+0000 7fa0b7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af20d591b0 0x55af21127850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:22.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.437+0000 7fa0b77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55af20d61390 0x55af21127d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.5:53720/0 (socket says 172.21.15.5:53720) 2024-08-31T05:44:22.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.437+0000 7fa0b77fe640 1 -- 172.21.15.5:0/1190236293 learned_addr learned my addr 172.21.15.5:0/1190236293 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:44:22.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.437+0000 7fa0bce03640 1 --2- 172.21.15.5:0/1190236293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55af20d82070 0x55af21127310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:22.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.438+0000 7fa0b7fff640 1 -- 172.21.15.5:0/1190236293 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55af20d61390 msgr2=0x55af21127d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:44:22.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.438+0000 7fa0b7fff640 1 --2- 172.21.15.5:0/1190236293 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55af20d61390 0x55af21127d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:22.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.438+0000 7fa0b7fff640 1 -- 172.21.15.5:0/1190236293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55af20d82070 msgr2=0x55af21127310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:44:22.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.438+0000 7fa0b7fff640 1 --2- 172.21.15.5:0/1190236293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55af20d82070 0x55af21127310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:22.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.438+0000 7fa0b7fff640 1 -- 172.21.15.5:0/1190236293 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af20ded650 con 0x55af20d591b0 2024-08-31T05:44:22.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.438+0000 7fa0bce03640 1 --2- 172.21.15.5:0/2385178803 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa0a00b50a0 0x7fa0a00b75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:22.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.438+0000 7fa0b7fff640 1 --2- 172.21.15.5:0/1190236293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af20d591b0 0x55af21127850 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8005ab0 tx=0x7fa0a8000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81b6602fd1f26cd3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:22.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.441+0000 7fa09e7fc640 1 -- 172.21.15.5:0/1190236293 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a8042070 con 0x55af20d591b0 2024-08-31T05:44:22.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.441+0000 7fa09e7fc640 1 -- 172.21.15.5:0/1190236293 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0a8047910 con 0x55af20d591b0 2024-08-31T05:44:22.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.442+0000 7fa0c4ddb740 1 -- 172.21.15.5:0/1190236293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af20d591b0 msgr2=0x55af21127850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:22.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.442+0000 7fa0c4ddb740 1 --2- 172.21.15.5:0/1190236293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af20d591b0 0x55af21127850 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8005ab0 tx=0x7fa0a8000bc0 comp rx=0 tx=0).stop 2024-08-31T05:44:22.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.443+0000 7fa0bce03640 1 --2- 172.21.15.5:0/2385178803 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa0a00b50a0 0x7fa0a00b75b0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac0058c0 tx=0x7fa0ac004730 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:22.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.444+0000 7fa0c4ddb740 1 -- 172.21.15.5:0/1190236293 shutdown_connections 2024-08-31T05:44:22.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.444+0000 7fa0c4ddb740 1 --2- 172.21.15.5:0/1190236293 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55af20d61390 0x55af21127d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:22.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.444+0000 7fa0c4ddb740 1 --2- 172.21.15.5:0/1190236293 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af20d591b0 0x55af21127850 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:22.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.444+0000 7fa0c4ddb740 1 --2- 172.21.15.5:0/1190236293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55af20d82070 0x55af21127310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:22.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.444+0000 7fa0c4ddb740 1 -- 172.21.15.5:0/1190236293 >> 172.21.15.5:0/1190236293 conn(0x55af20d76460 msgr2=0x55af21125200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:22.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.445+0000 7fa0c4ddb740 1 -- 172.21.15.5:0/1190236293 shutdown_connections 2024-08-31T05:44:22.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.445+0000 7fa0c4ddb740 1 -- 172.21.15.5:0/1190236293 wait complete. 2024-08-31T05:44:22.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.446+0000 7fa0c4ddb740 1 -- start start 2024-08-31T05:44:22.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.446+0000 7fa0c4ddb740 1 Processor -- start 2024-08-31T05:44:22.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.447+0000 7fa0c4ddb740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55af20d591b0 0x55af21132a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:22.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.447+0000 7fa0c4ddb740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55af20d61390 0x55af21132f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:22.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.447+0000 7fa0c4ddb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af20d82070 0x55af2113ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:22.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.447+0000 7fa0c4ddb740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55af20ef0700 con 0x55af20d61390 2024-08-31T05:44:22.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.447+0000 7fa0c4ddb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x55af21014750 con 0x55af20d82070 2024-08-31T05:44:22.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.447+0000 7fa0c4ddb740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55af21135ae0 con 0x55af20d591b0 2024-08-31T05:44:22.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.447+0000 7fa0c4ddb740 10 client.0 _ll_register_callbacks cb 0x55af21043e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:44:22.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.448+0000 7fa0bce03640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af20d82070 0x55af2113ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:22.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.448+0000 7fa0bce03640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af20d82070 0x55af2113ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:42248/0 (socket says 172.21.15.5:42248) 2024-08-31T05:44:22.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.448+0000 7fa0bce03640 1 -- 172.21.15.5:0/2141379750 learned_addr learned my addr 172.21.15.5:0/2141379750 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:44:22.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.448+0000 7fa0b77fe640 1 --2- 172.21.15.5:0/2141379750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55af20d61390 0x55af21132f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:22.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.449+0000 7fa0bce03640 1 -- 172.21.15.5:0/2141379750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55af20d591b0 msgr2=0x55af21132a40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T05:44:22.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.449+0000 7fa0bce03640 1 --2- 172.21.15.5:0/2141379750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55af20d591b0 0x55af21132a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:22.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.449+0000 7fa0bce03640 1 -- 172.21.15.5:0/2141379750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55af20d61390 msgr2=0x55af21132f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:44:22.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.449+0000 7fa0bce03640 1 --2- 172.21.15.5:0/2141379750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55af20d61390 0x55af21132f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:22.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.449+0000 7fa0bce03640 1 -- 172.21.15.5:0/2141379750 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af2104d900 con 0x55af20d82070 2024-08-31T05:44:22.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.449+0000 7fa0b77fe640 1 --2- 172.21.15.5:0/2141379750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55af20d61390 0x55af21132f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:44:22.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.449+0000 7fa0bce03640 1 --2- 172.21.15.5:0/2141379750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af20d82070 0x55af2113ee80 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac0117d0 tx=0x7fa0ac0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69c003cfd375fd32 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:22.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.450+0000 7fa0977fe640 10 client.0 ms_handle_connect on v2:172.21.15.50:3300/0 2024-08-31T05:44:22.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.450+0000 7fa0977fe640 1 -- 172.21.15.5:0/2141379750 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac023070 con 0x55af20d82070 2024-08-31T05:44:22.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.450+0000 7fa0977fe640 1 -- 172.21.15.5:0/2141379750 <== mon.2 v2:172.21.15.50:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9511+0+0 (secure 0 0 0) 0x7fa0ac011e10 con 0x55af20d82070 2024-08-31T05:44:22.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.451+0000 7fa0c4ddb740 1 -- 172.21.15.5:0/2141379750 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0a8047910 con 0x55af20d82070 2024-08-31T05:44:22.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.451+0000 7fa0977fe640 1 -- 172.21.15.5:0/2141379750 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fa0ac02c050 con 0x55af20d82070 2024-08-31T05:44:22.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.451+0000 7fa0c4ddb740 10 client.28949 fetch_fsmap learned FSMap version 36 2024-08-31T05:44:22.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.451+0000 7fa0c4ddb740 1 -- 172.21.15.5:0/2141379750 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55af21152950 con 0x55af20d82070 2024-08-31T05:44:22.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.452+0000 7fa0977fe640 1 -- 172.21.15.5:0/2141379750 <== mon.2 v2:172.21.15.50:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0a8047910 con 0x55af20d82070 2024-08-31T05:44:22.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.452+0000 7fa0977fe640 1 -- 172.21.15.5:0/2141379750 <== mon.2 v2:172.21.15.50:3300/0 5 ==== fsmap(e 36) ==== 8386+0+0 (secure 0 0 0) 0x7fa0ac01e040 con 0x55af20d82070 2024-08-31T05:44:22.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.452+0000 7fa0c4ddb740 10 client.28949 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T05:44:22.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.452+0000 7fa0c4ddb740 10 client.28949 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:44:22.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.452+0000 7fa0c4ddb740 20 client.28949 populate_metadata read hostname 'smithi005' 2024-08-31T05:44:22.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.452+0000 7fa0c4ddb740 1 --2- 172.21.15.5:0/2141379750 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55af20d409f0 0x55af21155fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:22.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.452+0000 7fa0c4ddb740 4 client.28949 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T05:44:22.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.452+0000 7fa0c4ddb740 1 -- 172.21.15.5:0/2141379750 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55af210a05d0 con 0x55af20d409f0 2024-08-31T05:44:22.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.455+0000 7fa0b7fff640 1 --2- 172.21.15.5:0/2141379750 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55af20d409f0 0x55af21155fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:22.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.462+0000 7fa0b7fff640 1 --2- 172.21.15.5:0/2141379750 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55af20d409f0 0x55af21155fc0 crc :-1 s=READY pgs=309 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82b1b944392fab42 server_cookie=8503df2b6e54190f in_seq=0 out_seq=0 2024-08-31T05:44:22.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.462+0000 7fa0977fe640 10 client.28949 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:44:22.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.464+0000 7fa0977fe640 1 -- 172.21.15.5:0/2141379750 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55af210a05d0 con 0x55af20d409f0 2024-08-31T05:44:22.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.464+0000 7fa0977fe640 10 client.28949 handle_command_reply: tid=0 2024-08-31T05:44:22.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.466+0000 7fa0c4ddb740 1 client.28949 shutdown 2024-08-31T05:44:22.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.467+0000 7fa0c4ddb740 1 -- 172.21.15.5:0/2141379750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af20d82070 msgr2=0x55af2113ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:22.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.467+0000 7fa0c4ddb740 1 --2- 172.21.15.5:0/2141379750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af20d82070 0x55af2113ee80 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac0117d0 tx=0x7fa0ac0046c0 comp rx=0 tx=0).stop 2024-08-31T05:44:22.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.467+0000 7fa0c4ddb740 1 -- 172.21.15.5:0/2141379750 shutdown_connections 2024-08-31T05:44:22.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.467+0000 7fa0c4ddb740 1 --2- 172.21.15.5:0/2141379750 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55af20d409f0 0x55af21155fc0 crc :-1 s=READY pgs=309 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:22.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.467+0000 7fa0c4ddb740 1 --2- 172.21.15.5:0/2141379750 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af20d82070 0x55af2113ee80 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:22.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.467+0000 7fa0c4ddb740 1 --2- 172.21.15.5:0/2141379750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55af20d61390 0x55af21132f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:22.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.467+0000 7fa0c4ddb740 1 --2- 172.21.15.5:0/2141379750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55af20d591b0 0x55af21132a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:22.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.467+0000 7fa0c4ddb740 1 -- 172.21.15.5:0/2141379750 >> 172.21.15.5:0/2141379750 conn(0x55af20d76460 msgr2=0x55af2112a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:22.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.467+0000 7fa0977fe640 0 client.28949 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:44:22.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.473+0000 7fa0c4ddb740 1 -- 172.21.15.5:0/2141379750 shutdown_connections 2024-08-31T05:44:22.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.474+0000 7fa0c4ddb740 1 -- 172.21.15.5:0/2141379750 wait complete. 2024-08-31T05:44:22.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.474+0000 7fa0c4ddb740 20 client.28949 trim_cache size 0 max 16384 2024-08-31T05:44:22.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.500+0000 7fa0c4ddb740 1 Processor -- start 2024-08-31T05:44:22.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.501+0000 7fa0c4ddb740 1 -- start start 2024-08-31T05:44:22.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.501+0000 7fa0c4ddb740 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af20d591b0 0x55af21132f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:22.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.501+0000 7fa0c4ddb740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55af20d61390 0x55af2113ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:22.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.501+0000 7fa0c4ddb740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55af20d82070 0x55af211247d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:22.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.501+0000 7fa0c4ddb740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a4010170 con 0x55af20d82070 2024-08-31T05:44:22.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.501+0000 7fa0c4ddb740 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a4011d70 con 0x55af20d591b0 2024-08-31T05:44:22.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.501+0000 7fa0c4ddb740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a4010840 con 0x55af20d61390 2024-08-31T05:44:22.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.505+0000 7fa0b7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af20d591b0 0x55af21132f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:22.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.505+0000 7fa0b7fff640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af20d591b0 0x55af21132f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:42258/0 (socket says 172.21.15.5:42258) 2024-08-31T05:44:22.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.505+0000 7fa0b7fff640 1 -- 172.21.15.5:0/990544332 learned_addr learned my addr 172.21.15.5:0/990544332 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:44:22.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.505+0000 7fa0b77fe640 1 --2- 172.21.15.5:0/990544332 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55af20d61390 0x55af2113ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:22.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.505+0000 7fa0b7fff640 1 -- 172.21.15.5:0/990544332 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55af20d61390 msgr2=0x55af2113ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:44:22.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.505+0000 7fa0b7fff640 1 --2- 172.21.15.5:0/990544332 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55af20d61390 0x55af2113ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:22.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.505+0000 7fa0b7fff640 1 -- 172.21.15.5:0/990544332 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55af20d82070 msgr2=0x55af211247d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T05:44:22.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.505+0000 7fa0b7fff640 1 --2- 172.21.15.5:0/990544332 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55af20d82070 0x55af211247d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:22.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.505+0000 7fa0b7fff640 1 -- 172.21.15.5:0/990544332 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af21150600 con 0x55af20d591b0 2024-08-31T05:44:22.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.506+0000 7fa0b7fff640 1 --2- 172.21.15.5:0/990544332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af20d591b0 0x55af21132f00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x55af21125f90 tx=0x7fa0a802b570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdf3c404a5c90f13 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:22.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.507+0000 7fa09dffb640 1 -- 172.21.15.5:0/990544332 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a8054070 con 0x55af20d591b0 2024-08-31T05:44:22.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.507+0000 7fa09dffb640 1 -- 172.21.15.5:0/990544332 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0a8047a30 con 0x55af20d591b0 2024-08-31T05:44:22.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.507+0000 7fa09dffb640 1 -- 172.21.15.5:0/990544332 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a8042040 con 0x55af20d591b0 2024-08-31T05:44:22.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.508+0000 7fa0c4ddb740 1 -- 172.21.15.5:0/990544332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af20d591b0 msgr2=0x55af21132f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:22.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.508+0000 7fa0c4ddb740 1 --2- 172.21.15.5:0/990544332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af20d591b0 0x55af21132f00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x55af21125f90 tx=0x7fa0a802b570 comp rx=0 tx=0).stop 2024-08-31T05:44:22.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.511+0000 7fa0c4ddb740 1 -- 172.21.15.5:0/990544332 shutdown_connections 2024-08-31T05:44:22.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.511+0000 7fa0c4ddb740 1 --2- 172.21.15.5:0/990544332 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55af20d82070 0x55af211247d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:22.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.511+0000 7fa0c4ddb740 1 --2- 172.21.15.5:0/990544332 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55af20d61390 0x55af2113ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:22.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.511+0000 7fa0c4ddb740 1 --2- 172.21.15.5:0/990544332 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af20d591b0 0x55af21132f00 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:22.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.511+0000 7fa0c4ddb740 1 -- 172.21.15.5:0/990544332 >> 172.21.15.5:0/990544332 conn(0x55af20d76460 msgr2=0x55af211327f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:22.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.513+0000 7fa0c4ddb740 1 -- 172.21.15.5:0/990544332 shutdown_connections 2024-08-31T05:44:22.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.513+0000 7fa0c4ddb740 1 -- 172.21.15.5:0/990544332 wait complete. 2024-08-31T05:44:22.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.513+0000 7fa0c4ddb740 1 -- start start 2024-08-31T05:44:22.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.514+0000 7fa0c4ddb740 1 Processor -- start 2024-08-31T05:44:22.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.515+0000 7fa0c4ddb740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55af20d591b0 0x55af21136f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:22.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.515+0000 7fa0c4ddb740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55af20d61390 0x55af21137470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:22.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.515+0000 7fa0b7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55af20d591b0 0x55af21136f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:22.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.515+0000 7fa0b7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55af20d591b0 0x55af21136f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55262/0 (socket says 172.21.15.5:55262) 2024-08-31T05:44:22.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.515+0000 7fa0b7fff640 1 -- 172.21.15.5:0/3474871903 learned_addr learned my addr 172.21.15.5:0/3474871903 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:44:22.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.515+0000 7fa0c4ddb740 1 --2- 172.21.15.5:0/3474871903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af20d82070 0x55af211379b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:22.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.516+0000 7fa0c4ddb740 1 -- 172.21.15.5:0/3474871903 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a40116a0 con 0x55af20d591b0 2024-08-31T05:44:22.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.516+0000 7fa0c4ddb740 1 -- 172.21.15.5:0/3474871903 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a4010fd0 con 0x55af20d82070 2024-08-31T05:44:22.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.516+0000 7fa0c4ddb740 1 -- 172.21.15.5:0/3474871903 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a400e170 con 0x55af20d61390 2024-08-31T05:44:22.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.516+0000 7fa0c4ddb740 10 client.0 _ll_register_callbacks cb 0x7fa0ac00db70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T05:44:22.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.518+0000 7fa0b77fe640 1 --2- 172.21.15.5:0/3474871903 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55af20d61390 0x55af21137470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:22.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.518+0000 7fa0bce03640 1 --2- 172.21.15.5:0/3474871903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af20d82070 0x55af211379b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:22.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.518+0000 7fa0b77fe640 1 -- 172.21.15.5:0/3474871903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af20d82070 msgr2=0x55af211379b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:44:22.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.518+0000 7fa0b77fe640 1 --2- 172.21.15.5:0/3474871903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af20d82070 0x55af211379b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:22.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.518+0000 7fa0b77fe640 1 -- 172.21.15.5:0/3474871903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55af20d591b0 msgr2=0x55af21136f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T05:44:22.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.518+0000 7fa0b77fe640 1 --2- 172.21.15.5:0/3474871903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55af20d591b0 0x55af21136f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:22.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.518+0000 7fa0b77fe640 1 -- 172.21.15.5:0/3474871903 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af21133990 con 0x55af20d61390 2024-08-31T05:44:22.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.519+0000 7fa0b77fe640 1 --2- 172.21.15.5:0/3474871903 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55af20d61390 0x55af21137470 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0005fa0 tx=0x7fa0b00e3440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5edfeecb03ee4f98 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:22.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.519+0000 7fa0977fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-08-31T05:44:22.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.519+0000 7fa0977fe640 1 -- 172.21.15.5:0/3474871903 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b00c6060 con 0x55af20d61390 2024-08-31T05:44:22.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.520+0000 7fa0977fe640 1 -- 172.21.15.5:0/3474871903 <== mon.1 v2:172.21.15.70:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9511+0+0 (secure 0 0 0) 0x7fa0b00a8450 con 0x55af20d61390 2024-08-31T05:44:22.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.520+0000 7fa0c4ddb740 1 -- 172.21.15.5:0/3474871903 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0a8047a30 con 0x55af20d61390 2024-08-31T05:44:22.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.520+0000 7fa0977fe640 1 -- 172.21.15.5:0/3474871903 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fa0b0097030 con 0x55af20d61390 2024-08-31T05:44:22.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.520+0000 7fa0c4ddb740 10 client.28945 fetch_fsmap learned FSMap version 36 2024-08-31T05:44:22.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.520+0000 7fa0c4ddb740 1 -- 172.21.15.5:0/3474871903 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55af211c0bf0 con 0x55af20d61390 2024-08-31T05:44:22.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.521+0000 7fa0977fe640 1 -- 172.21.15.5:0/3474871903 <== mon.1 v2:172.21.15.70:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0b00ab970 con 0x55af20d61390 2024-08-31T05:44:22.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.521+0000 7fa0977fe640 1 -- 172.21.15.5:0/3474871903 <== mon.1 v2:172.21.15.70:3300/0 5 ==== fsmap(e 36) ==== 8386+0+0 (secure 0 0 0) 0x7fa0b00b4cf0 con 0x55af20d61390 2024-08-31T05:44:22.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.521+0000 7fa0c4ddb740 10 client.28945 fetch_fsmap finished waiting for FSMap version 36 2024-08-31T05:44:22.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.521+0000 7fa0c4ddb740 10 client.28945 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-08-31T05:44:22.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.521+0000 7fa0c4ddb740 20 client.28945 populate_metadata read hostname 'smithi005' 2024-08-31T05:44:22.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.521+0000 7fa0c4ddb740 1 --2- 172.21.15.5:0/3474871903 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55af20d15da0 0x55af211c3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:22.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.521+0000 7fa0c4ddb740 4 client.28945 mds_command: new command op to 24652 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T05:44:22.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.522+0000 7fa0c4ddb740 1 -- 172.21.15.5:0/3474871903 --> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fa0a8047a30 con 0x55af20d15da0 2024-08-31T05:44:22.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.522+0000 7fa0b7fff640 1 --2- 172.21.15.5:0/3474871903 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55af20d15da0 0x55af211c3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:22.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.523+0000 7fa0b7fff640 1 --2- 172.21.15.5:0/3474871903 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55af20d15da0 0x55af211c3340 crc :-1 s=READY pgs=310 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a8b928e1859b2c3 server_cookie=e956895bbb51486e in_seq=0 out_seq=0 2024-08-31T05:44:22.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.523+0000 7fa0977fe640 10 client.28945 ms_handle_connect on v2:172.21.15.70:6838/2756569250 2024-08-31T05:44:22.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.524+0000 7fa0977fe640 1 -- 172.21.15.5:0/3474871903 <== mds.0 v2:172.21.15.70:6838/2756569250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fa0a8047a30 con 0x55af20d15da0 2024-08-31T05:44:22.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.524+0000 7fa0977fe640 10 client.28945 handle_command_reply: tid=0 2024-08-31T05:44:22.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.524+0000 7fa0c4ddb740 1 client.28945 shutdown 2024-08-31T05:44:22.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.524+0000 7fa0c4ddb740 1 -- 172.21.15.5:0/3474871903 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55af20d61390 msgr2=0x55af21137470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:22.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.524+0000 7fa0c4ddb740 1 --2- 172.21.15.5:0/3474871903 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55af20d61390 0x55af21137470 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0005fa0 tx=0x7fa0b00e3440 comp rx=0 tx=0).stop 2024-08-31T05:44:22.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.524+0000 7fa0c4ddb740 1 -- 172.21.15.5:0/3474871903 shutdown_connections 2024-08-31T05:44:22.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.524+0000 7fa0c4ddb740 1 --2- 172.21.15.5:0/3474871903 >> [v2:172.21.15.70:6838/2756569250,v1:172.21.15.70:6839/2756569250] conn(0x55af20d15da0 0x55af211c3340 crc :-1 s=READY pgs=310 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:22.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.524+0000 7fa0c4ddb740 1 --2- 172.21.15.5:0/3474871903 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x55af20d82070 0x55af211379b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:22.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.524+0000 7fa0c4ddb740 1 --2- 172.21.15.5:0/3474871903 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55af20d61390 0x55af21137470 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:22.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.524+0000 7fa0c4ddb740 1 --2- 172.21.15.5:0/3474871903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55af20d591b0 0x55af21136f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:22.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.524+0000 7fa0c4ddb740 1 -- 172.21.15.5:0/3474871903 >> 172.21.15.5:0/3474871903 conn(0x55af20d76460 msgr2=0x55af211282e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:22.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.524+0000 7fa0977fe640 0 client.28945 ms_handle_reset on v2:172.21.15.70:6838/2756569250 2024-08-31T05:44:22.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.525+0000 7fa0c4ddb740 1 -- 172.21.15.5:0/3474871903 shutdown_connections 2024-08-31T05:44:22.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.525+0000 7fa0c4ddb740 1 -- 172.21.15.5:0/3474871903 wait complete. 2024-08-31T05:44:22.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.525+0000 7fa0c4ddb740 20 client.28945 trim_cache size 0 max 16384 2024-08-31T05:44:22.529 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-08-31T05:44:22.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.526+0000 7fa0be866640 1 -- 172.21.15.5:0/2385178803 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa0a00b50a0 msgr2=0x7fa0a00b75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:22.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.526+0000 7fa0be866640 1 --2- 172.21.15.5:0/2385178803 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa0a00b50a0 0x7fa0a00b75b0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac0058c0 tx=0x7fa0ac004730 comp rx=0 tx=0).stop 2024-08-31T05:44:22.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.526+0000 7fa0be866640 1 -- 172.21.15.5:0/2385178803 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0b810f8e0 msgr2=0x7fa0b8080950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:22.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.526+0000 7fa0be866640 1 --2- 172.21.15.5:0/2385178803 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0b810f8e0 0x7fa0b8080950 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa0b000ebc0 tx=0x7fa0b000c6a0 comp rx=0 tx=0).stop 2024-08-31T05:44:22.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.527+0000 7fa0be866640 1 -- 172.21.15.5:0/2385178803 shutdown_connections 2024-08-31T05:44:22.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.527+0000 7fa0be866640 1 --2- 172.21.15.5:0/2385178803 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa0a00b50a0 0x7fa0a00b75b0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:22.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.527+0000 7fa0be866640 1 --2- 172.21.15.5:0/2385178803 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0b8110230 0x7fa0b8080eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:22.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.527+0000 7fa0be866640 1 --2- 172.21.15.5:0/2385178803 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0b810f8e0 0x7fa0b8080950 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:22.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.527+0000 7fa0be866640 1 --2- 172.21.15.5:0/2385178803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0b810b890 0x7fa0b8080410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:22.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.527+0000 7fa0be866640 1 -- 172.21.15.5:0/2385178803 >> 172.21.15.5:0/2385178803 conn(0x7fa0b8070c60 msgr2=0x7fa0b810d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:22.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.527+0000 7fa0be866640 1 -- 172.21.15.5:0/2385178803 shutdown_connections 2024-08-31T05:44:22.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:22.527+0000 7fa0be866640 1 -- 172.21.15.5:0/2385178803 wait complete. 2024-08-31T05:44:23.220 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:44:23 smithi005 ceph-mon[18602]: pgmap v793: 129 pgs: 129 active+clean; 844 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 6.9 MiB/s wr, 365 op/s 2024-08-31T05:44:23.392 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/thrasher.py", line 50, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-08-31T05:44:23.398 INFO:tasks.fwd_scrub:done joining 2024-08-31T05:44:23.398 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-08-31T05:44:23.408 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-31T05:44:23.411 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:44:23 smithi050 ceph-mon[22146]: pgmap v793: 129 pgs: 129 active+clean; 844 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 6.9 MiB/s wr, 365 op/s 2024-08-31T05:44:23.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.580+0000 7f29b800e640 1 -- 172.21.15.5:0/1582430199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29b01080b0 msgr2=0x7f29b01084c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:23.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.580+0000 7f29b800e640 1 --2- 172.21.15.5:0/1582430199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29b01080b0 0x7f29b01084c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f29a0009860 tx=0x7f29a002a340 comp rx=0 tx=0).stop 2024-08-31T05:44:23.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.580+0000 7f29b800e640 1 -- 172.21.15.5:0/1582430199 shutdown_connections 2024-08-31T05:44:23.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.580+0000 7f29b800e640 1 --2- 172.21.15.5:0/1582430199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29b0108a00 0x7f29b010f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:23.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.580+0000 7f29b800e640 1 --2- 172.21.15.5:0/1582430199 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29b01080b0 0x7f29b01084c0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:23.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.580+0000 7f29b800e640 1 --2- 172.21.15.5:0/1582430199 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29b0102ef0 0x7f29b0103300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:23.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.580+0000 7f29b800e640 1 -- 172.21.15.5:0/1582430199 >> 172.21.15.5:0/1582430199 conn(0x7f29b0079c10 msgr2=0x7f29b007a020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:23.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.580+0000 7f29b800e640 1 -- 172.21.15.5:0/1582430199 shutdown_connections 2024-08-31T05:44:23.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.580+0000 7f29b800e640 1 -- 172.21.15.5:0/1582430199 wait complete. 2024-08-31T05:44:23.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.581+0000 7f29b800e640 1 Processor -- start 2024-08-31T05:44:23.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.581+0000 7f29b800e640 1 -- start start 2024-08-31T05:44:23.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.581+0000 7f29b800e640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29b0102ef0 0x7f29b019c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:23.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.581+0000 7f29b800e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29b01080b0 0x7f29b019c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:23.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.581+0000 7f29b800e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29b0108a00 0x7f29b01a1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:23.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.582+0000 7f29b5daa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29b0102ef0 0x7f29b019c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:23.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.582+0000 7f29b800e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f29b01115c0 con 0x7f29b0108a00 2024-08-31T05:44:23.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.582+0000 7f29b800e640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f29b0111440 con 0x7f29b0102ef0 2024-08-31T05:44:23.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.582+0000 7f29b800e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f29b0111740 con 0x7f29b01080b0 2024-08-31T05:44:23.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.582+0000 7f29b5daa640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29b0102ef0 0x7f29b019c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.50:3300/0 says I am v2:172.21.15.5:42288/0 (socket says 172.21.15.5:42288) 2024-08-31T05:44:23.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.582+0000 7f29b5daa640 1 -- 172.21.15.5:0/923767249 learned_addr learned my addr 172.21.15.5:0/923767249 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:44:23.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.582+0000 7f29b65ab640 1 --2- 172.21.15.5:0/923767249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29b0108a00 0x7f29b01a1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:23.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.582+0000 7f29b55a9640 1 --2- 172.21.15.5:0/923767249 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29b01080b0 0x7f29b019c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:23.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.582+0000 7f29b5daa640 1 -- 172.21.15.5:0/923767249 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29b01080b0 msgr2=0x7f29b019c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:23.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.582+0000 7f29b5daa640 1 --2- 172.21.15.5:0/923767249 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29b01080b0 0x7f29b019c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:23.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.582+0000 7f29b5daa640 1 -- 172.21.15.5:0/923767249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29b0108a00 msgr2=0x7f29b01a1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:23.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.582+0000 7f29b5daa640 1 --2- 172.21.15.5:0/923767249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29b0108a00 0x7f29b01a1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:23.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.582+0000 7f29b5daa640 1 -- 172.21.15.5:0/923767249 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29b01a22c0 con 0x7f29b0102ef0 2024-08-31T05:44:23.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.582+0000 7f29b5daa640 1 --2- 172.21.15.5:0/923767249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29b0102ef0 0x7f29b019c390 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f29ac00e9f0 tx=0x7f29ac00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:23.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.582+0000 7f29a6ffd640 1 -- 172.21.15.5:0/923767249 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ac00cd80 con 0x7f29b0102ef0 2024-08-31T05:44:23.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.583+0000 7f29a6ffd640 1 -- 172.21.15.5:0/923767249 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29ac0054d0 con 0x7f29b0102ef0 2024-08-31T05:44:23.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.583+0000 7f29b800e640 1 -- 172.21.15.5:0/923767249 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29b01a25b0 con 0x7f29b0102ef0 2024-08-31T05:44:23.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.583+0000 7f29a6ffd640 1 -- 172.21.15.5:0/923767249 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ac010690 con 0x7f29b0102ef0 2024-08-31T05:44:23.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.583+0000 7f29b800e640 1 -- 172.21.15.5:0/923767249 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29b01a8d40 con 0x7f29b0102ef0 2024-08-31T05:44:23.589 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:44:23 smithi070 ceph-mon[22316]: pgmap v793: 129 pgs: 129 active+clean; 844 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 6.9 MiB/s wr, 365 op/s 2024-08-31T05:44:23.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.584+0000 7f29b800e640 1 -- 172.21.15.5:0/923767249 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29b0103300 con 0x7f29b0102ef0 2024-08-31T05:44:23.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.586+0000 7f29a6ffd640 1 -- 172.21.15.5:0/923767249 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f29ac004e90 con 0x7f29b0102ef0 2024-08-31T05:44:23.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.587+0000 7f29a6ffd640 1 --2- 172.21.15.5:0/923767249 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f299c0b4c90 0x7f299c0b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:23.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.587+0000 7f29b55a9640 1 --2- 172.21.15.5:0/923767249 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f299c0b4c90 0x7f299c0b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:23.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.587+0000 7f29a6ffd640 1 -- 172.21.15.5:0/923767249 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9511+0+0 (secure 0 0 0) 0x7f29ac0e5e00 con 0x7f29b0102ef0 2024-08-31T05:44:23.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.588+0000 7f29b55a9640 1 --2- 172.21.15.5:0/923767249 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f299c0b4c90 0x7f299c0b71a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f29b0069bf0 tx=0x7f29a0000bc0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:23.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.593+0000 7f29a6ffd640 1 -- 172.21.15.5:0/923767249 <== mon.2 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f29ac0ac810 con 0x7f29b0102ef0 2024-08-31T05:44:23.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.789+0000 7f29b800e640 1 -- 172.21.15.5:0/923767249 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f29b019d4b0 con 0x7f29b0102ef0 2024-08-31T05:44:23.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.791+0000 7f29a6ffd640 1 -- 172.21.15.5:0/923767249 <== mon.2 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) ==== 74+0+25310 (secure 0 0 0) 0x7f29ac0ac110 con 0x7f29b0102ef0 2024-08-31T05:44:23.794 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:44:23.794 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":103,"fsid":"69422704-6758-11ef-bcd4-c7b262605968","created":"2024-08-31T05:19:04.860258+0000","modified":"2024-08-31T05:44:14.941116+0000","last_up_change":"2024-08-31T05:26:38.675914+0000","last_in_change":"2024-08-31T05:26:15.366713+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T05:22:49.802575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T05:27:27.835197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T05:27:30.058144+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":23,"snap_epoch":102,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-31T05:27:36.272228+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":23,"snap_epoch":102,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c5745391-e9d7-4799-9db9-6b34bb91b7df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6803","nonce":2312496244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6805","nonce":2312496244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6809","nonce":2312496244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6807","nonce":2312496244}]},"public_addr":"172.21.15.5:6803/2312496244","cluster_addr":"172.21.15.5:6805/2312496244","heartbeat_back_addr":"172.21.15.5:6809/2312496244","heartbeat_front_addr":"172.21.15.5:6807/2312496244","state":["exists","up"]},{"osd":1,"uuid":"f1903bd7-b2c5-424e-a74e-795f729471db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6801","nonce":2777359361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6803","nonce":2777359361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6807","nonce":2777359361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6805","nonce":2777359361}]},"public_addr":"172.21.15.50:6801/2777359361","cluster_addr":"172.21.15.50:6803/2777359361","heartbeat_back_addr":"172.21.15.50:6807/2777359361","heartbeat_front_addr":"172.21.15.50:6805/2777359361","state":["exists","up"]},{"osd":2,"uuid":"134c5892-e44a-44f2-8cd2-484d22a45e2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6801","nonce":1400583716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6803","nonce":1400583716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6807","nonce":1400583716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6805","nonce":1400583716}]},"public_addr":"172.21.15.70:6801/1400583716","cluster_addr":"172.21.15.70:6803/1400583716","heartbeat_back_addr":"172.21.15.70:6807/1400583716","heartbeat_front_addr":"172.21.15.70:6805/1400583716","state":["exists","up"]},{"osd":3,"uuid":"af49398a-e171-496b-a50e-1f767fc42923","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6811","nonce":1647468379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6813","nonce":1647468379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6817","nonce":1647468379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6815","nonce":1647468379}]},"public_addr":"172.21.15.5:6811/1647468379","cluster_addr":"172.21.15.5:6813/1647468379","heartbeat_back_addr":"172.21.15.5:6817/1647468379","heartbeat_front_addr":"172.21.15.5:6815/1647468379","state":["exists","up"]},{"osd":4,"uuid":"59b847ef-6eb0-4c13-aa06-53a76d77ce45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6809","nonce":2314546877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6811","nonce":2314546877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6815","nonce":2314546877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6813","nonce":2314546877}]},"public_addr":"172.21.15.50:6809/2314546877","cluster_addr":"172.21.15.50:6811/2314546877","heartbeat_back_addr":"172.21.15.50:6815/2314546877","heartbeat_front_addr":"172.21.15.50:6813/2314546877","state":["exists","up"]},{"osd":5,"uuid":"b0dac185-4462-4760-aa36-0d221923b007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6809","nonce":311426299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6811","nonce":311426299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6815","nonce":311426299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6813","nonce":311426299}]},"public_addr":"172.21.15.70:6809/311426299","cluster_addr":"172.21.15.70:6811/311426299","heartbeat_back_addr":"172.21.15.70:6815/311426299","heartbeat_front_addr":"172.21.15.70:6813/311426299","state":["exists","up"]},{"osd":6,"uuid":"12486aa2-61e4-4bdf-94dd-ce5c4cd3df6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6819","nonce":1027645612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6821","nonce":1027645612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6825","nonce":1027645612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6823","nonce":1027645612}]},"public_addr":"172.21.15.5:6819/1027645612","cluster_addr":"172.21.15.5:6821/1027645612","heartbeat_back_addr":"172.21.15.5:6825/1027645612","heartbeat_front_addr":"172.21.15.5:6823/1027645612","state":["exists","up"]},{"osd":7,"uuid":"66f9dcf9-d5c3-4016-812f-d9496e9892d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6817","nonce":2718354517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6819","nonce":2718354517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6823","nonce":2718354517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6821","nonce":2718354517}]},"public_addr":"172.21.15.50:6817/2718354517","cluster_addr":"172.21.15.50:6819/2718354517","heartbeat_back_addr":"172.21.15.50:6823/2718354517","heartbeat_front_addr":"172.21.15.50:6821/2718354517","state":["exists","up"]},{"osd":8,"uuid":"584837f9-af4b-4189-a7e5-04156a94a805","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6817","nonce":3155722993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6819","nonce":3155722993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6823","nonce":3155722993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6821","nonce":3155722993}]},"public_addr":"172.21.15.70:6817/3155722993","cluster_addr":"172.21.15.70:6819/3155722993","heartbeat_back_addr":"172.21.15.70:6823/3155722993","heartbeat_front_addr":"172.21.15.70:6821/3155722993","state":["exists","up"]},{"osd":9,"uuid":"ef60de6e-3456-435c-bd48-ed2636cc0d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6827","nonce":2988145512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6829","nonce":2988145512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6833","nonce":2988145512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6831","nonce":2988145512}]},"public_addr":"172.21.15.5:6827/2988145512","cluster_addr":"172.21.15.5:6829/2988145512","heartbeat_back_addr":"172.21.15.5:6833/2988145512","heartbeat_front_addr":"172.21.15.5:6831/2988145512","state":["exists","up"]},{"osd":10,"uuid":"96c5de40-53df-412d-9501-8ce1711a76a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6825","nonce":4168871229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6827","nonce":4168871229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6831","nonce":4168871229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6829","nonce":4168871229}]},"public_addr":"172.21.15.50:6825/4168871229","cluster_addr":"172.21.15.50:6827/4168871229","heartbeat_back_addr":"172.21.15.50:6831/4168871229","heartbeat_front_addr":"172.21.15.50:6829/4168871229","state":["exists","up"]},{"osd":11,"uuid":"20beefe0-59c3-4392-9f61-8d215e9d2de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6825","nonce":2593470535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6827","nonce":2593470535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6831","nonce":2593470535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6829","nonce":2593470535}]},"public_addr":"172.21.15.70:6825/2593470535","cluster_addr":"172.21.15.70:6827/2593470535","heartbeat_back_addr":"172.21.15.70:6831/2593470535","heartbeat_front_addr":"172.21.15.70:6829/2593470535","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:21:56.748083+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:22:21.969492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:22:46.642917+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:23:11.630486+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:23:36.389322+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:24:01.431039+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:24:27.057017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:24:53.628200+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:25:19.356502+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:25:44.958024+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:26:10.804919+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:26:36.849133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":5,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:0/2473024253":"2024-09-01T05:20:57.333680+0000","172.21.15.5:0/2924148490":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/2163558485":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/2111919168":"2024-09-01T05:19:55.663503+0000","172.21.15.5:6801/3616278616":"2024-09-01T05:19:55.663503+0000","172.21.15.5:0/2436421090":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/1570244689":"2024-09-01T05:19:55.663503+0000","172.21.15.5:0/2700448223":"2024-09-01T05:20:57.333680+0000","172.21.15.5:6800/3616278616":"2024-09-01T05:19:55.663503+0000","172.21.15.5:6800/2898463711":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/2450461036":"2024-09-01T05:20:57.333680+0000","172.21.15.5:0/1947189952":"2024-09-01T05:19:55.663503+0000","172.21.15.5:6800/1439868821":"2024-09-01T05:20:57.333680+0000","172.21.15.5:6801/2898463711":"2024-09-01T05:19:31.728664+0000","172.21.15.5:6801/1439868821":"2024-09-01T05:20:57.333680+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":10,"length":1},{"begin":23,"length":1}]},{"pool":4,"snaps":[{"begin":10,"length":1},{"begin":23,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T05:44:23.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.793+0000 7f29b800e640 1 -- 172.21.15.5:0/923767249 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f299c0b4c90 msgr2=0x7f299c0b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:23.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.793+0000 7f29b800e640 1 --2- 172.21.15.5:0/923767249 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f299c0b4c90 0x7f299c0b71a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f29b0069bf0 tx=0x7f29a0000bc0 comp rx=0 tx=0).stop 2024-08-31T05:44:23.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.793+0000 7f29b800e640 1 -- 172.21.15.5:0/923767249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29b0102ef0 msgr2=0x7f29b019c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:23.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.793+0000 7f29b800e640 1 --2- 172.21.15.5:0/923767249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29b0102ef0 0x7f29b019c390 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f29ac00e9f0 tx=0x7f29ac00edf0 comp rx=0 tx=0).stop 2024-08-31T05:44:23.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.793+0000 7f29b800e640 1 -- 172.21.15.5:0/923767249 shutdown_connections 2024-08-31T05:44:23.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.793+0000 7f29b800e640 1 --2- 172.21.15.5:0/923767249 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f299c0b4c90 0x7f299c0b71a0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:23.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.793+0000 7f29b800e640 1 --2- 172.21.15.5:0/923767249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f29b0108a00 0x7f29b01a1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:23.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.793+0000 7f29b800e640 1 --2- 172.21.15.5:0/923767249 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29b01080b0 0x7f29b019c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:23.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.793+0000 7f29b800e640 1 --2- 172.21.15.5:0/923767249 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f29b0102ef0 0x7f29b019c390 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:23.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.793+0000 7f29b800e640 1 -- 172.21.15.5:0/923767249 >> 172.21.15.5:0/923767249 conn(0x7f29b0079c10 msgr2=0x7f29b0104080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:23.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.793+0000 7f29b800e640 1 -- 172.21.15.5:0/923767249 shutdown_connections 2024-08-31T05:44:23.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.793+0000 7f29b800e640 1 -- 172.21.15.5:0/923767249 wait complete. 2024-08-31T05:44:23.808 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-31T05:22:49.802575+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-31T05:27:27.835197+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-31T05:27:30.058144+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '102', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 23, 'snap_epoch': 102, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-08-31T05:27:36.272228+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '102', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 23, 'snap_epoch': 102, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-31T05:44:23.809 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-31T05:44:23.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.920+0000 7fc8d1469640 1 -- 172.21.15.5:0/131007534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8cc1089f0 msgr2=0x7fc8cc10f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:23.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.920+0000 7fc8d1469640 1 --2- 172.21.15.5:0/131007534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8cc1089f0 0x7fc8cc10f220 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4009ca0 tx=0x7fc8c402a8c0 comp rx=0 tx=0).stop 2024-08-31T05:44:23.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.920+0000 7fc8d1469640 1 -- 172.21.15.5:0/131007534 shutdown_connections 2024-08-31T05:44:23.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.920+0000 7fc8d1469640 1 --2- 172.21.15.5:0/131007534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8cc1089f0 0x7fc8cc10f220 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:23.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.920+0000 7fc8d1469640 1 --2- 172.21.15.5:0/131007534 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8cc1080a0 0x7fc8cc1084b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:23.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.920+0000 7fc8d1469640 1 --2- 172.21.15.5:0/131007534 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8cc102770 0x7fc8cc102b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:23.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.920+0000 7fc8d1469640 1 -- 172.21.15.5:0/131007534 >> 172.21.15.5:0/131007534 conn(0x7fc8cc0fe190 msgr2=0x7fc8cc1005e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:23.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.920+0000 7fc8d1469640 1 -- 172.21.15.5:0/131007534 shutdown_connections 2024-08-31T05:44:23.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.920+0000 7fc8d1469640 1 -- 172.21.15.5:0/131007534 wait complete. 2024-08-31T05:44:23.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.921+0000 7fc8d1469640 1 Processor -- start 2024-08-31T05:44:23.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.921+0000 7fc8d1469640 1 -- start start 2024-08-31T05:44:23.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.921+0000 7fc8d1469640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8cc102770 0x7fc8cc10fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:23.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.921+0000 7fc8d1469640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8cc1080a0 0x7fc8cc110240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:23.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.921+0000 7fc8d1469640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8cc1089f0 0x7fc8cc110780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:23.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.921+0000 7fc8d1469640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc8cc1137d0 con 0x7fc8cc1089f0 2024-08-31T05:44:23.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.921+0000 7fc8d1469640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc8cc113650 con 0x7fc8cc102770 2024-08-31T05:44:23.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.921+0000 7fc8d1469640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc8cc113950 con 0x7fc8cc1080a0 2024-08-31T05:44:23.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.922+0000 7fc8cb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8cc1089f0 0x7fc8cc110780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:23.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.922+0000 7fc8cb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8cc1089f0 0x7fc8cc110780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55310/0 (socket says 172.21.15.5:55310) 2024-08-31T05:44:23.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.922+0000 7fc8cb7fe640 1 -- 172.21.15.5:0/2803592835 learned_addr learned my addr 172.21.15.5:0/2803592835 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:44:23.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.922+0000 7fc8caffd640 1 --2- 172.21.15.5:0/2803592835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8cc102770 0x7fc8cc10fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:23.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.922+0000 7fc8ca7fc640 1 --2- 172.21.15.5:0/2803592835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8cc1080a0 0x7fc8cc110240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:23.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.922+0000 7fc8cb7fe640 1 -- 172.21.15.5:0/2803592835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8cc1080a0 msgr2=0x7fc8cc110240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:23.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.922+0000 7fc8cb7fe640 1 --2- 172.21.15.5:0/2803592835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8cc1080a0 0x7fc8cc110240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:23.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.922+0000 7fc8cb7fe640 1 -- 172.21.15.5:0/2803592835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8cc102770 msgr2=0x7fc8cc10fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:23.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.922+0000 7fc8cb7fe640 1 --2- 172.21.15.5:0/2803592835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8cc102770 0x7fc8cc10fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:23.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.922+0000 7fc8cb7fe640 1 -- 172.21.15.5:0/2803592835 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8cc1a83c0 con 0x7fc8cc1089f0 2024-08-31T05:44:23.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.922+0000 7fc8cb7fe640 1 --2- 172.21.15.5:0/2803592835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8cc1089f0 0x7fc8cc110780 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4005cc0 tx=0x7fc8c402f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:23.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.922+0000 7fc8b3fff640 1 -- 172.21.15.5:0/2803592835 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c4003cf0 con 0x7fc8cc1089f0 2024-08-31T05:44:23.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.922+0000 7fc8b3fff640 1 -- 172.21.15.5:0/2803592835 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8c40044f0 con 0x7fc8cc1089f0 2024-08-31T05:44:23.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.922+0000 7fc8b3fff640 1 -- 172.21.15.5:0/2803592835 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c402fd10 con 0x7fc8cc1089f0 2024-08-31T05:44:23.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.922+0000 7fc8d1469640 1 -- 172.21.15.5:0/2803592835 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8cc1a8650 con 0x7fc8cc1089f0 2024-08-31T05:44:23.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.922+0000 7fc8d1469640 1 -- 172.21.15.5:0/2803592835 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8cc1a8ba0 con 0x7fc8cc1089f0 2024-08-31T05:44:23.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.923+0000 7fc8d1469640 1 -- 172.21.15.5:0/2803592835 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8cc1039e0 con 0x7fc8cc1089f0 2024-08-31T05:44:23.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.925+0000 7fc8b3fff640 1 -- 172.21.15.5:0/2803592835 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fc8c4004040 con 0x7fc8cc1089f0 2024-08-31T05:44:23.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.926+0000 7fc8b3fff640 1 --2- 172.21.15.5:0/2803592835 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc8b40b4ca0 0x7fc8b40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:23.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.926+0000 7fc8caffd640 1 --2- 172.21.15.5:0/2803592835 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc8b40b4ca0 0x7fc8b40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:23.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.926+0000 7fc8b3fff640 1 -- 172.21.15.5:0/2803592835 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9511+0+0 (secure 0 0 0) 0x7fc8c4107140 con 0x7fc8cc1089f0 2024-08-31T05:44:23.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.926+0000 7fc8caffd640 1 --2- 172.21.15.5:0/2803592835 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc8b40b4ca0 0x7fc8b40b71b0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc0058c0 tx=0x7fc8bc00a250 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:23.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:23.929+0000 7fc8b3fff640 1 -- 172.21.15.5:0/2803592835 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc8c40cdb50 con 0x7fc8cc1089f0 2024-08-31T05:44:24.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.121+0000 7fc8d1469640 1 -- 172.21.15.5:0/2803592835 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc8cc111000 con 0x7fc8cc1089f0 2024-08-31T05:44:24.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.121+0000 7fc8b3fff640 1 -- 172.21.15.5:0/2803592835 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v103) ==== 93+0+10 (secure 0 0 0) 0x7fc8c40cd450 con 0x7fc8cc1089f0 2024-08-31T05:44:24.125 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-08-31T05:44:24.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.123+0000 7fc8d1469640 1 -- 172.21.15.5:0/2803592835 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc8b40b4ca0 msgr2=0x7fc8b40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:24.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.123+0000 7fc8d1469640 1 --2- 172.21.15.5:0/2803592835 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc8b40b4ca0 0x7fc8b40b71b0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc0058c0 tx=0x7fc8bc00a250 comp rx=0 tx=0).stop 2024-08-31T05:44:24.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.123+0000 7fc8d1469640 1 -- 172.21.15.5:0/2803592835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8cc1089f0 msgr2=0x7fc8cc110780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:24.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.123+0000 7fc8d1469640 1 --2- 172.21.15.5:0/2803592835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8cc1089f0 0x7fc8cc110780 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4005cc0 tx=0x7fc8c402f470 comp rx=0 tx=0).stop 2024-08-31T05:44:24.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.124+0000 7fc8d1469640 1 -- 172.21.15.5:0/2803592835 shutdown_connections 2024-08-31T05:44:24.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.124+0000 7fc8d1469640 1 --2- 172.21.15.5:0/2803592835 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc8b40b4ca0 0x7fc8b40b71b0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:24.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.124+0000 7fc8d1469640 1 --2- 172.21.15.5:0/2803592835 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8cc1089f0 0x7fc8cc110780 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:24.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.124+0000 7fc8d1469640 1 --2- 172.21.15.5:0/2803592835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8cc1080a0 0x7fc8cc110240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:24.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.124+0000 7fc8d1469640 1 --2- 172.21.15.5:0/2803592835 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc8cc102770 0x7fc8cc10fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:24.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.124+0000 7fc8d1469640 1 -- 172.21.15.5:0/2803592835 >> 172.21.15.5:0/2803592835 conn(0x7fc8cc0fe190 msgr2=0x7fc8cc105640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:24.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.124+0000 7fc8d1469640 1 -- 172.21.15.5:0/2803592835 shutdown_connections 2024-08-31T05:44:24.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.124+0000 7fc8d1469640 1 -- 172.21.15.5:0/2803592835 wait complete. 2024-08-31T05:44:24.138 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-31T05:44:24.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.249+0000 7fa0f7607640 1 -- 172.21.15.5:0/2417153836 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0f0104e90 msgr2=0x7fa0f01052a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:24.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.249+0000 7fa0f7607640 1 --2- 172.21.15.5:0/2417153836 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0f0104e90 0x7fa0f01052a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa0e0009900 tx=0x7fa0e002a3f0 comp rx=0 tx=0).stop 2024-08-31T05:44:24.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.249+0000 7fa0f7607640 1 -- 172.21.15.5:0/2417153836 shutdown_connections 2024-08-31T05:44:24.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.249+0000 7fa0f7607640 1 --2- 172.21.15.5:0/2417153836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0f01057e0 0x7fa0f010f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:24.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.249+0000 7fa0f7607640 1 --2- 172.21.15.5:0/2417153836 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0f0104e90 0x7fa0f01052a0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:24.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.249+0000 7fa0f7607640 1 --2- 172.21.15.5:0/2417153836 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0f0102e90 0x7fa0f01032a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:24.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.249+0000 7fa0f7607640 1 -- 172.21.15.5:0/2417153836 >> 172.21.15.5:0/2417153836 conn(0x7fa0f0079af0 msgr2=0x7fa0f0079f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:24.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.249+0000 7fa0f7607640 1 -- 172.21.15.5:0/2417153836 shutdown_connections 2024-08-31T05:44:24.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.249+0000 7fa0f7607640 1 -- 172.21.15.5:0/2417153836 wait complete. 2024-08-31T05:44:24.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.250+0000 7fa0f7607640 1 Processor -- start 2024-08-31T05:44:24.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.250+0000 7fa0f7607640 1 -- start start 2024-08-31T05:44:24.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.250+0000 7fa0f7607640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0f0102e90 0x7fa0f019a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:24.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.250+0000 7fa0f7607640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0f0104e90 0x7fa0f019a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:24.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.250+0000 7fa0f7607640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0f01057e0 0x7fa0f019fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:24.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.250+0000 7fa0f7607640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa0f0113800 con 0x7fa0f01057e0 2024-08-31T05:44:24.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.250+0000 7fa0f7607640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fa0f0113680 con 0x7fa0f0104e90 2024-08-31T05:44:24.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.250+0000 7fa0f7607640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa0f0113980 con 0x7fa0f0102e90 2024-08-31T05:44:24.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.250+0000 7fa0f5ba4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0f01057e0 0x7fa0f019fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:24.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.250+0000 7fa0f5ba4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0f01057e0 0x7fa0f019fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55338/0 (socket says 172.21.15.5:55338) 2024-08-31T05:44:24.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.250+0000 7fa0f5ba4640 1 -- 172.21.15.5:0/3247228446 learned_addr learned my addr 172.21.15.5:0/3247228446 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:44:24.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.250+0000 7fa0f4ba2640 1 --2- 172.21.15.5:0/3247228446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0f0104e90 0x7fa0f019a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:24.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.251+0000 7fa0f53a3640 1 --2- 172.21.15.5:0/3247228446 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0f0102e90 0x7fa0f019a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:24.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.251+0000 7fa0f5ba4640 1 -- 172.21.15.5:0/3247228446 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0f0102e90 msgr2=0x7fa0f019a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:24.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.251+0000 7fa0f5ba4640 1 --2- 172.21.15.5:0/3247228446 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0f0102e90 0x7fa0f019a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:24.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.251+0000 7fa0f5ba4640 1 -- 172.21.15.5:0/3247228446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0f0104e90 msgr2=0x7fa0f019a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:24.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.251+0000 7fa0f5ba4640 1 --2- 172.21.15.5:0/3247228446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0f0104e90 0x7fa0f019a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:24.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.251+0000 7fa0f5ba4640 1 -- 172.21.15.5:0/3247228446 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0f01a0110 con 0x7fa0f01057e0 2024-08-31T05:44:24.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.251+0000 7fa0f53a3640 1 --2- 172.21.15.5:0/3247228446 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0f0102e90 0x7fa0f019a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:44:24.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.251+0000 7fa0f5ba4640 1 --2- 172.21.15.5:0/3247228446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0f01057e0 0x7fa0f019fa10 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fa0e800efd0 tx=0x7fa0e800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:24.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.251+0000 7fa0e67fc640 1 -- 172.21.15.5:0/3247228446 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e8003b70 con 0x7fa0f01057e0 2024-08-31T05:44:24.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.251+0000 7fa0f7607640 1 -- 172.21.15.5:0/3247228446 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0f01a0400 con 0x7fa0f01057e0 2024-08-31T05:44:24.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.251+0000 7fa0e67fc640 1 -- 172.21.15.5:0/3247228446 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0e8003d10 con 0x7fa0f01057e0 2024-08-31T05:44:24.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.251+0000 7fa0e67fc640 1 -- 172.21.15.5:0/3247228446 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e80108a0 con 0x7fa0f01057e0 2024-08-31T05:44:24.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.251+0000 7fa0f7607640 1 -- 172.21.15.5:0/3247228446 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0f01a6b90 con 0x7fa0f01057e0 2024-08-31T05:44:24.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.252+0000 7fa0f7607640 1 -- 172.21.15.5:0/3247228446 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0f0103c00 con 0x7fa0f01057e0 2024-08-31T05:44:24.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.254+0000 7fa0e67fc640 1 -- 172.21.15.5:0/3247228446 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fa0e8004b40 con 0x7fa0f01057e0 2024-08-31T05:44:24.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.255+0000 7fa0e67fc640 1 --2- 172.21.15.5:0/3247228446 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa0dc0b4ca0 0x7fa0dc0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:24.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.255+0000 7fa0f53a3640 1 --2- 172.21.15.5:0/3247228446 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa0dc0b4ca0 0x7fa0dc0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:24.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.255+0000 7fa0e67fc640 1 -- 172.21.15.5:0/3247228446 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9511+0+0 (secure 0 0 0) 0x7fa0e80e6250 con 0x7fa0f01057e0 2024-08-31T05:44:24.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.255+0000 7fa0f53a3640 1 --2- 172.21.15.5:0/3247228446 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa0dc0b4ca0 0x7fa0dc0b71b0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec009c20 tx=0x7fa0ec005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:24.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.258+0000 7fa0e67fc640 1 -- 172.21.15.5:0/3247228446 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa0e80acc00 con 0x7fa0f01057e0 2024-08-31T05:44:24.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:44:24 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/923767249' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T05:44:24.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.442+0000 7fa0f7607640 1 -- 172.21.15.5:0/3247228446 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa0f002e430 con 0x7fa0f01057e0 2024-08-31T05:44:24.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.443+0000 7fa0e67fc640 1 -- 172.21.15.5:0/3247228446 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v103) ==== 104+0+11 (secure 0 0 0) 0x7fa0e80ac500 con 0x7fa0f01057e0 2024-08-31T05:44:24.446 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-08-31T05:44:24.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.445+0000 7fa0f7607640 1 -- 172.21.15.5:0/3247228446 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa0dc0b4ca0 msgr2=0x7fa0dc0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:24.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.445+0000 7fa0f7607640 1 --2- 172.21.15.5:0/3247228446 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa0dc0b4ca0 0x7fa0dc0b71b0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec009c20 tx=0x7fa0ec005f90 comp rx=0 tx=0).stop 2024-08-31T05:44:24.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.445+0000 7fa0f7607640 1 -- 172.21.15.5:0/3247228446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0f01057e0 msgr2=0x7fa0f019fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:24.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.445+0000 7fa0f7607640 1 --2- 172.21.15.5:0/3247228446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0f01057e0 0x7fa0f019fa10 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fa0e800efd0 tx=0x7fa0e800c6a0 comp rx=0 tx=0).stop 2024-08-31T05:44:24.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.445+0000 7fa0f7607640 1 -- 172.21.15.5:0/3247228446 shutdown_connections 2024-08-31T05:44:24.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.445+0000 7fa0f7607640 1 --2- 172.21.15.5:0/3247228446 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fa0dc0b4ca0 0x7fa0dc0b71b0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:24.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.445+0000 7fa0f7607640 1 --2- 172.21.15.5:0/3247228446 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0f01057e0 0x7fa0f019fa10 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:24.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.445+0000 7fa0f7607640 1 --2- 172.21.15.5:0/3247228446 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fa0f0104e90 0x7fa0f019a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:24.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.445+0000 7fa0f7607640 1 --2- 172.21.15.5:0/3247228446 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0f0102e90 0x7fa0f019a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:24.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.445+0000 7fa0f7607640 1 -- 172.21.15.5:0/3247228446 >> 172.21.15.5:0/3247228446 conn(0x7fa0f0079af0 msgr2=0x7fa0f006a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:24.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.445+0000 7fa0f7607640 1 -- 172.21.15.5:0/3247228446 shutdown_connections 2024-08-31T05:44:24.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.445+0000 7fa0f7607640 1 -- 172.21.15.5:0/3247228446 wait complete. 2024-08-31T05:44:24.459 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:44:24 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/923767249' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T05:44:24.460 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-31T05:44:24.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.573+0000 7f1ee6d58640 1 -- 172.21.15.5:0/809167948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ee0108090 msgr2=0x7f1ee01084a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:24.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.573+0000 7f1ee6d58640 1 --2- 172.21.15.5:0/809167948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ee0108090 0x7f1ee01084a0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f1ed0009900 tx=0x7f1ed002a410 comp rx=0 tx=0).stop 2024-08-31T05:44:24.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.573+0000 7f1ee6d58640 1 -- 172.21.15.5:0/809167948 shutdown_connections 2024-08-31T05:44:24.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.573+0000 7f1ee6d58640 1 --2- 172.21.15.5:0/809167948 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ee01089e0 0x7f1ee010f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:24.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.573+0000 7f1ee6d58640 1 --2- 172.21.15.5:0/809167948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ee0108090 0x7f1ee01084a0 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:24.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.573+0000 7f1ee6d58640 1 --2- 172.21.15.5:0/809167948 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ee0102760 0x7f1ee0102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:24.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.573+0000 7f1ee6d58640 1 -- 172.21.15.5:0/809167948 >> 172.21.15.5:0/809167948 conn(0x7f1ee00fe140 msgr2=0x7f1ee0100590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:24.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.573+0000 7f1ee6d58640 1 -- 172.21.15.5:0/809167948 shutdown_connections 2024-08-31T05:44:24.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.573+0000 7f1ee6d58640 1 -- 172.21.15.5:0/809167948 wait complete. 2024-08-31T05:44:24.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.573+0000 7f1ee6d58640 1 Processor -- start 2024-08-31T05:44:24.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.574+0000 7f1ee6d58640 1 -- start start 2024-08-31T05:44:24.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.574+0000 7f1ee6d58640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ee0102760 0x7f1ee019afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:24.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.574+0000 7f1ee6d58640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ee0108090 0x7f1ee019b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:24.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.574+0000 7f1ee6d58640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ee01089e0 0x7f1ee019ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:24.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.574+0000 7f1ee6d58640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee0112670 con 0x7f1ee0102760 2024-08-31T05:44:24.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.574+0000 7f1ee6d58640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee01124f0 con 0x7f1ee0108090 2024-08-31T05:44:24.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.574+0000 7f1ee6d58640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee01127f0 con 0x7f1ee01089e0 2024-08-31T05:44:24.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.574+0000 7f1ee4af4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ee0102760 0x7f1ee019afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:24.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.574+0000 7f1ee4af4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ee0102760 0x7f1ee019afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55350/0 (socket says 172.21.15.5:55350) 2024-08-31T05:44:24.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.574+0000 7f1ee4af4640 1 -- 172.21.15.5:0/2749653713 learned_addr learned my addr 172.21.15.5:0/2749653713 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:44:24.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.574+0000 7f1ed7fff640 1 --2- 172.21.15.5:0/2749653713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ee0108090 0x7f1ee019b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:24.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.574+0000 7f1ee52f5640 1 --2- 172.21.15.5:0/2749653713 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ee01089e0 0x7f1ee019ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:24.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.574+0000 7f1ee4af4640 1 -- 172.21.15.5:0/2749653713 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ee01089e0 msgr2=0x7f1ee019ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:24.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.574+0000 7f1ee4af4640 1 --2- 172.21.15.5:0/2749653713 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ee01089e0 0x7f1ee019ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:24.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.574+0000 7f1ee4af4640 1 -- 172.21.15.5:0/2749653713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ee0108090 msgr2=0x7f1ee019b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:24.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.574+0000 7f1ee4af4640 1 --2- 172.21.15.5:0/2749653713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ee0108090 0x7f1ee019b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:24.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.574+0000 7f1ee4af4640 1 -- 172.21.15.5:0/2749653713 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ee01a62a0 con 0x7f1ee0102760 2024-08-31T05:44:24.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.574+0000 7f1ee4af4640 1 --2- 172.21.15.5:0/2749653713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ee0102760 0x7f1ee019afe0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f1edc00d770 tx=0x7f1edc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:24.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.575+0000 7f1ed5ffb640 1 -- 172.21.15.5:0/2749653713 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1edc017070 con 0x7f1ee0102760 2024-08-31T05:44:24.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.575+0000 7f1ed5ffb640 1 -- 172.21.15.5:0/2749653713 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1edc0054d0 con 0x7f1ee0102760 2024-08-31T05:44:24.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.575+0000 7f1ee6d58640 1 -- 172.21.15.5:0/2749653713 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ee01a6590 con 0x7f1ee0102760 2024-08-31T05:44:24.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.575+0000 7f1ed5ffb640 1 -- 172.21.15.5:0/2749653713 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1edc004c30 con 0x7f1ee0102760 2024-08-31T05:44:24.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.575+0000 7f1ee6d58640 1 -- 172.21.15.5:0/2749653713 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ee01a6ab0 con 0x7f1ee0102760 2024-08-31T05:44:24.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.576+0000 7f1ee6d58640 1 -- 172.21.15.5:0/2749653713 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ee0102b70 con 0x7f1ee0102760 2024-08-31T05:44:24.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.578+0000 7f1ed5ffb640 1 -- 172.21.15.5:0/2749653713 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f1edc004dd0 con 0x7f1ee0102760 2024-08-31T05:44:24.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.578+0000 7f1ed5ffb640 1 --2- 172.21.15.5:0/2749653713 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f1ec80b4d20 0x7f1ec80b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:24.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.578+0000 7f1ed7fff640 1 --2- 172.21.15.5:0/2749653713 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f1ec80b4d20 0x7f1ec80b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:24.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.578+0000 7f1ed5ffb640 1 -- 172.21.15.5:0/2749653713 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9511+0+0 (secure 0 0 0) 0x7f1edc0e56a0 con 0x7f1ee0102760 2024-08-31T05:44:24.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.579+0000 7f1ed7fff640 1 --2- 172.21.15.5:0/2749653713 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f1ec80b4d20 0x7f1ec80b7230 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f1ed0009230 tx=0x7f1ed0031400 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:24.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.582+0000 7f1ed5ffb640 1 -- 172.21.15.5:0/2749653713 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f1edc0abae0 con 0x7f1ee0102760 2024-08-31T05:44:24.585 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:44:24 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/923767249' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T05:44:24.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.767+0000 7f1ee6d58640 1 -- 172.21.15.5:0/2749653713 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f1ee010a790 con 0x7f1ee0102760 2024-08-31T05:44:24.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.768+0000 7f1ed5ffb640 1 -- 172.21.15.5:0/2749653713 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v103) ==== 100+0+11 (secure 0 0 0) 0x7f1edc0e50a0 con 0x7f1ee0102760 2024-08-31T05:44:24.771 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-08-31T05:44:24.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.770+0000 7f1ee6d58640 1 -- 172.21.15.5:0/2749653713 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f1ec80b4d20 msgr2=0x7f1ec80b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:24.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.770+0000 7f1ee6d58640 1 --2- 172.21.15.5:0/2749653713 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f1ec80b4d20 0x7f1ec80b7230 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f1ed0009230 tx=0x7f1ed0031400 comp rx=0 tx=0).stop 2024-08-31T05:44:24.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.770+0000 7f1ee6d58640 1 -- 172.21.15.5:0/2749653713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ee0102760 msgr2=0x7f1ee019afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:24.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.770+0000 7f1ee6d58640 1 --2- 172.21.15.5:0/2749653713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ee0102760 0x7f1ee019afe0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f1edc00d770 tx=0x7f1edc00dc30 comp rx=0 tx=0).stop 2024-08-31T05:44:24.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.770+0000 7f1ee6d58640 1 -- 172.21.15.5:0/2749653713 shutdown_connections 2024-08-31T05:44:24.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.770+0000 7f1ee6d58640 1 --2- 172.21.15.5:0/2749653713 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f1ec80b4d20 0x7f1ec80b7230 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:24.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.770+0000 7f1ee6d58640 1 --2- 172.21.15.5:0/2749653713 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ee01089e0 0x7f1ee019ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:24.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.770+0000 7f1ee6d58640 1 --2- 172.21.15.5:0/2749653713 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f1ee0108090 0x7f1ee019b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:24.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.770+0000 7f1ee6d58640 1 --2- 172.21.15.5:0/2749653713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ee0102760 0x7f1ee019afe0 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:24.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.770+0000 7f1ee6d58640 1 -- 172.21.15.5:0/2749653713 >> 172.21.15.5:0/2749653713 conn(0x7f1ee00fe140 msgr2=0x7f1ee0101540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:24.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.770+0000 7f1ee6d58640 1 -- 172.21.15.5:0/2749653713 shutdown_connections 2024-08-31T05:44:24.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.770+0000 7f1ee6d58640 1 -- 172.21.15.5:0/2749653713 wait complete. 2024-08-31T05:44:24.785 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-08-31T05:44:24.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.896+0000 7f3a6044a640 1 -- 172.21.15.5:0/2827943086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a58102ef0 msgr2=0x7f3a58103300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:24.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.896+0000 7f3a6044a640 1 --2- 172.21.15.5:0/2827943086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a58102ef0 0x7f3a58103300 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f3a54009930 tx=0x7f3a5402a420 comp rx=0 tx=0).stop 2024-08-31T05:44:24.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.896+0000 7f3a6044a640 1 -- 172.21.15.5:0/2827943086 shutdown_connections 2024-08-31T05:44:24.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.896+0000 7f3a6044a640 1 --2- 172.21.15.5:0/2827943086 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a58105800 0x7f3a5810f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:24.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.896+0000 7f3a6044a640 1 --2- 172.21.15.5:0/2827943086 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a58104eb0 0x7f3a581052c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:24.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.896+0000 7f3a6044a640 1 --2- 172.21.15.5:0/2827943086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a58102ef0 0x7f3a58103300 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:24.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.896+0000 7f3a6044a640 1 -- 172.21.15.5:0/2827943086 >> 172.21.15.5:0/2827943086 conn(0x7f3a58079af0 msgr2=0x7f3a58079f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:24.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.896+0000 7f3a6044a640 1 -- 172.21.15.5:0/2827943086 shutdown_connections 2024-08-31T05:44:24.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.896+0000 7f3a6044a640 1 -- 172.21.15.5:0/2827943086 wait complete. 2024-08-31T05:44:24.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.896+0000 7f3a6044a640 1 Processor -- start 2024-08-31T05:44:24.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.896+0000 7f3a6044a640 1 -- start start 2024-08-31T05:44:24.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.897+0000 7f3a6044a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a58102ef0 0x7f3a581990a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:24.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.897+0000 7f3a6044a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a58104eb0 0x7f3a58199640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:24.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.897+0000 7f3a6044a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a58105800 0x7f3a5819e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:24.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.897+0000 7f3a6044a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3a58112720 con 0x7f3a58104eb0 2024-08-31T05:44:24.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.897+0000 7f3a6044a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f3a581125a0 con 0x7f3a58102ef0 2024-08-31T05:44:24.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.897+0000 7f3a6044a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3a581128a0 con 0x7f3a58105800 2024-08-31T05:44:24.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.897+0000 7f3a5d9e5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a58104eb0 0x7f3a58199640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:24.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.897+0000 7f3a5d9e5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a58104eb0 0x7f3a58199640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55382/0 (socket says 172.21.15.5:55382) 2024-08-31T05:44:24.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.897+0000 7f3a5d9e5640 1 -- 172.21.15.5:0/2293023022 learned_addr learned my addr 172.21.15.5:0/2293023022 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:44:24.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.897+0000 7f3a5e9e7640 1 --2- 172.21.15.5:0/2293023022 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a58105800 0x7f3a5819e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:24.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.897+0000 7f3a5e1e6640 1 --2- 172.21.15.5:0/2293023022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a58102ef0 0x7f3a581990a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:24.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.897+0000 7f3a5d9e5640 1 -- 172.21.15.5:0/2293023022 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a58105800 msgr2=0x7f3a5819e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:24.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.897+0000 7f3a5d9e5640 1 --2- 172.21.15.5:0/2293023022 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a58105800 0x7f3a5819e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:24.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.897+0000 7f3a5d9e5640 1 -- 172.21.15.5:0/2293023022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a58102ef0 msgr2=0x7f3a581990a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:24.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.897+0000 7f3a5d9e5640 1 --2- 172.21.15.5:0/2293023022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a58102ef0 0x7f3a581990a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:24.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.897+0000 7f3a5d9e5640 1 -- 172.21.15.5:0/2293023022 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a5819efd0 con 0x7f3a58104eb0 2024-08-31T05:44:24.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.897+0000 7f3a5e1e6640 1 --2- 172.21.15.5:0/2293023022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a58102ef0 0x7f3a581990a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:44:24.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.897+0000 7f3a5d9e5640 1 --2- 172.21.15.5:0/2293023022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a58104eb0 0x7f3a58199640 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c005fd0 tx=0x7f3a4c00dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:24.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.898+0000 7f3a4b7fe640 1 -- 172.21.15.5:0/2293023022 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a4c017070 con 0x7f3a58104eb0 2024-08-31T05:44:24.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.898+0000 7f3a4b7fe640 1 -- 172.21.15.5:0/2293023022 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a4c009c30 con 0x7f3a58104eb0 2024-08-31T05:44:24.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.898+0000 7f3a4b7fe640 1 -- 172.21.15.5:0/2293023022 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a4c003d30 con 0x7f3a58104eb0 2024-08-31T05:44:24.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.898+0000 7f3a6044a640 1 -- 172.21.15.5:0/2293023022 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a5819f2c0 con 0x7f3a58104eb0 2024-08-31T05:44:24.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.898+0000 7f3a6044a640 1 -- 172.21.15.5:0/2293023022 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a581a5a50 con 0x7f3a58104eb0 2024-08-31T05:44:24.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.899+0000 7f3a6044a640 1 -- 172.21.15.5:0/2293023022 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a5819a1c0 con 0x7f3a58104eb0 2024-08-31T05:44:24.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.900+0000 7f3a4b7fe640 1 -- 172.21.15.5:0/2293023022 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f3a4c003ed0 con 0x7f3a58104eb0 2024-08-31T05:44:24.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.901+0000 7f3a4b7fe640 1 --2- 172.21.15.5:0/2293023022 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f3a440b4ca0 0x7f3a440b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:24.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.901+0000 7f3a4b7fe640 1 -- 172.21.15.5:0/2293023022 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9511+0+0 (secure 0 0 0) 0x7f3a4c0e5e40 con 0x7f3a58104eb0 2024-08-31T05:44:24.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.901+0000 7f3a5e1e6640 1 --2- 172.21.15.5:0/2293023022 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f3a440b4ca0 0x7f3a440b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:24.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.902+0000 7f3a5e1e6640 1 --2- 172.21.15.5:0/2293023022 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f3a440b4ca0 0x7f3a440b71b0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f3a54005ab0 tx=0x7f3a54005fd0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:24.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:24.904+0000 7f3a4b7fe640 1 -- 172.21.15.5:0/2293023022 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f3a4c020030 con 0x7f3a58104eb0 2024-08-31T05:44:25.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.133+0000 7f3a6044a640 1 -- 172.21.15.5:0/2293023022 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f3a5802e430 con 0x7f3a58104eb0 2024-08-31T05:44:25.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.134+0000 7f3a4b7fe640 1 -- 172.21.15.5:0/2293023022 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v103) ==== 103+0+11 (secure 0 0 0) 0x7f3a4c009de0 con 0x7f3a58104eb0 2024-08-31T05:44:25.137 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-08-31T05:44:25.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.136+0000 7f3a6044a640 1 -- 172.21.15.5:0/2293023022 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f3a440b4ca0 msgr2=0x7f3a440b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:25.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.136+0000 7f3a6044a640 1 --2- 172.21.15.5:0/2293023022 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f3a440b4ca0 0x7f3a440b71b0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f3a54005ab0 tx=0x7f3a54005fd0 comp rx=0 tx=0).stop 2024-08-31T05:44:25.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.136+0000 7f3a6044a640 1 -- 172.21.15.5:0/2293023022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a58104eb0 msgr2=0x7f3a58199640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:25.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.136+0000 7f3a6044a640 1 --2- 172.21.15.5:0/2293023022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a58104eb0 0x7f3a58199640 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c005fd0 tx=0x7f3a4c00dde0 comp rx=0 tx=0).stop 2024-08-31T05:44:25.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.136+0000 7f3a6044a640 1 -- 172.21.15.5:0/2293023022 shutdown_connections 2024-08-31T05:44:25.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.136+0000 7f3a6044a640 1 --2- 172.21.15.5:0/2293023022 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f3a440b4ca0 0x7f3a440b71b0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:25.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.136+0000 7f3a6044a640 1 --2- 172.21.15.5:0/2293023022 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a58105800 0x7f3a5819e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:25.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.136+0000 7f3a6044a640 1 --2- 172.21.15.5:0/2293023022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3a58104eb0 0x7f3a58199640 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:25.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.136+0000 7f3a6044a640 1 --2- 172.21.15.5:0/2293023022 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f3a58102ef0 0x7f3a581990a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:25.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.136+0000 7f3a6044a640 1 -- 172.21.15.5:0/2293023022 >> 172.21.15.5:0/2293023022 conn(0x7f3a58079af0 msgr2=0x7f3a58106ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:25.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.136+0000 7f3a6044a640 1 -- 172.21.15.5:0/2293023022 shutdown_connections 2024-08-31T05:44:25.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.136+0000 7f3a6044a640 1 -- 172.21.15.5:0/2293023022 wait complete. 2024-08-31T05:44:25.151 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-08-31T05:44:25.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.259+0000 7fc52631a640 1 -- 172.21.15.5:0/2748466214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5201068c0 msgr2=0x7fc520110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:25.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.259+0000 7fc52631a640 1 --2- 172.21.15.5:0/2748466214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5201068c0 0x7fc520110330 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fc518009be0 tx=0x7fc51802a6c0 comp rx=0 tx=0).stop 2024-08-31T05:44:25.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.259+0000 7fc52631a640 1 -- 172.21.15.5:0/2748466214 shutdown_connections 2024-08-31T05:44:25.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.259+0000 7fc52631a640 1 --2- 172.21.15.5:0/2748466214 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5201068c0 0x7fc520110330 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:25.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.259+0000 7fc52631a640 1 --2- 172.21.15.5:0/2748466214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc520105f70 0x7fc520106380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:25.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.259+0000 7fc52631a640 1 --2- 172.21.15.5:0/2748466214 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc52006ba20 0x7fc52006be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:25.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.259+0000 7fc52631a640 1 -- 172.21.15.5:0/2748466214 >> 172.21.15.5:0/2748466214 conn(0x7fc5200784e0 msgr2=0x7fc5200788f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:25.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.259+0000 7fc52631a640 1 -- 172.21.15.5:0/2748466214 shutdown_connections 2024-08-31T05:44:25.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.259+0000 7fc52631a640 1 -- 172.21.15.5:0/2748466214 wait complete. 2024-08-31T05:44:25.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.260+0000 7fc52631a640 1 Processor -- start 2024-08-31T05:44:25.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.260+0000 7fc52631a640 1 -- start start 2024-08-31T05:44:25.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.260+0000 7fc52631a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc52006ba20 0x7fc52019a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:25.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.260+0000 7fc52631a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc520105f70 0x7fc52019a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:25.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.260+0000 7fc52631a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5201068c0 0x7fc52019f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:25.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.260+0000 7fc52631a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc5201137b0 con 0x7fc5201068c0 2024-08-31T05:44:25.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.260+0000 7fc52631a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fc520113630 con 0x7fc520105f70 2024-08-31T05:44:25.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.260+0000 7fc52631a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc520113930 con 0x7fc52006ba20 2024-08-31T05:44:25.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.260+0000 7fc5248b7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5201068c0 0x7fc52019f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:25.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.260+0000 7fc5248b7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5201068c0 0x7fc52019f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55406/0 (socket says 172.21.15.5:55406) 2024-08-31T05:44:25.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.260+0000 7fc5248b7640 1 -- 172.21.15.5:0/1798632048 learned_addr learned my addr 172.21.15.5:0/1798632048 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:44:25.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.260+0000 7fc51ffff640 1 --2- 172.21.15.5:0/1798632048 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc52006ba20 0x7fc52019a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:25.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.260+0000 7fc51f7fe640 1 --2- 172.21.15.5:0/1798632048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc520105f70 0x7fc52019a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:25.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.260+0000 7fc5248b7640 1 -- 172.21.15.5:0/1798632048 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc52006ba20 msgr2=0x7fc52019a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:25.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.260+0000 7fc5248b7640 1 --2- 172.21.15.5:0/1798632048 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc52006ba20 0x7fc52019a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:25.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.260+0000 7fc5248b7640 1 -- 172.21.15.5:0/1798632048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc520105f70 msgr2=0x7fc52019a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:25.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.260+0000 7fc5248b7640 1 --2- 172.21.15.5:0/1798632048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc520105f70 0x7fc52019a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:25.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.260+0000 7fc5248b7640 1 -- 172.21.15.5:0/1798632048 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5201a0060 con 0x7fc5201068c0 2024-08-31T05:44:25.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.260+0000 7fc51f7fe640 1 --2- 172.21.15.5:0/1798632048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc520105f70 0x7fc52019a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:44:25.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.261+0000 7fc5248b7640 1 --2- 172.21.15.5:0/1798632048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5201068c0 0x7fc52019f960 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fc518004af0 tx=0x7fc518003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:25.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.261+0000 7fc51d7fa640 1 -- 172.21.15.5:0/1798632048 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc518041020 con 0x7fc5201068c0 2024-08-31T05:44:25.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.261+0000 7fc51d7fa640 1 -- 172.21.15.5:0/1798632048 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc518003e10 con 0x7fc5201068c0 2024-08-31T05:44:25.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.261+0000 7fc52631a640 1 -- 172.21.15.5:0/1798632048 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5201a02f0 con 0x7fc5201068c0 2024-08-31T05:44:25.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.261+0000 7fc51d7fa640 1 -- 172.21.15.5:0/1798632048 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc518036040 con 0x7fc5201068c0 2024-08-31T05:44:25.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.261+0000 7fc52631a640 1 -- 172.21.15.5:0/1798632048 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5201a6ae0 con 0x7fc5201068c0 2024-08-31T05:44:25.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.262+0000 7fc52631a640 1 -- 172.21.15.5:0/1798632048 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc520104b10 con 0x7fc5201068c0 2024-08-31T05:44:25.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.264+0000 7fc51d7fa640 1 -- 172.21.15.5:0/1798632048 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fc518044020 con 0x7fc5201068c0 2024-08-31T05:44:25.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.264+0000 7fc51d7fa640 1 --2- 172.21.15.5:0/1798632048 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc5080b4ca0 0x7fc5080b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:25.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.265+0000 7fc51ffff640 1 --2- 172.21.15.5:0/1798632048 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc5080b4ca0 0x7fc5080b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:25.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.265+0000 7fc51d7fa640 1 -- 172.21.15.5:0/1798632048 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9511+0+0 (secure 0 0 0) 0x7fc518106640 con 0x7fc5201068c0 2024-08-31T05:44:25.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.265+0000 7fc51ffff640 1 --2- 172.21.15.5:0/1798632048 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc5080b4ca0 0x7fc5080b71b0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fc510009b60 tx=0x7fc510005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:25.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.269+0000 7fc51d7fa640 1 -- 172.21.15.5:0/1798632048 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc51804b020 con 0x7fc5201068c0 2024-08-31T05:44:25.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:44:25 smithi050 ceph-mon[22146]: pgmap v794: 129 pgs: 129 active+clean; 847 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 6.2 MiB/s wr, 329 op/s 2024-08-31T05:44:25.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:44:25 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/2803592835' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-31T05:44:25.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:44:25 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/3247228446' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-31T05:44:25.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:44:25 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/2749653713' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-31T05:44:25.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:44:25 smithi005 ceph-mon[18602]: pgmap v794: 129 pgs: 129 active+clean; 847 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 6.2 MiB/s wr, 329 op/s 2024-08-31T05:44:25.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:44:25 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/2803592835' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-31T05:44:25.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:44:25 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/3247228446' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-31T05:44:25.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:44:25 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/2749653713' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-31T05:44:25.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.504+0000 7fc52631a640 1 -- 172.21.15.5:0/1798632048 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fc52010b8f0 con 0x7fc5201068c0 2024-08-31T05:44:25.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.513+0000 7fc51d7fa640 1 -- 172.21.15.5:0/1798632048 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v26) ==== 81+0+826312 (secure 0 0 0) 0x7fc518030970 con 0x7fc5201068c0 2024-08-31T05:44:25.527 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:44:25.527 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:44:25.527 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 26, 2024-08-31T05:44:25.527 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.527 INFO:teuthology.orchestra.run.smithi005.stdout: "active_gid": 14220, 2024-08-31T05:44:25.528 INFO:teuthology.orchestra.run.smithi005.stdout: "active_name": "x", 2024-08-31T05:44:25.528 INFO:teuthology.orchestra.run.smithi005.stdout: "active_addrs": { 2024-08-31T05:44:25.528 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-31T05:44:25.528 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:25.528 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-31T05:44:25.528 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6800", 2024-08-31T05:44:25.528 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2696053609 2024-08-31T05:44:25.528 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.529 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:25.529 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-08-31T05:44:25.529 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6801", 2024-08-31T05:44:25.529 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2696053609 2024-08-31T05:44:25.529 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:25.529 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-31T05:44:25.529 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.529 INFO:teuthology.orchestra.run.smithi005.stdout: "active_addr": "172.21.15.5:6801/2696053609", 2024-08-31T05:44:25.529 INFO:teuthology.orchestra.run.smithi005.stdout: "active_change": "2024-08-31T05:20:57.333810+0000", 2024-08-31T05:44:25.530 INFO:teuthology.orchestra.run.smithi005.stdout: "active_mgr_features": 4540701547738038271, 2024-08-31T05:44:25.530 INFO:teuthology.orchestra.run.smithi005.stdout: "available": true, 2024-08-31T05:44:25.530 INFO:teuthology.orchestra.run.smithi005.stdout: "standbys": [ 2024-08-31T05:44:25.530 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:25.530 INFO:teuthology.orchestra.run.smithi005.stdout: "gid": 24130, 2024-08-31T05:44:25.530 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "z", 2024-08-31T05:44:25.530 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_features": 4540701547738038271, 2024-08-31T05:44:25.530 INFO:teuthology.orchestra.run.smithi005.stdout: "available_modules": [ 2024-08-31T05:44:25.531 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:25.531 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "alerts", 2024-08-31T05:44:25.531 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:25.531 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:25.531 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:25.531 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2024-08-31T05:44:25.531 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2024-08-31T05:44:25.531 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:25.531 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.532 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.532 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2024-08-31T05:44:25.532 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.532 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.532 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.532 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How frequently to reexamine health status", 2024-08-31T05:44:25.532 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.532 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.533 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.533 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.533 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:25.533 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:25.533 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.533 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.533 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.533 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:25.534 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.534 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.534 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:25.534 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:25.534 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:25.534 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:25.534 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:25.534 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:25.535 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:25.535 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:25.535 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.535 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.535 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.535 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.535 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.535 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:25.535 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:25.536 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.536 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.536 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.536 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:25.536 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.536 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.536 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.536 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.537 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.537 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.537 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.537 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.537 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:25.537 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:25.537 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.537 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.538 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.538 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:25.538 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.538 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.538 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:25.538 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:25.538 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:25.538 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:25.538 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:25.539 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:25.539 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:25.539 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:25.539 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.539 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.539 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.539 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.539 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.540 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:25.540 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:25.540 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.540 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.540 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.540 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:25.540 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.540 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.540 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.541 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.541 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.541 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.541 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.541 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.541 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_destination": { 2024-08-31T05:44:25.541 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_destination", 2024-08-31T05:44:25.541 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.542 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.542 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.542 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:25.542 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.542 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.543 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.543 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Email address to send alerts to", 2024-08-31T05:44:25.543 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.543 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.543 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.543 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.543 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_from_name": { 2024-08-31T05:44:25.543 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_from_name", 2024-08-31T05:44:25.544 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.544 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.544 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.545 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "Ceph", 2024-08-31T05:44:25.545 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.545 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.545 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.545 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Email From: name", 2024-08-31T05:44:25.545 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.545 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.545 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.546 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.546 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_host": { 2024-08-31T05:44:25.546 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_host", 2024-08-31T05:44:25.546 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.546 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.546 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.546 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:25.546 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.547 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.547 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.547 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SMTP server", 2024-08-31T05:44:25.547 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.547 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.547 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.547 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.547 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_password": { 2024-08-31T05:44:25.548 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_password", 2024-08-31T05:44:25.548 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.548 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.548 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.549 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:25.549 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.549 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.550 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.550 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Password to authenticate with", 2024-08-31T05:44:25.550 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.550 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.551 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.551 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.551 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_port": { 2024-08-31T05:44:25.551 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_port", 2024-08-31T05:44:25.552 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:25.552 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.552 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.553 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "465", 2024-08-31T05:44:25.553 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.553 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.553 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.554 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SMTP port", 2024-08-31T05:44:25.554 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.554 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.554 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.555 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.555 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_sender": { 2024-08-31T05:44:25.555 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_sender", 2024-08-31T05:44:25.555 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.555 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.556 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.556 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:25.556 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.556 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.556 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.556 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SMTP envelope sender", 2024-08-31T05:44:25.556 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.556 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.557 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.557 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.557 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_ssl": { 2024-08-31T05:44:25.557 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_ssl", 2024-08-31T05:44:25.557 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.557 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.557 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.558 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:25.558 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.558 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.558 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.558 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use SSL to connect to SMTP server", 2024-08-31T05:44:25.558 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.558 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.558 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.558 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.559 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_user": { 2024-08-31T05:44:25.559 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_user", 2024-08-31T05:44:25.559 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.559 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.559 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.559 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:25.559 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.559 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.560 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.560 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "User to authenticate as", 2024-08-31T05:44:25.560 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.560 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.560 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.560 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.560 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:25.560 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:25.561 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:25.561 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:25.561 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.561 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:25.561 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.561 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.561 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.561 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.562 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.562 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.562 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.562 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:25.562 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:25.562 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.562 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:25.562 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "balancer", 2024-08-31T05:44:25.562 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:25.563 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:25.563 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:25.563 INFO:teuthology.orchestra.run.smithi005.stdout: "active": { 2024-08-31T05:44:25.563 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "active", 2024-08-31T05:44:25.563 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.563 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.563 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.563 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:25.564 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.564 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.564 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.564 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "automatically balance PGs across cluster", 2024-08-31T05:44:25.564 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.564 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.564 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.564 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.564 INFO:teuthology.orchestra.run.smithi005.stdout: "begin_time": { 2024-08-31T05:44:25.565 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "begin_time", 2024-08-31T05:44:25.565 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.565 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.565 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.565 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0000", 2024-08-31T05:44:25.565 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.565 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.565 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.566 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "beginning time of day to automatically balance", 2024-08-31T05:44:25.566 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-31T05:44:25.566 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.566 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.566 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.566 INFO:teuthology.orchestra.run.smithi005.stdout: "begin_weekday": { 2024-08-31T05:44:25.566 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "begin_weekday", 2024-08-31T05:44:25.567 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2024-08-31T05:44:25.567 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.567 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.567 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:25.567 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "0", 2024-08-31T05:44:25.567 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "6", 2024-08-31T05:44:25.567 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.567 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-08-31T05:44:25.567 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-31T05:44:25.568 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.568 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.568 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.568 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_compat_max_iterations": { 2024-08-31T05:44:25.568 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crush_compat_max_iterations", 2024-08-31T05:44:25.568 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2024-08-31T05:44:25.568 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.568 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.569 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "25", 2024-08-31T05:44:25.569 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2024-08-31T05:44:25.569 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "250", 2024-08-31T05:44:25.569 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.569 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-08-31T05:44:25.569 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.569 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.569 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.569 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.570 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_compat_metrics": { 2024-08-31T05:44:25.570 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crush_compat_metrics", 2024-08-31T05:44:25.570 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.570 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.570 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.570 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "pgs,objects,bytes", 2024-08-31T05:44:25.570 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.570 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.571 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.571 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-08-31T05:44:25.571 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-08-31T05:44:25.571 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.571 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.571 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.571 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_compat_step": { 2024-08-31T05:44:25.571 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crush_compat_step", 2024-08-31T05:44:25.571 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-08-31T05:44:25.572 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.572 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.572 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0.5", 2024-08-31T05:44:25.572 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "0.001", 2024-08-31T05:44:25.572 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "0.999", 2024-08-31T05:44:25.572 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.573 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "aggressiveness of optimization", 2024-08-31T05:44:25.573 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-08-31T05:44:25.573 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.573 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.573 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.573 INFO:teuthology.orchestra.run.smithi005.stdout: "end_time": { 2024-08-31T05:44:25.573 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "end_time", 2024-08-31T05:44:25.573 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.573 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.574 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.574 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "2359", 2024-08-31T05:44:25.574 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.574 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.574 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.574 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "ending time of day to automatically balance", 2024-08-31T05:44:25.574 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-31T05:44:25.574 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.575 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.575 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.575 INFO:teuthology.orchestra.run.smithi005.stdout: "end_weekday": { 2024-08-31T05:44:25.575 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "end_weekday", 2024-08-31T05:44:25.575 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2024-08-31T05:44:25.575 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.575 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.575 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:25.575 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "0", 2024-08-31T05:44:25.576 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "6", 2024-08-31T05:44:25.576 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.576 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-08-31T05:44:25.576 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-31T05:44:25.576 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.576 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.577 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.577 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:25.577 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:25.577 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.577 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.577 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.577 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:25.577 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.578 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.578 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:25.578 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:25.578 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:25.578 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:25.578 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:25.578 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:25.579 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:25.579 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:25.579 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.579 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.579 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.579 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.579 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.579 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:25.580 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:25.580 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.580 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.580 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.581 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:25.581 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.581 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.581 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.581 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.582 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.582 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.582 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.582 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.582 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:25.582 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:25.583 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.583 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.583 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.583 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:25.583 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.583 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.583 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:25.583 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:25.584 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:25.584 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:25.584 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:25.584 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:25.584 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:25.584 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:25.584 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.584 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.585 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.585 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.585 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.585 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:25.585 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:25.585 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.586 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.586 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.586 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:25.586 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.586 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.586 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.587 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.587 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.587 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.587 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.588 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.588 INFO:teuthology.orchestra.run.smithi005.stdout: "min_score": { 2024-08-31T05:44:25.588 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "min_score", 2024-08-31T05:44:25.588 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-08-31T05:44:25.589 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.589 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.589 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:25.589 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.590 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.590 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.590 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-08-31T05:44:25.590 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.591 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.591 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.591 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.591 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": { 2024-08-31T05:44:25.592 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mode", 2024-08-31T05:44:25.592 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.592 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.592 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.593 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "upmap", 2024-08-31T05:44:25.593 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.593 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.593 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:25.593 INFO:teuthology.orchestra.run.smithi005.stdout: "crush-compat", 2024-08-31T05:44:25.594 INFO:teuthology.orchestra.run.smithi005.stdout: "none", 2024-08-31T05:44:25.594 INFO:teuthology.orchestra.run.smithi005.stdout: "read", 2024-08-31T05:44:25.594 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap", 2024-08-31T05:44:25.594 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap-read" 2024-08-31T05:44:25.595 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:25.595 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Balancer mode", 2024-08-31T05:44:25.596 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.596 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.597 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.597 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.597 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_ids": { 2024-08-31T05:44:25.598 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pool_ids", 2024-08-31T05:44:25.598 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.598 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.598 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.599 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:25.599 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.599 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.599 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.600 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-08-31T05:44:25.600 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.600 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.600 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.601 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.601 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2024-08-31T05:44:25.601 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2024-08-31T05:44:25.601 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:25.602 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.602 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.602 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2024-08-31T05:44:25.602 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.603 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.603 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.603 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-08-31T05:44:25.603 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.604 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.604 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.604 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.604 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:25.605 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:25.605 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:25.605 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:25.606 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.606 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:25.606 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.606 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.607 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.607 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.607 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.607 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.608 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.608 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.608 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap_max_deviation": { 2024-08-31T05:44:25.609 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "upmap_max_deviation", 2024-08-31T05:44:25.609 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:25.609 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.609 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.610 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2024-08-31T05:44:25.610 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2024-08-31T05:44:25.610 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.610 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.611 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "deviation below which no optimization is attempted", 2024-08-31T05:44:25.611 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-08-31T05:44:25.611 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.611 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.612 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.612 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap_max_optimizations": { 2024-08-31T05:44:25.612 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "upmap_max_optimizations", 2024-08-31T05:44:25.612 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2024-08-31T05:44:25.613 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.613 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.613 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-08-31T05:44:25.613 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.614 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.614 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.614 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-08-31T05:44:25.614 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.615 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.615 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.615 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:25.615 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:25.616 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.616 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:25.616 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephadm", 2024-08-31T05:44:25.617 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:25.617 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:25.617 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:25.617 INFO:teuthology.orchestra.run.smithi005.stdout: "agent_down_multiplier": { 2024-08-31T05:44:25.618 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "agent_down_multiplier", 2024-08-31T05:44:25.618 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-08-31T05:44:25.618 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.618 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.619 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "3.0", 2024-08-31T05:44:25.619 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.619 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.619 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.620 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-08-31T05:44:25.620 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.620 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.621 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.621 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.621 INFO:teuthology.orchestra.run.smithi005.stdout: "agent_refresh_rate": { 2024-08-31T05:44:25.621 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "agent_refresh_rate", 2024-08-31T05:44:25.622 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:25.622 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.622 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.623 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "20", 2024-08-31T05:44:25.623 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.623 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.623 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.623 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-08-31T05:44:25.624 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.624 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.624 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.624 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.624 INFO:teuthology.orchestra.run.smithi005.stdout: "agent_starting_port": { 2024-08-31T05:44:25.624 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "agent_starting_port", 2024-08-31T05:44:25.624 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:25.625 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.625 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.625 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "4721", 2024-08-31T05:44:25.625 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.625 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.625 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.625 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-08-31T05:44:25.625 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.626 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.626 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.626 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.626 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_ptrace": { 2024-08-31T05:44:25.626 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "allow_ptrace", 2024-08-31T05:44:25.626 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.626 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.626 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.627 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:25.627 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.627 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.627 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.627 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-08-31T05:44:25.627 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-08-31T05:44:25.627 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.627 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.628 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.628 INFO:teuthology.orchestra.run.smithi005.stdout: "autotune_interval": { 2024-08-31T05:44:25.628 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "autotune_interval", 2024-08-31T05:44:25.628 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:25.628 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.628 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.628 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2024-08-31T05:44:25.628 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.629 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.629 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.629 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to autotune daemon memory", 2024-08-31T05:44:25.629 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.629 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.629 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.630 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.630 INFO:teuthology.orchestra.run.smithi005.stdout: "autotune_memory_target_ratio": { 2024-08-31T05:44:25.630 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "autotune_memory_target_ratio", 2024-08-31T05:44:25.630 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-08-31T05:44:25.630 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.630 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.630 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0.7", 2024-08-31T05:44:25.630 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.631 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.631 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.631 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-08-31T05:44:25.631 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.631 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.631 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.631 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.631 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm_log_destination": { 2024-08-31T05:44:25.632 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephadm_log_destination", 2024-08-31T05:44:25.632 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.632 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.632 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.632 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:25.632 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.632 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.632 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:25.633 INFO:teuthology.orchestra.run.smithi005.stdout: "file", 2024-08-31T05:44:25.633 INFO:teuthology.orchestra.run.smithi005.stdout: "file,syslog", 2024-08-31T05:44:25.633 INFO:teuthology.orchestra.run.smithi005.stdout: "syslog" 2024-08-31T05:44:25.633 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:25.633 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-08-31T05:44:25.633 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.633 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.633 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.634 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.634 INFO:teuthology.orchestra.run.smithi005.stdout: "cgroups_split": { 2024-08-31T05:44:25.634 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cgroups_split", 2024-08-31T05:44:25.634 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.634 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.634 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.634 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:25.635 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.635 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.635 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.635 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-08-31T05:44:25.635 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.635 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.635 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.635 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.636 INFO:teuthology.orchestra.run.smithi005.stdout: "config_checks_enabled": { 2024-08-31T05:44:25.636 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "config_checks_enabled", 2024-08-31T05:44:25.636 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.636 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.636 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.636 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:25.636 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.636 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.637 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.637 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-08-31T05:44:25.637 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.637 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.637 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.637 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.637 INFO:teuthology.orchestra.run.smithi005.stdout: "config_dashboard": { 2024-08-31T05:44:25.637 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "config_dashboard", 2024-08-31T05:44:25.638 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.638 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.638 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.638 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:25.638 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.638 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.638 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.638 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-08-31T05:44:25.638 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.639 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.639 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.639 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.639 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_alertmanager": { 2024-08-31T05:44:25.639 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_alertmanager", 2024-08-31T05:44:25.639 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.639 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.639 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.640 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-08-31T05:44:25.640 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.640 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.640 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.640 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2024-08-31T05:44:25.640 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.640 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.640 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.641 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.641 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_base": { 2024-08-31T05:44:25.641 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_base", 2024-08-31T05:44:25.641 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.641 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.641 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.641 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/ceph", 2024-08-31T05:44:25.641 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.642 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.642 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.642 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Container image name, without the tag", 2024-08-31T05:44:25.642 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.642 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.642 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.642 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.643 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_elasticsearch": { 2024-08-31T05:44:25.643 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_elasticsearch", 2024-08-31T05:44:25.643 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.643 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.643 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.643 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-08-31T05:44:25.643 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.643 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.644 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.644 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "elasticsearch container image", 2024-08-31T05:44:25.644 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.644 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.644 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.644 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.645 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_grafana": { 2024-08-31T05:44:25.645 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_grafana", 2024-08-31T05:44:25.645 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.645 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.645 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.645 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-08-31T05:44:25.645 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.645 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.646 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.646 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2024-08-31T05:44:25.646 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.646 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.646 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.646 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.646 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_haproxy": { 2024-08-31T05:44:25.647 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_haproxy", 2024-08-31T05:44:25.647 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.647 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.647 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.647 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-08-31T05:44:25.647 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.647 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.648 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.648 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "HAproxy container image", 2024-08-31T05:44:25.648 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.648 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.648 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.648 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.648 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_jaeger_agent": { 2024-08-31T05:44:25.649 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_jaeger_agent", 2024-08-31T05:44:25.649 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.649 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.649 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.649 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-08-31T05:44:25.649 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.649 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.649 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.649 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Jaeger agent container image", 2024-08-31T05:44:25.650 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.650 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.650 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.650 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.650 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_jaeger_collector": { 2024-08-31T05:44:25.650 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_jaeger_collector", 2024-08-31T05:44:25.650 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.650 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.651 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.651 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-08-31T05:44:25.651 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.651 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.651 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.651 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Jaeger collector container image", 2024-08-31T05:44:25.651 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.651 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.652 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.652 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.652 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_jaeger_query": { 2024-08-31T05:44:25.652 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_jaeger_query", 2024-08-31T05:44:25.652 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.652 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.652 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.652 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-08-31T05:44:25.653 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.653 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.653 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.653 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Jaeger query container image", 2024-08-31T05:44:25.653 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.653 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.653 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.653 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.653 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_keepalived": { 2024-08-31T05:44:25.654 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_keepalived", 2024-08-31T05:44:25.654 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.654 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.654 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.654 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-08-31T05:44:25.654 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.654 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.654 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.655 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Keepalived container image", 2024-08-31T05:44:25.655 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.655 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.655 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.655 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.655 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_loki": { 2024-08-31T05:44:25.655 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_loki", 2024-08-31T05:44:25.655 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.655 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.656 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.656 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-08-31T05:44:25.656 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.656 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.656 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.656 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Loki container image", 2024-08-31T05:44:25.656 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.656 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.657 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.657 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.657 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_nginx": { 2024-08-31T05:44:25.657 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_nginx", 2024-08-31T05:44:25.657 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.657 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.657 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.657 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-08-31T05:44:25.658 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.658 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.658 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.658 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Nginx container image", 2024-08-31T05:44:25.658 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.658 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.658 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.658 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.659 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_node_exporter": { 2024-08-31T05:44:25.659 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_node_exporter", 2024-08-31T05:44:25.659 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.659 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.659 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.659 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-08-31T05:44:25.659 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.659 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.660 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.660 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2024-08-31T05:44:25.660 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.660 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.660 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.660 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.660 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_nvmeof": { 2024-08-31T05:44:25.660 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_nvmeof", 2024-08-31T05:44:25.661 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.661 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.661 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.661 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-08-31T05:44:25.661 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.661 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.661 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.661 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Nvme-of container image", 2024-08-31T05:44:25.661 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.662 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.662 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.662 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.662 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_oauth2_proxy": { 2024-08-31T05:44:25.662 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_oauth2_proxy", 2024-08-31T05:44:25.662 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.662 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.662 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.663 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-08-31T05:44:25.663 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.663 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.663 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.663 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "oauth2-proxy container image", 2024-08-31T05:44:25.663 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.663 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.664 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.664 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.664 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_prometheus": { 2024-08-31T05:44:25.664 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_prometheus", 2024-08-31T05:44:25.664 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.664 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.664 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.664 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-08-31T05:44:25.665 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.665 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.665 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.665 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2024-08-31T05:44:25.665 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.665 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.665 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.666 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.666 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_promtail": { 2024-08-31T05:44:25.666 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_promtail", 2024-08-31T05:44:25.666 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.666 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.666 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.666 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-08-31T05:44:25.666 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.666 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.667 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.667 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Promtail container image", 2024-08-31T05:44:25.667 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.667 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.667 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.667 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.667 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_samba": { 2024-08-31T05:44:25.667 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_samba", 2024-08-31T05:44:25.668 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.668 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.668 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.668 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-08-31T05:44:25.668 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.668 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.668 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.668 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Samba/SMB container image", 2024-08-31T05:44:25.669 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.669 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.669 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.669 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.669 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_snmp_gateway": { 2024-08-31T05:44:25.669 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_snmp_gateway", 2024-08-31T05:44:25.669 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.669 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.670 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.670 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-08-31T05:44:25.670 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.670 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.670 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.670 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SNMP Gateway container image", 2024-08-31T05:44:25.670 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.670 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.671 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.671 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.671 INFO:teuthology.orchestra.run.smithi005.stdout: "container_init": { 2024-08-31T05:44:25.671 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_init", 2024-08-31T05:44:25.671 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.671 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.671 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.671 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:25.671 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.672 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.672 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.672 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Run podman/docker with `--init`", 2024-08-31T05:44:25.672 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.672 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.672 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.672 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.672 INFO:teuthology.orchestra.run.smithi005.stdout: "daemon_cache_timeout": { 2024-08-31T05:44:25.673 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "daemon_cache_timeout", 2024-08-31T05:44:25.673 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:25.673 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.673 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.673 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2024-08-31T05:44:25.673 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.673 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.674 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.674 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-08-31T05:44:25.674 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.674 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.674 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.674 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.674 INFO:teuthology.orchestra.run.smithi005.stdout: "default_cephadm_command_timeout": { 2024-08-31T05:44:25.674 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "default_cephadm_command_timeout", 2024-08-31T05:44:25.675 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:25.675 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.675 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.675 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "900", 2024-08-31T05:44:25.675 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.675 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.675 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.675 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-08-31T05:44:25.676 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.676 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.676 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.676 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.676 INFO:teuthology.orchestra.run.smithi005.stdout: "default_registry": { 2024-08-31T05:44:25.676 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "default_registry", 2024-08-31T05:44:25.676 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.676 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.677 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.677 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io", 2024-08-31T05:44:25.677 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.677 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.677 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.677 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-08-31T05:44:25.677 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.677 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.678 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.678 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.678 INFO:teuthology.orchestra.run.smithi005.stdout: "device_cache_timeout": { 2024-08-31T05:44:25.678 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "device_cache_timeout", 2024-08-31T05:44:25.678 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:25.678 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.678 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.678 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "1800", 2024-08-31T05:44:25.678 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.679 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.679 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.679 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "seconds to cache device inventory", 2024-08-31T05:44:25.679 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.679 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.679 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.679 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.679 INFO:teuthology.orchestra.run.smithi005.stdout: "device_enhanced_scan": { 2024-08-31T05:44:25.680 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "device_enhanced_scan", 2024-08-31T05:44:25.680 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.680 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.680 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.680 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:25.681 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.681 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.681 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.681 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use libstoragemgmt during device scans", 2024-08-31T05:44:25.681 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.682 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.682 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.682 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.682 INFO:teuthology.orchestra.run.smithi005.stdout: "facts_cache_timeout": { 2024-08-31T05:44:25.683 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "facts_cache_timeout", 2024-08-31T05:44:25.683 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:25.683 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.683 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.684 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2024-08-31T05:44:25.684 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.684 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.684 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.685 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "seconds to cache host facts data", 2024-08-31T05:44:25.685 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.685 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.685 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.686 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.686 INFO:teuthology.orchestra.run.smithi005.stdout: "grafana_dashboards_path": { 2024-08-31T05:44:25.686 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "grafana_dashboards_path", 2024-08-31T05:44:25.686 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.687 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.687 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.687 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-08-31T05:44:25.687 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.688 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.688 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.688 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-08-31T05:44:25.689 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.689 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.689 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.689 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.690 INFO:teuthology.orchestra.run.smithi005.stdout: "host_check_interval": { 2024-08-31T05:44:25.690 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "host_check_interval", 2024-08-31T05:44:25.690 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:25.690 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.691 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.691 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2024-08-31T05:44:25.691 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.691 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.692 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.692 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to perform a host check", 2024-08-31T05:44:25.692 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.693 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.693 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.693 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.693 INFO:teuthology.orchestra.run.smithi005.stdout: "hw_monitoring": { 2024-08-31T05:44:25.694 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "hw_monitoring", 2024-08-31T05:44:25.694 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.694 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.694 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.695 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:25.695 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.695 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.696 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.696 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-08-31T05:44:25.696 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.696 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.697 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.697 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.697 INFO:teuthology.orchestra.run.smithi005.stdout: "inventory_list_all": { 2024-08-31T05:44:25.697 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "inventory_list_all", 2024-08-31T05:44:25.698 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.698 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.698 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.698 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:25.699 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.699 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.699 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.699 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-08-31T05:44:25.700 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.700 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.700 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.701 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.701 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:25.701 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:25.701 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.702 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.702 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.702 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:25.702 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.703 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.703 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:25.703 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:25.703 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:25.704 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:25.704 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:25.704 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:25.704 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:25.705 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:25.705 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.705 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.706 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.706 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.706 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.707 INFO:teuthology.orchestra.run.smithi005.stdout: "log_refresh_metadata": { 2024-08-31T05:44:25.707 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_refresh_metadata", 2024-08-31T05:44:25.707 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.707 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.708 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.708 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:25.708 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.708 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.708 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.709 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-08-31T05:44:25.709 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.709 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.709 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.710 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.710 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:25.710 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:25.710 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.710 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.710 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.710 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:25.711 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.711 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.711 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.711 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-08-31T05:44:25.711 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.711 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.711 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.711 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.712 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:25.712 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:25.712 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.712 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.712 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.712 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:25.712 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.712 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.713 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:25.713 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:25.713 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:25.713 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:25.713 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:25.713 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:25.713 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:25.713 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:25.714 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.714 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.714 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.714 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.714 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.714 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:25.714 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:25.714 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.714 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.715 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.715 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:25.715 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.715 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.715 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.715 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.715 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.715 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.716 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.716 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.716 INFO:teuthology.orchestra.run.smithi005.stdout: "manage_etc_ceph_ceph_conf": { 2024-08-31T05:44:25.716 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-08-31T05:44:25.716 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.716 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.716 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.717 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:25.717 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.717 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.717 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.717 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-08-31T05:44:25.717 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.717 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.718 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.718 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.718 INFO:teuthology.orchestra.run.smithi005.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-08-31T05:44:25.718 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-08-31T05:44:25.718 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.718 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.718 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.718 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "*", 2024-08-31T05:44:25.718 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.719 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.719 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.719 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-08-31T05:44:25.719 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.719 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.719 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.719 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.720 INFO:teuthology.orchestra.run.smithi005.stdout: "max_count_per_host": { 2024-08-31T05:44:25.720 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_count_per_host", 2024-08-31T05:44:25.720 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:25.720 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.720 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.720 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-08-31T05:44:25.720 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.720 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.721 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.721 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "max number of daemons per service per host", 2024-08-31T05:44:25.721 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.721 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.721 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.721 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.721 INFO:teuthology.orchestra.run.smithi005.stdout: "max_osd_draining_count": { 2024-08-31T05:44:25.721 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_osd_draining_count", 2024-08-31T05:44:25.722 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:25.722 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.722 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.722 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-08-31T05:44:25.722 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.722 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.722 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.722 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-08-31T05:44:25.723 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.723 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.723 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.723 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.723 INFO:teuthology.orchestra.run.smithi005.stdout: "migration_current": { 2024-08-31T05:44:25.723 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "migration_current", 2024-08-31T05:44:25.723 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:25.723 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.723 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.724 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:25.724 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.724 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.724 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.724 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "internal - do not modify", 2024-08-31T05:44:25.724 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.725 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.725 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.725 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.725 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": { 2024-08-31T05:44:25.725 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mode", 2024-08-31T05:44:25.725 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.725 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.725 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.726 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "root", 2024-08-31T05:44:25.726 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.726 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.726 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:25.726 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm-package", 2024-08-31T05:44:25.726 INFO:teuthology.orchestra.run.smithi005.stdout: "root" 2024-08-31T05:44:25.726 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:25.726 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "mode for remote execution of cephadm", 2024-08-31T05:44:25.726 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.727 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.727 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.727 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.727 INFO:teuthology.orchestra.run.smithi005.stdout: "oob_default_addr": { 2024-08-31T05:44:25.727 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "oob_default_addr", 2024-08-31T05:44:25.727 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.727 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.728 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.728 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "169.254.1.1", 2024-08-31T05:44:25.728 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.728 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.728 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.728 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Default address for RedFish API (oob management).", 2024-08-31T05:44:25.728 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.729 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.729 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.729 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.729 INFO:teuthology.orchestra.run.smithi005.stdout: "prometheus_alerts_path": { 2024-08-31T05:44:25.729 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "prometheus_alerts_path", 2024-08-31T05:44:25.729 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.729 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.729 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.730 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-08-31T05:44:25.730 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.730 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.730 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.730 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-08-31T05:44:25.730 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.730 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.730 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.731 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.731 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_insecure": { 2024-08-31T05:44:25.731 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_insecure", 2024-08-31T05:44:25.731 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.731 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.731 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.732 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:25.732 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.732 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.732 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.732 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-08-31T05:44:25.732 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.733 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.733 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.733 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.733 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_password": { 2024-08-31T05:44:25.733 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_password", 2024-08-31T05:44:25.733 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.733 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.733 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.734 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:25.734 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.734 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.734 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.734 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-08-31T05:44:25.734 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.734 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.734 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.734 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.735 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_url": { 2024-08-31T05:44:25.735 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_url", 2024-08-31T05:44:25.735 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.735 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.735 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.735 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:25.735 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.735 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.736 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.736 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-08-31T05:44:25.736 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.736 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.736 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.736 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.736 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_username": { 2024-08-31T05:44:25.736 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_username", 2024-08-31T05:44:25.737 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.737 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.737 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.737 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:25.737 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.737 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.737 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.737 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-08-31T05:44:25.738 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.738 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.738 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.738 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.738 INFO:teuthology.orchestra.run.smithi005.stdout: "secure_monitoring_stack": { 2024-08-31T05:44:25.738 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "secure_monitoring_stack", 2024-08-31T05:44:25.738 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.738 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.738 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.739 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:25.739 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.739 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.739 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.739 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-08-31T05:44:25.739 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.739 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.739 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.740 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.740 INFO:teuthology.orchestra.run.smithi005.stdout: "service_discovery_port": { 2024-08-31T05:44:25.740 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "service_discovery_port", 2024-08-31T05:44:25.740 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:25.740 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.741 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.741 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8765", 2024-08-31T05:44:25.741 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.741 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.741 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.741 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "cephadm service discovery port", 2024-08-31T05:44:25.741 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.741 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.741 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.742 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.742 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:25.742 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:25.742 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:25.742 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:25.742 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.742 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:25.742 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.743 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.743 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.743 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.743 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.743 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.743 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.743 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.743 INFO:teuthology.orchestra.run.smithi005.stdout: "ssh_config_file": { 2024-08-31T05:44:25.744 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssh_config_file", 2024-08-31T05:44:25.744 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.744 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.744 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.744 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:25.744 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.744 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.744 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.745 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-08-31T05:44:25.745 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.745 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.745 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.745 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.745 INFO:teuthology.orchestra.run.smithi005.stdout: "use_agent": { 2024-08-31T05:44:25.745 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "use_agent", 2024-08-31T05:44:25.745 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.745 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.746 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.746 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:25.746 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.746 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.746 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.746 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-08-31T05:44:25.746 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.747 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.747 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.747 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.747 INFO:teuthology.orchestra.run.smithi005.stdout: "use_repo_digest": { 2024-08-31T05:44:25.747 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "use_repo_digest", 2024-08-31T05:44:25.747 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.748 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.748 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.748 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:25.748 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.748 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.748 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.749 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-08-31T05:44:25.749 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.749 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.749 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.749 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.749 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_on_failed_host_check": { 2024-08-31T05:44:25.749 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_on_failed_host_check", 2024-08-31T05:44:25.749 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.750 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.750 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.750 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:25.750 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.750 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.750 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.750 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise a health warning if the host check fails", 2024-08-31T05:44:25.750 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.751 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.751 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.751 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.751 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_on_stray_daemons": { 2024-08-31T05:44:25.751 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_on_stray_daemons", 2024-08-31T05:44:25.751 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.751 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.751 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.752 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:25.752 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.752 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.752 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.752 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-08-31T05:44:25.752 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.752 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.753 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.753 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.753 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_on_stray_hosts": { 2024-08-31T05:44:25.753 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_on_stray_hosts", 2024-08-31T05:44:25.753 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.753 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.753 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.753 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:25.754 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.754 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.754 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.754 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-08-31T05:44:25.754 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.754 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.754 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.754 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:25.754 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:25.755 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.755 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:25.755 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crash", 2024-08-31T05:44:25.755 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:25.755 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:25.755 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:25.755 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:25.755 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:25.756 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.756 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.756 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.756 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:25.756 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.756 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.756 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:25.756 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:25.757 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:25.757 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:25.757 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:25.757 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:25.757 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:25.757 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:25.757 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.757 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.758 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.758 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.758 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.758 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:25.758 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:25.758 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.758 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.758 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.759 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:25.759 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.759 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.759 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.759 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.759 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.759 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.759 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.759 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.760 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:25.760 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:25.760 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.760 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.760 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.760 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:25.760 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.760 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.761 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:25.761 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:25.761 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:25.761 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:25.761 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:25.761 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:25.761 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:25.761 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:25.762 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.762 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.762 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.762 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.762 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.762 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:25.762 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:25.762 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.763 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.763 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.763 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:25.763 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.763 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.763 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.763 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.763 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.763 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.764 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.764 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.764 INFO:teuthology.orchestra.run.smithi005.stdout: "retain_interval": { 2024-08-31T05:44:25.764 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "retain_interval", 2024-08-31T05:44:25.764 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:25.764 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.764 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.764 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "31536000", 2024-08-31T05:44:25.765 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.765 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.765 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.765 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how long to retain crashes before pruning them", 2024-08-31T05:44:25.765 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.765 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.765 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.765 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.766 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:25.766 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:25.766 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:25.766 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:25.766 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.766 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:25.766 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.766 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.766 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.767 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.767 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.767 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.767 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.767 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.767 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_recent_interval": { 2024-08-31T05:44:25.767 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_recent_interval", 2024-08-31T05:44:25.767 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:25.768 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.768 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.768 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "1209600", 2024-08-31T05:44:25.768 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.768 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.768 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.768 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "time interval in which to warn about recent crashes", 2024-08-31T05:44:25.768 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.768 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.769 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.769 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:25.769 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:25.769 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.769 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:25.769 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "dashboard", 2024-08-31T05:44:25.769 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:25.770 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:25.770 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:25.770 INFO:teuthology.orchestra.run.smithi005.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-08-31T05:44:25.770 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-08-31T05:44:25.770 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:25.770 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.770 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.770 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-08-31T05:44:25.771 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.771 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.771 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.771 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.771 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.771 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.771 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.771 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.771 INFO:teuthology.orchestra.run.smithi005.stdout: "ALERTMANAGER_API_HOST": { 2024-08-31T05:44:25.772 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ALERTMANAGER_API_HOST", 2024-08-31T05:44:25.772 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.772 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.772 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.772 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:25.772 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.772 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.772 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.773 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.773 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.773 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.773 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.773 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.773 INFO:teuthology.orchestra.run.smithi005.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-08-31T05:44:25.773 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-08-31T05:44:25.773 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.774 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.774 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.774 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:25.774 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.774 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.774 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.774 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.774 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.774 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.775 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.775 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.775 INFO:teuthology.orchestra.run.smithi005.stdout: "AUDIT_API_ENABLED": { 2024-08-31T05:44:25.775 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "AUDIT_API_ENABLED", 2024-08-31T05:44:25.775 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.775 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.775 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.775 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:25.776 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.776 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.776 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.776 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.776 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.776 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.776 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.776 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.777 INFO:teuthology.orchestra.run.smithi005.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-08-31T05:44:25.777 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-08-31T05:44:25.777 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.777 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.777 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.777 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:25.777 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.777 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.777 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.778 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.778 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.778 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.778 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.778 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.778 INFO:teuthology.orchestra.run.smithi005.stdout: "ENABLE_BROWSABLE_API": { 2024-08-31T05:44:25.778 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ENABLE_BROWSABLE_API", 2024-08-31T05:44:25.778 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.779 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.779 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.779 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:25.779 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.779 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.779 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.779 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.779 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.780 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.780 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.780 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.780 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-08-31T05:44:25.780 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-08-31T05:44:25.780 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.780 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.780 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.781 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:25.781 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.781 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.781 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.781 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.781 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.781 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.781 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.781 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.782 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-08-31T05:44:25.782 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-08-31T05:44:25.782 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.782 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.782 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.782 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:25.782 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.782 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.783 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.783 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.783 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.783 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.783 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.783 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.783 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-08-31T05:44:25.783 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-08-31T05:44:25.783 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.784 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.784 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.784 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:25.784 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.784 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.784 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.784 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.784 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.785 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.785 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.785 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.785 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-08-31T05:44:25.785 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-08-31T05:44:25.785 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.785 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.785 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.786 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:25.786 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.786 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.786 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.786 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.786 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.786 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.786 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.787 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.787 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_NFS": { 2024-08-31T05:44:25.787 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-08-31T05:44:25.787 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.787 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.787 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.787 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:25.787 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.787 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.788 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.788 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.788 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.788 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.788 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.788 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.788 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_RBD": { 2024-08-31T05:44:25.788 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-08-31T05:44:25.789 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.789 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.789 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.789 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:25.789 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.789 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.789 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.789 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.790 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.790 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.790 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.790 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.790 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_RGW": { 2024-08-31T05:44:25.790 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-08-31T05:44:25.790 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.790 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.790 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.791 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:25.791 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.791 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.791 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.791 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.791 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.791 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.791 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.791 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.792 INFO:teuthology.orchestra.run.smithi005.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-08-31T05:44:25.792 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-08-31T05:44:25.792 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.792 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.792 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.792 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:25.792 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.793 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.793 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.793 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.793 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.793 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.793 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.793 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.793 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_PASSWORD": { 2024-08-31T05:44:25.794 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_PASSWORD", 2024-08-31T05:44:25.794 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.794 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.794 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.794 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "admin", 2024-08-31T05:44:25.794 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.794 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.794 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.795 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.795 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.795 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.795 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.795 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.795 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-08-31T05:44:25.795 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-08-31T05:44:25.795 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.795 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.796 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.796 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:25.796 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.796 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.796 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.796 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.796 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.796 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.797 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.797 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.797 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_URL": { 2024-08-31T05:44:25.797 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_URL", 2024-08-31T05:44:25.797 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.797 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.797 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.797 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:25.798 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.798 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.798 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.798 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.798 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.798 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.798 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.798 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.798 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_USERNAME": { 2024-08-31T05:44:25.799 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_USERNAME", 2024-08-31T05:44:25.799 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.799 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.799 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.799 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "admin", 2024-08-31T05:44:25.799 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.799 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.799 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.800 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.800 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.800 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.800 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.800 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.800 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-08-31T05:44:25.800 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-08-31T05:44:25.800 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.801 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.801 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.801 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:25.801 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.801 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.801 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.801 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.801 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.801 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.802 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.802 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.802 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-08-31T05:44:25.802 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-08-31T05:44:25.802 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.802 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.802 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.802 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:25.803 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.803 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.803 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.803 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.803 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.803 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.803 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.803 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.804 INFO:teuthology.orchestra.run.smithi005.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-08-31T05:44:25.804 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-08-31T05:44:25.804 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.804 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.804 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.804 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:25.804 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.804 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.804 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.805 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.805 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.805 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.805 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.805 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.805 INFO:teuthology.orchestra.run.smithi005.stdout: "ISSUE_TRACKER_API_KEY": { 2024-08-31T05:44:25.805 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-08-31T05:44:25.805 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.806 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.806 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.806 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:25.806 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.806 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.806 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.807 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.807 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.807 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.807 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.807 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.807 INFO:teuthology.orchestra.run.smithi005.stdout: "MANAGED_BY_CLUSTERS": { 2024-08-31T05:44:25.807 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-08-31T05:44:25.807 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.808 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.808 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.808 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "[]", 2024-08-31T05:44:25.808 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.808 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.808 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.808 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.808 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.808 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.809 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.809 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.809 INFO:teuthology.orchestra.run.smithi005.stdout: "MULTICLUSTER_CONFIG": { 2024-08-31T05:44:25.809 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "MULTICLUSTER_CONFIG", 2024-08-31T05:44:25.809 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.809 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.809 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.809 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "{}", 2024-08-31T05:44:25.810 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.810 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.810 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.810 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.810 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.810 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.810 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.810 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.811 INFO:teuthology.orchestra.run.smithi005.stdout: "PROMETHEUS_API_HOST": { 2024-08-31T05:44:25.811 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PROMETHEUS_API_HOST", 2024-08-31T05:44:25.811 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.811 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.811 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.811 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:25.811 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.811 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.811 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.812 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.812 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.812 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.812 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.812 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.812 INFO:teuthology.orchestra.run.smithi005.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-08-31T05:44:25.812 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-08-31T05:44:25.812 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.813 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.813 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.813 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:25.813 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.813 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.813 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.813 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.813 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.814 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.814 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.814 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.814 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-08-31T05:44:25.814 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-08-31T05:44:25.814 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.814 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.815 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.815 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:25.815 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.815 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.815 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.815 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.815 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.815 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.815 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.816 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.816 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-08-31T05:44:25.816 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-08-31T05:44:25.816 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.816 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.816 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.816 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:25.817 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.817 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.817 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.817 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.817 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.817 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.817 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.817 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.817 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-08-31T05:44:25.818 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-08-31T05:44:25.818 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.818 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.818 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.818 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:25.818 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.818 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.818 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.819 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.819 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.819 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.819 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.819 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.819 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-08-31T05:44:25.819 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-08-31T05:44:25.820 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.820 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.820 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.820 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:25.820 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.820 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.820 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.820 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.821 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.821 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.821 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.821 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.821 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-08-31T05:44:25.821 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-08-31T05:44:25.821 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.821 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.821 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.822 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:25.822 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.822 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.822 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.822 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.822 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.822 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.822 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.823 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.823 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-08-31T05:44:25.823 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-08-31T05:44:25.823 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.823 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.823 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.823 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:25.823 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.823 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.824 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.824 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.824 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.824 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.824 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.824 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.824 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-08-31T05:44:25.824 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-08-31T05:44:25.825 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.825 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.825 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.825 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:25.825 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.825 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.825 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.825 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.826 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.826 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.826 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.826 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.826 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_ENABLED": { 2024-08-31T05:44:25.826 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_ENABLED", 2024-08-31T05:44:25.826 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.826 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.826 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.827 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:25.827 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.827 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.827 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.827 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.827 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.827 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.827 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.828 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.828 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-08-31T05:44:25.828 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-08-31T05:44:25.828 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.828 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.828 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.828 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-08-31T05:44:25.828 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.828 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.829 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.829 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.829 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.829 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.829 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.829 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.829 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-08-31T05:44:25.829 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-08-31T05:44:25.830 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:25.830 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.830 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.830 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-08-31T05:44:25.830 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.830 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.830 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.830 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.830 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.831 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.831 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.831 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.831 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-08-31T05:44:25.831 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-08-31T05:44:25.831 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:25.831 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.831 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.832 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8", 2024-08-31T05:44:25.832 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.832 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.832 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.832 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.832 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.832 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.832 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.833 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.833 INFO:teuthology.orchestra.run.smithi005.stdout: "REST_REQUESTS_TIMEOUT": { 2024-08-31T05:44:25.833 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-08-31T05:44:25.833 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:25.833 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.833 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.833 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "45", 2024-08-31T05:44:25.833 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.834 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.834 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.834 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.834 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.834 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.834 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.834 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.834 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_ACCESS_KEY": { 2024-08-31T05:44:25.834 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_ACCESS_KEY", 2024-08-31T05:44:25.835 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.835 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.835 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.835 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:25.835 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.835 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.835 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.835 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.835 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.836 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.836 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.836 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.836 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-08-31T05:44:25.836 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-08-31T05:44:25.836 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.836 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.837 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.837 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "admin", 2024-08-31T05:44:25.837 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.837 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.837 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.837 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.837 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.837 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.838 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.838 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.838 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_SECRET_KEY": { 2024-08-31T05:44:25.838 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_SECRET_KEY", 2024-08-31T05:44:25.838 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.838 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.838 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.838 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:25.839 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.839 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.839 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.839 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.839 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.839 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.839 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.839 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.839 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_SSL_VERIFY": { 2024-08-31T05:44:25.840 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_SSL_VERIFY", 2024-08-31T05:44:25.840 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.840 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.840 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.840 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:25.840 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.840 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.840 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.841 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.841 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.841 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.841 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.841 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.841 INFO:teuthology.orchestra.run.smithi005.stdout: "UNSAFE_TLS_v1_2": { 2024-08-31T05:44:25.841 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "UNSAFE_TLS_v1_2", 2024-08-31T05:44:25.841 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.842 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.842 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.842 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:25.842 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.842 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.842 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.842 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.842 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.842 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.843 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.843 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.843 INFO:teuthology.orchestra.run.smithi005.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-08-31T05:44:25.843 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-08-31T05:44:25.843 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:25.843 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.843 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.843 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:25.844 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.844 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.844 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.844 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.844 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.844 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.844 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.844 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.845 INFO:teuthology.orchestra.run.smithi005.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-08-31T05:44:25.845 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-08-31T05:44:25.845 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:25.845 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.845 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.845 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-08-31T05:44:25.845 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.845 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.846 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.846 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.846 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.846 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.846 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.846 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.846 INFO:teuthology.orchestra.run.smithi005.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-08-31T05:44:25.846 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-08-31T05:44:25.847 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:25.847 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.847 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.847 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2024-08-31T05:44:25.847 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.847 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.847 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.847 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.847 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.848 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.848 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.848 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.848 INFO:teuthology.orchestra.run.smithi005.stdout: "cross_origin_url": { 2024-08-31T05:44:25.848 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cross_origin_url", 2024-08-31T05:44:25.848 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.848 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.848 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.849 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:25.849 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.849 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.849 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.849 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.849 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.849 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.849 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.850 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.850 INFO:teuthology.orchestra.run.smithi005.stdout: "crt_file": { 2024-08-31T05:44:25.850 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crt_file", 2024-08-31T05:44:25.850 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.850 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.850 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.850 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:25.850 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.850 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.851 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.851 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.851 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.851 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.851 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.851 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.851 INFO:teuthology.orchestra.run.smithi005.stdout: "debug": { 2024-08-31T05:44:25.851 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "debug", 2024-08-31T05:44:25.852 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.852 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.852 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.852 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:25.852 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.852 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.852 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.852 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Enable/disable debug options", 2024-08-31T05:44:25.853 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.853 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.853 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.853 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.853 INFO:teuthology.orchestra.run.smithi005.stdout: "jwt_token_ttl": { 2024-08-31T05:44:25.853 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "jwt_token_ttl", 2024-08-31T05:44:25.853 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:25.853 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.853 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.854 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "28800", 2024-08-31T05:44:25.854 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.854 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.854 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.854 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.854 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.854 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.854 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.855 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.855 INFO:teuthology.orchestra.run.smithi005.stdout: "key_file": { 2024-08-31T05:44:25.855 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "key_file", 2024-08-31T05:44:25.855 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.855 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.855 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.855 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:25.855 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.855 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.856 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.856 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.856 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.856 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.856 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.856 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.856 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:25.856 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:25.857 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.857 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.857 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.857 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:25.857 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.857 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.857 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:25.857 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:25.858 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:25.858 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:25.858 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:25.858 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:25.858 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:25.858 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:25.858 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.858 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.858 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.859 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.859 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.859 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:25.859 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:25.859 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.859 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.859 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.860 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:25.860 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.860 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.860 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.860 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.860 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.860 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.860 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.860 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.861 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:25.861 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:25.861 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.861 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.861 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.861 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:25.861 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.861 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.862 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:25.862 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:25.862 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:25.862 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:25.862 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:25.862 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:25.862 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:25.862 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:25.862 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.863 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.863 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.863 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.863 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.863 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:25.863 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:25.863 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.863 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.864 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.864 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:25.864 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.864 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.864 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.864 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.864 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.864 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.865 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.865 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.865 INFO:teuthology.orchestra.run.smithi005.stdout: "motd": { 2024-08-31T05:44:25.865 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "motd", 2024-08-31T05:44:25.865 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.865 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.865 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.865 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:25.865 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.866 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.866 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.866 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "The message of the day", 2024-08-31T05:44:25.866 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.866 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.866 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.866 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.866 INFO:teuthology.orchestra.run.smithi005.stdout: "redirect_resolve_ip_addr": { 2024-08-31T05:44:25.867 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "redirect_resolve_ip_addr", 2024-08-31T05:44:25.867 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.867 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.867 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.867 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:25.867 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.867 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.867 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.867 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.868 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.868 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.868 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.868 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.868 INFO:teuthology.orchestra.run.smithi005.stdout: "server_addr": { 2024-08-31T05:44:25.868 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_addr", 2024-08-31T05:44:25.868 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.868 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.869 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.869 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "::", 2024-08-31T05:44:25.869 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.869 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.869 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.869 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.869 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.869 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.870 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.870 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.870 INFO:teuthology.orchestra.run.smithi005.stdout: "server_port": { 2024-08-31T05:44:25.870 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_port", 2024-08-31T05:44:25.870 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:25.870 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.870 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.870 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8080", 2024-08-31T05:44:25.870 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.871 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.871 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.871 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.871 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.871 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.871 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.871 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.872 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:25.872 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:25.872 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:25.872 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:25.872 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.872 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:25.872 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.872 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.872 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.873 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.873 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.873 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.873 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.873 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.873 INFO:teuthology.orchestra.run.smithi005.stdout: "ssl": { 2024-08-31T05:44:25.873 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssl", 2024-08-31T05:44:25.873 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.874 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.874 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.874 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:25.874 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.874 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.874 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.874 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.874 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.875 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.875 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.875 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.875 INFO:teuthology.orchestra.run.smithi005.stdout: "ssl_server_port": { 2024-08-31T05:44:25.875 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssl_server_port", 2024-08-31T05:44:25.875 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:25.875 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.875 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.875 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8443", 2024-08-31T05:44:25.876 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.876 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.876 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.876 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.876 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.876 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.876 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.876 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.877 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_behaviour": { 2024-08-31T05:44:25.877 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_behaviour", 2024-08-31T05:44:25.877 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.877 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.877 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.877 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "redirect", 2024-08-31T05:44:25.877 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.877 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.878 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:25.878 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:25.878 INFO:teuthology.orchestra.run.smithi005.stdout: "redirect" 2024-08-31T05:44:25.878 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:25.878 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.878 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.878 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.878 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.878 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.879 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_error_status_code": { 2024-08-31T05:44:25.879 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_error_status_code", 2024-08-31T05:44:25.879 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:25.879 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.879 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.879 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "500", 2024-08-31T05:44:25.879 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "400", 2024-08-31T05:44:25.879 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "599", 2024-08-31T05:44:25.880 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.880 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.880 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.880 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.880 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.880 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.880 INFO:teuthology.orchestra.run.smithi005.stdout: "url_prefix": { 2024-08-31T05:44:25.880 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "url_prefix", 2024-08-31T05:44:25.881 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.881 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.881 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.881 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:25.881 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.881 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.881 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.881 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.881 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.882 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.882 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.882 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:25.882 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:25.882 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.882 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:25.882 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "devicehealth", 2024-08-31T05:44:25.883 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:25.883 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:25.883 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:25.883 INFO:teuthology.orchestra.run.smithi005.stdout: "enable_monitoring": { 2024-08-31T05:44:25.883 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enable_monitoring", 2024-08-31T05:44:25.883 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.883 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.883 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.884 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:25.884 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.884 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.884 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.884 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "monitor device health metrics", 2024-08-31T05:44:25.884 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.884 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.884 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.885 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.885 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:25.885 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:25.885 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.885 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.885 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.885 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:25.885 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.885 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.886 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:25.886 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:25.886 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:25.886 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:25.886 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:25.886 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:25.886 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:25.886 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:25.887 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.887 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.887 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.887 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.887 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.887 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:25.887 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:25.887 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.887 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.888 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.888 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:25.888 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.888 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.888 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.888 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.888 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.888 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.889 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.889 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.889 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:25.889 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:25.889 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.889 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.889 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.889 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:25.890 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.890 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.890 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:25.890 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:25.890 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:25.890 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:25.890 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:25.890 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:25.890 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:25.891 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:25.891 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.891 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.891 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.891 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.891 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.891 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:25.891 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:25.892 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.892 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.892 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.892 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:25.892 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.892 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.892 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.892 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.893 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.893 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.893 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.893 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.893 INFO:teuthology.orchestra.run.smithi005.stdout: "mark_out_threshold": { 2024-08-31T05:44:25.893 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mark_out_threshold", 2024-08-31T05:44:25.893 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:25.893 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.893 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.894 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "2419200", 2024-08-31T05:44:25.894 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.894 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.894 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.894 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-08-31T05:44:25.894 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.894 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.894 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.895 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.895 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_name": { 2024-08-31T05:44:25.895 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pool_name", 2024-08-31T05:44:25.895 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.895 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.895 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.895 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "device_health_metrics", 2024-08-31T05:44:25.895 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.895 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.896 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.896 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "name of pool in which to store device health metrics", 2024-08-31T05:44:25.896 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.896 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.896 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.896 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.896 INFO:teuthology.orchestra.run.smithi005.stdout: "retention_period": { 2024-08-31T05:44:25.896 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "retention_period", 2024-08-31T05:44:25.897 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:25.897 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.897 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.897 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "15552000", 2024-08-31T05:44:25.897 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.897 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.897 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.897 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how long to retain device health metrics", 2024-08-31T05:44:25.898 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.898 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.898 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.898 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.898 INFO:teuthology.orchestra.run.smithi005.stdout: "scrape_frequency": { 2024-08-31T05:44:25.898 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "scrape_frequency", 2024-08-31T05:44:25.898 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:25.898 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.899 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.899 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "86400", 2024-08-31T05:44:25.899 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.899 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.899 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.899 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to scrape device health metrics", 2024-08-31T05:44:25.899 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.899 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.899 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.900 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.900 INFO:teuthology.orchestra.run.smithi005.stdout: "self_heal": { 2024-08-31T05:44:25.900 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "self_heal", 2024-08-31T05:44:25.900 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.900 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.900 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.900 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:25.900 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.901 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.901 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.901 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-08-31T05:44:25.901 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.901 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.901 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.901 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.901 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2024-08-31T05:44:25.902 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2024-08-31T05:44:25.902 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:25.902 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.902 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.902 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2024-08-31T05:44:25.902 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.902 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.902 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.902 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to wake up and check device health", 2024-08-31T05:44:25.903 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.903 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.903 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.903 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.903 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:25.903 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:25.903 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:25.903 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:25.904 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.904 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:25.904 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.904 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.904 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.904 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.904 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.905 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.905 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.905 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.905 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_threshold": { 2024-08-31T05:44:25.905 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_threshold", 2024-08-31T05:44:25.905 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:25.905 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.905 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.905 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "7257600", 2024-08-31T05:44:25.906 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.906 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.906 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.906 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-08-31T05:44:25.906 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.906 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.906 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.906 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:25.907 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:25.907 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.907 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:25.907 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "diskprediction_local", 2024-08-31T05:44:25.907 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:25.907 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:25.907 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:25.907 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:25.908 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:25.908 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.908 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.908 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.908 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:25.908 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.908 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.908 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:25.909 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:25.909 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:25.909 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:25.909 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:25.909 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:25.909 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:25.909 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:25.909 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.910 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.910 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.910 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.910 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.910 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:25.910 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:25.910 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.910 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.910 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.911 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:25.911 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.911 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.911 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.911 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.911 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.911 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.911 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.912 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.912 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:25.912 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:25.912 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.912 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.912 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.912 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:25.912 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.912 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.913 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:25.913 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:25.913 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:25.913 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:25.913 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:25.913 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:25.913 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:25.913 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:25.914 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.914 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.914 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.914 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.914 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.914 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:25.914 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:25.914 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.915 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.915 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.915 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:25.915 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.915 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.915 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.915 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.915 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.915 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.916 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.916 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.916 INFO:teuthology.orchestra.run.smithi005.stdout: "predict_interval": { 2024-08-31T05:44:25.916 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "predict_interval", 2024-08-31T05:44:25.916 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.916 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.916 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.916 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "86400", 2024-08-31T05:44:25.917 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.917 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.917 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.917 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.917 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.917 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.917 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.917 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.918 INFO:teuthology.orchestra.run.smithi005.stdout: "predictor_model": { 2024-08-31T05:44:25.918 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "predictor_model", 2024-08-31T05:44:25.918 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.918 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.918 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.918 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "prophetstor", 2024-08-31T05:44:25.918 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.918 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.918 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.919 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.919 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.919 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.919 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.919 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.919 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2024-08-31T05:44:25.919 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2024-08-31T05:44:25.919 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.920 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.920 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.920 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2024-08-31T05:44:25.920 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.920 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.920 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.920 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.920 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.921 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.921 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.921 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.921 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:25.921 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:25.921 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:25.921 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:25.921 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.922 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:25.922 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.922 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.922 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.922 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.922 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.922 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.922 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.922 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:25.923 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:25.923 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.923 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:25.923 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "influx", 2024-08-31T05:44:25.923 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": false, 2024-08-31T05:44:25.923 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "influxdb python module not found", 2024-08-31T05:44:25.923 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:25.923 INFO:teuthology.orchestra.run.smithi005.stdout: "batch_size": { 2024-08-31T05:44:25.924 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "batch_size", 2024-08-31T05:44:25.924 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:25.924 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.924 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.924 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5000", 2024-08-31T05:44:25.924 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.924 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.924 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.925 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-08-31T05:44:25.925 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.925 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.925 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.925 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.925 INFO:teuthology.orchestra.run.smithi005.stdout: "database": { 2024-08-31T05:44:25.925 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "database", 2024-08-31T05:44:25.925 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.925 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.926 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.926 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "ceph", 2024-08-31T05:44:25.926 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.926 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.926 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.926 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-08-31T05:44:25.926 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.926 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.927 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.927 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.927 INFO:teuthology.orchestra.run.smithi005.stdout: "hostname": { 2024-08-31T05:44:25.927 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "hostname", 2024-08-31T05:44:25.927 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.927 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.927 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.927 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:25.928 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.928 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.928 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.928 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "InfluxDB server hostname", 2024-08-31T05:44:25.928 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.928 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.928 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.928 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.929 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2024-08-31T05:44:25.929 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2024-08-31T05:44:25.929 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:25.929 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.929 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.929 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "30", 2024-08-31T05:44:25.929 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "5", 2024-08-31T05:44:25.929 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.930 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.930 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-08-31T05:44:25.930 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.930 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.930 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.930 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.930 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:25.930 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:25.930 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.931 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.931 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.931 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:25.931 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.931 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.931 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:25.931 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:25.931 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:25.932 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:25.932 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:25.932 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:25.932 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:25.932 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:25.932 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.932 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.932 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.933 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.933 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.933 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:25.933 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:25.933 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.933 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.933 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.933 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:25.934 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.934 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.934 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.934 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.934 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.934 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.934 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.934 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.934 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:25.935 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:25.935 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.935 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.935 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.935 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:25.935 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.935 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.935 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:25.936 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:25.936 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:25.936 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:25.936 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:25.936 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:25.936 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:25.936 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:25.936 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.937 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.937 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.937 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.937 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.937 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:25.937 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:25.937 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.937 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.937 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.938 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:25.938 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.938 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.938 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.938 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.938 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.938 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.938 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.939 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.939 INFO:teuthology.orchestra.run.smithi005.stdout: "password": { 2024-08-31T05:44:25.939 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "password", 2024-08-31T05:44:25.939 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.939 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.939 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.939 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:25.939 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.939 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.940 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.940 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "password of InfluxDB server user", 2024-08-31T05:44:25.940 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.940 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.940 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.940 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.940 INFO:teuthology.orchestra.run.smithi005.stdout: "port": { 2024-08-31T05:44:25.940 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "port", 2024-08-31T05:44:25.941 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:25.941 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.941 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.941 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8086", 2024-08-31T05:44:25.941 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.941 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.941 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.941 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "InfluxDB server port", 2024-08-31T05:44:25.942 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.942 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.942 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.942 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.942 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:25.942 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:25.942 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:25.942 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:25.942 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.943 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:25.943 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.943 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.943 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.943 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.943 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.943 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.943 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.944 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.944 INFO:teuthology.orchestra.run.smithi005.stdout: "ssl": { 2024-08-31T05:44:25.944 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssl", 2024-08-31T05:44:25.944 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.944 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.944 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.944 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "false", 2024-08-31T05:44:25.944 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.945 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.945 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.945 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-08-31T05:44:25.945 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.945 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.945 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.945 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.945 INFO:teuthology.orchestra.run.smithi005.stdout: "threads": { 2024-08-31T05:44:25.945 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "threads", 2024-08-31T05:44:25.946 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:25.946 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.946 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.946 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2024-08-31T05:44:25.946 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2024-08-31T05:44:25.946 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "32", 2024-08-31T05:44:25.946 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.946 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-08-31T05:44:25.947 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.947 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.947 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.947 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.947 INFO:teuthology.orchestra.run.smithi005.stdout: "username": { 2024-08-31T05:44:25.947 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "username", 2024-08-31T05:44:25.947 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.947 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.947 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.948 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:25.948 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.948 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.948 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.948 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "username of InfluxDB server user", 2024-08-31T05:44:25.948 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.948 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.948 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.949 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.949 INFO:teuthology.orchestra.run.smithi005.stdout: "verify_ssl": { 2024-08-31T05:44:25.949 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "verify_ssl", 2024-08-31T05:44:25.949 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.949 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.949 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.949 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "true", 2024-08-31T05:44:25.950 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.950 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.950 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.950 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-08-31T05:44:25.950 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.950 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.950 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.950 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:25.950 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:25.951 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.951 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:25.951 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "insights", 2024-08-31T05:44:25.951 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:25.951 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:25.951 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:25.951 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:25.951 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:25.952 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.952 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.952 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.952 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:25.952 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.952 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.952 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:25.952 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:25.953 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:25.953 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:25.953 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:25.953 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:25.953 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:25.953 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:25.953 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.953 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.954 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.954 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.954 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.954 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:25.954 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:25.954 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.954 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.954 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.955 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:25.955 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.955 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.955 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.955 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.955 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.955 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.955 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.955 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.956 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:25.956 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:25.956 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.956 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.956 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.956 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:25.956 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.956 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.957 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:25.957 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:25.957 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:25.957 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:25.957 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:25.957 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:25.957 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:25.957 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:25.957 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.958 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.958 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.958 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.958 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.958 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:25.958 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:25.958 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.958 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.959 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.959 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:25.959 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.959 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.959 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.959 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.959 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.959 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.960 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.960 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.960 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:25.960 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:25.960 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:25.960 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:25.960 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.960 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:25.961 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.961 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.961 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.961 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.961 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.961 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.961 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.961 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:25.961 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:25.962 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.962 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:25.962 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "iostat", 2024-08-31T05:44:25.962 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:25.962 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:25.962 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:25.962 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:25.962 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:25.963 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.963 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.963 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.963 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:25.963 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.963 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.963 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:25.963 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:25.963 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:25.964 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:25.964 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:25.964 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:25.964 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:25.964 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:25.964 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.964 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.964 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.965 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.965 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.965 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:25.965 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:25.965 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.965 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.965 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.965 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:25.966 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.966 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.966 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.966 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.966 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.966 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.966 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.966 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.966 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:25.967 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:25.967 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.967 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.967 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.967 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:25.967 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.967 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.967 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:25.968 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:25.968 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:25.968 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:25.968 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:25.968 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:25.968 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:25.968 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:25.968 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.968 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.969 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.969 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.969 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.969 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:25.969 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:25.969 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.969 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.969 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.970 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:25.970 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.970 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.970 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.970 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.970 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.970 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.970 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.970 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.971 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:25.971 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:25.971 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:25.971 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:25.971 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.971 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:25.971 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.971 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.972 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.972 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.972 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.972 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.972 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.972 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:25.972 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:25.972 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.973 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:25.973 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "k8sevents", 2024-08-31T05:44:25.973 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:25.973 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:25.973 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:25.973 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_event_retention_days": { 2024-08-31T05:44:25.973 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ceph_event_retention_days", 2024-08-31T05:44:25.974 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:25.974 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.974 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.974 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "7", 2024-08-31T05:44:25.974 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.974 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.974 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.974 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Days to hold ceph event information within local cache", 2024-08-31T05:44:25.975 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.975 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.975 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.975 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.975 INFO:teuthology.orchestra.run.smithi005.stdout: "config_check_secs": { 2024-08-31T05:44:25.975 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "config_check_secs", 2024-08-31T05:44:25.975 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:25.975 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.975 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:25.976 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-08-31T05:44:25.976 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "10", 2024-08-31T05:44:25.976 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.976 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.976 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-08-31T05:44:25.976 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.976 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.976 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.977 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.977 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:25.977 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:25.977 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.977 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.977 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.977 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:25.977 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.978 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.978 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:25.978 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:25.978 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:25.978 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:25.978 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:25.978 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:25.978 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:25.978 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:25.979 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.979 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.979 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.979 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.979 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.979 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:25.979 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:25.979 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.980 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.980 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.980 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:25.980 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.980 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.980 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.980 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.980 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.981 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.981 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.981 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.981 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:25.981 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:25.981 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.981 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.981 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.982 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:25.982 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.982 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.982 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:25.982 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:25.982 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:25.982 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:25.982 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:25.983 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:25.983 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:25.983 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:25.983 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.983 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.983 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.983 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.983 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.983 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:25.984 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:25.984 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.984 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.984 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.984 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:25.984 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.984 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.984 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.985 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.985 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.985 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.985 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.985 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.985 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:25.985 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:25.985 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:25.986 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:25.986 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.986 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:25.986 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.986 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.986 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.986 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.986 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.987 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.987 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.987 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:25.987 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:25.987 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.987 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:25.987 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "localpool", 2024-08-31T05:44:25.987 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:25.987 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:25.988 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:25.988 INFO:teuthology.orchestra.run.smithi005.stdout: "failure_domain": { 2024-08-31T05:44:25.988 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "failure_domain", 2024-08-31T05:44:25.988 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.988 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.988 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.988 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "host", 2024-08-31T05:44:25.988 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.989 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.989 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.989 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "failure domain for any created local pool", 2024-08-31T05:44:25.989 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-08-31T05:44:25.989 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.989 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.989 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.989 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:25.990 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:25.990 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.990 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.990 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.990 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:25.990 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.990 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.990 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:25.991 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:25.991 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:25.991 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:25.991 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:25.991 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:25.991 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:25.991 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:25.992 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.992 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.992 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.992 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.992 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.992 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:25.993 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:25.993 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.993 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.993 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.994 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:25.994 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.994 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.994 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:25.994 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.995 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.995 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.995 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.995 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.995 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:25.995 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:25.995 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:25.996 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.996 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:25.996 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:25.996 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:25.996 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:25.997 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:25.997 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:25.997 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:25.997 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:25.997 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:25.997 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:25.998 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:25.998 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:25.998 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:25.998 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:25.998 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:25.998 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:25.999 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:25.999 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:25.999 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:25.999 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:25.999 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:25.999 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.000 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.000 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.000 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.000 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.000 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.000 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.000 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.000 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.001 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.001 INFO:teuthology.orchestra.run.smithi005.stdout: "min_size": { 2024-08-31T05:44:26.001 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "min_size", 2024-08-31T05:44:26.001 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.001 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.001 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.001 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.001 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.002 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.002 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.002 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "default min_size for any created local pool", 2024-08-31T05:44:26.002 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-08-31T05:44:26.002 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.002 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.002 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.002 INFO:teuthology.orchestra.run.smithi005.stdout: "num_rep": { 2024-08-31T05:44:26.003 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "num_rep", 2024-08-31T05:44:26.003 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.003 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.003 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.003 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "3", 2024-08-31T05:44:26.003 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.003 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.003 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.003 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "default replica count for any created local pool", 2024-08-31T05:44:26.004 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.004 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.004 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.004 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.004 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num": { 2024-08-31T05:44:26.004 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pg_num", 2024-08-31T05:44:26.004 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.004 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.005 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.005 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "128", 2024-08-31T05:44:26.005 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.005 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.005 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.005 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "default pg_num for any created local pool", 2024-08-31T05:44:26.005 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.005 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.006 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.006 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.006 INFO:teuthology.orchestra.run.smithi005.stdout: "prefix": { 2024-08-31T05:44:26.006 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "prefix", 2024-08-31T05:44:26.006 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.006 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.006 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.006 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.006 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.007 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.007 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.007 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "name prefix for any created local pool", 2024-08-31T05:44:26.007 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.007 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.007 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.007 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.007 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:26.008 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:26.008 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.008 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:26.008 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.008 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:26.008 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.008 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.008 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.009 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.009 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.009 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.009 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.009 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.009 INFO:teuthology.orchestra.run.smithi005.stdout: "subtree": { 2024-08-31T05:44:26.009 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "subtree", 2024-08-31T05:44:26.009 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.010 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.010 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.010 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "rack", 2024-08-31T05:44:26.010 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.010 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.010 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.010 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "CRUSH level for which to create a local pool", 2024-08-31T05:44:26.010 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-08-31T05:44:26.010 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.011 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.011 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.011 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.011 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.011 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:26.011 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mds_autoscaler", 2024-08-31T05:44:26.011 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:26.011 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:26.012 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:26.012 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:26.012 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:26.012 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.012 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.012 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.012 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.012 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.013 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.013 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.013 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.013 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.013 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.013 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.013 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.013 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.014 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.014 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.014 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.014 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.014 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.014 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.014 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:26.014 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:26.014 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.015 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.015 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.015 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.015 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.015 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.015 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.015 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.015 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.016 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.016 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.016 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.016 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:26.016 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:26.016 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.016 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.016 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.017 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:26.017 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.017 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.017 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.017 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.017 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.017 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.017 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.017 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.018 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.018 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.018 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.018 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.018 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.018 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.018 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.018 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:26.019 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:26.019 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.019 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.019 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.019 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.019 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.019 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.019 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.020 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.020 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.020 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.020 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.020 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.020 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:26.020 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:26.020 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.021 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:26.021 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.021 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:26.021 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.021 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.021 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.021 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.021 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.021 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.022 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.022 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.022 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.022 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.022 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:26.022 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mirroring", 2024-08-31T05:44:26.022 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:26.023 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:26.023 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:26.023 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:26.023 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:26.023 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.023 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.023 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.023 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.024 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.024 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.024 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.024 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.024 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.024 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.024 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.024 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.025 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.025 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.025 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.025 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.025 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.025 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.025 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.025 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:26.026 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:26.026 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.026 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.026 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.026 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.026 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.026 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.026 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.026 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.027 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.027 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.027 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.027 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.027 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:26.027 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:26.027 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.027 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.028 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.028 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:26.028 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.028 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.028 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.028 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.028 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.028 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.029 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.029 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.029 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.029 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.029 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.029 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.029 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.029 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.030 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.030 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:26.030 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:26.030 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.030 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.030 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.030 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.030 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.030 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.031 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.031 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.031 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.031 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.031 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.031 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.031 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:26.031 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:26.032 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.032 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:26.032 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.032 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:26.032 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.032 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.032 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.032 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.033 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.033 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.033 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.033 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.033 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.033 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.033 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:26.033 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "nfs", 2024-08-31T05:44:26.034 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:26.034 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:26.034 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:26.034 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:26.034 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:26.034 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.034 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.034 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.035 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.035 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.035 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.035 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.035 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.035 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.035 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.035 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.035 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.036 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.036 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.036 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.036 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.036 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.036 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.036 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.036 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:26.037 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:26.037 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.037 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.037 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.037 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.037 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.037 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.038 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.038 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.038 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.038 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.038 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.038 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.038 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:26.038 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:26.038 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.039 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.039 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.039 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:26.039 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.039 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.039 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.039 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.039 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.040 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.040 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.040 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.040 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.040 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.040 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.040 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.040 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.041 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.041 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.041 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:26.041 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:26.041 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.041 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.041 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.041 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.041 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.042 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.042 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.042 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.042 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.042 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.042 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.042 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.042 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:26.043 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:26.043 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.043 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:26.043 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.043 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:26.043 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.043 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.043 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.043 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.044 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.044 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.044 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.044 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.044 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.044 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.044 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:26.044 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "orchestrator", 2024-08-31T05:44:26.045 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:26.045 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:26.045 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:26.045 INFO:teuthology.orchestra.run.smithi005.stdout: "fail_fs": { 2024-08-31T05:44:26.045 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "fail_fs", 2024-08-31T05:44:26.045 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.045 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.045 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.045 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.046 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.046 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.046 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.046 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-08-31T05:44:26.046 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.046 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.046 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.047 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.047 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:26.047 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:26.047 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.047 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.047 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.047 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.047 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.047 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.048 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.048 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.048 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.048 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.048 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.048 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.048 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.048 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.049 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.049 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.049 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.049 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.049 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.049 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:26.049 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:26.049 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.050 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.050 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.050 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.050 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.050 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.050 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.050 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.050 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.050 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.051 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.051 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.051 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:26.051 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:26.051 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.051 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.051 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.051 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:26.052 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.052 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.052 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.052 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.052 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.052 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.052 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.052 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.052 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.053 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.053 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.053 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.053 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.053 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.053 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.053 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:26.053 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:26.054 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.054 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.054 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.054 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.054 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.054 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.054 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.054 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.054 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.055 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.055 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.055 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.055 INFO:teuthology.orchestra.run.smithi005.stdout: "orchestrator": { 2024-08-31T05:44:26.055 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "orchestrator", 2024-08-31T05:44:26.055 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.055 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.055 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.056 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.056 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.056 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.056 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.056 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm", 2024-08-31T05:44:26.056 INFO:teuthology.orchestra.run.smithi005.stdout: "rook", 2024-08-31T05:44:26.056 INFO:teuthology.orchestra.run.smithi005.stdout: "test_orchestrator" 2024-08-31T05:44:26.056 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.057 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Orchestrator backend", 2024-08-31T05:44:26.057 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.057 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.057 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.057 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.057 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:26.057 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:26.057 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.057 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:26.058 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.058 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:26.058 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.058 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.058 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.058 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.058 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.058 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.059 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.059 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.059 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.059 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.059 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:26.059 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "osd_perf_query", 2024-08-31T05:44:26.059 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:26.059 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:26.059 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:26.060 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:26.060 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:26.060 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.060 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.060 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.060 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.060 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.060 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.061 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.061 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.061 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.061 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.061 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.061 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.061 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.061 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.061 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.062 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.062 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.062 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.062 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.062 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:26.062 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:26.062 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.062 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.063 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.063 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.063 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.063 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.063 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.063 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.063 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.063 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.064 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.064 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.064 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:26.064 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:26.064 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.064 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.064 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.064 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:26.064 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.065 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.065 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.065 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.065 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.065 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.065 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.065 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.065 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.066 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.066 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.066 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.066 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.066 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.066 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.066 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:26.066 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:26.066 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.067 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.067 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.067 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.067 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.067 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.067 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.067 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.067 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.068 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.068 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.068 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.068 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:26.068 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:26.068 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.068 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:26.068 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.068 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:26.069 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.069 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.069 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.069 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.069 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.069 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.069 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.070 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.070 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.070 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.070 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:26.070 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "osd_support", 2024-08-31T05:44:26.070 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:26.070 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:26.070 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:26.071 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:26.071 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:26.071 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.071 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.071 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.071 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.071 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.071 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.071 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.072 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.072 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.072 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.072 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.072 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.072 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.072 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.072 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.073 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.073 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.073 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.073 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.073 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:26.073 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:26.073 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.073 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.074 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.074 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.074 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.074 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.074 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.074 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.074 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.074 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.074 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.075 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.075 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:26.075 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:26.075 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.075 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.075 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.075 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:26.075 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.076 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.076 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.076 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.076 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.076 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.076 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.076 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.076 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.077 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.077 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.077 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.077 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.077 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.077 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.077 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:26.077 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:26.078 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.078 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.078 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.078 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.078 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.078 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.078 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.078 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.078 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.079 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.079 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.079 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.079 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:26.079 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:26.079 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.079 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:26.079 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.080 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:26.080 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.080 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.080 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.080 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.080 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.080 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.080 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.081 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.081 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.081 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.081 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:26.081 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pg_autoscaler", 2024-08-31T05:44:26.081 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:26.081 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:26.081 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:26.081 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:26.082 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:26.082 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.082 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.082 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.082 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.082 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.082 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.082 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.083 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.083 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.083 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.083 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.083 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.083 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.083 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.083 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.083 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.084 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.084 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.084 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.084 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:26.084 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:26.084 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.084 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.084 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.085 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.085 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.085 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.085 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.085 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.085 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.085 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.085 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.085 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.086 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:26.086 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:26.086 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.086 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.086 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.086 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:26.086 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.086 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.087 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.087 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.087 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.087 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.087 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.087 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.087 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.087 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.088 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.088 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.088 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.088 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.088 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.088 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:26.088 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:26.088 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.088 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.089 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.089 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.089 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.089 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.089 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.089 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.089 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.089 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.090 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.090 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.090 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2024-08-31T05:44:26.090 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2024-08-31T05:44:26.090 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:26.090 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.090 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.090 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2024-08-31T05:44:26.090 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.091 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.091 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.091 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.091 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.091 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.091 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.091 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.091 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:26.092 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:26.092 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.092 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:26.092 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.092 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:26.092 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.092 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.092 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.093 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.093 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.093 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.093 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.093 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.093 INFO:teuthology.orchestra.run.smithi005.stdout: "threshold": { 2024-08-31T05:44:26.093 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "threshold", 2024-08-31T05:44:26.094 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-08-31T05:44:26.094 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.094 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.094 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "3.0", 2024-08-31T05:44:26.094 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1.0", 2024-08-31T05:44:26.094 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.094 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.094 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "scaling threshold", 2024-08-31T05:44:26.094 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-08-31T05:44:26.095 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.095 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.095 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.095 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.095 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.095 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:26.095 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "progress", 2024-08-31T05:44:26.095 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:26.096 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:26.096 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:26.096 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_pg_recovery_event": { 2024-08-31T05:44:26.096 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "allow_pg_recovery_event", 2024-08-31T05:44:26.096 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.096 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.096 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.096 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.097 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.097 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.097 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.097 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "allow the module to show pg recovery progress", 2024-08-31T05:44:26.097 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.097 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.097 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.097 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.097 INFO:teuthology.orchestra.run.smithi005.stdout: "enabled": { 2024-08-31T05:44:26.098 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enabled", 2024-08-31T05:44:26.098 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.098 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.098 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.098 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:26.098 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.098 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.098 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.099 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.099 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.099 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.099 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.099 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.099 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:26.099 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:26.099 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.099 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.100 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.100 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.100 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.100 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.100 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.100 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.100 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.100 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.101 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.101 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.101 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.101 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.101 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.101 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.101 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.101 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.102 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.102 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:26.102 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:26.102 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.102 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.102 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.102 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.102 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.102 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.103 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.103 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.103 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.103 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.103 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.103 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.103 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:26.103 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:26.104 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.104 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.104 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.104 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:26.104 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.104 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.104 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.104 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.104 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.105 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.105 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.105 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.105 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.105 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.105 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.105 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.105 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.106 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.106 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.106 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:26.106 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:26.106 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.106 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.106 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.106 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.106 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.107 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.107 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.107 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.107 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.107 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.107 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.107 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.107 INFO:teuthology.orchestra.run.smithi005.stdout: "max_completed_events": { 2024-08-31T05:44:26.108 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_completed_events", 2024-08-31T05:44:26.108 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.108 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.108 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.108 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "50", 2024-08-31T05:44:26.108 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.108 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.108 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.109 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "number of past completed events to remember", 2024-08-31T05:44:26.109 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.109 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.109 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.109 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.109 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2024-08-31T05:44:26.109 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2024-08-31T05:44:26.109 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:26.109 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.110 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.110 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2024-08-31T05:44:26.110 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.110 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.110 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.110 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how long the module is going to sleep", 2024-08-31T05:44:26.110 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.110 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.111 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.111 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.111 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:26.111 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:26.111 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.111 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:26.111 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.111 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:26.111 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.112 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.112 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.112 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.112 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.112 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.112 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.112 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.112 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.113 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.113 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:26.113 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "prometheus", 2024-08-31T05:44:26.113 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:26.113 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:26.113 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:26.113 INFO:teuthology.orchestra.run.smithi005.stdout: "cache": { 2024-08-31T05:44:26.113 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cache", 2024-08-31T05:44:26.114 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.114 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.114 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.114 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:26.114 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.114 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.114 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.114 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.114 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.115 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.115 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.115 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.115 INFO:teuthology.orchestra.run.smithi005.stdout: "exclude_perf_counters": { 2024-08-31T05:44:26.115 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "exclude_perf_counters", 2024-08-31T05:44:26.115 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.116 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.116 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.116 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:26.116 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.116 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.116 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.116 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-08-31T05:44:26.116 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-08-31T05:44:26.117 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.117 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.117 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.117 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:26.117 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:26.117 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.117 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.117 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.118 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.118 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.118 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.118 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.118 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.118 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.118 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.118 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.118 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.119 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.119 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.119 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.119 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.119 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.119 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.119 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.119 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:26.120 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:26.120 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.120 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.120 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.120 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.120 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.120 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.120 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.120 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.121 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.121 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.121 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.121 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.121 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:26.121 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:26.121 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.121 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.122 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.122 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:26.122 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.122 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.122 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.122 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.122 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.122 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.122 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.123 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.123 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.123 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.123 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.123 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.123 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.123 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.123 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.124 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:26.124 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:26.124 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.124 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.124 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.124 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.124 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.124 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.125 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.125 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.125 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.125 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.125 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.125 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.125 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_stats_pools": { 2024-08-31T05:44:26.125 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_stats_pools", 2024-08-31T05:44:26.125 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.126 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.126 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.126 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.126 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.126 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.126 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.126 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.126 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.127 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.127 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.127 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.127 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_stats_pools_refresh_interval": { 2024-08-31T05:44:26.127 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-08-31T05:44:26.127 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.127 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.127 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.127 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "300", 2024-08-31T05:44:26.128 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.128 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.128 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.128 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.128 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.128 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.128 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.128 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.129 INFO:teuthology.orchestra.run.smithi005.stdout: "scrape_interval": { 2024-08-31T05:44:26.129 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "scrape_interval", 2024-08-31T05:44:26.129 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-08-31T05:44:26.129 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.129 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.129 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "15.0", 2024-08-31T05:44:26.129 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.129 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.130 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.130 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.130 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.130 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.130 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.130 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.130 INFO:teuthology.orchestra.run.smithi005.stdout: "server_addr": { 2024-08-31T05:44:26.130 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_addr", 2024-08-31T05:44:26.130 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.131 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.131 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.131 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "::", 2024-08-31T05:44:26.131 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.131 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.131 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.131 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-08-31T05:44:26.131 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.132 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.132 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.132 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.132 INFO:teuthology.orchestra.run.smithi005.stdout: "server_port": { 2024-08-31T05:44:26.132 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_port", 2024-08-31T05:44:26.132 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.132 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.132 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.133 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "9283", 2024-08-31T05:44:26.133 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.133 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.133 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.133 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-08-31T05:44:26.133 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.133 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.133 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.133 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.134 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:26.134 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:26.134 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.134 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:26.134 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.134 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:26.134 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.134 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.135 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.135 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.135 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.135 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.135 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.135 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.135 INFO:teuthology.orchestra.run.smithi005.stdout: "stale_cache_strategy": { 2024-08-31T05:44:26.135 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "stale_cache_strategy", 2024-08-31T05:44:26.135 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.136 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.136 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.136 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "log", 2024-08-31T05:44:26.136 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.136 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.136 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.136 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.136 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.137 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.137 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.137 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.137 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_behaviour": { 2024-08-31T05:44:26.137 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_behaviour", 2024-08-31T05:44:26.137 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.137 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.138 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.138 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "default", 2024-08-31T05:44:26.138 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.138 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.138 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.138 INFO:teuthology.orchestra.run.smithi005.stdout: "default", 2024-08-31T05:44:26.138 INFO:teuthology.orchestra.run.smithi005.stdout: "error" 2024-08-31T05:44:26.138 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.138 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.139 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.139 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.139 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.139 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.139 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_error_status_code": { 2024-08-31T05:44:26.139 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_error_status_code", 2024-08-31T05:44:26.139 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.139 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.140 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.140 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "500", 2024-08-31T05:44:26.140 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "400", 2024-08-31T05:44:26.140 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "599", 2024-08-31T05:44:26.140 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.140 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.140 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.140 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.141 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.141 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.141 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.141 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.141 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:26.141 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_support", 2024-08-31T05:44:26.141 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:26.141 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:26.141 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:26.142 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:26.142 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:26.142 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.142 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.142 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.142 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.142 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.142 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.143 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.143 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.143 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.143 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.143 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.143 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.143 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.143 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.143 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.144 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.144 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.144 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.144 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.144 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:26.144 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:26.144 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.144 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.145 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.145 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.145 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.145 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.145 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.145 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.145 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.145 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.146 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.146 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.146 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:26.146 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:26.146 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.146 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.146 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.146 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:26.146 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.147 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.147 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.147 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.147 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.147 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.147 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.147 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.147 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.148 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.148 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.148 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.148 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.148 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.148 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.148 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:26.148 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:26.148 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.149 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.149 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.149 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.149 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.149 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.149 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.149 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.149 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.150 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.150 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.150 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.150 INFO:teuthology.orchestra.run.smithi005.stdout: "max_concurrent_snap_create": { 2024-08-31T05:44:26.150 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_concurrent_snap_create", 2024-08-31T05:44:26.150 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.150 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.150 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.151 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-08-31T05:44:26.151 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.151 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.151 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.151 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.151 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.151 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.151 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.151 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.152 INFO:teuthology.orchestra.run.smithi005.stdout: "mirror_snapshot_schedule": { 2024-08-31T05:44:26.152 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mirror_snapshot_schedule", 2024-08-31T05:44:26.152 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.152 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.152 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.152 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.152 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.152 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.153 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.153 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.153 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.153 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.153 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.153 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.153 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:26.153 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:26.154 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.154 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:26.154 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.154 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:26.154 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.154 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.154 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.154 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.155 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.155 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.155 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.155 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.155 INFO:teuthology.orchestra.run.smithi005.stdout: "trash_purge_schedule": { 2024-08-31T05:44:26.155 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "trash_purge_schedule", 2024-08-31T05:44:26.155 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.155 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.156 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.156 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.156 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.156 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.156 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.156 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.156 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.156 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.157 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.157 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.157 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.157 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.157 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:26.157 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "restful", 2024-08-31T05:44:26.157 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:26.157 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:26.157 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:26.158 INFO:teuthology.orchestra.run.smithi005.stdout: "enable_auth": { 2024-08-31T05:44:26.158 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enable_auth", 2024-08-31T05:44:26.158 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.158 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.158 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.158 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:26.158 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.158 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.159 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.159 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.159 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.159 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.159 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.159 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.159 INFO:teuthology.orchestra.run.smithi005.stdout: "key_file": { 2024-08-31T05:44:26.159 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "key_file", 2024-08-31T05:44:26.159 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.160 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.160 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.160 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.160 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.160 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.160 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.160 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.161 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.161 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.161 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.161 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.161 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:26.161 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:26.161 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.161 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.161 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.162 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.162 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.162 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.162 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.162 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.162 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.162 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.162 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.163 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.163 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.163 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.163 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.163 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.163 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.163 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.163 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.164 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:26.164 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:26.164 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.164 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.164 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.164 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.164 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.164 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.164 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.165 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.165 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.165 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.165 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.165 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.165 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:26.165 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:26.165 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.166 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.166 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.166 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:26.166 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.166 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.166 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.166 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.166 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.167 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.167 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.167 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.167 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.167 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.167 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.167 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.167 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.167 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.168 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.168 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:26.168 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:26.168 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.168 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.168 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.168 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.168 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.169 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.169 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.169 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.169 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.169 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.169 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.169 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.169 INFO:teuthology.orchestra.run.smithi005.stdout: "max_requests": { 2024-08-31T05:44:26.170 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_requests", 2024-08-31T05:44:26.170 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.170 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.170 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.170 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "500", 2024-08-31T05:44:26.170 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.170 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.170 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.170 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-08-31T05:44:26.171 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.171 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.171 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.171 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.171 INFO:teuthology.orchestra.run.smithi005.stdout: "server_addr": { 2024-08-31T05:44:26.171 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_addr", 2024-08-31T05:44:26.171 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.171 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.172 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.172 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.172 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.172 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.172 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.172 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.172 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.172 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.173 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.173 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.173 INFO:teuthology.orchestra.run.smithi005.stdout: "server_port": { 2024-08-31T05:44:26.173 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_port", 2024-08-31T05:44:26.173 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.173 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.173 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.173 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.174 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.174 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.174 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.174 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.174 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.174 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.174 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.174 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.175 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:26.175 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:26.175 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.175 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:26.175 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.175 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:26.175 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.175 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.175 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.176 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.176 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.176 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.176 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.176 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.176 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.176 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.176 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:26.177 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rgw", 2024-08-31T05:44:26.177 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:26.177 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:26.177 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:26.177 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:26.177 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:26.177 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.177 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.178 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.178 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.178 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.178 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.178 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.178 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.178 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.178 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.179 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.179 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.179 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.179 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.179 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.179 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.179 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.179 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.180 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.180 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:26.180 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:26.180 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.180 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.180 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.180 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.180 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.181 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.181 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.181 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.181 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.181 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.181 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.181 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.181 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:26.181 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:26.182 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.182 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.182 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.182 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:26.182 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.182 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.182 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.182 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.183 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.183 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.183 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.183 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.183 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.183 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.183 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.183 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.184 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.184 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.184 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.184 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:26.184 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:26.184 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.184 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.185 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.185 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.185 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.185 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.185 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.185 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.185 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.185 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.186 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.186 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.186 INFO:teuthology.orchestra.run.smithi005.stdout: "secondary_zone_period_retry_limit": { 2024-08-31T05:44:26.186 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "secondary_zone_period_retry_limit", 2024-08-31T05:44:26.186 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.186 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.186 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.186 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2024-08-31T05:44:26.186 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.187 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.187 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.187 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-08-31T05:44:26.187 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.187 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.187 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.187 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.187 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:26.188 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:26.188 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.188 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:26.188 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.188 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:26.188 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.188 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.188 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.189 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.189 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.189 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.189 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.189 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.189 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.189 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.189 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:26.189 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rook", 2024-08-31T05:44:26.190 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:26.190 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:26.190 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:26.190 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:26.190 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:26.190 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.190 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.190 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.191 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.191 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.191 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.191 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.191 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.191 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.191 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.191 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.192 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.192 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.192 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.192 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.192 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.192 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.192 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.192 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.192 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:26.193 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:26.193 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.193 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.193 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.193 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.193 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.193 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.193 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.194 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.194 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.194 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.194 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.194 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.194 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:26.194 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:26.194 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.195 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.195 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.195 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:26.195 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.195 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.195 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.195 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.195 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.195 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.196 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.196 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.196 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.196 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.196 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.196 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.196 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.196 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.197 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.197 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:26.197 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:26.197 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.197 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.197 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.197 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.197 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.198 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.198 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.198 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.198 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.198 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.198 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.198 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.198 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:26.198 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:26.199 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.199 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:26.199 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.199 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:26.199 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.199 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.199 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.199 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.199 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.200 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.200 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.200 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.200 INFO:teuthology.orchestra.run.smithi005.stdout: "storage_class": { 2024-08-31T05:44:26.200 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "storage_class", 2024-08-31T05:44:26.200 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.200 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.200 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.201 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "local", 2024-08-31T05:44:26.201 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.201 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.201 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.201 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-08-31T05:44:26.201 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.201 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.201 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.202 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.202 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.202 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.202 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:26.202 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "selftest", 2024-08-31T05:44:26.202 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:26.202 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:26.202 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:26.203 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:26.203 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:26.203 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.203 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.203 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.203 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.203 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.203 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.203 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.204 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.204 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.204 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.204 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.204 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.204 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.204 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.204 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.205 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.205 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.205 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.205 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.205 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:26.205 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:26.205 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.205 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.206 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.206 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.206 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.206 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.206 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.206 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.206 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.206 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.206 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.207 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.207 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:26.207 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:26.207 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.207 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.207 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.207 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:26.208 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.208 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.208 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.208 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.208 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.208 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.208 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.208 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.209 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.209 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.209 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.209 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.209 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.209 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.209 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.209 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:26.210 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:26.210 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.210 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.210 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.210 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.210 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.210 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.210 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.210 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.211 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.211 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.211 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.211 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.211 INFO:teuthology.orchestra.run.smithi005.stdout: "roption1": { 2024-08-31T05:44:26.211 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "roption1", 2024-08-31T05:44:26.211 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.211 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.212 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.212 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.212 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.212 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.212 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.212 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.212 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.212 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.213 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.213 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.213 INFO:teuthology.orchestra.run.smithi005.stdout: "roption2": { 2024-08-31T05:44:26.213 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "roption2", 2024-08-31T05:44:26.213 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.213 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.213 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.213 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "xyz", 2024-08-31T05:44:26.214 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.214 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.214 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.214 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.214 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.214 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.214 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.214 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.214 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption1": { 2024-08-31T05:44:26.215 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption1", 2024-08-31T05:44:26.215 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.215 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.215 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.215 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.215 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.215 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.215 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.216 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.216 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.216 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.216 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.216 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.216 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption2": { 2024-08-31T05:44:26.216 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption2", 2024-08-31T05:44:26.216 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.217 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.217 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.217 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.217 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.217 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.217 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.217 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.217 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.217 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.218 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.218 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.218 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption3": { 2024-08-31T05:44:26.218 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption3", 2024-08-31T05:44:26.218 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-08-31T05:44:26.218 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.218 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.218 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.219 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.219 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.219 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.219 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.219 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.219 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.219 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.219 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.220 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption4": { 2024-08-31T05:44:26.220 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption4", 2024-08-31T05:44:26.220 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.220 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.220 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.220 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.220 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.220 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.221 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.221 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.221 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.221 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.221 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.221 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.221 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption5": { 2024-08-31T05:44:26.221 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption5", 2024-08-31T05:44:26.221 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.222 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.222 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.222 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.222 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.222 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.222 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.222 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.222 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.223 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.223 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.223 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.223 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption6": { 2024-08-31T05:44:26.223 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption6", 2024-08-31T05:44:26.223 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.223 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.223 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.224 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:26.224 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.224 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.224 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.224 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.224 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.224 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.224 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.224 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.225 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption7": { 2024-08-31T05:44:26.225 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption7", 2024-08-31T05:44:26.225 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.225 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.225 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.225 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.225 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2024-08-31T05:44:26.225 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "42", 2024-08-31T05:44:26.226 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.226 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.226 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.226 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.226 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.226 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.226 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:26.226 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:26.227 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.227 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:26.227 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.227 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:26.227 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.227 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.227 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.227 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.227 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.228 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.228 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.228 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.228 INFO:teuthology.orchestra.run.smithi005.stdout: "testkey": { 2024-08-31T05:44:26.228 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "testkey", 2024-08-31T05:44:26.228 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.228 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.228 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.229 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.229 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.229 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.229 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.229 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.229 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.229 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.229 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.229 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.230 INFO:teuthology.orchestra.run.smithi005.stdout: "testlkey": { 2024-08-31T05:44:26.230 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "testlkey", 2024-08-31T05:44:26.230 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.230 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.230 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.230 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.230 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.231 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.231 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.231 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.231 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.231 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.231 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.231 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.231 INFO:teuthology.orchestra.run.smithi005.stdout: "testnewline": { 2024-08-31T05:44:26.232 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "testnewline", 2024-08-31T05:44:26.232 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.232 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.232 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.232 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.232 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.232 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.232 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.233 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.233 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.233 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.233 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.233 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.233 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.233 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.233 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:26.233 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smb", 2024-08-31T05:44:26.234 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:26.234 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:26.234 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:26.234 INFO:teuthology.orchestra.run.smithi005.stdout: "internal_store_backend": { 2024-08-31T05:44:26.234 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "internal_store_backend", 2024-08-31T05:44:26.234 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.234 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:26.234 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.235 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.235 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.235 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.235 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.235 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-08-31T05:44:26.235 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.235 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.235 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.236 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.236 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:26.236 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:26.236 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.236 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.236 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.236 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.236 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.237 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.237 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.237 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.237 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.237 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.237 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.237 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.237 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.237 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.238 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.238 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.238 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.238 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.238 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.238 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:26.238 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:26.238 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.239 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.239 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.239 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.239 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.239 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.239 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.239 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.239 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.239 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.240 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.240 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.240 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:26.240 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:26.240 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.240 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.240 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.240 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:26.241 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.241 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.241 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.241 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.241 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.241 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.241 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.241 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.242 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.242 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.242 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.242 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.242 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.242 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.242 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.242 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:26.242 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:26.243 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.243 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.243 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.243 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.243 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.243 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.243 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.243 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.244 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.244 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.244 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.244 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.244 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:26.244 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:26.244 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.244 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:26.245 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.245 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:26.245 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.245 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.245 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.245 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.245 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.245 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.245 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.246 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.246 INFO:teuthology.orchestra.run.smithi005.stdout: "update_orchestration": { 2024-08-31T05:44:26.246 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "update_orchestration", 2024-08-31T05:44:26.246 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.246 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.246 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.246 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:26.246 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.247 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.247 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.247 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-08-31T05:44:26.247 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.247 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.247 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.247 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.247 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.247 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.248 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:26.248 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "snap_schedule", 2024-08-31T05:44:26.248 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:26.248 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:26.248 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:26.248 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_m_granularity": { 2024-08-31T05:44:26.248 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "allow_m_granularity", 2024-08-31T05:44:26.248 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.249 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.249 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.249 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.249 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.249 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.249 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.249 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "allow minute scheduled snapshots", 2024-08-31T05:44:26.249 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.250 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.250 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.250 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.250 INFO:teuthology.orchestra.run.smithi005.stdout: "dump_on_update": { 2024-08-31T05:44:26.250 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "dump_on_update", 2024-08-31T05:44:26.250 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.250 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.250 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.250 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.251 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.251 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.251 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.251 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "dump database to debug log on update", 2024-08-31T05:44:26.251 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.251 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.251 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.251 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.252 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:26.252 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:26.252 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.252 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.252 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.252 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.252 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.252 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.253 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.253 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.253 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.253 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.253 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.253 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.253 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.253 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.254 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.254 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.254 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.254 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.254 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.254 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:26.254 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:26.254 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.255 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.255 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.255 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.255 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.255 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.255 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.255 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.255 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.255 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.256 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.256 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.256 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:26.256 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:26.256 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.256 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.256 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.256 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:26.257 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.257 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.257 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.257 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.257 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.257 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.257 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.257 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.258 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.258 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.258 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.258 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.258 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.258 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.258 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.258 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:26.258 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:26.259 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.259 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.259 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.259 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.259 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.259 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.259 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.259 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.260 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.260 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.260 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.260 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.260 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:26.260 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:26.260 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.260 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:26.261 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.261 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:26.261 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.261 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.261 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.261 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.261 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.261 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.261 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.262 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.262 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.262 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.262 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:26.262 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "stats", 2024-08-31T05:44:26.262 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:26.262 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:26.262 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:26.263 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:26.263 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:26.263 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.263 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.263 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.263 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.263 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.263 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.263 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.264 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.264 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.264 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.264 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.264 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.264 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.264 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.264 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.265 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.265 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.265 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.265 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.265 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:26.265 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:26.265 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.265 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.266 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.266 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.266 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.266 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.266 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.266 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.266 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.266 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.266 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.267 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.267 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:26.267 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:26.267 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.267 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.267 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.267 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:26.267 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.268 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.268 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.268 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.268 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.268 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.268 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.268 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.268 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.269 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.269 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.269 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.269 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.269 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.269 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.269 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:26.269 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:26.269 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.270 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.270 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.270 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.270 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.270 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.270 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.270 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.270 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.271 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.271 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.271 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.271 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:26.271 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:26.271 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.271 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:26.271 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.272 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:26.272 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.272 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.272 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.272 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.272 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.272 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.272 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.272 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.273 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.273 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.273 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:26.273 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "status", 2024-08-31T05:44:26.273 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:26.273 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:26.273 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:26.273 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:26.274 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:26.274 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.274 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.274 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.274 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.274 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.274 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.274 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.274 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.275 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.275 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.275 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.275 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.275 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.275 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.275 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.275 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.276 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.276 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.276 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.276 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:26.276 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:26.276 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.276 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.276 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.276 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.277 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.277 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.277 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.277 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.277 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.277 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.277 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.278 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.278 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:26.278 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:26.278 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.278 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.278 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.278 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:26.278 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.278 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.279 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.279 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.279 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.279 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.279 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.279 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.279 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.279 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.280 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.280 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.280 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.280 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.280 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.280 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:26.280 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:26.280 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.281 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.281 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.281 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.281 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.281 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.281 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.281 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.281 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.281 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.282 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.282 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.282 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:26.282 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:26.282 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.282 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:26.282 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.282 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:26.283 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.283 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.283 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.283 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.283 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.283 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.283 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.283 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.283 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.284 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.284 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:26.284 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "telegraf", 2024-08-31T05:44:26.284 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:26.284 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:26.284 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:26.284 INFO:teuthology.orchestra.run.smithi005.stdout: "address": { 2024-08-31T05:44:26.284 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "address", 2024-08-31T05:44:26.285 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.285 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.285 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.285 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-08-31T05:44:26.285 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.285 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.285 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.285 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.286 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.286 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.286 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.286 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.286 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2024-08-31T05:44:26.286 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2024-08-31T05:44:26.286 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:26.286 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.286 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.287 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "15", 2024-08-31T05:44:26.287 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.287 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.287 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.287 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.287 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.287 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.287 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.288 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.288 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:26.288 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:26.288 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.288 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.288 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.288 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.288 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.288 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.289 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.289 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.292 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.292 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.292 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.292 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.292 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.292 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.293 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.293 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.293 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.293 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.293 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.293 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:26.293 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:26.293 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.294 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.294 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.294 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.294 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.294 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.294 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.294 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.294 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.294 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.295 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.295 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.295 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:26.295 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:26.295 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.295 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.295 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.295 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:26.296 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.296 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.296 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.296 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.296 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.296 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.296 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.296 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.297 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.297 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.297 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.297 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.297 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.297 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.297 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.297 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:26.297 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:26.298 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.298 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.298 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.298 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.298 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.298 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.298 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.298 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.299 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.299 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.299 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.299 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.299 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:26.299 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:26.299 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.299 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:26.299 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.300 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:26.300 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.300 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.300 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.300 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.300 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.300 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.300 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.301 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.301 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.301 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.301 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:26.301 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "telemetry", 2024-08-31T05:44:26.301 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:26.301 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:26.301 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:26.301 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_basic": { 2024-08-31T05:44:26.302 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_basic", 2024-08-31T05:44:26.302 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.302 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.302 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.302 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:26.302 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.302 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.302 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.303 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share basic cluster information (size, version)", 2024-08-31T05:44:26.303 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.303 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.303 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.303 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.303 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_crash": { 2024-08-31T05:44:26.303 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_crash", 2024-08-31T05:44:26.303 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.304 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.304 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.304 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:26.304 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.304 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.304 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.304 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-08-31T05:44:26.304 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.305 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.305 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.305 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.305 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_device": { 2024-08-31T05:44:26.305 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_device", 2024-08-31T05:44:26.305 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.305 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.305 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.306 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:26.306 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.306 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.306 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.306 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-08-31T05:44:26.306 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.306 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.306 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.306 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.307 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_ident": { 2024-08-31T05:44:26.307 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_ident", 2024-08-31T05:44:26.307 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.307 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.307 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.307 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.307 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.307 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.308 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.308 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-08-31T05:44:26.308 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.308 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.308 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.308 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.308 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_perf": { 2024-08-31T05:44:26.308 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_perf", 2024-08-31T05:44:26.309 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.309 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.309 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.309 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.309 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.309 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.309 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.309 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share various performance metrics of a cluster", 2024-08-31T05:44:26.309 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.310 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.310 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.310 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.310 INFO:teuthology.orchestra.run.smithi005.stdout: "contact": { 2024-08-31T05:44:26.310 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "contact", 2024-08-31T05:44:26.310 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.310 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.310 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.311 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.311 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.311 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.311 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.311 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.311 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.311 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.311 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.311 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.312 INFO:teuthology.orchestra.run.smithi005.stdout: "description": { 2024-08-31T05:44:26.312 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "description", 2024-08-31T05:44:26.312 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.312 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.312 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.312 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.312 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.312 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.313 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.313 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.313 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.313 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.313 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.313 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.313 INFO:teuthology.orchestra.run.smithi005.stdout: "device_url": { 2024-08-31T05:44:26.313 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "device_url", 2024-08-31T05:44:26.314 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.314 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.315 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.315 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-08-31T05:44:26.315 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.315 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.315 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.315 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.315 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.315 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.316 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.316 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.316 INFO:teuthology.orchestra.run.smithi005.stdout: "enabled": { 2024-08-31T05:44:26.316 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enabled", 2024-08-31T05:44:26.316 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.316 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.316 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.316 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.317 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.317 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.317 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.317 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.317 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.317 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.317 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.317 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.317 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2024-08-31T05:44:26.318 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2024-08-31T05:44:26.318 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.318 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.318 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.318 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "24", 2024-08-31T05:44:26.318 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "8", 2024-08-31T05:44:26.318 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.318 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.319 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.319 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.319 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.319 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.319 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.319 INFO:teuthology.orchestra.run.smithi005.stdout: "last_opt_revision": { 2024-08-31T05:44:26.319 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "last_opt_revision", 2024-08-31T05:44:26.319 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.320 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.320 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.320 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "1", 2024-08-31T05:44:26.320 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.320 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.320 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.320 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.320 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.320 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.321 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.321 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.321 INFO:teuthology.orchestra.run.smithi005.stdout: "leaderboard": { 2024-08-31T05:44:26.321 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "leaderboard", 2024-08-31T05:44:26.321 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.321 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.321 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.321 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.322 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.322 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.322 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.322 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.322 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.322 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.322 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.322 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.323 INFO:teuthology.orchestra.run.smithi005.stdout: "leaderboard_description": { 2024-08-31T05:44:26.323 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "leaderboard_description", 2024-08-31T05:44:26.323 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.323 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.323 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.323 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.323 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.323 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.323 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.324 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.324 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.324 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.324 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.324 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.324 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:26.324 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:26.324 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.325 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.325 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.325 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.325 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.325 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.325 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.325 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.325 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.325 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.326 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.326 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.326 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.326 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.326 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.326 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.326 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.327 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.327 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.327 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:26.327 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:26.327 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.327 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.327 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.327 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.327 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.328 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.328 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.328 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.328 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.328 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.328 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.328 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.328 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:26.329 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:26.329 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.329 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.329 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.329 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:26.329 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.329 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.329 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.330 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.330 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.330 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.330 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.330 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.330 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.330 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.330 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.331 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.331 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.331 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.331 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.331 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:26.331 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:26.331 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.331 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.331 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.332 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.332 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.332 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.332 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.332 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.332 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.332 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.332 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.333 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.333 INFO:teuthology.orchestra.run.smithi005.stdout: "organization": { 2024-08-31T05:44:26.333 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "organization", 2024-08-31T05:44:26.333 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.333 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.333 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.333 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.333 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.334 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.334 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.334 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.334 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.334 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.334 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.334 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.334 INFO:teuthology.orchestra.run.smithi005.stdout: "proxy": { 2024-08-31T05:44:26.334 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "proxy", 2024-08-31T05:44:26.335 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.335 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.335 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.335 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.335 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.335 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.335 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.335 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.336 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.336 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.336 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.336 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.336 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:26.336 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:26.336 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.336 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:26.337 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.337 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:26.337 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.337 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.337 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.337 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.337 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.337 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.337 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.338 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.338 INFO:teuthology.orchestra.run.smithi005.stdout: "url": { 2024-08-31T05:44:26.338 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "url", 2024-08-31T05:44:26.338 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.338 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.338 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.338 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-08-31T05:44:26.338 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.339 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.339 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.339 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.339 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.339 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.339 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.339 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.339 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.339 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.340 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:26.340 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "test_orchestrator", 2024-08-31T05:44:26.340 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:26.340 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:26.340 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:26.340 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:26.340 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:26.340 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.341 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.341 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.341 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.341 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.341 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.341 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.341 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.341 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.342 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.342 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.342 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.342 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.342 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.342 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.342 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.342 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.342 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.343 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.343 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:26.343 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:26.343 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.343 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.343 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.343 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.343 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.344 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.344 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.344 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.344 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.344 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.344 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.344 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.344 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:26.345 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:26.345 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.345 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.345 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.345 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:26.345 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.345 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.345 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.345 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.346 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.346 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.346 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.346 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.346 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.346 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.346 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.346 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.347 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.347 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.347 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.347 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:26.347 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:26.347 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.347 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.347 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.347 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.348 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.348 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.348 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.348 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.348 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.348 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.348 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.348 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.349 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:26.349 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:26.349 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.349 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:26.349 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.349 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:26.349 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.349 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.350 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.350 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.350 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.350 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.350 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.350 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.350 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.350 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.351 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:26.351 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "volumes", 2024-08-31T05:44:26.351 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:26.351 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:26.351 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:26.351 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:26.351 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:26.351 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.352 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.352 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.352 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.352 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.352 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.352 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.352 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.352 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.353 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.353 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.353 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.353 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.353 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.353 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.353 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.353 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.353 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.354 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.354 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:26.354 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:26.354 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.354 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.354 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.354 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.354 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.355 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.355 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.355 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.355 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.355 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.355 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.355 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.355 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:26.355 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:26.356 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.356 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.356 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.356 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:26.356 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.356 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.357 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.357 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.357 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.357 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.357 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.357 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.357 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.357 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.358 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.358 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.358 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.358 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.358 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.358 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:26.358 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:26.358 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.359 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.359 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.359 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.359 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.359 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.359 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.359 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.359 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.359 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.360 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.360 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.360 INFO:teuthology.orchestra.run.smithi005.stdout: "max_concurrent_clones": { 2024-08-31T05:44:26.360 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_concurrent_clones", 2024-08-31T05:44:26.360 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.360 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.360 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.360 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "4", 2024-08-31T05:44:26.361 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.361 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.361 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.361 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Number of asynchronous cloner threads", 2024-08-31T05:44:26.361 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.361 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.361 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.361 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.362 INFO:teuthology.orchestra.run.smithi005.stdout: "periodic_async_work": { 2024-08-31T05:44:26.362 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "periodic_async_work", 2024-08-31T05:44:26.362 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.362 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.362 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.362 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.362 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.362 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.362 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.363 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Periodically check for async work", 2024-08-31T05:44:26.363 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.363 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.363 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.363 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.363 INFO:teuthology.orchestra.run.smithi005.stdout: "snapshot_clone_delay": { 2024-08-31T05:44:26.363 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "snapshot_clone_delay", 2024-08-31T05:44:26.363 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.364 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.364 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.364 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:26.364 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.364 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.364 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.364 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-08-31T05:44:26.364 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.364 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.365 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.365 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.365 INFO:teuthology.orchestra.run.smithi005.stdout: "snapshot_clone_no_wait": { 2024-08-31T05:44:26.365 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "snapshot_clone_no_wait", 2024-08-31T05:44:26.365 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.365 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.365 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.365 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:26.366 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.366 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.366 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.366 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-08-31T05:44:26.366 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.366 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.366 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.366 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.367 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:26.367 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:26.367 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.367 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:26.367 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.367 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:26.367 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.367 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.367 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.368 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.368 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.368 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.368 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.368 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.368 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.368 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.368 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:26.369 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix", 2024-08-31T05:44:26.369 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:26.369 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:26.369 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:26.369 INFO:teuthology.orchestra.run.smithi005.stdout: "discovery_interval": { 2024-08-31T05:44:26.369 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "discovery_interval", 2024-08-31T05:44:26.369 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2024-08-31T05:44:26.369 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.369 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.370 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "100", 2024-08-31T05:44:26.370 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.370 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.370 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.370 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.370 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.370 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.370 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.371 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.371 INFO:teuthology.orchestra.run.smithi005.stdout: "identifier": { 2024-08-31T05:44:26.371 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "identifier", 2024-08-31T05:44:26.371 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.371 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.371 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.371 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.371 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.372 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.372 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.372 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.372 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.372 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.372 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.372 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.372 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2024-08-31T05:44:26.372 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2024-08-31T05:44:26.373 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:26.373 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.373 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.373 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2024-08-31T05:44:26.373 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.373 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.373 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.374 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.374 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.374 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.374 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.374 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.374 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:26.374 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:26.374 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.374 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.375 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.375 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.375 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.375 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.375 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.375 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.375 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.375 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.376 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.376 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.376 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.376 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.376 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.376 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.376 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.376 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.377 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.377 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:26.377 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:26.377 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.377 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.377 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.377 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.377 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.377 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.378 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.378 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.378 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.378 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.378 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.378 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.378 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:26.378 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:26.379 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.379 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.379 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.379 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:26.379 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.379 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.379 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.379 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.379 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.380 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.380 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.380 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.380 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.380 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.380 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.380 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.380 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.381 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.381 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.381 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:26.381 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:26.381 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.381 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.381 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.381 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.382 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.382 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.382 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.382 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.382 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.382 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.382 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.382 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.382 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:26.383 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:26.383 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.383 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:26.383 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.383 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:26.383 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.383 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.383 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.384 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.384 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.384 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.384 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.384 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.384 INFO:teuthology.orchestra.run.smithi005.stdout: "zabbix_host": { 2024-08-31T05:44:26.384 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix_host", 2024-08-31T05:44:26.384 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.385 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.385 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.385 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.385 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.385 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.385 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.385 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.385 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.385 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.386 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.386 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.386 INFO:teuthology.orchestra.run.smithi005.stdout: "zabbix_port": { 2024-08-31T05:44:26.386 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix_port", 2024-08-31T05:44:26.386 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.386 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.386 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.386 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10051", 2024-08-31T05:44:26.387 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.387 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.387 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.387 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.387 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.387 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.387 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.387 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.387 INFO:teuthology.orchestra.run.smithi005.stdout: "zabbix_sender": { 2024-08-31T05:44:26.388 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix_sender", 2024-08-31T05:44:26.388 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.388 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.388 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.388 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-08-31T05:44:26.388 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.388 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.388 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.389 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.389 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.389 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.389 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.389 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.389 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.389 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.389 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-31T05:44:26.390 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.390 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:26.390 INFO:teuthology.orchestra.run.smithi005.stdout: "gid": 24164, 2024-08-31T05:44:26.390 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "y", 2024-08-31T05:44:26.390 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_features": 4540701547738038271, 2024-08-31T05:44:26.390 INFO:teuthology.orchestra.run.smithi005.stdout: "available_modules": [ 2024-08-31T05:44:26.390 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:26.390 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "alerts", 2024-08-31T05:44:26.390 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:26.391 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:26.391 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:26.391 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2024-08-31T05:44:26.391 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2024-08-31T05:44:26.391 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:26.391 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.391 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.391 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2024-08-31T05:44:26.392 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.392 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.392 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.392 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How frequently to reexamine health status", 2024-08-31T05:44:26.392 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.392 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.392 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.392 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.392 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:26.393 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:26.393 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.393 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.393 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.393 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.393 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.393 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.393 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.394 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.394 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.394 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.394 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.394 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.394 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.394 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.394 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.395 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.395 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.395 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.395 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.395 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:26.395 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:26.395 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.395 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.395 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.396 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.396 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.396 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.396 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.396 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.396 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.396 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.397 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.397 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.397 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:26.397 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:26.397 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.397 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.397 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.397 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:26.398 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.398 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.398 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.398 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.398 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.398 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.398 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.398 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.398 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.399 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.399 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.399 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.399 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.399 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.399 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.399 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:26.399 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:26.400 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.400 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.400 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.400 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.400 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.400 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.400 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.400 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.401 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.401 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.401 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.401 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.401 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_destination": { 2024-08-31T05:44:26.401 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_destination", 2024-08-31T05:44:26.401 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.401 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.401 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.402 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.402 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.402 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.402 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.402 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Email address to send alerts to", 2024-08-31T05:44:26.402 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.402 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.402 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.403 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.403 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_from_name": { 2024-08-31T05:44:26.403 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_from_name", 2024-08-31T05:44:26.403 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.403 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.403 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.403 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "Ceph", 2024-08-31T05:44:26.403 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.404 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.404 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.404 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Email From: name", 2024-08-31T05:44:26.404 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.404 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.404 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.404 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.404 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_host": { 2024-08-31T05:44:26.404 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_host", 2024-08-31T05:44:26.405 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.405 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.405 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.405 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.405 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.405 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.405 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.405 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SMTP server", 2024-08-31T05:44:26.406 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.406 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.406 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.406 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.406 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_password": { 2024-08-31T05:44:26.406 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_password", 2024-08-31T05:44:26.406 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.406 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.407 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.407 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.407 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.407 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.407 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.407 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Password to authenticate with", 2024-08-31T05:44:26.407 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.407 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.408 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.408 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.408 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_port": { 2024-08-31T05:44:26.408 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_port", 2024-08-31T05:44:26.408 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.408 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.408 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.408 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "465", 2024-08-31T05:44:26.408 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.409 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.409 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.409 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SMTP port", 2024-08-31T05:44:26.409 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.409 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.409 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.409 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.409 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_sender": { 2024-08-31T05:44:26.410 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_sender", 2024-08-31T05:44:26.410 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.410 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.410 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.410 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.410 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.410 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.410 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.411 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SMTP envelope sender", 2024-08-31T05:44:26.411 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.411 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.411 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.411 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.411 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_ssl": { 2024-08-31T05:44:26.411 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_ssl", 2024-08-31T05:44:26.411 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.411 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.412 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.412 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:26.412 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.412 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.412 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.412 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use SSL to connect to SMTP server", 2024-08-31T05:44:26.412 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.412 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.413 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.413 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.413 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_user": { 2024-08-31T05:44:26.413 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_user", 2024-08-31T05:44:26.413 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.413 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.413 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.413 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.414 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.414 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.414 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.414 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "User to authenticate as", 2024-08-31T05:44:26.414 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.414 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.414 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.414 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.414 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:26.415 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:26.415 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.415 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:26.415 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.415 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:26.415 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.415 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.415 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.416 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.416 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.416 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.416 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.416 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.416 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.416 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.416 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:26.417 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "balancer", 2024-08-31T05:44:26.417 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:26.417 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:26.417 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:26.417 INFO:teuthology.orchestra.run.smithi005.stdout: "active": { 2024-08-31T05:44:26.417 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "active", 2024-08-31T05:44:26.417 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.417 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.417 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.418 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:26.418 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.418 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.418 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.418 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "automatically balance PGs across cluster", 2024-08-31T05:44:26.418 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.418 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.418 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.419 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.419 INFO:teuthology.orchestra.run.smithi005.stdout: "begin_time": { 2024-08-31T05:44:26.419 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "begin_time", 2024-08-31T05:44:26.419 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.419 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.419 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.419 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0000", 2024-08-31T05:44:26.419 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.420 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.420 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.420 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "beginning time of day to automatically balance", 2024-08-31T05:44:26.420 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-31T05:44:26.420 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.420 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.420 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.420 INFO:teuthology.orchestra.run.smithi005.stdout: "begin_weekday": { 2024-08-31T05:44:26.421 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "begin_weekday", 2024-08-31T05:44:26.421 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2024-08-31T05:44:26.421 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.421 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.421 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:26.421 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "0", 2024-08-31T05:44:26.421 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "6", 2024-08-31T05:44:26.421 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.422 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-08-31T05:44:26.422 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-31T05:44:26.422 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.422 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.422 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.422 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_compat_max_iterations": { 2024-08-31T05:44:26.422 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crush_compat_max_iterations", 2024-08-31T05:44:26.422 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2024-08-31T05:44:26.423 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.423 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.423 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "25", 2024-08-31T05:44:26.423 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2024-08-31T05:44:26.423 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "250", 2024-08-31T05:44:26.423 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.423 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-08-31T05:44:26.423 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.423 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.424 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.424 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.424 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_compat_metrics": { 2024-08-31T05:44:26.424 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crush_compat_metrics", 2024-08-31T05:44:26.424 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.424 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.424 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.424 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "pgs,objects,bytes", 2024-08-31T05:44:26.425 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.425 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.425 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.425 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-08-31T05:44:26.425 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-08-31T05:44:26.425 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.425 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.425 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.426 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_compat_step": { 2024-08-31T05:44:26.426 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crush_compat_step", 2024-08-31T05:44:26.426 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-08-31T05:44:26.426 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.426 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.426 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0.5", 2024-08-31T05:44:26.426 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "0.001", 2024-08-31T05:44:26.426 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "0.999", 2024-08-31T05:44:26.427 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.427 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "aggressiveness of optimization", 2024-08-31T05:44:26.427 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-08-31T05:44:26.427 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.427 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.427 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.427 INFO:teuthology.orchestra.run.smithi005.stdout: "end_time": { 2024-08-31T05:44:26.427 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "end_time", 2024-08-31T05:44:26.427 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.428 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.428 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.428 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "2359", 2024-08-31T05:44:26.428 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.428 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.428 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.428 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "ending time of day to automatically balance", 2024-08-31T05:44:26.428 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-31T05:44:26.429 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.429 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.429 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.429 INFO:teuthology.orchestra.run.smithi005.stdout: "end_weekday": { 2024-08-31T05:44:26.429 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "end_weekday", 2024-08-31T05:44:26.429 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2024-08-31T05:44:26.429 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.429 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.430 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:26.430 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "0", 2024-08-31T05:44:26.430 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "6", 2024-08-31T05:44:26.430 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.430 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-08-31T05:44:26.430 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-31T05:44:26.430 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.430 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.431 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.431 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:26.431 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:26.431 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.431 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.431 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.431 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.431 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.431 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.432 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.432 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.432 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.432 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.432 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.432 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.432 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.432 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.433 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.433 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.433 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.433 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.433 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.433 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:26.433 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:26.433 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.434 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.434 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.434 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.434 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.434 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.434 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.434 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.434 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.434 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.435 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.435 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.435 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:26.435 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:26.435 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.435 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.435 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.435 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:26.436 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.436 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.436 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.436 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.436 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.436 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.436 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.436 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.437 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.437 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.437 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.437 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.437 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.437 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.437 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.437 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:26.437 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:26.438 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.438 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.438 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.438 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.438 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.438 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.438 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.438 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.439 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.439 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.439 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.439 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.439 INFO:teuthology.orchestra.run.smithi005.stdout: "min_score": { 2024-08-31T05:44:26.439 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "min_score", 2024-08-31T05:44:26.439 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-08-31T05:44:26.439 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.439 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.440 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:26.440 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.440 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.440 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.440 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-08-31T05:44:26.440 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.440 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.441 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.441 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.441 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": { 2024-08-31T05:44:26.441 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mode", 2024-08-31T05:44:26.441 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.441 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.441 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.441 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "upmap", 2024-08-31T05:44:26.442 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.442 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.442 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.442 INFO:teuthology.orchestra.run.smithi005.stdout: "crush-compat", 2024-08-31T05:44:26.442 INFO:teuthology.orchestra.run.smithi005.stdout: "none", 2024-08-31T05:44:26.442 INFO:teuthology.orchestra.run.smithi005.stdout: "read", 2024-08-31T05:44:26.442 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap", 2024-08-31T05:44:26.442 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap-read" 2024-08-31T05:44:26.443 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.443 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Balancer mode", 2024-08-31T05:44:26.443 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.443 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.443 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.443 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.443 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_ids": { 2024-08-31T05:44:26.443 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pool_ids", 2024-08-31T05:44:26.444 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.444 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.444 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.444 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.444 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.444 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.444 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.444 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-08-31T05:44:26.445 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.445 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.445 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.445 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.445 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2024-08-31T05:44:26.445 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2024-08-31T05:44:26.445 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:26.445 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.445 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.446 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2024-08-31T05:44:26.446 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.446 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.446 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.446 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-08-31T05:44:26.446 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.446 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.446 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.447 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.447 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:26.447 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:26.447 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.447 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:26.447 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.447 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:26.447 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.448 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.448 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.448 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.448 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.448 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.448 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.448 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.448 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap_max_deviation": { 2024-08-31T05:44:26.449 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "upmap_max_deviation", 2024-08-31T05:44:26.449 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.449 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.449 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.449 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2024-08-31T05:44:26.449 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2024-08-31T05:44:26.449 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.449 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.449 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "deviation below which no optimization is attempted", 2024-08-31T05:44:26.450 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-08-31T05:44:26.450 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.450 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.450 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.450 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap_max_optimizations": { 2024-08-31T05:44:26.450 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "upmap_max_optimizations", 2024-08-31T05:44:26.450 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2024-08-31T05:44:26.450 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.451 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.451 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-08-31T05:44:26.451 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.451 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.451 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.451 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-08-31T05:44:26.451 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.451 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.452 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.452 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.452 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.452 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.452 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:26.452 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephadm", 2024-08-31T05:44:26.452 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:26.452 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:26.452 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:26.453 INFO:teuthology.orchestra.run.smithi005.stdout: "agent_down_multiplier": { 2024-08-31T05:44:26.453 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "agent_down_multiplier", 2024-08-31T05:44:26.453 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-08-31T05:44:26.453 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.453 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.453 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "3.0", 2024-08-31T05:44:26.453 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.453 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.454 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.454 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-08-31T05:44:26.454 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.454 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.454 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.454 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.454 INFO:teuthology.orchestra.run.smithi005.stdout: "agent_refresh_rate": { 2024-08-31T05:44:26.454 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "agent_refresh_rate", 2024-08-31T05:44:26.455 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:26.455 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.455 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.455 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "20", 2024-08-31T05:44:26.455 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.455 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.455 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.455 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-08-31T05:44:26.455 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.456 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.456 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.456 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.456 INFO:teuthology.orchestra.run.smithi005.stdout: "agent_starting_port": { 2024-08-31T05:44:26.456 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "agent_starting_port", 2024-08-31T05:44:26.456 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.456 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.456 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.457 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "4721", 2024-08-31T05:44:26.457 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.457 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.457 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.457 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-08-31T05:44:26.457 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.457 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.457 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.458 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.458 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_ptrace": { 2024-08-31T05:44:26.458 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "allow_ptrace", 2024-08-31T05:44:26.458 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.458 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.458 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.458 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.458 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.458 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.459 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.459 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-08-31T05:44:26.459 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-08-31T05:44:26.459 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.459 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.459 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.459 INFO:teuthology.orchestra.run.smithi005.stdout: "autotune_interval": { 2024-08-31T05:44:26.459 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "autotune_interval", 2024-08-31T05:44:26.460 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:26.460 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.460 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.460 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2024-08-31T05:44:26.460 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.460 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.460 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.460 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to autotune daemon memory", 2024-08-31T05:44:26.461 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.461 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.461 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.461 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.461 INFO:teuthology.orchestra.run.smithi005.stdout: "autotune_memory_target_ratio": { 2024-08-31T05:44:26.461 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "autotune_memory_target_ratio", 2024-08-31T05:44:26.461 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-08-31T05:44:26.461 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.462 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.462 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0.7", 2024-08-31T05:44:26.462 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.462 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.462 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.462 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-08-31T05:44:26.462 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.462 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.463 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.463 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.463 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm_log_destination": { 2024-08-31T05:44:26.463 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephadm_log_destination", 2024-08-31T05:44:26.463 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.463 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.463 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.463 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.464 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.464 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.464 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.464 INFO:teuthology.orchestra.run.smithi005.stdout: "file", 2024-08-31T05:44:26.464 INFO:teuthology.orchestra.run.smithi005.stdout: "file,syslog", 2024-08-31T05:44:26.464 INFO:teuthology.orchestra.run.smithi005.stdout: "syslog" 2024-08-31T05:44:26.464 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.464 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-08-31T05:44:26.465 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.465 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.465 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.465 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.465 INFO:teuthology.orchestra.run.smithi005.stdout: "cgroups_split": { 2024-08-31T05:44:26.465 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cgroups_split", 2024-08-31T05:44:26.465 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.465 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.465 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.466 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:26.466 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.466 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.466 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.466 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-08-31T05:44:26.466 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.466 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.466 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.467 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.467 INFO:teuthology.orchestra.run.smithi005.stdout: "config_checks_enabled": { 2024-08-31T05:44:26.467 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "config_checks_enabled", 2024-08-31T05:44:26.467 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.467 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.467 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.467 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.467 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.468 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.468 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.468 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-08-31T05:44:26.468 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.468 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.468 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.468 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.468 INFO:teuthology.orchestra.run.smithi005.stdout: "config_dashboard": { 2024-08-31T05:44:26.469 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "config_dashboard", 2024-08-31T05:44:26.469 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.469 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.469 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.469 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:26.469 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.469 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.469 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.469 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-08-31T05:44:26.470 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.470 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.470 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.470 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.470 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_alertmanager": { 2024-08-31T05:44:26.470 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_alertmanager", 2024-08-31T05:44:26.470 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.470 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.471 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.471 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-08-31T05:44:26.471 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.471 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.471 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.471 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2024-08-31T05:44:26.471 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.471 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.472 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.472 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.472 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_base": { 2024-08-31T05:44:26.472 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_base", 2024-08-31T05:44:26.472 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.472 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.472 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.472 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/ceph", 2024-08-31T05:44:26.473 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.473 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.473 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.473 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Container image name, without the tag", 2024-08-31T05:44:26.473 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.473 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.473 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.473 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.473 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_elasticsearch": { 2024-08-31T05:44:26.474 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_elasticsearch", 2024-08-31T05:44:26.474 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.474 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.474 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.474 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-08-31T05:44:26.474 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.474 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.474 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.475 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "elasticsearch container image", 2024-08-31T05:44:26.475 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.475 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.475 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.475 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.475 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_grafana": { 2024-08-31T05:44:26.475 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_grafana", 2024-08-31T05:44:26.475 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.476 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.476 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.476 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-08-31T05:44:26.476 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.476 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.476 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.476 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2024-08-31T05:44:26.476 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.476 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.477 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.477 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.477 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_haproxy": { 2024-08-31T05:44:26.477 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_haproxy", 2024-08-31T05:44:26.477 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.477 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.477 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.477 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-08-31T05:44:26.478 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.478 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.478 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.478 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "HAproxy container image", 2024-08-31T05:44:26.478 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.478 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.478 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.478 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.479 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_jaeger_agent": { 2024-08-31T05:44:26.479 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_jaeger_agent", 2024-08-31T05:44:26.479 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.479 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.479 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.479 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-08-31T05:44:26.479 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.479 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.479 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.480 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Jaeger agent container image", 2024-08-31T05:44:26.480 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.480 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.480 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.480 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.480 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_jaeger_collector": { 2024-08-31T05:44:26.480 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_jaeger_collector", 2024-08-31T05:44:26.480 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.481 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.481 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.481 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-08-31T05:44:26.481 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.481 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.481 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.481 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Jaeger collector container image", 2024-08-31T05:44:26.481 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.482 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.482 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.482 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.482 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_jaeger_query": { 2024-08-31T05:44:26.482 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_jaeger_query", 2024-08-31T05:44:26.482 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.482 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.482 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.483 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-08-31T05:44:26.483 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.483 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.483 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.483 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Jaeger query container image", 2024-08-31T05:44:26.483 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.483 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.483 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.484 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.484 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_keepalived": { 2024-08-31T05:44:26.484 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_keepalived", 2024-08-31T05:44:26.484 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.484 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.484 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.484 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-08-31T05:44:26.484 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.485 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.485 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.485 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Keepalived container image", 2024-08-31T05:44:26.485 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.485 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.485 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.485 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.485 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_loki": { 2024-08-31T05:44:26.486 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_loki", 2024-08-31T05:44:26.486 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.486 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.486 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.486 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-08-31T05:44:26.486 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.486 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.486 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.486 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Loki container image", 2024-08-31T05:44:26.487 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.487 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.487 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.487 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.487 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_nginx": { 2024-08-31T05:44:26.487 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_nginx", 2024-08-31T05:44:26.487 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.487 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.488 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.488 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-08-31T05:44:26.488 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.488 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.488 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.488 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Nginx container image", 2024-08-31T05:44:26.488 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.488 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.489 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.489 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.489 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_node_exporter": { 2024-08-31T05:44:26.489 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_node_exporter", 2024-08-31T05:44:26.489 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.489 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.489 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.489 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-08-31T05:44:26.490 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.490 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.490 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.490 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2024-08-31T05:44:26.490 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.490 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.490 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.490 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.490 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_nvmeof": { 2024-08-31T05:44:26.491 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_nvmeof", 2024-08-31T05:44:26.491 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.491 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.491 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.491 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-08-31T05:44:26.491 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.491 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.491 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.492 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Nvme-of container image", 2024-08-31T05:44:26.492 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.492 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.492 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.492 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.492 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_oauth2_proxy": { 2024-08-31T05:44:26.492 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_oauth2_proxy", 2024-08-31T05:44:26.492 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.493 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.493 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.493 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-08-31T05:44:26.493 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.493 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.493 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.493 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "oauth2-proxy container image", 2024-08-31T05:44:26.493 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.493 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.494 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.494 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.494 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_prometheus": { 2024-08-31T05:44:26.494 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_prometheus", 2024-08-31T05:44:26.494 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.494 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.494 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.496 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-08-31T05:44:26.496 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.496 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.496 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.496 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2024-08-31T05:44:26.496 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.496 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.497 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.497 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.497 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_promtail": { 2024-08-31T05:44:26.497 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_promtail", 2024-08-31T05:44:26.497 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.497 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.497 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.497 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-08-31T05:44:26.498 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.498 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.498 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.498 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Promtail container image", 2024-08-31T05:44:26.498 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.498 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.498 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.498 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.499 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_samba": { 2024-08-31T05:44:26.499 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_samba", 2024-08-31T05:44:26.499 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.499 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.499 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.499 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-08-31T05:44:26.499 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.499 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.499 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.500 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Samba/SMB container image", 2024-08-31T05:44:26.500 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.500 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.500 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.500 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.500 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_snmp_gateway": { 2024-08-31T05:44:26.500 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_snmp_gateway", 2024-08-31T05:44:26.500 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.501 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.501 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.501 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-08-31T05:44:26.501 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.501 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.501 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.501 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SNMP Gateway container image", 2024-08-31T05:44:26.501 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.502 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.502 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.502 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.502 INFO:teuthology.orchestra.run.smithi005.stdout: "container_init": { 2024-08-31T05:44:26.502 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_init", 2024-08-31T05:44:26.502 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.502 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.502 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.503 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:26.503 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.503 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.503 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.503 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Run podman/docker with `--init`", 2024-08-31T05:44:26.503 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.503 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.503 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.503 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.504 INFO:teuthology.orchestra.run.smithi005.stdout: "daemon_cache_timeout": { 2024-08-31T05:44:26.504 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "daemon_cache_timeout", 2024-08-31T05:44:26.504 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:26.504 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.504 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.504 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2024-08-31T05:44:26.504 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.505 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.505 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.505 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-08-31T05:44:26.505 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.505 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.505 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.505 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.505 INFO:teuthology.orchestra.run.smithi005.stdout: "default_cephadm_command_timeout": { 2024-08-31T05:44:26.506 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "default_cephadm_command_timeout", 2024-08-31T05:44:26.506 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.506 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.506 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.506 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "900", 2024-08-31T05:44:26.506 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.506 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.506 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.507 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-08-31T05:44:26.507 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.507 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.507 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.507 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.507 INFO:teuthology.orchestra.run.smithi005.stdout: "default_registry": { 2024-08-31T05:44:26.507 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "default_registry", 2024-08-31T05:44:26.507 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.508 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.508 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.508 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io", 2024-08-31T05:44:26.508 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.508 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.508 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.508 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-08-31T05:44:26.508 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.509 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.509 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.509 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.509 INFO:teuthology.orchestra.run.smithi005.stdout: "device_cache_timeout": { 2024-08-31T05:44:26.509 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "device_cache_timeout", 2024-08-31T05:44:26.509 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:26.509 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.509 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.509 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "1800", 2024-08-31T05:44:26.510 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.510 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.510 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.510 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "seconds to cache device inventory", 2024-08-31T05:44:26.510 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.510 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.510 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.510 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.511 INFO:teuthology.orchestra.run.smithi005.stdout: "device_enhanced_scan": { 2024-08-31T05:44:26.511 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "device_enhanced_scan", 2024-08-31T05:44:26.511 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.511 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.511 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.511 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.511 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.511 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.512 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.512 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use libstoragemgmt during device scans", 2024-08-31T05:44:26.512 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.512 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.512 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.512 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.512 INFO:teuthology.orchestra.run.smithi005.stdout: "facts_cache_timeout": { 2024-08-31T05:44:26.512 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "facts_cache_timeout", 2024-08-31T05:44:26.513 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:26.513 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.513 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.513 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2024-08-31T05:44:26.513 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.513 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.513 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.513 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "seconds to cache host facts data", 2024-08-31T05:44:26.513 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.514 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.514 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.514 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.514 INFO:teuthology.orchestra.run.smithi005.stdout: "grafana_dashboards_path": { 2024-08-31T05:44:26.514 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "grafana_dashboards_path", 2024-08-31T05:44:26.514 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.514 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.514 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.515 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-08-31T05:44:26.515 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.515 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.515 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.515 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-08-31T05:44:26.515 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.515 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.515 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.516 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.516 INFO:teuthology.orchestra.run.smithi005.stdout: "host_check_interval": { 2024-08-31T05:44:26.516 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "host_check_interval", 2024-08-31T05:44:26.516 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:26.516 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.516 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.516 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2024-08-31T05:44:26.516 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.517 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.517 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.517 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to perform a host check", 2024-08-31T05:44:26.517 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.517 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.517 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.517 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.517 INFO:teuthology.orchestra.run.smithi005.stdout: "hw_monitoring": { 2024-08-31T05:44:26.517 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "hw_monitoring", 2024-08-31T05:44:26.518 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.518 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.518 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.518 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.518 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.518 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.518 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.518 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-08-31T05:44:26.519 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.519 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.519 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.519 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.519 INFO:teuthology.orchestra.run.smithi005.stdout: "inventory_list_all": { 2024-08-31T05:44:26.519 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "inventory_list_all", 2024-08-31T05:44:26.519 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.519 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.520 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.520 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.520 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.520 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.520 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.520 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-08-31T05:44:26.520 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.520 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.521 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.521 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.521 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:26.521 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:26.521 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.521 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.521 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.521 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.521 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.522 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.522 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.522 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.522 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.522 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.522 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.522 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.522 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.523 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.523 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.523 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.523 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.523 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.523 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.523 INFO:teuthology.orchestra.run.smithi005.stdout: "log_refresh_metadata": { 2024-08-31T05:44:26.523 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_refresh_metadata", 2024-08-31T05:44:26.524 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.524 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.524 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.524 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.524 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.524 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.524 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.524 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-08-31T05:44:26.525 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.525 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.525 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.525 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.525 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:26.525 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:26.525 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.525 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.526 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.526 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:26.526 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.526 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.526 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.526 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-08-31T05:44:26.526 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.526 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.527 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.527 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.527 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:26.527 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:26.527 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.527 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.527 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.527 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:26.528 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.528 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.528 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.528 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.528 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.528 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.528 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.528 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.529 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.529 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.529 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.529 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.529 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.529 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.529 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.529 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:26.530 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:26.530 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.530 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.530 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.530 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.530 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.530 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.530 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.530 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.531 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.531 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.531 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.531 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.531 INFO:teuthology.orchestra.run.smithi005.stdout: "manage_etc_ceph_ceph_conf": { 2024-08-31T05:44:26.531 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-08-31T05:44:26.531 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.531 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.532 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.532 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.532 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.532 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.532 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.532 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-08-31T05:44:26.532 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.532 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.533 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.533 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.533 INFO:teuthology.orchestra.run.smithi005.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-08-31T05:44:26.533 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-08-31T05:44:26.533 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.533 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.533 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.533 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "*", 2024-08-31T05:44:26.534 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.534 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.534 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.534 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-08-31T05:44:26.534 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.534 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.534 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.534 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.535 INFO:teuthology.orchestra.run.smithi005.stdout: "max_count_per_host": { 2024-08-31T05:44:26.535 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_count_per_host", 2024-08-31T05:44:26.535 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.535 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.535 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.535 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-08-31T05:44:26.535 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.535 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.536 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.536 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "max number of daemons per service per host", 2024-08-31T05:44:26.536 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.536 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.536 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.536 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.536 INFO:teuthology.orchestra.run.smithi005.stdout: "max_osd_draining_count": { 2024-08-31T05:44:26.536 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_osd_draining_count", 2024-08-31T05:44:26.536 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.537 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.537 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.537 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-08-31T05:44:26.537 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.537 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.537 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.537 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-08-31T05:44:26.537 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.538 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.538 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.538 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.538 INFO:teuthology.orchestra.run.smithi005.stdout: "migration_current": { 2024-08-31T05:44:26.538 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "migration_current", 2024-08-31T05:44:26.538 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.538 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.538 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.538 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.539 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.539 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.539 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.539 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "internal - do not modify", 2024-08-31T05:44:26.539 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.539 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.539 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.539 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.540 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": { 2024-08-31T05:44:26.540 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mode", 2024-08-31T05:44:26.540 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.540 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.540 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.540 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "root", 2024-08-31T05:44:26.540 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.540 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.541 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.541 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm-package", 2024-08-31T05:44:26.541 INFO:teuthology.orchestra.run.smithi005.stdout: "root" 2024-08-31T05:44:26.541 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.541 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "mode for remote execution of cephadm", 2024-08-31T05:44:26.541 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.541 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.541 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.542 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.542 INFO:teuthology.orchestra.run.smithi005.stdout: "oob_default_addr": { 2024-08-31T05:44:26.542 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "oob_default_addr", 2024-08-31T05:44:26.542 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.542 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.542 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.542 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "169.254.1.1", 2024-08-31T05:44:26.542 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.542 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.543 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.543 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Default address for RedFish API (oob management).", 2024-08-31T05:44:26.543 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.543 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.543 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.543 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.543 INFO:teuthology.orchestra.run.smithi005.stdout: "prometheus_alerts_path": { 2024-08-31T05:44:26.543 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "prometheus_alerts_path", 2024-08-31T05:44:26.544 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.544 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.544 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.544 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-08-31T05:44:26.544 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.544 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.544 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.544 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-08-31T05:44:26.544 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.545 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.545 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.545 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.545 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_insecure": { 2024-08-31T05:44:26.545 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_insecure", 2024-08-31T05:44:26.545 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.545 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.545 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.546 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.546 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.546 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.546 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.546 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-08-31T05:44:26.546 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.546 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.546 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.547 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.547 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_password": { 2024-08-31T05:44:26.547 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_password", 2024-08-31T05:44:26.547 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.547 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.547 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.547 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.547 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.548 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.548 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.548 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-08-31T05:44:26.548 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.548 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.548 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.548 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.548 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_url": { 2024-08-31T05:44:26.549 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_url", 2024-08-31T05:44:26.549 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.549 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.549 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.549 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.549 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.549 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.549 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.550 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-08-31T05:44:26.550 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.550 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.550 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.550 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.550 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_username": { 2024-08-31T05:44:26.550 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_username", 2024-08-31T05:44:26.550 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.550 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.551 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.551 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.551 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.551 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.551 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.551 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-08-31T05:44:26.551 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.551 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.552 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.552 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.552 INFO:teuthology.orchestra.run.smithi005.stdout: "secure_monitoring_stack": { 2024-08-31T05:44:26.552 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "secure_monitoring_stack", 2024-08-31T05:44:26.552 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.552 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.552 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.552 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.553 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.553 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.553 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.553 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-08-31T05:44:26.553 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.553 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.553 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.553 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.554 INFO:teuthology.orchestra.run.smithi005.stdout: "service_discovery_port": { 2024-08-31T05:44:26.554 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "service_discovery_port", 2024-08-31T05:44:26.554 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.554 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.554 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.554 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8765", 2024-08-31T05:44:26.554 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.554 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.555 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.555 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "cephadm service discovery port", 2024-08-31T05:44:26.555 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.555 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.555 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.555 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.555 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:26.555 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:26.556 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.556 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:26.556 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.556 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:26.556 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.556 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.556 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.556 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.557 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.557 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.557 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.557 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.557 INFO:teuthology.orchestra.run.smithi005.stdout: "ssh_config_file": { 2024-08-31T05:44:26.557 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssh_config_file", 2024-08-31T05:44:26.557 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.557 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.558 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.558 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.558 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.558 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.558 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.558 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-08-31T05:44:26.558 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.558 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.558 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.559 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.559 INFO:teuthology.orchestra.run.smithi005.stdout: "use_agent": { 2024-08-31T05:44:26.559 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "use_agent", 2024-08-31T05:44:26.559 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.559 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.559 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.559 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.559 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.560 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.560 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.560 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-08-31T05:44:26.560 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.560 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.560 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.560 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.560 INFO:teuthology.orchestra.run.smithi005.stdout: "use_repo_digest": { 2024-08-31T05:44:26.561 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "use_repo_digest", 2024-08-31T05:44:26.561 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.561 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.561 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.561 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:26.561 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.561 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.561 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.562 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-08-31T05:44:26.562 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.562 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.562 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.562 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.562 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_on_failed_host_check": { 2024-08-31T05:44:26.562 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_on_failed_host_check", 2024-08-31T05:44:26.562 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.562 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.563 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.563 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:26.563 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.563 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.563 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.563 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise a health warning if the host check fails", 2024-08-31T05:44:26.563 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.563 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.564 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.564 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.564 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_on_stray_daemons": { 2024-08-31T05:44:26.564 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_on_stray_daemons", 2024-08-31T05:44:26.564 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.564 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.564 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.564 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:26.565 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.565 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.565 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.565 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-08-31T05:44:26.565 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.565 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.565 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.565 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.566 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_on_stray_hosts": { 2024-08-31T05:44:26.566 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_on_stray_hosts", 2024-08-31T05:44:26.566 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.566 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.566 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.566 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:26.566 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.566 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.566 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.567 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-08-31T05:44:26.567 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.567 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.567 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.567 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.567 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.567 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.567 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:26.568 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crash", 2024-08-31T05:44:26.568 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:26.568 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:26.568 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:26.568 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:26.568 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:26.568 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.568 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.569 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.569 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.569 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.569 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.569 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.569 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.569 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.569 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.570 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.570 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.570 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.570 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.570 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.570 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.570 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.570 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.571 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.571 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:26.571 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:26.571 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.571 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.571 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.571 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.571 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.571 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.572 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.572 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.572 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.572 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.572 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.572 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.572 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:26.572 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:26.573 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.573 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.573 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.573 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:26.573 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.573 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.573 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.573 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.573 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.574 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.574 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.574 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.574 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.574 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.574 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.574 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.574 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.575 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.575 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.575 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:26.575 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:26.575 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.575 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.575 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.575 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.576 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.576 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.576 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.576 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.576 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.576 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.576 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.576 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.576 INFO:teuthology.orchestra.run.smithi005.stdout: "retain_interval": { 2024-08-31T05:44:26.577 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "retain_interval", 2024-08-31T05:44:26.577 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:26.577 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.577 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.577 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "31536000", 2024-08-31T05:44:26.577 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.577 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.577 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.578 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how long to retain crashes before pruning them", 2024-08-31T05:44:26.578 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.578 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.578 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.578 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.578 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:26.578 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:26.578 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.579 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:26.579 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.579 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:26.579 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.579 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.579 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.579 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.579 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.579 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.580 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.580 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.580 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_recent_interval": { 2024-08-31T05:44:26.580 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_recent_interval", 2024-08-31T05:44:26.580 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:26.580 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.580 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.580 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "1209600", 2024-08-31T05:44:26.581 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.581 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.581 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.581 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "time interval in which to warn about recent crashes", 2024-08-31T05:44:26.581 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.581 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.581 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.581 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.581 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.582 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.582 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:26.582 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "dashboard", 2024-08-31T05:44:26.582 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:26.582 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:26.582 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:26.582 INFO:teuthology.orchestra.run.smithi005.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-08-31T05:44:26.582 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-08-31T05:44:26.583 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.583 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.583 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.583 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-08-31T05:44:26.583 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.583 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.583 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.583 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.584 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.584 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.584 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.584 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.584 INFO:teuthology.orchestra.run.smithi005.stdout: "ALERTMANAGER_API_HOST": { 2024-08-31T05:44:26.584 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ALERTMANAGER_API_HOST", 2024-08-31T05:44:26.584 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.584 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.584 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.585 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.585 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.585 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.585 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.585 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.585 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.585 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.585 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.586 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.586 INFO:teuthology.orchestra.run.smithi005.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-08-31T05:44:26.586 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-08-31T05:44:26.586 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.586 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.586 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.586 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:26.586 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.587 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.587 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.587 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.587 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.587 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.587 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.587 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.587 INFO:teuthology.orchestra.run.smithi005.stdout: "AUDIT_API_ENABLED": { 2024-08-31T05:44:26.587 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "AUDIT_API_ENABLED", 2024-08-31T05:44:26.588 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.588 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.588 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.588 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.588 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.588 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.588 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.588 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.589 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.589 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.589 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.589 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.589 INFO:teuthology.orchestra.run.smithi005.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-08-31T05:44:26.589 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-08-31T05:44:26.589 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.589 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.590 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.590 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:26.590 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.590 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.590 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.590 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.590 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.590 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.591 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.591 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.591 INFO:teuthology.orchestra.run.smithi005.stdout: "ENABLE_BROWSABLE_API": { 2024-08-31T05:44:26.591 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ENABLE_BROWSABLE_API", 2024-08-31T05:44:26.591 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.591 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.591 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.591 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:26.592 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.592 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.592 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.592 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.592 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.592 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.592 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.592 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.593 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-08-31T05:44:26.593 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-08-31T05:44:26.593 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.593 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.593 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.593 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:26.593 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.593 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.593 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.594 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.594 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.594 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.594 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.594 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.594 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-08-31T05:44:26.594 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-08-31T05:44:26.594 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.595 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.595 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.595 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:26.595 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.595 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.595 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.595 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.595 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.596 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.596 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.596 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.596 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-08-31T05:44:26.596 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-08-31T05:44:26.596 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.596 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.596 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.596 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:26.597 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.597 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.597 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.597 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.597 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.597 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.597 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.597 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.598 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-08-31T05:44:26.598 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-08-31T05:44:26.598 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.598 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.598 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.598 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:26.598 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.598 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.598 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.599 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.599 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.599 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.599 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.599 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.599 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_NFS": { 2024-08-31T05:44:26.599 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-08-31T05:44:26.599 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.600 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.600 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.600 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:26.600 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.600 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.600 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.600 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.600 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.601 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.601 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.601 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.601 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_RBD": { 2024-08-31T05:44:26.601 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-08-31T05:44:26.601 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.601 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.601 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.601 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:26.602 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.602 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.602 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.602 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.602 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.602 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.602 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.602 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.603 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_RGW": { 2024-08-31T05:44:26.603 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-08-31T05:44:26.603 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.603 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.603 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.603 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:26.603 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.603 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.603 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.604 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.604 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.604 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.604 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.604 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.604 INFO:teuthology.orchestra.run.smithi005.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-08-31T05:44:26.604 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-08-31T05:44:26.604 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.605 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.605 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.605 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.605 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.605 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.605 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.605 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.605 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.606 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.606 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.606 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.606 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_PASSWORD": { 2024-08-31T05:44:26.606 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_PASSWORD", 2024-08-31T05:44:26.606 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.606 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.606 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.606 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "admin", 2024-08-31T05:44:26.607 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.607 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.607 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.607 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.607 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.607 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.607 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.607 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.608 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-08-31T05:44:26.608 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-08-31T05:44:26.608 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.608 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.608 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.608 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:26.608 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.608 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.608 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.609 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.609 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.609 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.609 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.609 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.609 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_URL": { 2024-08-31T05:44:26.609 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_URL", 2024-08-31T05:44:26.609 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.610 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.610 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.610 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.610 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.610 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.610 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.610 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.610 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.611 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.611 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.611 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.611 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_USERNAME": { 2024-08-31T05:44:26.611 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_USERNAME", 2024-08-31T05:44:26.611 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.611 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.611 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.611 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "admin", 2024-08-31T05:44:26.612 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.612 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.612 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.612 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.612 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.612 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.612 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.613 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.613 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-08-31T05:44:26.613 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-08-31T05:44:26.613 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.613 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.613 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.613 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.613 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.614 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.614 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.614 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.614 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.614 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.614 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.614 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.614 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-08-31T05:44:26.615 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-08-31T05:44:26.615 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.615 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.615 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.615 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.615 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.615 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.615 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.615 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.616 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.616 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.616 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.616 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.616 INFO:teuthology.orchestra.run.smithi005.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-08-31T05:44:26.616 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-08-31T05:44:26.616 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.616 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.617 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.617 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:26.617 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.617 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.617 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.617 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.617 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.617 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.617 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.618 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.618 INFO:teuthology.orchestra.run.smithi005.stdout: "ISSUE_TRACKER_API_KEY": { 2024-08-31T05:44:26.618 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-08-31T05:44:26.618 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.618 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.618 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.618 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.618 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.619 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.619 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.619 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.619 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.619 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.619 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.619 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.619 INFO:teuthology.orchestra.run.smithi005.stdout: "MANAGED_BY_CLUSTERS": { 2024-08-31T05:44:26.619 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-08-31T05:44:26.620 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.620 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.620 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.620 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "[]", 2024-08-31T05:44:26.620 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.620 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.620 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.620 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.621 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.621 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.621 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.621 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.621 INFO:teuthology.orchestra.run.smithi005.stdout: "MULTICLUSTER_CONFIG": { 2024-08-31T05:44:26.621 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "MULTICLUSTER_CONFIG", 2024-08-31T05:44:26.621 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.621 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.622 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.622 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "{}", 2024-08-31T05:44:26.622 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.622 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.622 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.622 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.622 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.622 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.623 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.624 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.624 INFO:teuthology.orchestra.run.smithi005.stdout: "PROMETHEUS_API_HOST": { 2024-08-31T05:44:26.624 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PROMETHEUS_API_HOST", 2024-08-31T05:44:26.624 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.625 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.625 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.625 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.625 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.625 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.625 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.625 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.625 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.625 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.626 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.626 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.626 INFO:teuthology.orchestra.run.smithi005.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-08-31T05:44:26.626 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-08-31T05:44:26.626 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.626 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.626 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.626 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:26.627 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.627 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.627 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.627 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.627 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.627 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.627 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.628 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.628 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-08-31T05:44:26.628 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-08-31T05:44:26.628 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.629 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.629 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.629 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.629 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.629 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.629 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.629 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.629 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.629 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.630 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.630 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.630 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-08-31T05:44:26.630 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-08-31T05:44:26.630 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.630 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.630 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.630 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.631 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.631 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.631 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.631 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.631 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.631 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.631 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.631 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.632 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-08-31T05:44:26.632 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-08-31T05:44:26.632 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.632 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.632 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.632 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:26.632 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.632 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.633 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.633 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.633 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.633 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.633 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.633 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.633 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-08-31T05:44:26.633 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-08-31T05:44:26.634 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.634 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.634 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.634 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:26.634 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.634 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.634 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.634 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.634 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.635 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.635 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.635 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.635 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-08-31T05:44:26.635 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-08-31T05:44:26.635 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.635 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.635 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.636 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.636 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.636 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.636 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.636 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.636 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.636 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.637 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.637 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.637 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-08-31T05:44:26.637 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-08-31T05:44:26.637 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.637 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.637 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.637 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.637 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.638 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.638 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.638 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.638 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.638 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.638 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.638 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.638 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-08-31T05:44:26.639 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-08-31T05:44:26.639 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.639 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.639 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.639 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.639 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.639 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.639 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.639 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.640 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.640 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.640 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.640 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.640 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_ENABLED": { 2024-08-31T05:44:26.640 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_ENABLED", 2024-08-31T05:44:26.640 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.640 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.641 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.641 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:26.641 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.641 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.641 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.641 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.641 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.641 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.642 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.642 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.642 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-08-31T05:44:26.642 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-08-31T05:44:26.642 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.642 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.642 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.642 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-08-31T05:44:26.643 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.643 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.643 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.643 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.643 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.643 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.643 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.643 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.643 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-08-31T05:44:26.644 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-08-31T05:44:26.644 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.644 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.644 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.644 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-08-31T05:44:26.644 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.644 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.644 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.645 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.645 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.645 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.645 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.645 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.645 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-08-31T05:44:26.645 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-08-31T05:44:26.645 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.646 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.646 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.646 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8", 2024-08-31T05:44:26.646 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.646 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.646 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.646 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.646 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.646 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.647 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.647 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.647 INFO:teuthology.orchestra.run.smithi005.stdout: "REST_REQUESTS_TIMEOUT": { 2024-08-31T05:44:26.647 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-08-31T05:44:26.647 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.647 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.647 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.647 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "45", 2024-08-31T05:44:26.648 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.648 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.648 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.648 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.648 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.648 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.648 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.648 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.648 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_ACCESS_KEY": { 2024-08-31T05:44:26.649 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_ACCESS_KEY", 2024-08-31T05:44:26.649 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.649 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.649 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.649 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.649 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.649 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.649 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.650 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.650 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.650 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.650 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.650 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.650 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-08-31T05:44:26.650 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-08-31T05:44:26.650 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.651 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.651 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.651 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "admin", 2024-08-31T05:44:26.651 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.651 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.651 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.651 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.651 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.652 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.652 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.652 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.652 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_SECRET_KEY": { 2024-08-31T05:44:26.652 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_SECRET_KEY", 2024-08-31T05:44:26.652 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.652 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.652 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.653 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.653 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.653 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.653 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.653 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.653 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.653 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.653 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.654 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.654 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_SSL_VERIFY": { 2024-08-31T05:44:26.654 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_SSL_VERIFY", 2024-08-31T05:44:26.654 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.654 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.654 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.654 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:26.654 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.654 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.655 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.655 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.655 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.655 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.655 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.655 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.655 INFO:teuthology.orchestra.run.smithi005.stdout: "UNSAFE_TLS_v1_2": { 2024-08-31T05:44:26.655 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "UNSAFE_TLS_v1_2", 2024-08-31T05:44:26.656 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.656 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.656 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.656 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.656 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.656 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.656 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.656 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.657 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.657 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.657 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.657 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.657 INFO:teuthology.orchestra.run.smithi005.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-08-31T05:44:26.657 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-08-31T05:44:26.657 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.657 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.658 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.658 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:26.658 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.658 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.658 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.658 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.658 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.658 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.659 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.659 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.659 INFO:teuthology.orchestra.run.smithi005.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-08-31T05:44:26.659 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-08-31T05:44:26.659 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.659 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.659 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.659 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-08-31T05:44:26.660 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.660 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.660 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.660 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.660 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.660 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.660 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.660 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.660 INFO:teuthology.orchestra.run.smithi005.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-08-31T05:44:26.661 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-08-31T05:44:26.661 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.661 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.661 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.661 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2024-08-31T05:44:26.661 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.661 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.661 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.662 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.662 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.662 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.662 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.662 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.662 INFO:teuthology.orchestra.run.smithi005.stdout: "cross_origin_url": { 2024-08-31T05:44:26.662 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cross_origin_url", 2024-08-31T05:44:26.662 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.663 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.663 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.663 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.663 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.663 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.663 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.663 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.663 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.664 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.664 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.664 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.664 INFO:teuthology.orchestra.run.smithi005.stdout: "crt_file": { 2024-08-31T05:44:26.664 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crt_file", 2024-08-31T05:44:26.664 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.664 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.664 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.665 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.665 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.665 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.665 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.665 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.665 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.665 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.665 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.665 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.666 INFO:teuthology.orchestra.run.smithi005.stdout: "debug": { 2024-08-31T05:44:26.666 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "debug", 2024-08-31T05:44:26.666 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.666 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.666 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.666 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.666 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.666 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.667 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.667 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Enable/disable debug options", 2024-08-31T05:44:26.667 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.667 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.667 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.667 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.667 INFO:teuthology.orchestra.run.smithi005.stdout: "jwt_token_ttl": { 2024-08-31T05:44:26.667 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "jwt_token_ttl", 2024-08-31T05:44:26.668 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.668 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.668 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.668 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "28800", 2024-08-31T05:44:26.668 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.668 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.668 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.668 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.668 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.669 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.669 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.669 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.669 INFO:teuthology.orchestra.run.smithi005.stdout: "key_file": { 2024-08-31T05:44:26.669 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "key_file", 2024-08-31T05:44:26.669 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.669 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.669 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.670 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.670 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.670 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.670 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.670 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.670 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.670 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.670 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.671 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.671 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:26.671 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:26.671 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.671 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.671 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.671 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.671 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.671 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.672 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.672 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.672 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.672 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.672 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.672 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.672 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.672 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.673 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.673 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.673 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.673 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.673 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.673 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:26.673 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:26.673 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.674 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.674 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.674 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.674 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.674 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.674 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.674 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.674 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.675 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.675 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.675 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.675 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:26.675 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:26.675 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.675 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.675 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.675 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:26.676 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.676 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.676 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.676 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.676 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.676 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.676 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.676 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.677 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.677 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.677 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.677 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.677 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.677 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.677 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.677 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:26.677 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:26.678 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.678 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.678 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.678 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.678 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.678 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.678 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.678 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.679 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.679 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.679 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.679 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.679 INFO:teuthology.orchestra.run.smithi005.stdout: "motd": { 2024-08-31T05:44:26.679 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "motd", 2024-08-31T05:44:26.679 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.679 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.680 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.680 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.680 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.680 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.680 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.680 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "The message of the day", 2024-08-31T05:44:26.680 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.680 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.680 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.681 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.681 INFO:teuthology.orchestra.run.smithi005.stdout: "redirect_resolve_ip_addr": { 2024-08-31T05:44:26.681 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "redirect_resolve_ip_addr", 2024-08-31T05:44:26.681 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.681 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.681 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.681 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.681 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.682 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.682 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.682 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.682 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.682 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.682 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.682 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.682 INFO:teuthology.orchestra.run.smithi005.stdout: "server_addr": { 2024-08-31T05:44:26.683 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_addr", 2024-08-31T05:44:26.683 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.683 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.683 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.683 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "::", 2024-08-31T05:44:26.683 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.683 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.683 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.683 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.684 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.684 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.684 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.684 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.684 INFO:teuthology.orchestra.run.smithi005.stdout: "server_port": { 2024-08-31T05:44:26.684 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_port", 2024-08-31T05:44:26.684 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.684 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.685 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.685 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8080", 2024-08-31T05:44:26.685 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.685 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.685 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.685 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.685 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.685 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.686 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.686 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.686 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:26.686 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:26.686 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.686 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:26.686 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.686 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:26.687 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.687 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.687 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.687 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.687 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.687 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.687 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.687 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.687 INFO:teuthology.orchestra.run.smithi005.stdout: "ssl": { 2024-08-31T05:44:26.688 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssl", 2024-08-31T05:44:26.688 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.688 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.688 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.688 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:26.688 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.688 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.688 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.689 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.689 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.689 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.689 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.689 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.689 INFO:teuthology.orchestra.run.smithi005.stdout: "ssl_server_port": { 2024-08-31T05:44:26.689 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssl_server_port", 2024-08-31T05:44:26.689 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.690 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.690 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.690 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8443", 2024-08-31T05:44:26.690 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.690 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.690 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.690 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.690 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.691 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.691 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.691 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.691 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_behaviour": { 2024-08-31T05:44:26.691 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_behaviour", 2024-08-31T05:44:26.691 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.691 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.691 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.691 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "redirect", 2024-08-31T05:44:26.692 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.692 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.692 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.692 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.692 INFO:teuthology.orchestra.run.smithi005.stdout: "redirect" 2024-08-31T05:44:26.692 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.692 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.692 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.693 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.693 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.693 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.693 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_error_status_code": { 2024-08-31T05:44:26.693 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_error_status_code", 2024-08-31T05:44:26.693 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.693 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.693 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.694 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "500", 2024-08-31T05:44:26.694 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "400", 2024-08-31T05:44:26.694 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "599", 2024-08-31T05:44:26.694 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.694 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.694 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.694 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.694 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.694 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.695 INFO:teuthology.orchestra.run.smithi005.stdout: "url_prefix": { 2024-08-31T05:44:26.695 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "url_prefix", 2024-08-31T05:44:26.695 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.695 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.695 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.695 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.695 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.695 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.696 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.696 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.696 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.696 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.696 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.696 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.696 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.696 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.697 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:26.697 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "devicehealth", 2024-08-31T05:44:26.697 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:26.697 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:26.697 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:26.697 INFO:teuthology.orchestra.run.smithi005.stdout: "enable_monitoring": { 2024-08-31T05:44:26.697 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enable_monitoring", 2024-08-31T05:44:26.697 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.698 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.698 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.698 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:26.698 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.698 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.698 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.698 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "monitor device health metrics", 2024-08-31T05:44:26.698 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.698 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.699 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.699 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.699 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:26.699 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:26.699 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.699 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.699 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.699 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.700 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.700 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.700 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.700 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.700 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.700 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.700 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.700 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.700 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.701 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.701 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.701 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.701 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.701 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.701 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.701 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:26.701 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:26.702 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.702 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.702 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.702 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.702 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.702 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.702 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.702 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.702 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.703 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.703 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.703 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.703 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:26.703 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:26.703 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.703 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.703 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.704 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:26.704 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.704 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.704 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.704 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.704 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.704 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.704 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.705 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.705 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.705 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.705 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.705 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.705 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.705 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.706 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.706 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:26.706 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:26.706 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.706 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.706 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.706 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.706 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.707 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.707 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.707 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.707 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.707 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.707 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.707 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.707 INFO:teuthology.orchestra.run.smithi005.stdout: "mark_out_threshold": { 2024-08-31T05:44:26.707 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mark_out_threshold", 2024-08-31T05:44:26.708 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:26.708 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.708 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.708 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "2419200", 2024-08-31T05:44:26.708 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.708 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.708 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.708 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-08-31T05:44:26.709 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.709 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.709 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.709 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.709 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_name": { 2024-08-31T05:44:26.709 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pool_name", 2024-08-31T05:44:26.709 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.709 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.710 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.710 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "device_health_metrics", 2024-08-31T05:44:26.710 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.710 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.710 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.710 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "name of pool in which to store device health metrics", 2024-08-31T05:44:26.710 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.710 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.711 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.711 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.711 INFO:teuthology.orchestra.run.smithi005.stdout: "retention_period": { 2024-08-31T05:44:26.711 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "retention_period", 2024-08-31T05:44:26.711 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:26.711 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.711 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.711 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "15552000", 2024-08-31T05:44:26.711 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.712 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.712 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.712 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how long to retain device health metrics", 2024-08-31T05:44:26.712 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.712 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.712 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.712 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.712 INFO:teuthology.orchestra.run.smithi005.stdout: "scrape_frequency": { 2024-08-31T05:44:26.713 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "scrape_frequency", 2024-08-31T05:44:26.713 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:26.713 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.713 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.713 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "86400", 2024-08-31T05:44:26.713 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.713 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.713 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.714 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to scrape device health metrics", 2024-08-31T05:44:26.714 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.714 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.714 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.714 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.714 INFO:teuthology.orchestra.run.smithi005.stdout: "self_heal": { 2024-08-31T05:44:26.714 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "self_heal", 2024-08-31T05:44:26.714 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.715 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.715 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.715 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:26.715 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.715 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.715 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.715 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-08-31T05:44:26.715 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.715 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.716 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.716 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.716 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2024-08-31T05:44:26.716 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2024-08-31T05:44:26.716 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:26.716 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.716 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.716 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2024-08-31T05:44:26.717 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.717 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.717 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.717 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to wake up and check device health", 2024-08-31T05:44:26.717 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.717 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.717 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.717 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.718 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:26.718 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:26.718 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.718 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:26.718 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.718 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:26.718 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.718 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.719 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.719 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.719 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.719 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.719 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.719 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.719 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_threshold": { 2024-08-31T05:44:26.719 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_threshold", 2024-08-31T05:44:26.719 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:26.720 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.720 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.720 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "7257600", 2024-08-31T05:44:26.720 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.720 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.720 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.720 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-08-31T05:44:26.720 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.721 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.721 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.721 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.721 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.721 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.721 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:26.721 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "diskprediction_local", 2024-08-31T05:44:26.721 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:26.722 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:26.722 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:26.722 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:26.722 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:26.722 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.722 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.722 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.722 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.723 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.723 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.723 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.723 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.723 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.723 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.723 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.723 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.723 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.724 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.724 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.724 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.724 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.724 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.724 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.724 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:26.724 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:26.725 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.725 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.725 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.725 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.725 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.725 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.725 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.725 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.725 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.726 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.726 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.726 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.726 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:26.726 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:26.726 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.726 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.726 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.727 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:26.727 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.727 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.727 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.727 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.727 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.727 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.727 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.728 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.728 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.728 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.728 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.728 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.728 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.728 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.728 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.729 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:26.729 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:26.729 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.729 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.729 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.729 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.729 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.729 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.730 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.730 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.730 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.730 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.730 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.730 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.730 INFO:teuthology.orchestra.run.smithi005.stdout: "predict_interval": { 2024-08-31T05:44:26.730 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "predict_interval", 2024-08-31T05:44:26.730 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.731 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.731 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.731 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "86400", 2024-08-31T05:44:26.731 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.731 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.731 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.731 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.731 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.732 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.732 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.732 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.732 INFO:teuthology.orchestra.run.smithi005.stdout: "predictor_model": { 2024-08-31T05:44:26.732 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "predictor_model", 2024-08-31T05:44:26.732 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.732 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.732 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.733 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "prophetstor", 2024-08-31T05:44:26.733 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.733 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.733 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.733 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.733 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.733 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.733 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.734 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.734 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2024-08-31T05:44:26.734 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2024-08-31T05:44:26.734 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.734 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.734 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.734 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2024-08-31T05:44:26.734 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.735 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.735 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.735 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.735 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.735 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.735 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.735 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.735 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:26.735 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:26.736 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.736 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:26.736 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.736 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:26.736 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.736 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.736 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.736 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.737 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.737 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.737 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.737 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.737 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.737 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.737 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:26.737 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "influx", 2024-08-31T05:44:26.738 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": false, 2024-08-31T05:44:26.738 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "influxdb python module not found", 2024-08-31T05:44:26.738 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:26.738 INFO:teuthology.orchestra.run.smithi005.stdout: "batch_size": { 2024-08-31T05:44:26.738 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "batch_size", 2024-08-31T05:44:26.738 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.738 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.738 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.739 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5000", 2024-08-31T05:44:26.739 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.739 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.739 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.739 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-08-31T05:44:26.739 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.739 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.739 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.739 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.740 INFO:teuthology.orchestra.run.smithi005.stdout: "database": { 2024-08-31T05:44:26.740 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "database", 2024-08-31T05:44:26.740 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.740 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.740 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.740 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "ceph", 2024-08-31T05:44:26.740 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.740 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.741 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.741 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-08-31T05:44:26.741 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.741 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.741 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.741 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.741 INFO:teuthology.orchestra.run.smithi005.stdout: "hostname": { 2024-08-31T05:44:26.741 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "hostname", 2024-08-31T05:44:26.742 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.742 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.742 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.742 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.742 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.742 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.742 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.742 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "InfluxDB server hostname", 2024-08-31T05:44:26.743 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.743 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.743 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.743 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.743 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2024-08-31T05:44:26.743 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2024-08-31T05:44:26.743 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:26.743 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.743 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.744 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "30", 2024-08-31T05:44:26.744 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "5", 2024-08-31T05:44:26.744 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.744 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.744 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-08-31T05:44:26.744 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.744 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.744 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.745 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.745 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:26.745 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:26.745 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.745 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.745 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.745 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.745 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.746 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.746 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.746 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.746 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.746 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.746 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.746 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.746 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.746 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.747 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.747 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.747 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.747 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.747 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.747 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:26.747 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:26.747 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.748 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.748 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.748 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.748 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.748 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.748 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.748 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.748 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.749 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.749 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.749 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.749 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:26.749 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:26.749 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.749 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.749 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.750 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:26.750 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.750 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.750 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.750 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.750 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.750 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.750 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.751 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.751 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.751 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.751 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.751 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.751 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.751 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.751 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.751 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:26.752 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:26.752 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.752 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.752 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.752 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.752 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.752 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.752 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.753 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.753 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.753 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.753 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.753 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.753 INFO:teuthology.orchestra.run.smithi005.stdout: "password": { 2024-08-31T05:44:26.753 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "password", 2024-08-31T05:44:26.753 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.754 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.754 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.754 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.754 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.754 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.754 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.754 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "password of InfluxDB server user", 2024-08-31T05:44:26.754 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.755 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.755 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.755 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.755 INFO:teuthology.orchestra.run.smithi005.stdout: "port": { 2024-08-31T05:44:26.755 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "port", 2024-08-31T05:44:26.755 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.755 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.755 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.755 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8086", 2024-08-31T05:44:26.756 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.756 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.756 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.756 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "InfluxDB server port", 2024-08-31T05:44:26.756 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.756 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.756 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.756 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.757 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:26.757 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:26.757 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.757 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:26.757 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.757 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:26.757 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.757 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.758 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.758 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.758 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.758 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.758 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.758 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.758 INFO:teuthology.orchestra.run.smithi005.stdout: "ssl": { 2024-08-31T05:44:26.758 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssl", 2024-08-31T05:44:26.758 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.759 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.759 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.759 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "false", 2024-08-31T05:44:26.759 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.759 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.759 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.759 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-08-31T05:44:26.759 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.760 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.760 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.760 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.760 INFO:teuthology.orchestra.run.smithi005.stdout: "threads": { 2024-08-31T05:44:26.760 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "threads", 2024-08-31T05:44:26.760 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.760 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.760 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.761 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2024-08-31T05:44:26.761 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2024-08-31T05:44:26.761 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "32", 2024-08-31T05:44:26.761 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.761 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-08-31T05:44:26.761 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.761 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.761 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.761 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.762 INFO:teuthology.orchestra.run.smithi005.stdout: "username": { 2024-08-31T05:44:26.762 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "username", 2024-08-31T05:44:26.762 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.762 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.762 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.762 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.762 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.762 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.763 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.763 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "username of InfluxDB server user", 2024-08-31T05:44:26.763 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.763 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.763 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.763 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.763 INFO:teuthology.orchestra.run.smithi005.stdout: "verify_ssl": { 2024-08-31T05:44:26.763 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "verify_ssl", 2024-08-31T05:44:26.764 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.764 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.764 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.764 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "true", 2024-08-31T05:44:26.764 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.764 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.764 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.764 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-08-31T05:44:26.765 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.765 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.765 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.765 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.765 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.765 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.765 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:26.765 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "insights", 2024-08-31T05:44:26.766 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:26.766 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:26.766 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:26.766 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:26.766 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:26.766 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.766 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.766 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.766 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.767 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.767 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.767 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.767 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.767 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.767 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.767 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.767 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.768 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.768 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.768 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.768 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.768 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.768 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.768 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.768 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:26.769 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:26.769 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.769 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.769 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.769 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.769 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.769 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.769 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.770 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.770 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.770 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.770 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.770 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.770 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:26.770 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:26.770 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.771 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.771 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.771 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:26.771 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.771 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.771 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.771 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.771 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.771 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.772 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.772 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.772 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.772 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.772 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.772 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.772 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.772 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.773 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.773 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:26.773 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:26.773 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.773 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.773 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.773 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.774 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.774 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.774 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.774 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.774 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.774 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.774 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.774 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.774 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:26.775 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:26.775 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.775 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:26.775 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.775 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:26.775 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.775 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.775 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.776 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.776 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.776 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.776 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.776 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.776 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.776 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.776 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:26.777 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "iostat", 2024-08-31T05:44:26.777 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:26.777 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:26.777 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:26.777 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:26.777 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:26.777 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.777 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.778 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.778 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.778 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.778 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.778 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.778 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.778 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.778 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.778 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.779 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.779 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.779 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.779 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.779 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.779 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.779 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.779 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.780 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:26.780 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:26.780 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.780 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.780 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.780 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.780 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.780 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.781 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.781 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.781 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.781 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.781 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.781 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.781 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:26.781 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:26.781 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.782 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.782 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.782 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:26.782 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.782 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.782 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.782 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.782 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.783 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.783 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.783 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.783 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.783 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.783 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.783 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.783 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.784 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.784 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.784 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:26.784 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:26.784 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.784 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.784 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.784 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.785 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.785 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.785 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.785 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.785 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.785 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.785 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.785 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.785 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:26.786 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:26.786 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.786 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:26.786 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.786 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:26.786 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.786 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.786 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.787 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.787 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.787 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.787 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.787 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.787 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.787 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.787 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:26.788 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "k8sevents", 2024-08-31T05:44:26.788 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:26.788 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:26.788 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:26.788 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_event_retention_days": { 2024-08-31T05:44:26.788 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ceph_event_retention_days", 2024-08-31T05:44:26.788 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.788 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.789 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.789 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "7", 2024-08-31T05:44:26.789 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.789 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.789 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.789 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Days to hold ceph event information within local cache", 2024-08-31T05:44:26.789 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.789 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.789 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.790 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.790 INFO:teuthology.orchestra.run.smithi005.stdout: "config_check_secs": { 2024-08-31T05:44:26.790 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "config_check_secs", 2024-08-31T05:44:26.790 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.790 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.790 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.790 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-08-31T05:44:26.790 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "10", 2024-08-31T05:44:26.791 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.791 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.791 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-08-31T05:44:26.791 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.791 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.791 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.791 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.791 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:26.792 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:26.792 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.792 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.792 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.792 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.792 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.792 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.792 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.793 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.793 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.793 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.793 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.793 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.793 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.793 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.793 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.794 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.794 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.794 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.794 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.794 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:26.794 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:26.794 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.794 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.795 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.795 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.795 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.795 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.795 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.795 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.795 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.795 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.795 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.796 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.796 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:26.796 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:26.796 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.796 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.796 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.796 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:26.797 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.797 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.797 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.797 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.797 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.797 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.797 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.797 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.797 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.798 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.798 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.798 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.798 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.798 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.798 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.798 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:26.798 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:26.799 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.799 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.799 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.799 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.799 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.799 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.799 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.799 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.800 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.800 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.800 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.800 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.800 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:26.800 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:26.800 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.800 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:26.801 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.801 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:26.801 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.801 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.801 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.801 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.801 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.801 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.802 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.802 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.802 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.802 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.802 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:26.802 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "localpool", 2024-08-31T05:44:26.802 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:26.802 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:26.802 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:26.803 INFO:teuthology.orchestra.run.smithi005.stdout: "failure_domain": { 2024-08-31T05:44:26.803 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "failure_domain", 2024-08-31T05:44:26.803 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.803 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.803 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.803 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "host", 2024-08-31T05:44:26.803 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.803 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.804 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.804 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "failure domain for any created local pool", 2024-08-31T05:44:26.804 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-08-31T05:44:26.804 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.804 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.804 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.804 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:26.804 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:26.805 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.805 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.805 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.805 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.805 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.805 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.805 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.805 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.806 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.806 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.806 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.806 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.806 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.806 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.806 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.806 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.806 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.807 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.807 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.807 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:26.807 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:26.807 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.807 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.807 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.807 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.808 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.808 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.808 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.808 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.808 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.808 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.808 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.808 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.808 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:26.809 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:26.809 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.809 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.809 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.809 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:26.809 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.809 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.809 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.810 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.810 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.810 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.810 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.810 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.810 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.810 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.810 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.811 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.811 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.811 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.811 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.811 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:26.811 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:26.811 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.811 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.812 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.812 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.812 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.812 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.812 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.812 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.812 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.812 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.813 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.813 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.813 INFO:teuthology.orchestra.run.smithi005.stdout: "min_size": { 2024-08-31T05:44:26.813 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "min_size", 2024-08-31T05:44:26.813 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.813 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.813 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.813 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.813 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.814 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.814 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.814 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "default min_size for any created local pool", 2024-08-31T05:44:26.814 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-08-31T05:44:26.814 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.814 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.814 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.814 INFO:teuthology.orchestra.run.smithi005.stdout: "num_rep": { 2024-08-31T05:44:26.815 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "num_rep", 2024-08-31T05:44:26.815 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.815 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.815 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.815 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "3", 2024-08-31T05:44:26.815 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.815 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.815 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.816 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "default replica count for any created local pool", 2024-08-31T05:44:26.816 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.816 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.816 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.816 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.816 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num": { 2024-08-31T05:44:26.816 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pg_num", 2024-08-31T05:44:26.816 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.817 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.817 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.817 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "128", 2024-08-31T05:44:26.817 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.817 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.817 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.817 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "default pg_num for any created local pool", 2024-08-31T05:44:26.817 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.818 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.818 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.818 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.818 INFO:teuthology.orchestra.run.smithi005.stdout: "prefix": { 2024-08-31T05:44:26.818 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "prefix", 2024-08-31T05:44:26.818 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.818 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.818 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.818 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.819 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.819 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.819 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.819 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "name prefix for any created local pool", 2024-08-31T05:44:26.819 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.819 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.819 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.820 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.820 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:26.820 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:26.820 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.820 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:26.820 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.820 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:26.820 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.820 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.821 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.821 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.821 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.821 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.821 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.821 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.821 INFO:teuthology.orchestra.run.smithi005.stdout: "subtree": { 2024-08-31T05:44:26.821 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "subtree", 2024-08-31T05:44:26.822 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.822 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.822 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.822 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "rack", 2024-08-31T05:44:26.822 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.822 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.822 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.822 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "CRUSH level for which to create a local pool", 2024-08-31T05:44:26.823 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-08-31T05:44:26.823 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.823 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.823 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.823 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.823 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.823 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:26.823 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mds_autoscaler", 2024-08-31T05:44:26.823 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:26.824 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:26.824 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:26.824 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:26.824 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:26.824 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.824 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.824 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.824 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.825 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.825 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.825 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.825 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.825 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.825 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.825 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.825 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.826 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.826 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.826 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.826 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.826 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.826 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.826 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.826 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:26.826 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:26.827 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.827 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.827 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.827 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.827 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.827 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.827 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.827 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.828 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.828 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.828 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.828 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.828 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:26.828 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:26.828 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.828 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.829 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.829 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:26.829 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.829 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.829 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.829 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.829 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.829 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.830 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.830 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.830 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.830 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.830 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.830 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.830 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.830 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.830 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.831 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:26.831 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:26.831 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.831 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.831 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.831 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.831 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.831 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.832 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.832 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.832 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.832 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.832 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.832 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.832 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:26.832 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:26.832 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.833 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:26.833 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.833 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:26.833 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.833 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.833 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.833 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.833 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.834 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.834 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.834 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.834 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.834 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.834 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:26.834 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mirroring", 2024-08-31T05:44:26.834 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:26.835 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:26.835 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:26.835 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:26.835 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:26.835 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.835 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.835 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.835 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.835 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.836 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.836 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.836 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.836 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.836 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.836 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.836 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.836 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.837 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.837 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.837 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.837 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.837 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.837 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.837 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:26.837 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:26.838 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.838 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.838 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.838 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.838 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.838 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.838 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.838 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.838 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.839 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.839 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.839 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.839 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:26.839 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:26.839 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.839 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.839 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.840 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:26.840 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.840 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.840 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.840 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.840 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.840 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.840 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.841 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.841 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.841 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.841 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.841 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.841 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.841 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.841 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.841 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:26.842 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:26.842 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.842 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.842 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.842 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.842 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.842 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.842 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.843 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.843 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.843 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.843 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.843 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.843 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:26.843 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:26.843 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.844 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:26.844 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.844 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:26.844 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.844 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.844 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.844 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.844 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.845 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.845 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.845 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.845 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.845 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.845 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:26.845 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "nfs", 2024-08-31T05:44:26.845 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:26.846 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:26.846 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:26.846 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:26.846 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:26.846 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.846 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.846 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.846 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.846 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.847 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.847 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.847 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.847 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.847 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.847 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.847 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.847 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.848 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.848 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.848 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.848 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.848 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.848 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.848 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:26.848 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:26.849 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.849 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.849 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.849 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.849 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.849 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.849 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.849 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.850 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.850 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.850 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.850 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.850 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:26.850 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:26.850 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.850 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.851 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.851 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:26.851 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.851 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.851 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.851 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.851 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.851 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.851 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.852 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.852 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.852 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.852 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.852 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.852 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.852 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.852 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.853 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:26.853 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:26.853 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.853 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.853 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.853 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.853 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.853 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.854 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.854 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.854 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.854 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.854 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.854 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.854 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:26.854 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:26.854 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.855 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:26.855 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.855 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:26.855 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.855 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.855 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.855 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.855 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.856 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.856 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.856 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.856 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.856 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.856 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:26.856 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "orchestrator", 2024-08-31T05:44:26.856 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:26.857 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:26.857 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:26.857 INFO:teuthology.orchestra.run.smithi005.stdout: "fail_fs": { 2024-08-31T05:44:26.857 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "fail_fs", 2024-08-31T05:44:26.857 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.857 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.857 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.857 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.858 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.858 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.858 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.858 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-08-31T05:44:26.858 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.858 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.858 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.858 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.859 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:26.859 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:26.859 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.859 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.859 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.859 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.859 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.859 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.859 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.860 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.860 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.860 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.860 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.860 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.860 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.860 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.860 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.861 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.861 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.861 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.861 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.861 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:26.861 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:26.861 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.861 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.862 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.862 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.862 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.862 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.862 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.862 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.862 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.862 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.862 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.863 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.863 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:26.863 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:26.863 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.863 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.863 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.863 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:26.863 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.864 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.864 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.864 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.864 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.864 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.864 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.864 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.864 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.865 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.865 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.865 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.865 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.865 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.865 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.865 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:26.865 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:26.865 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.866 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.866 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.866 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.866 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.866 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.866 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.866 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.867 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.867 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.867 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.867 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.867 INFO:teuthology.orchestra.run.smithi005.stdout: "orchestrator": { 2024-08-31T05:44:26.867 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "orchestrator", 2024-08-31T05:44:26.867 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.867 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.867 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.868 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.868 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.868 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.868 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.868 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm", 2024-08-31T05:44:26.868 INFO:teuthology.orchestra.run.smithi005.stdout: "rook", 2024-08-31T05:44:26.868 INFO:teuthology.orchestra.run.smithi005.stdout: "test_orchestrator" 2024-08-31T05:44:26.868 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.869 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Orchestrator backend", 2024-08-31T05:44:26.869 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.869 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.869 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.869 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.869 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:26.869 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:26.869 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.870 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:26.870 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.870 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:26.870 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.870 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.870 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.870 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.870 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.871 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.871 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.871 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.871 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.871 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.871 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:26.871 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "osd_perf_query", 2024-08-31T05:44:26.871 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:26.871 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:26.872 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:26.872 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:26.872 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:26.872 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.872 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.872 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.872 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.872 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.873 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.873 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.873 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.873 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.873 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.873 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.873 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.873 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.874 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.874 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.874 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.874 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.874 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.874 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.874 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:26.874 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:26.874 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.875 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.875 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.875 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.875 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.875 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.875 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.875 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.875 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.876 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.876 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.876 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.876 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:26.876 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:26.876 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.876 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.876 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.877 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:26.877 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.877 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.877 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.877 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.877 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.877 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.877 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.878 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.878 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.878 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.878 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.878 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.878 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.878 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.878 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.879 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:26.879 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:26.879 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.879 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.879 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.879 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.879 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.879 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.879 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.880 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.880 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.880 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.880 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.880 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.880 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:26.880 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:26.880 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.881 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:26.881 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.881 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:26.881 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.881 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.881 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.881 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.881 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.882 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.882 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.882 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.882 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.882 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.882 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:26.882 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "osd_support", 2024-08-31T05:44:26.882 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:26.883 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:26.883 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:26.883 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:26.883 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:26.883 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.883 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.883 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.883 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.884 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.884 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.884 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.884 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.884 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.884 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.884 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.884 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.885 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.885 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.885 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.885 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.885 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.885 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.885 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.885 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:26.886 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:26.886 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.886 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.886 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.886 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.886 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.886 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.886 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.886 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.887 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.887 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.887 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.887 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.887 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:26.887 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:26.887 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.887 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.888 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.888 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:26.888 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.888 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.888 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.888 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.888 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.888 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.889 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.889 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.889 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.889 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.889 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.889 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.889 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.889 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.889 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.890 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:26.890 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:26.890 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.890 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.890 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.890 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.890 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.890 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.891 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.891 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.891 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.891 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.891 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.891 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.891 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:26.891 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:26.892 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.892 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:26.892 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.892 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:26.892 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.892 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.892 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.893 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.893 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.893 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.893 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.893 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.893 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.893 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.893 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:26.893 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pg_autoscaler", 2024-08-31T05:44:26.894 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:26.894 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:26.894 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:26.894 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:26.894 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:26.894 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.894 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.894 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.895 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.895 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.895 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.895 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.895 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.895 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.895 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.895 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.895 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.896 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.896 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.896 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.896 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.896 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.896 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.896 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.896 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:26.897 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:26.897 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.897 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.897 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.897 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.897 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.897 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.897 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.898 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.898 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.898 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.898 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.898 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.898 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:26.898 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:26.898 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.898 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.899 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.899 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:26.899 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.899 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.899 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.899 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.899 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.899 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.900 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.900 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.900 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.900 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.900 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.900 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.900 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.900 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.901 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.901 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:26.901 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:26.901 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.901 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.901 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.901 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.901 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.902 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.902 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.902 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.902 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.902 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.902 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.904 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.904 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2024-08-31T05:44:26.904 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2024-08-31T05:44:26.904 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:26.904 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.904 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.904 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2024-08-31T05:44:26.905 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.905 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.905 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.905 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.905 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.905 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.905 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.905 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.906 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:26.906 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:26.906 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.906 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:26.906 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.906 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:26.906 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.906 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.906 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.907 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.907 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.907 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.907 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.907 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.907 INFO:teuthology.orchestra.run.smithi005.stdout: "threshold": { 2024-08-31T05:44:26.907 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "threshold", 2024-08-31T05:44:26.907 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-08-31T05:44:26.908 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.908 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.908 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "3.0", 2024-08-31T05:44:26.908 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1.0", 2024-08-31T05:44:26.908 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.908 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.908 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "scaling threshold", 2024-08-31T05:44:26.908 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-08-31T05:44:26.909 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.909 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.909 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.909 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.909 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.909 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:26.909 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "progress", 2024-08-31T05:44:26.909 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:26.909 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:26.910 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:26.910 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_pg_recovery_event": { 2024-08-31T05:44:26.910 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "allow_pg_recovery_event", 2024-08-31T05:44:26.910 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.910 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.910 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.910 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.910 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.911 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.911 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.911 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "allow the module to show pg recovery progress", 2024-08-31T05:44:26.911 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.911 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.911 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.911 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.911 INFO:teuthology.orchestra.run.smithi005.stdout: "enabled": { 2024-08-31T05:44:26.912 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enabled", 2024-08-31T05:44:26.912 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.912 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.912 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.912 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:26.912 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.912 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.912 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.913 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.913 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.913 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.913 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.913 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.913 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:26.913 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:26.913 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.914 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.914 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.914 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.914 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.914 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.914 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.914 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.914 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.914 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.915 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.915 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.915 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.915 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.915 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.915 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.915 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.915 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.916 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.916 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:26.916 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:26.916 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.916 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.916 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.916 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.916 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.917 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.917 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.917 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.917 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.917 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.917 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.917 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.917 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:26.918 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:26.918 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.918 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.918 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.918 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:26.918 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.918 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.918 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.919 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.919 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.919 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.919 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.919 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.919 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.919 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.919 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.919 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.920 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.920 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.920 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.920 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:26.920 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:26.920 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.920 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.920 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.921 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.921 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.921 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.921 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.921 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.921 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.921 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.921 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.922 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.922 INFO:teuthology.orchestra.run.smithi005.stdout: "max_completed_events": { 2024-08-31T05:44:26.922 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_completed_events", 2024-08-31T05:44:26.922 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.922 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.922 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.922 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "50", 2024-08-31T05:44:26.922 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.922 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.923 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.923 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "number of past completed events to remember", 2024-08-31T05:44:26.923 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.923 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.923 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.923 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.923 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2024-08-31T05:44:26.923 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2024-08-31T05:44:26.924 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:26.924 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.924 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.924 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2024-08-31T05:44:26.924 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.924 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.924 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.924 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how long the module is going to sleep", 2024-08-31T05:44:26.924 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.925 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.925 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.925 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.925 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:26.925 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:26.925 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.925 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:26.925 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.926 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:26.926 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.926 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.926 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.926 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.926 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.926 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.926 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.927 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.927 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.927 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.927 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:26.927 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "prometheus", 2024-08-31T05:44:26.927 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:26.927 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:26.927 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:26.927 INFO:teuthology.orchestra.run.smithi005.stdout: "cache": { 2024-08-31T05:44:26.928 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cache", 2024-08-31T05:44:26.928 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.928 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.928 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.928 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:26.928 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.928 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.928 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.929 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.929 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.929 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.929 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.929 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.929 INFO:teuthology.orchestra.run.smithi005.stdout: "exclude_perf_counters": { 2024-08-31T05:44:26.929 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "exclude_perf_counters", 2024-08-31T05:44:26.929 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.930 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.930 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.930 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:26.930 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.930 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.930 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.930 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-08-31T05:44:26.930 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-08-31T05:44:26.930 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.931 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.931 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.931 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:26.931 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:26.931 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.931 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.931 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.931 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.932 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.932 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.932 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.932 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.932 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.932 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.932 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.932 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.933 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.933 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.933 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.933 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.933 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.933 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.933 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.933 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:26.933 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:26.934 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.934 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.934 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.934 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.934 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.934 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.934 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.934 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.935 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.935 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.935 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.935 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.935 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:26.935 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:26.935 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.935 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.936 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.936 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:26.936 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.936 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.936 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.936 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.936 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.936 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.936 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.937 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.937 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.937 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.937 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.937 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.937 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.937 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.938 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.938 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:26.938 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:26.938 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.938 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.938 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.938 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.938 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.938 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.939 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.939 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.939 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.939 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.939 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.939 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.939 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_stats_pools": { 2024-08-31T05:44:26.939 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_stats_pools", 2024-08-31T05:44:26.940 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.940 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.940 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.940 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.940 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.940 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.940 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.940 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.941 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.941 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.941 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.941 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.941 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_stats_pools_refresh_interval": { 2024-08-31T05:44:26.941 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-08-31T05:44:26.941 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.941 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.941 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.942 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "300", 2024-08-31T05:44:26.942 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.942 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.942 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.942 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.942 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.942 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.942 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.943 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.943 INFO:teuthology.orchestra.run.smithi005.stdout: "scrape_interval": { 2024-08-31T05:44:26.943 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "scrape_interval", 2024-08-31T05:44:26.943 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-08-31T05:44:26.943 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.943 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.943 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "15.0", 2024-08-31T05:44:26.943 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.944 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.944 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.944 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.944 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.944 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.944 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.944 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.944 INFO:teuthology.orchestra.run.smithi005.stdout: "server_addr": { 2024-08-31T05:44:26.944 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_addr", 2024-08-31T05:44:26.945 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.945 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.945 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.945 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "::", 2024-08-31T05:44:26.945 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.945 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.945 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.945 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-08-31T05:44:26.946 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.946 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.946 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.946 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.946 INFO:teuthology.orchestra.run.smithi005.stdout: "server_port": { 2024-08-31T05:44:26.946 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_port", 2024-08-31T05:44:26.946 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.946 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.947 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.947 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "9283", 2024-08-31T05:44:26.947 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.947 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.947 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.947 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-08-31T05:44:26.947 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.947 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.947 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.948 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.948 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:26.948 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:26.948 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.948 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:26.948 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.948 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:26.948 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.949 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.949 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.949 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.949 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.949 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.949 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.949 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.949 INFO:teuthology.orchestra.run.smithi005.stdout: "stale_cache_strategy": { 2024-08-31T05:44:26.950 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "stale_cache_strategy", 2024-08-31T05:44:26.950 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.950 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.950 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.950 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "log", 2024-08-31T05:44:26.950 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.950 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.950 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.950 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.951 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.951 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.951 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.951 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.951 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_behaviour": { 2024-08-31T05:44:26.951 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_behaviour", 2024-08-31T05:44:26.951 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.951 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.952 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.952 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "default", 2024-08-31T05:44:26.952 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.952 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.952 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.952 INFO:teuthology.orchestra.run.smithi005.stdout: "default", 2024-08-31T05:44:26.952 INFO:teuthology.orchestra.run.smithi005.stdout: "error" 2024-08-31T05:44:26.952 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.953 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.953 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.953 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.953 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.953 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.953 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_error_status_code": { 2024-08-31T05:44:26.953 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_error_status_code", 2024-08-31T05:44:26.953 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.953 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.954 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.954 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "500", 2024-08-31T05:44:26.954 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "400", 2024-08-31T05:44:26.954 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "599", 2024-08-31T05:44:26.954 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.954 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.954 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.954 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.955 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.955 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.955 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.955 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.955 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:26.955 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_support", 2024-08-31T05:44:26.955 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:26.955 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:26.955 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:26.956 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:26.956 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:26.956 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.956 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.956 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.956 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.956 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.956 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.957 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.957 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.957 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.957 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.957 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.957 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.957 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.957 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.958 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.958 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.958 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.958 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.958 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.958 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:26.958 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:26.958 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.959 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.959 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.959 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.959 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.959 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.959 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.959 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.959 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.959 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.960 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.960 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.960 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:26.960 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:26.960 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.960 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.960 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.961 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:26.961 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.961 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.961 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.961 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.961 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.961 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.961 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.961 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.962 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.962 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.962 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.962 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.962 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.962 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.962 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.962 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:26.963 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:26.963 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.963 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.963 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.963 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.963 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.963 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.963 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.964 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.964 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.964 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.964 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.964 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.964 INFO:teuthology.orchestra.run.smithi005.stdout: "max_concurrent_snap_create": { 2024-08-31T05:44:26.964 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_concurrent_snap_create", 2024-08-31T05:44:26.964 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.964 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.965 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.965 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-08-31T05:44:26.965 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.965 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.965 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.965 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.965 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.965 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.966 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.966 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.966 INFO:teuthology.orchestra.run.smithi005.stdout: "mirror_snapshot_schedule": { 2024-08-31T05:44:26.966 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mirror_snapshot_schedule", 2024-08-31T05:44:26.966 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.966 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.966 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.966 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.967 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.967 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.967 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.967 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.967 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.967 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.967 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.967 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.967 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:26.968 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:26.968 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.968 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:26.968 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.968 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:26.968 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.968 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.968 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.969 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.969 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.969 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.969 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.969 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.969 INFO:teuthology.orchestra.run.smithi005.stdout: "trash_purge_schedule": { 2024-08-31T05:44:26.969 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "trash_purge_schedule", 2024-08-31T05:44:26.969 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.970 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.970 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.970 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.970 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.970 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.970 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.970 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.970 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.971 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.971 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.971 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.971 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.971 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.971 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:26.971 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "restful", 2024-08-31T05:44:26.971 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:26.971 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:26.972 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:26.972 INFO:teuthology.orchestra.run.smithi005.stdout: "enable_auth": { 2024-08-31T05:44:26.972 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enable_auth", 2024-08-31T05:44:26.972 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.972 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.972 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.972 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:26.972 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.973 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.973 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.973 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.973 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.973 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.973 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.973 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.973 INFO:teuthology.orchestra.run.smithi005.stdout: "key_file": { 2024-08-31T05:44:26.974 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "key_file", 2024-08-31T05:44:26.974 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.974 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.974 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.974 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.974 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.974 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.974 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.975 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.975 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.975 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.975 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.975 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.975 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:26.975 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:26.975 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.976 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.976 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.976 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.976 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.976 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.976 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.976 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.976 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.977 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.977 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.977 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.977 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.977 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.977 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.977 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.977 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.977 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.978 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.978 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:26.978 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:26.978 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.978 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.978 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.978 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.978 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.979 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.979 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.979 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.979 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.979 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.979 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.979 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.979 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:26.980 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:26.980 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.980 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.980 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.980 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:26.980 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.980 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.980 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.981 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.981 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.981 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.981 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.981 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.981 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.981 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.981 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.982 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.982 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.982 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.982 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.982 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:26.982 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:26.982 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.982 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.982 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.983 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.983 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.983 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.983 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.983 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.983 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.983 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.984 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.984 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.984 INFO:teuthology.orchestra.run.smithi005.stdout: "max_requests": { 2024-08-31T05:44:26.984 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_requests", 2024-08-31T05:44:26.984 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.984 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.984 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.984 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "500", 2024-08-31T05:44:26.985 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.985 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.985 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.985 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-08-31T05:44:26.985 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.985 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.985 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.985 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.985 INFO:teuthology.orchestra.run.smithi005.stdout: "server_addr": { 2024-08-31T05:44:26.986 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_addr", 2024-08-31T05:44:26.986 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.986 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.986 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.986 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.986 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.986 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.986 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.987 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.987 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.987 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.987 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.987 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.987 INFO:teuthology.orchestra.run.smithi005.stdout: "server_port": { 2024-08-31T05:44:26.987 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_port", 2024-08-31T05:44:26.987 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.988 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.988 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:26.988 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.988 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.988 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.988 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.988 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.988 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.989 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.989 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.989 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.989 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:26.989 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:26.989 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:26.989 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:26.989 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.989 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:26.990 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.990 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.990 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.990 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.990 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.990 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.990 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.990 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.991 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:26.991 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.991 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:26.991 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rgw", 2024-08-31T05:44:26.991 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:26.991 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:26.991 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:26.991 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:26.992 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:26.992 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.992 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.992 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.992 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:26.992 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.992 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.992 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.993 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.993 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.993 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.993 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.993 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.993 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.993 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.993 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.993 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.994 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.994 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.994 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.994 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:26.994 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:26.994 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.994 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.994 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.995 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.995 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.995 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.995 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.995 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.995 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.995 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.995 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.996 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.996 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:26.996 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:26.996 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:26.996 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.996 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.996 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:26.996 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.997 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.997 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:26.997 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:26.997 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:26.997 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:26.997 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:26.997 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:26.997 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:26.997 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:26.998 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.998 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:26.998 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:26.998 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:26.998 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:26.998 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:26.998 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:26.998 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:26.999 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:26.999 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:26.999 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:26.999 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:26.999 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:26.999 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:26.999 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:26.999 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.000 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.000 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.000 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.000 INFO:teuthology.orchestra.run.smithi005.stdout: "secondary_zone_period_retry_limit": { 2024-08-31T05:44:27.000 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "secondary_zone_period_retry_limit", 2024-08-31T05:44:27.000 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.000 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.000 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.001 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2024-08-31T05:44:27.001 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.001 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.001 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.001 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-08-31T05:44:27.001 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.001 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.001 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.001 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.002 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:27.002 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:27.002 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.002 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:27.002 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.002 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:27.002 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.002 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.003 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.003 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.003 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.003 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.003 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.003 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.003 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.003 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.004 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:27.004 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rook", 2024-08-31T05:44:27.004 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:27.004 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:27.004 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:27.004 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:27.004 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:27.004 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.004 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.005 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.005 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.005 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.005 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.005 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.005 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.005 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.005 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.006 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.006 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.006 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.006 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.006 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.006 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.006 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.006 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.007 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.007 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:27.007 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:27.007 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.007 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.007 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.007 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.007 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.008 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.008 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.008 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.008 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.008 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.008 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.008 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.008 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:27.009 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:27.009 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.009 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.009 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.009 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:27.009 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.009 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.009 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.010 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.010 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.010 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.010 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.010 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.010 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.010 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.010 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.010 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.011 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.011 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.011 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.011 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:27.011 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:27.011 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.011 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.011 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.012 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.012 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.012 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.012 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.012 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.012 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.012 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.012 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.013 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.013 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:27.013 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:27.013 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.013 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:27.013 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.013 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:27.013 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.014 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.014 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.014 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.014 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.014 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.014 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.014 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.014 INFO:teuthology.orchestra.run.smithi005.stdout: "storage_class": { 2024-08-31T05:44:27.014 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "storage_class", 2024-08-31T05:44:27.015 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.015 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.015 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.015 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "local", 2024-08-31T05:44:27.015 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.015 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.015 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.015 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-08-31T05:44:27.016 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.016 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.016 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.016 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.016 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.016 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.016 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:27.016 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "selftest", 2024-08-31T05:44:27.017 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:27.017 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:27.017 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:27.017 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:27.017 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:27.017 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.017 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.017 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.017 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.018 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.018 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.018 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.018 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.018 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.018 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.018 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.018 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.019 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.019 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.019 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.019 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.019 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.019 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.019 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.019 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:27.020 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:27.020 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.020 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.020 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.020 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.020 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.020 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.020 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.021 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.021 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.021 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.021 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.021 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.021 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:27.021 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:27.021 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.021 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.022 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.022 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:27.022 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.022 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.022 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.022 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.022 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.022 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.023 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.023 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.023 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.023 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.023 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.023 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.023 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.023 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.023 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.024 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:27.024 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:27.024 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.024 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.024 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.024 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.024 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.024 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.025 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.025 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.025 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.025 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.025 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.025 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.025 INFO:teuthology.orchestra.run.smithi005.stdout: "roption1": { 2024-08-31T05:44:27.025 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "roption1", 2024-08-31T05:44:27.026 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.026 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.026 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.026 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.026 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.026 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.026 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.026 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.026 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.027 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.027 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.027 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.027 INFO:teuthology.orchestra.run.smithi005.stdout: "roption2": { 2024-08-31T05:44:27.027 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "roption2", 2024-08-31T05:44:27.027 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.027 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.027 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.028 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "xyz", 2024-08-31T05:44:27.028 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.028 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.028 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.028 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.028 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.028 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.028 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.029 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.029 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption1": { 2024-08-31T05:44:27.029 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption1", 2024-08-31T05:44:27.029 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.029 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.029 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.029 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.029 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.029 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.030 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.030 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.030 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.030 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.030 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.030 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.030 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption2": { 2024-08-31T05:44:27.030 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption2", 2024-08-31T05:44:27.031 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.031 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.031 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.031 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.031 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.031 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.031 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.031 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.032 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.032 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.032 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.032 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.032 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption3": { 2024-08-31T05:44:27.032 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption3", 2024-08-31T05:44:27.032 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-08-31T05:44:27.032 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.033 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.033 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.033 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.033 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.033 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.033 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.033 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.033 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.033 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.034 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.034 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption4": { 2024-08-31T05:44:27.034 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption4", 2024-08-31T05:44:27.034 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.034 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.034 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.034 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.034 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.035 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.035 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.035 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.035 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.035 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.035 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.035 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.035 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption5": { 2024-08-31T05:44:27.036 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption5", 2024-08-31T05:44:27.036 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.036 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.036 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.036 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.036 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.036 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.036 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.037 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.037 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.037 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.037 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.037 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.037 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption6": { 2024-08-31T05:44:27.037 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption6", 2024-08-31T05:44:27.037 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.037 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.038 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.038 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:27.038 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.038 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.038 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.038 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.038 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.038 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.039 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.039 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.039 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption7": { 2024-08-31T05:44:27.039 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption7", 2024-08-31T05:44:27.039 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.039 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.039 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.039 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.040 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2024-08-31T05:44:27.040 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "42", 2024-08-31T05:44:27.040 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.040 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.040 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.040 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.040 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.040 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.041 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:27.041 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:27.041 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.041 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:27.041 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.041 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:27.041 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.041 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.041 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.042 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.042 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.042 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.042 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.042 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.042 INFO:teuthology.orchestra.run.smithi005.stdout: "testkey": { 2024-08-31T05:44:27.042 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "testkey", 2024-08-31T05:44:27.042 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.043 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.043 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.043 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.043 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.043 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.043 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.043 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.043 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.044 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.044 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.044 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.044 INFO:teuthology.orchestra.run.smithi005.stdout: "testlkey": { 2024-08-31T05:44:27.044 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "testlkey", 2024-08-31T05:44:27.044 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.044 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.044 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.044 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.045 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.045 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.045 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.045 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.045 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.045 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.045 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.045 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.046 INFO:teuthology.orchestra.run.smithi005.stdout: "testnewline": { 2024-08-31T05:44:27.046 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "testnewline", 2024-08-31T05:44:27.046 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.046 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.046 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.046 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.046 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.046 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.047 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.047 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.047 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.047 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.047 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.047 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.047 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.047 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.047 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:27.048 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smb", 2024-08-31T05:44:27.048 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:27.048 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:27.048 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:27.048 INFO:teuthology.orchestra.run.smithi005.stdout: "internal_store_backend": { 2024-08-31T05:44:27.048 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "internal_store_backend", 2024-08-31T05:44:27.048 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.048 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:27.049 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.049 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.049 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.049 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.049 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.049 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-08-31T05:44:27.049 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.049 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.050 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.050 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.050 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:27.050 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:27.050 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.050 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.050 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.050 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.051 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.051 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.051 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.051 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.051 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.051 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.051 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.051 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.051 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.052 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.052 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.052 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.052 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.052 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.052 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.052 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:27.052 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:27.053 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.053 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.053 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.053 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.053 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.053 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.053 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.054 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.054 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.054 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.054 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.054 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.054 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:27.054 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:27.054 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.054 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.055 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.055 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:27.055 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.055 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.055 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.055 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.055 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.055 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.056 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.056 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.056 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.056 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.056 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.056 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.056 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.056 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.057 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.057 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:27.057 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:27.057 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.057 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.057 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.057 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.057 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.058 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.058 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.058 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.058 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.058 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.058 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.058 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.058 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:27.058 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:27.059 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.059 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:27.059 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.059 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:27.059 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.059 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.059 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.059 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.060 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.060 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.060 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.060 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.060 INFO:teuthology.orchestra.run.smithi005.stdout: "update_orchestration": { 2024-08-31T05:44:27.060 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "update_orchestration", 2024-08-31T05:44:27.060 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.060 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.061 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.061 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:27.061 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.061 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.061 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.061 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-08-31T05:44:27.061 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.061 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.062 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.062 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.062 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.062 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.062 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:27.062 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "snap_schedule", 2024-08-31T05:44:27.062 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:27.062 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:27.063 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:27.063 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_m_granularity": { 2024-08-31T05:44:27.063 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "allow_m_granularity", 2024-08-31T05:44:27.063 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.063 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.063 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.063 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.063 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.063 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.064 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.064 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "allow minute scheduled snapshots", 2024-08-31T05:44:27.064 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.064 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.064 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.064 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.064 INFO:teuthology.orchestra.run.smithi005.stdout: "dump_on_update": { 2024-08-31T05:44:27.064 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "dump_on_update", 2024-08-31T05:44:27.065 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.065 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.065 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.065 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.065 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.065 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.065 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.065 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "dump database to debug log on update", 2024-08-31T05:44:27.066 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.066 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.066 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.066 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.066 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:27.066 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:27.066 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.066 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.067 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.067 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.067 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.067 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.067 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.067 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.067 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.067 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.067 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.068 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.068 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.068 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.068 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.068 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.068 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.068 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.068 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.069 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:27.069 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:27.069 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.069 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.069 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.069 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.069 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.069 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.070 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.070 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.070 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.070 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.070 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.070 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.070 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:27.070 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:27.071 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.071 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.071 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.071 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:27.071 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.071 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.071 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.071 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.072 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.072 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.072 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.072 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.072 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.072 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.072 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.072 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.073 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.073 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.073 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.073 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:27.073 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:27.073 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.073 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.073 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.073 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.074 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.074 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.074 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.074 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.074 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.074 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.074 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.074 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.075 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:27.075 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:27.075 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.075 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:27.075 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.075 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:27.075 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.075 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.076 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.076 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.076 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.076 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.076 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.076 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.076 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.076 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.077 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:27.077 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "stats", 2024-08-31T05:44:27.077 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:27.077 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:27.077 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:27.077 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:27.077 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:27.077 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.078 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.078 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.078 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.078 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.078 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.078 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.078 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.078 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.079 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.079 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.079 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.079 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.079 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.079 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.079 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.079 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.080 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.080 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.080 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:27.080 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:27.080 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.080 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.080 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.080 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.081 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.081 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.081 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.081 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.081 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.081 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.081 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.081 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.082 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:27.082 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:27.082 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.082 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.082 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.082 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:27.082 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.082 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.082 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.083 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.083 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.083 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.083 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.083 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.083 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.083 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.083 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.084 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.084 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.084 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.084 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.084 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:27.084 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:27.084 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.084 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.085 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.085 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.085 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.085 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.085 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.085 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.085 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.085 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.086 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.086 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.086 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:27.086 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:27.086 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.086 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:27.086 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.086 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:27.087 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.087 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.087 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.087 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.087 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.087 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.087 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.087 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.087 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.088 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.088 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:27.088 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "status", 2024-08-31T05:44:27.088 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:27.088 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:27.088 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:27.088 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:27.088 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:27.089 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.089 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.089 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.089 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.089 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.089 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.089 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.089 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.090 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.090 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.090 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.090 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.090 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.090 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.090 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.090 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.090 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.091 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.091 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.091 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:27.091 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:27.091 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.091 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.091 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.091 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.092 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.092 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.092 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.092 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.092 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.092 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.092 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.092 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.093 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:27.093 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:27.093 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.093 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.093 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.093 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:27.093 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.093 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.093 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.094 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.094 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.094 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.094 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.094 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.094 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.094 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.094 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.095 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.095 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.095 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.095 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.095 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:27.095 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:27.095 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.095 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.095 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.096 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.096 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.096 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.096 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.096 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.096 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.096 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.096 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.097 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.097 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:27.097 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:27.097 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.097 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:27.097 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.097 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:27.097 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.098 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.098 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.098 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.098 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.098 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.098 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.098 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.098 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.098 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.099 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:27.099 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "telegraf", 2024-08-31T05:44:27.099 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:27.099 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:27.099 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:27.099 INFO:teuthology.orchestra.run.smithi005.stdout: "address": { 2024-08-31T05:44:27.099 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "address", 2024-08-31T05:44:27.099 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.100 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.100 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.100 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-08-31T05:44:27.100 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.100 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.100 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.100 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.100 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.101 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.101 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.101 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.101 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2024-08-31T05:44:27.101 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2024-08-31T05:44:27.101 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:27.101 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.101 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.102 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "15", 2024-08-31T05:44:27.102 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.102 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.102 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.102 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.102 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.102 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.102 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.102 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.103 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:27.103 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:27.103 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.103 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.103 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.103 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.103 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.103 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.104 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.104 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.104 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.104 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.104 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.104 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.104 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.104 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.105 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.105 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.105 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.105 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.105 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.105 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:27.105 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:27.105 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.105 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.106 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.106 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.106 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.106 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.106 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.106 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.106 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.106 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.107 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.107 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.107 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:27.107 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:27.107 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.107 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.107 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.107 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:27.108 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.108 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.108 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.108 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.108 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.108 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.108 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.108 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.109 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.109 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.109 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.109 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.109 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.109 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.109 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.109 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:27.110 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:27.110 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.110 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.110 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.110 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.110 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.110 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.110 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.110 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.111 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.111 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.111 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.111 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.111 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:27.111 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:27.111 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.111 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:27.112 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.112 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:27.112 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.112 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.112 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.112 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.112 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.112 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.113 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.113 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.113 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.113 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.113 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:27.113 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "telemetry", 2024-08-31T05:44:27.113 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:27.113 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:27.113 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:27.114 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_basic": { 2024-08-31T05:44:27.114 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_basic", 2024-08-31T05:44:27.114 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.114 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.114 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.114 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:27.114 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.114 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.115 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.115 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share basic cluster information (size, version)", 2024-08-31T05:44:27.115 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.115 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.115 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.115 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.115 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_crash": { 2024-08-31T05:44:27.115 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_crash", 2024-08-31T05:44:27.115 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.116 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.116 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.116 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:27.116 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.116 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.116 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.116 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-08-31T05:44:27.116 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.117 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.117 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.117 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.117 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_device": { 2024-08-31T05:44:27.117 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_device", 2024-08-31T05:44:27.117 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.117 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.117 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.118 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:27.118 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.118 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.118 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.118 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-08-31T05:44:27.118 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.118 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.118 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.118 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.119 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_ident": { 2024-08-31T05:44:27.119 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_ident", 2024-08-31T05:44:27.119 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.119 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.119 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.119 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.119 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.120 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.120 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.120 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-08-31T05:44:27.120 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.120 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.120 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.120 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.120 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_perf": { 2024-08-31T05:44:27.120 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_perf", 2024-08-31T05:44:27.121 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.121 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.121 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.121 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.121 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.121 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.121 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.121 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share various performance metrics of a cluster", 2024-08-31T05:44:27.122 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.122 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.122 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.122 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.122 INFO:teuthology.orchestra.run.smithi005.stdout: "contact": { 2024-08-31T05:44:27.122 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "contact", 2024-08-31T05:44:27.122 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.122 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.123 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.123 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.123 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.123 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.123 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.123 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.123 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.123 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.124 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.124 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.124 INFO:teuthology.orchestra.run.smithi005.stdout: "description": { 2024-08-31T05:44:27.124 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "description", 2024-08-31T05:44:27.124 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.124 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.124 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.124 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.125 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.125 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.125 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.125 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.125 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.125 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.125 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.125 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.125 INFO:teuthology.orchestra.run.smithi005.stdout: "device_url": { 2024-08-31T05:44:27.126 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "device_url", 2024-08-31T05:44:27.126 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.126 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.126 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.126 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-08-31T05:44:27.126 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.126 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.126 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.127 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.127 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.127 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.127 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.127 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.127 INFO:teuthology.orchestra.run.smithi005.stdout: "enabled": { 2024-08-31T05:44:27.127 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enabled", 2024-08-31T05:44:27.127 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.127 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.128 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.128 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.128 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.128 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.128 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.128 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.128 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.128 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.129 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.129 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.129 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2024-08-31T05:44:27.129 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2024-08-31T05:44:27.129 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.129 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.129 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.129 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "24", 2024-08-31T05:44:27.130 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "8", 2024-08-31T05:44:27.130 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.130 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.130 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.130 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.130 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.130 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.130 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.130 INFO:teuthology.orchestra.run.smithi005.stdout: "last_opt_revision": { 2024-08-31T05:44:27.131 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "last_opt_revision", 2024-08-31T05:44:27.131 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.131 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.131 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.131 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "1", 2024-08-31T05:44:27.131 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.131 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.131 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.132 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.132 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.132 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.132 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.132 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.132 INFO:teuthology.orchestra.run.smithi005.stdout: "leaderboard": { 2024-08-31T05:44:27.132 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "leaderboard", 2024-08-31T05:44:27.132 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.133 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.133 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.133 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.133 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.133 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.133 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.133 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.133 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.133 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.134 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.134 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.134 INFO:teuthology.orchestra.run.smithi005.stdout: "leaderboard_description": { 2024-08-31T05:44:27.134 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "leaderboard_description", 2024-08-31T05:44:27.134 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.134 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.134 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.134 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.135 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.135 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.135 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.135 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.135 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.135 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.135 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.135 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.136 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:27.136 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:27.136 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.136 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.136 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.136 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.136 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.136 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.136 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.137 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.137 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.137 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.137 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.137 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.137 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.137 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.137 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.138 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.138 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.138 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.138 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.138 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:27.138 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:27.138 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.138 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.139 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.139 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.139 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.139 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.139 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.139 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.139 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.139 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.139 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.140 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.140 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:27.140 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:27.140 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.140 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.140 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.140 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:27.140 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.141 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.141 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.141 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.141 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.141 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.141 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.141 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.141 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.142 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.142 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.142 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.142 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.142 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.142 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.142 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:27.142 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:27.143 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.143 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.143 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.143 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.143 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.143 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.144 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.144 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.144 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.144 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.144 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.144 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.144 INFO:teuthology.orchestra.run.smithi005.stdout: "organization": { 2024-08-31T05:44:27.144 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "organization", 2024-08-31T05:44:27.144 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.145 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.145 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.145 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.145 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.145 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.145 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.145 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.145 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.146 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.146 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.146 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.146 INFO:teuthology.orchestra.run.smithi005.stdout: "proxy": { 2024-08-31T05:44:27.146 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "proxy", 2024-08-31T05:44:27.146 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.146 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.146 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.147 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.147 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.147 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.147 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.147 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.147 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.147 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.147 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.147 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.148 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:27.148 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:27.148 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.148 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:27.148 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.148 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:27.148 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.148 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.149 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.149 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.149 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.149 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.149 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.149 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.149 INFO:teuthology.orchestra.run.smithi005.stdout: "url": { 2024-08-31T05:44:27.149 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "url", 2024-08-31T05:44:27.149 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.150 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.150 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.150 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-08-31T05:44:27.150 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.150 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.150 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.150 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.150 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.151 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.151 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.151 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.151 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.151 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.151 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:27.151 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "test_orchestrator", 2024-08-31T05:44:27.151 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:27.152 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:27.152 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:27.152 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:27.152 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:27.152 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.152 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.152 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.152 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.153 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.153 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.153 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.153 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.153 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.153 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.153 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.153 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.153 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.154 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.154 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.154 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.154 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.154 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.154 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.154 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:27.154 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:27.155 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.155 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.155 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.155 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.155 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.155 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.155 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.155 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.156 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.156 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.156 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.156 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.156 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:27.156 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:27.156 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.156 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.157 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.157 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:27.157 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.157 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.157 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.157 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.157 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.157 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.157 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.158 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.158 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.158 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.158 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.158 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.158 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.158 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.158 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.159 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:27.159 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:27.159 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.159 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.159 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.159 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.159 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.159 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.159 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.160 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.160 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.160 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.160 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.160 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.160 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:27.160 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:27.160 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.161 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:27.161 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.161 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:27.161 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.161 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.161 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.161 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.161 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.162 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.162 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.162 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.162 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.162 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.162 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:27.162 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "volumes", 2024-08-31T05:44:27.162 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:27.163 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:27.163 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:27.163 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:27.163 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:27.163 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.163 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.163 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.163 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.163 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.164 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.164 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.164 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.164 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.164 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.164 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.164 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.164 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.165 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.165 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.165 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.165 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.165 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.165 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.165 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:27.165 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:27.165 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.166 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.166 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.166 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.166 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.166 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.166 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.166 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.166 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.167 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.167 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.167 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.167 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:27.167 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:27.167 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.167 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.167 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.167 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:27.168 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.168 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.168 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.168 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.168 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.168 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.168 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.168 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.169 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.169 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.169 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.169 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.169 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.169 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.169 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.169 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:27.170 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:27.170 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.170 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.170 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.170 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.170 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.170 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.170 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.171 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.171 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.171 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.171 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.171 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.171 INFO:teuthology.orchestra.run.smithi005.stdout: "max_concurrent_clones": { 2024-08-31T05:44:27.171 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_concurrent_clones", 2024-08-31T05:44:27.171 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.172 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.172 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.172 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "4", 2024-08-31T05:44:27.172 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.172 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.172 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.172 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Number of asynchronous cloner threads", 2024-08-31T05:44:27.172 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.172 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.173 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.173 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.173 INFO:teuthology.orchestra.run.smithi005.stdout: "periodic_async_work": { 2024-08-31T05:44:27.173 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "periodic_async_work", 2024-08-31T05:44:27.173 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.173 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.173 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.173 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.174 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.174 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.174 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.174 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Periodically check for async work", 2024-08-31T05:44:27.174 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.174 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.174 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.174 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.175 INFO:teuthology.orchestra.run.smithi005.stdout: "snapshot_clone_delay": { 2024-08-31T05:44:27.175 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "snapshot_clone_delay", 2024-08-31T05:44:27.175 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.175 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.175 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.175 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:27.175 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.175 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.176 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.176 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-08-31T05:44:27.176 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.176 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.176 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.176 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.176 INFO:teuthology.orchestra.run.smithi005.stdout: "snapshot_clone_no_wait": { 2024-08-31T05:44:27.176 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "snapshot_clone_no_wait", 2024-08-31T05:44:27.177 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.177 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.177 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.177 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:27.177 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.177 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.177 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.177 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-08-31T05:44:27.177 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.178 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.178 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.178 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.178 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:27.178 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:27.178 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.178 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:27.178 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.179 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:27.179 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.179 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.179 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.179 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.179 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.179 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.179 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.179 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.180 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.180 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.180 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:27.180 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix", 2024-08-31T05:44:27.180 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:27.180 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:27.180 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:27.180 INFO:teuthology.orchestra.run.smithi005.stdout: "discovery_interval": { 2024-08-31T05:44:27.181 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "discovery_interval", 2024-08-31T05:44:27.181 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2024-08-31T05:44:27.181 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.181 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.181 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "100", 2024-08-31T05:44:27.181 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.181 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.181 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.181 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.182 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.182 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.182 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.182 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.182 INFO:teuthology.orchestra.run.smithi005.stdout: "identifier": { 2024-08-31T05:44:27.182 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "identifier", 2024-08-31T05:44:27.182 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.182 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.183 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.183 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.183 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.183 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.183 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.183 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.183 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.183 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.184 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.184 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.184 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2024-08-31T05:44:27.184 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2024-08-31T05:44:27.184 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:27.184 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.184 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.184 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2024-08-31T05:44:27.184 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.185 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.185 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.185 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.185 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.185 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.185 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.185 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.185 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:27.186 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:27.186 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.186 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.186 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.186 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.186 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.186 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.186 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.187 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.187 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.187 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.187 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.187 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.187 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.187 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.187 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.187 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.188 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.188 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.188 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.188 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:27.188 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:27.188 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.188 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.188 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.189 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.189 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.189 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.189 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.189 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.189 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.189 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.189 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.189 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.190 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:27.190 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:27.190 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.190 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.190 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.190 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:27.190 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.190 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.191 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.191 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.191 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.191 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.191 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.191 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.191 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.191 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.192 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.192 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.192 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.192 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.192 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.192 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:27.192 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:27.192 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.192 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.193 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.193 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.193 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.193 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.193 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.193 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.193 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.193 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.194 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.194 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.194 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:27.194 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:27.194 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.194 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:27.194 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.194 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:27.195 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.195 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.195 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.195 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.195 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.195 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.195 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.195 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.195 INFO:teuthology.orchestra.run.smithi005.stdout: "zabbix_host": { 2024-08-31T05:44:27.196 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix_host", 2024-08-31T05:44:27.196 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.196 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.196 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.196 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.196 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.196 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.196 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.197 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.197 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.197 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.197 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.197 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.197 INFO:teuthology.orchestra.run.smithi005.stdout: "zabbix_port": { 2024-08-31T05:44:27.197 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix_port", 2024-08-31T05:44:27.197 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.198 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.198 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.198 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10051", 2024-08-31T05:44:27.198 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.198 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.198 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.198 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.198 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.198 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.199 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.199 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.199 INFO:teuthology.orchestra.run.smithi005.stdout: "zabbix_sender": { 2024-08-31T05:44:27.199 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix_sender", 2024-08-31T05:44:27.199 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.199 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.199 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.199 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-08-31T05:44:27.200 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.200 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.200 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.200 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.200 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.200 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.200 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.200 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.201 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.201 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.201 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-31T05:44:27.201 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.201 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.201 INFO:teuthology.orchestra.run.smithi005.stdout: "modules": [ 2024-08-31T05:44:27.201 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm", 2024-08-31T05:44:27.201 INFO:teuthology.orchestra.run.smithi005.stdout: "dashboard", 2024-08-31T05:44:27.202 INFO:teuthology.orchestra.run.smithi005.stdout: "iostat", 2024-08-31T05:44:27.202 INFO:teuthology.orchestra.run.smithi005.stdout: "nfs", 2024-08-31T05:44:27.202 INFO:teuthology.orchestra.run.smithi005.stdout: "restful", 2024-08-31T05:44:27.202 INFO:teuthology.orchestra.run.smithi005.stdout: "snap_schedule" 2024-08-31T05:44:27.202 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.202 INFO:teuthology.orchestra.run.smithi005.stdout: "available_modules": [ 2024-08-31T05:44:27.202 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:27.202 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "alerts", 2024-08-31T05:44:27.202 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:27.203 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:27.203 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:27.203 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2024-08-31T05:44:27.203 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2024-08-31T05:44:27.203 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:27.203 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.203 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.203 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2024-08-31T05:44:27.204 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.204 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.204 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.204 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How frequently to reexamine health status", 2024-08-31T05:44:27.204 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.204 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.204 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.204 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.205 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:27.205 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:27.205 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.205 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.205 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.205 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.205 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.205 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.205 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.206 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.206 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.206 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.206 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.206 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.206 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.206 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.206 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.207 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.207 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.207 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.207 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.207 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:27.207 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:27.207 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.207 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.207 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.208 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.208 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.208 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.208 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.208 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.208 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.208 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.208 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.209 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.209 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:27.209 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:27.209 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.209 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.209 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.209 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:27.209 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.210 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.210 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.210 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.210 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.210 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.210 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.210 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.210 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.210 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.211 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.211 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.211 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.211 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.211 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.211 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:27.211 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:27.211 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.212 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.212 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.212 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.212 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.212 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.212 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.212 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.212 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.213 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.213 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.213 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.213 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_destination": { 2024-08-31T05:44:27.213 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_destination", 2024-08-31T05:44:27.213 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.214 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.214 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.214 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.214 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.214 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.214 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.214 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Email address to send alerts to", 2024-08-31T05:44:27.214 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.215 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.215 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.215 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.215 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_from_name": { 2024-08-31T05:44:27.215 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_from_name", 2024-08-31T05:44:27.215 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.215 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.215 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.215 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "Ceph", 2024-08-31T05:44:27.216 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.216 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.216 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.216 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Email From: name", 2024-08-31T05:44:27.216 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.216 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.216 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.216 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.217 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_host": { 2024-08-31T05:44:27.217 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_host", 2024-08-31T05:44:27.217 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.217 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.217 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.217 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.217 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.217 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.218 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.218 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SMTP server", 2024-08-31T05:44:27.218 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.218 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.218 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.218 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.218 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_password": { 2024-08-31T05:44:27.218 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_password", 2024-08-31T05:44:27.218 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.219 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.219 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.219 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.219 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.219 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.219 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.219 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Password to authenticate with", 2024-08-31T05:44:27.219 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.220 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.220 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.220 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.220 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_port": { 2024-08-31T05:44:27.220 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_port", 2024-08-31T05:44:27.220 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.220 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.220 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.221 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "465", 2024-08-31T05:44:27.221 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.221 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.221 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.221 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SMTP port", 2024-08-31T05:44:27.221 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.221 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.221 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.221 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.222 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_sender": { 2024-08-31T05:44:27.222 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_sender", 2024-08-31T05:44:27.222 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.222 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.222 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.222 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.222 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.222 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.223 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.223 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SMTP envelope sender", 2024-08-31T05:44:27.223 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.223 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.223 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.223 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.223 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_ssl": { 2024-08-31T05:44:27.223 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_ssl", 2024-08-31T05:44:27.224 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.224 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.224 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.224 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:27.224 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.224 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.224 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.224 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use SSL to connect to SMTP server", 2024-08-31T05:44:27.225 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.225 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.225 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.225 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.225 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_user": { 2024-08-31T05:44:27.225 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_user", 2024-08-31T05:44:27.225 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.225 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.225 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.226 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.226 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.226 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.226 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.226 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "User to authenticate as", 2024-08-31T05:44:27.226 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.226 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.226 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.227 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.227 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:27.227 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:27.227 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.227 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:27.227 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.227 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:27.227 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.228 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.228 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.228 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.228 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.228 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.228 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.228 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.228 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.228 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.229 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:27.229 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "balancer", 2024-08-31T05:44:27.229 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:27.229 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:27.229 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:27.229 INFO:teuthology.orchestra.run.smithi005.stdout: "active": { 2024-08-31T05:44:27.229 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "active", 2024-08-31T05:44:27.229 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.230 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.230 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.230 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:27.230 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.230 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.230 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.230 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "automatically balance PGs across cluster", 2024-08-31T05:44:27.230 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.230 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.231 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.231 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.231 INFO:teuthology.orchestra.run.smithi005.stdout: "begin_time": { 2024-08-31T05:44:27.231 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "begin_time", 2024-08-31T05:44:27.231 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.231 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.231 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.231 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0000", 2024-08-31T05:44:27.232 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.232 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.232 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.232 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "beginning time of day to automatically balance", 2024-08-31T05:44:27.232 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-31T05:44:27.232 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.232 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.232 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.233 INFO:teuthology.orchestra.run.smithi005.stdout: "begin_weekday": { 2024-08-31T05:44:27.233 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "begin_weekday", 2024-08-31T05:44:27.233 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2024-08-31T05:44:27.233 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.233 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.233 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:27.233 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "0", 2024-08-31T05:44:27.233 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "6", 2024-08-31T05:44:27.233 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.234 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-08-31T05:44:27.234 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-31T05:44:27.234 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.234 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.234 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.234 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_compat_max_iterations": { 2024-08-31T05:44:27.234 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crush_compat_max_iterations", 2024-08-31T05:44:27.234 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2024-08-31T05:44:27.235 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.235 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.235 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "25", 2024-08-31T05:44:27.235 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2024-08-31T05:44:27.235 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "250", 2024-08-31T05:44:27.235 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.235 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-08-31T05:44:27.235 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.235 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.236 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.236 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.236 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_compat_metrics": { 2024-08-31T05:44:27.236 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crush_compat_metrics", 2024-08-31T05:44:27.236 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.236 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.236 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.236 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "pgs,objects,bytes", 2024-08-31T05:44:27.237 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.237 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.237 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.237 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-08-31T05:44:27.237 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-08-31T05:44:27.237 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.237 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.237 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.238 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_compat_step": { 2024-08-31T05:44:27.238 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crush_compat_step", 2024-08-31T05:44:27.238 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-08-31T05:44:27.238 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.238 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.238 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0.5", 2024-08-31T05:44:27.238 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "0.001", 2024-08-31T05:44:27.238 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "0.999", 2024-08-31T05:44:27.239 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.239 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "aggressiveness of optimization", 2024-08-31T05:44:27.239 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-08-31T05:44:27.239 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.239 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.239 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.239 INFO:teuthology.orchestra.run.smithi005.stdout: "end_time": { 2024-08-31T05:44:27.239 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "end_time", 2024-08-31T05:44:27.239 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.240 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.240 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.240 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "2359", 2024-08-31T05:44:27.240 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.240 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.240 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.240 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "ending time of day to automatically balance", 2024-08-31T05:44:27.240 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-31T05:44:27.241 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.241 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.241 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.241 INFO:teuthology.orchestra.run.smithi005.stdout: "end_weekday": { 2024-08-31T05:44:27.241 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "end_weekday", 2024-08-31T05:44:27.241 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2024-08-31T05:44:27.241 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.241 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.242 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:27.242 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "0", 2024-08-31T05:44:27.242 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "6", 2024-08-31T05:44:27.242 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.242 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-08-31T05:44:27.242 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-31T05:44:27.242 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.242 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.242 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.243 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:27.243 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:27.243 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.243 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.243 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.243 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.243 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.243 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.244 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.244 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.244 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.244 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.244 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.244 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.244 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.244 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.245 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.245 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.245 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.245 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.245 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.245 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:27.245 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:27.245 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.246 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.246 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.246 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.246 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.246 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.246 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.246 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.246 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.247 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.247 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.247 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.247 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:27.247 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:27.247 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.247 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.247 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.247 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:27.248 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.248 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.248 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.248 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.248 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.248 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.248 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.248 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.249 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.249 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.249 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.249 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.249 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.249 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.249 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.249 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:27.250 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:27.250 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.250 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.250 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.250 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.250 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.250 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.250 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.250 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.251 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.251 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.251 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.251 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.251 INFO:teuthology.orchestra.run.smithi005.stdout: "min_score": { 2024-08-31T05:44:27.251 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "min_score", 2024-08-31T05:44:27.251 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-08-31T05:44:27.251 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.252 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.252 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:27.252 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.252 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.252 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.252 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-08-31T05:44:27.252 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.252 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.252 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.253 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.253 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": { 2024-08-31T05:44:27.253 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mode", 2024-08-31T05:44:27.253 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.253 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.253 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.253 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "upmap", 2024-08-31T05:44:27.253 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.254 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.254 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.254 INFO:teuthology.orchestra.run.smithi005.stdout: "crush-compat", 2024-08-31T05:44:27.254 INFO:teuthology.orchestra.run.smithi005.stdout: "none", 2024-08-31T05:44:27.254 INFO:teuthology.orchestra.run.smithi005.stdout: "read", 2024-08-31T05:44:27.254 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap", 2024-08-31T05:44:27.254 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap-read" 2024-08-31T05:44:27.254 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.255 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Balancer mode", 2024-08-31T05:44:27.255 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.255 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.255 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.255 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.255 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_ids": { 2024-08-31T05:44:27.255 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pool_ids", 2024-08-31T05:44:27.255 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.255 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.256 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.256 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.256 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.256 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.256 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.256 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-08-31T05:44:27.256 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.256 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.257 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.257 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.257 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2024-08-31T05:44:27.257 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2024-08-31T05:44:27.257 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:27.257 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.257 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.257 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2024-08-31T05:44:27.257 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.258 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.258 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.258 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-08-31T05:44:27.258 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.258 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.258 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.258 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.258 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:27.259 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:27.259 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.259 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:27.259 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.259 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:27.259 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.259 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.259 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.260 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.260 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.260 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.260 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.260 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.260 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap_max_deviation": { 2024-08-31T05:44:27.260 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "upmap_max_deviation", 2024-08-31T05:44:27.260 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.260 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.261 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.261 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2024-08-31T05:44:27.261 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2024-08-31T05:44:27.261 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.261 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.261 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "deviation below which no optimization is attempted", 2024-08-31T05:44:27.261 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-08-31T05:44:27.261 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.262 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.262 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.262 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap_max_optimizations": { 2024-08-31T05:44:27.262 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "upmap_max_optimizations", 2024-08-31T05:44:27.262 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2024-08-31T05:44:27.262 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.262 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.262 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-08-31T05:44:27.262 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.263 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.263 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.263 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-08-31T05:44:27.263 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.263 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.263 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.263 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.263 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.264 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.264 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:27.264 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephadm", 2024-08-31T05:44:27.264 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:27.264 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:27.264 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:27.264 INFO:teuthology.orchestra.run.smithi005.stdout: "agent_down_multiplier": { 2024-08-31T05:44:27.264 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "agent_down_multiplier", 2024-08-31T05:44:27.265 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-08-31T05:44:27.265 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.265 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.265 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "3.0", 2024-08-31T05:44:27.265 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.265 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.265 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.265 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-08-31T05:44:27.266 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.266 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.266 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.266 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.266 INFO:teuthology.orchestra.run.smithi005.stdout: "agent_refresh_rate": { 2024-08-31T05:44:27.266 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "agent_refresh_rate", 2024-08-31T05:44:27.266 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:27.266 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.266 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.267 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "20", 2024-08-31T05:44:27.267 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.267 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.267 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.267 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-08-31T05:44:27.267 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.267 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.267 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.268 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.268 INFO:teuthology.orchestra.run.smithi005.stdout: "agent_starting_port": { 2024-08-31T05:44:27.268 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "agent_starting_port", 2024-08-31T05:44:27.268 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.268 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.268 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.268 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "4721", 2024-08-31T05:44:27.268 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.269 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.269 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.269 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-08-31T05:44:27.269 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.269 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.269 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.269 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.269 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_ptrace": { 2024-08-31T05:44:27.269 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "allow_ptrace", 2024-08-31T05:44:27.270 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.270 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.270 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.270 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.270 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.270 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.270 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.270 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-08-31T05:44:27.270 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-08-31T05:44:27.271 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.271 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.271 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.271 INFO:teuthology.orchestra.run.smithi005.stdout: "autotune_interval": { 2024-08-31T05:44:27.271 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "autotune_interval", 2024-08-31T05:44:27.271 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:27.271 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.272 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.272 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2024-08-31T05:44:27.272 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.272 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.272 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.272 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to autotune daemon memory", 2024-08-31T05:44:27.272 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.272 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.272 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.273 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.273 INFO:teuthology.orchestra.run.smithi005.stdout: "autotune_memory_target_ratio": { 2024-08-31T05:44:27.273 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "autotune_memory_target_ratio", 2024-08-31T05:44:27.273 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-08-31T05:44:27.273 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.273 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.273 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0.7", 2024-08-31T05:44:27.273 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.274 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.274 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.274 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-08-31T05:44:27.274 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.274 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.274 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.274 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.274 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm_log_destination": { 2024-08-31T05:44:27.275 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephadm_log_destination", 2024-08-31T05:44:27.275 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.275 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.275 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.275 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.275 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.275 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.275 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.275 INFO:teuthology.orchestra.run.smithi005.stdout: "file", 2024-08-31T05:44:27.276 INFO:teuthology.orchestra.run.smithi005.stdout: "file,syslog", 2024-08-31T05:44:27.276 INFO:teuthology.orchestra.run.smithi005.stdout: "syslog" 2024-08-31T05:44:27.276 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.276 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-08-31T05:44:27.276 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.276 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.276 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.276 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.277 INFO:teuthology.orchestra.run.smithi005.stdout: "cgroups_split": { 2024-08-31T05:44:27.277 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cgroups_split", 2024-08-31T05:44:27.277 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.277 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.277 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.277 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:27.277 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.277 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.278 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.278 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-08-31T05:44:27.278 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.278 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.278 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.278 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.278 INFO:teuthology.orchestra.run.smithi005.stdout: "config_checks_enabled": { 2024-08-31T05:44:27.278 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "config_checks_enabled", 2024-08-31T05:44:27.279 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.279 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.279 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.279 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.279 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.279 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.279 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.279 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-08-31T05:44:27.280 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.280 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.280 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.280 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.280 INFO:teuthology.orchestra.run.smithi005.stdout: "config_dashboard": { 2024-08-31T05:44:27.280 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "config_dashboard", 2024-08-31T05:44:27.280 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.280 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.281 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.281 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:27.281 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.281 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.281 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.281 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-08-31T05:44:27.281 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.281 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.282 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.282 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.282 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_alertmanager": { 2024-08-31T05:44:27.282 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_alertmanager", 2024-08-31T05:44:27.282 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.282 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.282 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.282 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-08-31T05:44:27.282 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.283 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.283 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.283 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2024-08-31T05:44:27.283 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.283 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.283 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.283 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.283 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_base": { 2024-08-31T05:44:27.284 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_base", 2024-08-31T05:44:27.284 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.284 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.284 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.284 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/ceph", 2024-08-31T05:44:27.284 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.284 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.284 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.285 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Container image name, without the tag", 2024-08-31T05:44:27.285 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.285 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.285 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.285 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.285 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_elasticsearch": { 2024-08-31T05:44:27.285 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_elasticsearch", 2024-08-31T05:44:27.285 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.286 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.286 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.286 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-08-31T05:44:27.286 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.286 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.286 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.286 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "elasticsearch container image", 2024-08-31T05:44:27.286 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.286 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.287 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.287 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.287 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_grafana": { 2024-08-31T05:44:27.287 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_grafana", 2024-08-31T05:44:27.287 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.287 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.287 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.287 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-08-31T05:44:27.288 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.288 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.288 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.288 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2024-08-31T05:44:27.288 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.288 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.288 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.288 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.289 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_haproxy": { 2024-08-31T05:44:27.289 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_haproxy", 2024-08-31T05:44:27.289 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.289 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.289 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.289 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-08-31T05:44:27.289 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.289 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.290 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.290 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "HAproxy container image", 2024-08-31T05:44:27.290 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.290 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.290 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.290 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.290 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_jaeger_agent": { 2024-08-31T05:44:27.290 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_jaeger_agent", 2024-08-31T05:44:27.290 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.291 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.291 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.291 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-08-31T05:44:27.291 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.291 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.291 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.291 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Jaeger agent container image", 2024-08-31T05:44:27.291 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.292 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.292 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.292 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.292 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_jaeger_collector": { 2024-08-31T05:44:27.292 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_jaeger_collector", 2024-08-31T05:44:27.292 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.292 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.292 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.293 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-08-31T05:44:27.293 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.293 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.293 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.293 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Jaeger collector container image", 2024-08-31T05:44:27.293 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.293 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.293 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.293 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.294 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_jaeger_query": { 2024-08-31T05:44:27.294 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_jaeger_query", 2024-08-31T05:44:27.294 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.294 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.294 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.294 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-08-31T05:44:27.294 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.294 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.295 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.295 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Jaeger query container image", 2024-08-31T05:44:27.295 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.295 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.295 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.295 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.295 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_keepalived": { 2024-08-31T05:44:27.295 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_keepalived", 2024-08-31T05:44:27.295 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.296 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.296 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.296 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-08-31T05:44:27.296 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.296 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.296 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.296 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Keepalived container image", 2024-08-31T05:44:27.297 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.297 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.297 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.297 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.297 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_loki": { 2024-08-31T05:44:27.297 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_loki", 2024-08-31T05:44:27.297 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.297 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.297 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.298 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-08-31T05:44:27.298 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.298 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.298 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.298 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Loki container image", 2024-08-31T05:44:27.298 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.298 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.298 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.299 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.299 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_nginx": { 2024-08-31T05:44:27.299 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_nginx", 2024-08-31T05:44:27.299 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.299 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.299 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.299 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-08-31T05:44:27.299 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.300 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.300 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.300 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Nginx container image", 2024-08-31T05:44:27.300 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.300 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.300 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.300 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.300 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_node_exporter": { 2024-08-31T05:44:27.301 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_node_exporter", 2024-08-31T05:44:27.301 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.301 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.301 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.301 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-08-31T05:44:27.301 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.301 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.301 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.301 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2024-08-31T05:44:27.302 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.302 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.302 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.302 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.302 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_nvmeof": { 2024-08-31T05:44:27.302 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_nvmeof", 2024-08-31T05:44:27.302 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.302 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.303 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.303 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-08-31T05:44:27.303 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.303 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.303 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.303 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Nvme-of container image", 2024-08-31T05:44:27.303 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.303 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.304 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.304 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.304 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_oauth2_proxy": { 2024-08-31T05:44:27.304 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_oauth2_proxy", 2024-08-31T05:44:27.304 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.304 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.304 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.304 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-08-31T05:44:27.305 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.305 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.305 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.305 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "oauth2-proxy container image", 2024-08-31T05:44:27.305 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.305 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.305 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.305 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.305 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_prometheus": { 2024-08-31T05:44:27.306 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_prometheus", 2024-08-31T05:44:27.306 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.306 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.306 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.306 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-08-31T05:44:27.306 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.306 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.306 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.307 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2024-08-31T05:44:27.307 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.307 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.307 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.307 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.307 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_promtail": { 2024-08-31T05:44:27.307 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_promtail", 2024-08-31T05:44:27.307 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.308 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.308 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.308 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-08-31T05:44:27.308 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.308 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.308 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.308 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Promtail container image", 2024-08-31T05:44:27.308 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.309 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.309 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.309 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.309 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_samba": { 2024-08-31T05:44:27.309 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_samba", 2024-08-31T05:44:27.309 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.309 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.309 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.309 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-08-31T05:44:27.310 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.310 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.310 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.310 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Samba/SMB container image", 2024-08-31T05:44:27.310 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.310 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.310 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.310 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.311 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_snmp_gateway": { 2024-08-31T05:44:27.311 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_snmp_gateway", 2024-08-31T05:44:27.311 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.311 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.311 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.311 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-08-31T05:44:27.311 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.311 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.311 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.312 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SNMP Gateway container image", 2024-08-31T05:44:27.312 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.312 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.312 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.312 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.312 INFO:teuthology.orchestra.run.smithi005.stdout: "container_init": { 2024-08-31T05:44:27.312 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_init", 2024-08-31T05:44:27.312 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.313 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.313 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.313 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:27.313 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.313 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.313 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.313 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Run podman/docker with `--init`", 2024-08-31T05:44:27.313 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.314 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.314 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.314 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.314 INFO:teuthology.orchestra.run.smithi005.stdout: "daemon_cache_timeout": { 2024-08-31T05:44:27.314 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "daemon_cache_timeout", 2024-08-31T05:44:27.314 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:27.314 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.314 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.315 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2024-08-31T05:44:27.315 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.315 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.315 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.315 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-08-31T05:44:27.315 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.315 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.315 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.315 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.316 INFO:teuthology.orchestra.run.smithi005.stdout: "default_cephadm_command_timeout": { 2024-08-31T05:44:27.316 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "default_cephadm_command_timeout", 2024-08-31T05:44:27.316 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.316 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.316 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.316 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "900", 2024-08-31T05:44:27.316 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.316 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.317 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.317 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-08-31T05:44:27.317 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.317 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.317 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.317 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.317 INFO:teuthology.orchestra.run.smithi005.stdout: "default_registry": { 2024-08-31T05:44:27.317 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "default_registry", 2024-08-31T05:44:27.318 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.318 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.318 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.318 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io", 2024-08-31T05:44:27.318 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.318 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.318 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.318 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-08-31T05:44:27.318 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.319 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.319 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.319 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.319 INFO:teuthology.orchestra.run.smithi005.stdout: "device_cache_timeout": { 2024-08-31T05:44:27.319 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "device_cache_timeout", 2024-08-31T05:44:27.319 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:27.319 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.319 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.320 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "1800", 2024-08-31T05:44:27.320 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.320 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.320 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.320 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "seconds to cache device inventory", 2024-08-31T05:44:27.320 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.320 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.321 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.321 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.321 INFO:teuthology.orchestra.run.smithi005.stdout: "device_enhanced_scan": { 2024-08-31T05:44:27.321 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "device_enhanced_scan", 2024-08-31T05:44:27.321 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.321 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.321 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.321 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.322 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.322 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.322 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.322 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use libstoragemgmt during device scans", 2024-08-31T05:44:27.322 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.322 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.322 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.322 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.323 INFO:teuthology.orchestra.run.smithi005.stdout: "facts_cache_timeout": { 2024-08-31T05:44:27.323 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "facts_cache_timeout", 2024-08-31T05:44:27.323 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:27.323 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.323 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.323 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2024-08-31T05:44:27.323 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.323 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.324 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.324 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "seconds to cache host facts data", 2024-08-31T05:44:27.324 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.324 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.324 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.324 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.324 INFO:teuthology.orchestra.run.smithi005.stdout: "grafana_dashboards_path": { 2024-08-31T05:44:27.324 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "grafana_dashboards_path", 2024-08-31T05:44:27.324 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.325 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.325 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.325 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-08-31T05:44:27.325 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.325 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.325 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.325 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-08-31T05:44:27.325 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.326 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.326 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.326 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.326 INFO:teuthology.orchestra.run.smithi005.stdout: "host_check_interval": { 2024-08-31T05:44:27.326 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "host_check_interval", 2024-08-31T05:44:27.326 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:27.326 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.326 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.327 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2024-08-31T05:44:27.327 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.327 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.327 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.327 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to perform a host check", 2024-08-31T05:44:27.327 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.327 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.327 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.327 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.328 INFO:teuthology.orchestra.run.smithi005.stdout: "hw_monitoring": { 2024-08-31T05:44:27.328 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "hw_monitoring", 2024-08-31T05:44:27.328 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.328 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.328 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.329 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.329 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.329 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.329 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.329 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-08-31T05:44:27.330 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.330 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.330 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.330 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.331 INFO:teuthology.orchestra.run.smithi005.stdout: "inventory_list_all": { 2024-08-31T05:44:27.331 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "inventory_list_all", 2024-08-31T05:44:27.331 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.331 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.331 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.332 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.332 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.332 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.332 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.333 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-08-31T05:44:27.333 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.333 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.333 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.334 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.334 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:27.334 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:27.335 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.335 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.335 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.335 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.336 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.336 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.336 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.336 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.337 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.337 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.337 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.337 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.338 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.338 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.338 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.338 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.339 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.339 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.339 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.339 INFO:teuthology.orchestra.run.smithi005.stdout: "log_refresh_metadata": { 2024-08-31T05:44:27.340 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_refresh_metadata", 2024-08-31T05:44:27.340 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.340 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.340 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.341 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.341 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.341 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.342 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.342 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-08-31T05:44:27.342 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.342 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.343 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.343 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.343 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:27.343 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:27.344 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.344 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.344 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.344 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:27.345 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.345 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.345 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.345 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-08-31T05:44:27.346 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.346 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.346 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.346 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.347 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:27.347 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:27.347 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.347 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.348 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.348 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:27.348 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.348 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.349 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.349 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.349 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.350 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.350 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.350 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.350 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.351 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.351 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.351 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.351 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.352 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.352 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.352 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:27.352 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:27.353 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.353 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.353 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.353 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.354 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.354 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.354 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.354 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.355 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.355 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.355 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.355 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.356 INFO:teuthology.orchestra.run.smithi005.stdout: "manage_etc_ceph_ceph_conf": { 2024-08-31T05:44:27.356 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-08-31T05:44:27.356 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.356 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.357 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.357 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.357 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.358 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.358 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.358 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-08-31T05:44:27.358 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.359 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.359 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.359 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.359 INFO:teuthology.orchestra.run.smithi005.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-08-31T05:44:27.360 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-08-31T05:44:27.360 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.360 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.360 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.361 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "*", 2024-08-31T05:44:27.361 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.361 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.361 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.362 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-08-31T05:44:27.362 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.362 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.362 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.363 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.363 INFO:teuthology.orchestra.run.smithi005.stdout: "max_count_per_host": { 2024-08-31T05:44:27.363 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_count_per_host", 2024-08-31T05:44:27.363 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.364 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.364 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.364 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-08-31T05:44:27.364 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.365 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.365 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.365 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "max number of daemons per service per host", 2024-08-31T05:44:27.366 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.366 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.366 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.366 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.367 INFO:teuthology.orchestra.run.smithi005.stdout: "max_osd_draining_count": { 2024-08-31T05:44:27.367 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_osd_draining_count", 2024-08-31T05:44:27.367 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.367 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.368 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.368 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-08-31T05:44:27.368 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.368 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.369 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.369 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-08-31T05:44:27.369 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.369 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.370 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.370 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.370 INFO:teuthology.orchestra.run.smithi005.stdout: "migration_current": { 2024-08-31T05:44:27.370 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "migration_current", 2024-08-31T05:44:27.371 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.371 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.371 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.371 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.372 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.372 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.372 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.373 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "internal - do not modify", 2024-08-31T05:44:27.373 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.373 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.373 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.374 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.374 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": { 2024-08-31T05:44:27.374 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mode", 2024-08-31T05:44:27.374 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.375 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.375 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.375 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "root", 2024-08-31T05:44:27.375 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.375 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.376 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.376 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm-package", 2024-08-31T05:44:27.376 INFO:teuthology.orchestra.run.smithi005.stdout: "root" 2024-08-31T05:44:27.376 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.377 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "mode for remote execution of cephadm", 2024-08-31T05:44:27.377 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.377 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.377 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.378 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.378 INFO:teuthology.orchestra.run.smithi005.stdout: "oob_default_addr": { 2024-08-31T05:44:27.378 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "oob_default_addr", 2024-08-31T05:44:27.379 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.379 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.379 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.379 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "169.254.1.1", 2024-08-31T05:44:27.379 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.380 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.380 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.380 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Default address for RedFish API (oob management).", 2024-08-31T05:44:27.380 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.380 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.381 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.381 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.381 INFO:teuthology.orchestra.run.smithi005.stdout: "prometheus_alerts_path": { 2024-08-31T05:44:27.381 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "prometheus_alerts_path", 2024-08-31T05:44:27.381 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.382 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.382 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.382 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-08-31T05:44:27.382 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.383 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.383 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.383 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-08-31T05:44:27.383 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.383 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.383 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.384 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.384 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_insecure": { 2024-08-31T05:44:27.384 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_insecure", 2024-08-31T05:44:27.384 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.384 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.385 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.385 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.385 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.385 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.385 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.385 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-08-31T05:44:27.386 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.386 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.386 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.386 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.386 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_password": { 2024-08-31T05:44:27.386 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_password", 2024-08-31T05:44:27.387 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.387 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.387 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.387 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.387 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.387 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.387 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.387 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-08-31T05:44:27.388 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.388 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.388 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.388 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.388 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_url": { 2024-08-31T05:44:27.388 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_url", 2024-08-31T05:44:27.388 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.388 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.389 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.389 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.389 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.389 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.389 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.389 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-08-31T05:44:27.389 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.389 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.389 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.390 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.390 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_username": { 2024-08-31T05:44:27.390 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_username", 2024-08-31T05:44:27.390 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.390 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.390 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.390 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.390 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.391 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.391 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.391 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-08-31T05:44:27.391 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.391 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.391 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.391 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.391 INFO:teuthology.orchestra.run.smithi005.stdout: "secure_monitoring_stack": { 2024-08-31T05:44:27.392 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "secure_monitoring_stack", 2024-08-31T05:44:27.392 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.392 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.392 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.392 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.392 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.392 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.392 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.392 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-08-31T05:44:27.393 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.393 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.393 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.393 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.393 INFO:teuthology.orchestra.run.smithi005.stdout: "service_discovery_port": { 2024-08-31T05:44:27.393 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "service_discovery_port", 2024-08-31T05:44:27.393 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.393 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.394 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.394 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8765", 2024-08-31T05:44:27.394 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.394 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.394 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.394 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "cephadm service discovery port", 2024-08-31T05:44:27.394 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.394 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.395 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.395 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.395 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:27.395 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:27.395 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.395 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:27.395 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.395 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:27.396 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.396 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.396 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.396 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.396 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.396 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.396 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.396 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.397 INFO:teuthology.orchestra.run.smithi005.stdout: "ssh_config_file": { 2024-08-31T05:44:27.397 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssh_config_file", 2024-08-31T05:44:27.397 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.397 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.397 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.397 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.397 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.397 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.397 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.398 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-08-31T05:44:27.398 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.398 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.398 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.398 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.398 INFO:teuthology.orchestra.run.smithi005.stdout: "use_agent": { 2024-08-31T05:44:27.398 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "use_agent", 2024-08-31T05:44:27.398 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.399 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.399 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.399 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.399 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.399 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.399 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.399 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-08-31T05:44:27.399 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.399 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.400 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.400 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.400 INFO:teuthology.orchestra.run.smithi005.stdout: "use_repo_digest": { 2024-08-31T05:44:27.400 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "use_repo_digest", 2024-08-31T05:44:27.400 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.400 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.400 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.401 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:27.401 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.401 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.401 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.401 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-08-31T05:44:27.401 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.401 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.401 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.402 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.402 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_on_failed_host_check": { 2024-08-31T05:44:27.402 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_on_failed_host_check", 2024-08-31T05:44:27.402 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.402 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.402 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.402 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:27.402 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.403 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.403 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.403 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise a health warning if the host check fails", 2024-08-31T05:44:27.403 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.403 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.403 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.403 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.403 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_on_stray_daemons": { 2024-08-31T05:44:27.403 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_on_stray_daemons", 2024-08-31T05:44:27.404 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.404 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.404 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.404 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:27.404 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.404 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.404 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.404 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-08-31T05:44:27.405 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.405 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.405 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.405 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.405 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_on_stray_hosts": { 2024-08-31T05:44:27.405 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_on_stray_hosts", 2024-08-31T05:44:27.405 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.405 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.406 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.406 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:27.406 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.406 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.406 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.406 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-08-31T05:44:27.406 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.406 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.407 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.407 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.407 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.407 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.407 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:27.407 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crash", 2024-08-31T05:44:27.407 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:27.407 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:27.407 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:27.408 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:27.408 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:27.408 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.408 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.408 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.408 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.408 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.408 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.409 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.409 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.409 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.409 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.409 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.409 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.409 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.409 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.410 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.410 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.410 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.410 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.410 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.410 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:27.410 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:27.410 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.411 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.411 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.411 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.411 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.411 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.411 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.411 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.411 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.411 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.412 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.412 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.412 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:27.412 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:27.412 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.412 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.412 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.412 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:27.413 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.413 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.413 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.413 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.413 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.413 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.413 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.413 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.414 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.414 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.414 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.414 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.414 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.414 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.414 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.414 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:27.415 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:27.415 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.415 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.415 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.415 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.415 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.415 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.415 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.415 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.416 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.416 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.416 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.416 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.416 INFO:teuthology.orchestra.run.smithi005.stdout: "retain_interval": { 2024-08-31T05:44:27.416 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "retain_interval", 2024-08-31T05:44:27.416 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:27.416 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.417 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.417 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "31536000", 2024-08-31T05:44:27.417 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.417 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.417 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.417 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how long to retain crashes before pruning them", 2024-08-31T05:44:27.417 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.417 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.418 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.418 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.418 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:27.418 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:27.418 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.418 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:27.418 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.418 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:27.418 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.419 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.419 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.419 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.419 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.419 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.419 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.419 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.419 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_recent_interval": { 2024-08-31T05:44:27.420 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_recent_interval", 2024-08-31T05:44:27.420 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:27.420 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.420 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.420 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "1209600", 2024-08-31T05:44:27.420 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.420 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.420 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.421 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "time interval in which to warn about recent crashes", 2024-08-31T05:44:27.421 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.421 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.421 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.421 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.421 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.421 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.421 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:27.422 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "dashboard", 2024-08-31T05:44:27.422 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:27.422 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:27.422 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:27.422 INFO:teuthology.orchestra.run.smithi005.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-08-31T05:44:27.422 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-08-31T05:44:27.422 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.422 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.423 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.423 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-08-31T05:44:27.423 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.423 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.423 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.423 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.423 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.423 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.423 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.424 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.424 INFO:teuthology.orchestra.run.smithi005.stdout: "ALERTMANAGER_API_HOST": { 2024-08-31T05:44:27.424 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ALERTMANAGER_API_HOST", 2024-08-31T05:44:27.424 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.424 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.424 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.424 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.424 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.425 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.425 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.425 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.425 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.425 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.425 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.425 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.425 INFO:teuthology.orchestra.run.smithi005.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-08-31T05:44:27.426 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-08-31T05:44:27.426 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.426 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.426 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.426 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:27.426 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.426 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.426 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.427 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.427 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.427 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.427 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.427 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.427 INFO:teuthology.orchestra.run.smithi005.stdout: "AUDIT_API_ENABLED": { 2024-08-31T05:44:27.427 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "AUDIT_API_ENABLED", 2024-08-31T05:44:27.427 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.427 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.428 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.428 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.428 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.428 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.428 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.428 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.428 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.428 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.429 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.429 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.429 INFO:teuthology.orchestra.run.smithi005.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-08-31T05:44:27.429 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-08-31T05:44:27.429 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.429 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.429 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.429 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:27.430 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.430 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.430 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.430 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.430 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.430 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.430 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.430 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.431 INFO:teuthology.orchestra.run.smithi005.stdout: "ENABLE_BROWSABLE_API": { 2024-08-31T05:44:27.431 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ENABLE_BROWSABLE_API", 2024-08-31T05:44:27.431 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.431 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.431 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.431 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:27.431 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.431 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.431 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.432 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.432 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.432 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.432 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.432 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.432 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-08-31T05:44:27.432 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-08-31T05:44:27.432 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.433 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.433 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.433 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:27.433 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.433 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.433 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.433 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.433 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.434 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.434 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.434 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.434 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-08-31T05:44:27.434 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-08-31T05:44:27.434 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.434 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.434 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.435 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:27.435 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.435 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.435 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.435 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.435 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.435 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.435 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.436 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.436 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-08-31T05:44:27.436 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-08-31T05:44:27.436 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.436 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.436 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.436 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:27.436 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.436 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.437 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.437 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.437 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.437 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.437 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.437 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.437 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-08-31T05:44:27.437 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-08-31T05:44:27.438 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.438 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.438 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.438 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:27.438 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.438 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.438 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.438 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.439 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.439 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.439 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.439 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.439 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_NFS": { 2024-08-31T05:44:27.439 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-08-31T05:44:27.439 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.439 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.439 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.440 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:27.440 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.440 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.440 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.440 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.440 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.440 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.440 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.441 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.441 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_RBD": { 2024-08-31T05:44:27.441 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-08-31T05:44:27.441 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.441 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.441 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.441 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:27.441 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.442 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.442 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.442 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.442 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.442 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.442 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.442 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.442 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_RGW": { 2024-08-31T05:44:27.443 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-08-31T05:44:27.443 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.443 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.443 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.443 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:27.443 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.443 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.443 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.443 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.444 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.444 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.444 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.444 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.444 INFO:teuthology.orchestra.run.smithi005.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-08-31T05:44:27.444 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-08-31T05:44:27.444 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.444 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.445 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.445 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.445 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.445 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.445 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.445 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.445 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.445 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.446 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.446 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.446 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_PASSWORD": { 2024-08-31T05:44:27.446 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_PASSWORD", 2024-08-31T05:44:27.446 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.446 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.446 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.446 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "admin", 2024-08-31T05:44:27.446 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.447 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.447 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.447 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.447 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.447 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.447 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.447 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.447 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-08-31T05:44:27.448 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-08-31T05:44:27.448 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.448 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.448 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.448 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:27.448 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.448 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.448 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.449 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.449 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.449 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.449 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.449 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.449 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_URL": { 2024-08-31T05:44:27.449 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_URL", 2024-08-31T05:44:27.449 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.450 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.450 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.450 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.450 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.450 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.450 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.450 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.450 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.450 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.451 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.451 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.451 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_USERNAME": { 2024-08-31T05:44:27.451 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_USERNAME", 2024-08-31T05:44:27.451 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.451 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.451 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.451 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "admin", 2024-08-31T05:44:27.452 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.452 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.452 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.452 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.452 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.452 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.452 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.452 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.453 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-08-31T05:44:27.453 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-08-31T05:44:27.453 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.453 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.453 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.453 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.453 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.453 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.454 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.454 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.454 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.454 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.454 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.454 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.454 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-08-31T05:44:27.454 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-08-31T05:44:27.454 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.455 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.455 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.455 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.455 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.455 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.455 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.455 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.455 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.456 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.456 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.456 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.456 INFO:teuthology.orchestra.run.smithi005.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-08-31T05:44:27.456 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-08-31T05:44:27.456 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.456 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.456 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.457 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:27.457 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.457 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.457 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.457 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.457 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.457 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.457 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.458 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.458 INFO:teuthology.orchestra.run.smithi005.stdout: "ISSUE_TRACKER_API_KEY": { 2024-08-31T05:44:27.458 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-08-31T05:44:27.458 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.458 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.458 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.458 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.458 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.458 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.459 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.459 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.459 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.459 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.459 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.459 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.459 INFO:teuthology.orchestra.run.smithi005.stdout: "MANAGED_BY_CLUSTERS": { 2024-08-31T05:44:27.459 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-08-31T05:44:27.460 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.460 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.460 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.460 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "[]", 2024-08-31T05:44:27.460 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.460 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.460 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.460 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.461 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.461 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.461 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.461 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.461 INFO:teuthology.orchestra.run.smithi005.stdout: "MULTICLUSTER_CONFIG": { 2024-08-31T05:44:27.461 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "MULTICLUSTER_CONFIG", 2024-08-31T05:44:27.461 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.461 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.462 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.462 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "{}", 2024-08-31T05:44:27.462 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.462 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.462 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.462 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.462 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.462 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.463 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.463 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.463 INFO:teuthology.orchestra.run.smithi005.stdout: "PROMETHEUS_API_HOST": { 2024-08-31T05:44:27.463 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PROMETHEUS_API_HOST", 2024-08-31T05:44:27.463 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.463 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.463 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.463 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.463 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.464 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.464 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.464 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.464 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.464 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.464 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.464 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.464 INFO:teuthology.orchestra.run.smithi005.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-08-31T05:44:27.465 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-08-31T05:44:27.465 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.465 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.465 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.465 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:27.465 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.465 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.465 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.466 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.466 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.466 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.466 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.466 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.466 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-08-31T05:44:27.466 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-08-31T05:44:27.466 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.466 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.467 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.467 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.467 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.467 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.467 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.467 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.467 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.467 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.468 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.468 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.468 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-08-31T05:44:27.468 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-08-31T05:44:27.468 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.468 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.468 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.468 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.469 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.469 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.469 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.469 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.469 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.469 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.469 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.469 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.470 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-08-31T05:44:27.470 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-08-31T05:44:27.470 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.470 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.470 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.470 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:27.470 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.470 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.471 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.471 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.471 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.471 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.471 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.471 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.471 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-08-31T05:44:27.471 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-08-31T05:44:27.471 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.472 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.472 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.472 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:27.472 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.472 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.472 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.472 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.472 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.473 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.473 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.473 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.473 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-08-31T05:44:27.473 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-08-31T05:44:27.473 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.473 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.473 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.474 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.474 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.474 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.474 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.474 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.474 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.474 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.474 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.475 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.475 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-08-31T05:44:27.475 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-08-31T05:44:27.475 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.475 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.475 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.475 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.475 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.475 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.476 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.476 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.476 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.476 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.476 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.476 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.476 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-08-31T05:44:27.476 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-08-31T05:44:27.477 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.477 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.477 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.477 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.477 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.477 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.477 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.477 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.478 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.478 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.478 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.478 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.478 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_ENABLED": { 2024-08-31T05:44:27.478 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_ENABLED", 2024-08-31T05:44:27.478 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.478 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.479 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.479 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:27.479 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.479 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.479 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.479 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.479 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.479 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.479 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.480 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.480 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-08-31T05:44:27.480 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-08-31T05:44:27.480 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.480 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.480 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.480 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-08-31T05:44:27.480 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.481 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.481 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.481 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.481 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.481 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.481 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.481 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.481 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-08-31T05:44:27.482 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-08-31T05:44:27.482 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.482 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.482 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.482 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-08-31T05:44:27.482 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.482 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.482 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.483 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.483 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.483 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.483 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.483 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.483 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-08-31T05:44:27.483 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-08-31T05:44:27.483 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.484 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.484 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.484 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8", 2024-08-31T05:44:27.484 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.484 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.484 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.484 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.484 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.485 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.485 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.485 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.485 INFO:teuthology.orchestra.run.smithi005.stdout: "REST_REQUESTS_TIMEOUT": { 2024-08-31T05:44:27.485 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-08-31T05:44:27.485 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.485 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.485 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.485 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "45", 2024-08-31T05:44:27.486 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.486 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.486 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.486 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.486 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.486 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.486 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.486 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.487 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_ACCESS_KEY": { 2024-08-31T05:44:27.487 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_ACCESS_KEY", 2024-08-31T05:44:27.487 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.487 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.487 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.487 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.487 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.487 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.488 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.488 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.488 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.488 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.488 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.488 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.488 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-08-31T05:44:27.488 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-08-31T05:44:27.489 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.489 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.489 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.489 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "admin", 2024-08-31T05:44:27.489 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.489 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.489 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.489 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.489 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.490 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.490 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.490 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.490 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_SECRET_KEY": { 2024-08-31T05:44:27.490 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_SECRET_KEY", 2024-08-31T05:44:27.490 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.490 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.490 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.491 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.491 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.491 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.491 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.491 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.491 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.491 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.491 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.492 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.492 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_SSL_VERIFY": { 2024-08-31T05:44:27.492 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_SSL_VERIFY", 2024-08-31T05:44:27.492 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.492 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.492 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.492 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:27.492 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.492 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.493 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.493 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.493 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.493 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.493 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.493 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.493 INFO:teuthology.orchestra.run.smithi005.stdout: "UNSAFE_TLS_v1_2": { 2024-08-31T05:44:27.493 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "UNSAFE_TLS_v1_2", 2024-08-31T05:44:27.494 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.494 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.494 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.494 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.494 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.494 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.494 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.494 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.495 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.495 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.495 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.495 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.495 INFO:teuthology.orchestra.run.smithi005.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-08-31T05:44:27.495 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-08-31T05:44:27.495 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.495 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.495 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.496 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:27.496 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.496 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.496 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.496 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.496 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.496 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.496 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.497 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.497 INFO:teuthology.orchestra.run.smithi005.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-08-31T05:44:27.497 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-08-31T05:44:27.497 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.497 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.497 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.497 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-08-31T05:44:27.497 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.498 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.498 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.498 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.498 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.498 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.498 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.498 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.498 INFO:teuthology.orchestra.run.smithi005.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-08-31T05:44:27.499 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-08-31T05:44:27.499 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.499 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.499 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.499 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2024-08-31T05:44:27.499 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.499 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.499 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.499 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.500 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.500 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.500 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.500 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.500 INFO:teuthology.orchestra.run.smithi005.stdout: "cross_origin_url": { 2024-08-31T05:44:27.500 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cross_origin_url", 2024-08-31T05:44:27.500 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.500 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.501 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.501 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.501 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.501 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.501 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.501 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.501 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.501 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.501 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.502 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.502 INFO:teuthology.orchestra.run.smithi005.stdout: "crt_file": { 2024-08-31T05:44:27.502 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crt_file", 2024-08-31T05:44:27.502 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.502 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.502 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.502 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.502 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.503 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.503 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.503 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.503 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.503 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.503 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.503 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.503 INFO:teuthology.orchestra.run.smithi005.stdout: "debug": { 2024-08-31T05:44:27.504 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "debug", 2024-08-31T05:44:27.504 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.504 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.504 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.504 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.504 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.504 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.504 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.505 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Enable/disable debug options", 2024-08-31T05:44:27.505 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.505 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.505 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.505 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.505 INFO:teuthology.orchestra.run.smithi005.stdout: "jwt_token_ttl": { 2024-08-31T05:44:27.505 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "jwt_token_ttl", 2024-08-31T05:44:27.505 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.505 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.506 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.506 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "28800", 2024-08-31T05:44:27.506 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.506 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.506 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.506 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.506 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.506 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.507 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.507 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.507 INFO:teuthology.orchestra.run.smithi005.stdout: "key_file": { 2024-08-31T05:44:27.507 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "key_file", 2024-08-31T05:44:27.507 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.507 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.507 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.507 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.508 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.508 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.508 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.508 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.508 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.508 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.508 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.508 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.508 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:27.509 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:27.509 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.509 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.509 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.509 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.509 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.509 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.509 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.510 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.510 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.510 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.510 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.510 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.510 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.510 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.510 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.511 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.511 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.511 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.511 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.511 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:27.511 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:27.511 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.511 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.512 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.512 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.512 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.512 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.512 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.512 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.512 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.512 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.513 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.513 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.513 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:27.513 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:27.513 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.513 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.513 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.513 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:27.513 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.514 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.514 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.514 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.514 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.514 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.514 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.516 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.516 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.516 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.516 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.516 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.517 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.517 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.517 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.517 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:27.517 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:27.517 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.517 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.517 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.518 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.518 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.518 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.518 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.518 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.518 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.518 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.518 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.519 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.519 INFO:teuthology.orchestra.run.smithi005.stdout: "motd": { 2024-08-31T05:44:27.519 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "motd", 2024-08-31T05:44:27.519 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.519 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.519 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.519 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.519 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.519 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.520 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.520 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "The message of the day", 2024-08-31T05:44:27.520 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.520 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.520 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.520 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.520 INFO:teuthology.orchestra.run.smithi005.stdout: "redirect_resolve_ip_addr": { 2024-08-31T05:44:27.520 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "redirect_resolve_ip_addr", 2024-08-31T05:44:27.521 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.521 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.521 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.521 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.521 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.521 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.521 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.521 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.522 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.522 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.522 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.522 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.522 INFO:teuthology.orchestra.run.smithi005.stdout: "server_addr": { 2024-08-31T05:44:27.522 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_addr", 2024-08-31T05:44:27.522 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.522 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.523 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.523 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "::", 2024-08-31T05:44:27.523 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.523 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.523 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.523 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.523 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.523 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.523 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.524 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.524 INFO:teuthology.orchestra.run.smithi005.stdout: "server_port": { 2024-08-31T05:44:27.524 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_port", 2024-08-31T05:44:27.524 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.524 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.524 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.524 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8080", 2024-08-31T05:44:27.524 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.525 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.525 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.525 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.525 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.525 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.525 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.525 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.525 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:27.526 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:27.526 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.526 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:27.526 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.526 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:27.526 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.526 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.526 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.526 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.527 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.527 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.527 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.527 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.527 INFO:teuthology.orchestra.run.smithi005.stdout: "ssl": { 2024-08-31T05:44:27.527 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssl", 2024-08-31T05:44:27.527 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.527 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.528 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.528 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:27.528 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.528 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.528 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.528 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.528 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.528 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.529 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.529 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.529 INFO:teuthology.orchestra.run.smithi005.stdout: "ssl_server_port": { 2024-08-31T05:44:27.529 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssl_server_port", 2024-08-31T05:44:27.529 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.529 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.529 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.529 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8443", 2024-08-31T05:44:27.529 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.530 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.530 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.530 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.530 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.530 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.530 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.530 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.530 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_behaviour": { 2024-08-31T05:44:27.531 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_behaviour", 2024-08-31T05:44:27.531 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.531 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.531 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.531 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "redirect", 2024-08-31T05:44:27.531 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.531 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.531 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.532 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.532 INFO:teuthology.orchestra.run.smithi005.stdout: "redirect" 2024-08-31T05:44:27.532 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.532 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.532 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.532 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.532 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.532 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.533 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_error_status_code": { 2024-08-31T05:44:27.533 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_error_status_code", 2024-08-31T05:44:27.533 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.533 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.533 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.533 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "500", 2024-08-31T05:44:27.533 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "400", 2024-08-31T05:44:27.533 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "599", 2024-08-31T05:44:27.533 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.534 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.534 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.534 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.534 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.534 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.534 INFO:teuthology.orchestra.run.smithi005.stdout: "url_prefix": { 2024-08-31T05:44:27.534 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "url_prefix", 2024-08-31T05:44:27.534 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.535 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.535 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.535 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.535 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.535 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.535 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.535 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.535 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.536 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.536 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.536 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.536 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.536 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.536 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:27.536 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "devicehealth", 2024-08-31T05:44:27.536 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:27.536 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:27.537 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:27.537 INFO:teuthology.orchestra.run.smithi005.stdout: "enable_monitoring": { 2024-08-31T05:44:27.537 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enable_monitoring", 2024-08-31T05:44:27.537 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.537 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.537 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.537 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:27.537 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.538 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.538 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.538 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "monitor device health metrics", 2024-08-31T05:44:27.538 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.538 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.538 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.538 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.538 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:27.539 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:27.539 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.539 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.539 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.539 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.539 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.539 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.539 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.539 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.540 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.540 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.540 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.540 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.540 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.540 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.540 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.540 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.541 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.541 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.541 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.541 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:27.541 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:27.541 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.541 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.541 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.542 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.542 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.542 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.542 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.542 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.542 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.542 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.542 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.543 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.543 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:27.543 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:27.543 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.543 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.543 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.543 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:27.543 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.543 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.544 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.544 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.544 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.544 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.544 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.544 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.544 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.544 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.545 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.545 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.545 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.545 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.545 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.545 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:27.545 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:27.546 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.546 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.546 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.546 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.546 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.546 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.546 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.546 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.547 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.547 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.547 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.547 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.547 INFO:teuthology.orchestra.run.smithi005.stdout: "mark_out_threshold": { 2024-08-31T05:44:27.547 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mark_out_threshold", 2024-08-31T05:44:27.547 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:27.547 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.548 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.548 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "2419200", 2024-08-31T05:44:27.548 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.548 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.548 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.548 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-08-31T05:44:27.548 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.548 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.549 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.549 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.549 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_name": { 2024-08-31T05:44:27.549 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pool_name", 2024-08-31T05:44:27.549 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.549 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.549 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.549 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "device_health_metrics", 2024-08-31T05:44:27.549 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.550 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.550 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.550 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "name of pool in which to store device health metrics", 2024-08-31T05:44:27.550 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.550 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.550 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.550 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.550 INFO:teuthology.orchestra.run.smithi005.stdout: "retention_period": { 2024-08-31T05:44:27.551 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "retention_period", 2024-08-31T05:44:27.551 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:27.551 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.551 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.551 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "15552000", 2024-08-31T05:44:27.551 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.551 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.551 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.552 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how long to retain device health metrics", 2024-08-31T05:44:27.552 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.552 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.552 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.552 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.552 INFO:teuthology.orchestra.run.smithi005.stdout: "scrape_frequency": { 2024-08-31T05:44:27.552 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "scrape_frequency", 2024-08-31T05:44:27.552 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:27.553 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.553 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.553 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "86400", 2024-08-31T05:44:27.553 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.553 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.553 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.553 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to scrape device health metrics", 2024-08-31T05:44:27.553 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.553 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.554 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.554 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.554 INFO:teuthology.orchestra.run.smithi005.stdout: "self_heal": { 2024-08-31T05:44:27.554 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "self_heal", 2024-08-31T05:44:27.554 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.554 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.554 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.554 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:27.555 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.555 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.555 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.555 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-08-31T05:44:27.555 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.555 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.555 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.555 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.556 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2024-08-31T05:44:27.556 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2024-08-31T05:44:27.556 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:27.556 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.556 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.556 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2024-08-31T05:44:27.556 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.556 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.556 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.557 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to wake up and check device health", 2024-08-31T05:44:27.557 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.557 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.557 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.557 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.557 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:27.557 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:27.557 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.558 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:27.558 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.558 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:27.558 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.558 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.558 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.558 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.558 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.559 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.559 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.559 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.559 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_threshold": { 2024-08-31T05:44:27.559 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_threshold", 2024-08-31T05:44:27.559 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:27.559 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.559 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.560 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "7257600", 2024-08-31T05:44:27.560 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.560 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.560 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.560 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-08-31T05:44:27.560 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.560 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.560 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.561 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.561 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.561 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.561 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:27.561 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "diskprediction_local", 2024-08-31T05:44:27.561 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:27.561 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:27.561 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:27.561 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:27.562 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:27.562 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.562 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.562 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.562 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.562 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.562 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.562 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.563 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.563 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.563 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.563 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.563 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.563 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.563 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.563 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.564 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.564 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.564 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.564 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.564 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:27.564 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:27.564 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.564 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.564 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.565 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.565 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.565 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.565 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.565 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.565 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.565 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.565 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.566 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.566 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:27.566 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:27.566 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.566 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.566 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.566 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:27.566 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.567 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.567 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.567 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.567 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.567 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.567 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.567 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.567 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.567 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.568 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.568 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.568 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.568 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.568 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.568 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:27.568 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:27.569 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.569 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.569 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.569 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.569 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.569 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.569 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.569 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.569 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.570 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.570 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.570 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.570 INFO:teuthology.orchestra.run.smithi005.stdout: "predict_interval": { 2024-08-31T05:44:27.570 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "predict_interval", 2024-08-31T05:44:27.570 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.570 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.570 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.571 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "86400", 2024-08-31T05:44:27.571 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.571 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.571 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.571 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.571 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.571 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.571 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.572 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.572 INFO:teuthology.orchestra.run.smithi005.stdout: "predictor_model": { 2024-08-31T05:44:27.572 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "predictor_model", 2024-08-31T05:44:27.572 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.572 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.572 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.572 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "prophetstor", 2024-08-31T05:44:27.572 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.573 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.573 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.573 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.573 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.573 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.573 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.573 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.573 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2024-08-31T05:44:27.574 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2024-08-31T05:44:27.574 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.574 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.574 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.574 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2024-08-31T05:44:27.574 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.574 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.574 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.575 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.575 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.575 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.575 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.575 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.575 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:27.575 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:27.575 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.575 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:27.576 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.576 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:27.576 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.576 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.576 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.576 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.576 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.576 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.577 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.577 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.577 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.577 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.577 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:27.577 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "influx", 2024-08-31T05:44:27.577 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": false, 2024-08-31T05:44:27.577 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "influxdb python module not found", 2024-08-31T05:44:27.578 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:27.578 INFO:teuthology.orchestra.run.smithi005.stdout: "batch_size": { 2024-08-31T05:44:27.578 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "batch_size", 2024-08-31T05:44:27.578 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.578 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.578 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.578 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5000", 2024-08-31T05:44:27.578 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.579 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.579 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.579 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-08-31T05:44:27.579 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.579 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.579 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.579 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.579 INFO:teuthology.orchestra.run.smithi005.stdout: "database": { 2024-08-31T05:44:27.579 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "database", 2024-08-31T05:44:27.580 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.580 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.580 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.580 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "ceph", 2024-08-31T05:44:27.580 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.580 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.580 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.580 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-08-31T05:44:27.581 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.581 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.581 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.581 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.581 INFO:teuthology.orchestra.run.smithi005.stdout: "hostname": { 2024-08-31T05:44:27.581 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "hostname", 2024-08-31T05:44:27.581 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.581 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.582 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.582 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.582 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.582 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.582 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.582 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "InfluxDB server hostname", 2024-08-31T05:44:27.582 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.582 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.582 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.583 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.583 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2024-08-31T05:44:27.583 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2024-08-31T05:44:27.583 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:27.583 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.583 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.583 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "30", 2024-08-31T05:44:27.583 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "5", 2024-08-31T05:44:27.584 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.584 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.584 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-08-31T05:44:27.584 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.584 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.584 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.584 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.584 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:27.585 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:27.585 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.585 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.585 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.585 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.585 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.585 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.585 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.586 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.586 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.586 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.586 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.586 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.586 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.586 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.586 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.586 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.587 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.587 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.587 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.587 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:27.587 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:27.587 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.587 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.587 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.588 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.588 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.588 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.588 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.588 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.588 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.588 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.588 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.589 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.589 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:27.589 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:27.589 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.589 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.589 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.589 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:27.589 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.589 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.590 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.590 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.590 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.590 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.590 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.590 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.590 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.590 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.591 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.591 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.591 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.591 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.591 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.591 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:27.591 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:27.591 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.591 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.592 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.592 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.592 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.592 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.592 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.592 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.592 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.592 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.593 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.593 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.593 INFO:teuthology.orchestra.run.smithi005.stdout: "password": { 2024-08-31T05:44:27.593 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "password", 2024-08-31T05:44:27.593 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.593 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.593 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.593 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.594 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.594 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.594 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.594 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "password of InfluxDB server user", 2024-08-31T05:44:27.594 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.594 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.594 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.594 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.595 INFO:teuthology.orchestra.run.smithi005.stdout: "port": { 2024-08-31T05:44:27.595 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "port", 2024-08-31T05:44:27.595 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.595 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.595 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.595 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8086", 2024-08-31T05:44:27.595 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.595 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.595 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.596 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "InfluxDB server port", 2024-08-31T05:44:27.596 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.596 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.596 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.596 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.596 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:27.596 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:27.597 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.597 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:27.597 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.597 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:27.597 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.597 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.597 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.597 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.597 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.598 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.598 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.598 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.598 INFO:teuthology.orchestra.run.smithi005.stdout: "ssl": { 2024-08-31T05:44:27.598 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssl", 2024-08-31T05:44:27.598 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.598 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.598 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.599 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "false", 2024-08-31T05:44:27.599 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.599 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.599 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.599 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-08-31T05:44:27.599 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.599 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.599 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.600 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.600 INFO:teuthology.orchestra.run.smithi005.stdout: "threads": { 2024-08-31T05:44:27.600 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "threads", 2024-08-31T05:44:27.600 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.600 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.600 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.600 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2024-08-31T05:44:27.600 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2024-08-31T05:44:27.600 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "32", 2024-08-31T05:44:27.601 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.601 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-08-31T05:44:27.601 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.601 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.601 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.601 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.601 INFO:teuthology.orchestra.run.smithi005.stdout: "username": { 2024-08-31T05:44:27.601 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "username", 2024-08-31T05:44:27.602 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.602 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.602 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.602 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.602 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.602 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.602 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.602 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "username of InfluxDB server user", 2024-08-31T05:44:27.603 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.603 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.603 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.603 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.603 INFO:teuthology.orchestra.run.smithi005.stdout: "verify_ssl": { 2024-08-31T05:44:27.603 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "verify_ssl", 2024-08-31T05:44:27.603 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.603 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.603 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.604 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "true", 2024-08-31T05:44:27.604 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.604 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.604 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.604 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-08-31T05:44:27.604 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.604 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.604 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.605 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.605 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.605 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.605 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:27.605 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "insights", 2024-08-31T05:44:27.605 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:27.605 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:27.605 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:27.606 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:27.606 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:27.606 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.606 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.606 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.606 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.606 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.606 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.606 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.607 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.607 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.607 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.607 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.607 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.607 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.607 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.607 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.608 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.608 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.608 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.608 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.608 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:27.608 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:27.608 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.608 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.609 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.609 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.609 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.609 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.609 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.609 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.609 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.609 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.610 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.610 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.610 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:27.610 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:27.610 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.610 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.610 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.610 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:27.610 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.611 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.611 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.611 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.611 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.611 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.611 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.611 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.611 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.612 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.612 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.612 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.612 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.612 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.612 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.612 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:27.612 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:27.613 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.613 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.613 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.613 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.613 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.613 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.613 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.613 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.613 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.614 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.614 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.614 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.614 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:27.614 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:27.614 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.614 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:27.614 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.615 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:27.615 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.615 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.615 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.615 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.615 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.615 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.615 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.616 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.616 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.616 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.616 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:27.616 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "iostat", 2024-08-31T05:44:27.616 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:27.616 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:27.616 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:27.616 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:27.617 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:27.617 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.617 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.617 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.617 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.617 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.617 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.617 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.618 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.618 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.618 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.618 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.618 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.618 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.618 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.618 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.619 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.619 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.619 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.619 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.619 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:27.619 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:27.619 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.619 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.619 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.620 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.620 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.620 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.620 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.620 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.620 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.620 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.620 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.621 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.621 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:27.621 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:27.621 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.621 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.621 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.621 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:27.621 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.622 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.622 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.622 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.622 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.622 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.622 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.622 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.622 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.623 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.623 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.623 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.623 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.623 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.623 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.623 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:27.623 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:27.623 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.624 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.624 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.624 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.624 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.624 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.624 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.624 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.625 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.625 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.625 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.625 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.625 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:27.625 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:27.625 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.625 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:27.625 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.626 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:27.626 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.626 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.626 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.626 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.626 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.626 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.626 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.627 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.627 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.627 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.627 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:27.627 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "k8sevents", 2024-08-31T05:44:27.627 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:27.627 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:27.627 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:27.628 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_event_retention_days": { 2024-08-31T05:44:27.628 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ceph_event_retention_days", 2024-08-31T05:44:27.628 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.628 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.628 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.628 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "7", 2024-08-31T05:44:27.628 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.628 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.628 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.629 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Days to hold ceph event information within local cache", 2024-08-31T05:44:27.629 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.629 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.629 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.629 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.629 INFO:teuthology.orchestra.run.smithi005.stdout: "config_check_secs": { 2024-08-31T05:44:27.629 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "config_check_secs", 2024-08-31T05:44:27.629 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.630 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.630 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.630 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-08-31T05:44:27.630 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "10", 2024-08-31T05:44:27.630 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.630 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.630 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-08-31T05:44:27.630 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.631 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.631 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.631 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.631 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:27.631 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:27.631 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.631 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.631 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.632 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.632 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.632 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.632 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.632 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.632 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.632 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.632 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.632 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.633 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.633 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.633 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.633 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.633 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.633 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.633 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.633 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:27.634 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:27.634 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.634 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.634 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.634 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.634 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.634 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.634 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.635 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.635 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.635 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.635 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.635 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.635 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:27.635 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:27.635 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.635 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.636 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.636 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:27.636 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.636 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.636 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.636 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.636 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.636 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.637 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.637 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.637 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.637 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.637 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.637 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.637 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.637 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.638 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.638 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:27.638 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:27.638 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.638 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.638 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.638 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.638 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.639 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.639 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.639 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.639 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.639 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.639 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.639 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.639 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:27.640 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:27.640 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.640 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:27.640 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.640 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:27.640 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.640 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.640 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.641 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.641 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.641 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.641 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.641 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.641 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.641 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.641 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:27.641 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "localpool", 2024-08-31T05:44:27.642 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:27.642 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:27.642 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:27.642 INFO:teuthology.orchestra.run.smithi005.stdout: "failure_domain": { 2024-08-31T05:44:27.642 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "failure_domain", 2024-08-31T05:44:27.642 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.642 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.642 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.643 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "host", 2024-08-31T05:44:27.643 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.643 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.643 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.643 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "failure domain for any created local pool", 2024-08-31T05:44:27.643 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-08-31T05:44:27.643 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.643 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.644 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.644 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:27.644 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:27.644 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.644 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.644 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.644 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.644 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.644 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.645 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.645 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.645 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.645 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.645 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.645 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.645 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.645 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.646 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.646 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.646 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.646 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.646 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.646 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:27.646 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:27.646 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.647 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.647 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.647 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.647 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.647 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.647 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.647 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.647 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.647 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.648 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.648 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.648 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:27.648 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:27.648 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.648 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.648 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.648 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:27.649 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.649 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.649 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.649 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.649 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.649 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.649 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.649 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.650 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.650 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.650 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.650 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.650 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.650 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.650 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.650 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:27.650 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:27.651 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.651 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.651 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.651 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.651 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.651 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.651 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.651 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.652 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.652 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.652 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.652 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.652 INFO:teuthology.orchestra.run.smithi005.stdout: "min_size": { 2024-08-31T05:44:27.652 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "min_size", 2024-08-31T05:44:27.652 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.652 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.653 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.653 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.653 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.653 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.653 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.653 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "default min_size for any created local pool", 2024-08-31T05:44:27.653 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-08-31T05:44:27.653 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.654 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.654 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.654 INFO:teuthology.orchestra.run.smithi005.stdout: "num_rep": { 2024-08-31T05:44:27.654 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "num_rep", 2024-08-31T05:44:27.654 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.654 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.654 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.654 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "3", 2024-08-31T05:44:27.655 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.655 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.655 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.655 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "default replica count for any created local pool", 2024-08-31T05:44:27.655 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.655 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.655 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.655 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.655 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num": { 2024-08-31T05:44:27.656 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pg_num", 2024-08-31T05:44:27.656 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.656 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.656 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.656 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "128", 2024-08-31T05:44:27.656 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.656 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.656 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.657 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "default pg_num for any created local pool", 2024-08-31T05:44:27.657 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.657 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.657 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.657 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.657 INFO:teuthology.orchestra.run.smithi005.stdout: "prefix": { 2024-08-31T05:44:27.657 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "prefix", 2024-08-31T05:44:27.657 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.658 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.658 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.658 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.658 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.658 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.658 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.658 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "name prefix for any created local pool", 2024-08-31T05:44:27.658 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.658 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.659 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.659 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.659 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:27.659 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:27.659 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.659 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:27.659 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.659 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:27.660 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.660 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.660 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.660 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.660 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.660 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.660 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.660 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.661 INFO:teuthology.orchestra.run.smithi005.stdout: "subtree": { 2024-08-31T05:44:27.661 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "subtree", 2024-08-31T05:44:27.661 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.661 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.661 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.661 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "rack", 2024-08-31T05:44:27.661 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.661 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.662 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.662 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "CRUSH level for which to create a local pool", 2024-08-31T05:44:27.662 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-08-31T05:44:27.662 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.662 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.662 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.662 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.662 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.662 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:27.663 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mds_autoscaler", 2024-08-31T05:44:27.663 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:27.663 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:27.663 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:27.663 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:27.663 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:27.663 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.663 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.664 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.664 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.664 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.664 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.664 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.664 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.664 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.664 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.665 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.665 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.665 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.665 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.665 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.665 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.665 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.665 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.665 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.666 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:27.666 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:27.666 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.666 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.666 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.666 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.666 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.666 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.667 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.667 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.667 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.667 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.667 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.667 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.667 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:27.667 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:27.668 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.668 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.668 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.668 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:27.668 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.668 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.668 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.668 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.669 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.669 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.669 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.669 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.669 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.669 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.669 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.669 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.669 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.670 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.670 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.670 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:27.670 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:27.670 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.670 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.670 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.670 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.671 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.671 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.671 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.671 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.671 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.671 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.671 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.671 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.672 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:27.672 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:27.672 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.672 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:27.672 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.672 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:27.672 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.672 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.672 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.673 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.673 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.673 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.673 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.673 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.673 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.673 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.673 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:27.674 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mirroring", 2024-08-31T05:44:27.674 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:27.674 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:27.674 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:27.674 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:27.674 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:27.674 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.674 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.675 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.675 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.675 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.675 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.675 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.675 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.675 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.675 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.676 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.676 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.676 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.676 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.676 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.676 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.676 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.676 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.677 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.677 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:27.677 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:27.677 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.677 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.677 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.677 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.677 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.677 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.678 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.678 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.678 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.678 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.678 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.678 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.678 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:27.678 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:27.679 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.679 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.679 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.679 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:27.679 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.679 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.679 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.679 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.679 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.680 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.680 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.680 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.680 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.680 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.680 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.680 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.680 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.681 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.681 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.681 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:27.681 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:27.681 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.681 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.681 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.681 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.682 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.682 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.682 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.682 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.682 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.682 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.682 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.682 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.683 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:27.683 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:27.683 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.683 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:27.683 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.683 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:27.683 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.683 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.684 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.684 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.684 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.684 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.684 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.684 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.684 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.684 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.685 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:27.685 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "nfs", 2024-08-31T05:44:27.685 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:27.685 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:27.685 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:27.685 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:27.685 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:27.685 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.686 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.686 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.686 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.686 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.686 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.686 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.686 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.686 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.687 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.687 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.687 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.687 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.687 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.687 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.687 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.687 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.687 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.688 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.688 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:27.688 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:27.688 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.688 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.688 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.688 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.688 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.689 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.689 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.689 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.689 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.689 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.689 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.689 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.689 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:27.690 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:27.690 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.690 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.690 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.690 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:27.690 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.690 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.690 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.691 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.691 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.691 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.691 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.691 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.691 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.691 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.691 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.692 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.692 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.692 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.692 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.692 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:27.692 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:27.692 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.692 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.693 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.693 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.693 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.693 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.693 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.693 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.693 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.693 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.694 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.694 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.694 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:27.694 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:27.694 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.694 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:27.694 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.694 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:27.695 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.695 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.695 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.695 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.695 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.695 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.695 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.695 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.695 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.696 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.696 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:27.696 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "orchestrator", 2024-08-31T05:44:27.696 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:27.696 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:27.696 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:27.696 INFO:teuthology.orchestra.run.smithi005.stdout: "fail_fs": { 2024-08-31T05:44:27.696 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "fail_fs", 2024-08-31T05:44:27.697 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.697 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.697 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.697 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.697 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.697 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.697 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.697 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-08-31T05:44:27.698 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.698 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.698 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.698 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.698 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:27.698 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:27.698 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.698 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.699 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.699 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.699 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.699 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.699 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.699 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.699 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.699 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.700 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.700 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.700 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.700 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.700 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.700 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.700 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.700 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.701 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.701 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:27.701 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:27.701 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.701 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.701 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.701 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.701 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.702 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.702 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.702 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.702 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.702 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.702 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.702 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.702 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:27.702 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:27.703 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.703 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.703 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.703 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:27.703 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.703 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.703 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.703 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.704 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.704 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.704 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.704 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.704 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.704 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.704 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.704 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.705 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.705 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.705 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.705 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:27.705 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:27.705 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.705 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.705 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.706 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.706 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.706 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.706 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.706 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.706 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.706 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.706 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.707 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.707 INFO:teuthology.orchestra.run.smithi005.stdout: "orchestrator": { 2024-08-31T05:44:27.707 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "orchestrator", 2024-08-31T05:44:27.707 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.707 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.707 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.707 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.707 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.707 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.708 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.708 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm", 2024-08-31T05:44:27.708 INFO:teuthology.orchestra.run.smithi005.stdout: "rook", 2024-08-31T05:44:27.708 INFO:teuthology.orchestra.run.smithi005.stdout: "test_orchestrator" 2024-08-31T05:44:27.708 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.708 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Orchestrator backend", 2024-08-31T05:44:27.708 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.708 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.709 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.709 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.709 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:27.709 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:27.709 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.709 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:27.709 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.709 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:27.710 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.710 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.710 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.710 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.710 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.710 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.710 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.710 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.711 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.711 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.711 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:27.711 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "osd_perf_query", 2024-08-31T05:44:27.711 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:27.711 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:27.711 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:27.711 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:27.712 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:27.712 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.712 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.712 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.712 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.712 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.712 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.712 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.713 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.713 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.713 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.713 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.713 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.713 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.713 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.713 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.714 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.714 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.714 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.714 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.714 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:27.714 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:27.714 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.714 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.714 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.715 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.715 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.715 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.715 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.715 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.715 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.715 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.715 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.716 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.716 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:27.716 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:27.716 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.716 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.716 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.716 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:27.716 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.717 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.717 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.717 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.717 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.717 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.717 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.717 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.717 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.718 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.718 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.718 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.718 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.718 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.718 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.718 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:27.718 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:27.720 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.720 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.720 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.720 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.720 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.720 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.721 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.721 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.721 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.721 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.721 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.721 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.721 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:27.721 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:27.722 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.722 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:27.722 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.722 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:27.722 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.722 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.722 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.722 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.723 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.723 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.723 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.723 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.723 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.723 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.723 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:27.723 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "osd_support", 2024-08-31T05:44:27.724 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:27.724 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:27.724 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:27.724 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:27.724 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:27.724 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.724 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.724 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.725 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.725 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.725 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.725 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.725 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.725 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.725 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.725 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.726 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.726 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.726 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.726 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.726 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.726 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.726 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.726 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.726 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:27.727 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:27.727 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.727 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.727 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.727 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.727 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.727 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.727 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.728 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.728 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.728 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.728 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.728 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.728 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:27.728 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:27.728 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.729 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.729 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.729 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:27.729 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.729 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.729 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.729 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.729 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.730 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.730 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.730 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.730 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.730 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.730 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.730 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.730 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.731 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.731 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.731 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:27.731 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:27.731 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.731 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.731 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.731 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.731 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.732 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.732 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.732 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.732 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.732 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.732 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.732 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.732 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:27.733 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:27.733 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.733 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:27.733 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.733 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:27.733 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.733 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.733 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.734 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.734 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.734 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.734 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.734 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.734 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.734 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.734 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:27.735 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pg_autoscaler", 2024-08-31T05:44:27.735 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:27.735 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:27.735 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:27.735 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:27.735 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:27.735 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.735 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.736 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.736 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.736 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.736 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.736 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.736 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.736 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.736 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.737 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.737 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.737 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.737 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.737 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.737 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.737 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.737 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.738 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.738 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:27.738 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:27.738 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.738 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.738 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.738 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.738 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.739 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.739 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.739 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.739 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.739 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.739 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.739 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.739 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:27.739 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:27.740 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.740 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.740 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.740 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:27.740 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.740 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.740 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.741 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.741 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.741 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.741 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.741 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.741 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.741 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.741 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.742 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.742 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.742 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.742 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.742 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:27.742 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:27.742 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.743 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.743 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.743 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.743 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.743 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.743 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.743 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.743 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.743 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.744 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.744 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.744 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2024-08-31T05:44:27.744 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2024-08-31T05:44:27.744 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:27.744 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.744 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.744 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2024-08-31T05:44:27.745 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.745 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.745 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.745 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.745 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.745 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.745 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.745 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.746 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:27.746 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:27.746 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.746 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:27.746 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.746 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:27.746 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.746 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.747 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.747 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.747 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.747 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.747 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.747 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.747 INFO:teuthology.orchestra.run.smithi005.stdout: "threshold": { 2024-08-31T05:44:27.747 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "threshold", 2024-08-31T05:44:27.748 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-08-31T05:44:27.748 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.748 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.748 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "3.0", 2024-08-31T05:44:27.748 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1.0", 2024-08-31T05:44:27.748 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.748 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.748 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "scaling threshold", 2024-08-31T05:44:27.748 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-08-31T05:44:27.749 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.749 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.749 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.749 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.749 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.749 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:27.749 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "progress", 2024-08-31T05:44:27.749 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:27.750 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:27.750 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:27.750 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_pg_recovery_event": { 2024-08-31T05:44:27.750 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "allow_pg_recovery_event", 2024-08-31T05:44:27.750 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.750 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.750 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.750 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.751 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.751 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.751 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.751 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "allow the module to show pg recovery progress", 2024-08-31T05:44:27.751 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.751 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.751 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.751 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.752 INFO:teuthology.orchestra.run.smithi005.stdout: "enabled": { 2024-08-31T05:44:27.752 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enabled", 2024-08-31T05:44:27.752 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.752 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.752 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.752 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:27.752 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.752 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.753 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.753 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.753 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.753 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.753 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.753 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.753 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:27.753 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:27.754 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.754 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.754 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.754 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.754 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.754 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.754 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.754 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.754 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.755 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.755 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.755 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.755 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.755 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.755 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.755 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.755 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.756 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.756 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.756 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:27.756 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:27.756 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.756 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.756 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.756 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.757 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.757 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.757 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.757 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.757 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.757 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.757 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.757 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.758 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:27.758 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:27.758 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.758 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.758 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.758 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:27.758 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.758 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.759 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.759 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.759 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.759 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.759 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.759 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.759 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.759 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.760 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.760 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.760 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.760 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.760 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.760 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:27.760 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:27.760 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.761 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.761 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.761 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.761 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.761 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.761 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.761 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.761 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.761 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.762 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.762 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.762 INFO:teuthology.orchestra.run.smithi005.stdout: "max_completed_events": { 2024-08-31T05:44:27.762 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_completed_events", 2024-08-31T05:44:27.762 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.762 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.762 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.762 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "50", 2024-08-31T05:44:27.763 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.763 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.763 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.763 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "number of past completed events to remember", 2024-08-31T05:44:27.763 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.763 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.763 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.763 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.764 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2024-08-31T05:44:27.764 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2024-08-31T05:44:27.764 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:27.764 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.764 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.764 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2024-08-31T05:44:27.764 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.764 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.765 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.765 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how long the module is going to sleep", 2024-08-31T05:44:27.765 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.765 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.765 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.765 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.765 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:27.765 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:27.766 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.766 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:27.766 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.766 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:27.766 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.766 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.766 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.766 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.767 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.767 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.767 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.767 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.767 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.767 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.767 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:27.767 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "prometheus", 2024-08-31T05:44:27.767 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:27.768 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:27.768 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:27.768 INFO:teuthology.orchestra.run.smithi005.stdout: "cache": { 2024-08-31T05:44:27.768 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cache", 2024-08-31T05:44:27.768 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.768 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.768 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.768 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:27.769 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.769 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.769 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.769 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.769 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.769 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.769 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.770 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.770 INFO:teuthology.orchestra.run.smithi005.stdout: "exclude_perf_counters": { 2024-08-31T05:44:27.770 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "exclude_perf_counters", 2024-08-31T05:44:27.770 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.770 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.770 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.770 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:27.770 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.771 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.771 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.771 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-08-31T05:44:27.771 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-08-31T05:44:27.771 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.771 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.771 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.771 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:27.772 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:27.772 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.772 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.772 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.772 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.772 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.772 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.772 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.772 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.773 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.773 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.773 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.773 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.773 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.773 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.773 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.774 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.774 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.774 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.774 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.774 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:27.774 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:27.774 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.774 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.775 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.775 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.775 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.775 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.775 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.775 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.775 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.775 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.776 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.776 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.776 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:27.776 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:27.776 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.776 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.776 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.776 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:27.777 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.777 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.777 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.777 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.777 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.777 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.777 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.777 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.778 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.778 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.778 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.778 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.778 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.778 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.778 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.778 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:27.779 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:27.779 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.779 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.779 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.779 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.779 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.779 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.779 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.780 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.780 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.780 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.780 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.780 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.780 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_stats_pools": { 2024-08-31T05:44:27.780 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_stats_pools", 2024-08-31T05:44:27.780 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.781 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.781 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.781 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.781 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.781 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.781 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.781 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.781 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.782 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.782 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.782 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.782 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_stats_pools_refresh_interval": { 2024-08-31T05:44:27.782 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-08-31T05:44:27.782 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.782 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.782 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.783 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "300", 2024-08-31T05:44:27.783 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.783 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.783 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.783 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.783 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.783 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.783 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.784 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.784 INFO:teuthology.orchestra.run.smithi005.stdout: "scrape_interval": { 2024-08-31T05:44:27.784 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "scrape_interval", 2024-08-31T05:44:27.784 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-08-31T05:44:27.784 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.784 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.784 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "15.0", 2024-08-31T05:44:27.784 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.785 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.785 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.785 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.785 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.785 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.785 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.785 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.785 INFO:teuthology.orchestra.run.smithi005.stdout: "server_addr": { 2024-08-31T05:44:27.786 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_addr", 2024-08-31T05:44:27.786 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.786 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.786 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.786 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "::", 2024-08-31T05:44:27.786 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.786 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.786 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.787 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-08-31T05:44:27.787 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.787 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.787 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.787 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.787 INFO:teuthology.orchestra.run.smithi005.stdout: "server_port": { 2024-08-31T05:44:27.787 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_port", 2024-08-31T05:44:27.787 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.788 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.788 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.788 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "9283", 2024-08-31T05:44:27.788 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.788 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.788 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.788 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-08-31T05:44:27.788 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.789 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.789 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.789 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.789 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:27.789 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:27.789 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.789 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:27.789 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.790 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:27.790 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.790 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.790 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.790 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.790 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.790 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.790 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.791 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.791 INFO:teuthology.orchestra.run.smithi005.stdout: "stale_cache_strategy": { 2024-08-31T05:44:27.791 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "stale_cache_strategy", 2024-08-31T05:44:27.791 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.791 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.791 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.791 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "log", 2024-08-31T05:44:27.791 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.791 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.792 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.792 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.792 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.792 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.792 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.792 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.792 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_behaviour": { 2024-08-31T05:44:27.792 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_behaviour", 2024-08-31T05:44:27.793 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.793 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.793 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.793 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "default", 2024-08-31T05:44:27.793 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.793 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.793 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.793 INFO:teuthology.orchestra.run.smithi005.stdout: "default", 2024-08-31T05:44:27.794 INFO:teuthology.orchestra.run.smithi005.stdout: "error" 2024-08-31T05:44:27.794 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.794 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.794 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.794 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.794 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.794 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.794 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_error_status_code": { 2024-08-31T05:44:27.795 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_error_status_code", 2024-08-31T05:44:27.795 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.795 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.795 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.795 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "500", 2024-08-31T05:44:27.795 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "400", 2024-08-31T05:44:27.795 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "599", 2024-08-31T05:44:27.795 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.795 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.796 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.796 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.796 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.796 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.796 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.796 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.796 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:27.796 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_support", 2024-08-31T05:44:27.797 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:27.797 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:27.797 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:27.797 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:27.797 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:27.797 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.797 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.797 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.798 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.798 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.798 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.798 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.798 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.798 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.798 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.798 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.799 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.799 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.799 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.799 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.799 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.799 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.799 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.799 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.800 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:27.800 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:27.800 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.800 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.800 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.800 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.800 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.800 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.801 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.801 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.801 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.801 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.801 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.801 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.801 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:27.801 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:27.802 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.802 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.802 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.802 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:27.802 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.802 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.802 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.802 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.803 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.803 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.803 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.803 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.803 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.803 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.803 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.803 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.804 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.804 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.804 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.804 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:27.804 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:27.804 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.804 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.804 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.805 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.805 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.805 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.805 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.805 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.805 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.805 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.805 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.806 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.806 INFO:teuthology.orchestra.run.smithi005.stdout: "max_concurrent_snap_create": { 2024-08-31T05:44:27.806 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_concurrent_snap_create", 2024-08-31T05:44:27.806 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.806 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.806 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.806 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-08-31T05:44:27.806 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.807 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.807 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.807 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.807 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.807 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.807 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.807 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.807 INFO:teuthology.orchestra.run.smithi005.stdout: "mirror_snapshot_schedule": { 2024-08-31T05:44:27.808 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mirror_snapshot_schedule", 2024-08-31T05:44:27.808 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.808 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.808 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.808 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.808 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.808 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.808 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.809 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.809 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.809 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.809 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.809 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.809 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:27.809 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:27.809 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.810 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:27.810 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.810 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:27.810 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.810 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.810 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.810 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.810 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.810 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.811 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.811 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.811 INFO:teuthology.orchestra.run.smithi005.stdout: "trash_purge_schedule": { 2024-08-31T05:44:27.811 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "trash_purge_schedule", 2024-08-31T05:44:27.811 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.811 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.811 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.811 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.812 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.812 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.812 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.812 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.812 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.812 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.812 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.812 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.813 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.813 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.813 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:27.813 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "restful", 2024-08-31T05:44:27.813 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:27.813 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:27.813 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:27.813 INFO:teuthology.orchestra.run.smithi005.stdout: "enable_auth": { 2024-08-31T05:44:27.814 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enable_auth", 2024-08-31T05:44:27.814 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.814 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.814 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.814 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:27.814 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.814 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.814 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.814 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.815 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.815 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.815 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.815 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.815 INFO:teuthology.orchestra.run.smithi005.stdout: "key_file": { 2024-08-31T05:44:27.815 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "key_file", 2024-08-31T05:44:27.815 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.815 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.816 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.816 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.816 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.816 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.816 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.816 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.816 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.816 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.817 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.817 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.817 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:27.817 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:27.817 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.817 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.817 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.817 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.818 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.818 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.818 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.818 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.818 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.818 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.818 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.818 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.819 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.819 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.819 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.819 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.819 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.819 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.819 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.819 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:27.819 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:27.820 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.820 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.820 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.820 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.820 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.820 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.820 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.820 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.821 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.821 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.821 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.821 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.821 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:27.821 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:27.821 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.821 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.822 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.822 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:27.822 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.822 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.822 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.822 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.822 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.822 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.822 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.823 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.823 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.823 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.823 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.823 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.823 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.823 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.823 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.824 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:27.824 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:27.824 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.824 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.824 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.824 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.824 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.824 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.825 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.825 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.825 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.825 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.825 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.825 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.825 INFO:teuthology.orchestra.run.smithi005.stdout: "max_requests": { 2024-08-31T05:44:27.825 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_requests", 2024-08-31T05:44:27.826 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.826 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.826 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.826 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "500", 2024-08-31T05:44:27.826 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.826 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.826 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.826 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-08-31T05:44:27.826 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.827 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.827 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.827 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.827 INFO:teuthology.orchestra.run.smithi005.stdout: "server_addr": { 2024-08-31T05:44:27.827 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_addr", 2024-08-31T05:44:27.827 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.827 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.827 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.828 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.828 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.828 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.828 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.828 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.828 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.828 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.828 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.829 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.829 INFO:teuthology.orchestra.run.smithi005.stdout: "server_port": { 2024-08-31T05:44:27.829 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_port", 2024-08-31T05:44:27.829 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.829 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.829 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.829 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.829 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.830 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.830 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.830 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.830 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.830 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.830 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.830 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.830 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:27.831 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:27.831 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.831 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:27.831 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.831 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:27.831 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.831 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.831 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.832 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.832 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.832 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.832 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.832 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.832 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.832 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.832 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:27.833 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rgw", 2024-08-31T05:44:27.833 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:27.833 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:27.833 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:27.833 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:27.833 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:27.833 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.833 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.834 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.834 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.834 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.834 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.834 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.834 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.834 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.834 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.834 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.835 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.835 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.835 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.835 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.835 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.835 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.835 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.835 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.836 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:27.836 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:27.836 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.836 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.836 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.836 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.836 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.836 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.837 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.837 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.837 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.837 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.837 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.837 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.837 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:27.837 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:27.838 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.838 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.838 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.838 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:27.838 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.838 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.838 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.838 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.839 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.839 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.839 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.839 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.839 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.839 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.839 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.839 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.840 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.840 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.840 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.840 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:27.840 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:27.840 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.840 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.840 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.841 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.841 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.841 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.841 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.841 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.841 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.841 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.841 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.841 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.842 INFO:teuthology.orchestra.run.smithi005.stdout: "secondary_zone_period_retry_limit": { 2024-08-31T05:44:27.842 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "secondary_zone_period_retry_limit", 2024-08-31T05:44:27.842 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.842 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.842 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.842 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2024-08-31T05:44:27.842 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.842 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.843 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.843 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-08-31T05:44:27.843 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.843 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.843 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.843 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.843 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:27.843 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:27.844 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.844 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:27.844 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.844 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:27.844 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.844 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.844 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.844 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.844 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.845 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.845 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.845 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.845 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.845 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.845 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:27.845 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rook", 2024-08-31T05:44:27.845 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:27.846 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:27.846 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:27.846 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:27.846 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:27.846 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.846 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.846 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.846 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.847 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.847 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.847 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.847 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.847 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.847 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.847 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.847 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.847 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.848 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.848 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.848 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.848 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.848 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.848 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.848 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:27.848 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:27.849 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.849 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.849 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.849 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.849 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.849 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.849 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.849 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.850 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.850 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.850 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.850 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.850 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:27.850 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:27.850 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.850 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.851 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.851 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:27.851 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.851 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.851 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.851 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.851 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.851 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.852 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.852 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.852 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.852 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.852 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.852 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.852 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.852 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.852 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.853 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:27.853 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:27.853 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.853 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.853 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.853 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.853 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.853 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.854 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.854 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.854 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.854 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.854 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.854 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.854 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:27.854 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:27.855 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.855 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:27.855 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.855 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:27.855 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.855 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.855 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.855 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.855 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.856 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.856 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.856 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.856 INFO:teuthology.orchestra.run.smithi005.stdout: "storage_class": { 2024-08-31T05:44:27.856 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "storage_class", 2024-08-31T05:44:27.856 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.856 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.856 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.857 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "local", 2024-08-31T05:44:27.857 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.857 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.857 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.857 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-08-31T05:44:27.857 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.857 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.857 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.858 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.858 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.858 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.858 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:27.858 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "selftest", 2024-08-31T05:44:27.858 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:27.858 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:27.858 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:27.859 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:27.859 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:27.859 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.859 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.859 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.859 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.859 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.859 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.859 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.860 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.860 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.860 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.860 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.860 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.860 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.860 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.860 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.861 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.861 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.861 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.861 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.861 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:27.861 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:27.861 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.861 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.862 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.862 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.862 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.862 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.862 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.862 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.862 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.862 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.863 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.863 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.863 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:27.863 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:27.863 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.863 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.863 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.863 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:27.864 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.864 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.864 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.864 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.864 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.864 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.864 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.864 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.864 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.865 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.865 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.865 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.865 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.865 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.865 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.865 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:27.865 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:27.866 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.866 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.866 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.866 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.866 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.866 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.866 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.866 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.867 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.867 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.867 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.867 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.867 INFO:teuthology.orchestra.run.smithi005.stdout: "roption1": { 2024-08-31T05:44:27.867 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "roption1", 2024-08-31T05:44:27.867 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.867 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.867 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.868 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.868 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.868 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.868 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.868 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.868 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.868 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.868 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.869 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.869 INFO:teuthology.orchestra.run.smithi005.stdout: "roption2": { 2024-08-31T05:44:27.869 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "roption2", 2024-08-31T05:44:27.869 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.869 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.869 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.869 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "xyz", 2024-08-31T05:44:27.869 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.870 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.870 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.870 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.870 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.870 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.870 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.870 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.870 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption1": { 2024-08-31T05:44:27.871 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption1", 2024-08-31T05:44:27.871 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.871 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.871 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.871 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.871 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.871 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.871 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.871 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.872 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.872 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.872 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.872 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.872 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption2": { 2024-08-31T05:44:27.872 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption2", 2024-08-31T05:44:27.872 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.872 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.873 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.873 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.873 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.873 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.873 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.873 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.873 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.873 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.874 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.874 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.874 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption3": { 2024-08-31T05:44:27.874 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption3", 2024-08-31T05:44:27.874 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-08-31T05:44:27.874 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.874 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.874 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.874 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.875 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.875 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.875 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.875 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.875 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.875 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.875 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.875 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption4": { 2024-08-31T05:44:27.876 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption4", 2024-08-31T05:44:27.876 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.876 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.876 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.876 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.876 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.876 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.876 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.877 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.877 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.877 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.877 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.877 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.877 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption5": { 2024-08-31T05:44:27.877 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption5", 2024-08-31T05:44:27.877 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.878 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.878 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.878 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.878 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.878 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.878 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.878 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.878 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.879 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.879 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.879 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.879 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption6": { 2024-08-31T05:44:27.879 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption6", 2024-08-31T05:44:27.879 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.879 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.879 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.880 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:27.880 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.880 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.880 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.880 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.880 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.880 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.880 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.881 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.881 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption7": { 2024-08-31T05:44:27.881 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption7", 2024-08-31T05:44:27.881 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.881 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.881 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.881 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.881 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2024-08-31T05:44:27.881 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "42", 2024-08-31T05:44:27.882 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.882 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.882 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.882 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.882 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.882 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.882 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:27.882 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:27.883 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.883 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:27.883 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.883 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:27.883 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.883 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.883 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.883 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.884 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.884 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.884 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.884 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.884 INFO:teuthology.orchestra.run.smithi005.stdout: "testkey": { 2024-08-31T05:44:27.884 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "testkey", 2024-08-31T05:44:27.884 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.884 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.884 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.885 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.885 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.885 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.885 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.885 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.885 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.885 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.886 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.886 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.886 INFO:teuthology.orchestra.run.smithi005.stdout: "testlkey": { 2024-08-31T05:44:27.886 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "testlkey", 2024-08-31T05:44:27.886 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.886 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.886 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.886 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.886 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.887 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.887 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.887 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.887 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.887 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.887 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.887 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.887 INFO:teuthology.orchestra.run.smithi005.stdout: "testnewline": { 2024-08-31T05:44:27.888 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "testnewline", 2024-08-31T05:44:27.888 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.888 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.888 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.888 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.888 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.888 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.888 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.889 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.889 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.889 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.889 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.889 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.889 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.889 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.889 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:27.890 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smb", 2024-08-31T05:44:27.890 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:27.890 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:27.890 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:27.890 INFO:teuthology.orchestra.run.smithi005.stdout: "internal_store_backend": { 2024-08-31T05:44:27.890 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "internal_store_backend", 2024-08-31T05:44:27.890 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.890 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:27.891 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.891 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.891 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.891 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.891 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.891 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-08-31T05:44:27.891 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.891 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.891 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.892 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.892 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:27.892 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:27.892 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.892 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.892 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.892 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.893 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.893 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.893 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.893 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.893 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.893 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.893 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.893 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.893 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.894 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.894 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.894 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.894 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.894 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.894 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.894 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:27.894 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:27.895 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.895 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.895 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.895 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.895 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.895 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.895 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.895 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.896 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.896 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.896 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.896 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.896 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:27.896 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:27.896 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.896 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.897 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.897 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:27.897 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.897 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.897 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.897 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.897 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.897 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.898 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.898 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.898 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.898 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.898 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.898 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.898 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.898 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.899 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.899 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:27.899 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:27.899 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.899 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.899 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.899 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.899 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.900 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.900 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.900 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.900 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.900 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.900 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.900 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.900 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:27.901 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:27.901 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.901 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:27.901 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.901 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:27.901 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.901 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.902 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.902 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.902 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.902 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.902 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.902 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.902 INFO:teuthology.orchestra.run.smithi005.stdout: "update_orchestration": { 2024-08-31T05:44:27.902 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "update_orchestration", 2024-08-31T05:44:27.903 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.903 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.903 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.903 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:27.903 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.903 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.903 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.903 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-08-31T05:44:27.904 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.904 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.904 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.904 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.904 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.904 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.904 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:27.904 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "snap_schedule", 2024-08-31T05:44:27.905 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:27.905 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:27.905 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:27.905 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_m_granularity": { 2024-08-31T05:44:27.905 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "allow_m_granularity", 2024-08-31T05:44:27.905 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.905 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.905 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.905 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.906 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.906 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.906 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.906 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "allow minute scheduled snapshots", 2024-08-31T05:44:27.906 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.906 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.906 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.906 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.907 INFO:teuthology.orchestra.run.smithi005.stdout: "dump_on_update": { 2024-08-31T05:44:27.907 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "dump_on_update", 2024-08-31T05:44:27.907 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.907 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.907 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.907 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.907 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.907 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.908 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.908 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "dump database to debug log on update", 2024-08-31T05:44:27.908 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.908 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.908 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.908 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.908 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:27.908 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:27.909 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.909 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.909 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.909 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.909 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.909 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.909 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.909 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.909 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.910 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.910 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.910 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.910 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.910 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.910 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.910 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.910 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.911 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.911 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.911 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:27.911 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:27.911 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.911 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.912 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.912 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.912 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.912 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.912 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.912 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.912 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.912 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.913 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.913 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.913 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:27.913 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:27.913 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.913 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.914 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.914 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:27.914 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.914 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.914 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.914 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.914 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.914 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.915 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.915 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.915 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.915 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.915 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.915 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.915 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.915 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.915 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.916 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:27.916 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:27.916 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.916 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.916 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.916 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.916 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.916 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.917 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.917 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.917 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.917 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.917 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.917 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.918 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:27.918 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:27.918 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.918 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:27.918 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.918 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:27.918 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.918 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.919 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.919 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.919 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.919 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.919 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.919 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.919 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.919 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.920 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:27.920 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "stats", 2024-08-31T05:44:27.920 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:27.920 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:27.920 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:27.920 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:27.920 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:27.920 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.921 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.921 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.924 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.924 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.924 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.924 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.924 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.924 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.925 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.925 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.925 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.925 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.925 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.925 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.925 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.925 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.926 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.926 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.926 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:27.926 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:27.926 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.926 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.926 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.926 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.926 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.927 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.927 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.927 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.927 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.927 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.927 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.927 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.927 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:27.928 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:27.928 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.928 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.928 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.928 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:27.928 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.928 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.928 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.929 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.929 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.929 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.929 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.929 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.929 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.929 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.929 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.929 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.930 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.930 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.930 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.930 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:27.930 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:27.930 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.930 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.930 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.931 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.931 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.931 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.931 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.931 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.931 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.931 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.931 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.931 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.932 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:27.932 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:27.932 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.932 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:27.932 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.932 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:27.932 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.932 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.933 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.933 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.933 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.933 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.933 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.933 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.933 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.933 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.934 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:27.934 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "status", 2024-08-31T05:44:27.934 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:27.934 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:27.934 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:27.934 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:27.934 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:27.934 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.934 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.935 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.935 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.935 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.935 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.935 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.935 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.935 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.935 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.936 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.936 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.936 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.936 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.936 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.936 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.936 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.936 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.936 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.937 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:27.937 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:27.937 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.937 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.937 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.937 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.937 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.937 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.938 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.938 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.938 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.938 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.938 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.938 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.938 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:27.938 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:27.939 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.939 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.939 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.939 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:27.939 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.939 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.939 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.939 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.939 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.940 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.940 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.940 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.940 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.940 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.940 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.940 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.940 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.941 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.941 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.941 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:27.941 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:27.941 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.941 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.941 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.941 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.941 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.942 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.942 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.942 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.942 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.942 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.942 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.942 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.942 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:27.943 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:27.943 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.943 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:27.943 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.943 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:27.943 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.943 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.943 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.944 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.944 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.944 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.944 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.944 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.944 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.944 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.944 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:27.944 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "telegraf", 2024-08-31T05:44:27.945 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:27.945 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:27.945 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:27.945 INFO:teuthology.orchestra.run.smithi005.stdout: "address": { 2024-08-31T05:44:27.945 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "address", 2024-08-31T05:44:27.945 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.945 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.945 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.946 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-08-31T05:44:27.946 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.946 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.946 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.946 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.946 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.946 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.946 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.947 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.947 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2024-08-31T05:44:27.947 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2024-08-31T05:44:27.947 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:27.947 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.947 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.947 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "15", 2024-08-31T05:44:27.947 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.947 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.948 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.948 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.948 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.948 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.948 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.948 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.948 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:27.948 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:27.949 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.949 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.949 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.949 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.949 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.949 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.949 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.949 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.950 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.950 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.950 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.950 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.950 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.950 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.950 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.950 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.951 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.951 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.951 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.951 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:27.951 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:27.951 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.951 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.951 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.952 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.952 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.952 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.952 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.952 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.952 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.952 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.952 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.953 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.953 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:27.953 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:27.953 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.953 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.953 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.953 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:27.953 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.954 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.954 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.954 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.954 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.954 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.954 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.954 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.954 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.954 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.955 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.955 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.955 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.955 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.955 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.955 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:27.955 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:27.955 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.956 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.956 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.956 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.956 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.956 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.956 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.956 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.956 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.956 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.957 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.957 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.957 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:27.957 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:27.957 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.957 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:27.957 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.957 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:27.958 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.958 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.958 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.958 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.958 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.958 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.958 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.958 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.959 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.959 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.959 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:27.959 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "telemetry", 2024-08-31T05:44:27.959 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:27.959 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:27.959 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:27.959 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_basic": { 2024-08-31T05:44:27.959 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_basic", 2024-08-31T05:44:27.960 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.960 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.960 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.960 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:27.960 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.960 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.960 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.960 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share basic cluster information (size, version)", 2024-08-31T05:44:27.961 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.961 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.961 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.961 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.961 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_crash": { 2024-08-31T05:44:27.961 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_crash", 2024-08-31T05:44:27.961 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.961 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.962 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.962 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:27.962 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.962 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.962 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.962 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-08-31T05:44:27.962 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.962 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.962 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.963 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.963 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_device": { 2024-08-31T05:44:27.963 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_device", 2024-08-31T05:44:27.963 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.963 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.963 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.963 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:27.963 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.964 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.964 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.964 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-08-31T05:44:27.964 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.964 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.964 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.964 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.964 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_ident": { 2024-08-31T05:44:27.964 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_ident", 2024-08-31T05:44:27.965 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.965 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.965 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.965 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.965 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.965 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.965 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.965 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-08-31T05:44:27.966 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.966 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.966 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.966 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.966 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_perf": { 2024-08-31T05:44:27.966 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_perf", 2024-08-31T05:44:27.966 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.966 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.967 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.967 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.967 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.967 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.967 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.967 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share various performance metrics of a cluster", 2024-08-31T05:44:27.967 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.967 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.968 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.968 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.968 INFO:teuthology.orchestra.run.smithi005.stdout: "contact": { 2024-08-31T05:44:27.968 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "contact", 2024-08-31T05:44:27.968 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.968 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.968 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.968 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.968 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.969 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.969 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.969 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.969 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.969 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.969 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.969 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.969 INFO:teuthology.orchestra.run.smithi005.stdout: "description": { 2024-08-31T05:44:27.970 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "description", 2024-08-31T05:44:27.970 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.970 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.970 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.970 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.970 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.970 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.970 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.971 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.971 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.971 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.971 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.971 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.971 INFO:teuthology.orchestra.run.smithi005.stdout: "device_url": { 2024-08-31T05:44:27.971 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "device_url", 2024-08-31T05:44:27.971 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.972 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.972 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.972 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-08-31T05:44:27.972 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.972 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.972 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.972 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.972 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.973 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.973 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.973 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.973 INFO:teuthology.orchestra.run.smithi005.stdout: "enabled": { 2024-08-31T05:44:27.973 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enabled", 2024-08-31T05:44:27.973 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.973 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.973 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.973 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.974 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.974 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.974 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.974 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.974 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.974 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.974 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.974 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.975 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2024-08-31T05:44:27.975 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2024-08-31T05:44:27.975 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.975 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.975 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.975 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "24", 2024-08-31T05:44:27.975 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "8", 2024-08-31T05:44:27.975 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.976 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.976 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.976 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.976 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.976 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.976 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.976 INFO:teuthology.orchestra.run.smithi005.stdout: "last_opt_revision": { 2024-08-31T05:44:27.976 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "last_opt_revision", 2024-08-31T05:44:27.977 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.977 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.977 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.977 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "1", 2024-08-31T05:44:27.977 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.977 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.977 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.977 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.978 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.978 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.978 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.978 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.978 INFO:teuthology.orchestra.run.smithi005.stdout: "leaderboard": { 2024-08-31T05:44:27.978 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "leaderboard", 2024-08-31T05:44:27.978 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.978 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.978 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.979 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.979 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.979 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.979 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.979 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.979 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.979 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.979 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.980 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.980 INFO:teuthology.orchestra.run.smithi005.stdout: "leaderboard_description": { 2024-08-31T05:44:27.980 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "leaderboard_description", 2024-08-31T05:44:27.980 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.980 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.980 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.980 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.980 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.981 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.981 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.981 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.981 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.981 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.981 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.981 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.981 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:27.981 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:27.982 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.982 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.982 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.982 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.982 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.982 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.982 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.982 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.983 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.983 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.983 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.983 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.983 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.983 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.983 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.983 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.983 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.984 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.984 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.984 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:27.984 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:27.984 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.984 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.984 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.984 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.985 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.985 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.985 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.985 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.985 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.985 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.985 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.985 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.986 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:27.986 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:27.986 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.986 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.986 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.986 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:27.986 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.986 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.986 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.987 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.987 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.987 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.987 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.987 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.987 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.987 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.987 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.988 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.988 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.988 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.988 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.988 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:27.988 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:27.988 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:27.988 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.989 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.989 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:27.989 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.989 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.989 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.989 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.989 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.989 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.990 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.990 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.990 INFO:teuthology.orchestra.run.smithi005.stdout: "organization": { 2024-08-31T05:44:27.990 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "organization", 2024-08-31T05:44:27.990 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.990 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.990 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.990 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.990 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.991 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.991 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.991 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.991 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.991 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.991 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.991 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.991 INFO:teuthology.orchestra.run.smithi005.stdout: "proxy": { 2024-08-31T05:44:27.991 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "proxy", 2024-08-31T05:44:27.992 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.992 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.992 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.992 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.992 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.992 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.992 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.993 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.993 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.993 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.993 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.993 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.993 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:27.993 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:27.993 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:27.994 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:27.994 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.994 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:27.994 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.994 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.994 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.994 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.994 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.995 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.995 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.995 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.995 INFO:teuthology.orchestra.run.smithi005.stdout: "url": { 2024-08-31T05:44:27.995 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "url", 2024-08-31T05:44:27.995 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.995 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.995 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:27.995 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-08-31T05:44:27.996 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.996 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.996 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:27.996 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.996 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:27.996 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:27.996 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:27.996 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.997 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:27.997 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:27.997 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:27.997 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "test_orchestrator", 2024-08-31T05:44:27.997 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:27.997 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:27.997 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:27.997 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:27.998 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:27.998 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:27.998 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:27.998 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:27.998 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:27.998 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:27.998 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:27.998 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:27.998 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:27.999 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:27.999 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:27.999 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:27.999 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:27.999 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:27.999 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:27.999 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:27.999 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:28.000 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:28.000 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:28.000 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.000 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:28.000 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:28.000 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:28.000 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:28.001 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:28.001 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:28.001 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:28.001 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:28.001 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:28.001 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:28.001 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:28.001 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:28.001 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:28.002 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.002 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:28.002 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:28.002 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:28.002 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:28.002 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:28.002 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:28.002 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:28.003 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:28.003 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:28.003 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:28.003 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:28.003 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:28.003 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:28.003 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:28.003 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:28.004 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:28.004 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:28.004 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:28.004 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:28.004 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:28.004 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.004 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:28.004 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:28.005 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:28.005 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:28.005 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:28.005 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:28.005 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:28.005 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:28.005 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:28.005 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:28.006 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:28.006 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:28.006 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:28.006 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.006 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:28.006 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:28.006 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:28.006 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:28.006 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:28.007 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:28.007 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:28.007 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:28.007 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:28.007 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:28.007 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:28.007 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:28.007 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:28.008 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:28.008 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:28.008 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.008 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:28.008 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "volumes", 2024-08-31T05:44:28.008 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:28.008 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:28.008 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:28.009 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:28.009 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:28.009 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:28.009 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:28.009 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:28.009 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:28.009 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:28.009 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:28.009 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:28.010 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:28.010 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:28.010 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:28.010 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:28.010 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:28.010 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:28.010 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:28.010 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:28.011 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:28.011 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:28.011 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:28.011 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.011 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:28.011 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:28.011 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:28.011 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:28.012 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:28.012 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:28.012 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:28.012 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:28.012 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:28.012 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:28.013 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:28.013 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:28.013 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:28.013 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.013 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:28.013 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:28.013 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:28.013 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:28.014 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:28.014 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:28.014 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:28.014 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:28.014 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:28.014 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:28.015 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:28.015 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:28.015 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:28.015 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:28.015 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:28.015 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:28.015 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:28.015 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:28.015 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:28.016 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:28.016 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.016 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:28.016 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:28.016 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:28.016 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:28.016 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:28.016 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:28.017 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:28.017 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:28.017 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:28.017 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:28.017 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:28.017 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:28.017 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:28.017 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.018 INFO:teuthology.orchestra.run.smithi005.stdout: "max_concurrent_clones": { 2024-08-31T05:44:28.018 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_concurrent_clones", 2024-08-31T05:44:28.018 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:28.018 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:28.018 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:28.018 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "4", 2024-08-31T05:44:28.019 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:28.019 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:28.019 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:28.019 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Number of asynchronous cloner threads", 2024-08-31T05:44:28.019 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:28.019 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:28.019 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:28.019 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.020 INFO:teuthology.orchestra.run.smithi005.stdout: "periodic_async_work": { 2024-08-31T05:44:28.020 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "periodic_async_work", 2024-08-31T05:44:28.020 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:28.020 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:28.020 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:28.020 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:28.020 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:28.020 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:28.021 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:28.021 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Periodically check for async work", 2024-08-31T05:44:28.021 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:28.021 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:28.021 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:28.021 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.021 INFO:teuthology.orchestra.run.smithi005.stdout: "snapshot_clone_delay": { 2024-08-31T05:44:28.021 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "snapshot_clone_delay", 2024-08-31T05:44:28.022 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:28.022 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:28.022 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:28.022 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:28.022 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:28.022 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:28.022 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:28.022 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-08-31T05:44:28.023 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:28.023 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:28.023 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:28.023 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.023 INFO:teuthology.orchestra.run.smithi005.stdout: "snapshot_clone_no_wait": { 2024-08-31T05:44:28.023 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "snapshot_clone_no_wait", 2024-08-31T05:44:28.023 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:28.023 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:28.023 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:28.024 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-08-31T05:44:28.024 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:28.024 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:28.024 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:28.024 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-08-31T05:44:28.024 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:28.024 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:28.024 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:28.025 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.025 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:28.025 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:28.025 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:28.025 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:28.025 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:28.025 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:28.025 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:28.026 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:28.026 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:28.026 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:28.026 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:28.026 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:28.026 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:28.026 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:28.026 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:28.026 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.027 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:28.027 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix", 2024-08-31T05:44:28.027 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-08-31T05:44:28.027 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-08-31T05:44:28.027 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-08-31T05:44:28.027 INFO:teuthology.orchestra.run.smithi005.stdout: "discovery_interval": { 2024-08-31T05:44:28.027 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "discovery_interval", 2024-08-31T05:44:28.027 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2024-08-31T05:44:28.028 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:28.028 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:28.028 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "100", 2024-08-31T05:44:28.028 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:28.028 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:28.028 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:28.028 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:28.028 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:28.029 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:28.029 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:28.029 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.029 INFO:teuthology.orchestra.run.smithi005.stdout: "identifier": { 2024-08-31T05:44:28.029 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "identifier", 2024-08-31T05:44:28.029 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:28.029 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:28.029 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:28.029 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:28.030 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:28.030 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:28.030 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:28.030 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:28.030 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:28.030 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:28.030 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:28.030 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.031 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2024-08-31T05:44:28.031 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2024-08-31T05:44:28.031 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-08-31T05:44:28.031 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:28.031 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:28.031 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2024-08-31T05:44:28.031 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:28.031 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:28.032 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:28.032 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:28.032 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:28.032 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:28.032 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:28.032 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.032 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-08-31T05:44:28.032 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-08-31T05:44:28.032 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:28.033 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:28.033 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:28.033 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:28.033 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:28.033 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:28.033 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:28.033 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:28.033 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:28.034 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:28.034 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:28.034 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:28.034 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:28.034 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:28.034 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:28.034 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:28.034 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:28.035 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:28.035 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.035 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-08-31T05:44:28.035 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-08-31T05:44:28.035 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:28.035 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:28.035 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:28.035 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:28.035 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:28.036 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:28.036 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:28.036 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:28.036 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:28.036 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:28.036 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:28.036 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.036 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-08-31T05:44:28.037 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-08-31T05:44:28.037 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:28.037 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:28.037 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:28.037 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-08-31T05:44:28.037 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:28.037 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:28.037 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-08-31T05:44:28.038 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-08-31T05:44:28.038 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-08-31T05:44:28.038 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-08-31T05:44:28.038 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-08-31T05:44:28.038 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-08-31T05:44:28.038 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-08-31T05:44:28.038 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:28.038 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:28.038 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:28.039 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:28.039 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:28.039 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.039 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-08-31T05:44:28.039 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-08-31T05:44:28.039 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-08-31T05:44:28.039 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:28.039 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:28.040 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-08-31T05:44:28.040 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:28.040 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:28.040 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:28.040 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:28.040 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:28.040 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:28.040 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:28.041 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.041 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-08-31T05:44:28.041 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-08-31T05:44:28.041 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:28.041 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-08-31T05:44:28.041 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-08-31T05:44:28.041 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-08-31T05:44:28.041 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:28.041 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:28.042 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:28.042 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:28.042 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:28.042 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:28.042 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:28.042 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.042 INFO:teuthology.orchestra.run.smithi005.stdout: "zabbix_host": { 2024-08-31T05:44:28.042 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix_host", 2024-08-31T05:44:28.043 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:28.043 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:28.043 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:28.043 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-08-31T05:44:28.043 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:28.043 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:28.043 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:28.043 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:28.043 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:28.044 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:28.044 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:28.044 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.044 INFO:teuthology.orchestra.run.smithi005.stdout: "zabbix_port": { 2024-08-31T05:44:28.044 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix_port", 2024-08-31T05:44:28.044 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-08-31T05:44:28.044 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:28.044 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:28.045 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10051", 2024-08-31T05:44:28.045 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:28.045 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:28.045 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:28.045 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:28.045 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:28.045 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:28.045 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:28.045 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.046 INFO:teuthology.orchestra.run.smithi005.stdout: "zabbix_sender": { 2024-08-31T05:44:28.046 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix_sender", 2024-08-31T05:44:28.046 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-08-31T05:44:28.046 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-08-31T05:44:28.046 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-08-31T05:44:28.046 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-08-31T05:44:28.046 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-08-31T05:44:28.046 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-08-31T05:44:28.047 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-08-31T05:44:28.047 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-08-31T05:44:28.047 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-08-31T05:44:28.047 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-08-31T05:44:28.047 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-08-31T05:44:28.047 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:28.047 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:28.047 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:28.047 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:28.048 INFO:teuthology.orchestra.run.smithi005.stdout: "services": { 2024-08-31T05:44:28.048 INFO:teuthology.orchestra.run.smithi005.stdout: "dashboard": "https://172.21.15.5:8443/" 2024-08-31T05:44:28.048 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.048 INFO:teuthology.orchestra.run.smithi005.stdout: "always_on_modules": { 2024-08-31T05:44:28.048 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus": [ 2024-08-31T05:44:28.048 INFO:teuthology.orchestra.run.smithi005.stdout: "balancer", 2024-08-31T05:44:28.048 INFO:teuthology.orchestra.run.smithi005.stdout: "crash", 2024-08-31T05:44:28.048 INFO:teuthology.orchestra.run.smithi005.stdout: "devicehealth", 2024-08-31T05:44:28.049 INFO:teuthology.orchestra.run.smithi005.stdout: "orchestrator", 2024-08-31T05:44:28.049 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_autoscaler", 2024-08-31T05:44:28.049 INFO:teuthology.orchestra.run.smithi005.stdout: "progress", 2024-08-31T05:44:28.049 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_support", 2024-08-31T05:44:28.049 INFO:teuthology.orchestra.run.smithi005.stdout: "status", 2024-08-31T05:44:28.049 INFO:teuthology.orchestra.run.smithi005.stdout: "telemetry", 2024-08-31T05:44:28.049 INFO:teuthology.orchestra.run.smithi005.stdout: "volumes" 2024-08-31T05:44:28.049 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:28.050 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific": [ 2024-08-31T05:44:28.050 INFO:teuthology.orchestra.run.smithi005.stdout: "balancer", 2024-08-31T05:44:28.050 INFO:teuthology.orchestra.run.smithi005.stdout: "crash", 2024-08-31T05:44:28.050 INFO:teuthology.orchestra.run.smithi005.stdout: "devicehealth", 2024-08-31T05:44:28.050 INFO:teuthology.orchestra.run.smithi005.stdout: "orchestrator", 2024-08-31T05:44:28.050 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_autoscaler", 2024-08-31T05:44:28.050 INFO:teuthology.orchestra.run.smithi005.stdout: "progress", 2024-08-31T05:44:28.050 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_support", 2024-08-31T05:44:28.050 INFO:teuthology.orchestra.run.smithi005.stdout: "status", 2024-08-31T05:44:28.051 INFO:teuthology.orchestra.run.smithi005.stdout: "telemetry", 2024-08-31T05:44:28.051 INFO:teuthology.orchestra.run.smithi005.stdout: "volumes" 2024-08-31T05:44:28.051 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:28.051 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy": [ 2024-08-31T05:44:28.051 INFO:teuthology.orchestra.run.smithi005.stdout: "balancer", 2024-08-31T05:44:28.051 INFO:teuthology.orchestra.run.smithi005.stdout: "crash", 2024-08-31T05:44:28.051 INFO:teuthology.orchestra.run.smithi005.stdout: "devicehealth", 2024-08-31T05:44:28.051 INFO:teuthology.orchestra.run.smithi005.stdout: "orchestrator", 2024-08-31T05:44:28.052 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_autoscaler", 2024-08-31T05:44:28.052 INFO:teuthology.orchestra.run.smithi005.stdout: "progress", 2024-08-31T05:44:28.052 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_support", 2024-08-31T05:44:28.052 INFO:teuthology.orchestra.run.smithi005.stdout: "status", 2024-08-31T05:44:28.052 INFO:teuthology.orchestra.run.smithi005.stdout: "telemetry", 2024-08-31T05:44:28.052 INFO:teuthology.orchestra.run.smithi005.stdout: "volumes" 2024-08-31T05:44:28.052 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:28.052 INFO:teuthology.orchestra.run.smithi005.stdout: "reef": [ 2024-08-31T05:44:28.052 INFO:teuthology.orchestra.run.smithi005.stdout: "balancer", 2024-08-31T05:44:28.053 INFO:teuthology.orchestra.run.smithi005.stdout: "crash", 2024-08-31T05:44:28.053 INFO:teuthology.orchestra.run.smithi005.stdout: "devicehealth", 2024-08-31T05:44:28.053 INFO:teuthology.orchestra.run.smithi005.stdout: "orchestrator", 2024-08-31T05:44:28.053 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_autoscaler", 2024-08-31T05:44:28.053 INFO:teuthology.orchestra.run.smithi005.stdout: "progress", 2024-08-31T05:44:28.053 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_support", 2024-08-31T05:44:28.053 INFO:teuthology.orchestra.run.smithi005.stdout: "status", 2024-08-31T05:44:28.053 INFO:teuthology.orchestra.run.smithi005.stdout: "telemetry", 2024-08-31T05:44:28.054 INFO:teuthology.orchestra.run.smithi005.stdout: "volumes" 2024-08-31T05:44:28.054 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-08-31T05:44:28.054 INFO:teuthology.orchestra.run.smithi005.stdout: "squid": [ 2024-08-31T05:44:28.054 INFO:teuthology.orchestra.run.smithi005.stdout: "balancer", 2024-08-31T05:44:28.054 INFO:teuthology.orchestra.run.smithi005.stdout: "crash", 2024-08-31T05:44:28.054 INFO:teuthology.orchestra.run.smithi005.stdout: "devicehealth", 2024-08-31T05:44:28.054 INFO:teuthology.orchestra.run.smithi005.stdout: "orchestrator", 2024-08-31T05:44:28.054 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_autoscaler", 2024-08-31T05:44:28.054 INFO:teuthology.orchestra.run.smithi005.stdout: "progress", 2024-08-31T05:44:28.055 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_support", 2024-08-31T05:44:28.055 INFO:teuthology.orchestra.run.smithi005.stdout: "status", 2024-08-31T05:44:28.055 INFO:teuthology.orchestra.run.smithi005.stdout: "telemetry", 2024-08-31T05:44:28.055 INFO:teuthology.orchestra.run.smithi005.stdout: "volumes" 2024-08-31T05:44:28.055 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-31T05:44:28.055 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.055 INFO:teuthology.orchestra.run.smithi005.stdout: "last_failure_osd_epoch": 5, 2024-08-31T05:44:28.055 INFO:teuthology.orchestra.run.smithi005.stdout: "active_clients": [ 2024-08-31T05:44:28.056 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:28.056 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "devicehealth", 2024-08-31T05:44:28.056 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-31T05:44:28.056 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:28.056 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-31T05:44:28.056 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:0", 2024-08-31T05:44:28.056 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 202504371 2024-08-31T05:44:28.056 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:28.057 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-31T05:44:28.057 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.057 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:28.057 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "libcephsqlite", 2024-08-31T05:44:28.057 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-31T05:44:28.057 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:28.057 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-31T05:44:28.057 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:0", 2024-08-31T05:44:28.057 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 4008651650 2024-08-31T05:44:28.058 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:28.058 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-31T05:44:28.058 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.058 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:28.058 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_support", 2024-08-31T05:44:28.058 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-31T05:44:28.058 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:28.058 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-31T05:44:28.059 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:0", 2024-08-31T05:44:28.059 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1995541846 2024-08-31T05:44:28.059 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:28.059 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-31T05:44:28.059 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.059 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:28.059 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "snap_schedule", 2024-08-31T05:44:28.059 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-31T05:44:28.060 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:28.060 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-31T05:44:28.060 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:0", 2024-08-31T05:44:28.060 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2967776398 2024-08-31T05:44:28.060 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:28.060 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-31T05:44:28.060 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.060 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:28.060 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "snap_schedule", 2024-08-31T05:44:28.061 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-31T05:44:28.061 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:28.061 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-31T05:44:28.061 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:0", 2024-08-31T05:44:28.061 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 440101317 2024-08-31T05:44:28.061 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:28.061 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-31T05:44:28.061 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.062 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:28.062 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "volumes", 2024-08-31T05:44:28.062 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-08-31T05:44:28.062 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-08-31T05:44:28.062 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-08-31T05:44:28.062 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:0", 2024-08-31T05:44:28.062 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1490833650 2024-08-31T05:44:28.062 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:28.062 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-31T05:44:28.063 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:28.063 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-08-31T05:44:28.063 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:44:28.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.519+0000 7fc52631a640 1 -- 172.21.15.5:0/1798632048 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc5080b4ca0 msgr2=0x7fc5080b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:28.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.519+0000 7fc52631a640 1 --2- 172.21.15.5:0/1798632048 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc5080b4ca0 0x7fc5080b71b0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fc510009b60 tx=0x7fc510005f90 comp rx=0 tx=0).stop 2024-08-31T05:44:28.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.519+0000 7fc52631a640 1 -- 172.21.15.5:0/1798632048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5201068c0 msgr2=0x7fc52019f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:28.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.519+0000 7fc52631a640 1 --2- 172.21.15.5:0/1798632048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5201068c0 0x7fc52019f960 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fc518004af0 tx=0x7fc518003c20 comp rx=0 tx=0).stop 2024-08-31T05:44:28.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.519+0000 7fc52631a640 1 -- 172.21.15.5:0/1798632048 shutdown_connections 2024-08-31T05:44:28.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.519+0000 7fc52631a640 1 --2- 172.21.15.5:0/1798632048 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fc5080b4ca0 0x7fc5080b71b0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:28.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.519+0000 7fc52631a640 1 --2- 172.21.15.5:0/1798632048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5201068c0 0x7fc52019f960 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:28.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.519+0000 7fc52631a640 1 --2- 172.21.15.5:0/1798632048 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fc520105f70 0x7fc52019a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:28.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.519+0000 7fc52631a640 1 --2- 172.21.15.5:0/1798632048 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc52006ba20 0x7fc52019a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:28.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.519+0000 7fc52631a640 1 -- 172.21.15.5:0/1798632048 >> 172.21.15.5:0/1798632048 conn(0x7fc5200784e0 msgr2=0x7fc520069f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:28.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.519+0000 7fc52631a640 1 -- 172.21.15.5:0/1798632048 shutdown_connections 2024-08-31T05:44:28.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:25.519+0000 7fc52631a640 1 -- 172.21.15.5:0/1798632048 wait complete. 2024-08-31T05:44:28.073 DEBUG:tasks.check_counter:Getting stats from a 2024-08-31T05:44:28.074 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph daemon mds.a perf dump 2024-08-31T05:44:28.074 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:44:26 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/2293023022' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-08-31T05:44:28.074 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:44:26 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/1798632048' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-08-31T05:44:28.075 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:44:27 smithi005 ceph-mon[18602]: pgmap v795: 129 pgs: 129 active+clean; 855 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.6 MiB/s wr, 214 op/s 2024-08-31T05:44:28.076 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:44:26 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/2293023022' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-08-31T05:44:28.076 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:44:26 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/1798632048' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-08-31T05:44:28.076 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:44:27 smithi050 ceph-mon[22146]: pgmap v795: 129 pgs: 129 active+clean; 855 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.6 MiB/s wr, 214 op/s 2024-08-31T05:44:28.076 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:44:25 smithi070 ceph-mon[22316]: pgmap v794: 129 pgs: 129 active+clean; 847 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 6.2 MiB/s wr, 329 op/s 2024-08-31T05:44:28.076 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:44:25 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/2803592835' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-31T05:44:28.076 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:44:25 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/3247228446' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-31T05:44:28.077 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:44:25 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/2749653713' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-31T05:44:28.077 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:44:26 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/2293023022' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-08-31T05:44:28.077 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:44:26 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/1798632048' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-08-31T05:44:28.077 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:44:27 smithi070 ceph-mon[22316]: pgmap v795: 129 pgs: 129 active+clean; 855 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.6 MiB/s wr, 214 op/s 2024-08-31T05:44:28.407 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:44:28.937 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:44:28.938 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T05:44:28.938 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 1320, 2024-08-31T05:44:28.938 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 1305, 2024-08-31T05:44:28.938 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 4083341, 2024-08-31T05:44:28.938 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 493874, 2024-08-31T05:44:28.938 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 6, 2024-08-31T05:44:28.938 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 2, 2024-08-31T05:44:28.939 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.165560502, 2024-08-31T05:44:28.939 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.074160291, 2024-08-31T05:44:28.939 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.062982741, 2024-08-31T05:44:28.939 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.030294635, 2024-08-31T05:44:28.939 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T05:44:28.939 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1304, 2024-08-31T05:44:28.939 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.052483677, 2024-08-31T05:44:28.939 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000040248 2024-08-31T05:44:28.939 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.940 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-08-31T05:44:28.940 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:28.940 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:28.940 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:28.940 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.940 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 1236928, 2024-08-31T05:44:28.940 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 173648 2024-08-31T05:44:28.940 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.941 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T05:44:28.941 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 906, 2024-08-31T05:44:28.941 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 1112, 2024-08-31T05:44:28.941 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 8614692, 2024-08-31T05:44:28.941 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 824636, 2024-08-31T05:44:28.941 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 8, 2024-08-31T05:44:28.941 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 5, 2024-08-31T05:44:28.941 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.107819909, 2024-08-31T05:44:28.942 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.046766007, 2024-08-31T05:44:28.942 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.026150471, 2024-08-31T05:44:28.942 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.027031923, 2024-08-31T05:44:28.942 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T05:44:28.942 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 1111, 2024-08-31T05:44:28.942 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.037796748, 2024-08-31T05:44:28.943 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000034020 2024-08-31T05:44:28.943 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.943 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-08-31T05:44:28.943 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:28.943 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:28.943 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:28.943 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.944 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 3360, 2024-08-31T05:44:28.944 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 538368 2024-08-31T05:44:28.944 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.944 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T05:44:28.944 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 982, 2024-08-31T05:44:28.944 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 984, 2024-08-31T05:44:28.944 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 8645261, 2024-08-31T05:44:28.944 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 312277, 2024-08-31T05:44:28.945 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 6, 2024-08-31T05:44:28.945 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 4, 2024-08-31T05:44:28.945 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.089061346, 2024-08-31T05:44:28.945 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.038107913, 2024-08-31T05:44:28.945 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.022986285, 2024-08-31T05:44:28.945 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.021497341, 2024-08-31T05:44:28.946 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T05:44:28.946 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 982, 2024-08-31T05:44:28.946 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.028777256, 2024-08-31T05:44:28.946 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000029304 2024-08-31T05:44:28.946 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.946 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-08-31T05:44:28.946 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:28.946 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:28.947 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:28.947 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.947 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-31T05:44:28.947 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 0 2024-08-31T05:44:28.947 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.947 INFO:teuthology.orchestra.run.smithi005.stdout: "cct": { 2024-08-31T05:44:28.947 INFO:teuthology.orchestra.run.smithi005.stdout: "total_workers": 1, 2024-08-31T05:44:28.948 INFO:teuthology.orchestra.run.smithi005.stdout: "unhealthy_workers": 0 2024-08-31T05:44:28.948 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.948 INFO:teuthology.orchestra.run.smithi005.stdout: "finisher-MDSRank": { 2024-08-31T05:44:28.948 INFO:teuthology.orchestra.run.smithi005.stdout: "queue_len": 0, 2024-08-31T05:44:28.948 INFO:teuthology.orchestra.run.smithi005.stdout: "complete_latency": { 2024-08-31T05:44:28.949 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 4785, 2024-08-31T05:44:28.949 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.124235503, 2024-08-31T05:44:28.949 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000025963 2024-08-31T05:44:28.949 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:28.949 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.949 INFO:teuthology.orchestra.run.smithi005.stdout: "finisher-PurgeQueue": { 2024-08-31T05:44:28.949 INFO:teuthology.orchestra.run.smithi005.stdout: "queue_len": 0, 2024-08-31T05:44:28.950 INFO:teuthology.orchestra.run.smithi005.stdout: "complete_latency": { 2024-08-31T05:44:28.950 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:28.952 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:28.952 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:28.952 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:28.953 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.953 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": { 2024-08-31T05:44:28.953 INFO:teuthology.orchestra.run.smithi005.stdout: "request": 0, 2024-08-31T05:44:28.953 INFO:teuthology.orchestra.run.smithi005.stdout: "reply": 0, 2024-08-31T05:44:28.953 INFO:teuthology.orchestra.run.smithi005.stdout: "reply_latency": { 2024-08-31T05:44:28.953 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:28.953 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:28.953 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:28.954 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.954 INFO:teuthology.orchestra.run.smithi005.stdout: "slow_reply": 0, 2024-08-31T05:44:28.954 INFO:teuthology.orchestra.run.smithi005.stdout: "forward": 0, 2024-08-31T05:44:28.954 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_fetch_complete": 0, 2024-08-31T05:44:28.954 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_fetch_keys": 0, 2024-08-31T05:44:28.954 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_commit": 0, 2024-08-31T05:44:28.954 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_split": 0, 2024-08-31T05:44:28.954 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_merge": 0, 2024-08-31T05:44:28.955 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes": 1973, 2024-08-31T05:44:28.955 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_top": 0, 2024-08-31T05:44:28.955 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_bottom": 1973, 2024-08-31T05:44:28.955 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_pin_tail": 0, 2024-08-31T05:44:28.955 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_pinned": 1973, 2024-08-31T05:44:28.955 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_expired": 0, 2024-08-31T05:44:28.955 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_with_caps": 0, 2024-08-31T05:44:28.955 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": 0, 2024-08-31T05:44:28.956 INFO:teuthology.orchestra.run.smithi005.stdout: "subtrees": 6, 2024-08-31T05:44:28.956 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse": 0, 2024-08-31T05:44:28.956 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_hit": 0, 2024-08-31T05:44:28.956 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_forward": 0, 2024-08-31T05:44:28.956 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_discover": 0, 2024-08-31T05:44:28.956 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_dir_fetch": 0, 2024-08-31T05:44:28.956 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_remote_ino": 0, 2024-08-31T05:44:28.956 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_lock": 0, 2024-08-31T05:44:28.956 INFO:teuthology.orchestra.run.smithi005.stdout: "load_cent": 0, 2024-08-31T05:44:28.957 INFO:teuthology.orchestra.run.smithi005.stdout: "q": 0, 2024-08-31T05:44:28.957 INFO:teuthology.orchestra.run.smithi005.stdout: "exported": 0, 2024-08-31T05:44:28.957 INFO:teuthology.orchestra.run.smithi005.stdout: "exported_inodes": 0, 2024-08-31T05:44:28.957 INFO:teuthology.orchestra.run.smithi005.stdout: "imported": 0, 2024-08-31T05:44:28.957 INFO:teuthology.orchestra.run.smithi005.stdout: "imported_inodes": 0, 2024-08-31T05:44:28.957 INFO:teuthology.orchestra.run.smithi005.stdout: "openino_dir_fetch": 0, 2024-08-31T05:44:28.957 INFO:teuthology.orchestra.run.smithi005.stdout: "openino_backtrace_fetch": 0, 2024-08-31T05:44:28.958 INFO:teuthology.orchestra.run.smithi005.stdout: "openino_peer_discover": 0, 2024-08-31T05:44:28.958 INFO:teuthology.orchestra.run.smithi005.stdout: "root_rfiles": 0, 2024-08-31T05:44:28.958 INFO:teuthology.orchestra.run.smithi005.stdout: "root_rbytes": 0, 2024-08-31T05:44:28.958 INFO:teuthology.orchestra.run.smithi005.stdout: "root_rsnaps": 0, 2024-08-31T05:44:28.958 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_backtrace_fetch": 0, 2024-08-31T05:44:28.958 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_set_tag": 0, 2024-08-31T05:44:28.958 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_backtrace_repaired": 0, 2024-08-31T05:44:28.959 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_inotable_repaired": 0, 2024-08-31T05:44:28.959 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_dir_inodes": 0, 2024-08-31T05:44:28.959 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_dir_base_inodes": 0, 2024-08-31T05:44:28.959 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_dirfrag_rstats": 0, 2024-08-31T05:44:28.959 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_file_inodes": 0, 2024-08-31T05:44:28.959 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_inode_file_caps": 0, 2024-08-31T05:44:28.960 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_revoke": 0, 2024-08-31T05:44:28.960 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_grant": 0, 2024-08-31T05:44:28.960 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_trunc": 0, 2024-08-31T05:44:28.960 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-31T05:44:28.960 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-31T05:44:28.960 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_caps": 0, 2024-08-31T05:44:28.960 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_caps_dirty": 0, 2024-08-31T05:44:28.961 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_cap_release": 0, 2024-08-31T05:44:28.961 INFO:teuthology.orchestra.run.smithi005.stdout: "process_request_cap_release": 0 2024-08-31T05:44:28.961 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.961 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_cache": { 2024-08-31T05:44:28.961 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_update": 0, 2024-08-31T05:44:28.961 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_update_receipt": 0, 2024-08-31T05:44:28.961 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_try_discover": 0, 2024-08-31T05:44:28.961 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_send_discover": 0, 2024-08-31T05:44:28.962 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_handle_discover": 0, 2024-08-31T05:44:28.962 INFO:teuthology.orchestra.run.smithi005.stdout: "num_strays": 0, 2024-08-31T05:44:28.962 INFO:teuthology.orchestra.run.smithi005.stdout: "num_strays_delayed": 0, 2024-08-31T05:44:28.962 INFO:teuthology.orchestra.run.smithi005.stdout: "num_strays_enqueuing": 0, 2024-08-31T05:44:28.962 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_created": 0, 2024-08-31T05:44:28.962 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_enqueued": 0, 2024-08-31T05:44:28.962 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_reintegrated": 0, 2024-08-31T05:44:28.963 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_migrated": 0, 2024-08-31T05:44:28.963 INFO:teuthology.orchestra.run.smithi005.stdout: "num_recovering_processing": 0, 2024-08-31T05:44:28.963 INFO:teuthology.orchestra.run.smithi005.stdout: "num_recovering_enqueued": 0, 2024-08-31T05:44:28.963 INFO:teuthology.orchestra.run.smithi005.stdout: "num_recovering_prioritized": 0, 2024-08-31T05:44:28.963 INFO:teuthology.orchestra.run.smithi005.stdout: "recovery_started": 0, 2024-08-31T05:44:28.963 INFO:teuthology.orchestra.run.smithi005.stdout: "recovery_completed": 0, 2024-08-31T05:44:28.963 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_quiesce_path": 0, 2024-08-31T05:44:28.963 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_quiesce_inode": 0, 2024-08-31T05:44:28.964 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_enqueue_scrub": 0, 2024-08-31T05:44:28.964 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_exportdir": 0, 2024-08-31T05:44:28.964 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_flush": 0, 2024-08-31T05:44:28.964 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_fragmentdir": 0, 2024-08-31T05:44:28.964 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_fragstats": 0, 2024-08-31T05:44:28.964 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_inodestats": 0, 2024-08-31T05:44:28.964 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:44:28.965 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_succeeded": 0, 2024-08-31T05:44:28.965 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_write_failed": 0 2024-08-31T05:44:28.965 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.965 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_log": { 2024-08-31T05:44:28.965 INFO:teuthology.orchestra.run.smithi005.stdout: "evlrg": 0, 2024-08-31T05:44:28.965 INFO:teuthology.orchestra.run.smithi005.stdout: "evadd": 0, 2024-08-31T05:44:28.965 INFO:teuthology.orchestra.run.smithi005.stdout: "evex": 0, 2024-08-31T05:44:28.965 INFO:teuthology.orchestra.run.smithi005.stdout: "evtrm": 0, 2024-08-31T05:44:28.966 INFO:teuthology.orchestra.run.smithi005.stdout: "ev": 8127, 2024-08-31T05:44:28.966 INFO:teuthology.orchestra.run.smithi005.stdout: "evexg": 0, 2024-08-31T05:44:28.966 INFO:teuthology.orchestra.run.smithi005.stdout: "evexd": 0, 2024-08-31T05:44:28.966 INFO:teuthology.orchestra.run.smithi005.stdout: "segadd": 0, 2024-08-31T05:44:28.966 INFO:teuthology.orchestra.run.smithi005.stdout: "segex": 0, 2024-08-31T05:44:28.966 INFO:teuthology.orchestra.run.smithi005.stdout: "segtrm": 0, 2024-08-31T05:44:28.966 INFO:teuthology.orchestra.run.smithi005.stdout: "seg": 10, 2024-08-31T05:44:28.966 INFO:teuthology.orchestra.run.smithi005.stdout: "segmjr": 2, 2024-08-31T05:44:28.967 INFO:teuthology.orchestra.run.smithi005.stdout: "segexg": 0, 2024-08-31T05:44:28.967 INFO:teuthology.orchestra.run.smithi005.stdout: "segexd": 0, 2024-08-31T05:44:28.967 INFO:teuthology.orchestra.run.smithi005.stdout: "expos": 4194304, 2024-08-31T05:44:28.967 INFO:teuthology.orchestra.run.smithi005.stdout: "wrpos": 23482247, 2024-08-31T05:44:28.967 INFO:teuthology.orchestra.run.smithi005.stdout: "rdpos": 23479136, 2024-08-31T05:44:28.967 INFO:teuthology.orchestra.run.smithi005.stdout: "jlat": { 2024-08-31T05:44:28.967 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:28.968 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:28.968 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:28.968 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.968 INFO:teuthology.orchestra.run.smithi005.stdout: "replayed": 8127 2024-08-31T05:44:28.968 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.968 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_mem": { 2024-08-31T05:44:28.968 INFO:teuthology.orchestra.run.smithi005.stdout: "ino": 382, 2024-08-31T05:44:28.969 INFO:teuthology.orchestra.run.smithi005.stdout: "ino+": 1892, 2024-08-31T05:44:28.969 INFO:teuthology.orchestra.run.smithi005.stdout: "ino-": 1510, 2024-08-31T05:44:28.969 INFO:teuthology.orchestra.run.smithi005.stdout: "dir": 33, 2024-08-31T05:44:28.969 INFO:teuthology.orchestra.run.smithi005.stdout: "dir+": 33, 2024-08-31T05:44:28.969 INFO:teuthology.orchestra.run.smithi005.stdout: "dir-": 0, 2024-08-31T05:44:28.969 INFO:teuthology.orchestra.run.smithi005.stdout: "dn": 1973, 2024-08-31T05:44:28.970 INFO:teuthology.orchestra.run.smithi005.stdout: "dn+": 1973, 2024-08-31T05:44:28.970 INFO:teuthology.orchestra.run.smithi005.stdout: "dn-": 0, 2024-08-31T05:44:28.970 INFO:teuthology.orchestra.run.smithi005.stdout: "cap": 0, 2024-08-31T05:44:28.970 INFO:teuthology.orchestra.run.smithi005.stdout: "cap+": 0, 2024-08-31T05:44:28.970 INFO:teuthology.orchestra.run.smithi005.stdout: "cap-": 0, 2024-08-31T05:44:28.970 INFO:teuthology.orchestra.run.smithi005.stdout: "rss": 123540, 2024-08-31T05:44:28.970 INFO:teuthology.orchestra.run.smithi005.stdout: "heap": 323887104 2024-08-31T05:44:28.970 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.971 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_server": { 2024-08-31T05:44:28.971 INFO:teuthology.orchestra.run.smithi005.stdout: "dispatch_client_request": 0, 2024-08-31T05:44:28.971 INFO:teuthology.orchestra.run.smithi005.stdout: "dispatch_server_request": 0, 2024-08-31T05:44:28.971 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_request": 0, 2024-08-31T05:44:28.971 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_session": 0, 2024-08-31T05:44:28.971 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_peer_request": 0, 2024-08-31T05:44:28.971 INFO:teuthology.orchestra.run.smithi005.stdout: "req_create_latency": { 2024-08-31T05:44:28.971 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:28.972 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:28.972 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:28.972 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.972 INFO:teuthology.orchestra.run.smithi005.stdout: "req_getattr_latency": { 2024-08-31T05:44:28.972 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:28.972 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:28.972 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:28.972 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.973 INFO:teuthology.orchestra.run.smithi005.stdout: "req_getfilelock_latency": { 2024-08-31T05:44:28.973 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:28.973 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:28.973 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:28.973 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.973 INFO:teuthology.orchestra.run.smithi005.stdout: "req_link_latency": { 2024-08-31T05:44:28.973 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:28.973 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:28.974 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:28.974 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.974 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookup_latency": { 2024-08-31T05:44:28.974 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:28.974 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:28.974 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:28.974 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.974 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookuphash_latency": { 2024-08-31T05:44:28.975 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:28.975 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:28.975 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:28.975 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.975 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupino_latency": { 2024-08-31T05:44:28.975 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:28.975 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:28.975 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:28.976 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.976 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupname_latency": { 2024-08-31T05:44:28.976 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:28.976 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:28.976 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:28.976 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.976 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupparent_latency": { 2024-08-31T05:44:28.977 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:28.977 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:28.977 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:28.977 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.977 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupsnap_latency": { 2024-08-31T05:44:28.977 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:28.977 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:28.977 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:28.978 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.978 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lssnap_latency": { 2024-08-31T05:44:28.978 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:28.979 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:28.979 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:28.979 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.979 INFO:teuthology.orchestra.run.smithi005.stdout: "req_mkdir_latency": { 2024-08-31T05:44:28.979 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:28.980 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:28.980 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:28.980 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.980 INFO:teuthology.orchestra.run.smithi005.stdout: "req_mknod_latency": { 2024-08-31T05:44:28.980 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:28.980 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:28.980 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:28.980 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.981 INFO:teuthology.orchestra.run.smithi005.stdout: "req_mksnap_latency": { 2024-08-31T05:44:28.981 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:28.981 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:28.981 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:28.981 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.981 INFO:teuthology.orchestra.run.smithi005.stdout: "req_open_latency": { 2024-08-31T05:44:28.981 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:28.981 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:28.982 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:28.982 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.982 INFO:teuthology.orchestra.run.smithi005.stdout: "req_readdir_latency": { 2024-08-31T05:44:28.982 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:28.982 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:28.982 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:28.982 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.982 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rename_latency": { 2024-08-31T05:44:28.983 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:28.983 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:28.983 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:28.983 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.983 INFO:teuthology.orchestra.run.smithi005.stdout: "req_renamesnap_latency": { 2024-08-31T05:44:28.983 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:28.983 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:28.983 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:28.984 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.984 INFO:teuthology.orchestra.run.smithi005.stdout: "req_snapdiff_latency": { 2024-08-31T05:44:28.984 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:28.984 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:28.984 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:28.984 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.984 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rmdir_latency": { 2024-08-31T05:44:28.984 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:28.985 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:28.985 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:28.985 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.985 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rmsnap_latency": { 2024-08-31T05:44:28.985 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:28.985 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:28.985 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:28.985 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.986 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rmxattr_latency": { 2024-08-31T05:44:28.986 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:28.986 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:28.986 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:28.986 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.986 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setattr_latency": { 2024-08-31T05:44:28.986 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:28.986 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:28.987 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:28.987 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.987 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setdirlayout_latency": { 2024-08-31T05:44:28.987 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:28.987 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:28.987 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:28.987 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.987 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setfilelock_latency": { 2024-08-31T05:44:28.987 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:28.988 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:28.988 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:28.988 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.988 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setlayout_latency": { 2024-08-31T05:44:28.988 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:28.988 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:28.988 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:28.988 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.989 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setxattr_latency": { 2024-08-31T05:44:28.989 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:28.989 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:28.989 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:28.989 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.989 INFO:teuthology.orchestra.run.smithi005.stdout: "req_symlink_latency": { 2024-08-31T05:44:28.989 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:28.989 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:28.990 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:28.990 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.990 INFO:teuthology.orchestra.run.smithi005.stdout: "req_unlink_latency": { 2024-08-31T05:44:28.990 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:28.990 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:28.990 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:28.991 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.991 INFO:teuthology.orchestra.run.smithi005.stdout: "cap_revoke_eviction": 0, 2024-08-31T05:44:28.991 INFO:teuthology.orchestra.run.smithi005.stdout: "cap_acquisition_throttle": 0, 2024-08-31T05:44:28.991 INFO:teuthology.orchestra.run.smithi005.stdout: "req_getvxattr_latency": { 2024-08-31T05:44:28.991 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:28.991 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:28.991 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:28.991 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:28.992 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.992 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_sessions": { 2024-08-31T05:44:28.992 INFO:teuthology.orchestra.run.smithi005.stdout: "session_count": 2, 2024-08-31T05:44:28.992 INFO:teuthology.orchestra.run.smithi005.stdout: "session_add": 3, 2024-08-31T05:44:28.992 INFO:teuthology.orchestra.run.smithi005.stdout: "session_remove": 1, 2024-08-31T05:44:28.992 INFO:teuthology.orchestra.run.smithi005.stdout: "sessions_open": 3, 2024-08-31T05:44:28.992 INFO:teuthology.orchestra.run.smithi005.stdout: "sessions_stale": 0, 2024-08-31T05:44:28.992 INFO:teuthology.orchestra.run.smithi005.stdout: "total_load": 0, 2024-08-31T05:44:28.993 INFO:teuthology.orchestra.run.smithi005.stdout: "average_load": 0, 2024-08-31T05:44:28.993 INFO:teuthology.orchestra.run.smithi005.stdout: "avg_session_uptime": 2444, 2024-08-31T05:44:28.993 INFO:teuthology.orchestra.run.smithi005.stdout: "mdthresh_evicted": 0 2024-08-31T05:44:28.993 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:28.993 INFO:teuthology.orchestra.run.smithi005.stdout: "mempool": { 2024-08-31T05:44:28.993 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_bytes": 0, 2024-08-31T05:44:28.993 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_items": 0, 2024-08-31T05:44:28.993 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T05:44:28.994 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_items": 0, 2024-08-31T05:44:28.994 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T05:44:28.994 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_items": 0, 2024-08-31T05:44:28.994 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T05:44:28.994 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T05:44:28.994 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T05:44:28.994 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T05:44:28.994 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T05:44:28.995 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_items": 0, 2024-08-31T05:44:28.995 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T05:44:28.995 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T05:44:28.995 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_bytes": 0, 2024-08-31T05:44:28.995 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_items": 0, 2024-08-31T05:44:28.995 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_bytes": 0, 2024-08-31T05:44:28.995 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_items": 0, 2024-08-31T05:44:28.996 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T05:44:28.996 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T05:44:28.996 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T05:44:28.996 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T05:44:28.996 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T05:44:28.996 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_items": 0, 2024-08-31T05:44:28.996 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_bytes": 0, 2024-08-31T05:44:28.997 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_items": 0, 2024-08-31T05:44:28.997 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T05:44:28.997 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T05:44:28.997 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_bytes": 0, 2024-08-31T05:44:28.997 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_items": 0, 2024-08-31T05:44:28.997 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_bytes": 0, 2024-08-31T05:44:28.997 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_items": 0, 2024-08-31T05:44:28.998 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T05:44:28.998 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_items": 0, 2024-08-31T05:44:28.998 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T05:44:28.998 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_items": 0, 2024-08-31T05:44:28.998 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_bytes": 227630, 2024-08-31T05:44:28.998 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_items": 440, 2024-08-31T05:44:28.998 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_bytes": 0, 2024-08-31T05:44:28.998 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_items": 0, 2024-08-31T05:44:28.999 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_bytes": 0, 2024-08-31T05:44:28.999 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_items": 0, 2024-08-31T05:44:28.999 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_bytes": 0, 2024-08-31T05:44:28.999 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_items": 0, 2024-08-31T05:44:28.999 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_bytes": 0, 2024-08-31T05:44:28.999 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_items": 0, 2024-08-31T05:44:28.999 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_bytes": 9736, 2024-08-31T05:44:28.999 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_items": 197, 2024-08-31T05:44:29.000 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T05:44:29.000 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_items": 0, 2024-08-31T05:44:29.000 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_bytes": 0, 2024-08-31T05:44:29.000 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_items": 0, 2024-08-31T05:44:29.000 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_bytes": 2342711, 2024-08-31T05:44:29.000 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_items": 43443, 2024-08-31T05:44:29.000 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_bytes": 0, 2024-08-31T05:44:29.001 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_items": 0, 2024-08-31T05:44:29.001 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_bytes": 0, 2024-08-31T05:44:29.001 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_items": 0 2024-08-31T05:44:29.001 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:29.001 INFO:teuthology.orchestra.run.smithi005.stdout: "objecter": { 2024-08-31T05:44:29.001 INFO:teuthology.orchestra.run.smithi005.stdout: "op_active": 0, 2024-08-31T05:44:29.002 INFO:teuthology.orchestra.run.smithi005.stdout: "op_laggy": 0, 2024-08-31T05:44:29.002 INFO:teuthology.orchestra.run.smithi005.stdout: "op_send": 2889, 2024-08-31T05:44:29.002 INFO:teuthology.orchestra.run.smithi005.stdout: "op_send_bytes": 21, 2024-08-31T05:44:29.002 INFO:teuthology.orchestra.run.smithi005.stdout: "op_resend": 3, 2024-08-31T05:44:29.002 INFO:teuthology.orchestra.run.smithi005.stdout: "op_reply": 2889, 2024-08-31T05:44:29.002 INFO:teuthology.orchestra.run.smithi005.stdout: "op_latency": { 2024-08-31T05:44:29.003 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 2889, 2024-08-31T05:44:29.003 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 2.006957824, 2024-08-31T05:44:29.003 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000694689 2024-08-31T05:44:29.003 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:29.003 INFO:teuthology.orchestra.run.smithi005.stdout: "op_inflight": 0, 2024-08-31T05:44:29.003 INFO:teuthology.orchestra.run.smithi005.stdout: "oplen_avg": { 2024-08-31T05:44:29.004 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 2889, 2024-08-31T05:44:29.004 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 2890 2024-08-31T05:44:29.004 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:29.004 INFO:teuthology.orchestra.run.smithi005.stdout: "op": 2889, 2024-08-31T05:44:29.004 INFO:teuthology.orchestra.run.smithi005.stdout: "op_r": 2889, 2024-08-31T05:44:29.004 INFO:teuthology.orchestra.run.smithi005.stdout: "op_w": 0, 2024-08-31T05:44:29.004 INFO:teuthology.orchestra.run.smithi005.stdout: "op_rmw": 0, 2024-08-31T05:44:29.005 INFO:teuthology.orchestra.run.smithi005.stdout: "op_pg": 0, 2024-08-31T05:44:29.005 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_stat": 1842, 2024-08-31T05:44:29.005 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_create": 0, 2024-08-31T05:44:29.005 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_read": 1045, 2024-08-31T05:44:29.005 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_write": 0, 2024-08-31T05:44:29.005 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_writefull": 0, 2024-08-31T05:44:29.005 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_writesame": 0, 2024-08-31T05:44:29.005 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_append": 0, 2024-08-31T05:44:29.006 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_zero": 0, 2024-08-31T05:44:29.006 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_truncate": 0, 2024-08-31T05:44:29.006 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_delete": 0, 2024-08-31T05:44:29.006 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_mapext": 0, 2024-08-31T05:44:29.006 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_sparse_read": 0, 2024-08-31T05:44:29.006 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_clonerange": 0, 2024-08-31T05:44:29.006 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_getxattr": 1, 2024-08-31T05:44:29.006 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_setxattr": 0, 2024-08-31T05:44:29.006 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_cmpxattr": 0, 2024-08-31T05:44:29.007 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_rmxattr": 0, 2024-08-31T05:44:29.007 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_resetxattrs": 0, 2024-08-31T05:44:29.007 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_call": 0, 2024-08-31T05:44:29.007 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_watch": 0, 2024-08-31T05:44:29.007 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_notify": 0, 2024-08-31T05:44:29.007 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_src_cmpxattr": 0, 2024-08-31T05:44:29.007 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_pgls": 0, 2024-08-31T05:44:29.008 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_pgls_filter": 0, 2024-08-31T05:44:29.008 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_other": 0, 2024-08-31T05:44:29.008 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_active": 0, 2024-08-31T05:44:29.008 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_send": 0, 2024-08-31T05:44:29.008 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_resend": 0, 2024-08-31T05:44:29.008 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_ping": 0, 2024-08-31T05:44:29.008 INFO:teuthology.orchestra.run.smithi005.stdout: "poolop_active": 0, 2024-08-31T05:44:29.008 INFO:teuthology.orchestra.run.smithi005.stdout: "poolop_send": 0, 2024-08-31T05:44:29.009 INFO:teuthology.orchestra.run.smithi005.stdout: "poolop_resend": 0, 2024-08-31T05:44:29.009 INFO:teuthology.orchestra.run.smithi005.stdout: "poolstat_active": 0, 2024-08-31T05:44:29.009 INFO:teuthology.orchestra.run.smithi005.stdout: "poolstat_send": 0, 2024-08-31T05:44:29.009 INFO:teuthology.orchestra.run.smithi005.stdout: "poolstat_resend": 0, 2024-08-31T05:44:29.009 INFO:teuthology.orchestra.run.smithi005.stdout: "statfs_active": 0, 2024-08-31T05:44:29.009 INFO:teuthology.orchestra.run.smithi005.stdout: "statfs_send": 0, 2024-08-31T05:44:29.010 INFO:teuthology.orchestra.run.smithi005.stdout: "statfs_resend": 0, 2024-08-31T05:44:29.010 INFO:teuthology.orchestra.run.smithi005.stdout: "command_active": 0, 2024-08-31T05:44:29.010 INFO:teuthology.orchestra.run.smithi005.stdout: "command_send": 0, 2024-08-31T05:44:29.010 INFO:teuthology.orchestra.run.smithi005.stdout: "command_resend": 0, 2024-08-31T05:44:29.010 INFO:teuthology.orchestra.run.smithi005.stdout: "map_epoch": 103, 2024-08-31T05:44:29.010 INFO:teuthology.orchestra.run.smithi005.stdout: "map_full": 0, 2024-08-31T05:44:29.011 INFO:teuthology.orchestra.run.smithi005.stdout: "map_inc": 18, 2024-08-31T05:44:29.011 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_sessions": 8, 2024-08-31T05:44:29.011 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_session_open": 10, 2024-08-31T05:44:29.011 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_session_close": 2, 2024-08-31T05:44:29.012 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_laggy": 0, 2024-08-31T05:44:29.012 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_wr": 0, 2024-08-31T05:44:29.012 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_rd": 2, 2024-08-31T05:44:29.012 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_del": 0 2024-08-31T05:44:29.012 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:29.012 INFO:teuthology.orchestra.run.smithi005.stdout: "oft": { 2024-08-31T05:44:29.012 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_objs": 0, 2024-08-31T05:44:29.012 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_kv_pairs": 0, 2024-08-31T05:44:29.013 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_updates": 0, 2024-08-31T05:44:29.013 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_removes": 0 2024-08-31T05:44:29.013 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:29.013 INFO:teuthology.orchestra.run.smithi005.stdout: "purge_queue": { 2024-08-31T05:44:29.013 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing_ops": 0, 2024-08-31T05:44:29.013 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing_ops_high_water": 0, 2024-08-31T05:44:29.013 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing": 0, 2024-08-31T05:44:29.014 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing_high_water": 0, 2024-08-31T05:44:29.014 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executed_ops": 0, 2024-08-31T05:44:29.014 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executed": 0, 2024-08-31T05:44:29.014 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_item_in_journal": 0 2024-08-31T05:44:29.014 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:29.014 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T05:44:29.014 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-08-31T05:44:29.015 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 104857600, 2024-08-31T05:44:29.015 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-08-31T05:44:29.015 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 3204, 2024-08-31T05:44:29.015 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 21035838, 2024-08-31T05:44:29.015 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-08-31T05:44:29.015 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 3204, 2024-08-31T05:44:29.016 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2024-08-31T05:44:29.016 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2024-08-31T05:44:29.016 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 3204, 2024-08-31T05:44:29.016 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 21035838, 2024-08-31T05:44:29.016 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-08-31T05:44:29.016 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:29.016 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:29.017 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:29.017 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:29.017 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:29.017 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-objecter_bytes": { 2024-08-31T05:44:29.017 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-08-31T05:44:29.017 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 104857600, 2024-08-31T05:44:29.017 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-08-31T05:44:29.017 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 0, 2024-08-31T05:44:29.018 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 0, 2024-08-31T05:44:29.018 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-08-31T05:44:29.018 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 0, 2024-08-31T05:44:29.018 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 2889, 2024-08-31T05:44:29.018 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 19287948, 2024-08-31T05:44:29.018 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 2889, 2024-08-31T05:44:29.018 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 19287948, 2024-08-31T05:44:29.019 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-08-31T05:44:29.019 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:29.019 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:29.019 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:29.019 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:29.019 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:29.019 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-objecter_ops": { 2024-08-31T05:44:29.019 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-08-31T05:44:29.020 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 1024, 2024-08-31T05:44:29.020 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-08-31T05:44:29.020 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 0, 2024-08-31T05:44:29.020 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 0, 2024-08-31T05:44:29.020 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-08-31T05:44:29.020 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 0, 2024-08-31T05:44:29.020 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 2889, 2024-08-31T05:44:29.020 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 2889, 2024-08-31T05:44:29.021 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 2889, 2024-08-31T05:44:29.021 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 2889, 2024-08-31T05:44:29.021 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-08-31T05:44:29.021 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:29.021 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:29.022 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:29.022 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:29.022 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:29.022 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-write_buf_throttle": { 2024-08-31T05:44:29.022 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-08-31T05:44:29.022 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 3758096384, 2024-08-31T05:44:29.022 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-08-31T05:44:29.022 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 0, 2024-08-31T05:44:29.022 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 0, 2024-08-31T05:44:29.023 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-08-31T05:44:29.023 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 0, 2024-08-31T05:44:29.023 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2024-08-31T05:44:29.023 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2024-08-31T05:44:29.023 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 0, 2024-08-31T05:44:29.023 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 0, 2024-08-31T05:44:29.023 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-08-31T05:44:29.023 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:29.024 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:29.024 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:29.024 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:29.024 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:29.024 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-write_buf_throttle-0x55903bd5e9c0": { 2024-08-31T05:44:29.024 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-08-31T05:44:29.024 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 3758096384, 2024-08-31T05:44:29.024 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-08-31T05:44:29.025 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 0, 2024-08-31T05:44:29.025 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 0, 2024-08-31T05:44:29.025 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-08-31T05:44:29.025 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 0, 2024-08-31T05:44:29.025 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2024-08-31T05:44:29.025 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2024-08-31T05:44:29.025 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 0, 2024-08-31T05:44:29.025 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 0, 2024-08-31T05:44:29.026 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-08-31T05:44:29.026 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:29.026 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:29.026 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:29.026 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:29.026 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:29.026 INFO:teuthology.orchestra.run.smithi005.stdout: "trackedop": { 2024-08-31T05:44:29.026 INFO:teuthology.orchestra.run.smithi005.stdout: "slow_ops_count": 0 2024-08-31T05:44:29.027 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:29.027 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:44:29.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:44:29 smithi050 ceph-mon[22146]: pgmap v796: 129 pgs: 129 active+clean; 856 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 5.5 MiB/s wr, 197 op/s 2024-08-31T05:44:29.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:44:29 smithi005 ceph-mon[18602]: pgmap v796: 129 pgs: 129 active+clean; 856 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 5.5 MiB/s wr, 197 op/s 2024-08-31T05:44:29.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:44:29 smithi070 ceph-mon[22316]: pgmap v796: 129 pgs: 129 active+clean; 856 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 5.5 MiB/s wr, 197 op/s 2024-08-31T05:44:29.791 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-08-31T05:44:29.792 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-08-31T05:44:29.792 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update=0 2024-08-31T05:44:29.792 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update_receipt=0 2024-08-31T05:44:29.792 INFO:tasks.check_counter:Daemon mds.a mds.root_rsnaps=0 2024-08-31T05:44:29.792 INFO:tasks.check_counter:Daemon mds.a mds_server.req_mksnap_latency.avgcount=0 2024-08-31T05:44:29.792 INFO:tasks.check_counter:Daemon mds.a mds_server.req_rmsnap_latency.avgcount=0 2024-08-31T05:44:29.792 DEBUG:tasks.check_counter:Getting stats from d 2024-08-31T05:44:29.793 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph daemon mds.d perf dump 2024-08-31T05:44:30.072 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:44:30.649 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:44:30.649 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T05:44:30.649 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 0, 2024-08-31T05:44:30.649 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 2, 2024-08-31T05:44:30.649 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 0, 2024-08-31T05:44:30.650 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 0, 2024-08-31T05:44:30.650 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 4, 2024-08-31T05:44:30.650 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 0, 2024-08-31T05:44:30.650 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.001288023, 2024-08-31T05:44:30.650 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.000000000, 2024-08-31T05:44:30.650 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.000254796, 2024-08-31T05:44:30.650 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T05:44:30.650 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T05:44:30.650 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:30.651 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:30.651 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:30.651 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:30.651 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-08-31T05:44:30.651 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:30.651 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:30.651 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:30.651 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:30.652 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-31T05:44:30.652 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 0 2024-08-31T05:44:30.652 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:30.652 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T05:44:30.652 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 2, 2024-08-31T05:44:30.652 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 215, 2024-08-31T05:44:30.652 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 320, 2024-08-31T05:44:30.652 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 198160, 2024-08-31T05:44:30.653 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 4, 2024-08-31T05:44:30.653 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 2, 2024-08-31T05:44:30.653 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.018399981, 2024-08-31T05:44:30.653 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.014591325, 2024-08-31T05:44:30.654 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.001790611, 2024-08-31T05:44:30.654 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T05:44:30.654 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T05:44:30.654 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 213, 2024-08-31T05:44:30.654 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.008399448, 2024-08-31T05:44:30.654 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000039434 2024-08-31T05:44:30.654 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:30.654 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-08-31T05:44:30.655 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:30.655 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:30.655 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:30.655 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:30.655 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 320, 2024-08-31T05:44:30.655 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 198160 2024-08-31T05:44:30.655 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:30.655 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T05:44:30.655 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 292, 2024-08-31T05:44:30.656 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 283, 2024-08-31T05:44:30.656 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 1155456, 2024-08-31T05:44:30.656 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 173472, 2024-08-31T05:44:30.656 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 2, 2024-08-31T05:44:30.656 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 1, 2024-08-31T05:44:30.656 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.046849844, 2024-08-31T05:44:30.656 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.020165421, 2024-08-31T05:44:30.656 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.038162022, 2024-08-31T05:44:30.657 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T05:44:30.657 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T05:44:30.657 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 283, 2024-08-31T05:44:30.657 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.015489515, 2024-08-31T05:44:30.657 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000054733 2024-08-31T05:44:30.657 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:30.657 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-08-31T05:44:30.657 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:30.657 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:30.658 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:30.658 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:30.658 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 1155456, 2024-08-31T05:44:30.658 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 173472 2024-08-31T05:44:30.658 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:30.658 INFO:teuthology.orchestra.run.smithi005.stdout: "cct": { 2024-08-31T05:44:30.658 INFO:teuthology.orchestra.run.smithi005.stdout: "total_workers": 0, 2024-08-31T05:44:30.658 INFO:teuthology.orchestra.run.smithi005.stdout: "unhealthy_workers": 0 2024-08-31T05:44:30.659 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:30.659 INFO:teuthology.orchestra.run.smithi005.stdout: "mempool": { 2024-08-31T05:44:30.659 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_bytes": 0, 2024-08-31T05:44:30.659 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_items": 0, 2024-08-31T05:44:30.659 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T05:44:30.659 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_items": 0, 2024-08-31T05:44:30.659 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T05:44:30.659 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_items": 0, 2024-08-31T05:44:30.659 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T05:44:30.660 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T05:44:30.660 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T05:44:30.660 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T05:44:30.660 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T05:44:30.660 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_items": 0, 2024-08-31T05:44:30.660 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T05:44:30.660 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T05:44:30.660 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_bytes": 0, 2024-08-31T05:44:30.660 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_items": 0, 2024-08-31T05:44:30.661 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_bytes": 0, 2024-08-31T05:44:30.661 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_items": 0, 2024-08-31T05:44:30.661 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T05:44:30.661 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T05:44:30.661 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T05:44:30.661 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T05:44:30.661 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T05:44:30.661 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_items": 0, 2024-08-31T05:44:30.662 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_bytes": 0, 2024-08-31T05:44:30.662 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_items": 0, 2024-08-31T05:44:30.662 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T05:44:30.662 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T05:44:30.662 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_bytes": 0, 2024-08-31T05:44:30.662 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_items": 0, 2024-08-31T05:44:30.662 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_bytes": 0, 2024-08-31T05:44:30.662 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_items": 0, 2024-08-31T05:44:30.662 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T05:44:30.663 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_items": 0, 2024-08-31T05:44:30.663 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T05:44:30.663 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_items": 0, 2024-08-31T05:44:30.663 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_bytes": 147954, 2024-08-31T05:44:30.663 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_items": 29, 2024-08-31T05:44:30.663 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_bytes": 0, 2024-08-31T05:44:30.663 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_items": 0, 2024-08-31T05:44:30.664 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_bytes": 0, 2024-08-31T05:44:30.664 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_items": 0, 2024-08-31T05:44:30.664 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_bytes": 0, 2024-08-31T05:44:30.664 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_items": 0, 2024-08-31T05:44:30.664 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_bytes": 0, 2024-08-31T05:44:30.664 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_items": 0, 2024-08-31T05:44:30.664 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_bytes": 0, 2024-08-31T05:44:30.665 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_items": 0, 2024-08-31T05:44:30.665 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T05:44:30.665 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_items": 0, 2024-08-31T05:44:30.665 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_bytes": 0, 2024-08-31T05:44:30.665 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_items": 0, 2024-08-31T05:44:30.665 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_bytes": 928, 2024-08-31T05:44:30.665 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_items": 2, 2024-08-31T05:44:30.665 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_bytes": 0, 2024-08-31T05:44:30.665 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_items": 0, 2024-08-31T05:44:30.666 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_bytes": 0, 2024-08-31T05:44:30.666 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_items": 0 2024-08-31T05:44:30.666 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:30.666 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T05:44:30.666 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-08-31T05:44:30.666 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 104857600, 2024-08-31T05:44:30.666 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-08-31T05:44:30.666 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 290, 2024-08-31T05:44:30.666 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 1111710, 2024-08-31T05:44:30.667 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-08-31T05:44:30.667 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 290, 2024-08-31T05:44:30.667 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2024-08-31T05:44:30.667 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2024-08-31T05:44:30.667 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 290, 2024-08-31T05:44:30.667 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 1111710, 2024-08-31T05:44:30.668 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-08-31T05:44:30.668 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:30.668 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:30.668 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:30.668 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:30.668 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:30.668 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:44:31.408 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:44:31 smithi050 ceph-mon[22146]: pgmap v797: 129 pgs: 129 active+clean; 856 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 664 KiB/s rd, 5.6 MiB/s wr, 200 op/s 2024-08-31T05:44:31.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:44:31 smithi005 ceph-mon[18602]: pgmap v797: 129 pgs: 129 active+clean; 856 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 664 KiB/s rd, 5.6 MiB/s wr, 200 op/s 2024-08-31T05:44:31.540 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-08-31T05:44:31.540 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-08-31T05:44:31.540 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-08-31T05:44:31.540 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-08-31T05:44:31.540 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-08-31T05:44:31.540 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-08-31T05:44:31.540 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-08-31T05:44:31.541 DEBUG:tasks.check_counter:Getting stats from g 2024-08-31T05:44:31.541 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph daemon mds.g perf dump 2024-08-31T05:44:31.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:44:31 smithi070 ceph-mon[22316]: pgmap v797: 129 pgs: 129 active+clean; 856 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 664 KiB/s rd, 5.6 MiB/s wr, 200 op/s 2024-08-31T05:44:31.800 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:44:32.345 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:44:32.346 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T05:44:32.346 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 978, 2024-08-31T05:44:32.346 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 980, 2024-08-31T05:44:32.347 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 328553, 2024-08-31T05:44:32.347 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 311005, 2024-08-31T05:44:32.347 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 6, 2024-08-31T05:44:32.347 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 2, 2024-08-31T05:44:32.348 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.115678233, 2024-08-31T05:44:32.348 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.057378766, 2024-08-31T05:44:32.348 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.022509555, 2024-08-31T05:44:32.348 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.026444294, 2024-08-31T05:44:32.349 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T05:44:32.349 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 978, 2024-08-31T05:44:32.350 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.041662808, 2024-08-31T05:44:32.350 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000042600 2024-08-31T05:44:32.350 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.350 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-08-31T05:44:32.351 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:32.351 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:32.351 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:32.351 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.352 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-31T05:44:32.352 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 0 2024-08-31T05:44:32.352 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.352 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T05:44:32.353 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 1889, 2024-08-31T05:44:32.353 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 2097, 2024-08-31T05:44:32.353 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 484179, 2024-08-31T05:44:32.354 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 1049393, 2024-08-31T05:44:32.354 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 5, 2024-08-31T05:44:32.354 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 4, 2024-08-31T05:44:32.355 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.145136914, 2024-08-31T05:44:32.355 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.065681390, 2024-08-31T05:44:32.355 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.029633705, 2024-08-31T05:44:32.355 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.040696259, 2024-08-31T05:44:32.356 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T05:44:32.356 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 2096, 2024-08-31T05:44:32.356 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.079186518, 2024-08-31T05:44:32.356 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000037779 2024-08-31T05:44:32.357 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.357 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-08-31T05:44:32.357 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:32.358 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:32.358 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:32.358 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.358 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 3200, 2024-08-31T05:44:32.359 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 450224 2024-08-31T05:44:32.359 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.359 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T05:44:32.359 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 318, 2024-08-31T05:44:32.360 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 303, 2024-08-31T05:44:32.360 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 1238820, 2024-08-31T05:44:32.360 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 175909, 2024-08-31T05:44:32.360 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 5, 2024-08-31T05:44:32.361 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 3, 2024-08-31T05:44:32.361 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.049355005, 2024-08-31T05:44:32.361 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.022687751, 2024-08-31T05:44:32.361 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.037438497, 2024-08-31T05:44:32.362 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.000063069, 2024-08-31T05:44:32.362 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T05:44:32.362 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 302, 2024-08-31T05:44:32.363 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.014151523, 2024-08-31T05:44:32.363 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000046859 2024-08-31T05:44:32.363 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.363 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-08-31T05:44:32.364 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:32.364 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:32.364 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:32.364 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.365 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 1237472, 2024-08-31T05:44:32.365 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 174944 2024-08-31T05:44:32.365 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.366 INFO:teuthology.orchestra.run.smithi005.stdout: "cct": { 2024-08-31T05:44:32.366 INFO:teuthology.orchestra.run.smithi005.stdout: "total_workers": 1, 2024-08-31T05:44:32.366 INFO:teuthology.orchestra.run.smithi005.stdout: "unhealthy_workers": 0 2024-08-31T05:44:32.366 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.366 INFO:teuthology.orchestra.run.smithi005.stdout: "finisher-MDSRank": { 2024-08-31T05:44:32.367 INFO:teuthology.orchestra.run.smithi005.stdout: "queue_len": 0, 2024-08-31T05:44:32.367 INFO:teuthology.orchestra.run.smithi005.stdout: "complete_latency": { 2024-08-31T05:44:32.367 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 4797, 2024-08-31T05:44:32.367 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.109608403, 2024-08-31T05:44:32.368 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000022849 2024-08-31T05:44:32.368 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:32.368 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.368 INFO:teuthology.orchestra.run.smithi005.stdout: "finisher-PurgeQueue": { 2024-08-31T05:44:32.369 INFO:teuthology.orchestra.run.smithi005.stdout: "queue_len": 0, 2024-08-31T05:44:32.369 INFO:teuthology.orchestra.run.smithi005.stdout: "complete_latency": { 2024-08-31T05:44:32.369 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:32.370 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:32.370 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:32.370 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:32.370 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.371 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": { 2024-08-31T05:44:32.371 INFO:teuthology.orchestra.run.smithi005.stdout: "request": 0, 2024-08-31T05:44:32.371 INFO:teuthology.orchestra.run.smithi005.stdout: "reply": 0, 2024-08-31T05:44:32.371 INFO:teuthology.orchestra.run.smithi005.stdout: "reply_latency": { 2024-08-31T05:44:32.372 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:32.372 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:32.372 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:32.372 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.373 INFO:teuthology.orchestra.run.smithi005.stdout: "slow_reply": 0, 2024-08-31T05:44:32.373 INFO:teuthology.orchestra.run.smithi005.stdout: "forward": 0, 2024-08-31T05:44:32.373 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_fetch_complete": 0, 2024-08-31T05:44:32.373 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_fetch_keys": 0, 2024-08-31T05:44:32.374 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_commit": 0, 2024-08-31T05:44:32.374 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_split": 0, 2024-08-31T05:44:32.374 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_merge": 0, 2024-08-31T05:44:32.374 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes": 0, 2024-08-31T05:44:32.375 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_top": 0, 2024-08-31T05:44:32.375 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_bottom": 0, 2024-08-31T05:44:32.375 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_pin_tail": 0, 2024-08-31T05:44:32.375 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_pinned": 0, 2024-08-31T05:44:32.376 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_expired": 0, 2024-08-31T05:44:32.376 INFO:teuthology.orchestra.run.smithi005.stdout: "inodes_with_caps": 0, 2024-08-31T05:44:32.376 INFO:teuthology.orchestra.run.smithi005.stdout: "caps": 0, 2024-08-31T05:44:32.376 INFO:teuthology.orchestra.run.smithi005.stdout: "subtrees": 1, 2024-08-31T05:44:32.377 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse": 0, 2024-08-31T05:44:32.377 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_hit": 0, 2024-08-31T05:44:32.377 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_forward": 0, 2024-08-31T05:44:32.377 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_discover": 0, 2024-08-31T05:44:32.378 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_dir_fetch": 0, 2024-08-31T05:44:32.378 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_remote_ino": 0, 2024-08-31T05:44:32.378 INFO:teuthology.orchestra.run.smithi005.stdout: "traverse_lock": 0, 2024-08-31T05:44:32.378 INFO:teuthology.orchestra.run.smithi005.stdout: "load_cent": 0, 2024-08-31T05:44:32.379 INFO:teuthology.orchestra.run.smithi005.stdout: "q": 0, 2024-08-31T05:44:32.379 INFO:teuthology.orchestra.run.smithi005.stdout: "exported": 0, 2024-08-31T05:44:32.379 INFO:teuthology.orchestra.run.smithi005.stdout: "exported_inodes": 0, 2024-08-31T05:44:32.379 INFO:teuthology.orchestra.run.smithi005.stdout: "imported": 0, 2024-08-31T05:44:32.380 INFO:teuthology.orchestra.run.smithi005.stdout: "imported_inodes": 0, 2024-08-31T05:44:32.380 INFO:teuthology.orchestra.run.smithi005.stdout: "openino_dir_fetch": 0, 2024-08-31T05:44:32.380 INFO:teuthology.orchestra.run.smithi005.stdout: "openino_backtrace_fetch": 0, 2024-08-31T05:44:32.380 INFO:teuthology.orchestra.run.smithi005.stdout: "openino_peer_discover": 0, 2024-08-31T05:44:32.381 INFO:teuthology.orchestra.run.smithi005.stdout: "root_rfiles": 0, 2024-08-31T05:44:32.381 INFO:teuthology.orchestra.run.smithi005.stdout: "root_rbytes": 0, 2024-08-31T05:44:32.381 INFO:teuthology.orchestra.run.smithi005.stdout: "root_rsnaps": 0, 2024-08-31T05:44:32.382 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_backtrace_fetch": 0, 2024-08-31T05:44:32.382 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_set_tag": 0, 2024-08-31T05:44:32.382 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_backtrace_repaired": 0, 2024-08-31T05:44:32.382 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_inotable_repaired": 0, 2024-08-31T05:44:32.383 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_dir_inodes": 0, 2024-08-31T05:44:32.383 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_dir_base_inodes": 0, 2024-08-31T05:44:32.383 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_dirfrag_rstats": 0, 2024-08-31T05:44:32.383 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_file_inodes": 0, 2024-08-31T05:44:32.384 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_inode_file_caps": 0, 2024-08-31T05:44:32.384 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_revoke": 0, 2024-08-31T05:44:32.384 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_grant": 0, 2024-08-31T05:44:32.384 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_trunc": 0, 2024-08-31T05:44:32.385 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-31T05:44:32.385 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-31T05:44:32.385 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_caps": 0, 2024-08-31T05:44:32.385 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_caps_dirty": 0, 2024-08-31T05:44:32.386 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_cap_release": 0, 2024-08-31T05:44:32.386 INFO:teuthology.orchestra.run.smithi005.stdout: "process_request_cap_release": 0 2024-08-31T05:44:32.386 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.386 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_cache": { 2024-08-31T05:44:32.387 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_update": 0, 2024-08-31T05:44:32.387 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_update_receipt": 0, 2024-08-31T05:44:32.387 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_try_discover": 0, 2024-08-31T05:44:32.387 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_send_discover": 0, 2024-08-31T05:44:32.388 INFO:teuthology.orchestra.run.smithi005.stdout: "dir_handle_discover": 0, 2024-08-31T05:44:32.388 INFO:teuthology.orchestra.run.smithi005.stdout: "num_strays": 0, 2024-08-31T05:44:32.388 INFO:teuthology.orchestra.run.smithi005.stdout: "num_strays_delayed": 0, 2024-08-31T05:44:32.388 INFO:teuthology.orchestra.run.smithi005.stdout: "num_strays_enqueuing": 0, 2024-08-31T05:44:32.389 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_created": 0, 2024-08-31T05:44:32.389 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_enqueued": 0, 2024-08-31T05:44:32.389 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_reintegrated": 0, 2024-08-31T05:44:32.389 INFO:teuthology.orchestra.run.smithi005.stdout: "strays_migrated": 0, 2024-08-31T05:44:32.390 INFO:teuthology.orchestra.run.smithi005.stdout: "num_recovering_processing": 0, 2024-08-31T05:44:32.390 INFO:teuthology.orchestra.run.smithi005.stdout: "num_recovering_enqueued": 0, 2024-08-31T05:44:32.390 INFO:teuthology.orchestra.run.smithi005.stdout: "num_recovering_prioritized": 0, 2024-08-31T05:44:32.390 INFO:teuthology.orchestra.run.smithi005.stdout: "recovery_started": 0, 2024-08-31T05:44:32.391 INFO:teuthology.orchestra.run.smithi005.stdout: "recovery_completed": 0, 2024-08-31T05:44:32.391 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_quiesce_path": 0, 2024-08-31T05:44:32.391 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_quiesce_inode": 0, 2024-08-31T05:44:32.391 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_enqueue_scrub": 0, 2024-08-31T05:44:32.392 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_exportdir": 0, 2024-08-31T05:44:32.392 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_flush": 0, 2024-08-31T05:44:32.392 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_fragmentdir": 0, 2024-08-31T05:44:32.392 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_fragstats": 0, 2024-08-31T05:44:32.393 INFO:teuthology.orchestra.run.smithi005.stdout: "ireq_inodestats": 0, 2024-08-31T05:44:32.393 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-08-31T05:44:32.393 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_succeeded": 0, 2024-08-31T05:44:32.393 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_write_failed": 0 2024-08-31T05:44:32.393 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.394 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_log": { 2024-08-31T05:44:32.394 INFO:teuthology.orchestra.run.smithi005.stdout: "evlrg": 0, 2024-08-31T05:44:32.394 INFO:teuthology.orchestra.run.smithi005.stdout: "evadd": 0, 2024-08-31T05:44:32.394 INFO:teuthology.orchestra.run.smithi005.stdout: "evex": 0, 2024-08-31T05:44:32.394 INFO:teuthology.orchestra.run.smithi005.stdout: "evtrm": 0, 2024-08-31T05:44:32.394 INFO:teuthology.orchestra.run.smithi005.stdout: "ev": 6, 2024-08-31T05:44:32.394 INFO:teuthology.orchestra.run.smithi005.stdout: "evexg": 0, 2024-08-31T05:44:32.394 INFO:teuthology.orchestra.run.smithi005.stdout: "evexd": 0, 2024-08-31T05:44:32.394 INFO:teuthology.orchestra.run.smithi005.stdout: "segadd": 0, 2024-08-31T05:44:32.395 INFO:teuthology.orchestra.run.smithi005.stdout: "segex": 0, 2024-08-31T05:44:32.395 INFO:teuthology.orchestra.run.smithi005.stdout: "segtrm": 0, 2024-08-31T05:44:32.395 INFO:teuthology.orchestra.run.smithi005.stdout: "seg": 2, 2024-08-31T05:44:32.395 INFO:teuthology.orchestra.run.smithi005.stdout: "segmjr": 2, 2024-08-31T05:44:32.395 INFO:teuthology.orchestra.run.smithi005.stdout: "segexg": 0, 2024-08-31T05:44:32.395 INFO:teuthology.orchestra.run.smithi005.stdout: "segexd": 0, 2024-08-31T05:44:32.395 INFO:teuthology.orchestra.run.smithi005.stdout: "expos": 4194304, 2024-08-31T05:44:32.395 INFO:teuthology.orchestra.run.smithi005.stdout: "wrpos": 4196123, 2024-08-31T05:44:32.396 INFO:teuthology.orchestra.run.smithi005.stdout: "rdpos": 4195732, 2024-08-31T05:44:32.396 INFO:teuthology.orchestra.run.smithi005.stdout: "jlat": { 2024-08-31T05:44:32.396 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:32.396 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:32.396 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:32.396 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.396 INFO:teuthology.orchestra.run.smithi005.stdout: "replayed": 6 2024-08-31T05:44:32.396 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.397 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_mem": { 2024-08-31T05:44:32.397 INFO:teuthology.orchestra.run.smithi005.stdout: "ino": 3, 2024-08-31T05:44:32.397 INFO:teuthology.orchestra.run.smithi005.stdout: "ino+": 3, 2024-08-31T05:44:32.397 INFO:teuthology.orchestra.run.smithi005.stdout: "ino-": 0, 2024-08-31T05:44:32.397 INFO:teuthology.orchestra.run.smithi005.stdout: "dir": 1, 2024-08-31T05:44:32.397 INFO:teuthology.orchestra.run.smithi005.stdout: "dir+": 1, 2024-08-31T05:44:32.397 INFO:teuthology.orchestra.run.smithi005.stdout: "dir-": 0, 2024-08-31T05:44:32.397 INFO:teuthology.orchestra.run.smithi005.stdout: "dn": 0, 2024-08-31T05:44:32.398 INFO:teuthology.orchestra.run.smithi005.stdout: "dn+": 0, 2024-08-31T05:44:32.398 INFO:teuthology.orchestra.run.smithi005.stdout: "dn-": 0, 2024-08-31T05:44:32.398 INFO:teuthology.orchestra.run.smithi005.stdout: "cap": 0, 2024-08-31T05:44:32.398 INFO:teuthology.orchestra.run.smithi005.stdout: "cap+": 0, 2024-08-31T05:44:32.398 INFO:teuthology.orchestra.run.smithi005.stdout: "cap-": 0, 2024-08-31T05:44:32.398 INFO:teuthology.orchestra.run.smithi005.stdout: "rss": 116464, 2024-08-31T05:44:32.398 INFO:teuthology.orchestra.run.smithi005.stdout: "heap": 316424192 2024-08-31T05:44:32.398 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.399 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_server": { 2024-08-31T05:44:32.399 INFO:teuthology.orchestra.run.smithi005.stdout: "dispatch_client_request": 0, 2024-08-31T05:44:32.399 INFO:teuthology.orchestra.run.smithi005.stdout: "dispatch_server_request": 0, 2024-08-31T05:44:32.399 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_request": 0, 2024-08-31T05:44:32.399 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_client_session": 0, 2024-08-31T05:44:32.399 INFO:teuthology.orchestra.run.smithi005.stdout: "handle_peer_request": 0, 2024-08-31T05:44:32.399 INFO:teuthology.orchestra.run.smithi005.stdout: "req_create_latency": { 2024-08-31T05:44:32.399 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:32.399 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:32.400 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:32.400 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.400 INFO:teuthology.orchestra.run.smithi005.stdout: "req_getattr_latency": { 2024-08-31T05:44:32.400 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:32.400 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:32.400 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:32.400 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.400 INFO:teuthology.orchestra.run.smithi005.stdout: "req_getfilelock_latency": { 2024-08-31T05:44:32.401 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:32.401 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:32.401 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:32.401 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.401 INFO:teuthology.orchestra.run.smithi005.stdout: "req_link_latency": { 2024-08-31T05:44:32.401 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:32.401 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:32.401 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:32.402 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.402 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookup_latency": { 2024-08-31T05:44:32.402 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:32.402 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:32.402 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:32.402 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.402 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookuphash_latency": { 2024-08-31T05:44:32.402 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:32.402 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:32.403 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:32.403 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.403 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupino_latency": { 2024-08-31T05:44:32.403 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:32.403 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:32.403 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:32.403 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.403 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupname_latency": { 2024-08-31T05:44:32.404 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:32.404 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:32.404 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:32.404 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.404 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupparent_latency": { 2024-08-31T05:44:32.404 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:32.404 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:32.404 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:32.405 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.405 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lookupsnap_latency": { 2024-08-31T05:44:32.405 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:32.405 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:32.405 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:32.405 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.405 INFO:teuthology.orchestra.run.smithi005.stdout: "req_lssnap_latency": { 2024-08-31T05:44:32.405 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:32.406 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:32.406 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:32.406 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.407 INFO:teuthology.orchestra.run.smithi005.stdout: "req_mkdir_latency": { 2024-08-31T05:44:32.407 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:32.407 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:32.407 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:32.407 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.407 INFO:teuthology.orchestra.run.smithi005.stdout: "req_mknod_latency": { 2024-08-31T05:44:32.407 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:32.407 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:32.408 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:32.408 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.408 INFO:teuthology.orchestra.run.smithi005.stdout: "req_mksnap_latency": { 2024-08-31T05:44:32.408 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:32.408 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:32.408 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:32.408 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.409 INFO:teuthology.orchestra.run.smithi005.stdout: "req_open_latency": { 2024-08-31T05:44:32.409 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:32.409 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:32.409 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:32.409 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.409 INFO:teuthology.orchestra.run.smithi005.stdout: "req_readdir_latency": { 2024-08-31T05:44:32.409 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:32.409 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:32.409 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:32.410 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.410 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rename_latency": { 2024-08-31T05:44:32.410 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:32.410 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:32.410 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:32.410 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.410 INFO:teuthology.orchestra.run.smithi005.stdout: "req_renamesnap_latency": { 2024-08-31T05:44:32.410 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:32.411 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:32.411 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:32.411 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.411 INFO:teuthology.orchestra.run.smithi005.stdout: "req_snapdiff_latency": { 2024-08-31T05:44:32.411 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:32.411 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:32.411 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:32.411 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.412 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rmdir_latency": { 2024-08-31T05:44:32.412 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:32.412 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:32.412 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:32.412 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.412 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rmsnap_latency": { 2024-08-31T05:44:32.412 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:32.412 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:32.413 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:32.413 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.413 INFO:teuthology.orchestra.run.smithi005.stdout: "req_rmxattr_latency": { 2024-08-31T05:44:32.413 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:32.413 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:32.413 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:32.413 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.413 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setattr_latency": { 2024-08-31T05:44:32.413 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:32.414 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:32.414 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:32.414 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.414 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setdirlayout_latency": { 2024-08-31T05:44:32.414 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:32.414 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:32.414 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:32.414 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.415 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setfilelock_latency": { 2024-08-31T05:44:32.415 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:32.415 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:32.415 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:32.415 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.415 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setlayout_latency": { 2024-08-31T05:44:32.415 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:32.415 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:32.416 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:32.416 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.416 INFO:teuthology.orchestra.run.smithi005.stdout: "req_setxattr_latency": { 2024-08-31T05:44:32.416 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:32.416 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:32.416 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:32.416 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.416 INFO:teuthology.orchestra.run.smithi005.stdout: "req_symlink_latency": { 2024-08-31T05:44:32.417 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:32.417 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:32.417 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:32.417 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.417 INFO:teuthology.orchestra.run.smithi005.stdout: "req_unlink_latency": { 2024-08-31T05:44:32.417 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:32.417 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:32.417 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:32.418 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.418 INFO:teuthology.orchestra.run.smithi005.stdout: "cap_revoke_eviction": 0, 2024-08-31T05:44:32.418 INFO:teuthology.orchestra.run.smithi005.stdout: "cap_acquisition_throttle": 0, 2024-08-31T05:44:32.418 INFO:teuthology.orchestra.run.smithi005.stdout: "req_getvxattr_latency": { 2024-08-31T05:44:32.418 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:32.418 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:32.418 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:32.418 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:32.418 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.419 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_sessions": { 2024-08-31T05:44:32.419 INFO:teuthology.orchestra.run.smithi005.stdout: "session_count": 2, 2024-08-31T05:44:32.419 INFO:teuthology.orchestra.run.smithi005.stdout: "session_add": 3, 2024-08-31T05:44:32.419 INFO:teuthology.orchestra.run.smithi005.stdout: "session_remove": 1, 2024-08-31T05:44:32.419 INFO:teuthology.orchestra.run.smithi005.stdout: "sessions_open": 2, 2024-08-31T05:44:32.419 INFO:teuthology.orchestra.run.smithi005.stdout: "sessions_stale": 0, 2024-08-31T05:44:32.419 INFO:teuthology.orchestra.run.smithi005.stdout: "total_load": 0, 2024-08-31T05:44:32.419 INFO:teuthology.orchestra.run.smithi005.stdout: "average_load": 0, 2024-08-31T05:44:32.420 INFO:teuthology.orchestra.run.smithi005.stdout: "avg_session_uptime": 1920, 2024-08-31T05:44:32.420 INFO:teuthology.orchestra.run.smithi005.stdout: "mdthresh_evicted": 0 2024-08-31T05:44:32.420 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.420 INFO:teuthology.orchestra.run.smithi005.stdout: "mempool": { 2024-08-31T05:44:32.420 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_bytes": 0, 2024-08-31T05:44:32.420 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_items": 0, 2024-08-31T05:44:32.420 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T05:44:32.420 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_items": 0, 2024-08-31T05:44:32.421 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T05:44:32.421 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_items": 0, 2024-08-31T05:44:32.421 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T05:44:32.421 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T05:44:32.421 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T05:44:32.421 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T05:44:32.421 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T05:44:32.421 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_items": 0, 2024-08-31T05:44:32.422 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T05:44:32.422 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T05:44:32.422 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_bytes": 0, 2024-08-31T05:44:32.422 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_items": 0, 2024-08-31T05:44:32.422 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_bytes": 0, 2024-08-31T05:44:32.422 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_items": 0, 2024-08-31T05:44:32.422 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T05:44:32.422 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T05:44:32.423 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T05:44:32.423 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T05:44:32.423 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T05:44:32.423 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_items": 0, 2024-08-31T05:44:32.423 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_bytes": 0, 2024-08-31T05:44:32.423 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_items": 0, 2024-08-31T05:44:32.423 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T05:44:32.423 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T05:44:32.423 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_bytes": 0, 2024-08-31T05:44:32.424 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_items": 0, 2024-08-31T05:44:32.424 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_bytes": 0, 2024-08-31T05:44:32.424 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_items": 0, 2024-08-31T05:44:32.424 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T05:44:32.424 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_items": 0, 2024-08-31T05:44:32.424 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T05:44:32.424 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_items": 0, 2024-08-31T05:44:32.425 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_bytes": 197520, 2024-08-31T05:44:32.425 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_items": 56, 2024-08-31T05:44:32.425 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_bytes": 0, 2024-08-31T05:44:32.425 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_items": 0, 2024-08-31T05:44:32.425 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_bytes": 0, 2024-08-31T05:44:32.425 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_items": 0, 2024-08-31T05:44:32.425 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_bytes": 0, 2024-08-31T05:44:32.425 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_items": 0, 2024-08-31T05:44:32.426 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_bytes": 0, 2024-08-31T05:44:32.426 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_items": 0, 2024-08-31T05:44:32.426 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_bytes": 9736, 2024-08-31T05:44:32.426 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_items": 197, 2024-08-31T05:44:32.426 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T05:44:32.426 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_items": 0, 2024-08-31T05:44:32.426 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_bytes": 0, 2024-08-31T05:44:32.426 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_items": 0, 2024-08-31T05:44:32.426 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_bytes": 8512, 2024-08-31T05:44:32.427 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_items": 13, 2024-08-31T05:44:32.427 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_bytes": 0, 2024-08-31T05:44:32.427 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_items": 0, 2024-08-31T05:44:32.427 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_bytes": 0, 2024-08-31T05:44:32.427 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_items": 0 2024-08-31T05:44:32.427 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.427 INFO:teuthology.orchestra.run.smithi005.stdout: "objecter": { 2024-08-31T05:44:32.427 INFO:teuthology.orchestra.run.smithi005.stdout: "op_active": 0, 2024-08-31T05:44:32.428 INFO:teuthology.orchestra.run.smithi005.stdout: "op_laggy": 0, 2024-08-31T05:44:32.428 INFO:teuthology.orchestra.run.smithi005.stdout: "op_send": 2865, 2024-08-31T05:44:32.428 INFO:teuthology.orchestra.run.smithi005.stdout: "op_send_bytes": 21, 2024-08-31T05:44:32.428 INFO:teuthology.orchestra.run.smithi005.stdout: "op_resend": 3, 2024-08-31T05:44:32.428 INFO:teuthology.orchestra.run.smithi005.stdout: "op_reply": 2865, 2024-08-31T05:44:32.428 INFO:teuthology.orchestra.run.smithi005.stdout: "op_latency": { 2024-08-31T05:44:32.428 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 2865, 2024-08-31T05:44:32.428 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 2.967937827, 2024-08-31T05:44:32.429 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.001035929 2024-08-31T05:44:32.429 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.429 INFO:teuthology.orchestra.run.smithi005.stdout: "op_inflight": 0, 2024-08-31T05:44:32.429 INFO:teuthology.orchestra.run.smithi005.stdout: "oplen_avg": { 2024-08-31T05:44:32.429 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 2865, 2024-08-31T05:44:32.429 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 2866 2024-08-31T05:44:32.429 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.429 INFO:teuthology.orchestra.run.smithi005.stdout: "op": 2865, 2024-08-31T05:44:32.430 INFO:teuthology.orchestra.run.smithi005.stdout: "op_r": 2865, 2024-08-31T05:44:32.430 INFO:teuthology.orchestra.run.smithi005.stdout: "op_w": 0, 2024-08-31T05:44:32.430 INFO:teuthology.orchestra.run.smithi005.stdout: "op_rmw": 0, 2024-08-31T05:44:32.430 INFO:teuthology.orchestra.run.smithi005.stdout: "op_pg": 0, 2024-08-31T05:44:32.430 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_stat": 1878, 2024-08-31T05:44:32.430 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_create": 0, 2024-08-31T05:44:32.432 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_read": 985, 2024-08-31T05:44:32.432 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_write": 0, 2024-08-31T05:44:32.432 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_writefull": 0, 2024-08-31T05:44:32.432 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_writesame": 0, 2024-08-31T05:44:32.433 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_append": 0, 2024-08-31T05:44:32.433 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_zero": 0, 2024-08-31T05:44:32.433 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_truncate": 0, 2024-08-31T05:44:32.433 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_delete": 0, 2024-08-31T05:44:32.433 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_mapext": 0, 2024-08-31T05:44:32.433 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_sparse_read": 0, 2024-08-31T05:44:32.433 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_clonerange": 0, 2024-08-31T05:44:32.433 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_getxattr": 1, 2024-08-31T05:44:32.434 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_setxattr": 0, 2024-08-31T05:44:32.434 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_cmpxattr": 0, 2024-08-31T05:44:32.434 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_rmxattr": 0, 2024-08-31T05:44:32.434 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_resetxattrs": 0, 2024-08-31T05:44:32.434 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_call": 0, 2024-08-31T05:44:32.434 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_watch": 0, 2024-08-31T05:44:32.434 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_notify": 0, 2024-08-31T05:44:32.434 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_src_cmpxattr": 0, 2024-08-31T05:44:32.434 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_pgls": 0, 2024-08-31T05:44:32.435 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_pgls_filter": 0, 2024-08-31T05:44:32.435 INFO:teuthology.orchestra.run.smithi005.stdout: "osdop_other": 0, 2024-08-31T05:44:32.435 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_active": 0, 2024-08-31T05:44:32.435 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_send": 0, 2024-08-31T05:44:32.435 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_resend": 0, 2024-08-31T05:44:32.435 INFO:teuthology.orchestra.run.smithi005.stdout: "linger_ping": 0, 2024-08-31T05:44:32.435 INFO:teuthology.orchestra.run.smithi005.stdout: "poolop_active": 0, 2024-08-31T05:44:32.436 INFO:teuthology.orchestra.run.smithi005.stdout: "poolop_send": 0, 2024-08-31T05:44:32.436 INFO:teuthology.orchestra.run.smithi005.stdout: "poolop_resend": 0, 2024-08-31T05:44:32.436 INFO:teuthology.orchestra.run.smithi005.stdout: "poolstat_active": 0, 2024-08-31T05:44:32.436 INFO:teuthology.orchestra.run.smithi005.stdout: "poolstat_send": 0, 2024-08-31T05:44:32.436 INFO:teuthology.orchestra.run.smithi005.stdout: "poolstat_resend": 0, 2024-08-31T05:44:32.436 INFO:teuthology.orchestra.run.smithi005.stdout: "statfs_active": 0, 2024-08-31T05:44:32.436 INFO:teuthology.orchestra.run.smithi005.stdout: "statfs_send": 0, 2024-08-31T05:44:32.436 INFO:teuthology.orchestra.run.smithi005.stdout: "statfs_resend": 0, 2024-08-31T05:44:32.437 INFO:teuthology.orchestra.run.smithi005.stdout: "command_active": 0, 2024-08-31T05:44:32.437 INFO:teuthology.orchestra.run.smithi005.stdout: "command_send": 0, 2024-08-31T05:44:32.437 INFO:teuthology.orchestra.run.smithi005.stdout: "command_resend": 0, 2024-08-31T05:44:32.437 INFO:teuthology.orchestra.run.smithi005.stdout: "map_epoch": 103, 2024-08-31T05:44:32.437 INFO:teuthology.orchestra.run.smithi005.stdout: "map_full": 0, 2024-08-31T05:44:32.437 INFO:teuthology.orchestra.run.smithi005.stdout: "map_inc": 18, 2024-08-31T05:44:32.437 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_sessions": 6, 2024-08-31T05:44:32.437 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_session_open": 7, 2024-08-31T05:44:32.437 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_session_close": 1, 2024-08-31T05:44:32.438 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_laggy": 0, 2024-08-31T05:44:32.438 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_wr": 0, 2024-08-31T05:44:32.438 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_rd": 2, 2024-08-31T05:44:32.438 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_del": 0 2024-08-31T05:44:32.438 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.438 INFO:teuthology.orchestra.run.smithi005.stdout: "oft": { 2024-08-31T05:44:32.438 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_objs": 0, 2024-08-31T05:44:32.439 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_kv_pairs": 0, 2024-08-31T05:44:32.439 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_updates": 0, 2024-08-31T05:44:32.439 INFO:teuthology.orchestra.run.smithi005.stdout: "omap_total_removes": 0 2024-08-31T05:44:32.439 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.439 INFO:teuthology.orchestra.run.smithi005.stdout: "purge_queue": { 2024-08-31T05:44:32.439 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing_ops": 0, 2024-08-31T05:44:32.439 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing_ops_high_water": 0, 2024-08-31T05:44:32.439 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing": 0, 2024-08-31T05:44:32.440 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executing_high_water": 0, 2024-08-31T05:44:32.440 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executed_ops": 0, 2024-08-31T05:44:32.440 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_executed": 0, 2024-08-31T05:44:32.440 INFO:teuthology.orchestra.run.smithi005.stdout: "pq_item_in_journal": 0 2024-08-31T05:44:32.440 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.440 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T05:44:32.440 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-08-31T05:44:32.441 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 104857600, 2024-08-31T05:44:32.441 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-08-31T05:44:32.441 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 3181, 2024-08-31T05:44:32.441 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 1746105, 2024-08-31T05:44:32.441 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-08-31T05:44:32.441 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 3181, 2024-08-31T05:44:32.441 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2024-08-31T05:44:32.441 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2024-08-31T05:44:32.442 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 3181, 2024-08-31T05:44:32.442 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 1746105, 2024-08-31T05:44:32.442 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-08-31T05:44:32.442 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:32.442 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:32.442 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:32.442 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:32.442 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.443 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-objecter_bytes": { 2024-08-31T05:44:32.443 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-08-31T05:44:32.443 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 104857600, 2024-08-31T05:44:32.443 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-08-31T05:44:32.443 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 0, 2024-08-31T05:44:32.443 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 0, 2024-08-31T05:44:32.443 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-08-31T05:44:32.443 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 0, 2024-08-31T05:44:32.443 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 2865, 2024-08-31T05:44:32.444 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 1824, 2024-08-31T05:44:32.444 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 2865, 2024-08-31T05:44:32.444 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 1824, 2024-08-31T05:44:32.444 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-08-31T05:44:32.444 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:32.444 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:32.444 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:32.444 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:32.445 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.445 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-objecter_ops": { 2024-08-31T05:44:32.445 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-08-31T05:44:32.445 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 1024, 2024-08-31T05:44:32.445 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-08-31T05:44:32.445 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 0, 2024-08-31T05:44:32.445 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 0, 2024-08-31T05:44:32.445 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-08-31T05:44:32.446 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 0, 2024-08-31T05:44:32.446 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 2865, 2024-08-31T05:44:32.446 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 2865, 2024-08-31T05:44:32.446 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 2865, 2024-08-31T05:44:32.446 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 2865, 2024-08-31T05:44:32.446 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-08-31T05:44:32.446 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:32.446 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:32.446 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:32.447 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:32.447 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.447 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-write_buf_throttle": { 2024-08-31T05:44:32.447 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-08-31T05:44:32.447 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 3758096384, 2024-08-31T05:44:32.447 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-08-31T05:44:32.447 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 0, 2024-08-31T05:44:32.447 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 0, 2024-08-31T05:44:32.448 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-08-31T05:44:32.448 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 0, 2024-08-31T05:44:32.448 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2024-08-31T05:44:32.448 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2024-08-31T05:44:32.448 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 0, 2024-08-31T05:44:32.448 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 0, 2024-08-31T05:44:32.448 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-08-31T05:44:32.448 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:32.449 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:32.449 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:32.449 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:32.449 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.449 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-write_buf_throttle-0x562c0af0ac30": { 2024-08-31T05:44:32.449 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-08-31T05:44:32.449 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 3758096384, 2024-08-31T05:44:32.449 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-08-31T05:44:32.450 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 0, 2024-08-31T05:44:32.450 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 0, 2024-08-31T05:44:32.450 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-08-31T05:44:32.450 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 0, 2024-08-31T05:44:32.450 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2024-08-31T05:44:32.450 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2024-08-31T05:44:32.450 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 0, 2024-08-31T05:44:32.450 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 0, 2024-08-31T05:44:32.450 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-08-31T05:44:32.451 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:32.451 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:32.451 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:32.451 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:32.451 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:32.451 INFO:teuthology.orchestra.run.smithi005.stdout: "trackedop": { 2024-08-31T05:44:32.451 INFO:teuthology.orchestra.run.smithi005.stdout: "slow_ops_count": 0 2024-08-31T05:44:32.451 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:32.452 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:44:33.124 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-08-31T05:44:33.125 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-08-31T05:44:33.125 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update=0 2024-08-31T05:44:33.125 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update_receipt=0 2024-08-31T05:44:33.125 INFO:tasks.check_counter:Daemon mds.g mds.root_rsnaps=0 2024-08-31T05:44:33.125 INFO:tasks.check_counter:Daemon mds.g mds_server.req_mksnap_latency.avgcount=0 2024-08-31T05:44:33.125 INFO:tasks.check_counter:Daemon mds.g mds_server.req_rmsnap_latency.avgcount=0 2024-08-31T05:44:33.125 DEBUG:tasks.check_counter:Getting stats from j 2024-08-31T05:44:33.126 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph daemon mds.j perf dump 2024-08-31T05:44:33.382 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:44:33.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:44:33 smithi050 ceph-mon[22146]: pgmap v798: 129 pgs: 129 active+clean; 858 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 609 KiB/s rd, 4.4 MiB/s wr, 155 op/s 2024-08-31T05:44:33.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:44:33 smithi005 ceph-mon[18602]: pgmap v798: 129 pgs: 129 active+clean; 858 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 609 KiB/s rd, 4.4 MiB/s wr, 155 op/s 2024-08-31T05:44:33.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:44:33 smithi070 ceph-mon[22316]: pgmap v798: 129 pgs: 129 active+clean; 858 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 609 KiB/s rd, 4.4 MiB/s wr, 155 op/s 2024-08-31T05:44:33.919 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-08-31T05:44:33.920 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T05:44:33.920 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 4, 2024-08-31T05:44:33.920 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 4, 2024-08-31T05:44:33.920 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 3040, 2024-08-31T05:44:33.920 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 448, 2024-08-31T05:44:33.921 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 4, 2024-08-31T05:44:33.921 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 0, 2024-08-31T05:44:33.921 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.003112641, 2024-08-31T05:44:33.921 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.000047454, 2024-08-31T05:44:33.921 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.002243693, 2024-08-31T05:44:33.921 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T05:44:33.921 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T05:44:33.921 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 3, 2024-08-31T05:44:33.922 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.003897049, 2024-08-31T05:44:33.922 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.001299016 2024-08-31T05:44:33.922 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:33.922 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-08-31T05:44:33.922 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:33.922 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:33.923 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:33.923 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:33.923 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 3040, 2024-08-31T05:44:33.923 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 448 2024-08-31T05:44:33.923 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:33.923 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T05:44:33.923 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 2, 2024-08-31T05:44:33.923 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 216, 2024-08-31T05:44:33.924 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 320, 2024-08-31T05:44:33.924 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 198336, 2024-08-31T05:44:33.924 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 4, 2024-08-31T05:44:33.924 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 2, 2024-08-31T05:44:33.924 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.019094979, 2024-08-31T05:44:33.925 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.015444758, 2024-08-31T05:44:33.925 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.001701118, 2024-08-31T05:44:33.925 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T05:44:33.925 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T05:44:33.925 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 214, 2024-08-31T05:44:33.925 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.009439658, 2024-08-31T05:44:33.925 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000044110 2024-08-31T05:44:33.926 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:33.926 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-08-31T05:44:33.926 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:33.926 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:33.926 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:33.926 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:33.927 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 320, 2024-08-31T05:44:33.927 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 198336 2024-08-31T05:44:33.927 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:33.927 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T05:44:33.927 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 290, 2024-08-31T05:44:33.927 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 283, 2024-08-31T05:44:33.928 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 1152960, 2024-08-31T05:44:33.928 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 174304, 2024-08-31T05:44:33.928 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 2, 2024-08-31T05:44:33.928 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 1, 2024-08-31T05:44:33.928 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.049151585, 2024-08-31T05:44:33.928 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.021222610, 2024-08-31T05:44:33.928 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.039124197, 2024-08-31T05:44:33.929 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T05:44:33.929 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T05:44:33.929 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 282, 2024-08-31T05:44:33.929 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.017647041, 2024-08-31T05:44:33.929 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000062578 2024-08-31T05:44:33.930 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:33.930 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-08-31T05:44:33.930 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:33.930 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:33.930 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:33.930 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:33.931 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 1152960, 2024-08-31T05:44:33.931 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 174304 2024-08-31T05:44:33.931 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:33.931 INFO:teuthology.orchestra.run.smithi005.stdout: "cct": { 2024-08-31T05:44:33.931 INFO:teuthology.orchestra.run.smithi005.stdout: "total_workers": 0, 2024-08-31T05:44:33.932 INFO:teuthology.orchestra.run.smithi005.stdout: "unhealthy_workers": 0 2024-08-31T05:44:33.932 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:33.932 INFO:teuthology.orchestra.run.smithi005.stdout: "mempool": { 2024-08-31T05:44:33.932 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_bytes": 0, 2024-08-31T05:44:33.933 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_items": 0, 2024-08-31T05:44:33.933 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T05:44:33.933 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_items": 0, 2024-08-31T05:44:33.933 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T05:44:33.933 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_items": 0, 2024-08-31T05:44:33.933 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T05:44:33.933 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T05:44:33.933 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T05:44:33.934 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T05:44:33.934 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T05:44:33.934 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_items": 0, 2024-08-31T05:44:33.934 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T05:44:33.934 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T05:44:33.934 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_bytes": 0, 2024-08-31T05:44:33.934 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_items": 0, 2024-08-31T05:44:33.934 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_bytes": 0, 2024-08-31T05:44:33.935 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_items": 0, 2024-08-31T05:44:33.935 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T05:44:33.935 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T05:44:33.935 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T05:44:33.935 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T05:44:33.935 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T05:44:33.935 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_items": 0, 2024-08-31T05:44:33.935 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_bytes": 0, 2024-08-31T05:44:33.935 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_items": 0, 2024-08-31T05:44:33.936 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T05:44:33.936 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T05:44:33.936 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_bytes": 0, 2024-08-31T05:44:33.936 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_items": 0, 2024-08-31T05:44:33.936 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_bytes": 0, 2024-08-31T05:44:33.937 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_items": 0, 2024-08-31T05:44:33.937 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T05:44:33.937 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_items": 0, 2024-08-31T05:44:33.937 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T05:44:33.937 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_items": 0, 2024-08-31T05:44:33.937 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_bytes": 147937, 2024-08-31T05:44:33.938 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_items": 28, 2024-08-31T05:44:33.938 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_bytes": 0, 2024-08-31T05:44:33.938 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_items": 0, 2024-08-31T05:44:33.938 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_bytes": 0, 2024-08-31T05:44:33.938 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_items": 0, 2024-08-31T05:44:33.939 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_bytes": 0, 2024-08-31T05:44:33.939 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_items": 0, 2024-08-31T05:44:33.939 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_bytes": 0, 2024-08-31T05:44:33.939 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_items": 0, 2024-08-31T05:44:33.939 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_bytes": 0, 2024-08-31T05:44:33.939 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_items": 0, 2024-08-31T05:44:33.939 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T05:44:33.939 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_items": 0, 2024-08-31T05:44:33.940 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_bytes": 0, 2024-08-31T05:44:33.940 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_items": 0, 2024-08-31T05:44:33.940 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_bytes": 928, 2024-08-31T05:44:33.940 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_items": 2, 2024-08-31T05:44:33.940 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_bytes": 0, 2024-08-31T05:44:33.940 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_items": 0, 2024-08-31T05:44:33.941 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_bytes": 0, 2024-08-31T05:44:33.941 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_items": 0 2024-08-31T05:44:33.941 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-08-31T05:44:33.941 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T05:44:33.941 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-08-31T05:44:33.941 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 104857600, 2024-08-31T05:44:33.941 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-08-31T05:44:33.941 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 292, 2024-08-31T05:44:33.942 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 1111970, 2024-08-31T05:44:33.942 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-08-31T05:44:33.942 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 292, 2024-08-31T05:44:33.942 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2024-08-31T05:44:33.942 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2024-08-31T05:44:33.942 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 292, 2024-08-31T05:44:33.943 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 1111970, 2024-08-31T05:44:33.943 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-08-31T05:44:33.943 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-08-31T05:44:33.943 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-08-31T05:44:33.943 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-08-31T05:44:33.943 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:33.943 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-08-31T05:44:33.943 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-08-31T05:44:34.693 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-08-31T05:44:34.693 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-08-31T05:44:34.693 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-08-31T05:44:34.693 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-08-31T05:44:34.693 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-08-31T05:44:34.693 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-08-31T05:44:34.693 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-08-31T05:44:34.694 DEBUG:tasks.check_counter:Getting stats from b 2024-08-31T05:44:34.694 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph daemon mds.b perf dump 2024-08-31T05:44:34.960 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T05:44:35.366 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:44:35 smithi050 ceph-mon[22146]: pgmap v799: 129 pgs: 129 active+clean; 856 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 611 KiB/s rd, 4.4 MiB/s wr, 158 op/s 2024-08-31T05:44:35.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:44:35 smithi005 ceph-mon[18602]: pgmap v799: 129 pgs: 129 active+clean; 856 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 611 KiB/s rd, 4.4 MiB/s wr, 158 op/s 2024-08-31T05:44:35.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:44:35 smithi070 ceph-mon[22316]: pgmap v799: 129 pgs: 129 active+clean; 856 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 611 KiB/s rd, 4.4 MiB/s wr, 158 op/s 2024-08-31T05:44:35.641 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-08-31T05:44:35.641 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T05:44:35.641 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 289611, 2024-08-31T05:44:35.641 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 145100, 2024-08-31T05:44:35.641 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 125469250, 2024-08-31T05:44:35.641 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 23328123, 2024-08-31T05:44:35.642 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 14, 2024-08-31T05:44:35.642 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 7, 2024-08-31T05:44:35.642 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 14.489643832, 2024-08-31T05:44:35.642 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 6.245160245, 2024-08-31T05:44:35.642 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 11.380419367, 2024-08-31T05:44:35.642 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.003988746, 2024-08-31T05:44:35.642 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T05:44:35.642 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 145098, 2024-08-31T05:44:35.643 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 2.187682420, 2024-08-31T05:44:35.643 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000015077 2024-08-31T05:44:35.643 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.643 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-08-31T05:44:35.643 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 433879, 2024-08-31T05:44:35.643 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.065862791, 2024-08-31T05:44:35.643 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000151 2024-08-31T05:44:35.643 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.644 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-31T05:44:35.644 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 0 2024-08-31T05:44:35.644 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.644 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T05:44:35.644 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 36511, 2024-08-31T05:44:35.644 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 34002, 2024-08-31T05:44:35.644 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 10136786, 2024-08-31T05:44:35.644 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 5478475, 2024-08-31T05:44:35.645 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 46, 2024-08-31T05:44:35.645 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 7, 2024-08-31T05:44:35.645 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 2.635149499, 2024-08-31T05:44:35.645 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 1.128748624, 2024-08-31T05:44:35.645 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 2.016172007, 2024-08-31T05:44:35.645 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.009562603, 2024-08-31T05:44:35.645 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T05:44:35.645 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 34000, 2024-08-31T05:44:35.646 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.534967130, 2024-08-31T05:44:35.646 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000015734 2024-08-31T05:44:35.646 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.646 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-08-31T05:44:35.646 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 69659, 2024-08-31T05:44:35.646 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.012441497, 2024-08-31T05:44:35.646 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000178 2024-08-31T05:44:35.647 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.647 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 1744, 2024-08-31T05:44:35.647 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 452784 2024-08-31T05:44:35.647 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.647 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T05:44:35.647 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 7681, 2024-08-31T05:44:35.648 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 4417, 2024-08-31T05:44:35.648 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 3300584, 2024-08-31T05:44:35.648 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 1079794, 2024-08-31T05:44:35.648 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 11, 2024-08-31T05:44:35.648 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 8, 2024-08-31T05:44:35.648 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.470739708, 2024-08-31T05:44:35.648 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.203908856, 2024-08-31T05:44:35.648 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.350285272, 2024-08-31T05:44:35.648 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.005590800, 2024-08-31T05:44:35.649 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T05:44:35.649 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 4417, 2024-08-31T05:44:35.649 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.118781920, 2024-08-31T05:44:35.649 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000026891 2024-08-31T05:44:35.649 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.649 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-08-31T05:44:35.649 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 11324, 2024-08-31T05:44:35.650 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.001988571, 2024-08-31T05:44:35.650 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000175 2024-08-31T05:44:35.650 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.650 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 1268016, 2024-08-31T05:44:35.650 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 179728 2024-08-31T05:44:35.650 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.650 INFO:teuthology.orchestra.run.smithi050.stdout: "cct": { 2024-08-31T05:44:35.650 INFO:teuthology.orchestra.run.smithi050.stdout: "total_workers": 1, 2024-08-31T05:44:35.650 INFO:teuthology.orchestra.run.smithi050.stdout: "unhealthy_workers": 0 2024-08-31T05:44:35.651 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.651 INFO:teuthology.orchestra.run.smithi050.stdout: "finisher-MDSRank": { 2024-08-31T05:44:35.651 INFO:teuthology.orchestra.run.smithi050.stdout: "queue_len": 0, 2024-08-31T05:44:35.651 INFO:teuthology.orchestra.run.smithi050.stdout: "complete_latency": { 2024-08-31T05:44:35.651 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 447, 2024-08-31T05:44:35.651 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.136193768, 2024-08-31T05:44:35.651 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000304684 2024-08-31T05:44:35.651 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T05:44:35.652 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.652 INFO:teuthology.orchestra.run.smithi050.stdout: "finisher-PurgeQueue": { 2024-08-31T05:44:35.652 INFO:teuthology.orchestra.run.smithi050.stdout: "queue_len": 0, 2024-08-31T05:44:35.652 INFO:teuthology.orchestra.run.smithi050.stdout: "complete_latency": { 2024-08-31T05:44:35.652 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 166, 2024-08-31T05:44:35.652 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.008516762, 2024-08-31T05:44:35.652 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000051305 2024-08-31T05:44:35.652 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T05:44:35.653 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.653 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": { 2024-08-31T05:44:35.653 INFO:teuthology.orchestra.run.smithi050.stdout: "request": 29967, 2024-08-31T05:44:35.653 INFO:teuthology.orchestra.run.smithi050.stdout: "reply": 265, 2024-08-31T05:44:35.653 INFO:teuthology.orchestra.run.smithi050.stdout: "reply_latency": { 2024-08-31T05:44:35.653 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 265, 2024-08-31T05:44:35.653 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 1.689630745, 2024-08-31T05:44:35.653 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.006375965 2024-08-31T05:44:35.654 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.654 INFO:teuthology.orchestra.run.smithi050.stdout: "slow_reply": 0, 2024-08-31T05:44:35.654 INFO:teuthology.orchestra.run.smithi050.stdout: "forward": 29702, 2024-08-31T05:44:35.654 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_fetch_complete": 0, 2024-08-31T05:44:35.654 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_fetch_keys": 0, 2024-08-31T05:44:35.654 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_commit": 11, 2024-08-31T05:44:35.654 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_split": 0, 2024-08-31T05:44:35.654 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_merge": 0, 2024-08-31T05:44:35.654 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes": 155, 2024-08-31T05:44:35.655 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_top": 63, 2024-08-31T05:44:35.655 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_bottom": 92, 2024-08-31T05:44:35.655 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_pin_tail": 0, 2024-08-31T05:44:35.655 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_pinned": 65, 2024-08-31T05:44:35.655 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_expired": 0, 2024-08-31T05:44:35.655 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_with_caps": 11, 2024-08-31T05:44:35.656 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": 11, 2024-08-31T05:44:35.656 INFO:teuthology.orchestra.run.smithi050.stdout: "subtrees": 6, 2024-08-31T05:44:35.656 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse": 30622, 2024-08-31T05:44:35.656 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_hit": 505, 2024-08-31T05:44:35.656 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_forward": 29701, 2024-08-31T05:44:35.656 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_discover": 109, 2024-08-31T05:44:35.656 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_dir_fetch": 0, 2024-08-31T05:44:35.656 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_remote_ino": 0, 2024-08-31T05:44:35.657 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_lock": 15, 2024-08-31T05:44:35.657 INFO:teuthology.orchestra.run.smithi050.stdout: "load_cent": 0, 2024-08-31T05:44:35.657 INFO:teuthology.orchestra.run.smithi050.stdout: "q": 0, 2024-08-31T05:44:35.657 INFO:teuthology.orchestra.run.smithi050.stdout: "exported": 0, 2024-08-31T05:44:35.657 INFO:teuthology.orchestra.run.smithi050.stdout: "exported_inodes": 0, 2024-08-31T05:44:35.657 INFO:teuthology.orchestra.run.smithi050.stdout: "imported": 1, 2024-08-31T05:44:35.657 INFO:teuthology.orchestra.run.smithi050.stdout: "imported_inodes": 12, 2024-08-31T05:44:35.658 INFO:teuthology.orchestra.run.smithi050.stdout: "openino_dir_fetch": 0, 2024-08-31T05:44:35.658 INFO:teuthology.orchestra.run.smithi050.stdout: "openino_backtrace_fetch": 7, 2024-08-31T05:44:35.658 INFO:teuthology.orchestra.run.smithi050.stdout: "openino_peer_discover": 0, 2024-08-31T05:44:35.658 INFO:teuthology.orchestra.run.smithi050.stdout: "root_rfiles": 736, 2024-08-31T05:44:35.658 INFO:teuthology.orchestra.run.smithi050.stdout: "root_rbytes": 205356007, 2024-08-31T05:44:35.658 INFO:teuthology.orchestra.run.smithi050.stdout: "root_rsnaps": 6, 2024-08-31T05:44:35.658 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_backtrace_fetch": 7, 2024-08-31T05:44:35.659 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_set_tag": 0, 2024-08-31T05:44:35.659 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_backtrace_repaired": 0, 2024-08-31T05:44:35.659 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_inotable_repaired": 0, 2024-08-31T05:44:35.659 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_dir_inodes": 0, 2024-08-31T05:44:35.659 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_dir_base_inodes": 0, 2024-08-31T05:44:35.659 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_dirfrag_rstats": 0, 2024-08-31T05:44:35.659 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_file_inodes": 7, 2024-08-31T05:44:35.659 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_inode_file_caps": 0, 2024-08-31T05:44:35.660 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_revoke": 23, 2024-08-31T05:44:35.660 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_grant": 207, 2024-08-31T05:44:35.660 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_trunc": 0, 2024-08-31T05:44:35.660 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-31T05:44:35.660 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-31T05:44:35.660 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_caps": 220, 2024-08-31T05:44:35.661 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_caps_dirty": 129, 2024-08-31T05:44:35.661 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_cap_release": 19, 2024-08-31T05:44:35.661 INFO:teuthology.orchestra.run.smithi050.stdout: "process_request_cap_release": 265 2024-08-31T05:44:35.661 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.661 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_cache": { 2024-08-31T05:44:35.661 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_update": 21, 2024-08-31T05:44:35.661 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_update_receipt": 396, 2024-08-31T05:44:35.662 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_try_discover": 249, 2024-08-31T05:44:35.662 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_send_discover": 309, 2024-08-31T05:44:35.662 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_handle_discover": 21, 2024-08-31T05:44:35.662 INFO:teuthology.orchestra.run.smithi050.stdout: "num_strays": 4, 2024-08-31T05:44:35.662 INFO:teuthology.orchestra.run.smithi050.stdout: "num_strays_delayed": 0, 2024-08-31T05:44:35.662 INFO:teuthology.orchestra.run.smithi050.stdout: "num_strays_enqueuing": 0, 2024-08-31T05:44:35.662 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_created": 48, 2024-08-31T05:44:35.662 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_enqueued": 44, 2024-08-31T05:44:35.663 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_reintegrated": 0, 2024-08-31T05:44:35.663 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_migrated": 0, 2024-08-31T05:44:35.663 INFO:teuthology.orchestra.run.smithi050.stdout: "num_recovering_processing": 0, 2024-08-31T05:44:35.663 INFO:teuthology.orchestra.run.smithi050.stdout: "num_recovering_enqueued": 0, 2024-08-31T05:44:35.663 INFO:teuthology.orchestra.run.smithi050.stdout: "num_recovering_prioritized": 0, 2024-08-31T05:44:35.663 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_started": 0, 2024-08-31T05:44:35.664 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_completed": 0, 2024-08-31T05:44:35.664 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_quiesce_path": 0, 2024-08-31T05:44:35.664 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_quiesce_inode": 0, 2024-08-31T05:44:35.664 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_enqueue_scrub": 0, 2024-08-31T05:44:35.664 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_exportdir": 0, 2024-08-31T05:44:35.664 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_flush": 0, 2024-08-31T05:44:35.664 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_fragmentdir": 0, 2024-08-31T05:44:35.665 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_fragstats": 0, 2024-08-31T05:44:35.665 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_inodestats": 0, 2024-08-31T05:44:35.665 INFO:teuthology.orchestra.run.smithi050.stdout: "uninline_started": 0, 2024-08-31T05:44:35.665 INFO:teuthology.orchestra.run.smithi050.stdout: "uninline_succeeded": 0, 2024-08-31T05:44:35.665 INFO:teuthology.orchestra.run.smithi050.stdout: "uninline_write_failed": 0 2024-08-31T05:44:35.665 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.666 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_log": { 2024-08-31T05:44:35.666 INFO:teuthology.orchestra.run.smithi050.stdout: "evlrg": 0, 2024-08-31T05:44:35.666 INFO:teuthology.orchestra.run.smithi050.stdout: "evadd": 413, 2024-08-31T05:44:35.666 INFO:teuthology.orchestra.run.smithi050.stdout: "evex": 0, 2024-08-31T05:44:35.666 INFO:teuthology.orchestra.run.smithi050.stdout: "evtrm": 0, 2024-08-31T05:44:35.666 INFO:teuthology.orchestra.run.smithi050.stdout: "ev": 413, 2024-08-31T05:44:35.667 INFO:teuthology.orchestra.run.smithi050.stdout: "evexg": 0, 2024-08-31T05:44:35.667 INFO:teuthology.orchestra.run.smithi050.stdout: "evexd": 0, 2024-08-31T05:44:35.667 INFO:teuthology.orchestra.run.smithi050.stdout: "segadd": 2, 2024-08-31T05:44:35.667 INFO:teuthology.orchestra.run.smithi050.stdout: "segex": 0, 2024-08-31T05:44:35.667 INFO:teuthology.orchestra.run.smithi050.stdout: "segtrm": 0, 2024-08-31T05:44:35.667 INFO:teuthology.orchestra.run.smithi050.stdout: "seg": 2, 2024-08-31T05:44:35.668 INFO:teuthology.orchestra.run.smithi050.stdout: "segmjr": 2, 2024-08-31T05:44:35.668 INFO:teuthology.orchestra.run.smithi050.stdout: "segexg": 0, 2024-08-31T05:44:35.668 INFO:teuthology.orchestra.run.smithi050.stdout: "segexd": 0, 2024-08-31T05:44:35.668 INFO:teuthology.orchestra.run.smithi050.stdout: "expos": 4194304, 2024-08-31T05:44:35.668 INFO:teuthology.orchestra.run.smithi050.stdout: "wrpos": 4767208, 2024-08-31T05:44:35.668 INFO:teuthology.orchestra.run.smithi050.stdout: "rdpos": 0, 2024-08-31T05:44:35.668 INFO:teuthology.orchestra.run.smithi050.stdout: "jlat": { 2024-08-31T05:44:35.668 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 193, 2024-08-31T05:44:35.669 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 1.008213768, 2024-08-31T05:44:35.669 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.005223905 2024-08-31T05:44:35.669 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.669 INFO:teuthology.orchestra.run.smithi050.stdout: "replayed": 0 2024-08-31T05:44:35.669 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.669 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_mem": { 2024-08-31T05:44:35.669 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 150, 2024-08-31T05:44:35.669 INFO:teuthology.orchestra.run.smithi050.stdout: "ino+": 190, 2024-08-31T05:44:35.670 INFO:teuthology.orchestra.run.smithi050.stdout: "ino-": 40, 2024-08-31T05:44:35.670 INFO:teuthology.orchestra.run.smithi050.stdout: "dir": 138, 2024-08-31T05:44:35.670 INFO:teuthology.orchestra.run.smithi050.stdout: "dir+": 198, 2024-08-31T05:44:35.670 INFO:teuthology.orchestra.run.smithi050.stdout: "dir-": 60, 2024-08-31T05:44:35.670 INFO:teuthology.orchestra.run.smithi050.stdout: "dn": 155, 2024-08-31T05:44:35.670 INFO:teuthology.orchestra.run.smithi050.stdout: "dn+": 199, 2024-08-31T05:44:35.670 INFO:teuthology.orchestra.run.smithi050.stdout: "dn-": 44, 2024-08-31T05:44:35.670 INFO:teuthology.orchestra.run.smithi050.stdout: "cap": 11, 2024-08-31T05:44:35.670 INFO:teuthology.orchestra.run.smithi050.stdout: "cap+": 62, 2024-08-31T05:44:35.671 INFO:teuthology.orchestra.run.smithi050.stdout: "cap-": 51, 2024-08-31T05:44:35.671 INFO:teuthology.orchestra.run.smithi050.stdout: "rss": 124040, 2024-08-31T05:44:35.671 INFO:teuthology.orchestra.run.smithi050.stdout: "heap": 331231232 2024-08-31T05:44:35.671 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.671 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_server": { 2024-08-31T05:44:35.671 INFO:teuthology.orchestra.run.smithi050.stdout: "dispatch_client_request": 30278, 2024-08-31T05:44:35.671 INFO:teuthology.orchestra.run.smithi050.stdout: "dispatch_server_request": 0, 2024-08-31T05:44:35.671 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_request": 29967, 2024-08-31T05:44:35.672 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_session": 40, 2024-08-31T05:44:35.672 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_peer_request": 73, 2024-08-31T05:44:35.672 INFO:teuthology.orchestra.run.smithi050.stdout: "req_create_latency": { 2024-08-31T05:44:35.672 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 48, 2024-08-31T05:44:35.672 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.928276863, 2024-08-31T05:44:35.672 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.019339101 2024-08-31T05:44:35.672 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.672 INFO:teuthology.orchestra.run.smithi050.stdout: "req_getattr_latency": { 2024-08-31T05:44:35.672 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 5, 2024-08-31T05:44:35.673 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.002885597, 2024-08-31T05:44:35.673 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000577119 2024-08-31T05:44:35.673 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.673 INFO:teuthology.orchestra.run.smithi050.stdout: "req_getfilelock_latency": { 2024-08-31T05:44:35.673 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:35.673 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:35.673 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:35.673 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.674 INFO:teuthology.orchestra.run.smithi050.stdout: "req_link_latency": { 2024-08-31T05:44:35.674 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:35.674 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:35.674 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:35.674 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.674 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookup_latency": { 2024-08-31T05:44:35.674 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 75, 2024-08-31T05:44:35.674 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.119230010, 2024-08-31T05:44:35.674 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.001589733 2024-08-31T05:44:35.675 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.675 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookuphash_latency": { 2024-08-31T05:44:35.675 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:35.675 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:35.675 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:35.675 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.675 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupino_latency": { 2024-08-31T05:44:35.675 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:35.676 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:35.676 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:35.676 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.676 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupname_latency": { 2024-08-31T05:44:35.676 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:35.676 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:35.676 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:35.676 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.676 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupparent_latency": { 2024-08-31T05:44:35.677 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:35.677 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:35.677 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:35.677 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.677 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupsnap_latency": { 2024-08-31T05:44:35.677 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:35.677 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:35.678 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:35.678 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.678 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lssnap_latency": { 2024-08-31T05:44:35.679 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:35.679 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:35.679 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:35.679 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.679 INFO:teuthology.orchestra.run.smithi050.stdout: "req_mkdir_latency": { 2024-08-31T05:44:35.679 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:35.679 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:35.679 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:35.679 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.680 INFO:teuthology.orchestra.run.smithi050.stdout: "req_mknod_latency": { 2024-08-31T05:44:35.680 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:35.680 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:35.680 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:35.680 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.680 INFO:teuthology.orchestra.run.smithi050.stdout: "req_mksnap_latency": { 2024-08-31T05:44:35.680 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:35.680 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:35.681 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:35.681 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.681 INFO:teuthology.orchestra.run.smithi050.stdout: "req_open_latency": { 2024-08-31T05:44:35.681 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:35.681 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:35.681 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:35.681 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.681 INFO:teuthology.orchestra.run.smithi050.stdout: "req_readdir_latency": { 2024-08-31T05:44:35.682 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 71, 2024-08-31T05:44:35.682 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.040185849, 2024-08-31T05:44:35.682 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000565997 2024-08-31T05:44:35.682 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.682 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rename_latency": { 2024-08-31T05:44:35.682 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 16, 2024-08-31T05:44:35.682 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.275200907, 2024-08-31T05:44:35.682 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.017200056 2024-08-31T05:44:35.682 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.683 INFO:teuthology.orchestra.run.smithi050.stdout: "req_renamesnap_latency": { 2024-08-31T05:44:35.683 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:35.683 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:35.683 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:35.683 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.683 INFO:teuthology.orchestra.run.smithi050.stdout: "req_snapdiff_latency": { 2024-08-31T05:44:35.683 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:35.683 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:35.684 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:35.684 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.684 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rmdir_latency": { 2024-08-31T05:44:35.684 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:35.684 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:35.684 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:35.684 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.684 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rmsnap_latency": { 2024-08-31T05:44:35.685 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:35.685 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:35.685 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:35.685 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.685 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rmxattr_latency": { 2024-08-31T05:44:35.685 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:35.685 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:35.685 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:35.686 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.686 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setattr_latency": { 2024-08-31T05:44:35.686 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 2, 2024-08-31T05:44:35.686 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.007843922, 2024-08-31T05:44:35.686 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.003921961 2024-08-31T05:44:35.686 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.686 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setdirlayout_latency": { 2024-08-31T05:44:35.686 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:35.687 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:35.687 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:35.687 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.687 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setfilelock_latency": { 2024-08-31T05:44:35.687 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:35.687 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:35.687 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:35.687 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.687 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setlayout_latency": { 2024-08-31T05:44:35.688 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:35.688 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:35.688 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:35.688 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.688 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setxattr_latency": { 2024-08-31T05:44:35.688 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:35.688 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:35.688 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:35.689 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.689 INFO:teuthology.orchestra.run.smithi050.stdout: "req_symlink_latency": { 2024-08-31T05:44:35.689 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:35.689 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:35.689 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:35.689 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.690 INFO:teuthology.orchestra.run.smithi050.stdout: "req_unlink_latency": { 2024-08-31T05:44:35.690 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 48, 2024-08-31T05:44:35.690 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.316007597, 2024-08-31T05:44:35.690 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.006583491 2024-08-31T05:44:35.690 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.690 INFO:teuthology.orchestra.run.smithi050.stdout: "cap_revoke_eviction": 0, 2024-08-31T05:44:35.690 INFO:teuthology.orchestra.run.smithi050.stdout: "cap_acquisition_throttle": 0, 2024-08-31T05:44:35.690 INFO:teuthology.orchestra.run.smithi050.stdout: "req_getvxattr_latency": { 2024-08-31T05:44:35.690 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:35.691 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:35.691 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:35.691 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T05:44:35.691 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.691 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_sessions": { 2024-08-31T05:44:35.692 INFO:teuthology.orchestra.run.smithi050.stdout: "session_count": 1, 2024-08-31T05:44:35.692 INFO:teuthology.orchestra.run.smithi050.stdout: "session_add": 2, 2024-08-31T05:44:35.692 INFO:teuthology.orchestra.run.smithi050.stdout: "session_remove": 1, 2024-08-31T05:44:35.692 INFO:teuthology.orchestra.run.smithi050.stdout: "sessions_open": 1, 2024-08-31T05:44:35.692 INFO:teuthology.orchestra.run.smithi050.stdout: "sessions_stale": 0, 2024-08-31T05:44:35.692 INFO:teuthology.orchestra.run.smithi050.stdout: "total_load": 208, 2024-08-31T05:44:35.692 INFO:teuthology.orchestra.run.smithi050.stdout: "average_load": 208, 2024-08-31T05:44:35.692 INFO:teuthology.orchestra.run.smithi050.stdout: "avg_session_uptime": 798, 2024-08-31T05:44:35.693 INFO:teuthology.orchestra.run.smithi050.stdout: "mdthresh_evicted": 0 2024-08-31T05:44:35.693 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.693 INFO:teuthology.orchestra.run.smithi050.stdout: "mempool": { 2024-08-31T05:44:35.693 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_bytes": 0, 2024-08-31T05:44:35.693 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_items": 0, 2024-08-31T05:44:35.693 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T05:44:35.693 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_items": 0, 2024-08-31T05:44:35.694 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T05:44:35.694 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_items": 0, 2024-08-31T05:44:35.694 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T05:44:35.694 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T05:44:35.694 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T05:44:35.694 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T05:44:35.694 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T05:44:35.694 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_items": 0, 2024-08-31T05:44:35.695 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T05:44:35.695 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T05:44:35.695 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_bytes": 0, 2024-08-31T05:44:35.695 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_items": 0, 2024-08-31T05:44:35.695 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_bytes": 0, 2024-08-31T05:44:35.695 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_items": 0, 2024-08-31T05:44:35.695 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T05:44:35.695 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T05:44:35.696 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T05:44:35.696 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T05:44:35.696 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T05:44:35.696 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_items": 0, 2024-08-31T05:44:35.696 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_bytes": 0, 2024-08-31T05:44:35.696 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_items": 0, 2024-08-31T05:44:35.696 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T05:44:35.696 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T05:44:35.697 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_bytes": 0, 2024-08-31T05:44:35.697 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_items": 0, 2024-08-31T05:44:35.697 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_bytes": 0, 2024-08-31T05:44:35.697 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_items": 0, 2024-08-31T05:44:35.697 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T05:44:35.697 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_items": 0, 2024-08-31T05:44:35.697 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T05:44:35.697 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_items": 0, 2024-08-31T05:44:35.698 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_bytes": 362193, 2024-08-31T05:44:35.698 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_items": 282, 2024-08-31T05:44:35.698 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_bytes": 528, 2024-08-31T05:44:35.698 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_items": 6, 2024-08-31T05:44:35.698 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_bytes": 0, 2024-08-31T05:44:35.698 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_items": 0, 2024-08-31T05:44:35.698 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_bytes": 0, 2024-08-31T05:44:35.699 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_items": 0, 2024-08-31T05:44:35.699 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_bytes": 0, 2024-08-31T05:44:35.699 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_items": 0, 2024-08-31T05:44:35.699 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_bytes": 9736, 2024-08-31T05:44:35.699 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_items": 197, 2024-08-31T05:44:35.699 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T05:44:35.699 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_items": 0, 2024-08-31T05:44:35.700 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_bytes": 0, 2024-08-31T05:44:35.700 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_items": 0, 2024-08-31T05:44:35.700 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_bytes": 664244, 2024-08-31T05:44:35.700 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_items": 6005, 2024-08-31T05:44:35.700 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_bytes": 0, 2024-08-31T05:44:35.700 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_items": 0, 2024-08-31T05:44:35.701 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_bytes": 0, 2024-08-31T05:44:35.701 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_items": 0 2024-08-31T05:44:35.701 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.701 INFO:teuthology.orchestra.run.smithi050.stdout: "objecter": { 2024-08-31T05:44:35.701 INFO:teuthology.orchestra.run.smithi050.stdout: "op_active": 0, 2024-08-31T05:44:35.702 INFO:teuthology.orchestra.run.smithi050.stdout: "op_laggy": 0, 2024-08-31T05:44:35.702 INFO:teuthology.orchestra.run.smithi050.stdout: "op_send": 412, 2024-08-31T05:44:35.702 INFO:teuthology.orchestra.run.smithi050.stdout: "op_send_bytes": 594789, 2024-08-31T05:44:35.702 INFO:teuthology.orchestra.run.smithi050.stdout: "op_resend": 29, 2024-08-31T05:44:35.702 INFO:teuthology.orchestra.run.smithi050.stdout: "op_reply": 412, 2024-08-31T05:44:35.702 INFO:teuthology.orchestra.run.smithi050.stdout: "op_latency": { 2024-08-31T05:44:35.702 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 412, 2024-08-31T05:44:35.703 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 2.317942485, 2024-08-31T05:44:35.703 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.005626073 2024-08-31T05:44:35.703 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.703 INFO:teuthology.orchestra.run.smithi050.stdout: "op_inflight": 0, 2024-08-31T05:44:35.703 INFO:teuthology.orchestra.run.smithi050.stdout: "oplen_avg": { 2024-08-31T05:44:35.704 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 412, 2024-08-31T05:44:35.704 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 468 2024-08-31T05:44:35.704 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.704 INFO:teuthology.orchestra.run.smithi050.stdout: "op": 412, 2024-08-31T05:44:35.704 INFO:teuthology.orchestra.run.smithi050.stdout: "op_r": 26, 2024-08-31T05:44:35.704 INFO:teuthology.orchestra.run.smithi050.stdout: "op_w": 386, 2024-08-31T05:44:35.705 INFO:teuthology.orchestra.run.smithi050.stdout: "op_rmw": 0, 2024-08-31T05:44:35.705 INFO:teuthology.orchestra.run.smithi050.stdout: "op_pg": 0, 2024-08-31T05:44:35.705 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_stat": 0, 2024-08-31T05:44:35.705 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_create": 10, 2024-08-31T05:44:35.705 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_read": 19, 2024-08-31T05:44:35.705 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_write": 212, 2024-08-31T05:44:35.705 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_writefull": 24, 2024-08-31T05:44:35.705 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_writesame": 0, 2024-08-31T05:44:35.706 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_append": 0, 2024-08-31T05:44:35.706 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_zero": 0, 2024-08-31T05:44:35.706 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_truncate": 0, 2024-08-31T05:44:35.706 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_delete": 100, 2024-08-31T05:44:35.709 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_mapext": 0, 2024-08-31T05:44:35.709 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_sparse_read": 0, 2024-08-31T05:44:35.709 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_clonerange": 0, 2024-08-31T05:44:35.709 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_getxattr": 7, 2024-08-31T05:44:35.709 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_setxattr": 20, 2024-08-31T05:44:35.709 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_cmpxattr": 0, 2024-08-31T05:44:35.709 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_rmxattr": 0, 2024-08-31T05:44:35.709 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_resetxattrs": 0, 2024-08-31T05:44:35.710 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_call": 0, 2024-08-31T05:44:35.710 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_watch": 0, 2024-08-31T05:44:35.710 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_notify": 0, 2024-08-31T05:44:35.710 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_src_cmpxattr": 0, 2024-08-31T05:44:35.710 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_pgls": 0, 2024-08-31T05:44:35.710 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_pgls_filter": 0, 2024-08-31T05:44:35.710 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_other": 0, 2024-08-31T05:44:35.710 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_active": 0, 2024-08-31T05:44:35.710 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_send": 0, 2024-08-31T05:44:35.711 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_resend": 0, 2024-08-31T05:44:35.711 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_ping": 0, 2024-08-31T05:44:35.711 INFO:teuthology.orchestra.run.smithi050.stdout: "poolop_active": 0, 2024-08-31T05:44:35.711 INFO:teuthology.orchestra.run.smithi050.stdout: "poolop_send": 0, 2024-08-31T05:44:35.711 INFO:teuthology.orchestra.run.smithi050.stdout: "poolop_resend": 0, 2024-08-31T05:44:35.711 INFO:teuthology.orchestra.run.smithi050.stdout: "poolstat_active": 0, 2024-08-31T05:44:35.711 INFO:teuthology.orchestra.run.smithi050.stdout: "poolstat_send": 0, 2024-08-31T05:44:35.711 INFO:teuthology.orchestra.run.smithi050.stdout: "poolstat_resend": 0, 2024-08-31T05:44:35.712 INFO:teuthology.orchestra.run.smithi050.stdout: "statfs_active": 0, 2024-08-31T05:44:35.712 INFO:teuthology.orchestra.run.smithi050.stdout: "statfs_send": 0, 2024-08-31T05:44:35.712 INFO:teuthology.orchestra.run.smithi050.stdout: "statfs_resend": 0, 2024-08-31T05:44:35.712 INFO:teuthology.orchestra.run.smithi050.stdout: "command_active": 0, 2024-08-31T05:44:35.712 INFO:teuthology.orchestra.run.smithi050.stdout: "command_send": 0, 2024-08-31T05:44:35.712 INFO:teuthology.orchestra.run.smithi050.stdout: "command_resend": 0, 2024-08-31T05:44:35.712 INFO:teuthology.orchestra.run.smithi050.stdout: "map_epoch": 103, 2024-08-31T05:44:35.712 INFO:teuthology.orchestra.run.smithi050.stdout: "map_full": 0, 2024-08-31T05:44:35.713 INFO:teuthology.orchestra.run.smithi050.stdout: "map_inc": 18, 2024-08-31T05:44:35.713 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_sessions": 12, 2024-08-31T05:44:35.713 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_session_open": 15, 2024-08-31T05:44:35.713 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_session_close": 3, 2024-08-31T05:44:35.713 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_laggy": 0, 2024-08-31T05:44:35.713 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_wr": 58, 2024-08-31T05:44:35.713 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_rd": 0, 2024-08-31T05:44:35.713 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_del": 18 2024-08-31T05:44:35.713 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.714 INFO:teuthology.orchestra.run.smithi050.stdout: "oft": { 2024-08-31T05:44:35.714 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_objs": 1, 2024-08-31T05:44:35.714 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_kv_pairs": 0, 2024-08-31T05:44:35.714 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_updates": 0, 2024-08-31T05:44:35.714 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_removes": 0 2024-08-31T05:44:35.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.714 INFO:teuthology.orchestra.run.smithi050.stdout: "purge_queue": { 2024-08-31T05:44:35.714 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing_ops": 0, 2024-08-31T05:44:35.715 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing_ops_high_water": 10, 2024-08-31T05:44:35.715 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing": 0, 2024-08-31T05:44:35.715 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing_high_water": 5, 2024-08-31T05:44:35.715 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executed_ops": 88, 2024-08-31T05:44:35.715 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executed": 44, 2024-08-31T05:44:35.715 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_item_in_journal": 0 2024-08-31T05:44:35.715 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.715 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T05:44:35.715 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-08-31T05:44:35.716 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 104857600, 2024-08-31T05:44:35.716 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-08-31T05:44:35.716 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 333799, 2024-08-31T05:44:35.716 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 108843700, 2024-08-31T05:44:35.716 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-08-31T05:44:35.716 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 333799, 2024-08-31T05:44:35.716 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2024-08-31T05:44:35.716 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2024-08-31T05:44:35.717 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 333799, 2024-08-31T05:44:35.717 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 108843700, 2024-08-31T05:44:35.717 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-08-31T05:44:35.717 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:35.717 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:35.717 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:35.717 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T05:44:35.717 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.718 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-objecter_bytes": { 2024-08-31T05:44:35.718 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-08-31T05:44:35.718 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 104857600, 2024-08-31T05:44:35.718 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-08-31T05:44:35.718 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 0, 2024-08-31T05:44:35.718 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 0, 2024-08-31T05:44:35.718 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-08-31T05:44:35.718 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 0, 2024-08-31T05:44:35.719 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 412, 2024-08-31T05:44:35.719 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 599601, 2024-08-31T05:44:35.719 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 412, 2024-08-31T05:44:35.719 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 599601, 2024-08-31T05:44:35.719 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-08-31T05:44:35.719 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:35.719 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:35.719 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:35.719 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T05:44:35.720 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.720 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-objecter_ops": { 2024-08-31T05:44:35.720 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-08-31T05:44:35.720 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 1024, 2024-08-31T05:44:35.720 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-08-31T05:44:35.720 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 0, 2024-08-31T05:44:35.720 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 0, 2024-08-31T05:44:35.720 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-08-31T05:44:35.721 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 0, 2024-08-31T05:44:35.721 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 412, 2024-08-31T05:44:35.721 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 412, 2024-08-31T05:44:35.721 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 412, 2024-08-31T05:44:35.721 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 412, 2024-08-31T05:44:35.721 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-08-31T05:44:35.721 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:35.721 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:35.722 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:35.722 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T05:44:35.722 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.722 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-write_buf_throttle": { 2024-08-31T05:44:35.722 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-08-31T05:44:35.722 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 3758096384, 2024-08-31T05:44:35.722 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-08-31T05:44:35.722 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 44, 2024-08-31T05:44:35.723 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 4812, 2024-08-31T05:44:35.723 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-08-31T05:44:35.723 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 44, 2024-08-31T05:44:35.723 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2024-08-31T05:44:35.723 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2024-08-31T05:44:35.723 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 19, 2024-08-31T05:44:35.723 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 4812, 2024-08-31T05:44:35.723 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-08-31T05:44:35.723 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:35.724 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:35.724 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:35.724 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T05:44:35.724 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.724 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-write_buf_throttle-0x55ebf8276750": { 2024-08-31T05:44:35.724 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 2396, 2024-08-31T05:44:35.724 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 3758096384, 2024-08-31T05:44:35.724 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-08-31T05:44:35.725 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 413, 2024-08-31T05:44:35.725 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 572904, 2024-08-31T05:44:35.725 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-08-31T05:44:35.725 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 413, 2024-08-31T05:44:35.725 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2024-08-31T05:44:35.725 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2024-08-31T05:44:35.725 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 193, 2024-08-31T05:44:35.725 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 570508, 2024-08-31T05:44:35.726 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-08-31T05:44:35.726 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:35.726 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:35.726 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:35.726 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T05:44:35.726 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:35.727 INFO:teuthology.orchestra.run.smithi050.stdout: "trackedop": { 2024-08-31T05:44:35.727 INFO:teuthology.orchestra.run.smithi050.stdout: "slow_ops_count": 0 2024-08-31T05:44:35.727 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T05:44:35.727 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-08-31T05:44:36.678 INFO:tasks.check_counter:Daemon mds.b mds.exported=0 2024-08-31T05:44:36.678 INFO:tasks.check_counter:Daemon mds.b mds.imported=1 2024-08-31T05:44:36.678 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=21 2024-08-31T05:44:36.678 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=396 2024-08-31T05:44:36.678 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-08-31T05:44:36.679 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=0 2024-08-31T05:44:36.679 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=0 2024-08-31T05:44:36.679 DEBUG:tasks.check_counter:Getting stats from e 2024-08-31T05:44:36.679 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph daemon mds.e perf dump 2024-08-31T05:44:36.941 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T05:44:37.214 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:44:37 smithi050 ceph-mon[22146]: pgmap v800: 129 pgs: 129 active+clean; 851 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 4.2 MiB/s wr, 179 op/s 2024-08-31T05:44:37.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:44:37 smithi005 ceph-mon[18602]: pgmap v800: 129 pgs: 129 active+clean; 851 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 4.2 MiB/s wr, 179 op/s 2024-08-31T05:44:37.538 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-08-31T05:44:37.538 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T05:44:37.538 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 1088, 2024-08-31T05:44:37.539 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 1090, 2024-08-31T05:44:37.539 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 7213775, 2024-08-31T05:44:37.539 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 345991, 2024-08-31T05:44:37.539 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 8, 2024-08-31T05:44:37.539 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 3, 2024-08-31T05:44:37.539 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.098619158, 2024-08-31T05:44:37.539 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.038088387, 2024-08-31T05:44:37.539 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.027387175, 2024-08-31T05:44:37.539 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.025379657, 2024-08-31T05:44:37.540 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T05:44:37.540 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 1088, 2024-08-31T05:44:37.540 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.030764077, 2024-08-31T05:44:37.540 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000028275 2024-08-31T05:44:37.540 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.540 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-08-31T05:44:37.540 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:37.541 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:37.541 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:37.541 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.541 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-31T05:44:37.541 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 0 2024-08-31T05:44:37.541 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.541 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T05:44:37.541 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 2010, 2024-08-31T05:44:37.541 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 2224, 2024-08-31T05:44:37.542 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 13170678, 2024-08-31T05:44:37.542 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 1091051, 2024-08-31T05:44:37.542 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 5, 2024-08-31T05:44:37.542 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 4, 2024-08-31T05:44:37.542 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.205281954, 2024-08-31T05:44:37.542 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.093526091, 2024-08-31T05:44:37.542 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.044697427, 2024-08-31T05:44:37.543 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.053290285, 2024-08-31T05:44:37.543 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T05:44:37.543 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 2222, 2024-08-31T05:44:37.543 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.062040790, 2024-08-31T05:44:37.543 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000027921 2024-08-31T05:44:37.543 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.544 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-08-31T05:44:37.544 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:37.544 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:37.544 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:37.544 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.544 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 160, 2024-08-31T05:44:37.544 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 452128 2024-08-31T05:44:37.545 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.545 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T05:44:37.545 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 436, 2024-08-31T05:44:37.545 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 419, 2024-08-31T05:44:37.545 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 5464666, 2024-08-31T05:44:37.545 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 213579, 2024-08-31T05:44:37.545 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 5, 2024-08-31T05:44:37.546 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 3, 2024-08-31T05:44:37.546 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.062598510, 2024-08-31T05:44:37.546 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.024891255, 2024-08-31T05:44:37.546 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.048204918, 2024-08-31T05:44:37.546 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.002902798, 2024-08-31T05:44:37.546 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T05:44:37.547 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 419, 2024-08-31T05:44:37.547 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.021979056, 2024-08-31T05:44:37.547 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000052455 2024-08-31T05:44:37.547 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.547 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-08-31T05:44:37.547 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:37.547 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:37.548 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:37.548 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.548 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 1242096, 2024-08-31T05:44:37.548 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 178272 2024-08-31T05:44:37.548 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.548 INFO:teuthology.orchestra.run.smithi050.stdout: "cct": { 2024-08-31T05:44:37.548 INFO:teuthology.orchestra.run.smithi050.stdout: "total_workers": 1, 2024-08-31T05:44:37.548 INFO:teuthology.orchestra.run.smithi050.stdout: "unhealthy_workers": 0 2024-08-31T05:44:37.549 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.549 INFO:teuthology.orchestra.run.smithi050.stdout: "finisher-MDSRank": { 2024-08-31T05:44:37.549 INFO:teuthology.orchestra.run.smithi050.stdout: "queue_len": 0, 2024-08-31T05:44:37.549 INFO:teuthology.orchestra.run.smithi050.stdout: "complete_latency": { 2024-08-31T05:44:37.549 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 5329, 2024-08-31T05:44:37.549 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.142291940, 2024-08-31T05:44:37.549 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000026701 2024-08-31T05:44:37.549 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T05:44:37.550 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.550 INFO:teuthology.orchestra.run.smithi050.stdout: "finisher-PurgeQueue": { 2024-08-31T05:44:37.550 INFO:teuthology.orchestra.run.smithi050.stdout: "queue_len": 0, 2024-08-31T05:44:37.550 INFO:teuthology.orchestra.run.smithi050.stdout: "complete_latency": { 2024-08-31T05:44:37.550 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:37.550 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:37.550 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:37.550 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T05:44:37.550 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.551 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": { 2024-08-31T05:44:37.551 INFO:teuthology.orchestra.run.smithi050.stdout: "request": 0, 2024-08-31T05:44:37.551 INFO:teuthology.orchestra.run.smithi050.stdout: "reply": 0, 2024-08-31T05:44:37.551 INFO:teuthology.orchestra.run.smithi050.stdout: "reply_latency": { 2024-08-31T05:44:37.551 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:37.551 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:37.551 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:37.551 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.551 INFO:teuthology.orchestra.run.smithi050.stdout: "slow_reply": 0, 2024-08-31T05:44:37.552 INFO:teuthology.orchestra.run.smithi050.stdout: "forward": 0, 2024-08-31T05:44:37.552 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_fetch_complete": 0, 2024-08-31T05:44:37.552 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_fetch_keys": 0, 2024-08-31T05:44:37.552 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_commit": 0, 2024-08-31T05:44:37.552 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_split": 0, 2024-08-31T05:44:37.552 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_merge": 0, 2024-08-31T05:44:37.552 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes": 2017, 2024-08-31T05:44:37.552 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_top": 1092, 2024-08-31T05:44:37.553 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_bottom": 925, 2024-08-31T05:44:37.553 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_pin_tail": 0, 2024-08-31T05:44:37.553 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_pinned": 469, 2024-08-31T05:44:37.553 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_expired": 0, 2024-08-31T05:44:37.553 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_with_caps": 0, 2024-08-31T05:44:37.553 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": 0, 2024-08-31T05:44:37.553 INFO:teuthology.orchestra.run.smithi050.stdout: "subtrees": 7, 2024-08-31T05:44:37.553 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse": 0, 2024-08-31T05:44:37.553 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_hit": 0, 2024-08-31T05:44:37.554 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_forward": 0, 2024-08-31T05:44:37.554 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_discover": 0, 2024-08-31T05:44:37.554 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_dir_fetch": 0, 2024-08-31T05:44:37.554 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_remote_ino": 0, 2024-08-31T05:44:37.554 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_lock": 0, 2024-08-31T05:44:37.554 INFO:teuthology.orchestra.run.smithi050.stdout: "load_cent": 0, 2024-08-31T05:44:37.554 INFO:teuthology.orchestra.run.smithi050.stdout: "q": 0, 2024-08-31T05:44:37.554 INFO:teuthology.orchestra.run.smithi050.stdout: "exported": 0, 2024-08-31T05:44:37.554 INFO:teuthology.orchestra.run.smithi050.stdout: "exported_inodes": 0, 2024-08-31T05:44:37.555 INFO:teuthology.orchestra.run.smithi050.stdout: "imported": 0, 2024-08-31T05:44:37.555 INFO:teuthology.orchestra.run.smithi050.stdout: "imported_inodes": 0, 2024-08-31T05:44:37.555 INFO:teuthology.orchestra.run.smithi050.stdout: "openino_dir_fetch": 0, 2024-08-31T05:44:37.555 INFO:teuthology.orchestra.run.smithi050.stdout: "openino_backtrace_fetch": 0, 2024-08-31T05:44:37.555 INFO:teuthology.orchestra.run.smithi050.stdout: "openino_peer_discover": 0, 2024-08-31T05:44:37.555 INFO:teuthology.orchestra.run.smithi050.stdout: "root_rfiles": 668, 2024-08-31T05:44:37.555 INFO:teuthology.orchestra.run.smithi050.stdout: "root_rbytes": 211661716, 2024-08-31T05:44:37.555 INFO:teuthology.orchestra.run.smithi050.stdout: "root_rsnaps": 6, 2024-08-31T05:44:37.556 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_backtrace_fetch": 0, 2024-08-31T05:44:37.556 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_set_tag": 0, 2024-08-31T05:44:37.556 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_backtrace_repaired": 0, 2024-08-31T05:44:37.556 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_inotable_repaired": 0, 2024-08-31T05:44:37.556 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_dir_inodes": 0, 2024-08-31T05:44:37.557 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_dir_base_inodes": 0, 2024-08-31T05:44:37.557 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_dirfrag_rstats": 0, 2024-08-31T05:44:37.557 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_file_inodes": 0, 2024-08-31T05:44:37.557 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_inode_file_caps": 0, 2024-08-31T05:44:37.557 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_revoke": 0, 2024-08-31T05:44:37.557 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_grant": 0, 2024-08-31T05:44:37.557 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_trunc": 0, 2024-08-31T05:44:37.557 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-31T05:44:37.558 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-31T05:44:37.558 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_caps": 0, 2024-08-31T05:44:37.558 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_caps_dirty": 0, 2024-08-31T05:44:37.558 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_cap_release": 0, 2024-08-31T05:44:37.558 INFO:teuthology.orchestra.run.smithi050.stdout: "process_request_cap_release": 0 2024-08-31T05:44:37.558 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.558 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_cache": { 2024-08-31T05:44:37.558 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_update": 0, 2024-08-31T05:44:37.558 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_update_receipt": 0, 2024-08-31T05:44:37.559 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_try_discover": 0, 2024-08-31T05:44:37.559 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_send_discover": 0, 2024-08-31T05:44:37.559 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_handle_discover": 0, 2024-08-31T05:44:37.559 INFO:teuthology.orchestra.run.smithi050.stdout: "num_strays": 0, 2024-08-31T05:44:37.559 INFO:teuthology.orchestra.run.smithi050.stdout: "num_strays_delayed": 0, 2024-08-31T05:44:37.559 INFO:teuthology.orchestra.run.smithi050.stdout: "num_strays_enqueuing": 0, 2024-08-31T05:44:37.559 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_created": 0, 2024-08-31T05:44:37.559 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_enqueued": 0, 2024-08-31T05:44:37.559 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_reintegrated": 0, 2024-08-31T05:44:37.560 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_migrated": 0, 2024-08-31T05:44:37.560 INFO:teuthology.orchestra.run.smithi050.stdout: "num_recovering_processing": 0, 2024-08-31T05:44:37.560 INFO:teuthology.orchestra.run.smithi050.stdout: "num_recovering_enqueued": 0, 2024-08-31T05:44:37.560 INFO:teuthology.orchestra.run.smithi050.stdout: "num_recovering_prioritized": 0, 2024-08-31T05:44:37.560 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_started": 0, 2024-08-31T05:44:37.560 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_completed": 0, 2024-08-31T05:44:37.560 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_quiesce_path": 0, 2024-08-31T05:44:37.560 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_quiesce_inode": 0, 2024-08-31T05:44:37.561 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_enqueue_scrub": 0, 2024-08-31T05:44:37.561 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_exportdir": 0, 2024-08-31T05:44:37.561 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_flush": 0, 2024-08-31T05:44:37.561 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_fragmentdir": 0, 2024-08-31T05:44:37.561 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_fragstats": 0, 2024-08-31T05:44:37.561 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_inodestats": 0, 2024-08-31T05:44:37.561 INFO:teuthology.orchestra.run.smithi050.stdout: "uninline_started": 0, 2024-08-31T05:44:37.561 INFO:teuthology.orchestra.run.smithi050.stdout: "uninline_succeeded": 0, 2024-08-31T05:44:37.562 INFO:teuthology.orchestra.run.smithi050.stdout: "uninline_write_failed": 0 2024-08-31T05:44:37.562 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.562 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_log": { 2024-08-31T05:44:37.562 INFO:teuthology.orchestra.run.smithi050.stdout: "evlrg": 0, 2024-08-31T05:44:37.562 INFO:teuthology.orchestra.run.smithi050.stdout: "evadd": 0, 2024-08-31T05:44:37.562 INFO:teuthology.orchestra.run.smithi050.stdout: "evex": 0, 2024-08-31T05:44:37.563 INFO:teuthology.orchestra.run.smithi050.stdout: "evtrm": 0, 2024-08-31T05:44:37.563 INFO:teuthology.orchestra.run.smithi050.stdout: "ev": 8859, 2024-08-31T05:44:37.563 INFO:teuthology.orchestra.run.smithi050.stdout: "evexg": 0, 2024-08-31T05:44:37.563 INFO:teuthology.orchestra.run.smithi050.stdout: "evexd": 0, 2024-08-31T05:44:37.563 INFO:teuthology.orchestra.run.smithi050.stdout: "segadd": 0, 2024-08-31T05:44:37.563 INFO:teuthology.orchestra.run.smithi050.stdout: "segex": 0, 2024-08-31T05:44:37.564 INFO:teuthology.orchestra.run.smithi050.stdout: "segtrm": 0, 2024-08-31T05:44:37.564 INFO:teuthology.orchestra.run.smithi050.stdout: "seg": 2, 2024-08-31T05:44:37.564 INFO:teuthology.orchestra.run.smithi050.stdout: "segmjr": 66, 2024-08-31T05:44:37.564 INFO:teuthology.orchestra.run.smithi050.stdout: "segexg": 0, 2024-08-31T05:44:37.564 INFO:teuthology.orchestra.run.smithi050.stdout: "segexd": 0, 2024-08-31T05:44:37.564 INFO:teuthology.orchestra.run.smithi050.stdout: "expos": 26074878, 2024-08-31T05:44:37.564 INFO:teuthology.orchestra.run.smithi050.stdout: "wrpos": 27905989, 2024-08-31T05:44:37.565 INFO:teuthology.orchestra.run.smithi050.stdout: "rdpos": 27904851, 2024-08-31T05:44:37.565 INFO:teuthology.orchestra.run.smithi050.stdout: "jlat": { 2024-08-31T05:44:37.565 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:37.565 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:37.566 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:37.566 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.566 INFO:teuthology.orchestra.run.smithi050.stdout: "replayed": 8859 2024-08-31T05:44:37.566 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.566 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_mem": { 2024-08-31T05:44:37.566 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 302, 2024-08-31T05:44:37.567 INFO:teuthology.orchestra.run.smithi050.stdout: "ino+": 2052, 2024-08-31T05:44:37.567 INFO:teuthology.orchestra.run.smithi050.stdout: "ino-": 1750, 2024-08-31T05:44:37.567 INFO:teuthology.orchestra.run.smithi050.stdout: "dir": 37, 2024-08-31T05:44:37.567 INFO:teuthology.orchestra.run.smithi050.stdout: "dir+": 48, 2024-08-31T05:44:37.567 INFO:teuthology.orchestra.run.smithi050.stdout: "dir-": 11, 2024-08-31T05:44:37.568 INFO:teuthology.orchestra.run.smithi050.stdout: "dn": 2017, 2024-08-31T05:44:37.568 INFO:teuthology.orchestra.run.smithi050.stdout: "dn+": 2164, 2024-08-31T05:44:37.568 INFO:teuthology.orchestra.run.smithi050.stdout: "dn-": 147, 2024-08-31T05:44:37.568 INFO:teuthology.orchestra.run.smithi050.stdout: "cap": 0, 2024-08-31T05:44:37.568 INFO:teuthology.orchestra.run.smithi050.stdout: "cap+": 0, 2024-08-31T05:44:37.568 INFO:teuthology.orchestra.run.smithi050.stdout: "cap-": 0, 2024-08-31T05:44:37.569 INFO:teuthology.orchestra.run.smithi050.stdout: "rss": 124776, 2024-08-31T05:44:37.569 INFO:teuthology.orchestra.run.smithi050.stdout: "heap": 323829760 2024-08-31T05:44:37.569 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.569 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_server": { 2024-08-31T05:44:37.570 INFO:teuthology.orchestra.run.smithi050.stdout: "dispatch_client_request": 0, 2024-08-31T05:44:37.570 INFO:teuthology.orchestra.run.smithi050.stdout: "dispatch_server_request": 0, 2024-08-31T05:44:37.570 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_request": 0, 2024-08-31T05:44:37.570 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_session": 0, 2024-08-31T05:44:37.570 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_peer_request": 0, 2024-08-31T05:44:37.570 INFO:teuthology.orchestra.run.smithi050.stdout: "req_create_latency": { 2024-08-31T05:44:37.571 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:37.571 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:37.571 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:37.571 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.571 INFO:teuthology.orchestra.run.smithi050.stdout: "req_getattr_latency": { 2024-08-31T05:44:37.572 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:37.572 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:37.572 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:37.572 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.572 INFO:teuthology.orchestra.run.smithi050.stdout: "req_getfilelock_latency": { 2024-08-31T05:44:37.572 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:37.572 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:37.573 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:37.573 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.573 INFO:teuthology.orchestra.run.smithi050.stdout: "req_link_latency": { 2024-08-31T05:44:37.573 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:37.573 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:37.573 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:37.574 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.574 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookup_latency": { 2024-08-31T05:44:37.574 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:37.574 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:37.574 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:37.574 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.574 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookuphash_latency": { 2024-08-31T05:44:37.575 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:37.575 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:37.575 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:37.575 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.575 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupino_latency": { 2024-08-31T05:44:37.575 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:37.575 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:37.576 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:37.576 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.576 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupname_latency": { 2024-08-31T05:44:37.576 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:37.576 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:37.576 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:37.576 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.576 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupparent_latency": { 2024-08-31T05:44:37.577 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:37.577 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:37.577 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:37.577 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.577 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupsnap_latency": { 2024-08-31T05:44:37.577 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:37.577 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:37.577 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:37.578 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.578 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lssnap_latency": { 2024-08-31T05:44:37.579 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:37.579 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:37.579 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:37.579 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.579 INFO:teuthology.orchestra.run.smithi050.stdout: "req_mkdir_latency": { 2024-08-31T05:44:37.579 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:37.580 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:37.580 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:37.580 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.580 INFO:teuthology.orchestra.run.smithi050.stdout: "req_mknod_latency": { 2024-08-31T05:44:37.580 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:37.580 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:37.580 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:37.580 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.581 INFO:teuthology.orchestra.run.smithi050.stdout: "req_mksnap_latency": { 2024-08-31T05:44:37.581 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:37.581 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:37.581 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:37.581 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.581 INFO:teuthology.orchestra.run.smithi050.stdout: "req_open_latency": { 2024-08-31T05:44:37.581 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:37.582 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:37.582 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:37.582 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.582 INFO:teuthology.orchestra.run.smithi050.stdout: "req_readdir_latency": { 2024-08-31T05:44:37.582 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:37.582 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:37.582 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:37.582 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.583 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rename_latency": { 2024-08-31T05:44:37.583 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:37.583 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:37.583 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:37.583 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.583 INFO:teuthology.orchestra.run.smithi050.stdout: "req_renamesnap_latency": { 2024-08-31T05:44:37.583 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:37.583 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:37.583 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:37.584 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.584 INFO:teuthology.orchestra.run.smithi050.stdout: "req_snapdiff_latency": { 2024-08-31T05:44:37.584 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:37.584 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:37.584 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:37.584 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.584 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rmdir_latency": { 2024-08-31T05:44:37.584 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:37.585 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:37.585 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:37.585 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.585 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rmsnap_latency": { 2024-08-31T05:44:37.585 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:37.585 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:37.585 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:37.586 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.586 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rmxattr_latency": { 2024-08-31T05:44:37.586 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:37.586 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:37.586 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:37.586 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.587 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setattr_latency": { 2024-08-31T05:44:37.587 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:37.587 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:37.587 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:37.587 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.587 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setdirlayout_latency": { 2024-08-31T05:44:37.587 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:37.588 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:37.588 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:37.588 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.588 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setfilelock_latency": { 2024-08-31T05:44:37.588 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:37.588 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:37.589 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:37.589 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.589 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setlayout_latency": { 2024-08-31T05:44:37.589 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:37.589 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:37.589 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:37.590 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.590 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setxattr_latency": { 2024-08-31T05:44:37.590 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:37.590 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:37.590 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:37.590 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.590 INFO:teuthology.orchestra.run.smithi050.stdout: "req_symlink_latency": { 2024-08-31T05:44:37.590 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:37.591 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:37.591 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:37.591 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.591 INFO:teuthology.orchestra.run.smithi050.stdout: "req_unlink_latency": { 2024-08-31T05:44:37.591 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:37.591 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:37.591 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:37.591 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.591 INFO:teuthology.orchestra.run.smithi050.stdout: "cap_revoke_eviction": 0, 2024-08-31T05:44:37.592 INFO:teuthology.orchestra.run.smithi050.stdout: "cap_acquisition_throttle": 0, 2024-08-31T05:44:37.592 INFO:teuthology.orchestra.run.smithi050.stdout: "req_getvxattr_latency": { 2024-08-31T05:44:37.592 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:37.592 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:37.592 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:37.592 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T05:44:37.592 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.592 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_sessions": { 2024-08-31T05:44:37.592 INFO:teuthology.orchestra.run.smithi050.stdout: "session_count": 2, 2024-08-31T05:44:37.593 INFO:teuthology.orchestra.run.smithi050.stdout: "session_add": 5, 2024-08-31T05:44:37.593 INFO:teuthology.orchestra.run.smithi050.stdout: "session_remove": 3, 2024-08-31T05:44:37.593 INFO:teuthology.orchestra.run.smithi050.stdout: "sessions_open": 3, 2024-08-31T05:44:37.593 INFO:teuthology.orchestra.run.smithi050.stdout: "sessions_stale": 0, 2024-08-31T05:44:37.593 INFO:teuthology.orchestra.run.smithi050.stdout: "total_load": 0, 2024-08-31T05:44:37.593 INFO:teuthology.orchestra.run.smithi050.stdout: "average_load": 0, 2024-08-31T05:44:37.593 INFO:teuthology.orchestra.run.smithi050.stdout: "avg_session_uptime": 2450, 2024-08-31T05:44:37.594 INFO:teuthology.orchestra.run.smithi050.stdout: "mdthresh_evicted": 0 2024-08-31T05:44:37.594 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.594 INFO:teuthology.orchestra.run.smithi050.stdout: "mempool": { 2024-08-31T05:44:37.594 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_bytes": 0, 2024-08-31T05:44:37.594 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_items": 0, 2024-08-31T05:44:37.594 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T05:44:37.594 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_items": 0, 2024-08-31T05:44:37.595 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T05:44:37.595 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_items": 0, 2024-08-31T05:44:37.595 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T05:44:37.595 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T05:44:37.595 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T05:44:37.595 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T05:44:37.595 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T05:44:37.596 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_items": 0, 2024-08-31T05:44:37.596 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T05:44:37.596 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T05:44:37.596 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_bytes": 0, 2024-08-31T05:44:37.596 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_items": 0, 2024-08-31T05:44:37.596 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_bytes": 0, 2024-08-31T05:44:37.596 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_items": 0, 2024-08-31T05:44:37.597 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T05:44:37.597 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T05:44:37.597 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T05:44:37.597 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T05:44:37.597 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T05:44:37.597 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_items": 0, 2024-08-31T05:44:37.597 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_bytes": 0, 2024-08-31T05:44:37.598 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_items": 0, 2024-08-31T05:44:37.598 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T05:44:37.598 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T05:44:37.598 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_bytes": 0, 2024-08-31T05:44:37.598 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_items": 0, 2024-08-31T05:44:37.599 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_bytes": 0, 2024-08-31T05:44:37.599 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_items": 0, 2024-08-31T05:44:37.599 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T05:44:37.599 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_items": 0, 2024-08-31T05:44:37.599 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T05:44:37.600 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_items": 0, 2024-08-31T05:44:37.600 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_bytes": 217008, 2024-08-31T05:44:37.600 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_items": 369, 2024-08-31T05:44:37.600 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_bytes": 0, 2024-08-31T05:44:37.600 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_items": 0, 2024-08-31T05:44:37.601 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_bytes": 0, 2024-08-31T05:44:37.601 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_items": 0, 2024-08-31T05:44:37.601 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_bytes": 0, 2024-08-31T05:44:37.601 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_items": 0, 2024-08-31T05:44:37.601 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_bytes": 0, 2024-08-31T05:44:37.601 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_items": 0, 2024-08-31T05:44:37.602 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_bytes": 9736, 2024-08-31T05:44:37.602 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_items": 197, 2024-08-31T05:44:37.602 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T05:44:37.602 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_items": 0, 2024-08-31T05:44:37.602 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_bytes": 0, 2024-08-31T05:44:37.603 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_items": 0, 2024-08-31T05:44:37.603 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_bytes": 2199316, 2024-08-31T05:44:37.603 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_items": 26962, 2024-08-31T05:44:37.603 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_bytes": 0, 2024-08-31T05:44:37.603 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_items": 0, 2024-08-31T05:44:37.603 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_bytes": 0, 2024-08-31T05:44:37.604 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_items": 0 2024-08-31T05:44:37.604 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.604 INFO:teuthology.orchestra.run.smithi050.stdout: "objecter": { 2024-08-31T05:44:37.604 INFO:teuthology.orchestra.run.smithi050.stdout: "op_active": 0, 2024-08-31T05:44:37.604 INFO:teuthology.orchestra.run.smithi050.stdout: "op_laggy": 0, 2024-08-31T05:44:37.604 INFO:teuthology.orchestra.run.smithi050.stdout: "op_send": 3208, 2024-08-31T05:44:37.605 INFO:teuthology.orchestra.run.smithi050.stdout: "op_send_bytes": 26, 2024-08-31T05:44:37.605 INFO:teuthology.orchestra.run.smithi050.stdout: "op_resend": 4, 2024-08-31T05:44:37.605 INFO:teuthology.orchestra.run.smithi050.stdout: "op_reply": 3208, 2024-08-31T05:44:37.605 INFO:teuthology.orchestra.run.smithi050.stdout: "op_latency": { 2024-08-31T05:44:37.605 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 3208, 2024-08-31T05:44:37.605 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 2.111946889, 2024-08-31T05:44:37.605 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000658337 2024-08-31T05:44:37.606 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.606 INFO:teuthology.orchestra.run.smithi050.stdout: "op_inflight": 0, 2024-08-31T05:44:37.606 INFO:teuthology.orchestra.run.smithi050.stdout: "oplen_avg": { 2024-08-31T05:44:37.606 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 3208, 2024-08-31T05:44:37.606 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 3209 2024-08-31T05:44:37.606 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.606 INFO:teuthology.orchestra.run.smithi050.stdout: "op": 3208, 2024-08-31T05:44:37.607 INFO:teuthology.orchestra.run.smithi050.stdout: "op_r": 3208, 2024-08-31T05:44:37.607 INFO:teuthology.orchestra.run.smithi050.stdout: "op_w": 0, 2024-08-31T05:44:37.607 INFO:teuthology.orchestra.run.smithi050.stdout: "op_rmw": 0, 2024-08-31T05:44:37.607 INFO:teuthology.orchestra.run.smithi050.stdout: "op_pg": 0, 2024-08-31T05:44:37.607 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_stat": 1966, 2024-08-31T05:44:37.607 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_create": 0, 2024-08-31T05:44:37.607 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_read": 1239, 2024-08-31T05:44:37.608 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_write": 0, 2024-08-31T05:44:37.608 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_writefull": 0, 2024-08-31T05:44:37.608 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_writesame": 0, 2024-08-31T05:44:37.608 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_append": 0, 2024-08-31T05:44:37.608 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_zero": 0, 2024-08-31T05:44:37.608 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_truncate": 0, 2024-08-31T05:44:37.609 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_delete": 0, 2024-08-31T05:44:37.609 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_mapext": 0, 2024-08-31T05:44:37.609 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_sparse_read": 0, 2024-08-31T05:44:37.609 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_clonerange": 0, 2024-08-31T05:44:37.609 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_getxattr": 2, 2024-08-31T05:44:37.609 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_setxattr": 0, 2024-08-31T05:44:37.609 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_cmpxattr": 0, 2024-08-31T05:44:37.610 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_rmxattr": 0, 2024-08-31T05:44:37.610 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_resetxattrs": 0, 2024-08-31T05:44:37.610 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_call": 0, 2024-08-31T05:44:37.610 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_watch": 0, 2024-08-31T05:44:37.610 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_notify": 0, 2024-08-31T05:44:37.611 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_src_cmpxattr": 0, 2024-08-31T05:44:37.611 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_pgls": 0, 2024-08-31T05:44:37.611 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_pgls_filter": 0, 2024-08-31T05:44:37.611 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_other": 0, 2024-08-31T05:44:37.611 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_active": 0, 2024-08-31T05:44:37.611 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_send": 0, 2024-08-31T05:44:37.612 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_resend": 0, 2024-08-31T05:44:37.612 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_ping": 0, 2024-08-31T05:44:37.612 INFO:teuthology.orchestra.run.smithi050.stdout: "poolop_active": 0, 2024-08-31T05:44:37.612 INFO:teuthology.orchestra.run.smithi050.stdout: "poolop_send": 0, 2024-08-31T05:44:37.612 INFO:teuthology.orchestra.run.smithi050.stdout: "poolop_resend": 0, 2024-08-31T05:44:37.613 INFO:teuthology.orchestra.run.smithi050.stdout: "poolstat_active": 0, 2024-08-31T05:44:37.613 INFO:teuthology.orchestra.run.smithi050.stdout: "poolstat_send": 0, 2024-08-31T05:44:37.613 INFO:teuthology.orchestra.run.smithi050.stdout: "poolstat_resend": 0, 2024-08-31T05:44:37.613 INFO:teuthology.orchestra.run.smithi050.stdout: "statfs_active": 0, 2024-08-31T05:44:37.613 INFO:teuthology.orchestra.run.smithi050.stdout: "statfs_send": 0, 2024-08-31T05:44:37.614 INFO:teuthology.orchestra.run.smithi050.stdout: "statfs_resend": 0, 2024-08-31T05:44:37.614 INFO:teuthology.orchestra.run.smithi050.stdout: "command_active": 0, 2024-08-31T05:44:37.614 INFO:teuthology.orchestra.run.smithi050.stdout: "command_send": 0, 2024-08-31T05:44:37.614 INFO:teuthology.orchestra.run.smithi050.stdout: "command_resend": 0, 2024-08-31T05:44:37.614 INFO:teuthology.orchestra.run.smithi050.stdout: "map_epoch": 103, 2024-08-31T05:44:37.614 INFO:teuthology.orchestra.run.smithi050.stdout: "map_full": 0, 2024-08-31T05:44:37.615 INFO:teuthology.orchestra.run.smithi050.stdout: "map_inc": 18, 2024-08-31T05:44:37.615 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_sessions": 7, 2024-08-31T05:44:37.615 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_session_open": 9, 2024-08-31T05:44:37.615 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_session_close": 2, 2024-08-31T05:44:37.615 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_laggy": 0, 2024-08-31T05:44:37.616 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_wr": 0, 2024-08-31T05:44:37.616 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_rd": 2, 2024-08-31T05:44:37.616 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_del": 0 2024-08-31T05:44:37.616 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.616 INFO:teuthology.orchestra.run.smithi050.stdout: "oft": { 2024-08-31T05:44:37.616 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_objs": 0, 2024-08-31T05:44:37.617 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_kv_pairs": 0, 2024-08-31T05:44:37.617 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_updates": 0, 2024-08-31T05:44:37.617 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_removes": 0 2024-08-31T05:44:37.617 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.617 INFO:teuthology.orchestra.run.smithi050.stdout: "purge_queue": { 2024-08-31T05:44:37.617 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing_ops": 0, 2024-08-31T05:44:37.618 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing_ops_high_water": 0, 2024-08-31T05:44:37.618 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing": 0, 2024-08-31T05:44:37.618 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing_high_water": 0, 2024-08-31T05:44:37.618 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executed_ops": 0, 2024-08-31T05:44:37.618 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executed": 0, 2024-08-31T05:44:37.618 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_item_in_journal": 0 2024-08-31T05:44:37.619 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.619 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T05:44:37.619 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-08-31T05:44:37.619 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 104857600, 2024-08-31T05:44:37.619 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-08-31T05:44:37.620 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 3530, 2024-08-31T05:44:37.620 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 25511956, 2024-08-31T05:44:37.620 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-08-31T05:44:37.620 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 3530, 2024-08-31T05:44:37.620 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2024-08-31T05:44:37.621 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2024-08-31T05:44:37.621 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 3530, 2024-08-31T05:44:37.621 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 25511956, 2024-08-31T05:44:37.621 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-08-31T05:44:37.621 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:37.621 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:37.622 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:37.622 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T05:44:37.622 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.622 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-objecter_bytes": { 2024-08-31T05:44:37.622 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-08-31T05:44:37.622 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 104857600, 2024-08-31T05:44:37.623 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-08-31T05:44:37.623 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 0, 2024-08-31T05:44:37.623 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 0, 2024-08-31T05:44:37.623 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-08-31T05:44:37.623 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 0, 2024-08-31T05:44:37.623 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 3208, 2024-08-31T05:44:37.624 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 23711695, 2024-08-31T05:44:37.624 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 3208, 2024-08-31T05:44:37.624 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 23711695, 2024-08-31T05:44:37.624 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-08-31T05:44:37.624 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:37.624 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:37.624 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:37.624 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T05:44:37.625 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.625 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-objecter_ops": { 2024-08-31T05:44:37.625 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-08-31T05:44:37.625 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 1024, 2024-08-31T05:44:37.625 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-08-31T05:44:37.625 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 0, 2024-08-31T05:44:37.626 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 0, 2024-08-31T05:44:37.626 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-08-31T05:44:37.626 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 0, 2024-08-31T05:44:37.626 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 3208, 2024-08-31T05:44:37.626 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 3208, 2024-08-31T05:44:37.626 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 3208, 2024-08-31T05:44:37.626 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 3208, 2024-08-31T05:44:37.627 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-08-31T05:44:37.627 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:37.627 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:37.627 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:37.627 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T05:44:37.627 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.627 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-write_buf_throttle": { 2024-08-31T05:44:37.628 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-08-31T05:44:37.628 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 3758096384, 2024-08-31T05:44:37.628 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-08-31T05:44:37.628 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 0, 2024-08-31T05:44:37.628 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 0, 2024-08-31T05:44:37.628 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-08-31T05:44:37.628 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 0, 2024-08-31T05:44:37.629 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2024-08-31T05:44:37.629 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2024-08-31T05:44:37.629 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 0, 2024-08-31T05:44:37.629 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 0, 2024-08-31T05:44:37.629 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-08-31T05:44:37.629 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:37.629 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:37.629 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:37.630 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T05:44:37.630 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.630 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-write_buf_throttle-0x55c2459ea750": { 2024-08-31T05:44:37.630 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-08-31T05:44:37.630 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 3758096384, 2024-08-31T05:44:37.630 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-08-31T05:44:37.631 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 0, 2024-08-31T05:44:37.631 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 0, 2024-08-31T05:44:37.631 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-08-31T05:44:37.631 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 0, 2024-08-31T05:44:37.631 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2024-08-31T05:44:37.631 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2024-08-31T05:44:37.632 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 0, 2024-08-31T05:44:37.632 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 0, 2024-08-31T05:44:37.632 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-08-31T05:44:37.632 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:37.632 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:37.632 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:37.633 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T05:44:37.633 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:37.633 INFO:teuthology.orchestra.run.smithi050.stdout: "trackedop": { 2024-08-31T05:44:37.633 INFO:teuthology.orchestra.run.smithi050.stdout: "slow_ops_count": 0 2024-08-31T05:44:37.633 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T05:44:37.633 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-08-31T05:44:37.634 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:44:37 smithi070 ceph-mon[22316]: pgmap v800: 129 pgs: 129 active+clean; 851 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 4.2 MiB/s wr, 179 op/s 2024-08-31T05:44:38.531 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-08-31T05:44:38.531 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-08-31T05:44:38.531 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-08-31T05:44:38.531 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-08-31T05:44:38.532 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=6 2024-08-31T05:44:38.532 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-08-31T05:44:38.532 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-08-31T05:44:38.532 DEBUG:tasks.check_counter:Getting stats from h 2024-08-31T05:44:38.532 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph daemon mds.h perf dump 2024-08-31T05:44:38.784 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T05:44:39.157 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:44:39 smithi050 ceph-mon[22146]: pgmap v801: 129 pgs: 129 active+clean; 851 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 2.0 MiB/s wr, 104 op/s 2024-08-31T05:44:39.345 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-08-31T05:44:39.346 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T05:44:39.346 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 296607, 2024-08-31T05:44:39.346 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 148592, 2024-08-31T05:44:39.346 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 127402190, 2024-08-31T05:44:39.346 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 24137071, 2024-08-31T05:44:39.346 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 14, 2024-08-31T05:44:39.346 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 8, 2024-08-31T05:44:39.347 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 14.707290655, 2024-08-31T05:44:39.347 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 6.339244316, 2024-08-31T05:44:39.347 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 11.541917299, 2024-08-31T05:44:39.347 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.004503399, 2024-08-31T05:44:39.347 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T05:44:39.347 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 148590, 2024-08-31T05:44:39.347 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 2.223191632, 2024-08-31T05:44:39.347 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000014961 2024-08-31T05:44:39.348 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.348 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-08-31T05:44:39.348 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 444715, 2024-08-31T05:44:39.348 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.068345389, 2024-08-31T05:44:39.348 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000153 2024-08-31T05:44:39.348 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.348 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-31T05:44:39.348 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 0 2024-08-31T05:44:39.348 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.349 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T05:44:39.349 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 6359, 2024-08-31T05:44:39.349 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 3428, 2024-08-31T05:44:39.349 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 2885384, 2024-08-31T05:44:39.349 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 1086522, 2024-08-31T05:44:39.349 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 43, 2024-08-31T05:44:39.349 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 6, 2024-08-31T05:44:39.349 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.385450869, 2024-08-31T05:44:39.350 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.158782466, 2024-08-31T05:44:39.350 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.307503190, 2024-08-31T05:44:39.350 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.000402201, 2024-08-31T05:44:39.350 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T05:44:39.350 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 3428, 2024-08-31T05:44:39.350 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.081217285, 2024-08-31T05:44:39.350 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000023692 2024-08-31T05:44:39.350 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.351 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-08-31T05:44:39.351 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 9044, 2024-08-31T05:44:39.351 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.001546051, 2024-08-31T05:44:39.351 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000170 2024-08-31T05:44:39.351 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.351 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 1253920, 2024-08-31T05:44:39.352 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 182048 2024-08-31T05:44:39.352 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.352 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T05:44:39.352 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 48, 2024-08-31T05:44:39.352 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 284, 2024-08-31T05:44:39.352 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 18731, 2024-08-31T05:44:39.352 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 622751, 2024-08-31T05:44:39.352 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 14, 2024-08-31T05:44:39.353 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 6, 2024-08-31T05:44:39.353 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.023315725, 2024-08-31T05:44:39.353 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.013826044, 2024-08-31T05:44:39.353 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.007286494, 2024-08-31T05:44:39.353 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.000468784, 2024-08-31T05:44:39.353 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T05:44:39.353 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 282, 2024-08-31T05:44:39.354 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.023671278, 2024-08-31T05:44:39.354 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000083940 2024-08-31T05:44:39.354 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.354 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-08-31T05:44:39.354 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 78, 2024-08-31T05:44:39.354 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000016749, 2024-08-31T05:44:39.354 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000214 2024-08-31T05:44:39.355 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.355 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 2368, 2024-08-31T05:44:39.355 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 549808 2024-08-31T05:44:39.355 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.355 INFO:teuthology.orchestra.run.smithi050.stdout: "cct": { 2024-08-31T05:44:39.355 INFO:teuthology.orchestra.run.smithi050.stdout: "total_workers": 1, 2024-08-31T05:44:39.355 INFO:teuthology.orchestra.run.smithi050.stdout: "unhealthy_workers": 0 2024-08-31T05:44:39.355 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.356 INFO:teuthology.orchestra.run.smithi050.stdout: "finisher-MDSRank": { 2024-08-31T05:44:39.356 INFO:teuthology.orchestra.run.smithi050.stdout: "queue_len": 0, 2024-08-31T05:44:39.357 INFO:teuthology.orchestra.run.smithi050.stdout: "complete_latency": { 2024-08-31T05:44:39.357 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 43, 2024-08-31T05:44:39.357 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.001799003, 2024-08-31T05:44:39.357 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000041837 2024-08-31T05:44:39.358 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T05:44:39.358 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.358 INFO:teuthology.orchestra.run.smithi050.stdout: "finisher-PurgeQueue": { 2024-08-31T05:44:39.358 INFO:teuthology.orchestra.run.smithi050.stdout: "queue_len": 0, 2024-08-31T05:44:39.358 INFO:teuthology.orchestra.run.smithi050.stdout: "complete_latency": { 2024-08-31T05:44:39.358 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 2, 2024-08-31T05:44:39.358 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000011451, 2024-08-31T05:44:39.359 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000005725 2024-08-31T05:44:39.359 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T05:44:39.359 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.359 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": { 2024-08-31T05:44:39.359 INFO:teuthology.orchestra.run.smithi050.stdout: "request": 16, 2024-08-31T05:44:39.360 INFO:teuthology.orchestra.run.smithi050.stdout: "reply": 1, 2024-08-31T05:44:39.360 INFO:teuthology.orchestra.run.smithi050.stdout: "reply_latency": { 2024-08-31T05:44:39.360 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 1, 2024-08-31T05:44:39.360 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000147968, 2024-08-31T05:44:39.360 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000147968 2024-08-31T05:44:39.360 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.360 INFO:teuthology.orchestra.run.smithi050.stdout: "slow_reply": 0, 2024-08-31T05:44:39.360 INFO:teuthology.orchestra.run.smithi050.stdout: "forward": 15, 2024-08-31T05:44:39.361 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_fetch_complete": 0, 2024-08-31T05:44:39.361 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_fetch_keys": 0, 2024-08-31T05:44:39.361 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_commit": 11, 2024-08-31T05:44:39.361 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_split": 0, 2024-08-31T05:44:39.361 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_merge": 0, 2024-08-31T05:44:39.361 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes": 128, 2024-08-31T05:44:39.361 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_top": 63, 2024-08-31T05:44:39.362 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_bottom": 65, 2024-08-31T05:44:39.362 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_pin_tail": 0, 2024-08-31T05:44:39.362 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_pinned": 37, 2024-08-31T05:44:39.362 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_expired": 0, 2024-08-31T05:44:39.362 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_with_caps": 1, 2024-08-31T05:44:39.362 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": 1, 2024-08-31T05:44:39.362 INFO:teuthology.orchestra.run.smithi050.stdout: "subtrees": 5, 2024-08-31T05:44:39.362 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse": 275, 2024-08-31T05:44:39.363 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_hit": 157, 2024-08-31T05:44:39.363 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_forward": 15, 2024-08-31T05:44:39.363 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_discover": 103, 2024-08-31T05:44:39.363 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_dir_fetch": 0, 2024-08-31T05:44:39.363 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_remote_ino": 0, 2024-08-31T05:44:39.363 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_lock": 0, 2024-08-31T05:44:39.363 INFO:teuthology.orchestra.run.smithi050.stdout: "load_cent": 0, 2024-08-31T05:44:39.364 INFO:teuthology.orchestra.run.smithi050.stdout: "q": 0, 2024-08-31T05:44:39.364 INFO:teuthology.orchestra.run.smithi050.stdout: "exported": 0, 2024-08-31T05:44:39.364 INFO:teuthology.orchestra.run.smithi050.stdout: "exported_inodes": 0, 2024-08-31T05:44:39.364 INFO:teuthology.orchestra.run.smithi050.stdout: "imported": 0, 2024-08-31T05:44:39.364 INFO:teuthology.orchestra.run.smithi050.stdout: "imported_inodes": 0, 2024-08-31T05:44:39.364 INFO:teuthology.orchestra.run.smithi050.stdout: "openino_dir_fetch": 0, 2024-08-31T05:44:39.364 INFO:teuthology.orchestra.run.smithi050.stdout: "openino_backtrace_fetch": 0, 2024-08-31T05:44:39.364 INFO:teuthology.orchestra.run.smithi050.stdout: "openino_peer_discover": 0, 2024-08-31T05:44:39.365 INFO:teuthology.orchestra.run.smithi050.stdout: "root_rfiles": 736, 2024-08-31T05:44:39.365 INFO:teuthology.orchestra.run.smithi050.stdout: "root_rbytes": 205356007, 2024-08-31T05:44:39.365 INFO:teuthology.orchestra.run.smithi050.stdout: "root_rsnaps": 6, 2024-08-31T05:44:39.365 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_backtrace_fetch": 0, 2024-08-31T05:44:39.365 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_set_tag": 0, 2024-08-31T05:44:39.365 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_backtrace_repaired": 0, 2024-08-31T05:44:39.365 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_inotable_repaired": 0, 2024-08-31T05:44:39.365 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_dir_inodes": 0, 2024-08-31T05:44:39.366 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_dir_base_inodes": 0, 2024-08-31T05:44:39.366 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_dirfrag_rstats": 0, 2024-08-31T05:44:39.366 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_file_inodes": 0, 2024-08-31T05:44:39.366 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_inode_file_caps": 0, 2024-08-31T05:44:39.366 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_revoke": 0, 2024-08-31T05:44:39.366 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_grant": 0, 2024-08-31T05:44:39.366 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_trunc": 0, 2024-08-31T05:44:39.366 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-31T05:44:39.367 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-31T05:44:39.367 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_caps": 0, 2024-08-31T05:44:39.367 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_caps_dirty": 0, 2024-08-31T05:44:39.367 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_cap_release": 0, 2024-08-31T05:44:39.367 INFO:teuthology.orchestra.run.smithi050.stdout: "process_request_cap_release": 0 2024-08-31T05:44:39.367 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.367 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_cache": { 2024-08-31T05:44:39.367 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_update": 0, 2024-08-31T05:44:39.368 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_update_receipt": 416, 2024-08-31T05:44:39.368 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_try_discover": 259, 2024-08-31T05:44:39.368 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_send_discover": 317, 2024-08-31T05:44:39.368 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_handle_discover": 0, 2024-08-31T05:44:39.368 INFO:teuthology.orchestra.run.smithi050.stdout: "num_strays": 0, 2024-08-31T05:44:39.368 INFO:teuthology.orchestra.run.smithi050.stdout: "num_strays_delayed": 0, 2024-08-31T05:44:39.368 INFO:teuthology.orchestra.run.smithi050.stdout: "num_strays_enqueuing": 0, 2024-08-31T05:44:39.368 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_created": 0, 2024-08-31T05:44:39.368 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_enqueued": 0, 2024-08-31T05:44:39.369 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_reintegrated": 0, 2024-08-31T05:44:39.369 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_migrated": 0, 2024-08-31T05:44:39.369 INFO:teuthology.orchestra.run.smithi050.stdout: "num_recovering_processing": 0, 2024-08-31T05:44:39.369 INFO:teuthology.orchestra.run.smithi050.stdout: "num_recovering_enqueued": 0, 2024-08-31T05:44:39.369 INFO:teuthology.orchestra.run.smithi050.stdout: "num_recovering_prioritized": 0, 2024-08-31T05:44:39.369 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_started": 0, 2024-08-31T05:44:39.369 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_completed": 0, 2024-08-31T05:44:39.370 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_quiesce_path": 0, 2024-08-31T05:44:39.370 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_quiesce_inode": 0, 2024-08-31T05:44:39.370 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_enqueue_scrub": 0, 2024-08-31T05:44:39.370 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_exportdir": 0, 2024-08-31T05:44:39.370 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_flush": 0, 2024-08-31T05:44:39.370 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_fragmentdir": 0, 2024-08-31T05:44:39.370 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_fragstats": 0, 2024-08-31T05:44:39.370 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_inodestats": 0, 2024-08-31T05:44:39.371 INFO:teuthology.orchestra.run.smithi050.stdout: "uninline_started": 0, 2024-08-31T05:44:39.371 INFO:teuthology.orchestra.run.smithi050.stdout: "uninline_succeeded": 0, 2024-08-31T05:44:39.371 INFO:teuthology.orchestra.run.smithi050.stdout: "uninline_write_failed": 0 2024-08-31T05:44:39.371 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.371 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_log": { 2024-08-31T05:44:39.371 INFO:teuthology.orchestra.run.smithi050.stdout: "evlrg": 0, 2024-08-31T05:44:39.371 INFO:teuthology.orchestra.run.smithi050.stdout: "evadd": 6, 2024-08-31T05:44:39.371 INFO:teuthology.orchestra.run.smithi050.stdout: "evex": 0, 2024-08-31T05:44:39.372 INFO:teuthology.orchestra.run.smithi050.stdout: "evtrm": 0, 2024-08-31T05:44:39.372 INFO:teuthology.orchestra.run.smithi050.stdout: "ev": 6, 2024-08-31T05:44:39.372 INFO:teuthology.orchestra.run.smithi050.stdout: "evexg": 0, 2024-08-31T05:44:39.372 INFO:teuthology.orchestra.run.smithi050.stdout: "evexd": 0, 2024-08-31T05:44:39.372 INFO:teuthology.orchestra.run.smithi050.stdout: "segadd": 2, 2024-08-31T05:44:39.372 INFO:teuthology.orchestra.run.smithi050.stdout: "segex": 0, 2024-08-31T05:44:39.372 INFO:teuthology.orchestra.run.smithi050.stdout: "segtrm": 0, 2024-08-31T05:44:39.372 INFO:teuthology.orchestra.run.smithi050.stdout: "seg": 2, 2024-08-31T05:44:39.373 INFO:teuthology.orchestra.run.smithi050.stdout: "segmjr": 2, 2024-08-31T05:44:39.373 INFO:teuthology.orchestra.run.smithi050.stdout: "segexg": 0, 2024-08-31T05:44:39.373 INFO:teuthology.orchestra.run.smithi050.stdout: "segexd": 0, 2024-08-31T05:44:39.373 INFO:teuthology.orchestra.run.smithi050.stdout: "expos": 4194304, 2024-08-31T05:44:39.373 INFO:teuthology.orchestra.run.smithi050.stdout: "wrpos": 4196123, 2024-08-31T05:44:39.373 INFO:teuthology.orchestra.run.smithi050.stdout: "rdpos": 0, 2024-08-31T05:44:39.373 INFO:teuthology.orchestra.run.smithi050.stdout: "jlat": { 2024-08-31T05:44:39.373 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 5, 2024-08-31T05:44:39.374 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.009591171, 2024-08-31T05:44:39.374 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.001918234 2024-08-31T05:44:39.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.374 INFO:teuthology.orchestra.run.smithi050.stdout: "replayed": 0 2024-08-31T05:44:39.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.374 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_mem": { 2024-08-31T05:44:39.374 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 131, 2024-08-31T05:44:39.374 INFO:teuthology.orchestra.run.smithi050.stdout: "ino+": 131, 2024-08-31T05:44:39.374 INFO:teuthology.orchestra.run.smithi050.stdout: "ino-": 0, 2024-08-31T05:44:39.375 INFO:teuthology.orchestra.run.smithi050.stdout: "dir": 137, 2024-08-31T05:44:39.375 INFO:teuthology.orchestra.run.smithi050.stdout: "dir+": 203, 2024-08-31T05:44:39.375 INFO:teuthology.orchestra.run.smithi050.stdout: "dir-": 66, 2024-08-31T05:44:39.375 INFO:teuthology.orchestra.run.smithi050.stdout: "dn": 128, 2024-08-31T05:44:39.375 INFO:teuthology.orchestra.run.smithi050.stdout: "dn+": 128, 2024-08-31T05:44:39.375 INFO:teuthology.orchestra.run.smithi050.stdout: "dn-": 0, 2024-08-31T05:44:39.375 INFO:teuthology.orchestra.run.smithi050.stdout: "cap": 1, 2024-08-31T05:44:39.375 INFO:teuthology.orchestra.run.smithi050.stdout: "cap+": 1, 2024-08-31T05:44:39.375 INFO:teuthology.orchestra.run.smithi050.stdout: "cap-": 0, 2024-08-31T05:44:39.376 INFO:teuthology.orchestra.run.smithi050.stdout: "rss": 121232, 2024-08-31T05:44:39.376 INFO:teuthology.orchestra.run.smithi050.stdout: "heap": 329138176 2024-08-31T05:44:39.376 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.376 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_server": { 2024-08-31T05:44:39.376 INFO:teuthology.orchestra.run.smithi050.stdout: "dispatch_client_request": 17, 2024-08-31T05:44:39.376 INFO:teuthology.orchestra.run.smithi050.stdout: "dispatch_server_request": 0, 2024-08-31T05:44:39.376 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_request": 16, 2024-08-31T05:44:39.376 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_session": 27, 2024-08-31T05:44:39.377 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_peer_request": 0, 2024-08-31T05:44:39.377 INFO:teuthology.orchestra.run.smithi050.stdout: "req_create_latency": { 2024-08-31T05:44:39.377 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:39.377 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:39.377 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:39.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.377 INFO:teuthology.orchestra.run.smithi050.stdout: "req_getattr_latency": { 2024-08-31T05:44:39.377 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:39.378 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:39.378 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:39.378 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.378 INFO:teuthology.orchestra.run.smithi050.stdout: "req_getfilelock_latency": { 2024-08-31T05:44:39.378 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:39.378 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:39.378 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:39.378 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.379 INFO:teuthology.orchestra.run.smithi050.stdout: "req_link_latency": { 2024-08-31T05:44:39.379 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:39.379 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:39.379 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:39.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.379 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookup_latency": { 2024-08-31T05:44:39.379 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:39.380 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:39.380 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:39.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.380 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookuphash_latency": { 2024-08-31T05:44:39.380 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:39.380 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:39.380 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:39.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.381 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupino_latency": { 2024-08-31T05:44:39.381 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 1, 2024-08-31T05:44:39.381 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000147968, 2024-08-31T05:44:39.381 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000147968 2024-08-31T05:44:39.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.381 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupname_latency": { 2024-08-31T05:44:39.381 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:39.381 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:39.382 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:39.382 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.382 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupparent_latency": { 2024-08-31T05:44:39.382 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:39.382 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:39.382 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:39.382 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.382 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupsnap_latency": { 2024-08-31T05:44:39.383 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:39.383 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:39.383 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:39.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.383 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lssnap_latency": { 2024-08-31T05:44:39.384 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:39.384 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:39.384 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:39.384 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.384 INFO:teuthology.orchestra.run.smithi050.stdout: "req_mkdir_latency": { 2024-08-31T05:44:39.385 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:39.385 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:39.385 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:39.385 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.385 INFO:teuthology.orchestra.run.smithi050.stdout: "req_mknod_latency": { 2024-08-31T05:44:39.385 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:39.385 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:39.386 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:39.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.386 INFO:teuthology.orchestra.run.smithi050.stdout: "req_mksnap_latency": { 2024-08-31T05:44:39.386 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:39.386 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:39.386 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:39.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.386 INFO:teuthology.orchestra.run.smithi050.stdout: "req_open_latency": { 2024-08-31T05:44:39.386 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:39.387 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:39.387 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:39.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.387 INFO:teuthology.orchestra.run.smithi050.stdout: "req_readdir_latency": { 2024-08-31T05:44:39.387 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:39.387 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:39.387 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:39.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.388 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rename_latency": { 2024-08-31T05:44:39.388 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:39.388 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:39.388 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:39.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.388 INFO:teuthology.orchestra.run.smithi050.stdout: "req_renamesnap_latency": { 2024-08-31T05:44:39.388 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:39.388 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:39.389 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:39.389 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.389 INFO:teuthology.orchestra.run.smithi050.stdout: "req_snapdiff_latency": { 2024-08-31T05:44:39.389 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:39.389 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:39.389 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:39.389 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.389 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rmdir_latency": { 2024-08-31T05:44:39.389 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:39.390 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:39.390 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:39.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.390 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rmsnap_latency": { 2024-08-31T05:44:39.390 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:39.390 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:39.390 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:39.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.391 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rmxattr_latency": { 2024-08-31T05:44:39.391 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:39.391 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:39.391 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:39.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.391 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setattr_latency": { 2024-08-31T05:44:39.391 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:39.391 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:39.392 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:39.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.392 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setdirlayout_latency": { 2024-08-31T05:44:39.392 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:39.392 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:39.392 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:39.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.393 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setfilelock_latency": { 2024-08-31T05:44:39.393 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:39.393 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:39.393 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:39.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.393 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setlayout_latency": { 2024-08-31T05:44:39.393 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:39.393 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:39.394 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:39.394 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.394 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setxattr_latency": { 2024-08-31T05:44:39.394 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:39.394 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:39.394 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:39.394 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.394 INFO:teuthology.orchestra.run.smithi050.stdout: "req_symlink_latency": { 2024-08-31T05:44:39.394 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:39.395 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:39.395 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:39.395 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.395 INFO:teuthology.orchestra.run.smithi050.stdout: "req_unlink_latency": { 2024-08-31T05:44:39.395 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:39.395 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:39.395 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:39.395 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.396 INFO:teuthology.orchestra.run.smithi050.stdout: "cap_revoke_eviction": 0, 2024-08-31T05:44:39.396 INFO:teuthology.orchestra.run.smithi050.stdout: "cap_acquisition_throttle": 0, 2024-08-31T05:44:39.396 INFO:teuthology.orchestra.run.smithi050.stdout: "req_getvxattr_latency": { 2024-08-31T05:44:39.396 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:39.396 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:39.396 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:39.396 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T05:44:39.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.397 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_sessions": { 2024-08-31T05:44:39.397 INFO:teuthology.orchestra.run.smithi050.stdout: "session_count": 2, 2024-08-31T05:44:39.397 INFO:teuthology.orchestra.run.smithi050.stdout: "session_add": 3, 2024-08-31T05:44:39.397 INFO:teuthology.orchestra.run.smithi050.stdout: "session_remove": 1, 2024-08-31T05:44:39.397 INFO:teuthology.orchestra.run.smithi050.stdout: "sessions_open": 2, 2024-08-31T05:44:39.397 INFO:teuthology.orchestra.run.smithi050.stdout: "sessions_stale": 0, 2024-08-31T05:44:39.397 INFO:teuthology.orchestra.run.smithi050.stdout: "total_load": 1, 2024-08-31T05:44:39.397 INFO:teuthology.orchestra.run.smithi050.stdout: "average_load": 1, 2024-08-31T05:44:39.398 INFO:teuthology.orchestra.run.smithi050.stdout: "avg_session_uptime": 840, 2024-08-31T05:44:39.398 INFO:teuthology.orchestra.run.smithi050.stdout: "mdthresh_evicted": 0 2024-08-31T05:44:39.398 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.398 INFO:teuthology.orchestra.run.smithi050.stdout: "mempool": { 2024-08-31T05:44:39.398 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_bytes": 0, 2024-08-31T05:44:39.398 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_items": 0, 2024-08-31T05:44:39.398 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T05:44:39.398 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_items": 0, 2024-08-31T05:44:39.398 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T05:44:39.399 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_items": 0, 2024-08-31T05:44:39.399 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T05:44:39.399 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T05:44:39.399 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T05:44:39.399 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T05:44:39.399 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T05:44:39.399 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_items": 0, 2024-08-31T05:44:39.399 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T05:44:39.400 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T05:44:39.400 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_bytes": 0, 2024-08-31T05:44:39.400 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_items": 0, 2024-08-31T05:44:39.400 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_bytes": 0, 2024-08-31T05:44:39.400 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_items": 0, 2024-08-31T05:44:39.400 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T05:44:39.400 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T05:44:39.400 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T05:44:39.401 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T05:44:39.401 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T05:44:39.401 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_items": 0, 2024-08-31T05:44:39.401 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_bytes": 0, 2024-08-31T05:44:39.401 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_items": 0, 2024-08-31T05:44:39.401 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T05:44:39.401 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T05:44:39.401 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_bytes": 0, 2024-08-31T05:44:39.402 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_items": 0, 2024-08-31T05:44:39.402 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_bytes": 0, 2024-08-31T05:44:39.402 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_items": 0, 2024-08-31T05:44:39.402 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T05:44:39.402 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_items": 0, 2024-08-31T05:44:39.402 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T05:44:39.402 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_items": 0, 2024-08-31T05:44:39.402 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_bytes": 286999, 2024-08-31T05:44:39.402 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_items": 233, 2024-08-31T05:44:39.403 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_bytes": 0, 2024-08-31T05:44:39.403 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_items": 0, 2024-08-31T05:44:39.403 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_bytes": 0, 2024-08-31T05:44:39.403 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_items": 0, 2024-08-31T05:44:39.403 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_bytes": 0, 2024-08-31T05:44:39.403 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_items": 0, 2024-08-31T05:44:39.403 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_bytes": 0, 2024-08-31T05:44:39.404 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_items": 0, 2024-08-31T05:44:39.404 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_bytes": 9736, 2024-08-31T05:44:39.404 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_items": 197, 2024-08-31T05:44:39.404 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T05:44:39.404 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_items": 0, 2024-08-31T05:44:39.404 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_bytes": 0, 2024-08-31T05:44:39.404 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_items": 0, 2024-08-31T05:44:39.404 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_bytes": 578087, 2024-08-31T05:44:39.405 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_items": 3797, 2024-08-31T05:44:39.405 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_bytes": 0, 2024-08-31T05:44:39.405 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_items": 0, 2024-08-31T05:44:39.405 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_bytes": 0, 2024-08-31T05:44:39.405 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_items": 0 2024-08-31T05:44:39.405 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.405 INFO:teuthology.orchestra.run.smithi050.stdout: "objecter": { 2024-08-31T05:44:39.405 INFO:teuthology.orchestra.run.smithi050.stdout: "op_active": 0, 2024-08-31T05:44:39.406 INFO:teuthology.orchestra.run.smithi050.stdout: "op_laggy": 0, 2024-08-31T05:44:39.406 INFO:teuthology.orchestra.run.smithi050.stdout: "op_send": 43, 2024-08-31T05:44:39.406 INFO:teuthology.orchestra.run.smithi050.stdout: "op_send_bytes": 12422, 2024-08-31T05:44:39.406 INFO:teuthology.orchestra.run.smithi050.stdout: "op_resend": 28, 2024-08-31T05:44:39.406 INFO:teuthology.orchestra.run.smithi050.stdout: "op_reply": 43, 2024-08-31T05:44:39.406 INFO:teuthology.orchestra.run.smithi050.stdout: "op_latency": { 2024-08-31T05:44:39.406 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 43, 2024-08-31T05:44:39.406 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.243993806, 2024-08-31T05:44:39.406 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.005674274 2024-08-31T05:44:39.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.407 INFO:teuthology.orchestra.run.smithi050.stdout: "op_inflight": 0, 2024-08-31T05:44:39.407 INFO:teuthology.orchestra.run.smithi050.stdout: "oplen_avg": { 2024-08-31T05:44:39.407 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 43, 2024-08-31T05:44:39.407 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 66 2024-08-31T05:44:39.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.407 INFO:teuthology.orchestra.run.smithi050.stdout: "op": 43, 2024-08-31T05:44:39.407 INFO:teuthology.orchestra.run.smithi050.stdout: "op_r": 0, 2024-08-31T05:44:39.408 INFO:teuthology.orchestra.run.smithi050.stdout: "op_w": 43, 2024-08-31T05:44:39.408 INFO:teuthology.orchestra.run.smithi050.stdout: "op_rmw": 0, 2024-08-31T05:44:39.408 INFO:teuthology.orchestra.run.smithi050.stdout: "op_pg": 0, 2024-08-31T05:44:39.408 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_stat": 0, 2024-08-31T05:44:39.408 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_create": 10, 2024-08-31T05:44:39.408 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_read": 0, 2024-08-31T05:44:39.408 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_write": 5, 2024-08-31T05:44:39.408 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_writefull": 8, 2024-08-31T05:44:39.408 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_writesame": 0, 2024-08-31T05:44:39.409 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_append": 0, 2024-08-31T05:44:39.409 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_zero": 0, 2024-08-31T05:44:39.409 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_truncate": 0, 2024-08-31T05:44:39.409 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_delete": 6, 2024-08-31T05:44:39.409 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_mapext": 0, 2024-08-31T05:44:39.409 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_sparse_read": 0, 2024-08-31T05:44:39.409 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_clonerange": 0, 2024-08-31T05:44:39.409 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_getxattr": 0, 2024-08-31T05:44:39.410 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_setxattr": 20, 2024-08-31T05:44:39.410 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_cmpxattr": 0, 2024-08-31T05:44:39.410 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_rmxattr": 0, 2024-08-31T05:44:39.410 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_resetxattrs": 0, 2024-08-31T05:44:39.410 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_call": 0, 2024-08-31T05:44:39.410 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_watch": 0, 2024-08-31T05:44:39.410 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_notify": 0, 2024-08-31T05:44:39.410 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_src_cmpxattr": 0, 2024-08-31T05:44:39.411 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_pgls": 0, 2024-08-31T05:44:39.411 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_pgls_filter": 0, 2024-08-31T05:44:39.411 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_other": 0, 2024-08-31T05:44:39.411 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_active": 0, 2024-08-31T05:44:39.411 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_send": 0, 2024-08-31T05:44:39.411 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_resend": 0, 2024-08-31T05:44:39.411 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_ping": 0, 2024-08-31T05:44:39.411 INFO:teuthology.orchestra.run.smithi050.stdout: "poolop_active": 0, 2024-08-31T05:44:39.412 INFO:teuthology.orchestra.run.smithi050.stdout: "poolop_send": 0, 2024-08-31T05:44:39.412 INFO:teuthology.orchestra.run.smithi050.stdout: "poolop_resend": 0, 2024-08-31T05:44:39.412 INFO:teuthology.orchestra.run.smithi050.stdout: "poolstat_active": 0, 2024-08-31T05:44:39.412 INFO:teuthology.orchestra.run.smithi050.stdout: "poolstat_send": 0, 2024-08-31T05:44:39.412 INFO:teuthology.orchestra.run.smithi050.stdout: "poolstat_resend": 0, 2024-08-31T05:44:39.412 INFO:teuthology.orchestra.run.smithi050.stdout: "statfs_active": 0, 2024-08-31T05:44:39.412 INFO:teuthology.orchestra.run.smithi050.stdout: "statfs_send": 0, 2024-08-31T05:44:39.412 INFO:teuthology.orchestra.run.smithi050.stdout: "statfs_resend": 0, 2024-08-31T05:44:39.413 INFO:teuthology.orchestra.run.smithi050.stdout: "command_active": 0, 2024-08-31T05:44:39.413 INFO:teuthology.orchestra.run.smithi050.stdout: "command_send": 0, 2024-08-31T05:44:39.413 INFO:teuthology.orchestra.run.smithi050.stdout: "command_resend": 0, 2024-08-31T05:44:39.413 INFO:teuthology.orchestra.run.smithi050.stdout: "map_epoch": 103, 2024-08-31T05:44:39.413 INFO:teuthology.orchestra.run.smithi050.stdout: "map_full": 0, 2024-08-31T05:44:39.413 INFO:teuthology.orchestra.run.smithi050.stdout: "map_inc": 18, 2024-08-31T05:44:39.413 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_sessions": 9, 2024-08-31T05:44:39.413 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_session_open": 13, 2024-08-31T05:44:39.414 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_session_close": 4, 2024-08-31T05:44:39.414 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_laggy": 0, 2024-08-31T05:44:39.414 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_wr": 16, 2024-08-31T05:44:39.414 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_rd": 0, 2024-08-31T05:44:39.414 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_del": 1 2024-08-31T05:44:39.414 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.414 INFO:teuthology.orchestra.run.smithi050.stdout: "oft": { 2024-08-31T05:44:39.414 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_objs": 1, 2024-08-31T05:44:39.415 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_kv_pairs": 0, 2024-08-31T05:44:39.415 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_updates": 0, 2024-08-31T05:44:39.415 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_removes": 0 2024-08-31T05:44:39.415 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.415 INFO:teuthology.orchestra.run.smithi050.stdout: "purge_queue": { 2024-08-31T05:44:39.415 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing_ops": 0, 2024-08-31T05:44:39.415 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing_ops_high_water": 0, 2024-08-31T05:44:39.415 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing": 0, 2024-08-31T05:44:39.416 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing_high_water": 0, 2024-08-31T05:44:39.416 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executed_ops": 0, 2024-08-31T05:44:39.416 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executed": 0, 2024-08-31T05:44:39.416 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_item_in_journal": 0 2024-08-31T05:44:39.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.416 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T05:44:39.416 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-08-31T05:44:39.416 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 104857600, 2024-08-31T05:44:39.417 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-08-31T05:44:39.417 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 303010, 2024-08-31T05:44:39.417 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 103014169, 2024-08-31T05:44:39.417 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-08-31T05:44:39.417 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 303010, 2024-08-31T05:44:39.417 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2024-08-31T05:44:39.417 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2024-08-31T05:44:39.417 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 303010, 2024-08-31T05:44:39.417 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 103014169, 2024-08-31T05:44:39.418 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-08-31T05:44:39.418 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:39.418 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:39.418 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:39.418 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T05:44:39.418 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.418 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-objecter_bytes": { 2024-08-31T05:44:39.418 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-08-31T05:44:39.419 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 104857600, 2024-08-31T05:44:39.419 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-08-31T05:44:39.419 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 0, 2024-08-31T05:44:39.419 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 0, 2024-08-31T05:44:39.419 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-08-31T05:44:39.419 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 0, 2024-08-31T05:44:39.419 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 43, 2024-08-31T05:44:39.419 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 12422, 2024-08-31T05:44:39.420 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 43, 2024-08-31T05:44:39.420 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 12422, 2024-08-31T05:44:39.420 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-08-31T05:44:39.420 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:39.420 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:39.420 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:39.420 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T05:44:39.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.420 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-objecter_ops": { 2024-08-31T05:44:39.421 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-08-31T05:44:39.421 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 1024, 2024-08-31T05:44:39.421 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-08-31T05:44:39.421 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 0, 2024-08-31T05:44:39.421 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 0, 2024-08-31T05:44:39.421 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-08-31T05:44:39.421 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 0, 2024-08-31T05:44:39.421 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 43, 2024-08-31T05:44:39.422 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 43, 2024-08-31T05:44:39.422 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 43, 2024-08-31T05:44:39.422 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 43, 2024-08-31T05:44:39.422 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-08-31T05:44:39.422 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:39.422 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:39.422 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:39.422 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T05:44:39.423 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.423 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-write_buf_throttle": { 2024-08-31T05:44:39.423 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-08-31T05:44:39.423 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 3758096384, 2024-08-31T05:44:39.423 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-08-31T05:44:39.423 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 0, 2024-08-31T05:44:39.423 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 0, 2024-08-31T05:44:39.423 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-08-31T05:44:39.423 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 0, 2024-08-31T05:44:39.424 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2024-08-31T05:44:39.424 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2024-08-31T05:44:39.424 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 0, 2024-08-31T05:44:39.424 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 0, 2024-08-31T05:44:39.424 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-08-31T05:44:39.424 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:39.424 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:39.424 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:39.425 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T05:44:39.425 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.425 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-write_buf_throttle-0x563174900750": { 2024-08-31T05:44:39.425 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-08-31T05:44:39.425 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 3758096384, 2024-08-31T05:44:39.425 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-08-31T05:44:39.425 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 6, 2024-08-31T05:44:39.425 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 1819, 2024-08-31T05:44:39.425 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-08-31T05:44:39.426 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 6, 2024-08-31T05:44:39.426 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2024-08-31T05:44:39.426 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2024-08-31T05:44:39.426 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 5, 2024-08-31T05:44:39.426 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 1819, 2024-08-31T05:44:39.426 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-08-31T05:44:39.426 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:39.426 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:39.427 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:39.427 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T05:44:39.427 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:39.427 INFO:teuthology.orchestra.run.smithi050.stdout: "trackedop": { 2024-08-31T05:44:39.427 INFO:teuthology.orchestra.run.smithi050.stdout: "slow_ops_count": 0 2024-08-31T05:44:39.427 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T05:44:39.427 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-08-31T05:44:39.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:44:39 smithi005 ceph-mon[18602]: pgmap v801: 129 pgs: 129 active+clean; 851 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 2.0 MiB/s wr, 104 op/s 2024-08-31T05:44:39.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:44:39 smithi070 ceph-mon[22316]: pgmap v801: 129 pgs: 129 active+clean; 851 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 2.0 MiB/s wr, 104 op/s 2024-08-31T05:44:40.190 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-08-31T05:44:40.191 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-08-31T05:44:40.191 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-08-31T05:44:40.191 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=416 2024-08-31T05:44:40.191 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=6 2024-08-31T05:44:40.191 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-08-31T05:44:40.191 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-08-31T05:44:40.191 DEBUG:tasks.check_counter:Getting stats from k 2024-08-31T05:44:40.192 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph daemon mds.k perf dump 2024-08-31T05:44:40.441 INFO:teuthology.orchestra.run.smithi050.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T05:44:40.990 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-08-31T05:44:40.990 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T05:44:40.990 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 1743, 2024-08-31T05:44:40.990 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 1745, 2024-08-31T05:44:40.990 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 512165855, 2024-08-31T05:44:40.991 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 554338, 2024-08-31T05:44:40.991 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 8, 2024-08-31T05:44:40.991 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 4, 2024-08-31T05:44:40.991 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.373249253, 2024-08-31T05:44:40.991 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.060983433, 2024-08-31T05:44:40.991 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.261420133, 2024-08-31T05:44:40.991 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.038359807, 2024-08-31T05:44:40.991 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T05:44:40.992 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 1743, 2024-08-31T05:44:40.992 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.045150265, 2024-08-31T05:44:40.992 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000025903 2024-08-31T05:44:40.992 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:40.992 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-08-31T05:44:40.992 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:40.992 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:40.992 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:40.993 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:40.993 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-31T05:44:40.993 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 0 2024-08-31T05:44:40.993 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:40.993 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T05:44:40.993 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 2144, 2024-08-31T05:44:40.993 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 2129, 2024-08-31T05:44:40.993 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 586387151, 2024-08-31T05:44:40.994 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 758989, 2024-08-31T05:44:40.994 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 6, 2024-08-31T05:44:40.994 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 5, 2024-08-31T05:44:40.994 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.483551400, 2024-08-31T05:44:40.994 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.076805773, 2024-08-31T05:44:40.994 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.367486427, 2024-08-31T05:44:40.994 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.039443383, 2024-08-31T05:44:40.995 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T05:44:40.995 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 2128, 2024-08-31T05:44:40.995 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.058216297, 2024-08-31T05:44:40.995 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000027357 2024-08-31T05:44:40.995 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:40.995 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-08-31T05:44:40.995 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:40.995 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:40.996 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:40.996 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:40.996 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 1239984, 2024-08-31T05:44:40.996 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 180224 2024-08-31T05:44:40.996 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:40.996 INFO:teuthology.orchestra.run.smithi050.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T05:44:40.996 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_messages": 1827, 2024-08-31T05:44:40.996 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages": 2041, 2024-08-31T05:44:40.997 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_bytes": 315119672, 2024-08-31T05:44:40.997 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_bytes": 1032324, 2024-08-31T05:44:40.997 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_created_connections": 6, 2024-08-31T05:44:40.997 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_active_connections": 5, 2024-08-31T05:44:40.997 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_total_time": 0.343726500, 2024-08-31T05:44:40.997 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_send_time": 0.087889877, 2024-08-31T05:44:40.997 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_recv_time": 0.192249905, 2024-08-31T05:44:40.997 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_running_fast_dispatch_time": 0.047898740, 2024-08-31T05:44:40.998 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T05:44:40.998 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 2040, 2024-08-31T05:44:40.998 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.069081123, 2024-08-31T05:44:40.998 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000033863 2024-08-31T05:44:40.998 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:40.998 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_handle_ack_lat": { 2024-08-31T05:44:40.998 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:40.998 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:40.999 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:40.999 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:40.999 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_recv_encrypted_bytes": 3200, 2024-08-31T05:44:40.999 INFO:teuthology.orchestra.run.smithi050.stdout: "msgr_send_encrypted_bytes": 452928 2024-08-31T05:44:40.999 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:40.999 INFO:teuthology.orchestra.run.smithi050.stdout: "cct": { 2024-08-31T05:44:40.999 INFO:teuthology.orchestra.run.smithi050.stdout: "total_workers": 1, 2024-08-31T05:44:40.999 INFO:teuthology.orchestra.run.smithi050.stdout: "unhealthy_workers": 0 2024-08-31T05:44:41.000 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:41.000 INFO:teuthology.orchestra.run.smithi050.stdout: "finisher-MDSRank": { 2024-08-31T05:44:41.000 INFO:teuthology.orchestra.run.smithi050.stdout: "queue_len": 0, 2024-08-31T05:44:41.000 INFO:teuthology.orchestra.run.smithi050.stdout: "complete_latency": { 2024-08-31T05:44:41.000 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 8005, 2024-08-31T05:44:41.000 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.260809016, 2024-08-31T05:44:41.000 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000032580 2024-08-31T05:44:41.000 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T05:44:41.000 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:41.001 INFO:teuthology.orchestra.run.smithi050.stdout: "finisher-PurgeQueue": { 2024-08-31T05:44:41.001 INFO:teuthology.orchestra.run.smithi050.stdout: "queue_len": 0, 2024-08-31T05:44:41.001 INFO:teuthology.orchestra.run.smithi050.stdout: "complete_latency": { 2024-08-31T05:44:41.001 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:41.001 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:41.001 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:41.001 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T05:44:41.001 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:41.002 INFO:teuthology.orchestra.run.smithi050.stdout: "mds": { 2024-08-31T05:44:41.002 INFO:teuthology.orchestra.run.smithi050.stdout: "request": 0, 2024-08-31T05:44:41.002 INFO:teuthology.orchestra.run.smithi050.stdout: "reply": 0, 2024-08-31T05:44:41.002 INFO:teuthology.orchestra.run.smithi050.stdout: "reply_latency": { 2024-08-31T05:44:41.002 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:41.002 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:41.002 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:41.002 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:41.003 INFO:teuthology.orchestra.run.smithi050.stdout: "slow_reply": 0, 2024-08-31T05:44:41.003 INFO:teuthology.orchestra.run.smithi050.stdout: "forward": 0, 2024-08-31T05:44:41.003 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_fetch_complete": 0, 2024-08-31T05:44:41.003 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_fetch_keys": 0, 2024-08-31T05:44:41.003 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_commit": 0, 2024-08-31T05:44:41.003 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_split": 0, 2024-08-31T05:44:41.004 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_merge": 0, 2024-08-31T05:44:41.004 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes": 58401, 2024-08-31T05:44:41.004 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_top": 28205, 2024-08-31T05:44:41.004 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_bottom": 30196, 2024-08-31T05:44:41.004 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_pin_tail": 0, 2024-08-31T05:44:41.004 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_pinned": 18109, 2024-08-31T05:44:41.004 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_expired": 0, 2024-08-31T05:44:41.004 INFO:teuthology.orchestra.run.smithi050.stdout: "inodes_with_caps": 0, 2024-08-31T05:44:41.005 INFO:teuthology.orchestra.run.smithi050.stdout: "caps": 0, 2024-08-31T05:44:41.005 INFO:teuthology.orchestra.run.smithi050.stdout: "subtrees": 12, 2024-08-31T05:44:41.005 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse": 0, 2024-08-31T05:44:41.005 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_hit": 0, 2024-08-31T05:44:41.005 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_forward": 0, 2024-08-31T05:44:41.005 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_discover": 0, 2024-08-31T05:44:41.005 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_dir_fetch": 0, 2024-08-31T05:44:41.005 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_remote_ino": 0, 2024-08-31T05:44:41.006 INFO:teuthology.orchestra.run.smithi050.stdout: "traverse_lock": 0, 2024-08-31T05:44:41.006 INFO:teuthology.orchestra.run.smithi050.stdout: "load_cent": 0, 2024-08-31T05:44:41.006 INFO:teuthology.orchestra.run.smithi050.stdout: "q": 0, 2024-08-31T05:44:41.006 INFO:teuthology.orchestra.run.smithi050.stdout: "exported": 0, 2024-08-31T05:44:41.006 INFO:teuthology.orchestra.run.smithi050.stdout: "exported_inodes": 0, 2024-08-31T05:44:41.006 INFO:teuthology.orchestra.run.smithi050.stdout: "imported": 0, 2024-08-31T05:44:41.007 INFO:teuthology.orchestra.run.smithi050.stdout: "imported_inodes": 0, 2024-08-31T05:44:41.007 INFO:teuthology.orchestra.run.smithi050.stdout: "openino_dir_fetch": 0, 2024-08-31T05:44:41.007 INFO:teuthology.orchestra.run.smithi050.stdout: "openino_backtrace_fetch": 0, 2024-08-31T05:44:41.007 INFO:teuthology.orchestra.run.smithi050.stdout: "openino_peer_discover": 0, 2024-08-31T05:44:41.007 INFO:teuthology.orchestra.run.smithi050.stdout: "root_rfiles": 0, 2024-08-31T05:44:41.007 INFO:teuthology.orchestra.run.smithi050.stdout: "root_rbytes": 0, 2024-08-31T05:44:41.007 INFO:teuthology.orchestra.run.smithi050.stdout: "root_rsnaps": 0, 2024-08-31T05:44:41.007 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_backtrace_fetch": 0, 2024-08-31T05:44:41.007 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_set_tag": 0, 2024-08-31T05:44:41.008 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_backtrace_repaired": 0, 2024-08-31T05:44:41.008 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_inotable_repaired": 0, 2024-08-31T05:44:41.008 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_dir_inodes": 0, 2024-08-31T05:44:41.008 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_dir_base_inodes": 0, 2024-08-31T05:44:41.008 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_dirfrag_rstats": 0, 2024-08-31T05:44:41.009 INFO:teuthology.orchestra.run.smithi050.stdout: "scrub_file_inodes": 0, 2024-08-31T05:44:41.009 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_inode_file_caps": 0, 2024-08-31T05:44:41.009 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_revoke": 0, 2024-08-31T05:44:41.009 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_grant": 0, 2024-08-31T05:44:41.009 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_trunc": 0, 2024-08-31T05:44:41.009 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-31T05:44:41.009 INFO:teuthology.orchestra.run.smithi050.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-31T05:44:41.010 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_caps": 0, 2024-08-31T05:44:41.010 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_caps_dirty": 0, 2024-08-31T05:44:41.010 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_cap_release": 0, 2024-08-31T05:44:41.010 INFO:teuthology.orchestra.run.smithi050.stdout: "process_request_cap_release": 0 2024-08-31T05:44:41.010 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:41.010 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_cache": { 2024-08-31T05:44:41.010 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_update": 0, 2024-08-31T05:44:41.010 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_update_receipt": 0, 2024-08-31T05:44:41.011 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_try_discover": 0, 2024-08-31T05:44:41.011 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_send_discover": 0, 2024-08-31T05:44:41.011 INFO:teuthology.orchestra.run.smithi050.stdout: "dir_handle_discover": 0, 2024-08-31T05:44:41.011 INFO:teuthology.orchestra.run.smithi050.stdout: "num_strays": 0, 2024-08-31T05:44:41.011 INFO:teuthology.orchestra.run.smithi050.stdout: "num_strays_delayed": 0, 2024-08-31T05:44:41.011 INFO:teuthology.orchestra.run.smithi050.stdout: "num_strays_enqueuing": 0, 2024-08-31T05:44:41.011 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_created": 0, 2024-08-31T05:44:41.011 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_enqueued": 0, 2024-08-31T05:44:41.012 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_reintegrated": 0, 2024-08-31T05:44:41.012 INFO:teuthology.orchestra.run.smithi050.stdout: "strays_migrated": 0, 2024-08-31T05:44:41.012 INFO:teuthology.orchestra.run.smithi050.stdout: "num_recovering_processing": 0, 2024-08-31T05:44:41.012 INFO:teuthology.orchestra.run.smithi050.stdout: "num_recovering_enqueued": 0, 2024-08-31T05:44:41.012 INFO:teuthology.orchestra.run.smithi050.stdout: "num_recovering_prioritized": 0, 2024-08-31T05:44:41.012 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_started": 0, 2024-08-31T05:44:41.012 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_completed": 0, 2024-08-31T05:44:41.012 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_quiesce_path": 0, 2024-08-31T05:44:41.013 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_quiesce_inode": 0, 2024-08-31T05:44:41.013 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_enqueue_scrub": 0, 2024-08-31T05:44:41.013 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_exportdir": 0, 2024-08-31T05:44:41.013 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_flush": 0, 2024-08-31T05:44:41.013 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_fragmentdir": 0, 2024-08-31T05:44:41.013 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_fragstats": 0, 2024-08-31T05:44:41.013 INFO:teuthology.orchestra.run.smithi050.stdout: "ireq_inodestats": 0, 2024-08-31T05:44:41.013 INFO:teuthology.orchestra.run.smithi050.stdout: "uninline_started": 0, 2024-08-31T05:44:41.013 INFO:teuthology.orchestra.run.smithi050.stdout: "uninline_succeeded": 0, 2024-08-31T05:44:41.014 INFO:teuthology.orchestra.run.smithi050.stdout: "uninline_write_failed": 0 2024-08-31T05:44:41.014 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:41.014 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_log": { 2024-08-31T05:44:41.014 INFO:teuthology.orchestra.run.smithi050.stdout: "evlrg": 0, 2024-08-31T05:44:41.014 INFO:teuthology.orchestra.run.smithi050.stdout: "evadd": 0, 2024-08-31T05:44:41.014 INFO:teuthology.orchestra.run.smithi050.stdout: "evex": 0, 2024-08-31T05:44:41.014 INFO:teuthology.orchestra.run.smithi050.stdout: "evtrm": 0, 2024-08-31T05:44:41.014 INFO:teuthology.orchestra.run.smithi050.stdout: "ev": 260131, 2024-08-31T05:44:41.015 INFO:teuthology.orchestra.run.smithi050.stdout: "evexg": 0, 2024-08-31T05:44:41.015 INFO:teuthology.orchestra.run.smithi050.stdout: "evexd": 0, 2024-08-31T05:44:41.015 INFO:teuthology.orchestra.run.smithi050.stdout: "segadd": 0, 2024-08-31T05:44:41.015 INFO:teuthology.orchestra.run.smithi050.stdout: "segex": 0, 2024-08-31T05:44:41.015 INFO:teuthology.orchestra.run.smithi050.stdout: "segtrm": 0, 2024-08-31T05:44:41.015 INFO:teuthology.orchestra.run.smithi050.stdout: "seg": 144, 2024-08-31T05:44:41.015 INFO:teuthology.orchestra.run.smithi050.stdout: "segmjr": 23, 2024-08-31T05:44:41.015 INFO:teuthology.orchestra.run.smithi050.stdout: "segexg": 0, 2024-08-31T05:44:41.015 INFO:teuthology.orchestra.run.smithi050.stdout: "segexd": 0, 2024-08-31T05:44:41.016 INFO:teuthology.orchestra.run.smithi050.stdout: "expos": 850315982, 2024-08-31T05:44:41.016 INFO:teuthology.orchestra.run.smithi050.stdout: "wrpos": 1415151745, 2024-08-31T05:44:41.016 INFO:teuthology.orchestra.run.smithi050.stdout: "rdpos": 1415148631, 2024-08-31T05:44:41.016 INFO:teuthology.orchestra.run.smithi050.stdout: "jlat": { 2024-08-31T05:44:41.016 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:41.016 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:41.016 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:41.016 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:41.017 INFO:teuthology.orchestra.run.smithi050.stdout: "replayed": 260131 2024-08-31T05:44:41.017 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:41.017 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_mem": { 2024-08-31T05:44:41.017 INFO:teuthology.orchestra.run.smithi050.stdout: "ino": 1924, 2024-08-31T05:44:41.017 INFO:teuthology.orchestra.run.smithi050.stdout: "ino+": 58003, 2024-08-31T05:44:41.017 INFO:teuthology.orchestra.run.smithi050.stdout: "ino-": 56079, 2024-08-31T05:44:41.017 INFO:teuthology.orchestra.run.smithi050.stdout: "dir": 164, 2024-08-31T05:44:41.017 INFO:teuthology.orchestra.run.smithi050.stdout: "dir+": 353, 2024-08-31T05:44:41.018 INFO:teuthology.orchestra.run.smithi050.stdout: "dir-": 189, 2024-08-31T05:44:41.018 INFO:teuthology.orchestra.run.smithi050.stdout: "dn": 58401, 2024-08-31T05:44:41.018 INFO:teuthology.orchestra.run.smithi050.stdout: "dn+": 58573, 2024-08-31T05:44:41.018 INFO:teuthology.orchestra.run.smithi050.stdout: "dn-": 172, 2024-08-31T05:44:41.018 INFO:teuthology.orchestra.run.smithi050.stdout: "cap": 0, 2024-08-31T05:44:41.018 INFO:teuthology.orchestra.run.smithi050.stdout: "cap+": 0, 2024-08-31T05:44:41.018 INFO:teuthology.orchestra.run.smithi050.stdout: "cap-": 0, 2024-08-31T05:44:41.018 INFO:teuthology.orchestra.run.smithi050.stdout: "rss": 179176, 2024-08-31T05:44:41.019 INFO:teuthology.orchestra.run.smithi050.stdout: "heap": 394760192 2024-08-31T05:44:41.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:41.019 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_server": { 2024-08-31T05:44:41.019 INFO:teuthology.orchestra.run.smithi050.stdout: "dispatch_client_request": 0, 2024-08-31T05:44:41.019 INFO:teuthology.orchestra.run.smithi050.stdout: "dispatch_server_request": 0, 2024-08-31T05:44:41.019 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_request": 0, 2024-08-31T05:44:41.019 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_client_session": 0, 2024-08-31T05:44:41.019 INFO:teuthology.orchestra.run.smithi050.stdout: "handle_peer_request": 0, 2024-08-31T05:44:41.020 INFO:teuthology.orchestra.run.smithi050.stdout: "req_create_latency": { 2024-08-31T05:44:41.020 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:41.020 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:41.020 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:41.020 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:41.020 INFO:teuthology.orchestra.run.smithi050.stdout: "req_getattr_latency": { 2024-08-31T05:44:41.020 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:41.020 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:41.021 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:41.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:41.021 INFO:teuthology.orchestra.run.smithi050.stdout: "req_getfilelock_latency": { 2024-08-31T05:44:41.021 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:41.021 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:41.021 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:41.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:41.021 INFO:teuthology.orchestra.run.smithi050.stdout: "req_link_latency": { 2024-08-31T05:44:41.022 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:41.022 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:41.022 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:41.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:41.022 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookup_latency": { 2024-08-31T05:44:41.022 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:41.022 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:41.022 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:41.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:41.023 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookuphash_latency": { 2024-08-31T05:44:41.023 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:41.023 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:41.023 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:41.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:41.023 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupino_latency": { 2024-08-31T05:44:41.023 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:41.023 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:41.024 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:41.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:41.024 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupname_latency": { 2024-08-31T05:44:41.024 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:41.024 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:41.024 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:41.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:41.024 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupparent_latency": { 2024-08-31T05:44:41.025 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:41.025 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:41.025 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:41.025 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:41.025 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lookupsnap_latency": { 2024-08-31T05:44:41.025 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:41.025 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:41.025 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:41.026 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:41.027 INFO:teuthology.orchestra.run.smithi050.stdout: "req_lssnap_latency": { 2024-08-31T05:44:41.027 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:41.027 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:41.027 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:41.027 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:41.027 INFO:teuthology.orchestra.run.smithi050.stdout: "req_mkdir_latency": { 2024-08-31T05:44:41.027 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:41.028 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:41.028 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:41.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:41.028 INFO:teuthology.orchestra.run.smithi050.stdout: "req_mknod_latency": { 2024-08-31T05:44:41.028 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:41.028 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:41.028 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:41.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:41.029 INFO:teuthology.orchestra.run.smithi050.stdout: "req_mksnap_latency": { 2024-08-31T05:44:41.029 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:41.029 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:41.029 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:41.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:41.029 INFO:teuthology.orchestra.run.smithi050.stdout: "req_open_latency": { 2024-08-31T05:44:41.029 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:41.029 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:41.030 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:41.030 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:41.030 INFO:teuthology.orchestra.run.smithi050.stdout: "req_readdir_latency": { 2024-08-31T05:44:41.030 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:41.030 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:41.030 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:41.030 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:41.030 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rename_latency": { 2024-08-31T05:44:41.031 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:41.031 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:41.031 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:41.031 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:41.031 INFO:teuthology.orchestra.run.smithi050.stdout: "req_renamesnap_latency": { 2024-08-31T05:44:41.031 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:41.031 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:41.031 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:41.032 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:41.032 INFO:teuthology.orchestra.run.smithi050.stdout: "req_snapdiff_latency": { 2024-08-31T05:44:41.032 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:41.032 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:41.032 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:41.032 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:41.032 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rmdir_latency": { 2024-08-31T05:44:41.032 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:41.033 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:41.033 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:41.033 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:41.033 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rmsnap_latency": { 2024-08-31T05:44:41.033 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:41.033 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:41.033 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:41.033 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:41.034 INFO:teuthology.orchestra.run.smithi050.stdout: "req_rmxattr_latency": { 2024-08-31T05:44:41.034 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:41.034 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:41.034 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:41.034 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:41.034 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setattr_latency": { 2024-08-31T05:44:41.034 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:41.034 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:41.035 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:41.035 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:41.035 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setdirlayout_latency": { 2024-08-31T05:44:41.035 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:41.035 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:41.035 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:41.035 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:41.035 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setfilelock_latency": { 2024-08-31T05:44:41.035 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:41.036 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:41.036 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:41.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:41.036 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setlayout_latency": { 2024-08-31T05:44:41.036 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:41.036 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:41.036 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:41.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:41.037 INFO:teuthology.orchestra.run.smithi050.stdout: "req_setxattr_latency": { 2024-08-31T05:44:41.037 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:41.037 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:41.037 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:41.037 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:41.037 INFO:teuthology.orchestra.run.smithi050.stdout: "req_symlink_latency": { 2024-08-31T05:44:41.037 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:41.037 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:41.038 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:41.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:41.038 INFO:teuthology.orchestra.run.smithi050.stdout: "req_unlink_latency": { 2024-08-31T05:44:41.038 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:41.038 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:41.038 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:41.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:41.038 INFO:teuthology.orchestra.run.smithi050.stdout: "cap_revoke_eviction": 0, 2024-08-31T05:44:41.039 INFO:teuthology.orchestra.run.smithi050.stdout: "cap_acquisition_throttle": 0, 2024-08-31T05:44:41.039 INFO:teuthology.orchestra.run.smithi050.stdout: "req_getvxattr_latency": { 2024-08-31T05:44:41.039 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:41.039 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:41.039 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:41.039 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T05:44:41.039 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:41.039 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_sessions": { 2024-08-31T05:44:41.039 INFO:teuthology.orchestra.run.smithi050.stdout: "session_count": 2, 2024-08-31T05:44:41.040 INFO:teuthology.orchestra.run.smithi050.stdout: "session_add": 2, 2024-08-31T05:44:41.040 INFO:teuthology.orchestra.run.smithi050.stdout: "session_remove": 0, 2024-08-31T05:44:41.040 INFO:teuthology.orchestra.run.smithi050.stdout: "sessions_open": 2, 2024-08-31T05:44:41.040 INFO:teuthology.orchestra.run.smithi050.stdout: "sessions_stale": 0, 2024-08-31T05:44:41.040 INFO:teuthology.orchestra.run.smithi050.stdout: "total_load": 0, 2024-08-31T05:44:41.040 INFO:teuthology.orchestra.run.smithi050.stdout: "average_load": 0, 2024-08-31T05:44:41.040 INFO:teuthology.orchestra.run.smithi050.stdout: "avg_session_uptime": 1926, 2024-08-31T05:44:41.040 INFO:teuthology.orchestra.run.smithi050.stdout: "mdthresh_evicted": 0 2024-08-31T05:44:41.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:41.041 INFO:teuthology.orchestra.run.smithi050.stdout: "mempool": { 2024-08-31T05:44:41.044 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_bytes": 0, 2024-08-31T05:44:41.044 INFO:teuthology.orchestra.run.smithi050.stdout: "bloom_filter_items": 0, 2024-08-31T05:44:41.044 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T05:44:41.044 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_items": 0, 2024-08-31T05:44:41.045 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T05:44:41.045 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_data_items": 0, 2024-08-31T05:44:41.045 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T05:44:41.045 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T05:44:41.045 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T05:44:41.045 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T05:44:41.045 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T05:44:41.045 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_other_items": 0, 2024-08-31T05:44:41.046 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T05:44:41.046 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T05:44:41.046 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_bytes": 0, 2024-08-31T05:44:41.046 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_items": 0, 2024-08-31T05:44:41.046 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_bytes": 0, 2024-08-31T05:44:41.046 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blob_items": 0, 2024-08-31T05:44:41.046 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T05:44:41.046 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T05:44:41.046 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T05:44:41.047 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T05:44:41.047 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T05:44:41.047 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_items": 0, 2024-08-31T05:44:41.047 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_bytes": 0, 2024-08-31T05:44:41.047 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_txc_items": 0, 2024-08-31T05:44:41.048 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T05:44:41.048 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T05:44:41.048 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_bytes": 0, 2024-08-31T05:44:41.048 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_writing_items": 0, 2024-08-31T05:44:41.048 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_bytes": 0, 2024-08-31T05:44:41.048 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_items": 0, 2024-08-31T05:44:41.048 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T05:44:41.048 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_reader_items": 0, 2024-08-31T05:44:41.049 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T05:44:41.049 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_file_writer_items": 0, 2024-08-31T05:44:41.049 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_bytes": 778176, 2024-08-31T05:44:41.049 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_anon_items": 2342, 2024-08-31T05:44:41.049 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_bytes": 88, 2024-08-31T05:44:41.049 INFO:teuthology.orchestra.run.smithi050.stdout: "buffer_meta_items": 1, 2024-08-31T05:44:41.049 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_bytes": 0, 2024-08-31T05:44:41.049 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_items": 0, 2024-08-31T05:44:41.049 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_bytes": 0, 2024-08-31T05:44:41.050 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mapbl_items": 0, 2024-08-31T05:44:41.050 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_bytes": 0, 2024-08-31T05:44:41.050 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pglog_items": 0, 2024-08-31T05:44:41.050 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_bytes": 9736, 2024-08-31T05:44:41.050 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_items": 197, 2024-08-31T05:44:41.050 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T05:44:41.050 INFO:teuthology.orchestra.run.smithi050.stdout: "osdmap_mapping_items": 0, 2024-08-31T05:44:41.050 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_bytes": 0, 2024-08-31T05:44:41.051 INFO:teuthology.orchestra.run.smithi050.stdout: "pgmap_items": 0, 2024-08-31T05:44:41.051 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_bytes": 45070786, 2024-08-31T05:44:41.051 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_co_items": 323669, 2024-08-31T05:44:41.051 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_bytes": 0, 2024-08-31T05:44:41.051 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_1_items": 0, 2024-08-31T05:44:41.051 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_bytes": 0, 2024-08-31T05:44:41.051 INFO:teuthology.orchestra.run.smithi050.stdout: "unittest_2_items": 0 2024-08-31T05:44:41.051 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:41.051 INFO:teuthology.orchestra.run.smithi050.stdout: "objecter": { 2024-08-31T05:44:41.052 INFO:teuthology.orchestra.run.smithi050.stdout: "op_active": 0, 2024-08-31T05:44:41.052 INFO:teuthology.orchestra.run.smithi050.stdout: "op_laggy": 0, 2024-08-31T05:44:41.052 INFO:teuthology.orchestra.run.smithi050.stdout: "op_send": 5385, 2024-08-31T05:44:41.052 INFO:teuthology.orchestra.run.smithi050.stdout: "op_send_bytes": 21, 2024-08-31T05:44:41.052 INFO:teuthology.orchestra.run.smithi050.stdout: "op_resend": 3, 2024-08-31T05:44:41.052 INFO:teuthology.orchestra.run.smithi050.stdout: "op_reply": 5385, 2024-08-31T05:44:41.052 INFO:teuthology.orchestra.run.smithi050.stdout: "op_latency": { 2024-08-31T05:44:41.052 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 5385, 2024-08-31T05:44:41.053 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 7.108821775, 2024-08-31T05:44:41.053 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.001320115 2024-08-31T05:44:41.053 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:41.053 INFO:teuthology.orchestra.run.smithi050.stdout: "op_inflight": 0, 2024-08-31T05:44:41.053 INFO:teuthology.orchestra.run.smithi050.stdout: "oplen_avg": { 2024-08-31T05:44:41.053 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 5385, 2024-08-31T05:44:41.053 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 5386 2024-08-31T05:44:41.053 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:41.054 INFO:teuthology.orchestra.run.smithi050.stdout: "op": 5385, 2024-08-31T05:44:41.054 INFO:teuthology.orchestra.run.smithi050.stdout: "op_r": 5385, 2024-08-31T05:44:41.054 INFO:teuthology.orchestra.run.smithi050.stdout: "op_w": 0, 2024-08-31T05:44:41.054 INFO:teuthology.orchestra.run.smithi050.stdout: "op_rmw": 0, 2024-08-31T05:44:41.054 INFO:teuthology.orchestra.run.smithi050.stdout: "op_pg": 0, 2024-08-31T05:44:41.054 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_stat": 3341, 2024-08-31T05:44:41.054 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_create": 0, 2024-08-31T05:44:41.054 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_read": 2042, 2024-08-31T05:44:41.055 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_write": 0, 2024-08-31T05:44:41.055 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_writefull": 0, 2024-08-31T05:44:41.055 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_writesame": 0, 2024-08-31T05:44:41.055 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_append": 0, 2024-08-31T05:44:41.055 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_zero": 0, 2024-08-31T05:44:41.055 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_truncate": 0, 2024-08-31T05:44:41.055 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_delete": 0, 2024-08-31T05:44:41.055 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_mapext": 0, 2024-08-31T05:44:41.055 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_sparse_read": 0, 2024-08-31T05:44:41.056 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_clonerange": 0, 2024-08-31T05:44:41.056 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_getxattr": 1, 2024-08-31T05:44:41.056 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_setxattr": 0, 2024-08-31T05:44:41.056 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_cmpxattr": 0, 2024-08-31T05:44:41.056 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_rmxattr": 0, 2024-08-31T05:44:41.056 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_resetxattrs": 0, 2024-08-31T05:44:41.056 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_call": 0, 2024-08-31T05:44:41.056 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_watch": 0, 2024-08-31T05:44:41.057 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_notify": 0, 2024-08-31T05:44:41.057 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_src_cmpxattr": 0, 2024-08-31T05:44:41.057 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_pgls": 0, 2024-08-31T05:44:41.057 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_pgls_filter": 0, 2024-08-31T05:44:41.057 INFO:teuthology.orchestra.run.smithi050.stdout: "osdop_other": 0, 2024-08-31T05:44:41.057 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_active": 0, 2024-08-31T05:44:41.057 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_send": 0, 2024-08-31T05:44:41.057 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_resend": 0, 2024-08-31T05:44:41.058 INFO:teuthology.orchestra.run.smithi050.stdout: "linger_ping": 0, 2024-08-31T05:44:41.058 INFO:teuthology.orchestra.run.smithi050.stdout: "poolop_active": 0, 2024-08-31T05:44:41.058 INFO:teuthology.orchestra.run.smithi050.stdout: "poolop_send": 0, 2024-08-31T05:44:41.058 INFO:teuthology.orchestra.run.smithi050.stdout: "poolop_resend": 0, 2024-08-31T05:44:41.058 INFO:teuthology.orchestra.run.smithi050.stdout: "poolstat_active": 0, 2024-08-31T05:44:41.058 INFO:teuthology.orchestra.run.smithi050.stdout: "poolstat_send": 0, 2024-08-31T05:44:41.058 INFO:teuthology.orchestra.run.smithi050.stdout: "poolstat_resend": 0, 2024-08-31T05:44:41.059 INFO:teuthology.orchestra.run.smithi050.stdout: "statfs_active": 0, 2024-08-31T05:44:41.059 INFO:teuthology.orchestra.run.smithi050.stdout: "statfs_send": 0, 2024-08-31T05:44:41.059 INFO:teuthology.orchestra.run.smithi050.stdout: "statfs_resend": 0, 2024-08-31T05:44:41.059 INFO:teuthology.orchestra.run.smithi050.stdout: "command_active": 0, 2024-08-31T05:44:41.059 INFO:teuthology.orchestra.run.smithi050.stdout: "command_send": 0, 2024-08-31T05:44:41.059 INFO:teuthology.orchestra.run.smithi050.stdout: "command_resend": 0, 2024-08-31T05:44:41.059 INFO:teuthology.orchestra.run.smithi050.stdout: "map_epoch": 103, 2024-08-31T05:44:41.060 INFO:teuthology.orchestra.run.smithi050.stdout: "map_full": 0, 2024-08-31T05:44:41.060 INFO:teuthology.orchestra.run.smithi050.stdout: "map_inc": 18, 2024-08-31T05:44:41.060 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_sessions": 11, 2024-08-31T05:44:41.060 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_session_open": 11, 2024-08-31T05:44:41.060 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_session_close": 0, 2024-08-31T05:44:41.060 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_laggy": 0, 2024-08-31T05:44:41.061 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_wr": 0, 2024-08-31T05:44:41.061 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_rd": 2, 2024-08-31T05:44:41.061 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_del": 0 2024-08-31T05:44:41.061 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:41.061 INFO:teuthology.orchestra.run.smithi050.stdout: "oft": { 2024-08-31T05:44:41.061 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_objs": 0, 2024-08-31T05:44:41.062 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_kv_pairs": 0, 2024-08-31T05:44:41.062 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_updates": 0, 2024-08-31T05:44:41.062 INFO:teuthology.orchestra.run.smithi050.stdout: "omap_total_removes": 0 2024-08-31T05:44:41.062 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:41.062 INFO:teuthology.orchestra.run.smithi050.stdout: "purge_queue": { 2024-08-31T05:44:41.062 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing_ops": 0, 2024-08-31T05:44:41.062 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing_ops_high_water": 0, 2024-08-31T05:44:41.062 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing": 0, 2024-08-31T05:44:41.063 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executing_high_water": 0, 2024-08-31T05:44:41.063 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executed_ops": 0, 2024-08-31T05:44:41.063 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_executed": 0, 2024-08-31T05:44:41.063 INFO:teuthology.orchestra.run.smithi050.stdout: "pq_item_in_journal": 0 2024-08-31T05:44:41.063 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:41.063 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T05:44:41.063 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-08-31T05:44:41.063 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 104857600, 2024-08-31T05:44:41.063 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-08-31T05:44:41.064 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 5710, 2024-08-31T05:44:41.064 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 1413139153, 2024-08-31T05:44:41.064 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-08-31T05:44:41.064 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 5710, 2024-08-31T05:44:41.064 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2024-08-31T05:44:41.064 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2024-08-31T05:44:41.064 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 5710, 2024-08-31T05:44:41.065 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 1413139153, 2024-08-31T05:44:41.065 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-08-31T05:44:41.065 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:41.065 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:41.065 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:41.065 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T05:44:41.065 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:41.065 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-objecter_bytes": { 2024-08-31T05:44:41.066 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-08-31T05:44:41.066 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 104857600, 2024-08-31T05:44:41.066 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-08-31T05:44:41.066 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 0, 2024-08-31T05:44:41.066 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 0, 2024-08-31T05:44:41.066 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-08-31T05:44:41.066 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 0, 2024-08-31T05:44:41.066 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 5385, 2024-08-31T05:44:41.067 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 1410967580, 2024-08-31T05:44:41.067 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 5385, 2024-08-31T05:44:41.067 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 1410967580, 2024-08-31T05:44:41.067 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-08-31T05:44:41.067 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:41.067 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:41.067 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:41.067 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T05:44:41.068 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:41.068 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-objecter_ops": { 2024-08-31T05:44:41.068 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-08-31T05:44:41.068 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 1024, 2024-08-31T05:44:41.068 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-08-31T05:44:41.068 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 0, 2024-08-31T05:44:41.068 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 0, 2024-08-31T05:44:41.068 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-08-31T05:44:41.069 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 0, 2024-08-31T05:44:41.069 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 5385, 2024-08-31T05:44:41.069 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 5385, 2024-08-31T05:44:41.069 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 5385, 2024-08-31T05:44:41.069 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 5385, 2024-08-31T05:44:41.069 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-08-31T05:44:41.069 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:41.069 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:41.070 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:41.070 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T05:44:41.070 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:41.070 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-write_buf_throttle": { 2024-08-31T05:44:41.070 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-08-31T05:44:41.070 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 3758096384, 2024-08-31T05:44:41.070 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-08-31T05:44:41.070 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 0, 2024-08-31T05:44:41.071 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 0, 2024-08-31T05:44:41.071 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-08-31T05:44:41.071 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 0, 2024-08-31T05:44:41.071 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2024-08-31T05:44:41.071 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2024-08-31T05:44:41.071 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 0, 2024-08-31T05:44:41.071 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 0, 2024-08-31T05:44:41.071 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-08-31T05:44:41.071 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:41.072 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:41.072 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:41.072 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T05:44:41.072 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:41.072 INFO:teuthology.orchestra.run.smithi050.stdout: "throttle-write_buf_throttle-0x5581afbc4c30": { 2024-08-31T05:44:41.072 INFO:teuthology.orchestra.run.smithi050.stdout: "val": 0, 2024-08-31T05:44:41.072 INFO:teuthology.orchestra.run.smithi050.stdout: "max": 3758096384, 2024-08-31T05:44:41.072 INFO:teuthology.orchestra.run.smithi050.stdout: "get_started": 0, 2024-08-31T05:44:41.073 INFO:teuthology.orchestra.run.smithi050.stdout: "get": 0, 2024-08-31T05:44:41.073 INFO:teuthology.orchestra.run.smithi050.stdout: "get_sum": 0, 2024-08-31T05:44:41.073 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_fail": 0, 2024-08-31T05:44:41.073 INFO:teuthology.orchestra.run.smithi050.stdout: "get_or_fail_success": 0, 2024-08-31T05:44:41.073 INFO:teuthology.orchestra.run.smithi050.stdout: "take": 0, 2024-08-31T05:44:41.073 INFO:teuthology.orchestra.run.smithi050.stdout: "take_sum": 0, 2024-08-31T05:44:41.073 INFO:teuthology.orchestra.run.smithi050.stdout: "put": 0, 2024-08-31T05:44:41.073 INFO:teuthology.orchestra.run.smithi050.stdout: "put_sum": 0, 2024-08-31T05:44:41.074 INFO:teuthology.orchestra.run.smithi050.stdout: "wait": { 2024-08-31T05:44:41.074 INFO:teuthology.orchestra.run.smithi050.stdout: "avgcount": 0, 2024-08-31T05:44:41.074 INFO:teuthology.orchestra.run.smithi050.stdout: "sum": 0.000000000, 2024-08-31T05:44:41.074 INFO:teuthology.orchestra.run.smithi050.stdout: "avgtime": 0.000000000 2024-08-31T05:44:41.074 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T05:44:41.074 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-08-31T05:44:41.074 INFO:teuthology.orchestra.run.smithi050.stdout: "trackedop": { 2024-08-31T05:44:41.074 INFO:teuthology.orchestra.run.smithi050.stdout: "slow_ops_count": 0 2024-08-31T05:44:41.075 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-08-31T05:44:41.075 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-08-31T05:44:41.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:44:41 smithi050 ceph-mon[22146]: pgmap v802: 129 pgs: 129 active+clean; 859 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 2.4 MiB/s wr, 120 op/s 2024-08-31T05:44:41.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:44:41 smithi005 ceph-mon[18602]: pgmap v802: 129 pgs: 129 active+clean; 859 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 2.4 MiB/s wr, 120 op/s 2024-08-31T05:44:41.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:44:41 smithi070 ceph-mon[22316]: pgmap v802: 129 pgs: 129 active+clean; 859 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 2.4 MiB/s wr, 120 op/s 2024-08-31T05:44:41.693 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-08-31T05:44:41.694 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-08-31T05:44:41.694 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update=0 2024-08-31T05:44:41.694 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update_receipt=0 2024-08-31T05:44:41.694 INFO:tasks.check_counter:Daemon mds.k mds.root_rsnaps=0 2024-08-31T05:44:41.694 INFO:tasks.check_counter:Daemon mds.k mds_server.req_mksnap_latency.avgcount=0 2024-08-31T05:44:41.694 INFO:tasks.check_counter:Daemon mds.k mds_server.req_rmsnap_latency.avgcount=0 2024-08-31T05:44:41.694 DEBUG:tasks.check_counter:Getting stats from c 2024-08-31T05:44:41.695 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph daemon mds.c perf dump 2024-08-31T05:44:42.060 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T05:44:43.254 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-08-31T05:44:43.254 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T05:44:43.254 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 769194, 2024-08-31T05:44:43.254 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 1145417, 2024-08-31T05:44:43.254 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 216499035, 2024-08-31T05:44:43.255 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 1458567855, 2024-08-31T05:44:43.255 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 49, 2024-08-31T05:44:43.255 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 8, 2024-08-31T05:44:43.255 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 66.644162855, 2024-08-31T05:44:43.255 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 36.966820715, 2024-08-31T05:44:43.255 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 30.489846366, 2024-08-31T05:44:43.255 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 4.061802386, 2024-08-31T05:44:43.255 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T05:44:43.256 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 1145415, 2024-08-31T05:44:43.256 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 39.497279085, 2024-08-31T05:44:43.256 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000034482 2024-08-31T05:44:43.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.256 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-08-31T05:44:43.256 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 1668210, 2024-08-31T05:44:43.256 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.309763838, 2024-08-31T05:44:43.256 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000185 2024-08-31T05:44:43.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.257 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-31T05:44:43.257 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 0 2024-08-31T05:44:43.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.257 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T05:44:43.257 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 209088, 2024-08-31T05:44:43.257 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 354127, 2024-08-31T05:44:43.257 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 39381247, 2024-08-31T05:44:43.258 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 588922215, 2024-08-31T05:44:43.258 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 12, 2024-08-31T05:44:43.258 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 7, 2024-08-31T05:44:43.258 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 23.372434112, 2024-08-31T05:44:43.258 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 12.358320946, 2024-08-31T05:44:43.258 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 8.529911662, 2024-08-31T05:44:43.258 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 2.418358457, 2024-08-31T05:44:43.258 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T05:44:43.259 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 354126, 2024-08-31T05:44:43.259 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 13.192721683, 2024-08-31T05:44:43.259 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000037254 2024-08-31T05:44:43.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.259 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-08-31T05:44:43.259 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 432069, 2024-08-31T05:44:43.259 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.105707890, 2024-08-31T05:44:43.259 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000244 2024-08-31T05:44:43.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.260 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 5408, 2024-08-31T05:44:43.260 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 554640 2024-08-31T05:44:43.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.260 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T05:44:43.260 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 355783, 2024-08-31T05:44:43.260 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 645888, 2024-08-31T05:44:43.260 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 68290692, 2024-08-31T05:44:43.260 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 612978538, 2024-08-31T05:44:43.261 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 8, 2024-08-31T05:44:43.261 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 7, 2024-08-31T05:44:43.261 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 36.715075193, 2024-08-31T05:44:43.261 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 20.080811312, 2024-08-31T05:44:43.261 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 15.999470900, 2024-08-31T05:44:43.261 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 2.127680498, 2024-08-31T05:44:43.261 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T05:44:43.261 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 645887, 2024-08-31T05:44:43.261 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 26.257396734, 2024-08-31T05:44:43.262 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000040653 2024-08-31T05:44:43.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.262 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-08-31T05:44:43.262 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 890309, 2024-08-31T05:44:43.262 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.184099925, 2024-08-31T05:44:43.262 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000206 2024-08-31T05:44:43.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.262 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 1269040, 2024-08-31T05:44:43.263 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 197408 2024-08-31T05:44:43.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.263 INFO:teuthology.orchestra.run.smithi070.stdout: "cct": { 2024-08-31T05:44:43.263 INFO:teuthology.orchestra.run.smithi070.stdout: "total_workers": 1, 2024-08-31T05:44:43.263 INFO:teuthology.orchestra.run.smithi070.stdout: "unhealthy_workers": 0 2024-08-31T05:44:43.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.263 INFO:teuthology.orchestra.run.smithi070.stdout: "finisher-MDSRank": { 2024-08-31T05:44:43.263 INFO:teuthology.orchestra.run.smithi070.stdout: "queue_len": 0, 2024-08-31T05:44:43.263 INFO:teuthology.orchestra.run.smithi070.stdout: "complete_latency": { 2024-08-31T05:44:43.264 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 170200, 2024-08-31T05:44:43.264 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 166.662347873, 2024-08-31T05:44:43.264 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000979214 2024-08-31T05:44:43.264 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-08-31T05:44:43.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.264 INFO:teuthology.orchestra.run.smithi070.stdout: "finisher-PurgeQueue": { 2024-08-31T05:44:43.265 INFO:teuthology.orchestra.run.smithi070.stdout: "queue_len": 0, 2024-08-31T05:44:43.265 INFO:teuthology.orchestra.run.smithi070.stdout: "complete_latency": { 2024-08-31T05:44:43.265 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 104234, 2024-08-31T05:44:43.265 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 15.059015235, 2024-08-31T05:44:43.265 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000144473 2024-08-31T05:44:43.265 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-08-31T05:44:43.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.265 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": { 2024-08-31T05:44:43.266 INFO:teuthology.orchestra.run.smithi070.stdout: "request": 401332, 2024-08-31T05:44:43.266 INFO:teuthology.orchestra.run.smithi070.stdout: "reply": 399440, 2024-08-31T05:44:43.266 INFO:teuthology.orchestra.run.smithi070.stdout: "reply_latency": { 2024-08-31T05:44:43.266 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 399440, 2024-08-31T05:44:43.266 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 935.723974477, 2024-08-31T05:44:43.266 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.002342589 2024-08-31T05:44:43.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.266 INFO:teuthology.orchestra.run.smithi070.stdout: "slow_reply": 0, 2024-08-31T05:44:43.266 INFO:teuthology.orchestra.run.smithi070.stdout: "forward": 1892, 2024-08-31T05:44:43.267 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_fetch_complete": 0, 2024-08-31T05:44:43.267 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_fetch_keys": 0, 2024-08-31T05:44:43.267 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_commit": 356, 2024-08-31T05:44:43.267 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_split": 24, 2024-08-31T05:44:43.267 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_merge": 32, 2024-08-31T05:44:43.267 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes": 5540, 2024-08-31T05:44:43.267 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_top": 2135, 2024-08-31T05:44:43.267 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_bottom": 3215, 2024-08-31T05:44:43.268 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_pin_tail": 190, 2024-08-31T05:44:43.268 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_pinned": 2487, 2024-08-31T05:44:43.268 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_expired": 232, 2024-08-31T05:44:43.268 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_with_caps": 576, 2024-08-31T05:44:43.268 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": 576, 2024-08-31T05:44:43.268 INFO:teuthology.orchestra.run.smithi070.stdout: "subtrees": 17, 2024-08-31T05:44:43.268 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse": 617425, 2024-08-31T05:44:43.268 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_hit": 360406, 2024-08-31T05:44:43.269 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_forward": 1891, 2024-08-31T05:44:43.269 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_discover": 34, 2024-08-31T05:44:43.269 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_dir_fetch": 0, 2024-08-31T05:44:43.269 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_remote_ino": 0, 2024-08-31T05:44:43.269 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_lock": 4497, 2024-08-31T05:44:43.269 INFO:teuthology.orchestra.run.smithi070.stdout: "load_cent": 0, 2024-08-31T05:44:43.269 INFO:teuthology.orchestra.run.smithi070.stdout: "q": 0, 2024-08-31T05:44:43.269 INFO:teuthology.orchestra.run.smithi070.stdout: "exported": 7, 2024-08-31T05:44:43.269 INFO:teuthology.orchestra.run.smithi070.stdout: "exported_inodes": 179, 2024-08-31T05:44:43.270 INFO:teuthology.orchestra.run.smithi070.stdout: "imported": 1, 2024-08-31T05:44:43.270 INFO:teuthology.orchestra.run.smithi070.stdout: "imported_inodes": 150, 2024-08-31T05:44:43.270 INFO:teuthology.orchestra.run.smithi070.stdout: "openino_dir_fetch": 0, 2024-08-31T05:44:43.270 INFO:teuthology.orchestra.run.smithi070.stdout: "openino_backtrace_fetch": 1818, 2024-08-31T05:44:43.270 INFO:teuthology.orchestra.run.smithi070.stdout: "openino_peer_discover": 0, 2024-08-31T05:44:43.270 INFO:teuthology.orchestra.run.smithi070.stdout: "root_rfiles": 736, 2024-08-31T05:44:43.270 INFO:teuthology.orchestra.run.smithi070.stdout: "root_rbytes": 205356007, 2024-08-31T05:44:43.270 INFO:teuthology.orchestra.run.smithi070.stdout: "root_rsnaps": 6, 2024-08-31T05:44:43.271 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_backtrace_fetch": 1818, 2024-08-31T05:44:43.271 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_set_tag": 0, 2024-08-31T05:44:43.271 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_backtrace_repaired": 0, 2024-08-31T05:44:43.271 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_inotable_repaired": 0, 2024-08-31T05:44:43.271 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_dir_inodes": 256, 2024-08-31T05:44:43.271 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_dir_base_inodes": 0, 2024-08-31T05:44:43.271 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_dirfrag_rstats": 256, 2024-08-31T05:44:43.271 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_file_inodes": 1562, 2024-08-31T05:44:43.272 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_inode_file_caps": 8, 2024-08-31T05:44:43.272 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_revoke": 12987, 2024-08-31T05:44:43.272 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_grant": 177972, 2024-08-31T05:44:43.272 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_trunc": 0, 2024-08-31T05:44:43.272 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-31T05:44:43.272 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-31T05:44:43.272 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_caps": 97753, 2024-08-31T05:44:43.272 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_caps_dirty": 45354, 2024-08-31T05:44:43.273 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_cap_release": 21208, 2024-08-31T05:44:43.273 INFO:teuthology.orchestra.run.smithi070.stdout: "process_request_cap_release": 277967 2024-08-31T05:44:43.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.273 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache": { 2024-08-31T05:44:43.273 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_update": 384, 2024-08-31T05:44:43.273 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_update_receipt": 77, 2024-08-31T05:44:43.273 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_try_discover": 51, 2024-08-31T05:44:43.273 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_send_discover": 61, 2024-08-31T05:44:43.273 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_handle_discover": 887, 2024-08-31T05:44:43.274 INFO:teuthology.orchestra.run.smithi070.stdout: "num_strays": 136, 2024-08-31T05:44:43.274 INFO:teuthology.orchestra.run.smithi070.stdout: "num_strays_delayed": 0, 2024-08-31T05:44:43.274 INFO:teuthology.orchestra.run.smithi070.stdout: "num_strays_enqueuing": 0, 2024-08-31T05:44:43.274 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_created": 56167, 2024-08-31T05:44:43.274 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_enqueued": 56031, 2024-08-31T05:44:43.274 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_reintegrated": 0, 2024-08-31T05:44:43.274 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_migrated": 0, 2024-08-31T05:44:43.274 INFO:teuthology.orchestra.run.smithi070.stdout: "num_recovering_processing": 0, 2024-08-31T05:44:43.275 INFO:teuthology.orchestra.run.smithi070.stdout: "num_recovering_enqueued": 0, 2024-08-31T05:44:43.275 INFO:teuthology.orchestra.run.smithi070.stdout: "num_recovering_prioritized": 0, 2024-08-31T05:44:43.275 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_started": 0, 2024-08-31T05:44:43.275 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_completed": 0, 2024-08-31T05:44:43.275 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_quiesce_path": 0, 2024-08-31T05:44:43.275 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_quiesce_inode": 0, 2024-08-31T05:44:43.275 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_enqueue_scrub": 0, 2024-08-31T05:44:43.275 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_exportdir": 7, 2024-08-31T05:44:43.275 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_flush": 0, 2024-08-31T05:44:43.276 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_fragmentdir": 56, 2024-08-31T05:44:43.276 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_fragstats": 0, 2024-08-31T05:44:43.276 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_inodestats": 0, 2024-08-31T05:44:43.276 INFO:teuthology.orchestra.run.smithi070.stdout: "uninline_started": 0, 2024-08-31T05:44:43.276 INFO:teuthology.orchestra.run.smithi070.stdout: "uninline_succeeded": 0, 2024-08-31T05:44:43.276 INFO:teuthology.orchestra.run.smithi070.stdout: "uninline_write_failed": 0 2024-08-31T05:44:43.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.276 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log": { 2024-08-31T05:44:43.277 INFO:teuthology.orchestra.run.smithi070.stdout: "evlrg": 0, 2024-08-31T05:44:43.277 INFO:teuthology.orchestra.run.smithi070.stdout: "evadd": 260485, 2024-08-31T05:44:43.277 INFO:teuthology.orchestra.run.smithi070.stdout: "evex": 192275, 2024-08-31T05:44:43.277 INFO:teuthology.orchestra.run.smithi070.stdout: "evtrm": 184351, 2024-08-31T05:44:43.277 INFO:teuthology.orchestra.run.smithi070.stdout: "ev": 76134, 2024-08-31T05:44:43.277 INFO:teuthology.orchestra.run.smithi070.stdout: "evexg": 0, 2024-08-31T05:44:43.277 INFO:teuthology.orchestra.run.smithi070.stdout: "evexd": 7924, 2024-08-31T05:44:43.277 INFO:teuthology.orchestra.run.smithi070.stdout: "segadd": 419, 2024-08-31T05:44:43.278 INFO:teuthology.orchestra.run.smithi070.stdout: "segex": 291, 2024-08-31T05:44:43.278 INFO:teuthology.orchestra.run.smithi070.stdout: "segtrm": 275, 2024-08-31T05:44:43.278 INFO:teuthology.orchestra.run.smithi070.stdout: "seg": 144, 2024-08-31T05:44:43.278 INFO:teuthology.orchestra.run.smithi070.stdout: "segmjr": 7, 2024-08-31T05:44:43.278 INFO:teuthology.orchestra.run.smithi070.stdout: "segexg": 0, 2024-08-31T05:44:43.278 INFO:teuthology.orchestra.run.smithi070.stdout: "segexd": 16, 2024-08-31T05:44:43.278 INFO:teuthology.orchestra.run.smithi070.stdout: "expos": 850315982, 2024-08-31T05:44:43.278 INFO:teuthology.orchestra.run.smithi070.stdout: "wrpos": 1417244596, 2024-08-31T05:44:43.279 INFO:teuthology.orchestra.run.smithi070.stdout: "rdpos": 0, 2024-08-31T05:44:43.279 INFO:teuthology.orchestra.run.smithi070.stdout: "jlat": { 2024-08-31T05:44:43.279 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 86512, 2024-08-31T05:44:43.279 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 247.620221904, 2024-08-31T05:44:43.279 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.002862264 2024-08-31T05:44:43.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.279 INFO:teuthology.orchestra.run.smithi070.stdout: "replayed": 0 2024-08-31T05:44:43.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.279 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_mem": { 2024-08-31T05:44:43.280 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 1978, 2024-08-31T05:44:43.280 INFO:teuthology.orchestra.run.smithi070.stdout: "ino+": 58072, 2024-08-31T05:44:43.280 INFO:teuthology.orchestra.run.smithi070.stdout: "ino-": 56094, 2024-08-31T05:44:43.280 INFO:teuthology.orchestra.run.smithi070.stdout: "dir": 185, 2024-08-31T05:44:43.280 INFO:teuthology.orchestra.run.smithi070.stdout: "dir+": 375, 2024-08-31T05:44:43.280 INFO:teuthology.orchestra.run.smithi070.stdout: "dir-": 190, 2024-08-31T05:44:43.280 INFO:teuthology.orchestra.run.smithi070.stdout: "dn": 5548, 2024-08-31T05:44:43.280 INFO:teuthology.orchestra.run.smithi070.stdout: "dn+": 118416, 2024-08-31T05:44:43.281 INFO:teuthology.orchestra.run.smithi070.stdout: "dn-": 112868, 2024-08-31T05:44:43.281 INFO:teuthology.orchestra.run.smithi070.stdout: "cap": 493, 2024-08-31T05:44:43.281 INFO:teuthology.orchestra.run.smithi070.stdout: "cap+": 60910, 2024-08-31T05:44:43.281 INFO:teuthology.orchestra.run.smithi070.stdout: "cap-": 60417, 2024-08-31T05:44:43.281 INFO:teuthology.orchestra.run.smithi070.stdout: "rss": 161536, 2024-08-31T05:44:43.281 INFO:teuthology.orchestra.run.smithi070.stdout: "heap": 368979968 2024-08-31T05:44:43.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.281 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_server": { 2024-08-31T05:44:43.281 INFO:teuthology.orchestra.run.smithi070.stdout: "dispatch_client_request": 589456, 2024-08-31T05:44:43.282 INFO:teuthology.orchestra.run.smithi070.stdout: "dispatch_server_request": 405, 2024-08-31T05:44:43.282 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_request": 401332, 2024-08-31T05:44:43.282 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_session": 7782, 2024-08-31T05:44:43.282 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_peer_request": 978, 2024-08-31T05:44:43.282 INFO:teuthology.orchestra.run.smithi070.stdout: "req_create_latency": { 2024-08-31T05:44:43.282 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 56720, 2024-08-31T05:44:43.282 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 136.267059684, 2024-08-31T05:44:43.282 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.002402451 2024-08-31T05:44:43.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.283 INFO:teuthology.orchestra.run.smithi070.stdout: "req_getattr_latency": { 2024-08-31T05:44:43.283 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 4643, 2024-08-31T05:44:43.283 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 35.271774040, 2024-08-31T05:44:43.283 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.007596763 2024-08-31T05:44:43.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.283 INFO:teuthology.orchestra.run.smithi070.stdout: "req_getfilelock_latency": { 2024-08-31T05:44:43.283 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:43.283 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:43.284 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:43.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.284 INFO:teuthology.orchestra.run.smithi070.stdout: "req_link_latency": { 2024-08-31T05:44:43.284 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:43.284 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:43.284 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:43.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.284 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookup_latency": { 2024-08-31T05:44:43.285 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 128413, 2024-08-31T05:44:43.285 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 176.213153886, 2024-08-31T05:44:43.285 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.001372237 2024-08-31T05:44:43.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.285 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookuphash_latency": { 2024-08-31T05:44:43.285 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:43.285 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:43.285 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:43.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.286 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupino_latency": { 2024-08-31T05:44:43.286 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:43.286 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:43.286 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:43.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.286 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupname_latency": { 2024-08-31T05:44:43.286 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:43.286 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:43.286 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:43.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.287 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupparent_latency": { 2024-08-31T05:44:43.287 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:43.287 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:43.288 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:43.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.288 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupsnap_latency": { 2024-08-31T05:44:43.288 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:43.288 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:43.288 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:43.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.289 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lssnap_latency": { 2024-08-31T05:44:43.289 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:43.289 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:43.289 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:43.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.289 INFO:teuthology.orchestra.run.smithi070.stdout: "req_mkdir_latency": { 2024-08-31T05:44:43.289 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 99, 2024-08-31T05:44:43.289 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.965477709, 2024-08-31T05:44:43.290 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.009752300 2024-08-31T05:44:43.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.290 INFO:teuthology.orchestra.run.smithi070.stdout: "req_mknod_latency": { 2024-08-31T05:44:43.290 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:43.290 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:43.290 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:43.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.290 INFO:teuthology.orchestra.run.smithi070.stdout: "req_mksnap_latency": { 2024-08-31T05:44:43.291 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:43.291 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:43.291 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:43.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.291 INFO:teuthology.orchestra.run.smithi070.stdout: "req_open_latency": { 2024-08-31T05:44:43.291 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 9, 2024-08-31T05:44:43.291 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.011961839, 2024-08-31T05:44:43.291 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.001329093 2024-08-31T05:44:43.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.292 INFO:teuthology.orchestra.run.smithi070.stdout: "req_readdir_latency": { 2024-08-31T05:44:43.292 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 139767, 2024-08-31T05:44:43.292 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 418.457852589, 2024-08-31T05:44:43.292 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.002993967 2024-08-31T05:44:43.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.292 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rename_latency": { 2024-08-31T05:44:43.292 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 11785, 2024-08-31T05:44:43.292 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 35.545658421, 2024-08-31T05:44:43.293 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.003016178 2024-08-31T05:44:43.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.293 INFO:teuthology.orchestra.run.smithi070.stdout: "req_renamesnap_latency": { 2024-08-31T05:44:43.293 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:43.293 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:43.293 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:43.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.293 INFO:teuthology.orchestra.run.smithi070.stdout: "req_snapdiff_latency": { 2024-08-31T05:44:43.294 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:43.294 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:43.294 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:43.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.294 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rmdir_latency": { 2024-08-31T05:44:43.294 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:43.294 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:43.294 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:43.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.295 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rmsnap_latency": { 2024-08-31T05:44:43.295 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:43.295 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:43.295 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:43.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.295 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rmxattr_latency": { 2024-08-31T05:44:43.295 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:43.296 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:43.296 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:43.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.296 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setattr_latency": { 2024-08-31T05:44:43.296 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 33, 2024-08-31T05:44:43.296 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.648550759, 2024-08-31T05:44:43.296 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.019653053 2024-08-31T05:44:43.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.296 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setdirlayout_latency": { 2024-08-31T05:44:43.297 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:43.297 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:43.297 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:43.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.297 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setfilelock_latency": { 2024-08-31T05:44:43.297 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 1804, 2024-08-31T05:44:43.297 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 2.208078322, 2024-08-31T05:44:43.297 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.001223990 2024-08-31T05:44:43.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.298 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setlayout_latency": { 2024-08-31T05:44:43.298 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:43.298 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:43.298 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:43.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.298 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setxattr_latency": { 2024-08-31T05:44:43.298 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:43.299 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:43.299 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:43.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.299 INFO:teuthology.orchestra.run.smithi070.stdout: "req_symlink_latency": { 2024-08-31T05:44:43.299 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:43.299 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:43.299 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:43.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.300 INFO:teuthology.orchestra.run.smithi070.stdout: "req_unlink_latency": { 2024-08-31T05:44:43.300 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 56167, 2024-08-31T05:44:43.300 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 130.134407228, 2024-08-31T05:44:43.300 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.002316919 2024-08-31T05:44:43.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.300 INFO:teuthology.orchestra.run.smithi070.stdout: "cap_revoke_eviction": 0, 2024-08-31T05:44:43.300 INFO:teuthology.orchestra.run.smithi070.stdout: "cap_acquisition_throttle": 0, 2024-08-31T05:44:43.300 INFO:teuthology.orchestra.run.smithi070.stdout: "req_getvxattr_latency": { 2024-08-31T05:44:43.300 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:43.301 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:43.301 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:43.301 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-08-31T05:44:43.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.301 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_sessions": { 2024-08-31T05:44:43.301 INFO:teuthology.orchestra.run.smithi070.stdout: "session_count": 2, 2024-08-31T05:44:43.301 INFO:teuthology.orchestra.run.smithi070.stdout: "session_add": 2, 2024-08-31T05:44:43.301 INFO:teuthology.orchestra.run.smithi070.stdout: "session_remove": 0, 2024-08-31T05:44:43.302 INFO:teuthology.orchestra.run.smithi070.stdout: "sessions_open": 2, 2024-08-31T05:44:43.302 INFO:teuthology.orchestra.run.smithi070.stdout: "sessions_stale": 0, 2024-08-31T05:44:43.302 INFO:teuthology.orchestra.run.smithi070.stdout: "total_load": 43401, 2024-08-31T05:44:43.302 INFO:teuthology.orchestra.run.smithi070.stdout: "average_load": 21700, 2024-08-31T05:44:43.302 INFO:teuthology.orchestra.run.smithi070.stdout: "avg_session_uptime": 853, 2024-08-31T05:44:43.302 INFO:teuthology.orchestra.run.smithi070.stdout: "mdthresh_evicted": 0 2024-08-31T05:44:43.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.302 INFO:teuthology.orchestra.run.smithi070.stdout: "mempool": { 2024-08-31T05:44:43.303 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_bytes": 0, 2024-08-31T05:44:43.303 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_items": 0, 2024-08-31T05:44:43.303 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T05:44:43.303 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_items": 0, 2024-08-31T05:44:43.303 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T05:44:43.303 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_items": 0, 2024-08-31T05:44:43.303 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T05:44:43.303 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T05:44:43.303 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T05:44:43.304 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T05:44:43.304 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T05:44:43.304 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_items": 0, 2024-08-31T05:44:43.304 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T05:44:43.304 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T05:44:43.304 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_bytes": 0, 2024-08-31T05:44:43.304 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_items": 0, 2024-08-31T05:44:43.304 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_bytes": 0, 2024-08-31T05:44:43.305 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_items": 0, 2024-08-31T05:44:43.305 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T05:44:43.305 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T05:44:43.305 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T05:44:43.305 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T05:44:43.305 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T05:44:43.305 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_items": 0, 2024-08-31T05:44:43.305 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_bytes": 0, 2024-08-31T05:44:43.305 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_items": 0, 2024-08-31T05:44:43.306 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T05:44:43.306 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T05:44:43.306 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_bytes": 0, 2024-08-31T05:44:43.306 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_items": 0, 2024-08-31T05:44:43.306 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_bytes": 0, 2024-08-31T05:44:43.306 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_items": 0, 2024-08-31T05:44:43.306 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T05:44:43.306 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_items": 0, 2024-08-31T05:44:43.307 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T05:44:43.307 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_items": 0, 2024-08-31T05:44:43.307 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_bytes": 2893279, 2024-08-31T05:44:43.307 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_items": 2046, 2024-08-31T05:44:43.307 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_bytes": 176, 2024-08-31T05:44:43.307 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_items": 2, 2024-08-31T05:44:43.307 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_bytes": 0, 2024-08-31T05:44:43.307 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_items": 0, 2024-08-31T05:44:43.308 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_bytes": 0, 2024-08-31T05:44:43.308 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_items": 0, 2024-08-31T05:44:43.308 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_bytes": 0, 2024-08-31T05:44:43.308 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_items": 0, 2024-08-31T05:44:43.308 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_bytes": 9736, 2024-08-31T05:44:43.308 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_items": 197, 2024-08-31T05:44:43.308 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T05:44:43.308 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_items": 0, 2024-08-31T05:44:43.309 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_bytes": 0, 2024-08-31T05:44:43.309 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_items": 0, 2024-08-31T05:44:43.309 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_bytes": 9754881, 2024-08-31T05:44:43.309 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_items": 142444, 2024-08-31T05:44:43.309 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_bytes": 0, 2024-08-31T05:44:43.309 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_items": 0, 2024-08-31T05:44:43.309 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_bytes": 0, 2024-08-31T05:44:43.309 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_items": 0 2024-08-31T05:44:43.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.310 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter": { 2024-08-31T05:44:43.310 INFO:teuthology.orchestra.run.smithi070.stdout: "op_active": 9, 2024-08-31T05:44:43.310 INFO:teuthology.orchestra.run.smithi070.stdout: "op_laggy": 0, 2024-08-31T05:44:43.310 INFO:teuthology.orchestra.run.smithi070.stdout: "op_send": 205598, 2024-08-31T05:44:43.310 INFO:teuthology.orchestra.run.smithi070.stdout: "op_send_bytes": 1427535169, 2024-08-31T05:44:43.310 INFO:teuthology.orchestra.run.smithi070.stdout: "op_resend": 33, 2024-08-31T05:44:43.310 INFO:teuthology.orchestra.run.smithi070.stdout: "op_reply": 205589, 2024-08-31T05:44:43.310 INFO:teuthology.orchestra.run.smithi070.stdout: "op_latency": { 2024-08-31T05:44:43.311 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 205589, 2024-08-31T05:44:43.311 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 745.930655531, 2024-08-31T05:44:43.311 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.003628261 2024-08-31T05:44:43.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.311 INFO:teuthology.orchestra.run.smithi070.stdout: "op_inflight": 8, 2024-08-31T05:44:43.311 INFO:teuthology.orchestra.run.smithi070.stdout: "oplen_avg": { 2024-08-31T05:44:43.311 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 205598, 2024-08-31T05:44:43.311 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 207804 2024-08-31T05:44:43.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.312 INFO:teuthology.orchestra.run.smithi070.stdout: "op": 205598, 2024-08-31T05:44:43.312 INFO:teuthology.orchestra.run.smithi070.stdout: "op_r": 3149, 2024-08-31T05:44:43.312 INFO:teuthology.orchestra.run.smithi070.stdout: "op_w": 202449, 2024-08-31T05:44:43.312 INFO:teuthology.orchestra.run.smithi070.stdout: "op_rmw": 0, 2024-08-31T05:44:43.312 INFO:teuthology.orchestra.run.smithi070.stdout: "op_pg": 0, 2024-08-31T05:44:43.312 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_stat": 121, 2024-08-31T05:44:43.312 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_create": 133, 2024-08-31T05:44:43.312 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_read": 1331, 2024-08-31T05:44:43.313 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_write": 87843, 2024-08-31T05:44:43.313 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_writefull": 573, 2024-08-31T05:44:43.313 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_writesame": 0, 2024-08-31T05:44:43.313 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_append": 0, 2024-08-31T05:44:43.313 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_zero": 0, 2024-08-31T05:44:43.313 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_truncate": 24, 2024-08-31T05:44:43.313 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_delete": 112738, 2024-08-31T05:44:43.313 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_mapext": 0, 2024-08-31T05:44:43.314 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_sparse_read": 0, 2024-08-31T05:44:43.314 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_clonerange": 0, 2024-08-31T05:44:43.314 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_getxattr": 1818, 2024-08-31T05:44:43.314 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_setxattr": 210, 2024-08-31T05:44:43.314 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_cmpxattr": 0, 2024-08-31T05:44:43.314 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_rmxattr": 0, 2024-08-31T05:44:43.314 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_resetxattrs": 0, 2024-08-31T05:44:43.314 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_call": 0, 2024-08-31T05:44:43.314 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_watch": 0, 2024-08-31T05:44:43.315 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_notify": 0, 2024-08-31T05:44:43.315 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_src_cmpxattr": 0, 2024-08-31T05:44:43.315 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_pgls": 0, 2024-08-31T05:44:43.315 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_pgls_filter": 0, 2024-08-31T05:44:43.315 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_other": 0, 2024-08-31T05:44:43.315 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_active": 0, 2024-08-31T05:44:43.315 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_send": 0, 2024-08-31T05:44:43.315 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_resend": 0, 2024-08-31T05:44:43.316 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_ping": 0, 2024-08-31T05:44:43.316 INFO:teuthology.orchestra.run.smithi070.stdout: "poolop_active": 0, 2024-08-31T05:44:43.316 INFO:teuthology.orchestra.run.smithi070.stdout: "poolop_send": 0, 2024-08-31T05:44:43.316 INFO:teuthology.orchestra.run.smithi070.stdout: "poolop_resend": 0, 2024-08-31T05:44:43.316 INFO:teuthology.orchestra.run.smithi070.stdout: "poolstat_active": 0, 2024-08-31T05:44:43.316 INFO:teuthology.orchestra.run.smithi070.stdout: "poolstat_send": 0, 2024-08-31T05:44:43.316 INFO:teuthology.orchestra.run.smithi070.stdout: "poolstat_resend": 0, 2024-08-31T05:44:43.316 INFO:teuthology.orchestra.run.smithi070.stdout: "statfs_active": 0, 2024-08-31T05:44:43.317 INFO:teuthology.orchestra.run.smithi070.stdout: "statfs_send": 0, 2024-08-31T05:44:43.317 INFO:teuthology.orchestra.run.smithi070.stdout: "statfs_resend": 0, 2024-08-31T05:44:43.317 INFO:teuthology.orchestra.run.smithi070.stdout: "command_active": 0, 2024-08-31T05:44:43.317 INFO:teuthology.orchestra.run.smithi070.stdout: "command_send": 0, 2024-08-31T05:44:43.317 INFO:teuthology.orchestra.run.smithi070.stdout: "command_resend": 0, 2024-08-31T05:44:43.317 INFO:teuthology.orchestra.run.smithi070.stdout: "map_epoch": 103, 2024-08-31T05:44:43.317 INFO:teuthology.orchestra.run.smithi070.stdout: "map_full": 0, 2024-08-31T05:44:43.317 INFO:teuthology.orchestra.run.smithi070.stdout: "map_inc": 18, 2024-08-31T05:44:43.318 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_sessions": 12, 2024-08-31T05:44:43.318 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_session_open": 12, 2024-08-31T05:44:43.318 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_session_close": 0, 2024-08-31T05:44:43.318 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_laggy": 0, 2024-08-31T05:44:43.318 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_wr": 2251, 2024-08-31T05:44:43.318 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_rd": 0, 2024-08-31T05:44:43.318 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_del": 762 2024-08-31T05:44:43.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.319 INFO:teuthology.orchestra.run.smithi070.stdout: "oft": { 2024-08-31T05:44:43.319 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_objs": 1, 2024-08-31T05:44:43.319 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_kv_pairs": 0, 2024-08-31T05:44:43.319 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_updates": 0, 2024-08-31T05:44:43.319 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_removes": 0 2024-08-31T05:44:43.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.319 INFO:teuthology.orchestra.run.smithi070.stdout: "purge_queue": { 2024-08-31T05:44:43.319 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing_ops": 10, 2024-08-31T05:44:43.319 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing_ops_high_water": 10, 2024-08-31T05:44:43.320 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing": 5, 2024-08-31T05:44:43.320 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing_high_water": 5, 2024-08-31T05:44:43.320 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executed_ops": 112028, 2024-08-31T05:44:43.320 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executed": 56014, 2024-08-31T05:44:43.320 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_item_in_journal": 18 2024-08-31T05:44:43.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.320 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T05:44:43.320 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-08-31T05:44:43.321 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 104857600, 2024-08-31T05:44:43.321 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-08-31T05:44:43.321 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 1334061, 2024-08-31T05:44:43.321 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 204082340, 2024-08-31T05:44:43.321 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-08-31T05:44:43.321 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 1334061, 2024-08-31T05:44:43.321 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-08-31T05:44:43.321 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-08-31T05:44:43.322 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 1334061, 2024-08-31T05:44:43.322 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 204082340, 2024-08-31T05:44:43.322 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-08-31T05:44:43.322 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:43.322 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:43.322 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:43.322 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-08-31T05:44:43.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.323 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-objecter_bytes": { 2024-08-31T05:44:43.323 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-08-31T05:44:43.323 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 104857600, 2024-08-31T05:44:43.323 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-08-31T05:44:43.323 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 0, 2024-08-31T05:44:43.323 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 0, 2024-08-31T05:44:43.323 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-08-31T05:44:43.323 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 0, 2024-08-31T05:44:43.324 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 205598, 2024-08-31T05:44:43.324 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 1433650428, 2024-08-31T05:44:43.324 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 205589, 2024-08-31T05:44:43.324 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 1433650428, 2024-08-31T05:44:43.324 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-08-31T05:44:43.324 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:43.324 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:43.324 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:43.324 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-08-31T05:44:43.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.325 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-objecter_ops": { 2024-08-31T05:44:43.325 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 9, 2024-08-31T05:44:43.325 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 1024, 2024-08-31T05:44:43.325 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-08-31T05:44:43.325 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 0, 2024-08-31T05:44:43.325 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 0, 2024-08-31T05:44:43.325 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-08-31T05:44:43.326 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 0, 2024-08-31T05:44:43.326 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 205598, 2024-08-31T05:44:43.326 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 205598, 2024-08-31T05:44:43.326 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 205589, 2024-08-31T05:44:43.326 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 205589, 2024-08-31T05:44:43.326 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-08-31T05:44:43.326 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:43.326 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:43.326 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:43.327 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-08-31T05:44:43.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.327 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-write_buf_throttle": { 2024-08-31T05:44:43.327 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-08-31T05:44:43.327 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 3758096384, 2024-08-31T05:44:43.327 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-08-31T05:44:43.327 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 56031, 2024-08-31T05:44:43.327 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 6115259, 2024-08-31T05:44:43.328 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-08-31T05:44:43.328 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 56031, 2024-08-31T05:44:43.328 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-08-31T05:44:43.328 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-08-31T05:44:43.328 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 1331, 2024-08-31T05:44:43.328 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 6115259, 2024-08-31T05:44:43.328 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-08-31T05:44:43.328 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:43.329 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:43.329 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:43.329 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-08-31T05:44:43.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.329 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-write_buf_throttle-0x5597020da680": { 2024-08-31T05:44:43.329 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 964402, 2024-08-31T05:44:43.329 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 3758096384, 2024-08-31T05:44:43.329 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-08-31T05:44:43.330 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 260485, 2024-08-31T05:44:43.330 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 1413050292, 2024-08-31T05:44:43.330 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-08-31T05:44:43.330 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 260485, 2024-08-31T05:44:43.330 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-08-31T05:44:43.330 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-08-31T05:44:43.330 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 86512, 2024-08-31T05:44:43.330 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 1412085890, 2024-08-31T05:44:43.330 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-08-31T05:44:43.331 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:43.331 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:43.331 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:43.331 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-08-31T05:44:43.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:43.331 INFO:teuthology.orchestra.run.smithi070.stdout: "trackedop": { 2024-08-31T05:44:43.331 INFO:teuthology.orchestra.run.smithi070.stdout: "slow_ops_count": 1 2024-08-31T05:44:43.331 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-08-31T05:44:43.332 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-08-31T05:44:43.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:44:43 smithi005 ceph-mon[18602]: pgmap v803: 129 pgs: 129 active+clean; 861 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 1.6 MiB/s wr, 80 op/s 2024-08-31T05:44:43.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:44:43 smithi070 ceph-mon[22316]: pgmap v803: 129 pgs: 129 active+clean; 861 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 1.6 MiB/s wr, 80 op/s 2024-08-31T05:44:43.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:44:43 smithi050 ceph-mon[22146]: pgmap v803: 129 pgs: 129 active+clean; 861 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 1.6 MiB/s wr, 80 op/s 2024-08-31T05:44:44.238 INFO:tasks.check_counter:Daemon mds.c mds.exported=7 2024-08-31T05:44:44.238 INFO:tasks.check_counter:Daemon mds.c mds.imported=1 2024-08-31T05:44:44.238 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=384 2024-08-31T05:44:44.238 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=77 2024-08-31T05:44:44.238 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=6 2024-08-31T05:44:44.239 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-08-31T05:44:44.239 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-08-31T05:44:44.239 DEBUG:tasks.check_counter:Getting stats from f 2024-08-31T05:44:44.239 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph daemon mds.f perf dump 2024-08-31T05:44:44.484 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T05:44:45.228 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:44:45 smithi070 ceph-mon[22316]: pgmap v804: 129 pgs: 129 active+clean; 861 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 1.4 MiB/s wr, 79 op/s 2024-08-31T05:44:45.373 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-08-31T05:44:45.374 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T05:44:45.374 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 57141, 2024-08-31T05:44:45.374 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 63902, 2024-08-31T05:44:45.375 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 17442684, 2024-08-31T05:44:45.375 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 32001646, 2024-08-31T05:44:45.375 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 14, 2024-08-31T05:44:45.375 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 9, 2024-08-31T05:44:45.376 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 4.412206732, 2024-08-31T05:44:45.376 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 2.178658927, 2024-08-31T05:44:45.376 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 2.592273692, 2024-08-31T05:44:45.376 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.074906964, 2024-08-31T05:44:45.377 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T05:44:45.377 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 63901, 2024-08-31T05:44:45.377 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 2.684148837, 2024-08-31T05:44:45.377 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000042004 2024-08-31T05:44:45.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.377 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-08-31T05:44:45.378 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 113852, 2024-08-31T05:44:45.378 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.021957860, 2024-08-31T05:44:45.378 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000192 2024-08-31T05:44:45.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.378 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 1258656, 2024-08-31T05:44:45.379 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 184896 2024-08-31T05:44:45.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.379 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T05:44:45.379 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 297574, 2024-08-31T05:44:45.379 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 159224, 2024-08-31T05:44:45.379 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 127011776, 2024-08-31T05:44:45.379 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 35424271, 2024-08-31T05:44:45.379 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 48, 2024-08-31T05:44:45.380 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 7, 2024-08-31T05:44:45.380 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 17.533119375, 2024-08-31T05:44:45.380 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 8.549644348, 2024-08-31T05:44:45.380 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 11.982416811, 2024-08-31T05:44:45.380 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.068457181, 2024-08-31T05:44:45.380 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T05:44:45.380 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 159223, 2024-08-31T05:44:45.381 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 3.723771686, 2024-08-31T05:44:45.381 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000023387 2024-08-31T05:44:45.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.381 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-08-31T05:44:45.381 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 451101, 2024-08-31T05:44:45.381 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.073246501, 2024-08-31T05:44:45.382 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000162 2024-08-31T05:44:45.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.382 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 5376, 2024-08-31T05:44:45.382 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 459952 2024-08-31T05:44:45.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.382 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T05:44:45.383 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 5700, 2024-08-31T05:44:45.383 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 8704, 2024-08-31T05:44:45.383 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 1172186, 2024-08-31T05:44:45.383 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 11100256, 2024-08-31T05:44:45.383 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 13, 2024-08-31T05:44:45.384 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 7, 2024-08-31T05:44:45.384 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.638093019, 2024-08-31T05:44:45.384 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.316265202, 2024-08-31T05:44:45.384 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.213884042, 2024-08-31T05:44:45.385 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.088940526, 2024-08-31T05:44:45.385 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T05:44:45.385 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 8702, 2024-08-31T05:44:45.385 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.773227279, 2024-08-31T05:44:45.386 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000088856 2024-08-31T05:44:45.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.386 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-08-31T05:44:45.386 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 8907, 2024-08-31T05:44:45.386 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.001944431, 2024-08-31T05:44:45.386 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000218 2024-08-31T05:44:45.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.386 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 3616, 2024-08-31T05:44:45.387 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 15872 2024-08-31T05:44:45.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.387 INFO:teuthology.orchestra.run.smithi070.stdout: "cct": { 2024-08-31T05:44:45.387 INFO:teuthology.orchestra.run.smithi070.stdout: "total_workers": 1, 2024-08-31T05:44:45.387 INFO:teuthology.orchestra.run.smithi070.stdout: "unhealthy_workers": 0 2024-08-31T05:44:45.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.387 INFO:teuthology.orchestra.run.smithi070.stdout: "finisher-MDSRank": { 2024-08-31T05:44:45.387 INFO:teuthology.orchestra.run.smithi070.stdout: "queue_len": 0, 2024-08-31T05:44:45.388 INFO:teuthology.orchestra.run.smithi070.stdout: "complete_latency": { 2024-08-31T05:44:45.388 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 5575, 2024-08-31T05:44:45.388 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 6.695958620, 2024-08-31T05:44:45.388 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.001201068 2024-08-31T05:44:45.388 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-08-31T05:44:45.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.388 INFO:teuthology.orchestra.run.smithi070.stdout: "finisher-PurgeQueue": { 2024-08-31T05:44:45.389 INFO:teuthology.orchestra.run.smithi070.stdout: "queue_len": 0, 2024-08-31T05:44:45.389 INFO:teuthology.orchestra.run.smithi070.stdout: "complete_latency": { 2024-08-31T05:44:45.389 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 3249, 2024-08-31T05:44:45.389 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.340141290, 2024-08-31T05:44:45.389 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000104691 2024-08-31T05:44:45.389 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-08-31T05:44:45.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.389 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": { 2024-08-31T05:44:45.390 INFO:teuthology.orchestra.run.smithi070.stdout: "request": 40313, 2024-08-31T05:44:45.390 INFO:teuthology.orchestra.run.smithi070.stdout: "reply": 11408, 2024-08-31T05:44:45.390 INFO:teuthology.orchestra.run.smithi070.stdout: "reply_latency": { 2024-08-31T05:44:45.390 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 11408, 2024-08-31T05:44:45.390 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 37.746524277, 2024-08-31T05:44:45.390 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.003308776 2024-08-31T05:44:45.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.390 INFO:teuthology.orchestra.run.smithi070.stdout: "slow_reply": 0, 2024-08-31T05:44:45.390 INFO:teuthology.orchestra.run.smithi070.stdout: "forward": 28905, 2024-08-31T05:44:45.391 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_fetch_complete": 0, 2024-08-31T05:44:45.391 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_fetch_keys": 0, 2024-08-31T05:44:45.391 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_commit": 11, 2024-08-31T05:44:45.391 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_split": 0, 2024-08-31T05:44:45.391 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_merge": 0, 2024-08-31T05:44:45.391 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes": 437, 2024-08-31T05:44:45.391 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_top": 72, 2024-08-31T05:44:45.391 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_bottom": 365, 2024-08-31T05:44:45.392 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_pin_tail": 0, 2024-08-31T05:44:45.392 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_pinned": 333, 2024-08-31T05:44:45.392 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_expired": 0, 2024-08-31T05:44:45.392 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_with_caps": 87, 2024-08-31T05:44:45.392 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": 87, 2024-08-31T05:44:45.392 INFO:teuthology.orchestra.run.smithi070.stdout: "subtrees": 8, 2024-08-31T05:44:45.392 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse": 48457, 2024-08-31T05:44:45.392 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_hit": 10520, 2024-08-31T05:44:45.392 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_forward": 28902, 2024-08-31T05:44:45.393 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_discover": 103, 2024-08-31T05:44:45.393 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_dir_fetch": 0, 2024-08-31T05:44:45.393 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_remote_ino": 0, 2024-08-31T05:44:45.393 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_lock": 154, 2024-08-31T05:44:45.393 INFO:teuthology.orchestra.run.smithi070.stdout: "load_cent": 0, 2024-08-31T05:44:45.393 INFO:teuthology.orchestra.run.smithi070.stdout: "q": 0, 2024-08-31T05:44:45.393 INFO:teuthology.orchestra.run.smithi070.stdout: "exported": 0, 2024-08-31T05:44:45.394 INFO:teuthology.orchestra.run.smithi070.stdout: "exported_inodes": 0, 2024-08-31T05:44:45.394 INFO:teuthology.orchestra.run.smithi070.stdout: "imported": 3, 2024-08-31T05:44:45.394 INFO:teuthology.orchestra.run.smithi070.stdout: "imported_inodes": 83, 2024-08-31T05:44:45.394 INFO:teuthology.orchestra.run.smithi070.stdout: "openino_dir_fetch": 0, 2024-08-31T05:44:45.394 INFO:teuthology.orchestra.run.smithi070.stdout: "openino_backtrace_fetch": 102, 2024-08-31T05:44:45.394 INFO:teuthology.orchestra.run.smithi070.stdout: "openino_peer_discover": 0, 2024-08-31T05:44:45.394 INFO:teuthology.orchestra.run.smithi070.stdout: "root_rfiles": 736, 2024-08-31T05:44:45.395 INFO:teuthology.orchestra.run.smithi070.stdout: "root_rbytes": 205356007, 2024-08-31T05:44:45.395 INFO:teuthology.orchestra.run.smithi070.stdout: "root_rsnaps": 6, 2024-08-31T05:44:45.395 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_backtrace_fetch": 102, 2024-08-31T05:44:45.395 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_set_tag": 0, 2024-08-31T05:44:45.395 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_backtrace_repaired": 0, 2024-08-31T05:44:45.395 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_inotable_repaired": 0, 2024-08-31T05:44:45.395 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_dir_inodes": 10, 2024-08-31T05:44:45.395 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_dir_base_inodes": 0, 2024-08-31T05:44:45.396 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_dirfrag_rstats": 10, 2024-08-31T05:44:45.396 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_file_inodes": 92, 2024-08-31T05:44:45.396 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_inode_file_caps": 0, 2024-08-31T05:44:45.396 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_revoke": 449, 2024-08-31T05:44:45.396 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_grant": 5429, 2024-08-31T05:44:45.396 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_trunc": 0, 2024-08-31T05:44:45.396 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-31T05:44:45.396 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-31T05:44:45.396 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_caps": 3307, 2024-08-31T05:44:45.397 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_caps_dirty": 1451, 2024-08-31T05:44:45.397 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_cap_release": 693, 2024-08-31T05:44:45.397 INFO:teuthology.orchestra.run.smithi070.stdout: "process_request_cap_release": 7473 2024-08-31T05:44:45.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.397 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache": { 2024-08-31T05:44:45.397 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_update": 69, 2024-08-31T05:44:45.397 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_update_receipt": 370, 2024-08-31T05:44:45.398 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_try_discover": 235, 2024-08-31T05:44:45.398 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_send_discover": 275, 2024-08-31T05:44:45.398 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_handle_discover": 82, 2024-08-31T05:44:45.398 INFO:teuthology.orchestra.run.smithi070.stdout: "num_strays": 24, 2024-08-31T05:44:45.398 INFO:teuthology.orchestra.run.smithi070.stdout: "num_strays_delayed": 0, 2024-08-31T05:44:45.398 INFO:teuthology.orchestra.run.smithi070.stdout: "num_strays_enqueuing": 0, 2024-08-31T05:44:45.398 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_created": 1750, 2024-08-31T05:44:45.398 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_enqueued": 1726, 2024-08-31T05:44:45.398 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_reintegrated": 0, 2024-08-31T05:44:45.399 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_migrated": 0, 2024-08-31T05:44:45.399 INFO:teuthology.orchestra.run.smithi070.stdout: "num_recovering_processing": 0, 2024-08-31T05:44:45.399 INFO:teuthology.orchestra.run.smithi070.stdout: "num_recovering_enqueued": 0, 2024-08-31T05:44:45.399 INFO:teuthology.orchestra.run.smithi070.stdout: "num_recovering_prioritized": 0, 2024-08-31T05:44:45.399 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_started": 0, 2024-08-31T05:44:45.399 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_completed": 0, 2024-08-31T05:44:45.399 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_quiesce_path": 0, 2024-08-31T05:44:45.399 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_quiesce_inode": 0, 2024-08-31T05:44:45.400 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_enqueue_scrub": 0, 2024-08-31T05:44:45.400 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_exportdir": 0, 2024-08-31T05:44:45.400 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_flush": 0, 2024-08-31T05:44:45.400 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_fragmentdir": 0, 2024-08-31T05:44:45.400 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_fragstats": 0, 2024-08-31T05:44:45.400 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_inodestats": 0, 2024-08-31T05:44:45.400 INFO:teuthology.orchestra.run.smithi070.stdout: "uninline_started": 0, 2024-08-31T05:44:45.400 INFO:teuthology.orchestra.run.smithi070.stdout: "uninline_succeeded": 0, 2024-08-31T05:44:45.401 INFO:teuthology.orchestra.run.smithi070.stdout: "uninline_write_failed": 0 2024-08-31T05:44:45.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.401 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log": { 2024-08-31T05:44:45.401 INFO:teuthology.orchestra.run.smithi070.stdout: "evlrg": 0, 2024-08-31T05:44:45.401 INFO:teuthology.orchestra.run.smithi070.stdout: "evadd": 8582, 2024-08-31T05:44:45.401 INFO:teuthology.orchestra.run.smithi070.stdout: "evex": 0, 2024-08-31T05:44:45.401 INFO:teuthology.orchestra.run.smithi070.stdout: "evtrm": 0, 2024-08-31T05:44:45.401 INFO:teuthology.orchestra.run.smithi070.stdout: "ev": 8582, 2024-08-31T05:44:45.401 INFO:teuthology.orchestra.run.smithi070.stdout: "evexg": 0, 2024-08-31T05:44:45.402 INFO:teuthology.orchestra.run.smithi070.stdout: "evexd": 0, 2024-08-31T05:44:45.402 INFO:teuthology.orchestra.run.smithi070.stdout: "segadd": 11, 2024-08-31T05:44:45.402 INFO:teuthology.orchestra.run.smithi070.stdout: "segex": 0, 2024-08-31T05:44:45.402 INFO:teuthology.orchestra.run.smithi070.stdout: "segtrm": 0, 2024-08-31T05:44:45.402 INFO:teuthology.orchestra.run.smithi070.stdout: "seg": 11, 2024-08-31T05:44:45.402 INFO:teuthology.orchestra.run.smithi070.stdout: "segmjr": 2, 2024-08-31T05:44:45.402 INFO:teuthology.orchestra.run.smithi070.stdout: "segexg": 0, 2024-08-31T05:44:45.402 INFO:teuthology.orchestra.run.smithi070.stdout: "segexd": 0, 2024-08-31T05:44:45.403 INFO:teuthology.orchestra.run.smithi070.stdout: "expos": 4194304, 2024-08-31T05:44:45.403 INFO:teuthology.orchestra.run.smithi070.stdout: "wrpos": 24320357, 2024-08-31T05:44:45.403 INFO:teuthology.orchestra.run.smithi070.stdout: "rdpos": 0, 2024-08-31T05:44:45.403 INFO:teuthology.orchestra.run.smithi070.stdout: "jlat": { 2024-08-31T05:44:45.403 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 2833, 2024-08-31T05:44:45.403 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 15.326410753, 2024-08-31T05:44:45.403 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.005409957 2024-08-31T05:44:45.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.404 INFO:teuthology.orchestra.run.smithi070.stdout: "replayed": 0 2024-08-31T05:44:45.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.404 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_mem": { 2024-08-31T05:44:45.404 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 331, 2024-08-31T05:44:45.404 INFO:teuthology.orchestra.run.smithi070.stdout: "ino+": 2002, 2024-08-31T05:44:45.404 INFO:teuthology.orchestra.run.smithi070.stdout: "ino-": 1671, 2024-08-31T05:44:45.405 INFO:teuthology.orchestra.run.smithi070.stdout: "dir": 140, 2024-08-31T05:44:45.405 INFO:teuthology.orchestra.run.smithi070.stdout: "dir+": 184, 2024-08-31T05:44:45.405 INFO:teuthology.orchestra.run.smithi070.stdout: "dir-": 44, 2024-08-31T05:44:45.405 INFO:teuthology.orchestra.run.smithi070.stdout: "dn": 437, 2024-08-31T05:44:45.405 INFO:teuthology.orchestra.run.smithi070.stdout: "dn+": 3997, 2024-08-31T05:44:45.405 INFO:teuthology.orchestra.run.smithi070.stdout: "dn-": 3560, 2024-08-31T05:44:45.405 INFO:teuthology.orchestra.run.smithi070.stdout: "cap": 87, 2024-08-31T05:44:45.405 INFO:teuthology.orchestra.run.smithi070.stdout: "cap+": 2061, 2024-08-31T05:44:45.405 INFO:teuthology.orchestra.run.smithi070.stdout: "cap-": 1974, 2024-08-31T05:44:45.406 INFO:teuthology.orchestra.run.smithi070.stdout: "rss": 134168, 2024-08-31T05:44:45.406 INFO:teuthology.orchestra.run.smithi070.stdout: "heap": 338571264 2024-08-31T05:44:45.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.406 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_server": { 2024-08-31T05:44:45.406 INFO:teuthology.orchestra.run.smithi070.stdout: "dispatch_client_request": 45304, 2024-08-31T05:44:45.406 INFO:teuthology.orchestra.run.smithi070.stdout: "dispatch_server_request": 1, 2024-08-31T05:44:45.406 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_request": 40313, 2024-08-31T05:44:45.406 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_session": 273, 2024-08-31T05:44:45.407 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_peer_request": 162, 2024-08-31T05:44:45.407 INFO:teuthology.orchestra.run.smithi070.stdout: "req_create_latency": { 2024-08-31T05:44:45.407 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 1755, 2024-08-31T05:44:45.407 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 9.983804331, 2024-08-31T05:44:45.407 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.005688777 2024-08-31T05:44:45.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.407 INFO:teuthology.orchestra.run.smithi070.stdout: "req_getattr_latency": { 2024-08-31T05:44:45.407 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 21, 2024-08-31T05:44:45.407 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.021141608, 2024-08-31T05:44:45.408 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.001006743 2024-08-31T05:44:45.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.408 INFO:teuthology.orchestra.run.smithi070.stdout: "req_getfilelock_latency": { 2024-08-31T05:44:45.408 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:45.408 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:45.408 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:45.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.408 INFO:teuthology.orchestra.run.smithi070.stdout: "req_link_latency": { 2024-08-31T05:44:45.409 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:45.409 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:45.409 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:45.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.409 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookup_latency": { 2024-08-31T05:44:45.409 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 4393, 2024-08-31T05:44:45.409 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 5.232713415, 2024-08-31T05:44:45.410 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.001191148 2024-08-31T05:44:45.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.410 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookuphash_latency": { 2024-08-31T05:44:45.410 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:45.410 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:45.410 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:45.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.411 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupino_latency": { 2024-08-31T05:44:45.411 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:45.411 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:45.411 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:45.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.411 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupname_latency": { 2024-08-31T05:44:45.411 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:45.411 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:45.412 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:45.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.412 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupparent_latency": { 2024-08-31T05:44:45.412 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:45.412 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:45.412 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:45.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.412 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupsnap_latency": { 2024-08-31T05:44:45.413 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:45.413 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:45.414 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:45.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.414 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lssnap_latency": { 2024-08-31T05:44:45.414 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:45.414 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:45.414 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:45.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.415 INFO:teuthology.orchestra.run.smithi070.stdout: "req_mkdir_latency": { 2024-08-31T05:44:45.415 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:45.415 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:45.415 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:45.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.415 INFO:teuthology.orchestra.run.smithi070.stdout: "req_mknod_latency": { 2024-08-31T05:44:45.415 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:45.416 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:45.416 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:45.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.416 INFO:teuthology.orchestra.run.smithi070.stdout: "req_mksnap_latency": { 2024-08-31T05:44:45.416 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:45.416 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:45.416 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:45.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.417 INFO:teuthology.orchestra.run.smithi070.stdout: "req_open_latency": { 2024-08-31T05:44:45.417 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:45.417 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:45.417 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:45.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.417 INFO:teuthology.orchestra.run.smithi070.stdout: "req_readdir_latency": { 2024-08-31T05:44:45.417 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 3063, 2024-08-31T05:44:45.418 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 15.551692291, 2024-08-31T05:44:45.418 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.005077274 2024-08-31T05:44:45.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.418 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rename_latency": { 2024-08-31T05:44:45.418 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 373, 2024-08-31T05:44:45.418 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 2.796324820, 2024-08-31T05:44:45.418 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.007496849 2024-08-31T05:44:45.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.418 INFO:teuthology.orchestra.run.smithi070.stdout: "req_renamesnap_latency": { 2024-08-31T05:44:45.419 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:45.419 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:45.419 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:45.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.419 INFO:teuthology.orchestra.run.smithi070.stdout: "req_snapdiff_latency": { 2024-08-31T05:44:45.419 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:45.419 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:45.419 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:45.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.420 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rmdir_latency": { 2024-08-31T05:44:45.420 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:45.420 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:45.420 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:45.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.420 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rmsnap_latency": { 2024-08-31T05:44:45.420 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:45.421 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:45.421 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:45.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.421 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rmxattr_latency": { 2024-08-31T05:44:45.421 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:45.421 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:45.421 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:45.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.421 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setattr_latency": { 2024-08-31T05:44:45.422 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 1, 2024-08-31T05:44:45.422 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.005266031, 2024-08-31T05:44:45.422 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.005266031 2024-08-31T05:44:45.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.422 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setdirlayout_latency": { 2024-08-31T05:44:45.422 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:45.422 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:45.423 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:45.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.423 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setfilelock_latency": { 2024-08-31T05:44:45.423 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 52, 2024-08-31T05:44:45.423 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.049836468, 2024-08-31T05:44:45.423 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000958393 2024-08-31T05:44:45.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.423 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setlayout_latency": { 2024-08-31T05:44:45.424 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:45.424 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:45.424 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:45.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.424 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setxattr_latency": { 2024-08-31T05:44:45.424 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:45.424 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:45.424 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:45.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.425 INFO:teuthology.orchestra.run.smithi070.stdout: "req_symlink_latency": { 2024-08-31T05:44:45.425 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:45.425 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:45.425 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:45.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.426 INFO:teuthology.orchestra.run.smithi070.stdout: "req_unlink_latency": { 2024-08-31T05:44:45.426 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 1750, 2024-08-31T05:44:45.426 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 4.105745313, 2024-08-31T05:44:45.426 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.002346140 2024-08-31T05:44:45.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.426 INFO:teuthology.orchestra.run.smithi070.stdout: "cap_revoke_eviction": 0, 2024-08-31T05:44:45.426 INFO:teuthology.orchestra.run.smithi070.stdout: "cap_acquisition_throttle": 0, 2024-08-31T05:44:45.426 INFO:teuthology.orchestra.run.smithi070.stdout: "req_getvxattr_latency": { 2024-08-31T05:44:45.427 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:45.427 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:45.427 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:45.427 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-08-31T05:44:45.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.427 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_sessions": { 2024-08-31T05:44:45.427 INFO:teuthology.orchestra.run.smithi070.stdout: "session_count": 2, 2024-08-31T05:44:45.427 INFO:teuthology.orchestra.run.smithi070.stdout: "session_add": 3, 2024-08-31T05:44:45.427 INFO:teuthology.orchestra.run.smithi070.stdout: "session_remove": 1, 2024-08-31T05:44:45.428 INFO:teuthology.orchestra.run.smithi070.stdout: "sessions_open": 2, 2024-08-31T05:44:45.428 INFO:teuthology.orchestra.run.smithi070.stdout: "sessions_stale": 0, 2024-08-31T05:44:45.428 INFO:teuthology.orchestra.run.smithi070.stdout: "total_load": 8131, 2024-08-31T05:44:45.428 INFO:teuthology.orchestra.run.smithi070.stdout: "average_load": 4065, 2024-08-31T05:44:45.428 INFO:teuthology.orchestra.run.smithi070.stdout: "avg_session_uptime": 817, 2024-08-31T05:44:45.428 INFO:teuthology.orchestra.run.smithi070.stdout: "mdthresh_evicted": 0 2024-08-31T05:44:45.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.429 INFO:teuthology.orchestra.run.smithi070.stdout: "mempool": { 2024-08-31T05:44:45.429 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_bytes": 0, 2024-08-31T05:44:45.429 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_items": 0, 2024-08-31T05:44:45.429 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T05:44:45.429 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_items": 0, 2024-08-31T05:44:45.429 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T05:44:45.429 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_items": 0, 2024-08-31T05:44:45.429 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T05:44:45.429 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T05:44:45.430 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T05:44:45.430 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T05:44:45.430 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T05:44:45.430 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_items": 0, 2024-08-31T05:44:45.430 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T05:44:45.430 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T05:44:45.430 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_bytes": 0, 2024-08-31T05:44:45.430 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_items": 0, 2024-08-31T05:44:45.431 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_bytes": 0, 2024-08-31T05:44:45.431 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_items": 0, 2024-08-31T05:44:45.431 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T05:44:45.431 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T05:44:45.431 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T05:44:45.431 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T05:44:45.431 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T05:44:45.431 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_items": 0, 2024-08-31T05:44:45.431 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_bytes": 0, 2024-08-31T05:44:45.432 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_items": 0, 2024-08-31T05:44:45.432 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T05:44:45.432 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T05:44:45.432 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_bytes": 0, 2024-08-31T05:44:45.432 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_items": 0, 2024-08-31T05:44:45.432 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_bytes": 0, 2024-08-31T05:44:45.433 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_items": 0, 2024-08-31T05:44:45.433 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T05:44:45.433 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_items": 0, 2024-08-31T05:44:45.433 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T05:44:45.433 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_items": 0, 2024-08-31T05:44:45.433 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_bytes": 987691, 2024-08-31T05:44:45.433 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_items": 573, 2024-08-31T05:44:45.433 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_bytes": 440, 2024-08-31T05:44:45.433 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_items": 5, 2024-08-31T05:44:45.434 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_bytes": 0, 2024-08-31T05:44:45.434 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_items": 0, 2024-08-31T05:44:45.434 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_bytes": 0, 2024-08-31T05:44:45.434 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_items": 0, 2024-08-31T05:44:45.434 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_bytes": 0, 2024-08-31T05:44:45.434 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_items": 0, 2024-08-31T05:44:45.434 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_bytes": 9736, 2024-08-31T05:44:45.434 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_items": 197, 2024-08-31T05:44:45.435 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T05:44:45.435 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_items": 0, 2024-08-31T05:44:45.435 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_bytes": 0, 2024-08-31T05:44:45.435 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_items": 0, 2024-08-31T05:44:45.435 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_bytes": 1462478, 2024-08-31T05:44:45.435 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_items": 27120, 2024-08-31T05:44:45.435 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_bytes": 0, 2024-08-31T05:44:45.436 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_items": 0, 2024-08-31T05:44:45.436 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_bytes": 0, 2024-08-31T05:44:45.436 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_items": 0 2024-08-31T05:44:45.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.436 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter": { 2024-08-31T05:44:45.436 INFO:teuthology.orchestra.run.smithi070.stdout: "op_active": 0, 2024-08-31T05:44:45.436 INFO:teuthology.orchestra.run.smithi070.stdout: "op_laggy": 0, 2024-08-31T05:44:45.437 INFO:teuthology.orchestra.run.smithi070.stdout: "op_send": 6686, 2024-08-31T05:44:45.437 INFO:teuthology.orchestra.run.smithi070.stdout: "op_send_bytes": 20486864, 2024-08-31T05:44:45.437 INFO:teuthology.orchestra.run.smithi070.stdout: "op_resend": 33, 2024-08-31T05:44:45.437 INFO:teuthology.orchestra.run.smithi070.stdout: "op_reply": 6686, 2024-08-31T05:44:45.437 INFO:teuthology.orchestra.run.smithi070.stdout: "op_latency": { 2024-08-31T05:44:45.437 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 6686, 2024-08-31T05:44:45.437 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 51.893467074, 2024-08-31T05:44:45.437 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.007761511 2024-08-31T05:44:45.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.438 INFO:teuthology.orchestra.run.smithi070.stdout: "op_inflight": 0, 2024-08-31T05:44:45.438 INFO:teuthology.orchestra.run.smithi070.stdout: "oplen_avg": { 2024-08-31T05:44:45.438 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 6686, 2024-08-31T05:44:45.438 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 6816 2024-08-31T05:44:45.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.438 INFO:teuthology.orchestra.run.smithi070.stdout: "op": 6686, 2024-08-31T05:44:45.438 INFO:teuthology.orchestra.run.smithi070.stdout: "op_r": 174, 2024-08-31T05:44:45.438 INFO:teuthology.orchestra.run.smithi070.stdout: "op_w": 6512, 2024-08-31T05:44:45.439 INFO:teuthology.orchestra.run.smithi070.stdout: "op_rmw": 0, 2024-08-31T05:44:45.439 INFO:teuthology.orchestra.run.smithi070.stdout: "op_pg": 0, 2024-08-31T05:44:45.439 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_stat": 0, 2024-08-31T05:44:45.439 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_create": 10, 2024-08-31T05:44:45.439 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_read": 72, 2024-08-31T05:44:45.439 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_write": 2905, 2024-08-31T05:44:45.439 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_writefull": 50, 2024-08-31T05:44:45.439 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_writesame": 0, 2024-08-31T05:44:45.440 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_append": 0, 2024-08-31T05:44:45.440 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_zero": 0, 2024-08-31T05:44:45.440 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_truncate": 0, 2024-08-31T05:44:45.440 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_delete": 3468, 2024-08-31T05:44:45.440 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_mapext": 0, 2024-08-31T05:44:45.440 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_sparse_read": 0, 2024-08-31T05:44:45.441 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_clonerange": 0, 2024-08-31T05:44:45.441 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_getxattr": 102, 2024-08-31T05:44:45.441 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_setxattr": 20, 2024-08-31T05:44:45.441 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_cmpxattr": 0, 2024-08-31T05:44:45.441 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_rmxattr": 0, 2024-08-31T05:44:45.441 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_resetxattrs": 0, 2024-08-31T05:44:45.441 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_call": 0, 2024-08-31T05:44:45.441 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_watch": 0, 2024-08-31T05:44:45.442 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_notify": 0, 2024-08-31T05:44:45.442 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_src_cmpxattr": 0, 2024-08-31T05:44:45.442 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_pgls": 0, 2024-08-31T05:44:45.442 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_pgls_filter": 0, 2024-08-31T05:44:45.442 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_other": 0, 2024-08-31T05:44:45.442 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_active": 0, 2024-08-31T05:44:45.443 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_send": 0, 2024-08-31T05:44:45.443 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_resend": 0, 2024-08-31T05:44:45.443 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_ping": 0, 2024-08-31T05:44:45.443 INFO:teuthology.orchestra.run.smithi070.stdout: "poolop_active": 0, 2024-08-31T05:44:45.443 INFO:teuthology.orchestra.run.smithi070.stdout: "poolop_send": 0, 2024-08-31T05:44:45.443 INFO:teuthology.orchestra.run.smithi070.stdout: "poolop_resend": 0, 2024-08-31T05:44:45.443 INFO:teuthology.orchestra.run.smithi070.stdout: "poolstat_active": 0, 2024-08-31T05:44:45.443 INFO:teuthology.orchestra.run.smithi070.stdout: "poolstat_send": 0, 2024-08-31T05:44:45.444 INFO:teuthology.orchestra.run.smithi070.stdout: "poolstat_resend": 0, 2024-08-31T05:44:45.444 INFO:teuthology.orchestra.run.smithi070.stdout: "statfs_active": 0, 2024-08-31T05:44:45.444 INFO:teuthology.orchestra.run.smithi070.stdout: "statfs_send": 0, 2024-08-31T05:44:45.444 INFO:teuthology.orchestra.run.smithi070.stdout: "statfs_resend": 0, 2024-08-31T05:44:45.444 INFO:teuthology.orchestra.run.smithi070.stdout: "command_active": 0, 2024-08-31T05:44:45.444 INFO:teuthology.orchestra.run.smithi070.stdout: "command_send": 0, 2024-08-31T05:44:45.444 INFO:teuthology.orchestra.run.smithi070.stdout: "command_resend": 0, 2024-08-31T05:44:45.444 INFO:teuthology.orchestra.run.smithi070.stdout: "map_epoch": 103, 2024-08-31T05:44:45.444 INFO:teuthology.orchestra.run.smithi070.stdout: "map_full": 0, 2024-08-31T05:44:45.445 INFO:teuthology.orchestra.run.smithi070.stdout: "map_inc": 18, 2024-08-31T05:44:45.445 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_sessions": 12, 2024-08-31T05:44:45.445 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_session_open": 18, 2024-08-31T05:44:45.445 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_session_close": 6, 2024-08-31T05:44:45.445 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_laggy": 0, 2024-08-31T05:44:45.445 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_wr": 138, 2024-08-31T05:44:45.445 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_rd": 0, 2024-08-31T05:44:45.446 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_del": 51 2024-08-31T05:44:45.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.446 INFO:teuthology.orchestra.run.smithi070.stdout: "oft": { 2024-08-31T05:44:45.446 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_objs": 1, 2024-08-31T05:44:45.446 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_kv_pairs": 0, 2024-08-31T05:44:45.446 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_updates": 0, 2024-08-31T05:44:45.446 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_removes": 0 2024-08-31T05:44:45.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.447 INFO:teuthology.orchestra.run.smithi070.stdout: "purge_queue": { 2024-08-31T05:44:45.447 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing_ops": 0, 2024-08-31T05:44:45.447 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing_ops_high_water": 10, 2024-08-31T05:44:45.447 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing": 0, 2024-08-31T05:44:45.447 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing_high_water": 5, 2024-08-31T05:44:45.447 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executed_ops": 3452, 2024-08-31T05:44:45.447 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executed": 1726, 2024-08-31T05:44:45.447 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_item_in_journal": 0 2024-08-31T05:44:45.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.448 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T05:44:45.448 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-08-31T05:44:45.448 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 104857600, 2024-08-31T05:44:45.448 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-08-31T05:44:45.448 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 360411, 2024-08-31T05:44:45.448 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 113167436, 2024-08-31T05:44:45.448 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-08-31T05:44:45.449 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 360411, 2024-08-31T05:44:45.449 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-08-31T05:44:45.449 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-08-31T05:44:45.449 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 360411, 2024-08-31T05:44:45.449 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 113167436, 2024-08-31T05:44:45.449 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-08-31T05:44:45.449 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:45.449 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:45.450 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:45.450 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-08-31T05:44:45.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.450 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-objecter_bytes": { 2024-08-31T05:44:45.450 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-08-31T05:44:45.450 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 104857600, 2024-08-31T05:44:45.450 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-08-31T05:44:45.450 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 0, 2024-08-31T05:44:45.450 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 0, 2024-08-31T05:44:45.451 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-08-31T05:44:45.451 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 0, 2024-08-31T05:44:45.451 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 6686, 2024-08-31T05:44:45.451 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 20675046, 2024-08-31T05:44:45.451 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 6686, 2024-08-31T05:44:45.451 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 20675046, 2024-08-31T05:44:45.451 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-08-31T05:44:45.451 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:45.452 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:45.452 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:45.452 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-08-31T05:44:45.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.452 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-objecter_ops": { 2024-08-31T05:44:45.452 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-08-31T05:44:45.453 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 1024, 2024-08-31T05:44:45.453 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-08-31T05:44:45.453 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 0, 2024-08-31T05:44:45.453 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 0, 2024-08-31T05:44:45.453 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-08-31T05:44:45.453 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 0, 2024-08-31T05:44:45.453 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 6686, 2024-08-31T05:44:45.453 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 6686, 2024-08-31T05:44:45.454 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 6686, 2024-08-31T05:44:45.454 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 6686, 2024-08-31T05:44:45.454 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-08-31T05:44:45.454 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:45.455 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:45.455 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:45.455 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-08-31T05:44:45.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.456 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-write_buf_throttle": { 2024-08-31T05:44:45.456 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-08-31T05:44:45.456 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 3758096384, 2024-08-31T05:44:45.456 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-08-31T05:44:45.457 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 1726, 2024-08-31T05:44:45.457 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 188182, 2024-08-31T05:44:45.457 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-08-31T05:44:45.457 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 1726, 2024-08-31T05:44:45.458 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-08-31T05:44:45.458 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-08-31T05:44:45.458 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 72, 2024-08-31T05:44:45.458 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 188182, 2024-08-31T05:44:45.459 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-08-31T05:44:45.459 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:45.459 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:45.459 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:45.459 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-08-31T05:44:45.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.459 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-write_buf_throttle-0x55ad3460c820": { 2024-08-31T05:44:45.459 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 34093, 2024-08-31T05:44:45.459 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 3758096384, 2024-08-31T05:44:45.460 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-08-31T05:44:45.460 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 8582, 2024-08-31T05:44:45.460 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 20126053, 2024-08-31T05:44:45.460 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-08-31T05:44:45.460 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 8582, 2024-08-31T05:44:45.460 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-08-31T05:44:45.460 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-08-31T05:44:45.460 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 2833, 2024-08-31T05:44:45.460 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 20091960, 2024-08-31T05:44:45.461 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-08-31T05:44:45.461 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:45.461 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:45.461 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:45.461 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-08-31T05:44:45.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:45.461 INFO:teuthology.orchestra.run.smithi070.stdout: "trackedop": { 2024-08-31T05:44:45.462 INFO:teuthology.orchestra.run.smithi070.stdout: "slow_ops_count": 0 2024-08-31T05:44:45.462 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-08-31T05:44:45.462 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-08-31T05:44:45.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:44:45 smithi005 ceph-mon[18602]: pgmap v804: 129 pgs: 129 active+clean; 861 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 1.4 MiB/s wr, 79 op/s 2024-08-31T05:44:45.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:44:45 smithi050 ceph-mon[22146]: pgmap v804: 129 pgs: 129 active+clean; 861 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 1.4 MiB/s wr, 79 op/s 2024-08-31T05:44:46.803 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-08-31T05:44:46.803 INFO:tasks.check_counter:Daemon mds.f mds.imported=3 2024-08-31T05:44:46.803 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=69 2024-08-31T05:44:46.803 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=370 2024-08-31T05:44:46.803 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=6 2024-08-31T05:44:46.803 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-08-31T05:44:46.804 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-08-31T05:44:46.804 DEBUG:tasks.check_counter:Getting stats from i 2024-08-31T05:44:46.804 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph daemon mds.i perf dump 2024-08-31T05:44:47.057 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T05:44:47.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:44:47 smithi050 ceph-mon[22146]: pgmap v805: 129 pgs: 129 active+clean; 861 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 2.3 MiB/s wr, 106 op/s 2024-08-31T05:44:47.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:44:47 smithi005 ceph-mon[18602]: pgmap v805: 129 pgs: 129 active+clean; 861 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 2.3 MiB/s wr, 106 op/s 2024-08-31T05:44:47.504 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:44:47 smithi070 ceph-mon[22316]: pgmap v805: 129 pgs: 129 active+clean; 861 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 2.3 MiB/s wr, 106 op/s 2024-08-31T05:44:47.648 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-08-31T05:44:47.649 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T05:44:47.649 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 13119, 2024-08-31T05:44:47.649 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 18802, 2024-08-31T05:44:47.649 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 3410089, 2024-08-31T05:44:47.649 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 18981218, 2024-08-31T05:44:47.649 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 31, 2024-08-31T05:44:47.649 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 4, 2024-08-31T05:44:47.650 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 1.321157635, 2024-08-31T05:44:47.650 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.617764202, 2024-08-31T05:44:47.650 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.486039488, 2024-08-31T05:44:47.650 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.205888710, 2024-08-31T05:44:47.650 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T05:44:47.650 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 18806, 2024-08-31T05:44:47.650 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 2.982173843, 2024-08-31T05:44:47.650 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000158575 2024-08-31T05:44:47.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.651 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-08-31T05:44:47.651 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 23575, 2024-08-31T05:44:47.651 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.004497493, 2024-08-31T05:44:47.651 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000190 2024-08-31T05:44:47.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.651 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 437200, 2024-08-31T05:44:47.651 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 132224 2024-08-31T05:44:47.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.652 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T05:44:47.652 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 306445, 2024-08-31T05:44:47.652 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 161068, 2024-08-31T05:44:47.652 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 131898557, 2024-08-31T05:44:47.652 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 36733457, 2024-08-31T05:44:47.652 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 19, 2024-08-31T05:44:47.652 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 6, 2024-08-31T05:44:47.652 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 18.171500554, 2024-08-31T05:44:47.653 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 8.835503436, 2024-08-31T05:44:47.653 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 12.249097529, 2024-08-31T05:44:47.653 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.183980270, 2024-08-31T05:44:47.653 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T05:44:47.653 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 161069, 2024-08-31T05:44:47.653 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 5.437420897, 2024-08-31T05:44:47.653 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000033758 2024-08-31T05:44:47.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.654 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-08-31T05:44:47.654 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 458506, 2024-08-31T05:44:47.654 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.078808871, 2024-08-31T05:44:47.654 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000171 2024-08-31T05:44:47.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.654 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 160, 2024-08-31T05:44:47.654 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 473440 2024-08-31T05:44:47.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.654 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T05:44:47.655 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 65026, 2024-08-31T05:44:47.655 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 77944, 2024-08-31T05:44:47.655 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 20256634, 2024-08-31T05:44:47.655 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 40728545, 2024-08-31T05:44:47.655 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 262, 2024-08-31T05:44:47.655 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 11, 2024-08-31T05:44:47.655 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 5.622576194, 2024-08-31T05:44:47.655 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 2.756620240, 2024-08-31T05:44:47.656 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 2.912875791, 2024-08-31T05:44:47.656 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.357986190, 2024-08-31T05:44:47.656 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T05:44:47.656 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 77935, 2024-08-31T05:44:47.656 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 4.630555432, 2024-08-31T05:44:47.656 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000059415 2024-08-31T05:44:47.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.656 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-08-31T05:44:47.657 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 127547, 2024-08-31T05:44:47.657 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.024526258, 2024-08-31T05:44:47.657 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000192 2024-08-31T05:44:47.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.657 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 1382496, 2024-08-31T05:44:47.657 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 241680 2024-08-31T05:44:47.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.657 INFO:teuthology.orchestra.run.smithi070.stdout: "cct": { 2024-08-31T05:44:47.658 INFO:teuthology.orchestra.run.smithi070.stdout: "total_workers": 1, 2024-08-31T05:44:47.658 INFO:teuthology.orchestra.run.smithi070.stdout: "unhealthy_workers": 0 2024-08-31T05:44:47.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.658 INFO:teuthology.orchestra.run.smithi070.stdout: "finisher-MDSRank": { 2024-08-31T05:44:47.658 INFO:teuthology.orchestra.run.smithi070.stdout: "queue_len": 0, 2024-08-31T05:44:47.658 INFO:teuthology.orchestra.run.smithi070.stdout: "complete_latency": { 2024-08-31T05:44:47.658 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 7812, 2024-08-31T05:44:47.658 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 7.591604196, 2024-08-31T05:44:47.658 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000971787 2024-08-31T05:44:47.659 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-08-31T05:44:47.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.659 INFO:teuthology.orchestra.run.smithi070.stdout: "finisher-PurgeQueue": { 2024-08-31T05:44:47.659 INFO:teuthology.orchestra.run.smithi070.stdout: "queue_len": 0, 2024-08-31T05:44:47.659 INFO:teuthology.orchestra.run.smithi070.stdout: "complete_latency": { 2024-08-31T05:44:47.659 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 3274, 2024-08-31T05:44:47.659 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.352629320, 2024-08-31T05:44:47.659 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000107705 2024-08-31T05:44:47.660 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-08-31T05:44:47.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.660 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": { 2024-08-31T05:44:47.660 INFO:teuthology.orchestra.run.smithi070.stdout: "request": 40423, 2024-08-31T05:44:47.660 INFO:teuthology.orchestra.run.smithi070.stdout: "reply": 11685, 2024-08-31T05:44:47.660 INFO:teuthology.orchestra.run.smithi070.stdout: "reply_latency": { 2024-08-31T05:44:47.661 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 11685, 2024-08-31T05:44:47.661 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 39.792769672, 2024-08-31T05:44:47.661 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.003405457 2024-08-31T05:44:47.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.661 INFO:teuthology.orchestra.run.smithi070.stdout: "slow_reply": 0, 2024-08-31T05:44:47.661 INFO:teuthology.orchestra.run.smithi070.stdout: "forward": 28738, 2024-08-31T05:44:47.661 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_fetch_complete": 4, 2024-08-31T05:44:47.661 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_fetch_keys": 1, 2024-08-31T05:44:47.662 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_commit": 540, 2024-08-31T05:44:47.662 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_split": 0, 2024-08-31T05:44:47.662 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_merge": 0, 2024-08-31T05:44:47.662 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes": 695, 2024-08-31T05:44:47.662 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_top": 93, 2024-08-31T05:44:47.662 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_bottom": 591, 2024-08-31T05:44:47.662 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_pin_tail": 11, 2024-08-31T05:44:47.662 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_pinned": 558, 2024-08-31T05:44:47.663 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_expired": 160, 2024-08-31T05:44:47.663 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_with_caps": 84, 2024-08-31T05:44:47.663 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": 85, 2024-08-31T05:44:47.663 INFO:teuthology.orchestra.run.smithi070.stdout: "subtrees": 9, 2024-08-31T05:44:47.663 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse": 48763, 2024-08-31T05:44:47.663 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_hit": 11215, 2024-08-31T05:44:47.663 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_forward": 28737, 2024-08-31T05:44:47.663 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_discover": 99, 2024-08-31T05:44:47.664 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_dir_fetch": 0, 2024-08-31T05:44:47.664 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_remote_ino": 0, 2024-08-31T05:44:47.664 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_lock": 168, 2024-08-31T05:44:47.664 INFO:teuthology.orchestra.run.smithi070.stdout: "load_cent": 0, 2024-08-31T05:44:47.664 INFO:teuthology.orchestra.run.smithi070.stdout: "q": 0, 2024-08-31T05:44:47.664 INFO:teuthology.orchestra.run.smithi070.stdout: "exported": 1, 2024-08-31T05:44:47.664 INFO:teuthology.orchestra.run.smithi070.stdout: "exported_inodes": 150, 2024-08-31T05:44:47.664 INFO:teuthology.orchestra.run.smithi070.stdout: "imported": 3, 2024-08-31T05:44:47.664 INFO:teuthology.orchestra.run.smithi070.stdout: "imported_inodes": 84, 2024-08-31T05:44:47.665 INFO:teuthology.orchestra.run.smithi070.stdout: "openino_dir_fetch": 0, 2024-08-31T05:44:47.665 INFO:teuthology.orchestra.run.smithi070.stdout: "openino_backtrace_fetch": 322, 2024-08-31T05:44:47.665 INFO:teuthology.orchestra.run.smithi070.stdout: "openino_peer_discover": 0, 2024-08-31T05:44:47.665 INFO:teuthology.orchestra.run.smithi070.stdout: "root_rfiles": 668, 2024-08-31T05:44:47.665 INFO:teuthology.orchestra.run.smithi070.stdout: "root_rbytes": 211661716, 2024-08-31T05:44:47.665 INFO:teuthology.orchestra.run.smithi070.stdout: "root_rsnaps": 6, 2024-08-31T05:44:47.665 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_backtrace_fetch": 322, 2024-08-31T05:44:47.665 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_set_tag": 0, 2024-08-31T05:44:47.666 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_backtrace_repaired": 0, 2024-08-31T05:44:47.666 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_inotable_repaired": 0, 2024-08-31T05:44:47.666 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_dir_inodes": 184, 2024-08-31T05:44:47.666 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_dir_base_inodes": 18, 2024-08-31T05:44:47.666 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_dirfrag_rstats": 166, 2024-08-31T05:44:47.666 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_file_inodes": 138, 2024-08-31T05:44:47.666 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_inode_file_caps": 2, 2024-08-31T05:44:47.667 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_revoke": 6594, 2024-08-31T05:44:47.667 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_grant": 11492, 2024-08-31T05:44:47.667 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_trunc": 0, 2024-08-31T05:44:47.667 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-31T05:44:47.667 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-31T05:44:47.667 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_caps": 9139, 2024-08-31T05:44:47.667 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_caps_dirty": 1443, 2024-08-31T05:44:47.667 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_cap_release": 655, 2024-08-31T05:44:47.668 INFO:teuthology.orchestra.run.smithi070.stdout: "process_request_cap_release": 7423 2024-08-31T05:44:47.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.668 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache": { 2024-08-31T05:44:47.668 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_update": 112, 2024-08-31T05:44:47.668 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_update_receipt": 337, 2024-08-31T05:44:47.668 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_try_discover": 216, 2024-08-31T05:44:47.668 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_send_discover": 247, 2024-08-31T05:44:47.668 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_handle_discover": 219, 2024-08-31T05:44:47.669 INFO:teuthology.orchestra.run.smithi070.stdout: "num_strays": 45, 2024-08-31T05:44:47.669 INFO:teuthology.orchestra.run.smithi070.stdout: "num_strays_delayed": 34, 2024-08-31T05:44:47.669 INFO:teuthology.orchestra.run.smithi070.stdout: "num_strays_enqueuing": 0, 2024-08-31T05:44:47.669 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_created": 1757, 2024-08-31T05:44:47.669 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_enqueued": 1712, 2024-08-31T05:44:47.669 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_reintegrated": 0, 2024-08-31T05:44:47.669 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_migrated": 0, 2024-08-31T05:44:47.669 INFO:teuthology.orchestra.run.smithi070.stdout: "num_recovering_processing": 0, 2024-08-31T05:44:47.670 INFO:teuthology.orchestra.run.smithi070.stdout: "num_recovering_enqueued": 0, 2024-08-31T05:44:47.670 INFO:teuthology.orchestra.run.smithi070.stdout: "num_recovering_prioritized": 0, 2024-08-31T05:44:47.670 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_started": 0, 2024-08-31T05:44:47.670 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_completed": 0, 2024-08-31T05:44:47.670 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_quiesce_path": 0, 2024-08-31T05:44:47.670 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_quiesce_inode": 0, 2024-08-31T05:44:47.670 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_enqueue_scrub": 18, 2024-08-31T05:44:47.670 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_exportdir": 1, 2024-08-31T05:44:47.670 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_flush": 0, 2024-08-31T05:44:47.671 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_fragmentdir": 0, 2024-08-31T05:44:47.671 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_fragstats": 0, 2024-08-31T05:44:47.671 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_inodestats": 0, 2024-08-31T05:44:47.671 INFO:teuthology.orchestra.run.smithi070.stdout: "uninline_started": 0, 2024-08-31T05:44:47.671 INFO:teuthology.orchestra.run.smithi070.stdout: "uninline_succeeded": 0, 2024-08-31T05:44:47.671 INFO:teuthology.orchestra.run.smithi070.stdout: "uninline_write_failed": 0 2024-08-31T05:44:47.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.671 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log": { 2024-08-31T05:44:47.672 INFO:teuthology.orchestra.run.smithi070.stdout: "evlrg": 0, 2024-08-31T05:44:47.672 INFO:teuthology.orchestra.run.smithi070.stdout: "evadd": 8977, 2024-08-31T05:44:47.672 INFO:teuthology.orchestra.run.smithi070.stdout: "evex": 8010, 2024-08-31T05:44:47.672 INFO:teuthology.orchestra.run.smithi070.stdout: "evtrm": 8010, 2024-08-31T05:44:47.672 INFO:teuthology.orchestra.run.smithi070.stdout: "ev": 967, 2024-08-31T05:44:47.672 INFO:teuthology.orchestra.run.smithi070.stdout: "evexg": 0, 2024-08-31T05:44:47.672 INFO:teuthology.orchestra.run.smithi070.stdout: "evexd": 1261, 2024-08-31T05:44:47.672 INFO:teuthology.orchestra.run.smithi070.stdout: "segadd": 73, 2024-08-31T05:44:47.673 INFO:teuthology.orchestra.run.smithi070.stdout: "segex": 72, 2024-08-31T05:44:47.673 INFO:teuthology.orchestra.run.smithi070.stdout: "segtrm": 72, 2024-08-31T05:44:47.673 INFO:teuthology.orchestra.run.smithi070.stdout: "seg": 1, 2024-08-31T05:44:47.673 INFO:teuthology.orchestra.run.smithi070.stdout: "segmjr": 1, 2024-08-31T05:44:47.673 INFO:teuthology.orchestra.run.smithi070.stdout: "segexg": 0, 2024-08-31T05:44:47.673 INFO:teuthology.orchestra.run.smithi070.stdout: "segexd": 2, 2024-08-31T05:44:47.673 INFO:teuthology.orchestra.run.smithi070.stdout: "expos": 26074878, 2024-08-31T05:44:47.673 INFO:teuthology.orchestra.run.smithi070.stdout: "wrpos": 28118341, 2024-08-31T05:44:47.673 INFO:teuthology.orchestra.run.smithi070.stdout: "rdpos": 0, 2024-08-31T05:44:47.674 INFO:teuthology.orchestra.run.smithi070.stdout: "jlat": { 2024-08-31T05:44:47.674 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 3319, 2024-08-31T05:44:47.674 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 13.659138260, 2024-08-31T05:44:47.674 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.004115437 2024-08-31T05:44:47.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.674 INFO:teuthology.orchestra.run.smithi070.stdout: "replayed": 0 2024-08-31T05:44:47.674 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.674 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_mem": { 2024-08-31T05:44:47.675 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 348, 2024-08-31T05:44:47.675 INFO:teuthology.orchestra.run.smithi070.stdout: "ino+": 2178, 2024-08-31T05:44:47.675 INFO:teuthology.orchestra.run.smithi070.stdout: "ino-": 1830, 2024-08-31T05:44:47.675 INFO:teuthology.orchestra.run.smithi070.stdout: "dir": 152, 2024-08-31T05:44:47.675 INFO:teuthology.orchestra.run.smithi070.stdout: "dir+": 205, 2024-08-31T05:44:47.675 INFO:teuthology.orchestra.run.smithi070.stdout: "dir-": 53, 2024-08-31T05:44:47.675 INFO:teuthology.orchestra.run.smithi070.stdout: "dn": 694, 2024-08-31T05:44:47.675 INFO:teuthology.orchestra.run.smithi070.stdout: "dn+": 4535, 2024-08-31T05:44:47.676 INFO:teuthology.orchestra.run.smithi070.stdout: "dn-": 3841, 2024-08-31T05:44:47.676 INFO:teuthology.orchestra.run.smithi070.stdout: "cap": 85, 2024-08-31T05:44:47.676 INFO:teuthology.orchestra.run.smithi070.stdout: "cap+": 2114, 2024-08-31T05:44:47.676 INFO:teuthology.orchestra.run.smithi070.stdout: "cap-": 2029, 2024-08-31T05:44:47.676 INFO:teuthology.orchestra.run.smithi070.stdout: "rss": 135840, 2024-08-31T05:44:47.676 INFO:teuthology.orchestra.run.smithi070.stdout: "heap": 353255424 2024-08-31T05:44:47.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.676 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_server": { 2024-08-31T05:44:47.677 INFO:teuthology.orchestra.run.smithi070.stdout: "dispatch_client_request": 45750, 2024-08-31T05:44:47.677 INFO:teuthology.orchestra.run.smithi070.stdout: "dispatch_server_request": 180, 2024-08-31T05:44:47.677 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_request": 40423, 2024-08-31T05:44:47.677 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_session": 288, 2024-08-31T05:44:47.677 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_peer_request": 537, 2024-08-31T05:44:47.677 INFO:teuthology.orchestra.run.smithi070.stdout: "req_create_latency": { 2024-08-31T05:44:47.677 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 1867, 2024-08-31T05:44:47.677 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 8.723959044, 2024-08-31T05:44:47.678 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.004672715 2024-08-31T05:44:47.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.678 INFO:teuthology.orchestra.run.smithi070.stdout: "req_getattr_latency": { 2024-08-31T05:44:47.678 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 346, 2024-08-31T05:44:47.678 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 2.480369917, 2024-08-31T05:44:47.678 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.007168699 2024-08-31T05:44:47.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.678 INFO:teuthology.orchestra.run.smithi070.stdout: "req_getfilelock_latency": { 2024-08-31T05:44:47.679 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:47.679 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:47.679 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:47.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.679 INFO:teuthology.orchestra.run.smithi070.stdout: "req_link_latency": { 2024-08-31T05:44:47.679 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:47.679 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:47.679 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:47.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.680 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookup_latency": { 2024-08-31T05:44:47.680 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 4285, 2024-08-31T05:44:47.680 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 4.763288630, 2024-08-31T05:44:47.680 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.001111619 2024-08-31T05:44:47.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.680 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookuphash_latency": { 2024-08-31T05:44:47.680 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:47.681 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:47.681 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:47.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.681 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupino_latency": { 2024-08-31T05:44:47.681 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 1, 2024-08-31T05:44:47.681 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000187811, 2024-08-31T05:44:47.681 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000187811 2024-08-31T05:44:47.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.681 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupname_latency": { 2024-08-31T05:44:47.682 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:47.682 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:47.682 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:47.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.682 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupparent_latency": { 2024-08-31T05:44:47.682 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:47.682 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:47.682 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:47.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.683 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupsnap_latency": { 2024-08-31T05:44:47.684 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:47.684 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:47.684 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:47.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.684 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lssnap_latency": { 2024-08-31T05:44:47.684 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 14, 2024-08-31T05:44:47.684 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.002324200, 2024-08-31T05:44:47.684 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000166014 2024-08-31T05:44:47.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.685 INFO:teuthology.orchestra.run.smithi070.stdout: "req_mkdir_latency": { 2024-08-31T05:44:47.685 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 20, 2024-08-31T05:44:47.685 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.026607521, 2024-08-31T05:44:47.685 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.001330376 2024-08-31T05:44:47.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.685 INFO:teuthology.orchestra.run.smithi070.stdout: "req_mknod_latency": { 2024-08-31T05:44:47.685 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:47.686 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:47.686 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:47.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.686 INFO:teuthology.orchestra.run.smithi070.stdout: "req_mksnap_latency": { 2024-08-31T05:44:47.686 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 14, 2024-08-31T05:44:47.686 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 2.195158381, 2024-08-31T05:44:47.686 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.156797027 2024-08-31T05:44:47.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.687 INFO:teuthology.orchestra.run.smithi070.stdout: "req_open_latency": { 2024-08-31T05:44:47.687 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 1, 2024-08-31T05:44:47.687 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000356044, 2024-08-31T05:44:47.687 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000356044 2024-08-31T05:44:47.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.687 INFO:teuthology.orchestra.run.smithi070.stdout: "req_readdir_latency": { 2024-08-31T05:44:47.687 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 2929, 2024-08-31T05:44:47.687 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 13.004554125, 2024-08-31T05:44:47.687 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.004439929 2024-08-31T05:44:47.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.688 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rename_latency": { 2024-08-31T05:44:47.688 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 371, 2024-08-31T05:44:47.688 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 2.459228355, 2024-08-31T05:44:47.688 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.006628647 2024-08-31T05:44:47.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.689 INFO:teuthology.orchestra.run.smithi070.stdout: "req_renamesnap_latency": { 2024-08-31T05:44:47.689 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:47.689 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:47.689 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:47.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.689 INFO:teuthology.orchestra.run.smithi070.stdout: "req_snapdiff_latency": { 2024-08-31T05:44:47.690 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:47.690 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:47.690 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:47.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.690 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rmdir_latency": { 2024-08-31T05:44:47.690 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 1, 2024-08-31T05:44:47.690 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.056800605, 2024-08-31T05:44:47.690 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.056800605 2024-08-31T05:44:47.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.691 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rmsnap_latency": { 2024-08-31T05:44:47.691 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 8, 2024-08-31T05:44:47.691 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 1.335181973, 2024-08-31T05:44:47.691 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.166897746 2024-08-31T05:44:47.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.691 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rmxattr_latency": { 2024-08-31T05:44:47.691 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:47.692 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:47.692 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:47.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.692 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setattr_latency": { 2024-08-31T05:44:47.692 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 2, 2024-08-31T05:44:47.692 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.001434915, 2024-08-31T05:44:47.692 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000717457 2024-08-31T05:44:47.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.693 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setdirlayout_latency": { 2024-08-31T05:44:47.693 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:47.693 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:47.693 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:47.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.693 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setfilelock_latency": { 2024-08-31T05:44:47.693 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 60, 2024-08-31T05:44:47.693 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.053783878, 2024-08-31T05:44:47.694 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000896397 2024-08-31T05:44:47.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.694 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setlayout_latency": { 2024-08-31T05:44:47.694 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:47.694 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:47.694 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:47.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.694 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setxattr_latency": { 2024-08-31T05:44:47.694 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 9, 2024-08-31T05:44:47.695 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.024553438, 2024-08-31T05:44:47.695 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.002728159 2024-08-31T05:44:47.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.695 INFO:teuthology.orchestra.run.smithi070.stdout: "req_symlink_latency": { 2024-08-31T05:44:47.695 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:47.695 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:47.695 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:47.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.696 INFO:teuthology.orchestra.run.smithi070.stdout: "req_unlink_latency": { 2024-08-31T05:44:47.696 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 1757, 2024-08-31T05:44:47.696 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 4.664980835, 2024-08-31T05:44:47.696 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.002655083 2024-08-31T05:44:47.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.696 INFO:teuthology.orchestra.run.smithi070.stdout: "cap_revoke_eviction": 0, 2024-08-31T05:44:47.696 INFO:teuthology.orchestra.run.smithi070.stdout: "cap_acquisition_throttle": 0, 2024-08-31T05:44:47.696 INFO:teuthology.orchestra.run.smithi070.stdout: "req_getvxattr_latency": { 2024-08-31T05:44:47.697 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:47.697 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:47.697 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:47.697 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-08-31T05:44:47.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.697 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_sessions": { 2024-08-31T05:44:47.697 INFO:teuthology.orchestra.run.smithi070.stdout: "session_count": 2, 2024-08-31T05:44:47.698 INFO:teuthology.orchestra.run.smithi070.stdout: "session_add": 5, 2024-08-31T05:44:47.698 INFO:teuthology.orchestra.run.smithi070.stdout: "session_remove": 3, 2024-08-31T05:44:47.698 INFO:teuthology.orchestra.run.smithi070.stdout: "sessions_open": 2, 2024-08-31T05:44:47.698 INFO:teuthology.orchestra.run.smithi070.stdout: "sessions_stale": 0, 2024-08-31T05:44:47.698 INFO:teuthology.orchestra.run.smithi070.stdout: "total_load": 6161, 2024-08-31T05:44:47.698 INFO:teuthology.orchestra.run.smithi070.stdout: "average_load": 3080, 2024-08-31T05:44:47.698 INFO:teuthology.orchestra.run.smithi070.stdout: "avg_session_uptime": 859, 2024-08-31T05:44:47.698 INFO:teuthology.orchestra.run.smithi070.stdout: "mdthresh_evicted": 0 2024-08-31T05:44:47.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.699 INFO:teuthology.orchestra.run.smithi070.stdout: "mempool": { 2024-08-31T05:44:47.699 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_bytes": 0, 2024-08-31T05:44:47.699 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_items": 0, 2024-08-31T05:44:47.699 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T05:44:47.699 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_items": 0, 2024-08-31T05:44:47.699 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T05:44:47.699 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_items": 0, 2024-08-31T05:44:47.699 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T05:44:47.700 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T05:44:47.700 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T05:44:47.700 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T05:44:47.700 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T05:44:47.700 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_items": 0, 2024-08-31T05:44:47.700 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T05:44:47.700 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T05:44:47.700 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_bytes": 0, 2024-08-31T05:44:47.701 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_items": 0, 2024-08-31T05:44:47.701 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_bytes": 0, 2024-08-31T05:44:47.701 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_items": 0, 2024-08-31T05:44:47.701 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T05:44:47.701 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T05:44:47.701 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T05:44:47.701 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T05:44:47.701 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T05:44:47.702 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_items": 0, 2024-08-31T05:44:47.702 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_bytes": 0, 2024-08-31T05:44:47.702 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_items": 0, 2024-08-31T05:44:47.702 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T05:44:47.702 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T05:44:47.702 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_bytes": 0, 2024-08-31T05:44:47.702 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_items": 0, 2024-08-31T05:44:47.702 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_bytes": 0, 2024-08-31T05:44:47.702 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_items": 0, 2024-08-31T05:44:47.703 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T05:44:47.703 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_items": 0, 2024-08-31T05:44:47.703 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T05:44:47.703 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_items": 0, 2024-08-31T05:44:47.703 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_bytes": 988410, 2024-08-31T05:44:47.703 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_items": 601, 2024-08-31T05:44:47.703 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_bytes": 352, 2024-08-31T05:44:47.704 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_items": 4, 2024-08-31T05:44:47.704 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_bytes": 0, 2024-08-31T05:44:47.704 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_items": 0, 2024-08-31T05:44:47.704 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_bytes": 0, 2024-08-31T05:44:47.704 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_items": 0, 2024-08-31T05:44:47.704 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_bytes": 0, 2024-08-31T05:44:47.704 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_items": 0, 2024-08-31T05:44:47.704 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_bytes": 9736, 2024-08-31T05:44:47.705 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_items": 197, 2024-08-31T05:44:47.705 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T05:44:47.705 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_items": 0, 2024-08-31T05:44:47.705 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_bytes": 0, 2024-08-31T05:44:47.705 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_items": 0, 2024-08-31T05:44:47.705 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_bytes": 1800398, 2024-08-31T05:44:47.705 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_items": 28059, 2024-08-31T05:44:47.705 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_bytes": 0, 2024-08-31T05:44:47.706 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_items": 0, 2024-08-31T05:44:47.706 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_bytes": 0, 2024-08-31T05:44:47.706 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_items": 0 2024-08-31T05:44:47.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.706 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter": { 2024-08-31T05:44:47.706 INFO:teuthology.orchestra.run.smithi070.stdout: "op_active": 0, 2024-08-31T05:44:47.706 INFO:teuthology.orchestra.run.smithi070.stdout: "op_laggy": 0, 2024-08-31T05:44:47.706 INFO:teuthology.orchestra.run.smithi070.stdout: "op_send": 10563, 2024-08-31T05:44:47.706 INFO:teuthology.orchestra.run.smithi070.stdout: "op_send_bytes": 27197656, 2024-08-31T05:44:47.707 INFO:teuthology.orchestra.run.smithi070.stdout: "op_resend": 37, 2024-08-31T05:44:47.707 INFO:teuthology.orchestra.run.smithi070.stdout: "op_reply": 10563, 2024-08-31T05:44:47.707 INFO:teuthology.orchestra.run.smithi070.stdout: "op_latency": { 2024-08-31T05:44:47.707 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 10563, 2024-08-31T05:44:47.707 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 209.390762555, 2024-08-31T05:44:47.707 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.019823039 2024-08-31T05:44:47.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.707 INFO:teuthology.orchestra.run.smithi070.stdout: "op_inflight": 0, 2024-08-31T05:44:47.708 INFO:teuthology.orchestra.run.smithi070.stdout: "oplen_avg": { 2024-08-31T05:44:47.708 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 10563, 2024-08-31T05:44:47.708 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 14490 2024-08-31T05:44:47.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.708 INFO:teuthology.orchestra.run.smithi070.stdout: "op": 10563, 2024-08-31T05:44:47.708 INFO:teuthology.orchestra.run.smithi070.stdout: "op_r": 442, 2024-08-31T05:44:47.708 INFO:teuthology.orchestra.run.smithi070.stdout: "op_w": 10121, 2024-08-31T05:44:47.709 INFO:teuthology.orchestra.run.smithi070.stdout: "op_rmw": 0, 2024-08-31T05:44:47.709 INFO:teuthology.orchestra.run.smithi070.stdout: "op_pg": 0, 2024-08-31T05:44:47.709 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_stat": 497, 2024-08-31T05:44:47.709 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_create": 1785, 2024-08-31T05:44:47.709 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_read": 97, 2024-08-31T05:44:47.709 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_write": 3398, 2024-08-31T05:44:47.709 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_writefull": 277, 2024-08-31T05:44:47.709 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_writesame": 0, 2024-08-31T05:44:47.710 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_append": 0, 2024-08-31T05:44:47.710 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_zero": 0, 2024-08-31T05:44:47.710 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_truncate": 0, 2024-08-31T05:44:47.710 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_delete": 3946, 2024-08-31T05:44:47.710 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_mapext": 0, 2024-08-31T05:44:47.710 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_sparse_read": 0, 2024-08-31T05:44:47.710 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_clonerange": 0, 2024-08-31T05:44:47.710 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_getxattr": 345, 2024-08-31T05:44:47.711 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_setxattr": 2717, 2024-08-31T05:44:47.711 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_cmpxattr": 0, 2024-08-31T05:44:47.711 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_rmxattr": 0, 2024-08-31T05:44:47.711 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_resetxattrs": 0, 2024-08-31T05:44:47.711 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_call": 0, 2024-08-31T05:44:47.711 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_watch": 0, 2024-08-31T05:44:47.711 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_notify": 0, 2024-08-31T05:44:47.712 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_src_cmpxattr": 0, 2024-08-31T05:44:47.712 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_pgls": 0, 2024-08-31T05:44:47.712 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_pgls_filter": 0, 2024-08-31T05:44:47.712 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_other": 0, 2024-08-31T05:44:47.712 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_active": 0, 2024-08-31T05:44:47.712 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_send": 0, 2024-08-31T05:44:47.712 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_resend": 0, 2024-08-31T05:44:47.712 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_ping": 0, 2024-08-31T05:44:47.712 INFO:teuthology.orchestra.run.smithi070.stdout: "poolop_active": 0, 2024-08-31T05:44:47.713 INFO:teuthology.orchestra.run.smithi070.stdout: "poolop_send": 0, 2024-08-31T05:44:47.713 INFO:teuthology.orchestra.run.smithi070.stdout: "poolop_resend": 0, 2024-08-31T05:44:47.713 INFO:teuthology.orchestra.run.smithi070.stdout: "poolstat_active": 0, 2024-08-31T05:44:47.713 INFO:teuthology.orchestra.run.smithi070.stdout: "poolstat_send": 0, 2024-08-31T05:44:47.713 INFO:teuthology.orchestra.run.smithi070.stdout: "poolstat_resend": 0, 2024-08-31T05:44:47.713 INFO:teuthology.orchestra.run.smithi070.stdout: "statfs_active": 0, 2024-08-31T05:44:47.713 INFO:teuthology.orchestra.run.smithi070.stdout: "statfs_send": 0, 2024-08-31T05:44:47.713 INFO:teuthology.orchestra.run.smithi070.stdout: "statfs_resend": 0, 2024-08-31T05:44:47.714 INFO:teuthology.orchestra.run.smithi070.stdout: "command_active": 0, 2024-08-31T05:44:47.714 INFO:teuthology.orchestra.run.smithi070.stdout: "command_send": 0, 2024-08-31T05:44:47.714 INFO:teuthology.orchestra.run.smithi070.stdout: "command_resend": 0, 2024-08-31T05:44:47.714 INFO:teuthology.orchestra.run.smithi070.stdout: "map_epoch": 103, 2024-08-31T05:44:47.714 INFO:teuthology.orchestra.run.smithi070.stdout: "map_full": 0, 2024-08-31T05:44:47.714 INFO:teuthology.orchestra.run.smithi070.stdout: "map_inc": 26, 2024-08-31T05:44:47.714 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_sessions": 12, 2024-08-31T05:44:47.714 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_session_open": 12, 2024-08-31T05:44:47.715 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_session_close": 0, 2024-08-31T05:44:47.715 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_laggy": 0, 2024-08-31T05:44:47.715 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_wr": 1309, 2024-08-31T05:44:47.715 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_rd": 10, 2024-08-31T05:44:47.715 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_del": 109 2024-08-31T05:44:47.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.715 INFO:teuthology.orchestra.run.smithi070.stdout: "oft": { 2024-08-31T05:44:47.715 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_objs": 1, 2024-08-31T05:44:47.716 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_kv_pairs": 0, 2024-08-31T05:44:47.716 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_updates": 0, 2024-08-31T05:44:47.716 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_removes": 0 2024-08-31T05:44:47.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.716 INFO:teuthology.orchestra.run.smithi070.stdout: "purge_queue": { 2024-08-31T05:44:47.716 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing_ops": 0, 2024-08-31T05:44:47.716 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing_ops_high_water": 10, 2024-08-31T05:44:47.716 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing": 0, 2024-08-31T05:44:47.716 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing_high_water": 5, 2024-08-31T05:44:47.717 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executed_ops": 3424, 2024-08-31T05:44:47.717 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executed": 1712, 2024-08-31T05:44:47.717 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_item_in_journal": 0 2024-08-31T05:44:47.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.717 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T05:44:47.717 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-08-31T05:44:47.717 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 104857600, 2024-08-31T05:44:47.718 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-08-31T05:44:47.718 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 384586, 2024-08-31T05:44:47.718 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 120873076, 2024-08-31T05:44:47.718 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-08-31T05:44:47.718 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 384586, 2024-08-31T05:44:47.718 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-08-31T05:44:47.718 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-08-31T05:44:47.718 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 384586, 2024-08-31T05:44:47.719 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 120873076, 2024-08-31T05:44:47.719 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-08-31T05:44:47.719 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:47.719 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:47.719 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:47.719 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-08-31T05:44:47.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.719 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-objecter_bytes": { 2024-08-31T05:44:47.720 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-08-31T05:44:47.720 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 104857600, 2024-08-31T05:44:47.720 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-08-31T05:44:47.720 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 0, 2024-08-31T05:44:47.720 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 0, 2024-08-31T05:44:47.720 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-08-31T05:44:47.720 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 0, 2024-08-31T05:44:47.721 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 10563, 2024-08-31T05:44:47.721 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 27384428, 2024-08-31T05:44:47.721 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 10563, 2024-08-31T05:44:47.721 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 27384428, 2024-08-31T05:44:47.721 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-08-31T05:44:47.721 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:47.721 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:47.721 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:47.721 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-08-31T05:44:47.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.722 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-objecter_ops": { 2024-08-31T05:44:47.722 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-08-31T05:44:47.722 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 1024, 2024-08-31T05:44:47.722 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-08-31T05:44:47.722 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 0, 2024-08-31T05:44:47.722 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 0, 2024-08-31T05:44:47.722 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-08-31T05:44:47.723 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 0, 2024-08-31T05:44:47.723 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 10563, 2024-08-31T05:44:47.723 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 10563, 2024-08-31T05:44:47.723 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 10563, 2024-08-31T05:44:47.723 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 10563, 2024-08-31T05:44:47.723 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-08-31T05:44:47.723 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:47.724 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:47.724 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:47.724 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-08-31T05:44:47.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.724 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-write_buf_throttle": { 2024-08-31T05:44:47.724 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-08-31T05:44:47.724 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 3758096384, 2024-08-31T05:44:47.724 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-08-31T05:44:47.725 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 1712, 2024-08-31T05:44:47.725 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 186840, 2024-08-31T05:44:47.725 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-08-31T05:44:47.725 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 1712, 2024-08-31T05:44:47.725 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-08-31T05:44:47.725 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-08-31T05:44:47.725 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 79, 2024-08-31T05:44:47.726 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 186840, 2024-08-31T05:44:47.726 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-08-31T05:44:47.726 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:47.726 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:47.726 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:47.726 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-08-31T05:44:47.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.726 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-write_buf_throttle-0x55f4ef0a4820": { 2024-08-31T05:44:47.727 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 1148, 2024-08-31T05:44:47.727 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 3758096384, 2024-08-31T05:44:47.727 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-08-31T05:44:47.727 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 8977, 2024-08-31T05:44:47.727 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 23924037, 2024-08-31T05:44:47.727 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-08-31T05:44:47.727 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 8977, 2024-08-31T05:44:47.727 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-08-31T05:44:47.728 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-08-31T05:44:47.728 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 3319, 2024-08-31T05:44:47.728 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 23922889, 2024-08-31T05:44:47.728 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-08-31T05:44:47.728 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:47.728 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:47.728 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:47.729 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-08-31T05:44:47.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:47.729 INFO:teuthology.orchestra.run.smithi070.stdout: "trackedop": { 2024-08-31T05:44:47.729 INFO:teuthology.orchestra.run.smithi070.stdout: "slow_ops_count": 0 2024-08-31T05:44:47.729 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-08-31T05:44:47.729 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-08-31T05:44:48.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:44:48 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:44:48.468 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:44:48 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:44:48.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:44:48 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T05:44:48.797 INFO:tasks.check_counter:Daemon mds.i mds.exported=1 2024-08-31T05:44:48.797 INFO:tasks.check_counter:Daemon mds.i mds.imported=3 2024-08-31T05:44:48.797 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=112 2024-08-31T05:44:48.797 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=337 2024-08-31T05:44:48.797 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-08-31T05:44:48.797 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=14 2024-08-31T05:44:48.797 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=8 2024-08-31T05:44:48.798 DEBUG:tasks.check_counter:Getting stats from l 2024-08-31T05:44:48.798 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph daemon mds.l perf dump 2024-08-31T05:44:49.043 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T05:44:49.464 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:44:49 smithi070 ceph-mon[22316]: pgmap v806: 129 pgs: 129 active+clean; 858 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 2.1 MiB/s wr, 81 op/s 2024-08-31T05:44:49.464 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:44:49 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:44:49.464 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:44:49 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:44:49.465 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:44:49 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:44:49.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:44:49 smithi005 ceph-mon[18602]: pgmap v806: 129 pgs: 129 active+clean; 858 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 2.1 MiB/s wr, 81 op/s 2024-08-31T05:44:49.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:44:49 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:44:49.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:44:49 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:44:49.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:44:49 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:44:49.558 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:44:49 smithi050 ceph-mon[22146]: pgmap v806: 129 pgs: 129 active+clean; 858 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 2.1 MiB/s wr, 81 op/s 2024-08-31T05:44:49.559 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:44:49 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T05:44:49.559 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:44:49 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T05:44:49.559 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:44:49 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' 2024-08-31T05:44:49.606 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-08-31T05:44:49.607 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T05:44:49.607 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 1324, 2024-08-31T05:44:49.607 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 1309, 2024-08-31T05:44:49.607 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 1576352, 2024-08-31T05:44:49.607 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 499208, 2024-08-31T05:44:49.607 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 5, 2024-08-31T05:44:49.607 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 1, 2024-08-31T05:44:49.608 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.150562404, 2024-08-31T05:44:49.608 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.065341130, 2024-08-31T05:44:49.608 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.065130567, 2024-08-31T05:44:49.608 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.026668405, 2024-08-31T05:44:49.608 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T05:44:49.608 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 1308, 2024-08-31T05:44:49.609 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.048881086, 2024-08-31T05:44:49.609 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000037370 2024-08-31T05:44:49.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.609 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-08-31T05:44:49.609 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:49.609 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:49.609 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:49.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.610 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 1241696, 2024-08-31T05:44:49.610 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 182480 2024-08-31T05:44:49.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.610 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T05:44:49.610 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 8, 2024-08-31T05:44:49.611 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 225, 2024-08-31T05:44:49.611 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 3916, 2024-08-31T05:44:49.611 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 549242, 2024-08-31T05:44:49.612 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 5, 2024-08-31T05:44:49.612 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 3, 2024-08-31T05:44:49.612 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.016448195, 2024-08-31T05:44:49.612 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.011079937, 2024-08-31T05:44:49.613 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.003748757, 2024-08-31T05:44:49.613 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.000073727, 2024-08-31T05:44:49.613 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T05:44:49.613 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 224, 2024-08-31T05:44:49.613 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.013929248, 2024-08-31T05:44:49.613 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000062184 2024-08-31T05:44:49.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.613 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-08-31T05:44:49.614 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:49.614 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:49.614 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:49.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.614 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 3360, 2024-08-31T05:44:49.614 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 548544 2024-08-31T05:44:49.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.614 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T05:44:49.615 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 1948, 2024-08-31T05:44:49.615 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 1950, 2024-08-31T05:44:49.615 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 1086801, 2024-08-31T05:44:49.615 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 619471, 2024-08-31T05:44:49.615 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 5, 2024-08-31T05:44:49.615 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 3, 2024-08-31T05:44:49.615 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.145151490, 2024-08-31T05:44:49.615 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.057565319, 2024-08-31T05:44:49.616 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.032008873, 2024-08-31T05:44:49.616 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.048520953, 2024-08-31T05:44:49.616 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T05:44:49.616 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 1948, 2024-08-31T05:44:49.616 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.071418892, 2024-08-31T05:44:49.616 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000036662 2024-08-31T05:44:49.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.616 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-08-31T05:44:49.617 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:49.617 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:49.617 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:49.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.617 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-31T05:44:49.617 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 0 2024-08-31T05:44:49.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.618 INFO:teuthology.orchestra.run.smithi070.stdout: "cct": { 2024-08-31T05:44:49.618 INFO:teuthology.orchestra.run.smithi070.stdout: "total_workers": 1, 2024-08-31T05:44:49.618 INFO:teuthology.orchestra.run.smithi070.stdout: "unhealthy_workers": 0 2024-08-31T05:44:49.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.618 INFO:teuthology.orchestra.run.smithi070.stdout: "finisher-MDSRank": { 2024-08-31T05:44:49.618 INFO:teuthology.orchestra.run.smithi070.stdout: "queue_len": 0, 2024-08-31T05:44:49.618 INFO:teuthology.orchestra.run.smithi070.stdout: "complete_latency": { 2024-08-31T05:44:49.619 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 4921, 2024-08-31T05:44:49.619 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.119628277, 2024-08-31T05:44:49.619 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000024309 2024-08-31T05:44:49.619 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-08-31T05:44:49.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.619 INFO:teuthology.orchestra.run.smithi070.stdout: "finisher-PurgeQueue": { 2024-08-31T05:44:49.619 INFO:teuthology.orchestra.run.smithi070.stdout: "queue_len": 0, 2024-08-31T05:44:49.619 INFO:teuthology.orchestra.run.smithi070.stdout: "complete_latency": { 2024-08-31T05:44:49.619 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:49.620 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:49.620 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:49.620 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-08-31T05:44:49.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.621 INFO:teuthology.orchestra.run.smithi070.stdout: "mds": { 2024-08-31T05:44:49.621 INFO:teuthology.orchestra.run.smithi070.stdout: "request": 0, 2024-08-31T05:44:49.621 INFO:teuthology.orchestra.run.smithi070.stdout: "reply": 0, 2024-08-31T05:44:49.621 INFO:teuthology.orchestra.run.smithi070.stdout: "reply_latency": { 2024-08-31T05:44:49.622 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:49.622 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:49.622 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:49.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.622 INFO:teuthology.orchestra.run.smithi070.stdout: "slow_reply": 0, 2024-08-31T05:44:49.622 INFO:teuthology.orchestra.run.smithi070.stdout: "forward": 0, 2024-08-31T05:44:49.622 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_fetch_complete": 0, 2024-08-31T05:44:49.622 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_fetch_keys": 0, 2024-08-31T05:44:49.623 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_commit": 0, 2024-08-31T05:44:49.623 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_split": 0, 2024-08-31T05:44:49.623 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_merge": 0, 2024-08-31T05:44:49.623 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes": 76, 2024-08-31T05:44:49.623 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_top": 1, 2024-08-31T05:44:49.623 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_bottom": 75, 2024-08-31T05:44:49.623 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_pin_tail": 0, 2024-08-31T05:44:49.623 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_pinned": 75, 2024-08-31T05:44:49.623 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_expired": 0, 2024-08-31T05:44:49.624 INFO:teuthology.orchestra.run.smithi070.stdout: "inodes_with_caps": 0, 2024-08-31T05:44:49.624 INFO:teuthology.orchestra.run.smithi070.stdout: "caps": 0, 2024-08-31T05:44:49.624 INFO:teuthology.orchestra.run.smithi070.stdout: "subtrees": 3, 2024-08-31T05:44:49.624 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse": 0, 2024-08-31T05:44:49.624 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_hit": 0, 2024-08-31T05:44:49.624 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_forward": 0, 2024-08-31T05:44:49.625 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_discover": 0, 2024-08-31T05:44:49.625 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_dir_fetch": 0, 2024-08-31T05:44:49.625 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_remote_ino": 0, 2024-08-31T05:44:49.625 INFO:teuthology.orchestra.run.smithi070.stdout: "traverse_lock": 0, 2024-08-31T05:44:49.625 INFO:teuthology.orchestra.run.smithi070.stdout: "load_cent": 0, 2024-08-31T05:44:49.625 INFO:teuthology.orchestra.run.smithi070.stdout: "q": 0, 2024-08-31T05:44:49.625 INFO:teuthology.orchestra.run.smithi070.stdout: "exported": 0, 2024-08-31T05:44:49.625 INFO:teuthology.orchestra.run.smithi070.stdout: "exported_inodes": 0, 2024-08-31T05:44:49.626 INFO:teuthology.orchestra.run.smithi070.stdout: "imported": 0, 2024-08-31T05:44:49.626 INFO:teuthology.orchestra.run.smithi070.stdout: "imported_inodes": 0, 2024-08-31T05:44:49.626 INFO:teuthology.orchestra.run.smithi070.stdout: "openino_dir_fetch": 0, 2024-08-31T05:44:49.626 INFO:teuthology.orchestra.run.smithi070.stdout: "openino_backtrace_fetch": 0, 2024-08-31T05:44:49.626 INFO:teuthology.orchestra.run.smithi070.stdout: "openino_peer_discover": 0, 2024-08-31T05:44:49.626 INFO:teuthology.orchestra.run.smithi070.stdout: "root_rfiles": 0, 2024-08-31T05:44:49.626 INFO:teuthology.orchestra.run.smithi070.stdout: "root_rbytes": 0, 2024-08-31T05:44:49.627 INFO:teuthology.orchestra.run.smithi070.stdout: "root_rsnaps": 0, 2024-08-31T05:44:49.627 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_backtrace_fetch": 0, 2024-08-31T05:44:49.627 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_set_tag": 0, 2024-08-31T05:44:49.627 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_backtrace_repaired": 0, 2024-08-31T05:44:49.627 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_inotable_repaired": 0, 2024-08-31T05:44:49.627 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_dir_inodes": 0, 2024-08-31T05:44:49.627 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_dir_base_inodes": 0, 2024-08-31T05:44:49.627 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_dirfrag_rstats": 0, 2024-08-31T05:44:49.627 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_file_inodes": 0, 2024-08-31T05:44:49.628 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_inode_file_caps": 0, 2024-08-31T05:44:49.628 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_revoke": 0, 2024-08-31T05:44:49.628 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_grant": 0, 2024-08-31T05:44:49.628 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_trunc": 0, 2024-08-31T05:44:49.628 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-31T05:44:49.628 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-31T05:44:49.628 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_caps": 0, 2024-08-31T05:44:49.628 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_caps_dirty": 0, 2024-08-31T05:44:49.629 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_cap_release": 0, 2024-08-31T05:44:49.629 INFO:teuthology.orchestra.run.smithi070.stdout: "process_request_cap_release": 0 2024-08-31T05:44:49.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.629 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_cache": { 2024-08-31T05:44:49.629 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_update": 0, 2024-08-31T05:44:49.629 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_update_receipt": 0, 2024-08-31T05:44:49.629 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_try_discover": 0, 2024-08-31T05:44:49.629 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_send_discover": 0, 2024-08-31T05:44:49.629 INFO:teuthology.orchestra.run.smithi070.stdout: "dir_handle_discover": 0, 2024-08-31T05:44:49.630 INFO:teuthology.orchestra.run.smithi070.stdout: "num_strays": 0, 2024-08-31T05:44:49.630 INFO:teuthology.orchestra.run.smithi070.stdout: "num_strays_delayed": 0, 2024-08-31T05:44:49.630 INFO:teuthology.orchestra.run.smithi070.stdout: "num_strays_enqueuing": 0, 2024-08-31T05:44:49.630 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_created": 0, 2024-08-31T05:44:49.630 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_enqueued": 0, 2024-08-31T05:44:49.630 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_reintegrated": 0, 2024-08-31T05:44:49.630 INFO:teuthology.orchestra.run.smithi070.stdout: "strays_migrated": 0, 2024-08-31T05:44:49.630 INFO:teuthology.orchestra.run.smithi070.stdout: "num_recovering_processing": 0, 2024-08-31T05:44:49.631 INFO:teuthology.orchestra.run.smithi070.stdout: "num_recovering_enqueued": 0, 2024-08-31T05:44:49.631 INFO:teuthology.orchestra.run.smithi070.stdout: "num_recovering_prioritized": 0, 2024-08-31T05:44:49.631 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_started": 0, 2024-08-31T05:44:49.631 INFO:teuthology.orchestra.run.smithi070.stdout: "recovery_completed": 0, 2024-08-31T05:44:49.631 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_quiesce_path": 0, 2024-08-31T05:44:49.631 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_quiesce_inode": 0, 2024-08-31T05:44:49.631 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_enqueue_scrub": 0, 2024-08-31T05:44:49.631 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_exportdir": 0, 2024-08-31T05:44:49.632 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_flush": 0, 2024-08-31T05:44:49.632 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_fragmentdir": 0, 2024-08-31T05:44:49.632 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_fragstats": 0, 2024-08-31T05:44:49.632 INFO:teuthology.orchestra.run.smithi070.stdout: "ireq_inodestats": 0, 2024-08-31T05:44:49.632 INFO:teuthology.orchestra.run.smithi070.stdout: "uninline_started": 0, 2024-08-31T05:44:49.632 INFO:teuthology.orchestra.run.smithi070.stdout: "uninline_succeeded": 0, 2024-08-31T05:44:49.632 INFO:teuthology.orchestra.run.smithi070.stdout: "uninline_write_failed": 0 2024-08-31T05:44:49.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.632 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_log": { 2024-08-31T05:44:49.633 INFO:teuthology.orchestra.run.smithi070.stdout: "evlrg": 0, 2024-08-31T05:44:49.633 INFO:teuthology.orchestra.run.smithi070.stdout: "evadd": 0, 2024-08-31T05:44:49.633 INFO:teuthology.orchestra.run.smithi070.stdout: "evex": 0, 2024-08-31T05:44:49.633 INFO:teuthology.orchestra.run.smithi070.stdout: "evtrm": 0, 2024-08-31T05:44:49.633 INFO:teuthology.orchestra.run.smithi070.stdout: "ev": 420, 2024-08-31T05:44:49.633 INFO:teuthology.orchestra.run.smithi070.stdout: "evexg": 0, 2024-08-31T05:44:49.633 INFO:teuthology.orchestra.run.smithi070.stdout: "evexd": 0, 2024-08-31T05:44:49.633 INFO:teuthology.orchestra.run.smithi070.stdout: "segadd": 0, 2024-08-31T05:44:49.633 INFO:teuthology.orchestra.run.smithi070.stdout: "segex": 0, 2024-08-31T05:44:49.634 INFO:teuthology.orchestra.run.smithi070.stdout: "segtrm": 0, 2024-08-31T05:44:49.634 INFO:teuthology.orchestra.run.smithi070.stdout: "seg": 2, 2024-08-31T05:44:49.634 INFO:teuthology.orchestra.run.smithi070.stdout: "segmjr": 2, 2024-08-31T05:44:49.634 INFO:teuthology.orchestra.run.smithi070.stdout: "segexg": 0, 2024-08-31T05:44:49.634 INFO:teuthology.orchestra.run.smithi070.stdout: "segexd": 0, 2024-08-31T05:44:49.634 INFO:teuthology.orchestra.run.smithi070.stdout: "expos": 4194304, 2024-08-31T05:44:49.635 INFO:teuthology.orchestra.run.smithi070.stdout: "wrpos": 4785316, 2024-08-31T05:44:49.635 INFO:teuthology.orchestra.run.smithi070.stdout: "rdpos": 4782282, 2024-08-31T05:44:49.635 INFO:teuthology.orchestra.run.smithi070.stdout: "jlat": { 2024-08-31T05:44:49.635 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:49.635 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:49.635 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:49.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.636 INFO:teuthology.orchestra.run.smithi070.stdout: "replayed": 420 2024-08-31T05:44:49.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.636 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_mem": { 2024-08-31T05:44:49.636 INFO:teuthology.orchestra.run.smithi070.stdout: "ino": 30, 2024-08-31T05:44:49.636 INFO:teuthology.orchestra.run.smithi070.stdout: "ino+": 74, 2024-08-31T05:44:49.636 INFO:teuthology.orchestra.run.smithi070.stdout: "ino-": 44, 2024-08-31T05:44:49.636 INFO:teuthology.orchestra.run.smithi070.stdout: "dir": 13, 2024-08-31T05:44:49.636 INFO:teuthology.orchestra.run.smithi070.stdout: "dir+": 13, 2024-08-31T05:44:49.636 INFO:teuthology.orchestra.run.smithi070.stdout: "dir-": 0, 2024-08-31T05:44:49.637 INFO:teuthology.orchestra.run.smithi070.stdout: "dn": 76, 2024-08-31T05:44:49.637 INFO:teuthology.orchestra.run.smithi070.stdout: "dn+": 76, 2024-08-31T05:44:49.637 INFO:teuthology.orchestra.run.smithi070.stdout: "dn-": 0, 2024-08-31T05:44:49.637 INFO:teuthology.orchestra.run.smithi070.stdout: "cap": 0, 2024-08-31T05:44:49.637 INFO:teuthology.orchestra.run.smithi070.stdout: "cap+": 0, 2024-08-31T05:44:49.637 INFO:teuthology.orchestra.run.smithi070.stdout: "cap-": 0, 2024-08-31T05:44:49.637 INFO:teuthology.orchestra.run.smithi070.stdout: "rss": 121096, 2024-08-31T05:44:49.637 INFO:teuthology.orchestra.run.smithi070.stdout: "heap": 318521344 2024-08-31T05:44:49.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.638 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_server": { 2024-08-31T05:44:49.638 INFO:teuthology.orchestra.run.smithi070.stdout: "dispatch_client_request": 0, 2024-08-31T05:44:49.638 INFO:teuthology.orchestra.run.smithi070.stdout: "dispatch_server_request": 0, 2024-08-31T05:44:49.638 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_request": 0, 2024-08-31T05:44:49.638 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_client_session": 0, 2024-08-31T05:44:49.638 INFO:teuthology.orchestra.run.smithi070.stdout: "handle_peer_request": 0, 2024-08-31T05:44:49.638 INFO:teuthology.orchestra.run.smithi070.stdout: "req_create_latency": { 2024-08-31T05:44:49.638 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:49.639 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:49.639 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:49.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.639 INFO:teuthology.orchestra.run.smithi070.stdout: "req_getattr_latency": { 2024-08-31T05:44:49.639 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:49.639 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:49.639 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:49.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.639 INFO:teuthology.orchestra.run.smithi070.stdout: "req_getfilelock_latency": { 2024-08-31T05:44:49.640 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:49.640 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:49.640 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:49.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.640 INFO:teuthology.orchestra.run.smithi070.stdout: "req_link_latency": { 2024-08-31T05:44:49.640 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:49.640 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:49.640 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:49.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.641 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookup_latency": { 2024-08-31T05:44:49.641 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:49.641 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:49.641 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:49.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.641 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookuphash_latency": { 2024-08-31T05:44:49.641 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:49.641 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:49.642 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:49.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.642 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupino_latency": { 2024-08-31T05:44:49.642 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:49.642 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:49.642 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:49.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.642 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupname_latency": { 2024-08-31T05:44:49.643 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:49.643 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:49.643 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:49.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.643 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupparent_latency": { 2024-08-31T05:44:49.643 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:49.643 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:49.643 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:49.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.644 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lookupsnap_latency": { 2024-08-31T05:44:49.644 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:49.644 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:49.644 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:49.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.644 INFO:teuthology.orchestra.run.smithi070.stdout: "req_lssnap_latency": { 2024-08-31T05:44:49.644 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:49.644 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:49.645 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:49.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.645 INFO:teuthology.orchestra.run.smithi070.stdout: "req_mkdir_latency": { 2024-08-31T05:44:49.645 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:49.646 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:49.646 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:49.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.646 INFO:teuthology.orchestra.run.smithi070.stdout: "req_mknod_latency": { 2024-08-31T05:44:49.646 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:49.646 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:49.646 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:49.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.647 INFO:teuthology.orchestra.run.smithi070.stdout: "req_mksnap_latency": { 2024-08-31T05:44:49.647 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:49.647 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:49.647 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:49.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.647 INFO:teuthology.orchestra.run.smithi070.stdout: "req_open_latency": { 2024-08-31T05:44:49.647 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:49.647 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:49.647 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:49.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.648 INFO:teuthology.orchestra.run.smithi070.stdout: "req_readdir_latency": { 2024-08-31T05:44:49.648 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:49.648 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:49.648 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:49.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.648 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rename_latency": { 2024-08-31T05:44:49.648 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:49.649 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:49.649 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:49.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.649 INFO:teuthology.orchestra.run.smithi070.stdout: "req_renamesnap_latency": { 2024-08-31T05:44:49.649 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:49.649 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:49.649 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:49.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.649 INFO:teuthology.orchestra.run.smithi070.stdout: "req_snapdiff_latency": { 2024-08-31T05:44:49.650 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:49.650 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:49.650 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:49.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.650 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rmdir_latency": { 2024-08-31T05:44:49.650 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:49.650 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:49.650 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:49.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.651 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rmsnap_latency": { 2024-08-31T05:44:49.651 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:49.651 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:49.651 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:49.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.651 INFO:teuthology.orchestra.run.smithi070.stdout: "req_rmxattr_latency": { 2024-08-31T05:44:49.651 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:49.651 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:49.652 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:49.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.652 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setattr_latency": { 2024-08-31T05:44:49.652 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:49.652 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:49.652 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:49.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.652 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setdirlayout_latency": { 2024-08-31T05:44:49.652 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:49.653 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:49.653 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:49.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.653 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setfilelock_latency": { 2024-08-31T05:44:49.653 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:49.653 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:49.653 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:49.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.654 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setlayout_latency": { 2024-08-31T05:44:49.654 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:49.654 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:49.654 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:49.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.654 INFO:teuthology.orchestra.run.smithi070.stdout: "req_setxattr_latency": { 2024-08-31T05:44:49.654 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:49.654 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:49.654 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:49.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.655 INFO:teuthology.orchestra.run.smithi070.stdout: "req_symlink_latency": { 2024-08-31T05:44:49.655 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:49.655 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:49.655 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:49.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.655 INFO:teuthology.orchestra.run.smithi070.stdout: "req_unlink_latency": { 2024-08-31T05:44:49.655 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:49.656 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:49.656 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:49.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.656 INFO:teuthology.orchestra.run.smithi070.stdout: "cap_revoke_eviction": 0, 2024-08-31T05:44:49.656 INFO:teuthology.orchestra.run.smithi070.stdout: "cap_acquisition_throttle": 0, 2024-08-31T05:44:49.656 INFO:teuthology.orchestra.run.smithi070.stdout: "req_getvxattr_latency": { 2024-08-31T05:44:49.656 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:49.656 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:49.656 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:49.657 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-08-31T05:44:49.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.657 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_sessions": { 2024-08-31T05:44:49.657 INFO:teuthology.orchestra.run.smithi070.stdout: "session_count": 1, 2024-08-31T05:44:49.657 INFO:teuthology.orchestra.run.smithi070.stdout: "session_add": 2, 2024-08-31T05:44:49.657 INFO:teuthology.orchestra.run.smithi070.stdout: "session_remove": 1, 2024-08-31T05:44:49.657 INFO:teuthology.orchestra.run.smithi070.stdout: "sessions_open": 1, 2024-08-31T05:44:49.657 INFO:teuthology.orchestra.run.smithi070.stdout: "sessions_stale": 0, 2024-08-31T05:44:49.658 INFO:teuthology.orchestra.run.smithi070.stdout: "total_load": 0, 2024-08-31T05:44:49.658 INFO:teuthology.orchestra.run.smithi070.stdout: "average_load": 0, 2024-08-31T05:44:49.658 INFO:teuthology.orchestra.run.smithi070.stdout: "avg_session_uptime": 1932, 2024-08-31T05:44:49.658 INFO:teuthology.orchestra.run.smithi070.stdout: "mdthresh_evicted": 0 2024-08-31T05:44:49.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.658 INFO:teuthology.orchestra.run.smithi070.stdout: "mempool": { 2024-08-31T05:44:49.658 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_bytes": 0, 2024-08-31T05:44:49.659 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_items": 0, 2024-08-31T05:44:49.659 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T05:44:49.659 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_items": 0, 2024-08-31T05:44:49.659 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T05:44:49.659 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_items": 0, 2024-08-31T05:44:49.659 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T05:44:49.659 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T05:44:49.660 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T05:44:49.660 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T05:44:49.660 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T05:44:49.660 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_items": 0, 2024-08-31T05:44:49.660 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T05:44:49.660 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T05:44:49.660 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_bytes": 0, 2024-08-31T05:44:49.660 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_items": 0, 2024-08-31T05:44:49.661 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_bytes": 0, 2024-08-31T05:44:49.661 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_items": 0, 2024-08-31T05:44:49.661 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T05:44:49.661 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T05:44:49.661 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T05:44:49.661 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T05:44:49.661 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T05:44:49.661 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_items": 0, 2024-08-31T05:44:49.661 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_bytes": 0, 2024-08-31T05:44:49.662 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_items": 0, 2024-08-31T05:44:49.662 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T05:44:49.662 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T05:44:49.662 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_bytes": 0, 2024-08-31T05:44:49.662 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_items": 0, 2024-08-31T05:44:49.662 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_bytes": 0, 2024-08-31T05:44:49.662 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_items": 0, 2024-08-31T05:44:49.662 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T05:44:49.662 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_items": 0, 2024-08-31T05:44:49.663 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T05:44:49.663 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_items": 0, 2024-08-31T05:44:49.663 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_bytes": 182922, 2024-08-31T05:44:49.663 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_items": 70, 2024-08-31T05:44:49.663 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_bytes": 0, 2024-08-31T05:44:49.663 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_items": 0, 2024-08-31T05:44:49.663 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_bytes": 0, 2024-08-31T05:44:49.663 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_items": 0, 2024-08-31T05:44:49.664 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_bytes": 0, 2024-08-31T05:44:49.664 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_items": 0, 2024-08-31T05:44:49.664 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_bytes": 0, 2024-08-31T05:44:49.664 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_items": 0, 2024-08-31T05:44:49.665 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_bytes": 9736, 2024-08-31T05:44:49.665 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_items": 197, 2024-08-31T05:44:49.665 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T05:44:49.665 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_items": 0, 2024-08-31T05:44:49.665 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_bytes": 0, 2024-08-31T05:44:49.665 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_items": 0, 2024-08-31T05:44:49.665 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_bytes": 144096, 2024-08-31T05:44:49.666 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_items": 1401, 2024-08-31T05:44:49.666 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_bytes": 0, 2024-08-31T05:44:49.666 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_items": 0, 2024-08-31T05:44:49.666 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_bytes": 0, 2024-08-31T05:44:49.666 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_items": 0 2024-08-31T05:44:49.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.666 INFO:teuthology.orchestra.run.smithi070.stdout: "objecter": { 2024-08-31T05:44:49.666 INFO:teuthology.orchestra.run.smithi070.stdout: "op_active": 0, 2024-08-31T05:44:49.667 INFO:teuthology.orchestra.run.smithi070.stdout: "op_laggy": 0, 2024-08-31T05:44:49.667 INFO:teuthology.orchestra.run.smithi070.stdout: "op_send": 2946, 2024-08-31T05:44:49.667 INFO:teuthology.orchestra.run.smithi070.stdout: "op_send_bytes": 21, 2024-08-31T05:44:49.667 INFO:teuthology.orchestra.run.smithi070.stdout: "op_resend": 3, 2024-08-31T05:44:49.667 INFO:teuthology.orchestra.run.smithi070.stdout: "op_reply": 2946, 2024-08-31T05:44:49.667 INFO:teuthology.orchestra.run.smithi070.stdout: "op_latency": { 2024-08-31T05:44:49.667 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 2946, 2024-08-31T05:44:49.667 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 1.998940006, 2024-08-31T05:44:49.667 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000678526 2024-08-31T05:44:49.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.668 INFO:teuthology.orchestra.run.smithi070.stdout: "op_inflight": 0, 2024-08-31T05:44:49.668 INFO:teuthology.orchestra.run.smithi070.stdout: "oplen_avg": { 2024-08-31T05:44:49.668 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 2946, 2024-08-31T05:44:49.668 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 2947 2024-08-31T05:44:49.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.668 INFO:teuthology.orchestra.run.smithi070.stdout: "op": 2946, 2024-08-31T05:44:49.668 INFO:teuthology.orchestra.run.smithi070.stdout: "op_r": 2946, 2024-08-31T05:44:49.669 INFO:teuthology.orchestra.run.smithi070.stdout: "op_w": 0, 2024-08-31T05:44:49.669 INFO:teuthology.orchestra.run.smithi070.stdout: "op_rmw": 0, 2024-08-31T05:44:49.669 INFO:teuthology.orchestra.run.smithi070.stdout: "op_pg": 0, 2024-08-31T05:44:49.669 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_stat": 1916, 2024-08-31T05:44:49.669 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_create": 0, 2024-08-31T05:44:49.669 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_read": 1028, 2024-08-31T05:44:49.669 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_write": 0, 2024-08-31T05:44:49.669 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_writefull": 0, 2024-08-31T05:44:49.669 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_writesame": 0, 2024-08-31T05:44:49.670 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_append": 0, 2024-08-31T05:44:49.670 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_zero": 0, 2024-08-31T05:44:49.670 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_truncate": 0, 2024-08-31T05:44:49.670 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_delete": 0, 2024-08-31T05:44:49.670 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_mapext": 0, 2024-08-31T05:44:49.670 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_sparse_read": 0, 2024-08-31T05:44:49.670 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_clonerange": 0, 2024-08-31T05:44:49.670 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_getxattr": 1, 2024-08-31T05:44:49.671 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_setxattr": 0, 2024-08-31T05:44:49.671 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_cmpxattr": 0, 2024-08-31T05:44:49.671 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_rmxattr": 0, 2024-08-31T05:44:49.671 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_resetxattrs": 0, 2024-08-31T05:44:49.671 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_call": 0, 2024-08-31T05:44:49.671 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_watch": 0, 2024-08-31T05:44:49.671 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_notify": 0, 2024-08-31T05:44:49.671 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_src_cmpxattr": 0, 2024-08-31T05:44:49.671 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_pgls": 0, 2024-08-31T05:44:49.672 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_pgls_filter": 0, 2024-08-31T05:44:49.672 INFO:teuthology.orchestra.run.smithi070.stdout: "osdop_other": 0, 2024-08-31T05:44:49.672 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_active": 0, 2024-08-31T05:44:49.672 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_send": 0, 2024-08-31T05:44:49.672 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_resend": 0, 2024-08-31T05:44:49.672 INFO:teuthology.orchestra.run.smithi070.stdout: "linger_ping": 0, 2024-08-31T05:44:49.672 INFO:teuthology.orchestra.run.smithi070.stdout: "poolop_active": 0, 2024-08-31T05:44:49.672 INFO:teuthology.orchestra.run.smithi070.stdout: "poolop_send": 0, 2024-08-31T05:44:49.672 INFO:teuthology.orchestra.run.smithi070.stdout: "poolop_resend": 0, 2024-08-31T05:44:49.673 INFO:teuthology.orchestra.run.smithi070.stdout: "poolstat_active": 0, 2024-08-31T05:44:49.673 INFO:teuthology.orchestra.run.smithi070.stdout: "poolstat_send": 0, 2024-08-31T05:44:49.673 INFO:teuthology.orchestra.run.smithi070.stdout: "poolstat_resend": 0, 2024-08-31T05:44:49.673 INFO:teuthology.orchestra.run.smithi070.stdout: "statfs_active": 0, 2024-08-31T05:44:49.673 INFO:teuthology.orchestra.run.smithi070.stdout: "statfs_send": 0, 2024-08-31T05:44:49.673 INFO:teuthology.orchestra.run.smithi070.stdout: "statfs_resend": 0, 2024-08-31T05:44:49.673 INFO:teuthology.orchestra.run.smithi070.stdout: "command_active": 0, 2024-08-31T05:44:49.673 INFO:teuthology.orchestra.run.smithi070.stdout: "command_send": 0, 2024-08-31T05:44:49.674 INFO:teuthology.orchestra.run.smithi070.stdout: "command_resend": 0, 2024-08-31T05:44:49.674 INFO:teuthology.orchestra.run.smithi070.stdout: "map_epoch": 103, 2024-08-31T05:44:49.674 INFO:teuthology.orchestra.run.smithi070.stdout: "map_full": 0, 2024-08-31T05:44:49.674 INFO:teuthology.orchestra.run.smithi070.stdout: "map_inc": 18, 2024-08-31T05:44:49.674 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_sessions": 4, 2024-08-31T05:44:49.674 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_session_open": 5, 2024-08-31T05:44:49.674 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_session_close": 1, 2024-08-31T05:44:49.674 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_laggy": 0, 2024-08-31T05:44:49.674 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_wr": 0, 2024-08-31T05:44:49.675 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_rd": 2, 2024-08-31T05:44:49.675 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_del": 0 2024-08-31T05:44:49.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.675 INFO:teuthology.orchestra.run.smithi070.stdout: "oft": { 2024-08-31T05:44:49.675 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_objs": 0, 2024-08-31T05:44:49.675 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_kv_pairs": 0, 2024-08-31T05:44:49.675 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_updates": 0, 2024-08-31T05:44:49.675 INFO:teuthology.orchestra.run.smithi070.stdout: "omap_total_removes": 0 2024-08-31T05:44:49.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.676 INFO:teuthology.orchestra.run.smithi070.stdout: "purge_queue": { 2024-08-31T05:44:49.676 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing_ops": 0, 2024-08-31T05:44:49.676 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing_ops_high_water": 0, 2024-08-31T05:44:49.676 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing": 0, 2024-08-31T05:44:49.676 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executing_high_water": 0, 2024-08-31T05:44:49.676 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executed_ops": 0, 2024-08-31T05:44:49.676 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_executed": 0, 2024-08-31T05:44:49.677 INFO:teuthology.orchestra.run.smithi070.stdout: "pq_item_in_journal": 0 2024-08-31T05:44:49.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.677 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T05:44:49.677 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-08-31T05:44:49.677 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 104857600, 2024-08-31T05:44:49.677 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-08-31T05:44:49.677 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 3276, 2024-08-31T05:44:49.677 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 2352366, 2024-08-31T05:44:49.677 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-08-31T05:44:49.678 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 3276, 2024-08-31T05:44:49.678 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-08-31T05:44:49.678 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-08-31T05:44:49.678 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 3276, 2024-08-31T05:44:49.678 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 2352366, 2024-08-31T05:44:49.678 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-08-31T05:44:49.678 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:49.678 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:49.679 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:49.679 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-08-31T05:44:49.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.680 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-objecter_bytes": { 2024-08-31T05:44:49.680 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-08-31T05:44:49.680 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 104857600, 2024-08-31T05:44:49.680 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-08-31T05:44:49.680 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 0, 2024-08-31T05:44:49.681 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 0, 2024-08-31T05:44:49.681 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-08-31T05:44:49.681 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 0, 2024-08-31T05:44:49.681 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 2946, 2024-08-31T05:44:49.681 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 591017, 2024-08-31T05:44:49.681 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 2946, 2024-08-31T05:44:49.682 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 591017, 2024-08-31T05:44:49.682 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-08-31T05:44:49.682 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:49.682 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:49.682 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:49.683 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-08-31T05:44:49.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.683 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-objecter_ops": { 2024-08-31T05:44:49.683 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-08-31T05:44:49.684 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 1024, 2024-08-31T05:44:49.684 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-08-31T05:44:49.684 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 0, 2024-08-31T05:44:49.684 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 0, 2024-08-31T05:44:49.685 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-08-31T05:44:49.685 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 0, 2024-08-31T05:44:49.685 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 2946, 2024-08-31T05:44:49.685 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 2946, 2024-08-31T05:44:49.686 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 2946, 2024-08-31T05:44:49.686 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 2946, 2024-08-31T05:44:49.686 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-08-31T05:44:49.686 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:49.686 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:49.687 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:49.687 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-08-31T05:44:49.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.687 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-write_buf_throttle": { 2024-08-31T05:44:49.687 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-08-31T05:44:49.688 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 3758096384, 2024-08-31T05:44:49.688 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-08-31T05:44:49.688 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 0, 2024-08-31T05:44:49.688 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 0, 2024-08-31T05:44:49.689 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-08-31T05:44:49.689 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 0, 2024-08-31T05:44:49.689 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-08-31T05:44:49.689 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-08-31T05:44:49.690 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 0, 2024-08-31T05:44:49.690 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 0, 2024-08-31T05:44:49.690 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-08-31T05:44:49.690 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:49.691 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:49.691 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:49.691 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-08-31T05:44:49.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.691 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-write_buf_throttle-0x5587aa9fe750": { 2024-08-31T05:44:49.692 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-08-31T05:44:49.692 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 3758096384, 2024-08-31T05:44:49.692 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-08-31T05:44:49.692 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 0, 2024-08-31T05:44:49.692 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 0, 2024-08-31T05:44:49.692 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-08-31T05:44:49.692 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 0, 2024-08-31T05:44:49.693 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-08-31T05:44:49.693 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-08-31T05:44:49.693 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 0, 2024-08-31T05:44:49.693 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 0, 2024-08-31T05:44:49.693 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-08-31T05:44:49.693 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-08-31T05:44:49.693 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-08-31T05:44:49.693 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-08-31T05:44:49.693 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-08-31T05:44:49.694 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-08-31T05:44:49.694 INFO:teuthology.orchestra.run.smithi070.stdout: "trackedop": { 2024-08-31T05:44:49.694 INFO:teuthology.orchestra.run.smithi070.stdout: "slow_ops_count": 0 2024-08-31T05:44:49.694 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-08-31T05:44:49.694 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-08-31T05:44:50.600 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-08-31T05:44:50.600 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-08-31T05:44:50.601 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=0 2024-08-31T05:44:50.601 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=0 2024-08-31T05:44:50.601 INFO:tasks.check_counter:Daemon mds.l mds.root_rsnaps=0 2024-08-31T05:44:50.601 INFO:tasks.check_counter:Daemon mds.l mds_server.req_mksnap_latency.avgcount=0 2024-08-31T05:44:50.601 INFO:tasks.check_counter:Daemon mds.l mds_server.req_rmsnap_latency.avgcount=0 2024-08-31T05:44:50.601 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-08-31T05:44:50.613 INFO:tasks.kclient:Unmounting kernel clients... 2024-08-31T05:44:50.613 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-31T05:44:50.613 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-31T05:44:50.634 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-08-31T05:44:50.634 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-31T05:44:50.697 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph osd blocklist ls 2024-08-31T05:44:50.998 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:44:51.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:44:51 smithi005 ceph-mon[18602]: pgmap v807: 129 pgs: 129 active+clean; 851 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 2.5 MiB/s wr, 110 op/s 2024-08-31T05:44:51.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:44:51 smithi070 ceph-mon[22316]: pgmap v807: 129 pgs: 129 active+clean; 851 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 2.5 MiB/s wr, 110 op/s 2024-08-31T05:44:51.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:44:51 smithi050 ceph-mon[22146]: pgmap v807: 129 pgs: 129 active+clean; 851 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 2.5 MiB/s wr, 110 op/s 2024-08-31T05:44:51.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:51.818+0000 7fcfac49a640 1 -- 172.21.15.5:0/1897674721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfa4108a90 msgr2=0x7fcfa410f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:51.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:51.818+0000 7fcfac49a640 1 --2- 172.21.15.5:0/1897674721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfa4108a90 0x7fcfa410f2c0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c009ca0 tx=0x7fcf9c02a8c0 comp rx=0 tx=0).stop 2024-08-31T05:44:51.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:51.818+0000 7fcfac49a640 1 -- 172.21.15.5:0/1897674721 shutdown_connections 2024-08-31T05:44:51.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:51.818+0000 7fcfac49a640 1 --2- 172.21.15.5:0/1897674721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfa4108a90 0x7fcfa410f2c0 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:51.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:51.818+0000 7fcfac49a640 1 --2- 172.21.15.5:0/1897674721 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcfa4108140 0x7fcfa4108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:51.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:51.818+0000 7fcfac49a640 1 --2- 172.21.15.5:0/1897674721 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfa4102800 0x7fcfa4102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:51.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:51.818+0000 7fcfac49a640 1 -- 172.21.15.5:0/1897674721 >> 172.21.15.5:0/1897674721 conn(0x7fcfa40794d0 msgr2=0x7fcfa40798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:51.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:51.818+0000 7fcfac49a640 1 -- 172.21.15.5:0/1897674721 shutdown_connections 2024-08-31T05:44:51.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:51.818+0000 7fcfac49a640 1 -- 172.21.15.5:0/1897674721 wait complete. 2024-08-31T05:44:51.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:51.819+0000 7fcfac49a640 1 Processor -- start 2024-08-31T05:44:51.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:51.820+0000 7fcfac49a640 1 -- start start 2024-08-31T05:44:51.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:51.820+0000 7fcfac49a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcfa4102800 0x7fcfa419a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:51.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:51.820+0000 7fcfac49a640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfa4108140 0x7fcfa419a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:51.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:51.820+0000 7fcfac49a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfa4108a90 0x7fcfa419fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:51.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:51.820+0000 7fcfac49a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fcfa4112710 con 0x7fcfa4108a90 2024-08-31T05:44:51.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:51.820+0000 7fcfac49a640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcfa4112590 con 0x7fcfa4108140 2024-08-31T05:44:51.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:51.820+0000 7fcfac49a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcfa4112890 con 0x7fcfa4102800 2024-08-31T05:44:51.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:51.820+0000 7fcfaaa37640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfa4108a90 0x7fcfa419fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:51.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:51.820+0000 7fcfaaa37640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfa4108a90 0x7fcfa419fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47156/0 (socket says 172.21.15.5:47156) 2024-08-31T05:44:51.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:51.820+0000 7fcfaaa37640 1 -- 172.21.15.5:0/3588265322 learned_addr learned my addr 172.21.15.5:0/3588265322 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:44:51.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:51.820+0000 7fcfa9a35640 1 --2- 172.21.15.5:0/3588265322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfa4108140 0x7fcfa419a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:51.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:51.820+0000 7fcfaa236640 1 --2- 172.21.15.5:0/3588265322 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcfa4102800 0x7fcfa419a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:51.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:51.820+0000 7fcfa9a35640 1 -- 172.21.15.5:0/3588265322 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcfa4102800 msgr2=0x7fcfa419a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:51.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:51.820+0000 7fcfa9a35640 1 --2- 172.21.15.5:0/3588265322 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcfa4102800 0x7fcfa419a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:51.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:51.820+0000 7fcfa9a35640 1 -- 172.21.15.5:0/3588265322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfa4108a90 msgr2=0x7fcfa419fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:51.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:51.820+0000 7fcfa9a35640 1 --2- 172.21.15.5:0/3588265322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfa4108a90 0x7fcfa419fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:51.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:51.820+0000 7fcfa9a35640 1 -- 172.21.15.5:0/3588265322 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfa41a01a0 con 0x7fcfa4108140 2024-08-31T05:44:51.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:51.821+0000 7fcfaaa37640 1 --2- 172.21.15.5:0/3588265322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfa4108a90 0x7fcfa419fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T05:44:51.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:51.821+0000 7fcfa9a35640 1 --2- 172.21.15.5:0/3588265322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfa4108140 0x7fcfa419a7d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fcf9400e9c0 tx=0x7fcf9400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:51.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:51.821+0000 7fcf9b7fe640 1 -- 172.21.15.5:0/3588265322 <== mon.2 v2:172.21.15.50:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf9400ccc0 con 0x7fcfa4108140 2024-08-31T05:44:51.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:51.821+0000 7fcfac49a640 1 -- 172.21.15.5:0/3588265322 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfa41a0490 con 0x7fcfa4108140 2024-08-31T05:44:51.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:51.821+0000 7fcf9b7fe640 1 -- 172.21.15.5:0/3588265322 <== mon.2 v2:172.21.15.50:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf94005020 con 0x7fcfa4108140 2024-08-31T05:44:51.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:51.821+0000 7fcfac49a640 1 -- 172.21.15.5:0/3588265322 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfa41a6bf0 con 0x7fcfa4108140 2024-08-31T05:44:51.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:51.821+0000 7fcf9b7fe640 1 -- 172.21.15.5:0/3588265322 <== mon.2 v2:172.21.15.50:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf94004a00 con 0x7fcfa4108140 2024-08-31T05:44:51.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:51.822+0000 7fcfac49a640 1 -- 172.21.15.5:0/3588265322 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf880052c0 con 0x7fcfa4108140 2024-08-31T05:44:51.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:51.824+0000 7fcf9b7fe640 1 -- 172.21.15.5:0/3588265322 <== mon.2 v2:172.21.15.50:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fcf94004ba0 con 0x7fcfa4108140 2024-08-31T05:44:51.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:51.824+0000 7fcf9b7fe640 1 --2- 172.21.15.5:0/3588265322 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fcf900b4d20 0x7fcf900b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:51.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:51.824+0000 7fcfaa236640 1 --2- 172.21.15.5:0/3588265322 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fcf900b4d20 0x7fcf900b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:51.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:51.824+0000 7fcf9b7fe640 1 -- 172.21.15.5:0/3588265322 <== mon.2 v2:172.21.15.50:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9511+0+0 (secure 0 0 0) 0x7fcf940e5670 con 0x7fcfa4108140 2024-08-31T05:44:51.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:51.825+0000 7fcfaa236640 1 --2- 172.21.15.5:0/3588265322 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fcf900b4d20 0x7fcf900b7230 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0009bd0 tx=0x7fcfa0005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:51.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:51.828+0000 7fcf9b7fe640 1 -- 172.21.15.5:0/3588265322 <== mon.2 v2:172.21.15.50:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fcf940ac110 con 0x7fcfa4108140 2024-08-31T05:44:52.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:52.028+0000 7fcfac49a640 1 -- 172.21.15.5:0/3588265322 --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fcf880055b0 con 0x7fcfa4108140 2024-08-31T05:44:52.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:52.029+0000 7fcf9b7fe640 1 -- 172.21.15.5:0/3588265322 <== mon.2 v2:172.21.15.50:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v103) ==== 81+0+873 (secure 0 0 0) 0x7fcf940aba10 con 0x7fcfa4108140 2024-08-31T05:44:52.031 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/2473024253 2024-09-01T05:20:57.333680+0000 2024-08-31T05:44:52.031 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/2924148490 2024-09-01T05:19:31.728664+0000 2024-08-31T05:44:52.031 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/2163558485 2024-09-01T05:19:31.728664+0000 2024-08-31T05:44:52.031 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/2111919168 2024-09-01T05:19:55.663503+0000 2024-08-31T05:44:52.032 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6801/3616278616 2024-09-01T05:19:55.663503+0000 2024-08-31T05:44:52.032 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/2436421090 2024-09-01T05:19:31.728664+0000 2024-08-31T05:44:52.032 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/1570244689 2024-09-01T05:19:55.663503+0000 2024-08-31T05:44:52.032 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/2700448223 2024-09-01T05:20:57.333680+0000 2024-08-31T05:44:52.032 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6800/3616278616 2024-09-01T05:19:55.663503+0000 2024-08-31T05:44:52.032 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6800/2898463711 2024-09-01T05:19:31.728664+0000 2024-08-31T05:44:52.032 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/2450461036 2024-09-01T05:20:57.333680+0000 2024-08-31T05:44:52.032 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/1947189952 2024-09-01T05:19:55.663503+0000 2024-08-31T05:44:52.033 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6800/1439868821 2024-09-01T05:20:57.333680+0000 2024-08-31T05:44:52.033 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6801/2898463711 2024-09-01T05:19:31.728664+0000 2024-08-31T05:44:52.033 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6801/1439868821 2024-09-01T05:20:57.333680+0000 2024-08-31T05:44:52.034 INFO:teuthology.orchestra.run.smithi005.stderr:listed 15 entries 2024-08-31T05:44:52.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:52.031+0000 7fcfac49a640 1 -- 172.21.15.5:0/3588265322 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fcf900b4d20 msgr2=0x7fcf900b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:52.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:52.031+0000 7fcfac49a640 1 --2- 172.21.15.5:0/3588265322 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fcf900b4d20 0x7fcf900b7230 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0009bd0 tx=0x7fcfa0005f90 comp rx=0 tx=0).stop 2024-08-31T05:44:52.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:52.031+0000 7fcfac49a640 1 -- 172.21.15.5:0/3588265322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfa4108140 msgr2=0x7fcfa419a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:52.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:52.031+0000 7fcfac49a640 1 --2- 172.21.15.5:0/3588265322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfa4108140 0x7fcfa419a7d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fcf9400e9c0 tx=0x7fcf9400ee80 comp rx=0 tx=0).stop 2024-08-31T05:44:52.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:52.031+0000 7fcfac49a640 1 -- 172.21.15.5:0/3588265322 shutdown_connections 2024-08-31T05:44:52.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:52.031+0000 7fcfac49a640 1 --2- 172.21.15.5:0/3588265322 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fcf900b4d20 0x7fcf900b7230 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:52.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:52.031+0000 7fcfac49a640 1 --2- 172.21.15.5:0/3588265322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcfa4108a90 0x7fcfa419fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:52.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:52.031+0000 7fcfac49a640 1 --2- 172.21.15.5:0/3588265322 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcfa4108140 0x7fcfa419a7d0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:52.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:52.031+0000 7fcfac49a640 1 --2- 172.21.15.5:0/3588265322 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcfa4102800 0x7fcfa419a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:52.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:52.031+0000 7fcfac49a640 1 -- 172.21.15.5:0/3588265322 >> 172.21.15.5:0/3588265322 conn(0x7fcfa40794d0 msgr2=0x7fcfa4100940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:52.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:52.031+0000 7fcfac49a640 1 -- 172.21.15.5:0/3588265322 shutdown_connections 2024-08-31T05:44:52.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:52.031+0000 7fcfac49a640 1 -- 172.21.15.5:0/3588265322 wait complete. 2024-08-31T05:44:52.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:44:52 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/3588265322' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-31T05:44:52.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:44:52 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/3588265322' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-31T05:44:52.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:44:52 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/3588265322' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-31T05:44:52.838 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-31T05:44:52.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T05:44:52.838 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-08-31T05:44:53.089 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-08-31T05:44:53.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T05:44:53.090 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-31T05:44:53.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T05:44:53.134 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-08-31T05:44:53.206 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-31T05:44:53.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T05:44:53.207 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-31T05:44:53.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T05:44:53.274 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link delete ceph-brx 2024-08-31T05:44:53.365 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:44:53 smithi005 ceph-mon[18602]: pgmap v808: 129 pgs: 129 active+clean; 851 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 1.6 MiB/s wr, 84 op/s 2024-08-31T05:44:53.370 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-08-31T05:44:53.383 INFO:tasks.cephadm:Teardown begin 2024-08-31T05:44:53.383 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-31T05:44:53.384 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T05:44:53.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:44:53 smithi070 ceph-mon[22316]: pgmap v808: 129 pgs: 129 active+clean; 851 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 1.6 MiB/s wr, 84 op/s 2024-08-31T05:44:53.641 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:44:53.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:44:53 smithi050 ceph-mon[22146]: pgmap v808: 129 pgs: 129 active+clean; 851 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 1.6 MiB/s wr, 84 op/s 2024-08-31T05:44:54.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.257+0000 7fcf22b54640 1 -- 172.21.15.5:0/3668274071 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf1c109290 msgr2=0x7fcf1c1096a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:54.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.257+0000 7fcf22b54640 1 --2- 172.21.15.5:0/3668274071 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf1c109290 0x7fcf1c1096a0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fcf10009900 tx=0x7fcf1002a410 comp rx=0 tx=0).stop 2024-08-31T05:44:54.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.257+0000 7fcf22b54640 1 -- 172.21.15.5:0/3668274071 shutdown_connections 2024-08-31T05:44:54.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.257+0000 7fcf22b54640 1 --2- 172.21.15.5:0/3668274071 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf1c109be0 0x7fcf1c110410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:54.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.257+0000 7fcf22b54640 1 --2- 172.21.15.5:0/3668274071 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf1c109290 0x7fcf1c1096a0 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:54.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.257+0000 7fcf22b54640 1 --2- 172.21.15.5:0/3668274071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf1c103950 0x7fcf1c103d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:54.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.257+0000 7fcf22b54640 1 -- 172.21.15.5:0/3668274071 >> 172.21.15.5:0/3668274071 conn(0x7fcf1c0ff3a0 msgr2=0x7fcf1c1017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:54.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.257+0000 7fcf22b54640 1 -- 172.21.15.5:0/3668274071 shutdown_connections 2024-08-31T05:44:54.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.257+0000 7fcf22b54640 1 -- 172.21.15.5:0/3668274071 wait complete. 2024-08-31T05:44:54.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.258+0000 7fcf22b54640 1 Processor -- start 2024-08-31T05:44:54.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.258+0000 7fcf22b54640 1 -- start start 2024-08-31T05:44:54.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.258+0000 7fcf22b54640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf1c103950 0x7fcf1c19a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:54.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.258+0000 7fcf22b54640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf1c109290 0x7fcf1c19a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:54.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.258+0000 7fcf22b54640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf1c109be0 0x7fcf1c19fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:54.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.258+0000 7fcf22b54640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fcf1c1138a0 con 0x7fcf1c109290 2024-08-31T05:44:54.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.258+0000 7fcf22b54640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fcf1c113720 con 0x7fcf1c103950 2024-08-31T05:44:54.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.258+0000 7fcf22b54640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcf1c113a20 con 0x7fcf1c109be0 2024-08-31T05:44:54.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.258+0000 7fcf1bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf1c109290 0x7fcf1c19a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:54.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.258+0000 7fcf1bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf1c109290 0x7fcf1c19a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55282/0 (socket says 172.21.15.5:55282) 2024-08-31T05:44:54.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.258+0000 7fcf1bfff640 1 -- 172.21.15.5:0/12847645 learned_addr learned my addr 172.21.15.5:0/12847645 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:44:54.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.258+0000 7fcf210f1640 1 --2- 172.21.15.5:0/12847645 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf1c109be0 0x7fcf1c19fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:54.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.258+0000 7fcf208f0640 1 --2- 172.21.15.5:0/12847645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf1c103950 0x7fcf1c19a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:54.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.259+0000 7fcf1bfff640 1 -- 172.21.15.5:0/12847645 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf1c109be0 msgr2=0x7fcf1c19fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:54.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.259+0000 7fcf1bfff640 1 --2- 172.21.15.5:0/12847645 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf1c109be0 0x7fcf1c19fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:54.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.259+0000 7fcf1bfff640 1 -- 172.21.15.5:0/12847645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf1c103950 msgr2=0x7fcf1c19a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:54.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.259+0000 7fcf1bfff640 1 --2- 172.21.15.5:0/12847645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf1c103950 0x7fcf1c19a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:54.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.259+0000 7fcf1bfff640 1 -- 172.21.15.5:0/12847645 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf1c1a01e0 con 0x7fcf1c109290 2024-08-31T05:44:54.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.259+0000 7fcf208f0640 1 --2- 172.21.15.5:0/12847645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf1c103950 0x7fcf1c19a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T05:44:54.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.259+0000 7fcf1bfff640 1 --2- 172.21.15.5:0/12847645 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf1c109290 0x7fcf1c19a810 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fcf1002a930 tx=0x7fcf10004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:54.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.259+0000 7fcf19ffb640 1 -- 172.21.15.5:0/12847645 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf1003f030 con 0x7fcf1c109290 2024-08-31T05:44:54.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.259+0000 7fcf19ffb640 1 -- 172.21.15.5:0/12847645 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf10003aa0 con 0x7fcf1c109290 2024-08-31T05:44:54.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.259+0000 7fcf19ffb640 1 -- 172.21.15.5:0/12847645 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf10035070 con 0x7fcf1c109290 2024-08-31T05:44:54.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.259+0000 7fcf22b54640 1 -- 172.21.15.5:0/12847645 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf1c1a0470 con 0x7fcf1c109290 2024-08-31T05:44:54.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.259+0000 7fcf22b54640 1 -- 172.21.15.5:0/12847645 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf1c1a6c30 con 0x7fcf1c109290 2024-08-31T05:44:54.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.260+0000 7fcf22b54640 1 -- 172.21.15.5:0/12847645 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf1c103d60 con 0x7fcf1c109290 2024-08-31T05:44:54.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.262+0000 7fcf19ffb640 1 -- 172.21.15.5:0/12847645 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fcf10042030 con 0x7fcf1c109290 2024-08-31T05:44:54.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.262+0000 7fcf19ffb640 1 --2- 172.21.15.5:0/12847645 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fcf040b4ca0 0x7fcf040b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:54.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.262+0000 7fcf208f0640 1 --2- 172.21.15.5:0/12847645 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fcf040b4ca0 0x7fcf040b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:54.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.262+0000 7fcf19ffb640 1 -- 172.21.15.5:0/12847645 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9511+0+0 (secure 0 0 0) 0x7fcf101064e0 con 0x7fcf1c109290 2024-08-31T05:44:54.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.263+0000 7fcf208f0640 1 --2- 172.21.15.5:0/12847645 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fcf040b4ca0 0x7fcf040b71b0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c0058c0 tx=0x7fcf0c005d30 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:54.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.266+0000 7fcf19ffb640 1 -- 172.21.15.5:0/12847645 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fcf100ccef0 con 0x7fcf1c109290 2024-08-31T05:44:54.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.490+0000 7fcf22b54640 1 -- 172.21.15.5:0/12847645 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcf1c19b3a0 con 0x7fcf1c109290 2024-08-31T05:44:54.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.491+0000 7fcf19ffb640 1 -- 172.21.15.5:0/12847645 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+11948 (secure 0 0 0) 0x7fcf1c19b3a0 con 0x7fcf1c109290 2024-08-31T05:44:54.494 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:44:54.494 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":36,"btime":"2024-08-31T05:43:22:948959+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14739,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2024812199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2024812199},{"type":"v1","addr":"172.21.15.5:6835","nonce":2024812199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3629023702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3629023702},{"type":"v1","addr":"172.21.15.5:6837","nonce":3629023702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":36,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T05:27:31.929153+0000","modified":"2024-08-31T05:43:22.085750+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24652,"mds_1":24638,"mds_2":24631,"mds_3":24625,"mds_4":24602},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6839/2412701258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":2412701258},{"type":"v1","addr":"172.21.15.5:6839","nonce":2412701258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14820":{"gid":14820,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6841/747057838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":747057838},{"type":"v1","addr":"172.21.15.5:6841","nonce":747057838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6833/1153378982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1153378982},{"type":"v1","addr":"172.21.15.50:6833","nonce":1153378982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6833/364083443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":364083443},{"type":"v1","addr":"172.21.15.70:6833","nonce":364083443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24587":{"gid":24587,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/2346896794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2346896794},{"type":"v1","addr":"172.21.15.50:6835","nonce":2346896794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24602":{"gid":24602,"name":"h","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.50:6837/428759669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":428759669},{"type":"v1","addr":"172.21.15.50:6837","nonce":428759669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.70:6835/2061504114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2061504114},{"type":"v1","addr":"172.21.15.70:6835","nonce":2061504114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.70:6837/2780036414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2780036414},{"type":"v1","addr":"172.21.15.70:6837","nonce":2780036414}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.50:6839/98200944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":98200944},{"type":"v1","addr":"172.21.15.50:6839","nonce":98200944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24652":{"gid":24652,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.70:6839/2756569250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":2756569250},{"type":"v1","addr":"172.21.15.70:6839","nonce":2756569250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24652,"qdb_cluster":[24652,24631,24638,24625,24602]},"id":1}]} 2024-08-31T05:44:54.494 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 36 2024-08-31T05:44:54.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.493+0000 7fcf22b54640 1 -- 172.21.15.5:0/12847645 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fcf040b4ca0 msgr2=0x7fcf040b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:54.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.493+0000 7fcf22b54640 1 --2- 172.21.15.5:0/12847645 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fcf040b4ca0 0x7fcf040b71b0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c0058c0 tx=0x7fcf0c005d30 comp rx=0 tx=0).stop 2024-08-31T05:44:54.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.493+0000 7fcf22b54640 1 -- 172.21.15.5:0/12847645 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf1c109290 msgr2=0x7fcf1c19a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:54.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.493+0000 7fcf22b54640 1 --2- 172.21.15.5:0/12847645 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf1c109290 0x7fcf1c19a810 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fcf1002a930 tx=0x7fcf10004270 comp rx=0 tx=0).stop 2024-08-31T05:44:54.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.493+0000 7fcf22b54640 1 -- 172.21.15.5:0/12847645 shutdown_connections 2024-08-31T05:44:54.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.493+0000 7fcf22b54640 1 --2- 172.21.15.5:0/12847645 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fcf040b4ca0 0x7fcf040b71b0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:54.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.493+0000 7fcf22b54640 1 --2- 172.21.15.5:0/12847645 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf1c109be0 0x7fcf1c19fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:54.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.493+0000 7fcf22b54640 1 --2- 172.21.15.5:0/12847645 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf1c109290 0x7fcf1c19a810 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:54.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.493+0000 7fcf22b54640 1 --2- 172.21.15.5:0/12847645 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fcf1c103950 0x7fcf1c19a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:54.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.493+0000 7fcf22b54640 1 -- 172.21.15.5:0/12847645 >> 172.21.15.5:0/12847645 conn(0x7fcf1c0ff3a0 msgr2=0x7fcf1c1017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:54.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.494+0000 7fcf22b54640 1 -- 172.21.15.5:0/12847645 shutdown_connections 2024-08-31T05:44:54.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:54.494+0000 7fcf22b54640 1 -- 172.21.15.5:0/12847645 wait complete. 2024-08-31T05:44:55.174 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T05:44:55.430 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:44:55.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:44:55 smithi005 ceph-mon[18602]: pgmap v809: 129 pgs: 129 active+clean; 851 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 1.5 MiB/s wr, 87 op/s 2024-08-31T05:44:55.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:44:55 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/12847645' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:44:55.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:44:55 smithi070 ceph-mon[22316]: pgmap v809: 129 pgs: 129 active+clean; 851 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 1.5 MiB/s wr, 87 op/s 2024-08-31T05:44:55.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:44:55 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/12847645' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:44:55.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:44:55 smithi050 ceph-mon[22146]: pgmap v809: 129 pgs: 129 active+clean; 851 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 1.5 MiB/s wr, 87 op/s 2024-08-31T05:44:55.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:44:55 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/12847645' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:44:56.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:56.123+0000 7f58b8bc9640 1 -- 172.21.15.5:0/995976828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58b4109b90 msgr2=0x7f58b41103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:56.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:56.123+0000 7f58b8bc9640 1 --2- 172.21.15.5:0/995976828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58b4109b90 0x7f58b41103c0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f58ac009ca0 tx=0x7f58ac02a8c0 comp rx=0 tx=0).stop 2024-08-31T05:44:56.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:56.123+0000 7f58b8bc9640 1 -- 172.21.15.5:0/995976828 shutdown_connections 2024-08-31T05:44:56.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:56.123+0000 7f58b8bc9640 1 --2- 172.21.15.5:0/995976828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58b4109b90 0x7f58b41103c0 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:56.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:56.123+0000 7f58b8bc9640 1 --2- 172.21.15.5:0/995976828 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58b4109240 0x7f58b4109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:56.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:56.123+0000 7f58b8bc9640 1 --2- 172.21.15.5:0/995976828 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58b4103900 0x7f58b4103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:56.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:56.123+0000 7f58b8bc9640 1 -- 172.21.15.5:0/995976828 >> 172.21.15.5:0/995976828 conn(0x7f58b407b5f0 msgr2=0x7f58b407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:56.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:56.123+0000 7f58b8bc9640 1 -- 172.21.15.5:0/995976828 shutdown_connections 2024-08-31T05:44:56.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:56.123+0000 7f58b8bc9640 1 -- 172.21.15.5:0/995976828 wait complete. 2024-08-31T05:44:56.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:56.124+0000 7f58b8bc9640 1 Processor -- start 2024-08-31T05:44:56.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:56.124+0000 7f58b8bc9640 1 -- start start 2024-08-31T05:44:56.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:56.124+0000 7f58b8bc9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58b4103900 0x7f58b419a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:56.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:56.124+0000 7f58b8bc9640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58b4109240 0x7f58b419a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:56.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:56.124+0000 7f58b8bc9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58b4109b90 0x7f58b419fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:56.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:56.124+0000 7f58b8bc9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f58b4113850 con 0x7f58b4109b90 2024-08-31T05:44:56.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:56.124+0000 7f58b8bc9640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f58b41136d0 con 0x7f58b4109240 2024-08-31T05:44:56.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:56.124+0000 7f58b8bc9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f58b41139d0 con 0x7f58b4103900 2024-08-31T05:44:56.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:56.125+0000 7f58b2d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58b4109b90 0x7f58b419fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:56.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:56.125+0000 7f58b2d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58b4109b90 0x7f58b419fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55302/0 (socket says 172.21.15.5:55302) 2024-08-31T05:44:56.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:56.125+0000 7f58b2d9d640 1 -- 172.21.15.5:0/3668049501 learned_addr learned my addr 172.21.15.5:0/3668049501 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:44:56.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:56.125+0000 7f58b259c640 1 --2- 172.21.15.5:0/3668049501 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58b4103900 0x7f58b419a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:56.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:56.125+0000 7f58b1d9b640 1 --2- 172.21.15.5:0/3668049501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58b4109240 0x7f58b419a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:56.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:56.125+0000 7f58b2d9d640 1 -- 172.21.15.5:0/3668049501 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58b4103900 msgr2=0x7f58b419a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:56.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:56.125+0000 7f58b2d9d640 1 --2- 172.21.15.5:0/3668049501 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58b4103900 0x7f58b419a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:56.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:56.125+0000 7f58b2d9d640 1 -- 172.21.15.5:0/3668049501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58b4109240 msgr2=0x7f58b419a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:56.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:56.125+0000 7f58b2d9d640 1 --2- 172.21.15.5:0/3668049501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58b4109240 0x7f58b419a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:56.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:56.125+0000 7f58b2d9d640 1 -- 172.21.15.5:0/3668049501 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58b41a0130 con 0x7f58b4109b90 2024-08-31T05:44:56.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:56.125+0000 7f58b2d9d640 1 --2- 172.21.15.5:0/3668049501 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58b4109b90 0x7f58b419fa00 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f58ac005cc0 tx=0x7f58ac02f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:56.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:56.125+0000 7f58a37fe640 1 -- 172.21.15.5:0/3668049501 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ac003bf0 con 0x7f58b4109b90 2024-08-31T05:44:56.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:56.125+0000 7f58b8bc9640 1 -- 172.21.15.5:0/3668049501 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58b41a03c0 con 0x7f58b4109b90 2024-08-31T05:44:56.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:56.125+0000 7f58a37fe640 1 -- 172.21.15.5:0/3668049501 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58ac003d90 con 0x7f58b4109b90 2024-08-31T05:44:56.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:56.125+0000 7f58a37fe640 1 -- 172.21.15.5:0/3668049501 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ac02fbc0 con 0x7f58b4109b90 2024-08-31T05:44:56.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:56.125+0000 7f58b8bc9640 1 -- 172.21.15.5:0/3668049501 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58b41a6b80 con 0x7f58b4109b90 2024-08-31T05:44:56.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:56.127+0000 7f58b8bc9640 1 -- 172.21.15.5:0/3668049501 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58b4103d10 con 0x7f58b4109b90 2024-08-31T05:44:56.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:56.128+0000 7f58a37fe640 1 -- 172.21.15.5:0/3668049501 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f58ac02fd60 con 0x7f58b4109b90 2024-08-31T05:44:56.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:56.129+0000 7f58a37fe640 1 --2- 172.21.15.5:0/3668049501 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f589c0b4ca0 0x7f589c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:56.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:56.129+0000 7f58b259c640 1 --2- 172.21.15.5:0/3668049501 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f589c0b4ca0 0x7f589c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:56.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:56.129+0000 7f58a37fe640 1 -- 172.21.15.5:0/3668049501 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9511+0+0 (secure 0 0 0) 0x7f58ac106e30 con 0x7f58b4109b90 2024-08-31T05:44:56.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:56.129+0000 7f58b259c640 1 --2- 172.21.15.5:0/3668049501 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f589c0b4ca0 0x7f589c0b71b0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f58a4005fd0 tx=0x7f58a400b390 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:56.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:56.133+0000 7f58a37fe640 1 -- 172.21.15.5:0/3668049501 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f58ac0cd7e0 con 0x7f58b4109b90 2024-08-31T05:44:56.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:56.356+0000 7f58b8bc9640 1 -- 172.21.15.5:0/3668049501 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f58b410b980 con 0x7f58b4109b90 2024-08-31T05:44:56.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:56.357+0000 7f58a37fe640 1 -- 172.21.15.5:0/3668049501 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+11948 (secure 0 0 0) 0x7f58ac0cd0e0 con 0x7f58b4109b90 2024-08-31T05:44:56.360 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:44:56.360 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":36,"btime":"2024-08-31T05:43:22:948959+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14739,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2024812199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2024812199},{"type":"v1","addr":"172.21.15.5:6835","nonce":2024812199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14751,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/3629023702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":3629023702},{"type":"v1","addr":"172.21.15.5:6837","nonce":3629023702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":36,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T05:27:31.929153+0000","modified":"2024-08-31T05:43:22.085750+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24652,"mds_1":24638,"mds_2":24631,"mds_3":24625,"mds_4":24602},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14808":{"gid":14808,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6839/2412701258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":2412701258},{"type":"v1","addr":"172.21.15.5:6839","nonce":2412701258}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14820":{"gid":14820,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.5:6841/747057838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":747057838},{"type":"v1","addr":"172.21.15.5:6841","nonce":747057838}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6833/1153378982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6832","nonce":1153378982},{"type":"v1","addr":"172.21.15.50:6833","nonce":1153378982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24583":{"gid":24583,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.70:6833/364083443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":364083443},{"type":"v1","addr":"172.21.15.70:6833","nonce":364083443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24587":{"gid":24587,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.50:6835/2346896794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6834","nonce":2346896794},{"type":"v1","addr":"172.21.15.50:6835","nonce":2346896794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24602":{"gid":24602,"name":"h","rank":4,"incarnation":26,"state":"up:active","state_seq":17,"addr":"172.21.15.50:6837/428759669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6836","nonce":428759669},{"type":"v1","addr":"172.21.15.50:6837","nonce":428759669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.70:6835/2061504114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2061504114},{"type":"v1","addr":"172.21.15.70:6835","nonce":2061504114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24631":{"gid":24631,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.70:6837/2780036414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2780036414},{"type":"v1","addr":"172.21.15.70:6837","nonce":2780036414}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":13,"addr":"172.21.15.50:6839/98200944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6838","nonce":98200944},{"type":"v1","addr":"172.21.15.50:6839","nonce":98200944}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24652":{"gid":24652,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.70:6839/2756569250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":2756569250},{"type":"v1","addr":"172.21.15.70:6839","nonce":2756569250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24652,"qdb_cluster":[24652,24631,24638,24625,24602]},"id":1}]} 2024-08-31T05:44:56.360 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 36 2024-08-31T05:44:56.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:56.360+0000 7f58b8bc9640 1 -- 172.21.15.5:0/3668049501 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f589c0b4ca0 msgr2=0x7f589c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:56.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:56.360+0000 7f58b8bc9640 1 --2- 172.21.15.5:0/3668049501 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f589c0b4ca0 0x7f589c0b71b0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f58a4005fd0 tx=0x7f58a400b390 comp rx=0 tx=0).stop 2024-08-31T05:44:56.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:56.360+0000 7f58b8bc9640 1 -- 172.21.15.5:0/3668049501 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58b4109b90 msgr2=0x7f58b419fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:56.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:56.360+0000 7f58b8bc9640 1 --2- 172.21.15.5:0/3668049501 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58b4109b90 0x7f58b419fa00 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f58ac005cc0 tx=0x7f58ac02f380 comp rx=0 tx=0).stop 2024-08-31T05:44:56.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:56.360+0000 7f58b8bc9640 1 -- 172.21.15.5:0/3668049501 shutdown_connections 2024-08-31T05:44:56.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:56.360+0000 7f58b8bc9640 1 --2- 172.21.15.5:0/3668049501 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f589c0b4ca0 0x7f589c0b71b0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:56.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:56.360+0000 7f58b8bc9640 1 --2- 172.21.15.5:0/3668049501 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58b4109b90 0x7f58b419fa00 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:56.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:56.360+0000 7f58b8bc9640 1 --2- 172.21.15.5:0/3668049501 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f58b4109240 0x7f58b419a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:56.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:56.360+0000 7f58b8bc9640 1 --2- 172.21.15.5:0/3668049501 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58b4103900 0x7f58b419a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:56.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:56.360+0000 7f58b8bc9640 1 -- 172.21.15.5:0/3668049501 >> 172.21.15.5:0/3668049501 conn(0x7f58b407b5f0 msgr2=0x7f58b4107290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:56.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:56.360+0000 7f58b8bc9640 1 -- 172.21.15.5:0/3668049501 shutdown_connections 2024-08-31T05:44:56.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:56.360+0000 7f58b8bc9640 1 -- 172.21.15.5:0/3668049501 wait complete. 2024-08-31T05:44:57.028 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T05:44:57.281 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:44:57.401 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:44:57 smithi005 ceph-mon[18602]: pgmap v810: 129 pgs: 129 active+clean; 851 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 1.5 MiB/s wr, 95 op/s 2024-08-31T05:44:57.401 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:44:57 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/3668049501' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:44:57.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:44:57 smithi070 ceph-mon[22316]: pgmap v810: 129 pgs: 129 active+clean; 851 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 1.5 MiB/s wr, 95 op/s 2024-08-31T05:44:57.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:44:57 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/3668049501' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:44:57.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:44:57 smithi050 ceph-mon[22146]: pgmap v810: 129 pgs: 129 active+clean; 851 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 1.5 MiB/s wr, 95 op/s 2024-08-31T05:44:57.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:44:57 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/3668049501' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T05:44:57.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:57.740+0000 7f2715be3640 1 -- 172.21.15.5:0/2028343401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2710075550 msgr2=0x7f2710075960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:57.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:57.740+0000 7f2715be3640 1 --2- 172.21.15.5:0/2028343401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2710075550 0x7f2710075960 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f2700009900 tx=0x7f270002a410 comp rx=0 tx=0).stop 2024-08-31T05:44:57.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:57.741+0000 7f2715be3640 1 -- 172.21.15.5:0/2028343401 shutdown_connections 2024-08-31T05:44:57.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:57.741+0000 7f2715be3640 1 --2- 172.21.15.5:0/2028343401 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f271010fe80 0x7f27101122c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:57.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:57.741+0000 7f2715be3640 1 --2- 172.21.15.5:0/2028343401 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2710075ea0 0x7f271010f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:57.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:57.741+0000 7f2715be3640 1 --2- 172.21.15.5:0/2028343401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2710075550 0x7f2710075960 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:57.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:57.741+0000 7f2715be3640 1 -- 172.21.15.5:0/2028343401 >> 172.21.15.5:0/2028343401 conn(0x7f27100ff370 msgr2=0x7f27101017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:57.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:57.741+0000 7f2715be3640 1 -- 172.21.15.5:0/2028343401 shutdown_connections 2024-08-31T05:44:57.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:57.741+0000 7f2715be3640 1 -- 172.21.15.5:0/2028343401 wait complete. 2024-08-31T05:44:57.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:57.741+0000 7f2715be3640 1 Processor -- start 2024-08-31T05:44:57.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:57.741+0000 7f2715be3640 1 -- start start 2024-08-31T05:44:57.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:57.742+0000 7f2715be3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2710075550 0x7f271019c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:57.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:57.742+0000 7f2715be3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2710075ea0 0x7f271019c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:57.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:57.742+0000 7f2715be3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f271010fe80 0x7f27101a1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:57.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:57.742+0000 7f2715be3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2710115a30 con 0x7f2710075550 2024-08-31T05:44:57.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:57.742+0000 7f2715be3640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f27101158b0 con 0x7f2710075ea0 2024-08-31T05:44:57.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:57.742+0000 7f2715be3640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2710115bb0 con 0x7f271010fe80 2024-08-31T05:44:57.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:57.742+0000 7f270f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2710075550 0x7f271019c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:57.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:57.742+0000 7f270f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2710075550 0x7f271019c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55308/0 (socket says 172.21.15.5:55308) 2024-08-31T05:44:57.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:57.742+0000 7f270f7fe640 1 -- 172.21.15.5:0/1124344792 learned_addr learned my addr 172.21.15.5:0/1124344792 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:44:57.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:57.742+0000 7f270ffff640 1 --2- 172.21.15.5:0/1124344792 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f271010fe80 0x7f27101a1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:57.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:57.742+0000 7f270effd640 1 --2- 172.21.15.5:0/1124344792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2710075ea0 0x7f271019c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:57.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:57.742+0000 7f270f7fe640 1 -- 172.21.15.5:0/1124344792 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f271010fe80 msgr2=0x7f27101a1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:57.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:57.742+0000 7f270f7fe640 1 --2- 172.21.15.5:0/1124344792 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f271010fe80 0x7f27101a1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:57.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:57.742+0000 7f270f7fe640 1 -- 172.21.15.5:0/1124344792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2710075ea0 msgr2=0x7f271019c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:57.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:57.742+0000 7f270f7fe640 1 --2- 172.21.15.5:0/1124344792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2710075ea0 0x7f271019c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:57.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:57.742+0000 7f270f7fe640 1 -- 172.21.15.5:0/1124344792 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27101a2390 con 0x7f2710075550 2024-08-31T05:44:57.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:57.742+0000 7f270f7fe640 1 --2- 172.21.15.5:0/1124344792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2710075550 0x7f271019c420 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f2700005940 tx=0x7f27000042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:57.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:57.743+0000 7f270cff9640 1 -- 172.21.15.5:0/1124344792 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f270003f030 con 0x7f2710075550 2024-08-31T05:44:57.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:57.743+0000 7f2715be3640 1 -- 172.21.15.5:0/1124344792 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27101a2620 con 0x7f2710075550 2024-08-31T05:44:57.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:57.743+0000 7f270cff9640 1 -- 172.21.15.5:0/1124344792 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2700003cb0 con 0x7f2710075550 2024-08-31T05:44:57.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:57.743+0000 7f270cff9640 1 -- 172.21.15.5:0/1124344792 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2700035070 con 0x7f2710075550 2024-08-31T05:44:57.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:57.743+0000 7f2715be3640 1 -- 172.21.15.5:0/1124344792 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27101a8de0 con 0x7f2710075550 2024-08-31T05:44:57.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:57.744+0000 7f2715be3640 1 -- 172.21.15.5:0/1124344792 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2710075960 con 0x7f2710075550 2024-08-31T05:44:57.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:57.745+0000 7f270cff9640 1 -- 172.21.15.5:0/1124344792 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f2700042030 con 0x7f2710075550 2024-08-31T05:44:57.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:57.746+0000 7f270cff9640 1 --2- 172.21.15.5:0/1124344792 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f26f80b4ca0 0x7f26f80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:57.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:57.746+0000 7f270effd640 1 --2- 172.21.15.5:0/1124344792 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f26f80b4ca0 0x7f26f80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:57.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:57.746+0000 7f270cff9640 1 -- 172.21.15.5:0/1124344792 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9511+0+0 (secure 0 0 0) 0x7f27001063d0 con 0x7f2710075550 2024-08-31T05:44:57.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:57.746+0000 7f270effd640 1 --2- 172.21.15.5:0/1124344792 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f26f80b4ca0 0x7f26f80b71b0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f2710112170 tx=0x7f270400b410 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:57.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:57.749+0000 7f270cff9640 1 -- 172.21.15.5:0/1124344792 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f27000cc730 con 0x7f2710075550 2024-08-31T05:44:57.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:57.938+0000 7f2715be3640 1 -- 172.21.15.5:0/1124344792 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f27101a8fb0 con 0x7f2710075550 2024-08-31T05:44:57.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:57.940+0000 7f270cff9640 1 -- 172.21.15.5:0/1124344792 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) ==== 74+0+25310 (secure 0 0 0) 0x7f27000d0ef0 con 0x7f2710075550 2024-08-31T05:44:57.942 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-08-31T05:44:57.942 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":103,"fsid":"69422704-6758-11ef-bcd4-c7b262605968","created":"2024-08-31T05:19:04.860258+0000","modified":"2024-08-31T05:44:14.941116+0000","last_up_change":"2024-08-31T05:26:38.675914+0000","last_in_change":"2024-08-31T05:26:15.366713+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T05:22:49.802575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T05:27:27.835197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T05:27:30.058144+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":23,"snap_epoch":102,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-31T05:27:36.272228+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":23,"snap_epoch":102,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c5745391-e9d7-4799-9db9-6b34bb91b7df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6803","nonce":2312496244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6805","nonce":2312496244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6809","nonce":2312496244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2312496244},{"type":"v1","addr":"172.21.15.5:6807","nonce":2312496244}]},"public_addr":"172.21.15.5:6803/2312496244","cluster_addr":"172.21.15.5:6805/2312496244","heartbeat_back_addr":"172.21.15.5:6809/2312496244","heartbeat_front_addr":"172.21.15.5:6807/2312496244","state":["exists","up"]},{"osd":1,"uuid":"f1903bd7-b2c5-424e-a74e-795f729471db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6801","nonce":2777359361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6803","nonce":2777359361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6807","nonce":2777359361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":2777359361},{"type":"v1","addr":"172.21.15.50:6805","nonce":2777359361}]},"public_addr":"172.21.15.50:6801/2777359361","cluster_addr":"172.21.15.50:6803/2777359361","heartbeat_back_addr":"172.21.15.50:6807/2777359361","heartbeat_front_addr":"172.21.15.50:6805/2777359361","state":["exists","up"]},{"osd":2,"uuid":"134c5892-e44a-44f2-8cd2-484d22a45e2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6801","nonce":1400583716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6803","nonce":1400583716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6807","nonce":1400583716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1400583716},{"type":"v1","addr":"172.21.15.70:6805","nonce":1400583716}]},"public_addr":"172.21.15.70:6801/1400583716","cluster_addr":"172.21.15.70:6803/1400583716","heartbeat_back_addr":"172.21.15.70:6807/1400583716","heartbeat_front_addr":"172.21.15.70:6805/1400583716","state":["exists","up"]},{"osd":3,"uuid":"af49398a-e171-496b-a50e-1f767fc42923","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6811","nonce":1647468379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6813","nonce":1647468379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6817","nonce":1647468379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1647468379},{"type":"v1","addr":"172.21.15.5:6815","nonce":1647468379}]},"public_addr":"172.21.15.5:6811/1647468379","cluster_addr":"172.21.15.5:6813/1647468379","heartbeat_back_addr":"172.21.15.5:6817/1647468379","heartbeat_front_addr":"172.21.15.5:6815/1647468379","state":["exists","up"]},{"osd":4,"uuid":"59b847ef-6eb0-4c13-aa06-53a76d77ce45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6809","nonce":2314546877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6811","nonce":2314546877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6815","nonce":2314546877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":2314546877},{"type":"v1","addr":"172.21.15.50:6813","nonce":2314546877}]},"public_addr":"172.21.15.50:6809/2314546877","cluster_addr":"172.21.15.50:6811/2314546877","heartbeat_back_addr":"172.21.15.50:6815/2314546877","heartbeat_front_addr":"172.21.15.50:6813/2314546877","state":["exists","up"]},{"osd":5,"uuid":"b0dac185-4462-4760-aa36-0d221923b007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6809","nonce":311426299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6811","nonce":311426299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6815","nonce":311426299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":311426299},{"type":"v1","addr":"172.21.15.70:6813","nonce":311426299}]},"public_addr":"172.21.15.70:6809/311426299","cluster_addr":"172.21.15.70:6811/311426299","heartbeat_back_addr":"172.21.15.70:6815/311426299","heartbeat_front_addr":"172.21.15.70:6813/311426299","state":["exists","up"]},{"osd":6,"uuid":"12486aa2-61e4-4bdf-94dd-ce5c4cd3df6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6819","nonce":1027645612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6821","nonce":1027645612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6825","nonce":1027645612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1027645612},{"type":"v1","addr":"172.21.15.5:6823","nonce":1027645612}]},"public_addr":"172.21.15.5:6819/1027645612","cluster_addr":"172.21.15.5:6821/1027645612","heartbeat_back_addr":"172.21.15.5:6825/1027645612","heartbeat_front_addr":"172.21.15.5:6823/1027645612","state":["exists","up"]},{"osd":7,"uuid":"66f9dcf9-d5c3-4016-812f-d9496e9892d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6817","nonce":2718354517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6819","nonce":2718354517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6823","nonce":2718354517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2718354517},{"type":"v1","addr":"172.21.15.50:6821","nonce":2718354517}]},"public_addr":"172.21.15.50:6817/2718354517","cluster_addr":"172.21.15.50:6819/2718354517","heartbeat_back_addr":"172.21.15.50:6823/2718354517","heartbeat_front_addr":"172.21.15.50:6821/2718354517","state":["exists","up"]},{"osd":8,"uuid":"584837f9-af4b-4189-a7e5-04156a94a805","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6817","nonce":3155722993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6819","nonce":3155722993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6823","nonce":3155722993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":3155722993},{"type":"v1","addr":"172.21.15.70:6821","nonce":3155722993}]},"public_addr":"172.21.15.70:6817/3155722993","cluster_addr":"172.21.15.70:6819/3155722993","heartbeat_back_addr":"172.21.15.70:6823/3155722993","heartbeat_front_addr":"172.21.15.70:6821/3155722993","state":["exists","up"]},{"osd":9,"uuid":"ef60de6e-3456-435c-bd48-ed2636cc0d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6827","nonce":2988145512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6829","nonce":2988145512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6833","nonce":2988145512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2988145512},{"type":"v1","addr":"172.21.15.5:6831","nonce":2988145512}]},"public_addr":"172.21.15.5:6827/2988145512","cluster_addr":"172.21.15.5:6829/2988145512","heartbeat_back_addr":"172.21.15.5:6833/2988145512","heartbeat_front_addr":"172.21.15.5:6831/2988145512","state":["exists","up"]},{"osd":10,"uuid":"96c5de40-53df-412d-9501-8ce1711a76a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6825","nonce":4168871229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6827","nonce":4168871229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6831","nonce":4168871229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":4168871229},{"type":"v1","addr":"172.21.15.50:6829","nonce":4168871229}]},"public_addr":"172.21.15.50:6825/4168871229","cluster_addr":"172.21.15.50:6827/4168871229","heartbeat_back_addr":"172.21.15.50:6831/4168871229","heartbeat_front_addr":"172.21.15.50:6829/4168871229","state":["exists","up"]},{"osd":11,"uuid":"20beefe0-59c3-4392-9f61-8d215e9d2de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6825","nonce":2593470535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6827","nonce":2593470535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6831","nonce":2593470535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":2593470535},{"type":"v1","addr":"172.21.15.70:6829","nonce":2593470535}]},"public_addr":"172.21.15.70:6825/2593470535","cluster_addr":"172.21.15.70:6827/2593470535","heartbeat_back_addr":"172.21.15.70:6831/2593470535","heartbeat_front_addr":"172.21.15.70:6829/2593470535","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:21:56.748083+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:22:21.969492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:22:46.642917+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:23:11.630486+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:23:36.389322+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:24:01.431039+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:24:27.057017+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:24:53.628200+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:25:19.356502+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:25:44.958024+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:26:10.804919+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T05:26:36.849133+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":7}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":5,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:0/2473024253":"2024-09-01T05:20:57.333680+0000","172.21.15.5:0/2924148490":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/2163558485":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/2111919168":"2024-09-01T05:19:55.663503+0000","172.21.15.5:6801/3616278616":"2024-09-01T05:19:55.663503+0000","172.21.15.5:0/2436421090":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/1570244689":"2024-09-01T05:19:55.663503+0000","172.21.15.5:0/2700448223":"2024-09-01T05:20:57.333680+0000","172.21.15.5:6800/3616278616":"2024-09-01T05:19:55.663503+0000","172.21.15.5:6800/2898463711":"2024-09-01T05:19:31.728664+0000","172.21.15.5:0/2450461036":"2024-09-01T05:20:57.333680+0000","172.21.15.5:0/1947189952":"2024-09-01T05:19:55.663503+0000","172.21.15.5:6800/1439868821":"2024-09-01T05:20:57.333680+0000","172.21.15.5:6801/2898463711":"2024-09-01T05:19:31.728664+0000","172.21.15.5:6801/1439868821":"2024-09-01T05:20:57.333680+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":10,"length":1},{"begin":23,"length":1}]},{"pool":4,"snaps":[{"begin":10,"length":1},{"begin":23,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T05:44:57.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:57.942+0000 7f2715be3640 1 -- 172.21.15.5:0/1124344792 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f26f80b4ca0 msgr2=0x7f26f80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:57.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:57.942+0000 7f2715be3640 1 --2- 172.21.15.5:0/1124344792 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f26f80b4ca0 0x7f26f80b71b0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f2710112170 tx=0x7f270400b410 comp rx=0 tx=0).stop 2024-08-31T05:44:57.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:57.942+0000 7f2715be3640 1 -- 172.21.15.5:0/1124344792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2710075550 msgr2=0x7f271019c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:57.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:57.942+0000 7f2715be3640 1 --2- 172.21.15.5:0/1124344792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2710075550 0x7f271019c420 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f2700005940 tx=0x7f27000042f0 comp rx=0 tx=0).stop 2024-08-31T05:44:57.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:57.942+0000 7f2715be3640 1 -- 172.21.15.5:0/1124344792 shutdown_connections 2024-08-31T05:44:57.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:57.942+0000 7f2715be3640 1 --2- 172.21.15.5:0/1124344792 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f26f80b4ca0 0x7f26f80b71b0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:57.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:57.942+0000 7f2715be3640 1 --2- 172.21.15.5:0/1124344792 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f271010fe80 0x7f27101a1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:57.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:57.942+0000 7f2715be3640 1 --2- 172.21.15.5:0/1124344792 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f2710075ea0 0x7f271019c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:57.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:57.942+0000 7f2715be3640 1 --2- 172.21.15.5:0/1124344792 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2710075550 0x7f271019c420 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:57.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:57.942+0000 7f2715be3640 1 -- 172.21.15.5:0/1124344792 >> 172.21.15.5:0/1124344792 conn(0x7f27100ff370 msgr2=0x7f2710109a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:57.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:57.942+0000 7f2715be3640 1 -- 172.21.15.5:0/1124344792 shutdown_connections 2024-08-31T05:44:57.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:57.942+0000 7f2715be3640 1 -- 172.21.15.5:0/1124344792 wait complete. 2024-08-31T05:44:58.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:44:58 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/1124344792' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T05:44:58.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:44:58 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/1124344792' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T05:44:58.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:44:58 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/1124344792' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T05:44:58.662 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs fail cephfs 2024-08-31T05:44:58.916 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:44:59.304 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:44:59 smithi005 ceph-mon[18602]: pgmap v811: 129 pgs: 129 active+clean; 852 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 704 KiB/s wr, 65 op/s 2024-08-31T05:44:59.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.393+0000 7ff5a2d98640 1 -- 172.21.15.5:0/145810084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff59c10dbf0 msgr2=0x7ff59c1100c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:59.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.393+0000 7ff5a2d98640 1 --2- 172.21.15.5:0/145810084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff59c10dbf0 0x7ff59c1100c0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7ff594009ca0 tx=0x7ff59402a8c0 comp rx=0 tx=0).stop 2024-08-31T05:44:59.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.393+0000 7ff5a2d98640 1 -- 172.21.15.5:0/145810084 shutdown_connections 2024-08-31T05:44:59.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.393+0000 7ff5a2d98640 1 --2- 172.21.15.5:0/145810084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff59c10dbf0 0x7ff59c1100c0 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:59.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.393+0000 7ff5a2d98640 1 --2- 172.21.15.5:0/145810084 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff59c105070 0x7ff59c10d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:59.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.393+0000 7ff5a2d98640 1 --2- 172.21.15.5:0/145810084 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff59c104640 0x7ff59c104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:59.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.393+0000 7ff5a2d98640 1 -- 172.21.15.5:0/145810084 >> 172.21.15.5:0/145810084 conn(0x7ff59c0794e0 msgr2=0x7ff59c0798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:59.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.393+0000 7ff5a2d98640 1 -- 172.21.15.5:0/145810084 shutdown_connections 2024-08-31T05:44:59.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.394+0000 7ff5a2d98640 1 -- 172.21.15.5:0/145810084 wait complete. 2024-08-31T05:44:59.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.394+0000 7ff5a2d98640 1 Processor -- start 2024-08-31T05:44:59.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.394+0000 7ff5a2d98640 1 -- start start 2024-08-31T05:44:59.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.394+0000 7ff5a2d98640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff59c104640 0x7ff59c19a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:59.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.394+0000 7ff5a2d98640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff59c105070 0x7ff59c19a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:59.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.395+0000 7ff5a2d98640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff59c10dbf0 0x7ff59c19fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:59.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.395+0000 7ff5a2d98640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff59c113830 con 0x7ff59c104640 2024-08-31T05:44:59.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.395+0000 7ff5a2d98640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7ff59c1136b0 con 0x7ff59c10dbf0 2024-08-31T05:44:59.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.395+0000 7ff5a2d98640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff59c1139b0 con 0x7ff59c105070 2024-08-31T05:44:59.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.395+0000 7ff5a0b34640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff59c104640 0x7ff59c19a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:59.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.395+0000 7ff5a0b34640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff59c104640 0x7ff59c19a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55320/0 (socket says 172.21.15.5:55320) 2024-08-31T05:44:59.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.395+0000 7ff5a0b34640 1 -- 172.21.15.5:0/3746284235 learned_addr learned my addr 172.21.15.5:0/3746284235 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:44:59.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.395+0000 7ff5a1335640 1 --2- 172.21.15.5:0/3746284235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff59c10dbf0 0x7ff59c19fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:59.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.395+0000 7ff593fff640 1 --2- 172.21.15.5:0/3746284235 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff59c105070 0x7ff59c19a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:59.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.395+0000 7ff5a0b34640 1 -- 172.21.15.5:0/3746284235 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff59c105070 msgr2=0x7ff59c19a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:59.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.395+0000 7ff5a0b34640 1 --2- 172.21.15.5:0/3746284235 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff59c105070 0x7ff59c19a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:59.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.395+0000 7ff5a0b34640 1 -- 172.21.15.5:0/3746284235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff59c10dbf0 msgr2=0x7ff59c19fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:59.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.395+0000 7ff5a0b34640 1 --2- 172.21.15.5:0/3746284235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff59c10dbf0 0x7ff59c19fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:59.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.395+0000 7ff5a0b34640 1 -- 172.21.15.5:0/3746284235 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff59c1a0270 con 0x7ff59c104640 2024-08-31T05:44:59.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.395+0000 7ff593fff640 1 --2- 172.21.15.5:0/3746284235 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff59c105070 0x7ff59c19a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:44:59.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.395+0000 7ff5a0b34640 1 --2- 172.21.15.5:0/3746284235 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff59c104640 0x7ff59c19a300 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7ff59800d950 tx=0x7ff59800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:59.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.395+0000 7ff591ffb640 1 -- 172.21.15.5:0/3746284235 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff598017070 con 0x7ff59c104640 2024-08-31T05:44:59.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.395+0000 7ff591ffb640 1 -- 172.21.15.5:0/3746284235 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff598009c30 con 0x7ff59c104640 2024-08-31T05:44:59.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.395+0000 7ff5a2d98640 1 -- 172.21.15.5:0/3746284235 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff59c1a0560 con 0x7ff59c104640 2024-08-31T05:44:59.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.395+0000 7ff591ffb640 1 -- 172.21.15.5:0/3746284235 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff59800f620 con 0x7ff59c104640 2024-08-31T05:44:59.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.396+0000 7ff5a2d98640 1 -- 172.21.15.5:0/3746284235 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff59c1a6cc0 con 0x7ff59c104640 2024-08-31T05:44:59.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.397+0000 7ff5a2d98640 1 -- 172.21.15.5:0/3746284235 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff59c06bf40 con 0x7ff59c104640 2024-08-31T05:44:59.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.398+0000 7ff591ffb640 1 -- 172.21.15.5:0/3746284235 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7ff59801a070 con 0x7ff59c104640 2024-08-31T05:44:59.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.399+0000 7ff591ffb640 1 --2- 172.21.15.5:0/3746284235 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff5840b4ca0 0x7ff5840b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:44:59.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.399+0000 7ff593fff640 1 --2- 172.21.15.5:0/3746284235 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff5840b4ca0 0x7ff5840b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:44:59.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.399+0000 7ff591ffb640 1 -- 172.21.15.5:0/3746284235 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9511+0+0 (secure 0 0 0) 0x7ff5980e5400 con 0x7ff59c104640 2024-08-31T05:44:59.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.399+0000 7ff593fff640 1 --2- 172.21.15.5:0/3746284235 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff5840b4ca0 0x7ff5840b71b0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7ff59c10f9a0 tx=0x7ff58c005f90 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:44:59.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.402+0000 7ff591ffb640 1 -- 172.21.15.5:0/3746284235 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff598009de0 con 0x7ff59c104640 2024-08-31T05:44:59.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:44:59 smithi070 ceph-mon[22316]: pgmap v811: 129 pgs: 129 active+clean; 852 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 704 KiB/s wr, 65 op/s 2024-08-31T05:44:59.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.625+0000 7ff5a2d98640 1 -- 172.21.15.5:0/3746284235 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7ff59c104a50 con 0x7ff59c104640 2024-08-31T05:44:59.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.628+0000 7ff591ffb640 1 -- 172.21.15.5:0/3746284235 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v37) ==== 161+0+0 (secure 0 0 0) 0x7ff5980abe10 con 0x7ff59c104640 2024-08-31T05:44:59.630 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-31T05:44:59.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.634+0000 7ff5a2d98640 1 -- 172.21.15.5:0/3746284235 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff5840b4ca0 msgr2=0x7ff5840b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:59.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.634+0000 7ff5a2d98640 1 --2- 172.21.15.5:0/3746284235 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff5840b4ca0 0x7ff5840b71b0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7ff59c10f9a0 tx=0x7ff58c005f90 comp rx=0 tx=0).stop 2024-08-31T05:44:59.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.635+0000 7ff5a2d98640 1 -- 172.21.15.5:0/3746284235 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff59c104640 msgr2=0x7ff59c19a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:44:59.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.635+0000 7ff5a2d98640 1 --2- 172.21.15.5:0/3746284235 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff59c104640 0x7ff59c19a300 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7ff59800d950 tx=0x7ff59800de10 comp rx=0 tx=0).stop 2024-08-31T05:44:59.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.635+0000 7ff5a2d98640 1 -- 172.21.15.5:0/3746284235 shutdown_connections 2024-08-31T05:44:59.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.635+0000 7ff5a2d98640 1 --2- 172.21.15.5:0/3746284235 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7ff5840b4ca0 0x7ff5840b71b0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:59.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.635+0000 7ff5a2d98640 1 --2- 172.21.15.5:0/3746284235 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7ff59c10dbf0 0x7ff59c19fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:59.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.635+0000 7ff5a2d98640 1 --2- 172.21.15.5:0/3746284235 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff59c105070 0x7ff59c19a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:59.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.635+0000 7ff5a2d98640 1 --2- 172.21.15.5:0/3746284235 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff59c104640 0x7ff59c19a300 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:44:59.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.635+0000 7ff5a2d98640 1 -- 172.21.15.5:0/3746284235 >> 172.21.15.5:0/3746284235 conn(0x7ff59c0794e0 msgr2=0x7ff59c106630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:44:59.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.635+0000 7ff5a2d98640 1 -- 172.21.15.5:0/3746284235 shutdown_connections 2024-08-31T05:44:59.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:44:59.635+0000 7ff5a2d98640 1 -- 172.21.15.5:0/3746284235 wait complete. 2024-08-31T05:44:59.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:44:59 smithi050 ceph-mon[22146]: pgmap v811: 129 pgs: 129 active+clean; 852 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 704 KiB/s wr, 65 op/s 2024-08-31T05:44:59.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:44:59 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mon-a[18598]: 2024-08-31T05:44:59.626+0000 7f5e9eac2640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-31T05:44:59.967 INFO:journalctl@ceph.mds.a.smithi005.stdout:Aug 31 05:44:59 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-a[60842]: ignoring --setuser ceph since I am not root 2024-08-31T05:44:59.968 INFO:journalctl@ceph.mds.a.smithi005.stdout:Aug 31 05:44:59 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-a[60842]: ignoring --setgroup ceph since I am not root 2024-08-31T05:44:59.968 INFO:journalctl@ceph.mds.a.smithi005.stdout:Aug 31 05:44:59 smithi005 ceph-mds[60846]: -- 172.21.15.5:0/3177542227 <== mon.0 v2:172.21.15.5:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564d32989c20 con 0x564d36b2f600 2024-08-31T05:44:59.968 INFO:journalctl@ceph.mds.a.smithi005.stdout:Aug 31 05:44:59 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-a[60842]: starting mds.a at 2024-08-31T05:44:59.968 INFO:journalctl@ceph.mds.g.smithi005.stdout:Aug 31 05:44:59 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-g[60457]: starting mds.g at 2024-08-31T05:45:00.086 INFO:journalctl@ceph.mds.l.smithi070.stdout:Aug 31 05:44:59 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-l[52910]: ignoring --setuser ceph since I am not root 2024-08-31T05:45:00.086 INFO:journalctl@ceph.mds.l.smithi070.stdout:Aug 31 05:44:59 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-l[52910]: ignoring --setgroup ceph since I am not root 2024-08-31T05:45:00.086 INFO:journalctl@ceph.mds.l.smithi070.stdout:Aug 31 05:44:59 smithi070 ceph-mds[52914]: -- 172.21.15.70:0/4012736646 <== mon.0 v2:172.21.15.5:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558930fa5860 con 0x55893514b180 2024-08-31T05:45:00.086 INFO:journalctl@ceph.mds.l.smithi070.stdout:Aug 31 05:44:59 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-l[52910]: starting mds.l at 2024-08-31T05:45:00.087 INFO:journalctl@ceph.mds.f.smithi070.stdout:Aug 31 05:44:59 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-f[53213]: ignoring --setuser ceph since I am not root 2024-08-31T05:45:00.087 INFO:journalctl@ceph.mds.f.smithi070.stdout:Aug 31 05:44:59 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-f[53213]: ignoring --setgroup ceph since I am not root 2024-08-31T05:45:00.087 INFO:journalctl@ceph.mds.f.smithi070.stdout:Aug 31 05:44:59 smithi070 ceph-mds[53217]: -- 172.21.15.70:0/3575308872 <== mon.1 v2:172.21.15.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555e5b675860 con 0x555e5f81b180 2024-08-31T05:45:00.087 INFO:journalctl@ceph.mds.f.smithi070.stdout:Aug 31 05:44:59 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-f[53213]: starting mds.f at 2024-08-31T05:45:00.087 INFO:journalctl@ceph.mds.i.smithi070.stdout:Aug 31 05:44:59 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-i[53824]: ignoring --setuser ceph since I am not root 2024-08-31T05:45:00.088 INFO:journalctl@ceph.mds.i.smithi070.stdout:Aug 31 05:44:59 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-i[53824]: ignoring --setgroup ceph since I am not root 2024-08-31T05:45:00.088 INFO:journalctl@ceph.mds.i.smithi070.stdout:Aug 31 05:44:59 smithi070 ceph-mds[53828]: -- 172.21.15.70:0/1889442021 <== mon.1 v2:172.21.15.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556b01051c20 con 0x556b051f7a80 2024-08-31T05:45:00.088 INFO:journalctl@ceph.mds.i.smithi070.stdout:Aug 31 05:44:59 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-i[53824]: starting mds.i at 2024-08-31T05:45:00.088 INFO:journalctl@ceph.mds.c.smithi070.stdout:Aug 31 05:44:59 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-c[53513]: ignoring --setuser ceph since I am not root 2024-08-31T05:45:00.088 INFO:journalctl@ceph.mds.c.smithi070.stdout:Aug 31 05:44:59 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-c[53513]: ignoring --setgroup ceph since I am not root 2024-08-31T05:45:00.088 INFO:journalctl@ceph.mds.c.smithi070.stdout:Aug 31 05:44:59 smithi070 ceph-mds[53517]: -- 172.21.15.70:0/3492285778 <== mon.1 v2:172.21.15.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b810eef860 con 0x55b815095180 2024-08-31T05:45:00.089 INFO:journalctl@ceph.mds.c.smithi070.stdout:Aug 31 05:44:59 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-c[53513]: starting mds.c at 2024-08-31T05:45:00.157 INFO:journalctl@ceph.mds.b.smithi050.stdout:Aug 31 05:44:59 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-b[53599]: ignoring --setuser ceph since I am not root 2024-08-31T05:45:00.157 INFO:journalctl@ceph.mds.b.smithi050.stdout:Aug 31 05:44:59 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-b[53599]: ignoring --setgroup ceph since I am not root 2024-08-31T05:45:00.157 INFO:journalctl@ceph.mds.b.smithi050.stdout:Aug 31 05:44:59 smithi050 ceph-mds[53603]: -- 172.21.15.50:0/678318874 <== mon.2 v2:172.21.15.50:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5632b4853860 con 0x5632b89f9600 2024-08-31T05:45:00.157 INFO:journalctl@ceph.mds.b.smithi050.stdout:Aug 31 05:44:59 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-b[53599]: starting mds.b at 2024-08-31T05:45:00.158 INFO:journalctl@ceph.mds.h.smithi050.stdout:Aug 31 05:44:59 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-h[53283]: ignoring --setuser ceph since I am not root 2024-08-31T05:45:00.158 INFO:journalctl@ceph.mds.h.smithi050.stdout:Aug 31 05:44:59 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-h[53283]: ignoring --setgroup ceph since I am not root 2024-08-31T05:45:00.158 INFO:journalctl@ceph.mds.h.smithi050.stdout:Aug 31 05:44:59 smithi050 ceph-mds[53287]: -- 172.21.15.50:0/469545209 <== mon.0 v2:172.21.15.5:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b8974f7860 con 0x55b89b69d180 2024-08-31T05:45:00.158 INFO:journalctl@ceph.mds.h.smithi050.stdout:Aug 31 05:44:59 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-h[53283]: starting mds.h at 2024-08-31T05:45:00.159 INFO:journalctl@ceph.mds.e.smithi050.stdout:Aug 31 05:44:59 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-e[52981]: ignoring --setuser ceph since I am not root 2024-08-31T05:45:00.159 INFO:journalctl@ceph.mds.e.smithi050.stdout:Aug 31 05:44:59 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-e[52981]: ignoring --setgroup ceph since I am not root 2024-08-31T05:45:00.159 INFO:journalctl@ceph.mds.e.smithi050.stdout:Aug 31 05:44:59 smithi050 ceph-mds[52985]: -- 172.21.15.50:0/50596631 <== mon.0 v2:172.21.15.5:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5616c0747860 con 0x5616c48ed180 2024-08-31T05:45:00.159 INFO:journalctl@ceph.mds.e.smithi050.stdout:Aug 31 05:44:59 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-e[52981]: starting mds.e at 2024-08-31T05:45:00.159 INFO:journalctl@ceph.mds.k.smithi050.stdout:Aug 31 05:44:59 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-k[52669]: ignoring --setuser ceph since I am not root 2024-08-31T05:45:00.159 INFO:journalctl@ceph.mds.k.smithi050.stdout:Aug 31 05:44:59 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-k[52669]: ignoring --setgroup ceph since I am not root 2024-08-31T05:45:00.160 INFO:journalctl@ceph.mds.k.smithi050.stdout:Aug 31 05:44:59 smithi050 ceph-mds[52673]: -- 172.21.15.50:0/65974747 <== mon.0 v2:172.21.15.5:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c2d39c9c20 con 0x55c2d7b6f600 2024-08-31T05:45:00.160 INFO:journalctl@ceph.mds.k.smithi050.stdout:Aug 31 05:44:59 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-k[52669]: starting mds.k at 2024-08-31T05:45:00.295 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:45:00 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/3746284235' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-08-31T05:45:00.295 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:45:00 smithi005 ceph-mon[18602]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-31T05:45:00.295 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:45:00 smithi005 ceph-mon[18602]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-31T05:45:00.296 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:45:00 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/3746284235' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-08-31T05:45:00.296 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:45:00 smithi005 ceph-mon[18602]: osdmap e104: 12 total, 12 up, 12 in 2024-08-31T05:45:00.296 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:45:00 smithi005 ceph-mon[18602]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-08-31T05:45:00.297 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-08-31T05:45:00.552 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:45:00.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:45:00 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/3746284235' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-08-31T05:45:00.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:45:00 smithi070 ceph-mon[22316]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-31T05:45:00.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:45:00 smithi070 ceph-mon[22316]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-31T05:45:00.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:45:00 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/3746284235' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-08-31T05:45:00.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:45:00 smithi070 ceph-mon[22316]: osdmap e104: 12 total, 12 up, 12 in 2024-08-31T05:45:00.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:45:00 smithi070 ceph-mon[22316]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-08-31T05:45:00.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:00 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/3746284235' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-08-31T05:45:00.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:00 smithi050 ceph-mon[22146]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-31T05:45:00.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:00 smithi050 ceph-mon[22146]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-31T05:45:00.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:00 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/3746284235' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-08-31T05:45:00.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:00 smithi050 ceph-mon[22146]: osdmap e104: 12 total, 12 up, 12 in 2024-08-31T05:45:00.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:00 smithi050 ceph-mon[22146]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-08-31T05:45:01.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:01.046+0000 7f66eb4a6640 1 -- 172.21.15.5:0/3663206387 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66e4102d40 msgr2=0x7f66e410fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:45:01.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:01.046+0000 7f66eb4a6640 1 --2- 172.21.15.5:0/3663206387 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66e4102d40 0x7f66e410fa60 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f66d4009900 tx=0x7f66d402a480 comp rx=0 tx=0).stop 2024-08-31T05:45:01.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:01.046+0000 7f66eb4a6640 1 -- 172.21.15.5:0/3663206387 shutdown_connections 2024-08-31T05:45:01.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:01.046+0000 7f66eb4a6640 1 --2- 172.21.15.5:0/3663206387 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66e410ffa0 0x7f66e41123c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:45:01.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:01.046+0000 7f66eb4a6640 1 --2- 172.21.15.5:0/3663206387 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66e4102d40 0x7f66e410fa60 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:45:01.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:01.046+0000 7f66eb4a6640 1 --2- 172.21.15.5:0/3663206387 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66e41023f0 0x7f66e4102800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:45:01.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:01.046+0000 7f66eb4a6640 1 -- 172.21.15.5:0/3663206387 >> 172.21.15.5:0/3663206387 conn(0x7f66e4079510 msgr2=0x7f66e4079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:45:01.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:01.046+0000 7f66eb4a6640 1 -- 172.21.15.5:0/3663206387 shutdown_connections 2024-08-31T05:45:01.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:01.046+0000 7f66eb4a6640 1 -- 172.21.15.5:0/3663206387 wait complete. 2024-08-31T05:45:01.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:01.047+0000 7f66eb4a6640 1 Processor -- start 2024-08-31T05:45:01.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:01.047+0000 7f66eb4a6640 1 -- start start 2024-08-31T05:45:01.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:01.047+0000 7f66eb4a6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66e41023f0 0x7f66e419c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:45:01.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:01.047+0000 7f66eb4a6640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66e4102d40 0x7f66e419ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:45:01.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:01.047+0000 7f66eb4a6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66e410ffa0 0x7f66e41a1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:45:01.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:01.047+0000 7f66eb4a6640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f66e4115a90 con 0x7f66e410ffa0 2024-08-31T05:45:01.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:01.047+0000 7f66eb4a6640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f66e4115910 con 0x7f66e4102d40 2024-08-31T05:45:01.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:01.047+0000 7f66eb4a6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f66e4115c10 con 0x7f66e41023f0 2024-08-31T05:45:01.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:01.047+0000 7f66e9a43640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66e410ffa0 0x7f66e41a1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:45:01.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:01.047+0000 7f66e9a43640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66e410ffa0 0x7f66e41a1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55368/0 (socket says 172.21.15.5:55368) 2024-08-31T05:45:01.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:01.047+0000 7f66e9a43640 1 -- 172.21.15.5:0/2205039059 learned_addr learned my addr 172.21.15.5:0/2205039059 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:45:01.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:01.047+0000 7f66e9242640 1 --2- 172.21.15.5:0/2205039059 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66e41023f0 0x7f66e419c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:45:01.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:01.047+0000 7f66e8a41640 1 --2- 172.21.15.5:0/2205039059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66e4102d40 0x7f66e419ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:45:01.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:01.047+0000 7f66e9a43640 1 -- 172.21.15.5:0/2205039059 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66e41023f0 msgr2=0x7f66e419c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:45:01.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:01.047+0000 7f66e9a43640 1 --2- 172.21.15.5:0/2205039059 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66e41023f0 0x7f66e419c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:45:01.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:01.047+0000 7f66e9a43640 1 -- 172.21.15.5:0/2205039059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66e4102d40 msgr2=0x7f66e419ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:45:01.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:01.047+0000 7f66e9a43640 1 --2- 172.21.15.5:0/2205039059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66e4102d40 0x7f66e419ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:45:01.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:01.047+0000 7f66e9a43640 1 -- 172.21.15.5:0/2205039059 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66e41a2330 con 0x7f66e410ffa0 2024-08-31T05:45:01.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:01.048+0000 7f66e9a43640 1 --2- 172.21.15.5:0/2205039059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66e410ffa0 0x7f66e41a1cc0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f66dc00cce0 tx=0x7f66dc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:45:01.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:01.048+0000 7f66da7fc640 1 -- 172.21.15.5:0/2205039059 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66dc00f450 con 0x7f66e410ffa0 2024-08-31T05:45:01.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:01.048+0000 7f66da7fc640 1 -- 172.21.15.5:0/2205039059 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66dc00faa0 con 0x7f66e410ffa0 2024-08-31T05:45:01.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:01.048+0000 7f66eb4a6640 1 -- 172.21.15.5:0/2205039059 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66e41a2620 con 0x7f66e410ffa0 2024-08-31T05:45:01.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:01.048+0000 7f66da7fc640 1 -- 172.21.15.5:0/2205039059 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66dc018b70 con 0x7f66e410ffa0 2024-08-31T05:45:01.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:01.048+0000 7f66eb4a6640 1 -- 172.21.15.5:0/2205039059 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66e41a2ae0 con 0x7f66e410ffa0 2024-08-31T05:45:01.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:01.049+0000 7f66eb4a6640 1 -- 172.21.15.5:0/2205039059 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66e406c000 con 0x7f66e410ffa0 2024-08-31T05:45:01.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:01.050+0000 7f66da7fc640 1 -- 172.21.15.5:0/2205039059 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f66dc018d10 con 0x7f66e410ffa0 2024-08-31T05:45:01.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:01.051+0000 7f66da7fc640 1 --2- 172.21.15.5:0/2205039059 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f66d00b4cd0 0x7f66d00b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:45:01.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:01.051+0000 7f66e9242640 1 --2- 172.21.15.5:0/2205039059 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f66d00b4cd0 0x7f66d00b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:45:01.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:01.051+0000 7f66da7fc640 1 -- 172.21.15.5:0/2205039059 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9853+0+0 (secure 0 0 0) 0x7f66dc0e5f50 con 0x7f66e410ffa0 2024-08-31T05:45:01.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:01.052+0000 7f66e9242640 1 --2- 172.21.15.5:0/2205039059 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f66d00b4cd0 0x7f66d00b71e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f66e0005fd0 tx=0x7f66e0005850 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:45:01.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:01.055+0000 7f66da7fc640 1 -- 172.21.15.5:0/2205039059 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f66dc014030 con 0x7f66e410ffa0 2024-08-31T05:45:01.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:45:01 smithi005 ceph-mon[18602]: pgmap v813: 129 pgs: 129 active+clean; 852 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 228 KiB/s wr, 32 op/s 2024-08-31T05:45:01.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:45:01 smithi005 ceph-mon[18602]: mds.? [v2:172.21.15.5:6838/1903912996,v1:172.21.15.5:6839/1903912996] up:boot 2024-08-31T05:45:01.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:45:01 smithi005 ceph-mon[18602]: mds.? [v2:172.21.15.5:6840/1377556759,v1:172.21.15.5:6841/1377556759] up:boot 2024-08-31T05:45:01.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:45:01 smithi005 ceph-mon[18602]: mds.? [v2:172.21.15.50:6832/3070985096,v1:172.21.15.50:6834/3070985096] up:boot 2024-08-31T05:45:01.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:45:01 smithi005 ceph-mon[18602]: mds.? [v2:172.21.15.50:6833/2429086010,v1:172.21.15.50:6835/2429086010] up:boot 2024-08-31T05:45:01.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:45:01 smithi005 ceph-mon[18602]: mds.? [v2:172.21.15.50:6836/1557083890,v1:172.21.15.50:6837/1557083890] up:boot 2024-08-31T05:45:01.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:45:01 smithi005 ceph-mon[18602]: mds.? [v2:172.21.15.50:6838/193839820,v1:172.21.15.50:6839/193839820] up:boot 2024-08-31T05:45:01.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:45:01 smithi005 ceph-mon[18602]: mds.? [v2:172.21.15.70:6832/38291845,v1:172.21.15.70:6834/38291845] up:boot 2024-08-31T05:45:01.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:45:01 smithi005 ceph-mon[18602]: mds.? [v2:172.21.15.70:6833/463870039,v1:172.21.15.70:6835/463870039] up:boot 2024-08-31T05:45:01.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:45:01 smithi005 ceph-mon[18602]: mds.? [v2:172.21.15.70:6836/624776907,v1:172.21.15.70:6839/624776907] up:boot 2024-08-31T05:45:01.219 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:45:01 smithi005 ceph-mon[18602]: mds.? [v2:172.21.15.70:6837/1852553127,v1:172.21.15.70:6838/1852553127] up:boot 2024-08-31T05:45:01.219 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:45:01 smithi005 ceph-mon[18602]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-08-31T05:45:01.219 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:45:01 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-08-31T05:45:01.219 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:45:01 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-08-31T05:45:01.219 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:45:01 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-31T05:45:01.219 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:45:01 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-08-31T05:45:01.219 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:45:01 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-31T05:45:01.219 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:45:01 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-08-31T05:45:01.219 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:45:01 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-31T05:45:01.220 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:45:01 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-31T05:45:01.220 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:45:01 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-31T05:45:01.220 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:45:01 smithi005 ceph-mon[18602]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-31T05:45:01.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:01.282+0000 7f66eb4a6640 1 -- 172.21.15.5:0/2205039059 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f66e41a8f90 con 0x7f66e410ffa0 2024-08-31T05:45:01.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:45:01 smithi070 ceph-mon[22316]: pgmap v813: 129 pgs: 129 active+clean; 852 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 228 KiB/s wr, 32 op/s 2024-08-31T05:45:01.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:45:01 smithi070 ceph-mon[22316]: mds.? [v2:172.21.15.5:6838/1903912996,v1:172.21.15.5:6839/1903912996] up:boot 2024-08-31T05:45:01.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:45:01 smithi070 ceph-mon[22316]: mds.? [v2:172.21.15.5:6840/1377556759,v1:172.21.15.5:6841/1377556759] up:boot 2024-08-31T05:45:01.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:45:01 smithi070 ceph-mon[22316]: mds.? [v2:172.21.15.50:6832/3070985096,v1:172.21.15.50:6834/3070985096] up:boot 2024-08-31T05:45:01.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:45:01 smithi070 ceph-mon[22316]: mds.? [v2:172.21.15.50:6833/2429086010,v1:172.21.15.50:6835/2429086010] up:boot 2024-08-31T05:45:01.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:45:01 smithi070 ceph-mon[22316]: mds.? [v2:172.21.15.50:6836/1557083890,v1:172.21.15.50:6837/1557083890] up:boot 2024-08-31T05:45:01.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:45:01 smithi070 ceph-mon[22316]: mds.? [v2:172.21.15.50:6838/193839820,v1:172.21.15.50:6839/193839820] up:boot 2024-08-31T05:45:01.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:45:01 smithi070 ceph-mon[22316]: mds.? [v2:172.21.15.70:6832/38291845,v1:172.21.15.70:6834/38291845] up:boot 2024-08-31T05:45:01.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:45:01 smithi070 ceph-mon[22316]: mds.? [v2:172.21.15.70:6833/463870039,v1:172.21.15.70:6835/463870039] up:boot 2024-08-31T05:45:01.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:45:01 smithi070 ceph-mon[22316]: mds.? [v2:172.21.15.70:6836/624776907,v1:172.21.15.70:6839/624776907] up:boot 2024-08-31T05:45:01.588 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:45:01 smithi070 ceph-mon[22316]: mds.? [v2:172.21.15.70:6837/1852553127,v1:172.21.15.70:6838/1852553127] up:boot 2024-08-31T05:45:01.588 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:45:01 smithi070 ceph-mon[22316]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-08-31T05:45:01.588 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:45:01 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-08-31T05:45:01.588 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:45:01 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-08-31T05:45:01.588 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:45:01 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-31T05:45:01.588 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:45:01 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-08-31T05:45:01.588 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:45:01 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-31T05:45:01.588 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:45:01 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-08-31T05:45:01.589 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:45:01 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-31T05:45:01.589 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:45:01 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-31T05:45:01.589 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:45:01 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-31T05:45:01.589 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:45:01 smithi070 ceph-mon[22316]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-31T05:45:01.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:01 smithi050 ceph-mon[22146]: pgmap v813: 129 pgs: 129 active+clean; 852 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 228 KiB/s wr, 32 op/s 2024-08-31T05:45:01.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:01 smithi050 ceph-mon[22146]: mds.? [v2:172.21.15.5:6838/1903912996,v1:172.21.15.5:6839/1903912996] up:boot 2024-08-31T05:45:01.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:01 smithi050 ceph-mon[22146]: mds.? [v2:172.21.15.5:6840/1377556759,v1:172.21.15.5:6841/1377556759] up:boot 2024-08-31T05:45:01.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:01 smithi050 ceph-mon[22146]: mds.? [v2:172.21.15.50:6832/3070985096,v1:172.21.15.50:6834/3070985096] up:boot 2024-08-31T05:45:01.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:01 smithi050 ceph-mon[22146]: mds.? [v2:172.21.15.50:6833/2429086010,v1:172.21.15.50:6835/2429086010] up:boot 2024-08-31T05:45:01.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:01 smithi050 ceph-mon[22146]: mds.? [v2:172.21.15.50:6836/1557083890,v1:172.21.15.50:6837/1557083890] up:boot 2024-08-31T05:45:01.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:01 smithi050 ceph-mon[22146]: mds.? [v2:172.21.15.50:6838/193839820,v1:172.21.15.50:6839/193839820] up:boot 2024-08-31T05:45:01.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:01 smithi050 ceph-mon[22146]: mds.? [v2:172.21.15.70:6832/38291845,v1:172.21.15.70:6834/38291845] up:boot 2024-08-31T05:45:01.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:01 smithi050 ceph-mon[22146]: mds.? [v2:172.21.15.70:6833/463870039,v1:172.21.15.70:6835/463870039] up:boot 2024-08-31T05:45:01.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:01 smithi050 ceph-mon[22146]: mds.? [v2:172.21.15.70:6836/624776907,v1:172.21.15.70:6839/624776907] up:boot 2024-08-31T05:45:01.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:01 smithi050 ceph-mon[22146]: mds.? [v2:172.21.15.70:6837/1852553127,v1:172.21.15.70:6838/1852553127] up:boot 2024-08-31T05:45:01.659 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:01 smithi050 ceph-mon[22146]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-08-31T05:45:01.659 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:01 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-08-31T05:45:01.659 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:01 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-08-31T05:45:01.659 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:01 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-31T05:45:01.659 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:01 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-08-31T05:45:01.659 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:01 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-31T05:45:01.659 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:01 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-08-31T05:45:01.659 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:01 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-31T05:45:01.659 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:01 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-31T05:45:01.660 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:01 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-31T05:45:01.660 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:01 smithi050 ceph-mon[22146]: from='mgr.14220 172.21.15.5:0/1436488908' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-31T05:45:02.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:02.204+0000 7f66da7fc640 1 -- 172.21.15.5:0/2205039059 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v39) ==== 104+0+0 (secure 0 0 0) 0x7f66dc0ac810 con 0x7f66e410ffa0 2024-08-31T05:45:02.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:02.207+0000 7f66eb4a6640 1 -- 172.21.15.5:0/2205039059 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f66d00b4cd0 msgr2=0x7f66d00b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:45:02.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:02.207+0000 7f66eb4a6640 1 --2- 172.21.15.5:0/2205039059 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f66d00b4cd0 0x7f66d00b71e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f66e0005fd0 tx=0x7f66e0005850 comp rx=0 tx=0).stop 2024-08-31T05:45:02.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:02.207+0000 7f66eb4a6640 1 -- 172.21.15.5:0/2205039059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66e410ffa0 msgr2=0x7f66e41a1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:45:02.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:02.207+0000 7f66eb4a6640 1 --2- 172.21.15.5:0/2205039059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66e410ffa0 0x7f66e41a1cc0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f66dc00cce0 tx=0x7f66dc00a620 comp rx=0 tx=0).stop 2024-08-31T05:45:02.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:02.207+0000 7f66eb4a6640 1 -- 172.21.15.5:0/2205039059 shutdown_connections 2024-08-31T05:45:02.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:02.207+0000 7f66eb4a6640 1 --2- 172.21.15.5:0/2205039059 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f66d00b4cd0 0x7f66d00b71e0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:45:02.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:02.207+0000 7f66eb4a6640 1 --2- 172.21.15.5:0/2205039059 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66e410ffa0 0x7f66e41a1cc0 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:45:02.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:02.207+0000 7f66eb4a6640 1 --2- 172.21.15.5:0/2205039059 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f66e4102d40 0x7f66e419ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:45:02.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:02.207+0000 7f66eb4a6640 1 --2- 172.21.15.5:0/2205039059 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66e41023f0 0x7f66e419c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:45:02.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:02.207+0000 7f66eb4a6640 1 -- 172.21.15.5:0/2205039059 >> 172.21.15.5:0/2205039059 conn(0x7f66e4079510 msgr2=0x7f66e4108a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:45:02.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:02.207+0000 7f66eb4a6640 1 -- 172.21.15.5:0/2205039059 shutdown_connections 2024-08-31T05:45:02.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:02.207+0000 7f66eb4a6640 1 -- 172.21.15.5:0/2205039059 wait complete. 2024-08-31T05:45:02.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:45:02 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/2205039059' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-08-31T05:45:02.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:45:02 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/2205039059' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-08-31T05:45:02.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:02 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/2205039059' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-08-31T05:45:02.913 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-31T05:45:03.169 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:45:03.462 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:45:03 smithi005 ceph-mon[18602]: pgmap v814: 129 pgs: 129 active+clean; 852 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 224 KiB/s wr, 31 op/s 2024-08-31T05:45:03.462 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:45:03 smithi005 ceph-mon[18602]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-31T05:45:03.462 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:45:03 smithi005 ceph-mon[18602]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-31T05:45:03.462 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:45:03 smithi005 ceph-mon[18602]: Cluster is now healthy 2024-08-31T05:45:03.462 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:45:03 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/2205039059' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-08-31T05:45:03.463 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:45:03 smithi005 ceph-mon[18602]: fsmap 12 up:standby 2024-08-31T05:45:03.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:45:03 smithi070 ceph-mon[22316]: pgmap v814: 129 pgs: 129 active+clean; 852 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 224 KiB/s wr, 31 op/s 2024-08-31T05:45:03.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:45:03 smithi070 ceph-mon[22316]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-31T05:45:03.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:45:03 smithi070 ceph-mon[22316]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-31T05:45:03.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:45:03 smithi070 ceph-mon[22316]: Cluster is now healthy 2024-08-31T05:45:03.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:45:03 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/2205039059' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-08-31T05:45:03.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:45:03 smithi070 ceph-mon[22316]: fsmap 12 up:standby 2024-08-31T05:45:03.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:03 smithi050 ceph-mon[22146]: pgmap v814: 129 pgs: 129 active+clean; 852 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 224 KiB/s wr, 31 op/s 2024-08-31T05:45:03.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:03 smithi050 ceph-mon[22146]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-31T05:45:03.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:03 smithi050 ceph-mon[22146]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-31T05:45:03.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:03 smithi050 ceph-mon[22146]: Cluster is now healthy 2024-08-31T05:45:03.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:03 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/2205039059' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-08-31T05:45:03.658 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:03 smithi050 ceph-mon[22146]: fsmap 12 up:standby 2024-08-31T05:45:03.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:03.693+0000 7fddad84c640 1 -- 172.21.15.5:0/2263173317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdda8108160 msgr2=0x7fdda8108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:45:03.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:03.693+0000 7fddad84c640 1 --2- 172.21.15.5:0/2263173317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdda8108160 0x7fdda8108570 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fdd90009900 tx=0x7fdd9002a410 comp rx=0 tx=0).stop 2024-08-31T05:45:03.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:03.693+0000 7fddad84c640 1 -- 172.21.15.5:0/2263173317 shutdown_connections 2024-08-31T05:45:03.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:03.693+0000 7fddad84c640 1 --2- 172.21.15.5:0/2263173317 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdda8108ab0 0x7fdda810f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:45:03.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:03.693+0000 7fddad84c640 1 --2- 172.21.15.5:0/2263173317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdda8108160 0x7fdda8108570 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:45:03.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:03.693+0000 7fddad84c640 1 --2- 172.21.15.5:0/2263173317 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdda8102820 0x7fdda8102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:45:03.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:03.693+0000 7fddad84c640 1 -- 172.21.15.5:0/2263173317 >> 172.21.15.5:0/2263173317 conn(0x7fdda80794e0 msgr2=0x7fdda80798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:45:03.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:03.693+0000 7fddad84c640 1 -- 172.21.15.5:0/2263173317 shutdown_connections 2024-08-31T05:45:03.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:03.693+0000 7fddad84c640 1 -- 172.21.15.5:0/2263173317 wait complete. 2024-08-31T05:45:03.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:03.694+0000 7fddad84c640 1 Processor -- start 2024-08-31T05:45:03.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:03.694+0000 7fddad84c640 1 -- start start 2024-08-31T05:45:03.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:03.694+0000 7fddad84c640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdda8102820 0x7fdda819c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:45:03.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:03.694+0000 7fddad84c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdda8108160 0x7fdda819c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:45:03.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:03.694+0000 7fddad84c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdda8108ab0 0x7fdda81a1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:45:03.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:03.694+0000 7fddad84c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdda8111620 con 0x7fdda8108ab0 2024-08-31T05:45:03.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:03.694+0000 7fddad84c640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fdda81114a0 con 0x7fdda8102820 2024-08-31T05:45:03.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:03.694+0000 7fddad84c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdda81117a0 con 0x7fdda8108160 2024-08-31T05:45:03.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:03.695+0000 7fdda77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdda8108ab0 0x7fdda81a1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:45:03.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:03.695+0000 7fdda77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdda8108ab0 0x7fdda81a1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44852/0 (socket says 172.21.15.5:44852) 2024-08-31T05:45:03.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:03.695+0000 7fdda77fe640 1 -- 172.21.15.5:0/87847631 learned_addr learned my addr 172.21.15.5:0/87847631 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:45:03.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:03.695+0000 7fdda6ffd640 1 --2- 172.21.15.5:0/87847631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdda8102820 0x7fdda819c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:45:03.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:03.695+0000 7fdd9ffff640 1 --2- 172.21.15.5:0/87847631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdda8108160 0x7fdda819c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:45:03.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:03.695+0000 7fdda77fe640 1 -- 172.21.15.5:0/87847631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdda8108160 msgr2=0x7fdda819c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:45:03.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:03.695+0000 7fdda77fe640 1 --2- 172.21.15.5:0/87847631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdda8108160 0x7fdda819c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:45:03.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:03.695+0000 7fdda77fe640 1 -- 172.21.15.5:0/87847631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdda8102820 msgr2=0x7fdda819c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:45:03.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:03.695+0000 7fdda77fe640 1 --2- 172.21.15.5:0/87847631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdda8102820 0x7fdda819c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:45:03.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:03.695+0000 7fdda77fe640 1 -- 172.21.15.5:0/87847631 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdda81a22f0 con 0x7fdda8108ab0 2024-08-31T05:45:03.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:03.695+0000 7fdda6ffd640 1 --2- 172.21.15.5:0/87847631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdda8102820 0x7fdda819c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:45:03.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:03.695+0000 7fdda77fe640 1 --2- 172.21.15.5:0/87847631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdda8108ab0 0x7fdda81a1c80 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fdda0009e20 tx=0x7fdda000e490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:45:03.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:03.695+0000 7fddac84a640 1 -- 172.21.15.5:0/87847631 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda0004b20 con 0x7fdda8108ab0 2024-08-31T05:45:03.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:03.695+0000 7fddac84a640 1 -- 172.21.15.5:0/87847631 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdda0004cc0 con 0x7fdda8108ab0 2024-08-31T05:45:03.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:03.695+0000 7fddad84c640 1 -- 172.21.15.5:0/87847631 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdda81a25e0 con 0x7fdda8108ab0 2024-08-31T05:45:03.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:03.695+0000 7fddac84a640 1 -- 172.21.15.5:0/87847631 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda0005860 con 0x7fdda8108ab0 2024-08-31T05:45:03.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:03.695+0000 7fddad84c640 1 -- 172.21.15.5:0/87847631 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdda81a2aa0 con 0x7fdda8108ab0 2024-08-31T05:45:03.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:03.696+0000 7fddad84c640 1 -- 172.21.15.5:0/87847631 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdda8103aa0 con 0x7fdda8108ab0 2024-08-31T05:45:03.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:03.698+0000 7fddac84a640 1 -- 172.21.15.5:0/87847631 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fdda001b020 con 0x7fdda8108ab0 2024-08-31T05:45:03.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:03.699+0000 7fddac84a640 1 --2- 172.21.15.5:0/87847631 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fdd940b4cd0 0x7fdd940b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:45:03.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:03.699+0000 7fdda6ffd640 1 --2- 172.21.15.5:0/87847631 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fdd940b4cd0 0x7fdd940b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:45:03.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:03.699+0000 7fddac84a640 1 -- 172.21.15.5:0/87847631 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9853+0+0 (secure 0 0 0) 0x7fdda00e6020 con 0x7fdda8108ab0 2024-08-31T05:45:03.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:03.699+0000 7fdda6ffd640 1 --2- 172.21.15.5:0/87847631 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fdd940b4cd0 0x7fdd940b71e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fdd9800abe0 tx=0x7fdd9800a5c0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:45:03.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:03.702+0000 7fddac84a640 1 -- 172.21.15.5:0/87847631 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fdda00ac880 con 0x7fdda8108ab0 2024-08-31T05:45:03.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:03.890+0000 7fddad84c640 1 -- 172.21.15.5:0/87847631 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fdda8102c30 con 0x7fdda8108ab0 2024-08-31T05:45:04.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:04.211+0000 7fddac84a640 1 -- 172.21.15.5:0/87847631 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v105) ==== 181+0+0 (secure 0 0 0) 0x7fdda8102c30 con 0x7fdda8108ab0 2024-08-31T05:45:04.214 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2024-08-31T05:45:04.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:04.215+0000 7fddad84c640 1 -- 172.21.15.5:0/87847631 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fdd940b4cd0 msgr2=0x7fdd940b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:45:04.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:04.215+0000 7fddad84c640 1 --2- 172.21.15.5:0/87847631 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fdd940b4cd0 0x7fdd940b71e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fdd9800abe0 tx=0x7fdd9800a5c0 comp rx=0 tx=0).stop 2024-08-31T05:45:04.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:04.215+0000 7fddad84c640 1 -- 172.21.15.5:0/87847631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdda8108ab0 msgr2=0x7fdda81a1c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:45:04.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:04.215+0000 7fddad84c640 1 --2- 172.21.15.5:0/87847631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdda8108ab0 0x7fdda81a1c80 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fdda0009e20 tx=0x7fdda000e490 comp rx=0 tx=0).stop 2024-08-31T05:45:04.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:04.216+0000 7fddad84c640 1 -- 172.21.15.5:0/87847631 shutdown_connections 2024-08-31T05:45:04.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:04.216+0000 7fddad84c640 1 --2- 172.21.15.5:0/87847631 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fdd940b4cd0 0x7fdd940b71e0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:45:04.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:04.216+0000 7fddad84c640 1 --2- 172.21.15.5:0/87847631 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdda8108ab0 0x7fdda81a1c80 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:45:04.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:04.216+0000 7fddad84c640 1 --2- 172.21.15.5:0/87847631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdda8108160 0x7fdda819c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:45:04.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:04.216+0000 7fddad84c640 1 --2- 172.21.15.5:0/87847631 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fdda8102820 0x7fdda819c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:45:04.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:04.216+0000 7fddad84c640 1 -- 172.21.15.5:0/87847631 >> 172.21.15.5:0/87847631 conn(0x7fdda80794e0 msgr2=0x7fdda8104230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:45:04.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:04.216+0000 7fddad84c640 1 -- 172.21.15.5:0/87847631 shutdown_connections 2024-08-31T05:45:04.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:04.216+0000 7fddad84c640 1 -- 172.21.15.5:0/87847631 wait complete. 2024-08-31T05:45:04.467 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:45:04 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/87847631' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-08-31T05:45:04.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:45:04 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/87847631' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-08-31T05:45:04.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:04 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/87847631' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-08-31T05:45:04.912 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-31T05:45:05.164 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:45:05.481 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:45:05 smithi005 ceph-mon[18602]: pgmap v815: 129 pgs: 129 active+clean; 852 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 166 KiB/s wr, 27 op/s 2024-08-31T05:45:05.481 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:45:05 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/87847631' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-08-31T05:45:05.482 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:45:05 smithi005 ceph-mon[18602]: osdmap e105: 12 total, 12 up, 12 in 2024-08-31T05:45:05.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:45:05 smithi070 ceph-mon[22316]: pgmap v815: 129 pgs: 129 active+clean; 852 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 166 KiB/s wr, 27 op/s 2024-08-31T05:45:05.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:45:05 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/87847631' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-08-31T05:45:05.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:45:05 smithi070 ceph-mon[22316]: osdmap e105: 12 total, 12 up, 12 in 2024-08-31T05:45:05.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:05 smithi050 ceph-mon[22146]: pgmap v815: 129 pgs: 129 active+clean; 852 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 166 KiB/s wr, 27 op/s 2024-08-31T05:45:05.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:05 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/87847631' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-08-31T05:45:05.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:05 smithi050 ceph-mon[22146]: osdmap e105: 12 total, 12 up, 12 in 2024-08-31T05:45:05.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:05.702+0000 7f34f6a08640 1 -- 172.21.15.5:0/841631497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34f0104600 msgr2=0x7f34f0104a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:45:05.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:05.702+0000 7f34f6a08640 1 --2- 172.21.15.5:0/841631497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34f0104600 0x7f34f0104a10 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f34e0009900 tx=0x7f34e002a410 comp rx=0 tx=0).stop 2024-08-31T05:45:05.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:05.702+0000 7f34f6a08640 1 -- 172.21.15.5:0/841631497 shutdown_connections 2024-08-31T05:45:05.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:05.702+0000 7f34f6a08640 1 --2- 172.21.15.5:0/841631497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34f010dbb0 0x7f34f01100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:45:05.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:05.702+0000 7f34f6a08640 1 --2- 172.21.15.5:0/841631497 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34f0105030 0x7f34f010d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:45:05.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:05.702+0000 7f34f6a08640 1 --2- 172.21.15.5:0/841631497 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34f0104600 0x7f34f0104a10 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:45:05.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:05.702+0000 7f34f6a08640 1 -- 172.21.15.5:0/841631497 >> 172.21.15.5:0/841631497 conn(0x7f34f00794e0 msgr2=0x7f34f00798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:45:05.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:05.702+0000 7f34f6a08640 1 -- 172.21.15.5:0/841631497 shutdown_connections 2024-08-31T05:45:05.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:05.702+0000 7f34f6a08640 1 -- 172.21.15.5:0/841631497 wait complete. 2024-08-31T05:45:05.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:05.703+0000 7f34f6a08640 1 Processor -- start 2024-08-31T05:45:05.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:05.703+0000 7f34f6a08640 1 -- start start 2024-08-31T05:45:05.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:05.704+0000 7f34f6a08640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34f0104600 0x7f34f019a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:45:05.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:05.704+0000 7f34f6a08640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34f0105030 0x7f34f019a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:45:05.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:05.704+0000 7f34f6a08640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34f010dbb0 0x7f34f019fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:45:05.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:05.704+0000 7f34f6a08640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f34f01138b0 con 0x7f34f0105030 2024-08-31T05:45:05.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:05.704+0000 7f34f6a08640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7f34f0113730 con 0x7f34f010dbb0 2024-08-31T05:45:05.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:05.704+0000 7f34f6a08640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f34f0113a30 con 0x7f34f0104600 2024-08-31T05:45:05.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:05.704+0000 7f34ef7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34f0105030 0x7f34f019a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:45:05.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:05.704+0000 7f34ef7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34f0105030 0x7f34f019a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44874/0 (socket says 172.21.15.5:44874) 2024-08-31T05:45:05.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:05.704+0000 7f34ef7fe640 1 -- 172.21.15.5:0/1941582751 learned_addr learned my addr 172.21.15.5:0/1941582751 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:45:05.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:05.704+0000 7f34f4fa5640 1 --2- 172.21.15.5:0/1941582751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34f010dbb0 0x7f34f019fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:45:05.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:05.704+0000 7f34effff640 1 --2- 172.21.15.5:0/1941582751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34f0104600 0x7f34f019a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:45:05.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:05.704+0000 7f34ef7fe640 1 -- 172.21.15.5:0/1941582751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34f0104600 msgr2=0x7f34f019a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:45:05.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:05.704+0000 7f34ef7fe640 1 --2- 172.21.15.5:0/1941582751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34f0104600 0x7f34f019a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:45:05.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:05.704+0000 7f34ef7fe640 1 -- 172.21.15.5:0/1941582751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34f010dbb0 msgr2=0x7f34f019fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:45:05.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:05.704+0000 7f34ef7fe640 1 --2- 172.21.15.5:0/1941582751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34f010dbb0 0x7f34f019fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:45:05.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:05.704+0000 7f34ef7fe640 1 -- 172.21.15.5:0/1941582751 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34f01a01f0 con 0x7f34f0105030 2024-08-31T05:45:05.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:05.704+0000 7f34effff640 1 --2- 172.21.15.5:0/1941582751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34f0104600 0x7f34f019a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:45:05.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:05.704+0000 7f34ef7fe640 1 --2- 172.21.15.5:0/1941582751 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34f0105030 0x7f34f019a820 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f34e400d740 tx=0x7f34e400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:45:05.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:05.704+0000 7f34ed7fa640 1 -- 172.21.15.5:0/1941582751 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34e4017070 con 0x7f34f0105030 2024-08-31T05:45:05.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:05.705+0000 7f34f6a08640 1 -- 172.21.15.5:0/1941582751 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34f01a04e0 con 0x7f34f0105030 2024-08-31T05:45:05.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:05.705+0000 7f34ed7fa640 1 -- 172.21.15.5:0/1941582751 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34e400de50 con 0x7f34f0105030 2024-08-31T05:45:05.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:05.705+0000 7f34ed7fa640 1 -- 172.21.15.5:0/1941582751 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34e400f620 con 0x7f34f0105030 2024-08-31T05:45:05.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:05.705+0000 7f34f6a08640 1 -- 172.21.15.5:0/1941582751 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34f01a6cc0 con 0x7f34f0105030 2024-08-31T05:45:05.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:05.706+0000 7f34f6a08640 1 -- 172.21.15.5:0/1941582751 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34f006bf80 con 0x7f34f0105030 2024-08-31T05:45:05.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:05.707+0000 7f34ed7fa640 1 -- 172.21.15.5:0/1941582751 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7f34e401a070 con 0x7f34f0105030 2024-08-31T05:45:05.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:05.708+0000 7f34ed7fa640 1 --2- 172.21.15.5:0/1941582751 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f34d80b4ca0 0x7f34d80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:45:05.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:05.708+0000 7f34effff640 1 --2- 172.21.15.5:0/1941582751 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f34d80b4ca0 0x7f34d80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:45:05.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:05.708+0000 7f34ed7fa640 1 -- 172.21.15.5:0/1941582751 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 9299+0+0 (secure 0 0 0) 0x7f34e40e52a0 con 0x7f34f0105030 2024-08-31T05:45:05.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:05.709+0000 7f34effff640 1 --2- 172.21.15.5:0/1941582751 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f34d80b4ca0 0x7f34d80b71b0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f34e0000c00 tx=0x7f34e0032da0 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:45:05.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:05.711+0000 7f34ed7fa640 1 -- 172.21.15.5:0/1941582751 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f34e40abd20 con 0x7f34f0105030 2024-08-31T05:45:05.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:05.897+0000 7f34f6a08640 1 -- 172.21.15.5:0/1941582751 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f34f0104a10 con 0x7f34f0105030 2024-08-31T05:45:06.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:06.219+0000 7f34ed7fa640 1 -- 172.21.15.5:0/1941582751 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v106) ==== 169+0+0 (secure 0 0 0) 0x7f34e40b4260 con 0x7f34f0105030 2024-08-31T05:45:06.221 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2024-08-31T05:45:06.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:06.224+0000 7f34f6a08640 1 -- 172.21.15.5:0/1941582751 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f34d80b4ca0 msgr2=0x7f34d80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:45:06.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:06.224+0000 7f34f6a08640 1 --2- 172.21.15.5:0/1941582751 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f34d80b4ca0 0x7f34d80b71b0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f34e0000c00 tx=0x7f34e0032da0 comp rx=0 tx=0).stop 2024-08-31T05:45:06.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:06.224+0000 7f34f6a08640 1 -- 172.21.15.5:0/1941582751 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34f0105030 msgr2=0x7f34f019a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:45:06.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:06.224+0000 7f34f6a08640 1 --2- 172.21.15.5:0/1941582751 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34f0105030 0x7f34f019a820 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f34e400d740 tx=0x7f34e400dc00 comp rx=0 tx=0).stop 2024-08-31T05:45:06.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:06.224+0000 7f34f6a08640 1 -- 172.21.15.5:0/1941582751 shutdown_connections 2024-08-31T05:45:06.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:06.224+0000 7f34f6a08640 1 --2- 172.21.15.5:0/1941582751 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7f34d80b4ca0 0x7f34d80b71b0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:45:06.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:06.224+0000 7f34f6a08640 1 --2- 172.21.15.5:0/1941582751 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7f34f010dbb0 0x7f34f019fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:45:06.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:06.224+0000 7f34f6a08640 1 --2- 172.21.15.5:0/1941582751 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f34f0105030 0x7f34f019a820 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:45:06.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:06.224+0000 7f34f6a08640 1 --2- 172.21.15.5:0/1941582751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34f0104600 0x7f34f019a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:45:06.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:06.224+0000 7f34f6a08640 1 -- 172.21.15.5:0/1941582751 >> 172.21.15.5:0/1941582751 conn(0x7f34f00794e0 msgr2=0x7f34f01005e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:45:06.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:06.225+0000 7f34f6a08640 1 -- 172.21.15.5:0/1941582751 shutdown_connections 2024-08-31T05:45:06.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:06.225+0000 7f34f6a08640 1 -- 172.21.15.5:0/1941582751 wait complete. 2024-08-31T05:45:06.520 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:45:06 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/1941582751' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-08-31T05:45:06.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:45:06 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/1941582751' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-08-31T05:45:06.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:06 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/1941582751' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-08-31T05:45:06.901 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 69422704-6758-11ef-bcd4-c7b262605968 -- ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-08-31T05:45:07.158 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T05:45:07.558 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:45:07 smithi005 ceph-mon[18602]: pgmap v817: 97 pgs: 97 active+clean; 281 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:45:07.559 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:45:07 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/1941582751' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-08-31T05:45:07.559 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:45:07 smithi005 ceph-mon[18602]: osdmap e106: 12 total, 12 up, 12 in 2024-08-31T05:45:07.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:45:07 smithi070 ceph-mon[22316]: pgmap v817: 97 pgs: 97 active+clean; 281 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:45:07.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:45:07 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/1941582751' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-08-31T05:45:07.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:45:07 smithi070 ceph-mon[22316]: osdmap e106: 12 total, 12 up, 12 in 2024-08-31T05:45:07.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:07 smithi050 ceph-mon[22146]: pgmap v817: 97 pgs: 97 active+clean; 281 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:45:07.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:07 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/1941582751' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-08-31T05:45:07.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:07 smithi050 ceph-mon[22146]: osdmap e106: 12 total, 12 up, 12 in 2024-08-31T05:45:07.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:07.657+0000 7fd48aae3640 1 -- 172.21.15.5:0/1985303856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd484108a90 msgr2=0x7fd48410f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:45:07.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:07.657+0000 7fd48aae3640 1 --2- 172.21.15.5:0/1985303856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd484108a90 0x7fd48410f2c0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7fd47c009ca0 tx=0x7fd47c02a8c0 comp rx=0 tx=0).stop 2024-08-31T05:45:07.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:07.657+0000 7fd48aae3640 1 -- 172.21.15.5:0/1985303856 shutdown_connections 2024-08-31T05:45:07.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:07.657+0000 7fd48aae3640 1 --2- 172.21.15.5:0/1985303856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd484108a90 0x7fd48410f2c0 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:45:07.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:07.657+0000 7fd48aae3640 1 --2- 172.21.15.5:0/1985303856 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd484108140 0x7fd484108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:45:07.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:07.657+0000 7fd48aae3640 1 --2- 172.21.15.5:0/1985303856 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd484102800 0x7fd484102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:45:07.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:07.657+0000 7fd48aae3640 1 -- 172.21.15.5:0/1985303856 >> 172.21.15.5:0/1985303856 conn(0x7fd4840794d0 msgr2=0x7fd4840798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:45:07.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:07.657+0000 7fd48aae3640 1 -- 172.21.15.5:0/1985303856 shutdown_connections 2024-08-31T05:45:07.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:07.657+0000 7fd48aae3640 1 -- 172.21.15.5:0/1985303856 wait complete. 2024-08-31T05:45:07.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:07.658+0000 7fd48aae3640 1 Processor -- start 2024-08-31T05:45:07.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:07.658+0000 7fd48aae3640 1 -- start start 2024-08-31T05:45:07.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:07.658+0000 7fd48aae3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd484102800 0x7fd48419c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:45:07.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:07.658+0000 7fd48aae3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd484108140 0x7fd48419ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:45:07.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:07.658+0000 7fd48aae3640 1 --2- >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd484108a90 0x7fd4841a1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:45:07.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:07.658+0000 7fd48aae3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd4841126f0 con 0x7fd484102800 2024-08-31T05:45:07.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:07.658+0000 7fd48aae3640 1 -- --> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] -- mon_getmap magic: 0 -- 0x7fd484112570 con 0x7fd484108a90 2024-08-31T05:45:07.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:07.658+0000 7fd48aae3640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd484112870 con 0x7fd484108140 2024-08-31T05:45:07.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:07.658+0000 7fd48887f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd484102800 0x7fd48419c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:45:07.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:07.658+0000 7fd48887f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd484102800 0x7fd48419c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44892/0 (socket says 172.21.15.5:44892) 2024-08-31T05:45:07.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:07.658+0000 7fd48887f640 1 -- 172.21.15.5:0/1027967348 learned_addr learned my addr 172.21.15.5:0/1027967348 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-08-31T05:45:07.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:07.658+0000 7fd483fff640 1 --2- 172.21.15.5:0/1027967348 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd484108140 0x7fd48419ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:45:07.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:07.658+0000 7fd489080640 1 --2- 172.21.15.5:0/1027967348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd484108a90 0x7fd4841a1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:45:07.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:07.658+0000 7fd48887f640 1 -- 172.21.15.5:0/1027967348 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd484108140 msgr2=0x7fd48419ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:45:07.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:07.658+0000 7fd48887f640 1 --2- 172.21.15.5:0/1027967348 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd484108140 0x7fd48419ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:45:07.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:07.658+0000 7fd48887f640 1 -- 172.21.15.5:0/1027967348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd484108a90 msgr2=0x7fd4841a1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:45:07.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:07.658+0000 7fd48887f640 1 --2- 172.21.15.5:0/1027967348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd484108a90 0x7fd4841a1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:45:07.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:07.658+0000 7fd48887f640 1 -- 172.21.15.5:0/1027967348 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4841a23e0 con 0x7fd484102800 2024-08-31T05:45:07.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:07.658+0000 7fd483fff640 1 --2- 172.21.15.5:0/1027967348 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd484108140 0x7fd48419ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T05:45:07.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:07.659+0000 7fd48887f640 1 --2- 172.21.15.5:0/1027967348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd484102800 0x7fd48419c470 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fd47400d950 tx=0x7fd47400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:45:07.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:07.659+0000 7fd481ffb640 1 -- 172.21.15.5:0/1027967348 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd474017070 con 0x7fd484102800 2024-08-31T05:45:07.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:07.659+0000 7fd481ffb640 1 -- 172.21.15.5:0/1027967348 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd474009c30 con 0x7fd484102800 2024-08-31T05:45:07.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:07.659+0000 7fd481ffb640 1 -- 172.21.15.5:0/1027967348 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd47400f620 con 0x7fd484102800 2024-08-31T05:45:07.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:07.659+0000 7fd48aae3640 1 -- 172.21.15.5:0/1027967348 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4841a26d0 con 0x7fd484102800 2024-08-31T05:45:07.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:07.659+0000 7fd48aae3640 1 -- 172.21.15.5:0/1027967348 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4841a8e30 con 0x7fd484102800 2024-08-31T05:45:07.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:07.660+0000 7fd48aae3640 1 -- 172.21.15.5:0/1027967348 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd484102c10 con 0x7fd484102800 2024-08-31T05:45:07.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:07.661+0000 7fd481ffb640 1 -- 172.21.15.5:0/1027967348 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 26) ==== 152707+0+0 (secure 0 0 0) 0x7fd474010460 con 0x7fd484102800 2024-08-31T05:45:07.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:07.662+0000 7fd481ffb640 1 --2- 172.21.15.5:0/1027967348 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd46c0b4ca0 0x7fd46c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T05:45:07.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:07.662+0000 7fd483fff640 1 --2- 172.21.15.5:0/1027967348 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd46c0b4ca0 0x7fd46c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T05:45:07.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:07.662+0000 7fd481ffb640 1 -- 172.21.15.5:0/1027967348 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8711+0+0 (secure 0 0 0) 0x7fd4740e5370 con 0x7fd484102800 2024-08-31T05:45:07.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:07.663+0000 7fd483fff640 1 --2- 172.21.15.5:0/1027967348 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd46c0b4ca0 0x7fd46c0b71b0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fd478005e00 tx=0x7fd478005c70 comp rx=0 tx=0).ready entity=mgr.14220 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T05:45:07.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:07.666+0000 7fd481ffb640 1 -- 172.21.15.5:0/1027967348 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd4740ac040 con 0x7fd484102800 2024-08-31T05:45:07.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:07.854+0000 7fd48aae3640 1 -- 172.21.15.5:0/1027967348 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd484100470 con 0x7fd484102800 2024-08-31T05:45:08.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:08.227+0000 7fd481ffb640 1 -- 172.21.15.5:0/1027967348 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v107) ==== 178+0+0 (secure 0 0 0) 0x7fd474009de0 con 0x7fd484102800 2024-08-31T05:45:08.229 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data_ec' removed 2024-08-31T05:45:08.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:08.231+0000 7fd48aae3640 1 -- 172.21.15.5:0/1027967348 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd46c0b4ca0 msgr2=0x7fd46c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:45:08.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:08.231+0000 7fd48aae3640 1 --2- 172.21.15.5:0/1027967348 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd46c0b4ca0 0x7fd46c0b71b0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fd478005e00 tx=0x7fd478005c70 comp rx=0 tx=0).stop 2024-08-31T05:45:08.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:08.231+0000 7fd48aae3640 1 -- 172.21.15.5:0/1027967348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd484102800 msgr2=0x7fd48419c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T05:45:08.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:08.231+0000 7fd48aae3640 1 --2- 172.21.15.5:0/1027967348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd484102800 0x7fd48419c470 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fd47400d950 tx=0x7fd47400de10 comp rx=0 tx=0).stop 2024-08-31T05:45:08.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:08.232+0000 7fd48aae3640 1 -- 172.21.15.5:0/1027967348 shutdown_connections 2024-08-31T05:45:08.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:08.232+0000 7fd48aae3640 1 --2- 172.21.15.5:0/1027967348 >> [v2:172.21.15.5:6800/2696053609,v1:172.21.15.5:6801/2696053609] conn(0x7fd46c0b4ca0 0x7fd46c0b71b0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:45:08.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:08.232+0000 7fd48aae3640 1 --2- 172.21.15.5:0/1027967348 >> [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] conn(0x7fd484108a90 0x7fd4841a1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:45:08.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:08.232+0000 7fd48aae3640 1 --2- 172.21.15.5:0/1027967348 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd484108140 0x7fd48419ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:45:08.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:08.232+0000 7fd48aae3640 1 --2- 172.21.15.5:0/1027967348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd484102800 0x7fd48419c470 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T05:45:08.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:08.232+0000 7fd48aae3640 1 -- 172.21.15.5:0/1027967348 >> 172.21.15.5:0/1027967348 conn(0x7fd4840794d0 msgr2=0x7fd48406ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T05:45:08.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:08.234+0000 7fd48aae3640 1 -- 172.21.15.5:0/1027967348 shutdown_connections 2024-08-31T05:45:08.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-08-31T05:45:08.234+0000 7fd48aae3640 1 -- 172.21.15.5:0/1027967348 wait complete. 2024-08-31T05:45:08.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:45:08 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/1027967348' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-08-31T05:45:08.599 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:45:08 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/1027967348' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-08-31T05:45:08.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:08 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/1027967348' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-08-31T05:45:08.969 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-31T05:45:08.996 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-31T05:45:09.031 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-31T05:45:09.065 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-08-31T05:45:09.065 DEBUG:teuthology.orchestra.run.smithi005:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-08-31T05:45:09.080 DEBUG:teuthology.orchestra.run.smithi050:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-08-31T05:45:09.097 DEBUG:teuthology.orchestra.run.smithi070:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-08-31T05:45:09.126 INFO:tasks.cephadm:Stopping all daemons... 2024-08-31T05:45:09.126 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-08-31T05:45:09.126 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-69422704-6758-11ef-bcd4-c7b262605968@mon.a 2024-08-31T05:45:09.217 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:45:09 smithi005 systemd[1]: Stopping Ceph mon.a for 69422704-6758-11ef-bcd4-c7b262605968... 2024-08-31T05:45:09.337 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:45:09 smithi070 ceph-mon[22316]: pgmap v819: 33 pgs: 33 active+clean; 281 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:45:09.337 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:45:09 smithi070 ceph-mon[22316]: from='client.? 172.21.15.5:0/1027967348' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-08-31T05:45:09.337 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:45:09 smithi070 ceph-mon[22316]: osdmap e107: 12 total, 12 up, 12 in 2024-08-31T05:45:09.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:09 smithi050 ceph-mon[22146]: pgmap v819: 33 pgs: 33 active+clean; 281 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:45:09.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:09 smithi050 ceph-mon[22146]: from='client.? 172.21.15.5:0/1027967348' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-08-31T05:45:09.407 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:09 smithi050 ceph-mon[22146]: osdmap e107: 12 total, 12 up, 12 in 2024-08-31T05:45:09.496 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:45:09 smithi005 ceph-mon[18602]: pgmap v819: 33 pgs: 33 active+clean; 281 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T05:45:09.496 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:45:09 smithi005 ceph-mon[18602]: from='client.? 172.21.15.5:0/1027967348' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-08-31T05:45:09.496 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:45:09 smithi005 ceph-mon[18602]: osdmap e107: 12 total, 12 up, 12 in 2024-08-31T05:45:09.496 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:45:09 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mon-a[18598]: 2024-08-31T05:45:09.453+0000 7f5ea42cd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T05:45:09.496 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:45:09 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mon-a[18598]: 2024-08-31T05:45:09.453+0000 7f5ea42cd640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-08-31T05:45:09.797 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:45:09 smithi005 podman[105398]: 2024-08-31 05:45:09.494549203 +0000 UTC m=+0.173422580 container died d301a3f56d33675afaa7a383425a7cf3ca3469a181201045b394c01881e21bd6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mon-a, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T05:45:10.132 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:45:09 smithi005 podman[105398]: 2024-08-31 05:45:09.870409104 +0000 UTC m=+0.549282480 container cleanup d301a3f56d33675afaa7a383425a7cf3ca3469a181201045b394c01881e21bd6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mon-a, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T05:45:10.132 INFO:journalctl@ceph.mon.a.smithi005.stdout:Aug 31 05:45:09 smithi005 bash[105398]: ceph-69422704-6758-11ef-bcd4-c7b262605968-mon-a 2024-08-31T05:45:10.306 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@mon.a.service' 2024-08-31T05:45:10.361 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T05:45:10.361 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-08-31T05:45:10.361 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-08-31T05:45:10.362 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-69422704-6758-11ef-bcd4-c7b262605968@mon.b 2024-08-31T05:45:10.657 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:10 smithi050 systemd[1]: Stopping Ceph mon.b for 69422704-6758-11ef-bcd4-c7b262605968... 2024-08-31T05:45:10.948 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:10 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-mon-b[22142]: 2024-08-31T05:45:10.689+0000 7f3b60d22640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T05:45:10.949 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:10 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-mon-b[22142]: 2024-08-31T05:45:10.689+0000 7f3b60d22640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-08-31T05:45:11.253 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:10 smithi050 podman[59547]: 2024-08-31 05:45:10.945123243 +0000 UTC m=+0.384924215 container died 26076fc1617aa79450cc20c22405598c422995d5d27ffd8033f2443258af779d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mon-b, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T05:45:11.604 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:11 smithi050 podman[59547]: 2024-08-31 05:45:11.359733952 +0000 UTC m=+0.799534929 container cleanup 26076fc1617aa79450cc20c22405598c422995d5d27ffd8033f2443258af779d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mon-b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T05:45:11.605 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:11 smithi050 bash[59547]: ceph-69422704-6758-11ef-bcd4-c7b262605968-mon-b 2024-08-31T05:45:11.844 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@mon.b.service' 2024-08-31T05:45:11.866 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:11 smithi050 podman[59562]: 2024-08-31 05:45:11.603236639 +0000 UTC m=+0.658590634 container remove 26076fc1617aa79450cc20c22405598c422995d5d27ffd8033f2443258af779d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mon-b, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T05:45:11.866 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:11 smithi050 systemd[1]: ceph-69422704-6758-11ef-bcd4-c7b262605968@mon.b.service: Deactivated successfully. 2024-08-31T05:45:11.866 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:11 smithi050 systemd[1]: Stopped Ceph mon.b for 69422704-6758-11ef-bcd4-c7b262605968. 2024-08-31T05:45:11.866 INFO:journalctl@ceph.mon.b.smithi050.stdout:Aug 31 05:45:11 smithi050 systemd[1]: ceph-69422704-6758-11ef-bcd4-c7b262605968@mon.b.service: Consumed 22.487s CPU time. 2024-08-31T05:45:11.895 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T05:45:11.896 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-08-31T05:45:11.896 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-08-31T05:45:11.896 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-69422704-6758-11ef-bcd4-c7b262605968@mon.c 2024-08-31T05:45:12.298 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:45:11 smithi070 systemd[1]: Stopping Ceph mon.c for 69422704-6758-11ef-bcd4-c7b262605968... 2024-08-31T05:45:12.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:45:12 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-mon-c[22312]: 2024-08-31T05:45:12.296+0000 7f3773741640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T05:45:12.586 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:45:12 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-mon-c[22312]: 2024-08-31T05:45:12.296+0000 7f3773741640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-08-31T05:45:12.587 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:45:12 smithi070 podman[58773]: 2024-08-31 05:45:12.4601197 +0000 UTC m=+0.321531477 container died d0d29cc757a21e855c7ef9ce469c8d96fb9b3b842de6751c5ef2e7d96d426efe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mon-c, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True) 2024-08-31T05:45:13.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:45:13 smithi070 podman[58773]: 2024-08-31 05:45:13.170457144 +0000 UTC m=+1.031868924 container cleanup d0d29cc757a21e855c7ef9ce469c8d96fb9b3b842de6751c5ef2e7d96d426efe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mon-c, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-08-31T05:45:13.336 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:45:13 smithi070 bash[58773]: ceph-69422704-6758-11ef-bcd4-c7b262605968-mon-c 2024-08-31T05:45:13.671 INFO:journalctl@ceph.mon.c.smithi070.stdout:Aug 31 05:45:13 smithi070 podman[58787]: 2024-08-31 05:45:13.463832498 +0000 UTC m=+1.000513752 container remove d0d29cc757a21e855c7ef9ce469c8d96fb9b3b842de6751c5ef2e7d96d426efe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mon-c, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-08-31T05:45:13.691 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@mon.c.service' 2024-08-31T05:45:13.744 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T05:45:13.745 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-08-31T05:45:13.745 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-08-31T05:45:13.745 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-69422704-6758-11ef-bcd4-c7b262605968@mgr.x 2024-08-31T05:45:14.078 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:45:13 smithi005 systemd[1]: Stopping Ceph mgr.x for 69422704-6758-11ef-bcd4-c7b262605968... 2024-08-31T05:45:14.396 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:45:14 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: 2024-08-31T05:45:14.074+0000 7f5e1b428640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T05:45:14.396 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:45:14 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x[18829]: 2024-08-31T05:45:14.074+0000 7f5e1b428640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-08-31T05:45:14.396 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:45:14 smithi005 podman[105518]: 2024-08-31 05:45:14.116841893 +0000 UTC m=+0.169774665 container died 4ade1cc1f01ff0b23e572cff03d96b8f21aa8c6aa09f5c9677eee5e944a9c224 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T05:45:14.717 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:45:14 smithi005 podman[105518]: 2024-08-31 05:45:14.601991941 +0000 UTC m=+0.654924712 container cleanup 4ade1cc1f01ff0b23e572cff03d96b8f21aa8c6aa09f5c9677eee5e944a9c224 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-08-31T05:45:14.717 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Aug 31 05:45:14 smithi005 bash[105518]: ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-x 2024-08-31T05:45:15.037 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@mgr.x.service' 2024-08-31T05:45:15.071 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T05:45:15.072 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-08-31T05:45:15.072 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-08-31T05:45:15.072 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-69422704-6758-11ef-bcd4-c7b262605968@mgr.y 2024-08-31T05:45:15.407 INFO:journalctl@ceph.mgr.y.smithi050.stdout:Aug 31 05:45:15 smithi050 systemd[1]: Stopping Ceph mgr.y for 69422704-6758-11ef-bcd4-c7b262605968... 2024-08-31T05:45:15.717 INFO:journalctl@ceph.mgr.y.smithi050.stdout:Aug 31 05:45:15 smithi050 podman[59668]: 2024-08-31 05:45:15.410627086 +0000 UTC m=+0.144554645 container died 8582941710f524f6450e38e33afca0966baf87e98517113373cbab916e5f63ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-y, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-08-31T05:45:16.068 INFO:journalctl@ceph.mgr.y.smithi050.stdout:Aug 31 05:45:15 smithi050 podman[59668]: 2024-08-31 05:45:15.815355258 +0000 UTC m=+0.549282807 container cleanup 8582941710f524f6450e38e33afca0966baf87e98517113373cbab916e5f63ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-y, io.buildah.version=1.37.1, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T05:45:16.068 INFO:journalctl@ceph.mgr.y.smithi050.stdout:Aug 31 05:45:15 smithi050 bash[59668]: ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-y 2024-08-31T05:45:16.287 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@mgr.y.service' 2024-08-31T05:45:16.321 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T05:45:16.322 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-08-31T05:45:16.322 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-08-31T05:45:16.322 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-69422704-6758-11ef-bcd4-c7b262605968@mgr.z 2024-08-31T05:45:16.586 INFO:journalctl@ceph.mgr.z.smithi070.stdout:Aug 31 05:45:16 smithi070 systemd[1]: Stopping Ceph mgr.z for 69422704-6758-11ef-bcd4-c7b262605968... 2024-08-31T05:45:17.019 INFO:journalctl@ceph.mgr.z.smithi070.stdout:Aug 31 05:45:16 smithi070 podman[58908]: 2024-08-31 05:45:16.671223967 +0000 UTC m=+0.158600575 container died ffd858e28eb8f6df4eea652be7c5932a650fb936b3405711265ee5d8b6e12c3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-z, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-08-31T05:45:17.336 INFO:journalctl@ceph.mgr.z.smithi070.stdout:Aug 31 05:45:17 smithi070 podman[58908]: 2024-08-31 05:45:17.125851605 +0000 UTC m=+0.613228214 container cleanup ffd858e28eb8f6df4eea652be7c5932a650fb936b3405711265ee5d8b6e12c3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-z, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True) 2024-08-31T05:45:17.336 INFO:journalctl@ceph.mgr.z.smithi070.stdout:Aug 31 05:45:17 smithi070 bash[58908]: ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-z 2024-08-31T05:45:17.639 INFO:journalctl@ceph.mgr.z.smithi070.stdout:Aug 31 05:45:17 smithi070 podman[58920]: 2024-08-31 05:45:17.379282631 +0000 UTC m=+0.692506349 container remove ffd858e28eb8f6df4eea652be7c5932a650fb936b3405711265ee5d8b6e12c3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mgr-z, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=) 2024-08-31T05:45:17.639 INFO:journalctl@ceph.mgr.z.smithi070.stdout:Aug 31 05:45:17 smithi070 systemd[1]: ceph-69422704-6758-11ef-bcd4-c7b262605968@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-08-31T05:45:17.644 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@mgr.z.service' 2024-08-31T05:45:17.680 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T05:45:17.680 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-08-31T05:45:17.680 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-08-31T05:45:17.681 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-69422704-6758-11ef-bcd4-c7b262605968@osd.0 2024-08-31T05:45:17.967 INFO:journalctl@ceph.osd.0.smithi005.stdout:Aug 31 05:45:17 smithi005 systemd[1]: Stopping Ceph osd.0 for 69422704-6758-11ef-bcd4-c7b262605968... 2024-08-31T05:45:18.467 INFO:journalctl@ceph.osd.0.smithi005.stdout:Aug 31 05:45:18 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-0[34499]: 2024-08-31T05:45:18.007+0000 7f6af4d0a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T05:45:18.467 INFO:journalctl@ceph.osd.0.smithi005.stdout:Aug 31 05:45:18 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-0[34499]: 2024-08-31T05:45:18.007+0000 7f6af4d0a640 -1 osd.0 107 *** Got signal Terminated *** 2024-08-31T05:45:18.467 INFO:journalctl@ceph.osd.0.smithi005.stdout:Aug 31 05:45:18 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-0[34499]: 2024-08-31T05:45:18.007+0000 7f6af4d0a640 -1 osd.0 107 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T05:45:23.785 INFO:journalctl@ceph.osd.0.smithi005.stdout:Aug 31 05:45:23 smithi005 podman[105640]: 2024-08-31 05:45:23.479388299 +0000 UTC m=+5.612761851 container died a600f2f532a930c0927b73dd53f7edd9e84b35b1320e24e3e1c856f4ed45904c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-08-31T05:45:24.211 INFO:journalctl@ceph.osd.0.smithi005.stdout:Aug 31 05:45:24 smithi005 podman[105640]: 2024-08-31 05:45:24.003614679 +0000 UTC m=+6.136988276 container cleanup a600f2f532a930c0927b73dd53f7edd9e84b35b1320e24e3e1c856f4ed45904c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-08-31T05:45:24.212 INFO:journalctl@ceph.osd.0.smithi005.stdout:Aug 31 05:45:24 smithi005 bash[105640]: ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-0 2024-08-31T05:45:24.467 INFO:journalctl@ceph.osd.0.smithi005.stdout:Aug 31 05:45:24 smithi005 podman[105657]: 2024-08-31 05:45:24.210320566 +0000 UTC m=+0.732647017 container remove a600f2f532a930c0927b73dd53f7edd9e84b35b1320e24e3e1c856f4ed45904c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-0, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T05:45:24.882 INFO:journalctl@ceph.osd.0.smithi005.stdout:Aug 31 05:45:24 smithi005 podman[105745]: 2024-08-31 05:45:24.52739301 +0000 UTC m=+0.015610078 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T05:45:24.882 INFO:journalctl@ceph.osd.0.smithi005.stdout:Aug 31 05:45:24 smithi005 podman[105745]: 2024-08-31 05:45:24.653418321 +0000 UTC m=+0.141635420 container create 5f88658acb26ef21c90a79e90ce5ef5e49d59e4a74a01b8a8dd8c1e496720596 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T05:45:24.883 INFO:journalctl@ceph.osd.0.smithi005.stdout:Aug 31 05:45:24 smithi005 podman[105745]: 2024-08-31 05:45:24.881152743 +0000 UTC m=+0.369369801 container init 5f88658acb26ef21c90a79e90ce5ef5e49d59e4a74a01b8a8dd8c1e496720596 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True) 2024-08-31T05:45:25.217 INFO:journalctl@ceph.osd.0.smithi005.stdout:Aug 31 05:45:24 smithi005 podman[105745]: 2024-08-31 05:45:24.884846019 +0000 UTC m=+0.373063089 container start 5f88658acb26ef21c90a79e90ce5ef5e49d59e4a74a01b8a8dd8c1e496720596 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T05:45:25.218 INFO:journalctl@ceph.osd.0.smithi005.stdout:Aug 31 05:45:24 smithi005 podman[105745]: 2024-08-31 05:45:24.981137739 +0000 UTC m=+0.469354803 container attach 5f88658acb26ef21c90a79e90ce5ef5e49d59e4a74a01b8a8dd8c1e496720596 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-0-deactivate, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731) 2024-08-31T05:45:25.218 INFO:journalctl@ceph.osd.0.smithi005.stdout:Aug 31 05:45:25 smithi005 podman[105745]: 2024-08-31 05:45:25.082880808 +0000 UTC m=+0.571097867 container died 5f88658acb26ef21c90a79e90ce5ef5e49d59e4a74a01b8a8dd8c1e496720596 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-0-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, org.label-schema.build-date=20240731) 2024-08-31T05:45:25.865 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@osd.0.service' 2024-08-31T05:45:25.904 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T05:45:25.905 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-08-31T05:45:25.905 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-08-31T05:45:25.905 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-69422704-6758-11ef-bcd4-c7b262605968@osd.1 2024-08-31T05:45:26.223 INFO:journalctl@ceph.osd.1.smithi050.stdout:Aug 31 05:45:25 smithi050 systemd[1]: Stopping Ceph osd.1 for 69422704-6758-11ef-bcd4-c7b262605968... 2024-08-31T05:45:26.657 INFO:journalctl@ceph.osd.1.smithi050.stdout:Aug 31 05:45:26 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-1[27783]: 2024-08-31T05:45:26.219+0000 7f85c9c76640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T05:45:26.657 INFO:journalctl@ceph.osd.1.smithi050.stdout:Aug 31 05:45:26 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-1[27783]: 2024-08-31T05:45:26.219+0000 7f85c9c76640 -1 osd.1 107 *** Got signal Terminated *** 2024-08-31T05:45:26.657 INFO:journalctl@ceph.osd.1.smithi050.stdout:Aug 31 05:45:26 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-1[27783]: 2024-08-31T05:45:26.219+0000 7f85c9c76640 -1 osd.1 107 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T05:45:31.907 INFO:journalctl@ceph.osd.1.smithi050.stdout:Aug 31 05:45:31 smithi050 podman[59801]: 2024-08-31 05:45:31.612221332 +0000 UTC m=+5.519710242 container died 14a2fa755edd7c153779b32ea4218ca3be5e65d486a31265c7051955c3dc4381 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-1, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-08-31T05:45:32.282 INFO:journalctl@ceph.osd.1.smithi050.stdout:Aug 31 05:45:32 smithi050 podman[59801]: 2024-08-31 05:45:32.040224787 +0000 UTC m=+5.947713739 container cleanup 14a2fa755edd7c153779b32ea4218ca3be5e65d486a31265c7051955c3dc4381 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, ceph=True) 2024-08-31T05:45:32.283 INFO:journalctl@ceph.osd.1.smithi050.stdout:Aug 31 05:45:32 smithi050 bash[59801]: ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-1 2024-08-31T05:45:32.657 INFO:journalctl@ceph.osd.1.smithi050.stdout:Aug 31 05:45:32 smithi050 podman[59825]: 2024-08-31 05:45:32.280791455 +0000 UTC m=+0.662404354 container remove 14a2fa755edd7c153779b32ea4218ca3be5e65d486a31265c7051955c3dc4381 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-1, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T05:45:33.028 INFO:journalctl@ceph.osd.1.smithi050.stdout:Aug 31 05:45:32 smithi050 podman[59915]: 2024-08-31 05:45:32.611476263 +0000 UTC m=+0.016043024 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T05:45:33.028 INFO:journalctl@ceph.osd.1.smithi050.stdout:Aug 31 05:45:32 smithi050 podman[59915]: 2024-08-31 05:45:32.739995869 +0000 UTC m=+0.144562619 container create bd631e92ccf187a91e184ca4b212b59d247054f8733457e7d33d6494577cb2e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-08-31T05:45:33.028 INFO:journalctl@ceph.osd.1.smithi050.stdout:Aug 31 05:45:33 smithi050 podman[59915]: 2024-08-31 05:45:33.026642751 +0000 UTC m=+0.431209512 container init bd631e92ccf187a91e184ca4b212b59d247054f8733457e7d33d6494577cb2e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-1-deactivate, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-08-31T05:45:33.407 INFO:journalctl@ceph.osd.1.smithi050.stdout:Aug 31 05:45:33 smithi050 podman[59915]: 2024-08-31 05:45:33.030618831 +0000 UTC m=+0.435185583 container start bd631e92ccf187a91e184ca4b212b59d247054f8733457e7d33d6494577cb2e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T05:45:33.407 INFO:journalctl@ceph.osd.1.smithi050.stdout:Aug 31 05:45:33 smithi050 podman[59915]: 2024-08-31 05:45:33.143201162 +0000 UTC m=+0.547767936 container attach bd631e92ccf187a91e184ca4b212b59d247054f8733457e7d33d6494577cb2e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-08-31T05:45:33.408 INFO:journalctl@ceph.osd.1.smithi050.stdout:Aug 31 05:45:33 smithi050 podman[59915]: 2024-08-31 05:45:33.219724853 +0000 UTC m=+0.624291606 container died bd631e92ccf187a91e184ca4b212b59d247054f8733457e7d33d6494577cb2e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T05:45:33.824 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@osd.1.service' 2024-08-31T05:45:33.864 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T05:45:33.864 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-08-31T05:45:33.864 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-08-31T05:45:33.865 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-69422704-6758-11ef-bcd4-c7b262605968@osd.2 2024-08-31T05:45:34.163 INFO:journalctl@ceph.osd.2.smithi070.stdout:Aug 31 05:45:33 smithi070 systemd[1]: Stopping Ceph osd.2 for 69422704-6758-11ef-bcd4-c7b262605968... 2024-08-31T05:45:34.586 INFO:journalctl@ceph.osd.2.smithi070.stdout:Aug 31 05:45:34 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-2[28434]: 2024-08-31T05:45:34.161+0000 7f7b2a81c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T05:45:34.586 INFO:journalctl@ceph.osd.2.smithi070.stdout:Aug 31 05:45:34 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-2[28434]: 2024-08-31T05:45:34.161+0000 7f7b2a81c640 -1 osd.2 107 *** Got signal Terminated *** 2024-08-31T05:45:34.586 INFO:journalctl@ceph.osd.2.smithi070.stdout:Aug 31 05:45:34 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-2[28434]: 2024-08-31T05:45:34.161+0000 7f7b2a81c640 -1 osd.2 107 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T05:45:40.015 INFO:journalctl@ceph.osd.2.smithi070.stdout:Aug 31 05:45:39 smithi070 podman[59031]: 2024-08-31 05:45:39.673532636 +0000 UTC m=+5.610118554 container died 42bceb64a815c77ed59e094f0818834416be54fad0eedcc8f49e73f00a6ffbfc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-08-31T05:45:40.336 INFO:journalctl@ceph.osd.2.smithi070.stdout:Aug 31 05:45:40 smithi070 podman[59031]: 2024-08-31 05:45:40.119708528 +0000 UTC m=+6.056294450 container cleanup 42bceb64a815c77ed59e094f0818834416be54fad0eedcc8f49e73f00a6ffbfc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1) 2024-08-31T05:45:40.336 INFO:journalctl@ceph.osd.2.smithi070.stdout:Aug 31 05:45:40 smithi070 bash[59031]: ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-2 2024-08-31T05:45:40.755 INFO:journalctl@ceph.osd.2.smithi070.stdout:Aug 31 05:45:40 smithi070 podman[59046]: 2024-08-31 05:45:40.446122896 +0000 UTC m=+0.771339320 container remove 42bceb64a815c77ed59e094f0818834416be54fad0eedcc8f49e73f00a6ffbfc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-08-31T05:45:41.076 INFO:journalctl@ceph.osd.2.smithi070.stdout:Aug 31 05:45:40 smithi070 podman[59136]: 2024-08-31 05:45:40.656359017 +0000 UTC m=+0.015412210 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T05:45:41.076 INFO:journalctl@ceph.osd.2.smithi070.stdout:Aug 31 05:45:40 smithi070 podman[59136]: 2024-08-31 05:45:40.788587623 +0000 UTC m=+0.147640808 container create 401cafecd55f403bd6340b1f5eedef033540a35304fb4a4d8a1cd9ee8f35cd1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T05:45:41.336 INFO:journalctl@ceph.osd.2.smithi070.stdout:Aug 31 05:45:41 smithi070 podman[59136]: 2024-08-31 05:45:41.074655399 +0000 UTC m=+0.433708586 container init 401cafecd55f403bd6340b1f5eedef033540a35304fb4a4d8a1cd9ee8f35cd1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-08-31T05:45:41.336 INFO:journalctl@ceph.osd.2.smithi070.stdout:Aug 31 05:45:41 smithi070 podman[59136]: 2024-08-31 05:45:41.078435238 +0000 UTC m=+0.437488429 container start 401cafecd55f403bd6340b1f5eedef033540a35304fb4a4d8a1cd9ee8f35cd1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T05:45:41.336 INFO:journalctl@ceph.osd.2.smithi070.stdout:Aug 31 05:45:41 smithi070 podman[59136]: 2024-08-31 05:45:41.183078589 +0000 UTC m=+0.542131786 container attach 401cafecd55f403bd6340b1f5eedef033540a35304fb4a4d8a1cd9ee8f35cd1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-08-31T05:45:41.836 INFO:journalctl@ceph.osd.2.smithi070.stdout:Aug 31 05:45:41 smithi070 podman[59136]: 2024-08-31 05:45:41.480865835 +0000 UTC m=+0.839919028 container died 401cafecd55f403bd6340b1f5eedef033540a35304fb4a4d8a1cd9ee8f35cd1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-2-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1) 2024-08-31T05:45:42.211 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@osd.2.service' 2024-08-31T05:45:42.250 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T05:45:42.250 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-08-31T05:45:42.250 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-08-31T05:45:42.250 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-69422704-6758-11ef-bcd4-c7b262605968@osd.3 2024-08-31T05:45:42.566 INFO:journalctl@ceph.osd.3.smithi005.stdout:Aug 31 05:45:42 smithi005 systemd[1]: Stopping Ceph osd.3 for 69422704-6758-11ef-bcd4-c7b262605968... 2024-08-31T05:45:42.967 INFO:journalctl@ceph.osd.3.smithi005.stdout:Aug 31 05:45:42 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-3[40929]: 2024-08-31T05:45:42.564+0000 7f3fe209c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T05:45:42.967 INFO:journalctl@ceph.osd.3.smithi005.stdout:Aug 31 05:45:42 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-3[40929]: 2024-08-31T05:45:42.564+0000 7f3fe209c640 -1 osd.3 107 *** Got signal Terminated *** 2024-08-31T05:45:42.967 INFO:journalctl@ceph.osd.3.smithi005.stdout:Aug 31 05:45:42 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-3[40929]: 2024-08-31T05:45:42.564+0000 7f3fe209c640 -1 osd.3 107 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T05:45:44.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:45:43 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:45:43.776+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:45:44.217 INFO:journalctl@ceph.osd.3.smithi005.stdout:Aug 31 05:45:43 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-3[40929]: 2024-08-31T05:45:43.955+0000 7f3fda67f640 -1 osd.3 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:18.933140+0000 front 2024-08-31T05:45:18.933170+0000 (oldest deadline 2024-08-31T05:45:43.633373+0000) 2024-08-31T05:45:45.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:45:44 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:45:44.733+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:45:45.087 INFO:journalctl@ceph.osd.5.smithi070.stdout:Aug 31 05:45:44 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-5[35331]: 2024-08-31T05:45:44.951+0000 7efe02f11640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:21.318095+0000 front 2024-08-31T05:45:21.317962+0000 (oldest deadline 2024-08-31T05:45:44.217920+0000) 2024-08-31T05:45:45.217 INFO:journalctl@ceph.osd.3.smithi005.stdout:Aug 31 05:45:44 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-3[40929]: 2024-08-31T05:45:44.980+0000 7f3fda67f640 -1 osd.3 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:18.933140+0000 front 2024-08-31T05:45:18.933170+0000 (oldest deadline 2024-08-31T05:45:43.633373+0000) 2024-08-31T05:45:45.217 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:45:44 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:45:44.926+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.527017+0000 front 2024-08-31T05:45:22.527052+0000 (oldest deadline 2024-08-31T05:45:44.727854+0000) 2024-08-31T05:45:46.086 INFO:journalctl@ceph.osd.5.smithi070.stdout:Aug 31 05:45:45 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-5[35331]: 2024-08-31T05:45:45.935+0000 7efe02f11640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:21.318095+0000 front 2024-08-31T05:45:21.317962+0000 (oldest deadline 2024-08-31T05:45:44.217920+0000) 2024-08-31T05:45:46.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:45:45 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:45:45.770+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:45:46.217 INFO:journalctl@ceph.osd.3.smithi005.stdout:Aug 31 05:45:46 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-3[40929]: 2024-08-31T05:45:46.012+0000 7f3fda67f640 -1 osd.3 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:18.933140+0000 front 2024-08-31T05:45:18.933170+0000 (oldest deadline 2024-08-31T05:45:43.633373+0000) 2024-08-31T05:45:46.217 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:45:45 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:45:45.900+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.527017+0000 front 2024-08-31T05:45:22.527052+0000 (oldest deadline 2024-08-31T05:45:44.727854+0000) 2024-08-31T05:45:46.407 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:45:46 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:45:46.143+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:45:46.980 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:45:46 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:45:46.722+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:45:47.217 INFO:journalctl@ceph.osd.3.smithi005.stdout:Aug 31 05:45:47 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-3[40929]: 2024-08-31T05:45:47.023+0000 7f3fda67f640 -1 osd.3 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:18.933140+0000 front 2024-08-31T05:45:18.933170+0000 (oldest deadline 2024-08-31T05:45:43.633373+0000) 2024-08-31T05:45:47.218 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:45:46 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:45:46.913+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.527017+0000 front 2024-08-31T05:45:22.527052+0000 (oldest deadline 2024-08-31T05:45:44.727854+0000) 2024-08-31T05:45:47.336 INFO:journalctl@ceph.osd.5.smithi070.stdout:Aug 31 05:45:46 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-5[35331]: 2024-08-31T05:45:46.979+0000 7efe02f11640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:21.318095+0000 front 2024-08-31T05:45:21.317962+0000 (oldest deadline 2024-08-31T05:45:44.217920+0000) 2024-08-31T05:45:47.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:45:47 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:45:47.155+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:45:48.086 INFO:journalctl@ceph.osd.5.smithi070.stdout:Aug 31 05:45:48 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-5[35331]: 2024-08-31T05:45:48.011+0000 7efe02f11640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:21.318095+0000 front 2024-08-31T05:45:21.317962+0000 (oldest deadline 2024-08-31T05:45:44.217920+0000) 2024-08-31T05:45:48.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:45:47 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:45:47.770+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:45:48.217 INFO:journalctl@ceph.osd.3.smithi005.stdout:Aug 31 05:45:47 smithi005 podman[105858]: 2024-08-31 05:45:47.997828066 +0000 UTC m=+5.554265288 container died 5a43aaca11d209a2d188ba2c8491ef08b92d7a643c2851d2bb4b8c05d755ffc7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-3, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-08-31T05:45:48.218 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:45:47 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:45:47.901+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.527017+0000 front 2024-08-31T05:45:22.527052+0000 (oldest deadline 2024-08-31T05:45:44.727854+0000) 2024-08-31T05:45:48.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:45:48 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:45:48.160+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:45:48.676 INFO:journalctl@ceph.osd.3.smithi005.stdout:Aug 31 05:45:48 smithi005 podman[105858]: 2024-08-31 05:45:48.389718024 +0000 UTC m=+5.946155239 container cleanup 5a43aaca11d209a2d188ba2c8491ef08b92d7a643c2851d2bb4b8c05d755ffc7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-3, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T05:45:48.676 INFO:journalctl@ceph.osd.3.smithi005.stdout:Aug 31 05:45:48 smithi005 bash[105858]: ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-3 2024-08-31T05:45:48.936 INFO:journalctl@ceph.osd.3.smithi005.stdout:Aug 31 05:45:48 smithi005 podman[105873]: 2024-08-31 05:45:48.674710363 +0000 UTC m=+0.674201462 container remove 5a43aaca11d209a2d188ba2c8491ef08b92d7a643c2851d2bb4b8c05d755ffc7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-3, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-08-31T05:45:49.024 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:45:48 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:45:48.762+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:45:49.217 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:45:48 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:45:48.934+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.527017+0000 front 2024-08-31T05:45:22.527052+0000 (oldest deadline 2024-08-31T05:45:44.727854+0000) 2024-08-31T05:45:49.217 INFO:journalctl@ceph.osd.3.smithi005.stdout:Aug 31 05:45:48 smithi005 podman[105963]: 2024-08-31 05:45:48.889249815 +0000 UTC m=+0.016160377 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T05:45:49.218 INFO:journalctl@ceph.osd.3.smithi005.stdout:Aug 31 05:45:49 smithi005 podman[105963]: 2024-08-31 05:45:49.009226759 +0000 UTC m=+0.136137357 container create 7e1b4fe8f52f1dfe8338fd13ad030666f54e34d41e44bf979869a562d6cda387 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-08-31T05:45:49.336 INFO:journalctl@ceph.osd.5.smithi070.stdout:Aug 31 05:45:49 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-5[35331]: 2024-08-31T05:45:49.023+0000 7efe02f11640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:21.318095+0000 front 2024-08-31T05:45:21.317962+0000 (oldest deadline 2024-08-31T05:45:44.217920+0000) 2024-08-31T05:45:49.407 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:45:49 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:45:49.120+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:45:49.521 INFO:journalctl@ceph.osd.3.smithi005.stdout:Aug 31 05:45:49 smithi005 podman[105963]: 2024-08-31 05:45:49.403537956 +0000 UTC m=+0.530448513 container init 7e1b4fe8f52f1dfe8338fd13ad030666f54e34d41e44bf979869a562d6cda387 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-08-31T05:45:49.521 INFO:journalctl@ceph.osd.3.smithi005.stdout:Aug 31 05:45:49 smithi005 podman[105963]: 2024-08-31 05:45:49.407343886 +0000 UTC m=+0.534254452 container start 7e1b4fe8f52f1dfe8338fd13ad030666f54e34d41e44bf979869a562d6cda387 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T05:45:49.522 INFO:journalctl@ceph.osd.3.smithi005.stdout:Aug 31 05:45:49 smithi005 podman[105963]: 2024-08-31 05:45:49.520104681 +0000 UTC m=+0.647015246 container attach 7e1b4fe8f52f1dfe8338fd13ad030666f54e34d41e44bf979869a562d6cda387 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-08-31T05:45:49.955 INFO:journalctl@ceph.osd.3.smithi005.stdout:Aug 31 05:45:49 smithi005 podman[105963]: 2024-08-31 05:45:49.599493502 +0000 UTC m=+0.726404067 container died 7e1b4fe8f52f1dfe8338fd13ad030666f54e34d41e44bf979869a562d6cda387 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-08-31T05:45:50.086 INFO:journalctl@ceph.osd.5.smithi070.stdout:Aug 31 05:45:50 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-5[35331]: 2024-08-31T05:45:50.000+0000 7efe02f11640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:21.318095+0000 front 2024-08-31T05:45:21.317962+0000 (oldest deadline 2024-08-31T05:45:44.217920+0000) 2024-08-31T05:45:50.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:45:49 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:45:49.790+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:45:50.217 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:45:49 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:45:49.953+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.527017+0000 front 2024-08-31T05:45:22.527052+0000 (oldest deadline 2024-08-31T05:45:44.727854+0000) 2024-08-31T05:45:50.286 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@osd.3.service' 2024-08-31T05:45:50.330 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T05:45:50.330 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-08-31T05:45:50.330 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-08-31T05:45:50.330 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-69422704-6758-11ef-bcd4-c7b262605968@osd.4 2024-08-31T05:45:50.407 INFO:journalctl@ceph.osd.4.smithi050.stdout:Aug 31 05:45:50 smithi050 systemd[1]: Stopping Ceph osd.4 for 69422704-6758-11ef-bcd4-c7b262605968... 2024-08-31T05:45:50.407 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:45:50 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:45:50.146+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:45:50.907 INFO:journalctl@ceph.osd.4.smithi050.stdout:Aug 31 05:45:50 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-4[34341]: 2024-08-31T05:45:50.624+0000 7f6af6895640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T05:45:50.907 INFO:journalctl@ceph.osd.4.smithi050.stdout:Aug 31 05:45:50 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-4[34341]: 2024-08-31T05:45:50.624+0000 7f6af6895640 -1 osd.4 107 *** Got signal Terminated *** 2024-08-31T05:45:50.907 INFO:journalctl@ceph.osd.4.smithi050.stdout:Aug 31 05:45:50 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-4[34341]: 2024-08-31T05:45:50.624+0000 7f6af6895640 -1 osd.4 107 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T05:45:51.086 INFO:journalctl@ceph.osd.5.smithi070.stdout:Aug 31 05:45:50 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-5[35331]: 2024-08-31T05:45:50.971+0000 7efe02f11640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:21.318095+0000 front 2024-08-31T05:45:21.317962+0000 (oldest deadline 2024-08-31T05:45:44.217920+0000) 2024-08-31T05:45:51.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:45:50 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:45:50.829+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:45:51.217 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:45:50 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:45:50.904+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.527017+0000 front 2024-08-31T05:45:22.527052+0000 (oldest deadline 2024-08-31T05:45:44.727854+0000) 2024-08-31T05:45:51.407 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:45:51 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:45:51.147+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:45:52.086 INFO:journalctl@ceph.osd.5.smithi070.stdout:Aug 31 05:45:51 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-5[35331]: 2024-08-31T05:45:51.931+0000 7efe02f11640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:21.318095+0000 front 2024-08-31T05:45:21.317962+0000 (oldest deadline 2024-08-31T05:45:44.217920+0000) 2024-08-31T05:45:52.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:45:51 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:45:51.803+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:45:52.217 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:45:51 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:45:51.908+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.527017+0000 front 2024-08-31T05:45:22.527052+0000 (oldest deadline 2024-08-31T05:45:44.727854+0000) 2024-08-31T05:45:52.407 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:45:52 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:45:52.117+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:45:53.217 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:45:52 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:45:52.901+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.527017+0000 front 2024-08-31T05:45:22.527052+0000 (oldest deadline 2024-08-31T05:45:44.727854+0000) 2024-08-31T05:45:53.336 INFO:journalctl@ceph.osd.5.smithi070.stdout:Aug 31 05:45:52 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-5[35331]: 2024-08-31T05:45:52.932+0000 7efe02f11640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:21.318095+0000 front 2024-08-31T05:45:21.317962+0000 (oldest deadline 2024-08-31T05:45:44.217920+0000) 2024-08-31T05:45:53.336 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:45:52 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:45:52.833+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:45:53.337 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:45:52 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:45:52.870+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.292206+0000 front 2024-08-31T05:45:29.292344+0000 (oldest deadline 2024-08-31T05:45:52.792211+0000) 2024-08-31T05:45:53.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:45:53 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:45:53.164+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:45:54.086 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:45:53 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:45:53.896+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.292206+0000 front 2024-08-31T05:45:29.292344+0000 (oldest deadline 2024-08-31T05:45:52.792211+0000) 2024-08-31T05:45:54.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:45:53 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:45:53.790+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:45:54.087 INFO:journalctl@ceph.osd.5.smithi070.stdout:Aug 31 05:45:53 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-5[35331]: 2024-08-31T05:45:53.898+0000 7efe02f11640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:21.318095+0000 front 2024-08-31T05:45:21.317962+0000 (oldest deadline 2024-08-31T05:45:44.217920+0000) 2024-08-31T05:45:54.087 INFO:journalctl@ceph.osd.5.smithi070.stdout:Aug 31 05:45:53 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-5[35331]: 2024-08-31T05:45:53.898+0000 7efe02f11640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:27.719330+0000 front 2024-08-31T05:45:27.719382+0000 (oldest deadline 2024-08-31T05:45:53.619320+0000) 2024-08-31T05:45:54.157 INFO:journalctl@ceph.osd.4.smithi050.stdout:Aug 31 05:45:53 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-4[34341]: 2024-08-31T05:45:53.783+0000 7f6af2e80640 -1 osd.4 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:30.616162+0000 front 2024-08-31T05:45:30.616198+0000 (oldest deadline 2024-08-31T05:45:53.516351+0000) 2024-08-31T05:45:54.157 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:45:53 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:45:53.784+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:30.947641+0000 front 2024-08-31T05:45:30.947613+0000 (oldest deadline 2024-08-31T05:45:53.247802+0000) 2024-08-31T05:45:54.217 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:45:53 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:45:53.858+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.527017+0000 front 2024-08-31T05:45:22.527052+0000 (oldest deadline 2024-08-31T05:45:44.727854+0000) 2024-08-31T05:45:54.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:45:54 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:45:54.185+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:45:54.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:45:54 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:45:54.185+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.261294+0000 front 2024-08-31T05:45:29.261323+0000 (oldest deadline 2024-08-31T05:45:53.361431+0000) 2024-08-31T05:45:55.086 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:45:54 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:45:54.901+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.292206+0000 front 2024-08-31T05:45:29.292344+0000 (oldest deadline 2024-08-31T05:45:52.792211+0000) 2024-08-31T05:45:55.086 INFO:journalctl@ceph.osd.5.smithi070.stdout:Aug 31 05:45:54 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-5[35331]: 2024-08-31T05:45:54.858+0000 7efe02f11640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:21.318095+0000 front 2024-08-31T05:45:21.317962+0000 (oldest deadline 2024-08-31T05:45:44.217920+0000) 2024-08-31T05:45:55.086 INFO:journalctl@ceph.osd.5.smithi070.stdout:Aug 31 05:45:54 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-5[35331]: 2024-08-31T05:45:54.858+0000 7efe02f11640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:27.719330+0000 front 2024-08-31T05:45:27.719382+0000 (oldest deadline 2024-08-31T05:45:53.619320+0000) 2024-08-31T05:45:55.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:45:54 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:45:54.786+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:45:55.143 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:45:54 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:45:54.831+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:30.947641+0000 front 2024-08-31T05:45:30.947613+0000 (oldest deadline 2024-08-31T05:45:53.247802+0000) 2024-08-31T05:45:55.143 INFO:journalctl@ceph.osd.4.smithi050.stdout:Aug 31 05:45:54 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-4[34341]: 2024-08-31T05:45:54.744+0000 7f6af2e80640 -1 osd.4 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:30.616162+0000 front 2024-08-31T05:45:30.616198+0000 (oldest deadline 2024-08-31T05:45:53.516351+0000) 2024-08-31T05:45:55.217 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:45:54 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:45:54.872+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.527017+0000 front 2024-08-31T05:45:22.527052+0000 (oldest deadline 2024-08-31T05:45:44.727854+0000) 2024-08-31T05:45:55.217 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:45:54 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:45:54.872+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.329641+0000 front 2024-08-31T05:45:29.329725+0000 (oldest deadline 2024-08-31T05:45:54.629726+0000) 2024-08-31T05:45:55.407 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:45:55 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:45:55.141+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:45:55.407 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:45:55 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:45:55.141+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.261294+0000 front 2024-08-31T05:45:29.261323+0000 (oldest deadline 2024-08-31T05:45:53.361431+0000) 2024-08-31T05:45:56.086 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:45:55 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:45:55.856+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.292206+0000 front 2024-08-31T05:45:29.292344+0000 (oldest deadline 2024-08-31T05:45:52.792211+0000) 2024-08-31T05:45:56.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:45:55 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:45:55.786+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:45:56.087 INFO:journalctl@ceph.osd.5.smithi070.stdout:Aug 31 05:45:55 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-5[35331]: 2024-08-31T05:45:55.903+0000 7efe02f11640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:21.318095+0000 front 2024-08-31T05:45:21.317962+0000 (oldest deadline 2024-08-31T05:45:44.217920+0000) 2024-08-31T05:45:56.087 INFO:journalctl@ceph.osd.5.smithi070.stdout:Aug 31 05:45:55 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-5[35331]: 2024-08-31T05:45:55.903+0000 7efe02f11640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:27.719330+0000 front 2024-08-31T05:45:27.719382+0000 (oldest deadline 2024-08-31T05:45:53.619320+0000) 2024-08-31T05:45:56.155 INFO:journalctl@ceph.osd.4.smithi050.stdout:Aug 31 05:45:56 smithi050 podman[60021]: 2024-08-31 05:45:56.045497915 +0000 UTC m=+5.516432840 container died 7c99cca641ece5d54a1a99c0eb0b88c3788d6ddd2d4c0c8e3e99f41a6b4a0601 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-08-31T05:45:56.155 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:45:55 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:45:55.831+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:30.947641+0000 front 2024-08-31T05:45:30.947613+0000 (oldest deadline 2024-08-31T05:45:53.247802+0000) 2024-08-31T05:45:56.217 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:45:55 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:45:55.918+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.527017+0000 front 2024-08-31T05:45:22.527052+0000 (oldest deadline 2024-08-31T05:45:44.727854+0000) 2024-08-31T05:45:56.217 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:45:55 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:45:55.918+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.329641+0000 front 2024-08-31T05:45:29.329725+0000 (oldest deadline 2024-08-31T05:45:54.629726+0000) 2024-08-31T05:45:56.407 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:45:56 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:45:56.152+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:45:56.407 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:45:56 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:45:56.152+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.261294+0000 front 2024-08-31T05:45:29.261323+0000 (oldest deadline 2024-08-31T05:45:53.361431+0000) 2024-08-31T05:45:56.717 INFO:journalctl@ceph.osd.6.smithi005.stdout:Aug 31 05:45:56 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-6[47562]: 2024-08-31T05:45:56.436+0000 7fe7a0f34640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.528985+0000 front 2024-08-31T05:45:29.528839+0000 (oldest deadline 2024-08-31T05:45:55.429017+0000) 2024-08-31T05:45:56.720 INFO:journalctl@ceph.osd.4.smithi050.stdout:Aug 31 05:45:56 smithi050 podman[60021]: 2024-08-31 05:45:56.437312542 +0000 UTC m=+5.908247503 container cleanup 7c99cca641ece5d54a1a99c0eb0b88c3788d6ddd2d4c0c8e3e99f41a6b4a0601 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-4, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T05:45:56.721 INFO:journalctl@ceph.osd.4.smithi050.stdout:Aug 31 05:45:56 smithi050 bash[60021]: ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-4 2024-08-31T05:45:57.035 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:45:56 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:45:56.850+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:30.947641+0000 front 2024-08-31T05:45:30.947613+0000 (oldest deadline 2024-08-31T05:45:53.247802+0000) 2024-08-31T05:45:57.035 INFO:journalctl@ceph.osd.4.smithi050.stdout:Aug 31 05:45:56 smithi050 podman[60037]: 2024-08-31 05:45:56.718629579 +0000 UTC m=+0.668525589 container remove 7c99cca641ece5d54a1a99c0eb0b88c3788d6ddd2d4c0c8e3e99f41a6b4a0601 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-4, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-08-31T05:45:57.086 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:45:56 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:45:56.866+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.292206+0000 front 2024-08-31T05:45:29.292344+0000 (oldest deadline 2024-08-31T05:45:52.792211+0000) 2024-08-31T05:45:57.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:45:56 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:45:56.754+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:45:57.087 INFO:journalctl@ceph.osd.5.smithi070.stdout:Aug 31 05:45:56 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-5[35331]: 2024-08-31T05:45:56.877+0000 7efe02f11640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:21.318095+0000 front 2024-08-31T05:45:21.317962+0000 (oldest deadline 2024-08-31T05:45:44.217920+0000) 2024-08-31T05:45:57.087 INFO:journalctl@ceph.osd.5.smithi070.stdout:Aug 31 05:45:56 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-5[35331]: 2024-08-31T05:45:56.877+0000 7efe02f11640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:27.719330+0000 front 2024-08-31T05:45:27.719382+0000 (oldest deadline 2024-08-31T05:45:53.619320+0000) 2024-08-31T05:45:57.306 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:45:57 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:45:57.209+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:45:57.307 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:45:57 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:45:57.209+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.261294+0000 front 2024-08-31T05:45:29.261323+0000 (oldest deadline 2024-08-31T05:45:53.361431+0000) 2024-08-31T05:45:57.307 INFO:journalctl@ceph.osd.4.smithi050.stdout:Aug 31 05:45:57 smithi050 podman[60126]: 2024-08-31 05:45:56.936520005 +0000 UTC m=+0.016007573 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T05:45:57.307 INFO:journalctl@ceph.osd.4.smithi050.stdout:Aug 31 05:45:57 smithi050 podman[60126]: 2024-08-31 05:45:57.052753673 +0000 UTC m=+0.132241231 container create aa9ea8700a663d0b0f0b9030d1693c5e4f6a247ecf11c3c468058aa4da94b1b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T05:45:57.307 INFO:journalctl@ceph.osd.4.smithi050.stdout:Aug 31 05:45:57 smithi050 podman[60126]: 2024-08-31 05:45:57.305578085 +0000 UTC m=+0.385065643 container init aa9ea8700a663d0b0f0b9030d1693c5e4f6a247ecf11c3c468058aa4da94b1b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-08-31T05:45:57.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:45:56 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:45:56.967+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.527017+0000 front 2024-08-31T05:45:22.527052+0000 (oldest deadline 2024-08-31T05:45:44.727854+0000) 2024-08-31T05:45:57.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:45:56 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:45:56.967+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.329641+0000 front 2024-08-31T05:45:29.329725+0000 (oldest deadline 2024-08-31T05:45:54.629726+0000) 2024-08-31T05:45:57.657 INFO:journalctl@ceph.osd.4.smithi050.stdout:Aug 31 05:45:57 smithi050 podman[60126]: 2024-08-31 05:45:57.309112579 +0000 UTC m=+0.388600141 container start aa9ea8700a663d0b0f0b9030d1693c5e4f6a247ecf11c3c468058aa4da94b1b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-08-31T05:45:57.657 INFO:journalctl@ceph.osd.4.smithi050.stdout:Aug 31 05:45:57 smithi050 podman[60126]: 2024-08-31 05:45:57.40559132 +0000 UTC m=+0.485078881 container attach aa9ea8700a663d0b0f0b9030d1693c5e4f6a247ecf11c3c468058aa4da94b1b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, ceph=True) 2024-08-31T05:45:57.658 INFO:journalctl@ceph.osd.4.smithi050.stdout:Aug 31 05:45:57 smithi050 podman[60126]: 2024-08-31 05:45:57.49628133 +0000 UTC m=+0.575768896 container died aa9ea8700a663d0b0f0b9030d1693c5e4f6a247ecf11c3c468058aa4da94b1b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-08-31T05:45:57.967 INFO:journalctl@ceph.osd.6.smithi005.stdout:Aug 31 05:45:57 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-6[47562]: 2024-08-31T05:45:57.481+0000 7fe7a0f34640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.528985+0000 front 2024-08-31T05:45:29.528839+0000 (oldest deadline 2024-08-31T05:45:55.429017+0000) 2024-08-31T05:45:58.086 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:45:57 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:45:57.878+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.292206+0000 front 2024-08-31T05:45:29.292344+0000 (oldest deadline 2024-08-31T05:45:52.792211+0000) 2024-08-31T05:45:58.086 INFO:journalctl@ceph.osd.5.smithi070.stdout:Aug 31 05:45:57 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-5[35331]: 2024-08-31T05:45:57.911+0000 7efe02f11640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:21.318095+0000 front 2024-08-31T05:45:21.317962+0000 (oldest deadline 2024-08-31T05:45:44.217920+0000) 2024-08-31T05:45:58.086 INFO:journalctl@ceph.osd.5.smithi070.stdout:Aug 31 05:45:57 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-5[35331]: 2024-08-31T05:45:57.911+0000 7efe02f11640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:27.719330+0000 front 2024-08-31T05:45:27.719382+0000 (oldest deadline 2024-08-31T05:45:53.619320+0000) 2024-08-31T05:45:58.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:45:57 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:45:57.762+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:45:58.103 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:45:57 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:45:57.853+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:30.947641+0000 front 2024-08-31T05:45:30.947613+0000 (oldest deadline 2024-08-31T05:45:53.247802+0000) 2024-08-31T05:45:58.133 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@osd.4.service' 2024-08-31T05:45:58.173 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T05:45:58.173 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-08-31T05:45:58.173 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-08-31T05:45:58.173 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-69422704-6758-11ef-bcd4-c7b262605968@osd.5 2024-08-31T05:45:58.407 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:45:58 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:45:58.185+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:45:58.407 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:45:58 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:45:58.185+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.261294+0000 front 2024-08-31T05:45:29.261323+0000 (oldest deadline 2024-08-31T05:45:53.361431+0000) 2024-08-31T05:45:58.444 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:45:57 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:45:57.966+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.527017+0000 front 2024-08-31T05:45:22.527052+0000 (oldest deadline 2024-08-31T05:45:44.727854+0000) 2024-08-31T05:45:58.444 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:45:57 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:45:57.966+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.329641+0000 front 2024-08-31T05:45:29.329725+0000 (oldest deadline 2024-08-31T05:45:54.629726+0000) 2024-08-31T05:45:58.490 INFO:journalctl@ceph.osd.5.smithi070.stdout:Aug 31 05:45:58 smithi070 systemd[1]: Stopping Ceph osd.5 for 69422704-6758-11ef-bcd4-c7b262605968... 2024-08-31T05:45:58.717 INFO:journalctl@ceph.osd.6.smithi005.stdout:Aug 31 05:45:58 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-6[47562]: 2024-08-31T05:45:58.442+0000 7fe7a0f34640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.528985+0000 front 2024-08-31T05:45:29.528839+0000 (oldest deadline 2024-08-31T05:45:55.429017+0000) 2024-08-31T05:45:58.778 INFO:journalctl@ceph.osd.5.smithi070.stdout:Aug 31 05:45:58 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-5[35331]: 2024-08-31T05:45:58.488+0000 7efe0a92e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T05:45:58.778 INFO:journalctl@ceph.osd.5.smithi070.stdout:Aug 31 05:45:58 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-5[35331]: 2024-08-31T05:45:58.488+0000 7efe0a92e640 -1 osd.5 107 *** Got signal Terminated *** 2024-08-31T05:45:58.778 INFO:journalctl@ceph.osd.5.smithi070.stdout:Aug 31 05:45:58 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-5[35331]: 2024-08-31T05:45:58.488+0000 7efe0a92e640 -1 osd.5 107 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T05:45:59.086 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:45:58 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:45:58.906+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.292206+0000 front 2024-08-31T05:45:29.292344+0000 (oldest deadline 2024-08-31T05:45:52.792211+0000) 2024-08-31T05:45:59.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:45:58 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:45:58.776+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:45:59.087 INFO:journalctl@ceph.osd.5.smithi070.stdout:Aug 31 05:45:58 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-5[35331]: 2024-08-31T05:45:58.862+0000 7efe02f11640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:21.318095+0000 front 2024-08-31T05:45:21.317962+0000 (oldest deadline 2024-08-31T05:45:44.217920+0000) 2024-08-31T05:45:59.087 INFO:journalctl@ceph.osd.5.smithi070.stdout:Aug 31 05:45:58 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-5[35331]: 2024-08-31T05:45:58.862+0000 7efe02f11640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:27.719330+0000 front 2024-08-31T05:45:27.719382+0000 (oldest deadline 2024-08-31T05:45:53.619320+0000) 2024-08-31T05:45:59.157 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:45:58 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:45:58.835+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:30.947641+0000 front 2024-08-31T05:45:30.947613+0000 (oldest deadline 2024-08-31T05:45:53.247802+0000) 2024-08-31T05:45:59.394 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:45:58 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:45:58.983+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.527017+0000 front 2024-08-31T05:45:22.527052+0000 (oldest deadline 2024-08-31T05:45:44.727854+0000) 2024-08-31T05:45:59.394 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:45:58 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:45:58.983+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.329641+0000 front 2024-08-31T05:45:29.329725+0000 (oldest deadline 2024-08-31T05:45:54.629726+0000) 2024-08-31T05:45:59.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:45:59 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:45:59.187+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:45:59.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:45:59 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:45:59.187+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.261294+0000 front 2024-08-31T05:45:29.261323+0000 (oldest deadline 2024-08-31T05:45:53.361431+0000) 2024-08-31T05:45:59.717 INFO:journalctl@ceph.osd.6.smithi005.stdout:Aug 31 05:45:59 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-6[47562]: 2024-08-31T05:45:59.392+0000 7fe7a0f34640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.528985+0000 front 2024-08-31T05:45:29.528839+0000 (oldest deadline 2024-08-31T05:45:55.429017+0000) 2024-08-31T05:46:00.086 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:45:59 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:45:59.932+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.292206+0000 front 2024-08-31T05:45:29.292344+0000 (oldest deadline 2024-08-31T05:45:52.792211+0000) 2024-08-31T05:46:00.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:45:59 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:45:59.776+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:46:00.087 INFO:journalctl@ceph.osd.5.smithi070.stdout:Aug 31 05:45:59 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-5[35331]: 2024-08-31T05:45:59.862+0000 7efe02f11640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:21.318095+0000 front 2024-08-31T05:45:21.317962+0000 (oldest deadline 2024-08-31T05:45:44.217920+0000) 2024-08-31T05:46:00.087 INFO:journalctl@ceph.osd.5.smithi070.stdout:Aug 31 05:45:59 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-5[35331]: 2024-08-31T05:45:59.862+0000 7efe02f11640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:27.719330+0000 front 2024-08-31T05:45:27.719382+0000 (oldest deadline 2024-08-31T05:45:53.619320+0000) 2024-08-31T05:46:00.145 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:45:59 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:45:59.788+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:30.947641+0000 front 2024-08-31T05:45:30.947613+0000 (oldest deadline 2024-08-31T05:45:53.247802+0000) 2024-08-31T05:46:00.407 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:00 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:00.144+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:46:00.407 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:00 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:00.144+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.261294+0000 front 2024-08-31T05:45:29.261323+0000 (oldest deadline 2024-08-31T05:45:53.361431+0000) 2024-08-31T05:46:00.407 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:00 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:00.144+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:35.662443+0000 front 2024-08-31T05:45:35.662552+0000 (oldest deadline 2024-08-31T05:45:59.762525+0000) 2024-08-31T05:46:00.441 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:00 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:00.019+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.527017+0000 front 2024-08-31T05:45:22.527052+0000 (oldest deadline 2024-08-31T05:45:44.727854+0000) 2024-08-31T05:46:00.441 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:00 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:00.019+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.329641+0000 front 2024-08-31T05:45:29.329725+0000 (oldest deadline 2024-08-31T05:45:54.629726+0000) 2024-08-31T05:46:00.717 INFO:journalctl@ceph.osd.6.smithi005.stdout:Aug 31 05:46:00 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-6[47562]: 2024-08-31T05:46:00.439+0000 7fe7a0f34640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.528985+0000 front 2024-08-31T05:45:29.528839+0000 (oldest deadline 2024-08-31T05:45:55.429017+0000) 2024-08-31T05:46:01.086 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:00 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:00.889+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.292206+0000 front 2024-08-31T05:45:29.292344+0000 (oldest deadline 2024-08-31T05:45:52.792211+0000) 2024-08-31T05:46:01.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:00 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:00.772+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:46:01.087 INFO:journalctl@ceph.osd.5.smithi070.stdout:Aug 31 05:46:00 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-5[35331]: 2024-08-31T05:46:00.837+0000 7efe02f11640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:21.318095+0000 front 2024-08-31T05:45:21.317962+0000 (oldest deadline 2024-08-31T05:45:44.217920+0000) 2024-08-31T05:46:01.087 INFO:journalctl@ceph.osd.5.smithi070.stdout:Aug 31 05:46:00 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-5[35331]: 2024-08-31T05:46:00.837+0000 7efe02f11640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:27.719330+0000 front 2024-08-31T05:45:27.719382+0000 (oldest deadline 2024-08-31T05:45:53.619320+0000) 2024-08-31T05:46:01.144 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:00 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:00.761+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:30.947641+0000 front 2024-08-31T05:45:30.947613+0000 (oldest deadline 2024-08-31T05:45:53.247802+0000) 2024-08-31T05:46:01.144 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:00 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:00.761+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:34.849362+0000 front 2024-08-31T05:45:34.849133+0000 (oldest deadline 2024-08-31T05:46:00.149158+0000) 2024-08-31T05:46:01.407 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:01 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:01.142+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:46:01.407 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:01 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:01.142+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.261294+0000 front 2024-08-31T05:45:29.261323+0000 (oldest deadline 2024-08-31T05:45:53.361431+0000) 2024-08-31T05:46:01.407 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:01 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:01.142+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:35.662443+0000 front 2024-08-31T05:45:35.662552+0000 (oldest deadline 2024-08-31T05:45:59.762525+0000) 2024-08-31T05:46:01.431 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:01 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:01.014+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.527017+0000 front 2024-08-31T05:45:22.527052+0000 (oldest deadline 2024-08-31T05:45:44.727854+0000) 2024-08-31T05:46:01.432 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:01 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:01.014+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.329641+0000 front 2024-08-31T05:45:29.329725+0000 (oldest deadline 2024-08-31T05:45:54.629726+0000) 2024-08-31T05:46:01.717 INFO:journalctl@ceph.osd.6.smithi005.stdout:Aug 31 05:46:01 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-6[47562]: 2024-08-31T05:46:01.429+0000 7fe7a0f34640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.528985+0000 front 2024-08-31T05:45:29.528839+0000 (oldest deadline 2024-08-31T05:45:55.429017+0000) 2024-08-31T05:46:02.086 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:01 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:01.894+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.292206+0000 front 2024-08-31T05:45:29.292344+0000 (oldest deadline 2024-08-31T05:45:52.792211+0000) 2024-08-31T05:46:02.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:01 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:01.766+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:46:02.087 INFO:journalctl@ceph.osd.5.smithi070.stdout:Aug 31 05:46:01 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-5[35331]: 2024-08-31T05:46:01.798+0000 7efe02f11640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:21.318095+0000 front 2024-08-31T05:45:21.317962+0000 (oldest deadline 2024-08-31T05:45:44.217920+0000) 2024-08-31T05:46:02.087 INFO:journalctl@ceph.osd.5.smithi070.stdout:Aug 31 05:46:01 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-5[35331]: 2024-08-31T05:46:01.798+0000 7efe02f11640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:27.719330+0000 front 2024-08-31T05:45:27.719382+0000 (oldest deadline 2024-08-31T05:45:53.619320+0000) 2024-08-31T05:46:02.157 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:01 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:01.763+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:30.947641+0000 front 2024-08-31T05:45:30.947613+0000 (oldest deadline 2024-08-31T05:45:53.247802+0000) 2024-08-31T05:46:02.157 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:01 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:01.763+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:34.849362+0000 front 2024-08-31T05:45:34.849133+0000 (oldest deadline 2024-08-31T05:46:00.149158+0000) 2024-08-31T05:46:02.416 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:02 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:02.005+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.527017+0000 front 2024-08-31T05:45:22.527052+0000 (oldest deadline 2024-08-31T05:45:44.727854+0000) 2024-08-31T05:46:02.416 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:02 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:02.005+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.329641+0000 front 2024-08-31T05:45:29.329725+0000 (oldest deadline 2024-08-31T05:45:54.629726+0000) 2024-08-31T05:46:02.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:02 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:02.166+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:46:02.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:02 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:02.166+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.261294+0000 front 2024-08-31T05:45:29.261323+0000 (oldest deadline 2024-08-31T05:45:53.361431+0000) 2024-08-31T05:46:02.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:02 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:02.166+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:35.662443+0000 front 2024-08-31T05:45:35.662552+0000 (oldest deadline 2024-08-31T05:45:59.762525+0000) 2024-08-31T05:46:02.717 INFO:journalctl@ceph.osd.6.smithi005.stdout:Aug 31 05:46:02 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-6[47562]: 2024-08-31T05:46:02.413+0000 7fe7a0f34640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.528985+0000 front 2024-08-31T05:45:29.528839+0000 (oldest deadline 2024-08-31T05:45:55.429017+0000) 2024-08-31T05:46:03.086 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:02 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:02.851+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.292206+0000 front 2024-08-31T05:45:29.292344+0000 (oldest deadline 2024-08-31T05:45:52.792211+0000) 2024-08-31T05:46:03.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:02 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:02.795+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:46:03.087 INFO:journalctl@ceph.osd.5.smithi070.stdout:Aug 31 05:46:02 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-5[35331]: 2024-08-31T05:46:02.780+0000 7efe02f11640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:21.318095+0000 front 2024-08-31T05:45:21.317962+0000 (oldest deadline 2024-08-31T05:45:44.217920+0000) 2024-08-31T05:46:03.088 INFO:journalctl@ceph.osd.5.smithi070.stdout:Aug 31 05:46:02 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-5[35331]: 2024-08-31T05:46:02.780+0000 7efe02f11640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:27.719330+0000 front 2024-08-31T05:45:27.719382+0000 (oldest deadline 2024-08-31T05:45:53.619320+0000) 2024-08-31T05:46:03.088 INFO:journalctl@ceph.osd.5.smithi070.stdout:Aug 31 05:46:02 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-5[35331]: 2024-08-31T05:46:02.780+0000 7efe02f11640 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.221156+0000 front 2024-08-31T05:45:38.221114+0000 (oldest deadline 2024-08-31T05:46:02.221979+0000) 2024-08-31T05:46:03.153 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:02 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:02.802+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:30.947641+0000 front 2024-08-31T05:45:30.947613+0000 (oldest deadline 2024-08-31T05:45:53.247802+0000) 2024-08-31T05:46:03.154 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:02 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:02.802+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:34.849362+0000 front 2024-08-31T05:45:34.849133+0000 (oldest deadline 2024-08-31T05:46:00.149158+0000) 2024-08-31T05:46:03.406 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:02 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:02.993+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.527017+0000 front 2024-08-31T05:45:22.527052+0000 (oldest deadline 2024-08-31T05:45:44.727854+0000) 2024-08-31T05:46:03.406 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:02 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:02.993+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.329641+0000 front 2024-08-31T05:45:29.329725+0000 (oldest deadline 2024-08-31T05:45:54.629726+0000) 2024-08-31T05:46:03.407 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:03 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:03.151+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:46:03.407 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:03 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:03.151+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.261294+0000 front 2024-08-31T05:45:29.261323+0000 (oldest deadline 2024-08-31T05:45:53.361431+0000) 2024-08-31T05:46:03.407 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:03 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:03.151+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:35.662443+0000 front 2024-08-31T05:45:35.662552+0000 (oldest deadline 2024-08-31T05:45:59.762525+0000) 2024-08-31T05:46:03.717 INFO:journalctl@ceph.osd.6.smithi005.stdout:Aug 31 05:46:03 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-6[47562]: 2024-08-31T05:46:03.404+0000 7fe7a0f34640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.528985+0000 front 2024-08-31T05:45:29.528839+0000 (oldest deadline 2024-08-31T05:45:55.429017+0000) 2024-08-31T05:46:03.717 INFO:journalctl@ceph.osd.6.smithi005.stdout:Aug 31 05:46:03 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-6[47562]: 2024-08-31T05:46:03.404+0000 7fe7a0f34640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:37.130478+0000 front 2024-08-31T05:45:37.130498+0000 (oldest deadline 2024-08-31T05:46:03.030556+0000) 2024-08-31T05:46:04.073 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:03 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:03.876+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.292206+0000 front 2024-08-31T05:45:29.292344+0000 (oldest deadline 2024-08-31T05:45:52.792211+0000) 2024-08-31T05:46:04.073 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:03 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:03.876+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:37.393671+0000 front 2024-08-31T05:45:37.393649+0000 (oldest deadline 2024-08-31T05:46:03.293761+0000) 2024-08-31T05:46:04.074 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:03 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:03.749+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:46:04.074 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:03 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:03.749+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.586285+0000 front 2024-08-31T05:45:38.586392+0000 (oldest deadline 2024-08-31T05:46:03.286480+0000) 2024-08-31T05:46:04.157 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:03 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:03.829+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:30.947641+0000 front 2024-08-31T05:45:30.947613+0000 (oldest deadline 2024-08-31T05:45:53.247802+0000) 2024-08-31T05:46:04.157 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:03 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:03.829+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:34.849362+0000 front 2024-08-31T05:45:34.849133+0000 (oldest deadline 2024-08-31T05:46:00.149158+0000) 2024-08-31T05:46:04.217 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:03 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:03.951+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.527017+0000 front 2024-08-31T05:45:22.527052+0000 (oldest deadline 2024-08-31T05:45:44.727854+0000) 2024-08-31T05:46:04.217 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:03 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:03.951+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.329641+0000 front 2024-08-31T05:45:29.329725+0000 (oldest deadline 2024-08-31T05:45:54.629726+0000) 2024-08-31T05:46:04.336 INFO:journalctl@ceph.osd.5.smithi070.stdout:Aug 31 05:46:04 smithi070 podman[59252]: 2024-08-31 05:46:04.072032964 +0000 UTC m=+5.704906209 container died 7e2b77e6e86b24a30cc69b63bcc1fdaf50806a6dc07ab6dcd998e082fda7871d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-5, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1) 2024-08-31T05:46:04.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:04 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:04.154+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:46:04.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:04 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:04.154+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.261294+0000 front 2024-08-31T05:45:29.261323+0000 (oldest deadline 2024-08-31T05:45:53.361431+0000) 2024-08-31T05:46:04.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:04 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:04.154+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:35.662443+0000 front 2024-08-31T05:45:35.662552+0000 (oldest deadline 2024-08-31T05:45:59.762525+0000) 2024-08-31T05:46:04.705 INFO:journalctl@ceph.osd.5.smithi070.stdout:Aug 31 05:46:04 smithi070 podman[59252]: 2024-08-31 05:46:04.445886511 +0000 UTC m=+6.078759740 container cleanup 7e2b77e6e86b24a30cc69b63bcc1fdaf50806a6dc07ab6dcd998e082fda7871d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-5, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T05:46:04.705 INFO:journalctl@ceph.osd.5.smithi070.stdout:Aug 31 05:46:04 smithi070 bash[59252]: ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-5 2024-08-31T05:46:04.717 INFO:journalctl@ceph.osd.6.smithi005.stdout:Aug 31 05:46:04 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-6[47562]: 2024-08-31T05:46:04.441+0000 7fe7a0f34640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.528985+0000 front 2024-08-31T05:45:29.528839+0000 (oldest deadline 2024-08-31T05:45:55.429017+0000) 2024-08-31T05:46:04.717 INFO:journalctl@ceph.osd.6.smithi005.stdout:Aug 31 05:46:04 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-6[47562]: 2024-08-31T05:46:04.441+0000 7fe7a0f34640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:37.130478+0000 front 2024-08-31T05:45:37.130498+0000 (oldest deadline 2024-08-31T05:46:03.030556+0000) 2024-08-31T05:46:05.086 INFO:journalctl@ceph.osd.5.smithi070.stdout:Aug 31 05:46:04 smithi070 podman[59268]: 2024-08-31 05:46:04.772319813 +0000 UTC m=+0.670395936 container remove 7e2b77e6e86b24a30cc69b63bcc1fdaf50806a6dc07ab6dcd998e082fda7871d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T05:46:05.086 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:04 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:04.840+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.292206+0000 front 2024-08-31T05:45:29.292344+0000 (oldest deadline 2024-08-31T05:45:52.792211+0000) 2024-08-31T05:46:05.087 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:04 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:04.840+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:37.393671+0000 front 2024-08-31T05:45:37.393649+0000 (oldest deadline 2024-08-31T05:46:03.293761+0000) 2024-08-31T05:46:05.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:04 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:04.703+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:46:05.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:04 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:04.703+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.586285+0000 front 2024-08-31T05:45:38.586392+0000 (oldest deadline 2024-08-31T05:46:03.286480+0000) 2024-08-31T05:46:05.157 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:04 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:04.831+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:30.947641+0000 front 2024-08-31T05:45:30.947613+0000 (oldest deadline 2024-08-31T05:45:53.247802+0000) 2024-08-31T05:46:05.157 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:04 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:04.831+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:34.849362+0000 front 2024-08-31T05:45:34.849133+0000 (oldest deadline 2024-08-31T05:46:00.149158+0000) 2024-08-31T05:46:05.217 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:04 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:04.959+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.527017+0000 front 2024-08-31T05:45:22.527052+0000 (oldest deadline 2024-08-31T05:45:44.727854+0000) 2024-08-31T05:46:05.221 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:04 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:04.959+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.329641+0000 front 2024-08-31T05:45:29.329725+0000 (oldest deadline 2024-08-31T05:45:54.629726+0000) 2024-08-31T05:46:05.221 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:04 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:04.959+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.532721+0000 front 2024-08-31T05:45:38.532675+0000 (oldest deadline 2024-08-31T05:46:04.432712+0000) 2024-08-31T05:46:05.451 INFO:journalctl@ceph.osd.5.smithi070.stdout:Aug 31 05:46:05 smithi070 podman[59356]: 2024-08-31 05:46:05.01380356 +0000 UTC m=+0.015287068 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T05:46:05.452 INFO:journalctl@ceph.osd.5.smithi070.stdout:Aug 31 05:46:05 smithi070 podman[59356]: 2024-08-31 05:46:05.114661293 +0000 UTC m=+0.116144843 container create 79b22d2330516aaf16d96adcdcbb8740efbda95c9f461a8c240cdc7226214901 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-08-31T05:46:05.452 INFO:journalctl@ceph.osd.5.smithi070.stdout:Aug 31 05:46:05 smithi070 podman[59356]: 2024-08-31 05:46:05.350276097 +0000 UTC m=+0.351759605 container init 79b22d2330516aaf16d96adcdcbb8740efbda95c9f461a8c240cdc7226214901 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-08-31T05:46:05.452 INFO:journalctl@ceph.osd.5.smithi070.stdout:Aug 31 05:46:05 smithi070 podman[59356]: 2024-08-31 05:46:05.353467602 +0000 UTC m=+0.354951110 container start 79b22d2330516aaf16d96adcdcbb8740efbda95c9f461a8c240cdc7226214901 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux ) 2024-08-31T05:46:05.452 INFO:journalctl@ceph.osd.5.smithi070.stdout:Aug 31 05:46:05 smithi070 podman[59356]: 2024-08-31 05:46:05.450368196 +0000 UTC m=+0.451851695 container attach 79b22d2330516aaf16d96adcdcbb8740efbda95c9f461a8c240cdc7226214901 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, GIT_BRANCH=HEAD) 2024-08-31T05:46:05.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:05 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:05.171+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:46:05.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:05 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:05.171+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.261294+0000 front 2024-08-31T05:45:29.261323+0000 (oldest deadline 2024-08-31T05:45:53.361431+0000) 2024-08-31T05:46:05.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:05 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:05.171+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:35.662443+0000 front 2024-08-31T05:45:35.662552+0000 (oldest deadline 2024-08-31T05:45:59.762525+0000) 2024-08-31T05:46:05.807 INFO:journalctl@ceph.osd.5.smithi070.stdout:Aug 31 05:46:05 smithi070 podman[59356]: 2024-08-31 05:46:05.542494716 +0000 UTC m=+0.543978230 container died 79b22d2330516aaf16d96adcdcbb8740efbda95c9f461a8c240cdc7226214901 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-5-deactivate, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux ) 2024-08-31T05:46:05.807 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:05 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:05.677+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:46:05.807 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:05 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:05.677+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.586285+0000 front 2024-08-31T05:45:38.586392+0000 (oldest deadline 2024-08-31T05:46:03.286480+0000) 2024-08-31T05:46:05.917 INFO:journalctl@ceph.osd.6.smithi005.stdout:Aug 31 05:46:05 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-6[47562]: 2024-08-31T05:46:05.491+0000 7fe7a0f34640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.528985+0000 front 2024-08-31T05:45:29.528839+0000 (oldest deadline 2024-08-31T05:45:55.429017+0000) 2024-08-31T05:46:05.918 INFO:journalctl@ceph.osd.6.smithi005.stdout:Aug 31 05:46:05 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-6[47562]: 2024-08-31T05:46:05.491+0000 7fe7a0f34640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:37.130478+0000 front 2024-08-31T05:45:37.130498+0000 (oldest deadline 2024-08-31T05:46:03.030556+0000) 2024-08-31T05:46:06.086 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:05 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:05.804+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.292206+0000 front 2024-08-31T05:45:29.292344+0000 (oldest deadline 2024-08-31T05:45:52.792211+0000) 2024-08-31T05:46:06.086 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:05 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:05.804+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:37.393671+0000 front 2024-08-31T05:45:37.393649+0000 (oldest deadline 2024-08-31T05:46:03.293761+0000) 2024-08-31T05:46:06.157 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:05 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:05.870+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:30.947641+0000 front 2024-08-31T05:45:30.947613+0000 (oldest deadline 2024-08-31T05:45:53.247802+0000) 2024-08-31T05:46:06.157 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:05 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:05.870+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:34.849362+0000 front 2024-08-31T05:45:34.849133+0000 (oldest deadline 2024-08-31T05:46:00.149158+0000) 2024-08-31T05:46:06.217 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:05 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:05.915+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.527017+0000 front 2024-08-31T05:45:22.527052+0000 (oldest deadline 2024-08-31T05:45:44.727854+0000) 2024-08-31T05:46:06.217 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:05 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:05.915+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.329641+0000 front 2024-08-31T05:45:29.329725+0000 (oldest deadline 2024-08-31T05:45:54.629726+0000) 2024-08-31T05:46:06.217 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:05 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:05.915+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.532721+0000 front 2024-08-31T05:45:38.532675+0000 (oldest deadline 2024-08-31T05:46:04.432712+0000) 2024-08-31T05:46:06.244 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@osd.5.service' 2024-08-31T05:46:06.284 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T05:46:06.285 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-08-31T05:46:06.285 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-08-31T05:46:06.285 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-69422704-6758-11ef-bcd4-c7b262605968@osd.6 2024-08-31T05:46:06.604 INFO:journalctl@ceph.osd.6.smithi005.stdout:Aug 31 05:46:06 smithi005 systemd[1]: Stopping Ceph osd.6 for 69422704-6758-11ef-bcd4-c7b262605968... 2024-08-31T05:46:06.604 INFO:journalctl@ceph.osd.6.smithi005.stdout:Aug 31 05:46:06 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-6[47562]: 2024-08-31T05:46:06.463+0000 7fe7a0f34640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.528985+0000 front 2024-08-31T05:45:29.528839+0000 (oldest deadline 2024-08-31T05:45:55.429017+0000) 2024-08-31T05:46:06.604 INFO:journalctl@ceph.osd.6.smithi005.stdout:Aug 31 05:46:06 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-6[47562]: 2024-08-31T05:46:06.463+0000 7fe7a0f34640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:37.130478+0000 front 2024-08-31T05:45:37.130498+0000 (oldest deadline 2024-08-31T05:46:03.030556+0000) 2024-08-31T05:46:06.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:06 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:06.185+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:46:06.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:06 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:06.185+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.261294+0000 front 2024-08-31T05:45:29.261323+0000 (oldest deadline 2024-08-31T05:45:53.361431+0000) 2024-08-31T05:46:06.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:06 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:06.185+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:35.662443+0000 front 2024-08-31T05:45:35.662552+0000 (oldest deadline 2024-08-31T05:45:59.762525+0000) 2024-08-31T05:46:06.875 INFO:journalctl@ceph.osd.6.smithi005.stdout:Aug 31 05:46:06 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-6[47562]: 2024-08-31T05:46:06.601+0000 7fe7a4949640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T05:46:06.876 INFO:journalctl@ceph.osd.6.smithi005.stdout:Aug 31 05:46:06 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-6[47562]: 2024-08-31T05:46:06.601+0000 7fe7a4949640 -1 osd.6 107 *** Got signal Terminated *** 2024-08-31T05:46:06.876 INFO:journalctl@ceph.osd.6.smithi005.stdout:Aug 31 05:46:06 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-6[47562]: 2024-08-31T05:46:06.601+0000 7fe7a4949640 -1 osd.6 107 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T05:46:07.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:06 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:06.653+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:46:07.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:06 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:06.653+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.586285+0000 front 2024-08-31T05:45:38.586392+0000 (oldest deadline 2024-08-31T05:46:03.286480+0000) 2024-08-31T05:46:07.087 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:06 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:06.830+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.292206+0000 front 2024-08-31T05:45:29.292344+0000 (oldest deadline 2024-08-31T05:45:52.792211+0000) 2024-08-31T05:46:07.087 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:06 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:06.830+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:37.393671+0000 front 2024-08-31T05:45:37.393649+0000 (oldest deadline 2024-08-31T05:46:03.293761+0000) 2024-08-31T05:46:07.157 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:06 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:06.888+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:30.947641+0000 front 2024-08-31T05:45:30.947613+0000 (oldest deadline 2024-08-31T05:45:53.247802+0000) 2024-08-31T05:46:07.157 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:06 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:06.888+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:34.849362+0000 front 2024-08-31T05:45:34.849133+0000 (oldest deadline 2024-08-31T05:46:00.149158+0000) 2024-08-31T05:46:07.217 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:06 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:06.949+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.527017+0000 front 2024-08-31T05:45:22.527052+0000 (oldest deadline 2024-08-31T05:45:44.727854+0000) 2024-08-31T05:46:07.217 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:06 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:06.949+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.329641+0000 front 2024-08-31T05:45:29.329725+0000 (oldest deadline 2024-08-31T05:45:54.629726+0000) 2024-08-31T05:46:07.217 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:06 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:06.949+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.532721+0000 front 2024-08-31T05:45:38.532675+0000 (oldest deadline 2024-08-31T05:46:04.432712+0000) 2024-08-31T05:46:07.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:07 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:07.226+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:46:07.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:07 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:07.226+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.261294+0000 front 2024-08-31T05:45:29.261323+0000 (oldest deadline 2024-08-31T05:45:53.361431+0000) 2024-08-31T05:46:07.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:07 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:07.226+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:35.662443+0000 front 2024-08-31T05:45:35.662552+0000 (oldest deadline 2024-08-31T05:45:59.762525+0000) 2024-08-31T05:46:07.717 INFO:journalctl@ceph.osd.6.smithi005.stdout:Aug 31 05:46:07 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-6[47562]: 2024-08-31T05:46:07.448+0000 7fe7a0f34640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.528985+0000 front 2024-08-31T05:45:29.528839+0000 (oldest deadline 2024-08-31T05:45:55.429017+0000) 2024-08-31T05:46:07.717 INFO:journalctl@ceph.osd.6.smithi005.stdout:Aug 31 05:46:07 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-6[47562]: 2024-08-31T05:46:07.448+0000 7fe7a0f34640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:37.130478+0000 front 2024-08-31T05:45:37.130498+0000 (oldest deadline 2024-08-31T05:46:03.030556+0000) 2024-08-31T05:46:08.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:07 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:07.607+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:46:08.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:07 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:07.607+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.586285+0000 front 2024-08-31T05:45:38.586392+0000 (oldest deadline 2024-08-31T05:46:03.286480+0000) 2024-08-31T05:46:08.086 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:07 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:07.814+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.292206+0000 front 2024-08-31T05:45:29.292344+0000 (oldest deadline 2024-08-31T05:45:52.792211+0000) 2024-08-31T05:46:08.087 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:07 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:07.814+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:37.393671+0000 front 2024-08-31T05:45:37.393649+0000 (oldest deadline 2024-08-31T05:46:03.293761+0000) 2024-08-31T05:46:08.217 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:07 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:07.990+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.527017+0000 front 2024-08-31T05:45:22.527052+0000 (oldest deadline 2024-08-31T05:45:44.727854+0000) 2024-08-31T05:46:08.217 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:07 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:07.990+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.329641+0000 front 2024-08-31T05:45:29.329725+0000 (oldest deadline 2024-08-31T05:45:54.629726+0000) 2024-08-31T05:46:08.217 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:07 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:07.990+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.532721+0000 front 2024-08-31T05:45:38.532675+0000 (oldest deadline 2024-08-31T05:46:04.432712+0000) 2024-08-31T05:46:08.270 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:07 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:07.922+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:30.947641+0000 front 2024-08-31T05:45:30.947613+0000 (oldest deadline 2024-08-31T05:45:53.247802+0000) 2024-08-31T05:46:08.270 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:07 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:07.922+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:34.849362+0000 front 2024-08-31T05:45:34.849133+0000 (oldest deadline 2024-08-31T05:46:00.149158+0000) 2024-08-31T05:46:08.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:08 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:08.267+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:46:08.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:08 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:08.267+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.261294+0000 front 2024-08-31T05:45:29.261323+0000 (oldest deadline 2024-08-31T05:45:53.361431+0000) 2024-08-31T05:46:08.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:08 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:08.267+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:35.662443+0000 front 2024-08-31T05:45:35.662552+0000 (oldest deadline 2024-08-31T05:45:59.762525+0000) 2024-08-31T05:46:08.717 INFO:journalctl@ceph.osd.6.smithi005.stdout:Aug 31 05:46:08 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-6[47562]: 2024-08-31T05:46:08.453+0000 7fe7a0f34640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.528985+0000 front 2024-08-31T05:45:29.528839+0000 (oldest deadline 2024-08-31T05:45:55.429017+0000) 2024-08-31T05:46:08.717 INFO:journalctl@ceph.osd.6.smithi005.stdout:Aug 31 05:46:08 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-6[47562]: 2024-08-31T05:46:08.453+0000 7fe7a0f34640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:37.130478+0000 front 2024-08-31T05:45:37.130498+0000 (oldest deadline 2024-08-31T05:46:03.030556+0000) 2024-08-31T05:46:09.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:08 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:08.616+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:46:09.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:08 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:08.616+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.586285+0000 front 2024-08-31T05:45:38.586392+0000 (oldest deadline 2024-08-31T05:46:03.286480+0000) 2024-08-31T05:46:09.086 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:08 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:08.835+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.292206+0000 front 2024-08-31T05:45:29.292344+0000 (oldest deadline 2024-08-31T05:45:52.792211+0000) 2024-08-31T05:46:09.087 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:08 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:08.835+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:37.393671+0000 front 2024-08-31T05:45:37.393649+0000 (oldest deadline 2024-08-31T05:46:03.293761+0000) 2024-08-31T05:46:09.157 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:08 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:08.900+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:30.947641+0000 front 2024-08-31T05:45:30.947613+0000 (oldest deadline 2024-08-31T05:45:53.247802+0000) 2024-08-31T05:46:09.157 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:08 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:08.900+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:34.849362+0000 front 2024-08-31T05:45:34.849133+0000 (oldest deadline 2024-08-31T05:46:00.149158+0000) 2024-08-31T05:46:09.445 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:08 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:08.994+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.527017+0000 front 2024-08-31T05:45:22.527052+0000 (oldest deadline 2024-08-31T05:45:44.727854+0000) 2024-08-31T05:46:09.445 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:08 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:08.994+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.329641+0000 front 2024-08-31T05:45:29.329725+0000 (oldest deadline 2024-08-31T05:45:54.629726+0000) 2024-08-31T05:46:09.445 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:08 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:08.994+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.532721+0000 front 2024-08-31T05:45:38.532675+0000 (oldest deadline 2024-08-31T05:46:04.432712+0000) 2024-08-31T05:46:09.445 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:08 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:08.994+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:44.433114+0000 front 2024-08-31T05:45:44.433143+0000 (oldest deadline 2024-08-31T05:46:08.533275+0000) 2024-08-31T05:46:09.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:09 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:09.299+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:46:09.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:09 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:09.299+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.261294+0000 front 2024-08-31T05:45:29.261323+0000 (oldest deadline 2024-08-31T05:45:53.361431+0000) 2024-08-31T05:46:09.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:09 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:09.299+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:35.662443+0000 front 2024-08-31T05:45:35.662552+0000 (oldest deadline 2024-08-31T05:45:59.762525+0000) 2024-08-31T05:46:09.717 INFO:journalctl@ceph.osd.6.smithi005.stdout:Aug 31 05:46:09 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-6[47562]: 2024-08-31T05:46:09.442+0000 7fe7a0f34640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.528985+0000 front 2024-08-31T05:45:29.528839+0000 (oldest deadline 2024-08-31T05:45:55.429017+0000) 2024-08-31T05:46:09.717 INFO:journalctl@ceph.osd.6.smithi005.stdout:Aug 31 05:46:09 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-6[47562]: 2024-08-31T05:46:09.442+0000 7fe7a0f34640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:37.130478+0000 front 2024-08-31T05:45:37.130498+0000 (oldest deadline 2024-08-31T05:46:03.030556+0000) 2024-08-31T05:46:09.717 INFO:journalctl@ceph.osd.6.smithi005.stdout:Aug 31 05:46:09 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-6[47562]: 2024-08-31T05:46:09.442+0000 7fe7a0f34640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:43.031032+0000 front 2024-08-31T05:45:43.031075+0000 (oldest deadline 2024-08-31T05:46:08.931255+0000) 2024-08-31T05:46:10.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:09 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:09.598+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:46:10.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:09 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:09.598+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.586285+0000 front 2024-08-31T05:45:38.586392+0000 (oldest deadline 2024-08-31T05:46:03.286480+0000) 2024-08-31T05:46:10.086 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:09 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:09.831+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.292206+0000 front 2024-08-31T05:45:29.292344+0000 (oldest deadline 2024-08-31T05:45:52.792211+0000) 2024-08-31T05:46:10.087 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:09 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:09.831+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:37.393671+0000 front 2024-08-31T05:45:37.393649+0000 (oldest deadline 2024-08-31T05:46:03.293761+0000) 2024-08-31T05:46:10.087 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:09 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:09.831+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:43.294394+0000 front 2024-08-31T05:45:43.294212+0000 (oldest deadline 2024-08-31T05:46:09.194267+0000) 2024-08-31T05:46:10.157 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:09 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:09.880+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:30.947641+0000 front 2024-08-31T05:45:30.947613+0000 (oldest deadline 2024-08-31T05:45:53.247802+0000) 2024-08-31T05:46:10.157 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:09 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:09.880+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:34.849362+0000 front 2024-08-31T05:45:34.849133+0000 (oldest deadline 2024-08-31T05:46:00.149158+0000) 2024-08-31T05:46:10.403 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:10 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:10.037+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.527017+0000 front 2024-08-31T05:45:22.527052+0000 (oldest deadline 2024-08-31T05:45:44.727854+0000) 2024-08-31T05:46:10.404 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:10 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:10.037+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.329641+0000 front 2024-08-31T05:45:29.329725+0000 (oldest deadline 2024-08-31T05:45:54.629726+0000) 2024-08-31T05:46:10.404 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:10 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:10.037+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.532721+0000 front 2024-08-31T05:45:38.532675+0000 (oldest deadline 2024-08-31T05:46:04.432712+0000) 2024-08-31T05:46:10.404 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:10 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:10.037+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:44.433114+0000 front 2024-08-31T05:45:44.433143+0000 (oldest deadline 2024-08-31T05:46:08.533275+0000) 2024-08-31T05:46:10.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:10 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:10.321+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:46:10.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:10 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:10.321+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.261294+0000 front 2024-08-31T05:45:29.261323+0000 (oldest deadline 2024-08-31T05:45:53.361431+0000) 2024-08-31T05:46:10.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:10 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:10.321+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:35.662443+0000 front 2024-08-31T05:45:35.662552+0000 (oldest deadline 2024-08-31T05:45:59.762525+0000) 2024-08-31T05:46:10.717 INFO:journalctl@ceph.osd.6.smithi005.stdout:Aug 31 05:46:10 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-6[47562]: 2024-08-31T05:46:10.401+0000 7fe7a0f34640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.528985+0000 front 2024-08-31T05:45:29.528839+0000 (oldest deadline 2024-08-31T05:45:55.429017+0000) 2024-08-31T05:46:10.717 INFO:journalctl@ceph.osd.6.smithi005.stdout:Aug 31 05:46:10 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-6[47562]: 2024-08-31T05:46:10.401+0000 7fe7a0f34640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:37.130478+0000 front 2024-08-31T05:45:37.130498+0000 (oldest deadline 2024-08-31T05:46:03.030556+0000) 2024-08-31T05:46:10.717 INFO:journalctl@ceph.osd.6.smithi005.stdout:Aug 31 05:46:10 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-6[47562]: 2024-08-31T05:46:10.401+0000 7fe7a0f34640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:43.031032+0000 front 2024-08-31T05:45:43.031075+0000 (oldest deadline 2024-08-31T05:46:08.931255+0000) 2024-08-31T05:46:11.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:10 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:10.626+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:46:11.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:10 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:10.626+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.586285+0000 front 2024-08-31T05:45:38.586392+0000 (oldest deadline 2024-08-31T05:46:03.286480+0000) 2024-08-31T05:46:11.086 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:10 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:10.813+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.292206+0000 front 2024-08-31T05:45:29.292344+0000 (oldest deadline 2024-08-31T05:45:52.792211+0000) 2024-08-31T05:46:11.086 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:10 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:10.813+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:37.393671+0000 front 2024-08-31T05:45:37.393649+0000 (oldest deadline 2024-08-31T05:46:03.293761+0000) 2024-08-31T05:46:11.087 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:10 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:10.813+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:43.294394+0000 front 2024-08-31T05:45:43.294212+0000 (oldest deadline 2024-08-31T05:46:09.194267+0000) 2024-08-31T05:46:11.157 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:10 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:10.895+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:30.947641+0000 front 2024-08-31T05:45:30.947613+0000 (oldest deadline 2024-08-31T05:45:53.247802+0000) 2024-08-31T05:46:11.157 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:10 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:10.895+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:34.849362+0000 front 2024-08-31T05:45:34.849133+0000 (oldest deadline 2024-08-31T05:46:00.149158+0000) 2024-08-31T05:46:11.157 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:10 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:10.895+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:44.850578+0000 front 2024-08-31T05:45:44.850403+0000 (oldest deadline 2024-08-31T05:46:10.150482+0000) 2024-08-31T05:46:11.423 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:11 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:11.042+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.527017+0000 front 2024-08-31T05:45:22.527052+0000 (oldest deadline 2024-08-31T05:45:44.727854+0000) 2024-08-31T05:46:11.424 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:11 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:11.042+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.329641+0000 front 2024-08-31T05:45:29.329725+0000 (oldest deadline 2024-08-31T05:45:54.629726+0000) 2024-08-31T05:46:11.424 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:11 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:11.042+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.532721+0000 front 2024-08-31T05:45:38.532675+0000 (oldest deadline 2024-08-31T05:46:04.432712+0000) 2024-08-31T05:46:11.424 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:11 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:11.042+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:44.433114+0000 front 2024-08-31T05:45:44.433143+0000 (oldest deadline 2024-08-31T05:46:08.533275+0000) 2024-08-31T05:46:11.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:11 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:11.339+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:46:11.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:11 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:11.339+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.261294+0000 front 2024-08-31T05:45:29.261323+0000 (oldest deadline 2024-08-31T05:45:53.361431+0000) 2024-08-31T05:46:11.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:11 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:11.339+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:35.662443+0000 front 2024-08-31T05:45:35.662552+0000 (oldest deadline 2024-08-31T05:45:59.762525+0000) 2024-08-31T05:46:11.717 INFO:journalctl@ceph.osd.6.smithi005.stdout:Aug 31 05:46:11 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-6[47562]: 2024-08-31T05:46:11.421+0000 7fe7a0f34640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.528985+0000 front 2024-08-31T05:45:29.528839+0000 (oldest deadline 2024-08-31T05:45:55.429017+0000) 2024-08-31T05:46:11.717 INFO:journalctl@ceph.osd.6.smithi005.stdout:Aug 31 05:46:11 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-6[47562]: 2024-08-31T05:46:11.421+0000 7fe7a0f34640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:37.130478+0000 front 2024-08-31T05:45:37.130498+0000 (oldest deadline 2024-08-31T05:46:03.030556+0000) 2024-08-31T05:46:11.717 INFO:journalctl@ceph.osd.6.smithi005.stdout:Aug 31 05:46:11 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-6[47562]: 2024-08-31T05:46:11.421+0000 7fe7a0f34640 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:43.031032+0000 front 2024-08-31T05:45:43.031075+0000 (oldest deadline 2024-08-31T05:46:08.931255+0000) 2024-08-31T05:46:11.836 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:11 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:11.578+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:46:11.836 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:11 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:11.578+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.586285+0000 front 2024-08-31T05:45:38.586392+0000 (oldest deadline 2024-08-31T05:46:03.286480+0000) 2024-08-31T05:46:11.836 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:11 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:11.578+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:47.387728+0000 front 2024-08-31T05:45:47.387982+0000 (oldest deadline 2024-08-31T05:46:10.887839+0000) 2024-08-31T05:46:11.837 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:11 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:11.815+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.292206+0000 front 2024-08-31T05:45:29.292344+0000 (oldest deadline 2024-08-31T05:45:52.792211+0000) 2024-08-31T05:46:11.837 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:11 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:11.815+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:37.393671+0000 front 2024-08-31T05:45:37.393649+0000 (oldest deadline 2024-08-31T05:46:03.293761+0000) 2024-08-31T05:46:11.837 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:11 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:11.815+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:43.294394+0000 front 2024-08-31T05:45:43.294212+0000 (oldest deadline 2024-08-31T05:46:09.194267+0000) 2024-08-31T05:46:12.157 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:11 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:11.887+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:30.947641+0000 front 2024-08-31T05:45:30.947613+0000 (oldest deadline 2024-08-31T05:45:53.247802+0000) 2024-08-31T05:46:12.157 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:11 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:11.887+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:34.849362+0000 front 2024-08-31T05:45:34.849133+0000 (oldest deadline 2024-08-31T05:46:00.149158+0000) 2024-08-31T05:46:12.157 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:11 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:11.887+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:44.850578+0000 front 2024-08-31T05:45:44.850403+0000 (oldest deadline 2024-08-31T05:46:10.150482+0000) 2024-08-31T05:46:12.467 INFO:journalctl@ceph.osd.6.smithi005.stdout:Aug 31 05:46:12 smithi005 podman[106066]: 2024-08-31 05:46:12.199619782 +0000 UTC m=+5.721681695 container died 6d6d836774baafa213224bfa1fdb4bcb0b1d0cbcb93df5075ec16f6a95f19c63 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-6, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-08-31T05:46:12.468 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:12 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:12.043+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.527017+0000 front 2024-08-31T05:45:22.527052+0000 (oldest deadline 2024-08-31T05:45:44.727854+0000) 2024-08-31T05:46:12.468 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:12 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:12.043+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.329641+0000 front 2024-08-31T05:45:29.329725+0000 (oldest deadline 2024-08-31T05:45:54.629726+0000) 2024-08-31T05:46:12.468 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:12 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:12.043+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.532721+0000 front 2024-08-31T05:45:38.532675+0000 (oldest deadline 2024-08-31T05:46:04.432712+0000) 2024-08-31T05:46:12.468 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:12 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:12.043+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:44.433114+0000 front 2024-08-31T05:45:44.433143+0000 (oldest deadline 2024-08-31T05:46:08.533275+0000) 2024-08-31T05:46:12.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:12 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:12.303+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:46:12.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:12 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:12.303+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.261294+0000 front 2024-08-31T05:45:29.261323+0000 (oldest deadline 2024-08-31T05:45:53.361431+0000) 2024-08-31T05:46:12.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:12 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:12.303+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:35.662443+0000 front 2024-08-31T05:45:35.662552+0000 (oldest deadline 2024-08-31T05:45:59.762525+0000) 2024-08-31T05:46:12.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:12 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:12.303+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:46.164178+0000 front 2024-08-31T05:45:46.164262+0000 (oldest deadline 2024-08-31T05:46:11.464217+0000) 2024-08-31T05:46:12.964 INFO:journalctl@ceph.osd.6.smithi005.stdout:Aug 31 05:46:12 smithi005 podman[106066]: 2024-08-31 05:46:12.694423245 +0000 UTC m=+6.216485219 container cleanup 6d6d836774baafa213224bfa1fdb4bcb0b1d0cbcb93df5075ec16f6a95f19c63 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-6, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1) 2024-08-31T05:46:12.964 INFO:journalctl@ceph.osd.6.smithi005.stdout:Aug 31 05:46:12 smithi005 bash[106066]: ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-6 2024-08-31T05:46:13.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:12 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:12.616+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:46:13.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:12 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:12.616+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.586285+0000 front 2024-08-31T05:45:38.586392+0000 (oldest deadline 2024-08-31T05:46:03.286480+0000) 2024-08-31T05:46:13.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:12 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:12.616+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:47.387728+0000 front 2024-08-31T05:45:47.387982+0000 (oldest deadline 2024-08-31T05:46:10.887839+0000) 2024-08-31T05:46:13.087 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:12 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:12.826+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.292206+0000 front 2024-08-31T05:45:29.292344+0000 (oldest deadline 2024-08-31T05:45:52.792211+0000) 2024-08-31T05:46:13.087 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:12 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:12.826+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:37.393671+0000 front 2024-08-31T05:45:37.393649+0000 (oldest deadline 2024-08-31T05:46:03.293761+0000) 2024-08-31T05:46:13.087 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:12 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:12.826+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:43.294394+0000 front 2024-08-31T05:45:43.294212+0000 (oldest deadline 2024-08-31T05:46:09.194267+0000) 2024-08-31T05:46:13.157 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:12 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:12.881+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:30.947641+0000 front 2024-08-31T05:45:30.947613+0000 (oldest deadline 2024-08-31T05:45:53.247802+0000) 2024-08-31T05:46:13.157 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:12 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:12.881+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:34.849362+0000 front 2024-08-31T05:45:34.849133+0000 (oldest deadline 2024-08-31T05:46:00.149158+0000) 2024-08-31T05:46:13.157 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:12 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:12.881+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:44.850578+0000 front 2024-08-31T05:45:44.850403+0000 (oldest deadline 2024-08-31T05:46:10.150482+0000) 2024-08-31T05:46:13.217 INFO:journalctl@ceph.osd.6.smithi005.stdout:Aug 31 05:46:12 smithi005 podman[106094]: 2024-08-31 05:46:12.962635356 +0000 UTC m=+0.756197917 container remove 6d6d836774baafa213224bfa1fdb4bcb0b1d0cbcb93df5075ec16f6a95f19c63 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-6, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1) 2024-08-31T05:46:13.217 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:13 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:13.086+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.527017+0000 front 2024-08-31T05:45:22.527052+0000 (oldest deadline 2024-08-31T05:45:44.727854+0000) 2024-08-31T05:46:13.217 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:13 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:13.086+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.329641+0000 front 2024-08-31T05:45:29.329725+0000 (oldest deadline 2024-08-31T05:45:54.629726+0000) 2024-08-31T05:46:13.218 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:13 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:13.086+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.532721+0000 front 2024-08-31T05:45:38.532675+0000 (oldest deadline 2024-08-31T05:46:04.432712+0000) 2024-08-31T05:46:13.218 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:13 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:13.086+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:44.433114+0000 front 2024-08-31T05:45:44.433143+0000 (oldest deadline 2024-08-31T05:46:08.533275+0000) 2024-08-31T05:46:13.551 INFO:journalctl@ceph.osd.6.smithi005.stdout:Aug 31 05:46:13 smithi005 podman[106180]: 2024-08-31 05:46:13.179099749 +0000 UTC m=+0.016081808 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T05:46:13.552 INFO:journalctl@ceph.osd.6.smithi005.stdout:Aug 31 05:46:13 smithi005 podman[106180]: 2024-08-31 05:46:13.313945743 +0000 UTC m=+0.150927795 container create 216d8c5df75f753f3785731356ca8480cce6d143ba3b3fee5f8a98d56aaf1c66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS) 2024-08-31T05:46:13.552 INFO:journalctl@ceph.osd.6.smithi005.stdout:Aug 31 05:46:13 smithi005 podman[106180]: 2024-08-31 05:46:13.549724758 +0000 UTC m=+0.386706805 container init 216d8c5df75f753f3785731356ca8480cce6d143ba3b3fee5f8a98d56aaf1c66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T05:46:13.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:13 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:13.306+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:46:13.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:13 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:13.306+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.261294+0000 front 2024-08-31T05:45:29.261323+0000 (oldest deadline 2024-08-31T05:45:53.361431+0000) 2024-08-31T05:46:13.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:13 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:13.306+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:35.662443+0000 front 2024-08-31T05:45:35.662552+0000 (oldest deadline 2024-08-31T05:45:59.762525+0000) 2024-08-31T05:46:13.658 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:13 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:13.306+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:46.164178+0000 front 2024-08-31T05:45:46.164262+0000 (oldest deadline 2024-08-31T05:46:11.464217+0000) 2024-08-31T05:46:13.967 INFO:journalctl@ceph.osd.6.smithi005.stdout:Aug 31 05:46:13 smithi005 podman[106180]: 2024-08-31 05:46:13.553130799 +0000 UTC m=+0.390112847 container start 216d8c5df75f753f3785731356ca8480cce6d143ba3b3fee5f8a98d56aaf1c66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-08-31T05:46:13.967 INFO:journalctl@ceph.osd.6.smithi005.stdout:Aug 31 05:46:13 smithi005 podman[106180]: 2024-08-31 05:46:13.641326957 +0000 UTC m=+0.478309016 container attach 216d8c5df75f753f3785731356ca8480cce6d143ba3b3fee5f8a98d56aaf1c66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-6-deactivate, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-08-31T05:46:13.968 INFO:journalctl@ceph.osd.6.smithi005.stdout:Aug 31 05:46:13 smithi005 podman[106180]: 2024-08-31 05:46:13.737777134 +0000 UTC m=+0.574759194 container died 216d8c5df75f753f3785731356ca8480cce6d143ba3b3fee5f8a98d56aaf1c66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-08-31T05:46:14.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:13 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:13.661+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:46:14.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:13 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:13.661+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.586285+0000 front 2024-08-31T05:45:38.586392+0000 (oldest deadline 2024-08-31T05:46:03.286480+0000) 2024-08-31T05:46:14.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:13 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:13.661+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:47.387728+0000 front 2024-08-31T05:45:47.387982+0000 (oldest deadline 2024-08-31T05:46:10.887839+0000) 2024-08-31T05:46:14.086 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:13 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:13.802+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.292206+0000 front 2024-08-31T05:45:29.292344+0000 (oldest deadline 2024-08-31T05:45:52.792211+0000) 2024-08-31T05:46:14.087 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:13 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:13.802+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:37.393671+0000 front 2024-08-31T05:45:37.393649+0000 (oldest deadline 2024-08-31T05:46:03.293761+0000) 2024-08-31T05:46:14.087 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:13 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:13.802+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:43.294394+0000 front 2024-08-31T05:45:43.294212+0000 (oldest deadline 2024-08-31T05:46:09.194267+0000) 2024-08-31T05:46:14.157 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:13 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:13.900+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:30.947641+0000 front 2024-08-31T05:45:30.947613+0000 (oldest deadline 2024-08-31T05:45:53.247802+0000) 2024-08-31T05:46:14.157 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:13 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:13.900+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:34.849362+0000 front 2024-08-31T05:45:34.849133+0000 (oldest deadline 2024-08-31T05:46:00.149158+0000) 2024-08-31T05:46:14.157 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:13 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:13.900+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:44.850578+0000 front 2024-08-31T05:45:44.850403+0000 (oldest deadline 2024-08-31T05:46:10.150482+0000) 2024-08-31T05:46:14.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:14 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:14.051+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.527017+0000 front 2024-08-31T05:45:22.527052+0000 (oldest deadline 2024-08-31T05:45:44.727854+0000) 2024-08-31T05:46:14.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:14 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:14.051+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.329641+0000 front 2024-08-31T05:45:29.329725+0000 (oldest deadline 2024-08-31T05:45:54.629726+0000) 2024-08-31T05:46:14.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:14 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:14.051+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.532721+0000 front 2024-08-31T05:45:38.532675+0000 (oldest deadline 2024-08-31T05:46:04.432712+0000) 2024-08-31T05:46:14.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:14 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:14.051+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:44.433114+0000 front 2024-08-31T05:45:44.433143+0000 (oldest deadline 2024-08-31T05:46:08.533275+0000) 2024-08-31T05:46:14.498 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@osd.6.service' 2024-08-31T05:46:14.543 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T05:46:14.543 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-08-31T05:46:14.543 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-08-31T05:46:14.543 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-69422704-6758-11ef-bcd4-c7b262605968@osd.7 2024-08-31T05:46:14.570 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:14 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:14.291+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:46:14.570 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:14 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:14.291+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.261294+0000 front 2024-08-31T05:45:29.261323+0000 (oldest deadline 2024-08-31T05:45:53.361431+0000) 2024-08-31T05:46:14.570 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:14 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:14.291+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:35.662443+0000 front 2024-08-31T05:45:35.662552+0000 (oldest deadline 2024-08-31T05:45:59.762525+0000) 2024-08-31T05:46:14.570 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:14 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:14.291+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:46.164178+0000 front 2024-08-31T05:45:46.164262+0000 (oldest deadline 2024-08-31T05:46:11.464217+0000) 2024-08-31T05:46:14.864 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:14 smithi050 systemd[1]: Stopping Ceph osd.7 for 69422704-6758-11ef-bcd4-c7b262605968... 2024-08-31T05:46:14.987 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:14 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:14.761+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.292206+0000 front 2024-08-31T05:45:29.292344+0000 (oldest deadline 2024-08-31T05:45:52.792211+0000) 2024-08-31T05:46:14.987 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:14 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:14.761+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:37.393671+0000 front 2024-08-31T05:45:37.393649+0000 (oldest deadline 2024-08-31T05:46:03.293761+0000) 2024-08-31T05:46:14.988 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:14 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:14.761+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:43.294394+0000 front 2024-08-31T05:45:43.294212+0000 (oldest deadline 2024-08-31T05:46:09.194267+0000) 2024-08-31T05:46:14.988 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:14 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:14.613+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:46:14.988 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:14 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:14.613+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.586285+0000 front 2024-08-31T05:45:38.586392+0000 (oldest deadline 2024-08-31T05:46:03.286480+0000) 2024-08-31T05:46:14.988 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:14 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:14.613+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:47.387728+0000 front 2024-08-31T05:45:47.387982+0000 (oldest deadline 2024-08-31T05:46:10.887839+0000) 2024-08-31T05:46:15.157 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:14 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:14.862+0000 7ffba458a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T05:46:15.157 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:14 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:14.862+0000 7ffba458a640 -1 osd.7 107 *** Got signal Terminated *** 2024-08-31T05:46:15.157 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:14 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:14.862+0000 7ffba458a640 -1 osd.7 107 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T05:46:15.157 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:14 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:14.886+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:30.947641+0000 front 2024-08-31T05:45:30.947613+0000 (oldest deadline 2024-08-31T05:45:53.247802+0000) 2024-08-31T05:46:15.157 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:14 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:14.886+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:34.849362+0000 front 2024-08-31T05:45:34.849133+0000 (oldest deadline 2024-08-31T05:46:00.149158+0000) 2024-08-31T05:46:15.157 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:14 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:14.886+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:44.850578+0000 front 2024-08-31T05:45:44.850403+0000 (oldest deadline 2024-08-31T05:46:10.150482+0000) 2024-08-31T05:46:15.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:15 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:15.039+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.527017+0000 front 2024-08-31T05:45:22.527052+0000 (oldest deadline 2024-08-31T05:45:44.727854+0000) 2024-08-31T05:46:15.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:15 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:15.039+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.329641+0000 front 2024-08-31T05:45:29.329725+0000 (oldest deadline 2024-08-31T05:45:54.629726+0000) 2024-08-31T05:46:15.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:15 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:15.039+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.532721+0000 front 2024-08-31T05:45:38.532675+0000 (oldest deadline 2024-08-31T05:46:04.432712+0000) 2024-08-31T05:46:15.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:15 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:15.039+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:44.433114+0000 front 2024-08-31T05:45:44.433143+0000 (oldest deadline 2024-08-31T05:46:08.533275+0000) 2024-08-31T05:46:15.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:15 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:15.331+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:46:15.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:15 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:15.331+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.261294+0000 front 2024-08-31T05:45:29.261323+0000 (oldest deadline 2024-08-31T05:45:53.361431+0000) 2024-08-31T05:46:15.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:15 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:15.331+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:35.662443+0000 front 2024-08-31T05:45:35.662552+0000 (oldest deadline 2024-08-31T05:45:59.762525+0000) 2024-08-31T05:46:15.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:15 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:15.331+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:46.164178+0000 front 2024-08-31T05:45:46.164262+0000 (oldest deadline 2024-08-31T05:46:11.464217+0000) 2024-08-31T05:46:15.999 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:15 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:15.767+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.292206+0000 front 2024-08-31T05:45:29.292344+0000 (oldest deadline 2024-08-31T05:45:52.792211+0000) 2024-08-31T05:46:15.999 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:15 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:15.767+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:37.393671+0000 front 2024-08-31T05:45:37.393649+0000 (oldest deadline 2024-08-31T05:46:03.293761+0000) 2024-08-31T05:46:16.000 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:15 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:15.767+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:43.294394+0000 front 2024-08-31T05:45:43.294212+0000 (oldest deadline 2024-08-31T05:46:09.194267+0000) 2024-08-31T05:46:16.000 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:15 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:15.634+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:46:16.000 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:15 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:15.634+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.586285+0000 front 2024-08-31T05:45:38.586392+0000 (oldest deadline 2024-08-31T05:46:03.286480+0000) 2024-08-31T05:46:16.000 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:15 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:15.634+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:47.387728+0000 front 2024-08-31T05:45:47.387982+0000 (oldest deadline 2024-08-31T05:46:10.887839+0000) 2024-08-31T05:46:16.157 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:15 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:15.837+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:30.947641+0000 front 2024-08-31T05:45:30.947613+0000 (oldest deadline 2024-08-31T05:45:53.247802+0000) 2024-08-31T05:46:16.157 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:15 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:15.837+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:34.849362+0000 front 2024-08-31T05:45:34.849133+0000 (oldest deadline 2024-08-31T05:46:00.149158+0000) 2024-08-31T05:46:16.157 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:15 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:15.837+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:44.850578+0000 front 2024-08-31T05:45:44.850403+0000 (oldest deadline 2024-08-31T05:46:10.150482+0000) 2024-08-31T05:46:16.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:16 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:16.000+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.527017+0000 front 2024-08-31T05:45:22.527052+0000 (oldest deadline 2024-08-31T05:45:44.727854+0000) 2024-08-31T05:46:16.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:16 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:16.000+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.329641+0000 front 2024-08-31T05:45:29.329725+0000 (oldest deadline 2024-08-31T05:45:54.629726+0000) 2024-08-31T05:46:16.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:16 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:16.000+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.532721+0000 front 2024-08-31T05:45:38.532675+0000 (oldest deadline 2024-08-31T05:46:04.432712+0000) 2024-08-31T05:46:16.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:16 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:16.000+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:44.433114+0000 front 2024-08-31T05:45:44.433143+0000 (oldest deadline 2024-08-31T05:46:08.533275+0000) 2024-08-31T05:46:16.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:16 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:16.307+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:46:16.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:16 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:16.307+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.261294+0000 front 2024-08-31T05:45:29.261323+0000 (oldest deadline 2024-08-31T05:45:53.361431+0000) 2024-08-31T05:46:16.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:16 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:16.307+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:35.662443+0000 front 2024-08-31T05:45:35.662552+0000 (oldest deadline 2024-08-31T05:45:59.762525+0000) 2024-08-31T05:46:16.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:16 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:16.307+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:46.164178+0000 front 2024-08-31T05:45:46.164262+0000 (oldest deadline 2024-08-31T05:46:11.464217+0000) 2024-08-31T05:46:17.086 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:16 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:16.762+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.292206+0000 front 2024-08-31T05:45:29.292344+0000 (oldest deadline 2024-08-31T05:45:52.792211+0000) 2024-08-31T05:46:17.086 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:16 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:16.762+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:37.393671+0000 front 2024-08-31T05:45:37.393649+0000 (oldest deadline 2024-08-31T05:46:03.293761+0000) 2024-08-31T05:46:17.086 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:16 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:16.762+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:43.294394+0000 front 2024-08-31T05:45:43.294212+0000 (oldest deadline 2024-08-31T05:46:09.194267+0000) 2024-08-31T05:46:17.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:16 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:16.676+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:46:17.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:16 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:16.677+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.586285+0000 front 2024-08-31T05:45:38.586392+0000 (oldest deadline 2024-08-31T05:46:03.286480+0000) 2024-08-31T05:46:17.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:16 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:16.677+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:47.387728+0000 front 2024-08-31T05:45:47.387982+0000 (oldest deadline 2024-08-31T05:46:10.887839+0000) 2024-08-31T05:46:17.157 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:16 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:16.854+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:30.947641+0000 front 2024-08-31T05:45:30.947613+0000 (oldest deadline 2024-08-31T05:45:53.247802+0000) 2024-08-31T05:46:17.157 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:16 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:16.854+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:34.849362+0000 front 2024-08-31T05:45:34.849133+0000 (oldest deadline 2024-08-31T05:46:00.149158+0000) 2024-08-31T05:46:17.157 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:16 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:16.854+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:44.850578+0000 front 2024-08-31T05:45:44.850403+0000 (oldest deadline 2024-08-31T05:46:10.150482+0000) 2024-08-31T05:46:17.370 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:16 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:16.998+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.527017+0000 front 2024-08-31T05:45:22.527052+0000 (oldest deadline 2024-08-31T05:45:44.727854+0000) 2024-08-31T05:46:17.370 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:16 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:16.998+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.329641+0000 front 2024-08-31T05:45:29.329725+0000 (oldest deadline 2024-08-31T05:45:54.629726+0000) 2024-08-31T05:46:17.371 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:16 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:16.998+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.532721+0000 front 2024-08-31T05:45:38.532675+0000 (oldest deadline 2024-08-31T05:46:04.432712+0000) 2024-08-31T05:46:17.371 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:16 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:16.998+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:44.433114+0000 front 2024-08-31T05:45:44.433143+0000 (oldest deadline 2024-08-31T05:46:08.533275+0000) 2024-08-31T05:46:17.371 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:16 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:16.998+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.834354+0000 front 2024-08-31T05:45:53.834515+0000 (oldest deadline 2024-08-31T05:46:16.734379+0000) 2024-08-31T05:46:17.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:17 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:17.268+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:46:17.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:17 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:17.268+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.261294+0000 front 2024-08-31T05:45:29.261323+0000 (oldest deadline 2024-08-31T05:45:53.361431+0000) 2024-08-31T05:46:17.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:17 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:17.268+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:35.662443+0000 front 2024-08-31T05:45:35.662552+0000 (oldest deadline 2024-08-31T05:45:59.762525+0000) 2024-08-31T05:46:17.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:17 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:17.268+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:46.164178+0000 front 2024-08-31T05:45:46.164262+0000 (oldest deadline 2024-08-31T05:46:11.464217+0000) 2024-08-31T05:46:18.086 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:17 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:17.795+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.292206+0000 front 2024-08-31T05:45:29.292344+0000 (oldest deadline 2024-08-31T05:45:52.792211+0000) 2024-08-31T05:46:18.086 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:17 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:17.795+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:37.393671+0000 front 2024-08-31T05:45:37.393649+0000 (oldest deadline 2024-08-31T05:46:03.293761+0000) 2024-08-31T05:46:18.087 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:17 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:17.795+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:43.294394+0000 front 2024-08-31T05:45:43.294212+0000 (oldest deadline 2024-08-31T05:46:09.194267+0000) 2024-08-31T05:46:18.087 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:17 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:17.795+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.895473+0000 front 2024-08-31T05:45:53.895591+0000 (oldest deadline 2024-08-31T05:46:16.795411+0000) 2024-08-31T05:46:18.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:17 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:17.635+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:46:18.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:17 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:17.635+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.586285+0000 front 2024-08-31T05:45:38.586392+0000 (oldest deadline 2024-08-31T05:46:03.286480+0000) 2024-08-31T05:46:18.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:17 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:17.635+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:47.387728+0000 front 2024-08-31T05:45:47.387982+0000 (oldest deadline 2024-08-31T05:46:10.887839+0000) 2024-08-31T05:46:18.157 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:17 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:17.863+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:30.947641+0000 front 2024-08-31T05:45:30.947613+0000 (oldest deadline 2024-08-31T05:45:53.247802+0000) 2024-08-31T05:46:18.157 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:17 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:17.863+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:34.849362+0000 front 2024-08-31T05:45:34.849133+0000 (oldest deadline 2024-08-31T05:46:00.149158+0000) 2024-08-31T05:46:18.157 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:17 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:17.863+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:44.850578+0000 front 2024-08-31T05:45:44.850403+0000 (oldest deadline 2024-08-31T05:46:10.150482+0000) 2024-08-31T05:46:18.217 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:17 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:17.992+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.527017+0000 front 2024-08-31T05:45:22.527052+0000 (oldest deadline 2024-08-31T05:45:44.727854+0000) 2024-08-31T05:46:18.217 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:17 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:17.992+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.329641+0000 front 2024-08-31T05:45:29.329725+0000 (oldest deadline 2024-08-31T05:45:54.629726+0000) 2024-08-31T05:46:18.217 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:17 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:17.992+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.532721+0000 front 2024-08-31T05:45:38.532675+0000 (oldest deadline 2024-08-31T05:46:04.432712+0000) 2024-08-31T05:46:18.217 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:17 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:17.992+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:44.433114+0000 front 2024-08-31T05:45:44.433143+0000 (oldest deadline 2024-08-31T05:46:08.533275+0000) 2024-08-31T05:46:18.217 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:17 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:17.992+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.834354+0000 front 2024-08-31T05:45:53.834515+0000 (oldest deadline 2024-08-31T05:46:16.734379+0000) 2024-08-31T05:46:18.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:18 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:18.239+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:46:18.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:18 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:18.239+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.261294+0000 front 2024-08-31T05:45:29.261323+0000 (oldest deadline 2024-08-31T05:45:53.361431+0000) 2024-08-31T05:46:18.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:18 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:18.239+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:35.662443+0000 front 2024-08-31T05:45:35.662552+0000 (oldest deadline 2024-08-31T05:45:59.762525+0000) 2024-08-31T05:46:18.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:18 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:18.239+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:46.164178+0000 front 2024-08-31T05:45:46.164262+0000 (oldest deadline 2024-08-31T05:46:11.464217+0000) 2024-08-31T05:46:19.086 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:18 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:18.844+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.292206+0000 front 2024-08-31T05:45:29.292344+0000 (oldest deadline 2024-08-31T05:45:52.792211+0000) 2024-08-31T05:46:19.086 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:18 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:18.844+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:37.393671+0000 front 2024-08-31T05:45:37.393649+0000 (oldest deadline 2024-08-31T05:46:03.293761+0000) 2024-08-31T05:46:19.086 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:18 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:18.844+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:43.294394+0000 front 2024-08-31T05:45:43.294212+0000 (oldest deadline 2024-08-31T05:46:09.194267+0000) 2024-08-31T05:46:19.087 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:18 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:18.844+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.895473+0000 front 2024-08-31T05:45:53.895591+0000 (oldest deadline 2024-08-31T05:46:16.795411+0000) 2024-08-31T05:46:19.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:18 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:18.617+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:46:19.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:18 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:18.617+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.586285+0000 front 2024-08-31T05:45:38.586392+0000 (oldest deadline 2024-08-31T05:46:03.286480+0000) 2024-08-31T05:46:19.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:18 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:18.617+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:47.387728+0000 front 2024-08-31T05:45:47.387982+0000 (oldest deadline 2024-08-31T05:46:10.887839+0000) 2024-08-31T05:46:19.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:18 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:18.617+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:54.389119+0000 front 2024-08-31T05:45:54.389023+0000 (oldest deadline 2024-08-31T05:46:17.889175+0000) 2024-08-31T05:46:19.157 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:18 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:18.852+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:30.947641+0000 front 2024-08-31T05:45:30.947613+0000 (oldest deadline 2024-08-31T05:45:53.247802+0000) 2024-08-31T05:46:19.157 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:18 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:18.852+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:34.849362+0000 front 2024-08-31T05:45:34.849133+0000 (oldest deadline 2024-08-31T05:46:00.149158+0000) 2024-08-31T05:46:19.157 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:18 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:18.852+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:44.850578+0000 front 2024-08-31T05:45:44.850403+0000 (oldest deadline 2024-08-31T05:46:10.150482+0000) 2024-08-31T05:46:19.157 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:18 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:18.852+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:52.952135+0000 front 2024-08-31T05:45:52.952161+0000 (oldest deadline 2024-08-31T05:46:18.252386+0000) 2024-08-31T05:46:19.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:19 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:19.035+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.527017+0000 front 2024-08-31T05:45:22.527052+0000 (oldest deadline 2024-08-31T05:45:44.727854+0000) 2024-08-31T05:46:19.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:19 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:19.035+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.329641+0000 front 2024-08-31T05:45:29.329725+0000 (oldest deadline 2024-08-31T05:45:54.629726+0000) 2024-08-31T05:46:19.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:19 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:19.035+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.532721+0000 front 2024-08-31T05:45:38.532675+0000 (oldest deadline 2024-08-31T05:46:04.432712+0000) 2024-08-31T05:46:19.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:19 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:19.035+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:44.433114+0000 front 2024-08-31T05:45:44.433143+0000 (oldest deadline 2024-08-31T05:46:08.533275+0000) 2024-08-31T05:46:19.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:19 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:19.035+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.834354+0000 front 2024-08-31T05:45:53.834515+0000 (oldest deadline 2024-08-31T05:46:16.734379+0000) 2024-08-31T05:46:19.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:19 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:19.230+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:46:19.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:19 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:19.230+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.261294+0000 front 2024-08-31T05:45:29.261323+0000 (oldest deadline 2024-08-31T05:45:53.361431+0000) 2024-08-31T05:46:19.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:19 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:19.230+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:35.662443+0000 front 2024-08-31T05:45:35.662552+0000 (oldest deadline 2024-08-31T05:45:59.762525+0000) 2024-08-31T05:46:19.658 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:19 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:19.230+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:46.164178+0000 front 2024-08-31T05:45:46.164262+0000 (oldest deadline 2024-08-31T05:46:11.464217+0000) 2024-08-31T05:46:19.658 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:19 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:19.230+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.765112+0000 front 2024-08-31T05:45:53.765136+0000 (oldest deadline 2024-08-31T05:46:19.065248+0000) 2024-08-31T05:46:20.086 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:19 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:19.796+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.292206+0000 front 2024-08-31T05:45:29.292344+0000 (oldest deadline 2024-08-31T05:45:52.792211+0000) 2024-08-31T05:46:20.086 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:19 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:19.796+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:37.393671+0000 front 2024-08-31T05:45:37.393649+0000 (oldest deadline 2024-08-31T05:46:03.293761+0000) 2024-08-31T05:46:20.086 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:19 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:19.796+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:43.294394+0000 front 2024-08-31T05:45:43.294212+0000 (oldest deadline 2024-08-31T05:46:09.194267+0000) 2024-08-31T05:46:20.086 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:19 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:19.796+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.895473+0000 front 2024-08-31T05:45:53.895591+0000 (oldest deadline 2024-08-31T05:46:16.795411+0000) 2024-08-31T05:46:20.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:19 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:19.631+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:46:20.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:19 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:19.631+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.586285+0000 front 2024-08-31T05:45:38.586392+0000 (oldest deadline 2024-08-31T05:46:03.286480+0000) 2024-08-31T05:46:20.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:19 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:19.631+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:47.387728+0000 front 2024-08-31T05:45:47.387982+0000 (oldest deadline 2024-08-31T05:46:10.887839+0000) 2024-08-31T05:46:20.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:19 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:19.631+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:54.389119+0000 front 2024-08-31T05:45:54.389023+0000 (oldest deadline 2024-08-31T05:46:17.889175+0000) 2024-08-31T05:46:20.157 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:19 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:19.849+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:30.947641+0000 front 2024-08-31T05:45:30.947613+0000 (oldest deadline 2024-08-31T05:45:53.247802+0000) 2024-08-31T05:46:20.157 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:19 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:19.849+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:34.849362+0000 front 2024-08-31T05:45:34.849133+0000 (oldest deadline 2024-08-31T05:46:00.149158+0000) 2024-08-31T05:46:20.157 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:19 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:19.849+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:44.850578+0000 front 2024-08-31T05:45:44.850403+0000 (oldest deadline 2024-08-31T05:46:10.150482+0000) 2024-08-31T05:46:20.157 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:19 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7[41264]: 2024-08-31T05:46:19.849+0000 7ffba0b75640 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:52.952135+0000 front 2024-08-31T05:45:52.952161+0000 (oldest deadline 2024-08-31T05:46:18.252386+0000) 2024-08-31T05:46:20.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:20 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:20.004+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.527017+0000 front 2024-08-31T05:45:22.527052+0000 (oldest deadline 2024-08-31T05:45:44.727854+0000) 2024-08-31T05:46:20.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:20 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:20.004+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.329641+0000 front 2024-08-31T05:45:29.329725+0000 (oldest deadline 2024-08-31T05:45:54.629726+0000) 2024-08-31T05:46:20.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:20 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:20.004+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.532721+0000 front 2024-08-31T05:45:38.532675+0000 (oldest deadline 2024-08-31T05:46:04.432712+0000) 2024-08-31T05:46:20.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:20 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:20.004+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:44.433114+0000 front 2024-08-31T05:45:44.433143+0000 (oldest deadline 2024-08-31T05:46:08.533275+0000) 2024-08-31T05:46:20.468 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:20 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:20.004+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.834354+0000 front 2024-08-31T05:45:53.834515+0000 (oldest deadline 2024-08-31T05:46:16.734379+0000) 2024-08-31T05:46:20.657 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:20 smithi050 podman[60228]: 2024-08-31 05:46:20.358967257 +0000 UTC m=+5.618075058 container died 966af6bada14cb244ed5b001760f30858f28e8006463167f7c79f579dfed5e13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T05:46:20.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:20 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:20.222+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:46:20.658 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:20 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:20.222+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.261294+0000 front 2024-08-31T05:45:29.261323+0000 (oldest deadline 2024-08-31T05:45:53.361431+0000) 2024-08-31T05:46:20.658 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:20 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:20.222+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:35.662443+0000 front 2024-08-31T05:45:35.662552+0000 (oldest deadline 2024-08-31T05:45:59.762525+0000) 2024-08-31T05:46:20.658 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:20 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:20.222+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:46.164178+0000 front 2024-08-31T05:45:46.164262+0000 (oldest deadline 2024-08-31T05:46:11.464217+0000) 2024-08-31T05:46:20.658 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:20 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:20.222+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.765112+0000 front 2024-08-31T05:45:53.765136+0000 (oldest deadline 2024-08-31T05:46:19.065248+0000) 2024-08-31T05:46:21.016 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:20 smithi050 podman[60228]: 2024-08-31 05:46:20.780077205 +0000 UTC m=+6.039185004 container cleanup 966af6bada14cb244ed5b001760f30858f28e8006463167f7c79f579dfed5e13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.1) 2024-08-31T05:46:21.016 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:20 smithi050 bash[60228]: ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7 2024-08-31T05:46:21.086 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:20 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:20.775+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.292206+0000 front 2024-08-31T05:45:29.292344+0000 (oldest deadline 2024-08-31T05:45:52.792211+0000) 2024-08-31T05:46:21.086 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:20 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:20.775+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:37.393671+0000 front 2024-08-31T05:45:37.393649+0000 (oldest deadline 2024-08-31T05:46:03.293761+0000) 2024-08-31T05:46:21.086 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:20 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:20.775+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:43.294394+0000 front 2024-08-31T05:45:43.294212+0000 (oldest deadline 2024-08-31T05:46:09.194267+0000) 2024-08-31T05:46:21.086 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:20 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:20.775+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.895473+0000 front 2024-08-31T05:45:53.895591+0000 (oldest deadline 2024-08-31T05:46:16.795411+0000) 2024-08-31T05:46:21.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:20 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:20.626+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:46:21.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:20 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:20.626+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.586285+0000 front 2024-08-31T05:45:38.586392+0000 (oldest deadline 2024-08-31T05:46:03.286480+0000) 2024-08-31T05:46:21.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:20 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:20.626+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:47.387728+0000 front 2024-08-31T05:45:47.387982+0000 (oldest deadline 2024-08-31T05:46:10.887839+0000) 2024-08-31T05:46:21.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:20 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:20.626+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:54.389119+0000 front 2024-08-31T05:45:54.389023+0000 (oldest deadline 2024-08-31T05:46:17.889175+0000) 2024-08-31T05:46:21.266 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:21 smithi050 podman[60244]: 2024-08-31 05:46:21.01490594 +0000 UTC m=+0.653842495 container remove 966af6bada14cb244ed5b001760f30858f28e8006463167f7c79f579dfed5e13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-08-31T05:46:21.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:21 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:21.017+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.527017+0000 front 2024-08-31T05:45:22.527052+0000 (oldest deadline 2024-08-31T05:45:44.727854+0000) 2024-08-31T05:46:21.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:21 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:21.017+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.329641+0000 front 2024-08-31T05:45:29.329725+0000 (oldest deadline 2024-08-31T05:45:54.629726+0000) 2024-08-31T05:46:21.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:21 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:21.017+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.532721+0000 front 2024-08-31T05:45:38.532675+0000 (oldest deadline 2024-08-31T05:46:04.432712+0000) 2024-08-31T05:46:21.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:21 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:21.017+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:44.433114+0000 front 2024-08-31T05:45:44.433143+0000 (oldest deadline 2024-08-31T05:46:08.533275+0000) 2024-08-31T05:46:21.468 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:21 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:21.017+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.834354+0000 front 2024-08-31T05:45:53.834515+0000 (oldest deadline 2024-08-31T05:46:16.734379+0000) 2024-08-31T05:46:21.616 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:21 smithi050 podman[60333]: 2024-08-31 05:46:21.356568798 +0000 UTC m=+0.016021717 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T05:46:21.616 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:21 smithi050 podman[60333]: 2024-08-31 05:46:21.474224757 +0000 UTC m=+0.133677670 container create dba741d887c7e778f4f99a27a3b420ac42d7acf3f9ca20f0cef2a63f43276ba1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T05:46:21.617 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:21 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:21.264+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:46:21.617 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:21 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:21.264+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.261294+0000 front 2024-08-31T05:45:29.261323+0000 (oldest deadline 2024-08-31T05:45:53.361431+0000) 2024-08-31T05:46:21.617 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:21 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:21.264+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:35.662443+0000 front 2024-08-31T05:45:35.662552+0000 (oldest deadline 2024-08-31T05:45:59.762525+0000) 2024-08-31T05:46:21.617 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:21 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:21.264+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:46.164178+0000 front 2024-08-31T05:45:46.164262+0000 (oldest deadline 2024-08-31T05:46:11.464217+0000) 2024-08-31T05:46:21.617 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:21 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:21.264+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.765112+0000 front 2024-08-31T05:45:53.765136+0000 (oldest deadline 2024-08-31T05:46:19.065248+0000) 2024-08-31T05:46:21.907 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:21 smithi050 podman[60333]: 2024-08-31 05:46:21.843559743 +0000 UTC m=+0.503012666 container init dba741d887c7e778f4f99a27a3b420ac42d7acf3f9ca20f0cef2a63f43276ba1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-08-31T05:46:21.907 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:21 smithi050 podman[60333]: 2024-08-31 05:46:21.847005172 +0000 UTC m=+0.506458086 container start dba741d887c7e778f4f99a27a3b420ac42d7acf3f9ca20f0cef2a63f43276ba1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7-deactivate, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-08-31T05:46:22.086 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:21 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:21.809+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.292206+0000 front 2024-08-31T05:45:29.292344+0000 (oldest deadline 2024-08-31T05:45:52.792211+0000) 2024-08-31T05:46:22.086 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:21 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:21.809+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:37.393671+0000 front 2024-08-31T05:45:37.393649+0000 (oldest deadline 2024-08-31T05:46:03.293761+0000) 2024-08-31T05:46:22.086 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:21 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:21.809+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:43.294394+0000 front 2024-08-31T05:45:43.294212+0000 (oldest deadline 2024-08-31T05:46:09.194267+0000) 2024-08-31T05:46:22.086 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:21 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:21.809+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.895473+0000 front 2024-08-31T05:45:53.895591+0000 (oldest deadline 2024-08-31T05:46:16.795411+0000) 2024-08-31T05:46:22.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:21 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:21.650+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:46:22.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:21 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:21.650+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.586285+0000 front 2024-08-31T05:45:38.586392+0000 (oldest deadline 2024-08-31T05:46:03.286480+0000) 2024-08-31T05:46:22.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:21 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:21.650+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:47.387728+0000 front 2024-08-31T05:45:47.387982+0000 (oldest deadline 2024-08-31T05:46:10.887839+0000) 2024-08-31T05:46:22.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:21 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:21.650+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:54.389119+0000 front 2024-08-31T05:45:54.389023+0000 (oldest deadline 2024-08-31T05:46:17.889175+0000) 2024-08-31T05:46:22.281 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:21 smithi050 podman[60333]: 2024-08-31 05:46:21.935213241 +0000 UTC m=+0.594666158 container attach dba741d887c7e778f4f99a27a3b420ac42d7acf3f9ca20f0cef2a63f43276ba1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7-deactivate, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, ceph=True) 2024-08-31T05:46:22.281 INFO:journalctl@ceph.osd.7.smithi050.stdout:Aug 31 05:46:22 smithi050 podman[60333]: 2024-08-31 05:46:22.041908039 +0000 UTC m=+0.701360965 container died dba741d887c7e778f4f99a27a3b420ac42d7acf3f9ca20f0cef2a63f43276ba1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True) 2024-08-31T05:46:22.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:22 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:22.022+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.527017+0000 front 2024-08-31T05:45:22.527052+0000 (oldest deadline 2024-08-31T05:45:44.727854+0000) 2024-08-31T05:46:22.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:22 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:22.022+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.329641+0000 front 2024-08-31T05:45:29.329725+0000 (oldest deadline 2024-08-31T05:45:54.629726+0000) 2024-08-31T05:46:22.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:22 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:22.022+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.532721+0000 front 2024-08-31T05:45:38.532675+0000 (oldest deadline 2024-08-31T05:46:04.432712+0000) 2024-08-31T05:46:22.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:22 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:22.022+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:44.433114+0000 front 2024-08-31T05:45:44.433143+0000 (oldest deadline 2024-08-31T05:46:08.533275+0000) 2024-08-31T05:46:22.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:22 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:22.022+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.834354+0000 front 2024-08-31T05:45:53.834515+0000 (oldest deadline 2024-08-31T05:46:16.734379+0000) 2024-08-31T05:46:22.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:22 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:22.278+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:46:22.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:22 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:22.278+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.261294+0000 front 2024-08-31T05:45:29.261323+0000 (oldest deadline 2024-08-31T05:45:53.361431+0000) 2024-08-31T05:46:22.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:22 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:22.278+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:35.662443+0000 front 2024-08-31T05:45:35.662552+0000 (oldest deadline 2024-08-31T05:45:59.762525+0000) 2024-08-31T05:46:22.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:22 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:22.278+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:46.164178+0000 front 2024-08-31T05:45:46.164262+0000 (oldest deadline 2024-08-31T05:46:11.464217+0000) 2024-08-31T05:46:22.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:22 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:22.278+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.765112+0000 front 2024-08-31T05:45:53.765136+0000 (oldest deadline 2024-08-31T05:46:19.065248+0000) 2024-08-31T05:46:22.734 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@osd.7.service' 2024-08-31T05:46:22.812 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T05:46:22.813 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-08-31T05:46:22.813 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-08-31T05:46:22.813 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-69422704-6758-11ef-bcd4-c7b262605968@osd.8 2024-08-31T05:46:23.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:22 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:22.616+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:46:23.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:22 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:22.616+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.586285+0000 front 2024-08-31T05:45:38.586392+0000 (oldest deadline 2024-08-31T05:46:03.286480+0000) 2024-08-31T05:46:23.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:22 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:22.616+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:47.387728+0000 front 2024-08-31T05:45:47.387982+0000 (oldest deadline 2024-08-31T05:46:10.887839+0000) 2024-08-31T05:46:23.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:22 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:22.616+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:54.389119+0000 front 2024-08-31T05:45:54.389023+0000 (oldest deadline 2024-08-31T05:46:17.889175+0000) 2024-08-31T05:46:23.087 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:22 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:22.767+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.292206+0000 front 2024-08-31T05:45:29.292344+0000 (oldest deadline 2024-08-31T05:45:52.792211+0000) 2024-08-31T05:46:23.087 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:22 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:22.767+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:37.393671+0000 front 2024-08-31T05:45:37.393649+0000 (oldest deadline 2024-08-31T05:46:03.293761+0000) 2024-08-31T05:46:23.087 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:22 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:22.767+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:43.294394+0000 front 2024-08-31T05:45:43.294212+0000 (oldest deadline 2024-08-31T05:46:09.194267+0000) 2024-08-31T05:46:23.087 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:22 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:22.767+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.895473+0000 front 2024-08-31T05:45:53.895591+0000 (oldest deadline 2024-08-31T05:46:16.795411+0000) 2024-08-31T05:46:23.087 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:22 smithi070 systemd[1]: Stopping Ceph osd.8 for 69422704-6758-11ef-bcd4-c7b262605968... 2024-08-31T05:46:23.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:22 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:22.999+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.527017+0000 front 2024-08-31T05:45:22.527052+0000 (oldest deadline 2024-08-31T05:45:44.727854+0000) 2024-08-31T05:46:23.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:22 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:22.999+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.329641+0000 front 2024-08-31T05:45:29.329725+0000 (oldest deadline 2024-08-31T05:45:54.629726+0000) 2024-08-31T05:46:23.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:22 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:22.999+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.532721+0000 front 2024-08-31T05:45:38.532675+0000 (oldest deadline 2024-08-31T05:46:04.432712+0000) 2024-08-31T05:46:23.468 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:22 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:22.999+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:44.433114+0000 front 2024-08-31T05:45:44.433143+0000 (oldest deadline 2024-08-31T05:46:08.533275+0000) 2024-08-31T05:46:23.468 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:22 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:22.999+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.834354+0000 front 2024-08-31T05:45:53.834515+0000 (oldest deadline 2024-08-31T05:46:16.734379+0000) 2024-08-31T05:46:23.571 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:23 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:23.121+0000 7f1af6dd5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T05:46:23.571 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:23 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:23.121+0000 7f1af6dd5640 -1 osd.8 107 *** Got signal Terminated *** 2024-08-31T05:46:23.571 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:23 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:23.121+0000 7f1af6dd5640 -1 osd.8 107 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T05:46:23.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:23 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:23.261+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:46:23.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:23 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:23.261+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.261294+0000 front 2024-08-31T05:45:29.261323+0000 (oldest deadline 2024-08-31T05:45:53.361431+0000) 2024-08-31T05:46:23.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:23 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:23.261+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:35.662443+0000 front 2024-08-31T05:45:35.662552+0000 (oldest deadline 2024-08-31T05:45:59.762525+0000) 2024-08-31T05:46:23.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:23 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:23.261+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:46.164178+0000 front 2024-08-31T05:45:46.164262+0000 (oldest deadline 2024-08-31T05:46:11.464217+0000) 2024-08-31T05:46:23.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:23 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:23.261+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.765112+0000 front 2024-08-31T05:45:53.765136+0000 (oldest deadline 2024-08-31T05:46:19.065248+0000) 2024-08-31T05:46:23.836 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:23 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:23.741+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.292206+0000 front 2024-08-31T05:45:29.292344+0000 (oldest deadline 2024-08-31T05:45:52.792211+0000) 2024-08-31T05:46:23.836 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:23 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:23.741+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:37.393671+0000 front 2024-08-31T05:45:37.393649+0000 (oldest deadline 2024-08-31T05:46:03.293761+0000) 2024-08-31T05:46:23.836 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:23 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:23.741+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:43.294394+0000 front 2024-08-31T05:45:43.294212+0000 (oldest deadline 2024-08-31T05:46:09.194267+0000) 2024-08-31T05:46:23.836 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:23 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:23.741+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.895473+0000 front 2024-08-31T05:45:53.895591+0000 (oldest deadline 2024-08-31T05:46:16.795411+0000) 2024-08-31T05:46:23.836 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:23 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:23.568+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:46:23.837 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:23 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:23.568+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.586285+0000 front 2024-08-31T05:45:38.586392+0000 (oldest deadline 2024-08-31T05:46:03.286480+0000) 2024-08-31T05:46:23.837 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:23 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:23.568+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:47.387728+0000 front 2024-08-31T05:45:47.387982+0000 (oldest deadline 2024-08-31T05:46:10.887839+0000) 2024-08-31T05:46:23.837 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:23 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:23.568+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:54.389119+0000 front 2024-08-31T05:45:54.389023+0000 (oldest deadline 2024-08-31T05:46:17.889175+0000) 2024-08-31T05:46:24.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:24 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:24.033+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.527017+0000 front 2024-08-31T05:45:22.527052+0000 (oldest deadline 2024-08-31T05:45:44.727854+0000) 2024-08-31T05:46:24.468 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:24 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:24.033+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.329641+0000 front 2024-08-31T05:45:29.329725+0000 (oldest deadline 2024-08-31T05:45:54.629726+0000) 2024-08-31T05:46:24.468 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:24 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:24.033+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.532721+0000 front 2024-08-31T05:45:38.532675+0000 (oldest deadline 2024-08-31T05:46:04.432712+0000) 2024-08-31T05:46:24.468 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:24 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:24.033+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:44.433114+0000 front 2024-08-31T05:45:44.433143+0000 (oldest deadline 2024-08-31T05:46:08.533275+0000) 2024-08-31T05:46:24.469 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:24 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:24.033+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.834354+0000 front 2024-08-31T05:45:53.834515+0000 (oldest deadline 2024-08-31T05:46:16.734379+0000) 2024-08-31T05:46:24.559 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:24 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:24.216+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:46:24.559 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:24 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:24.216+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.261294+0000 front 2024-08-31T05:45:29.261323+0000 (oldest deadline 2024-08-31T05:45:53.361431+0000) 2024-08-31T05:46:24.559 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:24 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:24.216+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:35.662443+0000 front 2024-08-31T05:45:35.662552+0000 (oldest deadline 2024-08-31T05:45:59.762525+0000) 2024-08-31T05:46:24.559 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:24 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:24.216+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:46.164178+0000 front 2024-08-31T05:45:46.164262+0000 (oldest deadline 2024-08-31T05:46:11.464217+0000) 2024-08-31T05:46:24.559 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:24 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:24.216+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.765112+0000 front 2024-08-31T05:45:53.765136+0000 (oldest deadline 2024-08-31T05:46:19.065248+0000) 2024-08-31T05:46:25.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:24 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:24.589+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:46:25.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:24 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:24.589+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.586285+0000 front 2024-08-31T05:45:38.586392+0000 (oldest deadline 2024-08-31T05:46:03.286480+0000) 2024-08-31T05:46:25.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:24 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:24.589+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:47.387728+0000 front 2024-08-31T05:45:47.387982+0000 (oldest deadline 2024-08-31T05:46:10.887839+0000) 2024-08-31T05:46:25.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:24 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:24.589+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:54.389119+0000 front 2024-08-31T05:45:54.389023+0000 (oldest deadline 2024-08-31T05:46:17.889175+0000) 2024-08-31T05:46:25.087 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:24 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:24.709+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.292206+0000 front 2024-08-31T05:45:29.292344+0000 (oldest deadline 2024-08-31T05:45:52.792211+0000) 2024-08-31T05:46:25.087 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:24 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:24.709+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:37.393671+0000 front 2024-08-31T05:45:37.393649+0000 (oldest deadline 2024-08-31T05:46:03.293761+0000) 2024-08-31T05:46:25.087 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:24 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:24.709+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:43.294394+0000 front 2024-08-31T05:45:43.294212+0000 (oldest deadline 2024-08-31T05:46:09.194267+0000) 2024-08-31T05:46:25.087 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:24 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:24.709+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.895473+0000 front 2024-08-31T05:45:53.895591+0000 (oldest deadline 2024-08-31T05:46:16.795411+0000) 2024-08-31T05:46:25.087 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:24 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:24.709+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:02.298670+0000 front 2024-08-31T05:46:02.298703+0000 (oldest deadline 2024-08-31T05:46:24.598836+0000) 2024-08-31T05:46:25.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:25 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:25.046+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.527017+0000 front 2024-08-31T05:45:22.527052+0000 (oldest deadline 2024-08-31T05:45:44.727854+0000) 2024-08-31T05:46:25.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:25 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:25.046+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.329641+0000 front 2024-08-31T05:45:29.329725+0000 (oldest deadline 2024-08-31T05:45:54.629726+0000) 2024-08-31T05:46:25.468 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:25 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:25.046+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.532721+0000 front 2024-08-31T05:45:38.532675+0000 (oldest deadline 2024-08-31T05:46:04.432712+0000) 2024-08-31T05:46:25.468 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:25 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:25.046+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:44.433114+0000 front 2024-08-31T05:45:44.433143+0000 (oldest deadline 2024-08-31T05:46:08.533275+0000) 2024-08-31T05:46:25.468 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:25 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:25.046+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.834354+0000 front 2024-08-31T05:45:53.834515+0000 (oldest deadline 2024-08-31T05:46:16.734379+0000) 2024-08-31T05:46:25.468 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:25 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:25.046+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.236650+0000 front 2024-08-31T05:46:01.236813+0000 (oldest deadline 2024-08-31T05:46:24.736780+0000) 2024-08-31T05:46:25.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:25 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:25.173+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:46:25.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:25 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:25.173+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.261294+0000 front 2024-08-31T05:45:29.261323+0000 (oldest deadline 2024-08-31T05:45:53.361431+0000) 2024-08-31T05:46:25.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:25 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:25.173+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:35.662443+0000 front 2024-08-31T05:45:35.662552+0000 (oldest deadline 2024-08-31T05:45:59.762525+0000) 2024-08-31T05:46:25.658 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:25 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:25.173+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:46.164178+0000 front 2024-08-31T05:45:46.164262+0000 (oldest deadline 2024-08-31T05:46:11.464217+0000) 2024-08-31T05:46:25.658 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:25 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:25.173+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.765112+0000 front 2024-08-31T05:45:53.765136+0000 (oldest deadline 2024-08-31T05:46:19.065248+0000) 2024-08-31T05:46:26.086 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:25 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:25.706+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.292206+0000 front 2024-08-31T05:45:29.292344+0000 (oldest deadline 2024-08-31T05:45:52.792211+0000) 2024-08-31T05:46:26.086 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:25 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:25.706+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:37.393671+0000 front 2024-08-31T05:45:37.393649+0000 (oldest deadline 2024-08-31T05:46:03.293761+0000) 2024-08-31T05:46:26.086 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:25 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:25.706+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:43.294394+0000 front 2024-08-31T05:45:43.294212+0000 (oldest deadline 2024-08-31T05:46:09.194267+0000) 2024-08-31T05:46:26.086 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:25 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:25.706+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.895473+0000 front 2024-08-31T05:45:53.895591+0000 (oldest deadline 2024-08-31T05:46:16.795411+0000) 2024-08-31T05:46:26.087 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:25 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:25.706+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:02.298670+0000 front 2024-08-31T05:46:02.298703+0000 (oldest deadline 2024-08-31T05:46:24.598836+0000) 2024-08-31T05:46:26.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:25 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:25.630+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:46:26.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:25 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:25.630+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.586285+0000 front 2024-08-31T05:45:38.586392+0000 (oldest deadline 2024-08-31T05:46:03.286480+0000) 2024-08-31T05:46:26.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:25 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:25.630+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:47.387728+0000 front 2024-08-31T05:45:47.387982+0000 (oldest deadline 2024-08-31T05:46:10.887839+0000) 2024-08-31T05:46:26.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:25 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:25.630+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:54.389119+0000 front 2024-08-31T05:45:54.389023+0000 (oldest deadline 2024-08-31T05:46:17.889175+0000) 2024-08-31T05:46:26.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:25 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:25.630+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.990353+0000 front 2024-08-31T05:46:01.990407+0000 (oldest deadline 2024-08-31T05:46:24.890512+0000) 2024-08-31T05:46:26.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:26 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:26.043+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.527017+0000 front 2024-08-31T05:45:22.527052+0000 (oldest deadline 2024-08-31T05:45:44.727854+0000) 2024-08-31T05:46:26.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:26 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:26.043+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.329641+0000 front 2024-08-31T05:45:29.329725+0000 (oldest deadline 2024-08-31T05:45:54.629726+0000) 2024-08-31T05:46:26.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:26 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:26.043+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.532721+0000 front 2024-08-31T05:45:38.532675+0000 (oldest deadline 2024-08-31T05:46:04.432712+0000) 2024-08-31T05:46:26.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:26 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:26.043+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:44.433114+0000 front 2024-08-31T05:45:44.433143+0000 (oldest deadline 2024-08-31T05:46:08.533275+0000) 2024-08-31T05:46:26.468 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:26 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:26.043+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.834354+0000 front 2024-08-31T05:45:53.834515+0000 (oldest deadline 2024-08-31T05:46:16.734379+0000) 2024-08-31T05:46:26.468 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:26 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:26.043+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.236650+0000 front 2024-08-31T05:46:01.236813+0000 (oldest deadline 2024-08-31T05:46:24.736780+0000) 2024-08-31T05:46:26.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:26 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:26.219+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:46:26.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:26 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:26.219+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.261294+0000 front 2024-08-31T05:45:29.261323+0000 (oldest deadline 2024-08-31T05:45:53.361431+0000) 2024-08-31T05:46:26.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:26 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:26.219+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:35.662443+0000 front 2024-08-31T05:45:35.662552+0000 (oldest deadline 2024-08-31T05:45:59.762525+0000) 2024-08-31T05:46:26.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:26 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:26.219+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:46.164178+0000 front 2024-08-31T05:45:46.164262+0000 (oldest deadline 2024-08-31T05:46:11.464217+0000) 2024-08-31T05:46:26.658 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:26 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:26.219+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.765112+0000 front 2024-08-31T05:45:53.765136+0000 (oldest deadline 2024-08-31T05:46:19.065248+0000) 2024-08-31T05:46:26.658 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:26 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:26.219+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.366359+0000 front 2024-08-31T05:46:01.366344+0000 (oldest deadline 2024-08-31T05:46:25.466127+0000) 2024-08-31T05:46:27.086 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:26 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:26.688+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.292206+0000 front 2024-08-31T05:45:29.292344+0000 (oldest deadline 2024-08-31T05:45:52.792211+0000) 2024-08-31T05:46:27.086 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:26 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:26.688+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:37.393671+0000 front 2024-08-31T05:45:37.393649+0000 (oldest deadline 2024-08-31T05:46:03.293761+0000) 2024-08-31T05:46:27.087 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:26 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:26.688+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:43.294394+0000 front 2024-08-31T05:45:43.294212+0000 (oldest deadline 2024-08-31T05:46:09.194267+0000) 2024-08-31T05:46:27.087 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:26 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:26.688+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.895473+0000 front 2024-08-31T05:45:53.895591+0000 (oldest deadline 2024-08-31T05:46:16.795411+0000) 2024-08-31T05:46:27.087 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:26 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:26.688+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:02.298670+0000 front 2024-08-31T05:46:02.298703+0000 (oldest deadline 2024-08-31T05:46:24.598836+0000) 2024-08-31T05:46:27.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:26 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:26.604+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:46:27.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:26 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:26.604+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.586285+0000 front 2024-08-31T05:45:38.586392+0000 (oldest deadline 2024-08-31T05:46:03.286480+0000) 2024-08-31T05:46:27.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:26 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:26.604+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:47.387728+0000 front 2024-08-31T05:45:47.387982+0000 (oldest deadline 2024-08-31T05:46:10.887839+0000) 2024-08-31T05:46:27.088 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:26 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:26.604+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:54.389119+0000 front 2024-08-31T05:45:54.389023+0000 (oldest deadline 2024-08-31T05:46:17.889175+0000) 2024-08-31T05:46:27.088 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:26 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:26.604+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.990353+0000 front 2024-08-31T05:46:01.990407+0000 (oldest deadline 2024-08-31T05:46:24.890512+0000) 2024-08-31T05:46:27.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:27 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:27.057+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.527017+0000 front 2024-08-31T05:45:22.527052+0000 (oldest deadline 2024-08-31T05:45:44.727854+0000) 2024-08-31T05:46:27.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:27 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:27.057+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.329641+0000 front 2024-08-31T05:45:29.329725+0000 (oldest deadline 2024-08-31T05:45:54.629726+0000) 2024-08-31T05:46:27.468 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:27 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:27.057+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.532721+0000 front 2024-08-31T05:45:38.532675+0000 (oldest deadline 2024-08-31T05:46:04.432712+0000) 2024-08-31T05:46:27.468 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:27 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:27.057+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:44.433114+0000 front 2024-08-31T05:45:44.433143+0000 (oldest deadline 2024-08-31T05:46:08.533275+0000) 2024-08-31T05:46:27.468 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:27 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:27.057+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.834354+0000 front 2024-08-31T05:45:53.834515+0000 (oldest deadline 2024-08-31T05:46:16.734379+0000) 2024-08-31T05:46:27.468 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:27 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:27.057+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.236650+0000 front 2024-08-31T05:46:01.236813+0000 (oldest deadline 2024-08-31T05:46:24.736780+0000) 2024-08-31T05:46:27.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:27 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:27.200+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:46:27.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:27 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:27.200+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.261294+0000 front 2024-08-31T05:45:29.261323+0000 (oldest deadline 2024-08-31T05:45:53.361431+0000) 2024-08-31T05:46:27.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:27 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:27.200+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:35.662443+0000 front 2024-08-31T05:45:35.662552+0000 (oldest deadline 2024-08-31T05:45:59.762525+0000) 2024-08-31T05:46:27.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:27 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:27.200+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:46.164178+0000 front 2024-08-31T05:45:46.164262+0000 (oldest deadline 2024-08-31T05:46:11.464217+0000) 2024-08-31T05:46:27.658 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:27 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:27.200+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.765112+0000 front 2024-08-31T05:45:53.765136+0000 (oldest deadline 2024-08-31T05:46:19.065248+0000) 2024-08-31T05:46:27.658 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:27 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:27.200+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.366359+0000 front 2024-08-31T05:46:01.366344+0000 (oldest deadline 2024-08-31T05:46:25.466127+0000) 2024-08-31T05:46:27.836 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:27 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:27.676+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.292206+0000 front 2024-08-31T05:45:29.292344+0000 (oldest deadline 2024-08-31T05:45:52.792211+0000) 2024-08-31T05:46:27.836 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:27 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:27.676+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:37.393671+0000 front 2024-08-31T05:45:37.393649+0000 (oldest deadline 2024-08-31T05:46:03.293761+0000) 2024-08-31T05:46:27.836 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:27 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:27.676+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:43.294394+0000 front 2024-08-31T05:45:43.294212+0000 (oldest deadline 2024-08-31T05:46:09.194267+0000) 2024-08-31T05:46:27.837 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:27 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:27.676+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.895473+0000 front 2024-08-31T05:45:53.895591+0000 (oldest deadline 2024-08-31T05:46:16.795411+0000) 2024-08-31T05:46:27.837 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:27 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8[41820]: 2024-08-31T05:46:27.676+0000 7f1af33c0640 -1 osd.8 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:02.298670+0000 front 2024-08-31T05:46:02.298703+0000 (oldest deadline 2024-08-31T05:46:24.598836+0000) 2024-08-31T05:46:27.837 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:27 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:27.577+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:46:27.837 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:27 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:27.577+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.586285+0000 front 2024-08-31T05:45:38.586392+0000 (oldest deadline 2024-08-31T05:46:03.286480+0000) 2024-08-31T05:46:27.837 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:27 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:27.577+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:47.387728+0000 front 2024-08-31T05:45:47.387982+0000 (oldest deadline 2024-08-31T05:46:10.887839+0000) 2024-08-31T05:46:27.837 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:27 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:27.577+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:54.389119+0000 front 2024-08-31T05:45:54.389023+0000 (oldest deadline 2024-08-31T05:46:17.889175+0000) 2024-08-31T05:46:27.838 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:27 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:27.577+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.990353+0000 front 2024-08-31T05:46:01.990407+0000 (oldest deadline 2024-08-31T05:46:24.890512+0000) 2024-08-31T05:46:28.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:28 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:28.081+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.527017+0000 front 2024-08-31T05:45:22.527052+0000 (oldest deadline 2024-08-31T05:45:44.727854+0000) 2024-08-31T05:46:28.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:28 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:28.081+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.329641+0000 front 2024-08-31T05:45:29.329725+0000 (oldest deadline 2024-08-31T05:45:54.629726+0000) 2024-08-31T05:46:28.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:28 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:28.081+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.532721+0000 front 2024-08-31T05:45:38.532675+0000 (oldest deadline 2024-08-31T05:46:04.432712+0000) 2024-08-31T05:46:28.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:28 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:28.081+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:44.433114+0000 front 2024-08-31T05:45:44.433143+0000 (oldest deadline 2024-08-31T05:46:08.533275+0000) 2024-08-31T05:46:28.468 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:28 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:28.081+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.834354+0000 front 2024-08-31T05:45:53.834515+0000 (oldest deadline 2024-08-31T05:46:16.734379+0000) 2024-08-31T05:46:28.468 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:28 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:28.081+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.236650+0000 front 2024-08-31T05:46:01.236813+0000 (oldest deadline 2024-08-31T05:46:24.736780+0000) 2024-08-31T05:46:28.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:28 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:28.242+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:46:28.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:28 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:28.242+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.261294+0000 front 2024-08-31T05:45:29.261323+0000 (oldest deadline 2024-08-31T05:45:53.361431+0000) 2024-08-31T05:46:28.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:28 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:28.242+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:35.662443+0000 front 2024-08-31T05:45:35.662552+0000 (oldest deadline 2024-08-31T05:45:59.762525+0000) 2024-08-31T05:46:28.658 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:28 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:28.242+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:46.164178+0000 front 2024-08-31T05:45:46.164262+0000 (oldest deadline 2024-08-31T05:46:11.464217+0000) 2024-08-31T05:46:28.658 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:28 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:28.242+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.765112+0000 front 2024-08-31T05:45:53.765136+0000 (oldest deadline 2024-08-31T05:46:19.065248+0000) 2024-08-31T05:46:28.658 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:28 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:28.242+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.366359+0000 front 2024-08-31T05:46:01.366344+0000 (oldest deadline 2024-08-31T05:46:25.466127+0000) 2024-08-31T05:46:28.836 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:28 smithi070 podman[59471]: 2024-08-31 05:46:28.68000912 +0000 UTC m=+5.669868655 container died 56c51196fdfdd76cf329d060bd026fd22a590a68bd40d071f36f0a614322e240 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T05:46:28.836 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:28 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:28.559+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:46:28.837 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:28 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:28.559+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.586285+0000 front 2024-08-31T05:45:38.586392+0000 (oldest deadline 2024-08-31T05:46:03.286480+0000) 2024-08-31T05:46:28.837 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:28 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:28.559+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:47.387728+0000 front 2024-08-31T05:45:47.387982+0000 (oldest deadline 2024-08-31T05:46:10.887839+0000) 2024-08-31T05:46:28.837 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:28 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:28.559+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:54.389119+0000 front 2024-08-31T05:45:54.389023+0000 (oldest deadline 2024-08-31T05:46:17.889175+0000) 2024-08-31T05:46:28.837 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:28 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:28.559+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.990353+0000 front 2024-08-31T05:46:01.990407+0000 (oldest deadline 2024-08-31T05:46:24.890512+0000) 2024-08-31T05:46:29.337 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:29 smithi070 podman[59471]: 2024-08-31 05:46:29.08008442 +0000 UTC m=+6.069943941 container cleanup 56c51196fdfdd76cf329d060bd026fd22a590a68bd40d071f36f0a614322e240 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-08-31T05:46:29.338 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:29 smithi070 bash[59471]: ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8 2024-08-31T05:46:29.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:29 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:29.099+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.527017+0000 front 2024-08-31T05:45:22.527052+0000 (oldest deadline 2024-08-31T05:45:44.727854+0000) 2024-08-31T05:46:29.468 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:29 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:29.099+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.329641+0000 front 2024-08-31T05:45:29.329725+0000 (oldest deadline 2024-08-31T05:45:54.629726+0000) 2024-08-31T05:46:29.468 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:29 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:29.099+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.532721+0000 front 2024-08-31T05:45:38.532675+0000 (oldest deadline 2024-08-31T05:46:04.432712+0000) 2024-08-31T05:46:29.468 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:29 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:29.099+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:44.433114+0000 front 2024-08-31T05:45:44.433143+0000 (oldest deadline 2024-08-31T05:46:08.533275+0000) 2024-08-31T05:46:29.468 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:29 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:29.099+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.834354+0000 front 2024-08-31T05:45:53.834515+0000 (oldest deadline 2024-08-31T05:46:16.734379+0000) 2024-08-31T05:46:29.469 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:29 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:29.099+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.236650+0000 front 2024-08-31T05:46:01.236813+0000 (oldest deadline 2024-08-31T05:46:24.736780+0000) 2024-08-31T05:46:29.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:29 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:29.226+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:46:29.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:29 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:29.226+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.261294+0000 front 2024-08-31T05:45:29.261323+0000 (oldest deadline 2024-08-31T05:45:53.361431+0000) 2024-08-31T05:46:29.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:29 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:29.226+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:35.662443+0000 front 2024-08-31T05:45:35.662552+0000 (oldest deadline 2024-08-31T05:45:59.762525+0000) 2024-08-31T05:46:29.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:29 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:29.226+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:46.164178+0000 front 2024-08-31T05:45:46.164262+0000 (oldest deadline 2024-08-31T05:46:11.464217+0000) 2024-08-31T05:46:29.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:29 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:29.226+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.765112+0000 front 2024-08-31T05:45:53.765136+0000 (oldest deadline 2024-08-31T05:46:19.065248+0000) 2024-08-31T05:46:29.658 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:29 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:29.226+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.366359+0000 front 2024-08-31T05:46:01.366344+0000 (oldest deadline 2024-08-31T05:46:25.466127+0000) 2024-08-31T05:46:29.700 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:29 smithi070 podman[59488]: 2024-08-31 05:46:29.356362046 +0000 UTC m=+0.671168515 container remove 56c51196fdfdd76cf329d060bd026fd22a590a68bd40d071f36f0a614322e240 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, ceph=True, org.label-schema.build-date=20240731) 2024-08-31T05:46:29.700 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:29 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:29.582+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:46:29.700 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:29 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:29.582+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.586285+0000 front 2024-08-31T05:45:38.586392+0000 (oldest deadline 2024-08-31T05:46:03.286480+0000) 2024-08-31T05:46:29.700 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:29 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:29.582+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:47.387728+0000 front 2024-08-31T05:45:47.387982+0000 (oldest deadline 2024-08-31T05:46:10.887839+0000) 2024-08-31T05:46:29.700 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:29 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:29.582+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:54.389119+0000 front 2024-08-31T05:45:54.389023+0000 (oldest deadline 2024-08-31T05:46:17.889175+0000) 2024-08-31T05:46:29.701 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:29 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:29.582+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.990353+0000 front 2024-08-31T05:46:01.990407+0000 (oldest deadline 2024-08-31T05:46:24.890512+0000) 2024-08-31T05:46:29.960 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:29 smithi070 podman[59577]: 2024-08-31 05:46:29.601088064 +0000 UTC m=+0.015684571 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T05:46:29.961 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:29 smithi070 podman[59577]: 2024-08-31 05:46:29.706967909 +0000 UTC m=+0.121564469 container create 671a6ccaf922928ca358e0f1bf9649bb1dcc81d74f45ad9180c1642f1d2de048 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, GIT_CLEAN=True) 2024-08-31T05:46:29.961 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:29 smithi070 podman[59577]: 2024-08-31 05:46:29.959504219 +0000 UTC m=+0.374100723 container init 671a6ccaf922928ca358e0f1bf9649bb1dcc81d74f45ad9180c1642f1d2de048 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8-deactivate, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-08-31T05:46:30.336 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:29 smithi070 podman[59577]: 2024-08-31 05:46:29.963071609 +0000 UTC m=+0.377668114 container start 671a6ccaf922928ca358e0f1bf9649bb1dcc81d74f45ad9180c1642f1d2de048 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T05:46:30.337 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:30 smithi070 podman[59577]: 2024-08-31 05:46:30.071271973 +0000 UTC m=+0.485868498 container attach 671a6ccaf922928ca358e0f1bf9649bb1dcc81d74f45ad9180c1642f1d2de048 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T05:46:30.337 INFO:journalctl@ceph.osd.8.smithi070.stdout:Aug 31 05:46:30 smithi070 podman[59577]: 2024-08-31 05:46:30.157287675 +0000 UTC m=+0.571884188 container died 671a6ccaf922928ca358e0f1bf9649bb1dcc81d74f45ad9180c1642f1d2de048 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T05:46:30.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:30 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:30.109+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.527017+0000 front 2024-08-31T05:45:22.527052+0000 (oldest deadline 2024-08-31T05:45:44.727854+0000) 2024-08-31T05:46:30.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:30 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:30.109+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.329641+0000 front 2024-08-31T05:45:29.329725+0000 (oldest deadline 2024-08-31T05:45:54.629726+0000) 2024-08-31T05:46:30.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:30 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:30.109+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.532721+0000 front 2024-08-31T05:45:38.532675+0000 (oldest deadline 2024-08-31T05:46:04.432712+0000) 2024-08-31T05:46:30.468 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:30 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:30.109+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:44.433114+0000 front 2024-08-31T05:45:44.433143+0000 (oldest deadline 2024-08-31T05:46:08.533275+0000) 2024-08-31T05:46:30.468 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:30 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:30.109+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.834354+0000 front 2024-08-31T05:45:53.834515+0000 (oldest deadline 2024-08-31T05:46:16.734379+0000) 2024-08-31T05:46:30.468 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:30 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:30.109+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.236650+0000 front 2024-08-31T05:46:01.236813+0000 (oldest deadline 2024-08-31T05:46:24.736780+0000) 2024-08-31T05:46:30.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:30 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:30.237+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:46:30.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:30 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:30.237+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.261294+0000 front 2024-08-31T05:45:29.261323+0000 (oldest deadline 2024-08-31T05:45:53.361431+0000) 2024-08-31T05:46:30.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:30 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:30.237+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:35.662443+0000 front 2024-08-31T05:45:35.662552+0000 (oldest deadline 2024-08-31T05:45:59.762525+0000) 2024-08-31T05:46:30.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:30 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:30.237+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:46.164178+0000 front 2024-08-31T05:45:46.164262+0000 (oldest deadline 2024-08-31T05:46:11.464217+0000) 2024-08-31T05:46:30.658 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:30 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:30.237+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.765112+0000 front 2024-08-31T05:45:53.765136+0000 (oldest deadline 2024-08-31T05:46:19.065248+0000) 2024-08-31T05:46:30.658 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:30 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:30.237+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.366359+0000 front 2024-08-31T05:46:01.366344+0000 (oldest deadline 2024-08-31T05:46:25.466127+0000) 2024-08-31T05:46:30.823 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:30 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:30.625+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:46:30.823 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:30 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:30.625+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.586285+0000 front 2024-08-31T05:45:38.586392+0000 (oldest deadline 2024-08-31T05:46:03.286480+0000) 2024-08-31T05:46:30.823 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:30 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:30.625+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:47.387728+0000 front 2024-08-31T05:45:47.387982+0000 (oldest deadline 2024-08-31T05:46:10.887839+0000) 2024-08-31T05:46:30.823 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:30 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:30.625+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:54.389119+0000 front 2024-08-31T05:45:54.389023+0000 (oldest deadline 2024-08-31T05:46:17.889175+0000) 2024-08-31T05:46:30.823 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:30 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:30.625+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.990353+0000 front 2024-08-31T05:46:01.990407+0000 (oldest deadline 2024-08-31T05:46:24.890512+0000) 2024-08-31T05:46:30.853 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@osd.8.service' 2024-08-31T05:46:30.892 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T05:46:30.892 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-08-31T05:46:30.893 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-08-31T05:46:30.893 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-69422704-6758-11ef-bcd4-c7b262605968@osd.9 2024-08-31T05:46:31.197 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:30 smithi005 systemd[1]: Stopping Ceph osd.9 for 69422704-6758-11ef-bcd4-c7b262605968... 2024-08-31T05:46:31.197 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:31 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:31.102+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.527017+0000 front 2024-08-31T05:45:22.527052+0000 (oldest deadline 2024-08-31T05:45:44.727854+0000) 2024-08-31T05:46:31.197 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:31 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:31.102+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.329641+0000 front 2024-08-31T05:45:29.329725+0000 (oldest deadline 2024-08-31T05:45:54.629726+0000) 2024-08-31T05:46:31.197 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:31 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:31.102+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.532721+0000 front 2024-08-31T05:45:38.532675+0000 (oldest deadline 2024-08-31T05:46:04.432712+0000) 2024-08-31T05:46:31.198 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:31 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:31.102+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:44.433114+0000 front 2024-08-31T05:45:44.433143+0000 (oldest deadline 2024-08-31T05:46:08.533275+0000) 2024-08-31T05:46:31.198 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:31 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:31.102+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.834354+0000 front 2024-08-31T05:45:53.834515+0000 (oldest deadline 2024-08-31T05:46:16.734379+0000) 2024-08-31T05:46:31.198 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:31 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:31.102+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.236650+0000 front 2024-08-31T05:46:01.236813+0000 (oldest deadline 2024-08-31T05:46:24.736780+0000) 2024-08-31T05:46:31.198 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:31 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:31.191+0000 7fc443446640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T05:46:31.198 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:31 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:31.191+0000 7fc443446640 -1 osd.9 107 *** Got signal Terminated *** 2024-08-31T05:46:31.199 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:31 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:31.191+0000 7fc443446640 -1 osd.9 107 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T05:46:31.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:31 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:31.228+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:46:31.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:31 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:31.228+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.261294+0000 front 2024-08-31T05:45:29.261323+0000 (oldest deadline 2024-08-31T05:45:53.361431+0000) 2024-08-31T05:46:31.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:31 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:31.228+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:35.662443+0000 front 2024-08-31T05:45:35.662552+0000 (oldest deadline 2024-08-31T05:45:59.762525+0000) 2024-08-31T05:46:31.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:31 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:31.228+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:46.164178+0000 front 2024-08-31T05:45:46.164262+0000 (oldest deadline 2024-08-31T05:46:11.464217+0000) 2024-08-31T05:46:31.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:31 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:31.228+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.765112+0000 front 2024-08-31T05:45:53.765136+0000 (oldest deadline 2024-08-31T05:46:19.065248+0000) 2024-08-31T05:46:31.658 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:31 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:31.228+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.366359+0000 front 2024-08-31T05:46:01.366344+0000 (oldest deadline 2024-08-31T05:46:25.466127+0000) 2024-08-31T05:46:31.836 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:31 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:31.585+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:46:31.836 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:31 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:31.585+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.586285+0000 front 2024-08-31T05:45:38.586392+0000 (oldest deadline 2024-08-31T05:46:03.286480+0000) 2024-08-31T05:46:31.836 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:31 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:31.585+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:47.387728+0000 front 2024-08-31T05:45:47.387982+0000 (oldest deadline 2024-08-31T05:46:10.887839+0000) 2024-08-31T05:46:31.837 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:31 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:31.585+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:54.389119+0000 front 2024-08-31T05:45:54.389023+0000 (oldest deadline 2024-08-31T05:46:17.889175+0000) 2024-08-31T05:46:31.837 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:31 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:31.585+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.990353+0000 front 2024-08-31T05:46:01.990407+0000 (oldest deadline 2024-08-31T05:46:24.890512+0000) 2024-08-31T05:46:32.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:32 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:32.071+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.527017+0000 front 2024-08-31T05:45:22.527052+0000 (oldest deadline 2024-08-31T05:45:44.727854+0000) 2024-08-31T05:46:32.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:32 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:32.071+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.329641+0000 front 2024-08-31T05:45:29.329725+0000 (oldest deadline 2024-08-31T05:45:54.629726+0000) 2024-08-31T05:46:32.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:32 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:32.071+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.532721+0000 front 2024-08-31T05:45:38.532675+0000 (oldest deadline 2024-08-31T05:46:04.432712+0000) 2024-08-31T05:46:32.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:32 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:32.071+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:44.433114+0000 front 2024-08-31T05:45:44.433143+0000 (oldest deadline 2024-08-31T05:46:08.533275+0000) 2024-08-31T05:46:32.468 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:32 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:32.071+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.834354+0000 front 2024-08-31T05:45:53.834515+0000 (oldest deadline 2024-08-31T05:46:16.734379+0000) 2024-08-31T05:46:32.468 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:32 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:32.071+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.236650+0000 front 2024-08-31T05:46:01.236813+0000 (oldest deadline 2024-08-31T05:46:24.736780+0000) 2024-08-31T05:46:32.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:32 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:32.250+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:46:32.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:32 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:32.250+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.261294+0000 front 2024-08-31T05:45:29.261323+0000 (oldest deadline 2024-08-31T05:45:53.361431+0000) 2024-08-31T05:46:32.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:32 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:32.250+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:35.662443+0000 front 2024-08-31T05:45:35.662552+0000 (oldest deadline 2024-08-31T05:45:59.762525+0000) 2024-08-31T05:46:32.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:32 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:32.250+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:46.164178+0000 front 2024-08-31T05:45:46.164262+0000 (oldest deadline 2024-08-31T05:46:11.464217+0000) 2024-08-31T05:46:32.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:32 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:32.250+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.765112+0000 front 2024-08-31T05:45:53.765136+0000 (oldest deadline 2024-08-31T05:46:19.065248+0000) 2024-08-31T05:46:32.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:32 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:32.250+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.366359+0000 front 2024-08-31T05:46:01.366344+0000 (oldest deadline 2024-08-31T05:46:25.466127+0000) 2024-08-31T05:46:33.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:32 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:32.588+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:46:33.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:32 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:32.588+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.586285+0000 front 2024-08-31T05:45:38.586392+0000 (oldest deadline 2024-08-31T05:46:03.286480+0000) 2024-08-31T05:46:33.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:32 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:32.588+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:47.387728+0000 front 2024-08-31T05:45:47.387982+0000 (oldest deadline 2024-08-31T05:46:10.887839+0000) 2024-08-31T05:46:33.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:32 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:32.588+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:54.389119+0000 front 2024-08-31T05:45:54.389023+0000 (oldest deadline 2024-08-31T05:46:17.889175+0000) 2024-08-31T05:46:33.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:32 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:32.588+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.990353+0000 front 2024-08-31T05:46:01.990407+0000 (oldest deadline 2024-08-31T05:46:24.890512+0000) 2024-08-31T05:46:33.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:33 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:33.114+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.527017+0000 front 2024-08-31T05:45:22.527052+0000 (oldest deadline 2024-08-31T05:45:44.727854+0000) 2024-08-31T05:46:33.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:33 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:33.114+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.329641+0000 front 2024-08-31T05:45:29.329725+0000 (oldest deadline 2024-08-31T05:45:54.629726+0000) 2024-08-31T05:46:33.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:33 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:33.114+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.532721+0000 front 2024-08-31T05:45:38.532675+0000 (oldest deadline 2024-08-31T05:46:04.432712+0000) 2024-08-31T05:46:33.468 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:33 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:33.114+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:44.433114+0000 front 2024-08-31T05:45:44.433143+0000 (oldest deadline 2024-08-31T05:46:08.533275+0000) 2024-08-31T05:46:33.468 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:33 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:33.114+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.834354+0000 front 2024-08-31T05:45:53.834515+0000 (oldest deadline 2024-08-31T05:46:16.734379+0000) 2024-08-31T05:46:33.468 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:33 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:33.114+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.236650+0000 front 2024-08-31T05:46:01.236813+0000 (oldest deadline 2024-08-31T05:46:24.736780+0000) 2024-08-31T05:46:33.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:33 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:33.227+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:46:33.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:33 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:33.227+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.261294+0000 front 2024-08-31T05:45:29.261323+0000 (oldest deadline 2024-08-31T05:45:53.361431+0000) 2024-08-31T05:46:33.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:33 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:33.227+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:35.662443+0000 front 2024-08-31T05:45:35.662552+0000 (oldest deadline 2024-08-31T05:45:59.762525+0000) 2024-08-31T05:46:33.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:33 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:33.227+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:46.164178+0000 front 2024-08-31T05:45:46.164262+0000 (oldest deadline 2024-08-31T05:46:11.464217+0000) 2024-08-31T05:46:33.658 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:33 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:33.227+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.765112+0000 front 2024-08-31T05:45:53.765136+0000 (oldest deadline 2024-08-31T05:46:19.065248+0000) 2024-08-31T05:46:33.658 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:33 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:33.227+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.366359+0000 front 2024-08-31T05:46:01.366344+0000 (oldest deadline 2024-08-31T05:46:25.466127+0000) 2024-08-31T05:46:34.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:33 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:33.612+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:46:34.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:33 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:33.612+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.586285+0000 front 2024-08-31T05:45:38.586392+0000 (oldest deadline 2024-08-31T05:46:03.286480+0000) 2024-08-31T05:46:34.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:33 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:33.612+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:47.387728+0000 front 2024-08-31T05:45:47.387982+0000 (oldest deadline 2024-08-31T05:46:10.887839+0000) 2024-08-31T05:46:34.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:33 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:33.612+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:54.389119+0000 front 2024-08-31T05:45:54.389023+0000 (oldest deadline 2024-08-31T05:46:17.889175+0000) 2024-08-31T05:46:34.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:33 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:33.612+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.990353+0000 front 2024-08-31T05:46:01.990407+0000 (oldest deadline 2024-08-31T05:46:24.890512+0000) 2024-08-31T05:46:34.469 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:34 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:34.122+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.527017+0000 front 2024-08-31T05:45:22.527052+0000 (oldest deadline 2024-08-31T05:45:44.727854+0000) 2024-08-31T05:46:34.469 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:34 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:34.122+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.329641+0000 front 2024-08-31T05:45:29.329725+0000 (oldest deadline 2024-08-31T05:45:54.629726+0000) 2024-08-31T05:46:34.469 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:34 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:34.122+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.532721+0000 front 2024-08-31T05:45:38.532675+0000 (oldest deadline 2024-08-31T05:46:04.432712+0000) 2024-08-31T05:46:34.469 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:34 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:34.122+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:44.433114+0000 front 2024-08-31T05:45:44.433143+0000 (oldest deadline 2024-08-31T05:46:08.533275+0000) 2024-08-31T05:46:34.469 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:34 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:34.122+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.834354+0000 front 2024-08-31T05:45:53.834515+0000 (oldest deadline 2024-08-31T05:46:16.734379+0000) 2024-08-31T05:46:34.469 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:34 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:34.122+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.236650+0000 front 2024-08-31T05:46:01.236813+0000 (oldest deadline 2024-08-31T05:46:24.736780+0000) 2024-08-31T05:46:34.613 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:34 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:34.254+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:46:34.614 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:34 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:34.254+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.261294+0000 front 2024-08-31T05:45:29.261323+0000 (oldest deadline 2024-08-31T05:45:53.361431+0000) 2024-08-31T05:46:34.614 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:34 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:34.254+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:35.662443+0000 front 2024-08-31T05:45:35.662552+0000 (oldest deadline 2024-08-31T05:45:59.762525+0000) 2024-08-31T05:46:34.614 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:34 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:34.254+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:46.164178+0000 front 2024-08-31T05:45:46.164262+0000 (oldest deadline 2024-08-31T05:46:11.464217+0000) 2024-08-31T05:46:34.614 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:34 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:34.254+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.765112+0000 front 2024-08-31T05:45:53.765136+0000 (oldest deadline 2024-08-31T05:46:19.065248+0000) 2024-08-31T05:46:34.614 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:34 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:34.254+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.366359+0000 front 2024-08-31T05:46:01.366344+0000 (oldest deadline 2024-08-31T05:46:25.466127+0000) 2024-08-31T05:46:35.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:34 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:34.591+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:46:35.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:34 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:34.591+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.586285+0000 front 2024-08-31T05:45:38.586392+0000 (oldest deadline 2024-08-31T05:46:03.286480+0000) 2024-08-31T05:46:35.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:34 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:34.591+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:47.387728+0000 front 2024-08-31T05:45:47.387982+0000 (oldest deadline 2024-08-31T05:46:10.887839+0000) 2024-08-31T05:46:35.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:34 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:34.591+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:54.389119+0000 front 2024-08-31T05:45:54.389023+0000 (oldest deadline 2024-08-31T05:46:17.889175+0000) 2024-08-31T05:46:35.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:34 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:34.591+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.990353+0000 front 2024-08-31T05:46:01.990407+0000 (oldest deadline 2024-08-31T05:46:24.890512+0000) 2024-08-31T05:46:35.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:35 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:35.110+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.527017+0000 front 2024-08-31T05:45:22.527052+0000 (oldest deadline 2024-08-31T05:45:44.727854+0000) 2024-08-31T05:46:35.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:35 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:35.110+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.329641+0000 front 2024-08-31T05:45:29.329725+0000 (oldest deadline 2024-08-31T05:45:54.629726+0000) 2024-08-31T05:46:35.467 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:35 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:35.110+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.532721+0000 front 2024-08-31T05:45:38.532675+0000 (oldest deadline 2024-08-31T05:46:04.432712+0000) 2024-08-31T05:46:35.468 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:35 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:35.110+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:44.433114+0000 front 2024-08-31T05:45:44.433143+0000 (oldest deadline 2024-08-31T05:46:08.533275+0000) 2024-08-31T05:46:35.468 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:35 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:35.110+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.834354+0000 front 2024-08-31T05:45:53.834515+0000 (oldest deadline 2024-08-31T05:46:16.734379+0000) 2024-08-31T05:46:35.468 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:35 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:35.110+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.236650+0000 front 2024-08-31T05:46:01.236813+0000 (oldest deadline 2024-08-31T05:46:24.736780+0000) 2024-08-31T05:46:35.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:35 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:35.263+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:46:35.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:35 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:35.263+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.261294+0000 front 2024-08-31T05:45:29.261323+0000 (oldest deadline 2024-08-31T05:45:53.361431+0000) 2024-08-31T05:46:35.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:35 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:35.263+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:35.662443+0000 front 2024-08-31T05:45:35.662552+0000 (oldest deadline 2024-08-31T05:45:59.762525+0000) 2024-08-31T05:46:35.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:35 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:35.263+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:46.164178+0000 front 2024-08-31T05:45:46.164262+0000 (oldest deadline 2024-08-31T05:46:11.464217+0000) 2024-08-31T05:46:35.658 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:35 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:35.263+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.765112+0000 front 2024-08-31T05:45:53.765136+0000 (oldest deadline 2024-08-31T05:46:19.065248+0000) 2024-08-31T05:46:35.658 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:35 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:35.263+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.366359+0000 front 2024-08-31T05:46:01.366344+0000 (oldest deadline 2024-08-31T05:46:25.466127+0000) 2024-08-31T05:46:35.658 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:35 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:35.263+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-08-31T05:46:09.467545+0000 front 2024-08-31T05:46:09.467573+0000 (oldest deadline 2024-08-31T05:46:34.767525+0000) 2024-08-31T05:46:35.836 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:35 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:35.554+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:46:35.836 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:35 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:35.554+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.586285+0000 front 2024-08-31T05:45:38.586392+0000 (oldest deadline 2024-08-31T05:46:03.286480+0000) 2024-08-31T05:46:35.836 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:35 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:35.554+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:47.387728+0000 front 2024-08-31T05:45:47.387982+0000 (oldest deadline 2024-08-31T05:46:10.887839+0000) 2024-08-31T05:46:35.837 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:35 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:35.554+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:54.389119+0000 front 2024-08-31T05:45:54.389023+0000 (oldest deadline 2024-08-31T05:46:17.889175+0000) 2024-08-31T05:46:35.837 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:35 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:35.554+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.990353+0000 front 2024-08-31T05:46:01.990407+0000 (oldest deadline 2024-08-31T05:46:24.890512+0000) 2024-08-31T05:46:36.369 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:36 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:36.102+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.527017+0000 front 2024-08-31T05:45:22.527052+0000 (oldest deadline 2024-08-31T05:45:44.727854+0000) 2024-08-31T05:46:36.369 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:36 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:36.102+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.329641+0000 front 2024-08-31T05:45:29.329725+0000 (oldest deadline 2024-08-31T05:45:54.629726+0000) 2024-08-31T05:46:36.369 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:36 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:36.102+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.532721+0000 front 2024-08-31T05:45:38.532675+0000 (oldest deadline 2024-08-31T05:46:04.432712+0000) 2024-08-31T05:46:36.369 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:36 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:36.102+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:44.433114+0000 front 2024-08-31T05:45:44.433143+0000 (oldest deadline 2024-08-31T05:46:08.533275+0000) 2024-08-31T05:46:36.369 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:36 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:36.102+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.834354+0000 front 2024-08-31T05:45:53.834515+0000 (oldest deadline 2024-08-31T05:46:16.734379+0000) 2024-08-31T05:46:36.369 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:36 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9[54086]: 2024-08-31T05:46:36.102+0000 7fc43ba29640 -1 osd.9 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.236650+0000 front 2024-08-31T05:46:01.236813+0000 (oldest deadline 2024-08-31T05:46:24.736780+0000) 2024-08-31T05:46:36.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:36 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:36.243+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:46:36.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:36 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:36.243+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.261294+0000 front 2024-08-31T05:45:29.261323+0000 (oldest deadline 2024-08-31T05:45:53.361431+0000) 2024-08-31T05:46:36.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:36 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:36.243+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:35.662443+0000 front 2024-08-31T05:45:35.662552+0000 (oldest deadline 2024-08-31T05:45:59.762525+0000) 2024-08-31T05:46:36.658 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:36 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:36.243+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:46.164178+0000 front 2024-08-31T05:45:46.164262+0000 (oldest deadline 2024-08-31T05:46:11.464217+0000) 2024-08-31T05:46:36.658 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:36 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:36.243+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.765112+0000 front 2024-08-31T05:45:53.765136+0000 (oldest deadline 2024-08-31T05:46:19.065248+0000) 2024-08-31T05:46:36.658 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:36 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:36.243+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.366359+0000 front 2024-08-31T05:46:01.366344+0000 (oldest deadline 2024-08-31T05:46:25.466127+0000) 2024-08-31T05:46:36.658 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:36 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:36.243+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-08-31T05:46:09.467545+0000 front 2024-08-31T05:46:09.467573+0000 (oldest deadline 2024-08-31T05:46:34.767525+0000) 2024-08-31T05:46:36.836 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:36 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:36.566+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:46:36.836 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:36 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:36.566+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.586285+0000 front 2024-08-31T05:45:38.586392+0000 (oldest deadline 2024-08-31T05:46:03.286480+0000) 2024-08-31T05:46:36.836 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:36 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:36.566+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:47.387728+0000 front 2024-08-31T05:45:47.387982+0000 (oldest deadline 2024-08-31T05:46:10.887839+0000) 2024-08-31T05:46:36.837 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:36 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:36.566+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:54.389119+0000 front 2024-08-31T05:45:54.389023+0000 (oldest deadline 2024-08-31T05:46:17.889175+0000) 2024-08-31T05:46:36.837 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:36 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:36.566+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.990353+0000 front 2024-08-31T05:46:01.990407+0000 (oldest deadline 2024-08-31T05:46:24.890512+0000) 2024-08-31T05:46:36.837 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:36 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:36.566+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-08-31T05:46:10.191495+0000 front 2024-08-31T05:46:10.191474+0000 (oldest deadline 2024-08-31T05:46:36.091468+0000) 2024-08-31T05:46:36.927 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:36 smithi005 podman[106285]: 2024-08-31 05:46:36.627970079 +0000 UTC m=+5.541280971 container died bf4fdfcd94193519af36541012ebe35ba3c231d6024bb9d7c756963e6595f30f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-08-31T05:46:37.217 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:37 smithi005 podman[106285]: 2024-08-31 05:46:37.024608139 +0000 UTC m=+5.937919027 container cleanup bf4fdfcd94193519af36541012ebe35ba3c231d6024bb9d7c756963e6595f30f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-08-31T05:46:37.217 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:37 smithi005 bash[106285]: ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9 2024-08-31T05:46:37.601 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:37 smithi005 podman[106304]: 2024-08-31 05:46:37.251011896 +0000 UTC m=+0.626059558 container remove bf4fdfcd94193519af36541012ebe35ba3c231d6024bb9d7c756963e6595f30f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T05:46:37.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:37 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:37.251+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:46:37.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:37 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:37.251+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.261294+0000 front 2024-08-31T05:45:29.261323+0000 (oldest deadline 2024-08-31T05:45:53.361431+0000) 2024-08-31T05:46:37.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:37 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:37.251+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:35.662443+0000 front 2024-08-31T05:45:35.662552+0000 (oldest deadline 2024-08-31T05:45:59.762525+0000) 2024-08-31T05:46:37.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:37 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:37.251+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:46.164178+0000 front 2024-08-31T05:45:46.164262+0000 (oldest deadline 2024-08-31T05:46:11.464217+0000) 2024-08-31T05:46:37.658 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:37 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:37.251+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.765112+0000 front 2024-08-31T05:45:53.765136+0000 (oldest deadline 2024-08-31T05:46:19.065248+0000) 2024-08-31T05:46:37.658 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:37 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:37.251+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.366359+0000 front 2024-08-31T05:46:01.366344+0000 (oldest deadline 2024-08-31T05:46:25.466127+0000) 2024-08-31T05:46:37.658 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:37 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:37.251+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-08-31T05:46:09.467545+0000 front 2024-08-31T05:46:09.467573+0000 (oldest deadline 2024-08-31T05:46:34.767525+0000) 2024-08-31T05:46:37.897 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:37 smithi005 podman[106400]: 2024-08-31 05:46:37.502939165 +0000 UTC m=+0.016050874 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T05:46:37.897 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:37 smithi005 podman[106400]: 2024-08-31 05:46:37.6018497 +0000 UTC m=+0.114961395 container create 74130ae66809679b8a5cf3e0d8bc46b7f312ac7d326c8a7c18adabe8c9b7803a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-08-31T05:46:37.898 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:37 smithi005 podman[106400]: 2024-08-31 05:46:37.81301948 +0000 UTC m=+0.326131195 container init 74130ae66809679b8a5cf3e0d8bc46b7f312ac7d326c8a7c18adabe8c9b7803a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-08-31T05:46:37.898 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:37 smithi005 podman[106400]: 2024-08-31 05:46:37.816371901 +0000 UTC m=+0.329483610 container start 74130ae66809679b8a5cf3e0d8bc46b7f312ac7d326c8a7c18adabe8c9b7803a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.1) 2024-08-31T05:46:37.898 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:37 smithi005 podman[106400]: 2024-08-31 05:46:37.896143172 +0000 UTC m=+0.409254877 container attach 74130ae66809679b8a5cf3e0d8bc46b7f312ac7d326c8a7c18adabe8c9b7803a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux ) 2024-08-31T05:46:38.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:37 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:37.614+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:46:38.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:37 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:37.614+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.586285+0000 front 2024-08-31T05:45:38.586392+0000 (oldest deadline 2024-08-31T05:46:03.286480+0000) 2024-08-31T05:46:38.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:37 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:37.614+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:47.387728+0000 front 2024-08-31T05:45:47.387982+0000 (oldest deadline 2024-08-31T05:46:10.887839+0000) 2024-08-31T05:46:38.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:37 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:37.614+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:54.389119+0000 front 2024-08-31T05:45:54.389023+0000 (oldest deadline 2024-08-31T05:46:17.889175+0000) 2024-08-31T05:46:38.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:37 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:37.614+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.990353+0000 front 2024-08-31T05:46:01.990407+0000 (oldest deadline 2024-08-31T05:46:24.890512+0000) 2024-08-31T05:46:38.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:37 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:37.614+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-08-31T05:46:10.191495+0000 front 2024-08-31T05:46:10.191474+0000 (oldest deadline 2024-08-31T05:46:36.091468+0000) 2024-08-31T05:46:38.155 INFO:journalctl@ceph.osd.9.smithi005.stdout:Aug 31 05:46:38 smithi005 podman[106400]: 2024-08-31 05:46:38.012162738 +0000 UTC m=+0.525274456 container died 74130ae66809679b8a5cf3e0d8bc46b7f312ac7d326c8a7c18adabe8c9b7803a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-9-deactivate, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T05:46:38.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:38 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:38.271+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:46:38.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:38 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:38.271+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.261294+0000 front 2024-08-31T05:45:29.261323+0000 (oldest deadline 2024-08-31T05:45:53.361431+0000) 2024-08-31T05:46:38.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:38 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:38.271+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:35.662443+0000 front 2024-08-31T05:45:35.662552+0000 (oldest deadline 2024-08-31T05:45:59.762525+0000) 2024-08-31T05:46:38.658 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:38 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:38.271+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:46.164178+0000 front 2024-08-31T05:45:46.164262+0000 (oldest deadline 2024-08-31T05:46:11.464217+0000) 2024-08-31T05:46:38.658 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:38 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:38.271+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.765112+0000 front 2024-08-31T05:45:53.765136+0000 (oldest deadline 2024-08-31T05:46:19.065248+0000) 2024-08-31T05:46:38.658 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:38 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:38.271+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.366359+0000 front 2024-08-31T05:46:01.366344+0000 (oldest deadline 2024-08-31T05:46:25.466127+0000) 2024-08-31T05:46:38.658 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:38 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:38.271+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-08-31T05:46:09.467545+0000 front 2024-08-31T05:46:09.467573+0000 (oldest deadline 2024-08-31T05:46:34.767525+0000) 2024-08-31T05:46:38.727 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@osd.9.service' 2024-08-31T05:46:38.766 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T05:46:38.766 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-08-31T05:46:38.766 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-08-31T05:46:38.766 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-69422704-6758-11ef-bcd4-c7b262605968@osd.10 2024-08-31T05:46:39.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:38 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:38.640+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:46:39.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:38 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:38.640+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.586285+0000 front 2024-08-31T05:45:38.586392+0000 (oldest deadline 2024-08-31T05:46:03.286480+0000) 2024-08-31T05:46:39.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:38 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:38.640+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:47.387728+0000 front 2024-08-31T05:45:47.387982+0000 (oldest deadline 2024-08-31T05:46:10.887839+0000) 2024-08-31T05:46:39.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:38 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:38.640+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:54.389119+0000 front 2024-08-31T05:45:54.389023+0000 (oldest deadline 2024-08-31T05:46:17.889175+0000) 2024-08-31T05:46:39.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:38 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:38.640+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.990353+0000 front 2024-08-31T05:46:01.990407+0000 (oldest deadline 2024-08-31T05:46:24.890512+0000) 2024-08-31T05:46:39.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:38 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:38.640+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-08-31T05:46:10.191495+0000 front 2024-08-31T05:46:10.191474+0000 (oldest deadline 2024-08-31T05:46:36.091468+0000) 2024-08-31T05:46:39.093 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:38 smithi050 systemd[1]: Stopping Ceph osd.10 for 69422704-6758-11ef-bcd4-c7b262605968... 2024-08-31T05:46:39.407 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:39 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:39.091+0000 7f84a514e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T05:46:39.407 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:39 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:39.091+0000 7f84a514e640 -1 osd.10 107 *** Got signal Terminated *** 2024-08-31T05:46:39.407 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:39 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:39.091+0000 7f84a514e640 -1 osd.10 107 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T05:46:39.407 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:39 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:39.259+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:46:39.408 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:39 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:39.259+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.261294+0000 front 2024-08-31T05:45:29.261323+0000 (oldest deadline 2024-08-31T05:45:53.361431+0000) 2024-08-31T05:46:39.408 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:39 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:39.259+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:35.662443+0000 front 2024-08-31T05:45:35.662552+0000 (oldest deadline 2024-08-31T05:45:59.762525+0000) 2024-08-31T05:46:39.408 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:39 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:39.259+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:46.164178+0000 front 2024-08-31T05:45:46.164262+0000 (oldest deadline 2024-08-31T05:46:11.464217+0000) 2024-08-31T05:46:39.408 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:39 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:39.259+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.765112+0000 front 2024-08-31T05:45:53.765136+0000 (oldest deadline 2024-08-31T05:46:19.065248+0000) 2024-08-31T05:46:39.408 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:39 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:39.259+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.366359+0000 front 2024-08-31T05:46:01.366344+0000 (oldest deadline 2024-08-31T05:46:25.466127+0000) 2024-08-31T05:46:39.408 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:39 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:39.259+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-08-31T05:46:09.467545+0000 front 2024-08-31T05:46:09.467573+0000 (oldest deadline 2024-08-31T05:46:34.767525+0000) 2024-08-31T05:46:40.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:39 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:39.655+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:46:40.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:39 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:39.655+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.586285+0000 front 2024-08-31T05:45:38.586392+0000 (oldest deadline 2024-08-31T05:46:03.286480+0000) 2024-08-31T05:46:40.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:39 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:39.655+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:47.387728+0000 front 2024-08-31T05:45:47.387982+0000 (oldest deadline 2024-08-31T05:46:10.887839+0000) 2024-08-31T05:46:40.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:39 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:39.655+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:54.389119+0000 front 2024-08-31T05:45:54.389023+0000 (oldest deadline 2024-08-31T05:46:17.889175+0000) 2024-08-31T05:46:40.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:39 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:39.655+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.990353+0000 front 2024-08-31T05:46:01.990407+0000 (oldest deadline 2024-08-31T05:46:24.890512+0000) 2024-08-31T05:46:40.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:39 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:39.655+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-08-31T05:46:10.191495+0000 front 2024-08-31T05:46:10.191474+0000 (oldest deadline 2024-08-31T05:46:36.091468+0000) 2024-08-31T05:46:40.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:40 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:40.248+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:46:40.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:40 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:40.248+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.261294+0000 front 2024-08-31T05:45:29.261323+0000 (oldest deadline 2024-08-31T05:45:53.361431+0000) 2024-08-31T05:46:40.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:40 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:40.248+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:35.662443+0000 front 2024-08-31T05:45:35.662552+0000 (oldest deadline 2024-08-31T05:45:59.762525+0000) 2024-08-31T05:46:40.658 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:40 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:40.248+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:46.164178+0000 front 2024-08-31T05:45:46.164262+0000 (oldest deadline 2024-08-31T05:46:11.464217+0000) 2024-08-31T05:46:40.658 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:40 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:40.248+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.765112+0000 front 2024-08-31T05:45:53.765136+0000 (oldest deadline 2024-08-31T05:46:19.065248+0000) 2024-08-31T05:46:40.658 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:40 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:40.248+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.366359+0000 front 2024-08-31T05:46:01.366344+0000 (oldest deadline 2024-08-31T05:46:25.466127+0000) 2024-08-31T05:46:40.658 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:40 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:40.248+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-08-31T05:46:09.467545+0000 front 2024-08-31T05:46:09.467573+0000 (oldest deadline 2024-08-31T05:46:34.767525+0000) 2024-08-31T05:46:41.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:40 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:40.688+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:46:41.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:40 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:40.688+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.586285+0000 front 2024-08-31T05:45:38.586392+0000 (oldest deadline 2024-08-31T05:46:03.286480+0000) 2024-08-31T05:46:41.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:40 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:40.688+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:47.387728+0000 front 2024-08-31T05:45:47.387982+0000 (oldest deadline 2024-08-31T05:46:10.887839+0000) 2024-08-31T05:46:41.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:40 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:40.688+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:54.389119+0000 front 2024-08-31T05:45:54.389023+0000 (oldest deadline 2024-08-31T05:46:17.889175+0000) 2024-08-31T05:46:41.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:40 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:40.688+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.990353+0000 front 2024-08-31T05:46:01.990407+0000 (oldest deadline 2024-08-31T05:46:24.890512+0000) 2024-08-31T05:46:41.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:40 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:40.688+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-08-31T05:46:10.191495+0000 front 2024-08-31T05:46:10.191474+0000 (oldest deadline 2024-08-31T05:46:36.091468+0000) 2024-08-31T05:46:41.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:41 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:41.265+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:46:41.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:41 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:41.265+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.261294+0000 front 2024-08-31T05:45:29.261323+0000 (oldest deadline 2024-08-31T05:45:53.361431+0000) 2024-08-31T05:46:41.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:41 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:41.265+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:35.662443+0000 front 2024-08-31T05:45:35.662552+0000 (oldest deadline 2024-08-31T05:45:59.762525+0000) 2024-08-31T05:46:41.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:41 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:41.265+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:46.164178+0000 front 2024-08-31T05:45:46.164262+0000 (oldest deadline 2024-08-31T05:46:11.464217+0000) 2024-08-31T05:46:41.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:41 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:41.265+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.765112+0000 front 2024-08-31T05:45:53.765136+0000 (oldest deadline 2024-08-31T05:46:19.065248+0000) 2024-08-31T05:46:41.658 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:41 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:41.265+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.366359+0000 front 2024-08-31T05:46:01.366344+0000 (oldest deadline 2024-08-31T05:46:25.466127+0000) 2024-08-31T05:46:41.658 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:41 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:41.265+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-08-31T05:46:09.467545+0000 front 2024-08-31T05:46:09.467573+0000 (oldest deadline 2024-08-31T05:46:34.767525+0000) 2024-08-31T05:46:41.836 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:41 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:41.662+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:46:41.836 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:41 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:41.662+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.586285+0000 front 2024-08-31T05:45:38.586392+0000 (oldest deadline 2024-08-31T05:46:03.286480+0000) 2024-08-31T05:46:41.837 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:41 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:41.662+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:47.387728+0000 front 2024-08-31T05:45:47.387982+0000 (oldest deadline 2024-08-31T05:46:10.887839+0000) 2024-08-31T05:46:41.837 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:41 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:41.662+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:54.389119+0000 front 2024-08-31T05:45:54.389023+0000 (oldest deadline 2024-08-31T05:46:17.889175+0000) 2024-08-31T05:46:41.837 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:41 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:41.662+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.990353+0000 front 2024-08-31T05:46:01.990407+0000 (oldest deadline 2024-08-31T05:46:24.890512+0000) 2024-08-31T05:46:41.837 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:41 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:41.662+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-08-31T05:46:10.191495+0000 front 2024-08-31T05:46:10.191474+0000 (oldest deadline 2024-08-31T05:46:36.091468+0000) 2024-08-31T05:46:42.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:42 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:42.256+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:46:42.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:42 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:42.256+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.261294+0000 front 2024-08-31T05:45:29.261323+0000 (oldest deadline 2024-08-31T05:45:53.361431+0000) 2024-08-31T05:46:42.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:42 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:42.256+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:35.662443+0000 front 2024-08-31T05:45:35.662552+0000 (oldest deadline 2024-08-31T05:45:59.762525+0000) 2024-08-31T05:46:42.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:42 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:42.256+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:46.164178+0000 front 2024-08-31T05:45:46.164262+0000 (oldest deadline 2024-08-31T05:46:11.464217+0000) 2024-08-31T05:46:42.658 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:42 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:42.256+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.765112+0000 front 2024-08-31T05:45:53.765136+0000 (oldest deadline 2024-08-31T05:46:19.065248+0000) 2024-08-31T05:46:42.658 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:42 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:42.256+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.366359+0000 front 2024-08-31T05:46:01.366344+0000 (oldest deadline 2024-08-31T05:46:25.466127+0000) 2024-08-31T05:46:42.658 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:42 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:42.256+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-08-31T05:46:09.467545+0000 front 2024-08-31T05:46:09.467573+0000 (oldest deadline 2024-08-31T05:46:34.767525+0000) 2024-08-31T05:46:43.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:42 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:42.710+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:46:43.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:42 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:42.710+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.586285+0000 front 2024-08-31T05:45:38.586392+0000 (oldest deadline 2024-08-31T05:46:03.286480+0000) 2024-08-31T05:46:43.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:42 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:42.710+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:47.387728+0000 front 2024-08-31T05:45:47.387982+0000 (oldest deadline 2024-08-31T05:46:10.887839+0000) 2024-08-31T05:46:43.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:42 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:42.710+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:54.389119+0000 front 2024-08-31T05:45:54.389023+0000 (oldest deadline 2024-08-31T05:46:17.889175+0000) 2024-08-31T05:46:43.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:42 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:42.710+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.990353+0000 front 2024-08-31T05:46:01.990407+0000 (oldest deadline 2024-08-31T05:46:24.890512+0000) 2024-08-31T05:46:43.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:42 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:42.710+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-08-31T05:46:10.191495+0000 front 2024-08-31T05:46:10.191474+0000 (oldest deadline 2024-08-31T05:46:36.091468+0000) 2024-08-31T05:46:43.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:43 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:43.269+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:22.960077+0000 front 2024-08-31T05:45:22.959840+0000 (oldest deadline 2024-08-31T05:45:45.259926+0000) 2024-08-31T05:46:43.657 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:43 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:43.269+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6804 osd.1 since back 2024-08-31T05:45:29.261294+0000 front 2024-08-31T05:45:29.261323+0000 (oldest deadline 2024-08-31T05:45:53.361431+0000) 2024-08-31T05:46:43.658 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:43 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:43.269+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:35.662443+0000 front 2024-08-31T05:45:35.662552+0000 (oldest deadline 2024-08-31T05:45:59.762525+0000) 2024-08-31T05:46:43.658 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:43 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:43.269+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:46.164178+0000 front 2024-08-31T05:45:46.164262+0000 (oldest deadline 2024-08-31T05:46:11.464217+0000) 2024-08-31T05:46:43.658 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:43 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:43.269+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:53.765112+0000 front 2024-08-31T05:45:53.765136+0000 (oldest deadline 2024-08-31T05:46:19.065248+0000) 2024-08-31T05:46:43.658 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:43 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:43.269+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.366359+0000 front 2024-08-31T05:46:01.366344+0000 (oldest deadline 2024-08-31T05:46:25.466127+0000) 2024-08-31T05:46:43.658 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:43 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10[47932]: 2024-08-31T05:46:43.269+0000 7f849d731640 -1 osd.10 107 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-08-31T05:46:09.467545+0000 front 2024-08-31T05:46:09.467573+0000 (oldest deadline 2024-08-31T05:46:34.767525+0000) 2024-08-31T05:46:44.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:43 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:43.729+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:46:44.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:43 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:43.729+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.586285+0000 front 2024-08-31T05:45:38.586392+0000 (oldest deadline 2024-08-31T05:46:03.286480+0000) 2024-08-31T05:46:44.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:43 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:43.729+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:47.387728+0000 front 2024-08-31T05:45:47.387982+0000 (oldest deadline 2024-08-31T05:46:10.887839+0000) 2024-08-31T05:46:44.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:43 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:43.729+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:54.389119+0000 front 2024-08-31T05:45:54.389023+0000 (oldest deadline 2024-08-31T05:46:17.889175+0000) 2024-08-31T05:46:44.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:43 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:43.729+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.990353+0000 front 2024-08-31T05:46:01.990407+0000 (oldest deadline 2024-08-31T05:46:24.890512+0000) 2024-08-31T05:46:44.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:43 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:43.729+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-08-31T05:46:10.191495+0000 front 2024-08-31T05:46:10.191474+0000 (oldest deadline 2024-08-31T05:46:36.091468+0000) 2024-08-31T05:46:44.970 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:44 smithi050 podman[60447]: 2024-08-31 05:46:44.677793048 +0000 UTC m=+5.709196564 container died d873c919450a9eebffd74165a4f530300dc085e39e9a76ee58825b9054ebb701 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-08-31T05:46:45.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:44 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:44.748+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:46:45.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:44 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:44.748+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.586285+0000 front 2024-08-31T05:45:38.586392+0000 (oldest deadline 2024-08-31T05:46:03.286480+0000) 2024-08-31T05:46:45.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:44 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:44.748+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:47.387728+0000 front 2024-08-31T05:45:47.387982+0000 (oldest deadline 2024-08-31T05:46:10.887839+0000) 2024-08-31T05:46:45.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:44 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:44.748+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:54.389119+0000 front 2024-08-31T05:45:54.389023+0000 (oldest deadline 2024-08-31T05:46:17.889175+0000) 2024-08-31T05:46:45.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:44 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:44.748+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.990353+0000 front 2024-08-31T05:46:01.990407+0000 (oldest deadline 2024-08-31T05:46:24.890512+0000) 2024-08-31T05:46:45.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:44 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:44.748+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-08-31T05:46:10.191495+0000 front 2024-08-31T05:46:10.191474+0000 (oldest deadline 2024-08-31T05:46:36.091468+0000) 2024-08-31T05:46:45.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:44 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:44.748+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.50:6820 osd.7 since back 2024-08-31T05:46:18.392552+0000 front 2024-08-31T05:46:18.392629+0000 (oldest deadline 2024-08-31T05:46:44.192781+0000) 2024-08-31T05:46:45.311 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:45 smithi050 podman[60447]: 2024-08-31 05:46:45.074911156 +0000 UTC m=+6.106314661 container cleanup d873c919450a9eebffd74165a4f530300dc085e39e9a76ee58825b9054ebb701 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux ) 2024-08-31T05:46:45.311 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:45 smithi050 bash[60447]: ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10 2024-08-31T05:46:45.635 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:45 smithi050 podman[60462]: 2024-08-31 05:46:45.309819604 +0000 UTC m=+0.621267909 container remove d873c919450a9eebffd74165a4f530300dc085e39e9a76ee58825b9054ebb701 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T05:46:45.907 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:45 smithi050 podman[60552]: 2024-08-31 05:46:45.536907256 +0000 UTC m=+0.016465480 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T05:46:45.907 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:45 smithi050 podman[60552]: 2024-08-31 05:46:45.635408967 +0000 UTC m=+0.114967175 container create 04956aac6ffe1002386ab30bd3fcb637362388b50171270020a24c7b9b02b764 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-08-31T05:46:45.907 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:45 smithi050 podman[60552]: 2024-08-31 05:46:45.862949611 +0000 UTC m=+0.342507817 container init 04956aac6ffe1002386ab30bd3fcb637362388b50171270020a24c7b9b02b764 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T05:46:45.908 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:45 smithi050 podman[60552]: 2024-08-31 05:46:45.86625674 +0000 UTC m=+0.345814948 container start 04956aac6ffe1002386ab30bd3fcb637362388b50171270020a24c7b9b02b764 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T05:46:46.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:45 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:45.761+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:46:46.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:45 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:45.761+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.586285+0000 front 2024-08-31T05:45:38.586392+0000 (oldest deadline 2024-08-31T05:46:03.286480+0000) 2024-08-31T05:46:46.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:45 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:45.761+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:47.387728+0000 front 2024-08-31T05:45:47.387982+0000 (oldest deadline 2024-08-31T05:46:10.887839+0000) 2024-08-31T05:46:46.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:45 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:45.761+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:54.389119+0000 front 2024-08-31T05:45:54.389023+0000 (oldest deadline 2024-08-31T05:46:17.889175+0000) 2024-08-31T05:46:46.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:45 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:45.761+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.990353+0000 front 2024-08-31T05:46:01.990407+0000 (oldest deadline 2024-08-31T05:46:24.890512+0000) 2024-08-31T05:46:46.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:45 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:45.761+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-08-31T05:46:10.191495+0000 front 2024-08-31T05:46:10.191474+0000 (oldest deadline 2024-08-31T05:46:36.091468+0000) 2024-08-31T05:46:46.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:45 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:45.761+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.50:6820 osd.7 since back 2024-08-31T05:46:18.392552+0000 front 2024-08-31T05:46:18.392629+0000 (oldest deadline 2024-08-31T05:46:44.192781+0000) 2024-08-31T05:46:46.359 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:45 smithi050 podman[60552]: 2024-08-31 05:46:45.954632619 +0000 UTC m=+0.434190855 container attach 04956aac6ffe1002386ab30bd3fcb637362388b50171270020a24c7b9b02b764 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-08-31T05:46:46.359 INFO:journalctl@ceph.osd.10.smithi050.stdout:Aug 31 05:46:46 smithi050 podman[60552]: 2024-08-31 05:46:46.069731166 +0000 UTC m=+0.549289384 container died 04956aac6ffe1002386ab30bd3fcb637362388b50171270020a24c7b9b02b764 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T05:46:46.644 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@osd.10.service' 2024-08-31T05:46:46.687 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T05:46:46.688 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-08-31T05:46:46.688 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-08-31T05:46:46.688 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-69422704-6758-11ef-bcd4-c7b262605968@osd.11 2024-08-31T05:46:46.983 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:46 smithi070 systemd[1]: Stopping Ceph osd.11 for 69422704-6758-11ef-bcd4-c7b262605968... 2024-08-31T05:46:46.983 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:46 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:46.750+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:46:46.984 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:46 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:46.750+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.586285+0000 front 2024-08-31T05:45:38.586392+0000 (oldest deadline 2024-08-31T05:46:03.286480+0000) 2024-08-31T05:46:46.984 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:46 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:46.750+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:47.387728+0000 front 2024-08-31T05:45:47.387982+0000 (oldest deadline 2024-08-31T05:46:10.887839+0000) 2024-08-31T05:46:46.984 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:46 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:46.750+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:54.389119+0000 front 2024-08-31T05:45:54.389023+0000 (oldest deadline 2024-08-31T05:46:17.889175+0000) 2024-08-31T05:46:46.984 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:46 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:46.750+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.990353+0000 front 2024-08-31T05:46:01.990407+0000 (oldest deadline 2024-08-31T05:46:24.890512+0000) 2024-08-31T05:46:46.984 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:46 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:46.750+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-08-31T05:46:10.191495+0000 front 2024-08-31T05:46:10.191474+0000 (oldest deadline 2024-08-31T05:46:36.091468+0000) 2024-08-31T05:46:46.984 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:46 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:46.750+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.50:6820 osd.7 since back 2024-08-31T05:46:18.392552+0000 front 2024-08-31T05:46:18.392629+0000 (oldest deadline 2024-08-31T05:46:44.192781+0000) 2024-08-31T05:46:47.336 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:46 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:46.980+0000 7f32e4ad7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T05:46:47.336 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:46 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:46.980+0000 7f32e4ad7640 -1 osd.11 107 *** Got signal Terminated *** 2024-08-31T05:46:47.336 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:46 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:46.980+0000 7f32e4ad7640 -1 osd.11 107 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T05:46:48.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:47 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:47.797+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:46:48.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:47 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:47.797+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.586285+0000 front 2024-08-31T05:45:38.586392+0000 (oldest deadline 2024-08-31T05:46:03.286480+0000) 2024-08-31T05:46:48.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:47 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:47.797+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:47.387728+0000 front 2024-08-31T05:45:47.387982+0000 (oldest deadline 2024-08-31T05:46:10.887839+0000) 2024-08-31T05:46:48.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:47 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:47.797+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:54.389119+0000 front 2024-08-31T05:45:54.389023+0000 (oldest deadline 2024-08-31T05:46:17.889175+0000) 2024-08-31T05:46:48.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:47 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:47.797+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.990353+0000 front 2024-08-31T05:46:01.990407+0000 (oldest deadline 2024-08-31T05:46:24.890512+0000) 2024-08-31T05:46:48.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:47 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:47.797+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-08-31T05:46:10.191495+0000 front 2024-08-31T05:46:10.191474+0000 (oldest deadline 2024-08-31T05:46:36.091468+0000) 2024-08-31T05:46:48.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:47 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:47.797+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.50:6820 osd.7 since back 2024-08-31T05:46:18.392552+0000 front 2024-08-31T05:46:18.392629+0000 (oldest deadline 2024-08-31T05:46:44.192781+0000) 2024-08-31T05:46:49.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:48 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:48.817+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:46:49.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:48 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:48.817+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.586285+0000 front 2024-08-31T05:45:38.586392+0000 (oldest deadline 2024-08-31T05:46:03.286480+0000) 2024-08-31T05:46:49.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:48 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:48.817+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:47.387728+0000 front 2024-08-31T05:45:47.387982+0000 (oldest deadline 2024-08-31T05:46:10.887839+0000) 2024-08-31T05:46:49.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:48 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:48.817+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:54.389119+0000 front 2024-08-31T05:45:54.389023+0000 (oldest deadline 2024-08-31T05:46:17.889175+0000) 2024-08-31T05:46:49.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:48 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:48.817+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.990353+0000 front 2024-08-31T05:46:01.990407+0000 (oldest deadline 2024-08-31T05:46:24.890512+0000) 2024-08-31T05:46:49.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:48 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:48.817+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-08-31T05:46:10.191495+0000 front 2024-08-31T05:46:10.191474+0000 (oldest deadline 2024-08-31T05:46:36.091468+0000) 2024-08-31T05:46:49.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:48 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:48.817+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.50:6820 osd.7 since back 2024-08-31T05:46:18.392552+0000 front 2024-08-31T05:46:18.392629+0000 (oldest deadline 2024-08-31T05:46:44.192781+0000) 2024-08-31T05:46:50.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:49 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:49.826+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:46:50.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:49 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:49.826+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.586285+0000 front 2024-08-31T05:45:38.586392+0000 (oldest deadline 2024-08-31T05:46:03.286480+0000) 2024-08-31T05:46:50.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:49 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:49.826+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:47.387728+0000 front 2024-08-31T05:45:47.387982+0000 (oldest deadline 2024-08-31T05:46:10.887839+0000) 2024-08-31T05:46:50.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:49 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:49.826+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:54.389119+0000 front 2024-08-31T05:45:54.389023+0000 (oldest deadline 2024-08-31T05:46:17.889175+0000) 2024-08-31T05:46:50.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:49 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:49.826+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.990353+0000 front 2024-08-31T05:46:01.990407+0000 (oldest deadline 2024-08-31T05:46:24.890512+0000) 2024-08-31T05:46:50.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:49 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:49.826+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-08-31T05:46:10.191495+0000 front 2024-08-31T05:46:10.191474+0000 (oldest deadline 2024-08-31T05:46:36.091468+0000) 2024-08-31T05:46:50.087 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:49 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:49.826+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.50:6820 osd.7 since back 2024-08-31T05:46:18.392552+0000 front 2024-08-31T05:46:18.392629+0000 (oldest deadline 2024-08-31T05:46:44.192781+0000) 2024-08-31T05:46:51.336 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:50 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:50.869+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:46:51.336 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:50 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:50.869+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.586285+0000 front 2024-08-31T05:45:38.586392+0000 (oldest deadline 2024-08-31T05:46:03.286480+0000) 2024-08-31T05:46:51.336 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:50 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:50.869+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:47.387728+0000 front 2024-08-31T05:45:47.387982+0000 (oldest deadline 2024-08-31T05:46:10.887839+0000) 2024-08-31T05:46:51.337 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:50 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:50.869+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:54.389119+0000 front 2024-08-31T05:45:54.389023+0000 (oldest deadline 2024-08-31T05:46:17.889175+0000) 2024-08-31T05:46:51.337 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:50 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:50.869+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.990353+0000 front 2024-08-31T05:46:01.990407+0000 (oldest deadline 2024-08-31T05:46:24.890512+0000) 2024-08-31T05:46:51.337 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:50 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:50.869+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-08-31T05:46:10.191495+0000 front 2024-08-31T05:46:10.191474+0000 (oldest deadline 2024-08-31T05:46:36.091468+0000) 2024-08-31T05:46:51.337 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:50 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:50.869+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.50:6820 osd.7 since back 2024-08-31T05:46:18.392552+0000 front 2024-08-31T05:46:18.392629+0000 (oldest deadline 2024-08-31T05:46:44.192781+0000) 2024-08-31T05:46:51.337 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:50 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:50.869+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6820 osd.8 since back 2024-08-31T05:46:24.193117+0000 front 2024-08-31T05:46:24.193150+0000 (oldest deadline 2024-08-31T05:46:50.093121+0000) 2024-08-31T05:46:52.336 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:51 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:51.860+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-08-31T05:45:20.582594+0000 front 2024-08-31T05:45:20.582727+0000 (oldest deadline 2024-08-31T05:45:43.482623+0000) 2024-08-31T05:46:52.337 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:51 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:51.860+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6804 osd.2 since back 2024-08-31T05:45:38.586285+0000 front 2024-08-31T05:45:38.586392+0000 (oldest deadline 2024-08-31T05:46:03.286480+0000) 2024-08-31T05:46:52.337 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:51 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:51.860+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-08-31T05:45:47.387728+0000 front 2024-08-31T05:45:47.387982+0000 (oldest deadline 2024-08-31T05:46:10.887839+0000) 2024-08-31T05:46:52.337 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:51 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:51.860+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.50:6812 osd.4 since back 2024-08-31T05:45:54.389119+0000 front 2024-08-31T05:45:54.389023+0000 (oldest deadline 2024-08-31T05:46:17.889175+0000) 2024-08-31T05:46:52.337 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:51 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:51.860+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6812 osd.5 since back 2024-08-31T05:46:01.990353+0000 front 2024-08-31T05:46:01.990407+0000 (oldest deadline 2024-08-31T05:46:24.890512+0000) 2024-08-31T05:46:52.338 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:51 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:51.860+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-08-31T05:46:10.191495+0000 front 2024-08-31T05:46:10.191474+0000 (oldest deadline 2024-08-31T05:46:36.091468+0000) 2024-08-31T05:46:52.338 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:51 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:51.860+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.50:6820 osd.7 since back 2024-08-31T05:46:18.392552+0000 front 2024-08-31T05:46:18.392629+0000 (oldest deadline 2024-08-31T05:46:44.192781+0000) 2024-08-31T05:46:52.338 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:51 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11[48516]: 2024-08-31T05:46:51.860+0000 7f32dd0ba640 -1 osd.11 107 heartbeat_check: no reply from 172.21.15.70:6820 osd.8 since back 2024-08-31T05:46:24.193117+0000 front 2024-08-31T05:46:24.193150+0000 (oldest deadline 2024-08-31T05:46:50.093121+0000) 2024-08-31T05:46:52.774 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:52 smithi070 podman[59692]: 2024-08-31 05:46:52.493180141 +0000 UTC m=+5.614461056 container died f4fd1dfee83c7d45c83c74d899c86ad5e7fd983813ae0bf776ab9c29ae3b1238 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-08-31T05:46:53.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:52 smithi070 podman[59692]: 2024-08-31 05:46:52.871721974 +0000 UTC m=+5.993002888 container cleanup f4fd1dfee83c7d45c83c74d899c86ad5e7fd983813ae0bf776ab9c29ae3b1238 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-08-31T05:46:53.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:52 smithi070 bash[59692]: ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11 2024-08-31T05:46:53.440 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:53 smithi070 podman[59707]: 2024-08-31 05:46:53.131300228 +0000 UTC m=+0.638838413 container remove f4fd1dfee83c7d45c83c74d899c86ad5e7fd983813ae0bf776ab9c29ae3b1238 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11, ceph=True, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-08-31T05:46:53.760 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:53 smithi070 podman[59797]: 2024-08-31 05:46:53.341328666 +0000 UTC m=+0.015312861 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T05:46:53.761 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:53 smithi070 podman[59797]: 2024-08-31 05:46:53.440104082 +0000 UTC m=+0.114088261 container create fe2526357151383f2d78797d6a2bdad0034777b29bceaeffd90543996ea972db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11-deactivate, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-08-31T05:46:53.761 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:53 smithi070 podman[59797]: 2024-08-31 05:46:53.676067366 +0000 UTC m=+0.350051542 container init fe2526357151383f2d78797d6a2bdad0034777b29bceaeffd90543996ea972db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-08-31T05:46:53.761 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:53 smithi070 podman[59797]: 2024-08-31 05:46:53.67924288 +0000 UTC m=+0.353227069 container start fe2526357151383f2d78797d6a2bdad0034777b29bceaeffd90543996ea972db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11-deactivate, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T05:46:53.761 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:53 smithi070 podman[59797]: 2024-08-31 05:46:53.759259157 +0000 UTC m=+0.433243344 container attach fe2526357151383f2d78797d6a2bdad0034777b29bceaeffd90543996ea972db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T05:46:54.086 INFO:journalctl@ceph.osd.11.smithi070.stdout:Aug 31 05:46:53 smithi070 podman[59797]: 2024-08-31 05:46:53.865287476 +0000 UTC m=+0.539271655 container died fe2526357151383f2d78797d6a2bdad0034777b29bceaeffd90543996ea972db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-osd-11-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T05:46:54.465 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@osd.11.service' 2024-08-31T05:46:54.502 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T05:46:54.503 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-08-31T05:46:54.503 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-08-31T05:46:54.503 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-69422704-6758-11ef-bcd4-c7b262605968@mds.a 2024-08-31T05:46:54.812 INFO:journalctl@ceph.mds.a.smithi005.stdout:Aug 31 05:46:54 smithi005 systemd[1]: Stopping Ceph mds.a for 69422704-6758-11ef-bcd4-c7b262605968... 2024-08-31T05:46:55.217 INFO:journalctl@ceph.mds.a.smithi005.stdout:Aug 31 05:46:54 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-a[60842]: 2024-08-31T05:46:54.809+0000 7f9c703ff640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T05:46:55.217 INFO:journalctl@ceph.mds.a.smithi005.stdout:Aug 31 05:46:54 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-a[60842]: 2024-08-31T05:46:54.809+0000 7f9c703ff640 -1 mds.a *** got signal Terminated *** 2024-08-31T05:46:59.217 INFO:journalctl@ceph.mds.a.smithi005.stdout:Aug 31 05:46:58 smithi005 podman[106504]: 2024-08-31 05:46:58.819063834 +0000 UTC m=+4.116939935 container died b2adead453e74cc3f73e08d20bad2034326c2f0573f038049db3f321d219a4f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-a, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T05:46:59.633 INFO:journalctl@ceph.mds.a.smithi005.stdout:Aug 31 05:46:59 smithi005 podman[106504]: 2024-08-31 05:46:59.258904879 +0000 UTC m=+4.556780981 container cleanup b2adead453e74cc3f73e08d20bad2034326c2f0573f038049db3f321d219a4f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-a, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-08-31T05:46:59.633 INFO:journalctl@ceph.mds.a.smithi005.stdout:Aug 31 05:46:59 smithi005 bash[106504]: ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-a 2024-08-31T05:46:59.634 INFO:journalctl@ceph.mds.a.smithi005.stdout:Aug 31 05:46:59 smithi005 podman[106516]: 2024-08-31 05:46:59.428078495 +0000 UTC m=+0.601569120 container remove b2adead453e74cc3f73e08d20bad2034326c2f0573f038049db3f321d219a4f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-a, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T05:46:59.652 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@mds.a.service' 2024-08-31T05:46:59.686 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T05:46:59.686 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-08-31T05:46:59.687 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-08-31T05:46:59.687 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-69422704-6758-11ef-bcd4-c7b262605968@mds.d 2024-08-31T05:46:59.967 INFO:journalctl@ceph.mds.d.smithi005.stdout:Aug 31 05:46:59 smithi005 systemd[1]: Stopping Ceph mds.d for 69422704-6758-11ef-bcd4-c7b262605968... 2024-08-31T05:47:00.467 INFO:journalctl@ceph.mds.d.smithi005.stdout:Aug 31 05:47:00 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-d[59657]: 2024-08-31T05:47:00.021+0000 7fd93cb05640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T05:47:00.467 INFO:journalctl@ceph.mds.d.smithi005.stdout:Aug 31 05:47:00 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-d[59657]: 2024-08-31T05:47:00.021+0000 7fd93cb05640 -1 mds.d *** got signal Terminated *** 2024-08-31T05:47:03.615 INFO:journalctl@ceph.mds.d.smithi005.stdout:Aug 31 05:47:03 smithi005 podman[106626]: 2024-08-31 05:47:03.220658545 +0000 UTC m=+3.311623022 container died abe2903c3fbc67dc1e266b5eb10c9f36768ba1d2400e3a2be2be321f17ee5776 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T05:47:03.616 INFO:journalctl@ceph.mds.d.smithi005.stdout:Aug 31 05:47:03 smithi005 podman[106626]: 2024-08-31 05:47:03.614010213 +0000 UTC m=+3.704974718 container cleanup abe2903c3fbc67dc1e266b5eb10c9f36768ba1d2400e3a2be2be321f17ee5776 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-08-31T05:47:03.967 INFO:journalctl@ceph.mds.d.smithi005.stdout:Aug 31 05:47:03 smithi005 bash[106626]: ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-d 2024-08-31T05:47:03.967 INFO:journalctl@ceph.mds.d.smithi005.stdout:Aug 31 05:47:03 smithi005 podman[106639]: 2024-08-31 05:47:03.848816416 +0000 UTC m=+0.624119830 container remove abe2903c3fbc67dc1e266b5eb10c9f36768ba1d2400e3a2be2be321f17ee5776 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-d, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-08-31T05:47:03.999 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@mds.d.service' 2024-08-31T05:47:04.031 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T05:47:04.031 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-08-31T05:47:04.032 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-08-31T05:47:04.032 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-69422704-6758-11ef-bcd4-c7b262605968@mds.g 2024-08-31T05:47:04.362 INFO:journalctl@ceph.mds.g.smithi005.stdout:Aug 31 05:47:04 smithi005 systemd[1]: Stopping Ceph mds.g for 69422704-6758-11ef-bcd4-c7b262605968... 2024-08-31T05:47:04.717 INFO:journalctl@ceph.mds.g.smithi005.stdout:Aug 31 05:47:04 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-g[60457]: 2024-08-31T05:47:04.359+0000 7f6779d5b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T05:47:04.717 INFO:journalctl@ceph.mds.g.smithi005.stdout:Aug 31 05:47:04 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-g[60457]: 2024-08-31T05:47:04.359+0000 7f6779d5b640 -1 mds.g *** got signal Terminated *** 2024-08-31T05:47:08.004 INFO:journalctl@ceph.mds.g.smithi005.stdout:Aug 31 05:47:07 smithi005 podman[106748]: 2024-08-31 05:47:07.723084779 +0000 UTC m=+3.468126343 container died 1b9c962806830371553d3f1f5cb2e7b8392905e10a181ca5fd1276de8b32894f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-g, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-08-31T05:47:08.345 INFO:journalctl@ceph.mds.g.smithi005.stdout:Aug 31 05:47:08 smithi005 podman[106748]: 2024-08-31 05:47:08.101487135 +0000 UTC m=+3.846528697 container cleanup 1b9c962806830371553d3f1f5cb2e7b8392905e10a181ca5fd1276de8b32894f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-g, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-08-31T05:47:08.346 INFO:journalctl@ceph.mds.g.smithi005.stdout:Aug 31 05:47:08 smithi005 bash[106748]: ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-g 2024-08-31T05:47:08.501 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@mds.g.service' 2024-08-31T05:47:08.533 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T05:47:08.533 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-08-31T05:47:08.533 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-08-31T05:47:08.533 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-69422704-6758-11ef-bcd4-c7b262605968@mds.j 2024-08-31T05:47:08.967 INFO:journalctl@ceph.mds.j.smithi005.stdout:Aug 31 05:47:08 smithi005 systemd[1]: Stopping Ceph mds.j for 69422704-6758-11ef-bcd4-c7b262605968... 2024-08-31T05:47:08.967 INFO:journalctl@ceph.mds.j.smithi005.stdout:Aug 31 05:47:08 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-j[59262]: 2024-08-31T05:47:08.846+0000 7f7a17de1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T05:47:08.967 INFO:journalctl@ceph.mds.j.smithi005.stdout:Aug 31 05:47:08 smithi005 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-j[59262]: 2024-08-31T05:47:08.846+0000 7f7a17de1640 -1 mds.j *** got signal Terminated *** 2024-08-31T05:47:11.541 INFO:journalctl@ceph.mds.j.smithi005.stdout:Aug 31 05:47:11 smithi005 podman[106868]: 2024-08-31 05:47:11.260868796 +0000 UTC m=+2.508317104 container died 79c435f3a5b958143ff7cc7c0074bee8a93a93f77b1edcee18ca983169ab91ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-j, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-08-31T05:47:11.874 INFO:journalctl@ceph.mds.j.smithi005.stdout:Aug 31 05:47:11 smithi005 podman[106868]: 2024-08-31 05:47:11.638453523 +0000 UTC m=+2.885901832 container cleanup 79c435f3a5b958143ff7cc7c0074bee8a93a93f77b1edcee18ca983169ab91ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-j, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-08-31T05:47:11.874 INFO:journalctl@ceph.mds.j.smithi005.stdout:Aug 31 05:47:11 smithi005 bash[106868]: ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-j 2024-08-31T05:47:12.002 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@mds.j.service' 2024-08-31T05:47:12.037 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T05:47:12.037 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-08-31T05:47:12.037 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-08-31T05:47:12.038 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-69422704-6758-11ef-bcd4-c7b262605968@mds.b 2024-08-31T05:47:12.336 INFO:journalctl@ceph.mds.b.smithi050.stdout:Aug 31 05:47:12 smithi050 systemd[1]: Stopping Ceph mds.b for 69422704-6758-11ef-bcd4-c7b262605968... 2024-08-31T05:47:12.620 INFO:journalctl@ceph.mds.b.smithi050.stdout:Aug 31 05:47:12 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-b[53599]: 2024-08-31T05:47:12.333+0000 7fc8b82f6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T05:47:12.620 INFO:journalctl@ceph.mds.b.smithi050.stdout:Aug 31 05:47:12 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-b[53599]: 2024-08-31T05:47:12.333+0000 7fc8b82f6640 -1 mds.b *** got signal Terminated *** 2024-08-31T05:47:16.019 INFO:journalctl@ceph.mds.b.smithi050.stdout:Aug 31 05:47:15 smithi050 podman[60654]: 2024-08-31 05:47:15.737620983 +0000 UTC m=+3.503824912 container died 415dd5033240e50544bc300f727d7c2f41e7d1e0a19ea8514b997fb2aeb1c693 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1) 2024-08-31T05:47:16.378 INFO:journalctl@ceph.mds.b.smithi050.stdout:Aug 31 05:47:16 smithi050 podman[60654]: 2024-08-31 05:47:16.125800213 +0000 UTC m=+3.892004130 container cleanup 415dd5033240e50544bc300f727d7c2f41e7d1e0a19ea8514b997fb2aeb1c693 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-b, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.1) 2024-08-31T05:47:16.378 INFO:journalctl@ceph.mds.b.smithi050.stdout:Aug 31 05:47:16 smithi050 bash[60654]: ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-b 2024-08-31T05:47:16.563 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@mds.b.service' 2024-08-31T05:47:16.597 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T05:47:16.598 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-08-31T05:47:16.598 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-08-31T05:47:16.598 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-69422704-6758-11ef-bcd4-c7b262605968@mds.e 2024-08-31T05:47:16.923 INFO:journalctl@ceph.mds.e.smithi050.stdout:Aug 31 05:47:16 smithi050 systemd[1]: Stopping Ceph mds.e for 69422704-6758-11ef-bcd4-c7b262605968... 2024-08-31T05:47:17.407 INFO:journalctl@ceph.mds.e.smithi050.stdout:Aug 31 05:47:16 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-e[52981]: 2024-08-31T05:47:16.921+0000 7f89b5544640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T05:47:17.407 INFO:journalctl@ceph.mds.e.smithi050.stdout:Aug 31 05:47:16 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-e[52981]: 2024-08-31T05:47:16.921+0000 7f89b5544640 -1 mds.e *** got signal Terminated *** 2024-08-31T05:47:20.001 INFO:journalctl@ceph.mds.e.smithi050.stdout:Aug 31 05:47:19 smithi050 podman[60785]: 2024-08-31 05:47:19.742630815 +0000 UTC m=+2.926536491 container died d52661ba868e0339c8120adf33977cb9a21122c553f3a617e9a0f72c0ccebec6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T05:47:20.374 INFO:journalctl@ceph.mds.e.smithi050.stdout:Aug 31 05:47:20 smithi050 podman[60785]: 2024-08-31 05:47:20.096862414 +0000 UTC m=+3.280768080 container cleanup d52661ba868e0339c8120adf33977cb9a21122c553f3a617e9a0f72c0ccebec6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-e, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-08-31T05:47:20.374 INFO:journalctl@ceph.mds.e.smithi050.stdout:Aug 31 05:47:20 smithi050 bash[60785]: ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-e 2024-08-31T05:47:20.553 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@mds.e.service' 2024-08-31T05:47:20.586 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T05:47:20.586 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-08-31T05:47:20.587 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-08-31T05:47:20.587 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-69422704-6758-11ef-bcd4-c7b262605968@mds.h 2024-08-31T05:47:20.907 INFO:journalctl@ceph.mds.h.smithi050.stdout:Aug 31 05:47:20 smithi050 systemd[1]: Stopping Ceph mds.h for 69422704-6758-11ef-bcd4-c7b262605968... 2024-08-31T05:47:21.407 INFO:journalctl@ceph.mds.h.smithi050.stdout:Aug 31 05:47:20 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-h[53283]: 2024-08-31T05:47:20.908+0000 7f1422082640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T05:47:21.407 INFO:journalctl@ceph.mds.h.smithi050.stdout:Aug 31 05:47:20 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-h[53283]: 2024-08-31T05:47:20.908+0000 7f1422082640 -1 mds.h *** got signal Terminated *** 2024-08-31T05:47:24.002 INFO:journalctl@ceph.mds.h.smithi050.stdout:Aug 31 05:47:23 smithi050 podman[60909]: 2024-08-31 05:47:23.726622365 +0000 UTC m=+2.920932545 container died fb36ada1d4ac26c3279536cb5f30a597cd1b314733dc2ef8cf2bc72e75bcf71e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-h, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-08-31T05:47:24.345 INFO:journalctl@ceph.mds.h.smithi050.stdout:Aug 31 05:47:24 smithi050 podman[60909]: 2024-08-31 05:47:24.109074054 +0000 UTC m=+3.303384236 container cleanup fb36ada1d4ac26c3279536cb5f30a597cd1b314733dc2ef8cf2bc72e75bcf71e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-h, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-08-31T05:47:24.345 INFO:journalctl@ceph.mds.h.smithi050.stdout:Aug 31 05:47:24 smithi050 bash[60909]: ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-h 2024-08-31T05:47:24.488 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@mds.h.service' 2024-08-31T05:47:24.520 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T05:47:24.520 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-08-31T05:47:24.521 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-08-31T05:47:24.521 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ceph-69422704-6758-11ef-bcd4-c7b262605968@mds.k 2024-08-31T05:47:24.907 INFO:journalctl@ceph.mds.k.smithi050.stdout:Aug 31 05:47:24 smithi050 systemd[1]: Stopping Ceph mds.k for 69422704-6758-11ef-bcd4-c7b262605968... 2024-08-31T05:47:24.907 INFO:journalctl@ceph.mds.k.smithi050.stdout:Aug 31 05:47:24 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-k[52669]: 2024-08-31T05:47:24.845+0000 7f9ddc431640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T05:47:24.907 INFO:journalctl@ceph.mds.k.smithi050.stdout:Aug 31 05:47:24 smithi050 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-k[52669]: 2024-08-31T05:47:24.845+0000 7f9ddc431640 -1 mds.k *** got signal Terminated *** 2024-08-31T05:47:27.982 INFO:journalctl@ceph.mds.k.smithi050.stdout:Aug 31 05:47:27 smithi050 podman[61029]: 2024-08-31 05:47:27.724185893 +0000 UTC m=+2.982102271 container died 7dea81a4f4a0313db8e618533dd6f544228a08363180bef2dbe3d1fa34eac3d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-k, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-08-31T05:47:28.241 INFO:journalctl@ceph.mds.k.smithi050.stdout:Aug 31 05:47:28 smithi050 podman[61029]: 2024-08-31 05:47:28.071909052 +0000 UTC m=+3.329825429 container cleanup 7dea81a4f4a0313db8e618533dd6f544228a08363180bef2dbe3d1fa34eac3d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-k, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS) 2024-08-31T05:47:28.241 INFO:journalctl@ceph.mds.k.smithi050.stdout:Aug 31 05:47:28 smithi050 bash[61029]: ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-k 2024-08-31T05:47:28.493 INFO:journalctl@ceph.mds.k.smithi050.stdout:Aug 31 05:47:28 smithi050 podman[61041]: 2024-08-31 05:47:28.239637736 +0000 UTC m=+0.508467188 container remove 7dea81a4f4a0313db8e618533dd6f544228a08363180bef2dbe3d1fa34eac3d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-k, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-08-31T05:47:28.496 DEBUG:teuthology.orchestra.run.smithi050:> sudo pkill -f 'journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@mds.k.service' 2024-08-31T05:47:28.529 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T05:47:28.529 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-08-31T05:47:28.529 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-08-31T05:47:28.529 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-69422704-6758-11ef-bcd4-c7b262605968@mds.c 2024-08-31T05:47:28.836 INFO:journalctl@ceph.mds.c.smithi070.stdout:Aug 31 05:47:28 smithi070 systemd[1]: Stopping Ceph mds.c for 69422704-6758-11ef-bcd4-c7b262605968... 2024-08-31T05:47:29.088 INFO:journalctl@ceph.mds.c.smithi070.stdout:Aug 31 05:47:28 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-c[53513]: 2024-08-31T05:47:28.925+0000 7fd46b46b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T05:47:29.089 INFO:journalctl@ceph.mds.c.smithi070.stdout:Aug 31 05:47:28 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-c[53513]: 2024-08-31T05:47:28.925+0000 7fd46b46b640 -1 mds.c *** got signal Terminated *** 2024-08-31T05:47:32.136 INFO:journalctl@ceph.mds.c.smithi070.stdout:Aug 31 05:47:31 smithi070 podman[59898]: 2024-08-31 05:47:31.863913919 +0000 UTC m=+3.143307998 container died 94cd21a2ad6f6bf0bb20a66b487f7cfe5031493ba2cb2d54a6531b39992f6934 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-c, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-08-31T05:47:32.477 INFO:journalctl@ceph.mds.c.smithi070.stdout:Aug 31 05:47:32 smithi070 podman[59898]: 2024-08-31 05:47:32.24185085 +0000 UTC m=+3.521244928 container cleanup 94cd21a2ad6f6bf0bb20a66b487f7cfe5031493ba2cb2d54a6531b39992f6934 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1) 2024-08-31T05:47:32.477 INFO:journalctl@ceph.mds.c.smithi070.stdout:Aug 31 05:47:32 smithi070 bash[59898]: ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-c 2024-08-31T05:47:32.628 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@mds.c.service' 2024-08-31T05:47:32.662 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T05:47:32.663 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-08-31T05:47:32.663 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-08-31T05:47:32.663 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-69422704-6758-11ef-bcd4-c7b262605968@mds.f 2024-08-31T05:47:32.989 INFO:journalctl@ceph.mds.f.smithi070.stdout:Aug 31 05:47:32 smithi070 systemd[1]: Stopping Ceph mds.f for 69422704-6758-11ef-bcd4-c7b262605968... 2024-08-31T05:47:33.336 INFO:journalctl@ceph.mds.f.smithi070.stdout:Aug 31 05:47:32 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-f[53213]: 2024-08-31T05:47:32.987+0000 7f652da45640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T05:47:33.336 INFO:journalctl@ceph.mds.f.smithi070.stdout:Aug 31 05:47:32 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-f[53213]: 2024-08-31T05:47:32.987+0000 7f652da45640 -1 mds.f *** got signal Terminated *** 2024-08-31T05:47:36.072 INFO:journalctl@ceph.mds.f.smithi070.stdout:Aug 31 05:47:35 smithi070 podman[60028]: 2024-08-31 05:47:35.785862852 +0000 UTC m=+2.911958054 container died 5ec2d22fd65e8f74ecafd2690c0bb8ce3360cb976ce90ab276753d851a7db959 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-f, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T05:47:36.336 INFO:journalctl@ceph.mds.f.smithi070.stdout:Aug 31 05:47:36 smithi070 podman[60028]: 2024-08-31 05:47:36.153636542 +0000 UTC m=+3.279731743 container cleanup 5ec2d22fd65e8f74ecafd2690c0bb8ce3360cb976ce90ab276753d851a7db959 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-08-31T05:47:36.336 INFO:journalctl@ceph.mds.f.smithi070.stdout:Aug 31 05:47:36 smithi070 bash[60028]: ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-f 2024-08-31T05:47:36.559 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@mds.f.service' 2024-08-31T05:47:36.593 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T05:47:36.593 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-08-31T05:47:36.593 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-08-31T05:47:36.594 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-69422704-6758-11ef-bcd4-c7b262605968@mds.i 2024-08-31T05:47:36.836 INFO:journalctl@ceph.mds.i.smithi070.stdout:Aug 31 05:47:36 smithi070 systemd[1]: Stopping Ceph mds.i for 69422704-6758-11ef-bcd4-c7b262605968... 2024-08-31T05:47:37.336 INFO:journalctl@ceph.mds.i.smithi070.stdout:Aug 31 05:47:36 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-i[53824]: 2024-08-31T05:47:36.931+0000 7fd2fee45640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T05:47:37.336 INFO:journalctl@ceph.mds.i.smithi070.stdout:Aug 31 05:47:36 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-i[53824]: 2024-08-31T05:47:36.931+0000 7fd2fee45640 -1 mds.i *** got signal Terminated *** 2024-08-31T05:47:39.836 INFO:journalctl@ceph.mds.i.smithi070.stdout:Aug 31 05:47:39 smithi070 podman[60150]: 2024-08-31 05:47:39.788033915 +0000 UTC m=+2.982868486 container died 56cfe73b724b6cf943cfc56600502409918bd751ae5df4f99094babf793cb0c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-i, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1) 2024-08-31T05:47:40.559 INFO:journalctl@ceph.mds.i.smithi070.stdout:Aug 31 05:47:40 smithi070 podman[60150]: 2024-08-31 05:47:40.240508021 +0000 UTC m=+3.435342592 container cleanup 56cfe73b724b6cf943cfc56600502409918bd751ae5df4f99094babf793cb0c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-i, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True) 2024-08-31T05:47:40.559 INFO:journalctl@ceph.mds.i.smithi070.stdout:Aug 31 05:47:40 smithi070 bash[60150]: ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-i 2024-08-31T05:47:40.709 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@mds.i.service' 2024-08-31T05:47:40.741 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T05:47:40.742 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-08-31T05:47:40.742 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-08-31T05:47:40.742 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-69422704-6758-11ef-bcd4-c7b262605968@mds.l 2024-08-31T05:47:41.086 INFO:journalctl@ceph.mds.l.smithi070.stdout:Aug 31 05:47:40 smithi070 systemd[1]: Stopping Ceph mds.l for 69422704-6758-11ef-bcd4-c7b262605968... 2024-08-31T05:47:41.086 INFO:journalctl@ceph.mds.l.smithi070.stdout:Aug 31 05:47:41 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-l[52910]: 2024-08-31T05:47:41.060+0000 7f55c8b53640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T05:47:41.086 INFO:journalctl@ceph.mds.l.smithi070.stdout:Aug 31 05:47:41 smithi070 ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-l[52910]: 2024-08-31T05:47:41.060+0000 7f55c8b53640 -1 mds.l *** got signal Terminated *** 2024-08-31T05:47:44.086 INFO:journalctl@ceph.mds.l.smithi070.stdout:Aug 31 05:47:43 smithi070 podman[60269]: 2024-08-31 05:47:43.766186877 +0000 UTC m=+2.811229243 container died 4fff19ffe3caad705972df9cc88114f332126bb8d22290caf1e0859042c63640 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-08-31T05:47:44.705 INFO:journalctl@ceph.mds.l.smithi070.stdout:Aug 31 05:47:44 smithi070 podman[60269]: 2024-08-31 05:47:44.469227995 +0000 UTC m=+3.514270361 container cleanup 4fff19ffe3caad705972df9cc88114f332126bb8d22290caf1e0859042c63640 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-l, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T05:47:44.705 INFO:journalctl@ceph.mds.l.smithi070.stdout:Aug 31 05:47:44 smithi070 bash[60269]: ceph-69422704-6758-11ef-bcd4-c7b262605968-mds-l 2024-08-31T05:47:44.830 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-69422704-6758-11ef-bcd4-c7b262605968@mds.l.service' 2024-08-31T05:47:44.861 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T05:47:44.862 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-08-31T05:47:44.862 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 69422704-6758-11ef-bcd4-c7b262605968 --force --keep-logs 2024-08-31T05:47:45.072 INFO:teuthology.orchestra.run.smithi005.stdout:Deleting cluster with fsid: 69422704-6758-11ef-bcd4-c7b262605968 2024-08-31T05:47:47.389 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 69422704-6758-11ef-bcd4-c7b262605968 --force --keep-logs 2024-08-31T05:47:47.598 INFO:teuthology.orchestra.run.smithi050.stdout:Deleting cluster with fsid: 69422704-6758-11ef-bcd4-c7b262605968 2024-08-31T05:47:50.127 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 69422704-6758-11ef-bcd4-c7b262605968 --force --keep-logs 2024-08-31T05:47:50.330 INFO:teuthology.orchestra.run.smithi070.stdout:Deleting cluster with fsid: 69422704-6758-11ef-bcd4-c7b262605968 2024-08-31T05:47:52.805 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-31T05:47:52.837 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-31T05:47:52.872 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-31T05:47:52.898 INFO:tasks.cephadm:Archiving crash dumps... 2024-08-31T05:47:52.900 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/crash to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881348/remote/smithi005/crash 2024-08-31T05:47:52.901 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/crash -- . 2024-08-31T05:47:52.939 INFO:teuthology.orchestra.run.smithi005.stderr:tar: /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/crash: Cannot open: No such file or directory 2024-08-31T05:47:52.940 INFO:teuthology.orchestra.run.smithi005.stderr:tar: Error is not recoverable: exiting now 2024-08-31T05:47:52.941 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/crash to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881348/remote/smithi050/crash 2024-08-31T05:47:52.942 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/crash -- . 2024-08-31T05:47:52.990 INFO:teuthology.orchestra.run.smithi050.stderr:tar: /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/crash: Cannot open: No such file or directory 2024-08-31T05:47:52.990 INFO:teuthology.orchestra.run.smithi050.stderr:tar: Error is not recoverable: exiting now 2024-08-31T05:47:52.992 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/crash to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881348/remote/smithi070/crash 2024-08-31T05:47:52.993 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/crash -- . 2024-08-31T05:47:53.031 INFO:teuthology.orchestra.run.smithi070.stderr:tar: /var/lib/ceph/69422704-6758-11ef-bcd4-c7b262605968/crash: Cannot open: No such file or directory 2024-08-31T05:47:53.031 INFO:teuthology.orchestra.run.smithi070.stderr:tar: Error is not recoverable: exiting now 2024-08-31T05:47:53.032 INFO:tasks.cephadm:Checking cluster log for badness... 2024-08-31T05:47:53.033 DEBUG:teuthology.orchestra.run.smithi005:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-08-31T05:47:53.069 INFO:tasks.cephadm:Compressing logs... 2024-08-31T05:47:53.070 DEBUG:teuthology.orchestra.run.smithi005:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-31T05:47:53.113 DEBUG:teuthology.orchestra.run.smithi050:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-31T05:47:53.115 DEBUG:teuthology.orchestra.run.smithi070:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-31T05:47:53.137 INFO:teuthology.orchestra.run.smithi005.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-08-31T05:47:53.138 INFO:teuthology.orchestra.run.smithi005.stderr:: No such file or directory 2024-08-31T05:47:53.138 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-osd.0.log 2024-08-31T05:47:53.138 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-osd.9.log 2024-08-31T05:47:53.138 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-volume.log 2024-08-31T05:47:53.141 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph.audit.log 2024-08-31T05:47:53.141 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-mds.a.log 2024-08-31T05:47:53.141 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph.audit.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-08-31T05:47:53.141 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph.cephadm.log 2024-08-31T05:47:53.141 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-mon.a.log 2024-08-31T05:47:53.141 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-mds.a.log: /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-mds.g.log 2024-08-31T05:47:53.142 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-mon.a.log: 84.4% -- replaced with /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph.cephadm.log.gz 2024-08-31T05:47:53.142 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-osd.6.log 2024-08-31T05:47:53.142 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-mds.g.log: 90.1% -- replaced with /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph.audit.log.gz 2024-08-31T05:47:53.143 INFO:teuthology.orchestra.run.smithi050.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-osd.10.log 2024-08-31T05:47:53.143 INFO:teuthology.orchestra.run.smithi050.stderr:: No such file or directory 2024-08-31T05:47:53.144 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-osd.1.log 2024-08-31T05:47:53.144 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-osd.7.log 2024-08-31T05:47:53.144 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-volume.log 2024-08-31T05:47:53.144 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-mds.b.log 2024-08-31T05:47:53.145 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-mds.k.log 2024-08-31T05:47:53.145 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-osd.4.log 2024-08-31T05:47:53.148 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph.audit.log 2024-08-31T05:47:53.148 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph.cephadm.log 2024-08-31T05:47:53.149 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph.audit.log: 90.2% -- replaced with /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph.audit.log.gz 2024-08-31T05:47:53.149 INFO:teuthology.orchestra.run.smithi005.stderr: 90.8% -- replaced with /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-volume.log.gz 2024-08-31T05:47:53.149 INFO:teuthology.orchestra.run.smithi070.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-08-31T05:47:53.151 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-volume.log 2024-08-31T05:47:53.152 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph.audit.log 2024-08-31T05:47:53.152 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-mds.i.log 2024-08-31T05:47:53.152 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-mon.c.log 2024-08-31T05:47:53.154 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph.audit.log: /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph.cephadm.log 2024-08-31T05:47:53.155 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose --/var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-mon.c.log: /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-osd.11.log 2024-08-31T05:47:53.155 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-osd.2.log 2024-08-31T05:47:53.155 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph.cephadm.log: /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-osd.5.log 2024-08-31T05:47:53.155 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph.log 2024-08-31T05:47:53.155 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-osd.2.log: /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-mds.l.log 2024-08-31T05:47:53.155 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-osd.8.log 2024-08-31T05:47:53.155 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-mgr.z.log 2024-08-31T05:47:53.156 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-mds.l.log: /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-mds.c.log 2024-08-31T05:47:53.156 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-mds.f.log 2024-08-31T05:47:53.156 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-08-31T05:47:53.158 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph.log 2024-08-31T05:47:53.158 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-mds.d.log 2024-08-31T05:47:53.158 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-mgr.x.log 2024-08-31T05:47:53.158 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-mds.d.log: 86.7% -- replaced with /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph.log.gz 2024-08-31T05:47:53.159 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-mds.j.log 2024-08-31T05:47:53.159 INFO:teuthology.orchestra.run.smithi050.stderr: 90.8% -- replaced with /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-volume.log.gz 2024-08-31T05:47:53.160 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-mgr.y.log 2024-08-31T05:47:53.161 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph.log 2024-08-31T05:47:53.161 INFO:teuthology.orchestra.run.smithi050.stderr: 81.6% -- replaced with /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph.cephadm.log.gz 2024-08-31T05:47:53.162 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-mds.h.log 2024-08-31T05:47:53.163 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-mgr.x.log: 95.0% -- replaced with /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-mds.d.log.gz 2024-08-31T05:47:53.163 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-osd.3.log 2024-08-31T05:47:53.166 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph.log: 86.7% -- replaced with /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph.log.gz 2024-08-31T05:47:53.166 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-mon.b.log 2024-08-31T05:47:53.169 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-mds.h.log: 92.7% -- replaced with /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-mgr.y.log.gz 2024-08-31T05:47:53.172 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-08-31T05:47:53.173 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-mds.e.log 2024-08-31T05:47:53.175 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-osd.3.log: 95.1% -- replaced with /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-mds.j.log.gz 2024-08-31T05:47:53.183 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-08-31T05:47:53.193 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/cephadm.log: 94.5% -- replaced with /var/log/ceph/cephadm.log.gz 2024-08-31T05:47:53.200 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-08-31T05:47:53.248 INFO:teuthology.orchestra.run.smithi005.stderr: 94.4% -- replaced with /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-mds.g.log.gz 2024-08-31T05:47:53.325 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-mds.c.log: /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 90.8% -- replaced with /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-volume.log.gz 2024-08-31T05:47:53.363 INFO:teuthology.orchestra.run.smithi070.stderr: 81.6% -- replaced with /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph.cephadm.log.gz 2024-08-31T05:47:53.384 INFO:teuthology.orchestra.run.smithi070.stderr: 92.7% -- replaced with /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-mgr.z.log.gz 2024-08-31T05:47:53.566 INFO:teuthology.orchestra.run.smithi070.stderr: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-08-31T05:47:53.571 INFO:teuthology.orchestra.run.smithi070.stderr: 86.7% -- replaced with /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph.log.gz 2024-08-31T05:47:53.590 INFO:teuthology.orchestra.run.smithi005.stderr: 90.3% -- replaced with /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-mgr.x.log.gz 2024-08-31T05:47:53.722 INFO:teuthology.orchestra.run.smithi070.stderr: 90.2% -- replaced with /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph.audit.log.gz 2024-08-31T05:47:53.857 INFO:teuthology.orchestra.run.smithi005.stderr: 95.3% -- replaced with /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-mds.a.log.gz 2024-08-31T05:47:54.115 INFO:teuthology.orchestra.run.smithi050.stderr: 95.0% -- replaced with /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-mds.e.log.gz 2024-08-31T05:47:54.714 INFO:teuthology.orchestra.run.smithi005.stderr: 90.3% -- replaced with /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-mon.a.log.gz 2024-08-31T05:47:54.769 INFO:teuthology.orchestra.run.smithi050.stderr: 93.1% -- replaced with /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-mon.b.log.gz 2024-08-31T05:47:55.028 INFO:teuthology.orchestra.run.smithi070.stderr: 94.2% -- replaced with /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-mds.l.log.gz 2024-08-31T05:48:03.168 INFO:teuthology.orchestra.run.smithi050.stderr: 96.1% -- replaced with /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-mds.b.log.gz 2024-08-31T05:48:03.240 INFO:teuthology.orchestra.run.smithi050.stderr: 96.8% -- replaced with /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-mds.h.log.gz 2024-08-31T05:48:08.733 INFO:teuthology.orchestra.run.smithi070.stderr: 91.7% -- replaced with /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-mon.c.log.gz 2024-08-31T05:48:13.027 INFO:teuthology.orchestra.run.smithi050.stderr: 95.3% -- replaced with /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-mds.k.log.gz 2024-08-31T05:48:17.885 INFO:teuthology.orchestra.run.smithi005.stderr: 91.9% -- replaced with /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-osd.0.log.gz 2024-08-31T05:48:18.016 INFO:teuthology.orchestra.run.smithi050.stderr: 91.7% -- replaced with /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-osd.10.log.gz 2024-08-31T05:48:20.204 INFO:teuthology.orchestra.run.smithi050.stderr: 91.9% -- replaced with /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-osd.1.log.gz 2024-08-31T05:48:21.979 INFO:teuthology.orchestra.run.smithi005.stderr: 91.3% -- replaced with /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-osd.6.log.gz 2024-08-31T05:48:24.267 INFO:teuthology.orchestra.run.smithi005.stderr: 91.6% -- replaced with /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-osd.3.log.gz 2024-08-31T05:48:24.443 INFO:teuthology.orchestra.run.smithi050.stderr: 91.6% -- replaced with /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-osd.7.log.gz 2024-08-31T05:48:27.268 INFO:teuthology.orchestra.run.smithi005.stderr: 91.4% -- replaced with /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-osd.9.log.gz 2024-08-31T05:48:27.271 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-08-31T05:48:27.271 INFO:teuthology.orchestra.run.smithi005.stderr:real 0m34.144s 2024-08-31T05:48:27.271 INFO:teuthology.orchestra.run.smithi005.stderr:user 1m57.997s 2024-08-31T05:48:27.271 INFO:teuthology.orchestra.run.smithi005.stderr:sys 0m3.482s 2024-08-31T05:48:31.188 INFO:teuthology.orchestra.run.smithi050.stderr: 91.4% -- replaced with /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-osd.4.log.gz 2024-08-31T05:48:31.191 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-08-31T05:48:31.191 INFO:teuthology.orchestra.run.smithi050.stderr:real 0m38.060s 2024-08-31T05:48:31.191 INFO:teuthology.orchestra.run.smithi050.stderr:user 2m37.965s 2024-08-31T05:48:31.191 INFO:teuthology.orchestra.run.smithi050.stderr:sys 0m4.577s 2024-08-31T05:52:00.517 INFO:teuthology.orchestra.run.smithi070.stderr: 94.6% -- replaced with /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-mds.i.log.gz 2024-08-31T05:52:42.233 INFO:teuthology.orchestra.run.smithi070.stderr: 91.5% -- replaced with /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-osd.2.log.gz 2024-08-31T05:53:21.046 INFO:teuthology.orchestra.run.smithi070.stderr: 91.5% -- replaced with /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-osd.11.log.gz 2024-08-31T05:53:24.076 INFO:teuthology.orchestra.run.smithi070.stderr: 91.3% -- replaced with /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-osd.8.log.gz 2024-08-31T05:53:43.449 INFO:teuthology.orchestra.run.smithi070.stderr: 94.7% -- replaced with /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-mds.f.log.gz 2024-08-31T05:54:39.362 INFO:teuthology.orchestra.run.smithi070.stderr: 91.2% -- replaced with /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-osd.5.log.gz 2024-08-31T05:59:41.920 INFO:teuthology.orchestra.run.smithi070.stderr: 93.2% -- replaced with /var/log/ceph/69422704-6758-11ef-bcd4-c7b262605968/ceph-mds.c.log.gz 2024-08-31T05:59:41.922 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-08-31T05:59:41.922 INFO:teuthology.orchestra.run.smithi070.stderr:real 11m48.792s 2024-08-31T05:59:41.922 INFO:teuthology.orchestra.run.smithi070.stderr:user 7m42.936s 2024-08-31T05:59:41.922 INFO:teuthology.orchestra.run.smithi070.stderr:sys 0m18.778s 2024-08-31T05:59:41.923 INFO:tasks.cephadm:Archiving logs... 2024-08-31T05:59:41.924 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881348/remote/smithi005/log 2024-08-31T05:59:41.925 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-31T06:00:00.369 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881348/remote/smithi050/log 2024-08-31T06:00:00.370 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-31T06:00:20.011 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881348/remote/smithi070/log 2024-08-31T06:00:20.012 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-31T06:01:31.918 INFO:tasks.cephadm:Removing cluster... 2024-08-31T06:01:31.918 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 69422704-6758-11ef-bcd4-c7b262605968 --force 2024-08-31T06:01:32.130 INFO:teuthology.orchestra.run.smithi005.stdout:Deleting cluster with fsid: 69422704-6758-11ef-bcd4-c7b262605968 2024-08-31T06:01:32.569 DEBUG:teuthology.orchestra.run.smithi050:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 69422704-6758-11ef-bcd4-c7b262605968 --force 2024-08-31T06:01:32.782 INFO:teuthology.orchestra.run.smithi050.stdout:Deleting cluster with fsid: 69422704-6758-11ef-bcd4-c7b262605968 2024-08-31T06:01:33.226 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 69422704-6758-11ef-bcd4-c7b262605968 --force 2024-08-31T06:01:33.622 INFO:teuthology.orchestra.run.smithi070.stdout:Deleting cluster with fsid: 69422704-6758-11ef-bcd4-c7b262605968 2024-08-31T06:01:34.264 INFO:tasks.cephadm:Removing cephadm ... 2024-08-31T06:01:34.264 DEBUG:teuthology.orchestra.run.smithi005:> rm -rf /home/ubuntu/cephtest/cephadm 2024-08-31T06:01:34.284 DEBUG:teuthology.orchestra.run.smithi050:> rm -rf /home/ubuntu/cephtest/cephadm 2024-08-31T06:01:34.303 DEBUG:teuthology.orchestra.run.smithi070:> rm -rf /home/ubuntu/cephtest/cephadm 2024-08-31T06:01:34.319 INFO:tasks.cephadm:Teardown complete 2024-08-31T06:01:34.319 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-08-31T06:01:34.330 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-08-31T06:01:34.330 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-31T06:01:34.333 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-31T06:01:34.345 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-31T06:01:34.479 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-08-31T06:01:34.489 INFO:teuthology.task.clock:Checking final clock skew... 2024-08-31T06:01:34.490 DEBUG:teuthology.orchestra.run.smithi005:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-31T06:01:34.493 DEBUG:teuthology.orchestra.run.smithi050:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-31T06:01:34.495 DEBUG:teuthology.orchestra.run.smithi070:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-31T06:01:34.507 INFO:teuthology.orchestra.run.smithi005.stderr:bash: line 1: ntpq: command not found 2024-08-31T06:01:34.509 INFO:teuthology.orchestra.run.smithi050.stderr:bash: line 1: ntpq: command not found 2024-08-31T06:01:34.510 INFO:teuthology.orchestra.run.smithi070.stderr:bash: line 1: ntpq: command not found 2024-08-31T06:01:34.512 INFO:teuthology.orchestra.run.smithi005.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-31T06:01:34.513 INFO:teuthology.orchestra.run.smithi005.stdout:=============================================================================== 2024-08-31T06:01:34.513 INFO:teuthology.orchestra.run.smithi005.stdout:^* hv01.front.sepia.ceph.com 3 6 377 60 -306us[ -284us] +/- 42ms 2024-08-31T06:01:34.513 INFO:teuthology.orchestra.run.smithi005.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 63 +194us[ +216us] +/- 64ms 2024-08-31T06:01:34.513 INFO:teuthology.orchestra.run.smithi005.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 60 +316us[ +316us] +/- 64ms 2024-08-31T06:01:34.513 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T06:01:34.515 INFO:teuthology.orchestra.run.smithi050.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-31T06:01:34.515 INFO:teuthology.orchestra.run.smithi050.stdout:=============================================================================== 2024-08-31T06:01:34.515 INFO:teuthology.orchestra.run.smithi050.stdout:^* hv01.front.sepia.ceph.com 3 6 377 58 -315us[ -300us] +/- 42ms 2024-08-31T06:01:34.515 INFO:teuthology.orchestra.run.smithi050.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 58 +190us[ +190us] +/- 64ms 2024-08-31T06:01:34.516 INFO:teuthology.orchestra.run.smithi050.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 58 +306us[ +322us] +/- 64ms 2024-08-31T06:01:34.516 INFO:teuthology.orchestra.run.smithi050.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T06:01:34.535 INFO:teuthology.orchestra.run.smithi070.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-31T06:01:34.536 INFO:teuthology.orchestra.run.smithi070.stdout:=============================================================================== 2024-08-31T06:01:34.536 INFO:teuthology.orchestra.run.smithi070.stdout:^* hv01.front.sepia.ceph.com 3 6 377 61 -312us[ -316us] +/- 42ms 2024-08-31T06:01:34.536 INFO:teuthology.orchestra.run.smithi070.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 60 +185us[ +185us] +/- 64ms 2024-08-31T06:01:34.536 INFO:teuthology.orchestra.run.smithi070.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 59 +290us[ +290us] +/- 64ms 2024-08-31T06:01:34.536 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T06:01:34.537 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-08-31T06:01:34.547 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-08-31T06:01:34.548 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-08-31T06:01:34.558 DEBUG:teuthology.orchestra.run.smithi005:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-31T06:01:34.638 DEBUG:teuthology.orchestra.run.smithi050:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-31T06:01:34.700 DEBUG:teuthology.orchestra.run.smithi070:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-31T06:01:34.793 DEBUG:teuthology.orchestra.run.smithi005:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-31T06:01:34.823 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T06:01:34.824 DEBUG:teuthology.orchestra.run.smithi050:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-31T06:01:34.854 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T06:01:34.855 DEBUG:teuthology.orchestra.run.smithi070:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-31T06:01:34.881 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T06:01:34.882 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-08-31T06:01:34.893 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-08-31T06:01:34.908 INFO:teuthology.task.internal:Duration was 2853.395104 seconds 2024-08-31T06:01:34.908 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-08-31T06:01:34.919 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-08-31T06:01:34.919 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-31T06:01:34.922 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-31T06:01:34.924 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-31T06:01:34.963 INFO:teuthology.orchestra.run.smithi005.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-31T06:01:34.965 INFO:teuthology.orchestra.run.smithi050.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-31T06:01:34.984 INFO:teuthology.orchestra.run.smithi070.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-31T06:01:35.453 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-08-31T06:01:35.453 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi005.front.sepia.ceph.com 2024-08-31T06:01:35.454 DEBUG:teuthology.orchestra.run.smithi005:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-31T06:01:35.478 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi050.front.sepia.ceph.com 2024-08-31T06:01:35.479 DEBUG:teuthology.orchestra.run.smithi050:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-31T06:01:35.524 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi070.front.sepia.ceph.com 2024-08-31T06:01:35.524 DEBUG:teuthology.orchestra.run.smithi070:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-31T06:01:35.550 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-08-31T06:01:35.550 DEBUG:teuthology.orchestra.run.smithi005:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-31T06:01:35.553 DEBUG:teuthology.orchestra.run.smithi050:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-31T06:01:35.567 DEBUG:teuthology.orchestra.run.smithi070:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-31T06:01:35.687 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-08-31T06:01:35.687 DEBUG:teuthology.orchestra.run.smithi005:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-31T06:01:35.690 DEBUG:teuthology.orchestra.run.smithi050:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-31T06:01:35.692 DEBUG:teuthology.orchestra.run.smithi070:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-31T06:01:37.064 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-08-31T06:01:37.076 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-08-31T06:01:37.077 DEBUG:teuthology.orchestra.run.smithi005:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-31T06:01:37.101 DEBUG:teuthology.orchestra.run.smithi050:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-31T06:01:37.131 DEBUG:teuthology.orchestra.run.smithi070:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-31T06:01:37.162 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-08-31T06:01:37.173 DEBUG:teuthology.orchestra.run.smithi005:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-31T06:01:37.176 DEBUG:teuthology.orchestra.run.smithi050:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-31T06:01:37.178 DEBUG:teuthology.orchestra.run.smithi070:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-31T06:01:37.196 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern = core 2024-08-31T06:01:37.203 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = core 2024-08-31T06:01:37.244 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern = core 2024-08-31T06:01:37.267 DEBUG:teuthology.orchestra.run.smithi005:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-31T06:01:37.281 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T06:01:37.282 DEBUG:teuthology.orchestra.run.smithi050:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-31T06:01:37.297 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T06:01:37.298 DEBUG:teuthology.orchestra.run.smithi070:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-31T06:01:37.324 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T06:01:37.324 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-08-31T06:01:37.336 INFO:teuthology.task.internal:Transferring archived files... 2024-08-31T06:01:37.337 DEBUG:teuthology.misc:Transferring archived files from smithi005:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881348/remote/smithi005 2024-08-31T06:01:37.338 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-31T06:01:37.397 DEBUG:teuthology.misc:Transferring archived files from smithi050:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881348/remote/smithi050 2024-08-31T06:01:37.397 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-31T06:01:37.432 DEBUG:teuthology.misc:Transferring archived files from smithi070:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881348/remote/smithi070 2024-08-31T06:01:37.433 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-31T06:01:37.468 INFO:teuthology.task.internal:Removing archive directory... 2024-08-31T06:01:37.469 DEBUG:teuthology.orchestra.run.smithi005:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-31T06:01:37.471 DEBUG:teuthology.orchestra.run.smithi050:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-31T06:01:37.474 DEBUG:teuthology.orchestra.run.smithi070:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-31T06:01:37.520 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-08-31T06:01:37.533 INFO:teuthology.task.internal:Not uploading archives. 2024-08-31T06:01:37.533 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-08-31T06:01:37.544 INFO:teuthology.task.internal:Tidying up after the test... 2024-08-31T06:01:37.544 DEBUG:teuthology.orchestra.run.smithi005:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-31T06:01:37.547 DEBUG:teuthology.orchestra.run.smithi050:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-31T06:01:37.549 DEBUG:teuthology.orchestra.run.smithi070:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-31T06:01:37.559 INFO:teuthology.orchestra.run.smithi005.stdout: 262217 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 31 06:01 /home/ubuntu/cephtest 2024-08-31T06:01:37.563 INFO:teuthology.orchestra.run.smithi050.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 31 06:01 /home/ubuntu/cephtest 2024-08-31T06:01:37.577 INFO:teuthology.orchestra.run.smithi070.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 31 06:01 /home/ubuntu/cephtest 2024-08-31T06:01:37.578 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-08-31T06:01:37.592 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-08-31T06:01:37.620 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/suites/dbench}} duration: 2853.395104408264 failure_reason: 'Command failed (workunit test suites/dbench.sh) on smithi005 with status 1: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d19e6118f7015f0047264006cb0c873528eb3ae6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh''' flavor: default owner: scheduled_mchangir@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=dcdfb20cc38047a19171386137633f0f status: fail success: false 2024-08-31T06:01:37.620 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-31T06:01:37.707 INFO:teuthology.run:FAIL